2024-09-17T03:23:02.623 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T03:23:02.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T03:23:02.738 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/scrub} email: pdonnell@redhat.com first_in_suite: false job_id: '7908445' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mds: mds cache max size: 1000 mds log max segments: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBADnoF2CPF7jCZQC9bVe0lwBdm7apOX/ueWX5V3KCOQoNfe6vKILvziZZt0430tVW9H1JEiesUIYgNnzLGIJCqA= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFPxxumItLZ7a8+dE4pvjbv3ZDiZG6IHG9Q5LwqJ+FQin45kzhkb4KBAOKEBGqCQbcluMdPurQ28zb0CRjHt0xU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T03:23:02.738 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T03:23:02.738 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T03:23:02.739 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T03:23:02.740 INFO:teuthology.task.internal:Checking packages... 2024-09-17T03:23:02.764 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T03:23:02.764 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T03:23:02.764 INFO:teuthology.packaging:ref: None 2024-09-17T03:23:02.764 INFO:teuthology.packaging:tag: None 2024-09-17T03:23:02.764 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T03:23:02.765 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:23:02.765 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T03:23:02.903 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T03:23:02.910 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T03:23:02.917 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T03:23:02.917 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T03:23:02.929 INFO:teuthology.task.internal:Saving configuration 2024-09-17T03:23:02.949 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T03:23:02.958 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T03:23:02.984 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 03:17:43.046104', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBADnoF2CPF7jCZQC9bVe0lwBdm7apOX/ueWX5V3KCOQoNfe6vKILvziZZt0430tVW9H1JEiesUIYgNnzLGIJCqA='} 2024-09-17T03:23:03.005 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 03:17:43.044424', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFPxxumItLZ7a8+dE4pvjbv3ZDiZG6IHG9Q5LwqJ+FQin45kzhkb4KBAOKEBGqCQbcluMdPurQ28zb0CRjHt0xU='} 2024-09-17T03:23:03.005 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T03:23:03.012 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T03:23:03.012 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T03:23:03.013 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T03:23:03.072 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb5bd60bac0>, signals=[15]) 2024-09-17T03:23:03.072 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T03:23:03.080 INFO:teuthology.task.internal:Opening connections... 2024-09-17T03:23:03.080 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:23:03.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:23:03.159 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:23:03.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:23:03.235 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T03:23:03.241 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-09-17T03:23:03.259 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-09-17T03:23:03.259 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-09-17T03:23:03.317 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-09-17T03:23:03.317 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2024-09-17T03:23:03.317 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-09-17T03:23:03.317 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-09-17T03:23:03.317 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2024-09-17T03:23:03.317 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2024-09-17T03:23:03.317 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T03:23:03.317 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-09-17T03:23:03.317 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2024-09-17T03:23:03.317 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T03:23:03.318 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-09-17T03:23:03.318 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T03:23:03.318 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T03:23:03.318 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T03:23:03.318 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-09-17T03:23:03.342 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-09-17T03:23:03.361 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-09-17T03:23:03.361 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-09-17T03:23:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-09-17T03:23:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-09-17T03:23:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-09-17T03:23:03.419 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-09-17T03:23:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-09-17T03:23:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-09-17T03:23:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T03:23:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-09-17T03:23:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-09-17T03:23:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T03:23:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-09-17T03:23:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T03:23:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T03:23:03.420 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T03:23:03.421 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-09-17T03:23:03.442 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T03:23:03.454 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T03:23:03.465 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T03:23:03.465 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2024-09-17T03:23:03.468 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-09-17T03:23:03.485 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T03:23:03.493 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T03:23:03.493 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2024-09-17T03:23:03.526 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-09-17T03:23:03.572 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T03:23:03.626 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T03:23:03.640 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T03:23:03.640 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-17T03:23:03.640 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-17T03:23:03.641 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T03:23:03.641 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T03:23:03.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:23:03.659 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-09-17T03:23:03.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:23:03.660 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-09-17T03:23:03.717 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-503.el9.x86_64 2024-09-17T03:23:03.718 INFO:teuthology.task.kernel:Running kernel on smithi146: 5.14.0-503.el9.x86_64 2024-09-17T03:23:03.718 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum install -y kernel 2024-09-17T03:23:03.719 INFO:teuthology.orchestra.run.smithi179.stdout:5.14.0-503.el9.x86_64 2024-09-17T03:23:03.719 INFO:teuthology.task.kernel:Running kernel on smithi179: 5.14.0-503.el9.x86_64 2024-09-17T03:23:03.719 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum install -y kernel 2024-09-17T03:23:06.316 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-17T03:23:06.657 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.3 MB 00:01 2024-09-17T03:23:10.259 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 20 MB 00:02 2024-09-17T03:23:10.358 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 6.9 MB/s | 20 MB 00:02 2024-09-17T03:23:16.043 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-17T03:23:16.109 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-17T03:23:17.516 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-17T03:23:17.576 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-17T03:23:18.709 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-17T03:23:18.854 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-17T03:23:24.153 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T03:23:24.260 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-17T03:23:26.068 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T03:23:26.068 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T03:23:26.158 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T03:23:26.158 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T03:23:26.168 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-09-17T03:23:26.184 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T03:23:26.184 INFO:teuthology.orchestra.run.smithi179.stdout: Package Architecture Version Repository Size 2024-09-17T03:23:26.184 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T03:23:26.184 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-09-17T03:23:26.185 INFO:teuthology.orchestra.run.smithi179.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T03:23:26.185 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-09-17T03:23:26.185 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T03:23:26.185 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T03:23:26.185 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T03:23:26.185 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:23:26.185 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-09-17T03:23:26.185 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T03:23:26.185 INFO:teuthology.orchestra.run.smithi179.stdout:Install 4 Packages 2024-09-17T03:23:26.185 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:23:26.186 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 79 M 2024-09-17T03:23:26.186 INFO:teuthology.orchestra.run.smithi179.stdout:Installed size: 126 M 2024-09-17T03:23:26.186 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-09-17T03:23:26.262 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-17T03:23:26.271 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-17T03:23:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: Package Architecture Version Repository Size 2024-09-17T03:23:26.271 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-17T03:23:26.271 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-17T03:23:26.271 INFO:teuthology.orchestra.run.smithi146.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T03:23:26.272 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-17T03:23:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T03:23:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T03:23:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T03:23:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:23:26.272 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-17T03:23:26.272 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2024-09-17T03:23:26.272 INFO:teuthology.orchestra.run.smithi146.stdout:Install 4 Packages 2024-09-17T03:23:26.272 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:23:26.273 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 79 M 2024-09-17T03:23:26.273 INFO:teuthology.orchestra.run.smithi146.stdout:Installed size: 126 M 2024-09-17T03:23:26.273 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-17T03:23:26.371 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T03:23:26.374 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T03:23:26.428 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T03:23:26.465 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T03:23:26.466 INFO:teuthology.orchestra.run.smithi146.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T03:23:26.467 INFO:teuthology.orchestra.run.smithi146.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T03:23:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T03:23:26.477 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T03:23:26.482 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T03:23:26.548 INFO:teuthology.orchestra.run.smithi146.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T03:23:26.552 INFO:teuthology.orchestra.run.smithi146.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T03:23:26.557 INFO:teuthology.orchestra.run.smithi146.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T03:23:26.605 INFO:teuthology.orchestra.run.smithi179.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 121 kB/s | 36 kB 00:00 2024-09-17T03:23:26.619 INFO:teuthology.orchestra.run.smithi146.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 161 kB/s | 36 kB 00:00 2024-09-17T03:23:26.770 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T03:23:26.802 INFO:teuthology.orchestra.run.smithi146.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T03:23:26.833 INFO:teuthology.orchestra.run.smithi179.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T03:23:26.853 INFO:teuthology.orchestra.run.smithi146.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T03:23:27.145 INFO:teuthology.orchestra.run.smithi146.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-17T03:23:27.628 INFO:teuthology.orchestra.run.smithi146.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-17T03:23:28.695 INFO:teuthology.orchestra.run.smithi146.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 14 MB/s | 29 MB 00:02 2024-09-17T03:23:28.697 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:23:28.698 INFO:teuthology.orchestra.run.smithi146.stdout:Total 32 MB/s | 79 MB 00:02 2024-09-17T03:23:29.389 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-17T03:23:29.754 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-17T03:23:29.754 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-17T03:23:30.718 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-17T03:23:30.718 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-17T03:23:33.155 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-17T03:23:33.571 INFO:teuthology.orchestra.run.smithi179.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-17T03:23:33.787 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T03:23:33.870 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T03:23:36.371 INFO:teuthology.orchestra.run.smithi179.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.9 MB/s | 29 MB 00:09 2024-09-17T03:23:36.608 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T03:23:36.748 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T03:23:36.837 INFO:teuthology.orchestra.run.smithi179.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.3 MB/s | 35 MB 00:10 2024-09-17T03:23:36.839 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:23:36.840 INFO:teuthology.orchestra.run.smithi179.stdout:Total 7.4 MB/s | 79 MB 00:10 2024-09-17T03:23:37.522 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-09-17T03:23:37.863 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-09-17T03:23:37.864 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-09-17T03:23:38.858 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-09-17T03:23:38.858 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-09-17T03:23:41.295 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-09-17T03:23:41.606 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T03:23:41.698 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:23:41.939 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T03:23:42.021 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T03:23:44.770 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T03:23:44.890 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T03:23:46.572 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:23:49.697 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T03:23:49.957 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:23:54.804 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:24:24.706 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:24:24.749 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:24:25.105 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:24:25.105 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T03:24:25.105 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T03:24:25.105 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T03:24:25.939 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:24:25.939 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:24:25.939 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-17T03:24:25.939 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T03:24:25.939 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T03:24:25.939 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T03:24:25.940 INFO:teuthology.orchestra.run.smithi146.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T03:24:25.940 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:24:25.940 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-17T03:24:26.292 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T03:24:26.373 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T03:24:26.373 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T03:24:26.374 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T03:24:26.374 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T03:24:26.374 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T03:24:26.374 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-17T03:24:26.374 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T03:24:26.374 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T03:24:26.433 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T03:24:26.433 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T03:24:26.434 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2-tools 2024-09-17T03:24:26.467 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2-tools 2024-09-17T03:24:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2024-09-17T03:24:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.06 2024-09-17T03:24:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 82.el9 2024-09-17T03:24:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2024-09-17T03:24:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T03:24:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:Group : Unspecified 2024-09-17T03:24:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 8274670 2024-09-17T03:24:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2024-09-17T03:24:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T03:24:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T03:24:26.468 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : builder@centos.org 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : CentOS 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Support tools for GRUB. 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:24:26.469 INFO:teuthology.orchestra.run.smithi146.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T03:24:26.470 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T03:24:26.470 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 5.14.0-508.el9.x86_64 2024-09-17T03:24:26.471 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T03:24:27.088 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2024-09-17T03:24:28.431 INFO:teuthology.orchestra.run.smithi146.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T03:24:28.466 INFO:teuthology.orchestra.run.smithi146.stderr:done 2024-09-17T03:24:28.468 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-09-17T03:24:28.484 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.NknZ6RO5eE 2024-09-17T03:24:28.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NknZ6RO5eE 2024-09-17T03:24:28.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.NknZ6RO5eE 2024-09-17T03:24:28.694 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.NknZ6RO5eE is 6KB 2024-09-17T03:24:28.743 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.NknZ6RO5eE 2024-09-17T03:24:28.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T03:24:28.821 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T03:24:28.821 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T03:24:28.821 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T03:24:28.821 INFO:teuthology.orchestra.run.smithi146.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T03:24:28.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T03:24:28.980 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2024-09-17T03:24:32.987 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:24:33.026 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:24:33.327 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:24:33.327 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T03:24:33.327 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T03:24:33.327 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T03:24:34.211 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T03:24:34.211 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:24:34.211 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-09-17T03:24:34.211 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T03:24:34.211 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T03:24:34.211 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T03:24:34.211 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T03:24:34.211 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:24:34.211 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-09-17T03:24:34.575 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T03:24:34.660 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T03:24:34.660 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T03:24:34.660 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T03:24:34.661 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T03:24:34.661 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T03:24:34.661 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-17T03:24:34.661 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T03:24:34.661 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T03:24:34.720 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T03:24:34.721 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T03:24:34.721 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2024-09-17T03:24:34.753 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2024-09-17T03:24:34.753 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2024-09-17T03:24:34.753 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.06 2024-09-17T03:24:34.753 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 82.el9 2024-09-17T03:24:34.753 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2024-09-17T03:24:34.753 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T03:24:34.753 INFO:teuthology.orchestra.run.smithi179.stdout:Group : Unspecified 2024-09-17T03:24:34.753 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 8274670 2024-09-17T03:24:34.753 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2024-09-17T03:24:34.753 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T03:24:34.753 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : builder@centos.org 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : CentOS 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T03:24:34.754 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2024-09-17T03:24:34.755 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:24:34.755 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T03:24:34.755 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T03:24:34.756 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 5.14.0-508.el9.x86_64 2024-09-17T03:24:34.756 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T03:24:35.374 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2024-09-17T03:24:36.707 INFO:teuthology.orchestra.run.smithi179.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T03:24:36.726 INFO:teuthology.orchestra.run.smithi179.stderr:done 2024-09-17T03:24:36.731 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-09-17T03:24:36.746 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.viboFe5kgl 2024-09-17T03:24:36.747 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.viboFe5kgl 2024-09-17T03:24:36.814 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.viboFe5kgl 2024-09-17T03:24:36.959 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.viboFe5kgl is 6KB 2024-09-17T03:24:37.007 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.viboFe5kgl 2024-09-17T03:24:37.022 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T03:24:37.085 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T03:24:37.085 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T03:24:37.085 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T03:24:37.085 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T03:24:37.087 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T03:24:37.241 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2024-09-17T03:24:59.002 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T03:24:59.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T03:24:59.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:25:07.249 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T03:25:07.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-17T03:25:07.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:25:17.501 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-17T03:25:26.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T03:25:26.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:25:29.565 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-17T03:25:41.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T03:25:41.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:25:59.997 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-09-17T03:26:07.258 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T03:26:15.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T03:26:15.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:26:15.364 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-09-17T03:26:15.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T03:26:15.741 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-17T03:26:15.741 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2024-09-17T03:26:15.756 INFO:teuthology.orchestra.run.smithi146.stdout:5.14.0-508.el9.x86_64 2024-09-17T03:26:15.756 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T03:26:15.756 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T03:26:15.756 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T03:26:16.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-17T03:26:16.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:26:16.757 DEBUG:teuthology.parallel:result is None 2024-09-17T03:26:16.825 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-17T03:26:17.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-17T03:26:17.252 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-17T03:26:17.253 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-09-17T03:26:17.267 INFO:teuthology.orchestra.run.smithi179.stdout:5.14.0-508.el9.x86_64 2024-09-17T03:26:17.268 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T03:26:17.268 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T03:26:17.268 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T03:26:18.268 DEBUG:teuthology.parallel:result is None 2024-09-17T03:26:18.269 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T03:26:18.277 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T03:26:18.278 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T03:26:18.280 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T03:26:18.295 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T03:26:18.302 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T03:26:18.312 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T03:26:18.312 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T03:26:18.338 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T03:26:18.370 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T03:26:18.377 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T03:26:18.377 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T03:26:18.407 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T03:26:18.483 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:26:18.499 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:26:18.528 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:26:18.539 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:26:18.541 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T03:26:18.549 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T03:26:18.549 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T03:26:18.551 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T03:26:18.576 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T03:26:18.585 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T03:26:18.586 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T03:26:18.616 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T03:26:18.631 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:26:18.712 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:26:18.763 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:26:18.844 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:26:18.887 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:26:18.887 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T03:26:18.952 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:26:18.994 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:26:19.038 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:26:19.116 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:26:19.152 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:26:19.152 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T03:26:19.213 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2024-09-17T03:26:19.216 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-09-17T03:26:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:26:19.291 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:26:19.788 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T03:26:19.796 INFO:teuthology.task.internal:Starting timer... 2024-09-17T03:26:19.796 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T03:26:19.807 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T03:26:19.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2024-09-17T03:26:19.930 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2024-09-17T03:26:19.935 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2024-09-17T03:26:20.005 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2024-09-17T03:26:20.007 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T03:26:20.007 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2024-09-17T03:26:20.059 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2024-09-17T03:26:20.059 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2024-09-17T03:26:20.081 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2024-09-17T03:26:20.081 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi146.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2024-09-17T03:26:20.081 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:26:20.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:26:20.148 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:26:20.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:26:20.173 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T03:26:20.174 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2024-09-17T03:26:20.247 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2024-09-17T03:26:20.279 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T03:26:20.288 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T03:26:20.300 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T03:26:20.301 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi146.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T03:30:05.940 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-09-17T03:30:05.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T03:30:05.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:30:06.020 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-09-17T03:30:06.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-09-17T03:30:06.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-17T03:30:06.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:30:06.175 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-17T03:30:06.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-17T03:30:06.211 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T03:30:06.221 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T03:30:06.221 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T03:30:06.222 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:30:06.224 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T03:30:06.225 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:30:06.251 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T03:30:06.265 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T03:30:06.279 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T03:30:06.289 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2024-09-17T03:30:06.293 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T03:30:06.302 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2024-09-17T03:30:06.314 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T03:30:06.317 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2024-09-17T03:30:06.329 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2024-09-17T03:30:06.329 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T03:30:06.343 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T03:30:06.357 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T03:30:06.386 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:30:06.390 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:30:06.390 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-09-17T03:30:06.390 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:30:06.390 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:30:06.390 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:30:06.390 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:30:06.409 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:30:06.414 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:30:06.414 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-09-17T03:30:06.414 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:30:06.414 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:30:06.414 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:30:06.414 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:30:06.415 INFO:teuthology.run_tasks:Running task install... 2024-09-17T03:30:06.423 DEBUG:teuthology.task.install:project ceph 2024-09-17T03:30:06.423 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T03:30:06.423 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T03:30:06.423 INFO:teuthology.task.install:Using flavor: default 2024-09-17T03:30:06.429 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T03:30:06.429 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T03:30:06.430 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T03:30:06.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:30:06.432 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T03:30:06.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:30:06.576 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T03:30:06.576 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T03:30:06.588 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T03:30:06.588 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T03:30:06.685 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T03:30:06.686 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:30:06.686 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T03:30:06.695 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T03:30:06.695 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:30:06.696 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T03:30:06.713 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T03:30:06.713 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T03:30:06.724 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T03:30:06.724 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T03:30:06.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T03:30:06.790 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T03:30:06.856 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T03:30:06.866 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T03:30:06.920 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2024-09-17T03:30:06.921 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2024-09-17T03:30:06.930 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2024-09-17T03:30:06.931 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2024-09-17T03:30:07.151 INFO:teuthology.orchestra.run.smithi146.stdout:45 files removed 2024-09-17T03:30:07.165 INFO:teuthology.orchestra.run.smithi179.stdout:45 files removed 2024-09-17T03:30:07.179 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T03:30:07.192 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T03:30:07.738 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-17T03:30:07.747 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-09-17T03:30:08.022 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-17T03:30:08.048 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-17T03:30:08.289 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-17T03:30:08.323 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-17T03:30:09.048 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-17T03:30:12.857 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.3 MB 00:04 2024-09-17T03:30:13.123 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - AppStream 6.8 MB/s | 20 MB 00:03 2024-09-17T03:30:17.349 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-17T03:30:19.008 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-17T03:30:19.954 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-17T03:30:21.907 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-17T03:30:25.368 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T03:30:26.175 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-17T03:30:27.556 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:30:27.557 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:30:27.570 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T03:30:27.571 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T03:30:27.571 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T03:30:27.572 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T03:30:27.576 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T03:30:27.577 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T03:30:27.578 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T03:30:27.642 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2024-09-17T03:30:27.652 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-09-17T03:30:27.652 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2024-09-17T03:30:27.652 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-09-17T03:30:27.652 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2024-09-17T03:30:27.652 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T03:30:27.653 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T03:30:27.654 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T03:30:27.655 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T03:30:27.655 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T03:30:27.655 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T03:30:27.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T03:30:27.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T03:30:27.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T03:30:27.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T03:30:27.656 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T03:30:27.656 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T03:30:27.656 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T03:30:27.656 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T03:30:27.656 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2024-09-17T03:30:27.656 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T03:30:27.656 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T03:30:27.656 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T03:30:27.657 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T03:30:27.657 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T03:30:27.657 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T03:30:27.657 INFO:teuthology.orchestra.run.smithi146.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T03:30:27.657 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T03:30:27.657 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2024-09-17T03:30:27.657 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T03:30:27.657 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T03:30:27.657 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T03:30:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T03:30:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T03:30:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T03:30:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T03:30:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T03:30:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T03:30:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T03:30:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T03:30:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T03:30:27.658 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T03:30:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T03:30:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T03:30:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T03:30:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T03:30:27.659 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T03:30:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T03:30:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T03:30:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T03:30:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T03:30:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T03:30:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T03:30:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T03:30:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T03:30:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T03:30:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T03:30:27.660 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T03:30:27.661 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T03:30:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T03:30:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T03:30:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T03:30:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T03:30:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T03:30:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T03:30:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T03:30:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T03:30:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T03:30:27.662 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T03:30:27.663 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T03:30:27.664 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T03:30:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T03:30:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T03:30:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T03:30:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T03:30:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T03:30:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T03:30:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T03:30:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T03:30:27.665 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T03:30:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T03:30:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T03:30:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T03:30:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T03:30:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T03:30:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T03:30:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T03:30:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T03:30:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T03:30:27.666 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T03:30:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T03:30:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T03:30:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T03:30:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T03:30:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T03:30:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T03:30:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T03:30:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T03:30:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T03:30:27.667 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T03:30:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T03:30:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T03:30:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T03:30:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T03:30:27.668 INFO:teuthology.orchestra.run.smithi146.stdout:Installing weak dependencies: 2024-09-17T03:30:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T03:30:27.668 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:30:27.668 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2024-09-17T03:30:27.668 INFO:teuthology.orchestra.run.smithi146.stdout:======================================================================================= 2024-09-17T03:30:27.669 INFO:teuthology.orchestra.run.smithi146.stdout:Install 149 Packages 2024-09-17T03:30:27.669 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 8 Packages 2024-09-17T03:30:27.669 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:30:27.669 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 228 M 2024-09-17T03:30:27.669 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2024-09-17T03:30:27.884 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-17T03:30:28.394 INFO:teuthology.orchestra.run.smithi146.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-17T03:30:28.586 INFO:teuthology.orchestra.run.smithi146.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.5 MB/s | 873 kB 00:00 2024-09-17T03:30:28.670 INFO:teuthology.orchestra.run.smithi146.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.7 MB/s | 148 kB 00:00 2024-09-17T03:30:28.753 INFO:teuthology.orchestra.run.smithi146.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-17T03:30:28.763 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-17T03:30:28.837 INFO:teuthology.orchestra.run.smithi146.stdout:(5/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 18 MB/s | 1.5 MB 00:00 2024-09-17T03:30:28.887 INFO:teuthology.orchestra.run.smithi146.stdout:(6/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-17T03:30:29.104 INFO:teuthology.orchestra.run.smithi146.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 19 MB/s | 5.0 MB 00:00 2024-09-17T03:30:29.538 INFO:teuthology.orchestra.run.smithi146.stdout:(8/157): ceph-radosgw-19.3.0-4989.gce1b342b.el9 24 MB/s | 10 MB 00:00 2024-09-17T03:30:29.588 INFO:teuthology.orchestra.run.smithi146.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 506 kB/s | 25 kB 00:00 2024-09-17T03:30:29.780 INFO:teuthology.orchestra.run.smithi146.stdout:(10/157): ceph-common-19.3.0-4989.gce1b342b.el9 13 MB/s | 20 MB 00:01 2024-09-17T03:30:29.831 INFO:teuthology.orchestra.run.smithi146.stdout:(11/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 4.4 MB/s | 225 kB 00:00 2024-09-17T03:30:30.014 INFO:teuthology.orchestra.run.smithi146.stdout:(12/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 16 MB/s | 18 MB 00:01 2024-09-17T03:30:30.031 INFO:teuthology.orchestra.run.smithi146.stdout:(13/157): cephfs-shell-19.3.0-4989.gce1b342b.el 135 kB/s | 27 kB 00:00 2024-09-17T03:30:30.048 INFO:teuthology.orchestra.run.smithi146.stdout:(14/157): libcephfs-devel-19.3.0-4989.gce1b342b 953 kB/s | 32 kB 00:00 2024-09-17T03:30:30.098 INFO:teuthology.orchestra.run.smithi146.stdout:(15/157): libcephsqlite-19.3.0-4989.gce1b342b.e 3.1 MB/s | 159 kB 00:00 2024-09-17T03:30:30.123 INFO:teuthology.orchestra.run.smithi146.stdout:(16/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 8.1 MB/s | 766 kB 00:00 2024-09-17T03:30:30.157 INFO:teuthology.orchestra.run.smithi146.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 2.1 MB/s | 127 kB 00:00 2024-09-17T03:30:30.190 INFO:teuthology.orchestra.run.smithi146.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 7.4 MB/s | 507 kB 00:00 2024-09-17T03:30:30.257 INFO:teuthology.orchestra.run.smithi146.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 678 kB/s | 45 kB 00:00 2024-09-17T03:30:30.357 INFO:teuthology.orchestra.run.smithi146.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 1.4 MB/s | 143 kB 00:00 2024-09-17T03:30:30.499 INFO:teuthology.orchestra.run.smithi146.stdout:(21/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 15 MB/s | 5.3 MB 00:00 2024-09-17T03:30:30.525 INFO:teuthology.orchestra.run.smithi146.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 971 kB/s | 162 kB 00:00 2024-09-17T03:30:30.550 INFO:teuthology.orchestra.run.smithi146.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 6.3 MB/s | 321 kB 00:00 2024-09-17T03:30:30.575 INFO:teuthology.orchestra.run.smithi146.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 5.9 MB/s | 305 kB 00:00 2024-09-17T03:30:30.600 INFO:teuthology.orchestra.run.smithi146.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.9 MB/s | 99 kB 00:00 2024-09-17T03:30:30.625 INFO:teuthology.orchestra.run.smithi146.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-17T03:30:30.685 INFO:teuthology.orchestra.run.smithi146.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 2.8 MB/s | 170 kB 00:00 2024-09-17T03:30:30.745 INFO:teuthology.orchestra.run.smithi146.stdout:(28/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 21 MB/s | 3.1 MB 00:00 2024-09-17T03:30:30.762 INFO:teuthology.orchestra.run.smithi146.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 444 kB/s | 34 kB 00:00 2024-09-17T03:30:30.795 INFO:teuthology.orchestra.run.smithi146.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 3.0 MB/s | 154 kB 00:00 2024-09-17T03:30:31.212 INFO:teuthology.orchestra.run.smithi146.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 18 MB/s | 7.4 MB 00:00 2024-09-17T03:30:31.279 INFO:teuthology.orchestra.run.smithi146.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 4.3 MB/s | 291 kB 00:00 2024-09-17T03:30:31.338 INFO:teuthology.orchestra.run.smithi146.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 850 kB/s | 49 kB 00:00 2024-09-17T03:30:31.680 INFO:teuthology.orchestra.run.smithi146.stdout:(34/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 19 MB/s | 40 MB 00:02 2024-09-17T03:30:31.708 INFO:teuthology.orchestra.run.smithi146.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4989.gc 45 kB/s | 16 kB 00:00 2024-09-17T03:30:31.730 INFO:teuthology.orchestra.run.smithi146.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 5.6 MB/s | 285 kB 00:00 2024-09-17T03:30:31.889 INFO:teuthology.orchestra.run.smithi146.stdout:(37/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 13 MB/s | 14 MB 00:01 2024-09-17T03:30:31.916 INFO:teuthology.orchestra.run.smithi146.stdout:(38/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 3.7 MB/s | 784 kB 00:00 2024-09-17T03:30:31.940 INFO:teuthology.orchestra.run.smithi146.stdout:(39/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 87 kB/s | 18 kB 00:00 2024-09-17T03:30:32.031 INFO:teuthology.orchestra.run.smithi146.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-17T03:30:32.090 INFO:teuthology.orchestra.run.smithi146.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-17T03:30:32.115 INFO:teuthology.orchestra.run.smithi146.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-17T03:30:32.149 INFO:teuthology.orchestra.run.smithi146.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.3 MB/s | 801 kB 00:00 2024-09-17T03:30:32.174 INFO:teuthology.orchestra.run.smithi146.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-17T03:30:32.199 INFO:teuthology.orchestra.run.smithi146.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-17T03:30:32.225 INFO:teuthology.orchestra.run.smithi146.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-17T03:30:32.250 INFO:teuthology.orchestra.run.smithi146.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-17T03:30:32.283 INFO:teuthology.orchestra.run.smithi146.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-09-17T03:30:32.959 INFO:teuthology.orchestra.run.smithi146.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 158 kB/s | 107 kB 00:00 2024-09-17T03:30:33.100 INFO:teuthology.orchestra.run.smithi146.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 787 kB/s | 689 kB 00:00 2024-09-17T03:30:33.145 INFO:teuthology.orchestra.run.smithi146.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-17T03:30:33.501 INFO:teuthology.orchestra.run.smithi146.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 40 kB/s | 22 kB 00:00 2024-09-17T03:30:33.734 INFO:teuthology.orchestra.run.smithi146.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-09-17T03:30:33.960 INFO:teuthology.orchestra.run.smithi146.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 365 kB/s | 313 kB 00:00 2024-09-17T03:30:34.211 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-17T03:30:34.235 INFO:teuthology.orchestra.run.smithi146.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 37 kB/s | 18 kB 00:00 2024-09-17T03:30:34.461 INFO:teuthology.orchestra.run.smithi146.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-09-17T03:30:34.561 INFO:teuthology.orchestra.run.smithi146.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-17T03:30:34.977 INFO:teuthology.orchestra.run.smithi146.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 230 kB/s | 171 kB 00:00 2024-09-17T03:30:35.128 INFO:teuthology.orchestra.run.smithi146.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 80 kB/s | 45 kB 00:00 2024-09-17T03:30:35.253 INFO:teuthology.orchestra.run.smithi146.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 204 kB/s | 160 kB 00:00 2024-09-17T03:30:35.786 INFO:teuthology.orchestra.run.smithi146.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-17T03:30:35.845 INFO:teuthology.orchestra.run.smithi146.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 764 kB/s | 662 kB 00:00 2024-09-17T03:30:35.987 INFO:teuthology.orchestra.run.smithi146.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 676 kB/s | 581 kB 00:00 2024-09-17T03:30:36.404 INFO:teuthology.orchestra.run.smithi146.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 77 kB/s | 47 kB 00:00 2024-09-17T03:30:36.405 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:30:36.406 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:30:36.420 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T03:30:36.421 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T03:30:36.421 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T03:30:36.421 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T03:30:36.422 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T03:30:36.424 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T03:30:36.425 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T03:30:36.488 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-09-17T03:30:36.509 INFO:teuthology.orchestra.run.smithi179.stdout:======================================================================================= 2024-09-17T03:30:36.509 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-09-17T03:30:36.509 INFO:teuthology.orchestra.run.smithi179.stdout:======================================================================================= 2024-09-17T03:30:36.509 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T03:30:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T03:30:36.511 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T03:30:36.512 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T03:30:36.513 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T03:30:36.514 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T03:30:36.515 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T03:30:36.516 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T03:30:36.517 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T03:30:36.517 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T03:30:36.517 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T03:30:36.517 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T03:30:36.517 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T03:30:36.517 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T03:30:36.517 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T03:30:36.517 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T03:30:36.517 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T03:30:36.517 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T03:30:36.517 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T03:30:36.518 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T03:30:36.519 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T03:30:36.520 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T03:30:36.521 INFO:teuthology.orchestra.run.smithi179.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T03:30:36.522 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T03:30:36.522 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T03:30:36.522 INFO:teuthology.orchestra.run.smithi179.stdout:Installing weak dependencies: 2024-09-17T03:30:36.522 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T03:30:36.522 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:30:36.522 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-09-17T03:30:36.522 INFO:teuthology.orchestra.run.smithi179.stdout:======================================================================================= 2024-09-17T03:30:36.522 INFO:teuthology.orchestra.run.smithi179.stdout:Install 149 Packages 2024-09-17T03:30:36.522 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 8 Packages 2024-09-17T03:30:36.522 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:30:36.523 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 228 M 2024-09-17T03:30:36.523 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-09-17T03:30:36.637 INFO:teuthology.orchestra.run.smithi146.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 369 kB/s | 292 kB 00:00 2024-09-17T03:30:36.696 INFO:teuthology.orchestra.run.smithi146.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 266 kB/s | 188 kB 00:00 2024-09-17T03:30:36.988 INFO:teuthology.orchestra.run.smithi146.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 66 kB/s | 38 kB 00:00 2024-09-17T03:30:37.046 INFO:teuthology.orchestra.run.smithi179.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 45 kB/s | 6.6 kB 00:00 2024-09-17T03:30:37.404 INFO:teuthology.orchestra.run.smithi179.stdout:(2/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-17T03:30:37.438 INFO:teuthology.orchestra.run.smithi179.stdout:(3/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 2.2 MB/s | 873 kB 00:00 2024-09-17T03:30:37.463 INFO:teuthology.orchestra.run.smithi179.stdout:(4/157): ceph-immutable-object-cache-19.3.0-498 2.5 MB/s | 148 kB 00:00 2024-09-17T03:30:37.547 INFO:teuthology.orchestra.run.smithi179.stdout:(5/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 18 MB/s | 1.5 MB 00:00 2024-09-17T03:30:37.814 INFO:teuthology.orchestra.run.smithi179.stdout:(6/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 19 MB/s | 5.0 MB 00:00 2024-09-17T03:30:37.930 INFO:teuthology.orchestra.run.smithi146.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-17T03:30:38.022 INFO:teuthology.orchestra.run.smithi179.stdout:(7/157): ceph-common-19.3.0-4989.gce1b342b.el9. 18 MB/s | 20 MB 00:01 2024-09-17T03:30:38.073 INFO:teuthology.orchestra.run.smithi179.stdout:(8/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 3.6 MB/s | 2.3 MB 00:00 2024-09-17T03:30:38.140 INFO:teuthology.orchestra.run.smithi179.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 379 kB/s | 25 kB 00:00 2024-09-17T03:30:38.297 INFO:teuthology.orchestra.run.smithi146.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.8 MB/s | 4.4 MB 00:01 2024-09-17T03:30:38.480 INFO:teuthology.orchestra.run.smithi146.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 1.1 MB/s | 1.6 MB 00:01 2024-09-17T03:30:38.573 INFO:teuthology.orchestra.run.smithi179.stdout:(10/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 19 MB/s | 10 MB 00:00 2024-09-17T03:30:38.765 INFO:teuthology.orchestra.run.smithi179.stdout:(11/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 19 MB/s | 18 MB 00:00 2024-09-17T03:30:38.790 INFO:teuthology.orchestra.run.smithi179.stdout:(12/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 1.0 MB/s | 225 kB 00:00 2024-09-17T03:30:38.807 INFO:teuthology.orchestra.run.smithi179.stdout:(13/157): cephfs-shell-19.3.0-4989.gce1b342b.el 651 kB/s | 27 kB 00:00 2024-09-17T03:30:38.824 INFO:teuthology.orchestra.run.smithi179.stdout:(14/157): libcephfs-devel-19.3.0-4989.gce1b342b 944 kB/s | 32 kB 00:00 2024-09-17T03:30:38.866 INFO:teuthology.orchestra.run.smithi179.stdout:(15/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 13 MB/s | 766 kB 00:00 2024-09-17T03:30:38.892 INFO:teuthology.orchestra.run.smithi179.stdout:(16/157): libcephsqlite-19.3.0-4989.gce1b342b.e 2.3 MB/s | 159 kB 00:00 2024-09-17T03:30:38.917 INFO:teuthology.orchestra.run.smithi179.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 2.5 MB/s | 127 kB 00:00 2024-09-17T03:30:39.009 INFO:teuthology.orchestra.run.smithi179.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 4.2 MB/s | 507 kB 00:00 2024-09-17T03:30:39.047 INFO:teuthology.orchestra.run.smithi146.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 183 kB/s | 137 kB 00:00 2024-09-17T03:30:39.076 INFO:teuthology.orchestra.run.smithi179.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 680 kB/s | 45 kB 00:00 2024-09-17T03:30:39.151 INFO:teuthology.orchestra.run.smithi179.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 1.9 MB/s | 143 kB 00:00 2024-09-17T03:30:39.226 INFO:teuthology.orchestra.run.smithi179.stdout:(21/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 17 MB/s | 5.3 MB 00:00 2024-09-17T03:30:39.252 INFO:teuthology.orchestra.run.smithi179.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.6 MB/s | 162 kB 00:00 2024-09-17T03:30:39.277 INFO:teuthology.orchestra.run.smithi179.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 6.3 MB/s | 321 kB 00:00 2024-09-17T03:30:39.336 INFO:teuthology.orchestra.run.smithi179.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 3.6 MB/s | 305 kB 00:00 2024-09-17T03:30:39.361 INFO:teuthology.orchestra.run.smithi179.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.2 MB/s | 99 kB 00:00 2024-09-17T03:30:39.394 INFO:teuthology.orchestra.run.smithi179.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-17T03:30:39.461 INFO:teuthology.orchestra.run.smithi179.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-17T03:30:39.529 INFO:teuthology.orchestra.run.smithi179.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4989.g 511 kB/s | 34 kB 00:00 2024-09-17T03:30:39.579 INFO:teuthology.orchestra.run.smithi179.stdout:(29/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 14 MB/s | 3.1 MB 00:00 2024-09-17T03:30:39.613 INFO:teuthology.orchestra.run.smithi179.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 1.8 MB/s | 154 kB 00:00 2024-09-17T03:30:39.772 INFO:teuthology.orchestra.run.smithi146.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 494 kB/s | 910 kB 00:01 2024-09-17T03:30:40.413 INFO:teuthology.orchestra.run.smithi179.stdout:(31/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 18 MB/s | 40 MB 00:02 2024-09-17T03:30:40.422 INFO:teuthology.orchestra.run.smithi146.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 135 kB/s | 87 kB 00:00 2024-09-17T03:30:40.463 INFO:teuthology.orchestra.run.smithi179.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 5.7 MB/s | 291 kB 00:00 2024-09-17T03:30:40.581 INFO:teuthology.orchestra.run.smithi146.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 2.8 MB/s | 5.8 MB 00:02 2024-09-17T03:30:40.605 INFO:teuthology.orchestra.run.smithi179.stdout:(33/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 14 MB/s | 14 MB 00:01 2024-09-17T03:30:40.614 INFO:teuthology.orchestra.run.smithi146.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 659 kB/s | 1.0 MB 00:01 2024-09-17T03:30:40.630 INFO:teuthology.orchestra.run.smithi179.stdout:(34/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 296 kB/s | 49 kB 00:00 2024-09-17T03:30:40.656 INFO:teuthology.orchestra.run.smithi179.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4989.gc 329 kB/s | 16 kB 00:00 2024-09-17T03:30:40.689 INFO:teuthology.orchestra.run.smithi179.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 4.8 MB/s | 285 kB 00:00 2024-09-17T03:30:40.723 INFO:teuthology.orchestra.run.smithi179.stdout:(37/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 11 MB/s | 784 kB 00:00 2024-09-17T03:30:40.748 INFO:teuthology.orchestra.run.smithi179.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 313 kB/s | 18 kB 00:00 2024-09-17T03:30:40.848 INFO:teuthology.orchestra.run.smithi179.stdout:(39/157): ceph-mgr-diskprediction-local-19.3.0- 6.0 MB/s | 7.4 MB 00:01 2024-09-17T03:30:41.206 INFO:teuthology.orchestra.run.smithi146.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 98 kB/s | 61 kB 00:00 2024-09-17T03:30:41.224 INFO:teuthology.orchestra.run.smithi179.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 159 kB/s | 80 kB 00:00 2024-09-17T03:30:41.399 INFO:teuthology.orchestra.run.smithi179.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-17T03:30:41.515 INFO:teuthology.orchestra.run.smithi146.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 272 kB/s | 245 kB 00:00 2024-09-17T03:30:41.574 INFO:teuthology.orchestra.run.smithi179.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 970 kB/s | 801 kB 00:00 2024-09-17T03:30:41.600 INFO:teuthology.orchestra.run.smithi179.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 674 kB/s | 253 kB 00:00 2024-09-17T03:30:41.691 INFO:teuthology.orchestra.run.smithi179.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 911 kB/s | 106 kB 00:00 2024-09-17T03:30:41.717 INFO:teuthology.orchestra.run.smithi179.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-17T03:30:41.817 INFO:teuthology.orchestra.run.smithi179.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 2.9 MB/s | 1.2 MB 00:00 2024-09-17T03:30:41.842 INFO:teuthology.orchestra.run.smithi179.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 830 kB/s | 125 kB 00:00 2024-09-17T03:30:41.876 INFO:teuthology.orchestra.run.smithi179.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-09-17T03:30:42.009 INFO:teuthology.orchestra.run.smithi179.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 803 kB/s | 107 kB 00:00 2024-09-17T03:30:42.057 INFO:teuthology.orchestra.run.smithi146.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 47 kB/s | 26 kB 00:00 2024-09-17T03:30:42.059 INFO:teuthology.orchestra.run.smithi179.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-17T03:30:42.085 INFO:teuthology.orchestra.run.smithi179.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 288 kB/s | 22 kB 00:00 2024-09-17T03:30:42.112 INFO:teuthology.orchestra.run.smithi146.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 274 kB/s | 248 kB 00:00 2024-09-17T03:30:42.119 INFO:teuthology.orchestra.run.smithi179.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-17T03:30:42.144 INFO:teuthology.orchestra.run.smithi179.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-09-17T03:30:42.169 INFO:teuthology.orchestra.run.smithi179.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-17T03:30:42.194 INFO:teuthology.orchestra.run.smithi179.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-17T03:30:42.220 INFO:teuthology.orchestra.run.smithi179.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-17T03:30:42.254 INFO:teuthology.orchestra.run.smithi179.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-17T03:30:42.312 INFO:teuthology.orchestra.run.smithi179.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-17T03:30:42.337 INFO:teuthology.orchestra.run.smithi179.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-17T03:30:42.363 INFO:teuthology.orchestra.run.smithi179.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-17T03:30:42.405 INFO:teuthology.orchestra.run.smithi179.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-17T03:30:42.430 INFO:teuthology.orchestra.run.smithi179.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-09-17T03:30:42.455 INFO:teuthology.orchestra.run.smithi179.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-09-17T03:30:42.481 INFO:teuthology.orchestra.run.smithi179.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-17T03:30:42.514 INFO:teuthology.orchestra.run.smithi179.stdout:(65/157): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-17T03:30:42.539 INFO:teuthology.orchestra.run.smithi179.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-17T03:30:42.557 INFO:teuthology.orchestra.run.smithi146.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 38 kB/s | 19 kB 00:00 2024-09-17T03:30:42.565 INFO:teuthology.orchestra.run.smithi179.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-17T03:30:42.640 INFO:teuthology.orchestra.run.smithi179.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-17T03:30:42.715 INFO:teuthology.orchestra.run.smithi179.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-17T03:30:42.782 INFO:teuthology.orchestra.run.smithi179.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-17T03:30:42.807 INFO:teuthology.orchestra.run.smithi179.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-17T03:30:42.833 INFO:teuthology.orchestra.run.smithi179.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-17T03:30:42.866 INFO:teuthology.orchestra.run.smithi179.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-17T03:30:42.883 INFO:teuthology.orchestra.run.smithi146.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 224 kB/s | 172 kB 00:00 2024-09-17T03:30:42.892 INFO:teuthology.orchestra.run.smithi179.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-17T03:30:42.975 INFO:teuthology.orchestra.run.smithi179.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-17T03:30:43.009 INFO:teuthology.orchestra.run.smithi179.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-09-17T03:30:43.059 INFO:teuthology.orchestra.run.smithi179.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-17T03:30:43.084 INFO:teuthology.orchestra.run.smithi179.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-17T03:30:43.102 INFO:teuthology.orchestra.run.smithi179.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 613 kB/s | 26 kB 00:00 2024-09-17T03:30:43.178 INFO:teuthology.orchestra.run.smithi179.stdout:(80/157): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-17T03:30:43.182 INFO:teuthology.orchestra.run.smithi146.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 56 kB/s | 35 kB 00:00 2024-09-17T03:30:43.194 INFO:teuthology.orchestra.run.smithi179.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-17T03:30:43.219 INFO:teuthology.orchestra.run.smithi179.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-17T03:30:43.244 INFO:teuthology.orchestra.run.smithi179.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 519 kB/s | 35 kB 00:00 2024-09-17T03:30:43.269 INFO:teuthology.orchestra.run.smithi179.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-17T03:30:43.295 INFO:teuthology.orchestra.run.smithi179.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-17T03:30:43.320 INFO:teuthology.orchestra.run.smithi179.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-17T03:30:43.346 INFO:teuthology.orchestra.run.smithi179.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-09-17T03:30:43.371 INFO:teuthology.orchestra.run.smithi179.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-17T03:30:43.396 INFO:teuthology.orchestra.run.smithi179.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-17T03:30:43.421 INFO:teuthology.orchestra.run.smithi179.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-17T03:30:43.447 INFO:teuthology.orchestra.run.smithi179.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T03:30:43.472 INFO:teuthology.orchestra.run.smithi179.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-17T03:30:43.556 INFO:teuthology.orchestra.run.smithi179.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-17T03:30:43.581 INFO:teuthology.orchestra.run.smithi179.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-17T03:30:43.606 INFO:teuthology.orchestra.run.smithi179.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-17T03:30:43.631 INFO:teuthology.orchestra.run.smithi179.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-17T03:30:43.657 INFO:teuthology.orchestra.run.smithi179.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-17T03:30:43.682 INFO:teuthology.orchestra.run.smithi179.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-17T03:30:43.707 INFO:teuthology.orchestra.run.smithi179.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-17T03:30:43.708 INFO:teuthology.orchestra.run.smithi146.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 1.8 MB/s | 6.0 MB 00:03 2024-09-17T03:30:43.733 INFO:teuthology.orchestra.run.smithi179.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T03:30:43.758 INFO:teuthology.orchestra.run.smithi179.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-17T03:30:43.783 INFO:teuthology.orchestra.run.smithi179.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T03:30:43.809 INFO:teuthology.orchestra.run.smithi179.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-17T03:30:43.875 INFO:teuthology.orchestra.run.smithi179.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-17T03:30:43.934 INFO:teuthology.orchestra.run.smithi179.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-17T03:30:43.975 INFO:teuthology.orchestra.run.smithi146.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 316 kB/s | 250 kB 00:00 2024-09-17T03:30:44.093 INFO:teuthology.orchestra.run.smithi179.stdout:(106/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-17T03:30:44.126 INFO:teuthology.orchestra.run.smithi179.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 1.6 MB/s | 308 kB 00:00 2024-09-17T03:30:44.152 INFO:teuthology.orchestra.run.smithi179.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 334 kB/s | 19 kB 00:00 2024-09-17T03:30:44.177 INFO:teuthology.orchestra.run.smithi179.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-17T03:30:44.210 INFO:teuthology.orchestra.run.smithi179.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-17T03:30:44.261 INFO:teuthology.orchestra.run.smithi179.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T03:30:44.294 INFO:teuthology.orchestra.run.smithi179.stdout:(112/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-09-17T03:30:44.336 INFO:teuthology.orchestra.run.smithi179.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-17T03:30:44.403 INFO:teuthology.orchestra.run.smithi179.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 8.3 MB/s | 548 kB 00:00 2024-09-17T03:30:44.429 INFO:teuthology.orchestra.run.smithi179.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T03:30:44.450 INFO:teuthology.orchestra.run.smithi146.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.3 MB/s | 5.1 MB 00:01 2024-09-17T03:30:44.454 INFO:teuthology.orchestra.run.smithi179.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-17T03:30:44.475 INFO:teuthology.orchestra.run.smithi146.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 290 kB/s | 222 kB 00:00 2024-09-17T03:30:44.479 INFO:teuthology.orchestra.run.smithi179.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-17T03:30:44.513 INFO:teuthology.orchestra.run.smithi179.stdout:(118/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-09-17T03:30:44.547 INFO:teuthology.orchestra.run.smithi179.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-17T03:30:44.625 INFO:teuthology.orchestra.run.smithi146.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 119 kB/s | 77 kB 00:00 2024-09-17T03:30:44.689 INFO:teuthology.orchestra.run.smithi179.stdout:(120/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.9 MB/s | 4.4 MB 00:00 2024-09-17T03:30:44.722 INFO:teuthology.orchestra.run.smithi179.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 1.7 MB/s | 358 kB 00:00 2024-09-17T03:30:44.747 INFO:teuthology.orchestra.run.smithi179.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.5 MB/s | 303 kB 00:00 2024-09-17T03:30:44.773 INFO:teuthology.orchestra.run.smithi179.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-17T03:30:44.798 INFO:teuthology.orchestra.run.smithi179.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-17T03:30:44.823 INFO:teuthology.orchestra.run.smithi179.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-17T03:30:44.849 INFO:teuthology.orchestra.run.smithi179.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 715 kB/s | 18 kB 00:00 2024-09-17T03:30:44.874 INFO:teuthology.orchestra.run.smithi179.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 464 kB/s | 23 kB 00:00 2024-09-17T03:30:44.899 INFO:teuthology.orchestra.run.smithi179.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-17T03:30:44.924 INFO:teuthology.orchestra.run.smithi179.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-17T03:30:44.958 INFO:teuthology.orchestra.run.smithi179.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-17T03:30:44.992 INFO:teuthology.orchestra.run.smithi179.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-17T03:30:45.017 INFO:teuthology.orchestra.run.smithi146.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 75 kB/s | 42 kB 00:00 2024-09-17T03:30:45.026 INFO:teuthology.orchestra.run.smithi179.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.6 MB/s | 58 kB 00:00 2024-09-17T03:30:45.068 INFO:teuthology.orchestra.run.smithi179.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.0 MB/s | 1.0 MB 00:00 2024-09-17T03:30:45.094 INFO:teuthology.orchestra.run.smithi179.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-17T03:30:45.119 INFO:teuthology.orchestra.run.smithi179.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-17T03:30:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-17T03:30:45.169 INFO:teuthology.orchestra.run.smithi179.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-17T03:30:45.195 INFO:teuthology.orchestra.run.smithi179.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-17T03:30:45.220 INFO:teuthology.orchestra.run.smithi179.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-17T03:30:45.254 INFO:teuthology.orchestra.run.smithi179.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-17T03:30:45.279 INFO:teuthology.orchestra.run.smithi179.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 611 kB/s | 36 kB 00:00 2024-09-17T03:30:45.321 INFO:teuthology.orchestra.run.smithi179.stdout:(142/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-17T03:30:45.346 INFO:teuthology.orchestra.run.smithi179.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 809 kB/s | 74 kB 00:00 2024-09-17T03:30:45.372 INFO:teuthology.orchestra.run.smithi179.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-17T03:30:45.397 INFO:teuthology.orchestra.run.smithi179.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-17T03:30:45.414 INFO:teuthology.orchestra.run.smithi179.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-09-17T03:30:45.426 INFO:teuthology.orchestra.run.smithi146.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 198 kB/s | 159 kB 00:00 2024-09-17T03:30:45.451 INFO:teuthology.orchestra.run.smithi146.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 276 kB/s | 269 kB 00:00 2024-09-17T03:30:45.456 INFO:teuthology.orchestra.run.smithi179.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-17T03:30:45.490 INFO:teuthology.orchestra.run.smithi179.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-17T03:30:45.573 INFO:teuthology.orchestra.run.smithi179.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-17T03:30:45.798 INFO:teuthology.orchestra.run.smithi179.stdout:(150/157): librados2-19.3.0-4989.gce1b342b.el9. 9.9 MB/s | 3.4 MB 00:00 2024-09-17T03:30:45.901 INFO:teuthology.orchestra.run.smithi146.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 315 kB/s | 279 kB 00:00 2024-09-17T03:30:45.907 INFO:teuthology.orchestra.run.smithi179.stdout:(151/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 7.6 MB/s | 3.2 MB 00:00 2024-09-17T03:30:46.018 INFO:teuthology.orchestra.run.smithi146.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-09-17T03:30:46.045 INFO:teuthology.orchestra.run.smithi146.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 91 kB/s | 54 kB 00:00 2024-09-17T03:30:46.282 INFO:teuthology.orchestra.run.smithi179.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 109 kB/s | 41 kB 00:00 2024-09-17T03:30:46.577 INFO:teuthology.orchestra.run.smithi146.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 75 kB/s | 42 kB 00:00 2024-09-17T03:30:46.602 INFO:teuthology.orchestra.run.smithi146.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 79 kB/s | 44 kB 00:00 2024-09-17T03:30:46.741 INFO:teuthology.orchestra.run.smithi179.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 543 kB/s | 249 kB 00:00 2024-09-17T03:30:46.799 INFO:teuthology.orchestra.run.smithi179.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:01 2024-09-17T03:30:47.108 INFO:teuthology.orchestra.run.smithi179.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.8 MB/s | 2.4 MB 00:00 2024-09-17T03:30:47.153 INFO:teuthology.orchestra.run.smithi146.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 65 kB/s | 36 kB 00:00 2024-09-17T03:30:47.300 INFO:teuthology.orchestra.run.smithi179.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 1.4 MB 00:00 2024-09-17T03:30:47.319 INFO:teuthology.orchestra.run.smithi146.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 298 kB/s | 221 kB 00:00 2024-09-17T03:30:47.691 INFO:teuthology.orchestra.run.smithi179.stdout:(157/157): NetworkManager-1.51.0-1.el9.x86_64.r 1.1 MB/s | 2.3 MB 00:02 2024-09-17T03:30:47.698 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:30:47.698 INFO:teuthology.orchestra.run.smithi179.stdout:Total 20 MB/s | 228 MB 00:11 2024-09-17T03:30:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 84 kB/s | 47 kB 00:00 2024-09-17T03:30:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 372 kB/s | 304 kB 00:00 2024-09-17T03:30:48.362 INFO:teuthology.orchestra.run.smithi146.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 90 kB/s | 58 kB 00:00 2024-09-17T03:30:48.837 INFO:teuthology.orchestra.run.smithi146.stdout:(101/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.5 MB/s | 16 MB 00:02 2024-09-17T03:30:48.862 INFO:teuthology.orchestra.run.smithi146.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 132 kB/s | 96 kB 00:00 2024-09-17T03:30:48.940 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-09-17T03:30:49.095 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-09-17T03:30:49.096 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-09-17T03:30:49.179 INFO:teuthology.orchestra.run.smithi146.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 79 kB/s | 64 kB 00:00 2024-09-17T03:30:49.379 INFO:teuthology.orchestra.run.smithi146.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 43 kB/s | 22 kB 00:00 2024-09-17T03:30:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:(105/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-17T03:30:49.455 INFO:teuthology.orchestra.run.smithi146.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-17T03:30:49.472 INFO:teuthology.orchestra.run.smithi146.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.3 MB/s | 19 kB 00:00 2024-09-17T03:30:49.514 INFO:teuthology.orchestra.run.smithi146.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-17T03:30:49.531 INFO:teuthology.orchestra.run.smithi146.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-17T03:30:49.555 INFO:teuthology.orchestra.run.smithi146.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T03:30:49.589 INFO:teuthology.orchestra.run.smithi146.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-17T03:30:49.623 INFO:teuthology.orchestra.run.smithi146.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-17T03:30:49.706 INFO:teuthology.orchestra.run.smithi146.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 839 kB 00:00 2024-09-17T03:30:49.773 INFO:teuthology.orchestra.run.smithi146.stdout:(114/157): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-17T03:30:49.790 INFO:teuthology.orchestra.run.smithi146.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-17T03:30:49.807 INFO:teuthology.orchestra.run.smithi146.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-17T03:30:49.833 INFO:teuthology.orchestra.run.smithi146.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-17T03:30:49.850 INFO:teuthology.orchestra.run.smithi146.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 338 kB/s | 14 kB 00:00 2024-09-17T03:30:49.875 INFO:teuthology.orchestra.run.smithi146.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-17T03:30:49.925 INFO:teuthology.orchestra.run.smithi146.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-17T03:30:49.951 INFO:teuthology.orchestra.run.smithi146.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-17T03:30:49.976 INFO:teuthology.orchestra.run.smithi146.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-17T03:30:50.009 INFO:teuthology.orchestra.run.smithi146.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-17T03:30:50.035 INFO:teuthology.orchestra.run.smithi146.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-17T03:30:50.060 INFO:teuthology.orchestra.run.smithi146.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-17T03:30:50.085 INFO:teuthology.orchestra.run.smithi146.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-17T03:30:50.111 INFO:teuthology.orchestra.run.smithi146.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-17T03:30:50.137 INFO:teuthology.orchestra.run.smithi146.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-17T03:30:50.186 INFO:teuthology.orchestra.run.smithi146.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-17T03:30:50.211 INFO:teuthology.orchestra.run.smithi146.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T03:30:50.237 INFO:teuthology.orchestra.run.smithi146.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T03:30:50.262 INFO:teuthology.orchestra.run.smithi146.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T03:30:50.304 INFO:teuthology.orchestra.run.smithi146.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-17T03:30:50.329 INFO:teuthology.orchestra.run.smithi146.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-17T03:30:50.354 INFO:teuthology.orchestra.run.smithi146.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-17T03:30:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-17T03:30:50.397 INFO:teuthology.orchestra.run.smithi146.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-09-17T03:30:50.414 INFO:teuthology.orchestra.run.smithi146.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 917 kB/s | 31 kB 00:00 2024-09-17T03:30:50.439 INFO:teuthology.orchestra.run.smithi146.stdout:(139/157): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-09-17T03:30:50.456 INFO:teuthology.orchestra.run.smithi146.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-17T03:30:50.473 INFO:teuthology.orchestra.run.smithi146.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-17T03:30:50.498 INFO:teuthology.orchestra.run.smithi146.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-17T03:30:50.532 INFO:teuthology.orchestra.run.smithi146.stdout:(143/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-17T03:30:50.557 INFO:teuthology.orchestra.run.smithi146.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-17T03:30:50.574 INFO:teuthology.orchestra.run.smithi146.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-17T03:30:50.607 INFO:teuthology.orchestra.run.smithi146.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-17T03:30:50.633 INFO:teuthology.orchestra.run.smithi146.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-17T03:30:50.708 INFO:teuthology.orchestra.run.smithi146.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T03:30:50.841 INFO:teuthology.orchestra.run.smithi146.stdout:(149/157): protobuf-compiler-3.14.0-13.el9.x86_ 520 kB/s | 863 kB 00:01 2024-09-17T03:30:50.908 INFO:teuthology.orchestra.run.smithi146.stdout:(150/157): librados2-19.3.0-4989.gce1b342b.el9. 12 MB/s | 3.4 MB 00:00 2024-09-17T03:30:51.017 INFO:teuthology.orchestra.run.smithi146.stdout:(151/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-17T03:30:51.059 INFO:teuthology.orchestra.run.smithi146.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-09-17T03:30:51.084 INFO:teuthology.orchestra.run.smithi146.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 614 kB/s | 41 kB 00:00 2024-09-17T03:30:51.118 INFO:teuthology.orchestra.run.smithi146.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-17T03:30:51.160 INFO:teuthology.orchestra.run.smithi146.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 7.2 MB/s | 1.8 MB 00:00 2024-09-17T03:30:51.218 INFO:teuthology.orchestra.run.smithi146.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-17T03:30:51.260 INFO:teuthology.orchestra.run.smithi146.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 7.7 MB/s | 1.4 MB 00:00 2024-09-17T03:30:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:30:51.266 INFO:teuthology.orchestra.run.smithi146.stdout:Total 9.7 MB/s | 228 MB 00:23 2024-09-17T03:30:51.680 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-09-17T03:30:51.680 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-09-17T03:30:52.491 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2024-09-17T03:30:52.648 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2024-09-17T03:30:52.648 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2024-09-17T03:30:54.903 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2024-09-17T03:30:54.904 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2024-09-17T03:30:58.180 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-09-17T03:30:58.313 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T03:30:58.357 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T03:30:58.429 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T03:30:58.471 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T03:30:58.497 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T03:30:58.549 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T03:30:58.887 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T03:30:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:30:59.141 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:30:59.165 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:30:59.257 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:30:59.286 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:30:59.316 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T03:30:59.493 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T03:30:59.551 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T03:30:59.587 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:30:59.692 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:30:59.730 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:30:59.793 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:30:59.831 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:30:59.852 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:31:00.041 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:31:00.212 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:31:00.313 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T03:31:00.426 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:31:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:31:00.766 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:31:00.883 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T03:31:00.919 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T03:31:00.954 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T03:31:01.027 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T03:31:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T03:31:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T03:31:01.155 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T03:31:01.188 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T03:31:01.224 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T03:31:01.235 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2024-09-17T03:31:01.301 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T03:31:01.356 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T03:31:01.363 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T03:31:01.394 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T03:31:01.438 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T03:31:01.505 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T03:31:01.526 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T03:31:01.556 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T03:31:01.573 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T03:31:01.599 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T03:31:01.628 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T03:31:01.631 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T03:31:01.657 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T03:31:01.699 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T03:31:01.713 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T03:31:01.752 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T03:31:01.834 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T03:31:01.968 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T03:31:02.029 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T03:31:02.056 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T03:31:02.191 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:31:02.317 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:31:02.358 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:31:02.449 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:31:02.487 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:31:02.526 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T03:31:02.561 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T03:31:02.650 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T03:31:02.687 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T03:31:02.703 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T03:31:02.731 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T03:31:02.760 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T03:31:02.768 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T03:31:02.788 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:31:02.810 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T03:31:02.893 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:31:02.922 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:31:02.968 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T03:31:02.985 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:31:03.006 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:31:03.021 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T03:31:03.032 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:31:03.113 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T03:31:03.177 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T03:31:03.234 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:31:03.250 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T03:31:03.281 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T03:31:03.318 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T03:31:03.364 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T03:31:03.400 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T03:31:03.405 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:31:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T03:31:03.494 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T03:31:03.529 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T03:31:03.632 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:31:03.633 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T03:31:03.714 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:31:03.921 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T03:31:03.937 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:31:04.017 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T03:31:04.048 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T03:31:04.085 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T03:31:04.120 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T03:31:04.132 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T03:31:04.167 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T03:31:04.193 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T03:31:04.207 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T03:31:04.240 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T03:31:04.245 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T03:31:04.265 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T03:31:04.278 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T03:31:04.321 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T03:31:04.354 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T03:31:04.361 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T03:31:04.382 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T03:31:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T03:31:04.491 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T03:31:04.503 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T03:31:04.531 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T03:31:04.543 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T03:31:04.559 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T03:31:04.593 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T03:31:04.595 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T03:31:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T03:31:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T03:31:04.672 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T03:31:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T03:31:04.706 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T03:31:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T03:31:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T03:31:04.762 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T03:31:04.777 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T03:31:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T03:31:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T03:31:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T03:31:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T03:31:04.941 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T03:31:04.967 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T03:31:04.984 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T03:31:05.027 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T03:31:05.101 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T03:31:05.131 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T03:31:05.161 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T03:31:05.186 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T03:31:05.696 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T03:31:05.781 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T03:31:05.819 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T03:31:05.870 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T03:31:05.908 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T03:31:05.908 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T03:31:05.957 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T03:31:05.958 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T03:31:05.992 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T03:31:06.091 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T03:31:06.117 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T03:31:06.139 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T03:31:06.178 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T03:31:06.192 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T03:31:06.269 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T03:31:06.289 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T03:31:06.328 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T03:31:06.333 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T03:31:06.407 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T03:31:06.438 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T03:31:06.474 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T03:31:06.513 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T03:31:06.521 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T03:31:06.543 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T03:31:06.565 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T03:31:06.607 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T03:31:06.628 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T03:31:06.650 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T03:31:06.786 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T03:31:06.827 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T03:31:06.868 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T03:31:06.970 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T03:31:07.002 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T03:31:07.051 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T03:31:07.084 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T03:31:07.109 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T03:31:07.208 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T03:31:07.290 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T03:31:07.335 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T03:31:07.374 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T03:31:07.407 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T03:31:07.415 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T03:31:07.453 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T03:31:07.492 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T03:31:07.523 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T03:31:07.553 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T03:31:07.588 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T03:31:07.621 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T03:31:07.662 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T03:31:07.700 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T03:31:07.787 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T03:31:07.839 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T03:31:07.870 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T03:31:07.973 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T03:31:08.038 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T03:31:08.677 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T03:31:08.765 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T03:31:08.771 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T03:31:08.799 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T03:31:08.818 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T03:31:08.832 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T03:31:08.852 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T03:31:08.952 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T03:31:08.999 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T03:31:09.052 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T03:31:09.141 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T03:31:09.157 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T03:31:09.180 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T03:31:09.314 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:31:09.365 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T03:31:09.394 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T03:31:09.411 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:31:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T03:31:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T03:31:09.489 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T03:31:09.985 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T03:31:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:31:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:31:10.109 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T03:31:10.167 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T03:31:10.282 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T03:31:11.550 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T03:31:11.638 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T03:31:11.666 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T03:31:11.699 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T03:31:12.025 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T03:31:12.070 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:31:12.169 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:31:12.200 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T03:31:12.236 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T03:31:12.394 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:31:12.452 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:31:12.741 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T03:31:12.765 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:31:12.836 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:31:12.866 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T03:31:13.020 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:31:13.059 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:31:13.142 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:31:13.142 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T03:31:13.142 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T03:31:13.143 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:13.177 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:31:15.135 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:31:15.171 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:31:15.761 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:31:15.798 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:31:15.889 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:31:15.889 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T03:31:15.890 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T03:31:15.890 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:15.933 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:31:25.465 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:31:25.466 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2024-09-17T03:31:25.466 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2024-09-17T03:31:25.466 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2024-09-17T03:31:25.466 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2024-09-17T03:31:25.466 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2024-09-17T03:31:25.466 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /root 2024-09-17T03:31:25.466 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2024-09-17T03:31:25.466 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:25.655 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:31:25.672 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:31:25.672 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:25.672 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T03:31:25.672 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:27.258 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:31:27.285 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:31:27.285 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:27.285 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T03:31:27.285 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:31:27.286 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:31:27.286 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:31:27.541 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:31:27.541 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:27.541 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T03:31:27.541 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:31:27.541 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:31:27.542 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:27.773 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:31:27.773 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2024-09-17T03:31:27.773 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2024-09-17T03:31:27.773 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2024-09-17T03:31:27.773 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2024-09-17T03:31:27.773 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2024-09-17T03:31:27.773 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /root 2024-09-17T03:31:27.773 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2024-09-17T03:31:27.773 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:27.942 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:31:27.958 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:31:27.958 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:27.958 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T03:31:27.958 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:28.026 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:31:28.050 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:31:28.050 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:28.050 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T03:31:28.050 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:31:28.050 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:31:28.050 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:28.156 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T03:31:28.214 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T03:31:28.269 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T03:31:28.455 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T03:31:28.502 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T03:31:28.580 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T03:31:28.668 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T03:31:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T03:31:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T03:31:28.901 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T03:31:28.930 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T03:31:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:31:29.410 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:31:29.443 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T03:31:29.517 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T03:31:29.542 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:31:29.563 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:31:29.589 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:31:29.590 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:29.590 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T03:31:29.590 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:31:29.590 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:31:29.590 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:31:29.871 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:31:29.872 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:29.872 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T03:31:29.872 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:31:29.872 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:31:29.872 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:30.358 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:31:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:31:30.381 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:30.381 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T03:31:30.381 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:31:30.381 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:31:30.381 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:30.489 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T03:31:30.545 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T03:31:30.600 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T03:31:30.789 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T03:31:30.842 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T03:31:30.920 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T03:31:31.008 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T03:31:31.148 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T03:31:31.192 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T03:31:31.224 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T03:31:31.251 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T03:31:31.697 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:31:31.725 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:31:31.757 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T03:31:31.832 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T03:31:31.856 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:31:32.778 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:31:32.831 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:31:33.794 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:31:33.823 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:31:33.939 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:31:34.116 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T03:31:34.142 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:31:34.166 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:31:34.166 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:34.166 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T03:31:34.167 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:31:34.167 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:31:34.167 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:34.218 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:31:34.229 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:31:34.328 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T03:31:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T03:31:35.068 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:31:35.128 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:31:35.352 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T03:31:35.409 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:31:35.432 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:31:35.432 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:35.432 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T03:31:35.433 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:31:35.433 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:31:35.433 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:35.479 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:31:35.502 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:31:35.502 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:35.502 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T03:31:35.502 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:35.546 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:31:35.569 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:31:35.570 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:35.570 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T03:31:35.570 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:31:35.570 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:31:35.570 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:35.889 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:31:35.912 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:31:35.912 INFO:teuthology.orchestra.run.smithi179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:35.913 INFO:teuthology.orchestra.run.smithi179.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T03:31:35.913 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:31:35.913 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:31:35.913 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:36.098 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:31:36.128 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:31:36.242 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:31:36.414 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T03:31:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:31:36.471 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:31:36.471 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:36.471 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T03:31:36.471 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:31:36.471 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:31:36.471 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:36.531 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:31:36.543 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:31:36.642 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T03:31:36.693 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T03:31:37.664 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T03:31:37.700 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:31:37.724 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:31:37.724 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:37.724 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T03:31:37.724 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:31:37.724 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:31:37.724 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:37.767 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:31:37.790 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:31:37.790 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:37.790 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T03:31:37.790 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:37.834 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:31:37.858 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:31:37.858 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:37.858 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T03:31:37.858 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:31:37.858 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:31:37.858 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:38.177 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:31:38.200 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:31:38.200 INFO:teuthology.orchestra.run.smithi146.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:31:38.200 INFO:teuthology.orchestra.run.smithi146.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T03:31:38.201 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:31:38.201 INFO:teuthology.orchestra.run.smithi146.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:31:38.201 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:39.919 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T03:31:39.959 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T03:31:40.000 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T03:31:40.032 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T03:31:40.059 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T03:31:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T03:31:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T03:31:40.328 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T03:31:40.357 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T03:31:40.404 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T03:31:41.054 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:31:41.085 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:31:41.105 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:31:41.931 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T03:31:42.015 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T03:31:42.066 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T03:31:42.156 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T03:31:42.185 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T03:31:42.210 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T03:31:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T03:31:42.236 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:31:42.239 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T03:31:42.280 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T03:31:42.321 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T03:31:42.328 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:31:42.328 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:31:42.353 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T03:31:42.380 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T03:31:42.412 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:31:42.437 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T03:31:42.442 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:31:42.442 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:31:42.576 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T03:31:42.627 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T03:31:42.630 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:31:42.630 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:31:42.657 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T03:31:42.687 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T03:31:42.715 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:31:42.733 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T03:31:42.780 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:31:43.364 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:31:43.405 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:31:43.426 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:31:44.268 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T03:31:44.359 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T03:31:44.412 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T03:31:44.500 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T03:31:44.529 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T03:31:44.555 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T03:31:44.588 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T03:31:44.589 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:31:44.690 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:31:44.690 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:31:44.773 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:31:44.799 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T03:31:44.804 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:31:44.804 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:31:44.992 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:31:44.992 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:31:45.076 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:31:45.143 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:31:49.623 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:31:49.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T03:31:49.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T03:31:49.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T03:31:49.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T03:31:49.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T03:31:49.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T03:31:49.637 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T03:31:49.637 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T03:31:49.637 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T03:31:49.637 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T03:31:49.637 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T03:31:49.637 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T03:31:49.637 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T03:31:49.638 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T03:31:49.639 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T03:31:49.640 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T03:31:49.641 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T03:31:49.641 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T03:31:49.641 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T03:31:49.641 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T03:31:49.641 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T03:31:49.641 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T03:31:49.641 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T03:31:49.641 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T03:31:49.641 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T03:31:49.641 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T03:31:49.641 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T03:31:49.642 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T03:31:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T03:31:49.644 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T03:31:49.645 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T03:31:49.646 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T03:31:49.647 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T03:31:49.647 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T03:31:49.647 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T03:31:49.647 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T03:31:49.647 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T03:31:49.647 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T03:31:49.647 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T03:31:49.647 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T03:31:49.647 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T03:31:49.647 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T03:31:51.258 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:31:51.258 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T03:31:51.258 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T03:31:51.258 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T03:31:51.258 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T03:31:51.258 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T03:31:51.258 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T03:31:51.258 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T03:31:51.258 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T03:31:51.259 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T03:31:51.260 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T03:31:51.261 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T03:31:51.261 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T03:31:51.261 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T03:31:51.261 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T03:31:51.261 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T03:31:51.261 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T03:31:51.262 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T03:31:51.263 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T03:31:51.264 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T03:31:51.265 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T03:31:51.266 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T03:31:51.266 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T03:31:51.266 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T03:31:51.266 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T03:31:51.266 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T03:31:51.266 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T03:31:51.266 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T03:31:51.266 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T03:31:51.266 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T03:31:51.267 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T03:31:51.267 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T03:31:51.267 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T03:31:51.267 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T03:31:51.268 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T03:31:51.268 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T03:31:51.268 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T03:31:51.268 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T03:31:51.268 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T03:31:51.268 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T03:31:51.268 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T03:31:51.268 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T03:31:51.268 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T03:31:51.268 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T03:31:51.268 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T03:31:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T03:31:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T03:31:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T03:31:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T03:31:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T03:31:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T03:31:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T03:31:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T03:31:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T03:31:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T03:31:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T03:31:51.270 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T03:31:51.270 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T03:31:51.270 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T03:31:51.270 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T03:31:51.270 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T03:31:51.270 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T03:31:51.270 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T03:31:51.270 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T03:31:51.270 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T03:31:51.270 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T03:31:51.270 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T03:31:51.271 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T03:31:51.271 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T03:31:51.271 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T03:31:51.271 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T03:31:51.271 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T03:31:51.271 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T03:31:51.271 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T03:31:51.271 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T03:31:51.271 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T03:31:51.271 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T03:31:51.271 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T03:31:51.272 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T03:31:51.272 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T03:31:51.272 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T03:31:51.272 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T03:31:51.272 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T03:31:51.272 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T03:31:51.272 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T03:31:51.272 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T03:31:51.272 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T03:31:51.272 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T03:31:51.273 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T03:31:51.273 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T03:31:51.273 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T03:31:52.380 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:31:52.380 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:52.380 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T03:31:52.381 INFO:teuthology.orchestra.run.smithi179.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:52.382 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T03:31:52.383 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.384 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T03:31:52.385 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T03:31:52.386 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T03:31:52.387 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T03:31:52.388 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T03:31:52.389 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T03:31:52.390 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T03:31:52.391 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T03:31:52.392 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T03:31:52.393 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T03:31:52.393 INFO:teuthology.orchestra.run.smithi179.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T03:31:52.393 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T03:31:52.393 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T03:31:52.393 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T03:31:52.393 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:52.393 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-09-17T03:31:52.819 DEBUG:teuthology.parallel:result is None 2024-09-17T03:31:54.184 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:31:54.185 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:54.185 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2024-09-17T03:31:54.185 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T03:31:54.185 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T03:31:54.185 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T03:31:54.185 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T03:31:54.185 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.185 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.185 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T03:31:54.186 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T03:31:54.186 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2024-09-17T03:31:54.186 INFO:teuthology.orchestra.run.smithi146.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T03:31:54.186 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T03:31:54.186 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T03:31:54.186 INFO:teuthology.orchestra.run.smithi146.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T03:31:54.186 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.186 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.186 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.186 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.187 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T03:31:54.188 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T03:31:54.189 INFO:teuthology.orchestra.run.smithi146.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T03:31:54.189 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T03:31:54.189 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T03:31:54.189 INFO:teuthology.orchestra.run.smithi146.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T03:31:54.189 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T03:31:54.189 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T03:31:54.189 INFO:teuthology.orchestra.run.smithi146.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T03:31:54.189 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.189 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.189 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.189 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T03:31:54.190 INFO:teuthology.orchestra.run.smithi146.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T03:31:54.190 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T03:31:54.190 INFO:teuthology.orchestra.run.smithi146.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T03:31:54.190 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T03:31:54.190 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T03:31:54.190 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.190 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.190 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T03:31:54.190 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.190 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T03:31:54.190 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T03:31:54.191 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T03:31:54.191 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T03:31:54.191 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T03:31:54.191 INFO:teuthology.orchestra.run.smithi146.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T03:31:54.192 INFO:teuthology.orchestra.run.smithi146.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T03:31:54.192 INFO:teuthology.orchestra.run.smithi146.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T03:31:54.192 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T03:31:54.192 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T03:31:54.192 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T03:31:54.192 INFO:teuthology.orchestra.run.smithi146.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T03:31:54.192 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T03:31:54.193 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T03:31:54.193 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T03:31:54.193 INFO:teuthology.orchestra.run.smithi146.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T03:31:54.193 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T03:31:54.193 INFO:teuthology.orchestra.run.smithi146.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T03:31:54.193 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T03:31:54.193 INFO:teuthology.orchestra.run.smithi146.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T03:31:54.193 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T03:31:54.194 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T03:31:54.195 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T03:31:54.196 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.197 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T03:31:54.198 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T03:31:54.199 INFO:teuthology.orchestra.run.smithi146.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T03:31:54.200 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T03:31:54.200 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T03:31:54.200 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T03:31:54.200 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:54.200 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2024-09-17T03:31:54.617 DEBUG:teuthology.parallel:result is None 2024-09-17T03:31:54.665 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:31:54.805 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T03:31:54.827 INFO:teuthology.orchestra.run.smithi146.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T03:31:54.828 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T03:31:54.828 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T03:31:54.830 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:31:54.976 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T03:31:55.002 INFO:teuthology.orchestra.run.smithi179.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T03:31:55.003 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T03:31:55.003 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T03:31:55.004 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T03:31:55.005 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:31:55.005 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T03:31:55.032 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:31:55.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T03:31:55.077 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T03:31:55.077 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:31:55.077 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T03:31:55.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T03:31:55.167 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:31:55.167 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T03:31:55.196 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T03:31:55.263 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T03:31:55.264 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:31:55.264 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T03:31:55.288 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T03:31:55.353 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:31:55.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T03:31:55.381 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T03:31:55.448 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T03:31:55.448 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:31:55.448 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T03:31:55.473 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T03:31:55.537 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:31:55.537 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T03:31:55.564 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T03:31:55.630 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T03:31:55.708 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T03:31:55.708 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2024-09-17T03:31:55.710 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2024-09-17T03:31:55.736 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T03:31:55.737 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T03:31:55.776 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T03:31:55.803 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T03:31:55.803 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T03:31:55.842 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T03:31:55.874 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T03:31:55.875 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T03:31:55.875 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T03:31:55.875 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:31:55.875 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T03:31:55.920 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T03:31:56.030 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T03:31:56.055 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:31:56.055 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T03:31:56.070 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T03:31:56.182 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T03:31:56.212 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T03:31:56.212 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T03:31:56.213 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/scrub}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908445', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 476, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '320/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBADnoF2CPF7jCZQC9bVe0lwBdm7apOX/ueWX5V3KCOQoNfe6vKILvziZZt0430tVW9H1JEiesUIYgNnzLGIJCqA=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFPxxumItLZ7a8+dE4pvjbv3ZDiZG6IHG9Q5LwqJ+FQin45kzhkb4KBAOKEBGqCQbcluMdPurQ28zb0CRjHt0xU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_02:09:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T03:31:56.213 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T03:31:56.216 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T03:31:56.262 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T03:31:56.272 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T03:31:56.328 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:31:56.328 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T03:31:56.350 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T03:31:56.350 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2024-09-17T03:31:56.405 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T03:31:56.405 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:31:56.405 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T03:31:56.405 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:31:56.405 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:31:56.405 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-17 03:31:45.533936634 +0000 2024-09-17T03:31:56.406 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-17 03:29:45.387791249 +0000 2024-09-17T03:31:56.406 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-17 03:29:45.387791249 +0000 2024-09-17T03:31:56.406 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-17 03:29:45.387791249 +0000 2024-09-17T03:31:56.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T03:31:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:31:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:31:56.469 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000197002 s, 2.6 MB/s 2024-09-17T03:31:56.470 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T03:31:56.527 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2024-09-17T03:31:56.583 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T03:31:56.583 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:31:56.583 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T03:31:56.583 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:31:56.583 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:31:56.583 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-17 03:31:45.534936618 +0000 2024-09-17T03:31:56.584 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-17 03:29:45.714786223 +0000 2024-09-17T03:31:56.584 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-17 03:29:45.714786223 +0000 2024-09-17T03:31:56.584 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-17 03:29:45.714786223 +0000 2024-09-17T03:31:56.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T03:31:56.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:31:56.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:31:56.647 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000212481 s, 2.4 MB/s 2024-09-17T03:31:56.648 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T03:31:56.705 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2024-09-17T03:31:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T03:31:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:31:56.760 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T03:31:56.760 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:31:56.760 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:31:56.760 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-17 03:31:45.534936618 +0000 2024-09-17T03:31:56.760 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-17 03:29:46.048781089 +0000 2024-09-17T03:31:56.760 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-17 03:29:46.048781089 +0000 2024-09-17T03:31:56.760 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-17 03:29:46.048781089 +0000 2024-09-17T03:31:56.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T03:31:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:31:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:31:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000216249 s, 2.4 MB/s 2024-09-17T03:31:56.824 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T03:31:56.881 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2024-09-17T03:31:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T03:31:56.937 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:31:56.937 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-17T03:31:56.937 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:31:56.937 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:31:56.937 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2024-09-17 03:31:45.534936618 +0000 2024-09-17T03:31:56.938 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2024-09-17 03:29:46.378776016 +0000 2024-09-17T03:31:56.938 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2024-09-17 03:29:46.378776016 +0000 2024-09-17T03:31:56.938 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2024-09-17 03:29:46.378776016 +0000 2024-09-17T03:31:56.938 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T03:31:57.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:31:57.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:31:57.001 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000164223 s, 3.1 MB/s 2024-09-17T03:31:57.002 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T03:31:57.058 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:31:57.058 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:31:57.059 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T03:31:57.077 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T03:31:57.077 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-09-17T03:31:57.134 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T03:31:57.135 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:31:57.135 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-17T03:31:57.135 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:31:57.135 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:31:57.135 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 03:31:43.146797257 +0000 2024-09-17T03:31:57.135 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 03:29:45.681854686 +0000 2024-09-17T03:31:57.135 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 03:29:45.681854686 +0000 2024-09-17T03:31:57.135 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 03:29:45.681854686 +0000 2024-09-17T03:31:57.135 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T03:31:57.201 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T03:31:57.201 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T03:31:57.201 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000352435 s, 1.5 MB/s 2024-09-17T03:31:57.203 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T03:31:57.261 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-09-17T03:31:57.318 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T03:31:57.319 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:31:57.319 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-17T03:31:57.319 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:31:57.319 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:31:57.319 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 03:31:43.146797257 +0000 2024-09-17T03:31:57.319 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 03:29:46.018847207 +0000 2024-09-17T03:31:57.319 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 03:29:46.018847207 +0000 2024-09-17T03:31:57.319 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 03:29:46.018847207 +0000 2024-09-17T03:31:57.319 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T03:31:57.384 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T03:31:57.384 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T03:31:57.384 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000225356 s, 2.3 MB/s 2024-09-17T03:31:57.385 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T03:31:57.442 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-09-17T03:31:57.498 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T03:31:57.498 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:31:57.498 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-17T03:31:57.498 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:31:57.498 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:31:57.499 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 03:31:43.147797235 +0000 2024-09-17T03:31:57.499 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 03:29:46.325840393 +0000 2024-09-17T03:31:57.499 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 03:29:46.325840393 +0000 2024-09-17T03:31:57.499 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 03:29:46.325840393 +0000 2024-09-17T03:31:57.499 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T03:31:57.562 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T03:31:57.562 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T03:31:57.563 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.00023847 s, 2.1 MB/s 2024-09-17T03:31:57.564 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T03:31:57.620 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-09-17T03:31:57.677 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T03:31:57.677 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:31:57.677 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-17T03:31:57.677 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:31:57.677 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:31:57.677 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 03:31:43.147797235 +0000 2024-09-17T03:31:57.677 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 03:29:46.660832958 +0000 2024-09-17T03:31:57.678 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 03:29:46.660832958 +0000 2024-09-17T03:31:57.678 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 03:29:46.660832958 +0000 2024-09-17T03:31:57.678 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T03:31:57.740 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T03:31:57.741 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T03:31:57.741 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000189895 s, 2.7 MB/s 2024-09-17T03:31:57.742 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T03:31:57.798 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:31:57.798 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T03:31:57.798 INFO:tasks.ceph:Generating config... 2024-09-17T03:31:57.799 INFO:tasks.ceph:[client] pid file = 2024-09-17T03:31:57.800 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T03:31:57.800 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-09-17T03:31:57.800 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-09-17T03:31:57.800 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T03:31:57.800 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T03:31:57.800 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T03:31:57.800 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T03:31:57.800 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T03:31:57.800 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T03:31:57.800 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T03:31:57.800 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T03:31:57.800 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-17T03:31:57.800 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T03:31:57.800 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T03:31:57.801 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T03:31:57.801 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T03:31:57.801 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T03:31:57.801 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T03:31:57.801 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T03:31:57.801 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T03:31:57.801 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T03:31:57.801 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T03:31:57.801 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T03:31:57.801 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T03:31:57.801 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T03:31:57.802 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T03:31:57.864 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T03:31:57.867 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T03:31:57.921 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:31:57.946 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.146'), ('mon.b', '172.21.15.179'), ('mon.c', '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]')] 2024-09-17T03:31:57.946 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.146,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}} 2024-09-17T03:31:57.947 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:31:57.947 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T03:31:58.002 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.146 --add b 172.21.15.179 --addv c '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:31:58.098 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:31:58.098 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: generated fsid 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:31:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:setting min_mon_release = quincy 2024-09-17T03:31:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:epoch 0 2024-09-17T03:31:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:fsid 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:31:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:last_changed 2024-09-17T03:31:58.100158+0000 2024-09-17T03:31:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:created 2024-09-17T03:31:58.100158+0000 2024-09-17T03:31:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:min_mon_release 17 (quincy) 2024-09-17T03:31:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:election_strategy: 1 2024-09-17T03:31:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:0: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.a 2024-09-17T03:31:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-09-17T03:31:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2024-09-17T03:31:58.099 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T03:31:58.100 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T03:31:58.115 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3f04b219-91f7-40f1-98fe-bc08c29ffc97... 2024-09-17T03:31:58.116 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:31:58.158 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:31:58.198 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2024-09-17T03:31:58.199 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2024-09-17T03:31:58.199 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:31:58.199 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2024-09-17T03:31:58.199 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.199 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2024-09-17T03:31:58.199 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.199 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2024-09-17T03:31:58.199 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.199 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2024-09-17T03:31:58.199 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2024-09-17T03:31:58.200 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.201 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.202 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2024-09-17T03:31:58.203 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2024-09-17T03:31:58.204 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2024-09-17T03:31:58.205 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2024-09-17T03:31:58.206 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2024-09-17T03:31:58.207 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout: mon down mkfs grace = 300 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2024-09-17T03:31:58.208 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-09-17T03:31:58.209 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-09-17T03:31:58.209 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-09-17T03:31:58.209 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-09-17T03:31:58.209 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2024-09-17T03:31:58.209 INFO:teuthology.orchestra.run.smithi146.stdout: mds cache max size = 1000 2024-09-17T03:31:58.209 INFO:teuthology.orchestra.run.smithi146.stdout: mds log max segments = 1 2024-09-17T03:31:58.209 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-17T03:31:58.209 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-17T03:31:58.210 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-17T03:31:58.211 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-17T03:31:58.212 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.146,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-17T03:31:58.213 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-17T03:31:58.214 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-09-17T03:31:58.215 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-17T03:31:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-17T03:31:58.217 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:31:58.218 INFO:teuthology.orchestra.run.smithi179.stdout: mon down mkfs grace = 300 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-17T03:31:58.219 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-17T03:31:58.220 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-17T03:31:58.220 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-17T03:31:58.220 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-17T03:31:58.220 INFO:teuthology.orchestra.run.smithi179.stdout: mds cache max size = 1000 2024-09-17T03:31:58.220 INFO:teuthology.orchestra.run.smithi179.stdout: mds log max segments = 1 2024-09-17T03:31:58.221 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T03:31:58.222 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T03:31:58.326 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T03:31:58.327 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:31:58.327 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T03:31:58.342 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:31:58.342 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T03:31:58.397 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:31:58.397 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:31:58.397 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T03:31:58.397 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:31:58.471 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:31:58.471 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:31:58.527 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:31:58.527 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:31:58.527 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T03:31:58.527 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:31:58.563 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:31:58.563 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:31:58.619 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T03:31:58.619 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T03:31:58.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T03:31:58.679 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T03:31:58.682 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T03:31:58.748 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T03:31:58.751 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T03:31:58.751 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T03:31:58.812 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T03:31:58.816 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T03:31:58.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T03:31:58.942 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T03:31:58.945 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T03:31:58.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T03:31:59.032 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T03:31:59.035 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T03:31:59.060 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T03:31:59.161 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T03:31:59.165 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T03:31:59.192 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T03:31:59.192 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T03:31:59.243 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T03:31:59.257 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T03:31:59.307 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T03:31:59.320 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T03:31:59.371 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T03:31:59.384 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T03:31:59.434 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T03:31:59.448 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T03:31:59.448 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T03:31:59.448 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T03:31:59.473 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:31:59.473 INFO:tasks.ceph:role: osd.0 2024-09-17T03:31:59.473 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:31:59.473 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T03:31:59.544 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:31:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:31:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:31:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:31:59.545 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:31:59.545 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:31:59.545 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:31:59.546 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:31:59.546 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:31:59.546 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:32:00.057 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-17T03:32:00.059 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-17T03:32:00.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T03:32:00.180 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T03:32:00.216 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T03:32:00.282 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:32:00.282 INFO:tasks.ceph:role: osd.1 2024-09-17T03:32:00.283 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:32:00.283 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T03:32:00.355 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:32:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:32:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:32:00.355 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:32:00.355 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:32:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:32:00.356 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:32:00.356 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:32:00.356 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:32:00.356 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:32:00.823 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-17T03:32:00.828 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-17T03:32:00.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T03:32:00.916 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T03:32:00.945 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T03:32:01.009 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:32:01.009 INFO:tasks.ceph:role: osd.2 2024-09-17T03:32:01.009 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:32:01.010 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T03:32:01.082 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:32:01.083 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:32:01.083 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:32:01.083 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:32:01.083 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:32:01.083 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:32:01.083 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:32:01.083 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:32:01.083 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:32:01.083 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:32:01.568 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-17T03:32:01.569 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-17T03:32:01.570 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T03:32:01.698 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T03:32:01.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T03:32:01.794 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:32:01.795 INFO:tasks.ceph:role: osd.3 2024-09-17T03:32:01.795 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:32:01.795 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T03:32:01.867 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:32:01.868 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:32:01.868 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:32:01.868 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:32:01.868 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:32:01.868 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:32:01.868 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:32:01.868 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:32:01.868 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:32:01.868 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:32:02.373 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2024-09-17T03:32:02.376 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2024-09-17T03:32:02.376 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T03:32:02.509 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T03:32:02.539 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:32:02.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:02.646+0000 7fbb4cfdb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T03:32:02.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:02.646+0000 7fbb4cfdb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T03:32:02.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:02.646+0000 7fbb4cfdb640 -1 bdev(0x557cf0381900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T03:32:02.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:02.646+0000 7fbb4cfdb640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T03:32:06.060 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T03:32:06.089 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:32:06.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:06.191+0000 7fc24ae11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T03:32:06.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:06.191+0000 7fc24ae11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T03:32:06.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:06.191+0000 7fc24ae11640 -1 bdev(0x556b4584b900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T03:32:06.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:06.191+0000 7fc24ae11640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T03:32:09.366 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T03:32:09.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:32:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:09.500+0000 7f2ca44ef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T03:32:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:09.500+0000 7f2ca44ef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T03:32:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:09.500+0000 7f2ca44ef640 -1 bdev(0x5603ff293900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T03:32:09.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:09.500+0000 7f2ca44ef640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T03:32:12.909 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T03:32:12.938 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:32:13.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:13.043+0000 7f10cca3b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T03:32:13.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:13.043+0000 7f10cca3b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T03:32:13.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:13.043+0000 7f10cca3b640 -1 bdev(0x564c967e9900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T03:32:13.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:13.044+0000 7f10cca3b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T03:32:15.956 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T03:32:15.984 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T03:32:16.015 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:32:16.015 INFO:tasks.ceph:role: osd.4 2024-09-17T03:32:16.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:32:16.016 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T03:32:16.091 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:32:16.092 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:32:16.092 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:32:16.092 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:32:16.092 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:32:16.092 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:32:16.092 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:32:16.092 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:32:16.092 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:32:16.092 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:32:16.601 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-17T03:32:16.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-17T03:32:16.601 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T03:32:16.710 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T03:32:16.740 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T03:32:16.807 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:32:16.807 INFO:tasks.ceph:role: osd.5 2024-09-17T03:32:16.807 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:32:16.807 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T03:32:16.879 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:32:16.880 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:32:16.880 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:32:16.880 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:32:16.880 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:32:16.880 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:32:16.880 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:32:16.880 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:32:16.880 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:32:16.880 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:32:17.346 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-17T03:32:17.348 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-17T03:32:17.348 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T03:32:17.432 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T03:32:17.501 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T03:32:17.565 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:32:17.565 INFO:tasks.ceph:role: osd.6 2024-09-17T03:32:17.566 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:32:17.566 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T03:32:17.637 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:32:17.637 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:32:17.637 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:32:17.637 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:32:17.637 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:32:17.637 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:32:17.638 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:32:17.638 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:32:17.638 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:32:17.638 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:32:18.167 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-17T03:32:18.169 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-17T03:32:18.169 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T03:32:18.302 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T03:32:18.332 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T03:32:18.397 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:32:18.397 INFO:tasks.ceph:role: osd.7 2024-09-17T03:32:18.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:32:18.397 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T03:32:18.470 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:32:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:32:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:32:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:32:18.470 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:32:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:32:18.470 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:32:18.470 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:32:18.470 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:32:18.470 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:32:18.947 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-17T03:32:18.949 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-17T03:32:18.949 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T03:32:19.066 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T03:32:19.096 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:32:19.208 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:19.207+0000 7f7aa160d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T03:32:19.208 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:19.207+0000 7f7aa160d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T03:32:19.208 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:19.207+0000 7f7aa160d640 -1 bdev(0x5608c152f900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T03:32:19.208 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:19.208+0000 7f7aa160d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T03:32:22.376 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T03:32:22.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:32:22.509 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:22.508+0000 7ff576a0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T03:32:22.509 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:22.508+0000 7ff576a0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T03:32:22.509 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:22.508+0000 7ff576a0d640 -1 bdev(0x5614e77c3900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T03:32:22.509 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:22.508+0000 7ff576a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T03:32:25.420 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T03:32:25.449 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:32:25.553 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:25.553+0000 7f0353a16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T03:32:25.553 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:25.553+0000 7f0353a16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T03:32:25.553 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:25.553+0000 7f0353a16640 -1 bdev(0x55a9260cd900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T03:32:25.554 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:25.553+0000 7f0353a16640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T03:32:26.215 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:32:26.218 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:32:28.968 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T03:32:28.997 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:32:29.100 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:29.100+0000 7f9fc27bf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T03:32:29.100 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:29.101+0000 7f9fc27bf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T03:32:29.100 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:29.101+0000 7f9fc27bf640 -1 bdev(0x55daaad65900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T03:32:29.100 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:29.101+0000 7f9fc27bf640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T03:32:32.264 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T03:32:32.293 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T03:32:32.293 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:32.294 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T03:32:32.324 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:32.324 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T03:32:32.393 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:32.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T03:32:32.461 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:32.461 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T03:32:32.528 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:32.528 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T03:32:32.595 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:32.595 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T03:32:32.661 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:32.661 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T03:32:32.728 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:32.728 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T03:32:32.758 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:32.758 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T03:32:32.826 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:32.826 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T03:32:32.894 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:32.894 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T03:32:32.961 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:32.961 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T03:32:33.027 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:33.027 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T03:32:33.092 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:33.092 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T03:32:33.157 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:33.157 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T03:32:33.175 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:33.175 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T03:32:33.232 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:33.232 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T03:32:33.248 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:33.248 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T03:32:33.303 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T03:32:33.304 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T03:32:33.306 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T03:32:33.347 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2024-09-17T03:32:33.347 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ== 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g== 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg== 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA== 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA== 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg== 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA== 2024-09-17T03:32:33.348 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg== 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ== 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw== 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww== 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A== 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg== 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2024-09-17T03:32:33.349 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w== 2024-09-17T03:32:33.350 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:32:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:32:33.350 INFO:teuthology.orchestra.run.smithi146.stdout:[client.2] 2024-09-17T03:32:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg== 2024-09-17T03:32:33.350 INFO:teuthology.orchestra.run.smithi146.stdout:[client.1] 2024-09-17T03:32:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig== 2024-09-17T03:32:33.350 INFO:teuthology.orchestra.run.smithi146.stdout:[client.3] 2024-09-17T03:32:33.350 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA== 2024-09-17T03:32:33.367 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2024-09-17T03:32:33.368 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ== 2024-09-17T03:32:33.368 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-17T03:32:33.368 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g== 2024-09-17T03:32:33.368 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-17T03:32:33.368 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg== 2024-09-17T03:32:33.368 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2024-09-17T03:32:33.368 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA== 2024-09-17T03:32:33.368 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2024-09-17T03:32:33.368 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA== 2024-09-17T03:32:33.368 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg== 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA== 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg== 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ== 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw== 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww== 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A== 2024-09-17T03:32:33.369 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2024-09-17T03:32:33.370 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg== 2024-09-17T03:32:33.370 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2024-09-17T03:32:33.370 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w== 2024-09-17T03:32:33.370 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2024-09-17T03:32:33.370 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:32:33.370 INFO:teuthology.orchestra.run.smithi179.stdout:[client.2] 2024-09-17T03:32:33.370 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg== 2024-09-17T03:32:33.370 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2024-09-17T03:32:33.370 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig== 2024-09-17T03:32:33.370 INFO:teuthology.orchestra.run.smithi179.stdout:[client.3] 2024-09-17T03:32:33.370 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA== 2024-09-17T03:32:33.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:32:33.394 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:32:33.474 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:32:33.478 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:32:33.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:32:33.545 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:32:33.609 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:33.612 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:33.672 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:33.675 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:33.736 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:33.738 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:33.799 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:33.802 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:33.863 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:32:33.865 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:32:33.926 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:32:33.929 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:32:33.992 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:32:33.995 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:32:34.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:34.062 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:34.123 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:34.126 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:34.187 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:34.189 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:34.250 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:34.252 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:32:34.313 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:32:34.315 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:32:34.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:32:34.381 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:32:34.446 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:32:34.449 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:32:34.514 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:32:34.516 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:32:34.581 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T03:32:34.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T03:32:34.605 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:32:34.711 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T03:32:34.736 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T03:32:34.761 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:32:34.868 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T03:32:34.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T03:32:34.958 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:32:35.064 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T03:32:35.088 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:32:35.091 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:32:35.143 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T03:32:35.143 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T03:32:35.143 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T03:32:35.147 INFO:tasks.ceph.mon.a:Started 2024-09-17T03:32:35.147 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T03:32:35.147 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T03:32:35.186 INFO:tasks.ceph.mon.b:Started 2024-09-17T03:32:35.186 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T03:32:35.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T03:32:35.188 INFO:tasks.ceph.mon.c:Started 2024-09-17T03:32:35.188 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T03:32:35.188 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T03:32:35.188 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T03:32:35.191 INFO:tasks.ceph.mgr.y:Started 2024-09-17T03:32:35.191 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T03:32:35.191 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T03:32:35.193 INFO:tasks.ceph.mgr.x:Started 2024-09-17T03:32:35.193 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T03:32:35.193 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T03:32:35.195 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T03:32:35.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T03:32:35.238 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T03:32:35.239 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T03:32:35.282 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T03:32:35.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T03:32:35.325 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T03:32:35.326 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T03:32:35.368 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T03:32:35.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T03:32:35.411 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T03:32:35.412 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T03:32:35.456 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T03:32:35.456 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T03:32:35.499 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T03:32:35.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T03:32:35.545 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T03:32:35.546 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T03:32:35.589 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T03:32:35.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T03:32:35.636 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T03:32:35.636 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T03:32:35.674 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T03:32:35.674 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T03:32:35.685 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T03:32:35.685 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T03:32:35.768 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T03:32:35.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T03:32:35.813 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T03:32:35.813 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T03:32:35.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.833+0000 7f46e6c06640 1 -- 172.21.15.146:0/3678835750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e00b4740 msgr2=0x7f46e008c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.833+0000 7f46e6c06640 1 --2- 172.21.15.146:0/3678835750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e00b4740 0x7f46e008c740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f46cc000c00 tx=0x7f46cc004730 comp rx=0 tx=0).stop 2024-09-17T03:32:35.836 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T03:32:35.836 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T03:32:35.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.837+0000 7f46e6c06640 1 -- 172.21.15.146:0/3678835750 shutdown_connections 2024-09-17T03:32:35.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.837+0000 7f46e6c06640 1 --2- 172.21.15.146:0/3678835750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46e00b5a70 0x7f46e00d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.837+0000 7f46e6c06640 1 --2- 172.21.15.146:0/3678835750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e00b4740 0x7f46e008c740 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.837+0000 7f46e6c06640 1 --2- 172.21.15.146:0/3678835750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46e0073830 0x7f46e00cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.837+0000 7f46e6c06640 1 -- 172.21.15.146:0/3678835750 >> 172.21.15.146:0/3678835750 conn(0x7f46e00b2e20 msgr2=0x7f46e0153bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:35.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.837+0000 7f46e6c06640 1 -- 172.21.15.146:0/3678835750 shutdown_connections 2024-09-17T03:32:35.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.837+0000 7f46e6c06640 1 -- 172.21.15.146:0/3678835750 wait complete. 2024-09-17T03:32:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.838+0000 7fb726ffd640 1 -- 172.21.15.146:0/945950936 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb728017020 con 0x7fb73015eb90 2024-09-17T03:32:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.839+0000 7fb738358640 1 -- 172.21.15.146:0/945950936 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7300ae620 con 0x7fb73015eb90 2024-09-17T03:32:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.841+0000 7fb726ffd640 1 -- 172.21.15.146:0/945950936 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb728010590 con 0x7fb73015eb90 2024-09-17T03:32:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.841+0000 7fb724ff9640 1 -- 172.21.15.146:0/945950936 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7300b3360 con 0x7fb73015eb90 2024-09-17T03:32:35.844 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T03:32:35.845 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T03:32:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.847+0000 7fb726ffd640 1 -- 172.21.15.146:0/945950936 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb72801e030 con 0x7fb73015eb90 2024-09-17T03:32:35.857 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T03:32:35.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T03:32:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.872+0000 7feff9c30640 1 -- 172.21.15.146:0/3397744257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefe4005270 msgr2=0x7fefe400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.872+0000 7feff9c30640 1 --2- 172.21.15.146:0/3397744257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fefe4005270 0x7fefe400b9c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fefec00c6a0 tx=0x7fefe4005830 comp rx=0 tx=0).stop 2024-09-17T03:32:35.875 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T03:32:35.875 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T03:32:35.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.872+0000 7feff3fff640 1 -- 172.21.15.146:0/3397744257 reap_dead start 2024-09-17T03:32:35.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.881+0000 7f66b4ebd640 1 -- 172.21.15.146:0/3295677404 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f6688005180 con 0x7f66b0159800 2024-09-17T03:32:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.881+0000 7feff9c30640 1 -- 172.21.15.146:0/3397744257 shutdown_connections 2024-09-17T03:32:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.881+0000 7feff9c30640 1 -- 172.21.15.146:0/3397744257 >> 172.21.15.146:0/3397744257 conn(0x7feff40d0200 msgr2=0x7feff40d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:35.891 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T03:32:35.892 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T03:32:35.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.891+0000 7f669effd640 1 -- 172.21.15.146:0/3295677404 <== mon.1 v2:172.21.15.179:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f66a801c030 con 0x7f66b0159800 2024-09-17T03:32:35.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.885+0000 7feff9c30640 1 -- 172.21.15.146:0/3397744257 shutdown_connections 2024-09-17T03:32:35.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.886+0000 7feff9c30640 1 -- 172.21.15.146:0/3397744257 wait complete. 2024-09-17T03:32:35.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.890+0000 7fa350c29640 1 -- 172.21.15.146:0/1623892920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa34c161ed0 msgr2=0x7fa34c070ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.890+0000 7fa350c29640 1 --2- 172.21.15.146:0/1623892920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa34c161ed0 0x7fa34c070ea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa34c072a10 tx=0x7fa33c02a5a0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.891+0000 7fa350c29640 1 -- 172.21.15.146:0/1623892920 shutdown_connections 2024-09-17T03:32:35.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.891+0000 7fa350c29640 1 --2- 172.21.15.146:0/1623892920 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa34c06fef0 0x7fa34c0b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.891+0000 7fa350c29640 1 --2- 172.21.15.146:0/1623892920 >> v2:172.21.15.179:3300/0 conn(0x7fa34c0b3bb0 0x7fa34c06f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.891+0000 7fa350c29640 1 --2- 172.21.15.146:0/1623892920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa34c161ed0 0x7fa34c070ea0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.891+0000 7fa350c29640 1 -- 172.21.15.146:0/1623892920 >> 172.21.15.146:0/1623892920 conn(0x7fa34c0b32d0 msgr2=0x7fa34c072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:35.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.893+0000 7feff9c30640 1 Processor -- start 2024-09-17T03:32:35.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.893+0000 7feff9c30640 1 -- start start 2024-09-17T03:32:35.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.902+0000 7feff9c30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fefe4005270 0x7feff40c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:35.906 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T03:32:35.906 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T03:32:35.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.895+0000 7fa350c29640 1 -- 172.21.15.146:0/1623892920 shutdown_connections 2024-09-17T03:32:35.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.895+0000 7fa350c29640 1 -- 172.21.15.146:0/1623892920 wait complete. 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.898+0000 7fa350c29640 1 Processor -- start 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.899+0000 7fa350c29640 1 -- start start 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.901+0000 7fa350c29640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa34c06fef0 0x7fa34c08ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.903+0000 7fa34b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa34c06fef0 0x7fa34c08ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.903+0000 7fa34b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa34c06fef0 0x7fa34c08ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57242/0 (socket says 172.21.15.146:57242) 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.903+0000 7fa34b7fe640 1 -- 172.21.15.146:0/3683309780 learned_addr learned my addr 172.21.15.146:0/3683309780 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.903+0000 7fa350c29640 1 --2- 172.21.15.146:0/3683309780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa34c0b3bb0 0x7fa34c155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.903+0000 7fa350c29640 1 --2- 172.21.15.146:0/3683309780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa34c161ed0 0x7fa34c209ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.903+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c0743e0 con 0x7fa34c06fef0 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.903+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c0b5dc0 con 0x7fa34c161ed0 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.903+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa34c074560 con 0x7fa34c0b3bb0 2024-09-17T03:32:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.904+0000 7fa34b7fe640 1 -- 172.21.15.146:0/3683309780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa34c0b3bb0 msgr2=0x7fa34c155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.904+0000 7fa34b7fe640 1 --2- 172.21.15.146:0/3683309780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa34c0b3bb0 0x7fa34c155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.904+0000 7fa34b7fe640 1 -- 172.21.15.146:0/3683309780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa34c161ed0 msgr2=0x7fa34c209ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.904+0000 7fa34b7fe640 1 --2- 172.21.15.146:0/3683309780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa34c161ed0 0x7fa34c209ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.904+0000 7fa34b7fe640 1 -- 172.21.15.146:0/3683309780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34c1567a0 con 0x7fa34c06fef0 2024-09-17T03:32:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.905+0000 7fa34b7fe640 1 --2- 172.21.15.146:0/3683309780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa34c06fef0 0x7fa34c08ca20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa33c034040 tx=0x7fa33c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.907+0000 7fa333fff640 1 -- 172.21.15.146:0/3683309780 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c035040 con 0x7fa34c06fef0 2024-09-17T03:32:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.908+0000 7feff9c30640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff4158cc0 0x7feff41590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.908+0000 7feff9c30640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff4159610 0x7feff41fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.908+0000 7feff2ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff4158cc0 0x7feff41590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.909+0000 7feff2ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff4158cc0 0x7feff41590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:52488/0 (socket says 172.21.15.146:52488) 2024-09-17T03:32:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.909+0000 7feff3fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff4159610 0x7feff41fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.909+0000 7feff3fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff4159610 0x7feff41fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:49298/0 (socket says 172.21.15.146:49298) 2024-09-17T03:32:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.909+0000 7feff2ffd640 1 -- 172.21.15.146:0/1085730916 learned_addr learned my addr 172.21.15.146:0/1085730916 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.909+0000 7feff9c30640 1 -- 172.21.15.146:0/1085730916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feff415e920 con 0x7fefe4005270 2024-09-17T03:32:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.909+0000 7feff37fe640 1 --2- 172.21.15.146:0/1085730916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fefe4005270 0x7feff40c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.909+0000 7feff9c30640 1 -- 172.21.15.146:0/1085730916 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feff40cbdc0 con 0x7feff4158cc0 2024-09-17T03:32:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.909+0000 7feff9c30640 1 -- 172.21.15.146:0/1085730916 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7feff415eaa0 con 0x7feff4159610 2024-09-17T03:32:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.910+0000 7f66b4ebd640 1 -- 172.21.15.146:0/3295677404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66b0159800 msgr2=0x7f66b0159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.910+0000 7f66b4ebd640 1 --2- 172.21.15.146:0/3295677404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66b0159800 0x7f66b0159c10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f66a8001b00 tx=0x7f66a8001fc0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.910+0000 7f66b4ebd640 1 -- 172.21.15.146:0/3295677404 shutdown_connections 2024-09-17T03:32:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.910+0000 7f66b4ebd640 1 --2- 172.21.15.146:0/3295677404 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66b0159800 0x7f66b0159c10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.910+0000 7f66b4ebd640 1 --2- 172.21.15.146:0/3295677404 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66b015b770 0x7f66b0150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.910+0000 7f66b4ebd640 1 --2- 172.21.15.146:0/3295677404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66b0070350 0x7f66b01e3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.910+0000 7f66b4ebd640 1 -- 172.21.15.146:0/3295677404 >> 172.21.15.146:0/3295677404 conn(0x7f66b00b2060 msgr2=0x7f66b00b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:35.914 DEBUG:tasks.ceph:set 22 configs 2024-09-17T03:32:35.914 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi146') 2024-09-17T03:32:35.915 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi146') 2024-09-17T03:32:35.915 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi146') 2024-09-17T03:32:35.915 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi146') 2024-09-17T03:32:35.915 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi146') 2024-09-17T03:32:35.915 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi146') 2024-09-17T03:32:35.915 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi146') 2024-09-17T03:32:35.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.911+0000 7f66b4ebd640 1 -- 172.21.15.146:0/3295677404 shutdown_connections 2024-09-17T03:32:35.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.911+0000 7f66b4ebd640 1 -- 172.21.15.146:0/3295677404 wait complete. 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.911+0000 7feff37fe640 1 -- 172.21.15.146:0/1085730916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff4159610 msgr2=0x7feff41fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.911+0000 7feff37fe640 1 --2- 172.21.15.146:0/1085730916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff4159610 0x7feff41fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.911+0000 7feff37fe640 1 -- 172.21.15.146:0/1085730916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff4158cc0 msgr2=0x7feff41590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.911+0000 7feff37fe640 1 --2- 172.21.15.146:0/1085730916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff4158cc0 0x7feff41590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.911+0000 7feff37fe640 1 -- 172.21.15.146:0/1085730916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff4158500 con 0x7fefe4005270 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.911+0000 7feff37fe640 1 --2- 172.21.15.146:0/1085730916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fefe4005270 0x7feff40c91c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fefe800b440 tx=0x7fefe800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.912+0000 7fefdffff640 1 -- 172.21.15.146:0/1085730916 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8015020 con 0x7fefe4005270 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.912+0000 7fefdffff640 1 -- 172.21.15.146:0/1085730916 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefe8011980 con 0x7fefe4005270 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.912+0000 7feff9c30640 1 -- 172.21.15.146:0/1085730916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff40ae3d0 con 0x7fefe4005270 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.912+0000 7feff9c30640 1 -- 172.21.15.146:0/1085730916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff40ae990 con 0x7fefe4005270 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.915+0000 7fefdffff640 1 -- 172.21.15.146:0/1085730916 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8011db0 con 0x7fefe4005270 2024-09-17T03:32:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.915+0000 7fefdffff640 1 -- 172.21.15.146:0/1085730916 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fefe8018020 con 0x7fefe4005270 2024-09-17T03:32:35.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.916+0000 7fefdffff640 1 -- 172.21.15.146:0/1085730916 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fefe8010930 con 0x7fefe4005270 2024-09-17T03:32:35.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.907+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa34c156a80 con 0x7fa34c06fef0 2024-09-17T03:32:35.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.917+0000 7fefddffb640 1 -- 172.21.15.146:0/1085730916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff40ccc60 con 0x7fefe4005270 2024-09-17T03:32:35.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.907+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa34c207de0 con 0x7fa34c06fef0 2024-09-17T03:32:35.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.907+0000 7fa333fff640 1 -- 172.21.15.146:0/3683309780 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa33c04a070 con 0x7fa34c06fef0 2024-09-17T03:32:35.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.907+0000 7fa333fff640 1 -- 172.21.15.146:0/3683309780 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c045cd0 con 0x7fa34c06fef0 2024-09-17T03:32:35.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.917+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32c005290 con 0x7fa34c06fef0 2024-09-17T03:32:35.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.921+0000 7fa333fff640 1 -- 172.21.15.146:0/3683309780 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa33c0047a0 con 0x7fa34c06fef0 2024-09-17T03:32:35.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.921+0000 7fa333fff640 1 -- 172.21.15.146:0/3683309780 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa33c04f460 con 0x7fa34c06fef0 2024-09-17T03:32:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.930+0000 7fefdffff640 1 -- 172.21.15.146:0/1085730916 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fefe801f020 con 0x7fefe4005270 2024-09-17T03:32:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.931+0000 7fa333fff640 1 -- 172.21.15.146:0/3683309780 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa33c004a90 con 0x7fa34c06fef0 2024-09-17T03:32:35.959 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi146') 2024-09-17T03:32:35.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.967+0000 7fd5a98dc640 1 -- 172.21.15.146:0/2299112996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd58c004e60 msgr2=0x7fd58c0052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.967+0000 7fd5a98dc640 1 --2- 172.21.15.146:0/2299112996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd58c004e60 0x7fd58c0052d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd594006f80 tx=0x7fd58c005830 comp rx=0 tx=0).stop 2024-09-17T03:32:35.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.967+0000 7fd5a37fe640 1 -- 172.21.15.146:0/2299112996 reap_dead start 2024-09-17T03:32:35.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.972+0000 7fd5a98dc640 1 -- 172.21.15.146:0/2299112996 shutdown_connections 2024-09-17T03:32:35.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.972+0000 7fd5a98dc640 1 -- 172.21.15.146:0/2299112996 >> 172.21.15.146:0/2299112996 conn(0x7fd5a40b2db0 msgr2=0x7fd5a40b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:35.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.972+0000 7fd5a98dc640 1 -- 172.21.15.146:0/2299112996 shutdown_connections 2024-09-17T03:32:35.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.972+0000 7fd5a98dc640 1 -- 172.21.15.146:0/2299112996 wait complete. 2024-09-17T03:32:35.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.975+0000 7fd5a98dc640 1 Processor -- start 2024-09-17T03:32:35.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.975+0000 7fd5a98dc640 1 -- start start 2024-09-17T03:32:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.978+0000 7fd5a98dc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd58c004e60 0x7fd5a42028b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.978+0000 7fd5a98dc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5a4153bf0 0x7fd5a4206a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.979+0000 7fd5a98dc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a41f91f0 0x7fd5a406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:35.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.979+0000 7fd5a98dc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a40af250 con 0x7fd5a41f91f0 2024-09-17T03:32:35.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.979+0000 7fd5a37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a41f91f0 0x7fd5a406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:35.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.979+0000 7fd5a37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a41f91f0 0x7fd5a406fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57276/0 (socket says 172.21.15.146:57276) 2024-09-17T03:32:35.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.979+0000 7fd5a37fe640 1 -- 172.21.15.146:0/3278979106 learned_addr learned my addr 172.21.15.146:0/3278979106 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:35.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.979+0000 7fd5a27fc640 1 --2- 172.21.15.146:0/3278979106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5a4153bf0 0x7fd5a4206a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:35.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.979+0000 7fd5a2ffd640 1 --2- 172.21.15.146:0/3278979106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd58c004e60 0x7fd5a42028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:35.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.979+0000 7fd5a98dc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a40af0d0 con 0x7fd58c004e60 2024-09-17T03:32:35.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.979+0000 7fd5a98dc640 1 -- 172.21.15.146:0/3278979106 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a40712a0 con 0x7fd5a4153bf0 2024-09-17T03:32:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.980+0000 7fd5a37fe640 1 -- 172.21.15.146:0/3278979106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5a4153bf0 msgr2=0x7fd5a4206a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.980+0000 7fd5a37fe640 1 --2- 172.21.15.146:0/3278979106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5a4153bf0 0x7fd5a4206a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.980+0000 7fd5a37fe640 1 -- 172.21.15.146:0/3278979106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd58c004e60 msgr2=0x7fd5a42028b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.980+0000 7fd5a37fe640 1 --2- 172.21.15.146:0/3278979106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd58c004e60 0x7fd5a42028b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.980+0000 7fd5a37fe640 1 -- 172.21.15.146:0/3278979106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a4203100 con 0x7fd5a41f91f0 2024-09-17T03:32:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.981+0000 7fd5a27fc640 1 --2- 172.21.15.146:0/3278979106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5a4153bf0 0x7fd5a4206a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:32:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.981+0000 7fd5a37fe640 1 --2- 172.21.15.146:0/3278979106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a41f91f0 0x7fd5a406fb50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd594006f80 tx=0x7fd594003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.981+0000 7fd5a2ffd640 1 --2- 172.21.15.146:0/3278979106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd58c004e60 0x7fd5a42028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:32:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.982+0000 7fd58bfff640 1 -- 172.21.15.146:0/3278979106 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594032070 con 0x7fd5a41f91f0 2024-09-17T03:32:35.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.982+0000 7fd58bfff640 1 -- 172.21.15.146:0/3278979106 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd59402e460 con 0x7fd5a41f91f0 2024-09-17T03:32:35.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.982+0000 7fd5a98dc640 1 -- 172.21.15.146:0/3278979106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a42033e0 con 0x7fd5a41f91f0 2024-09-17T03:32:35.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.982+0000 7fd5a98dc640 1 -- 172.21.15.146:0/3278979106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a4154030 con 0x7fd5a41f91f0 2024-09-17T03:32:35.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.984+0000 7fd58bfff640 1 -- 172.21.15.146:0/3278979106 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594006bd0 con 0x7fd5a41f91f0 2024-09-17T03:32:35.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.984+0000 7f5d2359e640 1 -- 172.21.15.146:0/770421594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d0c003aa0 msgr2=0x7f5d0c003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:35.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.986+0000 7fd589ffb640 1 -- 172.21.15.146:0/3278979106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd584005290 con 0x7fd5a41f91f0 2024-09-17T03:32:35.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.990+0000 7fd58bfff640 1 -- 172.21.15.146:0/3278979106 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd594035020 con 0x7fd5a41f91f0 2024-09-17T03:32:35.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.990+0000 7fd58bfff640 1 -- 172.21.15.146:0/3278979106 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd594042930 con 0x7fd5a41f91f0 2024-09-17T03:32:35.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.991+0000 7fd58bfff640 1 -- 172.21.15.146:0/3278979106 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd594042c40 con 0x7fd5a41f91f0 2024-09-17T03:32:35.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.984+0000 7f5d2359e640 1 --2- 172.21.15.146:0/770421594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d0c003aa0 0x7f5d0c003f10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5d140016c0 tx=0x7f5d0c005830 comp rx=0 tx=0).stop 2024-09-17T03:32:35.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.995+0000 7f5d2359e640 1 -- 172.21.15.146:0/770421594 shutdown_connections 2024-09-17T03:32:35.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.995+0000 7f5d2359e640 1 --2- 172.21.15.146:0/770421594 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d0c003aa0 0x7f5d0c003f10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:35.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.995+0000 7f5d2359e640 1 -- 172.21.15.146:0/770421594 >> 172.21.15.146:0/770421594 conn(0x7f5d240b2010 msgr2=0x7f5d240b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:35.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.995+0000 7f5d2359e640 1 -- 172.21.15.146:0/770421594 shutdown_connections 2024-09-17T03:32:35.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.995+0000 7f5d2359e640 1 -- 172.21.15.146:0/770421594 wait complete. 2024-09-17T03:32:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.998+0000 7f5d2359e640 1 Processor -- start 2024-09-17T03:32:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:35.998+0000 7f5d2359e640 1 -- start start 2024-09-17T03:32:36.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.011+0000 7f5d2359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d0c003aa0 0x7f5d24202ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.011+0000 7f5d2359e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d24095a50 0x7f5d240951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.011+0000 7f5d2359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d24091fc0 0x7f5d240923d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.011+0000 7f5d2359e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2406ee40 con 0x7f5d0c003aa0 2024-09-17T03:32:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.011+0000 7f5d2359e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2406ecc0 con 0x7f5d24095a50 2024-09-17T03:32:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.011+0000 7f5d2359e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2406efc0 con 0x7f5d24091fc0 2024-09-17T03:32:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.011+0000 7f5d2259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d0c003aa0 0x7f5d24202ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.011+0000 7f5d2259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d0c003aa0 0x7f5d24202ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57288/0 (socket says 172.21.15.146:57288) 2024-09-17T03:32:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.011+0000 7f5d2259c640 1 -- 172.21.15.146:0/486940090 learned_addr learned my addr 172.21.15.146:0/486940090 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.012+0000 7f5d2259c640 1 -- 172.21.15.146:0/486940090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d24091fc0 msgr2=0x7f5d240923d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:32:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.012+0000 7f5d2259c640 1 --2- 172.21.15.146:0/486940090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d24091fc0 0x7f5d240923d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.012+0000 7f5d2259c640 1 -- 172.21.15.146:0/486940090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d24095a50 msgr2=0x7f5d240951f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:32:36.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.012+0000 7f5d2259c640 1 --2- 172.21.15.146:0/486940090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d24095a50 0x7f5d240951f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.012+0000 7f5d2259c640 1 -- 172.21.15.146:0/486940090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d24092910 con 0x7f5d0c003aa0 2024-09-17T03:32:36.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.012+0000 7f5d2259c640 1 --2- 172.21.15.146:0/486940090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d0c003aa0 0x7f5d24202ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5d140017e0 tx=0x7f5d14006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.012+0000 7f5d12ffd640 1 -- 172.21.15.146:0/486940090 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14003800 con 0x7f5d0c003aa0 2024-09-17T03:32:36.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.012+0000 7f5d12ffd640 1 -- 172.21.15.146:0/486940090 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d140039a0 con 0x7f5d0c003aa0 2024-09-17T03:32:36.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.014+0000 7f5d12ffd640 1 -- 172.21.15.146:0/486940090 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14003df0 con 0x7f5d0c003aa0 2024-09-17T03:32:36.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.014+0000 7f5d2359e640 1 -- 172.21.15.146:0/486940090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2408f7e0 con 0x7f5d0c003aa0 2024-09-17T03:32:36.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.014+0000 7f5d2359e640 1 -- 172.21.15.146:0/486940090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d24091aa0 con 0x7f5d0c003aa0 2024-09-17T03:32:36.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.016+0000 7f5d12ffd640 1 -- 172.21.15.146:0/486940090 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5d14044020 con 0x7f5d0c003aa0 2024-09-17T03:32:36.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.016+0000 7f5d12ffd640 1 -- 172.21.15.146:0/486940090 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5d140338c0 con 0x7f5d0c003aa0 2024-09-17T03:32:36.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.018+0000 7f5d10ff9640 1 -- 172.21.15.146:0/486940090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d24097a70 con 0x7f5d0c003aa0 2024-09-17T03:32:36.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.018+0000 7f8d6a4fc640 1 -- 172.21.15.146:0/1142289742 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f8d44001690 con 0x7f8d64151500 2024-09-17T03:32:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.022+0000 7f5d12ffd640 1 -- 172.21.15.146:0/486940090 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5d24092910 con 0x7f5d0c003aa0 2024-09-17T03:32:36.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.028+0000 7f8d59ffb640 1 -- 172.21.15.146:0/1142289742 <== mon.2 v2:172.21.15.179:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f8d5c0059f0 con 0x7f8d64151500 2024-09-17T03:32:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.029+0000 7f8d4f7fe640 1 -- 172.21.15.146:0/1142289742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d64151500 msgr2=0x7f8d64151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.029+0000 7f8d4f7fe640 1 --2- 172.21.15.146:0/1142289742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d64151500 0x7f8d64151910 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8d50004780 tx=0x7f8d5c00eec0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.030+0000 7f8d4f7fe640 1 -- 172.21.15.146:0/1142289742 shutdown_connections 2024-09-17T03:32:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.030+0000 7f8d4f7fe640 1 --2- 172.21.15.146:0/1142289742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d64151500 0x7f8d64151910 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.030+0000 7f8d4f7fe640 1 --2- 172.21.15.146:0/1142289742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d641503e0 0x7f8d64150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.030+0000 7f8d4f7fe640 1 --2- 172.21.15.146:0/1142289742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d50004800 0x7f8d6415b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.030+0000 7f8d4f7fe640 1 -- 172.21.15.146:0/1142289742 >> 172.21.15.146:0/1142289742 conn(0x7f8d640b32d0 msgr2=0x7f8d640b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.030+0000 7f8d4f7fe640 1 -- 172.21.15.146:0/1142289742 shutdown_connections 2024-09-17T03:32:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.030+0000 7f8d4f7fe640 1 -- 172.21.15.146:0/1142289742 wait complete. 2024-09-17T03:32:36.061 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.117+0000 7f10a8fff640 1 -- 172.21.15.146:0/231255347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f109c0df800 msgr2=0x7f109c007ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.117+0000 7f10a8fff640 1 --2- 172.21.15.146:0/231255347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f109c0df800 0x7f109c007ca0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f109c00f350 tx=0x7f109402b5b0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.117+0000 7f10a8fff640 1 -- 172.21.15.146:0/231255347 shutdown_connections 2024-09-17T03:32:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.117+0000 7f10a8fff640 1 --2- 172.21.15.146:0/231255347 >> v2:172.21.15.146:3300/0 conn(0x7f109c0519a0 0x7f109c051db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.117+0000 7f10a8fff640 1 --2- 172.21.15.146:0/231255347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f109c0df800 0x7f109c007ca0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.117+0000 7f10a8fff640 1 -- 172.21.15.146:0/231255347 >> 172.21.15.146:0/231255347 conn(0x7f109c01e260 msgr2=0x7f109c039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.124+0000 7f10a8fff640 1 -- 172.21.15.146:0/231255347 shutdown_connections 2024-09-17T03:32:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.124+0000 7f10a8fff640 1 -- 172.21.15.146:0/231255347 wait complete. 2024-09-17T03:32:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.128+0000 7f10a8fff640 1 Processor -- start 2024-09-17T03:32:36.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.128+0000 7f10a8fff640 1 -- start start 2024-09-17T03:32:36.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.130+0000 7f10a8fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f109c006860 0x7f109c04ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7f10a8fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f109c0519a0 0x7f109c0d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7f10a259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f109c006860 0x7f109c04ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7f10a259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f109c006860 0x7f109c04ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:49348/0 (socket says 172.21.15.146:49348) 2024-09-17T03:32:36.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7f10a1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f109c0519a0 0x7f109c0d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7f10a1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f109c0519a0 0x7f109c0d14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57334/0 (socket says 172.21.15.146:57334) 2024-09-17T03:32:36.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7f10a8fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f109c0df800 0x7f109c0338c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7f10a1d9b640 1 -- 172.21.15.146:0/2579627379 learned_addr learned my addr 172.21.15.146:0/2579627379 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f109c0548a0 con 0x7f109c0519a0 2024-09-17T03:32:36.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f109c054720 con 0x7f109c0df800 2024-09-17T03:32:36.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f109c054a20 con 0x7f109c006860 2024-09-17T03:32:36.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7fc114890640 1 -- 172.21.15.146:0/2786574113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc108036970 msgr2=0x7fc10801c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.138+0000 7fc114890640 1 --2- 172.21.15.146:0/2786574113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc108036970 0x7fc10801c5b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc11002ebd0 tx=0x7fc11006b770 comp rx=0 tx=0).stop 2024-09-17T03:32:36.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.139+0000 7f10a2d9d640 1 --2- 172.21.15.146:0/2579627379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f109c0df800 0x7f109c0338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.139+0000 7f10a259c640 1 -- 172.21.15.146:0/2579627379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f109c0df800 msgr2=0x7f109c0338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.139+0000 7f10a259c640 1 --2- 172.21.15.146:0/2579627379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f109c0df800 0x7f109c0338c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.139+0000 7f10a259c640 1 -- 172.21.15.146:0/2579627379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f109c0519a0 msgr2=0x7f109c0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.139+0000 7f10a259c640 1 --2- 172.21.15.146:0/2579627379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f109c0519a0 0x7f109c0d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.139+0000 7f10a259c640 1 -- 172.21.15.146:0/2579627379 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109c04c0a0 con 0x7f109c006860 2024-09-17T03:32:36.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.140+0000 7f10a259c640 1 --2- 172.21.15.146:0/2579627379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f109c006860 0x7f109c04ebb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1094032000 tx=0x7f1094004300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.141+0000 7fb724ff9640 1 -- 172.21.15.146:0/945950936 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fb730073ea0 con 0x7fb73015eb90 2024-09-17T03:32:36.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.139+0000 7fc114890640 1 -- 172.21.15.146:0/2786574113 shutdown_connections 2024-09-17T03:32:36.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.139+0000 7fc114890640 1 --2- 172.21.15.146:0/2786574113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc108036970 0x7fc10801c5b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.139+0000 7fc114890640 1 --2- 172.21.15.146:0/2786574113 >> v2:172.21.15.146:3300/0 conn(0x7fc108005c60 0x7fc108036430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.139+0000 7fc114890640 1 --2- 172.21.15.146:0/2786574113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc108009ba0 0x7fc1080df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.139+0000 7fc114890640 1 -- 172.21.15.146:0/2786574113 >> 172.21.15.146:0/2786574113 conn(0x7fc108051420 msgr2=0x7fc108051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.142+0000 7fc114890640 1 -- 172.21.15.146:0/2786574113 shutdown_connections 2024-09-17T03:32:36.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.142+0000 7fc114890640 1 -- 172.21.15.146:0/2786574113 wait complete. 2024-09-17T03:32:36.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.145+0000 7fc114890640 1 Processor -- start 2024-09-17T03:32:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.146+0000 7fc114890640 1 -- start start 2024-09-17T03:32:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.148+0000 7fc114890640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc108005c60 0x7fc10818a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.148+0000 7f1092ffd640 1 -- 172.21.15.146:0/2579627379 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094005220 con 0x7f109c006860 2024-09-17T03:32:36.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.149+0000 7fc114890640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc108009ba0 0x7fc1080e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.149+0000 7fc114890640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc108036970 0x7fc1080dded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.149+0000 7fc10effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc108009ba0 0x7fc1080e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.149+0000 7fc114890640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc10800bdb0 con 0x7fc108009ba0 2024-09-17T03:32:36.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.149+0000 7fc10effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc108009ba0 0x7fc1080e3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57340/0 (socket says 172.21.15.146:57340) 2024-09-17T03:32:36.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.149+0000 7fc10effd640 1 -- 172.21.15.146:0/3068456387 learned_addr learned my addr 172.21.15.146:0/3068456387 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.149+0000 7fc10f7fe640 1 --2- 172.21.15.146:0/3068456387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc108005c60 0x7fc10818a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.149+0000 7fc114890640 1 -- 172.21.15.146:0/3068456387 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc10800bc30 con 0x7fc108005c60 2024-09-17T03:32:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.149+0000 7fc114890640 1 -- 172.21.15.146:0/3068456387 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc10801caf0 con 0x7fc108036970 2024-09-17T03:32:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.150+0000 7fc10effd640 1 -- 172.21.15.146:0/3068456387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc108036970 msgr2=0x7fc1080dded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.150+0000 7fc10effd640 1 --2- 172.21.15.146:0/3068456387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc108036970 0x7fc1080dded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.150+0000 7fc10effd640 1 -- 172.21.15.146:0/3068456387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc108005c60 msgr2=0x7fc10818a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.150+0000 7fc10effd640 1 --2- 172.21.15.146:0/3068456387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc108005c60 0x7fc10818a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.150+0000 7fc10effd640 1 -- 172.21.15.146:0/3068456387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1080dce30 con 0x7fc108009ba0 2024-09-17T03:32:36.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.150+0000 7fc10effd640 1 --2- 172.21.15.146:0/3068456387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc108009ba0 0x7fc1080e3c20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00b440 tx=0x7fc0fc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.148+0000 7f1092ffd640 1 -- 172.21.15.146:0/2579627379 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10940054b0 con 0x7f109c006860 2024-09-17T03:32:36.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.148+0000 7f1092ffd640 1 -- 172.21.15.146:0/2579627379 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094003a60 con 0x7f109c006860 2024-09-17T03:32:36.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.149+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109c0d7a30 con 0x7f109c006860 2024-09-17T03:32:36.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.149+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f109c032d70 con 0x7f109c006860 2024-09-17T03:32:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.153+0000 7fb726ffd640 1 -- 172.21.15.146:0/945950936 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7fb728010790 con 0x7fb73015eb90 2024-09-17T03:32:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.160+0000 7f1092ffd640 1 -- 172.21.15.146:0/2579627379 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f109402bd10 con 0x7f109c006860 2024-09-17T03:32:36.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.160+0000 7f1092ffd640 1 -- 172.21.15.146:0/2579627379 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f109403c410 con 0x7f109c006860 2024-09-17T03:32:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.161+0000 7fb738358640 1 -- 172.21.15.146:0/945950936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb73015eb90 msgr2=0x7fb7300ad530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.161+0000 7fb738358640 1 --2- 172.21.15.146:0/945950936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb73015eb90 0x7fb7300ad530 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb730163700 tx=0x7fb72800ca30 comp rx=0 tx=0).stop 2024-09-17T03:32:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.161+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f109c007560 con 0x7f109c006860 2024-09-17T03:32:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.161+0000 7fc0fbfff640 1 -- 172.21.15.146:0/3068456387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc015020 con 0x7fc108009ba0 2024-09-17T03:32:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.161+0000 7fc0fbfff640 1 -- 172.21.15.146:0/3068456387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0fc011980 con 0x7fc108009ba0 2024-09-17T03:32:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.161+0000 7fc0fbfff640 1 -- 172.21.15.146:0/3068456387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc011dd0 con 0x7fc108009ba0 2024-09-17T03:32:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.162+0000 7fb738358640 1 -- 172.21.15.146:0/945950936 shutdown_connections 2024-09-17T03:32:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.162+0000 7fb738358640 1 --2- 172.21.15.146:0/945950936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb730163120 0x7fb730161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.162+0000 7fb738358640 1 --2- 172.21.15.146:0/945950936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb730162600 0x7fb730206780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.162+0000 7fb738358640 1 --2- 172.21.15.146:0/945950936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb73015eb90 0x7fb7300ad530 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.162+0000 7fb738358640 1 -- 172.21.15.146:0/945950936 >> 172.21.15.146:0/945950936 conn(0x7fb7300b2060 msgr2=0x7fb730162a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.162+0000 7fc10f7fe640 1 --2- 172.21.15.146:0/3068456387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc108005c60 0x7fc10818a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:32:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.162+0000 7fc114890640 1 -- 172.21.15.146:0/3068456387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1080dd110 con 0x7fc108009ba0 2024-09-17T03:32:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.162+0000 7fc0fbfff640 1 -- 172.21.15.146:0/3068456387 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc0fc018020 con 0x7fc108009ba0 2024-09-17T03:32:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.162+0000 7fc114890640 1 -- 172.21.15.146:0/3068456387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1080dd6d0 con 0x7fc108009ba0 2024-09-17T03:32:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.163+0000 7fc0fbfff640 1 -- 172.21.15.146:0/3068456387 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc0fc0103e0 con 0x7fc108009ba0 2024-09-17T03:32:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.165+0000 7fc0f9ffb640 1 -- 172.21.15.146:0/3068456387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f0005290 con 0x7fc108009ba0 2024-09-17T03:32:36.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.166+0000 7fb738358640 1 -- 172.21.15.146:0/945950936 shutdown_connections 2024-09-17T03:32:36.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.166+0000 7fb738358640 1 -- 172.21.15.146:0/945950936 wait complete. 2024-09-17T03:32:36.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.166+0000 7f1092ffd640 1 -- 172.21.15.146:0/2579627379 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1094040030 con 0x7f109c006860 2024-09-17T03:32:36.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.176+0000 7fc0fbfff640 1 -- 172.21.15.146:0/3068456387 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc0fc01f020 con 0x7fc108009ba0 2024-09-17T03:32:36.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.176+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fa32c005580 con 0x7fa34c06fef0 2024-09-17T03:32:36.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.187+0000 7fefddffb640 1 -- 172.21.15.146:0/1085730916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7feff4072d90 con 0x7fefe4005270 2024-09-17T03:32:36.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.191+0000 7fa333fff640 1 -- 172.21.15.146:0/3683309780 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v11)=0 v11) ==== 121+0+0 (secure 0 0 0) 0x7fa33c004cc0 con 0x7fa34c06fef0 2024-09-17T03:32:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.193+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa34c06fef0 msgr2=0x7fa34c08ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.193+0000 7fa350c29640 1 --2- 172.21.15.146:0/3683309780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa34c06fef0 0x7fa34c08ca20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa33c034040 tx=0x7fa33c003c00 comp rx=0 tx=0).stop 2024-09-17T03:32:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.193+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 shutdown_connections 2024-09-17T03:32:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.193+0000 7fa350c29640 1 --2- 172.21.15.146:0/3683309780 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa34c161ed0 0x7fa34c209ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.193+0000 7fa350c29640 1 --2- 172.21.15.146:0/3683309780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa34c0b3bb0 0x7fa34c155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.193+0000 7fa350c29640 1 --2- 172.21.15.146:0/3683309780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa34c06fef0 0x7fa34c08ca20 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa33c034040 tx=0x7fa33c003c00 comp rx=0 tx=0).stop 2024-09-17T03:32:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.193+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 >> 172.21.15.146:0/3683309780 conn(0x7fa34c0b32d0 msgr2=0x7fa34c162bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.193+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 shutdown_connections 2024-09-17T03:32:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.194+0000 7fa350c29640 1 -- 172.21.15.146:0/3683309780 wait complete. 2024-09-17T03:32:36.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.198+0000 7fefdffff640 1 -- 172.21.15.146:0/1085730916 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fefe800d040 con 0x7fefe4005270 2024-09-17T03:32:36.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.210+0000 7feff9c30640 1 -- 172.21.15.146:0/1085730916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fefe4005270 msgr2=0x7feff40c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.210+0000 7feff9c30640 1 --2- 172.21.15.146:0/1085730916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fefe4005270 0x7feff40c91c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fefe800b440 tx=0x7fefe800b900 comp rx=0 tx=0).stop 2024-09-17T03:32:36.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.210+0000 7feff9c30640 1 -- 172.21.15.146:0/1085730916 shutdown_connections 2024-09-17T03:32:36.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.211+0000 7feff9c30640 1 --2- 172.21.15.146:0/1085730916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feff4159610 0x7feff41fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.211+0000 7feff9c30640 1 --2- 172.21.15.146:0/1085730916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feff4158cc0 0x7feff41590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.211+0000 7feff9c30640 1 --2- 172.21.15.146:0/1085730916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fefe4005270 0x7feff40c91c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.211+0000 7feff9c30640 1 -- 172.21.15.146:0/1085730916 >> 172.21.15.146:0/1085730916 conn(0x7feff40d0200 msgr2=0x7feff415f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.214+0000 7feff9c30640 1 -- 172.21.15.146:0/1085730916 shutdown_connections 2024-09-17T03:32:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.214+0000 7feff9c30640 1 -- 172.21.15.146:0/1085730916 wait complete. 2024-09-17T03:32:36.220 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.227+0000 7fdb9e519640 1 -- 172.21.15.146:0/4044906170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb90051620 msgr2=0x7fdb90051a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.227+0000 7fdb9e519640 1 --2- 172.21.15.146:0/4044906170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb90051620 0x7fdb90051a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdb94013f30 tx=0x7fdb94032810 comp rx=0 tx=0).stop 2024-09-17T03:32:36.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.230+0000 7fdb9e519640 1 -- 172.21.15.146:0/4044906170 shutdown_connections 2024-09-17T03:32:36.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.230+0000 7fdb9e519640 1 --2- 172.21.15.146:0/4044906170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb90051620 0x7fdb90051a30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.231+0000 7fdb9e519640 1 -- 172.21.15.146:0/4044906170 >> 172.21.15.146:0/4044906170 conn(0x7fdb9001d990 msgr2=0x7fdb90039650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.231+0000 7fdb9e519640 1 -- 172.21.15.146:0/4044906170 shutdown_connections 2024-09-17T03:32:36.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.231+0000 7fdb9e519640 1 -- 172.21.15.146:0/4044906170 wait complete. 2024-09-17T03:32:36.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.234+0000 7fdb9e519640 1 Processor -- start 2024-09-17T03:32:36.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.235+0000 7fdb9e519640 1 -- start start 2024-09-17T03:32:36.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.237+0000 7fdb9e519640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb90051620 0x7fdb900dd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.237+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2878100104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9be00053a0 msgr2=0x7f9be000ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.237+0000 7f9bfb4ce640 1 --2- 172.21.15.146:0/2878100104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9be00053a0 0x7f9be000ba20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0046a0 tx=0x7f9be0005830 comp rx=0 tx=0).stop 2024-09-17T03:32:36.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.237+0000 7fdb9e519640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb90052350 0x7fdb90186550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.237+0000 7fdb9d517640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb90051620 0x7fdb900dd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.237+0000 7fdb9d517640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb90051620 0x7fdb900dd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:49366/0 (socket says 172.21.15.146:49366) 2024-09-17T03:32:36.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.237+0000 7f9bf9a6b640 1 -- 172.21.15.146:0/2878100104 reap_dead start 2024-09-17T03:32:36.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2878100104 shutdown_connections 2024-09-17T03:32:36.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7fd589ffb640 1 -- 172.21.15.146:0/3278979106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fd584005850 con 0x7fd5a41f91f0 2024-09-17T03:32:36.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7f3c20615640 1 -- 172.21.15.146:0/2319777459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c1808ca60 msgr2=0x7f3c1816f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7f3c20615640 1 --2- 172.21.15.146:0/2319777459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c1808ca60 0x7f3c1816f280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3c140097e0 tx=0x7f3c1402a3b0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7f3c20615640 1 -- 172.21.15.146:0/2319777459 shutdown_connections 2024-09-17T03:32:36.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7f3c20615640 1 --2- 172.21.15.146:0/2319777459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c1808ca60 0x7f3c1816f280 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7f3c20615640 1 -- 172.21.15.146:0/2319777459 >> 172.21.15.146:0/2319777459 conn(0x7f3c180b2060 msgr2=0x7f3c180b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7fdb9cd16640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb90052350 0x7fdb90186550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7fdb9cd16640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb90052350 0x7fdb90186550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57382/0 (socket says 172.21.15.146:57382) 2024-09-17T03:32:36.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7fdb9d517640 1 -- 172.21.15.146:0/1593095054 learned_addr learned my addr 172.21.15.146:0/1593095054 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7fdb9e519640 1 --2- 172.21.15.146:0/1593095054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90054710 0x7fdb900e0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7fdb9e519640 1 -- 172.21.15.146:0/1593095054 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdb90052760 con 0x7fdb90052350 2024-09-17T03:32:36.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7fdb9dd18640 1 --2- 172.21.15.146:0/1593095054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90054710 0x7fdb900e0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7fdb9e519640 1 -- 172.21.15.146:0/1593095054 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdb90052180 con 0x7fdb90054710 2024-09-17T03:32:36.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7fdb9e519640 1 -- 172.21.15.146:0/1593095054 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdb900528e0 con 0x7fdb90051620 2024-09-17T03:32:36.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.239+0000 7fdb9dd18640 1 -- 172.21.15.146:0/1593095054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb90051620 msgr2=0x7fdb900dd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.239+0000 7fdb9dd18640 1 --2- 172.21.15.146:0/1593095054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb90051620 0x7fdb900dd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.239+0000 7fdb9dd18640 1 -- 172.21.15.146:0/1593095054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb90052350 msgr2=0x7fdb90186550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.239+0000 7fdb9dd18640 1 --2- 172.21.15.146:0/1593095054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb90052350 0x7fdb90186550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.239+0000 7fdb9dd18640 1 -- 172.21.15.146:0/1593095054 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb900ddf60 con 0x7fdb90054710 2024-09-17T03:32:36.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.239+0000 7fdb9cd16640 1 --2- 172.21.15.146:0/1593095054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb90052350 0x7fdb90186550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:32:36.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.240+0000 7fdb9dd18640 1 --2- 172.21.15.146:0/1593095054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90054710 0x7fdb900e0410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb9806c6a0 tx=0x7fdb9806a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2878100104 >> 172.21.15.146:0/2878100104 conn(0x7f9bf40b2060 msgr2=0x7f9bf40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.240+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2878100104 shutdown_connections 2024-09-17T03:32:36.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.240+0000 7fdb8dffb640 1 -- 172.21.15.146:0/1593095054 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb980753c0 con 0x7fdb90054710 2024-09-17T03:32:36.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.240+0000 7fdb8dffb640 1 -- 172.21.15.146:0/1593095054 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb98075650 con 0x7fdb90054710 2024-09-17T03:32:36.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.240+0000 7fdb9e519640 1 -- 172.21.15.146:0/1593095054 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb900dda50 con 0x7fdb90054710 2024-09-17T03:32:36.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.241+0000 7fdb9e519640 1 -- 172.21.15.146:0/1593095054 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb90186e70 con 0x7fdb90054710 2024-09-17T03:32:36.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.242+0000 7fdb8dffb640 1 -- 172.21.15.146:0/1593095054 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb98094620 con 0x7fdb90054710 2024-09-17T03:32:36.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.242+0000 7fdb8dffb640 1 -- 172.21.15.146:0/1593095054 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdb98094880 con 0x7fdb90054710 2024-09-17T03:32:36.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.242+0000 7fdb8dffb640 1 -- 172.21.15.146:0/1593095054 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdb98093d30 con 0x7fdb90054710 2024-09-17T03:32:36.242 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.242 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.243+0000 7fd58bfff640 1 -- 172.21.15.146:0/3278979106 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7fd594042e20 con 0x7fd5a41f91f0 2024-09-17T03:32:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7f3c20615640 1 -- 172.21.15.146:0/2319777459 shutdown_connections 2024-09-17T03:32:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.238+0000 7f3c20615640 1 -- 172.21.15.146:0/2319777459 wait complete. 2024-09-17T03:32:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.241+0000 7f3c20615640 1 Processor -- start 2024-09-17T03:32:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.241+0000 7f3c20615640 1 -- start start 2024-09-17T03:32:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.243+0000 7f3c20615640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c1816b940 0x7f3c18202d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.243+0000 7f3c20615640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c1816fed0 0x7f3c18165d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c1e3b1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c1816b940 0x7f3c18202d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c1e3b1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c1816b940 0x7f3c18202d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57386/0 (socket says 172.21.15.146:57386) 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c20615640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c180cca00 0x7f3c180cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c20615640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3c18073900 con 0x7f3c1816b940 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c20615640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3c18073780 con 0x7f3c180cca00 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c20615640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3c18073a80 con 0x7f3c1816fed0 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c1e3b1640 1 -- 172.21.15.146:0/1706902788 learned_addr learned my addr 172.21.15.146:0/1706902788 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c1e3b1640 1 -- 172.21.15.146:0/1706902788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c1816fed0 msgr2=0x7f3c18165d20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c1e3b1640 1 --2- 172.21.15.146:0/1706902788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c1816fed0 0x7f3c18165d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c1e3b1640 1 -- 172.21.15.146:0/1706902788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c180cca00 msgr2=0x7f3c180cce10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c1e3b1640 1 --2- 172.21.15.146:0/1706902788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c180cca00 0x7f3c180cce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.244+0000 7f3c1e3b1640 1 -- 172.21.15.146:0/1706902788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c180cd350 con 0x7f3c1816b940 2024-09-17T03:32:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.245+0000 7f3c1e3b1640 1 --2- 172.21.15.146:0/1706902788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c1816b940 0x7f3c18202d40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009900 tx=0x7f3c14030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.240+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2878100104 wait complete. 2024-09-17T03:32:36.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.246+0000 7fdb837fe640 1 -- 172.21.15.146:0/1593095054 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb78005290 con 0x7fdb90054710 2024-09-17T03:32:36.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.246+0000 7fd589ffb640 1 -- 172.21.15.146:0/3278979106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a41f91f0 msgr2=0x7fd5a406fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.246+0000 7fd589ffb640 1 --2- 172.21.15.146:0/3278979106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a41f91f0 0x7fd5a406fb50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd594006f80 tx=0x7fd594003d30 comp rx=0 tx=0).stop 2024-09-17T03:32:36.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.247+0000 7fd589ffb640 1 -- 172.21.15.146:0/3278979106 shutdown_connections 2024-09-17T03:32:36.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.247+0000 7fd589ffb640 1 --2- 172.21.15.146:0/3278979106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a41f91f0 0x7fd5a406fb50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.247+0000 7fd589ffb640 1 --2- 172.21.15.146:0/3278979106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5a4153bf0 0x7fd5a4206a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.247+0000 7fd589ffb640 1 --2- 172.21.15.146:0/3278979106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd58c004e60 0x7fd5a42028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.247+0000 7fd589ffb640 1 -- 172.21.15.146:0/3278979106 >> 172.21.15.146:0/3278979106 conn(0x7fd5a40b2db0 msgr2=0x7fd5a415e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.247+0000 7fd589ffb640 1 -- 172.21.15.146:0/3278979106 shutdown_connections 2024-09-17T03:32:36.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.247+0000 7fd589ffb640 1 -- 172.21.15.146:0/3278979106 wait complete. 2024-09-17T03:32:36.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.249+0000 7f9bfb4ce640 1 Processor -- start 2024-09-17T03:32:36.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.249+0000 7f5603969640 1 -- 172.21.15.146:0/1967764295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55fc0b50f0 msgr2=0x7f55fc06e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.249+0000 7f5603969640 1 --2- 172.21.15.146:0/1967764295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55fc0b50f0 0x7f55fc06e470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f55fc06e220 tx=0x7f55f402a870 comp rx=0 tx=0).stop 2024-09-17T03:32:36.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.249+0000 7f5603969640 1 -- 172.21.15.146:0/1967764295 shutdown_connections 2024-09-17T03:32:36.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.249+0000 7f5603969640 1 --2- 172.21.15.146:0/1967764295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55fc0b50f0 0x7f55fc06e470 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.249+0000 7f5603969640 1 -- 172.21.15.146:0/1967764295 >> 172.21.15.146:0/1967764295 conn(0x7f55fc0b2060 msgr2=0x7f55fc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.249+0000 7f9bfb4ce640 1 -- start start 2024-09-17T03:32:36.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.249+0000 7f5603969640 1 -- 172.21.15.146:0/1967764295 shutdown_connections 2024-09-17T03:32:36.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.250+0000 7fdb8dffb640 1 -- 172.21.15.146:0/1593095054 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdb900ddf60 con 0x7fdb90054710 2024-09-17T03:32:36.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.252+0000 7f9bfb4ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be00053a0 0x7f9bf40aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.252+0000 7f9bfb4ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf4158f50 0x7f9bf4161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.252+0000 7f9bf926a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be00053a0 0x7f9bf40aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.252+0000 7f9bf926a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be00053a0 0x7f9bf40aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:49402/0 (socket says 172.21.15.146:49402) 2024-09-17T03:32:36.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.249+0000 7f5603969640 1 -- 172.21.15.146:0/1967764295 wait complete. 2024-09-17T03:32:36.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.252+0000 7f5603969640 1 Processor -- start 2024-09-17T03:32:36.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.253+0000 7f5603969640 1 -- start start 2024-09-17T03:32:36.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.253+0000 7f9bf926a640 1 -- 172.21.15.146:0/2369192837 learned_addr learned my addr 172.21.15.146:0/2369192837 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.253+0000 7f9bfb4ce640 1 --2- 172.21.15.146:0/2369192837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf4161760 0x7f9bf415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.253+0000 7f9bf8a69640 1 --2- 172.21.15.146:0/2369192837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf4158f50 0x7f9bf4161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.253+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf4163360 con 0x7f9bf4161760 2024-09-17T03:32:36.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.253+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40af280 con 0x7f9bf4158f50 2024-09-17T03:32:36.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.253+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf41634e0 con 0x7f9be00053a0 2024-09-17T03:32:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.255+0000 7f5603969640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55fc06e9b0 0x7f55fc1ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.255+0000 7f5603969640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55fc0b50f0 0x7f55fc15e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.256+0000 7f5601705640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55fc06e9b0 0x7f55fc1ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.256+0000 7f5601705640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55fc06e9b0 0x7f55fc1ffd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:49420/0 (socket says 172.21.15.146:49420) 2024-09-17T03:32:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.256+0000 7f5601705640 1 -- 172.21.15.146:0/1799849330 learned_addr learned my addr 172.21.15.146:0/1799849330 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.256+0000 7f5600f04640 1 --2- 172.21.15.146:0/1799849330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55fc0b50f0 0x7f55fc15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.256+0000 7f5603969640 1 --2- 172.21.15.146:0/1799849330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55fc150470 0x7f55fc15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.256+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc0b3a70 con 0x7f55fc150470 2024-09-17T03:32:36.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.256+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc0707c0 con 0x7f55fc0b50f0 2024-09-17T03:32:36.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.256+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f55fc0b3bf0 con 0x7f55fc06e9b0 2024-09-17T03:32:36.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f5600f04640 1 -- 172.21.15.146:0/1799849330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55fc06e9b0 msgr2=0x7f55fc1ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f5600f04640 1 --2- 172.21.15.146:0/1799849330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55fc06e9b0 0x7f55fc1ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f5600f04640 1 -- 172.21.15.146:0/1799849330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55fc150470 msgr2=0x7f55fc15ead0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:32:36.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f9bf9a6b640 1 --2- 172.21.15.146:0/2369192837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf4161760 0x7f9bf415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f9bf8a69640 1 -- 172.21.15.146:0/2369192837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be00053a0 msgr2=0x7f9bf40aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f9bf8a69640 1 --2- 172.21.15.146:0/2369192837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be00053a0 0x7f9bf40aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f9bf8a69640 1 -- 172.21.15.146:0/2369192837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf4161760 msgr2=0x7f9bf415c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f9bf8a69640 1 --2- 172.21.15.146:0/2369192837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf4161760 0x7f9bf415c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f9bf8a69640 1 -- 172.21.15.146:0/2369192837 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf4161b70 con 0x7f9bf4158f50 2024-09-17T03:32:36.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f5600f04640 1 --2- 172.21.15.146:0/1799849330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55fc150470 0x7f55fc15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f9bf9a6b640 1 --2- 172.21.15.146:0/2369192837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf4161760 0x7f9bf415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:32:36.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f5600f04640 1 -- 172.21.15.146:0/1799849330 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc202a80 con 0x7f55fc0b50f0 2024-09-17T03:32:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.257+0000 7f9bf8a69640 1 --2- 172.21.15.146:0/2369192837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf4158f50 0x7f9bf4161220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000b490 tx=0x7f9bf000b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.258+0000 7f5600f04640 1 --2- 172.21.15.146:0/1799849330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55fc0b50f0 0x7f55fc15e590 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00c3c0 tx=0x7f55ec00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.258+0000 7f55f1ffb640 1 -- 172.21.15.146:0/1799849330 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec017070 con 0x7f55fc0b50f0 2024-09-17T03:32:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.260+0000 7f3c0effd640 1 -- 172.21.15.146:0/1706902788 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14040030 con 0x7f3c1816b940 2024-09-17T03:32:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.260+0000 7f3c0effd640 1 -- 172.21.15.146:0/1706902788 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c14038040 con 0x7f3c1816b940 2024-09-17T03:32:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.260+0000 7f3c0effd640 1 -- 172.21.15.146:0/1706902788 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14037070 con 0x7f3c1816b940 2024-09-17T03:32:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.258+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55fc200290 con 0x7f55fc0b50f0 2024-09-17T03:32:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.258+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55fc203000 con 0x7f55fc0b50f0 2024-09-17T03:32:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.258+0000 7f55f1ffb640 1 -- 172.21.15.146:0/1799849330 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55ec0053c0 con 0x7f55fc0b50f0 2024-09-17T03:32:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.258+0000 7f55f1ffb640 1 -- 172.21.15.146:0/1799849330 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec003850 con 0x7f55fc0b50f0 2024-09-17T03:32:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.260+0000 7f55f1ffb640 1 -- 172.21.15.146:0/1799849330 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f55ec01a070 con 0x7f55fc0b50f0 2024-09-17T03:32:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.260+0000 7f55f1ffb640 1 -- 172.21.15.146:0/1799849330 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f55ec01c780 con 0x7f55fc0b50f0 2024-09-17T03:32:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.259+0000 7f9be9ffb640 1 -- 172.21.15.146:0/2369192837 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0015020 con 0x7f9bf4158f50 2024-09-17T03:32:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.259+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf415b370 con 0x7f9bf4158f50 2024-09-17T03:32:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.259+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf415b930 con 0x7f9bf4158f50 2024-09-17T03:32:36.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.261+0000 7f9be9ffb640 1 -- 172.21.15.146:0/2369192837 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bf0011940 con 0x7f9bf4158f50 2024-09-17T03:32:36.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.261+0000 7f9be9ffb640 1 -- 172.21.15.146:0/2369192837 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0011d90 con 0x7f9bf4158f50 2024-09-17T03:32:36.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.261+0000 7f9be9ffb640 1 -- 172.21.15.146:0/2369192837 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9bf0018020 con 0x7f9bf4158f50 2024-09-17T03:32:36.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.262+0000 7f9be9ffb640 1 -- 172.21.15.146:0/2369192837 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9bf00199c0 con 0x7f9bf4158f50 2024-09-17T03:32:36.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.261+0000 7f3c20615640 1 -- 172.21.15.146:0/1706902788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c18166990 con 0x7f3c1816b940 2024-09-17T03:32:36.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.261+0000 7f3c20615640 1 -- 172.21.15.146:0/1706902788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c18166f50 con 0x7f3c1816b940 2024-09-17T03:32:36.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.263+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd4005290 con 0x7f9bf4158f50 2024-09-17T03:32:36.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.263+0000 7f3c0effd640 1 -- 172.21.15.146:0/1706902788 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3c14004260 con 0x7f3c1816b940 2024-09-17T03:32:36.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.263+0000 7f3c0effd640 1 -- 172.21.15.146:0/1706902788 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3c140055e0 con 0x7f3c1816b940 2024-09-17T03:32:36.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.264+0000 7f3c20615640 1 -- 172.21.15.146:0/1706902788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c1808ca60 con 0x7f3c1816b940 2024-09-17T03:32:36.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.268+0000 7fda1b9ba640 1 -- 172.21.15.146:0/404526812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda00004800 msgr2=0x7fda00004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.268+0000 7f3c0effd640 1 -- 172.21.15.146:0/1706902788 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3c14049020 con 0x7f3c1816b940 2024-09-17T03:32:36.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.268+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55dc005290 con 0x7f55fc0b50f0 2024-09-17T03:32:36.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.269+0000 7f9be9ffb640 1 -- 172.21.15.146:0/2369192837 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9bf001f020 con 0x7f9bf4158f50 2024-09-17T03:32:36.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.269+0000 7fda1b9ba640 1 --2- 172.21.15.146:0/404526812 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda00004800 0x7fda00004c10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c2e0 tx=0x7fda00005830 comp rx=0 tx=0).stop 2024-09-17T03:32:36.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.270+0000 7fda19f57640 1 -- 172.21.15.146:0/404526812 reap_dead start 2024-09-17T03:32:36.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.270+0000 7fda1b9ba640 1 -- 172.21.15.146:0/404526812 shutdown_connections 2024-09-17T03:32:36.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.271+0000 7fda1b9ba640 1 -- 172.21.15.146:0/404526812 >> 172.21.15.146:0/404526812 conn(0x7fda140d4be0 msgr2=0x7fda140d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.271+0000 7f55f1ffb640 1 -- 172.21.15.146:0/1799849330 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f55ec021080 con 0x7f55fc0b50f0 2024-09-17T03:32:36.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.271+0000 7fda1b9ba640 1 -- 172.21.15.146:0/404526812 shutdown_connections 2024-09-17T03:32:36.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.271+0000 7fda1b9ba640 1 -- 172.21.15.146:0/404526812 wait complete. 2024-09-17T03:32:36.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.274+0000 7fda1b9ba640 1 Processor -- start 2024-09-17T03:32:36.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.274+0000 7fda1b9ba640 1 -- start start 2024-09-17T03:32:36.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.277+0000 7fda1b9ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140c9f20 0x7fda140ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.273+0000 7facf25eb640 1 -- 172.21.15.146:0/2777631211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facec15f1d0 msgr2=0x7facec15f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.273+0000 7facf25eb640 1 --2- 172.21.15.146:0/2777631211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facec15f1d0 0x7facec15f5e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7facec0b3db0 tx=0x7face8009260 comp rx=0 tx=0).stop 2024-09-17T03:32:36.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.274+0000 7facf25eb640 1 -- 172.21.15.146:0/2777631211 shutdown_connections 2024-09-17T03:32:36.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.274+0000 7facf25eb640 1 --2- 172.21.15.146:0/2777631211 >> v2:172.21.15.179:3300/0 conn(0x7facec06f5b0 0x7facec06f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.274+0000 7facf25eb640 1 --2- 172.21.15.146:0/2777631211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facec15fb20 0x7facec06f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.274+0000 7facf25eb640 1 --2- 172.21.15.146:0/2777631211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facec15f1d0 0x7facec15f5e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.274+0000 7facf25eb640 1 -- 172.21.15.146:0/2777631211 >> 172.21.15.146:0/2777631211 conn(0x7facec0b2010 msgr2=0x7facec0b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.277+0000 7facf25eb640 1 -- 172.21.15.146:0/2777631211 shutdown_connections 2024-09-17T03:32:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.277+0000 7facf25eb640 1 -- 172.21.15.146:0/2777631211 wait complete. 2024-09-17T03:32:36.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.280+0000 7facf25eb640 1 Processor -- start 2024-09-17T03:32:36.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.280+0000 7facf25eb640 1 -- start start 2024-09-17T03:32:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7f5d10ff9640 1 -- 172.21.15.146:0/486940090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f5d24098e80 con 0x7f5d0c003aa0 2024-09-17T03:32:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7facf25eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facec06f5b0 0x7facec143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7facf15e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facec06f5b0 0x7facec143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7fda1b9ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda140ce170 0x7fda140ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7fda1b9ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda141f5c00 0x7fda141f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7fda1b9ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fda140d3190 con 0x7fda141f5c00 2024-09-17T03:32:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7fda1b9ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fda1406f650 con 0x7fda140c9f20 2024-09-17T03:32:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7fda1b9ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fda140d3310 con 0x7fda140ce170 2024-09-17T03:32:36.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7facf15e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facec06f5b0 0x7facec143980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57418/0 (socket says 172.21.15.146:57418) 2024-09-17T03:32:36.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7facf15e9640 1 -- 172.21.15.146:0/3945782303 learned_addr learned my addr 172.21.15.146:0/3945782303 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7facf25eb640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facec15f1d0 0x7facec143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7fda19756640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140c9f20 0x7fda140ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7fda19756640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140c9f20 0x7fda140ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:52584/0 (socket says 172.21.15.146:52584) 2024-09-17T03:32:36.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.283+0000 7fda19756640 1 -- 172.21.15.146:0/1254469116 learned_addr learned my addr 172.21.15.146:0/1254469116 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.284+0000 7facf0de8640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facec15f1d0 0x7facec143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.284+0000 7fda18f55640 1 --2- 172.21.15.146:0/1254469116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda140ce170 0x7fda140ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.284+0000 7facf25eb640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facec15fb20 0x7facec144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.284+0000 7fda19756640 1 -- 172.21.15.146:0/1254469116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda140ce170 msgr2=0x7fda140ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.284+0000 7fda19756640 1 --2- 172.21.15.146:0/1254469116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda140ce170 0x7fda140ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.284+0000 7fda19756640 1 -- 172.21.15.146:0/1254469116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda141f5c00 msgr2=0x7fda141f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.284+0000 7fda19756640 1 --2- 172.21.15.146:0/1254469116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda141f5c00 0x7fda141f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.284+0000 7fda19756640 1 -- 172.21.15.146:0/1254469116 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda140c7fb0 con 0x7fda140c9f20 2024-09-17T03:32:36.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.284+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7facec070080 con 0x7facec06f5b0 2024-09-17T03:32:36.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.284+0000 7facf1dea640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facec15fb20 0x7facec144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.285+0000 7fda19756640 1 --2- 172.21.15.146:0/1254469116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140c9f20 0x7fda140ca330 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00b970 tx=0x7fda0c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.285+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7facec06ff00 con 0x7facec15fb20 2024-09-17T03:32:36.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.285+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7facec070200 con 0x7facec15f1d0 2024-09-17T03:32:36.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.285+0000 7facf15e9640 1 -- 172.21.15.146:0/3945782303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facec15f1d0 msgr2=0x7facec143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.285+0000 7facf15e9640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facec15f1d0 0x7facec143ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.286+0000 7facf15e9640 1 -- 172.21.15.146:0/3945782303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facec15fb20 msgr2=0x7facec144400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.286+0000 7facf15e9640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facec15fb20 0x7facec144400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.286+0000 7facf15e9640 1 -- 172.21.15.146:0/3945782303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec155f00 con 0x7facec06f5b0 2024-09-17T03:32:36.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.286+0000 7facf15e9640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facec06f5b0 0x7facec143980 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7face800b9e0 tx=0x7face80042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.286+0000 7facf1dea640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facec15fb20 0x7facec144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:32:36.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.288+0000 7f5d12ffd640 1 -- 172.21.15.146:0/486940090 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v14)=0 v14) ==== 119+0+0 (secure 0 0 0) 0x7f5d14039040 con 0x7f5d0c003aa0 2024-09-17T03:32:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.287+0000 7fda09ffb640 1 -- 172.21.15.146:0/1254469116 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c019070 con 0x7fda140c9f20 2024-09-17T03:32:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.287+0000 7fda09ffb640 1 -- 172.21.15.146:0/1254469116 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda0c00cc50 con 0x7fda140c9f20 2024-09-17T03:32:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.287+0000 7fda1b9ba640 1 -- 172.21.15.146:0/1254469116 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda140c8290 con 0x7fda140c9f20 2024-09-17T03:32:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.287+0000 7fda1b9ba640 1 -- 172.21.15.146:0/1254469116 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda140c8850 con 0x7fda140c9f20 2024-09-17T03:32:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.287+0000 7fda09ffb640 1 -- 172.21.15.146:0/1254469116 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0146a0 con 0x7fda140c9f20 2024-09-17T03:32:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.289+0000 7fda09ffb640 1 -- 172.21.15.146:0/1254469116 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fda0c01c070 con 0x7fda140c9f20 2024-09-17T03:32:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.289+0000 7fda09ffb640 1 -- 172.21.15.146:0/1254469116 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fda0c01ed20 con 0x7fda140c9f20 2024-09-17T03:32:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.289+0000 7f5d2359e640 1 -- 172.21.15.146:0/486940090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d0c003aa0 msgr2=0x7f5d24202ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.289+0000 7f5d2359e640 1 --2- 172.21.15.146:0/486940090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d0c003aa0 0x7f5d24202ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5d140017e0 tx=0x7f5d14006290 comp rx=0 tx=0).stop 2024-09-17T03:32:36.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.289+0000 7face1ffb640 1 -- 172.21.15.146:0/3945782303 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8040020 con 0x7facec06f5b0 2024-09-17T03:32:36.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.290+0000 7face1ffb640 1 -- 172.21.15.146:0/3945782303 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7face80044d0 con 0x7facec06f5b0 2024-09-17T03:32:36.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.290+0000 7face1ffb640 1 -- 172.21.15.146:0/3945782303 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face80035f0 con 0x7facec06f5b0 2024-09-17T03:32:36.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.290+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec155c20 con 0x7facec06f5b0 2024-09-17T03:32:36.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.290+0000 7f5d2359e640 1 -- 172.21.15.146:0/486940090 shutdown_connections 2024-09-17T03:32:36.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.290+0000 7f5d2359e640 1 --2- 172.21.15.146:0/486940090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d24091fc0 0x7f5d240923d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.290+0000 7f5d2359e640 1 --2- 172.21.15.146:0/486940090 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d24095a50 0x7f5d240951f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.290+0000 7f5d2359e640 1 --2- 172.21.15.146:0/486940090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d0c003aa0 0x7f5d24202ef0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.290+0000 7f5d2359e640 1 -- 172.21.15.146:0/486940090 >> 172.21.15.146:0/486940090 conn(0x7f5d240b2010 msgr2=0x7f5d240b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.290+0000 7f5d2359e640 1 -- 172.21.15.146:0/486940090 shutdown_connections 2024-09-17T03:32:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.290+0000 7f5d2359e640 1 -- 172.21.15.146:0/486940090 wait complete. 2024-09-17T03:32:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.290+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec143180 con 0x7facec06f5b0 2024-09-17T03:32:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.291+0000 7face1ffb640 1 -- 172.21.15.146:0/3945782303 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7face8043020 con 0x7facec06f5b0 2024-09-17T03:32:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.291+0000 7face1ffb640 1 -- 172.21.15.146:0/3945782303 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7face803c8f0 con 0x7facec06f5b0 2024-09-17T03:32:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.291+0000 7fd9ff7fe640 1 -- 172.21.15.146:0/1254469116 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda140cf370 con 0x7fda140c9f20 2024-09-17T03:32:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.292+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec076450 con 0x7facec06f5b0 2024-09-17T03:32:36.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.295+0000 7fda09ffb640 1 -- 172.21.15.146:0/1254469116 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fda0c023070 con 0x7fda140c9f20 2024-09-17T03:32:36.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.299+0000 7face1ffb640 1 -- 172.21.15.146:0/3945782303 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7facec076450 con 0x7facec06f5b0 2024-09-17T03:32:36.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.298+0000 7f9984bce640 1 -- 172.21.15.146:0/1178558962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780df800 msgr2=0x7f9978007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.298+0000 7f9984bce640 1 --2- 172.21.15.146:0/1178558962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780df800 0x7f9978007c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9974009830 tx=0x7f997402a3f0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.306 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.306 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.310+0000 7f9984bce640 1 -- 172.21.15.146:0/1178558962 shutdown_connections 2024-09-17T03:32:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.310+0000 7f9984bce640 1 --2- 172.21.15.146:0/1178558962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780df800 0x7f9978007c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.310+0000 7f9984bce640 1 -- 172.21.15.146:0/1178558962 >> 172.21.15.146:0/1178558962 conn(0x7f997801e260 msgr2=0x7f9978039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.315+0000 7f9984bce640 1 -- 172.21.15.146:0/1178558962 shutdown_connections 2024-09-17T03:32:36.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.315+0000 7f9984bce640 1 -- 172.21.15.146:0/1178558962 wait complete. 2024-09-17T03:32:36.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.318+0000 7f9984bce640 1 Processor -- start 2024-09-17T03:32:36.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.318+0000 7f9984bce640 1 -- start start 2024-09-17T03:32:36.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.320+0000 7f9984bce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99780519a0 0x7f99780cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.320+0000 7f9984bce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9978054720 0x7f99780cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.320+0000 7f9984bce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780df800 0x7f99780cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.320+0000 7f997f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99780519a0 0x7f99780cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.320+0000 7f997f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99780519a0 0x7f99780cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57428/0 (socket says 172.21.15.146:57428) 2024-09-17T03:32:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.320+0000 7f997f7fe640 1 -- 172.21.15.146:0/3499065643 learned_addr learned my addr 172.21.15.146:0/3499065643 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.320+0000 7f9984bce640 1 -- 172.21.15.146:0/3499065643 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f99780e6300 con 0x7f99780519a0 2024-09-17T03:32:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.320+0000 7f9984bce640 1 -- 172.21.15.146:0/3499065643 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99780e6180 con 0x7f99780df800 2024-09-17T03:32:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.320+0000 7f9984bce640 1 -- 172.21.15.146:0/3499065643 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99780e6480 con 0x7f9978054720 2024-09-17T03:32:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.320+0000 7f997effd640 1 --2- 172.21.15.146:0/3499065643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9978054720 0x7f99780cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.321+0000 7f997ffff640 1 --2- 172.21.15.146:0/3499065643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780df800 0x7f99780cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.324+0000 7f997f7fe640 1 -- 172.21.15.146:0/3499065643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9978054720 msgr2=0x7f99780cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.324+0000 7f997f7fe640 1 --2- 172.21.15.146:0/3499065643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9978054720 0x7f99780cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.324+0000 7f997f7fe640 1 -- 172.21.15.146:0/3499065643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780df800 msgr2=0x7f99780cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.324+0000 7f997f7fe640 1 --2- 172.21.15.146:0/3499065643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780df800 0x7f99780cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.324+0000 7f997f7fe640 1 -- 172.21.15.146:0/3499065643 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99780e3180 con 0x7f99780519a0 2024-09-17T03:32:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.325+0000 7f997f7fe640 1 --2- 172.21.15.146:0/3499065643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99780519a0 0x7f99780cc430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9974009780 tx=0x7f9974004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.325+0000 7f996bfff640 1 -- 172.21.15.146:0/3499065643 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974031600 con 0x7f99780519a0 2024-09-17T03:32:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.325+0000 7f9984bce640 1 -- 172.21.15.146:0/3499065643 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9978050470 con 0x7f99780519a0 2024-09-17T03:32:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.325+0000 7f9984bce640 1 -- 172.21.15.146:0/3499065643 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9978047950 con 0x7f99780519a0 2024-09-17T03:32:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.326+0000 7f996bfff640 1 -- 172.21.15.146:0/3499065643 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9974003c30 con 0x7f99780519a0 2024-09-17T03:32:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.328+0000 7f996bfff640 1 -- 172.21.15.146:0/3499065643 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974031990 con 0x7f99780519a0 2024-09-17T03:32:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.328+0000 7f996bfff640 1 -- 172.21.15.146:0/3499065643 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9974031b70 con 0x7f99780519a0 2024-09-17T03:32:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.328+0000 7fc0f9ffb640 1 -- 172.21.15.146:0/3068456387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fc0f0005850 con 0x7fc108009ba0 2024-09-17T03:32:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.328+0000 7f996bfff640 1 -- 172.21.15.146:0/3499065643 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f997403ba90 con 0x7f99780519a0 2024-09-17T03:32:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.329+0000 7f9969ffb640 1 -- 172.21.15.146:0/3499065643 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9960005290 con 0x7f99780519a0 2024-09-17T03:32:36.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.337+0000 7fc0fbfff640 1 -- 172.21.15.146:0/3068456387 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7fc0fc00d040 con 0x7fc108009ba0 2024-09-17T03:32:36.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.338+0000 7fc114890640 1 -- 172.21.15.146:0/3068456387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc108009ba0 msgr2=0x7fc1080e3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.338+0000 7fc114890640 1 --2- 172.21.15.146:0/3068456387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc108009ba0 0x7fc1080e3c20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00b440 tx=0x7fc0fc00b900 comp rx=0 tx=0).stop 2024-09-17T03:32:36.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.335+0000 7f996bfff640 1 -- 172.21.15.146:0/3499065643 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f99780e3180 con 0x7f99780519a0 2024-09-17T03:32:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.339+0000 7fc114890640 1 -- 172.21.15.146:0/3068456387 shutdown_connections 2024-09-17T03:32:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.339+0000 7fc114890640 1 --2- 172.21.15.146:0/3068456387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc108036970 0x7fc1080dded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.339+0000 7fc114890640 1 --2- 172.21.15.146:0/3068456387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc108009ba0 0x7fc1080e3c20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.339+0000 7fc114890640 1 --2- 172.21.15.146:0/3068456387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc108005c60 0x7fc10818a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.339+0000 7fc114890640 1 -- 172.21.15.146:0/3068456387 >> 172.21.15.146:0/3068456387 conn(0x7fc108051420 msgr2=0x7fc108053ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.339+0000 7fc114890640 1 -- 172.21.15.146:0/3068456387 shutdown_connections 2024-09-17T03:32:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.339+0000 7fc114890640 1 -- 172.21.15.146:0/3068456387 wait complete. 2024-09-17T03:32:36.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.368+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f109c03a550 con 0x7f109c006860 2024-09-17T03:32:36.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.375+0000 7f1092ffd640 1 -- 172.21.15.146:0/2579627379 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7f1094004e10 con 0x7f109c006860 2024-09-17T03:32:36.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.377+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f109c006860 msgr2=0x7f109c04ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.377+0000 7f10a8fff640 1 --2- 172.21.15.146:0/2579627379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f109c006860 0x7f109c04ebb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1094032000 tx=0x7f1094004300 comp rx=0 tx=0).stop 2024-09-17T03:32:36.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.378+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 shutdown_connections 2024-09-17T03:32:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.378+0000 7f10a8fff640 1 --2- 172.21.15.146:0/2579627379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f109c0df800 0x7f109c0338c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.378+0000 7f10a8fff640 1 --2- 172.21.15.146:0/2579627379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f109c0519a0 0x7f109c0d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.378+0000 7f10a8fff640 1 --2- 172.21.15.146:0/2579627379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f109c006860 0x7f109c04ebb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.378+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 >> 172.21.15.146:0/2579627379 conn(0x7f109c01e260 msgr2=0x7f109c050ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.378+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 shutdown_connections 2024-09-17T03:32:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.378+0000 7f10a8fff640 1 -- 172.21.15.146:0/2579627379 wait complete. 2024-09-17T03:32:36.398 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.398 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.405+0000 7f3c20615640 1 -- 172.21.15.146:0/1706902788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f3c1806b200 con 0x7f3c1816b940 2024-09-17T03:32:36.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.408+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f9bd4005580 con 0x7f9bf4158f50 2024-09-17T03:32:36.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.411+0000 7f3c0effd640 1 -- 172.21.15.146:0/1706902788 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v17)=0 v17) ==== 119+0+0 (secure 0 0 0) 0x7f3c180cd350 con 0x7f3c1816b940 2024-09-17T03:32:36.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.412+0000 7f3c20615640 1 -- 172.21.15.146:0/1706902788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c1816b940 msgr2=0x7f3c18202d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.412+0000 7f3c20615640 1 --2- 172.21.15.146:0/1706902788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c1816b940 0x7f3c18202d40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009900 tx=0x7f3c14030c30 comp rx=0 tx=0).stop 2024-09-17T03:32:36.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.412+0000 7f3c20615640 1 -- 172.21.15.146:0/1706902788 shutdown_connections 2024-09-17T03:32:36.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.412+0000 7f3c20615640 1 --2- 172.21.15.146:0/1706902788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c180cca00 0x7f3c180cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.412+0000 7f3c20615640 1 --2- 172.21.15.146:0/1706902788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c1816fed0 0x7f3c18165d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.412+0000 7f3c20615640 1 --2- 172.21.15.146:0/1706902788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c1816b940 0x7f3c18202d40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.412+0000 7f3c20615640 1 -- 172.21.15.146:0/1706902788 >> 172.21.15.146:0/1706902788 conn(0x7f3c180b2060 msgr2=0x7f3c1816efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.413+0000 7f3c20615640 1 -- 172.21.15.146:0/1706902788 shutdown_connections 2024-09-17T03:32:36.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.413+0000 7f3c20615640 1 -- 172.21.15.146:0/1706902788 wait complete. 2024-09-17T03:32:36.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.421+0000 7f9be9ffb640 1 -- 172.21.15.146:0/2369192837 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v18)=0 v18) ==== 111+0+0 (secure 0 0 0) 0x7f9bf4161b70 con 0x7f9bf4158f50 2024-09-17T03:32:36.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.422+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf4158f50 msgr2=0x7f9bf4161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.422+0000 7f9bfb4ce640 1 --2- 172.21.15.146:0/2369192837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf4158f50 0x7f9bf4161220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000b490 tx=0x7f9bf000b950 comp rx=0 tx=0).stop 2024-09-17T03:32:36.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.423+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 shutdown_connections 2024-09-17T03:32:36.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.423+0000 7f9bfb4ce640 1 --2- 172.21.15.146:0/2369192837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf4161760 0x7f9bf415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.423+0000 7f9bfb4ce640 1 --2- 172.21.15.146:0/2369192837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf4158f50 0x7f9bf4161220 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.423+0000 7f9bfb4ce640 1 --2- 172.21.15.146:0/2369192837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9be00053a0 0x7f9bf40aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.423+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 >> 172.21.15.146:0/2369192837 conn(0x7f9bf40b2060 msgr2=0x7f9bf4159800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.423+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 shutdown_connections 2024-09-17T03:32:36.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.423+0000 7f9bfb4ce640 1 -- 172.21.15.146:0/2369192837 wait complete. 2024-09-17T03:32:36.426 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.429+0000 7fdb837fe640 1 -- 172.21.15.146:0/1593095054 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fdb78005580 con 0x7fdb90054710 2024-09-17T03:32:36.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.436+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f55dc005580 con 0x7f55fc0b50f0 2024-09-17T03:32:36.435 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.437+0000 7fdb8dffb640 1 -- 172.21.15.146:0/1593095054 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v19)=0 v19) ==== 125+0+0 (secure 0 0 0) 0x7fdb98090030 con 0x7fdb90054710 2024-09-17T03:32:36.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.438+0000 7fdb837fe640 1 -- 172.21.15.146:0/1593095054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90054710 msgr2=0x7fdb900e0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.438+0000 7fdb837fe640 1 --2- 172.21.15.146:0/1593095054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90054710 0x7fdb900e0410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdb9806c6a0 tx=0x7fdb9806a0e0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.438+0000 7fdb837fe640 1 -- 172.21.15.146:0/1593095054 shutdown_connections 2024-09-17T03:32:36.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.438+0000 7fdb837fe640 1 --2- 172.21.15.146:0/1593095054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb90054710 0x7fdb900e0410 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.438+0000 7fdb837fe640 1 --2- 172.21.15.146:0/1593095054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb90052350 0x7fdb90186550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.438+0000 7fdb837fe640 1 --2- 172.21.15.146:0/1593095054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb90051620 0x7fdb900dd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.438+0000 7fdb837fe640 1 -- 172.21.15.146:0/1593095054 >> 172.21.15.146:0/1593095054 conn(0x7fdb9001d990 msgr2=0x7fdb90005a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.438+0000 7fdb837fe640 1 -- 172.21.15.146:0/1593095054 shutdown_connections 2024-09-17T03:32:36.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.438+0000 7fdb837fe640 1 -- 172.21.15.146:0/1593095054 wait complete. 2024-09-17T03:32:36.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.441+0000 7f55f1ffb640 1 -- 172.21.15.146:0/1799849330 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7f55ec011e10 con 0x7f55fc0b50f0 2024-09-17T03:32:36.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.444+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55fc0b50f0 msgr2=0x7f55fc15e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.444+0000 7f5603969640 1 --2- 172.21.15.146:0/1799849330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55fc0b50f0 0x7f55fc15e590 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00c3c0 tx=0x7f55ec00c880 comp rx=0 tx=0).stop 2024-09-17T03:32:36.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.444+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 shutdown_connections 2024-09-17T03:32:36.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.444+0000 7f5603969640 1 --2- 172.21.15.146:0/1799849330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55fc150470 0x7f55fc15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.444+0000 7f5603969640 1 --2- 172.21.15.146:0/1799849330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55fc0b50f0 0x7f55fc15e590 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.444+0000 7f5603969640 1 --2- 172.21.15.146:0/1799849330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55fc06e9b0 0x7f55fc1ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.444+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 >> 172.21.15.146:0/1799849330 conn(0x7f55fc0b2060 msgr2=0x7f55fc15d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.444+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 shutdown_connections 2024-09-17T03:32:36.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.444+0000 7f5603969640 1 -- 172.21.15.146:0/1799849330 wait complete. 2024-09-17T03:32:36.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.455+0000 7fd9ff7fe640 1 -- 172.21.15.146:0/1254469116 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fda140d2bd0 con 0x7fda140c9f20 2024-09-17T03:32:36.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.457+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7facec0b2650 con 0x7facec06f5b0 2024-09-17T03:32:36.456 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.460+0000 7fda09ffb640 1 -- 172.21.15.146:0/1254469116 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v21)=0 v21) ==== 106+0+0 (secure 0 0 0) 0x7fda0c006e20 con 0x7fda140c9f20 2024-09-17T03:32:36.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.461+0000 7fd9ff7fe640 1 -- 172.21.15.146:0/1254469116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140c9f20 msgr2=0x7fda140ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.461+0000 7fd9ff7fe640 1 --2- 172.21.15.146:0/1254469116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140c9f20 0x7fda140ca330 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00b970 tx=0x7fda0c00be30 comp rx=0 tx=0).stop 2024-09-17T03:32:36.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.461+0000 7fd9ff7fe640 1 -- 172.21.15.146:0/1254469116 shutdown_connections 2024-09-17T03:32:36.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.461+0000 7fd9ff7fe640 1 --2- 172.21.15.146:0/1254469116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda141f5c00 0x7fda141f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.461+0000 7fd9ff7fe640 1 --2- 172.21.15.146:0/1254469116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda140ce170 0x7fda140ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.461+0000 7fd9ff7fe640 1 --2- 172.21.15.146:0/1254469116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda140c9f20 0x7fda140ca330 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.461+0000 7fd9ff7fe640 1 -- 172.21.15.146:0/1254469116 >> 172.21.15.146:0/1254469116 conn(0x7fda140d4be0 msgr2=0x7fda1415c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.461+0000 7fd9ff7fe640 1 -- 172.21.15.146:0/1254469116 shutdown_connections 2024-09-17T03:32:36.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.461+0000 7fd9ff7fe640 1 -- 172.21.15.146:0/1254469116 wait complete. 2024-09-17T03:32:36.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.462+0000 7face1ffb640 1 -- 172.21.15.146:0/3945782303 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7facec0b2650 con 0x7facec06f5b0 2024-09-17T03:32:36.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.463+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facec06f5b0 msgr2=0x7facec143980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.463+0000 7facf25eb640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facec06f5b0 0x7facec143980 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7face800b9e0 tx=0x7face80042e0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.463+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 shutdown_connections 2024-09-17T03:32:36.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.463+0000 7facf25eb640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facec15fb20 0x7facec144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.463+0000 7facf25eb640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facec15f1d0 0x7facec143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.463+0000 7facf25eb640 1 --2- 172.21.15.146:0/3945782303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facec06f5b0 0x7facec143980 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.463+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 >> 172.21.15.146:0/3945782303 conn(0x7facec0b2010 msgr2=0x7facec159320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.463+0000 7f9969ffb640 1 -- 172.21.15.146:0/3499065643 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f9960005580 con 0x7f99780519a0 2024-09-17T03:32:36.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.463+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 shutdown_connections 2024-09-17T03:32:36.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.463+0000 7facf25eb640 1 -- 172.21.15.146:0/3945782303 wait complete. 2024-09-17T03:32:36.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.466+0000 7f996bfff640 1 -- 172.21.15.146:0/3499065643 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f9974051030 con 0x7f99780519a0 2024-09-17T03:32:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.467+0000 7f9969ffb640 1 -- 172.21.15.146:0/3499065643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99780519a0 msgr2=0x7f99780cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.467+0000 7f9969ffb640 1 --2- 172.21.15.146:0/3499065643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99780519a0 0x7f99780cc430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9974009780 tx=0x7f9974004610 comp rx=0 tx=0).stop 2024-09-17T03:32:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.467+0000 7f9969ffb640 1 -- 172.21.15.146:0/3499065643 shutdown_connections 2024-09-17T03:32:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.467+0000 7f9969ffb640 1 --2- 172.21.15.146:0/3499065643 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99780df800 0x7f99780cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.467+0000 7f9969ffb640 1 --2- 172.21.15.146:0/3499065643 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9978054720 0x7f99780cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.467+0000 7f9969ffb640 1 --2- 172.21.15.146:0/3499065643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99780519a0 0x7f99780cc430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.467+0000 7f9969ffb640 1 -- 172.21.15.146:0/3499065643 >> 172.21.15.146:0/3499065643 conn(0x7f997801e260 msgr2=0x7f997804fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.467+0000 7f9969ffb640 1 -- 172.21.15.146:0/3499065643 shutdown_connections 2024-09-17T03:32:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.467+0000 7f9969ffb640 1 -- 172.21.15.146:0/3499065643 wait complete. 2024-09-17T03:32:36.479 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.479 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.480 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi146') 2024-09-17T03:32:36.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config dump 2024-09-17T03:32:36.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.632+0000 7f66e4b39640 1 -- 172.21.15.146:0/687977366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66e0073c90 msgr2=0x7f66e006fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.632+0000 7f66e4b39640 1 --2- 172.21.15.146:0/687977366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66e0073c90 0x7f66e006fae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f66e00cde70 tx=0x7f66c802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.632+0000 7f66e4b39640 1 -- 172.21.15.146:0/687977366 shutdown_connections 2024-09-17T03:32:36.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.632+0000 7f66e4b39640 1 --2- 172.21.15.146:0/687977366 >> v2:172.21.15.179:3300/0 conn(0x7f66e0070020 0x7f66e00b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.632+0000 7f66e4b39640 1 --2- 172.21.15.146:0/687977366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66e0073c90 0x7f66e006fae0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.632+0000 7f66e4b39640 1 -- 172.21.15.146:0/687977366 >> 172.21.15.146:0/687977366 conn(0x7f66e006dd60 msgr2=0x7f66e006e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.632+0000 7f66e4b39640 1 -- 172.21.15.146:0/687977366 shutdown_connections 2024-09-17T03:32:36.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.632+0000 7f66e4b39640 1 -- 172.21.15.146:0/687977366 wait complete. 2024-09-17T03:32:36.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.634+0000 7f66e4b39640 1 Processor -- start 2024-09-17T03:32:36.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.634+0000 7f66e4b39640 1 -- start start 2024-09-17T03:32:36.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66e4b39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e0070020 0x7f66e01f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66e4b39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66e0152920 0x7f66e0159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66e4b39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e0142c70 0x7f66e0157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66e4b39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66e00b5590 con 0x7f66e0152920 2024-09-17T03:32:36.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66e4b39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f66e00b5410 con 0x7f66e0070020 2024-09-17T03:32:36.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66e4b39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f66e00b5710 con 0x7f66e0142c70 2024-09-17T03:32:36.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66ddd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66e0152920 0x7f66e0159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66ddd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66e0152920 0x7f66e0159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57448/0 (socket says 172.21.15.146:57448) 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66ddd9b640 1 -- 172.21.15.146:0/1071320318 learned_addr learned my addr 172.21.15.146:0/1071320318 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66de59c640 1 --2- 172.21.15.146:0/1071320318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e0070020 0x7f66e01f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66ded9d640 1 --2- 172.21.15.146:0/1071320318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e0142c70 0x7f66e0157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66ddd9b640 1 -- 172.21.15.146:0/1071320318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e0142c70 msgr2=0x7f66e0157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66ddd9b640 1 --2- 172.21.15.146:0/1071320318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e0142c70 0x7f66e0157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66ddd9b640 1 -- 172.21.15.146:0/1071320318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e0070020 msgr2=0x7f66e01f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66ddd9b640 1 --2- 172.21.15.146:0/1071320318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e0070020 0x7f66e01f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66ddd9b640 1 -- 172.21.15.146:0/1071320318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e01f6cc0 con 0x7f66e0152920 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66ddd9b640 1 --2- 172.21.15.146:0/1071320318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66e0152920 0x7f66e0159300 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f66c80099c0 tx=0x7f66c80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.636+0000 7f66d6ffd640 1 -- 172.21.15.146:0/1071320318 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c803e030 con 0x7f66e0152920 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.637+0000 7f66d6ffd640 1 -- 172.21.15.146:0/1071320318 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66c8003db0 con 0x7f66e0152920 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.637+0000 7f66e4b39640 1 -- 172.21.15.146:0/1071320318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e0143850 con 0x7f66e0152920 2024-09-17T03:32:36.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.637+0000 7f66d6ffd640 1 -- 172.21.15.146:0/1071320318 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8035040 con 0x7f66e0152920 2024-09-17T03:32:36.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.637+0000 7f66e4b39640 1 -- 172.21.15.146:0/1071320318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e01f34b0 con 0x7f66e0152920 2024-09-17T03:32:36.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.637+0000 7f66d6ffd640 1 -- 172.21.15.146:0/1071320318 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f66c8041030 con 0x7f66e0152920 2024-09-17T03:32:36.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.637+0000 7f66d6ffd640 1 -- 172.21.15.146:0/1071320318 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f66c8043be0 con 0x7f66e0152920 2024-09-17T03:32:36.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.638+0000 7f66e4b39640 1 -- 172.21.15.146:0/1071320318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e00b5c30 con 0x7f66e0152920 2024-09-17T03:32:36.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.640+0000 7f66d6ffd640 1 -- 172.21.15.146:0/1071320318 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f66e01f6cc0 con 0x7f66e0152920 2024-09-17T03:32:36.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.698+0000 7f66e4b39640 1 -- 172.21.15.146:0/1071320318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f66e015b380 con 0x7f66e0152920 2024-09-17T03:32:36.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.699+0000 7f66d6ffd640 1 -- 172.21.15.146:0/1071320318 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f66c8004f20 con 0x7f66e0152920 2024-09-17T03:32:36.698 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:32:36.698 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:32:36.698 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:32:36.698 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:32:36.698 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:32:36.698 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:32:36.698 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:32:36.698 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:32:36.699 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:32:36.700 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:32:36.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.700+0000 7f66e4b39640 1 -- 172.21.15.146:0/1071320318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66e0152920 msgr2=0x7f66e0159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.700+0000 7f66e4b39640 1 --2- 172.21.15.146:0/1071320318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66e0152920 0x7f66e0159300 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f66c80099c0 tx=0x7f66c80038a0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.700+0000 7f66e4b39640 1 -- 172.21.15.146:0/1071320318 shutdown_connections 2024-09-17T03:32:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.700+0000 7f66e4b39640 1 --2- 172.21.15.146:0/1071320318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66e0142c70 0x7f66e0157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.700+0000 7f66e4b39640 1 --2- 172.21.15.146:0/1071320318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66e0152920 0x7f66e0159300 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.700+0000 7f66e4b39640 1 --2- 172.21.15.146:0/1071320318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66e0070020 0x7f66e01f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.700+0000 7f66e4b39640 1 -- 172.21.15.146:0/1071320318 >> 172.21.15.146:0/1071320318 conn(0x7f66e006dd60 msgr2=0x7f66e0151d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.700+0000 7f66e4b39640 1 -- 172.21.15.146:0/1071320318 shutdown_connections 2024-09-17T03:32:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.700+0000 7f66e4b39640 1 -- 172.21.15.146:0/1071320318 wait complete. 2024-09-17T03:32:36.709 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T03:32:36.710 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T03:32:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.823+0000 7fdcab319640 1 -- 172.21.15.146:0/3561749266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca4160b60 msgr2=0x7fdca40d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.823+0000 7fdcab319640 1 --2- 172.21.15.146:0/3561749266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca4160b60 0x7fdca40d1290 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c005fd0 tx=0x7fdc9c02aac0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.823+0000 7fdcab319640 1 -- 172.21.15.146:0/3561749266 shutdown_connections 2024-09-17T03:32:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.823+0000 7fdcab319640 1 --2- 172.21.15.146:0/3561749266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca4160b60 0x7fdca40d1290 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.823+0000 7fdcab319640 1 --2- 172.21.15.146:0/3561749266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca40b7c20 0x7fdca40ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.823+0000 7fdcab319640 1 -- 172.21.15.146:0/3561749266 >> 172.21.15.146:0/3561749266 conn(0x7fdca40b4190 msgr2=0x7fdca40b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.823+0000 7fdcab319640 1 -- 172.21.15.146:0/3561749266 shutdown_connections 2024-09-17T03:32:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.823+0000 7fdcab319640 1 -- 172.21.15.146:0/3561749266 wait complete. 2024-09-17T03:32:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.825+0000 7fdcab319640 1 Processor -- start 2024-09-17T03:32:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.825+0000 7fdcab319640 1 -- start start 2024-09-17T03:32:36.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.826+0000 7fdcab319640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca40b7c20 0x7fdca41465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.826+0000 7fdcab319640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdca40c78a0 0x7fdca415f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.826+0000 7fdcab319640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca4155e20 0x7fdca415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.826+0000 7fdcab319640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdca40d17d0 con 0x7fdca40b7c20 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.826+0000 7fdcab319640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdca40cd1f0 con 0x7fdca40c78a0 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.826+0000 7fdcab319640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdca40d1950 con 0x7fdca4155e20 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdca90b5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca40b7c20 0x7fdca41465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdca90b5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca40b7c20 0x7fdca41465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57458/0 (socket says 172.21.15.146:57458) 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdca90b5640 1 -- 172.21.15.146:0/3107488600 learned_addr learned my addr 172.21.15.146:0/3107488600 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdca88b4640 1 --2- 172.21.15.146:0/3107488600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdca40c78a0 0x7fdca415f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdca98b6640 1 --2- 172.21.15.146:0/3107488600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca4155e20 0x7fdca415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdca90b5640 1 -- 172.21.15.146:0/3107488600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca4155e20 msgr2=0x7fdca415f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdca90b5640 1 --2- 172.21.15.146:0/3107488600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca4155e20 0x7fdca415f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdca90b5640 1 -- 172.21.15.146:0/3107488600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdca40c78a0 msgr2=0x7fdca415f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdca90b5640 1 --2- 172.21.15.146:0/3107488600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdca40c78a0 0x7fdca415f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdca90b5640 1 -- 172.21.15.146:0/3107488600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca41498a0 con 0x7fdca40b7c20 2024-09-17T03:32:36.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdca90b5640 1 --2- 172.21.15.146:0/3107488600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca40b7c20 0x7fdca41465b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdca000e7c0 tx=0x7fdca000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:36.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdc99ffb640 1 -- 172.21.15.146:0/3107488600 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca000ccc0 con 0x7fdca40b7c20 2024-09-17T03:32:36.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdc99ffb640 1 -- 172.21.15.146:0/3107488600 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdca0010430 con 0x7fdca40b7c20 2024-09-17T03:32:36.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdcab319640 1 -- 172.21.15.146:0/3107488600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca4149b80 con 0x7fdca40b7c20 2024-09-17T03:32:36.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdc99ffb640 1 -- 172.21.15.146:0/3107488600 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0010860 con 0x7fdca40b7c20 2024-09-17T03:32:36.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.827+0000 7fdcab319640 1 -- 172.21.15.146:0/3107488600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca41565e0 con 0x7fdca40b7c20 2024-09-17T03:32:36.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.828+0000 7fdc99ffb640 1 -- 172.21.15.146:0/3107488600 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdca0010a00 con 0x7fdca40b7c20 2024-09-17T03:32:36.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.828+0000 7fdc99ffb640 1 -- 172.21.15.146:0/3107488600 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdca0018cc0 con 0x7fdca40b7c20 2024-09-17T03:32:36.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.829+0000 7fdcab319640 1 -- 172.21.15.146:0/3107488600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca4075390 con 0x7fdca40b7c20 2024-09-17T03:32:36.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.831+0000 7fdc99ffb640 1 -- 172.21.15.146:0/3107488600 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdca0018420 con 0x7fdca40b7c20 2024-09-17T03:32:36.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.934+0000 7fdcab319640 1 -- 172.21.15.146:0/3107488600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fdca40b71f0 con 0x7fdca40b7c20 2024-09-17T03:32:36.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.935+0000 7fdc99ffb640 1 -- 172.21.15.146:0/3107488600 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fdca0018600 con 0x7fdca40b7c20 2024-09-17T03:32:36.934 INFO:teuthology.orchestra.run.smithi146.stderr:adjusted tunables profile to default 2024-09-17T03:32:36.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.936+0000 7fdcab319640 1 -- 172.21.15.146:0/3107488600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca40b7c20 msgr2=0x7fdca41465b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:36.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.936+0000 7fdcab319640 1 --2- 172.21.15.146:0/3107488600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca40b7c20 0x7fdca41465b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdca000e7c0 tx=0x7fdca000ec80 comp rx=0 tx=0).stop 2024-09-17T03:32:36.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.936+0000 7fdcab319640 1 -- 172.21.15.146:0/3107488600 shutdown_connections 2024-09-17T03:32:36.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.936+0000 7fdcab319640 1 --2- 172.21.15.146:0/3107488600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdca4155e20 0x7fdca415f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.936+0000 7fdcab319640 1 --2- 172.21.15.146:0/3107488600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdca40c78a0 0x7fdca415f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.936+0000 7fdcab319640 1 --2- 172.21.15.146:0/3107488600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdca40b7c20 0x7fdca41465b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:36.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.936+0000 7fdcab319640 1 -- 172.21.15.146:0/3107488600 >> 172.21.15.146:0/3107488600 conn(0x7fdca40b4190 msgr2=0x7fdca415c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:36.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.937+0000 7fdcab319640 1 -- 172.21.15.146:0/3107488600 shutdown_connections 2024-09-17T03:32:36.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:36.937+0000 7fdcab319640 1 -- 172.21.15.146:0/3107488600 wait complete. 2024-09-17T03:32:36.946 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T03:32:36.947 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T03:32:36.947 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:36.947 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T03:32:36.972 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:36.972 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T03:32:37.038 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:37.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T03:32:37.104 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:32:37.104 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T03:32:37.170 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:37.170 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T03:32:37.196 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:37.196 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T03:32:37.262 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:37.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T03:32:37.328 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:32:37.328 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T03:32:37.394 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 1a5539a5-a505-4265-961c-c0d673dbf09d 0 2024-09-17T03:32:37.549 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.550+0000 7f2e6752b640 1 -- 172.21.15.179:0/1296417783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600701f0 msgr2=0x7f2e600b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:37.550 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.550+0000 7f2e6752b640 1 --2- 172.21.15.179:0/1296417783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600701f0 0x7f2e600b4cc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2e58005fd0 tx=0x7f2e5802aa90 comp rx=0 tx=0).stop 2024-09-17T03:32:37.550 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.550+0000 7f2e6752b640 1 -- 172.21.15.179:0/1296417783 shutdown_connections 2024-09-17T03:32:37.550 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.550+0000 7f2e6752b640 1 --2- 172.21.15.179:0/1296417783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e600701f0 0x7f2e600b4cc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.550 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.550+0000 7f2e6752b640 1 --2- 172.21.15.179:0/1296417783 >> v2:172.21.15.179:3300/0 conn(0x7f2e60152920 0x7f2e60073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.550 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.550+0000 7f2e6752b640 1 -- 172.21.15.179:0/1296417783 >> 172.21.15.179:0/1296417783 conn(0x7f2e6006dd60 msgr2=0x7f2e6006e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:37.550 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.550+0000 7f2e6752b640 1 -- 172.21.15.179:0/1296417783 shutdown_connections 2024-09-17T03:32:37.550 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.550+0000 7f2e6752b640 1 -- 172.21.15.179:0/1296417783 wait complete. 2024-09-17T03:32:37.551 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.552+0000 7f2e6752b640 1 Processor -- start 2024-09-17T03:32:37.551 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.552+0000 7f2e6752b640 1 -- start start 2024-09-17T03:32:37.554 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.553+0000 7f2e6752b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e600701f0 0x7f2e60155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:37.554 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.553+0000 7f2e6752b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e60073ac0 0x7f2e60153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.553+0000 7f2e6752b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e60152920 0x7f2e601e5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.553+0000 7f2e6752b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2e600b5590 con 0x7f2e600701f0 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.553+0000 7f2e6752b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2e600b5410 con 0x7f2e60152920 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.553+0000 7f2e6752b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2e600b5710 con 0x7f2e60073ac0 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.553+0000 7f2e65ac8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e60152920 0x7f2e601e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.553+0000 7f2e64ac6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e60073ac0 0x7f2e60153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.553+0000 7f2e652c7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e600701f0 0x7f2e60155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.553+0000 7f2e65ac8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e60152920 0x7f2e601e5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:45354/0 (socket says 172.21.15.179:45354) 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.553+0000 7f2e65ac8640 1 -- 172.21.15.179:0/2912567019 learned_addr learned my addr 172.21.15.179:0/2912567019 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e64ac6640 1 -- 172.21.15.179:0/2912567019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e60152920 msgr2=0x7f2e601e5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e64ac6640 1 --2- 172.21.15.179:0/2912567019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e60152920 0x7f2e601e5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e64ac6640 1 -- 172.21.15.179:0/2912567019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e600701f0 msgr2=0x7f2e60155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:37.555 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e64ac6640 1 --2- 172.21.15.179:0/2912567019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e600701f0 0x7f2e60155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e64ac6640 1 -- 172.21.15.179:0/2912567019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e60153d70 con 0x7f2e60073ac0 2024-09-17T03:32:37.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e652c7640 1 --2- 172.21.15.179:0/2912567019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e600701f0 0x7f2e60155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:32:37.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e64ac6640 1 --2- 172.21.15.179:0/2912567019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e60073ac0 0x7f2e60153830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2e600b10b0 tx=0x7f2e5c00eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:37.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e51ffb640 1 -- 172.21.15.179:0/2912567019 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0052d0 con 0x7f2e60073ac0 2024-09-17T03:32:37.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e51ffb640 1 -- 172.21.15.179:0/2912567019 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e5c001620 con 0x7f2e60073ac0 2024-09-17T03:32:37.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e51ffb640 1 -- 172.21.15.179:0/2912567019 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c001a70 con 0x7f2e60073ac0 2024-09-17T03:32:37.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e6752b640 1 -- 172.21.15.179:0/2912567019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e60154c30 con 0x7f2e60073ac0 2024-09-17T03:32:37.556 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e51ffb640 1 -- 172.21.15.179:0/2912567019 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e5c0035f0 con 0x7f2e60073ac0 2024-09-17T03:32:37.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e6752b640 1 -- 172.21.15.179:0/2912567019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e601551f0 con 0x7f2e60073ac0 2024-09-17T03:32:37.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.554+0000 7f2e51ffb640 1 -- 172.21.15.179:0/2912567019 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2e5c003e00 con 0x7f2e60073ac0 2024-09-17T03:32:37.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.555+0000 7f2e6752b640 1 -- 172.21.15.179:0/2912567019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e600b5be0 con 0x7f2e60073ac0 2024-09-17T03:32:37.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.557+0000 7f2e51ffb640 1 -- 172.21.15.179:0/2912567019 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2e5c016020 con 0x7f2e60073ac0 2024-09-17T03:32:37.628 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.628+0000 7f2e6752b640 1 -- 172.21.15.179:0/2912567019 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1a5539a5-a505-4265-961c-c0d673dbf09d", "id": 0} v 0) -- 0x7f2e6015b780 con 0x7f2e60073ac0 2024-09-17T03:32:37.632 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.633+0000 7f2e51ffb640 1 -- 172.21.15.179:0/2912567019 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a5539a5-a505-4265-961c-c0d673dbf09d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2e60073ed0 con 0x7f2e60073ac0 2024-09-17T03:32:37.632 INFO:teuthology.orchestra.run.smithi179.stdout:0 2024-09-17T03:32:37.633 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.634+0000 7f2e6752b640 1 -- 172.21.15.179:0/2912567019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e60073ac0 msgr2=0x7f2e60153830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:37.633 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.634+0000 7f2e6752b640 1 --2- 172.21.15.179:0/2912567019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e60073ac0 0x7f2e60153830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2e600b10b0 tx=0x7f2e5c00eaf0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.633 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.634+0000 7f2e6752b640 1 -- 172.21.15.179:0/2912567019 shutdown_connections 2024-09-17T03:32:37.633 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.634+0000 7f2e6752b640 1 --2- 172.21.15.179:0/2912567019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e60152920 0x7f2e601e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.634 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.634+0000 7f2e6752b640 1 --2- 172.21.15.179:0/2912567019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e60073ac0 0x7f2e60153830 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.634 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.634+0000 7f2e6752b640 1 --2- 172.21.15.179:0/2912567019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e600701f0 0x7f2e60155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.634 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.634+0000 7f2e6752b640 1 -- 172.21.15.179:0/2912567019 >> 172.21.15.179:0/2912567019 conn(0x7f2e6006dd60 msgr2=0x7f2e600b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:37.634 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.634+0000 7f2e6752b640 1 -- 172.21.15.179:0/2912567019 shutdown_connections 2024-09-17T03:32:37.634 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.634+0000 7f2e6752b640 1 -- 172.21.15.179:0/2912567019 wait complete. 2024-09-17T03:32:37.644 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new cde7a1c4-b80e-47ee-aace-c3490cf6a174 1 2024-09-17T03:32:37.758 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.758+0000 7f294e972640 1 -- 172.21.15.179:0/597732127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2948073c90 msgr2=0x7f294806fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:37.758 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.758+0000 7f294e972640 1 --2- 172.21.15.179:0/597732127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2948073c90 0x7f294806fae0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f293c009830 tx=0x7f293c02a5c0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.759 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.758+0000 7f294e972640 1 -- 172.21.15.179:0/597732127 shutdown_connections 2024-09-17T03:32:37.759 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.758+0000 7f294e972640 1 --2- 172.21.15.179:0/597732127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2948073c90 0x7f294806fae0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.759 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.758+0000 7f294e972640 1 -- 172.21.15.179:0/597732127 >> 172.21.15.179:0/597732127 conn(0x7f294806dd60 msgr2=0x7f294806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:37.759 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.759+0000 7f294e972640 1 -- 172.21.15.179:0/597732127 shutdown_connections 2024-09-17T03:32:37.759 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.759+0000 7f294e972640 1 -- 172.21.15.179:0/597732127 wait complete. 2024-09-17T03:32:37.760 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.760+0000 7f294e972640 1 Processor -- start 2024-09-17T03:32:37.760 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.761+0000 7f294e972640 1 -- start start 2024-09-17T03:32:37.763 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294e972640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948070020 0x7f2948156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:37.763 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294e972640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2948152920 0x7f294813e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:37.763 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294e972640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29481f8f90 0x7f29481f93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:37.763 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294e972640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f29480b5760 con 0x7f2948070020 2024-09-17T03:32:37.764 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294e972640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f29480b55e0 con 0x7f29481f8f90 2024-09-17T03:32:37.764 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294e972640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f29480b58e0 con 0x7f2948152920 2024-09-17T03:32:37.764 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294cf0f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29481f8f90 0x7f29481f93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:37.764 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f29477fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2948152920 0x7f294813e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:37.764 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294cf0f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29481f8f90 0x7f29481f93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:45378/0 (socket says 172.21.15.179:45378) 2024-09-17T03:32:37.764 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294cf0f640 1 -- 172.21.15.179:0/3903451958 learned_addr learned my addr 172.21.15.179:0/3903451958 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-17T03:32:37.764 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f2947fff640 1 --2- 172.21.15.179:0/3903451958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948070020 0x7f2948156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:37.764 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294cf0f640 1 -- 172.21.15.179:0/3903451958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2948152920 msgr2=0x7f294813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:37.764 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294cf0f640 1 --2- 172.21.15.179:0/3903451958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2948152920 0x7f294813e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.765 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294cf0f640 1 -- 172.21.15.179:0/3903451958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948070020 msgr2=0x7f2948156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:37.765 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294cf0f640 1 --2- 172.21.15.179:0/3903451958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948070020 0x7f2948156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.765 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f294cf0f640 1 -- 172.21.15.179:0/3903451958 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29481f98e0 con 0x7f29481f8f90 2024-09-17T03:32:37.765 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f29477fe640 1 --2- 172.21.15.179:0/3903451958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2948152920 0x7f294813e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:32:37.765 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.762+0000 7f2947fff640 1 --2- 172.21.15.179:0/3903451958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948070020 0x7f2948156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:32:37.765 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.763+0000 7f294cf0f640 1 --2- 172.21.15.179:0/3903451958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29481f8f90 0x7f29481f93a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f294000cae0 tx=0x7f294000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:37.765 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.763+0000 7f2944ff9640 1 -- 172.21.15.179:0/3903451958 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2940016020 con 0x7f29481f8f90 2024-09-17T03:32:37.765 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.763+0000 7f2944ff9640 1 -- 172.21.15.179:0/3903451958 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f294000ad30 con 0x7f29481f8f90 2024-09-17T03:32:37.765 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.763+0000 7f294e972640 1 -- 172.21.15.179:0/3903451958 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2948141bb0 con 0x7f29481f8f90 2024-09-17T03:32:37.765 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.763+0000 7f2944ff9640 1 -- 172.21.15.179:0/3903451958 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2940012680 con 0x7f29481f8f90 2024-09-17T03:32:37.765 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.763+0000 7f294e972640 1 -- 172.21.15.179:0/3903451958 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29481418d0 con 0x7f29481f8f90 2024-09-17T03:32:37.766 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.763+0000 7f2944ff9640 1 -- 172.21.15.179:0/3903451958 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2940019020 con 0x7f29481f8f90 2024-09-17T03:32:37.766 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.763+0000 7f2944ff9640 1 -- 172.21.15.179:0/3903451958 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f294001bd50 con 0x7f29481f8f90 2024-09-17T03:32:37.766 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.764+0000 7f294e972640 1 -- 172.21.15.179:0/3903451958 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f294806fae0 con 0x7f29481f8f90 2024-09-17T03:32:37.766 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.766+0000 7f2944ff9640 1 -- 172.21.15.179:0/3903451958 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2940020030 con 0x7f29481f8f90 2024-09-17T03:32:37.836 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.837+0000 7f294e972640 1 -- 172.21.15.179:0/3903451958 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cde7a1c4-b80e-47ee-aace-c3490cf6a174", "id": 1} v 0) -- 0x7f29481601b0 con 0x7f29481f8f90 2024-09-17T03:32:37.840 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.841+0000 7f2944ff9640 1 -- 172.21.15.179:0/3903451958 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cde7a1c4-b80e-47ee-aace-c3490cf6a174", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f29481f98e0 con 0x7f29481f8f90 2024-09-17T03:32:37.841 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-17T03:32:37.842 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.842+0000 7f294e972640 1 -- 172.21.15.179:0/3903451958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29481f8f90 msgr2=0x7f29481f93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:37.842 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.842+0000 7f294e972640 1 --2- 172.21.15.179:0/3903451958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29481f8f90 0x7f29481f93a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f294000cae0 tx=0x7f294000a060 comp rx=0 tx=0).stop 2024-09-17T03:32:37.842 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.842+0000 7f294e972640 1 -- 172.21.15.179:0/3903451958 shutdown_connections 2024-09-17T03:32:37.842 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.842+0000 7f294e972640 1 --2- 172.21.15.179:0/3903451958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29481f8f90 0x7f29481f93a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.842 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.842+0000 7f294e972640 1 --2- 172.21.15.179:0/3903451958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2948152920 0x7f294813e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.842 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.842+0000 7f294e972640 1 --2- 172.21.15.179:0/3903451958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948070020 0x7f2948156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.842 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.842+0000 7f294e972640 1 -- 172.21.15.179:0/3903451958 >> 172.21.15.179:0/3903451958 conn(0x7f294806dd60 msgr2=0x7f29480b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:37.843 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.842+0000 7f294e972640 1 -- 172.21.15.179:0/3903451958 shutdown_connections 2024-09-17T03:32:37.843 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.842+0000 7f294e972640 1 -- 172.21.15.179:0/3903451958 wait complete. 2024-09-17T03:32:37.852 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3 2 2024-09-17T03:32:37.966 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.966+0000 7f6adeeb6640 1 -- 172.21.15.179:0/645674911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ad806cc50 msgr2=0x7f6ad806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:37.966 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.966+0000 7f6adeeb6640 1 --2- 172.21.15.179:0/645674911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ad806cc50 0x7f6ad806d060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4005fd0 tx=0x7f6ac402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.966 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.966+0000 7f6adeeb6640 1 -- 172.21.15.179:0/645674911 shutdown_connections 2024-09-17T03:32:37.966 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.966+0000 7f6adeeb6640 1 --2- 172.21.15.179:0/645674911 >> v2:172.21.15.146:3300/0 conn(0x7f6ad806fbf0 0x7f6ad8070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.967 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.966+0000 7f6adeeb6640 1 --2- 172.21.15.179:0/645674911 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ad806cc50 0x7f6ad806d060 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.967 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.967+0000 7f6adeeb6640 1 -- 172.21.15.179:0/645674911 >> 172.21.15.179:0/645674911 conn(0x7f6ad806dd60 msgr2=0x7f6ad806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:37.967 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.967+0000 7f6adeeb6640 1 -- 172.21.15.179:0/645674911 shutdown_connections 2024-09-17T03:32:37.967 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.967+0000 7f6adeeb6640 1 -- 172.21.15.179:0/645674911 wait complete. 2024-09-17T03:32:37.967 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.968+0000 7f6adeeb6640 1 Processor -- start 2024-09-17T03:32:37.967 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.968+0000 7f6adeeb6640 1 -- start start 2024-09-17T03:32:37.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adeeb6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad806cc50 0x7f6ad8147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:37.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adeeb6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ad806fbf0 0x7f6ad81e7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:37.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adeeb6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad815d8a0 0x7f6ad81e8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:37.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adeeb6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad8073c80 con 0x7f6ad815d8a0 2024-09-17T03:32:37.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adeeb6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad8070540 con 0x7f6ad806cc50 2024-09-17T03:32:37.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adeeb6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad80706c0 con 0x7f6ad806fbf0 2024-09-17T03:32:37.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adcc52640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad806cc50 0x7f6ad8147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:37.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6ad7fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ad806fbf0 0x7f6ad81e7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:37.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6ad7fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ad806fbf0 0x7f6ad81e7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:41110/0 (socket says 172.21.15.179:41110) 2024-09-17T03:32:37.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adcc52640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad806cc50 0x7f6ad8147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:45394/0 (socket says 172.21.15.179:45394) 2024-09-17T03:32:37.971 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6add453640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad815d8a0 0x7f6ad81e8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6ad7fff640 1 -- 172.21.15.179:0/1295686806 learned_addr learned my addr 172.21.15.179:0/1295686806 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adcc52640 1 -- 172.21.15.179:0/1295686806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ad806fbf0 msgr2=0x7f6ad81e7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adcc52640 1 --2- 172.21.15.179:0/1295686806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ad806fbf0 0x7f6ad81e7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adcc52640 1 -- 172.21.15.179:0/1295686806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad815d8a0 msgr2=0x7f6ad81e8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adcc52640 1 --2- 172.21.15.179:0/1295686806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad815d8a0 0x7f6ad81e8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adcc52640 1 -- 172.21.15.179:0/1295686806 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad80b4020 con 0x7f6ad806cc50 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6ad7fff640 1 --2- 172.21.15.179:0/1295686806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ad806fbf0 0x7f6ad81e7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.970+0000 7f6adcc52640 1 --2- 172.21.15.179:0/1295686806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad806cc50 0x7f6ad8147f60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c3c0 tx=0x7f6acc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.971+0000 7f6ad57fa640 1 -- 172.21.15.179:0/1295686806 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc017070 con 0x7f6ad806cc50 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.971+0000 7f6ad57fa640 1 -- 172.21.15.179:0/1295686806 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6acc0053e0 con 0x7f6ad806cc50 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.971+0000 7f6ad57fa640 1 -- 172.21.15.179:0/1295686806 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc003850 con 0x7f6ad806cc50 2024-09-17T03:32:37.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.971+0000 7f6adeeb6640 1 -- 172.21.15.179:0/1295686806 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad81e6d00 con 0x7f6ad806cc50 2024-09-17T03:32:37.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.971+0000 7f6adeeb6640 1 -- 172.21.15.179:0/1295686806 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad81e72c0 con 0x7f6ad806cc50 2024-09-17T03:32:37.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.971+0000 7f6ad57fa640 1 -- 172.21.15.179:0/1295686806 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6acc01a070 con 0x7f6ad806cc50 2024-09-17T03:32:37.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.971+0000 7f6ad57fa640 1 -- 172.21.15.179:0/1295686806 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f6acc011d60 con 0x7f6ad806cc50 2024-09-17T03:32:37.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.972+0000 7f6adeeb6640 1 -- 172.21.15.179:0/1295686806 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad806ad70 con 0x7f6ad806cc50 2024-09-17T03:32:37.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:37.974+0000 7f6ad57fa640 1 -- 172.21.15.179:0/1295686806 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6acc021070 con 0x7f6ad806cc50 2024-09-17T03:32:38.043 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.044+0000 7f6adeeb6640 1 -- 172.21.15.179:0/1295686806 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3", "id": 2} v 0) -- 0x7f6ad8159ec0 con 0x7f6ad806cc50 2024-09-17T03:32:38.047 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.048+0000 7f6ad57fa640 1 -- 172.21.15.179:0/1295686806 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f6ad806d5a0 con 0x7f6ad806cc50 2024-09-17T03:32:38.047 INFO:teuthology.orchestra.run.smithi179.stdout:2 2024-09-17T03:32:38.048 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.049+0000 7f6adeeb6640 1 -- 172.21.15.179:0/1295686806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad806cc50 msgr2=0x7f6ad8147f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.048 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.049+0000 7f6adeeb6640 1 --2- 172.21.15.179:0/1295686806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad806cc50 0x7f6ad8147f60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c3c0 tx=0x7f6acc00c880 comp rx=0 tx=0).stop 2024-09-17T03:32:38.048 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.049+0000 7f6adeeb6640 1 -- 172.21.15.179:0/1295686806 shutdown_connections 2024-09-17T03:32:38.049 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.049+0000 7f6adeeb6640 1 --2- 172.21.15.179:0/1295686806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad815d8a0 0x7f6ad81e8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.049 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.049+0000 7f6adeeb6640 1 --2- 172.21.15.179:0/1295686806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ad806fbf0 0x7f6ad81e7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.049 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.049+0000 7f6adeeb6640 1 --2- 172.21.15.179:0/1295686806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad806cc50 0x7f6ad8147f60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.049 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.049+0000 7f6adeeb6640 1 -- 172.21.15.179:0/1295686806 >> 172.21.15.179:0/1295686806 conn(0x7f6ad806dd60 msgr2=0x7f6ad815c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:38.049 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.049+0000 7f6adeeb6640 1 -- 172.21.15.179:0/1295686806 shutdown_connections 2024-09-17T03:32:38.049 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.049+0000 7f6adeeb6640 1 -- 172.21.15.179:0/1295686806 wait complete. 2024-09-17T03:32:38.059 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 542f3e7b-0e57-449e-89e0-a8e443f8fa44 3 2024-09-17T03:32:38.172 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.172+0000 7faac79c2640 1 -- 172.21.15.179:0/1510877767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac0152920 msgr2=0x7faac0073580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.172 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.172+0000 7faac79c2640 1 --2- 172.21.15.179:0/1510877767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac0152920 0x7faac0073580 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faac0074620 tx=0x7faab002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.172 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.172+0000 7faac79c2640 1 -- 172.21.15.179:0/1510877767 shutdown_connections 2024-09-17T03:32:38.173 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.172+0000 7faac79c2640 1 --2- 172.21.15.179:0/1510877767 >> v2:172.21.15.146:3300/0 conn(0x7faac00701f0 0x7faac00b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.173 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.172+0000 7faac79c2640 1 --2- 172.21.15.179:0/1510877767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac0152920 0x7faac0073580 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.173 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.172+0000 7faac79c2640 1 -- 172.21.15.179:0/1510877767 >> 172.21.15.179:0/1510877767 conn(0x7faac006dd60 msgr2=0x7faac006e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:38.173 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.172+0000 7faac79c2640 1 -- 172.21.15.179:0/1510877767 shutdown_connections 2024-09-17T03:32:38.173 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.172+0000 7faac79c2640 1 -- 172.21.15.179:0/1510877767 wait complete. 2024-09-17T03:32:38.173 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.174+0000 7faac79c2640 1 Processor -- start 2024-09-17T03:32:38.174 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.174+0000 7faac79c2640 1 -- start start 2024-09-17T03:32:38.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.175+0000 7faac79c2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac00701f0 0x7faac01511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.176 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac79c2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac0073ac0 0x7faac0159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac79c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac0152920 0x7faac0154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac79c2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faac00b5590 con 0x7faac0152920 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac79c2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faac00b5410 con 0x7faac0073ac0 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac79c2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7faac00b5710 con 0x7faac00701f0 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac575e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac00701f0 0x7faac01511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac4f5d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac0073ac0 0x7faac0159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac4f5d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac0073ac0 0x7faac0159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:45412/0 (socket says 172.21.15.179:45412) 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac4f5d640 1 -- 172.21.15.179:0/2529787318 learned_addr learned my addr 172.21.15.179:0/2529787318 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac5f5f640 1 --2- 172.21.15.179:0/2529787318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac0152920 0x7faac0154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac575e640 1 -- 172.21.15.179:0/2529787318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac0073ac0 msgr2=0x7faac0159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac575e640 1 --2- 172.21.15.179:0/2529787318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac0073ac0 0x7faac0159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.177 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac575e640 1 -- 172.21.15.179:0/2529787318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac0152920 msgr2=0x7faac0154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac575e640 1 --2- 172.21.15.179:0/2529787318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac0152920 0x7faac0154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac575e640 1 -- 172.21.15.179:0/2529787318 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac00d03a0 con 0x7faac00701f0 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac4f5d640 1 --2- 172.21.15.179:0/2529787318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac0073ac0 0x7faac0159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac5f5f640 1 --2- 172.21.15.179:0/2529787318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac0152920 0x7faac0154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac575e640 1 --2- 172.21.15.179:0/2529787318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac00701f0 0x7faac01511a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faab0031000 tx=0x7faab00038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faab5ffb640 1 -- 172.21.15.179:0/2529787318 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab003e030 con 0x7faac00701f0 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faab5ffb640 1 -- 172.21.15.179:0/2529787318 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faab0003d90 con 0x7faac00701f0 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faac79c2640 1 -- 172.21.15.179:0/2529787318 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac01f5ac0 con 0x7faac00701f0 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.176+0000 7faab5ffb640 1 -- 172.21.15.179:0/2529787318 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0035040 con 0x7faac00701f0 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.177+0000 7faac79c2640 1 -- 172.21.15.179:0/2529787318 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faac01f3000 con 0x7faac00701f0 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.177+0000 7faab5ffb640 1 -- 172.21.15.179:0/2529787318 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faab0041030 con 0x7faac00701f0 2024-09-17T03:32:38.178 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.177+0000 7faab5ffb640 1 -- 172.21.15.179:0/2529787318 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7faab0043c10 con 0x7faac00701f0 2024-09-17T03:32:38.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.178+0000 7faac79c2640 1 -- 172.21.15.179:0/2529787318 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac00b5c30 con 0x7faac00701f0 2024-09-17T03:32:38.179 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.180+0000 7faab5ffb640 1 -- 172.21.15.179:0/2529787318 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7faab0004f70 con 0x7faac00701f0 2024-09-17T03:32:38.250 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.251+0000 7faac79c2640 1 -- 172.21.15.179:0/2529787318 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "542f3e7b-0e57-449e-89e0-a8e443f8fa44", "id": 3} v 0) -- 0x7faac0069a60 con 0x7faac00701f0 2024-09-17T03:32:38.254 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.255+0000 7faab5ffb640 1 -- 172.21.15.179:0/2529787318 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "542f3e7b-0e57-449e-89e0-a8e443f8fa44", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7faab0043780 con 0x7faac00701f0 2024-09-17T03:32:38.254 INFO:teuthology.orchestra.run.smithi179.stdout:3 2024-09-17T03:32:38.256 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.256+0000 7faac79c2640 1 -- 172.21.15.179:0/2529787318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac00701f0 msgr2=0x7faac01511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.256 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.256+0000 7faac79c2640 1 --2- 172.21.15.179:0/2529787318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac00701f0 0x7faac01511a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faab0031000 tx=0x7faab00038a0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.256 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.256+0000 7faac79c2640 1 -- 172.21.15.179:0/2529787318 shutdown_connections 2024-09-17T03:32:38.256 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.256+0000 7faac79c2640 1 --2- 172.21.15.179:0/2529787318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac0152920 0x7faac0154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.256 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.256+0000 7faac79c2640 1 --2- 172.21.15.179:0/2529787318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faac0073ac0 0x7faac0159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.256 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.256+0000 7faac79c2640 1 --2- 172.21.15.179:0/2529787318 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faac00701f0 0x7faac01511a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.256 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.256+0000 7faac79c2640 1 -- 172.21.15.179:0/2529787318 >> 172.21.15.179:0/2529787318 conn(0x7faac006dd60 msgr2=0x7faac006e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:38.256 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.256+0000 7faac79c2640 1 -- 172.21.15.179:0/2529787318 shutdown_connections 2024-09-17T03:32:38.256 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.256+0000 7faac79c2640 1 -- 172.21.15.179:0/2529787318 wait complete. 2024-09-17T03:32:38.266 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new d6cae9a1-5c96-42c9-b3c4-8193823111c0 4 2024-09-17T03:32:38.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.380+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/2601807573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d18073c90 msgr2=0x7f1d1806fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.380+0000 7f1d1cdc3640 1 --2- 172.21.15.179:0/2601807573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d18073c90 0x7f1d1806fae0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1d00005fd0 tx=0x7f1d0002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.380+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/2601807573 shutdown_connections 2024-09-17T03:32:38.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.380+0000 7f1d1cdc3640 1 --2- 172.21.15.179:0/2601807573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d18070020 0x7f1d180b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.380+0000 7f1d1cdc3640 1 --2- 172.21.15.179:0/2601807573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d18073c90 0x7f1d1806fae0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.380+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/2601807573 >> 172.21.15.179:0/2601807573 conn(0x7f1d1806dd60 msgr2=0x7f1d1806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:38.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.380+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/2601807573 shutdown_connections 2024-09-17T03:32:38.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.380+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/2601807573 wait complete. 2024-09-17T03:32:38.381 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.382+0000 7f1d1cdc3640 1 Processor -- start 2024-09-17T03:32:38.381 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.382+0000 7f1d1cdc3640 1 -- start start 2024-09-17T03:32:38.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.383+0000 7f1d1cdc3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d18070020 0x7f1d1814ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.383+0000 7f1d1cdc3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d18152920 0x7f1d181550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.383+0000 7f1d1cdc3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1815b2e0 0x7f1d181555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.383+0000 7f1d1cdc3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1d180b5590 con 0x7f1d18070020 2024-09-17T03:32:38.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.383+0000 7f1d1cdc3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1d180b5410 con 0x7f1d18152920 2024-09-17T03:32:38.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.383+0000 7f1d1cdc3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1d180b5710 con 0x7f1d1815b2e0 2024-09-17T03:32:38.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.383+0000 7f1d0ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d18152920 0x7f1d181550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.383+0000 7f1d0ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d18152920 0x7f1d181550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:45422/0 (socket says 172.21.15.179:45422) 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.383+0000 7f1d0ffff640 1 -- 172.21.15.179:0/326551962 learned_addr learned my addr 172.21.15.179:0/326551962 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.383+0000 7f1d16d9d640 1 --2- 172.21.15.179:0/326551962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1815b2e0 0x7f1d181555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.383+0000 7f1d1659c640 1 --2- 172.21.15.179:0/326551962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d18070020 0x7f1d1814ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d0ffff640 1 -- 172.21.15.179:0/326551962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1815b2e0 msgr2=0x7f1d181555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d0ffff640 1 --2- 172.21.15.179:0/326551962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1815b2e0 0x7f1d181555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d0ffff640 1 -- 172.21.15.179:0/326551962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d18070020 msgr2=0x7f1d1814ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d0ffff640 1 --2- 172.21.15.179:0/326551962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d18070020 0x7f1d1814ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d0ffff640 1 -- 172.21.15.179:0/326551962 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d181f8790 con 0x7f1d18152920 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d16d9d640 1 --2- 172.21.15.179:0/326551962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1815b2e0 0x7f1d181555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d0ffff640 1 --2- 172.21.15.179:0/326551962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d18152920 0x7f1d181550a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1d00034040 tx=0x7f1d000035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d0effd640 1 -- 172.21.15.179:0/326551962 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0003e030 con 0x7f1d18152920 2024-09-17T03:32:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d0effd640 1 -- 172.21.15.179:0/326551962 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d00003ae0 con 0x7f1d18152920 2024-09-17T03:32:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/326551962 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d181f8a70 con 0x7f1d18152920 2024-09-17T03:32:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d0effd640 1 -- 172.21.15.179:0/326551962 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00035040 con 0x7f1d18152920 2024-09-17T03:32:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/326551962 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d181f9030 con 0x7f1d18152920 2024-09-17T03:32:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d0effd640 1 -- 172.21.15.179:0/326551962 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1d00041030 con 0x7f1d18152920 2024-09-17T03:32:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.384+0000 7f1d0effd640 1 -- 172.21.15.179:0/326551962 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f1d00043a10 con 0x7f1d18152920 2024-09-17T03:32:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.385+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/326551962 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d180afcb0 con 0x7f1d18152920 2024-09-17T03:32:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.387+0000 7f1d0effd640 1 -- 172.21.15.179:0/326551962 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1d00043cf0 con 0x7f1d18152920 2024-09-17T03:32:38.458 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.458+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/326551962 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6cae9a1-5c96-42c9-b3c4-8193823111c0", "id": 4} v 0) -- 0x7f1d180b5bc0 con 0x7f1d18152920 2024-09-17T03:32:38.461 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.462+0000 7f1d0effd640 1 -- 172.21.15.179:0/326551962 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6cae9a1-5c96-42c9-b3c4-8193823111c0", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f1d00004cc0 con 0x7f1d18152920 2024-09-17T03:32:38.461 INFO:teuthology.orchestra.run.smithi179.stdout:4 2024-09-17T03:32:38.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.463+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/326551962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d18152920 msgr2=0x7f1d181550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.463+0000 7f1d1cdc3640 1 --2- 172.21.15.179:0/326551962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d18152920 0x7f1d181550a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1d00034040 tx=0x7f1d000035f0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.463+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/326551962 shutdown_connections 2024-09-17T03:32:38.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.463+0000 7f1d1cdc3640 1 --2- 172.21.15.179:0/326551962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d1815b2e0 0x7f1d181555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.463+0000 7f1d1cdc3640 1 --2- 172.21.15.179:0/326551962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d18152920 0x7f1d181550a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.463+0000 7f1d1cdc3640 1 --2- 172.21.15.179:0/326551962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d18070020 0x7f1d1814ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.463+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/326551962 >> 172.21.15.179:0/326551962 conn(0x7f1d1806dd60 msgr2=0x7f1d180b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:38.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.463+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/326551962 shutdown_connections 2024-09-17T03:32:38.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.463+0000 7f1d1cdc3640 1 -- 172.21.15.179:0/326551962 wait complete. 2024-09-17T03:32:38.473 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new d956715d-591c-4915-b131-ed4756ac0e3d 5 2024-09-17T03:32:38.587 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.587+0000 7f6971d50640 1 -- 172.21.15.179:0/11778496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f696c0d0350 msgr2=0x7f696c06eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.587 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.587+0000 7f6971d50640 1 --2- 172.21.15.179:0/11778496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f696c0d0350 0x7f696c06eb20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f696c073570 tx=0x7f695c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.587 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.587+0000 7f6971d50640 1 -- 172.21.15.179:0/11778496 shutdown_connections 2024-09-17T03:32:38.587 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.587+0000 7f6971d50640 1 --2- 172.21.15.179:0/11778496 >> v2:172.21.15.146:3300/0 conn(0x7f696c0b0330 0x7f696c1604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.587 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.587+0000 7f6971d50640 1 --2- 172.21.15.179:0/11778496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f696c0d0350 0x7f696c06eb20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.587 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.587+0000 7f6971d50640 1 -- 172.21.15.179:0/11778496 >> 172.21.15.179:0/11778496 conn(0x7f696c0b2e20 msgr2=0x7f696c0b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:38.587 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.587+0000 7f6971d50640 1 -- 172.21.15.179:0/11778496 shutdown_connections 2024-09-17T03:32:38.587 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.587+0000 7f6971d50640 1 -- 172.21.15.179:0/11778496 wait complete. 2024-09-17T03:32:38.588 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.589+0000 7f6971d50640 1 Processor -- start 2024-09-17T03:32:38.588 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.589+0000 7f6971d50640 1 -- start start 2024-09-17T03:32:38.592 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.590+0000 7f6971d50640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f696c0b0330 0x7f696c142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.592 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.590+0000 7f6971d50640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f696c0d0350 0x7f696c1f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.592 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.590+0000 7f6971d50640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f696c160a30 0x7f696c0b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.592 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.590+0000 7f6971d50640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f696c0afdc0 con 0x7f696c160a30 2024-09-17T03:32:38.592 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.590+0000 7f6971d50640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f696c0afc40 con 0x7f696c0b0330 2024-09-17T03:32:38.592 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.590+0000 7f6971d50640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f696c0aff40 con 0x7f696c0d0350 2024-09-17T03:32:38.592 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.590+0000 7f696b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f696c0b0330 0x7f696c142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.592 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.590+0000 7f696b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f696c0b0330 0x7f696c142510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:45440/0 (socket says 172.21.15.179:45440) 2024-09-17T03:32:38.592 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.590+0000 7f696b7fe640 1 -- 172.21.15.179:0/238272114 learned_addr learned my addr 172.21.15.179:0/238272114 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-17T03:32:38.592 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.590+0000 7f6963fff640 1 --2- 172.21.15.179:0/238272114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f696c0d0350 0x7f696c1f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.593 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.590+0000 7f696bfff640 1 --2- 172.21.15.179:0/238272114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f696c160a30 0x7f696c0b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.593 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f696b7fe640 1 -- 172.21.15.179:0/238272114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f696c0d0350 msgr2=0x7f696c1f7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.593 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f696b7fe640 1 --2- 172.21.15.179:0/238272114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f696c0d0350 0x7f696c1f7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.593 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f696b7fe640 1 -- 172.21.15.179:0/238272114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f696c160a30 msgr2=0x7f696c0b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.593 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f696b7fe640 1 --2- 172.21.15.179:0/238272114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f696c160a30 0x7f696c0b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.593 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f696b7fe640 1 -- 172.21.15.179:0/238272114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c145240 con 0x7f696c0b0330 2024-09-17T03:32:38.593 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f696b7fe640 1 --2- 172.21.15.179:0/238272114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f696c0b0330 0x7f696c142510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f695c005fd0 tx=0x7f695c0039e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:38.593 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f6968ff9640 1 -- 172.21.15.179:0/238272114 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c03e030 con 0x7f696c0b0330 2024-09-17T03:32:38.593 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f6968ff9640 1 -- 172.21.15.179:0/238272114 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f695c0047a0 con 0x7f696c0b0330 2024-09-17T03:32:38.594 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f6968ff9640 1 -- 172.21.15.179:0/238272114 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c035040 con 0x7f696c0b0330 2024-09-17T03:32:38.594 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f6971d50640 1 -- 172.21.15.179:0/238272114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696c1f3fe0 con 0x7f696c0b0330 2024-09-17T03:32:38.594 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f6971d50640 1 -- 172.21.15.179:0/238272114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696c1f45a0 con 0x7f696c0b0330 2024-09-17T03:32:38.594 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f6968ff9640 1 -- 172.21.15.179:0/238272114 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f695c041030 con 0x7f696c0b0330 2024-09-17T03:32:38.594 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.591+0000 7f6968ff9640 1 -- 172.21.15.179:0/238272114 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f695c031400 con 0x7f696c0b0330 2024-09-17T03:32:38.594 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.592+0000 7f6971d50640 1 -- 172.21.15.179:0/238272114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696c06ff90 con 0x7f696c0b0330 2024-09-17T03:32:38.595 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.596+0000 7f6968ff9640 1 -- 172.21.15.179:0/238272114 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f696c06ff90 con 0x7f696c0b0330 2024-09-17T03:32:38.666 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.667+0000 7f6971d50640 1 -- 172.21.15.179:0/238272114 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d956715d-591c-4915-b131-ed4756ac0e3d", "id": 5} v 0) -- 0x7f696c1604f0 con 0x7f696c0b0330 2024-09-17T03:32:38.671 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.671+0000 7f6968ff9640 1 -- 172.21.15.179:0/238272114 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d956715d-591c-4915-b131-ed4756ac0e3d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f695c043410 con 0x7f696c0b0330 2024-09-17T03:32:38.671 INFO:teuthology.orchestra.run.smithi179.stdout:5 2024-09-17T03:32:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.672+0000 7f6971d50640 1 -- 172.21.15.179:0/238272114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f696c0b0330 msgr2=0x7f696c142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.672+0000 7f6971d50640 1 --2- 172.21.15.179:0/238272114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f696c0b0330 0x7f696c142510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f695c005fd0 tx=0x7f695c0039e0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.672+0000 7f6971d50640 1 -- 172.21.15.179:0/238272114 shutdown_connections 2024-09-17T03:32:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.672+0000 7f6971d50640 1 --2- 172.21.15.179:0/238272114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f696c160a30 0x7f696c0b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.672+0000 7f6971d50640 1 --2- 172.21.15.179:0/238272114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f696c0d0350 0x7f696c1f7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.672 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.672+0000 7f6971d50640 1 --2- 172.21.15.179:0/238272114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f696c0b0330 0x7f696c142510 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.672+0000 7f6971d50640 1 -- 172.21.15.179:0/238272114 >> 172.21.15.179:0/238272114 conn(0x7f696c0b2e20 msgr2=0x7f696c15b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:38.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.672+0000 7f6971d50640 1 -- 172.21.15.179:0/238272114 shutdown_connections 2024-09-17T03:32:38.673 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.672+0000 7f6971d50640 1 -- 172.21.15.179:0/238272114 wait complete. 2024-09-17T03:32:38.683 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new da872c37-516d-432c-b171-fc750171a886 6 2024-09-17T03:32:38.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.797+0000 7f11b3390640 1 -- 172.21.15.179:0/2030466152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11ac0cd7a0 msgr2=0x7f11ac0cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.797+0000 7f11b3390640 1 --2- 172.21.15.179:0/2030466152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11ac0cd7a0 0x7f11ac0cdbb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f11a4005fd0 tx=0x7f11a402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.797+0000 7f11b3390640 1 -- 172.21.15.179:0/2030466152 shutdown_connections 2024-09-17T03:32:38.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.797+0000 7f11b3390640 1 --2- 172.21.15.179:0/2030466152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11ac0cd7a0 0x7f11ac0cdbb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.797+0000 7f11b3390640 1 -- 172.21.15.179:0/2030466152 >> 172.21.15.179:0/2030466152 conn(0x7f11ac09ba20 msgr2=0x7f11ac0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:38.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.797+0000 7f11b3390640 1 -- 172.21.15.179:0/2030466152 shutdown_connections 2024-09-17T03:32:38.797 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.797+0000 7f11b3390640 1 -- 172.21.15.179:0/2030466152 wait complete. 2024-09-17T03:32:38.798 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.799+0000 7f11b3390640 1 Processor -- start 2024-09-17T03:32:38.798 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.799+0000 7f11b3390640 1 -- start start 2024-09-17T03:32:38.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.800+0000 7f11b3390640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11ac0b47c0 0x7f11ac06f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.800+0000 7f11b3390640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11ac0cd7a0 0x7f11ac06f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.800+0000 7f11b3390640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11ac0d0710 0x7f11ac1f9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:38.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.800+0000 7f11b3390640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac0b2f30 con 0x7f11ac0cd7a0 2024-09-17T03:32:38.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.800+0000 7f11b3390640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac0b80a0 con 0x7f11ac0b47c0 2024-09-17T03:32:38.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.800+0000 7f11b3390640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f11ac168470 con 0x7f11ac0d0710 2024-09-17T03:32:38.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.800+0000 7f11b112c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11ac0b47c0 0x7f11ac06f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.800+0000 7f11b192d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11ac0d0710 0x7f11ac1f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.800+0000 7f11b112c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11ac0b47c0 0x7f11ac06f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:45450/0 (socket says 172.21.15.179:45450) 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.800+0000 7f11b112c640 1 -- 172.21.15.179:0/3600064721 learned_addr learned my addr 172.21.15.179:0/3600064721 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.800+0000 7f11b092b640 1 --2- 172.21.15.179:0/3600064721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11ac0cd7a0 0x7f11ac06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f11b112c640 1 -- 172.21.15.179:0/3600064721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11ac0d0710 msgr2=0x7f11ac1f9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f11b112c640 1 --2- 172.21.15.179:0/3600064721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11ac0d0710 0x7f11ac1f9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f11b112c640 1 -- 172.21.15.179:0/3600064721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11ac0cd7a0 msgr2=0x7f11ac06f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f11b112c640 1 --2- 172.21.15.179:0/3600064721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11ac0cd7a0 0x7f11ac06f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f11b112c640 1 -- 172.21.15.179:0/3600064721 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ac0b0fa0 con 0x7f11ac0b47c0 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f11b112c640 1 --2- 172.21.15.179:0/3600064721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11ac0b47c0 0x7f11ac06f0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f11a000c400 tx=0x7f11a000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f119dffb640 1 -- 172.21.15.179:0/3600064721 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0011790 con 0x7f11ac0b47c0 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f119dffb640 1 -- 172.21.15.179:0/3600064721 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11a0017070 con 0x7f11ac0b47c0 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f11b3390640 1 -- 172.21.15.179:0/3600064721 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ac0b1280 con 0x7f11ac0b47c0 2024-09-17T03:32:38.802 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f119dffb640 1 -- 172.21.15.179:0/3600064721 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0011ce0 con 0x7f11ac0b47c0 2024-09-17T03:32:38.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f119dffb640 1 -- 172.21.15.179:0/3600064721 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f11a001c460 con 0x7f11ac0b47c0 2024-09-17T03:32:38.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.801+0000 7f11b3390640 1 -- 172.21.15.179:0/3600064721 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ac15c640 con 0x7f11ac0b47c0 2024-09-17T03:32:38.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.802+0000 7f119dffb640 1 -- 172.21.15.179:0/3600064721 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f11a001c750 con 0x7f11ac0b47c0 2024-09-17T03:32:38.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.802+0000 7f11b3390640 1 -- 172.21.15.179:0/3600064721 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11ac0cdbb0 con 0x7f11ac0b47c0 2024-09-17T03:32:38.803 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.804+0000 7f119dffb640 1 -- 172.21.15.179:0/3600064721 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f11a0022020 con 0x7f11ac0b47c0 2024-09-17T03:32:38.874 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.875+0000 7f11b3390640 1 -- 172.21.15.179:0/3600064721 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "da872c37-516d-432c-b171-fc750171a886", "id": 6} v 0) -- 0x7f11ac0ced70 con 0x7f11ac0b47c0 2024-09-17T03:32:38.879 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.879+0000 7f119dffb640 1 -- 172.21.15.179:0/3600064721 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da872c37-516d-432c-b171-fc750171a886", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f11a0012420 con 0x7f11ac0b47c0 2024-09-17T03:32:38.879 INFO:teuthology.orchestra.run.smithi179.stdout:6 2024-09-17T03:32:38.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.880+0000 7f11b3390640 1 -- 172.21.15.179:0/3600064721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11ac0b47c0 msgr2=0x7f11ac06f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:38.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.880+0000 7f11b3390640 1 --2- 172.21.15.179:0/3600064721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11ac0b47c0 0x7f11ac06f0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f11a000c400 tx=0x7f11a000c8c0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.880+0000 7f11b3390640 1 -- 172.21.15.179:0/3600064721 shutdown_connections 2024-09-17T03:32:38.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.880+0000 7f11b3390640 1 --2- 172.21.15.179:0/3600064721 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11ac0d0710 0x7f11ac1f9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.880 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.880+0000 7f11b3390640 1 --2- 172.21.15.179:0/3600064721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11ac0cd7a0 0x7f11ac06f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.881 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.880+0000 7f11b3390640 1 --2- 172.21.15.179:0/3600064721 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11ac0b47c0 0x7f11ac06f0c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:38.881 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.880+0000 7f11b3390640 1 -- 172.21.15.179:0/3600064721 >> 172.21.15.179:0/3600064721 conn(0x7f11ac09ba20 msgr2=0x7f11ac0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:38.881 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.881+0000 7f11b3390640 1 -- 172.21.15.179:0/3600064721 shutdown_connections 2024-09-17T03:32:38.881 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:38.881+0000 7f11b3390640 1 -- 172.21.15.179:0/3600064721 wait complete. 2024-09-17T03:32:38.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 03575bb5-3966-4f22-85eb-378a03e46a11 7 2024-09-17T03:32:39.005 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.005+0000 7f580d225640 1 -- 172.21.15.179:0/489408230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5808074a00 msgr2=0x7f580806f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:39.005 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.005+0000 7f580d225640 1 --2- 172.21.15.179:0/489408230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5808074a00 0x7f580806f360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5800009be0 tx=0x7f580002a8d0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.006 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.006+0000 7f580d225640 1 -- 172.21.15.179:0/489408230 shutdown_connections 2024-09-17T03:32:39.006 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.006+0000 7f580d225640 1 --2- 172.21.15.179:0/489408230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5808074a00 0x7f580806f360 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.006 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.006+0000 7f580d225640 1 --2- 172.21.15.179:0/489408230 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58080b3c90 0x7f580815b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.006 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.006+0000 7f580d225640 1 -- 172.21.15.179:0/489408230 >> 172.21.15.179:0/489408230 conn(0x7f58080b2db0 msgr2=0x7f58080b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:39.006 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.006+0000 7f580d225640 1 -- 172.21.15.179:0/489408230 shutdown_connections 2024-09-17T03:32:39.006 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.006+0000 7f580d225640 1 -- 172.21.15.179:0/489408230 wait complete. 2024-09-17T03:32:39.007 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.008+0000 7f580d225640 1 Processor -- start 2024-09-17T03:32:39.007 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.008+0000 7f580d225640 1 -- start start 2024-09-17T03:32:39.010 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f580d225640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080b3c90 0x7f580809e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:39.010 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f580d225640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58080b4f30 0x7f58081451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:39.010 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f580d225640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58080731e0 0x7f58080735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:39.010 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f580d225640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f58080af3a0 con 0x7f58080731e0 2024-09-17T03:32:39.010 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f580d225640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f58080af220 con 0x7f58080b3c90 2024-09-17T03:32:39.010 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f580d225640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f58080af520 con 0x7f58080b4f30 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f5806d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080b3c90 0x7f580809e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f580659c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58080b4f30 0x7f58081451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f5806d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080b3c90 0x7f580809e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:45462/0 (socket says 172.21.15.179:45462) 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f580659c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58080b4f30 0x7f58081451c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:41172/0 (socket says 172.21.15.179:41172) 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f5806d9d640 1 -- 172.21.15.179:0/1199252814 learned_addr learned my addr 172.21.15.179:0/1199252814 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f580759e640 1 --2- 172.21.15.179:0/1199252814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58080731e0 0x7f58080735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f5806d9d640 1 -- 172.21.15.179:0/1199252814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58080b4f30 msgr2=0x7f58081451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f5806d9d640 1 --2- 172.21.15.179:0/1199252814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58080b4f30 0x7f58081451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f5806d9d640 1 -- 172.21.15.179:0/1199252814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58080731e0 msgr2=0x7f58080735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.009+0000 7f5806d9d640 1 --2- 172.21.15.179:0/1199252814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58080731e0 0x7f58080735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.010+0000 7f5806d9d640 1 -- 172.21.15.179:0/1199252814 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5808073b30 con 0x7f58080b3c90 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.010+0000 7f580659c640 1 --2- 172.21.15.179:0/1199252814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58080b4f30 0x7f58081451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.010+0000 7f5806d9d640 1 --2- 172.21.15.179:0/1199252814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080b3c90 0x7f580809e240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e9f0 tx=0x7f57f800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:39.011 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.010+0000 7f57ff7fe640 1 -- 172.21.15.179:0/1199252814 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f800cd80 con 0x7f58080b3c90 2024-09-17T03:32:39.012 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.010+0000 7f57ff7fe640 1 -- 172.21.15.179:0/1199252814 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57f8004020 con 0x7f58080b3c90 2024-09-17T03:32:39.012 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.010+0000 7f580d225640 1 -- 172.21.15.179:0/1199252814 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5808147e80 con 0x7f58080b3c90 2024-09-17T03:32:39.012 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.010+0000 7f57ff7fe640 1 -- 172.21.15.179:0/1199252814 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8004450 con 0x7f58080b3c90 2024-09-17T03:32:39.012 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.010+0000 7f580d225640 1 -- 172.21.15.179:0/1199252814 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5808148440 con 0x7f58080b3c90 2024-09-17T03:32:39.012 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.010+0000 7f57ff7fe640 1 -- 172.21.15.179:0/1199252814 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f57f80053b0 con 0x7f58080b3c90 2024-09-17T03:32:39.012 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.010+0000 7f57ff7fe640 1 -- 172.21.15.179:0/1199252814 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f57f8003d90 con 0x7f58080b3c90 2024-09-17T03:32:39.012 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.011+0000 7f580d225640 1 -- 172.21.15.179:0/1199252814 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58080af9d0 con 0x7f58080b3c90 2024-09-17T03:32:39.012 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.013+0000 7f57ff7fe640 1 -- 172.21.15.179:0/1199252814 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5808073b30 con 0x7f58080b3c90 2024-09-17T03:32:39.083 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.084+0000 7f580d225640 1 -- 172.21.15.179:0/1199252814 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "03575bb5-3966-4f22-85eb-378a03e46a11", "id": 7} v 0) -- 0x7f58080d0430 con 0x7f58080b3c90 2024-09-17T03:32:39.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.088+0000 7f57ff7fe640 1 -- 172.21.15.179:0/1199252814 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "03575bb5-3966-4f22-85eb-378a03e46a11", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f57f8003730 con 0x7f58080b3c90 2024-09-17T03:32:39.087 INFO:teuthology.orchestra.run.smithi179.stdout:7 2024-09-17T03:32:39.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.089+0000 7f580d225640 1 -- 172.21.15.179:0/1199252814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080b3c90 msgr2=0x7f580809e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:39.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.089+0000 7f580d225640 1 --2- 172.21.15.179:0/1199252814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080b3c90 0x7f580809e240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e9f0 tx=0x7f57f800eeb0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.089+0000 7f580d225640 1 -- 172.21.15.179:0/1199252814 shutdown_connections 2024-09-17T03:32:39.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.089+0000 7f580d225640 1 --2- 172.21.15.179:0/1199252814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58080731e0 0x7f58080735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.089+0000 7f580d225640 1 --2- 172.21.15.179:0/1199252814 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58080b4f30 0x7f58081451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.089+0000 7f580d225640 1 --2- 172.21.15.179:0/1199252814 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58080b3c90 0x7f580809e240 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.089+0000 7f580d225640 1 -- 172.21.15.179:0/1199252814 >> 172.21.15.179:0/1199252814 conn(0x7f58080b2db0 msgr2=0x7f58080b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:39.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.089+0000 7f580d225640 1 -- 172.21.15.179:0/1199252814 shutdown_connections 2024-09-17T03:32:39.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:32:39.089+0000 7f580d225640 1 -- 172.21.15.179:0/1199252814 wait complete. 2024-09-17T03:32:39.099 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T03:32:39.099 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T03:32:39.102 INFO:tasks.ceph.osd.0:Started 2024-09-17T03:32:39.102 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T03:32:39.102 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T03:32:39.105 INFO:tasks.ceph.osd.1:Started 2024-09-17T03:32:39.105 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T03:32:39.105 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T03:32:39.107 INFO:tasks.ceph.osd.2:Started 2024-09-17T03:32:39.107 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T03:32:39.107 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T03:32:39.110 INFO:tasks.ceph.osd.3:Started 2024-09-17T03:32:39.110 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T03:32:39.110 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T03:32:39.112 INFO:tasks.ceph.osd.4:Started 2024-09-17T03:32:39.112 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T03:32:39.112 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T03:32:39.114 INFO:tasks.ceph.osd.5:Started 2024-09-17T03:32:39.114 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T03:32:39.114 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T03:32:39.116 INFO:tasks.ceph.osd.6:Started 2024-09-17T03:32:39.116 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T03:32:39.116 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T03:32:39.119 INFO:tasks.ceph.osd.7:Started 2024-09-17T03:32:39.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:32:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.260+0000 7f9f707ed640 1 -- 172.21.15.146:0/680089975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f680b4530 msgr2=0x7f9f680b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.260+0000 7f9f707ed640 1 --2- 172.21.15.146:0/680089975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f680b4530 0x7f9f680b4940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009830 tx=0x7f9f5802a5c0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.260+0000 7f9f707ed640 1 -- 172.21.15.146:0/680089975 shutdown_connections 2024-09-17T03:32:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.260+0000 7f9f707ed640 1 --2- 172.21.15.146:0/680089975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f680b4530 0x7f9f680b4940 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.260+0000 7f9f707ed640 1 -- 172.21.15.146:0/680089975 >> 172.21.15.146:0/680089975 conn(0x7f9f680b3410 msgr2=0x7f9f680b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.260+0000 7f9f707ed640 1 -- 172.21.15.146:0/680089975 shutdown_connections 2024-09-17T03:32:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.260+0000 7f9f707ed640 1 -- 172.21.15.146:0/680089975 wait complete. 2024-09-17T03:32:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.261+0000 7f9f707ed640 1 Processor -- start 2024-09-17T03:32:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.262+0000 7f9f707ed640 1 -- start start 2024-09-17T03:32:39.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f707ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f6806dd60 0x7f9f6814b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f707ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f680b4530 0x7f9f681440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f707ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f680b55f0 0x7f9f68148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f707ed640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6815be90 con 0x7f9f680b4530 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f707ed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6815bd10 con 0x7f9f680b55f0 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f707ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6815c010 con 0x7f9f6806dd60 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f6dd88640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f680b4530 0x7f9f681440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f6dd88640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f680b4530 0x7f9f681440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56474/0 (socket says 172.21.15.146:56474) 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f6dd88640 1 -- 172.21.15.146:0/365665898 learned_addr learned my addr 172.21.15.146:0/365665898 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f6ed8a640 1 --2- 172.21.15.146:0/365665898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f680b55f0 0x7f9f68148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f6e589640 1 --2- 172.21.15.146:0/365665898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f6806dd60 0x7f9f6814b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f6dd88640 1 -- 172.21.15.146:0/365665898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f6806dd60 msgr2=0x7f9f6814b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f6dd88640 1 --2- 172.21.15.146:0/365665898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f6806dd60 0x7f9f6814b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f6dd88640 1 -- 172.21.15.146:0/365665898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f680b55f0 msgr2=0x7f9f68148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:39.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f6dd88640 1 --2- 172.21.15.146:0/365665898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f680b55f0 0x7f9f68148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f6dd88640 1 -- 172.21.15.146:0/365665898 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f68148030 con 0x7f9f680b4530 2024-09-17T03:32:39.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.263+0000 7f9f6dd88640 1 --2- 172.21.15.146:0/365665898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f680b4530 0x7f9f681440d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009950 tx=0x7f9f58033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:39.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.264+0000 7f9f5effd640 1 -- 172.21.15.146:0/365665898 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58031d60 con 0x7f9f680b4530 2024-09-17T03:32:39.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.264+0000 7f9f707ed640 1 -- 172.21.15.146:0/365665898 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f68148310 con 0x7f9f680b4530 2024-09-17T03:32:39.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.264+0000 7f9f5effd640 1 -- 172.21.15.146:0/365665898 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f58033e10 con 0x7f9f680b4530 2024-09-17T03:32:39.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.264+0000 7f9f707ed640 1 -- 172.21.15.146:0/365665898 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f681488d0 con 0x7f9f680b4530 2024-09-17T03:32:39.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.264+0000 7f9f5effd640 1 -- 172.21.15.146:0/365665898 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f580332d0 con 0x7f9f680b4530 2024-09-17T03:32:39.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.264+0000 7f9f5effd640 1 -- 172.21.15.146:0/365665898 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9f580334b0 con 0x7f9f680b4530 2024-09-17T03:32:39.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.264+0000 7f9f5effd640 1 -- 172.21.15.146:0/365665898 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9f580330d0 con 0x7f9f680b4530 2024-09-17T03:32:39.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.265+0000 7f9f707ed640 1 -- 172.21.15.146:0/365665898 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f6815c5a0 con 0x7f9f680b4530 2024-09-17T03:32:39.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.267+0000 7f9f5effd640 1 -- 172.21.15.146:0/365665898 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9f5804a030 con 0x7f9f680b4530 2024-09-17T03:32:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.327+0000 7f9f707ed640 1 -- 172.21.15.146:0/365665898 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f680b4940 con 0x7f9f680b4530 2024-09-17T03:32:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.328+0000 7f9f5effd640 1 -- 172.21.15.146:0/365665898 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9f5803f030 con 0x7f9f680b4530 2024-09-17T03:32:39.326 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:32:39.327 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":10,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:32:39.086389+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:32:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.328+0000 7f9f707ed640 1 -- 172.21.15.146:0/365665898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f680b4530 msgr2=0x7f9f681440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.328+0000 7f9f707ed640 1 --2- 172.21.15.146:0/365665898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f680b4530 0x7f9f681440d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009950 tx=0x7f9f58033c20 comp rx=0 tx=0).stop 2024-09-17T03:32:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.328+0000 7f9f707ed640 1 -- 172.21.15.146:0/365665898 shutdown_connections 2024-09-17T03:32:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.328+0000 7f9f707ed640 1 --2- 172.21.15.146:0/365665898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f680b55f0 0x7f9f68148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.329+0000 7f9f707ed640 1 --2- 172.21.15.146:0/365665898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f680b4530 0x7f9f681440d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.329+0000 7f9f707ed640 1 --2- 172.21.15.146:0/365665898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f6806dd60 0x7f9f6814b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:39.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.329+0000 7f9f707ed640 1 -- 172.21.15.146:0/365665898 >> 172.21.15.146:0/365665898 conn(0x7f9f680b3410 msgr2=0x7f9f680b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:39.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.329+0000 7f9f707ed640 1 -- 172.21.15.146:0/365665898 shutdown_connections 2024-09-17T03:32:39.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:39.329+0000 7f9f707ed640 1 -- 172.21.15.146:0/365665898 wait complete. 2024-09-17T03:32:39.339 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T03:32:39.339 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T03:32:40.146 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:32:40.252 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.253+0000 7f5229f39640 1 -- 172.21.15.146:0/843815262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5224071070 msgr2=0x7f52240b5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:40.252 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.253+0000 7f5229f39640 1 --2- 172.21.15.146:0/843815262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5224071070 0x7f52240b5ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f52240b4000 tx=0x7f521402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:32:40.252 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.253+0000 7f5229f39640 1 -- 172.21.15.146:0/843815262 shutdown_connections 2024-09-17T03:32:40.252 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.253+0000 7f5229f39640 1 --2- 172.21.15.146:0/843815262 >> v2:172.21.15.179:3300/0 conn(0x7f5224074850 0x7f522406f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:40.253 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.253+0000 7f5229f39640 1 --2- 172.21.15.146:0/843815262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52240b48d0 0x7f5224074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:40.253 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.253+0000 7f5229f39640 1 --2- 172.21.15.146:0/843815262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5224071070 0x7f52240b5ea0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:40.253 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.253+0000 7f5229f39640 1 -- 172.21.15.146:0/843815262 >> 172.21.15.146:0/843815262 conn(0x7f52240b2e20 msgr2=0x7f52240b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:40.253 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.253+0000 7f5229f39640 1 -- 172.21.15.146:0/843815262 shutdown_connections 2024-09-17T03:32:40.253 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.253+0000 7f5229f39640 1 -- 172.21.15.146:0/843815262 wait complete. 2024-09-17T03:32:40.253 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.255+0000 7f5229f39640 1 Processor -- start 2024-09-17T03:32:40.254 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.255+0000 7f5229f39640 1 -- start start 2024-09-17T03:32:40.257 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.256+0000 7f5229f39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5224071070 0x7f5224154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:40.257 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.256+0000 7f5229f39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5224074850 0x7f5224148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:40.257 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.256+0000 7f5229f39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52240b48d0 0x7f5224149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:40.257 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.256+0000 7f5229f39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f522406fd50 con 0x7f5224074850 2024-09-17T03:32:40.257 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.256+0000 7f5229f39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f522406fbd0 con 0x7f52240b48d0 2024-09-17T03:32:40.257 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.256+0000 7f5229f39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f522406fed0 con 0x7f5224071070 2024-09-17T03:32:40.257 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.256+0000 7f5222ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5224074850 0x7f5224148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:40.257 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.256+0000 7f5222ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5224074850 0x7f5224148b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56498/0 (socket says 172.21.15.146:56498) 2024-09-17T03:32:40.257 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.256+0000 7f5222ffd640 1 -- 172.21.15.146:0/3542876466 learned_addr learned my addr 172.21.15.146:0/3542876466 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:40.257 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.256+0000 7f52237fe640 1 --2- 172.21.15.146:0/3542876466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5224071070 0x7f5224154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.256+0000 7f5223fff640 1 --2- 172.21.15.146:0/3542876466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52240b48d0 0x7f5224149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f5222ffd640 1 -- 172.21.15.146:0/3542876466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5224071070 msgr2=0x7f5224154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f5222ffd640 1 --2- 172.21.15.146:0/3542876466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5224071070 0x7f5224154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f5222ffd640 1 -- 172.21.15.146:0/3542876466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52240b48d0 msgr2=0x7f5224149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f5222ffd640 1 --2- 172.21.15.146:0/3542876466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52240b48d0 0x7f5224149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f5222ffd640 1 -- 172.21.15.146:0/3542876466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522409e870 con 0x7f5224074850 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f5223fff640 1 --2- 172.21.15.146:0/3542876466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52240b48d0 0x7f5224149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f5222ffd640 1 --2- 172.21.15.146:0/3542876466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5224074850 0x7f5224148b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f520c00c970 tx=0x7f520c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f521bfff640 1 -- 172.21.15.146:0/3542876466 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c007bb0 con 0x7f5224074850 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f521bfff640 1 -- 172.21.15.146:0/3542876466 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f520c005020 con 0x7f5224074850 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f5229f39640 1 -- 172.21.15.146:0/3542876466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5224157a40 con 0x7f5224074850 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f521bfff640 1 -- 172.21.15.146:0/3542876466 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c007e60 con 0x7f5224074850 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.257+0000 7f5229f39640 1 -- 172.21.15.146:0/3542876466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5224158000 con 0x7f5224074850 2024-09-17T03:32:40.258 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.258+0000 7f5229f39640 1 -- 172.21.15.146:0/3542876466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f522406f3c0 con 0x7f5224074850 2024-09-17T03:32:40.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.258+0000 7f521bfff640 1 -- 172.21.15.146:0/3542876466 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f520c005470 con 0x7f5224074850 2024-09-17T03:32:40.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.258+0000 7f521bfff640 1 -- 172.21.15.146:0/3542876466 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f520c0527b0 con 0x7f5224074850 2024-09-17T03:32:40.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.260+0000 7f521bfff640 1 -- 172.21.15.146:0/3542876466 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f522409e870 con 0x7f5224074850 2024-09-17T03:32:40.320 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.321+0000 7f5229f39640 1 -- 172.21.15.146:0/3542876466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52240b3700 con 0x7f5224074850 2024-09-17T03:32:40.321 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.322+0000 7f521bfff640 1 -- 172.21.15.146:0/3542876466 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f520c014030 con 0x7f5224074850 2024-09-17T03:32:40.321 INFO:teuthology.misc.health.smithi146.stdout: 2024-09-17T03:32:40.321 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":10,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:32:39.086389+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:32:40.323 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.323+0000 7f5229f39640 1 -- 172.21.15.146:0/3542876466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5224074850 msgr2=0x7f5224148b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:40.323 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.323+0000 7f5229f39640 1 --2- 172.21.15.146:0/3542876466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5224074850 0x7f5224148b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f520c00c970 tx=0x7f520c00ce30 comp rx=0 tx=0).stop 2024-09-17T03:32:40.323 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.323+0000 7f5229f39640 1 -- 172.21.15.146:0/3542876466 shutdown_connections 2024-09-17T03:32:40.323 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.323+0000 7f5229f39640 1 --2- 172.21.15.146:0/3542876466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52240b48d0 0x7f5224149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:40.323 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.323+0000 7f5229f39640 1 --2- 172.21.15.146:0/3542876466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5224074850 0x7f5224148b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:40.323 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.323+0000 7f5229f39640 1 --2- 172.21.15.146:0/3542876466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5224071070 0x7f5224154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:40.323 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.323+0000 7f5229f39640 1 -- 172.21.15.146:0/3542876466 >> 172.21.15.146:0/3542876466 conn(0x7f52240b2e20 msgr2=0x7f522415f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:40.324 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.323+0000 7f5229f39640 1 -- 172.21.15.146:0/3542876466 shutdown_connections 2024-09-17T03:32:40.324 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:40.323+0000 7f5229f39640 1 -- 172.21.15.146:0/3542876466 wait complete. 2024-09-17T03:32:40.331 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T03:32:40.577 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-17T03:32:40.578+0000 7f3d2c80d640 -1 Falling back to public interface 2024-09-17T03:32:40.595 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-09-17T03:32:40.596+0000 7fdd17ad6640 -1 Falling back to public interface 2024-09-17T03:32:40.597 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-17T03:32:40.597+0000 7f697ff20640 -1 Falling back to public interface 2024-09-17T03:32:40.794 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-17T03:32:40.794+0000 7f82524dc640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T03:32:40.795 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-17T03:32:40.795+0000 7f82524dc640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T03:32:40.824 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-17T03:32:40.825+0000 7f9265024640 -1 Falling back to public interface 2024-09-17T03:32:40.840 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-09-17T03:32:40.841+0000 7f762dddd640 -1 Falling back to public interface 2024-09-17T03:32:40.845 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-09-17T03:32:40.846+0000 7fa65561a640 -1 Falling back to public interface 2024-09-17T03:32:41.071 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T03:32:41.072+0000 7fe0b1c0f640 -1 Falling back to public interface 2024-09-17T03:32:41.086 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-17T03:32:41.087+0000 7f7b1c1db640 -1 Falling back to public interface 2024-09-17T03:32:44.397 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-09-17T03:32:44.398+0000 7fdd17ad6640 -1 osd.3 0 log_to_monitors true 2024-09-17T03:32:44.413 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-17T03:32:44.413+0000 7f3d2c80d640 -1 osd.5 0 log_to_monitors true 2024-09-17T03:32:44.612 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-09-17T03:32:44.613+0000 7f762dddd640 -1 osd.0 0 log_to_monitors true 2024-09-17T03:32:44.837 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T03:32:44.838+0000 7fe0b1c0f640 -1 osd.2 0 log_to_monitors true 2024-09-17T03:32:44.877 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-17T03:32:44.878+0000 7f9265024640 -1 osd.4 0 log_to_monitors true 2024-09-17T03:32:44.918 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-17T03:32:44.918+0000 7f697ff20640 -1 osd.6 0 log_to_monitors true 2024-09-17T03:32:44.920 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-09-17T03:32:44.922+0000 7fa65561a640 -1 osd.1 0 log_to_monitors true 2024-09-17T03:32:45.150 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-17T03:32:45.151+0000 7f7b1c1db640 -1 osd.7 0 log_to_monitors true 2024-09-17T03:32:46.321 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-17T03:32:46.322+0000 7f3d2824a640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T03:32:46.332 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-17T03:32:46.333+0000 7f3d20040640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:32:46.370 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-09-17T03:32:46.371+0000 7fdd14279640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T03:32:46.383 INFO:tasks.ceph.osd.3.smithi146.stderr:2024-09-17T03:32:46.383+0000 7fdd0b85a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:32:47.137 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:32:47.251 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.251+0000 7f42b49a9640 1 -- 172.21.15.146:0/3984896597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b00cf4a0 msgr2=0x7f42b00cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:47.252 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.251+0000 7f42b49a9640 1 --2- 172.21.15.146:0/3984896597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b00cf4a0 0x7f42b00cf8b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42b008d780 tx=0x7f429802a530 comp rx=0 tx=0).stop 2024-09-17T03:32:47.252 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.251+0000 7f42b49a9640 1 -- 172.21.15.146:0/3984896597 shutdown_connections 2024-09-17T03:32:47.252 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.251+0000 7f42b49a9640 1 --2- 172.21.15.146:0/3984896597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b00cf4a0 0x7f42b00cf8b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:47.252 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.251+0000 7f42b49a9640 1 --2- 172.21.15.146:0/3984896597 >> v2:172.21.15.179:3300/0 conn(0x7f42b00d2350 0x7f42b015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:47.252 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.251+0000 7f42b49a9640 1 -- 172.21.15.146:0/3984896597 >> 172.21.15.146:0/3984896597 conn(0x7f42b00d4960 msgr2=0x7f42b00d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:47.252 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.251+0000 7f42b49a9640 1 -- 172.21.15.146:0/3984896597 shutdown_connections 2024-09-17T03:32:47.252 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.251+0000 7f42b49a9640 1 -- 172.21.15.146:0/3984896597 wait complete. 2024-09-17T03:32:47.255 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.255+0000 7f42b49a9640 1 Processor -- start 2024-09-17T03:32:47.255 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.255+0000 7f42b49a9640 1 -- start start 2024-09-17T03:32:47.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.257+0000 7f42b49a9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b00cf4a0 0x7f42b01f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:47.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.257+0000 7f42b49a9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b00cfdf0 0x7f42b01f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:47.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.257+0000 7f42b49a9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b00d2350 0x7f42b015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:47.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42b49a9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f42b0069410 con 0x7f42b00cf4a0 2024-09-17T03:32:47.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42b49a9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f42b00b9300 con 0x7f42b00cfdf0 2024-09-17T03:32:47.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42b49a9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f42b0069590 con 0x7f42b00d2350 2024-09-17T03:32:47.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42ae59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b00cf4a0 0x7f42b01f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:47.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42ae59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b00cf4a0 0x7f42b01f5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42806/0 (socket says 172.21.15.146:42806) 2024-09-17T03:32:47.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42ae59c640 1 -- 172.21.15.146:0/840372 learned_addr learned my addr 172.21.15.146:0/840372 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:47.259 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42aed9d640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b00d2350 0x7f42b015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:47.260 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42a5d9b640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b00cfdf0 0x7f42b01f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:47.260 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42ae59c640 1 -- 172.21.15.146:0/840372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b00d2350 msgr2=0x7f42b015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:47.260 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42ae59c640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b00d2350 0x7f42b015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:47.260 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42ae59c640 1 -- 172.21.15.146:0/840372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b00cfdf0 msgr2=0x7f42b01f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:47.260 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42ae59c640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b00cfdf0 0x7f42b01f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:47.260 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42ae59c640 1 -- 172.21.15.146:0/840372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b014fbd0 con 0x7f42b00cf4a0 2024-09-17T03:32:47.260 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42aed9d640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b00d2350 0x7f42b015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:32:47.260 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42a5d9b640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b00cfdf0 0x7f42b01f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:32:47.260 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.258+0000 7f42ae59c640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b00cf4a0 0x7f42b01f5b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42a000e790 tx=0x7f42a000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:47.261 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.259+0000 7f42a77fe640 1 -- 172.21.15.146:0/840372 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a000eea0 con 0x7f42b00cf4a0 2024-09-17T03:32:47.261 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.259+0000 7f42a77fe640 1 -- 172.21.15.146:0/840372 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42a000cdb0 con 0x7f42b00cf4a0 2024-09-17T03:32:47.261 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.259+0000 7f42b49a9640 1 -- 172.21.15.146:0/840372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b0152ab0 con 0x7f42b00cf4a0 2024-09-17T03:32:47.262 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.259+0000 7f42a77fe640 1 -- 172.21.15.146:0/840372 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0010690 con 0x7f42b00cf4a0 2024-09-17T03:32:47.262 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.259+0000 7f42b49a9640 1 -- 172.21.15.146:0/840372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b00ad620 con 0x7f42b00cf4a0 2024-09-17T03:32:47.262 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.260+0000 7f42b49a9640 1 -- 172.21.15.146:0/840372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b0069230 con 0x7f42b00cf4a0 2024-09-17T03:32:47.262 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.261+0000 7f42a77fe640 1 -- 172.21.15.146:0/840372 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f42a0010830 con 0x7f42b00cf4a0 2024-09-17T03:32:47.262 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.262+0000 7f42a77fe640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4290078b00 0x7f429007b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:47.262 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.262+0000 7f42a77fe640 1 -- 172.21.15.146:0/840372 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2791+0+0 (secure 0 0 0) 0x7f42a009aa50 con 0x7f42b00cf4a0 2024-09-17T03:32:47.263 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.262+0000 7f42a5d9b640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4290078b00 0x7f429007b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:47.263 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.263+0000 7f42a5d9b640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4290078b00 0x7f429007b010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4298034000 tx=0x7f4298004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:47.268 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.268+0000 7f42a77fe640 1 -- 172.21.15.146:0/840372 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42b0069230 con 0x7f42b00cf4a0 2024-09-17T03:32:47.479 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.479+0000 7f42b49a9640 1 -- 172.21.15.146:0/840372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42b0069a40 con 0x7f42b00cf4a0 2024-09-17T03:32:47.484 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.484+0000 7f42a77fe640 1 -- 172.21.15.146:0/840372 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8029 (secure 0 0 0) 0x7f42a0063b60 con 0x7f42b00cf4a0 2024-09-17T03:32:47.484 INFO:teuthology.misc.health.smithi146.stdout: 2024-09-17T03:32:47.484 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":13,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:32:46.454816+0000","last_up_change":"2024-09-17T03:32:46.454816+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:32:47.486 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 -- 172.21.15.146:0/840372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4290078b00 msgr2=0x7f429007b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:47.487 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4290078b00 0x7f429007b010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4298034000 tx=0x7f4298004730 comp rx=0 tx=0).stop 2024-09-17T03:32:47.487 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 -- 172.21.15.146:0/840372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b00cf4a0 msgr2=0x7f42b01f5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:47.487 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b00cf4a0 0x7f42b01f5b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42a000e790 tx=0x7f42a000ec50 comp rx=0 tx=0).stop 2024-09-17T03:32:47.487 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 -- 172.21.15.146:0/840372 shutdown_connections 2024-09-17T03:32:47.487 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4290078b00 0x7f429007b010 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:47.487 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42b00d2350 0x7f42b015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:47.487 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b00cfdf0 0x7f42b01f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:47.487 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 --2- 172.21.15.146:0/840372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42b00cf4a0 0x7f42b01f5b40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:47.487 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 -- 172.21.15.146:0/840372 >> 172.21.15.146:0/840372 conn(0x7f42b00d4960 msgr2=0x7f42b00b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:47.487 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 -- 172.21.15.146:0/840372 shutdown_connections 2024-09-17T03:32:47.487 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:47.486+0000 7f42b49a9640 1 -- 172.21.15.146:0/840372 wait complete. 2024-09-17T03:32:47.496 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-17T03:32:48.133 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-09-17T03:32:48.133+0000 7f7629d6b640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T03:32:48.153 INFO:tasks.ceph.osd.0.smithi146.stderr:2024-09-17T03:32:48.153+0000 7f7621b61640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:32:48.195 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-17T03:32:48.196+0000 7f9260913640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T03:32:48.202 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-17T03:32:48.203+0000 7f697c6c3640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T03:32:48.203 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-17T03:32:48.204+0000 7f7b1897e640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T03:32:48.210 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-17T03:32:48.211+0000 7f9258709640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:32:48.215 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-17T03:32:48.216+0000 7f6973ca4640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:32:48.215 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-17T03:32:48.216+0000 7f7b0ff5f640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:32:48.227 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-09-17T03:32:48.227+0000 7fa6517b5640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T03:32:48.230 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T03:32:48.231+0000 7fe0ad4ec640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T03:32:48.239 INFO:tasks.ceph.osd.1.smithi146.stderr:2024-09-17T03:32:48.240+0000 7fa648d96640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:32:48.244 INFO:tasks.ceph.osd.2.smithi146.stderr:2024-09-17T03:32:48.245+0000 7fe0a52e2640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:32:54.304 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:32:54.421 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.421+0000 7fc2a4070640 1 -- 172.21.15.146:0/2116125833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc29c15c0a0 msgr2=0x7fc29c0d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:54.421 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.421+0000 7fc2a4070640 1 --2- 172.21.15.146:0/2116125833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc29c15c0a0 0x7fc29c0d0730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc294005fd0 tx=0x7fc29402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.421 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.421+0000 7fc2a4070640 1 -- 172.21.15.146:0/2116125833 shutdown_connections 2024-09-17T03:32:54.421 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.421+0000 7fc2a4070640 1 --2- 172.21.15.146:0/2116125833 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc29c15c0a0 0x7fc29c0d0730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.421 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.421+0000 7fc2a4070640 1 --2- 172.21.15.146:0/2116125833 >> v2:172.21.15.179:3300/0 conn(0x7fc29c06f790 0x7fc29c155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.421 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.421+0000 7fc2a4070640 1 -- 172.21.15.146:0/2116125833 >> 172.21.15.146:0/2116125833 conn(0x7fc29c06ce30 msgr2=0x7fc29c06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:54.422 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.421+0000 7fc2a4070640 1 -- 172.21.15.146:0/2116125833 shutdown_connections 2024-09-17T03:32:54.422 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.421+0000 7fc2a4070640 1 -- 172.21.15.146:0/2116125833 wait complete. 2024-09-17T03:32:54.422 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.422+0000 7fc2a4070640 1 Processor -- start 2024-09-17T03:32:54.422 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.423+0000 7fc2a4070640 1 -- start start 2024-09-17T03:32:54.425 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a4070640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc29c06f790 0x7fc29c1f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:54.425 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a4070640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc29c15bc90 0x7fc29c1f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:54.425 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a4070640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc29c15c0a0 0x7fc29c13fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:54.425 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a4070640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c073340 con 0x7fc29c06f790 2024-09-17T03:32:54.425 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a4070640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c0734c0 con 0x7fc29c15c0a0 2024-09-17T03:32:54.425 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a4070640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc29c073640 con 0x7fc29c15bc90 2024-09-17T03:32:54.425 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a1e0c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc29c06f790 0x7fc29c1f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a1e0c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc29c06f790 0x7fc29c1f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42818/0 (socket says 172.21.15.146:42818) 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a1e0c640 1 -- 172.21.15.146:0/3147424290 learned_addr learned my addr 172.21.15.146:0/3147424290 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a260d640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc29c15c0a0 0x7fc29c13fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a160b640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc29c15bc90 0x7fc29c1f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a1e0c640 1 -- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc29c15bc90 msgr2=0x7fc29c1f76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a1e0c640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc29c15bc90 0x7fc29c1f76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a1e0c640 1 -- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc29c15c0a0 msgr2=0x7fc29c13fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a1e0c640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc29c15c0a0 0x7fc29c13fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a1e0c640 1 -- 172.21.15.146:0/3147424290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c14c370 con 0x7fc29c06f790 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a260d640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc29c15c0a0 0x7fc29c13fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.424+0000 7fc2a1e0c640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc29c06f790 0x7fc29c1f71a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc29800e9f0 tx=0x7fc29800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.425+0000 7fc2927fc640 1 -- 172.21.15.146:0/3147424290 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29800cd20 con 0x7fc29c06f790 2024-09-17T03:32:54.426 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.425+0000 7fc2927fc640 1 -- 172.21.15.146:0/3147424290 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc298004020 con 0x7fc29c06f790 2024-09-17T03:32:54.427 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.425+0000 7fc2927fc640 1 -- 172.21.15.146:0/3147424290 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298004450 con 0x7fc29c06f790 2024-09-17T03:32:54.427 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.425+0000 7fc2a4070640 1 -- 172.21.15.146:0/3147424290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29c14c090 con 0x7fc29c06f790 2024-09-17T03:32:54.427 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.425+0000 7fc2a4070640 1 -- 172.21.15.146:0/3147424290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29c14dd40 con 0x7fc29c06f790 2024-09-17T03:32:54.427 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.426+0000 7fc2a4070640 1 -- 172.21.15.146:0/3147424290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29c153540 con 0x7fc29c06f790 2024-09-17T03:32:54.428 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.426+0000 7fc2927fc640 1 -- 172.21.15.146:0/3147424290 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc2980035f0 con 0x7fc29c06f790 2024-09-17T03:32:54.428 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.427+0000 7fc2927fc640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc280078bc0 0x7fc28007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:54.428 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.427+0000 7fc2927fc640 1 -- 172.21.15.146:0/3147424290 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc29809b320 con 0x7fc29c06f790 2024-09-17T03:32:54.428 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.427+0000 7fc2a160b640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc280078bc0 0x7fc28007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:54.428 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.427+0000 7fc2a160b640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc280078bc0 0x7fc28007b0d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc29c152790 tx=0x7fc28c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:54.431 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.431+0000 7fc2927fc640 1 -- 172.21.15.146:0/3147424290 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc29c153540 con 0x7fc29c06f790 2024-09-17T03:32:54.608 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.608+0000 7fc2a4070640 1 -- 172.21.15.146:0/3147424290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc29c073b60 con 0x7fc29c06f790 2024-09-17T03:32:54.609 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.609+0000 7fc2927fc640 1 -- 172.21.15.146:0/3147424290 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12944 (secure 0 0 0) 0x7fc298063ab0 con 0x7fc29c06f790 2024-09-17T03:32:54.609 INFO:teuthology.misc.health.smithi146.stdout: 2024-09-17T03:32:54.609 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":17,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:32:50.581725+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:32:54.611 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 -- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc280078bc0 msgr2=0x7fc28007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:54.611 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc280078bc0 0x7fc28007b0d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc29c152790 tx=0x7fc28c009040 comp rx=0 tx=0).stop 2024-09-17T03:32:54.611 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 -- 172.21.15.146:0/3147424290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc29c06f790 msgr2=0x7fc29c1f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:54.611 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc29c06f790 0x7fc29c1f71a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc29800e9f0 tx=0x7fc29800eeb0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.611 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 -- 172.21.15.146:0/3147424290 shutdown_connections 2024-09-17T03:32:54.612 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc280078bc0 0x7fc28007b0d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.612 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc29c15c0a0 0x7fc29c13fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.612 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc29c15bc90 0x7fc29c1f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.612 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 --2- 172.21.15.146:0/3147424290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc29c06f790 0x7fc29c1f71a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.612 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 -- 172.21.15.146:0/3147424290 >> 172.21.15.146:0/3147424290 conn(0x7fc29c06ce30 msgr2=0x7fc29c0cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:54.612 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 -- 172.21.15.146:0/3147424290 shutdown_connections 2024-09-17T03:32:54.612 INFO:teuthology.misc.health.smithi146.stderr:2024-09-17T03:32:54.611+0000 7fc2a4070640 1 -- 172.21.15.146:0/3147424290 wait complete. 2024-09-17T03:32:54.621 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T03:32:54.621 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T03:32:54.621 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:32:54.622 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:32:54.624 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:32:54.624 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:32:54.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:32:54.626 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:32:54.626 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:32:54.626 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:32:54.629 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:32:54.629 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:32:54.629 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:32:54.631 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:32:54.631 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T03:32:54.632 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:32:54.712 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:32:54.712 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:32:54.724 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:32:54.728 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:32:54.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.754+0000 7f47b78de640 1 -- 172.21.15.146:0/3087060908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b006e470 msgr2=0x7f47b00b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:54.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.754+0000 7f47b78de640 1 --2- 172.21.15.146:0/3087060908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b006e470 0x7f47b00b4940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47a8005fd0 tx=0x7f47a802a940 comp rx=0 tx=0).stop 2024-09-17T03:32:54.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.754+0000 7f47b78de640 1 -- 172.21.15.146:0/3087060908 shutdown_connections 2024-09-17T03:32:54.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.754+0000 7f47b78de640 1 --2- 172.21.15.146:0/3087060908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b006e470 0x7f47b00b4940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.754+0000 7f47b78de640 1 -- 172.21.15.146:0/3087060908 >> 172.21.15.146:0/3087060908 conn(0x7f47b00b3410 msgr2=0x7f47b00b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:54.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.754+0000 7f47b78de640 1 -- 172.21.15.146:0/3087060908 shutdown_connections 2024-09-17T03:32:54.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.754+0000 7f47b78de640 1 -- 172.21.15.146:0/3087060908 wait complete. 2024-09-17T03:32:54.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.756+0000 7f47b78de640 1 Processor -- start 2024-09-17T03:32:54.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.756+0000 7f47b78de640 1 -- start start 2024-09-17T03:32:54.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b78de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47b00b4530 0x7f47b014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:54.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b78de640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47b00b55f0 0x7f47b00cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:54.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b78de640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b00d0210 0x7f47b015b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:54.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b78de640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f47b015c0a0 con 0x7f47b00d0210 2024-09-17T03:32:54.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b78de640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f47b015bf20 con 0x7f47b00b55f0 2024-09-17T03:32:54.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b78de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f47b015c220 con 0x7f47b00b4530 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b5e7b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b00d0210 0x7f47b015b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b4e79640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47b00b55f0 0x7f47b00cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b5e7b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b00d0210 0x7f47b015b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42880/0 (socket says 172.21.15.146:42880) 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b5e7b640 1 -- 172.21.15.146:0/3727590473 learned_addr learned my addr 172.21.15.146:0/3727590473 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b567a640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47b00b4530 0x7f47b014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b5e7b640 1 -- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47b00b4530 msgr2=0x7f47b014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b5e7b640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47b00b4530 0x7f47b014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b5e7b640 1 -- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47b00b55f0 msgr2=0x7f47b00cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b5e7b640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47b00b55f0 0x7f47b00cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b5e7b640 1 -- 172.21.15.146:0/3727590473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b00d0620 con 0x7f47b00d0210 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.757+0000 7f47b4e79640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47b00b55f0 0x7f47b00cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:32:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.758+0000 7f47b5e7b640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b00d0210 0x7f47b015b160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009cd0 tx=0x7f47a8031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:54.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.758+0000 7f47a5ffb640 1 -- 172.21.15.146:0/3727590473 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a803e070 con 0x7f47b00d0210 2024-09-17T03:32:54.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.758+0000 7f47a5ffb640 1 -- 172.21.15.146:0/3727590473 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47a8004560 con 0x7f47b00d0210 2024-09-17T03:32:54.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.758+0000 7f47b78de640 1 -- 172.21.15.146:0/3727590473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b0152f90 con 0x7f47b00d0210 2024-09-17T03:32:54.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.758+0000 7f47a5ffb640 1 -- 172.21.15.146:0/3727590473 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8043460 con 0x7f47b00d0210 2024-09-17T03:32:54.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.758+0000 7f47b78de640 1 -- 172.21.15.146:0/3727590473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b0153550 con 0x7f47b00d0210 2024-09-17T03:32:54.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.759+0000 7f47b78de640 1 -- 172.21.15.146:0/3727590473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b015c6d0 con 0x7f47b00d0210 2024-09-17T03:32:54.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.760+0000 7f47a5ffb640 1 -- 172.21.15.146:0/3727590473 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f47a803a440 con 0x7f47b00d0210 2024-09-17T03:32:54.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.760+0000 7f47a5ffb640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4794078b90 0x7f479407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:54.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.760+0000 7f47a5ffb640 1 -- 172.21.15.146:0/3727590473 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f47a80bc490 con 0x7f47b00d0210 2024-09-17T03:32:54.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.760+0000 7f47b567a640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4794078b90 0x7f479407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:54.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.761+0000 7f47b567a640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4794078b90 0x7f479407b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0046b0 tx=0x7f47ac007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:54.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.765+0000 7f47a5ffb640 1 -- 172.21.15.146:0/3727590473 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f47b00d0620 con 0x7f47b00d0210 2024-09-17T03:32:54.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.972+0000 7f47b78de640 1 -- 172.21.15.146:0/3727590473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47b00b1440 con 0x7f47b00d0210 2024-09-17T03:32:54.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.972+0000 7f47a5ffb640 1 -- 172.21.15.146:0/3727590473 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f47a8088ff0 con 0x7f47b00d0210 2024-09-17T03:32:54.972 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:32:54.973 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":2,"btime":"2024-09-17T03:32:54:718671+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/580111663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":580111663},{"type":"v1","addr":"172.21.15.146:6834","nonce":580111663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T03:32:54.973 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 2 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.974+0000 7f47b78de640 1 -- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4794078b90 msgr2=0x7f479407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.974+0000 7f47b78de640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4794078b90 0x7f479407b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0046b0 tx=0x7f47ac007eb0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.974+0000 7f47b78de640 1 -- 172.21.15.146:0/3727590473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b00d0210 msgr2=0x7f47b015b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.974+0000 7f47b78de640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b00d0210 0x7f47b015b160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009cd0 tx=0x7f47a8031ea0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.974+0000 7f47b78de640 1 -- 172.21.15.146:0/3727590473 shutdown_connections 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.974+0000 7f47b78de640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4794078b90 0x7f479407b0a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.974+0000 7f47b78de640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b00d0210 0x7f47b015b160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.974+0000 7f47b78de640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f47b00b55f0 0x7f47b00cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.974+0000 7f47b78de640 1 --2- 172.21.15.146:0/3727590473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47b00b4530 0x7f47b014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.974+0000 7f47b78de640 1 -- 172.21.15.146:0/3727590473 >> 172.21.15.146:0/3727590473 conn(0x7f47b00b3410 msgr2=0x7f47b00734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.974+0000 7f47b78de640 1 -- 172.21.15.146:0/3727590473 shutdown_connections 2024-09-17T03:32:54.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:54.975+0000 7f47b78de640 1 -- 172.21.15.146:0/3727590473 wait complete. 2024-09-17T03:32:56.293 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:32:56.296 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:32:56.986 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:32:57.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.112+0000 7fda201c6640 1 -- 172.21.15.146:0/102160956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda180b5750 msgr2=0x7fda180b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.112+0000 7fda201c6640 1 --2- 172.21.15.146:0/102160956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda180b5750 0x7fda180b3620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda08005fd0 tx=0x7fda0802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.112+0000 7fda201c6640 1 -- 172.21.15.146:0/102160956 shutdown_connections 2024-09-17T03:32:57.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.112+0000 7fda201c6640 1 --2- 172.21.15.146:0/102160956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda180b3b60 0x7fda1815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.112+0000 7fda201c6640 1 --2- 172.21.15.146:0/102160956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda180b5750 0x7fda180b3620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.112+0000 7fda201c6640 1 -- 172.21.15.146:0/102160956 >> 172.21.15.146:0/102160956 conn(0x7fda180b7b20 msgr2=0x7fda1809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:57.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.112+0000 7fda201c6640 1 -- 172.21.15.146:0/102160956 shutdown_connections 2024-09-17T03:32:57.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.112+0000 7fda201c6640 1 -- 172.21.15.146:0/102160956 wait complete. 2024-09-17T03:32:57.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.114+0000 7fda201c6640 1 Processor -- start 2024-09-17T03:32:57.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.114+0000 7fda201c6640 1 -- start start 2024-09-17T03:32:57.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda201c6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda180b3b60 0x7fda18146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda201c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda180b5750 0x7fda181e5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda201c6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda180b5ce0 0x7fda181e5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda201c6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fda1815d4b0 con 0x7fda180b5750 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda201c6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fda1815d330 con 0x7fda180b3b60 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda201c6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fda1815d630 con 0x7fda180b5ce0 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda1d761640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda180b5750 0x7fda181e5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda1d761640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda180b5750 0x7fda181e5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42898/0 (socket says 172.21.15.146:42898) 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda1d761640 1 -- 172.21.15.146:0/1589251253 learned_addr learned my addr 172.21.15.146:0/1589251253 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda1e763640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda180b5ce0 0x7fda181e5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda1df62640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda180b3b60 0x7fda18146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda1d761640 1 -- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda180b5ce0 msgr2=0x7fda181e5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda1d761640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda180b5ce0 0x7fda181e5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda1d761640 1 -- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda180b3b60 msgr2=0x7fda18146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda1d761640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda180b3b60 0x7fda18146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.115+0000 7fda1d761640 1 -- 172.21.15.146:0/1589251253 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda181f4840 con 0x7fda180b5750 2024-09-17T03:32:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.116+0000 7fda1d761640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda180b5750 0x7fda181e5850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda08006010 tx=0x7fda080038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.116+0000 7fda0e7fc640 1 -- 172.21.15.146:0/1589251253 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0803e030 con 0x7fda180b5750 2024-09-17T03:32:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.116+0000 7fda0e7fc640 1 -- 172.21.15.146:0/1589251253 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda08003ca0 con 0x7fda180b5750 2024-09-17T03:32:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.116+0000 7fda201c6640 1 -- 172.21.15.146:0/1589251253 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda1809ef40 con 0x7fda180b5750 2024-09-17T03:32:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.116+0000 7fda0e7fc640 1 -- 172.21.15.146:0/1589251253 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08035040 con 0x7fda180b5750 2024-09-17T03:32:57.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.116+0000 7fda201c6640 1 -- 172.21.15.146:0/1589251253 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda1809f500 con 0x7fda180b5750 2024-09-17T03:32:57.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.117+0000 7fda201c6640 1 -- 172.21.15.146:0/1589251253 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda1815db00 con 0x7fda180b5750 2024-09-17T03:32:57.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.118+0000 7fda0e7fc640 1 -- 172.21.15.146:0/1589251253 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda08041030 con 0x7fda180b5750 2024-09-17T03:32:57.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.118+0000 7fda0e7fc640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9fc078bc0 0x7fd9fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.118+0000 7fda0e7fc640 1 -- 172.21.15.146:0/1589251253 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fda080baf30 con 0x7fda180b5750 2024-09-17T03:32:57.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.118+0000 7fda1df62640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9fc078bc0 0x7fd9fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.119+0000 7fda1df62640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9fc078bc0 0x7fd9fc07b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda14001720 tx=0x7fda14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:57.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.123+0000 7fda0e7fc640 1 -- 172.21.15.146:0/1589251253 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fda08083100 con 0x7fda180b5750 2024-09-17T03:32:57.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.330+0000 7fda201c6640 1 -- 172.21.15.146:0/1589251253 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda18071520 con 0x7fda180b5750 2024-09-17T03:32:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.331+0000 7fda0e7fc640 1 -- 172.21.15.146:0/1589251253 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7fda0808ae20 con 0x7fda180b5750 2024-09-17T03:32:57.331 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:32:57.331 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":3,"btime":"2024-09-17T03:32:55:719916+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/771934087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":771934087},{"type":"v1","addr":"172.21.15.179:6837","nonce":771934087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/580111663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":580111663},{"type":"v1","addr":"172.21.15.146:6834","nonce":580111663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3998700466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3998700466},{"type":"v1","addr":"172.21.15.146:6835","nonce":3998700466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3419525644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3419525644},{"type":"v1","addr":"172.21.15.179:6835","nonce":3419525644}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T03:32:57.331 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 3 2024-09-17T03:32:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 -- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9fc078bc0 msgr2=0x7fd9fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9fc078bc0 0x7fd9fc07b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda14001720 tx=0x7fda14009040 comp rx=0 tx=0).stop 2024-09-17T03:32:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 -- 172.21.15.146:0/1589251253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda180b5750 msgr2=0x7fda181e5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda180b5750 0x7fda181e5850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda08006010 tx=0x7fda080038a0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 -- 172.21.15.146:0/1589251253 shutdown_connections 2024-09-17T03:32:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9fc078bc0 0x7fd9fc07b0d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fda180b5ce0 0x7fda181e5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda180b5750 0x7fda181e5850 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 --2- 172.21.15.146:0/1589251253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fda180b3b60 0x7fda18146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 -- 172.21.15.146:0/1589251253 >> 172.21.15.146:0/1589251253 conn(0x7fda180b7b20 msgr2=0x7fda1809bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 -- 172.21.15.146:0/1589251253 shutdown_connections 2024-09-17T03:32:57.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.333+0000 7fda201c6640 1 -- 172.21.15.146:0/1589251253 wait complete. 2024-09-17T03:32:57.344 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:32:57.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.457+0000 7f683d24d640 1 -- 172.21.15.146:0/1877441030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6838073d00 msgr2=0x7f683815c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.457+0000 7f683d24d640 1 --2- 172.21.15.146:0/1877441030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6838073d00 0x7f683815c7b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f682c005fd0 tx=0x7f682c02a540 comp rx=0 tx=0).stop 2024-09-17T03:32:57.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.457+0000 7f683d24d640 1 -- 172.21.15.146:0/1877441030 shutdown_connections 2024-09-17T03:32:57.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.457+0000 7f683d24d640 1 --2- 172.21.15.146:0/1877441030 >> v2:172.21.15.179:3300/0 conn(0x7f68381556c0 0x7f6838155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.457+0000 7f683d24d640 1 --2- 172.21.15.146:0/1877441030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6838073d00 0x7f683815c7b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.457+0000 7f683d24d640 1 -- 172.21.15.146:0/1877441030 >> 172.21.15.146:0/1877441030 conn(0x7f68380b3510 msgr2=0x7f68380b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:57.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.457+0000 7f683d24d640 1 -- 172.21.15.146:0/1877441030 shutdown_connections 2024-09-17T03:32:57.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.457+0000 7f683d24d640 1 -- 172.21.15.146:0/1877441030 wait complete. 2024-09-17T03:32:57.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.459+0000 7f683d24d640 1 Processor -- start 2024-09-17T03:32:57.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.459+0000 7f683d24d640 1 -- start start 2024-09-17T03:32:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683d24d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68380cdf90 0x7f6838145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683d24d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68381556c0 0x7f68381f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683d24d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683815a7a0 0x7f683815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683d24d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f68380b67f0 con 0x7f68381556c0 2024-09-17T03:32:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683d24d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6838156210 con 0x7f683815a7a0 2024-09-17T03:32:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683d24d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f68380cfb30 con 0x7f68380cdf90 2024-09-17T03:32:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68381556c0 0x7f68381f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68381556c0 0x7f68381f6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59366/0 (socket says 172.21.15.146:59366) 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683659c640 1 -- 172.21.15.146:0/1807522202 learned_addr learned my addr 172.21.15.146:0/1807522202 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f6836d9d640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68380cdf90 0x7f6838145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683759e640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683815a7a0 0x7f683815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683659c640 1 -- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68380cdf90 msgr2=0x7f6838145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683659c640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68380cdf90 0x7f6838145130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683659c640 1 -- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683815a7a0 msgr2=0x7f683815abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683659c640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683815a7a0 0x7f683815abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683659c640 1 -- 172.21.15.146:0/1807522202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683815b0f0 con 0x7f68381556c0 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f6836d9d640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68380cdf90 0x7f6838145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683759e640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683815a7a0 0x7f683815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:32:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f683659c640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68381556c0 0x7f68381f6620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f682c034040 tx=0x7f682c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:57.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.461+0000 7f681f7fe640 1 -- 172.21.15.146:0/1807522202 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c03e030 con 0x7f68381556c0 2024-09-17T03:32:57.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.462+0000 7f681f7fe640 1 -- 172.21.15.146:0/1807522202 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f682c003d90 con 0x7f68381556c0 2024-09-17T03:32:57.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.462+0000 7f683d24d640 1 -- 172.21.15.146:0/1807522202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68381f94c0 con 0x7f68381556c0 2024-09-17T03:32:57.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.462+0000 7f681f7fe640 1 -- 172.21.15.146:0/1807522202 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c035040 con 0x7f68381556c0 2024-09-17T03:32:57.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.462+0000 7f683d24d640 1 -- 172.21.15.146:0/1807522202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68381f9a80 con 0x7f68381556c0 2024-09-17T03:32:57.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.463+0000 7f683d24d640 1 -- 172.21.15.146:0/1807522202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f683815c7b0 con 0x7f68381556c0 2024-09-17T03:32:57.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.463+0000 7f681f7fe640 1 -- 172.21.15.146:0/1807522202 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f682c041030 con 0x7f68381556c0 2024-09-17T03:32:57.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.464+0000 7f681f7fe640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6824078b90 0x7f682407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.464+0000 7f681f7fe640 1 -- 172.21.15.146:0/1807522202 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f682c0bb570 con 0x7f68381556c0 2024-09-17T03:32:57.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.464+0000 7f6836d9d640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6824078b90 0x7f682407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.465+0000 7f6836d9d640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6824078b90 0x7f682407b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6828007fd0 tx=0x7f6828009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.469+0000 7f681f7fe640 1 -- 172.21.15.146:0/1807522202 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f683815b0f0 con 0x7f68381556c0 2024-09-17T03:32:57.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.645+0000 7f683d24d640 1 -- 172.21.15.146:0/1807522202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f68380d1360 con 0x7f68381556c0 2024-09-17T03:32:57.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.646+0000 7f681f7fe640 1 -- 172.21.15.146:0/1807522202 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f682c083c80 con 0x7f68381556c0 2024-09-17T03:32:57.646 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:32:57.646 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:32:57.646 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:32:57.646 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:32:57.647 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:32:57.647 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:32:57.647 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 -- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6824078b90 msgr2=0x7f682407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6824078b90 0x7f682407b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6828007fd0 tx=0x7f6828009040 comp rx=0 tx=0).stop 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 -- 172.21.15.146:0/1807522202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68381556c0 msgr2=0x7f68381f6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68381556c0 0x7f68381f6620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f682c034040 tx=0x7f682c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 -- 172.21.15.146:0/1807522202 shutdown_connections 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6824078b90 0x7f682407b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f683815a7a0 0x7f683815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68381556c0 0x7f68381f6620 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 --2- 172.21.15.146:0/1807522202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68380cdf90 0x7f6838145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 -- 172.21.15.146:0/1807522202 >> 172.21.15.146:0/1807522202 conn(0x7f68380b3510 msgr2=0x7f68380b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 -- 172.21.15.146:0/1807522202 shutdown_connections 2024-09-17T03:32:57.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.648+0000 7f683d24d640 1 -- 172.21.15.146:0/1807522202 wait complete. 2024-09-17T03:32:57.659 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:32:57.660 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:32:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.778+0000 7f3e0c494640 1 -- 172.21.15.146:0/140316617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df0004800 msgr2=0x7f3df0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.778+0000 7f3e0c494640 1 --2- 172.21.15.146:0/140316617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df0004800 0x7f3df0004c10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e040b0700 tx=0x7f3df0005830 comp rx=0 tx=0).stop 2024-09-17T03:32:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.778+0000 7f3e0aa31640 1 -- 172.21.15.146:0/140316617 reap_dead start 2024-09-17T03:32:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.778+0000 7f3e0c494640 1 -- 172.21.15.146:0/140316617 shutdown_connections 2024-09-17T03:32:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.778+0000 7f3e0c494640 1 -- 172.21.15.146:0/140316617 >> 172.21.15.146:0/140316617 conn(0x7f3e040b3410 msgr2=0x7f3e040b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.778+0000 7f3e0c494640 1 -- 172.21.15.146:0/140316617 shutdown_connections 2024-09-17T03:32:57.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.778+0000 7f3e0c494640 1 -- 172.21.15.146:0/140316617 wait complete. 2024-09-17T03:32:57.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.779+0000 7f3e0c494640 1 Processor -- start 2024-09-17T03:32:57.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.780+0000 7f3e0c494640 1 -- start start 2024-09-17T03:32:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e0c494640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3df0004800 0x7f3e0413ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e0c494640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e04150350 0x7f3e04151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e0c494640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e04151990 0x7f3e040ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e0c494640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04070f70 con 0x7f3e04150350 2024-09-17T03:32:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e0c494640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04070df0 con 0x7f3df0004800 2024-09-17T03:32:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e0c494640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0415bd10 con 0x7f3e04151990 2024-09-17T03:32:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e09a2f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e04150350 0x7f3e04151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e09a2f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e04150350 0x7f3e04151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59386/0 (socket says 172.21.15.146:59386) 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e09a2f640 1 -- 172.21.15.146:0/89225487 learned_addr learned my addr 172.21.15.146:0/89225487 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e0a230640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3df0004800 0x7f3e0413ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e0aa31640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e04151990 0x7f3e040ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e09a2f640 1 -- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e04151990 msgr2=0x7f3e040ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e09a2f640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e04151990 0x7f3e040ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e09a2f640 1 -- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3df0004800 msgr2=0x7f3e0413ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e09a2f640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3df0004800 0x7f3e0413ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e09a2f640 1 -- 172.21.15.146:0/89225487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0413f3c0 con 0x7f3e04150350 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e0a230640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3df0004800 0x7f3e0413ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3e09a2f640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e04150350 0x7f3e04151450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3df40018f0 tx=0x7f3df40060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.781+0000 7f3dfaffd640 1 -- 172.21.15.146:0/89225487 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4043070 con 0x7f3e04150350 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.782+0000 7f3dfaffd640 1 -- 172.21.15.146:0/89225487 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3df4003b10 con 0x7f3e04150350 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.782+0000 7f3e0c494640 1 -- 172.21.15.146:0/89225487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e04151da0 con 0x7f3e04150350 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.782+0000 7f3dfaffd640 1 -- 172.21.15.146:0/89225487 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df40064c0 con 0x7f3e04150350 2024-09-17T03:32:57.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.782+0000 7f3e0c494640 1 -- 172.21.15.146:0/89225487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0414ebe0 con 0x7f3e04150350 2024-09-17T03:32:57.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.783+0000 7f3e0c494640 1 -- 172.21.15.146:0/89225487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e040b4530 con 0x7f3e04150350 2024-09-17T03:32:57.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.783+0000 7f3dfaffd640 1 -- 172.21.15.146:0/89225487 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3df4046070 con 0x7f3e04150350 2024-09-17T03:32:57.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.784+0000 7f3dfaffd640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3de8078bc0 0x7f3de807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:57.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.784+0000 7f3dfaffd640 1 -- 172.21.15.146:0/89225487 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f3df40ba900 con 0x7f3e04150350 2024-09-17T03:32:57.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.784+0000 7f3e0a230640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3de8078bc0 0x7f3de807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:57.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.785+0000 7f3e0a230640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3de8078bc0 0x7f3de807b0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009bb0 tx=0x7f3e00005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:57.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.788+0000 7f3dfaffd640 1 -- 172.21.15.146:0/89225487 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3e04151da0 con 0x7f3e04150350 2024-09-17T03:32:57.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:57.963+0000 7f3e0c494640 1 -- 172.21.15.146:0/89225487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3e040b53d0 con 0x7f3e04150350 2024-09-17T03:32:58.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.732+0000 7f3dfaffd640 1 -- 172.21.15.146:0/89225487 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f3e0413f3c0 con 0x7f3e04150350 2024-09-17T03:32:58.733 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:32:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.735+0000 7f3e0c494640 1 -- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3de8078bc0 msgr2=0x7f3de807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.735+0000 7f3e0c494640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3de8078bc0 0x7f3de807b0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009bb0 tx=0x7f3e00005f90 comp rx=0 tx=0).stop 2024-09-17T03:32:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.735+0000 7f3e0c494640 1 -- 172.21.15.146:0/89225487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e04150350 msgr2=0x7f3e04151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.735+0000 7f3e0c494640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e04150350 0x7f3e04151450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3df40018f0 tx=0x7f3df40060e0 comp rx=0 tx=0).stop 2024-09-17T03:32:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.735+0000 7f3e0c494640 1 -- 172.21.15.146:0/89225487 shutdown_connections 2024-09-17T03:32:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.735+0000 7f3e0c494640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3de8078bc0 0x7f3de807b0d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.735+0000 7f3e0c494640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e04151990 0x7f3e040ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.735+0000 7f3e0c494640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e04150350 0x7f3e04151450 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.735+0000 7f3e0c494640 1 --2- 172.21.15.146:0/89225487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3df0004800 0x7f3e0413ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.735+0000 7f3e0c494640 1 -- 172.21.15.146:0/89225487 >> 172.21.15.146:0/89225487 conn(0x7f3e040b3410 msgr2=0x7f3e04075ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.736+0000 7f3e0c494640 1 -- 172.21.15.146:0/89225487 shutdown_connections 2024-09-17T03:32:58.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.736+0000 7f3e0c494640 1 -- 172.21.15.146:0/89225487 wait complete. 2024-09-17T03:32:58.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:32:58.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.877+0000 7f8bae464640 1 -- 172.21.15.146:0/713734861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba80b9c30 msgr2=0x7f8ba80d3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:58.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.877+0000 7f8bae464640 1 --2- 172.21.15.146:0/713734861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba80b9c30 0x7f8ba80d3100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b98005fd0 tx=0x7f8b9802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:32:58.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.877+0000 7f8bae464640 1 -- 172.21.15.146:0/713734861 shutdown_connections 2024-09-17T03:32:58.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.877+0000 7f8bae464640 1 --2- 172.21.15.146:0/713734861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ba80b6df0 0x7f8ba80b7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:58.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.877+0000 7f8bae464640 1 --2- 172.21.15.146:0/713734861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba80b9c30 0x7f8ba80d3100 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:58.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.877+0000 7f8bae464640 1 -- 172.21.15.146:0/713734861 >> 172.21.15.146:0/713734861 conn(0x7f8ba80d1460 msgr2=0x7f8ba80d1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:58.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.877+0000 7f8bae464640 1 -- 172.21.15.146:0/713734861 shutdown_connections 2024-09-17T03:32:58.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.877+0000 7f8bae464640 1 -- 172.21.15.146:0/713734861 wait complete. 2024-09-17T03:32:58.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.879+0000 7f8bae464640 1 Processor -- start 2024-09-17T03:32:58.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.879+0000 7f8bae464640 1 -- start start 2024-09-17T03:32:58.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8bae464640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba80b9c30 0x7f8ba80b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:58.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8bae464640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ba80cf270 0x7f8ba80abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:58.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8bae464640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba81f8a00 0x7f8ba81f8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:58.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8bae464640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba80b8860 con 0x7f8ba81f8a00 2024-09-17T03:32:58.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8bae464640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba80b86e0 con 0x7f8ba80b9c30 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8bae464640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba80b89e0 con 0x7f8ba80cf270 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8baca01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba81f8a00 0x7f8ba81f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8baca01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba81f8a00 0x7f8ba81f8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59402/0 (socket says 172.21.15.146:59402) 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8baca01640 1 -- 172.21.15.146:0/2306814324 learned_addr learned my addr 172.21.15.146:0/2306814324 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8ba7fff640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba80b9c30 0x7f8ba80b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8ba77fe640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ba80cf270 0x7f8ba80abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8baca01640 1 -- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ba80cf270 msgr2=0x7f8ba80abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8baca01640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ba80cf270 0x7f8ba80abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8baca01640 1 -- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba80b9c30 msgr2=0x7f8ba80b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8baca01640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba80b9c30 0x7f8ba80b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8baca01640 1 -- 172.21.15.146:0/2306814324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba81f69a0 con 0x7f8ba81f8a00 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8baca01640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba81f8a00 0x7f8ba81f8e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000e990 tx=0x7f8ba000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8ba4ff9640 1 -- 172.21.15.146:0/2306814324 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0004d20 con 0x7f8ba81f8a00 2024-09-17T03:32:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8ba4ff9640 1 -- 172.21.15.146:0/2306814324 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ba000caa0 con 0x7f8ba81f8a00 2024-09-17T03:32:58.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8bae464640 1 -- 172.21.15.146:0/2306814324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba81f9350 con 0x7f8ba81f8a00 2024-09-17T03:32:58.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.881+0000 7f8ba4ff9640 1 -- 172.21.15.146:0/2306814324 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0005020 con 0x7f8ba81f8a00 2024-09-17T03:32:58.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.882+0000 7f8bae464640 1 -- 172.21.15.146:0/2306814324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba81e93a0 con 0x7f8ba81f8a00 2024-09-17T03:32:58.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.882+0000 7f8bae464640 1 -- 172.21.15.146:0/2306814324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba80b8f00 con 0x7f8ba81f8a00 2024-09-17T03:32:58.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.883+0000 7f8ba4ff9640 1 -- 172.21.15.146:0/2306814324 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ba00051c0 con 0x7f8ba81f8a00 2024-09-17T03:32:58.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.883+0000 7f8ba4ff9640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b94078b90 0x7f8b9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:58.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.884+0000 7f8ba4ff9640 1 -- 172.21.15.146:0/2306814324 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f8ba009b440 con 0x7f8ba81f8a00 2024-09-17T03:32:58.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.884+0000 7f8ba7fff640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b94078b90 0x7f8b9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:58.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.884+0000 7f8ba7fff640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b94078b90 0x7f8b9407b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b98033000 tx=0x7f8b98004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:58.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:58.888+0000 7f8ba4ff9640 1 -- 172.21.15.146:0/2306814324 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8ba81f9350 con 0x7f8ba81f8a00 2024-09-17T03:32:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.063+0000 7f8bae464640 1 -- 172.21.15.146:0/2306814324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8ba81e9130 con 0x7f8ba81f8a00 2024-09-17T03:32:59.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.735+0000 7f8ba4ff9640 1 -- 172.21.15.146:0/2306814324 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f8ba0016030 con 0x7f8ba81f8a00 2024-09-17T03:32:59.735 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:32:59.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 -- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b94078b90 msgr2=0x7f8b9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:59.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b94078b90 0x7f8b9407b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8b98033000 tx=0x7f8b98004730 comp rx=0 tx=0).stop 2024-09-17T03:32:59.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 -- 172.21.15.146:0/2306814324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba81f8a00 msgr2=0x7f8ba81f8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:59.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba81f8a00 0x7f8ba81f8e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000e990 tx=0x7f8ba000ee50 comp rx=0 tx=0).stop 2024-09-17T03:32:59.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 -- 172.21.15.146:0/2306814324 shutdown_connections 2024-09-17T03:32:59.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b94078b90 0x7f8b9407b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba81f8a00 0x7f8ba81f8e10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ba80cf270 0x7f8ba80abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 --2- 172.21.15.146:0/2306814324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba80b9c30 0x7f8ba80b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 -- 172.21.15.146:0/2306814324 >> 172.21.15.146:0/2306814324 conn(0x7f8ba80d1460 msgr2=0x7f8ba80b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 -- 172.21.15.146:0/2306814324 shutdown_connections 2024-09-17T03:32:59.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.738+0000 7f8bae464640 1 -- 172.21.15.146:0/2306814324 wait complete. 2024-09-17T03:32:59.759 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:32:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.878+0000 7f1b3e713640 1 -- 172.21.15.146:0/3099792431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b20004d90 msgr2=0x7f1b20005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.878+0000 7f1b3e713640 1 --2- 172.21.15.146:0/3099792431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b20004d90 0x7f1b20005240 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b30002100 tx=0x7f1b20005830 comp rx=0 tx=0).stop 2024-09-17T03:32:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.878+0000 7f1b3ccb0640 1 -- 172.21.15.146:0/3099792431 reap_dead start 2024-09-17T03:32:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.878+0000 7f1b3e713640 1 -- 172.21.15.146:0/3099792431 shutdown_connections 2024-09-17T03:32:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.878+0000 7f1b3e713640 1 -- 172.21.15.146:0/3099792431 >> 172.21.15.146:0/3099792431 conn(0x7f1b380b2060 msgr2=0x7f1b380b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:32:59.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.878+0000 7f1b3e713640 1 -- 172.21.15.146:0/3099792431 shutdown_connections 2024-09-17T03:32:59.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.878+0000 7f1b3e713640 1 -- 172.21.15.146:0/3099792431 wait complete. 2024-09-17T03:32:59.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.880+0000 7f1b3e713640 1 Processor -- start 2024-09-17T03:32:59.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.880+0000 7f1b3e713640 1 -- start start 2024-09-17T03:32:59.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b3e713640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b20004d90 0x7f1b380af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:59.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b3e713640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38148de0 0x7f1b380cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:59.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b3e713640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b381491f0 0x7f1b380d0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:59.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b3e713640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38072c10 con 0x7f1b38148de0 2024-09-17T03:32:59.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b3e713640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38072a90 con 0x7f1b381491f0 2024-09-17T03:32:59.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b3e713640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1b38072d90 con 0x7f1b20004d90 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b377fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38148de0 0x7f1b380cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b37fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b20004d90 0x7f1b380af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b377fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38148de0 0x7f1b380cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59426/0 (socket says 172.21.15.146:59426) 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b377fe640 1 -- 172.21.15.146:0/2736416118 learned_addr learned my addr 172.21.15.146:0/2736416118 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b3ccb0640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b381491f0 0x7f1b380d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b377fe640 1 -- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b20004d90 msgr2=0x7f1b380af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b377fe640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b20004d90 0x7f1b380af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b377fe640 1 -- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b381491f0 msgr2=0x7f1b380d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b377fe640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b381491f0 0x7f1b380d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.881+0000 7f1b377fe640 1 -- 172.21.15.146:0/2736416118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b38149bc0 con 0x7f1b38148de0 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.882+0000 7f1b377fe640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38148de0 0x7f1b380cfe50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c011ab0 tx=0x7f1b2c011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.882+0000 7f1b34ff9640 1 -- 172.21.15.146:0/2736416118 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c01e070 con 0x7f1b38148de0 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.882+0000 7f1b34ff9640 1 -- 172.21.15.146:0/2736416118 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b2c00fc70 con 0x7f1b38148de0 2024-09-17T03:32:59.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.882+0000 7f1b3e713640 1 -- 172.21.15.146:0/2736416118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b38149ea0 con 0x7f1b38148de0 2024-09-17T03:32:59.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.882+0000 7f1b34ff9640 1 -- 172.21.15.146:0/2736416118 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c004290 con 0x7f1b38148de0 2024-09-17T03:32:59.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.882+0000 7f1b3e713640 1 -- 172.21.15.146:0/2736416118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b3814c7b0 con 0x7f1b38148de0 2024-09-17T03:32:59.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.883+0000 7f1b3e713640 1 -- 172.21.15.146:0/2736416118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b3815eb60 con 0x7f1b38148de0 2024-09-17T03:32:59.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.884+0000 7f1b34ff9640 1 -- 172.21.15.146:0/2736416118 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b2c021070 con 0x7f1b38148de0 2024-09-17T03:32:59.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.884+0000 7f1b34ff9640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b24078b90 0x7f1b2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:32:59.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.884+0000 7f1b34ff9640 1 -- 172.21.15.146:0/2736416118 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f1b2c09b500 con 0x7f1b38148de0 2024-09-17T03:32:59.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.884+0000 7f1b37fff640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b24078b90 0x7f1b2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:32:59.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.885+0000 7f1b37fff640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b24078b90 0x7f1b2407b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b280010e0 tx=0x7f1b280017a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:32:59.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:32:59.889+0000 7f1b34ff9640 1 -- 172.21.15.146:0/2736416118 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b2c00fe60 con 0x7f1b38148de0 2024-09-17T03:33:00.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.099+0000 7f1b3e713640 1 -- 172.21.15.146:0/2736416118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1b380b4780 con 0x7f1b38148de0 2024-09-17T03:33:00.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.746+0000 7f1b34ff9640 1 -- 172.21.15.146:0/2736416118 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f1b2c063360 con 0x7f1b38148de0 2024-09-17T03:33:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T03:33:00.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.750+0000 7f1b3e713640 1 -- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b24078b90 msgr2=0x7f1b2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:00.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.750+0000 7f1b3e713640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b24078b90 0x7f1b2407b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b280010e0 tx=0x7f1b280017a0 comp rx=0 tx=0).stop 2024-09-17T03:33:00.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.750+0000 7f1b3e713640 1 -- 172.21.15.146:0/2736416118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38148de0 msgr2=0x7f1b380cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:00.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.750+0000 7f1b3e713640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38148de0 0x7f1b380cfe50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c011ab0 tx=0x7f1b2c011f70 comp rx=0 tx=0).stop 2024-09-17T03:33:00.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.751+0000 7f1b3e713640 1 -- 172.21.15.146:0/2736416118 shutdown_connections 2024-09-17T03:33:00.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.751+0000 7f1b3e713640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b24078b90 0x7f1b2407b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:00.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.751+0000 7f1b3e713640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b381491f0 0x7f1b380d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:00.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.751+0000 7f1b3e713640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b38148de0 0x7f1b380cfe50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:00.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.751+0000 7f1b3e713640 1 --2- 172.21.15.146:0/2736416118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b20004d90 0x7f1b380af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:00.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.751+0000 7f1b3e713640 1 -- 172.21.15.146:0/2736416118 >> 172.21.15.146:0/2736416118 conn(0x7f1b380b2060 msgr2=0x7f1b3806f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:00.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.751+0000 7f1b3e713640 1 -- 172.21.15.146:0/2736416118 shutdown_connections 2024-09-17T03:33:00.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.756+0000 7f1b3e713640 1 -- 172.21.15.146:0/2736416118 wait complete. 2024-09-17T03:33:00.782 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.896+0000 7f0175782640 1 -- 172.21.15.146:0/2205398137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0158003a50 msgr2=0x7f0158003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.896+0000 7f0175782640 1 --2- 172.21.15.146:0/2205398137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0158003a50 0x7f0158003ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f01600016c0 tx=0x7f0158005830 comp rx=0 tx=0).stop 2024-09-17T03:33:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.897+0000 7f0175782640 1 -- 172.21.15.146:0/2205398137 shutdown_connections 2024-09-17T03:33:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.897+0000 7f0175782640 1 --2- 172.21.15.146:0/2205398137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0158003a50 0x7f0158003ec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.897+0000 7f0175782640 1 -- 172.21.15.146:0/2205398137 >> 172.21.15.146:0/2205398137 conn(0x7f01700d4be0 msgr2=0x7f01700d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.897+0000 7f0175782640 1 -- 172.21.15.146:0/2205398137 shutdown_connections 2024-09-17T03:33:00.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.897+0000 7f0175782640 1 -- 172.21.15.146:0/2205398137 wait complete. 2024-09-17T03:33:00.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.898+0000 7f0175782640 1 Processor -- start 2024-09-17T03:33:00.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.899+0000 7f0175782640 1 -- start start 2024-09-17T03:33:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f0175782640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0158003a50 0x7f01701fa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f0175782640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0170153ac0 0x7f0170156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f0175782640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0170156dc0 0x7f01700b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f0175782640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f017006f0c0 con 0x7f0170153ac0 2024-09-17T03:33:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f0175782640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f017006ef40 con 0x7f0170156dc0 2024-09-17T03:33:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f0175782640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f01701620f0 con 0x7f0158003a50 2024-09-17T03:33:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f016e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0170153ac0 0x7f0170156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f016e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0170153ac0 0x7f0170156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59436/0 (socket says 172.21.15.146:59436) 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f016e7fc640 1 -- 172.21.15.146:0/1212367238 learned_addr learned my addr 172.21.15.146:0/1212367238 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f016f7fe640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0170156dc0 0x7f01700b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f016effd640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0158003a50 0x7f01701fa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f016e7fc640 1 -- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0158003a50 msgr2=0x7f01701fa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f016e7fc640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0158003a50 0x7f01701fa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f016e7fc640 1 -- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0170156dc0 msgr2=0x7f01700b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f016e7fc640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0170156dc0 0x7f01700b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f016e7fc640 1 -- 172.21.15.146:0/1212367238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01701618f0 con 0x7f0170153ac0 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f016e7fc640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0170153ac0 0x7f0170156880 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0164011ae0 tx=0x7f0164009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.900+0000 7f01577fe640 1 -- 172.21.15.146:0/1212367238 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016400fcb0 con 0x7f0170153ac0 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.901+0000 7f01577fe640 1 -- 172.21.15.146:0/1212367238 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f016400fe50 con 0x7f0170153ac0 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.901+0000 7f0175782640 1 -- 172.21.15.146:0/1212367238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01701571d0 con 0x7f0170153ac0 2024-09-17T03:33:00.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.901+0000 7f01577fe640 1 -- 172.21.15.146:0/1212367238 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164004280 con 0x7f0170153ac0 2024-09-17T03:33:00.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.901+0000 7f0175782640 1 -- 172.21.15.146:0/1212367238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01700b56a0 con 0x7f0170153ac0 2024-09-17T03:33:00.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.902+0000 7f0175782640 1 -- 172.21.15.146:0/1212367238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0170050fc0 con 0x7f0170153ac0 2024-09-17T03:33:00.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.903+0000 7f01577fe640 1 -- 172.21.15.146:0/1212367238 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01640035f0 con 0x7f0170153ac0 2024-09-17T03:33:00.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.903+0000 7f01577fe640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f015c078b90 0x7f015c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:00.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.903+0000 7f01577fe640 1 -- 172.21.15.146:0/1212367238 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f016409b6f0 con 0x7f0170153ac0 2024-09-17T03:33:00.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.903+0000 7f016effd640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f015c078b90 0x7f015c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:00.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.904+0000 7f016effd640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f015c078b90 0x7f015c07b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0160032000 tx=0x7f016002c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:00.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:00.908+0000 7f01577fe640 1 -- 172.21.15.146:0/1212367238 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0170050fc0 con 0x7f0170153ac0 2024-09-17T03:33:01.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.083+0000 7f0175782640 1 -- 172.21.15.146:0/1212367238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01700767e0 con 0x7f0170153ac0 2024-09-17T03:33:01.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.084+0000 7f01577fe640 1 -- 172.21.15.146:0/1212367238 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16726 (secure 0 0 0) 0x7f01701571d0 con 0x7f0170153ac0 2024-09-17T03:33:01.085 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:01.085 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:00.100905+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:32:57.968580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:32:59.068488+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:01.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 -- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f015c078b90 msgr2=0x7f015c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f015c078b90 0x7f015c07b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0160032000 tx=0x7f016002c040 comp rx=0 tx=0).stop 2024-09-17T03:33:01.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 -- 172.21.15.146:0/1212367238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0170153ac0 msgr2=0x7f0170156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0170153ac0 0x7f0170156880 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0164011ae0 tx=0x7f0164009f10 comp rx=0 tx=0).stop 2024-09-17T03:33:01.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 -- 172.21.15.146:0/1212367238 shutdown_connections 2024-09-17T03:33:01.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f015c078b90 0x7f015c07b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0170156dc0 0x7f01700b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0170153ac0 0x7f0170156880 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 --2- 172.21.15.146:0/1212367238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0158003a50 0x7f01701fa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 -- 172.21.15.146:0/1212367238 >> 172.21.15.146:0/1212367238 conn(0x7f01700d4be0 msgr2=0x7f01700b9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:01.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 -- 172.21.15.146:0/1212367238 shutdown_connections 2024-09-17T03:33:01.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.087+0000 7f0175782640 1 -- 172.21.15.146:0/1212367238 wait complete. 2024-09-17T03:33:01.099 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.211+0000 7fd95f68c640 1 -- 172.21.15.146:0/4221977703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9580cd840 msgr2=0x7fd9580b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.211+0000 7fd95f68c640 1 --2- 172.21.15.146:0/4221977703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9580cd840 0x7fd9580b5680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd9580b45d0 tx=0x7fd94802a530 comp rx=0 tx=0).stop 2024-09-17T03:33:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.211+0000 7fd95f68c640 1 -- 172.21.15.146:0/4221977703 shutdown_connections 2024-09-17T03:33:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.211+0000 7fd95f68c640 1 --2- 172.21.15.146:0/4221977703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9580cd840 0x7fd9580b5680 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.211+0000 7fd95f68c640 1 -- 172.21.15.146:0/4221977703 >> 172.21.15.146:0/4221977703 conn(0x7fd9580b3150 msgr2=0x7fd9580b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.211+0000 7fd95f68c640 1 -- 172.21.15.146:0/4221977703 shutdown_connections 2024-09-17T03:33:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.211+0000 7fd95f68c640 1 -- 172.21.15.146:0/4221977703 wait complete. 2024-09-17T03:33:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.213+0000 7fd95f68c640 1 Processor -- start 2024-09-17T03:33:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.213+0000 7fd95f68c640 1 -- start start 2024-09-17T03:33:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.214+0000 7fd95f68c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9580cd840 0x7fd9581f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.214+0000 7fd95f68c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9580cdc50 0x7fd9581f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.214+0000 7fd95f68c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd95815c8e0 0x7fd9581465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.214+0000 7fd95f68c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd958073700 con 0x7fd95815c8e0 2024-09-17T03:33:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.214+0000 7fd95f68c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd958073580 con 0x7fd9580cd840 2024-09-17T03:33:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.214+0000 7fd95f68c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd958073880 con 0x7fd9580cdc50 2024-09-17T03:33:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95dc29640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd95815c8e0 0x7fd9581465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95dc29640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd95815c8e0 0x7fd9581465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59460/0 (socket says 172.21.15.146:59460) 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95dc29640 1 -- 172.21.15.146:0/2810509222 learned_addr learned my addr 172.21.15.146:0/2810509222 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95cc27640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9580cdc50 0x7fd9581f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95d428640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9580cd840 0x7fd9581f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95dc29640 1 -- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9580cdc50 msgr2=0x7fd9581f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95dc29640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9580cdc50 0x7fd9581f9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95dc29640 1 -- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9580cd840 msgr2=0x7fd9581f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95dc29640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9580cd840 0x7fd9581f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95dc29640 1 -- 172.21.15.146:0/2810509222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9580af990 con 0x7fd95815c8e0 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95cc27640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9580cdc50 0x7fd9581f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95dc29640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd95815c8e0 0x7fd9581465f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd95000c760 tx=0x7fd95000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd94dffb640 1 -- 172.21.15.146:0/2810509222 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950003b70 con 0x7fd95815c8e0 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd94dffb640 1 -- 172.21.15.146:0/2810509222 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd950003d10 con 0x7fd95815c8e0 2024-09-17T03:33:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd95f68c640 1 -- 172.21.15.146:0/2810509222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9580afc70 con 0x7fd95815c8e0 2024-09-17T03:33:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.215+0000 7fd94dffb640 1 -- 172.21.15.146:0/2810509222 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950005330 con 0x7fd95815c8e0 2024-09-17T03:33:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.216+0000 7fd95f68c640 1 -- 172.21.15.146:0/2810509222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9580b0230 con 0x7fd95815c8e0 2024-09-17T03:33:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.216+0000 7fd95f68c640 1 -- 172.21.15.146:0/2810509222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd958073d30 con 0x7fd95815c8e0 2024-09-17T03:33:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.217+0000 7fd94dffb640 1 -- 172.21.15.146:0/2810509222 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9500054d0 con 0x7fd95815c8e0 2024-09-17T03:33:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.218+0000 7fd94dffb640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd93c078b90 0x7fd93c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.218+0000 7fd94dffb640 1 -- 172.21.15.146:0/2810509222 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd95009a950 con 0x7fd95815c8e0 2024-09-17T03:33:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.218+0000 7fd95d428640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd93c078b90 0x7fd93c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.218+0000 7fd95d428640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd93c078b90 0x7fd93c07b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd954006fd0 tx=0x7fd954009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.222+0000 7fd94dffb640 1 -- 172.21.15.146:0/2810509222 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd950062e20 con 0x7fd95815c8e0 2024-09-17T03:33:01.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.397+0000 7fd95f68c640 1 -- 172.21.15.146:0/2810509222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9580af6f0 con 0x7fd95815c8e0 2024-09-17T03:33:01.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.398+0000 7fd94dffb640 1 -- 172.21.15.146:0/2810509222 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16726 (secure 0 0 0) 0x7fd950062720 con 0x7fd95815c8e0 2024-09-17T03:33:01.398 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:01.398 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:00.100905+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:32:57.968580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:32:59.068488+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:01.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 -- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd93c078b90 msgr2=0x7fd93c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd93c078b90 0x7fd93c07b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd954006fd0 tx=0x7fd954009060 comp rx=0 tx=0).stop 2024-09-17T03:33:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 -- 172.21.15.146:0/2810509222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd95815c8e0 msgr2=0x7fd9581465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd95815c8e0 0x7fd9581465f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd95000c760 tx=0x7fd95000cb60 comp rx=0 tx=0).stop 2024-09-17T03:33:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 -- 172.21.15.146:0/2810509222 shutdown_connections 2024-09-17T03:33:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd93c078b90 0x7fd93c07b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd95815c8e0 0x7fd9581465f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9580cdc50 0x7fd9581f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 --2- 172.21.15.146:0/2810509222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9580cd840 0x7fd9581f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 -- 172.21.15.146:0/2810509222 >> 172.21.15.146:0/2810509222 conn(0x7fd9580b3150 msgr2=0x7fd9580b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 -- 172.21.15.146:0/2810509222 shutdown_connections 2024-09-17T03:33:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.400+0000 7fd95f68c640 1 -- 172.21.15.146:0/2810509222 wait complete. 2024-09-17T03:33:01.412 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:33:01.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.528+0000 7fb06c62e640 1 -- 172.21.15.146:0/1548774694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb06415f1a0 msgr2=0x7fb0640cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.528+0000 7fb06c62e640 1 --2- 172.21.15.146:0/1548774694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb06415f1a0 0x7fb0640cfca0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb060005fd0 tx=0x7fb06002a540 comp rx=0 tx=0).stop 2024-09-17T03:33:01.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.528+0000 7fb06c62e640 1 -- 172.21.15.146:0/1548774694 shutdown_connections 2024-09-17T03:33:01.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.528+0000 7fb06c62e640 1 --2- 172.21.15.146:0/1548774694 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0641631a0 0x7fb0640cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.528+0000 7fb06c62e640 1 --2- 172.21.15.146:0/1548774694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb06415f1a0 0x7fb0640cfca0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.528+0000 7fb06c62e640 1 -- 172.21.15.146:0/1548774694 >> 172.21.15.146:0/1548774694 conn(0x7fb0640d11f0 msgr2=0x7fb0640d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:01.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.528+0000 7fb06c62e640 1 -- 172.21.15.146:0/1548774694 shutdown_connections 2024-09-17T03:33:01.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.528+0000 7fb06c62e640 1 -- 172.21.15.146:0/1548774694 wait complete. 2024-09-17T03:33:01.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.530+0000 7fb06c62e640 1 Processor -- start 2024-09-17T03:33:01.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.530+0000 7fb06c62e640 1 -- start start 2024-09-17T03:33:01.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.531+0000 7fb06c62e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640b61f0 0x7fb06414baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.531+0000 7fb06c62e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06415f1a0 0x7fb064159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06c62e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0641631a0 0x7fb0640b8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06c62e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb0640695f0 con 0x7fb0641631a0 2024-09-17T03:33:01.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06c62e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb064069470 con 0x7fb0640b61f0 2024-09-17T03:33:01.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06c62e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb064069770 con 0x7fb06415f1a0 2024-09-17T03:33:01.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06abcb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0641631a0 0x7fb0640b8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06abcb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0641631a0 0x7fb0640b8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59486/0 (socket says 172.21.15.146:59486) 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06abcb640 1 -- 172.21.15.146:0/1210086639 learned_addr learned my addr 172.21.15.146:0/1210086639 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb069bc9640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06415f1a0 0x7fb064159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06a3ca640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640b61f0 0x7fb06414baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06abcb640 1 -- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06415f1a0 msgr2=0x7fb064159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06abcb640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06415f1a0 0x7fb064159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06abcb640 1 -- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640b61f0 msgr2=0x7fb06414baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06abcb640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640b61f0 0x7fb06414baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06abcb640 1 -- 172.21.15.146:0/1210086639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0640cb950 con 0x7fb0641631a0 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06abcb640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0641631a0 0x7fb0640b8ee0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00c730 tx=0x7fb05c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb05affd640 1 -- 172.21.15.146:0/1210086639 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c003b70 con 0x7fb0641631a0 2024-09-17T03:33:01.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb05affd640 1 -- 172.21.15.146:0/1210086639 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb05c003d10 con 0x7fb0641631a0 2024-09-17T03:33:01.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06c62e640 1 -- 172.21.15.146:0/1210086639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0640cbc30 con 0x7fb0641631a0 2024-09-17T03:33:01.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb05affd640 1 -- 172.21.15.146:0/1210086639 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00aab0 con 0x7fb0641631a0 2024-09-17T03:33:01.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.532+0000 7fb06c62e640 1 -- 172.21.15.146:0/1210086639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0640cc1f0 con 0x7fb0641631a0 2024-09-17T03:33:01.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.533+0000 7fb06c62e640 1 -- 172.21.15.146:0/1210086639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb064069c20 con 0x7fb0641631a0 2024-09-17T03:33:01.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.534+0000 7fb05affd640 1 -- 172.21.15.146:0/1210086639 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb05c00ac50 con 0x7fb0641631a0 2024-09-17T03:33:01.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.534+0000 7fb05affd640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb048078bc0 0x7fb04807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.535+0000 7fb05affd640 1 -- 172.21.15.146:0/1210086639 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb05c09a930 con 0x7fb0641631a0 2024-09-17T03:33:01.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.535+0000 7fb06a3ca640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb048078bc0 0x7fb04807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.535+0000 7fb06a3ca640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb048078bc0 0x7fb04807b0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb060033000 tx=0x7fb060004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:01.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.539+0000 7fb05affd640 1 -- 172.21.15.146:0/1210086639 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb05c0627b0 con 0x7fb0641631a0 2024-09-17T03:33:01.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.751+0000 7fb06c62e640 1 -- 172.21.15.146:0/1210086639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb0641590f0 con 0x7fb0641631a0 2024-09-17T03:33:01.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.763+0000 7fb05affd640 1 -- 172.21.15.146:0/1210086639 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7fb05c0671e0 con 0x7fb0641631a0 2024-09-17T03:33:01.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.766+0000 7fb06c62e640 1 -- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb048078bc0 msgr2=0x7fb04807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.766+0000 7fb06c62e640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb048078bc0 0x7fb04807b0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb060033000 tx=0x7fb060004730 comp rx=0 tx=0).stop 2024-09-17T03:33:01.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.766+0000 7fb06c62e640 1 -- 172.21.15.146:0/1210086639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0641631a0 msgr2=0x7fb0640b8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.766+0000 7fb06c62e640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0641631a0 0x7fb0640b8ee0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb05c00c730 tx=0x7fb05c00cbf0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.766+0000 7fb06c62e640 1 -- 172.21.15.146:0/1210086639 shutdown_connections 2024-09-17T03:33:01.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.766+0000 7fb06c62e640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb048078bc0 0x7fb04807b0d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.766+0000 7fb06c62e640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0641631a0 0x7fb0640b8ee0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.766+0000 7fb06c62e640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb06415f1a0 0x7fb064159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.766+0000 7fb06c62e640 1 --2- 172.21.15.146:0/1210086639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640b61f0 0x7fb06414baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.766+0000 7fb06c62e640 1 -- 172.21.15.146:0/1210086639 >> 172.21.15.146:0/1210086639 conn(0x7fb0640d11f0 msgr2=0x7fb064162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:01.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.767+0000 7fb06c62e640 1 -- 172.21.15.146:0/1210086639 shutdown_connections 2024-09-17T03:33:01.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.767+0000 7fb06c62e640 1 -- 172.21.15.146:0/1210086639 wait complete. 2024-09-17T03:33:01.777 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:33:01.778 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:33:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.896+0000 7f25dd24d640 1 -- 172.21.15.146:0/1998684311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25d806f440 msgr2=0x7f25d80d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.896+0000 7f25dd24d640 1 --2- 172.21.15.146:0/1998684311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25d806f440 0x7f25d80d3190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f25d80b73c0 tx=0x7f25d002aa30 comp rx=0 tx=0).stop 2024-09-17T03:33:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.896+0000 7f25dd24d640 1 -- 172.21.15.146:0/1998684311 shutdown_connections 2024-09-17T03:33:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.896+0000 7f25dd24d640 1 --2- 172.21.15.146:0/1998684311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25d806f440 0x7f25d80d3190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.896+0000 7f25dd24d640 1 --2- 172.21.15.146:0/1998684311 >> v2:172.21.15.179:3300/0 conn(0x7f25d80b3870 0x7f25d80cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.896+0000 7f25dd24d640 1 -- 172.21.15.146:0/1998684311 >> 172.21.15.146:0/1998684311 conn(0x7f25d80d4be0 msgr2=0x7f25d80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.896+0000 7f25dd24d640 1 -- 172.21.15.146:0/1998684311 shutdown_connections 2024-09-17T03:33:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.896+0000 7f25dd24d640 1 -- 172.21.15.146:0/1998684311 wait complete. 2024-09-17T03:33:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.898+0000 7f25dd24d640 1 Processor -- start 2024-09-17T03:33:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.898+0000 7f25dd24d640 1 -- start start 2024-09-17T03:33:01.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.899+0000 7f25dd24d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25d80b3870 0x7f25d80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.899+0000 7f25dd24d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25d81620f0 0x7f25d81f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.899+0000 7f25dd24d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d80c7ea0 0x7f25d8152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.899+0000 7f25dd24d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f25d80d3a60 con 0x7f25d80b3870 2024-09-17T03:33:01.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.899+0000 7f25dd24d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f25d80d38e0 con 0x7f25d81620f0 2024-09-17T03:33:01.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.899+0000 7f25dd24d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f25d80d3be0 con 0x7f25d80c7ea0 2024-09-17T03:33:01.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.899+0000 7f25d6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25d80b3870 0x7f25d80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25d6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25d80b3870 0x7f25d80cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59504/0 (socket says 172.21.15.146:59504) 2024-09-17T03:33:01.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25d6d9d640 1 -- 172.21.15.146:0/1100578995 learned_addr learned my addr 172.21.15.146:0/1100578995 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:01.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25ce59c640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25d81620f0 0x7f25d81f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25d759e640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d80c7ea0 0x7f25d8152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25d6d9d640 1 -- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d80c7ea0 msgr2=0x7f25d8152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25d6d9d640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d80c7ea0 0x7f25d8152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25d6d9d640 1 -- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25d81620f0 msgr2=0x7f25d81f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25d6d9d640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25d81620f0 0x7f25d81f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25d6d9d640 1 -- 172.21.15.146:0/1100578995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d8153240 con 0x7f25d80b3870 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25d6d9d640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25d80b3870 0x7f25d80cea70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f25c800d770 tx=0x7f25c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25cffff640 1 -- 172.21.15.146:0/1100578995 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8017070 con 0x7f25d80b3870 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25cffff640 1 -- 172.21.15.146:0/1100578995 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25c8009d20 con 0x7f25d80b3870 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25cffff640 1 -- 172.21.15.146:0/1100578995 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80106c0 con 0x7f25d80b3870 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25dd24d640 1 -- 172.21.15.146:0/1100578995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d80cc020 con 0x7f25d80b3870 2024-09-17T03:33:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.900+0000 7f25dd24d640 1 -- 172.21.15.146:0/1100578995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d80cc5c0 con 0x7f25d80b3870 2024-09-17T03:33:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.901+0000 7f25dd24d640 1 -- 172.21.15.146:0/1100578995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d80d3190 con 0x7f25d80b3870 2024-09-17T03:33:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.902+0000 7f25cffff640 1 -- 172.21.15.146:0/1100578995 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f25c801a070 con 0x7f25d80b3870 2024-09-17T03:33:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.902+0000 7f25cffff640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25b8078bc0 0x7f25b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.902+0000 7f25cffff640 1 -- 172.21.15.146:0/1100578995 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f25c809ad90 con 0x7f25d80b3870 2024-09-17T03:33:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.903+0000 7f25ce59c640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25b8078bc0 0x7f25b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.903+0000 7f25ce59c640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25b8078bc0 0x7f25b807b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f25d80c9e60 tx=0x7f25c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:01.907+0000 7f25cffff640 1 -- 172.21.15.146:0/1100578995 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f25d8153240 con 0x7f25d80b3870 2024-09-17T03:33:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.115+0000 7f25dd24d640 1 -- 172.21.15.146:0/1100578995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f25d8161420 con 0x7f25d80b3870 2024-09-17T03:33:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.771+0000 7f25cffff640 1 -- 172.21.15.146:0/1100578995 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f25c8062c10 con 0x7f25d80b3870 2024-09-17T03:33:02.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 -- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25b8078bc0 msgr2=0x7f25b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:02.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25b8078bc0 0x7f25b807b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f25d80c9e60 tx=0x7f25c0009040 comp rx=0 tx=0).stop 2024-09-17T03:33:02.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 -- 172.21.15.146:0/1100578995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25d80b3870 msgr2=0x7f25d80cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25d80b3870 0x7f25d80cea70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f25c800d770 tx=0x7f25c800dc30 comp rx=0 tx=0).stop 2024-09-17T03:33:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 -- 172.21.15.146:0/1100578995 shutdown_connections 2024-09-17T03:33:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25b8078bc0 0x7f25b807b0d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25d80c7ea0 0x7f25d8152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25d81620f0 0x7f25d81f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 --2- 172.21.15.146:0/1100578995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25d80b3870 0x7f25d80cea70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 -- 172.21.15.146:0/1100578995 >> 172.21.15.146:0/1100578995 conn(0x7f25d80d4be0 msgr2=0x7f25d815e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 -- 172.21.15.146:0/1100578995 shutdown_connections 2024-09-17T03:33:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.774+0000 7f25dd24d640 1 -- 172.21.15.146:0/1100578995 wait complete. 2024-09-17T03:33:02.787 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:33:02.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:33:02.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.904+0000 7f7aaa47f640 1 -- 172.21.15.146:0/2456099797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a8c004000 msgr2=0x7f7a8c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:02.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.904+0000 7f7aaa47f640 1 --2- 172.21.15.146:0/2456099797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a8c004000 0x7f7a8c004800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009b50 tx=0x7f7a8c005830 comp rx=0 tx=0).stop 2024-09-17T03:33:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.904+0000 7f7aa8a1c640 1 -- 172.21.15.146:0/2456099797 reap_dead start 2024-09-17T03:33:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.904+0000 7f7aaa47f640 1 -- 172.21.15.146:0/2456099797 shutdown_connections 2024-09-17T03:33:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.904+0000 7f7aaa47f640 1 -- 172.21.15.146:0/2456099797 >> 172.21.15.146:0/2456099797 conn(0x7f7aa40d11f0 msgr2=0x7f7aa40d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.904+0000 7f7aaa47f640 1 -- 172.21.15.146:0/2456099797 shutdown_connections 2024-09-17T03:33:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.904+0000 7f7aaa47f640 1 -- 172.21.15.146:0/2456099797 wait complete. 2024-09-17T03:33:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.906+0000 7f7aaa47f640 1 Processor -- start 2024-09-17T03:33:02.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.906+0000 7f7aaa47f640 1 -- start start 2024-09-17T03:33:02.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.907+0000 7f7aaa47f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a8c004000 0x7f7aa41f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.907+0000 7f7aaa47f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa40c9c50 0x7f7aa41f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.907+0000 7f7aaa47f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa40cdea0 0x7f7aa40ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.907+0000 7f7aaa47f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa4069220 con 0x7f7aa40cdea0 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.907+0000 7f7aaa47f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa40cf4b0 con 0x7f7a8c004000 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.907+0000 7f7aaa47f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa40693a0 con 0x7f7aa40c9c50 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa8a1c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa40cdea0 0x7f7aa40ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa8a1c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa40cdea0 0x7f7aa40ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59532/0 (socket says 172.21.15.146:59532) 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa8a1c640 1 -- 172.21.15.146:0/356704445 learned_addr learned my addr 172.21.15.146:0/356704445 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa37fe640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa40c9c50 0x7f7aa41f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa3fff640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a8c004000 0x7f7aa41f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa8a1c640 1 -- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa40c9c50 msgr2=0x7f7aa41f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa8a1c640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa40c9c50 0x7f7aa41f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:02.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa8a1c640 1 -- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a8c004000 msgr2=0x7f7aa41f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:02.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa8a1c640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a8c004000 0x7f7aa41f81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:02.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa8a1c640 1 -- 172.21.15.146:0/356704445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa40ca3a0 con 0x7f7aa40cdea0 2024-09-17T03:33:02.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa3fff640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a8c004000 0x7f7aa41f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:02.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa8a1c640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa40cdea0 0x7f7aa40ce2b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7aa406e0d0 tx=0x7f7a9c006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:02.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa0ff9640 1 -- 172.21.15.146:0/356704445 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c011900 con 0x7f7aa40cdea0 2024-09-17T03:33:02.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa0ff9640 1 -- 172.21.15.146:0/356704445 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a9c018070 con 0x7f7aa40cdea0 2024-09-17T03:33:02.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aaa47f640 1 -- 172.21.15.146:0/356704445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa40ca680 con 0x7f7aa40cdea0 2024-09-17T03:33:02.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aa0ff9640 1 -- 172.21.15.146:0/356704445 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c011d40 con 0x7f7aa40cdea0 2024-09-17T03:33:02.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.908+0000 7f7aaa47f640 1 -- 172.21.15.146:0/356704445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa40cac40 con 0x7f7aa40cdea0 2024-09-17T03:33:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.909+0000 7f7aaa47f640 1 -- 172.21.15.146:0/356704445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa4069900 con 0x7f7aa40cdea0 2024-09-17T03:33:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.910+0000 7f7aa0ff9640 1 -- 172.21.15.146:0/356704445 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a9c01d460 con 0x7f7aa40cdea0 2024-09-17T03:33:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.910+0000 7f7aa0ff9640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a90078b90 0x7f7a9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.911+0000 7f7aa0ff9640 1 -- 172.21.15.146:0/356704445 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7a9c09b5f0 con 0x7f7aa40cdea0 2024-09-17T03:33:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.911+0000 7f7aa3fff640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a90078b90 0x7f7a9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:02.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.911+0000 7f7aa3fff640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a90078b90 0x7f7a9007b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a94001050 tx=0x7f7a940067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:02.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:02.915+0000 7f7aa0ff9640 1 -- 172.21.15.146:0/356704445 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7a9c063a30 con 0x7f7aa40cdea0 2024-09-17T03:33:03.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.125+0000 7f7aaa47f640 1 -- 172.21.15.146:0/356704445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7aa40ca130 con 0x7f7aa40cdea0 2024-09-17T03:33:03.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.126+0000 7f7aa0ff9640 1 -- 172.21.15.146:0/356704445 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5223 (secure 0 0 0) 0x7f7a9c063330 con 0x7f7aa40cdea0 2024-09-17T03:33:03.126 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:03.126 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":6,"btime":"2024-09-17T03:33:02:765358+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/771934087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":771934087},{"type":"v1","addr":"172.21.15.179:6837","nonce":771934087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/580111663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":580111663},{"type":"v1","addr":"172.21.15.146:6834","nonce":580111663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3998700466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3998700466},{"type":"v1","addr":"172.21.15.146:6835","nonce":3998700466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:33:00.100864+0000","modified":"2024-09-17T03:33:02.117833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3419525644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3419525644},{"type":"v1","addr":"172.21.15.179:6835","nonce":3419525644}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4396,"qdb_cluster":[4396]},"id":1}]} 2024-09-17T03:33:03.126 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 6 2024-09-17T03:33:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 -- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a90078b90 msgr2=0x7f7a9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a90078b90 0x7f7a9007b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a94001050 tx=0x7f7a940067a0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 -- 172.21.15.146:0/356704445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa40cdea0 msgr2=0x7f7aa40ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa40cdea0 0x7f7aa40ce2b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7aa406e0d0 tx=0x7f7a9c006430 comp rx=0 tx=0).stop 2024-09-17T03:33:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 -- 172.21.15.146:0/356704445 shutdown_connections 2024-09-17T03:33:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a90078b90 0x7f7a9007b0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aa40cdea0 0x7f7aa40ce2b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7aa40c9c50 0x7f7aa41f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 --2- 172.21.15.146:0/356704445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a8c004000 0x7f7aa41f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 -- 172.21.15.146:0/356704445 >> 172.21.15.146:0/356704445 conn(0x7f7aa40d11f0 msgr2=0x7f7aa40b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:03.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 -- 172.21.15.146:0/356704445 shutdown_connections 2024-09-17T03:33:03.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.128+0000 7f7aaa47f640 1 -- 172.21.15.146:0/356704445 wait complete. 2024-09-17T03:33:03.139 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:03.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.252+0000 7f1bbab8b640 1 -- 172.21.15.146:0/224174368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b9c004800 msgr2=0x7f1b9c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.252+0000 7f1bbab8b640 1 --2- 172.21.15.146:0/224174368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b9c004800 0x7f1b9c004c10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40016c0 tx=0x7f1b9c005830 comp rx=0 tx=0).stop 2024-09-17T03:33:03.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.252+0000 7f1bbab8b640 1 -- 172.21.15.146:0/224174368 shutdown_connections 2024-09-17T03:33:03.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.252+0000 7f1bbab8b640 1 --2- 172.21.15.146:0/224174368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b9c004800 0x7f1b9c004c10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.252+0000 7f1bbab8b640 1 -- 172.21.15.146:0/224174368 >> 172.21.15.146:0/224174368 conn(0x7f1bb40d11f0 msgr2=0x7f1bb40d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:03.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.252+0000 7f1bbab8b640 1 -- 172.21.15.146:0/224174368 shutdown_connections 2024-09-17T03:33:03.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.253+0000 7f1bbab8b640 1 -- 172.21.15.146:0/224174368 wait complete. 2024-09-17T03:33:03.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.254+0000 7f1bbab8b640 1 Processor -- start 2024-09-17T03:33:03.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.254+0000 7f1bbab8b640 1 -- start start 2024-09-17T03:33:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bbab8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b9c004800 0x7f1bb40cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bbab8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb40cb7b0 0x7f1bb40cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bbab8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb4158e50 0x7f1bb41615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bbab8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41631a0 con 0x7f1b9c004800 2024-09-17T03:33:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bbab8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb40b68c0 con 0x7f1bb40cb7b0 2024-09-17T03:33:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bbab8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb4163320 con 0x7f1bb4158e50 2024-09-17T03:33:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bb8927640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b9c004800 0x7f1bb40cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bb8927640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b9c004800 0x7f1bb40cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59554/0 (socket says 172.21.15.146:59554) 2024-09-17T03:33:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bb8927640 1 -- 172.21.15.146:0/1680365873 learned_addr learned my addr 172.21.15.146:0/1680365873 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1babfff640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb40cb7b0 0x7f1bb40cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bb9128640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb4158e50 0x7f1bb41615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bb8927640 1 -- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb4158e50 msgr2=0x7f1bb41615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bb8927640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb4158e50 0x7f1bb41615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bb8927640 1 -- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb40cb7b0 msgr2=0x7f1bb40cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bb8927640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb40cb7b0 0x7f1bb40cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bb8927640 1 -- 172.21.15.146:0/1680365873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb41f9170 con 0x7f1b9c004800 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bb9128640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb4158e50 0x7f1bb41615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bb8927640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b9c004800 0x7f1bb40cd060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1bb00018f0 tx=0x7f1bb00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1ba97fa640 1 -- 172.21.15.146:0/1680365873 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0015070 con 0x7f1b9c004800 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1ba97fa640 1 -- 172.21.15.146:0/1680365873 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bb0011900 con 0x7f1b9c004800 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bbab8b640 1 -- 172.21.15.146:0/1680365873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb41f9450 con 0x7f1b9c004800 2024-09-17T03:33:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1ba97fa640 1 -- 172.21.15.146:0/1680365873 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0011d50 con 0x7f1b9c004800 2024-09-17T03:33:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.256+0000 7f1bbab8b640 1 -- 172.21.15.146:0/1680365873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb41f9a10 con 0x7f1b9c004800 2024-09-17T03:33:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.257+0000 7f1bbab8b640 1 -- 172.21.15.146:0/1680365873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb40cbc20 con 0x7f1b9c004800 2024-09-17T03:33:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.258+0000 7f1ba97fa640 1 -- 172.21.15.146:0/1680365873 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1bb0018070 con 0x7f1b9c004800 2024-09-17T03:33:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.258+0000 7f1ba97fa640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba0078b90 0x7f1ba007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.259+0000 7f1ba97fa640 1 -- 172.21.15.146:0/1680365873 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1bb009b8d0 con 0x7f1b9c004800 2024-09-17T03:33:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.259+0000 7f1babfff640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba0078b90 0x7f1ba007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.259+0000 7f1babfff640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba0078b90 0x7f1ba007b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4032000 tx=0x7f1ba402c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:03.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.263+0000 7f1ba97fa640 1 -- 172.21.15.146:0/1680365873 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1bb40b6b40 con 0x7f1b9c004800 2024-09-17T03:33:03.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.436+0000 7f1bbab8b640 1 -- 172.21.15.146:0/1680365873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bb40cef40 con 0x7f1b9c004800 2024-09-17T03:33:03.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.437+0000 7f1ba97fa640 1 -- 172.21.15.146:0/1680365873 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7f1bb0063750 con 0x7f1b9c004800 2024-09-17T03:33:03.437 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:03.437 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:01.757648+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:32:57.968580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:32:59.068488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 -- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba0078b90 msgr2=0x7f1ba007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba0078b90 0x7f1ba007b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4032000 tx=0x7f1ba402c040 comp rx=0 tx=0).stop 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 -- 172.21.15.146:0/1680365873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b9c004800 msgr2=0x7f1bb40cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b9c004800 0x7f1bb40cd060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1bb00018f0 tx=0x7f1bb00039c0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 -- 172.21.15.146:0/1680365873 shutdown_connections 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba0078b90 0x7f1ba007b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb4158e50 0x7f1bb41615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb40cb7b0 0x7f1bb40cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 --2- 172.21.15.146:0/1680365873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b9c004800 0x7f1bb40cd060 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 -- 172.21.15.146:0/1680365873 >> 172.21.15.146:0/1680365873 conn(0x7f1bb40d11f0 msgr2=0x7f1bb40b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 -- 172.21.15.146:0/1680365873 shutdown_connections 2024-09-17T03:33:03.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.439+0000 7f1bbab8b640 1 -- 172.21.15.146:0/1680365873 wait complete. 2024-09-17T03:33:03.451 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:33:03.451 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.563+0000 7f3373a63640 1 -- 172.21.15.146:0/2813792221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f336c0cfca0 msgr2=0x7f336c0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.563+0000 7f3373a63640 1 --2- 172.21.15.146:0/2813792221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f336c0cfca0 0x7f336c0cef40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f335c009860 tx=0x7f335c02a510 comp rx=0 tx=0).stop 2024-09-17T03:33:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.564+0000 7f3373a63640 1 -- 172.21.15.146:0/2813792221 shutdown_connections 2024-09-17T03:33:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.564+0000 7f3373a63640 1 --2- 172.21.15.146:0/2813792221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f336c0cfca0 0x7f336c0cef40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.564+0000 7f3373a63640 1 -- 172.21.15.146:0/2813792221 >> 172.21.15.146:0/2813792221 conn(0x7f336c0d11f0 msgr2=0x7f336c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:03.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.564+0000 7f3373a63640 1 -- 172.21.15.146:0/2813792221 shutdown_connections 2024-09-17T03:33:03.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.564+0000 7f3373a63640 1 -- 172.21.15.146:0/2813792221 wait complete. 2024-09-17T03:33:03.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.565+0000 7f3373a63640 1 Processor -- start 2024-09-17T03:33:03.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.566+0000 7f3373a63640 1 -- start start 2024-09-17T03:33:03.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f3373a63640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0b61f0 0x7f336c150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f3373a63640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f336c0cfca0 0x7f336c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f3373a63640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f336c15f1a0 0x7f336c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f3373a63640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f336c0696c0 con 0x7f336c0b61f0 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f3373a63640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f336c069540 con 0x7f336c0cfca0 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f3373a63640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f336c069840 con 0x7f336c15f1a0 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f33717ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0b61f0 0x7f336c150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f33717ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0b61f0 0x7f336c150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59570/0 (socket says 172.21.15.146:59570) 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f33717ff640 1 -- 172.21.15.146:0/3016147886 learned_addr learned my addr 172.21.15.146:0/3016147886 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f3370ffe640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f336c0cfca0 0x7f336c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f3372000640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f336c15f1a0 0x7f336c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f33717ff640 1 -- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f336c15f1a0 msgr2=0x7f336c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f33717ff640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f336c15f1a0 0x7f336c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f33717ff640 1 -- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f336c0cfca0 msgr2=0x7f336c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f33717ff640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f336c0cfca0 0x7f336c15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f33717ff640 1 -- 172.21.15.146:0/3016147886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c15c550 con 0x7f336c0b61f0 2024-09-17T03:33:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f3372000640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f336c15f1a0 0x7f336c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:33:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.567+0000 7f33717ff640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0b61f0 0x7f336c150210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f336800c410 tx=0x7f336800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.568+0000 7f3361ffb640 1 -- 172.21.15.146:0/3016147886 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368011790 con 0x7f336c0b61f0 2024-09-17T03:33:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.568+0000 7f3361ffb640 1 -- 172.21.15.146:0/3016147886 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3368017070 con 0x7f336c0b61f0 2024-09-17T03:33:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.568+0000 7f3373a63640 1 -- 172.21.15.146:0/3016147886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336c14d700 con 0x7f336c0b61f0 2024-09-17T03:33:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.568+0000 7f3361ffb640 1 -- 172.21.15.146:0/3016147886 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368011d00 con 0x7f336c0b61f0 2024-09-17T03:33:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.568+0000 7f3373a63640 1 -- 172.21.15.146:0/3016147886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f336c0c9b60 con 0x7f336c0b61f0 2024-09-17T03:33:03.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.569+0000 7f3373a63640 1 -- 172.21.15.146:0/3016147886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336c0c9610 con 0x7f336c0b61f0 2024-09-17T03:33:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.569+0000 7f3361ffb640 1 -- 172.21.15.146:0/3016147886 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f336801c460 con 0x7f336c0b61f0 2024-09-17T03:33:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.570+0000 7f3361ffb640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3350078b90 0x7f335007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.570+0000 7f3361ffb640 1 -- 172.21.15.146:0/3016147886 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f336809ac00 con 0x7f336c0b61f0 2024-09-17T03:33:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.570+0000 7f3370ffe640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3350078b90 0x7f335007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.571+0000 7f3370ffe640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3350078b90 0x7f335007b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f335c034000 tx=0x7f335c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:03.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.574+0000 7f3361ffb640 1 -- 172.21.15.146:0/3016147886 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f33680a1080 con 0x7f336c0b61f0 2024-09-17T03:33:03.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.747+0000 7f3373a63640 1 -- 172.21.15.146:0/3016147886 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f336c0cef40 con 0x7f3350078b90 2024-09-17T03:33:03.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.752+0000 7f3361ffb640 1 -- 172.21.15.146:0/3016147886 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239312 (secure 0 0 0) 0x7f336c0cef40 con 0x7f3350078b90 2024-09-17T03:33:03.755 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:03.756 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:03.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 -- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3350078b90 msgr2=0x7f335007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3350078b90 0x7f335007b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f335c034000 tx=0x7f335c004730 comp rx=0 tx=0).stop 2024-09-17T03:33:03.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 -- 172.21.15.146:0/3016147886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0b61f0 msgr2=0x7f336c150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0b61f0 0x7f336c150210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f336800c410 tx=0x7f336800c8d0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 -- 172.21.15.146:0/3016147886 shutdown_connections 2024-09-17T03:33:03.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3350078b90 0x7f335007b0a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f336c15f1a0 0x7f336c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f336c0cfca0 0x7f336c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 --2- 172.21.15.146:0/3016147886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f336c0b61f0 0x7f336c150210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 -- 172.21.15.146:0/3016147886 >> 172.21.15.146:0/3016147886 conn(0x7f336c0d11f0 msgr2=0x7f336c0b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:03.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 -- 172.21.15.146:0/3016147886 shutdown_connections 2024-09-17T03:33:03.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.755+0000 7f3373a63640 1 -- 172.21.15.146:0/3016147886 wait complete. 2024-09-17T03:33:03.767 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-17T03:33:01.789205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":218696,"kb_used_data":2468,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756024,"statfs":{"total":773094113280,"available":772870168576,"internally_reserved":0,"allocated":2527232,"data_stored":1590461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000793"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:58.728820+0000","last_change":"2024-09-17T03:32:58.728820+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.728820+0000","last_undegraded":"2024-09-17T03:32:58.728820+0000","last_fullsized":"2024-09-17T03:32:58.728820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737442+0000","last_change":"2024-09-17T03:32:58.737442+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737442+0000","last_undegraded":"2024-09-17T03:32:58.737442+0000","last_fullsized":"2024-09-17T03:32:58.737442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:58.728820+0000","last_change":"2024-09-17T03:32:58.728820+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.728820+0000","last_undegraded":"2024-09-17T03:32:58.728820+0000","last_fullsized":"2024-09-17T03:32:58.728820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:58.728820+0000","last_change":"2024-09-17T03:32:58.728820+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.728820+0000","last_undegraded":"2024-09-17T03:32:58.728820+0000","last_fullsized":"2024-09-17T03:32:58.728820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738149+0000","last_change":"2024-09-17T03:32:58.738149+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738149+0000","last_undegraded":"2024-09-17T03:32:58.738149+0000","last_fullsized":"2024-09-17T03:32:58.738149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:58.728820+0000","last_change":"2024-09-17T03:32:58.728820+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.728820+0000","last_undegraded":"2024-09-17T03:32:58.728820+0000","last_fullsized":"2024-09-17T03:32:58.728820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742971+0000","last_change":"2024-09-17T03:32:58.742971+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742971+0000","last_undegraded":"2024-09-17T03:32:58.742971+0000","last_fullsized":"2024-09-17T03:32:58.742971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737436+0000","last_change":"2024-09-17T03:32:58.737436+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737436+0000","last_undegraded":"2024-09-17T03:32:58.737436+0000","last_fullsized":"2024-09-17T03:32:58.737436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.739792+0000","last_change":"2024-09-17T03:32:58.739792+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.739792+0000","last_undegraded":"2024-09-17T03:32:58.739792+0000","last_fullsized":"2024-09-17T03:32:58.739792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:58.728820+0000","last_change":"2024-09-17T03:32:58.728820+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.728820+0000","last_undegraded":"2024-09-17T03:32:58.728820+0000","last_fullsized":"2024-09-17T03:32:58.728820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737437+0000","last_change":"2024-09-17T03:32:58.737437+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737437+0000","last_undegraded":"2024-09-17T03:32:58.737437+0000","last_fullsized":"2024-09-17T03:32:58.737437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738740+0000","last_change":"2024-09-17T03:32:58.738740+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738740+0000","last_undegraded":"2024-09-17T03:32:58.738740+0000","last_fullsized":"2024-09-17T03:32:58.738740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.736807+0000","last_change":"2024-09-17T03:32:58.736807+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.736807+0000","last_undegraded":"2024-09-17T03:32:58.736807+0000","last_fullsized":"2024-09-17T03:32:58.736807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738880+0000","last_change":"2024-09-17T03:32:58.738880+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738880+0000","last_undegraded":"2024-09-17T03:32:58.738880+0000","last_fullsized":"2024-09-17T03:32:58.738880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741944+0000","last_change":"2024-09-17T03:32:58.741944+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741944+0000","last_undegraded":"2024-09-17T03:32:58.741944+0000","last_fullsized":"2024-09-17T03:32:58.741944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.739034+0000","last_change":"2024-09-17T03:32:58.739034+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.739034+0000","last_undegraded":"2024-09-17T03:32:58.739034+0000","last_fullsized":"2024-09-17T03:32:58.739034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T03:32:58.741533+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:32:58.741533+0000","last_peered":"2024-09-17T03:32:58.741533+0000","last_clean":"2024-09-17T03:32:58.741533+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:32:58.741533+0000","last_undegraded":"2024-09-17T03:32:58.741533+0000","last_fullsized":"2024-09-17T03:32:58.741533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:58.728820+0000","last_change":"2024-09-17T03:32:58.728820+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.728820+0000","last_undegraded":"2024-09-17T03:32:58.728820+0000","last_fullsized":"2024-09-17T03:32:58.728820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740270+0000","last_change":"2024-09-17T03:32:58.740270+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740270+0000","last_undegraded":"2024-09-17T03:32:58.740270+0000","last_fullsized":"2024-09-17T03:32:58.740270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738725+0000","last_change":"2024-09-17T03:32:58.738725+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738725+0000","last_undegraded":"2024-09-17T03:32:58.738725+0000","last_fullsized":"2024-09-17T03:32:58.738725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:58.728820+0000","last_change":"2024-09-17T03:32:58.728820+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.728820+0000","last_undegraded":"2024-09-17T03:32:58.728820+0000","last_fullsized":"2024-09-17T03:32:58.728820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.743085+0000","last_change":"2024-09-17T03:32:58.743085+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.743085+0000","last_undegraded":"2024-09-17T03:32:58.743085+0000","last_fullsized":"2024-09-17T03:32:58.743085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740409+0000","last_change":"2024-09-17T03:32:58.740409+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740409+0000","last_undegraded":"2024-09-17T03:32:58.740409+0000","last_fullsized":"2024-09-17T03:32:58.740409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742325+0000","last_change":"2024-09-17T03:32:58.742325+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742325+0000","last_undegraded":"2024-09-17T03:32:58.742325+0000","last_fullsized":"2024-09-17T03:32:58.742325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737604+0000","last_change":"2024-09-17T03:32:58.737604+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737604+0000","last_undegraded":"2024-09-17T03:32:58.737604+0000","last_fullsized":"2024-09-17T03:32:58.737604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740869+0000","last_change":"2024-09-17T03:32:58.740869+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740869+0000","last_undegraded":"2024-09-17T03:32:58.740869+0000","last_fullsized":"2024-09-17T03:32:58.740869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741868+0000","last_change":"2024-09-17T03:32:58.741868+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741868+0000","last_undegraded":"2024-09-17T03:32:58.741868+0000","last_fullsized":"2024-09-17T03:32:58.741868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742366+0000","last_change":"2024-09-17T03:32:58.742366+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742366+0000","last_undegraded":"2024-09-17T03:32:58.742366+0000","last_fullsized":"2024-09-17T03:32:58.742366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740380+0000","last_change":"2024-09-17T03:32:58.740380+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740380+0000","last_undegraded":"2024-09-17T03:32:58.740380+0000","last_fullsized":"2024-09-17T03:32:58.740380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740308+0000","last_change":"2024-09-17T03:32:58.740308+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740308+0000","last_undegraded":"2024-09-17T03:32:58.740308+0000","last_fullsized":"2024-09-17T03:32:58.740308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741019+0000","last_change":"2024-09-17T03:32:58.741019+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741019+0000","last_undegraded":"2024-09-17T03:32:58.741019+0000","last_fullsized":"2024-09-17T03:32:58.741019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:58.728820+0000","last_change":"2024-09-17T03:32:58.728820+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.728820+0000","last_undegraded":"2024-09-17T03:32:58.728820+0000","last_fullsized":"2024-09-17T03:32:58.728820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740499+0000","last_change":"2024-09-17T03:32:58.740499+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740499+0000","last_undegraded":"2024-09-17T03:32:58.740499+0000","last_fullsized":"2024-09-17T03:32:58.740499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":47580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":47580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":47580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:03.771 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:03.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.919+0000 7f4a33e0e640 1 -- 172.21.15.146:0/508483915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c0cfca0 msgr2=0x7f4a2c0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.919+0000 7f4a33e0e640 1 --2- 172.21.15.146:0/508483915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c0cfca0 0x7f4a2c0cef40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c068f10 tx=0x7f4a1c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.919+0000 7f4a33e0e640 1 -- 172.21.15.146:0/508483915 shutdown_connections 2024-09-17T03:33:03.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.919+0000 7f4a33e0e640 1 --2- 172.21.15.146:0/508483915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c0cfca0 0x7f4a2c0cef40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.919+0000 7f4a33e0e640 1 -- 172.21.15.146:0/508483915 >> 172.21.15.146:0/508483915 conn(0x7f4a2c0d11f0 msgr2=0x7f4a2c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:03.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.920+0000 7f4a33e0e640 1 -- 172.21.15.146:0/508483915 shutdown_connections 2024-09-17T03:33:03.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.920+0000 7f4a33e0e640 1 -- 172.21.15.146:0/508483915 wait complete. 2024-09-17T03:33:03.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.921+0000 7f4a33e0e640 1 Processor -- start 2024-09-17T03:33:03.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.921+0000 7f4a33e0e640 1 -- start start 2024-09-17T03:33:03.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a33e0e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a2c0b61f0 0x7f4a2c14cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a33e0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a2c0cfca0 0x7f4a2c0ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a33e0e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c15f1a0 0x7f4a2c1f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a33e0e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c069660 con 0x7f4a2c15f1a0 2024-09-17T03:33:03.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a33e0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c0694e0 con 0x7f4a2c0cfca0 2024-09-17T03:33:03.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a33e0e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2c0697e0 con 0x7f4a2c0b61f0 2024-09-17T03:33:03.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a323ab640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c15f1a0 0x7f4a2c1f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a323ab640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c15f1a0 0x7f4a2c1f8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59592/0 (socket says 172.21.15.146:59592) 2024-09-17T03:33:03.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a323ab640 1 -- 172.21.15.146:0/4012602560 learned_addr learned my addr 172.21.15.146:0/4012602560 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:03.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a313a9640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a2c0cfca0 0x7f4a2c0ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a31baa640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a2c0b61f0 0x7f4a2c14cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a323ab640 1 -- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a2c0b61f0 msgr2=0x7f4a2c14cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a323ab640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a2c0b61f0 0x7f4a2c14cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a323ab640 1 -- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a2c0cfca0 msgr2=0x7f4a2c0ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:03.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a323ab640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a2c0cfca0 0x7f4a2c0ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a323ab640 1 -- 172.21.15.146:0/4012602560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c14d0d0 con 0x7f4a2c15f1a0 2024-09-17T03:33:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a31baa640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a2c0b61f0 0x7f4a2c14cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:33:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a323ab640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c15f1a0 0x7f4a2c1f8e40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c700 tx=0x7f4a2400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a227fc640 1 -- 172.21.15.146:0/4012602560 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24003b70 con 0x7f4a2c15f1a0 2024-09-17T03:33:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a227fc640 1 -- 172.21.15.146:0/4012602560 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a24003d10 con 0x7f4a2c15f1a0 2024-09-17T03:33:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a227fc640 1 -- 172.21.15.146:0/4012602560 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400aab0 con 0x7f4a2c15f1a0 2024-09-17T03:33:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a33e0e640 1 -- 172.21.15.146:0/4012602560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2c0cc8a0 con 0x7f4a2c15f1a0 2024-09-17T03:33:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.923+0000 7f4a33e0e640 1 -- 172.21.15.146:0/4012602560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2c0ccb40 con 0x7f4a2c15f1a0 2024-09-17T03:33:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.924+0000 7f4a33e0e640 1 -- 172.21.15.146:0/4012602560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2c069c30 con 0x7f4a2c15f1a0 2024-09-17T03:33:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.925+0000 7f4a227fc640 1 -- 172.21.15.146:0/4012602560 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a2400ac50 con 0x7f4a2c15f1a0 2024-09-17T03:33:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.925+0000 7f4a227fc640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a10078bc0 0x7f4a1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.926+0000 7f4a227fc640 1 -- 172.21.15.146:0/4012602560 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4a2409ac10 con 0x7f4a2c15f1a0 2024-09-17T03:33:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.926+0000 7f4a31baa640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a10078bc0 0x7f4a1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.926+0000 7f4a31baa640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a10078bc0 0x7f4a1007b0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a28000f60 tx=0x7f4a28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:03.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:03.930+0000 7f4a227fc640 1 -- 172.21.15.146:0/4012602560 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a2c14d0d0 con 0x7f4a2c15f1a0 2024-09-17T03:33:04.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.099+0000 7f4a33e0e640 1 -- 172.21.15.146:0/4012602560 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a2c075ea0 con 0x7f4a10078bc0 2024-09-17T03:33:04.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.104+0000 7f4a227fc640 1 -- 172.21.15.146:0/4012602560 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243834 (secure 0 0 0) 0x7f4a2c075ea0 con 0x7f4a10078bc0 2024-09-17T03:33:04.106 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:04.107 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:04.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.107+0000 7f4a33e0e640 1 -- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a10078bc0 msgr2=0x7f4a1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.107+0000 7f4a33e0e640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a10078bc0 0x7f4a1007b0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a28000f60 tx=0x7f4a28009040 comp rx=0 tx=0).stop 2024-09-17T03:33:04.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.107+0000 7f4a33e0e640 1 -- 172.21.15.146:0/4012602560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c15f1a0 msgr2=0x7f4a2c1f8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.107+0000 7f4a33e0e640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c15f1a0 0x7f4a2c1f8e40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c700 tx=0x7f4a2400cbc0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.107+0000 7f4a33e0e640 1 -- 172.21.15.146:0/4012602560 shutdown_connections 2024-09-17T03:33:04.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.107+0000 7f4a33e0e640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a10078bc0 0x7f4a1007b0d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.107+0000 7f4a33e0e640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a2c15f1a0 0x7f4a2c1f8e40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.107+0000 7f4a33e0e640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a2c0cfca0 0x7f4a2c0ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.107+0000 7f4a33e0e640 1 --2- 172.21.15.146:0/4012602560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a2c0b61f0 0x7f4a2c14cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.107+0000 7f4a33e0e640 1 -- 172.21.15.146:0/4012602560 >> 172.21.15.146:0/4012602560 conn(0x7f4a2c0d11f0 msgr2=0x7f4a2c0b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:04.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.107+0000 7f4a33e0e640 1 -- 172.21.15.146:0/4012602560 shutdown_connections 2024-09-17T03:33:04.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.108+0000 7f4a33e0e640 1 -- 172.21.15.146:0/4012602560 wait complete. 2024-09-17T03:33:04.119 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T03:33:03.789703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218800,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755920,"statfs":{"total":773094113280,"available":772870062080,"internally_reserved":0,"allocated":2629632,"data_stored":1636197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.054810"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771728+0000","last_change":"2024-09-17T03:33:00.778126+0000","last_active":"2024-09-17T03:33:01.771728+0000","last_peered":"2024-09-17T03:33:01.771728+0000","last_clean":"2024-09-17T03:33:01.771728+0000","last_became_active":"2024-09-17T03:33:00.777760+0000","last_became_peered":"2024-09-17T03:33:00.777760+0000","last_unstale":"2024-09-17T03:33:01.771728+0000","last_undegraded":"2024-09-17T03:33:01.771728+0000","last_fullsized":"2024-09-17T03:33:01.771728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:48.841807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771542+0000","last_change":"2024-09-17T03:33:00.772869+0000","last_active":"2024-09-17T03:33:01.771542+0000","last_peered":"2024-09-17T03:33:01.771542+0000","last_clean":"2024-09-17T03:33:01.771542+0000","last_became_active":"2024-09-17T03:33:00.772517+0000","last_became_peered":"2024-09-17T03:33:00.772517+0000","last_unstale":"2024-09-17T03:33:01.771542+0000","last_undegraded":"2024-09-17T03:33:01.771542+0000","last_fullsized":"2024-09-17T03:33:01.771542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:19.582453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829349+0000","last_change":"2024-09-17T03:33:00.780226+0000","last_active":"2024-09-17T03:33:01.829349+0000","last_peered":"2024-09-17T03:33:01.829349+0000","last_clean":"2024-09-17T03:33:01.829349+0000","last_became_active":"2024-09-17T03:33:00.779937+0000","last_became_peered":"2024-09-17T03:33:00.779937+0000","last_unstale":"2024-09-17T03:33:01.829349+0000","last_undegraded":"2024-09-17T03:33:01.829349+0000","last_fullsized":"2024-09-17T03:33:01.829349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:23.843836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828003+0000","last_change":"2024-09-17T03:33:00.774115+0000","last_active":"2024-09-17T03:33:01.828003+0000","last_peered":"2024-09-17T03:33:01.828003+0000","last_clean":"2024-09-17T03:33:01.828003+0000","last_became_active":"2024-09-17T03:33:00.773803+0000","last_became_peered":"2024-09-17T03:33:00.773803+0000","last_unstale":"2024-09-17T03:33:01.828003+0000","last_undegraded":"2024-09-17T03:33:01.828003+0000","last_fullsized":"2024-09-17T03:33:01.828003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:13.109575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770738+0000","last_change":"2024-09-17T03:33:00.771303+0000","last_active":"2024-09-17T03:33:01.770738+0000","last_peered":"2024-09-17T03:33:01.770738+0000","last_clean":"2024-09-17T03:33:01.770738+0000","last_became_active":"2024-09-17T03:33:00.770971+0000","last_became_peered":"2024-09-17T03:33:00.770971+0000","last_unstale":"2024-09-17T03:33:01.770738+0000","last_undegraded":"2024-09-17T03:33:01.770738+0000","last_fullsized":"2024-09-17T03:33:01.770738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:31.492292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771440+0000","last_change":"2024-09-17T03:33:00.783198+0000","last_active":"2024-09-17T03:33:01.771440+0000","last_peered":"2024-09-17T03:33:01.771440+0000","last_clean":"2024-09-17T03:33:01.771440+0000","last_became_active":"2024-09-17T03:33:00.782880+0000","last_became_peered":"2024-09-17T03:33:00.782880+0000","last_unstale":"2024-09-17T03:33:01.771440+0000","last_undegraded":"2024-09-17T03:33:01.771440+0000","last_fullsized":"2024-09-17T03:33:01.771440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:54.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772159+0000","last_change":"2024-09-17T03:33:00.785690+0000","last_active":"2024-09-17T03:33:01.772159+0000","last_peered":"2024-09-17T03:33:01.772159+0000","last_clean":"2024-09-17T03:33:01.772159+0000","last_became_active":"2024-09-17T03:33:00.785379+0000","last_became_peered":"2024-09-17T03:33:00.785379+0000","last_unstale":"2024-09-17T03:33:01.772159+0000","last_undegraded":"2024-09-17T03:33:01.772159+0000","last_fullsized":"2024-09-17T03:33:01.772159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:23.348736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829110+0000","last_change":"2024-09-17T03:33:00.771812+0000","last_active":"2024-09-17T03:33:01.829110+0000","last_peered":"2024-09-17T03:33:01.829110+0000","last_clean":"2024-09-17T03:33:01.829110+0000","last_became_active":"2024-09-17T03:33:00.771519+0000","last_became_peered":"2024-09-17T03:33:00.771519+0000","last_unstale":"2024-09-17T03:33:01.829110+0000","last_undegraded":"2024-09-17T03:33:01.829110+0000","last_fullsized":"2024-09-17T03:33:01.829110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:35.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771263+0000","last_change":"2024-09-17T03:33:00.775473+0000","last_active":"2024-09-17T03:33:01.771263+0000","last_peered":"2024-09-17T03:33:01.771263+0000","last_clean":"2024-09-17T03:33:01.771263+0000","last_became_active":"2024-09-17T03:33:00.775162+0000","last_became_peered":"2024-09-17T03:33:00.775162+0000","last_unstale":"2024-09-17T03:33:01.771263+0000","last_undegraded":"2024-09-17T03:33:01.771263+0000","last_fullsized":"2024-09-17T03:33:01.771263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:46.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828630+0000","last_change":"2024-09-17T03:33:00.769652+0000","last_active":"2024-09-17T03:33:01.828630+0000","last_peered":"2024-09-17T03:33:01.828630+0000","last_clean":"2024-09-17T03:33:01.828630+0000","last_became_active":"2024-09-17T03:33:00.769304+0000","last_became_peered":"2024-09-17T03:33:00.769304+0000","last_unstale":"2024-09-17T03:33:01.828630+0000","last_undegraded":"2024-09-17T03:33:01.828630+0000","last_fullsized":"2024-09-17T03:33:01.828630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:57.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828353+0000","last_change":"2024-09-17T03:33:00.767896+0000","last_active":"2024-09-17T03:33:01.828353+0000","last_peered":"2024-09-17T03:33:01.828353+0000","last_clean":"2024-09-17T03:33:01.828353+0000","last_became_active":"2024-09-17T03:33:00.766950+0000","last_became_peered":"2024-09-17T03:33:00.766950+0000","last_unstale":"2024-09-17T03:33:01.828353+0000","last_undegraded":"2024-09-17T03:33:01.828353+0000","last_fullsized":"2024-09-17T03:33:01.828353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:06.893972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771900+0000","last_change":"2024-09-17T03:33:00.772070+0000","last_active":"2024-09-17T03:33:01.771900+0000","last_peered":"2024-09-17T03:33:01.771900+0000","last_clean":"2024-09-17T03:33:01.771900+0000","last_became_active":"2024-09-17T03:33:00.771721+0000","last_became_peered":"2024-09-17T03:33:00.771721+0000","last_unstale":"2024-09-17T03:33:01.771900+0000","last_undegraded":"2024-09-17T03:33:01.771900+0000","last_fullsized":"2024-09-17T03:33:01.771900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:27.987451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828369+0000","last_change":"2024-09-17T03:32:59.762042+0000","last_active":"2024-09-17T03:33:01.828369+0000","last_peered":"2024-09-17T03:33:01.828369+0000","last_clean":"2024-09-17T03:33:01.828369+0000","last_became_active":"2024-09-17T03:32:59.761644+0000","last_became_peered":"2024-09-17T03:32:59.761644+0000","last_unstale":"2024-09-17T03:33:01.828369+0000","last_undegraded":"2024-09-17T03:33:01.828369+0000","last_fullsized":"2024-09-17T03:33:01.828369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:05.070599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737442+0000","last_change":"2024-09-17T03:32:58.737442+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737442+0000","last_undegraded":"2024-09-17T03:32:58.737442+0000","last_fullsized":"2024-09-17T03:32:58.737442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829218+0000","last_change":"2024-09-17T03:32:59.758058+0000","last_active":"2024-09-17T03:33:01.829218+0000","last_peered":"2024-09-17T03:33:01.829218+0000","last_clean":"2024-09-17T03:33:01.829218+0000","last_became_active":"2024-09-17T03:32:59.757687+0000","last_became_peered":"2024-09-17T03:32:59.757687+0000","last_unstale":"2024-09-17T03:33:01.829218+0000","last_undegraded":"2024-09-17T03:33:01.829218+0000","last_fullsized":"2024-09-17T03:33:01.829218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827893+0000","last_change":"2024-09-17T03:33:00.770901+0000","last_active":"2024-09-17T03:33:01.827893+0000","last_peered":"2024-09-17T03:33:01.827893+0000","last_clean":"2024-09-17T03:33:01.827893+0000","last_became_active":"2024-09-17T03:33:00.770616+0000","last_became_peered":"2024-09-17T03:33:00.770616+0000","last_unstale":"2024-09-17T03:33:01.827893+0000","last_undegraded":"2024-09-17T03:33:01.827893+0000","last_fullsized":"2024-09-17T03:33:01.827893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:30.089705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770904+0000","last_change":"2024-09-17T03:32:59.754649+0000","last_active":"2024-09-17T03:33:01.770904+0000","last_peered":"2024-09-17T03:33:01.770904+0000","last_clean":"2024-09-17T03:33:01.770904+0000","last_became_active":"2024-09-17T03:32:59.754136+0000","last_became_peered":"2024-09-17T03:32:59.754136+0000","last_unstale":"2024-09-17T03:33:01.770904+0000","last_undegraded":"2024-09-17T03:33:01.770904+0000","last_fullsized":"2024-09-17T03:33:01.770904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738149+0000","last_change":"2024-09-17T03:32:58.738149+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738149+0000","last_undegraded":"2024-09-17T03:32:58.738149+0000","last_fullsized":"2024-09-17T03:32:58.738149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770975+0000","last_change":"2024-09-17T03:33:00.783600+0000","last_active":"2024-09-17T03:33:01.770975+0000","last_peered":"2024-09-17T03:33:01.770975+0000","last_clean":"2024-09-17T03:33:01.770975+0000","last_became_active":"2024-09-17T03:33:00.783299+0000","last_became_peered":"2024-09-17T03:33:00.783299+0000","last_unstale":"2024-09-17T03:33:01.770975+0000","last_undegraded":"2024-09-17T03:33:01.770975+0000","last_fullsized":"2024-09-17T03:33:01.770975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:44.836032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771087+0000","last_change":"2024-09-17T03:32:59.756949+0000","last_active":"2024-09-17T03:33:01.771087+0000","last_peered":"2024-09-17T03:33:01.771087+0000","last_clean":"2024-09-17T03:33:01.771087+0000","last_became_active":"2024-09-17T03:32:59.756555+0000","last_became_peered":"2024-09-17T03:32:59.756555+0000","last_unstale":"2024-09-17T03:33:01.771087+0000","last_undegraded":"2024-09-17T03:33:01.771087+0000","last_fullsized":"2024-09-17T03:33:01.771087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:41.461451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742971+0000","last_change":"2024-09-17T03:32:58.742971+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742971+0000","last_undegraded":"2024-09-17T03:32:58.742971+0000","last_fullsized":"2024-09-17T03:32:58.742971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737436+0000","last_change":"2024-09-17T03:32:58.737436+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737436+0000","last_undegraded":"2024-09-17T03:32:58.737436+0000","last_fullsized":"2024-09-17T03:32:58.737436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.739792+0000","last_change":"2024-09-17T03:32:58.739792+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.739792+0000","last_undegraded":"2024-09-17T03:32:58.739792+0000","last_fullsized":"2024-09-17T03:32:58.739792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772126+0000","last_change":"2024-09-17T03:32:59.760715+0000","last_active":"2024-09-17T03:33:01.772126+0000","last_peered":"2024-09-17T03:33:01.772126+0000","last_clean":"2024-09-17T03:33:01.772126+0000","last_became_active":"2024-09-17T03:32:59.760384+0000","last_became_peered":"2024-09-17T03:32:59.760384+0000","last_unstale":"2024-09-17T03:33:01.772126+0000","last_undegraded":"2024-09-17T03:33:01.772126+0000","last_fullsized":"2024-09-17T03:33:01.772126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:12.647154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737437+0000","last_change":"2024-09-17T03:32:58.737437+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737437+0000","last_undegraded":"2024-09-17T03:32:58.737437+0000","last_fullsized":"2024-09-17T03:32:58.737437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738740+0000","last_change":"2024-09-17T03:32:58.738740+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738740+0000","last_undegraded":"2024-09-17T03:32:58.738740+0000","last_fullsized":"2024-09-17T03:32:58.738740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.736807+0000","last_change":"2024-09-17T03:32:58.736807+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.736807+0000","last_undegraded":"2024-09-17T03:32:58.736807+0000","last_fullsized":"2024-09-17T03:32:58.736807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738880+0000","last_change":"2024-09-17T03:32:58.738880+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738880+0000","last_undegraded":"2024-09-17T03:32:58.738880+0000","last_fullsized":"2024-09-17T03:32:58.738880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741944+0000","last_change":"2024-09-17T03:32:58.741944+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741944+0000","last_undegraded":"2024-09-17T03:32:58.741944+0000","last_fullsized":"2024-09-17T03:32:58.741944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771993+0000","last_change":"2024-09-17T03:33:00.776604+0000","last_active":"2024-09-17T03:33:01.771993+0000","last_peered":"2024-09-17T03:33:01.771993+0000","last_clean":"2024-09-17T03:33:01.771993+0000","last_became_active":"2024-09-17T03:33:00.776020+0000","last_became_peered":"2024-09-17T03:33:00.776020+0000","last_unstale":"2024-09-17T03:33:01.771993+0000","last_undegraded":"2024-09-17T03:33:01.771993+0000","last_fullsized":"2024-09-17T03:33:01.771993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:06.411768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.739034+0000","last_change":"2024-09-17T03:32:58.739034+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.739034+0000","last_undegraded":"2024-09-17T03:32:58.739034+0000","last_fullsized":"2024-09-17T03:32:58.739034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T03:32:58.741533+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:32:58.741533+0000","last_peered":"2024-09-17T03:32:58.741533+0000","last_clean":"2024-09-17T03:32:58.741533+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:32:58.741533+0000","last_undegraded":"2024-09-17T03:32:58.741533+0000","last_fullsized":"2024-09-17T03:32:58.741533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771026+0000","last_change":"2024-09-17T03:32:59.755210+0000","last_active":"2024-09-17T03:33:01.771026+0000","last_peered":"2024-09-17T03:33:01.771026+0000","last_clean":"2024-09-17T03:33:01.771026+0000","last_became_active":"2024-09-17T03:32:59.753607+0000","last_became_peered":"2024-09-17T03:32:59.753607+0000","last_unstale":"2024-09-17T03:33:01.771026+0000","last_undegraded":"2024-09-17T03:33:01.771026+0000","last_fullsized":"2024-09-17T03:33:01.771026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829325+0000","last_change":"2024-09-17T03:33:00.780277+0000","last_active":"2024-09-17T03:33:01.829325+0000","last_peered":"2024-09-17T03:33:01.829325+0000","last_clean":"2024-09-17T03:33:01.829325+0000","last_became_active":"2024-09-17T03:33:00.780008+0000","last_became_peered":"2024-09-17T03:33:00.780008+0000","last_unstale":"2024-09-17T03:33:01.829325+0000","last_undegraded":"2024-09-17T03:33:01.829325+0000","last_fullsized":"2024-09-17T03:33:01.829325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:56.218073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740270+0000","last_change":"2024-09-17T03:32:58.740270+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740270+0000","last_undegraded":"2024-09-17T03:32:58.740270+0000","last_fullsized":"2024-09-17T03:32:58.740270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738725+0000","last_change":"2024-09-17T03:32:58.738725+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738725+0000","last_undegraded":"2024-09-17T03:32:58.738725+0000","last_fullsized":"2024-09-17T03:32:58.738725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772200+0000","last_change":"2024-09-17T03:32:59.753138+0000","last_active":"2024-09-17T03:33:01.772200+0000","last_peered":"2024-09-17T03:33:01.772200+0000","last_clean":"2024-09-17T03:33:01.772200+0000","last_became_active":"2024-09-17T03:32:59.752828+0000","last_became_peered":"2024-09-17T03:32:59.752828+0000","last_unstale":"2024-09-17T03:33:01.772200+0000","last_undegraded":"2024-09-17T03:33:01.772200+0000","last_fullsized":"2024-09-17T03:33:01.772200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:06.735843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.743085+0000","last_change":"2024-09-17T03:32:58.743085+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.743085+0000","last_undegraded":"2024-09-17T03:32:58.743085+0000","last_fullsized":"2024-09-17T03:32:58.743085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772112+0000","last_change":"2024-09-17T03:33:00.771853+0000","last_active":"2024-09-17T03:33:01.772112+0000","last_peered":"2024-09-17T03:33:01.772112+0000","last_clean":"2024-09-17T03:33:01.772112+0000","last_became_active":"2024-09-17T03:33:00.771534+0000","last_became_peered":"2024-09-17T03:33:00.771534+0000","last_unstale":"2024-09-17T03:33:01.772112+0000","last_undegraded":"2024-09-17T03:33:01.772112+0000","last_fullsized":"2024-09-17T03:33:01.772112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:07.316072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740409+0000","last_change":"2024-09-17T03:32:58.740409+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740409+0000","last_undegraded":"2024-09-17T03:32:58.740409+0000","last_fullsized":"2024-09-17T03:32:58.740409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742325+0000","last_change":"2024-09-17T03:32:58.742325+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742325+0000","last_undegraded":"2024-09-17T03:32:58.742325+0000","last_fullsized":"2024-09-17T03:32:58.742325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828852+0000","last_change":"2024-09-17T03:33:00.777441+0000","last_active":"2024-09-17T03:33:01.828852+0000","last_peered":"2024-09-17T03:33:01.828852+0000","last_clean":"2024-09-17T03:33:01.828852+0000","last_became_active":"2024-09-17T03:33:00.777102+0000","last_became_peered":"2024-09-17T03:33:00.777102+0000","last_unstale":"2024-09-17T03:33:01.828852+0000","last_undegraded":"2024-09-17T03:33:01.828852+0000","last_fullsized":"2024-09-17T03:33:01.828852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.389271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737604+0000","last_change":"2024-09-17T03:32:58.737604+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737604+0000","last_undegraded":"2024-09-17T03:32:58.737604+0000","last_fullsized":"2024-09-17T03:32:58.737604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740869+0000","last_change":"2024-09-17T03:32:58.740869+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740869+0000","last_undegraded":"2024-09-17T03:32:58.740869+0000","last_fullsized":"2024-09-17T03:32:58.740869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741868+0000","last_change":"2024-09-17T03:32:58.741868+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741868+0000","last_undegraded":"2024-09-17T03:32:58.741868+0000","last_fullsized":"2024-09-17T03:32:58.741868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828140+0000","last_change":"2024-09-17T03:33:00.761340+0000","last_active":"2024-09-17T03:33:01.828140+0000","last_peered":"2024-09-17T03:33:01.828140+0000","last_clean":"2024-09-17T03:33:01.828140+0000","last_became_active":"2024-09-17T03:33:00.760617+0000","last_became_peered":"2024-09-17T03:33:00.760617+0000","last_unstale":"2024-09-17T03:33:01.828140+0000","last_undegraded":"2024-09-17T03:33:01.828140+0000","last_fullsized":"2024-09-17T03:33:01.828140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:17.573959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742366+0000","last_change":"2024-09-17T03:32:58.742366+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742366+0000","last_undegraded":"2024-09-17T03:32:58.742366+0000","last_fullsized":"2024-09-17T03:32:58.742366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828236+0000","last_change":"2024-09-17T03:33:00.773988+0000","last_active":"2024-09-17T03:33:01.828236+0000","last_peered":"2024-09-17T03:33:01.828236+0000","last_clean":"2024-09-17T03:33:01.828236+0000","last_became_active":"2024-09-17T03:33:00.773669+0000","last_became_peered":"2024-09-17T03:33:00.773669+0000","last_unstale":"2024-09-17T03:33:01.828236+0000","last_undegraded":"2024-09-17T03:33:01.828236+0000","last_fullsized":"2024-09-17T03:33:01.828236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:36.829010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740380+0000","last_change":"2024-09-17T03:32:58.740380+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740380+0000","last_undegraded":"2024-09-17T03:32:58.740380+0000","last_fullsized":"2024-09-17T03:32:58.740380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772055+0000","last_change":"2024-09-17T03:33:00.775407+0000","last_active":"2024-09-17T03:33:01.772055+0000","last_peered":"2024-09-17T03:33:01.772055+0000","last_clean":"2024-09-17T03:33:01.772055+0000","last_became_active":"2024-09-17T03:33:00.773657+0000","last_became_peered":"2024-09-17T03:33:00.773657+0000","last_unstale":"2024-09-17T03:33:01.772055+0000","last_undegraded":"2024-09-17T03:33:01.772055+0000","last_fullsized":"2024-09-17T03:33:01.772055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:18.984982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740308+0000","last_change":"2024-09-17T03:32:58.740308+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740308+0000","last_undegraded":"2024-09-17T03:32:58.740308+0000","last_fullsized":"2024-09-17T03:32:58.740308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771973+0000","last_change":"2024-09-17T03:33:00.777352+0000","last_active":"2024-09-17T03:33:01.771973+0000","last_peered":"2024-09-17T03:33:01.771973+0000","last_clean":"2024-09-17T03:33:01.771973+0000","last_became_active":"2024-09-17T03:33:00.777033+0000","last_became_peered":"2024-09-17T03:33:00.777033+0000","last_unstale":"2024-09-17T03:33:01.771973+0000","last_undegraded":"2024-09-17T03:33:01.771973+0000","last_fullsized":"2024-09-17T03:33:01.771973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:46.197387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741019+0000","last_change":"2024-09-17T03:32:58.741019+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741019+0000","last_undegraded":"2024-09-17T03:32:58.741019+0000","last_fullsized":"2024-09-17T03:32:58.741019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828382+0000","last_change":"2024-09-17T03:32:59.763107+0000","last_active":"2024-09-17T03:33:01.828382+0000","last_peered":"2024-09-17T03:33:01.828382+0000","last_clean":"2024-09-17T03:33:01.828382+0000","last_became_active":"2024-09-17T03:32:59.762811+0000","last_became_peered":"2024-09-17T03:32:59.762811+0000","last_unstale":"2024-09-17T03:33:01.828382+0000","last_undegraded":"2024-09-17T03:33:01.828382+0000","last_fullsized":"2024-09-17T03:33:01.828382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828252+0000","last_change":"2024-09-17T03:33:00.774953+0000","last_active":"2024-09-17T03:33:01.828252+0000","last_peered":"2024-09-17T03:33:01.828252+0000","last_clean":"2024-09-17T03:33:01.828252+0000","last_became_active":"2024-09-17T03:33:00.773865+0000","last_became_peered":"2024-09-17T03:33:00.773865+0000","last_unstale":"2024-09-17T03:33:01.828252+0000","last_undegraded":"2024-09-17T03:33:01.828252+0000","last_fullsized":"2024-09-17T03:33:01.828252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:03.734959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740499+0000","last_change":"2024-09-17T03:32:58.740499+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740499+0000","last_undegraded":"2024-09-17T03:32:58.740499+0000","last_fullsized":"2024-09-17T03:32:58.740499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":47580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":200704,"data_stored":66537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:04.122 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.271+0000 7fe8c54a9640 1 -- 172.21.15.146:0/1126716127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c00b3870 msgr2=0x7fe8c00cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.271+0000 7fe8c54a9640 1 --2- 172.21.15.146:0/1126716127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c00b3870 0x7fe8c00cf370 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0005fd0 tx=0x7fe8b002a540 comp rx=0 tx=0).stop 2024-09-17T03:33:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.272+0000 7fe8c54a9640 1 -- 172.21.15.146:0/1126716127 shutdown_connections 2024-09-17T03:33:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.272+0000 7fe8c54a9640 1 --2- 172.21.15.146:0/1126716127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c01620f0 0x7fe8c006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.272+0000 7fe8c54a9640 1 --2- 172.21.15.146:0/1126716127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c00b3870 0x7fe8c00cf370 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.272+0000 7fe8c54a9640 1 -- 172.21.15.146:0/1126716127 >> 172.21.15.146:0/1126716127 conn(0x7fe8c00d4be0 msgr2=0x7fe8c00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.272+0000 7fe8c54a9640 1 -- 172.21.15.146:0/1126716127 shutdown_connections 2024-09-17T03:33:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.272+0000 7fe8c54a9640 1 -- 172.21.15.146:0/1126716127 wait complete. 2024-09-17T03:33:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.274+0000 7fe8c54a9640 1 Processor -- start 2024-09-17T03:33:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.274+0000 7fe8c54a9640 1 -- start start 2024-09-17T03:33:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8c54a9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c006f270 0x7fe8c014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8c54a9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8c00b3870 0x7fe8c00ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8c54a9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c01620f0 0x7fe8c00ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8c54a9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c00d43b0 con 0x7fe8c01620f0 2024-09-17T03:33:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8c54a9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0162fb0 con 0x7fe8c00b3870 2024-09-17T03:33:04.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8c54a9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c00cda90 con 0x7fe8c006f270 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8bf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c01620f0 0x7fe8c00ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8bf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c01620f0 0x7fe8c00ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59606/0 (socket says 172.21.15.146:59606) 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8bf7fe640 1 -- 172.21.15.146:0/3154845030 learned_addr learned my addr 172.21.15.146:0/3154845030 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8beffd640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c006f270 0x7fe8c014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8be7fc640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8c00b3870 0x7fe8c00ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8bf7fe640 1 -- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c006f270 msgr2=0x7fe8c014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8bf7fe640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c006f270 0x7fe8c014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8bf7fe640 1 -- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8c00b3870 msgr2=0x7fe8c00ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8bf7fe640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8c00b3870 0x7fe8c00ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8bf7fe640 1 -- 172.21.15.146:0/3154845030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c01593e0 con 0x7fe8c01620f0 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8beffd640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c006f270 0x7fe8c014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8be7fc640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8c00b3870 0x7fe8c00ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.275+0000 7fe8bf7fe640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c01620f0 0x7fe8c00ccfc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800c730 tx=0x7fe8b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.276+0000 7fe8a77fe640 1 -- 172.21.15.146:0/3154845030 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8017070 con 0x7fe8c01620f0 2024-09-17T03:33:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.276+0000 7fe8a77fe640 1 -- 172.21.15.146:0/3154845030 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8b8003c60 con 0x7fe8c01620f0 2024-09-17T03:33:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.276+0000 7fe8c54a9640 1 -- 172.21.15.146:0/3154845030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c015c530 con 0x7fe8c01620f0 2024-09-17T03:33:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.276+0000 7fe8a77fe640 1 -- 172.21.15.146:0/3154845030 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80052d0 con 0x7fe8c01620f0 2024-09-17T03:33:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.276+0000 7fe8c54a9640 1 -- 172.21.15.146:0/3154845030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c00c9d30 con 0x7fe8c01620f0 2024-09-17T03:33:04.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.277+0000 7fe8c54a9640 1 -- 172.21.15.146:0/3154845030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c0163480 con 0x7fe8c01620f0 2024-09-17T03:33:04.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.277+0000 7fe8a77fe640 1 -- 172.21.15.146:0/3154845030 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8b801a070 con 0x7fe8c01620f0 2024-09-17T03:33:04.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.278+0000 7fe8a77fe640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8ac078b90 0x7fe8ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:04.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.278+0000 7fe8a77fe640 1 -- 172.21.15.146:0/3154845030 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe8b809a4f0 con 0x7fe8c01620f0 2024-09-17T03:33:04.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.278+0000 7fe8beffd640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8ac078b90 0x7fe8ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:04.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.278+0000 7fe8beffd640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8ac078b90 0x7fe8ac07b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0033000 tx=0x7fe8b0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:04.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.282+0000 7fe8a77fe640 1 -- 172.21.15.146:0/3154845030 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8c006f680 con 0x7fe8c01620f0 2024-09-17T03:33:04.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.453+0000 7fe8c54a9640 1 -- 172.21.15.146:0/3154845030 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe8c00d2bd0 con 0x7fe8ac078b90 2024-09-17T03:33:04.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.457+0000 7fe8a77fe640 1 -- 172.21.15.146:0/3154845030 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243834 (secure 0 0 0) 0x7fe8c00d2bd0 con 0x7fe8ac078b90 2024-09-17T03:33:04.459 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:04.460 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 -- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8ac078b90 msgr2=0x7fe8ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8ac078b90 0x7fe8ac07b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0033000 tx=0x7fe8b0004730 comp rx=0 tx=0).stop 2024-09-17T03:33:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 -- 172.21.15.146:0/3154845030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c01620f0 msgr2=0x7fe8c00ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c01620f0 0x7fe8c00ccfc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800c730 tx=0x7fe8b800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 -- 172.21.15.146:0/3154845030 shutdown_connections 2024-09-17T03:33:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8ac078b90 0x7fe8ac07b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c01620f0 0x7fe8c00ccfc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8c00b3870 0x7fe8c00ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 --2- 172.21.15.146:0/3154845030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c006f270 0x7fe8c014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 -- 172.21.15.146:0/3154845030 >> 172.21.15.146:0/3154845030 conn(0x7fe8c00d4be0 msgr2=0x7fe8c01611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 -- 172.21.15.146:0/3154845030 shutdown_connections 2024-09-17T03:33:04.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.460+0000 7fe8c54a9640 1 -- 172.21.15.146:0/3154845030 wait complete. 2024-09-17T03:33:04.471 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T03:33:03.789703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218800,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755920,"statfs":{"total":773094113280,"available":772870062080,"internally_reserved":0,"allocated":2629632,"data_stored":1636197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.054810"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771728+0000","last_change":"2024-09-17T03:33:00.778126+0000","last_active":"2024-09-17T03:33:01.771728+0000","last_peered":"2024-09-17T03:33:01.771728+0000","last_clean":"2024-09-17T03:33:01.771728+0000","last_became_active":"2024-09-17T03:33:00.777760+0000","last_became_peered":"2024-09-17T03:33:00.777760+0000","last_unstale":"2024-09-17T03:33:01.771728+0000","last_undegraded":"2024-09-17T03:33:01.771728+0000","last_fullsized":"2024-09-17T03:33:01.771728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:48.841807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771542+0000","last_change":"2024-09-17T03:33:00.772869+0000","last_active":"2024-09-17T03:33:01.771542+0000","last_peered":"2024-09-17T03:33:01.771542+0000","last_clean":"2024-09-17T03:33:01.771542+0000","last_became_active":"2024-09-17T03:33:00.772517+0000","last_became_peered":"2024-09-17T03:33:00.772517+0000","last_unstale":"2024-09-17T03:33:01.771542+0000","last_undegraded":"2024-09-17T03:33:01.771542+0000","last_fullsized":"2024-09-17T03:33:01.771542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:19.582453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829349+0000","last_change":"2024-09-17T03:33:00.780226+0000","last_active":"2024-09-17T03:33:01.829349+0000","last_peered":"2024-09-17T03:33:01.829349+0000","last_clean":"2024-09-17T03:33:01.829349+0000","last_became_active":"2024-09-17T03:33:00.779937+0000","last_became_peered":"2024-09-17T03:33:00.779937+0000","last_unstale":"2024-09-17T03:33:01.829349+0000","last_undegraded":"2024-09-17T03:33:01.829349+0000","last_fullsized":"2024-09-17T03:33:01.829349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:23.843836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828003+0000","last_change":"2024-09-17T03:33:00.774115+0000","last_active":"2024-09-17T03:33:01.828003+0000","last_peered":"2024-09-17T03:33:01.828003+0000","last_clean":"2024-09-17T03:33:01.828003+0000","last_became_active":"2024-09-17T03:33:00.773803+0000","last_became_peered":"2024-09-17T03:33:00.773803+0000","last_unstale":"2024-09-17T03:33:01.828003+0000","last_undegraded":"2024-09-17T03:33:01.828003+0000","last_fullsized":"2024-09-17T03:33:01.828003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:13.109575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770738+0000","last_change":"2024-09-17T03:33:00.771303+0000","last_active":"2024-09-17T03:33:01.770738+0000","last_peered":"2024-09-17T03:33:01.770738+0000","last_clean":"2024-09-17T03:33:01.770738+0000","last_became_active":"2024-09-17T03:33:00.770971+0000","last_became_peered":"2024-09-17T03:33:00.770971+0000","last_unstale":"2024-09-17T03:33:01.770738+0000","last_undegraded":"2024-09-17T03:33:01.770738+0000","last_fullsized":"2024-09-17T03:33:01.770738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:31.492292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771440+0000","last_change":"2024-09-17T03:33:00.783198+0000","last_active":"2024-09-17T03:33:01.771440+0000","last_peered":"2024-09-17T03:33:01.771440+0000","last_clean":"2024-09-17T03:33:01.771440+0000","last_became_active":"2024-09-17T03:33:00.782880+0000","last_became_peered":"2024-09-17T03:33:00.782880+0000","last_unstale":"2024-09-17T03:33:01.771440+0000","last_undegraded":"2024-09-17T03:33:01.771440+0000","last_fullsized":"2024-09-17T03:33:01.771440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:54.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772159+0000","last_change":"2024-09-17T03:33:00.785690+0000","last_active":"2024-09-17T03:33:01.772159+0000","last_peered":"2024-09-17T03:33:01.772159+0000","last_clean":"2024-09-17T03:33:01.772159+0000","last_became_active":"2024-09-17T03:33:00.785379+0000","last_became_peered":"2024-09-17T03:33:00.785379+0000","last_unstale":"2024-09-17T03:33:01.772159+0000","last_undegraded":"2024-09-17T03:33:01.772159+0000","last_fullsized":"2024-09-17T03:33:01.772159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:23.348736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829110+0000","last_change":"2024-09-17T03:33:00.771812+0000","last_active":"2024-09-17T03:33:01.829110+0000","last_peered":"2024-09-17T03:33:01.829110+0000","last_clean":"2024-09-17T03:33:01.829110+0000","last_became_active":"2024-09-17T03:33:00.771519+0000","last_became_peered":"2024-09-17T03:33:00.771519+0000","last_unstale":"2024-09-17T03:33:01.829110+0000","last_undegraded":"2024-09-17T03:33:01.829110+0000","last_fullsized":"2024-09-17T03:33:01.829110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:35.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771263+0000","last_change":"2024-09-17T03:33:00.775473+0000","last_active":"2024-09-17T03:33:01.771263+0000","last_peered":"2024-09-17T03:33:01.771263+0000","last_clean":"2024-09-17T03:33:01.771263+0000","last_became_active":"2024-09-17T03:33:00.775162+0000","last_became_peered":"2024-09-17T03:33:00.775162+0000","last_unstale":"2024-09-17T03:33:01.771263+0000","last_undegraded":"2024-09-17T03:33:01.771263+0000","last_fullsized":"2024-09-17T03:33:01.771263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:46.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828630+0000","last_change":"2024-09-17T03:33:00.769652+0000","last_active":"2024-09-17T03:33:01.828630+0000","last_peered":"2024-09-17T03:33:01.828630+0000","last_clean":"2024-09-17T03:33:01.828630+0000","last_became_active":"2024-09-17T03:33:00.769304+0000","last_became_peered":"2024-09-17T03:33:00.769304+0000","last_unstale":"2024-09-17T03:33:01.828630+0000","last_undegraded":"2024-09-17T03:33:01.828630+0000","last_fullsized":"2024-09-17T03:33:01.828630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:57.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828353+0000","last_change":"2024-09-17T03:33:00.767896+0000","last_active":"2024-09-17T03:33:01.828353+0000","last_peered":"2024-09-17T03:33:01.828353+0000","last_clean":"2024-09-17T03:33:01.828353+0000","last_became_active":"2024-09-17T03:33:00.766950+0000","last_became_peered":"2024-09-17T03:33:00.766950+0000","last_unstale":"2024-09-17T03:33:01.828353+0000","last_undegraded":"2024-09-17T03:33:01.828353+0000","last_fullsized":"2024-09-17T03:33:01.828353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:06.893972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771900+0000","last_change":"2024-09-17T03:33:00.772070+0000","last_active":"2024-09-17T03:33:01.771900+0000","last_peered":"2024-09-17T03:33:01.771900+0000","last_clean":"2024-09-17T03:33:01.771900+0000","last_became_active":"2024-09-17T03:33:00.771721+0000","last_became_peered":"2024-09-17T03:33:00.771721+0000","last_unstale":"2024-09-17T03:33:01.771900+0000","last_undegraded":"2024-09-17T03:33:01.771900+0000","last_fullsized":"2024-09-17T03:33:01.771900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:27.987451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828369+0000","last_change":"2024-09-17T03:32:59.762042+0000","last_active":"2024-09-17T03:33:01.828369+0000","last_peered":"2024-09-17T03:33:01.828369+0000","last_clean":"2024-09-17T03:33:01.828369+0000","last_became_active":"2024-09-17T03:32:59.761644+0000","last_became_peered":"2024-09-17T03:32:59.761644+0000","last_unstale":"2024-09-17T03:33:01.828369+0000","last_undegraded":"2024-09-17T03:33:01.828369+0000","last_fullsized":"2024-09-17T03:33:01.828369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:05.070599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737442+0000","last_change":"2024-09-17T03:32:58.737442+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737442+0000","last_undegraded":"2024-09-17T03:32:58.737442+0000","last_fullsized":"2024-09-17T03:32:58.737442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829218+0000","last_change":"2024-09-17T03:32:59.758058+0000","last_active":"2024-09-17T03:33:01.829218+0000","last_peered":"2024-09-17T03:33:01.829218+0000","last_clean":"2024-09-17T03:33:01.829218+0000","last_became_active":"2024-09-17T03:32:59.757687+0000","last_became_peered":"2024-09-17T03:32:59.757687+0000","last_unstale":"2024-09-17T03:33:01.829218+0000","last_undegraded":"2024-09-17T03:33:01.829218+0000","last_fullsized":"2024-09-17T03:33:01.829218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827893+0000","last_change":"2024-09-17T03:33:00.770901+0000","last_active":"2024-09-17T03:33:01.827893+0000","last_peered":"2024-09-17T03:33:01.827893+0000","last_clean":"2024-09-17T03:33:01.827893+0000","last_became_active":"2024-09-17T03:33:00.770616+0000","last_became_peered":"2024-09-17T03:33:00.770616+0000","last_unstale":"2024-09-17T03:33:01.827893+0000","last_undegraded":"2024-09-17T03:33:01.827893+0000","last_fullsized":"2024-09-17T03:33:01.827893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:30.089705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770904+0000","last_change":"2024-09-17T03:32:59.754649+0000","last_active":"2024-09-17T03:33:01.770904+0000","last_peered":"2024-09-17T03:33:01.770904+0000","last_clean":"2024-09-17T03:33:01.770904+0000","last_became_active":"2024-09-17T03:32:59.754136+0000","last_became_peered":"2024-09-17T03:32:59.754136+0000","last_unstale":"2024-09-17T03:33:01.770904+0000","last_undegraded":"2024-09-17T03:33:01.770904+0000","last_fullsized":"2024-09-17T03:33:01.770904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738149+0000","last_change":"2024-09-17T03:32:58.738149+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738149+0000","last_undegraded":"2024-09-17T03:32:58.738149+0000","last_fullsized":"2024-09-17T03:32:58.738149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770975+0000","last_change":"2024-09-17T03:33:00.783600+0000","last_active":"2024-09-17T03:33:01.770975+0000","last_peered":"2024-09-17T03:33:01.770975+0000","last_clean":"2024-09-17T03:33:01.770975+0000","last_became_active":"2024-09-17T03:33:00.783299+0000","last_became_peered":"2024-09-17T03:33:00.783299+0000","last_unstale":"2024-09-17T03:33:01.770975+0000","last_undegraded":"2024-09-17T03:33:01.770975+0000","last_fullsized":"2024-09-17T03:33:01.770975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:44.836032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771087+0000","last_change":"2024-09-17T03:32:59.756949+0000","last_active":"2024-09-17T03:33:01.771087+0000","last_peered":"2024-09-17T03:33:01.771087+0000","last_clean":"2024-09-17T03:33:01.771087+0000","last_became_active":"2024-09-17T03:32:59.756555+0000","last_became_peered":"2024-09-17T03:32:59.756555+0000","last_unstale":"2024-09-17T03:33:01.771087+0000","last_undegraded":"2024-09-17T03:33:01.771087+0000","last_fullsized":"2024-09-17T03:33:01.771087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:41.461451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742971+0000","last_change":"2024-09-17T03:32:58.742971+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742971+0000","last_undegraded":"2024-09-17T03:32:58.742971+0000","last_fullsized":"2024-09-17T03:32:58.742971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737436+0000","last_change":"2024-09-17T03:32:58.737436+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737436+0000","last_undegraded":"2024-09-17T03:32:58.737436+0000","last_fullsized":"2024-09-17T03:32:58.737436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.739792+0000","last_change":"2024-09-17T03:32:58.739792+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.739792+0000","last_undegraded":"2024-09-17T03:32:58.739792+0000","last_fullsized":"2024-09-17T03:32:58.739792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772126+0000","last_change":"2024-09-17T03:32:59.760715+0000","last_active":"2024-09-17T03:33:01.772126+0000","last_peered":"2024-09-17T03:33:01.772126+0000","last_clean":"2024-09-17T03:33:01.772126+0000","last_became_active":"2024-09-17T03:32:59.760384+0000","last_became_peered":"2024-09-17T03:32:59.760384+0000","last_unstale":"2024-09-17T03:33:01.772126+0000","last_undegraded":"2024-09-17T03:33:01.772126+0000","last_fullsized":"2024-09-17T03:33:01.772126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:12.647154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737437+0000","last_change":"2024-09-17T03:32:58.737437+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737437+0000","last_undegraded":"2024-09-17T03:32:58.737437+0000","last_fullsized":"2024-09-17T03:32:58.737437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738740+0000","last_change":"2024-09-17T03:32:58.738740+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738740+0000","last_undegraded":"2024-09-17T03:32:58.738740+0000","last_fullsized":"2024-09-17T03:32:58.738740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.736807+0000","last_change":"2024-09-17T03:32:58.736807+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.736807+0000","last_undegraded":"2024-09-17T03:32:58.736807+0000","last_fullsized":"2024-09-17T03:32:58.736807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738880+0000","last_change":"2024-09-17T03:32:58.738880+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738880+0000","last_undegraded":"2024-09-17T03:32:58.738880+0000","last_fullsized":"2024-09-17T03:32:58.738880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741944+0000","last_change":"2024-09-17T03:32:58.741944+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741944+0000","last_undegraded":"2024-09-17T03:32:58.741944+0000","last_fullsized":"2024-09-17T03:32:58.741944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771993+0000","last_change":"2024-09-17T03:33:00.776604+0000","last_active":"2024-09-17T03:33:01.771993+0000","last_peered":"2024-09-17T03:33:01.771993+0000","last_clean":"2024-09-17T03:33:01.771993+0000","last_became_active":"2024-09-17T03:33:00.776020+0000","last_became_peered":"2024-09-17T03:33:00.776020+0000","last_unstale":"2024-09-17T03:33:01.771993+0000","last_undegraded":"2024-09-17T03:33:01.771993+0000","last_fullsized":"2024-09-17T03:33:01.771993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:06.411768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.739034+0000","last_change":"2024-09-17T03:32:58.739034+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.739034+0000","last_undegraded":"2024-09-17T03:32:58.739034+0000","last_fullsized":"2024-09-17T03:32:58.739034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T03:32:58.741533+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:32:58.741533+0000","last_peered":"2024-09-17T03:32:58.741533+0000","last_clean":"2024-09-17T03:32:58.741533+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:32:58.741533+0000","last_undegraded":"2024-09-17T03:32:58.741533+0000","last_fullsized":"2024-09-17T03:32:58.741533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771026+0000","last_change":"2024-09-17T03:32:59.755210+0000","last_active":"2024-09-17T03:33:01.771026+0000","last_peered":"2024-09-17T03:33:01.771026+0000","last_clean":"2024-09-17T03:33:01.771026+0000","last_became_active":"2024-09-17T03:32:59.753607+0000","last_became_peered":"2024-09-17T03:32:59.753607+0000","last_unstale":"2024-09-17T03:33:01.771026+0000","last_undegraded":"2024-09-17T03:33:01.771026+0000","last_fullsized":"2024-09-17T03:33:01.771026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829325+0000","last_change":"2024-09-17T03:33:00.780277+0000","last_active":"2024-09-17T03:33:01.829325+0000","last_peered":"2024-09-17T03:33:01.829325+0000","last_clean":"2024-09-17T03:33:01.829325+0000","last_became_active":"2024-09-17T03:33:00.780008+0000","last_became_peered":"2024-09-17T03:33:00.780008+0000","last_unstale":"2024-09-17T03:33:01.829325+0000","last_undegraded":"2024-09-17T03:33:01.829325+0000","last_fullsized":"2024-09-17T03:33:01.829325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:56.218073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740270+0000","last_change":"2024-09-17T03:32:58.740270+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740270+0000","last_undegraded":"2024-09-17T03:32:58.740270+0000","last_fullsized":"2024-09-17T03:32:58.740270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738725+0000","last_change":"2024-09-17T03:32:58.738725+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738725+0000","last_undegraded":"2024-09-17T03:32:58.738725+0000","last_fullsized":"2024-09-17T03:32:58.738725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772200+0000","last_change":"2024-09-17T03:32:59.753138+0000","last_active":"2024-09-17T03:33:01.772200+0000","last_peered":"2024-09-17T03:33:01.772200+0000","last_clean":"2024-09-17T03:33:01.772200+0000","last_became_active":"2024-09-17T03:32:59.752828+0000","last_became_peered":"2024-09-17T03:32:59.752828+0000","last_unstale":"2024-09-17T03:33:01.772200+0000","last_undegraded":"2024-09-17T03:33:01.772200+0000","last_fullsized":"2024-09-17T03:33:01.772200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:06.735843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.743085+0000","last_change":"2024-09-17T03:32:58.743085+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.743085+0000","last_undegraded":"2024-09-17T03:32:58.743085+0000","last_fullsized":"2024-09-17T03:32:58.743085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772112+0000","last_change":"2024-09-17T03:33:00.771853+0000","last_active":"2024-09-17T03:33:01.772112+0000","last_peered":"2024-09-17T03:33:01.772112+0000","last_clean":"2024-09-17T03:33:01.772112+0000","last_became_active":"2024-09-17T03:33:00.771534+0000","last_became_peered":"2024-09-17T03:33:00.771534+0000","last_unstale":"2024-09-17T03:33:01.772112+0000","last_undegraded":"2024-09-17T03:33:01.772112+0000","last_fullsized":"2024-09-17T03:33:01.772112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:07.316072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740409+0000","last_change":"2024-09-17T03:32:58.740409+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740409+0000","last_undegraded":"2024-09-17T03:32:58.740409+0000","last_fullsized":"2024-09-17T03:32:58.740409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742325+0000","last_change":"2024-09-17T03:32:58.742325+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742325+0000","last_undegraded":"2024-09-17T03:32:58.742325+0000","last_fullsized":"2024-09-17T03:32:58.742325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828852+0000","last_change":"2024-09-17T03:33:00.777441+0000","last_active":"2024-09-17T03:33:01.828852+0000","last_peered":"2024-09-17T03:33:01.828852+0000","last_clean":"2024-09-17T03:33:01.828852+0000","last_became_active":"2024-09-17T03:33:00.777102+0000","last_became_peered":"2024-09-17T03:33:00.777102+0000","last_unstale":"2024-09-17T03:33:01.828852+0000","last_undegraded":"2024-09-17T03:33:01.828852+0000","last_fullsized":"2024-09-17T03:33:01.828852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.389271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737604+0000","last_change":"2024-09-17T03:32:58.737604+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737604+0000","last_undegraded":"2024-09-17T03:32:58.737604+0000","last_fullsized":"2024-09-17T03:32:58.737604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740869+0000","last_change":"2024-09-17T03:32:58.740869+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740869+0000","last_undegraded":"2024-09-17T03:32:58.740869+0000","last_fullsized":"2024-09-17T03:32:58.740869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741868+0000","last_change":"2024-09-17T03:32:58.741868+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741868+0000","last_undegraded":"2024-09-17T03:32:58.741868+0000","last_fullsized":"2024-09-17T03:32:58.741868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828140+0000","last_change":"2024-09-17T03:33:00.761340+0000","last_active":"2024-09-17T03:33:01.828140+0000","last_peered":"2024-09-17T03:33:01.828140+0000","last_clean":"2024-09-17T03:33:01.828140+0000","last_became_active":"2024-09-17T03:33:00.760617+0000","last_became_peered":"2024-09-17T03:33:00.760617+0000","last_unstale":"2024-09-17T03:33:01.828140+0000","last_undegraded":"2024-09-17T03:33:01.828140+0000","last_fullsized":"2024-09-17T03:33:01.828140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:17.573959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742366+0000","last_change":"2024-09-17T03:32:58.742366+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742366+0000","last_undegraded":"2024-09-17T03:32:58.742366+0000","last_fullsized":"2024-09-17T03:32:58.742366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828236+0000","last_change":"2024-09-17T03:33:00.773988+0000","last_active":"2024-09-17T03:33:01.828236+0000","last_peered":"2024-09-17T03:33:01.828236+0000","last_clean":"2024-09-17T03:33:01.828236+0000","last_became_active":"2024-09-17T03:33:00.773669+0000","last_became_peered":"2024-09-17T03:33:00.773669+0000","last_unstale":"2024-09-17T03:33:01.828236+0000","last_undegraded":"2024-09-17T03:33:01.828236+0000","last_fullsized":"2024-09-17T03:33:01.828236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:36.829010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740380+0000","last_change":"2024-09-17T03:32:58.740380+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740380+0000","last_undegraded":"2024-09-17T03:32:58.740380+0000","last_fullsized":"2024-09-17T03:32:58.740380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772055+0000","last_change":"2024-09-17T03:33:00.775407+0000","last_active":"2024-09-17T03:33:01.772055+0000","last_peered":"2024-09-17T03:33:01.772055+0000","last_clean":"2024-09-17T03:33:01.772055+0000","last_became_active":"2024-09-17T03:33:00.773657+0000","last_became_peered":"2024-09-17T03:33:00.773657+0000","last_unstale":"2024-09-17T03:33:01.772055+0000","last_undegraded":"2024-09-17T03:33:01.772055+0000","last_fullsized":"2024-09-17T03:33:01.772055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:18.984982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740308+0000","last_change":"2024-09-17T03:32:58.740308+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740308+0000","last_undegraded":"2024-09-17T03:32:58.740308+0000","last_fullsized":"2024-09-17T03:32:58.740308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771973+0000","last_change":"2024-09-17T03:33:00.777352+0000","last_active":"2024-09-17T03:33:01.771973+0000","last_peered":"2024-09-17T03:33:01.771973+0000","last_clean":"2024-09-17T03:33:01.771973+0000","last_became_active":"2024-09-17T03:33:00.777033+0000","last_became_peered":"2024-09-17T03:33:00.777033+0000","last_unstale":"2024-09-17T03:33:01.771973+0000","last_undegraded":"2024-09-17T03:33:01.771973+0000","last_fullsized":"2024-09-17T03:33:01.771973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:46.197387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741019+0000","last_change":"2024-09-17T03:32:58.741019+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741019+0000","last_undegraded":"2024-09-17T03:32:58.741019+0000","last_fullsized":"2024-09-17T03:32:58.741019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828382+0000","last_change":"2024-09-17T03:32:59.763107+0000","last_active":"2024-09-17T03:33:01.828382+0000","last_peered":"2024-09-17T03:33:01.828382+0000","last_clean":"2024-09-17T03:33:01.828382+0000","last_became_active":"2024-09-17T03:32:59.762811+0000","last_became_peered":"2024-09-17T03:32:59.762811+0000","last_unstale":"2024-09-17T03:33:01.828382+0000","last_undegraded":"2024-09-17T03:33:01.828382+0000","last_fullsized":"2024-09-17T03:33:01.828382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828252+0000","last_change":"2024-09-17T03:33:00.774953+0000","last_active":"2024-09-17T03:33:01.828252+0000","last_peered":"2024-09-17T03:33:01.828252+0000","last_clean":"2024-09-17T03:33:01.828252+0000","last_became_active":"2024-09-17T03:33:00.773865+0000","last_became_peered":"2024-09-17T03:33:00.773865+0000","last_unstale":"2024-09-17T03:33:01.828252+0000","last_undegraded":"2024-09-17T03:33:01.828252+0000","last_fullsized":"2024-09-17T03:33:01.828252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:03.734959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740499+0000","last_change":"2024-09-17T03:32:58.740499+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740499+0000","last_undegraded":"2024-09-17T03:32:58.740499+0000","last_fullsized":"2024-09-17T03:32:58.740499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":47580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":200704,"data_stored":66537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:04.475 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-17T03:33:04.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.475 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-17T03:33:04.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.475 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-17T03:33:04.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.475 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-17T03:33:04.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.475 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-17T03:33:04.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.476 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-17T03:33:04.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.476 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-17T03:33:04.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.476 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-17T03:33:04.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.476 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-17T03:33:04.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.476 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-17T03:33:04.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.476 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-17T03:33:04.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.477 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-17T03:33:04.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.477 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-17T03:33:04.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.477 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-17T03:33:04.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.477 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-17T03:33:04.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.477 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-17T03:33:04.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.478 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-17T03:33:04.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.478 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-17T03:33:04.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.478 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-17T03:33:04.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.478 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-17T03:33:04.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.478 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-17T03:33:04.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.478 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-17T03:33:04.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.479 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-17T03:33:04.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.737442+0000', 'last_change': '2024-09-17T03:32:58.737442+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.737442+0000', 'last_undegraded': '2024-09-17T03:32:58.737442+0000', 'last_fullsized': '2024-09-17T03:32:58.737442+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:33:04.479 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-17T03:33:04.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.479 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-17T03:33:04.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.738149+0000', 'last_change': '2024-09-17T03:32:58.738149+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.738149+0000', 'last_undegraded': '2024-09-17T03:32:58.738149+0000', 'last_fullsized': '2024-09-17T03:32:58.738149+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:33:04.479 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-17T03:33:04.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.479 INFO:tasks.ceph.ceph_manager.ceph:PG 2.15 is not active+clean 2024-09-17T03:33:04.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.742971+0000', 'last_change': '2024-09-17T03:32:58.742971+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.742971+0000', 'last_undegraded': '2024-09-17T03:32:58.742971+0000', 'last_fullsized': '2024-09-17T03:32:58.742971+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:33:04.480 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-17T03:33:04.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.480 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-17T03:33:04.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.737436+0000', 'last_change': '2024-09-17T03:32:58.737436+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.737436+0000', 'last_undegraded': '2024-09-17T03:32:58.737436+0000', 'last_fullsized': '2024-09-17T03:32:58.737436+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:33:04.480 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-17T03:33:04.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.480 INFO:tasks.ceph.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-17T03:33:04.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.739792+0000', 'last_change': '2024-09-17T03:32:58.739792+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.739792+0000', 'last_undegraded': '2024-09-17T03:32:58.739792+0000', 'last_fullsized': '2024-09-17T03:32:58.739792+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:33:04.480 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-17T03:33:04.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.481 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-17T03:33:04.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.481 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-17T03:33:04.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.737437+0000', 'last_change': '2024-09-17T03:32:58.737437+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.737437+0000', 'last_undegraded': '2024-09-17T03:32:58.737437+0000', 'last_fullsized': '2024-09-17T03:32:58.737437+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:33:04.481 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-17T03:33:04.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.481 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-17T03:33:04.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.738740+0000', 'last_change': '2024-09-17T03:32:58.738740+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.738740+0000', 'last_undegraded': '2024-09-17T03:32:58.738740+0000', 'last_fullsized': '2024-09-17T03:32:58.738740+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:33:04.481 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-17T03:33:04.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.736807+0000', 'last_change': '2024-09-17T03:32:58.736807+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.736807+0000', 'last_undegraded': '2024-09-17T03:32:58.736807+0000', 'last_fullsized': '2024-09-17T03:32:58.736807+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.738880+0000', 'last_change': '2024-09-17T03:32:58.738880+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.738880+0000', 'last_undegraded': '2024-09-17T03:32:58.738880+0000', 'last_fullsized': '2024-09-17T03:32:58.738880+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:PG 2.d is not active+clean 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.741944+0000', 'last_change': '2024-09-17T03:32:58.741944+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.741944+0000', 'last_undegraded': '2024-09-17T03:32:58.741944+0000', 'last_fullsized': '2024-09-17T03:32:58.741944+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-17T03:33:04.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.739034+0000', 'last_change': '2024-09-17T03:32:58.739034+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.739034+0000', 'last_undegraded': '2024-09-17T03:32:58.739034+0000', 'last_fullsized': '2024-09-17T03:32:58.739034+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.740270+0000', 'last_change': '2024-09-17T03:32:58.740270+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.740270+0000', 'last_undegraded': '2024-09-17T03:32:58.740270+0000', 'last_fullsized': '2024-09-17T03:32:58.740270+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.738725+0000', 'last_change': '2024-09-17T03:32:58.738725+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.738725+0000', 'last_undegraded': '2024-09-17T03:32:58.738725+0000', 'last_fullsized': '2024-09-17T03:32:58.738725+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-17T03:33:04.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.484 INFO:tasks.ceph.ceph_manager.ceph:PG 2.4 is not active+clean 2024-09-17T03:33:04.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.743085+0000', 'last_change': '2024-09-17T03:32:58.743085+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.743085+0000', 'last_undegraded': '2024-09-17T03:32:58.743085+0000', 'last_fullsized': '2024-09-17T03:32:58.743085+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:33:04.484 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-17T03:33:04.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.740409+0000', 'last_change': '2024-09-17T03:32:58.740409+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.740409+0000', 'last_undegraded': '2024-09-17T03:32:58.740409+0000', 'last_fullsized': '2024-09-17T03:32:58.740409+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:33:04.484 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-17T03:33:04.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.484 INFO:tasks.ceph.ceph_manager.ceph:PG 2.6 is not active+clean 2024-09-17T03:33:04.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.742325+0000', 'last_change': '2024-09-17T03:32:58.742325+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.742325+0000', 'last_undegraded': '2024-09-17T03:32:58.742325+0000', 'last_fullsized': '2024-09-17T03:32:58.742325+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:33:04.484 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-17T03:33:04.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.737604+0000', 'last_change': '2024-09-17T03:32:58.737604+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.737604+0000', 'last_undegraded': '2024-09-17T03:32:58.737604+0000', 'last_fullsized': '2024-09-17T03:32:58.737604+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:33:04.484 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-17T03:33:04.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.485 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-17T03:33:04.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.740869+0000', 'last_change': '2024-09-17T03:32:58.740869+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.740869+0000', 'last_undegraded': '2024-09-17T03:32:58.740869+0000', 'last_fullsized': '2024-09-17T03:32:58.740869+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:33:04.485 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-17T03:33:04.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.485 INFO:tasks.ceph.ceph_manager.ceph:PG 2.9 is not active+clean 2024-09-17T03:33:04.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.741868+0000', 'last_change': '2024-09-17T03:32:58.741868+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.741868+0000', 'last_undegraded': '2024-09-17T03:32:58.741868+0000', 'last_fullsized': '2024-09-17T03:32:58.741868+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:33:04.485 INFO:tasks.ceph.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-17T03:33:04.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.742366+0000', 'last_change': '2024-09-17T03:32:58.742366+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.742366+0000', 'last_undegraded': '2024-09-17T03:32:58.742366+0000', 'last_fullsized': '2024-09-17T03:32:58.742366+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:33:04.485 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-17T03:33:04.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.740380+0000', 'last_change': '2024-09-17T03:32:58.740380+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.740380+0000', 'last_undegraded': '2024-09-17T03:32:58.740380+0000', 'last_fullsized': '2024-09-17T03:32:58.740380+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:33:04.486 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-17T03:33:04.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.486 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-17T03:33:04.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.740308+0000', 'last_change': '2024-09-17T03:32:58.740308+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.740308+0000', 'last_undegraded': '2024-09-17T03:32:58.740308+0000', 'last_fullsized': '2024-09-17T03:32:58.740308+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:33:04.486 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-17T03:33:04.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.741019+0000', 'last_change': '2024-09-17T03:32:58.741019+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.741019+0000', 'last_undegraded': '2024-09-17T03:32:58.741019+0000', 'last_fullsized': '2024-09-17T03:32:58.741019+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:33:04.486 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-17T03:33:04.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:32:59.734187+0000', 'last_change': '2024-09-17T03:32:59.734187+0000', 'last_active': '2024-09-17T03:32:59.734187+0000', 'last_peered': '2024-09-17T03:32:59.734187+0000', 'last_clean': '2024-09-17T03:32:59.734187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:59.734187+0000', 'last_undegraded': '2024-09-17T03:32:59.734187+0000', 'last_fullsized': '2024-09-17T03:32:59.734187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:59.734187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:04.486 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1f is not active+clean 2024-09-17T03:33:04.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:32:58.740499+0000', 'last_change': '2024-09-17T03:32:58.740499+0000', 'last_active': '2024-09-17T03:32:58.728820+0000', 'last_peered': '2024-09-17T03:32:58.728820+0000', 'last_clean': '2024-09-17T03:32:58.728820+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:32:58.740499+0000', 'last_undegraded': '2024-09-17T03:32:58.740499+0000', 'last_fullsized': '2024-09-17T03:32:58.740499+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'last_clean_scrub_stamp': '2024-09-17T03:32:58.728820+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:33:04.487 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:33:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.624+0000 7fe1e4abd640 1 -- 172.21.15.146:0/68983632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e01631a0 msgr2=0x7fe1e00cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.624+0000 7fe1e4abd640 1 --2- 172.21.15.146:0/68983632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e01631a0 0x7fe1e00cef40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4005fd0 tx=0x7fe1d402a540 comp rx=0 tx=0).stop 2024-09-17T03:33:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.625+0000 7fe1e4abd640 1 -- 172.21.15.146:0/68983632 shutdown_connections 2024-09-17T03:33:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.625+0000 7fe1e4abd640 1 --2- 172.21.15.146:0/68983632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e01631a0 0x7fe1e00cef40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.625+0000 7fe1e4abd640 1 --2- 172.21.15.146:0/68983632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e015f1a0 0x7fe1e00cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.625+0000 7fe1e4abd640 1 -- 172.21.15.146:0/68983632 >> 172.21.15.146:0/68983632 conn(0x7fe1e00d11f0 msgr2=0x7fe1e00d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:04.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.625+0000 7fe1e4abd640 1 -- 172.21.15.146:0/68983632 shutdown_connections 2024-09-17T03:33:04.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.625+0000 7fe1e4abd640 1 -- 172.21.15.146:0/68983632 wait complete. 2024-09-17T03:33:04.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.627+0000 7fe1e4abd640 1 Processor -- start 2024-09-17T03:33:04.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.627+0000 7fe1e4abd640 1 -- start start 2024-09-17T03:33:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1e4abd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e00b61f0 0x7fe1e01f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1e4abd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e015f1a0 0x7fe1e00b9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1e4abd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e01631a0 0x7fe1e01f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1e4abd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e00695b0 con 0x7fe1e01631a0 2024-09-17T03:33:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1e4abd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0069430 con 0x7fe1e00b61f0 2024-09-17T03:33:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1e4abd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e0069730 con 0x7fe1e015f1a0 2024-09-17T03:33:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1ded9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e01631a0 0x7fe1e01f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1ded9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e01631a0 0x7fe1e01f2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59628/0 (socket says 172.21.15.146:59628) 2024-09-17T03:33:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1ded9d640 1 -- 172.21.15.146:0/542008935 learned_addr learned my addr 172.21.15.146:0/542008935 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1de59c640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e00b61f0 0x7fe1e01f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1ddd9b640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e015f1a0 0x7fe1e00b9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1ded9d640 1 -- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e015f1a0 msgr2=0x7fe1e00b9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1ded9d640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e015f1a0 0x7fe1e00b9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1ded9d640 1 -- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e00b61f0 msgr2=0x7fe1e01f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1ded9d640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e00b61f0 0x7fe1e01f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1ded9d640 1 -- 172.21.15.146:0/542008935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e015a950 con 0x7fe1e01631a0 2024-09-17T03:33:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.628+0000 7fe1ded9d640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e01631a0 0x7fe1e01f2930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800c700 tx=0x7fe1d800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.629+0000 7fe1ceffd640 1 -- 172.21.15.146:0/542008935 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8003b70 con 0x7fe1e01631a0 2024-09-17T03:33:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.629+0000 7fe1ceffd640 1 -- 172.21.15.146:0/542008935 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1d8003d10 con 0x7fe1e01631a0 2024-09-17T03:33:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.629+0000 7fe1e4abd640 1 -- 172.21.15.146:0/542008935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e00c8440 con 0x7fe1e01631a0 2024-09-17T03:33:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.629+0000 7fe1ceffd640 1 -- 172.21.15.146:0/542008935 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800aab0 con 0x7fe1e01631a0 2024-09-17T03:33:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.629+0000 7fe1e4abd640 1 -- 172.21.15.146:0/542008935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e01f61b0 con 0x7fe1e01631a0 2024-09-17T03:33:04.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.630+0000 7fe1e4abd640 1 -- 172.21.15.146:0/542008935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e0069be0 con 0x7fe1e01631a0 2024-09-17T03:33:04.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.630+0000 7fe1ceffd640 1 -- 172.21.15.146:0/542008935 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1d800ac50 con 0x7fe1e01631a0 2024-09-17T03:33:04.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.631+0000 7fe1ceffd640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1c0078bc0 0x7fe1c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:04.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.631+0000 7fe1ceffd640 1 -- 172.21.15.146:0/542008935 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe1d809a9b0 con 0x7fe1e01631a0 2024-09-17T03:33:04.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.631+0000 7fe1de59c640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1c0078bc0 0x7fe1c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:04.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.631+0000 7fe1de59c640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1c0078bc0 0x7fe1c007b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0004630 tx=0x7fe1d000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:04.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.635+0000 7fe1ceffd640 1 -- 172.21.15.146:0/542008935 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe1d80627a0 con 0x7fe1e01631a0 2024-09-17T03:33:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.882+0000 7fe1e4abd640 1 -- 172.21.15.146:0/542008935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe1e00c7ff0 con 0x7fe1e01631a0 2024-09-17T03:33:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.883+0000 7fe1ceffd640 1 -- 172.21.15.146:0/542008935 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1150 (secure 0 0 0) 0x7fe1d80671d0 con 0x7fe1e01631a0 2024-09-17T03:33:04.883 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:04.883 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":41},{"state_name":"active+clean","count":32},{"state_name":"creating+peering","count":24}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224051200,"bytes_avail":772870062080,"bytes_total":773094113280,"unknown_pgs_ratio":0.42268040776252747,"inactive_pgs_ratio":0.24742268025875092},"fsmap":{"epoch":6,"btime":"2024-09-17T03:33:02:765358+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4396}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-17T03:32:35.463831+0000","services":{}},"progress_events":{}} 2024-09-17T03:33:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 -- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1c0078bc0 msgr2=0x7fe1c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1c0078bc0 0x7fe1c007b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0004630 tx=0x7fe1d000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 -- 172.21.15.146:0/542008935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e01631a0 msgr2=0x7fe1e01f2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e01631a0 0x7fe1e01f2930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800c700 tx=0x7fe1d800cbc0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 -- 172.21.15.146:0/542008935 shutdown_connections 2024-09-17T03:33:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1c0078bc0 0x7fe1c007b0d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1e01631a0 0x7fe1e01f2930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1e015f1a0 0x7fe1e00b9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 --2- 172.21.15.146:0/542008935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e00b61f0 0x7fe1e01f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 -- 172.21.15.146:0/542008935 >> 172.21.15.146:0/542008935 conn(0x7fe1e00d11f0 msgr2=0x7fe1e00b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 -- 172.21.15.146:0/542008935 shutdown_connections 2024-09-17T03:33:04.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:04.885+0000 7fe1e4abd640 1 -- 172.21.15.146:0/542008935 wait complete. 2024-09-17T03:33:04.896 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:33:04.896 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:05.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.008+0000 7f912d313640 1 -- 172.21.15.146:0/2385359874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912806cc50 msgr2=0x7f912806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:05.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.008+0000 7f912d313640 1 --2- 172.21.15.146:0/2385359874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912806cc50 0x7f912806d060 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9110009900 tx=0x7f911002a580 comp rx=0 tx=0).stop 2024-09-17T03:33:05.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.008+0000 7f912d313640 1 -- 172.21.15.146:0/2385359874 shutdown_connections 2024-09-17T03:33:05.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.008+0000 7f912d313640 1 --2- 172.21.15.146:0/2385359874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912806cc50 0x7f912806d060 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:05.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.008+0000 7f912d313640 1 -- 172.21.15.146:0/2385359874 >> 172.21.15.146:0/2385359874 conn(0x7f912806dd60 msgr2=0x7f912806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:05.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.008+0000 7f912d313640 1 -- 172.21.15.146:0/2385359874 shutdown_connections 2024-09-17T03:33:05.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.008+0000 7f912d313640 1 -- 172.21.15.146:0/2385359874 wait complete. 2024-09-17T03:33:05.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.010+0000 7f912d313640 1 Processor -- start 2024-09-17T03:33:05.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.010+0000 7f912d313640 1 -- start start 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.011+0000 7f912d313640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f912806cc50 0x7f9128154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.011+0000 7f912d313640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912806fbf0 0x7f9128154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.011+0000 7f912d313640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912815d8a0 0x7f91280b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.011+0000 7f912d313640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9128070710 con 0x7f912815d8a0 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.011+0000 7f912d313640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9128073c80 con 0x7f912806cc50 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.011+0000 7f912d313640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9128070890 con 0x7f912806fbf0 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.011+0000 7f91277fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912815d8a0 0x7f91280b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.011+0000 7f91277fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912815d8a0 0x7f91280b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59654/0 (socket says 172.21.15.146:59654) 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.011+0000 7f91277fe640 1 -- 172.21.15.146:0/1837465627 learned_addr learned my addr 172.21.15.146:0/1837465627 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f9126ffd640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f912806cc50 0x7f9128154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f911e7fc640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912806fbf0 0x7f9128154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f91277fe640 1 -- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912806fbf0 msgr2=0x7f9128154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:05.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f91277fe640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912806fbf0 0x7f9128154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:05.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f91277fe640 1 -- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f912806cc50 msgr2=0x7f9128154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:05.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f91277fe640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f912806cc50 0x7f9128154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:05.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f91277fe640 1 -- 172.21.15.146:0/1837465627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91281f7160 con 0x7f912815d8a0 2024-09-17T03:33:05.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f911e7fc640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912806fbf0 0x7f9128154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:05.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f91277fe640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912815d8a0 0x7f91280b3540 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f912000c730 tx=0x7f912000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:05.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f911ffff640 1 -- 172.21.15.146:0/1837465627 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120003b70 con 0x7f912815d8a0 2024-09-17T03:33:05.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f911ffff640 1 -- 172.21.15.146:0/1837465627 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9120003d10 con 0x7f912815d8a0 2024-09-17T03:33:05.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f912d313640 1 -- 172.21.15.146:0/1837465627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91281f7440 con 0x7f912815d8a0 2024-09-17T03:33:05.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f911ffff640 1 -- 172.21.15.146:0/1837465627 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91200052d0 con 0x7f912815d8a0 2024-09-17T03:33:05.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.012+0000 7f912d313640 1 -- 172.21.15.146:0/1837465627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91280b32b0 con 0x7f912815d8a0 2024-09-17T03:33:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.013+0000 7f912d313640 1 -- 172.21.15.146:0/1837465627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91281f7830 con 0x7f912815d8a0 2024-09-17T03:33:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.014+0000 7f911ffff640 1 -- 172.21.15.146:0/1837465627 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9120005470 con 0x7f912815d8a0 2024-09-17T03:33:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.014+0000 7f911ffff640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9108078b90 0x7f910807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.014+0000 7f911ffff640 1 -- 172.21.15.146:0/1837465627 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f912009a9f0 con 0x7f912815d8a0 2024-09-17T03:33:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.015+0000 7f9126ffd640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9108078b90 0x7f910807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:05.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.015+0000 7f9126ffd640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9108078b90 0x7f910807b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9118000f60 tx=0x7f9118009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:05.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.019+0000 7f911ffff640 1 -- 172.21.15.146:0/1837465627 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f912806d5a0 con 0x7f912815d8a0 2024-09-17T03:33:05.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.188+0000 7f912d313640 1 -- 172.21.15.146:0/1837465627 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f912806d060 con 0x7f9108078b90 2024-09-17T03:33:05.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.193+0000 7f911ffff640 1 -- 172.21.15.146:0/1837465627 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243834 (secure 0 0 0) 0x7f912806d060 con 0x7f9108078b90 2024-09-17T03:33:05.195 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:05.196 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 -- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9108078b90 msgr2=0x7f910807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9108078b90 0x7f910807b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9118000f60 tx=0x7f9118009040 comp rx=0 tx=0).stop 2024-09-17T03:33:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 -- 172.21.15.146:0/1837465627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912815d8a0 msgr2=0x7f91280b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912815d8a0 0x7f91280b3540 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f912000c730 tx=0x7f912000cb30 comp rx=0 tx=0).stop 2024-09-17T03:33:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 -- 172.21.15.146:0/1837465627 shutdown_connections 2024-09-17T03:33:05.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9108078b90 0x7f910807b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f912815d8a0 0x7f91280b3540 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f912806fbf0 0x7f9128154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 --2- 172.21.15.146:0/1837465627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f912806cc50 0x7f9128154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 -- 172.21.15.146:0/1837465627 >> 172.21.15.146:0/1837465627 conn(0x7f912806dd60 msgr2=0x7f9128159710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 -- 172.21.15.146:0/1837465627 shutdown_connections 2024-09-17T03:33:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:05.196+0000 7f912d313640 1 -- 172.21.15.146:0/1837465627 wait complete. 2024-09-17T03:33:05.207 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T03:33:03.789703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218800,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755920,"statfs":{"total":773094113280,"available":772870062080,"internally_reserved":0,"allocated":2629632,"data_stored":1636197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.054810"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771728+0000","last_change":"2024-09-17T03:33:00.778126+0000","last_active":"2024-09-17T03:33:01.771728+0000","last_peered":"2024-09-17T03:33:01.771728+0000","last_clean":"2024-09-17T03:33:01.771728+0000","last_became_active":"2024-09-17T03:33:00.777760+0000","last_became_peered":"2024-09-17T03:33:00.777760+0000","last_unstale":"2024-09-17T03:33:01.771728+0000","last_undegraded":"2024-09-17T03:33:01.771728+0000","last_fullsized":"2024-09-17T03:33:01.771728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:48.841807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771542+0000","last_change":"2024-09-17T03:33:00.772869+0000","last_active":"2024-09-17T03:33:01.771542+0000","last_peered":"2024-09-17T03:33:01.771542+0000","last_clean":"2024-09-17T03:33:01.771542+0000","last_became_active":"2024-09-17T03:33:00.772517+0000","last_became_peered":"2024-09-17T03:33:00.772517+0000","last_unstale":"2024-09-17T03:33:01.771542+0000","last_undegraded":"2024-09-17T03:33:01.771542+0000","last_fullsized":"2024-09-17T03:33:01.771542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:19.582453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829349+0000","last_change":"2024-09-17T03:33:00.780226+0000","last_active":"2024-09-17T03:33:01.829349+0000","last_peered":"2024-09-17T03:33:01.829349+0000","last_clean":"2024-09-17T03:33:01.829349+0000","last_became_active":"2024-09-17T03:33:00.779937+0000","last_became_peered":"2024-09-17T03:33:00.779937+0000","last_unstale":"2024-09-17T03:33:01.829349+0000","last_undegraded":"2024-09-17T03:33:01.829349+0000","last_fullsized":"2024-09-17T03:33:01.829349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:23.843836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828003+0000","last_change":"2024-09-17T03:33:00.774115+0000","last_active":"2024-09-17T03:33:01.828003+0000","last_peered":"2024-09-17T03:33:01.828003+0000","last_clean":"2024-09-17T03:33:01.828003+0000","last_became_active":"2024-09-17T03:33:00.773803+0000","last_became_peered":"2024-09-17T03:33:00.773803+0000","last_unstale":"2024-09-17T03:33:01.828003+0000","last_undegraded":"2024-09-17T03:33:01.828003+0000","last_fullsized":"2024-09-17T03:33:01.828003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:13.109575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770738+0000","last_change":"2024-09-17T03:33:00.771303+0000","last_active":"2024-09-17T03:33:01.770738+0000","last_peered":"2024-09-17T03:33:01.770738+0000","last_clean":"2024-09-17T03:33:01.770738+0000","last_became_active":"2024-09-17T03:33:00.770971+0000","last_became_peered":"2024-09-17T03:33:00.770971+0000","last_unstale":"2024-09-17T03:33:01.770738+0000","last_undegraded":"2024-09-17T03:33:01.770738+0000","last_fullsized":"2024-09-17T03:33:01.770738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:31.492292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771440+0000","last_change":"2024-09-17T03:33:00.783198+0000","last_active":"2024-09-17T03:33:01.771440+0000","last_peered":"2024-09-17T03:33:01.771440+0000","last_clean":"2024-09-17T03:33:01.771440+0000","last_became_active":"2024-09-17T03:33:00.782880+0000","last_became_peered":"2024-09-17T03:33:00.782880+0000","last_unstale":"2024-09-17T03:33:01.771440+0000","last_undegraded":"2024-09-17T03:33:01.771440+0000","last_fullsized":"2024-09-17T03:33:01.771440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:54.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772159+0000","last_change":"2024-09-17T03:33:00.785690+0000","last_active":"2024-09-17T03:33:01.772159+0000","last_peered":"2024-09-17T03:33:01.772159+0000","last_clean":"2024-09-17T03:33:01.772159+0000","last_became_active":"2024-09-17T03:33:00.785379+0000","last_became_peered":"2024-09-17T03:33:00.785379+0000","last_unstale":"2024-09-17T03:33:01.772159+0000","last_undegraded":"2024-09-17T03:33:01.772159+0000","last_fullsized":"2024-09-17T03:33:01.772159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:23.348736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829110+0000","last_change":"2024-09-17T03:33:00.771812+0000","last_active":"2024-09-17T03:33:01.829110+0000","last_peered":"2024-09-17T03:33:01.829110+0000","last_clean":"2024-09-17T03:33:01.829110+0000","last_became_active":"2024-09-17T03:33:00.771519+0000","last_became_peered":"2024-09-17T03:33:00.771519+0000","last_unstale":"2024-09-17T03:33:01.829110+0000","last_undegraded":"2024-09-17T03:33:01.829110+0000","last_fullsized":"2024-09-17T03:33:01.829110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:35.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771263+0000","last_change":"2024-09-17T03:33:00.775473+0000","last_active":"2024-09-17T03:33:01.771263+0000","last_peered":"2024-09-17T03:33:01.771263+0000","last_clean":"2024-09-17T03:33:01.771263+0000","last_became_active":"2024-09-17T03:33:00.775162+0000","last_became_peered":"2024-09-17T03:33:00.775162+0000","last_unstale":"2024-09-17T03:33:01.771263+0000","last_undegraded":"2024-09-17T03:33:01.771263+0000","last_fullsized":"2024-09-17T03:33:01.771263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:46.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828630+0000","last_change":"2024-09-17T03:33:00.769652+0000","last_active":"2024-09-17T03:33:01.828630+0000","last_peered":"2024-09-17T03:33:01.828630+0000","last_clean":"2024-09-17T03:33:01.828630+0000","last_became_active":"2024-09-17T03:33:00.769304+0000","last_became_peered":"2024-09-17T03:33:00.769304+0000","last_unstale":"2024-09-17T03:33:01.828630+0000","last_undegraded":"2024-09-17T03:33:01.828630+0000","last_fullsized":"2024-09-17T03:33:01.828630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:57.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828353+0000","last_change":"2024-09-17T03:33:00.767896+0000","last_active":"2024-09-17T03:33:01.828353+0000","last_peered":"2024-09-17T03:33:01.828353+0000","last_clean":"2024-09-17T03:33:01.828353+0000","last_became_active":"2024-09-17T03:33:00.766950+0000","last_became_peered":"2024-09-17T03:33:00.766950+0000","last_unstale":"2024-09-17T03:33:01.828353+0000","last_undegraded":"2024-09-17T03:33:01.828353+0000","last_fullsized":"2024-09-17T03:33:01.828353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:06.893972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771900+0000","last_change":"2024-09-17T03:33:00.772070+0000","last_active":"2024-09-17T03:33:01.771900+0000","last_peered":"2024-09-17T03:33:01.771900+0000","last_clean":"2024-09-17T03:33:01.771900+0000","last_became_active":"2024-09-17T03:33:00.771721+0000","last_became_peered":"2024-09-17T03:33:00.771721+0000","last_unstale":"2024-09-17T03:33:01.771900+0000","last_undegraded":"2024-09-17T03:33:01.771900+0000","last_fullsized":"2024-09-17T03:33:01.771900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:27.987451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828369+0000","last_change":"2024-09-17T03:32:59.762042+0000","last_active":"2024-09-17T03:33:01.828369+0000","last_peered":"2024-09-17T03:33:01.828369+0000","last_clean":"2024-09-17T03:33:01.828369+0000","last_became_active":"2024-09-17T03:32:59.761644+0000","last_became_peered":"2024-09-17T03:32:59.761644+0000","last_unstale":"2024-09-17T03:33:01.828369+0000","last_undegraded":"2024-09-17T03:33:01.828369+0000","last_fullsized":"2024-09-17T03:33:01.828369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:05.070599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737442+0000","last_change":"2024-09-17T03:32:58.737442+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737442+0000","last_undegraded":"2024-09-17T03:32:58.737442+0000","last_fullsized":"2024-09-17T03:32:58.737442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829218+0000","last_change":"2024-09-17T03:32:59.758058+0000","last_active":"2024-09-17T03:33:01.829218+0000","last_peered":"2024-09-17T03:33:01.829218+0000","last_clean":"2024-09-17T03:33:01.829218+0000","last_became_active":"2024-09-17T03:32:59.757687+0000","last_became_peered":"2024-09-17T03:32:59.757687+0000","last_unstale":"2024-09-17T03:33:01.829218+0000","last_undegraded":"2024-09-17T03:33:01.829218+0000","last_fullsized":"2024-09-17T03:33:01.829218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827893+0000","last_change":"2024-09-17T03:33:00.770901+0000","last_active":"2024-09-17T03:33:01.827893+0000","last_peered":"2024-09-17T03:33:01.827893+0000","last_clean":"2024-09-17T03:33:01.827893+0000","last_became_active":"2024-09-17T03:33:00.770616+0000","last_became_peered":"2024-09-17T03:33:00.770616+0000","last_unstale":"2024-09-17T03:33:01.827893+0000","last_undegraded":"2024-09-17T03:33:01.827893+0000","last_fullsized":"2024-09-17T03:33:01.827893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:30.089705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770904+0000","last_change":"2024-09-17T03:32:59.754649+0000","last_active":"2024-09-17T03:33:01.770904+0000","last_peered":"2024-09-17T03:33:01.770904+0000","last_clean":"2024-09-17T03:33:01.770904+0000","last_became_active":"2024-09-17T03:32:59.754136+0000","last_became_peered":"2024-09-17T03:32:59.754136+0000","last_unstale":"2024-09-17T03:33:01.770904+0000","last_undegraded":"2024-09-17T03:33:01.770904+0000","last_fullsized":"2024-09-17T03:33:01.770904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738149+0000","last_change":"2024-09-17T03:32:58.738149+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738149+0000","last_undegraded":"2024-09-17T03:32:58.738149+0000","last_fullsized":"2024-09-17T03:32:58.738149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770975+0000","last_change":"2024-09-17T03:33:00.783600+0000","last_active":"2024-09-17T03:33:01.770975+0000","last_peered":"2024-09-17T03:33:01.770975+0000","last_clean":"2024-09-17T03:33:01.770975+0000","last_became_active":"2024-09-17T03:33:00.783299+0000","last_became_peered":"2024-09-17T03:33:00.783299+0000","last_unstale":"2024-09-17T03:33:01.770975+0000","last_undegraded":"2024-09-17T03:33:01.770975+0000","last_fullsized":"2024-09-17T03:33:01.770975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:44.836032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771087+0000","last_change":"2024-09-17T03:32:59.756949+0000","last_active":"2024-09-17T03:33:01.771087+0000","last_peered":"2024-09-17T03:33:01.771087+0000","last_clean":"2024-09-17T03:33:01.771087+0000","last_became_active":"2024-09-17T03:32:59.756555+0000","last_became_peered":"2024-09-17T03:32:59.756555+0000","last_unstale":"2024-09-17T03:33:01.771087+0000","last_undegraded":"2024-09-17T03:33:01.771087+0000","last_fullsized":"2024-09-17T03:33:01.771087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:41.461451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742971+0000","last_change":"2024-09-17T03:32:58.742971+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742971+0000","last_undegraded":"2024-09-17T03:32:58.742971+0000","last_fullsized":"2024-09-17T03:32:58.742971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737436+0000","last_change":"2024-09-17T03:32:58.737436+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737436+0000","last_undegraded":"2024-09-17T03:32:58.737436+0000","last_fullsized":"2024-09-17T03:32:58.737436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.739792+0000","last_change":"2024-09-17T03:32:58.739792+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.739792+0000","last_undegraded":"2024-09-17T03:32:58.739792+0000","last_fullsized":"2024-09-17T03:32:58.739792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772126+0000","last_change":"2024-09-17T03:32:59.760715+0000","last_active":"2024-09-17T03:33:01.772126+0000","last_peered":"2024-09-17T03:33:01.772126+0000","last_clean":"2024-09-17T03:33:01.772126+0000","last_became_active":"2024-09-17T03:32:59.760384+0000","last_became_peered":"2024-09-17T03:32:59.760384+0000","last_unstale":"2024-09-17T03:33:01.772126+0000","last_undegraded":"2024-09-17T03:33:01.772126+0000","last_fullsized":"2024-09-17T03:33:01.772126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:12.647154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737437+0000","last_change":"2024-09-17T03:32:58.737437+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737437+0000","last_undegraded":"2024-09-17T03:32:58.737437+0000","last_fullsized":"2024-09-17T03:32:58.737437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738740+0000","last_change":"2024-09-17T03:32:58.738740+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738740+0000","last_undegraded":"2024-09-17T03:32:58.738740+0000","last_fullsized":"2024-09-17T03:32:58.738740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.736807+0000","last_change":"2024-09-17T03:32:58.736807+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.736807+0000","last_undegraded":"2024-09-17T03:32:58.736807+0000","last_fullsized":"2024-09-17T03:32:58.736807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738880+0000","last_change":"2024-09-17T03:32:58.738880+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738880+0000","last_undegraded":"2024-09-17T03:32:58.738880+0000","last_fullsized":"2024-09-17T03:32:58.738880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741944+0000","last_change":"2024-09-17T03:32:58.741944+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741944+0000","last_undegraded":"2024-09-17T03:32:58.741944+0000","last_fullsized":"2024-09-17T03:32:58.741944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771993+0000","last_change":"2024-09-17T03:33:00.776604+0000","last_active":"2024-09-17T03:33:01.771993+0000","last_peered":"2024-09-17T03:33:01.771993+0000","last_clean":"2024-09-17T03:33:01.771993+0000","last_became_active":"2024-09-17T03:33:00.776020+0000","last_became_peered":"2024-09-17T03:33:00.776020+0000","last_unstale":"2024-09-17T03:33:01.771993+0000","last_undegraded":"2024-09-17T03:33:01.771993+0000","last_fullsized":"2024-09-17T03:33:01.771993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:06.411768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.739034+0000","last_change":"2024-09-17T03:32:58.739034+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.739034+0000","last_undegraded":"2024-09-17T03:32:58.739034+0000","last_fullsized":"2024-09-17T03:32:58.739034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T03:32:58.741533+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:32:58.741533+0000","last_peered":"2024-09-17T03:32:58.741533+0000","last_clean":"2024-09-17T03:32:58.741533+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:32:58.741533+0000","last_undegraded":"2024-09-17T03:32:58.741533+0000","last_fullsized":"2024-09-17T03:32:58.741533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771026+0000","last_change":"2024-09-17T03:32:59.755210+0000","last_active":"2024-09-17T03:33:01.771026+0000","last_peered":"2024-09-17T03:33:01.771026+0000","last_clean":"2024-09-17T03:33:01.771026+0000","last_became_active":"2024-09-17T03:32:59.753607+0000","last_became_peered":"2024-09-17T03:32:59.753607+0000","last_unstale":"2024-09-17T03:33:01.771026+0000","last_undegraded":"2024-09-17T03:33:01.771026+0000","last_fullsized":"2024-09-17T03:33:01.771026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829325+0000","last_change":"2024-09-17T03:33:00.780277+0000","last_active":"2024-09-17T03:33:01.829325+0000","last_peered":"2024-09-17T03:33:01.829325+0000","last_clean":"2024-09-17T03:33:01.829325+0000","last_became_active":"2024-09-17T03:33:00.780008+0000","last_became_peered":"2024-09-17T03:33:00.780008+0000","last_unstale":"2024-09-17T03:33:01.829325+0000","last_undegraded":"2024-09-17T03:33:01.829325+0000","last_fullsized":"2024-09-17T03:33:01.829325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:56.218073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740270+0000","last_change":"2024-09-17T03:32:58.740270+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740270+0000","last_undegraded":"2024-09-17T03:32:58.740270+0000","last_fullsized":"2024-09-17T03:32:58.740270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.738725+0000","last_change":"2024-09-17T03:32:58.738725+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.738725+0000","last_undegraded":"2024-09-17T03:32:58.738725+0000","last_fullsized":"2024-09-17T03:32:58.738725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772200+0000","last_change":"2024-09-17T03:32:59.753138+0000","last_active":"2024-09-17T03:33:01.772200+0000","last_peered":"2024-09-17T03:33:01.772200+0000","last_clean":"2024-09-17T03:33:01.772200+0000","last_became_active":"2024-09-17T03:32:59.752828+0000","last_became_peered":"2024-09-17T03:32:59.752828+0000","last_unstale":"2024-09-17T03:33:01.772200+0000","last_undegraded":"2024-09-17T03:33:01.772200+0000","last_fullsized":"2024-09-17T03:33:01.772200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:06.735843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.743085+0000","last_change":"2024-09-17T03:32:58.743085+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.743085+0000","last_undegraded":"2024-09-17T03:32:58.743085+0000","last_fullsized":"2024-09-17T03:32:58.743085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772112+0000","last_change":"2024-09-17T03:33:00.771853+0000","last_active":"2024-09-17T03:33:01.772112+0000","last_peered":"2024-09-17T03:33:01.772112+0000","last_clean":"2024-09-17T03:33:01.772112+0000","last_became_active":"2024-09-17T03:33:00.771534+0000","last_became_peered":"2024-09-17T03:33:00.771534+0000","last_unstale":"2024-09-17T03:33:01.772112+0000","last_undegraded":"2024-09-17T03:33:01.772112+0000","last_fullsized":"2024-09-17T03:33:01.772112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:07.316072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740409+0000","last_change":"2024-09-17T03:32:58.740409+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740409+0000","last_undegraded":"2024-09-17T03:32:58.740409+0000","last_fullsized":"2024-09-17T03:32:58.740409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742325+0000","last_change":"2024-09-17T03:32:58.742325+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742325+0000","last_undegraded":"2024-09-17T03:32:58.742325+0000","last_fullsized":"2024-09-17T03:32:58.742325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828852+0000","last_change":"2024-09-17T03:33:00.777441+0000","last_active":"2024-09-17T03:33:01.828852+0000","last_peered":"2024-09-17T03:33:01.828852+0000","last_clean":"2024-09-17T03:33:01.828852+0000","last_became_active":"2024-09-17T03:33:00.777102+0000","last_became_peered":"2024-09-17T03:33:00.777102+0000","last_unstale":"2024-09-17T03:33:01.828852+0000","last_undegraded":"2024-09-17T03:33:01.828852+0000","last_fullsized":"2024-09-17T03:33:01.828852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.389271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.737604+0000","last_change":"2024-09-17T03:32:58.737604+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.737604+0000","last_undegraded":"2024-09-17T03:32:58.737604+0000","last_fullsized":"2024-09-17T03:32:58.737604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740869+0000","last_change":"2024-09-17T03:32:58.740869+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740869+0000","last_undegraded":"2024-09-17T03:32:58.740869+0000","last_fullsized":"2024-09-17T03:32:58.740869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741868+0000","last_change":"2024-09-17T03:32:58.741868+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741868+0000","last_undegraded":"2024-09-17T03:32:58.741868+0000","last_fullsized":"2024-09-17T03:32:58.741868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828140+0000","last_change":"2024-09-17T03:33:00.761340+0000","last_active":"2024-09-17T03:33:01.828140+0000","last_peered":"2024-09-17T03:33:01.828140+0000","last_clean":"2024-09-17T03:33:01.828140+0000","last_became_active":"2024-09-17T03:33:00.760617+0000","last_became_peered":"2024-09-17T03:33:00.760617+0000","last_unstale":"2024-09-17T03:33:01.828140+0000","last_undegraded":"2024-09-17T03:33:01.828140+0000","last_fullsized":"2024-09-17T03:33:01.828140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:17.573959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.742366+0000","last_change":"2024-09-17T03:32:58.742366+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.742366+0000","last_undegraded":"2024-09-17T03:32:58.742366+0000","last_fullsized":"2024-09-17T03:32:58.742366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828236+0000","last_change":"2024-09-17T03:33:00.773988+0000","last_active":"2024-09-17T03:33:01.828236+0000","last_peered":"2024-09-17T03:33:01.828236+0000","last_clean":"2024-09-17T03:33:01.828236+0000","last_became_active":"2024-09-17T03:33:00.773669+0000","last_became_peered":"2024-09-17T03:33:00.773669+0000","last_unstale":"2024-09-17T03:33:01.828236+0000","last_undegraded":"2024-09-17T03:33:01.828236+0000","last_fullsized":"2024-09-17T03:33:01.828236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:36.829010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740380+0000","last_change":"2024-09-17T03:32:58.740380+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740380+0000","last_undegraded":"2024-09-17T03:32:58.740380+0000","last_fullsized":"2024-09-17T03:32:58.740380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772055+0000","last_change":"2024-09-17T03:33:00.775407+0000","last_active":"2024-09-17T03:33:01.772055+0000","last_peered":"2024-09-17T03:33:01.772055+0000","last_clean":"2024-09-17T03:33:01.772055+0000","last_became_active":"2024-09-17T03:33:00.773657+0000","last_became_peered":"2024-09-17T03:33:00.773657+0000","last_unstale":"2024-09-17T03:33:01.772055+0000","last_undegraded":"2024-09-17T03:33:01.772055+0000","last_fullsized":"2024-09-17T03:33:01.772055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:18.984982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740308+0000","last_change":"2024-09-17T03:32:58.740308+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740308+0000","last_undegraded":"2024-09-17T03:32:58.740308+0000","last_fullsized":"2024-09-17T03:32:58.740308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771973+0000","last_change":"2024-09-17T03:33:00.777352+0000","last_active":"2024-09-17T03:33:01.771973+0000","last_peered":"2024-09-17T03:33:01.771973+0000","last_clean":"2024-09-17T03:33:01.771973+0000","last_became_active":"2024-09-17T03:33:00.777033+0000","last_became_peered":"2024-09-17T03:33:00.777033+0000","last_unstale":"2024-09-17T03:33:01.771973+0000","last_undegraded":"2024-09-17T03:33:01.771973+0000","last_fullsized":"2024-09-17T03:33:01.771973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:46.197387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.741019+0000","last_change":"2024-09-17T03:32:58.741019+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.741019+0000","last_undegraded":"2024-09-17T03:32:58.741019+0000","last_fullsized":"2024-09-17T03:32:58.741019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:32:59.734187+0000","last_change":"2024-09-17T03:32:59.734187+0000","last_active":"2024-09-17T03:32:59.734187+0000","last_peered":"2024-09-17T03:32:59.734187+0000","last_clean":"2024-09-17T03:32:59.734187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:59.734187+0000","last_undegraded":"2024-09-17T03:32:59.734187+0000","last_fullsized":"2024-09-17T03:32:59.734187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828382+0000","last_change":"2024-09-17T03:32:59.763107+0000","last_active":"2024-09-17T03:33:01.828382+0000","last_peered":"2024-09-17T03:33:01.828382+0000","last_clean":"2024-09-17T03:33:01.828382+0000","last_became_active":"2024-09-17T03:32:59.762811+0000","last_became_peered":"2024-09-17T03:32:59.762811+0000","last_unstale":"2024-09-17T03:33:01.828382+0000","last_undegraded":"2024-09-17T03:33:01.828382+0000","last_fullsized":"2024-09-17T03:33:01.828382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828252+0000","last_change":"2024-09-17T03:33:00.774953+0000","last_active":"2024-09-17T03:33:01.828252+0000","last_peered":"2024-09-17T03:33:01.828252+0000","last_clean":"2024-09-17T03:33:01.828252+0000","last_became_active":"2024-09-17T03:33:00.773865+0000","last_became_peered":"2024-09-17T03:33:00.773865+0000","last_unstale":"2024-09-17T03:33:01.828252+0000","last_undegraded":"2024-09-17T03:33:01.828252+0000","last_fullsized":"2024-09-17T03:33:01.828252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:03.734959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T03:32:58.740499+0000","last_change":"2024-09-17T03:32:58.740499+0000","last_active":"2024-09-17T03:32:58.728820+0000","last_peered":"2024-09-17T03:32:58.728820+0000","last_clean":"2024-09-17T03:32:58.728820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:32:58.740499+0000","last_undegraded":"2024-09-17T03:32:58.740499+0000","last_fullsized":"2024-09-17T03:32:58.740499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":47580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":200704,"data_stored":66537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:05.729 INFO:tasks.ceph.mds.d.smithi179.stderr:2024-09-17T03:33:05.729+0000 7f8b86404640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:33:08.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.340+0000 7f7f5949b640 1 -- 172.21.15.146:0/3553298875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f40004d40 msgr2=0x7f7f40005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.340+0000 7f7f5949b640 1 --2- 172.21.15.146:0/3553298875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f40004d40 0x7f7f40005150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f540ba8e0 tx=0x7f7f40005830 comp rx=0 tx=0).stop 2024-09-17T03:33:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.340+0000 7f7f537fe640 1 -- 172.21.15.146:0/3553298875 reap_dead start 2024-09-17T03:33:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.340+0000 7f7f5949b640 1 -- 172.21.15.146:0/3553298875 shutdown_connections 2024-09-17T03:33:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.340+0000 7f7f5949b640 1 -- 172.21.15.146:0/3553298875 >> 172.21.15.146:0/3553298875 conn(0x7f7f540d11f0 msgr2=0x7f7f540d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.341+0000 7f7f5949b640 1 -- 172.21.15.146:0/3553298875 shutdown_connections 2024-09-17T03:33:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.341+0000 7f7f5949b640 1 -- 172.21.15.146:0/3553298875 wait complete. 2024-09-17T03:33:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.342+0000 7f7f5949b640 1 Processor -- start 2024-09-17T03:33:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.343+0000 7f7f5949b640 1 -- start start 2024-09-17T03:33:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f5949b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f40004d40 0x7f7f540cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f5949b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f54154040 0x7f7f541538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f5949b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f540b8c60 0x7f7f540b9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f5949b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7f540b6780 con 0x7f7f54154040 2024-09-17T03:33:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f5949b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7f540b6600 con 0x7f7f540b8c60 2024-09-17T03:33:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f5949b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7f540b6900 con 0x7f7f40004d40 2024-09-17T03:33:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f4a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f54154040 0x7f7f541538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f4a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f54154040 0x7f7f541538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50298/0 (socket says 172.21.15.146:50298) 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f4a7fc640 1 -- 172.21.15.146:0/4026053994 learned_addr learned my addr 172.21.15.146:0/4026053994 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f52ffd640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f40004d40 0x7f7f540cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f537fe640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f540b8c60 0x7f7f540b9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f4a7fc640 1 -- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f40004d40 msgr2=0x7f7f540cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f4a7fc640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f40004d40 0x7f7f540cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f4a7fc640 1 -- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f540b8c60 msgr2=0x7f7f540b9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f4a7fc640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f540b8c60 0x7f7f540b9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f4a7fc640 1 -- 172.21.15.146:0/4026053994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f540b95b0 con 0x7f7f54154040 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.344+0000 7f7f4a7fc640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f54154040 0x7f7f541538d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c001a10 tx=0x7f7f3c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.345+0000 7f7f4bfff640 1 -- 172.21.15.146:0/4026053994 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00f760 con 0x7f7f54154040 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.345+0000 7f7f4bfff640 1 -- 172.21.15.146:0/4026053994 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f3c016020 con 0x7f7f54154040 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.345+0000 7f7f5949b640 1 -- 172.21.15.146:0/4026053994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f540cc0b0 con 0x7f7f54154040 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.345+0000 7f7f4bfff640 1 -- 172.21.15.146:0/4026053994 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00fba0 con 0x7f7f54154040 2024-09-17T03:33:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.345+0000 7f7f5949b640 1 -- 172.21.15.146:0/4026053994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f540cc670 con 0x7f7f54154040 2024-09-17T03:33:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.346+0000 7f7f5949b640 1 -- 172.21.15.146:0/4026053994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f540cbe20 con 0x7f7f54154040 2024-09-17T03:33:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.346+0000 7f7f4bfff640 1 -- 172.21.15.146:0/4026053994 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7f3c00fd40 con 0x7f7f54154040 2024-09-17T03:33:08.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.347+0000 7f7f4bfff640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f34078b90 0x7f7f3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:08.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.347+0000 7f7f4bfff640 1 -- 172.21.15.146:0/4026053994 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7f3c09b810 con 0x7f7f54154040 2024-09-17T03:33:08.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.347+0000 7f7f52ffd640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f34078b90 0x7f7f3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:08.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.348+0000 7f7f52ffd640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f34078b90 0x7f7f3407b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009cd0 tx=0x7f7f44005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.352+0000 7f7f4bfff640 1 -- 172.21.15.146:0/4026053994 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7f3c020020 con 0x7f7f54154040 2024-09-17T03:33:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.523+0000 7f7f5949b640 1 -- 172.21.15.146:0/4026053994 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f540cfca0 con 0x7f7f34078b90 2024-09-17T03:33:08.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.528+0000 7f7f4bfff640 1 -- 172.21.15.146:0/4026053994 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251912 (secure 0 0 0) 0x7f7f4405e820 con 0x7f7f34078b90 2024-09-17T03:33:08.531 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 -- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f34078b90 msgr2=0x7f7f3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f34078b90 0x7f7f3407b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009cd0 tx=0x7f7f44005f90 comp rx=0 tx=0).stop 2024-09-17T03:33:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 -- 172.21.15.146:0/4026053994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f54154040 msgr2=0x7f7f541538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f54154040 0x7f7f541538d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c001a10 tx=0x7f7f3c0039c0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 -- 172.21.15.146:0/4026053994 shutdown_connections 2024-09-17T03:33:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f34078b90 0x7f7f3407b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f540b8c60 0x7f7f540b9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f54154040 0x7f7f541538d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 --2- 172.21.15.146:0/4026053994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f40004d40 0x7f7f540cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 -- 172.21.15.146:0/4026053994 >> 172.21.15.146:0/4026053994 conn(0x7f7f540d11f0 msgr2=0x7f7f54075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 -- 172.21.15.146:0/4026053994 shutdown_connections 2024-09-17T03:33:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.531+0000 7f7f5949b640 1 -- 172.21.15.146:0/4026053994 wait complete. 2024-09-17T03:33:08.542 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T03:33:07.790935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219124,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755596,"statfs":{"total":773094113280,"available":772869730304,"internally_reserved":0,"allocated":2924544,"data_stored":1767532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002153"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829399+0000","last_change":"2024-09-17T03:33:00.776875+0000","last_active":"2024-09-17T03:33:01.829399+0000","last_peered":"2024-09-17T03:33:01.829399+0000","last_clean":"2024-09-17T03:33:01.829399+0000","last_became_active":"2024-09-17T03:33:00.776492+0000","last_became_peered":"2024-09-17T03:33:00.776492+0000","last_unstale":"2024-09-17T03:33:01.829399+0000","last_undegraded":"2024-09-17T03:33:01.829399+0000","last_fullsized":"2024-09-17T03:33:01.829399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:05.190506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767824+0000","last_change":"2024-09-17T03:33:00.768131+0000","last_active":"2024-09-17T03:33:01.767824+0000","last_peered":"2024-09-17T03:33:01.767824+0000","last_clean":"2024-09-17T03:33:01.767824+0000","last_became_active":"2024-09-17T03:33:00.767420+0000","last_became_peered":"2024-09-17T03:33:00.767420+0000","last_unstale":"2024-09-17T03:33:01.767824+0000","last_undegraded":"2024-09-17T03:33:01.767824+0000","last_fullsized":"2024-09-17T03:33:01.767824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:03.495898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827775+0000","last_change":"2024-09-17T03:33:00.762884+0000","last_active":"2024-09-17T03:33:01.827775+0000","last_peered":"2024-09-17T03:33:01.827775+0000","last_clean":"2024-09-17T03:33:01.827775+0000","last_became_active":"2024-09-17T03:33:00.762572+0000","last_became_peered":"2024-09-17T03:33:00.762572+0000","last_unstale":"2024-09-17T03:33:01.827775+0000","last_undegraded":"2024-09-17T03:33:01.827775+0000","last_fullsized":"2024-09-17T03:33:01.827775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:26.672695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771728+0000","last_change":"2024-09-17T03:33:00.778126+0000","last_active":"2024-09-17T03:33:01.771728+0000","last_peered":"2024-09-17T03:33:01.771728+0000","last_clean":"2024-09-17T03:33:01.771728+0000","last_became_active":"2024-09-17T03:33:00.777760+0000","last_became_peered":"2024-09-17T03:33:00.777760+0000","last_unstale":"2024-09-17T03:33:01.771728+0000","last_undegraded":"2024-09-17T03:33:01.771728+0000","last_fullsized":"2024-09-17T03:33:01.771728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:48.841807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829060+0000","last_change":"2024-09-17T03:33:00.782918+0000","last_active":"2024-09-17T03:33:01.829060+0000","last_peered":"2024-09-17T03:33:01.829060+0000","last_clean":"2024-09-17T03:33:01.829060+0000","last_became_active":"2024-09-17T03:33:00.782020+0000","last_became_peered":"2024-09-17T03:33:00.782020+0000","last_unstale":"2024-09-17T03:33:01.829060+0000","last_undegraded":"2024-09-17T03:33:01.829060+0000","last_fullsized":"2024-09-17T03:33:01.829060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:04.686891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771542+0000","last_change":"2024-09-17T03:33:00.772869+0000","last_active":"2024-09-17T03:33:01.771542+0000","last_peered":"2024-09-17T03:33:01.771542+0000","last_clean":"2024-09-17T03:33:01.771542+0000","last_became_active":"2024-09-17T03:33:00.772517+0000","last_became_peered":"2024-09-17T03:33:00.772517+0000","last_unstale":"2024-09-17T03:33:01.771542+0000","last_undegraded":"2024-09-17T03:33:01.771542+0000","last_fullsized":"2024-09-17T03:33:01.771542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:19.582453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828169+0000","last_change":"2024-09-17T03:33:00.773836+0000","last_active":"2024-09-17T03:33:01.828169+0000","last_peered":"2024-09-17T03:33:01.828169+0000","last_clean":"2024-09-17T03:33:01.828169+0000","last_became_active":"2024-09-17T03:33:00.773562+0000","last_became_peered":"2024-09-17T03:33:00.773562+0000","last_unstale":"2024-09-17T03:33:01.828169+0000","last_undegraded":"2024-09-17T03:33:01.828169+0000","last_fullsized":"2024-09-17T03:33:01.828169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:17.617717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829349+0000","last_change":"2024-09-17T03:33:00.780226+0000","last_active":"2024-09-17T03:33:01.829349+0000","last_peered":"2024-09-17T03:33:01.829349+0000","last_clean":"2024-09-17T03:33:01.829349+0000","last_became_active":"2024-09-17T03:33:00.779937+0000","last_became_peered":"2024-09-17T03:33:00.779937+0000","last_unstale":"2024-09-17T03:33:01.829349+0000","last_undegraded":"2024-09-17T03:33:01.829349+0000","last_fullsized":"2024-09-17T03:33:01.829349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:23.843836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829226+0000","last_change":"2024-09-17T03:33:00.781071+0000","last_active":"2024-09-17T03:33:01.829226+0000","last_peered":"2024-09-17T03:33:01.829226+0000","last_clean":"2024-09-17T03:33:01.829226+0000","last_became_active":"2024-09-17T03:33:00.780570+0000","last_became_peered":"2024-09-17T03:33:00.780570+0000","last_unstale":"2024-09-17T03:33:01.829226+0000","last_undegraded":"2024-09-17T03:33:01.829226+0000","last_fullsized":"2024-09-17T03:33:01.829226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:40.962739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771518+0000","last_change":"2024-09-17T03:33:00.776867+0000","last_active":"2024-09-17T03:33:01.771518+0000","last_peered":"2024-09-17T03:33:01.771518+0000","last_clean":"2024-09-17T03:33:01.771518+0000","last_became_active":"2024-09-17T03:33:00.776565+0000","last_became_peered":"2024-09-17T03:33:00.776565+0000","last_unstale":"2024-09-17T03:33:01.771518+0000","last_undegraded":"2024-09-17T03:33:01.771518+0000","last_fullsized":"2024-09-17T03:33:01.771518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:14.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770780+0000","last_change":"2024-09-17T03:33:00.776047+0000","last_active":"2024-09-17T03:33:01.770780+0000","last_peered":"2024-09-17T03:33:01.770780+0000","last_clean":"2024-09-17T03:33:01.770780+0000","last_became_active":"2024-09-17T03:33:00.775733+0000","last_became_peered":"2024-09-17T03:33:00.775733+0000","last_unstale":"2024-09-17T03:33:01.770780+0000","last_undegraded":"2024-09-17T03:33:01.770780+0000","last_fullsized":"2024-09-17T03:33:01.770780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:45.334569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828513+0000","last_change":"2024-09-17T03:33:00.775474+0000","last_active":"2024-09-17T03:33:01.828513+0000","last_peered":"2024-09-17T03:33:01.828513+0000","last_clean":"2024-09-17T03:33:01.828513+0000","last_became_active":"2024-09-17T03:33:00.775111+0000","last_became_peered":"2024-09-17T03:33:00.775111+0000","last_unstale":"2024-09-17T03:33:01.828513+0000","last_undegraded":"2024-09-17T03:33:01.828513+0000","last_fullsized":"2024-09-17T03:33:01.828513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:26.456013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828003+0000","last_change":"2024-09-17T03:33:00.774115+0000","last_active":"2024-09-17T03:33:01.828003+0000","last_peered":"2024-09-17T03:33:01.828003+0000","last_clean":"2024-09-17T03:33:01.828003+0000","last_became_active":"2024-09-17T03:33:00.773803+0000","last_became_peered":"2024-09-17T03:33:00.773803+0000","last_unstale":"2024-09-17T03:33:01.828003+0000","last_undegraded":"2024-09-17T03:33:01.828003+0000","last_fullsized":"2024-09-17T03:33:01.828003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:13.109575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828014+0000","last_change":"2024-09-17T03:33:00.764440+0000","last_active":"2024-09-17T03:33:01.828014+0000","last_peered":"2024-09-17T03:33:01.828014+0000","last_clean":"2024-09-17T03:33:01.828014+0000","last_became_active":"2024-09-17T03:33:00.764123+0000","last_became_peered":"2024-09-17T03:33:00.764123+0000","last_unstale":"2024-09-17T03:33:01.828014+0000","last_undegraded":"2024-09-17T03:33:01.828014+0000","last_fullsized":"2024-09-17T03:33:01.828014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:44.310926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767341+0000","last_change":"2024-09-17T03:33:00.756678+0000","last_active":"2024-09-17T03:33:01.767341+0000","last_peered":"2024-09-17T03:33:01.767341+0000","last_clean":"2024-09-17T03:33:01.767341+0000","last_became_active":"2024-09-17T03:33:00.756342+0000","last_became_peered":"2024-09-17T03:33:00.756342+0000","last_unstale":"2024-09-17T03:33:01.767341+0000","last_undegraded":"2024-09-17T03:33:01.767341+0000","last_fullsized":"2024-09-17T03:33:01.767341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:19.020262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770738+0000","last_change":"2024-09-17T03:33:00.771303+0000","last_active":"2024-09-17T03:33:01.770738+0000","last_peered":"2024-09-17T03:33:01.770738+0000","last_clean":"2024-09-17T03:33:01.770738+0000","last_became_active":"2024-09-17T03:33:00.770971+0000","last_became_peered":"2024-09-17T03:33:00.770971+0000","last_unstale":"2024-09-17T03:33:01.770738+0000","last_undegraded":"2024-09-17T03:33:01.770738+0000","last_fullsized":"2024-09-17T03:33:01.770738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:31.492292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771440+0000","last_change":"2024-09-17T03:33:00.783198+0000","last_active":"2024-09-17T03:33:01.771440+0000","last_peered":"2024-09-17T03:33:01.771440+0000","last_clean":"2024-09-17T03:33:01.771440+0000","last_became_active":"2024-09-17T03:33:00.782880+0000","last_became_peered":"2024-09-17T03:33:00.782880+0000","last_unstale":"2024-09-17T03:33:01.771440+0000","last_undegraded":"2024-09-17T03:33:01.771440+0000","last_fullsized":"2024-09-17T03:33:01.771440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:54.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827581+0000","last_change":"2024-09-17T03:33:00.774736+0000","last_active":"2024-09-17T03:33:01.827581+0000","last_peered":"2024-09-17T03:33:01.827581+0000","last_clean":"2024-09-17T03:33:01.827581+0000","last_became_active":"2024-09-17T03:33:00.774417+0000","last_became_peered":"2024-09-17T03:33:00.774417+0000","last_unstale":"2024-09-17T03:33:01.827581+0000","last_undegraded":"2024-09-17T03:33:01.827581+0000","last_fullsized":"2024-09-17T03:33:01.827581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:25.572520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829204+0000","last_change":"2024-09-17T03:33:00.777636+0000","last_active":"2024-09-17T03:33:01.829204+0000","last_peered":"2024-09-17T03:33:01.829204+0000","last_clean":"2024-09-17T03:33:01.829204+0000","last_became_active":"2024-09-17T03:33:00.777316+0000","last_became_peered":"2024-09-17T03:33:00.777316+0000","last_unstale":"2024-09-17T03:33:01.829204+0000","last_undegraded":"2024-09-17T03:33:01.829204+0000","last_fullsized":"2024-09-17T03:33:01.829204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:55.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771462+0000","last_change":"2024-09-17T03:33:00.767553+0000","last_active":"2024-09-17T03:33:01.771462+0000","last_peered":"2024-09-17T03:33:01.771462+0000","last_clean":"2024-09-17T03:33:01.771462+0000","last_became_active":"2024-09-17T03:33:00.767260+0000","last_became_peered":"2024-09-17T03:33:00.767260+0000","last_unstale":"2024-09-17T03:33:01.771462+0000","last_undegraded":"2024-09-17T03:33:01.771462+0000","last_fullsized":"2024-09-17T03:33:01.771462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:25.613842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828611+0000","last_change":"2024-09-17T03:33:00.782782+0000","last_active":"2024-09-17T03:33:01.828611+0000","last_peered":"2024-09-17T03:33:01.828611+0000","last_clean":"2024-09-17T03:33:01.828611+0000","last_became_active":"2024-09-17T03:33:00.782342+0000","last_became_peered":"2024-09-17T03:33:00.782342+0000","last_unstale":"2024-09-17T03:33:01.828611+0000","last_undegraded":"2024-09-17T03:33:01.828611+0000","last_fullsized":"2024-09-17T03:33:01.828611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:45.334569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772159+0000","last_change":"2024-09-17T03:33:00.785690+0000","last_active":"2024-09-17T03:33:01.772159+0000","last_peered":"2024-09-17T03:33:01.772159+0000","last_clean":"2024-09-17T03:33:01.772159+0000","last_became_active":"2024-09-17T03:33:00.785379+0000","last_became_peered":"2024-09-17T03:33:00.785379+0000","last_unstale":"2024-09-17T03:33:01.772159+0000","last_undegraded":"2024-09-17T03:33:01.772159+0000","last_fullsized":"2024-09-17T03:33:01.772159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:23.348736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829110+0000","last_change":"2024-09-17T03:33:00.771812+0000","last_active":"2024-09-17T03:33:01.829110+0000","last_peered":"2024-09-17T03:33:01.829110+0000","last_clean":"2024-09-17T03:33:01.829110+0000","last_became_active":"2024-09-17T03:33:00.771519+0000","last_became_peered":"2024-09-17T03:33:00.771519+0000","last_unstale":"2024-09-17T03:33:01.829110+0000","last_undegraded":"2024-09-17T03:33:01.829110+0000","last_fullsized":"2024-09-17T03:33:01.829110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:35.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771263+0000","last_change":"2024-09-17T03:33:00.775473+0000","last_active":"2024-09-17T03:33:01.771263+0000","last_peered":"2024-09-17T03:33:01.771263+0000","last_clean":"2024-09-17T03:33:01.771263+0000","last_became_active":"2024-09-17T03:33:00.775162+0000","last_became_peered":"2024-09-17T03:33:00.775162+0000","last_unstale":"2024-09-17T03:33:01.771263+0000","last_undegraded":"2024-09-17T03:33:01.771263+0000","last_fullsized":"2024-09-17T03:33:01.771263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:46.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828630+0000","last_change":"2024-09-17T03:33:00.769652+0000","last_active":"2024-09-17T03:33:01.828630+0000","last_peered":"2024-09-17T03:33:01.828630+0000","last_clean":"2024-09-17T03:33:01.828630+0000","last_became_active":"2024-09-17T03:33:00.769304+0000","last_became_peered":"2024-09-17T03:33:00.769304+0000","last_unstale":"2024-09-17T03:33:01.828630+0000","last_undegraded":"2024-09-17T03:33:01.828630+0000","last_fullsized":"2024-09-17T03:33:01.828630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:57.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771737+0000","last_change":"2024-09-17T03:33:00.782886+0000","last_active":"2024-09-17T03:33:01.771737+0000","last_peered":"2024-09-17T03:33:01.771737+0000","last_clean":"2024-09-17T03:33:01.771737+0000","last_became_active":"2024-09-17T03:33:00.782588+0000","last_became_peered":"2024-09-17T03:33:00.782588+0000","last_unstale":"2024-09-17T03:33:01.771737+0000","last_undegraded":"2024-09-17T03:33:01.771737+0000","last_fullsized":"2024-09-17T03:33:01.771737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:41.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767437+0000","last_change":"2024-09-17T03:33:00.760617+0000","last_active":"2024-09-17T03:33:01.767437+0000","last_peered":"2024-09-17T03:33:01.767437+0000","last_clean":"2024-09-17T03:33:01.767437+0000","last_became_active":"2024-09-17T03:33:00.760082+0000","last_became_peered":"2024-09-17T03:33:00.760082+0000","last_unstale":"2024-09-17T03:33:01.767437+0000","last_undegraded":"2024-09-17T03:33:01.767437+0000","last_fullsized":"2024-09-17T03:33:01.767437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:14.092201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828353+0000","last_change":"2024-09-17T03:33:00.767896+0000","last_active":"2024-09-17T03:33:01.828353+0000","last_peered":"2024-09-17T03:33:01.828353+0000","last_clean":"2024-09-17T03:33:01.828353+0000","last_became_active":"2024-09-17T03:33:00.766950+0000","last_became_peered":"2024-09-17T03:33:00.766950+0000","last_unstale":"2024-09-17T03:33:01.828353+0000","last_undegraded":"2024-09-17T03:33:01.828353+0000","last_fullsized":"2024-09-17T03:33:01.828353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:06.893972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828851+0000","last_change":"2024-09-17T03:33:00.765502+0000","last_active":"2024-09-17T03:33:01.828851+0000","last_peered":"2024-09-17T03:33:01.828851+0000","last_clean":"2024-09-17T03:33:01.828851+0000","last_became_active":"2024-09-17T03:33:00.764433+0000","last_became_peered":"2024-09-17T03:33:00.764433+0000","last_unstale":"2024-09-17T03:33:01.828851+0000","last_undegraded":"2024-09-17T03:33:01.828851+0000","last_fullsized":"2024-09-17T03:33:01.828851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:14.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771900+0000","last_change":"2024-09-17T03:33:00.772070+0000","last_active":"2024-09-17T03:33:01.771900+0000","last_peered":"2024-09-17T03:33:01.771900+0000","last_clean":"2024-09-17T03:33:01.771900+0000","last_became_active":"2024-09-17T03:33:00.771721+0000","last_became_peered":"2024-09-17T03:33:00.771721+0000","last_unstale":"2024-09-17T03:33:01.771900+0000","last_undegraded":"2024-09-17T03:33:01.771900+0000","last_fullsized":"2024-09-17T03:33:01.771900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:27.987451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828035+0000","last_change":"2024-09-17T03:33:00.775482+0000","last_active":"2024-09-17T03:33:01.828035+0000","last_peered":"2024-09-17T03:33:01.828035+0000","last_clean":"2024-09-17T03:33:01.828035+0000","last_became_active":"2024-09-17T03:33:00.775176+0000","last_became_peered":"2024-09-17T03:33:00.775176+0000","last_unstale":"2024-09-17T03:33:01.828035+0000","last_undegraded":"2024-09-17T03:33:01.828035+0000","last_fullsized":"2024-09-17T03:33:01.828035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:40.655267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770460+0000","last_change":"2024-09-17T03:33:00.769414+0000","last_active":"2024-09-17T03:33:01.770460+0000","last_peered":"2024-09-17T03:33:01.770460+0000","last_clean":"2024-09-17T03:33:01.770460+0000","last_became_active":"2024-09-17T03:33:00.769045+0000","last_became_peered":"2024-09-17T03:33:00.769045+0000","last_unstale":"2024-09-17T03:33:01.770460+0000","last_undegraded":"2024-09-17T03:33:01.770460+0000","last_fullsized":"2024-09-17T03:33:01.770460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:52.488679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828518+0000","last_change":"2024-09-17T03:33:00.756739+0000","last_active":"2024-09-17T03:33:01.828518+0000","last_peered":"2024-09-17T03:33:01.828518+0000","last_clean":"2024-09-17T03:33:01.828518+0000","last_became_active":"2024-09-17T03:33:00.756432+0000","last_became_peered":"2024-09-17T03:33:00.756432+0000","last_unstale":"2024-09-17T03:33:01.828518+0000","last_undegraded":"2024-09-17T03:33:01.828518+0000","last_fullsized":"2024-09-17T03:33:01.828518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.136914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828369+0000","last_change":"2024-09-17T03:32:59.762042+0000","last_active":"2024-09-17T03:33:01.828369+0000","last_peered":"2024-09-17T03:33:01.828369+0000","last_clean":"2024-09-17T03:33:01.828369+0000","last_became_active":"2024-09-17T03:32:59.761644+0000","last_became_peered":"2024-09-17T03:32:59.761644+0000","last_unstale":"2024-09-17T03:33:01.828369+0000","last_undegraded":"2024-09-17T03:33:01.828369+0000","last_fullsized":"2024-09-17T03:33:01.828369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:05.070599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829071+0000","last_change":"2024-09-17T03:33:00.768871+0000","last_active":"2024-09-17T03:33:01.829071+0000","last_peered":"2024-09-17T03:33:01.829071+0000","last_clean":"2024-09-17T03:33:01.829071+0000","last_became_active":"2024-09-17T03:33:00.768576+0000","last_became_peered":"2024-09-17T03:33:00.768576+0000","last_unstale":"2024-09-17T03:33:01.829071+0000","last_undegraded":"2024-09-17T03:33:01.829071+0000","last_fullsized":"2024-09-17T03:33:01.829071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:41.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770504+0000","last_change":"2024-09-17T03:32:59.750464+0000","last_active":"2024-09-17T03:33:01.770504+0000","last_peered":"2024-09-17T03:33:01.770504+0000","last_clean":"2024-09-17T03:33:01.770504+0000","last_became_active":"2024-09-17T03:32:59.750128+0000","last_became_peered":"2024-09-17T03:32:59.750128+0000","last_unstale":"2024-09-17T03:33:01.770504+0000","last_undegraded":"2024-09-17T03:33:01.770504+0000","last_fullsized":"2024-09-17T03:33:01.770504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:33.223602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829218+0000","last_change":"2024-09-17T03:32:59.758058+0000","last_active":"2024-09-17T03:33:01.829218+0000","last_peered":"2024-09-17T03:33:01.829218+0000","last_clean":"2024-09-17T03:33:01.829218+0000","last_became_active":"2024-09-17T03:32:59.757687+0000","last_became_peered":"2024-09-17T03:32:59.757687+0000","last_unstale":"2024-09-17T03:33:01.829218+0000","last_undegraded":"2024-09-17T03:33:01.829218+0000","last_fullsized":"2024-09-17T03:33:01.829218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827893+0000","last_change":"2024-09-17T03:33:00.770901+0000","last_active":"2024-09-17T03:33:01.827893+0000","last_peered":"2024-09-17T03:33:01.827893+0000","last_clean":"2024-09-17T03:33:01.827893+0000","last_became_active":"2024-09-17T03:33:00.770616+0000","last_became_peered":"2024-09-17T03:33:00.770616+0000","last_unstale":"2024-09-17T03:33:01.827893+0000","last_undegraded":"2024-09-17T03:33:01.827893+0000","last_fullsized":"2024-09-17T03:33:01.827893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:30.089705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770904+0000","last_change":"2024-09-17T03:32:59.754649+0000","last_active":"2024-09-17T03:33:01.770904+0000","last_peered":"2024-09-17T03:33:01.770904+0000","last_clean":"2024-09-17T03:33:01.770904+0000","last_became_active":"2024-09-17T03:32:59.754136+0000","last_became_peered":"2024-09-17T03:32:59.754136+0000","last_unstale":"2024-09-17T03:33:01.770904+0000","last_undegraded":"2024-09-17T03:33:01.770904+0000","last_fullsized":"2024-09-17T03:33:01.770904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767336+0000","last_change":"2024-09-17T03:33:00.760841+0000","last_active":"2024-09-17T03:33:01.767336+0000","last_peered":"2024-09-17T03:33:01.767336+0000","last_clean":"2024-09-17T03:33:01.767336+0000","last_became_active":"2024-09-17T03:33:00.760403+0000","last_became_peered":"2024-09-17T03:33:00.760403+0000","last_unstale":"2024-09-17T03:33:01.767336+0000","last_undegraded":"2024-09-17T03:33:01.767336+0000","last_fullsized":"2024-09-17T03:33:01.767336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:36.260269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770699+0000","last_change":"2024-09-17T03:32:59.754636+0000","last_active":"2024-09-17T03:33:01.770699+0000","last_peered":"2024-09-17T03:33:01.770699+0000","last_clean":"2024-09-17T03:33:01.770699+0000","last_became_active":"2024-09-17T03:32:59.754209+0000","last_became_peered":"2024-09-17T03:32:59.754209+0000","last_unstale":"2024-09-17T03:33:01.770699+0000","last_undegraded":"2024-09-17T03:33:01.770699+0000","last_fullsized":"2024-09-17T03:33:01.770699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:56.265096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770975+0000","last_change":"2024-09-17T03:33:00.783600+0000","last_active":"2024-09-17T03:33:01.770975+0000","last_peered":"2024-09-17T03:33:01.770975+0000","last_clean":"2024-09-17T03:33:01.770975+0000","last_became_active":"2024-09-17T03:33:00.783299+0000","last_became_peered":"2024-09-17T03:33:00.783299+0000","last_unstale":"2024-09-17T03:33:01.770975+0000","last_undegraded":"2024-09-17T03:33:01.770975+0000","last_fullsized":"2024-09-17T03:33:01.770975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:44.836032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771087+0000","last_change":"2024-09-17T03:32:59.756949+0000","last_active":"2024-09-17T03:33:01.771087+0000","last_peered":"2024-09-17T03:33:01.771087+0000","last_clean":"2024-09-17T03:33:01.771087+0000","last_became_active":"2024-09-17T03:32:59.756555+0000","last_became_peered":"2024-09-17T03:32:59.756555+0000","last_unstale":"2024-09-17T03:33:01.771087+0000","last_undegraded":"2024-09-17T03:33:01.771087+0000","last_fullsized":"2024-09-17T03:33:01.771087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:41.461451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828788+0000","last_change":"2024-09-17T03:33:00.779122+0000","last_active":"2024-09-17T03:33:01.828788+0000","last_peered":"2024-09-17T03:33:01.828788+0000","last_clean":"2024-09-17T03:33:01.828788+0000","last_became_active":"2024-09-17T03:33:00.778812+0000","last_became_peered":"2024-09-17T03:33:00.778812+0000","last_unstale":"2024-09-17T03:33:01.828788+0000","last_undegraded":"2024-09-17T03:33:01.828788+0000","last_fullsized":"2024-09-17T03:33:01.828788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:25.613842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767519+0000","last_change":"2024-09-17T03:32:59.757444+0000","last_active":"2024-09-17T03:33:01.767519+0000","last_peered":"2024-09-17T03:33:01.767519+0000","last_clean":"2024-09-17T03:33:01.767519+0000","last_became_active":"2024-09-17T03:32:59.757144+0000","last_became_peered":"2024-09-17T03:32:59.757144+0000","last_unstale":"2024-09-17T03:33:01.767519+0000","last_undegraded":"2024-09-17T03:33:01.767519+0000","last_fullsized":"2024-09-17T03:33:01.767519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:25.450646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828656+0000","last_change":"2024-09-17T03:33:00.783211+0000","last_active":"2024-09-17T03:33:01.828656+0000","last_peered":"2024-09-17T03:33:01.828656+0000","last_clean":"2024-09-17T03:33:01.828656+0000","last_became_active":"2024-09-17T03:33:00.782917+0000","last_became_peered":"2024-09-17T03:33:00.782917+0000","last_unstale":"2024-09-17T03:33:01.828656+0000","last_undegraded":"2024-09-17T03:33:01.828656+0000","last_fullsized":"2024-09-17T03:33:01.828656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:40.655267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771416+0000","last_change":"2024-09-17T03:32:59.756162+0000","last_active":"2024-09-17T03:33:01.771416+0000","last_peered":"2024-09-17T03:33:01.771416+0000","last_clean":"2024-09-17T03:33:01.771416+0000","last_became_active":"2024-09-17T03:32:59.755825+0000","last_became_peered":"2024-09-17T03:32:59.755825+0000","last_unstale":"2024-09-17T03:33:01.771416+0000","last_undegraded":"2024-09-17T03:33:01.771416+0000","last_fullsized":"2024-09-17T03:33:01.771416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:08.648990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828551+0000","last_change":"2024-09-17T03:33:00.777400+0000","last_active":"2024-09-17T03:33:01.828551+0000","last_peered":"2024-09-17T03:33:01.828551+0000","last_clean":"2024-09-17T03:33:01.828551+0000","last_became_active":"2024-09-17T03:33:00.776982+0000","last_became_peered":"2024-09-17T03:33:00.776982+0000","last_unstale":"2024-09-17T03:33:01.828551+0000","last_undegraded":"2024-09-17T03:33:01.828551+0000","last_fullsized":"2024-09-17T03:33:01.828551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:00.761824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829140+0000","last_change":"2024-09-17T03:32:59.752557+0000","last_active":"2024-09-17T03:33:01.829140+0000","last_peered":"2024-09-17T03:33:01.829140+0000","last_clean":"2024-09-17T03:33:01.829140+0000","last_became_active":"2024-09-17T03:32:59.752209+0000","last_became_peered":"2024-09-17T03:32:59.752209+0000","last_unstale":"2024-09-17T03:33:01.829140+0000","last_undegraded":"2024-09-17T03:33:01.829140+0000","last_fullsized":"2024-09-17T03:33:01.829140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:42.500391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828242+0000","last_change":"2024-09-17T03:33:00.782750+0000","last_active":"2024-09-17T03:33:01.828242+0000","last_peered":"2024-09-17T03:33:01.828242+0000","last_clean":"2024-09-17T03:33:01.828242+0000","last_became_active":"2024-09-17T03:33:00.782327+0000","last_became_peered":"2024-09-17T03:33:00.782327+0000","last_unstale":"2024-09-17T03:33:01.828242+0000","last_undegraded":"2024-09-17T03:33:01.828242+0000","last_fullsized":"2024-09-17T03:33:01.828242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:52.488679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772126+0000","last_change":"2024-09-17T03:32:59.760715+0000","last_active":"2024-09-17T03:33:01.772126+0000","last_peered":"2024-09-17T03:33:01.772126+0000","last_clean":"2024-09-17T03:33:01.772126+0000","last_became_active":"2024-09-17T03:32:59.760384+0000","last_became_peered":"2024-09-17T03:32:59.760384+0000","last_unstale":"2024-09-17T03:33:01.772126+0000","last_undegraded":"2024-09-17T03:33:01.772126+0000","last_fullsized":"2024-09-17T03:33:01.772126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:12.647154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829216+0000","last_change":"2024-09-17T03:33:00.783439+0000","last_active":"2024-09-17T03:33:01.829216+0000","last_peered":"2024-09-17T03:33:01.829216+0000","last_clean":"2024-09-17T03:33:01.829216+0000","last_became_active":"2024-09-17T03:33:00.783137+0000","last_became_peered":"2024-09-17T03:33:00.783137+0000","last_unstale":"2024-09-17T03:33:01.829216+0000","last_undegraded":"2024-09-17T03:33:01.829216+0000","last_fullsized":"2024-09-17T03:33:01.829216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:50.057290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770363+0000","last_change":"2024-09-17T03:32:59.752048+0000","last_active":"2024-09-17T03:33:01.770363+0000","last_peered":"2024-09-17T03:33:01.770363+0000","last_clean":"2024-09-17T03:33:01.770363+0000","last_became_active":"2024-09-17T03:32:59.751723+0000","last_became_peered":"2024-09-17T03:32:59.751723+0000","last_unstale":"2024-09-17T03:33:01.770363+0000","last_undegraded":"2024-09-17T03:33:01.770363+0000","last_fullsized":"2024-09-17T03:33:01.770363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:48.722694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770848+0000","last_change":"2024-09-17T03:33:00.768436+0000","last_active":"2024-09-17T03:33:01.770848+0000","last_peered":"2024-09-17T03:33:01.770848+0000","last_clean":"2024-09-17T03:33:01.770848+0000","last_became_active":"2024-09-17T03:33:00.768115+0000","last_became_peered":"2024-09-17T03:33:00.768115+0000","last_unstale":"2024-09-17T03:33:01.770848+0000","last_undegraded":"2024-09-17T03:33:01.770848+0000","last_fullsized":"2024-09-17T03:33:01.770848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:19.020262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828325+0000","last_change":"2024-09-17T03:32:59.752841+0000","last_active":"2024-09-17T03:33:01.828325+0000","last_peered":"2024-09-17T03:33:01.828325+0000","last_clean":"2024-09-17T03:33:01.828325+0000","last_became_active":"2024-09-17T03:32:59.752527+0000","last_became_peered":"2024-09-17T03:32:59.752527+0000","last_unstale":"2024-09-17T03:33:01.828325+0000","last_undegraded":"2024-09-17T03:33:01.828325+0000","last_fullsized":"2024-09-17T03:33:01.828325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:02.065991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829064+0000","last_change":"2024-09-17T03:33:00.777223+0000","last_active":"2024-09-17T03:33:01.829064+0000","last_peered":"2024-09-17T03:33:01.829064+0000","last_clean":"2024-09-17T03:33:01.829064+0000","last_became_active":"2024-09-17T03:33:00.776568+0000","last_became_peered":"2024-09-17T03:33:00.776568+0000","last_unstale":"2024-09-17T03:33:01.829064+0000","last_undegraded":"2024-09-17T03:33:01.829064+0000","last_fullsized":"2024-09-17T03:33:01.829064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:05.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828618+0000","last_change":"2024-09-17T03:32:59.752343+0000","last_active":"2024-09-17T03:33:01.828618+0000","last_peered":"2024-09-17T03:33:01.828618+0000","last_clean":"2024-09-17T03:33:01.828618+0000","last_became_active":"2024-09-17T03:32:59.751973+0000","last_became_peered":"2024-09-17T03:32:59.751973+0000","last_unstale":"2024-09-17T03:33:01.828618+0000","last_undegraded":"2024-09-17T03:33:01.828618+0000","last_fullsized":"2024-09-17T03:33:01.828618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.016385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828907+0000","last_change":"2024-09-17T03:33:00.782466+0000","last_active":"2024-09-17T03:33:01.828907+0000","last_peered":"2024-09-17T03:33:01.828907+0000","last_clean":"2024-09-17T03:33:01.828907+0000","last_became_active":"2024-09-17T03:33:00.782092+0000","last_became_peered":"2024-09-17T03:33:00.782092+0000","last_unstale":"2024-09-17T03:33:01.828907+0000","last_undegraded":"2024-09-17T03:33:01.828907+0000","last_fullsized":"2024-09-17T03:33:01.828907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:38.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827653+0000","last_change":"2024-09-17T03:32:59.761123+0000","last_active":"2024-09-17T03:33:01.827653+0000","last_peered":"2024-09-17T03:33:01.827653+0000","last_clean":"2024-09-17T03:33:01.827653+0000","last_became_active":"2024-09-17T03:32:59.760730+0000","last_became_peered":"2024-09-17T03:32:59.760730+0000","last_unstale":"2024-09-17T03:33:01.827653+0000","last_undegraded":"2024-09-17T03:33:01.827653+0000","last_fullsized":"2024-09-17T03:33:01.827653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:26.495834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829383+0000","last_change":"2024-09-17T03:33:00.778945+0000","last_active":"2024-09-17T03:33:01.829383+0000","last_peered":"2024-09-17T03:33:01.829383+0000","last_clean":"2024-09-17T03:33:01.829383+0000","last_became_active":"2024-09-17T03:33:00.778622+0000","last_became_peered":"2024-09-17T03:33:00.778622+0000","last_unstale":"2024-09-17T03:33:01.829383+0000","last_undegraded":"2024-09-17T03:33:01.829383+0000","last_fullsized":"2024-09-17T03:33:01.829383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:48.264109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767642+0000","last_change":"2024-09-17T03:32:59.753256+0000","last_active":"2024-09-17T03:33:01.767642+0000","last_peered":"2024-09-17T03:33:01.767642+0000","last_clean":"2024-09-17T03:33:01.767642+0000","last_became_active":"2024-09-17T03:32:59.752924+0000","last_became_peered":"2024-09-17T03:32:59.752924+0000","last_unstale":"2024-09-17T03:33:01.767642+0000","last_undegraded":"2024-09-17T03:33:01.767642+0000","last_fullsized":"2024-09-17T03:33:01.767642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:24.567153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771993+0000","last_change":"2024-09-17T03:33:00.776604+0000","last_active":"2024-09-17T03:33:01.771993+0000","last_peered":"2024-09-17T03:33:01.771993+0000","last_clean":"2024-09-17T03:33:01.771993+0000","last_became_active":"2024-09-17T03:33:00.776020+0000","last_became_peered":"2024-09-17T03:33:00.776020+0000","last_unstale":"2024-09-17T03:33:01.771993+0000","last_undegraded":"2024-09-17T03:33:01.771993+0000","last_fullsized":"2024-09-17T03:33:01.771993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:06.411768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827511+0000","last_change":"2024-09-17T03:32:59.757099+0000","last_active":"2024-09-17T03:33:01.827511+0000","last_peered":"2024-09-17T03:33:01.827511+0000","last_clean":"2024-09-17T03:33:01.827511+0000","last_became_active":"2024-09-17T03:32:59.756741+0000","last_became_peered":"2024-09-17T03:32:59.756741+0000","last_unstale":"2024-09-17T03:33:01.827511+0000","last_undegraded":"2024-09-17T03:33:01.827511+0000","last_fullsized":"2024-09-17T03:33:01.827511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:48.722694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828813+0000","last_change":"2024-09-17T03:33:00.781017+0000","last_active":"2024-09-17T03:33:01.828813+0000","last_peered":"2024-09-17T03:33:01.828813+0000","last_clean":"2024-09-17T03:33:01.828813+0000","last_became_active":"2024-09-17T03:33:00.780661+0000","last_became_peered":"2024-09-17T03:33:00.780661+0000","last_unstale":"2024-09-17T03:33:01.828813+0000","last_undegraded":"2024-09-17T03:33:01.828813+0000","last_fullsized":"2024-09-17T03:33:01.828813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:38.019743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827855+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:33:01.827855+0000","last_peered":"2024-09-17T03:33:01.827855+0000","last_clean":"2024-09-17T03:33:01.827855+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:33:01.827855+0000","last_undegraded":"2024-09-17T03:33:01.827855+0000","last_fullsized":"2024-09-17T03:33:01.827855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771026+0000","last_change":"2024-09-17T03:32:59.755210+0000","last_active":"2024-09-17T03:33:01.771026+0000","last_peered":"2024-09-17T03:33:01.771026+0000","last_clean":"2024-09-17T03:33:01.771026+0000","last_became_active":"2024-09-17T03:32:59.753607+0000","last_became_peered":"2024-09-17T03:32:59.753607+0000","last_unstale":"2024-09-17T03:33:01.771026+0000","last_undegraded":"2024-09-17T03:33:01.771026+0000","last_fullsized":"2024-09-17T03:33:01.771026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829325+0000","last_change":"2024-09-17T03:33:00.780277+0000","last_active":"2024-09-17T03:33:01.829325+0000","last_peered":"2024-09-17T03:33:01.829325+0000","last_clean":"2024-09-17T03:33:01.829325+0000","last_became_active":"2024-09-17T03:33:00.780008+0000","last_became_peered":"2024-09-17T03:33:00.780008+0000","last_unstale":"2024-09-17T03:33:01.829325+0000","last_undegraded":"2024-09-17T03:33:01.829325+0000","last_fullsized":"2024-09-17T03:33:01.829325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:56.218073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827807+0000","last_change":"2024-09-17T03:32:59.763822+0000","last_active":"2024-09-17T03:33:01.827807+0000","last_peered":"2024-09-17T03:33:01.827807+0000","last_clean":"2024-09-17T03:33:01.827807+0000","last_became_active":"2024-09-17T03:32:59.763474+0000","last_became_peered":"2024-09-17T03:32:59.763474+0000","last_unstale":"2024-09-17T03:33:01.827807+0000","last_undegraded":"2024-09-17T03:33:01.827807+0000","last_fullsized":"2024-09-17T03:33:01.827807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:02.046619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827486+0000","last_change":"2024-09-17T03:33:00.769651+0000","last_active":"2024-09-17T03:33:01.827486+0000","last_peered":"2024-09-17T03:33:01.827486+0000","last_clean":"2024-09-17T03:33:01.827486+0000","last_became_active":"2024-09-17T03:33:00.769137+0000","last_became_peered":"2024-09-17T03:33:00.769137+0000","last_unstale":"2024-09-17T03:33:01.827486+0000","last_undegraded":"2024-09-17T03:33:01.827486+0000","last_fullsized":"2024-09-17T03:33:01.827486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.450827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828105+0000","last_change":"2024-09-17T03:32:59.761128+0000","last_active":"2024-09-17T03:33:01.828105+0000","last_peered":"2024-09-17T03:33:01.828105+0000","last_clean":"2024-09-17T03:33:01.828105+0000","last_became_active":"2024-09-17T03:32:59.760765+0000","last_became_peered":"2024-09-17T03:32:59.760765+0000","last_unstale":"2024-09-17T03:33:01.828105+0000","last_undegraded":"2024-09-17T03:33:01.828105+0000","last_fullsized":"2024-09-17T03:33:01.828105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:04.446287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767343+0000","last_change":"2024-09-17T03:33:00.760063+0000","last_active":"2024-09-17T03:33:01.767343+0000","last_peered":"2024-09-17T03:33:01.767343+0000","last_clean":"2024-09-17T03:33:01.767343+0000","last_became_active":"2024-09-17T03:33:00.759678+0000","last_became_peered":"2024-09-17T03:33:00.759678+0000","last_unstale":"2024-09-17T03:33:01.767343+0000","last_undegraded":"2024-09-17T03:33:01.767343+0000","last_fullsized":"2024-09-17T03:33:01.767343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:07.035577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772200+0000","last_change":"2024-09-17T03:32:59.753138+0000","last_active":"2024-09-17T03:33:01.772200+0000","last_peered":"2024-09-17T03:33:01.772200+0000","last_clean":"2024-09-17T03:33:01.772200+0000","last_became_active":"2024-09-17T03:32:59.752828+0000","last_became_peered":"2024-09-17T03:32:59.752828+0000","last_unstale":"2024-09-17T03:33:01.772200+0000","last_undegraded":"2024-09-17T03:33:01.772200+0000","last_fullsized":"2024-09-17T03:33:01.772200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:06.735843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828444+0000","last_change":"2024-09-17T03:33:00.769042+0000","last_active":"2024-09-17T03:33:01.828444+0000","last_peered":"2024-09-17T03:33:01.828444+0000","last_clean":"2024-09-17T03:33:01.828444+0000","last_became_active":"2024-09-17T03:33:00.768097+0000","last_became_peered":"2024-09-17T03:33:00.768097+0000","last_unstale":"2024-09-17T03:33:01.828444+0000","last_undegraded":"2024-09-17T03:33:01.828444+0000","last_fullsized":"2024-09-17T03:33:01.828444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:29.022126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767570+0000","last_change":"2024-09-17T03:32:59.753623+0000","last_active":"2024-09-17T03:33:01.767570+0000","last_peered":"2024-09-17T03:33:01.767570+0000","last_clean":"2024-09-17T03:33:01.767570+0000","last_became_active":"2024-09-17T03:32:59.753253+0000","last_became_peered":"2024-09-17T03:32:59.753253+0000","last_unstale":"2024-09-17T03:33:01.767570+0000","last_undegraded":"2024-09-17T03:33:01.767570+0000","last_fullsized":"2024-09-17T03:33:01.767570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:26.495834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772112+0000","last_change":"2024-09-17T03:33:00.771853+0000","last_active":"2024-09-17T03:33:01.772112+0000","last_peered":"2024-09-17T03:33:01.772112+0000","last_clean":"2024-09-17T03:33:01.772112+0000","last_became_active":"2024-09-17T03:33:00.771534+0000","last_became_peered":"2024-09-17T03:33:00.771534+0000","last_unstale":"2024-09-17T03:33:01.772112+0000","last_undegraded":"2024-09-17T03:33:01.772112+0000","last_fullsized":"2024-09-17T03:33:01.772112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:07.316072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828986+0000","last_change":"2024-09-17T03:32:59.763327+0000","last_active":"2024-09-17T03:33:01.828986+0000","last_peered":"2024-09-17T03:33:01.828986+0000","last_clean":"2024-09-17T03:33:01.828986+0000","last_became_active":"2024-09-17T03:32:59.762808+0000","last_became_peered":"2024-09-17T03:32:59.762808+0000","last_unstale":"2024-09-17T03:33:01.828986+0000","last_undegraded":"2024-09-17T03:33:01.828986+0000","last_fullsized":"2024-09-17T03:33:01.828986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:09.031060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767457+0000","last_change":"2024-09-17T03:33:00.760233+0000","last_active":"2024-09-17T03:33:01.767457+0000","last_peered":"2024-09-17T03:33:01.767457+0000","last_clean":"2024-09-17T03:33:01.767457+0000","last_became_active":"2024-09-17T03:33:00.759904+0000","last_became_peered":"2024-09-17T03:33:00.759904+0000","last_unstale":"2024-09-17T03:33:01.767457+0000","last_undegraded":"2024-09-17T03:33:01.767457+0000","last_fullsized":"2024-09-17T03:33:01.767457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:23.150098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767506+0000","last_change":"2024-09-17T03:32:59.752736+0000","last_active":"2024-09-17T03:33:01.767506+0000","last_peered":"2024-09-17T03:33:01.767506+0000","last_clean":"2024-09-17T03:33:01.767506+0000","last_became_active":"2024-09-17T03:32:59.752395+0000","last_became_peered":"2024-09-17T03:32:59.752395+0000","last_unstale":"2024-09-17T03:33:01.767506+0000","last_undegraded":"2024-09-17T03:33:01.767506+0000","last_fullsized":"2024-09-17T03:33:01.767506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:39.649900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828852+0000","last_change":"2024-09-17T03:33:00.777441+0000","last_active":"2024-09-17T03:33:01.828852+0000","last_peered":"2024-09-17T03:33:01.828852+0000","last_clean":"2024-09-17T03:33:01.828852+0000","last_became_active":"2024-09-17T03:33:00.777102+0000","last_became_peered":"2024-09-17T03:33:00.777102+0000","last_unstale":"2024-09-17T03:33:01.828852+0000","last_undegraded":"2024-09-17T03:33:01.828852+0000","last_fullsized":"2024-09-17T03:33:01.828852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.389271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770870+0000","last_change":"2024-09-17T03:32:59.758935+0000","last_active":"2024-09-17T03:33:01.770870+0000","last_peered":"2024-09-17T03:33:01.770870+0000","last_clean":"2024-09-17T03:33:01.770870+0000","last_became_active":"2024-09-17T03:32:59.758594+0000","last_became_peered":"2024-09-17T03:32:59.758594+0000","last_unstale":"2024-09-17T03:33:01.770870+0000","last_undegraded":"2024-09-17T03:33:01.770870+0000","last_fullsized":"2024-09-17T03:33:01.770870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:47.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828639+0000","last_change":"2024-09-17T03:33:00.765218+0000","last_active":"2024-09-17T03:33:01.828639+0000","last_peered":"2024-09-17T03:33:01.828639+0000","last_clean":"2024-09-17T03:33:01.828639+0000","last_became_active":"2024-09-17T03:33:00.764728+0000","last_became_peered":"2024-09-17T03:33:00.764728+0000","last_unstale":"2024-09-17T03:33:01.828639+0000","last_undegraded":"2024-09-17T03:33:01.828639+0000","last_fullsized":"2024-09-17T03:33:01.828639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:19.020262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827701+0000","last_change":"2024-09-17T03:32:59.763500+0000","last_active":"2024-09-17T03:33:01.827701+0000","last_peered":"2024-09-17T03:33:01.827701+0000","last_clean":"2024-09-17T03:33:01.827701+0000","last_became_active":"2024-09-17T03:32:59.763055+0000","last_became_peered":"2024-09-17T03:32:59.763055+0000","last_unstale":"2024-09-17T03:33:01.827701+0000","last_undegraded":"2024-09-17T03:33:01.827701+0000","last_fullsized":"2024-09-17T03:33:01.827701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:08.648990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828125+0000","last_change":"2024-09-17T03:33:00.768008+0000","last_active":"2024-09-17T03:33:01.828125+0000","last_peered":"2024-09-17T03:33:01.828125+0000","last_clean":"2024-09-17T03:33:01.828125+0000","last_became_active":"2024-09-17T03:33:00.767649+0000","last_became_peered":"2024-09-17T03:33:00.767649+0000","last_unstale":"2024-09-17T03:33:01.828125+0000","last_undegraded":"2024-09-17T03:33:01.828125+0000","last_fullsized":"2024-09-17T03:33:01.828125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.501201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767401+0000","last_change":"2024-09-17T03:32:59.761083+0000","last_active":"2024-09-17T03:33:01.767401+0000","last_peered":"2024-09-17T03:33:01.767401+0000","last_clean":"2024-09-17T03:33:01.767401+0000","last_became_active":"2024-09-17T03:32:59.760765+0000","last_became_peered":"2024-09-17T03:32:59.760765+0000","last_unstale":"2024-09-17T03:33:01.767401+0000","last_undegraded":"2024-09-17T03:33:01.767401+0000","last_fullsized":"2024-09-17T03:33:01.767401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:28.016759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828140+0000","last_change":"2024-09-17T03:33:00.761340+0000","last_active":"2024-09-17T03:33:01.828140+0000","last_peered":"2024-09-17T03:33:01.828140+0000","last_clean":"2024-09-17T03:33:01.828140+0000","last_became_active":"2024-09-17T03:33:00.760617+0000","last_became_peered":"2024-09-17T03:33:00.760617+0000","last_unstale":"2024-09-17T03:33:01.828140+0000","last_undegraded":"2024-09-17T03:33:01.828140+0000","last_fullsized":"2024-09-17T03:33:01.828140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:17.573959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767550+0000","last_change":"2024-09-17T03:32:59.760660+0000","last_active":"2024-09-17T03:33:01.767550+0000","last_peered":"2024-09-17T03:33:01.767550+0000","last_clean":"2024-09-17T03:33:01.767550+0000","last_became_active":"2024-09-17T03:32:59.760223+0000","last_became_peered":"2024-09-17T03:32:59.760223+0000","last_unstale":"2024-09-17T03:33:01.767550+0000","last_undegraded":"2024-09-17T03:33:01.767550+0000","last_fullsized":"2024-09-17T03:33:01.767550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:04.446287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828236+0000","last_change":"2024-09-17T03:33:00.773988+0000","last_active":"2024-09-17T03:33:01.828236+0000","last_peered":"2024-09-17T03:33:01.828236+0000","last_clean":"2024-09-17T03:33:01.828236+0000","last_became_active":"2024-09-17T03:33:00.773669+0000","last_became_peered":"2024-09-17T03:33:00.773669+0000","last_unstale":"2024-09-17T03:33:01.828236+0000","last_undegraded":"2024-09-17T03:33:01.828236+0000","last_fullsized":"2024-09-17T03:33:01.828236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:36.829010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829149+0000","last_change":"2024-09-17T03:32:59.763512+0000","last_active":"2024-09-17T03:33:01.829149+0000","last_peered":"2024-09-17T03:33:01.829149+0000","last_clean":"2024-09-17T03:33:01.829149+0000","last_became_active":"2024-09-17T03:32:59.763073+0000","last_became_peered":"2024-09-17T03:32:59.763073+0000","last_unstale":"2024-09-17T03:33:01.829149+0000","last_undegraded":"2024-09-17T03:33:01.829149+0000","last_fullsized":"2024-09-17T03:33:01.829149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:05.582982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771163+0000","last_change":"2024-09-17T03:33:00.760569+0000","last_active":"2024-09-17T03:33:01.771163+0000","last_peered":"2024-09-17T03:33:01.771163+0000","last_clean":"2024-09-17T03:33:01.771163+0000","last_became_active":"2024-09-17T03:33:00.760215+0000","last_became_peered":"2024-09-17T03:33:00.760215+0000","last_unstale":"2024-09-17T03:33:01.771163+0000","last_undegraded":"2024-09-17T03:33:01.771163+0000","last_fullsized":"2024-09-17T03:33:01.771163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.597440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772055+0000","last_change":"2024-09-17T03:33:00.775407+0000","last_active":"2024-09-17T03:33:01.772055+0000","last_peered":"2024-09-17T03:33:01.772055+0000","last_clean":"2024-09-17T03:33:01.772055+0000","last_became_active":"2024-09-17T03:33:00.773657+0000","last_became_peered":"2024-09-17T03:33:00.773657+0000","last_unstale":"2024-09-17T03:33:01.772055+0000","last_undegraded":"2024-09-17T03:33:01.772055+0000","last_fullsized":"2024-09-17T03:33:01.772055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:18.984982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828727+0000","last_change":"2024-09-17T03:32:59.763902+0000","last_active":"2024-09-17T03:33:01.828727+0000","last_peered":"2024-09-17T03:33:01.828727+0000","last_clean":"2024-09-17T03:33:01.828727+0000","last_became_active":"2024-09-17T03:32:59.763401+0000","last_became_peered":"2024-09-17T03:32:59.763401+0000","last_unstale":"2024-09-17T03:33:01.828727+0000","last_undegraded":"2024-09-17T03:33:01.828727+0000","last_fullsized":"2024-09-17T03:33:01.828727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:25.445460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771973+0000","last_change":"2024-09-17T03:33:00.777352+0000","last_active":"2024-09-17T03:33:01.771973+0000","last_peered":"2024-09-17T03:33:01.771973+0000","last_clean":"2024-09-17T03:33:01.771973+0000","last_became_active":"2024-09-17T03:33:00.777033+0000","last_became_peered":"2024-09-17T03:33:00.777033+0000","last_unstale":"2024-09-17T03:33:01.771973+0000","last_undegraded":"2024-09-17T03:33:01.771973+0000","last_fullsized":"2024-09-17T03:33:01.771973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:46.197387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828815+0000","last_change":"2024-09-17T03:32:59.764471+0000","last_active":"2024-09-17T03:33:01.828815+0000","last_peered":"2024-09-17T03:33:01.828815+0000","last_clean":"2024-09-17T03:33:01.828815+0000","last_became_active":"2024-09-17T03:32:59.763904+0000","last_became_peered":"2024-09-17T03:32:59.763904+0000","last_unstale":"2024-09-17T03:33:01.828815+0000","last_undegraded":"2024-09-17T03:33:01.828815+0000","last_fullsized":"2024-09-17T03:33:01.828815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:26.131547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828645+0000","last_change":"2024-09-17T03:33:00.779461+0000","last_active":"2024-09-17T03:33:01.828645+0000","last_peered":"2024-09-17T03:33:01.828645+0000","last_clean":"2024-09-17T03:33:01.828645+0000","last_became_active":"2024-09-17T03:33:00.779082+0000","last_became_peered":"2024-09-17T03:33:00.779082+0000","last_unstale":"2024-09-17T03:33:01.828645+0000","last_undegraded":"2024-09-17T03:33:01.828645+0000","last_fullsized":"2024-09-17T03:33:01.828645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:07.035577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828382+0000","last_change":"2024-09-17T03:32:59.763107+0000","last_active":"2024-09-17T03:33:01.828382+0000","last_peered":"2024-09-17T03:33:01.828382+0000","last_clean":"2024-09-17T03:33:01.828382+0000","last_became_active":"2024-09-17T03:32:59.762811+0000","last_became_peered":"2024-09-17T03:32:59.762811+0000","last_unstale":"2024-09-17T03:33:01.828382+0000","last_undegraded":"2024-09-17T03:33:01.828382+0000","last_fullsized":"2024-09-17T03:33:01.828382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828252+0000","last_change":"2024-09-17T03:33:00.774953+0000","last_active":"2024-09-17T03:33:01.828252+0000","last_peered":"2024-09-17T03:33:01.828252+0000","last_clean":"2024-09-17T03:33:01.828252+0000","last_became_active":"2024-09-17T03:33:00.773865+0000","last_became_peered":"2024-09-17T03:33:00.773865+0000","last_unstale":"2024-09-17T03:33:01.828252+0000","last_undegraded":"2024-09-17T03:33:01.828252+0000","last_fullsized":"2024-09-17T03:33:01.828252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:03.734959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828747+0000","last_change":"2024-09-17T03:32:59.760741+0000","last_active":"2024-09-17T03:33:01.828747+0000","last_peered":"2024-09-17T03:33:01.828747+0000","last_clean":"2024-09-17T03:33:01.828747+0000","last_became_active":"2024-09-17T03:32:59.760355+0000","last_became_peered":"2024-09-17T03:32:59.760355+0000","last_unstale":"2024-09-17T03:33:01.828747+0000","last_undegraded":"2024-09-17T03:33:01.828747+0000","last_fullsized":"2024-09-17T03:33:01.828747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:14.945781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:08.546 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:33:08.547 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T03:33:08.547 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T03:33:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.697+0000 7f7daeb57640 1 -- 172.21.15.146:0/1373402945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7da80b7c20 msgr2=0x7f7da80ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.697+0000 7f7daeb57640 1 --2- 172.21.15.146:0/1373402945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7da80b7c20 0x7f7da80ccbd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7da80cebc0 tx=0x7f7da402a560 comp rx=0 tx=0).stop 2024-09-17T03:33:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.697+0000 7f7daeb57640 1 -- 172.21.15.146:0/1373402945 shutdown_connections 2024-09-17T03:33:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.697+0000 7f7daeb57640 1 --2- 172.21.15.146:0/1373402945 >> v2:172.21.15.179:3300/0 conn(0x7f7da8160990 0x7f7da80d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.697+0000 7f7daeb57640 1 --2- 172.21.15.146:0/1373402945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7da80c78a0 0x7f7da8160450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.697+0000 7f7daeb57640 1 --2- 172.21.15.146:0/1373402945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7da80b7c20 0x7f7da80ccbd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.697+0000 7f7daeb57640 1 -- 172.21.15.146:0/1373402945 >> 172.21.15.146:0/1373402945 conn(0x7f7da80b4190 msgr2=0x7f7da80b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.697+0000 7f7daeb57640 1 -- 172.21.15.146:0/1373402945 shutdown_connections 2024-09-17T03:33:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.697+0000 7f7daeb57640 1 -- 172.21.15.146:0/1373402945 wait complete. 2024-09-17T03:33:08.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.699+0000 7f7daeb57640 1 Processor -- start 2024-09-17T03:33:08.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.699+0000 7f7daeb57640 1 -- start start 2024-09-17T03:33:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.700+0000 7f7daeb57640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7da80b7c20 0x7f7da815f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.700+0000 7f7daeb57640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7da80c78a0 0x7f7da8149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.700+0000 7f7daeb57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7da8160990 0x7f7da814c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.700+0000 7f7daeb57640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7da815cc60 con 0x7f7da80c78a0 2024-09-17T03:33:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.700+0000 7f7daeb57640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7da80cd110 con 0x7f7da80b7c20 2024-09-17T03:33:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.700+0000 7f7daeb57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7da80d17d0 con 0x7f7da8160990 2024-09-17T03:33:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7da80c78a0 0x7f7da8149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7da80c78a0 0x7f7da8149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50318/0 (socket says 172.21.15.146:50318) 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9ffff640 1 -- 172.21.15.146:0/3111003635 learned_addr learned my addr 172.21.15.146:0/3111003635 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7dac8f3640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7da80b7c20 0x7f7da815f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7dad0f4640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7da8160990 0x7f7da814c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9ffff640 1 -- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7da8160990 msgr2=0x7f7da814c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9ffff640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7da8160990 0x7f7da814c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9ffff640 1 -- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7da80b7c20 msgr2=0x7f7da815f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9ffff640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7da80b7c20 0x7f7da815f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9ffff640 1 -- 172.21.15.146:0/3111003635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da809cb10 con 0x7f7da80c78a0 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9ffff640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7da80c78a0 0x7f7da8149900 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800d680 tx=0x7f7d9800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9d7fa640 1 -- 172.21.15.146:0/3111003635 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98017070 con 0x7f7da80c78a0 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9d7fa640 1 -- 172.21.15.146:0/3111003635 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d98004310 con 0x7f7da80c78a0 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7daeb57640 1 -- 172.21.15.146:0/3111003635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da814a310 con 0x7f7da80c78a0 2024-09-17T03:33:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7d9d7fa640 1 -- 172.21.15.146:0/3111003635 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98005280 con 0x7f7da80c78a0 2024-09-17T03:33:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.701+0000 7f7daeb57640 1 -- 172.21.15.146:0/3111003635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da814a8d0 con 0x7f7da80c78a0 2024-09-17T03:33:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.703+0000 7f7daeb57640 1 -- 172.21.15.146:0/3111003635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da8160020 con 0x7f7da80c78a0 2024-09-17T03:33:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.703+0000 7f7d9d7fa640 1 -- 172.21.15.146:0/3111003635 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d98005420 con 0x7f7da80c78a0 2024-09-17T03:33:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.703+0000 7f7d9d7fa640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d94078b90 0x7f7d9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.704+0000 7f7d9d7fa640 1 -- 172.21.15.146:0/3111003635 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d9809ae70 con 0x7f7da80c78a0 2024-09-17T03:33:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.704+0000 7f7dac8f3640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d94078b90 0x7f7d9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:08.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.704+0000 7f7dac8f3640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d94078b90 0x7f7d9407b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7da4033000 tx=0x7f7da4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.708+0000 7f7d9d7fa640 1 -- 172.21.15.146:0/3111003635 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7da8160020 con 0x7f7da80c78a0 2024-09-17T03:33:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.893+0000 7f7daeb57640 1 -- 172.21.15.146:0/3111003635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f7da8075390 con 0x7f7da80c78a0 2024-09-17T03:33:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.893+0000 7f7d9d7fa640 1 -- 172.21.15.146:0/3111003635 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f7d98020020 con 0x7f7da80c78a0 2024-09-17T03:33:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:08.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.895+0000 7f7daeb57640 1 -- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d94078b90 msgr2=0x7f7d9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:08.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.895+0000 7f7daeb57640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d94078b90 0x7f7d9407b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7da4033000 tx=0x7f7da4004730 comp rx=0 tx=0).stop 2024-09-17T03:33:08.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.895+0000 7f7daeb57640 1 -- 172.21.15.146:0/3111003635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7da80c78a0 msgr2=0x7f7da8149900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:08.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.895+0000 7f7daeb57640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7da80c78a0 0x7f7da8149900 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800d680 tx=0x7f7d9800db40 comp rx=0 tx=0).stop 2024-09-17T03:33:08.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.896+0000 7f7daeb57640 1 -- 172.21.15.146:0/3111003635 shutdown_connections 2024-09-17T03:33:08.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.896+0000 7f7daeb57640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d94078b90 0x7f7d9407b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.896+0000 7f7daeb57640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7da8160990 0x7f7da814c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.896+0000 7f7daeb57640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7da80c78a0 0x7f7da8149900 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.896+0000 7f7daeb57640 1 --2- 172.21.15.146:0/3111003635 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7da80b7c20 0x7f7da815f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.896+0000 7f7daeb57640 1 -- 172.21.15.146:0/3111003635 >> 172.21.15.146:0/3111003635 conn(0x7f7da80b4190 msgr2=0x7f7da80b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.896+0000 7f7daeb57640 1 -- 172.21.15.146:0/3111003635 shutdown_connections 2024-09-17T03:33:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:08.896+0000 7f7daeb57640 1 -- 172.21.15.146:0/3111003635 wait complete. 2024-09-17T03:33:08.906 INFO:teuthology.orchestra.run.smithi146.stdout:[{"version":31,"timestamp":"2024-09-17T03:32:48.235526+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"5312.580561"}]}] 2024-09-17T03:33:08.907 INFO:tasks.ceph_manager:config epoch is 31 2024-09-17T03:33:08.907 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T03:33:08.907 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T03:33:08.908 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T03:33:09.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.020+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/1830393602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5d40b3d30 msgr2=0x7fc5d415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.020+0000 7fc5dbd6a640 1 --2- 172.21.15.146:0/1830393602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5d40b3d30 0x7fc5d415caa0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc005fd0 tx=0x7fc5cc02aa90 comp rx=0 tx=0).stop 2024-09-17T03:33:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.020+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/1830393602 shutdown_connections 2024-09-17T03:33:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.020+0000 7fc5dbd6a640 1 --2- 172.21.15.146:0/1830393602 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5d40b3d30 0x7fc5d415caa0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.020+0000 7fc5dbd6a640 1 --2- 172.21.15.146:0/1830393602 >> v2:172.21.15.179:3300/0 conn(0x7fc5d40b5ce0 0x7fc5d40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.020+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/1830393602 >> 172.21.15.146:0/1830393602 conn(0x7fc5d40b7b20 msgr2=0x7fc5d409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.020+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/1830393602 shutdown_connections 2024-09-17T03:33:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.020+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/1830393602 wait complete. 2024-09-17T03:33:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.022+0000 7fc5dbd6a640 1 Processor -- start 2024-09-17T03:33:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.022+0000 7fc5dbd6a640 1 -- start start 2024-09-17T03:33:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.023+0000 7fc5dbd6a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d40b5750 0x7fc5d415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.023+0000 7fc5dbd6a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d40b5ce0 0x7fc5d415f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.023+0000 7fc5dbd6a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5d414e470 0x7fc5d41f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.023+0000 7fc5dbd6a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d415d510 con 0x7fc5d40b5750 2024-09-17T03:33:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.023+0000 7fc5dbd6a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d415d390 con 0x7fc5d40b5ce0 2024-09-17T03:33:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.023+0000 7fc5dbd6a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc5d415d690 con 0x7fc5d414e470 2024-09-17T03:33:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.023+0000 7fc5d9b06640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d40b5750 0x7fc5d415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.023+0000 7fc5d9b06640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d40b5750 0x7fc5d415ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50324/0 (socket says 172.21.15.146:50324) 2024-09-17T03:33:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.023+0000 7fc5d9b06640 1 -- 172.21.15.146:0/3699987667 learned_addr learned my addr 172.21.15.146:0/3699987667 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.023+0000 7fc5d9305640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d40b5ce0 0x7fc5d415f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.023+0000 7fc5da307640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5d414e470 0x7fc5d41f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.024+0000 7fc5d9b06640 1 -- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5d414e470 msgr2=0x7fc5d41f94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.024+0000 7fc5d9b06640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5d414e470 0x7fc5d41f94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.024+0000 7fc5d9b06640 1 -- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d40b5ce0 msgr2=0x7fc5d415f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.024+0000 7fc5d9b06640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d40b5ce0 0x7fc5d415f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.024+0000 7fc5d9b06640 1 -- 172.21.15.146:0/3699987667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d4159720 con 0x7fc5d40b5750 2024-09-17T03:33:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.024+0000 7fc5d9b06640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d40b5750 0x7fc5d415ee10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000ea20 tx=0x7fc5d000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.024+0000 7fc5ca7fc640 1 -- 172.21.15.146:0/3699987667 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d000ce40 con 0x7fc5d40b5750 2024-09-17T03:33:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.024+0000 7fc5ca7fc640 1 -- 172.21.15.146:0/3699987667 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5d0004020 con 0x7fc5d40b5750 2024-09-17T03:33:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.024+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/3699987667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d41599c0 con 0x7fc5d40b5750 2024-09-17T03:33:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.024+0000 7fc5ca7fc640 1 -- 172.21.15.146:0/3699987667 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0004470 con 0x7fc5d40b5750 2024-09-17T03:33:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.024+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/3699987667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d41e5350 con 0x7fc5d40b5750 2024-09-17T03:33:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.025+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/3699987667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5d415dbb0 con 0x7fc5d40b5750 2024-09-17T03:33:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.026+0000 7fc5ca7fc640 1 -- 172.21.15.146:0/3699987667 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc5d00035f0 con 0x7fc5d40b5750 2024-09-17T03:33:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.026+0000 7fc5ca7fc640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5b8078b90 0x7fc5b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.027+0000 7fc5ca7fc640 1 -- 172.21.15.146:0/3699987667 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc5d009b520 con 0x7fc5d40b5750 2024-09-17T03:33:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.027+0000 7fc5d9305640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5b8078b90 0x7fc5b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.027+0000 7fc5d9305640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5b8078b90 0x7fc5b807b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc5d415b3e0 tx=0x7fc5c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.031+0000 7fc5ca7fc640 1 -- 172.21.15.146:0/3699987667 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc5d00633b0 con 0x7fc5d40b5750 2024-09-17T03:33:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.250+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/3699987667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc5d40af850 con 0x7fc5d40b5750 2024-09-17T03:33:09.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.253+0000 7fc5ca7fc640 1 -- 172.21.15.146:0/3699987667 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194720 (secure 0 0 0) 0x7fc5d0067de0 con 0x7fc5d40b5750 2024-09-17T03:33:09.256 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.256+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5b8078b90 msgr2=0x7fc5b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.256+0000 7fc5dbd6a640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5b8078b90 0x7fc5b807b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc5d415b3e0 tx=0x7fc5c4009040 comp rx=0 tx=0).stop 2024-09-17T03:33:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.256+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/3699987667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d40b5750 msgr2=0x7fc5d415ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.256+0000 7fc5dbd6a640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d40b5750 0x7fc5d415ee10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000ea20 tx=0x7fc5d000eee0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.257+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/3699987667 shutdown_connections 2024-09-17T03:33:09.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.257+0000 7fc5dbd6a640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5b8078b90 0x7fc5b807b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.257+0000 7fc5dbd6a640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5d414e470 0x7fc5d41f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.257+0000 7fc5dbd6a640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d40b5ce0 0x7fc5d415f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.257+0000 7fc5dbd6a640 1 --2- 172.21.15.146:0/3699987667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d40b5750 0x7fc5d415ee10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.257+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/3699987667 >> 172.21.15.146:0/3699987667 conn(0x7fc5d40b7b20 msgr2=0x7fc5d40b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.257+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/3699987667 shutdown_connections 2024-09-17T03:33:09.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.257+0000 7fc5dbd6a640 1 -- 172.21.15.146:0/3699987667 wait complete. 2024-09-17T03:33:09.268 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3262901240},{"type":"v1","addr":"172.21.15.179:6801","nonce":3262901240}]},"active_addr":"172.21.15.179:6801/3262901240","active_change":"2024-09-17T03:32:39.780024+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4117,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":2641825053}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":2213989258}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":70639604}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":2029742982}]}]} 2024-09-17T03:33:09.272 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T03:33:09.272 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T03:33:09.272 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.384+0000 7f24a3be6640 1 -- 172.21.15.146:0/3719350625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c0b55f0 msgr2=0x7f249c070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.384+0000 7f24a3be6640 1 --2- 172.21.15.146:0/3719350625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c0b55f0 0x7f249c070be0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2498009830 tx=0x7f249802a5c0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.384+0000 7f24a3be6640 1 -- 172.21.15.146:0/3719350625 shutdown_connections 2024-09-17T03:33:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.384+0000 7f24a3be6640 1 --2- 172.21.15.146:0/3719350625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c0b55f0 0x7f249c070be0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.384+0000 7f24a3be6640 1 -- 172.21.15.146:0/3719350625 >> 172.21.15.146:0/3719350625 conn(0x7f249c0b3410 msgr2=0x7f249c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.384+0000 7f24a3be6640 1 -- 172.21.15.146:0/3719350625 shutdown_connections 2024-09-17T03:33:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.384+0000 7f24a3be6640 1 -- 172.21.15.146:0/3719350625 wait complete. 2024-09-17T03:33:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.386+0000 7f24a3be6640 1 Processor -- start 2024-09-17T03:33:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.386+0000 7f24a3be6640 1 -- start start 2024-09-17T03:33:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.387+0000 7f24a3be6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c06dd60 0x7f249c1f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.387+0000 7f24a3be6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f249c071120 0x7f249c14ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.387+0000 7f24a3be6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c0b55f0 0x7f249c151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.387+0000 7f24a3be6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f249c15c0a0 con 0x7f249c06dd60 2024-09-17T03:33:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.387+0000 7f24a3be6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f249c15bf20 con 0x7f249c0b55f0 2024-09-17T03:33:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.387+0000 7f24a3be6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f249c15c220 con 0x7f249c071120 2024-09-17T03:33:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a1982640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c06dd60 0x7f249c1f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a1982640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c06dd60 0x7f249c1f8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50340/0 (socket says 172.21.15.146:50340) 2024-09-17T03:33:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a1982640 1 -- 172.21.15.146:0/54424480 learned_addr learned my addr 172.21.15.146:0/54424480 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a1181640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f249c071120 0x7f249c14ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a2183640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c0b55f0 0x7f249c151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a1982640 1 -- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f249c071120 msgr2=0x7f249c14ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a1982640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f249c071120 0x7f249c14ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a1982640 1 -- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c0b55f0 msgr2=0x7f249c151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a1982640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c0b55f0 0x7f249c151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a1982640 1 -- 172.21.15.146:0/54424480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c150af0 con 0x7f249c06dd60 2024-09-17T03:33:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a1982640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c06dd60 0x7f249c1f8020 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2498000c00 tx=0x7f2498033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24927fc640 1 -- 172.21.15.146:0/54424480 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2498031d60 con 0x7f249c06dd60 2024-09-17T03:33:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24927fc640 1 -- 172.21.15.146:0/54424480 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24980330d0 con 0x7f249c06dd60 2024-09-17T03:33:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24927fc640 1 -- 172.21.15.146:0/54424480 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2498033520 con 0x7f249c06dd60 2024-09-17T03:33:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a3be6640 1 -- 172.21.15.146:0/54424480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249c150d90 con 0x7f249c06dd60 2024-09-17T03:33:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.388+0000 7f24a3be6640 1 -- 172.21.15.146:0/54424480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249c151350 con 0x7f249c06dd60 2024-09-17T03:33:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.389+0000 7f24a3be6640 1 -- 172.21.15.146:0/54424480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249c15c6d0 con 0x7f249c06dd60 2024-09-17T03:33:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.390+0000 7f24927fc640 1 -- 172.21.15.146:0/54424480 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24980035f0 con 0x7f249c06dd60 2024-09-17T03:33:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.390+0000 7f24927fc640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2480078bc0 0x7f248007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.391+0000 7f24927fc640 1 -- 172.21.15.146:0/54424480 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f24980bc020 con 0x7f249c06dd60 2024-09-17T03:33:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.391+0000 7f24a1181640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2480078bc0 0x7f248007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.391+0000 7f24a1181640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2480078bc0 0x7f248007b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f248c0046b0 tx=0x7f248c007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.395+0000 7f24927fc640 1 -- 172.21.15.146:0/54424480 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f249803f030 con 0x7f249c06dd60 2024-09-17T03:33:09.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.571+0000 7f24a3be6640 1 -- 172.21.15.146:0/54424480 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f249c0b2ee0 con 0x7f249c06dd60 2024-09-17T03:33:09.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.572+0000 7f24927fc640 1 -- 172.21.15.146:0/54424480 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7f2498083ea0 con 0x7f249c06dd60 2024-09-17T03:33:09.572 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:09.572 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:01.757648+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:32:57.968580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:32:59.068488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 -- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2480078bc0 msgr2=0x7f248007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2480078bc0 0x7f248007b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f248c0046b0 tx=0x7f248c007eb0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 -- 172.21.15.146:0/54424480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c06dd60 msgr2=0x7f249c1f8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c06dd60 0x7f249c1f8020 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2498000c00 tx=0x7f2498033d60 comp rx=0 tx=0).stop 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 -- 172.21.15.146:0/54424480 shutdown_connections 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2480078bc0 0x7f248007b0d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c0b55f0 0x7f249c151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f249c071120 0x7f249c14ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 --2- 172.21.15.146:0/54424480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249c06dd60 0x7f249c1f8020 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 -- 172.21.15.146:0/54424480 >> 172.21.15.146:0/54424480 conn(0x7f249c0b3410 msgr2=0x7f249c159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 -- 172.21.15.146:0/54424480 shutdown_connections 2024-09-17T03:33:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.574+0000 7f24a3be6640 1 -- 172.21.15.146:0/54424480 wait complete. 2024-09-17T03:33:09.585 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T03:33:09.586 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.699+0000 7f2c1724d640 1 -- 172.21.15.146:0/2409559135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf8003a00 msgr2=0x7f2bf8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.699+0000 7f2c1724d640 1 --2- 172.21.15.146:0/2409559135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf8003a00 0x7f2bf8003e70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00bb20 tx=0x7f2bf8005830 comp rx=0 tx=0).stop 2024-09-17T03:33:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.699+0000 7f2c157ea640 1 -- 172.21.15.146:0/2409559135 reap_dead start 2024-09-17T03:33:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.699+0000 7f2c1724d640 1 -- 172.21.15.146:0/2409559135 shutdown_connections 2024-09-17T03:33:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.699+0000 7f2c1724d640 1 -- 172.21.15.146:0/2409559135 >> 172.21.15.146:0/2409559135 conn(0x7f2c100b7b20 msgr2=0x7f2c1009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.699+0000 7f2c1724d640 1 -- 172.21.15.146:0/2409559135 shutdown_connections 2024-09-17T03:33:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.699+0000 7f2c1724d640 1 -- 172.21.15.146:0/2409559135 wait complete. 2024-09-17T03:33:09.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.701+0000 7f2c1724d640 1 Processor -- start 2024-09-17T03:33:09.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.701+0000 7f2c1724d640 1 -- start start 2024-09-17T03:33:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.702+0000 7f2c1724d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf8003a00 0x7f2c101f05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.702+0000 7f2c1724d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c10144f00 0x7f2c10157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.702+0000 7f2c1724d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c101f7330 0x7f2c101f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.702+0000 7f2c1724d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1015caa0 con 0x7f2bf8003a00 2024-09-17T03:33:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.702+0000 7f2c1724d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1015cc20 con 0x7f2c10144f00 2024-09-17T03:33:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.702+0000 7f2c1724d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1015cda0 con 0x7f2c101f7330 2024-09-17T03:33:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c14fe9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf8003a00 0x7f2c101f05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c14fe9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf8003a00 0x7f2c101f05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50358/0 (socket says 172.21.15.146:50358) 2024-09-17T03:33:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c14fe9640 1 -- 172.21.15.146:0/511105460 learned_addr learned my addr 172.21.15.146:0/511105460 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c07fff640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c10144f00 0x7f2c10157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c157ea640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c101f7330 0x7f2c101f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c14fe9640 1 -- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c101f7330 msgr2=0x7f2c101f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c14fe9640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c101f7330 0x7f2c101f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c14fe9640 1 -- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c10144f00 msgr2=0x7f2c10157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c14fe9640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c10144f00 0x7f2c10157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c14fe9640 1 -- 172.21.15.146:0/511105460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c101f0b30 con 0x7f2bf8003a00 2024-09-17T03:33:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c14fe9640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf8003a00 0x7f2c101f05f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00bb20 tx=0x7f2c0c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c057fa640 1 -- 172.21.15.146:0/511105460 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c040070 con 0x7f2bf8003a00 2024-09-17T03:33:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c057fa640 1 -- 172.21.15.146:0/511105460 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c0c004250 con 0x7f2bf8003a00 2024-09-17T03:33:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c1724d640 1 -- 172.21.15.146:0/511105460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c101578d0 con 0x7f2bf8003a00 2024-09-17T03:33:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c057fa640 1 -- 172.21.15.146:0/511105460 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c035040 con 0x7f2bf8003a00 2024-09-17T03:33:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.703+0000 7f2c1724d640 1 -- 172.21.15.146:0/511105460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c10154ca0 con 0x7f2bf8003a00 2024-09-17T03:33:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.704+0000 7f2c1724d640 1 -- 172.21.15.146:0/511105460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c100b1320 con 0x7f2bf8003a00 2024-09-17T03:33:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.705+0000 7f2c057fa640 1 -- 172.21.15.146:0/511105460 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c0c038020 con 0x7f2bf8003a00 2024-09-17T03:33:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.706+0000 7f2c057fa640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2bfc078b90 0x7f2bfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.706+0000 7f2c057fa640 1 -- 172.21.15.146:0/511105460 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2c0c0bbbd0 con 0x7f2bf8003a00 2024-09-17T03:33:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.706+0000 7f2c07fff640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2bfc078b90 0x7f2bfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.706+0000 7f2c07fff640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2bfc078b90 0x7f2bfc07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2c1015a2e0 tx=0x7f2c000014b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:09.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.710+0000 7f2c057fa640 1 -- 172.21.15.146:0/511105460 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2c0c084010 con 0x7f2bf8003a00 2024-09-17T03:33:09.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.886+0000 7f2c1724d640 1 -- 172.21.15.146:0/511105460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c101588c0 con 0x7f2bf8003a00 2024-09-17T03:33:09.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.887+0000 7f2c057fa640 1 -- 172.21.15.146:0/511105460 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7f2c0c043e40 con 0x7f2bf8003a00 2024-09-17T03:33:09.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:09.887 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:01.757648+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:32:57.968580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:32:59.068488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 -- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2bfc078b90 msgr2=0x7f2bfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2bfc078b90 0x7f2bfc07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2c1015a2e0 tx=0x7f2c000014b0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 -- 172.21.15.146:0/511105460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf8003a00 msgr2=0x7f2c101f05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf8003a00 0x7f2c101f05f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00bb20 tx=0x7f2c0c00b6f0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 -- 172.21.15.146:0/511105460 shutdown_connections 2024-09-17T03:33:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2bfc078b90 0x7f2bfc07b0a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2c101f7330 0x7f2c101f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c10144f00 0x7f2c10157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 --2- 172.21.15.146:0/511105460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf8003a00 0x7f2c101f05f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 -- 172.21.15.146:0/511105460 >> 172.21.15.146:0/511105460 conn(0x7f2c100b7b20 msgr2=0x7f2c101597a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:09.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 -- 172.21.15.146:0/511105460 shutdown_connections 2024-09-17T03:33:09.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:09.889+0000 7f2c1724d640 1 -- 172.21.15.146:0/511105460 wait complete. 2024-09-17T03:33:09.901 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T03:33:09.901 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T03:33:09.902 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T03:33:09.902 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T03:33:09.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T03:33:09.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T03:33:09.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T03:33:09.904 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T03:33:10.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.129+0000 7f97069c3640 1 -- 172.21.15.146:0/3689603255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96e8005270 msgr2=0x7f96e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.129+0000 7f97069c3640 1 --2- 172.21.15.146:0/3689603255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96e8005270 0x7f96e800b9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f96f8005fd0 tx=0x7f96e8005830 comp rx=0 tx=0).stop 2024-09-17T03:33:10.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.128+0000 7febe159a640 1 -- 172.21.15.146:0/3217783137 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd4031bf0 con 0x7febe4073740 2024-09-17T03:33:10.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.129+0000 7febe359e640 1 -- 172.21.15.146:0/3217783137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febe4073740 msgr2=0x7febe415f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.129+0000 7febe359e640 1 --2- 172.21.15.146:0/3217783137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febe4073740 0x7febe415f0e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7febd4009830 tx=0x7febd402a520 comp rx=0 tx=0).stop 2024-09-17T03:33:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.129+0000 7febe359e640 1 -- 172.21.15.146:0/3217783137 shutdown_connections 2024-09-17T03:33:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.129+0000 7febe359e640 1 --2- 172.21.15.146:0/3217783137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febe4073740 0x7febe415f0e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.129+0000 7febe359e640 1 --2- 172.21.15.146:0/3217783137 >> v2:172.21.15.146:3300/0 conn(0x7febe4070040 0x7febe40b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.129+0000 7febe359e640 1 -- 172.21.15.146:0/3217783137 >> 172.21.15.146:0/3217783137 conn(0x7febe40b2010 msgr2=0x7febe40b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f57227fc640 1 -- 172.21.15.146:0/3196858727 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c032990 con 0x7f57240735f0 2024-09-17T03:33:10.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f5729ace640 1 -- 172.21.15.146:0/3196858727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57240735f0 msgr2=0x7f5724073a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f97069c3640 1 -- 172.21.15.146:0/3689603255 shutdown_connections 2024-09-17T03:33:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f97069c3640 1 --2- 172.21.15.146:0/3689603255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96e8005270 0x7f96e800b9c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f97069c3640 1 -- 172.21.15.146:0/3689603255 >> 172.21.15.146:0/3689603255 conn(0x7f97000b1f30 msgr2=0x7f97000b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f5729ace640 1 --2- 172.21.15.146:0/3196858727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57240735f0 0x7f5724073a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5724072dc0 tx=0x7f571c02a820 comp rx=0 tx=0).stop 2024-09-17T03:33:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f97069c3640 1 -- 172.21.15.146:0/3689603255 shutdown_connections 2024-09-17T03:33:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f97069c3640 1 -- 172.21.15.146:0/3689603255 wait complete. 2024-09-17T03:33:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f5729ace640 1 -- 172.21.15.146:0/3196858727 shutdown_connections 2024-09-17T03:33:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f5729ace640 1 --2- 172.21.15.146:0/3196858727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57240735f0 0x7f5724073a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f5729ace640 1 --2- 172.21.15.146:0/3196858727 >> v2:172.21.15.179:3300/0 conn(0x7f57240cdf90 0x7f572415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.130+0000 7f5729ace640 1 -- 172.21.15.146:0/3196858727 >> 172.21.15.146:0/3196858727 conn(0x7f57240b3510 msgr2=0x7f57240b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.131+0000 7febe359e640 1 -- 172.21.15.146:0/3217783137 shutdown_connections 2024-09-17T03:33:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.131+0000 7febe359e640 1 -- 172.21.15.146:0/3217783137 wait complete. 2024-09-17T03:33:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.131+0000 7f5729ace640 1 -- 172.21.15.146:0/3196858727 shutdown_connections 2024-09-17T03:33:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.131+0000 7fba99343640 1 -- 172.21.15.146:0/3152469106 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba840047a0 con 0x7fba941668a0 2024-09-17T03:33:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.132+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3152469106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba941668a0 msgr2=0x7fba94168cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.132+0000 7fba9c5a9640 1 --2- 172.21.15.146:0/3152469106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba941668a0 0x7fba94168cc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba940b5390 tx=0x7fba8402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.131+0000 7f5729ace640 1 -- 172.21.15.146:0/3196858727 wait complete. 2024-09-17T03:33:10.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.133+0000 7f97069c3640 1 Processor -- start 2024-09-17T03:33:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.133+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3152469106 shutdown_connections 2024-09-17T03:33:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.133+0000 7fba9c5a9640 1 --2- 172.21.15.146:0/3152469106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba941668a0 0x7fba94168cc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.133+0000 7fba9c5a9640 1 --2- 172.21.15.146:0/3152469106 >> v2:172.21.15.179:3300/0 conn(0x7fba9406e990 0x7fba9406eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.133+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3152469106 >> 172.21.15.146:0/3152469106 conn(0x7fba940b7b20 msgr2=0x7fba9409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.133+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3152469106 shutdown_connections 2024-09-17T03:33:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7f97069c3640 1 -- start start 2024-09-17T03:33:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7f5c71d78640 1 -- 172.21.15.146:0/1201951087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c640df180 msgr2=0x7f5c64005c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7f5c71d78640 1 --2- 172.21.15.146:0/1201951087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c640df180 0x7f5c64005c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c02ebd0 tx=0x7f5c6c06c1f0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7f5c71d78640 1 -- 172.21.15.146:0/1201951087 shutdown_connections 2024-09-17T03:33:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7f5c71d78640 1 --2- 172.21.15.146:0/1201951087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c640df180 0x7f5c64005c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7f5c71d78640 1 -- 172.21.15.146:0/1201951087 >> 172.21.15.146:0/1201951087 conn(0x7f5c64051420 msgr2=0x7f5c64051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3152469106 wait complete. 2024-09-17T03:33:10.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7f5c71d78640 1 -- 172.21.15.146:0/1201951087 shutdown_connections 2024-09-17T03:33:10.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7f082b67e640 1 -- 172.21.15.146:0/3685347509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08240d1410 msgr2=0x7f082415ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7f082b67e640 1 --2- 172.21.15.146:0/3685347509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08240d1410 0x7f082415ea10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f082406dbc0 tx=0x7f081c02ebf0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.135+0000 7f082b67e640 1 -- 172.21.15.146:0/3685347509 shutdown_connections 2024-09-17T03:33:10.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.135+0000 7f082b67e640 1 --2- 172.21.15.146:0/3685347509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08240d1410 0x7f082415ea10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.135+0000 7f082b67e640 1 -- 172.21.15.146:0/3685347509 >> 172.21.15.146:0/3685347509 conn(0x7f082406d070 msgr2=0x7f082406d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.135+0000 7f5729ace640 1 Processor -- start 2024-09-17T03:33:10.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7f5c71d78640 1 -- 172.21.15.146:0/1201951087 wait complete. 2024-09-17T03:33:10.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7febe359e640 1 Processor -- start 2024-09-17T03:33:10.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.134+0000 7febe359e640 1 -- start start 2024-09-17T03:33:10.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.135+0000 7f5729ace640 1 -- start start 2024-09-17T03:33:10.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.135+0000 7f082b67e640 1 -- 172.21.15.146:0/3685347509 shutdown_connections 2024-09-17T03:33:10.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7fabae3ad640 1 -- 172.21.15.146:0/3363374935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba80b3870 msgr2=0x7faba80cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7fabae3ad640 1 --2- 172.21.15.146:0/3363374935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba80b3870 0x7faba80cf370 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faba80b73c0 tx=0x7faba002a950 comp rx=0 tx=0).stop 2024-09-17T03:33:10.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7f97069c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96e8005270 0x7f9700153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.135+0000 7f082b67e640 1 -- 172.21.15.146:0/3685347509 wait complete. 2024-09-17T03:33:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7f57e359e640 1 -- 172.21.15.146:0/346370635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57dc009ba0 msgr2=0x7f57dc005c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7f57e359e640 1 --2- 172.21.15.146:0/346370635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57dc009ba0 0x7f57dc005c60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f57d8005fd0 tx=0x7f57d802a530 comp rx=0 tx=0).stop 2024-09-17T03:33:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7f96fffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96e8005270 0x7f9700153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7f96fffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96e8005270 0x7f9700153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50438/0 (socket says 172.21.15.146:50438) 2024-09-17T03:33:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7f96fffff640 1 -- 172.21.15.146:0/378887388 learned_addr learned my addr 172.21.15.146:0/378887388 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7f97069c3640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97000b4e90 0x7f9700074360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7f57e359e640 1 -- 172.21.15.146:0/346370635 shutdown_connections 2024-09-17T03:33:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7f57e359e640 1 --2- 172.21.15.146:0/346370635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57dc009ba0 0x7f57dc005c60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7f57e359e640 1 --2- 172.21.15.146:0/346370635 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57dc00bc30 0x7f57dc0df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7fabae3ad640 1 -- 172.21.15.146:0/3363374935 shutdown_connections 2024-09-17T03:33:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7fba9c5a9640 1 Processor -- start 2024-09-17T03:33:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7f57e359e640 1 -- 172.21.15.146:0/346370635 >> 172.21.15.146:0/346370635 conn(0x7f57dc051420 msgr2=0x7f57dc051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7fabae3ad640 1 --2- 172.21.15.146:0/3363374935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faba806f440 0x7faba80d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7fabae3ad640 1 --2- 172.21.15.146:0/3363374935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba80b3870 0x7faba80cf370 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7fabae3ad640 1 -- 172.21.15.146:0/3363374935 >> 172.21.15.146:0/3363374935 conn(0x7faba80d4be0 msgr2=0x7faba80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7febe359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febe4073740 0x7febe42019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7febe359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe40b2b30 0x7febe415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7febe359e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febe4159650 0x7febe415bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7febe259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febe4073740 0x7febe42019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7febe259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febe4073740 0x7febe42019a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:36258/0 (socket says 172.21.15.146:36258) 2024-09-17T03:33:10.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.136+0000 7febe1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe40b2b30 0x7febe415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7fba9c5a9640 1 -- start start 2024-09-17T03:33:10.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe40b2b30 0x7febe415b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50448/0 (socket says 172.21.15.146:50448) 2024-09-17T03:33:10.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe259c640 1 -- 172.21.15.146:0/3596973267 learned_addr learned my addr 172.21.15.146:0/3596973267 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe359e640 1 -- 172.21.15.146:0/3596973267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7febe415f7a0 con 0x7febe40b2b30 2024-09-17T03:33:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe359e640 1 -- 172.21.15.146:0/3596973267 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7febe415f620 con 0x7febe4159650 2024-09-17T03:33:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe359e640 1 -- 172.21.15.146:0/3596973267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7febe415f920 con 0x7febe4073740 2024-09-17T03:33:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7f57e359e640 1 -- 172.21.15.146:0/346370635 shutdown_connections 2024-09-17T03:33:10.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7f57e359e640 1 -- 172.21.15.146:0/346370635 wait complete. 2024-09-17T03:33:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7f97069c3640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9700163300 0x7f97000748a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7f96ff7fe640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97000b4e90 0x7f9700074360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7f5c71d78640 1 Processor -- start 2024-09-17T03:33:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7f5c71d78640 1 -- start start 2024-09-17T03:33:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7f5729ace640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57240735f0 0x7f5724158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f97000ae010 con 0x7f96e8005270 2024-09-17T03:33:10.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7fabae3ad640 1 -- 172.21.15.146:0/3363374935 shutdown_connections 2024-09-17T03:33:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7fabae3ad640 1 -- 172.21.15.146:0/3363374935 wait complete. 2024-09-17T03:33:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe2d9d640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febe4159650 0x7febe415bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe259c640 1 -- 172.21.15.146:0/3596973267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febe4159650 msgr2=0x7febe415bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe259c640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febe4159650 0x7febe415bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe259c640 1 -- 172.21.15.146:0/3596973267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe40b2b30 msgr2=0x7febe415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe259c640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe40b2b30 0x7febe415b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe259c640 1 -- 172.21.15.146:0/3596973267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe415acc0 con 0x7febe4073740 2024-09-17T03:33:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.137+0000 7febe1d9b640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe40b2b30 0x7febe415b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:33:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f9704f60640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9700163300 0x7f97000748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f57237fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57240735f0 0x7f5724158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f57237fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57240735f0 0x7f5724158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50456/0 (socket says 172.21.15.146:50456) 2024-09-17T03:33:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f5729ace640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57240cdf90 0x7f572413fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f5729ace640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57241556c0 0x7f5724143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f5729ace640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f57240b67f0 con 0x7f57240735f0 2024-09-17T03:33:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f5729ace640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5724070140 con 0x7f57240cdf90 2024-09-17T03:33:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f5729ace640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f572406cc50 con 0x7f57241556c0 2024-09-17T03:33:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f57237fe640 1 -- 172.21.15.146:0/1966296437 learned_addr learned my addr 172.21.15.146:0/1966296437 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7febe259c640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febe4073740 0x7febe42019a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7febdc00cb40 tx=0x7febdc00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f97000ade90 con 0x7f97000b4e90 2024-09-17T03:33:10.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f97001668a0 con 0x7f9700163300 2024-09-17T03:33:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f082b67e640 1 Processor -- start 2024-09-17T03:33:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f082b67e640 1 -- start start 2024-09-17T03:33:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f96fffff640 1 -- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9700163300 msgr2=0x7f97000748a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f96fffff640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9700163300 0x7f97000748a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f96fffff640 1 -- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97000b4e90 msgr2=0x7f9700074360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f96fffff640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97000b4e90 0x7f9700074360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f96fffff640 1 -- 172.21.15.146:0/378887388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97001f9e70 con 0x7f96e8005270 2024-09-17T03:33:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7fba9c5a9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba9406e990 0x7fba941471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7f5723fff640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57241556c0 0x7f5724143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f57237fe640 1 -- 172.21.15.146:0/1966296437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57241556c0 msgr2=0x7f5724143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f57237fe640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57241556c0 0x7f5724143810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f57237fe640 1 -- 172.21.15.146:0/1966296437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57240cdf90 msgr2=0x7f572413fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f57237fe640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57240cdf90 0x7f572413fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f57237fe640 1 -- 172.21.15.146:0/1966296437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572415b250 con 0x7f57240735f0 2024-09-17T03:33:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7fba9c5a9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba9415ef10 0x7fba9414f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f5c71d78640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c64009ba0 0x7f5c64043350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7fba9a345640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba9406e990 0x7fba941471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f5c71d78640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c640df180 0x7f5c64043890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7fba9a345640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba9406e990 0x7fba941471b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50468/0 (socket says 172.21.15.146:50468) 2024-09-17T03:33:10.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7fba99b44640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba9415ef10 0x7fba9414f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c71d78640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c6417ef20 0x7f5c64181890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c70d76640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c64009ba0 0x7f5c64043350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c71d78640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5c64006d70 con 0x7f5c640df180 2024-09-17T03:33:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c71d78640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6400be40 con 0x7f5c64009ba0 2024-09-17T03:33:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c71d78640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5c64006ef0 con 0x7f5c6417ef20 2024-09-17T03:33:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c70d76640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c64009ba0 0x7f5c64043350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:59246/0 (socket says 172.21.15.146:59246) 2024-09-17T03:33:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c70d76640 1 -- 172.21.15.146:0/3815715311 learned_addr learned my addr 172.21.15.146:0/3815715311 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f96fffff640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96e8005270 0x7f9700153be0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f96f4001240 tx=0x7f96f4003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7fba99b44640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba9415ef10 0x7fba9414f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:36278/0 (socket says 172.21.15.146:36278) 2024-09-17T03:33:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c6bfff640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c640df180 0x7f5c64043890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f96fcff9640 1 -- 172.21.15.146:0/378887388 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4015070 con 0x7f96e8005270 2024-09-17T03:33:10.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c71577640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c6417ef20 0x7f5c64181890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f96fcff9640 1 -- 172.21.15.146:0/378887388 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96f400f980 con 0x7f96e8005270 2024-09-17T03:33:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.139+0000 7f57237fe640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57240735f0 0x7f5724158a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f571400e9c0 tx=0x7f571400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f570bfff640 1 -- 172.21.15.146:0/1966296437 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714004020 con 0x7f57240735f0 2024-09-17T03:33:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f570bfff640 1 -- 172.21.15.146:0/1966296437 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57140042b0 con 0x7f57240735f0 2024-09-17T03:33:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f570bfff640 1 -- 172.21.15.146:0/1966296437 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571400cab0 con 0x7f57240735f0 2024-09-17T03:33:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7febd2ffd640 1 -- 172.21.15.146:0/3596973267 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc016020 con 0x7febe4073740 2024-09-17T03:33:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7febd2ffd640 1 -- 172.21.15.146:0/3596973267 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febdc00adb0 con 0x7febe4073740 2024-09-17T03:33:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7febd2ffd640 1 -- 172.21.15.146:0/3596973267 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc012680 con 0x7febe4073740 2024-09-17T03:33:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7febe359e640 1 -- 172.21.15.146:0/3596973267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe415afa0 con 0x7febe4073740 2024-09-17T03:33:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.138+0000 7febe359e640 1 -- 172.21.15.146:0/3596973267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7febe4157b40 con 0x7febe4073740 2024-09-17T03:33:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7febe359e640 1 -- 172.21.15.146:0/3596973267 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7febe41566a0 con 0x7febe4073740 2024-09-17T03:33:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9700154120 con 0x7f96e8005270 2024-09-17T03:33:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9700160280 con 0x7f96e8005270 2024-09-17T03:33:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f9704f60640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9700163300 0x7f97000748a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:33:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f082b67e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f082406abd0 0x7f082413c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f082b67e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08240b5890 0x7f08241e6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f082941a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f082406abd0 0x7f082413c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f082b67e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0824159ac0 0x7f08241e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f082941a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f082406abd0 0x7f082413c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:36286/0 (socket says 172.21.15.146:36286) 2024-09-17T03:33:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f082b67e640 1 -- 172.21.15.146:0/3493847608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f082415f360 con 0x7f08240b5890 2024-09-17T03:33:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f082b67e640 1 -- 172.21.15.146:0/3493847608 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f082415f1e0 con 0x7f0824159ac0 2024-09-17T03:33:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f082941a640 1 -- 172.21.15.146:0/3493847608 learned_addr learned my addr 172.21.15.146:0/3493847608 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f082b67e640 1 -- 172.21.15.146:0/3493847608 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f082406e7b0 con 0x7f082406abd0 2024-09-17T03:33:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f0829c1b640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0824159ac0 0x7f08241e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f0828c19640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08240b5890 0x7f08241e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f57e359e640 1 Processor -- start 2024-09-17T03:33:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f57e359e640 1 -- start start 2024-09-17T03:33:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7fabae3ad640 1 Processor -- start 2024-09-17T03:33:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7fabae3ad640 1 -- start start 2024-09-17T03:33:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c70d76640 1 -- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c6417ef20 msgr2=0x7f5c64181890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c70d76640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c6417ef20 0x7f5c64181890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c70d76640 1 -- 172.21.15.146:0/3815715311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c640df180 msgr2=0x7f5c64043890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c70d76640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c640df180 0x7f5c64043890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c70d76640 1 -- 172.21.15.146:0/3815715311 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6417e310 con 0x7f5c64009ba0 2024-09-17T03:33:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.140+0000 7f5c70d76640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c64009ba0 0x7f5c64043350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000c410 tx=0x7f5c6000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f5c697fa640 1 -- 172.21.15.146:0/3815715311 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60017070 con 0x7f5c64009ba0 2024-09-17T03:33:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f5c697fa640 1 -- 172.21.15.146:0/3815715311 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c60005320 con 0x7f5c64009ba0 2024-09-17T03:33:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f5c697fa640 1 -- 172.21.15.146:0/3815715311 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c600047f0 con 0x7f5c64009ba0 2024-09-17T03:33:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f5c71d78640 1 -- 172.21.15.146:0/3815715311 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6417e5d0 con 0x7f5c64009ba0 2024-09-17T03:33:10.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7fba9a345640 1 -- 172.21.15.146:0/3655668723 learned_addr learned my addr 172.21.15.146:0/3655668723 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7fba9c5a9640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba941668a0 0x7fba9415f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7f0829c1b640 1 -- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f082406abd0 msgr2=0x7f082413c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7f0829c1b640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f082406abd0 0x7f082413c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7f0829c1b640 1 -- 172.21.15.146:0/3493847608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08240b5890 msgr2=0x7f08241e6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7f0829c1b640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08240b5890 0x7f08241e6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7f0829c1b640 1 -- 172.21.15.146:0/3493847608 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08241403d0 con 0x7f0824159ac0 2024-09-17T03:33:10.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fba940b75f0 con 0x7fba9406e990 2024-09-17T03:33:10.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7f0829c1b640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0824159ac0 0x7f08241e6bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f081400b3e0 tx=0x7f081400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7fba9ab46640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba941668a0 0x7fba9415f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7f0819ffb640 1 -- 172.21.15.146:0/3493847608 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814015020 con 0x7f0824159ac0 2024-09-17T03:33:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fba940b7470 con 0x7fba941668a0 2024-09-17T03:33:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7f0819ffb640 1 -- 172.21.15.146:0/3493847608 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0814011940 con 0x7f0824159ac0 2024-09-17T03:33:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7f57e359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57dc009ba0 0x7f57dc02b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fba940c7570 con 0x7fba9415ef10 2024-09-17T03:33:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7f082b67e640 1 -- 172.21.15.146:0/3493847608 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0824074610 con 0x7f0824159ac0 2024-09-17T03:33:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.142+0000 7febd2ffd640 1 -- 172.21.15.146:0/3596973267 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7febdc019020 con 0x7febe4073740 2024-09-17T03:33:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57dc00bc30 0x7f57dc0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f082b67e640 1 -- 172.21.15.146:0/3493847608 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f082413ccd0 con 0x7f0824159ac0 2024-09-17T03:33:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f96fcff9640 1 -- 172.21.15.146:0/378887388 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f400fdd0 con 0x7f96e8005270 2024-09-17T03:33:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.141+0000 7f96e67fc640 1 -- 172.21.15.146:0/378887388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96e0001030 con 0x7f96e8005270 2024-09-17T03:33:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f0819ffb640 1 -- 172.21.15.146:0/3493847608 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0814011d90 con 0x7f0824159ac0 2024-09-17T03:33:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e359e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57dc036400 0x7f57dc172c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e1d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57dc00bc30 0x7f57dc0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e1d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57dc00bc30 0x7f57dc0cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:36296/0 (socket says 172.21.15.146:36296) 2024-09-17T03:33:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e359e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc0069f0 con 0x7f57dc009ba0 2024-09-17T03:33:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e1d9b640 1 -- 172.21.15.146:0/3655060197 learned_addr learned my addr 172.21.15.146:0/3655060197 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e359e640 1 -- 172.21.15.146:0/3655060197 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc006870 con 0x7f57dc036400 2024-09-17T03:33:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e359e640 1 -- 172.21.15.146:0/3655060197 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f57dc006b70 con 0x7f57dc00bc30 2024-09-17T03:33:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e2d9d640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57dc036400 0x7f57dc172c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7fba99b44640 1 -- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba941668a0 msgr2=0x7fba9415f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7fba99b44640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba941668a0 0x7fba9415f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7fba99b44640 1 -- 172.21.15.146:0/3655668723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba9406e990 msgr2=0x7fba941471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7fba99b44640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba9406e990 0x7fba941471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7fba99b44640 1 -- 172.21.15.146:0/3655668723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9414e870 con 0x7fba9415ef10 2024-09-17T03:33:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e1d9b640 1 -- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57dc036400 msgr2=0x7f57dc172c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e1d9b640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f57dc036400 0x7f57dc172c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e1d9b640 1 -- 172.21.15.146:0/3655060197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57dc009ba0 msgr2=0x7f57dc02b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e1d9b640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57dc009ba0 0x7f57dc02b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7f57e1d9b640 1 -- 172.21.15.146:0/3655060197 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc020060 con 0x7f57dc00bc30 2024-09-17T03:33:10.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7febd2ffd640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7febc4078c60 0x7febc407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.143+0000 7fabae3ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba80b3870 0x7faba80ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7fabae3ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba81620f0 0x7faba8151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7fba99b44640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba9415ef10 0x7fba9414f910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fba88016fc0 tx=0x7fba88014490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7f5c71d78640 1 -- 172.21.15.146:0/3815715311 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c6417f7e0 con 0x7f5c64009ba0 2024-09-17T03:33:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7f5729ace640 1 -- 172.21.15.146:0/1966296437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5724157c40 con 0x7f57240735f0 2024-09-17T03:33:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7febd2ffd640 1 -- 172.21.15.146:0/3596973267 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7febdc09b450 con 0x7febe4073740 2024-09-17T03:33:10.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7febd2ffd640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x7febc4080f30 0x7febc4083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7febe1d9b640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7febc4078c60 0x7febc407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7f5729ace640 1 -- 172.21.15.146:0/1966296437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5724158200 con 0x7f57240735f0 2024-09-17T03:33:10.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7f082b67e640 1 -- 172.21.15.146:0/3493847608 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0804001030 con 0x7f0824159ac0 2024-09-17T03:33:10.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7faba7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba80b3870 0x7faba80ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7febd2ffd640 1 -- 172.21.15.146:0/3596973267 --> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febdc020e80 con 0x7febc4080f30 2024-09-17T03:33:10.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7f57e1d9b640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57dc00bc30 0x7f57dc0cf430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f57d8034040 tx=0x7f57d8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7faba77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba81620f0 0x7faba8151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7faba7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba80b3870 0x7faba80ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:59296/0 (socket says 172.21.15.146:59296) 2024-09-17T03:33:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7fba92ffd640 1 -- 172.21.15.146:0/3655668723 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8800fbd0 con 0x7fba9415ef10 2024-09-17T03:33:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.145+0000 7f5729ace640 1 -- 172.21.15.146:0/1966296437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5724073a00 con 0x7f57240735f0 2024-09-17T03:33:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7febd2ffd640 1 -- 172.21.15.146:0/3596973267 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7febdc0a2050 con 0x7febe4073740 2024-09-17T03:33:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7febe2d9d640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x7febc4080f30 0x7febc4083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.145+0000 7f96fcff9640 1 -- 172.21.15.146:0/378887388 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96f4011430 con 0x7f96e8005270 2024-09-17T03:33:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7f96fcff9640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f96ec078c90 0x7f96ec07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7f96fcff9640 1 -- 172.21.15.146:0/378887388 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f96f409c050 con 0x7f96e8005270 2024-09-17T03:33:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.145+0000 7f57d2ffd640 1 -- 172.21.15.146:0/3655060197 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d803e030 con 0x7f57dc00bc30 2024-09-17T03:33:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.145+0000 7f57d2ffd640 1 -- 172.21.15.146:0/3655060197 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57d80047a0 con 0x7f57dc00bc30 2024-09-17T03:33:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.145+0000 7f57e359e640 1 -- 172.21.15.146:0/3655060197 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc01efc0 con 0x7f57dc00bc30 2024-09-17T03:33:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.145+0000 7f57d2ffd640 1 -- 172.21.15.146:0/3655060197 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8035040 con 0x7f57dc00bc30 2024-09-17T03:33:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.145+0000 7f57e359e640 1 -- 172.21.15.146:0/3655060197 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc01f580 con 0x7f57dc00bc30 2024-09-17T03:33:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7faba77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba81620f0 0x7faba8151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50492/0 (socket says 172.21.15.146:50492) 2024-09-17T03:33:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7fabae3ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faba8160020 0x7faba8160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7fabae3ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faba80d3b10 con 0x7faba81620f0 2024-09-17T03:33:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7fabae3ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faba80d3990 con 0x7faba80b3870 2024-09-17T03:33:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7fabae3ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7faba80d3c90 con 0x7faba8160020 2024-09-17T03:33:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.145+0000 7faba7fff640 1 -- 172.21.15.146:0/2483689340 learned_addr learned my addr 172.21.15.146:0/2483689340 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.145+0000 7f5c56ffd640 1 -- 172.21.15.146:0/3815715311 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c64007430 con 0x7f5c64009ba0 2024-09-17T03:33:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.144+0000 7fba92ffd640 1 -- 172.21.15.146:0/3655668723 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba88021070 con 0x7fba9415ef10 2024-09-17T03:33:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.145+0000 7fba92ffd640 1 -- 172.21.15.146:0/3655668723 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba880110d0 con 0x7fba9415ef10 2024-09-17T03:33:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9414eb50 con 0x7fba9415ef10 2024-09-17T03:33:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9414f110 con 0x7fba9415ef10 2024-09-17T03:33:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7f96fcff9640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x7f96ec080f00 0x7f96ec083350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7f96ff7fe640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f96ec078c90 0x7f96ec07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7f96fcff9640 1 -- 172.21.15.146:0/378887388 --> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96f4012ec0 con 0x7f96ec080f00 2024-09-17T03:33:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7f96fcff9640 1 -- 172.21.15.146:0/378887388 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f96f409c440 con 0x7f96e8005270 2024-09-17T03:33:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7f0819ffb640 1 -- 172.21.15.146:0/3493847608 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0814018020 con 0x7f0824159ac0 2024-09-17T03:33:10.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7f57d0ff9640 1 -- 172.21.15.146:0/3655060197 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f57dc01fc40 con 0x7f57dc00bc30 2024-09-17T03:33:10.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.145+0000 7fabac94a640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faba8160020 0x7faba8160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7fabac94a640 1 -- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba80b3870 msgr2=0x7faba80ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7fabac94a640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba80b3870 0x7faba80ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7fabac94a640 1 -- 172.21.15.146:0/2483689340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba81620f0 msgr2=0x7faba8151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7fabac94a640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba81620f0 0x7faba8151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7fabac94a640 1 -- 172.21.15.146:0/2483689340 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba8160970 con 0x7faba8160020 2024-09-17T03:33:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7fabac94a640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faba8160020 0x7faba8160430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab9800e970 tx=0x7fab9800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.146+0000 7faba4ff9640 1 -- 172.21.15.146:0/2483689340 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9800ccc0 con 0x7faba8160020 2024-09-17T03:33:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7f570bfff640 1 -- 172.21.15.146:0/1966296437 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f571400cc50 con 0x7f57240735f0 2024-09-17T03:33:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7febe2d9d640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x7febc4080f30 0x7febc4083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7f9704f60640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x7f96ec080f00 0x7f96ec083350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7faba4ff9640 1 -- 172.21.15.146:0/2483689340 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab9800ce60 con 0x7faba8160020 2024-09-17T03:33:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7faba4ff9640 1 -- 172.21.15.146:0/2483689340 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98004280 con 0x7faba8160020 2024-09-17T03:33:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7fabae3ad640 1 -- 172.21.15.146:0/2483689340 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba80c8620 con 0x7faba8160020 2024-09-17T03:33:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7f0819ffb640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0808078c10 0x7f080807b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7fabae3ad640 1 -- 172.21.15.146:0/2483689340 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faba80c8be0 con 0x7faba8160020 2024-09-17T03:33:10.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7f5c697fa640 1 -- 172.21.15.146:0/3815715311 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c6001a070 con 0x7f5c64009ba0 2024-09-17T03:33:10.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7f5c697fa640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5c50078b90 0x7f5c5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7f082941a640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0808078c10 0x7f080807b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7f5c6bfff640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5c50078b90 0x7f5c5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7f5c697fa640 1 -- 172.21.15.146:0/3815715311 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5c6009a3a0 con 0x7f5c64009ba0 2024-09-17T03:33:10.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f570bfff640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5710078c60 0x7f571007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f5c697fa640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] conn(0x7f5c50080e60 0x7f5c500832b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7f96ff7fe640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f96ec078c90 0x7f96ec07b1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97000b4e20 tx=0x7f96f0005cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f9704f60640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x7f96ec080f00 0x7f96ec083350 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f0819ffb640 1 -- 172.21.15.146:0/3493847608 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f081409b240 con 0x7f0824159ac0 2024-09-17T03:33:10.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f0819ffb640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x7f0808080e80 0x7f08080832d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f0819ffb640 1 -- 172.21.15.146:0/3493847608 --> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0814018ec0 con 0x7f0808080e80 2024-09-17T03:33:10.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f0819ffb640 1 -- 172.21.15.146:0/3493847608 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f081409b630 con 0x7f0824159ac0 2024-09-17T03:33:10.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f5c697fa640 1 -- 172.21.15.146:0/3815715311 --> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c50083980 con 0x7f5c50080e60 2024-09-17T03:33:10.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f5c697fa640 1 -- 172.21.15.146:0/3815715311 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5c6009a790 con 0x7f5c64009ba0 2024-09-17T03:33:10.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f5c71577640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] conn(0x7f5c50080e60 0x7f5c500832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f0828c19640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x7f0808080e80 0x7f08080832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.147+0000 7febe1d9b640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7febc4078c60 0x7febc407b170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7febe40cfd60 tx=0x7febd8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7febd2ffd640 1 -- 172.21.15.146:0/3596973267 <== osd.1 v2:172.21.15.146:6816/2854727168 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7febdc020e80 con 0x7febc4080f30 2024-09-17T03:33:10.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fba9406eda0 con 0x7fba9415ef10 2024-09-17T03:33:10.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f082941a640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0808078c10 0x7f080807b120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0820009990 tx=0x7f0820009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f5c6bfff640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5c50078b90 0x7f5c5007b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5c64006c30 tx=0x7f5c58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f0828c19640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x7f0808080e80 0x7f08080832d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f570bfff640 1 -- 172.21.15.146:0/1966296437 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f57140a3af0 con 0x7f57240735f0 2024-09-17T03:33:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7fba92ffd640 1 -- 172.21.15.146:0/3655668723 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba8801a050 con 0x7fba9415ef10 2024-09-17T03:33:10.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f5c71577640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] conn(0x7f5c50080e60 0x7f5c500832b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f5722ffd640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5710078c60 0x7f571007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f570bfff640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] conn(0x7f5710080f30 0x7f5710083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.148+0000 7f57d2ffd640 1 -- 172.21.15.146:0/3655060197 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f57d8041030 con 0x7f57dc00bc30 2024-09-17T03:33:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f57d2ffd640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f57c4078c60 0x7f57c407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f57d2ffd640 1 -- 172.21.15.146:0/3655060197 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f57d80bbb00 con 0x7f57dc00bc30 2024-09-17T03:33:10.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f57d2ffd640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] conn(0x7f57c4080ed0 0x7f57c4083320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f57d2ffd640 1 -- 172.21.15.146:0/3655060197 --> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57c40839f0 con 0x7f57c4080ed0 2024-09-17T03:33:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f57d2ffd640 1 -- 172.21.15.146:0/3655060197 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f57d80bbef0 con 0x7f57dc00bc30 2024-09-17T03:33:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f570bfff640 1 -- 172.21.15.146:0/1966296437 --> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5710083a50 con 0x7f5710080f30 2024-09-17T03:33:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f570bfff640 1 -- 172.21.15.146:0/1966296437 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f57140a82a0 con 0x7f57240735f0 2024-09-17T03:33:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7f5723fff640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] conn(0x7f5710080f30 0x7f5710083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7fabae3ad640 1 -- 172.21.15.146:0/2483689340 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab88001030 con 0x7faba8160020 2024-09-17T03:33:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7f57e259c640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f57c4078c60 0x7f57c407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7f57e2d9d640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] conn(0x7f57c4080ed0 0x7f57c4083320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7f5c697fa640 1 -- 172.21.15.146:0/3815715311 <== osd.7 v2:172.21.15.179:6826/1919891472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c50083980 con 0x7f5c50080e60 2024-09-17T03:33:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7faba4ff9640 1 -- 172.21.15.146:0/2483689340 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab980035f0 con 0x7faba8160020 2024-09-17T03:33:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.149+0000 7f96fcff9640 1 -- 172.21.15.146:0/378887388 <== osd.3 v2:172.21.15.146:6800/99103729 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96f4012ec0 con 0x7f96ec080f00 2024-09-17T03:33:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7fba92ffd640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fba80078c90 0x7fba8007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7f5723fff640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] conn(0x7f5710080f30 0x7f5710083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7f5722ffd640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5710078c60 0x7f571007b170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f571c034000 tx=0x7f571c004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7fba9a345640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fba80078c90 0x7fba8007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7fba92ffd640 1 -- 172.21.15.146:0/3655668723 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fba880a3430 con 0x7fba9415ef10 2024-09-17T03:33:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7fba9a345640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fba80078c90 0x7fba8007b1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba8c007fd0 tx=0x7fba8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7f0819ffb640 1 -- 172.21.15.146:0/3493847608 <== osd.4 v2:172.21.15.179:6818/3302933995 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0814018ec0 con 0x7f0808080e80 2024-09-17T03:33:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.150+0000 7faba4ff9640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab94078be0 0x7fab9407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7faba4ff9640 1 -- 172.21.15.146:0/2483689340 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fab9809b3a0 con 0x7faba8160020 2024-09-17T03:33:10.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7faba7fff640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab94078be0 0x7fab9407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7faba4ff9640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x7fab94080eb0 0x7fab94083300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7faba4ff9640 1 -- 172.21.15.146:0/2483689340 --> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab9801fe50 con 0x7fab94080eb0 2024-09-17T03:33:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7faba4ff9640 1 -- 172.21.15.146:0/2483689340 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fab980a2050 con 0x7faba8160020 2024-09-17T03:33:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7fba92ffd640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] conn(0x7fba80080f00 0x7fba80083350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7faba77fe640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x7fab94080eb0 0x7fab94083300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7fba92ffd640 1 -- 172.21.15.146:0/3655668723 --> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba80083a20 con 0x7fba80080f00 2024-09-17T03:33:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7fba92ffd640 1 -- 172.21.15.146:0/3655668723 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fba880aa050 con 0x7fba9415ef10 2024-09-17T03:33:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7faba7fff640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab94078be0 0x7fab9407b0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faba00094e0 tx=0x7faba0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7f57e2d9d640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] conn(0x7f57c4080ed0 0x7f57c4083320 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7f57e259c640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f57c4078c60 0x7f57c407b170 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57d400ddc0 tx=0x7f57d400f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7f570bfff640 1 -- 172.21.15.146:0/1966296437 <== osd.0 v2:172.21.15.146:6808/2899634261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5710083a50 con 0x7f5710080f30 2024-09-17T03:33:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.151+0000 7fba9ab46640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] conn(0x7fba80080f00 0x7fba80083350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.152+0000 7faba77fe640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x7fab94080eb0 0x7fab94083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.152+0000 7fba9ab46640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] conn(0x7fba80080f00 0x7fba80083350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.153+0000 7f57d2ffd640 1 -- 172.21.15.146:0/3655060197 <== osd.5 v2:172.21.15.179:6802/3411666156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f57c40839f0 con 0x7f57c4080ed0 2024-09-17T03:33:10.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.152+0000 7faba4ff9640 1 -- 172.21.15.146:0/2483689340 <== osd.6 v2:172.21.15.179:6810/1755575046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab9801fe50 con 0x7fab94080eb0 2024-09-17T03:33:10.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.153+0000 7fba92ffd640 1 -- 172.21.15.146:0/3655668723 <== osd.2 v2:172.21.15.146:6824/2785235792 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fba80083a20 con 0x7fba80080f00 2024-09-17T03:33:10.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.176+0000 7febe359e640 1 -- 172.21.15.146:0/3596973267 --> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7febe41560b0 con 0x7febc4080f30 2024-09-17T03:33:10.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.177+0000 7febd2ffd640 1 -- 172.21.15.146:0/3596973267 <== osd.1 v2:172.21.15.146:6816/2854727168 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7febe41560b0 con 0x7febc4080f30 2024-09-17T03:33:10.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.178+0000 7febd0ff9640 1 -- 172.21.15.146:0/3596973267 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x7febc4080f30 msgr2=0x7febc4083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.178+0000 7febd0ff9640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x7febc4080f30 0x7febc4083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.178+0000 7febd0ff9640 1 -- 172.21.15.146:0/3596973267 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7febc4078c60 msgr2=0x7febc407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.178+0000 7febd0ff9640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7febc4078c60 0x7febc407b170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7febe40cfd60 tx=0x7febd8005f90 comp rx=0 tx=0).stop 2024-09-17T03:33:10.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.178+0000 7febd0ff9640 1 -- 172.21.15.146:0/3596973267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febe4073740 msgr2=0x7febe42019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.178+0000 7febd0ff9640 1 --2- 172.21.15.146:0/3596973267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febe4073740 0x7febe42019a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7febdc00cb40 tx=0x7febdc00a060 comp rx=0 tx=0).stop 2024-09-17T03:33:10.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.178+0000 7febe2d9d640 1 -- 172.21.15.146:0/3596973267 reap_dead start 2024-09-17T03:33:10.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.180+0000 7f96e67fc640 1 -- 172.21.15.146:0/378887388 --> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f96e0002dd0 con 0x7f96ec080f00 2024-09-17T03:33:10.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.178+0000 7febd0ff9640 1 -- 172.21.15.146:0/3596973267 shutdown_connections 2024-09-17T03:33:10.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.178+0000 7febd0ff9640 1 -- 172.21.15.146:0/3596973267 >> 172.21.15.146:0/3596973267 conn(0x7febe40b2010 msgr2=0x7febe40ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.178+0000 7febd0ff9640 1 -- 172.21.15.146:0/3596973267 shutdown_connections 2024-09-17T03:33:10.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.178+0000 7febd0ff9640 1 -- 172.21.15.146:0/3596973267 wait complete. 2024-09-17T03:33:10.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.180+0000 7f082b67e640 1 -- 172.21.15.146:0/3493847608 --> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0804002d50 con 0x7f0808080e80 2024-09-17T03:33:10.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.180+0000 7f96fcff9640 1 -- 172.21.15.146:0/378887388 <== osd.3 v2:172.21.15.146:6800/99103729 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f96e0002dd0 con 0x7f96ec080f00 2024-09-17T03:33:10.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.180+0000 7f5c56ffd640 1 -- 172.21.15.146:0/3815715311 --> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5c640069a0 con 0x7f5c50080e60 2024-09-17T03:33:10.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.180+0000 7f0819ffb640 1 -- 172.21.15.146:0/3493847608 <== osd.4 v2:172.21.15.179:6818/3302933995 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0804002d50 con 0x7f0808080e80 2024-09-17T03:33:10.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f5c697fa640 1 -- 172.21.15.146:0/3815715311 <== osd.7 v2:172.21.15.179:6826/1919891472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5c640069a0 con 0x7f5c50080e60 2024-09-17T03:33:10.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x7f96ec080f00 msgr2=0x7f96ec083350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f080f7fe640 1 -- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x7f0808080e80 msgr2=0x7f08080832d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f080f7fe640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x7f0808080e80 0x7f08080832d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f97069c3640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x7f96ec080f00 0x7f96ec083350 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f96ec078c90 msgr2=0x7f96ec07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f97069c3640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f96ec078c90 0x7f96ec07b1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97000b4e20 tx=0x7f96f0005cb0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96e8005270 msgr2=0x7f9700153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f97069c3640 1 --2- 172.21.15.146:0/378887388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96e8005270 0x7f9700153be0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f96f4001240 tx=0x7f96f4003a80 comp rx=0 tx=0).stop 2024-09-17T03:33:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f9704f60640 1 -- 172.21.15.146:0/378887388 reap_dead start 2024-09-17T03:33:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 shutdown_connections 2024-09-17T03:33:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.181+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 >> 172.21.15.146:0/378887388 conn(0x7f97000b1f30 msgr2=0x7f97000b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 shutdown_connections 2024-09-17T03:33:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f97069c3640 1 -- 172.21.15.146:0/378887388 wait complete. 2024-09-17T03:33:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f080f7fe640 1 -- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0808078c10 msgr2=0x7f080807b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f080f7fe640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0808078c10 0x7f080807b120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0820009990 tx=0x7f0820009110 comp rx=0 tx=0).stop 2024-09-17T03:33:10.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f080f7fe640 1 -- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0824159ac0 msgr2=0x7f08241e6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f080f7fe640 1 --2- 172.21.15.146:0/3493847608 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0824159ac0 0x7f08241e6bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f081400b3e0 tx=0x7f081400b8a0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f0829c1b640 1 -- 172.21.15.146:0/3493847608 reap_dead start 2024-09-17T03:33:10.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f5c56ffd640 1 -- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] conn(0x7f5c50080e60 msgr2=0x7f5c500832b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f5c56ffd640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] conn(0x7f5c50080e60 0x7f5c500832b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f080f7fe640 1 -- 172.21.15.146:0/3493847608 shutdown_connections 2024-09-17T03:33:10.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f080f7fe640 1 -- 172.21.15.146:0/3493847608 >> 172.21.15.146:0/3493847608 conn(0x7f082406d070 msgr2=0x7f08240b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f5c56ffd640 1 -- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5c50078b90 msgr2=0x7f5c5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f5c56ffd640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5c50078b90 0x7f5c5007b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5c64006c30 tx=0x7f5c58009040 comp rx=0 tx=0).stop 2024-09-17T03:33:10.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f5729ace640 1 -- 172.21.15.146:0/1966296437 --> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f57240cd840 con 0x7f5710080f30 2024-09-17T03:33:10.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7fabae3ad640 1 -- 172.21.15.146:0/2483689340 --> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fab88002dd0 con 0x7fab94080eb0 2024-09-17T03:33:10.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f5c56ffd640 1 -- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c64009ba0 msgr2=0x7f5c64043350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f5c56ffd640 1 --2- 172.21.15.146:0/3815715311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c64009ba0 0x7f5c64043350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000c410 tx=0x7f5c6000c8d0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f5c71577640 1 -- 172.21.15.146:0/3815715311 reap_dead start 2024-09-17T03:33:10.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f5c56ffd640 1 -- 172.21.15.146:0/3815715311 shutdown_connections 2024-09-17T03:33:10.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.182+0000 7f5c56ffd640 1 -- 172.21.15.146:0/3815715311 >> 172.21.15.146:0/3815715311 conn(0x7f5c64051420 msgr2=0x7f5c64034e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7f570bfff640 1 -- 172.21.15.146:0/1966296437 <== osd.0 v2:172.21.15.146:6808/2899634261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f57240cd840 con 0x7f5710080f30 2024-09-17T03:33:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7f080f7fe640 1 -- 172.21.15.146:0/3493847608 shutdown_connections 2024-09-17T03:33:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7f080f7fe640 1 -- 172.21.15.146:0/3493847608 wait complete. 2024-09-17T03:33:10.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7faba4ff9640 1 -- 172.21.15.146:0/2483689340 <== osd.6 v2:172.21.15.179:6810/1755575046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fab88002dd0 con 0x7fab94080eb0 2024-09-17T03:33:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7f5c56ffd640 1 -- 172.21.15.146:0/3815715311 shutdown_connections 2024-09-17T03:33:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7f5709ffb640 1 -- 172.21.15.146:0/1966296437 >> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] conn(0x7f5710080f30 msgr2=0x7f5710083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7f57d0ff9640 1 -- 172.21.15.146:0/3655060197 --> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f57dc0508d0 con 0x7f57c4080ed0 2024-09-17T03:33:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7fabae3ad640 1 -- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x7fab94080eb0 msgr2=0x7fab94083300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7fabae3ad640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x7fab94080eb0 0x7fab94083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7f5709ffb640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] conn(0x7f5710080f30 0x7f5710083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7f5c56ffd640 1 -- 172.21.15.146:0/3815715311 wait complete. 2024-09-17T03:33:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7fabae3ad640 1 -- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab94078be0 msgr2=0x7fab9407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7fabae3ad640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab94078be0 0x7fab9407b0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faba00094e0 tx=0x7faba0004ab0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7fabae3ad640 1 -- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faba8160020 msgr2=0x7faba8160430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7fabae3ad640 1 --2- 172.21.15.146:0/2483689340 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faba8160020 0x7faba8160430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab9800e970 tx=0x7fab9800ee30 comp rx=0 tx=0).stop 2024-09-17T03:33:10.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7fabac94a640 1 -- 172.21.15.146:0/2483689340 reap_dead start 2024-09-17T03:33:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.183+0000 7f5709ffb640 1 -- 172.21.15.146:0/1966296437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5710078c60 msgr2=0x7f571007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7f5709ffb640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5710078c60 0x7f571007b170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f571c034000 tx=0x7f571c004a40 comp rx=0 tx=0).stop 2024-09-17T03:33:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7f5709ffb640 1 -- 172.21.15.146:0/1966296437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57240735f0 msgr2=0x7f5724158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7f5709ffb640 1 --2- 172.21.15.146:0/1966296437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57240735f0 0x7f5724158a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f571400e9c0 tx=0x7f571400ee80 comp rx=0 tx=0).stop 2024-09-17T03:33:10.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7f5723fff640 1 -- 172.21.15.146:0/1966296437 reap_dead start 2024-09-17T03:33:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7f5709ffb640 1 -- 172.21.15.146:0/1966296437 shutdown_connections 2024-09-17T03:33:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7f5709ffb640 1 -- 172.21.15.146:0/1966296437 >> 172.21.15.146:0/1966296437 conn(0x7f57240b3510 msgr2=0x7f572406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7fabae3ad640 1 -- 172.21.15.146:0/2483689340 shutdown_connections 2024-09-17T03:33:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7fabae3ad640 1 -- 172.21.15.146:0/2483689340 >> 172.21.15.146:0/2483689340 conn(0x7faba80d4be0 msgr2=0x7faba815d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 --> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fba9414f6d0 con 0x7fba80080f00 2024-09-17T03:33:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7f5709ffb640 1 -- 172.21.15.146:0/1966296437 shutdown_connections 2024-09-17T03:33:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7f5709ffb640 1 -- 172.21.15.146:0/1966296437 wait complete. 2024-09-17T03:33:10.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7f57d2ffd640 1 -- 172.21.15.146:0/3655060197 <== osd.5 v2:172.21.15.179:6802/3411666156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f57dc0508d0 con 0x7f57c4080ed0 2024-09-17T03:33:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7fabae3ad640 1 -- 172.21.15.146:0/2483689340 shutdown_connections 2024-09-17T03:33:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.184+0000 7fabae3ad640 1 -- 172.21.15.146:0/2483689340 wait complete. 2024-09-17T03:33:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.185+0000 7f57d0ff9640 1 -- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] conn(0x7f57c4080ed0 msgr2=0x7f57c4083320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.185+0000 7f57d0ff9640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] conn(0x7f57c4080ed0 0x7f57c4083320 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.185+0000 7fba92ffd640 1 -- 172.21.15.146:0/3655668723 <== osd.2 v2:172.21.15.146:6824/2785235792 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fba9414f6d0 con 0x7fba80080f00 2024-09-17T03:33:10.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.185+0000 7f57d0ff9640 1 -- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f57c4078c60 msgr2=0x7f57c407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.185+0000 7f57d0ff9640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f57c4078c60 0x7f57c407b170 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57d400ddc0 tx=0x7f57d400f040 comp rx=0 tx=0).stop 2024-09-17T03:33:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.185+0000 7f57d0ff9640 1 -- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57dc00bc30 msgr2=0x7f57dc0cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.185+0000 7f57d0ff9640 1 --2- 172.21.15.146:0/3655060197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f57dc00bc30 0x7f57dc0cf430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f57d8034040 tx=0x7f57d8003c10 comp rx=0 tx=0).stop 2024-09-17T03:33:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.185+0000 7f57e2d9d640 1 -- 172.21.15.146:0/3655060197 reap_dead start 2024-09-17T03:33:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.186+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 >> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] conn(0x7fba80080f00 msgr2=0x7fba80083350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.186+0000 7fba9c5a9640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] conn(0x7fba80080f00 0x7fba80083350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.186+0000 7f57d0ff9640 1 -- 172.21.15.146:0/3655060197 shutdown_connections 2024-09-17T03:33:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.186+0000 7f57d0ff9640 1 -- 172.21.15.146:0/3655060197 >> 172.21.15.146:0/3655060197 conn(0x7f57dc051420 msgr2=0x7f57dc0537e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.186+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fba80078c90 msgr2=0x7fba8007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.186+0000 7fba9c5a9640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fba80078c90 0x7fba8007b1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba8c007fd0 tx=0x7fba8c009040 comp rx=0 tx=0).stop 2024-09-17T03:33:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.186+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba9415ef10 msgr2=0x7fba9414f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.186+0000 7fba9c5a9640 1 --2- 172.21.15.146:0/3655668723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fba9415ef10 0x7fba9414f910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fba88016fc0 tx=0x7fba88014490 comp rx=0 tx=0).stop 2024-09-17T03:33:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.186+0000 7fba9ab46640 1 -- 172.21.15.146:0/3655668723 reap_dead start 2024-09-17T03:33:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.189+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 shutdown_connections 2024-09-17T03:33:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.189+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 >> 172.21.15.146:0/3655668723 conn(0x7fba940b7b20 msgr2=0x7fba9414dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.189+0000 7f57d0ff9640 1 -- 172.21.15.146:0/3655060197 shutdown_connections 2024-09-17T03:33:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.189+0000 7f57d0ff9640 1 -- 172.21.15.146:0/3655060197 wait complete. 2024-09-17T03:33:10.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.189+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 shutdown_connections 2024-09-17T03:33:10.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.189+0000 7fba9c5a9640 1 -- 172.21.15.146:0/3655668723 wait complete. 2024-09-17T03:33:10.218 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2024-09-17T03:33:10.219 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T03:33:10.219 INFO:teuthology.orchestra.run.smithi146.stdout:64424509448 2024-09-17T03:33:10.220 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T03:33:10.220 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2024-09-17T03:33:10.221 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T03:33:10.221 INFO:teuthology.orchestra.run.smithi146.stdout:64424509448 2024-09-17T03:33:10.222 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T03:33:10.222 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2024-09-17T03:33:10.223 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T03:33:10.223 INFO:teuthology.orchestra.run.smithi146.stdout:64424509448 2024-09-17T03:33:10.224 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T03:33:10.224 INFO:teuthology.orchestra.run.smithi146.stdout:64424509448 2024-09-17T03:33:10.225 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T03:33:10.225 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2024-09-17T03:33:10.226 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T03:33:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f9950c2e640 1 -- 172.21.15.146:0/20420134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f994c0b4f10 msgr2=0x7f994c072470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f7d33fff640 1 -- 172.21.15.146:0/2433862801 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d34031b80 con 0x7f7d3c0b50f0 2024-09-17T03:33:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f9950c2e640 1 --2- 172.21.15.146:0/20420134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f994c0b4f10 0x7f994c072470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9944005fd0 tx=0x7f994402e970 comp rx=0 tx=0).stop 2024-09-17T03:33:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f14801da640 1 -- 172.21.15.146:0/2369232654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1478070020 msgr2=0x7f147806cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f14801da640 1 --2- 172.21.15.146:0/2369232654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1478070020 0x7f147806cc50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1470005fd0 tx=0x7f147002aa10 comp rx=0 tx=0).stop 2024-09-17T03:33:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f14801da640 1 -- 172.21.15.146:0/2369232654 shutdown_connections 2024-09-17T03:33:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f14801da640 1 --2- 172.21.15.146:0/2369232654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1478070020 0x7f147806cc50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f14801da640 1 --2- 172.21.15.146:0/2369232654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1478073c90 0x7f147806fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f14801da640 1 -- 172.21.15.146:0/2369232654 >> 172.21.15.146:0/2369232654 conn(0x7f147806dd60 msgr2=0x7f147806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f9950c2e640 1 -- 172.21.15.146:0/20420134 shutdown_connections 2024-09-17T03:33:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f9950c2e640 1 --2- 172.21.15.146:0/20420134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f994c0b4f10 0x7f994c072470 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f9950c2e640 1 -- 172.21.15.146:0/20420134 >> 172.21.15.146:0/20420134 conn(0x7f994c0b2060 msgr2=0x7f994c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f9950c2e640 1 -- 172.21.15.146:0/20420134 shutdown_connections 2024-09-17T03:33:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f7d433a1640 1 -- 172.21.15.146:0/2433862801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3c0b50f0 msgr2=0x7f7d3c06e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f7d433a1640 1 --2- 172.21.15.146:0/2433862801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3c0b50f0 0x7f7d3c06e470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c075580 tx=0x7f7d3402a7e0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.489+0000 7f7d433a1640 1 -- 172.21.15.146:0/2433862801 shutdown_connections 2024-09-17T03:33:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.489+0000 7f7d433a1640 1 --2- 172.21.15.146:0/2433862801 >> v2:172.21.15.146:3300/0 conn(0x7f7d3c0704f0 0x7f7d3c072470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.489+0000 7f7d433a1640 1 --2- 172.21.15.146:0/2433862801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3c0b50f0 0x7f7d3c06e470 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.489+0000 7f7d433a1640 1 -- 172.21.15.146:0/2433862801 >> 172.21.15.146:0/2433862801 conn(0x7f7d3c0b2060 msgr2=0x7f7d3c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.489+0000 7f5d1bfff640 1 -- 172.21.15.146:0/1826670307 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1400b880 con 0x7f5d100053a0 2024-09-17T03:33:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.489+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/1826670307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d100053a0 msgr2=0x7f5d1000ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.489+0000 7f5d2b4c5640 1 --2- 172.21.15.146:0/1826670307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d100053a0 0x7f5d1000ba50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5d24163710 tx=0x7f5d10005830 comp rx=0 tx=0).stop 2024-09-17T03:33:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.489+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/1826670307 shutdown_connections 2024-09-17T03:33:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.489+0000 7f5d2b4c5640 1 --2- 172.21.15.146:0/1826670307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d100053a0 0x7f5d1000ba50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.489+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/1826670307 >> 172.21.15.146:0/1826670307 conn(0x7f5d240b3510 msgr2=0x7f5d240b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.490+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/1826670307 shutdown_connections 2024-09-17T03:33:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.488+0000 7f9950c2e640 1 -- 172.21.15.146:0/20420134 wait complete. 2024-09-17T03:33:10.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.490+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/1826670307 wait complete. 2024-09-17T03:33:10.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.490+0000 7f14801da640 1 -- 172.21.15.146:0/2369232654 shutdown_connections 2024-09-17T03:33:10.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.490+0000 7f7d433a1640 1 -- 172.21.15.146:0/2433862801 shutdown_connections 2024-09-17T03:33:10.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.490+0000 7f7d433a1640 1 -- 172.21.15.146:0/2433862801 wait complete. 2024-09-17T03:33:10.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.491+0000 7f9950c2e640 1 Processor -- start 2024-09-17T03:33:10.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.492+0000 7f1c02b20640 1 -- 172.21.15.146:0/4031241528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc0b6670 msgr2=0x7f1bfc0b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.492+0000 7f1c02b20640 1 --2- 172.21.15.146:0/4031241528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc0b6670 0x7f1bfc0b04e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4005fd0 tx=0x7f1bf402acc0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.492+0000 7f5d2b4c5640 1 Processor -- start 2024-09-17T03:33:10.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.492+0000 7f9950c2e640 1 -- start start 2024-09-17T03:33:10.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.492+0000 7f5d2b4c5640 1 -- start start 2024-09-17T03:33:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.492+0000 7f7122d7b640 1 -- 172.21.15.146:0/3382023566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f711c072470 msgr2=0x7f711c072880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.492+0000 7f7122d7b640 1 --2- 172.21.15.146:0/3382023566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f711c072470 0x7f711c072880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f710c0083a0 tx=0x7f710c02c590 comp rx=0 tx=0).stop 2024-09-17T03:33:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.492+0000 7f7122d7b640 1 -- 172.21.15.146:0/3382023566 shutdown_connections 2024-09-17T03:33:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.492+0000 7f7122d7b640 1 --2- 172.21.15.146:0/3382023566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f711c072470 0x7f711c072880 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.492+0000 7f7122d7b640 1 -- 172.21.15.146:0/3382023566 >> 172.21.15.146:0/3382023566 conn(0x7f711c0b2060 msgr2=0x7f711c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.491+0000 7f14801da640 1 -- 172.21.15.146:0/2369232654 wait complete. 2024-09-17T03:33:10.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f4285feb640 1 -- 172.21.15.146:0/4059479727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4278036b40 msgr2=0x7f4278006660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f1c02b20640 1 -- 172.21.15.146:0/4031241528 shutdown_connections 2024-09-17T03:33:10.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f4285feb640 1 --2- 172.21.15.146:0/4059479727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4278036b40 0x7f4278006660 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f428007b100 tx=0x7f428006c1f0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f7122d7b640 1 -- 172.21.15.146:0/3382023566 shutdown_connections 2024-09-17T03:33:10.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f7122d7b640 1 -- 172.21.15.146:0/3382023566 wait complete. 2024-09-17T03:33:10.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f7d433a1640 1 Processor -- start 2024-09-17T03:33:10.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f1c02b20640 1 --2- 172.21.15.146:0/4031241528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc0b6670 0x7f1bfc0b04e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f1c02b20640 1 --2- 172.21.15.146:0/4031241528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc09be30 0x7f1bfc0b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f1c02b20640 1 -- 172.21.15.146:0/4031241528 >> 172.21.15.146:0/4031241528 conn(0x7f1bfc09ba20 msgr2=0x7f1bfc0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f4285feb640 1 -- 172.21.15.146:0/4059479727 shutdown_connections 2024-09-17T03:33:10.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f4285feb640 1 --2- 172.21.15.146:0/4059479727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4278036b40 0x7f4278006660 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f4285feb640 1 --2- 172.21.15.146:0/4059479727 >> v2:172.21.15.179:3300/0 conn(0x7f4278009ba0 0x7f42780df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f4285feb640 1 -- 172.21.15.146:0/4059479727 >> 172.21.15.146:0/4059479727 conn(0x7f4278051420 msgr2=0x7f4278051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f7d433a1640 1 -- start start 2024-09-17T03:33:10.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f4285feb640 1 -- 172.21.15.146:0/4059479727 shutdown_connections 2024-09-17T03:33:10.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f4285feb640 1 -- 172.21.15.146:0/4059479727 wait complete. 2024-09-17T03:33:10.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f8503bda640 1 -- 172.21.15.146:0/4256232237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84fc0afae0 msgr2=0x7f84fc072470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f8500974640 1 -- 172.21.15.146:0/4256232237 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8031600 con 0x7f84fc0afae0 2024-09-17T03:33:10.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f1c02b20640 1 -- 172.21.15.146:0/4031241528 shutdown_connections 2024-09-17T03:33:10.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.493+0000 7f1c02b20640 1 -- 172.21.15.146:0/4031241528 wait complete. 2024-09-17T03:33:10.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f8503bda640 1 --2- 172.21.15.146:0/4256232237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84fc0afae0 0x7f84fc072470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009830 tx=0x7f84f802a510 comp rx=0 tx=0).stop 2024-09-17T03:33:10.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f14801da640 1 Processor -- start 2024-09-17T03:33:10.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f8503bda640 1 -- 172.21.15.146:0/4256232237 shutdown_connections 2024-09-17T03:33:10.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f8503bda640 1 --2- 172.21.15.146:0/4256232237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84fc0afae0 0x7f84fc072470 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f9950c2e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f994c0704f0 0x7f994c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f8503bda640 1 -- 172.21.15.146:0/4256232237 >> 172.21.15.146:0/4256232237 conn(0x7f84fc0b2060 msgr2=0x7f84fc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f14801da640 1 -- start start 2024-09-17T03:33:10.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f5d2b4c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d100053a0 0x7f5d241530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f9950c2e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c0729b0 0x7f994c202ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f5d2b4c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d240d0020 0x7f5d24150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f8503bda640 1 -- 172.21.15.146:0/4256232237 shutdown_connections 2024-09-17T03:33:10.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f5d2b4c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d241fd470 0x7f5d241584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f994a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f994c0704f0 0x7f994c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f994a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f994c0704f0 0x7f994c15a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:36316/0 (socket says 172.21.15.146:36316) 2024-09-17T03:33:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f5d28a60640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d240d0020 0x7f5d24150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f5d28a60640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d240d0020 0x7f5d24150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:36326/0 (socket says 172.21.15.146:36326) 2024-09-17T03:33:10.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f9949d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c0729b0 0x7f994c202ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f5d28a60640 1 -- 172.21.15.146:0/55237097 learned_addr learned my addr 172.21.15.146:0/55237097 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f9949d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c0729b0 0x7f994c202ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50546/0 (socket says 172.21.15.146:50546) 2024-09-17T03:33:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/55237097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5d24070e40 con 0x7f5d100053a0 2024-09-17T03:33:10.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f994a59c640 1 -- 172.21.15.146:0/2999398623 learned_addr learned my addr 172.21.15.146:0/2999398623 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f9950c2e640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f994c0b4f10 0x7f994c14f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f5d29a62640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d241fd470 0x7f5d241584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f9950c2e640 1 -- 172.21.15.146:0/2999398623 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f994c0b3bf0 con 0x7f994c0729b0 2024-09-17T03:33:10.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f9950c2e640 1 -- 172.21.15.146:0/2999398623 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f994c0b3a70 con 0x7f994c0b4f10 2024-09-17T03:33:10.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f9950c2e640 1 -- 172.21.15.146:0/2999398623 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f994c0b3d70 con 0x7f994c0704f0 2024-09-17T03:33:10.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/55237097 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5d24070cc0 con 0x7f5d241fd470 2024-09-17T03:33:10.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f994ad9d640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f994c0b4f10 0x7f994c14f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.495+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/55237097 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2406cc50 con 0x7f5d240d0020 2024-09-17T03:33:10.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f7d433a1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d3c06e9b0 0x7f7d3c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f7d4113d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d3c06e9b0 0x7f7d3c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f7d4113d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d3c06e9b0 0x7f7d3c0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50566/0 (socket says 172.21.15.146:50566) 2024-09-17T03:33:10.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f5d29261640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d100053a0 0x7f5d241530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f7d4113d640 1 -- 172.21.15.146:0/3042770441 learned_addr learned my addr 172.21.15.146:0/3042770441 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f7d433a1640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d3c0704f0 0x7f7d3c1f91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f7d433a1640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3c0b50f0 0x7f7d3c1f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f7122d7b640 1 Processor -- start 2024-09-17T03:33:10.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f7122d7b640 1 -- start start 2024-09-17T03:33:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c0729b0 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f4285feb640 1 Processor -- start 2024-09-17T03:33:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c0b4580 con 0x7f7d3c0b50f0 2024-09-17T03:33:10.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7d3c072b30 con 0x7f7d3c0704f0 2024-09-17T03:33:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.494+0000 7f8503bda640 1 -- 172.21.15.146:0/4256232237 wait complete. 2024-09-17T03:33:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f4285feb640 1 -- start start 2024-09-17T03:33:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f9949d9b640 1 -- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f994c0704f0 msgr2=0x7f994c15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f9949d9b640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f994c0704f0 0x7f994c15a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f9949d9b640 1 -- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f994c0b4f10 msgr2=0x7f994c14f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f9949d9b640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f994c0b4f10 0x7f994c14f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f9949d9b640 1 -- 172.21.15.146:0/2999398623 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c153350 con 0x7f994c0729b0 2024-09-17T03:33:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f9949d9b640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c0729b0 0x7f994c202ac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9944035000 tx=0x7f994400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f14801da640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1478070020 0x7f147814b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f14801da640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1478152920 0x7f14781fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f1c02b20640 1 Processor -- start 2024-09-17T03:33:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f14801da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147816a0a0 0x7f14781fd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f14801da640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f147806d310 con 0x7f1478152920 2024-09-17T03:33:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f14801da640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f147806d190 con 0x7f147816a0a0 2024-09-17T03:33:10.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f1c02b20640 1 -- start start 2024-09-17T03:33:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f14801da640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f147806d490 con 0x7f1478070020 2024-09-17T03:33:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f147e777640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147816a0a0 0x7f14781fd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f5d29a62640 1 -- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d240d0020 msgr2=0x7f5d24150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f5d29a62640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d240d0020 0x7f5d24150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f5d29a62640 1 -- 172.21.15.146:0/55237097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d100053a0 msgr2=0x7f5d241530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f7d4113d640 1 -- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d3c0704f0 msgr2=0x7f7d3c1f91e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:33:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f7d4113d640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d3c0704f0 0x7f7d3c1f91e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f7d4113d640 1 -- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3c0b50f0 msgr2=0x7f7d3c1f9720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:33:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f7d4113d640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3c0b50f0 0x7f7d3c1f9720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f7d4113d640 1 -- 172.21.15.146:0/3042770441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c14fbf0 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f147e777640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147816a0a0 0x7f14781fd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:59364/0 (socket says 172.21.15.146:59364) 2024-09-17T03:33:10.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f147e777640 1 -- 172.21.15.146:0/1746762805 learned_addr learned my addr 172.21.15.146:0/1746762805 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f5d29a62640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d100053a0 0x7f5d241530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f8503bda640 1 Processor -- start 2024-09-17T03:33:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f8503bda640 1 -- start start 2024-09-17T03:33:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f5d29a62640 1 -- 172.21.15.146:0/55237097 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d240adbb0 con 0x7f5d241fd470 2024-09-17T03:33:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f147d775640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1478152920 0x7f14781fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f5d29261640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d100053a0 0x7f5d241530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:33:10.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f5d29a62640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d241fd470 0x7f5d241584c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d240b64d0 tx=0x7f5d14004620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.496+0000 7f993affd640 1 -- 172.21.15.146:0/2999398623 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944043020 con 0x7f994c0729b0 2024-09-17T03:33:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.497+0000 7f993affd640 1 -- 172.21.15.146:0/2999398623 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f994400ce80 con 0x7f994c0729b0 2024-09-17T03:33:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f993affd640 1 -- 172.21.15.146:0/2999398623 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944004280 con 0x7f994c0729b0 2024-09-17T03:33:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f9950c2e640 1 -- 172.21.15.146:0/2999398623 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994c153630 con 0x7f994c0729b0 2024-09-17T03:33:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f147d775640 1 -- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1478070020 msgr2=0x7f147814b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:33:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f147d775640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1478070020 0x7f147814b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f147d775640 1 -- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147816a0a0 msgr2=0x7f14781fd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f147d775640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147816a0a0 0x7f14781fd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f147d775640 1 -- 172.21.15.146:0/1746762805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14781fdfe0 con 0x7f1478152920 2024-09-17T03:33:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f5d19ffb640 1 -- 172.21.15.146:0/55237097 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14034040 con 0x7f5d241fd470 2024-09-17T03:33:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f9950c2e640 1 -- 172.21.15.146:0/2999398623 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994c204710 con 0x7f994c0729b0 2024-09-17T03:33:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f5d19ffb640 1 -- 172.21.15.146:0/55237097 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d1403e070 con 0x7f5d241fd470 2024-09-17T03:33:10.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f7122d7b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f711c072470 0x7f711c140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f5d19ffb640 1 -- 172.21.15.146:0/55237097 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1402cd60 con 0x7f5d241fd470 2024-09-17T03:33:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/55237097 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d240ade90 con 0x7f5d241fd470 2024-09-17T03:33:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f4285feb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4278005c60 0x7f42780dd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/55237097 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d241fcf50 con 0x7f5d241fd470 2024-09-17T03:33:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f4285feb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4278009ba0 0x7f42780de680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f4285feb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4278175490 0x7f42781758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f4285feb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4278006ba0 con 0x7f4278005c60 2024-09-17T03:33:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f1c02b20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bfc09be30 0x7f1bfc14bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f4285feb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f427800be40 con 0x7f4278009ba0 2024-09-17T03:33:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f1c02b20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc0b5be0 0x7f1bfc14c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f4285feb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4278006d20 con 0x7f4278175490 2024-09-17T03:33:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f1c02b20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0b6670 0x7f1bfc145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f1c02b20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc0b0ef0 con 0x7f1bfc0b5be0 2024-09-17T03:33:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f8503bda640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84fc0ae890 0x7f84fc157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f8503bda640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84fc0afae0 0x7f84fc0cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f8503bda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84fc15eb80 0x7f84fc206310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f8503bda640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f84fc0702e0 con 0x7f84fc0ae890 2024-09-17T03:33:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f8503bda640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f84fc070160 con 0x7f84fc15eb80 2024-09-17T03:33:10.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f8503bda640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f84fc070460 con 0x7f84fc0afae0 2024-09-17T03:33:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f1c02b20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc0b0d70 con 0x7f1bfc09be30 2024-09-17T03:33:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f1c02b20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1bfc0b1070 con 0x7f1bfc0b6670 2024-09-17T03:33:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f8502177640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84fc15eb80 0x7f84fc206310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f427ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4278009ba0 0x7f42780de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f427ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4278009ba0 0x7f42780de680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:59390/0 (socket says 172.21.15.146:59390) 2024-09-17T03:33:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f427ffff640 1 -- 172.21.15.146:0/1712026707 learned_addr learned my addr 172.21.15.146:0/1712026707 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f42857ea640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4278175490 0x7f42781758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f8502177640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84fc15eb80 0x7f84fc206310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:59404/0 (socket says 172.21.15.146:59404) 2024-09-17T03:33:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f8502177640 1 -- 172.21.15.146:0/3143086018 learned_addr learned my addr 172.21.15.146:0/3143086018 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f8501175640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84fc0afae0 0x7f84fc0cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f7d4113d640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d3c06e9b0 0x7f7d3c0cf550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009b30 tx=0x7f7d340315a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f7122d7b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f711c0b3360 0x7f711c1fd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.498+0000 7f7122d7b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f711c0b50f0 0x7f711c1fd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f7122d7b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f711c0706e0 con 0x7f711c072470 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f7122d7b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f711c070560 con 0x7f711c0b50f0 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f7122d7b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f711c0b3e80 con 0x7f711c0b3360 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f711bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f711c0b3360 0x7f711c1fd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f711bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f711c0b3360 0x7f711c1fd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:36336/0 (socket says 172.21.15.146:36336) 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.499+0000 7f711bfff640 1 -- 172.21.15.146:0/410945396 learned_addr learned my addr 172.21.15.146:0/410945396 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f711bfff640 1 -- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f711c0b50f0 msgr2=0x7f711c1fd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f711bfff640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f711c0b50f0 0x7f711c1fd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f711bfff640 1 -- 172.21.15.146:0/410945396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f711c072470 msgr2=0x7f711c140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f711bfff640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f711c072470 0x7f711c140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f711bfff640 1 -- 172.21.15.146:0/410945396 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711c1fe1a0 con 0x7f711c0b3360 2024-09-17T03:33:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f9950c2e640 1 -- 172.21.15.146:0/2999398623 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994c2035a0 con 0x7f994c0729b0 2024-09-17T03:33:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f1c010bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0b6670 0x7f1bfc145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f1c010bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0b6670 0x7f1bfc145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:36354/0 (socket says 172.21.15.146:36354) 2024-09-17T03:33:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f1c010bd640 1 -- 172.21.15.146:0/1166457715 learned_addr learned my addr 172.21.15.146:0/1166457715 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:10.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f42857ea640 1 -- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4278009ba0 msgr2=0x7f42780de680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f42857ea640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4278009ba0 0x7f42780de680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f42857ea640 1 -- 172.21.15.146:0/1712026707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4278005c60 msgr2=0x7f42780dd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f42857ea640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4278005c60 0x7f42780dd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f42857ea640 1 -- 172.21.15.146:0/1712026707 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4278176640 con 0x7f4278175490 2024-09-17T03:33:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f427ffff640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4278009ba0 0x7f42780de680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:33:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f147d775640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1478152920 0x7f14781fd260 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f147400e700 tx=0x7f147400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f42857ea640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4278175490 0x7f42781758a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f428006c110 tx=0x7f428006c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f8501976640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84fc0ae890 0x7f84fc157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f1bfbfff640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc0b5be0 0x7f1bfc14c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f7d31ffb640 1 -- 172.21.15.146:0/3042770441 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d34041020 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f7d31ffb640 1 -- 172.21.15.146:0/3042770441 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d34037040 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f7d31ffb640 1 -- 172.21.15.146:0/3042770441 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d34036070 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f8501175640 1 -- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84fc15eb80 msgr2=0x7f84fc206310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f8501175640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84fc15eb80 0x7f84fc206310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f8501175640 1 -- 172.21.15.146:0/3143086018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84fc0ae890 msgr2=0x7f84fc157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3c14fe90 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f1c008bc640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bfc09be30 0x7f1bfc14bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f8501175640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84fc0ae890 0x7f84fc157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f8501175640 1 -- 172.21.15.146:0/3143086018 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84fc0ceb30 con 0x7f84fc0afae0 2024-09-17T03:33:10.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f8501976640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84fc0ae890 0x7f84fc157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:10.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/55237097 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d2406d160 con 0x7f5d241fd470 2024-09-17T03:33:10.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f1c010bd640 1 -- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bfc09be30 msgr2=0x7f1bfc14bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f1c010bd640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bfc09be30 0x7f1bfc14bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f427d7fa640 1 -- 172.21.15.146:0/1712026707 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42800c2070 con 0x7f4278175490 2024-09-17T03:33:10.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3c150450 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f427d7fa640 1 -- 172.21.15.146:0/1712026707 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42800ab8e0 con 0x7f4278175490 2024-09-17T03:33:10.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f1c010bd640 1 -- 172.21.15.146:0/1166457715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc0b5be0 msgr2=0x7f1bfc14c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f1c010bd640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc0b5be0 0x7f1bfc14c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f1c010bd640 1 -- 172.21.15.146:0/1166457715 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bfc15f6e0 con 0x7f1bfc0b6670 2024-09-17T03:33:10.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f1c008bc640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bfc09be30 0x7f1bfc14bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:33:10.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f4285feb640 1 -- 172.21.15.146:0/1712026707 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427802c770 con 0x7f4278175490 2024-09-17T03:33:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f8501175640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84fc0afae0 0x7f84fc0cde40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00b3e0 tx=0x7f84ec00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f84f27fc640 1 -- 172.21.15.146:0/3143086018 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ec015030 con 0x7f84fc0afae0 2024-09-17T03:33:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f84f27fc640 1 -- 172.21.15.146:0/3143086018 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84ec004020 con 0x7f84fc0afae0 2024-09-17T03:33:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f84f27fc640 1 -- 172.21.15.146:0/3143086018 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ec011630 con 0x7f84fc0afae0 2024-09-17T03:33:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f8503bda640 1 -- 172.21.15.146:0/3143086018 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84fc0cee10 con 0x7f84fc0afae0 2024-09-17T03:33:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f8503bda640 1 -- 172.21.15.146:0/3143086018 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84fc0cf3d0 con 0x7f84fc0afae0 2024-09-17T03:33:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.502+0000 7f1c010bd640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0b6670 0x7f1bfc145740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006010 tx=0x7f1bf4003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f427d7fa640 1 -- 172.21.15.146:0/1712026707 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42800b0050 con 0x7f4278175490 2024-09-17T03:33:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f4285feb640 1 -- 172.21.15.146:0/1712026707 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4278175de0 con 0x7f4278175490 2024-09-17T03:33:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.502+0000 7f5d19ffb640 1 -- 172.21.15.146:0/55237097 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d14043460 con 0x7f5d241fd470 2024-09-17T03:33:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.502+0000 7f1bf97fa640 1 -- 172.21.15.146:0/1166457715 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4038040 con 0x7f1bfc0b6670 2024-09-17T03:33:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.503+0000 7f1bf97fa640 1 -- 172.21.15.146:0/1166457715 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bf4004240 con 0x7f1bfc0b6670 2024-09-17T03:33:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.503+0000 7f1bf97fa640 1 -- 172.21.15.146:0/1166457715 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4004650 con 0x7f1bfc0b6670 2024-09-17T03:33:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.503+0000 7f4285feb640 1 -- 172.21.15.146:0/1712026707 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42780df180 con 0x7f4278175490 2024-09-17T03:33:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.503+0000 7f5d19ffb640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5d08078c60 0x7f5d0807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f5d19ffb640 1 -- 172.21.15.146:0/55237097 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5d140ba8e0 con 0x7f5d241fd470 2024-09-17T03:33:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f427d7fa640 1 -- 172.21.15.146:0/1712026707 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42800c5070 con 0x7f4278175490 2024-09-17T03:33:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.503+0000 7f1c02b20640 1 -- 172.21.15.146:0/1166457715 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bfc15f9c0 con 0x7f1bfc0b6670 2024-09-17T03:33:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.503+0000 7f1c02b20640 1 -- 172.21.15.146:0/1166457715 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bfc15ff80 con 0x7f1bfc0b6670 2024-09-17T03:33:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.503+0000 7f7d31ffb640 1 -- 172.21.15.146:0/3042770441 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d34044020 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.500+0000 7f711bfff640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f711c0b3360 0x7f711c1fd2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f710c0084c0 tx=0x7f710c00a5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.502+0000 7f71197fa640 1 -- 172.21.15.146:0/410945396 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c038040 con 0x7f711c0b3360 2024-09-17T03:33:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.502+0000 7f71197fa640 1 -- 172.21.15.146:0/410945396 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f710c004020 con 0x7f711c0b3360 2024-09-17T03:33:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f71197fa640 1 -- 172.21.15.146:0/410945396 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c004430 con 0x7f711c0b3360 2024-09-17T03:33:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f5d29261640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5d08078c60 0x7f5d0807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d3c072470 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f7d31ffb640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d20078be0 0x7f7d2007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.501+0000 7f993affd640 1 -- 172.21.15.146:0/2999398623 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9944046020 con 0x7f994c0729b0 2024-09-17T03:33:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.502+0000 7f993affd640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f992c078bb0 0x7f992c07b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f1c02b20640 1 -- 172.21.15.146:0/1166457715 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bfc15f430 con 0x7f1bfc0b6670 2024-09-17T03:33:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f7122d7b640 1 -- 172.21.15.146:0/410945396 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711c1fdec0 con 0x7f711c0b3360 2024-09-17T03:33:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f7122d7b640 1 -- 172.21.15.146:0/410945396 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f711c0aa870 con 0x7f711c0b3360 2024-09-17T03:33:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f146e7fc640 1 -- 172.21.15.146:0/1746762805 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147400cab0 con 0x7f1478152920 2024-09-17T03:33:10.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f5d29261640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5d08078c60 0x7f5d0807b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c001a50 tx=0x7f5d1c0069e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f7d31ffb640 1 -- 172.21.15.146:0/3042770441 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d340bbea0 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f7d4093c640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d20078be0 0x7f7d2007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f993affd640 1 -- 172.21.15.146:0/2999398623 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f99440ba250 con 0x7f994c0729b0 2024-09-17T03:33:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f994a59c640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f992c078bb0 0x7f992c07b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f994a59c640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f992c078bb0 0x7f992c07b0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f993c0017e0 tx=0x7f993c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f84f27fc640 1 -- 172.21.15.146:0/3143086018 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84ec018070 con 0x7f84fc0afae0 2024-09-17T03:33:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.504+0000 7f8503bda640 1 -- 172.21.15.146:0/3143086018 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84fc15ad80 con 0x7f84fc0afae0 2024-09-17T03:33:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f427d7fa640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4264078c60 0x7f426407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f14801da640 1 -- 172.21.15.146:0/1746762805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147816c700 con 0x7f1478152920 2024-09-17T03:33:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f4284fe9640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4264078c60 0x7f426407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f14801da640 1 -- 172.21.15.146:0/1746762805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14781fdce0 con 0x7f1478152920 2024-09-17T03:33:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f1bf97fa640 1 -- 172.21.15.146:0/1166457715 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1bf4033440 con 0x7f1bfc0b6670 2024-09-17T03:33:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f7122d7b640 1 -- 172.21.15.146:0/410945396 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f711c0b4360 con 0x7f711c0b3360 2024-09-17T03:33:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.505+0000 7f84f27fc640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84e0078b90 0x7f84e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.506+0000 7f7d4093c640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d20078be0 0x7f7d2007b0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0afdb0 tx=0x7f7d38006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.506+0000 7f84f27fc640 1 -- 172.21.15.146:0/3143086018 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f84ec09a770 con 0x7f84fc0afae0 2024-09-17T03:33:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.506+0000 7f427d7fa640 1 -- 172.21.15.146:0/1712026707 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4280138050 con 0x7f4278175490 2024-09-17T03:33:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.506+0000 7f4284fe9640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4264078c60 0x7f426407b170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4274009400 tx=0x7f4274009390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.506+0000 7f8501976640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84e0078b90 0x7f84e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.506+0000 7f1bf97fa640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1be8078be0 0x7f1be807b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.506+0000 7f1bf97fa640 1 -- 172.21.15.146:0/1166457715 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1bf40bbca0 con 0x7f1bfc0b6670 2024-09-17T03:33:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.506+0000 7f1c008bc640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1be8078be0 0x7f1be807b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.506+0000 7f8501976640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84e0078b90 0x7f84e007b0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f84f8034000 tx=0x7f84f8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.507+0000 7f14801da640 1 -- 172.21.15.146:0/1746762805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147806d960 con 0x7f1478152920 2024-09-17T03:33:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.507+0000 7f1c008bc640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1be8078be0 0x7f1be807b0f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00a810 tx=0x7f1bec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.508+0000 7f5d19ffb640 1 -- 172.21.15.146:0/55237097 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5d14082d00 con 0x7f5d241fd470 2024-09-17T03:33:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.509+0000 7f427d7fa640 1 -- 172.21.15.146:0/1712026707 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42800ba070 con 0x7f4278175490 2024-09-17T03:33:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.510+0000 7f146e7fc640 1 -- 172.21.15.146:0/1746762805 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f147400cd40 con 0x7f1478152920 2024-09-17T03:33:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.510+0000 7f146e7fc640 1 -- 172.21.15.146:0/1746762805 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474026060 con 0x7f1478152920 2024-09-17T03:33:10.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.510+0000 7f993affd640 1 -- 172.21.15.146:0/2999398623 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9944083a90 con 0x7f994c0729b0 2024-09-17T03:33:10.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.511+0000 7f71197fa640 1 -- 172.21.15.146:0/410945396 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f710c0047a0 con 0x7f711c0b3360 2024-09-17T03:33:10.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.512+0000 7f71197fa640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70fc078be0 0x7f70fc07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.512+0000 7f7120b17640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70fc078be0 0x7f70fc07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.513+0000 7f7120b17640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70fc078be0 0x7f70fc07b0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7114002040 tx=0x7f7114001650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.515+0000 7f84f27fc640 1 -- 172.21.15.146:0/3143086018 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84ec062ba0 con 0x7f84fc0afae0 2024-09-17T03:33:10.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.516+0000 7f7d31ffb640 1 -- 172.21.15.146:0/3042770441 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d3404b030 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.518+0000 7f146e7fc640 1 -- 172.21.15.146:0/1746762805 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1474010690 con 0x7f1478152920 2024-09-17T03:33:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.519+0000 7f146e7fc640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f145c078bc0 0x7f145c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.519+0000 7f146e7fc640 1 -- 172.21.15.146:0/1746762805 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f147409bea0 con 0x7f1478152920 2024-09-17T03:33:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.519+0000 7f71197fa640 1 -- 172.21.15.146:0/410945396 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f710c07f3f0 con 0x7f711c0b3360 2024-09-17T03:33:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.520+0000 7f147df76640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f145c078bc0 0x7f145c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.520+0000 7f1bf97fa640 1 -- 172.21.15.146:0/1166457715 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1bf40c0070 con 0x7f1bfc0b6670 2024-09-17T03:33:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.522+0000 7f147df76640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f145c078bc0 0x7f145c07b0d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14680095f0 tx=0x7f1468006b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.522+0000 7f146e7fc640 1 -- 172.21.15.146:0/1746762805 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1474063d20 con 0x7f1478152920 2024-09-17T03:33:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.526+0000 7f71197fa640 1 -- 172.21.15.146:0/410945396 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f710c083880 con 0x7f711c0b3360 2024-09-17T03:33:10.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.913+0000 7f4285feb640 1 -- 172.21.15.146:0/1712026707 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f42780327a0 con 0x7f4278175490 2024-09-17T03:33:10.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.914+0000 7f427d7fa640 1 -- 172.21.15.146:0/1712026707 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42800ffeb0 con 0x7f4278175490 2024-09-17T03:33:10.914 INFO:teuthology.orchestra.run.smithi146.stdout:64424509447 2024-09-17T03:33:10.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.917+0000 7f426affd640 1 -- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4264078c60 msgr2=0x7f426407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.918+0000 7f426affd640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4264078c60 0x7f426407b170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4274009400 tx=0x7f4274009390 comp rx=0 tx=0).stop 2024-09-17T03:33:10.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.918+0000 7f426affd640 1 -- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4278175490 msgr2=0x7f42781758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.918+0000 7f426affd640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4278175490 0x7f42781758a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f428006c110 tx=0x7f428006c560 comp rx=0 tx=0).stop 2024-09-17T03:33:10.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.918+0000 7f426affd640 1 -- 172.21.15.146:0/1712026707 shutdown_connections 2024-09-17T03:33:10.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.918+0000 7f426affd640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4264078c60 0x7f426407b170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.918+0000 7f426affd640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4278175490 0x7f42781758a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.918+0000 7f426affd640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4278009ba0 0x7f42780de680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.918+0000 7f426affd640 1 --2- 172.21.15.146:0/1712026707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4278005c60 0x7f42780dd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.918+0000 7f426affd640 1 -- 172.21.15.146:0/1712026707 >> 172.21.15.146:0/1712026707 conn(0x7f4278051420 msgr2=0x7f4278051830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.919+0000 7f426affd640 1 -- 172.21.15.146:0/1712026707 shutdown_connections 2024-09-17T03:33:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.919+0000 7f426affd640 1 -- 172.21.15.146:0/1712026707 wait complete. 2024-09-17T03:33:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.924+0000 7f5d2b4c5640 1 -- 172.21.15.146:0/55237097 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5d240b3110 con 0x7f5d241fd470 2024-09-17T03:33:10.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.925+0000 7f5d19ffb640 1 -- 172.21.15.146:0/55237097 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d14082600 con 0x7f5d241fd470 2024-09-17T03:33:10.925 INFO:teuthology.orchestra.run.smithi146.stdout:64424509447 2024-09-17T03:33:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.928+0000 7f5d077fe640 1 -- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5d08078c60 msgr2=0x7f5d0807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.928+0000 7f5d077fe640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5d08078c60 0x7f5d0807b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c001a50 tx=0x7f5d1c0069e0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f5d077fe640 1 -- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d241fd470 msgr2=0x7f5d241584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f5d077fe640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d241fd470 0x7f5d241584c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d240b64d0 tx=0x7f5d14004620 comp rx=0 tx=0).stop 2024-09-17T03:33:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f5d077fe640 1 -- 172.21.15.146:0/55237097 shutdown_connections 2024-09-17T03:33:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f5d077fe640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5d08078c60 0x7f5d0807b170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f5d077fe640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d241fd470 0x7f5d241584c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f5d077fe640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d240d0020 0x7f5d24150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f5d077fe640 1 --2- 172.21.15.146:0/55237097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d100053a0 0x7f5d241530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f9950c2e640 1 -- 172.21.15.146:0/2999398623 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f994c072470 con 0x7f994c0729b0 2024-09-17T03:33:10.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f5d077fe640 1 -- 172.21.15.146:0/55237097 >> 172.21.15.146:0/55237097 conn(0x7f5d240b3510 msgr2=0x7f5d241576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f5d077fe640 1 -- 172.21.15.146:0/55237097 shutdown_connections 2024-09-17T03:33:10.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f5d077fe640 1 -- 172.21.15.146:0/55237097 wait complete. 2024-09-17T03:33:10.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.929+0000 7f993affd640 1 -- 172.21.15.146:0/2999398623 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99440884c0 con 0x7f994c0729b0 2024-09-17T03:33:10.931 INFO:teuthology.orchestra.run.smithi146.stdout:64424509447 2024-09-17T03:33:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.933+0000 7f8503bda640 1 -- 172.21.15.146:0/3143086018 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f84fc0d0fe0 con 0x7f84fc0afae0 2024-09-17T03:33:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.933+0000 7f9938ff9640 1 -- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f992c078bb0 msgr2=0x7f992c07b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.933+0000 7f9938ff9640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f992c078bb0 0x7f992c07b0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f993c0017e0 tx=0x7f993c009040 comp rx=0 tx=0).stop 2024-09-17T03:33:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.933+0000 7f9938ff9640 1 -- 172.21.15.146:0/2999398623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c0729b0 msgr2=0x7f994c202ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.933+0000 7f9938ff9640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c0729b0 0x7f994c202ac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9944035000 tx=0x7f994400ca80 comp rx=0 tx=0).stop 2024-09-17T03:33:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.934+0000 7f84f27fc640 1 -- 172.21.15.146:0/3143086018 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84ec0624a0 con 0x7f84fc0afae0 2024-09-17T03:33:10.937 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-09-17T03:33:10.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.934+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7d3c0b10d0 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.935+0000 7f7d31ffb640 1 -- 172.21.15.146:0/3042770441 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d3c14fbf0 con 0x7f7d3c06e9b0 2024-09-17T03:33:10.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.934+0000 7f9938ff9640 1 -- 172.21.15.146:0/2999398623 shutdown_connections 2024-09-17T03:33:10.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.934+0000 7f9938ff9640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f992c078bb0 0x7f992c07b0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.934+0000 7f9938ff9640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f994c0b4f10 0x7f994c14f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.934+0000 7f9938ff9640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f994c0729b0 0x7f994c202ac0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.934+0000 7f9938ff9640 1 --2- 172.21.15.146:0/2999398623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f994c0704f0 0x7f994c15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.934+0000 7f9938ff9640 1 -- 172.21.15.146:0/2999398623 >> 172.21.15.146:0/2999398623 conn(0x7f994c0b2060 msgr2=0x7f994c15d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.935+0000 7f9938ff9640 1 -- 172.21.15.146:0/2999398623 shutdown_connections 2024-09-17T03:33:10.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.935+0000 7f9938ff9640 1 -- 172.21.15.146:0/2999398623 wait complete. 2024-09-17T03:33:10.938 INFO:teuthology.orchestra.run.smithi146.stdout:64424509448 2024-09-17T03:33:10.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.6 2024-09-17T03:33:10.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.937+0000 7f8503bda640 1 -- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84e0078b90 msgr2=0x7f84e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.937+0000 7f8503bda640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84e0078b90 0x7f84e007b0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f84f8034000 tx=0x7f84f8004730 comp rx=0 tx=0).stop 2024-09-17T03:33:10.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.937+0000 7f8503bda640 1 -- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84fc0afae0 msgr2=0x7f84fc0cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.937+0000 7f8503bda640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84fc0afae0 0x7f84fc0cde40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00b3e0 tx=0x7f84ec00b8a0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.937+0000 7f8503bda640 1 -- 172.21.15.146:0/3143086018 shutdown_connections 2024-09-17T03:33:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.937+0000 7f8503bda640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84e0078b90 0x7f84e007b0a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.937+0000 7f8503bda640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84fc15eb80 0x7f84fc206310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.937+0000 7f8503bda640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84fc0afae0 0x7f84fc0cde40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.937+0000 7f8503bda640 1 --2- 172.21.15.146:0/3143086018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84fc0ae890 0x7f84fc157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.937+0000 7f8503bda640 1 -- 172.21.15.146:0/3143086018 >> 172.21.15.146:0/3143086018 conn(0x7f84fc0b2060 msgr2=0x7f84fc0b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.938+0000 7f8503bda640 1 -- 172.21.15.146:0/3143086018 shutdown_connections 2024-09-17T03:33:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.938+0000 7f8503bda640 1 -- 172.21.15.146:0/3143086018 wait complete. 2024-09-17T03:33:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.939+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d20078be0 msgr2=0x7f7d2007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.939+0000 7f7d433a1640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d20078be0 0x7f7d2007b0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0afdb0 tx=0x7f7d38006b70 comp rx=0 tx=0).stop 2024-09-17T03:33:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.939+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d3c06e9b0 msgr2=0x7f7d3c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.939+0000 7f7d433a1640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d3c06e9b0 0x7f7d3c0cf550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009b30 tx=0x7f7d340315a0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.939+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 shutdown_connections 2024-09-17T03:33:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.939+0000 7f7d433a1640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d20078be0 0x7f7d2007b0f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.939+0000 7f7d433a1640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d3c0b50f0 0x7f7d3c1f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.940+0000 7f7d433a1640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d3c0704f0 0x7f7d3c1f91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.940+0000 7f7d433a1640 1 --2- 172.21.15.146:0/3042770441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d3c06e9b0 0x7f7d3c0cf550 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.940+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 >> 172.21.15.146:0/3042770441 conn(0x7f7d3c0b2060 msgr2=0x7f7d3c0b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.940+0000 7f7122d7b640 1 -- 172.21.15.146:0/410945396 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f711c06e6c0 con 0x7f711c0b3360 2024-09-17T03:33:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.940+0000 7f1c02b20640 1 -- 172.21.15.146:0/1166457715 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1bfc0b1610 con 0x7f1bfc0b6670 2024-09-17T03:33:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.940+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 shutdown_connections 2024-09-17T03:33:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.940+0000 7f7d433a1640 1 -- 172.21.15.146:0/3042770441 wait complete. 2024-09-17T03:33:10.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.941+0000 7f1bf97fa640 1 -- 172.21.15.146:0/1166457715 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1bfc0b6a80 con 0x7f1bfc0b6670 2024-09-17T03:33:10.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.941+0000 7f71197fa640 1 -- 172.21.15.146:0/410945396 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f710c083180 con 0x7f711c0b3360 2024-09-17T03:33:10.945 INFO:teuthology.orchestra.run.smithi146.stdout:64424509447 2024-09-17T03:33:10.945 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2024-09-17T03:33:10.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.942+0000 7f14801da640 1 -- 172.21.15.146:0/1746762805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1478156000 con 0x7f1478152920 2024-09-17T03:33:10.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.943+0000 7f146e7fc640 1 -- 172.21.15.146:0/1746762805 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1474068750 con 0x7f1478152920 2024-09-17T03:33:10.946 INFO:teuthology.orchestra.run.smithi146.stdout:64424509448 2024-09-17T03:33:10.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f1c02b20640 1 -- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1be8078be0 msgr2=0x7f1be807b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f1c02b20640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1be8078be0 0x7f1be807b0f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00a810 tx=0x7f1bec008040 comp rx=0 tx=0).stop 2024-09-17T03:33:10.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f1c02b20640 1 -- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0b6670 msgr2=0x7f1bfc145740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f1c02b20640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0b6670 0x7f1bfc145740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006010 tx=0x7f1bf4003f10 comp rx=0 tx=0).stop 2024-09-17T03:33:10.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f7122d7b640 1 -- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70fc078be0 msgr2=0x7f70fc07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f7122d7b640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70fc078be0 0x7f70fc07b0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7114002040 tx=0x7f7114001650 comp rx=0 tx=0).stop 2024-09-17T03:33:10.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f7122d7b640 1 -- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f711c0b3360 msgr2=0x7f711c1fd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f7122d7b640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f711c0b3360 0x7f711c1fd2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f710c0084c0 tx=0x7f710c00a5a0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f1c02b20640 1 -- 172.21.15.146:0/1166457715 shutdown_connections 2024-09-17T03:33:10.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f1c02b20640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1be8078be0 0x7f1be807b0f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f1c02b20640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bfc0b6670 0x7f1bfc145740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.945+0000 7f1c02b20640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc0b5be0 0x7f1bfc14c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f1c02b20640 1 --2- 172.21.15.146:0/1166457715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bfc09be30 0x7f1bfc14bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f1c02b20640 1 -- 172.21.15.146:0/1166457715 >> 172.21.15.146:0/1166457715 conn(0x7f1bfc09ba20 msgr2=0x7f1bfc0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f1c02b20640 1 -- 172.21.15.146:0/1166457715 shutdown_connections 2024-09-17T03:33:10.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f1c02b20640 1 -- 172.21.15.146:0/1166457715 wait complete. 2024-09-17T03:33:10.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f7122d7b640 1 -- 172.21.15.146:0/410945396 shutdown_connections 2024-09-17T03:33:10.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f7122d7b640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70fc078be0 0x7f70fc07b0f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f7122d7b640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f711c0b50f0 0x7f711c1fd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f7122d7b640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f711c0b3360 0x7f711c1fd2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f7122d7b640 1 --2- 172.21.15.146:0/410945396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f711c072470 0x7f711c140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f7122d7b640 1 -- 172.21.15.146:0/410945396 >> 172.21.15.146:0/410945396 conn(0x7f711c0b2060 msgr2=0x7f711c154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f7122d7b640 1 -- 172.21.15.146:0/410945396 shutdown_connections 2024-09-17T03:33:10.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.946+0000 7f7122d7b640 1 -- 172.21.15.146:0/410945396 wait complete. 2024-09-17T03:33:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.947+0000 7f14801da640 1 -- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f145c078bc0 msgr2=0x7f145c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.947+0000 7f14801da640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f145c078bc0 0x7f145c07b0d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14680095f0 tx=0x7f1468006b50 comp rx=0 tx=0).stop 2024-09-17T03:33:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.948+0000 7f14801da640 1 -- 172.21.15.146:0/1746762805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1478152920 msgr2=0x7f14781fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.948+0000 7f14801da640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1478152920 0x7f14781fd260 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f147400e700 tx=0x7f147400ebc0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.948+0000 7f14801da640 1 -- 172.21.15.146:0/1746762805 shutdown_connections 2024-09-17T03:33:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.948+0000 7f14801da640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f145c078bc0 0x7f145c07b0d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.948+0000 7f14801da640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147816a0a0 0x7f14781fd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.948+0000 7f14801da640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1478152920 0x7f14781fd260 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.948+0000 7f14801da640 1 --2- 172.21.15.146:0/1746762805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1478070020 0x7f147814b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.948+0000 7f14801da640 1 -- 172.21.15.146:0/1746762805 >> 172.21.15.146:0/1746762805 conn(0x7f147806dd60 msgr2=0x7f14780b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:10.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.948+0000 7f14801da640 1 -- 172.21.15.146:0/1746762805 shutdown_connections 2024-09-17T03:33:10.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:10.948+0000 7f14801da640 1 -- 172.21.15.146:0/1746762805 wait complete. 2024-09-17T03:33:10.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.7 2024-09-17T03:33:10.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-09-17T03:33:10.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-09-17T03:33:10.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.2 2024-09-17T03:33:10.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-09-17T03:33:10.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.1 2024-09-17T03:33:10.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-09-17T03:33:11.940 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T03:33:11.953 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T03:33:11.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T03:33:11.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T03:33:11.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T03:33:11.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T03:33:11.967 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T03:33:11.967 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T03:33:12.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.132+0000 7f2070663640 1 -- 172.21.15.146:0/3400424126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2068162600 msgr2=0x7f2068162a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.134+0000 7f2070663640 1 --2- 172.21.15.146:0/3400424126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2068162600 0x7f2068162a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2064005fd0 tx=0x7f206402a5a0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.134+0000 7f2070663640 1 -- 172.21.15.146:0/3400424126 shutdown_connections 2024-09-17T03:33:12.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.135+0000 7f2070663640 1 --2- 172.21.15.146:0/3400424126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2068162600 0x7f2068162a10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.135+0000 7f2070663640 1 -- 172.21.15.146:0/3400424126 >> 172.21.15.146:0/3400424126 conn(0x7f20680b2060 msgr2=0x7f20680b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.135+0000 7f2070663640 1 -- 172.21.15.146:0/3400424126 shutdown_connections 2024-09-17T03:33:12.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.135+0000 7f2070663640 1 -- 172.21.15.146:0/3400424126 wait complete. 2024-09-17T03:33:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.141+0000 7f2070663640 1 Processor -- start 2024-09-17T03:33:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.141+0000 7f2070663640 1 -- start start 2024-09-17T03:33:12.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.144+0000 7f2070663640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20680b3360 0x7f206815ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.145+0000 7f206e3ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20680b3360 0x7f206815ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.145+0000 7f206e3ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20680b3360 0x7f206815ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50632/0 (socket says 172.21.15.146:50632) 2024-09-17T03:33:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.145+0000 7f206e3ff640 1 -- 172.21.15.146:0/86776197 learned_addr learned my addr 172.21.15.146:0/86776197 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.145+0000 7f2070663640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2068162600 0x7f2068156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.145+0000 7f2070663640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2068162f50 0x7f20681fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.145+0000 7f2070663640 1 -- 172.21.15.146:0/86776197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f20681634e0 con 0x7f20680b3360 2024-09-17T03:33:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.145+0000 7f206dbfe640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2068162600 0x7f2068156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.146+0000 7f206ec00640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2068162f50 0x7f20681fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.146+0000 7f2070663640 1 -- 172.21.15.146:0/86776197 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2068163360 con 0x7f2068162600 2024-09-17T03:33:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.146+0000 7f2070663640 1 -- 172.21.15.146:0/86776197 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f20680b3e80 con 0x7f2068162f50 2024-09-17T03:33:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.147+0000 7f206e3ff640 1 -- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2068162f50 msgr2=0x7f20681fd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.147+0000 7f206e3ff640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2068162f50 0x7f20681fd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.147+0000 7f206e3ff640 1 -- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2068162600 msgr2=0x7f2068156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.147+0000 7f206e3ff640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2068162600 0x7f2068156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.147+0000 7f206e3ff640 1 -- 172.21.15.146:0/86776197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20680cf4f0 con 0x7f20680b3360 2024-09-17T03:33:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.147+0000 7f206e3ff640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20680b3360 0x7f206815ff20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2064034040 tx=0x7f20640049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.148+0000 7f206ec00640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2068162f50 0x7f20681fd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:33:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.149+0000 7f205effd640 1 -- 172.21.15.146:0/86776197 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206403e030 con 0x7f20680b3360 2024-09-17T03:33:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.149+0000 7f205effd640 1 -- 172.21.15.146:0/86776197 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2064004cb0 con 0x7f20680b3360 2024-09-17T03:33:12.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.149+0000 7f2070663640 1 -- 172.21.15.146:0/86776197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20680cf7d0 con 0x7f20680b3360 2024-09-17T03:33:12.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.153+0000 7f2070663640 1 -- 172.21.15.146:0/86776197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f206815f720 con 0x7f20680b3360 2024-09-17T03:33:12.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.153+0000 7f205effd640 1 -- 172.21.15.146:0/86776197 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2064035040 con 0x7f20680b3360 2024-09-17T03:33:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.154+0000 7f205effd640 1 -- 172.21.15.146:0/86776197 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2064041030 con 0x7f20680b3360 2024-09-17T03:33:12.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.155+0000 7f205effd640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f204c078c90 0x7f204c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.155+0000 7f205effd640 1 -- 172.21.15.146:0/86776197 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f20640bada0 con 0x7f20680b3360 2024-09-17T03:33:12.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.155+0000 7f206dbfe640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f204c078c90 0x7f204c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.157+0000 7f206dbfe640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f204c078c90 0x7f204c07b1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f206806e420 tx=0x7f2060001af0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.157+0000 7f2070663640 1 -- 172.21.15.146:0/86776197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2068070a30 con 0x7f20680b3360 2024-09-17T03:33:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.167+0000 7f205effd640 1 -- 172.21.15.146:0/86776197 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2068070a30 con 0x7f20680b3360 2024-09-17T03:33:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.205+0000 7f848dad3640 1 -- 172.21.15.146:0/1236897778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84880b3cf0 msgr2=0x7f84880b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.205+0000 7f848dad3640 1 --2- 172.21.15.146:0/1236897778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84880b3cf0 0x7f84880b4100 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8480005fd0 tx=0x7f8480032d90 comp rx=0 tx=0).stop 2024-09-17T03:33:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.206+0000 7f848dad3640 1 -- 172.21.15.146:0/1236897778 shutdown_connections 2024-09-17T03:33:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.206+0000 7f848dad3640 1 --2- 172.21.15.146:0/1236897778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84880b3cf0 0x7f84880b4100 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.206+0000 7f848dad3640 1 --2- 172.21.15.146:0/1236897778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8488160060 0x7f8488152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.206+0000 7f848dad3640 1 -- 172.21.15.146:0/1236897778 >> 172.21.15.146:0/1236897778 conn(0x7f84880b2060 msgr2=0x7f84880b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.206+0000 7f848dad3640 1 -- 172.21.15.146:0/1236897778 shutdown_connections 2024-09-17T03:33:12.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.207+0000 7f848dad3640 1 -- 172.21.15.146:0/1236897778 wait complete. 2024-09-17T03:33:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.209+0000 7f848dad3640 1 Processor -- start 2024-09-17T03:33:12.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7f848dad3640 1 -- start start 2024-09-17T03:33:12.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7f323bfff640 1 -- 172.21.15.146:0/4052338076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3234052770 msgr2=0x7f3234006cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7f323bfff640 1 --2- 172.21.15.146:0/4052338076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3234052770 0x7f3234006cc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f323c07b100 tx=0x7f323c06c1f0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7f323bfff640 1 -- 172.21.15.146:0/4052338076 shutdown_connections 2024-09-17T03:33:12.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7f323bfff640 1 --2- 172.21.15.146:0/4052338076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3234052770 0x7f3234006cc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7f323bfff640 1 --2- 172.21.15.146:0/4052338076 >> v2:172.21.15.179:3300/0 conn(0x7f323400b070 0x7f323400b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7f323bfff640 1 -- 172.21.15.146:0/4052338076 >> 172.21.15.146:0/4052338076 conn(0x7f3234051420 msgr2=0x7f3234051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7fc1de9e6640 1 -- 172.21.15.146:0/4148652075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d80b59e0 msgr2=0x7fc1d80b5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7fc1de9e6640 1 --2- 172.21.15.146:0/4148652075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d80b59e0 0x7fc1d80b5df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0005fd0 tx=0x7fc1d002a930 comp rx=0 tx=0).stop 2024-09-17T03:33:12.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7f323bfff640 1 -- 172.21.15.146:0/4052338076 shutdown_connections 2024-09-17T03:33:12.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7f56ce05c640 1 -- 172.21.15.146:0/1101979316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56c806cc50 msgr2=0x7f56c806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7f56ce05c640 1 --2- 172.21.15.146:0/1101979316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56c806cc50 0x7f56c806d060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009830 tx=0x7f56bc02a490 comp rx=0 tx=0).stop 2024-09-17T03:33:12.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7fc1de9e6640 1 -- 172.21.15.146:0/4148652075 shutdown_connections 2024-09-17T03:33:12.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7fc1de9e6640 1 --2- 172.21.15.146:0/4148652075 >> v2:172.21.15.179:3300/0 conn(0x7fc1d815ea80 0x7fc1d815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7fc1de9e6640 1 --2- 172.21.15.146:0/4148652075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d80b59e0 0x7fc1d80b5df0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7fc1de9e6640 1 -- 172.21.15.146:0/4148652075 >> 172.21.15.146:0/4148652075 conn(0x7fc1d80b2db0 msgr2=0x7fc1d80b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.210+0000 7f323bfff640 1 -- 172.21.15.146:0/4052338076 wait complete. 2024-09-17T03:33:12.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.211+0000 7fc1de9e6640 1 -- 172.21.15.146:0/4148652075 shutdown_connections 2024-09-17T03:33:12.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.211+0000 7fc1de9e6640 1 -- 172.21.15.146:0/4148652075 wait complete. 2024-09-17T03:33:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.211+0000 7f56ce05c640 1 -- 172.21.15.146:0/1101979316 shutdown_connections 2024-09-17T03:33:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.211+0000 7f56ce05c640 1 --2- 172.21.15.146:0/1101979316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56c806cc50 0x7f56c806d060 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.211+0000 7f56ce05c640 1 -- 172.21.15.146:0/1101979316 >> 172.21.15.146:0/1101979316 conn(0x7f56c80d0ab0 msgr2=0x7f56c80b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.211+0000 7f33ded78640 1 -- 172.21.15.146:0/2556646122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d00519a0 msgr2=0x7f33d0051db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.211+0000 7f33ded78640 1 --2- 172.21.15.146:0/2556646122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d00519a0 0x7f33d0051db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f33d807b100 tx=0x7f33d806c1f0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f33ded78640 1 -- 172.21.15.146:0/2556646122 shutdown_connections 2024-09-17T03:33:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f848dad3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848806f770 0x7f84881f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f33ded78640 1 --2- 172.21.15.146:0/2556646122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d00519a0 0x7f33d0051db0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f33ded78640 1 --2- 172.21.15.146:0/2556646122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33d00df800 0x7f33d0007c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f33ded78640 1 -- 172.21.15.146:0/2556646122 >> 172.21.15.146:0/2556646122 conn(0x7f33d001e260 msgr2=0x7f33d0039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f848dad3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84880b3cf0 0x7f84881584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f84877fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848806f770 0x7f84881f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f84877fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848806f770 0x7f84881f1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:59462/0 (socket says 172.21.15.146:59462) 2024-09-17T03:33:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f84877fe640 1 -- 172.21.15.146:0/1147569637 learned_addr learned my addr 172.21.15.146:0/1147569637 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f848dad3640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8488160060 0x7f848815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f8486ffd640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84880b3cf0 0x7f84881584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f84880b4d30 con 0x7f8488160060 2024-09-17T03:33:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.212+0000 7f8487fff640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8488160060 0x7f848815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f84880b4bb0 con 0x7f848806f770 2024-09-17T03:33:12.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f56ce05c640 1 -- 172.21.15.146:0/1101979316 shutdown_connections 2024-09-17T03:33:12.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f56ce05c640 1 -- 172.21.15.146:0/1101979316 wait complete. 2024-09-17T03:33:12.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f84880b4eb0 con 0x7f84880b3cf0 2024-09-17T03:33:12.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f33ded78640 1 -- 172.21.15.146:0/2556646122 shutdown_connections 2024-09-17T03:33:12.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f89f359e640 1 -- 172.21.15.146:0/2623806881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ec0e3150 msgr2=0x7f89ec0e3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f89f359e640 1 --2- 172.21.15.146:0/2623806881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ec0e3150 0x7f89ec0e3560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009830 tx=0x7f89e802a3f0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f89f359e640 1 -- 172.21.15.146:0/2623806881 shutdown_connections 2024-09-17T03:33:12.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f84877fe640 1 -- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84880b3cf0 msgr2=0x7f84881584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f84877fe640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84880b3cf0 0x7f84881584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f84877fe640 1 -- 172.21.15.146:0/1147569637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8488160060 msgr2=0x7f848815e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f84877fe640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8488160060 0x7f848815e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f33ded78640 1 -- 172.21.15.146:0/2556646122 wait complete. 2024-09-17T03:33:12.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f84877fe640 1 -- 172.21.15.146:0/1147569637 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84881564e0 con 0x7f848806f770 2024-09-17T03:33:12.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f89f359e640 1 --2- 172.21.15.146:0/2623806881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ec0e3150 0x7f89ec0e3560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f89f359e640 1 --2- 172.21.15.146:0/2623806881 >> v2:172.21.15.146:3300/0 conn(0x7f89ec051c80 0x7f89ec052090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f89f359e640 1 -- 172.21.15.146:0/2623806881 >> 172.21.15.146:0/2623806881 conn(0x7f89ec01e230 msgr2=0x7f89ec039e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f84877fe640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848806f770 0x7f84881f1250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f847c00d740 tx=0x7f847c00dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.214+0000 7f89f359e640 1 -- 172.21.15.146:0/2623806881 shutdown_connections 2024-09-17T03:33:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.214+0000 7f89f359e640 1 -- 172.21.15.146:0/2623806881 wait complete. 2024-09-17T03:33:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.214+0000 7fc1de9e6640 1 Processor -- start 2024-09-17T03:33:12.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.214+0000 7f846ffff640 1 -- 172.21.15.146:0/1147569637 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c017070 con 0x7f848806f770 2024-09-17T03:33:12.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.214+0000 7f846ffff640 1 -- 172.21.15.146:0/1147569637 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f847c009d20 con 0x7f848806f770 2024-09-17T03:33:12.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.214+0000 7fc1de9e6640 1 -- start start 2024-09-17T03:33:12.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.215+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84881f1b60 con 0x7f848806f770 2024-09-17T03:33:12.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.215+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84881f2120 con 0x7f848806f770 2024-09-17T03:33:12.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.215+0000 7f846ffff640 1 -- 172.21.15.146:0/1147569637 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c0106c0 con 0x7f848806f770 2024-09-17T03:33:12.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.215+0000 7f56ce05c640 1 Processor -- start 2024-09-17T03:33:12.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.213+0000 7f323bfff640 1 Processor -- start 2024-09-17T03:33:12.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.214+0000 7f323bfff640 1 -- start start 2024-09-17T03:33:12.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.216+0000 7f56ce05c640 1 -- start start 2024-09-17T03:33:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.216+0000 7f323bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f323400b070 0x7f323404e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.216+0000 7f33ded78640 1 Processor -- start 2024-09-17T03:33:12.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.216+0000 7fc1de9e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d80747e0 0x7fc1d813fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.216+0000 7f89f359e640 1 Processor -- start 2024-09-17T03:33:12.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7fc1de9e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1d80b59e0 0x7fc1d8155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.216+0000 7f33ded78640 1 -- start start 2024-09-17T03:33:12.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7f89f359e640 1 -- start start 2024-09-17T03:33:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7fc1de9e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d815ea80 0x7fc1d809d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7fc1d77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1d80b59e0 0x7fc1d8155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7fc1d77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1d80b59e0 0x7fc1d8155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:59476/0 (socket says 172.21.15.146:59476) 2024-09-17T03:33:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7fc1d77fe640 1 -- 172.21.15.146:0/3684615940 learned_addr learned my addr 172.21.15.146:0/3684615940 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7fc1d7fff640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d80747e0 0x7fc1d813fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7fc1dcf83640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d815ea80 0x7fc1d809d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d80af250 con 0x7fc1d80747e0 2024-09-17T03:33:12.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7f846ffff640 1 -- 172.21.15.146:0/1147569637 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f847c01a070 con 0x7f848806f770 2024-09-17T03:33:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d80af0d0 con 0x7fc1d80b59e0 2024-09-17T03:33:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d8070b90 con 0x7fc1d815ea80 2024-09-17T03:33:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f6c9b561640 1 -- 172.21.15.146:0/1477089952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c941583f0 msgr2=0x7f6c9415aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f6c9b561640 1 --2- 172.21.15.146:0/1477089952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c941583f0 0x7f6c9415aeb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000c830 tx=0x7f6c9002b690 comp rx=0 tx=0).stop 2024-09-17T03:33:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7f323bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3234052360 0x7f3234048280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.217+0000 7f323bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234052770 0x7f3234180ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f323bfff640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3234007590 con 0x7f3234052770 2024-09-17T03:33:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f323bfff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3234007410 con 0x7f3234052360 2024-09-17T03:33:12.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f323bfff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3234039090 con 0x7f323400b070 2024-09-17T03:33:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f6c9b561640 1 -- 172.21.15.146:0/1477089952 shutdown_connections 2024-09-17T03:33:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f6c9b561640 1 --2- 172.21.15.146:0/1477089952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c941583f0 0x7f6c9415aeb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f6c9b561640 1 --2- 172.21.15.146:0/1477089952 >> v2:172.21.15.179:3300/0 conn(0x7f6c940c69d0 0x7f6c940c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f6c9b561640 1 -- 172.21.15.146:0/1477089952 >> 172.21.15.146:0/1477089952 conn(0x7f6c9406d280 msgr2=0x7f6c940b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f6c9b561640 1 -- 172.21.15.146:0/1477089952 shutdown_connections 2024-09-17T03:33:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f56ce05c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56c806cc50 0x7f56c80c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f56ce05c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56c806f9f0 0x7f56c8152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7fc1dcf83640 1 -- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1d80b59e0 msgr2=0x7fc1d8155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7fc1dcf83640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1d80b59e0 0x7fc1d8155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7fc1dcf83640 1 -- 172.21.15.146:0/3684615940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d80747e0 msgr2=0x7fc1d813fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f56ce05c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56c80b4950 0x7f56c80728e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f56ce05c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f56c806f7a0 con 0x7f56c806f9f0 2024-09-17T03:33:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f56ce05c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f56c806f620 con 0x7f56c80b4950 2024-09-17T03:33:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f56ce05c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f56c80caf60 con 0x7f56c806cc50 2024-09-17T03:33:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f6c9b561640 1 -- 172.21.15.146:0/1477089952 wait complete. 2024-09-17T03:33:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7fc1dcf83640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d80747e0 0x7fc1d813fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7fc1dcf83640 1 -- 172.21.15.146:0/3684615940 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d8160c80 con 0x7fc1d815ea80 2024-09-17T03:33:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f33ded78640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33d0006820 0x7f33d00226a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f33ded78640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33d00519a0 0x7f33d0034400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f33ded78640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d00df800 0x7f33d0033040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f846ffff640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8474078be0 0x7f847407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f846ffff640 1 -- 172.21.15.146:0/1147569637 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f847c09adc0 con 0x7f848806f770 2024-09-17T03:33:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7fc1d7fff640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d80747e0 0x7fc1d813fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:12.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f323b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234052770 0x7f3234180ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f33ded78640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f33d00548a0 con 0x7f33d00df800 2024-09-17T03:33:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f33ded78640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f33d0054720 con 0x7f33d00519a0 2024-09-17T03:33:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.218+0000 7f33ded78640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f33d0054a20 con 0x7f33d0006820 2024-09-17T03:33:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f89f359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ec0348c0 0x7f89ec04a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f89f359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ec051c80 0x7f89ec0de300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f89f359e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89ec0e3150 0x7f89ec0337a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f33dd575640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33d00519a0 0x7f33d0034400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f33dd575640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33d00519a0 0x7f33d0034400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:59482/0 (socket says 172.21.15.146:59482) 2024-09-17T03:33:12.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f33dd575640 1 -- 172.21.15.146:0/3046017433 learned_addr learned my addr 172.21.15.146:0/3046017433 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:12.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f56c7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56c80b4950 0x7f56c80728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84880b5380 con 0x7f848806f770 2024-09-17T03:33:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f56c7fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56c80b4950 0x7f56c80728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:59478/0 (socket says 172.21.15.146:59478) 2024-09-17T03:33:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f56c7fff640 1 -- 172.21.15.146:0/1729019344 learned_addr learned my addr 172.21.15.146:0/1729019344 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7fc1dcf83640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d815ea80 0x7fc1d809d360 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800baf0 tx=0x7fc1c8011e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f8486ffd640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8474078be0 0x7f847407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f89f259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ec0348c0 0x7f89ec04a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f89f259c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ec0348c0 0x7f89ec04a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:36424/0 (socket says 172.21.15.146:36424) 2024-09-17T03:33:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f33ddd76640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33d0006820 0x7f33d00226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f33de577640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d00df800 0x7f33d0033040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f56c77fe640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56c806cc50 0x7f56c80c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f323affd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f323400b070 0x7f323404e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f323affd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f323400b070 0x7f323404e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:36432/0 (socket says 172.21.15.146:36432) 2024-09-17T03:33:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f323affd640 1 -- 172.21.15.146:0/531550536 learned_addr learned my addr 172.21.15.146:0/531550536 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f89f259c640 1 -- 172.21.15.146:0/251418141 learned_addr learned my addr 172.21.15.146:0/251418141 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:12.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f323a7fc640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3234052360 0x7f3234048280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec0e3e30 con 0x7f89ec051c80 2024-09-17T03:33:12.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec0e3cb0 con 0x7f89ec0e3150 2024-09-17T03:33:12.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89ec0e3fb0 con 0x7f89ec0348c0 2024-09-17T03:33:12.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f89f1d9b640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ec051c80 0x7f89ec0de300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f56c6ffd640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56c806f9f0 0x7f56c8152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f33dd575640 1 -- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33d0006820 msgr2=0x7f33d00226a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7fc1d4ff9640 1 -- 172.21.15.146:0/3684615940 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8009e10 con 0x7fc1d815ea80 2024-09-17T03:33:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7fc1d4ff9640 1 -- 172.21.15.146:0/3684615940 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1c8011050 con 0x7fc1d815ea80 2024-09-17T03:33:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7fc1d4ff9640 1 -- 172.21.15.146:0/3684615940 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c80114a0 con 0x7fc1d815ea80 2024-09-17T03:33:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d8160f60 con 0x7fc1d815ea80 2024-09-17T03:33:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f33dd575640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33d0006820 0x7f33d00226a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f89f259c640 1 -- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89ec0e3150 msgr2=0x7f89ec0337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f89f259c640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89ec0e3150 0x7f89ec0337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f89f259c640 1 -- 172.21.15.146:0/251418141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ec051c80 msgr2=0x7f89ec0de300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f89f259c640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ec051c80 0x7f89ec0de300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d8161520 con 0x7fc1d815ea80 2024-09-17T03:33:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f323a7fc640 1 -- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f323400b070 msgr2=0x7f323404e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f323a7fc640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f323400b070 0x7f323404e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f323a7fc640 1 -- 172.21.15.146:0/531550536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234052770 msgr2=0x7f3234180ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f323a7fc640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234052770 0x7f3234180ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f323a7fc640 1 -- 172.21.15.146:0/531550536 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323417fee0 con 0x7f3234052360 2024-09-17T03:33:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f89f259c640 1 -- 172.21.15.146:0/251418141 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ec0de840 con 0x7f89ec0348c0 2024-09-17T03:33:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f56c77fe640 1 -- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56c80b4950 msgr2=0x7f56c80728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f56c77fe640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56c80b4950 0x7f56c80728e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f56c77fe640 1 -- 172.21.15.146:0/1729019344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56c806f9f0 msgr2=0x7f56c8152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f56c77fe640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56c806f9f0 0x7f56c8152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f56c77fe640 1 -- 172.21.15.146:0/1729019344 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c8153520 con 0x7f56c806cc50 2024-09-17T03:33:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f33dd575640 1 -- 172.21.15.146:0/3046017433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d00df800 msgr2=0x7f33d0033040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f33dd575640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d00df800 0x7f33d0033040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.219+0000 7f33dd575640 1 -- 172.21.15.146:0/3046017433 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d0031fa0 con 0x7f33d00519a0 2024-09-17T03:33:12.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f33ddd76640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33d0006820 0x7f33d00226a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:33:12.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f323a7fc640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3234052360 0x7f3234048280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f323000c340 tx=0x7f323000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f89f259c640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ec0348c0 0x7f89ec04a130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89e400c530 tx=0x7f89e400c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f56c77fe640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56c806cc50 0x7f56c80c9ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56c000c6c0 tx=0x7f56c000cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f8486ffd640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8474078be0 0x7f847407b0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8488155580 tx=0x7f8478007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.220+0000 7f33dd575640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33d00519a0 0x7f33d0034400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f33d806c820 tx=0x7f33d80b5f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f89e2ffd640 1 -- 172.21.15.146:0/251418141 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4016020 con 0x7f89ec0348c0 2024-09-17T03:33:12.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f89e2ffd640 1 -- 172.21.15.146:0/251418141 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89e4012830 con 0x7f89ec0348c0 2024-09-17T03:33:12.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ec0328a0 con 0x7f89ec0348c0 2024-09-17T03:33:12.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f56affff640 1 -- 172.21.15.146:0/1729019344 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c001e070 con 0x7f56c806cc50 2024-09-17T03:33:12.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f56ce05c640 1 -- 172.21.15.146:0/1729019344 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c8072e20 con 0x7f56c806cc50 2024-09-17T03:33:12.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f56ce05c640 1 -- 172.21.15.146:0/1729019344 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c80c90e0 con 0x7f56c806cc50 2024-09-17T03:33:12.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ec054450 con 0x7f89ec0348c0 2024-09-17T03:33:12.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f56affff640 1 -- 172.21.15.146:0/1729019344 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56c000a930 con 0x7f56c806cc50 2024-09-17T03:33:12.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f6c9b561640 1 Processor -- start 2024-09-17T03:33:12.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f89e2ffd640 1 -- 172.21.15.146:0/251418141 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4012c80 con 0x7f89ec0348c0 2024-09-17T03:33:12.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f6c9b561640 1 -- start start 2024-09-17T03:33:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.221+0000 7f56affff640 1 -- 172.21.15.146:0/1729019344 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c000ad60 con 0x7f56c806cc50 2024-09-17T03:33:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.222+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d80b5df0 con 0x7fc1d815ea80 2024-09-17T03:33:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.222+0000 7f56ce05c640 1 -- 172.21.15.146:0/1729019344 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c8070350 con 0x7f56c806cc50 2024-09-17T03:33:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.222+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ec052090 con 0x7f89ec0348c0 2024-09-17T03:33:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7fc1d4ff9640 1 -- 172.21.15.146:0/3684615940 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1c8005020 con 0x7fc1d815ea80 2024-09-17T03:33:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f6c9b561640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c940c69d0 0x7f6c9414aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f6c9b561640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c940cca50 0x7f6c9414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f6c9b561640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941583f0 0x7f6c9414ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f6c9b561640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9406ed50 con 0x7f6c940c69d0 2024-09-17T03:33:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f6c9b561640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9406ebd0 con 0x7f6c941583f0 2024-09-17T03:33:12.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f6c9b561640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6c9406eed0 con 0x7f6c940cca50 2024-09-17T03:33:12.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7fc1d4ff9640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c4078be0 0x7fc1c407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7fc1d4ff9640 1 -- 172.21.15.146:0/3684615940 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc1c809ed70 con 0x7fc1d815ea80 2024-09-17T03:33:12.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f6c9ad60640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941583f0 0x7f6c9414ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f6c9ad60640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941583f0 0x7f6c9414ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:59500/0 (socket says 172.21.15.146:59500) 2024-09-17T03:33:12.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f6c9ad60640 1 -- 172.21.15.146:0/3298433838 learned_addr learned my addr 172.21.15.146:0/3298433838 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:12.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f6c99d5e640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c940cca50 0x7f6c9414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7fc1d7fff640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c4078be0 0x7fc1c407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f6c9a55f640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c940c69d0 0x7f6c9414aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.223+0000 7f89e2ffd640 1 -- 172.21.15.146:0/251418141 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f89e4019020 con 0x7f89ec0348c0 2024-09-17T03:33:12.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7f6c9ad60640 1 -- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c940cca50 msgr2=0x7f6c9414a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7f6c9ad60640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c940cca50 0x7f6c9414a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7f6c9ad60640 1 -- 172.21.15.146:0/3298433838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c940c69d0 msgr2=0x7f6c9414aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7f56affff640 1 -- 172.21.15.146:0/1729019344 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f56c0021070 con 0x7f56c806cc50 2024-09-17T03:33:12.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7f6c9ad60640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c940c69d0 0x7f6c9414aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7f6c9ad60640 1 -- 172.21.15.146:0/3298433838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9414d430 con 0x7f6c941583f0 2024-09-17T03:33:12.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7f89e2ffd640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89d4078bc0 0x7f89d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7fc1d7fff640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c4078be0 0x7fc1c407b0f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc000f60 tx=0x7fc1cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7f6c9ad60640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941583f0 0x7f6c9414ca60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400b3e0 tx=0x7f6c8400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7f89e2ffd640 1 -- 172.21.15.146:0/251418141 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f89e409ac50 con 0x7f89ec0348c0 2024-09-17T03:33:12.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7f89f1d9b640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89d4078bc0 0x7f89d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.224+0000 7f56affff640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56b4078bc0 0x7f56b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.225+0000 7f56affff640 1 -- 172.21.15.146:0/1729019344 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f56c009e6b0 con 0x7f56c806cc50 2024-09-17T03:33:12.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.225+0000 7f56c6ffd640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56b4078bc0 0x7f56b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.225+0000 7f89f1d9b640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89d4078bc0 0x7f89d407b0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f89f4066360 tx=0x7f89f406b770 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.225+0000 7f56c6ffd640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56b4078bc0 0x7f56b407b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f56c8074310 tx=0x7f56b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.227+0000 7f32237fe640 1 -- 172.21.15.146:0/531550536 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230017070 con 0x7f3234052360 2024-09-17T03:33:12.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.227+0000 7f6c8affd640 1 -- 172.21.15.146:0/3298433838 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84015020 con 0x7f6c941583f0 2024-09-17T03:33:12.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.227+0000 7f6c9b561640 1 -- 172.21.15.146:0/3298433838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9414d710 con 0x7f6c941583f0 2024-09-17T03:33:12.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.228+0000 7f6c8affd640 1 -- 172.21.15.146:0/3298433838 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c84011920 con 0x7f6c941583f0 2024-09-17T03:33:12.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.228+0000 7f6c8affd640 1 -- 172.21.15.146:0/3298433838 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84011d10 con 0x7f6c941583f0 2024-09-17T03:33:12.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.228+0000 7f6c9b561640 1 -- 172.21.15.146:0/3298433838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c94074490 con 0x7f6c941583f0 2024-09-17T03:33:12.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.227+0000 7f323bfff640 1 -- 172.21.15.146:0/531550536 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32341801c0 con 0x7f3234052360 2024-09-17T03:33:12.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.228+0000 7f323bfff640 1 -- 172.21.15.146:0/531550536 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3234180780 con 0x7f3234052360 2024-09-17T03:33:12.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.227+0000 7f33ce7fc640 1 -- 172.21.15.146:0/3046017433 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d80b1050 con 0x7f33d00519a0 2024-09-17T03:33:12.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.228+0000 7f33ded78640 1 -- 172.21.15.146:0/3046017433 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d0032280 con 0x7f33d00519a0 2024-09-17T03:33:12.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.228+0000 7f33ded78640 1 -- 172.21.15.146:0/3046017433 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d0032840 con 0x7f33d00519a0 2024-09-17T03:33:12.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.228+0000 7f846ffff640 1 -- 172.21.15.146:0/1147569637 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f847c062c10 con 0x7f848806f770 2024-09-17T03:33:12.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.228+0000 7f32237fe640 1 -- 172.21.15.146:0/531550536 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32300053c0 con 0x7f3234052360 2024-09-17T03:33:12.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.228+0000 7f33ce7fc640 1 -- 172.21.15.146:0/3046017433 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33d80ba070 con 0x7f33d00519a0 2024-09-17T03:33:12.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.228+0000 7f33ce7fc640 1 -- 172.21.15.146:0/3046017433 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d80b6b60 con 0x7f33d00519a0 2024-09-17T03:33:12.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.229+0000 7f32237fe640 1 -- 172.21.15.146:0/531550536 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230003850 con 0x7f3234052360 2024-09-17T03:33:12.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.229+0000 7f323bfff640 1 -- 172.21.15.146:0/531550536 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321c005290 con 0x7f3234052360 2024-09-17T03:33:12.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.229+0000 7f33ded78640 1 -- 172.21.15.146:0/3046017433 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c0005290 con 0x7f33d00519a0 2024-09-17T03:33:12.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.230+0000 7f6c9b561640 1 -- 172.21.15.146:0/3298433838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c9414d1a0 con 0x7f6c941583f0 2024-09-17T03:33:12.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.230+0000 7f32237fe640 1 -- 172.21.15.146:0/531550536 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f323001a070 con 0x7f3234052360 2024-09-17T03:33:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.230+0000 7f6c8affd640 1 -- 172.21.15.146:0/3298433838 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c84018020 con 0x7f6c941583f0 2024-09-17T03:33:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.231+0000 7f32237fe640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3228078b90 0x7f322807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.231+0000 7f33ce7fc640 1 -- 172.21.15.146:0/3046017433 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f33d80c5060 con 0x7f33d00519a0 2024-09-17T03:33:12.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.231+0000 7f323affd640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3228078b90 0x7f322807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.231+0000 7f6c8affd640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 0x7f6c7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.231+0000 7f32237fe640 1 -- 172.21.15.146:0/531550536 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f323009a0f0 con 0x7f3234052360 2024-09-17T03:33:12.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.231+0000 7f6c8affd640 1 -- 172.21.15.146:0/3298433838 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6c8409aaf0 con 0x7f6c941583f0 2024-09-17T03:33:12.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.231+0000 7f6c9a55f640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 0x7f6c7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.231+0000 7f323affd640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3228078b90 0x7f322807b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f322c005860 tx=0x7f322c00b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.232+0000 7f33ce7fc640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33bc078b90 0x7f33bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.232+0000 7f6c9a55f640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 0x7f6c7807b0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c005fd0 tx=0x7f6c8c010040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.232+0000 7f33ce7fc640 1 -- 172.21.15.146:0/3046017433 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f33d8137f70 con 0x7f33d00519a0 2024-09-17T03:33:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.232+0000 7f33ddd76640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33bc078b90 0x7f33bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.232+0000 7f33ddd76640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33bc078b90 0x7f33bc07b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009f20 tx=0x7f33d4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.232+0000 7fc1d4ff9640 1 -- 172.21.15.146:0/3684615940 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc1c8016070 con 0x7fc1d815ea80 2024-09-17T03:33:12.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.240+0000 7f32237fe640 1 -- 172.21.15.146:0/531550536 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3230061f50 con 0x7f3234052360 2024-09-17T03:33:12.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.242+0000 7f89e2ffd640 1 -- 172.21.15.146:0/251418141 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89e40a0020 con 0x7f89ec0348c0 2024-09-17T03:33:12.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.251+0000 7f33ce7fc640 1 -- 172.21.15.146:0/3046017433 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f33d80ffd40 con 0x7f33d00519a0 2024-09-17T03:33:12.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.254+0000 7f56affff640 1 -- 172.21.15.146:0/1729019344 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f56c806d5a0 con 0x7f56c806cc50 2024-09-17T03:33:12.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.257+0000 7f6c8affd640 1 -- 172.21.15.146:0/3298433838 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6c8401f020 con 0x7f6c941583f0 2024-09-17T03:33:12.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.574+0000 7f2070663640 1 -- 172.21.15.146:0/86776197 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f20680746a0 con 0x7f20680b3360 2024-09-17T03:33:12.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.575+0000 7f205effd640 1 -- 172.21.15.146:0/86776197 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f20680746a0 con 0x7f20680b3360 2024-09-17T03:33:12.575 INFO:teuthology.orchestra.run.smithi146.stdout:64424509448 2024-09-17T03:33:12.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.579+0000 7f205cff9640 1 -- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f204c078c90 msgr2=0x7f204c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.579+0000 7f205cff9640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f204c078c90 0x7f204c07b1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f206806e420 tx=0x7f2060001af0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.579+0000 7f205cff9640 1 -- 172.21.15.146:0/86776197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20680b3360 msgr2=0x7f206815ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.579+0000 7f205cff9640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20680b3360 0x7f206815ff20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2064034040 tx=0x7f20640049d0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.579+0000 7f205cff9640 1 -- 172.21.15.146:0/86776197 shutdown_connections 2024-09-17T03:33:12.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.579+0000 7f205cff9640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f204c078c90 0x7f204c07b1a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.579+0000 7f205cff9640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2068162f50 0x7f20681fd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.580+0000 7f205cff9640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2068162600 0x7f2068156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.580+0000 7f205cff9640 1 --2- 172.21.15.146:0/86776197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20680b3360 0x7f206815ff20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.580+0000 7f205cff9640 1 -- 172.21.15.146:0/86776197 >> 172.21.15.146:0/86776197 conn(0x7f20680b2060 msgr2=0x7f2068072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.580+0000 7f205cff9640 1 -- 172.21.15.146:0/86776197 shutdown_connections 2024-09-17T03:33:12.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.580+0000 7f205cff9640 1 -- 172.21.15.146:0/86776197 wait complete. 2024-09-17T03:33:12.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-09-17T03:33:12.598 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:12.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.616+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f84880cf5c0 con 0x7f848806f770 2024-09-17T03:33:12.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.616+0000 7f846ffff640 1 -- 172.21.15.146:0/1147569637 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f847c067640 con 0x7f848806f770 2024-09-17T03:33:12.616 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8474078be0 msgr2=0x7f847407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8474078be0 0x7f847407b0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8488155580 tx=0x7f8478007e90 comp rx=0 tx=0).stop 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848806f770 msgr2=0x7f84881f1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848806f770 0x7f84881f1250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f847c00d740 tx=0x7f847c00dc00 comp rx=0 tx=0).stop 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 shutdown_connections 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8474078be0 0x7f847407b0f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8488160060 0x7f848815e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84880b3cf0 0x7f84881584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 --2- 172.21.15.146:0/1147569637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f848806f770 0x7f84881f1250 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 >> 172.21.15.146:0/1147569637 conn(0x7f84880b2060 msgr2=0x7f848806fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 shutdown_connections 2024-09-17T03:33:12.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.619+0000 7f848dad3640 1 -- 172.21.15.146:0/1147569637 wait complete. 2024-09-17T03:33:12.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2024-09-17T03:33:12.631 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:12.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.651+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc1d80b3360 con 0x7fc1d815ea80 2024-09-17T03:33:12.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.652+0000 7fc1d4ff9640 1 -- 172.21.15.146:0/3684615940 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc1c8067290 con 0x7fc1d815ea80 2024-09-17T03:33:12.652 INFO:teuthology.orchestra.run.smithi146.stdout:64424509448 2024-09-17T03:33:12.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.655+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c4078be0 msgr2=0x7fc1c407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.655+0000 7fc1de9e6640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c4078be0 0x7fc1c407b0f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc000f60 tx=0x7fc1cc009040 comp rx=0 tx=0).stop 2024-09-17T03:33:12.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.655+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d815ea80 msgr2=0x7fc1d809d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.655+0000 7fc1de9e6640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d815ea80 0x7fc1d809d360 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800baf0 tx=0x7fc1c8011e90 comp rx=0 tx=0).stop 2024-09-17T03:33:12.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.656+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 shutdown_connections 2024-09-17T03:33:12.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.656+0000 7fc1de9e6640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c4078be0 0x7fc1c407b0f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.656+0000 7fc1de9e6640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1d815ea80 0x7fc1d809d360 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.656+0000 7fc1de9e6640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1d80b59e0 0x7fc1d8155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.656+0000 7fc1de9e6640 1 --2- 172.21.15.146:0/3684615940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d80747e0 0x7fc1d813fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.656+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 >> 172.21.15.146:0/3684615940 conn(0x7fc1d80b2db0 msgr2=0x7fc1d815e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.656+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 shutdown_connections 2024-09-17T03:33:12.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.656+0000 7fc1de9e6640 1 -- 172.21.15.146:0/3684615940 wait complete. 2024-09-17T03:33:12.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.657+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f89ec036840 con 0x7f89ec0348c0 2024-09-17T03:33:12.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.657+0000 7f89e2ffd640 1 -- 172.21.15.146:0/251418141 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f89e4020020 con 0x7f89ec0348c0 2024-09-17T03:33:12.658 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2024-09-17T03:33:12.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89d4078bc0 msgr2=0x7f89d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89d4078bc0 0x7f89d407b0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f89f4066360 tx=0x7f89f406b770 comp rx=0 tx=0).stop 2024-09-17T03:33:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ec0348c0 msgr2=0x7f89ec04a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ec0348c0 0x7f89ec04a130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89e400c530 tx=0x7f89e400c9f0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 shutdown_connections 2024-09-17T03:33:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89d4078bc0 0x7f89d407b0d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89ec0e3150 0x7f89ec0337a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ec051c80 0x7f89ec0de300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 --2- 172.21.15.146:0/251418141 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ec0348c0 0x7f89ec04a130 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 >> 172.21.15.146:0/251418141 conn(0x7f89ec01e230 msgr2=0x7f89ec036d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 shutdown_connections 2024-09-17T03:33:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.661+0000 7f89f359e640 1 -- 172.21.15.146:0/251418141 wait complete. 2024-09-17T03:33:12.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.664+0000 7f323bfff640 1 -- 172.21.15.146:0/531550536 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f321c005850 con 0x7f3234052360 2024-09-17T03:33:12.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.665+0000 7f32237fe640 1 -- 172.21.15.146:0/531550536 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3230066980 con 0x7f3234052360 2024-09-17T03:33:12.665 INFO:teuthology.orchestra.run.smithi146.stdout:64424509448 2024-09-17T03:33:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.668+0000 7f323bfff640 1 -- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3228078b90 msgr2=0x7f322807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.669+0000 7f323bfff640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3228078b90 0x7f322807b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f322c005860 tx=0x7f322c00b390 comp rx=0 tx=0).stop 2024-09-17T03:33:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.669+0000 7f323bfff640 1 -- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3234052360 msgr2=0x7f3234048280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.669+0000 7f323bfff640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3234052360 0x7f3234048280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f323000c340 tx=0x7f323000c800 comp rx=0 tx=0).stop 2024-09-17T03:33:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.669+0000 7f323bfff640 1 -- 172.21.15.146:0/531550536 shutdown_connections 2024-09-17T03:33:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.669+0000 7f323bfff640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3228078b90 0x7f322807b0a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.669+0000 7f323bfff640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234052770 0x7f3234180ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.669+0000 7f323bfff640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3234052360 0x7f3234048280 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.669+0000 7f323bfff640 1 --2- 172.21.15.146:0/531550536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f323400b070 0x7f323404e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.669+0000 7f323bfff640 1 -- 172.21.15.146:0/531550536 >> 172.21.15.146:0/531550536 conn(0x7f3234051420 msgr2=0x7f3234035af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.669+0000 7f323bfff640 1 -- 172.21.15.146:0/531550536 shutdown_connections 2024-09-17T03:33:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.669+0000 7f323bfff640 1 -- 172.21.15.146:0/531550536 wait complete. 2024-09-17T03:33:12.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-09-17T03:33:12.673 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.674+0000 7f33ded78640 1 -- 172.21.15.146:0/3046017433 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f33c0005850 con 0x7f33d00519a0 2024-09-17T03:33:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.675+0000 7f33ce7fc640 1 -- 172.21.15.146:0/3046017433 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f33d8104770 con 0x7f33d00519a0 2024-09-17T03:33:12.675 INFO:teuthology.orchestra.run.smithi146.stdout:64424509448 2024-09-17T03:33:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.676+0000 7f56ce05c640 1 -- 172.21.15.146:0/1729019344 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f56c80b20b0 con 0x7f56c806cc50 2024-09-17T03:33:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.676+0000 7f56affff640 1 -- 172.21.15.146:0/1729019344 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56c0066640 con 0x7f56c806cc50 2024-09-17T03:33:12.676 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2024-09-17T03:33:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 -- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33bc078b90 msgr2=0x7f33bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33bc078b90 0x7f33bc07b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009f20 tx=0x7f33d4005f90 comp rx=0 tx=0).stop 2024-09-17T03:33:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 -- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33d00519a0 msgr2=0x7f33d0034400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33d00519a0 0x7f33d0034400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f33d806c820 tx=0x7f33d80b5f40 comp rx=0 tx=0).stop 2024-09-17T03:33:12.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 -- 172.21.15.146:0/3046017433 shutdown_connections 2024-09-17T03:33:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33bc078b90 0x7f33bc07b0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d00df800 0x7f33d0033040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33d00519a0 0x7f33d0034400 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 --2- 172.21.15.146:0/3046017433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33d0006820 0x7f33d00226a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 -- 172.21.15.146:0/3046017433 >> 172.21.15.146:0/3046017433 conn(0x7f33d001e260 msgr2=0x7f33d00dde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 -- 172.21.15.146:0/3046017433 shutdown_connections 2024-09-17T03:33:12.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.678+0000 7f33ded78640 1 -- 172.21.15.146:0/3046017433 wait complete. 2024-09-17T03:33:12.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-09-17T03:33:12.680 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 -- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56b4078bc0 msgr2=0x7f56b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56b4078bc0 0x7f56b407b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f56c8074310 tx=0x7f56b8009040 comp rx=0 tx=0).stop 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 -- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56c806cc50 msgr2=0x7f56c80c9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56c806cc50 0x7f56c80c9ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56c000c6c0 tx=0x7f56c000cb80 comp rx=0 tx=0).stop 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 -- 172.21.15.146:0/1729019344 shutdown_connections 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56b4078bc0 0x7f56b407b0d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56c80b4950 0x7f56c80728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56c806f9f0 0x7f56c8152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 --2- 172.21.15.146:0/1729019344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56c806cc50 0x7f56c80c9ea0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 -- 172.21.15.146:0/1729019344 >> 172.21.15.146:0/1729019344 conn(0x7f56c80d0ab0 msgr2=0x7f56c80c3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 -- 172.21.15.146:0/1729019344 shutdown_connections 2024-09-17T03:33:12.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.679+0000 7f56ce05c640 1 -- 172.21.15.146:0/1729019344 wait complete. 2024-09-17T03:33:12.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.682+0000 7f6c9b561640 1 -- 172.21.15.146:0/3298433838 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6c9406f3f0 con 0x7f6c941583f0 2024-09-17T03:33:12.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.682+0000 7f6c8affd640 1 -- 172.21.15.146:0/3298433838 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c840628d0 con 0x7f6c941583f0 2024-09-17T03:33:12.683 INFO:teuthology.orchestra.run.smithi146.stdout:64424509449 2024-09-17T03:33:12.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-09-17T03:33:12.683 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 -- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 msgr2=0x7f6c7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 0x7f6c7807b0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c005fd0 tx=0x7f6c8c010040 comp rx=0 tx=0).stop 2024-09-17T03:33:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 -- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941583f0 msgr2=0x7f6c9414ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941583f0 0x7f6c9414ca60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400b3e0 tx=0x7f6c8400b8a0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 -- 172.21.15.146:0/3298433838 shutdown_connections 2024-09-17T03:33:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 0x7f6c7807b0a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c941583f0 0x7f6c9414ca60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c940cca50 0x7f6c9414a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 --2- 172.21.15.146:0/3298433838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c940c69d0 0x7f6c9414aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 -- 172.21.15.146:0/3298433838 >> 172.21.15.146:0/3298433838 conn(0x7f6c9406d280 msgr2=0x7f6c940b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 -- 172.21.15.146:0/3298433838 shutdown_connections 2024-09-17T03:33:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.685+0000 7f6c9b561640 1 -- 172.21.15.146:0/3298433838 wait complete. 2024-09-17T03:33:12.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-09-17T03:33:12.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-09-17T03:33:12.694 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:12.694 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:12.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-09-17T03:33:12.697 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:12.698 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:33:12.698 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:12.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.850+0000 7fbffb2de640 1 -- 172.21.15.146:0/3265698503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfe0004d40 msgr2=0x7fbfe0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.850+0000 7fbffb2de640 1 --2- 172.21.15.146:0/3265698503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfe0004d40 0x7fbfe0005150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbfec005fd0 tx=0x7fbfe0005830 comp rx=0 tx=0).stop 2024-09-17T03:33:12.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.850+0000 7fbff987b640 1 -- 172.21.15.146:0/3265698503 reap_dead start 2024-09-17T03:33:12.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.850+0000 7fbffb2de640 1 -- 172.21.15.146:0/3265698503 shutdown_connections 2024-09-17T03:33:12.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.850+0000 7fbffb2de640 1 -- 172.21.15.146:0/3265698503 >> 172.21.15.146:0/3265698503 conn(0x7fbff40b2060 msgr2=0x7fbff40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:12.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.850+0000 7fbffb2de640 1 -- 172.21.15.146:0/3265698503 shutdown_connections 2024-09-17T03:33:12.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.850+0000 7fbffb2de640 1 -- 172.21.15.146:0/3265698503 wait complete. 2024-09-17T03:33:12.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.852+0000 7fbffb2de640 1 Processor -- start 2024-09-17T03:33:12.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.852+0000 7fbffb2de640 1 -- start start 2024-09-17T03:33:12.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.853+0000 7fbffb2de640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe0004d40 0x7fbff413bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.853+0000 7fbffb2de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbff4151280 0x7fbff4151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.853+0000 7fbffb2de640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff40ae890 0x7fbff40aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.853+0000 7fbffb2de640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbff40b4cf0 con 0x7fbff40ae890 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.853+0000 7fbffb2de640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbff40b4b70 con 0x7fbfe0004d40 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.853+0000 7fbffb2de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbff40b4e70 con 0x7fbff4151280 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.853+0000 7fbff987b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff40ae890 0x7fbff40aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.853+0000 7fbff987b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff40ae890 0x7fbff40aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50736/0 (socket says 172.21.15.146:50736) 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.853+0000 7fbff987b640 1 -- 172.21.15.146:0/85774892 learned_addr learned my addr 172.21.15.146:0/85774892 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.853+0000 7fbff8879640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbff4151280 0x7fbff4151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.853+0000 7fbff907a640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe0004d40 0x7fbff413bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.854+0000 7fbff987b640 1 -- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbff4151280 msgr2=0x7fbff4151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.854+0000 7fbff987b640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbff4151280 0x7fbff4151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.854+0000 7fbff987b640 1 -- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe0004d40 msgr2=0x7fbff413bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.854+0000 7fbff987b640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe0004d40 0x7fbff413bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.854+0000 7fbff987b640 1 -- 172.21.15.146:0/85774892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff40af1e0 con 0x7fbff40ae890 2024-09-17T03:33:12.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.854+0000 7fbff987b640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff40ae890 0x7fbff40aeca0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbfec02b860 tx=0x7fbfec033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.854+0000 7fbfe9ffb640 1 -- 172.21.15.146:0/85774892 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec042070 con 0x7fbff40ae890 2024-09-17T03:33:12.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.854+0000 7fbfe9ffb640 1 -- 172.21.15.146:0/85774892 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfec003970 con 0x7fbff40ae890 2024-09-17T03:33:12.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.854+0000 7fbffb2de640 1 -- 172.21.15.146:0/85774892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff4168560 con 0x7fbff40ae890 2024-09-17T03:33:12.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.854+0000 7fbfe9ffb640 1 -- 172.21.15.146:0/85774892 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec038040 con 0x7fbff40ae890 2024-09-17T03:33:12.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.854+0000 7fbffb2de640 1 -- 172.21.15.146:0/85774892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff4168b20 con 0x7fbff40ae890 2024-09-17T03:33:12.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.855+0000 7fbffb2de640 1 -- 172.21.15.146:0/85774892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff40b53d0 con 0x7fbff40ae890 2024-09-17T03:33:12.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.856+0000 7fbfe9ffb640 1 -- 172.21.15.146:0/85774892 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbfec033d10 con 0x7fbff40ae890 2024-09-17T03:33:12.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.856+0000 7fbfe9ffb640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfd8078b90 0x7fbfd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:12.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.857+0000 7fbfe9ffb640 1 -- 172.21.15.146:0/85774892 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbfec0bad80 con 0x7fbff40ae890 2024-09-17T03:33:12.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.857+0000 7fbff907a640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfd8078b90 0x7fbfd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:12.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.857+0000 7fbff907a640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfd8078b90 0x7fbfd807b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009c50 tx=0x7fbff0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:12.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:12.861+0000 7fbfe9ffb640 1 -- 172.21.15.146:0/85774892 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbff40af1e0 con 0x7fbff40ae890 2024-09-17T03:33:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.030+0000 7fbffb2de640 1 -- 172.21.15.146:0/85774892 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbff4157a30 con 0x7fbfd8078b90 2024-09-17T03:33:13.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.035+0000 7fbfe9ffb640 1 -- 172.21.15.146:0/85774892 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7fbff005e7d0 con 0x7fbfd8078b90 2024-09-17T03:33:13.038 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:13.039 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 -- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfd8078b90 msgr2=0x7fbfd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfd8078b90 0x7fbfd807b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009c50 tx=0x7fbff0005f90 comp rx=0 tx=0).stop 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 -- 172.21.15.146:0/85774892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff40ae890 msgr2=0x7fbff40aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff40ae890 0x7fbff40aeca0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbfec02b860 tx=0x7fbfec033ba0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 -- 172.21.15.146:0/85774892 shutdown_connections 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfd8078b90 0x7fbfd807b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbff40ae890 0x7fbff40aeca0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbff4151280 0x7fbff4151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 --2- 172.21.15.146:0/85774892 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfe0004d40 0x7fbff413bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 -- 172.21.15.146:0/85774892 >> 172.21.15.146:0/85774892 conn(0x7fbff40b2060 msgr2=0x7fbff415dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 -- 172.21.15.146:0/85774892 shutdown_connections 2024-09-17T03:33:13.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.038+0000 7fbffb2de640 1 -- 172.21.15.146:0/85774892 wait complete. 2024-09-17T03:33:13.049 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T03:33:11.792091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219124,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755596,"statfs":{"total":773094113280,"available":772869730304,"internally_reserved":0,"allocated":2924544,"data_stored":1767532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.023860"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829399+0000","last_change":"2024-09-17T03:33:00.776875+0000","last_active":"2024-09-17T03:33:01.829399+0000","last_peered":"2024-09-17T03:33:01.829399+0000","last_clean":"2024-09-17T03:33:01.829399+0000","last_became_active":"2024-09-17T03:33:00.776492+0000","last_became_peered":"2024-09-17T03:33:00.776492+0000","last_unstale":"2024-09-17T03:33:01.829399+0000","last_undegraded":"2024-09-17T03:33:01.829399+0000","last_fullsized":"2024-09-17T03:33:01.829399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:05.190506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767824+0000","last_change":"2024-09-17T03:33:00.768131+0000","last_active":"2024-09-17T03:33:01.767824+0000","last_peered":"2024-09-17T03:33:01.767824+0000","last_clean":"2024-09-17T03:33:01.767824+0000","last_became_active":"2024-09-17T03:33:00.767420+0000","last_became_peered":"2024-09-17T03:33:00.767420+0000","last_unstale":"2024-09-17T03:33:01.767824+0000","last_undegraded":"2024-09-17T03:33:01.767824+0000","last_fullsized":"2024-09-17T03:33:01.767824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:03.495898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827775+0000","last_change":"2024-09-17T03:33:00.762884+0000","last_active":"2024-09-17T03:33:01.827775+0000","last_peered":"2024-09-17T03:33:01.827775+0000","last_clean":"2024-09-17T03:33:01.827775+0000","last_became_active":"2024-09-17T03:33:00.762572+0000","last_became_peered":"2024-09-17T03:33:00.762572+0000","last_unstale":"2024-09-17T03:33:01.827775+0000","last_undegraded":"2024-09-17T03:33:01.827775+0000","last_fullsized":"2024-09-17T03:33:01.827775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:26.672695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771728+0000","last_change":"2024-09-17T03:33:00.778126+0000","last_active":"2024-09-17T03:33:01.771728+0000","last_peered":"2024-09-17T03:33:01.771728+0000","last_clean":"2024-09-17T03:33:01.771728+0000","last_became_active":"2024-09-17T03:33:00.777760+0000","last_became_peered":"2024-09-17T03:33:00.777760+0000","last_unstale":"2024-09-17T03:33:01.771728+0000","last_undegraded":"2024-09-17T03:33:01.771728+0000","last_fullsized":"2024-09-17T03:33:01.771728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:48.841807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829060+0000","last_change":"2024-09-17T03:33:00.782918+0000","last_active":"2024-09-17T03:33:01.829060+0000","last_peered":"2024-09-17T03:33:01.829060+0000","last_clean":"2024-09-17T03:33:01.829060+0000","last_became_active":"2024-09-17T03:33:00.782020+0000","last_became_peered":"2024-09-17T03:33:00.782020+0000","last_unstale":"2024-09-17T03:33:01.829060+0000","last_undegraded":"2024-09-17T03:33:01.829060+0000","last_fullsized":"2024-09-17T03:33:01.829060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:04.686891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771542+0000","last_change":"2024-09-17T03:33:00.772869+0000","last_active":"2024-09-17T03:33:01.771542+0000","last_peered":"2024-09-17T03:33:01.771542+0000","last_clean":"2024-09-17T03:33:01.771542+0000","last_became_active":"2024-09-17T03:33:00.772517+0000","last_became_peered":"2024-09-17T03:33:00.772517+0000","last_unstale":"2024-09-17T03:33:01.771542+0000","last_undegraded":"2024-09-17T03:33:01.771542+0000","last_fullsized":"2024-09-17T03:33:01.771542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:19.582453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828169+0000","last_change":"2024-09-17T03:33:00.773836+0000","last_active":"2024-09-17T03:33:01.828169+0000","last_peered":"2024-09-17T03:33:01.828169+0000","last_clean":"2024-09-17T03:33:01.828169+0000","last_became_active":"2024-09-17T03:33:00.773562+0000","last_became_peered":"2024-09-17T03:33:00.773562+0000","last_unstale":"2024-09-17T03:33:01.828169+0000","last_undegraded":"2024-09-17T03:33:01.828169+0000","last_fullsized":"2024-09-17T03:33:01.828169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:17.617717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829349+0000","last_change":"2024-09-17T03:33:00.780226+0000","last_active":"2024-09-17T03:33:01.829349+0000","last_peered":"2024-09-17T03:33:01.829349+0000","last_clean":"2024-09-17T03:33:01.829349+0000","last_became_active":"2024-09-17T03:33:00.779937+0000","last_became_peered":"2024-09-17T03:33:00.779937+0000","last_unstale":"2024-09-17T03:33:01.829349+0000","last_undegraded":"2024-09-17T03:33:01.829349+0000","last_fullsized":"2024-09-17T03:33:01.829349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:23.843836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829226+0000","last_change":"2024-09-17T03:33:00.781071+0000","last_active":"2024-09-17T03:33:01.829226+0000","last_peered":"2024-09-17T03:33:01.829226+0000","last_clean":"2024-09-17T03:33:01.829226+0000","last_became_active":"2024-09-17T03:33:00.780570+0000","last_became_peered":"2024-09-17T03:33:00.780570+0000","last_unstale":"2024-09-17T03:33:01.829226+0000","last_undegraded":"2024-09-17T03:33:01.829226+0000","last_fullsized":"2024-09-17T03:33:01.829226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:40.962739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771518+0000","last_change":"2024-09-17T03:33:00.776867+0000","last_active":"2024-09-17T03:33:01.771518+0000","last_peered":"2024-09-17T03:33:01.771518+0000","last_clean":"2024-09-17T03:33:01.771518+0000","last_became_active":"2024-09-17T03:33:00.776565+0000","last_became_peered":"2024-09-17T03:33:00.776565+0000","last_unstale":"2024-09-17T03:33:01.771518+0000","last_undegraded":"2024-09-17T03:33:01.771518+0000","last_fullsized":"2024-09-17T03:33:01.771518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:14.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770780+0000","last_change":"2024-09-17T03:33:00.776047+0000","last_active":"2024-09-17T03:33:01.770780+0000","last_peered":"2024-09-17T03:33:01.770780+0000","last_clean":"2024-09-17T03:33:01.770780+0000","last_became_active":"2024-09-17T03:33:00.775733+0000","last_became_peered":"2024-09-17T03:33:00.775733+0000","last_unstale":"2024-09-17T03:33:01.770780+0000","last_undegraded":"2024-09-17T03:33:01.770780+0000","last_fullsized":"2024-09-17T03:33:01.770780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:45.334569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828513+0000","last_change":"2024-09-17T03:33:00.775474+0000","last_active":"2024-09-17T03:33:01.828513+0000","last_peered":"2024-09-17T03:33:01.828513+0000","last_clean":"2024-09-17T03:33:01.828513+0000","last_became_active":"2024-09-17T03:33:00.775111+0000","last_became_peered":"2024-09-17T03:33:00.775111+0000","last_unstale":"2024-09-17T03:33:01.828513+0000","last_undegraded":"2024-09-17T03:33:01.828513+0000","last_fullsized":"2024-09-17T03:33:01.828513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:26.456013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828003+0000","last_change":"2024-09-17T03:33:00.774115+0000","last_active":"2024-09-17T03:33:01.828003+0000","last_peered":"2024-09-17T03:33:01.828003+0000","last_clean":"2024-09-17T03:33:01.828003+0000","last_became_active":"2024-09-17T03:33:00.773803+0000","last_became_peered":"2024-09-17T03:33:00.773803+0000","last_unstale":"2024-09-17T03:33:01.828003+0000","last_undegraded":"2024-09-17T03:33:01.828003+0000","last_fullsized":"2024-09-17T03:33:01.828003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:13.109575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828014+0000","last_change":"2024-09-17T03:33:00.764440+0000","last_active":"2024-09-17T03:33:01.828014+0000","last_peered":"2024-09-17T03:33:01.828014+0000","last_clean":"2024-09-17T03:33:01.828014+0000","last_became_active":"2024-09-17T03:33:00.764123+0000","last_became_peered":"2024-09-17T03:33:00.764123+0000","last_unstale":"2024-09-17T03:33:01.828014+0000","last_undegraded":"2024-09-17T03:33:01.828014+0000","last_fullsized":"2024-09-17T03:33:01.828014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:44.310926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767341+0000","last_change":"2024-09-17T03:33:00.756678+0000","last_active":"2024-09-17T03:33:01.767341+0000","last_peered":"2024-09-17T03:33:01.767341+0000","last_clean":"2024-09-17T03:33:01.767341+0000","last_became_active":"2024-09-17T03:33:00.756342+0000","last_became_peered":"2024-09-17T03:33:00.756342+0000","last_unstale":"2024-09-17T03:33:01.767341+0000","last_undegraded":"2024-09-17T03:33:01.767341+0000","last_fullsized":"2024-09-17T03:33:01.767341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:19.020262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770738+0000","last_change":"2024-09-17T03:33:00.771303+0000","last_active":"2024-09-17T03:33:01.770738+0000","last_peered":"2024-09-17T03:33:01.770738+0000","last_clean":"2024-09-17T03:33:01.770738+0000","last_became_active":"2024-09-17T03:33:00.770971+0000","last_became_peered":"2024-09-17T03:33:00.770971+0000","last_unstale":"2024-09-17T03:33:01.770738+0000","last_undegraded":"2024-09-17T03:33:01.770738+0000","last_fullsized":"2024-09-17T03:33:01.770738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:31.492292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771440+0000","last_change":"2024-09-17T03:33:00.783198+0000","last_active":"2024-09-17T03:33:01.771440+0000","last_peered":"2024-09-17T03:33:01.771440+0000","last_clean":"2024-09-17T03:33:01.771440+0000","last_became_active":"2024-09-17T03:33:00.782880+0000","last_became_peered":"2024-09-17T03:33:00.782880+0000","last_unstale":"2024-09-17T03:33:01.771440+0000","last_undegraded":"2024-09-17T03:33:01.771440+0000","last_fullsized":"2024-09-17T03:33:01.771440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:54.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827581+0000","last_change":"2024-09-17T03:33:00.774736+0000","last_active":"2024-09-17T03:33:01.827581+0000","last_peered":"2024-09-17T03:33:01.827581+0000","last_clean":"2024-09-17T03:33:01.827581+0000","last_became_active":"2024-09-17T03:33:00.774417+0000","last_became_peered":"2024-09-17T03:33:00.774417+0000","last_unstale":"2024-09-17T03:33:01.827581+0000","last_undegraded":"2024-09-17T03:33:01.827581+0000","last_fullsized":"2024-09-17T03:33:01.827581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:25.572520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829204+0000","last_change":"2024-09-17T03:33:00.777636+0000","last_active":"2024-09-17T03:33:01.829204+0000","last_peered":"2024-09-17T03:33:01.829204+0000","last_clean":"2024-09-17T03:33:01.829204+0000","last_became_active":"2024-09-17T03:33:00.777316+0000","last_became_peered":"2024-09-17T03:33:00.777316+0000","last_unstale":"2024-09-17T03:33:01.829204+0000","last_undegraded":"2024-09-17T03:33:01.829204+0000","last_fullsized":"2024-09-17T03:33:01.829204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:55.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771462+0000","last_change":"2024-09-17T03:33:00.767553+0000","last_active":"2024-09-17T03:33:01.771462+0000","last_peered":"2024-09-17T03:33:01.771462+0000","last_clean":"2024-09-17T03:33:01.771462+0000","last_became_active":"2024-09-17T03:33:00.767260+0000","last_became_peered":"2024-09-17T03:33:00.767260+0000","last_unstale":"2024-09-17T03:33:01.771462+0000","last_undegraded":"2024-09-17T03:33:01.771462+0000","last_fullsized":"2024-09-17T03:33:01.771462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:25.613842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828611+0000","last_change":"2024-09-17T03:33:00.782782+0000","last_active":"2024-09-17T03:33:01.828611+0000","last_peered":"2024-09-17T03:33:01.828611+0000","last_clean":"2024-09-17T03:33:01.828611+0000","last_became_active":"2024-09-17T03:33:00.782342+0000","last_became_peered":"2024-09-17T03:33:00.782342+0000","last_unstale":"2024-09-17T03:33:01.828611+0000","last_undegraded":"2024-09-17T03:33:01.828611+0000","last_fullsized":"2024-09-17T03:33:01.828611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:45.334569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772159+0000","last_change":"2024-09-17T03:33:00.785690+0000","last_active":"2024-09-17T03:33:01.772159+0000","last_peered":"2024-09-17T03:33:01.772159+0000","last_clean":"2024-09-17T03:33:01.772159+0000","last_became_active":"2024-09-17T03:33:00.785379+0000","last_became_peered":"2024-09-17T03:33:00.785379+0000","last_unstale":"2024-09-17T03:33:01.772159+0000","last_undegraded":"2024-09-17T03:33:01.772159+0000","last_fullsized":"2024-09-17T03:33:01.772159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:23.348736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829110+0000","last_change":"2024-09-17T03:33:00.771812+0000","last_active":"2024-09-17T03:33:01.829110+0000","last_peered":"2024-09-17T03:33:01.829110+0000","last_clean":"2024-09-17T03:33:01.829110+0000","last_became_active":"2024-09-17T03:33:00.771519+0000","last_became_peered":"2024-09-17T03:33:00.771519+0000","last_unstale":"2024-09-17T03:33:01.829110+0000","last_undegraded":"2024-09-17T03:33:01.829110+0000","last_fullsized":"2024-09-17T03:33:01.829110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:35.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771263+0000","last_change":"2024-09-17T03:33:00.775473+0000","last_active":"2024-09-17T03:33:01.771263+0000","last_peered":"2024-09-17T03:33:01.771263+0000","last_clean":"2024-09-17T03:33:01.771263+0000","last_became_active":"2024-09-17T03:33:00.775162+0000","last_became_peered":"2024-09-17T03:33:00.775162+0000","last_unstale":"2024-09-17T03:33:01.771263+0000","last_undegraded":"2024-09-17T03:33:01.771263+0000","last_fullsized":"2024-09-17T03:33:01.771263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:46.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828630+0000","last_change":"2024-09-17T03:33:00.769652+0000","last_active":"2024-09-17T03:33:01.828630+0000","last_peered":"2024-09-17T03:33:01.828630+0000","last_clean":"2024-09-17T03:33:01.828630+0000","last_became_active":"2024-09-17T03:33:00.769304+0000","last_became_peered":"2024-09-17T03:33:00.769304+0000","last_unstale":"2024-09-17T03:33:01.828630+0000","last_undegraded":"2024-09-17T03:33:01.828630+0000","last_fullsized":"2024-09-17T03:33:01.828630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:57.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771737+0000","last_change":"2024-09-17T03:33:00.782886+0000","last_active":"2024-09-17T03:33:01.771737+0000","last_peered":"2024-09-17T03:33:01.771737+0000","last_clean":"2024-09-17T03:33:01.771737+0000","last_became_active":"2024-09-17T03:33:00.782588+0000","last_became_peered":"2024-09-17T03:33:00.782588+0000","last_unstale":"2024-09-17T03:33:01.771737+0000","last_undegraded":"2024-09-17T03:33:01.771737+0000","last_fullsized":"2024-09-17T03:33:01.771737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:41.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767437+0000","last_change":"2024-09-17T03:33:00.760617+0000","last_active":"2024-09-17T03:33:01.767437+0000","last_peered":"2024-09-17T03:33:01.767437+0000","last_clean":"2024-09-17T03:33:01.767437+0000","last_became_active":"2024-09-17T03:33:00.760082+0000","last_became_peered":"2024-09-17T03:33:00.760082+0000","last_unstale":"2024-09-17T03:33:01.767437+0000","last_undegraded":"2024-09-17T03:33:01.767437+0000","last_fullsized":"2024-09-17T03:33:01.767437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:14.092201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828353+0000","last_change":"2024-09-17T03:33:00.767896+0000","last_active":"2024-09-17T03:33:01.828353+0000","last_peered":"2024-09-17T03:33:01.828353+0000","last_clean":"2024-09-17T03:33:01.828353+0000","last_became_active":"2024-09-17T03:33:00.766950+0000","last_became_peered":"2024-09-17T03:33:00.766950+0000","last_unstale":"2024-09-17T03:33:01.828353+0000","last_undegraded":"2024-09-17T03:33:01.828353+0000","last_fullsized":"2024-09-17T03:33:01.828353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:06.893972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828851+0000","last_change":"2024-09-17T03:33:00.765502+0000","last_active":"2024-09-17T03:33:01.828851+0000","last_peered":"2024-09-17T03:33:01.828851+0000","last_clean":"2024-09-17T03:33:01.828851+0000","last_became_active":"2024-09-17T03:33:00.764433+0000","last_became_peered":"2024-09-17T03:33:00.764433+0000","last_unstale":"2024-09-17T03:33:01.828851+0000","last_undegraded":"2024-09-17T03:33:01.828851+0000","last_fullsized":"2024-09-17T03:33:01.828851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:14.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771900+0000","last_change":"2024-09-17T03:33:00.772070+0000","last_active":"2024-09-17T03:33:01.771900+0000","last_peered":"2024-09-17T03:33:01.771900+0000","last_clean":"2024-09-17T03:33:01.771900+0000","last_became_active":"2024-09-17T03:33:00.771721+0000","last_became_peered":"2024-09-17T03:33:00.771721+0000","last_unstale":"2024-09-17T03:33:01.771900+0000","last_undegraded":"2024-09-17T03:33:01.771900+0000","last_fullsized":"2024-09-17T03:33:01.771900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:27.987451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828035+0000","last_change":"2024-09-17T03:33:00.775482+0000","last_active":"2024-09-17T03:33:01.828035+0000","last_peered":"2024-09-17T03:33:01.828035+0000","last_clean":"2024-09-17T03:33:01.828035+0000","last_became_active":"2024-09-17T03:33:00.775176+0000","last_became_peered":"2024-09-17T03:33:00.775176+0000","last_unstale":"2024-09-17T03:33:01.828035+0000","last_undegraded":"2024-09-17T03:33:01.828035+0000","last_fullsized":"2024-09-17T03:33:01.828035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:40.655267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770460+0000","last_change":"2024-09-17T03:33:00.769414+0000","last_active":"2024-09-17T03:33:01.770460+0000","last_peered":"2024-09-17T03:33:01.770460+0000","last_clean":"2024-09-17T03:33:01.770460+0000","last_became_active":"2024-09-17T03:33:00.769045+0000","last_became_peered":"2024-09-17T03:33:00.769045+0000","last_unstale":"2024-09-17T03:33:01.770460+0000","last_undegraded":"2024-09-17T03:33:01.770460+0000","last_fullsized":"2024-09-17T03:33:01.770460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:52.488679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828518+0000","last_change":"2024-09-17T03:33:00.756739+0000","last_active":"2024-09-17T03:33:01.828518+0000","last_peered":"2024-09-17T03:33:01.828518+0000","last_clean":"2024-09-17T03:33:01.828518+0000","last_became_active":"2024-09-17T03:33:00.756432+0000","last_became_peered":"2024-09-17T03:33:00.756432+0000","last_unstale":"2024-09-17T03:33:01.828518+0000","last_undegraded":"2024-09-17T03:33:01.828518+0000","last_fullsized":"2024-09-17T03:33:01.828518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.136914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828369+0000","last_change":"2024-09-17T03:32:59.762042+0000","last_active":"2024-09-17T03:33:01.828369+0000","last_peered":"2024-09-17T03:33:01.828369+0000","last_clean":"2024-09-17T03:33:01.828369+0000","last_became_active":"2024-09-17T03:32:59.761644+0000","last_became_peered":"2024-09-17T03:32:59.761644+0000","last_unstale":"2024-09-17T03:33:01.828369+0000","last_undegraded":"2024-09-17T03:33:01.828369+0000","last_fullsized":"2024-09-17T03:33:01.828369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:05.070599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829071+0000","last_change":"2024-09-17T03:33:00.768871+0000","last_active":"2024-09-17T03:33:01.829071+0000","last_peered":"2024-09-17T03:33:01.829071+0000","last_clean":"2024-09-17T03:33:01.829071+0000","last_became_active":"2024-09-17T03:33:00.768576+0000","last_became_peered":"2024-09-17T03:33:00.768576+0000","last_unstale":"2024-09-17T03:33:01.829071+0000","last_undegraded":"2024-09-17T03:33:01.829071+0000","last_fullsized":"2024-09-17T03:33:01.829071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:41.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770504+0000","last_change":"2024-09-17T03:32:59.750464+0000","last_active":"2024-09-17T03:33:01.770504+0000","last_peered":"2024-09-17T03:33:01.770504+0000","last_clean":"2024-09-17T03:33:01.770504+0000","last_became_active":"2024-09-17T03:32:59.750128+0000","last_became_peered":"2024-09-17T03:32:59.750128+0000","last_unstale":"2024-09-17T03:33:01.770504+0000","last_undegraded":"2024-09-17T03:33:01.770504+0000","last_fullsized":"2024-09-17T03:33:01.770504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:33.223602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829218+0000","last_change":"2024-09-17T03:32:59.758058+0000","last_active":"2024-09-17T03:33:01.829218+0000","last_peered":"2024-09-17T03:33:01.829218+0000","last_clean":"2024-09-17T03:33:01.829218+0000","last_became_active":"2024-09-17T03:32:59.757687+0000","last_became_peered":"2024-09-17T03:32:59.757687+0000","last_unstale":"2024-09-17T03:33:01.829218+0000","last_undegraded":"2024-09-17T03:33:01.829218+0000","last_fullsized":"2024-09-17T03:33:01.829218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827893+0000","last_change":"2024-09-17T03:33:00.770901+0000","last_active":"2024-09-17T03:33:01.827893+0000","last_peered":"2024-09-17T03:33:01.827893+0000","last_clean":"2024-09-17T03:33:01.827893+0000","last_became_active":"2024-09-17T03:33:00.770616+0000","last_became_peered":"2024-09-17T03:33:00.770616+0000","last_unstale":"2024-09-17T03:33:01.827893+0000","last_undegraded":"2024-09-17T03:33:01.827893+0000","last_fullsized":"2024-09-17T03:33:01.827893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:30.089705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770904+0000","last_change":"2024-09-17T03:32:59.754649+0000","last_active":"2024-09-17T03:33:01.770904+0000","last_peered":"2024-09-17T03:33:01.770904+0000","last_clean":"2024-09-17T03:33:01.770904+0000","last_became_active":"2024-09-17T03:32:59.754136+0000","last_became_peered":"2024-09-17T03:32:59.754136+0000","last_unstale":"2024-09-17T03:33:01.770904+0000","last_undegraded":"2024-09-17T03:33:01.770904+0000","last_fullsized":"2024-09-17T03:33:01.770904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767336+0000","last_change":"2024-09-17T03:33:00.760841+0000","last_active":"2024-09-17T03:33:01.767336+0000","last_peered":"2024-09-17T03:33:01.767336+0000","last_clean":"2024-09-17T03:33:01.767336+0000","last_became_active":"2024-09-17T03:33:00.760403+0000","last_became_peered":"2024-09-17T03:33:00.760403+0000","last_unstale":"2024-09-17T03:33:01.767336+0000","last_undegraded":"2024-09-17T03:33:01.767336+0000","last_fullsized":"2024-09-17T03:33:01.767336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:36.260269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770699+0000","last_change":"2024-09-17T03:32:59.754636+0000","last_active":"2024-09-17T03:33:01.770699+0000","last_peered":"2024-09-17T03:33:01.770699+0000","last_clean":"2024-09-17T03:33:01.770699+0000","last_became_active":"2024-09-17T03:32:59.754209+0000","last_became_peered":"2024-09-17T03:32:59.754209+0000","last_unstale":"2024-09-17T03:33:01.770699+0000","last_undegraded":"2024-09-17T03:33:01.770699+0000","last_fullsized":"2024-09-17T03:33:01.770699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:56.265096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770975+0000","last_change":"2024-09-17T03:33:00.783600+0000","last_active":"2024-09-17T03:33:01.770975+0000","last_peered":"2024-09-17T03:33:01.770975+0000","last_clean":"2024-09-17T03:33:01.770975+0000","last_became_active":"2024-09-17T03:33:00.783299+0000","last_became_peered":"2024-09-17T03:33:00.783299+0000","last_unstale":"2024-09-17T03:33:01.770975+0000","last_undegraded":"2024-09-17T03:33:01.770975+0000","last_fullsized":"2024-09-17T03:33:01.770975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:44.836032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771087+0000","last_change":"2024-09-17T03:32:59.756949+0000","last_active":"2024-09-17T03:33:01.771087+0000","last_peered":"2024-09-17T03:33:01.771087+0000","last_clean":"2024-09-17T03:33:01.771087+0000","last_became_active":"2024-09-17T03:32:59.756555+0000","last_became_peered":"2024-09-17T03:32:59.756555+0000","last_unstale":"2024-09-17T03:33:01.771087+0000","last_undegraded":"2024-09-17T03:33:01.771087+0000","last_fullsized":"2024-09-17T03:33:01.771087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:41.461451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828788+0000","last_change":"2024-09-17T03:33:00.779122+0000","last_active":"2024-09-17T03:33:01.828788+0000","last_peered":"2024-09-17T03:33:01.828788+0000","last_clean":"2024-09-17T03:33:01.828788+0000","last_became_active":"2024-09-17T03:33:00.778812+0000","last_became_peered":"2024-09-17T03:33:00.778812+0000","last_unstale":"2024-09-17T03:33:01.828788+0000","last_undegraded":"2024-09-17T03:33:01.828788+0000","last_fullsized":"2024-09-17T03:33:01.828788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:25.613842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767519+0000","last_change":"2024-09-17T03:32:59.757444+0000","last_active":"2024-09-17T03:33:01.767519+0000","last_peered":"2024-09-17T03:33:01.767519+0000","last_clean":"2024-09-17T03:33:01.767519+0000","last_became_active":"2024-09-17T03:32:59.757144+0000","last_became_peered":"2024-09-17T03:32:59.757144+0000","last_unstale":"2024-09-17T03:33:01.767519+0000","last_undegraded":"2024-09-17T03:33:01.767519+0000","last_fullsized":"2024-09-17T03:33:01.767519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:25.450646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828656+0000","last_change":"2024-09-17T03:33:00.783211+0000","last_active":"2024-09-17T03:33:01.828656+0000","last_peered":"2024-09-17T03:33:01.828656+0000","last_clean":"2024-09-17T03:33:01.828656+0000","last_became_active":"2024-09-17T03:33:00.782917+0000","last_became_peered":"2024-09-17T03:33:00.782917+0000","last_unstale":"2024-09-17T03:33:01.828656+0000","last_undegraded":"2024-09-17T03:33:01.828656+0000","last_fullsized":"2024-09-17T03:33:01.828656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:40.655267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771416+0000","last_change":"2024-09-17T03:32:59.756162+0000","last_active":"2024-09-17T03:33:01.771416+0000","last_peered":"2024-09-17T03:33:01.771416+0000","last_clean":"2024-09-17T03:33:01.771416+0000","last_became_active":"2024-09-17T03:32:59.755825+0000","last_became_peered":"2024-09-17T03:32:59.755825+0000","last_unstale":"2024-09-17T03:33:01.771416+0000","last_undegraded":"2024-09-17T03:33:01.771416+0000","last_fullsized":"2024-09-17T03:33:01.771416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:08.648990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828551+0000","last_change":"2024-09-17T03:33:00.777400+0000","last_active":"2024-09-17T03:33:01.828551+0000","last_peered":"2024-09-17T03:33:01.828551+0000","last_clean":"2024-09-17T03:33:01.828551+0000","last_became_active":"2024-09-17T03:33:00.776982+0000","last_became_peered":"2024-09-17T03:33:00.776982+0000","last_unstale":"2024-09-17T03:33:01.828551+0000","last_undegraded":"2024-09-17T03:33:01.828551+0000","last_fullsized":"2024-09-17T03:33:01.828551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:00.761824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829140+0000","last_change":"2024-09-17T03:32:59.752557+0000","last_active":"2024-09-17T03:33:01.829140+0000","last_peered":"2024-09-17T03:33:01.829140+0000","last_clean":"2024-09-17T03:33:01.829140+0000","last_became_active":"2024-09-17T03:32:59.752209+0000","last_became_peered":"2024-09-17T03:32:59.752209+0000","last_unstale":"2024-09-17T03:33:01.829140+0000","last_undegraded":"2024-09-17T03:33:01.829140+0000","last_fullsized":"2024-09-17T03:33:01.829140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:42.500391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828242+0000","last_change":"2024-09-17T03:33:00.782750+0000","last_active":"2024-09-17T03:33:01.828242+0000","last_peered":"2024-09-17T03:33:01.828242+0000","last_clean":"2024-09-17T03:33:01.828242+0000","last_became_active":"2024-09-17T03:33:00.782327+0000","last_became_peered":"2024-09-17T03:33:00.782327+0000","last_unstale":"2024-09-17T03:33:01.828242+0000","last_undegraded":"2024-09-17T03:33:01.828242+0000","last_fullsized":"2024-09-17T03:33:01.828242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:52.488679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772126+0000","last_change":"2024-09-17T03:32:59.760715+0000","last_active":"2024-09-17T03:33:01.772126+0000","last_peered":"2024-09-17T03:33:01.772126+0000","last_clean":"2024-09-17T03:33:01.772126+0000","last_became_active":"2024-09-17T03:32:59.760384+0000","last_became_peered":"2024-09-17T03:32:59.760384+0000","last_unstale":"2024-09-17T03:33:01.772126+0000","last_undegraded":"2024-09-17T03:33:01.772126+0000","last_fullsized":"2024-09-17T03:33:01.772126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:12.647154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829216+0000","last_change":"2024-09-17T03:33:00.783439+0000","last_active":"2024-09-17T03:33:01.829216+0000","last_peered":"2024-09-17T03:33:01.829216+0000","last_clean":"2024-09-17T03:33:01.829216+0000","last_became_active":"2024-09-17T03:33:00.783137+0000","last_became_peered":"2024-09-17T03:33:00.783137+0000","last_unstale":"2024-09-17T03:33:01.829216+0000","last_undegraded":"2024-09-17T03:33:01.829216+0000","last_fullsized":"2024-09-17T03:33:01.829216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:50.057290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770363+0000","last_change":"2024-09-17T03:32:59.752048+0000","last_active":"2024-09-17T03:33:01.770363+0000","last_peered":"2024-09-17T03:33:01.770363+0000","last_clean":"2024-09-17T03:33:01.770363+0000","last_became_active":"2024-09-17T03:32:59.751723+0000","last_became_peered":"2024-09-17T03:32:59.751723+0000","last_unstale":"2024-09-17T03:33:01.770363+0000","last_undegraded":"2024-09-17T03:33:01.770363+0000","last_fullsized":"2024-09-17T03:33:01.770363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:48.722694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770848+0000","last_change":"2024-09-17T03:33:00.768436+0000","last_active":"2024-09-17T03:33:01.770848+0000","last_peered":"2024-09-17T03:33:01.770848+0000","last_clean":"2024-09-17T03:33:01.770848+0000","last_became_active":"2024-09-17T03:33:00.768115+0000","last_became_peered":"2024-09-17T03:33:00.768115+0000","last_unstale":"2024-09-17T03:33:01.770848+0000","last_undegraded":"2024-09-17T03:33:01.770848+0000","last_fullsized":"2024-09-17T03:33:01.770848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:19.020262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828325+0000","last_change":"2024-09-17T03:32:59.752841+0000","last_active":"2024-09-17T03:33:01.828325+0000","last_peered":"2024-09-17T03:33:01.828325+0000","last_clean":"2024-09-17T03:33:01.828325+0000","last_became_active":"2024-09-17T03:32:59.752527+0000","last_became_peered":"2024-09-17T03:32:59.752527+0000","last_unstale":"2024-09-17T03:33:01.828325+0000","last_undegraded":"2024-09-17T03:33:01.828325+0000","last_fullsized":"2024-09-17T03:33:01.828325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:02.065991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829064+0000","last_change":"2024-09-17T03:33:00.777223+0000","last_active":"2024-09-17T03:33:01.829064+0000","last_peered":"2024-09-17T03:33:01.829064+0000","last_clean":"2024-09-17T03:33:01.829064+0000","last_became_active":"2024-09-17T03:33:00.776568+0000","last_became_peered":"2024-09-17T03:33:00.776568+0000","last_unstale":"2024-09-17T03:33:01.829064+0000","last_undegraded":"2024-09-17T03:33:01.829064+0000","last_fullsized":"2024-09-17T03:33:01.829064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:05.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828618+0000","last_change":"2024-09-17T03:32:59.752343+0000","last_active":"2024-09-17T03:33:01.828618+0000","last_peered":"2024-09-17T03:33:01.828618+0000","last_clean":"2024-09-17T03:33:01.828618+0000","last_became_active":"2024-09-17T03:32:59.751973+0000","last_became_peered":"2024-09-17T03:32:59.751973+0000","last_unstale":"2024-09-17T03:33:01.828618+0000","last_undegraded":"2024-09-17T03:33:01.828618+0000","last_fullsized":"2024-09-17T03:33:01.828618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.016385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828907+0000","last_change":"2024-09-17T03:33:00.782466+0000","last_active":"2024-09-17T03:33:01.828907+0000","last_peered":"2024-09-17T03:33:01.828907+0000","last_clean":"2024-09-17T03:33:01.828907+0000","last_became_active":"2024-09-17T03:33:00.782092+0000","last_became_peered":"2024-09-17T03:33:00.782092+0000","last_unstale":"2024-09-17T03:33:01.828907+0000","last_undegraded":"2024-09-17T03:33:01.828907+0000","last_fullsized":"2024-09-17T03:33:01.828907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:38.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827653+0000","last_change":"2024-09-17T03:32:59.761123+0000","last_active":"2024-09-17T03:33:01.827653+0000","last_peered":"2024-09-17T03:33:01.827653+0000","last_clean":"2024-09-17T03:33:01.827653+0000","last_became_active":"2024-09-17T03:32:59.760730+0000","last_became_peered":"2024-09-17T03:32:59.760730+0000","last_unstale":"2024-09-17T03:33:01.827653+0000","last_undegraded":"2024-09-17T03:33:01.827653+0000","last_fullsized":"2024-09-17T03:33:01.827653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:26.495834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829383+0000","last_change":"2024-09-17T03:33:00.778945+0000","last_active":"2024-09-17T03:33:01.829383+0000","last_peered":"2024-09-17T03:33:01.829383+0000","last_clean":"2024-09-17T03:33:01.829383+0000","last_became_active":"2024-09-17T03:33:00.778622+0000","last_became_peered":"2024-09-17T03:33:00.778622+0000","last_unstale":"2024-09-17T03:33:01.829383+0000","last_undegraded":"2024-09-17T03:33:01.829383+0000","last_fullsized":"2024-09-17T03:33:01.829383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:48.264109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767642+0000","last_change":"2024-09-17T03:32:59.753256+0000","last_active":"2024-09-17T03:33:01.767642+0000","last_peered":"2024-09-17T03:33:01.767642+0000","last_clean":"2024-09-17T03:33:01.767642+0000","last_became_active":"2024-09-17T03:32:59.752924+0000","last_became_peered":"2024-09-17T03:32:59.752924+0000","last_unstale":"2024-09-17T03:33:01.767642+0000","last_undegraded":"2024-09-17T03:33:01.767642+0000","last_fullsized":"2024-09-17T03:33:01.767642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:24.567153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771993+0000","last_change":"2024-09-17T03:33:00.776604+0000","last_active":"2024-09-17T03:33:01.771993+0000","last_peered":"2024-09-17T03:33:01.771993+0000","last_clean":"2024-09-17T03:33:01.771993+0000","last_became_active":"2024-09-17T03:33:00.776020+0000","last_became_peered":"2024-09-17T03:33:00.776020+0000","last_unstale":"2024-09-17T03:33:01.771993+0000","last_undegraded":"2024-09-17T03:33:01.771993+0000","last_fullsized":"2024-09-17T03:33:01.771993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:06.411768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827511+0000","last_change":"2024-09-17T03:32:59.757099+0000","last_active":"2024-09-17T03:33:01.827511+0000","last_peered":"2024-09-17T03:33:01.827511+0000","last_clean":"2024-09-17T03:33:01.827511+0000","last_became_active":"2024-09-17T03:32:59.756741+0000","last_became_peered":"2024-09-17T03:32:59.756741+0000","last_unstale":"2024-09-17T03:33:01.827511+0000","last_undegraded":"2024-09-17T03:33:01.827511+0000","last_fullsized":"2024-09-17T03:33:01.827511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:48.722694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828813+0000","last_change":"2024-09-17T03:33:00.781017+0000","last_active":"2024-09-17T03:33:01.828813+0000","last_peered":"2024-09-17T03:33:01.828813+0000","last_clean":"2024-09-17T03:33:01.828813+0000","last_became_active":"2024-09-17T03:33:00.780661+0000","last_became_peered":"2024-09-17T03:33:00.780661+0000","last_unstale":"2024-09-17T03:33:01.828813+0000","last_undegraded":"2024-09-17T03:33:01.828813+0000","last_fullsized":"2024-09-17T03:33:01.828813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:38.019743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827855+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:33:01.827855+0000","last_peered":"2024-09-17T03:33:01.827855+0000","last_clean":"2024-09-17T03:33:01.827855+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:33:01.827855+0000","last_undegraded":"2024-09-17T03:33:01.827855+0000","last_fullsized":"2024-09-17T03:33:01.827855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771026+0000","last_change":"2024-09-17T03:32:59.755210+0000","last_active":"2024-09-17T03:33:01.771026+0000","last_peered":"2024-09-17T03:33:01.771026+0000","last_clean":"2024-09-17T03:33:01.771026+0000","last_became_active":"2024-09-17T03:32:59.753607+0000","last_became_peered":"2024-09-17T03:32:59.753607+0000","last_unstale":"2024-09-17T03:33:01.771026+0000","last_undegraded":"2024-09-17T03:33:01.771026+0000","last_fullsized":"2024-09-17T03:33:01.771026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829325+0000","last_change":"2024-09-17T03:33:00.780277+0000","last_active":"2024-09-17T03:33:01.829325+0000","last_peered":"2024-09-17T03:33:01.829325+0000","last_clean":"2024-09-17T03:33:01.829325+0000","last_became_active":"2024-09-17T03:33:00.780008+0000","last_became_peered":"2024-09-17T03:33:00.780008+0000","last_unstale":"2024-09-17T03:33:01.829325+0000","last_undegraded":"2024-09-17T03:33:01.829325+0000","last_fullsized":"2024-09-17T03:33:01.829325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:56.218073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827807+0000","last_change":"2024-09-17T03:32:59.763822+0000","last_active":"2024-09-17T03:33:01.827807+0000","last_peered":"2024-09-17T03:33:01.827807+0000","last_clean":"2024-09-17T03:33:01.827807+0000","last_became_active":"2024-09-17T03:32:59.763474+0000","last_became_peered":"2024-09-17T03:32:59.763474+0000","last_unstale":"2024-09-17T03:33:01.827807+0000","last_undegraded":"2024-09-17T03:33:01.827807+0000","last_fullsized":"2024-09-17T03:33:01.827807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:02.046619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827486+0000","last_change":"2024-09-17T03:33:00.769651+0000","last_active":"2024-09-17T03:33:01.827486+0000","last_peered":"2024-09-17T03:33:01.827486+0000","last_clean":"2024-09-17T03:33:01.827486+0000","last_became_active":"2024-09-17T03:33:00.769137+0000","last_became_peered":"2024-09-17T03:33:00.769137+0000","last_unstale":"2024-09-17T03:33:01.827486+0000","last_undegraded":"2024-09-17T03:33:01.827486+0000","last_fullsized":"2024-09-17T03:33:01.827486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.450827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828105+0000","last_change":"2024-09-17T03:32:59.761128+0000","last_active":"2024-09-17T03:33:01.828105+0000","last_peered":"2024-09-17T03:33:01.828105+0000","last_clean":"2024-09-17T03:33:01.828105+0000","last_became_active":"2024-09-17T03:32:59.760765+0000","last_became_peered":"2024-09-17T03:32:59.760765+0000","last_unstale":"2024-09-17T03:33:01.828105+0000","last_undegraded":"2024-09-17T03:33:01.828105+0000","last_fullsized":"2024-09-17T03:33:01.828105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:04.446287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767343+0000","last_change":"2024-09-17T03:33:00.760063+0000","last_active":"2024-09-17T03:33:01.767343+0000","last_peered":"2024-09-17T03:33:01.767343+0000","last_clean":"2024-09-17T03:33:01.767343+0000","last_became_active":"2024-09-17T03:33:00.759678+0000","last_became_peered":"2024-09-17T03:33:00.759678+0000","last_unstale":"2024-09-17T03:33:01.767343+0000","last_undegraded":"2024-09-17T03:33:01.767343+0000","last_fullsized":"2024-09-17T03:33:01.767343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:07.035577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772200+0000","last_change":"2024-09-17T03:32:59.753138+0000","last_active":"2024-09-17T03:33:01.772200+0000","last_peered":"2024-09-17T03:33:01.772200+0000","last_clean":"2024-09-17T03:33:01.772200+0000","last_became_active":"2024-09-17T03:32:59.752828+0000","last_became_peered":"2024-09-17T03:32:59.752828+0000","last_unstale":"2024-09-17T03:33:01.772200+0000","last_undegraded":"2024-09-17T03:33:01.772200+0000","last_fullsized":"2024-09-17T03:33:01.772200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:06.735843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828444+0000","last_change":"2024-09-17T03:33:00.769042+0000","last_active":"2024-09-17T03:33:01.828444+0000","last_peered":"2024-09-17T03:33:01.828444+0000","last_clean":"2024-09-17T03:33:01.828444+0000","last_became_active":"2024-09-17T03:33:00.768097+0000","last_became_peered":"2024-09-17T03:33:00.768097+0000","last_unstale":"2024-09-17T03:33:01.828444+0000","last_undegraded":"2024-09-17T03:33:01.828444+0000","last_fullsized":"2024-09-17T03:33:01.828444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:29.022126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767570+0000","last_change":"2024-09-17T03:32:59.753623+0000","last_active":"2024-09-17T03:33:01.767570+0000","last_peered":"2024-09-17T03:33:01.767570+0000","last_clean":"2024-09-17T03:33:01.767570+0000","last_became_active":"2024-09-17T03:32:59.753253+0000","last_became_peered":"2024-09-17T03:32:59.753253+0000","last_unstale":"2024-09-17T03:33:01.767570+0000","last_undegraded":"2024-09-17T03:33:01.767570+0000","last_fullsized":"2024-09-17T03:33:01.767570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:26.495834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772112+0000","last_change":"2024-09-17T03:33:00.771853+0000","last_active":"2024-09-17T03:33:01.772112+0000","last_peered":"2024-09-17T03:33:01.772112+0000","last_clean":"2024-09-17T03:33:01.772112+0000","last_became_active":"2024-09-17T03:33:00.771534+0000","last_became_peered":"2024-09-17T03:33:00.771534+0000","last_unstale":"2024-09-17T03:33:01.772112+0000","last_undegraded":"2024-09-17T03:33:01.772112+0000","last_fullsized":"2024-09-17T03:33:01.772112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:07.316072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828986+0000","last_change":"2024-09-17T03:32:59.763327+0000","last_active":"2024-09-17T03:33:01.828986+0000","last_peered":"2024-09-17T03:33:01.828986+0000","last_clean":"2024-09-17T03:33:01.828986+0000","last_became_active":"2024-09-17T03:32:59.762808+0000","last_became_peered":"2024-09-17T03:32:59.762808+0000","last_unstale":"2024-09-17T03:33:01.828986+0000","last_undegraded":"2024-09-17T03:33:01.828986+0000","last_fullsized":"2024-09-17T03:33:01.828986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:09.031060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767457+0000","last_change":"2024-09-17T03:33:00.760233+0000","last_active":"2024-09-17T03:33:01.767457+0000","last_peered":"2024-09-17T03:33:01.767457+0000","last_clean":"2024-09-17T03:33:01.767457+0000","last_became_active":"2024-09-17T03:33:00.759904+0000","last_became_peered":"2024-09-17T03:33:00.759904+0000","last_unstale":"2024-09-17T03:33:01.767457+0000","last_undegraded":"2024-09-17T03:33:01.767457+0000","last_fullsized":"2024-09-17T03:33:01.767457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:23.150098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767506+0000","last_change":"2024-09-17T03:32:59.752736+0000","last_active":"2024-09-17T03:33:01.767506+0000","last_peered":"2024-09-17T03:33:01.767506+0000","last_clean":"2024-09-17T03:33:01.767506+0000","last_became_active":"2024-09-17T03:32:59.752395+0000","last_became_peered":"2024-09-17T03:32:59.752395+0000","last_unstale":"2024-09-17T03:33:01.767506+0000","last_undegraded":"2024-09-17T03:33:01.767506+0000","last_fullsized":"2024-09-17T03:33:01.767506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:39.649900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828852+0000","last_change":"2024-09-17T03:33:00.777441+0000","last_active":"2024-09-17T03:33:01.828852+0000","last_peered":"2024-09-17T03:33:01.828852+0000","last_clean":"2024-09-17T03:33:01.828852+0000","last_became_active":"2024-09-17T03:33:00.777102+0000","last_became_peered":"2024-09-17T03:33:00.777102+0000","last_unstale":"2024-09-17T03:33:01.828852+0000","last_undegraded":"2024-09-17T03:33:01.828852+0000","last_fullsized":"2024-09-17T03:33:01.828852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.389271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770870+0000","last_change":"2024-09-17T03:32:59.758935+0000","last_active":"2024-09-17T03:33:01.770870+0000","last_peered":"2024-09-17T03:33:01.770870+0000","last_clean":"2024-09-17T03:33:01.770870+0000","last_became_active":"2024-09-17T03:32:59.758594+0000","last_became_peered":"2024-09-17T03:32:59.758594+0000","last_unstale":"2024-09-17T03:33:01.770870+0000","last_undegraded":"2024-09-17T03:33:01.770870+0000","last_fullsized":"2024-09-17T03:33:01.770870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:47.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828639+0000","last_change":"2024-09-17T03:33:00.765218+0000","last_active":"2024-09-17T03:33:01.828639+0000","last_peered":"2024-09-17T03:33:01.828639+0000","last_clean":"2024-09-17T03:33:01.828639+0000","last_became_active":"2024-09-17T03:33:00.764728+0000","last_became_peered":"2024-09-17T03:33:00.764728+0000","last_unstale":"2024-09-17T03:33:01.828639+0000","last_undegraded":"2024-09-17T03:33:01.828639+0000","last_fullsized":"2024-09-17T03:33:01.828639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:19.020262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827701+0000","last_change":"2024-09-17T03:32:59.763500+0000","last_active":"2024-09-17T03:33:01.827701+0000","last_peered":"2024-09-17T03:33:01.827701+0000","last_clean":"2024-09-17T03:33:01.827701+0000","last_became_active":"2024-09-17T03:32:59.763055+0000","last_became_peered":"2024-09-17T03:32:59.763055+0000","last_unstale":"2024-09-17T03:33:01.827701+0000","last_undegraded":"2024-09-17T03:33:01.827701+0000","last_fullsized":"2024-09-17T03:33:01.827701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:08.648990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828125+0000","last_change":"2024-09-17T03:33:00.768008+0000","last_active":"2024-09-17T03:33:01.828125+0000","last_peered":"2024-09-17T03:33:01.828125+0000","last_clean":"2024-09-17T03:33:01.828125+0000","last_became_active":"2024-09-17T03:33:00.767649+0000","last_became_peered":"2024-09-17T03:33:00.767649+0000","last_unstale":"2024-09-17T03:33:01.828125+0000","last_undegraded":"2024-09-17T03:33:01.828125+0000","last_fullsized":"2024-09-17T03:33:01.828125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.501201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767401+0000","last_change":"2024-09-17T03:32:59.761083+0000","last_active":"2024-09-17T03:33:01.767401+0000","last_peered":"2024-09-17T03:33:01.767401+0000","last_clean":"2024-09-17T03:33:01.767401+0000","last_became_active":"2024-09-17T03:32:59.760765+0000","last_became_peered":"2024-09-17T03:32:59.760765+0000","last_unstale":"2024-09-17T03:33:01.767401+0000","last_undegraded":"2024-09-17T03:33:01.767401+0000","last_fullsized":"2024-09-17T03:33:01.767401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:28.016759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828140+0000","last_change":"2024-09-17T03:33:00.761340+0000","last_active":"2024-09-17T03:33:01.828140+0000","last_peered":"2024-09-17T03:33:01.828140+0000","last_clean":"2024-09-17T03:33:01.828140+0000","last_became_active":"2024-09-17T03:33:00.760617+0000","last_became_peered":"2024-09-17T03:33:00.760617+0000","last_unstale":"2024-09-17T03:33:01.828140+0000","last_undegraded":"2024-09-17T03:33:01.828140+0000","last_fullsized":"2024-09-17T03:33:01.828140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:17.573959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767550+0000","last_change":"2024-09-17T03:32:59.760660+0000","last_active":"2024-09-17T03:33:01.767550+0000","last_peered":"2024-09-17T03:33:01.767550+0000","last_clean":"2024-09-17T03:33:01.767550+0000","last_became_active":"2024-09-17T03:32:59.760223+0000","last_became_peered":"2024-09-17T03:32:59.760223+0000","last_unstale":"2024-09-17T03:33:01.767550+0000","last_undegraded":"2024-09-17T03:33:01.767550+0000","last_fullsized":"2024-09-17T03:33:01.767550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:04.446287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828236+0000","last_change":"2024-09-17T03:33:00.773988+0000","last_active":"2024-09-17T03:33:01.828236+0000","last_peered":"2024-09-17T03:33:01.828236+0000","last_clean":"2024-09-17T03:33:01.828236+0000","last_became_active":"2024-09-17T03:33:00.773669+0000","last_became_peered":"2024-09-17T03:33:00.773669+0000","last_unstale":"2024-09-17T03:33:01.828236+0000","last_undegraded":"2024-09-17T03:33:01.828236+0000","last_fullsized":"2024-09-17T03:33:01.828236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:36.829010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829149+0000","last_change":"2024-09-17T03:32:59.763512+0000","last_active":"2024-09-17T03:33:01.829149+0000","last_peered":"2024-09-17T03:33:01.829149+0000","last_clean":"2024-09-17T03:33:01.829149+0000","last_became_active":"2024-09-17T03:32:59.763073+0000","last_became_peered":"2024-09-17T03:32:59.763073+0000","last_unstale":"2024-09-17T03:33:01.829149+0000","last_undegraded":"2024-09-17T03:33:01.829149+0000","last_fullsized":"2024-09-17T03:33:01.829149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:05.582982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771163+0000","last_change":"2024-09-17T03:33:00.760569+0000","last_active":"2024-09-17T03:33:01.771163+0000","last_peered":"2024-09-17T03:33:01.771163+0000","last_clean":"2024-09-17T03:33:01.771163+0000","last_became_active":"2024-09-17T03:33:00.760215+0000","last_became_peered":"2024-09-17T03:33:00.760215+0000","last_unstale":"2024-09-17T03:33:01.771163+0000","last_undegraded":"2024-09-17T03:33:01.771163+0000","last_fullsized":"2024-09-17T03:33:01.771163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.597440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772055+0000","last_change":"2024-09-17T03:33:00.775407+0000","last_active":"2024-09-17T03:33:01.772055+0000","last_peered":"2024-09-17T03:33:01.772055+0000","last_clean":"2024-09-17T03:33:01.772055+0000","last_became_active":"2024-09-17T03:33:00.773657+0000","last_became_peered":"2024-09-17T03:33:00.773657+0000","last_unstale":"2024-09-17T03:33:01.772055+0000","last_undegraded":"2024-09-17T03:33:01.772055+0000","last_fullsized":"2024-09-17T03:33:01.772055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:18.984982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828727+0000","last_change":"2024-09-17T03:32:59.763902+0000","last_active":"2024-09-17T03:33:01.828727+0000","last_peered":"2024-09-17T03:33:01.828727+0000","last_clean":"2024-09-17T03:33:01.828727+0000","last_became_active":"2024-09-17T03:32:59.763401+0000","last_became_peered":"2024-09-17T03:32:59.763401+0000","last_unstale":"2024-09-17T03:33:01.828727+0000","last_undegraded":"2024-09-17T03:33:01.828727+0000","last_fullsized":"2024-09-17T03:33:01.828727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:25.445460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771973+0000","last_change":"2024-09-17T03:33:00.777352+0000","last_active":"2024-09-17T03:33:01.771973+0000","last_peered":"2024-09-17T03:33:01.771973+0000","last_clean":"2024-09-17T03:33:01.771973+0000","last_became_active":"2024-09-17T03:33:00.777033+0000","last_became_peered":"2024-09-17T03:33:00.777033+0000","last_unstale":"2024-09-17T03:33:01.771973+0000","last_undegraded":"2024-09-17T03:33:01.771973+0000","last_fullsized":"2024-09-17T03:33:01.771973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:46.197387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828815+0000","last_change":"2024-09-17T03:32:59.764471+0000","last_active":"2024-09-17T03:33:01.828815+0000","last_peered":"2024-09-17T03:33:01.828815+0000","last_clean":"2024-09-17T03:33:01.828815+0000","last_became_active":"2024-09-17T03:32:59.763904+0000","last_became_peered":"2024-09-17T03:32:59.763904+0000","last_unstale":"2024-09-17T03:33:01.828815+0000","last_undegraded":"2024-09-17T03:33:01.828815+0000","last_fullsized":"2024-09-17T03:33:01.828815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:26.131547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828645+0000","last_change":"2024-09-17T03:33:00.779461+0000","last_active":"2024-09-17T03:33:01.828645+0000","last_peered":"2024-09-17T03:33:01.828645+0000","last_clean":"2024-09-17T03:33:01.828645+0000","last_became_active":"2024-09-17T03:33:00.779082+0000","last_became_peered":"2024-09-17T03:33:00.779082+0000","last_unstale":"2024-09-17T03:33:01.828645+0000","last_undegraded":"2024-09-17T03:33:01.828645+0000","last_fullsized":"2024-09-17T03:33:01.828645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:07.035577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828382+0000","last_change":"2024-09-17T03:32:59.763107+0000","last_active":"2024-09-17T03:33:01.828382+0000","last_peered":"2024-09-17T03:33:01.828382+0000","last_clean":"2024-09-17T03:33:01.828382+0000","last_became_active":"2024-09-17T03:32:59.762811+0000","last_became_peered":"2024-09-17T03:32:59.762811+0000","last_unstale":"2024-09-17T03:33:01.828382+0000","last_undegraded":"2024-09-17T03:33:01.828382+0000","last_fullsized":"2024-09-17T03:33:01.828382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828252+0000","last_change":"2024-09-17T03:33:00.774953+0000","last_active":"2024-09-17T03:33:01.828252+0000","last_peered":"2024-09-17T03:33:01.828252+0000","last_clean":"2024-09-17T03:33:01.828252+0000","last_became_active":"2024-09-17T03:33:00.773865+0000","last_became_peered":"2024-09-17T03:33:00.773865+0000","last_unstale":"2024-09-17T03:33:01.828252+0000","last_undegraded":"2024-09-17T03:33:01.828252+0000","last_fullsized":"2024-09-17T03:33:01.828252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:03.734959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828747+0000","last_change":"2024-09-17T03:32:59.760741+0000","last_active":"2024-09-17T03:33:01.828747+0000","last_peered":"2024-09-17T03:33:01.828747+0000","last_clean":"2024-09-17T03:33:01.828747+0000","last_became_active":"2024-09-17T03:32:59.760355+0000","last_became_peered":"2024-09-17T03:32:59.760355+0000","last_unstale":"2024-09-17T03:33:01.828747+0000","last_undegraded":"2024-09-17T03:33:01.828747+0000","last_fullsized":"2024-09-17T03:33:01.828747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:14.945781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:13.054 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:13.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.203+0000 7f62d6e0e640 1 -- 172.21.15.146:0/647143611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62d00b3b60 msgr2=0x7f62d015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.203+0000 7f62d6e0e640 1 --2- 172.21.15.146:0/647143611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62d00b3b60 0x7f62d015caa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f62c8005fd0 tx=0x7f62c802aa90 comp rx=0 tx=0).stop 2024-09-17T03:33:13.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.203+0000 7f62d6e0e640 1 -- 172.21.15.146:0/647143611 shutdown_connections 2024-09-17T03:33:13.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.203+0000 7f62d6e0e640 1 --2- 172.21.15.146:0/647143611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62d00b3b60 0x7f62d015caa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.203+0000 7f62d6e0e640 1 --2- 172.21.15.146:0/647143611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62d00b5750 0x7f62d00b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.203+0000 7f62d6e0e640 1 -- 172.21.15.146:0/647143611 >> 172.21.15.146:0/647143611 conn(0x7f62d00b7b20 msgr2=0x7f62d009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:13.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.203+0000 7f62d6e0e640 1 -- 172.21.15.146:0/647143611 shutdown_connections 2024-09-17T03:33:13.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.203+0000 7f62d6e0e640 1 -- 172.21.15.146:0/647143611 wait complete. 2024-09-17T03:33:13.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.204+0000 7f62d6e0e640 1 Processor -- start 2024-09-17T03:33:13.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.205+0000 7f62d6e0e640 1 -- start start 2024-09-17T03:33:13.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62d6e0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62d00b3b60 0x7f62d014e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62d6e0e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62d00b5750 0x7f62d0151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62d6e0e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62d00b5ce0 0x7f62d01f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62d6e0e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62d015d460 con 0x7f62d00b5750 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62d6e0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f62d015d2e0 con 0x7f62d00b3b60 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62d6e0e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f62d015d5e0 con 0x7f62d00b5ce0 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62c7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62d00b5750 0x7f62d0151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62c7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62d00b5750 0x7f62d0151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50764/0 (socket says 172.21.15.146:50764) 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62c7fff640 1 -- 172.21.15.146:0/4167206902 learned_addr learned my addr 172.21.15.146:0/4167206902 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62d4baa640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62d00b3b60 0x7f62d014e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62d53ab640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62d00b5ce0 0x7f62d01f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62c7fff640 1 -- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62d00b5ce0 msgr2=0x7f62d01f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62c7fff640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62d00b5ce0 0x7f62d01f3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62c7fff640 1 -- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62d00b3b60 msgr2=0x7f62d014e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62c7fff640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62d00b3b60 0x7f62d014e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.206+0000 7f62c7fff640 1 -- 172.21.15.146:0/4167206902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d01508e0 con 0x7f62d00b5750 2024-09-17T03:33:13.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.207+0000 7f62c7fff640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62d00b5750 0x7f62d0151c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f62c000d770 tx=0x7f62c000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:13.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.207+0000 7f62c57fa640 1 -- 172.21.15.146:0/4167206902 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0017070 con 0x7f62d00b5750 2024-09-17T03:33:13.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.207+0000 7f62c57fa640 1 -- 172.21.15.146:0/4167206902 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62c0009d20 con 0x7f62d00b5750 2024-09-17T03:33:13.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.207+0000 7f62d6e0e640 1 -- 172.21.15.146:0/4167206902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d014e590 con 0x7f62d00b5750 2024-09-17T03:33:13.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.207+0000 7f62c57fa640 1 -- 172.21.15.146:0/4167206902 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c00106c0 con 0x7f62d00b5750 2024-09-17T03:33:13.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.207+0000 7f62d6e0e640 1 -- 172.21.15.146:0/4167206902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d0150e90 con 0x7f62d00b5750 2024-09-17T03:33:13.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.208+0000 7f62d6e0e640 1 -- 172.21.15.146:0/4167206902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d015c500 con 0x7f62d00b5750 2024-09-17T03:33:13.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.209+0000 7f62c57fa640 1 -- 172.21.15.146:0/4167206902 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f62c001a070 con 0x7f62d00b5750 2024-09-17T03:33:13.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.209+0000 7f62c57fa640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62bc078b90 0x7f62bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.209+0000 7f62c57fa640 1 -- 172.21.15.146:0/4167206902 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f62c009ad50 con 0x7f62d00b5750 2024-09-17T03:33:13.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.209+0000 7f62d4baa640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62bc078b90 0x7f62bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.210+0000 7f62d4baa640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62bc078b90 0x7f62bc07b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f62cc001720 tx=0x7f62cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:13.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.213+0000 7f62c57fa640 1 -- 172.21.15.146:0/4167206902 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f62d015c500 con 0x7f62d00b5750 2024-09-17T03:33:13.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.385+0000 7f62d6e0e640 1 -- 172.21.15.146:0/4167206902 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f62d0156280 con 0x7f62bc078b90 2024-09-17T03:33:13.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.389+0000 7f62c57fa640 1 -- 172.21.15.146:0/4167206902 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f62d0156280 con 0x7f62bc078b90 2024-09-17T03:33:13.392 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:13.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.392+0000 7f62d6e0e640 1 -- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62bc078b90 msgr2=0x7f62bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.392+0000 7f62d6e0e640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62bc078b90 0x7f62bc07b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f62cc001720 tx=0x7f62cc009040 comp rx=0 tx=0).stop 2024-09-17T03:33:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.392+0000 7f62d6e0e640 1 -- 172.21.15.146:0/4167206902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62d00b5750 msgr2=0x7f62d0151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.392+0000 7f62d6e0e640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62d00b5750 0x7f62d0151c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f62c000d770 tx=0x7f62c000dc30 comp rx=0 tx=0).stop 2024-09-17T03:33:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.392+0000 7f62d6e0e640 1 -- 172.21.15.146:0/4167206902 shutdown_connections 2024-09-17T03:33:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.392+0000 7f62d6e0e640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62bc078b90 0x7f62bc07b0a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.392+0000 7f62d6e0e640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62d00b5ce0 0x7f62d01f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.392+0000 7f62d6e0e640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62d00b5750 0x7f62d0151c50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.392+0000 7f62d6e0e640 1 --2- 172.21.15.146:0/4167206902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62d00b3b60 0x7f62d014e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.392+0000 7f62d6e0e640 1 -- 172.21.15.146:0/4167206902 >> 172.21.15.146:0/4167206902 conn(0x7f62d00b7b20 msgr2=0x7f62d015b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.393+0000 7f62d6e0e640 1 -- 172.21.15.146:0/4167206902 shutdown_connections 2024-09-17T03:33:13.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.393+0000 7f62d6e0e640 1 -- 172.21.15.146:0/4167206902 wait complete. 2024-09-17T03:33:13.404 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T03:33:11.792091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219124,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755596,"statfs":{"total":773094113280,"available":772869730304,"internally_reserved":0,"allocated":2924544,"data_stored":1767532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.023860"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829399+0000","last_change":"2024-09-17T03:33:00.776875+0000","last_active":"2024-09-17T03:33:01.829399+0000","last_peered":"2024-09-17T03:33:01.829399+0000","last_clean":"2024-09-17T03:33:01.829399+0000","last_became_active":"2024-09-17T03:33:00.776492+0000","last_became_peered":"2024-09-17T03:33:00.776492+0000","last_unstale":"2024-09-17T03:33:01.829399+0000","last_undegraded":"2024-09-17T03:33:01.829399+0000","last_fullsized":"2024-09-17T03:33:01.829399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:05.190506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767824+0000","last_change":"2024-09-17T03:33:00.768131+0000","last_active":"2024-09-17T03:33:01.767824+0000","last_peered":"2024-09-17T03:33:01.767824+0000","last_clean":"2024-09-17T03:33:01.767824+0000","last_became_active":"2024-09-17T03:33:00.767420+0000","last_became_peered":"2024-09-17T03:33:00.767420+0000","last_unstale":"2024-09-17T03:33:01.767824+0000","last_undegraded":"2024-09-17T03:33:01.767824+0000","last_fullsized":"2024-09-17T03:33:01.767824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:03.495898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827775+0000","last_change":"2024-09-17T03:33:00.762884+0000","last_active":"2024-09-17T03:33:01.827775+0000","last_peered":"2024-09-17T03:33:01.827775+0000","last_clean":"2024-09-17T03:33:01.827775+0000","last_became_active":"2024-09-17T03:33:00.762572+0000","last_became_peered":"2024-09-17T03:33:00.762572+0000","last_unstale":"2024-09-17T03:33:01.827775+0000","last_undegraded":"2024-09-17T03:33:01.827775+0000","last_fullsized":"2024-09-17T03:33:01.827775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:26.672695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771728+0000","last_change":"2024-09-17T03:33:00.778126+0000","last_active":"2024-09-17T03:33:01.771728+0000","last_peered":"2024-09-17T03:33:01.771728+0000","last_clean":"2024-09-17T03:33:01.771728+0000","last_became_active":"2024-09-17T03:33:00.777760+0000","last_became_peered":"2024-09-17T03:33:00.777760+0000","last_unstale":"2024-09-17T03:33:01.771728+0000","last_undegraded":"2024-09-17T03:33:01.771728+0000","last_fullsized":"2024-09-17T03:33:01.771728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:48.841807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829060+0000","last_change":"2024-09-17T03:33:00.782918+0000","last_active":"2024-09-17T03:33:01.829060+0000","last_peered":"2024-09-17T03:33:01.829060+0000","last_clean":"2024-09-17T03:33:01.829060+0000","last_became_active":"2024-09-17T03:33:00.782020+0000","last_became_peered":"2024-09-17T03:33:00.782020+0000","last_unstale":"2024-09-17T03:33:01.829060+0000","last_undegraded":"2024-09-17T03:33:01.829060+0000","last_fullsized":"2024-09-17T03:33:01.829060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:04.686891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771542+0000","last_change":"2024-09-17T03:33:00.772869+0000","last_active":"2024-09-17T03:33:01.771542+0000","last_peered":"2024-09-17T03:33:01.771542+0000","last_clean":"2024-09-17T03:33:01.771542+0000","last_became_active":"2024-09-17T03:33:00.772517+0000","last_became_peered":"2024-09-17T03:33:00.772517+0000","last_unstale":"2024-09-17T03:33:01.771542+0000","last_undegraded":"2024-09-17T03:33:01.771542+0000","last_fullsized":"2024-09-17T03:33:01.771542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:19.582453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828169+0000","last_change":"2024-09-17T03:33:00.773836+0000","last_active":"2024-09-17T03:33:01.828169+0000","last_peered":"2024-09-17T03:33:01.828169+0000","last_clean":"2024-09-17T03:33:01.828169+0000","last_became_active":"2024-09-17T03:33:00.773562+0000","last_became_peered":"2024-09-17T03:33:00.773562+0000","last_unstale":"2024-09-17T03:33:01.828169+0000","last_undegraded":"2024-09-17T03:33:01.828169+0000","last_fullsized":"2024-09-17T03:33:01.828169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:17.617717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829349+0000","last_change":"2024-09-17T03:33:00.780226+0000","last_active":"2024-09-17T03:33:01.829349+0000","last_peered":"2024-09-17T03:33:01.829349+0000","last_clean":"2024-09-17T03:33:01.829349+0000","last_became_active":"2024-09-17T03:33:00.779937+0000","last_became_peered":"2024-09-17T03:33:00.779937+0000","last_unstale":"2024-09-17T03:33:01.829349+0000","last_undegraded":"2024-09-17T03:33:01.829349+0000","last_fullsized":"2024-09-17T03:33:01.829349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:23.843836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829226+0000","last_change":"2024-09-17T03:33:00.781071+0000","last_active":"2024-09-17T03:33:01.829226+0000","last_peered":"2024-09-17T03:33:01.829226+0000","last_clean":"2024-09-17T03:33:01.829226+0000","last_became_active":"2024-09-17T03:33:00.780570+0000","last_became_peered":"2024-09-17T03:33:00.780570+0000","last_unstale":"2024-09-17T03:33:01.829226+0000","last_undegraded":"2024-09-17T03:33:01.829226+0000","last_fullsized":"2024-09-17T03:33:01.829226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:40.962739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771518+0000","last_change":"2024-09-17T03:33:00.776867+0000","last_active":"2024-09-17T03:33:01.771518+0000","last_peered":"2024-09-17T03:33:01.771518+0000","last_clean":"2024-09-17T03:33:01.771518+0000","last_became_active":"2024-09-17T03:33:00.776565+0000","last_became_peered":"2024-09-17T03:33:00.776565+0000","last_unstale":"2024-09-17T03:33:01.771518+0000","last_undegraded":"2024-09-17T03:33:01.771518+0000","last_fullsized":"2024-09-17T03:33:01.771518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:14.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770780+0000","last_change":"2024-09-17T03:33:00.776047+0000","last_active":"2024-09-17T03:33:01.770780+0000","last_peered":"2024-09-17T03:33:01.770780+0000","last_clean":"2024-09-17T03:33:01.770780+0000","last_became_active":"2024-09-17T03:33:00.775733+0000","last_became_peered":"2024-09-17T03:33:00.775733+0000","last_unstale":"2024-09-17T03:33:01.770780+0000","last_undegraded":"2024-09-17T03:33:01.770780+0000","last_fullsized":"2024-09-17T03:33:01.770780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:45.334569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828513+0000","last_change":"2024-09-17T03:33:00.775474+0000","last_active":"2024-09-17T03:33:01.828513+0000","last_peered":"2024-09-17T03:33:01.828513+0000","last_clean":"2024-09-17T03:33:01.828513+0000","last_became_active":"2024-09-17T03:33:00.775111+0000","last_became_peered":"2024-09-17T03:33:00.775111+0000","last_unstale":"2024-09-17T03:33:01.828513+0000","last_undegraded":"2024-09-17T03:33:01.828513+0000","last_fullsized":"2024-09-17T03:33:01.828513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:26.456013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828003+0000","last_change":"2024-09-17T03:33:00.774115+0000","last_active":"2024-09-17T03:33:01.828003+0000","last_peered":"2024-09-17T03:33:01.828003+0000","last_clean":"2024-09-17T03:33:01.828003+0000","last_became_active":"2024-09-17T03:33:00.773803+0000","last_became_peered":"2024-09-17T03:33:00.773803+0000","last_unstale":"2024-09-17T03:33:01.828003+0000","last_undegraded":"2024-09-17T03:33:01.828003+0000","last_fullsized":"2024-09-17T03:33:01.828003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:13.109575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828014+0000","last_change":"2024-09-17T03:33:00.764440+0000","last_active":"2024-09-17T03:33:01.828014+0000","last_peered":"2024-09-17T03:33:01.828014+0000","last_clean":"2024-09-17T03:33:01.828014+0000","last_became_active":"2024-09-17T03:33:00.764123+0000","last_became_peered":"2024-09-17T03:33:00.764123+0000","last_unstale":"2024-09-17T03:33:01.828014+0000","last_undegraded":"2024-09-17T03:33:01.828014+0000","last_fullsized":"2024-09-17T03:33:01.828014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:44.310926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767341+0000","last_change":"2024-09-17T03:33:00.756678+0000","last_active":"2024-09-17T03:33:01.767341+0000","last_peered":"2024-09-17T03:33:01.767341+0000","last_clean":"2024-09-17T03:33:01.767341+0000","last_became_active":"2024-09-17T03:33:00.756342+0000","last_became_peered":"2024-09-17T03:33:00.756342+0000","last_unstale":"2024-09-17T03:33:01.767341+0000","last_undegraded":"2024-09-17T03:33:01.767341+0000","last_fullsized":"2024-09-17T03:33:01.767341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:19.020262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770738+0000","last_change":"2024-09-17T03:33:00.771303+0000","last_active":"2024-09-17T03:33:01.770738+0000","last_peered":"2024-09-17T03:33:01.770738+0000","last_clean":"2024-09-17T03:33:01.770738+0000","last_became_active":"2024-09-17T03:33:00.770971+0000","last_became_peered":"2024-09-17T03:33:00.770971+0000","last_unstale":"2024-09-17T03:33:01.770738+0000","last_undegraded":"2024-09-17T03:33:01.770738+0000","last_fullsized":"2024-09-17T03:33:01.770738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:31.492292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771440+0000","last_change":"2024-09-17T03:33:00.783198+0000","last_active":"2024-09-17T03:33:01.771440+0000","last_peered":"2024-09-17T03:33:01.771440+0000","last_clean":"2024-09-17T03:33:01.771440+0000","last_became_active":"2024-09-17T03:33:00.782880+0000","last_became_peered":"2024-09-17T03:33:00.782880+0000","last_unstale":"2024-09-17T03:33:01.771440+0000","last_undegraded":"2024-09-17T03:33:01.771440+0000","last_fullsized":"2024-09-17T03:33:01.771440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:54.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827581+0000","last_change":"2024-09-17T03:33:00.774736+0000","last_active":"2024-09-17T03:33:01.827581+0000","last_peered":"2024-09-17T03:33:01.827581+0000","last_clean":"2024-09-17T03:33:01.827581+0000","last_became_active":"2024-09-17T03:33:00.774417+0000","last_became_peered":"2024-09-17T03:33:00.774417+0000","last_unstale":"2024-09-17T03:33:01.827581+0000","last_undegraded":"2024-09-17T03:33:01.827581+0000","last_fullsized":"2024-09-17T03:33:01.827581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:25.572520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829204+0000","last_change":"2024-09-17T03:33:00.777636+0000","last_active":"2024-09-17T03:33:01.829204+0000","last_peered":"2024-09-17T03:33:01.829204+0000","last_clean":"2024-09-17T03:33:01.829204+0000","last_became_active":"2024-09-17T03:33:00.777316+0000","last_became_peered":"2024-09-17T03:33:00.777316+0000","last_unstale":"2024-09-17T03:33:01.829204+0000","last_undegraded":"2024-09-17T03:33:01.829204+0000","last_fullsized":"2024-09-17T03:33:01.829204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:55.362338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771462+0000","last_change":"2024-09-17T03:33:00.767553+0000","last_active":"2024-09-17T03:33:01.771462+0000","last_peered":"2024-09-17T03:33:01.771462+0000","last_clean":"2024-09-17T03:33:01.771462+0000","last_became_active":"2024-09-17T03:33:00.767260+0000","last_became_peered":"2024-09-17T03:33:00.767260+0000","last_unstale":"2024-09-17T03:33:01.771462+0000","last_undegraded":"2024-09-17T03:33:01.771462+0000","last_fullsized":"2024-09-17T03:33:01.771462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:25.613842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828611+0000","last_change":"2024-09-17T03:33:00.782782+0000","last_active":"2024-09-17T03:33:01.828611+0000","last_peered":"2024-09-17T03:33:01.828611+0000","last_clean":"2024-09-17T03:33:01.828611+0000","last_became_active":"2024-09-17T03:33:00.782342+0000","last_became_peered":"2024-09-17T03:33:00.782342+0000","last_unstale":"2024-09-17T03:33:01.828611+0000","last_undegraded":"2024-09-17T03:33:01.828611+0000","last_fullsized":"2024-09-17T03:33:01.828611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:45.334569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772159+0000","last_change":"2024-09-17T03:33:00.785690+0000","last_active":"2024-09-17T03:33:01.772159+0000","last_peered":"2024-09-17T03:33:01.772159+0000","last_clean":"2024-09-17T03:33:01.772159+0000","last_became_active":"2024-09-17T03:33:00.785379+0000","last_became_peered":"2024-09-17T03:33:00.785379+0000","last_unstale":"2024-09-17T03:33:01.772159+0000","last_undegraded":"2024-09-17T03:33:01.772159+0000","last_fullsized":"2024-09-17T03:33:01.772159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:23.348736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829110+0000","last_change":"2024-09-17T03:33:00.771812+0000","last_active":"2024-09-17T03:33:01.829110+0000","last_peered":"2024-09-17T03:33:01.829110+0000","last_clean":"2024-09-17T03:33:01.829110+0000","last_became_active":"2024-09-17T03:33:00.771519+0000","last_became_peered":"2024-09-17T03:33:00.771519+0000","last_unstale":"2024-09-17T03:33:01.829110+0000","last_undegraded":"2024-09-17T03:33:01.829110+0000","last_fullsized":"2024-09-17T03:33:01.829110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:35.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771263+0000","last_change":"2024-09-17T03:33:00.775473+0000","last_active":"2024-09-17T03:33:01.771263+0000","last_peered":"2024-09-17T03:33:01.771263+0000","last_clean":"2024-09-17T03:33:01.771263+0000","last_became_active":"2024-09-17T03:33:00.775162+0000","last_became_peered":"2024-09-17T03:33:00.775162+0000","last_unstale":"2024-09-17T03:33:01.771263+0000","last_undegraded":"2024-09-17T03:33:01.771263+0000","last_fullsized":"2024-09-17T03:33:01.771263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:46.467609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828630+0000","last_change":"2024-09-17T03:33:00.769652+0000","last_active":"2024-09-17T03:33:01.828630+0000","last_peered":"2024-09-17T03:33:01.828630+0000","last_clean":"2024-09-17T03:33:01.828630+0000","last_became_active":"2024-09-17T03:33:00.769304+0000","last_became_peered":"2024-09-17T03:33:00.769304+0000","last_unstale":"2024-09-17T03:33:01.828630+0000","last_undegraded":"2024-09-17T03:33:01.828630+0000","last_fullsized":"2024-09-17T03:33:01.828630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:57.243490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771737+0000","last_change":"2024-09-17T03:33:00.782886+0000","last_active":"2024-09-17T03:33:01.771737+0000","last_peered":"2024-09-17T03:33:01.771737+0000","last_clean":"2024-09-17T03:33:01.771737+0000","last_became_active":"2024-09-17T03:33:00.782588+0000","last_became_peered":"2024-09-17T03:33:00.782588+0000","last_unstale":"2024-09-17T03:33:01.771737+0000","last_undegraded":"2024-09-17T03:33:01.771737+0000","last_fullsized":"2024-09-17T03:33:01.771737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:41.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767437+0000","last_change":"2024-09-17T03:33:00.760617+0000","last_active":"2024-09-17T03:33:01.767437+0000","last_peered":"2024-09-17T03:33:01.767437+0000","last_clean":"2024-09-17T03:33:01.767437+0000","last_became_active":"2024-09-17T03:33:00.760082+0000","last_became_peered":"2024-09-17T03:33:00.760082+0000","last_unstale":"2024-09-17T03:33:01.767437+0000","last_undegraded":"2024-09-17T03:33:01.767437+0000","last_fullsized":"2024-09-17T03:33:01.767437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:14.092201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828353+0000","last_change":"2024-09-17T03:33:00.767896+0000","last_active":"2024-09-17T03:33:01.828353+0000","last_peered":"2024-09-17T03:33:01.828353+0000","last_clean":"2024-09-17T03:33:01.828353+0000","last_became_active":"2024-09-17T03:33:00.766950+0000","last_became_peered":"2024-09-17T03:33:00.766950+0000","last_unstale":"2024-09-17T03:33:01.828353+0000","last_undegraded":"2024-09-17T03:33:01.828353+0000","last_fullsized":"2024-09-17T03:33:01.828353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:06.893972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828851+0000","last_change":"2024-09-17T03:33:00.765502+0000","last_active":"2024-09-17T03:33:01.828851+0000","last_peered":"2024-09-17T03:33:01.828851+0000","last_clean":"2024-09-17T03:33:01.828851+0000","last_became_active":"2024-09-17T03:33:00.764433+0000","last_became_peered":"2024-09-17T03:33:00.764433+0000","last_unstale":"2024-09-17T03:33:01.828851+0000","last_undegraded":"2024-09-17T03:33:01.828851+0000","last_fullsized":"2024-09-17T03:33:01.828851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:14.731583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771900+0000","last_change":"2024-09-17T03:33:00.772070+0000","last_active":"2024-09-17T03:33:01.771900+0000","last_peered":"2024-09-17T03:33:01.771900+0000","last_clean":"2024-09-17T03:33:01.771900+0000","last_became_active":"2024-09-17T03:33:00.771721+0000","last_became_peered":"2024-09-17T03:33:00.771721+0000","last_unstale":"2024-09-17T03:33:01.771900+0000","last_undegraded":"2024-09-17T03:33:01.771900+0000","last_fullsized":"2024-09-17T03:33:01.771900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:27.987451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828035+0000","last_change":"2024-09-17T03:33:00.775482+0000","last_active":"2024-09-17T03:33:01.828035+0000","last_peered":"2024-09-17T03:33:01.828035+0000","last_clean":"2024-09-17T03:33:01.828035+0000","last_became_active":"2024-09-17T03:33:00.775176+0000","last_became_peered":"2024-09-17T03:33:00.775176+0000","last_unstale":"2024-09-17T03:33:01.828035+0000","last_undegraded":"2024-09-17T03:33:01.828035+0000","last_fullsized":"2024-09-17T03:33:01.828035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:40.655267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770460+0000","last_change":"2024-09-17T03:33:00.769414+0000","last_active":"2024-09-17T03:33:01.770460+0000","last_peered":"2024-09-17T03:33:01.770460+0000","last_clean":"2024-09-17T03:33:01.770460+0000","last_became_active":"2024-09-17T03:33:00.769045+0000","last_became_peered":"2024-09-17T03:33:00.769045+0000","last_unstale":"2024-09-17T03:33:01.770460+0000","last_undegraded":"2024-09-17T03:33:01.770460+0000","last_fullsized":"2024-09-17T03:33:01.770460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:52.488679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828518+0000","last_change":"2024-09-17T03:33:00.756739+0000","last_active":"2024-09-17T03:33:01.828518+0000","last_peered":"2024-09-17T03:33:01.828518+0000","last_clean":"2024-09-17T03:33:01.828518+0000","last_became_active":"2024-09-17T03:33:00.756432+0000","last_became_peered":"2024-09-17T03:33:00.756432+0000","last_unstale":"2024-09-17T03:33:01.828518+0000","last_undegraded":"2024-09-17T03:33:01.828518+0000","last_fullsized":"2024-09-17T03:33:01.828518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.136914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828369+0000","last_change":"2024-09-17T03:32:59.762042+0000","last_active":"2024-09-17T03:33:01.828369+0000","last_peered":"2024-09-17T03:33:01.828369+0000","last_clean":"2024-09-17T03:33:01.828369+0000","last_became_active":"2024-09-17T03:32:59.761644+0000","last_became_peered":"2024-09-17T03:32:59.761644+0000","last_unstale":"2024-09-17T03:33:01.828369+0000","last_undegraded":"2024-09-17T03:33:01.828369+0000","last_fullsized":"2024-09-17T03:33:01.828369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:05.070599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829071+0000","last_change":"2024-09-17T03:33:00.768871+0000","last_active":"2024-09-17T03:33:01.829071+0000","last_peered":"2024-09-17T03:33:01.829071+0000","last_clean":"2024-09-17T03:33:01.829071+0000","last_became_active":"2024-09-17T03:33:00.768576+0000","last_became_peered":"2024-09-17T03:33:00.768576+0000","last_unstale":"2024-09-17T03:33:01.829071+0000","last_undegraded":"2024-09-17T03:33:01.829071+0000","last_fullsized":"2024-09-17T03:33:01.829071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:41.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770504+0000","last_change":"2024-09-17T03:32:59.750464+0000","last_active":"2024-09-17T03:33:01.770504+0000","last_peered":"2024-09-17T03:33:01.770504+0000","last_clean":"2024-09-17T03:33:01.770504+0000","last_became_active":"2024-09-17T03:32:59.750128+0000","last_became_peered":"2024-09-17T03:32:59.750128+0000","last_unstale":"2024-09-17T03:33:01.770504+0000","last_undegraded":"2024-09-17T03:33:01.770504+0000","last_fullsized":"2024-09-17T03:33:01.770504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:33.223602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829218+0000","last_change":"2024-09-17T03:32:59.758058+0000","last_active":"2024-09-17T03:33:01.829218+0000","last_peered":"2024-09-17T03:33:01.829218+0000","last_clean":"2024-09-17T03:33:01.829218+0000","last_became_active":"2024-09-17T03:32:59.757687+0000","last_became_peered":"2024-09-17T03:32:59.757687+0000","last_unstale":"2024-09-17T03:33:01.829218+0000","last_undegraded":"2024-09-17T03:33:01.829218+0000","last_fullsized":"2024-09-17T03:33:01.829218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827893+0000","last_change":"2024-09-17T03:33:00.770901+0000","last_active":"2024-09-17T03:33:01.827893+0000","last_peered":"2024-09-17T03:33:01.827893+0000","last_clean":"2024-09-17T03:33:01.827893+0000","last_became_active":"2024-09-17T03:33:00.770616+0000","last_became_peered":"2024-09-17T03:33:00.770616+0000","last_unstale":"2024-09-17T03:33:01.827893+0000","last_undegraded":"2024-09-17T03:33:01.827893+0000","last_fullsized":"2024-09-17T03:33:01.827893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:30.089705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770904+0000","last_change":"2024-09-17T03:32:59.754649+0000","last_active":"2024-09-17T03:33:01.770904+0000","last_peered":"2024-09-17T03:33:01.770904+0000","last_clean":"2024-09-17T03:33:01.770904+0000","last_became_active":"2024-09-17T03:32:59.754136+0000","last_became_peered":"2024-09-17T03:32:59.754136+0000","last_unstale":"2024-09-17T03:33:01.770904+0000","last_undegraded":"2024-09-17T03:33:01.770904+0000","last_fullsized":"2024-09-17T03:33:01.770904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.329730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767336+0000","last_change":"2024-09-17T03:33:00.760841+0000","last_active":"2024-09-17T03:33:01.767336+0000","last_peered":"2024-09-17T03:33:01.767336+0000","last_clean":"2024-09-17T03:33:01.767336+0000","last_became_active":"2024-09-17T03:33:00.760403+0000","last_became_peered":"2024-09-17T03:33:00.760403+0000","last_unstale":"2024-09-17T03:33:01.767336+0000","last_undegraded":"2024-09-17T03:33:01.767336+0000","last_fullsized":"2024-09-17T03:33:01.767336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:36.260269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770699+0000","last_change":"2024-09-17T03:32:59.754636+0000","last_active":"2024-09-17T03:33:01.770699+0000","last_peered":"2024-09-17T03:33:01.770699+0000","last_clean":"2024-09-17T03:33:01.770699+0000","last_became_active":"2024-09-17T03:32:59.754209+0000","last_became_peered":"2024-09-17T03:32:59.754209+0000","last_unstale":"2024-09-17T03:33:01.770699+0000","last_undegraded":"2024-09-17T03:33:01.770699+0000","last_fullsized":"2024-09-17T03:33:01.770699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:56.265096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770975+0000","last_change":"2024-09-17T03:33:00.783600+0000","last_active":"2024-09-17T03:33:01.770975+0000","last_peered":"2024-09-17T03:33:01.770975+0000","last_clean":"2024-09-17T03:33:01.770975+0000","last_became_active":"2024-09-17T03:33:00.783299+0000","last_became_peered":"2024-09-17T03:33:00.783299+0000","last_unstale":"2024-09-17T03:33:01.770975+0000","last_undegraded":"2024-09-17T03:33:01.770975+0000","last_fullsized":"2024-09-17T03:33:01.770975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:44.836032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771087+0000","last_change":"2024-09-17T03:32:59.756949+0000","last_active":"2024-09-17T03:33:01.771087+0000","last_peered":"2024-09-17T03:33:01.771087+0000","last_clean":"2024-09-17T03:33:01.771087+0000","last_became_active":"2024-09-17T03:32:59.756555+0000","last_became_peered":"2024-09-17T03:32:59.756555+0000","last_unstale":"2024-09-17T03:33:01.771087+0000","last_undegraded":"2024-09-17T03:33:01.771087+0000","last_fullsized":"2024-09-17T03:33:01.771087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:41.461451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828788+0000","last_change":"2024-09-17T03:33:00.779122+0000","last_active":"2024-09-17T03:33:01.828788+0000","last_peered":"2024-09-17T03:33:01.828788+0000","last_clean":"2024-09-17T03:33:01.828788+0000","last_became_active":"2024-09-17T03:33:00.778812+0000","last_became_peered":"2024-09-17T03:33:00.778812+0000","last_unstale":"2024-09-17T03:33:01.828788+0000","last_undegraded":"2024-09-17T03:33:01.828788+0000","last_fullsized":"2024-09-17T03:33:01.828788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:25.613842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767519+0000","last_change":"2024-09-17T03:32:59.757444+0000","last_active":"2024-09-17T03:33:01.767519+0000","last_peered":"2024-09-17T03:33:01.767519+0000","last_clean":"2024-09-17T03:33:01.767519+0000","last_became_active":"2024-09-17T03:32:59.757144+0000","last_became_peered":"2024-09-17T03:32:59.757144+0000","last_unstale":"2024-09-17T03:33:01.767519+0000","last_undegraded":"2024-09-17T03:33:01.767519+0000","last_fullsized":"2024-09-17T03:33:01.767519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:25.450646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828656+0000","last_change":"2024-09-17T03:33:00.783211+0000","last_active":"2024-09-17T03:33:01.828656+0000","last_peered":"2024-09-17T03:33:01.828656+0000","last_clean":"2024-09-17T03:33:01.828656+0000","last_became_active":"2024-09-17T03:33:00.782917+0000","last_became_peered":"2024-09-17T03:33:00.782917+0000","last_unstale":"2024-09-17T03:33:01.828656+0000","last_undegraded":"2024-09-17T03:33:01.828656+0000","last_fullsized":"2024-09-17T03:33:01.828656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:40.655267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771416+0000","last_change":"2024-09-17T03:32:59.756162+0000","last_active":"2024-09-17T03:33:01.771416+0000","last_peered":"2024-09-17T03:33:01.771416+0000","last_clean":"2024-09-17T03:33:01.771416+0000","last_became_active":"2024-09-17T03:32:59.755825+0000","last_became_peered":"2024-09-17T03:32:59.755825+0000","last_unstale":"2024-09-17T03:33:01.771416+0000","last_undegraded":"2024-09-17T03:33:01.771416+0000","last_fullsized":"2024-09-17T03:33:01.771416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:08.648990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828551+0000","last_change":"2024-09-17T03:33:00.777400+0000","last_active":"2024-09-17T03:33:01.828551+0000","last_peered":"2024-09-17T03:33:01.828551+0000","last_clean":"2024-09-17T03:33:01.828551+0000","last_became_active":"2024-09-17T03:33:00.776982+0000","last_became_peered":"2024-09-17T03:33:00.776982+0000","last_unstale":"2024-09-17T03:33:01.828551+0000","last_undegraded":"2024-09-17T03:33:01.828551+0000","last_fullsized":"2024-09-17T03:33:01.828551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:00.761824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829140+0000","last_change":"2024-09-17T03:32:59.752557+0000","last_active":"2024-09-17T03:33:01.829140+0000","last_peered":"2024-09-17T03:33:01.829140+0000","last_clean":"2024-09-17T03:33:01.829140+0000","last_became_active":"2024-09-17T03:32:59.752209+0000","last_became_peered":"2024-09-17T03:32:59.752209+0000","last_unstale":"2024-09-17T03:33:01.829140+0000","last_undegraded":"2024-09-17T03:33:01.829140+0000","last_fullsized":"2024-09-17T03:33:01.829140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:42.500391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828242+0000","last_change":"2024-09-17T03:33:00.782750+0000","last_active":"2024-09-17T03:33:01.828242+0000","last_peered":"2024-09-17T03:33:01.828242+0000","last_clean":"2024-09-17T03:33:01.828242+0000","last_became_active":"2024-09-17T03:33:00.782327+0000","last_became_peered":"2024-09-17T03:33:00.782327+0000","last_unstale":"2024-09-17T03:33:01.828242+0000","last_undegraded":"2024-09-17T03:33:01.828242+0000","last_fullsized":"2024-09-17T03:33:01.828242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:52.488679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772126+0000","last_change":"2024-09-17T03:32:59.760715+0000","last_active":"2024-09-17T03:33:01.772126+0000","last_peered":"2024-09-17T03:33:01.772126+0000","last_clean":"2024-09-17T03:33:01.772126+0000","last_became_active":"2024-09-17T03:32:59.760384+0000","last_became_peered":"2024-09-17T03:32:59.760384+0000","last_unstale":"2024-09-17T03:33:01.772126+0000","last_undegraded":"2024-09-17T03:33:01.772126+0000","last_fullsized":"2024-09-17T03:33:01.772126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:12.647154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829216+0000","last_change":"2024-09-17T03:33:00.783439+0000","last_active":"2024-09-17T03:33:01.829216+0000","last_peered":"2024-09-17T03:33:01.829216+0000","last_clean":"2024-09-17T03:33:01.829216+0000","last_became_active":"2024-09-17T03:33:00.783137+0000","last_became_peered":"2024-09-17T03:33:00.783137+0000","last_unstale":"2024-09-17T03:33:01.829216+0000","last_undegraded":"2024-09-17T03:33:01.829216+0000","last_fullsized":"2024-09-17T03:33:01.829216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:50.057290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770363+0000","last_change":"2024-09-17T03:32:59.752048+0000","last_active":"2024-09-17T03:33:01.770363+0000","last_peered":"2024-09-17T03:33:01.770363+0000","last_clean":"2024-09-17T03:33:01.770363+0000","last_became_active":"2024-09-17T03:32:59.751723+0000","last_became_peered":"2024-09-17T03:32:59.751723+0000","last_unstale":"2024-09-17T03:33:01.770363+0000","last_undegraded":"2024-09-17T03:33:01.770363+0000","last_fullsized":"2024-09-17T03:33:01.770363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:48.722694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770848+0000","last_change":"2024-09-17T03:33:00.768436+0000","last_active":"2024-09-17T03:33:01.770848+0000","last_peered":"2024-09-17T03:33:01.770848+0000","last_clean":"2024-09-17T03:33:01.770848+0000","last_became_active":"2024-09-17T03:33:00.768115+0000","last_became_peered":"2024-09-17T03:33:00.768115+0000","last_unstale":"2024-09-17T03:33:01.770848+0000","last_undegraded":"2024-09-17T03:33:01.770848+0000","last_fullsized":"2024-09-17T03:33:01.770848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:19.020262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828325+0000","last_change":"2024-09-17T03:32:59.752841+0000","last_active":"2024-09-17T03:33:01.828325+0000","last_peered":"2024-09-17T03:33:01.828325+0000","last_clean":"2024-09-17T03:33:01.828325+0000","last_became_active":"2024-09-17T03:32:59.752527+0000","last_became_peered":"2024-09-17T03:32:59.752527+0000","last_unstale":"2024-09-17T03:33:01.828325+0000","last_undegraded":"2024-09-17T03:33:01.828325+0000","last_fullsized":"2024-09-17T03:33:01.828325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:02.065991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829064+0000","last_change":"2024-09-17T03:33:00.777223+0000","last_active":"2024-09-17T03:33:01.829064+0000","last_peered":"2024-09-17T03:33:01.829064+0000","last_clean":"2024-09-17T03:33:01.829064+0000","last_became_active":"2024-09-17T03:33:00.776568+0000","last_became_peered":"2024-09-17T03:33:00.776568+0000","last_unstale":"2024-09-17T03:33:01.829064+0000","last_undegraded":"2024-09-17T03:33:01.829064+0000","last_fullsized":"2024-09-17T03:33:01.829064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:05.136285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828618+0000","last_change":"2024-09-17T03:32:59.752343+0000","last_active":"2024-09-17T03:33:01.828618+0000","last_peered":"2024-09-17T03:33:01.828618+0000","last_clean":"2024-09-17T03:33:01.828618+0000","last_became_active":"2024-09-17T03:32:59.751973+0000","last_became_peered":"2024-09-17T03:32:59.751973+0000","last_unstale":"2024-09-17T03:33:01.828618+0000","last_undegraded":"2024-09-17T03:33:01.828618+0000","last_fullsized":"2024-09-17T03:33:01.828618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.016385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828907+0000","last_change":"2024-09-17T03:33:00.782466+0000","last_active":"2024-09-17T03:33:01.828907+0000","last_peered":"2024-09-17T03:33:01.828907+0000","last_clean":"2024-09-17T03:33:01.828907+0000","last_became_active":"2024-09-17T03:33:00.782092+0000","last_became_peered":"2024-09-17T03:33:00.782092+0000","last_unstale":"2024-09-17T03:33:01.828907+0000","last_undegraded":"2024-09-17T03:33:01.828907+0000","last_fullsized":"2024-09-17T03:33:01.828907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:38.197777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827653+0000","last_change":"2024-09-17T03:32:59.761123+0000","last_active":"2024-09-17T03:33:01.827653+0000","last_peered":"2024-09-17T03:33:01.827653+0000","last_clean":"2024-09-17T03:33:01.827653+0000","last_became_active":"2024-09-17T03:32:59.760730+0000","last_became_peered":"2024-09-17T03:32:59.760730+0000","last_unstale":"2024-09-17T03:33:01.827653+0000","last_undegraded":"2024-09-17T03:33:01.827653+0000","last_fullsized":"2024-09-17T03:33:01.827653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:26.495834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829383+0000","last_change":"2024-09-17T03:33:00.778945+0000","last_active":"2024-09-17T03:33:01.829383+0000","last_peered":"2024-09-17T03:33:01.829383+0000","last_clean":"2024-09-17T03:33:01.829383+0000","last_became_active":"2024-09-17T03:33:00.778622+0000","last_became_peered":"2024-09-17T03:33:00.778622+0000","last_unstale":"2024-09-17T03:33:01.829383+0000","last_undegraded":"2024-09-17T03:33:01.829383+0000","last_fullsized":"2024-09-17T03:33:01.829383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:48.264109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767642+0000","last_change":"2024-09-17T03:32:59.753256+0000","last_active":"2024-09-17T03:33:01.767642+0000","last_peered":"2024-09-17T03:33:01.767642+0000","last_clean":"2024-09-17T03:33:01.767642+0000","last_became_active":"2024-09-17T03:32:59.752924+0000","last_became_peered":"2024-09-17T03:32:59.752924+0000","last_unstale":"2024-09-17T03:33:01.767642+0000","last_undegraded":"2024-09-17T03:33:01.767642+0000","last_fullsized":"2024-09-17T03:33:01.767642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:24.567153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771993+0000","last_change":"2024-09-17T03:33:00.776604+0000","last_active":"2024-09-17T03:33:01.771993+0000","last_peered":"2024-09-17T03:33:01.771993+0000","last_clean":"2024-09-17T03:33:01.771993+0000","last_became_active":"2024-09-17T03:33:00.776020+0000","last_became_peered":"2024-09-17T03:33:00.776020+0000","last_unstale":"2024-09-17T03:33:01.771993+0000","last_undegraded":"2024-09-17T03:33:01.771993+0000","last_fullsized":"2024-09-17T03:33:01.771993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:06.411768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827511+0000","last_change":"2024-09-17T03:32:59.757099+0000","last_active":"2024-09-17T03:33:01.827511+0000","last_peered":"2024-09-17T03:33:01.827511+0000","last_clean":"2024-09-17T03:33:01.827511+0000","last_became_active":"2024-09-17T03:32:59.756741+0000","last_became_peered":"2024-09-17T03:32:59.756741+0000","last_unstale":"2024-09-17T03:33:01.827511+0000","last_undegraded":"2024-09-17T03:33:01.827511+0000","last_fullsized":"2024-09-17T03:33:01.827511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:48.722694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828813+0000","last_change":"2024-09-17T03:33:00.781017+0000","last_active":"2024-09-17T03:33:01.828813+0000","last_peered":"2024-09-17T03:33:01.828813+0000","last_clean":"2024-09-17T03:33:01.828813+0000","last_became_active":"2024-09-17T03:33:00.780661+0000","last_became_peered":"2024-09-17T03:33:00.780661+0000","last_unstale":"2024-09-17T03:33:01.828813+0000","last_undegraded":"2024-09-17T03:33:01.828813+0000","last_fullsized":"2024-09-17T03:33:01.828813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:38.019743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827855+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:33:01.827855+0000","last_peered":"2024-09-17T03:33:01.827855+0000","last_clean":"2024-09-17T03:33:01.827855+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:33:01.827855+0000","last_undegraded":"2024-09-17T03:33:01.827855+0000","last_fullsized":"2024-09-17T03:33:01.827855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771026+0000","last_change":"2024-09-17T03:32:59.755210+0000","last_active":"2024-09-17T03:33:01.771026+0000","last_peered":"2024-09-17T03:33:01.771026+0000","last_clean":"2024-09-17T03:33:01.771026+0000","last_became_active":"2024-09-17T03:32:59.753607+0000","last_became_peered":"2024-09-17T03:32:59.753607+0000","last_unstale":"2024-09-17T03:33:01.771026+0000","last_undegraded":"2024-09-17T03:33:01.771026+0000","last_fullsized":"2024-09-17T03:33:01.771026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829325+0000","last_change":"2024-09-17T03:33:00.780277+0000","last_active":"2024-09-17T03:33:01.829325+0000","last_peered":"2024-09-17T03:33:01.829325+0000","last_clean":"2024-09-17T03:33:01.829325+0000","last_became_active":"2024-09-17T03:33:00.780008+0000","last_became_peered":"2024-09-17T03:33:00.780008+0000","last_unstale":"2024-09-17T03:33:01.829325+0000","last_undegraded":"2024-09-17T03:33:01.829325+0000","last_fullsized":"2024-09-17T03:33:01.829325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:56.218073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827807+0000","last_change":"2024-09-17T03:32:59.763822+0000","last_active":"2024-09-17T03:33:01.827807+0000","last_peered":"2024-09-17T03:33:01.827807+0000","last_clean":"2024-09-17T03:33:01.827807+0000","last_became_active":"2024-09-17T03:32:59.763474+0000","last_became_peered":"2024-09-17T03:32:59.763474+0000","last_unstale":"2024-09-17T03:33:01.827807+0000","last_undegraded":"2024-09-17T03:33:01.827807+0000","last_fullsized":"2024-09-17T03:33:01.827807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:02.046619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827486+0000","last_change":"2024-09-17T03:33:00.769651+0000","last_active":"2024-09-17T03:33:01.827486+0000","last_peered":"2024-09-17T03:33:01.827486+0000","last_clean":"2024-09-17T03:33:01.827486+0000","last_became_active":"2024-09-17T03:33:00.769137+0000","last_became_peered":"2024-09-17T03:33:00.769137+0000","last_unstale":"2024-09-17T03:33:01.827486+0000","last_undegraded":"2024-09-17T03:33:01.827486+0000","last_fullsized":"2024-09-17T03:33:01.827486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.450827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828105+0000","last_change":"2024-09-17T03:32:59.761128+0000","last_active":"2024-09-17T03:33:01.828105+0000","last_peered":"2024-09-17T03:33:01.828105+0000","last_clean":"2024-09-17T03:33:01.828105+0000","last_became_active":"2024-09-17T03:32:59.760765+0000","last_became_peered":"2024-09-17T03:32:59.760765+0000","last_unstale":"2024-09-17T03:33:01.828105+0000","last_undegraded":"2024-09-17T03:33:01.828105+0000","last_fullsized":"2024-09-17T03:33:01.828105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:04.446287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767343+0000","last_change":"2024-09-17T03:33:00.760063+0000","last_active":"2024-09-17T03:33:01.767343+0000","last_peered":"2024-09-17T03:33:01.767343+0000","last_clean":"2024-09-17T03:33:01.767343+0000","last_became_active":"2024-09-17T03:33:00.759678+0000","last_became_peered":"2024-09-17T03:33:00.759678+0000","last_unstale":"2024-09-17T03:33:01.767343+0000","last_undegraded":"2024-09-17T03:33:01.767343+0000","last_fullsized":"2024-09-17T03:33:01.767343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:07.035577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772200+0000","last_change":"2024-09-17T03:32:59.753138+0000","last_active":"2024-09-17T03:33:01.772200+0000","last_peered":"2024-09-17T03:33:01.772200+0000","last_clean":"2024-09-17T03:33:01.772200+0000","last_became_active":"2024-09-17T03:32:59.752828+0000","last_became_peered":"2024-09-17T03:32:59.752828+0000","last_unstale":"2024-09-17T03:33:01.772200+0000","last_undegraded":"2024-09-17T03:33:01.772200+0000","last_fullsized":"2024-09-17T03:33:01.772200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:06.735843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828444+0000","last_change":"2024-09-17T03:33:00.769042+0000","last_active":"2024-09-17T03:33:01.828444+0000","last_peered":"2024-09-17T03:33:01.828444+0000","last_clean":"2024-09-17T03:33:01.828444+0000","last_became_active":"2024-09-17T03:33:00.768097+0000","last_became_peered":"2024-09-17T03:33:00.768097+0000","last_unstale":"2024-09-17T03:33:01.828444+0000","last_undegraded":"2024-09-17T03:33:01.828444+0000","last_fullsized":"2024-09-17T03:33:01.828444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:29.022126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767570+0000","last_change":"2024-09-17T03:32:59.753623+0000","last_active":"2024-09-17T03:33:01.767570+0000","last_peered":"2024-09-17T03:33:01.767570+0000","last_clean":"2024-09-17T03:33:01.767570+0000","last_became_active":"2024-09-17T03:32:59.753253+0000","last_became_peered":"2024-09-17T03:32:59.753253+0000","last_unstale":"2024-09-17T03:33:01.767570+0000","last_undegraded":"2024-09-17T03:33:01.767570+0000","last_fullsized":"2024-09-17T03:33:01.767570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:26.495834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772112+0000","last_change":"2024-09-17T03:33:00.771853+0000","last_active":"2024-09-17T03:33:01.772112+0000","last_peered":"2024-09-17T03:33:01.772112+0000","last_clean":"2024-09-17T03:33:01.772112+0000","last_became_active":"2024-09-17T03:33:00.771534+0000","last_became_peered":"2024-09-17T03:33:00.771534+0000","last_unstale":"2024-09-17T03:33:01.772112+0000","last_undegraded":"2024-09-17T03:33:01.772112+0000","last_fullsized":"2024-09-17T03:33:01.772112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:07.316072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828986+0000","last_change":"2024-09-17T03:32:59.763327+0000","last_active":"2024-09-17T03:33:01.828986+0000","last_peered":"2024-09-17T03:33:01.828986+0000","last_clean":"2024-09-17T03:33:01.828986+0000","last_became_active":"2024-09-17T03:32:59.762808+0000","last_became_peered":"2024-09-17T03:32:59.762808+0000","last_unstale":"2024-09-17T03:33:01.828986+0000","last_undegraded":"2024-09-17T03:33:01.828986+0000","last_fullsized":"2024-09-17T03:33:01.828986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:09.031060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767457+0000","last_change":"2024-09-17T03:33:00.760233+0000","last_active":"2024-09-17T03:33:01.767457+0000","last_peered":"2024-09-17T03:33:01.767457+0000","last_clean":"2024-09-17T03:33:01.767457+0000","last_became_active":"2024-09-17T03:33:00.759904+0000","last_became_peered":"2024-09-17T03:33:00.759904+0000","last_unstale":"2024-09-17T03:33:01.767457+0000","last_undegraded":"2024-09-17T03:33:01.767457+0000","last_fullsized":"2024-09-17T03:33:01.767457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:23.150098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767506+0000","last_change":"2024-09-17T03:32:59.752736+0000","last_active":"2024-09-17T03:33:01.767506+0000","last_peered":"2024-09-17T03:33:01.767506+0000","last_clean":"2024-09-17T03:33:01.767506+0000","last_became_active":"2024-09-17T03:32:59.752395+0000","last_became_peered":"2024-09-17T03:32:59.752395+0000","last_unstale":"2024-09-17T03:33:01.767506+0000","last_undegraded":"2024-09-17T03:33:01.767506+0000","last_fullsized":"2024-09-17T03:33:01.767506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:39.649900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828852+0000","last_change":"2024-09-17T03:33:00.777441+0000","last_active":"2024-09-17T03:33:01.828852+0000","last_peered":"2024-09-17T03:33:01.828852+0000","last_clean":"2024-09-17T03:33:01.828852+0000","last_became_active":"2024-09-17T03:33:00.777102+0000","last_became_peered":"2024-09-17T03:33:00.777102+0000","last_unstale":"2024-09-17T03:33:01.828852+0000","last_undegraded":"2024-09-17T03:33:01.828852+0000","last_fullsized":"2024-09-17T03:33:01.828852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.389271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.770870+0000","last_change":"2024-09-17T03:32:59.758935+0000","last_active":"2024-09-17T03:33:01.770870+0000","last_peered":"2024-09-17T03:33:01.770870+0000","last_clean":"2024-09-17T03:33:01.770870+0000","last_became_active":"2024-09-17T03:32:59.758594+0000","last_became_peered":"2024-09-17T03:32:59.758594+0000","last_unstale":"2024-09-17T03:33:01.770870+0000","last_undegraded":"2024-09-17T03:33:01.770870+0000","last_fullsized":"2024-09-17T03:33:01.770870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:47.493156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828639+0000","last_change":"2024-09-17T03:33:00.765218+0000","last_active":"2024-09-17T03:33:01.828639+0000","last_peered":"2024-09-17T03:33:01.828639+0000","last_clean":"2024-09-17T03:33:01.828639+0000","last_became_active":"2024-09-17T03:33:00.764728+0000","last_became_peered":"2024-09-17T03:33:00.764728+0000","last_unstale":"2024-09-17T03:33:01.828639+0000","last_undegraded":"2024-09-17T03:33:01.828639+0000","last_fullsized":"2024-09-17T03:33:01.828639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:19.020262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.827701+0000","last_change":"2024-09-17T03:32:59.763500+0000","last_active":"2024-09-17T03:33:01.827701+0000","last_peered":"2024-09-17T03:33:01.827701+0000","last_clean":"2024-09-17T03:33:01.827701+0000","last_became_active":"2024-09-17T03:32:59.763055+0000","last_became_peered":"2024-09-17T03:32:59.763055+0000","last_unstale":"2024-09-17T03:33:01.827701+0000","last_undegraded":"2024-09-17T03:33:01.827701+0000","last_fullsized":"2024-09-17T03:33:01.827701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:08.648990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828125+0000","last_change":"2024-09-17T03:33:00.768008+0000","last_active":"2024-09-17T03:33:01.828125+0000","last_peered":"2024-09-17T03:33:01.828125+0000","last_clean":"2024-09-17T03:33:01.828125+0000","last_became_active":"2024-09-17T03:33:00.767649+0000","last_became_peered":"2024-09-17T03:33:00.767649+0000","last_unstale":"2024-09-17T03:33:01.828125+0000","last_undegraded":"2024-09-17T03:33:01.828125+0000","last_fullsized":"2024-09-17T03:33:01.828125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.501201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767401+0000","last_change":"2024-09-17T03:32:59.761083+0000","last_active":"2024-09-17T03:33:01.767401+0000","last_peered":"2024-09-17T03:33:01.767401+0000","last_clean":"2024-09-17T03:33:01.767401+0000","last_became_active":"2024-09-17T03:32:59.760765+0000","last_became_peered":"2024-09-17T03:32:59.760765+0000","last_unstale":"2024-09-17T03:33:01.767401+0000","last_undegraded":"2024-09-17T03:33:01.767401+0000","last_fullsized":"2024-09-17T03:33:01.767401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:28.016759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828140+0000","last_change":"2024-09-17T03:33:00.761340+0000","last_active":"2024-09-17T03:33:01.828140+0000","last_peered":"2024-09-17T03:33:01.828140+0000","last_clean":"2024-09-17T03:33:01.828140+0000","last_became_active":"2024-09-17T03:33:00.760617+0000","last_became_peered":"2024-09-17T03:33:00.760617+0000","last_unstale":"2024-09-17T03:33:01.828140+0000","last_undegraded":"2024-09-17T03:33:01.828140+0000","last_fullsized":"2024-09-17T03:33:01.828140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:17.573959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.767550+0000","last_change":"2024-09-17T03:32:59.760660+0000","last_active":"2024-09-17T03:33:01.767550+0000","last_peered":"2024-09-17T03:33:01.767550+0000","last_clean":"2024-09-17T03:33:01.767550+0000","last_became_active":"2024-09-17T03:32:59.760223+0000","last_became_peered":"2024-09-17T03:32:59.760223+0000","last_unstale":"2024-09-17T03:33:01.767550+0000","last_undegraded":"2024-09-17T03:33:01.767550+0000","last_fullsized":"2024-09-17T03:33:01.767550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:04.446287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828236+0000","last_change":"2024-09-17T03:33:00.773988+0000","last_active":"2024-09-17T03:33:01.828236+0000","last_peered":"2024-09-17T03:33:01.828236+0000","last_clean":"2024-09-17T03:33:01.828236+0000","last_became_active":"2024-09-17T03:33:00.773669+0000","last_became_peered":"2024-09-17T03:33:00.773669+0000","last_unstale":"2024-09-17T03:33:01.828236+0000","last_undegraded":"2024-09-17T03:33:01.828236+0000","last_fullsized":"2024-09-17T03:33:01.828236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:36.829010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.829149+0000","last_change":"2024-09-17T03:32:59.763512+0000","last_active":"2024-09-17T03:33:01.829149+0000","last_peered":"2024-09-17T03:33:01.829149+0000","last_clean":"2024-09-17T03:33:01.829149+0000","last_became_active":"2024-09-17T03:32:59.763073+0000","last_became_peered":"2024-09-17T03:32:59.763073+0000","last_unstale":"2024-09-17T03:33:01.829149+0000","last_undegraded":"2024-09-17T03:33:01.829149+0000","last_fullsized":"2024-09-17T03:33:01.829149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:05.582982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771163+0000","last_change":"2024-09-17T03:33:00.760569+0000","last_active":"2024-09-17T03:33:01.771163+0000","last_peered":"2024-09-17T03:33:01.771163+0000","last_clean":"2024-09-17T03:33:01.771163+0000","last_became_active":"2024-09-17T03:33:00.760215+0000","last_became_peered":"2024-09-17T03:33:00.760215+0000","last_unstale":"2024-09-17T03:33:01.771163+0000","last_undegraded":"2024-09-17T03:33:01.771163+0000","last_fullsized":"2024-09-17T03:33:01.771163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:39.597440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.772055+0000","last_change":"2024-09-17T03:33:00.775407+0000","last_active":"2024-09-17T03:33:01.772055+0000","last_peered":"2024-09-17T03:33:01.772055+0000","last_clean":"2024-09-17T03:33:01.772055+0000","last_became_active":"2024-09-17T03:33:00.773657+0000","last_became_peered":"2024-09-17T03:33:00.773657+0000","last_unstale":"2024-09-17T03:33:01.772055+0000","last_undegraded":"2024-09-17T03:33:01.772055+0000","last_fullsized":"2024-09-17T03:33:01.772055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:18.984982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828727+0000","last_change":"2024-09-17T03:32:59.763902+0000","last_active":"2024-09-17T03:33:01.828727+0000","last_peered":"2024-09-17T03:33:01.828727+0000","last_clean":"2024-09-17T03:33:01.828727+0000","last_became_active":"2024-09-17T03:32:59.763401+0000","last_became_peered":"2024-09-17T03:32:59.763401+0000","last_unstale":"2024-09-17T03:33:01.828727+0000","last_undegraded":"2024-09-17T03:33:01.828727+0000","last_fullsized":"2024-09-17T03:33:01.828727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:25.445460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.771973+0000","last_change":"2024-09-17T03:33:00.777352+0000","last_active":"2024-09-17T03:33:01.771973+0000","last_peered":"2024-09-17T03:33:01.771973+0000","last_clean":"2024-09-17T03:33:01.771973+0000","last_became_active":"2024-09-17T03:33:00.777033+0000","last_became_peered":"2024-09-17T03:33:00.777033+0000","last_unstale":"2024-09-17T03:33:01.771973+0000","last_undegraded":"2024-09-17T03:33:01.771973+0000","last_fullsized":"2024-09-17T03:33:01.771973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:46.197387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828815+0000","last_change":"2024-09-17T03:32:59.764471+0000","last_active":"2024-09-17T03:33:01.828815+0000","last_peered":"2024-09-17T03:33:01.828815+0000","last_clean":"2024-09-17T03:33:01.828815+0000","last_became_active":"2024-09-17T03:32:59.763904+0000","last_became_peered":"2024-09-17T03:32:59.763904+0000","last_unstale":"2024-09-17T03:33:01.828815+0000","last_undegraded":"2024-09-17T03:33:01.828815+0000","last_fullsized":"2024-09-17T03:33:01.828815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:26.131547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828645+0000","last_change":"2024-09-17T03:33:00.779461+0000","last_active":"2024-09-17T03:33:01.828645+0000","last_peered":"2024-09-17T03:33:01.828645+0000","last_clean":"2024-09-17T03:33:01.828645+0000","last_became_active":"2024-09-17T03:33:00.779082+0000","last_became_peered":"2024-09-17T03:33:00.779082+0000","last_unstale":"2024-09-17T03:33:01.828645+0000","last_undegraded":"2024-09-17T03:33:01.828645+0000","last_fullsized":"2024-09-17T03:33:01.828645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:07.035577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828382+0000","last_change":"2024-09-17T03:32:59.763107+0000","last_active":"2024-09-17T03:33:01.828382+0000","last_peered":"2024-09-17T03:33:01.828382+0000","last_clean":"2024-09-17T03:33:01.828382+0000","last_became_active":"2024-09-17T03:32:59.762811+0000","last_became_peered":"2024-09-17T03:32:59.762811+0000","last_unstale":"2024-09-17T03:33:01.828382+0000","last_undegraded":"2024-09-17T03:33:01.828382+0000","last_fullsized":"2024-09-17T03:33:01.828382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:02.001895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828252+0000","last_change":"2024-09-17T03:33:00.774953+0000","last_active":"2024-09-17T03:33:01.828252+0000","last_peered":"2024-09-17T03:33:01.828252+0000","last_clean":"2024-09-17T03:33:01.828252+0000","last_became_active":"2024-09-17T03:33:00.773865+0000","last_became_peered":"2024-09-17T03:33:00.773865+0000","last_unstale":"2024-09-17T03:33:01.828252+0000","last_undegraded":"2024-09-17T03:33:01.828252+0000","last_fullsized":"2024-09-17T03:33:01.828252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:59.734187+0000","last_clean_scrub_stamp":"2024-09-17T03:32:59.734187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:03.734959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:33:01.828747+0000","last_change":"2024-09-17T03:32:59.760741+0000","last_active":"2024-09-17T03:33:01.828747+0000","last_peered":"2024-09-17T03:33:01.828747+0000","last_clean":"2024-09-17T03:33:01.828747+0000","last_became_active":"2024-09-17T03:32:59.760355+0000","last_became_peered":"2024-09-17T03:32:59.760355+0000","last_unstale":"2024-09-17T03:33:01.828747+0000","last_undegraded":"2024-09-17T03:33:01.828747+0000","last_fullsized":"2024-09-17T03:33:01.828747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:58.728820+0000","last_clean_scrub_stamp":"2024-09-17T03:32:58.728820+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:14.945781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:13.407 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:33:13.408 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T03:33:13.408 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T03:33:13.408 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T03:33:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.555+0000 7fc8a1a70640 1 -- 172.21.15.146:0/142590634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c0b3b60 msgr2=0x7fc89c15caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.555+0000 7fc8a1a70640 1 --2- 172.21.15.146:0/142590634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c0b3b60 0x7fc89c15caa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc894005fd0 tx=0x7fc89402aa90 comp rx=0 tx=0).stop 2024-09-17T03:33:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.555+0000 7fc8a1a70640 1 -- 172.21.15.146:0/142590634 shutdown_connections 2024-09-17T03:33:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.555+0000 7fc8a1a70640 1 --2- 172.21.15.146:0/142590634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c0b3b60 0x7fc89c15caa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.555+0000 7fc8a1a70640 1 --2- 172.21.15.146:0/142590634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0b5750 0x7fc89c0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.555+0000 7fc8a1a70640 1 -- 172.21.15.146:0/142590634 >> 172.21.15.146:0/142590634 conn(0x7fc89c0b7b20 msgr2=0x7fc89c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.555+0000 7fc8a1a70640 1 -- 172.21.15.146:0/142590634 shutdown_connections 2024-09-17T03:33:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.555+0000 7fc8a1a70640 1 -- 172.21.15.146:0/142590634 wait complete. 2024-09-17T03:33:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.557+0000 7fc8a1a70640 1 Processor -- start 2024-09-17T03:33:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.557+0000 7fc8a1a70640 1 -- start start 2024-09-17T03:33:13.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc8a1a70640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b3b60 0x7fc89c0d2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc8a1a70640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c0b5750 0x7fc89c1498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc8a1a70640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0b5ce0 0x7fc89c15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc8a1a70640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c15d3b0 con 0x7fc89c0b3b60 2024-09-17T03:33:13.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc8a1a70640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c15d230 con 0x7fc89c0b5750 2024-09-17T03:33:13.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc8a1a70640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc89c15d530 con 0x7fc89c0b5ce0 2024-09-17T03:33:13.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc89b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b3b60 0x7fc89c0d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc89b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b3b60 0x7fc89c0d2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50774/0 (socket says 172.21.15.146:50774) 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc89b7fe640 1 -- 172.21.15.146:0/836468168 learned_addr learned my addr 172.21.15.146:0/836468168 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc89affd640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c0b5750 0x7fc89c1498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc89bfff640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0b5ce0 0x7fc89c15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc89b7fe640 1 -- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0b5ce0 msgr2=0x7fc89c15e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc89b7fe640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0b5ce0 0x7fc89c15e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc89b7fe640 1 -- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c0b5750 msgr2=0x7fc89c1498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc89b7fe640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c0b5750 0x7fc89c1498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc89b7fe640 1 -- 172.21.15.146:0/836468168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89c0d2960 con 0x7fc89c0b3b60 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc89b7fe640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b3b60 0x7fc89c0d2420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c3a0 tx=0x7fc88c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc883fff640 1 -- 172.21.15.146:0/836468168 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c017070 con 0x7fc89c0b3b60 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc8a1a70640 1 -- 172.21.15.146:0/836468168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89c149df0 con 0x7fc89c0b3b60 2024-09-17T03:33:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc883fff640 1 -- 172.21.15.146:0/836468168 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc88c0053c0 con 0x7fc89c0b3b60 2024-09-17T03:33:13.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc883fff640 1 -- 172.21.15.146:0/836468168 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c003850 con 0x7fc89c0b3b60 2024-09-17T03:33:13.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.559+0000 7fc8a1a70640 1 -- 172.21.15.146:0/836468168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89c1f6c60 con 0x7fc89c0b3b60 2024-09-17T03:33:13.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.560+0000 7fc8a1a70640 1 -- 172.21.15.146:0/836468168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc89c1f6a50 con 0x7fc89c0b3b60 2024-09-17T03:33:13.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.561+0000 7fc883fff640 1 -- 172.21.15.146:0/836468168 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc88c01a070 con 0x7fc89c0b3b60 2024-09-17T03:33:13.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.562+0000 7fc883fff640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc888078b90 0x7fc88807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.562+0000 7fc883fff640 1 -- 172.21.15.146:0/836468168 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc88c09a1c0 con 0x7fc89c0b3b60 2024-09-17T03:33:13.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.562+0000 7fc89affd640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc888078b90 0x7fc88807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.562+0000 7fc89affd640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc888078b90 0x7fc88807b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc89c071a50 tx=0x7fc890005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:13.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.566+0000 7fc883fff640 1 -- 172.21.15.146:0/836468168 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc89c0b3f70 con 0x7fc89c0b3b60 2024-09-17T03:33:13.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.777+0000 7fc8a1a70640 1 -- 172.21.15.146:0/836468168 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc89c15caa0 con 0x7fc89c0b3b60 2024-09-17T03:33:13.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.778+0000 7fc883fff640 1 -- 172.21.15.146:0/836468168 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc88c062580 con 0x7fc89c0b3b60 2024-09-17T03:33:13.778 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:13.778 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T03:33:13.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 -- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc888078b90 msgr2=0x7fc88807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc888078b90 0x7fc88807b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc89c071a50 tx=0x7fc890005f90 comp rx=0 tx=0).stop 2024-09-17T03:33:13.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 -- 172.21.15.146:0/836468168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b3b60 msgr2=0x7fc89c0d2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b3b60 0x7fc89c0d2420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c3a0 tx=0x7fc88c00c860 comp rx=0 tx=0).stop 2024-09-17T03:33:13.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 -- 172.21.15.146:0/836468168 shutdown_connections 2024-09-17T03:33:13.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc888078b90 0x7fc88807b0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc89c0b5ce0 0x7fc89c15e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc89c0b5750 0x7fc89c1498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 --2- 172.21.15.146:0/836468168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc89c0b3b60 0x7fc89c0d2420 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 -- 172.21.15.146:0/836468168 >> 172.21.15.146:0/836468168 conn(0x7fc89c0b7b20 msgr2=0x7fc89c070960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:13.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 -- 172.21.15.146:0/836468168 shutdown_connections 2024-09-17T03:33:13.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.780+0000 7fc8a1a70640 1 -- 172.21.15.146:0/836468168 wait complete. 2024-09-17T03:33:13.791 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T03:33:13.792 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:33:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.905+0000 7f773e798640 1 -- 172.21.15.146:0/141398208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380b3b60 msgr2=0x7f773815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.905+0000 7f773e798640 1 --2- 172.21.15.146:0/141398208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380b3b60 0x7f773815caa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7730005fd0 tx=0x7f773002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.905+0000 7f773e798640 1 -- 172.21.15.146:0/141398208 shutdown_connections 2024-09-17T03:33:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.905+0000 7f773e798640 1 --2- 172.21.15.146:0/141398208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380b3b60 0x7f773815caa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.905+0000 7f773e798640 1 --2- 172.21.15.146:0/141398208 >> v2:172.21.15.179:3300/0 conn(0x7f77380b5750 0x7f77380b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.905+0000 7f773e798640 1 -- 172.21.15.146:0/141398208 >> 172.21.15.146:0/141398208 conn(0x7f77380b7b20 msgr2=0x7f773809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.905+0000 7f773e798640 1 -- 172.21.15.146:0/141398208 shutdown_connections 2024-09-17T03:33:13.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.905+0000 7f773e798640 1 -- 172.21.15.146:0/141398208 wait complete. 2024-09-17T03:33:13.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.907+0000 7f773e798640 1 Processor -- start 2024-09-17T03:33:13.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.907+0000 7f773e798640 1 -- start start 2024-09-17T03:33:13.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773e798640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77380b3b60 0x7f77381f7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773e798640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380b5750 0x7f7738146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773e798640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77380b5ce0 0x7f773815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773e798640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f773815d4b0 con 0x7f77380b5ce0 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773e798640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f773815d330 con 0x7f77380b3b60 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773e798640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f773815d630 con 0x7f77380b5750 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773cd35640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77380b5ce0 0x7f773815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773cd35640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77380b5ce0 0x7f773815ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50790/0 (socket says 172.21.15.146:50790) 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773cd35640 1 -- 172.21.15.146:0/1579718427 learned_addr learned my addr 172.21.15.146:0/1579718427 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f77377fe640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380b5750 0x7f7738146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f7737fff640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77380b3b60 0x7f77381f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773cd35640 1 -- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380b5750 msgr2=0x7f7738146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773cd35640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380b5750 0x7f7738146960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773cd35640 1 -- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77380b3b60 msgr2=0x7f77381f7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773cd35640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77380b3b60 0x7f77381f7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773cd35640 1 -- 172.21.15.146:0/1579718427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77381f3a70 con 0x7f77380b5ce0 2024-09-17T03:33:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f773cd35640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77380b5ce0 0x7f773815ed40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7730009cd0 tx=0x7f7730031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:13.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.909+0000 7f7734ff9640 1 -- 172.21.15.146:0/1579718427 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730031990 con 0x7f77380b5ce0 2024-09-17T03:33:13.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.910+0000 7f7734ff9640 1 -- 172.21.15.146:0/1579718427 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7730031c20 con 0x7f77380b5ce0 2024-09-17T03:33:13.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.910+0000 7f7734ff9640 1 -- 172.21.15.146:0/1579718427 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77300330d0 con 0x7f77380b5ce0 2024-09-17T03:33:13.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.910+0000 7f773e798640 1 -- 172.21.15.146:0/1579718427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77381f3d50 con 0x7f77380b5ce0 2024-09-17T03:33:13.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.910+0000 7f773e798640 1 -- 172.21.15.146:0/1579718427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77381f4310 con 0x7f77380b5ce0 2024-09-17T03:33:13.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.911+0000 7f773e798640 1 -- 172.21.15.146:0/1579718427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f773815dae0 con 0x7f77380b5ce0 2024-09-17T03:33:13.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.911+0000 7f7734ff9640 1 -- 172.21.15.146:0/1579718427 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7730033270 con 0x7f77380b5ce0 2024-09-17T03:33:13.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.912+0000 7f7734ff9640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7724078b90 0x7f772407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:13.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.912+0000 7f7734ff9640 1 -- 172.21.15.146:0/1579718427 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f77300bbe80 con 0x7f77380b5ce0 2024-09-17T03:33:13.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.912+0000 7f7737fff640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7724078b90 0x7f772407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:13.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.913+0000 7f7737fff640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7724078b90 0x7f772407b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7728001720 tx=0x7f7728007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:13.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:13.917+0000 7f7734ff9640 1 -- 172.21.15.146:0/1579718427 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f773004a030 con 0x7f77380b5ce0 2024-09-17T03:33:14.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.126+0000 7f773e798640 1 -- 172.21.15.146:0/1579718427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77380b65b0 con 0x7f77380b5ce0 2024-09-17T03:33:14.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.126+0000 7f7734ff9640 1 -- 172.21.15.146:0/1579718427 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5223 (secure 0 0 0) 0x7f773003f030 con 0x7f77380b5ce0 2024-09-17T03:33:14.126 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:14.127 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":6,"btime":"2024-09-17T03:33:02:765358+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/771934087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":771934087},{"type":"v1","addr":"172.21.15.179:6837","nonce":771934087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/580111663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":580111663},{"type":"v1","addr":"172.21.15.146:6834","nonce":580111663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3998700466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3998700466},{"type":"v1","addr":"172.21.15.146:6835","nonce":3998700466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:33:00.100864+0000","modified":"2024-09-17T03:33:02.117833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3419525644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3419525644},{"type":"v1","addr":"172.21.15.179:6835","nonce":3419525644}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4396,"qdb_cluster":[4396]},"id":1}]} 2024-09-17T03:33:14.127 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 6 2024-09-17T03:33:14.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.128+0000 7f773e798640 1 -- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7724078b90 msgr2=0x7f772407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.128+0000 7f773e798640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7724078b90 0x7f772407b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7728001720 tx=0x7f7728007e90 comp rx=0 tx=0).stop 2024-09-17T03:33:14.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.128+0000 7f773e798640 1 -- 172.21.15.146:0/1579718427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77380b5ce0 msgr2=0x7f773815ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.128+0000 7f773e798640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77380b5ce0 0x7f773815ed40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7730009cd0 tx=0x7f7730031700 comp rx=0 tx=0).stop 2024-09-17T03:33:14.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.129+0000 7f773e798640 1 -- 172.21.15.146:0/1579718427 shutdown_connections 2024-09-17T03:33:14.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.129+0000 7f773e798640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7724078b90 0x7f772407b0a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.129+0000 7f773e798640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77380b5ce0 0x7f773815ed40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.129+0000 7f773e798640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77380b5750 0x7f7738146960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.129+0000 7f773e798640 1 --2- 172.21.15.146:0/1579718427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77380b3b60 0x7f77381f7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.129+0000 7f773e798640 1 -- 172.21.15.146:0/1579718427 >> 172.21.15.146:0/1579718427 conn(0x7f77380b7b20 msgr2=0x7f7738155c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:14.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.129+0000 7f773e798640 1 -- 172.21.15.146:0/1579718427 shutdown_connections 2024-09-17T03:33:14.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.129+0000 7f773e798640 1 -- 172.21.15.146:0/1579718427 wait complete. 2024-09-17T03:33:14.140 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:33:14.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.252+0000 7fb456c4d640 1 -- 172.21.15.146:0/3168015133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45015c8e0 msgr2=0x7fb45006f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.252+0000 7fb456c4d640 1 --2- 172.21.15.146:0/3168015133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45015c8e0 0x7fb45006f580 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb4500b45d0 tx=0x7fb44002a890 comp rx=0 tx=0).stop 2024-09-17T03:33:14.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.252+0000 7fb456c4d640 1 -- 172.21.15.146:0/3168015133 shutdown_connections 2024-09-17T03:33:14.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.252+0000 7fb456c4d640 1 --2- 172.21.15.146:0/3168015133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45015c8e0 0x7fb45006f580 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.252+0000 7fb456c4d640 1 -- 172.21.15.146:0/3168015133 >> 172.21.15.146:0/3168015133 conn(0x7fb4500b3150 msgr2=0x7fb4500b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:14.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.252+0000 7fb456c4d640 1 -- 172.21.15.146:0/3168015133 shutdown_connections 2024-09-17T03:33:14.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.252+0000 7fb456c4d640 1 -- 172.21.15.146:0/3168015133 wait complete. 2024-09-17T03:33:14.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.254+0000 7fb456c4d640 1 Processor -- start 2024-09-17T03:33:14.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.254+0000 7fb456c4d640 1 -- start start 2024-09-17T03:33:14.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.255+0000 7fb456c4d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4500cd840 0x7fb450141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.255+0000 7fb456c4d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4500cdc50 0x7fb450150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.255+0000 7fb456c4d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45015c8e0 0x7fb450151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.255+0000 7fb456c4d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb450073700 con 0x7fb45015c8e0 2024-09-17T03:33:14.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.255+0000 7fb456c4d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb450073580 con 0x7fb4500cdc50 2024-09-17T03:33:14.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.255+0000 7fb456c4d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb450073880 con 0x7fb4500cd840 2024-09-17T03:33:14.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb4551ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45015c8e0 0x7fb450151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb4551ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45015c8e0 0x7fb450151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50822/0 (socket says 172.21.15.146:50822) 2024-09-17T03:33:14.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb4551ea640 1 -- 172.21.15.146:0/2195565977 learned_addr learned my addr 172.21.15.146:0/2195565977 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:14.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb44ffff640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4500cdc50 0x7fb450150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb4549e9640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4500cd840 0x7fb450141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb4551ea640 1 -- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4500cd840 msgr2=0x7fb450141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb4551ea640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4500cd840 0x7fb450141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb4551ea640 1 -- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4500cdc50 msgr2=0x7fb450150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb4551ea640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4500cdc50 0x7fb450150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb4551ea640 1 -- 172.21.15.146:0/2195565977 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4501f6b20 con 0x7fb45015c8e0 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb4551ea640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45015c8e0 0x7fb450151490 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb44800c3c0 tx=0x7fb44800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb44d7fa640 1 -- 172.21.15.146:0/2195565977 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448017070 con 0x7fb45015c8e0 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb44d7fa640 1 -- 172.21.15.146:0/2195565977 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4480053c0 con 0x7fb45015c8e0 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb456c4d640 1 -- 172.21.15.146:0/2195565977 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4501f6840 con 0x7fb45015c8e0 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb44d7fa640 1 -- 172.21.15.146:0/2195565977 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448003850 con 0x7fb45015c8e0 2024-09-17T03:33:14.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.256+0000 7fb456c4d640 1 -- 172.21.15.146:0/2195565977 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4501e4050 con 0x7fb45015c8e0 2024-09-17T03:33:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.257+0000 7fb456c4d640 1 -- 172.21.15.146:0/2195565977 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb450073d30 con 0x7fb45015c8e0 2024-09-17T03:33:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.258+0000 7fb44d7fa640 1 -- 172.21.15.146:0/2195565977 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb44801a070 con 0x7fb45015c8e0 2024-09-17T03:33:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.258+0000 7fb44d7fa640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb43c078bc0 0x7fb43c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.258+0000 7fb44d7fa640 1 -- 172.21.15.146:0/2195565977 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb448099fc0 con 0x7fb45015c8e0 2024-09-17T03:33:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.259+0000 7fb4549e9640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb43c078bc0 0x7fb43c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.259+0000 7fb4549e9640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb43c078bc0 0x7fb43c07b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb440034000 tx=0x7fb440004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:14.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.263+0000 7fb44d7fa640 1 -- 172.21.15.146:0/2195565977 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb448061f00 con 0x7fb45015c8e0 2024-09-17T03:33:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.472+0000 7fb456c4d640 1 -- 172.21.15.146:0/2195565977 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb450070f00 con 0x7fb45015c8e0 2024-09-17T03:33:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.473+0000 7fb44d7fa640 1 -- 172.21.15.146:0/2195565977 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5223 (secure 0 0 0) 0x7fb448066930 con 0x7fb45015c8e0 2024-09-17T03:33:14.473 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:14.473 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":6,"btime":"2024-09-17T03:33:02:765358+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/771934087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":771934087},{"type":"v1","addr":"172.21.15.179:6837","nonce":771934087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/580111663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":580111663},{"type":"v1","addr":"172.21.15.146:6834","nonce":580111663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3998700466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3998700466},{"type":"v1","addr":"172.21.15.146:6835","nonce":3998700466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:33:00.100864+0000","modified":"2024-09-17T03:33:02.117833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3419525644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3419525644},{"type":"v1","addr":"172.21.15.179:6835","nonce":3419525644}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4396,"qdb_cluster":[4396]},"id":1}]} 2024-09-17T03:33:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 6 2024-09-17T03:33:14.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 -- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb43c078bc0 msgr2=0x7fb43c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb43c078bc0 0x7fb43c07b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb440034000 tx=0x7fb440004ab0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 -- 172.21.15.146:0/2195565977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45015c8e0 msgr2=0x7fb450151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45015c8e0 0x7fb450151490 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb44800c3c0 tx=0x7fb44800c880 comp rx=0 tx=0).stop 2024-09-17T03:33:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 -- 172.21.15.146:0/2195565977 shutdown_connections 2024-09-17T03:33:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb43c078bc0 0x7fb43c07b0d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45015c8e0 0x7fb450151490 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4500cdc50 0x7fb450150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 --2- 172.21.15.146:0/2195565977 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4500cd840 0x7fb450141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 -- 172.21.15.146:0/2195565977 >> 172.21.15.146:0/2195565977 conn(0x7fb4500b3150 msgr2=0x7fb4500b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 -- 172.21.15.146:0/2195565977 shutdown_connections 2024-09-17T03:33:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.475+0000 7fb456c4d640 1 -- 172.21.15.146:0/2195565977 wait complete. 2024-09-17T03:33:14.487 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.599+0000 7f4cd05da640 1 -- 172.21.15.146:0/1467307651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc80b5ce0 msgr2=0x7f4cc80b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.599+0000 7f4cd05da640 1 --2- 172.21.15.146:0/1467307651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc80b5ce0 0x7f4cc80b1320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8005fd0 tx=0x7f4cb802aa00 comp rx=0 tx=0).stop 2024-09-17T03:33:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.599+0000 7f4cd05da640 1 -- 172.21.15.146:0/1467307651 shutdown_connections 2024-09-17T03:33:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.599+0000 7f4cd05da640 1 --2- 172.21.15.146:0/1467307651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc80b3d30 0x7f4cc815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.599+0000 7f4cd05da640 1 --2- 172.21.15.146:0/1467307651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc80b5ce0 0x7f4cc80b1320 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.599+0000 7f4cd05da640 1 -- 172.21.15.146:0/1467307651 >> 172.21.15.146:0/1467307651 conn(0x7f4cc80b7b20 msgr2=0x7f4cc809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.599+0000 7f4cd05da640 1 -- 172.21.15.146:0/1467307651 shutdown_connections 2024-09-17T03:33:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.599+0000 7f4cd05da640 1 -- 172.21.15.146:0/1467307651 wait complete. 2024-09-17T03:33:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.601+0000 7f4cd05da640 1 Processor -- start 2024-09-17T03:33:14.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.601+0000 7f4cd05da640 1 -- start start 2024-09-17T03:33:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cd05da640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc80b5750 0x7f4cc8147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cd05da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc80b5ce0 0x7f4cc81f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cd05da640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc8150080 0x7f4cc81f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cd05da640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc815d4b0 con 0x7f4cc8150080 2024-09-17T03:33:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cd05da640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc815d330 con 0x7f4cc80b5ce0 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cd05da640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc815d630 con 0x7f4cc80b5750 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cceb77640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc8150080 0x7f4cc81f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cce376640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc80b5750 0x7f4cc8147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cce376640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc80b5750 0x7f4cc8147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:36546/0 (socket says 172.21.15.146:36546) 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cceb77640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc8150080 0x7f4cc81f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50840/0 (socket says 172.21.15.146:50840) 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cce376640 1 -- 172.21.15.146:0/1893826584 learned_addr learned my addr 172.21.15.146:0/1893826584 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4ccdb75640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc80b5ce0 0x7f4cc81f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cceb77640 1 -- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc80b5750 msgr2=0x7f4cc8147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cceb77640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc80b5750 0x7f4cc8147ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cceb77640 1 -- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc80b5ce0 msgr2=0x7f4cc81f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cceb77640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc80b5ce0 0x7f4cc81f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.602+0000 7f4cceb77640 1 -- 172.21.15.146:0/1893826584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc81548e0 con 0x7f4cc8150080 2024-09-17T03:33:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.603+0000 7f4cceb77640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc8150080 0x7f4cc81f4c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000c710 tx=0x7f4cc000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:14.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.603+0000 7f4cc6ffd640 1 -- 172.21.15.146:0/1893826584 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0004220 con 0x7f4cc8150080 2024-09-17T03:33:14.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.603+0000 7f4cc6ffd640 1 -- 172.21.15.146:0/1893826584 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cc00077a0 con 0x7f4cc8150080 2024-09-17T03:33:14.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.603+0000 7f4cd05da640 1 -- 172.21.15.146:0/1893826584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc8154bc0 con 0x7f4cc8150080 2024-09-17T03:33:14.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.603+0000 7f4cc6ffd640 1 -- 172.21.15.146:0/1893826584 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0007bd0 con 0x7f4cc8150080 2024-09-17T03:33:14.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.603+0000 7f4cd05da640 1 -- 172.21.15.146:0/1893826584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc8155180 con 0x7f4cc8150080 2024-09-17T03:33:14.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.604+0000 7f4cd05da640 1 -- 172.21.15.146:0/1893826584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc8154650 con 0x7f4cc8150080 2024-09-17T03:33:14.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.605+0000 7f4cc6ffd640 1 -- 172.21.15.146:0/1893826584 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4cc00035f0 con 0x7f4cc8150080 2024-09-17T03:33:14.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.605+0000 7f4cc6ffd640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb4078b90 0x7f4cb407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.605+0000 7f4cc6ffd640 1 -- 172.21.15.146:0/1893826584 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4cc009afb0 con 0x7f4cc8150080 2024-09-17T03:33:14.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.605+0000 7f4cce376640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb4078b90 0x7f4cb407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.606+0000 7f4cce376640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb4078b90 0x7f4cb407b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80094e0 tx=0x7f4cb803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:14.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.609+0000 7f4cc6ffd640 1 -- 172.21.15.146:0/1893826584 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4cc0014030 con 0x7f4cc8150080 2024-09-17T03:33:14.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.785+0000 7f4cd05da640 1 -- 172.21.15.146:0/1893826584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cc815bc20 con 0x7f4cc8150080 2024-09-17T03:33:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.786+0000 7f4cc6ffd640 1 -- 172.21.15.146:0/1893826584 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7f4cc0062da0 con 0x7f4cc8150080 2024-09-17T03:33:14.787 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:14.787 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:01.757648+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:32:57.968580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:32:59.068488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 -- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb4078b90 msgr2=0x7f4cb407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb4078b90 0x7f4cb407b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80094e0 tx=0x7f4cb803b040 comp rx=0 tx=0).stop 2024-09-17T03:33:14.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 -- 172.21.15.146:0/1893826584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc8150080 msgr2=0x7f4cc81f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc8150080 0x7f4cc81f4c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000c710 tx=0x7f4cc000cbd0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 -- 172.21.15.146:0/1893826584 shutdown_connections 2024-09-17T03:33:14.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb4078b90 0x7f4cb407b0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc8150080 0x7f4cc81f4c50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc80b5ce0 0x7f4cc81f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 --2- 172.21.15.146:0/1893826584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc80b5750 0x7f4cc8147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 -- 172.21.15.146:0/1893826584 >> 172.21.15.146:0/1893826584 conn(0x7f4cc80b7b20 msgr2=0x7f4cc81596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:14.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 -- 172.21.15.146:0/1893826584 shutdown_connections 2024-09-17T03:33:14.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.789+0000 7f4cd05da640 1 -- 172.21.15.146:0/1893826584 wait complete. 2024-09-17T03:33:14.802 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:33:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.915+0000 7fe213225640 1 -- 172.21.15.146:0/2995100058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c0b7c20 msgr2=0x7fe20c0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.915+0000 7fe213225640 1 --2- 172.21.15.146:0/2995100058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c0b7c20 0x7fe20c0ccbd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0cebc0 tx=0x7fe20002a560 comp rx=0 tx=0).stop 2024-09-17T03:33:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.915+0000 7fe213225640 1 -- 172.21.15.146:0/2995100058 shutdown_connections 2024-09-17T03:33:14.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.915+0000 7fe213225640 1 --2- 172.21.15.146:0/2995100058 >> v2:172.21.15.179:3300/0 conn(0x7fe20c160990 0x7fe20c0d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.915+0000 7fe213225640 1 --2- 172.21.15.146:0/2995100058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20c0c78a0 0x7fe20c160450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.915+0000 7fe213225640 1 --2- 172.21.15.146:0/2995100058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c0b7c20 0x7fe20c0ccbd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.915+0000 7fe213225640 1 -- 172.21.15.146:0/2995100058 >> 172.21.15.146:0/2995100058 conn(0x7fe20c0b4190 msgr2=0x7fe20c0b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.915+0000 7fe213225640 1 -- 172.21.15.146:0/2995100058 shutdown_connections 2024-09-17T03:33:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.915+0000 7fe213225640 1 -- 172.21.15.146:0/2995100058 wait complete. 2024-09-17T03:33:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.917+0000 7fe213225640 1 Processor -- start 2024-09-17T03:33:14.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.917+0000 7fe213225640 1 -- start start 2024-09-17T03:33:14.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.918+0000 7fe213225640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20c0b7c20 0x7fe20c1f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.918+0000 7fe213225640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe20c0c78a0 0x7fe20c1f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.918+0000 7fe213225640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c160990 0x7fe20c1f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.918+0000 7fe213225640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe20c15cc60 con 0x7fe20c160990 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.918+0000 7fe213225640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe20c0cd110 con 0x7fe20c0c78a0 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.918+0000 7fe213225640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe20c0d17d0 con 0x7fe20c0b7c20 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.918+0000 7fe2117c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c160990 0x7fe20c1f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.918+0000 7fe2117c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c160990 0x7fe20c1f6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50868/0 (socket says 172.21.15.146:50868) 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.918+0000 7fe2117c2640 1 -- 172.21.15.146:0/2762974213 learned_addr learned my addr 172.21.15.146:0/2762974213 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.918+0000 7fe20bfff640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe20c0c78a0 0x7fe20c1f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.918+0000 7fe210fc1640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20c0b7c20 0x7fe20c1f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.919+0000 7fe2117c2640 1 -- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20c0b7c20 msgr2=0x7fe20c1f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.919+0000 7fe2117c2640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20c0b7c20 0x7fe20c1f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.919+0000 7fe2117c2640 1 -- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe20c0c78a0 msgr2=0x7fe20c1f07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.919+0000 7fe2117c2640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe20c0c78a0 0x7fe20c1f07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:14.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.919+0000 7fe2117c2640 1 -- 172.21.15.146:0/2762974213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20c147570 con 0x7fe20c160990 2024-09-17T03:33:14.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.919+0000 7fe2117c2640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c160990 0x7fe20c1f6c00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe20400cb00 tx=0x7fe20400a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:14.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.919+0000 7fe2097fa640 1 -- 172.21.15.146:0/2762974213 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20400ae30 con 0x7fe20c160990 2024-09-17T03:33:14.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.919+0000 7fe2097fa640 1 -- 172.21.15.146:0/2762974213 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe20400f450 con 0x7fe20c160990 2024-09-17T03:33:14.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.919+0000 7fe213225640 1 -- 172.21.15.146:0/2762974213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe20c1f4370 con 0x7fe20c160990 2024-09-17T03:33:14.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.919+0000 7fe2097fa640 1 -- 172.21.15.146:0/2762974213 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20400f8c0 con 0x7fe20c160990 2024-09-17T03:33:14.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.919+0000 7fe213225640 1 -- 172.21.15.146:0/2762974213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe20c0caa10 con 0x7fe20c160990 2024-09-17T03:33:14.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.920+0000 7fe213225640 1 -- 172.21.15.146:0/2762974213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe20c1f40e0 con 0x7fe20c160990 2024-09-17T03:33:14.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.921+0000 7fe2097fa640 1 -- 172.21.15.146:0/2762974213 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe20400fa60 con 0x7fe20c160990 2024-09-17T03:33:14.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.921+0000 7fe2097fa640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078b90 0x7fe1f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:14.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.922+0000 7fe2097fa640 1 -- 172.21.15.146:0/2762974213 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe20409b680 con 0x7fe20c160990 2024-09-17T03:33:14.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.922+0000 7fe210fc1640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078b90 0x7fe1f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:14.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.922+0000 7fe210fc1640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078b90 0x7fe1f007b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe200033000 tx=0x7fe200004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:14.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:14.926+0000 7fe2097fa640 1 -- 172.21.15.146:0/2762974213 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe204014030 con 0x7fe20c160990 2024-09-17T03:33:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.134+0000 7fe213225640 1 -- 172.21.15.146:0/2762974213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe20c075390 con 0x7fe20c160990 2024-09-17T03:33:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.135+0000 7fe2097fa640 1 -- 172.21.15.146:0/2762974213 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5223 (secure 0 0 0) 0x7fe204063470 con 0x7fe20c160990 2024-09-17T03:33:15.135 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:15.135 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":6,"btime":"2024-09-17T03:33:02:765358+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/771934087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":771934087},{"type":"v1","addr":"172.21.15.179:6837","nonce":771934087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/580111663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":580111663},{"type":"v1","addr":"172.21.15.146:6834","nonce":580111663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3998700466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3998700466},{"type":"v1","addr":"172.21.15.146:6835","nonce":3998700466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:33:00.100864+0000","modified":"2024-09-17T03:33:02.117833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3419525644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3419525644},{"type":"v1","addr":"172.21.15.179:6835","nonce":3419525644}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4396,"qdb_cluster":[4396]},"id":1}]} 2024-09-17T03:33:15.136 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 6 2024-09-17T03:33:15.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 -- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078b90 msgr2=0x7fe1f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:15.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078b90 0x7fe1f007b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe200033000 tx=0x7fe200004730 comp rx=0 tx=0).stop 2024-09-17T03:33:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 -- 172.21.15.146:0/2762974213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c160990 msgr2=0x7fe20c1f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c160990 0x7fe20c1f6c00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe20400cb00 tx=0x7fe20400a250 comp rx=0 tx=0).stop 2024-09-17T03:33:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 -- 172.21.15.146:0/2762974213 shutdown_connections 2024-09-17T03:33:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078b90 0x7fe1f007b0a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c160990 0x7fe20c1f6c00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe20c0c78a0 0x7fe20c1f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 --2- 172.21.15.146:0/2762974213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe20c0b7c20 0x7fe20c1f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 -- 172.21.15.146:0/2762974213 >> 172.21.15.146:0/2762974213 conn(0x7fe20c0b4190 msgr2=0x7fe20c070840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 -- 172.21.15.146:0/2762974213 shutdown_connections 2024-09-17T03:33:15.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.137+0000 7fe213225640 1 -- 172.21.15.146:0/2762974213 wait complete. 2024-09-17T03:33:15.552 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:33:00.100864+0000', 'modified': '2024-09-17T03:33:02.117833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4396}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4396': {'gid': 4396, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6835/3419525644', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 3419525644}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 3419525644}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4396, 'qdb_cluster': [4396]} 2024-09-17T03:33:15.552 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:33:15.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:33:15.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.668+0000 7f5c15284640 1 -- 172.21.15.146:0/1572902914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c100b3870 msgr2=0x7f5c100cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:15.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.668+0000 7f5c15284640 1 --2- 172.21.15.146:0/1572902914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c100b3870 0x7f5c100cf370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5c00005fd0 tx=0x7f5c0002a540 comp rx=0 tx=0).stop 2024-09-17T03:33:15.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.668+0000 7f5c15284640 1 -- 172.21.15.146:0/1572902914 shutdown_connections 2024-09-17T03:33:15.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.668+0000 7f5c15284640 1 --2- 172.21.15.146:0/1572902914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c101620f0 0x7f5c1006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.668+0000 7f5c15284640 1 --2- 172.21.15.146:0/1572902914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c100b3870 0x7f5c100cf370 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.668+0000 7f5c15284640 1 -- 172.21.15.146:0/1572902914 >> 172.21.15.146:0/1572902914 conn(0x7f5c100d4be0 msgr2=0x7f5c100d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:15.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.668+0000 7f5c15284640 1 -- 172.21.15.146:0/1572902914 shutdown_connections 2024-09-17T03:33:15.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.668+0000 7f5c15284640 1 -- 172.21.15.146:0/1572902914 wait complete. 2024-09-17T03:33:15.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.670+0000 7f5c15284640 1 Processor -- start 2024-09-17T03:33:15.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.670+0000 7f5c15284640 1 -- start start 2024-09-17T03:33:15.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c15284640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c1006f270 0x7f5c100cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c15284640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c100b3870 0x7f5c100ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c15284640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c101620f0 0x7f5c101f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c15284640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5c100d43b0 con 0x7f5c101620f0 2024-09-17T03:33:15.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c15284640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5c10162fb0 con 0x7f5c100b3870 2024-09-17T03:33:15.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c15284640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5c100ce0a0 con 0x7f5c1006f270 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c0f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c101620f0 0x7f5c101f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c0f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c101620f0 0x7f5c101f6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50878/0 (socket says 172.21.15.146:50878) 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c0f7fe640 1 -- 172.21.15.146:0/1675889390 learned_addr learned my addr 172.21.15.146:0/1675889390 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c0effd640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c1006f270 0x7f5c100cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c0e7fc640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c100b3870 0x7f5c100ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c0f7fe640 1 -- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c1006f270 msgr2=0x7f5c100cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c0f7fe640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c1006f270 0x7f5c100cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c0f7fe640 1 -- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c100b3870 msgr2=0x7f5c100ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c0f7fe640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c100b3870 0x7f5c100ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c0f7fe640 1 -- 172.21.15.146:0/1675889390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c101f6ab0 con 0x7f5c101620f0 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c0f7fe640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c101620f0 0x7f5c101f6570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800c730 tx=0x7f5c0800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:15.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5bf77fe640 1 -- 172.21.15.146:0/1675889390 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08017070 con 0x7f5c101620f0 2024-09-17T03:33:15.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5bf77fe640 1 -- 172.21.15.146:0/1675889390 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c08003c60 con 0x7f5c101620f0 2024-09-17T03:33:15.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c15284640 1 -- 172.21.15.146:0/1675889390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c100cb940 con 0x7f5c101620f0 2024-09-17T03:33:15.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5bf77fe640 1 -- 172.21.15.146:0/1675889390 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c080052d0 con 0x7f5c101620f0 2024-09-17T03:33:15.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.672+0000 7f5c15284640 1 -- 172.21.15.146:0/1675889390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c100cbbe0 con 0x7f5c101620f0 2024-09-17T03:33:15.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.675+0000 7f5bf77fe640 1 -- 172.21.15.146:0/1675889390 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c0801a070 con 0x7f5c101620f0 2024-09-17T03:33:15.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.675+0000 7f5bf77fe640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bfc078b90 0x7f5bfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.675+0000 7f5bf77fe640 1 -- 172.21.15.146:0/1675889390 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5c0809a530 con 0x7f5c101620f0 2024-09-17T03:33:15.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.676+0000 7f5c0effd640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bfc078b90 0x7f5bfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.676+0000 7f5c1c1ee740 1 Processor -- start 2024-09-17T03:33:15.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.676+0000 7f5c0effd640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bfc078b90 0x7f5bfc07b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c00033000 tx=0x7f5c00004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:15.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.676+0000 7f5c1c1ee740 1 -- start start 2024-09-17T03:33:15.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a284d270 0x55d2a2c1efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a28243b0 0x55d2a2c1f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c3c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d2a2b67820 con 0x55d2a282c590 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d2a2b56c50 con 0x55d2a284d270 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d2a2b5aa60 con 0x55d2a28243b0 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c0f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c3c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c0f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c3c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50888/0 (socket says 172.21.15.146:50888) 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c0f7fe640 1 -- 172.21.15.146:0/797196599 learned_addr learned my addr 172.21.15.146:0/797196599 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c0effd640 1 --2- 172.21.15.146:0/797196599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a284d270 0x55d2a2c1efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c0e7fc640 1 --2- 172.21.15.146:0/797196599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a28243b0 0x55d2a2c1f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c0f7fe640 1 -- 172.21.15.146:0/797196599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a28243b0 msgr2=0x55d2a2c1f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c0f7fe640 1 --2- 172.21.15.146:0/797196599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a28243b0 0x55d2a2c1f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c0f7fe640 1 -- 172.21.15.146:0/797196599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a284d270 msgr2=0x55d2a2c1efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:15.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c0f7fe640 1 --2- 172.21.15.146:0/797196599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a284d270 0x55d2a2c1efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c0f7fe640 1 -- 172.21.15.146:0/797196599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2a28b8850 con 0x55d2a282c590 2024-09-17T03:33:15.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5c0f7fe640 1 --2- 172.21.15.146:0/797196599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c3c3e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800c700 tx=0x7f5c08061a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37b02f71416a9d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:15.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5bf4ff9640 1 -- 172.21.15.146:0/797196599 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08062300 con 0x55d2a282c590 2024-09-17T03:33:15.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5bf4ff9640 1 -- 172.21.15.146:0/797196599 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c08066de0 con 0x55d2a282c590 2024-09-17T03:33:15.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.678+0000 7f5bf4ff9640 1 -- 172.21.15.146:0/797196599 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0806bc90 con 0x55d2a282c590 2024-09-17T03:33:15.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.679+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/797196599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 msgr2=0x55d2a2c3c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:15.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.679+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/797196599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c3c3e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800c700 tx=0x7f5c08061a70 comp rx=0 tx=0).stop 2024-09-17T03:33:15.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.679+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/797196599 shutdown_connections 2024-09-17T03:33:15.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.679+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/797196599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c3c3e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.679+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/797196599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a28243b0 0x55d2a2c1f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.679+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/797196599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a284d270 0x55d2a2c1efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.679+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/797196599 >> 172.21.15.146:0/797196599 conn(0x55d2a28413c0 msgr2=0x55d2a2bf5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:15.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.679+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/797196599 shutdown_connections 2024-09-17T03:33:15.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.679+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/797196599 wait complete. 2024-09-17T03:33:15.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.680+0000 7f5c1c1ee740 1 -- start start 2024-09-17T03:33:15.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.680+0000 7f5c1c1ee740 1 Processor -- start 2024-09-17T03:33:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a28243b0 0x55d2a2bf37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c33980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a284d270 0x55d2a2c4c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d2a28c7620 con 0x55d2a282c590 2024-09-17T03:33:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d2a2afc5f0 con 0x55d2a28243b0 2024-09-17T03:33:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d2a2c1fa20 con 0x55d2a284d270 2024-09-17T03:33:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c1c1ee740 10 client.0 _ll_register_callbacks cb 0x55d2a2b000a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:33:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c0e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c33980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c0e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c33980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50904/0 (socket says 172.21.15.146:50904) 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3187137359 learned_addr learned my addr 172.21.15.146:0/3187137359 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c0f7fe640 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a284d270 0x55d2a2c4c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c0effd640 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a28243b0 0x55d2a2bf37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a284d270 msgr2=0x55d2a2c4c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c0e7fc640 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a284d270 0x55d2a2c4c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a28243b0 msgr2=0x55d2a2bf37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c0e7fc640 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a28243b0 0x55d2a2bf37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3187137359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2a292f6b0 con 0x55d2a282c590 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c0e7fc640 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c33980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400d980 tx=0x7f5c0400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a67cf426112a61d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5bedffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5bedffb640 1 -- 172.21.15.146:0/3187137359 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0401b640 con 0x55d2a282c590 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5bedffb640 1 -- 172.21.15.146:0/3187137359 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5c0401b7e0 con 0x55d2a282c590 2024-09-17T03:33:15.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3187137359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c08066de0 con 0x55d2a282c590 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5bedffb640 1 -- 172.21.15.146:0/3187137359 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5c04023050 con 0x55d2a282c590 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c1c1ee740 10 client.4731 fetch_fsmap learned FSMap version 6 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.682+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3187137359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55d2a2bfbd20 con 0x55d2a282c590 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.683+0000 7f5bedffb640 1 -- 172.21.15.146:0/3187137359 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c08066de0 con 0x55d2a282c590 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.683+0000 7f5bedffb640 1 -- 172.21.15.146:0/3187137359 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f5c04026020 con 0x55d2a282c590 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.683+0000 7f5c1c1ee740 10 client.4731 fetch_fsmap finished waiting for FSMap version 6 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.683+0000 7f5c1c1ee740 10 client.4731 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.683+0000 7f5c1c1ee740 20 client.4731 populate_metadata read hostname 'smithi146' 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.683+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:6834/3419525644,v1:172.21.15.179:6835/3419525644] conn(0x55d2a280be40 0x55d2a2bfc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.683+0000 7f5c1c1ee740 4 client.4731 mds_command: new command op to 4396 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.683+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3187137359 --> [v2:172.21.15.179:6834/3419525644,v1:172.21.15.179:6835/3419525644] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2a2b69770 con 0x55d2a280be40 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.683+0000 7f5c0effd640 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:6834/3419525644,v1:172.21.15.179:6835/3419525644] conn(0x55d2a280be40 0x55d2a2bfc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.683+0000 7f5bedffb640 10 client.4731 ms_handle_connect on v2:172.21.15.179:6834/3419525644 2024-09-17T03:33:15.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.683+0000 7f5c0effd640 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:6834/3419525644,v1:172.21.15.179:6835/3419525644] conn(0x55d2a280be40 0x55d2a2bfc490 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61ee25b9ac2680d1 server_cookie=83339c14d5cbed8c in_seq=0 out_seq=0 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5bedffb640 1 -- 172.21.15.146:0/3187137359 <== mds.0 v2:172.21.15.179:6834/3419525644 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2a2b69770 con 0x55d2a280be40 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5bedffb640 10 client.4731 handle_command_reply: tid=0 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5c1c1ee740 1 client.4731 shutdown 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3187137359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 msgr2=0x55d2a2c33980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c33980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400d980 tx=0x7f5c0400de40 comp rx=0 tx=0).stop 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3187137359 shutdown_connections 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:6834/3419525644,v1:172.21.15.179:6835/3419525644] conn(0x55d2a280be40 0x55d2a2bfc490 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a284d270 0x55d2a2c4c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c33980 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3187137359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a28243b0 0x55d2a2bf37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5bedffb640 0 client.4731 ms_handle_reset on v2:172.21.15.179:6834/3419525644 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.684+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3187137359 >> 172.21.15.146:0/3187137359 conn(0x55d2a28413c0 msgr2=0x55d2a2bf5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.685+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3187137359 shutdown_connections 2024-09-17T03:33:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.685+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3187137359 wait complete. 2024-09-17T03:33:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.685+0000 7f5c1c1ee740 20 client.4731 trim_cache size 0 max 16384 2024-09-17T03:33:15.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.703+0000 7f5c1c1ee740 1 Processor -- start 2024-09-17T03:33:15.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.703+0000 7f5c1c1ee740 1 -- start start 2024-09-17T03:33:15.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a28243b0 0x55d2a2bee200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c478f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a284d270 0x55d2a2c47e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5c10155110 con 0x55d2a282c590 2024-09-17T03:33:15.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5c10154470 con 0x55d2a28243b0 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5c10154ac0 con 0x55d2a284d270 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c0e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c0e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c478f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50910/0 (socket says 172.21.15.146:50910) 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3020564016 learned_addr learned my addr 172.21.15.146:0/3020564016 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c0effd640 1 --2- 172.21.15.146:0/3020564016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a28243b0 0x55d2a2bee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c0f7fe640 1 --2- 172.21.15.146:0/3020564016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a284d270 0x55d2a2c47e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3020564016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a284d270 msgr2=0x55d2a2c47e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c0e7fc640 1 --2- 172.21.15.146:0/3020564016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a284d270 0x55d2a2c47e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3020564016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a28243b0 msgr2=0x55d2a2bee200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c0e7fc640 1 --2- 172.21.15.146:0/3020564016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a28243b0 0x55d2a2bee200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.704+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3020564016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2a2befb30 con 0x55d2a282c590 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5c0e7fc640 1 --2- 172.21.15.146:0/3020564016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c478f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5c04005e00 tx=0x7f5c04003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183e38bf5906c060 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:15.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5beffff640 1 -- 172.21.15.146:0/3020564016 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0401b640 con 0x55d2a282c590 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5beffff640 1 -- 172.21.15.146:0/3020564016 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c04005070 con 0x55d2a282c590 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5beffff640 1 -- 172.21.15.146:0/3020564016 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04005480 con 0x55d2a282c590 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3020564016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 msgr2=0x55d2a2c478f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3020564016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c478f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5c04005e00 tx=0x7f5c04003ea0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3020564016 shutdown_connections 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3020564016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a284d270 0x55d2a2c47e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3020564016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2c478f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3020564016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a28243b0 0x55d2a2bee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3020564016 >> 172.21.15.146:0/3020564016 conn(0x55d2a28413c0 msgr2=0x55d2a2c2fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3020564016 shutdown_connections 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.705+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3020564016 wait complete. 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.706+0000 7f5c1c1ee740 1 -- start start 2024-09-17T03:33:15.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.706+0000 7f5c1c1ee740 1 Processor -- start 2024-09-17T03:33:15.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a28243b0 0x55d2a2cbd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2ca1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c1c1ee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a284d270 0x55d2a2c1eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d2a2c33ec0 con 0x55d2a282c590 2024-09-17T03:33:15.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d2a2c34670 con 0x55d2a284d270 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c1c1ee740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d2a2c39fa0 con 0x55d2a28243b0 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c1c1ee740 10 client.0 _ll_register_callbacks cb 0x7f5c04004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c0e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2ca1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c0e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2ca1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50914/0 (socket says 172.21.15.146:50914) 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3216892305 learned_addr learned my addr 172.21.15.146:0/3216892305 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c0effd640 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a28243b0 0x55d2a2cbd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c0f7fe640 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a284d270 0x55d2a2c1eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a28243b0 msgr2=0x55d2a2cbd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c0e7fc640 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a28243b0 0x55d2a2cbd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a284d270 msgr2=0x55d2a2c1eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c0e7fc640 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a284d270 0x55d2a2c1eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c0e7fc640 1 -- 172.21.15.146:0/3216892305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2a2cbd900 con 0x55d2a282c590 2024-09-17T03:33:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c0e7fc640 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2ca1280 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5c04003f60 tx=0x7f5c0401b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f03dd49f16f792 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5bedffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5bedffb640 1 -- 172.21.15.146:0/3216892305 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04005430 con 0x55d2a282c590 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5bedffb640 1 -- 172.21.15.146:0/3216892305 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5c040055d0 con 0x55d2a282c590 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.708+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3216892305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c04005070 con 0x55d2a282c590 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5bedffb640 1 -- 172.21.15.146:0/3216892305 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5c0403e050 con 0x55d2a282c590 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5c1c1ee740 10 client.4737 fetch_fsmap learned FSMap version 6 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3216892305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55d2a2c1f440 con 0x55d2a282c590 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5bedffb640 1 -- 172.21.15.146:0/3216892305 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c04005070 con 0x55d2a282c590 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5bedffb640 1 -- 172.21.15.146:0/3216892305 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f5c04041020 con 0x55d2a282c590 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5c1c1ee740 10 client.4737 fetch_fsmap finished waiting for FSMap version 6 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5c1c1ee740 10 client.4737 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5c1c1ee740 20 client.4737 populate_metadata read hostname 'smithi146' 2024-09-17T03:33:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:6834/3419525644,v1:172.21.15.179:6835/3419525644] conn(0x55d2a2c33220 0x55d2a2c33630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5c1c1ee740 4 client.4737 mds_command: new command op to 4396 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3216892305 --> [v2:172.21.15.179:6834/3419525644,v1:172.21.15.179:6835/3419525644] -- command(tid 0: {"prefix": "status"}) -- 0x55d2a2b65220 con 0x55d2a2c33220 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5c0effd640 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:6834/3419525644,v1:172.21.15.179:6835/3419525644] conn(0x55d2a2c33220 0x55d2a2c33630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5bedffb640 10 client.4737 ms_handle_connect on v2:172.21.15.179:6834/3419525644 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.709+0000 7f5c0effd640 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:6834/3419525644,v1:172.21.15.179:6835/3419525644] conn(0x55d2a2c33220 0x55d2a2c33630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5444991d765c154 server_cookie=1bea6a5f0631babf in_seq=0 out_seq=0 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5bedffb640 1 -- 172.21.15.146:0/3216892305 <== mds.0 v2:172.21.15.179:6834/3419525644 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55d2a2b65220 con 0x55d2a2c33220 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5bedffb640 10 client.4737 handle_command_reply: tid=0 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 1 client.4737 shutdown 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3216892305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 msgr2=0x55d2a2ca1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2ca1280 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5c04003f60 tx=0x7f5c0401b670 comp rx=0 tx=0).stop 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3216892305 shutdown_connections 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:6834/3419525644,v1:172.21.15.179:6835/3419525644] conn(0x55d2a2c33220 0x55d2a2c33630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a284d270 0x55d2a2c1eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5bedffb640 0 client.4737 ms_handle_reset on v2:172.21.15.179:6834/3419525644 2024-09-17T03:33:15.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a282c590 0x55d2a2ca1280 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 1 --2- 172.21.15.146:0/3216892305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a28243b0 0x55d2a2cbd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3216892305 >> 172.21.15.146:0/3216892305 conn(0x55d2a28413c0 msgr2=0x55d2a2c478f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:15.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3216892305 shutdown_connections 2024-09-17T03:33:15.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 1 -- 172.21.15.146:0/3216892305 wait complete. 2024-09-17T03:33:15.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c1c1ee740 20 client.4737 trim_cache size 0 max 16384 2024-09-17T03:33:15.716 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4396, 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 14.962453543000001, 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 6, 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 21, 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 21, 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 20.983495885 2024-09-17T03:33:15.717 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:33:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c15284640 1 -- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bfc078b90 msgr2=0x7f5bfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c15284640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bfc078b90 0x7f5bfc07b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c00033000 tx=0x7f5c00004730 comp rx=0 tx=0).stop 2024-09-17T03:33:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c15284640 1 -- 172.21.15.146:0/1675889390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c101620f0 msgr2=0x7f5c101f6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.710+0000 7f5c15284640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c101620f0 0x7f5c101f6570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800c730 tx=0x7f5c0800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.711+0000 7f5c15284640 1 -- 172.21.15.146:0/1675889390 shutdown_connections 2024-09-17T03:33:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.711+0000 7f5c15284640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bfc078b90 0x7f5bfc07b0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.711+0000 7f5c15284640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c101620f0 0x7f5c101f6570 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.711+0000 7f5c15284640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c100b3870 0x7f5c100ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.711+0000 7f5c15284640 1 --2- 172.21.15.146:0/1675889390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c1006f270 0x7f5c100cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.711+0000 7f5c15284640 1 -- 172.21.15.146:0/1675889390 >> 172.21.15.146:0/1675889390 conn(0x7f5c100d4be0 msgr2=0x7f5c101613c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.711+0000 7f5c15284640 1 -- 172.21.15.146:0/1675889390 shutdown_connections 2024-09-17T03:33:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:15.711+0000 7f5c15284640 1 -- 172.21.15.146:0/1675889390 wait complete. 2024-09-17T03:33:15.722 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T03:33:15.748 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T03:33:15.748 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T03:33:15.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:15.748 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:33:15.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:15.765 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-09-17T03:33:15.831 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2024-09-17T03:33:15.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:33:15.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:15.833 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:33:15.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:15.889 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-09-17T03:33:15.955 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2024-09-17T03:33:15.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:33:15.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:15.957 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-17T03:33:15.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:15.977 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-09-17T03:33:16.049 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2024-09-17T03:33:16.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:33:16.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:16.051 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-17T03:33:16.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:16.109 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-09-17T03:33:16.178 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2024-09-17T03:33:16.180 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:33:16.180 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-17T03:33:16.180 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:33:16.180 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:33:16.181 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:33:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.295+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2999812938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0b3870 msgr2=0x7f2e0c0cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.295+0000 7f2e13fe4640 1 --2- 172.21.15.146:0/2999812938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0b3870 0x7f2e0c0cf370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009830 tx=0x7f2e0802a480 comp rx=0 tx=0).stop 2024-09-17T03:33:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.295+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2999812938 shutdown_connections 2024-09-17T03:33:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.295+0000 7f2e13fe4640 1 --2- 172.21.15.146:0/2999812938 >> v2:172.21.15.179:3300/0 conn(0x7f2e0c1620f0 0x7f2e0c06ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.295+0000 7f2e13fe4640 1 --2- 172.21.15.146:0/2999812938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0b3870 0x7f2e0c0cf370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.295+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2999812938 >> 172.21.15.146:0/2999812938 conn(0x7f2e0c0d4be0 msgr2=0x7f2e0c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.295+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2999812938 shutdown_connections 2024-09-17T03:33:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.295+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2999812938 wait complete. 2024-09-17T03:33:16.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.297+0000 7f2e13fe4640 1 Processor -- start 2024-09-17T03:33:16.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.297+0000 7f2e13fe4640 1 -- start start 2024-09-17T03:33:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e13fe4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c06f270 0x7f2e0c0b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e13fe4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0b3870 0x7f2e0c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e13fe4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e0c1620f0 0x7f2e0c0cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e13fe4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c0d43b0 con 0x7f2e0c06f270 2024-09-17T03:33:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e13fe4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c162fb0 con 0x7f2e0c1620f0 2024-09-17T03:33:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e13fe4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0c0ca7f0 con 0x7f2e0c0b3870 2024-09-17T03:33:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e11d80640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c06f270 0x7f2e0c0b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e11d80640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c06f270 0x7f2e0c0b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50930/0 (socket says 172.21.15.146:50930) 2024-09-17T03:33:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e11d80640 1 -- 172.21.15.146:0/2739122416 learned_addr learned my addr 172.21.15.146:0/2739122416 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e1157f640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0b3870 0x7f2e0c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e12581640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e0c1620f0 0x7f2e0c0cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.298+0000 7f2e11d80640 1 -- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0b3870 msgr2=0x7f2e0c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.299+0000 7f2e11d80640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0b3870 0x7f2e0c0ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.299+0000 7f2e11d80640 1 -- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e0c1620f0 msgr2=0x7f2e0c0cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.299+0000 7f2e11d80640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e0c1620f0 0x7f2e0c0cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.299+0000 7f2e11d80640 1 -- 172.21.15.146:0/2739122416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c1f6290 con 0x7f2e0c06f270 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.299+0000 7f2e11d80640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c06f270 0x7f2e0c0b2d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2e0802aa70 tx=0x7f2e08033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.299+0000 7f2e027fc640 1 -- 172.21.15.146:0/2739122416 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08031d60 con 0x7f2e0c06f270 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.299+0000 7f2e027fc640 1 -- 172.21.15.146:0/2739122416 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e08033e10 con 0x7f2e0c06f270 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.299+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2739122416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0c1f6500 con 0x7f2e0c06f270 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.299+0000 7f2e027fc640 1 -- 172.21.15.146:0/2739122416 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08005260 con 0x7f2e0c06f270 2024-09-17T03:33:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.299+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2739122416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e0c1f6ac0 con 0x7f2e0c06f270 2024-09-17T03:33:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.300+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2739122416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e0c163460 con 0x7f2e0c06f270 2024-09-17T03:33:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.301+0000 7f2e027fc640 1 -- 172.21.15.146:0/2739122416 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2e08005400 con 0x7f2e0c06f270 2024-09-17T03:33:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.301+0000 7f2e027fc640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2df0078bc0 0x7f2df007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:16.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.301+0000 7f2e027fc640 1 -- 172.21.15.146:0/2739122416 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2e080bbe20 con 0x7f2e0c06f270 2024-09-17T03:33:16.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.301+0000 7f2e1157f640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2df0078bc0 0x7f2df007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:16.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.302+0000 7f2e1157f640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2df0078bc0 0x7f2df007b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0cb570 tx=0x7f2dfc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:16.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.306+0000 7f2e027fc640 1 -- 172.21.15.146:0/2739122416 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2e0803f030 con 0x7f2e0c06f270 2024-09-17T03:33:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.516+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2739122416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2e0c0d2bd0 con 0x7f2e0c06f270 2024-09-17T03:33:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.517+0000 7f2e027fc640 1 -- 172.21.15.146:0/2739122416 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f2e08083b90 con 0x7f2e0c06f270 2024-09-17T03:33:16.517 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:33:16.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2df0078bc0 msgr2=0x7f2df007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:16.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2df0078bc0 0x7f2df007b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0cb570 tx=0x7f2dfc005f90 comp rx=0 tx=0).stop 2024-09-17T03:33:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2739122416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c06f270 msgr2=0x7f2e0c0b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c06f270 0x7f2e0c0b2d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2e0802aa70 tx=0x7f2e08033c20 comp rx=0 tx=0).stop 2024-09-17T03:33:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2739122416 shutdown_connections 2024-09-17T03:33:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2df0078bc0 0x7f2df007b0d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e0c1620f0 0x7f2e0c0cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e0c0b3870 0x7f2e0c0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 --2- 172.21.15.146:0/2739122416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e0c06f270 0x7f2e0c0b2d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2739122416 >> 172.21.15.146:0/2739122416 conn(0x7f2e0c0d4be0 msgr2=0x7f2e0c15fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2739122416 shutdown_connections 2024-09-17T03:33:16.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16.519+0000 7f2e13fe4640 1 -- 172.21.15.146:0/2739122416 wait complete. 2024-09-17T03:33:16.530 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:33:16.530 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:33:16.530 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:33:16.530 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:33:16.530 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:33:16.530 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:33:16.530 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:33:16.530 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:33:16.530 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:33:16.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:16.531 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:33:16.546 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:33:16.546 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:33:16.546 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:33:16.546 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:16.546 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:33:16.547 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42775sec preferred_lft 42775sec 2024-09-17T03:33:16.548 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:33:16.548 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:16.548 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T03:33:16.548 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:16.548 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:33:16.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2024-09-17T03:33:16.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2024-09-17T03:33:16.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2024-09-17T03:33:16.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T03:33:16.549 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:33:16.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:16.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:16.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:16.743 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:33:16.768 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:33:16.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:16.770 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:33:16.846 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:33:16.846 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:33:16.846 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:33:16.846 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:33:16.846 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:33:16.847 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:16.847 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:33:16.847 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:33:16.847 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:33:16.847 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:33:16.847 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:33:16.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:17.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:17.158 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:33:17.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:17.175 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2024-09-17T03:33:17.232 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:17.232 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:33:17.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:33:17.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T03:33:17.232 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:33:17.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:17.351 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T03:33:17.352 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:17.352 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:33:17.352 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T03:33:17.352 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T03:33:17.352 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T03:33:17.352 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T03:33:17.352 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T03:33:17.352 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:33:17.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:17.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:17.482 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:17.482 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:33:17.482 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:33:17.482 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T03:33:17.482 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:33:17.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:17.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:17.560 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:33:17.560 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:33:17.574 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:33:17.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:33:17.575 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:33:17.630 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:33:17.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:17.630 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:33:17.735 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:33:17.736 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:33:17.736 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:33:17.870 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:33:17.870 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:33:17.870 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:33:17.870 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:33:17.870 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:33:17.877 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:33:17.877 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:33:17.877 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:33:17.877 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:33:17.877 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:33:17.878 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:33:17.878 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:33:17.878 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:33:17.878 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:33:17.878 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:33:17.878 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:33:17.879 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:33:17.879 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:33:17.880 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:33:17.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:17.881 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:33:17.906 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:17.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:18.012 INFO:teuthology.orchestra.run.smithi146.stdout:client4714 2024-09-17T03:33:18.012 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:33:18.012 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:18.028 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:18.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:18.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:18.133 INFO:teuthology.orchestra.run.smithi146.stdout:client4714 2024-09-17T03:33:18.133 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:18.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:18.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:18.197 INFO:teuthology.orchestra.run.smithi146.stdout:client4714 2024-09-17T03:33:18.197 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3f04b219-91f7-40f1-98fe-bc08c29ffc97.client4714/status') 2024-09-17T03:33:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:18.263 INFO:teuthology.orchestra.run.smithi146.stdout:instance: client.4714 (3)172.21.15.146:0/95348523 2024-09-17T03:33:18.263 INFO:teuthology.orchestra.run.smithi146.stdout:blocklisted: false 2024-09-17T03:33:18.263 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2024-09-17T03:33:18.263 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2024-09-17T03:33:18.263 INFO:teuthology.orchestra.run.smithi146.stderr:69 bytes copied, 2.0115e-05 s, 3.4 MB/s 2024-09-17T03:33:18.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:18.270 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-17T03:33:18.270 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:33:18.270 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T03:33:18.271 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:33:18.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.383+0000 7f0009415640 1 -- 172.21.15.146:0/2005420683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040b5750 msgr2=0x7f00040b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:18.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.383+0000 7f0009415640 1 --2- 172.21.15.146:0/2005420683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040b5750 0x7f00040b3620 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f00040b1a60 tx=0x7effec02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:33:18.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.383+0000 7f0009415640 1 -- 172.21.15.146:0/2005420683 shutdown_connections 2024-09-17T03:33:18.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.383+0000 7f0009415640 1 --2- 172.21.15.146:0/2005420683 >> v2:172.21.15.179:3300/0 conn(0x7f00040b3b60 0x7f000415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:18.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.383+0000 7f0009415640 1 --2- 172.21.15.146:0/2005420683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040b5750 0x7f00040b3620 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:18.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.383+0000 7f0009415640 1 -- 172.21.15.146:0/2005420683 >> 172.21.15.146:0/2005420683 conn(0x7f00040b7b20 msgr2=0x7f000409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:18.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.383+0000 7f0009415640 1 -- 172.21.15.146:0/2005420683 shutdown_connections 2024-09-17T03:33:18.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.383+0000 7f0009415640 1 -- 172.21.15.146:0/2005420683 wait complete. 2024-09-17T03:33:18.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.385+0000 7f0009415640 1 Processor -- start 2024-09-17T03:33:18.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.385+0000 7f0009415640 1 -- start start 2024-09-17T03:33:18.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0009415640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040b3b60 0x7f0004146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:18.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0009415640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00040b5750 0x7f00041493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:18.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0009415640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00040b5ce0 0x7f00041498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:18.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0009415640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f000415d480 con 0x7f00040b3b60 2024-09-17T03:33:18.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0009415640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f000415d300 con 0x7f00040b5ce0 2024-09-17T03:33:18.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0009415640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f000415d600 con 0x7f00040b5750 2024-09-17T03:33:18.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0002ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040b3b60 0x7f0004146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:18.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0002ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040b3b60 0x7f0004146b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52514/0 (socket says 172.21.15.146:52514) 2024-09-17T03:33:18.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0002ffd640 1 -- 172.21.15.146:0/1144251965 learned_addr learned my addr 172.21.15.146:0/1144251965 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:18.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7efffbfff640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00040b5750 0x7f00041493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f00037fe640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00040b5ce0 0x7f00041498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0002ffd640 1 -- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00040b5750 msgr2=0x7f00041493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0002ffd640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00040b5750 0x7f00041493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0002ffd640 1 -- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00040b5ce0 msgr2=0x7f00041498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0002ffd640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00040b5ce0 0x7f00041498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0002ffd640 1 -- 172.21.15.146:0/1144251965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00041f4730 con 0x7f00040b3b60 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0002ffd640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040b3b60 0x7f0004146b90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efff400b410 tx=0x7efff400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7efffb7fe640 1 -- 172.21.15.146:0/1144251965 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4015020 con 0x7f00040b3b60 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7efffb7fe640 1 -- 172.21.15.146:0/1144251965 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efff4011920 con 0x7f00040b3b60 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0009415640 1 -- 172.21.15.146:0/1144251965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00040c7610 con 0x7f00040b3b60 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7efffb7fe640 1 -- 172.21.15.146:0/1144251965 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4011d70 con 0x7f00040b3b60 2024-09-17T03:33:18.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.387+0000 7f0009415640 1 -- 172.21.15.146:0/1144251965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00041473c0 con 0x7f00040b3b60 2024-09-17T03:33:18.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.388+0000 7f0009415640 1 -- 172.21.15.146:0/1144251965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000415ecb0 con 0x7f00040b3b60 2024-09-17T03:33:18.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.389+0000 7efffb7fe640 1 -- 172.21.15.146:0/1144251965 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efff4018020 con 0x7f00040b3b60 2024-09-17T03:33:18.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.390+0000 7efffb7fe640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078b90 0x7effe407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:18.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.390+0000 7efffb7fe640 1 -- 172.21.15.146:0/1144251965 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efff409ac40 con 0x7f00040b3b60 2024-09-17T03:33:18.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.390+0000 7efffbfff640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078b90 0x7effe407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:18.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.391+0000 7efffbfff640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078b90 0x7effe407b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7effec033000 tx=0x7effec004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:18.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.395+0000 7efffb7fe640 1 -- 172.21.15.146:0/1144251965 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efff401f020 con 0x7f00040b3b60 2024-09-17T03:33:18.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.605+0000 7f0009415640 1 -- 172.21.15.146:0/1144251965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f000415ac60 con 0x7f00040b3b60 2024-09-17T03:33:18.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.605+0000 7efffb7fe640 1 -- 172.21.15.146:0/1144251965 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7efff40631a0 con 0x7f00040b3b60 2024-09-17T03:33:18.605 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:33:18.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 -- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078b90 msgr2=0x7effe407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:18.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078b90 0x7effe407b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7effec033000 tx=0x7effec004730 comp rx=0 tx=0).stop 2024-09-17T03:33:18.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 -- 172.21.15.146:0/1144251965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040b3b60 msgr2=0x7f0004146b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:18.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040b3b60 0x7f0004146b90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efff400b410 tx=0x7efff400b8d0 comp rx=0 tx=0).stop 2024-09-17T03:33:18.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 -- 172.21.15.146:0/1144251965 shutdown_connections 2024-09-17T03:33:18.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078b90 0x7effe407b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:18.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00040b5ce0 0x7f00041498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:18.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00040b5750 0x7f00041493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:18.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 --2- 172.21.15.146:0/1144251965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040b3b60 0x7f0004146b90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:18.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 -- 172.21.15.146:0/1144251965 >> 172.21.15.146:0/1144251965 conn(0x7f00040b7b20 msgr2=0x7f0004155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:18.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 -- 172.21.15.146:0/1144251965 shutdown_connections 2024-09-17T03:33:18.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18.607+0000 7f0009415640 1 -- 172.21.15.146:0/1144251965 wait complete. 2024-09-17T03:33:18.618 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:33:18.618 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:33:18.618 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:33:18.618 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T03:33:18.618 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T03:33:18.618 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:33:18.618 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:33:18.619 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:33:18.619 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T03:33:18.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:18.619 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:33:18.634 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:33:18.634 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:18.635 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:33:18.636 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:18.636 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:33:18.636 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42773sec preferred_lft 42773sec 2024-09-17T03:33:18.636 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:33:18.636 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:18.636 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:33:18.636 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:18.636 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:33:18.636 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:18.637 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:33:18.637 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:18.637 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:33:18.637 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:33:18.637 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link tentative 2024-09-17T03:33:18.637 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:18.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:18.638 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:33:18.699 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:33:18.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:18.700 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:33:18.757 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:33:18.757 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:33:18.757 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:33:18.757 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:33:18.757 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:33:18.758 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:18.758 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:33:18.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:33:18.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:33:18.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:33:18.758 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:33:18.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:18.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:18.884 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:33:18.900 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:33:18.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:18.900 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2024-09-17T03:33:18.955 INFO:teuthology.orchestra.run.smithi146.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T03:33:18.955 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:18.955 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:33:18.955 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:33:18.956 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T03:33:18.956 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:33:19.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:19.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:19.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:19.072 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T03:33:19.096 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:33:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:33:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:33:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:33:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:19.097 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:33:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:ed:9b:ea:e7:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:33:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:33:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ced:9bff:feea:e757/64 scope link 2024-09-17T03:33:19.097 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:19.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:19.098 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T03:33:19.164 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:33:19.164 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:33:19.164 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:33:19.164 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:19.164 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:33:19.164 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:19.164 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:33:19.164 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:ed:9b:ea:e7:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:33:19.164 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:33:19.165 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:19.165 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ced:9bff:feea:e757/64 scope link 2024-09-17T03:33:19.165 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:19.166 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T03:33:19.166 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:19.166 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:33:19.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T03:33:19.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T03:33:19.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T03:33:19.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T03:33:19.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T03:33:19.167 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:33:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:19.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:19.319 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:19.319 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:33:19.319 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.1 up 2024-09-17T03:33:19.319 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T03:33:19.319 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:33:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:19.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:33:19.396 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T03:33:19.410 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T03:33:19.411 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:33:19.411 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T03:33:19.466 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:33:19.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:19.466 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:33:19.560 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:33:19.560 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:33:19.560 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:33:19.571 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:33:19.571 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:33:19.571 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:33:19.571 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:33:19.571 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:33:19.577 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:33:19.577 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:33:19.577 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:33:19.577 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:33:19.578 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:33:19.578 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:33:19.578 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:33:19.578 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:33:19.578 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-17T03:33:19.578 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:33:19.578 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:33:19.579 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:33:19.579 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:33:19.580 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:33:19.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:19.580 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T03:33:19.604 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:19.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:19.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:19.701 INFO:teuthology.orchestra.run.smithi146.stdout:client4562 2024-09-17T03:33:19.702 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:33:19.702 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:19.718 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:19.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:19.813 INFO:teuthology.orchestra.run.smithi146.stdout:client4562 2024-09-17T03:33:19.814 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:19.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:19.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:19.870 INFO:teuthology.orchestra.run.smithi146.stdout:client4562 2024-09-17T03:33:19.870 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3f04b219-91f7-40f1-98fe-bc08c29ffc97.client4562/status') 2024-09-17T03:33:19.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:19.928 INFO:teuthology.orchestra.run.smithi146.stdout:instance: client.4562 (3)172.21.15.146:0/1196888541 2024-09-17T03:33:19.928 INFO:teuthology.orchestra.run.smithi146.stdout:blocklisted: false 2024-09-17T03:33:19.928 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2024-09-17T03:33:19.929 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2024-09-17T03:33:19.929 INFO:teuthology.orchestra.run.smithi146.stderr:71 bytes copied, 2.328e-05 s, 3.0 MB/s 2024-09-17T03:33:19.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:19.934 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-17T03:33:19.934 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:33:19.934 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:33:19.935 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:33:20.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.047+0000 7f1501b19640 1 -- 172.21.15.146:0/1576119358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14e4004800 msgr2=0x7f14e4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:20.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.047+0000 7f1501b19640 1 --2- 172.21.15.146:0/1576119358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14e4004800 0x7f14e4004c10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009b50 tx=0x7f14e4005830 comp rx=0 tx=0).stop 2024-09-17T03:33:20.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.047+0000 7f14fbfff640 1 -- 172.21.15.146:0/1576119358 reap_dead start 2024-09-17T03:33:20.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.047+0000 7f1501b19640 1 -- 172.21.15.146:0/1576119358 shutdown_connections 2024-09-17T03:33:20.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.047+0000 7f1501b19640 1 -- 172.21.15.146:0/1576119358 >> 172.21.15.146:0/1576119358 conn(0x7f14fc0b7b20 msgr2=0x7f14fc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:20.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.048+0000 7f1501b19640 1 -- 172.21.15.146:0/1576119358 shutdown_connections 2024-09-17T03:33:20.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.048+0000 7f1501b19640 1 -- 172.21.15.146:0/1576119358 wait complete. 2024-09-17T03:33:20.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.049+0000 7f1501b19640 1 Processor -- start 2024-09-17T03:33:20.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.049+0000 7f1501b19640 1 -- start start 2024-09-17T03:33:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f1501b19640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14e4004800 0x7f14fc09ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f1501b19640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14fc0d2070 0x7f14fc14a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f1501b19640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14fc14a570 0x7f14fc1f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f1501b19640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f14fc0b1320 con 0x7f14fc0d2070 2024-09-17T03:33:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f1501b19640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14fc15ddc0 con 0x7f14e4004800 2024-09-17T03:33:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f1501b19640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f14fc0b14a0 con 0x7f14fc14a570 2024-09-17T03:33:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f14faffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14fc0d2070 0x7f14fc14a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f14faffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14fc0d2070 0x7f14fc14a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52532/0 (socket says 172.21.15.146:52532) 2024-09-17T03:33:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f14faffd640 1 -- 172.21.15.146:0/2140822827 learned_addr learned my addr 172.21.15.146:0/2140822827 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f14fb7fe640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14e4004800 0x7f14fc09ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f14fbfff640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14fc14a570 0x7f14fc1f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f14faffd640 1 -- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14fc14a570 msgr2=0x7f14fc1f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f14faffd640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14fc14a570 0x7f14fc1f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f14faffd640 1 -- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14e4004800 msgr2=0x7f14fc09ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f14faffd640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14e4004800 0x7f14fc09ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f14faffd640 1 -- 172.21.15.146:0/2140822827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14fc09dcc0 con 0x7f14fc0d2070 2024-09-17T03:33:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.051+0000 7f14faffd640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14fc0d2070 0x7f14fc14a030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009a70 tx=0x7f14f0009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.052+0000 7f14e3fff640 1 -- 172.21.15.146:0/2140822827 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0038050 con 0x7f14fc0d2070 2024-09-17T03:33:20.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.052+0000 7f14e3fff640 1 -- 172.21.15.146:0/2140822827 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14f0039040 con 0x7f14fc0d2070 2024-09-17T03:33:20.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.052+0000 7f1501b19640 1 -- 172.21.15.146:0/2140822827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14fc09dfa0 con 0x7f14fc0d2070 2024-09-17T03:33:20.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.052+0000 7f14e3fff640 1 -- 172.21.15.146:0/2140822827 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0033e40 con 0x7f14fc0d2070 2024-09-17T03:33:20.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.052+0000 7f1501b19640 1 -- 172.21.15.146:0/2140822827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14fc09e560 con 0x7f14fc0d2070 2024-09-17T03:33:20.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.053+0000 7f1501b19640 1 -- 172.21.15.146:0/2140822827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14fc09da30 con 0x7f14fc0d2070 2024-09-17T03:33:20.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.053+0000 7f14e3fff640 1 -- 172.21.15.146:0/2140822827 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14f002b8c0 con 0x7f14fc0d2070 2024-09-17T03:33:20.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.054+0000 7f14e3fff640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14e8078bc0 0x7f14e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:20.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.054+0000 7f14e3fff640 1 -- 172.21.15.146:0/2140822827 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f14f00bbef0 con 0x7f14fc0d2070 2024-09-17T03:33:20.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.054+0000 7f14fb7fe640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14e8078bc0 0x7f14e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:20.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.055+0000 7f14fb7fe640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14e8078bc0 0x7f14e807b0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14ec005eb0 tx=0x7f14ec005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:20.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.059+0000 7f14e3fff640 1 -- 172.21.15.146:0/2140822827 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14f00843c0 con 0x7f14fc0d2070 2024-09-17T03:33:20.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.266+0000 7f1501b19640 1 -- 172.21.15.146:0/2140822827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f14fc0b3620 con 0x7f14fc0d2070 2024-09-17T03:33:20.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.267+0000 7f14e3fff640 1 -- 172.21.15.146:0/2140822827 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f14f0083cc0 con 0x7f14fc0d2070 2024-09-17T03:33:20.267 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:33:20.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 -- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14e8078bc0 msgr2=0x7f14e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:20.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14e8078bc0 0x7f14e807b0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14ec005eb0 tx=0x7f14ec005f90 comp rx=0 tx=0).stop 2024-09-17T03:33:20.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 -- 172.21.15.146:0/2140822827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14fc0d2070 msgr2=0x7f14fc14a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14fc0d2070 0x7f14fc14a030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009a70 tx=0x7f14f0009850 comp rx=0 tx=0).stop 2024-09-17T03:33:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 -- 172.21.15.146:0/2140822827 shutdown_connections 2024-09-17T03:33:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14e8078bc0 0x7f14e807b0d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14fc14a570 0x7f14fc1f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14fc0d2070 0x7f14fc14a030 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 --2- 172.21.15.146:0/2140822827 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14e4004800 0x7f14fc09ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 -- 172.21.15.146:0/2140822827 >> 172.21.15.146:0/2140822827 conn(0x7f14fc0b7b20 msgr2=0x7f14fc0d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 -- 172.21.15.146:0/2140822827 shutdown_connections 2024-09-17T03:33:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:20.269+0000 7f1501b19640 1 -- 172.21.15.146:0/2140822827 wait complete. 2024-09-17T03:33:20.280 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:33:20.280 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:33:20.280 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-17T03:33:20.280 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:33:20.280 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:33:20.280 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:33:20.281 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:33:20.281 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:33:20.281 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:33:20.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:20.281 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:20.301 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-17T03:33:20.302 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:20.302 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:20.302 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:33:20.302 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:20.302 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:33:20.302 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42773sec preferred_lft 42773sec 2024-09-17T03:33:20.302 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-17T03:33:20.302 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:20.302 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T03:33:20.302 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:20.302 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-17T03:33:20.303 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add name ceph-brx type bridge 2024-09-17T03:33:20.303 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr flush dev ceph-brx 2024-09-17T03:33:20.303 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set ceph-brx up 2024-09-17T03:33:20.303 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T03:33:20.303 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-17T03:33:20.398 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:20.599 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:20.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:20.607 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:33:20.632 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-17T03:33:20.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:20.634 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-17T03:33:20.701 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-17T03:33:20.701 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:33:20.701 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:33:20.702 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:33:20.702 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:33:20.702 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:20.702 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-17T03:33:20.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:33:20.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:33:20.703 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:33:20.703 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-17T03:33:20.792 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:21.016 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:21.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:21.023 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-17T03:33:21.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:21.039 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2024-09-17T03:33:21.095 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:21.095 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-17T03:33:21.095 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:33:21.095 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T03:33:21.095 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-17T03:33:21.184 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:21.207 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:21.213 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T03:33:21.213 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:21.214 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-17T03:33:21.214 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T03:33:21.214 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T03:33:21.214 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T03:33:21.214 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T03:33:21.214 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T03:33:21.214 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-17T03:33:21.262 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:21.336 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:21.342 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:21.342 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-17T03:33:21.342 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2024-09-17T03:33:21.342 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T03:33:21.343 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-17T03:33:21.390 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:21.413 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:21.420 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:33:21.420 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:33:21.435 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:33:21.435 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:33:21.435 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:33:21.490 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:33:21.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:21.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:33:21.640 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:33:21.640 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:33:21.640 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-09-17T03:33:21.765 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:33:21.766 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:33:21.766 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-09-17T03:33:21.766 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:33:21.766 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:33:21.772 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:33:21.772 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:33:21.772 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-09-17T03:33:21.772 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:33:21.772 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:33:21.773 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:33:21.773 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:33:21.773 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:33:21.773 INFO:teuthology.orchestra.run.smithi179.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:33:21.773 INFO:teuthology.orchestra.run.smithi179.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:33:21.773 INFO:teuthology.orchestra.run.smithi179.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:33:21.773 INFO:teuthology.orchestra.run.smithi179.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:33:21.773 INFO:teuthology.orchestra.run.smithi179.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:33:21.774 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:33:21.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:21.774 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:33:21.799 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:21.888 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:21.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:21.896 INFO:teuthology.orchestra.run.smithi179.stdout:client4726 2024-09-17T03:33:21.896 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:33:21.896 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:21.912 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:22.000 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:22.002 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:22.007 INFO:teuthology.orchestra.run.smithi179.stdout:client4726 2024-09-17T03:33:22.008 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:22.055 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:22.057 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:22.063 INFO:teuthology.orchestra.run.smithi179.stdout:client4726 2024-09-17T03:33:22.063 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3f04b219-91f7-40f1-98fe-bc08c29ffc97.client4726/status') 2024-09-17T03:33:22.110 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:instance: client.4726 (3)192.168.0.1:0/201789297 2024-09-17T03:33:22.120 INFO:teuthology.orchestra.run.smithi179.stdout:blocklisted: false 2024-09-17T03:33:22.120 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records in 2024-09-17T03:33:22.121 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records out 2024-09-17T03:33:22.121 INFO:teuthology.orchestra.run.smithi179.stderr:68 bytes copied, 5.4402e-05 s, 1.2 MB/s 2024-09-17T03:33:22.121 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:22.127 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-17T03:33:22.127 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:33:22.127 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T03:33:22.128 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:33:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.255+0000 7f06ddef2640 1 -- 172.21.15.146:0/2463344455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06d80b5750 msgr2=0x7f06d80b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:22.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.255+0000 7f06ddef2640 1 --2- 172.21.15.146:0/2463344455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06d80b5750 0x7f06d80b3620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009830 tx=0x7f06cc02a510 comp rx=0 tx=0).stop 2024-09-17T03:33:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.255+0000 7f06ddef2640 1 -- 172.21.15.146:0/2463344455 shutdown_connections 2024-09-17T03:33:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.255+0000 7f06ddef2640 1 --2- 172.21.15.146:0/2463344455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06d80b3b60 0x7f06d815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.255+0000 7f06ddef2640 1 --2- 172.21.15.146:0/2463344455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06d80b5750 0x7f06d80b3620 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.255+0000 7f06ddef2640 1 -- 172.21.15.146:0/2463344455 >> 172.21.15.146:0/2463344455 conn(0x7f06d80b7b20 msgr2=0x7f06d809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.255+0000 7f06ddef2640 1 -- 172.21.15.146:0/2463344455 shutdown_connections 2024-09-17T03:33:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.255+0000 7f06ddef2640 1 -- 172.21.15.146:0/2463344455 wait complete. 2024-09-17T03:33:22.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.257+0000 7f06ddef2640 1 Processor -- start 2024-09-17T03:33:22.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.257+0000 7f06ddef2640 1 -- start start 2024-09-17T03:33:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.258+0000 7f06ddef2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06d80b3b60 0x7f06d8151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.258+0000 7f06ddef2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06d80b5750 0x7f06d814f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.258+0000 7f06ddef2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06d80b5ce0 0x7f06d815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.258+0000 7f06ddef2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f06d815d4b0 con 0x7f06d80b5750 2024-09-17T03:33:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.258+0000 7f06ddef2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f06d815d330 con 0x7f06d80b5ce0 2024-09-17T03:33:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.258+0000 7f06ddef2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f06d815d630 con 0x7f06d80b3b60 2024-09-17T03:33:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06d6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06d80b5750 0x7f06d814f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06d6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06d80b5750 0x7f06d814f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52558/0 (socket says 172.21.15.146:52558) 2024-09-17T03:33:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06d6ffd640 1 -- 172.21.15.146:0/2713439431 learned_addr learned my addr 172.21.15.146:0/2713439431 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06d77fe640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06d80b3b60 0x7f06d8151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:22.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06d7fff640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06d80b5ce0 0x7f06d815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06d6ffd640 1 -- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06d80b3b60 msgr2=0x7f06d8151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06d6ffd640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06d80b3b60 0x7f06d8151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06d6ffd640 1 -- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06d80b5ce0 msgr2=0x7f06d815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06d6ffd640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06d80b5ce0 0x7f06d815ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06d6ffd640 1 -- 172.21.15.146:0/2713439431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d81f5c00 con 0x7f06d80b5750 2024-09-17T03:33:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06d6ffd640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06d80b5750 0x7f06d814f9a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009950 tx=0x7f06cc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06bffff640 1 -- 172.21.15.146:0/2713439431 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc031d60 con 0x7f06d80b5750 2024-09-17T03:33:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06bffff640 1 -- 172.21.15.146:0/2713439431 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06cc033e10 con 0x7f06d80b5750 2024-09-17T03:33:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06bffff640 1 -- 172.21.15.146:0/2713439431 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc033310 con 0x7f06d80b5750 2024-09-17T03:33:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06ddef2640 1 -- 172.21.15.146:0/2713439431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d81f5ec0 con 0x7f06d80b5750 2024-09-17T03:33:22.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.259+0000 7f06ddef2640 1 -- 172.21.15.146:0/2713439431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d81f6480 con 0x7f06d80b5750 2024-09-17T03:33:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.261+0000 7f06ddef2640 1 -- 172.21.15.146:0/2713439431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d81518e0 con 0x7f06d80b5750 2024-09-17T03:33:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.261+0000 7f06bffff640 1 -- 172.21.15.146:0/2713439431 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06cc0334b0 con 0x7f06d80b5750 2024-09-17T03:33:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.262+0000 7f06bffff640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06c4078bc0 0x7f06c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.262+0000 7f06bffff640 1 -- 172.21.15.146:0/2713439431 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f06cc0bbf10 con 0x7f06d80b5750 2024-09-17T03:33:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.262+0000 7f06d77fe640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06c4078bc0 0x7f06c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.262+0000 7f06d77fe640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06c4078bc0 0x7f06c407b0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f06c8007d60 tx=0x7f06c8007cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:22.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.266+0000 7f06bffff640 1 -- 172.21.15.146:0/2713439431 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06cc03f030 con 0x7f06d80b5750 2024-09-17T03:33:22.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.480+0000 7f06ddef2640 1 -- 172.21.15.146:0/2713439431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f06d815dae0 con 0x7f06d80b5750 2024-09-17T03:33:22.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.480+0000 7f06bffff640 1 -- 172.21.15.146:0/2713439431 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f06cc083d90 con 0x7f06d80b5750 2024-09-17T03:33:22.480 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:33:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.482+0000 7f06ddef2640 1 -- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06c4078bc0 msgr2=0x7f06c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.482+0000 7f06ddef2640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06c4078bc0 0x7f06c407b0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f06c8007d60 tx=0x7f06c8007cf0 comp rx=0 tx=0).stop 2024-09-17T03:33:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.482+0000 7f06ddef2640 1 -- 172.21.15.146:0/2713439431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06d80b5750 msgr2=0x7f06d814f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.482+0000 7f06ddef2640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06d80b5750 0x7f06d814f9a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009950 tx=0x7f06cc033c20 comp rx=0 tx=0).stop 2024-09-17T03:33:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.482+0000 7f06ddef2640 1 -- 172.21.15.146:0/2713439431 shutdown_connections 2024-09-17T03:33:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.482+0000 7f06ddef2640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06c4078bc0 0x7f06c407b0d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.482+0000 7f06ddef2640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06d80b5ce0 0x7f06d815ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.482+0000 7f06ddef2640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06d80b5750 0x7f06d814f9a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.483+0000 7f06ddef2640 1 --2- 172.21.15.146:0/2713439431 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06d80b3b60 0x7f06d8151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.483+0000 7f06ddef2640 1 -- 172.21.15.146:0/2713439431 >> 172.21.15.146:0/2713439431 conn(0x7f06d80b7b20 msgr2=0x7f06d815a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.483+0000 7f06ddef2640 1 -- 172.21.15.146:0/2713439431 shutdown_connections 2024-09-17T03:33:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:22.483+0000 7f06ddef2640 1 -- 172.21.15.146:0/2713439431 wait complete. 2024-09-17T03:33:22.493 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:33:22.493 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:33:22.493 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2024-09-17T03:33:22.493 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T03:33:22.493 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T03:33:22.493 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:33:22.494 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:33:22.494 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:33:22.494 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T03:33:22.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:22.494 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2024-09-17T03:33:22.511 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:33:22.511 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:33:22.512 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:33:22.512 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:22.512 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-17T03:33:22.512 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:22.513 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:22.513 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:22.513 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f0 2024-09-17T03:33:22.513 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:22.513 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:22.513 INFO:teuthology.orchestra.run.smithi179.stdout: altname enp7s0f1 2024-09-17T03:33:22.514 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:22.514 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:22.514 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:33:22.514 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:22.514 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:33:22.514 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42770sec preferred_lft 42770sec 2024-09-17T03:33:22.515 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::ec4:7aff:fe88:725b/64 scope link noprefixroute 2024-09-17T03:33:22.515 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:22.515 INFO:teuthology.orchestra.run.smithi179.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:33:22.515 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether be:46:37:0c:9f:37 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:22.515 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:33:22.515 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:22.516 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::7cc5:1eff:fed6:d4b5/64 scope link 2024-09-17T03:33:22.516 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:22.516 INFO:teuthology.orchestra.run.smithi179.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:33:22.516 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether be:46:37:0c:9f:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:33:22.516 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::bc46:37ff:fe0c:9f37/64 scope link tentative 2024-09-17T03:33:22.516 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:22.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:22.517 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:33:22.575 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-17T03:33:22.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:22.576 DEBUG:teuthology.orchestra.run.smithi179:> route 2024-09-17T03:33:22.633 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2024-09-17T03:33:22.633 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:33:22.633 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:33:22.633 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:33:22.633 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:33:22.633 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:22.634 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-17T03:33:22.634 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:33:22.634 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:33:22.634 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:33:22.634 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-17T03:33:22.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:22.754 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:22.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:22.761 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-17T03:33:22.776 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:33:22.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:22.777 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2024-09-17T03:33:22.832 INFO:teuthology.orchestra.run.smithi179.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T03:33:22.832 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:22.832 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-17T03:33:22.832 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:33:22.833 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T03:33:22.833 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-17T03:33:22.920 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:22.942 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:22.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:22.949 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T03:33:22.973 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:33:22.973 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:33:22.973 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:33:22.973 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:22.973 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-17T03:33:22.973 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:22.974 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:33:22.974 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 66:e7:a8:f2:6f:50 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:33:22.974 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:33:22.974 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:22.974 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::64e7:a8ff:fef2:6f50/64 scope link tentative 2024-09-17T03:33:22.974 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:22.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:22.975 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T03:33:23.040 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:33:23.041 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:33:23.041 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:33:23.041 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:23.041 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2024-09-17T03:33:23.041 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:23.041 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:33:23.041 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 66:e7:a8:f2:6f:50 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:33:23.041 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:33:23.041 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:23.041 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::64e7:a8ff:fef2:6f50/64 scope link tentative 2024-09-17T03:33:23.041 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:23.042 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T03:33:23.042 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:23.043 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-17T03:33:23.043 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T03:33:23.043 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T03:33:23.043 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T03:33:23.043 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T03:33:23.043 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T03:33:23.043 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-17T03:33:23.131 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:23.187 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:23.193 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:23.194 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2024-09-17T03:33:23.194 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.1 up 2024-09-17T03:33:23.194 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T03:33:23.194 DEBUG:teuthology.orchestra.run.smithi179:> ') 2024-09-17T03:33:23.241 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:23.263 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:23.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:33:23.271 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T03:33:23.286 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T03:33:23.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:33:23.286 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T03:33:23.341 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:33:23.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:23.341 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:33:23.435 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:33:23.435 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:33:23.435 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-09-17T03:33:23.446 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:33:23.446 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:33:23.446 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-09-17T03:33:23.446 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:33:23.446 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:33:23.451 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:33:23.452 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:33:23.452 INFO:teuthology.orchestra.run.smithi179.stdout:invalid new device string format 2024-09-17T03:33:23.452 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:33:23.452 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:33:23.452 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:33:23.452 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:33:23.452 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:33:23.453 INFO:teuthology.orchestra.run.smithi179.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-17T03:33:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:33:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:33:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:33:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:33:23.454 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:33:23.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:23.454 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T03:33:23.479 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:23.567 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:23.569 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:23.575 INFO:teuthology.orchestra.run.smithi179.stdout:client4732 2024-09-17T03:33:23.575 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:33:23.575 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:23.591 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:23.679 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:23.680 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:23.686 INFO:teuthology.orchestra.run.smithi179.stdout:client4732 2024-09-17T03:33:23.686 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:23.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:23.738 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:23.742 INFO:teuthology.orchestra.run.smithi179.stdout:client4732 2024-09-17T03:33:23.742 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3f04b219-91f7-40f1-98fe-bc08c29ffc97.client4732/status') 2024-09-17T03:33:23.790 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:23.800 INFO:teuthology.orchestra.run.smithi179.stdout:instance: client.4732 (3)192.168.0.2:0/2507100819 2024-09-17T03:33:23.800 INFO:teuthology.orchestra.run.smithi179.stdout:blocklisted: false 2024-09-17T03:33:23.800 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records in 2024-09-17T03:33:23.801 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records out 2024-09-17T03:33:23.801 INFO:teuthology.orchestra.run.smithi179.stderr:69 bytes copied, 3.849e-05 s, 1.8 MB/s 2024-09-17T03:33:23.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-17T03:33:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:23.808 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T03:33:23.847 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-09-17T03:33:23.847 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T03:33:23.847 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.976+0000 7fecb2abe640 1 -- 172.21.15.146:0/4197427254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec9c003c10 msgr2=0x7fec9c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.976+0000 7fecb2abe640 1 --2- 172.21.15.146:0/4197427254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec9c003c10 0x7fec9c004060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feca0001830 tx=0x7fec9c005830 comp rx=0 tx=0).stop 2024-09-17T03:33:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.976+0000 7fecb105b640 1 -- 172.21.15.146:0/4197427254 reap_dead start 2024-09-17T03:33:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.976+0000 7fecb2abe640 1 -- 172.21.15.146:0/4197427254 shutdown_connections 2024-09-17T03:33:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.976+0000 7fecb2abe640 1 -- 172.21.15.146:0/4197427254 >> 172.21.15.146:0/4197427254 conn(0x7fecac0b2060 msgr2=0x7fecac0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.976+0000 7fecb2abe640 1 -- 172.21.15.146:0/4197427254 shutdown_connections 2024-09-17T03:33:23.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.976+0000 7fecb2abe640 1 -- 172.21.15.146:0/4197427254 wait complete. 2024-09-17T03:33:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.978+0000 7fecb2abe640 1 Processor -- start 2024-09-17T03:33:23.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.978+0000 7fecb2abe640 1 -- start start 2024-09-17T03:33:23.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecb2abe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec9c003c10 0x7fecac149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:23.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecb2abe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecac15d450 0x7fecac15d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:23.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecb2abe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecac0aeab0 0x7fecac0aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:23.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecb2abe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fecac06e470 con 0x7fecac15d450 2024-09-17T03:33:23.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecb2abe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fecac0b4dc0 con 0x7fecac0aeab0 2024-09-17T03:33:23.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecb2abe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fecac06e5f0 con 0x7fec9c003c10 2024-09-17T03:33:23.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecabfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecac15d450 0x7fecac15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:23.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecabfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecac15d450 0x7fecac15d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52574/0 (socket says 172.21.15.146:52574) 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecabfff640 1 -- 172.21.15.146:0/2919818236 learned_addr learned my addr 172.21.15.146:0/2919818236 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecb085a640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec9c003c10 0x7fecac149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecb105b640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecac0aeab0 0x7fecac0aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecabfff640 1 -- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec9c003c10 msgr2=0x7fecac149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecabfff640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec9c003c10 0x7fecac149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecabfff640 1 -- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecac0aeab0 msgr2=0x7fecac0aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecabfff640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecac0aeab0 0x7fecac0aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecabfff640 1 -- 172.21.15.146:0/2919818236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac1465d0 con 0x7fecac15d450 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecb105b640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecac0aeab0 0x7fecac0aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecabfff640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecac15d450 0x7fecac15d860 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fec98006680 tx=0x7fec980066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7feca97fa640 1 -- 172.21.15.146:0/2919818236 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98015070 con 0x7fecac15d450 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7feca97fa640 1 -- 172.21.15.146:0/2919818236 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec98011900 con 0x7fecac15d450 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.980+0000 7fecb2abe640 1 -- 172.21.15.146:0/2919818236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecac0af400 con 0x7fecac15d450 2024-09-17T03:33:23.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.981+0000 7feca97fa640 1 -- 172.21.15.146:0/2919818236 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98011d10 con 0x7fecac15d450 2024-09-17T03:33:23.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.981+0000 7fecb2abe640 1 -- 172.21.15.146:0/2919818236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecac145d30 con 0x7fecac15d450 2024-09-17T03:33:23.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.982+0000 7fecb2abe640 1 -- 172.21.15.146:0/2919818236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecac1457c0 con 0x7fecac15d450 2024-09-17T03:33:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.982+0000 7feca97fa640 1 -- 172.21.15.146:0/2919818236 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec98018070 con 0x7fecac15d450 2024-09-17T03:33:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.983+0000 7feca97fa640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec90078b90 0x7fec9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.983+0000 7feca97fa640 1 -- 172.21.15.146:0/2919818236 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fec9809b8b0 con 0x7fecac15d450 2024-09-17T03:33:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.983+0000 7fecb085a640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec90078b90 0x7fec9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:23.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.984+0000 7fecb085a640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec90078b90 0x7fec9007b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feca0032000 tx=0x7feca0001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:23.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:23.988+0000 7feca97fa640 1 -- 172.21.15.146:0/2919818236 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fecac0af400 con 0x7fecac15d450 2024-09-17T03:33:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.163+0000 7fecb2abe640 1 -- 172.21.15.146:0/2919818236 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecac15ead0 con 0x7fecac15d450 2024-09-17T03:33:24.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.164+0000 7feca97fa640 1 -- 172.21.15.146:0/2919818236 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7fec980637c0 con 0x7fecac15d450 2024-09-17T03:33:24.164 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:24.164 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:01.757648+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:32:57.968580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:32:59.068488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 -- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec90078b90 msgr2=0x7fec9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec90078b90 0x7fec9007b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feca0032000 tx=0x7feca0001360 comp rx=0 tx=0).stop 2024-09-17T03:33:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 -- 172.21.15.146:0/2919818236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecac15d450 msgr2=0x7fecac15d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecac15d450 0x7fecac15d860 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fec98006680 tx=0x7fec980066b0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 -- 172.21.15.146:0/2919818236 shutdown_connections 2024-09-17T03:33:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec90078b90 0x7fec9007b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fecac0aeab0 0x7fecac0aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecac15d450 0x7fecac15d860 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 --2- 172.21.15.146:0/2919818236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec9c003c10 0x7fecac149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 -- 172.21.15.146:0/2919818236 >> 172.21.15.146:0/2919818236 conn(0x7fecac0b2060 msgr2=0x7fecac157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 -- 172.21.15.146:0/2919818236 shutdown_connections 2024-09-17T03:33:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.167+0000 7fecb2abe640 1 -- 172.21.15.146:0/2919818236 wait complete. 2024-09-17T03:33:24.177 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T03:32:57.968580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T03:32:59.068488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:33:24.178 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:33:24.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.295+0000 7faeb06bd640 1 -- 172.21.15.146:0/618874967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80b5ce0 msgr2=0x7faea80b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.295+0000 7faeb06bd640 1 --2- 172.21.15.146:0/618874967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80b5ce0 0x7faea80b1320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faea4005fd0 tx=0x7faea402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.295+0000 7faeb06bd640 1 -- 172.21.15.146:0/618874967 shutdown_connections 2024-09-17T03:33:24.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.295+0000 7faeb06bd640 1 --2- 172.21.15.146:0/618874967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80b5ce0 0x7faea80b1320 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.295+0000 7faeb06bd640 1 -- 172.21.15.146:0/618874967 >> 172.21.15.146:0/618874967 conn(0x7faea80b7b20 msgr2=0x7faea809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:24.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.295+0000 7faeb06bd640 1 -- 172.21.15.146:0/618874967 shutdown_connections 2024-09-17T03:33:24.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.295+0000 7faeb06bd640 1 -- 172.21.15.146:0/618874967 wait complete. 2024-09-17T03:33:24.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.297+0000 7faeb06bd640 1 Processor -- start 2024-09-17T03:33:24.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.297+0000 7faeb06bd640 1 -- start start 2024-09-17T03:33:24.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.298+0000 7faeb06bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80b5750 0x7faea81f73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.298+0000 7faeb06bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea80b5ce0 0x7faea81f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.298+0000 7faeb06bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea81441d0 0x7faea81445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.298+0000 7faeb06bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faea815d680 con 0x7faea80b5750 2024-09-17T03:33:24.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.298+0000 7faeb06bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faea815d500 con 0x7faea80b5ce0 2024-09-17T03:33:24.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.298+0000 7faeb06bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7faea815d800 con 0x7faea81441d0 2024-09-17T03:33:24.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.298+0000 7faeae459640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80b5750 0x7faea81f73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.298+0000 7faeae459640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80b5750 0x7faea81f73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52590/0 (socket says 172.21.15.146:52590) 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.298+0000 7faeae459640 1 -- 172.21.15.146:0/606497357 learned_addr learned my addr 172.21.15.146:0/606497357 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7faeadc58640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea80b5ce0 0x7faea81f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7faeaec5a640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea81441d0 0x7faea81445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7faeae459640 1 -- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea81441d0 msgr2=0x7faea81445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7faeae459640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea81441d0 0x7faea81445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7faeae459640 1 -- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea80b5ce0 msgr2=0x7faea81f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7faeae459640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea80b5ce0 0x7faea81f7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7faeae459640 1 -- 172.21.15.146:0/606497357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea81f4f00 con 0x7faea80b5750 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7faeadc58640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea80b5ce0 0x7faea81f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7faeae459640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80b5750 0x7faea81f73c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faea4034040 tx=0x7faea40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:24.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7fae9effd640 1 -- 172.21.15.146:0/606497357 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea403e030 con 0x7faea80b5750 2024-09-17T03:33:24.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7fae9effd640 1 -- 172.21.15.146:0/606497357 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faea4003ca0 con 0x7faea80b5750 2024-09-17T03:33:24.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7fae9effd640 1 -- 172.21.15.146:0/606497357 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4035040 con 0x7faea80b5750 2024-09-17T03:33:24.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7faeb06bd640 1 -- 172.21.15.146:0/606497357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea81454a0 con 0x7faea80b5750 2024-09-17T03:33:24.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.299+0000 7faeb06bd640 1 -- 172.21.15.146:0/606497357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea8152300 con 0x7faea80b5750 2024-09-17T03:33:24.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.300+0000 7faeb06bd640 1 -- 172.21.15.146:0/606497357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea81f50d0 con 0x7faea80b5750 2024-09-17T03:33:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.301+0000 7fae9effd640 1 -- 172.21.15.146:0/606497357 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faea4041030 con 0x7faea80b5750 2024-09-17T03:33:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.301+0000 7fae9effd640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae8c078bc0 0x7fae8c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.301+0000 7fae9effd640 1 -- 172.21.15.146:0/606497357 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faea40bb3d0 con 0x7faea80b5750 2024-09-17T03:33:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.301+0000 7faeadc58640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae8c078bc0 0x7fae8c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.302+0000 7faeadc58640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae8c078bc0 0x7fae8c07b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae98006fd0 tx=0x7fae98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:24.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.306+0000 7fae9effd640 1 -- 172.21.15.146:0/606497357 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faea4083810 con 0x7faea80b5750 2024-09-17T03:33:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.483+0000 7faeb06bd640 1 -- 172.21.15.146:0/606497357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faea80b7440 con 0x7faea80b5750 2024-09-17T03:33:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.483+0000 7fae9effd640 1 -- 172.21.15.146:0/606497357 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7faea4083110 con 0x7faea80b5750 2024-09-17T03:33:24.482 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:33:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 -- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae8c078bc0 msgr2=0x7fae8c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae8c078bc0 0x7fae8c07b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae98006fd0 tx=0x7fae98008040 comp rx=0 tx=0).stop 2024-09-17T03:33:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 -- 172.21.15.146:0/606497357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80b5750 msgr2=0x7faea81f73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80b5750 0x7faea81f73c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faea4034040 tx=0x7faea40038a0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 -- 172.21.15.146:0/606497357 shutdown_connections 2024-09-17T03:33:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae8c078bc0 0x7fae8c07b0d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faea81441d0 0x7faea81445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faea80b5ce0 0x7faea81f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 --2- 172.21.15.146:0/606497357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faea80b5750 0x7faea81f73c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 -- 172.21.15.146:0/606497357 >> 172.21.15.146:0/606497357 conn(0x7faea80b7b20 msgr2=0x7faea81596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 -- 172.21.15.146:0/606497357 shutdown_connections 2024-09-17T03:33:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.485+0000 7faeb06bd640 1 -- 172.21.15.146:0/606497357 wait complete. 2024-09-17T03:33:24.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T03:33:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.612+0000 7f1b7ea30640 1 -- 172.21.15.146:0/3091267488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780b5ce0 msgr2=0x7f1b780b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.612+0000 7f1b7ea30640 1 --2- 172.21.15.146:0/3091267488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780b5ce0 0x7f1b780b1320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009830 tx=0x7f1b6802a510 comp rx=0 tx=0).stop 2024-09-17T03:33:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.612+0000 7f1b7ea30640 1 -- 172.21.15.146:0/3091267488 shutdown_connections 2024-09-17T03:33:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.613+0000 7f1b7ea30640 1 --2- 172.21.15.146:0/3091267488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b780b5750 0x7f1b780b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.613+0000 7f1b7ea30640 1 --2- 172.21.15.146:0/3091267488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780b5ce0 0x7f1b780b1320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.613+0000 7f1b7ea30640 1 -- 172.21.15.146:0/3091267488 >> 172.21.15.146:0/3091267488 conn(0x7f1b780b7b20 msgr2=0x7f1b7809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.613+0000 7f1b7ea30640 1 -- 172.21.15.146:0/3091267488 shutdown_connections 2024-09-17T03:33:24.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.613+0000 7f1b7ea30640 1 -- 172.21.15.146:0/3091267488 wait complete. 2024-09-17T03:33:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.614+0000 7f1b7ea30640 1 Processor -- start 2024-09-17T03:33:24.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.615+0000 7f1b7ea30640 1 -- start start 2024-09-17T03:33:24.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b7ea30640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b780b3b60 0x7f1b781527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b7ea30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b780b5750 0x7f1b78145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b7ea30640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780b5ce0 0x7f1b78142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b7ea30640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b780b27b0 con 0x7f1b780b5750 2024-09-17T03:33:24.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b7ea30640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7815dd00 con 0x7f1b780b5ce0 2024-09-17T03:33:24.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b7ea30640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1b780b2930 con 0x7f1b780b3b60 2024-09-17T03:33:24.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b777fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b780b5750 0x7f1b78145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b777fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b780b5750 0x7f1b78145fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52606/0 (socket says 172.21.15.146:52606) 2024-09-17T03:33:24.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b777fe640 1 -- 172.21.15.146:0/4283059598 learned_addr learned my addr 172.21.15.146:0/4283059598 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:24.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b77fff640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b780b3b60 0x7f1b781527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b7cfcd640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780b5ce0 0x7f1b78142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b777fe640 1 -- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b780b3b60 msgr2=0x7f1b781527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b777fe640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b780b3b60 0x7f1b781527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b777fe640 1 -- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780b5ce0 msgr2=0x7f1b78142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b777fe640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780b5ce0 0x7f1b78142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.616+0000 7f1b777fe640 1 -- 172.21.15.146:0/4283059598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b78157f40 con 0x7f1b780b5750 2024-09-17T03:33:24.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.617+0000 7f1b777fe640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b780b5750 0x7f1b78145fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00e9f0 tx=0x7f1b6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:24.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.617+0000 7f1b74ff9640 1 -- 172.21.15.146:0/4283059598 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c00cd80 con 0x7f1b780b5750 2024-09-17T03:33:24.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.617+0000 7f1b74ff9640 1 -- 172.21.15.146:0/4283059598 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b6c004020 con 0x7f1b780b5750 2024-09-17T03:33:24.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.617+0000 7f1b7ea30640 1 -- 172.21.15.146:0/4283059598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7809c820 con 0x7f1b780b5750 2024-09-17T03:33:24.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.617+0000 7f1b74ff9640 1 -- 172.21.15.146:0/4283059598 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c004470 con 0x7f1b780b5750 2024-09-17T03:33:24.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.617+0000 7f1b7ea30640 1 -- 172.21.15.146:0/4283059598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b781566c0 con 0x7f1b780b5750 2024-09-17T03:33:24.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.618+0000 7f1b7ea30640 1 -- 172.21.15.146:0/4283059598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b7809cd00 con 0x7f1b780b5750 2024-09-17T03:33:24.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.618+0000 7f1b74ff9640 1 -- 172.21.15.146:0/4283059598 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b6c0035f0 con 0x7f1b780b5750 2024-09-17T03:33:24.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.619+0000 7f1b74ff9640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b64078bc0 0x7f1b6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.619+0000 7f1b74ff9640 1 -- 172.21.15.146:0/4283059598 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1b6c09b630 con 0x7f1b780b5750 2024-09-17T03:33:24.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.619+0000 7f1b77fff640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b64078bc0 0x7f1b6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.620+0000 7f1b77fff640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b64078bc0 0x7f1b6407b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1b68034000 tx=0x7f1b68004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.623+0000 7f1b74ff9640 1 -- 172.21.15.146:0/4283059598 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b7809cd00 con 0x7f1b780b5750 2024-09-17T03:33:24.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.801+0000 7f1b7ea30640 1 -- 172.21.15.146:0/4283059598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1b780b2de0 con 0x7f1b780b5750 2024-09-17T03:33:24.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.802+0000 7f1b74ff9640 1 -- 172.21.15.146:0/4283059598 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f1b6c0633a0 con 0x7f1b780b5750 2024-09-17T03:33:24.801 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2024-09-17T03:33:24.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 -- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b64078bc0 msgr2=0x7f1b6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b64078bc0 0x7f1b6407b0d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1b68034000 tx=0x7f1b68004730 comp rx=0 tx=0).stop 2024-09-17T03:33:24.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 -- 172.21.15.146:0/4283059598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b780b5750 msgr2=0x7f1b78145fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b780b5750 0x7f1b78145fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00e9f0 tx=0x7f1b6c00eeb0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 -- 172.21.15.146:0/4283059598 shutdown_connections 2024-09-17T03:33:24.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b64078bc0 0x7f1b6407b0d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b780b5ce0 0x7f1b78142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b780b5750 0x7f1b78145fc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 --2- 172.21.15.146:0/4283059598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b780b3b60 0x7f1b781527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 -- 172.21.15.146:0/4283059598 >> 172.21.15.146:0/4283059598 conn(0x7f1b780b7b20 msgr2=0x7f1b780b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:24.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 -- 172.21.15.146:0/4283059598 shutdown_connections 2024-09-17T03:33:24.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.804+0000 7f1b7ea30640 1 -- 172.21.15.146:0/4283059598 wait complete. 2024-09-17T03:33:24.814 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T03:33:24.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.931+0000 7f5cb9d43640 1 -- 172.21.15.146:0/2416432699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb40b5750 msgr2=0x7f5cb40b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.931+0000 7f5cb9d43640 1 --2- 172.21.15.146:0/2416432699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb40b5750 0x7f5cb40b3620 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009830 tx=0x7f5ca802a510 comp rx=0 tx=0).stop 2024-09-17T03:33:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.931+0000 7f5cb9d43640 1 -- 172.21.15.146:0/2416432699 shutdown_connections 2024-09-17T03:33:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.931+0000 7f5cb9d43640 1 --2- 172.21.15.146:0/2416432699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb40b3b60 0x7f5cb415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.931+0000 7f5cb9d43640 1 --2- 172.21.15.146:0/2416432699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb40b5750 0x7f5cb40b3620 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.931+0000 7f5cb9d43640 1 -- 172.21.15.146:0/2416432699 >> 172.21.15.146:0/2416432699 conn(0x7f5cb40b7b20 msgr2=0x7f5cb409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.931+0000 7f5cb9d43640 1 -- 172.21.15.146:0/2416432699 shutdown_connections 2024-09-17T03:33:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.931+0000 7f5cb9d43640 1 -- 172.21.15.146:0/2416432699 wait complete. 2024-09-17T03:33:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.933+0000 7f5cb9d43640 1 Processor -- start 2024-09-17T03:33:24.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.933+0000 7f5cb9d43640 1 -- start start 2024-09-17T03:33:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.934+0000 7f5cb9d43640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb40b3b60 0x7f5cb41432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.934+0000 7f5cb9d43640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb40b5750 0x7f5cb4151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.934+0000 7f5cb9d43640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb40b5ce0 0x7f5cb41f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.934+0000 7f5cb9d43640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb415d4b0 con 0x7f5cb40b3b60 2024-09-17T03:33:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.934+0000 7f5cb9d43640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb415d330 con 0x7f5cb40b5750 2024-09-17T03:33:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.934+0000 7f5cb9d43640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb415d630 con 0x7f5cb40b5ce0 2024-09-17T03:33:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.934+0000 7f5cb37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb40b3b60 0x7f5cb41432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.934+0000 7f5cb37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb40b3b60 0x7f5cb41432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52626/0 (socket says 172.21.15.146:52626) 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.934+0000 7f5cb37fe640 1 -- 172.21.15.146:0/3820051725 learned_addr learned my addr 172.21.15.146:0/3820051725 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5cb3fff640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb40b5ce0 0x7f5cb41f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5cb2ffd640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb40b5750 0x7f5cb4151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5cb37fe640 1 -- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb40b5ce0 msgr2=0x7f5cb41f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5cb37fe640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb40b5ce0 0x7f5cb41f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5cb37fe640 1 -- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb40b5750 msgr2=0x7f5cb4151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5cb37fe640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb40b5750 0x7f5cb4151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5cb37fe640 1 -- 172.21.15.146:0/3820051725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb4150e20 con 0x7f5cb40b3b60 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5cb3fff640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb40b5ce0 0x7f5cb41f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5cb37fe640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb40b3b60 0x7f5cb41432c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5ca400c7a0 tx=0x7f5ca400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5c9bfff640 1 -- 172.21.15.146:0/3820051725 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4017070 con 0x7f5cb40b3b60 2024-09-17T03:33:24.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5c9bfff640 1 -- 172.21.15.146:0/3820051725 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ca4005070 con 0x7f5cb40b3b60 2024-09-17T03:33:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5cb9d43640 1 -- 172.21.15.146:0/3820051725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb4151100 con 0x7f5cb40b3b60 2024-09-17T03:33:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5c9bfff640 1 -- 172.21.15.146:0/3820051725 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca40054a0 con 0x7f5cb40b3b60 2024-09-17T03:33:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.935+0000 7f5cb9d43640 1 -- 172.21.15.146:0/3820051725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb41516c0 con 0x7f5cb40b3b60 2024-09-17T03:33:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.936+0000 7f5cb9d43640 1 -- 172.21.15.146:0/3820051725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb40b7440 con 0x7f5cb40b3b60 2024-09-17T03:33:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.937+0000 7f5c9bfff640 1 -- 172.21.15.146:0/3820051725 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ca401a070 con 0x7f5cb40b3b60 2024-09-17T03:33:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.937+0000 7f5c9bfff640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ca0078b90 0x7f5ca007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.938+0000 7f5c9bfff640 1 -- 172.21.15.146:0/3820051725 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5ca409a3c0 con 0x7f5cb40b3b60 2024-09-17T03:33:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.938+0000 7f5cb2ffd640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ca0078b90 0x7f5ca007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.938+0000 7f5cb2ffd640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ca0078b90 0x7f5ca007b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8034000 tx=0x7f5ca8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:24.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:24.942+0000 7f5c9bfff640 1 -- 172.21.15.146:0/3820051725 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5cb40b3f70 con 0x7f5cb40b3b60 2024-09-17T03:33:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.114+0000 7f5cb9d43640 1 -- 172.21.15.146:0/3820051725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5cb415ec60 con 0x7f5cb40b3b60 2024-09-17T03:33:25.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.115+0000 7f5c9bfff640 1 -- 172.21.15.146:0/3820051725 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f5ca4062800 con 0x7f5cb40b3b60 2024-09-17T03:33:25.114 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2024-09-17T03:33:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 -- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ca0078b90 msgr2=0x7f5ca007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ca0078b90 0x7f5ca007b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8034000 tx=0x7f5ca8004730 comp rx=0 tx=0).stop 2024-09-17T03:33:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 -- 172.21.15.146:0/3820051725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb40b3b60 msgr2=0x7f5cb41432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb40b3b60 0x7f5cb41432c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5ca400c7a0 tx=0x7f5ca400cc60 comp rx=0 tx=0).stop 2024-09-17T03:33:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 -- 172.21.15.146:0/3820051725 shutdown_connections 2024-09-17T03:33:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ca0078b90 0x7f5ca007b0a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5cb40b5ce0 0x7f5cb41f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5cb40b5750 0x7f5cb4151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 --2- 172.21.15.146:0/3820051725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb40b3b60 0x7f5cb41432c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 -- 172.21.15.146:0/3820051725 >> 172.21.15.146:0/3820051725 conn(0x7f5cb40b7b20 msgr2=0x7f5cb4156760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 -- 172.21.15.146:0/3820051725 shutdown_connections 2024-09-17T03:33:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.117+0000 7f5cb9d43640 1 -- 172.21.15.146:0/3820051725 wait complete. 2024-09-17T03:33:25.128 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-17T03:33:25.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.242+0000 7f35e5e7e640 1 -- 172.21.15.146:0/1624239937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35e00d0710 msgr2=0x7f35e00cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:25.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.242+0000 7f35e5e7e640 1 --2- 172.21.15.146:0/1624239937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35e00d0710 0x7f35e00cf170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009830 tx=0x7f35d002a480 comp rx=0 tx=0).stop 2024-09-17T03:33:25.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.243+0000 7f35e5e7e640 1 -- 172.21.15.146:0/1624239937 shutdown_connections 2024-09-17T03:33:25.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.243+0000 7f35e5e7e640 1 --2- 172.21.15.146:0/1624239937 >> v2:172.21.15.179:3300/0 conn(0x7f35e00cf6b0 0x7f35e0161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.243+0000 7f35e5e7e640 1 --2- 172.21.15.146:0/1624239937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35e00d0710 0x7f35e00cf170 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.243+0000 7f35e5e7e640 1 -- 172.21.15.146:0/1624239937 >> 172.21.15.146:0/1624239937 conn(0x7f35e009ba20 msgr2=0x7f35e00b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:25.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.243+0000 7f35e5e7e640 1 -- 172.21.15.146:0/1624239937 shutdown_connections 2024-09-17T03:33:25.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.243+0000 7f35e5e7e640 1 -- 172.21.15.146:0/1624239937 wait complete. 2024-09-17T03:33:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.244+0000 7f35e5e7e640 1 Processor -- start 2024-09-17T03:33:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.245+0000 7f35e5e7e640 1 -- start start 2024-09-17T03:33:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35e5e7e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35e00b47c0 0x7f35e015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35e5e7e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35e00cf6b0 0x7f35e01f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35e5e7e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35e00d0710 0x7f35e015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35e5e7e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f35e00b1de0 con 0x7f35e00b47c0 2024-09-17T03:33:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35e5e7e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f35e0162080 con 0x7f35e00d0710 2024-09-17T03:33:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35e5e7e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f35e00b1f60 con 0x7f35e00cf6b0 2024-09-17T03:33:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35df7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35e00b47c0 0x7f35e015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35df7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35e00b47c0 0x7f35e015ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52630/0 (socket says 172.21.15.146:52630) 2024-09-17T03:33:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35df7fe640 1 -- 172.21.15.146:0/731112875 learned_addr learned my addr 172.21.15.146:0/731112875 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:25.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35deffd640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35e00cf6b0 0x7f35e01f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35dffff640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35e00d0710 0x7f35e015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35df7fe640 1 -- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35e00cf6b0 msgr2=0x7f35e01f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35df7fe640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35e00cf6b0 0x7f35e01f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35df7fe640 1 -- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35e00d0710 msgr2=0x7f35e015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35df7fe640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35e00d0710 0x7f35e015ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35df7fe640 1 -- 172.21.15.146:0/731112875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e015d5c0 con 0x7f35e00b47c0 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.246+0000 7f35df7fe640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35e00b47c0 0x7f35e015ccc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f35d002aa70 tx=0x7f35d0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.247+0000 7f35c7fff640 1 -- 172.21.15.146:0/731112875 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0005c90 con 0x7f35e00b47c0 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.247+0000 7f35c7fff640 1 -- 172.21.15.146:0/731112875 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35d0031e50 con 0x7f35e00b47c0 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.247+0000 7f35e5e7e640 1 -- 172.21.15.146:0/731112875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e015d8a0 con 0x7f35e00b47c0 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.247+0000 7f35c7fff640 1 -- 172.21.15.146:0/731112875 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0005260 con 0x7f35e00b47c0 2024-09-17T03:33:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.247+0000 7f35e5e7e640 1 -- 172.21.15.146:0/731112875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e015de60 con 0x7f35e00b47c0 2024-09-17T03:33:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.248+0000 7f35e5e7e640 1 -- 172.21.15.146:0/731112875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e00cf170 con 0x7f35e00b47c0 2024-09-17T03:33:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.248+0000 7f35c7fff640 1 -- 172.21.15.146:0/731112875 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f35d0005400 con 0x7f35e00b47c0 2024-09-17T03:33:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.249+0000 7f35c7fff640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f35cc078b90 0x7f35cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.249+0000 7f35c7fff640 1 -- 172.21.15.146:0/731112875 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f35d00bbde0 con 0x7f35e00b47c0 2024-09-17T03:33:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.249+0000 7f35deffd640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f35cc078b90 0x7f35cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.250+0000 7f35deffd640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f35cc078b90 0x7f35cc07b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f35e00b6a30 tx=0x7f35d4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:25.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.253+0000 7f35c7fff640 1 -- 172.21.15.146:0/731112875 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f35d003f030 con 0x7f35e00b47c0 2024-09-17T03:33:25.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.495+0000 7f35e5e7e640 1 -- 172.21.15.146:0/731112875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f35e00ced70 con 0x7f35e00b47c0 2024-09-17T03:33:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.900+0000 7f35c7fff640 1 -- 172.21.15.146:0/731112875 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v46) ==== 151+0+0 (secure 0 0 0) 0x7f35d0083b50 con 0x7f35e00b47c0 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.902+0000 7f35e5e7e640 1 -- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f35cc078b90 msgr2=0x7f35cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.902+0000 7f35e5e7e640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f35cc078b90 0x7f35cc07b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f35e00b6a30 tx=0x7f35d4005f90 comp rx=0 tx=0).stop 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.902+0000 7f35e5e7e640 1 -- 172.21.15.146:0/731112875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35e00b47c0 msgr2=0x7f35e015ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.902+0000 7f35e5e7e640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35e00b47c0 0x7f35e015ccc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f35d002aa70 tx=0x7f35d0033c20 comp rx=0 tx=0).stop 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.902+0000 7f35e5e7e640 1 -- 172.21.15.146:0/731112875 shutdown_connections 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.902+0000 7f35e5e7e640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f35cc078b90 0x7f35cc07b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.902+0000 7f35e5e7e640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35e00d0710 0x7f35e015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.902+0000 7f35e5e7e640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35e00cf6b0 0x7f35e01f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.902+0000 7f35e5e7e640 1 --2- 172.21.15.146:0/731112875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35e00b47c0 0x7f35e015ccc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.902+0000 7f35e5e7e640 1 -- 172.21.15.146:0/731112875 >> 172.21.15.146:0/731112875 conn(0x7f35e009ba20 msgr2=0x7f35e00b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.903+0000 7f35e5e7e640 1 -- 172.21.15.146:0/731112875 shutdown_connections 2024-09-17T03:33:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:25.903+0000 7f35e5e7e640 1 -- 172.21.15.146:0/731112875 wait complete. 2024-09-17T03:33:25.913 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:33:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.028+0000 7fe4c218a640 1 -- 172.21.15.146:0/3925894443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc0b3d30 msgr2=0x7fe4bc1677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.028+0000 7fe4c218a640 1 --2- 172.21.15.146:0/3925894443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc0b3d30 0x7fe4bc1677c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4005fd0 tx=0x7fe4b402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.028+0000 7fe4c218a640 1 -- 172.21.15.146:0/3925894443 shutdown_connections 2024-09-17T03:33:26.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.028+0000 7fe4c218a640 1 --2- 172.21.15.146:0/3925894443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc0b3d30 0x7fe4bc1677c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.028+0000 7fe4c218a640 1 -- 172.21.15.146:0/3925894443 >> 172.21.15.146:0/3925894443 conn(0x7fe4bc0b7b20 msgr2=0x7fe4bc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:26.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.028+0000 7fe4c218a640 1 -- 172.21.15.146:0/3925894443 shutdown_connections 2024-09-17T03:33:26.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.028+0000 7fe4c218a640 1 -- 172.21.15.146:0/3925894443 wait complete. 2024-09-17T03:33:26.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.030+0000 7fe4c218a640 1 Processor -- start 2024-09-17T03:33:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.030+0000 7fe4c218a640 1 -- start start 2024-09-17T03:33:26.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.031+0000 7fe4c218a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc0b5750 0x7fe4bc14cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.031+0000 7fe4c218a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4bc0b5ce0 0x7fe4bc154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.031+0000 7fe4c218a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4bc14f150 0x7fe4bc14c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.031+0000 7fe4c218a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc167f10 con 0x7fe4bc0b5750 2024-09-17T03:33:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.031+0000 7fe4c218a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc15ddb0 con 0x7fe4bc0b5ce0 2024-09-17T03:33:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.031+0000 7fe4c218a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe4bc168090 con 0x7fe4bc14f150 2024-09-17T03:33:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.031+0000 7fe4bb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc0b5750 0x7fe4bc14cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.031+0000 7fe4bb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc0b5750 0x7fe4bc14cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52634/0 (socket says 172.21.15.146:52634) 2024-09-17T03:33:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.031+0000 7fe4bb7fe640 1 -- 172.21.15.146:0/2566343816 learned_addr learned my addr 172.21.15.146:0/2566343816 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.031+0000 7fe4baffd640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4bc0b5ce0 0x7fe4bc154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.031+0000 7fe4bbfff640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4bc14f150 0x7fe4bc14c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.032+0000 7fe4bb7fe640 1 -- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4bc14f150 msgr2=0x7fe4bc14c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.032+0000 7fe4bb7fe640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4bc14f150 0x7fe4bc14c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.032+0000 7fe4bb7fe640 1 -- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4bc0b5ce0 msgr2=0x7fe4bc154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.032+0000 7fe4bb7fe640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4bc0b5ce0 0x7fe4bc154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.032+0000 7fe4bb7fe640 1 -- 172.21.15.146:0/2566343816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc14c990 con 0x7fe4bc0b5750 2024-09-17T03:33:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.032+0000 7fe4bb7fe640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc0b5750 0x7fe4bc14cbe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00c430 tx=0x7fe4ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.032+0000 7fe4a3fff640 1 -- 172.21.15.146:0/2566343816 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac017070 con 0x7fe4bc0b5750 2024-09-17T03:33:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.032+0000 7fe4a3fff640 1 -- 172.21.15.146:0/2566343816 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4ac0053c0 con 0x7fe4bc0b5750 2024-09-17T03:33:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.032+0000 7fe4c218a640 1 -- 172.21.15.146:0/2566343816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4bc14d430 con 0x7fe4bc0b5750 2024-09-17T03:33:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.032+0000 7fe4a3fff640 1 -- 172.21.15.146:0/2566343816 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac003850 con 0x7fe4bc0b5750 2024-09-17T03:33:26.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.032+0000 7fe4c218a640 1 -- 172.21.15.146:0/2566343816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4bc14d9f0 con 0x7fe4bc0b5750 2024-09-17T03:33:26.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.033+0000 7fe4c218a640 1 -- 172.21.15.146:0/2566343816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4bc0b1320 con 0x7fe4bc0b5750 2024-09-17T03:33:26.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.034+0000 7fe4a3fff640 1 -- 172.21.15.146:0/2566343816 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe4ac01a070 con 0x7fe4bc0b5750 2024-09-17T03:33:26.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.034+0000 7fe4a3fff640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe4a8078b90 0x7fe4a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.034+0000 7fe4a3fff640 1 -- 172.21.15.146:0/2566343816 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe4ac09a090 con 0x7fe4bc0b5750 2024-09-17T03:33:26.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.035+0000 7fe4baffd640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe4a8078b90 0x7fe4a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.035+0000 7fe4baffd640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe4a8078b90 0x7fe4a807b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0d2950 tx=0x7fe4b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:26.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.039+0000 7fe4a3fff640 1 -- 172.21.15.146:0/2566343816 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe4ac061e80 con 0x7fe4bc0b5750 2024-09-17T03:33:26.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.212+0000 7fe4c218a640 1 -- 172.21.15.146:0/2566343816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe4bc15a0a0 con 0x7fe4bc0b5750 2024-09-17T03:33:26.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.213+0000 7fe4a3fff640 1 -- 172.21.15.146:0/2566343816 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7fe4ac0668b0 con 0x7fe4bc0b5750 2024-09-17T03:33:26.212 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:33:26.212 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:33:26.212 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:33:26.212 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:33:26.213 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:33:26.214 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:33:26.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 -- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe4a8078b90 msgr2=0x7fe4a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe4a8078b90 0x7fe4a807b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0d2950 tx=0x7fe4b0009040 comp rx=0 tx=0).stop 2024-09-17T03:33:26.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 -- 172.21.15.146:0/2566343816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc0b5750 msgr2=0x7fe4bc14cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc0b5750 0x7fe4bc14cbe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00c430 tx=0x7fe4ac00c8f0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 -- 172.21.15.146:0/2566343816 shutdown_connections 2024-09-17T03:33:26.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe4a8078b90 0x7fe4a807b0a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe4bc14f150 0x7fe4bc14c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe4bc0b5ce0 0x7fe4bc154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 --2- 172.21.15.146:0/2566343816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4bc0b5750 0x7fe4bc14cbe0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 -- 172.21.15.146:0/2566343816 >> 172.21.15.146:0/2566343816 conn(0x7fe4bc0b7b20 msgr2=0x7fe4bc0d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:26.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 -- 172.21.15.146:0/2566343816 shutdown_connections 2024-09-17T03:33:26.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.215+0000 7fe4c218a640 1 -- 172.21.15.146:0/2566343816 wait complete. 2024-09-17T03:33:26.226 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:33:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.343+0000 7ff4832e5640 1 -- 172.21.15.146:0/3487144197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47c0cfca0 msgr2=0x7ff47c0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.343+0000 7ff4832e5640 1 --2- 172.21.15.146:0/3487144197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47c0cfca0 0x7ff47c0cef40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff47c068f10 tx=0x7ff46c02a480 comp rx=0 tx=0).stop 2024-09-17T03:33:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.343+0000 7ff4832e5640 1 -- 172.21.15.146:0/3487144197 shutdown_connections 2024-09-17T03:33:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.343+0000 7ff4832e5640 1 --2- 172.21.15.146:0/3487144197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47c0cfca0 0x7ff47c0cef40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.343+0000 7ff4832e5640 1 -- 172.21.15.146:0/3487144197 >> 172.21.15.146:0/3487144197 conn(0x7ff47c0d11f0 msgr2=0x7ff47c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.343+0000 7ff4832e5640 1 -- 172.21.15.146:0/3487144197 shutdown_connections 2024-09-17T03:33:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.343+0000 7ff4832e5640 1 -- 172.21.15.146:0/3487144197 wait complete. 2024-09-17T03:33:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.345+0000 7ff4832e5640 1 Processor -- start 2024-09-17T03:33:26.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.345+0000 7ff4832e5640 1 -- start start 2024-09-17T03:33:26.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff4832e5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47c0b61f0 0x7ff47c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff4832e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47c0cfca0 0x7ff47c15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff4832e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47c15f1a0 0x7ff47c15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff4832e5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c069660 con 0x7ff47c0b61f0 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff4832e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c0694e0 con 0x7ff47c15f1a0 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff4832e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff47c0697e0 con 0x7ff47c0cfca0 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff481081640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47c0b61f0 0x7ff47c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff481081640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47c0b61f0 0x7ff47c0ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52650/0 (socket says 172.21.15.146:52650) 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff481081640 1 -- 172.21.15.146:0/2155031574 learned_addr learned my addr 172.21.15.146:0/2155031574 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff480880640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47c0cfca0 0x7ff47c15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff481882640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47c15f1a0 0x7ff47c15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff481081640 1 -- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47c0cfca0 msgr2=0x7ff47c15b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff481081640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47c0cfca0 0x7ff47c15b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff481081640 1 -- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47c15f1a0 msgr2=0x7ff47c15ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff481081640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47c15f1a0 0x7ff47c15ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff481081640 1 -- 172.21.15.146:0/2155031574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47c14da30 con 0x7ff47c0b61f0 2024-09-17T03:33:26.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.346+0000 7ff481882640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47c15f1a0 0x7ff47c15ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:33:26.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.347+0000 7ff481081640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47c0b61f0 0x7ff47c0ce350 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff47800c3c0 tx=0x7ff47800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:26.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.347+0000 7ff471ffb640 1 -- 172.21.15.146:0/2155031574 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff478017070 con 0x7ff47c0b61f0 2024-09-17T03:33:26.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.347+0000 7ff471ffb640 1 -- 172.21.15.146:0/2155031574 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4780035f0 con 0x7ff47c0b61f0 2024-09-17T03:33:26.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.347+0000 7ff4832e5640 1 -- 172.21.15.146:0/2155031574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47c0cb270 con 0x7ff47c0b61f0 2024-09-17T03:33:26.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.347+0000 7ff471ffb640 1 -- 172.21.15.146:0/2155031574 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff478003a80 con 0x7ff47c0b61f0 2024-09-17T03:33:26.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.347+0000 7ff4832e5640 1 -- 172.21.15.146:0/2155031574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff47c15ad50 con 0x7ff47c0b61f0 2024-09-17T03:33:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.348+0000 7ff4832e5640 1 -- 172.21.15.146:0/2155031574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff47c069c70 con 0x7ff47c0b61f0 2024-09-17T03:33:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.349+0000 7ff471ffb640 1 -- 172.21.15.146:0/2155031574 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff47801a070 con 0x7ff47c0b61f0 2024-09-17T03:33:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.349+0000 7ff471ffb640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff460078bc0 0x7ff46007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.349+0000 7ff471ffb640 1 -- 172.21.15.146:0/2155031574 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff478099f10 con 0x7ff47c0b61f0 2024-09-17T03:33:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.349+0000 7ff480880640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff460078bc0 0x7ff46007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.350+0000 7ff480880640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff460078bc0 0x7ff46007b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff46c034000 tx=0x7ff46c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:26.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.354+0000 7ff471ffb640 1 -- 172.21.15.146:0/2155031574 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff478062470 con 0x7ff47c0b61f0 2024-09-17T03:33:26.359 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:33:26.361 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:33:26.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.535+0000 7ff4832e5640 1 -- 172.21.15.146:0/2155031574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff47c0c7ff0 con 0x7ff47c0b61f0 2024-09-17T03:33:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.539+0000 7ff471ffb640 1 -- 172.21.15.146:0/2155031574 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7ff478061d70 con 0x7ff47c0b61f0 2024-09-17T03:33:26.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 -- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff460078bc0 msgr2=0x7ff46007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff460078bc0 0x7ff46007b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff46c034000 tx=0x7ff46c004730 comp rx=0 tx=0).stop 2024-09-17T03:33:26.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 -- 172.21.15.146:0/2155031574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47c0b61f0 msgr2=0x7ff47c0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47c0b61f0 0x7ff47c0ce350 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff47800c3c0 tx=0x7ff47800c880 comp rx=0 tx=0).stop 2024-09-17T03:33:26.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 -- 172.21.15.146:0/2155031574 shutdown_connections 2024-09-17T03:33:26.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff460078bc0 0x7ff46007b0d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff47c15f1a0 0x7ff47c15ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff47c0cfca0 0x7ff47c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 --2- 172.21.15.146:0/2155031574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff47c0b61f0 0x7ff47c0ce350 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 -- 172.21.15.146:0/2155031574 >> 172.21.15.146:0/2155031574 conn(0x7ff47c0d11f0 msgr2=0x7ff47c0b9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:26.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 -- 172.21.15.146:0/2155031574 shutdown_connections 2024-09-17T03:33:26.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.541+0000 7ff4832e5640 1 -- 172.21.15.146:0/2155031574 wait complete. 2024-09-17T03:33:26.551 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:33:26.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:33:26.594 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:33:26.637 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:33:26.637 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:33:26.637 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:26.654 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:33:26.654 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:26.711 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:33:26.711 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:26.767 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:33:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.924+0000 7f8c9abc6640 1 -- 172.21.15.146:0/1671327772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c940b4ec0 msgr2=0x7f8c940b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.924+0000 7f8c9abc6640 1 --2- 172.21.15.146:0/1671327772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c940b4ec0 0x7f8c940b52d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009830 tx=0x7f8c7c02a480 comp rx=0 tx=0).stop 2024-09-17T03:33:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.924+0000 7f8c9abc6640 1 -- 172.21.15.146:0/1671327772 shutdown_connections 2024-09-17T03:33:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.924+0000 7f8c9abc6640 1 --2- 172.21.15.146:0/1671327772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c940b4ec0 0x7f8c940b52d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.924+0000 7f8c9abc6640 1 --2- 172.21.15.146:0/1671327772 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c940b3d00 0x7f8c940b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.924+0000 7f8c9abc6640 1 -- 172.21.15.146:0/1671327772 >> 172.21.15.146:0/1671327772 conn(0x7f8c940b2e20 msgr2=0x7f8c940b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.924+0000 7f8c9abc6640 1 -- 172.21.15.146:0/1671327772 shutdown_connections 2024-09-17T03:33:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.924+0000 7f8c9abc6640 1 -- 172.21.15.146:0/1671327772 wait complete. 2024-09-17T03:33:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.925+0000 7f8c9abc6640 1 Processor -- start 2024-09-17T03:33:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.925+0000 7f8c9abc6640 1 -- start start 2024-09-17T03:33:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c9abc6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c940ae6f0 0x7f8c941418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c9abc6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c940b3d00 0x7f8c94073200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c9abc6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c940b4ec0 0x7f8c94073740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c9abc6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8c94074ba0 con 0x7f8c940b3d00 2024-09-17T03:33:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c9abc6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8c94074a20 con 0x7f8c940b4ec0 2024-09-17T03:33:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c9abc6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8c940aeb00 con 0x7f8c940ae6f0 2024-09-17T03:33:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c93fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c940b3d00 0x7f8c94073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c93fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c940b3d00 0x7f8c94073200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52662/0 (socket says 172.21.15.146:52662) 2024-09-17T03:33:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c93fff640 1 -- 172.21.15.146:0/690388515 learned_addr learned my addr 172.21.15.146:0/690388515 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c98962640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c940ae6f0 0x7f8c941418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c99163640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c940b4ec0 0x7f8c94073740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c93fff640 1 -- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c940ae6f0 msgr2=0x7f8c941418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c93fff640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c940ae6f0 0x7f8c941418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c93fff640 1 -- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c940b4ec0 msgr2=0x7f8c94073740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c93fff640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c940b4ec0 0x7f8c94073740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c93fff640 1 -- 172.21.15.146:0/690388515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c940cbf10 con 0x7f8c940b3d00 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c99163640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c940b4ec0 0x7f8c94073740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.927+0000 7f8c98962640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c940ae6f0 0x7f8c941418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.928+0000 7f8c93fff640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c940b3d00 0x7f8c94073200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009950 tx=0x7f8c7c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.928+0000 7f8c917fa640 1 -- 172.21.15.146:0/690388515 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c005c90 con 0x7f8c940b3d00 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.928+0000 7f8c9abc6640 1 -- 172.21.15.146:0/690388515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c940cc1f0 con 0x7f8c940b3d00 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.928+0000 7f8c917fa640 1 -- 172.21.15.146:0/690388515 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c7c031e50 con 0x7f8c940b3d00 2024-09-17T03:33:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.928+0000 7f8c917fa640 1 -- 172.21.15.146:0/690388515 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c005260 con 0x7f8c940b3d00 2024-09-17T03:33:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.928+0000 7f8c9abc6640 1 -- 172.21.15.146:0/690388515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c940cc7b0 con 0x7f8c940b3d00 2024-09-17T03:33:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.929+0000 7f8c9abc6640 1 -- 172.21.15.146:0/690388515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c940cade0 con 0x7f8c940b3d00 2024-09-17T03:33:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.930+0000 7f8c917fa640 1 -- 172.21.15.146:0/690388515 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c7c005400 con 0x7f8c940b3d00 2024-09-17T03:33:26.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.930+0000 7f8c917fa640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8c78078b90 0x7f8c7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.930+0000 7f8c917fa640 1 -- 172.21.15.146:0/690388515 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8c7c0bc240 con 0x7f8c940b3d00 2024-09-17T03:33:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.931+0000 7f8c98962640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8c78078b90 0x7f8c7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.931+0000 7f8c98962640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8c78078b90 0x7f8c7807b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c005fd0 tx=0x7f8c8c009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:26.934+0000 7f8c917fa640 1 -- 172.21.15.146:0/690388515 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8c7c03f030 con 0x7f8c940b3d00 2024-09-17T03:33:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.118+0000 7f8c9abc6640 1 -- 172.21.15.146:0/690388515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8c940b4110 con 0x7f8c940b3d00 2024-09-17T03:33:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.118+0000 7f8c917fa640 1 -- 172.21.15.146:0/690388515 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f8c7c084700 con 0x7f8c940b3d00 2024-09-17T03:33:27.117 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:33:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.120+0000 7f8c9abc6640 1 -- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8c78078b90 msgr2=0x7f8c7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.121+0000 7f8c9abc6640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8c78078b90 0x7f8c7807b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c005fd0 tx=0x7f8c8c009500 comp rx=0 tx=0).stop 2024-09-17T03:33:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.121+0000 7f8c9abc6640 1 -- 172.21.15.146:0/690388515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c940b3d00 msgr2=0x7f8c94073200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.121+0000 7f8c9abc6640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c940b3d00 0x7f8c94073200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009950 tx=0x7f8c7c033c20 comp rx=0 tx=0).stop 2024-09-17T03:33:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.121+0000 7f8c9abc6640 1 -- 172.21.15.146:0/690388515 shutdown_connections 2024-09-17T03:33:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.121+0000 7f8c9abc6640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8c78078b90 0x7f8c7807b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.121+0000 7f8c9abc6640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c940b4ec0 0x7f8c94073740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.121+0000 7f8c9abc6640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c940b3d00 0x7f8c94073200 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.121+0000 7f8c9abc6640 1 --2- 172.21.15.146:0/690388515 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8c940ae6f0 0x7f8c941418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.121+0000 7f8c9abc6640 1 -- 172.21.15.146:0/690388515 >> 172.21.15.146:0/690388515 conn(0x7f8c940b2e20 msgr2=0x7f8c9415a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.121+0000 7f8c9abc6640 1 -- 172.21.15.146:0/690388515 shutdown_connections 2024-09-17T03:33:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.121+0000 7f8c9abc6640 1 -- 172.21.15.146:0/690388515 wait complete. 2024-09-17T03:33:27.131 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:33:27.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:27.131 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T03:33:27.157 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:33:27.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:27.157 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:33:27.221 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:33:27.221 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:27.240 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:33:27.240 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:27.298 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:33:27.298 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:27.355 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:33:27.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.471+0000 7f9d2580e640 1 -- 172.21.15.146:0/2580814916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d0c004800 msgr2=0x7f9d0c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:27.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.471+0000 7f9d2580e640 1 --2- 172.21.15.146:0/2580814916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d0c004800 0x7f9d0c004c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9d08001830 tx=0x7f9d0c005830 comp rx=0 tx=0).stop 2024-09-17T03:33:27.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.471+0000 7f9d1f7fe640 1 -- 172.21.15.146:0/2580814916 reap_dead start 2024-09-17T03:33:27.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.471+0000 7f9d2580e640 1 -- 172.21.15.146:0/2580814916 shutdown_connections 2024-09-17T03:33:27.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.471+0000 7f9d2580e640 1 -- 172.21.15.146:0/2580814916 >> 172.21.15.146:0/2580814916 conn(0x7f9d200d4be0 msgr2=0x7f9d200d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:27.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.471+0000 7f9d2580e640 1 -- 172.21.15.146:0/2580814916 shutdown_connections 2024-09-17T03:33:27.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.471+0000 7f9d2580e640 1 -- 172.21.15.146:0/2580814916 wait complete. 2024-09-17T03:33:27.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.473+0000 7f9d2580e640 1 Processor -- start 2024-09-17T03:33:27.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.473+0000 7f9d2580e640 1 -- start start 2024-09-17T03:33:27.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d2580e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d0c004800 0x7f9d2014edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:27.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d2580e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200cb8a0 0x7f9d200cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:27.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d2580e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d200cde30 0x7f9d201f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:27.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d2580e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9d200d4320 con 0x7f9d200cde30 2024-09-17T03:33:27.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d2580e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9d200d41a0 con 0x7f9d0c004800 2024-09-17T03:33:27.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d2580e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9d200d44a0 con 0x7f9d200cb8a0 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d1f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d200cde30 0x7f9d201f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d1f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d200cde30 0x7f9d201f6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39032/0 (socket says 172.21.15.146:39032) 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d1f7fe640 1 -- 172.21.15.146:0/1328684577 learned_addr learned my addr 172.21.15.146:0/1328684577 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d17fff640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200cb8a0 0x7f9d200cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d1effd640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d0c004800 0x7f9d2014edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d1f7fe640 1 -- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200cb8a0 msgr2=0x7f9d200cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d1f7fe640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200cb8a0 0x7f9d200cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d1f7fe640 1 -- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d0c004800 msgr2=0x7f9d2014edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d1f7fe640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d0c004800 0x7f9d2014edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.474+0000 7f9d1f7fe640 1 -- 172.21.15.146:0/1328684577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d200ce240 con 0x7f9d200cde30 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.475+0000 7f9d1f7fe640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d200cde30 0x7f9d201f6110 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d200b37b0 tx=0x7f9d1800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.475+0000 7f9d1cff9640 1 -- 172.21.15.146:0/1328684577 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18004b20 con 0x7f9d200cde30 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.475+0000 7f9d1cff9640 1 -- 172.21.15.146:0/1328684577 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d18004cc0 con 0x7f9d200cde30 2024-09-17T03:33:27.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.475+0000 7f9d2580e640 1 -- 172.21.15.146:0/1328684577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d200b4eb0 con 0x7f9d200cde30 2024-09-17T03:33:27.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.475+0000 7f9d1cff9640 1 -- 172.21.15.146:0/1328684577 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18003bd0 con 0x7f9d200cde30 2024-09-17T03:33:27.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.475+0000 7f9d2580e640 1 -- 172.21.15.146:0/1328684577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d200b5470 con 0x7f9d200cde30 2024-09-17T03:33:27.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.476+0000 7f9d2580e640 1 -- 172.21.15.146:0/1328684577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d201620f0 con 0x7f9d200cde30 2024-09-17T03:33:27.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.477+0000 7f9d1cff9640 1 -- 172.21.15.146:0/1328684577 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d18004030 con 0x7f9d200cde30 2024-09-17T03:33:27.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.477+0000 7f9d1cff9640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d00078bc0 0x7f9d0007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:27.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.477+0000 7f9d1cff9640 1 -- 172.21.15.146:0/1328684577 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9d1809b410 con 0x7f9d200cde30 2024-09-17T03:33:27.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.477+0000 7f9d1effd640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d00078bc0 0x7f9d0007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:27.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.478+0000 7f9d1effd640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d00078bc0 0x7f9d0007b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9d10006b20 tx=0x7f9d10000f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:27.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.482+0000 7f9d1cff9640 1 -- 172.21.15.146:0/1328684577 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9d200ce240 con 0x7f9d200cde30 2024-09-17T03:33:27.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.667+0000 7f9d2580e640 1 -- 172.21.15.146:0/1328684577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9d200d52a0 con 0x7f9d200cde30 2024-09-17T03:33:27.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.668+0000 7f9d1cff9640 1 -- 172.21.15.146:0/1328684577 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f9d180638e0 con 0x7f9d200cde30 2024-09-17T03:33:27.667 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 -- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d00078bc0 msgr2=0x7f9d0007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d00078bc0 0x7f9d0007b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9d10006b20 tx=0x7f9d10000f30 comp rx=0 tx=0).stop 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 -- 172.21.15.146:0/1328684577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d200cde30 msgr2=0x7f9d201f6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d200cde30 0x7f9d201f6110 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d200b37b0 tx=0x7f9d1800f3c0 comp rx=0 tx=0).stop 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 -- 172.21.15.146:0/1328684577 shutdown_connections 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d00078bc0 0x7f9d0007b0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d200cde30 0x7f9d201f6110 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d200cb8a0 0x7f9d200cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 --2- 172.21.15.146:0/1328684577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d0c004800 0x7f9d2014edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 -- 172.21.15.146:0/1328684577 >> 172.21.15.146:0/1328684577 conn(0x7f9d200d4be0 msgr2=0x7f9d20161510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 -- 172.21.15.146:0/1328684577 shutdown_connections 2024-09-17T03:33:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:27.670+0000 7f9d2580e640 1 -- 172.21.15.146:0/1328684577 wait complete. 2024-09-17T03:33:27.682 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:33:27.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:27.683 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-17T03:33:27.715 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:33:27.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:27.715 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:33:27.786 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:33:27.786 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:27.802 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:33:27.802 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:27.858 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:33:27.858 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:27.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:33:28.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.069+0000 7f07bcf4a640 1 -- 172.21.15.146:0/4173429971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b80b3d30 msgr2=0x7f07b815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.069+0000 7f07bcf4a640 1 --2- 172.21.15.146:0/4173429971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b80b3d30 0x7f07b815caa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f07b0005fd0 tx=0x7f07b002aa00 comp rx=0 tx=0).stop 2024-09-17T03:33:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.069+0000 7f07bcf4a640 1 -- 172.21.15.146:0/4173429971 shutdown_connections 2024-09-17T03:33:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.069+0000 7f07bcf4a640 1 --2- 172.21.15.146:0/4173429971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b80b3d30 0x7f07b815caa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.069+0000 7f07bcf4a640 1 --2- 172.21.15.146:0/4173429971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07b80b5ce0 0x7f07b80b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.069+0000 7f07bcf4a640 1 -- 172.21.15.146:0/4173429971 >> 172.21.15.146:0/4173429971 conn(0x7f07b80b7b20 msgr2=0x7f07b809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.069+0000 7f07bcf4a640 1 -- 172.21.15.146:0/4173429971 shutdown_connections 2024-09-17T03:33:28.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.069+0000 7f07bcf4a640 1 -- 172.21.15.146:0/4173429971 wait complete. 2024-09-17T03:33:28.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.071+0000 7f07bcf4a640 1 Processor -- start 2024-09-17T03:33:28.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.071+0000 7f07bcf4a640 1 -- start start 2024-09-17T03:33:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.072+0000 7f07bcf4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b80b5750 0x7f07b8153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.072+0000 7f07bcf4a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07b80b5ce0 0x7f07b81f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.072+0000 7f07bcf4a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07b8156720 0x7f07b8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.072+0000 7f07bcf4a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f07b815d460 con 0x7f07b80b5750 2024-09-17T03:33:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.072+0000 7f07bcf4a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f07b815d2e0 con 0x7f07b80b5ce0 2024-09-17T03:33:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.072+0000 7f07bcf4a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f07b815d5e0 con 0x7f07b8156720 2024-09-17T03:33:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07b659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b80b5750 0x7f07b8153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07b659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b80b5750 0x7f07b8153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39062/0 (socket says 172.21.15.146:39062) 2024-09-17T03:33:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07b659c640 1 -- 172.21.15.146:0/1948566603 learned_addr learned my addr 172.21.15.146:0/1948566603 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07b6d9d640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07b8156720 0x7f07b8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:28.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07b5d9b640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07b80b5ce0 0x7f07b81f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:28.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07b659c640 1 -- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07b8156720 msgr2=0x7f07b8156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:28.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07b659c640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07b8156720 0x7f07b8156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07b659c640 1 -- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07b80b5ce0 msgr2=0x7f07b81f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:28.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07b659c640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07b80b5ce0 0x7f07b81f3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07b659c640 1 -- 172.21.15.146:0/1948566603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b8157070 con 0x7f07b80b5750 2024-09-17T03:33:28.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07b659c640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b80b5750 0x7f07b8153740 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07a800d700 tx=0x7f07a800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:28.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07a6ffd640 1 -- 172.21.15.146:0/1948566603 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a8017070 con 0x7f07b80b5750 2024-09-17T03:33:28.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07a6ffd640 1 -- 172.21.15.146:0/1948566603 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07a8005310 con 0x7f07b80b5750 2024-09-17T03:33:28.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07bcf4a640 1 -- 172.21.15.146:0/1948566603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b8153c80 con 0x7f07b80b5750 2024-09-17T03:33:28.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07a6ffd640 1 -- 172.21.15.146:0/1948566603 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a8009820 con 0x7f07b80b5750 2024-09-17T03:33:28.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.073+0000 7f07bcf4a640 1 -- 172.21.15.146:0/1948566603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b8154f90 con 0x7f07b80b5750 2024-09-17T03:33:28.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.074+0000 7f07bcf4a640 1 -- 172.21.15.146:0/1948566603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b815daa0 con 0x7f07b80b5750 2024-09-17T03:33:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.075+0000 7f07a6ffd640 1 -- 172.21.15.146:0/1948566603 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07a80099c0 con 0x7f07b80b5750 2024-09-17T03:33:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.076+0000 7f07a6ffd640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0798078b90 0x7f079807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.076+0000 7f07a6ffd640 1 -- 172.21.15.146:0/1948566603 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f07a809ad00 con 0x7f07b80b5750 2024-09-17T03:33:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.076+0000 7f07b5d9b640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0798078b90 0x7f079807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.077+0000 7f07b5d9b640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0798078b90 0x7f079807b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f07b80a0890 tx=0x7f07ac009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.080+0000 7f07a6ffd640 1 -- 172.21.15.146:0/1948566603 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f07b8157070 con 0x7f07b80b5750 2024-09-17T03:33:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.264+0000 7f07bcf4a640 1 -- 172.21.15.146:0/1948566603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f07b8158bc0 con 0x7f07b80b5750 2024-09-17T03:33:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.265+0000 7f07a6ffd640 1 -- 172.21.15.146:0/1948566603 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f07a8062c10 con 0x7f07b80b5750 2024-09-17T03:33:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:33:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 -- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0798078b90 msgr2=0x7f079807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0798078b90 0x7f079807b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f07b80a0890 tx=0x7f07ac009060 comp rx=0 tx=0).stop 2024-09-17T03:33:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 -- 172.21.15.146:0/1948566603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b80b5750 msgr2=0x7f07b8153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b80b5750 0x7f07b8153740 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07a800d700 tx=0x7f07a800dbc0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 -- 172.21.15.146:0/1948566603 shutdown_connections 2024-09-17T03:33:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0798078b90 0x7f079807b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07b8156720 0x7f07b8156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07b80b5ce0 0x7f07b81f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 --2- 172.21.15.146:0/1948566603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07b80b5750 0x7f07b8153740 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 -- 172.21.15.146:0/1948566603 >> 172.21.15.146:0/1948566603 conn(0x7f07b80b7b20 msgr2=0x7f07b8159770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:28.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 -- 172.21.15.146:0/1948566603 shutdown_connections 2024-09-17T03:33:28.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.269+0000 7f07bcf4a640 1 -- 172.21.15.146:0/1948566603 wait complete. 2024-09-17T03:33:28.284 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T03:33:28.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:28.285 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-17T03:33:28.323 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:33:28.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:28.323 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T03:33:28.379 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:33:28.379 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:28.399 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:33:28.399 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:28.458 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:33:28.458 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:28.517 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:33:28.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.633+0000 7f4f00486640 1 -- 172.21.15.146:0/238747845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee0003a50 msgr2=0x7f4ee0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:28.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.633+0000 7f4f00486640 1 --2- 172.21.15.146:0/238747845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee0003a50 0x7f4ee0003ec0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c610 tx=0x7f4ee0005830 comp rx=0 tx=0).stop 2024-09-17T03:33:28.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.633+0000 7f4f00486640 1 -- 172.21.15.146:0/238747845 shutdown_connections 2024-09-17T03:33:28.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.633+0000 7f4f00486640 1 --2- 172.21.15.146:0/238747845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee0003a50 0x7f4ee0003ec0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.633+0000 7f4f00486640 1 -- 172.21.15.146:0/238747845 >> 172.21.15.146:0/238747845 conn(0x7f4ef80b7b20 msgr2=0x7f4ef809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:28.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.633+0000 7f4f00486640 1 -- 172.21.15.146:0/238747845 shutdown_connections 2024-09-17T03:33:28.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.633+0000 7f4f00486640 1 -- 172.21.15.146:0/238747845 wait complete. 2024-09-17T03:33:28.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.634+0000 7f4f00486640 1 Processor -- start 2024-09-17T03:33:28.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.635+0000 7f4f00486640 1 -- start start 2024-09-17T03:33:28.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4f00486640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ee0003a50 0x7f4ef806dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:28.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4f00486640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ef81f5f30 0x7f4ef8143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:28.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4f00486640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef81f8ad0 0x7f4ef81f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:28.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4f00486640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef80b3620 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4f00486640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef80b1750 con 0x7f4ee0003a50 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4f00486640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef80b37a0 con 0x7f4ef81f5f30 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4efea23640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef81f8ad0 0x7f4ef81f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4efea23640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef81f8ad0 0x7f4ef81f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39090/0 (socket says 172.21.15.146:39090) 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4efea23640 1 -- 172.21.15.146:0/2761645819 learned_addr learned my addr 172.21.15.146:0/2761645819 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4efe222640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ee0003a50 0x7f4ef806dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4efda21640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ef81f5f30 0x7f4ef8143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4efea23640 1 -- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ef81f5f30 msgr2=0x7f4ef8143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4efea23640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ef81f5f30 0x7f4ef8143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4efea23640 1 -- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ee0003a50 msgr2=0x7f4ef806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4efea23640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ee0003a50 0x7f4ef806dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4efea23640 1 -- 172.21.15.146:0/2761645819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef81f9940 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.636+0000 7f4efea23640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef81f8ad0 0x7f4ef81f8ee0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80b1a30 tx=0x7f4ef000fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.637+0000 7f4ef6ffd640 1 -- 172.21.15.146:0/2761645819 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0005220 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.637+0000 7f4ef6ffd640 1 -- 172.21.15.146:0/2761645819 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ef00054b0 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.637+0000 7f4ef6ffd640 1 -- 172.21.15.146:0/2761645819 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0004a00 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.637+0000 7f4f00486640 1 -- 172.21.15.146:0/2761645819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef81f9420 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.637+0000 7f4f00486640 1 -- 172.21.15.146:0/2761645819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef8143e70 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.637+0000 7f4f00486640 1 -- 172.21.15.146:0/2761645819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef815ccd0 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.638+0000 7f4ef6ffd640 1 -- 172.21.15.146:0/2761645819 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4ef0019030 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.639+0000 7f4ef6ffd640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ee4078b90 0x7f4ee407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.639+0000 7f4ef6ffd640 1 -- 172.21.15.146:0/2761645819 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4ef009af60 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.639+0000 7f4efe222640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ee4078b90 0x7f4ee407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.640+0000 7f4efe222640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ee4078b90 0x7f4ee407b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8033000 tx=0x7f4ef80b6180 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.643+0000 7f4ef6ffd640 1 -- 172.21.15.146:0/2761645819 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4ef81f9420 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.830+0000 7f4f00486640 1 -- 172.21.15.146:0/2761645819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4ef80b3d00 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.831+0000 7f4ef6ffd640 1 -- 172.21.15.146:0/2761645819 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f4ef0062de0 con 0x7f4ef81f8ad0 2024-09-17T03:33:28.830 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:33:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 -- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ee4078b90 msgr2=0x7f4ee407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ee4078b90 0x7f4ee407b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8033000 tx=0x7f4ef80b6180 comp rx=0 tx=0).stop 2024-09-17T03:33:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 -- 172.21.15.146:0/2761645819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef81f8ad0 msgr2=0x7f4ef81f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:28.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef81f8ad0 0x7f4ef81f8ee0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80b1a30 tx=0x7f4ef000fa20 comp rx=0 tx=0).stop 2024-09-17T03:33:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 -- 172.21.15.146:0/2761645819 shutdown_connections 2024-09-17T03:33:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ee4078b90 0x7f4ee407b0a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef81f8ad0 0x7f4ef81f8ee0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ef81f5f30 0x7f4ef8143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 --2- 172.21.15.146:0/2761645819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ee0003a50 0x7f4ef806dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 -- 172.21.15.146:0/2761645819 >> 172.21.15.146:0/2761645819 conn(0x7f4ef80b7b20 msgr2=0x7f4ef815aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 -- 172.21.15.146:0/2761645819 shutdown_connections 2024-09-17T03:33:28.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:28.833+0000 7f4f00486640 1 -- 172.21.15.146:0/2761645819 wait complete. 2024-09-17T03:33:28.843 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T03:33:28.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:28.844 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-17T03:33:28.876 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:33:28.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:28.876 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T03:33:28.934 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:33:28.935 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:33:29.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.048+0000 7f18ec230640 1 -- 172.21.15.146:0/3127009825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e40b3d30 msgr2=0x7f18e415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.048+0000 7f18ec230640 1 --2- 172.21.15.146:0/3127009825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e40b3d30 0x7f18e415caa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f18e40b5390 tx=0x7f18dc02aac0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.048+0000 7f18ec230640 1 -- 172.21.15.146:0/3127009825 shutdown_connections 2024-09-17T03:33:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.048+0000 7f18ec230640 1 --2- 172.21.15.146:0/3127009825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e40b3d30 0x7f18e415caa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.048+0000 7f18ec230640 1 --2- 172.21.15.146:0/3127009825 >> v2:172.21.15.179:3300/0 conn(0x7f18e40b5ce0 0x7f18e40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.048+0000 7f18ec230640 1 -- 172.21.15.146:0/3127009825 >> 172.21.15.146:0/3127009825 conn(0x7f18e40b7b20 msgr2=0x7f18e409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.048+0000 7f18ec230640 1 -- 172.21.15.146:0/3127009825 shutdown_connections 2024-09-17T03:33:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.048+0000 7f18ec230640 1 -- 172.21.15.146:0/3127009825 wait complete. 2024-09-17T03:33:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.050+0000 7f18ec230640 1 Processor -- start 2024-09-17T03:33:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.050+0000 7f18ec230640 1 -- start start 2024-09-17T03:33:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.051+0000 7f18ec230640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e40b5750 0x7f18e415f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.051+0000 7f18ec230640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18e40b5ce0 0x7f18e41518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.051+0000 7f18ec230640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18e415dc90 0x7f18e415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.051+0000 7f18ec230640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f18e415d420 con 0x7f18e40b5750 2024-09-17T03:33:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.051+0000 7f18ec230640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f18e415d2a0 con 0x7f18e415dc90 2024-09-17T03:33:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.051+0000 7f18ec230640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f18e415d5a0 con 0x7f18e40b5ce0 2024-09-17T03:33:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.051+0000 7f18e9fcc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e40b5750 0x7f18e415f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18e9fcc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e40b5750 0x7f18e415f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39102/0 (socket says 172.21.15.146:39102) 2024-09-17T03:33:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18e9fcc640 1 -- 172.21.15.146:0/31140501 learned_addr learned my addr 172.21.15.146:0/31140501 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18e9fcc640 1 -- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18e40b5ce0 msgr2=0x7f18e41518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18e9fcc640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18e40b5ce0 0x7f18e41518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18e9fcc640 1 -- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18e415dc90 msgr2=0x7f18e415e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18e9fcc640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18e415dc90 0x7f18e415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18e9fcc640 1 -- 172.21.15.146:0/31140501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e415e5e0 con 0x7f18e40b5750 2024-09-17T03:33:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18e9fcc640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e40b5750 0x7f18e415f200 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f18e000e7f0 tx=0x7f18e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18da7fc640 1 -- 172.21.15.146:0/31140501 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e000ccc0 con 0x7f18e40b5750 2024-09-17T03:33:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18da7fc640 1 -- 172.21.15.146:0/31140501 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18e000ce80 con 0x7f18e40b5750 2024-09-17T03:33:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18da7fc640 1 -- 172.21.15.146:0/31140501 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0005280 con 0x7f18e40b5750 2024-09-17T03:33:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18ec230640 1 -- 172.21.15.146:0/31140501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e414ecf0 con 0x7f18e40b5750 2024-09-17T03:33:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.052+0000 7f18ec230640 1 -- 172.21.15.146:0/31140501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e41510f0 con 0x7f18e40b5750 2024-09-17T03:33:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.053+0000 7f18ec230640 1 -- 172.21.15.146:0/31140501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e415da80 con 0x7f18e40b5750 2024-09-17T03:33:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.054+0000 7f18da7fc640 1 -- 172.21.15.146:0/31140501 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f18e0005420 con 0x7f18e40b5750 2024-09-17T03:33:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.054+0000 7f18da7fc640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18c8078b90 0x7f18c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.054+0000 7f18da7fc640 1 -- 172.21.15.146:0/31140501 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f18e009b700 con 0x7f18e40b5750 2024-09-17T03:33:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.055+0000 7f18e97cb640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18c8078b90 0x7f18c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.055+0000 7f18e97cb640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18c8078b90 0x7f18c807b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f18e41e5880 tx=0x7f18d4007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.059+0000 7f18da7fc640 1 -- 172.21.15.146:0/31140501 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f18e0063bd0 con 0x7f18e40b5750 2024-09-17T03:33:29.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.267+0000 7f18ec230640 1 -- 172.21.15.146:0/31140501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18e4071b00 con 0x7f18e40b5750 2024-09-17T03:33:29.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.267+0000 7f18da7fc640 1 -- 172.21.15.146:0/31140501 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5223 (secure 0 0 0) 0x7f18e00634d0 con 0x7f18e40b5750 2024-09-17T03:33:29.266 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:29.267 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":6,"btime":"2024-09-17T03:33:02:765358+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/771934087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":771934087},{"type":"v1","addr":"172.21.15.179:6837","nonce":771934087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/580111663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":580111663},{"type":"v1","addr":"172.21.15.146:6834","nonce":580111663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3998700466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3998700466},{"type":"v1","addr":"172.21.15.146:6835","nonce":3998700466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:33:00.100864+0000","modified":"2024-09-17T03:33:02.117833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3419525644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3419525644},{"type":"v1","addr":"172.21.15.179:6835","nonce":3419525644}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4396,"qdb_cluster":[4396]},"id":1}]} 2024-09-17T03:33:29.267 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 6 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.269+0000 7f18ec230640 1 -- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18c8078b90 msgr2=0x7f18c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.269+0000 7f18ec230640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18c8078b90 0x7f18c807b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f18e41e5880 tx=0x7f18d4007930 comp rx=0 tx=0).stop 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.269+0000 7f18ec230640 1 -- 172.21.15.146:0/31140501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e40b5750 msgr2=0x7f18e415f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.269+0000 7f18ec230640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e40b5750 0x7f18e415f200 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f18e000e7f0 tx=0x7f18e000ecb0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.269+0000 7f18ec230640 1 -- 172.21.15.146:0/31140501 shutdown_connections 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.269+0000 7f18ec230640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18c8078b90 0x7f18c807b0a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.269+0000 7f18ec230640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18e415dc90 0x7f18e415e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.269+0000 7f18ec230640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18e40b5ce0 0x7f18e41518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.269+0000 7f18ec230640 1 --2- 172.21.15.146:0/31140501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18e40b5750 0x7f18e415f200 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.269+0000 7f18ec230640 1 -- 172.21.15.146:0/31140501 >> 172.21.15.146:0/31140501 conn(0x7f18e40b7b20 msgr2=0x7f18e40d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.270+0000 7f18ec230640 1 -- 172.21.15.146:0/31140501 shutdown_connections 2024-09-17T03:33:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.270+0000 7f18ec230640 1 -- 172.21.15.146:0/31140501 wait complete. 2024-09-17T03:33:29.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:33:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.394+0000 7f628d55e640 1 -- 172.21.15.146:0/3188625946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62880b5750 msgr2=0x7f62880b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.394+0000 7f628d55e640 1 --2- 172.21.15.146:0/3188625946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62880b5750 0x7f62880b3620 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f62880b1a60 tx=0x7f627002a560 comp rx=0 tx=0).stop 2024-09-17T03:33:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.394+0000 7f628d55e640 1 -- 172.21.15.146:0/3188625946 shutdown_connections 2024-09-17T03:33:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.394+0000 7f628d55e640 1 --2- 172.21.15.146:0/3188625946 >> v2:172.21.15.179:3300/0 conn(0x7f62880b3b60 0x7f628815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.394+0000 7f628d55e640 1 --2- 172.21.15.146:0/3188625946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62880b5750 0x7f62880b3620 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.394+0000 7f628d55e640 1 -- 172.21.15.146:0/3188625946 >> 172.21.15.146:0/3188625946 conn(0x7f62880b7b20 msgr2=0x7f628809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.394+0000 7f628d55e640 1 -- 172.21.15.146:0/3188625946 shutdown_connections 2024-09-17T03:33:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.394+0000 7f628d55e640 1 -- 172.21.15.146:0/3188625946 wait complete. 2024-09-17T03:33:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.396+0000 7f628d55e640 1 Processor -- start 2024-09-17T03:33:29.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.396+0000 7f628d55e640 1 -- start start 2024-09-17T03:33:29.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.397+0000 7f628d55e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62880b3b60 0x7f628809c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.397+0000 7f628d55e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62880b5750 0x7f6288155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.397+0000 7f628d55e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62880b5ce0 0x7f6288158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.397+0000 7f628d55e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f628815d420 con 0x7f62880b3b60 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.397+0000 7f628d55e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f628815d2a0 con 0x7f62880b5750 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.397+0000 7f628d55e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f628815d5a0 con 0x7f62880b5ce0 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.397+0000 7f6286ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62880b3b60 0x7f628809c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.397+0000 7f6286ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62880b3b60 0x7f628809c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39126/0 (socket says 172.21.15.146:39126) 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.397+0000 7f6286ffd640 1 -- 172.21.15.146:0/1665506667 learned_addr learned my addr 172.21.15.146:0/1665506667 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.397+0000 7f62877fe640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62880b5ce0 0x7f6288158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.397+0000 7f627e7fc640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62880b5750 0x7f6288155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.398+0000 7f6286ffd640 1 -- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62880b5ce0 msgr2=0x7f6288158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.398+0000 7f6286ffd640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62880b5ce0 0x7f6288158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.398+0000 7f6286ffd640 1 -- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62880b5750 msgr2=0x7f6288155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.398+0000 7f6286ffd640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62880b5750 0x7f6288155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.398+0000 7f6286ffd640 1 -- 172.21.15.146:0/1665506667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62881f7e70 con 0x7f62880b3b60 2024-09-17T03:33:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.398+0000 7f6286ffd640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62880b3b60 0x7f628809c5f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f627800c3d0 tx=0x7f627800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.398+0000 7f627ffff640 1 -- 172.21.15.146:0/1665506667 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278017070 con 0x7f62880b3b60 2024-09-17T03:33:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.398+0000 7f627ffff640 1 -- 172.21.15.146:0/1665506667 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62780053c0 con 0x7f62880b3b60 2024-09-17T03:33:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.398+0000 7f628d55e640 1 -- 172.21.15.146:0/1665506667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628809cb30 con 0x7f62880b3b60 2024-09-17T03:33:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.398+0000 7f627ffff640 1 -- 172.21.15.146:0/1665506667 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278003850 con 0x7f62880b3b60 2024-09-17T03:33:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.398+0000 7f628d55e640 1 -- 172.21.15.146:0/1665506667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62881f75d0 con 0x7f62880b3b60 2024-09-17T03:33:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.399+0000 7f628d55e640 1 -- 172.21.15.146:0/1665506667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62880b3620 con 0x7f62880b3b60 2024-09-17T03:33:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.400+0000 7f627ffff640 1 -- 172.21.15.146:0/1665506667 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f627801a070 con 0x7f62880b3b60 2024-09-17T03:33:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.400+0000 7f627ffff640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6268078b90 0x7f626807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.400+0000 7f627ffff640 1 -- 172.21.15.146:0/1665506667 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6278099fe0 con 0x7f62880b3b60 2024-09-17T03:33:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.401+0000 7f627e7fc640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6268078b90 0x7f626807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.401+0000 7f627e7fc640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6268078b90 0x7f626807b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6270033000 tx=0x7f6270004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.405+0000 7f627ffff640 1 -- 172.21.15.146:0/1665506667 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f62880b3f70 con 0x7f62880b3b60 2024-09-17T03:33:29.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.615+0000 7f628d55e640 1 -- 172.21.15.146:0/1665506667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f628809f0e0 con 0x7f62880b3b60 2024-09-17T03:33:29.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.616+0000 7f627ffff640 1 -- 172.21.15.146:0/1665506667 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5223 (secure 0 0 0) 0x7f6278061e60 con 0x7f62880b3b60 2024-09-17T03:33:29.615 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:29.615 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":6,"btime":"2024-09-17T03:33:02:765358+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/771934087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":771934087},{"type":"v1","addr":"172.21.15.179:6837","nonce":771934087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/580111663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":580111663},{"type":"v1","addr":"172.21.15.146:6834","nonce":580111663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3998700466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3998700466},{"type":"v1","addr":"172.21.15.146:6835","nonce":3998700466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:33:00.100864+0000","modified":"2024-09-17T03:33:02.117833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3419525644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3419525644},{"type":"v1","addr":"172.21.15.179:6835","nonce":3419525644}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4396,"qdb_cluster":[4396]},"id":1}]} 2024-09-17T03:33:29.615 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 6 2024-09-17T03:33:29.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 -- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6268078b90 msgr2=0x7f626807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6268078b90 0x7f626807b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6270033000 tx=0x7f6270004730 comp rx=0 tx=0).stop 2024-09-17T03:33:29.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 -- 172.21.15.146:0/1665506667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62880b3b60 msgr2=0x7f628809c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62880b3b60 0x7f628809c5f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f627800c3d0 tx=0x7f627800c890 comp rx=0 tx=0).stop 2024-09-17T03:33:29.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 -- 172.21.15.146:0/1665506667 shutdown_connections 2024-09-17T03:33:29.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6268078b90 0x7f626807b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62880b5ce0 0x7f6288158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62880b5750 0x7f6288155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 --2- 172.21.15.146:0/1665506667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62880b3b60 0x7f628809c5f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 -- 172.21.15.146:0/1665506667 >> 172.21.15.146:0/1665506667 conn(0x7f62880b7b20 msgr2=0x7f628815fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:29.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 -- 172.21.15.146:0/1665506667 shutdown_connections 2024-09-17T03:33:29.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.618+0000 7f628d55e640 1 -- 172.21.15.146:0/1665506667 wait complete. 2024-09-17T03:33:29.628 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.742+0000 7f31f0db0640 1 -- 172.21.15.146:0/331414180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ec15f1a0 msgr2=0x7f31ec0cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.742+0000 7f31f0db0640 1 --2- 172.21.15.146:0/331414180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ec15f1a0 0x7f31ec0cfca0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f31ec15cd70 tx=0x7f31dc02a560 comp rx=0 tx=0).stop 2024-09-17T03:33:29.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.742+0000 7f31f0db0640 1 -- 172.21.15.146:0/331414180 shutdown_connections 2024-09-17T03:33:29.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.742+0000 7f31f0db0640 1 --2- 172.21.15.146:0/331414180 >> v2:172.21.15.179:3300/0 conn(0x7f31ec1631a0 0x7f31ec0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.742+0000 7f31f0db0640 1 --2- 172.21.15.146:0/331414180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ec15f1a0 0x7f31ec0cfca0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.742+0000 7f31f0db0640 1 -- 172.21.15.146:0/331414180 >> 172.21.15.146:0/331414180 conn(0x7f31ec0d11f0 msgr2=0x7f31ec0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:29.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.742+0000 7f31f0db0640 1 -- 172.21.15.146:0/331414180 shutdown_connections 2024-09-17T03:33:29.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.742+0000 7f31f0db0640 1 -- 172.21.15.146:0/331414180 wait complete. 2024-09-17T03:33:29.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.744+0000 7f31f0db0640 1 Processor -- start 2024-09-17T03:33:29.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.744+0000 7f31f0db0640 1 -- start start 2024-09-17T03:33:29.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.745+0000 7f31f0db0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31ec0b61f0 0x7f31ec1f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.745+0000 7f31f0db0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31ec15f1a0 0x7f31ec149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.745+0000 7f31f0db0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ec1631a0 0x7f31ec14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.745+0000 7f31f0db0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec0695b0 con 0x7f31ec1631a0 2024-09-17T03:33:29.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.745+0000 7f31f0db0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec069430 con 0x7f31ec0b61f0 2024-09-17T03:33:29.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.745+0000 7f31f0db0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec069730 con 0x7f31ec15f1a0 2024-09-17T03:33:29.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31ead9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ec1631a0 0x7f31ec14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:29.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31ead9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ec1631a0 0x7f31ec14a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39150/0 (socket says 172.21.15.146:39150) 2024-09-17T03:33:29.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31ead9d640 1 -- 172.21.15.146:0/1605656548 learned_addr learned my addr 172.21.15.146:0/1605656548 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:29.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31ea59c640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31ec0b61f0 0x7f31ec1f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31e1d9b640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31ec15f1a0 0x7f31ec149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31ead9d640 1 -- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31ec15f1a0 msgr2=0x7f31ec149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31ead9d640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31ec15f1a0 0x7f31ec149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31ead9d640 1 -- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31ec0b61f0 msgr2=0x7f31ec1f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31ead9d640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31ec0b61f0 0x7f31ec1f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31ead9d640 1 -- 172.21.15.146:0/1605656548 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec148ab0 con 0x7f31ec1631a0 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31ea59c640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31ec0b61f0 0x7f31ec1f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31ead9d640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ec1631a0 0x7f31ec14a090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f31e400c6f0 tx=0x7f31e400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31e37fe640 1 -- 172.21.15.146:0/1605656548 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4017070 con 0x7f31ec1631a0 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31e37fe640 1 -- 172.21.15.146:0/1605656548 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31e4003c90 con 0x7f31ec1631a0 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31f0db0640 1 -- 172.21.15.146:0/1605656548 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ec148d90 con 0x7f31ec1631a0 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31e37fe640 1 -- 172.21.15.146:0/1605656548 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4003e60 con 0x7f31ec1631a0 2024-09-17T03:33:29.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.746+0000 7f31f0db0640 1 -- 172.21.15.146:0/1605656548 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ec149350 con 0x7f31ec1631a0 2024-09-17T03:33:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.748+0000 7f31f0db0640 1 -- 172.21.15.146:0/1605656548 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ec069be0 con 0x7f31ec1631a0 2024-09-17T03:33:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.748+0000 7f31e37fe640 1 -- 172.21.15.146:0/1605656548 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31e401a070 con 0x7f31ec1631a0 2024-09-17T03:33:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.749+0000 7f31e37fe640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31cc078b90 0x7f31cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:29.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.749+0000 7f31e37fe640 1 -- 172.21.15.146:0/1605656548 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f31e409a3d0 con 0x7f31ec1631a0 2024-09-17T03:33:29.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.749+0000 7f31ea59c640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31cc078b90 0x7f31cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:29.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.749+0000 7f31ea59c640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31cc078b90 0x7f31cc07b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f31dc033000 tx=0x7f31dc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:29.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.753+0000 7f31e37fe640 1 -- 172.21.15.146:0/1605656548 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f31e4062790 con 0x7f31ec1631a0 2024-09-17T03:33:29.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.930+0000 7f31f0db0640 1 -- 172.21.15.146:0/1605656548 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31ec0c7ff0 con 0x7f31ec1631a0 2024-09-17T03:33:29.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.931+0000 7f31e37fe640 1 -- 172.21.15.146:0/1605656548 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7f31e4062090 con 0x7f31ec1631a0 2024-09-17T03:33:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:29.931 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:01.757648+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:32:57.968580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:32:59.068488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:29.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 -- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31cc078b90 msgr2=0x7f31cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31cc078b90 0x7f31cc07b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f31dc033000 tx=0x7f31dc004730 comp rx=0 tx=0).stop 2024-09-17T03:33:29.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 -- 172.21.15.146:0/1605656548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ec1631a0 msgr2=0x7f31ec14a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:29.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ec1631a0 0x7f31ec14a090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f31e400c6f0 tx=0x7f31e400cbb0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 -- 172.21.15.146:0/1605656548 shutdown_connections 2024-09-17T03:33:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31cc078b90 0x7f31cc07b0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31ec1631a0 0x7f31ec14a090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f31ec15f1a0 0x7f31ec149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 --2- 172.21.15.146:0/1605656548 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31ec0b61f0 0x7f31ec1f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 -- 172.21.15.146:0/1605656548 >> 172.21.15.146:0/1605656548 conn(0x7f31ec0d11f0 msgr2=0x7f31ec162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 -- 172.21.15.146:0/1605656548 shutdown_connections 2024-09-17T03:33:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:29.934+0000 7f31f0db0640 1 -- 172.21.15.146:0/1605656548 wait complete. 2024-09-17T03:33:29.945 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:33:29.945 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:33:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.057+0000 7fe960f0b640 1 -- 172.21.15.146:0/2647088068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe95c073480 msgr2=0x7fe95c073890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.057+0000 7fe960f0b640 1 --2- 172.21.15.146:0/2647088068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe95c073480 0x7fe95c073890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0d1400 tx=0x7fe95402aa30 comp rx=0 tx=0).stop 2024-09-17T03:33:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.057+0000 7fe960f0b640 1 -- 172.21.15.146:0/2647088068 shutdown_connections 2024-09-17T03:33:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.057+0000 7fe960f0b640 1 --2- 172.21.15.146:0/2647088068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe95c073480 0x7fe95c073890 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.057+0000 7fe960f0b640 1 --2- 172.21.15.146:0/2647088068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c1604f0 0x7fe95c160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.057+0000 7fe960f0b640 1 --2- 172.21.15.146:0/2647088068 >> v2:172.21.15.179:3300/0 conn(0x7fe95c153a60 0x7fe95c15d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.057+0000 7fe960f0b640 1 -- 172.21.15.146:0/2647088068 >> 172.21.15.146:0/2647088068 conn(0x7fe95c0b2060 msgr2=0x7fe95c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.057+0000 7fe960f0b640 1 -- 172.21.15.146:0/2647088068 shutdown_connections 2024-09-17T03:33:30.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.057+0000 7fe960f0b640 1 -- 172.21.15.146:0/2647088068 wait complete. 2024-09-17T03:33:30.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.059+0000 7fe960f0b640 1 Processor -- start 2024-09-17T03:33:30.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.059+0000 7fe960f0b640 1 -- start start 2024-09-17T03:33:30.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe960f0b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe95c073480 0x7fe95c157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe960f0b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c153a60 0x7fe95c13fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe960f0b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe95c1604f0 0x7fe95c151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe960f0b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c073dd0 con 0x7fe95c1604f0 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe960f0b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c06f830 con 0x7fe95c073480 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe960f0b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe95c073f50 con 0x7fe95c153a60 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe95ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe95c1604f0 0x7fe95c151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe95ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe95c1604f0 0x7fe95c151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39170/0 (socket says 172.21.15.146:39170) 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe95ad9d640 1 -- 172.21.15.146:0/403962034 learned_addr learned my addr 172.21.15.146:0/403962034 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe95a59c640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe95c073480 0x7fe95c157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe951d9b640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c153a60 0x7fe95c13fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe95ad9d640 1 -- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c153a60 msgr2=0x7fe95c13fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe95ad9d640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c153a60 0x7fe95c13fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe95ad9d640 1 -- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe95c073480 msgr2=0x7fe95c157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe95ad9d640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe95c073480 0x7fe95c157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe95ad9d640 1 -- 172.21.15.146:0/403962034 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c15c910 con 0x7fe95c1604f0 2024-09-17T03:33:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe95ad9d640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe95c1604f0 0x7fe95c151680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe95402b020 tx=0x7fe954003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.061+0000 7fe9537fe640 1 -- 172.21.15.146:0/403962034 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954033050 con 0x7fe95c1604f0 2024-09-17T03:33:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.062+0000 7fe9537fe640 1 -- 172.21.15.146:0/403962034 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe954004450 con 0x7fe95c1604f0 2024-09-17T03:33:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.062+0000 7fe960f0b640 1 -- 172.21.15.146:0/403962034 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95c1508c0 con 0x7fe95c1604f0 2024-09-17T03:33:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.062+0000 7fe9537fe640 1 -- 172.21.15.146:0/403962034 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954038450 con 0x7fe95c1604f0 2024-09-17T03:33:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.062+0000 7fe960f0b640 1 -- 172.21.15.146:0/403962034 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95c150e80 con 0x7fe95c1604f0 2024-09-17T03:33:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.063+0000 7fe960f0b640 1 -- 172.21.15.146:0/403962034 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95c15d980 con 0x7fe95c1604f0 2024-09-17T03:33:30.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.063+0000 7fe9537fe640 1 -- 172.21.15.146:0/403962034 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe954036070 con 0x7fe95c1604f0 2024-09-17T03:33:30.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.064+0000 7fe9537fe640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe93c078b90 0x7fe93c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.064+0000 7fe9537fe640 1 -- 172.21.15.146:0/403962034 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe9540bc200 con 0x7fe95c1604f0 2024-09-17T03:33:30.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.064+0000 7fe95a59c640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe93c078b90 0x7fe93c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.065+0000 7fe95a59c640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe93c078b90 0x7fe93c07b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00daa0 tx=0x7fe94c005d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:30.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.068+0000 7fe9537fe640 1 -- 172.21.15.146:0/403962034 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe9540846d0 con 0x7fe95c1604f0 2024-09-17T03:33:30.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.275+0000 7fe960f0b640 1 -- 172.21.15.146:0/403962034 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe95c0b11d0 con 0x7fe95c1604f0 2024-09-17T03:33:30.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.276+0000 7fe9537fe640 1 -- 172.21.15.146:0/403962034 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5223 (secure 0 0 0) 0x7fe954083fd0 con 0x7fe95c1604f0 2024-09-17T03:33:30.276 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:30.276 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":6,"btime":"2024-09-17T03:33:02:765358+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/771934087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":771934087},{"type":"v1","addr":"172.21.15.179:6837","nonce":771934087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/580111663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":580111663},{"type":"v1","addr":"172.21.15.146:6834","nonce":580111663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3998700466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3998700466},{"type":"v1","addr":"172.21.15.146:6835","nonce":3998700466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:33:00.100864+0000","modified":"2024-09-17T03:33:02.117833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3419525644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3419525644},{"type":"v1","addr":"172.21.15.179:6835","nonce":3419525644}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4396,"qdb_cluster":[4396]},"id":1}]} 2024-09-17T03:33:30.276 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 6 2024-09-17T03:33:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 -- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe93c078b90 msgr2=0x7fe93c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe93c078b90 0x7fe93c07b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00daa0 tx=0x7fe94c005d70 comp rx=0 tx=0).stop 2024-09-17T03:33:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 -- 172.21.15.146:0/403962034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe95c1604f0 msgr2=0x7fe95c151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe95c1604f0 0x7fe95c151680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe95402b020 tx=0x7fe954003f10 comp rx=0 tx=0).stop 2024-09-17T03:33:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 -- 172.21.15.146:0/403962034 shutdown_connections 2024-09-17T03:33:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe93c078b90 0x7fe93c07b0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe95c1604f0 0x7fe95c151680 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe95c153a60 0x7fe95c13fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 --2- 172.21.15.146:0/403962034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe95c073480 0x7fe95c157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 -- 172.21.15.146:0/403962034 >> 172.21.15.146:0/403962034 conn(0x7fe95c0b2060 msgr2=0x7fe95c0d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 -- 172.21.15.146:0/403962034 shutdown_connections 2024-09-17T03:33:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.278+0000 7fe960f0b640 1 -- 172.21.15.146:0/403962034 wait complete. 2024-09-17T03:33:30.290 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:33:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.404+0000 7fea96af2640 1 -- 172.21.15.146:0/3954436021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea900b61f0 msgr2=0x7fea900b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.404+0000 7fea96af2640 1 --2- 172.21.15.146:0/3954436021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea900b61f0 0x7fea900b6600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea88005fd0 tx=0x7fea8802a710 comp rx=0 tx=0).stop 2024-09-17T03:33:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.405+0000 7fea96af2640 1 -- 172.21.15.146:0/3954436021 shutdown_connections 2024-09-17T03:33:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.405+0000 7fea96af2640 1 --2- 172.21.15.146:0/3954436021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea900b61f0 0x7fea900b6600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.405+0000 7fea96af2640 1 --2- 172.21.15.146:0/3954436021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea900cfca0 0x7fea900cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.405+0000 7fea96af2640 1 -- 172.21.15.146:0/3954436021 >> 172.21.15.146:0/3954436021 conn(0x7fea900d11f0 msgr2=0x7fea900d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.405+0000 7fea96af2640 1 -- 172.21.15.146:0/3954436021 shutdown_connections 2024-09-17T03:33:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.405+0000 7fea96af2640 1 -- 172.21.15.146:0/3954436021 wait complete. 2024-09-17T03:33:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.406+0000 7fea96af2640 1 Processor -- start 2024-09-17T03:33:30.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.406+0000 7fea96af2640 1 -- start start 2024-09-17T03:33:30.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea96af2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea900b61f0 0x7fea90157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea96af2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea900cfca0 0x7fea901f9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea96af2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9015f1a0 0x7fea90161350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea96af2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea900695b0 con 0x7fea900b61f0 2024-09-17T03:33:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea96af2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fea90069430 con 0x7fea900cfca0 2024-09-17T03:33:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea96af2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fea90069730 con 0x7fea9015f1a0 2024-09-17T03:33:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea9488e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea900b61f0 0x7fea90157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea9488e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea900b61f0 0x7fea90157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39182/0 (socket says 172.21.15.146:39182) 2024-09-17T03:33:30.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea9488e640 1 -- 172.21.15.146:0/1508623593 learned_addr learned my addr 172.21.15.146:0/1508623593 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea8ffff640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea900cfca0 0x7fea901f9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea9508f640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9015f1a0 0x7fea90161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea9488e640 1 -- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9015f1a0 msgr2=0x7fea90161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea9488e640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9015f1a0 0x7fea90161350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea9488e640 1 -- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea900cfca0 msgr2=0x7fea901f9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea9488e640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea900cfca0 0x7fea901f9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.408+0000 7fea9488e640 1 -- 172.21.15.146:0/1508623593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9015ad20 con 0x7fea900b61f0 2024-09-17T03:33:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.409+0000 7fea9488e640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea900b61f0 0x7fea90157fd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea8000c760 tx=0x7fea8000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.409+0000 7fea8d7fa640 1 -- 172.21.15.146:0/1508623593 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea80017070 con 0x7fea900b61f0 2024-09-17T03:33:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.409+0000 7fea8d7fa640 1 -- 172.21.15.146:0/1508623593 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea8000a640 con 0x7fea900b61f0 2024-09-17T03:33:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.409+0000 7fea96af2640 1 -- 172.21.15.146:0/1508623593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea90158510 con 0x7fea900b61f0 2024-09-17T03:33:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.409+0000 7fea8d7fa640 1 -- 172.21.15.146:0/1508623593 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8000aa90 con 0x7fea900b61f0 2024-09-17T03:33:30.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.409+0000 7fea96af2640 1 -- 172.21.15.146:0/1508623593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9015afc0 con 0x7fea900b61f0 2024-09-17T03:33:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.410+0000 7fea96af2640 1 -- 172.21.15.146:0/1508623593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea90069c50 con 0x7fea900b61f0 2024-09-17T03:33:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.410+0000 7fea8d7fa640 1 -- 172.21.15.146:0/1508623593 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea8001a070 con 0x7fea900b61f0 2024-09-17T03:33:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.411+0000 7fea8d7fa640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea7c078b90 0x7fea7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.411+0000 7fea8d7fa640 1 -- 172.21.15.146:0/1508623593 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fea8009a3f0 con 0x7fea900b61f0 2024-09-17T03:33:30.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.411+0000 7fea8ffff640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea7c078b90 0x7fea7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.412+0000 7fea8ffff640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea7c078b90 0x7fea7c07b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea900d2990 tx=0x7fea84009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:30.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.416+0000 7fea8d7fa640 1 -- 172.21.15.146:0/1508623593 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea9015ad20 con 0x7fea900b61f0 2024-09-17T03:33:30.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.625+0000 7fea96af2640 1 -- 172.21.15.146:0/1508623593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea900d3270 con 0x7fea900b61f0 2024-09-17T03:33:30.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.626+0000 7fea8d7fa640 1 -- 172.21.15.146:0/1508623593 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5223 (secure 0 0 0) 0x7fea900b6b40 con 0x7fea900b61f0 2024-09-17T03:33:30.626 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:30.626 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":6,"btime":"2024-09-17T03:33:02:765358+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/771934087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":771934087},{"type":"v1","addr":"172.21.15.179:6837","nonce":771934087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4380,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/580111663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":580111663},{"type":"v1","addr":"172.21.15.146:6834","nonce":580111663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3998700466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3998700466},{"type":"v1","addr":"172.21.15.146:6835","nonce":3998700466}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:33:00.100864+0000","modified":"2024-09-17T03:33:02.117833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4396},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4396":{"gid":4396,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6835/3419525644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3419525644},{"type":"v1","addr":"172.21.15.179:6835","nonce":3419525644}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4396,"qdb_cluster":[4396]},"id":1}]} 2024-09-17T03:33:30.626 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 6 2024-09-17T03:33:30.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 -- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea7c078b90 msgr2=0x7fea7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea7c078b90 0x7fea7c07b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea900d2990 tx=0x7fea84009260 comp rx=0 tx=0).stop 2024-09-17T03:33:30.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 -- 172.21.15.146:0/1508623593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea900b61f0 msgr2=0x7fea90157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea900b61f0 0x7fea90157fd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea8000c760 tx=0x7fea8000cc20 comp rx=0 tx=0).stop 2024-09-17T03:33:30.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 -- 172.21.15.146:0/1508623593 shutdown_connections 2024-09-17T03:33:30.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea7c078b90 0x7fea7c07b0a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9015f1a0 0x7fea90161350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea900cfca0 0x7fea901f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 --2- 172.21.15.146:0/1508623593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea900b61f0 0x7fea90157fd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 -- 172.21.15.146:0/1508623593 >> 172.21.15.146:0/1508623593 conn(0x7fea900d11f0 msgr2=0x7fea900d3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:30.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 -- 172.21.15.146:0/1508623593 shutdown_connections 2024-09-17T03:33:30.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.628+0000 7fea96af2640 1 -- 172.21.15.146:0/1508623593 wait complete. 2024-09-17T03:33:30.639 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:30.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.753+0000 7f33e8425640 1 -- 172.21.15.146:0/2314855859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00b47c0 msgr2=0x7f33e0161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.753+0000 7f33e8425640 1 --2- 172.21.15.146:0/2314855859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00b47c0 0x7f33e0161930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f33e00740d0 tx=0x7f33d802aa30 comp rx=0 tx=0).stop 2024-09-17T03:33:30.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.753+0000 7f33e8425640 1 -- 172.21.15.146:0/2314855859 shutdown_connections 2024-09-17T03:33:30.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.753+0000 7f33e8425640 1 --2- 172.21.15.146:0/2314855859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00b47c0 0x7f33e0161930 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.753+0000 7f33e8425640 1 --2- 172.21.15.146:0/2314855859 >> v2:172.21.15.179:3300/0 conn(0x7f33e00d0710 0x7f33e00cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.753+0000 7f33e8425640 1 -- 172.21.15.146:0/2314855859 >> 172.21.15.146:0/2314855859 conn(0x7f33e009ba20 msgr2=0x7f33e00b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:30.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.753+0000 7f33e8425640 1 -- 172.21.15.146:0/2314855859 shutdown_connections 2024-09-17T03:33:30.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.753+0000 7f33e8425640 1 -- 172.21.15.146:0/2314855859 wait complete. 2024-09-17T03:33:30.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.755+0000 7f33e8425640 1 Processor -- start 2024-09-17T03:33:30.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.755+0000 7f33e8425640 1 -- start start 2024-09-17T03:33:30.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.756+0000 7f33e8425640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e00b47c0 0x7f33e00d2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e8425640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00cf6b0 0x7f33e009c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e8425640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e00d0710 0x7f33e009c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e8425640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f33e00b1de0 con 0x7f33e00cf6b0 2024-09-17T03:33:30.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e8425640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f33e0162080 con 0x7f33e00d0710 2024-09-17T03:33:30.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e8425640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f33e00b1f60 con 0x7f33e00b47c0 2024-09-17T03:33:30.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e59c0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00cf6b0 0x7f33e009c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e59c0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00cf6b0 0x7f33e009c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39196/0 (socket says 172.21.15.146:39196) 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e59c0640 1 -- 172.21.15.146:0/1949785114 learned_addr learned my addr 172.21.15.146:0/1949785114 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e69c2640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e00d0710 0x7f33e009c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e61c1640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e00b47c0 0x7f33e00d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e59c0640 1 -- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e00b47c0 msgr2=0x7f33e00d2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e59c0640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e00b47c0 0x7f33e00d2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e59c0640 1 -- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e00d0710 msgr2=0x7f33e009c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e59c0640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e00d0710 0x7f33e009c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e59c0640 1 -- 172.21.15.146:0/1949785114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e01f3d20 con 0x7f33e00cf6b0 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e61c1640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e00b47c0 0x7f33e00d2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e59c0640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00cf6b0 0x7f33e009c4a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f33d000c400 tx=0x7f33d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33d6ffd640 1 -- 172.21.15.146:0/1949785114 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0017070 con 0x7f33e00cf6b0 2024-09-17T03:33:30.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33d6ffd640 1 -- 172.21.15.146:0/1949785114 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33d00053c0 con 0x7f33e00cf6b0 2024-09-17T03:33:30.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33d6ffd640 1 -- 172.21.15.146:0/1949785114 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0003850 con 0x7f33e00cf6b0 2024-09-17T03:33:30.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e8425640 1 -- 172.21.15.146:0/1949785114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e01f3fe0 con 0x7f33e00cf6b0 2024-09-17T03:33:30.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.757+0000 7f33e8425640 1 -- 172.21.15.146:0/1949785114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e01f45a0 con 0x7f33e00cf6b0 2024-09-17T03:33:30.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.758+0000 7f33e8425640 1 -- 172.21.15.146:0/1949785114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e00b5dc0 con 0x7f33e00cf6b0 2024-09-17T03:33:30.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.759+0000 7f33d6ffd640 1 -- 172.21.15.146:0/1949785114 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f33d001a070 con 0x7f33e00cf6b0 2024-09-17T03:33:30.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.759+0000 7f33d6ffd640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33c4078bf0 0x7f33c407b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:30.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.760+0000 7f33d6ffd640 1 -- 172.21.15.146:0/1949785114 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f33d009a110 con 0x7f33e00cf6b0 2024-09-17T03:33:30.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.760+0000 7f33e61c1640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33c4078bf0 0x7f33c407b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:30.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.760+0000 7f33e61c1640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33c4078bf0 0x7f33c407b100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f33dc005fd0 tx=0x7f33dc00f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:30.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.764+0000 7f33d6ffd640 1 -- 172.21.15.146:0/1949785114 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f33e00b5dc0 con 0x7f33e00cf6b0 2024-09-17T03:33:30.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.941+0000 7f33e8425640 1 -- 172.21.15.146:0/1949785114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33e009cf40 con 0x7f33e00cf6b0 2024-09-17T03:33:30.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.942+0000 7f33d6ffd640 1 -- 172.21.15.146:0/1949785114 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7f33d0061e60 con 0x7f33e00cf6b0 2024-09-17T03:33:30.941 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:30.941 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:01.757648+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:32:57.968580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:32:59.068488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:30.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 -- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33c4078bf0 msgr2=0x7f33c407b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33c4078bf0 0x7f33c407b100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f33dc005fd0 tx=0x7f33dc00f360 comp rx=0 tx=0).stop 2024-09-17T03:33:30.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 -- 172.21.15.146:0/1949785114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00cf6b0 msgr2=0x7f33e009c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:30.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00cf6b0 0x7f33e009c4a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f33d000c400 tx=0x7f33d000c8c0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 -- 172.21.15.146:0/1949785114 shutdown_connections 2024-09-17T03:33:30.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f33c4078bf0 0x7f33c407b100 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33e00d0710 0x7f33e009c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00cf6b0 0x7f33e009c4a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 --2- 172.21.15.146:0/1949785114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33e00b47c0 0x7f33e00d2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:30.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 -- 172.21.15.146:0/1949785114 >> 172.21.15.146:0/1949785114 conn(0x7f33e009ba20 msgr2=0x7f33e00b6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:30.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 -- 172.21.15.146:0/1949785114 shutdown_connections 2024-09-17T03:33:30.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:30.944+0000 7f33e8425640 1 -- 172.21.15.146:0/1949785114 wait complete. 2024-09-17T03:33:30.955 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:33:31.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.069+0000 7fcb40507640 1 -- 172.21.15.146:0/943863174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb380b61f0 msgr2=0x7fcb380b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:31.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.069+0000 7fcb40507640 1 --2- 172.21.15.146:0/943863174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb380b61f0 0x7fcb380b6600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcb3808d7c0 tx=0x7fcb3002a980 comp rx=0 tx=0).stop 2024-09-17T03:33:31.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.070+0000 7fcb40507640 1 -- 172.21.15.146:0/943863174 shutdown_connections 2024-09-17T03:33:31.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.070+0000 7fcb40507640 1 --2- 172.21.15.146:0/943863174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb380b61f0 0x7fcb380b6600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.070+0000 7fcb40507640 1 --2- 172.21.15.146:0/943863174 >> v2:172.21.15.179:3300/0 conn(0x7fcb381631a0 0x7fcb380cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.070+0000 7fcb40507640 1 --2- 172.21.15.146:0/943863174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb3815f1a0 0x7fcb380cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.070+0000 7fcb40507640 1 -- 172.21.15.146:0/943863174 >> 172.21.15.146:0/943863174 conn(0x7fcb380d11f0 msgr2=0x7fcb380d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:31.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.070+0000 7fcb40507640 1 -- 172.21.15.146:0/943863174 shutdown_connections 2024-09-17T03:33:31.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.070+0000 7fcb40507640 1 -- 172.21.15.146:0/943863174 wait complete. 2024-09-17T03:33:31.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.071+0000 7fcb40507640 1 Processor -- start 2024-09-17T03:33:31.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.071+0000 7fcb40507640 1 -- start start 2024-09-17T03:33:31.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb40507640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb380b61f0 0x7fcb380cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:31.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb40507640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb3815f1a0 0x7fcb3814fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:31.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb40507640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb381631a0 0x7fcb3815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:31.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb40507640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcb380693a0 con 0x7fcb3815f1a0 2024-09-17T03:33:31.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb40507640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcb38069220 con 0x7fcb380b61f0 2024-09-17T03:33:31.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb40507640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcb38069520 con 0x7fcb381631a0 2024-09-17T03:33:31.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb3daa2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb3815f1a0 0x7fcb3814fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:31.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb3daa2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb3815f1a0 0x7fcb3814fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39220/0 (socket says 172.21.15.146:39220) 2024-09-17T03:33:31.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb3daa2640 1 -- 172.21.15.146:0/1879966290 learned_addr learned my addr 172.21.15.146:0/1879966290 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:31.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb3daa2640 1 -- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb381631a0 msgr2=0x7fcb3815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:31.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb3e2a3640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb380b61f0 0x7fcb380cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:31.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb3eaa4640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb381631a0 0x7fcb3815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:31.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb3daa2640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb381631a0 0x7fcb3815b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb3daa2640 1 -- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb380b61f0 msgr2=0x7fcb380cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb3daa2640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb380b61f0 0x7fcb380cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb3daa2640 1 -- 172.21.15.146:0/1879966290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb380cd030 con 0x7fcb3815f1a0 2024-09-17T03:33:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb3daa2640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb3815f1a0 0x7fcb3814fcc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800e790 tx=0x7fcb2800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb2effd640 1 -- 172.21.15.146:0/1879966290 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800eea0 con 0x7fcb3815f1a0 2024-09-17T03:33:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb2effd640 1 -- 172.21.15.146:0/1879966290 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb2800cdb0 con 0x7fcb3815f1a0 2024-09-17T03:33:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.073+0000 7fcb40507640 1 -- 172.21.15.146:0/1879966290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb380cd310 con 0x7fcb3815f1a0 2024-09-17T03:33:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.074+0000 7fcb2effd640 1 -- 172.21.15.146:0/1879966290 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28010690 con 0x7fcb3815f1a0 2024-09-17T03:33:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.074+0000 7fcb40507640 1 -- 172.21.15.146:0/1879966290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb380cd8d0 con 0x7fcb3815f1a0 2024-09-17T03:33:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.075+0000 7fcb40507640 1 -- 172.21.15.146:0/1879966290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb38069a40 con 0x7fcb3815f1a0 2024-09-17T03:33:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.075+0000 7fcb2effd640 1 -- 172.21.15.146:0/1879966290 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb28010830 con 0x7fcb3815f1a0 2024-09-17T03:33:31.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.076+0000 7fcb2effd640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb1c078b90 0x7fcb1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:31.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.076+0000 7fcb2effd640 1 -- 172.21.15.146:0/1879966290 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcb2809b6e0 con 0x7fcb3815f1a0 2024-09-17T03:33:31.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.076+0000 7fcb3e2a3640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb1c078b90 0x7fcb1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:31.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.077+0000 7fcb3e2a3640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb1c078b90 0x7fcb1c07b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009a00 tx=0x7fcb34005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:31.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.080+0000 7fcb2effd640 1 -- 172.21.15.146:0/1879966290 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcb28063b30 con 0x7fcb3815f1a0 2024-09-17T03:33:31.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.293+0000 7fcb40507640 1 -- 172.21.15.146:0/1879966290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcb380ccdc0 con 0x7fcb3815f1a0 2024-09-17T03:33:31.292 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:33:31.294+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:33:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.295+0000 7fcb2effd640 1 -- 172.21.15.146:0/1879966290 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fcb28063430 con 0x7fcb3815f1a0 2024-09-17T03:33:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 -- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb1c078b90 msgr2=0x7fcb1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb1c078b90 0x7fcb1c07b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009a00 tx=0x7fcb34005f90 comp rx=0 tx=0).stop 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 -- 172.21.15.146:0/1879966290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb3815f1a0 msgr2=0x7fcb3814fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb3815f1a0 0x7fcb3814fcc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800e790 tx=0x7fcb2800ec50 comp rx=0 tx=0).stop 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 -- 172.21.15.146:0/1879966290 shutdown_connections 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb1c078b90 0x7fcb1c07b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb381631a0 0x7fcb3815b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb3815f1a0 0x7fcb3814fcc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 --2- 172.21.15.146:0/1879966290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb380b61f0 0x7fcb380cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 -- 172.21.15.146:0/1879966290 >> 172.21.15.146:0/1879966290 conn(0x7fcb380d11f0 msgr2=0x7fcb3815d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 -- 172.21.15.146:0/1879966290 shutdown_connections 2024-09-17T03:33:31.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.298+0000 7fcb40507640 1 -- 172.21.15.146:0/1879966290 wait complete. 2024-09-17T03:33:31.307 INFO:tasks.ceph.mds.d.smithi179.stderr: -6860> 2024-09-17T03:33:05.729+0000 7f8b86404640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:33:31.308 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:33:31.367 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:33:31.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.425+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2705074805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48e80ae890 msgr2=0x7f48e806cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:31.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.425+0000 7f48ef6e5640 1 --2- 172.21.15.146:0/2705074805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48e80ae890 0x7f48e806cc50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f48d8005fd0 tx=0x7f48d802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.425+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2705074805 shutdown_connections 2024-09-17T03:33:31.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.425+0000 7f48ef6e5640 1 --2- 172.21.15.146:0/2705074805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48e80ae890 0x7f48e806cc50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.425+0000 7f48ef6e5640 1 --2- 172.21.15.146:0/2705074805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80b0c60 0x7f48e8155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.426+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2705074805 >> 172.21.15.146:0/2705074805 conn(0x7f48e80b3150 msgr2=0x7f48e80b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:31.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.426+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2705074805 shutdown_connections 2024-09-17T03:33:31.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.426+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2705074805 wait complete. 2024-09-17T03:33:31.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.427+0000 7f48ef6e5640 1 Processor -- start 2024-09-17T03:33:31.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.427+0000 7f48ef6e5640 1 -- start start 2024-09-17T03:33:31.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ef6e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80ae890 0x7f48e81614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:31.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ef6e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48e80aeca0 0x7f48e8148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:31.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ef6e5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48e80b0c60 0x7f48e815b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:31.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ef6e5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f48e806d550 con 0x7f48e80b0c60 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ef6e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f48e806d3d0 con 0x7f48e80aeca0 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ef6e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f48e80b62c0 con 0x7f48e80ae890 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48edc82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48e80b0c60 0x7f48e815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48edc82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48e80b0c60 0x7f48e815b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39238/0 (socket says 172.21.15.146:39238) 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48edc82640 1 -- 172.21.15.146:0/2753145202 learned_addr learned my addr 172.21.15.146:0/2753145202 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ecc80640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48e80aeca0 0x7f48e8148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ed481640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80ae890 0x7f48e81614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48edc82640 1 -- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80ae890 msgr2=0x7f48e81614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48edc82640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80ae890 0x7f48e81614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48edc82640 1 -- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48e80aeca0 msgr2=0x7f48e8148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48edc82640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48e80aeca0 0x7f48e8148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:31.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48edc82640 1 -- 172.21.15.146:0/2753145202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e81f8f20 con 0x7f48e80b0c60 2024-09-17T03:33:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ed481640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80ae890 0x7f48e81614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48edc82640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48e80b0c60 0x7f48e815b520 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f48e000c730 tx=0x7f48e000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ddffb640 1 -- 172.21.15.146:0/2753145202 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0003b70 con 0x7f48e80b0c60 2024-09-17T03:33:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ddffb640 1 -- 172.21.15.146:0/2753145202 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48e0003d10 con 0x7f48e80b0c60 2024-09-17T03:33:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2753145202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e8149280 con 0x7f48e80b0c60 2024-09-17T03:33:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.429+0000 7f48ddffb640 1 -- 172.21.15.146:0/2753145202 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0005330 con 0x7f48e80b0c60 2024-09-17T03:33:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.430+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2753145202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e81f91e0 con 0x7f48e80b0c60 2024-09-17T03:33:31.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.431+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2753145202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48e80af3c0 con 0x7f48e80b0c60 2024-09-17T03:33:31.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.431+0000 7f48ddffb640 1 -- 172.21.15.146:0/2753145202 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f48e00054d0 con 0x7f48e80b0c60 2024-09-17T03:33:31.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.432+0000 7f48ddffb640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48cc078b90 0x7f48cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:31.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.432+0000 7f48ddffb640 1 -- 172.21.15.146:0/2753145202 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f48e009aa30 con 0x7f48e80b0c60 2024-09-17T03:33:31.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.432+0000 7f48ed481640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48cc078b90 0x7f48cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:31.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.432+0000 7f48ed481640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48cc078b90 0x7f48cc07b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009b80 tx=0x7f48e4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:31.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.436+0000 7f48ddffb640 1 -- 172.21.15.146:0/2753145202 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f48e80af3c0 con 0x7f48e80b0c60 2024-09-17T03:33:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:31.646+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2753145202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f48e8071320 con 0x7f48e80b0c60 2024-09-17T03:33:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.301+0000 7f48ddffb640 1 -- 172.21.15.146:0/2753145202 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f48e0062ea0 con 0x7f48e80b0c60 2024-09-17T03:33:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48cc078b90 msgr2=0x7f48cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48cc078b90 0x7f48cc07b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009b80 tx=0x7f48e4005f90 comp rx=0 tx=0).stop 2024-09-17T03:33:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2753145202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48e80b0c60 msgr2=0x7f48e815b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48e80b0c60 0x7f48e815b520 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f48e000c730 tx=0x7f48e000cb30 comp rx=0 tx=0).stop 2024-09-17T03:33:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2753145202 shutdown_connections 2024-09-17T03:33:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48cc078b90 0x7f48cc07b0a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48e80b0c60 0x7f48e815b520 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48e80aeca0 0x7f48e8148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 --2- 172.21.15.146:0/2753145202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48e80ae890 0x7f48e81614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2753145202 >> 172.21.15.146:0/2753145202 conn(0x7f48e80b3150 msgr2=0x7f48e806f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2753145202 shutdown_connections 2024-09-17T03:33:32.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.303+0000 7f48ef6e5640 1 -- 172.21.15.146:0/2753145202 wait complete. 2024-09-17T03:33:32.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:33:32.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.435+0000 7fcb25086640 1 -- 172.21.15.146:0/1369672730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200b3b60 msgr2=0x7fcb2015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:32.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.435+0000 7fcb25086640 1 --2- 172.21.15.146:0/1369672730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200b3b60 0x7fcb2015caa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcb18005fd0 tx=0x7fcb1802aa90 comp rx=0 tx=0).stop 2024-09-17T03:33:32.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.436+0000 7fcb25086640 1 -- 172.21.15.146:0/1369672730 shutdown_connections 2024-09-17T03:33:32.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.436+0000 7fcb25086640 1 --2- 172.21.15.146:0/1369672730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200b3b60 0x7fcb2015caa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:32.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.436+0000 7fcb25086640 1 --2- 172.21.15.146:0/1369672730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb200b5750 0x7fcb200b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:32.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.436+0000 7fcb25086640 1 -- 172.21.15.146:0/1369672730 >> 172.21.15.146:0/1369672730 conn(0x7fcb200b7b20 msgr2=0x7fcb2009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:32.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.436+0000 7fcb25086640 1 -- 172.21.15.146:0/1369672730 shutdown_connections 2024-09-17T03:33:32.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.436+0000 7fcb25086640 1 -- 172.21.15.146:0/1369672730 wait complete. 2024-09-17T03:33:32.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.437+0000 7fcb25086640 1 Processor -- start 2024-09-17T03:33:32.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.438+0000 7fcb25086640 1 -- start start 2024-09-17T03:33:32.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb25086640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200b3b60 0x7fcb200a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:32.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb25086640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb200b5750 0x7fcb20143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:32.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb25086640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb200b5ce0 0x7fcb2015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:32.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb25086640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2015d460 con 0x7fcb200b3b60 2024-09-17T03:33:32.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb25086640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2015d2e0 con 0x7fcb200b5ce0 2024-09-17T03:33:32.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb25086640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2015d5e0 con 0x7fcb200b5750 2024-09-17T03:33:32.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb1ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200b3b60 0x7fcb200a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb1ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200b3b60 0x7fcb200a0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39244/0 (socket says 172.21.15.146:39244) 2024-09-17T03:33:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb1ed9d640 1 -- 172.21.15.146:0/4170821500 learned_addr learned my addr 172.21.15.146:0/4170821500 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb1659c640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb200b5750 0x7fcb20143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb1f59e640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb200b5ce0 0x7fcb2015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb1ed9d640 1 -- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb200b5750 msgr2=0x7fcb20143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb1ed9d640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb200b5750 0x7fcb20143980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb1ed9d640 1 -- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb200b5ce0 msgr2=0x7fcb2015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb1ed9d640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb200b5ce0 0x7fcb2015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.439+0000 7fcb1ed9d640 1 -- 172.21.15.146:0/4170821500 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb20146e70 con 0x7fcb200b3b60 2024-09-17T03:33:32.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.440+0000 7fcb1ed9d640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200b3b60 0x7fcb200a0240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000c3a0 tx=0x7fcb1000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:32.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.440+0000 7fcb17fff640 1 -- 172.21.15.146:0/4170821500 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10017070 con 0x7fcb200b3b60 2024-09-17T03:33:32.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.440+0000 7fcb17fff640 1 -- 172.21.15.146:0/4170821500 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb100053c0 con 0x7fcb200b3b60 2024-09-17T03:33:32.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.440+0000 7fcb25086640 1 -- 172.21.15.146:0/4170821500 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb201473e0 con 0x7fcb200b3b60 2024-09-17T03:33:32.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.440+0000 7fcb17fff640 1 -- 172.21.15.146:0/4170821500 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10003850 con 0x7fcb200b3b60 2024-09-17T03:33:32.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.440+0000 7fcb25086640 1 -- 172.21.15.146:0/4170821500 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb20147100 con 0x7fcb200b3b60 2024-09-17T03:33:32.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.441+0000 7fcb25086640 1 -- 172.21.15.146:0/4170821500 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb20155e40 con 0x7fcb200b3b60 2024-09-17T03:33:32.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.441+0000 7fcb17fff640 1 -- 172.21.15.146:0/4170821500 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb1001a070 con 0x7fcb200b3b60 2024-09-17T03:33:32.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.442+0000 7fcb17fff640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb00078b90 0x7fcb0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:32.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.442+0000 7fcb17fff640 1 -- 172.21.15.146:0/4170821500 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7fcb1009a090 con 0x7fcb200b3b60 2024-09-17T03:33:32.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.442+0000 7fcb1659c640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb00078b90 0x7fcb0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:32.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.443+0000 7fcb1659c640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb00078b90 0x7fcb0007b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcb201558b0 tx=0x7fcb0800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:32.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.446+0000 7fcb17fff640 1 -- 172.21.15.146:0/4170821500 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcb200b3f70 con 0x7fcb200b3b60 2024-09-17T03:33:32.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:32.623+0000 7fcb25086640 1 -- 172.21.15.146:0/4170821500 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcb2015c130 con 0x7fcb200b3b60 2024-09-17T03:33:33.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.302+0000 7fcb17fff640 1 -- 172.21.15.146:0/4170821500 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7fcb10061eb0 con 0x7fcb200b3b60 2024-09-17T03:33:33.302 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:33:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.306+0000 7fcb25086640 1 -- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb00078b90 msgr2=0x7fcb0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:33.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.306+0000 7fcb25086640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb00078b90 0x7fcb0007b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcb201558b0 tx=0x7fcb0800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:33:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.306+0000 7fcb25086640 1 -- 172.21.15.146:0/4170821500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200b3b60 msgr2=0x7fcb200a0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.306+0000 7fcb25086640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200b3b60 0x7fcb200a0240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000c3a0 tx=0x7fcb1000c860 comp rx=0 tx=0).stop 2024-09-17T03:33:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.306+0000 7fcb25086640 1 -- 172.21.15.146:0/4170821500 shutdown_connections 2024-09-17T03:33:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.306+0000 7fcb25086640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb00078b90 0x7fcb0007b0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.306+0000 7fcb25086640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb200b5ce0 0x7fcb2015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.306+0000 7fcb25086640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb200b5750 0x7fcb20143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.306+0000 7fcb25086640 1 --2- 172.21.15.146:0/4170821500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200b3b60 0x7fcb200a0240 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.306+0000 7fcb25086640 1 -- 172.21.15.146:0/4170821500 >> 172.21.15.146:0/4170821500 conn(0x7fcb200b7b20 msgr2=0x7fcb2009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.306+0000 7fcb25086640 1 -- 172.21.15.146:0/4170821500 shutdown_connections 2024-09-17T03:33:33.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.307+0000 7fcb25086640 1 -- 172.21.15.146:0/4170821500 wait complete. 2024-09-17T03:33:33.319 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:33:33.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.441+0000 7f78fe639640 1 -- 172.21.15.146:0/3463768722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78f80cf6b0 msgr2=0x7f78f8161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:33.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.441+0000 7f78fe639640 1 --2- 172.21.15.146:0/3463768722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78f80cf6b0 0x7f78f8161220 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f78f80740d0 tx=0x7f78ec02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:33:33.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.441+0000 7f78fe639640 1 -- 172.21.15.146:0/3463768722 shutdown_connections 2024-09-17T03:33:33.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.441+0000 7f78fe639640 1 --2- 172.21.15.146:0/3463768722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78f80cf6b0 0x7f78f8161220 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:33.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.441+0000 7f78fe639640 1 --2- 172.21.15.146:0/3463768722 >> v2:172.21.15.179:3300/0 conn(0x7f78f80d0710 0x7f78f80cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:33.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.441+0000 7f78fe639640 1 -- 172.21.15.146:0/3463768722 >> 172.21.15.146:0/3463768722 conn(0x7f78f809ba20 msgr2=0x7f78f80b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:33.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.441+0000 7f78fe639640 1 -- 172.21.15.146:0/3463768722 shutdown_connections 2024-09-17T03:33:33.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.441+0000 7f78fe639640 1 -- 172.21.15.146:0/3463768722 wait complete. 2024-09-17T03:33:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.443+0000 7f78fe639640 1 Processor -- start 2024-09-17T03:33:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.443+0000 7f78fe639640 1 -- start start 2024-09-17T03:33:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.444+0000 7f78fe639640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f80b47c0 0x7f78f80a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.444+0000 7f78fe639640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78f80cf6b0 0x7f78f80c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.444+0000 7f78fe639640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78f80d0710 0x7f78f81f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.444+0000 7f78fe639640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f78f80b1de0 con 0x7f78f80d0710 2024-09-17T03:33:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.444+0000 7f78fe639640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78f8162080 con 0x7f78f80b47c0 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.444+0000 7f78fe639640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f78f80b1f60 con 0x7f78f80cf6b0 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78fcbd6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78f80d0710 0x7f78f81f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78fcbd6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78f80d0710 0x7f78f81f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39270/0 (socket says 172.21.15.146:39270) 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78fcbd6640 1 -- 172.21.15.146:0/3617818106 learned_addr learned my addr 172.21.15.146:0/3617818106 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78f7fff640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f80b47c0 0x7f78f80a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78f77fe640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78f80cf6b0 0x7f78f80c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78fcbd6640 1 -- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78f80cf6b0 msgr2=0x7f78f80c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78fcbd6640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78f80cf6b0 0x7f78f80c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78fcbd6640 1 -- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f80b47c0 msgr2=0x7f78f80a0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78fcbd6640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f80b47c0 0x7f78f80a0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78fcbd6640 1 -- 172.21.15.146:0/3617818106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f80c9b50 con 0x7f78f80d0710 2024-09-17T03:33:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78f7fff640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f80b47c0 0x7f78f80a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78fcbd6640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78f80d0710 0x7f78f81f7420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78f000b990 tx=0x7f78f000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78f4ff9640 1 -- 172.21.15.146:0/3617818106 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0019070 con 0x7f78f80d0710 2024-09-17T03:33:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78f4ff9640 1 -- 172.21.15.146:0/3617818106 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78f000cc90 con 0x7f78f80d0710 2024-09-17T03:33:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78fe639640 1 -- 172.21.15.146:0/3617818106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f80ca060 con 0x7f78f80d0710 2024-09-17T03:33:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78f4ff9640 1 -- 172.21.15.146:0/3617818106 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f00146a0 con 0x7f78f80d0710 2024-09-17T03:33:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.445+0000 7f78fe639640 1 -- 172.21.15.146:0/3617818106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f80ca620 con 0x7f78f80d0710 2024-09-17T03:33:33.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.446+0000 7f78fe639640 1 -- 172.21.15.146:0/3617818106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f80c9dd0 con 0x7f78f80d0710 2024-09-17T03:33:33.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.447+0000 7f78f4ff9640 1 -- 172.21.15.146:0/3617818106 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78f001c070 con 0x7f78f80d0710 2024-09-17T03:33:33.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.447+0000 7f78f4ff9640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78e4078bc0 0x7f78e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:33.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.447+0000 7f78f4ff9640 1 -- 172.21.15.146:0/3617818106 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7f78f009a990 con 0x7f78f80d0710 2024-09-17T03:33:33.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.448+0000 7f78f7fff640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78e4078bc0 0x7f78e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:33.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.448+0000 7f78f7fff640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78e4078bc0 0x7f78e407b0d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009890 tx=0x7f78e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:33.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.452+0000 7f78f4ff9640 1 -- 172.21.15.146:0/3617818106 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f78f0062f30 con 0x7f78f80d0710 2024-09-17T03:33:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:33.628+0000 7f78fe639640 1 -- 172.21.15.146:0/3617818106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f78f80ced70 con 0x7f78f80d0710 2024-09-17T03:33:34.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.308+0000 7f78f4ff9640 1 -- 172.21.15.146:0/3617818106 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7f78f0062830 con 0x7f78f80d0710 2024-09-17T03:33:34.307 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:33:34.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 -- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78e4078bc0 msgr2=0x7f78e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:34.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78e4078bc0 0x7f78e407b0d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009890 tx=0x7f78e8008040 comp rx=0 tx=0).stop 2024-09-17T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 -- 172.21.15.146:0/3617818106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78f80d0710 msgr2=0x7f78f81f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78f80d0710 0x7f78f81f7420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78f000b990 tx=0x7f78f000be50 comp rx=0 tx=0).stop 2024-09-17T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 -- 172.21.15.146:0/3617818106 shutdown_connections 2024-09-17T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78e4078bc0 0x7f78e407b0d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78f80d0710 0x7f78f81f7420 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78f80cf6b0 0x7f78f80c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 --2- 172.21.15.146:0/3617818106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78f80b47c0 0x7f78f80a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 -- 172.21.15.146:0/3617818106 >> 172.21.15.146:0/3617818106 conn(0x7f78f809ba20 msgr2=0x7f78f8160860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 -- 172.21.15.146:0/3617818106 shutdown_connections 2024-09-17T03:33:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.311+0000 7f78fe639640 1 -- 172.21.15.146:0/3617818106 wait complete. 2024-09-17T03:33:34.326 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:33:34.326 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:33:34.326 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:33:34.326 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:33:34.327 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:33:34.327 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:33:34.327 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:33:34.327 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:33:34.327 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:33:34.328 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:33:34.328 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:33:34.328 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:33:34.328 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:33:34.328 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:33:34.329 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:33:34.329 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:33:34.337 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:33:34.337 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:33:34.338 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:33:34.338 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:33:34.340 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:33:34.340 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:33:34.343 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:33:34.343 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:33:34.380 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:33:34.381 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:34.381 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:33:34.381 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:34.385 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:33:34.385 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:34.386 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:33:34.387 DEBUG:teuthology.parallel:result is None 2024-09-17T03:33:34.387 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:33:34.475 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:33:34.475 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:33:34.483 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:33:34.483 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:33:34.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.515+0000 7fd9f5469640 1 -- 172.21.15.146:0/4067736989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9f00b47c0 msgr2=0x7fd9f00cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.515+0000 7fd9f5469640 1 --2- 172.21.15.146:0/4067736989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9f00b47c0 0x7fd9f00cd090 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00d3620 tx=0x7fd9e402a560 comp rx=0 tx=0).stop 2024-09-17T03:33:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.515+0000 7fd9f5469640 1 -- 172.21.15.146:0/4067736989 shutdown_connections 2024-09-17T03:33:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.515+0000 7fd9f5469640 1 --2- 172.21.15.146:0/4067736989 >> v2:172.21.15.179:3300/0 conn(0x7fd9f00cd5d0 0x7fd9f00cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.515+0000 7fd9f5469640 1 --2- 172.21.15.146:0/4067736989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9f00b47c0 0x7fd9f00cd090 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.515+0000 7fd9f5469640 1 -- 172.21.15.146:0/4067736989 >> 172.21.15.146:0/4067736989 conn(0x7fd9f009ba20 msgr2=0x7fd9f00b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.515+0000 7fd9f5469640 1 -- 172.21.15.146:0/4067736989 shutdown_connections 2024-09-17T03:33:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.515+0000 7fd9f5469640 1 -- 172.21.15.146:0/4067736989 wait complete. 2024-09-17T03:33:34.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.517+0000 7fd9f5469640 1 Processor -- start 2024-09-17T03:33:34.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.517+0000 7fd9f5469640 1 -- start start 2024-09-17T03:33:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9f5469640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9f00b47c0 0x7fd9f00cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9f5469640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f00cd5d0 0x7fd9f00caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9f5469640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f00d0710 0x7fd9f00c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9f5469640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f00b80a0 con 0x7fd9f00b47c0 2024-09-17T03:33:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9f5469640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f00b1de0 con 0x7fd9f00d0710 2024-09-17T03:33:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9f5469640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f00ca1b0 con 0x7fd9f00cd5d0 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9eeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9f00b47c0 0x7fd9f00cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9eeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9f00b47c0 0x7fd9f00cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39336/0 (socket says 172.21.15.146:39336) 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9eeffd640 1 -- 172.21.15.146:0/1860452682 learned_addr learned my addr 172.21.15.146:0/1860452682 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9ef7fe640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f00d0710 0x7fd9f00c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9ee7fc640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f00cd5d0 0x7fd9f00caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9eeffd640 1 -- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f00cd5d0 msgr2=0x7fd9f00caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9eeffd640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f00cd5d0 0x7fd9f00caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9eeffd640 1 -- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f00d0710 msgr2=0x7fd9f00c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9eeffd640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f00d0710 0x7fd9f00c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9eeffd640 1 -- 172.21.15.146:0/1860452682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f01f7f50 con 0x7fd9f00b47c0 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.519+0000 7fd9eeffd640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9f00b47c0 0x7fd9f00cc0d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000c3a0 tx=0x7fd9e000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.520+0000 7fd9d77fe640 1 -- 172.21.15.146:0/1860452682 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0017070 con 0x7fd9f00b47c0 2024-09-17T03:33:34.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.520+0000 7fd9d77fe640 1 -- 172.21.15.146:0/1860452682 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9e00053c0 con 0x7fd9f00b47c0 2024-09-17T03:33:34.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.520+0000 7fd9f5469640 1 -- 172.21.15.146:0/1860452682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f00c8a90 con 0x7fd9f00b47c0 2024-09-17T03:33:34.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.520+0000 7fd9d77fe640 1 -- 172.21.15.146:0/1860452682 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0003850 con 0x7fd9f00b47c0 2024-09-17T03:33:34.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.520+0000 7fd9f5469640 1 -- 172.21.15.146:0/1860452682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f00c65c0 con 0x7fd9f00b47c0 2024-09-17T03:33:34.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.521+0000 7fd9f5469640 1 -- 172.21.15.146:0/1860452682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f00cd090 con 0x7fd9f00b47c0 2024-09-17T03:33:34.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.521+0000 7fd9d77fe640 1 -- 172.21.15.146:0/1860452682 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9e001a070 con 0x7fd9f00b47c0 2024-09-17T03:33:34.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.522+0000 7fd9d77fe640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9dc078b90 0x7fd9dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:34.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.522+0000 7fd9d77fe640 1 -- 172.21.15.146:0/1860452682 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7fd9e0099bf0 con 0x7fd9f00b47c0 2024-09-17T03:33:34.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.522+0000 7fd9ee7fc640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9dc078b90 0x7fd9dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:34.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.522+0000 7fd9ee7fc640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9dc078b90 0x7fd9dc07b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4033000 tx=0x7fd9e4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:34.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.526+0000 7fd9d77fe640 1 -- 172.21.15.146:0/1860452682 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9f01f7f50 con 0x7fd9f00b47c0 2024-09-17T03:33:34.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:34.711+0000 7fd9f5469640 1 -- 172.21.15.146:0/1860452682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd9f01dcd80 con 0x7fd9f00b47c0 2024-09-17T03:33:35.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.319+0000 7fd9d77fe640 1 -- 172.21.15.146:0/1860452682 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7fd9e0061d70 con 0x7fd9f00b47c0 2024-09-17T03:33:35.318 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:33:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 -- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9dc078b90 msgr2=0x7fd9dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9dc078b90 0x7fd9dc07b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4033000 tx=0x7fd9e4004730 comp rx=0 tx=0).stop 2024-09-17T03:33:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 -- 172.21.15.146:0/1860452682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9f00b47c0 msgr2=0x7fd9f00cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9f00b47c0 0x7fd9f00cc0d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000c3a0 tx=0x7fd9e000c7a0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 -- 172.21.15.146:0/1860452682 shutdown_connections 2024-09-17T03:33:35.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9dc078b90 0x7fd9dc07b0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f00d0710 0x7fd9f00c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f00cd5d0 0x7fd9f00caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 --2- 172.21.15.146:0/1860452682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9f00b47c0 0x7fd9f00cc0d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 -- 172.21.15.146:0/1860452682 >> 172.21.15.146:0/1860452682 conn(0x7fd9f009ba20 msgr2=0x7fd9f00b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 -- 172.21.15.146:0/1860452682 shutdown_connections 2024-09-17T03:33:35.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.322+0000 7fd9f5469640 1 -- 172.21.15.146:0/1860452682 wait complete. 2024-09-17T03:33:35.333 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:33:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.446+0000 7f0d623c6640 1 -- 172.21.15.146:0/544459642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d5c0b61f0 msgr2=0x7f0d5c0b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.446+0000 7f0d623c6640 1 --2- 172.21.15.146:0/544459642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d5c0b61f0 0x7f0d5c0b6600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c15cd70 tx=0x7f0d5402a820 comp rx=0 tx=0).stop 2024-09-17T03:33:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.446+0000 7f0d623c6640 1 -- 172.21.15.146:0/544459642 shutdown_connections 2024-09-17T03:33:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.446+0000 7f0d623c6640 1 --2- 172.21.15.146:0/544459642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d5c0b61f0 0x7f0d5c0b6600 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.446+0000 7f0d623c6640 1 --2- 172.21.15.146:0/544459642 >> v2:172.21.15.179:3300/0 conn(0x7f0d5c0cfca0 0x7f0d5c0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.446+0000 7f0d623c6640 1 -- 172.21.15.146:0/544459642 >> 172.21.15.146:0/544459642 conn(0x7f0d5c0d11f0 msgr2=0x7f0d5c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.446+0000 7f0d623c6640 1 -- 172.21.15.146:0/544459642 shutdown_connections 2024-09-17T03:33:35.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.447+0000 7f0d623c6640 1 -- 172.21.15.146:0/544459642 wait complete. 2024-09-17T03:33:35.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.449+0000 7f0d623c6640 1 Processor -- start 2024-09-17T03:33:35.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.449+0000 7f0d623c6640 1 -- start start 2024-09-17T03:33:35.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d623c6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d5c0b61f0 0x7f0d5c1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:35.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d623c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d5c0cfca0 0x7f0d5c1f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:35.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d623c6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d5c15f1a0 0x7f0d5c159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:35.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d623c6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c0695b0 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d623c6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c069430 con 0x7f0d5c0b61f0 2024-09-17T03:33:35.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d623c6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c069730 con 0x7f0d5c15f1a0 2024-09-17T03:33:35.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d53fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d5c0cfca0 0x7f0d5c1f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:35.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d53fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d5c0cfca0 0x7f0d5c1f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39362/0 (socket says 172.21.15.146:39362) 2024-09-17T03:33:35.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d53fff640 1 -- 172.21.15.146:0/939686955 learned_addr learned my addr 172.21.15.146:0/939686955 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:35.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d5bfff640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d5c0b61f0 0x7f0d5c1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:35.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d60963640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d5c15f1a0 0x7f0d5c159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:35.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d53fff640 1 -- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d5c15f1a0 msgr2=0x7f0d5c159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:35.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d53fff640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d5c15f1a0 0x7f0d5c159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d53fff640 1 -- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d5c0b61f0 msgr2=0x7f0d5c1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:35.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d53fff640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d5c0b61f0 0x7f0d5c1579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d53fff640 1 -- 172.21.15.146:0/939686955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c0ce9b0 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.450+0000 7f0d5bfff640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d5c0b61f0 0x7f0d5c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:35.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.451+0000 7f0d53fff640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d5c0cfca0 0x7f0d5c1f6300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400d740 tx=0x7f0d4400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:35.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.451+0000 7f0d597fa640 1 -- 172.21.15.146:0/939686955 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44017070 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.451+0000 7f0d597fa640 1 -- 172.21.15.146:0/939686955 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d44009d20 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.451+0000 7f0d623c6640 1 -- 172.21.15.146:0/939686955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c0c9770 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.451+0000 7f0d597fa640 1 -- 172.21.15.146:0/939686955 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d440106c0 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.451+0000 7f0d623c6640 1 -- 172.21.15.146:0/939686955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c0c9d30 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.452+0000 7f0d623c6640 1 -- 172.21.15.146:0/939686955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5c069c50 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.453+0000 7f0d597fa640 1 -- 172.21.15.146:0/939686955 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d4401a070 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.453+0000 7f0d597fa640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d3c078bc0 0x7f0d3c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:35.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.453+0000 7f0d597fa640 1 -- 172.21.15.146:0/939686955 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f0d4409ab20 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.453+0000 7f0d5bfff640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d3c078bc0 0x7f0d3c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:35.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.454+0000 7f0d5bfff640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d3c078bc0 0x7f0d3c07b0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0016a0 tx=0x7f0d4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:35.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.458+0000 7f0d597fa640 1 -- 172.21.15.146:0/939686955 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0d44063340 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.703+0000 7f0d623c6640 1 -- 172.21.15.146:0/939686955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0d5c0c7ff0 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.703+0000 7f0d597fa640 1 -- 172.21.15.146:0/939686955 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f0d44062c40 con 0x7f0d5c0cfca0 2024-09-17T03:33:35.706 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:35.706 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:33:35.706 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:33:35.706 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.706 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:33:35.706 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:33:35.706 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.706 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:33:35.706 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:33:35.706 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.707 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:33:35.708 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:33:35.709 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:33:35.710 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:33:35.711 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.712 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:33:35.713 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.714 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:33:35.715 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:33:35.716 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.717 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-mds", 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBT+OhmyuyTGxAAv5+/MDOniL+QbG/+p8Zlww==", 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T03:33:35.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBT+OhmavaTGxAAyyNN6wXfjN3fqy28VYYEBg==", 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-osd", 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBT+OhmVP2TGxAAXp8IXD0BffUuv2zRTv4ssw==", 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBT+Ohm7QaUGxAAzx/YtYnlpOzgCqarOtap7g==", 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBT+OhmHQ6UGxAAeccGtZXmcnk1AqWpDaqUiA==", 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T03:33:35.720 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBT+OhmbBWUGxAAnhw99/oE53kj8Y80/tRNew==", 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:33:35.721 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:35.722 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:33:35.723 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:33:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.705+0000 7f0d623c6640 1 -- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d3c078bc0 msgr2=0x7f0d3c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.705+0000 7f0d623c6640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d3c078bc0 0x7f0d3c07b0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0016a0 tx=0x7f0d4c009040 comp rx=0 tx=0).stop 2024-09-17T03:33:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.705+0000 7f0d623c6640 1 -- 172.21.15.146:0/939686955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d5c0cfca0 msgr2=0x7f0d5c1f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.705+0000 7f0d623c6640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d5c0cfca0 0x7f0d5c1f6300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400d740 tx=0x7f0d4400dc00 comp rx=0 tx=0).stop 2024-09-17T03:33:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.705+0000 7f0d623c6640 1 -- 172.21.15.146:0/939686955 shutdown_connections 2024-09-17T03:33:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.705+0000 7f0d623c6640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d3c078bc0 0x7f0d3c07b0d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.705+0000 7f0d623c6640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d5c15f1a0 0x7f0d5c159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.705+0000 7f0d623c6640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d5c0cfca0 0x7f0d5c1f6300 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.705+0000 7f0d623c6640 1 --2- 172.21.15.146:0/939686955 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d5c0b61f0 0x7f0d5c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.705+0000 7f0d623c6640 1 -- 172.21.15.146:0/939686955 >> 172.21.15.146:0/939686955 conn(0x7f0d5c0d11f0 msgr2=0x7f0d5c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:35.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.706+0000 7f0d623c6640 1 -- 172.21.15.146:0/939686955 shutdown_connections 2024-09-17T03:33:35.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.706+0000 7f0d623c6640 1 -- 172.21.15.146:0/939686955 wait complete. 2024-09-17T03:33:35.725 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T03:33:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.840+0000 7f174ee7e640 1 -- 172.21.15.146:0/1074498198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480b5ce0 msgr2=0x7f17480b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.840+0000 7f174ee7e640 1 --2- 172.21.15.146:0/1074498198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480b5ce0 0x7f17480b1320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1748074610 tx=0x7f173c02a560 comp rx=0 tx=0).stop 2024-09-17T03:33:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.841+0000 7f174ee7e640 1 -- 172.21.15.146:0/1074498198 shutdown_connections 2024-09-17T03:33:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.841+0000 7f174ee7e640 1 --2- 172.21.15.146:0/1074498198 >> v2:172.21.15.179:3300/0 conn(0x7f17480b3b60 0x7f17480b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.841+0000 7f174ee7e640 1 --2- 172.21.15.146:0/1074498198 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17480b5750 0x7f17480b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.841+0000 7f174ee7e640 1 --2- 172.21.15.146:0/1074498198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480b5ce0 0x7f17480b1320 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.841+0000 7f174ee7e640 1 -- 172.21.15.146:0/1074498198 >> 172.21.15.146:0/1074498198 conn(0x7f17480b7b20 msgr2=0x7f174809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.841+0000 7f174ee7e640 1 -- 172.21.15.146:0/1074498198 shutdown_connections 2024-09-17T03:33:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.841+0000 7f174ee7e640 1 -- 172.21.15.146:0/1074498198 wait complete. 2024-09-17T03:33:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.842+0000 7f174ee7e640 1 Processor -- start 2024-09-17T03:33:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.842+0000 7f174ee7e640 1 -- start start 2024-09-17T03:33:35.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174ee7e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17480b3b60 0x7f1748146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:35.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174ee7e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17480b5750 0x7f174806dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:35.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174ee7e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480b5ce0 0x7f174806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:35.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174ee7e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f17480b2970 con 0x7f17480b5ce0 2024-09-17T03:33:35.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174ee7e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f17480b27f0 con 0x7f17480b5750 2024-09-17T03:33:35.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174ee7e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f17480b2af0 con 0x7f17480b3b60 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174d41b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480b5ce0 0x7f174806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174d41b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480b5ce0 0x7f174806e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39372/0 (socket says 172.21.15.146:39372) 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174d41b640 1 -- 172.21.15.146:0/1163333532 learned_addr learned my addr 172.21.15.146:0/1163333532 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174cc1a640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17480b3b60 0x7f1748146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f1747fff640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17480b5750 0x7f174806dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174d41b640 1 -- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17480b3b60 msgr2=0x7f1748146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174d41b640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17480b3b60 0x7f1748146eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174d41b640 1 -- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17480b5750 msgr2=0x7f174806dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174d41b640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17480b5750 0x7f174806dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.844+0000 7f174d41b640 1 -- 172.21.15.146:0/1163333532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174815f170 con 0x7f17480b5ce0 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.845+0000 7f174d41b640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480b5ce0 0x7f174806e2a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f174000cab0 tx=0x7f174000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.845+0000 7f17457fa640 1 -- 172.21.15.146:0/1163333532 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740007d30 con 0x7f17480b5ce0 2024-09-17T03:33:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.845+0000 7f17457fa640 1 -- 172.21.15.146:0/1163333532 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f174000f450 con 0x7f17480b5ce0 2024-09-17T03:33:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.845+0000 7f174ee7e640 1 -- 172.21.15.146:0/1163333532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174815f450 con 0x7f17480b5ce0 2024-09-17T03:33:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.845+0000 7f17457fa640 1 -- 172.21.15.146:0/1163333532 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174000f8a0 con 0x7f17480b5ce0 2024-09-17T03:33:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.845+0000 7f174ee7e640 1 -- 172.21.15.146:0/1163333532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174815fa10 con 0x7f17480b5ce0 2024-09-17T03:33:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.846+0000 7f174ee7e640 1 -- 172.21.15.146:0/1163333532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17480b3620 con 0x7f17480b5ce0 2024-09-17T03:33:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.847+0000 7f17457fa640 1 -- 172.21.15.146:0/1163333532 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f174000fa40 con 0x7f17480b5ce0 2024-09-17T03:33:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.847+0000 7f17457fa640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f172c078b90 0x7f172c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.847+0000 7f17457fa640 1 -- 172.21.15.146:0/1163333532 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f174009b290 con 0x7f17480b5ce0 2024-09-17T03:33:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.847+0000 7f174cc1a640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f172c078b90 0x7f172c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.848+0000 7f174cc1a640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f172c078b90 0x7f172c07b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f173c033000 tx=0x7f173c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:35.852+0000 7f17457fa640 1 -- 172.21.15.146:0/1163333532 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1740014030 con 0x7f17480b5ce0 2024-09-17T03:33:36.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.093+0000 7f174ee7e640 1 -- 172.21.15.146:0/1163333532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f174815bd90 con 0x7f17480b5ce0 2024-09-17T03:33:36.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.096+0000 7f17457fa640 1 -- 172.21.15.146:0/1163333532 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f17400633e0 con 0x7f17480b5ce0 2024-09-17T03:33:36.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 -- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f172c078b90 msgr2=0x7f172c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f172c078b90 0x7f172c07b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f173c033000 tx=0x7f173c004730 comp rx=0 tx=0).stop 2024-09-17T03:33:36.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 -- 172.21.15.146:0/1163333532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480b5ce0 msgr2=0x7f174806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480b5ce0 0x7f174806e2a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f174000cab0 tx=0x7f174000cf70 comp rx=0 tx=0).stop 2024-09-17T03:33:36.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 -- 172.21.15.146:0/1163333532 shutdown_connections 2024-09-17T03:33:36.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f172c078b90 0x7f172c07b0a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17480b5ce0 0x7f174806e2a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f17480b5750 0x7f174806dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 --2- 172.21.15.146:0/1163333532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17480b3b60 0x7f1748146eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 -- 172.21.15.146:0/1163333532 >> 172.21.15.146:0/1163333532 conn(0x7f17480b7b20 msgr2=0x7f1748071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:36.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 -- 172.21.15.146:0/1163333532 shutdown_connections 2024-09-17T03:33:36.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.098+0000 7f174ee7e640 1 -- 172.21.15.146:0/1163333532 wait complete. 2024-09-17T03:33:36.108 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T03:33:36.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.223+0000 7f10c5807640 1 -- 172.21.15.146:0/789387060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10ac004d40 msgr2=0x7f10ac0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.223+0000 7f10c5807640 1 --2- 172.21.15.146:0/789387060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10ac004d40 0x7f10ac0051f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f10b8005fd0 tx=0x7f10ac005830 comp rx=0 tx=0).stop 2024-09-17T03:33:36.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.223+0000 7f10bf7fe640 1 -- 172.21.15.146:0/789387060 reap_dead start 2024-09-17T03:33:36.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.223+0000 7f10c5807640 1 -- 172.21.15.146:0/789387060 shutdown_connections 2024-09-17T03:33:36.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.223+0000 7f10c5807640 1 -- 172.21.15.146:0/789387060 >> 172.21.15.146:0/789387060 conn(0x7f10c00d4960 msgr2=0x7f10c00d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:36.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.223+0000 7f10c5807640 1 -- 172.21.15.146:0/789387060 shutdown_connections 2024-09-17T03:33:36.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.223+0000 7f10c5807640 1 -- 172.21.15.146:0/789387060 wait complete. 2024-09-17T03:33:36.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.224+0000 7f10c5807640 1 Processor -- start 2024-09-17T03:33:36.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.225+0000 7f10c5807640 1 -- start start 2024-09-17T03:33:36.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10c5807640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10ac004d40 0x7f10c00b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10c5807640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c0153af0 0x7f10c00b9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10c5807640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00ce850 0x7f10c01f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10c5807640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f10c015edb0 con 0x7f10ac004d40 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10c5807640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10c015ec30 con 0x7f10c0153af0 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10c5807640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f10c015ef30 con 0x7f10c00ce850 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10beffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10ac004d40 0x7f10c00b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10beffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10ac004d40 0x7f10c00b8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39400/0 (socket says 172.21.15.146:39400) 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10beffd640 1 -- 172.21.15.146:0/1113798349 learned_addr learned my addr 172.21.15.146:0/1113798349 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10b67fc640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c0153af0 0x7f10c00b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10bf7fe640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00ce850 0x7f10c01f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10beffd640 1 -- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00ce850 msgr2=0x7f10c01f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10beffd640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00ce850 0x7f10c01f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10beffd640 1 -- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c0153af0 msgr2=0x7f10c00b9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10beffd640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c0153af0 0x7f10c00b9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.226+0000 7f10beffd640 1 -- 172.21.15.146:0/1113798349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c01f8a00 con 0x7f10ac004d40 2024-09-17T03:33:36.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.227+0000 7f10beffd640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10ac004d40 0x7f10c00b8e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f10b0003f80 tx=0x7f10b00016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:36.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.227+0000 7f10bcff9640 1 -- 172.21.15.146:0/1113798349 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0011700 con 0x7f10ac004d40 2024-09-17T03:33:36.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.227+0000 7f10bcff9640 1 -- 172.21.15.146:0/1113798349 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10b0016020 con 0x7f10ac004d40 2024-09-17T03:33:36.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.227+0000 7f10c5807640 1 -- 172.21.15.146:0/1113798349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c01f8ce0 con 0x7f10ac004d40 2024-09-17T03:33:36.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.227+0000 7f10bcff9640 1 -- 172.21.15.146:0/1113798349 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0011b20 con 0x7f10ac004d40 2024-09-17T03:33:36.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.227+0000 7f10c5807640 1 -- 172.21.15.146:0/1113798349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c015c690 con 0x7f10ac004d40 2024-09-17T03:33:36.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.228+0000 7f10c5807640 1 -- 172.21.15.146:0/1113798349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c0068d00 con 0x7f10ac004d40 2024-09-17T03:33:36.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.228+0000 7f10bcff9640 1 -- 172.21.15.146:0/1113798349 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10b0011cc0 con 0x7f10ac004d40 2024-09-17T03:33:36.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.229+0000 7f10bcff9640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f10a0078b90 0x7f10a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.229+0000 7f10bcff9640 1 -- 172.21.15.146:0/1113798349 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f10b009b510 con 0x7f10ac004d40 2024-09-17T03:33:36.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.229+0000 7f10b67fc640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f10a0078b90 0x7f10a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.230+0000 7f10b67fc640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f10a0078b90 0x7f10a007b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f10c00b9bf0 tx=0x7f10a8006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:36.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.233+0000 7f10bcff9640 1 -- 172.21.15.146:0/1113798349 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f10b0020020 con 0x7f10ac004d40 2024-09-17T03:33:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.479+0000 7f10c5807640 1 -- 172.21.15.146:0/1113798349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f10c015db30 con 0x7f10ac004d40 2024-09-17T03:33:36.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.482+0000 7f10bcff9640 1 -- 172.21.15.146:0/1113798349 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f10b00636e0 con 0x7f10ac004d40 2024-09-17T03:33:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 -- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f10a0078b90 msgr2=0x7f10a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f10a0078b90 0x7f10a007b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f10c00b9bf0 tx=0x7f10a8006040 comp rx=0 tx=0).stop 2024-09-17T03:33:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 -- 172.21.15.146:0/1113798349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10ac004d40 msgr2=0x7f10c00b8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10ac004d40 0x7f10c00b8e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f10b0003f80 tx=0x7f10b00016f0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 -- 172.21.15.146:0/1113798349 shutdown_connections 2024-09-17T03:33:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f10a0078b90 0x7f10a007b0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10c00ce850 0x7f10c01f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10c0153af0 0x7f10c00b9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 --2- 172.21.15.146:0/1113798349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10ac004d40 0x7f10c00b8e10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 -- 172.21.15.146:0/1113798349 >> 172.21.15.146:0/1113798349 conn(0x7f10c00d4960 msgr2=0x7f10c0075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 -- 172.21.15.146:0/1113798349 shutdown_connections 2024-09-17T03:33:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.484+0000 7f10c5807640 1 -- 172.21.15.146:0/1113798349 wait complete. 2024-09-17T03:33:36.494 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T03:33:36.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.610+0000 7fd9fd027640 1 -- 172.21.15.146:0/2689324094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e4004800 msgr2=0x7fd9e4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.610+0000 7fd9fd027640 1 --2- 172.21.15.146:0/2689324094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e4004800 0x7fd9e4004c10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000c310 tx=0x7fd9e4005830 comp rx=0 tx=0).stop 2024-09-17T03:33:36.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.610+0000 7fd9f759e640 1 -- 172.21.15.146:0/2689324094 reap_dead start 2024-09-17T03:33:36.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.610+0000 7fd9fd027640 1 -- 172.21.15.146:0/2689324094 shutdown_connections 2024-09-17T03:33:36.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.610+0000 7fd9fd027640 1 -- 172.21.15.146:0/2689324094 >> 172.21.15.146:0/2689324094 conn(0x7fd9f806d3c0 msgr2=0x7fd9f80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:36.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.610+0000 7fd9fd027640 1 -- 172.21.15.146:0/2689324094 shutdown_connections 2024-09-17T03:33:36.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.610+0000 7fd9fd027640 1 -- 172.21.15.146:0/2689324094 wait complete. 2024-09-17T03:33:36.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.612+0000 7fd9fd027640 1 Processor -- start 2024-09-17T03:33:36.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.612+0000 7fd9fd027640 1 -- start start 2024-09-17T03:33:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.613+0000 7fd9fd027640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e4004800 0x7fd9f81f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.613+0000 7fd9fd027640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f81553f0 0x7fd9f81f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9fd027640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f80b1210 0x7fd9f80b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9fd027640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f81526a0 con 0x7fd9e4004800 2024-09-17T03:33:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9fd027640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f80b4720 con 0x7fd9f80b1210 2024-09-17T03:33:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9fd027640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f8152820 con 0x7fd9f81553f0 2024-09-17T03:33:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9f6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e4004800 0x7fd9f81f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9f6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e4004800 0x7fd9f81f4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39418/0 (socket says 172.21.15.146:39418) 2024-09-17T03:33:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9f6d9d640 1 -- 172.21.15.146:0/2099557405 learned_addr learned my addr 172.21.15.146:0/2099557405 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9ee59c640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f81553f0 0x7fd9f81f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9f759e640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f80b1210 0x7fd9f80b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9f6d9d640 1 -- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f81553f0 msgr2=0x7fd9f81f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9f6d9d640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f81553f0 0x7fd9f81f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9f6d9d640 1 -- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f80b1210 msgr2=0x7fd9f80b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9f6d9d640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f80b1210 0x7fd9f80b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9f6d9d640 1 -- 172.21.15.146:0/2099557405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f814ce80 con 0x7fd9e4004800 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9f6d9d640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e4004800 0x7fd9f81f4130 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80118d0 tx=0x7fd9e8011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9effff640 1 -- 172.21.15.146:0/2099557405 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e801e070 con 0x7fd9e4004800 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9effff640 1 -- 172.21.15.146:0/2099557405 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9e800fb50 con 0x7fd9e4004800 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9fd027640 1 -- 172.21.15.146:0/2099557405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f814d160 con 0x7fd9e4004800 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9effff640 1 -- 172.21.15.146:0/2099557405 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8019410 con 0x7fd9e4004800 2024-09-17T03:33:36.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.614+0000 7fd9fd027640 1 -- 172.21.15.146:0/2099557405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f814d720 con 0x7fd9e4004800 2024-09-17T03:33:36.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.615+0000 7fd9fd027640 1 -- 172.21.15.146:0/2099557405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f80cfea0 con 0x7fd9e4004800 2024-09-17T03:33:36.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.616+0000 7fd9effff640 1 -- 172.21.15.146:0/2099557405 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9e8021070 con 0x7fd9e4004800 2024-09-17T03:33:36.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.617+0000 7fd9effff640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d8078bc0 0x7fd9d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.617+0000 7fd9effff640 1 -- 172.21.15.146:0/2099557405 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fd9e809b850 con 0x7fd9e4004800 2024-09-17T03:33:36.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.617+0000 7fd9ee59c640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d8078bc0 0x7fd9d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.618+0000 7fd9ee59c640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d8078bc0 0x7fd9d807b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0033000 tx=0x7fd9e0038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:36.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.620+0000 7fd9effff640 1 -- 172.21.15.146:0/2099557405 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9e8063b30 con 0x7fd9e4004800 2024-09-17T03:33:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.860+0000 7fd9fd027640 1 -- 172.21.15.146:0/2099557405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fd9f80d13a0 con 0x7fd9e4004800 2024-09-17T03:33:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.863+0000 7fd9effff640 1 -- 172.21.15.146:0/2099557405 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fd9e8068560 con 0x7fd9e4004800 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 -- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d8078bc0 msgr2=0x7fd9d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d8078bc0 0x7fd9d807b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0033000 tx=0x7fd9e0038040 comp rx=0 tx=0).stop 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 -- 172.21.15.146:0/2099557405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e4004800 msgr2=0x7fd9f81f4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e4004800 0x7fd9f81f4130 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80118d0 tx=0x7fd9e8011d90 comp rx=0 tx=0).stop 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 -- 172.21.15.146:0/2099557405 shutdown_connections 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d8078bc0 0x7fd9d807b0d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9f80b1210 0x7fd9f80b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9f81553f0 0x7fd9f81f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 --2- 172.21.15.146:0/2099557405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e4004800 0x7fd9f81f4130 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 -- 172.21.15.146:0/2099557405 >> 172.21.15.146:0/2099557405 conn(0x7fd9f806d3c0 msgr2=0x7fd9f81509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 -- 172.21.15.146:0/2099557405 shutdown_connections 2024-09-17T03:33:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.865+0000 7fd9fd027640 1 -- 172.21.15.146:0/2099557405 wait complete. 2024-09-17T03:33:36.876 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T03:33:36.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.990+0000 7fb1e4e69640 1 -- 172.21.15.146:0/2545434813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e015f1a0 msgr2=0x7fb1e00cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.990+0000 7fb1e4e69640 1 --2- 172.21.15.146:0/2545434813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e015f1a0 0x7fb1e00cfca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0005fd0 tx=0x7fb1d002a820 comp rx=0 tx=0).stop 2024-09-17T03:33:36.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.991+0000 7fb1e4e69640 1 -- 172.21.15.146:0/2545434813 shutdown_connections 2024-09-17T03:33:36.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.991+0000 7fb1e4e69640 1 --2- 172.21.15.146:0/2545434813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1e00b61f0 0x7fb1e00b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.991+0000 7fb1e4e69640 1 --2- 172.21.15.146:0/2545434813 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e015f1a0 0x7fb1e00cfca0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.991+0000 7fb1e4e69640 1 -- 172.21.15.146:0/2545434813 >> 172.21.15.146:0/2545434813 conn(0x7fb1e00d11f0 msgr2=0x7fb1e00d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.991+0000 7fb1e4e69640 1 -- 172.21.15.146:0/2545434813 shutdown_connections 2024-09-17T03:33:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.991+0000 7fb1e4e69640 1 -- 172.21.15.146:0/2545434813 wait complete. 2024-09-17T03:33:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.993+0000 7fb1e4e69640 1 Processor -- start 2024-09-17T03:33:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.993+0000 7fb1e4e69640 1 -- start start 2024-09-17T03:33:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1e4e69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e00b61f0 0x7fb1e00c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1e4e69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1e015f1a0 0x7fb1e01f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1e4e69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e01631a0 0x7fb1e01f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1e4e69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00695b0 con 0x7fb1e01631a0 2024-09-17T03:33:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1e4e69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e0069430 con 0x7fb1e00b61f0 2024-09-17T03:33:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1e4e69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e0069730 con 0x7fb1e015f1a0 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1ded9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e01631a0 0x7fb1e01f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1ded9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e01631a0 0x7fb1e01f63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39432/0 (socket says 172.21.15.146:39432) 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1ded9d640 1 -- 172.21.15.146:0/1300088547 learned_addr learned my addr 172.21.15.146:0/1300088547 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1de59c640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e00b61f0 0x7fb1e00c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1ddd9b640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1e015f1a0 0x7fb1e01f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1ded9d640 1 -- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1e015f1a0 msgr2=0x7fb1e01f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1ded9d640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1e015f1a0 0x7fb1e01f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1ded9d640 1 -- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e00b61f0 msgr2=0x7fb1e00c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1ded9d640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e00b61f0 0x7fb1e00c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1ded9d640 1 -- 172.21.15.146:0/1300088547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e00ca540 con 0x7fb1e01631a0 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.994+0000 7fb1ded9d640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e01631a0 0x7fb1e01f63a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800e6a0 tx=0x7fb1d800eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.995+0000 7fb1ceffd640 1 -- 172.21.15.146:0/1300088547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d800cab0 con 0x7fb1e01631a0 2024-09-17T03:33:36.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.995+0000 7fb1ceffd640 1 -- 172.21.15.146:0/1300088547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1d800cc50 con 0x7fb1e01631a0 2024-09-17T03:33:36.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.995+0000 7fb1e4e69640 1 -- 172.21.15.146:0/1300088547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e00c8340 con 0x7fb1e01631a0 2024-09-17T03:33:36.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.995+0000 7fb1ceffd640 1 -- 172.21.15.146:0/1300088547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8005280 con 0x7fb1e01631a0 2024-09-17T03:33:36.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.995+0000 7fb1e4e69640 1 -- 172.21.15.146:0/1300088547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e00c8900 con 0x7fb1e01631a0 2024-09-17T03:33:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.996+0000 7fb1e4e69640 1 -- 172.21.15.146:0/1300088547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e00c9020 con 0x7fb1e01631a0 2024-09-17T03:33:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.996+0000 7fb1ceffd640 1 -- 172.21.15.146:0/1300088547 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1d8005420 con 0x7fb1e01631a0 2024-09-17T03:33:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.997+0000 7fb1ceffd640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 0x7fb1c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.997+0000 7fb1ceffd640 1 -- 172.21.15.146:0/1300088547 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fb1d809b1a0 con 0x7fb1e01631a0 2024-09-17T03:33:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.997+0000 7fb1de59c640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 0x7fb1c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:36.998+0000 7fb1de59c640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 0x7fb1c007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0034000 tx=0x7fb1d0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.002+0000 7fb1ceffd640 1 -- 172.21.15.146:0/1300088547 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1d800ce20 con 0x7fb1e01631a0 2024-09-17T03:33:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.243+0000 7fb1e4e69640 1 -- 172.21.15.146:0/1300088547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fb1e00c7ff0 con 0x7fb1e01631a0 2024-09-17T03:33:37.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.246+0000 7fb1ceffd640 1 -- 172.21.15.146:0/1300088547 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fb1d80632f0 con 0x7fb1e01631a0 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 -- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 msgr2=0x7fb1c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 0x7fb1c007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0034000 tx=0x7fb1d0004ab0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 -- 172.21.15.146:0/1300088547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e01631a0 msgr2=0x7fb1e01f63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e01631a0 0x7fb1e01f63a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800e6a0 tx=0x7fb1d800eb60 comp rx=0 tx=0).stop 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 -- 172.21.15.146:0/1300088547 shutdown_connections 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 0x7fb1c007b0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e01631a0 0x7fb1e01f63a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1e015f1a0 0x7fb1e01f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 --2- 172.21.15.146:0/1300088547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e00b61f0 0x7fb1e00c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 -- 172.21.15.146:0/1300088547 >> 172.21.15.146:0/1300088547 conn(0x7fb1e00d11f0 msgr2=0x7fb1e00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 -- 172.21.15.146:0/1300088547 shutdown_connections 2024-09-17T03:33:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.248+0000 7fb1e4e69640 1 -- 172.21.15.146:0/1300088547 wait complete. 2024-09-17T03:33:37.258 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T03:33:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.374+0000 7fb9dda94640 1 -- 172.21.15.146:0/4017138112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d8153af0 msgr2=0x7fb9d815ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.374+0000 7fb9dda94640 1 --2- 172.21.15.146:0/4017138112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d8153af0 0x7fb9d815ce70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8005fd0 tx=0x7fb9c802a520 comp rx=0 tx=0).stop 2024-09-17T03:33:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.374+0000 7fb9dda94640 1 -- 172.21.15.146:0/4017138112 shutdown_connections 2024-09-17T03:33:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.375+0000 7fb9dda94640 1 --2- 172.21.15.146:0/4017138112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d80cdf10 0x7fb9d80734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.375+0000 7fb9dda94640 1 --2- 172.21.15.146:0/4017138112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d8153af0 0x7fb9d815ce70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.375+0000 7fb9dda94640 1 -- 172.21.15.146:0/4017138112 >> 172.21.15.146:0/4017138112 conn(0x7fb9d80b3410 msgr2=0x7fb9d80b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.375+0000 7fb9dda94640 1 -- 172.21.15.146:0/4017138112 shutdown_connections 2024-09-17T03:33:37.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.375+0000 7fb9dda94640 1 -- 172.21.15.146:0/4017138112 wait complete. 2024-09-17T03:33:37.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.376+0000 7fb9dda94640 1 Processor -- start 2024-09-17T03:33:37.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.376+0000 7fb9dda94640 1 -- start start 2024-09-17T03:33:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9dda94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d8073a30 0x7fb9d81f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9dda94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d80cdf10 0x7fb9d8153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9dda94640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d8153af0 0x7fb9d81e8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9dda94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d8160bc0 con 0x7fb9d8073a30 2024-09-17T03:33:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9dda94640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d80d0bd0 con 0x7fb9d80cdf10 2024-09-17T03:33:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9dda94640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d8160d40 con 0x7fb9d8153af0 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9d77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d8073a30 0x7fb9d81f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9d77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d8073a30 0x7fb9d81f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52210/0 (socket says 172.21.15.146:52210) 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9d77fe640 1 -- 172.21.15.146:0/853165600 learned_addr learned my addr 172.21.15.146:0/853165600 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9d7fff640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d8153af0 0x7fb9d81e8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9d6ffd640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d80cdf10 0x7fb9d8153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9d77fe640 1 -- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d8153af0 msgr2=0x7fb9d81e8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9d77fe640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d8153af0 0x7fb9d81e8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9d77fe640 1 -- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d80cdf10 msgr2=0x7fb9d8153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9d77fe640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d80cdf10 0x7fb9d8153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9d77fe640 1 -- 172.21.15.146:0/853165600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d81570c0 con 0x7fb9d8073a30 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.378+0000 7fb9d77fe640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d8073a30 0x7fb9d81f4560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8034040 tx=0x7fb9c80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.379+0000 7fb9bffff640 1 -- 172.21.15.146:0/853165600 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c803e030 con 0x7fb9d8073a30 2024-09-17T03:33:37.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.379+0000 7fb9bffff640 1 -- 172.21.15.146:0/853165600 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9c80047a0 con 0x7fb9d8073a30 2024-09-17T03:33:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.379+0000 7fb9dda94640 1 -- 172.21.15.146:0/853165600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d81e6490 con 0x7fb9d8073a30 2024-09-17T03:33:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.379+0000 7fb9bffff640 1 -- 172.21.15.146:0/853165600 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8035040 con 0x7fb9d8073a30 2024-09-17T03:33:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.379+0000 7fb9dda94640 1 -- 172.21.15.146:0/853165600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d81544e0 con 0x7fb9d8073a30 2024-09-17T03:33:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.380+0000 7fb9dda94640 1 -- 172.21.15.146:0/853165600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d8154710 con 0x7fb9d8073a30 2024-09-17T03:33:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.380+0000 7fb9bffff640 1 -- 172.21.15.146:0/853165600 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb9c8041030 con 0x7fb9d8073a30 2024-09-17T03:33:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.381+0000 7fb9bffff640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c4078b90 0x7fb9c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.381+0000 7fb9bffff640 1 -- 172.21.15.146:0/853165600 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fb9c80bb020 con 0x7fb9d8073a30 2024-09-17T03:33:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.381+0000 7fb9d6ffd640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c4078b90 0x7fb9c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.382+0000 7fb9d6ffd640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c4078b90 0x7fb9c407b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9d814fd30 tx=0x7fb9cc00a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.386+0000 7fb9bffff640 1 -- 172.21.15.146:0/853165600 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9d8154710 con 0x7fb9d8073a30 2024-09-17T03:33:37.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.633+0000 7fb9dda94640 1 -- 172.21.15.146:0/853165600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fb9d80734f0 con 0x7fb9d8073a30 2024-09-17T03:33:37.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.636+0000 7fb9bffff640 1 -- 172.21.15.146:0/853165600 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7fb9d8070ac0 con 0x7fb9d8073a30 2024-09-17T03:33:37.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 -- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c4078b90 msgr2=0x7fb9c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c4078b90 0x7fb9c407b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9d814fd30 tx=0x7fb9cc00a250 comp rx=0 tx=0).stop 2024-09-17T03:33:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 -- 172.21.15.146:0/853165600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d8073a30 msgr2=0x7fb9d81f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d8073a30 0x7fb9d81f4560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8034040 tx=0x7fb9c80039e0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 -- 172.21.15.146:0/853165600 shutdown_connections 2024-09-17T03:33:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c4078b90 0x7fb9c407b0a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9d8153af0 0x7fb9d81e8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9d80cdf10 0x7fb9d8153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 --2- 172.21.15.146:0/853165600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9d8073a30 0x7fb9d81f4560 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 -- 172.21.15.146:0/853165600 >> 172.21.15.146:0/853165600 conn(0x7fb9d80b3410 msgr2=0x7fb9d80b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 -- 172.21.15.146:0/853165600 shutdown_connections 2024-09-17T03:33:37.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.639+0000 7fb9dda94640 1 -- 172.21.15.146:0/853165600 wait complete. 2024-09-17T03:33:37.650 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T03:33:37.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.764+0000 7fb9cdec5640 1 -- 172.21.15.146:0/1400279048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80cd7a0 msgr2=0x7fb9c80cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:37.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.764+0000 7fb9cdec5640 1 --2- 172.21.15.146:0/1400279048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80cd7a0 0x7fb9c80cdbb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0005fd0 tx=0x7fb9c002aa10 comp rx=0 tx=0).stop 2024-09-17T03:33:37.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.764+0000 7fb9cdec5640 1 -- 172.21.15.146:0/1400279048 shutdown_connections 2024-09-17T03:33:37.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.764+0000 7fb9cdec5640 1 --2- 172.21.15.146:0/1400279048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80cd7a0 0x7fb9c80cdbb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.764+0000 7fb9cdec5640 1 -- 172.21.15.146:0/1400279048 >> 172.21.15.146:0/1400279048 conn(0x7fb9c809ba20 msgr2=0x7fb9c80b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:37.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.764+0000 7fb9cdec5640 1 -- 172.21.15.146:0/1400279048 shutdown_connections 2024-09-17T03:33:37.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.764+0000 7fb9cdec5640 1 -- 172.21.15.146:0/1400279048 wait complete. 2024-09-17T03:33:37.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.766+0000 7fb9cdec5640 1 Processor -- start 2024-09-17T03:33:37.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.766+0000 7fb9cdec5640 1 -- start start 2024-09-17T03:33:37.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9cdec5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c80b47c0 0x7fb9c8154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:37.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9cdec5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c80cd7a0 0x7fb9c80ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9cdec5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80d0710 0x7fb9c80ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9cdec5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c80b2f30 con 0x7fb9c80d0710 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9cdec5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c80b80a0 con 0x7fb9c80cd7a0 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9cdec5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c8168470 con 0x7fb9c80b47c0 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80d0710 0x7fb9c80ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80d0710 0x7fb9c80ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52224/0 (socket says 172.21.15.146:52224) 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9c7fff640 1 -- 172.21.15.146:0/4157313239 learned_addr learned my addr 172.21.15.146:0/4157313239 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9c6ffd640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c80cd7a0 0x7fb9c80ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9c77fe640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c80b47c0 0x7fb9c8154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9c7fff640 1 -- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c80b47c0 msgr2=0x7fb9c8154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9c7fff640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c80b47c0 0x7fb9c8154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9c7fff640 1 -- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c80cd7a0 msgr2=0x7fb9c80ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9c7fff640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c80cd7a0 0x7fb9c80ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:37.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9c7fff640 1 -- 172.21.15.146:0/4157313239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c80cc560 con 0x7fb9c80d0710 2024-09-17T03:33:37.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.768+0000 7fb9c7fff640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80d0710 0x7fb9c80ca680 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0006010 tx=0x7fb9c0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:37.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.769+0000 7fb9affff640 1 -- 172.21.15.146:0/4157313239 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0046070 con 0x7fb9c80d0710 2024-09-17T03:33:37.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.769+0000 7fb9affff640 1 -- 172.21.15.146:0/4157313239 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9c00045c0 con 0x7fb9c80d0710 2024-09-17T03:33:37.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.769+0000 7fb9cdec5640 1 -- 172.21.15.146:0/4157313239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c80c9c60 con 0x7fb9c80d0710 2024-09-17T03:33:37.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.769+0000 7fb9affff640 1 -- 172.21.15.146:0/4157313239 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0033070 con 0x7fb9c80d0710 2024-09-17T03:33:37.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.769+0000 7fb9cdec5640 1 -- 172.21.15.146:0/4157313239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c815fdf0 con 0x7fb9c80d0710 2024-09-17T03:33:37.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.770+0000 7fb9cdec5640 1 -- 172.21.15.146:0/4157313239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c80cdbb0 con 0x7fb9c80d0710 2024-09-17T03:33:37.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.770+0000 7fb9affff640 1 -- 172.21.15.146:0/4157313239 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb9c0049070 con 0x7fb9c80d0710 2024-09-17T03:33:37.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.771+0000 7fb9affff640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9b4078bc0 0x7fb9b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:37.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.771+0000 7fb9affff640 1 -- 172.21.15.146:0/4157313239 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fb9c00bbc50 con 0x7fb9c80d0710 2024-09-17T03:33:37.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.771+0000 7fb9c77fe640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9b4078bc0 0x7fb9b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:37.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.772+0000 7fb9c77fe640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9b4078bc0 0x7fb9b407b0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8001720 tx=0x7fb9b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:37.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:37.776+0000 7fb9affff640 1 -- 172.21.15.146:0/4157313239 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9c00c1020 con 0x7fb9c80d0710 2024-09-17T03:33:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.018+0000 7fb9cdec5640 1 -- 172.21.15.146:0/4157313239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fb9c80d1170 con 0x7fb9c80d0710 2024-09-17T03:33:38.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.021+0000 7fb9affff640 1 -- 172.21.15.146:0/4157313239 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fb9c80cc560 con 0x7fb9c80d0710 2024-09-17T03:33:38.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 -- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9b4078bc0 msgr2=0x7fb9b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:38.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9b4078bc0 0x7fb9b407b0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8001720 tx=0x7fb9b8009040 comp rx=0 tx=0).stop 2024-09-17T03:33:38.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 -- 172.21.15.146:0/4157313239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80d0710 msgr2=0x7fb9c80ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:38.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80d0710 0x7fb9c80ca680 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0006010 tx=0x7fb9c0003f10 comp rx=0 tx=0).stop 2024-09-17T03:33:38.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 -- 172.21.15.146:0/4157313239 shutdown_connections 2024-09-17T03:33:38.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9b4078bc0 0x7fb9b407b0d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80d0710 0x7fb9c80ca680 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c80cd7a0 0x7fb9c80ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 --2- 172.21.15.146:0/4157313239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c80b47c0 0x7fb9c8154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 -- 172.21.15.146:0/4157313239 >> 172.21.15.146:0/4157313239 conn(0x7fb9c809ba20 msgr2=0x7fb9c80b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 -- 172.21.15.146:0/4157313239 shutdown_connections 2024-09-17T03:33:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.024+0000 7fb9cdec5640 1 -- 172.21.15.146:0/4157313239 wait complete. 2024-09-17T03:33:38.034 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:33:38.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.149+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/3048481348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa415f010 msgr2=0x7f5fa41515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:38.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.149+0000 7f5fa9fcc640 1 --2- 172.21.15.146:0/3048481348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa415f010 0x7f5fa41515a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40b3120 tx=0x7f5f9c02bbe0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.149+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/3048481348 shutdown_connections 2024-09-17T03:33:38.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.149+0000 7f5fa9fcc640 1 --2- 172.21.15.146:0/3048481348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa415f010 0x7f5fa41515a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.149+0000 7f5fa9fcc640 1 --2- 172.21.15.146:0/3048481348 >> v2:172.21.15.179:3300/0 conn(0x7f5fa4072df0 0x7f5fa415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.149+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/3048481348 >> 172.21.15.146:0/3048481348 conn(0x7f5fa40b2060 msgr2=0x7f5fa40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:38.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.149+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/3048481348 shutdown_connections 2024-09-17T03:33:38.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.149+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/3048481348 wait complete. 2024-09-17T03:33:38.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.151+0000 7f5fa9fcc640 1 Processor -- start 2024-09-17T03:33:38.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.151+0000 7f5fa9fcc640 1 -- start start 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.152+0000 7f5fa9fcc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fa4072df0 0x7f5fa4147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.152+0000 7f5fa9fcc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa40b3360 0x7f5fa40aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.152+0000 7f5fa9fcc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa415f010 0x7f5fa41e6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.152+0000 7f5fa9fcc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa406e9a0 con 0x7f5fa40b3360 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.152+0000 7f5fa9fcc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa406e820 con 0x7f5fa4072df0 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.152+0000 7f5fa9fcc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa406eb20 con 0x7f5fa415f010 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.152+0000 7f5f9bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa40b3360 0x7f5fa40aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.152+0000 7f5f9bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa40b3360 0x7f5fa40aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52236/0 (socket says 172.21.15.146:52236) 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.152+0000 7f5f9bfff640 1 -- 172.21.15.146:0/1920437184 learned_addr learned my addr 172.21.15.146:0/1920437184 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5fa3fff640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa415f010 0x7f5fa41e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5fa37fe640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fa4072df0 0x7f5fa4147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:38.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5f9bfff640 1 -- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa415f010 msgr2=0x7f5fa41e6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:38.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5f9bfff640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa415f010 0x7f5fa41e6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5f9bfff640 1 -- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fa4072df0 msgr2=0x7f5fa4147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:38.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5f9bfff640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fa4072df0 0x7f5fa4147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5f9bfff640 1 -- 172.21.15.146:0/1920437184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa414b160 con 0x7f5fa40b3360 2024-09-17T03:33:38.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5fa37fe640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fa4072df0 0x7f5fa4147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:38.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5f9bfff640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa40b3360 0x7f5fa40aeda0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00dfd0 tx=0x7f5f8c009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:38.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5fa0ff9640 1 -- 172.21.15.146:0/1920437184 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c01d070 con 0x7f5fa40b3360 2024-09-17T03:33:38.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5fa0ff9640 1 -- 172.21.15.146:0/1920437184 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f8c0077a0 con 0x7f5fa40b3360 2024-09-17T03:33:38.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/1920437184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa414b440 con 0x7f5fa40b3360 2024-09-17T03:33:38.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5fa0ff9640 1 -- 172.21.15.146:0/1920437184 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c007bd0 con 0x7f5fa40b3360 2024-09-17T03:33:38.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.153+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/1920437184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa414ba00 con 0x7f5fa40b3360 2024-09-17T03:33:38.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.154+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/1920437184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa415ead0 con 0x7f5fa40b3360 2024-09-17T03:33:38.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.155+0000 7f5fa0ff9640 1 -- 172.21.15.146:0/1920437184 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f8c020070 con 0x7f5fa40b3360 2024-09-17T03:33:38.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.155+0000 7f5fa0ff9640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f84078bc0 0x7f5f8407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:38.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.156+0000 7f5fa0ff9640 1 -- 172.21.15.146:0/1920437184 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f5f8c09c170 con 0x7f5fa40b3360 2024-09-17T03:33:38.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.156+0000 7f5fa37fe640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f84078bc0 0x7f5f8407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:38.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.157+0000 7f5fa37fe640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f84078bc0 0x7f5f8407b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f94000f60 tx=0x7f5f94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:38.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.160+0000 7f5fa0ff9640 1 -- 172.21.15.146:0/1920437184 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5f8c0643b0 con 0x7f5fa40b3360 2024-09-17T03:33:38.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.339+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/1920437184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5fa414ae80 con 0x7f5fa40b3360 2024-09-17T03:33:38.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.340+0000 7f5fa0ff9640 1 -- 172.21.15.146:0/1920437184 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7f5f8c068de0 con 0x7f5fa40b3360 2024-09-17T03:33:38.339 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:38.339 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:33:38.339 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:33:38.339 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:33:38.339 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:33:38.339 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:33:38.340 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:33:38.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f84078bc0 msgr2=0x7f5f8407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:38.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f84078bc0 0x7f5f8407b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f94000f60 tx=0x7f5f94009040 comp rx=0 tx=0).stop 2024-09-17T03:33:38.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/1920437184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa40b3360 msgr2=0x7f5fa40aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:38.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa40b3360 0x7f5fa40aeda0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00dfd0 tx=0x7f5f8c009cc0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/1920437184 shutdown_connections 2024-09-17T03:33:38.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f84078bc0 0x7f5f8407b0d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fa415f010 0x7f5fa41e6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fa40b3360 0x7f5fa40aeda0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 --2- 172.21.15.146:0/1920437184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fa4072df0 0x7f5fa4147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/1920437184 >> 172.21.15.146:0/1920437184 conn(0x7f5fa40b2060 msgr2=0x7f5fa415c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:38.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/1920437184 shutdown_connections 2024-09-17T03:33:38.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.342+0000 7f5fa9fcc640 1 -- 172.21.15.146:0/1920437184 wait complete. 2024-09-17T03:33:38.353 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:33:38.353 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:33:38.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.474+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1342665436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4581620f0 msgr2=0x7fd45806ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.474+0000 7fd45e2f9640 1 --2- 172.21.15.146:0/1342665436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4581620f0 0x7fd45806ed30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd4580b73c0 tx=0x7fd44002a560 comp rx=0 tx=0).stop 2024-09-17T03:33:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.474+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1342665436 shutdown_connections 2024-09-17T03:33:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.474+0000 7fd45e2f9640 1 --2- 172.21.15.146:0/1342665436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4581620f0 0x7fd45806ed30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.474+0000 7fd45e2f9640 1 --2- 172.21.15.146:0/1342665436 >> v2:172.21.15.179:3300/0 conn(0x7fd4580b3870 0x7fd4580cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.474+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1342665436 >> 172.21.15.146:0/1342665436 conn(0x7fd4580d4be0 msgr2=0x7fd4580d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.474+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1342665436 shutdown_connections 2024-09-17T03:33:38.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.474+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1342665436 wait complete. 2024-09-17T03:33:38.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.476+0000 7fd45e2f9640 1 Processor -- start 2024-09-17T03:33:38.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.476+0000 7fd45e2f9640 1 -- start start 2024-09-17T03:33:38.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.477+0000 7fd45e2f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd45806f270 0x7fd458151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:38.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.477+0000 7fd45e2f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4580b3870 0x7fd4580c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:38.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.477+0000 7fd45e2f9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4581620f0 0x7fd4580ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:38.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.477+0000 7fd45e2f9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd458162670 con 0x7fd4580b3870 2024-09-17T03:33:38.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.477+0000 7fd45e2f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd4580d43b0 con 0x7fd45806f270 2024-09-17T03:33:38.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.477+0000 7fd45e2f9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd458162fb0 con 0x7fd4581620f0 2024-09-17T03:33:38.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4580b3870 0x7fd4580c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:38.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd44ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4580b3870 0x7fd4580c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52252/0 (socket says 172.21.15.146:52252) 2024-09-17T03:33:38.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd44ffff640 1 -- 172.21.15.146:0/1697457526 learned_addr learned my addr 172.21.15.146:0/1697457526 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd457fff640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd45806f270 0x7fd458151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd45c896640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4581620f0 0x7fd4580ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd44ffff640 1 -- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4581620f0 msgr2=0x7fd4580ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd44ffff640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4581620f0 0x7fd4580ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd44ffff640 1 -- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd45806f270 msgr2=0x7fd458151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd44ffff640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd45806f270 0x7fd458151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd44ffff640 1 -- 172.21.15.146:0/1697457526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd458152180 con 0x7fd4580b3870 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd44ffff640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4580b3870 0x7fd4580c9f60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd440034040 tx=0x7fd440003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd4557fa640 1 -- 172.21.15.146:0/1697457526 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44003e030 con 0x7fd4580b3870 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd4557fa640 1 -- 172.21.15.146:0/1697457526 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd440003e00 con 0x7fd4580b3870 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1697457526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4580c7fd0 con 0x7fd4580b3870 2024-09-17T03:33:38.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd4557fa640 1 -- 172.21.15.146:0/1697457526 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440035040 con 0x7fd4580b3870 2024-09-17T03:33:38.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.478+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1697457526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4580c8590 con 0x7fd4580b3870 2024-09-17T03:33:38.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.479+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1697457526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4580cecd0 con 0x7fd4580b3870 2024-09-17T03:33:38.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.480+0000 7fd4557fa640 1 -- 172.21.15.146:0/1697457526 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd440041030 con 0x7fd4580b3870 2024-09-17T03:33:38.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.481+0000 7fd4557fa640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd438078b90 0x7fd43807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:38.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.481+0000 7fd4557fa640 1 -- 172.21.15.146:0/1697457526 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fd4400bb150 con 0x7fd4580b3870 2024-09-17T03:33:38.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.481+0000 7fd457fff640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd438078b90 0x7fd43807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:38.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.481+0000 7fd457fff640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd438078b90 0x7fd43807b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd44800bb50 tx=0x7fd44800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:38.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.485+0000 7fd4557fa640 1 -- 172.21.15.146:0/1697457526 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd4400832a0 con 0x7fd4580b3870 2024-09-17T03:33:38.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:38.667+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1697457526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd458163460 con 0x7fd4580b3870 2024-09-17T03:33:39.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.639+0000 7fd4557fa640 1 -- 172.21.15.146:0/1697457526 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7fd440087cd0 con 0x7fd4580b3870 2024-09-17T03:33:39.639 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:33:39.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd438078b90 msgr2=0x7fd43807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:39.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd438078b90 0x7fd43807b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd44800bb50 tx=0x7fd44800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:33:39.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1697457526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4580b3870 msgr2=0x7fd4580c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4580b3870 0x7fd4580c9f60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd440034040 tx=0x7fd440003910 comp rx=0 tx=0).stop 2024-09-17T03:33:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1697457526 shutdown_connections 2024-09-17T03:33:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd438078b90 0x7fd43807b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4581620f0 0x7fd4580ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4580b3870 0x7fd4580c9f60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 --2- 172.21.15.146:0/1697457526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd45806f270 0x7fd458151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1697457526 >> 172.21.15.146:0/1697457526 conn(0x7fd4580d4be0 msgr2=0x7fd458160b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1697457526 shutdown_connections 2024-09-17T03:33:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.642+0000 7fd45e2f9640 1 -- 172.21.15.146:0/1697457526 wait complete. 2024-09-17T03:33:39.656 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:33:39.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.780+0000 7ff40e969640 1 -- 172.21.15.146:0/1597078354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40815eda0 msgr2=0x7ff408069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:39.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.780+0000 7ff40e969640 1 --2- 172.21.15.146:0/1597078354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40815eda0 0x7ff408069240 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc005fd0 tx=0x7ff3fc02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:33:39.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.780+0000 7ff40e969640 1 -- 172.21.15.146:0/1597078354 shutdown_connections 2024-09-17T03:33:39.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.780+0000 7ff40e969640 1 --2- 172.21.15.146:0/1597078354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40815eda0 0x7ff408069240 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:39.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.780+0000 7ff40e969640 1 --2- 172.21.15.146:0/1597078354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4080d2330 0x7ff408068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:39.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.780+0000 7ff40e969640 1 -- 172.21.15.146:0/1597078354 >> 172.21.15.146:0/1597078354 conn(0x7ff40806d070 msgr2=0x7ff40806d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:39.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.780+0000 7ff40e969640 1 -- 172.21.15.146:0/1597078354 shutdown_connections 2024-09-17T03:33:39.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.780+0000 7ff40e969640 1 -- 172.21.15.146:0/1597078354 wait complete. 2024-09-17T03:33:39.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.781+0000 7ff40e969640 1 Processor -- start 2024-09-17T03:33:39.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.782+0000 7ff40e969640 1 -- start start 2024-09-17T03:33:39.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40e969640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4080cefc0 0x7ff40815e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:39.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40e969640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4080d2330 0x7ff408151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:39.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40e969640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40815eda0 0x7ff4081e95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:39.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40e969640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff4080b9020 con 0x7ff40815eda0 2024-09-17T03:33:39.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40e969640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff4080b8ea0 con 0x7ff4080d2330 2024-09-17T03:33:39.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40e969640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff4080b91a0 con 0x7ff4080cefc0 2024-09-17T03:33:39.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40cf06640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40815eda0 0x7ff4081e95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:39.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40cf06640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40815eda0 0x7ff4081e95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52268/0 (socket says 172.21.15.146:52268) 2024-09-17T03:33:39.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40cf06640 1 -- 172.21.15.146:0/4179272735 learned_addr learned my addr 172.21.15.146:0/4179272735 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:39.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff407fff640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4080cefc0 0x7ff40815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:39.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff4077fe640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4080d2330 0x7ff408151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:39.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40cf06640 1 -- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4080cefc0 msgr2=0x7ff40815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40cf06640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4080cefc0 0x7ff40815e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40cf06640 1 -- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4080d2330 msgr2=0x7ff408151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40cf06640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4080d2330 0x7ff408151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.783+0000 7ff40cf06640 1 -- 172.21.15.146:0/4179272735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff408152080 con 0x7ff40815eda0 2024-09-17T03:33:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.784+0000 7ff40cf06640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40815eda0 0x7ff4081e95f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff400002230 tx=0x7ff40000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.784+0000 7ff404ff9640 1 -- 172.21.15.146:0/4179272735 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400003b70 con 0x7ff40815eda0 2024-09-17T03:33:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.784+0000 7ff404ff9640 1 -- 172.21.15.146:0/4179272735 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff400003d10 con 0x7ff40815eda0 2024-09-17T03:33:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.784+0000 7ff404ff9640 1 -- 172.21.15.146:0/4179272735 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400005330 con 0x7ff40815eda0 2024-09-17T03:33:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.784+0000 7ff40e969640 1 -- 172.21.15.146:0/4179272735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4080c9130 con 0x7ff40815eda0 2024-09-17T03:33:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.784+0000 7ff40e969640 1 -- 172.21.15.146:0/4179272735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4080c96f0 con 0x7ff40815eda0 2024-09-17T03:33:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.785+0000 7ff40e969640 1 -- 172.21.15.146:0/4179272735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40806a010 con 0x7ff40815eda0 2024-09-17T03:33:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.786+0000 7ff404ff9640 1 -- 172.21.15.146:0/4179272735 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4000056e0 con 0x7ff40815eda0 2024-09-17T03:33:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.786+0000 7ff404ff9640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3f4078bc0 0x7ff3f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.786+0000 7ff404ff9640 1 -- 172.21.15.146:0/4179272735 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7ff40009a9d0 con 0x7ff40815eda0 2024-09-17T03:33:39.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.787+0000 7ff407fff640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3f4078bc0 0x7ff3f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:39.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.787+0000 7ff407fff640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3f4078bc0 0x7ff3f407b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8004630 tx=0x7ff3f800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:39.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.791+0000 7ff404ff9640 1 -- 172.21.15.146:0/4179272735 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff4000629a0 con 0x7ff40815eda0 2024-09-17T03:33:39.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:39.967+0000 7ff40e969640 1 -- 172.21.15.146:0/4179272735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff4080cfcf0 con 0x7ff40815eda0 2024-09-17T03:33:40.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.646+0000 7ff404ff9640 1 -- 172.21.15.146:0/4179272735 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7ff4000673d0 con 0x7ff40815eda0 2024-09-17T03:33:40.645 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:33:40.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.649+0000 7ff40e969640 1 -- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3f4078bc0 msgr2=0x7ff3f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:40.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.649+0000 7ff40e969640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3f4078bc0 0x7ff3f407b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8004630 tx=0x7ff3f800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:33:40.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.649+0000 7ff40e969640 1 -- 172.21.15.146:0/4179272735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40815eda0 msgr2=0x7ff4081e95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:40.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.649+0000 7ff40e969640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40815eda0 0x7ff4081e95f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff400002230 tx=0x7ff40000cb90 comp rx=0 tx=0).stop 2024-09-17T03:33:40.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.649+0000 7ff40e969640 1 -- 172.21.15.146:0/4179272735 shutdown_connections 2024-09-17T03:33:40.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.649+0000 7ff40e969640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3f4078bc0 0x7ff3f407b0d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:40.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.649+0000 7ff40e969640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff40815eda0 0x7ff4081e95f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:40.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.649+0000 7ff40e969640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4080d2330 0x7ff408151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:40.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.649+0000 7ff40e969640 1 --2- 172.21.15.146:0/4179272735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4080cefc0 0x7ff40815e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:40.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.650+0000 7ff40e969640 1 -- 172.21.15.146:0/4179272735 >> 172.21.15.146:0/4179272735 conn(0x7ff40806d070 msgr2=0x7ff408161cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:40.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.650+0000 7ff40e969640 1 -- 172.21.15.146:0/4179272735 shutdown_connections 2024-09-17T03:33:40.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.650+0000 7ff40e969640 1 -- 172.21.15.146:0/4179272735 wait complete. 2024-09-17T03:33:40.671 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:33:40.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.791+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/2962335867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b30003a00 msgr2=0x7f1b30003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:40.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.791+0000 7f1b4ff2b640 1 --2- 172.21.15.146:0/2962335867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b30003a00 0x7f1b30003e50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1b38005fd0 tx=0x7f1b30005830 comp rx=0 tx=0).stop 2024-09-17T03:33:40.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.791+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/2962335867 shutdown_connections 2024-09-17T03:33:40.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.791+0000 7f1b4ff2b640 1 --2- 172.21.15.146:0/2962335867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b30003a00 0x7f1b30003e50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:40.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.791+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/2962335867 >> 172.21.15.146:0/2962335867 conn(0x7f1b480b3410 msgr2=0x7f1b480b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:40.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.791+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/2962335867 shutdown_connections 2024-09-17T03:33:40.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.791+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/2962335867 wait complete. 2024-09-17T03:33:40.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.793+0000 7f1b4ff2b640 1 Processor -- start 2024-09-17T03:33:40.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.793+0000 7f1b4ff2b640 1 -- start start 2024-09-17T03:33:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.794+0000 7f1b4ff2b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30003a00 0x7f1b481f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.794+0000 7f1b4ff2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b481e5560 0x7f1b48151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.794+0000 7f1b4ff2b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b48155ca0 0x7f1b4815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.794+0000 7f1b4ff2b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4806e2f0 con 0x7f1b481e5560 2024-09-17T03:33:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.794+0000 7f1b4ff2b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4806e170 con 0x7f1b30003a00 2024-09-17T03:33:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.794+0000 7f1b4ff2b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4806e470 con 0x7f1b48155ca0 2024-09-17T03:33:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.794+0000 7f1b4d4c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b481e5560 0x7f1b48151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4d4c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b481e5560 0x7f1b48151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52298/0 (socket says 172.21.15.146:52298) 2024-09-17T03:33:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4d4c6640 1 -- 172.21.15.146:0/3604304091 learned_addr learned my addr 172.21.15.146:0/3604304091 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4dcc7640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30003a00 0x7f1b481f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:40.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4e4c8640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b48155ca0 0x7f1b4815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4d4c6640 1 -- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b48155ca0 msgr2=0x7f1b4815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4d4c6640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b48155ca0 0x7f1b4815ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4d4c6640 1 -- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30003a00 msgr2=0x7f1b481f7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4d4c6640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30003a00 0x7f1b481f7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4d4c6640 1 -- 172.21.15.146:0/3604304091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b48151550 con 0x7f1b481e5560 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4e4c8640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b48155ca0 0x7f1b4815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4d4c6640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b481e5560 0x7f1b48151010 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00f6f0 tx=0x7f1b3c00fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b467fc640 1 -- 172.21.15.146:0/3604304091 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c015070 con 0x7f1b481e5560 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b467fc640 1 -- 172.21.15.146:0/3604304091 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b3c006170 con 0x7f1b481e5560 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/3604304091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4806cda0 con 0x7f1b481e5560 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b467fc640 1 -- 172.21.15.146:0/3604304091 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c003830 con 0x7f1b481e5560 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.795+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/3604304091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b48154660 con 0x7f1b481e5560 2024-09-17T03:33:40.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.796+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/3604304091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b480b4530 con 0x7f1b481e5560 2024-09-17T03:33:40.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.797+0000 7f1b467fc640 1 -- 172.21.15.146:0/3604304091 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b3c018070 con 0x7f1b481e5560 2024-09-17T03:33:40.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.798+0000 7f1b467fc640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b34078b90 0x7f1b3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:40.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.798+0000 7f1b4dcc7640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b34078b90 0x7f1b3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:40.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.798+0000 7f1b467fc640 1 -- 172.21.15.146:0/3604304091 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f1b3c09adf0 con 0x7f1b481e5560 2024-09-17T03:33:40.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.798+0000 7f1b4dcc7640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b34078b90 0x7f1b3407b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1b38035000 tx=0x7f1b38004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:40.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:40.803+0000 7f1b467fc640 1 -- 172.21.15.146:0/3604304091 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b48151550 con 0x7f1b481e5560 2024-09-17T03:33:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.014+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/3604304091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1b481f79c0 con 0x7f1b481e5560 2024-09-17T03:33:41.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.648+0000 7f1b467fc640 1 -- 172.21.15.146:0/3604304091 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f1b3c062cd0 con 0x7f1b481e5560 2024-09-17T03:33:41.647 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 4 and data pool 5 2024-09-17T03:33:41.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b34078b90 msgr2=0x7f1b3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:41.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b34078b90 0x7f1b3407b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1b38035000 tx=0x7f1b38004a40 comp rx=0 tx=0).stop 2024-09-17T03:33:41.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/3604304091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b481e5560 msgr2=0x7f1b48151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:41.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b481e5560 0x7f1b48151010 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00f6f0 tx=0x7f1b3c00fbb0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/3604304091 shutdown_connections 2024-09-17T03:33:41.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b34078b90 0x7f1b3407b0a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b48155ca0 0x7f1b4815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b481e5560 0x7f1b48151010 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 --2- 172.21.15.146:0/3604304091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b30003a00 0x7f1b481f7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/3604304091 >> 172.21.15.146:0/3604304091 conn(0x7f1b480b3410 msgr2=0x7f1b48151ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:41.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/3604304091 shutdown_connections 2024-09-17T03:33:41.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.651+0000 7f1b4ff2b640 1 -- 172.21.15.146:0/3604304091 wait complete. 2024-09-17T03:33:41.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:41.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.798+0000 7fcead0bd640 1 -- 172.21.15.146:0/4021114685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcea80b55f0 msgr2=0x7fcea8070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:41.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.798+0000 7fcead0bd640 1 --2- 172.21.15.146:0/4021114685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcea80b55f0 0x7fcea8070be0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fce98005fd0 tx=0x7fce9802a520 comp rx=0 tx=0).stop 2024-09-17T03:33:41.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.798+0000 7fcead0bd640 1 -- 172.21.15.146:0/4021114685 shutdown_connections 2024-09-17T03:33:41.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.798+0000 7fcead0bd640 1 --2- 172.21.15.146:0/4021114685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcea806dd60 0x7fcea806e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.798+0000 7fcead0bd640 1 --2- 172.21.15.146:0/4021114685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcea80b55f0 0x7fcea8070be0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.798+0000 7fcead0bd640 1 -- 172.21.15.146:0/4021114685 >> 172.21.15.146:0/4021114685 conn(0x7fcea80b3410 msgr2=0x7fcea80b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:41.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.798+0000 7fcead0bd640 1 -- 172.21.15.146:0/4021114685 shutdown_connections 2024-09-17T03:33:41.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.798+0000 7fcead0bd640 1 -- 172.21.15.146:0/4021114685 wait complete. 2024-09-17T03:33:41.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.800+0000 7fcead0bd640 1 Processor -- start 2024-09-17T03:33:41.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.800+0000 7fcead0bd640 1 -- start start 2024-09-17T03:33:41.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.801+0000 7fcead0bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcea806dd60 0x7fcea81f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:41.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.801+0000 7fcead0bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcea8071120 0x7fcea8141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:41.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.801+0000 7fcead0bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcea80b55f0 0x7fcea81f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:41.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.801+0000 7fcead0bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcea815be90 con 0x7fcea8071120 2024-09-17T03:33:41.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.801+0000 7fcead0bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcea815bd10 con 0x7fcea806dd60 2024-09-17T03:33:41.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.801+0000 7fcead0bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcea815c010 con 0x7fcea80b55f0 2024-09-17T03:33:41.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.801+0000 7fcea659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcea8071120 0x7fcea8141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:41.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcea6d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcea806dd60 0x7fcea81f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcea659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcea8071120 0x7fcea8141d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52324/0 (socket says 172.21.15.146:52324) 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcea659c640 1 -- 172.21.15.146:0/3455242382 learned_addr learned my addr 172.21.15.146:0/3455242382 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcea759e640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcea80b55f0 0x7fcea81f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcea659c640 1 -- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcea80b55f0 msgr2=0x7fcea81f7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcea659c640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcea80b55f0 0x7fcea81f7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcea659c640 1 -- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcea806dd60 msgr2=0x7fcea81f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcea659c640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcea806dd60 0x7fcea81f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcea659c640 1 -- 172.21.15.146:0/3455242382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea815ac30 con 0x7fcea8071120 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcea659c640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcea8071120 0x7fcea8141d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00b3f0 tx=0x7fce9c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fce8f7fe640 1 -- 172.21.15.146:0/3455242382 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c015020 con 0x7fcea8071120 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fce8f7fe640 1 -- 172.21.15.146:0/3455242382 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce9c011920 con 0x7fcea8071120 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcead0bd640 1 -- 172.21.15.146:0/3455242382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea81f7cd0 con 0x7fcea8071120 2024-09-17T03:33:41.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fce8f7fe640 1 -- 172.21.15.146:0/3455242382 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c011d70 con 0x7fcea8071120 2024-09-17T03:33:41.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.802+0000 7fcead0bd640 1 -- 172.21.15.146:0/3455242382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea81f3ec0 con 0x7fcea8071120 2024-09-17T03:33:41.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.803+0000 7fcead0bd640 1 -- 172.21.15.146:0/3455242382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea81f7a40 con 0x7fcea8071120 2024-09-17T03:33:41.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.804+0000 7fce8f7fe640 1 -- 172.21.15.146:0/3455242382 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce9c018020 con 0x7fcea8071120 2024-09-17T03:33:41.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.805+0000 7fce8f7fe640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce94078b90 0x7fce9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:41.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.805+0000 7fce8f7fe640 1 -- 172.21.15.146:0/3455242382 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fce9c09a870 con 0x7fcea8071120 2024-09-17T03:33:41.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.805+0000 7fcea6d9d640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce94078b90 0x7fce9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:41.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.805+0000 7fcea6d9d640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce94078b90 0x7fce9407b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce98033000 tx=0x7fce98004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:41.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.809+0000 7fce8f7fe640 1 -- 172.21.15.146:0/3455242382 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce9c01f030 con 0x7fcea8071120 2024-09-17T03:33:41.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.985+0000 7fcead0bd640 1 -- 172.21.15.146:0/3455242382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcea815c530 con 0x7fcea8071120 2024-09-17T03:33:41.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.986+0000 7fce8f7fe640 1 -- 172.21.15.146:0/3455242382 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16790 (secure 0 0 0) 0x7fce9c062660 con 0x7fcea8071120 2024-09-17T03:33:41.985 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:41.985 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":31,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:41.014872+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:33:38.670836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T03:33:39.971433+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:41.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 -- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce94078b90 msgr2=0x7fce9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:41.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce94078b90 0x7fce9407b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce98033000 tx=0x7fce98004730 comp rx=0 tx=0).stop 2024-09-17T03:33:41.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 -- 172.21.15.146:0/3455242382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcea8071120 msgr2=0x7fcea8141d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:41.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcea8071120 0x7fcea8141d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00b3f0 tx=0x7fce9c00b8b0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 -- 172.21.15.146:0/3455242382 shutdown_connections 2024-09-17T03:33:41.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce94078b90 0x7fce9407b0a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcea80b55f0 0x7fcea81f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcea8071120 0x7fcea8141d90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 --2- 172.21.15.146:0/3455242382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcea806dd60 0x7fcea81f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 -- 172.21.15.146:0/3455242382 >> 172.21.15.146:0/3455242382 conn(0x7fcea80b3410 msgr2=0x7fcea80b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 -- 172.21.15.146:0/3455242382 shutdown_connections 2024-09-17T03:33:41.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:41.988+0000 7fcead0bd640 1 -- 172.21.15.146:0/3455242382 wait complete. 2024-09-17T03:33:41.999 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:42.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.112+0000 7fa02289d640 1 -- 172.21.15.146:0/4267058614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01c06f440 msgr2=0x7fa01c169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.112+0000 7fa02289d640 1 --2- 172.21.15.146:0/4267058614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01c06f440 0x7fa01c169c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa014005fd0 tx=0x7fa01402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.112+0000 7fa02289d640 1 -- 172.21.15.146:0/4267058614 shutdown_connections 2024-09-17T03:33:42.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.112+0000 7fa02289d640 1 --2- 172.21.15.146:0/4267058614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01c06f440 0x7fa01c169c10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.112+0000 7fa02289d640 1 -- 172.21.15.146:0/4267058614 >> 172.21.15.146:0/4267058614 conn(0x7fa01c0d4be0 msgr2=0x7fa01c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:42.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.112+0000 7fa02289d640 1 -- 172.21.15.146:0/4267058614 shutdown_connections 2024-09-17T03:33:42.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.112+0000 7fa02289d640 1 -- 172.21.15.146:0/4267058614 wait complete. 2024-09-17T03:33:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.114+0000 7fa02289d640 1 Processor -- start 2024-09-17T03:33:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.114+0000 7fa02289d640 1 -- start start 2024-09-17T03:33:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa02289d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa01c0b3870 0x7fa01c156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa02289d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa01c0cf370 0x7fa01c0ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa02289d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01c156c10 0x7fa01c0cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa02289d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa01c16a2d0 con 0x7fa01c156c10 2024-09-17T03:33:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa02289d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa01c16a150 con 0x7fa01c0cf370 2024-09-17T03:33:42.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa02289d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa01c16a450 con 0x7fa01c0b3870 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa020e3a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01c156c10 0x7fa01c0cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa020e3a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01c156c10 0x7fa01c0cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52352/0 (socket says 172.21.15.146:52352) 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa020e3a640 1 -- 172.21.15.146:0/1991166342 learned_addr learned my addr 172.21.15.146:0/1991166342 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa01bfff640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa01c0b3870 0x7fa01c156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa01b7fe640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa01c0cf370 0x7fa01c0ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa020e3a640 1 -- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa01c0b3870 msgr2=0x7fa01c156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa020e3a640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa01c0b3870 0x7fa01c156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa020e3a640 1 -- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa01c0cf370 msgr2=0x7fa01c0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa020e3a640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa01c0cf370 0x7fa01c0ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa020e3a640 1 -- 172.21.15.146:0/1991166342 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01c0b6b00 con 0x7fa01c156c10 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa01bfff640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa01c0b3870 0x7fa01c156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa020e3a640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01c156c10 0x7fa01c0cd290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa014009cd0 tx=0x7fa014003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.116+0000 7fa018ff9640 1 -- 172.21.15.146:0/1991166342 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa014031b90 con 0x7fa01c156c10 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.117+0000 7fa018ff9640 1 -- 172.21.15.146:0/1991166342 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa014031e20 con 0x7fa01c156c10 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.117+0000 7fa02289d640 1 -- 172.21.15.146:0/1991166342 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01c0cdb60 con 0x7fa01c156c10 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.117+0000 7fa018ff9640 1 -- 172.21.15.146:0/1991166342 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0140332f0 con 0x7fa01c156c10 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.117+0000 7fa02289d640 1 -- 172.21.15.146:0/1991166342 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa01c155960 con 0x7fa01c156c10 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.117+0000 7fa02289d640 1 -- 172.21.15.146:0/1991166342 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa01c0ce220 con 0x7fa01c156c10 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.118+0000 7fa018ff9640 1 -- 172.21.15.146:0/1991166342 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa014031660 con 0x7fa01c156c10 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.119+0000 7fa018ff9640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa008078b90 0x7fa00807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.119+0000 7fa018ff9640 1 -- 172.21.15.146:0/1991166342 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa0140bc240 con 0x7fa01c156c10 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.119+0000 7fa01bfff640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa008078b90 0x7fa00807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.119+0000 7fa01bfff640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa008078b90 0x7fa00807b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0046b0 tx=0x7fa00c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.123+0000 7fa018ff9640 1 -- 172.21.15.146:0/1991166342 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa01c0ce220 con 0x7fa01c156c10 2024-09-17T03:33:42.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.299+0000 7fa02289d640 1 -- 172.21.15.146:0/1991166342 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa01c155bc0 con 0x7fa01c156c10 2024-09-17T03:33:42.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.301+0000 7fa018ff9640 1 -- 172.21.15.146:0/1991166342 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16790 (secure 0 0 0) 0x7fa01403f030 con 0x7fa01c156c10 2024-09-17T03:33:42.300 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:42.300 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":31,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:41.014872+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:33:38.670836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T03:33:39.971433+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:42.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 -- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa008078b90 msgr2=0x7fa00807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa008078b90 0x7fa00807b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0046b0 tx=0x7fa00c009040 comp rx=0 tx=0).stop 2024-09-17T03:33:42.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 -- 172.21.15.146:0/1991166342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01c156c10 msgr2=0x7fa01c0cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01c156c10 0x7fa01c0cd290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa014009cd0 tx=0x7fa014003ba0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 -- 172.21.15.146:0/1991166342 shutdown_connections 2024-09-17T03:33:42.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa008078b90 0x7fa00807b0a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa01c156c10 0x7fa01c0cd290 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa01c0cf370 0x7fa01c0ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 --2- 172.21.15.146:0/1991166342 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa01c0b3870 0x7fa01c156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 -- 172.21.15.146:0/1991166342 >> 172.21.15.146:0/1991166342 conn(0x7fa01c0d4be0 msgr2=0x7fa01c0b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:42.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 -- 172.21.15.146:0/1991166342 shutdown_connections 2024-09-17T03:33:42.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.303+0000 7fa02289d640 1 -- 172.21.15.146:0/1991166342 wait complete. 2024-09-17T03:33:42.313 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:33:42.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.431+0000 7f202843f640 1 -- 172.21.15.146:0/10625591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020070020 msgr2=0x7f20200b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.431+0000 7f202843f640 1 --2- 172.21.15.146:0/10625591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020070020 0x7f20200b4cc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2018009830 tx=0x7f201802a510 comp rx=0 tx=0).stop 2024-09-17T03:33:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.431+0000 7f202843f640 1 -- 172.21.15.146:0/10625591 shutdown_connections 2024-09-17T03:33:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.431+0000 7f202843f640 1 --2- 172.21.15.146:0/10625591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020070020 0x7f20200b4cc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.431+0000 7f202843f640 1 --2- 172.21.15.146:0/10625591 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2020073c90 0x7f202006fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.431+0000 7f202843f640 1 -- 172.21.15.146:0/10625591 >> 172.21.15.146:0/10625591 conn(0x7f202006dd60 msgr2=0x7f202006e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.431+0000 7f202843f640 1 -- 172.21.15.146:0/10625591 shutdown_connections 2024-09-17T03:33:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.431+0000 7f202843f640 1 -- 172.21.15.146:0/10625591 wait complete. 2024-09-17T03:33:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.433+0000 7f202843f640 1 Processor -- start 2024-09-17T03:33:42.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.433+0000 7f202843f640 1 -- start start 2024-09-17T03:33:42.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.434+0000 7f202843f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020070020 0x7f20201543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.434+0000 7f202843f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2020152920 0x7f2020157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.434+0000 7f202843f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20201f21f0 0x7f2020153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.434+0000 7f202843f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f20200b5590 con 0x7f2020070020 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.434+0000 7f202843f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f20200b5410 con 0x7f20201f21f0 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.434+0000 7f202843f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f20200b5710 con 0x7f2020152920 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.434+0000 7f20261db640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020070020 0x7f20201543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f20261db640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020070020 0x7f20201543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52374/0 (socket says 172.21.15.146:52374) 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f20261db640 1 -- 172.21.15.146:0/1240033763 learned_addr learned my addr 172.21.15.146:0/1240033763 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f20259da640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2020152920 0x7f2020157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f20269dc640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20201f21f0 0x7f2020153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f20261db640 1 -- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2020152920 msgr2=0x7f2020157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f20261db640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2020152920 0x7f2020157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f20261db640 1 -- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20201f21f0 msgr2=0x7f2020153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f20261db640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20201f21f0 0x7f2020153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f20261db640 1 -- 172.21.15.146:0/1240033763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20201566b0 con 0x7f2020070020 2024-09-17T03:33:42.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f20261db640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020070020 0x7f20201543e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f201c00cbc0 tx=0x7f201c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:42.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f2016ffd640 1 -- 172.21.15.146:0/1240033763 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c016020 con 0x7f2020070020 2024-09-17T03:33:42.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f2016ffd640 1 -- 172.21.15.146:0/1240033763 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f201c00ad90 con 0x7f2020070020 2024-09-17T03:33:42.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f202843f640 1 -- 172.21.15.146:0/1240033763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20201f2dd0 con 0x7f2020070020 2024-09-17T03:33:42.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f2016ffd640 1 -- 172.21.15.146:0/1240033763 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c012680 con 0x7f2020070020 2024-09-17T03:33:42.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.435+0000 7f202843f640 1 -- 172.21.15.146:0/1240033763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2020152e20 con 0x7f2020070020 2024-09-17T03:33:42.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.436+0000 7f202843f640 1 -- 172.21.15.146:0/1240033763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20200b5c30 con 0x7f2020070020 2024-09-17T03:33:42.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.437+0000 7f2016ffd640 1 -- 172.21.15.146:0/1240033763 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f201c019020 con 0x7f2020070020 2024-09-17T03:33:42.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.437+0000 7f2016ffd640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2004078b90 0x7f200407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.438+0000 7f2016ffd640 1 -- 172.21.15.146:0/1240033763 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f201c09b250 con 0x7f2020070020 2024-09-17T03:33:42.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.438+0000 7f20259da640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2004078b90 0x7f200407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.438+0000 7f20259da640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2004078b90 0x7f200407b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f20200d18f0 tx=0x7f201000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:42.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.442+0000 7f2016ffd640 1 -- 172.21.15.146:0/1240033763 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f201c020020 con 0x7f2020070020 2024-09-17T03:33:42.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.655+0000 7f202843f640 1 -- 172.21.15.146:0/1240033763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f202006e4f0 con 0x7f2020070020 2024-09-17T03:33:42.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.665+0000 7f2016ffd640 1 -- 172.21.15.146:0/1240033763 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7f201c063040 con 0x7f2020070020 2024-09-17T03:33:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 -- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2004078b90 msgr2=0x7f200407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2004078b90 0x7f200407b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f20200d18f0 tx=0x7f201000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 -- 172.21.15.146:0/1240033763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020070020 msgr2=0x7f20201543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020070020 0x7f20201543e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f201c00cbc0 tx=0x7f201c00a060 comp rx=0 tx=0).stop 2024-09-17T03:33:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 -- 172.21.15.146:0/1240033763 shutdown_connections 2024-09-17T03:33:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2004078b90 0x7f200407b0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20201f21f0 0x7f2020153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2020152920 0x7f2020157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 --2- 172.21.15.146:0/1240033763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2020070020 0x7f20201543e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 -- 172.21.15.146:0/1240033763 >> 172.21.15.146:0/1240033763 conn(0x7f202006dd60 msgr2=0x7f20200ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:42.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 -- 172.21.15.146:0/1240033763 shutdown_connections 2024-09-17T03:33:42.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.667+0000 7f202843f640 1 -- 172.21.15.146:0/1240033763 wait complete. 2024-09-17T03:33:42.677 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:33:42.678 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:33:42.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.796+0000 7f3c77912640 1 -- 172.21.15.146:0/2216497469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c5c004800 msgr2=0x7f3c5c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.796+0000 7f3c77912640 1 --2- 172.21.15.146:0/2216497469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c5c004800 0x7f3c5c004c10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3c60001690 tx=0x7f3c5c005830 comp rx=0 tx=0).stop 2024-09-17T03:33:42.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.796+0000 7f3c75eaf640 1 -- 172.21.15.146:0/2216497469 reap_dead start 2024-09-17T03:33:42.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.796+0000 7f3c77912640 1 -- 172.21.15.146:0/2216497469 shutdown_connections 2024-09-17T03:33:42.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.796+0000 7f3c77912640 1 -- 172.21.15.146:0/2216497469 >> 172.21.15.146:0/2216497469 conn(0x7f3c700d4be0 msgr2=0x7f3c700d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:42.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.796+0000 7f3c77912640 1 -- 172.21.15.146:0/2216497469 shutdown_connections 2024-09-17T03:33:42.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.796+0000 7f3c77912640 1 -- 172.21.15.146:0/2216497469 wait complete. 2024-09-17T03:33:42.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.798+0000 7f3c77912640 1 Processor -- start 2024-09-17T03:33:42.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.798+0000 7f3c77912640 1 -- start start 2024-09-17T03:33:42.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c77912640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c5c004800 0x7f3c700c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c77912640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c700c9da0 0x7f3c7015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c77912640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c7015f190 0x7f3c701f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c77912640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3c700d38a0 con 0x7f3c5c004800 2024-09-17T03:33:42.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c77912640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3c700cf7c0 con 0x7f3c7015f190 2024-09-17T03:33:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c77912640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3c700d3a20 con 0x7f3c700c9da0 2024-09-17T03:33:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c756ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c5c004800 0x7f3c700c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c756ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c5c004800 0x7f3c700c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52382/0 (socket says 172.21.15.146:52382) 2024-09-17T03:33:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c756ae640 1 -- 172.21.15.146:0/2348470430 learned_addr learned my addr 172.21.15.146:0/2348470430 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c74ead640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c700c9da0 0x7f3c7015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c75eaf640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c7015f190 0x7f3c701f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c756ae640 1 -- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c700c9da0 msgr2=0x7f3c7015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c756ae640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c700c9da0 0x7f3c7015ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c756ae640 1 -- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c7015f190 msgr2=0x7f3c701f4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c756ae640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c7015f190 0x7f3c701f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.799+0000 7f3c756ae640 1 -- 172.21.15.146:0/2348470430 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c701f5b60 con 0x7f3c5c004800 2024-09-17T03:33:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.800+0000 7f3c756ae640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c5c004800 0x7f3c700c9860 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c011ae0 tx=0x7f3c6c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.800+0000 7f3c65ffb640 1 -- 172.21.15.146:0/2348470430 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c01e070 con 0x7f3c5c004800 2024-09-17T03:33:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.800+0000 7f3c65ffb640 1 -- 172.21.15.146:0/2348470430 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c6c00fe70 con 0x7f3c5c004800 2024-09-17T03:33:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.800+0000 7f3c65ffb640 1 -- 172.21.15.146:0/2348470430 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c004290 con 0x7f3c5c004800 2024-09-17T03:33:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.800+0000 7f3c77912640 1 -- 172.21.15.146:0/2348470430 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c701f5e40 con 0x7f3c5c004800 2024-09-17T03:33:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.800+0000 7f3c77912640 1 -- 172.21.15.146:0/2348470430 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c701f6400 con 0x7f3c5c004800 2024-09-17T03:33:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.801+0000 7f3c77912640 1 -- 172.21.15.146:0/2348470430 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c700d3fb0 con 0x7f3c5c004800 2024-09-17T03:33:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.802+0000 7f3c65ffb640 1 -- 172.21.15.146:0/2348470430 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3c6c021070 con 0x7f3c5c004800 2024-09-17T03:33:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.802+0000 7f3c65ffb640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3c54078b90 0x7f3c5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.802+0000 7f3c65ffb640 1 -- 172.21.15.146:0/2348470430 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f3c6c09b760 con 0x7f3c5c004800 2024-09-17T03:33:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.802+0000 7f3c74ead640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3c54078b90 0x7f3c5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.803+0000 7f3c74ead640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3c54078b90 0x7f3c5407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3c60032000 tx=0x7f3c60001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:42.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:42.807+0000 7f3c65ffb640 1 -- 172.21.15.146:0/2348470430 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3c6c0636a0 con 0x7f3c5c004800 2024-09-17T03:33:43.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.019+0000 7f3c77912640 1 -- 172.21.15.146:0/2348470430 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3c700d2bd0 con 0x7f3c5c004800 2024-09-17T03:33:43.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.667+0000 7f3c65ffb640 1 -- 172.21.15.146:0/2348470430 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7f3c6c0680d0 con 0x7f3c5c004800 2024-09-17T03:33:43.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.669+0000 7f3c77912640 1 -- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3c54078b90 msgr2=0x7f3c5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:43.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.669+0000 7f3c77912640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3c54078b90 0x7f3c5407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3c60032000 tx=0x7f3c60001190 comp rx=0 tx=0).stop 2024-09-17T03:33:43.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.669+0000 7f3c77912640 1 -- 172.21.15.146:0/2348470430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c5c004800 msgr2=0x7f3c700c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:43.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.669+0000 7f3c77912640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c5c004800 0x7f3c700c9860 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c011ae0 tx=0x7f3c6c009e90 comp rx=0 tx=0).stop 2024-09-17T03:33:43.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.669+0000 7f3c77912640 1 -- 172.21.15.146:0/2348470430 shutdown_connections 2024-09-17T03:33:43.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.669+0000 7f3c77912640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3c54078b90 0x7f3c5407b0a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:43.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.669+0000 7f3c77912640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c7015f190 0x7f3c701f4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:43.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.669+0000 7f3c77912640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c700c9da0 0x7f3c7015ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:43.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.669+0000 7f3c77912640 1 --2- 172.21.15.146:0/2348470430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c5c004800 0x7f3c700c9860 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:43.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.669+0000 7f3c77912640 1 -- 172.21.15.146:0/2348470430 >> 172.21.15.146:0/2348470430 conn(0x7f3c700d4be0 msgr2=0x7f3c7006eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:43.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.669+0000 7f3c77912640 1 -- 172.21.15.146:0/2348470430 shutdown_connections 2024-09-17T03:33:43.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.670+0000 7f3c77912640 1 -- 172.21.15.146:0/2348470430 wait complete. 2024-09-17T03:33:43.684 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:33:43.684 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:33:43.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.801+0000 7fdf6e939640 1 -- 172.21.15.146:0/1158084795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf680cdf10 msgr2=0x7fdf680734f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:43.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.801+0000 7fdf6e939640 1 --2- 172.21.15.146:0/1158084795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf680cdf10 0x7fdf680734f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdf680b6940 tx=0x7fdf5c02a530 comp rx=0 tx=0).stop 2024-09-17T03:33:43.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.801+0000 7fdf6e939640 1 -- 172.21.15.146:0/1158084795 shutdown_connections 2024-09-17T03:33:43.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.801+0000 7fdf6e939640 1 --2- 172.21.15.146:0/1158084795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf680cdf10 0x7fdf680734f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:43.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.801+0000 7fdf6e939640 1 --2- 172.21.15.146:0/1158084795 >> v2:172.21.15.179:3300/0 conn(0x7fdf68153af0 0x7fdf6815ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:43.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.801+0000 7fdf6e939640 1 -- 172.21.15.146:0/1158084795 >> 172.21.15.146:0/1158084795 conn(0x7fdf680b3410 msgr2=0x7fdf680b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:43.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.801+0000 7fdf6e939640 1 -- 172.21.15.146:0/1158084795 shutdown_connections 2024-09-17T03:33:43.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.801+0000 7fdf6e939640 1 -- 172.21.15.146:0/1158084795 wait complete. 2024-09-17T03:33:43.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.803+0000 7fdf6e939640 1 Processor -- start 2024-09-17T03:33:43.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.803+0000 7fdf6e939640 1 -- start start 2024-09-17T03:33:43.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6e939640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf68073a30 0x7fdf6806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:43.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6e939640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf680cdf10 0x7fdf68144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:43.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6e939640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf68153af0 0x7fdf681451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:43.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6e939640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdf68160bc0 con 0x7fdf68153af0 2024-09-17T03:33:43.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6e939640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf680d0b50 con 0x7fdf680cdf10 2024-09-17T03:33:43.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6e939640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdf68160d40 con 0x7fdf68073a30 2024-09-17T03:33:43.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6ced6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf68153af0 0x7fdf681451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:43.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6ced6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf68153af0 0x7fdf681451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52388/0 (socket says 172.21.15.146:52388) 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6ced6640 1 -- 172.21.15.146:0/833928118 learned_addr learned my addr 172.21.15.146:0/833928118 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf677fe640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf680cdf10 0x7fdf68144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf67fff640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf68073a30 0x7fdf6806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6ced6640 1 -- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf68073a30 msgr2=0x7fdf6806de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6ced6640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf68073a30 0x7fdf6806de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6ced6640 1 -- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf680cdf10 msgr2=0x7fdf68144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6ced6640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf680cdf10 0x7fdf68144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6ced6640 1 -- 172.21.15.146:0/833928118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf681f77f0 con 0x7fdf68153af0 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf67fff640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf68073a30 0x7fdf6806de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf6ced6640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf68153af0 0x7fdf681451b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000c760 tx=0x7fdf6000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf64ff9640 1 -- 172.21.15.146:0/833928118 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60003b70 con 0x7fdf68153af0 2024-09-17T03:33:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.805+0000 7fdf64ff9640 1 -- 172.21.15.146:0/833928118 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf60003d10 con 0x7fdf68153af0 2024-09-17T03:33:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.806+0000 7fdf6e939640 1 -- 172.21.15.146:0/833928118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf681f7a60 con 0x7fdf68153af0 2024-09-17T03:33:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.806+0000 7fdf64ff9640 1 -- 172.21.15.146:0/833928118 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf600052d0 con 0x7fdf68153af0 2024-09-17T03:33:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.806+0000 7fdf6e939640 1 -- 172.21.15.146:0/833928118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf68158290 con 0x7fdf68153af0 2024-09-17T03:33:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.806+0000 7fdf6e939640 1 -- 172.21.15.146:0/833928118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf68155060 con 0x7fdf68153af0 2024-09-17T03:33:43.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.807+0000 7fdf64ff9640 1 -- 172.21.15.146:0/833928118 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf60005470 con 0x7fdf68153af0 2024-09-17T03:33:43.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.808+0000 7fdf64ff9640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf54078bc0 0x7fdf5407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:43.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.808+0000 7fdf64ff9640 1 -- 172.21.15.146:0/833928118 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fdf6009aa50 con 0x7fdf68153af0 2024-09-17T03:33:43.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.808+0000 7fdf67fff640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf54078bc0 0x7fdf5407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:43.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.809+0000 7fdf67fff640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf54078bc0 0x7fdf5407b0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf58005fd0 tx=0x7fdf5800f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:43.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:43.812+0000 7fdf64ff9640 1 -- 172.21.15.146:0/833928118 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdf68070ac0 con 0x7fdf68153af0 2024-09-17T03:33:44.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.024+0000 7fdf6e939640 1 -- 172.21.15.146:0/833928118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf68158000 con 0x7fdf68153af0 2024-09-17T03:33:44.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.025+0000 7fdf64ff9640 1 -- 172.21.15.146:0/833928118 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5231 (secure 0 0 0) 0x7fdf60062e90 con 0x7fdf68153af0 2024-09-17T03:33:44.024 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:44.024 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":13,"btime":"2024-09-17T03:33:43:665910+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/699096289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":699096289},{"type":"v1","addr":"172.21.15.146:6834","nonce":699096289}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3576644376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3576644376},{"type":"v1","addr":"172.21.15.179:6837","nonce":3576644376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4852,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1904604031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1904604031},{"type":"v1","addr":"172.21.15.146:6835","nonce":1904604031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:33:41.014829+0000","modified":"2024-09-17T03:33:43.020222+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/3055708361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3055708361},{"type":"v1","addr":"172.21.15.179:6836","nonce":3055708361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4864,"qdb_cluster":[4864]},"id":2}]} 2024-09-17T03:33:44.024 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 13 2024-09-17T03:33:44.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 -- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf54078bc0 msgr2=0x7fdf5407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf54078bc0 0x7fdf5407b0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf58005fd0 tx=0x7fdf5800f360 comp rx=0 tx=0).stop 2024-09-17T03:33:44.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 -- 172.21.15.146:0/833928118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf68153af0 msgr2=0x7fdf681451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf68153af0 0x7fdf681451b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000c760 tx=0x7fdf6000cb60 comp rx=0 tx=0).stop 2024-09-17T03:33:44.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 -- 172.21.15.146:0/833928118 shutdown_connections 2024-09-17T03:33:44.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf54078bc0 0x7fdf5407b0d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf68153af0 0x7fdf681451b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf680cdf10 0x7fdf68144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 --2- 172.21.15.146:0/833928118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf68073a30 0x7fdf6806de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 -- 172.21.15.146:0/833928118 >> 172.21.15.146:0/833928118 conn(0x7fdf680b3410 msgr2=0x7fdf6815f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:44.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 -- 172.21.15.146:0/833928118 shutdown_connections 2024-09-17T03:33:44.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.027+0000 7fdf6e939640 1 -- 172.21.15.146:0/833928118 wait complete. 2024-09-17T03:33:44.037 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:33:44.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.151+0000 7fab7b39b640 1 -- 172.21.15.146:0/3104178795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab740b61f0 msgr2=0x7fab740b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.151+0000 7fab7b39b640 1 --2- 172.21.15.146:0/3104178795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab740b61f0 0x7fab740b6600 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fab7406e100 tx=0x7fab6c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:33:44.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.151+0000 7fab7b39b640 1 -- 172.21.15.146:0/3104178795 shutdown_connections 2024-09-17T03:33:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.151+0000 7fab7b39b640 1 --2- 172.21.15.146:0/3104178795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab740b61f0 0x7fab740b6600 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.151+0000 7fab7b39b640 1 --2- 172.21.15.146:0/3104178795 >> v2:172.21.15.179:3300/0 conn(0x7fab7415f1a0 0x7fab740cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.151+0000 7fab7b39b640 1 -- 172.21.15.146:0/3104178795 >> 172.21.15.146:0/3104178795 conn(0x7fab740d11f0 msgr2=0x7fab740d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.151+0000 7fab7b39b640 1 -- 172.21.15.146:0/3104178795 shutdown_connections 2024-09-17T03:33:44.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.151+0000 7fab7b39b640 1 -- 172.21.15.146:0/3104178795 wait complete. 2024-09-17T03:33:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.153+0000 7fab7b39b640 1 Processor -- start 2024-09-17T03:33:44.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.153+0000 7fab7b39b640 1 -- start start 2024-09-17T03:33:44.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.154+0000 7fab7b39b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab740b61f0 0x7fab741f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.154+0000 7fab7b39b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7415f1a0 0x7fab741618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.154+0000 7fab7b39b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab741631a0 0x7fab741f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.154+0000 7fab7b39b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab740695b0 con 0x7fab740b61f0 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.154+0000 7fab7b39b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab74069430 con 0x7fab7415f1a0 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.154+0000 7fab7b39b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fab74069730 con 0x7fab741631a0 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.154+0000 7fab79137640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab740b61f0 0x7fab741f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab79137640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab740b61f0 0x7fab741f6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52412/0 (socket says 172.21.15.146:52412) 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab79137640 1 -- 172.21.15.146:0/3266989581 learned_addr learned my addr 172.21.15.146:0/3266989581 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab79938640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab741631a0 0x7fab741f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab78936640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7415f1a0 0x7fab741618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab79137640 1 -- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab741631a0 msgr2=0x7fab741f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab79137640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab741631a0 0x7fab741f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab79137640 1 -- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7415f1a0 msgr2=0x7fab741618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab79137640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7415f1a0 0x7fab741618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab79137640 1 -- 172.21.15.146:0/3266989581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab741f7090 con 0x7fab740b61f0 2024-09-17T03:33:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab79137640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab740b61f0 0x7fab741f6b50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab6400e790 tx=0x7fab6400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab71ffb640 1 -- 172.21.15.146:0/3266989581 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6400eea0 con 0x7fab740b61f0 2024-09-17T03:33:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab71ffb640 1 -- 172.21.15.146:0/3266989581 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab6400cdb0 con 0x7fab740b61f0 2024-09-17T03:33:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab71ffb640 1 -- 172.21.15.146:0/3266989581 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64010690 con 0x7fab740b61f0 2024-09-17T03:33:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab7b39b640 1 -- 172.21.15.146:0/3266989581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab74162400 con 0x7fab740b61f0 2024-09-17T03:33:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.155+0000 7fab7b39b640 1 -- 172.21.15.146:0/3266989581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab740cab70 con 0x7fab740b61f0 2024-09-17T03:33:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.157+0000 7fab7b39b640 1 -- 172.21.15.146:0/3266989581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab74069be0 con 0x7fab740b61f0 2024-09-17T03:33:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.157+0000 7fab71ffb640 1 -- 172.21.15.146:0/3266989581 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab64010830 con 0x7fab740b61f0 2024-09-17T03:33:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.158+0000 7fab71ffb640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab60078b90 0x7fab6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.158+0000 7fab71ffb640 1 -- 172.21.15.146:0/3266989581 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fab6409b6a0 con 0x7fab740b61f0 2024-09-17T03:33:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.158+0000 7fab78936640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab60078b90 0x7fab6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.158+0000 7fab78936640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab60078b90 0x7fab6007b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fab7415cfd0 tx=0x7fab68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.162+0000 7fab71ffb640 1 -- 172.21.15.146:0/3266989581 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fab64063520 con 0x7fab740b61f0 2024-09-17T03:33:44.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.339+0000 7fab7b39b640 1 -- 172.21.15.146:0/3266989581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab740c7ff0 con 0x7fab740b61f0 2024-09-17T03:33:44.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.340+0000 7fab71ffb640 1 -- 172.21.15.146:0/3266989581 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16777 (secure 0 0 0) 0x7fab64067f50 con 0x7fab740b61f0 2024-09-17T03:33:44.340 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:44.340 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":32,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:33:42.648367+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:33:38.670836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T03:33:39.971433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:33:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 -- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab60078b90 msgr2=0x7fab6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab60078b90 0x7fab6007b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fab7415cfd0 tx=0x7fab68009040 comp rx=0 tx=0).stop 2024-09-17T03:33:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 -- 172.21.15.146:0/3266989581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab740b61f0 msgr2=0x7fab741f6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab740b61f0 0x7fab741f6b50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab6400e790 tx=0x7fab6400ec50 comp rx=0 tx=0).stop 2024-09-17T03:33:44.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 -- 172.21.15.146:0/3266989581 shutdown_connections 2024-09-17T03:33:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab60078b90 0x7fab6007b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab741631a0 0x7fab741f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7415f1a0 0x7fab741618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 --2- 172.21.15.146:0/3266989581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab740b61f0 0x7fab741f6b50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 -- 172.21.15.146:0/3266989581 >> 172.21.15.146:0/3266989581 conn(0x7fab740d11f0 msgr2=0x7fab7415d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 -- 172.21.15.146:0/3266989581 shutdown_connections 2024-09-17T03:33:44.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.343+0000 7fab7b39b640 1 -- 172.21.15.146:0/3266989581 wait complete. 2024-09-17T03:33:44.354 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:33:44.354 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:44.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.467+0000 7ff7ae501640 1 -- 172.21.15.146:0/2250261546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a8070040 msgr2=0x7ff7a80cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.467+0000 7ff7ae501640 1 --2- 172.21.15.146:0/2250261546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a8070040 0x7ff7a80cf350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0005fd0 tx=0x7ff7a002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.467+0000 7ff7ae501640 1 -- 172.21.15.146:0/2250261546 shutdown_connections 2024-09-17T03:33:44.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.467+0000 7ff7ae501640 1 --2- 172.21.15.146:0/2250261546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a8070040 0x7ff7a80cf350 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.467+0000 7ff7ae501640 1 --2- 172.21.15.146:0/2250261546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a815c9e0 0x7ff7a80b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.467+0000 7ff7ae501640 1 -- 172.21.15.146:0/2250261546 >> 172.21.15.146:0/2250261546 conn(0x7ff7a806d3c0 msgr2=0x7ff7a80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:44.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.467+0000 7ff7ae501640 1 -- 172.21.15.146:0/2250261546 shutdown_connections 2024-09-17T03:33:44.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.467+0000 7ff7ae501640 1 -- 172.21.15.146:0/2250261546 wait complete. 2024-09-17T03:33:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.469+0000 7ff7ae501640 1 Processor -- start 2024-09-17T03:33:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.469+0000 7ff7ae501640 1 -- start start 2024-09-17T03:33:44.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.470+0000 7ff7ae501640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a806fc30 0x7ff7a81f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.470+0000 7ff7ae501640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a8070040 0x7ff7a80b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.470+0000 7ff7ae501640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a815c9e0 0x7ff7a815f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.470+0000 7ff7ae501640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a80b4310 con 0x7ff7a815c9e0 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.470+0000 7ff7ae501640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a80b4190 con 0x7ff7a806fc30 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.470+0000 7ff7ae501640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a80b4490 con 0x7ff7a8070040 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.470+0000 7ff7aca9e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a815c9e0 0x7ff7a815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.470+0000 7ff7aca9e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a815c9e0 0x7ff7a815f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52432/0 (socket says 172.21.15.146:52432) 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.470+0000 7ff7aca9e640 1 -- 172.21.15.146:0/2623382390 learned_addr learned my addr 172.21.15.146:0/2623382390 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.470+0000 7ff7a7fff640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a806fc30 0x7ff7a81f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.470+0000 7ff7a77fe640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a8070040 0x7ff7a80b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.471+0000 7ff7aca9e640 1 -- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a8070040 msgr2=0x7ff7a80b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.471+0000 7ff7aca9e640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a8070040 0x7ff7a80b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.471+0000 7ff7aca9e640 1 -- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a806fc30 msgr2=0x7ff7a81f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.471+0000 7ff7aca9e640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a806fc30 0x7ff7a81f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.471+0000 7ff7aca9e640 1 -- 172.21.15.146:0/2623382390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a81f4c80 con 0x7ff7a815c9e0 2024-09-17T03:33:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.471+0000 7ff7aca9e640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a815c9e0 0x7ff7a815f180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009cd0 tx=0x7ff7a0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.471+0000 7ff7a4ff9640 1 -- 172.21.15.146:0/2623382390 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0031da0 con 0x7ff7a815c9e0 2024-09-17T03:33:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.471+0000 7ff7a4ff9640 1 -- 172.21.15.146:0/2623382390 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7a0003e10 con 0x7ff7a815c9e0 2024-09-17T03:33:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.471+0000 7ff7ae501640 1 -- 172.21.15.146:0/2623382390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a80b0ea0 con 0x7ff7a815c9e0 2024-09-17T03:33:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.471+0000 7ff7a4ff9640 1 -- 172.21.15.146:0/2623382390 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0033330 con 0x7ff7a815c9e0 2024-09-17T03:33:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.471+0000 7ff7ae501640 1 -- 172.21.15.146:0/2623382390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a80b1460 con 0x7ff7a815c9e0 2024-09-17T03:33:44.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.472+0000 7ff7ae501640 1 -- 172.21.15.146:0/2623382390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a80b4940 con 0x7ff7a815c9e0 2024-09-17T03:33:44.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.473+0000 7ff7a4ff9640 1 -- 172.21.15.146:0/2623382390 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff7a00334d0 con 0x7ff7a815c9e0 2024-09-17T03:33:44.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.473+0000 7ff7a4ff9640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff794078b90 0x7ff79407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.474+0000 7ff7a4ff9640 1 -- 172.21.15.146:0/2623382390 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff7a00bc230 con 0x7ff7a815c9e0 2024-09-17T03:33:44.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.474+0000 7ff7a7fff640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff794078b90 0x7ff79407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.474+0000 7ff7a7fff640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff794078b90 0x7ff79407b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff798005fd0 tx=0x7ff79800a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.478+0000 7ff7a4ff9640 1 -- 172.21.15.146:0/2623382390 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff7a003f030 con 0x7ff7a815c9e0 2024-09-17T03:33:44.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.649+0000 7ff7ae501640 1 -- 172.21.15.146:0/2623382390 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7a80cfe60 con 0x7ff794078b90 2024-09-17T03:33:44.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.654+0000 7ff7a4ff9640 1 -- 172.21.15.146:0/2623382390 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241477 (secure 0 0 0) 0x7ff7a80cfe60 con 0x7ff794078b90 2024-09-17T03:33:44.655 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:44.656 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:44.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 -- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff794078b90 msgr2=0x7ff79407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff794078b90 0x7ff79407b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff798005fd0 tx=0x7ff79800a250 comp rx=0 tx=0).stop 2024-09-17T03:33:44.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 -- 172.21.15.146:0/2623382390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a815c9e0 msgr2=0x7ff7a815f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a815c9e0 0x7ff7a815f180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009cd0 tx=0x7ff7a0003c20 comp rx=0 tx=0).stop 2024-09-17T03:33:44.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 -- 172.21.15.146:0/2623382390 shutdown_connections 2024-09-17T03:33:44.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff794078b90 0x7ff79407b0a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7a815c9e0 0x7ff7a815f180 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7a8070040 0x7ff7a80b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 --2- 172.21.15.146:0/2623382390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7a806fc30 0x7ff7a81f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 -- 172.21.15.146:0/2623382390 >> 172.21.15.146:0/2623382390 conn(0x7ff7a806d3c0 msgr2=0x7ff7a8152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:44.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 -- 172.21.15.146:0/2623382390 shutdown_connections 2024-09-17T03:33:44.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.657+0000 7ff7ae501640 1 -- 172.21.15.146:0/2623382390 wait complete. 2024-09-17T03:33:44.668 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-17T03:33:43.799294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592070,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":60,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":219904,"kb_used_data":3624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754816,"statfs":{"total":773094113280,"available":772868931584,"internally_reserved":0,"allocated":3710976,"data_stored":2107000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1702,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.157405"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.669912+0000","last_change":"2024-09-17T03:33:41.662887+0000","last_active":"2024-09-17T03:33:41.669912+0000","last_peered":"2024-09-17T03:33:41.669912+0000","last_clean":"2024-09-17T03:33:41.669912+0000","last_became_active":"2024-09-17T03:33:41.662600+0000","last_became_peered":"2024-09-17T03:33:41.662600+0000","last_unstale":"2024-09-17T03:33:41.669912+0000","last_undegraded":"2024-09-17T03:33:41.669912+0000","last_fullsized":"2024-09-17T03:33:41.669912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:18.146167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.677678+0000","last_change":"2024-09-17T03:33:41.676205+0000","last_active":"2024-09-17T03:33:41.677678+0000","last_peered":"2024-09-17T03:33:41.677678+0000","last_clean":"2024-09-17T03:33:41.677678+0000","last_became_active":"2024-09-17T03:33:41.675785+0000","last_became_peered":"2024-09-17T03:33:41.675785+0000","last_unstale":"2024-09-17T03:33:41.677678+0000","last_undegraded":"2024-09-17T03:33:41.677678+0000","last_fullsized":"2024-09-17T03:33:41.677678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:22.654084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679864+0000","last_change":"2024-09-17T03:33:41.673177+0000","last_active":"2024-09-17T03:33:41.679864+0000","last_peered":"2024-09-17T03:33:41.679864+0000","last_clean":"2024-09-17T03:33:41.679864+0000","last_became_active":"2024-09-17T03:33:41.671525+0000","last_became_peered":"2024-09-17T03:33:41.671525+0000","last_unstale":"2024-09-17T03:33:41.679864+0000","last_undegraded":"2024-09-17T03:33:41.679864+0000","last_fullsized":"2024-09-17T03:33:41.679864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:27.398745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.686103+0000","last_change":"2024-09-17T03:33:41.683531+0000","last_active":"2024-09-17T03:33:41.686103+0000","last_peered":"2024-09-17T03:33:41.686103+0000","last_clean":"2024-09-17T03:33:41.686103+0000","last_became_active":"2024-09-17T03:33:41.683185+0000","last_became_peered":"2024-09-17T03:33:41.683185+0000","last_unstale":"2024-09-17T03:33:41.686103+0000","last_undegraded":"2024-09-17T03:33:41.686103+0000","last_fullsized":"2024-09-17T03:33:41.686103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:35.674290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679838+0000","last_change":"2024-09-17T03:33:41.669466+0000","last_active":"2024-09-17T03:33:41.679838+0000","last_peered":"2024-09-17T03:33:41.679838+0000","last_clean":"2024-09-17T03:33:41.679838+0000","last_became_active":"2024-09-17T03:33:41.668995+0000","last_became_peered":"2024-09-17T03:33:41.668995+0000","last_unstale":"2024-09-17T03:33:41.679838+0000","last_undegraded":"2024-09-17T03:33:41.679838+0000","last_fullsized":"2024-09-17T03:33:41.679838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:34.559813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.683515+0000","last_change":"2024-09-17T03:33:41.680388+0000","last_active":"2024-09-17T03:33:41.683515+0000","last_peered":"2024-09-17T03:33:41.683515+0000","last_clean":"2024-09-17T03:33:41.683515+0000","last_became_active":"2024-09-17T03:33:41.680067+0000","last_became_peered":"2024-09-17T03:33:41.680067+0000","last_unstale":"2024-09-17T03:33:41.683515+0000","last_undegraded":"2024-09-17T03:33:41.683515+0000","last_fullsized":"2024-09-17T03:33:41.683515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:18.223647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.680007+0000","last_change":"2024-09-17T03:33:41.676041+0000","last_active":"2024-09-17T03:33:41.680007+0000","last_peered":"2024-09-17T03:33:41.680007+0000","last_clean":"2024-09-17T03:33:41.680007+0000","last_became_active":"2024-09-17T03:33:41.675417+0000","last_became_peered":"2024-09-17T03:33:41.675417+0000","last_unstale":"2024-09-17T03:33:41.680007+0000","last_undegraded":"2024-09-17T03:33:41.680007+0000","last_fullsized":"2024-09-17T03:33:41.680007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:41.459158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.671473+0000","last_change":"2024-09-17T03:33:41.667308+0000","last_active":"2024-09-17T03:33:41.671473+0000","last_peered":"2024-09-17T03:33:41.671473+0000","last_clean":"2024-09-17T03:33:41.671473+0000","last_became_active":"2024-09-17T03:33:41.666990+0000","last_became_peered":"2024-09-17T03:33:41.666990+0000","last_unstale":"2024-09-17T03:33:41.671473+0000","last_undegraded":"2024-09-17T03:33:41.671473+0000","last_fullsized":"2024-09-17T03:33:41.671473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:31.926728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675778+0000","last_change":"2024-09-17T03:33:41.672443+0000","last_active":"2024-09-17T03:33:41.675778+0000","last_peered":"2024-09-17T03:33:41.675778+0000","last_clean":"2024-09-17T03:33:41.675778+0000","last_became_active":"2024-09-17T03:33:41.672025+0000","last_became_peered":"2024-09-17T03:33:41.672025+0000","last_unstale":"2024-09-17T03:33:41.675778+0000","last_undegraded":"2024-09-17T03:33:41.675778+0000","last_fullsized":"2024-09-17T03:33:41.675778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:35.234066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679977+0000","last_change":"2024-09-17T03:33:41.675720+0000","last_active":"2024-09-17T03:33:41.679977+0000","last_peered":"2024-09-17T03:33:41.679977+0000","last_clean":"2024-09-17T03:33:41.679977+0000","last_became_active":"2024-09-17T03:33:41.674212+0000","last_became_peered":"2024-09-17T03:33:41.674212+0000","last_unstale":"2024-09-17T03:33:41.679977+0000","last_undegraded":"2024-09-17T03:33:41.679977+0000","last_fullsized":"2024-09-17T03:33:41.679977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:09.047247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.670754+0000","last_change":"2024-09-17T03:33:41.667684+0000","last_active":"2024-09-17T03:33:41.670754+0000","last_peered":"2024-09-17T03:33:41.670754+0000","last_clean":"2024-09-17T03:33:41.670754+0000","last_became_active":"2024-09-17T03:33:41.667362+0000","last_became_peered":"2024-09-17T03:33:41.667362+0000","last_unstale":"2024-09-17T03:33:41.670754+0000","last_undegraded":"2024-09-17T03:33:41.670754+0000","last_fullsized":"2024-09-17T03:33:41.670754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:04.350237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687457+0000","last_change":"2024-09-17T03:33:40.670251+0000","last_active":"2024-09-17T03:33:41.687457+0000","last_peered":"2024-09-17T03:33:41.687457+0000","last_clean":"2024-09-17T03:33:41.687457+0000","last_became_active":"2024-09-17T03:33:40.669956+0000","last_became_peered":"2024-09-17T03:33:40.669956+0000","last_unstale":"2024-09-17T03:33:41.687457+0000","last_undegraded":"2024-09-17T03:33:41.687457+0000","last_fullsized":"2024-09-17T03:33:41.687457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:04.466425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.676297+0000","last_change":"2024-09-17T03:33:41.673601+0000","last_active":"2024-09-17T03:33:41.676297+0000","last_peered":"2024-09-17T03:33:41.676297+0000","last_clean":"2024-09-17T03:33:41.676297+0000","last_became_active":"2024-09-17T03:33:41.673307+0000","last_became_peered":"2024-09-17T03:33:41.673307+0000","last_unstale":"2024-09-17T03:33:41.676297+0000","last_undegraded":"2024-09-17T03:33:41.676297+0000","last_fullsized":"2024-09-17T03:33:41.676297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:30.683645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.655398+0000","last_change":"2024-09-17T03:33:40.668613+0000","last_active":"2024-09-17T03:33:41.655398+0000","last_peered":"2024-09-17T03:33:41.655398+0000","last_clean":"2024-09-17T03:33:41.655398+0000","last_became_active":"2024-09-17T03:33:40.668131+0000","last_became_peered":"2024-09-17T03:33:40.668131+0000","last_unstale":"2024-09-17T03:33:41.655398+0000","last_undegraded":"2024-09-17T03:33:41.655398+0000","last_fullsized":"2024-09-17T03:33:41.655398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:05.271520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675785+0000","last_change":"2024-09-17T03:33:41.672818+0000","last_active":"2024-09-17T03:33:41.675785+0000","last_peered":"2024-09-17T03:33:41.675785+0000","last_clean":"2024-09-17T03:33:41.675785+0000","last_became_active":"2024-09-17T03:33:41.672405+0000","last_became_peered":"2024-09-17T03:33:41.672405+0000","last_unstale":"2024-09-17T03:33:41.675785+0000","last_undegraded":"2024-09-17T03:33:41.675785+0000","last_fullsized":"2024-09-17T03:33:41.675785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:04.973538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.657879+0000","last_change":"2024-09-17T03:33:40.671952+0000","last_active":"2024-09-17T03:33:41.657879+0000","last_peered":"2024-09-17T03:33:41.657879+0000","last_clean":"2024-09-17T03:33:41.657879+0000","last_became_active":"2024-09-17T03:33:40.671688+0000","last_became_peered":"2024-09-17T03:33:40.671688+0000","last_unstale":"2024-09-17T03:33:41.657879+0000","last_undegraded":"2024-09-17T03:33:41.657879+0000","last_fullsized":"2024-09-17T03:33:41.657879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:41.813739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.680053+0000","last_change":"2024-09-17T03:33:41.673698+0000","last_active":"2024-09-17T03:33:41.680053+0000","last_peered":"2024-09-17T03:33:41.680053+0000","last_clean":"2024-09-17T03:33:41.680053+0000","last_became_active":"2024-09-17T03:33:41.673373+0000","last_became_peered":"2024-09-17T03:33:41.673373+0000","last_unstale":"2024-09-17T03:33:41.680053+0000","last_undegraded":"2024-09-17T03:33:41.680053+0000","last_fullsized":"2024-09-17T03:33:41.680053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:22.366281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687146+0000","last_change":"2024-09-17T03:33:41.681730+0000","last_active":"2024-09-17T03:33:41.687146+0000","last_peered":"2024-09-17T03:33:41.687146+0000","last_clean":"2024-09-17T03:33:41.687146+0000","last_became_active":"2024-09-17T03:33:41.678867+0000","last_became_peered":"2024-09-17T03:33:41.678867+0000","last_unstale":"2024-09-17T03:33:41.687146+0000","last_undegraded":"2024-09-17T03:33:41.687146+0000","last_fullsized":"2024-09-17T03:33:41.687146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:30.928493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.682018+0000","last_change":"2024-09-17T03:33:40.667467+0000","last_active":"2024-09-17T03:33:41.682018+0000","last_peered":"2024-09-17T03:33:41.682018+0000","last_clean":"2024-09-17T03:33:41.682018+0000","last_became_active":"2024-09-17T03:33:40.667051+0000","last_became_peered":"2024-09-17T03:33:40.667051+0000","last_unstale":"2024-09-17T03:33:41.682018+0000","last_undegraded":"2024-09-17T03:33:41.682018+0000","last_fullsized":"2024-09-17T03:33:41.682018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:01.755385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679898+0000","last_change":"2024-09-17T03:33:41.676992+0000","last_active":"2024-09-17T03:33:41.679898+0000","last_peered":"2024-09-17T03:33:41.679898+0000","last_clean":"2024-09-17T03:33:41.679898+0000","last_became_active":"2024-09-17T03:33:41.676639+0000","last_became_peered":"2024-09-17T03:33:41.676639+0000","last_unstale":"2024-09-17T03:33:41.679898+0000","last_undegraded":"2024-09-17T03:33:41.679898+0000","last_fullsized":"2024-09-17T03:33:41.679898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:04.225065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.692710+0000","last_change":"2024-09-17T03:33:40.670776+0000","last_active":"2024-09-17T03:33:41.692710+0000","last_peered":"2024-09-17T03:33:41.692710+0000","last_clean":"2024-09-17T03:33:41.692710+0000","last_became_active":"2024-09-17T03:33:40.670019+0000","last_became_peered":"2024-09-17T03:33:40.670019+0000","last_unstale":"2024-09-17T03:33:41.692710+0000","last_undegraded":"2024-09-17T03:33:41.692710+0000","last_fullsized":"2024-09-17T03:33:41.692710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:22.598820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.669867+0000","last_change":"2024-09-17T03:33:41.662805+0000","last_active":"2024-09-17T03:33:41.669867+0000","last_peered":"2024-09-17T03:33:41.669867+0000","last_clean":"2024-09-17T03:33:41.669867+0000","last_became_active":"2024-09-17T03:33:41.662456+0000","last_became_peered":"2024-09-17T03:33:41.662456+0000","last_unstale":"2024-09-17T03:33:41.669867+0000","last_undegraded":"2024-09-17T03:33:41.669867+0000","last_fullsized":"2024-09-17T03:33:41.669867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:28.588107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.655667+0000","last_change":"2024-09-17T03:33:40.672072+0000","last_active":"2024-09-17T03:33:41.655667+0000","last_peered":"2024-09-17T03:33:41.655667+0000","last_clean":"2024-09-17T03:33:41.655667+0000","last_became_active":"2024-09-17T03:33:40.671735+0000","last_became_peered":"2024-09-17T03:33:40.671735+0000","last_unstale":"2024-09-17T03:33:41.655667+0000","last_undegraded":"2024-09-17T03:33:41.655667+0000","last_fullsized":"2024-09-17T03:33:41.655667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:23.354684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.690118+0000","last_change":"2024-09-17T03:33:40.670623+0000","last_active":"2024-09-17T03:33:41.690118+0000","last_peered":"2024-09-17T03:33:41.690118+0000","last_clean":"2024-09-17T03:33:41.690118+0000","last_became_active":"2024-09-17T03:33:40.670144+0000","last_became_peered":"2024-09-17T03:33:40.670144+0000","last_unstale":"2024-09-17T03:33:41.690118+0000","last_undegraded":"2024-09-17T03:33:41.690118+0000","last_fullsized":"2024-09-17T03:33:41.690118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:29.403504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675863+0000","last_change":"2024-09-17T03:33:41.672981+0000","last_active":"2024-09-17T03:33:41.675863+0000","last_peered":"2024-09-17T03:33:41.675863+0000","last_clean":"2024-09-17T03:33:41.675863+0000","last_became_active":"2024-09-17T03:33:41.672258+0000","last_became_peered":"2024-09-17T03:33:41.672258+0000","last_unstale":"2024-09-17T03:33:41.675863+0000","last_undegraded":"2024-09-17T03:33:41.675863+0000","last_fullsized":"2024-09-17T03:33:41.675863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:05.695841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.665126+0000","last_change":"2024-09-17T03:33:40.669866+0000","last_active":"2024-09-17T03:33:41.665126+0000","last_peered":"2024-09-17T03:33:41.665126+0000","last_clean":"2024-09-17T03:33:41.665126+0000","last_became_active":"2024-09-17T03:33:40.669549+0000","last_became_peered":"2024-09-17T03:33:40.669549+0000","last_unstale":"2024-09-17T03:33:41.665126+0000","last_undegraded":"2024-09-17T03:33:41.665126+0000","last_fullsized":"2024-09-17T03:33:41.665126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:57.788845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.682928+0000","last_change":"2024-09-17T03:33:41.679445+0000","last_active":"2024-09-17T03:33:41.682928+0000","last_peered":"2024-09-17T03:33:41.682928+0000","last_clean":"2024-09-17T03:33:41.682928+0000","last_became_active":"2024-09-17T03:33:41.679125+0000","last_became_peered":"2024-09-17T03:33:41.679125+0000","last_unstale":"2024-09-17T03:33:41.682928+0000","last_undegraded":"2024-09-17T03:33:41.682928+0000","last_fullsized":"2024-09-17T03:33:41.682928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:55.146128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687271+0000","last_change":"2024-09-17T03:33:41.682134+0000","last_active":"2024-09-17T03:33:41.687271+0000","last_peered":"2024-09-17T03:33:41.687271+0000","last_clean":"2024-09-17T03:33:41.687271+0000","last_became_active":"2024-09-17T03:33:41.681496+0000","last_became_peered":"2024-09-17T03:33:41.681496+0000","last_unstale":"2024-09-17T03:33:41.687271+0000","last_undegraded":"2024-09-17T03:33:41.687271+0000","last_fullsized":"2024-09-17T03:33:41.687271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:16.460288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.656496+0000","last_change":"2024-09-17T03:33:40.670191+0000","last_active":"2024-09-17T03:33:41.656496+0000","last_peered":"2024-09-17T03:33:41.656496+0000","last_clean":"2024-09-17T03:33:41.656496+0000","last_became_active":"2024-09-17T03:33:40.669759+0000","last_became_peered":"2024-09-17T03:33:40.669759+0000","last_unstale":"2024-09-17T03:33:41.656496+0000","last_undegraded":"2024-09-17T03:33:41.656496+0000","last_fullsized":"2024-09-17T03:33:41.656496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:48.218566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T03:33:36.064143+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:33:36.064143+0000","last_peered":"2024-09-17T03:33:36.064143+0000","last_clean":"2024-09-17T03:33:36.064143+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:33:36.064143+0000","last_undegraded":"2024-09-17T03:33:36.064143+0000","last_fullsized":"2024-09-17T03:33:36.064143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1702,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":18,"acting":18,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":897024,"data_stored":701148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":897024,"data_stored":701148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":130311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":131273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:44.672 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:44.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.822+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/2931571618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e240b5750 msgr2=0x7f9e240b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.822+0000 7f9e2b6f9640 1 --2- 172.21.15.146:0/2931571618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e240b5750 0x7f9e240b3620 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9e14005fd0 tx=0x7f9e1402a530 comp rx=0 tx=0).stop 2024-09-17T03:33:44.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.822+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/2931571618 shutdown_connections 2024-09-17T03:33:44.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.822+0000 7f9e2b6f9640 1 --2- 172.21.15.146:0/2931571618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e240b3b60 0x7f9e2415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.822+0000 7f9e2b6f9640 1 --2- 172.21.15.146:0/2931571618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e240b5750 0x7f9e240b3620 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.822+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/2931571618 >> 172.21.15.146:0/2931571618 conn(0x7f9e240b7b20 msgr2=0x7f9e2409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:44.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.822+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/2931571618 shutdown_connections 2024-09-17T03:33:44.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.822+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/2931571618 wait complete. 2024-09-17T03:33:44.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.824+0000 7f9e2b6f9640 1 Processor -- start 2024-09-17T03:33:44.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.824+0000 7f9e2b6f9640 1 -- start start 2024-09-17T03:33:44.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.825+0000 7f9e2b6f9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e240b3b60 0x7f9e241f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.825+0000 7f9e2b6f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240b5750 0x7f9e24143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.825+0000 7f9e2b6f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e240b5ce0 0x7f9e24071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.825+0000 7f9e2b6f9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2415d4b0 con 0x7f9e240b5ce0 2024-09-17T03:33:44.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.825+0000 7f9e2b6f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2415d330 con 0x7f9e240b5750 2024-09-17T03:33:44.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.825+0000 7f9e2b6f9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2415d630 con 0x7f9e240b3b60 2024-09-17T03:33:44.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.825+0000 7f9e29c96640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e240b5ce0 0x7f9e24071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.825+0000 7f9e29c96640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e240b5ce0 0x7f9e24071b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52464/0 (socket says 172.21.15.146:52464) 2024-09-17T03:33:44.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.825+0000 7f9e29c96640 1 -- 172.21.15.146:0/3580859437 learned_addr learned my addr 172.21.15.146:0/3580859437 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:44.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.825+0000 7f9e29495640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e240b3b60 0x7f9e241f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.825+0000 7f9e28c94640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240b5750 0x7f9e24143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.826+0000 7f9e29c96640 1 -- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e240b3b60 msgr2=0x7f9e241f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.826+0000 7f9e29c96640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e240b3b60 0x7f9e241f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.826+0000 7f9e29c96640 1 -- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240b5750 msgr2=0x7f9e24143750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.826+0000 7f9e29c96640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240b5750 0x7f9e24143750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.826+0000 7f9e29c96640 1 -- 172.21.15.146:0/3580859437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e24147090 con 0x7f9e240b5ce0 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.826+0000 7f9e29c96640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e240b5ce0 0x7f9e24071b40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00c9a0 tx=0x7f9e1c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.826+0000 7f9e19ffb640 1 -- 172.21.15.146:0/3580859437 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c007bb0 con 0x7f9e240b5ce0 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.826+0000 7f9e19ffb640 1 -- 172.21.15.146:0/3580859437 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e1c00f450 con 0x7f9e240b5ce0 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.826+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/3580859437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e24146480 con 0x7f9e240b5ce0 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.826+0000 7f9e19ffb640 1 -- 172.21.15.146:0/3580859437 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c007e60 con 0x7f9e240b5ce0 2024-09-17T03:33:44.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.826+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/3580859437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e24146a40 con 0x7f9e240b5ce0 2024-09-17T03:33:44.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.827+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/3580859437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e2415ec60 con 0x7f9e240b5ce0 2024-09-17T03:33:44.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.828+0000 7f9e19ffb640 1 -- 172.21.15.146:0/3580859437 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e1c00f8a0 con 0x7f9e240b5ce0 2024-09-17T03:33:44.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.828+0000 7f9e19ffb640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e08078bc0 0x7f9e0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:44.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.828+0000 7f9e19ffb640 1 -- 172.21.15.146:0/3580859437 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f9e1c09b2c0 con 0x7f9e240b5ce0 2024-09-17T03:33:44.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.828+0000 7f9e29495640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e08078bc0 0x7f9e0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:44.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.829+0000 7f9e29495640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e08078bc0 0x7f9e0807b0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000b450 tx=0x7f9e2000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:44.833+0000 7f9e19ffb640 1 -- 172.21.15.146:0/3580859437 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e1c014030 con 0x7f9e240b5ce0 2024-09-17T03:33:45.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.005+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/3580859437 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e24159bc0 con 0x7f9e08078bc0 2024-09-17T03:33:45.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.010+0000 7f9e19ffb640 1 -- 172.21.15.146:0/3580859437 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241477 (secure 0 0 0) 0x7f9e24159bc0 con 0x7f9e08078bc0 2024-09-17T03:33:45.011 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:45.012 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:45.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.013+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e08078bc0 msgr2=0x7f9e0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.013+0000 7f9e2b6f9640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e08078bc0 0x7f9e0807b0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000b450 tx=0x7f9e2000d040 comp rx=0 tx=0).stop 2024-09-17T03:33:45.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.013+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/3580859437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e240b5ce0 msgr2=0x7f9e24071b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.013+0000 7f9e2b6f9640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e240b5ce0 0x7f9e24071b40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00c9a0 tx=0x7f9e1c00ce60 comp rx=0 tx=0).stop 2024-09-17T03:33:45.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.013+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/3580859437 shutdown_connections 2024-09-17T03:33:45.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.013+0000 7f9e2b6f9640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e08078bc0 0x7f9e0807b0d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.013+0000 7f9e2b6f9640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e240b5ce0 0x7f9e24071b40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.013+0000 7f9e2b6f9640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240b5750 0x7f9e24143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.013+0000 7f9e2b6f9640 1 --2- 172.21.15.146:0/3580859437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e240b3b60 0x7f9e241f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.013+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/3580859437 >> 172.21.15.146:0/3580859437 conn(0x7f9e240b7b20 msgr2=0x7f9e2415a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.014+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/3580859437 shutdown_connections 2024-09-17T03:33:45.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.014+0000 7f9e2b6f9640 1 -- 172.21.15.146:0/3580859437 wait complete. 2024-09-17T03:33:45.024 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-17T03:33:43.799294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592070,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":60,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":219904,"kb_used_data":3624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754816,"statfs":{"total":773094113280,"available":772868931584,"internally_reserved":0,"allocated":3710976,"data_stored":2107000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1702,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.157405"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.669912+0000","last_change":"2024-09-17T03:33:41.662887+0000","last_active":"2024-09-17T03:33:41.669912+0000","last_peered":"2024-09-17T03:33:41.669912+0000","last_clean":"2024-09-17T03:33:41.669912+0000","last_became_active":"2024-09-17T03:33:41.662600+0000","last_became_peered":"2024-09-17T03:33:41.662600+0000","last_unstale":"2024-09-17T03:33:41.669912+0000","last_undegraded":"2024-09-17T03:33:41.669912+0000","last_fullsized":"2024-09-17T03:33:41.669912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:18.146167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.677678+0000","last_change":"2024-09-17T03:33:41.676205+0000","last_active":"2024-09-17T03:33:41.677678+0000","last_peered":"2024-09-17T03:33:41.677678+0000","last_clean":"2024-09-17T03:33:41.677678+0000","last_became_active":"2024-09-17T03:33:41.675785+0000","last_became_peered":"2024-09-17T03:33:41.675785+0000","last_unstale":"2024-09-17T03:33:41.677678+0000","last_undegraded":"2024-09-17T03:33:41.677678+0000","last_fullsized":"2024-09-17T03:33:41.677678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:22.654084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679864+0000","last_change":"2024-09-17T03:33:41.673177+0000","last_active":"2024-09-17T03:33:41.679864+0000","last_peered":"2024-09-17T03:33:41.679864+0000","last_clean":"2024-09-17T03:33:41.679864+0000","last_became_active":"2024-09-17T03:33:41.671525+0000","last_became_peered":"2024-09-17T03:33:41.671525+0000","last_unstale":"2024-09-17T03:33:41.679864+0000","last_undegraded":"2024-09-17T03:33:41.679864+0000","last_fullsized":"2024-09-17T03:33:41.679864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:27.398745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.686103+0000","last_change":"2024-09-17T03:33:41.683531+0000","last_active":"2024-09-17T03:33:41.686103+0000","last_peered":"2024-09-17T03:33:41.686103+0000","last_clean":"2024-09-17T03:33:41.686103+0000","last_became_active":"2024-09-17T03:33:41.683185+0000","last_became_peered":"2024-09-17T03:33:41.683185+0000","last_unstale":"2024-09-17T03:33:41.686103+0000","last_undegraded":"2024-09-17T03:33:41.686103+0000","last_fullsized":"2024-09-17T03:33:41.686103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:35.674290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679838+0000","last_change":"2024-09-17T03:33:41.669466+0000","last_active":"2024-09-17T03:33:41.679838+0000","last_peered":"2024-09-17T03:33:41.679838+0000","last_clean":"2024-09-17T03:33:41.679838+0000","last_became_active":"2024-09-17T03:33:41.668995+0000","last_became_peered":"2024-09-17T03:33:41.668995+0000","last_unstale":"2024-09-17T03:33:41.679838+0000","last_undegraded":"2024-09-17T03:33:41.679838+0000","last_fullsized":"2024-09-17T03:33:41.679838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:34.559813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.683515+0000","last_change":"2024-09-17T03:33:41.680388+0000","last_active":"2024-09-17T03:33:41.683515+0000","last_peered":"2024-09-17T03:33:41.683515+0000","last_clean":"2024-09-17T03:33:41.683515+0000","last_became_active":"2024-09-17T03:33:41.680067+0000","last_became_peered":"2024-09-17T03:33:41.680067+0000","last_unstale":"2024-09-17T03:33:41.683515+0000","last_undegraded":"2024-09-17T03:33:41.683515+0000","last_fullsized":"2024-09-17T03:33:41.683515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:18.223647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.680007+0000","last_change":"2024-09-17T03:33:41.676041+0000","last_active":"2024-09-17T03:33:41.680007+0000","last_peered":"2024-09-17T03:33:41.680007+0000","last_clean":"2024-09-17T03:33:41.680007+0000","last_became_active":"2024-09-17T03:33:41.675417+0000","last_became_peered":"2024-09-17T03:33:41.675417+0000","last_unstale":"2024-09-17T03:33:41.680007+0000","last_undegraded":"2024-09-17T03:33:41.680007+0000","last_fullsized":"2024-09-17T03:33:41.680007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:41.459158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.671473+0000","last_change":"2024-09-17T03:33:41.667308+0000","last_active":"2024-09-17T03:33:41.671473+0000","last_peered":"2024-09-17T03:33:41.671473+0000","last_clean":"2024-09-17T03:33:41.671473+0000","last_became_active":"2024-09-17T03:33:41.666990+0000","last_became_peered":"2024-09-17T03:33:41.666990+0000","last_unstale":"2024-09-17T03:33:41.671473+0000","last_undegraded":"2024-09-17T03:33:41.671473+0000","last_fullsized":"2024-09-17T03:33:41.671473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:31.926728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675778+0000","last_change":"2024-09-17T03:33:41.672443+0000","last_active":"2024-09-17T03:33:41.675778+0000","last_peered":"2024-09-17T03:33:41.675778+0000","last_clean":"2024-09-17T03:33:41.675778+0000","last_became_active":"2024-09-17T03:33:41.672025+0000","last_became_peered":"2024-09-17T03:33:41.672025+0000","last_unstale":"2024-09-17T03:33:41.675778+0000","last_undegraded":"2024-09-17T03:33:41.675778+0000","last_fullsized":"2024-09-17T03:33:41.675778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:35.234066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679977+0000","last_change":"2024-09-17T03:33:41.675720+0000","last_active":"2024-09-17T03:33:41.679977+0000","last_peered":"2024-09-17T03:33:41.679977+0000","last_clean":"2024-09-17T03:33:41.679977+0000","last_became_active":"2024-09-17T03:33:41.674212+0000","last_became_peered":"2024-09-17T03:33:41.674212+0000","last_unstale":"2024-09-17T03:33:41.679977+0000","last_undegraded":"2024-09-17T03:33:41.679977+0000","last_fullsized":"2024-09-17T03:33:41.679977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:09.047247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.670754+0000","last_change":"2024-09-17T03:33:41.667684+0000","last_active":"2024-09-17T03:33:41.670754+0000","last_peered":"2024-09-17T03:33:41.670754+0000","last_clean":"2024-09-17T03:33:41.670754+0000","last_became_active":"2024-09-17T03:33:41.667362+0000","last_became_peered":"2024-09-17T03:33:41.667362+0000","last_unstale":"2024-09-17T03:33:41.670754+0000","last_undegraded":"2024-09-17T03:33:41.670754+0000","last_fullsized":"2024-09-17T03:33:41.670754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:04.350237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687457+0000","last_change":"2024-09-17T03:33:40.670251+0000","last_active":"2024-09-17T03:33:41.687457+0000","last_peered":"2024-09-17T03:33:41.687457+0000","last_clean":"2024-09-17T03:33:41.687457+0000","last_became_active":"2024-09-17T03:33:40.669956+0000","last_became_peered":"2024-09-17T03:33:40.669956+0000","last_unstale":"2024-09-17T03:33:41.687457+0000","last_undegraded":"2024-09-17T03:33:41.687457+0000","last_fullsized":"2024-09-17T03:33:41.687457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:04.466425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.676297+0000","last_change":"2024-09-17T03:33:41.673601+0000","last_active":"2024-09-17T03:33:41.676297+0000","last_peered":"2024-09-17T03:33:41.676297+0000","last_clean":"2024-09-17T03:33:41.676297+0000","last_became_active":"2024-09-17T03:33:41.673307+0000","last_became_peered":"2024-09-17T03:33:41.673307+0000","last_unstale":"2024-09-17T03:33:41.676297+0000","last_undegraded":"2024-09-17T03:33:41.676297+0000","last_fullsized":"2024-09-17T03:33:41.676297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:30.683645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.655398+0000","last_change":"2024-09-17T03:33:40.668613+0000","last_active":"2024-09-17T03:33:41.655398+0000","last_peered":"2024-09-17T03:33:41.655398+0000","last_clean":"2024-09-17T03:33:41.655398+0000","last_became_active":"2024-09-17T03:33:40.668131+0000","last_became_peered":"2024-09-17T03:33:40.668131+0000","last_unstale":"2024-09-17T03:33:41.655398+0000","last_undegraded":"2024-09-17T03:33:41.655398+0000","last_fullsized":"2024-09-17T03:33:41.655398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:05.271520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675785+0000","last_change":"2024-09-17T03:33:41.672818+0000","last_active":"2024-09-17T03:33:41.675785+0000","last_peered":"2024-09-17T03:33:41.675785+0000","last_clean":"2024-09-17T03:33:41.675785+0000","last_became_active":"2024-09-17T03:33:41.672405+0000","last_became_peered":"2024-09-17T03:33:41.672405+0000","last_unstale":"2024-09-17T03:33:41.675785+0000","last_undegraded":"2024-09-17T03:33:41.675785+0000","last_fullsized":"2024-09-17T03:33:41.675785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:04.973538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.657879+0000","last_change":"2024-09-17T03:33:40.671952+0000","last_active":"2024-09-17T03:33:41.657879+0000","last_peered":"2024-09-17T03:33:41.657879+0000","last_clean":"2024-09-17T03:33:41.657879+0000","last_became_active":"2024-09-17T03:33:40.671688+0000","last_became_peered":"2024-09-17T03:33:40.671688+0000","last_unstale":"2024-09-17T03:33:41.657879+0000","last_undegraded":"2024-09-17T03:33:41.657879+0000","last_fullsized":"2024-09-17T03:33:41.657879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:41.813739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.680053+0000","last_change":"2024-09-17T03:33:41.673698+0000","last_active":"2024-09-17T03:33:41.680053+0000","last_peered":"2024-09-17T03:33:41.680053+0000","last_clean":"2024-09-17T03:33:41.680053+0000","last_became_active":"2024-09-17T03:33:41.673373+0000","last_became_peered":"2024-09-17T03:33:41.673373+0000","last_unstale":"2024-09-17T03:33:41.680053+0000","last_undegraded":"2024-09-17T03:33:41.680053+0000","last_fullsized":"2024-09-17T03:33:41.680053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:22.366281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687146+0000","last_change":"2024-09-17T03:33:41.681730+0000","last_active":"2024-09-17T03:33:41.687146+0000","last_peered":"2024-09-17T03:33:41.687146+0000","last_clean":"2024-09-17T03:33:41.687146+0000","last_became_active":"2024-09-17T03:33:41.678867+0000","last_became_peered":"2024-09-17T03:33:41.678867+0000","last_unstale":"2024-09-17T03:33:41.687146+0000","last_undegraded":"2024-09-17T03:33:41.687146+0000","last_fullsized":"2024-09-17T03:33:41.687146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:30.928493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.682018+0000","last_change":"2024-09-17T03:33:40.667467+0000","last_active":"2024-09-17T03:33:41.682018+0000","last_peered":"2024-09-17T03:33:41.682018+0000","last_clean":"2024-09-17T03:33:41.682018+0000","last_became_active":"2024-09-17T03:33:40.667051+0000","last_became_peered":"2024-09-17T03:33:40.667051+0000","last_unstale":"2024-09-17T03:33:41.682018+0000","last_undegraded":"2024-09-17T03:33:41.682018+0000","last_fullsized":"2024-09-17T03:33:41.682018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:01.755385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679898+0000","last_change":"2024-09-17T03:33:41.676992+0000","last_active":"2024-09-17T03:33:41.679898+0000","last_peered":"2024-09-17T03:33:41.679898+0000","last_clean":"2024-09-17T03:33:41.679898+0000","last_became_active":"2024-09-17T03:33:41.676639+0000","last_became_peered":"2024-09-17T03:33:41.676639+0000","last_unstale":"2024-09-17T03:33:41.679898+0000","last_undegraded":"2024-09-17T03:33:41.679898+0000","last_fullsized":"2024-09-17T03:33:41.679898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:04.225065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.692710+0000","last_change":"2024-09-17T03:33:40.670776+0000","last_active":"2024-09-17T03:33:41.692710+0000","last_peered":"2024-09-17T03:33:41.692710+0000","last_clean":"2024-09-17T03:33:41.692710+0000","last_became_active":"2024-09-17T03:33:40.670019+0000","last_became_peered":"2024-09-17T03:33:40.670019+0000","last_unstale":"2024-09-17T03:33:41.692710+0000","last_undegraded":"2024-09-17T03:33:41.692710+0000","last_fullsized":"2024-09-17T03:33:41.692710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:22.598820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.669867+0000","last_change":"2024-09-17T03:33:41.662805+0000","last_active":"2024-09-17T03:33:41.669867+0000","last_peered":"2024-09-17T03:33:41.669867+0000","last_clean":"2024-09-17T03:33:41.669867+0000","last_became_active":"2024-09-17T03:33:41.662456+0000","last_became_peered":"2024-09-17T03:33:41.662456+0000","last_unstale":"2024-09-17T03:33:41.669867+0000","last_undegraded":"2024-09-17T03:33:41.669867+0000","last_fullsized":"2024-09-17T03:33:41.669867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:28.588107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.655667+0000","last_change":"2024-09-17T03:33:40.672072+0000","last_active":"2024-09-17T03:33:41.655667+0000","last_peered":"2024-09-17T03:33:41.655667+0000","last_clean":"2024-09-17T03:33:41.655667+0000","last_became_active":"2024-09-17T03:33:40.671735+0000","last_became_peered":"2024-09-17T03:33:40.671735+0000","last_unstale":"2024-09-17T03:33:41.655667+0000","last_undegraded":"2024-09-17T03:33:41.655667+0000","last_fullsized":"2024-09-17T03:33:41.655667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:23.354684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.690118+0000","last_change":"2024-09-17T03:33:40.670623+0000","last_active":"2024-09-17T03:33:41.690118+0000","last_peered":"2024-09-17T03:33:41.690118+0000","last_clean":"2024-09-17T03:33:41.690118+0000","last_became_active":"2024-09-17T03:33:40.670144+0000","last_became_peered":"2024-09-17T03:33:40.670144+0000","last_unstale":"2024-09-17T03:33:41.690118+0000","last_undegraded":"2024-09-17T03:33:41.690118+0000","last_fullsized":"2024-09-17T03:33:41.690118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:29.403504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675863+0000","last_change":"2024-09-17T03:33:41.672981+0000","last_active":"2024-09-17T03:33:41.675863+0000","last_peered":"2024-09-17T03:33:41.675863+0000","last_clean":"2024-09-17T03:33:41.675863+0000","last_became_active":"2024-09-17T03:33:41.672258+0000","last_became_peered":"2024-09-17T03:33:41.672258+0000","last_unstale":"2024-09-17T03:33:41.675863+0000","last_undegraded":"2024-09-17T03:33:41.675863+0000","last_fullsized":"2024-09-17T03:33:41.675863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:05.695841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.665126+0000","last_change":"2024-09-17T03:33:40.669866+0000","last_active":"2024-09-17T03:33:41.665126+0000","last_peered":"2024-09-17T03:33:41.665126+0000","last_clean":"2024-09-17T03:33:41.665126+0000","last_became_active":"2024-09-17T03:33:40.669549+0000","last_became_peered":"2024-09-17T03:33:40.669549+0000","last_unstale":"2024-09-17T03:33:41.665126+0000","last_undegraded":"2024-09-17T03:33:41.665126+0000","last_fullsized":"2024-09-17T03:33:41.665126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:57.788845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.682928+0000","last_change":"2024-09-17T03:33:41.679445+0000","last_active":"2024-09-17T03:33:41.682928+0000","last_peered":"2024-09-17T03:33:41.682928+0000","last_clean":"2024-09-17T03:33:41.682928+0000","last_became_active":"2024-09-17T03:33:41.679125+0000","last_became_peered":"2024-09-17T03:33:41.679125+0000","last_unstale":"2024-09-17T03:33:41.682928+0000","last_undegraded":"2024-09-17T03:33:41.682928+0000","last_fullsized":"2024-09-17T03:33:41.682928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:55.146128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687271+0000","last_change":"2024-09-17T03:33:41.682134+0000","last_active":"2024-09-17T03:33:41.687271+0000","last_peered":"2024-09-17T03:33:41.687271+0000","last_clean":"2024-09-17T03:33:41.687271+0000","last_became_active":"2024-09-17T03:33:41.681496+0000","last_became_peered":"2024-09-17T03:33:41.681496+0000","last_unstale":"2024-09-17T03:33:41.687271+0000","last_undegraded":"2024-09-17T03:33:41.687271+0000","last_fullsized":"2024-09-17T03:33:41.687271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:16.460288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.656496+0000","last_change":"2024-09-17T03:33:40.670191+0000","last_active":"2024-09-17T03:33:41.656496+0000","last_peered":"2024-09-17T03:33:41.656496+0000","last_clean":"2024-09-17T03:33:41.656496+0000","last_became_active":"2024-09-17T03:33:40.669759+0000","last_became_peered":"2024-09-17T03:33:40.669759+0000","last_unstale":"2024-09-17T03:33:41.656496+0000","last_undegraded":"2024-09-17T03:33:41.656496+0000","last_fullsized":"2024-09-17T03:33:41.656496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:48.218566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T03:33:36.064143+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:33:36.064143+0000","last_peered":"2024-09-17T03:33:36.064143+0000","last_clean":"2024-09-17T03:33:36.064143+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:33:36.064143+0000","last_undegraded":"2024-09-17T03:33:36.064143+0000","last_fullsized":"2024-09-17T03:33:36.064143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1702,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":18,"acting":18,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":897024,"data_stored":701148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":897024,"data_stored":701148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":130311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":131273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:45.027 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:45.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.177+0000 7f457aebd640 1 -- 172.21.15.146:0/429109626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45740b3870 msgr2=0x7f45740cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.177+0000 7f457aebd640 1 --2- 172.21.15.146:0/429109626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45740b3870 0x7f45740cf370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f45740b3790 tx=0x7f456402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.177+0000 7f457aebd640 1 -- 172.21.15.146:0/429109626 shutdown_connections 2024-09-17T03:33:45.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.177+0000 7f457aebd640 1 --2- 172.21.15.146:0/429109626 >> v2:172.21.15.179:3300/0 conn(0x7f457406f440 0x7f45740d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.177+0000 7f457aebd640 1 --2- 172.21.15.146:0/429109626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45740b3870 0x7f45740cf370 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.177+0000 7f457aebd640 1 -- 172.21.15.146:0/429109626 >> 172.21.15.146:0/429109626 conn(0x7f45740d4be0 msgr2=0x7f45740d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:45.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.177+0000 7f457aebd640 1 -- 172.21.15.146:0/429109626 shutdown_connections 2024-09-17T03:33:45.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.177+0000 7f457aebd640 1 -- 172.21.15.146:0/429109626 wait complete. 2024-09-17T03:33:45.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.179+0000 7f457aebd640 1 Processor -- start 2024-09-17T03:33:45.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.179+0000 7f457aebd640 1 -- start start 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.180+0000 7f457aebd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45740b3870 0x7f45740ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.180+0000 7f457aebd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45741620f0 0x7f4574159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.180+0000 7f457aebd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45740b6360 0x7f45740b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.180+0000 7f457aebd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f45740d3a60 con 0x7f45741620f0 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.180+0000 7f457aebd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f45740d38e0 con 0x7f45740b3870 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.180+0000 7f457aebd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f45740d3be0 con 0x7f45740b6360 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f4573fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45741620f0 0x7f4574159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f4573fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45741620f0 0x7f4574159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52474/0 (socket says 172.21.15.146:52474) 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f4573fff640 1 -- 172.21.15.146:0/3124835432 learned_addr learned my addr 172.21.15.146:0/3124835432 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f4578c59640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45740b3870 0x7f45740ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f457945a640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45740b6360 0x7f45740b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f4573fff640 1 -- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45740b6360 msgr2=0x7f45740b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f4573fff640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45740b6360 0x7f45740b6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f4573fff640 1 -- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45740b3870 msgr2=0x7f45740ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f4573fff640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45740b3870 0x7f45740ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f4573fff640 1 -- 172.21.15.146:0/3124835432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45740b6cb0 con 0x7f45741620f0 2024-09-17T03:33:45.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f4573fff640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45741620f0 0x7f4574159890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f456800ba50 tx=0x7f456800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:45.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f45717fa640 1 -- 172.21.15.146:0/3124835432 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568019070 con 0x7f45741620f0 2024-09-17T03:33:45.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f45717fa640 1 -- 172.21.15.146:0/3124835432 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f456800cd00 con 0x7f45741620f0 2024-09-17T03:33:45.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f457aebd640 1 -- 172.21.15.146:0/3124835432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45740c90c0 con 0x7f45741620f0 2024-09-17T03:33:45.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f45717fa640 1 -- 172.21.15.146:0/3124835432 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45680146a0 con 0x7f45741620f0 2024-09-17T03:33:45.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.181+0000 7f457aebd640 1 -- 172.21.15.146:0/3124835432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45740ceb00 con 0x7f45741620f0 2024-09-17T03:33:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.182+0000 7f457aebd640 1 -- 172.21.15.146:0/3124835432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45740cf370 con 0x7f45741620f0 2024-09-17T03:33:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.183+0000 7f45717fa640 1 -- 172.21.15.146:0/3124835432 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f456801c070 con 0x7f45741620f0 2024-09-17T03:33:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.183+0000 7f45717fa640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4560078b90 0x7f456007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.184+0000 7f45717fa640 1 -- 172.21.15.146:0/3124835432 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f456809abd0 con 0x7f45741620f0 2024-09-17T03:33:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.184+0000 7f4578c59640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4560078b90 0x7f456007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.184+0000 7f4578c59640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4560078b90 0x7f456007b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4564033000 tx=0x7f4564004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.188+0000 7f45717fa640 1 -- 172.21.15.146:0/3124835432 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f45740b6cb0 con 0x7f45741620f0 2024-09-17T03:33:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.360+0000 7f457aebd640 1 -- 172.21.15.146:0/3124835432 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45740d2bd0 con 0x7f4560078b90 2024-09-17T03:33:45.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.364+0000 7f45717fa640 1 -- 172.21.15.146:0/3124835432 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241477 (secure 0 0 0) 0x7f45740d2bd0 con 0x7f4560078b90 2024-09-17T03:33:45.366 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 -- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4560078b90 msgr2=0x7f456007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4560078b90 0x7f456007b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4564033000 tx=0x7f4564004730 comp rx=0 tx=0).stop 2024-09-17T03:33:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 -- 172.21.15.146:0/3124835432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45741620f0 msgr2=0x7f4574159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45741620f0 0x7f4574159890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f456800ba50 tx=0x7f456800bf10 comp rx=0 tx=0).stop 2024-09-17T03:33:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 -- 172.21.15.146:0/3124835432 shutdown_connections 2024-09-17T03:33:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4560078b90 0x7f456007b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45740b6360 0x7f45740b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45741620f0 0x7f4574159890 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 --2- 172.21.15.146:0/3124835432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45740b3870 0x7f45740ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 -- 172.21.15.146:0/3124835432 >> 172.21.15.146:0/3124835432 conn(0x7f45740d4be0 msgr2=0x7f45740b89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 -- 172.21.15.146:0/3124835432 shutdown_connections 2024-09-17T03:33:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.368+0000 7f457aebd640 1 -- 172.21.15.146:0/3124835432 wait complete. 2024-09-17T03:33:45.378 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-17T03:33:43.799294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592070,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":126,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":60,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":219904,"kb_used_data":3624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754816,"statfs":{"total":773094113280,"available":772868931584,"internally_reserved":0,"allocated":3710976,"data_stored":2107000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1702,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.157405"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.669912+0000","last_change":"2024-09-17T03:33:41.662887+0000","last_active":"2024-09-17T03:33:41.669912+0000","last_peered":"2024-09-17T03:33:41.669912+0000","last_clean":"2024-09-17T03:33:41.669912+0000","last_became_active":"2024-09-17T03:33:41.662600+0000","last_became_peered":"2024-09-17T03:33:41.662600+0000","last_unstale":"2024-09-17T03:33:41.669912+0000","last_undegraded":"2024-09-17T03:33:41.669912+0000","last_fullsized":"2024-09-17T03:33:41.669912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:18.146167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.677678+0000","last_change":"2024-09-17T03:33:41.676205+0000","last_active":"2024-09-17T03:33:41.677678+0000","last_peered":"2024-09-17T03:33:41.677678+0000","last_clean":"2024-09-17T03:33:41.677678+0000","last_became_active":"2024-09-17T03:33:41.675785+0000","last_became_peered":"2024-09-17T03:33:41.675785+0000","last_unstale":"2024-09-17T03:33:41.677678+0000","last_undegraded":"2024-09-17T03:33:41.677678+0000","last_fullsized":"2024-09-17T03:33:41.677678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:22.654084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679864+0000","last_change":"2024-09-17T03:33:41.673177+0000","last_active":"2024-09-17T03:33:41.679864+0000","last_peered":"2024-09-17T03:33:41.679864+0000","last_clean":"2024-09-17T03:33:41.679864+0000","last_became_active":"2024-09-17T03:33:41.671525+0000","last_became_peered":"2024-09-17T03:33:41.671525+0000","last_unstale":"2024-09-17T03:33:41.679864+0000","last_undegraded":"2024-09-17T03:33:41.679864+0000","last_fullsized":"2024-09-17T03:33:41.679864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:27.398745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.686103+0000","last_change":"2024-09-17T03:33:41.683531+0000","last_active":"2024-09-17T03:33:41.686103+0000","last_peered":"2024-09-17T03:33:41.686103+0000","last_clean":"2024-09-17T03:33:41.686103+0000","last_became_active":"2024-09-17T03:33:41.683185+0000","last_became_peered":"2024-09-17T03:33:41.683185+0000","last_unstale":"2024-09-17T03:33:41.686103+0000","last_undegraded":"2024-09-17T03:33:41.686103+0000","last_fullsized":"2024-09-17T03:33:41.686103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:35.674290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679838+0000","last_change":"2024-09-17T03:33:41.669466+0000","last_active":"2024-09-17T03:33:41.679838+0000","last_peered":"2024-09-17T03:33:41.679838+0000","last_clean":"2024-09-17T03:33:41.679838+0000","last_became_active":"2024-09-17T03:33:41.668995+0000","last_became_peered":"2024-09-17T03:33:41.668995+0000","last_unstale":"2024-09-17T03:33:41.679838+0000","last_undegraded":"2024-09-17T03:33:41.679838+0000","last_fullsized":"2024-09-17T03:33:41.679838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:34.559813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.683515+0000","last_change":"2024-09-17T03:33:41.680388+0000","last_active":"2024-09-17T03:33:41.683515+0000","last_peered":"2024-09-17T03:33:41.683515+0000","last_clean":"2024-09-17T03:33:41.683515+0000","last_became_active":"2024-09-17T03:33:41.680067+0000","last_became_peered":"2024-09-17T03:33:41.680067+0000","last_unstale":"2024-09-17T03:33:41.683515+0000","last_undegraded":"2024-09-17T03:33:41.683515+0000","last_fullsized":"2024-09-17T03:33:41.683515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:18.223647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.680007+0000","last_change":"2024-09-17T03:33:41.676041+0000","last_active":"2024-09-17T03:33:41.680007+0000","last_peered":"2024-09-17T03:33:41.680007+0000","last_clean":"2024-09-17T03:33:41.680007+0000","last_became_active":"2024-09-17T03:33:41.675417+0000","last_became_peered":"2024-09-17T03:33:41.675417+0000","last_unstale":"2024-09-17T03:33:41.680007+0000","last_undegraded":"2024-09-17T03:33:41.680007+0000","last_fullsized":"2024-09-17T03:33:41.680007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:41.459158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.671473+0000","last_change":"2024-09-17T03:33:41.667308+0000","last_active":"2024-09-17T03:33:41.671473+0000","last_peered":"2024-09-17T03:33:41.671473+0000","last_clean":"2024-09-17T03:33:41.671473+0000","last_became_active":"2024-09-17T03:33:41.666990+0000","last_became_peered":"2024-09-17T03:33:41.666990+0000","last_unstale":"2024-09-17T03:33:41.671473+0000","last_undegraded":"2024-09-17T03:33:41.671473+0000","last_fullsized":"2024-09-17T03:33:41.671473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:31.926728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675778+0000","last_change":"2024-09-17T03:33:41.672443+0000","last_active":"2024-09-17T03:33:41.675778+0000","last_peered":"2024-09-17T03:33:41.675778+0000","last_clean":"2024-09-17T03:33:41.675778+0000","last_became_active":"2024-09-17T03:33:41.672025+0000","last_became_peered":"2024-09-17T03:33:41.672025+0000","last_unstale":"2024-09-17T03:33:41.675778+0000","last_undegraded":"2024-09-17T03:33:41.675778+0000","last_fullsized":"2024-09-17T03:33:41.675778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:35.234066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679977+0000","last_change":"2024-09-17T03:33:41.675720+0000","last_active":"2024-09-17T03:33:41.679977+0000","last_peered":"2024-09-17T03:33:41.679977+0000","last_clean":"2024-09-17T03:33:41.679977+0000","last_became_active":"2024-09-17T03:33:41.674212+0000","last_became_peered":"2024-09-17T03:33:41.674212+0000","last_unstale":"2024-09-17T03:33:41.679977+0000","last_undegraded":"2024-09-17T03:33:41.679977+0000","last_fullsized":"2024-09-17T03:33:41.679977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:09.047247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.670754+0000","last_change":"2024-09-17T03:33:41.667684+0000","last_active":"2024-09-17T03:33:41.670754+0000","last_peered":"2024-09-17T03:33:41.670754+0000","last_clean":"2024-09-17T03:33:41.670754+0000","last_became_active":"2024-09-17T03:33:41.667362+0000","last_became_peered":"2024-09-17T03:33:41.667362+0000","last_unstale":"2024-09-17T03:33:41.670754+0000","last_undegraded":"2024-09-17T03:33:41.670754+0000","last_fullsized":"2024-09-17T03:33:41.670754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:04.350237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687457+0000","last_change":"2024-09-17T03:33:40.670251+0000","last_active":"2024-09-17T03:33:41.687457+0000","last_peered":"2024-09-17T03:33:41.687457+0000","last_clean":"2024-09-17T03:33:41.687457+0000","last_became_active":"2024-09-17T03:33:40.669956+0000","last_became_peered":"2024-09-17T03:33:40.669956+0000","last_unstale":"2024-09-17T03:33:41.687457+0000","last_undegraded":"2024-09-17T03:33:41.687457+0000","last_fullsized":"2024-09-17T03:33:41.687457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:04.466425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.676297+0000","last_change":"2024-09-17T03:33:41.673601+0000","last_active":"2024-09-17T03:33:41.676297+0000","last_peered":"2024-09-17T03:33:41.676297+0000","last_clean":"2024-09-17T03:33:41.676297+0000","last_became_active":"2024-09-17T03:33:41.673307+0000","last_became_peered":"2024-09-17T03:33:41.673307+0000","last_unstale":"2024-09-17T03:33:41.676297+0000","last_undegraded":"2024-09-17T03:33:41.676297+0000","last_fullsized":"2024-09-17T03:33:41.676297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:30.683645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.655398+0000","last_change":"2024-09-17T03:33:40.668613+0000","last_active":"2024-09-17T03:33:41.655398+0000","last_peered":"2024-09-17T03:33:41.655398+0000","last_clean":"2024-09-17T03:33:41.655398+0000","last_became_active":"2024-09-17T03:33:40.668131+0000","last_became_peered":"2024-09-17T03:33:40.668131+0000","last_unstale":"2024-09-17T03:33:41.655398+0000","last_undegraded":"2024-09-17T03:33:41.655398+0000","last_fullsized":"2024-09-17T03:33:41.655398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:05.271520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675785+0000","last_change":"2024-09-17T03:33:41.672818+0000","last_active":"2024-09-17T03:33:41.675785+0000","last_peered":"2024-09-17T03:33:41.675785+0000","last_clean":"2024-09-17T03:33:41.675785+0000","last_became_active":"2024-09-17T03:33:41.672405+0000","last_became_peered":"2024-09-17T03:33:41.672405+0000","last_unstale":"2024-09-17T03:33:41.675785+0000","last_undegraded":"2024-09-17T03:33:41.675785+0000","last_fullsized":"2024-09-17T03:33:41.675785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:04.973538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.657879+0000","last_change":"2024-09-17T03:33:40.671952+0000","last_active":"2024-09-17T03:33:41.657879+0000","last_peered":"2024-09-17T03:33:41.657879+0000","last_clean":"2024-09-17T03:33:41.657879+0000","last_became_active":"2024-09-17T03:33:40.671688+0000","last_became_peered":"2024-09-17T03:33:40.671688+0000","last_unstale":"2024-09-17T03:33:41.657879+0000","last_undegraded":"2024-09-17T03:33:41.657879+0000","last_fullsized":"2024-09-17T03:33:41.657879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:41.813739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.680053+0000","last_change":"2024-09-17T03:33:41.673698+0000","last_active":"2024-09-17T03:33:41.680053+0000","last_peered":"2024-09-17T03:33:41.680053+0000","last_clean":"2024-09-17T03:33:41.680053+0000","last_became_active":"2024-09-17T03:33:41.673373+0000","last_became_peered":"2024-09-17T03:33:41.673373+0000","last_unstale":"2024-09-17T03:33:41.680053+0000","last_undegraded":"2024-09-17T03:33:41.680053+0000","last_fullsized":"2024-09-17T03:33:41.680053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:22.366281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687146+0000","last_change":"2024-09-17T03:33:41.681730+0000","last_active":"2024-09-17T03:33:41.687146+0000","last_peered":"2024-09-17T03:33:41.687146+0000","last_clean":"2024-09-17T03:33:41.687146+0000","last_became_active":"2024-09-17T03:33:41.678867+0000","last_became_peered":"2024-09-17T03:33:41.678867+0000","last_unstale":"2024-09-17T03:33:41.687146+0000","last_undegraded":"2024-09-17T03:33:41.687146+0000","last_fullsized":"2024-09-17T03:33:41.687146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:30.928493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.682018+0000","last_change":"2024-09-17T03:33:40.667467+0000","last_active":"2024-09-17T03:33:41.682018+0000","last_peered":"2024-09-17T03:33:41.682018+0000","last_clean":"2024-09-17T03:33:41.682018+0000","last_became_active":"2024-09-17T03:33:40.667051+0000","last_became_peered":"2024-09-17T03:33:40.667051+0000","last_unstale":"2024-09-17T03:33:41.682018+0000","last_undegraded":"2024-09-17T03:33:41.682018+0000","last_fullsized":"2024-09-17T03:33:41.682018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:01.755385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679898+0000","last_change":"2024-09-17T03:33:41.676992+0000","last_active":"2024-09-17T03:33:41.679898+0000","last_peered":"2024-09-17T03:33:41.679898+0000","last_clean":"2024-09-17T03:33:41.679898+0000","last_became_active":"2024-09-17T03:33:41.676639+0000","last_became_peered":"2024-09-17T03:33:41.676639+0000","last_unstale":"2024-09-17T03:33:41.679898+0000","last_undegraded":"2024-09-17T03:33:41.679898+0000","last_fullsized":"2024-09-17T03:33:41.679898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:04.225065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.692710+0000","last_change":"2024-09-17T03:33:40.670776+0000","last_active":"2024-09-17T03:33:41.692710+0000","last_peered":"2024-09-17T03:33:41.692710+0000","last_clean":"2024-09-17T03:33:41.692710+0000","last_became_active":"2024-09-17T03:33:40.670019+0000","last_became_peered":"2024-09-17T03:33:40.670019+0000","last_unstale":"2024-09-17T03:33:41.692710+0000","last_undegraded":"2024-09-17T03:33:41.692710+0000","last_fullsized":"2024-09-17T03:33:41.692710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:22.598820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.669867+0000","last_change":"2024-09-17T03:33:41.662805+0000","last_active":"2024-09-17T03:33:41.669867+0000","last_peered":"2024-09-17T03:33:41.669867+0000","last_clean":"2024-09-17T03:33:41.669867+0000","last_became_active":"2024-09-17T03:33:41.662456+0000","last_became_peered":"2024-09-17T03:33:41.662456+0000","last_unstale":"2024-09-17T03:33:41.669867+0000","last_undegraded":"2024-09-17T03:33:41.669867+0000","last_fullsized":"2024-09-17T03:33:41.669867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:28.588107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.655667+0000","last_change":"2024-09-17T03:33:40.672072+0000","last_active":"2024-09-17T03:33:41.655667+0000","last_peered":"2024-09-17T03:33:41.655667+0000","last_clean":"2024-09-17T03:33:41.655667+0000","last_became_active":"2024-09-17T03:33:40.671735+0000","last_became_peered":"2024-09-17T03:33:40.671735+0000","last_unstale":"2024-09-17T03:33:41.655667+0000","last_undegraded":"2024-09-17T03:33:41.655667+0000","last_fullsized":"2024-09-17T03:33:41.655667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:23.354684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.690118+0000","last_change":"2024-09-17T03:33:40.670623+0000","last_active":"2024-09-17T03:33:41.690118+0000","last_peered":"2024-09-17T03:33:41.690118+0000","last_clean":"2024-09-17T03:33:41.690118+0000","last_became_active":"2024-09-17T03:33:40.670144+0000","last_became_peered":"2024-09-17T03:33:40.670144+0000","last_unstale":"2024-09-17T03:33:41.690118+0000","last_undegraded":"2024-09-17T03:33:41.690118+0000","last_fullsized":"2024-09-17T03:33:41.690118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:29.403504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675863+0000","last_change":"2024-09-17T03:33:41.672981+0000","last_active":"2024-09-17T03:33:41.675863+0000","last_peered":"2024-09-17T03:33:41.675863+0000","last_clean":"2024-09-17T03:33:41.675863+0000","last_became_active":"2024-09-17T03:33:41.672258+0000","last_became_peered":"2024-09-17T03:33:41.672258+0000","last_unstale":"2024-09-17T03:33:41.675863+0000","last_undegraded":"2024-09-17T03:33:41.675863+0000","last_fullsized":"2024-09-17T03:33:41.675863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:05.695841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.665126+0000","last_change":"2024-09-17T03:33:40.669866+0000","last_active":"2024-09-17T03:33:41.665126+0000","last_peered":"2024-09-17T03:33:41.665126+0000","last_clean":"2024-09-17T03:33:41.665126+0000","last_became_active":"2024-09-17T03:33:40.669549+0000","last_became_peered":"2024-09-17T03:33:40.669549+0000","last_unstale":"2024-09-17T03:33:41.665126+0000","last_undegraded":"2024-09-17T03:33:41.665126+0000","last_fullsized":"2024-09-17T03:33:41.665126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:57.788845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.682928+0000","last_change":"2024-09-17T03:33:41.679445+0000","last_active":"2024-09-17T03:33:41.682928+0000","last_peered":"2024-09-17T03:33:41.682928+0000","last_clean":"2024-09-17T03:33:41.682928+0000","last_became_active":"2024-09-17T03:33:41.679125+0000","last_became_peered":"2024-09-17T03:33:41.679125+0000","last_unstale":"2024-09-17T03:33:41.682928+0000","last_undegraded":"2024-09-17T03:33:41.682928+0000","last_fullsized":"2024-09-17T03:33:41.682928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:55.146128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687271+0000","last_change":"2024-09-17T03:33:41.682134+0000","last_active":"2024-09-17T03:33:41.687271+0000","last_peered":"2024-09-17T03:33:41.687271+0000","last_clean":"2024-09-17T03:33:41.687271+0000","last_became_active":"2024-09-17T03:33:41.681496+0000","last_became_peered":"2024-09-17T03:33:41.681496+0000","last_unstale":"2024-09-17T03:33:41.687271+0000","last_undegraded":"2024-09-17T03:33:41.687271+0000","last_fullsized":"2024-09-17T03:33:41.687271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:16.460288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.656496+0000","last_change":"2024-09-17T03:33:40.670191+0000","last_active":"2024-09-17T03:33:41.656496+0000","last_peered":"2024-09-17T03:33:41.656496+0000","last_clean":"2024-09-17T03:33:41.656496+0000","last_became_active":"2024-09-17T03:33:40.669759+0000","last_became_peered":"2024-09-17T03:33:40.669759+0000","last_unstale":"2024-09-17T03:33:41.656496+0000","last_undegraded":"2024-09-17T03:33:41.656496+0000","last_fullsized":"2024-09-17T03:33:41.656496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:48.218566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:40.640619+0000","last_change":"2024-09-17T03:33:40.640619+0000","last_active":"2024-09-17T03:33:40.640619+0000","last_peered":"2024-09-17T03:33:40.640619+0000","last_clean":"2024-09-17T03:33:40.640619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:40.640619+0000","last_undegraded":"2024-09-17T03:33:40.640619+0000","last_fullsized":"2024-09-17T03:33:40.640619+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:33:39.638407+0000","last_change":"2024-09-17T03:33:39.638407+0000","last_active":"2024-09-17T03:33:39.638407+0000","last_peered":"2024-09-17T03:33:39.638407+0000","last_clean":"2024-09-17T03:33:39.638407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:33:39.638407+0000","last_undegraded":"2024-09-17T03:33:39.638407+0000","last_fullsized":"2024-09-17T03:33:39.638407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T03:33:36.064143+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:33:36.064143+0000","last_peered":"2024-09-17T03:33:36.064143+0000","last_clean":"2024-09-17T03:33:36.064143+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:33:36.064143+0000","last_undegraded":"2024-09-17T03:33:36.064143+0000","last_fullsized":"2024-09-17T03:33:36.064143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1702,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":18,"acting":18,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":897024,"data_stored":701148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":897024,"data_stored":701148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":130311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":131273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:45.381 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-17T03:33:45.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.381 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-17T03:33:45.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.381 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-17T03:33:45.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-17T03:33:45.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-17T03:33:45.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-17T03:33:45.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-17T03:33:45.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-17T03:33:45.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-17T03:33:45.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.388 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.389 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.390 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-17T03:33:45.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.392 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-17T03:33:45.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:40.640619+0000', 'last_change': '2024-09-17T03:33:40.640619+0000', 'last_active': '2024-09-17T03:33:40.640619+0000', 'last_peered': '2024-09-17T03:33:40.640619+0000', 'last_clean': '2024-09-17T03:33:40.640619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:40.640619+0000', 'last_undegraded': '2024-09-17T03:33:40.640619+0000', 'last_fullsized': '2024-09-17T03:33:40.640619+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:40.640619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.392 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-17T03:33:45.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:33:39.638407+0000', 'last_change': '2024-09-17T03:33:39.638407+0000', 'last_active': '2024-09-17T03:33:39.638407+0000', 'last_peered': '2024-09-17T03:33:39.638407+0000', 'last_clean': '2024-09-17T03:33:39.638407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:33:39.638407+0000', 'last_undegraded': '2024-09-17T03:33:39.638407+0000', 'last_fullsized': '2024-09-17T03:33:39.638407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'last_clean_scrub_stamp': '2024-09-17T03:33:39.638407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:33:45.392 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:33:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.531+0000 7fa20ee27640 1 -- 172.21.15.146:0/1572182856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2080701e0 msgr2=0x7fa2080cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.531+0000 7fa20ee27640 1 --2- 172.21.15.146:0/1572182856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2080701e0 0x7fa2080cfea0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa2080726f0 tx=0x7fa20002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.531+0000 7fa20ee27640 1 -- 172.21.15.146:0/1572182856 shutdown_connections 2024-09-17T03:33:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.531+0000 7fa20ee27640 1 --2- 172.21.15.146:0/1572182856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2080701e0 0x7fa2080cfea0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.531+0000 7fa20ee27640 1 --2- 172.21.15.146:0/1572182856 >> v2:172.21.15.179:3300/0 conn(0x7fa20815c9f0 0x7fa2081526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.531+0000 7fa20ee27640 1 -- 172.21.15.146:0/1572182856 >> 172.21.15.146:0/1572182856 conn(0x7fa20806d3c0 msgr2=0x7fa2080b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.531+0000 7fa20ee27640 1 -- 172.21.15.146:0/1572182856 shutdown_connections 2024-09-17T03:33:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.531+0000 7fa20ee27640 1 -- 172.21.15.146:0/1572182856 wait complete. 2024-09-17T03:33:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.533+0000 7fa20ee27640 1 Processor -- start 2024-09-17T03:33:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.533+0000 7fa20ee27640 1 -- start start 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.534+0000 7fa20ee27640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2080b4100 0x7fa2081f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.534+0000 7fa20ee27640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa20815ad70 0x7fa20806e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.534+0000 7fa20ee27640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa20815b180 0x7fa20806ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.534+0000 7fa20ee27640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa2080d0770 con 0x7fa20815ad70 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.534+0000 7fa20ee27640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa2080d05f0 con 0x7fa20815b180 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.534+0000 7fa20ee27640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa2080d08f0 con 0x7fa2080b4100 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.534+0000 7fa207fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa20815ad70 0x7fa20806e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.534+0000 7fa207fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa20815ad70 0x7fa20806e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52494/0 (socket says 172.21.15.146:52494) 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.534+0000 7fa207fff640 1 -- 172.21.15.146:0/1983750045 learned_addr learned my addr 172.21.15.146:0/1983750045 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa20cbc3640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2080b4100 0x7fa2081f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa20d3c4640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa20815b180 0x7fa20806ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa207fff640 1 -- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2080b4100 msgr2=0x7fa2081f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa207fff640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2080b4100 0x7fa2081f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa207fff640 1 -- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa20815b180 msgr2=0x7fa20806ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa207fff640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa20815b180 0x7fa20806ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa207fff640 1 -- 172.21.15.146:0/1983750045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2081f7200 con 0x7fa20815ad70 2024-09-17T03:33:45.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa20d3c4640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa20815b180 0x7fa20806ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:45.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa207fff640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa20815ad70 0x7fa20806e9c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c370 tx=0x7fa1f400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:45.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa2057fa640 1 -- 172.21.15.146:0/1983750045 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4006890 con 0x7fa20815ad70 2024-09-17T03:33:45.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa2057fa640 1 -- 172.21.15.146:0/1983750045 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1f4006b20 con 0x7fa20815ad70 2024-09-17T03:33:45.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa20ee27640 1 -- 172.21.15.146:0/1983750045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2081493b0 con 0x7fa20815ad70 2024-09-17T03:33:45.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa2057fa640 1 -- 172.21.15.146:0/1983750045 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4007020 con 0x7fa20815ad70 2024-09-17T03:33:45.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.535+0000 7fa20ee27640 1 -- 172.21.15.146:0/1983750045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa208146c30 con 0x7fa20815ad70 2024-09-17T03:33:45.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.536+0000 7fa20ee27640 1 -- 172.21.15.146:0/1983750045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20815c9f0 con 0x7fa20815ad70 2024-09-17T03:33:45.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.537+0000 7fa2057fa640 1 -- 172.21.15.146:0/1983750045 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa1f4019020 con 0x7fa20815ad70 2024-09-17T03:33:45.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.537+0000 7fa2057fa640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1ec078b90 0x7fa1ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.538+0000 7fa2057fa640 1 -- 172.21.15.146:0/1983750045 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa1f409a4b0 con 0x7fa20815ad70 2024-09-17T03:33:45.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.538+0000 7fa20cbc3640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1ec078b90 0x7fa1ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.538+0000 7fa20cbc3640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1ec078b90 0x7fa1ec07b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa2080b07a0 tx=0x7fa1fc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:45.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.542+0000 7fa2057fa640 1 -- 172.21.15.146:0/1983750045 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa2081f7200 con 0x7fa20815ad70 2024-09-17T03:33:45.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.785+0000 7fa20ee27640 1 -- 172.21.15.146:0/1983750045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa20815bed0 con 0x7fa20815ad70 2024-09-17T03:33:45.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.786+0000 7fa2057fa640 1 -- 172.21.15.146:0/1983750045 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2742 (secure 0 0 0) 0x7fa1f40628f0 con 0x7fa20815ad70 2024-09-17T03:33:45.785 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:45.785 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":70,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":67},{"state_name":"active+clean","count":30}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":592070,"bytes_used":225181696,"bytes_avail":772868931584,"bytes_total":773094113280,"unknown_pgs_ratio":0.69072163105010986,"write_bytes_sec":985,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":13,"btime":"2024-09-17T03:33:43:665910+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":4864}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-17T03:33:41.798969+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:33:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 -- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1ec078b90 msgr2=0x7fa1ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1ec078b90 0x7fa1ec07b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa2080b07a0 tx=0x7fa1fc005f90 comp rx=0 tx=0).stop 2024-09-17T03:33:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 -- 172.21.15.146:0/1983750045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa20815ad70 msgr2=0x7fa20806e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa20815ad70 0x7fa20806e9c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c370 tx=0x7fa1f400c830 comp rx=0 tx=0).stop 2024-09-17T03:33:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 -- 172.21.15.146:0/1983750045 shutdown_connections 2024-09-17T03:33:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1ec078b90 0x7fa1ec07b0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa20815b180 0x7fa20806ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa20815ad70 0x7fa20806e9c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 --2- 172.21.15.146:0/1983750045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2080b4100 0x7fa2081f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 -- 172.21.15.146:0/1983750045 >> 172.21.15.146:0/1983750045 conn(0x7fa20806d3c0 msgr2=0x7fa2080cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 -- 172.21.15.146:0/1983750045 shutdown_connections 2024-09-17T03:33:45.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.788+0000 7fa20ee27640 1 -- 172.21.15.146:0/1983750045 wait complete. 2024-09-17T03:33:45.798 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:33:45.799 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:45.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.912+0000 7f34c0cde640 1 -- 172.21.15.146:0/933208201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34bc070350 msgr2=0x7f34bc072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.912+0000 7f34c0cde640 1 --2- 172.21.15.146:0/933208201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34bc070350 0x7f34bc072680 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f34bc071f20 tx=0x7f34b002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.912+0000 7f34c0cde640 1 -- 172.21.15.146:0/933208201 shutdown_connections 2024-09-17T03:33:45.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.912+0000 7f34c0cde640 1 --2- 172.21.15.146:0/933208201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34bc070350 0x7f34bc072680 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.912+0000 7f34c0cde640 1 --2- 172.21.15.146:0/933208201 >> v2:172.21.15.179:3300/0 conn(0x7f34bc15b770 0x7f34bc06fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.912+0000 7f34c0cde640 1 -- 172.21.15.146:0/933208201 >> 172.21.15.146:0/933208201 conn(0x7f34bc0b2060 msgr2=0x7f34bc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:45.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.912+0000 7f34c0cde640 1 -- 172.21.15.146:0/933208201 shutdown_connections 2024-09-17T03:33:45.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.912+0000 7f34c0cde640 1 -- 172.21.15.146:0/933208201 wait complete. 2024-09-17T03:33:45.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.914+0000 7f34c0cde640 1 Processor -- start 2024-09-17T03:33:45.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.914+0000 7f34c0cde640 1 -- start start 2024-09-17T03:33:45.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34c0cde640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34bc070350 0x7f34bc1418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34c0cde640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34bc072bc0 0x7f34bc157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34c0cde640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34bc15b770 0x7f34bc158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34c0cde640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc15f9f0 con 0x7f34bc072bc0 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34c0cde640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc0b5590 con 0x7f34bc070350 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34c0cde640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f34bc15fb70 con 0x7f34bc15b770 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34b9d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34bc072bc0 0x7f34bc157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34b9d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34bc072bc0 0x7f34bc157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52516/0 (socket says 172.21.15.146:52516) 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34b9d9b640 1 -- 172.21.15.146:0/2319269002 learned_addr learned my addr 172.21.15.146:0/2319269002 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34ba59c640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34bc070350 0x7f34bc1418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34bad9d640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34bc15b770 0x7f34bc158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.915+0000 7f34b9d9b640 1 -- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34bc15b770 msgr2=0x7f34bc158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.916+0000 7f34b9d9b640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34bc15b770 0x7f34bc158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.916+0000 7f34b9d9b640 1 -- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34bc070350 msgr2=0x7f34bc1418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:45.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.916+0000 7f34b9d9b640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34bc070350 0x7f34bc1418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:45.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.916+0000 7f34b9d9b640 1 -- 172.21.15.146:0/2319269002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34bc1f62a0 con 0x7f34bc072bc0 2024-09-17T03:33:45.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.916+0000 7f34ba59c640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34bc070350 0x7f34bc1418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:45.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.916+0000 7f34b9d9b640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34bc072bc0 0x7f34bc157cc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f34b00098e0 tx=0x7f34b0004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:45.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.916+0000 7f34aaffd640 1 -- 172.21.15.146:0/2319269002 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0005c30 con 0x7f34bc072bc0 2024-09-17T03:33:45.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.916+0000 7f34aaffd640 1 -- 172.21.15.146:0/2319269002 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34b0004e50 con 0x7f34bc072bc0 2024-09-17T03:33:45.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.916+0000 7f34aaffd640 1 -- 172.21.15.146:0/2319269002 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0005040 con 0x7f34bc072bc0 2024-09-17T03:33:45.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.916+0000 7f34c0cde640 1 -- 172.21.15.146:0/2319269002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34bc1f6580 con 0x7f34bc072bc0 2024-09-17T03:33:45.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.916+0000 7f34c0cde640 1 -- 172.21.15.146:0/2319269002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34bc15d4c0 con 0x7f34bc072bc0 2024-09-17T03:33:45.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.917+0000 7f34c0cde640 1 -- 172.21.15.146:0/2319269002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34bc1f6010 con 0x7f34bc072bc0 2024-09-17T03:33:45.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.918+0000 7f34aaffd640 1 -- 172.21.15.146:0/2319269002 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34b00051e0 con 0x7f34bc072bc0 2024-09-17T03:33:45.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.918+0000 7f34aaffd640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f349c078b90 0x7f349c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:45.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.918+0000 7f34aaffd640 1 -- 172.21.15.146:0/2319269002 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f34b00bc0b0 con 0x7f34bc072bc0 2024-09-17T03:33:45.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.919+0000 7f34ba59c640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f349c078b90 0x7f349c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:45.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.919+0000 7f34ba59c640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f349c078b90 0x7f349c07b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f34ac005fd0 tx=0x7f34ac009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:45.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:45.923+0000 7f34aaffd640 1 -- 172.21.15.146:0/2319269002 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f34b003f030 con 0x7f34bc072bc0 2024-09-17T03:33:46.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.094+0000 7f34c0cde640 1 -- 172.21.15.146:0/2319269002 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34bc1f6aa0 con 0x7f349c078b90 2024-09-17T03:33:46.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.098+0000 7f34aaffd640 1 -- 172.21.15.146:0/2319269002 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251938 (secure 0 0 0) 0x7f34ac01c490 con 0x7f349c078b90 2024-09-17T03:33:46.100 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:46.101 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.101+0000 7f34c0cde640 1 -- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f349c078b90 msgr2=0x7f349c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:46.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.101+0000 7f34c0cde640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f349c078b90 0x7f349c07b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f34ac005fd0 tx=0x7f34ac009500 comp rx=0 tx=0).stop 2024-09-17T03:33:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.101+0000 7f34c0cde640 1 -- 172.21.15.146:0/2319269002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34bc072bc0 msgr2=0x7f34bc157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.101+0000 7f34c0cde640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34bc072bc0 0x7f34bc157cc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f34b00098e0 tx=0x7f34b0004a50 comp rx=0 tx=0).stop 2024-09-17T03:33:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.101+0000 7f34c0cde640 1 -- 172.21.15.146:0/2319269002 shutdown_connections 2024-09-17T03:33:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.101+0000 7f34c0cde640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f349c078b90 0x7f349c07b0a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.101+0000 7f34c0cde640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34bc15b770 0x7f34bc158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.102+0000 7f34c0cde640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34bc072bc0 0x7f34bc157cc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.102+0000 7f34c0cde640 1 --2- 172.21.15.146:0/2319269002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34bc070350 0x7f34bc1418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.102+0000 7f34c0cde640 1 -- 172.21.15.146:0/2319269002 >> 172.21.15.146:0/2319269002 conn(0x7f34bc0b2060 msgr2=0x7f34bc0b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.102+0000 7f34c0cde640 1 -- 172.21.15.146:0/2319269002 shutdown_connections 2024-09-17T03:33:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:46.102+0000 7f34c0cde640 1 -- 172.21.15.146:0/2319269002 wait complete. 2024-09-17T03:33:46.112 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-17T03:33:45.799774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220200,"kb_used_data":3952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754520,"statfs":{"total":773094113280,"available":772868628480,"internally_reserved":0,"allocated":4046848,"data_stored":2260468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001161"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657467+0000","last_change":"2024-09-17T03:33:41.674817+0000","last_active":"2024-09-17T03:33:42.657467+0000","last_peered":"2024-09-17T03:33:42.657467+0000","last_clean":"2024-09-17T03:33:42.657467+0000","last_became_active":"2024-09-17T03:33:41.674464+0000","last_became_peered":"2024-09-17T03:33:41.674464+0000","last_unstale":"2024-09-17T03:33:42.657467+0000","last_undegraded":"2024-09-17T03:33:42.657467+0000","last_fullsized":"2024-09-17T03:33:42.657467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:40.185907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.669912+0000","last_change":"2024-09-17T03:33:41.662887+0000","last_active":"2024-09-17T03:33:41.669912+0000","last_peered":"2024-09-17T03:33:41.669912+0000","last_clean":"2024-09-17T03:33:41.669912+0000","last_became_active":"2024-09-17T03:33:41.662600+0000","last_became_peered":"2024-09-17T03:33:41.662600+0000","last_unstale":"2024-09-17T03:33:41.669912+0000","last_undegraded":"2024-09-17T03:33:41.669912+0000","last_fullsized":"2024-09-17T03:33:41.669912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:18.146167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.677678+0000","last_change":"2024-09-17T03:33:41.676205+0000","last_active":"2024-09-17T03:33:41.677678+0000","last_peered":"2024-09-17T03:33:41.677678+0000","last_clean":"2024-09-17T03:33:41.677678+0000","last_became_active":"2024-09-17T03:33:41.675785+0000","last_became_peered":"2024-09-17T03:33:41.675785+0000","last_unstale":"2024-09-17T03:33:41.677678+0000","last_undegraded":"2024-09-17T03:33:41.677678+0000","last_fullsized":"2024-09-17T03:33:41.677678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:22.654084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991356+0000","last_change":"2024-09-17T03:33:41.677552+0000","last_active":"2024-09-17T03:33:42.991356+0000","last_peered":"2024-09-17T03:33:42.991356+0000","last_clean":"2024-09-17T03:33:42.991356+0000","last_became_active":"2024-09-17T03:33:41.677121+0000","last_became_peered":"2024-09-17T03:33:41.677121+0000","last_unstale":"2024-09-17T03:33:42.991356+0000","last_undegraded":"2024-09-17T03:33:42.991356+0000","last_fullsized":"2024-09-17T03:33:42.991356+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:34.600296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993052+0000","last_change":"2024-09-17T03:33:41.670621+0000","last_active":"2024-09-17T03:33:42.993052+0000","last_peered":"2024-09-17T03:33:42.993052+0000","last_clean":"2024-09-17T03:33:42.993052+0000","last_became_active":"2024-09-17T03:33:41.670308+0000","last_became_peered":"2024-09-17T03:33:41.670308+0000","last_unstale":"2024-09-17T03:33:42.993052+0000","last_undegraded":"2024-09-17T03:33:42.993052+0000","last_fullsized":"2024-09-17T03:33:42.993052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:36.953151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679864+0000","last_change":"2024-09-17T03:33:41.673177+0000","last_active":"2024-09-17T03:33:41.679864+0000","last_peered":"2024-09-17T03:33:41.679864+0000","last_clean":"2024-09-17T03:33:41.679864+0000","last_became_active":"2024-09-17T03:33:41.671525+0000","last_became_peered":"2024-09-17T03:33:41.671525+0000","last_unstale":"2024-09-17T03:33:41.679864+0000","last_undegraded":"2024-09-17T03:33:41.679864+0000","last_fullsized":"2024-09-17T03:33:41.679864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:27.398745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992197+0000","last_change":"2024-09-17T03:33:41.678710+0000","last_active":"2024-09-17T03:33:42.992197+0000","last_peered":"2024-09-17T03:33:42.992197+0000","last_clean":"2024-09-17T03:33:42.992197+0000","last_became_active":"2024-09-17T03:33:41.678414+0000","last_became_peered":"2024-09-17T03:33:41.678414+0000","last_unstale":"2024-09-17T03:33:42.992197+0000","last_undegraded":"2024-09-17T03:33:42.992197+0000","last_fullsized":"2024-09-17T03:33:42.992197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:40.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991726+0000","last_change":"2024-09-17T03:33:41.679451+0000","last_active":"2024-09-17T03:33:42.991726+0000","last_peered":"2024-09-17T03:33:42.991726+0000","last_clean":"2024-09-17T03:33:42.991726+0000","last_became_active":"2024-09-17T03:33:41.679145+0000","last_became_peered":"2024-09-17T03:33:41.679145+0000","last_unstale":"2024-09-17T03:33:42.991726+0000","last_undegraded":"2024-09-17T03:33:42.991726+0000","last_fullsized":"2024-09-17T03:33:42.991726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:13.155949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657055+0000","last_change":"2024-09-17T03:33:41.673577+0000","last_active":"2024-09-17T03:33:42.657055+0000","last_peered":"2024-09-17T03:33:42.657055+0000","last_clean":"2024-09-17T03:33:42.657055+0000","last_became_active":"2024-09-17T03:33:41.673276+0000","last_became_peered":"2024-09-17T03:33:41.673276+0000","last_unstale":"2024-09-17T03:33:42.657055+0000","last_undegraded":"2024-09-17T03:33:42.657055+0000","last_fullsized":"2024-09-17T03:33:42.657055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:22.290357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991503+0000","last_change":"2024-09-17T03:33:41.671601+0000","last_active":"2024-09-17T03:33:42.991503+0000","last_peered":"2024-09-17T03:33:42.991503+0000","last_clean":"2024-09-17T03:33:42.991503+0000","last_became_active":"2024-09-17T03:33:41.671214+0000","last_became_peered":"2024-09-17T03:33:41.671214+0000","last_unstale":"2024-09-17T03:33:42.991503+0000","last_undegraded":"2024-09-17T03:33:42.991503+0000","last_fullsized":"2024-09-17T03:33:42.991503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:22.290357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992704+0000","last_change":"2024-09-17T03:33:41.681838+0000","last_active":"2024-09-17T03:33:42.992704+0000","last_peered":"2024-09-17T03:33:42.992704+0000","last_clean":"2024-09-17T03:33:42.992704+0000","last_became_active":"2024-09-17T03:33:41.681486+0000","last_became_peered":"2024-09-17T03:33:41.681486+0000","last_unstale":"2024-09-17T03:33:42.992704+0000","last_undegraded":"2024-09-17T03:33:42.992704+0000","last_fullsized":"2024-09-17T03:33:42.992704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:11.391267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.686103+0000","last_change":"2024-09-17T03:33:41.683531+0000","last_active":"2024-09-17T03:33:41.686103+0000","last_peered":"2024-09-17T03:33:41.686103+0000","last_clean":"2024-09-17T03:33:41.686103+0000","last_became_active":"2024-09-17T03:33:41.683185+0000","last_became_peered":"2024-09-17T03:33:41.683185+0000","last_unstale":"2024-09-17T03:33:41.686103+0000","last_undegraded":"2024-09-17T03:33:41.686103+0000","last_fullsized":"2024-09-17T03:33:41.686103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:35.674290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993273+0000","last_change":"2024-09-17T03:33:41.669624+0000","last_active":"2024-09-17T03:33:42.993273+0000","last_peered":"2024-09-17T03:33:42.993273+0000","last_clean":"2024-09-17T03:33:42.993273+0000","last_became_active":"2024-09-17T03:33:41.669299+0000","last_became_peered":"2024-09-17T03:33:41.669299+0000","last_unstale":"2024-09-17T03:33:42.993273+0000","last_undegraded":"2024-09-17T03:33:42.993273+0000","last_fullsized":"2024-09-17T03:33:42.993273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:36.268770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679838+0000","last_change":"2024-09-17T03:33:41.669466+0000","last_active":"2024-09-17T03:33:41.679838+0000","last_peered":"2024-09-17T03:33:41.679838+0000","last_clean":"2024-09-17T03:33:41.679838+0000","last_became_active":"2024-09-17T03:33:41.668995+0000","last_became_peered":"2024-09-17T03:33:41.668995+0000","last_unstale":"2024-09-17T03:33:41.679838+0000","last_undegraded":"2024-09-17T03:33:41.679838+0000","last_fullsized":"2024-09-17T03:33:41.679838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:34.559813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.683515+0000","last_change":"2024-09-17T03:33:41.680388+0000","last_active":"2024-09-17T03:33:41.683515+0000","last_peered":"2024-09-17T03:33:41.683515+0000","last_clean":"2024-09-17T03:33:41.683515+0000","last_became_active":"2024-09-17T03:33:41.680067+0000","last_became_peered":"2024-09-17T03:33:41.680067+0000","last_unstale":"2024-09-17T03:33:41.683515+0000","last_undegraded":"2024-09-17T03:33:41.683515+0000","last_fullsized":"2024-09-17T03:33:41.683515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:18.223647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992317+0000","last_change":"2024-09-17T03:33:41.687970+0000","last_active":"2024-09-17T03:33:42.992317+0000","last_peered":"2024-09-17T03:33:42.992317+0000","last_clean":"2024-09-17T03:33:42.992317+0000","last_became_active":"2024-09-17T03:33:41.687623+0000","last_became_peered":"2024-09-17T03:33:41.687623+0000","last_unstale":"2024-09-17T03:33:42.992317+0000","last_undegraded":"2024-09-17T03:33:42.992317+0000","last_fullsized":"2024-09-17T03:33:42.992317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:33.081092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992563+0000","last_change":"2024-09-17T03:33:41.677678+0000","last_active":"2024-09-17T03:33:42.992563+0000","last_peered":"2024-09-17T03:33:42.992563+0000","last_clean":"2024-09-17T03:33:42.992563+0000","last_became_active":"2024-09-17T03:33:41.677170+0000","last_became_peered":"2024-09-17T03:33:41.677170+0000","last_unstale":"2024-09-17T03:33:42.992563+0000","last_undegraded":"2024-09-17T03:33:42.992563+0000","last_fullsized":"2024-09-17T03:33:42.992563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:32.711035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.680007+0000","last_change":"2024-09-17T03:33:41.676041+0000","last_active":"2024-09-17T03:33:41.680007+0000","last_peered":"2024-09-17T03:33:41.680007+0000","last_clean":"2024-09-17T03:33:41.680007+0000","last_became_active":"2024-09-17T03:33:41.675417+0000","last_became_peered":"2024-09-17T03:33:41.675417+0000","last_unstale":"2024-09-17T03:33:41.680007+0000","last_undegraded":"2024-09-17T03:33:41.680007+0000","last_fullsized":"2024-09-17T03:33:41.680007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:41.459158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.671473+0000","last_change":"2024-09-17T03:33:41.667308+0000","last_active":"2024-09-17T03:33:41.671473+0000","last_peered":"2024-09-17T03:33:41.671473+0000","last_clean":"2024-09-17T03:33:41.671473+0000","last_became_active":"2024-09-17T03:33:41.666990+0000","last_became_peered":"2024-09-17T03:33:41.666990+0000","last_unstale":"2024-09-17T03:33:41.671473+0000","last_undegraded":"2024-09-17T03:33:41.671473+0000","last_fullsized":"2024-09-17T03:33:41.671473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:31.926728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993315+0000","last_change":"2024-09-17T03:33:41.673295+0000","last_active":"2024-09-17T03:33:42.993315+0000","last_peered":"2024-09-17T03:33:42.993315+0000","last_clean":"2024-09-17T03:33:42.993315+0000","last_became_active":"2024-09-17T03:33:41.672985+0000","last_became_peered":"2024-09-17T03:33:41.672985+0000","last_unstale":"2024-09-17T03:33:42.993315+0000","last_undegraded":"2024-09-17T03:33:42.993315+0000","last_fullsized":"2024-09-17T03:33:42.993315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:06.233705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656996+0000","last_change":"2024-09-17T03:33:41.667523+0000","last_active":"2024-09-17T03:33:42.656996+0000","last_peered":"2024-09-17T03:33:42.656996+0000","last_clean":"2024-09-17T03:33:42.656996+0000","last_became_active":"2024-09-17T03:33:41.667133+0000","last_became_peered":"2024-09-17T03:33:41.667133+0000","last_unstale":"2024-09-17T03:33:42.656996+0000","last_undegraded":"2024-09-17T03:33:42.656996+0000","last_fullsized":"2024-09-17T03:33:42.656996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:16.834058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656808+0000","last_change":"2024-09-17T03:33:41.675178+0000","last_active":"2024-09-17T03:33:42.656808+0000","last_peered":"2024-09-17T03:33:42.656808+0000","last_clean":"2024-09-17T03:33:42.656808+0000","last_became_active":"2024-09-17T03:33:41.674823+0000","last_became_peered":"2024-09-17T03:33:41.674823+0000","last_unstale":"2024-09-17T03:33:42.656808+0000","last_undegraded":"2024-09-17T03:33:42.656808+0000","last_fullsized":"2024-09-17T03:33:42.656808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:51.240971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991745+0000","last_change":"2024-09-17T03:33:41.672659+0000","last_active":"2024-09-17T03:33:42.991745+0000","last_peered":"2024-09-17T03:33:42.991745+0000","last_clean":"2024-09-17T03:33:42.991745+0000","last_became_active":"2024-09-17T03:33:41.672284+0000","last_became_peered":"2024-09-17T03:33:41.672284+0000","last_unstale":"2024-09-17T03:33:42.991745+0000","last_undegraded":"2024-09-17T03:33:42.991745+0000","last_fullsized":"2024-09-17T03:33:42.991745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:04.560105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675778+0000","last_change":"2024-09-17T03:33:41.672443+0000","last_active":"2024-09-17T03:33:41.675778+0000","last_peered":"2024-09-17T03:33:41.675778+0000","last_clean":"2024-09-17T03:33:41.675778+0000","last_became_active":"2024-09-17T03:33:41.672025+0000","last_became_peered":"2024-09-17T03:33:41.672025+0000","last_unstale":"2024-09-17T03:33:41.675778+0000","last_undegraded":"2024-09-17T03:33:41.675778+0000","last_fullsized":"2024-09-17T03:33:41.675778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:35.234066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991985+0000","last_change":"2024-09-17T03:33:41.684412+0000","last_active":"2024-09-17T03:33:42.991985+0000","last_peered":"2024-09-17T03:33:42.991985+0000","last_clean":"2024-09-17T03:33:42.991985+0000","last_became_active":"2024-09-17T03:33:41.683918+0000","last_became_peered":"2024-09-17T03:33:41.683918+0000","last_unstale":"2024-09-17T03:33:42.991985+0000","last_undegraded":"2024-09-17T03:33:42.991985+0000","last_fullsized":"2024-09-17T03:33:42.991985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:44.044011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679977+0000","last_change":"2024-09-17T03:33:41.675720+0000","last_active":"2024-09-17T03:33:41.679977+0000","last_peered":"2024-09-17T03:33:41.679977+0000","last_clean":"2024-09-17T03:33:41.679977+0000","last_became_active":"2024-09-17T03:33:41.674212+0000","last_became_peered":"2024-09-17T03:33:41.674212+0000","last_unstale":"2024-09-17T03:33:41.679977+0000","last_undegraded":"2024-09-17T03:33:41.679977+0000","last_fullsized":"2024-09-17T03:33:41.679977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:09.047247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992470+0000","last_change":"2024-09-17T03:33:41.678048+0000","last_active":"2024-09-17T03:33:42.992470+0000","last_peered":"2024-09-17T03:33:42.992470+0000","last_clean":"2024-09-17T03:33:42.992470+0000","last_became_active":"2024-09-17T03:33:41.677672+0000","last_became_peered":"2024-09-17T03:33:41.677672+0000","last_unstale":"2024-09-17T03:33:42.992470+0000","last_undegraded":"2024-09-17T03:33:42.992470+0000","last_fullsized":"2024-09-17T03:33:42.992470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:52.711071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.670754+0000","last_change":"2024-09-17T03:33:41.667684+0000","last_active":"2024-09-17T03:33:41.670754+0000","last_peered":"2024-09-17T03:33:41.670754+0000","last_clean":"2024-09-17T03:33:41.670754+0000","last_became_active":"2024-09-17T03:33:41.667362+0000","last_became_peered":"2024-09-17T03:33:41.667362+0000","last_unstale":"2024-09-17T03:33:41.670754+0000","last_undegraded":"2024-09-17T03:33:41.670754+0000","last_fullsized":"2024-09-17T03:33:41.670754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:04.350237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656729+0000","last_change":"2024-09-17T03:33:41.674572+0000","last_active":"2024-09-17T03:33:42.656729+0000","last_peered":"2024-09-17T03:33:42.656729+0000","last_clean":"2024-09-17T03:33:42.656729+0000","last_became_active":"2024-09-17T03:33:41.674306+0000","last_became_peered":"2024-09-17T03:33:41.674306+0000","last_unstale":"2024-09-17T03:33:42.656729+0000","last_undegraded":"2024-09-17T03:33:42.656729+0000","last_fullsized":"2024-09-17T03:33:42.656729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:34.668015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992487+0000","last_change":"2024-09-17T03:33:41.677756+0000","last_active":"2024-09-17T03:33:42.992487+0000","last_peered":"2024-09-17T03:33:42.992487+0000","last_clean":"2024-09-17T03:33:42.992487+0000","last_became_active":"2024-09-17T03:33:41.676032+0000","last_became_peered":"2024-09-17T03:33:41.676032+0000","last_unstale":"2024-09-17T03:33:42.992487+0000","last_undegraded":"2024-09-17T03:33:42.992487+0000","last_fullsized":"2024-09-17T03:33:42.992487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:12.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.655856+0000","last_change":"2024-09-17T03:33:41.665587+0000","last_active":"2024-09-17T03:33:42.655856+0000","last_peered":"2024-09-17T03:33:42.655856+0000","last_clean":"2024-09-17T03:33:42.655856+0000","last_became_active":"2024-09-17T03:33:41.663632+0000","last_became_peered":"2024-09-17T03:33:41.663632+0000","last_unstale":"2024-09-17T03:33:42.655856+0000","last_undegraded":"2024-09-17T03:33:42.655856+0000","last_fullsized":"2024-09-17T03:33:42.655856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:22.573724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991721+0000","last_change":"2024-09-17T03:33:41.673469+0000","last_active":"2024-09-17T03:33:42.991721+0000","last_peered":"2024-09-17T03:33:42.991721+0000","last_clean":"2024-09-17T03:33:42.991721+0000","last_became_active":"2024-09-17T03:33:41.673147+0000","last_became_peered":"2024-09-17T03:33:41.673147+0000","last_unstale":"2024-09-17T03:33:42.991721+0000","last_undegraded":"2024-09-17T03:33:42.991721+0000","last_fullsized":"2024-09-17T03:33:42.991721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:38.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991311+0000","last_change":"2024-09-17T03:33:41.673716+0000","last_active":"2024-09-17T03:33:42.991311+0000","last_peered":"2024-09-17T03:33:42.991311+0000","last_clean":"2024-09-17T03:33:42.991311+0000","last_became_active":"2024-09-17T03:33:41.673397+0000","last_became_peered":"2024-09-17T03:33:41.673397+0000","last_unstale":"2024-09-17T03:33:42.991311+0000","last_undegraded":"2024-09-17T03:33:42.991311+0000","last_fullsized":"2024-09-17T03:33:42.991311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:40.185907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657606+0000","last_change":"2024-09-17T03:33:40.660677+0000","last_active":"2024-09-17T03:33:42.657606+0000","last_peered":"2024-09-17T03:33:42.657606+0000","last_clean":"2024-09-17T03:33:42.657606+0000","last_became_active":"2024-09-17T03:33:40.660345+0000","last_became_peered":"2024-09-17T03:33:40.660345+0000","last_unstale":"2024-09-17T03:33:42.657606+0000","last_undegraded":"2024-09-17T03:33:42.657606+0000","last_fullsized":"2024-09-17T03:33:42.657606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:05.231493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657527+0000","last_change":"2024-09-17T03:33:41.660349+0000","last_active":"2024-09-17T03:33:42.657527+0000","last_peered":"2024-09-17T03:33:42.657527+0000","last_clean":"2024-09-17T03:33:42.657527+0000","last_became_active":"2024-09-17T03:33:41.660039+0000","last_became_peered":"2024-09-17T03:33:41.660039+0000","last_unstale":"2024-09-17T03:33:42.657527+0000","last_undegraded":"2024-09-17T03:33:42.657527+0000","last_fullsized":"2024-09-17T03:33:42.657527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:05.861455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991453+0000","last_change":"2024-09-17T03:33:40.668406+0000","last_active":"2024-09-17T03:33:42.991453+0000","last_peered":"2024-09-17T03:33:42.991453+0000","last_clean":"2024-09-17T03:33:42.991453+0000","last_became_active":"2024-09-17T03:33:40.667453+0000","last_became_peered":"2024-09-17T03:33:40.667453+0000","last_unstale":"2024-09-17T03:33:42.991453+0000","last_undegraded":"2024-09-17T03:33:42.991453+0000","last_fullsized":"2024-09-17T03:33:42.991453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:58.527534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657005+0000","last_change":"2024-09-17T03:33:41.674410+0000","last_active":"2024-09-17T03:33:42.657005+0000","last_peered":"2024-09-17T03:33:42.657005+0000","last_clean":"2024-09-17T03:33:42.657005+0000","last_became_active":"2024-09-17T03:33:41.674137+0000","last_became_peered":"2024-09-17T03:33:41.674137+0000","last_unstale":"2024-09-17T03:33:42.657005+0000","last_undegraded":"2024-09-17T03:33:42.657005+0000","last_fullsized":"2024-09-17T03:33:42.657005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:44.356306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687457+0000","last_change":"2024-09-17T03:33:40.670251+0000","last_active":"2024-09-17T03:33:41.687457+0000","last_peered":"2024-09-17T03:33:41.687457+0000","last_clean":"2024-09-17T03:33:41.687457+0000","last_became_active":"2024-09-17T03:33:40.669956+0000","last_became_peered":"2024-09-17T03:33:40.669956+0000","last_unstale":"2024-09-17T03:33:41.687457+0000","last_undegraded":"2024-09-17T03:33:41.687457+0000","last_fullsized":"2024-09-17T03:33:41.687457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:04.466425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992567+0000","last_change":"2024-09-17T03:33:41.665075+0000","last_active":"2024-09-17T03:33:42.992567+0000","last_peered":"2024-09-17T03:33:42.992567+0000","last_clean":"2024-09-17T03:33:42.992567+0000","last_became_active":"2024-09-17T03:33:41.664510+0000","last_became_peered":"2024-09-17T03:33:41.664510+0000","last_unstale":"2024-09-17T03:33:42.992567+0000","last_undegraded":"2024-09-17T03:33:42.992567+0000","last_fullsized":"2024-09-17T03:33:42.992567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:13.155949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993255+0000","last_change":"2024-09-17T03:33:40.664419+0000","last_active":"2024-09-17T03:33:42.993255+0000","last_peered":"2024-09-17T03:33:42.993255+0000","last_clean":"2024-09-17T03:33:42.993255+0000","last_became_active":"2024-09-17T03:33:40.664096+0000","last_became_peered":"2024-09-17T03:33:40.664096+0000","last_unstale":"2024-09-17T03:33:42.993255+0000","last_undegraded":"2024-09-17T03:33:42.993255+0000","last_fullsized":"2024-09-17T03:33:42.993255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:19.501660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991886+0000","last_change":"2024-09-17T03:33:41.672384+0000","last_active":"2024-09-17T03:33:42.991886+0000","last_peered":"2024-09-17T03:33:42.991886+0000","last_clean":"2024-09-17T03:33:42.991886+0000","last_became_active":"2024-09-17T03:33:41.672092+0000","last_became_peered":"2024-09-17T03:33:41.672092+0000","last_unstale":"2024-09-17T03:33:42.991886+0000","last_undegraded":"2024-09-17T03:33:42.991886+0000","last_fullsized":"2024-09-17T03:33:42.991886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:55.089034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657037+0000","last_change":"2024-09-17T03:33:40.664363+0000","last_active":"2024-09-17T03:33:42.657037+0000","last_peered":"2024-09-17T03:33:42.657037+0000","last_clean":"2024-09-17T03:33:42.657037+0000","last_became_active":"2024-09-17T03:33:40.664039+0000","last_became_peered":"2024-09-17T03:33:40.664039+0000","last_unstale":"2024-09-17T03:33:42.657037+0000","last_undegraded":"2024-09-17T03:33:42.657037+0000","last_fullsized":"2024-09-17T03:33:42.657037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:28.168328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.676297+0000","last_change":"2024-09-17T03:33:41.673601+0000","last_active":"2024-09-17T03:33:41.676297+0000","last_peered":"2024-09-17T03:33:41.676297+0000","last_clean":"2024-09-17T03:33:41.676297+0000","last_became_active":"2024-09-17T03:33:41.673307+0000","last_became_peered":"2024-09-17T03:33:41.673307+0000","last_unstale":"2024-09-17T03:33:41.676297+0000","last_undegraded":"2024-09-17T03:33:41.676297+0000","last_fullsized":"2024-09-17T03:33:41.676297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:30.683645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657119+0000","last_change":"2024-09-17T03:33:40.663470+0000","last_active":"2024-09-17T03:33:42.657119+0000","last_peered":"2024-09-17T03:33:42.657119+0000","last_clean":"2024-09-17T03:33:42.657119+0000","last_became_active":"2024-09-17T03:33:40.663098+0000","last_became_peered":"2024-09-17T03:33:40.663098+0000","last_unstale":"2024-09-17T03:33:42.657119+0000","last_undegraded":"2024-09-17T03:33:42.657119+0000","last_fullsized":"2024-09-17T03:33:42.657119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:18.101997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.655866+0000","last_change":"2024-09-17T03:33:41.672506+0000","last_active":"2024-09-17T03:33:42.655866+0000","last_peered":"2024-09-17T03:33:42.655866+0000","last_clean":"2024-09-17T03:33:42.655866+0000","last_became_active":"2024-09-17T03:33:41.672036+0000","last_became_peered":"2024-09-17T03:33:41.672036+0000","last_unstale":"2024-09-17T03:33:42.655866+0000","last_undegraded":"2024-09-17T03:33:42.655866+0000","last_fullsized":"2024-09-17T03:33:42.655866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:05.861455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.655398+0000","last_change":"2024-09-17T03:33:40.668613+0000","last_active":"2024-09-17T03:33:41.655398+0000","last_peered":"2024-09-17T03:33:41.655398+0000","last_clean":"2024-09-17T03:33:41.655398+0000","last_became_active":"2024-09-17T03:33:40.668131+0000","last_became_peered":"2024-09-17T03:33:40.668131+0000","last_unstale":"2024-09-17T03:33:41.655398+0000","last_undegraded":"2024-09-17T03:33:41.655398+0000","last_fullsized":"2024-09-17T03:33:41.655398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:05.271520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991156+0000","last_change":"2024-09-17T03:33:41.669562+0000","last_active":"2024-09-17T03:33:42.991156+0000","last_peered":"2024-09-17T03:33:42.991156+0000","last_clean":"2024-09-17T03:33:42.991156+0000","last_became_active":"2024-09-17T03:33:41.668768+0000","last_became_peered":"2024-09-17T03:33:41.668768+0000","last_unstale":"2024-09-17T03:33:42.991156+0000","last_undegraded":"2024-09-17T03:33:42.991156+0000","last_fullsized":"2024-09-17T03:33:42.991156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:41.416808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.655799+0000","last_change":"2024-09-17T03:33:40.658632+0000","last_active":"2024-09-17T03:33:42.655799+0000","last_peered":"2024-09-17T03:33:42.655799+0000","last_clean":"2024-09-17T03:33:42.655799+0000","last_became_active":"2024-09-17T03:33:40.658275+0000","last_became_peered":"2024-09-17T03:33:40.658275+0000","last_unstale":"2024-09-17T03:33:42.655799+0000","last_undegraded":"2024-09-17T03:33:42.655799+0000","last_fullsized":"2024-09-17T03:33:42.655799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:17.923962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675785+0000","last_change":"2024-09-17T03:33:41.672818+0000","last_active":"2024-09-17T03:33:41.675785+0000","last_peered":"2024-09-17T03:33:41.675785+0000","last_clean":"2024-09-17T03:33:41.675785+0000","last_became_active":"2024-09-17T03:33:41.672405+0000","last_became_peered":"2024-09-17T03:33:41.672405+0000","last_unstale":"2024-09-17T03:33:41.675785+0000","last_undegraded":"2024-09-17T03:33:41.675785+0000","last_fullsized":"2024-09-17T03:33:41.675785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:04.973538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.657879+0000","last_change":"2024-09-17T03:33:40.671952+0000","last_active":"2024-09-17T03:33:41.657879+0000","last_peered":"2024-09-17T03:33:41.657879+0000","last_clean":"2024-09-17T03:33:41.657879+0000","last_became_active":"2024-09-17T03:33:40.671688+0000","last_became_peered":"2024-09-17T03:33:40.671688+0000","last_unstale":"2024-09-17T03:33:41.657879+0000","last_undegraded":"2024-09-17T03:33:41.657879+0000","last_fullsized":"2024-09-17T03:33:41.657879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:41.813739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.680053+0000","last_change":"2024-09-17T03:33:41.673698+0000","last_active":"2024-09-17T03:33:41.680053+0000","last_peered":"2024-09-17T03:33:41.680053+0000","last_clean":"2024-09-17T03:33:41.680053+0000","last_became_active":"2024-09-17T03:33:41.673373+0000","last_became_peered":"2024-09-17T03:33:41.673373+0000","last_unstale":"2024-09-17T03:33:41.680053+0000","last_undegraded":"2024-09-17T03:33:41.680053+0000","last_fullsized":"2024-09-17T03:33:41.680053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:22.366281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991562+0000","last_change":"2024-09-17T03:33:40.666374+0000","last_active":"2024-09-17T03:33:42.991562+0000","last_peered":"2024-09-17T03:33:42.991562+0000","last_clean":"2024-09-17T03:33:42.991562+0000","last_became_active":"2024-09-17T03:33:40.666113+0000","last_became_peered":"2024-09-17T03:33:40.666113+0000","last_unstale":"2024-09-17T03:33:42.991562+0000","last_undegraded":"2024-09-17T03:33:42.991562+0000","last_fullsized":"2024-09-17T03:33:42.991562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:17.463874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687146+0000","last_change":"2024-09-17T03:33:41.681730+0000","last_active":"2024-09-17T03:33:41.687146+0000","last_peered":"2024-09-17T03:33:41.687146+0000","last_clean":"2024-09-17T03:33:41.687146+0000","last_became_active":"2024-09-17T03:33:41.678867+0000","last_became_peered":"2024-09-17T03:33:41.678867+0000","last_unstale":"2024-09-17T03:33:41.687146+0000","last_undegraded":"2024-09-17T03:33:41.687146+0000","last_fullsized":"2024-09-17T03:33:41.687146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:30.928493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.682018+0000","last_change":"2024-09-17T03:33:40.667467+0000","last_active":"2024-09-17T03:33:41.682018+0000","last_peered":"2024-09-17T03:33:41.682018+0000","last_clean":"2024-09-17T03:33:41.682018+0000","last_became_active":"2024-09-17T03:33:40.667051+0000","last_became_peered":"2024-09-17T03:33:40.667051+0000","last_unstale":"2024-09-17T03:33:41.682018+0000","last_undegraded":"2024-09-17T03:33:41.682018+0000","last_fullsized":"2024-09-17T03:33:41.682018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:01.755385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.679898+0000","last_change":"2024-09-17T03:33:41.676992+0000","last_active":"2024-09-17T03:33:41.679898+0000","last_peered":"2024-09-17T03:33:41.679898+0000","last_clean":"2024-09-17T03:33:41.679898+0000","last_became_active":"2024-09-17T03:33:41.676639+0000","last_became_peered":"2024-09-17T03:33:41.676639+0000","last_unstale":"2024-09-17T03:33:41.679898+0000","last_undegraded":"2024-09-17T03:33:41.679898+0000","last_fullsized":"2024-09-17T03:33:41.679898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:04.225065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.692710+0000","last_change":"2024-09-17T03:33:40.670776+0000","last_active":"2024-09-17T03:33:41.692710+0000","last_peered":"2024-09-17T03:33:41.692710+0000","last_clean":"2024-09-17T03:33:41.692710+0000","last_became_active":"2024-09-17T03:33:40.670019+0000","last_became_peered":"2024-09-17T03:33:40.670019+0000","last_unstale":"2024-09-17T03:33:41.692710+0000","last_undegraded":"2024-09-17T03:33:41.692710+0000","last_fullsized":"2024-09-17T03:33:41.692710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:22.598820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991579+0000","last_change":"2024-09-17T03:33:41.678042+0000","last_active":"2024-09-17T03:33:42.991579+0000","last_peered":"2024-09-17T03:33:42.991579+0000","last_clean":"2024-09-17T03:33:42.991579+0000","last_became_active":"2024-09-17T03:33:41.677711+0000","last_became_peered":"2024-09-17T03:33:41.677711+0000","last_unstale":"2024-09-17T03:33:42.991579+0000","last_undegraded":"2024-09-17T03:33:42.991579+0000","last_fullsized":"2024-09-17T03:33:42.991579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:44.356306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657146+0000","last_change":"2024-09-17T03:33:40.661416+0000","last_active":"2024-09-17T03:33:42.657146+0000","last_peered":"2024-09-17T03:33:42.657146+0000","last_clean":"2024-09-17T03:33:42.657146+0000","last_became_active":"2024-09-17T03:33:40.661076+0000","last_became_peered":"2024-09-17T03:33:40.661076+0000","last_unstale":"2024-09-17T03:33:42.657146+0000","last_undegraded":"2024-09-17T03:33:42.657146+0000","last_fullsized":"2024-09-17T03:33:42.657146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:58.527534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.669867+0000","last_change":"2024-09-17T03:33:41.662805+0000","last_active":"2024-09-17T03:33:41.669867+0000","last_peered":"2024-09-17T03:33:41.669867+0000","last_clean":"2024-09-17T03:33:41.669867+0000","last_became_active":"2024-09-17T03:33:41.662456+0000","last_became_peered":"2024-09-17T03:33:41.662456+0000","last_unstale":"2024-09-17T03:33:41.669867+0000","last_undegraded":"2024-09-17T03:33:41.669867+0000","last_fullsized":"2024-09-17T03:33:41.669867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:28.588107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991704+0000","last_change":"2024-09-17T03:33:40.661581+0000","last_active":"2024-09-17T03:33:42.991704+0000","last_peered":"2024-09-17T03:33:42.991704+0000","last_clean":"2024-09-17T03:33:42.991704+0000","last_became_active":"2024-09-17T03:33:40.661231+0000","last_became_peered":"2024-09-17T03:33:40.661231+0000","last_unstale":"2024-09-17T03:33:42.991704+0000","last_undegraded":"2024-09-17T03:33:42.991704+0000","last_fullsized":"2024-09-17T03:33:42.991704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:45.094726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992212+0000","last_change":"2024-09-17T03:33:41.674247+0000","last_active":"2024-09-17T03:33:42.992212+0000","last_peered":"2024-09-17T03:33:42.992212+0000","last_clean":"2024-09-17T03:33:42.992212+0000","last_became_active":"2024-09-17T03:33:41.673948+0000","last_became_peered":"2024-09-17T03:33:41.673948+0000","last_unstale":"2024-09-17T03:33:42.992212+0000","last_undegraded":"2024-09-17T03:33:42.992212+0000","last_fullsized":"2024-09-17T03:33:42.992212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:12.387230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.655667+0000","last_change":"2024-09-17T03:33:40.672072+0000","last_active":"2024-09-17T03:33:41.655667+0000","last_peered":"2024-09-17T03:33:41.655667+0000","last_clean":"2024-09-17T03:33:41.655667+0000","last_became_active":"2024-09-17T03:33:40.671735+0000","last_became_peered":"2024-09-17T03:33:40.671735+0000","last_unstale":"2024-09-17T03:33:41.655667+0000","last_undegraded":"2024-09-17T03:33:41.655667+0000","last_fullsized":"2024-09-17T03:33:41.655667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:23.354684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.655792+0000","last_change":"2024-09-17T03:33:41.659557+0000","last_active":"2024-09-17T03:33:42.655792+0000","last_peered":"2024-09-17T03:33:42.655792+0000","last_clean":"2024-09-17T03:33:42.655792+0000","last_became_active":"2024-09-17T03:33:41.659254+0000","last_became_peered":"2024-09-17T03:33:41.659254+0000","last_unstale":"2024-09-17T03:33:42.655792+0000","last_undegraded":"2024-09-17T03:33:42.655792+0000","last_fullsized":"2024-09-17T03:33:42.655792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:31.276493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.690118+0000","last_change":"2024-09-17T03:33:40.670623+0000","last_active":"2024-09-17T03:33:41.690118+0000","last_peered":"2024-09-17T03:33:41.690118+0000","last_clean":"2024-09-17T03:33:41.690118+0000","last_became_active":"2024-09-17T03:33:40.670144+0000","last_became_peered":"2024-09-17T03:33:40.670144+0000","last_unstale":"2024-09-17T03:33:41.690118+0000","last_undegraded":"2024-09-17T03:33:41.690118+0000","last_fullsized":"2024-09-17T03:33:41.690118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:29.403504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656619+0000","last_change":"2024-09-17T03:33:41.670316+0000","last_active":"2024-09-17T03:33:42.656619+0000","last_peered":"2024-09-17T03:33:42.656619+0000","last_clean":"2024-09-17T03:33:42.656619+0000","last_became_active":"2024-09-17T03:33:41.669633+0000","last_became_peered":"2024-09-17T03:33:41.669633+0000","last_unstale":"2024-09-17T03:33:42.656619+0000","last_undegraded":"2024-09-17T03:33:42.656619+0000","last_fullsized":"2024-09-17T03:33:42.656619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:04.560105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992198+0000","last_change":"2024-09-17T03:33:40.671383+0000","last_active":"2024-09-17T03:33:42.992198+0000","last_peered":"2024-09-17T03:33:42.992198+0000","last_clean":"2024-09-17T03:33:42.992198+0000","last_became_active":"2024-09-17T03:33:40.671065+0000","last_became_peered":"2024-09-17T03:33:40.671065+0000","last_unstale":"2024-09-17T03:33:42.992198+0000","last_undegraded":"2024-09-17T03:33:42.992198+0000","last_fullsized":"2024-09-17T03:33:42.992198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:13.524929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.675863+0000","last_change":"2024-09-17T03:33:41.672981+0000","last_active":"2024-09-17T03:33:41.675863+0000","last_peered":"2024-09-17T03:33:41.675863+0000","last_clean":"2024-09-17T03:33:41.675863+0000","last_became_active":"2024-09-17T03:33:41.672258+0000","last_became_peered":"2024-09-17T03:33:41.672258+0000","last_unstale":"2024-09-17T03:33:41.675863+0000","last_undegraded":"2024-09-17T03:33:41.675863+0000","last_fullsized":"2024-09-17T03:33:41.675863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:05.695841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656769+0000","last_change":"2024-09-17T03:33:40.663061+0000","last_active":"2024-09-17T03:33:42.656769+0000","last_peered":"2024-09-17T03:33:42.656769+0000","last_clean":"2024-09-17T03:33:42.656769+0000","last_became_active":"2024-09-17T03:33:40.662713+0000","last_became_peered":"2024-09-17T03:33:40.662713+0000","last_unstale":"2024-09-17T03:33:42.656769+0000","last_undegraded":"2024-09-17T03:33:42.656769+0000","last_fullsized":"2024-09-17T03:33:42.656769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:44.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991601+0000","last_change":"2024-09-17T03:33:41.678934+0000","last_active":"2024-09-17T03:33:42.991601+0000","last_peered":"2024-09-17T03:33:42.991601+0000","last_clean":"2024-09-17T03:33:42.991601+0000","last_became_active":"2024-09-17T03:33:41.678685+0000","last_became_peered":"2024-09-17T03:33:41.678685+0000","last_unstale":"2024-09-17T03:33:42.991601+0000","last_undegraded":"2024-09-17T03:33:42.991601+0000","last_fullsized":"2024-09-17T03:33:42.991601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:27.375945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656554+0000","last_change":"2024-09-17T03:33:40.664118+0000","last_active":"2024-09-17T03:33:42.656554+0000","last_peered":"2024-09-17T03:33:42.656554+0000","last_clean":"2024-09-17T03:33:42.656554+0000","last_became_active":"2024-09-17T03:33:40.663787+0000","last_became_peered":"2024-09-17T03:33:40.663787+0000","last_unstale":"2024-09-17T03:33:42.656554+0000","last_undegraded":"2024-09-17T03:33:42.656554+0000","last_fullsized":"2024-09-17T03:33:42.656554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:35.266558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993346+0000","last_change":"2024-09-17T03:33:41.677552+0000","last_active":"2024-09-17T03:33:42.993346+0000","last_peered":"2024-09-17T03:33:42.993346+0000","last_clean":"2024-09-17T03:33:42.993346+0000","last_became_active":"2024-09-17T03:33:41.677230+0000","last_became_peered":"2024-09-17T03:33:41.677230+0000","last_unstale":"2024-09-17T03:33:42.993346+0000","last_undegraded":"2024-09-17T03:33:42.993346+0000","last_fullsized":"2024-09-17T03:33:42.993346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:29.170540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656946+0000","last_change":"2024-09-17T03:33:40.664215+0000","last_active":"2024-09-17T03:33:42.656946+0000","last_peered":"2024-09-17T03:33:42.656946+0000","last_clean":"2024-09-17T03:33:42.656946+0000","last_became_active":"2024-09-17T03:33:40.663909+0000","last_became_peered":"2024-09-17T03:33:40.663909+0000","last_unstale":"2024-09-17T03:33:42.656946+0000","last_undegraded":"2024-09-17T03:33:42.656946+0000","last_fullsized":"2024-09-17T03:33:42.656946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:05.231493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993039+0000","last_change":"2024-09-17T03:33:41.668639+0000","last_active":"2024-09-17T03:33:42.993039+0000","last_peered":"2024-09-17T03:33:42.993039+0000","last_clean":"2024-09-17T03:33:42.993039+0000","last_became_active":"2024-09-17T03:33:41.668312+0000","last_became_peered":"2024-09-17T03:33:41.668312+0000","last_unstale":"2024-09-17T03:33:42.993039+0000","last_undegraded":"2024-09-17T03:33:42.993039+0000","last_fullsized":"2024-09-17T03:33:42.993039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:45.593323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992370+0000","last_change":"2024-09-17T03:33:40.664616+0000","last_active":"2024-09-17T03:33:42.992370+0000","last_peered":"2024-09-17T03:33:42.992370+0000","last_clean":"2024-09-17T03:33:42.992370+0000","last_became_active":"2024-09-17T03:33:40.664264+0000","last_became_peered":"2024-09-17T03:33:40.664264+0000","last_unstale":"2024-09-17T03:33:42.992370+0000","last_undegraded":"2024-09-17T03:33:42.992370+0000","last_fullsized":"2024-09-17T03:33:42.992370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:28.168328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993294+0000","last_change":"2024-09-17T03:33:41.667758+0000","last_active":"2024-09-17T03:33:42.993294+0000","last_peered":"2024-09-17T03:33:42.993294+0000","last_clean":"2024-09-17T03:33:42.993294+0000","last_became_active":"2024-09-17T03:33:41.667401+0000","last_became_peered":"2024-09-17T03:33:41.667401+0000","last_unstale":"2024-09-17T03:33:42.993294+0000","last_undegraded":"2024-09-17T03:33:42.993294+0000","last_fullsized":"2024-09-17T03:33:42.993294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:30.963722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656050+0000","last_change":"2024-09-17T03:33:40.662725+0000","last_active":"2024-09-17T03:33:42.656050+0000","last_peered":"2024-09-17T03:33:42.656050+0000","last_clean":"2024-09-17T03:33:42.656050+0000","last_became_active":"2024-09-17T03:33:40.662406+0000","last_became_peered":"2024-09-17T03:33:40.662406+0000","last_unstale":"2024-09-17T03:33:42.656050+0000","last_undegraded":"2024-09-17T03:33:42.656050+0000","last_fullsized":"2024-09-17T03:33:42.656050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:28.168328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992995+0000","last_change":"2024-09-17T03:33:41.669060+0000","last_active":"2024-09-17T03:33:42.992995+0000","last_peered":"2024-09-17T03:33:42.992995+0000","last_clean":"2024-09-17T03:33:42.992995+0000","last_became_active":"2024-09-17T03:33:41.667468+0000","last_became_peered":"2024-09-17T03:33:41.667468+0000","last_unstale":"2024-09-17T03:33:42.992995+0000","last_undegraded":"2024-09-17T03:33:42.992995+0000","last_fullsized":"2024-09-17T03:33:42.992995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:19.104209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656206+0000","last_change":"2024-09-17T03:33:40.664696+0000","last_active":"2024-09-17T03:33:42.656206+0000","last_peered":"2024-09-17T03:33:42.656206+0000","last_clean":"2024-09-17T03:33:42.656206+0000","last_became_active":"2024-09-17T03:33:40.660791+0000","last_became_peered":"2024-09-17T03:33:40.660791+0000","last_unstale":"2024-09-17T03:33:42.656206+0000","last_undegraded":"2024-09-17T03:33:42.656206+0000","last_fullsized":"2024-09-17T03:33:42.656206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:35.950939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991930+0000","last_change":"2024-09-17T03:33:41.677927+0000","last_active":"2024-09-17T03:33:42.991930+0000","last_peered":"2024-09-17T03:33:42.991930+0000","last_clean":"2024-09-17T03:33:42.991930+0000","last_became_active":"2024-09-17T03:33:41.677608+0000","last_became_peered":"2024-09-17T03:33:41.677608+0000","last_unstale":"2024-09-17T03:33:42.991930+0000","last_undegraded":"2024-09-17T03:33:42.991930+0000","last_fullsized":"2024-09-17T03:33:42.991930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:34.555723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.665126+0000","last_change":"2024-09-17T03:33:40.669866+0000","last_active":"2024-09-17T03:33:41.665126+0000","last_peered":"2024-09-17T03:33:41.665126+0000","last_clean":"2024-09-17T03:33:41.665126+0000","last_became_active":"2024-09-17T03:33:40.669549+0000","last_became_peered":"2024-09-17T03:33:40.669549+0000","last_unstale":"2024-09-17T03:33:41.665126+0000","last_undegraded":"2024-09-17T03:33:41.665126+0000","last_fullsized":"2024-09-17T03:33:41.665126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:57.788845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993445+0000","last_change":"2024-09-17T03:33:41.672665+0000","last_active":"2024-09-17T03:33:42.993445+0000","last_peered":"2024-09-17T03:33:42.993445+0000","last_clean":"2024-09-17T03:33:42.993445+0000","last_became_active":"2024-09-17T03:33:41.672334+0000","last_became_peered":"2024-09-17T03:33:41.672334+0000","last_unstale":"2024-09-17T03:33:42.993445+0000","last_undegraded":"2024-09-17T03:33:42.993445+0000","last_fullsized":"2024-09-17T03:33:42.993445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:59.529746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992316+0000","last_change":"2024-09-17T03:33:40.666549+0000","last_active":"2024-09-17T03:33:42.992316+0000","last_peered":"2024-09-17T03:33:42.992316+0000","last_clean":"2024-09-17T03:33:42.992316+0000","last_became_active":"2024-09-17T03:33:40.666244+0000","last_became_peered":"2024-09-17T03:33:40.666244+0000","last_unstale":"2024-09-17T03:33:42.992316+0000","last_undegraded":"2024-09-17T03:33:42.992316+0000","last_fullsized":"2024-09-17T03:33:42.992316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:41.577748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.682928+0000","last_change":"2024-09-17T03:33:41.679445+0000","last_active":"2024-09-17T03:33:41.682928+0000","last_peered":"2024-09-17T03:33:41.682928+0000","last_clean":"2024-09-17T03:33:41.682928+0000","last_became_active":"2024-09-17T03:33:41.679125+0000","last_became_peered":"2024-09-17T03:33:41.679125+0000","last_unstale":"2024-09-17T03:33:41.682928+0000","last_undegraded":"2024-09-17T03:33:41.682928+0000","last_fullsized":"2024-09-17T03:33:41.682928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:55.146128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:43.657954+0000","last_change":"2024-09-17T03:33:40.665533+0000","last_active":"2024-09-17T03:33:43.657954+0000","last_peered":"2024-09-17T03:33:43.657954+0000","last_clean":"2024-09-17T03:33:43.657954+0000","last_became_active":"2024-09-17T03:33:40.665200+0000","last_became_peered":"2024-09-17T03:33:40.665200+0000","last_unstale":"2024-09-17T03:33:43.657954+0000","last_undegraded":"2024-09-17T03:33:43.657954+0000","last_fullsized":"2024-09-17T03:33:43.657954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:17.286640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991494+0000","last_change":"2024-09-17T03:33:41.666826+0000","last_active":"2024-09-17T03:33:42.991494+0000","last_peered":"2024-09-17T03:33:42.991494+0000","last_clean":"2024-09-17T03:33:42.991494+0000","last_became_active":"2024-09-17T03:33:41.666391+0000","last_became_peered":"2024-09-17T03:33:41.666391+0000","last_unstale":"2024-09-17T03:33:42.991494+0000","last_undegraded":"2024-09-17T03:33:42.991494+0000","last_fullsized":"2024-09-17T03:33:42.991494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:05.861455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991716+0000","last_change":"2024-09-17T03:33:40.663395+0000","last_active":"2024-09-17T03:33:42.991716+0000","last_peered":"2024-09-17T03:33:42.991716+0000","last_clean":"2024-09-17T03:33:42.991716+0000","last_became_active":"2024-09-17T03:33:40.663092+0000","last_became_peered":"2024-09-17T03:33:40.663092+0000","last_unstale":"2024-09-17T03:33:42.991716+0000","last_undegraded":"2024-09-17T03:33:42.991716+0000","last_fullsized":"2024-09-17T03:33:42.991716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:47.770177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656198+0000","last_change":"2024-09-17T03:33:41.658698+0000","last_active":"2024-09-17T03:33:42.656198+0000","last_peered":"2024-09-17T03:33:42.656198+0000","last_clean":"2024-09-17T03:33:42.656198+0000","last_became_active":"2024-09-17T03:33:41.658359+0000","last_became_peered":"2024-09-17T03:33:41.658359+0000","last_unstale":"2024-09-17T03:33:42.656198+0000","last_undegraded":"2024-09-17T03:33:42.656198+0000","last_fullsized":"2024-09-17T03:33:42.656198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:20.694417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992554+0000","last_change":"2024-09-17T03:33:40.661794+0000","last_active":"2024-09-17T03:33:42.992554+0000","last_peered":"2024-09-17T03:33:42.992554+0000","last_clean":"2024-09-17T03:33:42.992554+0000","last_became_active":"2024-09-17T03:33:40.661487+0000","last_became_peered":"2024-09-17T03:33:40.661487+0000","last_unstale":"2024-09-17T03:33:42.992554+0000","last_undegraded":"2024-09-17T03:33:42.992554+0000","last_fullsized":"2024-09-17T03:33:42.992554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:59.452720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992244+0000","last_change":"2024-09-17T03:33:41.656023+0000","last_active":"2024-09-17T03:33:42.992244+0000","last_peered":"2024-09-17T03:33:42.992244+0000","last_clean":"2024-09-17T03:33:42.992244+0000","last_became_active":"2024-09-17T03:33:41.655670+0000","last_became_peered":"2024-09-17T03:33:41.655670+0000","last_unstale":"2024-09-17T03:33:42.992244+0000","last_undegraded":"2024-09-17T03:33:42.992244+0000","last_fullsized":"2024-09-17T03:33:42.992244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:34.668015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991782+0000","last_change":"2024-09-17T03:33:40.665757+0000","last_active":"2024-09-17T03:33:42.991782+0000","last_peered":"2024-09-17T03:33:42.991782+0000","last_clean":"2024-09-17T03:33:42.991782+0000","last_became_active":"2024-09-17T03:33:40.665466+0000","last_became_peered":"2024-09-17T03:33:40.665466+0000","last_unstale":"2024-09-17T03:33:42.991782+0000","last_undegraded":"2024-09-17T03:33:42.991782+0000","last_fullsized":"2024-09-17T03:33:42.991782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:54.047983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.687271+0000","last_change":"2024-09-17T03:33:41.682134+0000","last_active":"2024-09-17T03:33:41.687271+0000","last_peered":"2024-09-17T03:33:41.687271+0000","last_clean":"2024-09-17T03:33:41.687271+0000","last_became_active":"2024-09-17T03:33:41.681496+0000","last_became_peered":"2024-09-17T03:33:41.681496+0000","last_unstale":"2024-09-17T03:33:41.687271+0000","last_undegraded":"2024-09-17T03:33:41.687271+0000","last_fullsized":"2024-09-17T03:33:41.687271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:16.460288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656853+0000","last_change":"2024-09-17T03:33:40.660226+0000","last_active":"2024-09-17T03:33:42.656853+0000","last_peered":"2024-09-17T03:33:42.656853+0000","last_clean":"2024-09-17T03:33:42.656853+0000","last_became_active":"2024-09-17T03:33:40.659614+0000","last_became_peered":"2024-09-17T03:33:40.659614+0000","last_unstale":"2024-09-17T03:33:42.656853+0000","last_undegraded":"2024-09-17T03:33:42.656853+0000","last_fullsized":"2024-09-17T03:33:42.656853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:29.961510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656927+0000","last_change":"2024-09-17T03:33:41.676310+0000","last_active":"2024-09-17T03:33:42.656927+0000","last_peered":"2024-09-17T03:33:42.656927+0000","last_clean":"2024-09-17T03:33:42.656927+0000","last_became_active":"2024-09-17T03:33:41.675536+0000","last_became_peered":"2024-09-17T03:33:41.675536+0000","last_unstale":"2024-09-17T03:33:42.656927+0000","last_undegraded":"2024-09-17T03:33:42.656927+0000","last_fullsized":"2024-09-17T03:33:42.656927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:41.416808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T03:33:41.656496+0000","last_change":"2024-09-17T03:33:40.670191+0000","last_active":"2024-09-17T03:33:41.656496+0000","last_peered":"2024-09-17T03:33:41.656496+0000","last_clean":"2024-09-17T03:33:41.656496+0000","last_became_active":"2024-09-17T03:33:40.669759+0000","last_became_peered":"2024-09-17T03:33:40.669759+0000","last_unstale":"2024-09-17T03:33:41.656496+0000","last_undegraded":"2024-09-17T03:33:41.656496+0000","last_fullsized":"2024-09-17T03:33:41.656496+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:48.218566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991890+0000","last_change":"2024-09-17T03:33:41.680784+0000","last_active":"2024-09-17T03:33:42.991890+0000","last_peered":"2024-09-17T03:33:42.991890+0000","last_clean":"2024-09-17T03:33:42.991890+0000","last_became_active":"2024-09-17T03:33:41.680311+0000","last_became_peered":"2024-09-17T03:33:41.680311+0000","last_unstale":"2024-09-17T03:33:42.991890+0000","last_undegraded":"2024-09-17T03:33:42.991890+0000","last_fullsized":"2024-09-17T03:33:42.991890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:35.010455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.655675+0000","last_change":"2024-09-17T03:33:40.665655+0000","last_active":"2024-09-17T03:33:42.655675+0000","last_peered":"2024-09-17T03:33:42.655675+0000","last_clean":"2024-09-17T03:33:42.655675+0000","last_became_active":"2024-09-17T03:33:40.665242+0000","last_became_peered":"2024-09-17T03:33:40.665242+0000","last_unstale":"2024-09-17T03:33:42.655675+0000","last_undegraded":"2024-09-17T03:33:42.655675+0000","last_fullsized":"2024-09-17T03:33:42.655675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:29.961510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992306+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:33:42.992306+0000","last_peered":"2024-09-17T03:33:42.992306+0000","last_clean":"2024-09-17T03:33:42.992306+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:33:42.992306+0000","last_undegraded":"2024-09-17T03:33:42.992306+0000","last_fullsized":"2024-09-17T03:33:42.992306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":726397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":360448,"data_stored":136555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":360448,"data_stored":136043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":136009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":137573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":726307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":130311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":131273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:46.329 INFO:tasks.ceph.mds.d.smithi179.stderr:2024-09-17T03:33:46.329+0000 7ff6a6c99640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:33:49.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:33:49.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.231+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/2075070022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d40cd5d0 msgr2=0x7fe7d40cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:49.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.231+0000 7fe7dbd7b640 1 --2- 172.21.15.146:0/2075070022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d40cd5d0 0x7fe7d40cd9e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40d0b20 tx=0x7fe7cc02a820 comp rx=0 tx=0).stop 2024-09-17T03:33:49.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.231+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/2075070022 shutdown_connections 2024-09-17T03:33:49.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.231+0000 7fe7dbd7b640 1 --2- 172.21.15.146:0/2075070022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d40cd5d0 0x7fe7d40cd9e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.231+0000 7fe7dbd7b640 1 --2- 172.21.15.146:0/2075070022 >> v2:172.21.15.179:3300/0 conn(0x7fe7d40b47c0 0x7fe7d40cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.231+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/2075070022 >> 172.21.15.146:0/2075070022 conn(0x7fe7d409ba20 msgr2=0x7fe7d40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:49.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.231+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/2075070022 shutdown_connections 2024-09-17T03:33:49.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.231+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/2075070022 wait complete. 2024-09-17T03:33:49.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.233+0000 7fe7dbd7b640 1 Processor -- start 2024-09-17T03:33:49.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.233+0000 7fe7dbd7b640 1 -- start start 2024-09-17T03:33:49.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.234+0000 7fe7dbd7b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d40b47c0 0x7fe7d41e3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:49.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.234+0000 7fe7dbd7b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d40cd5d0 0x7fe7d40b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:49.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.234+0000 7fe7dbd7b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d40d0710 0x7fe7d41e4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:49.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.234+0000 7fe7dbd7b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d40b1de0 con 0x7fe7d40d0710 2024-09-17T03:33:49.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.234+0000 7fe7dbd7b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d40b80a0 con 0x7fe7d40b47c0 2024-09-17T03:33:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.234+0000 7fe7dbd7b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d40b1f60 con 0x7fe7d40cd5d0 2024-09-17T03:33:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7da318640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d40d0710 0x7fe7d41e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7da318640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d40d0710 0x7fe7d41e4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58634/0 (socket says 172.21.15.146:58634) 2024-09-17T03:33:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7da318640 1 -- 172.21.15.146:0/84512165 learned_addr learned my addr 172.21.15.146:0/84512165 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7d9b17640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d40b47c0 0x7fe7d41e3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7d9316640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d40cd5d0 0x7fe7d40b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7da318640 1 -- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d40cd5d0 msgr2=0x7fe7d40b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7da318640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d40cd5d0 0x7fe7d40b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7da318640 1 -- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d40b47c0 msgr2=0x7fe7d41e3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:49.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7da318640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d40b47c0 0x7fe7d41e3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7da318640 1 -- 172.21.15.146:0/84512165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d406f000 con 0x7fe7d40d0710 2024-09-17T03:33:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7da318640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d40d0710 0x7fe7d41e4780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009b30 tx=0x7fe7cc032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7ca7fc640 1 -- 172.21.15.146:0/84512165 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc037040 con 0x7fe7d40d0710 2024-09-17T03:33:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7ca7fc640 1 -- 172.21.15.146:0/84512165 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7cc042070 con 0x7fe7d40d0710 2024-09-17T03:33:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/84512165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d406f2e0 con 0x7fe7d40d0710 2024-09-17T03:33:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7ca7fc640 1 -- 172.21.15.146:0/84512165 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0042a0 con 0x7fe7d40d0710 2024-09-17T03:33:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.235+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/84512165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d406f8a0 con 0x7fe7d40d0710 2024-09-17T03:33:49.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.236+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/84512165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d40b62c0 con 0x7fe7d40d0710 2024-09-17T03:33:49.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.238+0000 7fe7ca7fc640 1 -- 172.21.15.146:0/84512165 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe7cc004440 con 0x7fe7d40d0710 2024-09-17T03:33:49.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.238+0000 7fe7ca7fc640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7b8078bc0 0x7fe7b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:49.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.238+0000 7fe7ca7fc640 1 -- 172.21.15.146:0/84512165 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe7cc0bc480 con 0x7fe7d40d0710 2024-09-17T03:33:49.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.239+0000 7fe7d9b17640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7b8078bc0 0x7fe7b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:49.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.239+0000 7fe7d9b17640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7b8078bc0 0x7fe7b807b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0007fd0 tx=0x7fe7d0001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:49.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.242+0000 7fe7ca7fc640 1 -- 172.21.15.146:0/84512165 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe7d40b62c0 con 0x7fe7d40d0710 2024-09-17T03:33:49.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.421+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/84512165 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7d40cd090 con 0x7fe7b8078bc0 2024-09-17T03:33:49.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.426+0000 7fe7ca7fc640 1 -- 172.21.15.146:0/84512165 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251928 (secure 0 0 0) 0x7fe7d40cd090 con 0x7fe7b8078bc0 2024-09-17T03:33:49.429 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:49.430 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:33:49.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.429+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7b8078bc0 msgr2=0x7fe7b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:49.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.429+0000 7fe7dbd7b640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7b8078bc0 0x7fe7b807b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0007fd0 tx=0x7fe7d0001370 comp rx=0 tx=0).stop 2024-09-17T03:33:49.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.429+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/84512165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d40d0710 msgr2=0x7fe7d41e4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:49.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.429+0000 7fe7dbd7b640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d40d0710 0x7fe7d41e4780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009b30 tx=0x7fe7cc032c90 comp rx=0 tx=0).stop 2024-09-17T03:33:49.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.429+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/84512165 shutdown_connections 2024-09-17T03:33:49.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.429+0000 7fe7dbd7b640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7b8078bc0 0x7fe7b807b0d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.429+0000 7fe7dbd7b640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7d40d0710 0x7fe7d41e4780 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.429+0000 7fe7dbd7b640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7d40cd5d0 0x7fe7d40b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.429+0000 7fe7dbd7b640 1 --2- 172.21.15.146:0/84512165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7d40b47c0 0x7fe7d41e3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.429+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/84512165 >> 172.21.15.146:0/84512165 conn(0x7fe7d409ba20 msgr2=0x7fe7d4071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:49.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.429+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/84512165 shutdown_connections 2024-09-17T03:33:49.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.430+0000 7fe7dbd7b640 1 -- 172.21.15.146:0/84512165 wait complete. 2024-09-17T03:33:49.440 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-17T03:33:47.800463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220232,"kb_used_data":3976,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754488,"statfs":{"total":773094113280,"available":772868595712,"internally_reserved":0,"allocated":4071424,"data_stored":2273068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.152741"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657467+0000","last_change":"2024-09-17T03:33:41.674817+0000","last_active":"2024-09-17T03:33:42.657467+0000","last_peered":"2024-09-17T03:33:42.657467+0000","last_clean":"2024-09-17T03:33:42.657467+0000","last_became_active":"2024-09-17T03:33:41.674464+0000","last_became_peered":"2024-09-17T03:33:41.674464+0000","last_unstale":"2024-09-17T03:33:42.657467+0000","last_undegraded":"2024-09-17T03:33:42.657467+0000","last_fullsized":"2024-09-17T03:33:42.657467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:40.185907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652403+0000","last_change":"2024-09-17T03:33:41.662887+0000","last_active":"2024-09-17T03:33:42.652403+0000","last_peered":"2024-09-17T03:33:42.652403+0000","last_clean":"2024-09-17T03:33:42.652403+0000","last_became_active":"2024-09-17T03:33:41.662600+0000","last_became_peered":"2024-09-17T03:33:41.662600+0000","last_unstale":"2024-09-17T03:33:42.652403+0000","last_undegraded":"2024-09-17T03:33:42.652403+0000","last_fullsized":"2024-09-17T03:33:42.652403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:51.917059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992399+0000","last_change":"2024-09-17T03:33:41.676205+0000","last_active":"2024-09-17T03:33:42.992399+0000","last_peered":"2024-09-17T03:33:42.992399+0000","last_clean":"2024-09-17T03:33:42.992399+0000","last_became_active":"2024-09-17T03:33:41.675785+0000","last_became_peered":"2024-09-17T03:33:41.675785+0000","last_unstale":"2024-09-17T03:33:42.992399+0000","last_undegraded":"2024-09-17T03:33:42.992399+0000","last_fullsized":"2024-09-17T03:33:42.992399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:32.382836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991356+0000","last_change":"2024-09-17T03:33:41.677552+0000","last_active":"2024-09-17T03:33:42.991356+0000","last_peered":"2024-09-17T03:33:42.991356+0000","last_clean":"2024-09-17T03:33:42.991356+0000","last_became_active":"2024-09-17T03:33:41.677121+0000","last_became_peered":"2024-09-17T03:33:41.677121+0000","last_unstale":"2024-09-17T03:33:42.991356+0000","last_undegraded":"2024-09-17T03:33:42.991356+0000","last_fullsized":"2024-09-17T03:33:42.991356+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:34.600296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993052+0000","last_change":"2024-09-17T03:33:41.670621+0000","last_active":"2024-09-17T03:33:42.993052+0000","last_peered":"2024-09-17T03:33:42.993052+0000","last_clean":"2024-09-17T03:33:42.993052+0000","last_became_active":"2024-09-17T03:33:41.670308+0000","last_became_peered":"2024-09-17T03:33:41.670308+0000","last_unstale":"2024-09-17T03:33:42.993052+0000","last_undegraded":"2024-09-17T03:33:42.993052+0000","last_fullsized":"2024-09-17T03:33:42.993052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:36.953151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652064+0000","last_change":"2024-09-17T03:33:41.673177+0000","last_active":"2024-09-17T03:33:42.652064+0000","last_peered":"2024-09-17T03:33:42.652064+0000","last_clean":"2024-09-17T03:33:42.652064+0000","last_became_active":"2024-09-17T03:33:41.671525+0000","last_became_peered":"2024-09-17T03:33:41.671525+0000","last_unstale":"2024-09-17T03:33:42.652064+0000","last_undegraded":"2024-09-17T03:33:42.652064+0000","last_fullsized":"2024-09-17T03:33:42.652064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:29.934984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992197+0000","last_change":"2024-09-17T03:33:41.678710+0000","last_active":"2024-09-17T03:33:42.992197+0000","last_peered":"2024-09-17T03:33:42.992197+0000","last_clean":"2024-09-17T03:33:42.992197+0000","last_became_active":"2024-09-17T03:33:41.678414+0000","last_became_peered":"2024-09-17T03:33:41.678414+0000","last_unstale":"2024-09-17T03:33:42.992197+0000","last_undegraded":"2024-09-17T03:33:42.992197+0000","last_fullsized":"2024-09-17T03:33:42.992197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:40.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991726+0000","last_change":"2024-09-17T03:33:41.679451+0000","last_active":"2024-09-17T03:33:42.991726+0000","last_peered":"2024-09-17T03:33:42.991726+0000","last_clean":"2024-09-17T03:33:42.991726+0000","last_became_active":"2024-09-17T03:33:41.679145+0000","last_became_peered":"2024-09-17T03:33:41.679145+0000","last_unstale":"2024-09-17T03:33:42.991726+0000","last_undegraded":"2024-09-17T03:33:42.991726+0000","last_fullsized":"2024-09-17T03:33:42.991726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:13.155949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657055+0000","last_change":"2024-09-17T03:33:41.673577+0000","last_active":"2024-09-17T03:33:42.657055+0000","last_peered":"2024-09-17T03:33:42.657055+0000","last_clean":"2024-09-17T03:33:42.657055+0000","last_became_active":"2024-09-17T03:33:41.673276+0000","last_became_peered":"2024-09-17T03:33:41.673276+0000","last_unstale":"2024-09-17T03:33:42.657055+0000","last_undegraded":"2024-09-17T03:33:42.657055+0000","last_fullsized":"2024-09-17T03:33:42.657055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:22.290357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991503+0000","last_change":"2024-09-17T03:33:41.671601+0000","last_active":"2024-09-17T03:33:42.991503+0000","last_peered":"2024-09-17T03:33:42.991503+0000","last_clean":"2024-09-17T03:33:42.991503+0000","last_became_active":"2024-09-17T03:33:41.671214+0000","last_became_peered":"2024-09-17T03:33:41.671214+0000","last_unstale":"2024-09-17T03:33:42.991503+0000","last_undegraded":"2024-09-17T03:33:42.991503+0000","last_fullsized":"2024-09-17T03:33:42.991503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:22.290357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992704+0000","last_change":"2024-09-17T03:33:41.681838+0000","last_active":"2024-09-17T03:33:42.992704+0000","last_peered":"2024-09-17T03:33:42.992704+0000","last_clean":"2024-09-17T03:33:42.992704+0000","last_became_active":"2024-09-17T03:33:41.681486+0000","last_became_peered":"2024-09-17T03:33:41.681486+0000","last_unstale":"2024-09-17T03:33:42.992704+0000","last_undegraded":"2024-09-17T03:33:42.992704+0000","last_fullsized":"2024-09-17T03:33:42.992704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:11.391267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991890+0000","last_change":"2024-09-17T03:33:41.683531+0000","last_active":"2024-09-17T03:33:42.991890+0000","last_peered":"2024-09-17T03:33:42.991890+0000","last_clean":"2024-09-17T03:33:42.991890+0000","last_became_active":"2024-09-17T03:33:41.683185+0000","last_became_peered":"2024-09-17T03:33:41.683185+0000","last_unstale":"2024-09-17T03:33:42.991890+0000","last_undegraded":"2024-09-17T03:33:42.991890+0000","last_fullsized":"2024-09-17T03:33:42.991890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:29.209210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993273+0000","last_change":"2024-09-17T03:33:41.669624+0000","last_active":"2024-09-17T03:33:42.993273+0000","last_peered":"2024-09-17T03:33:42.993273+0000","last_clean":"2024-09-17T03:33:42.993273+0000","last_became_active":"2024-09-17T03:33:41.669299+0000","last_became_peered":"2024-09-17T03:33:41.669299+0000","last_unstale":"2024-09-17T03:33:42.993273+0000","last_undegraded":"2024-09-17T03:33:42.993273+0000","last_fullsized":"2024-09-17T03:33:42.993273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:36.268770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652213+0000","last_change":"2024-09-17T03:33:41.669466+0000","last_active":"2024-09-17T03:33:42.652213+0000","last_peered":"2024-09-17T03:33:42.652213+0000","last_clean":"2024-09-17T03:33:42.652213+0000","last_became_active":"2024-09-17T03:33:41.668995+0000","last_became_peered":"2024-09-17T03:33:41.668995+0000","last_unstale":"2024-09-17T03:33:42.652213+0000","last_undegraded":"2024-09-17T03:33:42.652213+0000","last_fullsized":"2024-09-17T03:33:42.652213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:32.382836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991181+0000","last_change":"2024-09-17T03:33:41.680388+0000","last_active":"2024-09-17T03:33:42.991181+0000","last_peered":"2024-09-17T03:33:42.991181+0000","last_clean":"2024-09-17T03:33:42.991181+0000","last_became_active":"2024-09-17T03:33:41.680067+0000","last_became_peered":"2024-09-17T03:33:41.680067+0000","last_unstale":"2024-09-17T03:33:42.991181+0000","last_undegraded":"2024-09-17T03:33:42.991181+0000","last_fullsized":"2024-09-17T03:33:42.991181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:41.459158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992317+0000","last_change":"2024-09-17T03:33:41.687970+0000","last_active":"2024-09-17T03:33:42.992317+0000","last_peered":"2024-09-17T03:33:42.992317+0000","last_clean":"2024-09-17T03:33:42.992317+0000","last_became_active":"2024-09-17T03:33:41.687623+0000","last_became_peered":"2024-09-17T03:33:41.687623+0000","last_unstale":"2024-09-17T03:33:42.992317+0000","last_undegraded":"2024-09-17T03:33:42.992317+0000","last_fullsized":"2024-09-17T03:33:42.992317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:33.081092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992563+0000","last_change":"2024-09-17T03:33:41.677678+0000","last_active":"2024-09-17T03:33:42.992563+0000","last_peered":"2024-09-17T03:33:42.992563+0000","last_clean":"2024-09-17T03:33:42.992563+0000","last_became_active":"2024-09-17T03:33:41.677170+0000","last_became_peered":"2024-09-17T03:33:41.677170+0000","last_unstale":"2024-09-17T03:33:42.992563+0000","last_undegraded":"2024-09-17T03:33:42.992563+0000","last_fullsized":"2024-09-17T03:33:42.992563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:32.711035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652494+0000","last_change":"2024-09-17T03:33:41.676041+0000","last_active":"2024-09-17T03:33:42.652494+0000","last_peered":"2024-09-17T03:33:42.652494+0000","last_clean":"2024-09-17T03:33:42.652494+0000","last_became_active":"2024-09-17T03:33:41.675417+0000","last_became_peered":"2024-09-17T03:33:41.675417+0000","last_unstale":"2024-09-17T03:33:42.652494+0000","last_undegraded":"2024-09-17T03:33:42.652494+0000","last_fullsized":"2024-09-17T03:33:42.652494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:39.040573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652120+0000","last_change":"2024-09-17T03:33:41.667308+0000","last_active":"2024-09-17T03:33:42.652120+0000","last_peered":"2024-09-17T03:33:42.652120+0000","last_clean":"2024-09-17T03:33:42.652120+0000","last_became_active":"2024-09-17T03:33:41.666990+0000","last_became_peered":"2024-09-17T03:33:41.666990+0000","last_unstale":"2024-09-17T03:33:42.652120+0000","last_undegraded":"2024-09-17T03:33:42.652120+0000","last_fullsized":"2024-09-17T03:33:42.652120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:32.795208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993315+0000","last_change":"2024-09-17T03:33:41.673295+0000","last_active":"2024-09-17T03:33:42.993315+0000","last_peered":"2024-09-17T03:33:42.993315+0000","last_clean":"2024-09-17T03:33:42.993315+0000","last_became_active":"2024-09-17T03:33:41.672985+0000","last_became_peered":"2024-09-17T03:33:41.672985+0000","last_unstale":"2024-09-17T03:33:42.993315+0000","last_undegraded":"2024-09-17T03:33:42.993315+0000","last_fullsized":"2024-09-17T03:33:42.993315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:06.233705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656996+0000","last_change":"2024-09-17T03:33:41.667523+0000","last_active":"2024-09-17T03:33:42.656996+0000","last_peered":"2024-09-17T03:33:42.656996+0000","last_clean":"2024-09-17T03:33:42.656996+0000","last_became_active":"2024-09-17T03:33:41.667133+0000","last_became_peered":"2024-09-17T03:33:41.667133+0000","last_unstale":"2024-09-17T03:33:42.656996+0000","last_undegraded":"2024-09-17T03:33:42.656996+0000","last_fullsized":"2024-09-17T03:33:42.656996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:16.834058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656808+0000","last_change":"2024-09-17T03:33:41.675178+0000","last_active":"2024-09-17T03:33:42.656808+0000","last_peered":"2024-09-17T03:33:42.656808+0000","last_clean":"2024-09-17T03:33:42.656808+0000","last_became_active":"2024-09-17T03:33:41.674823+0000","last_became_peered":"2024-09-17T03:33:41.674823+0000","last_unstale":"2024-09-17T03:33:42.656808+0000","last_undegraded":"2024-09-17T03:33:42.656808+0000","last_fullsized":"2024-09-17T03:33:42.656808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:51.240971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991745+0000","last_change":"2024-09-17T03:33:41.672659+0000","last_active":"2024-09-17T03:33:42.991745+0000","last_peered":"2024-09-17T03:33:42.991745+0000","last_clean":"2024-09-17T03:33:42.991745+0000","last_became_active":"2024-09-17T03:33:41.672284+0000","last_became_peered":"2024-09-17T03:33:41.672284+0000","last_unstale":"2024-09-17T03:33:42.991745+0000","last_undegraded":"2024-09-17T03:33:42.991745+0000","last_fullsized":"2024-09-17T03:33:42.991745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:04.560105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991194+0000","last_change":"2024-09-17T03:33:41.672443+0000","last_active":"2024-09-17T03:33:42.991194+0000","last_peered":"2024-09-17T03:33:42.991194+0000","last_clean":"2024-09-17T03:33:42.991194+0000","last_became_active":"2024-09-17T03:33:41.672025+0000","last_became_peered":"2024-09-17T03:33:41.672025+0000","last_unstale":"2024-09-17T03:33:42.991194+0000","last_undegraded":"2024-09-17T03:33:42.991194+0000","last_fullsized":"2024-09-17T03:33:42.991194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:54.948434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991985+0000","last_change":"2024-09-17T03:33:41.684412+0000","last_active":"2024-09-17T03:33:42.991985+0000","last_peered":"2024-09-17T03:33:42.991985+0000","last_clean":"2024-09-17T03:33:42.991985+0000","last_became_active":"2024-09-17T03:33:41.683918+0000","last_became_peered":"2024-09-17T03:33:41.683918+0000","last_unstale":"2024-09-17T03:33:42.991985+0000","last_undegraded":"2024-09-17T03:33:42.991985+0000","last_fullsized":"2024-09-17T03:33:42.991985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:44.044011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652717+0000","last_change":"2024-09-17T03:33:41.675720+0000","last_active":"2024-09-17T03:33:42.652717+0000","last_peered":"2024-09-17T03:33:42.652717+0000","last_clean":"2024-09-17T03:33:42.652717+0000","last_became_active":"2024-09-17T03:33:41.674212+0000","last_became_peered":"2024-09-17T03:33:41.674212+0000","last_unstale":"2024-09-17T03:33:42.652717+0000","last_undegraded":"2024-09-17T03:33:42.652717+0000","last_fullsized":"2024-09-17T03:33:42.652717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:30.392793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992470+0000","last_change":"2024-09-17T03:33:41.678048+0000","last_active":"2024-09-17T03:33:42.992470+0000","last_peered":"2024-09-17T03:33:42.992470+0000","last_clean":"2024-09-17T03:33:42.992470+0000","last_became_active":"2024-09-17T03:33:41.677672+0000","last_became_peered":"2024-09-17T03:33:41.677672+0000","last_unstale":"2024-09-17T03:33:42.992470+0000","last_undegraded":"2024-09-17T03:33:42.992470+0000","last_fullsized":"2024-09-17T03:33:42.992470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:52.711071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991916+0000","last_change":"2024-09-17T03:33:41.667684+0000","last_active":"2024-09-17T03:33:42.991916+0000","last_peered":"2024-09-17T03:33:42.991916+0000","last_clean":"2024-09-17T03:33:42.991916+0000","last_became_active":"2024-09-17T03:33:41.667362+0000","last_became_peered":"2024-09-17T03:33:41.667362+0000","last_unstale":"2024-09-17T03:33:42.991916+0000","last_undegraded":"2024-09-17T03:33:42.991916+0000","last_fullsized":"2024-09-17T03:33:42.991916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:32.795208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656729+0000","last_change":"2024-09-17T03:33:41.674572+0000","last_active":"2024-09-17T03:33:42.656729+0000","last_peered":"2024-09-17T03:33:42.656729+0000","last_clean":"2024-09-17T03:33:42.656729+0000","last_became_active":"2024-09-17T03:33:41.674306+0000","last_became_peered":"2024-09-17T03:33:41.674306+0000","last_unstale":"2024-09-17T03:33:42.656729+0000","last_undegraded":"2024-09-17T03:33:42.656729+0000","last_fullsized":"2024-09-17T03:33:42.656729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:34.668015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992487+0000","last_change":"2024-09-17T03:33:41.677756+0000","last_active":"2024-09-17T03:33:42.992487+0000","last_peered":"2024-09-17T03:33:42.992487+0000","last_clean":"2024-09-17T03:33:42.992487+0000","last_became_active":"2024-09-17T03:33:41.676032+0000","last_became_peered":"2024-09-17T03:33:41.676032+0000","last_unstale":"2024-09-17T03:33:42.992487+0000","last_undegraded":"2024-09-17T03:33:42.992487+0000","last_fullsized":"2024-09-17T03:33:42.992487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:12.662192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.655856+0000","last_change":"2024-09-17T03:33:41.665587+0000","last_active":"2024-09-17T03:33:42.655856+0000","last_peered":"2024-09-17T03:33:42.655856+0000","last_clean":"2024-09-17T03:33:42.655856+0000","last_became_active":"2024-09-17T03:33:41.663632+0000","last_became_peered":"2024-09-17T03:33:41.663632+0000","last_unstale":"2024-09-17T03:33:42.655856+0000","last_undegraded":"2024-09-17T03:33:42.655856+0000","last_fullsized":"2024-09-17T03:33:42.655856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:22.573724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991721+0000","last_change":"2024-09-17T03:33:41.673469+0000","last_active":"2024-09-17T03:33:42.991721+0000","last_peered":"2024-09-17T03:33:42.991721+0000","last_clean":"2024-09-17T03:33:42.991721+0000","last_became_active":"2024-09-17T03:33:41.673147+0000","last_became_peered":"2024-09-17T03:33:41.673147+0000","last_unstale":"2024-09-17T03:33:42.991721+0000","last_undegraded":"2024-09-17T03:33:42.991721+0000","last_fullsized":"2024-09-17T03:33:42.991721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:38.028530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991311+0000","last_change":"2024-09-17T03:33:41.673716+0000","last_active":"2024-09-17T03:33:42.991311+0000","last_peered":"2024-09-17T03:33:42.991311+0000","last_clean":"2024-09-17T03:33:42.991311+0000","last_became_active":"2024-09-17T03:33:41.673397+0000","last_became_peered":"2024-09-17T03:33:41.673397+0000","last_unstale":"2024-09-17T03:33:42.991311+0000","last_undegraded":"2024-09-17T03:33:42.991311+0000","last_fullsized":"2024-09-17T03:33:42.991311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:40.185907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657606+0000","last_change":"2024-09-17T03:33:40.660677+0000","last_active":"2024-09-17T03:33:42.657606+0000","last_peered":"2024-09-17T03:33:42.657606+0000","last_clean":"2024-09-17T03:33:42.657606+0000","last_became_active":"2024-09-17T03:33:40.660345+0000","last_became_peered":"2024-09-17T03:33:40.660345+0000","last_unstale":"2024-09-17T03:33:42.657606+0000","last_undegraded":"2024-09-17T03:33:42.657606+0000","last_fullsized":"2024-09-17T03:33:42.657606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:05.231493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657527+0000","last_change":"2024-09-17T03:33:41.660349+0000","last_active":"2024-09-17T03:33:42.657527+0000","last_peered":"2024-09-17T03:33:42.657527+0000","last_clean":"2024-09-17T03:33:42.657527+0000","last_became_active":"2024-09-17T03:33:41.660039+0000","last_became_peered":"2024-09-17T03:33:41.660039+0000","last_unstale":"2024-09-17T03:33:42.657527+0000","last_undegraded":"2024-09-17T03:33:42.657527+0000","last_fullsized":"2024-09-17T03:33:42.657527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:05.861455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991453+0000","last_change":"2024-09-17T03:33:40.668406+0000","last_active":"2024-09-17T03:33:42.991453+0000","last_peered":"2024-09-17T03:33:42.991453+0000","last_clean":"2024-09-17T03:33:42.991453+0000","last_became_active":"2024-09-17T03:33:40.667453+0000","last_became_peered":"2024-09-17T03:33:40.667453+0000","last_unstale":"2024-09-17T03:33:42.991453+0000","last_undegraded":"2024-09-17T03:33:42.991453+0000","last_fullsized":"2024-09-17T03:33:42.991453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:58.527534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657005+0000","last_change":"2024-09-17T03:33:41.674410+0000","last_active":"2024-09-17T03:33:42.657005+0000","last_peered":"2024-09-17T03:33:42.657005+0000","last_clean":"2024-09-17T03:33:42.657005+0000","last_became_active":"2024-09-17T03:33:41.674137+0000","last_became_peered":"2024-09-17T03:33:41.674137+0000","last_unstale":"2024-09-17T03:33:42.657005+0000","last_undegraded":"2024-09-17T03:33:42.657005+0000","last_fullsized":"2024-09-17T03:33:42.657005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:44.356306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652248+0000","last_change":"2024-09-17T03:33:40.670251+0000","last_active":"2024-09-17T03:33:42.652248+0000","last_peered":"2024-09-17T03:33:42.652248+0000","last_clean":"2024-09-17T03:33:42.652248+0000","last_became_active":"2024-09-17T03:33:40.669956+0000","last_became_peered":"2024-09-17T03:33:40.669956+0000","last_unstale":"2024-09-17T03:33:42.652248+0000","last_undegraded":"2024-09-17T03:33:42.652248+0000","last_fullsized":"2024-09-17T03:33:42.652248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:04.466425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992567+0000","last_change":"2024-09-17T03:33:41.665075+0000","last_active":"2024-09-17T03:33:42.992567+0000","last_peered":"2024-09-17T03:33:42.992567+0000","last_clean":"2024-09-17T03:33:42.992567+0000","last_became_active":"2024-09-17T03:33:41.664510+0000","last_became_peered":"2024-09-17T03:33:41.664510+0000","last_unstale":"2024-09-17T03:33:42.992567+0000","last_undegraded":"2024-09-17T03:33:42.992567+0000","last_fullsized":"2024-09-17T03:33:42.992567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:13.155949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993255+0000","last_change":"2024-09-17T03:33:40.664419+0000","last_active":"2024-09-17T03:33:42.993255+0000","last_peered":"2024-09-17T03:33:42.993255+0000","last_clean":"2024-09-17T03:33:42.993255+0000","last_became_active":"2024-09-17T03:33:40.664096+0000","last_became_peered":"2024-09-17T03:33:40.664096+0000","last_unstale":"2024-09-17T03:33:42.993255+0000","last_undegraded":"2024-09-17T03:33:42.993255+0000","last_fullsized":"2024-09-17T03:33:42.993255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:19.501660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991886+0000","last_change":"2024-09-17T03:33:41.672384+0000","last_active":"2024-09-17T03:33:42.991886+0000","last_peered":"2024-09-17T03:33:42.991886+0000","last_clean":"2024-09-17T03:33:42.991886+0000","last_became_active":"2024-09-17T03:33:41.672092+0000","last_became_peered":"2024-09-17T03:33:41.672092+0000","last_unstale":"2024-09-17T03:33:42.991886+0000","last_undegraded":"2024-09-17T03:33:42.991886+0000","last_fullsized":"2024-09-17T03:33:42.991886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:55.089034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657037+0000","last_change":"2024-09-17T03:33:40.664363+0000","last_active":"2024-09-17T03:33:42.657037+0000","last_peered":"2024-09-17T03:33:42.657037+0000","last_clean":"2024-09-17T03:33:42.657037+0000","last_became_active":"2024-09-17T03:33:40.664039+0000","last_became_peered":"2024-09-17T03:33:40.664039+0000","last_unstale":"2024-09-17T03:33:42.657037+0000","last_undegraded":"2024-09-17T03:33:42.657037+0000","last_fullsized":"2024-09-17T03:33:42.657037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:28.168328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991557+0000","last_change":"2024-09-17T03:33:41.673601+0000","last_active":"2024-09-17T03:33:42.991557+0000","last_peered":"2024-09-17T03:33:42.991557+0000","last_clean":"2024-09-17T03:33:42.991557+0000","last_became_active":"2024-09-17T03:33:41.673307+0000","last_became_peered":"2024-09-17T03:33:41.673307+0000","last_unstale":"2024-09-17T03:33:42.991557+0000","last_undegraded":"2024-09-17T03:33:42.991557+0000","last_fullsized":"2024-09-17T03:33:42.991557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:16.460288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657119+0000","last_change":"2024-09-17T03:33:40.663470+0000","last_active":"2024-09-17T03:33:42.657119+0000","last_peered":"2024-09-17T03:33:42.657119+0000","last_clean":"2024-09-17T03:33:42.657119+0000","last_became_active":"2024-09-17T03:33:40.663098+0000","last_became_peered":"2024-09-17T03:33:40.663098+0000","last_unstale":"2024-09-17T03:33:42.657119+0000","last_undegraded":"2024-09-17T03:33:42.657119+0000","last_fullsized":"2024-09-17T03:33:42.657119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:18.101997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.655866+0000","last_change":"2024-09-17T03:33:41.672506+0000","last_active":"2024-09-17T03:33:42.655866+0000","last_peered":"2024-09-17T03:33:42.655866+0000","last_clean":"2024-09-17T03:33:42.655866+0000","last_became_active":"2024-09-17T03:33:41.672036+0000","last_became_peered":"2024-09-17T03:33:41.672036+0000","last_unstale":"2024-09-17T03:33:42.655866+0000","last_undegraded":"2024-09-17T03:33:42.655866+0000","last_fullsized":"2024-09-17T03:33:42.655866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:05.861455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.651816+0000","last_change":"2024-09-17T03:33:40.668613+0000","last_active":"2024-09-17T03:33:42.651816+0000","last_peered":"2024-09-17T03:33:42.651816+0000","last_clean":"2024-09-17T03:33:42.651816+0000","last_became_active":"2024-09-17T03:33:40.668131+0000","last_became_peered":"2024-09-17T03:33:40.668131+0000","last_unstale":"2024-09-17T03:33:42.651816+0000","last_undegraded":"2024-09-17T03:33:42.651816+0000","last_fullsized":"2024-09-17T03:33:42.651816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:05.271520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991156+0000","last_change":"2024-09-17T03:33:41.669562+0000","last_active":"2024-09-17T03:33:42.991156+0000","last_peered":"2024-09-17T03:33:42.991156+0000","last_clean":"2024-09-17T03:33:42.991156+0000","last_became_active":"2024-09-17T03:33:41.668768+0000","last_became_peered":"2024-09-17T03:33:41.668768+0000","last_unstale":"2024-09-17T03:33:42.991156+0000","last_undegraded":"2024-09-17T03:33:42.991156+0000","last_fullsized":"2024-09-17T03:33:42.991156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:41.416808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.655799+0000","last_change":"2024-09-17T03:33:40.658632+0000","last_active":"2024-09-17T03:33:42.655799+0000","last_peered":"2024-09-17T03:33:42.655799+0000","last_clean":"2024-09-17T03:33:42.655799+0000","last_became_active":"2024-09-17T03:33:40.658275+0000","last_became_peered":"2024-09-17T03:33:40.658275+0000","last_unstale":"2024-09-17T03:33:42.655799+0000","last_undegraded":"2024-09-17T03:33:42.655799+0000","last_fullsized":"2024-09-17T03:33:42.655799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:17.923962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992369+0000","last_change":"2024-09-17T03:33:41.672818+0000","last_active":"2024-09-17T03:33:42.992369+0000","last_peered":"2024-09-17T03:33:42.992369+0000","last_clean":"2024-09-17T03:33:42.992369+0000","last_became_active":"2024-09-17T03:33:41.672405+0000","last_became_peered":"2024-09-17T03:33:41.672405+0000","last_unstale":"2024-09-17T03:33:42.992369+0000","last_undegraded":"2024-09-17T03:33:42.992369+0000","last_fullsized":"2024-09-17T03:33:42.992369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:29.934984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652622+0000","last_change":"2024-09-17T03:33:40.671952+0000","last_active":"2024-09-17T03:33:42.652622+0000","last_peered":"2024-09-17T03:33:42.652622+0000","last_clean":"2024-09-17T03:33:42.652622+0000","last_became_active":"2024-09-17T03:33:40.671688+0000","last_became_peered":"2024-09-17T03:33:40.671688+0000","last_unstale":"2024-09-17T03:33:42.652622+0000","last_undegraded":"2024-09-17T03:33:42.652622+0000","last_fullsized":"2024-09-17T03:33:42.652622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:41.813739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652488+0000","last_change":"2024-09-17T03:33:41.673698+0000","last_active":"2024-09-17T03:33:42.652488+0000","last_peered":"2024-09-17T03:33:42.652488+0000","last_clean":"2024-09-17T03:33:42.652488+0000","last_became_active":"2024-09-17T03:33:41.673373+0000","last_became_peered":"2024-09-17T03:33:41.673373+0000","last_unstale":"2024-09-17T03:33:42.652488+0000","last_undegraded":"2024-09-17T03:33:42.652488+0000","last_fullsized":"2024-09-17T03:33:42.652488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:24.601155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991562+0000","last_change":"2024-09-17T03:33:40.666374+0000","last_active":"2024-09-17T03:33:42.991562+0000","last_peered":"2024-09-17T03:33:42.991562+0000","last_clean":"2024-09-17T03:33:42.991562+0000","last_became_active":"2024-09-17T03:33:40.666113+0000","last_became_peered":"2024-09-17T03:33:40.666113+0000","last_unstale":"2024-09-17T03:33:42.991562+0000","last_undegraded":"2024-09-17T03:33:42.991562+0000","last_fullsized":"2024-09-17T03:33:42.991562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:17.463874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652334+0000","last_change":"2024-09-17T03:33:41.681730+0000","last_active":"2024-09-17T03:33:42.652334+0000","last_peered":"2024-09-17T03:33:42.652334+0000","last_clean":"2024-09-17T03:33:42.652334+0000","last_became_active":"2024-09-17T03:33:41.678867+0000","last_became_peered":"2024-09-17T03:33:41.678867+0000","last_unstale":"2024-09-17T03:33:42.652334+0000","last_undegraded":"2024-09-17T03:33:42.652334+0000","last_fullsized":"2024-09-17T03:33:42.652334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:21.956146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992649+0000","last_change":"2024-09-17T03:33:40.667467+0000","last_active":"2024-09-17T03:33:42.992649+0000","last_peered":"2024-09-17T03:33:42.992649+0000","last_clean":"2024-09-17T03:33:42.992649+0000","last_became_active":"2024-09-17T03:33:40.667051+0000","last_became_peered":"2024-09-17T03:33:40.667051+0000","last_unstale":"2024-09-17T03:33:42.992649+0000","last_undegraded":"2024-09-17T03:33:42.992649+0000","last_fullsized":"2024-09-17T03:33:42.992649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:01.755385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992608+0000","last_change":"2024-09-17T03:33:41.676992+0000","last_active":"2024-09-17T03:33:42.992608+0000","last_peered":"2024-09-17T03:33:42.992608+0000","last_clean":"2024-09-17T03:33:42.992608+0000","last_became_active":"2024-09-17T03:33:41.676639+0000","last_became_peered":"2024-09-17T03:33:41.676639+0000","last_unstale":"2024-09-17T03:33:42.992608+0000","last_undegraded":"2024-09-17T03:33:42.992608+0000","last_fullsized":"2024-09-17T03:33:42.992608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:21.956146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652518+0000","last_change":"2024-09-17T03:33:40.670776+0000","last_active":"2024-09-17T03:33:42.652518+0000","last_peered":"2024-09-17T03:33:42.652518+0000","last_clean":"2024-09-17T03:33:42.652518+0000","last_became_active":"2024-09-17T03:33:40.670019+0000","last_became_peered":"2024-09-17T03:33:40.670019+0000","last_unstale":"2024-09-17T03:33:42.652518+0000","last_undegraded":"2024-09-17T03:33:42.652518+0000","last_fullsized":"2024-09-17T03:33:42.652518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:22.598820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991579+0000","last_change":"2024-09-17T03:33:41.678042+0000","last_active":"2024-09-17T03:33:42.991579+0000","last_peered":"2024-09-17T03:33:42.991579+0000","last_clean":"2024-09-17T03:33:42.991579+0000","last_became_active":"2024-09-17T03:33:41.677711+0000","last_became_peered":"2024-09-17T03:33:41.677711+0000","last_unstale":"2024-09-17T03:33:42.991579+0000","last_undegraded":"2024-09-17T03:33:42.991579+0000","last_fullsized":"2024-09-17T03:33:42.991579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:44.356306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.657146+0000","last_change":"2024-09-17T03:33:40.661416+0000","last_active":"2024-09-17T03:33:42.657146+0000","last_peered":"2024-09-17T03:33:42.657146+0000","last_clean":"2024-09-17T03:33:42.657146+0000","last_became_active":"2024-09-17T03:33:40.661076+0000","last_became_peered":"2024-09-17T03:33:40.661076+0000","last_unstale":"2024-09-17T03:33:42.657146+0000","last_undegraded":"2024-09-17T03:33:42.657146+0000","last_fullsized":"2024-09-17T03:33:42.657146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:58.527534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652064+0000","last_change":"2024-09-17T03:33:41.662805+0000","last_active":"2024-09-17T03:33:42.652064+0000","last_peered":"2024-09-17T03:33:42.652064+0000","last_clean":"2024-09-17T03:33:42.652064+0000","last_became_active":"2024-09-17T03:33:41.662456+0000","last_became_peered":"2024-09-17T03:33:41.662456+0000","last_unstale":"2024-09-17T03:33:42.652064+0000","last_undegraded":"2024-09-17T03:33:42.652064+0000","last_fullsized":"2024-09-17T03:33:42.652064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:37.950599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991704+0000","last_change":"2024-09-17T03:33:40.661581+0000","last_active":"2024-09-17T03:33:42.991704+0000","last_peered":"2024-09-17T03:33:42.991704+0000","last_clean":"2024-09-17T03:33:42.991704+0000","last_became_active":"2024-09-17T03:33:40.661231+0000","last_became_peered":"2024-09-17T03:33:40.661231+0000","last_unstale":"2024-09-17T03:33:42.991704+0000","last_undegraded":"2024-09-17T03:33:42.991704+0000","last_fullsized":"2024-09-17T03:33:42.991704+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:45.094726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992212+0000","last_change":"2024-09-17T03:33:41.674247+0000","last_active":"2024-09-17T03:33:42.992212+0000","last_peered":"2024-09-17T03:33:42.992212+0000","last_clean":"2024-09-17T03:33:42.992212+0000","last_became_active":"2024-09-17T03:33:41.673948+0000","last_became_peered":"2024-09-17T03:33:41.673948+0000","last_unstale":"2024-09-17T03:33:42.992212+0000","last_undegraded":"2024-09-17T03:33:42.992212+0000","last_fullsized":"2024-09-17T03:33:42.992212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:12.387230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.651898+0000","last_change":"2024-09-17T03:33:40.672072+0000","last_active":"2024-09-17T03:33:42.651898+0000","last_peered":"2024-09-17T03:33:42.651898+0000","last_clean":"2024-09-17T03:33:42.651898+0000","last_became_active":"2024-09-17T03:33:40.671735+0000","last_became_peered":"2024-09-17T03:33:40.671735+0000","last_unstale":"2024-09-17T03:33:42.651898+0000","last_undegraded":"2024-09-17T03:33:42.651898+0000","last_fullsized":"2024-09-17T03:33:42.651898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:23.354684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.655792+0000","last_change":"2024-09-17T03:33:41.659557+0000","last_active":"2024-09-17T03:33:42.655792+0000","last_peered":"2024-09-17T03:33:42.655792+0000","last_clean":"2024-09-17T03:33:42.655792+0000","last_became_active":"2024-09-17T03:33:41.659254+0000","last_became_peered":"2024-09-17T03:33:41.659254+0000","last_unstale":"2024-09-17T03:33:42.655792+0000","last_undegraded":"2024-09-17T03:33:42.655792+0000","last_fullsized":"2024-09-17T03:33:42.655792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:31.276493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652137+0000","last_change":"2024-09-17T03:33:40.670623+0000","last_active":"2024-09-17T03:33:42.652137+0000","last_peered":"2024-09-17T03:33:42.652137+0000","last_clean":"2024-09-17T03:33:42.652137+0000","last_became_active":"2024-09-17T03:33:40.670144+0000","last_became_peered":"2024-09-17T03:33:40.670144+0000","last_unstale":"2024-09-17T03:33:42.652137+0000","last_undegraded":"2024-09-17T03:33:42.652137+0000","last_fullsized":"2024-09-17T03:33:42.652137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:29.403504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656619+0000","last_change":"2024-09-17T03:33:41.670316+0000","last_active":"2024-09-17T03:33:42.656619+0000","last_peered":"2024-09-17T03:33:42.656619+0000","last_clean":"2024-09-17T03:33:42.656619+0000","last_became_active":"2024-09-17T03:33:41.669633+0000","last_became_peered":"2024-09-17T03:33:41.669633+0000","last_unstale":"2024-09-17T03:33:42.656619+0000","last_undegraded":"2024-09-17T03:33:42.656619+0000","last_fullsized":"2024-09-17T03:33:42.656619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:04.560105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992198+0000","last_change":"2024-09-17T03:33:40.671383+0000","last_active":"2024-09-17T03:33:42.992198+0000","last_peered":"2024-09-17T03:33:42.992198+0000","last_clean":"2024-09-17T03:33:42.992198+0000","last_became_active":"2024-09-17T03:33:40.671065+0000","last_became_peered":"2024-09-17T03:33:40.671065+0000","last_unstale":"2024-09-17T03:33:42.992198+0000","last_undegraded":"2024-09-17T03:33:42.992198+0000","last_fullsized":"2024-09-17T03:33:42.992198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:13.524929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992695+0000","last_change":"2024-09-17T03:33:41.672981+0000","last_active":"2024-09-17T03:33:42.992695+0000","last_peered":"2024-09-17T03:33:42.992695+0000","last_clean":"2024-09-17T03:33:42.992695+0000","last_became_active":"2024-09-17T03:33:41.672258+0000","last_became_peered":"2024-09-17T03:33:41.672258+0000","last_unstale":"2024-09-17T03:33:42.992695+0000","last_undegraded":"2024-09-17T03:33:42.992695+0000","last_fullsized":"2024-09-17T03:33:42.992695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:37.950599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656769+0000","last_change":"2024-09-17T03:33:40.663061+0000","last_active":"2024-09-17T03:33:42.656769+0000","last_peered":"2024-09-17T03:33:42.656769+0000","last_clean":"2024-09-17T03:33:42.656769+0000","last_became_active":"2024-09-17T03:33:40.662713+0000","last_became_peered":"2024-09-17T03:33:40.662713+0000","last_unstale":"2024-09-17T03:33:42.656769+0000","last_undegraded":"2024-09-17T03:33:42.656769+0000","last_fullsized":"2024-09-17T03:33:42.656769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:44.591111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991601+0000","last_change":"2024-09-17T03:33:41.678934+0000","last_active":"2024-09-17T03:33:42.991601+0000","last_peered":"2024-09-17T03:33:42.991601+0000","last_clean":"2024-09-17T03:33:42.991601+0000","last_became_active":"2024-09-17T03:33:41.678685+0000","last_became_peered":"2024-09-17T03:33:41.678685+0000","last_unstale":"2024-09-17T03:33:42.991601+0000","last_undegraded":"2024-09-17T03:33:42.991601+0000","last_fullsized":"2024-09-17T03:33:42.991601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:27.375945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656554+0000","last_change":"2024-09-17T03:33:40.664118+0000","last_active":"2024-09-17T03:33:42.656554+0000","last_peered":"2024-09-17T03:33:42.656554+0000","last_clean":"2024-09-17T03:33:42.656554+0000","last_became_active":"2024-09-17T03:33:40.663787+0000","last_became_peered":"2024-09-17T03:33:40.663787+0000","last_unstale":"2024-09-17T03:33:42.656554+0000","last_undegraded":"2024-09-17T03:33:42.656554+0000","last_fullsized":"2024-09-17T03:33:42.656554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:35.266558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993346+0000","last_change":"2024-09-17T03:33:41.677552+0000","last_active":"2024-09-17T03:33:42.993346+0000","last_peered":"2024-09-17T03:33:42.993346+0000","last_clean":"2024-09-17T03:33:42.993346+0000","last_became_active":"2024-09-17T03:33:41.677230+0000","last_became_peered":"2024-09-17T03:33:41.677230+0000","last_unstale":"2024-09-17T03:33:42.993346+0000","last_undegraded":"2024-09-17T03:33:42.993346+0000","last_fullsized":"2024-09-17T03:33:42.993346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:29.170540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656946+0000","last_change":"2024-09-17T03:33:40.664215+0000","last_active":"2024-09-17T03:33:42.656946+0000","last_peered":"2024-09-17T03:33:42.656946+0000","last_clean":"2024-09-17T03:33:42.656946+0000","last_became_active":"2024-09-17T03:33:40.663909+0000","last_became_peered":"2024-09-17T03:33:40.663909+0000","last_unstale":"2024-09-17T03:33:42.656946+0000","last_undegraded":"2024-09-17T03:33:42.656946+0000","last_fullsized":"2024-09-17T03:33:42.656946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:05.231493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993039+0000","last_change":"2024-09-17T03:33:41.668639+0000","last_active":"2024-09-17T03:33:42.993039+0000","last_peered":"2024-09-17T03:33:42.993039+0000","last_clean":"2024-09-17T03:33:42.993039+0000","last_became_active":"2024-09-17T03:33:41.668312+0000","last_became_peered":"2024-09-17T03:33:41.668312+0000","last_unstale":"2024-09-17T03:33:42.993039+0000","last_undegraded":"2024-09-17T03:33:42.993039+0000","last_fullsized":"2024-09-17T03:33:42.993039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:45.593323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992370+0000","last_change":"2024-09-17T03:33:40.664616+0000","last_active":"2024-09-17T03:33:42.992370+0000","last_peered":"2024-09-17T03:33:42.992370+0000","last_clean":"2024-09-17T03:33:42.992370+0000","last_became_active":"2024-09-17T03:33:40.664264+0000","last_became_peered":"2024-09-17T03:33:40.664264+0000","last_unstale":"2024-09-17T03:33:42.992370+0000","last_undegraded":"2024-09-17T03:33:42.992370+0000","last_fullsized":"2024-09-17T03:33:42.992370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:28.168328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993294+0000","last_change":"2024-09-17T03:33:41.667758+0000","last_active":"2024-09-17T03:33:42.993294+0000","last_peered":"2024-09-17T03:33:42.993294+0000","last_clean":"2024-09-17T03:33:42.993294+0000","last_became_active":"2024-09-17T03:33:41.667401+0000","last_became_peered":"2024-09-17T03:33:41.667401+0000","last_unstale":"2024-09-17T03:33:42.993294+0000","last_undegraded":"2024-09-17T03:33:42.993294+0000","last_fullsized":"2024-09-17T03:33:42.993294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:30.963722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656050+0000","last_change":"2024-09-17T03:33:40.662725+0000","last_active":"2024-09-17T03:33:42.656050+0000","last_peered":"2024-09-17T03:33:42.656050+0000","last_clean":"2024-09-17T03:33:42.656050+0000","last_became_active":"2024-09-17T03:33:40.662406+0000","last_became_peered":"2024-09-17T03:33:40.662406+0000","last_unstale":"2024-09-17T03:33:42.656050+0000","last_undegraded":"2024-09-17T03:33:42.656050+0000","last_fullsized":"2024-09-17T03:33:42.656050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:28.168328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992995+0000","last_change":"2024-09-17T03:33:41.669060+0000","last_active":"2024-09-17T03:33:42.992995+0000","last_peered":"2024-09-17T03:33:42.992995+0000","last_clean":"2024-09-17T03:33:42.992995+0000","last_became_active":"2024-09-17T03:33:41.667468+0000","last_became_peered":"2024-09-17T03:33:41.667468+0000","last_unstale":"2024-09-17T03:33:42.992995+0000","last_undegraded":"2024-09-17T03:33:42.992995+0000","last_fullsized":"2024-09-17T03:33:42.992995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:19.104209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656206+0000","last_change":"2024-09-17T03:33:40.664696+0000","last_active":"2024-09-17T03:33:42.656206+0000","last_peered":"2024-09-17T03:33:42.656206+0000","last_clean":"2024-09-17T03:33:42.656206+0000","last_became_active":"2024-09-17T03:33:40.660791+0000","last_became_peered":"2024-09-17T03:33:40.660791+0000","last_unstale":"2024-09-17T03:33:42.656206+0000","last_undegraded":"2024-09-17T03:33:42.656206+0000","last_fullsized":"2024-09-17T03:33:42.656206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:35.950939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991930+0000","last_change":"2024-09-17T03:33:41.677927+0000","last_active":"2024-09-17T03:33:42.991930+0000","last_peered":"2024-09-17T03:33:42.991930+0000","last_clean":"2024-09-17T03:33:42.991930+0000","last_became_active":"2024-09-17T03:33:41.677608+0000","last_became_peered":"2024-09-17T03:33:41.677608+0000","last_unstale":"2024-09-17T03:33:42.991930+0000","last_undegraded":"2024-09-17T03:33:42.991930+0000","last_fullsized":"2024-09-17T03:33:42.991930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:34.555723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991092+0000","last_change":"2024-09-17T03:33:40.669866+0000","last_active":"2024-09-17T03:33:42.991092+0000","last_peered":"2024-09-17T03:33:42.991092+0000","last_clean":"2024-09-17T03:33:42.991092+0000","last_became_active":"2024-09-17T03:33:40.669549+0000","last_became_peered":"2024-09-17T03:33:40.669549+0000","last_unstale":"2024-09-17T03:33:42.991092+0000","last_undegraded":"2024-09-17T03:33:42.991092+0000","last_fullsized":"2024-09-17T03:33:42.991092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:57.788845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.993445+0000","last_change":"2024-09-17T03:33:41.672665+0000","last_active":"2024-09-17T03:33:42.993445+0000","last_peered":"2024-09-17T03:33:42.993445+0000","last_clean":"2024-09-17T03:33:42.993445+0000","last_became_active":"2024-09-17T03:33:41.672334+0000","last_became_peered":"2024-09-17T03:33:41.672334+0000","last_unstale":"2024-09-17T03:33:42.993445+0000","last_undegraded":"2024-09-17T03:33:42.993445+0000","last_fullsized":"2024-09-17T03:33:42.993445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:59.529746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992316+0000","last_change":"2024-09-17T03:33:40.666549+0000","last_active":"2024-09-17T03:33:42.992316+0000","last_peered":"2024-09-17T03:33:42.992316+0000","last_clean":"2024-09-17T03:33:42.992316+0000","last_became_active":"2024-09-17T03:33:40.666244+0000","last_became_peered":"2024-09-17T03:33:40.666244+0000","last_unstale":"2024-09-17T03:33:42.992316+0000","last_undegraded":"2024-09-17T03:33:42.992316+0000","last_fullsized":"2024-09-17T03:33:42.992316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:41.577748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992780+0000","last_change":"2024-09-17T03:33:41.679445+0000","last_active":"2024-09-17T03:33:42.992780+0000","last_peered":"2024-09-17T03:33:42.992780+0000","last_clean":"2024-09-17T03:33:42.992780+0000","last_became_active":"2024-09-17T03:33:41.679125+0000","last_became_peered":"2024-09-17T03:33:41.679125+0000","last_unstale":"2024-09-17T03:33:42.992780+0000","last_undegraded":"2024-09-17T03:33:42.992780+0000","last_fullsized":"2024-09-17T03:33:42.992780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:24.601155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:43.657954+0000","last_change":"2024-09-17T03:33:40.665533+0000","last_active":"2024-09-17T03:33:43.657954+0000","last_peered":"2024-09-17T03:33:43.657954+0000","last_clean":"2024-09-17T03:33:43.657954+0000","last_became_active":"2024-09-17T03:33:40.665200+0000","last_became_peered":"2024-09-17T03:33:40.665200+0000","last_unstale":"2024-09-17T03:33:43.657954+0000","last_undegraded":"2024-09-17T03:33:43.657954+0000","last_fullsized":"2024-09-17T03:33:43.657954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:17.286640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991494+0000","last_change":"2024-09-17T03:33:41.666826+0000","last_active":"2024-09-17T03:33:42.991494+0000","last_peered":"2024-09-17T03:33:42.991494+0000","last_clean":"2024-09-17T03:33:42.991494+0000","last_became_active":"2024-09-17T03:33:41.666391+0000","last_became_peered":"2024-09-17T03:33:41.666391+0000","last_unstale":"2024-09-17T03:33:42.991494+0000","last_undegraded":"2024-09-17T03:33:42.991494+0000","last_fullsized":"2024-09-17T03:33:42.991494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:05.861455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991716+0000","last_change":"2024-09-17T03:33:40.663395+0000","last_active":"2024-09-17T03:33:42.991716+0000","last_peered":"2024-09-17T03:33:42.991716+0000","last_clean":"2024-09-17T03:33:42.991716+0000","last_became_active":"2024-09-17T03:33:40.663092+0000","last_became_peered":"2024-09-17T03:33:40.663092+0000","last_unstale":"2024-09-17T03:33:42.991716+0000","last_undegraded":"2024-09-17T03:33:42.991716+0000","last_fullsized":"2024-09-17T03:33:42.991716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:47.770177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656198+0000","last_change":"2024-09-17T03:33:41.658698+0000","last_active":"2024-09-17T03:33:42.656198+0000","last_peered":"2024-09-17T03:33:42.656198+0000","last_clean":"2024-09-17T03:33:42.656198+0000","last_became_active":"2024-09-17T03:33:41.658359+0000","last_became_peered":"2024-09-17T03:33:41.658359+0000","last_unstale":"2024-09-17T03:33:42.656198+0000","last_undegraded":"2024-09-17T03:33:42.656198+0000","last_fullsized":"2024-09-17T03:33:42.656198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:20.694417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992554+0000","last_change":"2024-09-17T03:33:40.661794+0000","last_active":"2024-09-17T03:33:42.992554+0000","last_peered":"2024-09-17T03:33:42.992554+0000","last_clean":"2024-09-17T03:33:42.992554+0000","last_became_active":"2024-09-17T03:33:40.661487+0000","last_became_peered":"2024-09-17T03:33:40.661487+0000","last_unstale":"2024-09-17T03:33:42.992554+0000","last_undegraded":"2024-09-17T03:33:42.992554+0000","last_fullsized":"2024-09-17T03:33:42.992554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:59.452720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992244+0000","last_change":"2024-09-17T03:33:41.656023+0000","last_active":"2024-09-17T03:33:42.992244+0000","last_peered":"2024-09-17T03:33:42.992244+0000","last_clean":"2024-09-17T03:33:42.992244+0000","last_became_active":"2024-09-17T03:33:41.655670+0000","last_became_peered":"2024-09-17T03:33:41.655670+0000","last_unstale":"2024-09-17T03:33:42.992244+0000","last_undegraded":"2024-09-17T03:33:42.992244+0000","last_fullsized":"2024-09-17T03:33:42.992244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:34.668015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991782+0000","last_change":"2024-09-17T03:33:40.665757+0000","last_active":"2024-09-17T03:33:42.991782+0000","last_peered":"2024-09-17T03:33:42.991782+0000","last_clean":"2024-09-17T03:33:42.991782+0000","last_became_active":"2024-09-17T03:33:40.665466+0000","last_became_peered":"2024-09-17T03:33:40.665466+0000","last_unstale":"2024-09-17T03:33:42.991782+0000","last_undegraded":"2024-09-17T03:33:42.991782+0000","last_fullsized":"2024-09-17T03:33:42.991782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:54.047983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.651829+0000","last_change":"2024-09-17T03:33:41.682134+0000","last_active":"2024-09-17T03:33:42.651829+0000","last_peered":"2024-09-17T03:33:42.651829+0000","last_clean":"2024-09-17T03:33:42.651829+0000","last_became_active":"2024-09-17T03:33:41.681496+0000","last_became_peered":"2024-09-17T03:33:41.681496+0000","last_unstale":"2024-09-17T03:33:42.651829+0000","last_undegraded":"2024-09-17T03:33:42.651829+0000","last_fullsized":"2024-09-17T03:33:42.651829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:29.209210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656853+0000","last_change":"2024-09-17T03:33:40.660226+0000","last_active":"2024-09-17T03:33:42.656853+0000","last_peered":"2024-09-17T03:33:42.656853+0000","last_clean":"2024-09-17T03:33:42.656853+0000","last_became_active":"2024-09-17T03:33:40.659614+0000","last_became_peered":"2024-09-17T03:33:40.659614+0000","last_unstale":"2024-09-17T03:33:42.656853+0000","last_undegraded":"2024-09-17T03:33:42.656853+0000","last_fullsized":"2024-09-17T03:33:42.656853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:29.961510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.656927+0000","last_change":"2024-09-17T03:33:41.676310+0000","last_active":"2024-09-17T03:33:42.656927+0000","last_peered":"2024-09-17T03:33:42.656927+0000","last_clean":"2024-09-17T03:33:42.656927+0000","last_became_active":"2024-09-17T03:33:41.675536+0000","last_became_peered":"2024-09-17T03:33:41.675536+0000","last_unstale":"2024-09-17T03:33:42.656927+0000","last_undegraded":"2024-09-17T03:33:42.656927+0000","last_fullsized":"2024-09-17T03:33:42.656927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:41.416808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.652043+0000","last_change":"2024-09-17T03:33:40.670191+0000","last_active":"2024-09-17T03:33:42.652043+0000","last_peered":"2024-09-17T03:33:42.652043+0000","last_clean":"2024-09-17T03:33:42.652043+0000","last_became_active":"2024-09-17T03:33:40.669759+0000","last_became_peered":"2024-09-17T03:33:40.669759+0000","last_unstale":"2024-09-17T03:33:42.652043+0000","last_undegraded":"2024-09-17T03:33:42.652043+0000","last_fullsized":"2024-09-17T03:33:42.652043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:48.218566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.991890+0000","last_change":"2024-09-17T03:33:41.680784+0000","last_active":"2024-09-17T03:33:42.991890+0000","last_peered":"2024-09-17T03:33:42.991890+0000","last_clean":"2024-09-17T03:33:42.991890+0000","last_became_active":"2024-09-17T03:33:41.680311+0000","last_became_peered":"2024-09-17T03:33:41.680311+0000","last_unstale":"2024-09-17T03:33:42.991890+0000","last_undegraded":"2024-09-17T03:33:42.991890+0000","last_fullsized":"2024-09-17T03:33:42.991890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:40.640619+0000","last_clean_scrub_stamp":"2024-09-17T03:33:40.640619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:35.010455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.655675+0000","last_change":"2024-09-17T03:33:40.665655+0000","last_active":"2024-09-17T03:33:42.655675+0000","last_peered":"2024-09-17T03:33:42.655675+0000","last_clean":"2024-09-17T03:33:42.655675+0000","last_became_active":"2024-09-17T03:33:40.665242+0000","last_became_peered":"2024-09-17T03:33:40.665242+0000","last_unstale":"2024-09-17T03:33:42.655675+0000","last_undegraded":"2024-09-17T03:33:42.655675+0000","last_fullsized":"2024-09-17T03:33:42.655675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:33:39.638407+0000","last_clean_scrub_stamp":"2024-09-17T03:33:39.638407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:29.961510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:33:42.992306+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:33:42.992306+0000","last_peered":"2024-09-17T03:33:42.992306+0000","last_clean":"2024-09-17T03:33:42.992306+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:33:42.992306+0000","last_undegraded":"2024-09-17T03:33:42.992306+0000","last_fullsized":"2024-09-17T03:33:42.992306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":726397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":360448,"data_stored":136555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":360448,"data_stored":136043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":136009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":137573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":726307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":360448,"data_stored":136611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":368640,"data_stored":137573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:33:49.495 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:33:49.495 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:33:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.617+0000 7f8f10ba1640 1 -- 172.21.15.146:0/1465770809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f0c0b5700 msgr2=0x7f8f0c0b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:49.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.617+0000 7f8f10ba1640 1 --2- 172.21.15.146:0/1465770809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f0c0b5700 0x7f8f0c0b5b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8efc005fd0 tx=0x7f8efc02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.617+0000 7f8f10ba1640 1 -- 172.21.15.146:0/1465770809 shutdown_connections 2024-09-17T03:33:49.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.617+0000 7f8f10ba1640 1 --2- 172.21.15.146:0/1465770809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c15f410 0x7f8f0c15dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.617+0000 7f8f10ba1640 1 --2- 172.21.15.146:0/1465770809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f0c0b5700 0x7f8f0c0b5b10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.617+0000 7f8f10ba1640 1 -- 172.21.15.146:0/1465770809 >> 172.21.15.146:0/1465770809 conn(0x7f8f0c0749f0 msgr2=0x7f8f0c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:49.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.617+0000 7f8f10ba1640 1 -- 172.21.15.146:0/1465770809 shutdown_connections 2024-09-17T03:33:49.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.617+0000 7f8f10ba1640 1 -- 172.21.15.146:0/1465770809 wait complete. 2024-09-17T03:33:49.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.619+0000 7f8f10ba1640 1 Processor -- start 2024-09-17T03:33:49.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.619+0000 7f8f10ba1640 1 -- start start 2024-09-17T03:33:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.620+0000 7f8f10ba1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0b5700 0x7f8f0c1420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.620+0000 7f8f10ba1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c15d0a0 0x7f8f0c154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.620+0000 7f8f10ba1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f0c15f410 0x7f8f0c152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.620+0000 7f8f10ba1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c166c30 con 0x7f8f0c15f410 2024-09-17T03:33:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.620+0000 7f8f10ba1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c166ab0 con 0x7f8f0c15d0a0 2024-09-17T03:33:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.620+0000 7f8f10ba1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8f0c166db0 con 0x7f8f0c0b5700 2024-09-17T03:33:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.620+0000 7f8f0ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f0c15f410 0x7f8f0c152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:49.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.620+0000 7f8f0ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f0c15f410 0x7f8f0c152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58642/0 (socket says 172.21.15.146:58642) 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.620+0000 7f8f0ad9d640 1 -- 172.21.15.146:0/3908516874 learned_addr learned my addr 172.21.15.146:0/3908516874 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f09d9b640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c15d0a0 0x7f8f0c154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f0a59c640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0b5700 0x7f8f0c1420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f0ad9d640 1 -- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0b5700 msgr2=0x7f8f0c1420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f0ad9d640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0b5700 0x7f8f0c1420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f0ad9d640 1 -- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c15d0a0 msgr2=0x7f8f0c154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f0ad9d640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c15d0a0 0x7f8f0c154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f0ad9d640 1 -- 172.21.15.146:0/3908516874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c150670 con 0x7f8f0c15f410 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f09d9b640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c15d0a0 0x7f8f0c154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f0ad9d640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f0c15f410 0x7f8f0c152e30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400c970 tx=0x7f8f0400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f02ffd640 1 -- 172.21.15.146:0/3908516874 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04004460 con 0x7f8f0c15f410 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f02ffd640 1 -- 172.21.15.146:0/3908516874 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f040077a0 con 0x7f8f0c15f410 2024-09-17T03:33:49.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f10ba1640 1 -- 172.21.15.146:0/3908516874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0c150950 con 0x7f8f0c15f410 2024-09-17T03:33:49.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f02ffd640 1 -- 172.21.15.146:0/3908516874 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04007bd0 con 0x7f8f0c15f410 2024-09-17T03:33:49.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.621+0000 7f8f10ba1640 1 -- 172.21.15.146:0/3908516874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0c150f10 con 0x7f8f0c15f410 2024-09-17T03:33:49.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.622+0000 7f8f10ba1640 1 -- 172.21.15.146:0/3908516874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f0c0b5b10 con 0x7f8f0c15f410 2024-09-17T03:33:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.623+0000 7f8f02ffd640 1 -- 172.21.15.146:0/3908516874 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f040035f0 con 0x7f8f0c15f410 2024-09-17T03:33:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.623+0000 7f8f02ffd640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8eec078b90 0x7f8eec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.624+0000 7f8f02ffd640 1 -- 172.21.15.146:0/3908516874 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8f0409b3a0 con 0x7f8f0c15f410 2024-09-17T03:33:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.624+0000 7f8f0a59c640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8eec078b90 0x7f8eec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:49.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.624+0000 7f8f0a59c640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8eec078b90 0x7f8eec07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8efc034000 tx=0x7f8efc004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:49.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.628+0000 7f8f02ffd640 1 -- 172.21.15.146:0/3908516874 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f04013030 con 0x7f8f0c15f410 2024-09-17T03:33:49.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.881+0000 7f8f10ba1640 1 -- 172.21.15.146:0/3908516874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8f0c0b3a80 con 0x7f8f0c15f410 2024-09-17T03:33:49.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.884+0000 7f8f02ffd640 1 -- 172.21.15.146:0/3908516874 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f8f04063870 con 0x7f8f0c15f410 2024-09-17T03:33:49.884 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:33:49.884 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:33:49.884 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:33:49.884 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:33:49.884 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:33:49.885 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:33:49.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 -- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8eec078b90 msgr2=0x7f8eec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:49.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8eec078b90 0x7f8eec07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8efc034000 tx=0x7f8efc004ab0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 -- 172.21.15.146:0/3908516874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f0c15f410 msgr2=0x7f8f0c152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:49.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f0c15f410 0x7f8f0c152e30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400c970 tx=0x7f8f0400ce30 comp rx=0 tx=0).stop 2024-09-17T03:33:49.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 -- 172.21.15.146:0/3908516874 shutdown_connections 2024-09-17T03:33:49.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8eec078b90 0x7f8eec07b0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f0c15f410 0x7f8f0c152e30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f0c15d0a0 0x7f8f0c154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 --2- 172.21.15.146:0/3908516874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f0c0b5700 0x7f8f0c1420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:49.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 -- 172.21.15.146:0/3908516874 >> 172.21.15.146:0/3908516874 conn(0x7f8f0c0749f0 msgr2=0x7f8f0c15aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:49.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 -- 172.21.15.146:0/3908516874 shutdown_connections 2024-09-17T03:33:49.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:49.886+0000 7f8f10ba1640 1 -- 172.21.15.146:0/3908516874 wait complete. 2024-09-17T03:33:49.898 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:33:50.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.011+0000 7ff4268a4640 1 -- 172.21.15.146:0/1353362953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff408003c10 msgr2=0x7ff408004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.011+0000 7ff4268a4640 1 --2- 172.21.15.146:0/1353362953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff408003c10 0x7ff408004060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff410006f90 tx=0x7ff408005830 comp rx=0 tx=0).stop 2024-09-17T03:33:50.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.011+0000 7ff424e41640 1 -- 172.21.15.146:0/1353362953 reap_dead start 2024-09-17T03:33:50.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.011+0000 7ff4268a4640 1 -- 172.21.15.146:0/1353362953 shutdown_connections 2024-09-17T03:33:50.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.011+0000 7ff4268a4640 1 -- 172.21.15.146:0/1353362953 >> 172.21.15.146:0/1353362953 conn(0x7ff4200d4be0 msgr2=0x7ff4200d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:50.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.011+0000 7ff4268a4640 1 -- 172.21.15.146:0/1353362953 shutdown_connections 2024-09-17T03:33:50.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.011+0000 7ff4268a4640 1 -- 172.21.15.146:0/1353362953 wait complete. 2024-09-17T03:33:50.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.013+0000 7ff4268a4640 1 Processor -- start 2024-09-17T03:33:50.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.013+0000 7ff4268a4640 1 -- start start 2024-09-17T03:33:50.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.014+0000 7ff4268a4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff408003c10 0x7ff4200cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.014+0000 7ff4268a4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff420167590 0x7ff4200b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.014+0000 7ff4268a4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200b3f60 0x7ff4201f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.014+0000 7ff4268a4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff42006f6b0 con 0x7ff4200b3f60 2024-09-17T03:33:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.014+0000 7ff4268a4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff4200d43b0 con 0x7ff408003c10 2024-09-17T03:33:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.014+0000 7ff4268a4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff420167c00 con 0x7ff420167590 2024-09-17T03:33:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.014+0000 7ff424e41640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200b3f60 0x7ff4201f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.014+0000 7ff424e41640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200b3f60 0x7ff4201f61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58654/0 (socket says 172.21.15.146:58654) 2024-09-17T03:33:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.014+0000 7ff424e41640 1 -- 172.21.15.146:0/2942825703 learned_addr learned my addr 172.21.15.146:0/2942825703 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.014+0000 7ff41ffff640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff408003c10 0x7ff4200cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.014+0000 7ff41f7fe640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff420167590 0x7ff4200b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.015+0000 7ff424e41640 1 -- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff420167590 msgr2=0x7ff4200b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.015+0000 7ff424e41640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff420167590 0x7ff4200b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.015+0000 7ff424e41640 1 -- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff408003c10 msgr2=0x7ff4200cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.015+0000 7ff424e41640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff408003c10 0x7ff4200cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.015+0000 7ff424e41640 1 -- 172.21.15.146:0/2942825703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4200ce5f0 con 0x7ff4200b3f60 2024-09-17T03:33:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.015+0000 7ff424e41640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200b3f60 0x7ff4201f61d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff4200b37b0 tx=0x7ff41800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.015+0000 7ff41cff9640 1 -- 172.21.15.146:0/2942825703 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418003970 con 0x7ff4200b3f60 2024-09-17T03:33:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.015+0000 7ff41cff9640 1 -- 172.21.15.146:0/2942825703 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff418003b10 con 0x7ff4200b3f60 2024-09-17T03:33:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.015+0000 7ff41cff9640 1 -- 172.21.15.146:0/2942825703 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418004030 con 0x7ff4200b3f60 2024-09-17T03:33:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.015+0000 7ff4268a4640 1 -- 172.21.15.146:0/2942825703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4200ce8d0 con 0x7ff4200b3f60 2024-09-17T03:33:50.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.015+0000 7ff4268a4640 1 -- 172.21.15.146:0/2942825703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4200b46b0 con 0x7ff4200b3f60 2024-09-17T03:33:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.016+0000 7ff4268a4640 1 -- 172.21.15.146:0/2942825703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4200b4910 con 0x7ff4200b3f60 2024-09-17T03:33:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.017+0000 7ff41cff9640 1 -- 172.21.15.146:0/2942825703 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4180041d0 con 0x7ff4200b3f60 2024-09-17T03:33:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.017+0000 7ff41cff9640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff40c078bc0 0x7ff40c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.017+0000 7ff41cff9640 1 -- 172.21.15.146:0/2942825703 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff41809b1a0 con 0x7ff4200b3f60 2024-09-17T03:33:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.017+0000 7ff41ffff640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff40c078bc0 0x7ff40c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.018+0000 7ff41ffff640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff40c078bc0 0x7ff40c07b0d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff410033000 tx=0x7ff420069ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:50.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.022+0000 7ff41cff9640 1 -- 172.21.15.146:0/2942825703 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff418062f90 con 0x7ff4200b3f60 2024-09-17T03:33:50.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.231+0000 7ff4268a4640 1 -- 172.21.15.146:0/2942825703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4200d2bd0 con 0x7ff4200b3f60 2024-09-17T03:33:50.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.232+0000 7ff41cff9640 1 -- 172.21.15.146:0/2942825703 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5231 (secure 0 0 0) 0x7ff4180679c0 con 0x7ff4200b3f60 2024-09-17T03:33:50.232 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:33:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":13,"btime":"2024-09-17T03:33:43:665910+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/699096289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":699096289},{"type":"v1","addr":"172.21.15.146:6834","nonce":699096289}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3576644376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3576644376},{"type":"v1","addr":"172.21.15.179:6837","nonce":3576644376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4852,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1904604031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1904604031},{"type":"v1","addr":"172.21.15.146:6835","nonce":1904604031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:33:41.014829+0000","modified":"2024-09-17T03:33:43.020222+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/3055708361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3055708361},{"type":"v1","addr":"172.21.15.179:6836","nonce":3055708361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4864,"qdb_cluster":[4864]},"id":2}]} 2024-09-17T03:33:50.232 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 13 2024-09-17T03:33:50.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 -- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff40c078bc0 msgr2=0x7ff40c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff40c078bc0 0x7ff40c07b0d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff410033000 tx=0x7ff420069ad0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 -- 172.21.15.146:0/2942825703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200b3f60 msgr2=0x7ff4201f61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200b3f60 0x7ff4201f61d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff4200b37b0 tx=0x7ff41800f3c0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 -- 172.21.15.146:0/2942825703 shutdown_connections 2024-09-17T03:33:50.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff40c078bc0 0x7ff40c07b0d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4200b3f60 0x7ff4201f61d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff420167590 0x7ff4200b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 --2- 172.21.15.146:0/2942825703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff408003c10 0x7ff4200cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 -- 172.21.15.146:0/2942825703 >> 172.21.15.146:0/2942825703 conn(0x7ff4200d4be0 msgr2=0x7ff420162d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:50.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 -- 172.21.15.146:0/2942825703 shutdown_connections 2024-09-17T03:33:50.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.234+0000 7ff4268a4640 1 -- 172.21.15.146:0/2942825703 wait complete. 2024-09-17T03:33:50.648 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:33:41.014829+0000', 'modified': '2024-09-17T03:33:43.020222+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4864}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4864': {'gid': 4864, 'name': 'd', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6836/3055708361', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 3055708361}, {'type': 'v1', 'addr': '172.21.15.179:6836', 'nonce': 3055708361}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4864, 'qdb_cluster': [4864]} 2024-09-17T03:33:50.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:33:50.649 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:33:50.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.766+0000 7f4822a63640 1 -- 172.21.15.146:0/2702470252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48080039e0 msgr2=0x7f4808003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.766+0000 7f4822a63640 1 --2- 172.21.15.146:0/2702470252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48080039e0 0x7f4808003e10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f480c001960 tx=0x7f4808005830 comp rx=0 tx=0).stop 2024-09-17T03:33:50.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.766+0000 7f4821000640 1 -- 172.21.15.146:0/2702470252 reap_dead start 2024-09-17T03:33:50.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.766+0000 7f4822a63640 1 -- 172.21.15.146:0/2702470252 shutdown_connections 2024-09-17T03:33:50.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.766+0000 7f4822a63640 1 -- 172.21.15.146:0/2702470252 >> 172.21.15.146:0/2702470252 conn(0x7f481c0b2060 msgr2=0x7f481c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:50.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.766+0000 7f4822a63640 1 -- 172.21.15.146:0/2702470252 shutdown_connections 2024-09-17T03:33:50.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.766+0000 7f4822a63640 1 -- 172.21.15.146:0/2702470252 wait complete. 2024-09-17T03:33:50.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.768+0000 7f4822a63640 1 Processor -- start 2024-09-17T03:33:50.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.768+0000 7f4822a63640 1 -- start start 2024-09-17T03:33:50.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4822a63640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48080039e0 0x7f481c1526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4822a63640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f481c1551a0 0x7f481c14c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4822a63640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f481c15a230 0x7f481c15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4822a63640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f481c072c10 con 0x7f481c1551a0 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4822a63640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f481c072a90 con 0x7f48080039e0 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4822a63640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f481c072d90 con 0x7f481c15a230 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4813fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f481c1551a0 0x7f481c14c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4813fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f481c1551a0 0x7f481c14c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58668/0 (socket says 172.21.15.146:58668) 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4813fff640 1 -- 172.21.15.146:0/2610351917 learned_addr learned my addr 172.21.15.146:0/2610351917 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f481bfff640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48080039e0 0x7f481c1526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4821000640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f481c15a230 0x7f481c15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4813fff640 1 -- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f481c15a230 msgr2=0x7f481c15a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4813fff640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f481c15a230 0x7f481c15a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4813fff640 1 -- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48080039e0 msgr2=0x7f481c1526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4813fff640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48080039e0 0x7f481c1526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.769+0000 7f4813fff640 1 -- 172.21.15.146:0/2610351917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481c152c10 con 0x7f481c1551a0 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.770+0000 7f4813fff640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f481c1551a0 0x7f481c14c960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4804011ab0 tx=0x7f4804011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.770+0000 7f48197fa640 1 -- 172.21.15.146:0/2610351917 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480401e070 con 0x7f481c1551a0 2024-09-17T03:33:50.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.770+0000 7f48197fa640 1 -- 172.21.15.146:0/2610351917 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f480400fc70 con 0x7f481c1551a0 2024-09-17T03:33:50.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.770+0000 7f4822a63640 1 -- 172.21.15.146:0/2610351917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481c15ab80 con 0x7f481c1551a0 2024-09-17T03:33:50.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.770+0000 7f48197fa640 1 -- 172.21.15.146:0/2610351917 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804004290 con 0x7f481c1551a0 2024-09-17T03:33:50.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.770+0000 7f4822a63640 1 -- 172.21.15.146:0/2610351917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f481c155840 con 0x7f481c1551a0 2024-09-17T03:33:50.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.772+0000 7f48197fa640 1 -- 172.21.15.146:0/2610351917 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4804021070 con 0x7f481c1551a0 2024-09-17T03:33:50.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.772+0000 7f48197fa640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 0x7f47fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.772+0000 7f48197fa640 1 -- 172.21.15.146:0/2610351917 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f480409b570 con 0x7f481c1551a0 2024-09-17T03:33:50.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.773+0000 7f481bfff640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 0x7f47fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.773+0000 7f48299d1740 1 Processor -- start 2024-09-17T03:33:50.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.773+0000 7f481bfff640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 0x7f47fc07b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f480c032000 tx=0x7f480c02c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:50.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.773+0000 7f48299d1740 1 -- start start 2024-09-17T03:33:50.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.774+0000 7f48299d1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860e3270 0x5637864b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.774+0000 7f48299d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.774+0000 7f48299d1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860c2590 0x5637864d23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.774+0000 7f48299d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5637863fd820 con 0x5637860ba3b0 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.774+0000 7f48299d1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5637863ecc50 con 0x5637860c2590 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.774+0000 7f48299d1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5637863f0a60 con 0x5637860e3270 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4813fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4813fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58684/0 (socket says 172.21.15.146:58684) 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4813fff640 1 -- 172.21.15.146:0/1361722865 learned_addr learned my addr 172.21.15.146:0/1361722865 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4821000640 1 --2- 172.21.15.146:0/1361722865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860c2590 0x5637864d23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f481bfff640 1 --2- 172.21.15.146:0/1361722865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860e3270 0x5637864b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4813fff640 1 -- 172.21.15.146:0/1361722865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860e3270 msgr2=0x5637864b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4813fff640 1 --2- 172.21.15.146:0/1361722865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860e3270 0x5637864b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4813fff640 1 -- 172.21.15.146:0/1361722865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860c2590 msgr2=0x5637864d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4813fff640 1 --2- 172.21.15.146:0/1361722865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860c2590 0x5637864d23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4813fff640 1 -- 172.21.15.146:0/1361722865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56378614e850 con 0x5637860ba3b0 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f481bfff640 1 --2- 172.21.15.146:0/1361722865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860e3270 0x5637864b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4813fff640 1 --2- 172.21.15.146:0/1361722865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864b54e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4804063300 tx=0x7f4804062d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9ba7e189eb05a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4811ffb640 1 -- 172.21.15.146:0/1361722865 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804063370 con 0x5637860ba3b0 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4811ffb640 1 -- 172.21.15.146:0/1361722865 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4804067da0 con 0x5637860ba3b0 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.775+0000 7f4811ffb640 1 -- 172.21.15.146:0/1361722865 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480406cc50 con 0x5637860ba3b0 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.776+0000 7f48299d1740 1 -- 172.21.15.146:0/1361722865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 msgr2=0x5637864b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.776+0000 7f48299d1740 1 --2- 172.21.15.146:0/1361722865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864b54e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4804063300 tx=0x7f4804062d90 comp rx=0 tx=0).stop 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.776+0000 7f48299d1740 1 -- 172.21.15.146:0/1361722865 shutdown_connections 2024-09-17T03:33:50.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.776+0000 7f48299d1740 1 --2- 172.21.15.146:0/1361722865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860c2590 0x5637864d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.776+0000 7f48299d1740 1 --2- 172.21.15.146:0/1361722865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864b54e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.776+0000 7f48299d1740 1 --2- 172.21.15.146:0/1361722865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860e3270 0x5637864b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.776+0000 7f48299d1740 1 -- 172.21.15.146:0/1361722865 >> 172.21.15.146:0/1361722865 conn(0x5637860d73c0 msgr2=0x56378648b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.776+0000 7f48299d1740 1 -- 172.21.15.146:0/1361722865 shutdown_connections 2024-09-17T03:33:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.776+0000 7f48299d1740 1 -- 172.21.15.146:0/1361722865 wait complete. 2024-09-17T03:33:50.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.777+0000 7f48299d1740 1 -- start start 2024-09-17T03:33:50.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.777+0000 7f48299d1740 1 Processor -- start 2024-09-17T03:33:50.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.778+0000 7f48299d1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860ba3b0 0x5637864a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.778+0000 7f48299d1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860c2590 0x5637864d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.778+0000 7f48299d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860e3270 0x5637864d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.778+0000 7f48299d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56378615d620 con 0x5637860e3270 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.778+0000 7f48299d1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5637863925f0 con 0x5637860ba3b0 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.778+0000 7f48299d1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5637864b5a20 con 0x5637860c2590 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.778+0000 7f48299d1740 10 client.0 _ll_register_callbacks cb 0x5637863960a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f4821000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860e3270 0x5637864d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f4821000640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860e3270 0x5637864d2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58696/0 (socket says 172.21.15.146:58696) 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f4821000640 1 -- 172.21.15.146:0/1893764405 learned_addr learned my addr 172.21.15.146:0/1893764405 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f481bfff640 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860ba3b0 0x5637864a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f4813fff640 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860c2590 0x5637864d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f4821000640 1 -- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860c2590 msgr2=0x5637864d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f4821000640 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860c2590 0x5637864d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f4821000640 1 -- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860ba3b0 msgr2=0x5637864a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f4821000640 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860ba3b0 0x5637864a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f4821000640 1 -- 172.21.15.146:0/1893764405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637861c56b0 con 0x5637860e3270 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f4821000640 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860e3270 0x5637864d2680 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f481c0cd040 tx=0x7f4814003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec396b87aac693a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f47faffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f47faffd640 1 -- 172.21.15.146:0/1893764405 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814011430 con 0x5637860e3270 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f47faffd640 1 -- 172.21.15.146:0/1893764405 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f481400a910 con 0x5637860e3270 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f48299d1740 1 -- 172.21.15.146:0/1893764405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4804067da0 con 0x5637860e3270 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f47faffd640 1 -- 172.21.15.146:0/1893764405 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f4814022050 con 0x5637860e3270 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f48299d1740 10 client.5136 fetch_fsmap learned FSMap version 13 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.779+0000 7f48299d1740 1 -- 172.21.15.146:0/1893764405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5637864e36d0 con 0x5637860e3270 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.780+0000 7f47faffd640 1 -- 172.21.15.146:0/1893764405 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4804067da0 con 0x5637860e3270 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.780+0000 7f47faffd640 1 -- 172.21.15.146:0/1893764405 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 13) ==== 3502+0+0 (secure 0 0 0) 0x7f4814025020 con 0x5637860e3270 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.780+0000 7f48299d1740 10 client.5136 fetch_fsmap finished waiting for FSMap version 13 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.780+0000 7f48299d1740 10 client.5136 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.780+0000 7f48299d1740 20 client.5136 populate_metadata read hostname 'smithi146' 2024-09-17T03:33:50.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.780+0000 7f48299d1740 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x5637860a1e40 0x5637864c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.780+0000 7f48299d1740 4 client.5136 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.780+0000 7f48299d1740 1 -- 172.21.15.146:0/1893764405 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637863ff770 con 0x5637860a1e40 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.780+0000 7f481bfff640 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x5637860a1e40 0x5637864c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.780+0000 7f47faffd640 10 client.5136 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.780+0000 7f481bfff640 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x5637860a1e40 0x5637864c6ef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33b04a9a2725a76 server_cookie=51298702b618a812 in_seq=0 out_seq=0 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f47faffd640 1 -- 172.21.15.146:0/1893764405 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637863ff770 con 0x5637860a1e40 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f47faffd640 10 client.5136 handle_command_reply: tid=0 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f48299d1740 1 client.5136 shutdown 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f48299d1740 1 -- 172.21.15.146:0/1893764405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860e3270 msgr2=0x5637864d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f48299d1740 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860e3270 0x5637864d2680 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f481c0cd040 tx=0x7f4814003d40 comp rx=0 tx=0).stop 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f48299d1740 1 -- 172.21.15.146:0/1893764405 shutdown_connections 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f48299d1740 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x5637860a1e40 0x5637864c6ef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f48299d1740 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860e3270 0x5637864d2680 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f48299d1740 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860c2590 0x5637864d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f47faffd640 0 client.5136 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:33:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f48299d1740 1 --2- 172.21.15.146:0/1893764405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860ba3b0 0x5637864a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f48299d1740 1 -- 172.21.15.146:0/1893764405 >> 172.21.15.146:0/1893764405 conn(0x5637860d73c0 msgr2=0x56378648b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.781+0000 7f48299d1740 1 -- 172.21.15.146:0/1893764405 shutdown_connections 2024-09-17T03:33:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.782+0000 7f48299d1740 1 -- 172.21.15.146:0/1893764405 wait complete. 2024-09-17T03:33:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.782+0000 7f48299d1740 20 client.5136 trim_cache size 0 max 16384 2024-09-17T03:33:50.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.800+0000 7f48299d1740 1 Processor -- start 2024-09-17T03:33:50.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.800+0000 7f48299d1740 1 -- start start 2024-09-17T03:33:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f48299d1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860ba3b0 0x56378648b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f48299d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860c2590 0x5637864d1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f48299d1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860e3270 0x5637864d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f48299d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f481c201ab0 con 0x5637860c2590 2024-09-17T03:33:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f48299d1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f481c0af6f0 con 0x5637860e3270 2024-09-17T03:33:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f48299d1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f481c201460 con 0x5637860ba3b0 2024-09-17T03:33:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f4813fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860c2590 0x5637864d1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f4813fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860c2590 0x5637864d1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58712/0 (socket says 172.21.15.146:58712) 2024-09-17T03:33:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f4813fff640 1 -- 172.21.15.146:0/1863754808 learned_addr learned my addr 172.21.15.146:0/1863754808 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f4813fff640 1 -- 172.21.15.146:0/1863754808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860ba3b0 msgr2=0x56378648b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f4813fff640 1 --2- 172.21.15.146:0/1863754808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860ba3b0 0x56378648b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f4813fff640 1 -- 172.21.15.146:0/1863754808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860e3270 msgr2=0x5637864d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f4813fff640 1 --2- 172.21.15.146:0/1863754808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860e3270 0x5637864d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f4813fff640 1 -- 172.21.15.146:0/1863754808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637864c6590 con 0x5637860c2590 2024-09-17T03:33:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.801+0000 7f4813fff640 1 --2- 172.21.15.146:0/1863754808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860c2590 0x5637864d1710 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4804099af0 tx=0x7f480409b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf88db2e05bb4aaa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48117fa640 1 -- 172.21.15.146:0/1863754808 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804063370 con 0x5637860c2590 2024-09-17T03:33:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48117fa640 1 -- 172.21.15.146:0/1863754808 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f480405f5e0 con 0x5637860c2590 2024-09-17T03:33:50.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48117fa640 1 -- 172.21.15.146:0/1863754808 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480409b0e0 con 0x5637860c2590 2024-09-17T03:33:50.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48299d1740 1 -- 172.21.15.146:0/1863754808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860c2590 msgr2=0x5637864d1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48299d1740 1 --2- 172.21.15.146:0/1863754808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860c2590 0x5637864d1710 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4804099af0 tx=0x7f480409b070 comp rx=0 tx=0).stop 2024-09-17T03:33:50.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48299d1740 1 -- 172.21.15.146:0/1863754808 shutdown_connections 2024-09-17T03:33:50.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48299d1740 1 --2- 172.21.15.146:0/1863754808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860e3270 0x5637864d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48299d1740 1 --2- 172.21.15.146:0/1863754808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860c2590 0x5637864d1710 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48299d1740 1 --2- 172.21.15.146:0/1863754808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860ba3b0 0x56378648b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48299d1740 1 -- 172.21.15.146:0/1863754808 >> 172.21.15.146:0/1863754808 conn(0x5637860d73c0 msgr2=0x5637864a3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:50.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48299d1740 1 -- 172.21.15.146:0/1863754808 shutdown_connections 2024-09-17T03:33:50.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.802+0000 7f48299d1740 1 -- 172.21.15.146:0/1863754808 wait complete. 2024-09-17T03:33:50.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.803+0000 7f48299d1740 1 -- start start 2024-09-17T03:33:50.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.803+0000 7f48299d1740 1 Processor -- start 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f48299d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f48299d1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860c2590 0x563786540b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f48299d1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860e3270 0x563786541060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f48299d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56378649fb80 con 0x5637860ba3b0 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f48299d1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5637864c7f70 con 0x5637860c2590 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f48299d1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5637864a05d0 con 0x5637860e3270 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f48299d1740 10 client.0 _ll_register_callbacks cb 0x7f4814006b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f481bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f481bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58714/0 (socket says 172.21.15.146:58714) 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f481bfff640 1 -- 172.21.15.146:0/4084825361 learned_addr learned my addr 172.21.15.146:0/4084825361 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f4813fff640 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860c2590 0x563786540b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f4821000640 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860e3270 0x563786541060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f481bfff640 1 -- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860e3270 msgr2=0x563786541060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f481bfff640 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860e3270 0x563786541060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f481bfff640 1 -- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860c2590 msgr2=0x563786540b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f481bfff640 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860c2590 0x563786540b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f481bfff640 1 -- 172.21.15.146:0/4084825361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56378648c880 con 0x5637860ba3b0 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f4813fff640 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860c2590 0x563786540b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f481bfff640 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864c8950 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f480c02ac30 tx=0x7f480c0014c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc57e1920a04eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f47faffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f47faffd640 1 -- 172.21.15.146:0/4084825361 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c037040 con 0x5637860ba3b0 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f47faffd640 1 -- 172.21.15.146:0/4084825361 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f480c0063f0 con 0x5637860ba3b0 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.805+0000 7f48299d1740 1 -- 172.21.15.146:0/4084825361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f480405f5e0 con 0x5637860ba3b0 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f47faffd640 1 -- 172.21.15.146:0/4084825361 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f480c03e460 con 0x5637860ba3b0 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f48299d1740 10 client.5142 fetch_fsmap learned FSMap version 13 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f48299d1740 1 -- 172.21.15.146:0/4084825361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x56378649e670 con 0x5637860ba3b0 2024-09-17T03:33:50.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f47faffd640 1 -- 172.21.15.146:0/4084825361 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f480405f5e0 con 0x5637860ba3b0 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f47faffd640 1 -- 172.21.15.146:0/4084825361 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 13) ==== 3502+0+0 (secure 0 0 0) 0x7f480c03e600 con 0x5637860ba3b0 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f48299d1740 10 client.5142 fetch_fsmap finished waiting for FSMap version 13 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f48299d1740 10 client.5142 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f48299d1740 20 client.5142 populate_metadata read hostname 'smithi146' 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f48299d1740 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x563786553bd0 0x5637864f2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f48299d1740 4 client.5142 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f48299d1740 1 -- 172.21.15.146:0/4084825361 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "status"}) -- 0x5637863fb220 con 0x563786553bd0 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.806+0000 7f4813fff640 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x563786553bd0 0x5637864f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f47faffd640 10 client.5142 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f4813fff640 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x563786553bd0 0x5637864f2310 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc8d84850bbbbfc1 server_cookie=2475950bb542a085 in_seq=0 out_seq=0 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f47faffd640 1 -- 172.21.15.146:0/4084825361 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5637863fb220 con 0x563786553bd0 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f47faffd640 10 client.5142 handle_command_reply: tid=0 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 1 client.5142 shutdown 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 1 -- 172.21.15.146:0/4084825361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 msgr2=0x5637864c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864c8950 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f480c02ac30 tx=0x7f480c0014c0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 1 -- 172.21.15.146:0/4084825361 shutdown_connections 2024-09-17T03:33:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x563786553bd0 0x5637864f2310 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5637860e3270 0x563786541060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5637860c2590 0x563786540b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f47faffd640 0 client.5142 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:33:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 1 --2- 172.21.15.146:0/4084825361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5637860ba3b0 0x5637864c8950 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 1 -- 172.21.15.146:0/4084825361 >> 172.21.15.146:0/4084825361 conn(0x5637860d73c0 msgr2=0x56378648b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 1 -- 172.21.15.146:0/4084825361 shutdown_connections 2024-09-17T03:33:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 1 -- 172.21.15.146:0/4084825361 wait complete. 2024-09-17T03:33:50.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.807+0000 7f48299d1740 20 client.5142 trim_cache size 0 max 16384 2024-09-17T03:33:50.812 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:33:50.813 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:33:50.813 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:33:50.813 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4864, 2024-09-17T03:33:50.813 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:33:50.813 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:33:50.813 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:33:50.813 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 9.1590281949999994, 2024-09-17T03:33:50.813 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 13, 2024-09-17T03:33:50.813 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 32, 2024-09-17T03:33:50.813 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 32, 2024-09-17T03:33:50.813 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 16.322683299000001 2024-09-17T03:33:50.814 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:33:50.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 -- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 msgr2=0x7f47fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 0x7f47fc07b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f480c032000 tx=0x7f480c02c000 comp rx=0 tx=0).stop 2024-09-17T03:33:50.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 -- 172.21.15.146:0/2610351917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f481c1551a0 msgr2=0x7f481c14c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f481c1551a0 0x7f481c14c960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4804011ab0 tx=0x7f4804011f70 comp rx=0 tx=0).stop 2024-09-17T03:33:50.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 -- 172.21.15.146:0/2610351917 shutdown_connections 2024-09-17T03:33:50.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 0x7f47fc07b0a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f481c15a230 0x7f481c15a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f481c1551a0 0x7f481c14c960 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 --2- 172.21.15.146:0/2610351917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48080039e0 0x7f481c1526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 -- 172.21.15.146:0/2610351917 >> 172.21.15.146:0/2610351917 conn(0x7f481c0b2060 msgr2=0x7f481c158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:50.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 -- 172.21.15.146:0/2610351917 shutdown_connections 2024-09-17T03:33:50.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.808+0000 7f4822a63640 1 -- 172.21.15.146:0/2610351917 wait complete. 2024-09-17T03:33:50.819 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:33:50.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.933+0000 7fab6ec4d640 1 -- 172.21.15.146:0/70383957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab680b50f0 msgr2=0x7fab6806e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.933+0000 7fab6ec4d640 1 --2- 172.21.15.146:0/70383957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab680b50f0 0x7fab6806e470 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fab680ccb60 tx=0x7fab6402a560 comp rx=0 tx=0).stop 2024-09-17T03:33:50.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.933+0000 7fab6ec4d640 1 -- 172.21.15.146:0/70383957 shutdown_connections 2024-09-17T03:33:50.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.933+0000 7fab6ec4d640 1 --2- 172.21.15.146:0/70383957 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab680729b0 0x7fab6815e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.933+0000 7fab6ec4d640 1 --2- 172.21.15.146:0/70383957 >> v2:172.21.15.179:3300/0 conn(0x7fab6806e9b0 0x7fab68072470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.933+0000 7fab6ec4d640 1 --2- 172.21.15.146:0/70383957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab680b50f0 0x7fab6806e470 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.933+0000 7fab6ec4d640 1 -- 172.21.15.146:0/70383957 >> 172.21.15.146:0/70383957 conn(0x7fab680b2060 msgr2=0x7fab680b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:50.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.933+0000 7fab6ec4d640 1 -- 172.21.15.146:0/70383957 shutdown_connections 2024-09-17T03:33:50.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.933+0000 7fab6ec4d640 1 -- 172.21.15.146:0/70383957 wait complete. 2024-09-17T03:33:50.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.935+0000 7fab6ec4d640 1 Processor -- start 2024-09-17T03:33:50.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.935+0000 7fab6ec4d640 1 -- start start 2024-09-17T03:33:50.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.936+0000 7fab6ec4d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6806e9b0 0x7fab681f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.936+0000 7fab6ec4d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab680729b0 0x7fab68159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.936+0000 7fab6ec4d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab680b50f0 0x7fab680aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.936+0000 7fab6ec4d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab680b2f30 con 0x7fab6806e9b0 2024-09-17T03:33:50.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.936+0000 7fab6ec4d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab68070770 con 0x7fab680b50f0 2024-09-17T03:33:50.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.936+0000 7fab6ec4d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fab6815ebb0 con 0x7fab680729b0 2024-09-17T03:33:50.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.936+0000 7fab6c9e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6806e9b0 0x7fab681f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.936+0000 7fab6c9e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6806e9b0 0x7fab681f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58728/0 (socket says 172.21.15.146:58728) 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.936+0000 7fab6c9e9640 1 -- 172.21.15.146:0/4236371989 learned_addr learned my addr 172.21.15.146:0/4236371989 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab5ffff640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab680729b0 0x7fab68159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab6d1ea640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab680b50f0 0x7fab680aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab6c9e9640 1 -- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab680729b0 msgr2=0x7fab68159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab6c9e9640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab680729b0 0x7fab68159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab6c9e9640 1 -- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab680b50f0 msgr2=0x7fab680aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab6c9e9640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab680b50f0 0x7fab680aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab6c9e9640 1 -- 172.21.15.146:0/4236371989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab681f69e0 con 0x7fab6806e9b0 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab6c9e9640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6806e9b0 0x7fab681f64a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fab6402ab50 tx=0x7fab640038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab5d7fa640 1 -- 172.21.15.146:0/4236371989 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6403f070 con 0x7fab6806e9b0 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab5d7fa640 1 -- 172.21.15.146:0/4236371989 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab640047a0 con 0x7fab6806e9b0 2024-09-17T03:33:50.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab5d7fa640 1 -- 172.21.15.146:0/4236371989 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64035030 con 0x7fab6806e9b0 2024-09-17T03:33:50.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab6ec4d640 1 -- 172.21.15.146:0/4236371989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab68159df0 con 0x7fab6806e9b0 2024-09-17T03:33:50.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.937+0000 7fab6ec4d640 1 -- 172.21.15.146:0/4236371989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab68155b60 con 0x7fab6806e9b0 2024-09-17T03:33:50.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.938+0000 7fab6ec4d640 1 -- 172.21.15.146:0/4236371989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6815e670 con 0x7fab6806e9b0 2024-09-17T03:33:50.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.939+0000 7fab5d7fa640 1 -- 172.21.15.146:0/4236371989 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab64042070 con 0x7fab6806e9b0 2024-09-17T03:33:50.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.940+0000 7fab5d7fa640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab54078bf0 0x7fab5407b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:50.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.940+0000 7fab5d7fa640 1 -- 172.21.15.146:0/4236371989 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fab640bba80 con 0x7fab6806e9b0 2024-09-17T03:33:50.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.940+0000 7fab5ffff640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab54078bf0 0x7fab5407b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:50.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.940+0000 7fab5ffff640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab54078bf0 0x7fab5407b100 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fab6815ac20 tx=0x7fab5800b3e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:50.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:50.944+0000 7fab5d7fa640 1 -- 172.21.15.146:0/4236371989 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fab64083990 con 0x7fab6806e9b0 2024-09-17T03:33:51.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.153+0000 7fab6ec4d640 1 -- 172.21.15.146:0/4236371989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fab681598b0 con 0x7fab6806e9b0 2024-09-17T03:33:51.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.154+0000 7fab5d7fa640 1 -- 172.21.15.146:0/4236371989 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7fab640883c0 con 0x7fab6806e9b0 2024-09-17T03:33:51.154 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:33:51.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 -- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab54078bf0 msgr2=0x7fab5407b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab54078bf0 0x7fab5407b100 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fab6815ac20 tx=0x7fab5800b3e0 comp rx=0 tx=0).stop 2024-09-17T03:33:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 -- 172.21.15.146:0/4236371989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6806e9b0 msgr2=0x7fab681f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6806e9b0 0x7fab681f64a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fab6402ab50 tx=0x7fab640038a0 comp rx=0 tx=0).stop 2024-09-17T03:33:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 -- 172.21.15.146:0/4236371989 shutdown_connections 2024-09-17T03:33:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab54078bf0 0x7fab5407b100 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab680b50f0 0x7fab680aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab680729b0 0x7fab68159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 --2- 172.21.15.146:0/4236371989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab6806e9b0 0x7fab681f64a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 -- 172.21.15.146:0/4236371989 >> 172.21.15.146:0/4236371989 conn(0x7fab680b2060 msgr2=0x7fab68152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 -- 172.21.15.146:0/4236371989 shutdown_connections 2024-09-17T03:33:51.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51.156+0000 7fab6ec4d640 1 -- 172.21.15.146:0/4236371989 wait complete. 2024-09-17T03:33:51.168 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:33:51.168 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:33:51.168 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:33:51.168 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:33:51.169 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:33:51.169 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:33:51.169 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:33:51.169 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:33:51.169 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:33:51.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:51.169 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:33:51.185 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:33:51.185 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:33:51.185 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:33:51.185 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:33:51.186 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42741sec preferred_lft 42741sec 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:33:51.187 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:33:51.188 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:33:51.188 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:33:51.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:51.188 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:33:51.250 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:33:51.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:51.251 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:33:51.308 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:33:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:33:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:33:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:33:51.309 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:33:51.309 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:33:51.309 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:33:51.310 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:33:51.310 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:33:51.310 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:33:51.310 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:33:51.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:33:51.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:51.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:51.436 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:33:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:33:51.451 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:33:51.451 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:33:51.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:51.451 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:33:51.516 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:33:51.516 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:33:51.572 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:33:51.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:33:51.572 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:33:51.626 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:33:51.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:51.627 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:33:51.722 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:33:51.722 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:33:51.723 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:33:51.734 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:33:51.734 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:33:51.734 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:33:51.734 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:33:51.734 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:33:51.739 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:33:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:33:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:33:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:33:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:33:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:33:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:33:51.740 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:33:51.741 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:33:51.741 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:33:51.741 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:33:51.741 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:33:51.741 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:33:51.742 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:33:51.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:51.743 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:33:51.769 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:33:51.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:33:51.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:33:51.874 INFO:teuthology.orchestra.run.smithi146.stdout:client5151 2024-09-17T03:33:51.874 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:33:51.874 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:51.890 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-17T03:33:52.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.047+0000 7fa515b94640 1 -- 172.21.15.146:0/1643768483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510072680 msgr2=0x7fa510072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:52.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.047+0000 7fa515b94640 1 --2- 172.21.15.146:0/1643768483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510072680 0x7fa510072a90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa504009820 tx=0x7fa50402a470 comp rx=0 tx=0).stop 2024-09-17T03:33:52.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.047+0000 7fa515b94640 1 -- 172.21.15.146:0/1643768483 shutdown_connections 2024-09-17T03:33:52.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.047+0000 7fa515b94640 1 --2- 172.21.15.146:0/1643768483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5100b4370 0x7fa5100b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:52.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.047+0000 7fa515b94640 1 --2- 172.21.15.146:0/1643768483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510072680 0x7fa510072a90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:52.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.047+0000 7fa515b94640 1 -- 172.21.15.146:0/1643768483 >> 172.21.15.146:0/1643768483 conn(0x7fa5100b2060 msgr2=0x7fa5100b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:52.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.047+0000 7fa515b94640 1 -- 172.21.15.146:0/1643768483 shutdown_connections 2024-09-17T03:33:52.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.047+0000 7fa515b94640 1 -- 172.21.15.146:0/1643768483 wait complete. 2024-09-17T03:33:52.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.049+0000 7fa515b94640 1 Processor -- start 2024-09-17T03:33:52.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.049+0000 7fa515b94640 1 -- start start 2024-09-17T03:33:52.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.050+0000 7fa515b94640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa510072680 0x7fa5101436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.050+0000 7fa515b94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5100b4370 0x7fa5101e8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.050+0000 7fa515b94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51015b770 0x7fa5101e88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.050+0000 7fa515b94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa5100b5050 con 0x7fa51015b770 2024-09-17T03:33:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.050+0000 7fa515b94640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa5100b4ed0 con 0x7fa5100b4370 2024-09-17T03:33:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.050+0000 7fa515b94640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa5100b51d0 con 0x7fa510072680 2024-09-17T03:33:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.050+0000 7fa50ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51015b770 0x7fa5101e88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.050+0000 7fa50ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51015b770 0x7fa5101e88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58756/0 (socket says 172.21.15.146:58756) 2024-09-17T03:33:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.050+0000 7fa50ffff640 1 -- 172.21.15.146:0/3650819599 learned_addr learned my addr 172.21.15.146:0/3650819599 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:33:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa50effd640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5100b4370 0x7fa5101e8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa50f7fe640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa510072680 0x7fa5101436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:52.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa50ffff640 1 -- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa510072680 msgr2=0x7fa5101436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa50ffff640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa510072680 0x7fa5101436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa50ffff640 1 -- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5100b4370 msgr2=0x7fa5101e8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa50ffff640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5100b4370 0x7fa5101e8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa50ffff640 1 -- 172.21.15.146:0/3650819599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa510143c30 con 0x7fa51015b770 2024-09-17T03:33:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa50effd640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5100b4370 0x7fa5101e8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:33:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa50ffff640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51015b770 0x7fa5101e88b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa50800e9c0 tx=0x7fa50800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa4f7fff640 1 -- 172.21.15.146:0/3650819599 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508004d20 con 0x7fa51015b770 2024-09-17T03:33:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa4f7fff640 1 -- 172.21.15.146:0/3650819599 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa50800cac0 con 0x7fa51015b770 2024-09-17T03:33:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa515b94640 1 -- 172.21.15.146:0/3650819599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa510146db0 con 0x7fa51015b770 2024-09-17T03:33:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa4f7fff640 1 -- 172.21.15.146:0/3650819599 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508005020 con 0x7fa51015b770 2024-09-17T03:33:52.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.051+0000 7fa515b94640 1 -- 172.21.15.146:0/3650819599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5101f8f20 con 0x7fa51015b770 2024-09-17T03:33:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.052+0000 7fa515b94640 1 -- 172.21.15.146:0/3650819599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa510146b20 con 0x7fa51015b770 2024-09-17T03:33:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.053+0000 7fa4f7fff640 1 -- 172.21.15.146:0/3650819599 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa5080051c0 con 0x7fa51015b770 2024-09-17T03:33:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.053+0000 7fa4f7fff640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4fc078b90 0x7fa4fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:33:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.053+0000 7fa4f7fff640 1 -- 172.21.15.146:0/3650819599 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa50809b5b0 con 0x7fa51015b770 2024-09-17T03:33:52.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.053+0000 7fa50f7fe640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4fc078b90 0x7fa4fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:33:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.054+0000 7fa50f7fe640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4fc078b90 0x7fa4fc07b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa500007fd0 tx=0x7fa500009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:33:52.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.058+0000 7fa4f7fff640 1 -- 172.21.15.146:0/3650819599 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa508016030 con 0x7fa51015b770 2024-09-17T03:33:52.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.267+0000 7fa515b94640 1 -- 172.21.15.146:0/3650819599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fa510073590 con 0x7fa51015b770 2024-09-17T03:33:52.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.876+0000 7fa4f7fff640 1 -- 172.21.15.146:0/3650819599 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v14) ==== 167+0+0 (secure 0 0 0) 0x7fa508063a00 con 0x7fa51015b770 2024-09-17T03:33:52.876 INFO:teuthology.orchestra.run.smithi146.stderr:enabled new snapshots 2024-09-17T03:33:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 -- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4fc078b90 msgr2=0x7fa4fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4fc078b90 0x7fa4fc07b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa500007fd0 tx=0x7fa500009040 comp rx=0 tx=0).stop 2024-09-17T03:33:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 -- 172.21.15.146:0/3650819599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51015b770 msgr2=0x7fa5101e88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:33:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51015b770 0x7fa5101e88b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa50800e9c0 tx=0x7fa50800ee80 comp rx=0 tx=0).stop 2024-09-17T03:33:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 -- 172.21.15.146:0/3650819599 shutdown_connections 2024-09-17T03:33:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4fc078b90 0x7fa4fc07b0a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa51015b770 0x7fa5101e88b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5100b4370 0x7fa5101e8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 --2- 172.21.15.146:0/3650819599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa510072680 0x7fa5101436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:33:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 -- 172.21.15.146:0/3650819599 >> 172.21.15.146:0/3650819599 conn(0x7fa5100b2060 msgr2=0x7fa510158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:33:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 -- 172.21.15.146:0/3650819599 shutdown_connections 2024-09-17T03:33:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:33:52.879+0000 7fa515b94640 1 -- 172.21.15.146:0/3650819599 wait complete. 2024-09-17T03:33:52.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:33:52.894 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-17T03:33:52.917 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:33:52.917 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:33:52.975 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:33:52.975 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:33:52.975 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2024-09-17T03:33:52.975 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:33:52.975 DEBUG:teuthology.orchestra.run.smithi146:> n = 2000 2024-09-17T03:33:52.975 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2024-09-17T03:33:52.975 DEBUG:teuthology.orchestra.run.smithi146:> if 3 > 0: 2024-09-17T03:33:52.975 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2024-09-17T03:33:52.975 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> try: 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:33:52.976 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(3): 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2024-09-17T03:33:52.977 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:33:56.546 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:33:56.548 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:34:14.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:34:14.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:34:14.374 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-17T03:34:14.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:34:14.825 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-17T03:34:26.674 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:34:26.678 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:34:45.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:34:45.016 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-17T03:34:45.138 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-17T03:34:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.253+0000 7fce25ca9640 1 -- 172.21.15.146:0/422483776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce2015b770 msgr2=0x7fce2006fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.253+0000 7fce25ca9640 1 --2- 172.21.15.146:0/422483776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce2015b770 0x7fce2006fe10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fce20074da0 tx=0x7fce1002a9b0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.254+0000 7fce25ca9640 1 -- 172.21.15.146:0/422483776 shutdown_connections 2024-09-17T03:34:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.254+0000 7fce25ca9640 1 --2- 172.21.15.146:0/422483776 >> v2:172.21.15.179:3300/0 conn(0x7fce20072bc0 0x7fce2015f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.254+0000 7fce25ca9640 1 --2- 172.21.15.146:0/422483776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce20070350 0x7fce20072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.254+0000 7fce25ca9640 1 --2- 172.21.15.146:0/422483776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce2015b770 0x7fce2006fe10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.254+0000 7fce25ca9640 1 -- 172.21.15.146:0/422483776 >> 172.21.15.146:0/422483776 conn(0x7fce200b2060 msgr2=0x7fce200b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.254+0000 7fce25ca9640 1 -- 172.21.15.146:0/422483776 shutdown_connections 2024-09-17T03:34:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.254+0000 7fce25ca9640 1 -- 172.21.15.146:0/422483776 wait complete. 2024-09-17T03:34:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.255+0000 7fce25ca9640 1 Processor -- start 2024-09-17T03:34:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.255+0000 7fce25ca9640 1 -- start start 2024-09-17T03:34:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce25ca9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce20070350 0x7fce201486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce25ca9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce20072bc0 0x7fce200ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce25ca9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce2015b770 0x7fce2006ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce25ca9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fce2015fbb0 con 0x7fce20070350 2024-09-17T03:34:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce25ca9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fce2015fa30 con 0x7fce20072bc0 2024-09-17T03:34:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce25ca9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fce2015fd30 con 0x7fce2015b770 2024-09-17T03:34:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce20070350 0x7fce201486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce20070350 0x7fce201486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54522/0 (socket says 172.21.15.146:54522) 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce1f7fe640 1 -- 172.21.15.146:0/4050597290 learned_addr learned my addr 172.21.15.146:0/4050597290 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce1effd640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce20072bc0 0x7fce200ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce1ffff640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce2015b770 0x7fce2006ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce1f7fe640 1 -- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce2015b770 msgr2=0x7fce2006ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce2015b770 0x7fce2006ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce1f7fe640 1 -- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce20072bc0 msgr2=0x7fce200ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce20072bc0 0x7fce200ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce1f7fe640 1 -- 172.21.15.146:0/4050597290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce20148e00 con 0x7fce20070350 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce20070350 0x7fce201486f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fce10006010 tx=0x7fce10003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce07fff640 1 -- 172.21.15.146:0/4050597290 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10034050 con 0x7fce20070350 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.257+0000 7fce07fff640 1 -- 172.21.15.146:0/4050597290 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce10004550 con 0x7fce20070350 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.258+0000 7fce25ca9640 1 -- 172.21.15.146:0/4050597290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce201490e0 con 0x7fce20070350 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.258+0000 7fce07fff640 1 -- 172.21.15.146:0/4050597290 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10043440 con 0x7fce20070350 2024-09-17T03:34:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.258+0000 7fce25ca9640 1 -- 172.21.15.146:0/4050597290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce201496a0 con 0x7fce20070350 2024-09-17T03:34:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.259+0000 7fce07fff640 1 -- 172.21.15.146:0/4050597290 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce10037020 con 0x7fce20070350 2024-09-17T03:34:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.260+0000 7fce07fff640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce0c078bc0 0x7fce0c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.260+0000 7fce07fff640 1 -- 172.21.15.146:0/4050597290 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fce100bbfd0 con 0x7fce20070350 2024-09-17T03:34:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.260+0000 7fce1effd640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce0c078bc0 0x7fce0c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.260+0000 7fce1effd640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce0c078bc0 0x7fce0c07b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce20157370 tx=0x7fce1400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.261+0000 7fce2cc18740 1 Processor -- start 2024-09-17T03:34:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.261+0000 7fce2cc18740 1 -- start start 2024-09-17T03:34:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.262+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e63310b390 0x55e6334cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.262+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e6334f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.262+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334d9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.262+0000 7fce2cc18740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e633425bd0 con 0x55e6330ea6b0 2024-09-17T03:34:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.262+0000 7fce2cc18740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e633415000 con 0x55e63310b390 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.262+0000 7fce2cc18740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55e633418e10 con 0x55e6330e24d0 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.262+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334d9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e6334f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334d9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54534/0 (socket says 172.21.15.146:54534) 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1ffff640 1 -- 172.21.15.146:0/2067198433 learned_addr learned my addr 172.21.15.146:0/2067198433 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/2067198433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e63310b390 0x55e6334cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1ffff640 1 -- 172.21.15.146:0/2067198433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 msgr2=0x55e6334f8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1ffff640 1 --2- 172.21.15.146:0/2067198433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e6334f8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1ffff640 1 -- 172.21.15.146:0/2067198433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e63310b390 msgr2=0x55e6334cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1ffff640 1 --2- 172.21.15.146:0/2067198433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e63310b390 0x55e6334cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1ffff640 1 -- 172.21.15.146:0/2067198433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6331ed7d0 con 0x55e6330ea6b0 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1effd640 1 --2- 172.21.15.146:0/2067198433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e6334f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/2067198433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e63310b390 0x55e6334cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:34:45.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce1ffff640 1 --2- 172.21.15.146:0/2067198433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334d9f10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fce180036a0 tx=0x7fce18003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ecfeae28d55072 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce057fa640 1 -- 172.21.15.146:0/2067198433 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1800bb40 con 0x55e6330ea6b0 2024-09-17T03:34:45.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce057fa640 1 -- 172.21.15.146:0/2067198433 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce18015030 con 0x55e6330ea6b0 2024-09-17T03:34:45.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.263+0000 7fce057fa640 1 -- 172.21.15.146:0/2067198433 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18005220 con 0x55e6330ea6b0 2024-09-17T03:34:45.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.264+0000 7fce2cc18740 1 -- 172.21.15.146:0/2067198433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 msgr2=0x55e6334d9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.264+0000 7fce2cc18740 1 --2- 172.21.15.146:0/2067198433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334d9f10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fce180036a0 tx=0x7fce18003b60 comp rx=0 tx=0).stop 2024-09-17T03:34:45.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.264+0000 7fce2cc18740 1 -- 172.21.15.146:0/2067198433 shutdown_connections 2024-09-17T03:34:45.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.264+0000 7fce2cc18740 1 --2- 172.21.15.146:0/2067198433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334d9f10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.264+0000 7fce2cc18740 1 --2- 172.21.15.146:0/2067198433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e6334f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.264+0000 7fce2cc18740 1 --2- 172.21.15.146:0/2067198433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e63310b390 0x55e6334cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.264+0000 7fce2cc18740 1 -- 172.21.15.146:0/2067198433 >> 172.21.15.146:0/2067198433 conn(0x55e6330ff4e0 msgr2=0x55e6334b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.264+0000 7fce2cc18740 1 -- 172.21.15.146:0/2067198433 shutdown_connections 2024-09-17T03:34:45.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.264+0000 7fce2cc18740 1 -- 172.21.15.146:0/2067198433 wait complete. 2024-09-17T03:34:45.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.265+0000 7fce2cc18740 1 -- start start 2024-09-17T03:34:45.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.265+0000 7fce2cc18740 1 Processor -- start 2024-09-17T03:34:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.266+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e6334df740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.266+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e6330ea6b0 0x55e6334eee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.266+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e63310b390 0x55e6334ef350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.266+0000 7fce2cc18740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e633185740 con 0x55e63310b390 2024-09-17T03:34:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.266+0000 7fce2cc18740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e6333ba540 con 0x55e6330ea6b0 2024-09-17T03:34:45.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.266+0000 7fce2cc18740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55e6334cc5c0 con 0x55e6330e24d0 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce2cc18740 10 client.0 _ll_register_callbacks cb 0x55e6333b90e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e63310b390 0x55e6334ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e63310b390 0x55e6334ef350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54536/0 (socket says 172.21.15.146:54536) 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce1ffff640 1 -- 172.21.15.146:0/3214401126 learned_addr learned my addr 172.21.15.146:0/3214401126 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce1effd640 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e6330ea6b0 0x55e6334eee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e6334df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce1ffff640 1 -- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 msgr2=0x55e6334df740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce1ffff640 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e6334df740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce1ffff640 1 -- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e6330ea6b0 msgr2=0x55e6334eee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce1ffff640 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e6330ea6b0 0x55e6334eee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce1ffff640 1 -- 172.21.15.146:0/3214401126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6331546a0 con 0x55e63310b390 2024-09-17T03:34:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce1ffff640 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e63310b390 0x55e6334ef350 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fce1800bc50 tx=0x7fce18004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af075c87dc7d180a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fcdfe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/3214401126 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1800be90 con 0x55e63310b390 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/3214401126 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fce18005020 con 0x55e63310b390 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce2cc18740 1 -- 172.21.15.146:0/3214401126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce18015030 con 0x55e63310b390 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/3214401126 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fce18005220 con 0x55e63310b390 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce2cc18740 10 client.5172 fetch_fsmap learned FSMap version 14 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.267+0000 7fce2cc18740 1 -- 172.21.15.146:0/3214401126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55e63324df60 con 0x55e63310b390 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.268+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/3214401126 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce18015030 con 0x55e63310b390 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.268+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/3214401126 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fce18031080 con 0x55e63310b390 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.268+0000 7fce2cc18740 10 client.5172 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.268+0000 7fce2cc18740 10 client.5172 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-09-17T03:34:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.268+0000 7fce2cc18740 20 client.5172 populate_metadata read hostname 'smithi146' 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.268+0000 7fce2cc18740 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55e6330c9f60 0x55e6334ca400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.268+0000 7fce2cc18740 4 client.5172 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.268+0000 7fce2cc18740 1 -- 172.21.15.146:0/3214401126 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e633427b20 con 0x55e6330c9f60 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.268+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55e6330c9f60 0x55e6334ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.268+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55e6330c9f60 0x55e6334ca400 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=349130057d8b6b4f server_cookie=864c7e5676c51dce in_seq=0 out_seq=0 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.268+0000 7fcdfe7fc640 10 client.5172 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/3214401126 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e633427b20 con 0x55e6330c9f60 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fcdfe7fc640 10 client.5172 handle_command_reply: tid=0 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 1 client.5172 shutdown 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 1 -- 172.21.15.146:0/3214401126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e63310b390 msgr2=0x55e6334ef350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e63310b390 0x55e6334ef350 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fce1800bc50 tx=0x7fce18004250 comp rx=0 tx=0).stop 2024-09-17T03:34:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 1 -- 172.21.15.146:0/3214401126 shutdown_connections 2024-09-17T03:34:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55e6330c9f60 0x55e6334ca400 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e63310b390 0x55e6334ef350 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e6330ea6b0 0x55e6334eee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fcdfe7fc640 0 client.5172 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 1 --2- 172.21.15.146:0/3214401126 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e6334df740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 1 -- 172.21.15.146:0/3214401126 >> 172.21.15.146:0/3214401126 conn(0x55e6330ff4e0 msgr2=0x55e6334f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 1 -- 172.21.15.146:0/3214401126 shutdown_connections 2024-09-17T03:34:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 1 -- 172.21.15.146:0/3214401126 wait complete. 2024-09-17T03:34:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.269+0000 7fce2cc18740 20 client.5172 trim_cache size 0 max 16384 2024-09-17T03:34:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.285+0000 7fce2cc18740 1 Processor -- start 2024-09-17T03:34:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.285+0000 7fce2cc18740 1 -- start start 2024-09-17T03:34:45.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e6330e24d0 0x55e6334cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334ef140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e63310b390 0x55e6334f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce2cc18740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fce201fe080 con 0x55e6330ea6b0 2024-09-17T03:34:45.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce2cc18740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fce200ab8f0 con 0x55e6330e24d0 2024-09-17T03:34:45.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce2cc18740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fce2015df60 con 0x55e63310b390 2024-09-17T03:34:45.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce1effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce1effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334ef140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54552/0 (socket says 172.21.15.146:54552) 2024-09-17T03:34:45.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce1effd640 1 -- 172.21.15.146:0/3374659253 learned_addr learned my addr 172.21.15.146:0/3374659253 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/3374659253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e6330e24d0 0x55e6334cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce1ffff640 1 --2- 172.21.15.146:0/3374659253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e63310b390 0x55e6334f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce1effd640 1 -- 172.21.15.146:0/3374659253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e63310b390 msgr2=0x55e6334f43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce1effd640 1 --2- 172.21.15.146:0/3374659253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e63310b390 0x55e6334f43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce1effd640 1 -- 172.21.15.146:0/3374659253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e6330e24d0 msgr2=0x55e6334cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce1effd640 1 --2- 172.21.15.146:0/3374659253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e6330e24d0 0x55e6334cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce1effd640 1 -- 172.21.15.146:0/3374659253 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6331ebad0 con 0x55e6330ea6b0 2024-09-17T03:34:45.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.287+0000 7fce1effd640 1 --2- 172.21.15.146:0/3374659253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334ef140 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce140114a0 tx=0x7fce14013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626c1ce1c6096ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.288+0000 7fce04ff9640 1 -- 172.21.15.146:0/3374659253 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14029420 con 0x55e6330ea6b0 2024-09-17T03:34:45.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.288+0000 7fce04ff9640 1 -- 172.21.15.146:0/3374659253 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce140295c0 con 0x55e6330ea6b0 2024-09-17T03:34:45.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.288+0000 7fce04ff9640 1 -- 172.21.15.146:0/3374659253 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce140299d0 con 0x55e6330ea6b0 2024-09-17T03:34:45.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.288+0000 7fce2cc18740 1 -- 172.21.15.146:0/3374659253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 msgr2=0x55e6334ef140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.288+0000 7fce2cc18740 1 --2- 172.21.15.146:0/3374659253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334ef140 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce140114a0 tx=0x7fce14013000 comp rx=0 tx=0).stop 2024-09-17T03:34:45.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.288+0000 7fce2cc18740 1 -- 172.21.15.146:0/3374659253 shutdown_connections 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.288+0000 7fce2cc18740 1 --2- 172.21.15.146:0/3374659253 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e63310b390 0x55e6334f43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.288+0000 7fce2cc18740 1 --2- 172.21.15.146:0/3374659253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334ef140 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.288+0000 7fce2cc18740 1 --2- 172.21.15.146:0/3374659253 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e6330e24d0 0x55e6334cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.288+0000 7fce2cc18740 1 -- 172.21.15.146:0/3374659253 >> 172.21.15.146:0/3374659253 conn(0x55e6330ff4e0 msgr2=0x55e6334a8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.289+0000 7fce2cc18740 1 -- 172.21.15.146:0/3374659253 shutdown_connections 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.289+0000 7fce2cc18740 1 -- 172.21.15.146:0/3374659253 wait complete. 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.289+0000 7fce2cc18740 1 -- start start 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.289+0000 7fce2cc18740 1 Processor -- start 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e633564a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce2cc18740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e63310b390 0x55e6334f4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce2cc18740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e6334ef710 con 0x55e6330ea6b0 2024-09-17T03:34:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce2cc18740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fce2014a9e0 con 0x55e63310b390 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce2cc18740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55e6334b31d0 con 0x55e6330e24d0 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce2cc18740 10 client.0 _ll_register_callbacks cb 0x7fce10009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce1effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce1effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334f43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54564/0 (socket says 172.21.15.146:54564) 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce1effd640 1 -- 172.21.15.146:0/1873202527 learned_addr learned my addr 172.21.15.146:0/1873202527 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e633564a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce1ffff640 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e63310b390 0x55e6334f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce1effd640 1 -- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 msgr2=0x55e633564a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce1effd640 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e633564a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce1effd640 1 -- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e63310b390 msgr2=0x55e6334f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce1effd640 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e63310b390 0x55e6334f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce1effd640 1 -- 172.21.15.146:0/1873202527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6334aca00 con 0x55e6330ea6b0 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce1effd640 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334f43c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fce1402aa60 tx=0x7fce14011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f5a5ba40d1c8a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fcdfe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/1873202527 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14029420 con 0x55e6330ea6b0 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/1873202527 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fce1402e070 con 0x55e6330ea6b0 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.291+0000 7fce2cc18740 1 -- 172.21.15.146:0/1873202527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce140295c0 con 0x55e6330ea6b0 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/1873202527 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fce1401e630 con 0x55e6330ea6b0 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fce2cc18740 10 client.5178 fetch_fsmap learned FSMap version 14 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fce2cc18740 1 -- 172.21.15.146:0/1873202527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55e6334ac5b0 con 0x55e6330ea6b0 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/1873202527 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce140295c0 con 0x55e6330ea6b0 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/1873202527 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fce1401e7d0 con 0x55e6330ea6b0 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fce2cc18740 10 client.5178 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fce2cc18740 10 client.5178 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-09-17T03:34:45.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fce2cc18740 20 client.5178 populate_metadata read hostname 'smithi146' 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fce2cc18740 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55e63351e7f0 0x55e6335031c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fce2cc18740 4 client.5178 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fce2cc18740 1 -- 172.21.15.146:0/1873202527 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55e6334235d0 con 0x55e63351e7f0 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55e63351e7f0 0x55e6335031c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fcdfe7fc640 10 client.5178 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.292+0000 7fce1f7fe640 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55e63351e7f0 0x55e6335031c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d1ad6e665bb15d server_cookie=738ba7c1dd3882d8 in_seq=0 out_seq=0 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fcdfe7fc640 1 -- 172.21.15.146:0/1873202527 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18087 (crc 0 0 0) 0x55e6334235d0 con 0x55e63351e7f0 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fcdfe7fc640 10 client.5178 handle_command_reply: tid=0 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 1 client.5178 shutdown 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 1 -- 172.21.15.146:0/1873202527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 msgr2=0x55e6334f43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334f43c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fce1402aa60 tx=0x7fce14011f90 comp rx=0 tx=0).stop 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 1 -- 172.21.15.146:0/1873202527 shutdown_connections 2024-09-17T03:34:45.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55e63351e7f0 0x55e6335031c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e63310b390 0x55e6334f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fcdfe7fc640 0 client.5178 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e6330ea6b0 0x55e6334f43c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 1 --2- 172.21.15.146:0/1873202527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e6330e24d0 0x55e633564a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 1 -- 172.21.15.146:0/1873202527 >> 172.21.15.146:0/1873202527 conn(0x55e6330ff4e0 msgr2=0x55e6334a8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 1 -- 172.21.15.146:0/1873202527 shutdown_connections 2024-09-17T03:34:45.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 1 -- 172.21.15.146:0/1873202527 wait complete. 2024-09-17T03:34:45.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.293+0000 7fce2cc18740 20 client.5178 trim_cache size 0 max 16384 2024-09-17T03:34:45.298 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 1612, 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 1613, 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 405754, 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 34888183, 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 9, 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.263984524, 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.156927018, 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.033474951, 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.062574504, 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:34:45.299 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1612, 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.377137454, 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000233956 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2, 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000191, 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000095 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 0 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-09-17T03:34:45.300 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 27743, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 50077, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 9252330, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 41248290, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 7, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 2.189396718, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 1.457529105, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 1.045967762, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.039311584, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 50076, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.300969509, 2024-09-17T03:34:45.301 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000025979 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 46802, 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.009993796, 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000213 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 128112, 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 19408 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 2010, 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 2024, 2024-09-17T03:34:45.302 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 694768, 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 38710970, 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 6, 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.323532624, 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.194655958, 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.048269030, 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.069317365, 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2023, 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.229085184, 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000113240 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.303 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 2032, 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 113008 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-17T03:34:45.304 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1378, 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 17.217122590, 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.012494283 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1985, 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.778163316, 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000392021 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.305 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 25655, 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 25655, 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 25655, 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 378.677848799, 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.014760391 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_complete": 0, 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_keys": 0, 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 12, 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2024-09-17T03:34:45.306 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 19927, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 0, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 19927, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 19926, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 0, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 58, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 58, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 2, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 46759, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 46190, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2024-09-17T03:34:45.307 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 114, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2024-09-17T03:34:45.308 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 1028, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 4027, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2024-09-17T03:34:45.309 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 3082, 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 2474, 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 60, 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 14102 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update": 0, 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update_receipt": 0, 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_try_discover": 0, 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_send_discover": 0, 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_handle_discover": 0, 2024-09-17T03:34:45.310 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 2000, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 164, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 4190, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 1780, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 2251, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2024-09-17T03:34:45.311 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_path": 0, 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_inode": 0, 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 0, 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0, 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_succeeded": 0, 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_write_failed": 0 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2024-09-17T03:34:45.312 INFO:teuthology.orchestra.run.smithi146.stdout: "evlrg": 0, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 23919, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 0, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 0, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 23919, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 0, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 32, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 0, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 0, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 32, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "segmjr": 3, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 0, 2024-09-17T03:34:45.313 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 4194304, 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 93966106, 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 0, 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2633, 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 103.647451439, 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.039364774 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 0 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 2014, 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 2014, 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 0, 2024-09-17T03:34:45.314 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 13, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 13, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 0, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 19927, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 19928, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 1, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 58, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 8194, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 8136, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 178316, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 406740992 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 28665, 2024-09-17T03:34:45.315 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 25655, 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 4, 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2000, 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2.581708117, 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001290854 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 30, 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.006987406, 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000232913 2024-09-17T03:34:45.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6000, 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 7.288516362, 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001214752 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 7360, 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 5.177316697, 2024-09-17T03:34:45.317 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000703439 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.318 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000055603, 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000055603 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2024-09-17T03:34:45.319 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.320 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.320 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.320 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2024-09-17T03:34:45.320 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:34:45.320 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.003202302, 2024-09-17T03:34:45.320 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.003202302 2024-09-17T03:34:45.320 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.320 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2024-09-17T03:34:45.320 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.320 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.429262204, 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.429262204 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000126631, 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000126631 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.321 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8, 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.480665801, 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.060083225 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2251, 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 342.185766029, 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.152015000 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.322 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: "req_snapdiff_latency": { 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.323 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.098207142, 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.098207142 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:34:45.324 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000323171, 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000323171 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.325 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.326 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8000, 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 20.425711334, 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002553213 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.327 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 1, 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 0, 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 1, 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 18073, 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 18073, 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 52, 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: "mdthresh_evicted": 0 2024-09-17T03:34:45.328 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-09-17T03:34:45.329 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-09-17T03:34:45.330 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 16409558, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 6113, 2024-09-17T03:34:45.331 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 440, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 5, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 5312, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 75, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-09-17T03:34:45.332 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 21268636, 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 887411, 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 4680, 2024-09-17T03:34:45.333 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 90240787, 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 37, 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 4680, 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "op_latency": { 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4680, 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 23.694472744, 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.005062921 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "op_inflight": 0, 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4680, 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 4782 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 4680, 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 60, 2024-09-17T03:34:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 4620, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 0, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 11, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 60, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 2693, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 37, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 1780, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 33, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2024-09-17T03:34:45.335 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 22, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2024-09-17T03:34:45.336 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2024-09-17T03:34:45.337 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 32, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 1, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 8, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 8, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 113, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 0, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 33 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.338 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 1, 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 32, 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 32, 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed_ops": 1780, 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 1780, 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2024-09-17T03:34:45.339 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 31361, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 7950887, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 31361, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 31361, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 7950887, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.340 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 4680, 2024-09-17T03:34:45.341 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 90434807, 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 4680, 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 90434807, 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-17T03:34:45.342 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 4680, 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 4680, 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 4680, 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 4680, 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:34:45.343 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 1780, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 194020, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 1780, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 60, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 194020, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.344 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55ba8d1d55f0": { 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 84, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 23919, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 89771802, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 23919, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2633, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 89771718, 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:34:45.345 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:34:45.346 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:34:45.346 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:34:45.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.346 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.346 INFO:teuthology.orchestra.run.smithi146.stdout: "trackedop": { 2024-09-17T03:34:45.346 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_ops_count": 0 2024-09-17T03:34:45.346 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.346 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:34:45.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 -- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce0c078bc0 msgr2=0x7fce0c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce0c078bc0 0x7fce0c07b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce20157370 tx=0x7fce1400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 -- 172.21.15.146:0/4050597290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce20070350 msgr2=0x7fce201486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce20070350 0x7fce201486f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fce10006010 tx=0x7fce10003f90 comp rx=0 tx=0).stop 2024-09-17T03:34:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 -- 172.21.15.146:0/4050597290 shutdown_connections 2024-09-17T03:34:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce0c078bc0 0x7fce0c07b0d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce2015b770 0x7fce2006ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce20072bc0 0x7fce200ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 --2- 172.21.15.146:0/4050597290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce20070350 0x7fce201486f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 -- 172.21.15.146:0/4050597290 >> 172.21.15.146:0/4050597290 conn(0x7fce200b2060 msgr2=0x7fce20075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 -- 172.21.15.146:0/4050597290 shutdown_connections 2024-09-17T03:34:45.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.294+0000 7fce25ca9640 1 -- 172.21.15.146:0/4050597290 wait complete. 2024-09-17T03:34:45.349 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-17T03:34:45.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:34:45.349 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-09-17T03:34:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.469+0000 7f8a68db0640 1 -- 172.21.15.146:0/356969696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a640b5ce0 msgr2=0x7f8a640b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.469+0000 7f8a68db0640 1 --2- 172.21.15.146:0/356969696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a640b5ce0 0x7f8a640b1320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8a54005fd0 tx=0x7f8a5402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.469+0000 7f8a68db0640 1 -- 172.21.15.146:0/356969696 shutdown_connections 2024-09-17T03:34:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.469+0000 7f8a68db0640 1 --2- 172.21.15.146:0/356969696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a640b3d30 0x7f8a6415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.469+0000 7f8a68db0640 1 --2- 172.21.15.146:0/356969696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a640b5ce0 0x7f8a640b1320 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.469+0000 7f8a68db0640 1 -- 172.21.15.146:0/356969696 >> 172.21.15.146:0/356969696 conn(0x7f8a640b7b20 msgr2=0x7f8a6409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.469+0000 7f8a68db0640 1 -- 172.21.15.146:0/356969696 shutdown_connections 2024-09-17T03:34:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.469+0000 7f8a68db0640 1 -- 172.21.15.146:0/356969696 wait complete. 2024-09-17T03:34:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.471+0000 7f8a68db0640 1 Processor -- start 2024-09-17T03:34:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.471+0000 7f8a68db0640 1 -- start start 2024-09-17T03:34:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a68db0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a640b5750 0x7f8a64156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a68db0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a640b5ce0 0x7f8a640719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a68db0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a64071ee0 0x7f8a6414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a68db0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6415d4b0 con 0x7f8a640b5ce0 2024-09-17T03:34:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a68db0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6415d330 con 0x7f8a640b5750 2024-09-17T03:34:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a68db0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6415d630 con 0x7f8a64071ee0 2024-09-17T03:34:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a5bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a640b5ce0 0x7f8a640719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a5bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a640b5ce0 0x7f8a640719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54582/0 (socket says 172.21.15.146:54582) 2024-09-17T03:34:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a5bfff640 1 -- 172.21.15.146:0/3444327210 learned_addr learned my addr 172.21.15.146:0/3444327210 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a6259c640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a640b5750 0x7f8a64156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a62d9d640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a64071ee0 0x7f8a6414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a5bfff640 1 -- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a64071ee0 msgr2=0x7f8a6414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a5bfff640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a64071ee0 0x7f8a6414fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a5bfff640 1 -- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a640b5750 msgr2=0x7f8a64156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a5bfff640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a640b5750 0x7f8a64156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a5bfff640 1 -- 172.21.15.146:0/3444327210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a641f4550 con 0x7f8a640b5ce0 2024-09-17T03:34:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.472+0000 7f8a5bfff640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a640b5ce0 0x7f8a640719a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00c3c0 tx=0x7f8a4c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.473+0000 7f8a5affd640 1 -- 172.21.15.146:0/3444327210 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c017070 con 0x7f8a640b5ce0 2024-09-17T03:34:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.473+0000 7f8a5affd640 1 -- 172.21.15.146:0/3444327210 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a4c0035f0 con 0x7f8a640b5ce0 2024-09-17T03:34:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.473+0000 7f8a68db0640 1 -- 172.21.15.146:0/3444327210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a641f3cb0 con 0x7f8a640b5ce0 2024-09-17T03:34:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.473+0000 7f8a5affd640 1 -- 172.21.15.146:0/3444327210 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c003a80 con 0x7f8a640b5ce0 2024-09-17T03:34:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.473+0000 7f8a68db0640 1 -- 172.21.15.146:0/3444327210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a641f4270 con 0x7f8a640b5ce0 2024-09-17T03:34:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.475+0000 7f8a5affd640 1 -- 172.21.15.146:0/3444327210 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a4c01a070 con 0x7f8a640b5ce0 2024-09-17T03:34:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.475+0000 7f8a5affd640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a44078b90 0x7f8a4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.475+0000 7f8a5affd640 1 -- 172.21.15.146:0/3444327210 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8a4c099e00 con 0x7f8a640b5ce0 2024-09-17T03:34:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.475+0000 7f8a6259c640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a44078b90 0x7f8a4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.476+0000 7f8a6259c640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a44078b90 0x7f8a4407b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a54033000 tx=0x7f8a54004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.476+0000 7f8a6fdf5740 1 Processor -- start 2024-09-17T03:34:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.476+0000 7f8a6fdf5740 1 -- start start 2024-09-17T03:34:45.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.477+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a1603ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.477+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a1603634c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ff9e7f0 0x55a16038e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a1602d9a30 con 0x55a15ffbf4d0 2024-09-17T03:34:45.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a1602c8e60 con 0x55a15ff96610 2024-09-17T03:34:45.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a1602ccc70 con 0x55a15ff9e7f0 2024-09-17T03:34:45.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a1603ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a1603ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54584/0 (socket says 172.21.15.146:54584) 2024-09-17T03:34:45.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6259c640 1 -- 172.21.15.146:0/2341901908 learned_addr learned my addr 172.21.15.146:0/2341901908 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a62d9d640 1 --2- 172.21.15.146:0/2341901908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ff9e7f0 0x55a16038e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a5bfff640 1 --2- 172.21.15.146:0/2341901908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a1603634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6259c640 1 -- 172.21.15.146:0/2341901908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ff9e7f0 msgr2=0x55a16038e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6259c640 1 --2- 172.21.15.146:0/2341901908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ff9e7f0 0x55a16038e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6259c640 1 -- 172.21.15.146:0/2341901908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 msgr2=0x55a1603634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6259c640 1 --2- 172.21.15.146:0/2341901908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a1603634c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6259c640 1 -- 172.21.15.146:0/2341901908 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16026f190 con 0x55a15ffbf4d0 2024-09-17T03:34:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a6259c640 1 --2- 172.21.15.146:0/2341901908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a1603ad9e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8a540099c0 tx=0x7f8a5403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cbb64a032e493 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a43fff640 1 -- 172.21.15.146:0/2341901908 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54035040 con 0x55a15ffbf4d0 2024-09-17T03:34:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a43fff640 1 -- 172.21.15.146:0/2341901908 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a5404d070 con 0x55a15ffbf4d0 2024-09-17T03:34:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.478+0000 7f8a43fff640 1 -- 172.21.15.146:0/2341901908 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54003ac0 con 0x55a15ffbf4d0 2024-09-17T03:34:45.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.479+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2341901908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 msgr2=0x55a1603ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.479+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/2341901908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a1603ad9e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8a540099c0 tx=0x7f8a5403d000 comp rx=0 tx=0).stop 2024-09-17T03:34:45.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.479+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2341901908 shutdown_connections 2024-09-17T03:34:45.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.479+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/2341901908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ff9e7f0 0x55a16038e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.479+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/2341901908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a1603634c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.479+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/2341901908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a1603ad9e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.479+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2341901908 >> 172.21.15.146:0/2341901908 conn(0x55a15ffb3620 msgr2=0x55a160367c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.479+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2341901908 shutdown_connections 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.479+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2341901908 wait complete. 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.480+0000 7f8a6fdf5740 1 -- start start 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.480+0000 7f8a6fdf5740 1 Processor -- start 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ff96610 0x55a1603a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff9e7f0 0x55a16038e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a16038ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a160039880 con 0x55a15ffbf4d0 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a16024f5a0 con 0x55a15ff9e7f0 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a1603a57d0 con 0x55a15ff96610 2024-09-17T03:34:45.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a6fdf5740 10 client.0 _ll_register_callbacks cb 0x55a16027da90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a62d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a16038ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a62d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a16038ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54594/0 (socket says 172.21.15.146:54594) 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a62d9d640 1 -- 172.21.15.146:0/1610427206 learned_addr learned my addr 172.21.15.146:0/1610427206 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a6259c640 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ff96610 0x55a1603a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a5bfff640 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff9e7f0 0x55a16038e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a62d9d640 1 -- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ff96610 msgr2=0x55a1603a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a62d9d640 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ff96610 0x55a1603a6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a62d9d640 1 -- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff9e7f0 msgr2=0x55a16038e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a62d9d640 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff9e7f0 0x55a16038e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a62d9d640 1 -- 172.21.15.146:0/1610427206 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1600a3940 con 0x55a15ffbf4d0 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a62d9d640 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a16038ea90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0129f0 tx=0x7f8a5c012eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d607981bc10b34e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a417fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a417fa640 1 -- 172.21.15.146:0/1610427206 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c00f9c0 con 0x55a15ffbf4d0 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a417fa640 1 -- 172.21.15.146:0/1610427206 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8a5c00fb60 con 0x55a15ffbf4d0 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.482+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/1610427206 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a16029f420 con 0x55a15ffbf4d0 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a417fa640 1 -- 172.21.15.146:0/1610427206 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f8a5c024050 con 0x55a15ffbf4d0 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a6fdf5740 10 client.5193 fetch_fsmap learned FSMap version 14 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/1610427206 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55a1601040d0 con 0x55a15ffbf4d0 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a417fa640 1 -- 172.21.15.146:0/1610427206 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a16029f420 con 0x55a15ffbf4d0 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a417fa640 1 -- 172.21.15.146:0/1610427206 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f8a5c027020 con 0x55a15ffbf4d0 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a6fdf5740 10 client.5193 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a6fdf5740 10 client.5193 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a6fdf5740 20 client.5193 populate_metadata read hostname 'smithi146' 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55a15ff7e2b0 0x55a1603a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a6fdf5740 4 client.5193 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/1610427206 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1602db980 con 0x55a15ff7e2b0 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.483+0000 7f8a6259c640 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55a15ff7e2b0 0x55a1603a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a6259c640 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55a15ff7e2b0 0x55a1603a4eb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b99cbf6cdd9668 server_cookie=4e043b84b7af586c in_seq=0 out_seq=0 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a417fa640 10 client.5193 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a417fa640 1 -- 172.21.15.146:0/1610427206 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1602db980 con 0x55a15ff7e2b0 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a417fa640 10 client.5193 handle_command_reply: tid=0 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a6fdf5740 1 client.5193 shutdown 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/1610427206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 msgr2=0x55a16038ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a16038ea90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0129f0 tx=0x7f8a5c012eb0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/1610427206 shutdown_connections 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55a15ff7e2b0 0x55a1603a4eb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ffbf4d0 0x55a16038ea90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff9e7f0 0x55a16038e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/1610427206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ff96610 0x55a1603a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a417fa640 0 client.5193 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.484+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/1610427206 >> 172.21.15.146:0/1610427206 conn(0x55a15ffb3620 msgr2=0x55a160368be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.485+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/1610427206 shutdown_connections 2024-09-17T03:34:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.485+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/1610427206 wait complete. 2024-09-17T03:34:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.485+0000 7f8a6fdf5740 20 client.5193 trim_cache size 0 max 16384 2024-09-17T03:34:45.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.503+0000 7f8a6fdf5740 1 Processor -- start 2024-09-17T03:34:45.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.503+0000 7f8a6fdf5740 1 -- start start 2024-09-17T03:34:45.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a1603beee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a160390e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ffbf4d0 0x55a16037fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8a641f6bc0 con 0x55a15ff9e7f0 2024-09-17T03:34:45.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6406efc0 con 0x55a15ff96610 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8a64153970 con 0x55a15ffbf4d0 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a5bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a160390e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a5bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a160390e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54600/0 (socket says 172.21.15.146:54600) 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a5bfff640 1 -- 172.21.15.146:0/3282394139 learned_addr learned my addr 172.21.15.146:0/3282394139 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a6259c640 1 --2- 172.21.15.146:0/3282394139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a1603beee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a62d9d640 1 --2- 172.21.15.146:0/3282394139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ffbf4d0 0x55a16037fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a5bfff640 1 -- 172.21.15.146:0/3282394139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ffbf4d0 msgr2=0x55a16037fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a5bfff640 1 --2- 172.21.15.146:0/3282394139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ffbf4d0 0x55a16037fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a5bfff640 1 -- 172.21.15.146:0/3282394139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 msgr2=0x55a1603beee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a5bfff640 1 --2- 172.21.15.146:0/3282394139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a1603beee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a5bfff640 1 -- 172.21.15.146:0/3282394139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1600087e0 con 0x55a15ff9e7f0 2024-09-17T03:34:45.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a6259c640 1 --2- 172.21.15.146:0/3282394139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a1603beee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.504+0000 7f8a62d9d640 1 --2- 172.21.15.146:0/3282394139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ffbf4d0 0x55a16037fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a5bfff640 1 --2- 172.21.15.146:0/3282394139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a160390e40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c061a40 tx=0x7f8a4c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77ca24b7116e970 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a437fe640 1 -- 172.21.15.146:0/3282394139 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c06b620 con 0x55a15ff9e7f0 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a437fe640 1 -- 172.21.15.146:0/3282394139 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a4c06b190 con 0x55a15ff9e7f0 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a437fe640 1 -- 172.21.15.146:0/3282394139 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c060fa0 con 0x55a15ff9e7f0 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/3282394139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 msgr2=0x55a160390e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/3282394139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a160390e40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c061a40 tx=0x7f8a4c014040 comp rx=0 tx=0).stop 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/3282394139 shutdown_connections 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/3282394139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ffbf4d0 0x55a16037fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/3282394139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a160390e40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/3282394139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a1603beee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/3282394139 >> 172.21.15.146:0/3282394139 conn(0x55a15ffb3620 msgr2=0x55a160368c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.505+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/3282394139 shutdown_connections 2024-09-17T03:34:45.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.506+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/3282394139 wait complete. 2024-09-17T03:34:45.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.506+0000 7f8a6fdf5740 1 -- start start 2024-09-17T03:34:45.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.506+0000 7f8a6fdf5740 1 Processor -- start 2024-09-17T03:34:45.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a160427110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a1603637f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a6fdf5740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ffbf4d0 0x55a16037fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8a64153fc0 con 0x55a15ff9e7f0 2024-09-17T03:34:45.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a1603808a0 con 0x55a15ff96610 2024-09-17T03:34:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a6fdf5740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a160388a60 con 0x55a15ffbf4d0 2024-09-17T03:34:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a6fdf5740 10 client.0 _ll_register_callbacks cb 0x7f8a5c009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:34:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a5bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a1603637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a5bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a1603637f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54608/0 (socket says 172.21.15.146:54608) 2024-09-17T03:34:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a5bfff640 1 -- 172.21.15.146:0/2166059337 learned_addr learned my addr 172.21.15.146:0/2166059337 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a6259c640 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a160427110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a62d9d640 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ffbf4d0 0x55a16037fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a5bfff640 1 -- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ffbf4d0 msgr2=0x55a16037fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a5bfff640 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ffbf4d0 0x55a16037fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a5bfff640 1 -- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 msgr2=0x55a160427110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a5bfff640 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a160427110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a5bfff640 1 -- 172.21.15.146:0/2166059337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a160295fb0 con 0x55a15ff9e7f0 2024-09-17T03:34:45.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a5bfff640 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a1603637f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c007fd0 tx=0x7f8a4c05dfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3284e3509abff36 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a417fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:34:45.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.508+0000 7f8a417fa640 1 -- 172.21.15.146:0/2166059337 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c05d890 con 0x55a15ff9e7f0 2024-09-17T03:34:45.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a417fa640 1 -- 172.21.15.146:0/2166059337 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8a4c060a10 con 0x55a15ff9e7f0 2024-09-17T03:34:45.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2166059337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a4c06b190 con 0x55a15ff9e7f0 2024-09-17T03:34:45.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a417fa640 1 -- 172.21.15.146:0/2166059337 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f8a4c060c10 con 0x55a15ff9e7f0 2024-09-17T03:34:45.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a6fdf5740 10 client.5199 fetch_fsmap learned FSMap version 14 2024-09-17T03:34:45.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2166059337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55a1603887a0 con 0x55a15ff9e7f0 2024-09-17T03:34:45.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a417fa640 1 -- 172.21.15.146:0/2166059337 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a4c06b190 con 0x55a15ff9e7f0 2024-09-17T03:34:45.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a417fa640 1 -- 172.21.15.146:0/2166059337 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f8a4c069a60 con 0x55a15ff9e7f0 2024-09-17T03:34:45.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a6fdf5740 10 client.5199 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T03:34:45.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a6fdf5740 10 client.5199 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-09-17T03:34:45.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a6fdf5740 20 client.5199 populate_metadata read hostname 'smithi146' 2024-09-17T03:34:45.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55a160363d30 0x55a16037ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a6fdf5740 4 client.5199 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-09-17T03:34:45.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2166059337 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) -- 0x55a1602d7430 con 0x55a160363d30 2024-09-17T03:34:45.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a6259c640 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55a160363d30 0x55a16037ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.509+0000 7f8a417fa640 10 client.5199 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.510+0000 7f8a6259c640 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55a160363d30 0x55a16037ff90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be76ec766963ce50 server_cookie=b1ad73099e03e0b0 in_seq=0 out_seq=0 2024-09-17T03:34:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a417fa640 1 -- 172.21.15.146:0/2166059337 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a1602d7430 con 0x55a160363d30 2024-09-17T03:34:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a417fa640 10 client.5199 handle_command_reply: tid=0 2024-09-17T03:34:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a6fdf5740 1 client.5199 shutdown 2024-09-17T03:34:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2166059337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 msgr2=0x55a1603637f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a1603637f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c007fd0 tx=0x7f8a4c05dfb0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2166059337 shutdown_connections 2024-09-17T03:34:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55a160363d30 0x55a16037ff90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a15ffbf4d0 0x55a16037fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a15ff9e7f0 0x55a1603637f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a6fdf5740 1 --2- 172.21.15.146:0/2166059337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a15ff96610 0x55a160427110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a417fa640 0 client.5199 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2166059337 >> 172.21.15.146:0/2166059337 conn(0x55a15ffb3620 msgr2=0x55a160390e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2166059337 shutdown_connections 2024-09-17T03:34:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.516+0000 7f8a6fdf5740 1 -- 172.21.15.146:0/2166059337 wait complete. 2024-09-17T03:34:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a6fdf5740 20 client.5199 trim_cache size 0 max 16384 2024-09-17T03:34:45.517 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:34:45.518 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:34:45.518 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "2bc60f8f-f317-473a-a6bf-8d9f367e6acd", 2024-09-17T03:34:45.518 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:34:45.518 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:34:45.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 -- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a44078b90 msgr2=0x7f8a4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a44078b90 0x7f8a4407b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a54033000 tx=0x7f8a54004730 comp rx=0 tx=0).stop 2024-09-17T03:34:45.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 -- 172.21.15.146:0/3444327210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a640b5ce0 msgr2=0x7f8a640719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a640b5ce0 0x7f8a640719a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00c3c0 tx=0x7f8a4c00c7c0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 -- 172.21.15.146:0/3444327210 shutdown_connections 2024-09-17T03:34:45.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a44078b90 0x7f8a4407b0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a64071ee0 0x7f8a6414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a640b5ce0 0x7f8a640719a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 --2- 172.21.15.146:0/3444327210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a640b5750 0x7f8a64156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 -- 172.21.15.146:0/3444327210 >> 172.21.15.146:0/3444327210 conn(0x7f8a640b7b20 msgr2=0x7f8a640b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 -- 172.21.15.146:0/3444327210 shutdown_connections 2024-09-17T03:34:45.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.517+0000 7f8a68db0640 1 -- 172.21.15.146:0/3444327210 wait complete. 2024-09-17T03:34:45.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:34:45.528 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-17T03:34:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.647+0000 7fa9ba89b640 1 -- 172.21.15.146:0/4032677010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b40b4530 msgr2=0x7fa9b40b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.647+0000 7fa9ba89b640 1 --2- 172.21.15.146:0/4032677010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b40b4530 0x7fa9b40b4940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8005fd0 tx=0x7fa9a802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.647+0000 7fa9ba89b640 1 -- 172.21.15.146:0/4032677010 shutdown_connections 2024-09-17T03:34:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.647+0000 7fa9ba89b640 1 --2- 172.21.15.146:0/4032677010 >> v2:172.21.15.179:3300/0 conn(0x7fa9b406dd60 0x7fa9b406e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.647+0000 7fa9ba89b640 1 --2- 172.21.15.146:0/4032677010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b40b4530 0x7fa9b40b4940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.647+0000 7fa9ba89b640 1 -- 172.21.15.146:0/4032677010 >> 172.21.15.146:0/4032677010 conn(0x7fa9b40b3410 msgr2=0x7fa9b40b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.647+0000 7fa9ba89b640 1 -- 172.21.15.146:0/4032677010 shutdown_connections 2024-09-17T03:34:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.647+0000 7fa9ba89b640 1 -- 172.21.15.146:0/4032677010 wait complete. 2024-09-17T03:34:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.649+0000 7fa9ba89b640 1 Processor -- start 2024-09-17T03:34:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.649+0000 7fa9ba89b640 1 -- start start 2024-09-17T03:34:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9ba89b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b406dd60 0x7fa9b415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9ba89b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9b40b4530 0x7fa9b4147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9ba89b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b40b55f0 0x7fa9b406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9ba89b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b415be90 con 0x7fa9b406dd60 2024-09-17T03:34:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9ba89b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b415bd10 con 0x7fa9b40b4530 2024-09-17T03:34:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9ba89b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b415c010 con 0x7fa9b40b55f0 2024-09-17T03:34:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b406dd60 0x7fa9b415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b406dd60 0x7fa9b415aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54614/0 (socket says 172.21.15.146:54614) 2024-09-17T03:34:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9b40b4530 0x7fa9b4147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b3fff640 1 -- 172.21.15.146:0/2491759586 learned_addr learned my addr 172.21.15.146:0/2491759586 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b8e38640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b40b55f0 0x7fa9b406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b3fff640 1 -- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b40b55f0 msgr2=0x7fa9b406cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b40b55f0 0x7fa9b406cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b3fff640 1 -- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9b40b4530 msgr2=0x7fa9b4147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9b40b4530 0x7fa9b4147d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b3fff640 1 -- 172.21.15.146:0/2491759586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b41f58b0 con 0x7fa9b406dd60 2024-09-17T03:34:45.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b406dd60 0x7fa9b415aa20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400c310 tx=0x7fa9a400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.651+0000 7fa9b0ff9640 1 -- 172.21.15.146:0/2491759586 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40052d0 con 0x7fa9b406dd60 2024-09-17T03:34:45.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.652+0000 7fa9b0ff9640 1 -- 172.21.15.146:0/2491759586 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9a4007020 con 0x7fa9b406dd60 2024-09-17T03:34:45.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.652+0000 7fa9ba89b640 1 -- 172.21.15.146:0/2491759586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b41f5b70 con 0x7fa9b406dd60 2024-09-17T03:34:45.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.652+0000 7fa9b0ff9640 1 -- 172.21.15.146:0/2491759586 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4007470 con 0x7fa9b406dd60 2024-09-17T03:34:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.652+0000 7fa9ba89b640 1 -- 172.21.15.146:0/2491759586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b41f6130 con 0x7fa9b406dd60 2024-09-17T03:34:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.654+0000 7fa9b0ff9640 1 -- 172.21.15.146:0/2491759586 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa9a40067d0 con 0x7fa9b406dd60 2024-09-17T03:34:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.654+0000 7fa9b0ff9640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a0078b90 0x7fa9a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.655+0000 7fa9b0ff9640 1 -- 172.21.15.146:0/2491759586 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa9a409a1b0 con 0x7fa9b406dd60 2024-09-17T03:34:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.655+0000 7fa9b37fe640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a0078b90 0x7fa9a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.655+0000 7fa9b37fe640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a0078b90 0x7fa9a007b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8033000 tx=0x7fa9a8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.655+0000 7fa9c180d740 1 Processor -- start 2024-09-17T03:34:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.655+0000 7fa9c180d740 1 -- start start 2024-09-17T03:34:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.656+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a6270390 0x55d2a6641740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.656+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a62474d0 0x55d2a6641c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.656+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 0x55d2a665eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9c180d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d2a658aa60 con 0x55d2a624f6b0 2024-09-17T03:34:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9c180d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d2a6579e90 con 0x55d2a6270390 2024-09-17T03:34:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9c180d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d2a657dca0 con 0x55d2a62474d0 2024-09-17T03:34:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a6270390 0x55d2a6641740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b37fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a62474d0 0x55d2a6641c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a6270390 0x55d2a6641740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:37144/0 (socket says 172.21.15.146:37144) 2024-09-17T03:34:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b3fff640 1 -- 172.21.15.146:0/2235993901 learned_addr learned my addr 172.21.15.146:0/2235993901 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b8e38640 1 --2- 172.21.15.146:0/2235993901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 0x55d2a665eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b8e38640 1 -- 172.21.15.146:0/2235993901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a62474d0 msgr2=0x55d2a6641c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b8e38640 1 --2- 172.21.15.146:0/2235993901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a62474d0 0x55d2a6641c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b8e38640 1 -- 172.21.15.146:0/2235993901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a6270390 msgr2=0x55d2a6641740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b8e38640 1 --2- 172.21.15.146:0/2235993901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a6270390 0x55d2a6641740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b8e38640 1 -- 172.21.15.146:0/2235993901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2a63527d0 con 0x55d2a624f6b0 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/2235993901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a6270390 0x55d2a6641740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa9b8e38640 1 --2- 172.21.15.146:0/2235993901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 0x55d2a665eb80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac005fd0 tx=0x7fa9ac011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2cb11fe391f52c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa999ffb640 1 -- 172.21.15.146:0/2235993901 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac004d20 con 0x55d2a624f6b0 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa999ffb640 1 -- 172.21.15.146:0/2235993901 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9ac003a30 con 0x55d2a624f6b0 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.657+0000 7fa999ffb640 1 -- 172.21.15.146:0/2235993901 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac003e00 con 0x55d2a624f6b0 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.658+0000 7fa9c180d740 1 -- 172.21.15.146:0/2235993901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 msgr2=0x55d2a665eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.658+0000 7fa9c180d740 1 --2- 172.21.15.146:0/2235993901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 0x55d2a665eb80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac005fd0 tx=0x7fa9ac011810 comp rx=0 tx=0).stop 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.658+0000 7fa9c180d740 1 -- 172.21.15.146:0/2235993901 shutdown_connections 2024-09-17T03:34:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.658+0000 7fa9c180d740 1 --2- 172.21.15.146:0/2235993901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 0x55d2a665eb80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.658+0000 7fa9c180d740 1 --2- 172.21.15.146:0/2235993901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a62474d0 0x55d2a6641c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.658+0000 7fa9c180d740 1 --2- 172.21.15.146:0/2235993901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a6270390 0x55d2a6641740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.658+0000 7fa9c180d740 1 -- 172.21.15.146:0/2235993901 >> 172.21.15.146:0/2235993901 conn(0x55d2a62644e0 msgr2=0x55d2a6617a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.658+0000 7fa9c180d740 1 -- 172.21.15.146:0/2235993901 shutdown_connections 2024-09-17T03:34:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.658+0000 7fa9c180d740 1 -- 172.21.15.146:0/2235993901 wait complete. 2024-09-17T03:34:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.659+0000 7fa9c180d740 1 -- start start 2024-09-17T03:34:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.660+0000 7fa9c180d740 1 Processor -- start 2024-09-17T03:34:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 0x55d2a662a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 0x55d2a662f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a6270390 0x55d2a662f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9c180d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d2a62ea740 con 0x55d2a624f6b0 2024-09-17T03:34:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9c180d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d2a651f970 con 0x55d2a62474d0 2024-09-17T03:34:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9c180d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d2a66421c0 con 0x55d2a6270390 2024-09-17T03:34:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9c180d740 10 client.0 _ll_register_callbacks cb 0x55d2a6522be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:34:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 0x55d2a662f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 0x55d2a662f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54630/0 (socket says 172.21.15.146:54630) 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9b37fe640 1 -- 172.21.15.146:0/3606861320 learned_addr learned my addr 172.21.15.146:0/3606861320 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 0x55d2a662a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9b8e38640 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a6270390 0x55d2a662f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9b37fe640 1 -- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a6270390 msgr2=0x55d2a662f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9b37fe640 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a6270390 0x55d2a662f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9b37fe640 1 -- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 msgr2=0x55d2a662a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9b37fe640 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 0x55d2a662a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.661+0000 7fa9b37fe640 1 -- 172.21.15.146:0/3606861320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2a62db970 con 0x55d2a624f6b0 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9b8e38640 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a6270390 0x55d2a662f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 0x55d2a662a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9b37fe640 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 0x55d2a662f450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8006010 tx=0x7fa9a8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450666ce3a766f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa992ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa992ffd640 1 -- 172.21.15.146:0/3606861320 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a804e030 con 0x55d2a624f6b0 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa992ffd640 1 -- 172.21.15.146:0/3606861320 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa9a803c680 con 0x55d2a624f6b0 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9c180d740 1 -- 172.21.15.146:0/3606861320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9ac003a30 con 0x55d2a624f6b0 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa992ffd640 1 -- 172.21.15.146:0/3606861320 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fa9a8035040 con 0x55d2a624f6b0 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9c180d740 10 client.5208 fetch_fsmap learned FSMap version 14 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9c180d740 1 -- 172.21.15.146:0/3606861320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55d2a62b96a0 con 0x55d2a624f6b0 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa992ffd640 1 -- 172.21.15.146:0/3606861320 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9ac003a30 con 0x55d2a624f6b0 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa992ffd640 1 -- 172.21.15.146:0/3606861320 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fa9a803a040 con 0x55d2a624f6b0 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9c180d740 10 client.5208 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9c180d740 10 client.5208 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9c180d740 20 client.5208 populate_metadata read hostname 'smithi146' 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9c180d740 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d2a622ef60 0x55d2a6615580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9c180d740 4 client.5208 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.662+0000 7fa9c180d740 1 -- 172.21.15.146:0/3606861320 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2a658c9b0 con 0x55d2a622ef60 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.663+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d2a622ef60 0x55d2a6615580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.663+0000 7fa992ffd640 10 client.5208 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.663+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d2a622ef60 0x55d2a6615580 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=979b8e20ecb45f98 server_cookie=fa3b249d98d9427c in_seq=0 out_seq=0 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.664+0000 7fa992ffd640 1 -- 172.21.15.146:0/3606861320 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2a658c9b0 con 0x55d2a622ef60 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.664+0000 7fa992ffd640 10 client.5208 handle_command_reply: tid=0 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.664+0000 7fa9c180d740 1 client.5208 shutdown 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa9c180d740 1 -- 172.21.15.146:0/3606861320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 msgr2=0x55d2a662f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa9c180d740 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 0x55d2a662f450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8006010 tx=0x7fa9a8009260 comp rx=0 tx=0).stop 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa9c180d740 1 -- 172.21.15.146:0/3606861320 shutdown_connections 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa9c180d740 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d2a622ef60 0x55d2a6615580 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa9c180d740 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a6270390 0x55d2a662f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa9c180d740 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a624f6b0 0x55d2a662f450 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa9c180d740 1 --2- 172.21.15.146:0/3606861320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 0x55d2a662a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa9c180d740 1 -- 172.21.15.146:0/3606861320 >> 172.21.15.146:0/3606861320 conn(0x55d2a62644e0 msgr2=0x55d2a66178b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa992ffd640 0 client.5208 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa9c180d740 1 -- 172.21.15.146:0/3606861320 shutdown_connections 2024-09-17T03:34:45.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa9c180d740 1 -- 172.21.15.146:0/3606861320 wait complete. 2024-09-17T03:34:45.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.665+0000 7fa9c180d740 20 client.5208 trim_cache size 0 max 16384 2024-09-17T03:34:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.685+0000 7fa9c180d740 1 Processor -- start 2024-09-17T03:34:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.685+0000 7fa9c180d740 1 -- start start 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a62474d0 0x55d2a6617890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a624f6b0 0x55d2a6617dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a6270390 0x55d2a667f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9c180d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b4202500 con 0x55d2a62474d0 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9c180d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b42015a0 con 0x55d2a624f6b0 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9c180d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b41f9770 con 0x55d2a6270390 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a62474d0 0x55d2a6617890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a62474d0 0x55d2a6617890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54638/0 (socket says 172.21.15.146:54638) 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9b3fff640 1 -- 172.21.15.146:0/2263750809 learned_addr learned my addr 172.21.15.146:0/2263750809 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9b37fe640 1 --2- 172.21.15.146:0/2263750809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a624f6b0 0x55d2a6617dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9b8e38640 1 --2- 172.21.15.146:0/2263750809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a6270390 0x55d2a667f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9b3fff640 1 -- 172.21.15.146:0/2263750809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a6270390 msgr2=0x55d2a667f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/2263750809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a6270390 0x55d2a667f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9b3fff640 1 -- 172.21.15.146:0/2263750809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a624f6b0 msgr2=0x55d2a6617dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/2263750809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a624f6b0 0x55d2a6617dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9b3fff640 1 -- 172.21.15.146:0/2263750809 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2a6652bb0 con 0x55d2a62474d0 2024-09-17T03:34:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.687+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/2263750809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a62474d0 0x55d2a6617890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa9a405f190 tx=0x7fa9a4084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9f4701c763ff5f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.688+0000 7fa9997fa640 1 -- 172.21.15.146:0/2263750809 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4007610 con 0x55d2a62474d0 2024-09-17T03:34:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.688+0000 7fa9997fa640 1 -- 172.21.15.146:0/2263750809 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9a405e190 con 0x55d2a62474d0 2024-09-17T03:34:45.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.688+0000 7fa9997fa640 1 -- 172.21.15.146:0/2263750809 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4061180 con 0x55d2a62474d0 2024-09-17T03:34:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.688+0000 7fa9c180d740 1 -- 172.21.15.146:0/2263750809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a62474d0 msgr2=0x55d2a6617890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.688+0000 7fa9c180d740 1 --2- 172.21.15.146:0/2263750809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a62474d0 0x55d2a6617890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa9a405f190 tx=0x7fa9a4084040 comp rx=0 tx=0).stop 2024-09-17T03:34:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.688+0000 7fa9c180d740 1 -- 172.21.15.146:0/2263750809 shutdown_connections 2024-09-17T03:34:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.688+0000 7fa9c180d740 1 --2- 172.21.15.146:0/2263750809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a6270390 0x55d2a667f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.688+0000 7fa9c180d740 1 --2- 172.21.15.146:0/2263750809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a624f6b0 0x55d2a6617dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.688+0000 7fa9c180d740 1 --2- 172.21.15.146:0/2263750809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a62474d0 0x55d2a6617890 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.688+0000 7fa9c180d740 1 -- 172.21.15.146:0/2263750809 >> 172.21.15.146:0/2263750809 conn(0x55d2a62644e0 msgr2=0x55d2a662a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.689+0000 7fa9c180d740 1 -- 172.21.15.146:0/2263750809 shutdown_connections 2024-09-17T03:34:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.689+0000 7fa9c180d740 1 -- 172.21.15.146:0/2263750809 wait complete. 2024-09-17T03:34:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.689+0000 7fa9c180d740 1 -- start start 2024-09-17T03:34:45.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.690+0000 7fa9c180d740 1 Processor -- start 2024-09-17T03:34:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 0x55d2a667eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a624f6b0 0x55d2a66d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9c180d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a6270390 0x55d2a66dac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9c180d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b41f9dc0 con 0x55d2a6270390 2024-09-17T03:34:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9c180d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d2a66db8b0 con 0x55d2a62474d0 2024-09-17T03:34:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9c180d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d2a66dec00 con 0x55d2a624f6b0 2024-09-17T03:34:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9c180d740 10 client.0 _ll_register_callbacks cb 0x7fa9a80043d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:34:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9b8e38640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a6270390 0x55d2a66dac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9b3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 0x55d2a667eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9b37fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a624f6b0 0x55d2a66d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9b8e38640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a6270390 0x55d2a66dac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54648/0 (socket says 172.21.15.146:54648) 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.691+0000 7fa9b8e38640 1 -- 172.21.15.146:0/1522532793 learned_addr learned my addr 172.21.15.146:0/1522532793 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9b3fff640 1 -- 172.21.15.146:0/1522532793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a624f6b0 msgr2=0x55d2a66d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a624f6b0 0x55d2a66d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9b3fff640 1 -- 172.21.15.146:0/1522532793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a6270390 msgr2=0x55d2a66dac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a6270390 0x55d2a66dac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9b3fff640 1 -- 172.21.15.146:0/1522532793 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2a66df130 con 0x55d2a62474d0 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9b8e38640 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a6270390 0x55d2a66dac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9b3fff640 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 0x55d2a667eb50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa9a405e6e0 tx=0x7fa9a40616b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=789081d64c380f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa992ffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa992ffd640 1 -- 172.21.15.146:0/1522532793 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4081070 con 0x55d2a62474d0 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa992ffd640 1 -- 172.21.15.146:0/1522532793 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa9a4061180 con 0x55d2a62474d0 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9c180d740 1 -- 172.21.15.146:0/1522532793 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9a405e190 con 0x55d2a62474d0 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa992ffd640 1 -- 172.21.15.146:0/1522532793 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fa9a4061380 con 0x55d2a62474d0 2024-09-17T03:34:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9c180d740 10 client.5077 fetch_fsmap learned FSMap version 14 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9c180d740 1 -- 172.21.15.146:0/1522532793 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55d2a6676330 con 0x55d2a62474d0 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa992ffd640 1 -- 172.21.15.146:0/1522532793 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9a405e190 con 0x55d2a62474d0 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa992ffd640 1 -- 172.21.15.146:0/1522532793 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fa9a4098b00 con 0x55d2a62474d0 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9c180d740 10 client.5077 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9c180d740 10 client.5077 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9c180d740 20 client.5077 populate_metadata read hostname 'smithi146' 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.692+0000 7fa9c180d740 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d2a66db140 0x55d2a666aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.693+0000 7fa9c180d740 4 client.5077 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.693+0000 7fa9c180d740 1 -- 172.21.15.146:0/1522532793 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d2a6588460 con 0x55d2a66db140 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.693+0000 7fa9b37fe640 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d2a66db140 0x55d2a666aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.693+0000 7fa992ffd640 10 client.5077 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.693+0000 7fa9b37fe640 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d2a66db140 0x55d2a666aa00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b89312de9d2e1a55 server_cookie=d6b3d68316c47796 in_seq=0 out_seq=0 2024-09-17T03:34:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa992ffd640 1 -- 172.21.15.146:0/1522532793 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55d2a6588460 con 0x55d2a66db140 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa992ffd640 10 client.5077 handle_command_reply: tid=0 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa9c180d740 1 client.5077 shutdown 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa9c180d740 1 -- 172.21.15.146:0/1522532793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 msgr2=0x55d2a667eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa9c180d740 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 0x55d2a667eb50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa9a405e6e0 tx=0x7fa9a40616b0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa9c180d740 1 -- 172.21.15.146:0/1522532793 shutdown_connections 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa9c180d740 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d2a66db140 0x55d2a666aa00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa9c180d740 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d2a6270390 0x55d2a66dac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa9c180d740 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d2a624f6b0 0x55d2a66d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa9c180d740 1 --2- 172.21.15.146:0/1522532793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d2a62474d0 0x55d2a667eb50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa992ffd640 0 client.5077 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa9c180d740 1 -- 172.21.15.146:0/1522532793 >> 172.21.15.146:0/1522532793 conn(0x55d2a62644e0 msgr2=0x55d2a662f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa9c180d740 1 -- 172.21.15.146:0/1522532793 shutdown_connections 2024-09-17T03:34:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.694+0000 7fa9c180d740 1 -- 172.21.15.146:0/1522532793 wait complete. 2024-09-17T03:34:45.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9c180d740 20 client.5077 trim_cache size 0 max 16384 2024-09-17T03:34:45.698 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:34:45.698 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "scrub active (1698 inodes in the stack)", 2024-09-17T03:34:45.698 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:34:45.698 INFO:teuthology.orchestra.run.smithi146.stdout: "2bc60f8f-f317-473a-a6bf-8d9f367e6acd": { 2024-09-17T03:34:45.698 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:34:45.698 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "2bc60f8f-f317-473a-a6bf-8d9f367e6acd", 2024-09-17T03:34:45.698 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive,scrub_mdsdir" 2024-09-17T03:34:45.698 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.698 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:34:45.699 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:34:45.699 INFO:teuthology.orchestra.run.smithi146.stdout: "2bc60f8f-f317-473a-a6bf-8d9f367e6acd": { 2024-09-17T03:34:45.699 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:34:45.509695+0000", 2024-09-17T03:34:45.699 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:34:45.699 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:34:45.699 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:34:45.699 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:34:45.699 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:34:45.699 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.699 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:34:45.699 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:34:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 -- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a0078b90 msgr2=0x7fa9a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a0078b90 0x7fa9a007b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8033000 tx=0x7fa9a8004730 comp rx=0 tx=0).stop 2024-09-17T03:34:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 -- 172.21.15.146:0/2491759586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b406dd60 msgr2=0x7fa9b415aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:34:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b406dd60 0x7fa9b415aa20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400c310 tx=0x7fa9a400c7d0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 -- 172.21.15.146:0/2491759586 shutdown_connections 2024-09-17T03:34:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a0078b90 0x7fa9a007b0a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9b40b55f0 0x7fa9b406cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9b40b4530 0x7fa9b4147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 --2- 172.21.15.146:0/2491759586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b406dd60 0x7fa9b415aa20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:34:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 -- 172.21.15.146:0/2491759586 >> 172.21.15.146:0/2491759586 conn(0x7fa9b40b3410 msgr2=0x7fa9b4155170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:34:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 -- 172.21.15.146:0/2491759586 shutdown_connections 2024-09-17T03:34:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:34:45.695+0000 7fa9ba89b640 1 -- 172.21.15.146:0/2491759586 wait complete. 2024-09-17T03:34:45.705 INFO:tasks.cephfs.filesystem:scrub status for tag:2bc60f8f-f317-473a-a6bf-8d9f367e6acd - {'path': '/', 'tag': '2bc60f8f-f317-473a-a6bf-8d9f367e6acd', 'options': 'recursive,scrub_mdsdir'} 2024-09-17T03:34:56.781 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:34:56.786 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:35:15.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:15.707 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-17T03:35:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.836+0000 7ff075319640 1 -- 172.21.15.146:0/716978935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0700cdf10 msgr2=0x7ff0700cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.836+0000 7ff075319640 1 --2- 172.21.15.146:0/716978935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0700cdf10 0x7ff0700cf930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff060005fd0 tx=0x7ff06002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.836+0000 7ff075319640 1 -- 172.21.15.146:0/716978935 shutdown_connections 2024-09-17T03:35:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.836+0000 7ff075319640 1 --2- 172.21.15.146:0/716978935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0700cdf10 0x7ff0700cf930 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.836+0000 7ff075319640 1 --2- 172.21.15.146:0/716978935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff070073c00 0x7ff07015ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.836+0000 7ff075319640 1 -- 172.21.15.146:0/716978935 >> 172.21.15.146:0/716978935 conn(0x7ff0700b3410 msgr2=0x7ff0700b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.836+0000 7ff075319640 1 -- 172.21.15.146:0/716978935 shutdown_connections 2024-09-17T03:35:15.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.836+0000 7ff075319640 1 -- 172.21.15.146:0/716978935 wait complete. 2024-09-17T03:35:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.838+0000 7ff075319640 1 Processor -- start 2024-09-17T03:35:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.838+0000 7ff075319640 1 -- start start 2024-09-17T03:35:15.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff075319640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0700cdf10 0x7ff0701e6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff075319640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff070153af0 0x7ff0701f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff075319640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff070157540 0x7ff070157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff075319640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff0700d0400 con 0x7ff0700cdf10 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff075319640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff0700d0280 con 0x7ff070157540 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff075319640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff0700d0580 con 0x7ff070153af0 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0700cdf10 0x7ff0701e6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0700cdf10 0x7ff0701e6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47106/0 (socket says 172.21.15.146:47106) 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06effd640 1 -- 172.21.15.146:0/1308359302 learned_addr learned my addr 172.21.15.146:0/1308359302 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff070153af0 0x7ff0701f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06effd640 1 -- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff070153af0 msgr2=0x7ff0701f3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06f7fe640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff070157540 0x7ff070157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06effd640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff070153af0 0x7ff0701f3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06effd640 1 -- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff070157540 msgr2=0x7ff070157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06effd640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff070157540 0x7ff070157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06effd640 1 -- 172.21.15.146:0/1308359302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff070157e90 con 0x7ff0700cdf10 2024-09-17T03:35:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff070153af0 0x7ff0701f3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06f7fe640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff070157540 0x7ff070157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff06effd640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0700cdf10 0x7ff0701e6550 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff06800c730 tx=0x7ff06800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff0677fe640 1 -- 172.21.15.146:0/1308359302 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068016020 con 0x7ff0700cdf10 2024-09-17T03:35:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff0677fe640 1 -- 172.21.15.146:0/1308359302 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff06800a950 con 0x7ff0700cdf10 2024-09-17T03:35:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff075319640 1 -- 172.21.15.146:0/1308359302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0701f43b0 con 0x7ff0700cdf10 2024-09-17T03:35:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.840+0000 7ff0677fe640 1 -- 172.21.15.146:0/1308359302 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06800ada0 con 0x7ff0700cdf10 2024-09-17T03:35:15.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.841+0000 7ff075319640 1 -- 172.21.15.146:0/1308359302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0701e7210 con 0x7ff0700cdf10 2024-09-17T03:35:15.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.842+0000 7ff0677fe640 1 -- 172.21.15.146:0/1308359302 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff068019020 con 0x7ff0700cdf10 2024-09-17T03:35:15.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.843+0000 7ff0677fe640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff050078b90 0x7ff05007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.843+0000 7ff0677fe640 1 -- 172.21.15.146:0/1308359302 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7ff06809a9b0 con 0x7ff0700cdf10 2024-09-17T03:35:15.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.843+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff050078b90 0x7ff05007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.844+0000 7ff07c283740 1 Processor -- start 2024-09-17T03:35:15.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.844+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff050078b90 0x7ff05007b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff070072fa0 tx=0x7ff058005db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:15.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.844+0000 7ff07c283740 1 -- start start 2024-09-17T03:35:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.845+0000 7ff07c283740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 0x55d4973e2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.845+0000 7ff07c283740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d496fe84d0 0x55d4973e2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.845+0000 7ff07c283740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.845+0000 7ff07c283740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d49732ba60 con 0x55d496ff06b0 2024-09-17T03:35:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.845+0000 7ff07c283740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d49731ae90 con 0x55d496fe84d0 2024-09-17T03:35:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.845+0000 7ff07c283740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d49731eca0 con 0x55d497011390 2024-09-17T03:35:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.845+0000 7ff06f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.845+0000 7ff06f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973ffb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47114/0 (socket says 172.21.15.146:47114) 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.845+0000 7ff06f7fe640 1 -- 172.21.15.146:0/3320080293 learned_addr learned my addr 172.21.15.146:0/3320080293 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.845+0000 7ff06effd640 1 --2- 172.21.15.146:0/3320080293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 0x55d4973e2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.845+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/3320080293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d496fe84d0 0x55d4973e2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.846+0000 7ff06f7fe640 1 -- 172.21.15.146:0/3320080293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 msgr2=0x55d4973e2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.846+0000 7ff06f7fe640 1 --2- 172.21.15.146:0/3320080293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 0x55d4973e2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.846+0000 7ff06f7fe640 1 -- 172.21.15.146:0/3320080293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d496fe84d0 msgr2=0x55d4973e2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.846+0000 7ff06f7fe640 1 --2- 172.21.15.146:0/3320080293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d496fe84d0 0x55d4973e2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.846+0000 7ff06f7fe640 1 -- 172.21.15.146:0/3320080293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4970f37d0 con 0x55d496ff06b0 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.846+0000 7ff06effd640 1 --2- 172.21.15.146:0/3320080293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 0x55d4973e2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.846+0000 7ff06f7fe640 1 --2- 172.21.15.146:0/3320080293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973ffb80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff060009cd0 tx=0x7ff060004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65df7105496deb2f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.846+0000 7ff064ff9640 1 -- 172.21.15.146:0/3320080293 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06003f070 con 0x55d496ff06b0 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.846+0000 7ff064ff9640 1 -- 172.21.15.146:0/3320080293 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff060003ce0 con 0x55d496ff06b0 2024-09-17T03:35:15.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.846+0000 7ff064ff9640 1 -- 172.21.15.146:0/3320080293 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060004260 con 0x55d496ff06b0 2024-09-17T03:35:15.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.847+0000 7ff07c283740 1 -- 172.21.15.146:0/3320080293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 msgr2=0x55d4973ffb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:15.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.847+0000 7ff07c283740 1 --2- 172.21.15.146:0/3320080293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973ffb80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff060009cd0 tx=0x7ff060004a40 comp rx=0 tx=0).stop 2024-09-17T03:35:15.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.847+0000 7ff07c283740 1 -- 172.21.15.146:0/3320080293 shutdown_connections 2024-09-17T03:35:15.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.847+0000 7ff07c283740 1 --2- 172.21.15.146:0/3320080293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973ffb80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.847+0000 7ff07c283740 1 --2- 172.21.15.146:0/3320080293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d496fe84d0 0x55d4973e2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.847+0000 7ff07c283740 1 --2- 172.21.15.146:0/3320080293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 0x55d4973e2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.847+0000 7ff07c283740 1 -- 172.21.15.146:0/3320080293 >> 172.21.15.146:0/3320080293 conn(0x55d4970054e0 msgr2=0x55d4973b8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:15.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.847+0000 7ff07c283740 1 -- 172.21.15.146:0/3320080293 shutdown_connections 2024-09-17T03:35:15.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.847+0000 7ff07c283740 1 -- 172.21.15.146:0/3320080293 wait complete. 2024-09-17T03:35:15.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.848+0000 7ff07c283740 1 -- start start 2024-09-17T03:35:15.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.848+0000 7ff07c283740 1 Processor -- start 2024-09-17T03:35:15.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.849+0000 7ff07c283740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d496fe84d0 0x55d4973f3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.849+0000 7ff07c283740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973fb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.849+0000 7ff07c283740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 0x55d49740ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.849+0000 7ff07c283740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d49708b740 con 0x55d496ff06b0 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.849+0000 7ff07c283740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d4972c0970 con 0x55d496fe84d0 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.849+0000 7ff07c283740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d4973e31c0 con 0x55d497011390 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.849+0000 7ff07c283740 10 client.0 _ll_register_callbacks cb 0x55d4972c3be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.849+0000 7ff06e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.849+0000 7ff06e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973fb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47122/0 (socket says 172.21.15.146:47122) 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.849+0000 7ff06e7fc640 1 -- 172.21.15.146:0/941417013 learned_addr learned my addr 172.21.15.146:0/941417013 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff06f7fe640 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 0x55d49740ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff06effd640 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d496fe84d0 0x55d4973f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff06e7fc640 1 -- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 msgr2=0x55d49740ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 0x55d49740ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff06e7fc640 1 -- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d496fe84d0 msgr2=0x55d4973f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d496fe84d0 0x55d4973f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff06e7fc640 1 -- 172.21.15.146:0/941417013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d49707c970 con 0x55d496ff06b0 2024-09-17T03:35:15.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff06f7fe640 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 0x55d49740ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff06effd640 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d496fe84d0 0x55d4973f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973fb5e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff070072700 tx=0x7ff0580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e83ca7842ea6b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff04dffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff04dffb640 1 -- 172.21.15.146:0/941417013 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058023070 con 0x55d496ff06b0 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff07c283740 1 -- 172.21.15.146:0/941417013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff060003ce0 con 0x55d496ff06b0 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff04dffb640 1 -- 172.21.15.146:0/941417013 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7ff058004220 con 0x55d496ff06b0 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff04dffb640 1 -- 172.21.15.146:0/941417013 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ff05802d050 con 0x55d496ff06b0 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff07c283740 10 client.5229 fetch_fsmap learned FSMap version 14 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff07c283740 1 -- 172.21.15.146:0/941417013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55d49705a6a0 con 0x55d496ff06b0 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.850+0000 7ff04dffb640 1 -- 172.21.15.146:0/941417013 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff060003ce0 con 0x55d496ff06b0 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.851+0000 7ff04dffb640 1 -- 172.21.15.146:0/941417013 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7ff058030020 con 0x55d496ff06b0 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.851+0000 7ff07c283740 10 client.5229 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T03:35:15.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.851+0000 7ff07c283740 10 client.5229 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.851+0000 7ff07c283740 20 client.5229 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.851+0000 7ff07c283740 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d496fcff60 0x55d4973f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.851+0000 7ff07c283740 4 client.5229 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.851+0000 7ff07c283740 1 -- 172.21.15.146:0/941417013 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d49732d9b0 con 0x55d496fcff60 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.851+0000 7ff06effd640 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d496fcff60 0x55d4973f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.851+0000 7ff04dffb640 10 client.5229 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.851+0000 7ff06effd640 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d496fcff60 0x55d4973f5d70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fca052239063ffad server_cookie=50073136d044b796 in_seq=0 out_seq=0 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff04dffb640 1 -- 172.21.15.146:0/941417013 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d49732d9b0 con 0x55d496fcff60 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff04dffb640 10 client.5229 handle_command_reply: tid=0 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 1 client.5229 shutdown 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 1 -- 172.21.15.146:0/941417013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 msgr2=0x55d4973fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973fb5e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff070072700 tx=0x7ff0580046c0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 1 -- 172.21.15.146:0/941417013 shutdown_connections 2024-09-17T03:35:15.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d496fcff60 0x55d4973f5d70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d497011390 0x55d49740ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff04dffb640 0 client.5229 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:35:15.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973fb5e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 1 --2- 172.21.15.146:0/941417013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d496fe84d0 0x55d4973f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 1 -- 172.21.15.146:0/941417013 >> 172.21.15.146:0/941417013 conn(0x55d4970054e0 msgr2=0x55d4973b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:15.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 1 -- 172.21.15.146:0/941417013 shutdown_connections 2024-09-17T03:35:15.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 1 -- 172.21.15.146:0/941417013 wait complete. 2024-09-17T03:35:15.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.852+0000 7ff07c283740 20 client.5229 trim_cache size 0 max 16384 2024-09-17T03:35:15.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.870+0000 7ff07c283740 1 Processor -- start 2024-09-17T03:35:15.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.870+0000 7ff07c283740 1 -- start start 2024-09-17T03:35:15.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.871+0000 7ff07c283740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d496fe84d0 0x55d4973b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.871+0000 7ff07c283740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d497420400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.871+0000 7ff07c283740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d497011390 0x55d497420940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.871+0000 7ff07c283740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff070200090 con 0x55d496ff06b0 2024-09-17T03:35:15.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.871+0000 7ff07c283740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff0701ff0b0 con 0x55d497011390 2024-09-17T03:35:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.871+0000 7ff07c283740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff0701555e0 con 0x55d496fe84d0 2024-09-17T03:35:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.871+0000 7ff06e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d497420400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.871+0000 7ff06e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d497420400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47128/0 (socket says 172.21.15.146:47128) 2024-09-17T03:35:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.871+0000 7ff06e7fc640 1 -- 172.21.15.146:0/4168596099 learned_addr learned my addr 172.21.15.146:0/4168596099 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.872+0000 7ff06e7fc640 1 -- 172.21.15.146:0/4168596099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d496fe84d0 msgr2=0x55d4973b8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.872+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/4168596099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d496fe84d0 0x55d4973b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.872+0000 7ff06e7fc640 1 -- 172.21.15.146:0/4168596099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d497011390 msgr2=0x55d497420940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.872+0000 7ff06f7fe640 1 --2- 172.21.15.146:0/4168596099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d497011390 0x55d497420940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.872+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/4168596099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d497011390 0x55d497420940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.872+0000 7ff06e7fc640 1 -- 172.21.15.146:0/4168596099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4973f7df0 con 0x55d496ff06b0 2024-09-17T03:35:15.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.872+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/4168596099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d497420400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff058005f80 tx=0x7ff058005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65c6643ff0e2a7f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:15.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.872+0000 7ff04ffff640 1 -- 172.21.15.146:0/4168596099 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058023070 con 0x55d496ff06b0 2024-09-17T03:35:15.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.872+0000 7ff04ffff640 1 -- 172.21.15.146:0/4168596099 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff058035020 con 0x55d496ff06b0 2024-09-17T03:35:15.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.872+0000 7ff04ffff640 1 -- 172.21.15.146:0/4168596099 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058005030 con 0x55d496ff06b0 2024-09-17T03:35:15.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.873+0000 7ff07c283740 1 -- 172.21.15.146:0/4168596099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 msgr2=0x55d497420400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.873+0000 7ff07c283740 1 --2- 172.21.15.146:0/4168596099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d497420400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff058005f80 tx=0x7ff058005fb0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.873+0000 7ff07c283740 1 -- 172.21.15.146:0/4168596099 shutdown_connections 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.873+0000 7ff07c283740 1 --2- 172.21.15.146:0/4168596099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d497011390 0x55d497420940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.873+0000 7ff07c283740 1 --2- 172.21.15.146:0/4168596099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d497420400 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.873+0000 7ff07c283740 1 --2- 172.21.15.146:0/4168596099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d496fe84d0 0x55d4973b8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.873+0000 7ff07c283740 1 -- 172.21.15.146:0/4168596099 >> 172.21.15.146:0/4168596099 conn(0x55d4970054e0 msgr2=0x55d4973fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.873+0000 7ff07c283740 1 -- 172.21.15.146:0/4168596099 shutdown_connections 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.873+0000 7ff07c283740 1 -- 172.21.15.146:0/4168596099 wait complete. 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.874+0000 7ff07c283740 1 -- start start 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.874+0000 7ff07c283740 1 Processor -- start 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff07c283740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d496fe84d0 0x55d497480790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff07c283740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff07c283740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d497011390 0x55d4973ef690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff07c283740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d4973b2ad0 con 0x55d496ff06b0 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff07c283740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff070155c30 con 0x55d497011390 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff07c283740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d497416d40 con 0x55d496fe84d0 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff07c283740 10 client.0 _ll_register_callbacks cb 0x7ff058009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47144/0 (socket says 172.21.15.146:47144) 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06e7fc640 1 -- 172.21.15.146:0/422230459 learned_addr learned my addr 172.21.15.146:0/422230459 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06f7fe640 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d497011390 0x55d4973ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06effd640 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d496fe84d0 0x55d497480790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06e7fc640 1 -- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d496fe84d0 msgr2=0x55d497480790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d496fe84d0 0x55d497480790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06e7fc640 1 -- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d497011390 msgr2=0x55d4973ef690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d497011390 0x55d4973ef690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06e7fc640 1 -- 172.21.15.146:0/422230459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d497420e90 con 0x55d496ff06b0 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06f7fe640 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d497011390 0x55d4973ef690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06effd640 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d496fe84d0 0x55d497480790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff06e7fc640 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973f60c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff05800e8b0 tx=0x7ff05801f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4e837119f93d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.875+0000 7ff04dffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff04dffb640 1 -- 172.21.15.146:0/422230459 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058023040 con 0x55d496ff06b0 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff04dffb640 1 -- 172.21.15.146:0/422230459 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7ff05803bb00 con 0x55d496ff06b0 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff07c283740 1 -- 172.21.15.146:0/422230459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff058035020 con 0x55d496ff06b0 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff04dffb640 1 -- 172.21.15.146:0/422230459 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ff05803bd00 con 0x55d496ff06b0 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff07c283740 10 client.5235 fetch_fsmap learned FSMap version 14 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff07c283740 1 -- 172.21.15.146:0/422230459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55d497416b40 con 0x55d496ff06b0 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff04dffb640 1 -- 172.21.15.146:0/422230459 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff058035020 con 0x55d496ff06b0 2024-09-17T03:35:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff04dffb640 1 -- 172.21.15.146:0/422230459 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7ff058042050 con 0x55d496ff06b0 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff07c283740 10 client.5235 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff07c283740 10 client.5235 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff07c283740 20 client.5235 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff07c283740 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d4973b8b10 0x55d4973efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff07c283740 4 client.5235 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff07c283740 1 -- 172.21.15.146:0/422230459 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d497329460 con 0x55d4973b8b10 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.876+0000 7ff06effd640 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d4973b8b10 0x55d4973efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff04dffb640 10 client.5235 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff06effd640 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d4973b8b10 0x55d4973efbd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65a6c7243a1eaceb server_cookie=4262a592ab3f1e8a in_seq=0 out_seq=0 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff04dffb640 1 -- 172.21.15.146:0/422230459 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55d497329460 con 0x55d4973b8b10 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff04dffb640 10 client.5235 handle_command_reply: tid=0 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 1 client.5235 shutdown 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 1 -- 172.21.15.146:0/422230459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 msgr2=0x55d4973f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:15.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973f60c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff05800e8b0 tx=0x7ff05801f6d0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 1 -- 172.21.15.146:0/422230459 shutdown_connections 2024-09-17T03:35:15.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55d4973b8b10 0x55d4973efbd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d497011390 0x55d4973ef690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d496ff06b0 0x55d4973f60c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 1 --2- 172.21.15.146:0/422230459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d496fe84d0 0x55d497480790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff04dffb640 0 client.5235 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:35:15.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 1 -- 172.21.15.146:0/422230459 >> 172.21.15.146:0/422230459 conn(0x55d4970054e0 msgr2=0x55d4973f6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:15.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 1 -- 172.21.15.146:0/422230459 shutdown_connections 2024-09-17T03:35:15.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 1 -- 172.21.15.146:0/422230459 wait complete. 2024-09-17T03:35:15.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.877+0000 7ff07c283740 20 client.5235 trim_cache size 0 max 16384 2024-09-17T03:35:15.883 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:15.884 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2024-09-17T03:35:15.884 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {}, 2024-09-17T03:35:15.884 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:35:15.884 INFO:teuthology.orchestra.run.smithi146.stdout: "2bc60f8f-f317-473a-a6bf-8d9f367e6acd": { 2024-09-17T03:35:15.884 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:34:45.509695+0000", 2024-09-17T03:35:15.884 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:35:15.884 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:15.884 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:15.884 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:15.884 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:15.884 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:15.885 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:15.885 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:15.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 -- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff050078b90 msgr2=0x7ff05007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:15.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff050078b90 0x7ff05007b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff070072fa0 tx=0x7ff058005db0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 -- 172.21.15.146:0/1308359302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0700cdf10 msgr2=0x7ff0701e6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:15.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0700cdf10 0x7ff0701e6550 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff06800c730 tx=0x7ff06800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 -- 172.21.15.146:0/1308359302 shutdown_connections 2024-09-17T03:35:15.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff050078b90 0x7ff05007b0a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff070157540 0x7ff070157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff070153af0 0x7ff0701f3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 --2- 172.21.15.146:0/1308359302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0700cdf10 0x7ff0701e6550 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:15.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 -- 172.21.15.146:0/1308359302 >> 172.21.15.146:0/1308359302 conn(0x7ff0700b3410 msgr2=0x7ff070152740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:15.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 -- 172.21.15.146:0/1308359302 shutdown_connections 2024-09-17T03:35:15.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:15.878+0000 7ff075319640 1 -- 172.21.15.146:0/1308359302 wait complete. 2024-09-17T03:35:15.889 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:35:15.889 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-17T03:35:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.003+0000 7fcd869ad640 1 -- 172.21.15.146:0/1402209835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8015c9f0 msgr2=0x7fcd801526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.003+0000 7fcd869ad640 1 --2- 172.21.15.146:0/1402209835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8015c9f0 0x7fcd801526a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcd80070660 tx=0x7fcd7002a560 comp rx=0 tx=0).stop 2024-09-17T03:35:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.003+0000 7fcd869ad640 1 -- 172.21.15.146:0/1402209835 shutdown_connections 2024-09-17T03:35:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.003+0000 7fcd869ad640 1 --2- 172.21.15.146:0/1402209835 >> v2:172.21.15.179:3300/0 conn(0x7fcd800b4510 0x7fcd80070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.003+0000 7fcd869ad640 1 --2- 172.21.15.146:0/1402209835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd800b4100 0x7fcd8006fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.003+0000 7fcd869ad640 1 --2- 172.21.15.146:0/1402209835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8015c9f0 0x7fcd801526a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.003+0000 7fcd869ad640 1 -- 172.21.15.146:0/1402209835 >> 172.21.15.146:0/1402209835 conn(0x7fcd8006d3c0 msgr2=0x7fcd800b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.003+0000 7fcd869ad640 1 -- 172.21.15.146:0/1402209835 shutdown_connections 2024-09-17T03:35:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.003+0000 7fcd869ad640 1 -- 172.21.15.146:0/1402209835 wait complete. 2024-09-17T03:35:16.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.005+0000 7fcd869ad640 1 Processor -- start 2024-09-17T03:35:16.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.005+0000 7fcd869ad640 1 -- start start 2024-09-17T03:35:16.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd869ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd800b4100 0x7fcd80135260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd869ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd800b4510 0x7fcd80148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd869ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8014c8f0 0x7fcd80136b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd869ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd800d04e0 con 0x7fcd800b4100 2024-09-17T03:35:16.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd869ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd800d0360 con 0x7fcd800b4510 2024-09-17T03:35:16.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd869ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcd800d0660 con 0x7fcd8014c8f0 2024-09-17T03:35:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd800b4100 0x7fcd80135260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd800b4100 0x7fcd80135260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47154/0 (socket says 172.21.15.146:47154) 2024-09-17T03:35:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7ffff640 1 -- 172.21.15.146:0/3449679736 learned_addr learned my addr 172.21.15.146:0/3449679736 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd800b4510 0x7fcd80148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd84f4a640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8014c8f0 0x7fcd80136b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7ffff640 1 -- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8014c8f0 msgr2=0x7fcd80136b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8014c8f0 0x7fcd80136b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7ffff640 1 -- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd800b4510 msgr2=0x7fcd80148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd800b4510 0x7fcd80148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7ffff640 1 -- 172.21.15.146:0/3449679736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd80137090 con 0x7fcd800b4100 2024-09-17T03:35:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd800b4100 0x7fcd80135260 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcd70000c00 tx=0x7fcd700038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7cff9640 1 -- 172.21.15.146:0/3449679736 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7003e030 con 0x7fcd800b4100 2024-09-17T03:35:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7cff9640 1 -- 172.21.15.146:0/3449679736 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd70003ca0 con 0x7fcd800b4100 2024-09-17T03:35:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd869ad640 1 -- 172.21.15.146:0/3449679736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd80135ab0 con 0x7fcd800b4100 2024-09-17T03:35:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd7cff9640 1 -- 172.21.15.146:0/3449679736 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70035040 con 0x7fcd800b4100 2024-09-17T03:35:16.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.007+0000 7fcd869ad640 1 -- 172.21.15.146:0/3449679736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd80136070 con 0x7fcd800b4100 2024-09-17T03:35:16.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.009+0000 7fcd7cff9640 1 -- 172.21.15.146:0/3449679736 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd70041030 con 0x7fcd800b4100 2024-09-17T03:35:16.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.010+0000 7fcd7cff9640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd60078bc0 0x7fcd6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.010+0000 7fcd7cff9640 1 -- 172.21.15.146:0/3449679736 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7fcd700bb2a0 con 0x7fcd800b4100 2024-09-17T03:35:16.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.010+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd60078bc0 0x7fcd6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.011+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd60078bc0 0x7fcd6007b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcd8014cdf0 tx=0x7fcd68005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:16.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.011+0000 7fcd8d9fb740 1 Processor -- start 2024-09-17T03:35:16.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.011+0000 7fcd8d9fb740 1 -- start start 2024-09-17T03:35:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x55722016f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd844d0 0x55722019aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x55722017bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5572200c7bd0 con 0x55721fd8c6b0 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5572200b7000 con 0x55721fdad390 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5572200bae10 con 0x55721fd844d0 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd84f4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x55722017bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd84f4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x55722017bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47158/0 (socket says 172.21.15.146:47158) 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd84f4a640 1 -- 172.21.15.146:0/4127790861 learned_addr learned my addr 172.21.15.146:0/4127790861 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/4127790861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd844d0 0x55722019aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/4127790861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x55722016f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd84f4a640 1 -- 172.21.15.146:0/4127790861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd844d0 msgr2=0x55722019aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd84f4a640 1 --2- 172.21.15.146:0/4127790861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd844d0 0x55722019aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd84f4a640 1 -- 172.21.15.146:0/4127790861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 msgr2=0x55722016f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd84f4a640 1 --2- 172.21.15.146:0/4127790861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x55722016f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.012+0000 7fcd84f4a640 1 -- 172.21.15.146:0/4127790861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55721fe8f7d0 con 0x55721fd8c6b0 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.013+0000 7fcd84f4a640 1 --2- 172.21.15.146:0/4127790861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x55722017bf10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009e50 tx=0x7fcd780107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76078294f5ffbf62 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.013+0000 7fcd75ffb640 1 -- 172.21.15.146:0/4127790861 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78004d20 con 0x55721fd8c6b0 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.013+0000 7fcd75ffb640 1 -- 172.21.15.146:0/4127790861 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd78003970 con 0x55721fd8c6b0 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.013+0000 7fcd75ffb640 1 -- 172.21.15.146:0/4127790861 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78003dc0 con 0x55721fd8c6b0 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.013+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4127790861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 msgr2=0x55722017bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.013+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/4127790861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x55722017bf10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009e50 tx=0x7fcd780107a0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.013+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4127790861 shutdown_connections 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.013+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/4127790861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x55722017bf10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.013+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/4127790861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd844d0 0x55722019aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.013+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/4127790861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x55722016f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.013+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4127790861 >> 172.21.15.146:0/4127790861 conn(0x55721fda14e0 msgr2=0x557220155200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.014+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4127790861 shutdown_connections 2024-09-17T03:35:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.014+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4127790861 wait complete. 2024-09-17T03:35:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.014+0000 7fcd8d9fb740 1 -- start start 2024-09-17T03:35:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.015+0000 7fcd8d9fb740 1 Processor -- start 2024-09-17T03:35:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x557220168dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fd8c6b0 0x5572201b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fdad390 0x55722014e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55721fe27740 con 0x55721fd844d0 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55722005c540 con 0x55721fd8c6b0 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55722016e5c0 con 0x55721fdad390 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd7ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x557220168dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd8d9fb740 10 client.0 _ll_register_callbacks cb 0x55722005b0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd7ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x557220168dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47172/0 (socket says 172.21.15.146:47172) 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd7ffff640 1 -- 172.21.15.146:0/4130825237 learned_addr learned my addr 172.21.15.146:0/4130825237 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fd8c6b0 0x5572201b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd84f4a640 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fdad390 0x55722014e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd7ffff640 1 -- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fdad390 msgr2=0x55722014e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fdad390 0x55722014e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd7ffff640 1 -- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fd8c6b0 msgr2=0x5572201b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fd8c6b0 0x5572201b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd7ffff640 1 -- 172.21.15.146:0/4130825237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55721fdf66a0 con 0x55721fd844d0 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x557220168dc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcd700099c0 tx=0x7fcd700828a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7646e90c79c284ae server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.016+0000 7fcd5effd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd5effd640 1 -- 172.21.15.146:0/4130825237 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7009a070 con 0x55721fd844d0 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd5effd640 1 -- 172.21.15.146:0/4130825237 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7fcd700b9bd0 con 0x55721fd844d0 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4130825237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd78003970 con 0x55721fd844d0 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd5effd640 1 -- 172.21.15.146:0/4130825237 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fcd70048040 con 0x55721fd844d0 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd8d9fb740 10 client.5247 fetch_fsmap learned FSMap version 14 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4130825237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55721feeff60 con 0x55721fd844d0 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd5effd640 1 -- 172.21.15.146:0/4130825237 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd78003970 con 0x55721fd844d0 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd5effd640 1 -- 172.21.15.146:0/4130825237 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fcd7009d020 con 0x55721fd844d0 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd8d9fb740 10 client.5247 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T03:35:16.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd8d9fb740 10 client.5247 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd8d9fb740 20 client.5247 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55721fd6bf60 0x557220169d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd8d9fb740 4 client.5247 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4130825237 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572200c9b20 con 0x55721fd6bf60 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.017+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55721fd6bf60 0x557220169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.018+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55721fd6bf60 0x557220169d70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=129148ffb65a6eb3 server_cookie=4c2edfbb820af371 in_seq=0 out_seq=0 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.018+0000 7fcd5effd640 10 client.5247 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.018+0000 7fcd5effd640 1 -- 172.21.15.146:0/4130825237 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572200c9b20 con 0x55721fd6bf60 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.018+0000 7fcd5effd640 10 client.5247 handle_command_reply: tid=0 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.018+0000 7fcd8d9fb740 1 client.5247 shutdown 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4130825237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 msgr2=0x557220168dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x557220168dc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcd700099c0 tx=0x7fcd700828a0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4130825237 shutdown_connections 2024-09-17T03:35:16.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x55721fd6bf60 0x557220169d70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fdad390 0x55722014e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fd8c6b0 0x5572201b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd5effd640 0 client.5247 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:35:16.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/4130825237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x557220168dc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4130825237 >> 172.21.15.146:0/4130825237 conn(0x55721fda14e0 msgr2=0x55722017bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:16.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4130825237 shutdown_connections 2024-09-17T03:35:16.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/4130825237 wait complete. 2024-09-17T03:35:16.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.019+0000 7fcd8d9fb740 20 client.5247 trim_cache size 0 max 16384 2024-09-17T03:35:16.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.035+0000 7fcd8d9fb740 1 Processor -- start 2024-09-17T03:35:16.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.035+0000 7fcd8d9fb740 1 -- start start 2024-09-17T03:35:16.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.036+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd844d0 0x5572201c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.036+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x5572201b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.036+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x557220169d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.036+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd801fdf40 con 0x55721fd8c6b0 2024-09-17T03:35:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.036+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd80168d90 con 0x55721fdad390 2024-09-17T03:35:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.036+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcd80137da0 con 0x55721fd844d0 2024-09-17T03:35:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.036+0000 7fcd7f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x5572201b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.036+0000 7fcd7f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x5572201b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47176/0 (socket says 172.21.15.146:47176) 2024-09-17T03:35:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.036+0000 7fcd7f7fe640 1 -- 172.21.15.146:0/2292429412 learned_addr learned my addr 172.21.15.146:0/2292429412 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd84f4a640 1 --2- 172.21.15.146:0/2292429412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x557220169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/2292429412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd844d0 0x5572201c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd7f7fe640 1 -- 172.21.15.146:0/2292429412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd844d0 msgr2=0x5572201c19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/2292429412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd844d0 0x5572201c19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd7f7fe640 1 -- 172.21.15.146:0/2292429412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 msgr2=0x557220169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:16.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/2292429412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x557220169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd7f7fe640 1 -- 172.21.15.146:0/2292429412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55721fe8dad0 con 0x55721fd8c6b0 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd84f4a640 1 --2- 172.21.15.146:0/2292429412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x557220169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/2292429412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd844d0 0x5572201c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/2292429412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x5572201b1090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcd68011810 tx=0x7fcd68014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc4c96463f40715 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd757fa640 1 -- 172.21.15.146:0/2292429412 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd68003d70 con 0x55721fd8c6b0 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd757fa640 1 -- 172.21.15.146:0/2292429412 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd6802a430 con 0x55721fd8c6b0 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.037+0000 7fcd757fa640 1 -- 172.21.15.146:0/2292429412 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6802a7e0 con 0x55721fd8c6b0 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.038+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/2292429412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 msgr2=0x5572201b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.038+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/2292429412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x5572201b1090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcd68011810 tx=0x7fcd68014000 comp rx=0 tx=0).stop 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.038+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/2292429412 shutdown_connections 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.038+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/2292429412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x557220169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.038+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/2292429412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd8c6b0 0x5572201b1090 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.038+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/2292429412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd844d0 0x5572201c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.038+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/2292429412 >> 172.21.15.146:0/2292429412 conn(0x55721fda14e0 msgr2=0x557220192470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:16.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.038+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/2292429412 shutdown_connections 2024-09-17T03:35:16.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.038+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/2292429412 wait complete. 2024-09-17T03:35:16.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.039+0000 7fcd8d9fb740 1 -- start start 2024-09-17T03:35:16.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.039+0000 7fcd8d9fb740 1 Processor -- start 2024-09-17T03:35:16.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x55722018f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd8c6b0 0x55722019c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd8d9fb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x557220190980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557220169600 con 0x55721fd844d0 2024-09-17T03:35:16.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd80168740 con 0x55721fdad390 2024-09-17T03:35:16.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd8d9fb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55722018fdb0 con 0x55721fd8c6b0 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd8d9fb740 10 client.0 _ll_register_callbacks cb 0x7fcd7007ef10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd7ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x55722018f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd7ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x55722018f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47192/0 (socket says 172.21.15.146:47192) 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd7ffff640 1 -- 172.21.15.146:0/278208104 learned_addr learned my addr 172.21.15.146:0/278208104 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd8c6b0 0x55722019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.040+0000 7fcd84f4a640 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x557220190980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd7ffff640 1 -- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd8c6b0 msgr2=0x55722019c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd8c6b0 0x55722019c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd7ffff640 1 -- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 msgr2=0x557220190980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x557220190980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd7ffff640 1 -- 172.21.15.146:0/278208104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55722016d8d0 con 0x55721fd844d0 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd7ffff640 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x55722018f330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcd700802e0 tx=0x7fcd7007f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d430c8de4d0035e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd5effd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd5effd640 1 -- 172.21.15.146:0/278208104 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7009a040 con 0x55721fd844d0 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd5effd640 1 -- 172.21.15.146:0/278208104 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7fcd7008c550 con 0x55721fd844d0 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/278208104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd6802a430 con 0x55721fd844d0 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd5effd640 1 -- 172.21.15.146:0/278208104 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fcd70082e40 con 0x55721fd844d0 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd8d9fb740 10 client.5253 fetch_fsmap learned FSMap version 14 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/278208104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55722016d8d0 con 0x55721fd844d0 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd5effd640 1 -- 172.21.15.146:0/278208104 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd6802a430 con 0x55721fd844d0 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd5effd640 1 -- 172.21.15.146:0/278208104 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fcd7009d020 con 0x55721fd844d0 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd8d9fb740 10 client.5253 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd8d9fb740 10 client.5253 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd8d9fb740 20 client.5253 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x557220190ec0 0x557220150630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd8d9fb740 4 client.5253 mds_command: new command op to 4864 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.041+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/278208104 --> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] -- command(tid 0: {"prefix": "perf dump"}) -- 0x5572200c55d0 con 0x557220190ec0 2024-09-17T03:35:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.042+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x557220190ec0 0x557220150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.042+0000 7fcd5effd640 10 client.5253 ms_handle_connect on v2:172.21.15.179:6834/3055708361 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.042+0000 7fcd7f7fe640 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x557220190ec0 0x557220150630 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc9034ac4ca75491 server_cookie=c15f353b9dc5eaf in_seq=0 out_seq=0 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.042+0000 7fcd5effd640 1 -- 172.21.15.146:0/278208104 <== mds.0 v2:172.21.15.179:6834/3055708361 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18099 (crc 0 0 0) 0x5572200c55d0 con 0x557220190ec0 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.042+0000 7fcd5effd640 10 client.5253 handle_command_reply: tid=0 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.042+0000 7fcd8d9fb740 1 client.5253 shutdown 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/278208104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 msgr2=0x55722018f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x55722018f330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcd700802e0 tx=0x7fcd7007f5b0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/278208104 shutdown_connections 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:6834/3055708361,v1:172.21.15.179:6836/3055708361] conn(0x557220190ec0 0x557220150630 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55721fdad390 0x557220190980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd5effd640 0 client.5253 ms_handle_reset on v2:172.21.15.179:6834/3055708361 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55721fd8c6b0 0x55722019c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd8d9fb740 1 --2- 172.21.15.146:0/278208104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55721fd844d0 0x55722018f330 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/278208104 >> 172.21.15.146:0/278208104 conn(0x55721fda14e0 msgr2=0x557220169cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:16.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/278208104 shutdown_connections 2024-09-17T03:35:16.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd8d9fb740 1 -- 172.21.15.146:0/278208104 wait complete. 2024-09-17T03:35:16.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd8d9fb740 20 client.5253 trim_cache size 0 max 16384 2024-09-17T03:35:16.049 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 3126, 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 3127, 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 790552, 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 35501827, 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 17, 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 6, 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.370045810, 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.206740732, 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.055348459, 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.090578042, 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3126, 2024-09-17T03:35:16.050 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.468575603, 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000149896 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 10, 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000924, 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000092 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 0 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 28821, 2024-09-17T03:35:16.051 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 51126, 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 9532216, 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 42809309, 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 7, 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 2.275241134, 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 1.496781568, 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 1.063110760, 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.065068457, 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 51125, 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.358179610, 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000026565 2024-09-17T03:35:16.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 46807, 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.009997477, 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000213 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 132080, 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 26384 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 3510, 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 3530, 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 1278300, 2024-09-17T03:35:16.053 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 39417390, 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 6, 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.440751007, 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.254987752, 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.068738474, 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.099832158, 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3529, 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.344615317, 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000097652 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.054 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 2032, 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 124096 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-17T03:35:16.055 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1906, 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 18.216210440, 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.009557298 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4083, 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.334737423, 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000326901 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.056 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 25655, 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 25655, 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 25655, 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 378.677848799, 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.014760391 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_complete": 0, 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_keys": 0, 2024-09-17T03:35:16.057 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 12, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 17927, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 0, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 17927, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 17926, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 0, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 2, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 2, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 2, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 48760, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 48191, 2024-09-17T03:35:16.058 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2024-09-17T03:35:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2024-09-17T03:35:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2024-09-17T03:35:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2024-09-17T03:35:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 114, 2024-09-17T03:35:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 0, 2024-09-17T03:35:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2024-09-17T03:35:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2024-09-17T03:35:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2024-09-17T03:35:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2024-09-17T03:35:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2024-09-17T03:35:16.059 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2024-09-17T03:35:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 2013, 2024-09-17T03:35:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2024-09-17T03:35:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2024-09-17T03:35:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2024-09-17T03:35:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2024-09-17T03:35:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 2013, 2024-09-17T03:35:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2024-09-17T03:35:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2024-09-17T03:35:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2024-09-17T03:35:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 13, 2024-09-17T03:35:16.060 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 2, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 11, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 2000, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 1029, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 4027, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 3082, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 2474, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 61, 2024-09-17T03:35:16.061 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 14102 2024-09-17T03:35:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2024-09-17T03:35:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update": 0, 2024-09-17T03:35:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update_receipt": 0, 2024-09-17T03:35:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_try_discover": 0, 2024-09-17T03:35:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_send_discover": 0, 2024-09-17T03:35:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_handle_discover": 0, 2024-09-17T03:35:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 0, 2024-09-17T03:35:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 0, 2024-09-17T03:35:16.062 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2024-09-17T03:35:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 4190, 2024-09-17T03:35:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 3780, 2024-09-17T03:35:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 2251, 2024-09-17T03:35:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2024-09-17T03:35:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2024-09-17T03:35:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2024-09-17T03:35:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2024-09-17T03:35:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2024-09-17T03:35:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2024-09-17T03:35:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_path": 0, 2024-09-17T03:35:16.063 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_inode": 0, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 1, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_succeeded": 0, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_write_failed": 0 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "evlrg": 0, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 25926, 2024-09-17T03:35:16.064 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 0, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 0, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 25926, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 0, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 35, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 0, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 0, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 35, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "segmjr": 4, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 0, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 4194304, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 95180050, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 0, 2024-09-17T03:35:16.065 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2637, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 103.678167139, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.039316711 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 0 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 14, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 2016, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 2002, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 13, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 13, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 0, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 17927, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 19928, 2024-09-17T03:35:16.066 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 2001, 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 2, 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 8194, 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 8192, 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 167400, 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 407789568 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 28665, 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 25655, 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 6, 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2024-09-17T03:35:16.067 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2000, 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2.581708117, 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001290854 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 30, 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.006987406, 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000232913 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.068 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6000, 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 7.288516362, 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001214752 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 7360, 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 5.177316697, 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000703439 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.069 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2024-09-17T03:35:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.070 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000055603, 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000055603 2024-09-17T03:35:16.071 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.003202302, 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.003202302 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.072 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.429262204, 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.429262204 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000126631, 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000126631 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8, 2024-09-17T03:35:16.073 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.480665801, 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.060083225 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2251, 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 342.185766029, 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.152015000 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "req_snapdiff_latency": { 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.074 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.098207142, 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.098207142 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.075 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000323171, 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000323171 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.076 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.077 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8000, 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 20.425711334, 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002553213 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.078 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 1, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 0, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 1, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 18073, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 18073, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 82, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "mdthresh_evicted": 0 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-09-17T03:35:16.079 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-09-17T03:35:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-09-17T03:35:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-09-17T03:35:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-09-17T03:35:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-17T03:35:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-09-17T03:35:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-17T03:35:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-09-17T03:35:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-09-17T03:35:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-09-17T03:35:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-17T03:35:16.080 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-09-17T03:35:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-09-17T03:35:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-09-17T03:35:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-09-17T03:35:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-09-17T03:35:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-17T03:35:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-09-17T03:35:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-17T03:35:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-09-17T03:35:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-09-17T03:35:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-09-17T03:35:16.081 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 250473, 2024-09-17T03:35:16.082 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 92, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 440, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 5, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 5416, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 77, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-09-17T03:35:16.083 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 13072493, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 661997, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 8718, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 91669324, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 37, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 8718, 2024-09-17T03:35:16.084 INFO:teuthology.orchestra.run.smithi146.stdout: "op_latency": { 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8718, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 35.432212471, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.004064259 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "op_inflight": 0, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8718, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 8823 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 8718, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 2083, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 6635, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 0, 2024-09-17T03:35:16.085 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 11, 2024-09-17T03:35:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 68, 2024-09-17T03:35:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 2703, 2024-09-17T03:35:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 39, 2024-09-17T03:35:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2024-09-17T03:35:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2024-09-17T03:35:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 1780, 2024-09-17T03:35:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2024-09-17T03:35:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 2033, 2024-09-17T03:35:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2024-09-17T03:35:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2024-09-17T03:35:16.086 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2024-09-17T03:35:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 2015, 2024-09-17T03:35:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 22, 2024-09-17T03:35:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2024-09-17T03:35:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2024-09-17T03:35:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2024-09-17T03:35:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2024-09-17T03:35:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2024-09-17T03:35:16.087 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2024-09-17T03:35:16.088 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2024-09-17T03:35:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2024-09-17T03:35:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2024-09-17T03:35:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2024-09-17T03:35:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2024-09-17T03:35:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2024-09-17T03:35:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2024-09-17T03:35:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2024-09-17T03:35:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 34, 2024-09-17T03:35:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2024-09-17T03:35:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 3, 2024-09-17T03:35:16.089 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 8, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 8, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 117, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 0, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 35 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 1, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2024-09-17T03:35:16.090 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 32, 2024-09-17T03:35:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2024-09-17T03:35:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 32, 2024-09-17T03:35:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed_ops": 3780, 2024-09-17T03:35:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 3780, 2024-09-17T03:35:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2024-09-17T03:35:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-17T03:35:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:35:16.091 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 35453, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 8830718, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 35453, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 35453, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 8830718, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.092 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 8718, 2024-09-17T03:35:16.093 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 92065344, 2024-09-17T03:35:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 8718, 2024-09-17T03:35:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 92065344, 2024-09-17T03:35:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:35:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2024-09-17T03:35:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:35:16.094 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2024-09-17T03:35:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:35:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-17T03:35:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-17T03:35:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:35:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-17T03:35:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 8718, 2024-09-17T03:35:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 8718, 2024-09-17T03:35:16.095 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 8718, 2024-09-17T03:35:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 8718, 2024-09-17T03:35:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:35:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2024-09-17T03:35:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:35:16.096 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 3780, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 396020, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 3780, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 66, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 396020, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.097 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55ba8d1d55f0": { 2024-09-17T03:35:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:35:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-17T03:35:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:35:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 25926, 2024-09-17T03:35:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 90985746, 2024-09-17T03:35:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:35:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 25926, 2024-09-17T03:35:16.098 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:35:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:35:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2637, 2024-09-17T03:35:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 90985746, 2024-09-17T03:35:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:35:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:35:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:35:16.099 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:35:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: "trackedop": { 2024-09-17T03:35:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_ops_count": 0 2024-09-17T03:35:16.100 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:16.100 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:16.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd869ad640 1 -- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd60078bc0 msgr2=0x7fcd6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd869ad640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd60078bc0 0x7fcd6007b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcd8014cdf0 tx=0x7fcd68005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd869ad640 1 -- 172.21.15.146:0/3449679736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd800b4100 msgr2=0x7fcd80135260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd869ad640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd800b4100 0x7fcd80135260 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcd70000c00 tx=0x7fcd700038a0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd869ad640 1 -- 172.21.15.146:0/3449679736 shutdown_connections 2024-09-17T03:35:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd869ad640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd60078bc0 0x7fcd6007b0d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd869ad640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd8014c8f0 0x7fcd80136b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd869ad640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd800b4510 0x7fcd80148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd869ad640 1 --2- 172.21.15.146:0/3449679736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd800b4100 0x7fcd80135260 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.043+0000 7fcd869ad640 1 -- 172.21.15.146:0/3449679736 >> 172.21.15.146:0/3449679736 conn(0x7fcd8006d3c0 msgr2=0x7fcd80074960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.044+0000 7fcd869ad640 1 -- 172.21.15.146:0/3449679736 shutdown_connections 2024-09-17T03:35:16.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.044+0000 7fcd869ad640 1 -- 172.21.15.146:0/3449679736 wait complete. 2024-09-17T03:35:16.104 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:35:16.105 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:35:16.160 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:35:16.203 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:35:16.204 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:35:16.204 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:35:16.204 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:16.220 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:35:16.220 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:16.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:35:16.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.431+0000 7efd59af9640 1 -- 172.21.15.146:0/1512667314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd40003a30 msgr2=0x7efd40003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.431+0000 7efd59af9640 1 --2- 172.21.15.146:0/1512667314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd40003a30 0x7efd40003ea0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efd440016c0 tx=0x7efd40005830 comp rx=0 tx=0).stop 2024-09-17T03:35:16.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.431+0000 7efd53fff640 1 -- 172.21.15.146:0/1512667314 reap_dead start 2024-09-17T03:35:16.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.431+0000 7efd59af9640 1 -- 172.21.15.146:0/1512667314 shutdown_connections 2024-09-17T03:35:16.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.431+0000 7efd59af9640 1 -- 172.21.15.146:0/1512667314 >> 172.21.15.146:0/1512667314 conn(0x7efd540b7b20 msgr2=0x7efd5409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:16.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.431+0000 7efd59af9640 1 -- 172.21.15.146:0/1512667314 shutdown_connections 2024-09-17T03:35:16.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.431+0000 7efd59af9640 1 -- 172.21.15.146:0/1512667314 wait complete. 2024-09-17T03:35:16.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.433+0000 7efd59af9640 1 Processor -- start 2024-09-17T03:35:16.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.433+0000 7efd59af9640 1 -- start start 2024-09-17T03:35:16.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.434+0000 7efd59af9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd40003a30 0x7efd541f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.434+0000 7efd59af9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd541650a0 0x7efd54163fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.434+0000 7efd59af9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd5406f9e0 0x7efd541644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.434+0000 7efd59af9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efd541657b0 con 0x7efd541650a0 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.434+0000 7efd59af9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efd5415dcc0 con 0x7efd5406f9e0 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.434+0000 7efd59af9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efd54165930 con 0x7efd40003a30 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.434+0000 7efd4bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd541650a0 0x7efd54163fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.434+0000 7efd4bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd541650a0 0x7efd54163fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47204/0 (socket says 172.21.15.146:47204) 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.434+0000 7efd4bfff640 1 -- 172.21.15.146:0/4161676967 learned_addr learned my addr 172.21.15.146:0/4161676967 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.434+0000 7efd537fe640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd40003a30 0x7efd541f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.434+0000 7efd53fff640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd5406f9e0 0x7efd541644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.435+0000 7efd4bfff640 1 -- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd40003a30 msgr2=0x7efd541f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.435+0000 7efd4bfff640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd40003a30 0x7efd541f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.435+0000 7efd4bfff640 1 -- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd5406f9e0 msgr2=0x7efd541644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.435+0000 7efd4bfff640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd5406f9e0 0x7efd541644e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.435+0000 7efd4bfff640 1 -- 172.21.15.146:0/4161676967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd541f9170 con 0x7efd541650a0 2024-09-17T03:35:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.435+0000 7efd4bfff640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd541650a0 0x7efd54163fa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00e570 tx=0x7efd3c00ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.435+0000 7efd50ff9640 1 -- 172.21.15.146:0/4161676967 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c015070 con 0x7efd541650a0 2024-09-17T03:35:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.435+0000 7efd50ff9640 1 -- 172.21.15.146:0/4161676967 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd3c010980 con 0x7efd541650a0 2024-09-17T03:35:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.435+0000 7efd59af9640 1 -- 172.21.15.146:0/4161676967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd541f9450 con 0x7efd541650a0 2024-09-17T03:35:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.435+0000 7efd50ff9640 1 -- 172.21.15.146:0/4161676967 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c010d50 con 0x7efd541650a0 2024-09-17T03:35:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.435+0000 7efd59af9640 1 -- 172.21.15.146:0/4161676967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd541f9a10 con 0x7efd541650a0 2024-09-17T03:35:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.436+0000 7efd59af9640 1 -- 172.21.15.146:0/4161676967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd540b3620 con 0x7efd541650a0 2024-09-17T03:35:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.437+0000 7efd50ff9640 1 -- 172.21.15.146:0/4161676967 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd3c018070 con 0x7efd541650a0 2024-09-17T03:35:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.437+0000 7efd50ff9640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd34078b90 0x7efd3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.437+0000 7efd50ff9640 1 -- 172.21.15.146:0/4161676967 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7efd3c09b050 con 0x7efd541650a0 2024-09-17T03:35:16.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.438+0000 7efd537fe640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd34078b90 0x7efd3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.438+0000 7efd537fe640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd34078b90 0x7efd3407b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efd44032000 tx=0x7efd4402c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:16.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.442+0000 7efd50ff9640 1 -- 172.21.15.146:0/4161676967 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efd3c062ec0 con 0x7efd541650a0 2024-09-17T03:35:16.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.627+0000 7efd59af9640 1 -- 172.21.15.146:0/4161676967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efd54050f60 con 0x7efd541650a0 2024-09-17T03:35:16.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.628+0000 7efd50ff9640 1 -- 172.21.15.146:0/4161676967 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7efd3c0678f0 con 0x7efd541650a0 2024-09-17T03:35:16.628 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:35:16.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 -- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd34078b90 msgr2=0x7efd3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd34078b90 0x7efd3407b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efd44032000 tx=0x7efd4402c040 comp rx=0 tx=0).stop 2024-09-17T03:35:16.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 -- 172.21.15.146:0/4161676967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd541650a0 msgr2=0x7efd54163fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd541650a0 0x7efd54163fa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00e570 tx=0x7efd3c00ea30 comp rx=0 tx=0).stop 2024-09-17T03:35:16.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 -- 172.21.15.146:0/4161676967 shutdown_connections 2024-09-17T03:35:16.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd34078b90 0x7efd3407b0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd5406f9e0 0x7efd541644e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd541650a0 0x7efd54163fa0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 --2- 172.21.15.146:0/4161676967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd40003a30 0x7efd541f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 -- 172.21.15.146:0/4161676967 >> 172.21.15.146:0/4161676967 conn(0x7efd540b7b20 msgr2=0x7efd54070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:16.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 -- 172.21.15.146:0/4161676967 shutdown_connections 2024-09-17T03:35:16.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.630+0000 7efd59af9640 1 -- 172.21.15.146:0/4161676967 wait complete. 2024-09-17T03:35:16.641 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:35:16.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:16.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:35:16.684 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:35:16.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:16.685 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:35:16.740 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:35:16.741 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:35:16.741 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:16.759 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:35:16.759 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:35:16.760 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:35:16.760 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:16.797 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:35:16.797 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:35:16.797 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:35:16.797 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:16.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:35:16.816 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:16.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.950+0000 7f49da3da640 1 -- 172.21.15.146:0/1694264330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d40b3d30 msgr2=0x7f49d415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.950+0000 7f49da3da640 1 --2- 172.21.15.146:0/1694264330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d40b3d30 0x7f49d415caa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f49d40b5390 tx=0x7f49cc02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.950+0000 7f49da3da640 1 -- 172.21.15.146:0/1694264330 shutdown_connections 2024-09-17T03:35:16.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.950+0000 7f49da3da640 1 --2- 172.21.15.146:0/1694264330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d40b3d30 0x7f49d415caa0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.950+0000 7f49da3da640 1 --2- 172.21.15.146:0/1694264330 >> v2:172.21.15.179:3300/0 conn(0x7f49d40b5ce0 0x7f49d40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.950+0000 7f49da3da640 1 -- 172.21.15.146:0/1694264330 >> 172.21.15.146:0/1694264330 conn(0x7f49d40b7b20 msgr2=0x7f49d409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:16.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.950+0000 7f49da3da640 1 -- 172.21.15.146:0/1694264330 shutdown_connections 2024-09-17T03:35:16.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.950+0000 7f49da3da640 1 -- 172.21.15.146:0/1694264330 wait complete. 2024-09-17T03:35:16.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.951+0000 7f49da3da640 1 Processor -- start 2024-09-17T03:35:16.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.952+0000 7f49da3da640 1 -- start start 2024-09-17T03:35:16.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49da3da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d40b5750 0x7f49d414f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49da3da640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d40b5ce0 0x7f49d40d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49da3da640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d414e6d0 0x7f49d415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49da3da640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f49d415d3f0 con 0x7f49d40b5ce0 2024-09-17T03:35:16.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49da3da640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49d415d270 con 0x7f49d40b5750 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49da3da640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f49d415d570 con 0x7f49d414e6d0 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d40b5ce0 0x7f49d40d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d40b5ce0 0x7f49d40d1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47222/0 (socket says 172.21.15.146:47222) 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49d37fe640 1 -- 172.21.15.146:0/424335863 learned_addr learned my addr 172.21.15.146:0/424335863 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49d3fff640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d40b5750 0x7f49d414f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49d8977640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d414e6d0 0x7f49d415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49d37fe640 1 -- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d414e6d0 msgr2=0x7f49d415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49d37fe640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d414e6d0 0x7f49d415ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49d37fe640 1 -- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d40b5750 msgr2=0x7f49d414f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49d37fe640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d40b5750 0x7f49d414f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.953+0000 7f49d37fe640 1 -- 172.21.15.146:0/424335863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d4150040 con 0x7f49d40b5ce0 2024-09-17T03:35:16.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.954+0000 7f49d37fe640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d40b5ce0 0x7f49d40d1e80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c340 tx=0x7f49c800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.954+0000 7f49d0ff9640 1 -- 172.21.15.146:0/424335863 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8011790 con 0x7f49d40b5ce0 2024-09-17T03:35:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.954+0000 7f49d0ff9640 1 -- 172.21.15.146:0/424335863 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49c8017070 con 0x7f49d40b5ce0 2024-09-17T03:35:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.954+0000 7f49da3da640 1 -- 172.21.15.146:0/424335863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d4150320 con 0x7f49d40b5ce0 2024-09-17T03:35:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.954+0000 7f49d0ff9640 1 -- 172.21.15.146:0/424335863 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8011cc0 con 0x7f49d40b5ce0 2024-09-17T03:35:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.954+0000 7f49da3da640 1 -- 172.21.15.146:0/424335863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d41508e0 con 0x7f49d40b5ce0 2024-09-17T03:35:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.955+0000 7f49da3da640 1 -- 172.21.15.146:0/424335863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d415da90 con 0x7f49d40b5ce0 2024-09-17T03:35:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.956+0000 7f49d0ff9640 1 -- 172.21.15.146:0/424335863 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49c801c460 con 0x7f49d40b5ce0 2024-09-17T03:35:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.956+0000 7f49d0ff9640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c0078bc0 0x7f49c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.956+0000 7f49d0ff9640 1 -- 172.21.15.146:0/424335863 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7f49c809a910 con 0x7f49d40b5ce0 2024-09-17T03:35:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.956+0000 7f49d3fff640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c0078bc0 0x7f49c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.957+0000 7f49d3fff640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c0078bc0 0x7f49c007b0d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f49c400a490 tx=0x7f49c400a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:16.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:16.961+0000 7f49d0ff9640 1 -- 172.21.15.146:0/424335863 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f49c80626e0 con 0x7f49d40b5ce0 2024-09-17T03:35:17.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.170+0000 7f49da3da640 1 -- 172.21.15.146:0/424335863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49d4155aa0 con 0x7f49d40b5ce0 2024-09-17T03:35:17.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.171+0000 7f49d0ff9640 1 -- 172.21.15.146:0/424335863 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7f49c8067110 con 0x7f49d40b5ce0 2024-09-17T03:35:17.171 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:17.171 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"btime":"2024-09-17T03:33:52:871238+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/699096289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":699096289},{"type":"v1","addr":"172.21.15.146:6834","nonce":699096289}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3576644376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3576644376},{"type":"v1","addr":"172.21.15.179:6837","nonce":3576644376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4852,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1904604031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1904604031},{"type":"v1","addr":"172.21.15.146:6835","nonce":1904604031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T03:33:41.014829+0000","modified":"2024-09-17T03:33:52.269693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/3055708361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3055708361},{"type":"v1","addr":"172.21.15.179:6836","nonce":3055708361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4864,"qdb_cluster":[4864]},"id":2}]} 2024-09-17T03:35:17.172 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.173+0000 7f49da3da640 1 -- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c0078bc0 msgr2=0x7f49c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.173+0000 7f49da3da640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c0078bc0 0x7f49c007b0d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f49c400a490 tx=0x7f49c400a420 comp rx=0 tx=0).stop 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.173+0000 7f49da3da640 1 -- 172.21.15.146:0/424335863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d40b5ce0 msgr2=0x7f49d40d1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.173+0000 7f49da3da640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d40b5ce0 0x7f49d40d1e80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c340 tx=0x7f49c800c800 comp rx=0 tx=0).stop 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.174+0000 7f49da3da640 1 -- 172.21.15.146:0/424335863 shutdown_connections 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.174+0000 7f49da3da640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c0078bc0 0x7f49c007b0d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.174+0000 7f49da3da640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d414e6d0 0x7f49d415ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.174+0000 7f49da3da640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d40b5ce0 0x7f49d40d1e80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.174+0000 7f49da3da640 1 --2- 172.21.15.146:0/424335863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d40b5750 0x7f49d414f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.174+0000 7f49da3da640 1 -- 172.21.15.146:0/424335863 >> 172.21.15.146:0/424335863 conn(0x7f49d40b7b20 msgr2=0x7f49d41562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.174+0000 7f49da3da640 1 -- 172.21.15.146:0/424335863 shutdown_connections 2024-09-17T03:35:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.174+0000 7f49da3da640 1 -- 172.21.15.146:0/424335863 wait complete. 2024-09-17T03:35:17.185 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:17.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.300+0000 7efd91427640 1 -- 172.21.15.146:0/157818224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c0b47c0 msgr2=0x7efd8c0cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.300+0000 7efd91427640 1 --2- 172.21.15.146:0/157818224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c0b47c0 0x7efd8c0cd090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd80009860 tx=0x7efd8002a510 comp rx=0 tx=0).stop 2024-09-17T03:35:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.300+0000 7efd91427640 1 -- 172.21.15.146:0/157818224 shutdown_connections 2024-09-17T03:35:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.300+0000 7efd91427640 1 --2- 172.21.15.146:0/157818224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c0b47c0 0x7efd8c0cd090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.300+0000 7efd91427640 1 -- 172.21.15.146:0/157818224 >> 172.21.15.146:0/157818224 conn(0x7efd8c09ba20 msgr2=0x7efd8c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.300+0000 7efd91427640 1 -- 172.21.15.146:0/157818224 shutdown_connections 2024-09-17T03:35:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.300+0000 7efd91427640 1 -- 172.21.15.146:0/157818224 wait complete. 2024-09-17T03:35:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.302+0000 7efd91427640 1 Processor -- start 2024-09-17T03:35:17.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.302+0000 7efd91427640 1 -- start start 2024-09-17T03:35:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd91427640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c0b47c0 0x7efd8c167530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd91427640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c0cd5d0 0x7efd8c161950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd91427640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd8c0d0710 0x7efd8c1f7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd91427640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c168470 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd91427640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c0b80a0 con 0x7efd8c0d0710 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd91427640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efd8c1685f0 con 0x7efd8c0b47c0 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd8a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c0cd5d0 0x7efd8c161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd8a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c0cd5d0 0x7efd8c161950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39482/0 (socket says 172.21.15.146:39482) 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd8a7fc640 1 -- 172.21.15.146:0/463300947 learned_addr learned my addr 172.21.15.146:0/463300947 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd8affd640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c0b47c0 0x7efd8c167530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd8b7fe640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd8c0d0710 0x7efd8c1f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd8a7fc640 1 -- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c0b47c0 msgr2=0x7efd8c167530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd8a7fc640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c0b47c0 0x7efd8c167530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd8a7fc640 1 -- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd8c0d0710 msgr2=0x7efd8c1f7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd8a7fc640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd8c0d0710 0x7efd8c1f7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.303+0000 7efd8a7fc640 1 -- 172.21.15.146:0/463300947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c162390 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.304+0000 7efd8a7fc640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c0cd5d0 0x7efd8c161950 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efd80009980 tx=0x7efd80033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:17.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.304+0000 7efd737fe640 1 -- 172.21.15.146:0/463300947 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80031d60 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.304+0000 7efd737fe640 1 -- 172.21.15.146:0/463300947 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd80033e50 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.304+0000 7efd91427640 1 -- 172.21.15.146:0/463300947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8c162670 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.304+0000 7efd737fe640 1 -- 172.21.15.146:0/463300947 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80005260 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.304+0000 7efd91427640 1 -- 172.21.15.146:0/463300947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8c167a70 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.305+0000 7efd91427640 1 -- 172.21.15.146:0/463300947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd8c0cd090 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.306+0000 7efd737fe640 1 -- 172.21.15.146:0/463300947 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd80005400 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.306+0000 7efd737fe640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd78078bc0 0x7efd7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.306+0000 7efd737fe640 1 -- 172.21.15.146:0/463300947 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7efd800bbea0 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.306+0000 7efd8affd640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd78078bc0 0x7efd7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.307+0000 7efd8affd640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd78078bc0 0x7efd7807b0d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000f60 tx=0x7efd7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.311+0000 7efd737fe640 1 -- 172.21.15.146:0/463300947 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efd8003f030 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.523+0000 7efd91427640 1 -- 172.21.15.146:0/463300947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd8c0ced70 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.524+0000 7efd737fe640 1 -- 172.21.15.146:0/463300947 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7efd80031770 con 0x7efd8c0cd5d0 2024-09-17T03:35:17.524 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:17.524 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"btime":"2024-09-17T03:33:52:871238+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/699096289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":699096289},{"type":"v1","addr":"172.21.15.146:6834","nonce":699096289}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3576644376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3576644376},{"type":"v1","addr":"172.21.15.179:6837","nonce":3576644376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4852,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1904604031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1904604031},{"type":"v1","addr":"172.21.15.146:6835","nonce":1904604031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T03:33:41.014829+0000","modified":"2024-09-17T03:33:52.269693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/3055708361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3055708361},{"type":"v1","addr":"172.21.15.179:6836","nonce":3055708361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4864,"qdb_cluster":[4864]},"id":2}]} 2024-09-17T03:35:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2024-09-17T03:35:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 -- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd78078bc0 msgr2=0x7efd7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd78078bc0 0x7efd7807b0d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000f60 tx=0x7efd7c009040 comp rx=0 tx=0).stop 2024-09-17T03:35:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 -- 172.21.15.146:0/463300947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c0cd5d0 msgr2=0x7efd8c161950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c0cd5d0 0x7efd8c161950 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efd80009980 tx=0x7efd80033ba0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 -- 172.21.15.146:0/463300947 shutdown_connections 2024-09-17T03:35:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd78078bc0 0x7efd7807b0d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd8c0d0710 0x7efd8c1f7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd8c0cd5d0 0x7efd8c161950 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 --2- 172.21.15.146:0/463300947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd8c0b47c0 0x7efd8c167530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 -- 172.21.15.146:0/463300947 >> 172.21.15.146:0/463300947 conn(0x7efd8c09ba20 msgr2=0x7efd8c0cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 -- 172.21.15.146:0/463300947 shutdown_connections 2024-09-17T03:35:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.526+0000 7efd91427640 1 -- 172.21.15.146:0/463300947 wait complete. 2024-09-17T03:35:17.537 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:17.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.650+0000 7f82e2990640 1 -- 172.21.15.146:0/2342312795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82c4004d40 msgr2=0x7f82c4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.650+0000 7f82e2990640 1 --2- 172.21.15.146:0/2342312795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82c4004d40 0x7f82c4005150 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f82d4005fd0 tx=0x7f82c4005830 comp rx=0 tx=0).stop 2024-09-17T03:35:17.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.650+0000 7f82e0f2d640 1 -- 172.21.15.146:0/2342312795 reap_dead start 2024-09-17T03:35:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.650+0000 7f82e2990640 1 -- 172.21.15.146:0/2342312795 shutdown_connections 2024-09-17T03:35:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.650+0000 7f82e2990640 1 -- 172.21.15.146:0/2342312795 >> 172.21.15.146:0/2342312795 conn(0x7f82dc0b7b20 msgr2=0x7f82dc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.650+0000 7f82e2990640 1 -- 172.21.15.146:0/2342312795 shutdown_connections 2024-09-17T03:35:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.650+0000 7f82e2990640 1 -- 172.21.15.146:0/2342312795 wait complete. 2024-09-17T03:35:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.652+0000 7f82e2990640 1 Processor -- start 2024-09-17T03:35:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.652+0000 7f82e2990640 1 -- start start 2024-09-17T03:35:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e2990640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c4004d40 0x7f82dc1f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e2990640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc152e40 0x7f82dc153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e2990640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc153790 0x7f82dc154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e2990640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc0b1870 con 0x7f82dc153790 2024-09-17T03:35:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e2990640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc0b16f0 con 0x7f82c4004d40 2024-09-17T03:35:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e2990640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f82dc15cfe0 con 0x7f82dc152e40 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e0f2d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc153790 0x7f82dc154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e0f2d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc153790 0x7f82dc154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39496/0 (socket says 172.21.15.146:39496) 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e0f2d640 1 -- 172.21.15.146:0/3942490648 learned_addr learned my addr 172.21.15.146:0/3942490648 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82dbfff640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c4004d40 0x7f82dc1f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82db7fe640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc152e40 0x7f82dc153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e0f2d640 1 -- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc152e40 msgr2=0x7f82dc153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e0f2d640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc152e40 0x7f82dc153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e0f2d640 1 -- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c4004d40 msgr2=0x7f82dc1f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e0f2d640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c4004d40 0x7f82dc1f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e0f2d640 1 -- 172.21.15.146:0/3942490648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82dc1543a0 con 0x7f82dc153790 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e0f2d640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc153790 0x7f82dc154850 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f82d402b860 tx=0x7f82d4033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82d8ff9640 1 -- 172.21.15.146:0/3942490648 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4042070 con 0x7f82dc153790 2024-09-17T03:35:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82d8ff9640 1 -- 172.21.15.146:0/3942490648 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82d4003970 con 0x7f82dc153790 2024-09-17T03:35:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82d8ff9640 1 -- 172.21.15.146:0/3942490648 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4038040 con 0x7f82dc153790 2024-09-17T03:35:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e2990640 1 -- 172.21.15.146:0/3942490648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82dc151e50 con 0x7f82dc153790 2024-09-17T03:35:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.654+0000 7f82e2990640 1 -- 172.21.15.146:0/3942490648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82dc152410 con 0x7f82dc153790 2024-09-17T03:35:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.655+0000 7f82e2990640 1 -- 172.21.15.146:0/3942490648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82dc15caa0 con 0x7f82dc153790 2024-09-17T03:35:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.656+0000 7f82d8ff9640 1 -- 172.21.15.146:0/3942490648 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82d4033d10 con 0x7f82dc153790 2024-09-17T03:35:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.657+0000 7f82d8ff9640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82c8078bf0 0x7f82c807b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.657+0000 7f82d8ff9640 1 -- 172.21.15.146:0/3942490648 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7f82d40bae60 con 0x7f82dc153790 2024-09-17T03:35:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.657+0000 7f82dbfff640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82c8078bf0 0x7f82c807b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.658+0000 7f82dbfff640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82c8078bf0 0x7f82c807b100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009b90 tx=0x7f82cc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.661+0000 7f82d8ff9640 1 -- 172.21.15.146:0/3942490648 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f82d4082c30 con 0x7f82dc153790 2024-09-17T03:35:17.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.842+0000 7f82e2990640 1 -- 172.21.15.146:0/3942490648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82dc0714f0 con 0x7f82dc153790 2024-09-17T03:35:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.843+0000 7f82d8ff9640 1 -- 172.21.15.146:0/3942490648 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16842 (secure 0 0 0) 0x7f82d4087660 con 0x7f82dc153790 2024-09-17T03:35:17.844 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:17.844 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":34,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:35:00.267957+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:33:38.670836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T03:33:39.971433+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:17.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 -- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82c8078bf0 msgr2=0x7f82c807b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82c8078bf0 0x7f82c807b100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009b90 tx=0x7f82cc005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:17.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 -- 172.21.15.146:0/3942490648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc153790 msgr2=0x7f82dc154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc153790 0x7f82dc154850 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f82d402b860 tx=0x7f82d4033ba0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 -- 172.21.15.146:0/3942490648 shutdown_connections 2024-09-17T03:35:17.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82c8078bf0 0x7f82c807b100 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82dc153790 0x7f82dc154850 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82dc152e40 0x7f82dc153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 --2- 172.21.15.146:0/3942490648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82c4004d40 0x7f82dc1f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 -- 172.21.15.146:0/3942490648 >> 172.21.15.146:0/3942490648 conn(0x7f82dc0b7b20 msgr2=0x7f82dc15f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:17.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 -- 172.21.15.146:0/3942490648 shutdown_connections 2024-09-17T03:35:17.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.846+0000 7f82e2990640 1 -- 172.21.15.146:0/3942490648 wait complete. 2024-09-17T03:35:17.857 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:35:17.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:17.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.970+0000 7fddc3ded640 1 -- 172.21.15.146:0/4120431537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc15c9f0 msgr2=0x7fddbc1526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.970+0000 7fddc3ded640 1 --2- 172.21.15.146:0/4120431537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc15c9f0 0x7fddbc1526a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fddbc15d000 tx=0x7fddb802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.970+0000 7fddc3ded640 1 -- 172.21.15.146:0/4120431537 shutdown_connections 2024-09-17T03:35:17.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.970+0000 7fddc3ded640 1 --2- 172.21.15.146:0/4120431537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddbc0701e0 0x7fddbc0cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.970+0000 7fddc3ded640 1 --2- 172.21.15.146:0/4120431537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc15c9f0 0x7fddbc1526a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.970+0000 7fddc3ded640 1 -- 172.21.15.146:0/4120431537 >> 172.21.15.146:0/4120431537 conn(0x7fddbc06d3c0 msgr2=0x7fddbc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:17.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.971+0000 7fddc3ded640 1 -- 172.21.15.146:0/4120431537 shutdown_connections 2024-09-17T03:35:17.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.971+0000 7fddc3ded640 1 -- 172.21.15.146:0/4120431537 wait complete. 2024-09-17T03:35:17.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.972+0000 7fddc3ded640 1 Processor -- start 2024-09-17T03:35:17.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.972+0000 7fddc3ded640 1 -- start start 2024-09-17T03:35:17.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.973+0000 7fddc3ded640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddbc0b4100 0x7fddbc06e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc3ded640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06ef00 0x7fddbc0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc3ded640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddbc0b2bd0 0x7fddbc1f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc3ded640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc0d0770 con 0x7fddbc06ef00 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc3ded640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc0d05f0 con 0x7fddbc0b2bd0 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc3ded640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fddbc0d08f0 con 0x7fddbc0b4100 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc1388640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06ef00 0x7fddbc0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc1388640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06ef00 0x7fddbc0b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39520/0 (socket says 172.21.15.146:39520) 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc1388640 1 -- 172.21.15.146:0/2164182098 learned_addr learned my addr 172.21.15.146:0/2164182098 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc238a640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddbc0b2bd0 0x7fddbc1f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc1b89640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddbc0b4100 0x7fddbc06e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc1388640 1 -- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddbc0b4100 msgr2=0x7fddbc06e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc1388640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddbc0b4100 0x7fddbc06e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc1388640 1 -- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddbc0b2bd0 msgr2=0x7fddbc1f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc1388640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddbc0b2bd0 0x7fddbc1f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:17.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc1388640 1 -- 172.21.15.146:0/2164182098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc06f310 con 0x7fddbc06ef00 2024-09-17T03:35:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc1388640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06ef00 0x7fddbc0b2690 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fddac00c3d0 tx=0x7fddac00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddb27fc640 1 -- 172.21.15.146:0/2164182098 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac017070 con 0x7fddbc06ef00 2024-09-17T03:35:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddb27fc640 1 -- 172.21.15.146:0/2164182098 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddac0053c0 con 0x7fddbc06ef00 2024-09-17T03:35:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddb27fc640 1 -- 172.21.15.146:0/2164182098 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddac003850 con 0x7fddbc06ef00 2024-09-17T03:35:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc3ded640 1 -- 172.21.15.146:0/2164182098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddbc1f3a60 con 0x7fddbc06ef00 2024-09-17T03:35:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.974+0000 7fddc3ded640 1 -- 172.21.15.146:0/2164182098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddbc0b1e90 con 0x7fddbc06ef00 2024-09-17T03:35:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.975+0000 7fddc3ded640 1 -- 172.21.15.146:0/2164182098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddbc15c9f0 con 0x7fddbc06ef00 2024-09-17T03:35:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.976+0000 7fddb27fc640 1 -- 172.21.15.146:0/2164182098 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fddac01a070 con 0x7fddbc06ef00 2024-09-17T03:35:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.976+0000 7fddb27fc640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdda0078b90 0x7fdda007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.977+0000 7fddb27fc640 1 -- 172.21.15.146:0/2164182098 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7fddac099f30 con 0x7fddbc06ef00 2024-09-17T03:35:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.977+0000 7fddc1b89640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdda0078b90 0x7fdda007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.977+0000 7fddc1b89640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdda0078b90 0x7fdda007b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fddb8033000 tx=0x7fddb8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:17.981+0000 7fddb27fc640 1 -- 172.21.15.146:0/2164182098 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fddbc06f310 con 0x7fddbc06ef00 2024-09-17T03:35:18.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.191+0000 7fddc3ded640 1 -- 172.21.15.146:0/2164182098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddbc15b7e0 con 0x7fddbc06ef00 2024-09-17T03:35:18.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.191+0000 7fddb27fc640 1 -- 172.21.15.146:0/2164182098 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7fddac061d90 con 0x7fddbc06ef00 2024-09-17T03:35:18.191 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:18.192 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"btime":"2024-09-17T03:33:52:871238+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/699096289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":699096289},{"type":"v1","addr":"172.21.15.146:6834","nonce":699096289}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3576644376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3576644376},{"type":"v1","addr":"172.21.15.179:6837","nonce":3576644376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4852,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1904604031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1904604031},{"type":"v1","addr":"172.21.15.146:6835","nonce":1904604031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T03:33:41.014829+0000","modified":"2024-09-17T03:33:52.269693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/3055708361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3055708361},{"type":"v1","addr":"172.21.15.179:6836","nonce":3055708361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4864,"qdb_cluster":[4864]},"id":2}]} 2024-09-17T03:35:18.192 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2024-09-17T03:35:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.193+0000 7fddc3ded640 1 -- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdda0078b90 msgr2=0x7fdda007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.193+0000 7fddc3ded640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdda0078b90 0x7fdda007b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fddb8033000 tx=0x7fddb8004730 comp rx=0 tx=0).stop 2024-09-17T03:35:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.194+0000 7fddc3ded640 1 -- 172.21.15.146:0/2164182098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06ef00 msgr2=0x7fddbc0b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.194+0000 7fddc3ded640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06ef00 0x7fddbc0b2690 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fddac00c3d0 tx=0x7fddac00c890 comp rx=0 tx=0).stop 2024-09-17T03:35:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.194+0000 7fddc3ded640 1 -- 172.21.15.146:0/2164182098 shutdown_connections 2024-09-17T03:35:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.194+0000 7fddc3ded640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdda0078b90 0x7fdda007b0a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.194+0000 7fddc3ded640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddbc0b2bd0 0x7fddbc1f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.194+0000 7fddc3ded640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddbc06ef00 0x7fddbc0b2690 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.194+0000 7fddc3ded640 1 --2- 172.21.15.146:0/2164182098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddbc0b4100 0x7fddbc06e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.194+0000 7fddc3ded640 1 -- 172.21.15.146:0/2164182098 >> 172.21.15.146:0/2164182098 conn(0x7fddbc06d3c0 msgr2=0x7fddbc074210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:18.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.194+0000 7fddc3ded640 1 -- 172.21.15.146:0/2164182098 shutdown_connections 2024-09-17T03:35:18.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.194+0000 7fddc3ded640 1 -- 172.21.15.146:0/2164182098 wait complete. 2024-09-17T03:35:18.205 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:18.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.320+0000 7f2e03007640 1 -- 172.21.15.146:0/3107549973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de4004800 msgr2=0x7f2de4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.320+0000 7f2e03007640 1 --2- 172.21.15.146:0/3107549973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de4004800 0x7f2de4004c10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc073530 tx=0x7f2de4005830 comp rx=0 tx=0).stop 2024-09-17T03:35:18.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.320+0000 7f2e03007640 1 -- 172.21.15.146:0/3107549973 shutdown_connections 2024-09-17T03:35:18.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.320+0000 7f2e03007640 1 --2- 172.21.15.146:0/3107549973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de4004800 0x7f2de4004c10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.320+0000 7f2e03007640 1 -- 172.21.15.146:0/3107549973 >> 172.21.15.146:0/3107549973 conn(0x7f2dfc0b3150 msgr2=0x7f2dfc0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:18.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.320+0000 7f2e03007640 1 -- 172.21.15.146:0/3107549973 shutdown_connections 2024-09-17T03:35:18.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.320+0000 7f2e03007640 1 -- 172.21.15.146:0/3107549973 wait complete. 2024-09-17T03:35:18.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.321+0000 7f2e03007640 1 Processor -- start 2024-09-17T03:35:18.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.321+0000 7f2e03007640 1 -- start start 2024-09-17T03:35:18.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e03007640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de4004800 0x7f2dfc147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e03007640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dfc0aa510 0x7f2dfc0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e03007640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dfc06cc50 0x7f2dfc06d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e03007640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc0b5a10 con 0x7f2de4004800 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e03007640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc0b5890 con 0x7f2dfc0aa510 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e03007640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2dfc0b5b90 con 0x7f2dfc06cc50 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e00da3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de4004800 0x7f2dfc147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e00da3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de4004800 0x7f2dfc147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39542/0 (socket says 172.21.15.146:39542) 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e00da3640 1 -- 172.21.15.146:0/1161765523 learned_addr learned my addr 172.21.15.146:0/1161765523 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2dfbfff640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dfc0aa510 0x7f2dfc0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e015a4640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dfc06cc50 0x7f2dfc06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e00da3640 1 -- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dfc06cc50 msgr2=0x7f2dfc06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e00da3640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dfc06cc50 0x7f2dfc06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e00da3640 1 -- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dfc0aa510 msgr2=0x7f2dfc0aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e00da3640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dfc0aa510 0x7f2dfc0aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e00da3640 1 -- 172.21.15.146:0/1161765523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc06d5a0 con 0x7f2de4004800 2024-09-17T03:35:18.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2dfbfff640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dfc0aa510 0x7f2dfc0aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:18.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e015a4640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dfc06cc50 0x7f2dfc06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:18.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2e00da3640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de4004800 0x7f2dfc147ff0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2dec011a80 tx=0x7f2dec011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:18.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2df97fa640 1 -- 172.21.15.146:0/1161765523 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec00fe10 con 0x7f2de4004800 2024-09-17T03:35:18.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.323+0000 7f2df97fa640 1 -- 172.21.15.146:0/1161765523 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dec016070 con 0x7f2de4004800 2024-09-17T03:35:18.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.324+0000 7f2e03007640 1 -- 172.21.15.146:0/1161765523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dfc1f70f0 con 0x7f2de4004800 2024-09-17T03:35:18.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.324+0000 7f2df97fa640 1 -- 172.21.15.146:0/1161765523 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec012780 con 0x7f2de4004800 2024-09-17T03:35:18.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.324+0000 7f2e03007640 1 -- 172.21.15.146:0/1161765523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dfc1f76b0 con 0x7f2de4004800 2024-09-17T03:35:18.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.324+0000 7f2e03007640 1 -- 172.21.15.146:0/1161765523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dfc0b4ba0 con 0x7f2de4004800 2024-09-17T03:35:18.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.325+0000 7f2df97fa640 1 -- 172.21.15.146:0/1161765523 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2dec018030 con 0x7f2de4004800 2024-09-17T03:35:18.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.326+0000 7f2df97fa640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2de8078b90 0x7f2de807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.326+0000 7f2df97fa640 1 -- 172.21.15.146:0/1161765523 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7f2dec09b630 con 0x7f2de4004800 2024-09-17T03:35:18.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.326+0000 7f2dfbfff640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2de8078b90 0x7f2de807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.326+0000 7f2dfbfff640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2de8078b90 0x7f2de807b0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2df0033000 tx=0x7f2dfc06ffe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:18.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.330+0000 7f2df97fa640 1 -- 172.21.15.146:0/1161765523 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2dfc06d5a0 con 0x7f2de4004800 2024-09-17T03:35:18.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.540+0000 7f2e03007640 1 -- 172.21.15.146:0/1161765523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dfc15bda0 con 0x7f2de4004800 2024-09-17T03:35:18.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.540+0000 7f2df97fa640 1 -- 172.21.15.146:0/1161765523 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7f2dec06c020 con 0x7f2de4004800 2024-09-17T03:35:18.541 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:18.541 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":14,"btime":"2024-09-17T03:33:52:871238+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/699096289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":699096289},{"type":"v1","addr":"172.21.15.146:6834","nonce":699096289}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3576644376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3576644376},{"type":"v1","addr":"172.21.15.179:6837","nonce":3576644376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4852,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1904604031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1904604031},{"type":"v1","addr":"172.21.15.146:6835","nonce":1904604031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T03:33:41.014829+0000","modified":"2024-09-17T03:33:52.269693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4864":{"gid":4864,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/3055708361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3055708361},{"type":"v1","addr":"172.21.15.179:6836","nonce":3055708361}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4864,"qdb_cluster":[4864]},"id":2}]} 2024-09-17T03:35:18.541 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 14 2024-09-17T03:35:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 -- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2de8078b90 msgr2=0x7f2de807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2de8078b90 0x7f2de807b0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2df0033000 tx=0x7f2dfc06ffe0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 -- 172.21.15.146:0/1161765523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de4004800 msgr2=0x7f2dfc147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de4004800 0x7f2dfc147ff0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2dec011a80 tx=0x7f2dec011f40 comp rx=0 tx=0).stop 2024-09-17T03:35:18.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 -- 172.21.15.146:0/1161765523 shutdown_connections 2024-09-17T03:35:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2de8078b90 0x7f2de807b0a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dfc06cc50 0x7f2dfc06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dfc0aa510 0x7f2dfc0aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 --2- 172.21.15.146:0/1161765523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2de4004800 0x7f2dfc147ff0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 -- 172.21.15.146:0/1161765523 >> 172.21.15.146:0/1161765523 conn(0x7f2dfc0b3150 msgr2=0x7f2dfc075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 -- 172.21.15.146:0/1161765523 shutdown_connections 2024-09-17T03:35:18.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.543+0000 7f2e03007640 1 -- 172.21.15.146:0/1161765523 wait complete. 2024-09-17T03:35:18.554 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:18.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.666+0000 7f315130b640 1 -- 172.21.15.146:0/2809632649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f314c15c8e0 msgr2=0x7f314c06f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.666+0000 7f315130b640 1 --2- 172.21.15.146:0/2809632649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f314c15c8e0 0x7f314c06f580 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f314c0b45d0 tx=0x7f313c02a800 comp rx=0 tx=0).stop 2024-09-17T03:35:18.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.666+0000 7f315130b640 1 -- 172.21.15.146:0/2809632649 shutdown_connections 2024-09-17T03:35:18.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.666+0000 7f315130b640 1 --2- 172.21.15.146:0/2809632649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f314c15c8e0 0x7f314c06f580 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.666+0000 7f315130b640 1 -- 172.21.15.146:0/2809632649 >> 172.21.15.146:0/2809632649 conn(0x7f314c0b3150 msgr2=0x7f314c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:18.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.666+0000 7f315130b640 1 -- 172.21.15.146:0/2809632649 shutdown_connections 2024-09-17T03:35:18.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.666+0000 7f315130b640 1 -- 172.21.15.146:0/2809632649 wait complete. 2024-09-17T03:35:18.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.668+0000 7f315130b640 1 Processor -- start 2024-09-17T03:35:18.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.668+0000 7f315130b640 1 -- start start 2024-09-17T03:35:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.669+0000 7f315130b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f314c0cd840 0x7f314c13b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.669+0000 7f315130b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f314c0cdc50 0x7f314c13de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.669+0000 7f315130b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f314c15c8e0 0x7f314c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.669+0000 7f315130b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f314c073910 con 0x7f314c0cd840 2024-09-17T03:35:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.669+0000 7f315130b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f314c073790 con 0x7f314c0cdc50 2024-09-17T03:35:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.669+0000 7f315130b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f314c073a90 con 0x7f314c15c8e0 2024-09-17T03:35:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.669+0000 7f314affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f314c0cd840 0x7f314c13b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.669+0000 7f314affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f314c0cd840 0x7f314c13b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39554/0 (socket says 172.21.15.146:39554) 2024-09-17T03:35:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.669+0000 7f314affd640 1 -- 172.21.15.146:0/1424318247 learned_addr learned my addr 172.21.15.146:0/1424318247 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.669+0000 7f314a7fc640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f314c0cdc50 0x7f314c13de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.669+0000 7f314b7fe640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f314c15c8e0 0x7f314c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.670+0000 7f314affd640 1 -- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f314c15c8e0 msgr2=0x7f314c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.670+0000 7f314affd640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f314c15c8e0 0x7f314c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.670+0000 7f314affd640 1 -- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f314c0cdc50 msgr2=0x7f314c13de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.670+0000 7f314affd640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f314c0cdc50 0x7f314c13de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.670+0000 7f314affd640 1 -- 172.21.15.146:0/1424318247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314c155270 con 0x7f314c0cd840 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.670+0000 7f314affd640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f314c0cd840 0x7f314c13b720 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f313c009b30 tx=0x7f313c033f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.670+0000 7f31337fe640 1 -- 172.21.15.146:0/1424318247 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c042020 con 0x7f314c0cd840 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.670+0000 7f31337fe640 1 -- 172.21.15.146:0/1424318247 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f313c004330 con 0x7f314c0cd840 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.670+0000 7f315130b640 1 -- 172.21.15.146:0/1424318247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314c13e630 con 0x7f314c0cd840 2024-09-17T03:35:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.670+0000 7f31337fe640 1 -- 172.21.15.146:0/1424318247 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c037040 con 0x7f314c0cd840 2024-09-17T03:35:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.670+0000 7f315130b640 1 -- 172.21.15.146:0/1424318247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f314c13ebf0 con 0x7f314c0cd840 2024-09-17T03:35:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.671+0000 7f315130b640 1 -- 172.21.15.146:0/1424318247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f314c06f580 con 0x7f314c0cd840 2024-09-17T03:35:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.672+0000 7f31337fe640 1 -- 172.21.15.146:0/1424318247 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f313c045020 con 0x7f314c0cd840 2024-09-17T03:35:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.672+0000 7f31337fe640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3138078bc0 0x7f313807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.672+0000 7f31337fe640 1 -- 172.21.15.146:0/1424318247 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7f313c0bbab0 con 0x7f314c0cd840 2024-09-17T03:35:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.672+0000 7f314a7fc640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3138078bc0 0x7f313807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.673+0000 7f314a7fc640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3138078bc0 0x7f313807b0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f314c1f5bb0 tx=0x7f3140009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.677+0000 7f31337fe640 1 -- 172.21.15.146:0/1424318247 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f313c04c070 con 0x7f314c0cd840 2024-09-17T03:35:18.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.853+0000 7f315130b640 1 -- 172.21.15.146:0/1424318247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f314c0ce690 con 0x7f314c0cd840 2024-09-17T03:35:18.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.854+0000 7f31337fe640 1 -- 172.21.15.146:0/1424318247 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16842 (secure 0 0 0) 0x7f313c02f070 con 0x7f314c0cd840 2024-09-17T03:35:18.854 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:18.855 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":34,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:35:00.267957+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:33:38.670836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T03:33:39.971433+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":33,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.856+0000 7f315130b640 1 -- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3138078bc0 msgr2=0x7f313807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.856+0000 7f315130b640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3138078bc0 0x7f313807b0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f314c1f5bb0 tx=0x7f3140009060 comp rx=0 tx=0).stop 2024-09-17T03:35:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.856+0000 7f315130b640 1 -- 172.21.15.146:0/1424318247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f314c0cd840 msgr2=0x7f314c13b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.856+0000 7f315130b640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f314c0cd840 0x7f314c13b720 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f313c009b30 tx=0x7f313c033f00 comp rx=0 tx=0).stop 2024-09-17T03:35:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.856+0000 7f315130b640 1 -- 172.21.15.146:0/1424318247 shutdown_connections 2024-09-17T03:35:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.856+0000 7f315130b640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3138078bc0 0x7f313807b0d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.856+0000 7f315130b640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f314c15c8e0 0x7f314c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.856+0000 7f315130b640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f314c0cdc50 0x7f314c13de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.856+0000 7f315130b640 1 --2- 172.21.15.146:0/1424318247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f314c0cd840 0x7f314c13b720 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.856+0000 7f315130b640 1 -- 172.21.15.146:0/1424318247 >> 172.21.15.146:0/1424318247 conn(0x7f314c0b3150 msgr2=0x7f314c0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.857+0000 7f315130b640 1 -- 172.21.15.146:0/1424318247 shutdown_connections 2024-09-17T03:35:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.857+0000 7f315130b640 1 -- 172.21.15.146:0/1424318247 wait complete. 2024-09-17T03:35:18.868 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:35:18.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.981+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1531590361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e40b3d30 msgr2=0x7fe6e415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.981+0000 7fe6ebb94640 1 --2- 172.21.15.146:0/1531590361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e40b3d30 0x7fe6e415caa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc005fd0 tx=0x7fe6dc02aa90 comp rx=0 tx=0).stop 2024-09-17T03:35:18.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.981+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1531590361 shutdown_connections 2024-09-17T03:35:18.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.981+0000 7fe6ebb94640 1 --2- 172.21.15.146:0/1531590361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e40b3d30 0x7fe6e415caa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.981+0000 7fe6ebb94640 1 --2- 172.21.15.146:0/1531590361 >> v2:172.21.15.179:3300/0 conn(0x7fe6e40b5ce0 0x7fe6e40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.981+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1531590361 >> 172.21.15.146:0/1531590361 conn(0x7fe6e40b7b20 msgr2=0x7fe6e409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:18.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.981+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1531590361 shutdown_connections 2024-09-17T03:35:18.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.981+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1531590361 wait complete. 2024-09-17T03:35:18.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.983+0000 7fe6ebb94640 1 Processor -- start 2024-09-17T03:35:18.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.983+0000 7fe6ebb94640 1 -- start start 2024-09-17T03:35:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.984+0000 7fe6ebb94640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e40b5750 0x7fe6e4142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.984+0000 7fe6ebb94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e40b5ce0 0x7fe6e415fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.984+0000 7fe6ebb94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e413f8f0 0x7fe6e41540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.984+0000 7fe6ebb94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e415d420 con 0x7fe6e40b5ce0 2024-09-17T03:35:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.984+0000 7fe6ebb94640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e415d2a0 con 0x7fe6e413f8f0 2024-09-17T03:35:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.984+0000 7fe6ebb94640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e415d5a0 con 0x7fe6e40b5750 2024-09-17T03:35:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e912f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e40b5ce0 0x7fe6e415fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e912f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e40b5ce0 0x7fe6e415fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39560/0 (socket says 172.21.15.146:39560) 2024-09-17T03:35:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e912f640 1 -- 172.21.15.146:0/1466734795 learned_addr learned my addr 172.21.15.146:0/1466734795 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6ea131640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e413f8f0 0x7fe6e41540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e9930640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e40b5750 0x7fe6e4142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e912f640 1 -- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e40b5750 msgr2=0x7fe6e4142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e912f640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e40b5750 0x7fe6e4142b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e912f640 1 -- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e413f8f0 msgr2=0x7fe6e41540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e912f640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e413f8f0 0x7fe6e41540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e912f640 1 -- 172.21.15.146:0/1466734795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e41545f0 con 0x7fe6e40b5ce0 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6ea131640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e413f8f0 0x7fe6e41540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e912f640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e40b5ce0 0x7fe6e415fcb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800c370 tx=0x7fe6d800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e27fc640 1 -- 172.21.15.146:0/1466734795 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8017070 con 0x7fe6e40b5ce0 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e27fc640 1 -- 172.21.15.146:0/1466734795 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6d80053c0 con 0x7fe6e40b5ce0 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1466734795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e4152350 con 0x7fe6e40b5ce0 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6e27fc640 1 -- 172.21.15.146:0/1466734795 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8003850 con 0x7fe6e40b5ce0 2024-09-17T03:35:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.985+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1466734795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e4152910 con 0x7fe6e40b5ce0 2024-09-17T03:35:18.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.987+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1466734795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e415dac0 con 0x7fe6e40b5ce0 2024-09-17T03:35:18.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.987+0000 7fe6e27fc640 1 -- 172.21.15.146:0/1466734795 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe6d801a070 con 0x7fe6e40b5ce0 2024-09-17T03:35:18.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.988+0000 7fe6e27fc640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6d0078b90 0x7fe6d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:18.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.988+0000 7fe6e27fc640 1 -- 172.21.15.146:0/1466734795 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5737+0+0 (secure 0 0 0) 0x7fe6d809a080 con 0x7fe6e40b5ce0 2024-09-17T03:35:18.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.988+0000 7fe6e9930640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6d0078b90 0x7fe6d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:18.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.989+0000 7fe6e9930640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6d0078b90 0x7fe6d007b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009b30 tx=0x7fe6d4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:18.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:18.992+0000 7fe6e27fc640 1 -- 172.21.15.146:0/1466734795 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe6d8061dd0 con 0x7fe6e40b5ce0 2024-09-17T03:35:19.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.202+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1466734795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe6e4143080 con 0x7fe6e40b5ce0 2024-09-17T03:35:19.203 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:35:19.203+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:35:19.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.205+0000 7fe6e27fc640 1 -- 172.21.15.146:0/1466734795 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7fe6d8066800 con 0x7fe6e40b5ce0 2024-09-17T03:35:19.205 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:35:19.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.207+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6d0078b90 msgr2=0x7fe6d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:19.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.207+0000 7fe6ebb94640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6d0078b90 0x7fe6d007b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009b30 tx=0x7fe6d4005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:19.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.207+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1466734795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e40b5ce0 msgr2=0x7fe6e415fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:19.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.207+0000 7fe6ebb94640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e40b5ce0 0x7fe6e415fcb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800c370 tx=0x7fe6d800c830 comp rx=0 tx=0).stop 2024-09-17T03:35:19.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.207+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1466734795 shutdown_connections 2024-09-17T03:35:19.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.207+0000 7fe6ebb94640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6d0078b90 0x7fe6d007b0a0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009b30 tx=0x7fe6d4005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:19.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.207+0000 7fe6ebb94640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6e413f8f0 0x7fe6e41540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:19.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.207+0000 7fe6ebb94640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e40b5ce0 0x7fe6e415fcb0 secure :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800c370 tx=0x7fe6d800c830 comp rx=0 tx=0).stop 2024-09-17T03:35:19.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.207+0000 7fe6ebb94640 1 --2- 172.21.15.146:0/1466734795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e40b5750 0x7fe6e4142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:19.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.207+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1466734795 >> 172.21.15.146:0/1466734795 conn(0x7fe6e40b7b20 msgr2=0x7fe6e41560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:19.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.208+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1466734795 shutdown_connections 2024-09-17T03:35:19.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.208+0000 7fe6ebb94640 1 -- 172.21.15.146:0/1466734795 wait complete. 2024-09-17T03:35:19.219 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:35:19.277 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:35:19.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.336+0000 7f386e7c3640 1 -- 172.21.15.146:0/736517040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f386815f1a0 msgr2=0x7f38680cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:19.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.336+0000 7f386e7c3640 1 --2- 172.21.15.146:0/736517040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f386815f1a0 0x7f38680cfca0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f38680ba8e0 tx=0x7f385802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:35:19.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.336+0000 7f386e7c3640 1 -- 172.21.15.146:0/736517040 shutdown_connections 2024-09-17T03:35:19.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.336+0000 7f386e7c3640 1 --2- 172.21.15.146:0/736517040 >> v2:172.21.15.179:3300/0 conn(0x7f38680b61f0 0x7f38680b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:19.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.336+0000 7f386e7c3640 1 --2- 172.21.15.146:0/736517040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f386815f1a0 0x7f38680cfca0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:19.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.336+0000 7f386e7c3640 1 -- 172.21.15.146:0/736517040 >> 172.21.15.146:0/736517040 conn(0x7f38680d11f0 msgr2=0x7f38680d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:19.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.336+0000 7f386e7c3640 1 -- 172.21.15.146:0/736517040 shutdown_connections 2024-09-17T03:35:19.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.336+0000 7f386e7c3640 1 -- 172.21.15.146:0/736517040 wait complete. 2024-09-17T03:35:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.338+0000 7f386e7c3640 1 Processor -- start 2024-09-17T03:35:19.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.338+0000 7f386e7c3640 1 -- start start 2024-09-17T03:35:19.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.339+0000 7f386e7c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38680b61f0 0x7f386815a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:19.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.339+0000 7f386e7c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f386815f1a0 0x7f3868153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:19.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.339+0000 7f386e7c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38681631a0 0x7f38681f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:19.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386e7c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f38680695b0 con 0x7f38681631a0 2024-09-17T03:35:19.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386e7c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3868069430 con 0x7f386815f1a0 2024-09-17T03:35:19.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386e7c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3868069730 con 0x7f38680b61f0 2024-09-17T03:35:19.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386cd60640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38681631a0 0x7f38681f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:19.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f3867fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38680b61f0 0x7f386815a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386cd60640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38681631a0 0x7f38681f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39570/0 (socket says 172.21.15.146:39570) 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386cd60640 1 -- 172.21.15.146:0/1145264989 learned_addr learned my addr 172.21.15.146:0/1145264989 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f38677fe640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f386815f1a0 0x7f3868153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386cd60640 1 -- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38680b61f0 msgr2=0x7f386815a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386cd60640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38680b61f0 0x7f386815a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386cd60640 1 -- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f386815f1a0 msgr2=0x7f3868153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386cd60640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f386815f1a0 0x7f3868153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386cd60640 1 -- 172.21.15.146:0/1145264989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3868154240 con 0x7f38681631a0 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f386cd60640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38681631a0 0x7f38681f5880 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f386000cb00 tx=0x7f386000a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.340+0000 7f3864ff9640 1 -- 172.21.15.146:0/1145264989 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386000f450 con 0x7f38681631a0 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.341+0000 7f3864ff9640 1 -- 172.21.15.146:0/1145264989 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f386000f700 con 0x7f38681631a0 2024-09-17T03:35:19.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.341+0000 7f386e7c3640 1 -- 172.21.15.146:0/1145264989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38680cdff0 con 0x7f38681631a0 2024-09-17T03:35:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.341+0000 7f3864ff9640 1 -- 172.21.15.146:0/1145264989 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386000fb50 con 0x7f38681631a0 2024-09-17T03:35:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.341+0000 7f386e7c3640 1 -- 172.21.15.146:0/1145264989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38680ce5b0 con 0x7f38681631a0 2024-09-17T03:35:19.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.343+0000 7f386e7c3640 1 -- 172.21.15.146:0/1145264989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3868069be0 con 0x7f38681631a0 2024-09-17T03:35:19.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.344+0000 7f3864ff9640 1 -- 172.21.15.146:0/1145264989 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f386000fcf0 con 0x7f38681631a0 2024-09-17T03:35:19.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.345+0000 7f3864ff9640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3854078bc0 0x7f385407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:19.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.345+0000 7f3864ff9640 1 -- 172.21.15.146:0/1145264989 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f386009b660 con 0x7f38681631a0 2024-09-17T03:35:19.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.345+0000 7f3867fff640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3854078bc0 0x7f385407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:19.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.346+0000 7f3867fff640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3854078bc0 0x7f385407b0d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3858034000 tx=0x7f3858004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:19.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.350+0000 7f3864ff9640 1 -- 172.21.15.146:0/1145264989 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3868154240 con 0x7f38681631a0 2024-09-17T03:35:19.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:19.561+0000 7f386e7c3640 1 -- 172.21.15.146:0/1145264989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3868159d20 con 0x7f38681631a0 2024-09-17T03:35:20.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.206+0000 7f3864ff9640 1 -- 172.21.15.146:0/1145264989 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7f3860014030 con 0x7f38681631a0 2024-09-17T03:35:20.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 -- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3854078bc0 msgr2=0x7f385407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:20.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3854078bc0 0x7f385407b0d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3858034000 tx=0x7f3858004730 comp rx=0 tx=0).stop 2024-09-17T03:35:20.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 -- 172.21.15.146:0/1145264989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38681631a0 msgr2=0x7f38681f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:20.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38681631a0 0x7f38681f5880 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f386000cb00 tx=0x7f386000a250 comp rx=0 tx=0).stop 2024-09-17T03:35:20.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 -- 172.21.15.146:0/1145264989 shutdown_connections 2024-09-17T03:35:20.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3854078bc0 0x7f385407b0d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:20.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38681631a0 0x7f38681f5880 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:20.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f386815f1a0 0x7f3868153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:20.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 --2- 172.21.15.146:0/1145264989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38680b61f0 0x7f386815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:20.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 -- 172.21.15.146:0/1145264989 >> 172.21.15.146:0/1145264989 conn(0x7f38680d11f0 msgr2=0x7f38680d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:20.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 -- 172.21.15.146:0/1145264989 shutdown_connections 2024-09-17T03:35:20.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.210+0000 7f386e7c3640 1 -- 172.21.15.146:0/1145264989 wait complete. 2024-09-17T03:35:20.223 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:35:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.345+0000 7fd44197b640 1 -- 172.21.15.146:0/2255345860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43c0b61f0 msgr2=0x7fd43c0b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.345+0000 7fd44197b640 1 --2- 172.21.15.146:0/2255345860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43c0b61f0 0x7fd43c0b6600 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd434005fd0 tx=0x7fd43402aa10 comp rx=0 tx=0).stop 2024-09-17T03:35:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.345+0000 7fd44197b640 1 -- 172.21.15.146:0/2255345860 shutdown_connections 2024-09-17T03:35:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.345+0000 7fd44197b640 1 --2- 172.21.15.146:0/2255345860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43c0b61f0 0x7fd43c0b6600 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.345+0000 7fd44197b640 1 --2- 172.21.15.146:0/2255345860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43c0cfca0 0x7fd43c0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.345+0000 7fd44197b640 1 -- 172.21.15.146:0/2255345860 >> 172.21.15.146:0/2255345860 conn(0x7fd43c0d11f0 msgr2=0x7fd43c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.345+0000 7fd44197b640 1 -- 172.21.15.146:0/2255345860 shutdown_connections 2024-09-17T03:35:20.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.345+0000 7fd44197b640 1 -- 172.21.15.146:0/2255345860 wait complete. 2024-09-17T03:35:20.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.347+0000 7fd44197b640 1 Processor -- start 2024-09-17T03:35:20.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.347+0000 7fd44197b640 1 -- start start 2024-09-17T03:35:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd44197b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43c0b61f0 0x7fd43c0b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd44197b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43c0cfca0 0x7fd43c1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd44197b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd43c15f1a0 0x7fd43c0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd44197b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c0695b0 con 0x7fd43c0b61f0 2024-09-17T03:35:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd44197b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c069430 con 0x7fd43c15f1a0 2024-09-17T03:35:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd44197b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd43c069730 con 0x7fd43c0cfca0 2024-09-17T03:35:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd43affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43c0b61f0 0x7fd43c0b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd43affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43c0b61f0 0x7fd43c0b83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39586/0 (socket says 172.21.15.146:39586) 2024-09-17T03:35:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd43affd640 1 -- 172.21.15.146:0/1348748132 learned_addr learned my addr 172.21.15.146:0/1348748132 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd433fff640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43c0cfca0 0x7fd43c1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:20.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd43b7fe640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd43c15f1a0 0x7fd43c0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd43affd640 1 -- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43c0cfca0 msgr2=0x7fd43c1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd43affd640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43c0cfca0 0x7fd43c1568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd43affd640 1 -- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd43c15f1a0 msgr2=0x7fd43c0cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd43affd640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd43c15f1a0 0x7fd43c0cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd43affd640 1 -- 172.21.15.146:0/1348748132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c0cdd20 con 0x7fd43c0b61f0 2024-09-17T03:35:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd43affd640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43c0b61f0 0x7fd43c0b83f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00c3a0 tx=0x7fd42c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd438ff9640 1 -- 172.21.15.146:0/1348748132 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c017070 con 0x7fd43c0b61f0 2024-09-17T03:35:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd438ff9640 1 -- 172.21.15.146:0/1348748132 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd42c0053c0 con 0x7fd43c0b61f0 2024-09-17T03:35:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd438ff9640 1 -- 172.21.15.146:0/1348748132 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c003850 con 0x7fd43c0b61f0 2024-09-17T03:35:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd44197b640 1 -- 172.21.15.146:0/1348748132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43c0ce1c0 con 0x7fd43c0b61f0 2024-09-17T03:35:20.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.349+0000 7fd44197b640 1 -- 172.21.15.146:0/1348748132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43c0cbbc0 con 0x7fd43c0b61f0 2024-09-17T03:35:20.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.350+0000 7fd44197b640 1 -- 172.21.15.146:0/1348748132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd43c069c50 con 0x7fd43c0b61f0 2024-09-17T03:35:20.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.351+0000 7fd438ff9640 1 -- 172.21.15.146:0/1348748132 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd42c01a070 con 0x7fd43c0b61f0 2024-09-17T03:35:20.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.351+0000 7fd438ff9640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd41c078b90 0x7fd41c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:20.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.352+0000 7fd438ff9640 1 -- 172.21.15.146:0/1348748132 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fd42c099fd0 con 0x7fd43c0b61f0 2024-09-17T03:35:20.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.352+0000 7fd433fff640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd41c078b90 0x7fd41c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:20.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.352+0000 7fd433fff640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd41c078b90 0x7fd41c07b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd43c15e7b0 tx=0x7fd42400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.356+0000 7fd438ff9640 1 -- 172.21.15.146:0/1348748132 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd43c0b6b40 con 0x7fd43c0b61f0 2024-09-17T03:35:20.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:20.534+0000 7fd44197b640 1 -- 172.21.15.146:0/1348748132 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd43c0c7ff0 con 0x7fd43c0b61f0 2024-09-17T03:35:21.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.309+0000 7fd438ff9640 1 -- 172.21.15.146:0/1348748132 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7fd42c061df0 con 0x7fd43c0b61f0 2024-09-17T03:35:21.310 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:35:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.312+0000 7fd44197b640 1 -- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd41c078b90 msgr2=0x7fd41c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.312+0000 7fd44197b640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd41c078b90 0x7fd41c07b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd43c15e7b0 tx=0x7fd42400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:35:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.312+0000 7fd44197b640 1 -- 172.21.15.146:0/1348748132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43c0b61f0 msgr2=0x7fd43c0b83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.312+0000 7fd44197b640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43c0b61f0 0x7fd43c0b83f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00c3a0 tx=0x7fd42c00c860 comp rx=0 tx=0).stop 2024-09-17T03:35:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.312+0000 7fd44197b640 1 -- 172.21.15.146:0/1348748132 shutdown_connections 2024-09-17T03:35:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.312+0000 7fd44197b640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd41c078b90 0x7fd41c07b0a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.312+0000 7fd44197b640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd43c15f1a0 0x7fd43c0cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.312+0000 7fd44197b640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43c0cfca0 0x7fd43c1568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.312+0000 7fd44197b640 1 --2- 172.21.15.146:0/1348748132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43c0b61f0 0x7fd43c0b83f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:21.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.312+0000 7fd44197b640 1 -- 172.21.15.146:0/1348748132 >> 172.21.15.146:0/1348748132 conn(0x7fd43c0d11f0 msgr2=0x7fd43c0b7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:21.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.313+0000 7fd44197b640 1 -- 172.21.15.146:0/1348748132 shutdown_connections 2024-09-17T03:35:21.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.313+0000 7fd44197b640 1 -- 172.21.15.146:0/1348748132 wait complete. 2024-09-17T03:35:21.326 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:35:21.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.445+0000 7fd3f5864640 1 -- 172.21.15.146:0/3358913915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f015f1a0 msgr2=0x7fd3f00cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:21.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.445+0000 7fd3f5864640 1 --2- 172.21.15.146:0/3358913915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f015f1a0 0x7fd3f00cfca0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0068f10 tx=0x7fd3e802a510 comp rx=0 tx=0).stop 2024-09-17T03:35:21.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.445+0000 7fd3f5864640 1 -- 172.21.15.146:0/3358913915 shutdown_connections 2024-09-17T03:35:21.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.445+0000 7fd3f5864640 1 --2- 172.21.15.146:0/3358913915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f015f1a0 0x7fd3f00cfca0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:21.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.445+0000 7fd3f5864640 1 -- 172.21.15.146:0/3358913915 >> 172.21.15.146:0/3358913915 conn(0x7fd3f00d11f0 msgr2=0x7fd3f00d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:21.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.445+0000 7fd3f5864640 1 -- 172.21.15.146:0/3358913915 shutdown_connections 2024-09-17T03:35:21.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.445+0000 7fd3f5864640 1 -- 172.21.15.146:0/3358913915 wait complete. 2024-09-17T03:35:21.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.447+0000 7fd3f5864640 1 Processor -- start 2024-09-17T03:35:21.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.447+0000 7fd3f5864640 1 -- start start 2024-09-17T03:35:21.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3f5864640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f00b61f0 0x7fd3f01563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:21.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3f5864640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f015f1a0 0x7fd3f0154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:21.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3f5864640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3f01631a0 0x7fd3f0157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:21.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3f5864640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f00695e0 con 0x7fd3f015f1a0 2024-09-17T03:35:21.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3f5864640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f0069460 con 0x7fd3f01631a0 2024-09-17T03:35:21.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3f5864640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f0069760 con 0x7fd3f00b61f0 2024-09-17T03:35:21.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3ee7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f015f1a0 0x7fd3f0154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:21.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3ee7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f015f1a0 0x7fd3f0154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39608/0 (socket says 172.21.15.146:39608) 2024-09-17T03:35:21.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3ee7fc640 1 -- 172.21.15.146:0/4161191714 learned_addr learned my addr 172.21.15.146:0/4161191714 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:21.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3eeffd640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f00b61f0 0x7fd3f01563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3ef7fe640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3f01631a0 0x7fd3f0157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3ee7fc640 1 -- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f00b61f0 msgr2=0x7fd3f01563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3ee7fc640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f00b61f0 0x7fd3f01563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3ee7fc640 1 -- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3f01631a0 msgr2=0x7fd3f0157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.448+0000 7fd3ee7fc640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3f01631a0 0x7fd3f0157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.449+0000 7fd3ee7fc640 1 -- 172.21.15.146:0/4161191714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f00ce670 con 0x7fd3f015f1a0 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.449+0000 7fd3eeffd640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f00b61f0 0x7fd3f01563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.449+0000 7fd3ee7fc640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f015f1a0 0x7fd3f0154d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c430 tx=0x7fd3d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.449+0000 7fd3e7fff640 1 -- 172.21.15.146:0/4161191714 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8011790 con 0x7fd3f015f1a0 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.449+0000 7fd3e7fff640 1 -- 172.21.15.146:0/4161191714 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3d8017070 con 0x7fd3f015f1a0 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.449+0000 7fd3f5864640 1 -- 172.21.15.146:0/4161191714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f00b9460 con 0x7fd3f015f1a0 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.449+0000 7fd3e7fff640 1 -- 172.21.15.146:0/4161191714 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8011ca0 con 0x7fd3f015f1a0 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.449+0000 7fd3f5864640 1 -- 172.21.15.146:0/4161191714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f00b9a20 con 0x7fd3f015f1a0 2024-09-17T03:35:21.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.450+0000 7fd3f5864640 1 -- 172.21.15.146:0/4161191714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f00ce3d0 con 0x7fd3f015f1a0 2024-09-17T03:35:21.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.451+0000 7fd3e7fff640 1 -- 172.21.15.146:0/4161191714 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3d801c460 con 0x7fd3f015f1a0 2024-09-17T03:35:21.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.451+0000 7fd3e7fff640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd3d0078b90 0x7fd3d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:21.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.451+0000 7fd3e7fff640 1 -- 172.21.15.146:0/4161191714 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7fd3d809a9f0 con 0x7fd3f015f1a0 2024-09-17T03:35:21.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.451+0000 7fd3eeffd640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd3d0078b90 0x7fd3d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:21.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.452+0000 7fd3eeffd640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd3d0078b90 0x7fd3d007b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8034000 tx=0x7fd3e8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:21.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.456+0000 7fd3e7fff640 1 -- 172.21.15.146:0/4161191714 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd3f00ce3d0 con 0x7fd3f015f1a0 2024-09-17T03:35:21.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:21.634+0000 7fd3f5864640 1 -- 172.21.15.146:0/4161191714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd3f0069c10 con 0x7fd3f015f1a0 2024-09-17T03:35:22.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.323+0000 7fd3e7fff640 1 -- 172.21.15.146:0/4161191714 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7fd3d8062f90 con 0x7fd3f015f1a0 2024-09-17T03:35:22.324 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:35:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.327+0000 7fd3f5864640 1 -- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd3d0078b90 msgr2=0x7fd3d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.327+0000 7fd3f5864640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd3d0078b90 0x7fd3d007b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8034000 tx=0x7fd3e8004730 comp rx=0 tx=0).stop 2024-09-17T03:35:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.327+0000 7fd3f5864640 1 -- 172.21.15.146:0/4161191714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f015f1a0 msgr2=0x7fd3f0154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.328+0000 7fd3f5864640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f015f1a0 0x7fd3f0154d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c430 tx=0x7fd3d800c8f0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.328+0000 7fd3f5864640 1 -- 172.21.15.146:0/4161191714 shutdown_connections 2024-09-17T03:35:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.328+0000 7fd3f5864640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd3d0078b90 0x7fd3d007b0a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.328+0000 7fd3f5864640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd3f01631a0 0x7fd3f0157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.328+0000 7fd3f5864640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3f015f1a0 0x7fd3f0154d80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.328+0000 7fd3f5864640 1 --2- 172.21.15.146:0/4161191714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd3f00b61f0 0x7fd3f01563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.328+0000 7fd3f5864640 1 -- 172.21.15.146:0/4161191714 >> 172.21.15.146:0/4161191714 conn(0x7fd3f00d11f0 msgr2=0x7fd3f01ec900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:22.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.328+0000 7fd3f5864640 1 -- 172.21.15.146:0/4161191714 shutdown_connections 2024-09-17T03:35:22.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.328+0000 7fd3f5864640 1 -- 172.21.15.146:0/4161191714 wait complete. 2024-09-17T03:35:22.344 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:35:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.470+0000 7fd6408c5640 1 -- 172.21.15.146:0/1953671437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd63c15b770 msgr2=0x7fd63c06fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.470+0000 7fd6408c5640 1 --2- 172.21.15.146:0/1953671437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd63c15b770 0x7fd63c06fe10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd63c073c00 tx=0x7fd62c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.470+0000 7fd6408c5640 1 -- 172.21.15.146:0/1953671437 shutdown_connections 2024-09-17T03:35:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.470+0000 7fd6408c5640 1 --2- 172.21.15.146:0/1953671437 >> v2:172.21.15.179:3300/0 conn(0x7fd63c070350 0x7fd63c072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.470+0000 7fd6408c5640 1 --2- 172.21.15.146:0/1953671437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd63c15b770 0x7fd63c06fe10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.470+0000 7fd6408c5640 1 -- 172.21.15.146:0/1953671437 >> 172.21.15.146:0/1953671437 conn(0x7fd63c0b2060 msgr2=0x7fd63c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.471+0000 7fd6408c5640 1 -- 172.21.15.146:0/1953671437 shutdown_connections 2024-09-17T03:35:22.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.471+0000 7fd6408c5640 1 -- 172.21.15.146:0/1953671437 wait complete. 2024-09-17T03:35:22.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.472+0000 7fd6408c5640 1 Processor -- start 2024-09-17T03:35:22.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.472+0000 7fd6408c5640 1 -- start start 2024-09-17T03:35:22.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd6408c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd63c070350 0x7fd63c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:22.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd6408c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd63c072bc0 0x7fd63c1f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:22.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd6408c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c15b770 0x7fd63c1f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:22.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd6408c5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd63c15f9f0 con 0x7fd63c070350 2024-09-17T03:35:22.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd6408c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd63c0b5590 con 0x7fd63c15b770 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd6408c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd63c15fb70 con 0x7fd63c072bc0 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd63a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd63c070350 0x7fd63c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd63a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd63c070350 0x7fd63c15de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39628/0 (socket says 172.21.15.146:39628) 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd63a59c640 1 -- 172.21.15.146:0/228509259 learned_addr learned my addr 172.21.15.146:0/228509259 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd639d9b640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd63c072bc0 0x7fd63c1f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd63ad9d640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c15b770 0x7fd63c1f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd63a59c640 1 -- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd63c072bc0 msgr2=0x7fd63c1f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd63a59c640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd63c072bc0 0x7fd63c1f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd63a59c640 1 -- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c15b770 msgr2=0x7fd63c1f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd63a59c640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c15b770 0x7fd63c1f3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd63a59c640 1 -- 172.21.15.146:0/228509259 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63c15e340 con 0x7fd63c070350 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd63a59c640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd63c070350 0x7fd63c15de00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0099c0 tx=0x7fd62c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd62affd640 1 -- 172.21.15.146:0/228509259 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c03e030 con 0x7fd63c070350 2024-09-17T03:35:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.474+0000 7fd62affd640 1 -- 172.21.15.146:0/228509259 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd62c0047a0 con 0x7fd63c070350 2024-09-17T03:35:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.475+0000 7fd6408c5640 1 -- 172.21.15.146:0/228509259 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd63c1f46e0 con 0x7fd63c070350 2024-09-17T03:35:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.475+0000 7fd62affd640 1 -- 172.21.15.146:0/228509259 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c035040 con 0x7fd63c070350 2024-09-17T03:35:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.475+0000 7fd6408c5640 1 -- 172.21.15.146:0/228509259 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd63c15d320 con 0x7fd63c070350 2024-09-17T03:35:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.475+0000 7fd6408c5640 1 -- 172.21.15.146:0/228509259 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd63c072680 con 0x7fd63c070350 2024-09-17T03:35:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.476+0000 7fd62affd640 1 -- 172.21.15.146:0/228509259 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd62c041030 con 0x7fd63c070350 2024-09-17T03:35:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.477+0000 7fd62affd640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd61c078b90 0x7fd61c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.477+0000 7fd62affd640 1 -- 172.21.15.146:0/228509259 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd62c0bb300 con 0x7fd63c070350 2024-09-17T03:35:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.477+0000 7fd639d9b640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd61c078b90 0x7fd61c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.478+0000 7fd639d9b640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd61c078b90 0x7fd61c07b0a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd630006fd0 tx=0x7fd630008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.481+0000 7fd62affd640 1 -- 172.21.15.146:0/228509259 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd63c15bb80 con 0x7fd63c070350 2024-09-17T03:35:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.658+0000 7fd6408c5640 1 -- 172.21.15.146:0/228509259 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fd63c158ab0 con 0x7fd63c070350 2024-09-17T03:35:22.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.662+0000 7fd62affd640 1 -- 172.21.15.146:0/228509259 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7fd62c083ad0 con 0x7fd63c070350 2024-09-17T03:35:22.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 -- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd61c078b90 msgr2=0x7fd61c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:22.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd61c078b90 0x7fd61c07b0a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd630006fd0 tx=0x7fd630008040 comp rx=0 tx=0).stop 2024-09-17T03:35:22.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 -- 172.21.15.146:0/228509259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd63c070350 msgr2=0x7fd63c15de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:22.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd63c070350 0x7fd63c15de00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0099c0 tx=0x7fd62c0039e0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 -- 172.21.15.146:0/228509259 shutdown_connections 2024-09-17T03:35:22.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd61c078b90 0x7fd61c07b0a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd63c15b770 0x7fd63c1f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd63c072bc0 0x7fd63c1f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 --2- 172.21.15.146:0/228509259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd63c070350 0x7fd63c15de00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 -- 172.21.15.146:0/228509259 >> 172.21.15.146:0/228509259 conn(0x7fd63c0b2060 msgr2=0x7fd63c0cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:22.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 -- 172.21.15.146:0/228509259 shutdown_connections 2024-09-17T03:35:22.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.664+0000 7fd6408c5640 1 -- 172.21.15.146:0/228509259 wait complete. 2024-09-17T03:35:22.675 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-17T03:35:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.790+0000 7f9629b39640 1 -- 172.21.15.146:0/4038868262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f960c003fd0 msgr2=0x7f960c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.790+0000 7f9629b39640 1 --2- 172.21.15.146:0/4038868262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f960c003fd0 0x7f960c004800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f96240b0940 tx=0x7f960c005830 comp rx=0 tx=0).stop 2024-09-17T03:35:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.790+0000 7f9623fff640 1 -- 172.21.15.146:0/4038868262 reap_dead start 2024-09-17T03:35:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.790+0000 7f9629b39640 1 -- 172.21.15.146:0/4038868262 shutdown_connections 2024-09-17T03:35:22.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.790+0000 7f9629b39640 1 -- 172.21.15.146:0/4038868262 >> 172.21.15.146:0/4038868262 conn(0x7f96240d0c50 msgr2=0x7f96240d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.790+0000 7f9629b39640 1 -- 172.21.15.146:0/4038868262 shutdown_connections 2024-09-17T03:35:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.790+0000 7f9629b39640 1 -- 172.21.15.146:0/4038868262 wait complete. 2024-09-17T03:35:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.792+0000 7f9629b39640 1 Processor -- start 2024-09-17T03:35:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.792+0000 7f9629b39640 1 -- start start 2024-09-17T03:35:22.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.793+0000 7f9629b39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f960c003fd0 0x7f962415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:22.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.793+0000 7f9629b39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96241f7ac0 0x7f962409e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:22.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.793+0000 7f9629b39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9624151d10 0x7f9624154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.793+0000 7f9629b39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f962415bfd0 con 0x7f960c003fd0 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.793+0000 7f9629b39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f962415be50 con 0x7f9624151d10 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.793+0000 7f9629b39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f96240add50 con 0x7f96241f7ac0 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.793+0000 7f96237fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f960c003fd0 0x7f962415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.793+0000 7f96237fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f960c003fd0 0x7f962415d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39642/0 (socket says 172.21.15.146:39642) 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.793+0000 7f96237fe640 1 -- 172.21.15.146:0/2983676387 learned_addr learned my addr 172.21.15.146:0/2983676387 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.793+0000 7f9622ffd640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96241f7ac0 0x7f962409e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.793+0000 7f9623fff640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9624151d10 0x7f9624154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f96237fe640 1 -- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96241f7ac0 msgr2=0x7f962409e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f96237fe640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96241f7ac0 0x7f962409e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f96237fe640 1 -- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9624151d10 msgr2=0x7f9624154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f96237fe640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9624151d10 0x7f9624154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f96237fe640 1 -- 172.21.15.146:0/2983676387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962415de00 con 0x7f960c003fd0 2024-09-17T03:35:22.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f9623fff640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9624151d10 0x7f9624154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:22.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f96237fe640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f960c003fd0 0x7f962415d5b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9614011ae0 tx=0x7f9614009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:22.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f960bfff640 1 -- 172.21.15.146:0/2983676387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961401e070 con 0x7f960c003fd0 2024-09-17T03:35:22.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f960bfff640 1 -- 172.21.15.146:0/2983676387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f961400fc10 con 0x7f960c003fd0 2024-09-17T03:35:22.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f9629b39640 1 -- 172.21.15.146:0/2983676387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f962409d4c0 con 0x7f960c003fd0 2024-09-17T03:35:22.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f960bfff640 1 -- 172.21.15.146:0/2983676387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614019410 con 0x7f960c003fd0 2024-09-17T03:35:22.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.794+0000 7f9629b39640 1 -- 172.21.15.146:0/2983676387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f962409da80 con 0x7f960c003fd0 2024-09-17T03:35:22.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.795+0000 7f9629b39640 1 -- 172.21.15.146:0/2983676387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96240b5360 con 0x7f960c003fd0 2024-09-17T03:35:22.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.796+0000 7f960bfff640 1 -- 172.21.15.146:0/2983676387 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9614021070 con 0x7f960c003fd0 2024-09-17T03:35:22.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.796+0000 7f960bfff640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9610078b90 0x7f961007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:22.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.796+0000 7f960bfff640 1 -- 172.21.15.146:0/2983676387 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f961409b160 con 0x7f960c003fd0 2024-09-17T03:35:22.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.796+0000 7f9622ffd640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9610078b90 0x7f961007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:22.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.797+0000 7f9622ffd640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9610078b90 0x7f961007b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9618033000 tx=0x7f96240b6050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:22.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:22.801+0000 7f960bfff640 1 -- 172.21.15.146:0/2983676387 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f96140632e0 con 0x7f960c003fd0 2024-09-17T03:35:23.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.040+0000 7f9629b39640 1 -- 172.21.15.146:0/2983676387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f96241599c0 con 0x7f960c003fd0 2024-09-17T03:35:23.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.325+0000 7f960bfff640 1 -- 172.21.15.146:0/2983676387 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v120) ==== 148+0+0 (secure 0 0 0) 0x7f9614067d10 con 0x7f960c003fd0 2024-09-17T03:35:23.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 -- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9610078b90 msgr2=0x7f961007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9610078b90 0x7f961007b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9618033000 tx=0x7f96240b6050 comp rx=0 tx=0).stop 2024-09-17T03:35:23.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 -- 172.21.15.146:0/2983676387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f960c003fd0 msgr2=0x7f962415d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f960c003fd0 0x7f962415d5b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9614011ae0 tx=0x7f9614009e60 comp rx=0 tx=0).stop 2024-09-17T03:35:23.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 -- 172.21.15.146:0/2983676387 shutdown_connections 2024-09-17T03:35:23.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9610078b90 0x7f961007b0a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9624151d10 0x7f9624154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96241f7ac0 0x7f962409e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 --2- 172.21.15.146:0/2983676387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f960c003fd0 0x7f962415d5b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 -- 172.21.15.146:0/2983676387 >> 172.21.15.146:0/2983676387 conn(0x7f96240d0c50 msgr2=0x7f96240b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:23.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 -- 172.21.15.146:0/2983676387 shutdown_connections 2024-09-17T03:35:23.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.327+0000 7f9629b39640 1 -- 172.21.15.146:0/2983676387 wait complete. 2024-09-17T03:35:23.338 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-09-17T03:35:23.339 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T03:35:23.339 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:23.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.451+0000 7f364b332640 1 -- 172.21.15.146:0/1675546495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36440b5ce0 msgr2=0x7f36440b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.451+0000 7f364b332640 1 --2- 172.21.15.146:0/1675546495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36440b5ce0 0x7f36440b1320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3640009830 tx=0x7f364002a510 comp rx=0 tx=0).stop 2024-09-17T03:35:23.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.451+0000 7f364b332640 1 -- 172.21.15.146:0/1675546495 shutdown_connections 2024-09-17T03:35:23.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.451+0000 7f364b332640 1 --2- 172.21.15.146:0/1675546495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36440b3d30 0x7f364415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.451+0000 7f364b332640 1 --2- 172.21.15.146:0/1675546495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36440b5ce0 0x7f36440b1320 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.451+0000 7f364b332640 1 -- 172.21.15.146:0/1675546495 >> 172.21.15.146:0/1675546495 conn(0x7f36440b7b20 msgr2=0x7f364409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:23.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.451+0000 7f364b332640 1 -- 172.21.15.146:0/1675546495 shutdown_connections 2024-09-17T03:35:23.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.451+0000 7f364b332640 1 -- 172.21.15.146:0/1675546495 wait complete. 2024-09-17T03:35:23.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.453+0000 7f364b332640 1 Processor -- start 2024-09-17T03:35:23.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.453+0000 7f364b332640 1 -- start start 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.454+0000 7f364b332640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36440b5750 0x7f364413f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.454+0000 7f364b332640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36440b5ce0 0x7f364413eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f364b332640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3644150560 0x7f36441e5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f364b332640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f364415d4b0 con 0x7f36440b5750 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f364b332640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f364415d330 con 0x7f36440b5ce0 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f364b332640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f364415d630 con 0x7f3644150560 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36490ce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36440b5750 0x7f364413f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36490ce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36440b5750 0x7f364413f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39656/0 (socket says 172.21.15.146:39656) 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36490ce640 1 -- 172.21.15.146:0/4070716510 learned_addr learned my addr 172.21.15.146:0/4070716510 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36498cf640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3644150560 0x7f36441e5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36488cd640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36440b5ce0 0x7f364413eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36490ce640 1 -- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3644150560 msgr2=0x7f36441e5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36490ce640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3644150560 0x7f36441e5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36490ce640 1 -- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36440b5ce0 msgr2=0x7f364413eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36490ce640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36440b5ce0 0x7f364413eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36490ce640 1 -- 172.21.15.146:0/4070716510 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36441e51b0 con 0x7f36440b5750 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36488cd640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36440b5ce0 0x7f364413eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36498cf640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3644150560 0x7f36441e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f36490ce640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36440b5750 0x7f364413f480 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3640009950 tx=0x7f3640033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f3639ffb640 1 -- 172.21.15.146:0/4070716510 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640005c90 con 0x7f36440b5750 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f364b332640 1 -- 172.21.15.146:0/4070716510 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36441e5490 con 0x7f36440b5750 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f3639ffb640 1 -- 172.21.15.146:0/4070716510 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3640031e50 con 0x7f36440b5750 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.455+0000 7f3639ffb640 1 -- 172.21.15.146:0/4070716510 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640005260 con 0x7f36440b5750 2024-09-17T03:35:23.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.456+0000 7f364b332640 1 -- 172.21.15.146:0/4070716510 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36441e5a50 con 0x7f36440b5750 2024-09-17T03:35:23.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.457+0000 7f364b332640 1 -- 172.21.15.146:0/4070716510 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f364415ecd0 con 0x7f36440b5750 2024-09-17T03:35:23.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.457+0000 7f3639ffb640 1 -- 172.21.15.146:0/4070716510 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3640005400 con 0x7f36440b5750 2024-09-17T03:35:23.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.458+0000 7f3639ffb640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3628078bc0 0x7f362807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:23.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.458+0000 7f3639ffb640 1 -- 172.21.15.146:0/4070716510 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f36400bbaf0 con 0x7f36440b5750 2024-09-17T03:35:23.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.458+0000 7f36488cd640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3628078bc0 0x7f362807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:23.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.459+0000 7f36488cd640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3628078bc0 0x7f362807b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3634007a50 tx=0x7f3634009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:23.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.462+0000 7f3639ffb640 1 -- 172.21.15.146:0/4070716510 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f364003f030 con 0x7f36440b5750 2024-09-17T03:35:23.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.636+0000 7f364b332640 1 -- 172.21.15.146:0/4070716510 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3644050f60 con 0x7f36440b5750 2024-09-17T03:35:23.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.637+0000 7f3639ffb640 1 -- 172.21.15.146:0/4070716510 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13082 (secure 0 0 0) 0x7f3640084240 con 0x7f36440b5750 2024-09-17T03:35:23.637 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:23.638 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":37,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:35:22.316889+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6836/3055708361":"2024-09-18T03:35:19.204630+0000","172.21.15.179:6834/3055708361":"2024-09-18T03:35:19.204630+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:23.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.639+0000 7f364b332640 1 -- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3628078bc0 msgr2=0x7f362807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.639+0000 7f364b332640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3628078bc0 0x7f362807b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3634007a50 tx=0x7f3634009040 comp rx=0 tx=0).stop 2024-09-17T03:35:23.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.639+0000 7f364b332640 1 -- 172.21.15.146:0/4070716510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36440b5750 msgr2=0x7f364413f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.639+0000 7f364b332640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36440b5750 0x7f364413f480 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3640009950 tx=0x7f3640033c20 comp rx=0 tx=0).stop 2024-09-17T03:35:23.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.639+0000 7f364b332640 1 -- 172.21.15.146:0/4070716510 shutdown_connections 2024-09-17T03:35:23.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.639+0000 7f364b332640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3628078bc0 0x7f362807b0d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.639+0000 7f364b332640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3644150560 0x7f36441e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.639+0000 7f364b332640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36440b5ce0 0x7f364413eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.639+0000 7f364b332640 1 --2- 172.21.15.146:0/4070716510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36440b5750 0x7f364413f480 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.639+0000 7f364b332640 1 -- 172.21.15.146:0/4070716510 >> 172.21.15.146:0/4070716510 conn(0x7f36440b7b20 msgr2=0x7f36440b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:23.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.640+0000 7f364b332640 1 -- 172.21.15.146:0/4070716510 shutdown_connections 2024-09-17T03:35:23.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.640+0000 7f364b332640 1 -- 172.21.15.146:0/4070716510 wait complete. 2024-09-17T03:35:23.651 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:35:23.651 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:35:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.768+0000 7f877cc27640 1 -- 172.21.15.146:0/3418911046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f877806f440 msgr2=0x7f87780d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.768+0000 7f877cc27640 1 --2- 172.21.15.146:0/3418911046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f877806f440 0x7f87780d3190 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f87780b73c0 tx=0x7f877002aa30 comp rx=0 tx=0).stop 2024-09-17T03:35:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.768+0000 7f877cc27640 1 -- 172.21.15.146:0/3418911046 shutdown_connections 2024-09-17T03:35:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.768+0000 7f877cc27640 1 --2- 172.21.15.146:0/3418911046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f877806f440 0x7f87780d3190 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.768+0000 7f877cc27640 1 --2- 172.21.15.146:0/3418911046 >> v2:172.21.15.179:3300/0 conn(0x7f87780b3870 0x7f87780cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.768+0000 7f877cc27640 1 -- 172.21.15.146:0/3418911046 >> 172.21.15.146:0/3418911046 conn(0x7f87780d4be0 msgr2=0x7f87780d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.768+0000 7f877cc27640 1 -- 172.21.15.146:0/3418911046 shutdown_connections 2024-09-17T03:35:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.768+0000 7f877cc27640 1 -- 172.21.15.146:0/3418911046 wait complete. 2024-09-17T03:35:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.770+0000 7f877cc27640 1 Processor -- start 2024-09-17T03:35:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.770+0000 7f877cc27640 1 -- start start 2024-09-17T03:35:23.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.771+0000 7f877cc27640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87780b3870 0x7f87781e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:23.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.771+0000 7f877cc27640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87781620f0 0x7f877814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:23.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.771+0000 7f877cc27640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87780c7ea0 0x7f87780c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:23.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.771+0000 7f877cc27640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f87780d3a60 con 0x7f87780b3870 2024-09-17T03:35:23.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.771+0000 7f877cc27640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f87780d38e0 con 0x7f87780c7ea0 2024-09-17T03:35:23.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.771+0000 7f877cc27640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f87780d3be0 con 0x7f87781620f0 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f877659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87780b3870 0x7f87781e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f877659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87780b3870 0x7f87781e94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39672/0 (socket says 172.21.15.146:39672) 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f877659c640 1 -- 172.21.15.146:0/4059846949 learned_addr learned my addr 172.21.15.146:0/4059846949 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f8776d9d640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87780c7ea0 0x7f87780c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f877659c640 1 -- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87781620f0 msgr2=0x7f877814eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f8775d9b640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87781620f0 0x7f877814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f877659c640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87781620f0 0x7f877814eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f877659c640 1 -- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87780c7ea0 msgr2=0x7f87780c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f877659c640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87780c7ea0 0x7f87780c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f877659c640 1 -- 172.21.15.146:0/4059846949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87781fa4a0 con 0x7f87780b3870 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f8776d9d640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87780c7ea0 0x7f87780c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f8775d9b640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87781620f0 0x7f877814eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:23.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f877659c640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87780b3870 0x7f87781e94e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f876800d700 tx=0x7f876800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f8766ffd640 1 -- 172.21.15.146:0/4059846949 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768017070 con 0x7f87780b3870 2024-09-17T03:35:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f8766ffd640 1 -- 172.21.15.146:0/4059846949 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8768005310 con 0x7f87780b3870 2024-09-17T03:35:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f877cc27640 1 -- 172.21.15.146:0/4059846949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87781e8720 con 0x7f87780b3870 2024-09-17T03:35:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f8766ffd640 1 -- 172.21.15.146:0/4059846949 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768009820 con 0x7f87780b3870 2024-09-17T03:35:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.772+0000 7f877cc27640 1 -- 172.21.15.146:0/4059846949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87781e8ce0 con 0x7f87780b3870 2024-09-17T03:35:23.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.773+0000 7f877cc27640 1 -- 172.21.15.146:0/4059846949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87780d3190 con 0x7f87780b3870 2024-09-17T03:35:23.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.774+0000 7f8766ffd640 1 -- 172.21.15.146:0/4059846949 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f87680099c0 con 0x7f87780b3870 2024-09-17T03:35:23.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.775+0000 7f8766ffd640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8758078b90 0x7f875807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:23.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.775+0000 7f8766ffd640 1 -- 172.21.15.146:0/4059846949 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f876809aac0 con 0x7f87780b3870 2024-09-17T03:35:23.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.775+0000 7f8775d9b640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8758078b90 0x7f875807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:23.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.775+0000 7f8775d9b640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8758078b90 0x7f875807b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f877815b250 tx=0x7f876c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:23.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.779+0000 7f8766ffd640 1 -- 172.21.15.146:0/4059846949 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8768063290 con 0x7f87780b3870 2024-09-17T03:35:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.953+0000 7f877cc27640 1 -- 172.21.15.146:0/4059846949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f87780764a0 con 0x7f87780b3870 2024-09-17T03:35:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.954+0000 7f8766ffd640 1 -- 172.21.15.146:0/4059846949 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f8768062b90 con 0x7f87780b3870 2024-09-17T03:35:23.955 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:35:23.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 -- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8758078b90 msgr2=0x7f875807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8758078b90 0x7f875807b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f877815b250 tx=0x7f876c009040 comp rx=0 tx=0).stop 2024-09-17T03:35:23.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 -- 172.21.15.146:0/4059846949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87780b3870 msgr2=0x7f87781e94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:23.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87780b3870 0x7f87781e94e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f876800d700 tx=0x7f876800dbc0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 -- 172.21.15.146:0/4059846949 shutdown_connections 2024-09-17T03:35:23.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8758078b90 0x7f875807b0a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87780c7ea0 0x7f87780c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87781620f0 0x7f877814eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 --2- 172.21.15.146:0/4059846949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87780b3870 0x7f87781e94e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:23.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 -- 172.21.15.146:0/4059846949 >> 172.21.15.146:0/4059846949 conn(0x7f87780d4be0 msgr2=0x7f87780b96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:23.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 -- 172.21.15.146:0/4059846949 shutdown_connections 2024-09-17T03:35:23.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:23.956+0000 7f877cc27640 1 -- 172.21.15.146:0/4059846949 wait complete. 2024-09-17T03:35:23.968 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-17T03:35:24.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.081+0000 7f22c0ede640 1 -- 172.21.15.146:0/3697662324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22bc0b5ce0 msgr2=0x7f22bc0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:24.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.081+0000 7f22c0ede640 1 --2- 172.21.15.146:0/3697662324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22bc0b5ce0 0x7f22bc0b1320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0b6120 tx=0x7f22ac02a530 comp rx=0 tx=0).stop 2024-09-17T03:35:24.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.081+0000 7f22c0ede640 1 -- 172.21.15.146:0/3697662324 shutdown_connections 2024-09-17T03:35:24.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.081+0000 7f22c0ede640 1 --2- 172.21.15.146:0/3697662324 >> v2:172.21.15.179:3300/0 conn(0x7f22bc0b3d30 0x7f22bc15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:24.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.081+0000 7f22c0ede640 1 --2- 172.21.15.146:0/3697662324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22bc0b5ce0 0x7f22bc0b1320 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:24.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.081+0000 7f22c0ede640 1 -- 172.21.15.146:0/3697662324 >> 172.21.15.146:0/3697662324 conn(0x7f22bc0b7b20 msgr2=0x7f22bc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:24.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.081+0000 7f22c0ede640 1 -- 172.21.15.146:0/3697662324 shutdown_connections 2024-09-17T03:35:24.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.081+0000 7f22c0ede640 1 -- 172.21.15.146:0/3697662324 wait complete. 2024-09-17T03:35:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.083+0000 7f22c0ede640 1 Processor -- start 2024-09-17T03:35:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.084+0000 7f22c0ede640 1 -- start start 2024-09-17T03:35:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22c0ede640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22bc0b5750 0x7f22bc152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22c0ede640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22bc0b5ce0 0x7f22bc1f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22c0ede640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22bc1f39f0 0x7f22bc155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22c0ede640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc15d3f0 con 0x7f22bc1f39f0 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22c0ede640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc15d270 con 0x7f22bc0b5ce0 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22c0ede640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc15d570 con 0x7f22bc0b5750 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22bad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22bc1f39f0 0x7f22bc155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22bad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22bc1f39f0 0x7f22bc155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39686/0 (socket says 172.21.15.146:39686) 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22bad9d640 1 -- 172.21.15.146:0/3967120725 learned_addr learned my addr 172.21.15.146:0/3967120725 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22ba59c640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22bc0b5750 0x7f22bc152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22b1d9b640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22bc0b5ce0 0x7f22bc1f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22bad9d640 1 -- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22bc0b5750 msgr2=0x7f22bc152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22bad9d640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22bc0b5750 0x7f22bc152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22bad9d640 1 -- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22bc0b5ce0 msgr2=0x7f22bc1f34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22bad9d640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22bc0b5ce0 0x7f22bc1f34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22bad9d640 1 -- 172.21.15.146:0/3967120725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc152ed0 con 0x7f22bc1f39f0 2024-09-17T03:35:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22ba59c640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22bc0b5750 0x7f22bc152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.085+0000 7f22bad9d640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22bc1f39f0 0x7f22bc155b80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f22b400ea70 tx=0x7f22b400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.086+0000 7f22b37fe640 1 -- 172.21.15.146:0/3967120725 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b400ce40 con 0x7f22bc1f39f0 2024-09-17T03:35:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.086+0000 7f22b37fe640 1 -- 172.21.15.146:0/3967120725 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22b4004c10 con 0x7f22bc1f39f0 2024-09-17T03:35:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.086+0000 7f22b37fe640 1 -- 172.21.15.146:0/3967120725 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4005020 con 0x7f22bc1f39f0 2024-09-17T03:35:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.086+0000 7f22c0ede640 1 -- 172.21.15.146:0/3967120725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc1531b0 con 0x7f22bc1f39f0 2024-09-17T03:35:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.086+0000 7f22c0ede640 1 -- 172.21.15.146:0/3967120725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc152970 con 0x7f22bc1f39f0 2024-09-17T03:35:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.087+0000 7f22c0ede640 1 -- 172.21.15.146:0/3967120725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22bc1f4210 con 0x7f22bc1f39f0 2024-09-17T03:35:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.087+0000 7f22b37fe640 1 -- 172.21.15.146:0/3967120725 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f22b40051c0 con 0x7f22bc1f39f0 2024-09-17T03:35:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.088+0000 7f22b37fe640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f229c078bc0 0x7f229c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.088+0000 7f22b37fe640 1 -- 172.21.15.146:0/3967120725 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f22b409b750 con 0x7f22bc1f39f0 2024-09-17T03:35:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.088+0000 7f22ba59c640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f229c078bc0 0x7f229c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.088+0000 7f22ba59c640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f229c078bc0 0x7f229c07b0d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f22ac034000 tx=0x7f22ac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:24.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.092+0000 7f22b37fe640 1 -- 172.21.15.146:0/3967120725 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f22b4063f20 con 0x7f22bc1f39f0 2024-09-17T03:35:24.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:24.334+0000 7f22c0ede640 1 -- 172.21.15.146:0/3967120725 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f22bc15ec10 con 0x7f22bc1f39f0 2024-09-17T03:35:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.331+0000 7f22b37fe640 1 -- 172.21.15.146:0/3967120725 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v122) ==== 146+0+0 (secure 0 0 0) 0x7f22b4063820 con 0x7f22bc1f39f0 2024-09-17T03:35:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 -- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f229c078bc0 msgr2=0x7f229c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f229c078bc0 0x7f229c07b0d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f22ac034000 tx=0x7f22ac004730 comp rx=0 tx=0).stop 2024-09-17T03:35:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 -- 172.21.15.146:0/3967120725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22bc1f39f0 msgr2=0x7f22bc155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22bc1f39f0 0x7f22bc155b80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f22b400ea70 tx=0x7f22b400ef30 comp rx=0 tx=0).stop 2024-09-17T03:35:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 -- 172.21.15.146:0/3967120725 shutdown_connections 2024-09-17T03:35:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f229c078bc0 0x7f229c07b0d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22bc1f39f0 0x7f22bc155b80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22bc0b5ce0 0x7f22bc1f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 --2- 172.21.15.146:0/3967120725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22bc0b5750 0x7f22bc152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 -- 172.21.15.146:0/3967120725 >> 172.21.15.146:0/3967120725 conn(0x7f22bc0b7b20 msgr2=0x7f22bc15bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 -- 172.21.15.146:0/3967120725 shutdown_connections 2024-09-17T03:35:25.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.334+0000 7f22c0ede640 1 -- 172.21.15.146:0/3967120725 wait complete. 2024-09-17T03:35:25.347 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:35:25.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.461+0000 7f1fec994640 1 -- 172.21.15.146:0/2538932254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe80b3360 msgr2=0x7f1fe8072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.461+0000 7f1fec994640 1 --2- 172.21.15.146:0/2538932254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe80b3360 0x7f1fe8072df0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8005fd0 tx=0x7f1fd802bbc0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.461+0000 7f1fec994640 1 -- 172.21.15.146:0/2538932254 shutdown_connections 2024-09-17T03:35:25.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.461+0000 7f1fec994640 1 --2- 172.21.15.146:0/2538932254 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fe80cfc40 0x7f1fe815ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.461+0000 7f1fec994640 1 --2- 172.21.15.146:0/2538932254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe80b3360 0x7f1fe8072df0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.461+0000 7f1fec994640 1 -- 172.21.15.146:0/2538932254 >> 172.21.15.146:0/2538932254 conn(0x7f1fe80b2060 msgr2=0x7f1fe80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:25.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.461+0000 7f1fec994640 1 -- 172.21.15.146:0/2538932254 shutdown_connections 2024-09-17T03:35:25.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.461+0000 7f1fec994640 1 -- 172.21.15.146:0/2538932254 wait complete. 2024-09-17T03:35:25.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.463+0000 7f1fec994640 1 Processor -- start 2024-09-17T03:35:25.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.463+0000 7f1fec994640 1 -- start start 2024-09-17T03:35:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fec994640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fe80b3360 0x7f1fe8152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fec994640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fe80cfc40 0x7f1fe815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fec994640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe815f010 0x7f1fe8144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fec994640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe806e800 con 0x7f1fe815f010 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fec994640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe806e680 con 0x7f1fe80b3360 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fec994640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe806e980 con 0x7f1fe80cfc40 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fe6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe815f010 0x7f1fe8144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fe6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe815f010 0x7f1fe8144da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39718/0 (socket says 172.21.15.146:39718) 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fe6d9d640 1 -- 172.21.15.146:0/4184851567 learned_addr learned my addr 172.21.15.146:0/4184851567 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fe659c640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fe80b3360 0x7f1fe8152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fe5d9b640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fe80cfc40 0x7f1fe815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fe6d9d640 1 -- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fe80cfc40 msgr2=0x7f1fe815ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fe6d9d640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fe80cfc40 0x7f1fe815ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fe6d9d640 1 -- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fe80b3360 msgr2=0x7f1fe8152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fe6d9d640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fe80b3360 0x7f1fe8152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fe6d9d640 1 -- 172.21.15.146:0/4184851567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe8159d70 con 0x7f1fe815f010 2024-09-17T03:35:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.464+0000 7f1fe5d9b640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fe80cfc40 0x7f1fe815ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.465+0000 7f1fe6d9d640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe815f010 0x7f1fe8144da0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c390 tx=0x7f1fe000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.465+0000 7f1fd6ffd640 1 -- 172.21.15.146:0/4184851567 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0011790 con 0x7f1fe815f010 2024-09-17T03:35:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.465+0000 7f1fd6ffd640 1 -- 172.21.15.146:0/4184851567 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fe0017070 con 0x7f1fe815f010 2024-09-17T03:35:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.465+0000 7f1fec994640 1 -- 172.21.15.146:0/4184851567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe815a050 con 0x7f1fe815f010 2024-09-17T03:35:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.465+0000 7f1fd6ffd640 1 -- 172.21.15.146:0/4184851567 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0011c40 con 0x7f1fe815f010 2024-09-17T03:35:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.465+0000 7f1fec994640 1 -- 172.21.15.146:0/4184851567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe81536f0 con 0x7f1fe815f010 2024-09-17T03:35:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.466+0000 7f1fec994640 1 -- 172.21.15.146:0/4184851567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe8072df0 con 0x7f1fe815f010 2024-09-17T03:35:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.466+0000 7f1fd6ffd640 1 -- 172.21.15.146:0/4184851567 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1fe001c460 con 0x7f1fe815f010 2024-09-17T03:35:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.467+0000 7f1fd6ffd640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1fc8078b90 0x7f1fc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.467+0000 7f1fd6ffd640 1 -- 172.21.15.146:0/4184851567 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f1fe009a6a0 con 0x7f1fe815f010 2024-09-17T03:35:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.467+0000 7f1fe659c640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1fc8078b90 0x7f1fc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.468+0000 7f1fe659c640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1fc8078b90 0x7f1fc807b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8035000 tx=0x7f1fd8004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:25.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.472+0000 7f1fd6ffd640 1 -- 172.21.15.146:0/4184851567 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1fe815f420 con 0x7f1fe815f010 2024-09-17T03:35:25.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.646+0000 7f1fec994640 1 -- 172.21.15.146:0/4184851567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f1fe806b200 con 0x7f1fe815f010 2024-09-17T03:35:25.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.646+0000 7f1fd6ffd640 1 -- 172.21.15.146:0/4184851567 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+2294 (secure 0 0 0) 0x7f1fe0062e70 con 0x7f1fe815f010 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:35:25.647 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:35:25.648 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:35:25.649 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:35:25.649 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:35:25.649 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:35:25.649 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:35:25.649 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:35:25.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 -- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1fc8078b90 msgr2=0x7f1fc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1fc8078b90 0x7f1fc807b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8035000 tx=0x7f1fd8004ab0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 -- 172.21.15.146:0/4184851567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe815f010 msgr2=0x7f1fe8144da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe815f010 0x7f1fe8144da0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c390 tx=0x7f1fe000c850 comp rx=0 tx=0).stop 2024-09-17T03:35:25.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 -- 172.21.15.146:0/4184851567 shutdown_connections 2024-09-17T03:35:25.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1fc8078b90 0x7f1fc807b0a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe815f010 0x7f1fe8144da0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fe80cfc40 0x7f1fe815ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 --2- 172.21.15.146:0/4184851567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fe80b3360 0x7f1fe8152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 -- 172.21.15.146:0/4184851567 >> 172.21.15.146:0/4184851567 conn(0x7f1fe80b2060 msgr2=0x7f1fe8150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:25.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 -- 172.21.15.146:0/4184851567 shutdown_connections 2024-09-17T03:35:25.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.649+0000 7f1fec994640 1 -- 172.21.15.146:0/4184851567 wait complete. 2024-09-17T03:35:25.660 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:35:25.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.777+0000 7f9007357640 1 -- 172.21.15.146:0/2925499270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec004800 msgr2=0x7f8fec004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.777+0000 7f9007357640 1 --2- 172.21.15.146:0/2925499270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec004800 0x7f8fec004c10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000c4a0 tx=0x7f8fec005830 comp rx=0 tx=0).stop 2024-09-17T03:35:25.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.777+0000 7f9007357640 1 -- 172.21.15.146:0/2925499270 shutdown_connections 2024-09-17T03:35:25.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.777+0000 7f9007357640 1 --2- 172.21.15.146:0/2925499270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec004800 0x7f8fec004c10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.777+0000 7f9007357640 1 -- 172.21.15.146:0/2925499270 >> 172.21.15.146:0/2925499270 conn(0x7f90000d11f0 msgr2=0x7f90000d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:25.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.777+0000 7f9007357640 1 -- 172.21.15.146:0/2925499270 shutdown_connections 2024-09-17T03:35:25.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.777+0000 7f9007357640 1 -- 172.21.15.146:0/2925499270 wait complete. 2024-09-17T03:35:25.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.779+0000 7f9007357640 1 Processor -- start 2024-09-17T03:35:25.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.779+0000 7f9007357640 1 -- start start 2024-09-17T03:35:25.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f9007357640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fec004800 0x7f9000159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f9007357640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90000cac50 0x7f900015b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f9007357640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90001f5e80 0x7f90001f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f9007357640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90001631a0 con 0x7f90001f5e80 2024-09-17T03:35:25.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f9007357640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f90000b68c0 con 0x7f90000cac50 2024-09-17T03:35:25.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f9007357640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9000163320 con 0x7f8fec004800 2024-09-17T03:35:25.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f90058f4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90001f5e80 0x7f90001f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f90058f4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90001f5e80 0x7f90001f6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39732/0 (socket says 172.21.15.146:39732) 2024-09-17T03:35:25.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f90058f4640 1 -- 172.21.15.146:0/478606542 learned_addr learned my addr 172.21.15.146:0/478606542 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:25.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f90050f3640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fec004800 0x7f9000159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f90048f2640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90000cac50 0x7f900015b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f90058f4640 1 -- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fec004800 msgr2=0x7f9000159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f90058f4640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fec004800 0x7f9000159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f90058f4640 1 -- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90000cac50 msgr2=0x7f900015b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f90058f4640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90000cac50 0x7f900015b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.780+0000 7f90058f4640 1 -- 172.21.15.146:0/478606542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90001f9440 con 0x7f90001f5e80 2024-09-17T03:35:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.781+0000 7f90058f4640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90001f5e80 0x7f90001f6290 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f90000d0870 tx=0x7f8ff8010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.781+0000 7f8ff5ffb640 1 -- 172.21.15.146:0/478606542 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff800ee70 con 0x7f90001f5e80 2024-09-17T03:35:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.781+0000 7f8ff5ffb640 1 -- 172.21.15.146:0/478606542 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ff8015070 con 0x7f90001f5e80 2024-09-17T03:35:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.781+0000 7f9007357640 1 -- 172.21.15.146:0/478606542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90001f9720 con 0x7f90001f5e80 2024-09-17T03:35:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.781+0000 7f8ff5ffb640 1 -- 172.21.15.146:0/478606542 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8003d00 con 0x7f90001f5e80 2024-09-17T03:35:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.781+0000 7f9007357640 1 -- 172.21.15.146:0/478606542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90001f5960 con 0x7f90001f5e80 2024-09-17T03:35:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.782+0000 7f9007357640 1 -- 172.21.15.146:0/478606542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90001f91b0 con 0x7f90001f5e80 2024-09-17T03:35:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.783+0000 7f8ff5ffb640 1 -- 172.21.15.146:0/478606542 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ff8004030 con 0x7f90001f5e80 2024-09-17T03:35:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.783+0000 7f8ff5ffb640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8fe4078b90 0x7f8fe407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.783+0000 7f8ff5ffb640 1 -- 172.21.15.146:0/478606542 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f8ff809b480 con 0x7f90001f5e80 2024-09-17T03:35:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.783+0000 7f90050f3640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8fe4078b90 0x7f8fe407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.784+0000 7f90050f3640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8fe4078b90 0x7f8fe407b0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc006680 tx=0x7f8ffc006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.788+0000 7f8ff5ffb640 1 -- 172.21.15.146:0/478606542 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8ff8063600 con 0x7f90001f5e80 2024-09-17T03:35:25.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.964+0000 7f9007357640 1 -- 172.21.15.146:0/478606542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f90001f5760 con 0x7f90001f5e80 2024-09-17T03:35:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.968+0000 7f8ff5ffb640 1 -- 172.21.15.146:0/478606542 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f8ff8068030 con 0x7f90001f5e80 2024-09-17T03:35:25.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 -- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8fe4078b90 msgr2=0x7f8fe407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8fe4078b90 0x7f8fe407b0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc006680 tx=0x7f8ffc006b70 comp rx=0 tx=0).stop 2024-09-17T03:35:25.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 -- 172.21.15.146:0/478606542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90001f5e80 msgr2=0x7f90001f6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:25.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90001f5e80 0x7f90001f6290 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f90000d0870 tx=0x7f8ff8010e80 comp rx=0 tx=0).stop 2024-09-17T03:35:25.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 -- 172.21.15.146:0/478606542 shutdown_connections 2024-09-17T03:35:25.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8fe4078b90 0x7f8fe407b0a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90001f5e80 0x7f90001f6290 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90000cac50 0x7f900015b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 --2- 172.21.15.146:0/478606542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8fec004800 0x7f9000159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:25.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 -- 172.21.15.146:0/478606542 >> 172.21.15.146:0/478606542 conn(0x7f90000d11f0 msgr2=0x7f900015e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:25.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 -- 172.21.15.146:0/478606542 shutdown_connections 2024-09-17T03:35:25.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:25.970+0000 7f9007357640 1 -- 172.21.15.146:0/478606542 wait complete. 2024-09-17T03:35:25.981 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:35:25.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:35:26.021 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:35:26.070 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:35:26.070 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:35:26.071 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:26.086 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:35:26.086 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:35:26.086 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:26.105 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:35:26.105 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:35:26.105 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:26.142 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:35:26.142 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:35:26.142 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:26.163 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:35:26.163 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:35:26.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.295+0000 7f7928a7e640 1 -- 172.21.15.146:0/2421528478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79240b4100 msgr2=0x7f792406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.295+0000 7f7928a7e640 1 --2- 172.21.15.146:0/2421528478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79240b4100 0x7f792406fad0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f792415d000 tx=0x7f791802a510 comp rx=0 tx=0).stop 2024-09-17T03:35:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.295+0000 7f7928a7e640 1 -- 172.21.15.146:0/2421528478 shutdown_connections 2024-09-17T03:35:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.295+0000 7f7928a7e640 1 --2- 172.21.15.146:0/2421528478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79240b4100 0x7f792406fad0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.295+0000 7f7928a7e640 1 --2- 172.21.15.146:0/2421528478 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f792415c9f0 0x7f79241526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.295+0000 7f7928a7e640 1 -- 172.21.15.146:0/2421528478 >> 172.21.15.146:0/2421528478 conn(0x7f792406d3c0 msgr2=0x7f79240b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.295+0000 7f7928a7e640 1 -- 172.21.15.146:0/2421528478 shutdown_connections 2024-09-17T03:35:26.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.295+0000 7f7928a7e640 1 -- 172.21.15.146:0/2421528478 wait complete. 2024-09-17T03:35:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.297+0000 7f7928a7e640 1 Processor -- start 2024-09-17T03:35:26.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.297+0000 7f7928a7e640 1 -- start start 2024-09-17T03:35:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.298+0000 7f7928a7e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79240b4100 0x7f7924151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.298+0000 7f7928a7e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79240b4510 0x7f79241e5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.298+0000 7f7928a7e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7924154a00 0x7f7924154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.298+0000 7f7928a7e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f79240d0730 con 0x7f79240b4510 2024-09-17T03:35:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.298+0000 7f7928a7e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79240d05b0 con 0x7f7924154a00 2024-09-17T03:35:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.298+0000 7f7928a7e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f79240d08b0 con 0x7f79240b4100 2024-09-17T03:35:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7921d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79240b4510 0x7f79241e5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7921d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79240b4510 0x7f79241e5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39752/0 (socket says 172.21.15.146:39752) 2024-09-17T03:35:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7921d9b640 1 -- 172.21.15.146:0/526485520 learned_addr learned my addr 172.21.15.146:0/526485520 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f792259c640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79240b4100 0x7f7924151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7922d9d640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7924154a00 0x7f7924154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7921d9b640 1 -- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79240b4100 msgr2=0x7f7924151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7921d9b640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79240b4100 0x7f7924151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7921d9b640 1 -- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7924154a00 msgr2=0x7f7924154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7921d9b640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7924154a00 0x7f7924154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7921d9b640 1 -- 172.21.15.146:0/526485520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7924155350 con 0x7f79240b4510 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7921d9b640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79240b4510 0x7f79241e5f60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7918009780 tx=0x7f7918033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7912ffd640 1 -- 172.21.15.146:0/526485520 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918031d60 con 0x7f79240b4510 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7912ffd640 1 -- 172.21.15.146:0/526485520 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7918005020 con 0x7f79240b4510 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7928a7e640 1 -- 172.21.15.146:0/526485520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79241581c0 con 0x7f79240b4510 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7912ffd640 1 -- 172.21.15.146:0/526485520 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918005470 con 0x7f79240b4510 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.299+0000 7f7928a7e640 1 -- 172.21.15.146:0/526485520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7924158480 con 0x7f79240b4510 2024-09-17T03:35:26.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.300+0000 7f7928a7e640 1 -- 172.21.15.146:0/526485520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f792415c9f0 con 0x7f79240b4510 2024-09-17T03:35:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.301+0000 7f7912ffd640 1 -- 172.21.15.146:0/526485520 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79180047a0 con 0x7f79240b4510 2024-09-17T03:35:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.302+0000 7f7912ffd640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7904078bc0 0x7f790407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.302+0000 7f7912ffd640 1 -- 172.21.15.146:0/526485520 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f79180bbcb0 con 0x7f79240b4510 2024-09-17T03:35:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.302+0000 7f792259c640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7904078bc0 0x7f790407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.303+0000 7f792259c640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7904078bc0 0x7f790407b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f79240b07a0 tx=0x7f791400a590 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:26.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.306+0000 7f7912ffd640 1 -- 172.21.15.146:0/526485520 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7924155350 con 0x7f79240b4510 2024-09-17T03:35:26.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.519+0000 7f7928a7e640 1 -- 172.21.15.146:0/526485520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79240d1b40 con 0x7f79240b4510 2024-09-17T03:35:26.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.519+0000 7f7912ffd640 1 -- 172.21.15.146:0/526485520 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3919 (secure 0 0 0) 0x7f791803f030 con 0x7f79240b4510 2024-09-17T03:35:26.520 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:26.520 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"btime":"2024-09-17T03:35:20:206496+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/699096289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":699096289},{"type":"v1","addr":"172.21.15.146:6834","nonce":699096289}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4685,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3576644376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3576644376},{"type":"v1","addr":"172.21.15.179:6837","nonce":3576644376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4852,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1904604031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1904604031},{"type":"v1","addr":"172.21.15.146:6835","nonce":1904604031}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1727100959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1727100959},{"type":"v1","addr":"172.21.15.179:6836","nonce":1727100959}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[]} 2024-09-17T03:35:26.520 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 16 2024-09-17T03:35:26.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 -- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7904078bc0 msgr2=0x7f790407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7904078bc0 0x7f790407b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f79240b07a0 tx=0x7f791400a590 comp rx=0 tx=0).stop 2024-09-17T03:35:26.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 -- 172.21.15.146:0/526485520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79240b4510 msgr2=0x7f79241e5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79240b4510 0x7f79241e5f60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7918009780 tx=0x7f7918033d60 comp rx=0 tx=0).stop 2024-09-17T03:35:26.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 -- 172.21.15.146:0/526485520 shutdown_connections 2024-09-17T03:35:26.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7904078bc0 0x7f790407b0d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7924154a00 0x7f7924154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79240b4510 0x7f79241e5f60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 --2- 172.21.15.146:0/526485520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79240b4100 0x7f7924151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 -- 172.21.15.146:0/526485520 >> 172.21.15.146:0/526485520 conn(0x7f792406d3c0 msgr2=0x7f79240cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:26.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 -- 172.21.15.146:0/526485520 shutdown_connections 2024-09-17T03:35:26.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.522+0000 7f7928a7e640 1 -- 172.21.15.146:0/526485520 wait complete. 2024-09-17T03:35:26.533 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:35:26.533 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:35:26.533 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:35:26.534 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:35:26.534 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:35:26.534 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:35:26.534 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:35:26.534 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:35:26.534 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:35:26.534 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:35:26.535 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:35:26.535 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:35:26.535 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:35:26.535 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:35:26.535 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:35:26.535 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:35:26.544 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:35:26.544 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:35:26.545 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:35:26.545 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:35:26.547 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:35:26.547 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:35:26.551 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:35:26.551 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:35:26.586 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:35:26.586 DEBUG:teuthology.parallel:result is None 2024-09-17T03:35:26.587 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:35:26.587 DEBUG:teuthology.parallel:result is None 2024-09-17T03:35:26.593 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:35:26.594 DEBUG:teuthology.parallel:result is None 2024-09-17T03:35:26.595 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:35:26.595 DEBUG:teuthology.parallel:result is None 2024-09-17T03:35:26.595 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:35:26.672 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:35:26.674 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:35:26.691 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:35:26.691 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:35:26.692 INFO:tasks.ceph.mds.b.smithi179.stderr:2024-09-17T03:35:26.692+0000 7fcc9ecad640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T03:35:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.716+0000 7ff398d69640 1 -- 172.21.15.146:0/105542627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3940b3870 msgr2=0x7ff3940cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.716+0000 7ff398d69640 1 --2- 172.21.15.146:0/105542627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3940b3870 0x7ff3940cf370 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff39408d590 tx=0x7ff38402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.716+0000 7ff398d69640 1 -- 172.21.15.146:0/105542627 shutdown_connections 2024-09-17T03:35:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.716+0000 7ff398d69640 1 --2- 172.21.15.146:0/105542627 >> v2:172.21.15.179:3300/0 conn(0x7ff39406f270 0x7ff3941628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.716+0000 7ff398d69640 1 --2- 172.21.15.146:0/105542627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3941620f0 0x7ff39406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.716+0000 7ff398d69640 1 --2- 172.21.15.146:0/105542627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3940b3870 0x7ff3940cf370 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.716+0000 7ff398d69640 1 -- 172.21.15.146:0/105542627 >> 172.21.15.146:0/105542627 conn(0x7ff3940d4be0 msgr2=0x7ff3940d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.716+0000 7ff398d69640 1 -- 172.21.15.146:0/105542627 shutdown_connections 2024-09-17T03:35:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.716+0000 7ff398d69640 1 -- 172.21.15.146:0/105542627 wait complete. 2024-09-17T03:35:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.718+0000 7ff398d69640 1 Processor -- start 2024-09-17T03:35:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.718+0000 7ff398d69640 1 -- start start 2024-09-17T03:35:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff398d69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff39406f270 0x7ff3940cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff398d69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3940b3870 0x7ff3940b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff398d69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3941620f0 0x7ff39414da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff398d69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff394163170 con 0x7ff3940b3870 2024-09-17T03:35:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff398d69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff394162ff0 con 0x7ff39406f270 2024-09-17T03:35:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff398d69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff3941632f0 con 0x7ff3941620f0 2024-09-17T03:35:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff391d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3940b3870 0x7ff3940b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff391d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3940b3870 0x7ff3940b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39798/0 (socket says 172.21.15.146:39798) 2024-09-17T03:35:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff391d9b640 1 -- 172.21.15.146:0/617174843 learned_addr learned my addr 172.21.15.146:0/617174843 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:26.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff392d9d640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3941620f0 0x7ff39414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff39259c640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff39406f270 0x7ff3940cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff391d9b640 1 -- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3941620f0 msgr2=0x7ff39414da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff391d9b640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3941620f0 0x7ff39414da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff391d9b640 1 -- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff39406f270 msgr2=0x7ff3940cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff391d9b640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff39406f270 0x7ff3940cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff391d9b640 1 -- 172.21.15.146:0/617174843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3940cf090 con 0x7ff3940b3870 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff391d9b640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3940b3870 0x7ff3940b2fb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff38800d6d0 tx=0x7ff38800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff382ffd640 1 -- 172.21.15.146:0/617174843 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388017070 con 0x7ff3940b3870 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff382ffd640 1 -- 172.21.15.146:0/617174843 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff388009b10 con 0x7ff3940b3870 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff398d69640 1 -- 172.21.15.146:0/617174843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3940cedb0 con 0x7ff3940b3870 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.720+0000 7ff382ffd640 1 -- 172.21.15.146:0/617174843 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388010460 con 0x7ff3940b3870 2024-09-17T03:35:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.721+0000 7ff398d69640 1 -- 172.21.15.146:0/617174843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3940ca490 con 0x7ff3940b3870 2024-09-17T03:35:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.722+0000 7ff398d69640 1 -- 172.21.15.146:0/617174843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3940cf370 con 0x7ff3940b3870 2024-09-17T03:35:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.722+0000 7ff382ffd640 1 -- 172.21.15.146:0/617174843 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff38801a070 con 0x7ff3940b3870 2024-09-17T03:35:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.723+0000 7ff382ffd640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff374078b90 0x7ff37407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.723+0000 7ff382ffd640 1 -- 172.21.15.146:0/617174843 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ff38809aa90 con 0x7ff3940b3870 2024-09-17T03:35:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.723+0000 7ff39259c640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff374078b90 0x7ff37407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.724+0000 7ff39259c640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff374078b90 0x7ff37407b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff384033000 tx=0x7ff384004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:26.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.727+0000 7ff382ffd640 1 -- 172.21.15.146:0/617174843 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff388062b90 con 0x7ff3940b3870 2024-09-17T03:35:26.854 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:35:26.857 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:35:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:26.917+0000 7ff398d69640 1 -- 172.21.15.146:0/617174843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff3940d2bd0 con 0x7ff3940b3870 2024-09-17T03:35:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.352+0000 7ff382ffd640 1 -- 172.21.15.146:0/617174843 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) ==== 97+0+0 (secure 0 0 0) 0x7ff3880675c0 con 0x7ff3940b3870 2024-09-17T03:35:27.352 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:35:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 -- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff374078b90 msgr2=0x7ff37407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff374078b90 0x7ff37407b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff384033000 tx=0x7ff384004730 comp rx=0 tx=0).stop 2024-09-17T03:35:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 -- 172.21.15.146:0/617174843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3940b3870 msgr2=0x7ff3940b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3940b3870 0x7ff3940b2fb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff38800d6d0 tx=0x7ff38800db90 comp rx=0 tx=0).stop 2024-09-17T03:35:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 -- 172.21.15.146:0/617174843 shutdown_connections 2024-09-17T03:35:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff374078b90 0x7ff37407b0a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3941620f0 0x7ff39414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3940b3870 0x7ff3940b2fb0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 --2- 172.21.15.146:0/617174843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff39406f270 0x7ff3940cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 -- 172.21.15.146:0/617174843 >> 172.21.15.146:0/617174843 conn(0x7ff3940d4be0 msgr2=0x7ff394160bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 -- 172.21.15.146:0/617174843 shutdown_connections 2024-09-17T03:35:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.354+0000 7ff398d69640 1 -- 172.21.15.146:0/617174843 wait complete. 2024-09-17T03:35:27.368 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:35:27.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.523+0000 7f7c74cbe640 1 -- 172.21.15.146:0/2193777676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c700b5ce0 msgr2=0x7f7c700b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:27.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.523+0000 7f7c74cbe640 1 --2- 172.21.15.146:0/2193777676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c700b5ce0 0x7f7c700b1320 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009830 tx=0x7f7c6002a510 comp rx=0 tx=0).stop 2024-09-17T03:35:27.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.523+0000 7f7c74cbe640 1 -- 172.21.15.146:0/2193777676 shutdown_connections 2024-09-17T03:35:27.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.523+0000 7f7c74cbe640 1 --2- 172.21.15.146:0/2193777676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c700b5ce0 0x7f7c700b1320 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.523+0000 7f7c74cbe640 1 -- 172.21.15.146:0/2193777676 >> 172.21.15.146:0/2193777676 conn(0x7f7c700b7b20 msgr2=0x7f7c7009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:27.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.523+0000 7f7c74cbe640 1 -- 172.21.15.146:0/2193777676 shutdown_connections 2024-09-17T03:35:27.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.523+0000 7f7c74cbe640 1 -- 172.21.15.146:0/2193777676 wait complete. 2024-09-17T03:35:27.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.525+0000 7f7c74cbe640 1 Processor -- start 2024-09-17T03:35:27.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.525+0000 7f7c74cbe640 1 -- start start 2024-09-17T03:35:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.526+0000 7f7c74cbe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c700b5750 0x7f7c701f73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.526+0000 7f7c74cbe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700b5ce0 0x7f7c701f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.526+0000 7f7c74cbe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c701441d0 0x7f7c701445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.526+0000 7f7c74cbe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7015d680 con 0x7f7c701441d0 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.526+0000 7f7c74cbe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7015d500 con 0x7f7c700b5750 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.526+0000 7f7c74cbe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7c7015d800 con 0x7f7c700b5ce0 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.526+0000 7f7c6ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c701441d0 0x7f7c701445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.526+0000 7f7c6ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c701441d0 0x7f7c701445e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44174/0 (socket says 172.21.15.146:44174) 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.526+0000 7f7c6ed9d640 1 -- 172.21.15.146:0/3025834433 learned_addr learned my addr 172.21.15.146:0/3025834433 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c65d9b640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700b5ce0 0x7f7c701f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c6e59c640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c700b5750 0x7f7c701f73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c6ed9d640 1 -- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700b5ce0 msgr2=0x7f7c701f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c6ed9d640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700b5ce0 0x7f7c701f7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c6ed9d640 1 -- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c700b5750 msgr2=0x7f7c701f73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c6ed9d640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c700b5750 0x7f7c701f73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c6ed9d640 1 -- 172.21.15.146:0/3025834433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c701f4f00 con 0x7f7c701441d0 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c6ed9d640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c701441d0 0x7f7c701445e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800cb10 tx=0x7f7c6800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c677fe640 1 -- 172.21.15.146:0/3025834433 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68016020 con 0x7f7c701441d0 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c677fe640 1 -- 172.21.15.146:0/3025834433 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c6800ad00 con 0x7f7c701441d0 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c74cbe640 1 -- 172.21.15.146:0/3025834433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c701454a0 con 0x7f7c701441d0 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c677fe640 1 -- 172.21.15.146:0/3025834433 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68012680 con 0x7f7c701441d0 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.527+0000 7f7c74cbe640 1 -- 172.21.15.146:0/3025834433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c70152300 con 0x7f7c701441d0 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.528+0000 7f7c74cbe640 1 -- 172.21.15.146:0/3025834433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c701f50d0 con 0x7f7c701441d0 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.529+0000 7f7c677fe640 1 -- 172.21.15.146:0/3025834433 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c68019020 con 0x7f7c701441d0 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.529+0000 7f7c677fe640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c50078bc0 0x7f7c5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.529+0000 7f7c677fe640 1 -- 172.21.15.146:0/3025834433 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f7c6809ab60 con 0x7f7c701441d0 2024-09-17T03:35:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.530+0000 7f7c6e59c640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c50078bc0 0x7f7c5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:27.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.530+0000 7f7c6e59c640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c50078bc0 0x7f7c5007b0d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c60034000 tx=0x7f7c60004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:27.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.534+0000 7f7c677fe640 1 -- 172.21.15.146:0/3025834433 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7c68020030 con 0x7f7c701441d0 2024-09-17T03:35:27.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.774+0000 7f7c74cbe640 1 -- 172.21.15.146:0/3025834433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7c701520f0 con 0x7f7c701441d0 2024-09-17T03:35:27.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.775+0000 7f7c677fe640 1 -- 172.21.15.146:0/3025834433 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f7c68062ca0 con 0x7f7c701441d0 2024-09-17T03:35:27.775 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:27.775 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:27.775 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:35:27.776 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:35:27.777 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.778 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:35:27.779 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:35:27.781 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.782 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:35:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.784 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:35:27.785 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:35:27.786 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.787 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:35:27.788 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:35:27.789 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:35:27.789 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:35:27.789 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:35:27.789 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.789 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:27.789 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:35:27.789 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:27.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 -- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c50078bc0 msgr2=0x7f7c5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:27.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c50078bc0 0x7f7c5007b0d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c60034000 tx=0x7f7c60004730 comp rx=0 tx=0).stop 2024-09-17T03:35:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 -- 172.21.15.146:0/3025834433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c701441d0 msgr2=0x7f7c701445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c701441d0 0x7f7c701445e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800cb10 tx=0x7f7c6800a060 comp rx=0 tx=0).stop 2024-09-17T03:35:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 -- 172.21.15.146:0/3025834433 shutdown_connections 2024-09-17T03:35:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c50078bc0 0x7f7c5007b0d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c701441d0 0x7f7c701445e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c700b5ce0 0x7f7c701f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 --2- 172.21.15.146:0/3025834433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c700b5750 0x7f7c701f73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 -- 172.21.15.146:0/3025834433 >> 172.21.15.146:0/3025834433 conn(0x7f7c700b7b20 msgr2=0x7f7c701596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 -- 172.21.15.146:0/3025834433 shutdown_connections 2024-09-17T03:35:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.777+0000 7f7c74cbe640 1 -- 172.21.15.146:0/3025834433 wait complete. 2024-09-17T03:35:27.792 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:35:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.904+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/3746822987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540cf6b0 msgr2=0x7f7f54161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.904+0000 7f7f5a4bd640 1 --2- 172.21.15.146:0/3746822987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540cf6b0 0x7f7f54161220 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7f540740d0 tx=0x7f7f4802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.904+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/3746822987 shutdown_connections 2024-09-17T03:35:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.904+0000 7f7f5a4bd640 1 --2- 172.21.15.146:0/3746822987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540cf6b0 0x7f7f54161220 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.904+0000 7f7f5a4bd640 1 --2- 172.21.15.146:0/3746822987 >> v2:172.21.15.179:3300/0 conn(0x7f7f540d0710 0x7f7f540cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.904+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/3746822987 >> 172.21.15.146:0/3746822987 conn(0x7f7f5409ba20 msgr2=0x7f7f540b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.904+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/3746822987 shutdown_connections 2024-09-17T03:35:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.904+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/3746822987 wait complete. 2024-09-17T03:35:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.906+0000 7f7f5a4bd640 1 Processor -- start 2024-09-17T03:35:27.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.906+0000 7f7f5a4bd640 1 -- start start 2024-09-17T03:35:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f5a4bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f540b47c0 0x7f7f5415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f5a4bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540cf6b0 0x7f7f54156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f5a4bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f540d0710 0x7f7f5415f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f5a4bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7f540b1de0 con 0x7f7f540cf6b0 2024-09-17T03:35:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f5a4bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7f54162080 con 0x7f7f540b47c0 2024-09-17T03:35:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f5a4bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7f540b1f60 con 0x7f7f540d0710 2024-09-17T03:35:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f537fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540cf6b0 0x7f7f54156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:27.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f537fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540cf6b0 0x7f7f54156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44188/0 (socket says 172.21.15.146:44188) 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f537fe640 1 -- 172.21.15.146:0/4269698395 learned_addr learned my addr 172.21.15.146:0/4269698395 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f53fff640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f540b47c0 0x7f7f5415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f58a5a640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f540d0710 0x7f7f5415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f537fe640 1 -- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f540d0710 msgr2=0x7f7f5415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f537fe640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f540d0710 0x7f7f5415f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f537fe640 1 -- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f540b47c0 msgr2=0x7f7f5415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f537fe640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f540b47c0 0x7f7f5415a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f537fe640 1 -- 172.21.15.146:0/4269698395 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f54158c20 con 0x7f7f540cf6b0 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f53fff640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f540b47c0 0x7f7f5415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f58a5a640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f540d0710 0x7f7f5415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f537fe640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540cf6b0 0x7f7f54156810 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7f480098f0 tx=0x7f7f48033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f50ff9640 1 -- 172.21.15.146:0/4269698395 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48031d60 con 0x7f7f540cf6b0 2024-09-17T03:35:27.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f50ff9640 1 -- 172.21.15.146:0/4269698395 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f48033e10 con 0x7f7f540cf6b0 2024-09-17T03:35:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/4269698395 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f541f3d50 con 0x7f7f540cf6b0 2024-09-17T03:35:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f50ff9640 1 -- 172.21.15.146:0/4269698395 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48005260 con 0x7f7f540cf6b0 2024-09-17T03:35:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.908+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/4269698395 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f541f4310 con 0x7f7f540cf6b0 2024-09-17T03:35:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.909+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/4269698395 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f540cf170 con 0x7f7f540cf6b0 2024-09-17T03:35:27.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.910+0000 7f7f50ff9640 1 -- 172.21.15.146:0/4269698395 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7f48005400 con 0x7f7f540cf6b0 2024-09-17T03:35:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.910+0000 7f7f50ff9640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f40078b90 0x7f7f4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.911+0000 7f7f50ff9640 1 -- 172.21.15.146:0/4269698395 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f7f480bbd40 con 0x7f7f540cf6b0 2024-09-17T03:35:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.911+0000 7f7f53fff640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f40078b90 0x7f7f4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:27.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.911+0000 7f7f53fff640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f40078b90 0x7f7f4007b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f440058c0 tx=0x7f7f44005c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:27.915+0000 7f7f50ff9640 1 -- 172.21.15.146:0/4269698395 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7f4803f030 con 0x7f7f540cf6b0 2024-09-17T03:35:28.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.091+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/4269698395 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7f540ced70 con 0x7f7f540cf6b0 2024-09-17T03:35:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.092+0000 7f7f50ff9640 1 -- 172.21.15.146:0/4269698395 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7f7f480844d0 con 0x7f7f540cf6b0 2024-09-17T03:35:28.092 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:28.092 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:35:28.092 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:28.092 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:35:28.092 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:35:28.092 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:28.092 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f40078b90 msgr2=0x7f7f4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f40078b90 0x7f7f4007b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f440058c0 tx=0x7f7f44005c90 comp rx=0 tx=0).stop 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/4269698395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540cf6b0 msgr2=0x7f7f54156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540cf6b0 0x7f7f54156810 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7f480098f0 tx=0x7f7f48033c20 comp rx=0 tx=0).stop 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/4269698395 shutdown_connections 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f40078b90 0x7f7f4007b0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f540d0710 0x7f7f5415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540cf6b0 0x7f7f54156810 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 --2- 172.21.15.146:0/4269698395 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f540b47c0 0x7f7f5415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/4269698395 >> 172.21.15.146:0/4269698395 conn(0x7f7f5409ba20 msgr2=0x7f7f54071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/4269698395 shutdown_connections 2024-09-17T03:35:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.094+0000 7f7f5a4bd640 1 -- 172.21.15.146:0/4269698395 wait complete. 2024-09-17T03:35:28.106 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:35:28.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:35:28.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.223+0000 7f5fb1494640 1 -- 172.21.15.146:0/3565202697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fac0b2480 msgr2=0x7f5fac0b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:28.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.223+0000 7f5fb1494640 1 --2- 172.21.15.146:0/3565202697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fac0b2480 0x7f5fac0b08d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5fac075540 tx=0x7f5fa402a560 comp rx=0 tx=0).stop 2024-09-17T03:35:28.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.223+0000 7f5fb1494640 1 -- 172.21.15.146:0/3565202697 shutdown_connections 2024-09-17T03:35:28.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.223+0000 7f5fb1494640 1 --2- 172.21.15.146:0/3565202697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fac0b2480 0x7f5fac0b08d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.223+0000 7f5fb1494640 1 --2- 172.21.15.146:0/3565202697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fac0b3250 0x7f5fac0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.223+0000 7f5fb1494640 1 --2- 172.21.15.146:0/3565202697 >> v2:172.21.15.179:3300/0 conn(0x7f5fac0b4f20 0x7f5fac0b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.223+0000 7f5fb1494640 1 -- 172.21.15.146:0/3565202697 >> 172.21.15.146:0/3565202697 conn(0x7f5fac09ba20 msgr2=0x7f5fac0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:28.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.223+0000 7f5fb1494640 1 -- 172.21.15.146:0/3565202697 shutdown_connections 2024-09-17T03:35:28.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.223+0000 7f5fb1494640 1 -- 172.21.15.146:0/3565202697 wait complete. 2024-09-17T03:35:28.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.225+0000 7f5fb1494640 1 Processor -- start 2024-09-17T03:35:28.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.225+0000 7f5fb1494640 1 -- start start 2024-09-17T03:35:28.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5fb1494640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fac0b2480 0x7f5fac0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:28.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5fb1494640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fac0b3250 0x7f5fac15f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:28.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5fb1494640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fac0b4f20 0x7f5fac09d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:28.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5fb1494640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac0b1250 con 0x7f5fac0b3250 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5fb1494640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac0b10d0 con 0x7f5fac0b2480 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5fb1494640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5fac0b13d0 con 0x7f5fac0b4f20 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5faa7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fac0b3250 0x7f5fac15f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5faa7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fac0b3250 0x7f5fac15f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44208/0 (socket says 172.21.15.146:44208) 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5faa7fc640 1 -- 172.21.15.146:0/2674965500 learned_addr learned my addr 172.21.15.146:0/2674965500 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5fab7fe640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fac0b4f20 0x7f5fac09d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5faaffd640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fac0b2480 0x7f5fac0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5faa7fc640 1 -- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fac0b4f20 msgr2=0x7f5fac09d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5faa7fc640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fac0b4f20 0x7f5fac09d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5faa7fc640 1 -- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fac0b2480 msgr2=0x7f5fac0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5faa7fc640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fac0b2480 0x7f5fac0cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.226+0000 7f5faa7fc640 1 -- 172.21.15.146:0/2674965500 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fac1f47d0 con 0x7f5fac0b3250 2024-09-17T03:35:28.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.227+0000 7f5faaffd640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fac0b2480 0x7f5fac0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:28.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.227+0000 7f5faa7fc640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fac0b3250 0x7f5fac15f220 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400d720 tx=0x7f5f9400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:28.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.227+0000 7f5fa37fe640 1 -- 172.21.15.146:0/2674965500 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94017070 con 0x7f5fac0b3250 2024-09-17T03:35:28.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.227+0000 7f5fa37fe640 1 -- 172.21.15.146:0/2674965500 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f94009ab0 con 0x7f5fac0b3250 2024-09-17T03:35:28.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.227+0000 7f5fb1494640 1 -- 172.21.15.146:0/2674965500 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fac0cd0e0 con 0x7f5fac0b3250 2024-09-17T03:35:28.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.227+0000 7f5fa37fe640 1 -- 172.21.15.146:0/2674965500 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94010460 con 0x7f5fac0b3250 2024-09-17T03:35:28.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.227+0000 7f5fb1494640 1 -- 172.21.15.146:0/2674965500 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fac0cd6a0 con 0x7f5fac0b3250 2024-09-17T03:35:28.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.228+0000 7f5fb1494640 1 -- 172.21.15.146:0/2674965500 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fac0b1f40 con 0x7f5fac0b3250 2024-09-17T03:35:28.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.229+0000 7f5fa37fe640 1 -- 172.21.15.146:0/2674965500 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f9401a070 con 0x7f5fac0b3250 2024-09-17T03:35:28.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.229+0000 7f5fa37fe640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f8c078bc0 0x7f5f8c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:28.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.229+0000 7f5fa37fe640 1 -- 172.21.15.146:0/2674965500 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f5f9409aab0 con 0x7f5fac0b3250 2024-09-17T03:35:28.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.229+0000 7f5faaffd640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f8c078bc0 0x7f5f8c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:28.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.230+0000 7f5faaffd640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f8c078bc0 0x7f5f8c07b0d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c005fd0 tx=0x7f5f9c009340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:28.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.234+0000 7f5fa37fe640 1 -- 172.21.15.146:0/2674965500 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5f94063240 con 0x7f5fac0b3250 2024-09-17T03:35:28.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:28.415+0000 7f5fb1494640 1 -- 172.21.15.146:0/2674965500 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5fac0d3540 con 0x7f5fac0b3250 2024-09-17T03:35:29.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.372+0000 7f5fa37fe640 1 -- 172.21.15.146:0/2674965500 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7f5f94062b40 con 0x7f5fac0b3250 2024-09-17T03:35:29.372 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:35:29.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.376+0000 7f5fb1494640 1 -- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f8c078bc0 msgr2=0x7f5f8c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.376+0000 7f5fb1494640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f8c078bc0 0x7f5f8c07b0d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c005fd0 tx=0x7f5f9c009340 comp rx=0 tx=0).stop 2024-09-17T03:35:29.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.376+0000 7f5fb1494640 1 -- 172.21.15.146:0/2674965500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fac0b3250 msgr2=0x7f5fac15f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.376+0000 7f5fb1494640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fac0b3250 0x7f5fac15f220 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400d720 tx=0x7f5f9400dbe0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.376+0000 7f5fb1494640 1 -- 172.21.15.146:0/2674965500 shutdown_connections 2024-09-17T03:35:29.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.376+0000 7f5fb1494640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f8c078bc0 0x7f5f8c07b0d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.376+0000 7f5fb1494640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5fac0b4f20 0x7f5fac09d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.376+0000 7f5fb1494640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fac0b3250 0x7f5fac15f220 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.376+0000 7f5fb1494640 1 --2- 172.21.15.146:0/2674965500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5fac0b2480 0x7f5fac0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.376+0000 7f5fb1494640 1 -- 172.21.15.146:0/2674965500 >> 172.21.15.146:0/2674965500 conn(0x7f5fac09ba20 msgr2=0x7f5fac0b7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.376+0000 7f5fb1494640 1 -- 172.21.15.146:0/2674965500 shutdown_connections 2024-09-17T03:35:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.377+0000 7f5fb1494640 1 -- 172.21.15.146:0/2674965500 wait complete. 2024-09-17T03:35:29.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:35:29.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.515+0000 7fc5d00e5640 1 -- 172.21.15.146:0/293596331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c80b1ce0 msgr2=0x7fc5c80b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.515+0000 7fc5d00e5640 1 --2- 172.21.15.146:0/293596331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c80b1ce0 0x7fc5c80b0aa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8073f90 tx=0x7fc5b802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.515+0000 7fc5d00e5640 1 -- 172.21.15.146:0/293596331 shutdown_connections 2024-09-17T03:35:29.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.515+0000 7fc5d00e5640 1 --2- 172.21.15.146:0/293596331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c80b0fe0 0x7fc5c806ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.515+0000 7fc5d00e5640 1 --2- 172.21.15.146:0/293596331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c80b1ce0 0x7fc5c80b0aa0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.515+0000 7fc5d00e5640 1 --2- 172.21.15.146:0/293596331 >> v2:172.21.15.179:3300/0 conn(0x7fc5c80b7450 0x7fc5c80b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.515+0000 7fc5d00e5640 1 -- 172.21.15.146:0/293596331 >> 172.21.15.146:0/293596331 conn(0x7fc5c80749f0 msgr2=0x7fc5c809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.515+0000 7fc5d00e5640 1 -- 172.21.15.146:0/293596331 shutdown_connections 2024-09-17T03:35:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.515+0000 7fc5d00e5640 1 -- 172.21.15.146:0/293596331 wait complete. 2024-09-17T03:35:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.516+0000 7fc5d00e5640 1 Processor -- start 2024-09-17T03:35:29.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.517+0000 7fc5d00e5640 1 -- start start 2024-09-17T03:35:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5d00e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5c80b0fe0 0x7fc5c815df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5d00e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c80b1ce0 0x7fc5c81e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5d00e5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c80b7450 0x7fc5c806e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5d00e5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c80b6870 con 0x7fc5c80b7450 2024-09-17T03:35:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5d00e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c80af780 con 0x7fc5c80b0fe0 2024-09-17T03:35:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5d00e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c806f340 con 0x7fc5c80b1ce0 2024-09-17T03:35:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5ce682640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c80b7450 0x7fc5c806e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5ce682640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c80b7450 0x7fc5c806e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44226/0 (socket says 172.21.15.146:44226) 2024-09-17T03:35:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5ce682640 1 -- 172.21.15.146:0/1603961312 learned_addr learned my addr 172.21.15.146:0/1603961312 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5cde81640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5c80b0fe0 0x7fc5c815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5cd680640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c80b1ce0 0x7fc5c81e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5ce682640 1 -- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c80b1ce0 msgr2=0x7fc5c81e9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5ce682640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c80b1ce0 0x7fc5c81e9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5ce682640 1 -- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5c80b0fe0 msgr2=0x7fc5c815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5ce682640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5c80b0fe0 0x7fc5c815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5ce682640 1 -- 172.21.15.146:0/1603961312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c815c6b0 con 0x7fc5c80b7450 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.518+0000 7fc5ce682640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c80b7450 0x7fc5c806e140 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000d5e0 tx=0x7fc5c000daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.519+0000 7fc5be7fc640 1 -- 172.21.15.146:0/1603961312 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0017070 con 0x7fc5c80b7450 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.519+0000 7fc5be7fc640 1 -- 172.21.15.146:0/1603961312 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5c0005310 con 0x7fc5c80b7450 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.519+0000 7fc5d00e5640 1 -- 172.21.15.146:0/1603961312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c815c990 con 0x7fc5c80b7450 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.519+0000 7fc5be7fc640 1 -- 172.21.15.146:0/1603961312 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00047a0 con 0x7fc5c80b7450 2024-09-17T03:35:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.519+0000 7fc5d00e5640 1 -- 172.21.15.146:0/1603961312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c815cf50 con 0x7fc5c80b7450 2024-09-17T03:35:29.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.520+0000 7fc5d00e5640 1 -- 172.21.15.146:0/1603961312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c80b0aa0 con 0x7fc5c80b7450 2024-09-17T03:35:29.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.520+0000 7fc5be7fc640 1 -- 172.21.15.146:0/1603961312 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc5c0004940 con 0x7fc5c80b7450 2024-09-17T03:35:29.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.521+0000 7fc5be7fc640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 0x7fc5ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:29.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.521+0000 7fc5be7fc640 1 -- 172.21.15.146:0/1603961312 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7fc5c009a9f0 con 0x7fc5c80b7450 2024-09-17T03:35:29.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.521+0000 7fc5cde81640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 0x7fc5ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:29.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.522+0000 7fc5cde81640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 0x7fc5ac07b0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4005fd0 tx=0x7fc5c40095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:29.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.526+0000 7fc5be7fc640 1 -- 172.21.15.146:0/1603961312 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc5c00629c0 con 0x7fc5c80b7450 2024-09-17T03:35:29.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:29.702+0000 7fc5d00e5640 1 -- 172.21.15.146:0/1603961312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc5c81ea710 con 0x7fc5c80b7450 2024-09-17T03:35:30.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.377+0000 7fc5be7fc640 1 -- 172.21.15.146:0/1603961312 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7fc5c00673f0 con 0x7fc5c80b7450 2024-09-17T03:35:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 -- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 msgr2=0x7fc5ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 0x7fc5ac07b0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4005fd0 tx=0x7fc5c40095e0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 -- 172.21.15.146:0/1603961312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c80b7450 msgr2=0x7fc5c806e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c80b7450 0x7fc5c806e140 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000d5e0 tx=0x7fc5c000daa0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 -- 172.21.15.146:0/1603961312 shutdown_connections 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 0x7fc5ac07b0d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c80b7450 0x7fc5c806e140 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c80b1ce0 0x7fc5c81e9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 --2- 172.21.15.146:0/1603961312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5c80b0fe0 0x7fc5c815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 -- 172.21.15.146:0/1603961312 >> 172.21.15.146:0/1603961312 conn(0x7fc5c80749f0 msgr2=0x7fc5c80b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 -- 172.21.15.146:0/1603961312 shutdown_connections 2024-09-17T03:35:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.380+0000 7fc5d00e5640 1 -- 172.21.15.146:0/1603961312 wait complete. 2024-09-17T03:35:30.402 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:35:30.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.519+0000 7fa9c1e15640 1 -- 172.21.15.146:0/421236049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9bc145ce0 msgr2=0x7fa9bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:30.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.519+0000 7fa9c1e15640 1 --2- 172.21.15.146:0/421236049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9bc145ce0 0x7fa9bc06d190 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc0749d0 tx=0x7fa9b002a560 comp rx=0 tx=0).stop 2024-09-17T03:35:30.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.519+0000 7fa9c1e15640 1 -- 172.21.15.146:0/421236049 shutdown_connections 2024-09-17T03:35:30.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.519+0000 7fa9c1e15640 1 --2- 172.21.15.146:0/421236049 >> v2:172.21.15.179:3300/0 conn(0x7fa9bc073580 0x7fa9bc073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.519+0000 7fa9c1e15640 1 --2- 172.21.15.146:0/421236049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9bc145ce0 0x7fa9bc06d190 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.519+0000 7fa9c1e15640 1 --2- 172.21.15.146:0/421236049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9bc146230 0x7fa9bc06cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.519+0000 7fa9c1e15640 1 -- 172.21.15.146:0/421236049 >> 172.21.15.146:0/421236049 conn(0x7fa9bc0b3150 msgr2=0x7fa9bc0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:30.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.519+0000 7fa9c1e15640 1 -- 172.21.15.146:0/421236049 shutdown_connections 2024-09-17T03:35:30.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.519+0000 7fa9c1e15640 1 -- 172.21.15.146:0/421236049 wait complete. 2024-09-17T03:35:30.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.521+0000 7fa9c1e15640 1 Processor -- start 2024-09-17T03:35:30.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.521+0000 7fa9c1e15640 1 -- start start 2024-09-17T03:35:30.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.522+0000 7fa9c1e15640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9bc073580 0x7fa9bc159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:30.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.522+0000 7fa9c1e15640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9bc145ce0 0x7fa9bc141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.522+0000 7fa9c1e15640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9bc146230 0x7fa9bc070d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.522+0000 7fa9c1e15640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc074260 con 0x7fa9bc146230 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.522+0000 7fa9c1e15640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc0740e0 con 0x7fa9bc073580 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.522+0000 7fa9c1e15640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa9bc0743e0 con 0x7fa9bc145ce0 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.522+0000 7fa9bbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9bc146230 0x7fa9bc070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.522+0000 7fa9bbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9bc146230 0x7fa9bc070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44252/0 (socket says 172.21.15.146:44252) 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.522+0000 7fa9bbfff640 1 -- 172.21.15.146:0/4179718935 learned_addr learned my addr 172.21.15.146:0/4179718935 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.522+0000 7fa9baffd640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9bc145ce0 0x7fa9bc141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.522+0000 7fa9bb7fe640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9bc073580 0x7fa9bc159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9bbfff640 1 -- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9bc145ce0 msgr2=0x7fa9bc141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9bbfff640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9bc145ce0 0x7fa9bc141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9bbfff640 1 -- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9bc073580 msgr2=0x7fa9bc159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:30.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9bbfff640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9bc073580 0x7fa9bc159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:30.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9bbfff640 1 -- 172.21.15.146:0/4179718935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc141fa0 con 0x7fa9bc146230 2024-09-17T03:35:30.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9bb7fe640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9bc073580 0x7fa9bc159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:30.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9bbfff640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9bc146230 0x7fa9bc070d80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400d9b0 tx=0x7fa9b400de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:30.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9a3fff640 1 -- 172.21.15.146:0/4179718935 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4016070 con 0x7fa9bc146230 2024-09-17T03:35:30.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9a3fff640 1 -- 172.21.15.146:0/4179718935 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9b400bda0 con 0x7fa9bc146230 2024-09-17T03:35:30.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9c1e15640 1 -- 172.21.15.146:0/4179718935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9bc13f820 con 0x7fa9bc146230 2024-09-17T03:35:30.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9a3fff640 1 -- 172.21.15.146:0/4179718935 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4003bd0 con 0x7fa9bc146230 2024-09-17T03:35:30.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.523+0000 7fa9c1e15640 1 -- 172.21.15.146:0/4179718935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9bc13fde0 con 0x7fa9bc146230 2024-09-17T03:35:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.524+0000 7fa9c1e15640 1 -- 172.21.15.146:0/4179718935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9bc141d10 con 0x7fa9bc146230 2024-09-17T03:35:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.525+0000 7fa9a3fff640 1 -- 172.21.15.146:0/4179718935 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa9b4010460 con 0x7fa9bc146230 2024-09-17T03:35:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.525+0000 7fa9a3fff640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a8078bc0 0x7fa9a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.526+0000 7fa9a3fff640 1 -- 172.21.15.146:0/4179718935 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7fa9b409b240 con 0x7fa9bc146230 2024-09-17T03:35:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.526+0000 7fa9bb7fe640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a8078bc0 0x7fa9a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.526+0000 7fa9bb7fe640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a8078bc0 0x7fa9a807b0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009b80 tx=0x7fa9ac005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:30.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.530+0000 7fa9a3fff640 1 -- 172.21.15.146:0/4179718935 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa9b4063090 con 0x7fa9bc146230 2024-09-17T03:35:30.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:30.741+0000 7fa9c1e15640 1 -- 172.21.15.146:0/4179718935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa9bc073990 con 0x7fa9bc146230 2024-09-17T03:35:31.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.380+0000 7fa9a3fff640 1 -- 172.21.15.146:0/4179718935 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v19) ==== 172+0+0 (secure 0 0 0) 0x7fa9b4067ac0 con 0x7fa9bc146230 2024-09-17T03:35:31.379 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 6 and data pool 7 2024-09-17T03:35:31.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.384+0000 7fa9c1e15640 1 -- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a8078bc0 msgr2=0x7fa9a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.384+0000 7fa9c1e15640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a8078bc0 0x7fa9a807b0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009b80 tx=0x7fa9ac005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:31.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.384+0000 7fa9c1e15640 1 -- 172.21.15.146:0/4179718935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9bc146230 msgr2=0x7fa9bc070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.384+0000 7fa9c1e15640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9bc146230 0x7fa9bc070d80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400d9b0 tx=0x7fa9b400de70 comp rx=0 tx=0).stop 2024-09-17T03:35:31.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.384+0000 7fa9c1e15640 1 -- 172.21.15.146:0/4179718935 shutdown_connections 2024-09-17T03:35:31.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.384+0000 7fa9c1e15640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa9a8078bc0 0x7fa9a807b0d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.384+0000 7fa9c1e15640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9bc146230 0x7fa9bc070d80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.384+0000 7fa9c1e15640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa9bc145ce0 0x7fa9bc141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.384+0000 7fa9c1e15640 1 --2- 172.21.15.146:0/4179718935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa9bc073580 0x7fa9bc159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.384+0000 7fa9c1e15640 1 -- 172.21.15.146:0/4179718935 >> 172.21.15.146:0/4179718935 conn(0x7fa9bc0b3150 msgr2=0x7fa9bc145440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:31.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.385+0000 7fa9c1e15640 1 -- 172.21.15.146:0/4179718935 shutdown_connections 2024-09-17T03:35:31.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.385+0000 7fa9c1e15640 1 -- 172.21.15.146:0/4179718935 wait complete. 2024-09-17T03:35:31.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.534+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/709406319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb190003a50 msgr2=0x7fb190003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.534+0000 7fb1ad1ba640 1 --2- 172.21.15.146:0/709406319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb190003a50 0x7fb190003ee0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb19800bb20 tx=0x7fb190005830 comp rx=0 tx=0).stop 2024-09-17T03:35:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.534+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/709406319 shutdown_connections 2024-09-17T03:35:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.534+0000 7fb1ad1ba640 1 --2- 172.21.15.146:0/709406319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb190003a50 0x7fb190003ee0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.534+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/709406319 >> 172.21.15.146:0/709406319 conn(0x7fb1a80d11f0 msgr2=0x7fb1a80d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.534+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/709406319 shutdown_connections 2024-09-17T03:35:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.534+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/709406319 wait complete. 2024-09-17T03:35:31.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.536+0000 7fb1ad1ba640 1 Processor -- start 2024-09-17T03:35:31.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.536+0000 7fb1ad1ba640 1 -- start start 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1ad1ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb190003a50 0x7fb1a80c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1ad1ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1a815c070 0x7fb1a8158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1ad1ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a80cbc60 0x7fb1a80cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1ad1ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a80b6600 con 0x7fb1a80cbc60 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1ad1ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a80d00c0 con 0x7fb190003a50 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1ad1ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a80b6780 con 0x7fb1a815c070 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a759e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a80cbc60 0x7fb1a80cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a759e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a80cbc60 0x7fb1a80cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44272/0 (socket says 172.21.15.146:44272) 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a759e640 1 -- 172.21.15.146:0/3702212155 learned_addr learned my addr 172.21.15.146:0/3702212155 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a659c640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1a815c070 0x7fb1a8158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a6d9d640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb190003a50 0x7fb1a80c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a759e640 1 -- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1a815c070 msgr2=0x7fb1a8158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a759e640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1a815c070 0x7fb1a8158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a759e640 1 -- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb190003a50 msgr2=0x7fb1a80c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a759e640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb190003a50 0x7fb1a80c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a759e640 1 -- 172.21.15.146:0/3702212155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a80c90b0 con 0x7fb1a80cbc60 2024-09-17T03:35:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a659c640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1a815c070 0x7fb1a8158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1a759e640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a80cbc60 0x7fb1a80cc070 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb1a808d6a0 tx=0x7fb1a00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb18f7fe640 1 -- 172.21.15.146:0/3702212155 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0011870 con 0x7fb1a80cbc60 2024-09-17T03:35:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb18f7fe640 1 -- 172.21.15.146:0/3702212155 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1a0017070 con 0x7fb1a80cbc60 2024-09-17T03:35:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/3702212155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a80c9390 con 0x7fb1a80cbc60 2024-09-17T03:35:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb18f7fe640 1 -- 172.21.15.146:0/3702212155 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0011dc0 con 0x7fb1a80cbc60 2024-09-17T03:35:31.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.538+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/3702212155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a80cb9d0 con 0x7fb1a80cbc60 2024-09-17T03:35:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.539+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/3702212155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a80cb1d0 con 0x7fb1a80cbc60 2024-09-17T03:35:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.540+0000 7fb18f7fe640 1 -- 172.21.15.146:0/3702212155 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1a001c460 con 0x7fb1a80cbc60 2024-09-17T03:35:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.541+0000 7fb18f7fe640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb194078b90 0x7fb19407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.541+0000 7fb18f7fe640 1 -- 172.21.15.146:0/3702212155 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fb1a009b480 con 0x7fb1a80cbc60 2024-09-17T03:35:31.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.541+0000 7fb1a6d9d640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb194078b90 0x7fb19407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.542+0000 7fb1a6d9d640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb194078b90 0x7fb19407b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb198036000 tx=0x7fb1980046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:31.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.545+0000 7fb18f7fe640 1 -- 172.21.15.146:0/3702212155 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1a00638c0 con 0x7fb1a80cbc60 2024-09-17T03:35:31.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.721+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/3702212155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1a80cef40 con 0x7fb1a80cbc60 2024-09-17T03:35:31.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.722+0000 7fb18f7fe640 1 -- 172.21.15.146:0/3702212155 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16734 (secure 0 0 0) 0x7fb1a00631c0 con 0x7fb1a80cbc60 2024-09-17T03:35:31.721 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:31.722 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":44,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:35:30.743500+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:28.420197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:29.707406+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:31.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb194078b90 msgr2=0x7fb19407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb194078b90 0x7fb19407b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb198036000 tx=0x7fb1980046c0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/3702212155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a80cbc60 msgr2=0x7fb1a80cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a80cbc60 0x7fb1a80cc070 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb1a808d6a0 tx=0x7fb1a00019b0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/3702212155 shutdown_connections 2024-09-17T03:35:31.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb194078b90 0x7fb19407b0a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1a80cbc60 0x7fb1a80cc070 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1a815c070 0x7fb1a8158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 --2- 172.21.15.146:0/3702212155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb190003a50 0x7fb1a80c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/3702212155 >> 172.21.15.146:0/3702212155 conn(0x7fb1a80d11f0 msgr2=0x7fb1a815e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:31.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/3702212155 shutdown_connections 2024-09-17T03:35:31.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.724+0000 7fb1ad1ba640 1 -- 172.21.15.146:0/3702212155 wait complete. 2024-09-17T03:35:31.735 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.850+0000 7f4a79e1f640 1 -- 172.21.15.146:0/2439164383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a74073580 msgr2=0x7f4a74073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.850+0000 7f4a79e1f640 1 --2- 172.21.15.146:0/2439164383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a74073580 0x7f4a74073990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4a740724b0 tx=0x7f4a6c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:35:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.850+0000 7f4a79e1f640 1 -- 172.21.15.146:0/2439164383 shutdown_connections 2024-09-17T03:35:31.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.850+0000 7f4a79e1f640 1 --2- 172.21.15.146:0/2439164383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a74073580 0x7f4a74073990 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.850+0000 7f4a79e1f640 1 --2- 172.21.15.146:0/2439164383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a74145ce0 0x7f4a7406d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.850+0000 7f4a79e1f640 1 --2- 172.21.15.146:0/2439164383 >> v2:172.21.15.179:3300/0 conn(0x7f4a74146230 0x7f4a7406cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.850+0000 7f4a79e1f640 1 -- 172.21.15.146:0/2439164383 >> 172.21.15.146:0/2439164383 conn(0x7f4a740b3150 msgr2=0x7f4a740b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.850+0000 7f4a79e1f640 1 -- 172.21.15.146:0/2439164383 shutdown_connections 2024-09-17T03:35:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.850+0000 7f4a79e1f640 1 -- 172.21.15.146:0/2439164383 wait complete. 2024-09-17T03:35:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.851+0000 7f4a79e1f640 1 Processor -- start 2024-09-17T03:35:31.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.852+0000 7f4a79e1f640 1 -- start start 2024-09-17T03:35:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a79e1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a74073580 0x7f4a7413f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a79e1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a74145ce0 0x7f4a7415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a79e1f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a74146230 0x7f4a7415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a79e1f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74074260 con 0x7f4a74146230 2024-09-17T03:35:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a79e1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4a740740e0 con 0x7f4a74145ce0 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a79e1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4a740743e0 con 0x7f4a74073580 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a73fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a74146230 0x7f4a7415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a73fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a74146230 0x7f4a7415b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44294/0 (socket says 172.21.15.146:44294) 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a73fff640 1 -- 172.21.15.146:0/3148913109 learned_addr learned my addr 172.21.15.146:0/3148913109 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a72ffd640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a74145ce0 0x7f4a7415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a737fe640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a74073580 0x7f4a7413f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a73fff640 1 -- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a74073580 msgr2=0x7f4a7413f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a73fff640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a74073580 0x7f4a7413f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a73fff640 1 -- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a74145ce0 msgr2=0x7f4a7415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a73fff640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a74145ce0 0x7f4a7415afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.853+0000 7f4a73fff640 1 -- 172.21.15.146:0/3148913109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a740ca7d0 con 0x7f4a74146230 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.854+0000 7f4a73fff640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a74146230 0x7f4a7415b4e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c02b020 tx=0x7f4a6c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.854+0000 7f4a5bfff640 1 -- 172.21.15.146:0/3148913109 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c033050 con 0x7f4a74146230 2024-09-17T03:35:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.854+0000 7f4a5bfff640 1 -- 172.21.15.146:0/3148913109 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a6c004450 con 0x7f4a74146230 2024-09-17T03:35:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.854+0000 7f4a79e1f640 1 -- 172.21.15.146:0/3148913109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7413f5a0 con 0x7f4a74146230 2024-09-17T03:35:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.854+0000 7f4a5bfff640 1 -- 172.21.15.146:0/3148913109 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c038450 con 0x7f4a74146230 2024-09-17T03:35:31.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.854+0000 7f4a79e1f640 1 -- 172.21.15.146:0/3148913109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a74141690 con 0x7f4a74146230 2024-09-17T03:35:31.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.855+0000 7f4a79e1f640 1 -- 172.21.15.146:0/3148913109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a74141120 con 0x7f4a74146230 2024-09-17T03:35:31.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.855+0000 7f4a5bfff640 1 -- 172.21.15.146:0/3148913109 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a6c036070 con 0x7f4a74146230 2024-09-17T03:35:31.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.856+0000 7f4a5bfff640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a60078b90 0x7f4a6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:31.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.856+0000 7f4a5bfff640 1 -- 172.21.15.146:0/3148913109 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f4a6c0bc0c0 con 0x7f4a74146230 2024-09-17T03:35:31.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.856+0000 7f4a737fe640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a60078b90 0x7f4a6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:31.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.857+0000 7f4a737fe640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a60078b90 0x7f4a6007b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4a64005fd0 tx=0x7f4a6400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:31.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:31.860+0000 7f4a5bfff640 1 -- 172.21.15.146:0/3148913109 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a6c083fd0 con 0x7f4a74146230 2024-09-17T03:35:32.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.035+0000 7f4a79e1f640 1 -- 172.21.15.146:0/3148913109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a74073990 con 0x7f4a74146230 2024-09-17T03:35:32.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.036+0000 7f4a5bfff640 1 -- 172.21.15.146:0/3148913109 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16734 (secure 0 0 0) 0x7f4a6c088a00 con 0x7f4a74146230 2024-09-17T03:35:32.035 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:32.035 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":44,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:35:30.743500+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:28.420197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:29.707406+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:32.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 -- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a60078b90 msgr2=0x7f4a6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a60078b90 0x7f4a6007b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4a64005fd0 tx=0x7f4a6400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 -- 172.21.15.146:0/3148913109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a74146230 msgr2=0x7f4a7415b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a74146230 0x7f4a7415b4e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c02b020 tx=0x7f4a6c003f10 comp rx=0 tx=0).stop 2024-09-17T03:35:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 -- 172.21.15.146:0/3148913109 shutdown_connections 2024-09-17T03:35:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a60078b90 0x7f4a6007b0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a74146230 0x7f4a7415b4e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a74145ce0 0x7f4a7415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 --2- 172.21.15.146:0/3148913109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a74073580 0x7f4a7413f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 -- 172.21.15.146:0/3148913109 >> 172.21.15.146:0/3148913109 conn(0x7f4a740b3150 msgr2=0x7f4a7415c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 -- 172.21.15.146:0/3148913109 shutdown_connections 2024-09-17T03:35:32.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.038+0000 7f4a79e1f640 1 -- 172.21.15.146:0/3148913109 wait complete. 2024-09-17T03:35:32.049 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:35:32.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.166+0000 7f3102112640 1 -- 172.21.15.146:0/3785690693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30fc06fbf0 msgr2=0x7f30fc070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.166+0000 7f3102112640 1 --2- 172.21.15.146:0/3785690693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30fc06fbf0 0x7f30fc070000 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f30f4005fd0 tx=0x7f30f402a780 comp rx=0 tx=0).stop 2024-09-17T03:35:32.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.166+0000 7f3102112640 1 -- 172.21.15.146:0/3785690693 shutdown_connections 2024-09-17T03:35:32.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.166+0000 7f3102112640 1 --2- 172.21.15.146:0/3785690693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30fc06fbf0 0x7f30fc070000 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.166+0000 7f3102112640 1 --2- 172.21.15.146:0/3785690693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30fc06cc50 0x7f30fc06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.166+0000 7f3102112640 1 -- 172.21.15.146:0/3785690693 >> 172.21.15.146:0/3785690693 conn(0x7f30fc06dd60 msgr2=0x7f30fc06e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:32.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.166+0000 7f3102112640 1 -- 172.21.15.146:0/3785690693 shutdown_connections 2024-09-17T03:35:32.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.166+0000 7f3102112640 1 -- 172.21.15.146:0/3785690693 wait complete. 2024-09-17T03:35:32.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.168+0000 7f3102112640 1 Processor -- start 2024-09-17T03:35:32.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.168+0000 7f3102112640 1 -- start start 2024-09-17T03:35:32.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.169+0000 7f3102112640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30fc06cc50 0x7f30fc0b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.169+0000 7f3102112640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30fc06fbf0 0x7f30fc14fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.169+0000 7f3102112640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30fc15d8a0 0x7f30fc1f9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f3102112640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc15e120 con 0x7f30fc06cc50 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f3102112640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc073c80 con 0x7f30fc06fbf0 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f3102112640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f30fc070540 con 0x7f30fc15d8a0 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30fb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30fc06cc50 0x7f30fc0b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30fb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30fc06cc50 0x7f30fc0b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44324/0 (socket says 172.21.15.146:44324) 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30fb7fe640 1 -- 172.21.15.146:0/3228408978 learned_addr learned my addr 172.21.15.146:0/3228408978 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30fbfff640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30fc15d8a0 0x7f30fc1f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30f3fff640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30fc06fbf0 0x7f30fc14fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30fb7fe640 1 -- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30fc15d8a0 msgr2=0x7f30fc1f9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30fb7fe640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30fc15d8a0 0x7f30fc1f9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30fb7fe640 1 -- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30fc06fbf0 msgr2=0x7f30fc14fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30fb7fe640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30fc06fbf0 0x7f30fc14fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30fb7fe640 1 -- 172.21.15.146:0/3228408978 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc0afa30 con 0x7f30fc06cc50 2024-09-17T03:35:32.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30f3fff640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30fc06fbf0 0x7f30fc14fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:32.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30fb7fe640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30fc06cc50 0x7f30fc0b6020 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c3c0 tx=0x7f30ec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:32.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30f8ff9640 1 -- 172.21.15.146:0/3228408978 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec017070 con 0x7f30fc06cc50 2024-09-17T03:35:32.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30f8ff9640 1 -- 172.21.15.146:0/3228408978 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30ec0035f0 con 0x7f30fc06cc50 2024-09-17T03:35:32.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f3102112640 1 -- 172.21.15.146:0/3228408978 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30fc0aff30 con 0x7f30fc06cc50 2024-09-17T03:35:32.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f30f8ff9640 1 -- 172.21.15.146:0/3228408978 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec003a80 con 0x7f30fc06cc50 2024-09-17T03:35:32.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.170+0000 7f3102112640 1 -- 172.21.15.146:0/3228408978 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30fc0b04f0 con 0x7f30fc06cc50 2024-09-17T03:35:32.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.171+0000 7f3102112640 1 -- 172.21.15.146:0/3228408978 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30fc0709f0 con 0x7f30fc06cc50 2024-09-17T03:35:32.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.172+0000 7f30f8ff9640 1 -- 172.21.15.146:0/3228408978 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30ec01a070 con 0x7f30fc06cc50 2024-09-17T03:35:32.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.173+0000 7f30f8ff9640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30dc078bc0 0x7f30dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.173+0000 7f30f8ff9640 1 -- 172.21.15.146:0/3228408978 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f30ec099f80 con 0x7f30fc06cc50 2024-09-17T03:35:32.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.173+0000 7f30f3fff640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30dc078bc0 0x7f30dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.173+0000 7f30f3fff640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30dc078bc0 0x7f30dc07b0d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0d0ee0 tx=0x7f30e4005f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:32.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.177+0000 7f30f8ff9640 1 -- 172.21.15.146:0/3228408978 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30fc06d5a0 con 0x7f30fc06cc50 2024-09-17T03:35:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.387+0000 7f3102112640 1 -- 172.21.15.146:0/3228408978 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f30fc0d18d0 con 0x7f30fc06cc50 2024-09-17T03:35:32.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.397+0000 7f30f8ff9640 1 -- 172.21.15.146:0/3228408978 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) ==== 118+0+0 (secure 0 0 0) 0x7f30ec061d70 con 0x7f30fc06cc50 2024-09-17T03:35:32.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 -- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30dc078bc0 msgr2=0x7f30dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30dc078bc0 0x7f30dc07b0d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0d0ee0 tx=0x7f30e4005f10 comp rx=0 tx=0).stop 2024-09-17T03:35:32.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 -- 172.21.15.146:0/3228408978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30fc06cc50 msgr2=0x7f30fc0b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30fc06cc50 0x7f30fc0b6020 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c3c0 tx=0x7f30ec00c880 comp rx=0 tx=0).stop 2024-09-17T03:35:32.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 -- 172.21.15.146:0/3228408978 shutdown_connections 2024-09-17T03:35:32.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30dc078bc0 0x7f30dc07b0d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30fc15d8a0 0x7f30fc1f9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30fc06fbf0 0x7f30fc14fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 --2- 172.21.15.146:0/3228408978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30fc06cc50 0x7f30fc0b6020 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 -- 172.21.15.146:0/3228408978 >> 172.21.15.146:0/3228408978 conn(0x7f30fc06dd60 msgr2=0x7f30fc06e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:32.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 -- 172.21.15.146:0/3228408978 shutdown_connections 2024-09-17T03:35:32.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.400+0000 7f3102112640 1 -- 172.21.15.146:0/3228408978 wait complete. 2024-09-17T03:35:32.411 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:35:32.411 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:35:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.528+0000 7ffb44c25640 1 -- 172.21.15.146:0/3574027738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb400cefe0 msgr2=0x7ffb400cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.528+0000 7ffb44c25640 1 --2- 172.21.15.146:0/3574027738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb400cefe0 0x7ffb400cf3f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009830 tx=0x7ffb3402a480 comp rx=0 tx=0).stop 2024-09-17T03:35:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.528+0000 7ffb44c25640 1 -- 172.21.15.146:0/3574027738 shutdown_connections 2024-09-17T03:35:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.528+0000 7ffb44c25640 1 --2- 172.21.15.146:0/3574027738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb400d1190 0x7ffb400d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.528+0000 7ffb44c25640 1 --2- 172.21.15.146:0/3574027738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb400cefe0 0x7ffb400cf3f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.528+0000 7ffb44c25640 1 -- 172.21.15.146:0/3574027738 >> 172.21.15.146:0/3574027738 conn(0x7ffb4009ba20 msgr2=0x7ffb400b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.528+0000 7ffb44c25640 1 -- 172.21.15.146:0/3574027738 shutdown_connections 2024-09-17T03:35:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.528+0000 7ffb44c25640 1 -- 172.21.15.146:0/3574027738 wait complete. 2024-09-17T03:35:32.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.530+0000 7ffb44c25640 1 Processor -- start 2024-09-17T03:35:32.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.530+0000 7ffb44c25640 1 -- start start 2024-09-17T03:35:32.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb44c25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb400b7580 0x7ffb400c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb44c25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb400cefe0 0x7ffb401e18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb44c25640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb400d1190 0x7ffb401e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb44c25640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4006dee0 con 0x7ffb400d1190 2024-09-17T03:35:32.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb44c25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4006dd60 con 0x7ffb400b7580 2024-09-17T03:35:32.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb44c25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffb4006e060 con 0x7ffb400cefe0 2024-09-17T03:35:32.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb3ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb400d1190 0x7ffb401e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb3ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb400d1190 0x7ffb401e3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44350/0 (socket says 172.21.15.146:44350) 2024-09-17T03:35:32.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb3ed9d640 1 -- 172.21.15.146:0/3040387260 learned_addr learned my addr 172.21.15.146:0/3040387260 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:32.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb3dd9b640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb400cefe0 0x7ffb401e18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb3ed9d640 1 -- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb400cefe0 msgr2=0x7ffb401e18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb3e59c640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb400b7580 0x7ffb400c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb3ed9d640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb400cefe0 0x7ffb401e18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb3ed9d640 1 -- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb400b7580 msgr2=0x7ffb400c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:32.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb3ed9d640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb400b7580 0x7ffb400c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:32.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb3ed9d640 1 -- 172.21.15.146:0/3040387260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb400c65d0 con 0x7ffb400d1190 2024-09-17T03:35:32.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb3ed9d640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb400d1190 0x7ffb401e3500 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800cae0 tx=0x7ffb38007220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:32.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb2effd640 1 -- 172.21.15.146:0/3040387260 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38007da0 con 0x7ffb400d1190 2024-09-17T03:35:32.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb2effd640 1 -- 172.21.15.146:0/3040387260 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb38004c30 con 0x7ffb400d1190 2024-09-17T03:35:32.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb2effd640 1 -- 172.21.15.146:0/3040387260 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38005280 con 0x7ffb400d1190 2024-09-17T03:35:32.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.532+0000 7ffb44c25640 1 -- 172.21.15.146:0/3040387260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb400cc450 con 0x7ffb400d1190 2024-09-17T03:35:32.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.533+0000 7ffb44c25640 1 -- 172.21.15.146:0/3040387260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb400cb290 con 0x7ffb400d1190 2024-09-17T03:35:32.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.534+0000 7ffb44c25640 1 -- 172.21.15.146:0/3040387260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb401f67c0 con 0x7ffb400d1190 2024-09-17T03:35:32.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.534+0000 7ffb2effd640 1 -- 172.21.15.146:0/3040387260 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb38005420 con 0x7ffb400d1190 2024-09-17T03:35:32.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.535+0000 7ffb2effd640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb20078b90 0x7ffb2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:32.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.535+0000 7ffb2effd640 1 -- 172.21.15.146:0/3040387260 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ffb3809b7b0 con 0x7ffb400d1190 2024-09-17T03:35:32.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.535+0000 7ffb3e59c640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb20078b90 0x7ffb2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:32.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.536+0000 7ffb3e59c640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb20078b90 0x7ffb2007b0a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007fd0 tx=0x7ffb30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:32.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.540+0000 7ffb2effd640 1 -- 172.21.15.146:0/3040387260 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffb38014070 con 0x7ffb400d1190 2024-09-17T03:35:32.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:32.750+0000 7ffb44c25640 1 -- 172.21.15.146:0/3040387260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ffb400c67a0 con 0x7ffb400d1190 2024-09-17T03:35:33.353 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-09-17T03:35:33.354+0000 7f57b224f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:35:33.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.408+0000 7ffb2effd640 1 -- 172.21.15.146:0/3040387260 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7ffb38063c80 con 0x7ffb400d1190 2024-09-17T03:35:33.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.410+0000 7ffb44c25640 1 -- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb20078b90 msgr2=0x7ffb2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.410+0000 7ffb44c25640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb20078b90 0x7ffb2007b0a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb30007fd0 tx=0x7ffb30009040 comp rx=0 tx=0).stop 2024-09-17T03:35:33.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.410+0000 7ffb44c25640 1 -- 172.21.15.146:0/3040387260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb400d1190 msgr2=0x7ffb401e3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.410+0000 7ffb44c25640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb400d1190 0x7ffb401e3500 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800cae0 tx=0x7ffb38007220 comp rx=0 tx=0).stop 2024-09-17T03:35:33.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.410+0000 7ffb44c25640 1 -- 172.21.15.146:0/3040387260 shutdown_connections 2024-09-17T03:35:33.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.410+0000 7ffb44c25640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb20078b90 0x7ffb2007b0a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.410+0000 7ffb44c25640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb400d1190 0x7ffb401e3500 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.411+0000 7ffb44c25640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb400cefe0 0x7ffb401e18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.411+0000 7ffb44c25640 1 --2- 172.21.15.146:0/3040387260 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb400b7580 0x7ffb400c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.411+0000 7ffb44c25640 1 -- 172.21.15.146:0/3040387260 >> 172.21.15.146:0/3040387260 conn(0x7ffb4009ba20 msgr2=0x7ffb400ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:33.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.411+0000 7ffb44c25640 1 -- 172.21.15.146:0/3040387260 shutdown_connections 2024-09-17T03:35:33.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.411+0000 7ffb44c25640 1 -- 172.21.15.146:0/3040387260 wait complete. 2024-09-17T03:35:33.422 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:35:33.422 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:33.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.540+0000 7fb10c520640 1 -- 172.21.15.146:0/1867109590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb10415c8e0 msgr2=0x7fb10406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.540+0000 7fb10c520640 1 --2- 172.21.15.146:0/1867109590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb10415c8e0 0x7fb10406f580 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb100005fd0 tx=0x7fb10002a540 comp rx=0 tx=0).stop 2024-09-17T03:35:33.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.540+0000 7fb10c520640 1 -- 172.21.15.146:0/1867109590 shutdown_connections 2024-09-17T03:35:33.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.540+0000 7fb10c520640 1 --2- 172.21.15.146:0/1867109590 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1040cd840 0x7fb1040b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.540+0000 7fb10c520640 1 --2- 172.21.15.146:0/1867109590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb10415c8e0 0x7fb10406f580 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.540+0000 7fb10c520640 1 -- 172.21.15.146:0/1867109590 >> 172.21.15.146:0/1867109590 conn(0x7fb1040b3150 msgr2=0x7fb1040b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:33.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.540+0000 7fb10c520640 1 -- 172.21.15.146:0/1867109590 shutdown_connections 2024-09-17T03:35:33.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.540+0000 7fb10c520640 1 -- 172.21.15.146:0/1867109590 wait complete. 2024-09-17T03:35:33.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.542+0000 7fb10c520640 1 Processor -- start 2024-09-17T03:35:33.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.542+0000 7fb10c520640 1 -- start start 2024-09-17T03:35:33.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10c520640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1040cd840 0x7fb1041f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10c520640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1040cdc50 0x7fb1041e84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10c520640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb10415c8e0 0x7fb104157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10c520640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb104073580 con 0x7fb1040cd840 2024-09-17T03:35:33.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10c520640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb1040b5e10 con 0x7fb1040cdc50 2024-09-17T03:35:33.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10c520640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb104073700 con 0x7fb10415c8e0 2024-09-17T03:35:33.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10a2bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1040cd840 0x7fb1041f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:33.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10a2bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1040cd840 0x7fb1041f5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44374/0 (socket says 172.21.15.146:44374) 2024-09-17T03:35:33.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10a2bc640 1 -- 172.21.15.146:0/3847763400 learned_addr learned my addr 172.21.15.146:0/3847763400 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:33.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb109abb640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1040cdc50 0x7fb1041e84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:33.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10aabd640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb10415c8e0 0x7fb104157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:33.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10a2bc640 1 -- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb10415c8e0 msgr2=0x7fb104157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10a2bc640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb10415c8e0 0x7fb104157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10a2bc640 1 -- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1040cdc50 msgr2=0x7fb1041e84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10a2bc640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1040cdc50 0x7fb1041e84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10a2bc640 1 -- 172.21.15.146:0/3847763400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1041f6930 con 0x7fb1040cd840 2024-09-17T03:35:33.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.543+0000 7fb10a2bc640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1040cd840 0x7fb1041f5980 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb100034040 tx=0x7fb100003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:33.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.544+0000 7fb0faffd640 1 -- 172.21.15.146:0/3847763400 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10003e030 con 0x7fb1040cd840 2024-09-17T03:35:33.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.544+0000 7fb0faffd640 1 -- 172.21.15.146:0/3847763400 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb100003e00 con 0x7fb1040cd840 2024-09-17T03:35:33.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.544+0000 7fb10c520640 1 -- 172.21.15.146:0/3847763400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1041f6370 con 0x7fb1040cd840 2024-09-17T03:35:33.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.544+0000 7fb0faffd640 1 -- 172.21.15.146:0/3847763400 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100035040 con 0x7fb1040cd840 2024-09-17T03:35:33.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.544+0000 7fb10c520640 1 -- 172.21.15.146:0/3847763400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb104154c00 con 0x7fb1040cd840 2024-09-17T03:35:33.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.545+0000 7fb10c520640 1 -- 172.21.15.146:0/3847763400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb104073bb0 con 0x7fb1040cd840 2024-09-17T03:35:33.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.545+0000 7fb0faffd640 1 -- 172.21.15.146:0/3847763400 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb100041030 con 0x7fb1040cd840 2024-09-17T03:35:33.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.546+0000 7fb0faffd640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0e8078b90 0x7fb0e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.546+0000 7fb0faffd640 1 -- 172.21.15.146:0/3847763400 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb1000bb470 con 0x7fb1040cd840 2024-09-17T03:35:33.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.546+0000 7fb109abb640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0e8078b90 0x7fb0e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:33.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.547+0000 7fb109abb640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0e8078b90 0x7fb0e807b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4005fd0 tx=0x7fb0f4005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:33.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.550+0000 7fb0faffd640 1 -- 172.21.15.146:0/3847763400 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb100083940 con 0x7fb1040cd840 2024-09-17T03:35:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.759+0000 7fb10c520640 1 -- 172.21.15.146:0/3847763400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1041f5ec0 con 0x7fb1040cd840 2024-09-17T03:35:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.760+0000 7fb0faffd640 1 -- 172.21.15.146:0/3847763400 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5229 (secure 0 0 0) 0x7fb100083240 con 0x7fb1040cd840 2024-09-17T03:35:33.759 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:33.759 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"btime":"2024-09-17T03:35:33:398538+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2310307824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2310307824},{"type":"v1","addr":"172.21.15.179:6836","nonce":2310307824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/422393296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":422393296},{"type":"v1","addr":"172.21.15.179:6837","nonce":422393296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3793010114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3793010114},{"type":"v1","addr":"172.21.15.146:6833","nonce":3793010114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:30.743460+0000","modified":"2024-09-17T03:35:32.751716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/924109004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":924109004},{"type":"v1","addr":"172.21.15.146:6835","nonce":924109004}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5400,"qdb_cluster":[5400]},"id":3}]} 2024-09-17T03:35:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 -- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0e8078b90 msgr2=0x7fb0e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0e8078b90 0x7fb0e807b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4005fd0 tx=0x7fb0f4005850 comp rx=0 tx=0).stop 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 -- 172.21.15.146:0/3847763400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1040cd840 msgr2=0x7fb1041f5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1040cd840 0x7fb1041f5980 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb100034040 tx=0x7fb100003910 comp rx=0 tx=0).stop 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 -- 172.21.15.146:0/3847763400 shutdown_connections 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0e8078b90 0x7fb0e807b0a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb10415c8e0 0x7fb104157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1040cdc50 0x7fb1041e84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 --2- 172.21.15.146:0/3847763400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1040cd840 0x7fb1041f5980 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 -- 172.21.15.146:0/3847763400 >> 172.21.15.146:0/3847763400 conn(0x7fb1040b3150 msgr2=0x7fb1040d0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 -- 172.21.15.146:0/3847763400 shutdown_connections 2024-09-17T03:35:33.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.762+0000 7fb10c520640 1 -- 172.21.15.146:0/3847763400 wait complete. 2024-09-17T03:35:33.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:35:33.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.887+0000 7fa159227640 1 -- 172.21.15.146:0/3084385970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa154072680 msgr2=0x7fa154072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.887+0000 7fa159227640 1 --2- 172.21.15.146:0/3084385970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa154072680 0x7fa154072a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa13c009820 tx=0x7fa13c02a480 comp rx=0 tx=0).stop 2024-09-17T03:35:33.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.887+0000 7fa159227640 1 -- 172.21.15.146:0/3084385970 shutdown_connections 2024-09-17T03:35:33.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.887+0000 7fa159227640 1 --2- 172.21.15.146:0/3084385970 >> v2:172.21.15.179:3300/0 conn(0x7fa1540b4370 0x7fa1540b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.887+0000 7fa159227640 1 --2- 172.21.15.146:0/3084385970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa154072680 0x7fa154072a90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.887+0000 7fa159227640 1 -- 172.21.15.146:0/3084385970 >> 172.21.15.146:0/3084385970 conn(0x7fa1540b2060 msgr2=0x7fa1540b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:33.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.887+0000 7fa159227640 1 -- 172.21.15.146:0/3084385970 shutdown_connections 2024-09-17T03:35:33.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.887+0000 7fa159227640 1 -- 172.21.15.146:0/3084385970 wait complete. 2024-09-17T03:35:33.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.889+0000 7fa159227640 1 Processor -- start 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.889+0000 7fa159227640 1 -- start start 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.890+0000 7fa159227640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa154072680 0x7fa1540ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.890+0000 7fa159227640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1540b4370 0x7fa154158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.890+0000 7fa159227640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa15415b770 0x7fa1541e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.890+0000 7fa159227640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa1540b4e40 con 0x7fa1540b4370 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.890+0000 7fa159227640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa1540b4cc0 con 0x7fa15415b770 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.890+0000 7fa159227640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa1540b4fc0 con 0x7fa154072680 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.890+0000 7fa14a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1540b4370 0x7fa154158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.890+0000 7fa14a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1540b4370 0x7fa154158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44376/0 (socket says 172.21.15.146:44376) 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.890+0000 7fa14a59c640 1 -- 172.21.15.146:0/2843336094 learned_addr learned my addr 172.21.15.146:0/2843336094 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa152d9d640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa154072680 0x7fa1540ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:33.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa15359e640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa15415b770 0x7fa1541e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa14a59c640 1 -- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa154072680 msgr2=0x7fa1540ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa14a59c640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa154072680 0x7fa1540ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa14a59c640 1 -- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa15415b770 msgr2=0x7fa1541e4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa14a59c640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa15415b770 0x7fa1541e4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa14a59c640 1 -- 172.21.15.146:0/2843336094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1541e4100 con 0x7fa1540b4370 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa15359e640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa15415b770 0x7fa1541e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa14a59c640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1540b4370 0x7fa154158d10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa13c02aa70 tx=0x7fa13c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa14bfff640 1 -- 172.21.15.146:0/2843336094 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c041070 con 0x7fa1540b4370 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa14bfff640 1 -- 172.21.15.146:0/2843336094 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa13c004e50 con 0x7fa1540b4370 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa159227640 1 -- 172.21.15.146:0/2843336094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1541e43e0 con 0x7fa1540b4370 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa14bfff640 1 -- 172.21.15.146:0/2843336094 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c005040 con 0x7fa1540b4370 2024-09-17T03:35:33.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.891+0000 7fa159227640 1 -- 172.21.15.146:0/2843336094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa154159540 con 0x7fa1540b4370 2024-09-17T03:35:33.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.892+0000 7fa159227640 1 -- 172.21.15.146:0/2843336094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1540cf240 con 0x7fa1540b4370 2024-09-17T03:35:33.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.893+0000 7fa14bfff640 1 -- 172.21.15.146:0/2843336094 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa13c044070 con 0x7fa1540b4370 2024-09-17T03:35:33.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.893+0000 7fa14bfff640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa134078bc0 0x7fa13407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:33.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.893+0000 7fa14bfff640 1 -- 172.21.15.146:0/2843336094 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fa13c0be3c0 con 0x7fa1540b4370 2024-09-17T03:35:33.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.893+0000 7fa152d9d640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa134078bc0 0x7fa13407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:33.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.894+0000 7fa152d9d640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa134078bc0 0x7fa13407b0d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa144001600 tx=0x7fa144009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:33.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:33.898+0000 7fa14bfff640 1 -- 172.21.15.146:0/2843336094 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa13c086950 con 0x7fa1540b4370 2024-09-17T03:35:34.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.072+0000 7fa159227640 1 -- 172.21.15.146:0/2843336094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1540b5580 con 0x7fa1540b4370 2024-09-17T03:35:34.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.073+0000 7fa14bfff640 1 -- 172.21.15.146:0/2843336094 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16721 (secure 0 0 0) 0x7fa13c086250 con 0x7fa1540b4370 2024-09-17T03:35:34.073 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:34.073 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":45,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:35:32.391679+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:28.420197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:29.707406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:35:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 -- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa134078bc0 msgr2=0x7fa13407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa134078bc0 0x7fa13407b0d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa144001600 tx=0x7fa144009040 comp rx=0 tx=0).stop 2024-09-17T03:35:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 -- 172.21.15.146:0/2843336094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1540b4370 msgr2=0x7fa154158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1540b4370 0x7fa154158d10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa13c02aa70 tx=0x7fa13c004a50 comp rx=0 tx=0).stop 2024-09-17T03:35:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 -- 172.21.15.146:0/2843336094 shutdown_connections 2024-09-17T03:35:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa134078bc0 0x7fa13407b0d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa15415b770 0x7fa1541e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1540b4370 0x7fa154158d10 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 --2- 172.21.15.146:0/2843336094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa154072680 0x7fa1540ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 -- 172.21.15.146:0/2843336094 >> 172.21.15.146:0/2843336094 conn(0x7fa1540b2060 msgr2=0x7fa1540cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:34.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 -- 172.21.15.146:0/2843336094 shutdown_connections 2024-09-17T03:35:34.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.076+0000 7fa159227640 1 -- 172.21.15.146:0/2843336094 wait complete. 2024-09-17T03:35:34.086 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:35:34.086 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:35:34.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.200+0000 7f34b74dd640 1 -- 172.21.15.146:0/3825093956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34b00cd990 msgr2=0x7f34b0074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.200+0000 7f34b74dd640 1 --2- 172.21.15.146:0/3825093956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34b00cd990 0x7f34b0074740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f34ac005fd0 tx=0x7f34ac02a4b0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.200+0000 7f34b74dd640 1 -- 172.21.15.146:0/3825093956 shutdown_connections 2024-09-17T03:35:34.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.200+0000 7f34b74dd640 1 --2- 172.21.15.146:0/3825093956 >> v2:172.21.15.179:3300/0 conn(0x7f34b015b8c0 0x7f34b006f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.200+0000 7f34b74dd640 1 --2- 172.21.15.146:0/3825093956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34b00cd990 0x7f34b0074740 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.200+0000 7f34b74dd640 1 -- 172.21.15.146:0/3825093956 >> 172.21.15.146:0/3825093956 conn(0x7f34b00b2950 msgr2=0x7f34b00b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.200+0000 7f34b74dd640 1 -- 172.21.15.146:0/3825093956 shutdown_connections 2024-09-17T03:35:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.200+0000 7f34b74dd640 1 -- 172.21.15.146:0/3825093956 wait complete. 2024-09-17T03:35:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.202+0000 7f34b74dd640 1 Processor -- start 2024-09-17T03:35:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.202+0000 7f34b74dd640 1 -- start start 2024-09-17T03:35:34.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b74dd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34b006fec0 0x7f34b00aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b74dd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34b00cd990 0x7f34b015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b74dd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34b015b8c0 0x7f34b015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b74dd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f34b0073d40 con 0x7f34b00cd990 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b74dd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34b0072f20 con 0x7f34b015b8c0 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b74dd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f34b01440d0 con 0x7f34b006fec0 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b4a78640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34b00cd990 0x7f34b015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b4a78640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34b00cd990 0x7f34b015a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44386/0 (socket says 172.21.15.146:44386) 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b4a78640 1 -- 172.21.15.146:0/1584833714 learned_addr learned my addr 172.21.15.146:0/1584833714 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b5279640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34b006fec0 0x7f34b00aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b5a7a640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34b015b8c0 0x7f34b015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b4a78640 1 -- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34b006fec0 msgr2=0x7f34b00aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.203+0000 7f34b4a78640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34b006fec0 0x7f34b00aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.204+0000 7f34b4a78640 1 -- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34b015b8c0 msgr2=0x7f34b015aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.204+0000 7f34b4a78640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34b015b8c0 0x7f34b015aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.204+0000 7f34b4a78640 1 -- 172.21.15.146:0/1584833714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b0145f40 con 0x7f34b00cd990 2024-09-17T03:35:34.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.204+0000 7f34b4a78640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34b00cd990 0x7f34b015a960 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f34a000e7c0 tx=0x7f34a000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:34.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.204+0000 7f34a5ffb640 1 -- 172.21.15.146:0/1584833714 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a000ccc0 con 0x7f34b00cd990 2024-09-17T03:35:34.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.204+0000 7f34b74dd640 1 -- 172.21.15.146:0/1584833714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b0145180 con 0x7f34b00cd990 2024-09-17T03:35:34.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.204+0000 7f34a5ffb640 1 -- 172.21.15.146:0/1584833714 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34a000ee70 con 0x7f34b00cd990 2024-09-17T03:35:34.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.204+0000 7f34a5ffb640 1 -- 172.21.15.146:0/1584833714 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a0010690 con 0x7f34b00cd990 2024-09-17T03:35:34.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.204+0000 7f34b74dd640 1 -- 172.21.15.146:0/1584833714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b0145740 con 0x7f34b00cd990 2024-09-17T03:35:34.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.205+0000 7f34b74dd640 1 -- 172.21.15.146:0/1584833714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b01f4500 con 0x7f34b00cd990 2024-09-17T03:35:34.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.206+0000 7f34a5ffb640 1 -- 172.21.15.146:0/1584833714 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34a0010830 con 0x7f34b00cd990 2024-09-17T03:35:34.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.206+0000 7f34a5ffb640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3494078b90 0x7f349407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.206+0000 7f34a5ffb640 1 -- 172.21.15.146:0/1584833714 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f34a009b640 con 0x7f34b00cd990 2024-09-17T03:35:34.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.207+0000 7f34b5279640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3494078b90 0x7f349407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.207+0000 7f34b5279640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3494078b90 0x7f349407b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f34ac033000 tx=0x7f34ac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:34.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.211+0000 7f34a5ffb640 1 -- 172.21.15.146:0/1584833714 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f34a0063440 con 0x7f34b00cd990 2024-09-17T03:35:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.383+0000 7f34b74dd640 1 -- 172.21.15.146:0/1584833714 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34b00af310 con 0x7f3494078b90 2024-09-17T03:35:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.388+0000 7f34a5ffb640 1 -- 172.21.15.146:0/1584833714 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242945 (secure 0 0 0) 0x7f34ac0055c0 con 0x7f3494078b90 2024-09-17T03:35:34.389 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:35:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 -- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3494078b90 msgr2=0x7f349407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3494078b90 0x7f349407b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f34ac033000 tx=0x7f34ac004730 comp rx=0 tx=0).stop 2024-09-17T03:35:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 -- 172.21.15.146:0/1584833714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34b00cd990 msgr2=0x7f34b015a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34b00cd990 0x7f34b015a960 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f34a000e7c0 tx=0x7f34a000ec80 comp rx=0 tx=0).stop 2024-09-17T03:35:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 -- 172.21.15.146:0/1584833714 shutdown_connections 2024-09-17T03:35:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3494078b90 0x7f349407b0a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34b015b8c0 0x7f34b015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34b00cd990 0x7f34b015a960 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 --2- 172.21.15.146:0/1584833714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34b006fec0 0x7f34b00aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 -- 172.21.15.146:0/1584833714 >> 172.21.15.146:0/1584833714 conn(0x7f34b00b2950 msgr2=0x7f34b0157570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 -- 172.21.15.146:0/1584833714 shutdown_connections 2024-09-17T03:35:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.391+0000 7f34b74dd640 1 -- 172.21.15.146:0/1584833714 wait complete. 2024-09-17T03:35:34.402 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-17T03:35:33.827007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":96,"acting":96,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":283580,"kb_used_data":4928,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754691140,"statfs":{"total":773094113280,"available":772803727360,"internally_reserved":0,"allocated":5046272,"data_stored":2709730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.452073"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.411529+0000","last_change":"2024-09-17T03:35:31.409810+0000","last_active":"2024-09-17T03:35:31.411529+0000","last_peered":"2024-09-17T03:35:31.411529+0000","last_clean":"2024-09-17T03:35:31.411529+0000","last_became_active":"2024-09-17T03:35:31.409035+0000","last_became_peered":"2024-09-17T03:35:31.409035+0000","last_unstale":"2024-09-17T03:35:31.411529+0000","last_undegraded":"2024-09-17T03:35:31.411529+0000","last_fullsized":"2024-09-17T03:35:31.411529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:29.696914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.410306+0000","last_change":"2024-09-17T03:35:31.406083+0000","last_active":"2024-09-17T03:35:31.410306+0000","last_peered":"2024-09-17T03:35:31.410306+0000","last_clean":"2024-09-17T03:35:31.410306+0000","last_became_active":"2024-09-17T03:35:31.405778+0000","last_became_peered":"2024-09-17T03:35:31.405778+0000","last_unstale":"2024-09-17T03:35:31.410306+0000","last_undegraded":"2024-09-17T03:35:31.410306+0000","last_fullsized":"2024-09-17T03:35:31.410306+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:12.145737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414293+0000","last_change":"2024-09-17T03:35:31.405448+0000","last_active":"2024-09-17T03:35:31.414293+0000","last_peered":"2024-09-17T03:35:31.414293+0000","last_clean":"2024-09-17T03:35:31.414293+0000","last_became_active":"2024-09-17T03:35:31.404612+0000","last_became_peered":"2024-09-17T03:35:31.404612+0000","last_unstale":"2024-09-17T03:35:31.414293+0000","last_undegraded":"2024-09-17T03:35:31.414293+0000","last_fullsized":"2024-09-17T03:35:31.414293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:09.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.410987+0000","last_change":"2024-09-17T03:35:31.406987+0000","last_active":"2024-09-17T03:35:31.410987+0000","last_peered":"2024-09-17T03:35:31.410987+0000","last_clean":"2024-09-17T03:35:31.410987+0000","last_became_active":"2024-09-17T03:35:31.406667+0000","last_became_peered":"2024-09-17T03:35:31.406667+0000","last_unstale":"2024-09-17T03:35:31.410987+0000","last_undegraded":"2024-09-17T03:35:31.410987+0000","last_fullsized":"2024-09-17T03:35:31.410987+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:02.196006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418047+0000","last_change":"2024-09-17T03:35:31.412835+0000","last_active":"2024-09-17T03:35:31.418047+0000","last_peered":"2024-09-17T03:35:31.418047+0000","last_clean":"2024-09-17T03:35:31.418047+0000","last_became_active":"2024-09-17T03:35:31.412198+0000","last_became_peered":"2024-09-17T03:35:31.412198+0000","last_unstale":"2024-09-17T03:35:31.418047+0000","last_undegraded":"2024-09-17T03:35:31.418047+0000","last_fullsized":"2024-09-17T03:35:31.418047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:55.296103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.415609+0000","last_change":"2024-09-17T03:35:31.407472+0000","last_active":"2024-09-17T03:35:31.415609+0000","last_peered":"2024-09-17T03:35:31.415609+0000","last_clean":"2024-09-17T03:35:31.415609+0000","last_became_active":"2024-09-17T03:35:31.407113+0000","last_became_peered":"2024-09-17T03:35:31.407113+0000","last_unstale":"2024-09-17T03:35:31.415609+0000","last_undegraded":"2024-09-17T03:35:31.415609+0000","last_fullsized":"2024-09-17T03:35:31.415609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:54.277873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.409711+0000","last_change":"2024-09-17T03:35:31.405766+0000","last_active":"2024-09-17T03:35:31.409711+0000","last_peered":"2024-09-17T03:35:31.409711+0000","last_clean":"2024-09-17T03:35:31.409711+0000","last_became_active":"2024-09-17T03:35:31.405486+0000","last_became_peered":"2024-09-17T03:35:31.405486+0000","last_unstale":"2024-09-17T03:35:31.409711+0000","last_undegraded":"2024-09-17T03:35:31.409711+0000","last_fullsized":"2024-09-17T03:35:31.409711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:30.491636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418468+0000","last_change":"2024-09-17T03:35:31.414578+0000","last_active":"2024-09-17T03:35:31.418468+0000","last_peered":"2024-09-17T03:35:31.418468+0000","last_clean":"2024-09-17T03:35:31.418468+0000","last_became_active":"2024-09-17T03:35:31.414262+0000","last_became_peered":"2024-09-17T03:35:31.414262+0000","last_unstale":"2024-09-17T03:35:31.418468+0000","last_undegraded":"2024-09-17T03:35:31.418468+0000","last_fullsized":"2024-09-17T03:35:31.418468+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:32.910866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420476+0000","last_change":"2024-09-17T03:35:30.397571+0000","last_active":"2024-09-17T03:35:31.420476+0000","last_peered":"2024-09-17T03:35:31.420476+0000","last_clean":"2024-09-17T03:35:31.420476+0000","last_became_active":"2024-09-17T03:35:30.397265+0000","last_became_peered":"2024-09-17T03:35:30.397265+0000","last_unstale":"2024-09-17T03:35:31.420476+0000","last_undegraded":"2024-09-17T03:35:31.420476+0000","last_fullsized":"2024-09-17T03:35:31.420476+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:28.399672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.377555+0000","last_change":"2024-09-17T03:35:29.377555+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.377555+0000","last_undegraded":"2024-09-17T03:35:29.377555+0000","last_fullsized":"2024-09-17T03:35:29.377555+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414454+0000","last_change":"2024-09-17T03:35:31.413962+0000","last_active":"2024-09-17T03:35:31.414454+0000","last_peered":"2024-09-17T03:35:31.414454+0000","last_clean":"2024-09-17T03:35:31.414454+0000","last_became_active":"2024-09-17T03:35:31.413687+0000","last_became_peered":"2024-09-17T03:35:31.413687+0000","last_unstale":"2024-09-17T03:35:31.414454+0000","last_undegraded":"2024-09-17T03:35:31.414454+0000","last_fullsized":"2024-09-17T03:35:31.414454+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:15.856455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.378647+0000","last_change":"2024-09-17T03:35:29.378647+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.378647+0000","last_undegraded":"2024-09-17T03:35:29.378647+0000","last_fullsized":"2024-09-17T03:35:29.378647+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382036+0000","last_change":"2024-09-17T03:35:29.382036+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382036+0000","last_undegraded":"2024-09-17T03:35:29.382036+0000","last_fullsized":"2024-09-17T03:35:29.382036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420303+0000","last_change":"2024-09-17T03:35:30.397347+0000","last_active":"2024-09-17T03:35:31.420303+0000","last_peered":"2024-09-17T03:35:31.420303+0000","last_clean":"2024-09-17T03:35:31.420303+0000","last_became_active":"2024-09-17T03:35:30.397032+0000","last_became_peered":"2024-09-17T03:35:30.397032+0000","last_unstale":"2024-09-17T03:35:31.420303+0000","last_undegraded":"2024-09-17T03:35:31.420303+0000","last_fullsized":"2024-09-17T03:35:31.420303+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:30.018392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.377545+0000","last_change":"2024-09-17T03:35:29.377545+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.377545+0000","last_undegraded":"2024-09-17T03:35:29.377545+0000","last_fullsized":"2024-09-17T03:35:29.377545+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.392717+0000","last_change":"2024-09-17T03:35:30.395877+0000","last_active":"2024-09-17T03:35:31.392717+0000","last_peered":"2024-09-17T03:35:31.392717+0000","last_clean":"2024-09-17T03:35:31.392717+0000","last_became_active":"2024-09-17T03:35:30.395247+0000","last_became_peered":"2024-09-17T03:35:30.395247+0000","last_unstale":"2024-09-17T03:35:31.392717+0000","last_undegraded":"2024-09-17T03:35:31.392717+0000","last_fullsized":"2024-09-17T03:35:31.392717+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:14.615340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382739+0000","last_change":"2024-09-17T03:35:29.382739+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382739+0000","last_undegraded":"2024-09-17T03:35:29.382739+0000","last_fullsized":"2024-09-17T03:35:29.382739+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.376834+0000","last_change":"2024-09-17T03:35:29.376834+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.376834+0000","last_undegraded":"2024-09-17T03:35:29.376834+0000","last_fullsized":"2024-09-17T03:35:29.376834+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381880+0000","last_change":"2024-09-17T03:35:29.381880+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381880+0000","last_undegraded":"2024-09-17T03:35:29.381880+0000","last_fullsized":"2024-09-17T03:35:29.381880+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418539+0000","last_change":"2024-09-17T03:35:31.414900+0000","last_active":"2024-09-17T03:35:31.418539+0000","last_peered":"2024-09-17T03:35:31.418539+0000","last_clean":"2024-09-17T03:35:31.418539+0000","last_became_active":"2024-09-17T03:35:31.414601+0000","last_became_peered":"2024-09-17T03:35:31.414601+0000","last_unstale":"2024-09-17T03:35:31.418539+0000","last_undegraded":"2024-09-17T03:35:31.418539+0000","last_fullsized":"2024-09-17T03:35:31.418539+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:47.578570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.383178+0000","last_change":"2024-09-17T03:35:29.383178+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.383178+0000","last_undegraded":"2024-09-17T03:35:29.383178+0000","last_fullsized":"2024-09-17T03:35:29.383178+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.379213+0000","last_change":"2024-09-17T03:35:29.379213+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.379213+0000","last_undegraded":"2024-09-17T03:35:29.379213+0000","last_fullsized":"2024-09-17T03:35:29.379213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418638+0000","last_change":"2024-09-17T03:35:30.400765+0000","last_active":"2024-09-17T03:35:31.418638+0000","last_peered":"2024-09-17T03:35:31.418638+0000","last_clean":"2024-09-17T03:35:31.418638+0000","last_became_active":"2024-09-17T03:35:30.400244+0000","last_became_peered":"2024-09-17T03:35:30.400244+0000","last_unstale":"2024-09-17T03:35:31.418638+0000","last_undegraded":"2024-09-17T03:35:31.418638+0000","last_fullsized":"2024-09-17T03:35:31.418638+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:07.625536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382833+0000","last_change":"2024-09-17T03:35:29.382833+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382833+0000","last_undegraded":"2024-09-17T03:35:29.382833+0000","last_fullsized":"2024-09-17T03:35:29.382833+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.417835+0000","last_change":"2024-09-17T03:35:31.411302+0000","last_active":"2024-09-17T03:35:31.417835+0000","last_peered":"2024-09-17T03:35:31.417835+0000","last_clean":"2024-09-17T03:35:31.417835+0000","last_became_active":"2024-09-17T03:35:31.411018+0000","last_became_peered":"2024-09-17T03:35:31.411018+0000","last_unstale":"2024-09-17T03:35:31.417835+0000","last_undegraded":"2024-09-17T03:35:31.417835+0000","last_fullsized":"2024-09-17T03:35:31.417835+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:24.509256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.389019+0000","last_change":"2024-09-17T03:35:30.395268+0000","last_active":"2024-09-17T03:35:31.389019+0000","last_peered":"2024-09-17T03:35:31.389019+0000","last_clean":"2024-09-17T03:35:31.389019+0000","last_became_active":"2024-09-17T03:35:30.394971+0000","last_became_peered":"2024-09-17T03:35:30.394971+0000","last_unstale":"2024-09-17T03:35:31.389019+0000","last_undegraded":"2024-09-17T03:35:31.389019+0000","last_fullsized":"2024-09-17T03:35:31.389019+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:33.367494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382177+0000","last_change":"2024-09-17T03:35:29.382177+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382177+0000","last_undegraded":"2024-09-17T03:35:29.382177+0000","last_fullsized":"2024-09-17T03:35:29.382177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.379244+0000","last_change":"2024-09-17T03:35:29.379244+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.379244+0000","last_undegraded":"2024-09-17T03:35:29.379244+0000","last_fullsized":"2024-09-17T03:35:29.379244+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.376893+0000","last_change":"2024-09-17T03:35:29.376893+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.376893+0000","last_undegraded":"2024-09-17T03:35:29.376893+0000","last_fullsized":"2024-09-17T03:35:29.376893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.407210+0000","last_change":"2024-09-17T03:35:30.396610+0000","last_active":"2024-09-17T03:35:31.407210+0000","last_peered":"2024-09-17T03:35:31.407210+0000","last_clean":"2024-09-17T03:35:31.407210+0000","last_became_active":"2024-09-17T03:35:30.396283+0000","last_became_peered":"2024-09-17T03:35:30.396283+0000","last_unstale":"2024-09-17T03:35:31.407210+0000","last_undegraded":"2024-09-17T03:35:31.407210+0000","last_fullsized":"2024-09-17T03:35:31.407210+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:23.780096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.397521+0000","last_change":"2024-09-17T03:35:30.393748+0000","last_active":"2024-09-17T03:35:31.397521+0000","last_peered":"2024-09-17T03:35:31.397521+0000","last_clean":"2024-09-17T03:35:31.397521+0000","last_became_active":"2024-09-17T03:35:30.393414+0000","last_became_peered":"2024-09-17T03:35:30.393414+0000","last_unstale":"2024-09-17T03:35:31.397521+0000","last_undegraded":"2024-09-17T03:35:31.397521+0000","last_fullsized":"2024-09-17T03:35:31.397521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:58.947583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414334+0000","last_change":"2024-09-17T03:35:31.405793+0000","last_active":"2024-09-17T03:35:31.414334+0000","last_peered":"2024-09-17T03:35:31.414334+0000","last_clean":"2024-09-17T03:35:31.414334+0000","last_became_active":"2024-09-17T03:35:31.405147+0000","last_became_peered":"2024-09-17T03:35:31.405147+0000","last_unstale":"2024-09-17T03:35:31.414334+0000","last_undegraded":"2024-09-17T03:35:31.414334+0000","last_fullsized":"2024-09-17T03:35:31.414334+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:12.994357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420361+0000","last_change":"2024-09-17T03:35:30.396540+0000","last_active":"2024-09-17T03:35:31.420361+0000","last_peered":"2024-09-17T03:35:31.420361+0000","last_clean":"2024-09-17T03:35:31.420361+0000","last_became_active":"2024-09-17T03:35:30.396260+0000","last_became_peered":"2024-09-17T03:35:30.396260+0000","last_unstale":"2024-09-17T03:35:31.420361+0000","last_undegraded":"2024-09-17T03:35:31.420361+0000","last_fullsized":"2024-09-17T03:35:31.420361+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:46.350229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.393481+0000","last_change":"2024-09-17T03:35:30.392017+0000","last_active":"2024-09-17T03:35:31.393481+0000","last_peered":"2024-09-17T03:35:31.393481+0000","last_clean":"2024-09-17T03:35:31.393481+0000","last_became_active":"2024-09-17T03:35:30.391697+0000","last_became_peered":"2024-09-17T03:35:30.391697+0000","last_unstale":"2024-09-17T03:35:31.393481+0000","last_undegraded":"2024-09-17T03:35:31.393481+0000","last_fullsized":"2024-09-17T03:35:31.393481+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:02.448896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381662+0000","last_change":"2024-09-17T03:35:29.381662+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381662+0000","last_undegraded":"2024-09-17T03:35:29.381662+0000","last_fullsized":"2024-09-17T03:35:29.381662+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381951+0000","last_change":"2024-09-17T03:35:29.381951+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381951+0000","last_undegraded":"2024-09-17T03:35:29.381951+0000","last_fullsized":"2024-09-17T03:35:29.381951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.389515+0000","last_change":"2024-09-17T03:35:30.403062+0000","last_active":"2024-09-17T03:35:31.389515+0000","last_peered":"2024-09-17T03:35:31.389515+0000","last_clean":"2024-09-17T03:35:31.389515+0000","last_became_active":"2024-09-17T03:35:30.402662+0000","last_became_peered":"2024-09-17T03:35:30.402662+0000","last_unstale":"2024-09-17T03:35:31.389515+0000","last_undegraded":"2024-09-17T03:35:31.389515+0000","last_fullsized":"2024-09-17T03:35:31.389515+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:59.550123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382552+0000","last_change":"2024-09-17T03:35:29.382552+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382552+0000","last_undegraded":"2024-09-17T03:35:29.382552+0000","last_fullsized":"2024-09-17T03:35:29.382552+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.378646+0000","last_change":"2024-09-17T03:35:29.378646+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.378646+0000","last_undegraded":"2024-09-17T03:35:29.378646+0000","last_fullsized":"2024-09-17T03:35:29.378646+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414362+0000","last_change":"2024-09-17T03:35:31.409930+0000","last_active":"2024-09-17T03:35:31.414362+0000","last_peered":"2024-09-17T03:35:31.414362+0000","last_clean":"2024-09-17T03:35:31.414362+0000","last_became_active":"2024-09-17T03:35:31.407002+0000","last_became_peered":"2024-09-17T03:35:31.407002+0000","last_unstale":"2024-09-17T03:35:31.414362+0000","last_undegraded":"2024-09-17T03:35:31.414362+0000","last_fullsized":"2024-09-17T03:35:31.414362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:37.172164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382369+0000","last_change":"2024-09-17T03:35:29.382369+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382369+0000","last_undegraded":"2024-09-17T03:35:29.382369+0000","last_fullsized":"2024-09-17T03:35:29.382369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418566+0000","last_change":"2024-09-17T03:35:31.415927+0000","last_active":"2024-09-17T03:35:31.418566+0000","last_peered":"2024-09-17T03:35:31.418566+0000","last_clean":"2024-09-17T03:35:31.418566+0000","last_became_active":"2024-09-17T03:35:31.415622+0000","last_became_peered":"2024-09-17T03:35:31.415622+0000","last_unstale":"2024-09-17T03:35:31.418566+0000","last_undegraded":"2024-09-17T03:35:31.418566+0000","last_fullsized":"2024-09-17T03:35:31.418566+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:09.098082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.376836+0000","last_change":"2024-09-17T03:35:29.376836+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.376836+0000","last_undegraded":"2024-09-17T03:35:29.376836+0000","last_fullsized":"2024-09-17T03:35:29.376836+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.409739+0000","last_change":"2024-09-17T03:35:31.403965+0000","last_active":"2024-09-17T03:35:31.409739+0000","last_peered":"2024-09-17T03:35:31.409739+0000","last_clean":"2024-09-17T03:35:31.409739+0000","last_became_active":"2024-09-17T03:35:31.403611+0000","last_became_peered":"2024-09-17T03:35:31.403611+0000","last_unstale":"2024-09-17T03:35:31.409739+0000","last_undegraded":"2024-09-17T03:35:31.409739+0000","last_fullsized":"2024-09-17T03:35:31.409739+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:04.069685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.378640+0000","last_change":"2024-09-17T03:35:29.378640+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.378640+0000","last_undegraded":"2024-09-17T03:35:29.378640+0000","last_fullsized":"2024-09-17T03:35:29.378640+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381669+0000","last_change":"2024-09-17T03:35:29.381669+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381669+0000","last_undegraded":"2024-09-17T03:35:29.381669+0000","last_fullsized":"2024-09-17T03:35:29.381669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.413751+0000","last_change":"2024-09-17T03:35:30.395939+0000","last_active":"2024-09-17T03:35:31.413751+0000","last_peered":"2024-09-17T03:35:31.413751+0000","last_clean":"2024-09-17T03:35:31.413751+0000","last_became_active":"2024-09-17T03:35:30.395536+0000","last_became_peered":"2024-09-17T03:35:30.395536+0000","last_unstale":"2024-09-17T03:35:31.413751+0000","last_undegraded":"2024-09-17T03:35:31.413751+0000","last_fullsized":"2024-09-17T03:35:31.413751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:24.396630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":150,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-17T03:35:29.383769+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:35:29.383769+0000","last_peered":"2024-09-17T03:35:29.383769+0000","last_clean":"2024-09-17T03:35:29.383769+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:35:29.383769+0000","last_undegraded":"2024-09-17T03:35:29.383769+0000","last_fullsized":"2024-09-17T03:35:29.383769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":30,"acting":30,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1064960,"data_stored":776689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35820,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35808,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336032,"statfs":{"total":96636764160,"available":96600096768,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1064960,"data_stored":776689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":512000,"data_stored":205250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35856,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335984,"statfs":{"total":96636764160,"available":96600047616,"internally_reserved":0,"allocated":520192,"data_stored":205818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:35:34.407 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:35:34.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.557+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2863757120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b34070350 msgr2=0x7f9b34072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.557+0000 7f9b3b1cf640 1 --2- 172.21.15.146:0/2863757120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b34070350 0x7f9b34072680 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009bb0 tx=0x7f9b2802a820 comp rx=0 tx=0).stop 2024-09-17T03:35:34.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.557+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2863757120 shutdown_connections 2024-09-17T03:35:34.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.557+0000 7f9b3b1cf640 1 --2- 172.21.15.146:0/2863757120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b34070350 0x7f9b34072680 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.557+0000 7f9b3b1cf640 1 --2- 172.21.15.146:0/2863757120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b3415b770 0x7f9b3406fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.557+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2863757120 >> 172.21.15.146:0/2863757120 conn(0x7f9b340b2060 msgr2=0x7f9b340b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:34.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.557+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2863757120 shutdown_connections 2024-09-17T03:35:34.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.557+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2863757120 wait complete. 2024-09-17T03:35:34.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.558+0000 7f9b3b1cf640 1 Processor -- start 2024-09-17T03:35:34.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.559+0000 7f9b3b1cf640 1 -- start start 2024-09-17T03:35:34.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b3b1cf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b34070350 0x7f9b341f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b3b1cf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b34072bc0 0x7f9b3415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b3b1cf640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b3415b770 0x7f9b341508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b3b1cf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3415f9f0 con 0x7f9b34070350 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b3b1cf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9b340b5590 con 0x7f9b34072bc0 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b3b1cf640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3415fb70 con 0x7f9b3415b770 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b38f6b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b34070350 0x7f9b341f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b38f6b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b34070350 0x7f9b341f3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44400/0 (socket says 172.21.15.146:44400) 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b38f6b640 1 -- 172.21.15.146:0/2221060504 learned_addr learned my addr 172.21.15.146:0/2221060504 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b3976c640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b3415b770 0x7f9b341508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b33fff640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b34072bc0 0x7f9b3415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b38f6b640 1 -- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b3415b770 msgr2=0x7f9b341508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b38f6b640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b3415b770 0x7f9b341508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b38f6b640 1 -- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b34072bc0 msgr2=0x7f9b3415e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b38f6b640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b34072bc0 0x7f9b3415e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.560+0000 7f9b38f6b640 1 -- 172.21.15.146:0/2221060504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b341f4210 con 0x7f9b34070350 2024-09-17T03:35:34.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.561+0000 7f9b38f6b640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b34070350 0x7f9b341f3cd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400d740 tx=0x7f9b2400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:34.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.561+0000 7f9b317fa640 1 -- 172.21.15.146:0/2221060504 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24017070 con 0x7f9b34070350 2024-09-17T03:35:34.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.561+0000 7f9b317fa640 1 -- 172.21.15.146:0/2221060504 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b24009d20 con 0x7f9b34070350 2024-09-17T03:35:34.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.561+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2221060504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b34153470 con 0x7f9b34070350 2024-09-17T03:35:34.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.561+0000 7f9b317fa640 1 -- 172.21.15.146:0/2221060504 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b240106c0 con 0x7f9b34070350 2024-09-17T03:35:34.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.561+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2221060504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b34153a30 con 0x7f9b34070350 2024-09-17T03:35:34.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.562+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2221060504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b34050f60 con 0x7f9b34070350 2024-09-17T03:35:34.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.563+0000 7f9b317fa640 1 -- 172.21.15.146:0/2221060504 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b2401a070 con 0x7f9b34070350 2024-09-17T03:35:34.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.563+0000 7f9b317fa640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b20078b90 0x7f9b2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.563+0000 7f9b317fa640 1 -- 172.21.15.146:0/2221060504 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f9b2409af10 con 0x7f9b34070350 2024-09-17T03:35:34.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.563+0000 7f9b33fff640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b20078b90 0x7f9b2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.564+0000 7f9b33fff640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b20078b90 0x7f9b2007b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b34074da0 tx=0x7f9b28004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:34.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.568+0000 7f9b317fa640 1 -- 172.21.15.146:0/2221060504 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b34050f60 con 0x7f9b34070350 2024-09-17T03:35:34.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.740+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2221060504 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b341531f0 con 0x7f9b20078b90 2024-09-17T03:35:34.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.744+0000 7f9b317fa640 1 -- 172.21.15.146:0/2221060504 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242945 (secure 0 0 0) 0x7f9b28003a60 con 0x7f9b20078b90 2024-09-17T03:35:34.746 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:34.747 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:35:34.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.747+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b20078b90 msgr2=0x7f9b2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.747+0000 7f9b3b1cf640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b20078b90 0x7f9b2007b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b34074da0 tx=0x7f9b28004ab0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.747+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2221060504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b34070350 msgr2=0x7f9b341f3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.747+0000 7f9b3b1cf640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b34070350 0x7f9b341f3cd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400d740 tx=0x7f9b2400dc00 comp rx=0 tx=0).stop 2024-09-17T03:35:34.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.748+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2221060504 shutdown_connections 2024-09-17T03:35:34.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.748+0000 7f9b3b1cf640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b20078b90 0x7f9b2007b0a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.748+0000 7f9b3b1cf640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b3415b770 0x7f9b341508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.748+0000 7f9b3b1cf640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b34072bc0 0x7f9b3415e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.748+0000 7f9b3b1cf640 1 --2- 172.21.15.146:0/2221060504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b34070350 0x7f9b341f3cd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.748+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2221060504 >> 172.21.15.146:0/2221060504 conn(0x7f9b340b2060 msgr2=0x7f9b340b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.748+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2221060504 shutdown_connections 2024-09-17T03:35:34.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.748+0000 7f9b3b1cf640 1 -- 172.21.15.146:0/2221060504 wait complete. 2024-09-17T03:35:34.759 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-17T03:35:33.827007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":96,"acting":96,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":283580,"kb_used_data":4928,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754691140,"statfs":{"total":773094113280,"available":772803727360,"internally_reserved":0,"allocated":5046272,"data_stored":2709730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.452073"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.411529+0000","last_change":"2024-09-17T03:35:31.409810+0000","last_active":"2024-09-17T03:35:31.411529+0000","last_peered":"2024-09-17T03:35:31.411529+0000","last_clean":"2024-09-17T03:35:31.411529+0000","last_became_active":"2024-09-17T03:35:31.409035+0000","last_became_peered":"2024-09-17T03:35:31.409035+0000","last_unstale":"2024-09-17T03:35:31.411529+0000","last_undegraded":"2024-09-17T03:35:31.411529+0000","last_fullsized":"2024-09-17T03:35:31.411529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:29.696914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.410306+0000","last_change":"2024-09-17T03:35:31.406083+0000","last_active":"2024-09-17T03:35:31.410306+0000","last_peered":"2024-09-17T03:35:31.410306+0000","last_clean":"2024-09-17T03:35:31.410306+0000","last_became_active":"2024-09-17T03:35:31.405778+0000","last_became_peered":"2024-09-17T03:35:31.405778+0000","last_unstale":"2024-09-17T03:35:31.410306+0000","last_undegraded":"2024-09-17T03:35:31.410306+0000","last_fullsized":"2024-09-17T03:35:31.410306+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:12.145737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414293+0000","last_change":"2024-09-17T03:35:31.405448+0000","last_active":"2024-09-17T03:35:31.414293+0000","last_peered":"2024-09-17T03:35:31.414293+0000","last_clean":"2024-09-17T03:35:31.414293+0000","last_became_active":"2024-09-17T03:35:31.404612+0000","last_became_peered":"2024-09-17T03:35:31.404612+0000","last_unstale":"2024-09-17T03:35:31.414293+0000","last_undegraded":"2024-09-17T03:35:31.414293+0000","last_fullsized":"2024-09-17T03:35:31.414293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:09.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.410987+0000","last_change":"2024-09-17T03:35:31.406987+0000","last_active":"2024-09-17T03:35:31.410987+0000","last_peered":"2024-09-17T03:35:31.410987+0000","last_clean":"2024-09-17T03:35:31.410987+0000","last_became_active":"2024-09-17T03:35:31.406667+0000","last_became_peered":"2024-09-17T03:35:31.406667+0000","last_unstale":"2024-09-17T03:35:31.410987+0000","last_undegraded":"2024-09-17T03:35:31.410987+0000","last_fullsized":"2024-09-17T03:35:31.410987+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:02.196006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418047+0000","last_change":"2024-09-17T03:35:31.412835+0000","last_active":"2024-09-17T03:35:31.418047+0000","last_peered":"2024-09-17T03:35:31.418047+0000","last_clean":"2024-09-17T03:35:31.418047+0000","last_became_active":"2024-09-17T03:35:31.412198+0000","last_became_peered":"2024-09-17T03:35:31.412198+0000","last_unstale":"2024-09-17T03:35:31.418047+0000","last_undegraded":"2024-09-17T03:35:31.418047+0000","last_fullsized":"2024-09-17T03:35:31.418047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:55.296103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.415609+0000","last_change":"2024-09-17T03:35:31.407472+0000","last_active":"2024-09-17T03:35:31.415609+0000","last_peered":"2024-09-17T03:35:31.415609+0000","last_clean":"2024-09-17T03:35:31.415609+0000","last_became_active":"2024-09-17T03:35:31.407113+0000","last_became_peered":"2024-09-17T03:35:31.407113+0000","last_unstale":"2024-09-17T03:35:31.415609+0000","last_undegraded":"2024-09-17T03:35:31.415609+0000","last_fullsized":"2024-09-17T03:35:31.415609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:54.277873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.409711+0000","last_change":"2024-09-17T03:35:31.405766+0000","last_active":"2024-09-17T03:35:31.409711+0000","last_peered":"2024-09-17T03:35:31.409711+0000","last_clean":"2024-09-17T03:35:31.409711+0000","last_became_active":"2024-09-17T03:35:31.405486+0000","last_became_peered":"2024-09-17T03:35:31.405486+0000","last_unstale":"2024-09-17T03:35:31.409711+0000","last_undegraded":"2024-09-17T03:35:31.409711+0000","last_fullsized":"2024-09-17T03:35:31.409711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:30.491636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418468+0000","last_change":"2024-09-17T03:35:31.414578+0000","last_active":"2024-09-17T03:35:31.418468+0000","last_peered":"2024-09-17T03:35:31.418468+0000","last_clean":"2024-09-17T03:35:31.418468+0000","last_became_active":"2024-09-17T03:35:31.414262+0000","last_became_peered":"2024-09-17T03:35:31.414262+0000","last_unstale":"2024-09-17T03:35:31.418468+0000","last_undegraded":"2024-09-17T03:35:31.418468+0000","last_fullsized":"2024-09-17T03:35:31.418468+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:32.910866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420476+0000","last_change":"2024-09-17T03:35:30.397571+0000","last_active":"2024-09-17T03:35:31.420476+0000","last_peered":"2024-09-17T03:35:31.420476+0000","last_clean":"2024-09-17T03:35:31.420476+0000","last_became_active":"2024-09-17T03:35:30.397265+0000","last_became_peered":"2024-09-17T03:35:30.397265+0000","last_unstale":"2024-09-17T03:35:31.420476+0000","last_undegraded":"2024-09-17T03:35:31.420476+0000","last_fullsized":"2024-09-17T03:35:31.420476+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:28.399672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.377555+0000","last_change":"2024-09-17T03:35:29.377555+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.377555+0000","last_undegraded":"2024-09-17T03:35:29.377555+0000","last_fullsized":"2024-09-17T03:35:29.377555+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414454+0000","last_change":"2024-09-17T03:35:31.413962+0000","last_active":"2024-09-17T03:35:31.414454+0000","last_peered":"2024-09-17T03:35:31.414454+0000","last_clean":"2024-09-17T03:35:31.414454+0000","last_became_active":"2024-09-17T03:35:31.413687+0000","last_became_peered":"2024-09-17T03:35:31.413687+0000","last_unstale":"2024-09-17T03:35:31.414454+0000","last_undegraded":"2024-09-17T03:35:31.414454+0000","last_fullsized":"2024-09-17T03:35:31.414454+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:15.856455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.378647+0000","last_change":"2024-09-17T03:35:29.378647+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.378647+0000","last_undegraded":"2024-09-17T03:35:29.378647+0000","last_fullsized":"2024-09-17T03:35:29.378647+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382036+0000","last_change":"2024-09-17T03:35:29.382036+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382036+0000","last_undegraded":"2024-09-17T03:35:29.382036+0000","last_fullsized":"2024-09-17T03:35:29.382036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420303+0000","last_change":"2024-09-17T03:35:30.397347+0000","last_active":"2024-09-17T03:35:31.420303+0000","last_peered":"2024-09-17T03:35:31.420303+0000","last_clean":"2024-09-17T03:35:31.420303+0000","last_became_active":"2024-09-17T03:35:30.397032+0000","last_became_peered":"2024-09-17T03:35:30.397032+0000","last_unstale":"2024-09-17T03:35:31.420303+0000","last_undegraded":"2024-09-17T03:35:31.420303+0000","last_fullsized":"2024-09-17T03:35:31.420303+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:30.018392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.377545+0000","last_change":"2024-09-17T03:35:29.377545+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.377545+0000","last_undegraded":"2024-09-17T03:35:29.377545+0000","last_fullsized":"2024-09-17T03:35:29.377545+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.392717+0000","last_change":"2024-09-17T03:35:30.395877+0000","last_active":"2024-09-17T03:35:31.392717+0000","last_peered":"2024-09-17T03:35:31.392717+0000","last_clean":"2024-09-17T03:35:31.392717+0000","last_became_active":"2024-09-17T03:35:30.395247+0000","last_became_peered":"2024-09-17T03:35:30.395247+0000","last_unstale":"2024-09-17T03:35:31.392717+0000","last_undegraded":"2024-09-17T03:35:31.392717+0000","last_fullsized":"2024-09-17T03:35:31.392717+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:14.615340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382739+0000","last_change":"2024-09-17T03:35:29.382739+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382739+0000","last_undegraded":"2024-09-17T03:35:29.382739+0000","last_fullsized":"2024-09-17T03:35:29.382739+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.376834+0000","last_change":"2024-09-17T03:35:29.376834+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.376834+0000","last_undegraded":"2024-09-17T03:35:29.376834+0000","last_fullsized":"2024-09-17T03:35:29.376834+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381880+0000","last_change":"2024-09-17T03:35:29.381880+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381880+0000","last_undegraded":"2024-09-17T03:35:29.381880+0000","last_fullsized":"2024-09-17T03:35:29.381880+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418539+0000","last_change":"2024-09-17T03:35:31.414900+0000","last_active":"2024-09-17T03:35:31.418539+0000","last_peered":"2024-09-17T03:35:31.418539+0000","last_clean":"2024-09-17T03:35:31.418539+0000","last_became_active":"2024-09-17T03:35:31.414601+0000","last_became_peered":"2024-09-17T03:35:31.414601+0000","last_unstale":"2024-09-17T03:35:31.418539+0000","last_undegraded":"2024-09-17T03:35:31.418539+0000","last_fullsized":"2024-09-17T03:35:31.418539+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:47.578570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.383178+0000","last_change":"2024-09-17T03:35:29.383178+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.383178+0000","last_undegraded":"2024-09-17T03:35:29.383178+0000","last_fullsized":"2024-09-17T03:35:29.383178+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.379213+0000","last_change":"2024-09-17T03:35:29.379213+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.379213+0000","last_undegraded":"2024-09-17T03:35:29.379213+0000","last_fullsized":"2024-09-17T03:35:29.379213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418638+0000","last_change":"2024-09-17T03:35:30.400765+0000","last_active":"2024-09-17T03:35:31.418638+0000","last_peered":"2024-09-17T03:35:31.418638+0000","last_clean":"2024-09-17T03:35:31.418638+0000","last_became_active":"2024-09-17T03:35:30.400244+0000","last_became_peered":"2024-09-17T03:35:30.400244+0000","last_unstale":"2024-09-17T03:35:31.418638+0000","last_undegraded":"2024-09-17T03:35:31.418638+0000","last_fullsized":"2024-09-17T03:35:31.418638+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:07.625536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382833+0000","last_change":"2024-09-17T03:35:29.382833+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382833+0000","last_undegraded":"2024-09-17T03:35:29.382833+0000","last_fullsized":"2024-09-17T03:35:29.382833+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.417835+0000","last_change":"2024-09-17T03:35:31.411302+0000","last_active":"2024-09-17T03:35:31.417835+0000","last_peered":"2024-09-17T03:35:31.417835+0000","last_clean":"2024-09-17T03:35:31.417835+0000","last_became_active":"2024-09-17T03:35:31.411018+0000","last_became_peered":"2024-09-17T03:35:31.411018+0000","last_unstale":"2024-09-17T03:35:31.417835+0000","last_undegraded":"2024-09-17T03:35:31.417835+0000","last_fullsized":"2024-09-17T03:35:31.417835+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:24.509256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.389019+0000","last_change":"2024-09-17T03:35:30.395268+0000","last_active":"2024-09-17T03:35:31.389019+0000","last_peered":"2024-09-17T03:35:31.389019+0000","last_clean":"2024-09-17T03:35:31.389019+0000","last_became_active":"2024-09-17T03:35:30.394971+0000","last_became_peered":"2024-09-17T03:35:30.394971+0000","last_unstale":"2024-09-17T03:35:31.389019+0000","last_undegraded":"2024-09-17T03:35:31.389019+0000","last_fullsized":"2024-09-17T03:35:31.389019+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:33.367494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382177+0000","last_change":"2024-09-17T03:35:29.382177+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382177+0000","last_undegraded":"2024-09-17T03:35:29.382177+0000","last_fullsized":"2024-09-17T03:35:29.382177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.379244+0000","last_change":"2024-09-17T03:35:29.379244+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.379244+0000","last_undegraded":"2024-09-17T03:35:29.379244+0000","last_fullsized":"2024-09-17T03:35:29.379244+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.376893+0000","last_change":"2024-09-17T03:35:29.376893+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.376893+0000","last_undegraded":"2024-09-17T03:35:29.376893+0000","last_fullsized":"2024-09-17T03:35:29.376893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.407210+0000","last_change":"2024-09-17T03:35:30.396610+0000","last_active":"2024-09-17T03:35:31.407210+0000","last_peered":"2024-09-17T03:35:31.407210+0000","last_clean":"2024-09-17T03:35:31.407210+0000","last_became_active":"2024-09-17T03:35:30.396283+0000","last_became_peered":"2024-09-17T03:35:30.396283+0000","last_unstale":"2024-09-17T03:35:31.407210+0000","last_undegraded":"2024-09-17T03:35:31.407210+0000","last_fullsized":"2024-09-17T03:35:31.407210+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:23.780096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.397521+0000","last_change":"2024-09-17T03:35:30.393748+0000","last_active":"2024-09-17T03:35:31.397521+0000","last_peered":"2024-09-17T03:35:31.397521+0000","last_clean":"2024-09-17T03:35:31.397521+0000","last_became_active":"2024-09-17T03:35:30.393414+0000","last_became_peered":"2024-09-17T03:35:30.393414+0000","last_unstale":"2024-09-17T03:35:31.397521+0000","last_undegraded":"2024-09-17T03:35:31.397521+0000","last_fullsized":"2024-09-17T03:35:31.397521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:58.947583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414334+0000","last_change":"2024-09-17T03:35:31.405793+0000","last_active":"2024-09-17T03:35:31.414334+0000","last_peered":"2024-09-17T03:35:31.414334+0000","last_clean":"2024-09-17T03:35:31.414334+0000","last_became_active":"2024-09-17T03:35:31.405147+0000","last_became_peered":"2024-09-17T03:35:31.405147+0000","last_unstale":"2024-09-17T03:35:31.414334+0000","last_undegraded":"2024-09-17T03:35:31.414334+0000","last_fullsized":"2024-09-17T03:35:31.414334+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:12.994357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420361+0000","last_change":"2024-09-17T03:35:30.396540+0000","last_active":"2024-09-17T03:35:31.420361+0000","last_peered":"2024-09-17T03:35:31.420361+0000","last_clean":"2024-09-17T03:35:31.420361+0000","last_became_active":"2024-09-17T03:35:30.396260+0000","last_became_peered":"2024-09-17T03:35:30.396260+0000","last_unstale":"2024-09-17T03:35:31.420361+0000","last_undegraded":"2024-09-17T03:35:31.420361+0000","last_fullsized":"2024-09-17T03:35:31.420361+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:46.350229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.393481+0000","last_change":"2024-09-17T03:35:30.392017+0000","last_active":"2024-09-17T03:35:31.393481+0000","last_peered":"2024-09-17T03:35:31.393481+0000","last_clean":"2024-09-17T03:35:31.393481+0000","last_became_active":"2024-09-17T03:35:30.391697+0000","last_became_peered":"2024-09-17T03:35:30.391697+0000","last_unstale":"2024-09-17T03:35:31.393481+0000","last_undegraded":"2024-09-17T03:35:31.393481+0000","last_fullsized":"2024-09-17T03:35:31.393481+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:02.448896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381662+0000","last_change":"2024-09-17T03:35:29.381662+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381662+0000","last_undegraded":"2024-09-17T03:35:29.381662+0000","last_fullsized":"2024-09-17T03:35:29.381662+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381951+0000","last_change":"2024-09-17T03:35:29.381951+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381951+0000","last_undegraded":"2024-09-17T03:35:29.381951+0000","last_fullsized":"2024-09-17T03:35:29.381951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.389515+0000","last_change":"2024-09-17T03:35:30.403062+0000","last_active":"2024-09-17T03:35:31.389515+0000","last_peered":"2024-09-17T03:35:31.389515+0000","last_clean":"2024-09-17T03:35:31.389515+0000","last_became_active":"2024-09-17T03:35:30.402662+0000","last_became_peered":"2024-09-17T03:35:30.402662+0000","last_unstale":"2024-09-17T03:35:31.389515+0000","last_undegraded":"2024-09-17T03:35:31.389515+0000","last_fullsized":"2024-09-17T03:35:31.389515+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:59.550123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382552+0000","last_change":"2024-09-17T03:35:29.382552+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382552+0000","last_undegraded":"2024-09-17T03:35:29.382552+0000","last_fullsized":"2024-09-17T03:35:29.382552+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.378646+0000","last_change":"2024-09-17T03:35:29.378646+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.378646+0000","last_undegraded":"2024-09-17T03:35:29.378646+0000","last_fullsized":"2024-09-17T03:35:29.378646+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414362+0000","last_change":"2024-09-17T03:35:31.409930+0000","last_active":"2024-09-17T03:35:31.414362+0000","last_peered":"2024-09-17T03:35:31.414362+0000","last_clean":"2024-09-17T03:35:31.414362+0000","last_became_active":"2024-09-17T03:35:31.407002+0000","last_became_peered":"2024-09-17T03:35:31.407002+0000","last_unstale":"2024-09-17T03:35:31.414362+0000","last_undegraded":"2024-09-17T03:35:31.414362+0000","last_fullsized":"2024-09-17T03:35:31.414362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:37.172164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382369+0000","last_change":"2024-09-17T03:35:29.382369+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382369+0000","last_undegraded":"2024-09-17T03:35:29.382369+0000","last_fullsized":"2024-09-17T03:35:29.382369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418566+0000","last_change":"2024-09-17T03:35:31.415927+0000","last_active":"2024-09-17T03:35:31.418566+0000","last_peered":"2024-09-17T03:35:31.418566+0000","last_clean":"2024-09-17T03:35:31.418566+0000","last_became_active":"2024-09-17T03:35:31.415622+0000","last_became_peered":"2024-09-17T03:35:31.415622+0000","last_unstale":"2024-09-17T03:35:31.418566+0000","last_undegraded":"2024-09-17T03:35:31.418566+0000","last_fullsized":"2024-09-17T03:35:31.418566+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:09.098082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.376836+0000","last_change":"2024-09-17T03:35:29.376836+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.376836+0000","last_undegraded":"2024-09-17T03:35:29.376836+0000","last_fullsized":"2024-09-17T03:35:29.376836+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.409739+0000","last_change":"2024-09-17T03:35:31.403965+0000","last_active":"2024-09-17T03:35:31.409739+0000","last_peered":"2024-09-17T03:35:31.409739+0000","last_clean":"2024-09-17T03:35:31.409739+0000","last_became_active":"2024-09-17T03:35:31.403611+0000","last_became_peered":"2024-09-17T03:35:31.403611+0000","last_unstale":"2024-09-17T03:35:31.409739+0000","last_undegraded":"2024-09-17T03:35:31.409739+0000","last_fullsized":"2024-09-17T03:35:31.409739+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:04.069685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.378640+0000","last_change":"2024-09-17T03:35:29.378640+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.378640+0000","last_undegraded":"2024-09-17T03:35:29.378640+0000","last_fullsized":"2024-09-17T03:35:29.378640+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381669+0000","last_change":"2024-09-17T03:35:29.381669+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381669+0000","last_undegraded":"2024-09-17T03:35:29.381669+0000","last_fullsized":"2024-09-17T03:35:29.381669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.413751+0000","last_change":"2024-09-17T03:35:30.395939+0000","last_active":"2024-09-17T03:35:31.413751+0000","last_peered":"2024-09-17T03:35:31.413751+0000","last_clean":"2024-09-17T03:35:31.413751+0000","last_became_active":"2024-09-17T03:35:30.395536+0000","last_became_peered":"2024-09-17T03:35:30.395536+0000","last_unstale":"2024-09-17T03:35:31.413751+0000","last_undegraded":"2024-09-17T03:35:31.413751+0000","last_fullsized":"2024-09-17T03:35:31.413751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:24.396630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":150,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-17T03:35:29.383769+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:35:29.383769+0000","last_peered":"2024-09-17T03:35:29.383769+0000","last_clean":"2024-09-17T03:35:29.383769+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:35:29.383769+0000","last_undegraded":"2024-09-17T03:35:29.383769+0000","last_fullsized":"2024-09-17T03:35:29.383769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":30,"acting":30,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1064960,"data_stored":776689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35820,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35808,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336032,"statfs":{"total":96636764160,"available":96600096768,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1064960,"data_stored":776689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":512000,"data_stored":205250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35856,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335984,"statfs":{"total":96636764160,"available":96600047616,"internally_reserved":0,"allocated":520192,"data_stored":205818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:35:34.763 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:35:34.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.913+0000 7f4ccaf69640 1 -- 172.21.15.146:0/3526627916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cac003c10 msgr2=0x7f4cac004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.913+0000 7f4ccaf69640 1 --2- 172.21.15.146:0/3526627916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cac003c10 0x7f4cac004060 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009ed0 tx=0x7f4cac005830 comp rx=0 tx=0).stop 2024-09-17T03:35:34.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.913+0000 7f4cc9506640 1 -- 172.21.15.146:0/3526627916 reap_dead start 2024-09-17T03:35:34.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.913+0000 7f4ccaf69640 1 -- 172.21.15.146:0/3526627916 shutdown_connections 2024-09-17T03:35:34.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.913+0000 7f4ccaf69640 1 -- 172.21.15.146:0/3526627916 >> 172.21.15.146:0/3526627916 conn(0x7f4cc40b2060 msgr2=0x7f4cc40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:34.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.913+0000 7f4ccaf69640 1 -- 172.21.15.146:0/3526627916 shutdown_connections 2024-09-17T03:35:34.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.913+0000 7f4ccaf69640 1 -- 172.21.15.146:0/3526627916 wait complete. 2024-09-17T03:35:34.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.915+0000 7f4ccaf69640 1 Processor -- start 2024-09-17T03:35:34.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.915+0000 7f4ccaf69640 1 -- start start 2024-09-17T03:35:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4ccaf69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac003c10 0x7f4cc4150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4ccaf69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc414c130 0x7f4cc4153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4ccaf69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc414c540 0x7f4cc4153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4ccaf69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4073180 con 0x7f4cc414c540 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4ccaf69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4073000 con 0x7f4cc414c130 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4ccaf69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc4151a00 con 0x7f4cac003c10 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4cc9506640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc414c540 0x7f4cc4153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4cc9506640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc414c540 0x7f4cc4153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44406/0 (socket says 172.21.15.146:44406) 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4cc9506640 1 -- 172.21.15.146:0/852763071 learned_addr learned my addr 172.21.15.146:0/852763071 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4cc8d05640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac003c10 0x7f4cc4150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4cc3fff640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc414c130 0x7f4cc4153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4cc9506640 1 -- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac003c10 msgr2=0x7f4cc4150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4cc9506640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac003c10 0x7f4cc4150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4cc9506640 1 -- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc414c130 msgr2=0x7f4cc4153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.916+0000 7f4cc9506640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc414c130 0x7f4cc4153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.917+0000 7f4cc9506640 1 -- 172.21.15.146:0/852763071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc4154190 con 0x7f4cc414c540 2024-09-17T03:35:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.917+0000 7f4cc9506640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc414c540 0x7f4cc4153670 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40affa0 tx=0x7f4cbc001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.917+0000 7f4cc17fa640 1 -- 172.21.15.146:0/852763071 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc004e60 con 0x7f4cc414c540 2024-09-17T03:35:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.917+0000 7f4cc17fa640 1 -- 172.21.15.146:0/852763071 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cbc011630 con 0x7f4cc414c540 2024-09-17T03:35:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.917+0000 7f4ccaf69640 1 -- 172.21.15.146:0/852763071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc4154470 con 0x7f4cc414c540 2024-09-17T03:35:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.917+0000 7f4cc17fa640 1 -- 172.21.15.146:0/852763071 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc011a60 con 0x7f4cc414c540 2024-09-17T03:35:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.917+0000 7f4ccaf69640 1 -- 172.21.15.146:0/852763071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc4151740 con 0x7f4cc414c540 2024-09-17T03:35:34.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.918+0000 7f4ccaf69640 1 -- 172.21.15.146:0/852763071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc40b1830 con 0x7f4cc414c540 2024-09-17T03:35:34.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.918+0000 7f4cc17fa640 1 -- 172.21.15.146:0/852763071 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4cbc011c00 con 0x7f4cc414c540 2024-09-17T03:35:34.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.919+0000 7f4cc17fa640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078bc0 0x7f4cb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:34.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.919+0000 7f4cc17fa640 1 -- 172.21.15.146:0/852763071 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4cbc09b330 con 0x7f4cc414c540 2024-09-17T03:35:34.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.919+0000 7f4cc8d05640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078bc0 0x7f4cb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:34.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.920+0000 7f4cc8d05640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078bc0 0x7f4cb007b0d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4035000 tx=0x7f4cb402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:34.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:34.923+0000 7f4cc17fa640 1 -- 172.21.15.146:0/852763071 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4cc40b1830 con 0x7f4cc414c540 2024-09-17T03:35:35.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.094+0000 7f4ccaf69640 1 -- 172.21.15.146:0/852763071 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4cc40af400 con 0x7f4cb0078bc0 2024-09-17T03:35:35.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.099+0000 7f4cc17fa640 1 -- 172.21.15.146:0/852763071 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242945 (secure 0 0 0) 0x7f4cc40af400 con 0x7f4cb0078bc0 2024-09-17T03:35:35.100 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:35.101 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 -- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078bc0 msgr2=0x7f4cb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078bc0 0x7f4cb007b0d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4035000 tx=0x7f4cb402d040 comp rx=0 tx=0).stop 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 -- 172.21.15.146:0/852763071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc414c540 msgr2=0x7f4cc4153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc414c540 0x7f4cc4153670 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40affa0 tx=0x7f4cbc001800 comp rx=0 tx=0).stop 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 -- 172.21.15.146:0/852763071 shutdown_connections 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078bc0 0x7f4cb007b0d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc414c540 0x7f4cc4153670 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc414c130 0x7f4cc4153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 --2- 172.21.15.146:0/852763071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cac003c10 0x7f4cc4150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 -- 172.21.15.146:0/852763071 >> 172.21.15.146:0/852763071 conn(0x7f4cc40b2060 msgr2=0x7f4cc4075d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 -- 172.21.15.146:0/852763071 shutdown_connections 2024-09-17T03:35:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.102+0000 7f4ccaf69640 1 -- 172.21.15.146:0/852763071 wait complete. 2024-09-17T03:35:35.112 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-17T03:35:33.827007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":96,"acting":96,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":283580,"kb_used_data":4928,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754691140,"statfs":{"total":773094113280,"available":772803727360,"internally_reserved":0,"allocated":5046272,"data_stored":2709730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.452073"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.411529+0000","last_change":"2024-09-17T03:35:31.409810+0000","last_active":"2024-09-17T03:35:31.411529+0000","last_peered":"2024-09-17T03:35:31.411529+0000","last_clean":"2024-09-17T03:35:31.411529+0000","last_became_active":"2024-09-17T03:35:31.409035+0000","last_became_peered":"2024-09-17T03:35:31.409035+0000","last_unstale":"2024-09-17T03:35:31.411529+0000","last_undegraded":"2024-09-17T03:35:31.411529+0000","last_fullsized":"2024-09-17T03:35:31.411529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:29.696914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.410306+0000","last_change":"2024-09-17T03:35:31.406083+0000","last_active":"2024-09-17T03:35:31.410306+0000","last_peered":"2024-09-17T03:35:31.410306+0000","last_clean":"2024-09-17T03:35:31.410306+0000","last_became_active":"2024-09-17T03:35:31.405778+0000","last_became_peered":"2024-09-17T03:35:31.405778+0000","last_unstale":"2024-09-17T03:35:31.410306+0000","last_undegraded":"2024-09-17T03:35:31.410306+0000","last_fullsized":"2024-09-17T03:35:31.410306+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:12.145737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414293+0000","last_change":"2024-09-17T03:35:31.405448+0000","last_active":"2024-09-17T03:35:31.414293+0000","last_peered":"2024-09-17T03:35:31.414293+0000","last_clean":"2024-09-17T03:35:31.414293+0000","last_became_active":"2024-09-17T03:35:31.404612+0000","last_became_peered":"2024-09-17T03:35:31.404612+0000","last_unstale":"2024-09-17T03:35:31.414293+0000","last_undegraded":"2024-09-17T03:35:31.414293+0000","last_fullsized":"2024-09-17T03:35:31.414293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:09.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.410987+0000","last_change":"2024-09-17T03:35:31.406987+0000","last_active":"2024-09-17T03:35:31.410987+0000","last_peered":"2024-09-17T03:35:31.410987+0000","last_clean":"2024-09-17T03:35:31.410987+0000","last_became_active":"2024-09-17T03:35:31.406667+0000","last_became_peered":"2024-09-17T03:35:31.406667+0000","last_unstale":"2024-09-17T03:35:31.410987+0000","last_undegraded":"2024-09-17T03:35:31.410987+0000","last_fullsized":"2024-09-17T03:35:31.410987+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:02.196006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418047+0000","last_change":"2024-09-17T03:35:31.412835+0000","last_active":"2024-09-17T03:35:31.418047+0000","last_peered":"2024-09-17T03:35:31.418047+0000","last_clean":"2024-09-17T03:35:31.418047+0000","last_became_active":"2024-09-17T03:35:31.412198+0000","last_became_peered":"2024-09-17T03:35:31.412198+0000","last_unstale":"2024-09-17T03:35:31.418047+0000","last_undegraded":"2024-09-17T03:35:31.418047+0000","last_fullsized":"2024-09-17T03:35:31.418047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:55.296103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.415609+0000","last_change":"2024-09-17T03:35:31.407472+0000","last_active":"2024-09-17T03:35:31.415609+0000","last_peered":"2024-09-17T03:35:31.415609+0000","last_clean":"2024-09-17T03:35:31.415609+0000","last_became_active":"2024-09-17T03:35:31.407113+0000","last_became_peered":"2024-09-17T03:35:31.407113+0000","last_unstale":"2024-09-17T03:35:31.415609+0000","last_undegraded":"2024-09-17T03:35:31.415609+0000","last_fullsized":"2024-09-17T03:35:31.415609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:54.277873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.409711+0000","last_change":"2024-09-17T03:35:31.405766+0000","last_active":"2024-09-17T03:35:31.409711+0000","last_peered":"2024-09-17T03:35:31.409711+0000","last_clean":"2024-09-17T03:35:31.409711+0000","last_became_active":"2024-09-17T03:35:31.405486+0000","last_became_peered":"2024-09-17T03:35:31.405486+0000","last_unstale":"2024-09-17T03:35:31.409711+0000","last_undegraded":"2024-09-17T03:35:31.409711+0000","last_fullsized":"2024-09-17T03:35:31.409711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:30.491636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418468+0000","last_change":"2024-09-17T03:35:31.414578+0000","last_active":"2024-09-17T03:35:31.418468+0000","last_peered":"2024-09-17T03:35:31.418468+0000","last_clean":"2024-09-17T03:35:31.418468+0000","last_became_active":"2024-09-17T03:35:31.414262+0000","last_became_peered":"2024-09-17T03:35:31.414262+0000","last_unstale":"2024-09-17T03:35:31.418468+0000","last_undegraded":"2024-09-17T03:35:31.418468+0000","last_fullsized":"2024-09-17T03:35:31.418468+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:32.910866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420476+0000","last_change":"2024-09-17T03:35:30.397571+0000","last_active":"2024-09-17T03:35:31.420476+0000","last_peered":"2024-09-17T03:35:31.420476+0000","last_clean":"2024-09-17T03:35:31.420476+0000","last_became_active":"2024-09-17T03:35:30.397265+0000","last_became_peered":"2024-09-17T03:35:30.397265+0000","last_unstale":"2024-09-17T03:35:31.420476+0000","last_undegraded":"2024-09-17T03:35:31.420476+0000","last_fullsized":"2024-09-17T03:35:31.420476+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:28.399672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.377555+0000","last_change":"2024-09-17T03:35:29.377555+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.377555+0000","last_undegraded":"2024-09-17T03:35:29.377555+0000","last_fullsized":"2024-09-17T03:35:29.377555+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414454+0000","last_change":"2024-09-17T03:35:31.413962+0000","last_active":"2024-09-17T03:35:31.414454+0000","last_peered":"2024-09-17T03:35:31.414454+0000","last_clean":"2024-09-17T03:35:31.414454+0000","last_became_active":"2024-09-17T03:35:31.413687+0000","last_became_peered":"2024-09-17T03:35:31.413687+0000","last_unstale":"2024-09-17T03:35:31.414454+0000","last_undegraded":"2024-09-17T03:35:31.414454+0000","last_fullsized":"2024-09-17T03:35:31.414454+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:15.856455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.378647+0000","last_change":"2024-09-17T03:35:29.378647+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.378647+0000","last_undegraded":"2024-09-17T03:35:29.378647+0000","last_fullsized":"2024-09-17T03:35:29.378647+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382036+0000","last_change":"2024-09-17T03:35:29.382036+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382036+0000","last_undegraded":"2024-09-17T03:35:29.382036+0000","last_fullsized":"2024-09-17T03:35:29.382036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420303+0000","last_change":"2024-09-17T03:35:30.397347+0000","last_active":"2024-09-17T03:35:31.420303+0000","last_peered":"2024-09-17T03:35:31.420303+0000","last_clean":"2024-09-17T03:35:31.420303+0000","last_became_active":"2024-09-17T03:35:30.397032+0000","last_became_peered":"2024-09-17T03:35:30.397032+0000","last_unstale":"2024-09-17T03:35:31.420303+0000","last_undegraded":"2024-09-17T03:35:31.420303+0000","last_fullsized":"2024-09-17T03:35:31.420303+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:30.018392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.377545+0000","last_change":"2024-09-17T03:35:29.377545+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.377545+0000","last_undegraded":"2024-09-17T03:35:29.377545+0000","last_fullsized":"2024-09-17T03:35:29.377545+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.392717+0000","last_change":"2024-09-17T03:35:30.395877+0000","last_active":"2024-09-17T03:35:31.392717+0000","last_peered":"2024-09-17T03:35:31.392717+0000","last_clean":"2024-09-17T03:35:31.392717+0000","last_became_active":"2024-09-17T03:35:30.395247+0000","last_became_peered":"2024-09-17T03:35:30.395247+0000","last_unstale":"2024-09-17T03:35:31.392717+0000","last_undegraded":"2024-09-17T03:35:31.392717+0000","last_fullsized":"2024-09-17T03:35:31.392717+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:14.615340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382739+0000","last_change":"2024-09-17T03:35:29.382739+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382739+0000","last_undegraded":"2024-09-17T03:35:29.382739+0000","last_fullsized":"2024-09-17T03:35:29.382739+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.376834+0000","last_change":"2024-09-17T03:35:29.376834+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.376834+0000","last_undegraded":"2024-09-17T03:35:29.376834+0000","last_fullsized":"2024-09-17T03:35:29.376834+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381880+0000","last_change":"2024-09-17T03:35:29.381880+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381880+0000","last_undegraded":"2024-09-17T03:35:29.381880+0000","last_fullsized":"2024-09-17T03:35:29.381880+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418539+0000","last_change":"2024-09-17T03:35:31.414900+0000","last_active":"2024-09-17T03:35:31.418539+0000","last_peered":"2024-09-17T03:35:31.418539+0000","last_clean":"2024-09-17T03:35:31.418539+0000","last_became_active":"2024-09-17T03:35:31.414601+0000","last_became_peered":"2024-09-17T03:35:31.414601+0000","last_unstale":"2024-09-17T03:35:31.418539+0000","last_undegraded":"2024-09-17T03:35:31.418539+0000","last_fullsized":"2024-09-17T03:35:31.418539+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:47.578570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.383178+0000","last_change":"2024-09-17T03:35:29.383178+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.383178+0000","last_undegraded":"2024-09-17T03:35:29.383178+0000","last_fullsized":"2024-09-17T03:35:29.383178+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.379213+0000","last_change":"2024-09-17T03:35:29.379213+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.379213+0000","last_undegraded":"2024-09-17T03:35:29.379213+0000","last_fullsized":"2024-09-17T03:35:29.379213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418638+0000","last_change":"2024-09-17T03:35:30.400765+0000","last_active":"2024-09-17T03:35:31.418638+0000","last_peered":"2024-09-17T03:35:31.418638+0000","last_clean":"2024-09-17T03:35:31.418638+0000","last_became_active":"2024-09-17T03:35:30.400244+0000","last_became_peered":"2024-09-17T03:35:30.400244+0000","last_unstale":"2024-09-17T03:35:31.418638+0000","last_undegraded":"2024-09-17T03:35:31.418638+0000","last_fullsized":"2024-09-17T03:35:31.418638+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:07.625536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382833+0000","last_change":"2024-09-17T03:35:29.382833+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382833+0000","last_undegraded":"2024-09-17T03:35:29.382833+0000","last_fullsized":"2024-09-17T03:35:29.382833+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.417835+0000","last_change":"2024-09-17T03:35:31.411302+0000","last_active":"2024-09-17T03:35:31.417835+0000","last_peered":"2024-09-17T03:35:31.417835+0000","last_clean":"2024-09-17T03:35:31.417835+0000","last_became_active":"2024-09-17T03:35:31.411018+0000","last_became_peered":"2024-09-17T03:35:31.411018+0000","last_unstale":"2024-09-17T03:35:31.417835+0000","last_undegraded":"2024-09-17T03:35:31.417835+0000","last_fullsized":"2024-09-17T03:35:31.417835+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:24.509256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.389019+0000","last_change":"2024-09-17T03:35:30.395268+0000","last_active":"2024-09-17T03:35:31.389019+0000","last_peered":"2024-09-17T03:35:31.389019+0000","last_clean":"2024-09-17T03:35:31.389019+0000","last_became_active":"2024-09-17T03:35:30.394971+0000","last_became_peered":"2024-09-17T03:35:30.394971+0000","last_unstale":"2024-09-17T03:35:31.389019+0000","last_undegraded":"2024-09-17T03:35:31.389019+0000","last_fullsized":"2024-09-17T03:35:31.389019+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:33.367494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382177+0000","last_change":"2024-09-17T03:35:29.382177+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382177+0000","last_undegraded":"2024-09-17T03:35:29.382177+0000","last_fullsized":"2024-09-17T03:35:29.382177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.379244+0000","last_change":"2024-09-17T03:35:29.379244+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.379244+0000","last_undegraded":"2024-09-17T03:35:29.379244+0000","last_fullsized":"2024-09-17T03:35:29.379244+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.376893+0000","last_change":"2024-09-17T03:35:29.376893+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.376893+0000","last_undegraded":"2024-09-17T03:35:29.376893+0000","last_fullsized":"2024-09-17T03:35:29.376893+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.407210+0000","last_change":"2024-09-17T03:35:30.396610+0000","last_active":"2024-09-17T03:35:31.407210+0000","last_peered":"2024-09-17T03:35:31.407210+0000","last_clean":"2024-09-17T03:35:31.407210+0000","last_became_active":"2024-09-17T03:35:30.396283+0000","last_became_peered":"2024-09-17T03:35:30.396283+0000","last_unstale":"2024-09-17T03:35:31.407210+0000","last_undegraded":"2024-09-17T03:35:31.407210+0000","last_fullsized":"2024-09-17T03:35:31.407210+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:23.780096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.397521+0000","last_change":"2024-09-17T03:35:30.393748+0000","last_active":"2024-09-17T03:35:31.397521+0000","last_peered":"2024-09-17T03:35:31.397521+0000","last_clean":"2024-09-17T03:35:31.397521+0000","last_became_active":"2024-09-17T03:35:30.393414+0000","last_became_peered":"2024-09-17T03:35:30.393414+0000","last_unstale":"2024-09-17T03:35:31.397521+0000","last_undegraded":"2024-09-17T03:35:31.397521+0000","last_fullsized":"2024-09-17T03:35:31.397521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:58.947583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414334+0000","last_change":"2024-09-17T03:35:31.405793+0000","last_active":"2024-09-17T03:35:31.414334+0000","last_peered":"2024-09-17T03:35:31.414334+0000","last_clean":"2024-09-17T03:35:31.414334+0000","last_became_active":"2024-09-17T03:35:31.405147+0000","last_became_peered":"2024-09-17T03:35:31.405147+0000","last_unstale":"2024-09-17T03:35:31.414334+0000","last_undegraded":"2024-09-17T03:35:31.414334+0000","last_fullsized":"2024-09-17T03:35:31.414334+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:12.994357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420361+0000","last_change":"2024-09-17T03:35:30.396540+0000","last_active":"2024-09-17T03:35:31.420361+0000","last_peered":"2024-09-17T03:35:31.420361+0000","last_clean":"2024-09-17T03:35:31.420361+0000","last_became_active":"2024-09-17T03:35:30.396260+0000","last_became_peered":"2024-09-17T03:35:30.396260+0000","last_unstale":"2024-09-17T03:35:31.420361+0000","last_undegraded":"2024-09-17T03:35:31.420361+0000","last_fullsized":"2024-09-17T03:35:31.420361+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:46.350229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.393481+0000","last_change":"2024-09-17T03:35:30.392017+0000","last_active":"2024-09-17T03:35:31.393481+0000","last_peered":"2024-09-17T03:35:31.393481+0000","last_clean":"2024-09-17T03:35:31.393481+0000","last_became_active":"2024-09-17T03:35:30.391697+0000","last_became_peered":"2024-09-17T03:35:30.391697+0000","last_unstale":"2024-09-17T03:35:31.393481+0000","last_undegraded":"2024-09-17T03:35:31.393481+0000","last_fullsized":"2024-09-17T03:35:31.393481+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:02.448896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381662+0000","last_change":"2024-09-17T03:35:29.381662+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381662+0000","last_undegraded":"2024-09-17T03:35:29.381662+0000","last_fullsized":"2024-09-17T03:35:29.381662+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381951+0000","last_change":"2024-09-17T03:35:29.381951+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381951+0000","last_undegraded":"2024-09-17T03:35:29.381951+0000","last_fullsized":"2024-09-17T03:35:29.381951+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.389515+0000","last_change":"2024-09-17T03:35:30.403062+0000","last_active":"2024-09-17T03:35:31.389515+0000","last_peered":"2024-09-17T03:35:31.389515+0000","last_clean":"2024-09-17T03:35:31.389515+0000","last_became_active":"2024-09-17T03:35:30.402662+0000","last_became_peered":"2024-09-17T03:35:30.402662+0000","last_unstale":"2024-09-17T03:35:31.389515+0000","last_undegraded":"2024-09-17T03:35:31.389515+0000","last_fullsized":"2024-09-17T03:35:31.389515+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:59.550123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382552+0000","last_change":"2024-09-17T03:35:29.382552+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382552+0000","last_undegraded":"2024-09-17T03:35:29.382552+0000","last_fullsized":"2024-09-17T03:35:29.382552+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.378646+0000","last_change":"2024-09-17T03:35:29.378646+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.378646+0000","last_undegraded":"2024-09-17T03:35:29.378646+0000","last_fullsized":"2024-09-17T03:35:29.378646+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414362+0000","last_change":"2024-09-17T03:35:31.409930+0000","last_active":"2024-09-17T03:35:31.414362+0000","last_peered":"2024-09-17T03:35:31.414362+0000","last_clean":"2024-09-17T03:35:31.414362+0000","last_became_active":"2024-09-17T03:35:31.407002+0000","last_became_peered":"2024-09-17T03:35:31.407002+0000","last_unstale":"2024-09-17T03:35:31.414362+0000","last_undegraded":"2024-09-17T03:35:31.414362+0000","last_fullsized":"2024-09-17T03:35:31.414362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:37.172164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.382369+0000","last_change":"2024-09-17T03:35:29.382369+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.382369+0000","last_undegraded":"2024-09-17T03:35:29.382369+0000","last_fullsized":"2024-09-17T03:35:29.382369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418566+0000","last_change":"2024-09-17T03:35:31.415927+0000","last_active":"2024-09-17T03:35:31.418566+0000","last_peered":"2024-09-17T03:35:31.418566+0000","last_clean":"2024-09-17T03:35:31.418566+0000","last_became_active":"2024-09-17T03:35:31.415622+0000","last_became_peered":"2024-09-17T03:35:31.415622+0000","last_unstale":"2024-09-17T03:35:31.418566+0000","last_undegraded":"2024-09-17T03:35:31.418566+0000","last_fullsized":"2024-09-17T03:35:31.418566+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:09.098082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.376836+0000","last_change":"2024-09-17T03:35:29.376836+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.376836+0000","last_undegraded":"2024-09-17T03:35:29.376836+0000","last_fullsized":"2024-09-17T03:35:29.376836+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.409739+0000","last_change":"2024-09-17T03:35:31.403965+0000","last_active":"2024-09-17T03:35:31.409739+0000","last_peered":"2024-09-17T03:35:31.409739+0000","last_clean":"2024-09-17T03:35:31.409739+0000","last_became_active":"2024-09-17T03:35:31.403611+0000","last_became_peered":"2024-09-17T03:35:31.403611+0000","last_unstale":"2024-09-17T03:35:31.409739+0000","last_undegraded":"2024-09-17T03:35:31.409739+0000","last_fullsized":"2024-09-17T03:35:31.409739+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:04.069685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.378640+0000","last_change":"2024-09-17T03:35:29.378640+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.378640+0000","last_undegraded":"2024-09-17T03:35:29.378640+0000","last_fullsized":"2024-09-17T03:35:29.378640+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":42,"state":"creating+peering","last_fresh":"2024-09-17T03:35:29.381669+0000","last_change":"2024-09-17T03:35:29.381669+0000","last_active":"2024-09-17T03:35:29.371817+0000","last_peered":"2024-09-17T03:35:29.371817+0000","last_clean":"2024-09-17T03:35:29.371817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:29.381669+0000","last_undegraded":"2024-09-17T03:35:29.381669+0000","last_fullsized":"2024-09-17T03:35:29.381669+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:35:30.374040+0000","last_change":"2024-09-17T03:35:30.374040+0000","last_active":"2024-09-17T03:35:30.374040+0000","last_peered":"2024-09-17T03:35:30.374040+0000","last_clean":"2024-09-17T03:35:30.374040+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:35:30.374040+0000","last_undegraded":"2024-09-17T03:35:30.374040+0000","last_fullsized":"2024-09-17T03:35:30.374040+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.413751+0000","last_change":"2024-09-17T03:35:30.395939+0000","last_active":"2024-09-17T03:35:31.413751+0000","last_peered":"2024-09-17T03:35:31.413751+0000","last_clean":"2024-09-17T03:35:31.413751+0000","last_became_active":"2024-09-17T03:35:30.395536+0000","last_became_peered":"2024-09-17T03:35:30.395536+0000","last_unstale":"2024-09-17T03:35:31.413751+0000","last_undegraded":"2024-09-17T03:35:31.413751+0000","last_fullsized":"2024-09-17T03:35:31.413751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:24.396630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":150,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-17T03:35:29.383769+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:35:29.383769+0000","last_peered":"2024-09-17T03:35:29.383769+0000","last_clean":"2024-09-17T03:35:29.383769+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:35:29.383769+0000","last_undegraded":"2024-09-17T03:35:29.383769+0000","last_fullsized":"2024-09-17T03:35:29.383769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":30,"acting":30,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1064960,"data_stored":776689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35820,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35808,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336032,"statfs":{"total":96636764160,"available":96600096768,"internally_reserved":0,"allocated":471040,"data_stored":186321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1064960,"data_stored":776689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":512000,"data_stored":205250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35856,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335984,"statfs":{"total":96636764160,"available":96600047616,"internally_reserved":0,"allocated":520192,"data_stored":205818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:35:35.116 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3f is not active+clean 2024-09-17T03:35:35.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.116 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-09-17T03:35:35.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.116 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-09-17T03:35:35.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.116 INFO:tasks.ceph.ceph_manager.ceph:PG 7.39 is not active+clean 2024-09-17T03:35:35.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.116 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-09-17T03:35:35.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:PG 7.33 is not active+clean 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-09-17T03:35:35.117 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.118 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-09-17T03:35:35.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.118 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-09-17T03:35:35.118 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.118 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-09-17T03:35:35.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.119 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2c is not active+clean 2024-09-17T03:35:35.119 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.120 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-09-17T03:35:35.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.120 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-09-17T03:35:35.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.120 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-09-17T03:35:35.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.120 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-09-17T03:35:35.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.120 INFO:tasks.ceph.ceph_manager.ceph:PG 7.26 is not active+clean 2024-09-17T03:35:35.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.120 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:PG 7.20 is not active+clean 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.121 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.377555+0000', 'last_change': '2024-09-17T03:35:29.377555+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.377555+0000', 'last_undegraded': '2024-09-17T03:35:29.377555+0000', 'last_fullsized': '2024-09-17T03:35:29.377555+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.378647+0000', 'last_change': '2024-09-17T03:35:29.378647+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.378647+0000', 'last_undegraded': '2024-09-17T03:35:29.378647+0000', 'last_fullsized': '2024-09-17T03:35:29.378647+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.382036+0000', 'last_change': '2024-09-17T03:35:29.382036+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.382036+0000', 'last_undegraded': '2024-09-17T03:35:29.382036+0000', 'last_fullsized': '2024-09-17T03:35:29.382036+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.122 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.377545+0000', 'last_change': '2024-09-17T03:35:29.377545+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.377545+0000', 'last_undegraded': '2024-09-17T03:35:29.377545+0000', 'last_fullsized': '2024-09-17T03:35:29.377545+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.382739+0000', 'last_change': '2024-09-17T03:35:29.382739+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.382739+0000', 'last_undegraded': '2024-09-17T03:35:29.382739+0000', 'last_fullsized': '2024-09-17T03:35:29.382739+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.376834+0000', 'last_change': '2024-09-17T03:35:29.376834+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.376834+0000', 'last_undegraded': '2024-09-17T03:35:29.376834+0000', 'last_fullsized': '2024-09-17T03:35:29.376834+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:35:35.123 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.381880+0000', 'last_change': '2024-09-17T03:35:29.381880+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.381880+0000', 'last_undegraded': '2024-09-17T03:35:29.381880+0000', 'last_fullsized': '2024-09-17T03:35:29.381880+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.383178+0000', 'last_change': '2024-09-17T03:35:29.383178+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.383178+0000', 'last_undegraded': '2024-09-17T03:35:29.383178+0000', 'last_fullsized': '2024-09-17T03:35:29.383178+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.379213+0000', 'last_change': '2024-09-17T03:35:29.379213+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.379213+0000', 'last_undegraded': '2024-09-17T03:35:29.379213+0000', 'last_fullsized': '2024-09-17T03:35:29.379213+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.124 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.382833+0000', 'last_change': '2024-09-17T03:35:29.382833+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.382833+0000', 'last_undegraded': '2024-09-17T03:35:29.382833+0000', 'last_fullsized': '2024-09-17T03:35:29.382833+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.382177+0000', 'last_change': '2024-09-17T03:35:29.382177+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.382177+0000', 'last_undegraded': '2024-09-17T03:35:29.382177+0000', 'last_fullsized': '2024-09-17T03:35:29.382177+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.379244+0000', 'last_change': '2024-09-17T03:35:29.379244+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.379244+0000', 'last_undegraded': '2024-09-17T03:35:29.379244+0000', 'last_fullsized': '2024-09-17T03:35:29.379244+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:35:35.125 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-17T03:35:35.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.126 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-09-17T03:35:35.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.376893+0000', 'last_change': '2024-09-17T03:35:29.376893+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.376893+0000', 'last_undegraded': '2024-09-17T03:35:29.376893+0000', 'last_fullsized': '2024-09-17T03:35:29.376893+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:35:35.126 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-17T03:35:35.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.126 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-17T03:35:35.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.126 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.381662+0000', 'last_change': '2024-09-17T03:35:29.381662+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.381662+0000', 'last_undegraded': '2024-09-17T03:35:29.381662+0000', 'last_fullsized': '2024-09-17T03:35:29.381662+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.381951+0000', 'last_change': '2024-09-17T03:35:29.381951+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.381951+0000', 'last_undegraded': '2024-09-17T03:35:29.381951+0000', 'last_fullsized': '2024-09-17T03:35:29.381951+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-17T03:35:35.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.128 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-09-17T03:35:35.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.382552+0000', 'last_change': '2024-09-17T03:35:29.382552+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.382552+0000', 'last_undegraded': '2024-09-17T03:35:29.382552+0000', 'last_fullsized': '2024-09-17T03:35:29.382552+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:35:35.128 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-09-17T03:35:35.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.128 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-09-17T03:35:35.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.378646+0000', 'last_change': '2024-09-17T03:35:29.378646+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.378646+0000', 'last_undegraded': '2024-09-17T03:35:29.378646+0000', 'last_fullsized': '2024-09-17T03:35:29.378646+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:35:35.128 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-09-17T03:35:35.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.382369+0000', 'last_change': '2024-09-17T03:35:29.382369+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.382369+0000', 'last_undegraded': '2024-09-17T03:35:29.382369+0000', 'last_fullsized': '2024-09-17T03:35:29.382369+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:35:35.128 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-09-17T03:35:35.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.376836+0000', 'last_change': '2024-09-17T03:35:29.376836+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.376836+0000', 'last_undegraded': '2024-09-17T03:35:29.376836+0000', 'last_fullsized': '2024-09-17T03:35:29.376836+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:35:35.129 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-09-17T03:35:35.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.378640+0000', 'last_change': '2024-09-17T03:35:29.378640+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.378640+0000', 'last_undegraded': '2024-09-17T03:35:29.378640+0000', 'last_fullsized': '2024-09-17T03:35:29.378640+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:35:35.129 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-17T03:35:35.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.129 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-09-17T03:35:35.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 42, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:35:29.381669+0000', 'last_change': '2024-09-17T03:35:29.381669+0000', 'last_active': '2024-09-17T03:35:29.371817+0000', 'last_peered': '2024-09-17T03:35:29.371817+0000', 'last_clean': '2024-09-17T03:35:29.371817+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:29.381669+0000', 'last_undegraded': '2024-09-17T03:35:29.381669+0000', 'last_fullsized': '2024-09-17T03:35:29.381669+0000', 'mapping_epoch': 42, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 42, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:29.371817+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:35:35.129 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-17T03:35:35.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:35:30.374040+0000', 'last_change': '2024-09-17T03:35:30.374040+0000', 'last_active': '2024-09-17T03:35:30.374040+0000', 'last_peered': '2024-09-17T03:35:30.374040+0000', 'last_clean': '2024-09-17T03:35:30.374040+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:35:30.374040+0000', 'last_undegraded': '2024-09-17T03:35:30.374040+0000', 'last_fullsized': '2024-09-17T03:35:30.374040+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'last_clean_scrub_stamp': '2024-09-17T03:35:30.374040+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:35:35.130 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:35:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.266+0000 7f07512d3640 1 -- 172.21.15.146:0/2340015848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0738003a30 msgr2=0x7f0738003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.266+0000 7f07512d3640 1 --2- 172.21.15.146:0/2340015848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0738003a30 0x7f0738003ea0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0744009ed0 tx=0x7f0738005830 comp rx=0 tx=0).stop 2024-09-17T03:35:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.266+0000 7f074b7fe640 1 -- 172.21.15.146:0/2340015848 reap_dead start 2024-09-17T03:35:35.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.266+0000 7f07512d3640 1 -- 172.21.15.146:0/2340015848 shutdown_connections 2024-09-17T03:35:35.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.266+0000 7f07512d3640 1 -- 172.21.15.146:0/2340015848 >> 172.21.15.146:0/2340015848 conn(0x7f074c09ba20 msgr2=0x7f074c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:35.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.266+0000 7f07512d3640 1 -- 172.21.15.146:0/2340015848 shutdown_connections 2024-09-17T03:35:35.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.266+0000 7f07512d3640 1 -- 172.21.15.146:0/2340015848 wait complete. 2024-09-17T03:35:35.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.268+0000 7f07512d3640 1 Processor -- start 2024-09-17T03:35:35.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.268+0000 7f07512d3640 1 -- start start 2024-09-17T03:35:35.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.269+0000 7f07512d3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0738003a30 0x7f074c14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.269+0000 7f07512d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1e9800 0x7f074c1e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.269+0000 7f07512d3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0cd050 0x7f074c0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.269+0000 7f07512d3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f074c0b2f30 con 0x7f074c1e9800 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.269+0000 7f07512d3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f074c0b80a0 con 0x7f0738003a30 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.269+0000 7f07512d3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f074c0cf170 con 0x7f074c0cd050 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.269+0000 7f074a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1e9800 0x7f074c1e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.269+0000 7f074a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1e9800 0x7f074c1e9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44422/0 (socket says 172.21.15.146:44422) 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.269+0000 7f074a7fc640 1 -- 172.21.15.146:0/554723491 learned_addr learned my addr 172.21.15.146:0/554723491 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.269+0000 7f074b7fe640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0cd050 0x7f074c0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.269+0000 7f074affd640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0738003a30 0x7f074c14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.270+0000 7f074a7fc640 1 -- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0cd050 msgr2=0x7f074c0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.270+0000 7f074a7fc640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0cd050 0x7f074c0cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.270+0000 7f074a7fc640 1 -- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0738003a30 msgr2=0x7f074c14b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.270+0000 7f074a7fc640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0738003a30 0x7f074c14b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.270+0000 7f074a7fc640 1 -- 172.21.15.146:0/554723491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074c15ef80 con 0x7f074c1e9800 2024-09-17T03:35:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.270+0000 7f074a7fc640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1e9800 0x7f074c1e9c10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0734004e20 tx=0x7f0734001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.270+0000 7f07437fe640 1 -- 172.21.15.146:0/554723491 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734015020 con 0x7f074c1e9800 2024-09-17T03:35:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.270+0000 7f07437fe640 1 -- 172.21.15.146:0/554723491 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0734011960 con 0x7f074c1e9800 2024-09-17T03:35:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.270+0000 7f07512d3640 1 -- 172.21.15.146:0/554723491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074c0cd9a0 con 0x7f074c1e9800 2024-09-17T03:35:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.270+0000 7f07437fe640 1 -- 172.21.15.146:0/554723491 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734011d70 con 0x7f074c1e9800 2024-09-17T03:35:35.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.270+0000 7f07512d3640 1 -- 172.21.15.146:0/554723491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f074c14e190 con 0x7f074c1e9800 2024-09-17T03:35:35.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.271+0000 7f07512d3640 1 -- 172.21.15.146:0/554723491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074c161220 con 0x7f074c1e9800 2024-09-17T03:35:35.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.272+0000 7f07437fe640 1 -- 172.21.15.146:0/554723491 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0734018020 con 0x7f074c1e9800 2024-09-17T03:35:35.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.272+0000 7f07437fe640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f072c078bc0 0x7f072c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.272+0000 7f07437fe640 1 -- 172.21.15.146:0/554723491 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f073409b5a0 con 0x7f074c1e9800 2024-09-17T03:35:35.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.272+0000 7f074affd640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f072c078bc0 0x7f072c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.273+0000 7f074affd640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f072c078bc0 0x7f072c07b0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0744035000 tx=0x7f074402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:35.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.277+0000 7f07437fe640 1 -- 172.21.15.146:0/554723491 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f073401f020 con 0x7f074c1e9800 2024-09-17T03:35:35.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.522+0000 7f07512d3640 1 -- 172.21.15.146:0/554723491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f074c0ced70 con 0x7f074c1e9800 2024-09-17T03:35:35.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.522+0000 7f07437fe640 1 -- 172.21.15.146:0/554723491 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1216 (secure 0 0 0) 0x7f074c0cd9a0 con 0x7f074c1e9800 2024-09-17T03:35:35.521 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:35.521 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":180,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":49},{"state_name":"active+clean","count":27},{"state_name":"creating+peering","count":21}],"num_pgs":97,"num_pools":3,"num_objects":9,"data_bytes":591054,"bytes_used":290385920,"bytes_avail":772803727360,"bytes_total":773094113280,"unknown_pgs_ratio":0.50515460968017578,"inactive_pgs_ratio":0.2164948433637619,"write_bytes_sec":2070,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":21,"btime":"2024-09-17T03:35:33:398538+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5400}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-17T03:35:19.823580+0000","services":{}},"progress_events":{}} 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 -- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f072c078bc0 msgr2=0x7f072c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f072c078bc0 0x7f072c07b0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0744035000 tx=0x7f074402d040 comp rx=0 tx=0).stop 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 -- 172.21.15.146:0/554723491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1e9800 msgr2=0x7f074c1e9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1e9800 0x7f074c1e9c10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0734004e20 tx=0x7f0734001630 comp rx=0 tx=0).stop 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 -- 172.21.15.146:0/554723491 shutdown_connections 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f072c078bc0 0x7f072c07b0d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f074c0cd050 0x7f074c0cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f074c1e9800 0x7f074c1e9c10 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 --2- 172.21.15.146:0/554723491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0738003a30 0x7f074c14b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 -- 172.21.15.146:0/554723491 >> 172.21.15.146:0/554723491 conn(0x7f074c09ba20 msgr2=0x7f074c0b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 -- 172.21.15.146:0/554723491 shutdown_connections 2024-09-17T03:35:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.524+0000 7f07512d3640 1 -- 172.21.15.146:0/554723491 wait complete. 2024-09-17T03:35:35.535 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:35:35.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:35:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.649+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1395687309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b60005350 msgr2=0x7f9b6000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.649+0000 7f9b7d60a640 1 --2- 172.21.15.146:0/1395687309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b60005350 0x7f9b6000b9c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9b70001dc0 tx=0x7f9b60005830 comp rx=0 tx=0).stop 2024-09-17T03:35:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.649+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1395687309 shutdown_connections 2024-09-17T03:35:35.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.649+0000 7f9b7d60a640 1 --2- 172.21.15.146:0/1395687309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b60005350 0x7f9b6000b9c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.649+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1395687309 >> 172.21.15.146:0/1395687309 conn(0x7f9b780d11f0 msgr2=0x7f9b780d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:35.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.649+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1395687309 shutdown_connections 2024-09-17T03:35:35.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.649+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1395687309 wait complete. 2024-09-17T03:35:35.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.651+0000 7f9b7d60a640 1 Processor -- start 2024-09-17T03:35:35.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.651+0000 7f9b7d60a640 1 -- start start 2024-09-17T03:35:35.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.652+0000 7f9b7d60a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b60005350 0x7f9b780b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.652+0000 7f9b7d60a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b7814f8e0 0x7f9b780cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.652+0000 7f9b7d60a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7814fcf0 0x7f9b780cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.652+0000 7f9b7d60a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b780b6600 con 0x7f9b7814fcf0 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.652+0000 7f9b7d60a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9b780d00c0 con 0x7f9b60005350 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.652+0000 7f9b7d60a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9b780b6780 con 0x7f9b7814f8e0 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.652+0000 7f9b777fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7814fcf0 0x7f9b780cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.652+0000 7f9b777fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7814fcf0 0x7f9b780cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44440/0 (socket says 172.21.15.146:44440) 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.652+0000 7f9b777fe640 1 -- 172.21.15.146:0/1049701513 learned_addr learned my addr 172.21.15.146:0/1049701513 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b767fc640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b7814f8e0 0x7f9b780cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b76ffd640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b60005350 0x7f9b780b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b777fe640 1 -- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b7814f8e0 msgr2=0x7f9b780cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b777fe640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b7814f8e0 0x7f9b780cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b777fe640 1 -- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b60005350 msgr2=0x7f9b780b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b777fe640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b60005350 0x7f9b780b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b777fe640 1 -- 172.21.15.146:0/1049701513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b780cc7a0 con 0x7f9b7814fcf0 2024-09-17T03:35:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b777fe640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7814fcf0 0x7f9b780cd6a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9b70001eb0 tx=0x7f9b70006ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b5f7fe640 1 -- 172.21.15.146:0/1049701513 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70003d80 con 0x7f9b7814fcf0 2024-09-17T03:35:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b5f7fe640 1 -- 172.21.15.146:0/1049701513 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b70005a10 con 0x7f9b7814fcf0 2024-09-17T03:35:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1049701513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b780c93e0 con 0x7f9b7814fcf0 2024-09-17T03:35:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b5f7fe640 1 -- 172.21.15.146:0/1049701513 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70005e60 con 0x7f9b7814fcf0 2024-09-17T03:35:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.653+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1049701513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b780c99a0 con 0x7f9b7814fcf0 2024-09-17T03:35:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.654+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1049701513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b780cef40 con 0x7f9b7814fcf0 2024-09-17T03:35:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.655+0000 7f9b5f7fe640 1 -- 172.21.15.146:0/1049701513 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b70005030 con 0x7f9b7814fcf0 2024-09-17T03:35:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.655+0000 7f9b5f7fe640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b64078b90 0x7f9b6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.655+0000 7f9b5f7fe640 1 -- 172.21.15.146:0/1049701513 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f9b700baf20 con 0x7f9b7814fcf0 2024-09-17T03:35:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.656+0000 7f9b76ffd640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b64078b90 0x7f9b6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.656+0000 7f9b76ffd640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b64078b90 0x7f9b6407b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009bd0 tx=0x7f9b68005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.660+0000 7f9b5f7fe640 1 -- 172.21.15.146:0/1049701513 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b70043060 con 0x7f9b7814fcf0 2024-09-17T03:35:35.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.831+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1049701513 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b780c7ff0 con 0x7f9b64078b90 2024-09-17T03:35:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.835+0000 7f9b5f7fe640 1 -- 172.21.15.146:0/1049701513 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f9b780c7ff0 con 0x7f9b64078b90 2024-09-17T03:35:35.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:35.838 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:35:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.838+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b64078b90 msgr2=0x7f9b6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.838+0000 7f9b7d60a640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b64078b90 0x7f9b6407b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009bd0 tx=0x7f9b68005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.838+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1049701513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7814fcf0 msgr2=0x7f9b780cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.838+0000 7f9b7d60a640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7814fcf0 0x7f9b780cd6a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9b70001eb0 tx=0x7f9b70006ca0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.839+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1049701513 shutdown_connections 2024-09-17T03:35:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.839+0000 7f9b7d60a640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b64078b90 0x7f9b6407b0a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.839+0000 7f9b7d60a640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b7814fcf0 0x7f9b780cd6a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.839+0000 7f9b7d60a640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b7814f8e0 0x7f9b780cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.839+0000 7f9b7d60a640 1 --2- 172.21.15.146:0/1049701513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b60005350 0x7f9b780b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.839+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1049701513 >> 172.21.15.146:0/1049701513 conn(0x7f9b780d11f0 msgr2=0x7f9b780b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.839+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1049701513 shutdown_connections 2024-09-17T03:35:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:35.839+0000 7f9b7d60a640 1 -- 172.21.15.146:0/1049701513 wait complete. 2024-09-17T03:35:35.849 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-17T03:35:35.827616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283904,"kb_used_data":5264,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754690816,"statfs":{"total":773094113280,"available":772803395584,"internally_reserved":0,"allocated":5390336,"data_stored":2864796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001787"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247030+0000","last_change":"2024-09-17T03:35:31.398341+0000","last_active":"2024-09-17T03:35:33.247030+0000","last_peered":"2024-09-17T03:35:33.247030+0000","last_clean":"2024-09-17T03:35:33.247030+0000","last_became_active":"2024-09-17T03:35:31.397901+0000","last_became_peered":"2024-09-17T03:35:31.397901+0000","last_unstale":"2024-09-17T03:35:33.247030+0000","last_undegraded":"2024-09-17T03:35:33.247030+0000","last_fullsized":"2024-09-17T03:35:33.247030+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:57.875816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.411529+0000","last_change":"2024-09-17T03:35:31.409810+0000","last_active":"2024-09-17T03:35:31.411529+0000","last_peered":"2024-09-17T03:35:31.411529+0000","last_clean":"2024-09-17T03:35:31.411529+0000","last_became_active":"2024-09-17T03:35:31.409035+0000","last_became_peered":"2024-09-17T03:35:31.409035+0000","last_unstale":"2024-09-17T03:35:31.411529+0000","last_undegraded":"2024-09-17T03:35:31.411529+0000","last_fullsized":"2024-09-17T03:35:31.411529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:29.696914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402882+0000","last_change":"2024-09-17T03:35:31.403821+0000","last_active":"2024-09-17T03:35:32.402882+0000","last_peered":"2024-09-17T03:35:32.402882+0000","last_clean":"2024-09-17T03:35:32.402882+0000","last_became_active":"2024-09-17T03:35:31.403509+0000","last_became_peered":"2024-09-17T03:35:31.403509+0000","last_unstale":"2024-09-17T03:35:32.402882+0000","last_undegraded":"2024-09-17T03:35:32.402882+0000","last_fullsized":"2024-09-17T03:35:32.402882+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:38.874740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246174+0000","last_change":"2024-09-17T03:35:31.411466+0000","last_active":"2024-09-17T03:35:33.246174+0000","last_peered":"2024-09-17T03:35:33.246174+0000","last_clean":"2024-09-17T03:35:33.246174+0000","last_became_active":"2024-09-17T03:35:31.411138+0000","last_became_peered":"2024-09-17T03:35:31.411138+0000","last_unstale":"2024-09-17T03:35:33.246174+0000","last_undegraded":"2024-09-17T03:35:33.246174+0000","last_fullsized":"2024-09-17T03:35:33.246174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:00.699229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.410306+0000","last_change":"2024-09-17T03:35:31.406083+0000","last_active":"2024-09-17T03:35:31.410306+0000","last_peered":"2024-09-17T03:35:31.410306+0000","last_clean":"2024-09-17T03:35:31.410306+0000","last_became_active":"2024-09-17T03:35:31.405778+0000","last_became_peered":"2024-09-17T03:35:31.405778+0000","last_unstale":"2024-09-17T03:35:31.410306+0000","last_undegraded":"2024-09-17T03:35:31.410306+0000","last_fullsized":"2024-09-17T03:35:31.410306+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:12.145737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414293+0000","last_change":"2024-09-17T03:35:31.405448+0000","last_active":"2024-09-17T03:35:31.414293+0000","last_peered":"2024-09-17T03:35:31.414293+0000","last_clean":"2024-09-17T03:35:31.414293+0000","last_became_active":"2024-09-17T03:35:31.404612+0000","last_became_peered":"2024-09-17T03:35:31.404612+0000","last_unstale":"2024-09-17T03:35:31.414293+0000","last_undegraded":"2024-09-17T03:35:31.414293+0000","last_fullsized":"2024-09-17T03:35:31.414293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:09.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246218+0000","last_change":"2024-09-17T03:35:31.401210+0000","last_active":"2024-09-17T03:35:33.246218+0000","last_peered":"2024-09-17T03:35:33.246218+0000","last_clean":"2024-09-17T03:35:33.246218+0000","last_became_active":"2024-09-17T03:35:31.400898+0000","last_became_peered":"2024-09-17T03:35:31.400898+0000","last_unstale":"2024-09-17T03:35:33.246218+0000","last_undegraded":"2024-09-17T03:35:33.246218+0000","last_fullsized":"2024-09-17T03:35:33.246218+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:05.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245798+0000","last_change":"2024-09-17T03:35:31.414441+0000","last_active":"2024-09-17T03:35:33.245798+0000","last_peered":"2024-09-17T03:35:33.245798+0000","last_clean":"2024-09-17T03:35:33.245798+0000","last_became_active":"2024-09-17T03:35:31.413335+0000","last_became_peered":"2024-09-17T03:35:31.413335+0000","last_unstale":"2024-09-17T03:35:33.245798+0000","last_undegraded":"2024-09-17T03:35:33.245798+0000","last_fullsized":"2024-09-17T03:35:33.245798+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:53.851297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247266+0000","last_change":"2024-09-17T03:35:31.405502+0000","last_active":"2024-09-17T03:35:33.247266+0000","last_peered":"2024-09-17T03:35:33.247266+0000","last_clean":"2024-09-17T03:35:33.247266+0000","last_became_active":"2024-09-17T03:35:31.405176+0000","last_became_peered":"2024-09-17T03:35:31.405176+0000","last_unstale":"2024-09-17T03:35:33.247266+0000","last_undegraded":"2024-09-17T03:35:33.247266+0000","last_fullsized":"2024-09-17T03:35:33.247266+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:57.119206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247233+0000","last_change":"2024-09-17T03:35:31.412249+0000","last_active":"2024-09-17T03:35:33.247233+0000","last_peered":"2024-09-17T03:35:33.247233+0000","last_clean":"2024-09-17T03:35:33.247233+0000","last_became_active":"2024-09-17T03:35:31.411891+0000","last_became_peered":"2024-09-17T03:35:31.411891+0000","last_unstale":"2024-09-17T03:35:33.247233+0000","last_undegraded":"2024-09-17T03:35:33.247233+0000","last_fullsized":"2024-09-17T03:35:33.247233+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:41.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246424+0000","last_change":"2024-09-17T03:35:31.405072+0000","last_active":"2024-09-17T03:35:33.246424+0000","last_peered":"2024-09-17T03:35:33.246424+0000","last_clean":"2024-09-17T03:35:33.246424+0000","last_became_active":"2024-09-17T03:35:31.402405+0000","last_became_peered":"2024-09-17T03:35:31.402405+0000","last_unstale":"2024-09-17T03:35:33.246424+0000","last_undegraded":"2024-09-17T03:35:33.246424+0000","last_fullsized":"2024-09-17T03:35:33.246424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:47.232514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.410987+0000","last_change":"2024-09-17T03:35:31.406987+0000","last_active":"2024-09-17T03:35:31.410987+0000","last_peered":"2024-09-17T03:35:31.410987+0000","last_clean":"2024-09-17T03:35:31.410987+0000","last_became_active":"2024-09-17T03:35:31.406667+0000","last_became_peered":"2024-09-17T03:35:31.406667+0000","last_unstale":"2024-09-17T03:35:31.410987+0000","last_undegraded":"2024-09-17T03:35:31.410987+0000","last_fullsized":"2024-09-17T03:35:31.410987+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:02.196006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402329+0000","last_change":"2024-09-17T03:35:31.405276+0000","last_active":"2024-09-17T03:35:32.402329+0000","last_peered":"2024-09-17T03:35:32.402329+0000","last_clean":"2024-09-17T03:35:32.402329+0000","last_became_active":"2024-09-17T03:35:31.404854+0000","last_became_peered":"2024-09-17T03:35:31.404854+0000","last_unstale":"2024-09-17T03:35:32.402329+0000","last_undegraded":"2024-09-17T03:35:32.402329+0000","last_fullsized":"2024-09-17T03:35:32.402329+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:51.927743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246364+0000","last_change":"2024-09-17T03:35:31.405373+0000","last_active":"2024-09-17T03:35:33.246364+0000","last_peered":"2024-09-17T03:35:33.246364+0000","last_clean":"2024-09-17T03:35:33.246364+0000","last_became_active":"2024-09-17T03:35:31.402700+0000","last_became_peered":"2024-09-17T03:35:31.402700+0000","last_unstale":"2024-09-17T03:35:33.246364+0000","last_undegraded":"2024-09-17T03:35:33.246364+0000","last_fullsized":"2024-09-17T03:35:33.246364+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:54.146369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418047+0000","last_change":"2024-09-17T03:35:31.412835+0000","last_active":"2024-09-17T03:35:31.418047+0000","last_peered":"2024-09-17T03:35:31.418047+0000","last_clean":"2024-09-17T03:35:31.418047+0000","last_became_active":"2024-09-17T03:35:31.412198+0000","last_became_peered":"2024-09-17T03:35:31.412198+0000","last_unstale":"2024-09-17T03:35:31.418047+0000","last_undegraded":"2024-09-17T03:35:31.418047+0000","last_fullsized":"2024-09-17T03:35:31.418047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:55.296103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401574+0000","last_change":"2024-09-17T03:35:31.398353+0000","last_active":"2024-09-17T03:35:32.401574+0000","last_peered":"2024-09-17T03:35:32.401574+0000","last_clean":"2024-09-17T03:35:32.401574+0000","last_became_active":"2024-09-17T03:35:31.397981+0000","last_became_peered":"2024-09-17T03:35:31.397981+0000","last_unstale":"2024-09-17T03:35:32.401574+0000","last_undegraded":"2024-09-17T03:35:32.401574+0000","last_fullsized":"2024-09-17T03:35:32.401574+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:10.466900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402104+0000","last_change":"2024-09-17T03:35:31.407366+0000","last_active":"2024-09-17T03:35:32.402104+0000","last_peered":"2024-09-17T03:35:32.402104+0000","last_clean":"2024-09-17T03:35:32.402104+0000","last_became_active":"2024-09-17T03:35:31.407070+0000","last_became_peered":"2024-09-17T03:35:31.407070+0000","last_unstale":"2024-09-17T03:35:32.402104+0000","last_undegraded":"2024-09-17T03:35:32.402104+0000","last_fullsized":"2024-09-17T03:35:32.402104+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:39.576378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402766+0000","last_change":"2024-09-17T03:35:31.409589+0000","last_active":"2024-09-17T03:35:32.402766+0000","last_peered":"2024-09-17T03:35:32.402766+0000","last_clean":"2024-09-17T03:35:32.402766+0000","last_became_active":"2024-09-17T03:35:31.409282+0000","last_became_peered":"2024-09-17T03:35:31.409282+0000","last_unstale":"2024-09-17T03:35:32.402766+0000","last_undegraded":"2024-09-17T03:35:32.402766+0000","last_fullsized":"2024-09-17T03:35:32.402766+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:09.036592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403409+0000","last_change":"2024-09-17T03:35:31.400666+0000","last_active":"2024-09-17T03:35:32.403409+0000","last_peered":"2024-09-17T03:35:32.403409+0000","last_clean":"2024-09-17T03:35:32.403409+0000","last_became_active":"2024-09-17T03:35:31.400310+0000","last_became_peered":"2024-09-17T03:35:31.400310+0000","last_unstale":"2024-09-17T03:35:32.403409+0000","last_undegraded":"2024-09-17T03:35:32.403409+0000","last_fullsized":"2024-09-17T03:35:32.403409+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:26.276737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402585+0000","last_change":"2024-09-17T03:35:31.398683+0000","last_active":"2024-09-17T03:35:32.402585+0000","last_peered":"2024-09-17T03:35:32.402585+0000","last_clean":"2024-09-17T03:35:32.402585+0000","last_became_active":"2024-09-17T03:35:31.397815+0000","last_became_peered":"2024-09-17T03:35:31.397815+0000","last_unstale":"2024-09-17T03:35:32.402585+0000","last_undegraded":"2024-09-17T03:35:32.402585+0000","last_fullsized":"2024-09-17T03:35:32.402585+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:27.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.415609+0000","last_change":"2024-09-17T03:35:31.407472+0000","last_active":"2024-09-17T03:35:31.415609+0000","last_peered":"2024-09-17T03:35:31.415609+0000","last_clean":"2024-09-17T03:35:31.415609+0000","last_became_active":"2024-09-17T03:35:31.407113+0000","last_became_peered":"2024-09-17T03:35:31.407113+0000","last_unstale":"2024-09-17T03:35:31.415609+0000","last_undegraded":"2024-09-17T03:35:31.415609+0000","last_fullsized":"2024-09-17T03:35:31.415609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:54.277873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246126+0000","last_change":"2024-09-17T03:35:31.412021+0000","last_active":"2024-09-17T03:35:33.246126+0000","last_peered":"2024-09-17T03:35:33.246126+0000","last_clean":"2024-09-17T03:35:33.246126+0000","last_became_active":"2024-09-17T03:35:31.411220+0000","last_became_peered":"2024-09-17T03:35:31.411220+0000","last_unstale":"2024-09-17T03:35:33.246126+0000","last_undegraded":"2024-09-17T03:35:33.246126+0000","last_fullsized":"2024-09-17T03:35:33.246126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:28.465361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402579+0000","last_change":"2024-09-17T03:35:31.400850+0000","last_active":"2024-09-17T03:35:32.402579+0000","last_peered":"2024-09-17T03:35:32.402579+0000","last_clean":"2024-09-17T03:35:32.402579+0000","last_became_active":"2024-09-17T03:35:31.399694+0000","last_became_peered":"2024-09-17T03:35:31.399694+0000","last_unstale":"2024-09-17T03:35:32.402579+0000","last_undegraded":"2024-09-17T03:35:32.402579+0000","last_fullsized":"2024-09-17T03:35:32.402579+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:15.804029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401959+0000","last_change":"2024-09-17T03:35:31.397458+0000","last_active":"2024-09-17T03:35:32.401959+0000","last_peered":"2024-09-17T03:35:32.401959+0000","last_clean":"2024-09-17T03:35:32.401959+0000","last_became_active":"2024-09-17T03:35:31.397125+0000","last_became_peered":"2024-09-17T03:35:31.397125+0000","last_unstale":"2024-09-17T03:35:32.401959+0000","last_undegraded":"2024-09-17T03:35:32.401959+0000","last_fullsized":"2024-09-17T03:35:32.401959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:12.398467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403366+0000","last_change":"2024-09-17T03:35:31.402912+0000","last_active":"2024-09-17T03:35:32.403366+0000","last_peered":"2024-09-17T03:35:32.403366+0000","last_clean":"2024-09-17T03:35:32.403366+0000","last_became_active":"2024-09-17T03:35:31.402288+0000","last_became_peered":"2024-09-17T03:35:31.402288+0000","last_unstale":"2024-09-17T03:35:32.403366+0000","last_undegraded":"2024-09-17T03:35:32.403366+0000","last_fullsized":"2024-09-17T03:35:32.403366+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:48.618526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402739+0000","last_change":"2024-09-17T03:35:31.404224+0000","last_active":"2024-09-17T03:35:32.402739+0000","last_peered":"2024-09-17T03:35:32.402739+0000","last_clean":"2024-09-17T03:35:32.402739+0000","last_became_active":"2024-09-17T03:35:31.403881+0000","last_became_peered":"2024-09-17T03:35:31.403881+0000","last_unstale":"2024-09-17T03:35:32.402739+0000","last_undegraded":"2024-09-17T03:35:32.402739+0000","last_fullsized":"2024-09-17T03:35:32.402739+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:48.268855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401989+0000","last_change":"2024-09-17T03:35:31.406570+0000","last_active":"2024-09-17T03:35:32.401989+0000","last_peered":"2024-09-17T03:35:32.401989+0000","last_clean":"2024-09-17T03:35:32.401989+0000","last_became_active":"2024-09-17T03:35:31.406264+0000","last_became_peered":"2024-09-17T03:35:31.406264+0000","last_unstale":"2024-09-17T03:35:32.401989+0000","last_undegraded":"2024-09-17T03:35:32.401989+0000","last_fullsized":"2024-09-17T03:35:32.401989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:54.519809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.409711+0000","last_change":"2024-09-17T03:35:31.405766+0000","last_active":"2024-09-17T03:35:31.409711+0000","last_peered":"2024-09-17T03:35:31.409711+0000","last_clean":"2024-09-17T03:35:31.409711+0000","last_became_active":"2024-09-17T03:35:31.405486+0000","last_became_peered":"2024-09-17T03:35:31.405486+0000","last_unstale":"2024-09-17T03:35:31.409711+0000","last_undegraded":"2024-09-17T03:35:31.409711+0000","last_fullsized":"2024-09-17T03:35:31.409711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:30.491636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402914+0000","last_change":"2024-09-17T03:35:31.397945+0000","last_active":"2024-09-17T03:35:32.402914+0000","last_peered":"2024-09-17T03:35:32.402914+0000","last_clean":"2024-09-17T03:35:32.402914+0000","last_became_active":"2024-09-17T03:35:31.397483+0000","last_became_peered":"2024-09-17T03:35:31.397483+0000","last_unstale":"2024-09-17T03:35:32.402914+0000","last_undegraded":"2024-09-17T03:35:32.402914+0000","last_fullsized":"2024-09-17T03:35:32.402914+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:17.690747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401490+0000","last_change":"2024-09-17T03:35:31.399674+0000","last_active":"2024-09-17T03:35:32.401490+0000","last_peered":"2024-09-17T03:35:32.401490+0000","last_clean":"2024-09-17T03:35:32.401490+0000","last_became_active":"2024-09-17T03:35:31.399333+0000","last_became_peered":"2024-09-17T03:35:31.399333+0000","last_unstale":"2024-09-17T03:35:32.401490+0000","last_undegraded":"2024-09-17T03:35:32.401490+0000","last_fullsized":"2024-09-17T03:35:32.401490+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:47.420180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418468+0000","last_change":"2024-09-17T03:35:31.414578+0000","last_active":"2024-09-17T03:35:31.418468+0000","last_peered":"2024-09-17T03:35:31.418468+0000","last_clean":"2024-09-17T03:35:31.418468+0000","last_became_active":"2024-09-17T03:35:31.414262+0000","last_became_peered":"2024-09-17T03:35:31.414262+0000","last_unstale":"2024-09-17T03:35:31.418468+0000","last_undegraded":"2024-09-17T03:35:31.418468+0000","last_fullsized":"2024-09-17T03:35:31.418468+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:32.910866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402217+0000","last_change":"2024-09-17T03:35:31.401064+0000","last_active":"2024-09-17T03:35:32.402217+0000","last_peered":"2024-09-17T03:35:32.402217+0000","last_clean":"2024-09-17T03:35:32.402217+0000","last_became_active":"2024-09-17T03:35:31.400749+0000","last_became_peered":"2024-09-17T03:35:31.400749+0000","last_unstale":"2024-09-17T03:35:32.402217+0000","last_undegraded":"2024-09-17T03:35:32.402217+0000","last_fullsized":"2024-09-17T03:35:32.402217+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:00.633516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.549749+0000","last_change":"2024-09-17T03:35:31.403885+0000","last_active":"2024-09-17T03:35:32.549749+0000","last_peered":"2024-09-17T03:35:32.549749+0000","last_clean":"2024-09-17T03:35:32.549749+0000","last_became_active":"2024-09-17T03:35:31.403576+0000","last_became_peered":"2024-09-17T03:35:31.403576+0000","last_unstale":"2024-09-17T03:35:32.549749+0000","last_undegraded":"2024-09-17T03:35:32.549749+0000","last_fullsized":"2024-09-17T03:35:32.549749+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:12.326673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420476+0000","last_change":"2024-09-17T03:35:30.397571+0000","last_active":"2024-09-17T03:35:31.420476+0000","last_peered":"2024-09-17T03:35:31.420476+0000","last_clean":"2024-09-17T03:35:31.420476+0000","last_became_active":"2024-09-17T03:35:30.397265+0000","last_became_peered":"2024-09-17T03:35:30.397265+0000","last_unstale":"2024-09-17T03:35:31.420476+0000","last_undegraded":"2024-09-17T03:35:31.420476+0000","last_fullsized":"2024-09-17T03:35:31.420476+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:28.399672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403356+0000","last_change":"2024-09-17T03:35:31.405484+0000","last_active":"2024-09-17T03:35:32.403356+0000","last_peered":"2024-09-17T03:35:32.403356+0000","last_clean":"2024-09-17T03:35:32.403356+0000","last_became_active":"2024-09-17T03:35:31.405056+0000","last_became_peered":"2024-09-17T03:35:31.405056+0000","last_unstale":"2024-09-17T03:35:32.403356+0000","last_undegraded":"2024-09-17T03:35:32.403356+0000","last_fullsized":"2024-09-17T03:35:32.403356+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:06.889353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402461+0000","last_change":"2024-09-17T03:35:30.398056+0000","last_active":"2024-09-17T03:35:32.402461+0000","last_peered":"2024-09-17T03:35:32.402461+0000","last_clean":"2024-09-17T03:35:32.402461+0000","last_became_active":"2024-09-17T03:35:30.397379+0000","last_became_peered":"2024-09-17T03:35:30.397379+0000","last_unstale":"2024-09-17T03:35:32.402461+0000","last_undegraded":"2024-09-17T03:35:32.402461+0000","last_fullsized":"2024-09-17T03:35:32.402461+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:16.688525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414454+0000","last_change":"2024-09-17T03:35:31.413962+0000","last_active":"2024-09-17T03:35:31.414454+0000","last_peered":"2024-09-17T03:35:31.414454+0000","last_clean":"2024-09-17T03:35:31.414454+0000","last_became_active":"2024-09-17T03:35:31.413687+0000","last_became_peered":"2024-09-17T03:35:31.413687+0000","last_unstale":"2024-09-17T03:35:31.414454+0000","last_undegraded":"2024-09-17T03:35:31.414454+0000","last_fullsized":"2024-09-17T03:35:31.414454+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:15.856455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.549901+0000","last_change":"2024-09-17T03:35:30.395465+0000","last_active":"2024-09-17T03:35:32.549901+0000","last_peered":"2024-09-17T03:35:32.549901+0000","last_clean":"2024-09-17T03:35:32.549901+0000","last_became_active":"2024-09-17T03:35:30.392479+0000","last_became_peered":"2024-09-17T03:35:30.392479+0000","last_unstale":"2024-09-17T03:35:32.549901+0000","last_undegraded":"2024-09-17T03:35:32.549901+0000","last_fullsized":"2024-09-17T03:35:32.549901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:31.379313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.550069+0000","last_change":"2024-09-17T03:35:31.404441+0000","last_active":"2024-09-17T03:35:32.550069+0000","last_peered":"2024-09-17T03:35:32.550069+0000","last_clean":"2024-09-17T03:35:32.550069+0000","last_became_active":"2024-09-17T03:35:31.404070+0000","last_became_peered":"2024-09-17T03:35:31.404070+0000","last_unstale":"2024-09-17T03:35:32.550069+0000","last_undegraded":"2024-09-17T03:35:32.550069+0000","last_fullsized":"2024-09-17T03:35:32.550069+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:16.775732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246426+0000","last_change":"2024-09-17T03:35:30.399494+0000","last_active":"2024-09-17T03:35:33.246426+0000","last_peered":"2024-09-17T03:35:33.246426+0000","last_clean":"2024-09-17T03:35:33.246426+0000","last_became_active":"2024-09-17T03:35:30.399167+0000","last_became_peered":"2024-09-17T03:35:30.399167+0000","last_unstale":"2024-09-17T03:35:33.246426+0000","last_undegraded":"2024-09-17T03:35:33.246426+0000","last_fullsized":"2024-09-17T03:35:33.246426+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:46.230292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402691+0000","last_change":"2024-09-17T03:35:31.408478+0000","last_active":"2024-09-17T03:35:32.402691+0000","last_peered":"2024-09-17T03:35:32.402691+0000","last_clean":"2024-09-17T03:35:32.402691+0000","last_became_active":"2024-09-17T03:35:31.408166+0000","last_became_peered":"2024-09-17T03:35:31.408166+0000","last_unstale":"2024-09-17T03:35:32.402691+0000","last_undegraded":"2024-09-17T03:35:32.402691+0000","last_fullsized":"2024-09-17T03:35:32.402691+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:27.777180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420303+0000","last_change":"2024-09-17T03:35:30.397347+0000","last_active":"2024-09-17T03:35:31.420303+0000","last_peered":"2024-09-17T03:35:31.420303+0000","last_clean":"2024-09-17T03:35:31.420303+0000","last_became_active":"2024-09-17T03:35:30.397032+0000","last_became_peered":"2024-09-17T03:35:30.397032+0000","last_unstale":"2024-09-17T03:35:31.420303+0000","last_undegraded":"2024-09-17T03:35:31.420303+0000","last_fullsized":"2024-09-17T03:35:31.420303+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:30.018392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246606+0000","last_change":"2024-09-17T03:35:31.409130+0000","last_active":"2024-09-17T03:35:33.246606+0000","last_peered":"2024-09-17T03:35:33.246606+0000","last_clean":"2024-09-17T03:35:33.246606+0000","last_became_active":"2024-09-17T03:35:31.402684+0000","last_became_peered":"2024-09-17T03:35:31.402684+0000","last_unstale":"2024-09-17T03:35:33.246606+0000","last_undegraded":"2024-09-17T03:35:33.246606+0000","last_fullsized":"2024-09-17T03:35:33.246606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:06.416514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401573+0000","last_change":"2024-09-17T03:35:30.398440+0000","last_active":"2024-09-17T03:35:32.401573+0000","last_peered":"2024-09-17T03:35:32.401573+0000","last_clean":"2024-09-17T03:35:32.401573+0000","last_became_active":"2024-09-17T03:35:30.397990+0000","last_became_peered":"2024-09-17T03:35:30.397990+0000","last_unstale":"2024-09-17T03:35:32.401573+0000","last_undegraded":"2024-09-17T03:35:32.401573+0000","last_fullsized":"2024-09-17T03:35:32.401573+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:23.192397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247021+0000","last_change":"2024-09-17T03:35:31.413310+0000","last_active":"2024-09-17T03:35:33.247021+0000","last_peered":"2024-09-17T03:35:33.247021+0000","last_clean":"2024-09-17T03:35:33.247021+0000","last_became_active":"2024-09-17T03:35:31.411948+0000","last_became_peered":"2024-09-17T03:35:31.411948+0000","last_unstale":"2024-09-17T03:35:33.247021+0000","last_undegraded":"2024-09-17T03:35:33.247021+0000","last_fullsized":"2024-09-17T03:35:33.247021+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:05.779628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.392717+0000","last_change":"2024-09-17T03:35:30.395877+0000","last_active":"2024-09-17T03:35:31.392717+0000","last_peered":"2024-09-17T03:35:31.392717+0000","last_clean":"2024-09-17T03:35:31.392717+0000","last_became_active":"2024-09-17T03:35:30.395247+0000","last_became_peered":"2024-09-17T03:35:30.395247+0000","last_unstale":"2024-09-17T03:35:31.392717+0000","last_undegraded":"2024-09-17T03:35:31.392717+0000","last_fullsized":"2024-09-17T03:35:31.392717+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:14.615340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402186+0000","last_change":"2024-09-17T03:35:31.397405+0000","last_active":"2024-09-17T03:35:32.402186+0000","last_peered":"2024-09-17T03:35:32.402186+0000","last_clean":"2024-09-17T03:35:32.402186+0000","last_became_active":"2024-09-17T03:35:31.396061+0000","last_became_peered":"2024-09-17T03:35:31.396061+0000","last_unstale":"2024-09-17T03:35:32.402186+0000","last_undegraded":"2024-09-17T03:35:32.402186+0000","last_fullsized":"2024-09-17T03:35:32.402186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:24.194620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246594+0000","last_change":"2024-09-17T03:35:30.399040+0000","last_active":"2024-09-17T03:35:33.246594+0000","last_peered":"2024-09-17T03:35:33.246594+0000","last_clean":"2024-09-17T03:35:33.246594+0000","last_became_active":"2024-09-17T03:35:30.398743+0000","last_became_peered":"2024-09-17T03:35:30.398743+0000","last_unstale":"2024-09-17T03:35:33.246594+0000","last_undegraded":"2024-09-17T03:35:33.246594+0000","last_fullsized":"2024-09-17T03:35:33.246594+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:26.711406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402379+0000","last_change":"2024-09-17T03:35:31.409547+0000","last_active":"2024-09-17T03:35:32.402379+0000","last_peered":"2024-09-17T03:35:32.402379+0000","last_clean":"2024-09-17T03:35:32.402379+0000","last_became_active":"2024-09-17T03:35:31.409211+0000","last_became_peered":"2024-09-17T03:35:31.409211+0000","last_unstale":"2024-09-17T03:35:32.402379+0000","last_undegraded":"2024-09-17T03:35:32.402379+0000","last_fullsized":"2024-09-17T03:35:32.402379+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:51.208868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402177+0000","last_change":"2024-09-17T03:35:30.397179+0000","last_active":"2024-09-17T03:35:32.402177+0000","last_peered":"2024-09-17T03:35:32.402177+0000","last_clean":"2024-09-17T03:35:32.402177+0000","last_became_active":"2024-09-17T03:35:30.396865+0000","last_became_peered":"2024-09-17T03:35:30.396865+0000","last_unstale":"2024-09-17T03:35:32.402177+0000","last_undegraded":"2024-09-17T03:35:32.402177+0000","last_fullsized":"2024-09-17T03:35:32.402177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:33.348171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247058+0000","last_change":"2024-09-17T03:35:31.395456+0000","last_active":"2024-09-17T03:35:33.247058+0000","last_peered":"2024-09-17T03:35:33.247058+0000","last_clean":"2024-09-17T03:35:33.247058+0000","last_became_active":"2024-09-17T03:35:31.395031+0000","last_became_peered":"2024-09-17T03:35:31.395031+0000","last_unstale":"2024-09-17T03:35:33.247058+0000","last_undegraded":"2024-09-17T03:35:33.247058+0000","last_fullsized":"2024-09-17T03:35:33.247058+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:02.367382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247302+0000","last_change":"2024-09-17T03:35:30.400208+0000","last_active":"2024-09-17T03:35:33.247302+0000","last_peered":"2024-09-17T03:35:33.247302+0000","last_clean":"2024-09-17T03:35:33.247302+0000","last_became_active":"2024-09-17T03:35:30.399880+0000","last_became_peered":"2024-09-17T03:35:30.399880+0000","last_unstale":"2024-09-17T03:35:33.247302+0000","last_undegraded":"2024-09-17T03:35:33.247302+0000","last_fullsized":"2024-09-17T03:35:33.247302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:07.030028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418539+0000","last_change":"2024-09-17T03:35:31.414900+0000","last_active":"2024-09-17T03:35:31.418539+0000","last_peered":"2024-09-17T03:35:31.418539+0000","last_clean":"2024-09-17T03:35:31.418539+0000","last_became_active":"2024-09-17T03:35:31.414601+0000","last_became_peered":"2024-09-17T03:35:31.414601+0000","last_unstale":"2024-09-17T03:35:31.418539+0000","last_undegraded":"2024-09-17T03:35:31.418539+0000","last_fullsized":"2024-09-17T03:35:31.418539+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:47.578570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246720+0000","last_change":"2024-09-17T03:35:30.397885+0000","last_active":"2024-09-17T03:35:33.246720+0000","last_peered":"2024-09-17T03:35:33.246720+0000","last_clean":"2024-09-17T03:35:33.246720+0000","last_became_active":"2024-09-17T03:35:30.397354+0000","last_became_peered":"2024-09-17T03:35:30.397354+0000","last_unstale":"2024-09-17T03:35:33.246720+0000","last_undegraded":"2024-09-17T03:35:33.246720+0000","last_fullsized":"2024-09-17T03:35:33.246720+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:35.865022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246617+0000","last_change":"2024-09-17T03:35:31.402934+0000","last_active":"2024-09-17T03:35:33.246617+0000","last_peered":"2024-09-17T03:35:33.246617+0000","last_clean":"2024-09-17T03:35:33.246617+0000","last_became_active":"2024-09-17T03:35:31.402618+0000","last_became_peered":"2024-09-17T03:35:31.402618+0000","last_unstale":"2024-09-17T03:35:33.246617+0000","last_undegraded":"2024-09-17T03:35:33.246617+0000","last_fullsized":"2024-09-17T03:35:33.246617+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:17.122609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402503+0000","last_change":"2024-09-17T03:35:30.400299+0000","last_active":"2024-09-17T03:35:32.402503+0000","last_peered":"2024-09-17T03:35:32.402503+0000","last_clean":"2024-09-17T03:35:32.402503+0000","last_became_active":"2024-09-17T03:35:30.399979+0000","last_became_peered":"2024-09-17T03:35:30.399979+0000","last_unstale":"2024-09-17T03:35:32.402503+0000","last_undegraded":"2024-09-17T03:35:32.402503+0000","last_fullsized":"2024-09-17T03:35:32.402503+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:59.706576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402595+0000","last_change":"2024-09-17T03:35:31.399942+0000","last_active":"2024-09-17T03:35:32.402595+0000","last_peered":"2024-09-17T03:35:32.402595+0000","last_clean":"2024-09-17T03:35:32.402595+0000","last_became_active":"2024-09-17T03:35:31.399566+0000","last_became_peered":"2024-09-17T03:35:31.399566+0000","last_unstale":"2024-09-17T03:35:32.402595+0000","last_undegraded":"2024-09-17T03:35:32.402595+0000","last_fullsized":"2024-09-17T03:35:32.402595+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:34.350393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418638+0000","last_change":"2024-09-17T03:35:30.400765+0000","last_active":"2024-09-17T03:35:31.418638+0000","last_peered":"2024-09-17T03:35:31.418638+0000","last_clean":"2024-09-17T03:35:31.418638+0000","last_became_active":"2024-09-17T03:35:30.400244+0000","last_became_peered":"2024-09-17T03:35:30.400244+0000","last_unstale":"2024-09-17T03:35:31.418638+0000","last_undegraded":"2024-09-17T03:35:31.418638+0000","last_fullsized":"2024-09-17T03:35:31.418638+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:07.625536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246829+0000","last_change":"2024-09-17T03:35:31.412718+0000","last_active":"2024-09-17T03:35:33.246829+0000","last_peered":"2024-09-17T03:35:33.246829+0000","last_clean":"2024-09-17T03:35:33.246829+0000","last_became_active":"2024-09-17T03:35:31.412309+0000","last_became_peered":"2024-09-17T03:35:31.412309+0000","last_unstale":"2024-09-17T03:35:33.246829+0000","last_undegraded":"2024-09-17T03:35:33.246829+0000","last_fullsized":"2024-09-17T03:35:33.246829+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:36.867244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246179+0000","last_change":"2024-09-17T03:35:30.398242+0000","last_active":"2024-09-17T03:35:33.246179+0000","last_peered":"2024-09-17T03:35:33.246179+0000","last_clean":"2024-09-17T03:35:33.246179+0000","last_became_active":"2024-09-17T03:35:30.397921+0000","last_became_peered":"2024-09-17T03:35:30.397921+0000","last_unstale":"2024-09-17T03:35:33.246179+0000","last_undegraded":"2024-09-17T03:35:33.246179+0000","last_fullsized":"2024-09-17T03:35:33.246179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:39.458251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.417835+0000","last_change":"2024-09-17T03:35:31.411302+0000","last_active":"2024-09-17T03:35:31.417835+0000","last_peered":"2024-09-17T03:35:31.417835+0000","last_clean":"2024-09-17T03:35:31.417835+0000","last_became_active":"2024-09-17T03:35:31.411018+0000","last_became_peered":"2024-09-17T03:35:31.411018+0000","last_unstale":"2024-09-17T03:35:31.417835+0000","last_undegraded":"2024-09-17T03:35:31.417835+0000","last_fullsized":"2024-09-17T03:35:31.417835+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:24.509256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.389019+0000","last_change":"2024-09-17T03:35:30.395268+0000","last_active":"2024-09-17T03:35:31.389019+0000","last_peered":"2024-09-17T03:35:31.389019+0000","last_clean":"2024-09-17T03:35:31.389019+0000","last_became_active":"2024-09-17T03:35:30.394971+0000","last_became_peered":"2024-09-17T03:35:30.394971+0000","last_unstale":"2024-09-17T03:35:31.389019+0000","last_undegraded":"2024-09-17T03:35:31.389019+0000","last_fullsized":"2024-09-17T03:35:31.389019+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:33.367494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246225+0000","last_change":"2024-09-17T03:35:31.402192+0000","last_active":"2024-09-17T03:35:33.246225+0000","last_peered":"2024-09-17T03:35:33.246225+0000","last_clean":"2024-09-17T03:35:33.246225+0000","last_became_active":"2024-09-17T03:35:31.401863+0000","last_became_peered":"2024-09-17T03:35:31.401863+0000","last_unstale":"2024-09-17T03:35:33.246225+0000","last_undegraded":"2024-09-17T03:35:33.246225+0000","last_fullsized":"2024-09-17T03:35:33.246225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:53.350279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246706+0000","last_change":"2024-09-17T03:35:30.401384+0000","last_active":"2024-09-17T03:35:33.246706+0000","last_peered":"2024-09-17T03:35:33.246706+0000","last_clean":"2024-09-17T03:35:33.246706+0000","last_became_active":"2024-09-17T03:35:30.400971+0000","last_became_peered":"2024-09-17T03:35:30.400971+0000","last_unstale":"2024-09-17T03:35:33.246706+0000","last_undegraded":"2024-09-17T03:35:33.246706+0000","last_fullsized":"2024-09-17T03:35:33.246706+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:50.925521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402755+0000","last_change":"2024-09-17T03:35:31.409312+0000","last_active":"2024-09-17T03:35:32.402755+0000","last_peered":"2024-09-17T03:35:32.402755+0000","last_clean":"2024-09-17T03:35:32.402755+0000","last_became_active":"2024-09-17T03:35:31.408971+0000","last_became_peered":"2024-09-17T03:35:31.408971+0000","last_unstale":"2024-09-17T03:35:32.402755+0000","last_undegraded":"2024-09-17T03:35:32.402755+0000","last_fullsized":"2024-09-17T03:35:32.402755+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:25.374706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402262+0000","last_change":"2024-09-17T03:35:30.393290+0000","last_active":"2024-09-17T03:35:32.402262+0000","last_peered":"2024-09-17T03:35:32.402262+0000","last_clean":"2024-09-17T03:35:32.402262+0000","last_became_active":"2024-09-17T03:35:30.392989+0000","last_became_peered":"2024-09-17T03:35:30.392989+0000","last_unstale":"2024-09-17T03:35:32.402262+0000","last_undegraded":"2024-09-17T03:35:32.402262+0000","last_fullsized":"2024-09-17T03:35:32.402262+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:24.104031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247288+0000","last_change":"2024-09-17T03:35:31.416789+0000","last_active":"2024-09-17T03:35:33.247288+0000","last_peered":"2024-09-17T03:35:33.247288+0000","last_clean":"2024-09-17T03:35:33.247288+0000","last_became_active":"2024-09-17T03:35:31.416494+0000","last_became_peered":"2024-09-17T03:35:31.416494+0000","last_unstale":"2024-09-17T03:35:33.247288+0000","last_undegraded":"2024-09-17T03:35:33.247288+0000","last_fullsized":"2024-09-17T03:35:33.247288+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:49.069752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402600+0000","last_change":"2024-09-17T03:35:30.397699+0000","last_active":"2024-09-17T03:35:32.402600+0000","last_peered":"2024-09-17T03:35:32.402600+0000","last_clean":"2024-09-17T03:35:32.402600+0000","last_became_active":"2024-09-17T03:35:30.396979+0000","last_became_peered":"2024-09-17T03:35:30.396979+0000","last_unstale":"2024-09-17T03:35:32.402600+0000","last_undegraded":"2024-09-17T03:35:32.402600+0000","last_fullsized":"2024-09-17T03:35:32.402600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:31.991916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403051+0000","last_change":"2024-09-17T03:35:31.404256+0000","last_active":"2024-09-17T03:35:32.403051+0000","last_peered":"2024-09-17T03:35:32.403051+0000","last_clean":"2024-09-17T03:35:32.403051+0000","last_became_active":"2024-09-17T03:35:31.403885+0000","last_became_peered":"2024-09-17T03:35:31.403885+0000","last_unstale":"2024-09-17T03:35:32.403051+0000","last_undegraded":"2024-09-17T03:35:32.403051+0000","last_fullsized":"2024-09-17T03:35:32.403051+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:32.994138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.407210+0000","last_change":"2024-09-17T03:35:30.396610+0000","last_active":"2024-09-17T03:35:31.407210+0000","last_peered":"2024-09-17T03:35:31.407210+0000","last_clean":"2024-09-17T03:35:31.407210+0000","last_became_active":"2024-09-17T03:35:30.396283+0000","last_became_peered":"2024-09-17T03:35:30.396283+0000","last_unstale":"2024-09-17T03:35:31.407210+0000","last_undegraded":"2024-09-17T03:35:31.407210+0000","last_fullsized":"2024-09-17T03:35:31.407210+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:23.780096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403180+0000","last_change":"2024-09-17T03:35:31.401440+0000","last_active":"2024-09-17T03:35:32.403180+0000","last_peered":"2024-09-17T03:35:32.403180+0000","last_clean":"2024-09-17T03:35:32.403180+0000","last_became_active":"2024-09-17T03:35:31.401099+0000","last_became_peered":"2024-09-17T03:35:31.401099+0000","last_unstale":"2024-09-17T03:35:32.403180+0000","last_undegraded":"2024-09-17T03:35:32.403180+0000","last_fullsized":"2024-09-17T03:35:32.403180+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:32.381535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.397521+0000","last_change":"2024-09-17T03:35:30.393748+0000","last_active":"2024-09-17T03:35:31.397521+0000","last_peered":"2024-09-17T03:35:31.397521+0000","last_clean":"2024-09-17T03:35:31.397521+0000","last_became_active":"2024-09-17T03:35:30.393414+0000","last_became_peered":"2024-09-17T03:35:30.393414+0000","last_unstale":"2024-09-17T03:35:31.397521+0000","last_undegraded":"2024-09-17T03:35:31.397521+0000","last_fullsized":"2024-09-17T03:35:31.397521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:58.947583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414334+0000","last_change":"2024-09-17T03:35:31.405793+0000","last_active":"2024-09-17T03:35:31.414334+0000","last_peered":"2024-09-17T03:35:31.414334+0000","last_clean":"2024-09-17T03:35:31.414334+0000","last_became_active":"2024-09-17T03:35:31.405147+0000","last_became_peered":"2024-09-17T03:35:31.405147+0000","last_unstale":"2024-09-17T03:35:31.414334+0000","last_undegraded":"2024-09-17T03:35:31.414334+0000","last_fullsized":"2024-09-17T03:35:31.414334+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:12.994357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.420361+0000","last_change":"2024-09-17T03:35:30.396540+0000","last_active":"2024-09-17T03:35:31.420361+0000","last_peered":"2024-09-17T03:35:31.420361+0000","last_clean":"2024-09-17T03:35:31.420361+0000","last_became_active":"2024-09-17T03:35:30.396260+0000","last_became_peered":"2024-09-17T03:35:30.396260+0000","last_unstale":"2024-09-17T03:35:31.420361+0000","last_undegraded":"2024-09-17T03:35:31.420361+0000","last_fullsized":"2024-09-17T03:35:31.420361+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:46.350229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.549684+0000","last_change":"2024-09-17T03:35:31.408122+0000","last_active":"2024-09-17T03:35:32.549684+0000","last_peered":"2024-09-17T03:35:32.549684+0000","last_clean":"2024-09-17T03:35:32.549684+0000","last_became_active":"2024-09-17T03:35:31.407811+0000","last_became_peered":"2024-09-17T03:35:31.407811+0000","last_unstale":"2024-09-17T03:35:32.549684+0000","last_undegraded":"2024-09-17T03:35:32.549684+0000","last_fullsized":"2024-09-17T03:35:32.549684+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:35.956501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.393481+0000","last_change":"2024-09-17T03:35:30.392017+0000","last_active":"2024-09-17T03:35:31.393481+0000","last_peered":"2024-09-17T03:35:31.393481+0000","last_clean":"2024-09-17T03:35:31.393481+0000","last_became_active":"2024-09-17T03:35:30.391697+0000","last_became_peered":"2024-09-17T03:35:30.391697+0000","last_unstale":"2024-09-17T03:35:31.393481+0000","last_undegraded":"2024-09-17T03:35:31.393481+0000","last_fullsized":"2024-09-17T03:35:31.393481+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:02.448896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402215+0000","last_change":"2024-09-17T03:35:31.397272+0000","last_active":"2024-09-17T03:35:32.402215+0000","last_peered":"2024-09-17T03:35:32.402215+0000","last_clean":"2024-09-17T03:35:32.402215+0000","last_became_active":"2024-09-17T03:35:31.396973+0000","last_became_peered":"2024-09-17T03:35:31.396973+0000","last_unstale":"2024-09-17T03:35:32.402215+0000","last_undegraded":"2024-09-17T03:35:32.402215+0000","last_fullsized":"2024-09-17T03:35:32.402215+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:58.482184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246167+0000","last_change":"2024-09-17T03:35:30.399305+0000","last_active":"2024-09-17T03:35:33.246167+0000","last_peered":"2024-09-17T03:35:33.246167+0000","last_clean":"2024-09-17T03:35:33.246167+0000","last_became_active":"2024-09-17T03:35:30.399023+0000","last_became_peered":"2024-09-17T03:35:30.399023+0000","last_unstale":"2024-09-17T03:35:33.246167+0000","last_undegraded":"2024-09-17T03:35:33.246167+0000","last_fullsized":"2024-09-17T03:35:33.246167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:57.479962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246007+0000","last_change":"2024-09-17T03:35:31.405875+0000","last_active":"2024-09-17T03:35:33.246007+0000","last_peered":"2024-09-17T03:35:33.246007+0000","last_clean":"2024-09-17T03:35:33.246007+0000","last_became_active":"2024-09-17T03:35:31.405563+0000","last_became_peered":"2024-09-17T03:35:31.405563+0000","last_unstale":"2024-09-17T03:35:33.246007+0000","last_undegraded":"2024-09-17T03:35:33.246007+0000","last_fullsized":"2024-09-17T03:35:33.246007+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:07.327340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245901+0000","last_change":"2024-09-17T03:35:30.400721+0000","last_active":"2024-09-17T03:35:33.245901+0000","last_peered":"2024-09-17T03:35:33.245901+0000","last_clean":"2024-09-17T03:35:33.245901+0000","last_became_active":"2024-09-17T03:35:30.400348+0000","last_became_peered":"2024-09-17T03:35:30.400348+0000","last_unstale":"2024-09-17T03:35:33.245901+0000","last_undegraded":"2024-09-17T03:35:33.245901+0000","last_fullsized":"2024-09-17T03:35:33.245901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:40.349515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403531+0000","last_change":"2024-09-17T03:35:31.401442+0000","last_active":"2024-09-17T03:35:32.403531+0000","last_peered":"2024-09-17T03:35:32.403531+0000","last_clean":"2024-09-17T03:35:32.403531+0000","last_became_active":"2024-09-17T03:35:31.400088+0000","last_became_peered":"2024-09-17T03:35:31.400088+0000","last_unstale":"2024-09-17T03:35:32.403531+0000","last_undegraded":"2024-09-17T03:35:32.403531+0000","last_fullsized":"2024-09-17T03:35:32.403531+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:58.702553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.389515+0000","last_change":"2024-09-17T03:35:30.403062+0000","last_active":"2024-09-17T03:35:31.389515+0000","last_peered":"2024-09-17T03:35:31.389515+0000","last_clean":"2024-09-17T03:35:31.389515+0000","last_became_active":"2024-09-17T03:35:30.402662+0000","last_became_peered":"2024-09-17T03:35:30.402662+0000","last_unstale":"2024-09-17T03:35:31.389515+0000","last_undegraded":"2024-09-17T03:35:31.389515+0000","last_fullsized":"2024-09-17T03:35:31.389515+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:59.550123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246485+0000","last_change":"2024-09-17T03:35:31.408051+0000","last_active":"2024-09-17T03:35:33.246485+0000","last_peered":"2024-09-17T03:35:33.246485+0000","last_clean":"2024-09-17T03:35:33.246485+0000","last_became_active":"2024-09-17T03:35:31.407739+0000","last_became_peered":"2024-09-17T03:35:31.407739+0000","last_unstale":"2024-09-17T03:35:33.246485+0000","last_undegraded":"2024-09-17T03:35:33.246485+0000","last_fullsized":"2024-09-17T03:35:33.246485+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:40.460473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246829+0000","last_change":"2024-09-17T03:35:30.397693+0000","last_active":"2024-09-17T03:35:33.246829+0000","last_peered":"2024-09-17T03:35:33.246829+0000","last_clean":"2024-09-17T03:35:33.246829+0000","last_became_active":"2024-09-17T03:35:30.397339+0000","last_became_peered":"2024-09-17T03:35:30.397339+0000","last_unstale":"2024-09-17T03:35:33.246829+0000","last_undegraded":"2024-09-17T03:35:33.246829+0000","last_fullsized":"2024-09-17T03:35:33.246829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:04.777406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246885+0000","last_change":"2024-09-17T03:35:31.394108+0000","last_active":"2024-09-17T03:35:33.246885+0000","last_peered":"2024-09-17T03:35:33.246885+0000","last_clean":"2024-09-17T03:35:33.246885+0000","last_became_active":"2024-09-17T03:35:31.393791+0000","last_became_peered":"2024-09-17T03:35:31.393791+0000","last_unstale":"2024-09-17T03:35:33.246885+0000","last_undegraded":"2024-09-17T03:35:33.246885+0000","last_fullsized":"2024-09-17T03:35:33.246885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:02.525626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.549500+0000","last_change":"2024-09-17T03:35:30.392739+0000","last_active":"2024-09-17T03:35:32.549500+0000","last_peered":"2024-09-17T03:35:32.549500+0000","last_clean":"2024-09-17T03:35:32.549500+0000","last_became_active":"2024-09-17T03:35:30.392368+0000","last_became_peered":"2024-09-17T03:35:30.392368+0000","last_unstale":"2024-09-17T03:35:32.549500+0000","last_undegraded":"2024-09-17T03:35:32.549500+0000","last_fullsized":"2024-09-17T03:35:32.549500+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:16.688525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.414362+0000","last_change":"2024-09-17T03:35:31.409930+0000","last_active":"2024-09-17T03:35:31.414362+0000","last_peered":"2024-09-17T03:35:31.414362+0000","last_clean":"2024-09-17T03:35:31.414362+0000","last_became_active":"2024-09-17T03:35:31.407002+0000","last_became_peered":"2024-09-17T03:35:31.407002+0000","last_unstale":"2024-09-17T03:35:31.414362+0000","last_undegraded":"2024-09-17T03:35:31.414362+0000","last_fullsized":"2024-09-17T03:35:31.414362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:37.172164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246452+0000","last_change":"2024-09-17T03:35:30.395917+0000","last_active":"2024-09-17T03:35:33.246452+0000","last_peered":"2024-09-17T03:35:33.246452+0000","last_clean":"2024-09-17T03:35:33.246452+0000","last_became_active":"2024-09-17T03:35:30.395586+0000","last_became_peered":"2024-09-17T03:35:30.395586+0000","last_unstale":"2024-09-17T03:35:33.246452+0000","last_undegraded":"2024-09-17T03:35:33.246452+0000","last_fullsized":"2024-09-17T03:35:33.246452+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:50.206646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.418566+0000","last_change":"2024-09-17T03:35:31.415927+0000","last_active":"2024-09-17T03:35:31.418566+0000","last_peered":"2024-09-17T03:35:31.418566+0000","last_clean":"2024-09-17T03:35:31.418566+0000","last_became_active":"2024-09-17T03:35:31.415622+0000","last_became_peered":"2024-09-17T03:35:31.415622+0000","last_unstale":"2024-09-17T03:35:31.418566+0000","last_undegraded":"2024-09-17T03:35:31.418566+0000","last_fullsized":"2024-09-17T03:35:31.418566+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:09.098082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401768+0000","last_change":"2024-09-17T03:35:30.398674+0000","last_active":"2024-09-17T03:35:32.401768+0000","last_peered":"2024-09-17T03:35:32.401768+0000","last_clean":"2024-09-17T03:35:32.401768+0000","last_became_active":"2024-09-17T03:35:30.397619+0000","last_became_peered":"2024-09-17T03:35:30.397619+0000","last_unstale":"2024-09-17T03:35:32.401768+0000","last_undegraded":"2024-09-17T03:35:32.401768+0000","last_fullsized":"2024-09-17T03:35:32.401768+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:14.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.409739+0000","last_change":"2024-09-17T03:35:31.403965+0000","last_active":"2024-09-17T03:35:31.409739+0000","last_peered":"2024-09-17T03:35:31.409739+0000","last_clean":"2024-09-17T03:35:31.409739+0000","last_became_active":"2024-09-17T03:35:31.403611+0000","last_became_peered":"2024-09-17T03:35:31.403611+0000","last_unstale":"2024-09-17T03:35:31.409739+0000","last_undegraded":"2024-09-17T03:35:31.409739+0000","last_fullsized":"2024-09-17T03:35:31.409739+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:04.069685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.549651+0000","last_change":"2024-09-17T03:35:30.392733+0000","last_active":"2024-09-17T03:35:32.549651+0000","last_peered":"2024-09-17T03:35:32.549651+0000","last_clean":"2024-09-17T03:35:32.549651+0000","last_became_active":"2024-09-17T03:35:30.392400+0000","last_became_peered":"2024-09-17T03:35:30.392400+0000","last_unstale":"2024-09-17T03:35:32.549651+0000","last_undegraded":"2024-09-17T03:35:32.549651+0000","last_fullsized":"2024-09-17T03:35:32.549651+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:31.991916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402273+0000","last_change":"2024-09-17T03:35:31.405956+0000","last_active":"2024-09-17T03:35:32.402273+0000","last_peered":"2024-09-17T03:35:32.402273+0000","last_clean":"2024-09-17T03:35:32.402273+0000","last_became_active":"2024-09-17T03:35:31.405630+0000","last_became_peered":"2024-09-17T03:35:31.405630+0000","last_unstale":"2024-09-17T03:35:32.402273+0000","last_undegraded":"2024-09-17T03:35:32.402273+0000","last_fullsized":"2024-09-17T03:35:32.402273+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:10.489788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246821+0000","last_change":"2024-09-17T03:35:30.401802+0000","last_active":"2024-09-17T03:35:33.246821+0000","last_peered":"2024-09-17T03:35:33.246821+0000","last_clean":"2024-09-17T03:35:33.246821+0000","last_became_active":"2024-09-17T03:35:30.401518+0000","last_became_peered":"2024-09-17T03:35:30.401518+0000","last_unstale":"2024-09-17T03:35:33.246821+0000","last_undegraded":"2024-09-17T03:35:33.246821+0000","last_fullsized":"2024-09-17T03:35:33.246821+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:47.266633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247339+0000","last_change":"2024-09-17T03:35:31.398693+0000","last_active":"2024-09-17T03:35:33.247339+0000","last_peered":"2024-09-17T03:35:33.247339+0000","last_clean":"2024-09-17T03:35:33.247339+0000","last_became_active":"2024-09-17T03:35:31.398341+0000","last_became_peered":"2024-09-17T03:35:31.398341+0000","last_unstale":"2024-09-17T03:35:33.247339+0000","last_undegraded":"2024-09-17T03:35:33.247339+0000","last_fullsized":"2024-09-17T03:35:33.247339+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:02.746934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:35:31.413751+0000","last_change":"2024-09-17T03:35:30.395939+0000","last_active":"2024-09-17T03:35:31.413751+0000","last_peered":"2024-09-17T03:35:31.413751+0000","last_clean":"2024-09-17T03:35:31.413751+0000","last_became_active":"2024-09-17T03:35:30.395536+0000","last_became_peered":"2024-09-17T03:35:30.395536+0000","last_unstale":"2024-09-17T03:35:31.413751+0000","last_undegraded":"2024-09-17T03:35:31.413751+0000","last_fullsized":"2024-09-17T03:35:31.413751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:24.396630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":156,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245767+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:35:33.245767+0000","last_peered":"2024-09-17T03:35:33.245767+0000","last_clean":"2024-09-17T03:35:33.245767+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:35:33.245767+0000","last_undegraded":"2024-09-17T03:35:33.245767+0000","last_fullsized":"2024-09-17T03:35:33.245767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36440,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335400,"statfs":{"total":96636764160,"available":96599449600,"internally_reserved":0,"allocated":1118208,"data_stored":801938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35864,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335976,"statfs":{"total":96636764160,"available":96600039424,"internally_reserved":0,"allocated":528384,"data_stored":212152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40032,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331808,"statfs":{"total":96636764160,"available":96595771392,"internally_reserved":0,"allocated":532480,"data_stored":213092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":536576,"data_stored":213114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35868,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335972,"statfs":{"total":96636764160,"available":96600035328,"internally_reserved":0,"allocated":524288,"data_stored":211550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":801882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":512000,"data_stored":205250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35856,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335984,"statfs":{"total":96636764160,"available":96600047616,"internally_reserved":0,"allocated":520192,"data_stored":205818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:35:38.853 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:35:38.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.981+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2098804176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac41631a0 msgr2=0x7fdac40cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.981+0000 7fdacb7f1640 1 --2- 172.21.15.146:0/2098804176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac41631a0 0x7fdac40cef40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdac406e100 tx=0x7fdab402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.981+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2098804176 shutdown_connections 2024-09-17T03:35:38.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.981+0000 7fdacb7f1640 1 --2- 172.21.15.146:0/2098804176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac41631a0 0x7fdac40cef40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.981+0000 7fdacb7f1640 1 --2- 172.21.15.146:0/2098804176 >> v2:172.21.15.179:3300/0 conn(0x7fdac415f1a0 0x7fdac40cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.981+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2098804176 >> 172.21.15.146:0/2098804176 conn(0x7fdac40d11f0 msgr2=0x7fdac40d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:38.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.981+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2098804176 shutdown_connections 2024-09-17T03:35:38.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.981+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2098804176 wait complete. 2024-09-17T03:35:38.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.983+0000 7fdacb7f1640 1 Processor -- start 2024-09-17T03:35:38.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.983+0000 7fdacb7f1640 1 -- start start 2024-09-17T03:35:38.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdacb7f1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac40b61f0 0x7fdac4158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdacb7f1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac415f1a0 0x7fdac40cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdacb7f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdac41631a0 0x7fdac40c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdacb7f1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40695b0 con 0x7fdac40b61f0 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdacb7f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdac4069430 con 0x7fdac41631a0 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdacb7f1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdac4069730 con 0x7fdac415f1a0 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdac958d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac40b61f0 0x7fdac4158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdac958d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac40b61f0 0x7fdac4158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39106/0 (socket says 172.21.15.146:39106) 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdac958d640 1 -- 172.21.15.146:0/2404216575 learned_addr learned my addr 172.21.15.146:0/2404216575 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdac9d8e640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdac41631a0 0x7fdac40c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdac8d8c640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac415f1a0 0x7fdac40cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdac958d640 1 -- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac415f1a0 msgr2=0x7fdac40cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdac958d640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac415f1a0 0x7fdac40cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdac958d640 1 -- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdac41631a0 msgr2=0x7fdac40c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdac958d640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdac41631a0 0x7fdac40c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.984+0000 7fdac958d640 1 -- 172.21.15.146:0/2404216575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac4161cf0 con 0x7fdac40b61f0 2024-09-17T03:35:38.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.985+0000 7fdac958d640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac40b61f0 0x7fdac4158290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdac000ea20 tx=0x7fdac000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:38.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.985+0000 7fdab9ffb640 1 -- 172.21.15.146:0/2404216575 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac000cde0 con 0x7fdac40b61f0 2024-09-17T03:35:38.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.985+0000 7fdab9ffb640 1 -- 172.21.15.146:0/2404216575 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdac0011560 con 0x7fdac40b61f0 2024-09-17T03:35:38.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.985+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2404216575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac4161fd0 con 0x7fdac40b61f0 2024-09-17T03:35:38.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.985+0000 7fdab9ffb640 1 -- 172.21.15.146:0/2404216575 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac0011990 con 0x7fdac40b61f0 2024-09-17T03:35:38.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.985+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2404216575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac40c8740 con 0x7fdac40b61f0 2024-09-17T03:35:38.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.986+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2404216575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac4069be0 con 0x7fdac40b61f0 2024-09-17T03:35:38.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.987+0000 7fdab9ffb640 1 -- 172.21.15.146:0/2404216575 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdac0011b30 con 0x7fdac40b61f0 2024-09-17T03:35:38.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.987+0000 7fdab9ffb640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa8078b90 0x7fdaa807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:38.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.987+0000 7fdab9ffb640 1 -- 172.21.15.146:0/2404216575 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fdac009b860 con 0x7fdac40b61f0 2024-09-17T03:35:38.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.988+0000 7fdac8d8c640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa8078b90 0x7fdaa807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:38.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.988+0000 7fdac8d8c640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa8078b90 0x7fdaa807b0a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdab4033000 tx=0x7fdab4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:38.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:38.992+0000 7fdab9ffb640 1 -- 172.21.15.146:0/2404216575 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdac0016030 con 0x7fdac40b61f0 2024-09-17T03:35:39.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.165+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2404216575 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdac40b4e10 con 0x7fdaa8078b90 2024-09-17T03:35:39.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.170+0000 7fdab9ffb640 1 -- 172.21.15.146:0/2404216575 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251924 (secure 0 0 0) 0x7fdac40b4e10 con 0x7fdaa8078b90 2024-09-17T03:35:39.171 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:39.173 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:35:39.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa8078b90 msgr2=0x7fdaa807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa8078b90 0x7fdaa807b0a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdab4033000 tx=0x7fdab4004730 comp rx=0 tx=0).stop 2024-09-17T03:35:39.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2404216575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac40b61f0 msgr2=0x7fdac4158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac40b61f0 0x7fdac4158290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdac000ea20 tx=0x7fdac000eee0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2404216575 shutdown_connections 2024-09-17T03:35:39.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa8078b90 0x7fdaa807b0a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdac41631a0 0x7fdac40c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdac415f1a0 0x7fdac40cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 --2- 172.21.15.146:0/2404216575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac40b61f0 0x7fdac4158290 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2404216575 >> 172.21.15.146:0/2404216575 conn(0x7fdac40d11f0 msgr2=0x7fdac4162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:39.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2404216575 shutdown_connections 2024-09-17T03:35:39.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.173+0000 7fdacb7f1640 1 -- 172.21.15.146:0/2404216575 wait complete. 2024-09-17T03:35:39.183 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-09-17T03:35:37.828384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283936,"kb_used_data":5288,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754690784,"statfs":{"total":773094113280,"available":772803362816,"internally_reserved":0,"allocated":5414912,"data_stored":2877396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.447333"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247030+0000","last_change":"2024-09-17T03:35:31.398341+0000","last_active":"2024-09-17T03:35:33.247030+0000","last_peered":"2024-09-17T03:35:33.247030+0000","last_clean":"2024-09-17T03:35:33.247030+0000","last_became_active":"2024-09-17T03:35:31.397901+0000","last_became_peered":"2024-09-17T03:35:31.397901+0000","last_unstale":"2024-09-17T03:35:33.247030+0000","last_undegraded":"2024-09-17T03:35:33.247030+0000","last_fullsized":"2024-09-17T03:35:33.247030+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:57.875816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246258+0000","last_change":"2024-09-17T03:35:31.409810+0000","last_active":"2024-09-17T03:35:33.246258+0000","last_peered":"2024-09-17T03:35:33.246258+0000","last_clean":"2024-09-17T03:35:33.246258+0000","last_became_active":"2024-09-17T03:35:31.409035+0000","last_became_peered":"2024-09-17T03:35:31.409035+0000","last_unstale":"2024-09-17T03:35:33.246258+0000","last_undegraded":"2024-09-17T03:35:33.246258+0000","last_fullsized":"2024-09-17T03:35:33.246258+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:09.563736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402882+0000","last_change":"2024-09-17T03:35:31.403821+0000","last_active":"2024-09-17T03:35:32.402882+0000","last_peered":"2024-09-17T03:35:32.402882+0000","last_clean":"2024-09-17T03:35:32.402882+0000","last_became_active":"2024-09-17T03:35:31.403509+0000","last_became_peered":"2024-09-17T03:35:31.403509+0000","last_unstale":"2024-09-17T03:35:32.402882+0000","last_undegraded":"2024-09-17T03:35:32.402882+0000","last_fullsized":"2024-09-17T03:35:32.402882+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:38.874740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246174+0000","last_change":"2024-09-17T03:35:31.411466+0000","last_active":"2024-09-17T03:35:33.246174+0000","last_peered":"2024-09-17T03:35:33.246174+0000","last_clean":"2024-09-17T03:35:33.246174+0000","last_became_active":"2024-09-17T03:35:31.411138+0000","last_became_peered":"2024-09-17T03:35:31.411138+0000","last_unstale":"2024-09-17T03:35:33.246174+0000","last_undegraded":"2024-09-17T03:35:33.246174+0000","last_fullsized":"2024-09-17T03:35:33.246174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:00.699229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245869+0000","last_change":"2024-09-17T03:35:31.406083+0000","last_active":"2024-09-17T03:35:33.245869+0000","last_peered":"2024-09-17T03:35:33.245869+0000","last_clean":"2024-09-17T03:35:33.245869+0000","last_became_active":"2024-09-17T03:35:31.405778+0000","last_became_peered":"2024-09-17T03:35:31.405778+0000","last_unstale":"2024-09-17T03:35:33.245869+0000","last_undegraded":"2024-09-17T03:35:33.245869+0000","last_fullsized":"2024-09-17T03:35:33.245869+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:47.352451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246593+0000","last_change":"2024-09-17T03:35:31.405448+0000","last_active":"2024-09-17T03:35:33.246593+0000","last_peered":"2024-09-17T03:35:33.246593+0000","last_clean":"2024-09-17T03:35:33.246593+0000","last_became_active":"2024-09-17T03:35:31.404612+0000","last_became_peered":"2024-09-17T03:35:31.404612+0000","last_unstale":"2024-09-17T03:35:33.246593+0000","last_undegraded":"2024-09-17T03:35:33.246593+0000","last_fullsized":"2024-09-17T03:35:33.246593+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:01.540889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246218+0000","last_change":"2024-09-17T03:35:31.401210+0000","last_active":"2024-09-17T03:35:33.246218+0000","last_peered":"2024-09-17T03:35:33.246218+0000","last_clean":"2024-09-17T03:35:33.246218+0000","last_became_active":"2024-09-17T03:35:31.400898+0000","last_became_peered":"2024-09-17T03:35:31.400898+0000","last_unstale":"2024-09-17T03:35:33.246218+0000","last_undegraded":"2024-09-17T03:35:33.246218+0000","last_fullsized":"2024-09-17T03:35:33.246218+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:05.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245798+0000","last_change":"2024-09-17T03:35:31.414441+0000","last_active":"2024-09-17T03:35:33.245798+0000","last_peered":"2024-09-17T03:35:33.245798+0000","last_clean":"2024-09-17T03:35:33.245798+0000","last_became_active":"2024-09-17T03:35:31.413335+0000","last_became_peered":"2024-09-17T03:35:31.413335+0000","last_unstale":"2024-09-17T03:35:33.245798+0000","last_undegraded":"2024-09-17T03:35:33.245798+0000","last_fullsized":"2024-09-17T03:35:33.245798+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:53.851297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247266+0000","last_change":"2024-09-17T03:35:31.405502+0000","last_active":"2024-09-17T03:35:33.247266+0000","last_peered":"2024-09-17T03:35:33.247266+0000","last_clean":"2024-09-17T03:35:33.247266+0000","last_became_active":"2024-09-17T03:35:31.405176+0000","last_became_peered":"2024-09-17T03:35:31.405176+0000","last_unstale":"2024-09-17T03:35:33.247266+0000","last_undegraded":"2024-09-17T03:35:33.247266+0000","last_fullsized":"2024-09-17T03:35:33.247266+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:57.119206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247233+0000","last_change":"2024-09-17T03:35:31.412249+0000","last_active":"2024-09-17T03:35:33.247233+0000","last_peered":"2024-09-17T03:35:33.247233+0000","last_clean":"2024-09-17T03:35:33.247233+0000","last_became_active":"2024-09-17T03:35:31.411891+0000","last_became_peered":"2024-09-17T03:35:31.411891+0000","last_unstale":"2024-09-17T03:35:33.247233+0000","last_undegraded":"2024-09-17T03:35:33.247233+0000","last_fullsized":"2024-09-17T03:35:33.247233+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:41.351738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246424+0000","last_change":"2024-09-17T03:35:31.405072+0000","last_active":"2024-09-17T03:35:33.246424+0000","last_peered":"2024-09-17T03:35:33.246424+0000","last_clean":"2024-09-17T03:35:33.246424+0000","last_became_active":"2024-09-17T03:35:31.402405+0000","last_became_peered":"2024-09-17T03:35:31.402405+0000","last_unstale":"2024-09-17T03:35:33.246424+0000","last_undegraded":"2024-09-17T03:35:33.246424+0000","last_fullsized":"2024-09-17T03:35:33.246424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:47.232514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245903+0000","last_change":"2024-09-17T03:35:31.406987+0000","last_active":"2024-09-17T03:35:33.245903+0000","last_peered":"2024-09-17T03:35:33.245903+0000","last_clean":"2024-09-17T03:35:33.245903+0000","last_became_active":"2024-09-17T03:35:31.406667+0000","last_became_peered":"2024-09-17T03:35:31.406667+0000","last_unstale":"2024-09-17T03:35:33.245903+0000","last_undegraded":"2024-09-17T03:35:33.245903+0000","last_fullsized":"2024-09-17T03:35:33.245903+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:54.277873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402329+0000","last_change":"2024-09-17T03:35:31.405276+0000","last_active":"2024-09-17T03:35:32.402329+0000","last_peered":"2024-09-17T03:35:32.402329+0000","last_clean":"2024-09-17T03:35:32.402329+0000","last_became_active":"2024-09-17T03:35:31.404854+0000","last_became_peered":"2024-09-17T03:35:31.404854+0000","last_unstale":"2024-09-17T03:35:32.402329+0000","last_undegraded":"2024-09-17T03:35:32.402329+0000","last_fullsized":"2024-09-17T03:35:32.402329+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:51.927743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246364+0000","last_change":"2024-09-17T03:35:31.405373+0000","last_active":"2024-09-17T03:35:33.246364+0000","last_peered":"2024-09-17T03:35:33.246364+0000","last_clean":"2024-09-17T03:35:33.246364+0000","last_became_active":"2024-09-17T03:35:31.402700+0000","last_became_peered":"2024-09-17T03:35:31.402700+0000","last_unstale":"2024-09-17T03:35:33.246364+0000","last_undegraded":"2024-09-17T03:35:33.246364+0000","last_fullsized":"2024-09-17T03:35:33.246364+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:54.146369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245590+0000","last_change":"2024-09-17T03:35:31.412835+0000","last_active":"2024-09-17T03:35:33.245590+0000","last_peered":"2024-09-17T03:35:33.245590+0000","last_clean":"2024-09-17T03:35:33.245590+0000","last_became_active":"2024-09-17T03:35:31.412198+0000","last_became_peered":"2024-09-17T03:35:31.412198+0000","last_unstale":"2024-09-17T03:35:33.245590+0000","last_undegraded":"2024-09-17T03:35:33.245590+0000","last_fullsized":"2024-09-17T03:35:33.245590+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:13.093759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401574+0000","last_change":"2024-09-17T03:35:31.398353+0000","last_active":"2024-09-17T03:35:32.401574+0000","last_peered":"2024-09-17T03:35:32.401574+0000","last_clean":"2024-09-17T03:35:32.401574+0000","last_became_active":"2024-09-17T03:35:31.397981+0000","last_became_peered":"2024-09-17T03:35:31.397981+0000","last_unstale":"2024-09-17T03:35:32.401574+0000","last_undegraded":"2024-09-17T03:35:32.401574+0000","last_fullsized":"2024-09-17T03:35:32.401574+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:10.466900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402104+0000","last_change":"2024-09-17T03:35:31.407366+0000","last_active":"2024-09-17T03:35:32.402104+0000","last_peered":"2024-09-17T03:35:32.402104+0000","last_clean":"2024-09-17T03:35:32.402104+0000","last_became_active":"2024-09-17T03:35:31.407070+0000","last_became_peered":"2024-09-17T03:35:31.407070+0000","last_unstale":"2024-09-17T03:35:32.402104+0000","last_undegraded":"2024-09-17T03:35:32.402104+0000","last_fullsized":"2024-09-17T03:35:32.402104+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:39.576378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402766+0000","last_change":"2024-09-17T03:35:31.409589+0000","last_active":"2024-09-17T03:35:32.402766+0000","last_peered":"2024-09-17T03:35:32.402766+0000","last_clean":"2024-09-17T03:35:32.402766+0000","last_became_active":"2024-09-17T03:35:31.409282+0000","last_became_peered":"2024-09-17T03:35:31.409282+0000","last_unstale":"2024-09-17T03:35:32.402766+0000","last_undegraded":"2024-09-17T03:35:32.402766+0000","last_fullsized":"2024-09-17T03:35:32.402766+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:09.036592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403409+0000","last_change":"2024-09-17T03:35:31.400666+0000","last_active":"2024-09-17T03:35:32.403409+0000","last_peered":"2024-09-17T03:35:32.403409+0000","last_clean":"2024-09-17T03:35:32.403409+0000","last_became_active":"2024-09-17T03:35:31.400310+0000","last_became_peered":"2024-09-17T03:35:31.400310+0000","last_unstale":"2024-09-17T03:35:32.403409+0000","last_undegraded":"2024-09-17T03:35:32.403409+0000","last_fullsized":"2024-09-17T03:35:32.403409+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:26.276737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402585+0000","last_change":"2024-09-17T03:35:31.398683+0000","last_active":"2024-09-17T03:35:32.402585+0000","last_peered":"2024-09-17T03:35:32.402585+0000","last_clean":"2024-09-17T03:35:32.402585+0000","last_became_active":"2024-09-17T03:35:31.397815+0000","last_became_peered":"2024-09-17T03:35:31.397815+0000","last_unstale":"2024-09-17T03:35:32.402585+0000","last_undegraded":"2024-09-17T03:35:32.402585+0000","last_fullsized":"2024-09-17T03:35:32.402585+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:27.713628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245712+0000","last_change":"2024-09-17T03:35:31.407472+0000","last_active":"2024-09-17T03:35:33.245712+0000","last_peered":"2024-09-17T03:35:33.245712+0000","last_clean":"2024-09-17T03:35:33.245712+0000","last_became_active":"2024-09-17T03:35:31.407113+0000","last_became_peered":"2024-09-17T03:35:31.407113+0000","last_unstale":"2024-09-17T03:35:33.245712+0000","last_undegraded":"2024-09-17T03:35:33.245712+0000","last_fullsized":"2024-09-17T03:35:33.245712+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:47.630846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246126+0000","last_change":"2024-09-17T03:35:31.412021+0000","last_active":"2024-09-17T03:35:33.246126+0000","last_peered":"2024-09-17T03:35:33.246126+0000","last_clean":"2024-09-17T03:35:33.246126+0000","last_became_active":"2024-09-17T03:35:31.411220+0000","last_became_peered":"2024-09-17T03:35:31.411220+0000","last_unstale":"2024-09-17T03:35:33.246126+0000","last_undegraded":"2024-09-17T03:35:33.246126+0000","last_fullsized":"2024-09-17T03:35:33.246126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:28.465361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402579+0000","last_change":"2024-09-17T03:35:31.400850+0000","last_active":"2024-09-17T03:35:32.402579+0000","last_peered":"2024-09-17T03:35:32.402579+0000","last_clean":"2024-09-17T03:35:32.402579+0000","last_became_active":"2024-09-17T03:35:31.399694+0000","last_became_peered":"2024-09-17T03:35:31.399694+0000","last_unstale":"2024-09-17T03:35:32.402579+0000","last_undegraded":"2024-09-17T03:35:32.402579+0000","last_fullsized":"2024-09-17T03:35:32.402579+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:15.804029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401959+0000","last_change":"2024-09-17T03:35:31.397458+0000","last_active":"2024-09-17T03:35:32.401959+0000","last_peered":"2024-09-17T03:35:32.401959+0000","last_clean":"2024-09-17T03:35:32.401959+0000","last_became_active":"2024-09-17T03:35:31.397125+0000","last_became_peered":"2024-09-17T03:35:31.397125+0000","last_unstale":"2024-09-17T03:35:32.401959+0000","last_undegraded":"2024-09-17T03:35:32.401959+0000","last_fullsized":"2024-09-17T03:35:32.401959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:12.398467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403366+0000","last_change":"2024-09-17T03:35:31.402912+0000","last_active":"2024-09-17T03:35:32.403366+0000","last_peered":"2024-09-17T03:35:32.403366+0000","last_clean":"2024-09-17T03:35:32.403366+0000","last_became_active":"2024-09-17T03:35:31.402288+0000","last_became_peered":"2024-09-17T03:35:31.402288+0000","last_unstale":"2024-09-17T03:35:32.403366+0000","last_undegraded":"2024-09-17T03:35:32.403366+0000","last_fullsized":"2024-09-17T03:35:32.403366+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:48.618526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402739+0000","last_change":"2024-09-17T03:35:31.404224+0000","last_active":"2024-09-17T03:35:32.402739+0000","last_peered":"2024-09-17T03:35:32.402739+0000","last_clean":"2024-09-17T03:35:32.402739+0000","last_became_active":"2024-09-17T03:35:31.403881+0000","last_became_peered":"2024-09-17T03:35:31.403881+0000","last_unstale":"2024-09-17T03:35:32.402739+0000","last_undegraded":"2024-09-17T03:35:32.402739+0000","last_fullsized":"2024-09-17T03:35:32.402739+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:48.268855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401989+0000","last_change":"2024-09-17T03:35:31.406570+0000","last_active":"2024-09-17T03:35:32.401989+0000","last_peered":"2024-09-17T03:35:32.401989+0000","last_clean":"2024-09-17T03:35:32.401989+0000","last_became_active":"2024-09-17T03:35:31.406264+0000","last_became_peered":"2024-09-17T03:35:31.406264+0000","last_unstale":"2024-09-17T03:35:32.401989+0000","last_undegraded":"2024-09-17T03:35:32.401989+0000","last_fullsized":"2024-09-17T03:35:32.401989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:54.519809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246495+0000","last_change":"2024-09-17T03:35:31.405766+0000","last_active":"2024-09-17T03:35:33.246495+0000","last_peered":"2024-09-17T03:35:33.246495+0000","last_clean":"2024-09-17T03:35:33.246495+0000","last_became_active":"2024-09-17T03:35:31.405486+0000","last_became_peered":"2024-09-17T03:35:31.405486+0000","last_unstale":"2024-09-17T03:35:33.246495+0000","last_undegraded":"2024-09-17T03:35:33.246495+0000","last_fullsized":"2024-09-17T03:35:33.246495+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:12.994357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402914+0000","last_change":"2024-09-17T03:35:31.397945+0000","last_active":"2024-09-17T03:35:32.402914+0000","last_peered":"2024-09-17T03:35:32.402914+0000","last_clean":"2024-09-17T03:35:32.402914+0000","last_became_active":"2024-09-17T03:35:31.397483+0000","last_became_peered":"2024-09-17T03:35:31.397483+0000","last_unstale":"2024-09-17T03:35:32.402914+0000","last_undegraded":"2024-09-17T03:35:32.402914+0000","last_fullsized":"2024-09-17T03:35:32.402914+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:17.690747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401490+0000","last_change":"2024-09-17T03:35:31.399674+0000","last_active":"2024-09-17T03:35:32.401490+0000","last_peered":"2024-09-17T03:35:32.401490+0000","last_clean":"2024-09-17T03:35:32.401490+0000","last_became_active":"2024-09-17T03:35:31.399333+0000","last_became_peered":"2024-09-17T03:35:31.399333+0000","last_unstale":"2024-09-17T03:35:32.401490+0000","last_undegraded":"2024-09-17T03:35:32.401490+0000","last_fullsized":"2024-09-17T03:35:32.401490+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:47.420180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245686+0000","last_change":"2024-09-17T03:35:31.414578+0000","last_active":"2024-09-17T03:35:33.245686+0000","last_peered":"2024-09-17T03:35:33.245686+0000","last_clean":"2024-09-17T03:35:33.245686+0000","last_became_active":"2024-09-17T03:35:31.414262+0000","last_became_peered":"2024-09-17T03:35:31.414262+0000","last_unstale":"2024-09-17T03:35:33.245686+0000","last_undegraded":"2024-09-17T03:35:33.245686+0000","last_fullsized":"2024-09-17T03:35:33.245686+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:39.538673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402217+0000","last_change":"2024-09-17T03:35:31.401064+0000","last_active":"2024-09-17T03:35:32.402217+0000","last_peered":"2024-09-17T03:35:32.402217+0000","last_clean":"2024-09-17T03:35:32.402217+0000","last_became_active":"2024-09-17T03:35:31.400749+0000","last_became_peered":"2024-09-17T03:35:31.400749+0000","last_unstale":"2024-09-17T03:35:32.402217+0000","last_undegraded":"2024-09-17T03:35:32.402217+0000","last_fullsized":"2024-09-17T03:35:32.402217+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:00.633516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.549749+0000","last_change":"2024-09-17T03:35:31.403885+0000","last_active":"2024-09-17T03:35:32.549749+0000","last_peered":"2024-09-17T03:35:32.549749+0000","last_clean":"2024-09-17T03:35:32.549749+0000","last_became_active":"2024-09-17T03:35:31.403576+0000","last_became_peered":"2024-09-17T03:35:31.403576+0000","last_unstale":"2024-09-17T03:35:32.549749+0000","last_undegraded":"2024-09-17T03:35:32.549749+0000","last_fullsized":"2024-09-17T03:35:32.549749+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:12.326673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247038+0000","last_change":"2024-09-17T03:35:30.397571+0000","last_active":"2024-09-17T03:35:33.247038+0000","last_peered":"2024-09-17T03:35:33.247038+0000","last_clean":"2024-09-17T03:35:33.247038+0000","last_became_active":"2024-09-17T03:35:30.397265+0000","last_became_peered":"2024-09-17T03:35:30.397265+0000","last_unstale":"2024-09-17T03:35:33.247038+0000","last_undegraded":"2024-09-17T03:35:33.247038+0000","last_fullsized":"2024-09-17T03:35:33.247038+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:28.399672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403356+0000","last_change":"2024-09-17T03:35:31.405484+0000","last_active":"2024-09-17T03:35:32.403356+0000","last_peered":"2024-09-17T03:35:32.403356+0000","last_clean":"2024-09-17T03:35:32.403356+0000","last_became_active":"2024-09-17T03:35:31.405056+0000","last_became_peered":"2024-09-17T03:35:31.405056+0000","last_unstale":"2024-09-17T03:35:32.403356+0000","last_undegraded":"2024-09-17T03:35:32.403356+0000","last_fullsized":"2024-09-17T03:35:32.403356+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:06.889353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402461+0000","last_change":"2024-09-17T03:35:30.398056+0000","last_active":"2024-09-17T03:35:32.402461+0000","last_peered":"2024-09-17T03:35:32.402461+0000","last_clean":"2024-09-17T03:35:32.402461+0000","last_became_active":"2024-09-17T03:35:30.397379+0000","last_became_peered":"2024-09-17T03:35:30.397379+0000","last_unstale":"2024-09-17T03:35:32.402461+0000","last_undegraded":"2024-09-17T03:35:32.402461+0000","last_fullsized":"2024-09-17T03:35:32.402461+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:16.688525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246770+0000","last_change":"2024-09-17T03:35:31.413962+0000","last_active":"2024-09-17T03:35:33.246770+0000","last_peered":"2024-09-17T03:35:33.246770+0000","last_clean":"2024-09-17T03:35:33.246770+0000","last_became_active":"2024-09-17T03:35:31.413687+0000","last_became_peered":"2024-09-17T03:35:31.413687+0000","last_unstale":"2024-09-17T03:35:33.246770+0000","last_undegraded":"2024-09-17T03:35:33.246770+0000","last_fullsized":"2024-09-17T03:35:33.246770+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:37.172164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.549901+0000","last_change":"2024-09-17T03:35:30.395465+0000","last_active":"2024-09-17T03:35:32.549901+0000","last_peered":"2024-09-17T03:35:32.549901+0000","last_clean":"2024-09-17T03:35:32.549901+0000","last_became_active":"2024-09-17T03:35:30.392479+0000","last_became_peered":"2024-09-17T03:35:30.392479+0000","last_unstale":"2024-09-17T03:35:32.549901+0000","last_undegraded":"2024-09-17T03:35:32.549901+0000","last_fullsized":"2024-09-17T03:35:32.549901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:31.379313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.550069+0000","last_change":"2024-09-17T03:35:31.404441+0000","last_active":"2024-09-17T03:35:32.550069+0000","last_peered":"2024-09-17T03:35:32.550069+0000","last_clean":"2024-09-17T03:35:32.550069+0000","last_became_active":"2024-09-17T03:35:31.404070+0000","last_became_peered":"2024-09-17T03:35:31.404070+0000","last_unstale":"2024-09-17T03:35:32.550069+0000","last_undegraded":"2024-09-17T03:35:32.550069+0000","last_fullsized":"2024-09-17T03:35:32.550069+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:16.775732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246426+0000","last_change":"2024-09-17T03:35:30.399494+0000","last_active":"2024-09-17T03:35:33.246426+0000","last_peered":"2024-09-17T03:35:33.246426+0000","last_clean":"2024-09-17T03:35:33.246426+0000","last_became_active":"2024-09-17T03:35:30.399167+0000","last_became_peered":"2024-09-17T03:35:30.399167+0000","last_unstale":"2024-09-17T03:35:33.246426+0000","last_undegraded":"2024-09-17T03:35:33.246426+0000","last_fullsized":"2024-09-17T03:35:33.246426+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:46.230292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402691+0000","last_change":"2024-09-17T03:35:31.408478+0000","last_active":"2024-09-17T03:35:32.402691+0000","last_peered":"2024-09-17T03:35:32.402691+0000","last_clean":"2024-09-17T03:35:32.402691+0000","last_became_active":"2024-09-17T03:35:31.408166+0000","last_became_peered":"2024-09-17T03:35:31.408166+0000","last_unstale":"2024-09-17T03:35:32.402691+0000","last_undegraded":"2024-09-17T03:35:32.402691+0000","last_fullsized":"2024-09-17T03:35:32.402691+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:27.777180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246043+0000","last_change":"2024-09-17T03:35:30.397347+0000","last_active":"2024-09-17T03:35:33.246043+0000","last_peered":"2024-09-17T03:35:33.246043+0000","last_clean":"2024-09-17T03:35:33.246043+0000","last_became_active":"2024-09-17T03:35:30.397032+0000","last_became_peered":"2024-09-17T03:35:30.397032+0000","last_unstale":"2024-09-17T03:35:33.246043+0000","last_undegraded":"2024-09-17T03:35:33.246043+0000","last_fullsized":"2024-09-17T03:35:33.246043+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:30.018392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246606+0000","last_change":"2024-09-17T03:35:31.409130+0000","last_active":"2024-09-17T03:35:33.246606+0000","last_peered":"2024-09-17T03:35:33.246606+0000","last_clean":"2024-09-17T03:35:33.246606+0000","last_became_active":"2024-09-17T03:35:31.402684+0000","last_became_peered":"2024-09-17T03:35:31.402684+0000","last_unstale":"2024-09-17T03:35:33.246606+0000","last_undegraded":"2024-09-17T03:35:33.246606+0000","last_fullsized":"2024-09-17T03:35:33.246606+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:06.416514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401573+0000","last_change":"2024-09-17T03:35:30.398440+0000","last_active":"2024-09-17T03:35:32.401573+0000","last_peered":"2024-09-17T03:35:32.401573+0000","last_clean":"2024-09-17T03:35:32.401573+0000","last_became_active":"2024-09-17T03:35:30.397990+0000","last_became_peered":"2024-09-17T03:35:30.397990+0000","last_unstale":"2024-09-17T03:35:32.401573+0000","last_undegraded":"2024-09-17T03:35:32.401573+0000","last_fullsized":"2024-09-17T03:35:32.401573+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:23.192397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247021+0000","last_change":"2024-09-17T03:35:31.413310+0000","last_active":"2024-09-17T03:35:33.247021+0000","last_peered":"2024-09-17T03:35:33.247021+0000","last_clean":"2024-09-17T03:35:33.247021+0000","last_became_active":"2024-09-17T03:35:31.411948+0000","last_became_peered":"2024-09-17T03:35:31.411948+0000","last_unstale":"2024-09-17T03:35:33.247021+0000","last_undegraded":"2024-09-17T03:35:33.247021+0000","last_fullsized":"2024-09-17T03:35:33.247021+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:05.779628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245639+0000","last_change":"2024-09-17T03:35:30.395877+0000","last_active":"2024-09-17T03:35:33.245639+0000","last_peered":"2024-09-17T03:35:33.245639+0000","last_clean":"2024-09-17T03:35:33.245639+0000","last_became_active":"2024-09-17T03:35:30.395247+0000","last_became_peered":"2024-09-17T03:35:30.395247+0000","last_unstale":"2024-09-17T03:35:33.245639+0000","last_undegraded":"2024-09-17T03:35:33.245639+0000","last_fullsized":"2024-09-17T03:35:33.245639+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:14.615340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402186+0000","last_change":"2024-09-17T03:35:31.397405+0000","last_active":"2024-09-17T03:35:32.402186+0000","last_peered":"2024-09-17T03:35:32.402186+0000","last_clean":"2024-09-17T03:35:32.402186+0000","last_became_active":"2024-09-17T03:35:31.396061+0000","last_became_peered":"2024-09-17T03:35:31.396061+0000","last_unstale":"2024-09-17T03:35:32.402186+0000","last_undegraded":"2024-09-17T03:35:32.402186+0000","last_fullsized":"2024-09-17T03:35:32.402186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:24.194620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246594+0000","last_change":"2024-09-17T03:35:30.399040+0000","last_active":"2024-09-17T03:35:33.246594+0000","last_peered":"2024-09-17T03:35:33.246594+0000","last_clean":"2024-09-17T03:35:33.246594+0000","last_became_active":"2024-09-17T03:35:30.398743+0000","last_became_peered":"2024-09-17T03:35:30.398743+0000","last_unstale":"2024-09-17T03:35:33.246594+0000","last_undegraded":"2024-09-17T03:35:33.246594+0000","last_fullsized":"2024-09-17T03:35:33.246594+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:26.711406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402379+0000","last_change":"2024-09-17T03:35:31.409547+0000","last_active":"2024-09-17T03:35:32.402379+0000","last_peered":"2024-09-17T03:35:32.402379+0000","last_clean":"2024-09-17T03:35:32.402379+0000","last_became_active":"2024-09-17T03:35:31.409211+0000","last_became_peered":"2024-09-17T03:35:31.409211+0000","last_unstale":"2024-09-17T03:35:32.402379+0000","last_undegraded":"2024-09-17T03:35:32.402379+0000","last_fullsized":"2024-09-17T03:35:32.402379+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:51.208868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402177+0000","last_change":"2024-09-17T03:35:30.397179+0000","last_active":"2024-09-17T03:35:32.402177+0000","last_peered":"2024-09-17T03:35:32.402177+0000","last_clean":"2024-09-17T03:35:32.402177+0000","last_became_active":"2024-09-17T03:35:30.396865+0000","last_became_peered":"2024-09-17T03:35:30.396865+0000","last_unstale":"2024-09-17T03:35:32.402177+0000","last_undegraded":"2024-09-17T03:35:32.402177+0000","last_fullsized":"2024-09-17T03:35:32.402177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:33.348171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247058+0000","last_change":"2024-09-17T03:35:31.395456+0000","last_active":"2024-09-17T03:35:33.247058+0000","last_peered":"2024-09-17T03:35:33.247058+0000","last_clean":"2024-09-17T03:35:33.247058+0000","last_became_active":"2024-09-17T03:35:31.395031+0000","last_became_peered":"2024-09-17T03:35:31.395031+0000","last_unstale":"2024-09-17T03:35:33.247058+0000","last_undegraded":"2024-09-17T03:35:33.247058+0000","last_fullsized":"2024-09-17T03:35:33.247058+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:02.367382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247302+0000","last_change":"2024-09-17T03:35:30.400208+0000","last_active":"2024-09-17T03:35:33.247302+0000","last_peered":"2024-09-17T03:35:33.247302+0000","last_clean":"2024-09-17T03:35:33.247302+0000","last_became_active":"2024-09-17T03:35:30.399880+0000","last_became_peered":"2024-09-17T03:35:30.399880+0000","last_unstale":"2024-09-17T03:35:33.247302+0000","last_undegraded":"2024-09-17T03:35:33.247302+0000","last_fullsized":"2024-09-17T03:35:33.247302+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:07.030028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246307+0000","last_change":"2024-09-17T03:35:31.414900+0000","last_active":"2024-09-17T03:35:33.246307+0000","last_peered":"2024-09-17T03:35:33.246307+0000","last_clean":"2024-09-17T03:35:33.246307+0000","last_became_active":"2024-09-17T03:35:31.414601+0000","last_became_peered":"2024-09-17T03:35:31.414601+0000","last_unstale":"2024-09-17T03:35:33.246307+0000","last_undegraded":"2024-09-17T03:35:33.246307+0000","last_fullsized":"2024-09-17T03:35:33.246307+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:41.999520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246720+0000","last_change":"2024-09-17T03:35:30.397885+0000","last_active":"2024-09-17T03:35:33.246720+0000","last_peered":"2024-09-17T03:35:33.246720+0000","last_clean":"2024-09-17T03:35:33.246720+0000","last_became_active":"2024-09-17T03:35:30.397354+0000","last_became_peered":"2024-09-17T03:35:30.397354+0000","last_unstale":"2024-09-17T03:35:33.246720+0000","last_undegraded":"2024-09-17T03:35:33.246720+0000","last_fullsized":"2024-09-17T03:35:33.246720+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:35.865022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246617+0000","last_change":"2024-09-17T03:35:31.402934+0000","last_active":"2024-09-17T03:35:33.246617+0000","last_peered":"2024-09-17T03:35:33.246617+0000","last_clean":"2024-09-17T03:35:33.246617+0000","last_became_active":"2024-09-17T03:35:31.402618+0000","last_became_peered":"2024-09-17T03:35:31.402618+0000","last_unstale":"2024-09-17T03:35:33.246617+0000","last_undegraded":"2024-09-17T03:35:33.246617+0000","last_fullsized":"2024-09-17T03:35:33.246617+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:17.122609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402503+0000","last_change":"2024-09-17T03:35:30.400299+0000","last_active":"2024-09-17T03:35:32.402503+0000","last_peered":"2024-09-17T03:35:32.402503+0000","last_clean":"2024-09-17T03:35:32.402503+0000","last_became_active":"2024-09-17T03:35:30.399979+0000","last_became_peered":"2024-09-17T03:35:30.399979+0000","last_unstale":"2024-09-17T03:35:32.402503+0000","last_undegraded":"2024-09-17T03:35:32.402503+0000","last_fullsized":"2024-09-17T03:35:32.402503+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:59.706576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402595+0000","last_change":"2024-09-17T03:35:31.399942+0000","last_active":"2024-09-17T03:35:32.402595+0000","last_peered":"2024-09-17T03:35:32.402595+0000","last_clean":"2024-09-17T03:35:32.402595+0000","last_became_active":"2024-09-17T03:35:31.399566+0000","last_became_peered":"2024-09-17T03:35:31.399566+0000","last_unstale":"2024-09-17T03:35:32.402595+0000","last_undegraded":"2024-09-17T03:35:32.402595+0000","last_fullsized":"2024-09-17T03:35:32.402595+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:34.350393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246170+0000","last_change":"2024-09-17T03:35:30.400765+0000","last_active":"2024-09-17T03:35:33.246170+0000","last_peered":"2024-09-17T03:35:33.246170+0000","last_clean":"2024-09-17T03:35:33.246170+0000","last_became_active":"2024-09-17T03:35:30.400244+0000","last_became_peered":"2024-09-17T03:35:30.400244+0000","last_unstale":"2024-09-17T03:35:33.246170+0000","last_undegraded":"2024-09-17T03:35:33.246170+0000","last_fullsized":"2024-09-17T03:35:33.246170+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:07.625536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246829+0000","last_change":"2024-09-17T03:35:31.412718+0000","last_active":"2024-09-17T03:35:33.246829+0000","last_peered":"2024-09-17T03:35:33.246829+0000","last_clean":"2024-09-17T03:35:33.246829+0000","last_became_active":"2024-09-17T03:35:31.412309+0000","last_became_peered":"2024-09-17T03:35:31.412309+0000","last_unstale":"2024-09-17T03:35:33.246829+0000","last_undegraded":"2024-09-17T03:35:33.246829+0000","last_fullsized":"2024-09-17T03:35:33.246829+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:36.867244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246179+0000","last_change":"2024-09-17T03:35:30.398242+0000","last_active":"2024-09-17T03:35:33.246179+0000","last_peered":"2024-09-17T03:35:33.246179+0000","last_clean":"2024-09-17T03:35:33.246179+0000","last_became_active":"2024-09-17T03:35:30.397921+0000","last_became_peered":"2024-09-17T03:35:30.397921+0000","last_unstale":"2024-09-17T03:35:33.246179+0000","last_undegraded":"2024-09-17T03:35:33.246179+0000","last_fullsized":"2024-09-17T03:35:33.246179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:39.458251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245950+0000","last_change":"2024-09-17T03:35:31.411302+0000","last_active":"2024-09-17T03:35:33.245950+0000","last_peered":"2024-09-17T03:35:33.245950+0000","last_clean":"2024-09-17T03:35:33.245950+0000","last_became_active":"2024-09-17T03:35:31.411018+0000","last_became_peered":"2024-09-17T03:35:31.411018+0000","last_unstale":"2024-09-17T03:35:33.245950+0000","last_undegraded":"2024-09-17T03:35:33.245950+0000","last_fullsized":"2024-09-17T03:35:33.245950+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:50.670352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245812+0000","last_change":"2024-09-17T03:35:30.395268+0000","last_active":"2024-09-17T03:35:33.245812+0000","last_peered":"2024-09-17T03:35:33.245812+0000","last_clean":"2024-09-17T03:35:33.245812+0000","last_became_active":"2024-09-17T03:35:30.394971+0000","last_became_peered":"2024-09-17T03:35:30.394971+0000","last_unstale":"2024-09-17T03:35:33.245812+0000","last_undegraded":"2024-09-17T03:35:33.245812+0000","last_fullsized":"2024-09-17T03:35:33.245812+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:33.367494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246225+0000","last_change":"2024-09-17T03:35:31.402192+0000","last_active":"2024-09-17T03:35:33.246225+0000","last_peered":"2024-09-17T03:35:33.246225+0000","last_clean":"2024-09-17T03:35:33.246225+0000","last_became_active":"2024-09-17T03:35:31.401863+0000","last_became_peered":"2024-09-17T03:35:31.401863+0000","last_unstale":"2024-09-17T03:35:33.246225+0000","last_undegraded":"2024-09-17T03:35:33.246225+0000","last_fullsized":"2024-09-17T03:35:33.246225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:53.350279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246706+0000","last_change":"2024-09-17T03:35:30.401384+0000","last_active":"2024-09-17T03:35:33.246706+0000","last_peered":"2024-09-17T03:35:33.246706+0000","last_clean":"2024-09-17T03:35:33.246706+0000","last_became_active":"2024-09-17T03:35:30.400971+0000","last_became_peered":"2024-09-17T03:35:30.400971+0000","last_unstale":"2024-09-17T03:35:33.246706+0000","last_undegraded":"2024-09-17T03:35:33.246706+0000","last_fullsized":"2024-09-17T03:35:33.246706+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:50.925521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402755+0000","last_change":"2024-09-17T03:35:31.409312+0000","last_active":"2024-09-17T03:35:32.402755+0000","last_peered":"2024-09-17T03:35:32.402755+0000","last_clean":"2024-09-17T03:35:32.402755+0000","last_became_active":"2024-09-17T03:35:31.408971+0000","last_became_peered":"2024-09-17T03:35:31.408971+0000","last_unstale":"2024-09-17T03:35:32.402755+0000","last_undegraded":"2024-09-17T03:35:32.402755+0000","last_fullsized":"2024-09-17T03:35:32.402755+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:25.374706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402262+0000","last_change":"2024-09-17T03:35:30.393290+0000","last_active":"2024-09-17T03:35:32.402262+0000","last_peered":"2024-09-17T03:35:32.402262+0000","last_clean":"2024-09-17T03:35:32.402262+0000","last_became_active":"2024-09-17T03:35:30.392989+0000","last_became_peered":"2024-09-17T03:35:30.392989+0000","last_unstale":"2024-09-17T03:35:32.402262+0000","last_undegraded":"2024-09-17T03:35:32.402262+0000","last_fullsized":"2024-09-17T03:35:32.402262+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:24.104031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247288+0000","last_change":"2024-09-17T03:35:31.416789+0000","last_active":"2024-09-17T03:35:33.247288+0000","last_peered":"2024-09-17T03:35:33.247288+0000","last_clean":"2024-09-17T03:35:33.247288+0000","last_became_active":"2024-09-17T03:35:31.416494+0000","last_became_peered":"2024-09-17T03:35:31.416494+0000","last_unstale":"2024-09-17T03:35:33.247288+0000","last_undegraded":"2024-09-17T03:35:33.247288+0000","last_fullsized":"2024-09-17T03:35:33.247288+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:49.069752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402600+0000","last_change":"2024-09-17T03:35:30.397699+0000","last_active":"2024-09-17T03:35:32.402600+0000","last_peered":"2024-09-17T03:35:32.402600+0000","last_clean":"2024-09-17T03:35:32.402600+0000","last_became_active":"2024-09-17T03:35:30.396979+0000","last_became_peered":"2024-09-17T03:35:30.396979+0000","last_unstale":"2024-09-17T03:35:32.402600+0000","last_undegraded":"2024-09-17T03:35:32.402600+0000","last_fullsized":"2024-09-17T03:35:32.402600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:31.991916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403051+0000","last_change":"2024-09-17T03:35:31.404256+0000","last_active":"2024-09-17T03:35:32.403051+0000","last_peered":"2024-09-17T03:35:32.403051+0000","last_clean":"2024-09-17T03:35:32.403051+0000","last_became_active":"2024-09-17T03:35:31.403885+0000","last_became_peered":"2024-09-17T03:35:31.403885+0000","last_unstale":"2024-09-17T03:35:32.403051+0000","last_undegraded":"2024-09-17T03:35:32.403051+0000","last_fullsized":"2024-09-17T03:35:32.403051+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:32.994138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246152+0000","last_change":"2024-09-17T03:35:30.396610+0000","last_active":"2024-09-17T03:35:33.246152+0000","last_peered":"2024-09-17T03:35:33.246152+0000","last_clean":"2024-09-17T03:35:33.246152+0000","last_became_active":"2024-09-17T03:35:30.396283+0000","last_became_peered":"2024-09-17T03:35:30.396283+0000","last_unstale":"2024-09-17T03:35:33.246152+0000","last_undegraded":"2024-09-17T03:35:33.246152+0000","last_fullsized":"2024-09-17T03:35:33.246152+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:23.780096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403180+0000","last_change":"2024-09-17T03:35:31.401440+0000","last_active":"2024-09-17T03:35:32.403180+0000","last_peered":"2024-09-17T03:35:32.403180+0000","last_clean":"2024-09-17T03:35:32.403180+0000","last_became_active":"2024-09-17T03:35:31.401099+0000","last_became_peered":"2024-09-17T03:35:31.401099+0000","last_unstale":"2024-09-17T03:35:32.403180+0000","last_undegraded":"2024-09-17T03:35:32.403180+0000","last_fullsized":"2024-09-17T03:35:32.403180+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:32.381535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246495+0000","last_change":"2024-09-17T03:35:30.393748+0000","last_active":"2024-09-17T03:35:33.246495+0000","last_peered":"2024-09-17T03:35:33.246495+0000","last_clean":"2024-09-17T03:35:33.246495+0000","last_became_active":"2024-09-17T03:35:30.393414+0000","last_became_peered":"2024-09-17T03:35:30.393414+0000","last_unstale":"2024-09-17T03:35:33.246495+0000","last_undegraded":"2024-09-17T03:35:33.246495+0000","last_fullsized":"2024-09-17T03:35:33.246495+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:58.947583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245711+0000","last_change":"2024-09-17T03:35:31.405793+0000","last_active":"2024-09-17T03:35:33.245711+0000","last_peered":"2024-09-17T03:35:33.245711+0000","last_clean":"2024-09-17T03:35:33.245711+0000","last_became_active":"2024-09-17T03:35:31.405147+0000","last_became_peered":"2024-09-17T03:35:31.405147+0000","last_unstale":"2024-09-17T03:35:33.245711+0000","last_undegraded":"2024-09-17T03:35:33.245711+0000","last_fullsized":"2024-09-17T03:35:33.245711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:11.301139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246387+0000","last_change":"2024-09-17T03:35:30.396540+0000","last_active":"2024-09-17T03:35:33.246387+0000","last_peered":"2024-09-17T03:35:33.246387+0000","last_clean":"2024-09-17T03:35:33.246387+0000","last_became_active":"2024-09-17T03:35:30.396260+0000","last_became_peered":"2024-09-17T03:35:30.396260+0000","last_unstale":"2024-09-17T03:35:33.246387+0000","last_undegraded":"2024-09-17T03:35:33.246387+0000","last_fullsized":"2024-09-17T03:35:33.246387+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:46.350229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.549684+0000","last_change":"2024-09-17T03:35:31.408122+0000","last_active":"2024-09-17T03:35:32.549684+0000","last_peered":"2024-09-17T03:35:32.549684+0000","last_clean":"2024-09-17T03:35:32.549684+0000","last_became_active":"2024-09-17T03:35:31.407811+0000","last_became_peered":"2024-09-17T03:35:31.407811+0000","last_unstale":"2024-09-17T03:35:32.549684+0000","last_undegraded":"2024-09-17T03:35:32.549684+0000","last_fullsized":"2024-09-17T03:35:32.549684+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:35.956501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245665+0000","last_change":"2024-09-17T03:35:30.392017+0000","last_active":"2024-09-17T03:35:33.245665+0000","last_peered":"2024-09-17T03:35:33.245665+0000","last_clean":"2024-09-17T03:35:33.245665+0000","last_became_active":"2024-09-17T03:35:30.391697+0000","last_became_peered":"2024-09-17T03:35:30.391697+0000","last_unstale":"2024-09-17T03:35:33.245665+0000","last_undegraded":"2024-09-17T03:35:33.245665+0000","last_fullsized":"2024-09-17T03:35:33.245665+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:02.448896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402215+0000","last_change":"2024-09-17T03:35:31.397272+0000","last_active":"2024-09-17T03:35:32.402215+0000","last_peered":"2024-09-17T03:35:32.402215+0000","last_clean":"2024-09-17T03:35:32.402215+0000","last_became_active":"2024-09-17T03:35:31.396973+0000","last_became_peered":"2024-09-17T03:35:31.396973+0000","last_unstale":"2024-09-17T03:35:32.402215+0000","last_undegraded":"2024-09-17T03:35:32.402215+0000","last_fullsized":"2024-09-17T03:35:32.402215+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:58.482184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246167+0000","last_change":"2024-09-17T03:35:30.399305+0000","last_active":"2024-09-17T03:35:33.246167+0000","last_peered":"2024-09-17T03:35:33.246167+0000","last_clean":"2024-09-17T03:35:33.246167+0000","last_became_active":"2024-09-17T03:35:30.399023+0000","last_became_peered":"2024-09-17T03:35:30.399023+0000","last_unstale":"2024-09-17T03:35:33.246167+0000","last_undegraded":"2024-09-17T03:35:33.246167+0000","last_fullsized":"2024-09-17T03:35:33.246167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:57.479962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246007+0000","last_change":"2024-09-17T03:35:31.405875+0000","last_active":"2024-09-17T03:35:33.246007+0000","last_peered":"2024-09-17T03:35:33.246007+0000","last_clean":"2024-09-17T03:35:33.246007+0000","last_became_active":"2024-09-17T03:35:31.405563+0000","last_became_peered":"2024-09-17T03:35:31.405563+0000","last_unstale":"2024-09-17T03:35:33.246007+0000","last_undegraded":"2024-09-17T03:35:33.246007+0000","last_fullsized":"2024-09-17T03:35:33.246007+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:07.327340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245901+0000","last_change":"2024-09-17T03:35:30.400721+0000","last_active":"2024-09-17T03:35:33.245901+0000","last_peered":"2024-09-17T03:35:33.245901+0000","last_clean":"2024-09-17T03:35:33.245901+0000","last_became_active":"2024-09-17T03:35:30.400348+0000","last_became_peered":"2024-09-17T03:35:30.400348+0000","last_unstale":"2024-09-17T03:35:33.245901+0000","last_undegraded":"2024-09-17T03:35:33.245901+0000","last_fullsized":"2024-09-17T03:35:33.245901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:40.349515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.403531+0000","last_change":"2024-09-17T03:35:31.401442+0000","last_active":"2024-09-17T03:35:32.403531+0000","last_peered":"2024-09-17T03:35:32.403531+0000","last_clean":"2024-09-17T03:35:32.403531+0000","last_became_active":"2024-09-17T03:35:31.400088+0000","last_became_peered":"2024-09-17T03:35:31.400088+0000","last_unstale":"2024-09-17T03:35:32.403531+0000","last_undegraded":"2024-09-17T03:35:32.403531+0000","last_fullsized":"2024-09-17T03:35:32.403531+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:58.702553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246244+0000","last_change":"2024-09-17T03:35:30.403062+0000","last_active":"2024-09-17T03:35:33.246244+0000","last_peered":"2024-09-17T03:35:33.246244+0000","last_clean":"2024-09-17T03:35:33.246244+0000","last_became_active":"2024-09-17T03:35:30.402662+0000","last_became_peered":"2024-09-17T03:35:30.402662+0000","last_unstale":"2024-09-17T03:35:33.246244+0000","last_undegraded":"2024-09-17T03:35:33.246244+0000","last_fullsized":"2024-09-17T03:35:33.246244+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:59.550123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246485+0000","last_change":"2024-09-17T03:35:31.408051+0000","last_active":"2024-09-17T03:35:33.246485+0000","last_peered":"2024-09-17T03:35:33.246485+0000","last_clean":"2024-09-17T03:35:33.246485+0000","last_became_active":"2024-09-17T03:35:31.407739+0000","last_became_peered":"2024-09-17T03:35:31.407739+0000","last_unstale":"2024-09-17T03:35:33.246485+0000","last_undegraded":"2024-09-17T03:35:33.246485+0000","last_fullsized":"2024-09-17T03:35:33.246485+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:40.460473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246829+0000","last_change":"2024-09-17T03:35:30.397693+0000","last_active":"2024-09-17T03:35:33.246829+0000","last_peered":"2024-09-17T03:35:33.246829+0000","last_clean":"2024-09-17T03:35:33.246829+0000","last_became_active":"2024-09-17T03:35:30.397339+0000","last_became_peered":"2024-09-17T03:35:30.397339+0000","last_unstale":"2024-09-17T03:35:33.246829+0000","last_undegraded":"2024-09-17T03:35:33.246829+0000","last_fullsized":"2024-09-17T03:35:33.246829+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:04.777406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246885+0000","last_change":"2024-09-17T03:35:31.394108+0000","last_active":"2024-09-17T03:35:33.246885+0000","last_peered":"2024-09-17T03:35:33.246885+0000","last_clean":"2024-09-17T03:35:33.246885+0000","last_became_active":"2024-09-17T03:35:31.393791+0000","last_became_peered":"2024-09-17T03:35:31.393791+0000","last_unstale":"2024-09-17T03:35:33.246885+0000","last_undegraded":"2024-09-17T03:35:33.246885+0000","last_fullsized":"2024-09-17T03:35:33.246885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:02.525626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.549500+0000","last_change":"2024-09-17T03:35:30.392739+0000","last_active":"2024-09-17T03:35:32.549500+0000","last_peered":"2024-09-17T03:35:32.549500+0000","last_clean":"2024-09-17T03:35:32.549500+0000","last_became_active":"2024-09-17T03:35:30.392368+0000","last_became_peered":"2024-09-17T03:35:30.392368+0000","last_unstale":"2024-09-17T03:35:32.549500+0000","last_undegraded":"2024-09-17T03:35:32.549500+0000","last_fullsized":"2024-09-17T03:35:32.549500+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:16.688525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246640+0000","last_change":"2024-09-17T03:35:31.409930+0000","last_active":"2024-09-17T03:35:33.246640+0000","last_peered":"2024-09-17T03:35:33.246640+0000","last_clean":"2024-09-17T03:35:33.246640+0000","last_became_active":"2024-09-17T03:35:31.407002+0000","last_became_peered":"2024-09-17T03:35:31.407002+0000","last_unstale":"2024-09-17T03:35:33.246640+0000","last_undegraded":"2024-09-17T03:35:33.246640+0000","last_fullsized":"2024-09-17T03:35:33.246640+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:50.545008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246452+0000","last_change":"2024-09-17T03:35:30.395917+0000","last_active":"2024-09-17T03:35:33.246452+0000","last_peered":"2024-09-17T03:35:33.246452+0000","last_clean":"2024-09-17T03:35:33.246452+0000","last_became_active":"2024-09-17T03:35:30.395586+0000","last_became_peered":"2024-09-17T03:35:30.395586+0000","last_unstale":"2024-09-17T03:35:33.246452+0000","last_undegraded":"2024-09-17T03:35:33.246452+0000","last_fullsized":"2024-09-17T03:35:33.246452+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:50.206646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245853+0000","last_change":"2024-09-17T03:35:31.415927+0000","last_active":"2024-09-17T03:35:33.245853+0000","last_peered":"2024-09-17T03:35:33.245853+0000","last_clean":"2024-09-17T03:35:33.245853+0000","last_became_active":"2024-09-17T03:35:31.415622+0000","last_became_peered":"2024-09-17T03:35:31.415622+0000","last_unstale":"2024-09-17T03:35:33.245853+0000","last_undegraded":"2024-09-17T03:35:33.245853+0000","last_fullsized":"2024-09-17T03:35:33.245853+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:19.074965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.401768+0000","last_change":"2024-09-17T03:35:30.398674+0000","last_active":"2024-09-17T03:35:32.401768+0000","last_peered":"2024-09-17T03:35:32.401768+0000","last_clean":"2024-09-17T03:35:32.401768+0000","last_became_active":"2024-09-17T03:35:30.397619+0000","last_became_peered":"2024-09-17T03:35:30.397619+0000","last_unstale":"2024-09-17T03:35:32.401768+0000","last_undegraded":"2024-09-17T03:35:32.401768+0000","last_fullsized":"2024-09-17T03:35:32.401768+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:14.801806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246165+0000","last_change":"2024-09-17T03:35:31.403965+0000","last_active":"2024-09-17T03:35:33.246165+0000","last_peered":"2024-09-17T03:35:33.246165+0000","last_clean":"2024-09-17T03:35:33.246165+0000","last_became_active":"2024-09-17T03:35:31.403611+0000","last_became_peered":"2024-09-17T03:35:31.403611+0000","last_unstale":"2024-09-17T03:35:33.246165+0000","last_undegraded":"2024-09-17T03:35:33.246165+0000","last_fullsized":"2024-09-17T03:35:33.246165+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:59.949805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.549651+0000","last_change":"2024-09-17T03:35:30.392733+0000","last_active":"2024-09-17T03:35:32.549651+0000","last_peered":"2024-09-17T03:35:32.549651+0000","last_clean":"2024-09-17T03:35:32.549651+0000","last_became_active":"2024-09-17T03:35:30.392400+0000","last_became_peered":"2024-09-17T03:35:30.392400+0000","last_unstale":"2024-09-17T03:35:32.549651+0000","last_undegraded":"2024-09-17T03:35:32.549651+0000","last_fullsized":"2024-09-17T03:35:32.549651+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:31.991916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:32.402273+0000","last_change":"2024-09-17T03:35:31.405956+0000","last_active":"2024-09-17T03:35:32.402273+0000","last_peered":"2024-09-17T03:35:32.402273+0000","last_clean":"2024-09-17T03:35:32.402273+0000","last_became_active":"2024-09-17T03:35:31.405630+0000","last_became_peered":"2024-09-17T03:35:31.405630+0000","last_unstale":"2024-09-17T03:35:32.402273+0000","last_undegraded":"2024-09-17T03:35:32.402273+0000","last_fullsized":"2024-09-17T03:35:32.402273+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:10.489788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246821+0000","last_change":"2024-09-17T03:35:30.401802+0000","last_active":"2024-09-17T03:35:33.246821+0000","last_peered":"2024-09-17T03:35:33.246821+0000","last_clean":"2024-09-17T03:35:33.246821+0000","last_became_active":"2024-09-17T03:35:30.401518+0000","last_became_peered":"2024-09-17T03:35:30.401518+0000","last_unstale":"2024-09-17T03:35:33.246821+0000","last_undegraded":"2024-09-17T03:35:33.246821+0000","last_fullsized":"2024-09-17T03:35:33.246821+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:47.266633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.247339+0000","last_change":"2024-09-17T03:35:31.398693+0000","last_active":"2024-09-17T03:35:33.247339+0000","last_peered":"2024-09-17T03:35:33.247339+0000","last_clean":"2024-09-17T03:35:33.247339+0000","last_became_active":"2024-09-17T03:35:31.398341+0000","last_became_peered":"2024-09-17T03:35:31.398341+0000","last_unstale":"2024-09-17T03:35:33.247339+0000","last_undegraded":"2024-09-17T03:35:33.247339+0000","last_fullsized":"2024-09-17T03:35:33.247339+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:30.374040+0000","last_clean_scrub_stamp":"2024-09-17T03:35:30.374040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:02.746934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.246376+0000","last_change":"2024-09-17T03:35:30.395939+0000","last_active":"2024-09-17T03:35:33.246376+0000","last_peered":"2024-09-17T03:35:33.246376+0000","last_clean":"2024-09-17T03:35:33.246376+0000","last_became_active":"2024-09-17T03:35:30.395536+0000","last_became_peered":"2024-09-17T03:35:30.395536+0000","last_unstale":"2024-09-17T03:35:33.246376+0000","last_undegraded":"2024-09-17T03:35:33.246376+0000","last_fullsized":"2024-09-17T03:35:33.246376+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:35:29.371817+0000","last_clean_scrub_stamp":"2024-09-17T03:35:29.371817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:24.396630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":156,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:35:33.245767+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:35:33.245767+0000","last_peered":"2024-09-17T03:35:33.245767+0000","last_clean":"2024-09-17T03:35:33.245767+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:35:33.245767+0000","last_undegraded":"2024-09-17T03:35:33.245767+0000","last_fullsized":"2024-09-17T03:35:33.245767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36440,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335400,"statfs":{"total":96636764160,"available":96599449600,"internally_reserved":0,"allocated":1118208,"data_stored":801938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35864,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335976,"statfs":{"total":96636764160,"available":96600039424,"internally_reserved":0,"allocated":528384,"data_stored":212152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40032,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331808,"statfs":{"total":96636764160,"available":96595771392,"internally_reserved":0,"allocated":532480,"data_stored":213092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":536576,"data_stored":213114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35868,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335972,"statfs":{"total":96636764160,"available":96600035328,"internally_reserved":0,"allocated":524288,"data_stored":211550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":801882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35864,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335976,"statfs":{"total":96636764160,"available":96600039424,"internally_reserved":0,"allocated":524288,"data_stored":211550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35872,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335968,"statfs":{"total":96636764160,"available":96600031232,"internally_reserved":0,"allocated":532480,"data_stored":212118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:35:39.187 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:35:39.187 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:35:39.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.345+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3089655798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa4004040 msgr2=0x7f9fa4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.345+0000 7f9fc31ad640 1 --2- 172.21.15.146:0/3089655798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa4004040 0x7f9fa4004800 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009b20 tx=0x7f9fa4005830 comp rx=0 tx=0).stop 2024-09-17T03:35:39.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.345+0000 7f9fc174a640 1 -- 172.21.15.146:0/3089655798 reap_dead start 2024-09-17T03:35:39.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.345+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3089655798 shutdown_connections 2024-09-17T03:35:39.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.345+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3089655798 >> 172.21.15.146:0/3089655798 conn(0x7f9fbc06dd60 msgr2=0x7f9fbc06e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:39.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.345+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3089655798 shutdown_connections 2024-09-17T03:35:39.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.345+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3089655798 wait complete. 2024-09-17T03:35:39.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.347+0000 7f9fc31ad640 1 Processor -- start 2024-09-17T03:35:39.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.347+0000 7f9fc31ad640 1 -- start start 2024-09-17T03:35:39.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc31ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa4004040 0x7f9fbc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc31ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fbc0b3710 0x7f9fbc0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc31ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fbc15d690 0x7f9fbc15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc31ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc073660 con 0x7f9fbc15d690 2024-09-17T03:35:39.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc31ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc0d1040 con 0x7f9fa4004040 2024-09-17T03:35:39.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc31ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9fbc0737e0 con 0x7f9fbc0b3710 2024-09-17T03:35:39.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc174a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fbc15d690 0x7f9fbc15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc174a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fbc15d690 0x7f9fbc15daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39122/0 (socket says 172.21.15.146:39122) 2024-09-17T03:35:39.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc174a640 1 -- 172.21.15.146:0/3119706479 learned_addr learned my addr 172.21.15.146:0/3119706479 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:39.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc0f49640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa4004040 0x7f9fbc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fbbfff640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fbc0b3710 0x7f9fbc0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc174a640 1 -- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fbc0b3710 msgr2=0x7f9fbc0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc174a640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fbc0b3710 0x7f9fbc0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc174a640 1 -- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa4004040 msgr2=0x7f9fbc15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc174a640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa4004040 0x7f9fbc15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fc174a640 1 -- 172.21.15.146:0/3119706479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fbc15dfe0 con 0x7f9fbc15d690 2024-09-17T03:35:39.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.348+0000 7f9fbbfff640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fbc0b3710 0x7f9fbc0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:39.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.349+0000 7f9fc174a640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fbc15d690 0x7f9fbc15daa0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40016b0 tx=0x7f9fb40064e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:39.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.349+0000 7f9fb97fa640 1 -- 172.21.15.146:0/3119706479 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4010890 con 0x7f9fbc15d690 2024-09-17T03:35:39.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.349+0000 7f9fb97fa640 1 -- 172.21.15.146:0/3119706479 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fb4017070 con 0x7f9fbc15d690 2024-09-17T03:35:39.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.349+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3119706479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fbc1f8fc0 con 0x7f9fbc15d690 2024-09-17T03:35:39.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.349+0000 7f9fb97fa640 1 -- 172.21.15.146:0/3119706479 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4010da0 con 0x7f9fbc15d690 2024-09-17T03:35:39.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.349+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3119706479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fbc1f9580 con 0x7f9fbc15d690 2024-09-17T03:35:39.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.350+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3119706479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fbc144f90 con 0x7f9fbc15d690 2024-09-17T03:35:39.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.350+0000 7f9fb97fa640 1 -- 172.21.15.146:0/3119706479 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9fb401c460 con 0x7f9fbc15d690 2024-09-17T03:35:39.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.351+0000 7f9fb97fa640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9fa8078b90 0x7f9fa807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.351+0000 7f9fb97fa640 1 -- 172.21.15.146:0/3119706479 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f9fb409b790 con 0x7f9fbc15d690 2024-09-17T03:35:39.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.351+0000 7f9fc0f49640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9fa8078b90 0x7f9fa807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.352+0000 7f9fc0f49640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9fa8078b90 0x7f9fa807b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9fac005fd0 tx=0x7f9fac00d630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:39.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.355+0000 7f9fb97fa640 1 -- 172.21.15.146:0/3119706479 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9fbc15dfe0 con 0x7f9fbc15d690 2024-09-17T03:35:39.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.606+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3119706479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9fbc144650 con 0x7f9fbc15d690 2024-09-17T03:35:39.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.609+0000 7f9fb97fa640 1 -- 172.21.15.146:0/3119706479 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f9fbc073fb0 con 0x7f9fbc15d690 2024-09-17T03:35:39.608 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:35:39.608 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:35:39.608 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:35:39.608 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:35:39.608 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:35:39.608 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:35:39.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9fa8078b90 msgr2=0x7f9fa807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9fa8078b90 0x7f9fa807b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9fac005fd0 tx=0x7f9fac00d630 comp rx=0 tx=0).stop 2024-09-17T03:35:39.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3119706479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fbc15d690 msgr2=0x7f9fbc15daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fbc15d690 0x7f9fbc15daa0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40016b0 tx=0x7f9fb40064e0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3119706479 shutdown_connections 2024-09-17T03:35:39.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9fa8078b90 0x7f9fa807b0a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fbc15d690 0x7f9fbc15daa0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fbc0b3710 0x7f9fbc0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 --2- 172.21.15.146:0/3119706479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa4004040 0x7f9fbc15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3119706479 >> 172.21.15.146:0/3119706479 conn(0x7f9fbc06dd60 msgr2=0x7f9fbc0b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:39.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3119706479 shutdown_connections 2024-09-17T03:35:39.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.611+0000 7f9fc31ad640 1 -- 172.21.15.146:0/3119706479 wait complete. 2024-09-17T03:35:39.622 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:39.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.735+0000 7f191cc3f640 1 -- 172.21.15.146:0/1121767869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f191806f420 msgr2=0x7f19180cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.735+0000 7f191cc3f640 1 --2- 172.21.15.146:0/1121767869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f191806f420 0x7f19180cf310 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f19180d3120 tx=0x7f190002a510 comp rx=0 tx=0).stop 2024-09-17T03:35:39.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.735+0000 7f191cc3f640 1 -- 172.21.15.146:0/1121767869 shutdown_connections 2024-09-17T03:35:39.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.735+0000 7f191cc3f640 1 --2- 172.21.15.146:0/1121767869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f191806f420 0x7f19180cf310 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.735+0000 7f191cc3f640 1 -- 172.21.15.146:0/1121767869 >> 172.21.15.146:0/1121767869 conn(0x7f19180d4b80 msgr2=0x7f19180d4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:39.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.735+0000 7f191cc3f640 1 -- 172.21.15.146:0/1121767869 shutdown_connections 2024-09-17T03:35:39.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.735+0000 7f191cc3f640 1 -- 172.21.15.146:0/1121767869 wait complete. 2024-09-17T03:35:39.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.737+0000 7f191cc3f640 1 Processor -- start 2024-09-17T03:35:39.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.737+0000 7f191cc3f640 1 -- start start 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.738+0000 7f191cc3f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1918068d00 0x7f19180abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.738+0000 7f191cc3f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f191815ebd0 0x7f191814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.738+0000 7f191cc3f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19181f9ab0 0x7f1918151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.738+0000 7f191cc3f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f19180d3ed0 con 0x7f191815ebd0 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.738+0000 7f191cc3f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f19180d3d50 con 0x7f19181f9ab0 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.738+0000 7f191cc3f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f19180d4050 con 0x7f1918068d00 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.738+0000 7f190dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f191815ebd0 0x7f191814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.738+0000 7f190dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f191815ebd0 0x7f191814dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39140/0 (socket says 172.21.15.146:39140) 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.738+0000 7f190dd9b640 1 -- 172.21.15.146:0/3343216263 learned_addr learned my addr 172.21.15.146:0/3343216263 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f191659c640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1918068d00 0x7f19180abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f1916d9d640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19181f9ab0 0x7f1918151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f190dd9b640 1 -- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1918068d00 msgr2=0x7f19180abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f190dd9b640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1918068d00 0x7f19180abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f190dd9b640 1 -- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19181f9ab0 msgr2=0x7f1918151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f190dd9b640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19181f9ab0 0x7f1918151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f190dd9b640 1 -- 172.21.15.146:0/3343216263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19181fa550 con 0x7f191815ebd0 2024-09-17T03:35:39.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f190dd9b640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f191815ebd0 0x7f191814dd50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19000098f0 tx=0x7f1900033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:39.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f190f7fe640 1 -- 172.21.15.146:0/3343216263 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1900031d60 con 0x7f191815ebd0 2024-09-17T03:35:39.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f190f7fe640 1 -- 172.21.15.146:0/3343216263 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1900033e10 con 0x7f191815ebd0 2024-09-17T03:35:39.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f191cc3f640 1 -- 172.21.15.146:0/3343216263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19181fa830 con 0x7f191815ebd0 2024-09-17T03:35:39.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f190f7fe640 1 -- 172.21.15.146:0/3343216263 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1900005260 con 0x7f191815ebd0 2024-09-17T03:35:39.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.739+0000 7f191cc3f640 1 -- 172.21.15.146:0/3343216263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19180ac180 con 0x7f191815ebd0 2024-09-17T03:35:39.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.740+0000 7f191cc3f640 1 -- 172.21.15.146:0/3343216263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19180ce990 con 0x7f191815ebd0 2024-09-17T03:35:39.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.741+0000 7f190f7fe640 1 -- 172.21.15.146:0/3343216263 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1900005400 con 0x7f191815ebd0 2024-09-17T03:35:39.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.742+0000 7f190f7fe640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18f8078bc0 0x7f18f807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:39.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.742+0000 7f190f7fe640 1 -- 172.21.15.146:0/3343216263 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f19000bbee0 con 0x7f191815ebd0 2024-09-17T03:35:39.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.742+0000 7f191659c640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18f8078bc0 0x7f18f807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:39.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.743+0000 7f191659c640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18f8078bc0 0x7f18f807b0d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1908006fd0 tx=0x7f1908009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:39.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.746+0000 7f190f7fe640 1 -- 172.21.15.146:0/3343216263 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f19180ce990 con 0x7f191815ebd0 2024-09-17T03:35:39.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.957+0000 7f191cc3f640 1 -- 172.21.15.146:0/3343216263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19180b5ea0 con 0x7f191815ebd0 2024-09-17T03:35:39.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.957+0000 7f190f7fe640 1 -- 172.21.15.146:0/3343216263 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5229 (secure 0 0 0) 0x7f19180b5ea0 con 0x7f191815ebd0 2024-09-17T03:35:39.956 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:39.956 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"btime":"2024-09-17T03:35:33:398538+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2310307824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2310307824},{"type":"v1","addr":"172.21.15.179:6836","nonce":2310307824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/422393296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":422393296},{"type":"v1","addr":"172.21.15.179:6837","nonce":422393296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3793010114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3793010114},{"type":"v1","addr":"172.21.15.146:6833","nonce":3793010114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:30.743460+0000","modified":"2024-09-17T03:35:32.751716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/924109004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":924109004},{"type":"v1","addr":"172.21.15.146:6835","nonce":924109004}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5400,"qdb_cluster":[5400]},"id":3}]} 2024-09-17T03:35:39.957 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 -- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18f8078bc0 msgr2=0x7f18f807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18f8078bc0 0x7f18f807b0d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1908006fd0 tx=0x7f1908009060 comp rx=0 tx=0).stop 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 -- 172.21.15.146:0/3343216263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f191815ebd0 msgr2=0x7f191814dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f191815ebd0 0x7f191814dd50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19000098f0 tx=0x7f1900033c20 comp rx=0 tx=0).stop 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 -- 172.21.15.146:0/3343216263 shutdown_connections 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f18f8078bc0 0x7f18f807b0d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19181f9ab0 0x7f1918151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f191815ebd0 0x7f191814dd50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 --2- 172.21.15.146:0/3343216263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1918068d00 0x7f19180abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 -- 172.21.15.146:0/3343216263 >> 172.21.15.146:0/3343216263 conn(0x7f19180d4b80 msgr2=0x7f19180b9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 -- 172.21.15.146:0/3343216263 shutdown_connections 2024-09-17T03:35:39.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:39.959+0000 7f191cc3f640 1 -- 172.21.15.146:0/3343216263 wait complete. 2024-09-17T03:35:40.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:35:30.743460+0000', 'modified': '2024-09-17T03:35:32.751716+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5400}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5400': {'gid': 5400, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/924109004', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 924109004}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 924109004}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5400, 'qdb_cluster': [5400]} 2024-09-17T03:35:40.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:35:40.373 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:35:40.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.489+0000 7fab48150640 1 -- 172.21.15.146:0/2982148770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab40069410 msgr2=0x7fab400b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.489+0000 7fab48150640 1 --2- 172.21.15.146:0/2982148770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab40069410 0x7fab400b3c00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fab4006ff40 tx=0x7fab3002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.489+0000 7fab48150640 1 -- 172.21.15.146:0/2982148770 shutdown_connections 2024-09-17T03:35:40.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.489+0000 7fab48150640 1 --2- 172.21.15.146:0/2982148770 >> v2:172.21.15.179:3300/0 conn(0x7fab400d3ce0 0x7fab4015ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.489+0000 7fab48150640 1 --2- 172.21.15.146:0/2982148770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab40069410 0x7fab400b3c00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.489+0000 7fab48150640 1 -- 172.21.15.146:0/2982148770 >> 172.21.15.146:0/2982148770 conn(0x7fab400d4960 msgr2=0x7fab400d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.489+0000 7fab48150640 1 -- 172.21.15.146:0/2982148770 shutdown_connections 2024-09-17T03:35:40.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.489+0000 7fab48150640 1 -- 172.21.15.146:0/2982148770 wait complete. 2024-09-17T03:35:40.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.491+0000 7fab48150640 1 Processor -- start 2024-09-17T03:35:40.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.491+0000 7fab48150640 1 -- start start 2024-09-17T03:35:40.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.492+0000 7fab48150640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400b36b0 0x7fab4014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.492+0000 7fab48150640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab400d3ce0 0x7fab4014ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.492+0000 7fab48150640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4014f280 0x7fab40159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.492+0000 7fab48150640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab40168ca0 con 0x7fab4014f280 2024-09-17T03:35:40.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.492+0000 7fab48150640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab40168b20 con 0x7fab400d3ce0 2024-09-17T03:35:40.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.492+0000 7fab48150640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fab40168e20 con 0x7fab400b36b0 2024-09-17T03:35:40.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab466ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4014f280 0x7fab40159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab466ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4014f280 0x7fab40159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39162/0 (socket says 172.21.15.146:39162) 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab466ed640 1 -- 172.21.15.146:0/2506007663 learned_addr learned my addr 172.21.15.146:0/2506007663 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab456eb640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab400d3ce0 0x7fab4014ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab45eec640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400b36b0 0x7fab4014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab466ed640 1 -- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400b36b0 msgr2=0x7fab4014e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab466ed640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400b36b0 0x7fab4014e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab466ed640 1 -- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab400d3ce0 msgr2=0x7fab4014ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab466ed640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab400d3ce0 0x7fab4014ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab466ed640 1 -- 172.21.15.146:0/2506007663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4015b530 con 0x7fab4014f280 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab45eec640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400b36b0 0x7fab4014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab466ed640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4014f280 0x7fab40159510 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fab3800e990 tx=0x7fab3800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab367fc640 1 -- 172.21.15.146:0/2506007663 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38004d20 con 0x7fab4014f280 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab367fc640 1 -- 172.21.15.146:0/2506007663 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab3800caa0 con 0x7fab4014f280 2024-09-17T03:35:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab48150640 1 -- 172.21.15.146:0/2506007663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4015b810 con 0x7fab4014f280 2024-09-17T03:35:40.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.493+0000 7fab367fc640 1 -- 172.21.15.146:0/2506007663 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38005020 con 0x7fab4014f280 2024-09-17T03:35:40.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.494+0000 7fab48150640 1 -- 172.21.15.146:0/2506007663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab40158d10 con 0x7fab4014f280 2024-09-17T03:35:40.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.496+0000 7fab367fc640 1 -- 172.21.15.146:0/2506007663 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab380051c0 con 0x7fab4014f280 2024-09-17T03:35:40.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.497+0000 7fab367fc640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab24078b90 0x7fab2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.497+0000 7fab367fc640 1 -- 172.21.15.146:0/2506007663 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fab3809b620 con 0x7fab4014f280 2024-09-17T03:35:40.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.497+0000 7fab45eec640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab24078b90 0x7fab2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.497+0000 7fab4f0bc740 1 Processor -- start 2024-09-17T03:35:40.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.497+0000 7fab4f0bc740 1 -- start start 2024-09-17T03:35:40.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.497+0000 7fab45eec640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab24078b90 0x7fab2407b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0016a0 tx=0x7fab3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.498+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50bd270 0x55adc548efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.498+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc50943b0 0x55adc548f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.498+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc509c590 0x55adc54ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.498+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55adc53d7820 con 0x55adc50943b0 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.498+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55adc53c6c50 con 0x55adc509c590 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.498+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55adc53caa60 con 0x55adc50bd270 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.498+0000 7fab456eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc50943b0 0x55adc548f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab456eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc50943b0 0x55adc548f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39170/0 (socket says 172.21.15.146:39170) 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab456eb640 1 -- 172.21.15.146:0/1981923599 learned_addr learned my addr 172.21.15.146:0/1981923599 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab45eec640 1 --2- 172.21.15.146:0/1981923599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50bd270 0x55adc548efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab466ed640 1 --2- 172.21.15.146:0/1981923599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc509c590 0x55adc54ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab456eb640 1 -- 172.21.15.146:0/1981923599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50bd270 msgr2=0x55adc548efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab456eb640 1 --2- 172.21.15.146:0/1981923599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50bd270 0x55adc548efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab456eb640 1 -- 172.21.15.146:0/1981923599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc509c590 msgr2=0x55adc54ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab456eb640 1 --2- 172.21.15.146:0/1981923599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc509c590 0x55adc54ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab456eb640 1 -- 172.21.15.146:0/1981923599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc5128850 con 0x55adc50943b0 2024-09-17T03:35:40.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab456eb640 1 --2- 172.21.15.146:0/1981923599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc50943b0 0x55adc548f4e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fab30000c00 tx=0x7fab300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8b27aad5874d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab237fe640 1 -- 172.21.15.146:0/1981923599 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30040030 con 0x55adc50943b0 2024-09-17T03:35:40.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab237fe640 1 -- 172.21.15.146:0/1981923599 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab30004040 con 0x55adc50943b0 2024-09-17T03:35:40.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.499+0000 7fab237fe640 1 -- 172.21.15.146:0/1981923599 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30035040 con 0x55adc50943b0 2024-09-17T03:35:40.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.500+0000 7fab4f0bc740 1 -- 172.21.15.146:0/1981923599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc50943b0 msgr2=0x55adc548f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.500+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/1981923599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc50943b0 0x55adc548f4e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fab30000c00 tx=0x7fab300046c0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.500+0000 7fab4f0bc740 1 -- 172.21.15.146:0/1981923599 shutdown_connections 2024-09-17T03:35:40.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.500+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/1981923599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc509c590 0x55adc54ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.500+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/1981923599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc50943b0 0x55adc548f4e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.500+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/1981923599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50bd270 0x55adc548efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.500+0000 7fab4f0bc740 1 -- 172.21.15.146:0/1981923599 >> 172.21.15.146:0/1981923599 conn(0x55adc50b13c0 msgr2=0x55adc5465260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.500+0000 7fab4f0bc740 1 -- 172.21.15.146:0/1981923599 shutdown_connections 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.500+0000 7fab4f0bc740 1 -- 172.21.15.146:0/1981923599 wait complete. 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.501+0000 7fab4f0bc740 1 -- start start 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.501+0000 7fab4f0bc740 1 Processor -- start 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.502+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50943b0 0x55adc54b9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50bd270 0x55adc547d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55adc5137620 con 0x55adc509c590 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55adc536c5f0 con 0x55adc50bd270 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55adc548fa20 con 0x55adc50943b0 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab4f0bc740 10 client.0 _ll_register_callbacks cb 0x55adc53700a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab456eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab456eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39178/0 (socket says 172.21.15.146:39178) 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab456eb640 1 -- 172.21.15.146:0/117473589 learned_addr learned my addr 172.21.15.146:0/117473589 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab45eec640 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50943b0 0x55adc54b9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab466ed640 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50bd270 0x55adc547d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab456eb640 1 -- 172.21.15.146:0/117473589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50943b0 msgr2=0x55adc54b9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab456eb640 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50943b0 0x55adc54b9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab456eb640 1 -- 172.21.15.146:0/117473589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50bd270 msgr2=0x55adc547d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab456eb640 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50bd270 0x55adc547d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab456eb640 1 -- 172.21.15.146:0/117473589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc519f6b0 con 0x55adc509c590 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab456eb640 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54a0b90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fab30005740 tx=0x7fab30005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7750db2cdd8924a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab20ff9640 1 -- 172.21.15.146:0/117473589 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30035070 con 0x55adc509c590 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab20ff9640 1 -- 172.21.15.146:0/117473589 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fab300035f0 con 0x55adc509c590 2024-09-17T03:35:40.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab4f0bc740 1 -- 172.21.15.146:0/117473589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab30004040 con 0x55adc509c590 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab20ff9640 1 -- 172.21.15.146:0/117473589 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fab30050050 con 0x55adc509c590 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab4f0bc740 10 client.5559 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.503+0000 7fab4f0bc740 1 -- 172.21.15.146:0/117473589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55adc547d6f0 con 0x55adc509c590 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.504+0000 7fab20ff9640 1 -- 172.21.15.146:0/117473589 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab30004040 con 0x55adc509c590 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.504+0000 7fab20ff9640 1 -- 172.21.15.146:0/117473589 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fab30053020 con 0x55adc509c590 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.504+0000 7fab4f0bc740 10 client.5559 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.504+0000 7fab4f0bc740 10 client.5559 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.504+0000 7fab4f0bc740 20 client.5559 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.504+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55adc507be40 0x55adc548e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.504+0000 7fab4f0bc740 4 client.5559 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.504+0000 7fab4f0bc740 1 -- 172.21.15.146:0/117473589 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adc53d9770 con 0x55adc507be40 2024-09-17T03:35:40.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.504+0000 7fab45eec640 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55adc507be40 0x55adc548e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.504+0000 7fab20ff9640 10 client.5559 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.504+0000 7fab45eec640 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55adc507be40 0x55adc548e190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d984a19bbf28297 server_cookie=3bcbb77d87c90369 in_seq=0 out_seq=0 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab20ff9640 1 -- 172.21.15.146:0/117473589 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55adc53d9770 con 0x55adc507be40 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab20ff9640 10 client.5559 handle_command_reply: tid=0 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 1 client.5559 shutdown 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 1 -- 172.21.15.146:0/117473589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 msgr2=0x55adc54a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54a0b90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fab30005740 tx=0x7fab30005770 comp rx=0 tx=0).stop 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 1 -- 172.21.15.146:0/117473589 shutdown_connections 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55adc507be40 0x55adc548e190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50bd270 0x55adc547d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab20ff9640 0 client.5559 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:40.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54a0b90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/117473589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50943b0 0x55adc54b9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 1 -- 172.21.15.146:0/117473589 >> 172.21.15.146:0/117473589 conn(0x55adc50b13c0 msgr2=0x55adc54adb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 1 -- 172.21.15.146:0/117473589 shutdown_connections 2024-09-17T03:35:40.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 1 -- 172.21.15.146:0/117473589 wait complete. 2024-09-17T03:35:40.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.505+0000 7fab4f0bc740 20 client.5559 trim_cache size 0 max 16384 2024-09-17T03:35:40.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.524+0000 7fab4f0bc740 1 Processor -- start 2024-09-17T03:35:40.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.524+0000 7fab4f0bc740 1 -- start start 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50943b0 0x55adc54cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50bd270 0x55adc54c3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab402022e0 con 0x55adc509c590 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab402013c0 con 0x55adc50943b0 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fab400ce0e0 con 0x55adc50bd270 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab456eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab456eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39186/0 (socket says 172.21.15.146:39186) 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab456eb640 1 -- 172.21.15.146:0/617885384 learned_addr learned my addr 172.21.15.146:0/617885384 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab456eb640 1 -- 172.21.15.146:0/617885384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50bd270 msgr2=0x55adc54c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab456eb640 1 --2- 172.21.15.146:0/617885384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50bd270 0x55adc54c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab456eb640 1 -- 172.21.15.146:0/617885384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50943b0 msgr2=0x55adc54cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab456eb640 1 --2- 172.21.15.146:0/617885384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50943b0 0x55adc54cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab456eb640 1 -- 172.21.15.146:0/617885384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adc545f210 con 0x55adc509c590 2024-09-17T03:35:40.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.525+0000 7fab456eb640 1 --2- 172.21.15.146:0/617885384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cde60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fab30009230 tx=0x7fab30003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16b77d787675218 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab22ffd640 1 -- 172.21.15.146:0/617885384 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30040070 con 0x55adc509c590 2024-09-17T03:35:40.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab22ffd640 1 -- 172.21.15.146:0/617885384 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab30049020 con 0x55adc509c590 2024-09-17T03:35:40.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab22ffd640 1 -- 172.21.15.146:0/617885384 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30035030 con 0x55adc509c590 2024-09-17T03:35:40.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab4f0bc740 1 -- 172.21.15.146:0/617885384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 msgr2=0x55adc54cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/617885384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cde60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fab30009230 tx=0x7fab30003890 comp rx=0 tx=0).stop 2024-09-17T03:35:40.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab4f0bc740 1 -- 172.21.15.146:0/617885384 shutdown_connections 2024-09-17T03:35:40.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/617885384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50bd270 0x55adc54c3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/617885384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cde60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/617885384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50943b0 0x55adc54cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab4f0bc740 1 -- 172.21.15.146:0/617885384 >> 172.21.15.146:0/617885384 conn(0x55adc50b13c0 msgr2=0x55adc547cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab4f0bc740 1 -- 172.21.15.146:0/617885384 shutdown_connections 2024-09-17T03:35:40.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.526+0000 7fab4f0bc740 1 -- 172.21.15.146:0/617885384 wait complete. 2024-09-17T03:35:40.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.527+0000 7fab4f0bc740 1 -- start start 2024-09-17T03:35:40.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.527+0000 7fab4f0bc740 1 Processor -- start 2024-09-17T03:35:40.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50943b0 0x55adc55284a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab4f0bc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50bd270 0x55adc548ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55adc5137620 con 0x55adc509c590 2024-09-17T03:35:40.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab400ce730 con 0x55adc50bd270 2024-09-17T03:35:40.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab4f0bc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55adc5487490 con 0x55adc50943b0 2024-09-17T03:35:40.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab4f0bc740 10 client.0 _ll_register_callbacks cb 0x7fab3805fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:40.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab456eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab456eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39198/0 (socket says 172.21.15.146:39198) 2024-09-17T03:35:40.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab456eb640 1 -- 172.21.15.146:0/733723628 learned_addr learned my addr 172.21.15.146:0/733723628 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab45eec640 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50943b0 0x55adc55284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab466ed640 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50bd270 0x55adc548ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab456eb640 1 -- 172.21.15.146:0/733723628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50943b0 msgr2=0x55adc55284a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab456eb640 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50943b0 0x55adc55284a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab456eb640 1 -- 172.21.15.146:0/733723628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50bd270 msgr2=0x55adc548ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab456eb640 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50bd270 0x55adc548ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab456eb640 1 -- 172.21.15.146:0/733723628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc548bd30 con 0x55adc509c590 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab466ed640 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50bd270 0x55adc548ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab456eb640 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cdef0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fab3003e040 tx=0x7fab30004960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0d2272ca6f9b4d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab20ff9640 1 -- 172.21.15.146:0/733723628 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3005b060 con 0x55adc509c590 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab20ff9640 1 -- 172.21.15.146:0/733723628 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fab30004d60 con 0x55adc509c590 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.529+0000 7fab4f0bc740 1 -- 172.21.15.146:0/733723628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab30049020 con 0x55adc509c590 2024-09-17T03:35:40.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab20ff9640 1 -- 172.21.15.146:0/733723628 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fab30061050 con 0x55adc509c590 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab4f0bc740 10 client.5565 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab4f0bc740 1 -- 172.21.15.146:0/733723628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55adc54b8b40 con 0x55adc509c590 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab20ff9640 1 -- 172.21.15.146:0/733723628 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab30049020 con 0x55adc509c590 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab20ff9640 1 -- 172.21.15.146:0/733723628 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fab30053040 con 0x55adc509c590 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab4f0bc740 10 client.5565 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab4f0bc740 10 client.5565 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab4f0bc740 20 client.5565 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55adc548f330 0x55adc552c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab4f0bc740 4 client.5565 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab4f0bc740 1 -- 172.21.15.146:0/733723628 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "status"}) -- 0x55adc53d5220 con 0x55adc548f330 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab45eec640 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55adc548f330 0x55adc552c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.530+0000 7fab20ff9640 10 client.5565 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab45eec640 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55adc548f330 0x55adc552c080 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4413543191e082a server_cookie=17939fd85b7857eb in_seq=0 out_seq=0 2024-09-17T03:35:40.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab20ff9640 1 -- 172.21.15.146:0/733723628 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55adc53d5220 con 0x55adc548f330 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab20ff9640 10 client.5565 handle_command_reply: tid=0 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 1 client.5565 shutdown 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 1 -- 172.21.15.146:0/733723628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 msgr2=0x55adc54cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cdef0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fab3003e040 tx=0x7fab30004960 comp rx=0 tx=0).stop 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 1 -- 172.21.15.146:0/733723628 shutdown_connections 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55adc548f330 0x55adc552c080 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55adc50bd270 0x55adc548ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab20ff9640 0 client.5565 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55adc509c590 0x55adc54cdef0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 1 --2- 172.21.15.146:0/733723628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55adc50943b0 0x55adc55284a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 1 -- 172.21.15.146:0/733723628 >> 172.21.15.146:0/733723628 conn(0x55adc50b13c0 msgr2=0x55adc54c3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 1 -- 172.21.15.146:0/733723628 shutdown_connections 2024-09-17T03:35:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 1 -- 172.21.15.146:0/733723628 wait complete. 2024-09-17T03:35:40.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.531+0000 7fab4f0bc740 20 client.5565 trim_cache size 0 max 16384 2024-09-17T03:35:40.536 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:40.536 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:35:40.536 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:35:40.536 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5400, 2024-09-17T03:35:40.536 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:35:40.536 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:35:40.536 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:35:40.536 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 9.1502557079999995, 2024-09-17T03:35:40.536 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 21, 2024-09-17T03:35:40.537 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 45, 2024-09-17T03:35:40.537 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 45, 2024-09-17T03:35:40.537 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 13.85367546 2024-09-17T03:35:40.537 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 -- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab24078b90 msgr2=0x7fab2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab24078b90 0x7fab2407b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0016a0 tx=0x7fab3c009040 comp rx=0 tx=0).stop 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 -- 172.21.15.146:0/2506007663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4014f280 msgr2=0x7fab40159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4014f280 0x7fab40159510 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fab3800e990 tx=0x7fab3800ee50 comp rx=0 tx=0).stop 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 -- 172.21.15.146:0/2506007663 shutdown_connections 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab24078b90 0x7fab2407b0a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4014f280 0x7fab40159510 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab400d3ce0 0x7fab4014ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 --2- 172.21.15.146:0/2506007663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab400b36b0 0x7fab4014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 -- 172.21.15.146:0/2506007663 >> 172.21.15.146:0/2506007663 conn(0x7fab400d4960 msgr2=0x7fab400d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 -- 172.21.15.146:0/2506007663 shutdown_connections 2024-09-17T03:35:40.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.532+0000 7fab48150640 1 -- 172.21.15.146:0/2506007663 wait complete. 2024-09-17T03:35:40.542 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:35:40.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.659+0000 7fb7f259d640 1 -- 172.21.15.146:0/2816942658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80039e0 msgr2=0x7fb7d8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.659+0000 7fb7f259d640 1 --2- 172.21.15.146:0/2816942658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80039e0 0x7fb7d8003e10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8006f80 tx=0x7fb7d8005830 comp rx=0 tx=0).stop 2024-09-17T03:35:40.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.659+0000 7fb7f1d9c640 1 -- 172.21.15.146:0/2816942658 reap_dead start 2024-09-17T03:35:40.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.659+0000 7fb7f259d640 1 -- 172.21.15.146:0/2816942658 shutdown_connections 2024-09-17T03:35:40.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.659+0000 7fb7f259d640 1 -- 172.21.15.146:0/2816942658 >> 172.21.15.146:0/2816942658 conn(0x7fb7ec0d4980 msgr2=0x7fb7ec0d4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.660+0000 7fb7f259d640 1 -- 172.21.15.146:0/2816942658 shutdown_connections 2024-09-17T03:35:40.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.660+0000 7fb7f259d640 1 -- 172.21.15.146:0/2816942658 wait complete. 2024-09-17T03:35:40.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.661+0000 7fb7f259d640 1 Processor -- start 2024-09-17T03:35:40.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.661+0000 7fb7f259d640 1 -- start start 2024-09-17T03:35:40.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f259d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80039e0 0x7fb7ec0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f259d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7ec0ce020 0x7fb7ec1f91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f259d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7ec1f52c0 0x7fb7ec15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f259d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec0ced30 con 0x7fb7d80039e0 2024-09-17T03:35:40.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f259d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec0cebb0 con 0x7fb7ec1f52c0 2024-09-17T03:35:40.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f259d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb7ec0ceeb0 con 0x7fb7ec0ce020 2024-09-17T03:35:40.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f159b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80039e0 0x7fb7ec0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f159b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80039e0 0x7fb7ec0caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39210/0 (socket says 172.21.15.146:39210) 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f159b640 1 -- 172.21.15.146:0/3464617280 learned_addr learned my addr 172.21.15.146:0/3464617280 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f0d9a640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7ec0ce020 0x7fb7ec1f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f1d9c640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7ec1f52c0 0x7fb7ec15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f159b640 1 -- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7ec0ce020 msgr2=0x7fb7ec1f91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f159b640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7ec0ce020 0x7fb7ec1f91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f159b640 1 -- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7ec1f52c0 msgr2=0x7fb7ec15c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f159b640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7ec1f52c0 0x7fb7ec15c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f159b640 1 -- 172.21.15.146:0/3464617280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ec162df0 con 0x7fb7d80039e0 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f159b640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80039e0 0x7fb7ec0caea0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c350 tx=0x7fb7e8003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7e1ffb640 1 -- 172.21.15.146:0/3464617280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8032030 con 0x7fb7d80039e0 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7e1ffb640 1 -- 172.21.15.146:0/3464617280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7e80014f0 con 0x7fb7d80039e0 2024-09-17T03:35:40.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7f259d640 1 -- 172.21.15.146:0/3464617280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ec1633b0 con 0x7fb7d80039e0 2024-09-17T03:35:40.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.663+0000 7fb7e1ffb640 1 -- 172.21.15.146:0/3464617280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8001c20 con 0x7fb7d80039e0 2024-09-17T03:35:40.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.664+0000 7fb7f259d640 1 -- 172.21.15.146:0/3464617280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ec1f89d0 con 0x7fb7d80039e0 2024-09-17T03:35:40.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.665+0000 7fb7f259d640 1 -- 172.21.15.146:0/3464617280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7ec0cf440 con 0x7fb7d80039e0 2024-09-17T03:35:40.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.665+0000 7fb7e1ffb640 1 -- 172.21.15.146:0/3464617280 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb7e8035020 con 0x7fb7d80039e0 2024-09-17T03:35:40.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.666+0000 7fb7e1ffb640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb7d0078bc0 0x7fb7d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:40.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.666+0000 7fb7e1ffb640 1 -- 172.21.15.146:0/3464617280 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fb7e80bb280 con 0x7fb7d80039e0 2024-09-17T03:35:40.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.666+0000 7fb7f0d9a640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb7d0078bc0 0x7fb7d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:40.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.667+0000 7fb7f0d9a640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb7d0078bc0 0x7fb7d007b0d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0b3210 tx=0x7fb7dc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:40.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.670+0000 7fb7e1ffb640 1 -- 172.21.15.146:0/3464617280 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb7e8047030 con 0x7fb7d80039e0 2024-09-17T03:35:40.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.885+0000 7fb7f259d640 1 -- 172.21.15.146:0/3464617280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb7ec0d1ea0 con 0x7fb7d80039e0 2024-09-17T03:35:40.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.885+0000 7fb7e1ffb640 1 -- 172.21.15.146:0/3464617280 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7fb7e8006260 con 0x7fb7d80039e0 2024-09-17T03:35:40.885 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:35:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 -- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb7d0078bc0 msgr2=0x7fb7d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb7d0078bc0 0x7fb7d007b0d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0b3210 tx=0x7fb7dc005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 -- 172.21.15.146:0/3464617280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80039e0 msgr2=0x7fb7ec0caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80039e0 0x7fb7ec0caea0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c350 tx=0x7fb7e8003e40 comp rx=0 tx=0).stop 2024-09-17T03:35:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 -- 172.21.15.146:0/3464617280 shutdown_connections 2024-09-17T03:35:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb7d0078bc0 0x7fb7d007b0d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7ec1f52c0 0x7fb7ec15c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7ec0ce020 0x7fb7ec1f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 --2- 172.21.15.146:0/3464617280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80039e0 0x7fb7ec0caea0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 -- 172.21.15.146:0/3464617280 >> 172.21.15.146:0/3464617280 conn(0x7fb7ec0d4980 msgr2=0x7fb7ec0d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 -- 172.21.15.146:0/3464617280 shutdown_connections 2024-09-17T03:35:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:40.888+0000 7fb7f259d640 1 -- 172.21.15.146:0/3464617280 wait complete. 2024-09-17T03:35:40.898 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:35:40.898 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:35:40.898 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:35:40.898 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:35:40.898 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:35:40.899 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:35:40.899 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:35:40.899 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:35:40.899 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:35:40.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:40.899 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:35:40.915 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42631sec preferred_lft 42631sec 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:35:40.916 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:35:40.917 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:35:40.917 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:35:40.917 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:35:40.917 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:35:40.917 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:35:40.917 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:35:40.917 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:35:40.917 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:35:40.917 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:35:40.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:40.918 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:35:40.978 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:35:40.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:40.979 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:35:41.036 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:35:41.036 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:35:41.036 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:35:41.036 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:35:41.036 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:35:41.037 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:35:41.037 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:35:41.037 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:35:41.037 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:35:41.037 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:35:41.037 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:35:41.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:35:41.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:41.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:41.163 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:35:41.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:35:41.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:35:41.178 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:35:41.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:41.179 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:35:41.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:35:41.244 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:35:41.299 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:35:41.299 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:35:41.299 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:35:41.355 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:35:41.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:41.355 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:35:41.449 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:35:41.449 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:35:41.449 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:35:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:35:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:35:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:35:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:35:41.460 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:35:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:35:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:35:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:35:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:35:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:35:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:35:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:35:41.467 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:35:41.468 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:35:41.468 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:35:41.468 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:35:41.468 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:35:41.468 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:35:41.469 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:35:41.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:41.470 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:35:41.495 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:35:41.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:35:41.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:41.598 INFO:teuthology.orchestra.run.smithi146.stdout:client5102 2024-09-17T03:35:41.598 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:35:41.599 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:41.614 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-17T03:35:41.614 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-17T03:35:41.614 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-17T03:35:41.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:41.615 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-17T03:35:41.678 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:35:41.678 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:35:41.678 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-09-17T03:35:41.678 DEBUG:teuthology.orchestra.run.smithi146:> import json 2024-09-17T03:35:41.678 DEBUG:teuthology.orchestra.run.smithi146:> import sys 2024-09-17T03:35:41.678 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:35:41.678 DEBUG:teuthology.orchestra.run.smithi146:> try: 2024-09-17T03:35:41.678 DEBUG:teuthology.orchestra.run.smithi146:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-17T03:35:41.678 DEBUG:teuthology.orchestra.run.smithi146:> except OSError as e: 2024-09-17T03:35:41.678 DEBUG:teuthology.orchestra.run.smithi146:> sys.exit(e.errno) 2024-09-17T03:35:41.678 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:35:41.679 DEBUG:teuthology.orchestra.run.smithi146:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-17T03:35:41.679 DEBUG:teuthology.orchestra.run.smithi146:> print(json.dumps( 2024-09-17T03:35:41.679 DEBUG:teuthology.orchestra.run.smithi146:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-17T03:35:41.679 DEBUG:teuthology.orchestra.run.smithi146:> indent=2)) 2024-09-17T03:35:41.679 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:35:41.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:41 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-09-17T03:35:41.794 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T03:35:41.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:41.795 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-09-17T03:35:41.852 INFO:teuthology.orchestra.run.smithi146.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-09-17T03:35:42.004 INFO:teuthology.orchestra.run.smithi146.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-17T03:35:45.183 INFO:teuthology.orchestra.run.smithi146.stderr:Updating files: 45% (641/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 83% (1163/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-17T03:35:45.188 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-09-17T03:35:45.188 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-17T03:35:45.189 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-17T03:35:45.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.346+0000 7f553fa25640 1 -- 172.21.15.146:0/185423169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5524004d40 msgr2=0x7f5524005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.346+0000 7f553fa25640 1 --2- 172.21.15.146:0/185423169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5524004d40 0x7f5524005150 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f553000e3d0 tx=0x7f5524005830 comp rx=0 tx=0).stop 2024-09-17T03:35:45.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.346+0000 7f553dfc2640 1 -- 172.21.15.146:0/185423169 reap_dead start 2024-09-17T03:35:45.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.346+0000 7f553fa25640 1 -- 172.21.15.146:0/185423169 shutdown_connections 2024-09-17T03:35:45.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.346+0000 7f553fa25640 1 -- 172.21.15.146:0/185423169 >> 172.21.15.146:0/185423169 conn(0x7f55380b2060 msgr2=0x7f55380b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.346+0000 7f553fa25640 1 -- 172.21.15.146:0/185423169 shutdown_connections 2024-09-17T03:35:45.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.346+0000 7f553fa25640 1 -- 172.21.15.146:0/185423169 wait complete. 2024-09-17T03:35:45.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.347+0000 7f553fa25640 1 Processor -- start 2024-09-17T03:35:45.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.348+0000 7f553fa25640 1 -- start start 2024-09-17T03:35:45.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553fa25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5524004d40 0x7f55381f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553fa25640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55381444d0 0x7f55381448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553fa25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55380ae890 0x7f55380aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553fa25640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f55380b48b0 con 0x7f55381444d0 2024-09-17T03:35:45.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553fa25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5538070160 con 0x7f55380ae890 2024-09-17T03:35:45.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553fa25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f55380b4a30 con 0x7f5524004d40 2024-09-17T03:35:45.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553cfc0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55381444d0 0x7f55381448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553cfc0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55381444d0 0x7f55381448e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39222/0 (socket says 172.21.15.146:39222) 2024-09-17T03:35:45.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553cfc0640 1 -- 172.21.15.146:0/1715014539 learned_addr learned my addr 172.21.15.146:0/1715014539 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553d7c1640 1 --2- 172.21.15.146:0/1715014539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5524004d40 0x7f55381f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553dfc2640 1 --2- 172.21.15.146:0/1715014539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55380ae890 0x7f55380aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553cfc0640 1 -- 172.21.15.146:0/1715014539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5524004d40 msgr2=0x7f55381f5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553cfc0640 1 --2- 172.21.15.146:0/1715014539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5524004d40 0x7f55381f5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553cfc0640 1 -- 172.21.15.146:0/1715014539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55380ae890 msgr2=0x7f55380aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553cfc0640 1 --2- 172.21.15.146:0/1715014539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55380ae890 0x7f55380aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553cfc0640 1 -- 172.21.15.146:0/1715014539 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55380af1e0 con 0x7f55381444d0 2024-09-17T03:35:45.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553d7c1640 1 --2- 172.21.15.146:0/1715014539 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5524004d40 0x7f55381f5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:45.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553dfc2640 1 --2- 172.21.15.146:0/1715014539 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55380ae890 0x7f55380aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:45.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.349+0000 7f553cfc0640 1 --2- 172.21.15.146:0/1715014539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55381444d0 0x7f55381448e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5528006670 tx=0x7f55280039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.350+0000 7f552dffb640 1 -- 172.21.15.146:0/1715014539 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528015070 con 0x7f55381444d0 2024-09-17T03:35:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.350+0000 7f552dffb640 1 -- 172.21.15.146:0/1715014539 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5528011900 con 0x7f55381444d0 2024-09-17T03:35:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.350+0000 7f553fa25640 1 -- 172.21.15.146:0/1715014539 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55381e6a00 con 0x7f55381444d0 2024-09-17T03:35:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.350+0000 7f552dffb640 1 -- 172.21.15.146:0/1715014539 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528011d30 con 0x7f55381444d0 2024-09-17T03:35:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.350+0000 7f553fa25640 1 -- 172.21.15.146:0/1715014539 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55381f89d0 con 0x7f55381444d0 2024-09-17T03:35:45.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.351+0000 7f552dffb640 1 -- 172.21.15.146:0/1715014539 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f552800f430 con 0x7f55381444d0 2024-09-17T03:35:45.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.352+0000 7f552dffb640 1 --2- 172.21.15.146:0/1715014539 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f551c078b90 0x7f551c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.352+0000 7f552dffb640 1 -- 172.21.15.146:0/1715014539 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f552809bae0 con 0x7f55381444d0 2024-09-17T03:35:45.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.352+0000 7f553d7c1640 1 --2- 172.21.15.146:0/1715014539 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f551c078b90 0x7f551c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.353+0000 7f553d7c1640 1 --2- 172.21.15.146:0/1715014539 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f551c078b90 0x7f551c07b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5534009bd0 tx=0x7f5534005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.353+0000 7f5546a71740 1 Processor -- start 2024-09-17T03:35:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.353+0000 7f5546a71740 1 -- start start 2024-09-17T03:35:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.354+0000 7f5546a71740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7f6530 0x5604fcbe55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.354+0000 7f5546a71740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcbc8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.354+0000 7f5546a71740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7d5850 0x5604fcbc87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.354+0000 7f5546a71740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5604fcb10c40 con 0x5604fc7cd670 2024-09-17T03:35:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.354+0000 7f5546a71740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5604fcb00070 con 0x5604fc7d5850 2024-09-17T03:35:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.354+0000 7f5546a71740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5604fcb03e80 con 0x5604fc7f6530 2024-09-17T03:35:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.354+0000 7f553cfc0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcbc8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.354+0000 7f553cfc0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcbc8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39232/0 (socket says 172.21.15.146:39232) 2024-09-17T03:35:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.354+0000 7f553cfc0640 1 -- 172.21.15.146:0/3935726267 learned_addr learned my addr 172.21.15.146:0/3935726267 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.354+0000 7f553dfc2640 1 --2- 172.21.15.146:0/3935726267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7d5850 0x5604fcbc87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.354+0000 7f553d7c1640 1 --2- 172.21.15.146:0/3935726267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7f6530 0x5604fcbe55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.355+0000 7f553cfc0640 1 -- 172.21.15.146:0/3935726267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7f6530 msgr2=0x5604fcbe55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.355+0000 7f553cfc0640 1 --2- 172.21.15.146:0/3935726267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7f6530 0x5604fcbe55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.355+0000 7f553cfc0640 1 -- 172.21.15.146:0/3935726267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7d5850 msgr2=0x5604fcbc87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.355+0000 7f553cfc0640 1 --2- 172.21.15.146:0/3935726267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7d5850 0x5604fcbc87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.355+0000 7f553cfc0640 1 -- 172.21.15.146:0/3935726267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604fcab98b0 con 0x5604fc7cd670 2024-09-17T03:35:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.355+0000 7f553dfc2640 1 --2- 172.21.15.146:0/3935726267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7d5850 0x5604fcbc87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.355+0000 7f553cfc0640 1 --2- 172.21.15.146:0/3935726267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcbc8290 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5528099fd0 tx=0x7f5528063390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3e7b016d01b295 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.355+0000 7f5522ffd640 1 -- 172.21.15.146:0/3935726267 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528020070 con 0x5604fc7cd670 2024-09-17T03:35:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.355+0000 7f5522ffd640 1 -- 172.21.15.146:0/3935726267 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5528063880 con 0x5604fc7cd670 2024-09-17T03:35:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.355+0000 7f5522ffd640 1 -- 172.21.15.146:0/3935726267 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528064db0 con 0x5604fc7cd670 2024-09-17T03:35:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.356+0000 7f5546a71740 1 -- 172.21.15.146:0/3935726267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 msgr2=0x5604fcbc8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.356+0000 7f5546a71740 1 --2- 172.21.15.146:0/3935726267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcbc8290 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5528099fd0 tx=0x7f5528063390 comp rx=0 tx=0).stop 2024-09-17T03:35:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.356+0000 7f5546a71740 1 -- 172.21.15.146:0/3935726267 shutdown_connections 2024-09-17T03:35:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.356+0000 7f5546a71740 1 --2- 172.21.15.146:0/3935726267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7d5850 0x5604fcbc87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.356+0000 7f5546a71740 1 --2- 172.21.15.146:0/3935726267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcbc8290 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.356+0000 7f5546a71740 1 --2- 172.21.15.146:0/3935726267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7f6530 0x5604fcbe55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.356+0000 7f5546a71740 1 -- 172.21.15.146:0/3935726267 >> 172.21.15.146:0/3935726267 conn(0x5604fc7ea680 msgr2=0x5604fcb9e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.356+0000 7f5546a71740 1 -- 172.21.15.146:0/3935726267 shutdown_connections 2024-09-17T03:35:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.356+0000 7f5546a71740 1 -- 172.21.15.146:0/3935726267 wait complete. 2024-09-17T03:35:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.357+0000 7f5546a71740 1 -- start start 2024-09-17T03:35:45.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.357+0000 7f5546a71740 1 Processor -- start 2024-09-17T03:35:45.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.358+0000 7f5546a71740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7cd670 0x5604fcbc19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.358+0000 7f5546a71740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7d5850 0x5604fcbab000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.358+0000 7f5546a71740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7f6530 0x5604fcbab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.358+0000 7f5546a71740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5604fc8708e0 con 0x5604fc7f6530 2024-09-17T03:35:45.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.358+0000 7f5546a71740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5604fcaa5a50 con 0x5604fc7cd670 2024-09-17T03:35:45.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.358+0000 7f5546a71740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5604fcbc41d0 con 0x5604fc7d5850 2024-09-17T03:35:45.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.358+0000 7f5546a71740 10 client.0 _ll_register_callbacks cb 0x5604fcaf9c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:45.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.358+0000 7f553dfc2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7f6530 0x5604fcbab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.358+0000 7f553dfc2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7f6530 0x5604fcbab540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39240/0 (socket says 172.21.15.146:39240) 2024-09-17T03:35:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.358+0000 7f553dfc2640 1 -- 172.21.15.146:0/749537427 learned_addr learned my addr 172.21.15.146:0/749537427 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.358+0000 7f553d7c1640 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7cd670 0x5604fcbc19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f553cfc0640 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7d5850 0x5604fcbab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f553dfc2640 1 -- 172.21.15.146:0/749537427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7d5850 msgr2=0x5604fcbab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f553dfc2640 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7d5850 0x5604fcbab000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f553dfc2640 1 -- 172.21.15.146:0/749537427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7cd670 msgr2=0x5604fcbc19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f553dfc2640 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7cd670 0x5604fcbc19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f553dfc2640 1 -- 172.21.15.146:0/749537427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604fc7f2590 con 0x5604fc7f6530 2024-09-17T03:35:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f553dfc2640 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7f6530 0x5604fcbab540 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f553000e4f0 tx=0x7f5530000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa0e32ef8c31aae server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f5517fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f5517fff640 1 -- 172.21.15.146:0/749537427 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530009c80 con 0x5604fc7f6530 2024-09-17T03:35:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f5517fff640 1 -- 172.21.15.146:0/749537427 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f553003dd30 con 0x5604fc7f6530 2024-09-17T03:35:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f5546a71740 1 -- 172.21.15.146:0/749537427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604fcb18f40 con 0x5604fc7f6530 2024-09-17T03:35:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f5517fff640 1 -- 172.21.15.146:0/749537427 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5530009200 con 0x5604fc7f6530 2024-09-17T03:35:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f5546a71740 10 client.5583 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f5546a71740 1 -- 172.21.15.146:0/749537427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5604fc861b10 con 0x5604fc7f6530 2024-09-17T03:35:45.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f5517fff640 1 -- 172.21.15.146:0/749537427 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5604fcb18f40 con 0x5604fc7f6530 2024-09-17T03:35:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.359+0000 7f5517fff640 1 -- 172.21.15.146:0/749537427 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f5530044030 con 0x5604fc7f6530 2024-09-17T03:35:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.360+0000 7f5546a71740 10 client.5583 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.360+0000 7f5546a71740 10 client.5583 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.360+0000 7f5546a71740 20 client.5583 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.360+0000 7f5546a71740 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5604fc7b5100 0x5604fcbf6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.360+0000 7f5546a71740 4 client.5583 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.360+0000 7f5546a71740 1 -- 172.21.15.146:0/749537427 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604fcb12b90 con 0x5604fc7b5100 2024-09-17T03:35:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.360+0000 7f553d7c1640 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5604fc7b5100 0x5604fcbf6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.360+0000 7f5517fff640 10 client.5583 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.360+0000 7f553d7c1640 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5604fc7b5100 0x5604fcbf6140 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d27de23d434cd9 server_cookie=9c9208287c65815a in_seq=0 out_seq=0 2024-09-17T03:35:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5517fff640 1 -- 172.21.15.146:0/749537427 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604fcb12b90 con 0x5604fc7b5100 2024-09-17T03:35:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5517fff640 10 client.5583 handle_command_reply: tid=0 2024-09-17T03:35:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 1 client.5583 shutdown 2024-09-17T03:35:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 1 -- 172.21.15.146:0/749537427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7f6530 msgr2=0x5604fcbab540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7f6530 0x5604fcbab540 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f553000e4f0 tx=0x7f5530000f40 comp rx=0 tx=0).stop 2024-09-17T03:35:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 1 -- 172.21.15.146:0/749537427 shutdown_connections 2024-09-17T03:35:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5604fc7b5100 0x5604fcbf6140 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7f6530 0x5604fcbab540 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5517fff640 0 client.5583 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7d5850 0x5604fcbab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 1 --2- 172.21.15.146:0/749537427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7cd670 0x5604fcbc19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 1 -- 172.21.15.146:0/749537427 >> 172.21.15.146:0/749537427 conn(0x5604fc7ea680 msgr2=0x5604fcb97860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 1 -- 172.21.15.146:0/749537427 shutdown_connections 2024-09-17T03:35:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 1 -- 172.21.15.146:0/749537427 wait complete. 2024-09-17T03:35:45.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.361+0000 7f5546a71740 20 client.5583 trim_cache size 0 max 16384 2024-09-17T03:35:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.376+0000 7f5546a71740 1 Processor -- start 2024-09-17T03:35:45.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.376+0000 7f5546a71740 1 -- start start 2024-09-17T03:35:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.377+0000 7f5546a71740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7cd670 0x5604fcb9f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.377+0000 7f5546a71740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7d5850 0x5604fcb9f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.377+0000 7f5546a71740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7f6530 0x5604fcba9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.377+0000 7f5546a71740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f55382025d0 con 0x5604fc7d5850 2024-09-17T03:35:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.377+0000 7f5546a71740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f553806f660 con 0x5604fc7cd670 2024-09-17T03:35:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.377+0000 7f5546a71740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5538159630 con 0x5604fc7f6530 2024-09-17T03:35:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.377+0000 7f553cfc0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7d5850 0x5604fcb9f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.377+0000 7f553cfc0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7d5850 0x5604fcb9f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39248/0 (socket says 172.21.15.146:39248) 2024-09-17T03:35:45.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.377+0000 7f553cfc0640 1 -- 172.21.15.146:0/2104594965 learned_addr learned my addr 172.21.15.146:0/2104594965 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.378+0000 7f553dfc2640 1 --2- 172.21.15.146:0/2104594965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7f6530 0x5604fcba9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.378+0000 7f553d7c1640 1 --2- 172.21.15.146:0/2104594965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7cd670 0x5604fcb9f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.378+0000 7f553cfc0640 1 -- 172.21.15.146:0/2104594965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7f6530 msgr2=0x5604fcba9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.378+0000 7f553cfc0640 1 --2- 172.21.15.146:0/2104594965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7f6530 0x5604fcba9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.378+0000 7f553cfc0640 1 -- 172.21.15.146:0/2104594965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7cd670 msgr2=0x5604fcb9f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.378+0000 7f553cfc0640 1 --2- 172.21.15.146:0/2104594965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7cd670 0x5604fcb9f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.378+0000 7f553cfc0640 1 -- 172.21.15.146:0/2104594965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604fcbdd0d0 con 0x5604fc7d5850 2024-09-17T03:35:45.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.378+0000 7f553cfc0640 1 --2- 172.21.15.146:0/2104594965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7d5850 0x5604fcb9f740 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f552805fe00 tx=0x7f5528099f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5854ddb2f629b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.378+0000 7f55227fc640 1 -- 172.21.15.146:0/2104594965 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528082070 con 0x5604fc7d5850 2024-09-17T03:35:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.378+0000 7f55227fc640 1 -- 172.21.15.146:0/2104594965 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f552806d210 con 0x5604fc7d5850 2024-09-17T03:35:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.378+0000 7f55227fc640 1 -- 172.21.15.146:0/2104594965 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5528020040 con 0x5604fc7d5850 2024-09-17T03:35:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.379+0000 7f5546a71740 1 -- 172.21.15.146:0/2104594965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7d5850 msgr2=0x5604fcb9f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.379+0000 7f5546a71740 1 --2- 172.21.15.146:0/2104594965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7d5850 0x5604fcb9f740 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f552805fe00 tx=0x7f5528099f30 comp rx=0 tx=0).stop 2024-09-17T03:35:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.379+0000 7f5546a71740 1 -- 172.21.15.146:0/2104594965 shutdown_connections 2024-09-17T03:35:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.379+0000 7f5546a71740 1 --2- 172.21.15.146:0/2104594965 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7f6530 0x5604fcba9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.379+0000 7f5546a71740 1 --2- 172.21.15.146:0/2104594965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7d5850 0x5604fcb9f740 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.379+0000 7f5546a71740 1 --2- 172.21.15.146:0/2104594965 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7cd670 0x5604fcb9f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.379+0000 7f5546a71740 1 -- 172.21.15.146:0/2104594965 >> 172.21.15.146:0/2104594965 conn(0x5604fc7ea680 msgr2=0x5604fcbf66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.379+0000 7f5546a71740 1 -- 172.21.15.146:0/2104594965 shutdown_connections 2024-09-17T03:35:45.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.379+0000 7f5546a71740 1 -- 172.21.15.146:0/2104594965 wait complete. 2024-09-17T03:35:45.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.380+0000 7f5546a71740 1 -- start start 2024-09-17T03:35:45.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.380+0000 7f5546a71740 1 Processor -- start 2024-09-17T03:35:45.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.381+0000 7f5546a71740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcc629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.381+0000 7f5546a71740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7d5850 0x5604fcbbf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.381+0000 7f5546a71740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7f6530 0x5604fcbbf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.381+0000 7f5546a71740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f553806f010 con 0x5604fc7cd670 2024-09-17T03:35:45.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.381+0000 7f5546a71740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5604fcb9a0a0 con 0x5604fc7f6530 2024-09-17T03:35:45.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.381+0000 7f5546a71740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5604fcb9fc10 con 0x5604fc7d5850 2024-09-17T03:35:45.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.381+0000 7f5546a71740 10 client.0 _ll_register_callbacks cb 0x7f55240036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:45.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.381+0000 7f553d7c1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcc629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.381+0000 7f553d7c1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcc629b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39258/0 (socket says 172.21.15.146:39258) 2024-09-17T03:35:45.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.381+0000 7f553d7c1640 1 -- 172.21.15.146:0/231196024 learned_addr learned my addr 172.21.15.146:0/231196024 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f553cfc0640 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7d5850 0x5604fcbbf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f553dfc2640 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7f6530 0x5604fcbbf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f553d7c1640 1 -- 172.21.15.146:0/231196024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7d5850 msgr2=0x5604fcbbf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f553d7c1640 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7d5850 0x5604fcbbf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f553d7c1640 1 -- 172.21.15.146:0/231196024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7f6530 msgr2=0x5604fcbbf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f553d7c1640 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7f6530 0x5604fcbbf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f553d7c1640 1 -- 172.21.15.146:0/231196024 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604fc8d8970 con 0x5604fc7cd670 2024-09-17T03:35:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f553cfc0640 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7d5850 0x5604fcbbf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f553d7c1640 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcc629b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x5604fcbabc60 tx=0x7f55340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55a5e718a771eb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f5517fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f5517fff640 1 -- 172.21.15.146:0/231196024 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55340038f0 con 0x5604fc7cd670 2024-09-17T03:35:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f5517fff640 1 -- 172.21.15.146:0/231196024 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f5534034b20 con 0x5604fc7cd670 2024-09-17T03:35:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f5546a71740 1 -- 172.21.15.146:0/231196024 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f552806d210 con 0x5604fc7cd670 2024-09-17T03:35:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f5517fff640 1 -- 172.21.15.146:0/231196024 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5534034d20 con 0x5604fc7cd670 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f5546a71740 10 client.5589 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f5546a71740 1 -- 172.21.15.146:0/231196024 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5604fcc07660 con 0x5604fc7cd670 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f5517fff640 1 -- 172.21.15.146:0/231196024 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f552806d210 con 0x5604fc7cd670 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f5517fff640 1 -- 172.21.15.146:0/231196024 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f553403b050 con 0x5604fc7cd670 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f5546a71740 10 client.5589 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.382+0000 7f5546a71740 10 client.5589 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.383+0000 7f5546a71740 20 client.5589 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.383+0000 7f5546a71740 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5604fcbbec30 0x5604fcc06810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.383+0000 7f5546a71740 4 client.5589 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.383+0000 7f5546a71740 1 -- 172.21.15.146:0/231196024 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x5604fcb0e640 con 0x5604fcbbec30 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.383+0000 7f553cfc0640 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5604fcbbec30 0x5604fcc06810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.383+0000 7f5517fff640 10 client.5589 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.383+0000 7f553cfc0640 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5604fcbbec30 0x5604fcc06810 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ed922a2077d8bc5 server_cookie=a308af9e12635218 in_seq=0 out_seq=0 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5517fff640 1 -- 172.21.15.146:0/231196024 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x5604fcb0e640 con 0x5604fcbbec30 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5517fff640 10 client.5589 handle_command_reply: tid=0 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 1 client.5589 shutdown 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 1 -- 172.21.15.146:0/231196024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 msgr2=0x5604fcc629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcc629b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x5604fcbabc60 tx=0x7f55340046c0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 1 -- 172.21.15.146:0/231196024 shutdown_connections 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5604fcbbec30 0x5604fcc06810 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fc7f6530 0x5604fcbbf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fc7d5850 0x5604fcbbf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5517fff640 0 client.5589 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 1 --2- 172.21.15.146:0/231196024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fc7cd670 0x5604fcc629b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 1 -- 172.21.15.146:0/231196024 >> 172.21.15.146:0/231196024 conn(0x5604fc7ea680 msgr2=0x5604fcb9f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 1 -- 172.21.15.146:0/231196024 shutdown_connections 2024-09-17T03:35:45.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 1 -- 172.21.15.146:0/231196024 wait complete. 2024-09-17T03:35:45.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.384+0000 7f5546a71740 20 client.5589 trim_cache size 0 max 16384 2024-09-17T03:35:45.391 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:45.391 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:35:45.391 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": -2 2024-09-17T03:35:45.391 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:45.392 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T03:35:45.392 INFO:teuthology.orchestra.run.smithi146.stderr:Error ENOENT: 2024-09-17T03:35:45.393 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-17T03:35:45.393 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-17T03:35:45.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-17T03:35:45.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.510+0000 7f9510319640 1 -- 172.21.15.146:0/2212657882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95080b3360 msgr2=0x7f9508072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.510+0000 7f9510319640 1 --2- 172.21.15.146:0/2212657882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95080b3360 0x7f9508072df0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009830 tx=0x7f94fc02a510 comp rx=0 tx=0).stop 2024-09-17T03:35:45.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.510+0000 7f9510319640 1 -- 172.21.15.146:0/2212657882 shutdown_connections 2024-09-17T03:35:45.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.510+0000 7f9510319640 1 --2- 172.21.15.146:0/2212657882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f950815f1e0 0x7f95081515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.510+0000 7f9510319640 1 --2- 172.21.15.146:0/2212657882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95080b3360 0x7f9508072df0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.510+0000 7f9510319640 1 -- 172.21.15.146:0/2212657882 >> 172.21.15.146:0/2212657882 conn(0x7f95080b2060 msgr2=0x7f95080b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.510+0000 7f9510319640 1 -- 172.21.15.146:0/2212657882 shutdown_connections 2024-09-17T03:35:45.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.510+0000 7f9510319640 1 -- 172.21.15.146:0/2212657882 wait complete. 2024-09-17T03:35:45.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.512+0000 7f9510319640 1 Processor -- start 2024-09-17T03:35:45.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.512+0000 7f9510319640 1 -- start start 2024-09-17T03:35:45.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f9510319640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95080b3360 0x7f950813bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f9510319640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95080cfc40 0x7f950813d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f9510319640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f950814f710 0x7f950813b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f9510319640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f950806ea50 con 0x7f95080cfc40 2024-09-17T03:35:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f9510319640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f950806e8d0 con 0x7f950814f710 2024-09-17T03:35:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f9510319640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9508151ae0 con 0x7f95080b3360 2024-09-17T03:35:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950d8b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95080cfc40 0x7f950813d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950d8b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95080cfc40 0x7f950813d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39266/0 (socket says 172.21.15.146:39266) 2024-09-17T03:35:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950d8b4640 1 -- 172.21.15.146:0/3846459398 learned_addr learned my addr 172.21.15.146:0/3846459398 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950e8b6640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f950814f710 0x7f950813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950e0b5640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95080b3360 0x7f950813bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950d8b4640 1 -- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95080b3360 msgr2=0x7f950813bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950d8b4640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95080b3360 0x7f950813bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950d8b4640 1 -- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f950814f710 msgr2=0x7f950813b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950d8b4640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f950814f710 0x7f950813b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950d8b4640 1 -- 172.21.15.146:0/3846459398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950813c8e0 con 0x7f95080cfc40 2024-09-17T03:35:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950e8b6640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f950814f710 0x7f950813b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.513+0000 7f950e0b5640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95080b3360 0x7f950813bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.514+0000 7f950d8b4640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95080cfc40 0x7f950813d980 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f950400c440 tx=0x7f950400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.514+0000 7f94faffd640 1 -- 172.21.15.146:0/3846459398 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504017070 con 0x7f95080cfc40 2024-09-17T03:35:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.514+0000 7f94faffd640 1 -- 172.21.15.146:0/3846459398 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95040035f0 con 0x7f95080cfc40 2024-09-17T03:35:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.514+0000 7f9510319640 1 -- 172.21.15.146:0/3846459398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950813cbc0 con 0x7f95080cfc40 2024-09-17T03:35:45.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.514+0000 7f94faffd640 1 -- 172.21.15.146:0/3846459398 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504003a40 con 0x7f95080cfc40 2024-09-17T03:35:45.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.514+0000 7f9510319640 1 -- 172.21.15.146:0/3846459398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950813d180 con 0x7f95080cfc40 2024-09-17T03:35:45.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.515+0000 7f94faffd640 1 -- 172.21.15.146:0/3846459398 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f950401a070 con 0x7f95080cfc40 2024-09-17T03:35:45.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.516+0000 7f94faffd640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94ec078b90 0x7f94ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.516+0000 7f94faffd640 1 -- 172.21.15.146:0/3846459398 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9504099ed0 con 0x7f95080cfc40 2024-09-17T03:35:45.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.516+0000 7f950e0b5640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94ec078b90 0x7f94ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.517+0000 7f950e0b5640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94ec078b90 0x7f94ec07b0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f94fc034000 tx=0x7f94fc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.517+0000 7f9517287740 1 Processor -- start 2024-09-17T03:35:45.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.517+0000 7f9517287740 1 -- start start 2024-09-17T03:35:45.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f9517287740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8ebc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f9517287740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ebce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f9517287740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8aca8a0 0x55bde8ed9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f9517287740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bde8e05cc0 con 0x55bde8ac26c0 2024-09-17T03:35:45.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f9517287740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55bde8df50f0 con 0x55bde8aca8a0 2024-09-17T03:35:45.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f9517287740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55bde8df8f00 con 0x55bde8aeb580 2024-09-17T03:35:45.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950d8b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ebce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950d8b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ebce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39272/0 (socket says 172.21.15.146:39272) 2024-09-17T03:35:45.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950d8b4640 1 -- 172.21.15.146:0/3033376669 learned_addr learned my addr 172.21.15.146:0/3033376669 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950e0b5640 1 --2- 172.21.15.146:0/3033376669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8ebc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950e8b6640 1 --2- 172.21.15.146:0/3033376669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8aca8a0 0x55bde8ed9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950d8b4640 1 -- 172.21.15.146:0/3033376669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 msgr2=0x55bde8ebc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950d8b4640 1 --2- 172.21.15.146:0/3033376669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8ebc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950d8b4640 1 -- 172.21.15.146:0/3033376669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8aca8a0 msgr2=0x55bde8ed9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950d8b4640 1 --2- 172.21.15.146:0/3033376669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8aca8a0 0x55bde8ed9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950d8b4640 1 -- 172.21.15.146:0/3033376669 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde8bcf9f0 con 0x55bde8ac26c0 2024-09-17T03:35:45.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950e0b5640 1 --2- 172.21.15.146:0/3033376669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8ebc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:45.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f950d8b4640 1 --2- 172.21.15.146:0/3033376669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ebce50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9504061960 tx=0x7f9504061830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75e40b7bc5fa678 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f94ebfff640 1 -- 172.21.15.146:0/3033376669 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504066740 con 0x55bde8ac26c0 2024-09-17T03:35:45.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f94ebfff640 1 -- 172.21.15.146:0/3033376669 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f950406b5f0 con 0x55bde8ac26c0 2024-09-17T03:35:45.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.519+0000 7f94ebfff640 1 -- 172.21.15.146:0/3033376669 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950406b360 con 0x55bde8ac26c0 2024-09-17T03:35:45.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.520+0000 7f9517287740 1 -- 172.21.15.146:0/3033376669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 msgr2=0x55bde8ebce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.520+0000 7f9517287740 1 --2- 172.21.15.146:0/3033376669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ebce50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9504061960 tx=0x7f9504061830 comp rx=0 tx=0).stop 2024-09-17T03:35:45.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.520+0000 7f9517287740 1 -- 172.21.15.146:0/3033376669 shutdown_connections 2024-09-17T03:35:45.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.520+0000 7f9517287740 1 --2- 172.21.15.146:0/3033376669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8aca8a0 0x55bde8ed9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.520+0000 7f9517287740 1 --2- 172.21.15.146:0/3033376669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ebce50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.520+0000 7f9517287740 1 --2- 172.21.15.146:0/3033376669 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8ebc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.520+0000 7f9517287740 1 -- 172.21.15.146:0/3033376669 >> 172.21.15.146:0/3033376669 conn(0x55bde8adf6d0 msgr2=0x55bde8e92bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.520+0000 7f9517287740 1 -- 172.21.15.146:0/3033376669 shutdown_connections 2024-09-17T03:35:45.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.520+0000 7f9517287740 1 -- 172.21.15.146:0/3033376669 wait complete. 2024-09-17T03:35:45.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.521+0000 7f9517287740 1 -- start start 2024-09-17T03:35:45.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.521+0000 7f9517287740 1 Processor -- start 2024-09-17T03:35:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f9517287740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8ac26c0 0x55bde8ed7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f9517287740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ea91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f9517287740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8ed09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f9517287740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bde8b65930 con 0x55bde8aca8a0 2024-09-17T03:35:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f9517287740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55bde8d7b720 con 0x55bde8ac26c0 2024-09-17T03:35:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f9517287740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55bde8ebd390 con 0x55bde8aeb580 2024-09-17T03:35:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f9517287740 10 client.0 _ll_register_callbacks cb 0x55bde8d79490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:45.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f950d8b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ea91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f950d8b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ea91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39282/0 (socket says 172.21.15.146:39282) 2024-09-17T03:35:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f950d8b4640 1 -- 172.21.15.146:0/2114330424 learned_addr learned my addr 172.21.15.146:0/2114330424 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f950e8b6640 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8ed09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f950e0b5640 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8ac26c0 0x55bde8ed7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f950d8b4640 1 -- 172.21.15.146:0/2114330424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 msgr2=0x55bde8ed09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f950d8b4640 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8ed09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f950d8b4640 1 -- 172.21.15.146:0/2114330424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8ac26c0 msgr2=0x55bde8ed7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f950d8b4640 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8ac26c0 0x55bde8ed7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f950d8b4640 1 -- 172.21.15.146:0/2114330424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bde8b34890 con 0x55bde8aca8a0 2024-09-17T03:35:45.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f950d8b4640 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ea91f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f950405dc70 tx=0x7f95040610f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a830ffa330fd07d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.523+0000 7f94e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f94e97fa640 1 -- 172.21.15.146:0/2114330424 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504066740 con 0x55bde8aca8a0 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f94e97fa640 1 -- 172.21.15.146:0/2114330424 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f950405d7c0 con 0x55bde8aca8a0 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f9517287740 1 -- 172.21.15.146:0/2114330424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f950406b5f0 con 0x55bde8aca8a0 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f94e97fa640 1 -- 172.21.15.146:0/2114330424 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9504060930 con 0x55bde8aca8a0 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f9517287740 10 client.5601 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f9517287740 1 -- 172.21.15.146:0/2114330424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55bde8c30180 con 0x55bde8aca8a0 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f94e97fa640 1 -- 172.21.15.146:0/2114330424 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f950406b5f0 con 0x55bde8aca8a0 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f94e97fa640 1 -- 172.21.15.146:0/2114330424 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f9504060ad0 con 0x55bde8aca8a0 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f9517287740 10 client.5601 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f9517287740 10 client.5601 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f9517287740 20 client.5601 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f9517287740 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bde8aaa150 0x55bde8ece6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f9517287740 4 client.5601 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f9517287740 1 -- 172.21.15.146:0/2114330424 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bde8e07c10 con 0x55bde8aaa150 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.524+0000 7f950e0b5640 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bde8aaa150 0x55bde8ece6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.525+0000 7f94e97fa640 10 client.5601 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.525+0000 7f950e0b5640 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bde8aaa150 0x55bde8ece6b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18d23490bda9c007 server_cookie=7cd3ee9e885fdd9a in_seq=0 out_seq=0 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.525+0000 7f94e97fa640 1 -- 172.21.15.146:0/2114330424 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bde8e07c10 con 0x55bde8aaa150 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.525+0000 7f94e97fa640 10 client.5601 handle_command_reply: tid=0 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.525+0000 7f9517287740 1 client.5601 shutdown 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f9517287740 1 -- 172.21.15.146:0/2114330424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 msgr2=0x55bde8ea91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f9517287740 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ea91f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f950405dc70 tx=0x7f95040610f0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f9517287740 1 -- 172.21.15.146:0/2114330424 shutdown_connections 2024-09-17T03:35:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f9517287740 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bde8aaa150 0x55bde8ece6b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f9517287740 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8ed09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f94e97fa640 0 client.5601 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f9517287740 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ea91f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f9517287740 1 --2- 172.21.15.146:0/2114330424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8ac26c0 0x55bde8ed7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f9517287740 1 -- 172.21.15.146:0/2114330424 >> 172.21.15.146:0/2114330424 conn(0x55bde8adf6d0 msgr2=0x55bde8e8d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f9517287740 1 -- 172.21.15.146:0/2114330424 shutdown_connections 2024-09-17T03:35:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f9517287740 1 -- 172.21.15.146:0/2114330424 wait complete. 2024-09-17T03:35:45.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.526+0000 7f9517287740 20 client.5601 trim_cache size 0 max 16384 2024-09-17T03:35:45.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.543+0000 7f9517287740 1 Processor -- start 2024-09-17T03:35:45.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.544+0000 7f9517287740 1 -- start start 2024-09-17T03:35:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f9517287740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ea3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f9517287740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8aca8a0 0x55bde8e8bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f9517287740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8e8c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f9517287740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9508200080 con 0x55bde8ac26c0 2024-09-17T03:35:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f9517287740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f95081ff0a0 con 0x55bde8aca8a0 2024-09-17T03:35:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f9517287740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f950813ec90 con 0x55bde8aeb580 2024-09-17T03:35:45.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f950e0b5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ea3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f950e0b5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ea3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39292/0 (socket says 172.21.15.146:39292) 2024-09-17T03:35:45.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f950e0b5640 1 -- 172.21.15.146:0/4265901645 learned_addr learned my addr 172.21.15.146:0/4265901645 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f950e0b5640 1 -- 172.21.15.146:0/4265901645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 msgr2=0x55bde8e8c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f950e0b5640 1 --2- 172.21.15.146:0/4265901645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8e8c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f950e0b5640 1 -- 172.21.15.146:0/4265901645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8aca8a0 msgr2=0x55bde8e8bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f950e0b5640 1 --2- 172.21.15.146:0/4265901645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8aca8a0 0x55bde8e8bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f950e0b5640 1 -- 172.21.15.146:0/4265901645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bde8bcdcf0 con 0x55bde8ac26c0 2024-09-17T03:35:45.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f950e0b5640 1 --2- 172.21.15.146:0/4265901645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ea3d80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009950 tx=0x7f94fc03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd5486eb7b9da85 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.545+0000 7f94eb7fe640 1 -- 172.21.15.146:0/4265901645 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc04a430 con 0x55bde8ac26c0 2024-09-17T03:35:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.546+0000 7f94eb7fe640 1 -- 172.21.15.146:0/4265901645 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94fc056030 con 0x55bde8ac26c0 2024-09-17T03:35:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.546+0000 7f94eb7fe640 1 -- 172.21.15.146:0/4265901645 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc04a8e0 con 0x55bde8ac26c0 2024-09-17T03:35:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.546+0000 7f9517287740 1 -- 172.21.15.146:0/4265901645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 msgr2=0x55bde8ea3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.546+0000 7f9517287740 1 --2- 172.21.15.146:0/4265901645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ea3d80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009950 tx=0x7f94fc03d000 comp rx=0 tx=0).stop 2024-09-17T03:35:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.546+0000 7f9517287740 1 -- 172.21.15.146:0/4265901645 shutdown_connections 2024-09-17T03:35:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.546+0000 7f9517287740 1 --2- 172.21.15.146:0/4265901645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8e8c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.546+0000 7f9517287740 1 --2- 172.21.15.146:0/4265901645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8aca8a0 0x55bde8e8bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.546+0000 7f9517287740 1 --2- 172.21.15.146:0/4265901645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8ac26c0 0x55bde8ea3d80 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.546+0000 7f9517287740 1 -- 172.21.15.146:0/4265901645 >> 172.21.15.146:0/4265901645 conn(0x55bde8adf6d0 msgr2=0x55bde8eaa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.546+0000 7f9517287740 1 -- 172.21.15.146:0/4265901645 shutdown_connections 2024-09-17T03:35:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.546+0000 7f9517287740 1 -- 172.21.15.146:0/4265901645 wait complete. 2024-09-17T03:35:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.547+0000 7f9517287740 1 -- start start 2024-09-17T03:35:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.547+0000 7f9517287740 1 Processor -- start 2024-09-17T03:35:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f9517287740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8ac26c0 0x55bde8f5f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f9517287740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ef9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f9517287740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8e8bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f9517287740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bde8edab00 con 0x55bde8aca8a0 2024-09-17T03:35:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f9517287740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f95081fea50 con 0x55bde8ac26c0 2024-09-17T03:35:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f9517287740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55bde8ed7700 con 0x55bde8aeb580 2024-09-17T03:35:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f9517287740 10 client.0 _ll_register_callbacks cb 0x7f9504066070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f950d8b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ef9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f950d8b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ef9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39304/0 (socket says 172.21.15.146:39304) 2024-09-17T03:35:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f950d8b4640 1 -- 172.21.15.146:0/3459357166 learned_addr learned my addr 172.21.15.146:0/3459357166 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f950d8b4640 1 -- 172.21.15.146:0/3459357166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 msgr2=0x55bde8e8bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f950d8b4640 1 --2- 172.21.15.146:0/3459357166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8e8bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f950d8b4640 1 -- 172.21.15.146:0/3459357166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8ac26c0 msgr2=0x55bde8f5f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f950d8b4640 1 --2- 172.21.15.146:0/3459357166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8ac26c0 0x55bde8f5f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f950d8b4640 1 -- 172.21.15.146:0/3459357166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bde8ef0fb0 con 0x55bde8aca8a0 2024-09-17T03:35:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f950d8b4640 1 --2- 172.21.15.146:0/3459357166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ef9fb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9504061ba0 tx=0x7f9504007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b9aa2873bf385a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f94e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f94e97fa640 1 -- 172.21.15.146:0/3459357166 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950406b5f0 con 0x55bde8aca8a0 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f94e97fa640 1 -- 172.21.15.146:0/3459357166 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9504066350 con 0x55bde8aca8a0 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.549+0000 7f9517287740 1 -- 172.21.15.146:0/3459357166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94fc056030 con 0x55bde8aca8a0 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f94e97fa640 1 -- 172.21.15.146:0/3459357166 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f950407e030 con 0x55bde8aca8a0 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f9517287740 10 client.5607 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f9517287740 1 -- 172.21.15.146:0/3459357166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55bde8ef0fb0 con 0x55bde8aca8a0 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f94e97fa640 1 -- 172.21.15.146:0/3459357166 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94fc056030 con 0x55bde8aca8a0 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f94e97fa640 1 -- 172.21.15.146:0/3459357166 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f950406ab30 con 0x55bde8aca8a0 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f9517287740 10 client.5607 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f9517287740 10 client.5607 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f9517287740 20 client.5607 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f9517287740 1 --2- 172.21.15.146:0/3459357166 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bde8efa4f0 0x55bde8e8c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f9517287740 4 client.5607 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f9517287740 1 -- 172.21.15.146:0/3459357166 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55bde8e036c0 con 0x55bde8efa4f0 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f950e0b5640 1 --2- 172.21.15.146:0/3459357166 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bde8efa4f0 0x55bde8e8c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.550+0000 7f94e97fa640 10 client.5607 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f950e0b5640 1 --2- 172.21.15.146:0/3459357166 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bde8efa4f0 0x55bde8e8c500 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f38b743442ca40a1 server_cookie=876284fd8c8a8031 in_seq=0 out_seq=0 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f94e97fa640 1 -- 172.21.15.146:0/3459357166 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x55bde8e036c0 con 0x55bde8efa4f0 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f94e97fa640 10 client.5607 handle_command_reply: tid=0 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 1 client.5607 shutdown 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 1 -- 172.21.15.146:0/3459357166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 msgr2=0x55bde8ef9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 1 --2- 172.21.15.146:0/3459357166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ef9fb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9504061ba0 tx=0x7f9504007e20 comp rx=0 tx=0).stop 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 1 -- 172.21.15.146:0/3459357166 shutdown_connections 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 1 --2- 172.21.15.146:0/3459357166 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bde8efa4f0 0x55bde8e8c500 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 1 --2- 172.21.15.146:0/3459357166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bde8aeb580 0x55bde8e8bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f94e97fa640 0 client.5607 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 1 --2- 172.21.15.146:0/3459357166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bde8aca8a0 0x55bde8ef9fb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 1 --2- 172.21.15.146:0/3459357166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bde8ac26c0 0x55bde8f5f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 1 -- 172.21.15.146:0/3459357166 >> 172.21.15.146:0/3459357166 conn(0x55bde8adf6d0 msgr2=0x55bde8e886e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 1 -- 172.21.15.146:0/3459357166 shutdown_connections 2024-09-17T03:35:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 1 -- 172.21.15.146:0/3459357166 wait complete. 2024-09-17T03:35:45.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.551+0000 7f9517287740 20 client.5607 trim_cache size 0 max 16384 2024-09-17T03:35:45.558 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:45.558 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": -2 2024-09-17T03:35:45.559 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:45.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 -- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94ec078b90 msgr2=0x7f94ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94ec078b90 0x7f94ec07b0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f94fc034000 tx=0x7f94fc004730 comp rx=0 tx=0).stop 2024-09-17T03:35:45.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 -- 172.21.15.146:0/3846459398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95080cfc40 msgr2=0x7f950813d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95080cfc40 0x7f950813d980 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f950400c440 tx=0x7f950400c900 comp rx=0 tx=0).stop 2024-09-17T03:35:45.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 -- 172.21.15.146:0/3846459398 shutdown_connections 2024-09-17T03:35:45.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94ec078b90 0x7f94ec07b0a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f950814f710 0x7f950813b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95080cfc40 0x7f950813d980 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 --2- 172.21.15.146:0/3846459398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f95080b3360 0x7f950813bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 -- 172.21.15.146:0/3846459398 >> 172.21.15.146:0/3846459398 conn(0x7f95080b2060 msgr2=0x7f95080b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 -- 172.21.15.146:0/3846459398 shutdown_connections 2024-09-17T03:35:45.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.552+0000 7f9510319640 1 -- 172.21.15.146:0/3846459398 wait complete. 2024-09-17T03:35:45.562 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-17T03:35:45.563 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-09-17T03:35:45.564 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-09-17T03:35:45.564 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites 2024-09-17T03:35:45.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.681+0000 7fe584be4640 1 -- 172.21.15.146:0/2595029739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe568003a30 msgr2=0x7fe568003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.681+0000 7fe584be4640 1 --2- 172.21.15.146:0/2595029739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe568003a30 0x7fe568003ea0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe570001dc0 tx=0x7fe568005830 comp rx=0 tx=0).stop 2024-09-17T03:35:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.681+0000 7fe57ed9d640 1 -- 172.21.15.146:0/2595029739 reap_dead start 2024-09-17T03:35:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.681+0000 7fe584be4640 1 -- 172.21.15.146:0/2595029739 shutdown_connections 2024-09-17T03:35:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.681+0000 7fe584be4640 1 -- 172.21.15.146:0/2595029739 >> 172.21.15.146:0/2595029739 conn(0x7fe58009ba20 msgr2=0x7fe5800b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.681+0000 7fe584be4640 1 -- 172.21.15.146:0/2595029739 shutdown_connections 2024-09-17T03:35:45.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.681+0000 7fe584be4640 1 -- 172.21.15.146:0/2595029739 wait complete. 2024-09-17T03:35:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.683+0000 7fe584be4640 1 Processor -- start 2024-09-17T03:35:45.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.683+0000 7fe584be4640 1 -- start start 2024-09-17T03:35:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.684+0000 7fe584be4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe568003a30 0x7fe5801e5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.684+0000 7fe584be4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe580070950 0x7fe5800cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.684+0000 7fe584be4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe580070d60 0x7fe5800cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.684+0000 7fe584be4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe5800b2f30 con 0x7fe568003a30 2024-09-17T03:35:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.684+0000 7fe584be4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe5800b80a0 con 0x7fe580070950 2024-09-17T03:35:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.684+0000 7fe584be4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe5800cd090 con 0x7fe580070d60 2024-09-17T03:35:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.684+0000 7fe57e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe568003a30 0x7fe5801e5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.684+0000 7fe57e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe568003a30 0x7fe5801e5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39332/0 (socket says 172.21.15.146:39332) 2024-09-17T03:35:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.684+0000 7fe57e59c640 1 -- 172.21.15.146:0/3240887945 learned_addr learned my addr 172.21.15.146:0/3240887945 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe57ed9d640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe580070d60 0x7fe5800cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe580070950 0x7fe5800cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe57e59c640 1 -- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe580070d60 msgr2=0x7fe5800cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe57e59c640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe580070d60 0x7fe5800cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe57e59c640 1 -- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe580070950 msgr2=0x7fe5800cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe57e59c640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe580070950 0x7fe5800cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe57e59c640 1 -- 172.21.15.146:0/3240887945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5800af390 con 0x7fe568003a30 2024-09-17T03:35:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe57e59c640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe568003a30 0x7fe5801e5ef0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe57002acc0 tx=0x7fe570006db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe56effd640 1 -- 172.21.15.146:0/3240887945 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570006250 con 0x7fe568003a30 2024-09-17T03:35:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe56effd640 1 -- 172.21.15.146:0/3240887945 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5700064e0 con 0x7fe568003a30 2024-09-17T03:35:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe584be4640 1 -- 172.21.15.146:0/3240887945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5800af630 con 0x7fe568003a30 2024-09-17T03:35:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe56effd640 1 -- 172.21.15.146:0/3240887945 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5700068b0 con 0x7fe568003a30 2024-09-17T03:35:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.685+0000 7fe584be4640 1 -- 172.21.15.146:0/3240887945 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5800afbf0 con 0x7fe568003a30 2024-09-17T03:35:45.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.687+0000 7fe56effd640 1 -- 172.21.15.146:0/3240887945 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe570033480 con 0x7fe568003a30 2024-09-17T03:35:45.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.687+0000 7fe56effd640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe560078d60 0x7fe56007b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.688+0000 7fe56effd640 1 -- 172.21.15.146:0/3240887945 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe5700bb3e0 con 0x7fe568003a30 2024-09-17T03:35:45.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.688+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe560078d60 0x7fe56007b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.688+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe560078d60 0x7fe56007b270 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5800c9150 tx=0x7fe574005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.689+0000 7fe58bc32740 1 Processor -- start 2024-09-17T03:35:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.689+0000 7fe58bc32740 1 -- start start 2024-09-17T03:35:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96585650 0x55bc96946240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc9655c790 0x55bc96971dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc96564970 0x55bc96952e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe58bc32740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bc9689fbf0 con 0x55bc9655c790 2024-09-17T03:35:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe58bc32740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55bc9688f020 con 0x55bc96585650 2024-09-17T03:35:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe58bc32740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55bc96892e30 con 0x55bc96564970 2024-09-17T03:35:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe57dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc9655c790 0x55bc96971dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe57dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc9655c790 0x55bc96971dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39334/0 (socket says 172.21.15.146:39334) 2024-09-17T03:35:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe57dd9b640 1 -- 172.21.15.146:0/1018997731 learned_addr learned my addr 172.21.15.146:0/1018997731 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe57e59c640 1 --2- 172.21.15.146:0/1018997731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96585650 0x55bc96946240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe57ed9d640 1 --2- 172.21.15.146:0/1018997731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc96564970 0x55bc96952e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe57dd9b640 1 -- 172.21.15.146:0/1018997731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc96564970 msgr2=0x55bc96952e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/1018997731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc96564970 0x55bc96952e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe57dd9b640 1 -- 172.21.15.146:0/1018997731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96585650 msgr2=0x55bc96946240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/1018997731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96585650 0x55bc96946240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.690+0000 7fe57dd9b640 1 -- 172.21.15.146:0/1018997731 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc968f3680 con 0x55bc9655c790 2024-09-17T03:35:45.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.691+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/1018997731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc9655c790 0x55bc96971dd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe574012f80 tx=0x7fe574017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8391435d5d786261 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.691+0000 7fe55ffff640 1 -- 172.21.15.146:0/1018997731 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574003b70 con 0x55bc9655c790 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.691+0000 7fe55ffff640 1 -- 172.21.15.146:0/1018997731 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe574003d10 con 0x55bc9655c790 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.691+0000 7fe55ffff640 1 -- 172.21.15.146:0/1018997731 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5740296a0 con 0x55bc9655c790 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.692+0000 7fe58bc32740 1 -- 172.21.15.146:0/1018997731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc9655c790 msgr2=0x55bc96971dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.692+0000 7fe58bc32740 1 --2- 172.21.15.146:0/1018997731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc9655c790 0x55bc96971dd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe574012f80 tx=0x7fe574017000 comp rx=0 tx=0).stop 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.692+0000 7fe58bc32740 1 -- 172.21.15.146:0/1018997731 shutdown_connections 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.692+0000 7fe58bc32740 1 --2- 172.21.15.146:0/1018997731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc96564970 0x55bc96952e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.692+0000 7fe58bc32740 1 --2- 172.21.15.146:0/1018997731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc9655c790 0x55bc96971dd0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.692+0000 7fe58bc32740 1 --2- 172.21.15.146:0/1018997731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96585650 0x55bc96946240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.692+0000 7fe58bc32740 1 -- 172.21.15.146:0/1018997731 >> 172.21.15.146:0/1018997731 conn(0x55bc965797a0 msgr2=0x55bc9692c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.692+0000 7fe58bc32740 1 -- 172.21.15.146:0/1018997731 shutdown_connections 2024-09-17T03:35:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.692+0000 7fe58bc32740 1 -- 172.21.15.146:0/1018997731 wait complete. 2024-09-17T03:35:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.693+0000 7fe58bc32740 1 -- start start 2024-09-17T03:35:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.693+0000 7fe58bc32740 1 Processor -- start 2024-09-17T03:35:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc9655c790 0x55bc96956630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96564970 0x55bc9696d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96585650 0x55bc96944580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe58bc32740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bc965ffa00 con 0x55bc96585650 2024-09-17T03:35:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe58bc32740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55bc968347f0 con 0x55bc96564970 2024-09-17T03:35:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe58bc32740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55bc969454e0 con 0x55bc9655c790 2024-09-17T03:35:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe58bc32740 10 client.0 _ll_register_callbacks cb 0x55bc96837700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe57ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96585650 0x55bc96944580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe57ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96585650 0x55bc96944580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39340/0 (socket says 172.21.15.146:39340) 2024-09-17T03:35:45.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe57ed9d640 1 -- 172.21.15.146:0/2774998943 learned_addr learned my addr 172.21.15.146:0/2774998943 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe57e59c640 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc9655c790 0x55bc96956630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.694+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96564970 0x55bc9696d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe57ed9d640 1 -- 172.21.15.146:0/2774998943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc9655c790 msgr2=0x55bc96956630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe57ed9d640 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc9655c790 0x55bc96956630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe57ed9d640 1 -- 172.21.15.146:0/2774998943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96564970 msgr2=0x55bc9696d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe57ed9d640 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96564970 0x55bc9696d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe57ed9d640 1 -- 172.21.15.146:0/2774998943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc965f0c30 con 0x55bc96585650 2024-09-17T03:35:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe57ed9d640 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96585650 0x55bc96944580 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe5800d20f0 tx=0x7fe5780064e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac8f6d85469ea46 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe55d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe55d7fa640 1 -- 172.21.15.146:0/2774998943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578012850 con 0x55bc96585650 2024-09-17T03:35:45.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe55d7fa640 1 -- 172.21.15.146:0/2774998943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe5780129f0 con 0x55bc96585650 2024-09-17T03:35:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe58bc32740 1 -- 172.21.15.146:0/2774998943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe574003d10 con 0x55bc96585650 2024-09-17T03:35:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe55d7fa640 1 -- 172.21.15.146:0/2774998943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe578021050 con 0x55bc96585650 2024-09-17T03:35:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe58bc32740 10 client.5619 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe58bc32740 1 -- 172.21.15.146:0/2774998943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55bc96667a90 con 0x55bc96585650 2024-09-17T03:35:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe55d7fa640 1 -- 172.21.15.146:0/2774998943 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe574003d10 con 0x55bc96585650 2024-09-17T03:35:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe55d7fa640 1 -- 172.21.15.146:0/2774998943 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fe578024020 con 0x55bc96585650 2024-09-17T03:35:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe58bc32740 10 client.5619 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe58bc32740 10 client.5619 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe58bc32740 20 client.5619 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe58bc32740 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bc96544220 0x55bc9696b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe58bc32740 4 client.5619 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.695+0000 7fe58bc32740 1 -- 172.21.15.146:0/2774998943 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc968a1b40 con 0x55bc96544220 2024-09-17T03:35:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.696+0000 7fe57e59c640 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bc96544220 0x55bc9696b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.696+0000 7fe55d7fa640 10 client.5619 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.696+0000 7fe57e59c640 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bc96544220 0x55bc9696b7f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6490d8c932b4a5 server_cookie=4de29343f4dbb425 in_seq=0 out_seq=0 2024-09-17T03:35:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.696+0000 7fe55d7fa640 1 -- 172.21.15.146:0/2774998943 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc968a1b40 con 0x55bc96544220 2024-09-17T03:35:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.696+0000 7fe55d7fa640 10 client.5619 handle_command_reply: tid=0 2024-09-17T03:35:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.696+0000 7fe58bc32740 1 client.5619 shutdown 2024-09-17T03:35:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe58bc32740 1 -- 172.21.15.146:0/2774998943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96585650 msgr2=0x55bc96944580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe58bc32740 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96585650 0x55bc96944580 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe5800d20f0 tx=0x7fe5780064e0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe58bc32740 1 -- 172.21.15.146:0/2774998943 shutdown_connections 2024-09-17T03:35:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe58bc32740 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bc96544220 0x55bc9696b7f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe58bc32740 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96585650 0x55bc96944580 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe55d7fa640 0 client.5619 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe58bc32740 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96564970 0x55bc9696d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe58bc32740 1 --2- 172.21.15.146:0/2774998943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc9655c790 0x55bc96956630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe58bc32740 1 -- 172.21.15.146:0/2774998943 >> 172.21.15.146:0/2774998943 conn(0x55bc965797a0 msgr2=0x55bc96952e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe58bc32740 1 -- 172.21.15.146:0/2774998943 shutdown_connections 2024-09-17T03:35:45.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe58bc32740 1 -- 172.21.15.146:0/2774998943 wait complete. 2024-09-17T03:35:45.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.697+0000 7fe58bc32740 20 client.5619 trim_cache size 0 max 16384 2024-09-17T03:35:45.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.712+0000 7fe58bc32740 1 Processor -- start 2024-09-17T03:35:45.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.712+0000 7fe58bc32740 1 -- start start 2024-09-17T03:35:45.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.713+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc96943d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.713+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc9655c790 0x55bc969442d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.713+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96564970 0x55bc96998070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.713+0000 7fe58bc32740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801fe420 con 0x55bc96544220 2024-09-17T03:35:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.713+0000 7fe58bc32740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe58006f570 con 0x55bc96564970 2024-09-17T03:35:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.713+0000 7fe58bc32740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe5800b16e0 con 0x55bc9655c790 2024-09-17T03:35:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.713+0000 7fe57e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc96943d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.713+0000 7fe57e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc96943d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39348/0 (socket says 172.21.15.146:39348) 2024-09-17T03:35:45.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.713+0000 7fe57e59c640 1 -- 172.21.15.146:0/3995046349 learned_addr learned my addr 172.21.15.146:0/3995046349 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/3995046349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc9655c790 0x55bc969442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe57ed9d640 1 --2- 172.21.15.146:0/3995046349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96564970 0x55bc96998070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe57e59c640 1 -- 172.21.15.146:0/3995046349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc9655c790 msgr2=0x55bc969442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe57e59c640 1 --2- 172.21.15.146:0/3995046349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc9655c790 0x55bc969442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe57e59c640 1 -- 172.21.15.146:0/3995046349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96564970 msgr2=0x55bc96998070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe57e59c640 1 --2- 172.21.15.146:0/3995046349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96564970 0x55bc96998070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe57e59c640 1 -- 172.21.15.146:0/3995046349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9696d960 con 0x55bc96544220 2024-09-17T03:35:45.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/3995046349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc9655c790 0x55bc969442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe57ed9d640 1 --2- 172.21.15.146:0/3995046349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96564970 0x55bc96998070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe57e59c640 1 --2- 172.21.15.146:0/3995046349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc96943d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe570000f80 tx=0x7fe5700b97a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf5e89bd51fcfb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe55f7fe640 1 -- 172.21.15.146:0/3995046349 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570087c50 con 0x55bc96544220 2024-09-17T03:35:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe55f7fe640 1 -- 172.21.15.146:0/3995046349 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe57008cb00 con 0x55bc96544220 2024-09-17T03:35:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.714+0000 7fe55f7fe640 1 -- 172.21.15.146:0/3995046349 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5700bb0b0 con 0x55bc96544220 2024-09-17T03:35:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.715+0000 7fe58bc32740 1 -- 172.21.15.146:0/3995046349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 msgr2=0x55bc96943d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.715+0000 7fe58bc32740 1 --2- 172.21.15.146:0/3995046349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc96943d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe570000f80 tx=0x7fe5700b97a0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.715+0000 7fe58bc32740 1 -- 172.21.15.146:0/3995046349 shutdown_connections 2024-09-17T03:35:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.715+0000 7fe58bc32740 1 --2- 172.21.15.146:0/3995046349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc96564970 0x55bc96998070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.715+0000 7fe58bc32740 1 --2- 172.21.15.146:0/3995046349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc9655c790 0x55bc969442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.715+0000 7fe58bc32740 1 --2- 172.21.15.146:0/3995046349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc96943d90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.715+0000 7fe58bc32740 1 -- 172.21.15.146:0/3995046349 >> 172.21.15.146:0/3995046349 conn(0x55bc965797a0 msgr2=0x55bc96967cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.715+0000 7fe58bc32740 1 -- 172.21.15.146:0/3995046349 shutdown_connections 2024-09-17T03:35:45.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.715+0000 7fe58bc32740 1 -- 172.21.15.146:0/3995046349 wait complete. 2024-09-17T03:35:45.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.715+0000 7fe58bc32740 1 -- start start 2024-09-17T03:35:45.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.716+0000 7fe58bc32740 1 Processor -- start 2024-09-17T03:35:45.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc9694b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc9655c790 0x55bc969f4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe58bc32740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc96564970 0x55bc96998220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe58bc32740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55bc9698eb90 con 0x55bc96544220 2024-09-17T03:35:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe58bc32740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe58006ef70 con 0x55bc9655c790 2024-09-17T03:35:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe58bc32740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55bc96972f30 con 0x55bc96564970 2024-09-17T03:35:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe58bc32740 10 client.0 _ll_register_callbacks cb 0x7fe578000ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe57e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc9694b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe57e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc9694b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39364/0 (socket says 172.21.15.146:39364) 2024-09-17T03:35:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe57e59c640 1 -- 172.21.15.146:0/3073046750 learned_addr learned my addr 172.21.15.146:0/3073046750 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe57ed9d640 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc96564970 0x55bc96998220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc9655c790 0x55bc969f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe57e59c640 1 -- 172.21.15.146:0/3073046750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc96564970 msgr2=0x55bc96998220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe57e59c640 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc96564970 0x55bc96998220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe57e59c640 1 -- 172.21.15.146:0/3073046750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc9655c790 msgr2=0x55bc969f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe57e59c640 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc9655c790 0x55bc969f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.717+0000 7fe57e59c640 1 -- 172.21.15.146:0/3073046750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc9696d400 con 0x55bc96544220 2024-09-17T03:35:45.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe57e59c640 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc9694b160 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe57008bfa0 tx=0x7fe570001d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d50b0a4c3bf4e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe55d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:45.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe55d7fa640 1 -- 172.21.15.146:0/3073046750 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57007f3e0 con 0x55bc96544220 2024-09-17T03:35:45.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe55d7fa640 1 -- 172.21.15.146:0/3073046750 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe57009ed20 con 0x55bc96544220 2024-09-17T03:35:45.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe58bc32740 1 -- 172.21.15.146:0/3073046750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe57008cb00 con 0x55bc96544220 2024-09-17T03:35:45.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe55d7fa640 1 -- 172.21.15.146:0/3073046750 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe57007f580 con 0x55bc96544220 2024-09-17T03:35:45.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe58bc32740 10 client.5625 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:45.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe58bc32740 1 -- 172.21.15.146:0/3073046750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55bc9694dc80 con 0x55bc96544220 2024-09-17T03:35:45.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe55d7fa640 1 -- 172.21.15.146:0/3073046750 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe57008cb00 con 0x55bc96544220 2024-09-17T03:35:45.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe55d7fa640 1 -- 172.21.15.146:0/3073046750 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fe57008c670 con 0x55bc96544220 2024-09-17T03:35:45.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe58bc32740 10 client.5625 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:45.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe58bc32740 10 client.5625 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:45.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe58bc32740 20 client.5625 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:45.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe58bc32740 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bc96519660 0x55bc96998760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe58bc32740 4 client.5625 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-17T03:35:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe58bc32740 1 -- 172.21.15.146:0/3073046750 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55bc969298d0 con 0x55bc96519660 2024-09-17T03:35:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.718+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bc96519660 0x55bc96998760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.719+0000 7fe55d7fa640 10 client.5625 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.719+0000 7fe57dd9b640 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bc96519660 0x55bc96998760 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef22c3a4ea2dc420 server_cookie=c1e58fdf84fe4c7c in_seq=0 out_seq=0 2024-09-17T03:35:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe55d7fa640 1 -- 172.21.15.146:0/3073046750 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc969298d0 con 0x55bc96519660 2024-09-17T03:35:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe55d7fa640 10 client.5625 handle_command_reply: tid=0 2024-09-17T03:35:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 1 client.5625 shutdown 2024-09-17T03:35:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 1 -- 172.21.15.146:0/3073046750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 msgr2=0x55bc9694b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc9694b160 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe57008bfa0 tx=0x7fe570001d10 comp rx=0 tx=0).stop 2024-09-17T03:35:45.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 1 -- 172.21.15.146:0/3073046750 shutdown_connections 2024-09-17T03:35:45.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55bc96519660 0x55bc96998760 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55bc96564970 0x55bc96998220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55bc9655c790 0x55bc969f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe55d7fa640 0 client.5625 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 1 --2- 172.21.15.146:0/3073046750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc96544220 0x55bc9694b160 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 1 -- 172.21.15.146:0/3073046750 >> 172.21.15.146:0/3073046750 conn(0x55bc965797a0 msgr2=0x55bc96943d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 1 -- 172.21.15.146:0/3073046750 shutdown_connections 2024-09-17T03:35:45.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 1 -- 172.21.15.146:0/3073046750 wait complete. 2024-09-17T03:35:45.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.722+0000 7fe58bc32740 20 client.5625 trim_cache size 0 max 16384 2024-09-17T03:35:45.729 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:45.730 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:35:45.730 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:35:45.730 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:45.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 -- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe560078d60 msgr2=0x7fe56007b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe560078d60 0x7fe56007b270 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5800c9150 tx=0x7fe574005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:45.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 -- 172.21.15.146:0/3240887945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe568003a30 msgr2=0x7fe5801e5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe568003a30 0x7fe5801e5ef0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe57002acc0 tx=0x7fe570006db0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 -- 172.21.15.146:0/3240887945 shutdown_connections 2024-09-17T03:35:45.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe560078d60 0x7fe56007b270 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe580070d60 0x7fe5800cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe580070950 0x7fe5800cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 --2- 172.21.15.146:0/3240887945 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe568003a30 0x7fe5801e5ef0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 -- 172.21.15.146:0/3240887945 >> 172.21.15.146:0/3240887945 conn(0x7fe58009ba20 msgr2=0x7fe5800cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 -- 172.21.15.146:0/3240887945 shutdown_connections 2024-09-17T03:35:45.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.723+0000 7fe584be4640 1 -- 172.21.15.146:0/3240887945 wait complete. 2024-09-17T03:35:45.733 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' returned '{'message': '', 'return_code': 0}' 2024-09-17T03:35:45.733 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-17T03:35:45.733 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-17T03:35:45.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.850+0000 7f9097d13640 1 -- 172.21.15.146:0/3870363535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90900cfca0 msgr2=0x7f90900cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.850+0000 7f9097d13640 1 --2- 172.21.15.146:0/3870363535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90900cfca0 0x7f90900cef40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f90900ba8e0 tx=0x7f908402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.850+0000 7f9097d13640 1 -- 172.21.15.146:0/3870363535 shutdown_connections 2024-09-17T03:35:45.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.850+0000 7f9097d13640 1 --2- 172.21.15.146:0/3870363535 >> v2:172.21.15.179:3300/0 conn(0x7f90900b61f0 0x7f90900b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.850+0000 7f9097d13640 1 --2- 172.21.15.146:0/3870363535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90900cfca0 0x7f90900cef40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.850+0000 7f9097d13640 1 -- 172.21.15.146:0/3870363535 >> 172.21.15.146:0/3870363535 conn(0x7f90900d11f0 msgr2=0x7f90900d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.850+0000 7f9097d13640 1 -- 172.21.15.146:0/3870363535 shutdown_connections 2024-09-17T03:35:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.850+0000 7f9097d13640 1 -- 172.21.15.146:0/3870363535 wait complete. 2024-09-17T03:35:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.851+0000 7f9097d13640 1 Processor -- start 2024-09-17T03:35:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.852+0000 7f9097d13640 1 -- start start 2024-09-17T03:35:45.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f9097d13640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900b61f0 0x7f90900cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f9097d13640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90900cfca0 0x7f909014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f9097d13640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f909015f1a0 0x7f9090159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f9097d13640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90900695b0 con 0x7f90900cfca0 2024-09-17T03:35:45.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f9097d13640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9090069430 con 0x7f909015f1a0 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f9097d13640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9090069730 con 0x7f90900b61f0 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f90952ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90900cfca0 0x7f909014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f90952ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90900cfca0 0x7f909014fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39370/0 (socket says 172.21.15.146:39370) 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f90952ae640 1 -- 172.21.15.146:0/2418376029 learned_addr learned my addr 172.21.15.146:0/2418376029 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f90962b0640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f909015f1a0 0x7f9090159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f9095aaf640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900b61f0 0x7f90900cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f90952ae640 1 -- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900b61f0 msgr2=0x7f90900cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f90952ae640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900b61f0 0x7f90900cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f90952ae640 1 -- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f909015f1a0 msgr2=0x7f9090159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f90952ae640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f909015f1a0 0x7f9090159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f90952ae640 1 -- 172.21.15.146:0/2418376029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90900cc2f0 con 0x7f90900cfca0 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f90962b0640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f909015f1a0 0x7f9090159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.853+0000 7f90952ae640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90900cfca0 0x7f909014fba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f908402aa90 tx=0x7f9084033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.854+0000 7f908e7fc640 1 -- 172.21.15.146:0/2418376029 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9084005c90 con 0x7f90900cfca0 2024-09-17T03:35:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.854+0000 7f908e7fc640 1 -- 172.21.15.146:0/2418376029 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9084031e50 con 0x7f90900cfca0 2024-09-17T03:35:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.854+0000 7f9097d13640 1 -- 172.21.15.146:0/2418376029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90900cc5d0 con 0x7f90900cfca0 2024-09-17T03:35:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.854+0000 7f908e7fc640 1 -- 172.21.15.146:0/2418376029 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9084005240 con 0x7f90900cfca0 2024-09-17T03:35:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.854+0000 7f9097d13640 1 -- 172.21.15.146:0/2418376029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90900ccb90 con 0x7f90900cfca0 2024-09-17T03:35:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.856+0000 7f908e7fc640 1 -- 172.21.15.146:0/2418376029 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90840053e0 con 0x7f90900cfca0 2024-09-17T03:35:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.856+0000 7f908e7fc640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f907c078bc0 0x7f907c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.856+0000 7f908e7fc640 1 -- 172.21.15.146:0/2418376029 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f90840bbe10 con 0x7f90900cfca0 2024-09-17T03:35:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.856+0000 7f9095aaf640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f907c078bc0 0x7f907c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.857+0000 7f9095aaf640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f907c078bc0 0x7f907c07b0d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9080001770 tx=0x7f9080009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.857+0000 7f909ec81740 1 Processor -- start 2024-09-17T03:35:45.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.857+0000 7f909ec81740 1 -- start start 2024-09-17T03:35:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.858+0000 7f909ec81740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd190fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.858+0000 7f909ec81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd7c7d0 0x5597bd165e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.858+0000 7f909ec81740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd849b0 0x5597bd166350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.858+0000 7f909ec81740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5597bd0bfb00 con 0x5597bcda5690 2024-09-17T03:35:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.858+0000 7f909ec81740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5597bd0aef30 con 0x5597bcd7c7d0 2024-09-17T03:35:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.858+0000 7f909ec81740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5597bd0b2d40 con 0x5597bcd849b0 2024-09-17T03:35:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.858+0000 7f9095aaf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd190fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.858+0000 7f9095aaf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd190fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39380/0 (socket says 172.21.15.146:39380) 2024-09-17T03:35:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.858+0000 7f9095aaf640 1 -- 172.21.15.146:0/1695423730 learned_addr learned my addr 172.21.15.146:0/1695423730 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.859+0000 7f90952ae640 1 --2- 172.21.15.146:0/1695423730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd7c7d0 0x5597bd165e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.859+0000 7f90962b0640 1 --2- 172.21.15.146:0/1695423730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd849b0 0x5597bd166350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.859+0000 7f9095aaf640 1 -- 172.21.15.146:0/1695423730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd849b0 msgr2=0x5597bd166350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.859+0000 7f9095aaf640 1 --2- 172.21.15.146:0/1695423730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd849b0 0x5597bd166350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.859+0000 7f9095aaf640 1 -- 172.21.15.146:0/1695423730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd7c7d0 msgr2=0x5597bd165e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.859+0000 7f9095aaf640 1 --2- 172.21.15.146:0/1695423730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd7c7d0 0x5597bd165e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.859+0000 7f9095aaf640 1 -- 172.21.15.146:0/1695423730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597bce89b00 con 0x5597bcda5690 2024-09-17T03:35:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.859+0000 7f9095aaf640 1 --2- 172.21.15.146:0/1695423730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd190fc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f908000edb0 tx=0x7f9080011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431b38ca53ef13d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.859+0000 7f90777fe640 1 -- 172.21.15.146:0/1695423730 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080025070 con 0x5597bcda5690 2024-09-17T03:35:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.859+0000 7f90777fe640 1 -- 172.21.15.146:0/1695423730 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9080020400 con 0x5597bcda5690 2024-09-17T03:35:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.859+0000 7f90777fe640 1 -- 172.21.15.146:0/1695423730 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080020830 con 0x5597bcda5690 2024-09-17T03:35:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.860+0000 7f909ec81740 1 -- 172.21.15.146:0/1695423730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 msgr2=0x5597bd190fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.860+0000 7f909ec81740 1 --2- 172.21.15.146:0/1695423730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd190fc0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f908000edb0 tx=0x7f9080011000 comp rx=0 tx=0).stop 2024-09-17T03:35:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.860+0000 7f909ec81740 1 -- 172.21.15.146:0/1695423730 shutdown_connections 2024-09-17T03:35:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.860+0000 7f909ec81740 1 --2- 172.21.15.146:0/1695423730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd849b0 0x5597bd166350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.860+0000 7f909ec81740 1 --2- 172.21.15.146:0/1695423730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd7c7d0 0x5597bd165e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.860+0000 7f909ec81740 1 --2- 172.21.15.146:0/1695423730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd190fc0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.860+0000 7f909ec81740 1 -- 172.21.15.146:0/1695423730 >> 172.21.15.146:0/1695423730 conn(0x5597bcd997e0 msgr2=0x5597bd14c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.860+0000 7f909ec81740 1 -- 172.21.15.146:0/1695423730 shutdown_connections 2024-09-17T03:35:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.860+0000 7f909ec81740 1 -- 172.21.15.146:0/1695423730 wait complete. 2024-09-17T03:35:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.861+0000 7f909ec81740 1 -- start start 2024-09-17T03:35:45.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.861+0000 7f909ec81740 1 Processor -- start 2024-09-17T03:35:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.862+0000 7f909ec81740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd7c7d0 0x5597bd1a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.862+0000 7f909ec81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd849b0 0x5597bd18ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.862+0000 7f909ec81740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd186930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.862+0000 7f909ec81740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5597bce1fa40 con 0x5597bcda5690 2024-09-17T03:35:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.862+0000 7f909ec81740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5597bd035680 con 0x5597bcd849b0 2024-09-17T03:35:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.862+0000 7f909ec81740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5597bd1a2460 con 0x5597bcd7c7d0 2024-09-17T03:35:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f909ec81740 10 client.0 _ll_register_callbacks cb 0x5597bd063c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f90962b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd186930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f90962b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd186930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39388/0 (socket says 172.21.15.146:39388) 2024-09-17T03:35:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f90962b0640 1 -- 172.21.15.146:0/2689818570 learned_addr learned my addr 172.21.15.146:0/2689818570 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f90952ae640 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd849b0 0x5597bd18ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f9095aaf640 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd7c7d0 0x5597bd1a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f90962b0640 1 -- 172.21.15.146:0/2689818570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd7c7d0 msgr2=0x5597bd1a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f90962b0640 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd7c7d0 0x5597bd1a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f90962b0640 1 -- 172.21.15.146:0/2689818570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd849b0 msgr2=0x5597bd18ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f90962b0640 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd849b0 0x5597bd18ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f90962b0640 1 -- 172.21.15.146:0/2689818570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597bcdee9a0 con 0x5597bcda5690 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f90962b0640 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd186930 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f908800bf40 tx=0x7f908800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c27f2bf14df758 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f9074ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f9074ff9640 1 -- 172.21.15.146:0/2689818570 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088018020 con 0x5597bcda5690 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f9074ff9640 1 -- 172.21.15.146:0/2689818570 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9088014670 con 0x5597bcda5690 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f909ec81740 1 -- 172.21.15.146:0/2689818570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9080020400 con 0x5597bcda5690 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f9074ff9640 1 -- 172.21.15.146:0/2689818570 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9088022050 con 0x5597bcda5690 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f909ec81740 10 client.5640 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.863+0000 7f909ec81740 1 -- 172.21.15.146:0/2689818570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5597bceea290 con 0x5597bcda5690 2024-09-17T03:35:45.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.864+0000 7f9074ff9640 1 -- 172.21.15.146:0/2689818570 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9080020400 con 0x5597bcda5690 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.864+0000 7f9074ff9640 1 -- 172.21.15.146:0/2689818570 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f9088025020 con 0x5597bcda5690 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.864+0000 7f909ec81740 10 client.5640 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.864+0000 7f909ec81740 10 client.5640 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.864+0000 7f909ec81740 20 client.5640 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.864+0000 7f909ec81740 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5597bcd64260 0x5597bd1a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.864+0000 7f909ec81740 4 client.5640 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.864+0000 7f909ec81740 1 -- 172.21.15.146:0/2689818570 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597bd0c1a50 con 0x5597bcd64260 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.864+0000 7f9095aaf640 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5597bcd64260 0x5597bd1a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.864+0000 7f9074ff9640 10 client.5640 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.864+0000 7f9095aaf640 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5597bcd64260 0x5597bd1a14d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e0be47da55ea206 server_cookie=f4792dd02d7c7b07 in_seq=0 out_seq=0 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f9074ff9640 1 -- 172.21.15.146:0/2689818570 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5597bd0c1a50 con 0x5597bcd64260 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f9074ff9640 10 client.5640 handle_command_reply: tid=0 2024-09-17T03:35:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 1 client.5640 shutdown 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 1 -- 172.21.15.146:0/2689818570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 msgr2=0x5597bd186930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd186930 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f908800bf40 tx=0x7f908800f670 comp rx=0 tx=0).stop 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 1 -- 172.21.15.146:0/2689818570 shutdown_connections 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5597bcd64260 0x5597bd1a14d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcda5690 0x5597bd186930 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd849b0 0x5597bd18ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f9074ff9640 0 client.5640 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 1 --2- 172.21.15.146:0/2689818570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd7c7d0 0x5597bd1a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 1 -- 172.21.15.146:0/2689818570 >> 172.21.15.146:0/2689818570 conn(0x5597bcd997e0 msgr2=0x5597bd1663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 1 -- 172.21.15.146:0/2689818570 shutdown_connections 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 1 -- 172.21.15.146:0/2689818570 wait complete. 2024-09-17T03:35:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.865+0000 7f909ec81740 20 client.5640 trim_cache size 0 max 16384 2024-09-17T03:35:45.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.883+0000 7f909ec81740 1 Processor -- start 2024-09-17T03:35:45.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.883+0000 7f909ec81740 1 -- start start 2024-09-17T03:35:45.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.884+0000 7f909ec81740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd7c7d0 0x5597bd187ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.884+0000 7f909ec81740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd849b0 0x5597bd191470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f909ec81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcda5690 0x5597bd19e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f909ec81740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90902025d0 con 0x5597bcd7c7d0 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f909ec81740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f90900c9f50 con 0x5597bcda5690 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f909ec81740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f90900c92b0 con 0x5597bcd849b0 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f9095aaf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd7c7d0 0x5597bd187ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f9095aaf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd7c7d0 0x5597bd187ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39398/0 (socket says 172.21.15.146:39398) 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f9095aaf640 1 -- 172.21.15.146:0/4218125125 learned_addr learned my addr 172.21.15.146:0/4218125125 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f90962b0640 1 --2- 172.21.15.146:0/4218125125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcda5690 0x5597bd19e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f90952ae640 1 --2- 172.21.15.146:0/4218125125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd849b0 0x5597bd191470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f9095aaf640 1 -- 172.21.15.146:0/4218125125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd849b0 msgr2=0x5597bd191470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f9095aaf640 1 --2- 172.21.15.146:0/4218125125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd849b0 0x5597bd191470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f9095aaf640 1 -- 172.21.15.146:0/4218125125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcda5690 msgr2=0x5597bd19e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f9095aaf640 1 --2- 172.21.15.146:0/4218125125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcda5690 0x5597bd19e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f9095aaf640 1 -- 172.21.15.146:0/4218125125 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597bce87e00 con 0x5597bcd7c7d0 2024-09-17T03:35:45.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f90952ae640 1 --2- 172.21.15.146:0/4218125125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd849b0 0x5597bd191470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:45.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.885+0000 7f9095aaf640 1 --2- 172.21.15.146:0/4218125125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd7c7d0 0x5597bd187ee0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9080020000 tx=0x7f9080015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00094162bf5d8ad server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f9076ffd640 1 -- 172.21.15.146:0/4218125125 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080025040 con 0x5597bcd7c7d0 2024-09-17T03:35:45.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f9076ffd640 1 -- 172.21.15.146:0/4218125125 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9080036070 con 0x5597bcd7c7d0 2024-09-17T03:35:45.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f9076ffd640 1 -- 172.21.15.146:0/4218125125 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908002a410 con 0x5597bcd7c7d0 2024-09-17T03:35:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f909ec81740 1 -- 172.21.15.146:0/4218125125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd7c7d0 msgr2=0x5597bd187ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f909ec81740 1 --2- 172.21.15.146:0/4218125125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd7c7d0 0x5597bd187ee0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9080020000 tx=0x7f9080015000 comp rx=0 tx=0).stop 2024-09-17T03:35:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f909ec81740 1 -- 172.21.15.146:0/4218125125 shutdown_connections 2024-09-17T03:35:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f909ec81740 1 --2- 172.21.15.146:0/4218125125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcda5690 0x5597bd19e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f909ec81740 1 --2- 172.21.15.146:0/4218125125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcd849b0 0x5597bd191470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f909ec81740 1 --2- 172.21.15.146:0/4218125125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd7c7d0 0x5597bd187ee0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f909ec81740 1 -- 172.21.15.146:0/4218125125 >> 172.21.15.146:0/4218125125 conn(0x5597bcd997e0 msgr2=0x5597bd190460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f909ec81740 1 -- 172.21.15.146:0/4218125125 shutdown_connections 2024-09-17T03:35:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.887+0000 7f909ec81740 1 -- 172.21.15.146:0/4218125125 wait complete. 2024-09-17T03:35:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.888+0000 7f909ec81740 1 -- start start 2024-09-17T03:35:45.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.888+0000 7f909ec81740 1 Processor -- start 2024-09-17T03:35:45.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f909ec81740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd7c7d0 0x5597bd192e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f909ec81740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd849b0 0x5597bd1b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f909ec81740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcda5690 0x5597bd1b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f909ec81740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90900c9900 con 0x5597bcd849b0 2024-09-17T03:35:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f909ec81740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5597bd1b45c0 con 0x5597bcd7c7d0 2024-09-17T03:35:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f909ec81740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5597bd164b80 con 0x5597bcda5690 2024-09-17T03:35:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f909ec81740 10 client.0 _ll_register_callbacks cb 0x7f908800b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f90952ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd849b0 0x5597bd1b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f90952ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd849b0 0x5597bd1b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39412/0 (socket says 172.21.15.146:39412) 2024-09-17T03:35:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f90952ae640 1 -- 172.21.15.146:0/1719082083 learned_addr learned my addr 172.21.15.146:0/1719082083 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f9095aaf640 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd7c7d0 0x5597bd192e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f90962b0640 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcda5690 0x5597bd1b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f90952ae640 1 -- 172.21.15.146:0/1719082083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcda5690 msgr2=0x5597bd1b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f90952ae640 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcda5690 0x5597bd1b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f90952ae640 1 -- 172.21.15.146:0/1719082083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd7c7d0 msgr2=0x5597bd192e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:45.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f90952ae640 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd7c7d0 0x5597bd192e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f90952ae640 1 -- 172.21.15.146:0/1719082083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597bd199620 con 0x5597bcd849b0 2024-09-17T03:35:45.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f90952ae640 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd849b0 0x5597bd1b37c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f90840ba2a0 tx=0x7f90840841c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ced148cce0dcfbc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:45.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.890+0000 7f9074ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:45.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f9074ff9640 1 -- 172.21.15.146:0/1719082083 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9084048040 con 0x5597bcd849b0 2024-09-17T03:35:45.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f9074ff9640 1 -- 172.21.15.146:0/1719082083 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9084088190 con 0x5597bcd849b0 2024-09-17T03:35:45.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f909ec81740 1 -- 172.21.15.146:0/1719082083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9080036070 con 0x5597bcd849b0 2024-09-17T03:35:45.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f9074ff9640 1 -- 172.21.15.146:0/1719082083 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9084031770 con 0x5597bcd849b0 2024-09-17T03:35:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f909ec81740 10 client.5646 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f909ec81740 1 -- 172.21.15.146:0/1719082083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5597bd145680 con 0x5597bcd849b0 2024-09-17T03:35:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f9074ff9640 1 -- 172.21.15.146:0/1719082083 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9080036070 con 0x5597bcd849b0 2024-09-17T03:35:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f9074ff9640 1 -- 172.21.15.146:0/1719082083 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f9084082e00 con 0x5597bcd849b0 2024-09-17T03:35:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f909ec81740 10 client.5646 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f909ec81740 10 client.5646 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f909ec81740 20 client.5646 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f909ec81740 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5597bd163de0 0x5597bd1641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f909ec81740 4 client.5646 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-17T03:35:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f909ec81740 1 -- 172.21.15.146:0/1719082083 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x5597bd142060 con 0x5597bd163de0 2024-09-17T03:35:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.891+0000 7f9095aaf640 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5597bd163de0 0x5597bd1641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.892+0000 7f9074ff9640 10 client.5646 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.892+0000 7f9095aaf640 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5597bd163de0 0x5597bd1641f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c24f420bb9b851a0 server_cookie=b1db7db63ac97de2 in_seq=0 out_seq=0 2024-09-17T03:35:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.892+0000 7f9074ff9640 1 -- 172.21.15.146:0/1719082083 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5597bd142060 con 0x5597bd163de0 2024-09-17T03:35:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.892+0000 7f9074ff9640 10 client.5646 handle_command_reply: tid=0 2024-09-17T03:35:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.892+0000 7f909ec81740 1 client.5646 shutdown 2024-09-17T03:35:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.892+0000 7f909ec81740 1 -- 172.21.15.146:0/1719082083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd849b0 msgr2=0x5597bd1b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.892+0000 7f909ec81740 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd849b0 0x5597bd1b37c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f90840ba2a0 tx=0x7f90840841c0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f909ec81740 1 -- 172.21.15.146:0/1719082083 shutdown_connections 2024-09-17T03:35:45.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f909ec81740 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5597bd163de0 0x5597bd1641f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f909ec81740 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5597bcda5690 0x5597bd1b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f909ec81740 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5597bcd849b0 0x5597bd1b37c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f909ec81740 1 --2- 172.21.15.146:0/1719082083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5597bcd7c7d0 0x5597bd192e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9074ff9640 0 client.5646 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:45.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f909ec81740 1 -- 172.21.15.146:0/1719082083 >> 172.21.15.146:0/1719082083 conn(0x5597bcd997e0 msgr2=0x5597bd191470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f909ec81740 1 -- 172.21.15.146:0/1719082083 shutdown_connections 2024-09-17T03:35:45.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f909ec81740 1 -- 172.21.15.146:0/1719082083 wait complete. 2024-09-17T03:35:45.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f909ec81740 20 client.5646 trim_cache size 0 max 16384 2024-09-17T03:35:45.898 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:45.899 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:35:45.899 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "dee09f00-18b7-4525-8418-50d2c01a47aa", 2024-09-17T03:35:45.899 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:35:45.899 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 -- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f907c078bc0 msgr2=0x7f907c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f907c078bc0 0x7f907c07b0d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9080001770 tx=0x7f9080009040 comp rx=0 tx=0).stop 2024-09-17T03:35:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 -- 172.21.15.146:0/2418376029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90900cfca0 msgr2=0x7f909014fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90900cfca0 0x7f909014fba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f908402aa90 tx=0x7f9084033c20 comp rx=0 tx=0).stop 2024-09-17T03:35:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 -- 172.21.15.146:0/2418376029 shutdown_connections 2024-09-17T03:35:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f907c078bc0 0x7f907c07b0d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f909015f1a0 0x7f9090159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90900cfca0 0x7f909014fba0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 --2- 172.21.15.146:0/2418376029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90900b61f0 0x7f90900cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:45.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 -- 172.21.15.146:0/2418376029 >> 172.21.15.146:0/2418376029 conn(0x7f90900d11f0 msgr2=0x7f909015cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:45.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 -- 172.21.15.146:0/2418376029 shutdown_connections 2024-09-17T03:35:45.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:45.893+0000 7f9097d13640 1 -- 172.21.15.146:0/2418376029 wait complete. 2024-09-17T03:35:45.903 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'dee09f00-18b7-4525-8418-50d2c01a47aa', 'mode': 'asynchronous'}' 2024-09-17T03:35:45.903 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-17T03:35:45.903 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-17T03:35:45.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-17T03:35:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.020+0000 7f2b764f2640 1 -- 172.21.15.146:0/1075407961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700b3d30 msgr2=0x7f2b7015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.020+0000 7f2b764f2640 1 --2- 172.21.15.146:0/1075407961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700b3d30 0x7f2b7015caa0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2b700b5390 tx=0x7f2b6802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.020+0000 7f2b764f2640 1 -- 172.21.15.146:0/1075407961 shutdown_connections 2024-09-17T03:35:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.020+0000 7f2b764f2640 1 --2- 172.21.15.146:0/1075407961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700b3d30 0x7f2b7015caa0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.020+0000 7f2b764f2640 1 --2- 172.21.15.146:0/1075407961 >> v2:172.21.15.179:3300/0 conn(0x7f2b700b5ce0 0x7f2b700b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.020+0000 7f2b764f2640 1 -- 172.21.15.146:0/1075407961 >> 172.21.15.146:0/1075407961 conn(0x7f2b700b7b20 msgr2=0x7f2b7009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.020+0000 7f2b764f2640 1 -- 172.21.15.146:0/1075407961 shutdown_connections 2024-09-17T03:35:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.020+0000 7f2b764f2640 1 -- 172.21.15.146:0/1075407961 wait complete. 2024-09-17T03:35:46.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.022+0000 7f2b764f2640 1 Processor -- start 2024-09-17T03:35:46.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.022+0000 7f2b764f2640 1 -- start start 2024-09-17T03:35:46.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.023+0000 7f2b764f2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700b5750 0x7f2b701f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.023+0000 7f2b764f2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b700b5ce0 0x7f2b7015eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.023+0000 7f2b764f2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b7015f410 0x7f2b701f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.023+0000 7f2b764f2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7015d3f0 con 0x7f2b700b5750 2024-09-17T03:35:46.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.023+0000 7f2b764f2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7015d270 con 0x7f2b7015f410 2024-09-17T03:35:46.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.023+0000 7f2b764f2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7015d570 con 0x7f2b700b5ce0 2024-09-17T03:35:46.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.023+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700b5750 0x7f2b701f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.023+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700b5750 0x7f2b701f70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39424/0 (socket says 172.21.15.146:39424) 2024-09-17T03:35:46.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.023+0000 7f2b6ffff640 1 -- 172.21.15.146:0/3330425417 learned_addr learned my addr 172.21.15.146:0/3330425417 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b74a8f640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b7015f410 0x7f2b701f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b700b5ce0 0x7f2b7015eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b6ffff640 1 -- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b700b5ce0 msgr2=0x7f2b7015eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b700b5ce0 0x7f2b7015eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b6ffff640 1 -- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b7015f410 msgr2=0x7f2b701f38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b7015f410 0x7f2b701f38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b6ffff640 1 -- 172.21.15.146:0/3330425417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b70149da0 con 0x7f2b700b5750 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700b5750 0x7f2b701f70f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000d740 tx=0x7f2b6000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b6cff9640 1 -- 172.21.15.146:0/3330425417 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60017070 con 0x7f2b700b5750 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b6cff9640 1 -- 172.21.15.146:0/3330425417 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b60009d20 con 0x7f2b700b5750 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b764f2640 1 -- 172.21.15.146:0/3330425417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7014a080 con 0x7f2b700b5750 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b6cff9640 1 -- 172.21.15.146:0/3330425417 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b600106c0 con 0x7f2b700b5750 2024-09-17T03:35:46.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.024+0000 7f2b764f2640 1 -- 172.21.15.146:0/3330425417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7014a640 con 0x7f2b700b5750 2024-09-17T03:35:46.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.027+0000 7f2b6cff9640 1 -- 172.21.15.146:0/3330425417 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b6001a070 con 0x7f2b700b5750 2024-09-17T03:35:46.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.027+0000 7f2b6cff9640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b5c078b90 0x7f2b5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.027+0000 7f2b6cff9640 1 -- 172.21.15.146:0/3330425417 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f2b6009aea0 con 0x7f2b700b5750 2024-09-17T03:35:46.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.027+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b5c078b90 0x7f2b5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.028+0000 7f2b7d45f740 1 Processor -- start 2024-09-17T03:35:46.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.028+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b5c078b90 0x7f2b5c07b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2b7009d7b0 tx=0x7f2b64007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.028+0000 7f2b7d45f740 1 -- start start 2024-09-17T03:35:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345ef27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b01ba0 0x55a345ef2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b09d80 0x55a345efb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a345e44bd0 con 0x55a345b2aa60 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a345e34000 con 0x55a345b09d80 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a345e37e10 con 0x55a345b01ba0 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345ef27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345ef27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39440/0 (socket says 172.21.15.146:39440) 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b6ffff640 1 -- 172.21.15.146:0/2428538286 learned_addr learned my addr 172.21.15.146:0/2428538286 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b74a8f640 1 --2- 172.21.15.146:0/2428538286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b09d80 0x55a345efb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/2428538286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b01ba0 0x55a345ef2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b6ffff640 1 -- 172.21.15.146:0/2428538286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b01ba0 msgr2=0x55a345ef2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.029+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/2428538286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b01ba0 0x55a345ef2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.030+0000 7f2b6ffff640 1 -- 172.21.15.146:0/2428538286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b09d80 msgr2=0x55a345efb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.030+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/2428538286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b09d80 0x55a345efb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.030+0000 7f2b6ffff640 1 -- 172.21.15.146:0/2428538286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a345dfee80 con 0x55a345b2aa60 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.030+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/2428538286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345ef27f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2b60099300 tx=0x7f2b60062510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dda681c84696012 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.030+0000 7f2b55ffb640 1 -- 172.21.15.146:0/2428538286 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60021040 con 0x55a345b2aa60 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.030+0000 7f2b55ffb640 1 -- 172.21.15.146:0/2428538286 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b60067680 con 0x55a345b2aa60 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.030+0000 7f2b55ffb640 1 -- 172.21.15.146:0/2428538286 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60062140 con 0x55a345b2aa60 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.031+0000 7f2b7d45f740 1 -- 172.21.15.146:0/2428538286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 msgr2=0x55a345ef27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.031+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/2428538286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345ef27f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2b60099300 tx=0x7f2b60062510 comp rx=0 tx=0).stop 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.031+0000 7f2b7d45f740 1 -- 172.21.15.146:0/2428538286 shutdown_connections 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.031+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/2428538286 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b09d80 0x55a345efb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.031+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/2428538286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b01ba0 0x55a345ef2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.031+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/2428538286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345ef27f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.031+0000 7f2b7d45f740 1 -- 172.21.15.146:0/2428538286 >> 172.21.15.146:0/2428538286 conn(0x55a345b1ebb0 msgr2=0x55a345ed1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.031+0000 7f2b7d45f740 1 -- 172.21.15.146:0/2428538286 shutdown_connections 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.031+0000 7f2b7d45f740 1 -- 172.21.15.146:0/2428538286 wait complete. 2024-09-17T03:35:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.032+0000 7f2b7d45f740 1 -- start start 2024-09-17T03:35:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.032+0000 7f2b7d45f740 1 Processor -- start 2024-09-17T03:35:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b01ba0 0x55a345f0fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b09d80 0x55a345f177b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b2aa60 0x55a345f262b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a345ba4e10 con 0x55a345b01ba0 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a345dd9980 con 0x55a345b2aa60 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a345f273c0 con 0x55a345b09d80 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b7d45f740 10 client.0 _ll_register_callbacks cb 0x55a345de9050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b01ba0 0x55a345f0fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b01ba0 0x55a345f0fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39456/0 (socket says 172.21.15.146:39456) 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b6ffff640 1 -- 172.21.15.146:0/1267865670 learned_addr learned my addr 172.21.15.146:0/1267865670 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b74a8f640 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b2aa60 0x55a345f262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b09d80 0x55a345f177b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b6ffff640 1 -- 172.21.15.146:0/1267865670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b09d80 msgr2=0x55a345f177b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b09d80 0x55a345f177b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b6ffff640 1 -- 172.21.15.146:0/1267865670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b2aa60 msgr2=0x55a345f262b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b2aa60 0x55a345f262b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.033+0000 7f2b6ffff640 1 -- 172.21.15.146:0/1267865670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a345b26ac0 con 0x55a345b01ba0 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b01ba0 0x55a345f0fd80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2b6005ff50 tx=0x7f2b600621f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405b16e93711b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b4effd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b4effd640 1 -- 172.21.15.146:0/1267865670 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60021070 con 0x55a345b01ba0 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b4effd640 1 -- 172.21.15.146:0/1267865670 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f2b6004e1d0 con 0x55a345b01ba0 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1267865670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a345e30800 con 0x55a345b01ba0 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b4effd640 1 -- 172.21.15.146:0/1267865670 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2b6006c5c0 con 0x55a345b01ba0 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b7d45f740 10 client.5661 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1267865670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55a345b96040 con 0x55a345b01ba0 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b4effd640 1 -- 172.21.15.146:0/1267865670 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a345e30800 con 0x55a345b01ba0 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b4effd640 1 -- 172.21.15.146:0/1267865670 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f2b600619b0 con 0x55a345b01ba0 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b7d45f740 10 client.5661 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b7d45f740 10 client.5661 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b7d45f740 20 client.5661 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:46.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a345ae9630 0x55a345f26de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b7d45f740 4 client.5661 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1267865670 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a345e46b20 con 0x55a345ae9630 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.034+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a345ae9630 0x55a345f26de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.035+0000 7f2b4effd640 10 client.5661 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.035+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a345ae9630 0x55a345f26de0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab769f83c3ed2394 server_cookie=123c375d15bcec3d in_seq=0 out_seq=0 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.035+0000 7f2b4effd640 1 -- 172.21.15.146:0/1267865670 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a345e46b20 con 0x55a345ae9630 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.035+0000 7f2b4effd640 10 client.5661 handle_command_reply: tid=0 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.035+0000 7f2b7d45f740 1 client.5661 shutdown 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1267865670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b01ba0 msgr2=0x55a345f0fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b01ba0 0x55a345f0fd80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2b6005ff50 tx=0x7f2b600621f0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1267865670 shutdown_connections 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a345ae9630 0x55a345f26de0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b2aa60 0x55a345f262b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b09d80 0x55a345f177b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1267865670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b01ba0 0x55a345f0fd80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b4effd640 0 client.5661 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1267865670 >> 172.21.15.146:0/1267865670 conn(0x55a345b1ebb0 msgr2=0x55a345eca990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1267865670 shutdown_connections 2024-09-17T03:35:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1267865670 wait complete. 2024-09-17T03:35:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.036+0000 7f2b7d45f740 20 client.5661 trim_cache size 0 max 16384 2024-09-17T03:35:46.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.051+0000 7f2b7d45f740 1 Processor -- start 2024-09-17T03:35:46.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.051+0000 7f2b7d45f740 1 -- start start 2024-09-17T03:35:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.052+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b01ba0 0x55a345ecab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.052+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b09d80 0x55a345f38c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.052+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b2aa60 0x55a345f39170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.052+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70200310 con 0x55a345b09d80 2024-09-17T03:35:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.052+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7009ce60 con 0x55a345b2aa60 2024-09-17T03:35:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.052+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2b70147090 con 0x55a345b01ba0 2024-09-17T03:35:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.052+0000 7f2b6f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b09d80 0x55a345f38c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.052+0000 7f2b6f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b09d80 0x55a345f38c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39468/0 (socket says 172.21.15.146:39468) 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.052+0000 7f2b6f7fe640 1 -- 172.21.15.146:0/1602649524 learned_addr learned my addr 172.21.15.146:0/1602649524 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b74a8f640 1 --2- 172.21.15.146:0/1602649524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b2aa60 0x55a345f39170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/1602649524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b01ba0 0x55a345ecab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b6f7fe640 1 -- 172.21.15.146:0/1602649524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b01ba0 msgr2=0x55a345ecab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/1602649524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b01ba0 0x55a345ecab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b6f7fe640 1 -- 172.21.15.146:0/1602649524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b2aa60 msgr2=0x55a345f39170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/1602649524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b2aa60 0x55a345f39170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b6f7fe640 1 -- 172.21.15.146:0/1602649524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a345c0eed0 con 0x55a345b09d80 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/1602649524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b01ba0 0x55a345ecab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b74a8f640 1 --2- 172.21.15.146:0/1602649524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b2aa60 0x55a345f39170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/1602649524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b09d80 0x55a345f38c30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2b64001550 tx=0x7f2b64015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbe17ce55235564 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b557fa640 1 -- 172.21.15.146:0/1602649524 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6401b040 con 0x55a345b09d80 2024-09-17T03:35:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b557fa640 1 -- 172.21.15.146:0/1602649524 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b6401c040 con 0x55a345b09d80 2024-09-17T03:35:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.053+0000 7f2b557fa640 1 -- 172.21.15.146:0/1602649524 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b64024cc0 con 0x55a345b09d80 2024-09-17T03:35:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.054+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1602649524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b09d80 msgr2=0x55a345f38c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.054+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1602649524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b09d80 0x55a345f38c30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2b64001550 tx=0x7f2b64015000 comp rx=0 tx=0).stop 2024-09-17T03:35:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.054+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1602649524 shutdown_connections 2024-09-17T03:35:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.054+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1602649524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b2aa60 0x55a345f39170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.054+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1602649524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b09d80 0x55a345f38c30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.054+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1602649524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b01ba0 0x55a345ecab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.054+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1602649524 >> 172.21.15.146:0/1602649524 conn(0x55a345b1ebb0 msgr2=0x55a345ecffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.054+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1602649524 shutdown_connections 2024-09-17T03:35:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.054+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1602649524 wait complete. 2024-09-17T03:35:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.055+0000 7f2b7d45f740 1 -- start start 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.055+0000 7f2b7d45f740 1 Processor -- start 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b01ba0 0x55a345f0b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b09d80 0x55a345f92680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b7d45f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345f95850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a345f26d60 con 0x55a345b2aa60 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7009c810 con 0x55a345b01ba0 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b7d45f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a345f0be50 con 0x55a345b09d80 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b7d45f740 10 client.0 _ll_register_callbacks cb 0x7f2b60089070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b74a8f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345f95850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b74a8f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345f95850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39484/0 (socket says 172.21.15.146:39484) 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b74a8f640 1 -- 172.21.15.146:0/1951291174 learned_addr learned my addr 172.21.15.146:0/1951291174 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b01ba0 0x55a345f0b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.056+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b09d80 0x55a345f92680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b74a8f640 1 -- 172.21.15.146:0/1951291174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b09d80 msgr2=0x55a345f92680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b74a8f640 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b09d80 0x55a345f92680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b74a8f640 1 -- 172.21.15.146:0/1951291174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b01ba0 msgr2=0x55a345f0b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b74a8f640 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b01ba0 0x55a345f0b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b74a8f640 1 -- 172.21.15.146:0/1951291174 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a345df9c80 con 0x55a345b2aa60 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b01ba0 0x55a345f0b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b74a8f640 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345f95850 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2b68005fd0 tx=0x7f2b68004110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d52e9032734e7b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b4effd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b4effd640 1 -- 172.21.15.146:0/1951291174 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b680046c0 con 0x55a345b2aa60 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b4effd640 1 -- 172.21.15.146:0/1951291174 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f2b68031440 con 0x55a345b2aa60 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1951291174 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b6401c040 con 0x55a345b2aa60 2024-09-17T03:35:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b4effd640 1 -- 172.21.15.146:0/1951291174 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2b68052050 con 0x55a345b2aa60 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b7d45f740 10 client.5667 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1951291174 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55a345f17840 con 0x55a345b2aa60 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b4effd640 1 -- 172.21.15.146:0/1951291174 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b6401c040 con 0x55a345b2aa60 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b4effd640 1 -- 172.21.15.146:0/1951291174 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f2b68055020 con 0x55a345b2aa60 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b7d45f740 10 client.5667 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b7d45f740 10 client.5667 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b7d45f740 20 client.5667 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a345ecba90 0x55a345f95d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b7d45f740 4 client.5667 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.057+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1951291174 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x55a345e425d0 con 0x55a345ecba90 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.058+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a345ecba90 0x55a345f95d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.058+0000 7f2b4effd640 10 client.5667 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.058+0000 7f2b6ffff640 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a345ecba90 0x55a345f95d90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=756d05b8bb73132c server_cookie=dbdb9477ea75c4b2 in_seq=0 out_seq=0 2024-09-17T03:35:46.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.061+0000 7f2b4effd640 1 -- 172.21.15.146:0/1951291174 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a345e425d0 con 0x55a345ecba90 2024-09-17T03:35:46.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.061+0000 7f2b4effd640 10 client.5667 handle_command_reply: tid=0 2024-09-17T03:35:46.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.061+0000 7f2b7d45f740 1 client.5667 shutdown 2024-09-17T03:35:46.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1951291174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 msgr2=0x55a345f95850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345f95850 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2b68005fd0 tx=0x7f2b68004110 comp rx=0 tx=0).stop 2024-09-17T03:35:46.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1951291174 shutdown_connections 2024-09-17T03:35:46.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a345ecba90 0x55a345f95d90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a345b2aa60 0x55a345f95850 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b4effd640 0 client.5667 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a345b09d80 0x55a345f92680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b7d45f740 1 --2- 172.21.15.146:0/1951291174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a345b01ba0 0x55a345f0b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1951291174 >> 172.21.15.146:0/1951291174 conn(0x55a345b1ebb0 msgr2=0x55a345ecffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1951291174 shutdown_connections 2024-09-17T03:35:46.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b7d45f740 1 -- 172.21.15.146:0/1951291174 wait complete. 2024-09-17T03:35:46.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b7d45f740 20 client.5667 trim_cache size 0 max 16384 2024-09-17T03:35:46.064 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:46.064 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:35:46.064 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:35:46.064 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:46.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b764f2640 1 -- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b5c078b90 msgr2=0x7f2b5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b764f2640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b5c078b90 0x7f2b5c07b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2b7009d7b0 tx=0x7f2b64007e90 comp rx=0 tx=0).stop 2024-09-17T03:35:46.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b764f2640 1 -- 172.21.15.146:0/3330425417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700b5750 msgr2=0x7f2b701f70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b764f2640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700b5750 0x7f2b701f70f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000d740 tx=0x7f2b6000dc00 comp rx=0 tx=0).stop 2024-09-17T03:35:46.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b764f2640 1 -- 172.21.15.146:0/3330425417 shutdown_connections 2024-09-17T03:35:46.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b764f2640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b5c078b90 0x7f2b5c07b0a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b764f2640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b7015f410 0x7f2b701f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b764f2640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b700b5ce0 0x7f2b7015eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b764f2640 1 --2- 172.21.15.146:0/3330425417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700b5750 0x7f2b701f70f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.062+0000 7f2b764f2640 1 -- 172.21.15.146:0/3330425417 >> 172.21.15.146:0/3330425417 conn(0x7f2b700b7b20 msgr2=0x7f2b700b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.063+0000 7f2b764f2640 1 -- 172.21.15.146:0/3330425417 shutdown_connections 2024-09-17T03:35:46.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.063+0000 7f2b764f2640 1 -- 172.21.15.146:0/3330425417 wait complete. 2024-09-17T03:35:46.072 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'message': '', 'return_code': 0}' 2024-09-17T03:35:46.072 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-17T03:35:46.073 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-17T03:35:46.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.190+0000 7f7eb2f20640 1 -- 172.21.15.146:0/2489834640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eac0b4510 msgr2=0x7f7eac070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.190+0000 7f7eb2f20640 1 --2- 172.21.15.146:0/2489834640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eac0b4510 0x7f7eac070010 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4005fd0 tx=0x7f7ea402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.190+0000 7f7eb2f20640 1 -- 172.21.15.146:0/2489834640 shutdown_connections 2024-09-17T03:35:46.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.190+0000 7f7eb2f20640 1 --2- 172.21.15.146:0/2489834640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eac0b4510 0x7f7eac070010 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.190+0000 7f7eb2f20640 1 --2- 172.21.15.146:0/2489834640 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eac0b4100 0x7f7eac06fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.190+0000 7f7eb2f20640 1 -- 172.21.15.146:0/2489834640 >> 172.21.15.146:0/2489834640 conn(0x7f7eac06d3c0 msgr2=0x7f7eac0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.190+0000 7f7eb2f20640 1 -- 172.21.15.146:0/2489834640 shutdown_connections 2024-09-17T03:35:46.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.190+0000 7f7eb2f20640 1 -- 172.21.15.146:0/2489834640 wait complete. 2024-09-17T03:35:46.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.191+0000 7f7eb2f20640 1 Processor -- start 2024-09-17T03:35:46.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.191+0000 7f7eb2f20640 1 -- start start 2024-09-17T03:35:46.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb2f20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eac0b4100 0x7f7eac1467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb2f20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7eac0b4510 0x7f7eac1f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb2f20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eac14d890 0x7f7eac1f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb2f20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac0d0770 con 0x7f7eac14d890 2024-09-17T03:35:46.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb2f20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac0d05f0 con 0x7f7eac0b4510 2024-09-17T03:35:46.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb2f20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7eac0d08f0 con 0x7f7eac0b4100 2024-09-17T03:35:46.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb14bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eac14d890 0x7f7eac1f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb14bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eac14d890 0x7f7eac1f7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39500/0 (socket says 172.21.15.146:39500) 2024-09-17T03:35:46.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb14bd640 1 -- 172.21.15.146:0/3894464486 learned_addr learned my addr 172.21.15.146:0/3894464486 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eac0b4100 0x7f7eac1467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eabfff640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7eac0b4510 0x7f7eac1f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb14bd640 1 -- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eac0b4100 msgr2=0x7f7eac1467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb14bd640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eac0b4100 0x7f7eac1467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb14bd640 1 -- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7eac0b4510 msgr2=0x7f7eac1f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb14bd640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7eac0b4510 0x7f7eac1f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.193+0000 7f7eb14bd640 1 -- 172.21.15.146:0/3894464486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac1535d0 con 0x7f7eac14d890 2024-09-17T03:35:46.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.194+0000 7f7eb14bd640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eac14d890 0x7f7eac1f7110 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009cd0 tx=0x7f7ea4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.194+0000 7f7ea97fa640 1 -- 172.21.15.146:0/3894464486 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4031b90 con 0x7f7eac14d890 2024-09-17T03:35:46.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.194+0000 7f7ea97fa640 1 -- 172.21.15.146:0/3894464486 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ea4031e20 con 0x7f7eac14d890 2024-09-17T03:35:46.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.194+0000 7f7ea97fa640 1 -- 172.21.15.146:0/3894464486 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4033310 con 0x7f7eac14d890 2024-09-17T03:35:46.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.194+0000 7f7eb2f20640 1 -- 172.21.15.146:0/3894464486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eac1538b0 con 0x7f7eac14d890 2024-09-17T03:35:46.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.194+0000 7f7eb2f20640 1 -- 172.21.15.146:0/3894464486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eac153e70 con 0x7f7eac14d890 2024-09-17T03:35:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.196+0000 7f7ea97fa640 1 -- 172.21.15.146:0/3894464486 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ea4031660 con 0x7f7eac14d890 2024-09-17T03:35:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.197+0000 7f7ea97fa640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078b90 0x7f7e9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.197+0000 7f7ea97fa640 1 -- 172.21.15.146:0/3894464486 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f7ea40bc1e0 con 0x7f7eac14d890 2024-09-17T03:35:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.197+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078b90 0x7f7e9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.197+0000 7f7eb9e8f740 1 Processor -- start 2024-09-17T03:35:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.197+0000 7f7eb9e8f740 1 -- start start 2024-09-17T03:35:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.197+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078b90 0x7f7e9807b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c000f60 tx=0x7f7e9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717fc00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717ba8bd0 0x557717fa2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fa32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557717eebf20 con 0x557717bd1a90 2024-09-17T03:35:46.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557717edb350 con 0x557717ba8bd0 2024-09-17T03:35:46.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x557717edf160 con 0x557717bb0db0 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb0cbc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717fc00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb0cbc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717fc00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39504/0 (socket says 172.21.15.146:39504) 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/3109917708 learned_addr learned my addr 172.21.15.146:0/3109917708 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eabfff640 1 --2- 172.21.15.146:0/3109917708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717ba8bd0 0x557717fa2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb14bd640 1 --2- 172.21.15.146:0/3109917708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fa32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/3109917708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 msgr2=0x557717fa32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/3109917708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fa32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/3109917708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717ba8bd0 msgr2=0x557717fa2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/3109917708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717ba8bd0 0x557717fa2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/3109917708 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557717e87660 con 0x557717bd1a90 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eabfff640 1 --2- 172.21.15.146:0/3109917708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717ba8bd0 0x557717fa2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:46.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/3109917708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717fc00d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00f9e0 tx=0x7f7e9c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361037a56d2a8118 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7e927fc640 1 -- 172.21.15.146:0/3109917708 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c025070 con 0x557717bd1a90 2024-09-17T03:35:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7e927fc640 1 -- 172.21.15.146:0/3109917708 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e9c01b050 con 0x557717bd1a90 2024-09-17T03:35:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.199+0000 7f7e927fc640 1 -- 172.21.15.146:0/3109917708 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c014de0 con 0x557717bd1a90 2024-09-17T03:35:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.200+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3109917708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 msgr2=0x557717fc00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.200+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/3109917708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717fc00d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00f9e0 tx=0x7f7e9c012000 comp rx=0 tx=0).stop 2024-09-17T03:35:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.200+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3109917708 shutdown_connections 2024-09-17T03:35:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.200+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/3109917708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fa32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.200+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/3109917708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717ba8bd0 0x557717fa2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.200+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/3109917708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717fc00d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.200+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3109917708 >> 172.21.15.146:0/3109917708 conn(0x557717bc5be0 msgr2=0x557717f78fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.200+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3109917708 shutdown_connections 2024-09-17T03:35:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.200+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3109917708 wait complete. 2024-09-17T03:35:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.201+0000 7f7eb9e8f740 1 -- start start 2024-09-17T03:35:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.201+0000 7f7eb9e8f740 1 Processor -- start 2024-09-17T03:35:46.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717ba8bd0 0x557717fcda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717f9c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557717c4be40 con 0x557717bd1a90 2024-09-17T03:35:46.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557717e80850 con 0x557717ba8bd0 2024-09-17T03:35:46.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x557717fceab0 con 0x557717bb0db0 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb9e8f740 10 client.0 _ll_register_callbacks cb 0x557717ed45d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb14bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717f9c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb14bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717f9c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39522/0 (socket says 172.21.15.146:39522) 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb14bd640 1 -- 172.21.15.146:0/3096071675 learned_addr learned my addr 172.21.15.146:0/3096071675 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717ba8bd0 0x557717fcda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eabfff640 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb14bd640 1 -- 172.21.15.146:0/3096071675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 msgr2=0x557717fce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb14bd640 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb14bd640 1 -- 172.21.15.146:0/3096071675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717ba8bd0 msgr2=0x557717fcda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb14bd640 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717ba8bd0 0x557717fcda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb14bd640 1 -- 172.21.15.146:0/3096071675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557717cb5f00 con 0x557717bd1a90 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eabfff640 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:46.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb14bd640 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717f9c2d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4083d90 tx=0x7f7ea4084660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6f2cec1220807b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7e8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/3096071675 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4083800 con 0x557717bd1a90 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/3096071675 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f7ea408d470 con 0x557717bd1a90 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.203+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3096071675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e9c01b050 con 0x557717bd1a90 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/3096071675 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7ea40a3050 con 0x557717bd1a90 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7eb9e8f740 10 client.5682 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3096071675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x557717c1ada0 con 0x557717bd1a90 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/3096071675 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e9c01b050 con 0x557717bd1a90 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/3096071675 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f7ea404b030 con 0x557717bd1a90 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7eb9e8f740 10 client.5682 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7eb9e8f740 10 client.5682 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7eb9e8f740 20 client.5682 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557717b90660 0x557717fb8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7eb9e8f740 4 client.5682 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3096071675 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557717eede70 con 0x557717b90660 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557717b90660 0x557717fb8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7e8b7fe640 10 client.5682 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.204+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557717b90660 0x557717fb8640 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bccb46a497f0474 server_cookie=106006255ee749ca in_seq=0 out_seq=0 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/3096071675 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557717eede70 con 0x557717b90660 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7e8b7fe640 10 client.5682 handle_command_reply: tid=0 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7eb9e8f740 1 client.5682 shutdown 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3096071675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 msgr2=0x557717f9c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717f9c2d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4083d90 tx=0x7f7ea4084660 comp rx=0 tx=0).stop 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3096071675 shutdown_connections 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557717b90660 0x557717fb8640 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717bd1a90 0x557717f9c2d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7e8b7fe640 0 client.5682 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/3096071675 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717ba8bd0 0x557717fcda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3096071675 >> 172.21.15.146:0/3096071675 conn(0x557717bc5be0 msgr2=0x557717f72330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3096071675 shutdown_connections 2024-09-17T03:35:46.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.205+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/3096071675 wait complete. 2024-09-17T03:35:46.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.206+0000 7f7eb9e8f740 20 client.5682 trim_cache size 0 max 16384 2024-09-17T03:35:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.223+0000 7f7eb9e8f740 1 Processor -- start 2024-09-17T03:35:46.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.223+0000 7f7eb9e8f740 1 -- start start 2024-09-17T03:35:46.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.224+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x557717f9c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.224+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717bb0db0 0x557717fbe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bd1a90 0x557717fbe640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac1fff80 con 0x557717ba8bd0 2024-09-17T03:35:46.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac1fefb0 con 0x557717bb0db0 2024-09-17T03:35:46.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7eac1f5000 con 0x557717bd1a90 2024-09-17T03:35:46.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb0cbc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x557717f9c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb0cbc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x557717f9c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39524/0 (socket says 172.21.15.146:39524) 2024-09-17T03:35:46.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/1036050537 learned_addr learned my addr 172.21.15.146:0/1036050537 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/1036050537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bd1a90 msgr2=0x557717fbe640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/1036050537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bd1a90 0x557717fbe640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/1036050537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717bb0db0 msgr2=0x557717fbe100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/1036050537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717bb0db0 0x557717fbe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/1036050537 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557717d16690 con 0x557717ba8bd0 2024-09-17T03:35:46.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/1036050537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x557717f9c2b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c014820 tx=0x7f7e9c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30090cc704283b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7e91ffb640 1 -- 172.21.15.146:0/1036050537 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c025040 con 0x557717ba8bd0 2024-09-17T03:35:46.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7e91ffb640 1 -- 172.21.15.146:0/1036050537 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e9c01b040 con 0x557717ba8bd0 2024-09-17T03:35:46.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.225+0000 7f7e91ffb640 1 -- 172.21.15.146:0/1036050537 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c035980 con 0x557717ba8bd0 2024-09-17T03:35:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.226+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/1036050537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 msgr2=0x557717f9c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.226+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/1036050537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x557717f9c2b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c014820 tx=0x7f7e9c001080 comp rx=0 tx=0).stop 2024-09-17T03:35:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.226+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/1036050537 shutdown_connections 2024-09-17T03:35:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.226+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/1036050537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bd1a90 0x557717fbe640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.226+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/1036050537 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717bb0db0 0x557717fbe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.226+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/1036050537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x557717f9c2b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.226+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/1036050537 >> 172.21.15.146:0/1036050537 conn(0x557717bc5be0 msgr2=0x557717f6ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.226+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/1036050537 shutdown_connections 2024-09-17T03:35:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.226+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/1036050537 wait complete. 2024-09-17T03:35:46.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.227+0000 7f7eb9e8f740 1 -- start start 2024-09-17T03:35:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.227+0000 7f7eb9e8f740 1 Processor -- start 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.228+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x55771803a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.228+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fbe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.228+0000 7f7eb9e8f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717bd1a90 0x557717fbe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.228+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557717fc1cb0 con 0x557717ba8bd0 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.228+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac1f5650 con 0x557717bd1a90 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.228+0000 7f7eb9e8f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x557717fcd560 con 0x557717bb0db0 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb9e8f740 10 client.0 _ll_register_callbacks cb 0x7f7ea408b0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb0cbc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x55771803a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb0cbc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x55771803a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39526/0 (socket says 172.21.15.146:39526) 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/42464974 learned_addr learned my addr 172.21.15.146:0/42464974 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eabfff640 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fbe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb14bd640 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717bd1a90 0x557717fbe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/42464974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 msgr2=0x557717fbe2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fbe2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/42464974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717bd1a90 msgr2=0x557717fbe7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717bd1a90 0x557717fbe7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb0cbc640 1 -- 172.21.15.146:0/42464974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557717cb4200 con 0x557717ba8bd0 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb0cbc640 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x55771803a5c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0015b0 tx=0x7f7e9c035540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf1ef38815cd3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7e8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/42464974 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c031030 con 0x557717ba8bd0 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/42464974 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f7e9c035c90 con 0x557717ba8bd0 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/42464974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e9c01b040 con 0x557717ba8bd0 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/42464974 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7e9c045050 con 0x557717ba8bd0 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb9e8f740 10 client.5688 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/42464974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55771803e030 con 0x557717ba8bd0 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.229+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/42464974 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e9c01b040 con 0x557717ba8bd0 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.230+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/42464974 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f7e9c048020 con 0x557717ba8bd0 2024-09-17T03:35:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.230+0000 7f7eb9e8f740 10 client.5688 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.230+0000 7f7eb9e8f740 10 client.5688 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.230+0000 7f7eb9e8f740 20 client.5688 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.230+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557717fccee0 0x557717fc1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.230+0000 7f7eb9e8f740 4 client.5688 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.230+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/42464974 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x557717f74f20 con 0x557717fccee0 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.230+0000 7f7eabfff640 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557717fccee0 0x557717fc1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.230+0000 7f7e8b7fe640 10 client.5688 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.230+0000 7f7eabfff640 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557717fccee0 0x557717fc1800 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38100578677250a server_cookie=d71042317c95e3e6 in_seq=0 out_seq=0 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/42464974 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557717f74f20 con 0x557717fccee0 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7e8b7fe640 10 client.5688 handle_command_reply: tid=0 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7eb9e8f740 1 client.5688 shutdown 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/42464974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 msgr2=0x55771803a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x55771803a5c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0015b0 tx=0x7f7e9c035540 comp rx=0 tx=0).stop 2024-09-17T03:35:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/42464974 shutdown_connections 2024-09-17T03:35:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557717fccee0 0x557717fc1800 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7e8b7fe640 0 client.5688 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557717bd1a90 0x557717fbe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557717bb0db0 0x557717fbe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7eb9e8f740 1 --2- 172.21.15.146:0/42464974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557717ba8bd0 0x55771803a5c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.231+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/42464974 >> 172.21.15.146:0/42464974 conn(0x557717bc5be0 msgr2=0x557717f6ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/42464974 shutdown_connections 2024-09-17T03:35:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb9e8f740 1 -- 172.21.15.146:0/42464974 wait complete. 2024-09-17T03:35:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb9e8f740 20 client.5688 trim_cache size 0 max 16384 2024-09-17T03:35:46.238 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:46.238 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:35:46.238 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "d88b3f93-07b9-4851-80e0-841d2041b343", 2024-09-17T03:35:46.238 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:35:46.238 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:46.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 -- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078b90 msgr2=0x7f7e9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078b90 0x7f7e9807b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c000f60 tx=0x7f7e9c009040 comp rx=0 tx=0).stop 2024-09-17T03:35:46.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 -- 172.21.15.146:0/3894464486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eac14d890 msgr2=0x7f7eac1f7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eac14d890 0x7f7eac1f7110 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009cd0 tx=0x7f7ea4003ba0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 -- 172.21.15.146:0/3894464486 shutdown_connections 2024-09-17T03:35:46.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078b90 0x7f7e9807b0a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eac14d890 0x7f7eac1f7110 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7eac0b4510 0x7f7eac1f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 --2- 172.21.15.146:0/3894464486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eac0b4100 0x7f7eac1467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 -- 172.21.15.146:0/3894464486 >> 172.21.15.146:0/3894464486 conn(0x7f7eac06d3c0 msgr2=0x7f7eac072c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 -- 172.21.15.146:0/3894464486 shutdown_connections 2024-09-17T03:35:46.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.232+0000 7f7eb2f20640 1 -- 172.21.15.146:0/3894464486 wait complete. 2024-09-17T03:35:46.243 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': 'd88b3f93-07b9-4851-80e0-841d2041b343', 'mode': 'asynchronous'}' 2024-09-17T03:35:46.243 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-09-17T03:35:46.243 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-17T03:35:46.243 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-17T03:35:46.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.376+0000 7f147a0e5640 1 -- 172.21.15.146:0/2583160336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1460003fd0 msgr2=0x7f1460004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.376+0000 7f147a0e5640 1 --2- 172.21.15.146:0/2583160336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1460003fd0 0x7f1460004800 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f145c001050 tx=0x7f1460005830 comp rx=0 tx=0).stop 2024-09-17T03:35:46.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.376+0000 7f1473fff640 1 -- 172.21.15.146:0/2583160336 reap_dead start 2024-09-17T03:35:46.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.376+0000 7f147a0e5640 1 -- 172.21.15.146:0/2583160336 shutdown_connections 2024-09-17T03:35:46.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.376+0000 7f147a0e5640 1 -- 172.21.15.146:0/2583160336 >> 172.21.15.146:0/2583160336 conn(0x7f14740d11f0 msgr2=0x7f14740d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.376+0000 7f147a0e5640 1 -- 172.21.15.146:0/2583160336 shutdown_connections 2024-09-17T03:35:46.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.376+0000 7f147a0e5640 1 -- 172.21.15.146:0/2583160336 wait complete. 2024-09-17T03:35:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.378+0000 7f147a0e5640 1 Processor -- start 2024-09-17T03:35:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.378+0000 7f147a0e5640 1 -- start start 2024-09-17T03:35:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f147a0e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1460003fd0 0x7f14740cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f147a0e5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1474156df0 0x7f147414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f147a0e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147414de90 0x7f14740cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f147a0e5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f14740d0030 con 0x7f1474156df0 2024-09-17T03:35:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f147a0e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14740cfeb0 con 0x7f147414de90 2024-09-17T03:35:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f147a0e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f14740d01b0 con 0x7f1460003fd0 2024-09-17T03:35:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f1472ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1474156df0 0x7f147414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f1472ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1474156df0 0x7f147414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39540/0 (socket says 172.21.15.146:39540) 2024-09-17T03:35:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f1472ffd640 1 -- 172.21.15.146:0/3549901593 learned_addr learned my addr 172.21.15.146:0/3549901593 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f1472ffd640 1 -- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1460003fd0 msgr2=0x7f14740cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f1472ffd640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1460003fd0 0x7f14740cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f1472ffd640 1 -- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147414de90 msgr2=0x7f14740cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f1472ffd640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147414de90 0x7f14740cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f1472ffd640 1 -- 172.21.15.146:0/3549901593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14740cc980 con 0x7f1474156df0 2024-09-17T03:35:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f1472ffd640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1474156df0 0x7f147414d950 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f145c000f60 tx=0x7f145c006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f146bfff640 1 -- 172.21.15.146:0/3549901593 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c039070 con 0x7f1474156df0 2024-09-17T03:35:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f146bfff640 1 -- 172.21.15.146:0/3549901593 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f145c02b620 con 0x7f1474156df0 2024-09-17T03:35:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f147a0e5640 1 -- 172.21.15.146:0/3549901593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14740ccc60 con 0x7f1474156df0 2024-09-17T03:35:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f146bfff640 1 -- 172.21.15.146:0/3549901593 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c02ba30 con 0x7f1474156df0 2024-09-17T03:35:46.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.380+0000 7f147a0e5640 1 -- 172.21.15.146:0/3549901593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14740cd220 con 0x7f1474156df0 2024-09-17T03:35:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.382+0000 7f146bfff640 1 -- 172.21.15.146:0/3549901593 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f145c02bbd0 con 0x7f1474156df0 2024-09-17T03:35:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.383+0000 7f146bfff640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1454078b90 0x7f145407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.383+0000 7f146bfff640 1 -- 172.21.15.146:0/3549901593 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f145c0bacc0 con 0x7f1474156df0 2024-09-17T03:35:46.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.383+0000 7f14737fe640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1454078b90 0x7f145407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.383+0000 7f14737fe640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1454078b90 0x7f145407b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1464009ab0 tx=0x7f1464009390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.384+0000 7f1481055740 1 Processor -- start 2024-09-17T03:35:46.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.384+0000 7f1481055740 1 -- start start 2024-09-17T03:35:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.385+0000 7f1481055740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aaf1e0 0x559a55e81090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.385+0000 7f1481055740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a86320 0x559a55e815d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.385+0000 7f1481055740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a8e500 0x559a55e9e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.385+0000 7f1481055740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559a55dc98f0 con 0x559a55aaf1e0 2024-09-17T03:35:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.385+0000 7f1481055740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559a55db8d20 con 0x559a55a8e500 2024-09-17T03:35:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.385+0000 7f1481055740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x559a55dbcb30 con 0x559a55a86320 2024-09-17T03:35:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.385+0000 7f14737fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aaf1e0 0x559a55e81090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.385+0000 7f14737fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aaf1e0 0x559a55e81090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39556/0 (socket says 172.21.15.146:39556) 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.385+0000 7f14737fe640 1 -- 172.21.15.146:0/2040801082 learned_addr learned my addr 172.21.15.146:0/2040801082 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.386+0000 7f1472ffd640 1 --2- 172.21.15.146:0/2040801082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a86320 0x559a55e815d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.386+0000 7f1473fff640 1 --2- 172.21.15.146:0/2040801082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a8e500 0x559a55e9e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.386+0000 7f14737fe640 1 -- 172.21.15.146:0/2040801082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a86320 msgr2=0x559a55e815d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.386+0000 7f14737fe640 1 --2- 172.21.15.146:0/2040801082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a86320 0x559a55e815d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.386+0000 7f14737fe640 1 -- 172.21.15.146:0/2040801082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a8e500 msgr2=0x559a55e9e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.386+0000 7f14737fe640 1 --2- 172.21.15.146:0/2040801082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a8e500 0x559a55e9e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.386+0000 7f14737fe640 1 -- 172.21.15.146:0/2040801082 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a55b1a7c0 con 0x559a55aaf1e0 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.386+0000 7f14737fe640 1 --2- 172.21.15.146:0/2040801082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aaf1e0 0x559a55e81090 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1464009430 tx=0x7f1464014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf9d9ddbab90754 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.386+0000 7f14697fa640 1 -- 172.21.15.146:0/2040801082 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464003b70 con 0x559a55aaf1e0 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.386+0000 7f14697fa640 1 -- 172.21.15.146:0/2040801082 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1464003d10 con 0x559a55aaf1e0 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.386+0000 7f14697fa640 1 -- 172.21.15.146:0/2040801082 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146401e680 con 0x559a55aaf1e0 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.387+0000 7f1481055740 1 -- 172.21.15.146:0/2040801082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aaf1e0 msgr2=0x559a55e81090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.387+0000 7f1481055740 1 --2- 172.21.15.146:0/2040801082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aaf1e0 0x559a55e81090 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1464009430 tx=0x7f1464014000 comp rx=0 tx=0).stop 2024-09-17T03:35:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.387+0000 7f1481055740 1 -- 172.21.15.146:0/2040801082 shutdown_connections 2024-09-17T03:35:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.387+0000 7f1481055740 1 --2- 172.21.15.146:0/2040801082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a8e500 0x559a55e9e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.387+0000 7f1481055740 1 --2- 172.21.15.146:0/2040801082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a86320 0x559a55e815d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.387+0000 7f1481055740 1 --2- 172.21.15.146:0/2040801082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aaf1e0 0x559a55e81090 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.387+0000 7f1481055740 1 -- 172.21.15.146:0/2040801082 >> 172.21.15.146:0/2040801082 conn(0x559a55aa3330 msgr2=0x559a55e57350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.387+0000 7f1481055740 1 -- 172.21.15.146:0/2040801082 shutdown_connections 2024-09-17T03:35:46.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.387+0000 7f1481055740 1 -- 172.21.15.146:0/2040801082 wait complete. 2024-09-17T03:35:46.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.388+0000 7f1481055740 1 -- start start 2024-09-17T03:35:46.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.388+0000 7f1481055740 1 Processor -- start 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.389+0000 7f1481055740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a86320 0x559a55e6ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.389+0000 7f1481055740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a8e500 0x559a55e80160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.389+0000 7f1481055740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55aaf1e0 0x559a55e806a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.389+0000 7f1481055740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559a55b29590 con 0x559a55a86320 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.389+0000 7f1481055740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559a55d5e6c0 con 0x559a55aaf1e0 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.389+0000 7f1481055740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x559a55e81b10 con 0x559a55a8e500 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.389+0000 7f1481055740 10 client.0 _ll_register_callbacks cb 0x559a55d62170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.389+0000 7f14737fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a86320 0x559a55e6ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.389+0000 7f14737fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a86320 0x559a55e6ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39572/0 (socket says 172.21.15.146:39572) 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.389+0000 7f14737fe640 1 -- 172.21.15.146:0/1694201139 learned_addr learned my addr 172.21.15.146:0/1694201139 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.389+0000 7f1472ffd640 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a8e500 0x559a55e80160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f1473fff640 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55aaf1e0 0x559a55e806a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14737fe640 1 -- 172.21.15.146:0/1694201139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a8e500 msgr2=0x559a55e80160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14737fe640 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a8e500 0x559a55e80160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14737fe640 1 -- 172.21.15.146:0/1694201139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55aaf1e0 msgr2=0x559a55e806a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14737fe640 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55aaf1e0 0x559a55e806a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14737fe640 1 -- 172.21.15.146:0/1694201139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a55b91620 con 0x559a55a86320 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14737fe640 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a86320 0x559a55e6ca80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1464009400 tx=0x7f1464026b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672046ab5380e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14527fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14527fc640 1 -- 172.21.15.146:0/1694201139 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464003b70 con 0x559a55a86320 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14527fc640 1 -- 172.21.15.146:0/1694201139 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f146401e630 con 0x559a55a86320 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f1481055740 1 -- 172.21.15.146:0/1694201139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1464003d10 con 0x559a55a86320 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14527fc640 1 -- 172.21.15.146:0/1694201139 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1464038050 con 0x559a55a86320 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f1481055740 10 client.5700 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f1481055740 1 -- 172.21.15.146:0/1694201139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x559a55e6cfc0 con 0x559a55a86320 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14527fc640 1 -- 172.21.15.146:0/1694201139 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1464003d10 con 0x559a55a86320 2024-09-17T03:35:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f14527fc640 1 -- 172.21.15.146:0/1694201139 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f146403b020 con 0x559a55a86320 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f1481055740 10 client.5700 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f1481055740 10 client.5700 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f1481055740 20 client.5700 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.390+0000 7f1481055740 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x559a55a6dfc0 0x559a55e6ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.391+0000 7f1481055740 4 client.5700 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.391+0000 7f1481055740 1 -- 172.21.15.146:0/1694201139 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a55dcb840 con 0x559a55a6dfc0 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.391+0000 7f1472ffd640 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x559a55a6dfc0 0x559a55e6ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.391+0000 7f14527fc640 10 client.5700 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.391+0000 7f1472ffd640 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x559a55a6dfc0 0x559a55e6ed20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=574b9ac26c0da3dd server_cookie=20bb0b84acf6c6ac in_seq=0 out_seq=0 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f14527fc640 1 -- 172.21.15.146:0/1694201139 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a55dcb840 con 0x559a55a6dfc0 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f14527fc640 10 client.5700 handle_command_reply: tid=0 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 1 client.5700 shutdown 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 1 -- 172.21.15.146:0/1694201139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a86320 msgr2=0x559a55e6ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a86320 0x559a55e6ca80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1464009400 tx=0x7f1464026b70 comp rx=0 tx=0).stop 2024-09-17T03:35:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 1 -- 172.21.15.146:0/1694201139 shutdown_connections 2024-09-17T03:35:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x559a55a6dfc0 0x559a55e6ed20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f14527fc640 0 client.5700 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55aaf1e0 0x559a55e806a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a8e500 0x559a55e80160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 1 --2- 172.21.15.146:0/1694201139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a86320 0x559a55e6ca80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 1 -- 172.21.15.146:0/1694201139 >> 172.21.15.146:0/1694201139 conn(0x559a55aa3330 msgr2=0x559a55e51bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 1 -- 172.21.15.146:0/1694201139 shutdown_connections 2024-09-17T03:35:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 1 -- 172.21.15.146:0/1694201139 wait complete. 2024-09-17T03:35:46.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.392+0000 7f1481055740 20 client.5700 trim_cache size 0 max 16384 2024-09-17T03:35:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.409+0000 7f1481055740 1 Processor -- start 2024-09-17T03:35:46.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.409+0000 7f1481055740 1 -- start start 2024-09-17T03:35:46.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.410+0000 7f1481055740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55aa3330 0x559a55e95af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.410+0000 7f1481055740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a6dfc0 0x559a55ebea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.410+0000 7f1481055740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a86320 0x559a55ebefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.410+0000 7f1481055740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1474202a70 con 0x559a55a6dfc0 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.410+0000 7f1481055740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1474201ac0 con 0x559a55a86320 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.410+0000 7f1481055740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f14740ca7a0 con 0x559a55aa3330 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1472ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a6dfc0 0x559a55ebea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1472ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a6dfc0 0x559a55ebea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39574/0 (socket says 172.21.15.146:39574) 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1472ffd640 1 -- 172.21.15.146:0/2069434096 learned_addr learned my addr 172.21.15.146:0/2069434096 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f14737fe640 1 --2- 172.21.15.146:0/2069434096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55aa3330 0x559a55e95af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1473fff640 1 --2- 172.21.15.146:0/2069434096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a86320 0x559a55ebefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1472ffd640 1 -- 172.21.15.146:0/2069434096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55aa3330 msgr2=0x559a55e95af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1472ffd640 1 --2- 172.21.15.146:0/2069434096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55aa3330 0x559a55e95af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1472ffd640 1 -- 172.21.15.146:0/2069434096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a86320 msgr2=0x559a55ebefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1472ffd640 1 --2- 172.21.15.146:0/2069434096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a86320 0x559a55ebefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1472ffd640 1 -- 172.21.15.146:0/2069434096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a55e54ad0 con 0x559a55a6dfc0 2024-09-17T03:35:46.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f14737fe640 1 --2- 172.21.15.146:0/2069434096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55aa3330 0x559a55e95af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1472ffd640 1 --2- 172.21.15.146:0/2069434096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a6dfc0 0x559a55ebea90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f145c07fc30 tx=0x7f145c02b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8694751b5ed90064 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1468ff9640 1 -- 172.21.15.146:0/2069434096 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c0874a0 con 0x559a55a6dfc0 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1468ff9640 1 -- 172.21.15.146:0/2069434096 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f145c02f040 con 0x559a55a6dfc0 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.411+0000 7f1468ff9640 1 -- 172.21.15.146:0/2069434096 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c08c3e0 con 0x559a55a6dfc0 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.412+0000 7f1481055740 1 -- 172.21.15.146:0/2069434096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a6dfc0 msgr2=0x559a55ebea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.412+0000 7f1481055740 1 --2- 172.21.15.146:0/2069434096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a6dfc0 0x559a55ebea90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f145c07fc30 tx=0x7f145c02b280 comp rx=0 tx=0).stop 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.412+0000 7f1481055740 1 -- 172.21.15.146:0/2069434096 shutdown_connections 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.412+0000 7f1481055740 1 --2- 172.21.15.146:0/2069434096 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a86320 0x559a55ebefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.412+0000 7f1481055740 1 --2- 172.21.15.146:0/2069434096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55a6dfc0 0x559a55ebea90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.412+0000 7f1481055740 1 --2- 172.21.15.146:0/2069434096 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55aa3330 0x559a55e95af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.412+0000 7f1481055740 1 -- 172.21.15.146:0/2069434096 >> 172.21.15.146:0/2069434096 conn(0x559a55e921f0 msgr2=0x559a55e52fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.412+0000 7f1481055740 1 -- 172.21.15.146:0/2069434096 shutdown_connections 2024-09-17T03:35:46.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.412+0000 7f1481055740 1 -- 172.21.15.146:0/2069434096 wait complete. 2024-09-17T03:35:46.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.413+0000 7f1481055740 1 -- start start 2024-09-17T03:35:46.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.413+0000 7f1481055740 1 Processor -- start 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.414+0000 7f1481055740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a6dfc0 0x559a55ebedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.414+0000 7f1481055740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a86320 0x559a55ebf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.414+0000 7f1481055740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aa3330 0x559a55ebda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1481055740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f14742014a0 con 0x559a55aa3330 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1481055740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559a55ebeab0 con 0x559a55a6dfc0 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1481055740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x559a55f04c10 con 0x559a55a86320 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1481055740 10 client.0 _ll_register_callbacks cb 0x7f1464011c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1473fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aa3330 0x559a55ebda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1473fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aa3330 0x559a55ebda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39582/0 (socket says 172.21.15.146:39582) 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1473fff640 1 -- 172.21.15.146:0/3345368886 learned_addr learned my addr 172.21.15.146:0/3345368886 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f14737fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a6dfc0 0x559a55ebedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1472ffd640 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a86320 0x559a55ebf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1473fff640 1 -- 172.21.15.146:0/3345368886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a86320 msgr2=0x559a55ebf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1473fff640 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a86320 0x559a55ebf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1473fff640 1 -- 172.21.15.146:0/3345368886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a6dfc0 msgr2=0x559a55ebedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1473fff640 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a6dfc0 0x559a55ebedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1473fff640 1 -- 172.21.15.146:0/3345368886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a55f043f0 con 0x559a55aa3330 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f14737fe640 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a6dfc0 0x559a55ebedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1473fff640 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aa3330 0x559a55ebda80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f146c005fd0 tx=0x7f146c0044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd253266758e7875 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f14527fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f14527fc640 1 -- 172.21.15.146:0/3345368886 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c010ac0 con 0x559a55aa3330 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f14527fc640 1 -- 172.21.15.146:0/3345368886 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f146c010c60 con 0x559a55aa3330 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1481055740 1 -- 172.21.15.146:0/3345368886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f145c02f040 con 0x559a55aa3330 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f14527fc640 1 -- 172.21.15.146:0/3345368886 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f146c025050 con 0x559a55aa3330 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.415+0000 7f1481055740 10 client.5706 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f1481055740 1 -- 172.21.15.146:0/3345368886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x559a55e93d30 con 0x559a55aa3330 2024-09-17T03:35:46.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f14527fc640 1 -- 172.21.15.146:0/3345368886 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f145c02f040 con 0x559a55aa3330 2024-09-17T03:35:46.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f14527fc640 1 -- 172.21.15.146:0/3345368886 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f146c028020 con 0x559a55aa3330 2024-09-17T03:35:46.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f1481055740 10 client.5706 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:46.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f1481055740 10 client.5706 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:46.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f1481055740 20 client.5706 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:46.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f1481055740 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x559a55aaf1e0 0x559a55ebdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f1481055740 4 client.5706 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-17T03:35:46.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f1481055740 1 -- 172.21.15.146:0/3345368886 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x559a55e9e060 con 0x559a55aaf1e0 2024-09-17T03:35:46.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f14737fe640 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x559a55aaf1e0 0x559a55ebdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f14527fc640 10 client.5706 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.416+0000 7f14737fe640 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x559a55aaf1e0 0x559a55ebdfc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70c1dae84b0ffc9d server_cookie=cf7436646f708bd6 in_seq=0 out_seq=0 2024-09-17T03:35:46.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f14527fc640 1 -- 172.21.15.146:0/3345368886 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559a55e9e060 con 0x559a55aaf1e0 2024-09-17T03:35:46.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f14527fc640 10 client.5706 handle_command_reply: tid=0 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 1 client.5706 shutdown 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 1 -- 172.21.15.146:0/3345368886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aa3330 msgr2=0x559a55ebda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aa3330 0x559a55ebda80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f146c005fd0 tx=0x7f146c0044d0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 1 -- 172.21.15.146:0/3345368886 shutdown_connections 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x559a55aaf1e0 0x559a55ebdfc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559a55aa3330 0x559a55ebda80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559a55a86320 0x559a55ebf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f14527fc640 0 client.5706 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 1 --2- 172.21.15.146:0/3345368886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559a55a6dfc0 0x559a55ebedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 1 -- 172.21.15.146:0/3345368886 >> 172.21.15.146:0/3345368886 conn(0x559a55e921f0 msgr2=0x559a55e50620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 1 -- 172.21.15.146:0/3345368886 shutdown_connections 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 1 -- 172.21.15.146:0/3345368886 wait complete. 2024-09-17T03:35:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f1481055740 20 client.5706 trim_cache size 0 max 16384 2024-09-17T03:35:46.422 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:46.422 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:35:46.422 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:35:46.422 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:46.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f147a0e5640 1 -- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1454078b90 msgr2=0x7f145407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.419+0000 7f147a0e5640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1454078b90 0x7f145407b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1464009ab0 tx=0x7f1464009390 comp rx=0 tx=0).stop 2024-09-17T03:35:46.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.420+0000 7f147a0e5640 1 -- 172.21.15.146:0/3549901593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1474156df0 msgr2=0x7f147414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.420+0000 7f147a0e5640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1474156df0 0x7f147414d950 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f145c000f60 tx=0x7f145c006310 comp rx=0 tx=0).stop 2024-09-17T03:35:46.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.420+0000 7f147a0e5640 1 -- 172.21.15.146:0/3549901593 shutdown_connections 2024-09-17T03:35:46.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.420+0000 7f147a0e5640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1454078b90 0x7f145407b0a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.420+0000 7f147a0e5640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f147414de90 0x7f14740cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.420+0000 7f147a0e5640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1474156df0 0x7f147414d950 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.420+0000 7f147a0e5640 1 --2- 172.21.15.146:0/3549901593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1460003fd0 0x7f14740cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.420+0000 7f147a0e5640 1 -- 172.21.15.146:0/3549901593 >> 172.21.15.146:0/3549901593 conn(0x7f14740d11f0 msgr2=0x7f147406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.420+0000 7f147a0e5640 1 -- 172.21.15.146:0/3549901593 shutdown_connections 2024-09-17T03:35:46.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.420+0000 7f147a0e5640 1 -- 172.21.15.146:0/3549901593 wait complete. 2024-09-17T03:35:46.429 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-17T03:35:46.429 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-17T03:35:46.430 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-17T03:35:46.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.547+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/140413914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a40b4530 msgr2=0x7fe3a40b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.547+0000 7fe3ab8ec640 1 --2- 172.21.15.146:0/140413914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a40b4530 0x7fe3a40b4940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe394009830 tx=0x7fe39402a510 comp rx=0 tx=0).stop 2024-09-17T03:35:46.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.547+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/140413914 shutdown_connections 2024-09-17T03:35:46.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.547+0000 7fe3ab8ec640 1 --2- 172.21.15.146:0/140413914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a406dd60 0x7fe3a406e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.547+0000 7fe3ab8ec640 1 --2- 172.21.15.146:0/140413914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a40b4530 0x7fe3a40b4940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.547+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/140413914 >> 172.21.15.146:0/140413914 conn(0x7fe3a40b3410 msgr2=0x7fe3a40b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.547+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/140413914 shutdown_connections 2024-09-17T03:35:46.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.547+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/140413914 wait complete. 2024-09-17T03:35:46.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.549+0000 7fe3ab8ec640 1 Processor -- start 2024-09-17T03:35:46.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.549+0000 7fe3ab8ec640 1 -- start start 2024-09-17T03:35:46.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.550+0000 7fe3ab8ec640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a406dd60 0x7fe3a40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.550+0000 7fe3ab8ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a40b4530 0x7fe3a40ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.550+0000 7fe3ab8ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a40b55f0 0x7fe3a41438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.550+0000 7fe3ab8ec640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a415bd10 con 0x7fe3a406dd60 2024-09-17T03:35:46.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.550+0000 7fe3ab8ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a40b5c50 con 0x7fe3a40b4530 2024-09-17T03:35:46.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.550+0000 7fe3ab8ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a415be90 con 0x7fe3a40b55f0 2024-09-17T03:35:46.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.550+0000 7fe3a9688640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a406dd60 0x7fe3a40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.550+0000 7fe3a9688640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a406dd60 0x7fe3a40cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39590/0 (socket says 172.21.15.146:39590) 2024-09-17T03:35:46.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.550+0000 7fe3a9688640 1 -- 172.21.15.146:0/322468676 learned_addr learned my addr 172.21.15.146:0/322468676 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe3a8e87640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a40b4530 0x7fe3a40ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe3a9e89640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a40b55f0 0x7fe3a41438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe3a9688640 1 -- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a40b55f0 msgr2=0x7fe3a41438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe3a9688640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a40b55f0 0x7fe3a41438a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe3a9688640 1 -- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a40b4530 msgr2=0x7fe3a40ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe3a9688640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a40b4530 0x7fe3a40ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe3a9688640 1 -- 172.21.15.146:0/322468676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a40d1480 con 0x7fe3a406dd60 2024-09-17T03:35:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe3a9688640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a406dd60 0x7fe3a40cf290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000c440 tx=0x7fe3a000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe399ffb640 1 -- 172.21.15.146:0/322468676 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0017070 con 0x7fe3a406dd60 2024-09-17T03:35:46.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe399ffb640 1 -- 172.21.15.146:0/322468676 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3a00035f0 con 0x7fe3a406dd60 2024-09-17T03:35:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/322468676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a4147f30 con 0x7fe3a406dd60 2024-09-17T03:35:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe399ffb640 1 -- 172.21.15.146:0/322468676 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0003a40 con 0x7fe3a406dd60 2024-09-17T03:35:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.551+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/322468676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a41484f0 con 0x7fe3a406dd60 2024-09-17T03:35:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.553+0000 7fe399ffb640 1 -- 172.21.15.146:0/322468676 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3a001a070 con 0x7fe3a406dd60 2024-09-17T03:35:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.554+0000 7fe399ffb640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe388078b90 0x7fe38807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.554+0000 7fe399ffb640 1 -- 172.21.15.146:0/322468676 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe3a0099f50 con 0x7fe3a406dd60 2024-09-17T03:35:46.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.554+0000 7fe3a8e87640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe388078b90 0x7fe38807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.554+0000 7fe3b285b740 1 Processor -- start 2024-09-17T03:35:46.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.554+0000 7fe3a8e87640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe388078b90 0x7fe38807b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe394034000 tx=0x7fe394004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.554+0000 7fe3b285b740 1 -- start start 2024-09-17T03:35:46.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559a8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555ae360 0x55c0559a8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555b6540 0x55c0559c5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3b285b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c0558f1ad0 con 0x55c0555d7220 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3b285b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c0558e0f00 con 0x55c0555ae360 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3b285b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c0558e4d10 con 0x55c0555b6540 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3a9688640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3a9688640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559a8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39596/0 (socket says 172.21.15.146:39596) 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3a9688640 1 -- 172.21.15.146:0/3606084672 learned_addr learned my addr 172.21.15.146:0/3606084672 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3a8e87640 1 --2- 172.21.15.146:0/3606084672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555ae360 0x55c0559a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3a9e89640 1 --2- 172.21.15.146:0/3606084672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555b6540 0x55c0559c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3a9688640 1 -- 172.21.15.146:0/3606084672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555b6540 msgr2=0x55c0559c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3a9688640 1 --2- 172.21.15.146:0/3606084672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555b6540 0x55c0559c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3a9688640 1 -- 172.21.15.146:0/3606084672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555ae360 msgr2=0x55c0559a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3a9688640 1 --2- 172.21.15.146:0/3606084672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555ae360 0x55c0559a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3a9688640 1 -- 172.21.15.146:0/3606084672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0555d3280 con 0x55c0555d7220 2024-09-17T03:35:46.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe3a9688640 1 --2- 172.21.15.146:0/3606084672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559a8300 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0061b20 tx=0x7fe3a005ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe5417868c6eee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe38effd640 1 -- 172.21.15.146:0/3606084672 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0088070 con 0x55c0555d7220 2024-09-17T03:35:46.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe38effd640 1 -- 172.21.15.146:0/3606084672 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3a006b700 con 0x55c0555d7220 2024-09-17T03:35:46.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.556+0000 7fe38effd640 1 -- 172.21.15.146:0/3606084672 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a006b270 con 0x55c0555d7220 2024-09-17T03:35:46.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.557+0000 7fe3b285b740 1 -- 172.21.15.146:0/3606084672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 msgr2=0x55c0559a8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.557+0000 7fe3b285b740 1 --2- 172.21.15.146:0/3606084672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559a8300 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0061b20 tx=0x7fe3a005ddf0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.557+0000 7fe3b285b740 1 -- 172.21.15.146:0/3606084672 shutdown_connections 2024-09-17T03:35:46.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.557+0000 7fe3b285b740 1 --2- 172.21.15.146:0/3606084672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555b6540 0x55c0559c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.557+0000 7fe3b285b740 1 --2- 172.21.15.146:0/3606084672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555ae360 0x55c0559a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.557+0000 7fe3b285b740 1 --2- 172.21.15.146:0/3606084672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559a8300 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.557+0000 7fe3b285b740 1 -- 172.21.15.146:0/3606084672 >> 172.21.15.146:0/3606084672 conn(0x55c0555cb370 msgr2=0x55c05597e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.557+0000 7fe3b285b740 1 -- 172.21.15.146:0/3606084672 shutdown_connections 2024-09-17T03:35:46.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.557+0000 7fe3b285b740 1 -- 172.21.15.146:0/3606084672 wait complete. 2024-09-17T03:35:46.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.558+0000 7fe3b285b740 1 -- start start 2024-09-17T03:35:46.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.558+0000 7fe3b285b740 1 Processor -- start 2024-09-17T03:35:46.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555ae360 0x55c0559bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555b6540 0x55c0559bb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555d7220 0x55c0559b9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3b285b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c0556515d0 con 0x55c0555ae360 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3b285b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c055886460 con 0x55c0555b6540 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3b285b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c0559a8d80 con 0x55c0555d7220 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3b285b740 10 client.0 _ll_register_callbacks cb 0x55c055895b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a9688640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555ae360 0x55c0559bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a9688640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555ae360 0x55c0559bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39598/0 (socket says 172.21.15.146:39598) 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a9688640 1 -- 172.21.15.146:0/820052822 learned_addr learned my addr 172.21.15.146:0/820052822 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a9e89640 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555d7220 0x55c0559b9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a8e87640 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555b6540 0x55c0559bb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a9688640 1 -- 172.21.15.146:0/820052822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555d7220 msgr2=0x55c0559b9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a9688640 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555d7220 0x55c0559b9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a9688640 1 -- 172.21.15.146:0/820052822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555b6540 msgr2=0x55c0559bb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a9688640 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555b6540 0x55c0559bb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a9688640 1 -- 172.21.15.146:0/820052822 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0556bb690 con 0x55c0555ae360 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a9e89640 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555d7220 0x55c0559b9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3a9688640 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555ae360 0x55c0559bee80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0005600 tx=0x7fe3a006b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53ae64e66e439d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe383fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe383fff640 1 -- 172.21.15.146:0/820052822 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0088040 con 0x55c0555ae360 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe383fff640 1 -- 172.21.15.146:0/820052822 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe3a0061290 con 0x55c0555ae360 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.560+0000 7fe3b285b740 1 -- 172.21.15.146:0/820052822 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3a006b700 con 0x55c0555ae360 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe383fff640 1 -- 172.21.15.146:0/820052822 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe3a005d770 con 0x55c0555ae360 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe3b285b740 10 client.5715 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe3b285b740 1 -- 172.21.15.146:0/820052822 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55c05571be20 con 0x55c0555ae360 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe383fff640 1 -- 172.21.15.146:0/820052822 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3a006b700 con 0x55c0555ae360 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe383fff640 1 -- 172.21.15.146:0/820052822 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fe3a005d910 con 0x55c0555ae360 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe3b285b740 10 client.5715 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe3b285b740 10 client.5715 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe3b285b740 20 client.5715 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe3b285b740 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c055596000 0x55c0559d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe3b285b740 4 client.5715 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe3b285b740 1 -- 172.21.15.146:0/820052822 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0558f3a20 con 0x55c055596000 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe3a8e87640 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c055596000 0x55c0559d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.561+0000 7fe383fff640 10 client.5715 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe3a8e87640 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c055596000 0x55c0559d17d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a528a79a8b8738c3 server_cookie=403c5a8573c581ee in_seq=0 out_seq=0 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe383fff640 1 -- 172.21.15.146:0/820052822 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c0558f3a20 con 0x55c055596000 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe383fff640 10 client.5715 handle_command_reply: tid=0 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe3b285b740 1 client.5715 shutdown 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe3b285b740 1 -- 172.21.15.146:0/820052822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555ae360 msgr2=0x55c0559bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe3b285b740 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555ae360 0x55c0559bee80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0005600 tx=0x7fe3a006b520 comp rx=0 tx=0).stop 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe3b285b740 1 -- 172.21.15.146:0/820052822 shutdown_connections 2024-09-17T03:35:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe3b285b740 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c055596000 0x55c0559d17d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe3b285b740 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555d7220 0x55c0559b9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe3b285b740 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555b6540 0x55c0559bb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe3b285b740 1 --2- 172.21.15.146:0/820052822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555ae360 0x55c0559bee80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe383fff640 0 client.5715 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe3b285b740 1 -- 172.21.15.146:0/820052822 >> 172.21.15.146:0/820052822 conn(0x55c0555cb370 msgr2=0x55c055998460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.562+0000 7fe3b285b740 1 -- 172.21.15.146:0/820052822 shutdown_connections 2024-09-17T03:35:46.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.563+0000 7fe3b285b740 1 -- 172.21.15.146:0/820052822 wait complete. 2024-09-17T03:35:46.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.563+0000 7fe3b285b740 20 client.5715 trim_cache size 0 max 16384 2024-09-17T03:35:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.580+0000 7fe3b285b740 1 Processor -- start 2024-09-17T03:35:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.580+0000 7fe3b285b740 1 -- start start 2024-09-17T03:35:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555ae360 0x55c0559bf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555b6540 0x55c0559c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c055a3b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3b285b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a42002a0 con 0x55c0555d7220 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3b285b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a415a8c0 con 0x55c0555b6540 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3b285b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a4159c70 con 0x55c0555ae360 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a9e89640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c055a3b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a9e89640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c055a3b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39610/0 (socket says 172.21.15.146:39610) 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a9e89640 1 -- 172.21.15.146:0/2112712321 learned_addr learned my addr 172.21.15.146:0/2112712321 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a9688640 1 --2- 172.21.15.146:0/2112712321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555ae360 0x55c0559bf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a8e87640 1 --2- 172.21.15.146:0/2112712321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555b6540 0x55c0559c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a9e89640 1 -- 172.21.15.146:0/2112712321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555ae360 msgr2=0x55c0559bf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a9e89640 1 --2- 172.21.15.146:0/2112712321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555ae360 0x55c0559bf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a9e89640 1 -- 172.21.15.146:0/2112712321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555b6540 msgr2=0x55c0559c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a9e89640 1 --2- 172.21.15.146:0/2112712321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555b6540 0x55c0559c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a9e89640 1 -- 172.21.15.146:0/2112712321 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0559ba260 con 0x55c0555d7220 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a8e87640 1 --2- 172.21.15.146:0/2112712321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555b6540 0x55c0559c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe3a9e89640 1 --2- 172.21.15.146:0/2112712321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c055a3b990 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009f20 tx=0x7fe39c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a72d61248e771f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe38e7fc640 1 -- 172.21.15.146:0/2112712321 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c003d80 con 0x55c0555d7220 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe38e7fc640 1 -- 172.21.15.146:0/2112712321 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe39c004050 con 0x55c0555d7220 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.582+0000 7fe38e7fc640 1 -- 172.21.15.146:0/2112712321 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0044a0 con 0x55c0555d7220 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.583+0000 7fe3b285b740 1 -- 172.21.15.146:0/2112712321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 msgr2=0x55c055a3b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.583+0000 7fe3b285b740 1 --2- 172.21.15.146:0/2112712321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c055a3b990 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009f20 tx=0x7fe39c0095c0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.583+0000 7fe3b285b740 1 -- 172.21.15.146:0/2112712321 shutdown_connections 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.583+0000 7fe3b285b740 1 --2- 172.21.15.146:0/2112712321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c055a3b990 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.583+0000 7fe3b285b740 1 --2- 172.21.15.146:0/2112712321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555b6540 0x55c0559c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.583+0000 7fe3b285b740 1 --2- 172.21.15.146:0/2112712321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555ae360 0x55c0559bf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.583+0000 7fe3b285b740 1 -- 172.21.15.146:0/2112712321 >> 172.21.15.146:0/2112712321 conn(0x55c0555cb370 msgr2=0x55c0559a8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.583+0000 7fe3b285b740 1 -- 172.21.15.146:0/2112712321 shutdown_connections 2024-09-17T03:35:46.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.583+0000 7fe3b285b740 1 -- 172.21.15.146:0/2112712321 wait complete. 2024-09-17T03:35:46.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.584+0000 7fe3b285b740 1 -- start start 2024-09-17T03:35:46.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.584+0000 7fe3b285b740 1 Processor -- start 2024-09-17T03:35:46.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.585+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555ae360 0x55c055a38f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.585+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555b6540 0x55c0559c3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.585+0000 7fe3b285b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559c3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.585+0000 7fe3b285b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c0559c58e0 con 0x55c0555d7220 2024-09-17T03:35:46.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.585+0000 7fe3b285b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a415a270 con 0x55c0555ae360 2024-09-17T03:35:46.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.585+0000 7fe3b285b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c0559e08b0 con 0x55c0555b6540 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.585+0000 7fe3b285b740 10 client.0 _ll_register_callbacks cb 0x7fe3940096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.585+0000 7fe3a9e89640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3a9e89640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559c3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39614/0 (socket says 172.21.15.146:39614) 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3a9e89640 1 -- 172.21.15.146:0/1533976583 learned_addr learned my addr 172.21.15.146:0/1533976583 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3a9688640 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555ae360 0x55c055a38f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3a8e87640 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555b6540 0x55c0559c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3a9e89640 1 -- 172.21.15.146:0/1533976583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555b6540 msgr2=0x55c0559c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3a9e89640 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555b6540 0x55c0559c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3a9e89640 1 -- 172.21.15.146:0/1533976583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555ae360 msgr2=0x55c055a38f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3a9e89640 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555ae360 0x55c055a38f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3a9e89640 1 -- 172.21.15.146:0/1533976583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c055620530 con 0x55c0555d7220 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3a8e87640 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555b6540 0x55c0559c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:46.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3a9e89640 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559c3660 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00f000 tx=0x7fe39c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79789a11d3efba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe383fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:46.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe383fff640 1 -- 172.21.15.146:0/1533976583 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c004b20 con 0x55c0555d7220 2024-09-17T03:35:46.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe383fff640 1 -- 172.21.15.146:0/1533976583 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe39c004cc0 con 0x55c0555d7220 2024-09-17T03:35:46.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3b285b740 1 -- 172.21.15.146:0/1533976583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe39c004050 con 0x55c0555d7220 2024-09-17T03:35:46.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe383fff640 1 -- 172.21.15.146:0/1533976583 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe39c034050 con 0x55c0555d7220 2024-09-17T03:35:46.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3b285b740 10 client.5721 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:46.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.586+0000 7fe3b285b740 1 -- 172.21.15.146:0/1533976583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55c055997f10 con 0x55c0555d7220 2024-09-17T03:35:46.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.587+0000 7fe383fff640 1 -- 172.21.15.146:0/1533976583 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe39c004050 con 0x55c0555d7220 2024-09-17T03:35:46.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.587+0000 7fe383fff640 1 -- 172.21.15.146:0/1533976583 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fe39c037020 con 0x55c0555d7220 2024-09-17T03:35:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.587+0000 7fe3b285b740 10 client.5721 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.587+0000 7fe3b285b740 10 client.5721 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.587+0000 7fe3b285b740 20 client.5721 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.587+0000 7fe3b285b740 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c0559e71d0 0x55c0559bac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.587+0000 7fe3b285b740 4 client.5721 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-17T03:35:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.587+0000 7fe3b285b740 1 -- 172.21.15.146:0/1533976583 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x55c0559c00b0 con 0x55c0559e71d0 2024-09-17T03:35:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.587+0000 7fe3a9688640 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c0559e71d0 0x55c0559bac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.587+0000 7fe383fff640 10 client.5721 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.587+0000 7fe3a9688640 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c0559e71d0 0x55c0559bac10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=492f34804f87128 server_cookie=705e15b8a053fce in_seq=0 out_seq=0 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe383fff640 1 -- 172.21.15.146:0/1533976583 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c0559c00b0 con 0x55c0559e71d0 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe383fff640 10 client.5721 handle_command_reply: tid=0 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 1 client.5721 shutdown 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 1 -- 172.21.15.146:0/1533976583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 msgr2=0x55c0559c3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559c3660 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00f000 tx=0x7fe39c004430 comp rx=0 tx=0).stop 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 1 -- 172.21.15.146:0/1533976583 shutdown_connections 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c0559e71d0 0x55c0559bac10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0555d7220 0x55c0559c3660 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0555b6540 0x55c0559c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 1 --2- 172.21.15.146:0/1533976583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0555ae360 0x55c055a38f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 1 -- 172.21.15.146:0/1533976583 >> 172.21.15.146:0/1533976583 conn(0x55c0555cb370 msgr2=0x55c0559e7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe383fff640 0 client.5721 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 1 -- 172.21.15.146:0/1533976583 shutdown_connections 2024-09-17T03:35:46.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 1 -- 172.21.15.146:0/1533976583 wait complete. 2024-09-17T03:35:46.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.588+0000 7fe3b285b740 20 client.5721 trim_cache size 0 max 16384 2024-09-17T03:35:46.598 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:46.598 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:35:46.598 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "adfb75e5-b911-4f8d-a47c-c41436f4748a", 2024-09-17T03:35:46.598 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:35:46.598 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:46.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe388078b90 msgr2=0x7fe38807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe388078b90 0x7fe38807b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe394034000 tx=0x7fe394004730 comp rx=0 tx=0).stop 2024-09-17T03:35:46.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/322468676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a406dd60 msgr2=0x7fe3a40cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a406dd60 0x7fe3a40cf290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000c440 tx=0x7fe3a000c900 comp rx=0 tx=0).stop 2024-09-17T03:35:46.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/322468676 shutdown_connections 2024-09-17T03:35:46.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe388078b90 0x7fe38807b0a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3a40b55f0 0x7fe3a41438a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3a40b4530 0x7fe3a40ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 --2- 172.21.15.146:0/322468676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3a406dd60 0x7fe3a40cf290 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/322468676 >> 172.21.15.146:0/322468676 conn(0x7fe3a40b3410 msgr2=0x7fe3a4075ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/322468676 shutdown_connections 2024-09-17T03:35:46.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.589+0000 7fe3ab8ec640 1 -- 172.21.15.146:0/322468676 wait complete. 2024-09-17T03:35:46.601 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'adfb75e5-b911-4f8d-a47c-c41436f4748a', 'mode': 'asynchronous'}' 2024-09-17T03:35:46.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:46.602 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-09-17T03:35:46.618 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-09-17T03:35:46.618 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-09-17T03:35:46.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.775+0000 7efd5b2d5640 1 -- 172.21.15.146:0/3457203716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd540b61f0 msgr2=0x7efd540b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.775+0000 7efd5b2d5640 1 --2- 172.21.15.146:0/3457203716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd540b61f0 0x7efd540b6600 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efd5406e100 tx=0x7efd5002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.775+0000 7efd5b2d5640 1 -- 172.21.15.146:0/3457203716 shutdown_connections 2024-09-17T03:35:46.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.775+0000 7efd5b2d5640 1 --2- 172.21.15.146:0/3457203716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd540b61f0 0x7efd540b6600 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.775+0000 7efd5b2d5640 1 --2- 172.21.15.146:0/3457203716 >> v2:172.21.15.179:3300/0 conn(0x7efd5415f1a0 0x7efd540cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.775+0000 7efd5b2d5640 1 -- 172.21.15.146:0/3457203716 >> 172.21.15.146:0/3457203716 conn(0x7efd540d11f0 msgr2=0x7efd540d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.775+0000 7efd5b2d5640 1 -- 172.21.15.146:0/3457203716 shutdown_connections 2024-09-17T03:35:46.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.775+0000 7efd5b2d5640 1 -- 172.21.15.146:0/3457203716 wait complete. 2024-09-17T03:35:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.777+0000 7efd5b2d5640 1 Processor -- start 2024-09-17T03:35:46.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.777+0000 7efd5b2d5640 1 -- start start 2024-09-17T03:35:46.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd5b2d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd540b61f0 0x7efd5414cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd5b2d5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd5415f1a0 0x7efd5415b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd5b2d5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd541631a0 0x7efd5415b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd5b2d5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efd540695b0 con 0x7efd540b61f0 2024-09-17T03:35:46.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd5b2d5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efd54069430 con 0x7efd541631a0 2024-09-17T03:35:46.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd5b2d5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efd54069730 con 0x7efd5415f1a0 2024-09-17T03:35:46.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd59071640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd540b61f0 0x7efd5414cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd59071640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd540b61f0 0x7efd5414cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39632/0 (socket says 172.21.15.146:39632) 2024-09-17T03:35:46.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd59071640 1 -- 172.21.15.146:0/1502432958 learned_addr learned my addr 172.21.15.146:0/1502432958 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd59872640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd541631a0 0x7efd5415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd58870640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd5415f1a0 0x7efd5415b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd59071640 1 -- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd5415f1a0 msgr2=0x7efd5415b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.778+0000 7efd59071640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd5415f1a0 0x7efd5415b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.779+0000 7efd59071640 1 -- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd541631a0 msgr2=0x7efd5415b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.779+0000 7efd59071640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd541631a0 0x7efd5415b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.779+0000 7efd59071640 1 -- 172.21.15.146:0/1502432958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5414d1d0 con 0x7efd540b61f0 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.779+0000 7efd59872640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd541631a0 0x7efd5415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.779+0000 7efd58870640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd5415f1a0 0x7efd5415b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.779+0000 7efd59071640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd540b61f0 0x7efd5414cc90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00cce0 tx=0x7efd4c007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.779+0000 7efd49ffb640 1 -- 172.21.15.146:0/1502432958 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c004b20 con 0x7efd540b61f0 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.779+0000 7efd49ffb640 1 -- 172.21.15.146:0/1502432958 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd4c004db0 con 0x7efd540b61f0 2024-09-17T03:35:46.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.779+0000 7efd5b2d5640 1 -- 172.21.15.146:0/1502432958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5415c390 con 0x7efd540b61f0 2024-09-17T03:35:46.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.779+0000 7efd49ffb640 1 -- 172.21.15.146:0/1502432958 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c005280 con 0x7efd540b61f0 2024-09-17T03:35:46.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.779+0000 7efd5b2d5640 1 -- 172.21.15.146:0/1502432958 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd540c9480 con 0x7efd540b61f0 2024-09-17T03:35:46.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.781+0000 7efd49ffb640 1 -- 172.21.15.146:0/1502432958 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd4c005420 con 0x7efd540b61f0 2024-09-17T03:35:46.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.782+0000 7efd49ffb640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd38078bc0 0x7efd3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.782+0000 7efd49ffb640 1 -- 172.21.15.146:0/1502432958 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7efd4c09b570 con 0x7efd540b61f0 2024-09-17T03:35:46.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.782+0000 7efd58870640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd38078bc0 0x7efd3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.783+0000 7efd6223f740 1 Processor -- start 2024-09-17T03:35:46.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.783+0000 7efd6223f740 1 -- start start 2024-09-17T03:35:46.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.783+0000 7efd58870640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd38078bc0 0x7efd3807b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efd440013f0 tx=0x7efd44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd6223f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e788750 0x55955eb75a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd6223f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e75f890 0x55955eb2a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd6223f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955eb2ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd6223f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55955eaa2b20 con 0x55955e75f890 2024-09-17T03:35:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd6223f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55955ea91f50 con 0x55955e788750 2024-09-17T03:35:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd6223f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55955ea95d60 con 0x55955e767a70 2024-09-17T03:35:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd58870640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e75f890 0x55955eb2a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd58870640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e75f890 0x55955eb2a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39648/0 (socket says 172.21.15.146:39648) 2024-09-17T03:35:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd58870640 1 -- 172.21.15.146:0/3246294054 learned_addr learned my addr 172.21.15.146:0/3246294054 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd59071640 1 --2- 172.21.15.146:0/3246294054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e788750 0x55955eb75a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd59872640 1 --2- 172.21.15.146:0/3246294054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955eb2ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd58870640 1 -- 172.21.15.146:0/3246294054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 msgr2=0x55955eb2ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd58870640 1 --2- 172.21.15.146:0/3246294054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955eb2ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd58870640 1 -- 172.21.15.146:0/3246294054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e788750 msgr2=0x55955eb75a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd58870640 1 --2- 172.21.15.146:0/3246294054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e788750 0x55955eb75a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd58870640 1 -- 172.21.15.146:0/3246294054 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55955e7f3d30 con 0x55955e75f890 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd59872640 1 --2- 172.21.15.146:0/3246294054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955eb2ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd58870640 1 --2- 172.21.15.146:0/3246294054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e75f890 0x55955eb2a8f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efd4400d860 tx=0x7efd44010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4057070b21c3f2c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.784+0000 7efd3effd640 1 -- 172.21.15.146:0/3246294054 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44024070 con 0x55955e75f890 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.785+0000 7efd3effd640 1 -- 172.21.15.146:0/3246294054 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd44014ba0 con 0x55955e75f890 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.785+0000 7efd3effd640 1 -- 172.21.15.146:0/3246294054 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4401f400 con 0x55955e75f890 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.785+0000 7efd6223f740 1 -- 172.21.15.146:0/3246294054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e75f890 msgr2=0x55955eb2a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.785+0000 7efd6223f740 1 --2- 172.21.15.146:0/3246294054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e75f890 0x55955eb2a8f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efd4400d860 tx=0x7efd44010000 comp rx=0 tx=0).stop 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.785+0000 7efd6223f740 1 -- 172.21.15.146:0/3246294054 shutdown_connections 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.785+0000 7efd6223f740 1 --2- 172.21.15.146:0/3246294054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955eb2ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.785+0000 7efd6223f740 1 --2- 172.21.15.146:0/3246294054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e75f890 0x55955eb2a8f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.785+0000 7efd6223f740 1 --2- 172.21.15.146:0/3246294054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e788750 0x55955eb75a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.785+0000 7efd6223f740 1 -- 172.21.15.146:0/3246294054 >> 172.21.15.146:0/3246294054 conn(0x55955e77c8a0 msgr2=0x55955eb2fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.785+0000 7efd6223f740 1 -- 172.21.15.146:0/3246294054 shutdown_connections 2024-09-17T03:35:46.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.785+0000 7efd6223f740 1 -- 172.21.15.146:0/3246294054 wait complete. 2024-09-17T03:35:46.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.786+0000 7efd6223f740 1 -- start start 2024-09-17T03:35:46.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.786+0000 7efd6223f740 1 Processor -- start 2024-09-17T03:35:46.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd6223f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e75f890 0x55955eb6a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd6223f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e767a70 0x55955eb7c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd6223f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e788750 0x55955eb4ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd6223f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55955e802b00 con 0x55955e767a70 2024-09-17T03:35:46.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd6223f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55955ea377c0 con 0x55955e788750 2024-09-17T03:35:46.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd6223f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55955eb78dd0 con 0x55955e75f890 2024-09-17T03:35:46.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd6223f740 10 client.0 _ll_register_callbacks cb 0x55955ea8f5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:46.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd58870640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e767a70 0x55955eb7c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd58870640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e767a70 0x55955eb7c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39660/0 (socket says 172.21.15.146:39660) 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd58870640 1 -- 172.21.15.146:0/2268681995 learned_addr learned my addr 172.21.15.146:0/2268681995 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd59872640 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e788750 0x55955eb4ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd59071640 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e75f890 0x55955eb6a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd58870640 1 -- 172.21.15.146:0/2268681995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e75f890 msgr2=0x55955eb6a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd58870640 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e75f890 0x55955eb6a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd58870640 1 -- 172.21.15.146:0/2268681995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e788750 msgr2=0x55955eb4ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd58870640 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e788750 0x55955eb4ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd58870640 1 -- 172.21.15.146:0/2268681995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55955e86ab90 con 0x55955e767a70 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd58870640 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e767a70 0x55955eb7c510 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efd44022040 tx=0x7efd44004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44630fbd75b1d206 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd33fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.788+0000 7efd33fff640 1 -- 172.21.15.146:0/2268681995 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44024070 con 0x55955e767a70 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd33fff640 1 -- 172.21.15.146:0/2268681995 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7efd4401f810 con 0x55955e767a70 2024-09-17T03:35:46.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd6223f740 1 -- 172.21.15.146:0/2268681995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd44014ba0 con 0x55955e767a70 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd33fff640 1 -- 172.21.15.146:0/2268681995 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efd44036050 con 0x55955e767a70 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd6223f740 10 client.5736 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd6223f740 1 -- 172.21.15.146:0/2268681995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55955eb7af40 con 0x55955e767a70 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd33fff640 1 -- 172.21.15.146:0/2268681995 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd44014ba0 con 0x55955e767a70 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd33fff640 1 -- 172.21.15.146:0/2268681995 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7efd44039020 con 0x55955e767a70 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd6223f740 10 client.5736 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd6223f740 10 client.5736 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd6223f740 20 client.5736 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd6223f740 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55955e747320 0x55955eb77d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd6223f740 4 client.5736 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd6223f740 1 -- 172.21.15.146:0/2268681995 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55955eaa4a70 con 0x55955e747320 2024-09-17T03:35:46.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd59071640 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55955e747320 0x55955eb77d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.789+0000 7efd33fff640 10 client.5736 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd59071640 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55955e747320 0x55955eb77d10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=857ff91c1379aa93 server_cookie=457853e2a7b674d4 in_seq=0 out_seq=0 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd33fff640 1 -- 172.21.15.146:0/2268681995 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55955eaa4a70 con 0x55955e747320 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd33fff640 10 client.5736 handle_command_reply: tid=0 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd6223f740 1 client.5736 shutdown 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd6223f740 1 -- 172.21.15.146:0/2268681995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e767a70 msgr2=0x55955eb7c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd6223f740 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e767a70 0x55955eb7c510 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efd44022040 tx=0x7efd44004620 comp rx=0 tx=0).stop 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd6223f740 1 -- 172.21.15.146:0/2268681995 shutdown_connections 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd6223f740 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55955e747320 0x55955eb77d10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd6223f740 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e788750 0x55955eb4ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd6223f740 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e767a70 0x55955eb7c510 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd6223f740 1 --2- 172.21.15.146:0/2268681995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e75f890 0x55955eb6a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd33fff640 0 client.5736 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.790+0000 7efd6223f740 1 -- 172.21.15.146:0/2268681995 >> 172.21.15.146:0/2268681995 conn(0x55955e77c8a0 msgr2=0x55955eb6ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.791+0000 7efd6223f740 1 -- 172.21.15.146:0/2268681995 shutdown_connections 2024-09-17T03:35:46.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.791+0000 7efd6223f740 1 -- 172.21.15.146:0/2268681995 wait complete. 2024-09-17T03:35:46.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.791+0000 7efd6223f740 20 client.5736 trim_cache size 0 max 16384 2024-09-17T03:35:46.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.805+0000 7efd6223f740 1 Processor -- start 2024-09-17T03:35:46.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.806+0000 7efd6223f740 1 -- start start 2024-09-17T03:35:46.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd6223f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e75f890 0x55955eb556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd6223f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955eb7b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd6223f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955eb7b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd6223f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efd542022f0 con 0x55955e788750 2024-09-17T03:35:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd6223f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efd54201370 con 0x55955e75f890 2024-09-17T03:35:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd6223f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efd54200850 con 0x55955e767a70 2024-09-17T03:35:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd59872640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955eb7b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd59872640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955eb7b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39674/0 (socket says 172.21.15.146:39674) 2024-09-17T03:35:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd59872640 1 -- 172.21.15.146:0/979179387 learned_addr learned my addr 172.21.15.146:0/979179387 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd58870640 1 --2- 172.21.15.146:0/979179387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955eb7b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd59071640 1 --2- 172.21.15.146:0/979179387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e75f890 0x55955eb556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd59872640 1 -- 172.21.15.146:0/979179387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 msgr2=0x55955eb7b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd59872640 1 --2- 172.21.15.146:0/979179387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955eb7b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd59872640 1 -- 172.21.15.146:0/979179387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e75f890 msgr2=0x55955eb556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd59872640 1 --2- 172.21.15.146:0/979179387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e75f890 0x55955eb556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd59872640 1 -- 172.21.15.146:0/979179387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55955eb76860 con 0x55955e788750 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.807+0000 7efd59872640 1 --2- 172.21.15.146:0/979179387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955eb7b740 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7efd500098f0 tx=0x7efd500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8af505df8d115fc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd3e7fc640 1 -- 172.21.15.146:0/979179387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500035f0 con 0x55955e788750 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd3e7fc640 1 -- 172.21.15.146:0/979179387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd50003790 con 0x55955e788750 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd3e7fc640 1 -- 172.21.15.146:0/979179387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50003be0 con 0x55955e788750 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd6223f740 1 -- 172.21.15.146:0/979179387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 msgr2=0x55955eb7b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd6223f740 1 --2- 172.21.15.146:0/979179387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955eb7b740 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7efd500098f0 tx=0x7efd500046c0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd6223f740 1 -- 172.21.15.146:0/979179387 shutdown_connections 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd6223f740 1 --2- 172.21.15.146:0/979179387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955eb7b740 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd6223f740 1 --2- 172.21.15.146:0/979179387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955eb7b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd6223f740 1 --2- 172.21.15.146:0/979179387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e75f890 0x55955eb556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd6223f740 1 -- 172.21.15.146:0/979179387 >> 172.21.15.146:0/979179387 conn(0x55955e77c8a0 msgr2=0x55955eb2f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd6223f740 1 -- 172.21.15.146:0/979179387 shutdown_connections 2024-09-17T03:35:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.808+0000 7efd6223f740 1 -- 172.21.15.146:0/979179387 wait complete. 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.809+0000 7efd6223f740 1 -- start start 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.809+0000 7efd6223f740 1 Processor -- start 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd6223f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e75f890 0x55955ebf13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd6223f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955ebf7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd6223f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955ebf80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd6223f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55955eb56480 con 0x55955e788750 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd6223f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efd54200d50 con 0x55955e75f890 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd6223f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55955eb752f0 con 0x55955e767a70 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd6223f740 10 client.0 _ll_register_callbacks cb 0x7efd44022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd59872640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955ebf80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd59872640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955ebf80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39688/0 (socket says 172.21.15.146:39688) 2024-09-17T03:35:46.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd59872640 1 -- 172.21.15.146:0/811750841 learned_addr learned my addr 172.21.15.146:0/811750841 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd59071640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e75f890 0x55955ebf13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd58870640 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955ebf7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd59872640 1 -- 172.21.15.146:0/811750841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 msgr2=0x55955ebf7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd59872640 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955ebf7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd59872640 1 -- 172.21.15.146:0/811750841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e75f890 msgr2=0x55955ebf13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd59872640 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e75f890 0x55955ebf13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd59872640 1 -- 172.21.15.146:0/811750841 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55955eb56030 con 0x55955e788750 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd59872640 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955ebf80a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efd50009780 tx=0x7efd50003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3583f5e004d7c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd33fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.811+0000 7efd33fff640 1 -- 172.21.15.146:0/811750841 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50003ed0 con 0x55955e788750 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd33fff640 1 -- 172.21.15.146:0/811750841 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7efd50050b10 con 0x55955e788750 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd6223f740 1 -- 172.21.15.146:0/811750841 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd50003790 con 0x55955e788750 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd33fff640 1 -- 172.21.15.146:0/811750841 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efd50057050 con 0x55955e788750 2024-09-17T03:35:46.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd6223f740 10 client.5742 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd6223f740 1 -- 172.21.15.146:0/811750841 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55955ebf4590 con 0x55955e788750 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd33fff640 1 -- 172.21.15.146:0/811750841 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd50003790 con 0x55955e788750 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd33fff640 1 -- 172.21.15.146:0/811750841 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7efd5005a020 con 0x55955e788750 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd6223f740 10 client.5742 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd6223f740 10 client.5742 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd6223f740 20 client.5742 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd6223f740 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55955ebf40e0 0x55955eb8ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd6223f740 4 client.5742 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}] 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd6223f740 1 -- 172.21.15.146:0/811750841 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}) -- 0x55955eaa0520 con 0x55955ebf40e0 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd59071640 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55955ebf40e0 0x55955eb8ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.812+0000 7efd33fff640 10 client.5742 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.813+0000 7efd59071640 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55955ebf40e0 0x55955eb8ce90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d89a580b97b9cb6 server_cookie=9832116f1d673ebe in_seq=0 out_seq=0 2024-09-17T03:35:46.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd33fff640 1 -- 172.21.15.146:0/811750841 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55955eaa0520 con 0x55955ebf40e0 2024-09-17T03:35:46.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd33fff640 10 client.5742 handle_command_reply: tid=0 2024-09-17T03:35:46.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd6223f740 1 client.5742 shutdown 2024-09-17T03:35:46.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd6223f740 1 -- 172.21.15.146:0/811750841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 msgr2=0x55955ebf80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd6223f740 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955ebf80a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efd50009780 tx=0x7efd50003b50 comp rx=0 tx=0).stop 2024-09-17T03:35:46.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd6223f740 1 -- 172.21.15.146:0/811750841 shutdown_connections 2024-09-17T03:35:46.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd6223f740 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55955ebf40e0 0x55955eb8ce90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd6223f740 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55955e788750 0x55955ebf80a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd6223f740 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55955e767a70 0x55955ebf7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd33fff640 0 client.5742 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:46.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd6223f740 1 --2- 172.21.15.146:0/811750841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55955e75f890 0x55955ebf13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd6223f740 1 -- 172.21.15.146:0/811750841 >> 172.21.15.146:0/811750841 conn(0x55955e77c8a0 msgr2=0x55955eb2f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd6223f740 1 -- 172.21.15.146:0/811750841 shutdown_connections 2024-09-17T03:35:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.815+0000 7efd6223f740 1 -- 172.21.15.146:0/811750841 wait complete. 2024-09-17T03:35:46.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd6223f740 20 client.5742 trim_cache size 0 max 16384 2024-09-17T03:35:46.819 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:46.819 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:35:46.820 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:35:46.820 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 -- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd38078bc0 msgr2=0x7efd3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd38078bc0 0x7efd3807b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efd440013f0 tx=0x7efd44009040 comp rx=0 tx=0).stop 2024-09-17T03:35:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 -- 172.21.15.146:0/1502432958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd540b61f0 msgr2=0x7efd5414cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd540b61f0 0x7efd5414cc90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00cce0 tx=0x7efd4c007610 comp rx=0 tx=0).stop 2024-09-17T03:35:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 -- 172.21.15.146:0/1502432958 shutdown_connections 2024-09-17T03:35:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd38078bc0 0x7efd3807b0d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd541631a0 0x7efd5415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd5415f1a0 0x7efd5415b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 --2- 172.21.15.146:0/1502432958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd540b61f0 0x7efd5414cc90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:46.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 -- 172.21.15.146:0/1502432958 >> 172.21.15.146:0/1502432958 conn(0x7efd540d11f0 msgr2=0x7efd540b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:46.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 -- 172.21.15.146:0/1502432958 shutdown_connections 2024-09-17T03:35:46.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:46.816+0000 7efd5b2d5640 1 -- 172.21.15.146:0/1502432958 wait complete. 2024-09-17T03:35:46.826 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' returned '{'message': '', 'return_code': 0}' 2024-09-17T03:35:46.826 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:35:46.826 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:46.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:46.842 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T03:35:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:35:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:35:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824324 s, 127 MB/s 2024-09-17T03:35:46.906 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-17T03:35:46.907 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-17T03:35:47.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.063+0000 7f33893ff640 1 -- 172.21.15.146:0/3450025338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3370006260 msgr2=0x7f337000cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.063+0000 7f33893ff640 1 --2- 172.21.15.146:0/3450025338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3370006260 0x7f337000cad0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f337c009ed0 tx=0x7f3370006940 comp rx=0 tx=0).stop 2024-09-17T03:35:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.063+0000 7f33837fe640 1 -- 172.21.15.146:0/3450025338 reap_dead start 2024-09-17T03:35:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.063+0000 7f33893ff640 1 -- 172.21.15.146:0/3450025338 shutdown_connections 2024-09-17T03:35:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.063+0000 7f33893ff640 1 -- 172.21.15.146:0/3450025338 >> 172.21.15.146:0/3450025338 conn(0x7f33840b2b50 msgr2=0x7f33840b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.063+0000 7f33893ff640 1 -- 172.21.15.146:0/3450025338 shutdown_connections 2024-09-17T03:35:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.063+0000 7f33893ff640 1 -- 172.21.15.146:0/3450025338 wait complete. 2024-09-17T03:35:47.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.065+0000 7f33893ff640 1 Processor -- start 2024-09-17T03:35:47.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.065+0000 7f33893ff640 1 -- start start 2024-09-17T03:35:47.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.066+0000 7f33893ff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3370006260 0x7f33841f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.066+0000 7f33893ff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33841f69f0 0x7f33841f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.066+0000 7f33893ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3384142dd0 0x7f33841431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.066+0000 7f33893ff640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3384158ec0 con 0x7f3384142dd0 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.066+0000 7f33893ff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f33840af190 con 0x7f33841f69f0 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.066+0000 7f33893ff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f338415ea70 con 0x7f3370006260 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.066+0000 7f33837fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3384142dd0 0x7f33841431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.066+0000 7f33837fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3384142dd0 0x7f33841431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39706/0 (socket says 172.21.15.146:39706) 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.066+0000 7f33837fe640 1 -- 172.21.15.146:0/1742213018 learned_addr learned my addr 172.21.15.146:0/1742213018 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.066+0000 7f3382ffd640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3370006260 0x7f33841f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.066+0000 7f337a7fc640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33841f69f0 0x7f33841f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.067+0000 7f33837fe640 1 -- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3370006260 msgr2=0x7f33841f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.067+0000 7f33837fe640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3370006260 0x7f33841f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.067+0000 7f33837fe640 1 -- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33841f69f0 msgr2=0x7f33841f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.067+0000 7f33837fe640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33841f69f0 0x7f33841f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.067+0000 7f33837fe640 1 -- 172.21.15.146:0/1742213018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3384143ce0 con 0x7f3384142dd0 2024-09-17T03:35:47.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.067+0000 7f33837fe640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3384142dd0 0x7f33841431e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f337c02af20 tx=0x7f337c033da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.067+0000 7f337bfff640 1 -- 172.21.15.146:0/1742213018 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c042070 con 0x7f3384142dd0 2024-09-17T03:35:47.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.067+0000 7f337bfff640 1 -- 172.21.15.146:0/1742213018 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f337c003b70 con 0x7f3384142dd0 2024-09-17T03:35:47.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.067+0000 7f33893ff640 1 -- 172.21.15.146:0/1742213018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33840b0a40 con 0x7f3384142dd0 2024-09-17T03:35:47.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.067+0000 7f337bfff640 1 -- 172.21.15.146:0/1742213018 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c038040 con 0x7f3384142dd0 2024-09-17T03:35:47.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.067+0000 7f33893ff640 1 -- 172.21.15.146:0/1742213018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33840b1000 con 0x7f3384142dd0 2024-09-17T03:35:47.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.069+0000 7f337bfff640 1 -- 172.21.15.146:0/1742213018 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f337c004030 con 0x7f3384142dd0 2024-09-17T03:35:47.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.069+0000 7f337bfff640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3364078b90 0x7f336407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.070+0000 7f337bfff640 1 -- 172.21.15.146:0/1742213018 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f337c0bb1d0 con 0x7f3384142dd0 2024-09-17T03:35:47.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.070+0000 7f3382ffd640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3364078b90 0x7f336407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.070+0000 7f3382ffd640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3364078b90 0x7f336407b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3374006cd0 tx=0x7f3374000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.070+0000 7f3390444740 1 Processor -- start 2024-09-17T03:35:47.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.071+0000 7f3390444740 1 -- start start 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f3390444740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd54e750 0x55f5dd93bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f3390444740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd525890 0x55f5dd8f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f3390444740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd8f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f3390444740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f5dd868b20 con 0x55f5dd525890 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f3390444740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f5dd857f50 con 0x55f5dd54e750 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f3390444740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f5dd85bd60 con 0x55f5dd52da70 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f337a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd525890 0x55f5dd8f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f337a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd525890 0x55f5dd8f0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39716/0 (socket says 172.21.15.146:39716) 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f337a7fc640 1 -- 172.21.15.146:0/1116148504 learned_addr learned my addr 172.21.15.146:0/1116148504 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f3382ffd640 1 --2- 172.21.15.146:0/1116148504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd54e750 0x55f5dd93bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f33837fe640 1 --2- 172.21.15.146:0/1116148504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd8f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f337a7fc640 1 -- 172.21.15.146:0/1116148504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 msgr2=0x55f5dd8f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f337a7fc640 1 --2- 172.21.15.146:0/1116148504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd8f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f337a7fc640 1 -- 172.21.15.146:0/1116148504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd54e750 msgr2=0x55f5dd93bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f337a7fc640 1 --2- 172.21.15.146:0/1116148504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd54e750 0x55f5dd93bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f337a7fc640 1 -- 172.21.15.146:0/1116148504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5dd5b9d30 con 0x55f5dd525890 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f33837fe640 1 --2- 172.21.15.146:0/1116148504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd8f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f337a7fc640 1 --2- 172.21.15.146:0/1116148504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd525890 0x55f5dd8f0a90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f33840720c0 tx=0x7f336c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daedc31f7396f6a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.072+0000 7f3378ff9640 1 -- 172.21.15.146:0/1116148504 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c00de60 con 0x55f5dd525890 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.073+0000 7f3378ff9640 1 -- 172.21.15.146:0/1116148504 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f336c004250 con 0x55f5dd525890 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.073+0000 7f3378ff9640 1 -- 172.21.15.146:0/1116148504 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0035f0 con 0x55f5dd525890 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.073+0000 7f3390444740 1 -- 172.21.15.146:0/1116148504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd525890 msgr2=0x55f5dd8f0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.073+0000 7f3390444740 1 --2- 172.21.15.146:0/1116148504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd525890 0x55f5dd8f0a90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f33840720c0 tx=0x7f336c012820 comp rx=0 tx=0).stop 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.073+0000 7f3390444740 1 -- 172.21.15.146:0/1116148504 shutdown_connections 2024-09-17T03:35:47.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.073+0000 7f3390444740 1 --2- 172.21.15.146:0/1116148504 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd8f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.073+0000 7f3390444740 1 --2- 172.21.15.146:0/1116148504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd525890 0x55f5dd8f0a90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.073+0000 7f3390444740 1 --2- 172.21.15.146:0/1116148504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd54e750 0x55f5dd93bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.073+0000 7f3390444740 1 -- 172.21.15.146:0/1116148504 >> 172.21.15.146:0/1116148504 conn(0x55f5dd5428a0 msgr2=0x55f5dd8f5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.073+0000 7f3390444740 1 -- 172.21.15.146:0/1116148504 shutdown_connections 2024-09-17T03:35:47.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.074+0000 7f3390444740 1 -- 172.21.15.146:0/1116148504 wait complete. 2024-09-17T03:35:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.074+0000 7f3390444740 1 -- start start 2024-09-17T03:35:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.074+0000 7f3390444740 1 Processor -- start 2024-09-17T03:35:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3390444740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd525890 0x55f5dd931010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3390444740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd52da70 0x55f5dd91c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3390444740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3390444740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f5dd5c8b00 con 0x55f5dd54e750 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3390444740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f5dd7fd7c0 con 0x55f5dd52da70 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3390444740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f5dd9344e0 con 0x55f5dd525890 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3390444740 10 client.0 _ll_register_callbacks cb 0x55f5dd8555e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f33837fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f33837fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39726/0 (socket says 172.21.15.146:39726) 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f33837fe640 1 -- 172.21.15.146:0/963774344 learned_addr learned my addr 172.21.15.146:0/963774344 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f337a7fc640 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd52da70 0x55f5dd91c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3382ffd640 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd525890 0x55f5dd931010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f33837fe640 1 -- 172.21.15.146:0/963774344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd525890 msgr2=0x55f5dd931010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f33837fe640 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd525890 0x55f5dd931010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f33837fe640 1 -- 172.21.15.146:0/963774344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd52da70 msgr2=0x55f5dd91c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f33837fe640 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd52da70 0x55f5dd91c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f33837fe640 1 -- 172.21.15.146:0/963774344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5dd630b90 con 0x55f5dd54e750 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f33837fe640 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94d150 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f337c0b9660 tx=0x7f337c083550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a143d5d354097a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3361ffb640 1 -- 172.21.15.146:0/963774344 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c009200 con 0x55f5dd54e750 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3361ffb640 1 -- 172.21.15.146:0/963774344 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f337c0810e0 con 0x55f5dd54e750 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.076+0000 7f3390444740 1 -- 172.21.15.146:0/963774344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f336c004250 con 0x55f5dd54e750 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3361ffb640 1 -- 172.21.15.146:0/963774344 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f337c0a4050 con 0x55f5dd54e750 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3390444740 10 client.5754 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3390444740 1 -- 172.21.15.146:0/963774344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55f5dd907ec0 con 0x55f5dd54e750 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3361ffb640 1 -- 172.21.15.146:0/963774344 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f336c004250 con 0x55f5dd54e750 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3361ffb640 1 -- 172.21.15.146:0/963774344 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f337c03b070 con 0x55f5dd54e750 2024-09-17T03:35:47.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3390444740 10 client.5754 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3390444740 10 client.5754 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3390444740 20 client.5754 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3390444740 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f5dd50d320 0x55f5dd9331a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3390444740 4 client.5754 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3390444740 1 -- 172.21.15.146:0/963774344 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5dd86aa70 con 0x55f5dd50d320 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3382ffd640 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f5dd50d320 0x55f5dd9331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3361ffb640 10 client.5754 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.077+0000 7f3382ffd640 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f5dd50d320 0x55f5dd9331a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad75b23f5e3ec3f9 server_cookie=c2032a393388b6f9 in_seq=0 out_seq=0 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3361ffb640 1 -- 172.21.15.146:0/963774344 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f5dd86aa70 con 0x55f5dd50d320 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3361ffb640 10 client.5754 handle_command_reply: tid=0 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 1 client.5754 shutdown 2024-09-17T03:35:47.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 1 -- 172.21.15.146:0/963774344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 msgr2=0x55f5dd94d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94d150 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f337c0b9660 tx=0x7f337c083550 comp rx=0 tx=0).stop 2024-09-17T03:35:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 1 -- 172.21.15.146:0/963774344 shutdown_connections 2024-09-17T03:35:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f5dd50d320 0x55f5dd9331a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94d150 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3361ffb640 0 client.5754 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd52da70 0x55f5dd91c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 1 --2- 172.21.15.146:0/963774344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd525890 0x55f5dd931010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 1 -- 172.21.15.146:0/963774344 >> 172.21.15.146:0/963774344 conn(0x55f5dd5428a0 msgr2=0x55f5dd8f0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 1 -- 172.21.15.146:0/963774344 shutdown_connections 2024-09-17T03:35:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 1 -- 172.21.15.146:0/963774344 wait complete. 2024-09-17T03:35:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.078+0000 7f3390444740 20 client.5754 trim_cache size 0 max 16384 2024-09-17T03:35:47.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.093+0000 7f3390444740 1 Processor -- start 2024-09-17T03:35:47.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.093+0000 7f3390444740 1 -- start start 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.094+0000 7f3390444740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd525890 0x55f5dd8f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.094+0000 7f3390444740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd8f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.094+0000 7f3390444740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.094+0000 7f3390444740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3384200390 con 0x55f5dd54e750 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.094+0000 7f3390444740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3384146540 con 0x55f5dd525890 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.094+0000 7f3390444740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f33840b2250 con 0x55f5dd52da70 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f33837fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f33837fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39736/0 (socket says 172.21.15.146:39736) 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f33837fe640 1 -- 172.21.15.146:0/4173420109 learned_addr learned my addr 172.21.15.146:0/4173420109 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f337a7fc640 1 --2- 172.21.15.146:0/4173420109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd8f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f3382ffd640 1 --2- 172.21.15.146:0/4173420109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd525890 0x55f5dd8f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f33837fe640 1 -- 172.21.15.146:0/4173420109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 msgr2=0x55f5dd8f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f33837fe640 1 --2- 172.21.15.146:0/4173420109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd8f3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f33837fe640 1 -- 172.21.15.146:0/4173420109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd525890 msgr2=0x55f5dd8f36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f33837fe640 1 --2- 172.21.15.146:0/4173420109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd525890 0x55f5dd8f36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f33837fe640 1 -- 172.21.15.146:0/4173420109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5dd8f1e60 con 0x55f5dd54e750 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f33837fe640 1 --2- 172.21.15.146:0/4173420109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94bbd0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f337c00e350 tx=0x7f337c082820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49fddebc4c954cf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f3363fff640 1 -- 172.21.15.146:0/4173420109 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c09d220 con 0x55f5dd54e750 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f3363fff640 1 -- 172.21.15.146:0/4173420109 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f337c0879b0 con 0x55f5dd54e750 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.095+0000 7f3363fff640 1 -- 172.21.15.146:0/4173420109 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c009ad0 con 0x55f5dd54e750 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.096+0000 7f3390444740 1 -- 172.21.15.146:0/4173420109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 msgr2=0x55f5dd94bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.096+0000 7f3390444740 1 --2- 172.21.15.146:0/4173420109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94bbd0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f337c00e350 tx=0x7f337c082820 comp rx=0 tx=0).stop 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.096+0000 7f3390444740 1 -- 172.21.15.146:0/4173420109 shutdown_connections 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.096+0000 7f3390444740 1 --2- 172.21.15.146:0/4173420109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd94bbd0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.096+0000 7f3390444740 1 --2- 172.21.15.146:0/4173420109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd8f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.096+0000 7f3390444740 1 --2- 172.21.15.146:0/4173420109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd525890 0x55f5dd8f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.096+0000 7f3390444740 1 -- 172.21.15.146:0/4173420109 >> 172.21.15.146:0/4173420109 conn(0x55f5dd5428a0 msgr2=0x55f5dd93b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.096+0000 7f3390444740 1 -- 172.21.15.146:0/4173420109 shutdown_connections 2024-09-17T03:35:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.096+0000 7f3390444740 1 -- 172.21.15.146:0/4173420109 wait complete. 2024-09-17T03:35:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.097+0000 7f3390444740 1 -- start start 2024-09-17T03:35:47.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.097+0000 7f3390444740 1 Processor -- start 2024-09-17T03:35:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f3390444740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd525890 0x55f5dd9b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f3390444740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd9bcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f3390444740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd9bd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f3390444740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f5dd93c330 con 0x55f5dd54e750 2024-09-17T03:35:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f3390444740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3384145ed0 con 0x55f5dd525890 2024-09-17T03:35:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f3390444740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f5dd8f0f30 con 0x55f5dd52da70 2024-09-17T03:35:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f3390444740 10 client.0 _ll_register_callbacks cb 0x7f337c009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f33837fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd9bd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f33837fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd9bd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39740/0 (socket says 172.21.15.146:39740) 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f33837fe640 1 -- 172.21.15.146:0/3555311599 learned_addr learned my addr 172.21.15.146:0/3555311599 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f3382ffd640 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd525890 0x55f5dd9b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f337a7fc640 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd9bcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f33837fe640 1 -- 172.21.15.146:0/3555311599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 msgr2=0x55f5dd9bcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f33837fe640 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd9bcea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.098+0000 7f33837fe640 1 -- 172.21.15.146:0/3555311599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd525890 msgr2=0x55f5dd9b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f33837fe640 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd525890 0x55f5dd9b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f33837fe640 1 -- 172.21.15.146:0/3555311599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5dd8f3bf0 con 0x55f5dd54e750 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f33837fe640 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd9bd3e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f337c082c80 tx=0x7f337c009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe18f9b83b056f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3361ffb640 1 -- 172.21.15.146:0/3555311599 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c091030 con 0x55f5dd54e750 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3361ffb640 1 -- 172.21.15.146:0/3555311599 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f337c0a90d0 con 0x55f5dd54e750 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3390444740 1 -- 172.21.15.146:0/3555311599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f337c0879b0 con 0x55f5dd54e750 2024-09-17T03:35:47.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3361ffb640 1 -- 172.21.15.146:0/3555311599 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f337c009200 con 0x55f5dd54e750 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3390444740 10 client.5760 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3390444740 1 -- 172.21.15.146:0/3555311599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55f5dd8f3bf0 con 0x55f5dd54e750 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3361ffb640 1 -- 172.21.15.146:0/3555311599 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f337c0879b0 con 0x55f5dd54e750 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3361ffb640 1 -- 172.21.15.146:0/3555311599 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f337c08cb40 con 0x55f5dd54e750 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3390444740 10 client.5760 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3390444740 10 client.5760 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3390444740 20 client.5760 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3390444740 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f5dd8f14e0 0x55f5dd91ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3390444740 4 client.5760 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3390444740 1 -- 172.21.15.146:0/3555311599 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x55f5dd866520 con 0x55f5dd8f14e0 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.099+0000 7f3382ffd640 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f5dd8f14e0 0x55f5dd91ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.100+0000 7f3361ffb640 10 client.5760 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.100+0000 7f3382ffd640 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f5dd8f14e0 0x55f5dd91ea80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ddb236b44789fda server_cookie=99fb3cbc92b66d7a in_seq=0 out_seq=0 2024-09-17T03:35:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3361ffb640 1 -- 172.21.15.146:0/3555311599 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f5dd866520 con 0x55f5dd8f14e0 2024-09-17T03:35:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3361ffb640 10 client.5760 handle_command_reply: tid=0 2024-09-17T03:35:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 1 client.5760 shutdown 2024-09-17T03:35:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 1 -- 172.21.15.146:0/3555311599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 msgr2=0x55f5dd9bd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd9bd3e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f337c082c80 tx=0x7f337c009e20 comp rx=0 tx=0).stop 2024-09-17T03:35:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 1 -- 172.21.15.146:0/3555311599 shutdown_connections 2024-09-17T03:35:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f5dd8f14e0 0x55f5dd91ea80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5dd54e750 0x55f5dd9bd3e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3361ffb640 0 client.5760 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f5dd52da70 0x55f5dd9bcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 1 --2- 172.21.15.146:0/3555311599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f5dd525890 0x55f5dd9b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 1 -- 172.21.15.146:0/3555311599 >> 172.21.15.146:0/3555311599 conn(0x55f5dd5428a0 msgr2=0x55f5dd95dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 1 -- 172.21.15.146:0/3555311599 shutdown_connections 2024-09-17T03:35:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 1 -- 172.21.15.146:0/3555311599 wait complete. 2024-09-17T03:35:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.105+0000 7f3390444740 20 client.5760 trim_cache size 0 max 16384 2024-09-17T03:35:47.106 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:47.106 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:35:47.106 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:35:47.106 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:47.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 -- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3364078b90 msgr2=0x7f336407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3364078b90 0x7f336407b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3374006cd0 tx=0x7f3374000ed0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 -- 172.21.15.146:0/1742213018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3384142dd0 msgr2=0x7f33841431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3384142dd0 0x7f33841431e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f337c02af20 tx=0x7f337c033da0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 -- 172.21.15.146:0/1742213018 shutdown_connections 2024-09-17T03:35:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3364078b90 0x7f336407b0a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3384142dd0 0x7f33841431e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33841f69f0 0x7f33841f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 --2- 172.21.15.146:0/1742213018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3370006260 0x7f33841f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 -- 172.21.15.146:0/1742213018 >> 172.21.15.146:0/1742213018 conn(0x7f33840b2b50 msgr2=0x7f3384155220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 -- 172.21.15.146:0/1742213018 shutdown_connections 2024-09-17T03:35:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.106+0000 7f33893ff640 1 -- 172.21.15.146:0/1742213018 wait complete. 2024-09-17T03:35:47.116 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'message': '', 'return_code': 0}' 2024-09-17T03:35:47.116 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:35:47.116 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:35:47.117 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-09-17T03:35:47.117 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:35:47.117 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-09-17T03:35:47.117 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:35:47.182 INFO:teuthology.orchestra.run.smithi146.stdout:1099511630412 2024-09-17T03:35:47.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:47.191 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-17T03:35:47.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.348+0000 7f0a57f13640 1 -- 172.21.15.146:0/3972916042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a3c004800 msgr2=0x7f0a3c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.349+0000 7f0a57f13640 1 --2- 172.21.15.146:0/3972916042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a3c004800 0x7f0a3c004c10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009b50 tx=0x7f0a3c005830 comp rx=0 tx=0).stop 2024-09-17T03:35:47.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.349+0000 7f0a564b0640 1 -- 172.21.15.146:0/3972916042 reap_dead start 2024-09-17T03:35:47.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.349+0000 7f0a57f13640 1 -- 172.21.15.146:0/3972916042 shutdown_connections 2024-09-17T03:35:47.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.349+0000 7f0a57f13640 1 -- 172.21.15.146:0/3972916042 >> 172.21.15.146:0/3972916042 conn(0x7f0a500b3150 msgr2=0x7f0a500b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.349+0000 7f0a57f13640 1 -- 172.21.15.146:0/3972916042 shutdown_connections 2024-09-17T03:35:47.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.349+0000 7f0a57f13640 1 -- 172.21.15.146:0/3972916042 wait complete. 2024-09-17T03:35:47.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.350+0000 7f0a57f13640 1 Processor -- start 2024-09-17T03:35:47.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.350+0000 7f0a57f13640 1 -- start start 2024-09-17T03:35:47.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a57f13640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a3c004800 0x7f0a501f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a57f13640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a501f9590 0x7f0a501f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a57f13640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a501f8ef0 0x7f0a5014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a57f13640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a500b6890 con 0x7f0a501f8ef0 2024-09-17T03:35:47.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a57f13640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0a500b6710 con 0x7f0a501f9590 2024-09-17T03:35:47.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a57f13640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0a5006cc50 con 0x7f0a3c004800 2024-09-17T03:35:47.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a564b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a501f8ef0 0x7f0a5014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a564b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a501f8ef0 0x7f0a5014c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53588/0 (socket says 172.21.15.146:53588) 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a564b0640 1 -- 172.21.15.146:0/3742196423 learned_addr learned my addr 172.21.15.146:0/3742196423 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a554ae640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a501f9590 0x7f0a501f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a55caf640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a3c004800 0x7f0a501f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a564b0640 1 -- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a3c004800 msgr2=0x7f0a501f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a564b0640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a3c004800 0x7f0a501f4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a564b0640 1 -- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a501f9590 msgr2=0x7f0a501f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a564b0640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a501f9590 0x7f0a501f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a564b0640 1 -- 172.21.15.146:0/3742196423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a501f52b0 con 0x7f0a501f8ef0 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a554ae640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a501f9590 0x7f0a501f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a55caf640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a3c004800 0x7f0a501f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a564b0640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a501f8ef0 0x7f0a5014c8e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0a480013d0 tx=0x7f0a48006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.352+0000 7f0a467fc640 1 -- 172.21.15.146:0/3742196423 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800fa20 con 0x7f0a501f8ef0 2024-09-17T03:35:47.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.353+0000 7f0a467fc640 1 -- 172.21.15.146:0/3742196423 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a4800fc00 con 0x7f0a501f8ef0 2024-09-17T03:35:47.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.353+0000 7f0a467fc640 1 -- 172.21.15.146:0/3742196423 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a48011430 con 0x7f0a501f8ef0 2024-09-17T03:35:47.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.353+0000 7f0a57f13640 1 -- 172.21.15.146:0/3742196423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a501f9300 con 0x7f0a501f8ef0 2024-09-17T03:35:47.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.353+0000 7f0a57f13640 1 -- 172.21.15.146:0/3742196423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a5014bb20 con 0x7f0a501f8ef0 2024-09-17T03:35:47.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.354+0000 7f0a467fc640 1 -- 172.21.15.146:0/3742196423 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a480115d0 con 0x7f0a501f8ef0 2024-09-17T03:35:47.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.355+0000 7f0a467fc640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a34078b90 0x7f0a3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.355+0000 7f0a467fc640 1 -- 172.21.15.146:0/3742196423 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f0a4809b770 con 0x7f0a501f8ef0 2024-09-17T03:35:47.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.356+0000 7f0a55caf640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a34078b90 0x7f0a3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.356+0000 7f0a55caf640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a34078b90 0x7f0a3407b0a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c000c00 tx=0x7f0a4c006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.356+0000 7f0a5ee82740 1 Processor -- start 2024-09-17T03:35:47.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.356+0000 7f0a5ee82740 1 -- start start 2024-09-17T03:35:47.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.357+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.357+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5241fd4d0 0x55a5245f8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.357+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5242056b0 0x55a524615610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.357+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a5245408e0 con 0x55a524226390 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.357+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a52452fd10 con 0x55a5242056b0 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.357+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a524533b20 con 0x55a5241fd4d0 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a55caf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a55caf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53600/0 (socket says 172.21.15.146:53600) 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a55caf640 1 -- 172.21.15.146:0/2722657844 learned_addr learned my addr 172.21.15.146:0/2722657844 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a554ae640 1 --2- 172.21.15.146:0/2722657844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5241fd4d0 0x55a5245f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a564b0640 1 --2- 172.21.15.146:0/2722657844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5242056b0 0x55a524615610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a55caf640 1 -- 172.21.15.146:0/2722657844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5241fd4d0 msgr2=0x55a5245f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a55caf640 1 --2- 172.21.15.146:0/2722657844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5241fd4d0 0x55a5245f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a55caf640 1 -- 172.21.15.146:0/2722657844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5242056b0 msgr2=0x55a524615610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a55caf640 1 --2- 172.21.15.146:0/2722657844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5242056b0 0x55a524615610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a55caf640 1 -- 172.21.15.146:0/2722657844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a524291970 con 0x55a524226390 2024-09-17T03:35:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a55caf640 1 --2- 172.21.15.146:0/2722657844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f81d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0128b0 tx=0x7f0a4c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc37ae402658845 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a337fe640 1 -- 172.21.15.146:0/2722657844 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c022070 con 0x55a524226390 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a337fe640 1 -- 172.21.15.146:0/2722657844 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a4c001990 con 0x55a524226390 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.358+0000 7f0a337fe640 1 -- 172.21.15.146:0/2722657844 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c016070 con 0x55a524226390 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.359+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2722657844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 msgr2=0x55a5245f81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.359+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/2722657844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f81d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0128b0 tx=0x7f0a4c013000 comp rx=0 tx=0).stop 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.359+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2722657844 shutdown_connections 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.359+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/2722657844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5242056b0 0x55a524615610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.359+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/2722657844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5241fd4d0 0x55a5245f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.359+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/2722657844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f81d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.359+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2722657844 >> 172.21.15.146:0/2722657844 conn(0x55a52421a4e0 msgr2=0x55a5245ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.359+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2722657844 shutdown_connections 2024-09-17T03:35:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.359+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2722657844 wait complete. 2024-09-17T03:35:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.360+0000 7f0a5ee82740 1 -- start start 2024-09-17T03:35:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.360+0000 7f0a5ee82740 1 Processor -- start 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5241fd4d0 0x55a5245e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a524226390 0x55a5245f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a5242a0740 con 0x55a5242056b0 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a5244d57f0 con 0x55a524226390 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a5245f8c50 con 0x55a5241fd4d0 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a5ee82740 10 client.0 _ll_register_callbacks cb 0x55a5244d92a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a554ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a554ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245f74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53610/0 (socket says 172.21.15.146:53610) 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a554ae640 1 -- 172.21.15.146:0/329031568 learned_addr learned my addr 172.21.15.146:0/329031568 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a564b0640 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a524226390 0x55a5245f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a55caf640 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5241fd4d0 0x55a5245e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a554ae640 1 -- 172.21.15.146:0/329031568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5241fd4d0 msgr2=0x55a5245e3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a554ae640 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5241fd4d0 0x55a5245e3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a554ae640 1 -- 172.21.15.146:0/329031568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a524226390 msgr2=0x55a5245f79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a554ae640 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a524226390 0x55a5245f79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a554ae640 1 -- 172.21.15.146:0/329031568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5243087d0 con 0x55a5242056b0 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a55caf640 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5241fd4d0 0x55a5245e3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a554ae640 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245f74a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009b50 tx=0x7f0a400097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ac59d89fce17c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a30ff9640 1 -- 172.21.15.146:0/329031568 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a40045070 con 0x55a5242056b0 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a30ff9640 1 -- 172.21.15.146:0/329031568 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f0a40004220 con 0x55a5242056b0 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a5ee82740 1 -- 172.21.15.146:0/329031568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a4c001990 con 0x55a5242056b0 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a30ff9640 1 -- 172.21.15.146:0/329031568 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0a4004f050 con 0x55a5242056b0 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a5ee82740 10 client.5772 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.362+0000 7f0a5ee82740 1 -- 172.21.15.146:0/329031568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55a5245e44c0 con 0x55a5242056b0 2024-09-17T03:35:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.363+0000 7f0a30ff9640 1 -- 172.21.15.146:0/329031568 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a4c001990 con 0x55a5242056b0 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.363+0000 7f0a30ff9640 1 -- 172.21.15.146:0/329031568 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f0a40052020 con 0x55a5242056b0 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.363+0000 7f0a5ee82740 10 client.5772 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.363+0000 7f0a5ee82740 10 client.5772 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.363+0000 7f0a5ee82740 20 client.5772 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.363+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a5241e4f60 0x55a524609f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.363+0000 7f0a5ee82740 4 client.5772 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.363+0000 7f0a5ee82740 1 -- 172.21.15.146:0/329031568 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a524542830 con 0x55a5241e4f60 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.363+0000 7f0a55caf640 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a5241e4f60 0x55a524609f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.363+0000 7f0a30ff9640 10 client.5772 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.363+0000 7f0a55caf640 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a5241e4f60 0x55a524609f70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9671e79a46736806 server_cookie=3ccb60b3a546d1b1 in_seq=0 out_seq=0 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a30ff9640 1 -- 172.21.15.146:0/329031568 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a524542830 con 0x55a5241e4f60 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a30ff9640 10 client.5772 handle_command_reply: tid=0 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 1 client.5772 shutdown 2024-09-17T03:35:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 1 -- 172.21.15.146:0/329031568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 msgr2=0x55a5245f74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245f74a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009b50 tx=0x7f0a400097f0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 1 -- 172.21.15.146:0/329031568 shutdown_connections 2024-09-17T03:35:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a5241e4f60 0x55a524609f70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a524226390 0x55a5245f79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245f74a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a30ff9640 0 client.5772 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/329031568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5241fd4d0 0x55a5245e3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 1 -- 172.21.15.146:0/329031568 >> 172.21.15.146:0/329031568 conn(0x55a52421a4e0 msgr2=0x55a524614be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 1 -- 172.21.15.146:0/329031568 shutdown_connections 2024-09-17T03:35:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 1 -- 172.21.15.146:0/329031568 wait complete. 2024-09-17T03:35:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.364+0000 7f0a5ee82740 20 client.5772 trim_cache size 0 max 16384 2024-09-17T03:35:47.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.378+0000 7f0a5ee82740 1 Processor -- start 2024-09-17T03:35:47.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.378+0000 7f0a5ee82740 1 -- start start 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5241fd4d0 0x55a52461eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5242056b0 0x55a52461f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a50202800 con 0x55a524226390 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0a50201820 con 0x55a5241fd4d0 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0a50200d40 con 0x55a5242056b0 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a564b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a564b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53624/0 (socket says 172.21.15.146:53624) 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a564b0640 1 -- 172.21.15.146:0/3520409551 learned_addr learned my addr 172.21.15.146:0/3520409551 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a55caf640 1 --2- 172.21.15.146:0/3520409551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5241fd4d0 0x55a52461eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a554ae640 1 --2- 172.21.15.146:0/3520409551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5242056b0 0x55a52461f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a564b0640 1 -- 172.21.15.146:0/3520409551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5242056b0 msgr2=0x55a52461f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a564b0640 1 --2- 172.21.15.146:0/3520409551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5242056b0 0x55a52461f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a564b0640 1 -- 172.21.15.146:0/3520409551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5241fd4d0 msgr2=0x55a52461eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a564b0640 1 --2- 172.21.15.146:0/3520409551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5241fd4d0 0x55a52461eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.379+0000 7f0a564b0640 1 -- 172.21.15.146:0/3520409551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52460cf60 con 0x55a524226390 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.380+0000 7f0a564b0640 1 --2- 172.21.15.146:0/3520409551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f7fa0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0a48006fd0 tx=0x7f0a4805fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddb4955b7eb8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.380+0000 7f0a32ffd640 1 -- 172.21.15.146:0/3520409551 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a48063b60 con 0x55a524226390 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.380+0000 7f0a32ffd640 1 -- 172.21.15.146:0/3520409551 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a48063460 con 0x55a524226390 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.380+0000 7f0a32ffd640 1 -- 172.21.15.146:0/3520409551 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4806cb60 con 0x55a524226390 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.380+0000 7f0a5ee82740 1 -- 172.21.15.146:0/3520409551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 msgr2=0x55a5245f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.380+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/3520409551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f7fa0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0a48006fd0 tx=0x7f0a4805fb30 comp rx=0 tx=0).stop 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.380+0000 7f0a5ee82740 1 -- 172.21.15.146:0/3520409551 shutdown_connections 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.380+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/3520409551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a524226390 0x55a5245f7fa0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.380+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/3520409551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a5242056b0 0x55a52461f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.380+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/3520409551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5241fd4d0 0x55a52461eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.380+0000 7f0a5ee82740 1 -- 172.21.15.146:0/3520409551 >> 172.21.15.146:0/3520409551 conn(0x55a52421a4e0 msgr2=0x55a5245e6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.381+0000 7f0a5ee82740 1 -- 172.21.15.146:0/3520409551 shutdown_connections 2024-09-17T03:35:47.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.381+0000 7f0a5ee82740 1 -- 172.21.15.146:0/3520409551 wait complete. 2024-09-17T03:35:47.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.381+0000 7f0a5ee82740 1 -- start start 2024-09-17T03:35:47.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.381+0000 7f0a5ee82740 1 Processor -- start 2024-09-17T03:35:47.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5241fd4d0 0x55a5246776f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245e2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a5ee82740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a524226390 0x55a5245e2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a50201230 con 0x55a5242056b0 2024-09-17T03:35:47.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a5245ca800 con 0x55a5241fd4d0 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a5ee82740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a5245f4b40 con 0x55a524226390 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a5ee82740 10 client.0 _ll_register_callbacks cb 0x7f0a3c0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a554ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a554ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245e2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53634/0 (socket says 172.21.15.146:53634) 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a554ae640 1 -- 172.21.15.146:0/2141008300 learned_addr learned my addr 172.21.15.146:0/2141008300 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a554ae640 1 -- 172.21.15.146:0/2141008300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a524226390 msgr2=0x55a5245e2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a55caf640 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5241fd4d0 0x55a5246776f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a564b0640 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a524226390 0x55a5245e2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a554ae640 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a524226390 0x55a5245e2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a554ae640 1 -- 172.21.15.146:0/2141008300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5241fd4d0 msgr2=0x55a5246776f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a554ae640 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5241fd4d0 0x55a5246776f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a554ae640 1 -- 172.21.15.146:0/2141008300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a524621e40 con 0x55a5242056b0 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a55caf640 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5241fd4d0 0x55a5246776f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:47.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a564b0640 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a524226390 0x55a5245e2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a554ae640 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245e2120 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0a4002b4d0 tx=0x7f0a40034b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d075cc4689b688 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.383+0000 7f0a30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a30ff9640 1 -- 172.21.15.146:0/2141008300 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a40043070 con 0x55a5242056b0 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a30ff9640 1 -- 172.21.15.146:0/2141008300 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f0a40005220 con 0x55a5242056b0 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2141008300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a48063460 con 0x55a5242056b0 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a30ff9640 1 -- 172.21.15.146:0/2141008300 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0a4005d050 con 0x55a5242056b0 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a5ee82740 10 client.5778 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2141008300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55a5246916d0 con 0x55a5242056b0 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a30ff9640 1 -- 172.21.15.146:0/2141008300 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a48063460 con 0x55a5242056b0 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a30ff9640 1 -- 172.21.15.146:0/2141008300 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f0a40060020 con 0x55a5242056b0 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a5ee82740 10 client.5778 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a5ee82740 10 client.5778 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a5ee82740 20 client.5778 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a52460c690 0x55a524622340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a5ee82740 4 client.5778 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2141008300 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a52453e2e0 con 0x55a52460c690 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a55caf640 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a52460c690 0x55a524622340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.384+0000 7f0a30ff9640 10 client.5778 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a55caf640 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a52460c690 0x55a524622340 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11cacca5eb586de3 server_cookie=3fa32b08e430d02d in_seq=0 out_seq=0 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a30ff9640 1 -- 172.21.15.146:0/2141008300 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a52453e2e0 con 0x55a52460c690 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a30ff9640 10 client.5778 handle_command_reply: tid=0 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 1 client.5778 shutdown 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2141008300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 msgr2=0x55a5245e2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245e2120 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0a4002b4d0 tx=0x7f0a40034b60 comp rx=0 tx=0).stop 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2141008300 shutdown_connections 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55a52460c690 0x55a524622340 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a524226390 0x55a5245e2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5242056b0 0x55a5245e2120 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a30ff9640 0 client.5778 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 1 --2- 172.21.15.146:0/2141008300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a5241fd4d0 0x55a5246776f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2141008300 >> 172.21.15.146:0/2141008300 conn(0x55a52421a4e0 msgr2=0x55a52461eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2141008300 shutdown_connections 2024-09-17T03:35:47.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 1 -- 172.21.15.146:0/2141008300 wait complete. 2024-09-17T03:35:47.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.385+0000 7f0a5ee82740 20 client.5778 trim_cache size 0 max 16384 2024-09-17T03:35:47.390 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2024-09-17T03:35:47.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 -- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a34078b90 msgr2=0x7f0a3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a34078b90 0x7f0a3407b0a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c000c00 tx=0x7f0a4c006ba0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 -- 172.21.15.146:0/3742196423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a501f8ef0 msgr2=0x7f0a5014c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a501f8ef0 0x7f0a5014c8e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0a480013d0 tx=0x7f0a48006720 comp rx=0 tx=0).stop 2024-09-17T03:35:47.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 -- 172.21.15.146:0/3742196423 shutdown_connections 2024-09-17T03:35:47.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a34078b90 0x7f0a3407b0a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a501f8ef0 0x7f0a5014c8e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a501f9590 0x7f0a501f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 --2- 172.21.15.146:0/3742196423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a3c004800 0x7f0a501f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 -- 172.21.15.146:0/3742196423 >> 172.21.15.146:0/3742196423 conn(0x7f0a500b3150 msgr2=0x7f0a500b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 -- 172.21.15.146:0/3742196423 shutdown_connections 2024-09-17T03:35:47.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.386+0000 7f0a57f13640 1 -- 172.21.15.146:0/3742196423 wait complete. 2024-09-17T03:35:47.397 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4c.00000000 parent 2024-09-17T03:35:47.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.454+0000 7fe76e95af40 1 Processor -- start 2024-09-17T03:35:47.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.454+0000 7fe76e95af40 1 -- start start 2024-09-17T03:35:47.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.455+0000 7fe76e95af40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5571a4da4ce0 0x5571a4e38660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.455+0000 7fe76e95af40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4da5630 0x5571a4d773c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.455+0000 7fe76e95af40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5571a4e4df40 0x5571a4d77900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.455+0000 7fe76e95af40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5571a4cc5d60 con 0x5571a4da5630 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.455+0000 7fe76e95af40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5571a4d24430 con 0x5571a4e4df40 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.455+0000 7fe76e95af40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5571a4da63d0 con 0x5571a4da4ce0 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe75fc13640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4da5630 0x5571a4d773c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe75fc13640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4da5630 0x5571a4d773c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53648/0 (socket says 172.21.15.146:53648) 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe75fc13640 1 -- 172.21.15.146:0/4098902183 learned_addr learned my addr 172.21.15.146:0/4098902183 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe768414640 1 --2- 172.21.15.146:0/4098902183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5571a4da4ce0 0x5571a4e38660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe768c15640 1 --2- 172.21.15.146:0/4098902183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5571a4e4df40 0x5571a4d77900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe75fc13640 1 -- 172.21.15.146:0/4098902183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5571a4da4ce0 msgr2=0x5571a4e38660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe75fc13640 1 --2- 172.21.15.146:0/4098902183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5571a4da4ce0 0x5571a4e38660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe75fc13640 1 -- 172.21.15.146:0/4098902183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5571a4e4df40 msgr2=0x5571a4d77900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe75fc13640 1 --2- 172.21.15.146:0/4098902183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5571a4e4df40 0x5571a4d77900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe75fc13640 1 -- 172.21.15.146:0/4098902183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571a4da20a0 con 0x5571a4da5630 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe768414640 1 --2- 172.21.15.146:0/4098902183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5571a4da4ce0 0x5571a4e38660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:47.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe768c15640 1 --2- 172.21.15.146:0/4098902183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5571a4e4df40 0x5571a4d77900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe75fc13640 1 --2- 172.21.15.146:0/4098902183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4da5630 0x5571a4d773c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe750025f60 tx=0x7fe750002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6784af58d58c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe767412640 1 -- 172.21.15.146:0/4098902183 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75004d9c0 con 0x5571a4da5630 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe767412640 1 -- 172.21.15.146:0/4098902183 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe750056690 con 0x5571a4da5630 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.456+0000 7fe767412640 1 -- 172.21.15.146:0/4098902183 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750056ae0 con 0x5571a4da5630 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.457+0000 7fe76e95af40 1 -- 172.21.15.146:0/4098902183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4da5630 msgr2=0x5571a4d773c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.457+0000 7fe76e95af40 1 --2- 172.21.15.146:0/4098902183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4da5630 0x5571a4d773c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe750025f60 tx=0x7fe750002fb0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.457+0000 7fe76e95af40 1 -- 172.21.15.146:0/4098902183 shutdown_connections 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.457+0000 7fe76e95af40 1 --2- 172.21.15.146:0/4098902183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5571a4e4df40 0x5571a4d77900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.457+0000 7fe76e95af40 1 --2- 172.21.15.146:0/4098902183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4da5630 0x5571a4d773c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.457+0000 7fe76e95af40 1 --2- 172.21.15.146:0/4098902183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5571a4da4ce0 0x5571a4e38660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.457+0000 7fe76e95af40 1 -- 172.21.15.146:0/4098902183 >> 172.21.15.146:0/4098902183 conn(0x5571a4c96ac0 msgr2=0x5571a4dc1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.457+0000 7fe76e95af40 1 -- 172.21.15.146:0/4098902183 shutdown_connections 2024-09-17T03:35:47.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.457+0000 7fe76e95af40 1 -- 172.21.15.146:0/4098902183 wait complete. 2024-09-17T03:35:47.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.458+0000 7fe76e95af40 1 Processor -- start 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.458+0000 7fe76e95af40 1 -- start start 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe76e95af40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5571a4da4ce0 0x5571a4e33a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe76e95af40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5571a4da5630 0x5571a4dbc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe76e95af40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4e4df40 0x5571a4dbc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe76e95af40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5571a4e43f30 con 0x5571a4e4df40 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe76e95af40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5571a4da2340 con 0x5571a4da4ce0 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe76e95af40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5571a4e3ffe0 con 0x5571a4da5630 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe768c15640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4e4df40 0x5571a4dbc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe768c15640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4e4df40 0x5571a4dbc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53652/0 (socket says 172.21.15.146:53652) 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe768c15640 1 -- 172.21.15.146:0/3407621630 learned_addr learned my addr 172.21.15.146:0/3407621630 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe75fc13640 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5571a4da5630 0x5571a4dbc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe768414640 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5571a4da4ce0 0x5571a4e33a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe768c15640 1 -- 172.21.15.146:0/3407621630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5571a4da5630 msgr2=0x5571a4dbc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe768c15640 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5571a4da5630 0x5571a4dbc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe768c15640 1 -- 172.21.15.146:0/3407621630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5571a4da4ce0 msgr2=0x5571a4e33a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe768c15640 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5571a4da4ce0 0x5571a4e33a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.459+0000 7fe768c15640 1 -- 172.21.15.146:0/3407621630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571a4da3820 con 0x5571a4e4df40 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.460+0000 7fe768c15640 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4e4df40 0x5571a4dbc580 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe76000a5d0 tx=0x7fe76000aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.460+0000 7fe766410640 1 -- 172.21.15.146:0/3407621630 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76000e8f0 con 0x5571a4e4df40 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.460+0000 7fe766410640 1 -- 172.21.15.146:0/3407621630 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe76000ea90 con 0x5571a4e4df40 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.460+0000 7fe76e95af40 1 -- 172.21.15.146:0/3407621630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571a4d75770 con 0x5571a4e4df40 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.460+0000 7fe766410640 1 -- 172.21.15.146:0/3407621630 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76000d410 con 0x5571a4e4df40 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.460+0000 7fe76e95af40 1 -- 172.21.15.146:0/3407621630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571a4ee2b60 con 0x5571a4e4df40 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.462+0000 7fe766410640 1 -- 172.21.15.146:0/3407621630 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe76000b040 con 0x5571a4e4df40 2024-09-17T03:35:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.462+0000 7fe766410640 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7480775a0 0x7fe748079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.462+0000 7fe766410640 1 -- 172.21.15.146:0/3407621630 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe760099f90 con 0x5571a4e4df40 2024-09-17T03:35:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.462+0000 7fe768414640 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7480775a0 0x7fe748079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.462+0000 7fe76e95af40 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x5571a4dbfb20 0x5571a4ee4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.462+0000 7fe76e95af40 1 -- 172.21.15.146:0/3407621630 --> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] -- osd_op(unknown.0.0:1 7.3a 7:5fa3b718:::10000000a4c.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47) -- 0x5571a4d75c30 con 0x5571a4dbfb20 2024-09-17T03:35:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.462+0000 7fe75fc13640 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x5571a4dbfb20 0x5571a4ee4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.463+0000 7fe768414640 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7480775a0 0x7fe748079ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c6d0 tx=0x7fe758005950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.463+0000 7fe75fc13640 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x5571a4dbfb20 0x5571a4ee4540 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe75fc13640 1 -- 172.21.15.146:0/3407621630 <== osd.3 v2:172.21.15.146:6800/99103729 1 ==== osd_op_reply(1 10000000a4c.00000000 [rmxattr] v47'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe75005f030 con 0x5571a4dbfb20 2024-09-17T03:35:47.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe76e95af40 1 -- 172.21.15.146:0/3407621630 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x5571a4dbfb20 msgr2=0x5571a4ee4540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe76e95af40 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x5571a4dbfb20 0x5571a4ee4540 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe76e95af40 1 -- 172.21.15.146:0/3407621630 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7480775a0 msgr2=0x7fe748079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe76e95af40 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7480775a0 0x7fe748079ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c6d0 tx=0x7fe758005950 comp rx=0 tx=0).stop 2024-09-17T03:35:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe76e95af40 1 -- 172.21.15.146:0/3407621630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4e4df40 msgr2=0x5571a4dbc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe76e95af40 1 --2- 172.21.15.146:0/3407621630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5571a4e4df40 0x5571a4dbc580 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe76000a5d0 tx=0x7fe76000aa90 comp rx=0 tx=0).stop 2024-09-17T03:35:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe768c15640 1 -- 172.21.15.146:0/3407621630 reap_dead start 2024-09-17T03:35:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe76e95af40 1 -- 172.21.15.146:0/3407621630 shutdown_connections 2024-09-17T03:35:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe76e95af40 1 -- 172.21.15.146:0/3407621630 >> 172.21.15.146:0/3407621630 conn(0x5571a4c96ac0 msgr2=0x5571a4dc1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe76e95af40 1 -- 172.21.15.146:0/3407621630 shutdown_connections 2024-09-17T03:35:47.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.464+0000 7fe76e95af40 1 -- 172.21.15.146:0/3407621630 wait complete. 2024-09-17T03:35:47.467 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-17T03:35:47.467 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-17T03:35:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.585+0000 7f78d6df1640 1 -- 172.21.15.146:0/3735916978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78bc004d40 msgr2=0x7f78bc0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.585+0000 7f78d6df1640 1 --2- 172.21.15.146:0/3735916978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78bc004d40 0x7f78bc0051f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f78d00b8440 tx=0x7f78bc005830 comp rx=0 tx=0).stop 2024-09-17T03:35:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.585+0000 7f78d538e640 1 -- 172.21.15.146:0/3735916978 reap_dead start 2024-09-17T03:35:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.585+0000 7f78d6df1640 1 -- 172.21.15.146:0/3735916978 shutdown_connections 2024-09-17T03:35:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.585+0000 7f78d6df1640 1 -- 172.21.15.146:0/3735916978 >> 172.21.15.146:0/3735916978 conn(0x7f78d00b7b20 msgr2=0x7f78d009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.585+0000 7f78d6df1640 1 -- 172.21.15.146:0/3735916978 shutdown_connections 2024-09-17T03:35:47.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.585+0000 7f78d6df1640 1 -- 172.21.15.146:0/3735916978 wait complete. 2024-09-17T03:35:47.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.586+0000 7f78d6df1640 1 Processor -- start 2024-09-17T03:35:47.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.587+0000 7f78d6df1640 1 -- start start 2024-09-17T03:35:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78d6df1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc004d40 0x7f78d0145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78d6df1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78d015f910 0x7f78d0153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78d6df1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78d0153c50 0x7f78d01f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78d6df1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f78d015d1b0 con 0x7f78d015f910 2024-09-17T03:35:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78d6df1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78d00b38b0 con 0x7f78bc004d40 2024-09-17T03:35:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78d6df1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f78d015d330 con 0x7f78d0153c50 2024-09-17T03:35:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78cffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78d015f910 0x7f78d0153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78cffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78d015f910 0x7f78d0153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53674/0 (socket says 172.21.15.146:53674) 2024-09-17T03:35:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78cffff640 1 -- 172.21.15.146:0/661729653 learned_addr learned my addr 172.21.15.146:0/661729653 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc004d40 0x7f78d0145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78d538e640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78d0153c50 0x7f78d01f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78cffff640 1 -- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78d0153c50 msgr2=0x7f78d01f6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78cffff640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78d0153c50 0x7f78d01f6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78cffff640 1 -- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc004d40 msgr2=0x7f78d0145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78cffff640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc004d40 0x7f78d0145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78cffff640 1 -- 172.21.15.146:0/661729653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d0145570 con 0x7f78d015f910 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.588+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc004d40 0x7f78d0145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.589+0000 7f78cffff640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78d015f910 0x7f78d0153710 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f78b8011b10 tx=0x7f78b8009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.589+0000 7f78cd7fa640 1 -- 172.21.15.146:0/661729653 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b801e070 con 0x7f78d015f910 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.589+0000 7f78cd7fa640 1 -- 172.21.15.146:0/661729653 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78b8004050 con 0x7f78d015f910 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.589+0000 7f78d6df1640 1 -- 172.21.15.146:0/661729653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d0152950 con 0x7f78d015f910 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.589+0000 7f78cd7fa640 1 -- 172.21.15.146:0/661729653 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b800fea0 con 0x7f78d015f910 2024-09-17T03:35:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.589+0000 7f78d6df1640 1 -- 172.21.15.146:0/661729653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d0152f10 con 0x7f78d015f910 2024-09-17T03:35:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.591+0000 7f78cd7fa640 1 -- 172.21.15.146:0/661729653 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78b8021070 con 0x7f78d015f910 2024-09-17T03:35:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.591+0000 7f78cd7fa640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78b0078bc0 0x7f78b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.592+0000 7f78cd7fa640 1 -- 172.21.15.146:0/661729653 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f78b809b700 con 0x7f78d015f910 2024-09-17T03:35:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.592+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78b0078bc0 0x7f78b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.592+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78b0078bc0 0x7f78b007b0d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78c0006d10 tx=0x7f78c0006ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.592+0000 7f78dde3c740 1 Processor -- start 2024-09-17T03:35:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.592+0000 7f78dde3c740 1 -- start start 2024-09-17T03:35:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce82418e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 0x557ce81f6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e33ab0 0x557ce81f6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78dde3c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557ce816ec80 con 0x557ce7e54790 2024-09-17T03:35:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78dde3c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557ce815e0b0 con 0x557ce7e2b8d0 2024-09-17T03:35:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78dde3c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x557ce8161ec0 con 0x557ce7e33ab0 2024-09-17T03:35:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78d4b8d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce82418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78d4b8d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce82418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53676/0 (socket says 172.21.15.146:53676) 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78d4b8d640 1 -- 172.21.15.146:0/1936375443 learned_addr learned my addr 172.21.15.146:0/1936375443 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78d538e640 1 --2- 172.21.15.146:0/1936375443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e33ab0 0x557ce81f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78cffff640 1 --2- 172.21.15.146:0/1936375443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 0x557ce81f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78d4b8d640 1 -- 172.21.15.146:0/1936375443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e33ab0 msgr2=0x557ce81f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/1936375443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e33ab0 0x557ce81f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78d4b8d640 1 -- 172.21.15.146:0/1936375443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 msgr2=0x557ce81f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/1936375443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 0x557ce81f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78d4b8d640 1 -- 172.21.15.146:0/1936375443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ce7f38c00 con 0x557ce7e54790 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78d538e640 1 --2- 172.21.15.146:0/1936375443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e33ab0 0x557ce81f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/1936375443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce82418e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f78c0001f00 tx=0x7f78c0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd6c04510779336 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78c67fc640 1 -- 172.21.15.146:0/1936375443 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0025070 con 0x557ce7e54790 2024-09-17T03:35:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78c67fc640 1 -- 172.21.15.146:0/1936375443 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78c0001f30 con 0x557ce7e54790 2024-09-17T03:35:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.594+0000 7f78c67fc640 1 -- 172.21.15.146:0/1936375443 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0011630 con 0x557ce7e54790 2024-09-17T03:35:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.595+0000 7f78dde3c740 1 -- 172.21.15.146:0/1936375443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 msgr2=0x557ce82418e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.595+0000 7f78dde3c740 1 --2- 172.21.15.146:0/1936375443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce82418e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f78c0001f00 tx=0x7f78c0012000 comp rx=0 tx=0).stop 2024-09-17T03:35:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.595+0000 7f78dde3c740 1 -- 172.21.15.146:0/1936375443 shutdown_connections 2024-09-17T03:35:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.595+0000 7f78dde3c740 1 --2- 172.21.15.146:0/1936375443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e33ab0 0x557ce81f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.595+0000 7f78dde3c740 1 --2- 172.21.15.146:0/1936375443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 0x557ce81f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.595+0000 7f78dde3c740 1 --2- 172.21.15.146:0/1936375443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce82418e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.595+0000 7f78dde3c740 1 -- 172.21.15.146:0/1936375443 >> 172.21.15.146:0/1936375443 conn(0x557ce7e488e0 msgr2=0x557ce81fbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.595+0000 7f78dde3c740 1 -- 172.21.15.146:0/1936375443 shutdown_connections 2024-09-17T03:35:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.595+0000 7f78dde3c740 1 -- 172.21.15.146:0/1936375443 wait complete. 2024-09-17T03:35:47.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.596+0000 7f78dde3c740 1 -- start start 2024-09-17T03:35:47.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.596+0000 7f78dde3c740 1 Processor -- start 2024-09-17T03:35:47.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 0x557ce8225b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e33ab0 0x557ce821b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce821b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78dde3c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557ce7eceb40 con 0x557ce7e54790 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78dde3c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557ce8103620 con 0x557ce7e2b8d0 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78dde3c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x557ce82515a0 con 0x557ce7e33ab0 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78dde3c740 10 client.0 _ll_register_callbacks cb 0x557ce8156f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78d538e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce821b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78d538e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce821b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53686/0 (socket says 172.21.15.146:53686) 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78d538e640 1 -- 172.21.15.146:0/449528346 learned_addr learned my addr 172.21.15.146:0/449528346 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78cffff640 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e33ab0 0x557ce821b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 0x557ce8225b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78d538e640 1 -- 172.21.15.146:0/449528346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e33ab0 msgr2=0x557ce821b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78d538e640 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e33ab0 0x557ce821b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78d538e640 1 -- 172.21.15.146:0/449528346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 msgr2=0x557ce8225b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78d538e640 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 0x557ce8225b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78d538e640 1 -- 172.21.15.146:0/449528346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ce7e9daa0 con 0x557ce7e54790 2024-09-17T03:35:47.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78d538e640 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce821b560 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f78c802b260 tx=0x7f78c8006e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590572368506492a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78af7fe640 1 -- 172.21.15.146:0/449528346 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c80062a0 con 0x557ce7e54790 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78af7fe640 1 -- 172.21.15.146:0/449528346 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f78c8006440 con 0x557ce7e54790 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.598+0000 7f78dde3c740 1 -- 172.21.15.146:0/449528346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78c0001f30 con 0x557ce7e54790 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78af7fe640 1 -- 172.21.15.146:0/449528346 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f78c8001950 con 0x557ce7e54790 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78dde3c740 10 client.5799 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78dde3c740 1 -- 172.21.15.146:0/449528346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x557ce7f99390 con 0x557ce7e54790 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78af7fe640 1 -- 172.21.15.146:0/449528346 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78c0001f30 con 0x557ce7e54790 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78af7fe640 1 -- 172.21.15.146:0/449528346 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f78c803e030 con 0x557ce7e54790 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78dde3c740 10 client.5799 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78dde3c740 10 client.5799 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78dde3c740 20 client.5799 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78dde3c740 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557ce7e13360 0x557ce823abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78dde3c740 4 client.5799 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78dde3c740 1 -- 172.21.15.146:0/449528346 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ce8170bd0 con 0x557ce7e13360 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557ce7e13360 0x557ce823abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78af7fe640 10 client.5799 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.599+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557ce7e13360 0x557ce823abf0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12bf25bdbb9177ce server_cookie=84af98d435f8fced in_seq=0 out_seq=0 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78af7fe640 1 -- 172.21.15.146:0/449528346 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557ce8170bd0 con 0x557ce7e13360 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78af7fe640 10 client.5799 handle_command_reply: tid=0 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78dde3c740 1 client.5799 shutdown 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78dde3c740 1 -- 172.21.15.146:0/449528346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 msgr2=0x557ce821b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78dde3c740 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce821b560 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f78c802b260 tx=0x7f78c8006e70 comp rx=0 tx=0).stop 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78dde3c740 1 -- 172.21.15.146:0/449528346 shutdown_connections 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78dde3c740 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557ce7e13360 0x557ce823abf0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78dde3c740 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e54790 0x557ce821b560 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78dde3c740 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e33ab0 0x557ce821b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78af7fe640 0 client.5799 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78dde3c740 1 --2- 172.21.15.146:0/449528346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 0x557ce8225b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78dde3c740 1 -- 172.21.15.146:0/449528346 >> 172.21.15.146:0/449528346 conn(0x557ce7e488e0 msgr2=0x557ce8243760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78dde3c740 1 -- 172.21.15.146:0/449528346 shutdown_connections 2024-09-17T03:35:47.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.600+0000 7f78dde3c740 1 -- 172.21.15.146:0/449528346 wait complete. 2024-09-17T03:35:47.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.601+0000 7f78dde3c740 20 client.5799 trim_cache size 0 max 16384 2024-09-17T03:35:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.618+0000 7f78dde3c740 1 Processor -- start 2024-09-17T03:35:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.618+0000 7f78dde3c740 1 -- start start 2024-09-17T03:35:47.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.619+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 0x557ce8225810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.619+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce82416c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.619+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e54790 0x557ce8241c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.619+0000 7f78dde3c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f78d02008f0 con 0x557ce7e33ab0 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.619+0000 7f78dde3c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01ff8f0 con 0x557ce7e2b8d0 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.619+0000 7f78dde3c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f78d01f43f0 con 0x557ce7e54790 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.619+0000 7f78cffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce82416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.620+0000 7f78cffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce82416c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53698/0 (socket says 172.21.15.146:53698) 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.620+0000 7f78cffff640 1 -- 172.21.15.146:0/4063599972 learned_addr learned my addr 172.21.15.146:0/4063599972 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.620+0000 7f78cffff640 1 -- 172.21.15.146:0/4063599972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e54790 msgr2=0x557ce8241c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.620+0000 7f78cffff640 1 --2- 172.21.15.146:0/4063599972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e54790 0x557ce8241c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.620+0000 7f78cffff640 1 -- 172.21.15.146:0/4063599972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 msgr2=0x557ce8225810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.620+0000 7f78cffff640 1 --2- 172.21.15.146:0/4063599972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 0x557ce8225810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.620+0000 7f78cffff640 1 -- 172.21.15.146:0/4063599972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ce7f36f00 con 0x557ce7e33ab0 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.620+0000 7f78cffff640 1 --2- 172.21.15.146:0/4063599972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce82416c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f78b8063390 tx=0x7f78b80631a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5615734a5c33d1ef server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.620+0000 7f78c5ffb640 1 -- 172.21.15.146:0/4063599972 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8062af0 con 0x557ce7e33ab0 2024-09-17T03:35:47.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.620+0000 7f78c5ffb640 1 -- 172.21.15.146:0/4063599972 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78b806a2d0 con 0x557ce7e33ab0 2024-09-17T03:35:47.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.620+0000 7f78c5ffb640 1 -- 172.21.15.146:0/4063599972 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b805efe0 con 0x557ce7e33ab0 2024-09-17T03:35:47.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.621+0000 7f78dde3c740 1 -- 172.21.15.146:0/4063599972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 msgr2=0x557ce82416c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.621+0000 7f78dde3c740 1 --2- 172.21.15.146:0/4063599972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce82416c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f78b8063390 tx=0x7f78b80631a0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.621+0000 7f78dde3c740 1 -- 172.21.15.146:0/4063599972 shutdown_connections 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.621+0000 7f78dde3c740 1 --2- 172.21.15.146:0/4063599972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e54790 0x557ce8241c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.621+0000 7f78dde3c740 1 --2- 172.21.15.146:0/4063599972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce82416c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.621+0000 7f78dde3c740 1 --2- 172.21.15.146:0/4063599972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e2b8d0 0x557ce8225810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.621+0000 7f78dde3c740 1 -- 172.21.15.146:0/4063599972 >> 172.21.15.146:0/4063599972 conn(0x557ce7e488e0 msgr2=0x557ce81fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.621+0000 7f78dde3c740 1 -- 172.21.15.146:0/4063599972 shutdown_connections 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.621+0000 7f78dde3c740 1 -- 172.21.15.146:0/4063599972 wait complete. 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.622+0000 7f78dde3c740 1 -- start start 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.622+0000 7f78dde3c740 1 Processor -- start 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e2b8d0 0x557ce823d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce823dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78dde3c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e54790 0x557ce823e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78dde3c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01ff2a0 con 0x557ce7e33ab0 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78dde3c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557ce8221460 con 0x557ce7e54790 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78dde3c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x557ce81f89b0 con 0x557ce7e2b8d0 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78dde3c740 10 client.0 _ll_register_callbacks cb 0x7f78b8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78cffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce823dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78cffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce823dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53714/0 (socket says 172.21.15.146:53714) 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78cffff640 1 -- 172.21.15.146:0/53907959 learned_addr learned my addr 172.21.15.146:0/53907959 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e2b8d0 0x557ce823d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.623+0000 7f78d538e640 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e54790 0x557ce823e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78cffff640 1 -- 172.21.15.146:0/53907959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e2b8d0 msgr2=0x557ce823d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78cffff640 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e2b8d0 0x557ce823d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78cffff640 1 -- 172.21.15.146:0/53907959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e54790 msgr2=0x557ce823e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78cffff640 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e54790 0x557ce823e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78cffff640 1 -- 172.21.15.146:0/53907959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ce8221250 con 0x557ce7e33ab0 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78d538e640 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e54790 0x557ce823e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78cffff640 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce823dca0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f78b8011ae0 tx=0x7f78b80637b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a995861c08dbd33c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78af7fe640 1 -- 172.21.15.146:0/53907959 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8081070 con 0x557ce7e33ab0 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78af7fe640 1 -- 172.21.15.146:0/53907959 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f78b8089b90 con 0x557ce7e33ab0 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78dde3c740 1 -- 172.21.15.146:0/53907959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78b806a2d0 con 0x557ce7e33ab0 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78af7fe640 1 -- 172.21.15.146:0/53907959 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f78b8090050 con 0x557ce7e33ab0 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78dde3c740 10 client.5805 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78dde3c740 1 -- 172.21.15.146:0/53907959 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x557ce823d260 con 0x557ce7e33ab0 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78af7fe640 1 -- 172.21.15.146:0/53907959 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78b806a2d0 con 0x557ce7e33ab0 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78af7fe640 1 -- 172.21.15.146:0/53907959 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f78b8093020 con 0x557ce7e33ab0 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78dde3c740 10 client.5805 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78dde3c740 10 client.5805 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78dde3c740 20 client.5805 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78dde3c740 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557ce82c3550 0x557ce82c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78dde3c740 4 client.5805 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-17T03:35:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.624+0000 7f78dde3c740 1 -- 172.21.15.146:0/53907959 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x557ce816c680 con 0x557ce82c3550 2024-09-17T03:35:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.625+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557ce82c3550 0x557ce82c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.625+0000 7f78af7fe640 10 client.5805 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.625+0000 7f78d4b8d640 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557ce82c3550 0x557ce82c3960 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=280b8714f9757772 server_cookie=ad5dfc8f356aed5b in_seq=0 out_seq=0 2024-09-17T03:35:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78af7fe640 1 -- 172.21.15.146:0/53907959 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557ce816c680 con 0x557ce82c3550 2024-09-17T03:35:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78af7fe640 10 client.5805 handle_command_reply: tid=0 2024-09-17T03:35:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78dde3c740 1 client.5805 shutdown 2024-09-17T03:35:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78dde3c740 1 -- 172.21.15.146:0/53907959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 msgr2=0x557ce823dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78dde3c740 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce823dca0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f78b8011ae0 tx=0x7f78b80637b0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78dde3c740 1 -- 172.21.15.146:0/53907959 shutdown_connections 2024-09-17T03:35:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78dde3c740 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557ce82c3550 0x557ce82c3960 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78af7fe640 0 client.5805 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78dde3c740 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557ce7e54790 0x557ce823e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78dde3c740 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ce7e33ab0 0x557ce823dca0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78dde3c740 1 --2- 172.21.15.146:0/53907959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557ce7e2b8d0 0x557ce823d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78dde3c740 1 -- 172.21.15.146:0/53907959 >> 172.21.15.146:0/53907959 conn(0x557ce7e488e0 msgr2=0x557ce8225810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78dde3c740 1 -- 172.21.15.146:0/53907959 shutdown_connections 2024-09-17T03:35:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.626+0000 7f78dde3c740 1 -- 172.21.15.146:0/53907959 wait complete. 2024-09-17T03:35:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78dde3c740 20 client.5805 trim_cache size 0 max 16384 2024-09-17T03:35:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:47.631 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:35:47.631 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "f9d6b976-53b1-4d14-bae0-a072551d0c46", 2024-09-17T03:35:47.631 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:35:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:47.631 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f57ae247640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4c [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v442 pv446 ap=4 s=0 n(v0 1=1+0)->n(v0 rc2024-09-17T03:35:46.901178+0000 b1048576 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={5102=0-4194304@1} caps={5102=pAsxLsXsxFcb/pAsxXsxFxwb@3},l=5102 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=0 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x55b0daa90100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000a4c:[<0x10000000001/new_file_0 v442>,<0x10000000000/ceph-qa-suite v42>,<0x1/scrub_test_path v10>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-17T03:35:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 -- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78b0078bc0 msgr2=0x7f78b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78b0078bc0 0x7f78b007b0d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78c0006d10 tx=0x7f78c0006ea0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 -- 172.21.15.146:0/661729653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78d015f910 msgr2=0x7f78d0153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78d015f910 0x7f78d0153710 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f78b8011b10 tx=0x7f78b8009e90 comp rx=0 tx=0).stop 2024-09-17T03:35:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 -- 172.21.15.146:0/661729653 shutdown_connections 2024-09-17T03:35:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78b0078bc0 0x7f78b007b0d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78d0153c50 0x7f78d01f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78d015f910 0x7f78d0153710 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 --2- 172.21.15.146:0/661729653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78bc004d40 0x7f78d0145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 -- 172.21.15.146:0/661729653 >> 172.21.15.146:0/661729653 conn(0x7f78d00b7b20 msgr2=0x7f78d015a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 -- 172.21.15.146:0/661729653 shutdown_connections 2024-09-17T03:35:47.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.627+0000 7f78d6df1640 1 -- 172.21.15.146:0/661729653 wait complete. 2024-09-17T03:35:47.637 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': 'f9d6b976-53b1-4d14-bae0-a072551d0c46', 'mode': 'asynchronous'}' 2024-09-17T03:35:47.638 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:35:47.638 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-17T03:35:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.753+0000 7f23afcd5640 1 -- 172.21.15.146:0/1406283957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a80b5be0 msgr2=0x7f23a809be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.753+0000 7f23afcd5640 1 --2- 172.21.15.146:0/1406283957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a80b5be0 0x7f23a809be30 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009830 tx=0x7f23a402a510 comp rx=0 tx=0).stop 2024-09-17T03:35:47.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.753+0000 7f23afcd5640 1 -- 172.21.15.146:0/1406283957 shutdown_connections 2024-09-17T03:35:47.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.753+0000 7f23afcd5640 1 --2- 172.21.15.146:0/1406283957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a80b5be0 0x7f23a809be30 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.753+0000 7f23afcd5640 1 -- 172.21.15.146:0/1406283957 >> 172.21.15.146:0/1406283957 conn(0x7f23a809ba20 msgr2=0x7f23a80b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.753+0000 7f23afcd5640 1 -- 172.21.15.146:0/1406283957 shutdown_connections 2024-09-17T03:35:47.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.753+0000 7f23afcd5640 1 -- 172.21.15.146:0/1406283957 wait complete. 2024-09-17T03:35:47.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.755+0000 7f23afcd5640 1 Processor -- start 2024-09-17T03:35:47.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.755+0000 7f23afcd5640 1 -- start start 2024-09-17T03:35:47.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.756+0000 7f23afcd5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23a80b5be0 0x7f23a81f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.756+0000 7f23afcd5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23a815ca70 0x7f23a81f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.756+0000 7f23afcd5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a806dd60 0x7f23a81e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.756+0000 7f23afcd5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80b10c0 con 0x7f23a806dd60 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.756+0000 7f23afcd5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80b0f40 con 0x7f23a815ca70 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.756+0000 7f23afcd5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f23a80b1240 con 0x7f23a80b5be0 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.756+0000 7f23ae272640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a806dd60 0x7f23a81e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.756+0000 7f23ae272640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a806dd60 0x7f23a81e70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53734/0 (socket says 172.21.15.146:53734) 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.756+0000 7f23ae272640 1 -- 172.21.15.146:0/247030873 learned_addr learned my addr 172.21.15.146:0/247030873 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.756+0000 7f23ada71640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23a80b5be0 0x7f23a81f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.756+0000 7f23ad270640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23a815ca70 0x7f23a81f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.757+0000 7f23ae272640 1 -- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23a80b5be0 msgr2=0x7f23a81f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.757+0000 7f23ae272640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23a80b5be0 0x7f23a81f5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.757+0000 7f23ae272640 1 -- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23a815ca70 msgr2=0x7f23a81f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.757+0000 7f23ae272640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23a815ca70 0x7f23a81f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.757+0000 7f23ae272640 1 -- 172.21.15.146:0/247030873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a815e390 con 0x7f23a806dd60 2024-09-17T03:35:47.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.757+0000 7f23ae272640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a806dd60 0x7f23a81e70e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f23a000be90 tx=0x7f23a000bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.757+0000 7f239e7fc640 1 -- 172.21.15.146:0/247030873 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0019070 con 0x7f23a806dd60 2024-09-17T03:35:47.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.757+0000 7f239e7fc640 1 -- 172.21.15.146:0/247030873 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23a0014440 con 0x7f23a806dd60 2024-09-17T03:35:47.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.757+0000 7f23afcd5640 1 -- 172.21.15.146:0/247030873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a806e4d0 con 0x7f23a806dd60 2024-09-17T03:35:47.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.757+0000 7f239e7fc640 1 -- 172.21.15.146:0/247030873 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00148d0 con 0x7f23a806dd60 2024-09-17T03:35:47.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.757+0000 7f23afcd5640 1 -- 172.21.15.146:0/247030873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a806ea90 con 0x7f23a806dd60 2024-09-17T03:35:47.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.759+0000 7f239e7fc640 1 -- 172.21.15.146:0/247030873 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23a001c070 con 0x7f23a806dd60 2024-09-17T03:35:47.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.759+0000 7f239e7fc640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f238c078b90 0x7f238c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.759+0000 7f239e7fc640 1 -- 172.21.15.146:0/247030873 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f23a009abd0 con 0x7f23a806dd60 2024-09-17T03:35:47.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.760+0000 7f23ada71640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f238c078b90 0x7f238c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.760+0000 7f23ada71640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f238c078b90 0x7f238c07b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f23a4034000 tx=0x7f23a4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.760+0000 7f23b6c3d740 1 Processor -- start 2024-09-17T03:35:47.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.761+0000 7f23b6c3d740 1 -- start start 2024-09-17T03:35:47.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94220a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b941f5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562b9414ea60 con 0x562b93e136b0 2024-09-17T03:35:47.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562b9413de90 con 0x562b93e0b4d0 2024-09-17T03:35:47.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562b94141ca0 con 0x562b93e34390 2024-09-17T03:35:47.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23ae272640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23ada71640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94220a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23ae272640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941f5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53748/0 (socket says 172.21.15.146:53748) 2024-09-17T03:35:47.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23ae272640 1 -- 172.21.15.146:0/4016865563 learned_addr learned my addr 172.21.15.146:0/4016865563 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23ad270640 1 --2- 172.21.15.146:0/4016865563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b941f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23ae272640 1 -- 172.21.15.146:0/4016865563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 msgr2=0x562b94220a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23ae272640 1 --2- 172.21.15.146:0/4016865563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94220a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23ae272640 1 -- 172.21.15.146:0/4016865563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 msgr2=0x562b941f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23ae272640 1 --2- 172.21.15.146:0/4016865563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b941f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23ae272640 1 -- 172.21.15.146:0/4016865563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b93f167d0 con 0x562b93e136b0 2024-09-17T03:35:47.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.762+0000 7f23ae272640 1 --2- 172.21.15.146:0/4016865563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941f5da0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f23a0099060 tx=0x7f23a0062180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4d2dfe76de497 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.763+0000 7f238b7fe640 1 -- 172.21.15.146:0/4016865563 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0087030 con 0x562b93e136b0 2024-09-17T03:35:47.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.763+0000 7f238b7fe640 1 -- 172.21.15.146:0/4016865563 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23a0067440 con 0x562b93e136b0 2024-09-17T03:35:47.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.763+0000 7f238b7fe640 1 -- 172.21.15.146:0/4016865563 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a006c2f0 con 0x562b93e136b0 2024-09-17T03:35:47.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.763+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4016865563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 msgr2=0x562b941f5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.763+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4016865563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941f5da0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f23a0099060 tx=0x7f23a0062180 comp rx=0 tx=0).stop 2024-09-17T03:35:47.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.763+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4016865563 shutdown_connections 2024-09-17T03:35:47.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.763+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4016865563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941f5da0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.763+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4016865563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b941f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.763+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4016865563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94220a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.763+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4016865563 >> 172.21.15.146:0/4016865563 conn(0x562b93e284e0 msgr2=0x562b941dbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.764+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4016865563 shutdown_connections 2024-09-17T03:35:47.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.764+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4016865563 wait complete. 2024-09-17T03:35:47.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.764+0000 7f23b6c3d740 1 -- start start 2024-09-17T03:35:47.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.764+0000 7f23b6c3d740 1 Processor -- start 2024-09-17T03:35:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b9421cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94217030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562b93eae740 con 0x562b93e136b0 2024-09-17T03:35:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562b940e3970 con 0x562b93e0b4d0 2024-09-17T03:35:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562b941e4e10 con 0x562b93e34390 2024-09-17T03:35:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23b6c3d740 10 client.0 _ll_register_callbacks cb 0x562b940f2780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23ad270640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23ad270640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941e6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53762/0 (socket says 172.21.15.146:53762) 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23ad270640 1 -- 172.21.15.146:0/4132872719 learned_addr learned my addr 172.21.15.146:0/4132872719 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23ada71640 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b9421cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23ad270640 1 -- 172.21.15.146:0/4132872719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 msgr2=0x562b94217030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23ae272640 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94217030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23ad270640 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94217030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23ad270640 1 -- 172.21.15.146:0/4132872719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 msgr2=0x562b9421cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23ad270640 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b9421cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23ad270640 1 -- 172.21.15.146:0/4132872719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b93e9f970 con 0x562b93e136b0 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.766+0000 7f23ada71640 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b9421cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f23ad270640 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941e6b50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2398012520 tx=0x7f23980129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffa50857591524 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f2388ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f2388ff9640 1 -- 172.21.15.146:0/4132872719 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398019070 con 0x562b93e136b0 2024-09-17T03:35:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f2388ff9640 1 -- 172.21.15.146:0/4132872719 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f2398005260 con 0x562b93e136b0 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4132872719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23a0067440 con 0x562b93e136b0 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f2388ff9640 1 -- 172.21.15.146:0/4132872719 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2398024050 con 0x562b93e136b0 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f23b6c3d740 10 client.5820 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4132872719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x562b93e7d6a0 con 0x562b93e136b0 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f2388ff9640 1 -- 172.21.15.146:0/4132872719 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23a0067440 con 0x562b93e136b0 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f2388ff9640 1 -- 172.21.15.146:0/4132872719 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f2398027020 con 0x562b93e136b0 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f23b6c3d740 10 client.5820 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f23b6c3d740 10 client.5820 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f23b6c3d740 20 client.5820 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b93df2f60 0x562b941e45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f23b6c3d740 4 client.5820 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4132872719 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b941509b0 con 0x562b93df2f60 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.767+0000 7f23ada71640 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b93df2f60 0x562b941e45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.768+0000 7f2388ff9640 10 client.5820 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.768+0000 7f23ada71640 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b93df2f60 0x562b941e45c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45b83ab26d4b9d36 server_cookie=ca72207eeba1c1dc in_seq=0 out_seq=0 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.768+0000 7f2388ff9640 1 -- 172.21.15.146:0/4132872719 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b941509b0 con 0x562b93df2f60 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.768+0000 7f2388ff9640 10 client.5820 handle_command_reply: tid=0 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.768+0000 7f23b6c3d740 1 client.5820 shutdown 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4132872719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 msgr2=0x562b941e6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941e6b50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2398012520 tx=0x7f23980129e0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4132872719 shutdown_connections 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b93df2f60 0x562b941e45c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94217030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b941e6b50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f2388ff9640 0 client.5820 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4132872719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b9421cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4132872719 >> 172.21.15.146:0/4132872719 conn(0x562b93e284e0 msgr2=0x562b941d5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4132872719 shutdown_connections 2024-09-17T03:35:47.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4132872719 wait complete. 2024-09-17T03:35:47.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.769+0000 7f23b6c3d740 20 client.5820 trim_cache size 0 max 16384 2024-09-17T03:35:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.786+0000 7f23b6c3d740 1 Processor -- start 2024-09-17T03:35:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.786+0000 7f23b6c3d740 1 -- start start 2024-09-17T03:35:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e0b4d0 0x562b941f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e136b0 0x562b9429a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94220820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f23a8202600 con 0x562b93e0b4d0 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f23a8201600 con 0x562b93e136b0 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f23a815f610 con 0x562b93e34390 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23ada71640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e0b4d0 0x562b941f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23ada71640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e0b4d0 0x562b941f49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53770/0 (socket says 172.21.15.146:53770) 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23ada71640 1 -- 172.21.15.146:0/3025024356 learned_addr learned my addr 172.21.15.146:0/3025024356 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23ada71640 1 -- 172.21.15.146:0/3025024356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 msgr2=0x562b94220820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23ada71640 1 --2- 172.21.15.146:0/3025024356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94220820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23ada71640 1 -- 172.21.15.146:0/3025024356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e136b0 msgr2=0x562b9429a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23ada71640 1 --2- 172.21.15.146:0/3025024356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e136b0 0x562b9429a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23ada71640 1 -- 172.21.15.146:0/3025024356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b941d8860 con 0x562b93e0b4d0 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f23ada71640 1 --2- 172.21.15.146:0/3025024356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e0b4d0 0x562b941f49f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009920 tx=0x7f23a403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76a9aa2b1f53783 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f238affd640 1 -- 172.21.15.146:0/3025024356 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4054070 con 0x562b93e0b4d0 2024-09-17T03:35:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f238affd640 1 -- 172.21.15.146:0/3025024356 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23a4003c80 con 0x562b93e0b4d0 2024-09-17T03:35:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.788+0000 7f238affd640 1 -- 172.21.15.146:0/3025024356 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4052640 con 0x562b93e0b4d0 2024-09-17T03:35:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.789+0000 7f23b6c3d740 1 -- 172.21.15.146:0/3025024356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e0b4d0 msgr2=0x562b941f49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.789+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/3025024356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e0b4d0 0x562b941f49f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009920 tx=0x7f23a403e040 comp rx=0 tx=0).stop 2024-09-17T03:35:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.789+0000 7f23b6c3d740 1 -- 172.21.15.146:0/3025024356 shutdown_connections 2024-09-17T03:35:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.789+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/3025024356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94220820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.789+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/3025024356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e136b0 0x562b9429a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.789+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/3025024356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e0b4d0 0x562b941f49f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.789+0000 7f23b6c3d740 1 -- 172.21.15.146:0/3025024356 >> 172.21.15.146:0/3025024356 conn(0x562b93e284e0 msgr2=0x562b941d6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.789+0000 7f23b6c3d740 1 -- 172.21.15.146:0/3025024356 shutdown_connections 2024-09-17T03:35:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.789+0000 7f23b6c3d740 1 -- 172.21.15.146:0/3025024356 wait complete. 2024-09-17T03:35:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.790+0000 7f23b6c3d740 1 -- start start 2024-09-17T03:35:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.790+0000 7f23b6c3d740 1 Processor -- start 2024-09-17T03:35:47.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.791+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b942999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.791+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b94216c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.791+0000 7f23b6c3d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94201b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.791+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562b94244540 con 0x562b93e136b0 2024-09-17T03:35:47.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.791+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81f9c30 con 0x562b93e0b4d0 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.791+0000 7f23b6c3d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562b942a1f20 con 0x562b93e34390 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.791+0000 7f23b6c3d740 10 client.0 _ll_register_callbacks cb 0x7f23980013b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23ad270640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b94216c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23ad270640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b94216c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53776/0 (socket says 172.21.15.146:53776) 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23ad270640 1 -- 172.21.15.146:0/4024310569 learned_addr learned my addr 172.21.15.146:0/4024310569 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23ae272640 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94201b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23ad270640 1 -- 172.21.15.146:0/4024310569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 msgr2=0x562b94201b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23ada71640 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b942999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23ad270640 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94201b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23ad270640 1 -- 172.21.15.146:0/4024310569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 msgr2=0x562b942999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23ad270640 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b942999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23ad270640 1 -- 172.21.15.146:0/4024310569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b9421d8c0 con 0x562b93e136b0 2024-09-17T03:35:47.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23ad270640 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b94216c50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2398001e20 tx=0x7f23980047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fd77a86383a0b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f2388ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f2388ff9640 1 -- 172.21.15.146:0/4024310569 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398019040 con 0x562b93e136b0 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f2388ff9640 1 -- 172.21.15.146:0/4024310569 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f239801e640 con 0x562b93e136b0 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4024310569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23a4003c80 con 0x562b93e136b0 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f2388ff9640 1 -- 172.21.15.146:0/4024310569 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2398034050 con 0x562b93e136b0 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23b6c3d740 10 client.5826 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4024310569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x562b941f4b30 con 0x562b93e136b0 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.792+0000 7f2388ff9640 1 -- 172.21.15.146:0/4024310569 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23a4003c80 con 0x562b93e136b0 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f2388ff9640 1 -- 172.21.15.146:0/4024310569 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f2398037020 con 0x562b93e136b0 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f23b6c3d740 10 client.5826 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f23b6c3d740 10 client.5826 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:47.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f23b6c3d740 20 client.5826 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b94217190 0x562b94202080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f23b6c3d740 4 client.5826 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4024310569 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b9414c460 con 0x562b94217190 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f23ada71640 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b94217190 0x562b94202080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f2388ff9640 10 client.5826 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f23ada71640 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b94217190 0x562b94202080 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bafddc67752d796a server_cookie=585222398f42b250 in_seq=0 out_seq=0 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f2388ff9640 1 -- 172.21.15.146:0/4024310569 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1593 (crc 0 0 0) 0x562b9414c460 con 0x562b94217190 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f2388ff9640 10 client.5826 handle_command_reply: tid=0 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.793+0000 7f23b6c3d740 1 client.5826 shutdown 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4024310569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 msgr2=0x562b94216c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b94216c50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2398001e20 tx=0x7f23980047e0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4024310569 shutdown_connections 2024-09-17T03:35:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b94217190 0x562b94202080 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b93e34390 0x562b94201b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f2388ff9640 0 client.5826 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b93e136b0 0x562b94216c50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23b6c3d740 1 --2- 172.21.15.146:0/4024310569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b93e0b4d0 0x562b942999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4024310569 >> 172.21.15.146:0/4024310569 conn(0x562b93e284e0 msgr2=0x562b941d4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4024310569 shutdown_connections 2024-09-17T03:35:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23b6c3d740 1 -- 172.21.15.146:0/4024310569 wait complete. 2024-09-17T03:35:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23b6c3d740 20 client.5826 trim_cache size 0 max 16384 2024-09-17T03:35:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "f9d6b976-53b1-4d14-bae0-a072551d0c46": { 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "f9d6b976-53b1-4d14-bae0-a072551d0c46", 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "" 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "f9d6b976-53b1-4d14-bae0-a072551d0c46": { 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:47.625167+0000", 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-17T03:35:47.799 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "adfb75e5-b911-4f8d-a47c-c41436f4748a": { 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:46.587183+0000", 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:47.800 INFO:teuthology.orchestra.run.smithi146.stdout: "d88b3f93-07b9-4851-80e0-841d2041b343": { 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:46.231188+0000", 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "dee09f00-18b7-4525-8418-50d2c01a47aa": { 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:45.892193+0000", 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:47.801 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:47.802 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23afcd5640 1 -- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f238c078b90 msgr2=0x7f238c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23afcd5640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f238c078b90 0x7f238c07b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f23a4034000 tx=0x7f23a4004730 comp rx=0 tx=0).stop 2024-09-17T03:35:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23afcd5640 1 -- 172.21.15.146:0/247030873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a806dd60 msgr2=0x7f23a81e70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23afcd5640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a806dd60 0x7f23a81e70e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f23a000be90 tx=0x7f23a000bf80 comp rx=0 tx=0).stop 2024-09-17T03:35:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23afcd5640 1 -- 172.21.15.146:0/247030873 shutdown_connections 2024-09-17T03:35:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23afcd5640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f238c078b90 0x7f238c07b0a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23afcd5640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23a806dd60 0x7f23a81e70e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23afcd5640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23a815ca70 0x7f23a81f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23afcd5640 1 --2- 172.21.15.146:0/247030873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23a80b5be0 0x7f23a81f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23afcd5640 1 -- 172.21.15.146:0/247030873 >> 172.21.15.146:0/247030873 conn(0x7f23a809ba20 msgr2=0x7f23a815b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.794+0000 7f23afcd5640 1 -- 172.21.15.146:0/247030873 shutdown_connections 2024-09-17T03:35:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:47.795+0000 7f23afcd5640 1 -- 172.21.15.146:0/247030873 wait complete. 2024-09-17T03:35:52.806 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:35:52.806 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-17T03:35:52.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.932+0000 7f92f9989640 1 -- 172.21.15.146:0/3181778424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92e00041c0 msgr2=0x7f92e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.932+0000 7f92f9989640 1 --2- 172.21.15.146:0/3181778424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92e00041c0 0x7f92e0004800 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f92dc001800 tx=0x7f92e0005830 comp rx=0 tx=0).stop 2024-09-17T03:35:52.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.932+0000 7f92f37fe640 1 -- 172.21.15.146:0/3181778424 reap_dead start 2024-09-17T03:35:52.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.932+0000 7f92f9989640 1 -- 172.21.15.146:0/3181778424 shutdown_connections 2024-09-17T03:35:52.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.932+0000 7f92f9989640 1 -- 172.21.15.146:0/3181778424 >> 172.21.15.146:0/3181778424 conn(0x7f92f40d4be0 msgr2=0x7f92f40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:52.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.933+0000 7f92f9989640 1 -- 172.21.15.146:0/3181778424 shutdown_connections 2024-09-17T03:35:52.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.933+0000 7f92f9989640 1 -- 172.21.15.146:0/3181778424 wait complete. 2024-09-17T03:35:52.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.934+0000 7f92f9989640 1 Processor -- start 2024-09-17T03:35:52.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.935+0000 7f92f9989640 1 -- start start 2024-09-17T03:35:52.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f9989640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00041c0 0x7f92f4153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f9989640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f40b5890 0x7f92f4154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f9989640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f4161500 0x7f92f41552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f9989640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f92f40d38a0 con 0x7f92f4161500 2024-09-17T03:35:52.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f9989640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92f40cf740 con 0x7f92e00041c0 2024-09-17T03:35:52.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f9989640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f92f40d3a20 con 0x7f92f40b5890 2024-09-17T03:35:52.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f4161500 0x7f92f41552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f4161500 0x7f92f41552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53796/0 (socket says 172.21.15.146:53796) 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f37fe640 1 -- 172.21.15.146:0/1901908611 learned_addr learned my addr 172.21.15.146:0/1901908611 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92ea7fc640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f40b5890 0x7f92f4154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00041c0 0x7f92f4153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f37fe640 1 -- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f40b5890 msgr2=0x7f92f4154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f37fe640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f40b5890 0x7f92f4154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f37fe640 1 -- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00041c0 msgr2=0x7f92f4153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f37fe640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00041c0 0x7f92f4153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f37fe640 1 -- 172.21.15.146:0/1901908611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f40b62e0 con 0x7f92f4161500 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f37fe640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f4161500 0x7f92f41552f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0014a0 tx=0x7f92ec00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.936+0000 7f92f0ff9640 1 -- 172.21.15.146:0/1901908611 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec015020 con 0x7f92f4161500 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.937+0000 7f92f0ff9640 1 -- 172.21.15.146:0/1901908611 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92ec010980 con 0x7f92f4161500 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.937+0000 7f92f9989640 1 -- 172.21.15.146:0/1901908611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f4154230 con 0x7f92f4161500 2024-09-17T03:35:52.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.937+0000 7f92f0ff9640 1 -- 172.21.15.146:0/1901908611 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec010dd0 con 0x7f92f4161500 2024-09-17T03:35:52.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.937+0000 7f92f9989640 1 -- 172.21.15.146:0/1901908611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f41f5a60 con 0x7f92f4161500 2024-09-17T03:35:52.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.938+0000 7f92f0ff9640 1 -- 172.21.15.146:0/1901908611 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92ec018020 con 0x7f92f4161500 2024-09-17T03:35:52.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.939+0000 7f92f0ff9640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f92d4078b90 0x7f92d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.939+0000 7f92f0ff9640 1 -- 172.21.15.146:0/1901908611 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f92ec09b000 con 0x7f92f4161500 2024-09-17T03:35:52.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.939+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f92d4078b90 0x7f92d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.940+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f92d4078b90 0x7f92d407b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009af0 tx=0x7f92e4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:52.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.940+0000 7f93009d3740 1 Processor -- start 2024-09-17T03:35:52.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.940+0000 7f93009d3740 1 -- start start 2024-09-17T03:35:52.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.941+0000 7f93009d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a806390 0x561b5abf2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.941+0000 7f93009d3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7dd4d0 0x561b5abc7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.941+0000 7f93009d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a7e56b0 0x561b5abc7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.941+0000 7f93009d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b5ab20a60 con 0x561b5a806390 2024-09-17T03:35:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.941+0000 7f93009d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561b5ab0fe90 con 0x561b5a7e56b0 2024-09-17T03:35:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.941+0000 7f93009d3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561b5ab13ca0 con 0x561b5a7dd4d0 2024-09-17T03:35:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.941+0000 7f92f2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a806390 0x561b5abf2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.941+0000 7f92f2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a806390 0x561b5abf2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53800/0 (socket says 172.21.15.146:53800) 2024-09-17T03:35:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92f2ffd640 1 -- 172.21.15.146:0/3331028739 learned_addr learned my addr 172.21.15.146:0/3331028739 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92ea7fc640 1 --2- 172.21.15.146:0/3331028739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7dd4d0 0x561b5abc7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92f37fe640 1 --2- 172.21.15.146:0/3331028739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a7e56b0 0x561b5abc7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92f2ffd640 1 -- 172.21.15.146:0/3331028739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7dd4d0 msgr2=0x561b5abc7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/3331028739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7dd4d0 0x561b5abc7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92f2ffd640 1 -- 172.21.15.146:0/3331028739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a7e56b0 msgr2=0x561b5abc7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/3331028739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a7e56b0 0x561b5abc7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92f2ffd640 1 -- 172.21.15.146:0/3331028739 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5a8e87d0 con 0x561b5a806390 2024-09-17T03:35:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/3331028739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a806390 0x561b5abf2a10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f92e4012fb0 tx=0x7f92e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ad6c26ba7a4098 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92e97fa640 1 -- 172.21.15.146:0/3331028739 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e4003b70 con 0x561b5a806390 2024-09-17T03:35:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92e97fa640 1 -- 172.21.15.146:0/3331028739 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92e4003d10 con 0x561b5a806390 2024-09-17T03:35:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.942+0000 7f92e97fa640 1 -- 172.21.15.146:0/3331028739 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e4005220 con 0x561b5a806390 2024-09-17T03:35:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.943+0000 7f93009d3740 1 -- 172.21.15.146:0/3331028739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a806390 msgr2=0x561b5abf2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.943+0000 7f93009d3740 1 --2- 172.21.15.146:0/3331028739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a806390 0x561b5abf2a10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f92e4012fb0 tx=0x7f92e4017000 comp rx=0 tx=0).stop 2024-09-17T03:35:52.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.943+0000 7f93009d3740 1 -- 172.21.15.146:0/3331028739 shutdown_connections 2024-09-17T03:35:52.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.943+0000 7f93009d3740 1 --2- 172.21.15.146:0/3331028739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a7e56b0 0x561b5abc7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.943+0000 7f93009d3740 1 --2- 172.21.15.146:0/3331028739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7dd4d0 0x561b5abc7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.943+0000 7f93009d3740 1 --2- 172.21.15.146:0/3331028739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a806390 0x561b5abf2a10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.943+0000 7f93009d3740 1 -- 172.21.15.146:0/3331028739 >> 172.21.15.146:0/3331028739 conn(0x561b5a7fa4e0 msgr2=0x561b5abadd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:52.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.943+0000 7f93009d3740 1 -- 172.21.15.146:0/3331028739 shutdown_connections 2024-09-17T03:35:52.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.943+0000 7f93009d3740 1 -- 172.21.15.146:0/3331028739 wait complete. 2024-09-17T03:35:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.944+0000 7f93009d3740 1 -- start start 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.944+0000 7f93009d3740 1 Processor -- start 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.945+0000 7f93009d3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7dd4d0 0x561b5abc6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f93009d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abeb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f93009d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a806390 0x561b5abef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f93009d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b5a880740 con 0x561b5a7e56b0 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f93009d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561b5aab5970 con 0x561b5a806390 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f93009d3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561b5abee110 con 0x561b5a7dd4d0 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f93009d3740 10 client.0 _ll_register_callbacks cb 0x561b5aac4780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92ea7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abeb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92ea7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abeb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53804/0 (socket says 172.21.15.146:53804) 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92ea7fc640 1 -- 172.21.15.146:0/609397860 learned_addr learned my addr 172.21.15.146:0/609397860 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7dd4d0 0x561b5abc6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92f37fe640 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a806390 0x561b5abef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92ea7fc640 1 -- 172.21.15.146:0/609397860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7dd4d0 msgr2=0x561b5abc6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92ea7fc640 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7dd4d0 0x561b5abc6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92ea7fc640 1 -- 172.21.15.146:0/609397860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a806390 msgr2=0x561b5abef5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92ea7fc640 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a806390 0x561b5abef5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92ea7fc640 1 -- 172.21.15.146:0/609397860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b5a871970 con 0x561b5a7e56b0 2024-09-17T03:35:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92ea7fc640 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abeb7c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f92dc001920 tx=0x7f92dc0064d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47d0a9b28962eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92d27fc640 1 -- 172.21.15.146:0/609397860 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc044020 con 0x561b5a7e56b0 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92d27fc640 1 -- 172.21.15.146:0/609397860 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f92dc0037f0 con 0x561b5a7e56b0 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f93009d3740 1 -- 172.21.15.146:0/609397860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92e4003d10 con 0x561b5a7e56b0 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f92d27fc640 1 -- 172.21.15.146:0/609397860 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f92dc04e050 con 0x561b5a7e56b0 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.946+0000 7f93009d3740 10 client.5838 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f93009d3740 1 -- 172.21.15.146:0/609397860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x561b5a84f6a0 con 0x561b5a7e56b0 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f92d27fc640 1 -- 172.21.15.146:0/609397860 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92e4003d10 con 0x561b5a7e56b0 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f92d27fc640 1 -- 172.21.15.146:0/609397860 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f92dc0039f0 con 0x561b5a7e56b0 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f93009d3740 10 client.5838 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f93009d3740 10 client.5838 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f93009d3740 20 client.5838 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f93009d3740 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x561b5a7c4f60 0x561b5abefb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f93009d3740 4 client.5838 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f93009d3740 1 -- 172.21.15.146:0/609397860 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b5ab229b0 con 0x561b5a7c4f60 2024-09-17T03:35:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x561b5a7c4f60 0x561b5abefb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f92d27fc640 10 client.5838 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.947+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x561b5a7c4f60 0x561b5abefb10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2eb70a9d2b8a5ec server_cookie=97e3d4c8fdc0c472 in_seq=0 out_seq=0 2024-09-17T03:35:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f92d27fc640 1 -- 172.21.15.146:0/609397860 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f92e4033f90 con 0x561b5a7c4f60 2024-09-17T03:35:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f92d27fc640 10 client.5838 handle_command_reply: tid=0 2024-09-17T03:35:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 1 client.5838 shutdown 2024-09-17T03:35:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 1 -- 172.21.15.146:0/609397860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 msgr2=0x561b5abeb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abeb7c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f92dc001920 tx=0x7f92dc0064d0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 1 -- 172.21.15.146:0/609397860 shutdown_connections 2024-09-17T03:35:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x561b5a7c4f60 0x561b5abefb10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a806390 0x561b5abef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f92d27fc640 0 client.5838 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abeb7c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 1 --2- 172.21.15.146:0/609397860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7dd4d0 0x561b5abc6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 1 -- 172.21.15.146:0/609397860 >> 172.21.15.146:0/609397860 conn(0x561b5a7fa4e0 msgr2=0x561b5aba8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 1 -- 172.21.15.146:0/609397860 shutdown_connections 2024-09-17T03:35:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 1 -- 172.21.15.146:0/609397860 wait complete. 2024-09-17T03:35:52.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.948+0000 7f93009d3740 20 client.5838 trim_cache size 0 max 16384 2024-09-17T03:35:52.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.966+0000 7f93009d3740 1 Processor -- start 2024-09-17T03:35:52.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.966+0000 7f93009d3740 1 -- start start 2024-09-17T03:35:52.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.967+0000 7f93009d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7dd4d0 0x561b5abec420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.967+0000 7f93009d3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7e56b0 0x561b5ac15f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.967+0000 7f93009d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a806390 0x561b5aba8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.967+0000 7f93009d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f92f42024e0 con 0x561b5a7dd4d0 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.967+0000 7f93009d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4201500 con 0x561b5a806390 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.967+0000 7f93009d3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f92f415f400 con 0x561b5a7e56b0 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.967+0000 7f92f2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7dd4d0 0x561b5abec420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.967+0000 7f92f2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7dd4d0 0x561b5abec420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53806/0 (socket says 172.21.15.146:53806) 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.967+0000 7f92f2ffd640 1 -- 172.21.15.146:0/3853037774 learned_addr learned my addr 172.21.15.146:0/3853037774 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.968+0000 7f92ea7fc640 1 --2- 172.21.15.146:0/3853037774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7e56b0 0x561b5ac15f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.968+0000 7f92f37fe640 1 --2- 172.21.15.146:0/3853037774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a806390 0x561b5aba8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.968+0000 7f92f2ffd640 1 -- 172.21.15.146:0/3853037774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7e56b0 msgr2=0x561b5ac15f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.968+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/3853037774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7e56b0 0x561b5ac15f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.968+0000 7f92f2ffd640 1 -- 172.21.15.146:0/3853037774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a806390 msgr2=0x561b5aba8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.968+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/3853037774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a806390 0x561b5aba8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.968+0000 7f92f2ffd640 1 -- 172.21.15.146:0/3853037774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5abc8330 con 0x561b5a7dd4d0 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.968+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/3853037774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7dd4d0 0x561b5abec420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f92e4012f80 tx=0x7f92e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa992281ad173cf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.968+0000 7f92e8ff9640 1 -- 172.21.15.146:0/3853037774 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e4039070 con 0x561b5a7dd4d0 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.968+0000 7f92e8ff9640 1 -- 172.21.15.146:0/3853037774 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92e402e040 con 0x561b5a7dd4d0 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.968+0000 7f92e8ff9640 1 -- 172.21.15.146:0/3853037774 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e4003d70 con 0x561b5a7dd4d0 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.969+0000 7f93009d3740 1 -- 172.21.15.146:0/3853037774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7dd4d0 msgr2=0x561b5abec420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.969+0000 7f93009d3740 1 --2- 172.21.15.146:0/3853037774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7dd4d0 0x561b5abec420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f92e4012f80 tx=0x7f92e4004730 comp rx=0 tx=0).stop 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.969+0000 7f93009d3740 1 -- 172.21.15.146:0/3853037774 shutdown_connections 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.969+0000 7f93009d3740 1 --2- 172.21.15.146:0/3853037774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a806390 0x561b5aba8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.969+0000 7f93009d3740 1 --2- 172.21.15.146:0/3853037774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a7e56b0 0x561b5ac15f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.969+0000 7f93009d3740 1 --2- 172.21.15.146:0/3853037774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7dd4d0 0x561b5abec420 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.969+0000 7f93009d3740 1 -- 172.21.15.146:0/3853037774 >> 172.21.15.146:0/3853037774 conn(0x561b5a7fa4e0 msgr2=0x561b5abf2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:52.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.969+0000 7f93009d3740 1 -- 172.21.15.146:0/3853037774 shutdown_connections 2024-09-17T03:35:52.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.969+0000 7f93009d3740 1 -- 172.21.15.146:0/3853037774 wait complete. 2024-09-17T03:35:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.970+0000 7f93009d3740 1 -- start start 2024-09-17T03:35:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.970+0000 7f93009d3740 1 Processor -- start 2024-09-17T03:35:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f93009d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a7dd4d0 0x561b5ac65910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f93009d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abf13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f93009d3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a806390 0x561b5abf18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f93009d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b5ac04900 con 0x561b5a7e56b0 2024-09-17T03:35:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f93009d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92f41f9ae0 con 0x561b5a7dd4d0 2024-09-17T03:35:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f93009d3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561b5ac66290 con 0x561b5a806390 2024-09-17T03:35:52.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f93009d3740 10 client.0 _ll_register_callbacks cb 0x7f92e000bb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f92ea7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abf13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f92ea7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abf13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53814/0 (socket says 172.21.15.146:53814) 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f92ea7fc640 1 -- 172.21.15.146:0/2976600575 learned_addr learned my addr 172.21.15.146:0/2976600575 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f92f37fe640 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a806390 0x561b5abf18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.971+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a7dd4d0 0x561b5ac65910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92ea7fc640 1 -- 172.21.15.146:0/2976600575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a806390 msgr2=0x561b5abf18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92ea7fc640 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a806390 0x561b5abf18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92ea7fc640 1 -- 172.21.15.146:0/2976600575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a7dd4d0 msgr2=0x561b5ac65910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92ea7fc640 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a7dd4d0 0x561b5ac65910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92ea7fc640 1 -- 172.21.15.146:0/2976600575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b5abf47b0 con 0x561b5a7e56b0 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92ea7fc640 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abf13b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x561b5abd4d00 tx=0x7f92dc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfc2da88245cdef server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:52.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92d27fc640 1 -- 172.21.15.146:0/2976600575 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc057060 con 0x561b5a7e56b0 2024-09-17T03:35:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92d27fc640 1 -- 172.21.15.146:0/2976600575 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f92dc033680 con 0x561b5a7e56b0 2024-09-17T03:35:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f93009d3740 1 -- 172.21.15.146:0/2976600575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92e402e040 con 0x561b5a7e56b0 2024-09-17T03:35:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92d27fc640 1 -- 172.21.15.146:0/2976600575 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f92dc05d050 con 0x561b5a7e56b0 2024-09-17T03:35:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f93009d3740 10 client.5844 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f93009d3740 1 -- 172.21.15.146:0/2976600575 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x561b5abe7ee0 con 0x561b5a7e56b0 2024-09-17T03:35:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92d27fc640 1 -- 172.21.15.146:0/2976600575 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92e402e040 con 0x561b5a7e56b0 2024-09-17T03:35:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92d27fc640 1 -- 172.21.15.146:0/2976600575 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f92dc060020 con 0x561b5a7e56b0 2024-09-17T03:35:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f93009d3740 10 client.5844 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f93009d3740 10 client.5844 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:52.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f93009d3740 20 client.5844 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:52.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f93009d3740 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x561b5ac68a90 0x561b5abfdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:52.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f93009d3740 4 client.5844 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:35:52.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f93009d3740 1 -- 172.21.15.146:0/2976600575 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561b5ab1e460 con 0x561b5ac68a90 2024-09-17T03:35:52.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.972+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x561b5ac68a90 0x561b5abfdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:52.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f92d27fc640 10 client.5844 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:52.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f92f2ffd640 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x561b5ac68a90 0x561b5abfdcb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd59e5f97cae9a29 server_cookie=940d1bc40101b610 in_seq=0 out_seq=0 2024-09-17T03:35:52.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f92d27fc640 1 -- 172.21.15.146:0/2976600575 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1372 (crc 0 0 0) 0x561b5ab1e460 con 0x561b5ac68a90 2024-09-17T03:35:52.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f92d27fc640 10 client.5844 handle_command_reply: tid=0 2024-09-17T03:35:52.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 1 client.5844 shutdown 2024-09-17T03:35:52.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 1 -- 172.21.15.146:0/2976600575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 msgr2=0x561b5abf13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abf13b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x561b5abd4d00 tx=0x7f92dc0038a0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 1 -- 172.21.15.146:0/2976600575 shutdown_connections 2024-09-17T03:35:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x561b5ac68a90 0x561b5abfdcb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b5a806390 0x561b5abf18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b5a7e56b0 0x561b5abf13b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 1 --2- 172.21.15.146:0/2976600575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b5a7dd4d0 0x561b5ac65910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 1 -- 172.21.15.146:0/2976600575 >> 172.21.15.146:0/2976600575 conn(0x561b5a7fa4e0 msgr2=0x561b5abf2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f92d27fc640 0 client.5844 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 1 -- 172.21.15.146:0/2976600575 shutdown_connections 2024-09-17T03:35:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 1 -- 172.21.15.146:0/2976600575 wait complete. 2024-09-17T03:35:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.973+0000 7f93009d3740 20 client.5844 trim_cache size 0 max 16384 2024-09-17T03:35:52.980 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:52.980 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2024-09-17T03:35:52.980 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {}, 2024-09-17T03:35:52.980 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:35:52.980 INFO:teuthology.orchestra.run.smithi146.stdout: "f9d6b976-53b1-4d14-bae0-a072551d0c46": { 2024-09-17T03:35:52.980 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:47.625167+0000", 2024-09-17T03:35:52.980 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-17T03:35:52.980 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:52.980 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:52.980 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:52.981 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:52.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:52.981 INFO:teuthology.orchestra.run.smithi146.stdout: "adfb75e5-b911-4f8d-a47c-c41436f4748a": { 2024-09-17T03:35:52.981 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:46.587183+0000", 2024-09-17T03:35:52.981 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:35:52.981 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:52.981 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:52.981 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:52.981 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:52.981 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:52.981 INFO:teuthology.orchestra.run.smithi146.stdout: "d88b3f93-07b9-4851-80e0-841d2041b343": { 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:46.231188+0000", 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "dee09f00-18b7-4525-8418-50d2c01a47aa": { 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:45.892193+0000", 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:52.982 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:52.983 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:52.983 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:52.983 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:52.983 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:52.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 -- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f92d4078b90 msgr2=0x7f92d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f92d4078b90 0x7f92d407b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009af0 tx=0x7f92e4005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:52.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 -- 172.21.15.146:0/1901908611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f4161500 msgr2=0x7f92f41552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f4161500 0x7f92f41552f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0014a0 tx=0x7f92ec00ea10 comp rx=0 tx=0).stop 2024-09-17T03:35:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 -- 172.21.15.146:0/1901908611 shutdown_connections 2024-09-17T03:35:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f92d4078b90 0x7f92d407b0a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92f4161500 0x7f92f41552f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92f40b5890 0x7f92f4154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 --2- 172.21.15.146:0/1901908611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92e00041c0 0x7f92f4153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 -- 172.21.15.146:0/1901908611 >> 172.21.15.146:0/1901908611 conn(0x7f92f40d4be0 msgr2=0x7f92f40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 -- 172.21.15.146:0/1901908611 shutdown_connections 2024-09-17T03:35:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:52.974+0000 7f92f9989640 1 -- 172.21.15.146:0/1901908611 wait complete. 2024-09-17T03:35:52.985 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:35:52.986 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-17T03:35:53.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.101+0000 7fcea1790640 1 -- 172.21.15.146:0/3734113953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce9c0b5750 msgr2=0x7fce9c0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.101+0000 7fcea1790640 1 --2- 172.21.15.146:0/3734113953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce9c0b5750 0x7fce9c0b3620 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0b5390 tx=0x7fce8402a530 comp rx=0 tx=0).stop 2024-09-17T03:35:53.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.101+0000 7fcea1790640 1 -- 172.21.15.146:0/3734113953 shutdown_connections 2024-09-17T03:35:53.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.101+0000 7fcea1790640 1 --2- 172.21.15.146:0/3734113953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce9c0b5750 0x7fce9c0b3620 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.101+0000 7fcea1790640 1 --2- 172.21.15.146:0/3734113953 >> v2:172.21.15.179:3300/0 conn(0x7fce9c0b5ce0 0x7fce9c0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.101+0000 7fcea1790640 1 -- 172.21.15.146:0/3734113953 >> 172.21.15.146:0/3734113953 conn(0x7fce9c0b7b20 msgr2=0x7fce9c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.101+0000 7fcea1790640 1 -- 172.21.15.146:0/3734113953 shutdown_connections 2024-09-17T03:35:53.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.101+0000 7fcea1790640 1 -- 172.21.15.146:0/3734113953 wait complete. 2024-09-17T03:35:53.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.103+0000 7fcea1790640 1 Processor -- start 2024-09-17T03:35:53.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.103+0000 7fcea1790640 1 -- start start 2024-09-17T03:35:53.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.104+0000 7fcea1790640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce9c0b3b60 0x7fce9c14d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.104+0000 7fcea1790640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce9c0b5750 0x7fce9c1f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.104+0000 7fcea1790640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce9c0b5ce0 0x7fce9c1f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.104+0000 7fcea1790640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c0b27b0 con 0x7fce9c0b3b60 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.104+0000 7fcea1790640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c15dcc0 con 0x7fce9c0b5ce0 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.104+0000 7fcea1790640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c0b2930 con 0x7fce9c0b5750 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.104+0000 7fce9affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce9c0b3b60 0x7fce9c14d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.104+0000 7fce9affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce9c0b3b60 0x7fce9c14d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53832/0 (socket says 172.21.15.146:53832) 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.104+0000 7fce9affd640 1 -- 172.21.15.146:0/601933035 learned_addr learned my addr 172.21.15.146:0/601933035 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fce9b7fe640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce9c0b5ce0 0x7fce9c1f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fce9affd640 1 -- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce9c0b5750 msgr2=0x7fce9c1f6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fce9affd640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce9c0b5750 0x7fce9c1f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fce9affd640 1 -- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce9c0b5ce0 msgr2=0x7fce9c1f7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fce9affd640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce9c0b5ce0 0x7fce9c1f7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fce9affd640 1 -- 172.21.15.146:0/601933035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c155300 con 0x7fce9c0b3b60 2024-09-17T03:35:53.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fce9affd640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce9c0b3b60 0x7fce9c14d9b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c9a0 tx=0x7fce8c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fce93fff640 1 -- 172.21.15.146:0/601933035 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c007bb0 con 0x7fce9c0b3b60 2024-09-17T03:35:53.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fce93fff640 1 -- 172.21.15.146:0/601933035 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce8c007e40 con 0x7fce9c0b3b60 2024-09-17T03:35:53.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fcea1790640 1 -- 172.21.15.146:0/601933035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c14def0 con 0x7fce9c0b3b60 2024-09-17T03:35:53.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fce93fff640 1 -- 172.21.15.146:0/601933035 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c00f690 con 0x7fce9c0b3b60 2024-09-17T03:35:53.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.105+0000 7fcea1790640 1 -- 172.21.15.146:0/601933035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c155850 con 0x7fce9c0b3b60 2024-09-17T03:35:53.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.107+0000 7fce93fff640 1 -- 172.21.15.146:0/601933035 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce8c00f830 con 0x7fce9c0b3b60 2024-09-17T03:35:53.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.107+0000 7fce93fff640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce7c078bc0 0x7fce7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.107+0000 7fce93fff640 1 -- 172.21.15.146:0/601933035 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fce8c09b590 con 0x7fce9c0b3b60 2024-09-17T03:35:53.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.108+0000 7fce927fc640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce7c078bc0 0x7fce7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.108+0000 7fce927fc640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce7c078bc0 0x7fce7c07b0d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fce84034000 tx=0x7fce840046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.108+0000 7fcea87e0740 1 Processor -- start 2024-09-17T03:35:53.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.108+0000 7fcea87e0740 1 -- start start 2024-09-17T03:35:53.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc637390 0x55efcca091d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca09710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcca26610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fcea87e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55efcc9518e0 con 0x55efcc60e4d0 2024-09-17T03:35:53.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fcea87e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55efcc940d10 con 0x55efcc6166b0 2024-09-17T03:35:53.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fcea87e0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55efcc944b20 con 0x55efcc637390 2024-09-17T03:35:53.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce927fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca09710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce927fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca09710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53846/0 (socket says 172.21.15.146:53846) 2024-09-17T03:35:53.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce927fc640 1 -- 172.21.15.146:0/1382819032 learned_addr learned my addr 172.21.15.146:0/1382819032 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce9affd640 1 --2- 172.21.15.146:0/1382819032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc637390 0x55efcca091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce9b7fe640 1 --2- 172.21.15.146:0/1382819032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcca26610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce927fc640 1 -- 172.21.15.146:0/1382819032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc637390 msgr2=0x55efcca091d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce927fc640 1 --2- 172.21.15.146:0/1382819032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc637390 0x55efcca091d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce927fc640 1 -- 172.21.15.146:0/1382819032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 msgr2=0x55efcca26610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce927fc640 1 --2- 172.21.15.146:0/1382819032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcca26610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce927fc640 1 -- 172.21.15.146:0/1382819032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcc6a2970 con 0x55efcc60e4d0 2024-09-17T03:35:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce9b7fe640 1 --2- 172.21.15.146:0/1382819032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcca26610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce927fc640 1 --2- 172.21.15.146:0/1382819032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca09710 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fce840098f0 tx=0x7fce8403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf07bb938d6cf21 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.110+0000 7fce90ff9640 1 -- 172.21.15.146:0/1382819032 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8404c070 con 0x55efcc60e4d0 2024-09-17T03:35:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.111+0000 7fce90ff9640 1 -- 172.21.15.146:0/1382819032 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce84003a20 con 0x55efcc60e4d0 2024-09-17T03:35:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.111+0000 7fce90ff9640 1 -- 172.21.15.146:0/1382819032 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84048450 con 0x55efcc60e4d0 2024-09-17T03:35:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.111+0000 7fcea87e0740 1 -- 172.21.15.146:0/1382819032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 msgr2=0x55efcca09710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.111+0000 7fcea87e0740 1 --2- 172.21.15.146:0/1382819032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca09710 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fce840098f0 tx=0x7fce8403c000 comp rx=0 tx=0).stop 2024-09-17T03:35:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.111+0000 7fcea87e0740 1 -- 172.21.15.146:0/1382819032 shutdown_connections 2024-09-17T03:35:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.111+0000 7fcea87e0740 1 --2- 172.21.15.146:0/1382819032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcca26610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.111+0000 7fcea87e0740 1 --2- 172.21.15.146:0/1382819032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca09710 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.111+0000 7fcea87e0740 1 --2- 172.21.15.146:0/1382819032 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc637390 0x55efcca091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.111+0000 7fcea87e0740 1 -- 172.21.15.146:0/1382819032 >> 172.21.15.146:0/1382819032 conn(0x55efcc62b4e0 msgr2=0x55efcc9df490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.112+0000 7fcea87e0740 1 -- 172.21.15.146:0/1382819032 shutdown_connections 2024-09-17T03:35:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.112+0000 7fcea87e0740 1 -- 172.21.15.146:0/1382819032 wait complete. 2024-09-17T03:35:53.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.112+0000 7fcea87e0740 1 -- start start 2024-09-17T03:35:53.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.112+0000 7fcea87e0740 1 Processor -- start 2024-09-17T03:35:53.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca05fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcca06500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc637390 0x55efcca35e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fcea87e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55efcc6b1740 con 0x55efcc60e4d0 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fcea87e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55efcc8e67f0 con 0x55efcc6166b0 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fcea87e0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55efcca09c50 con 0x55efcc637390 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fcea87e0740 10 client.0 _ll_register_callbacks cb 0x55efcc8ea2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce9affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca05fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce9affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca05fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53856/0 (socket says 172.21.15.146:53856) 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce9affd640 1 -- 172.21.15.146:0/3985243976 learned_addr learned my addr 172.21.15.146:0/3985243976 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce927fc640 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcca06500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce9b7fe640 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc637390 0x55efcca35e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce9affd640 1 -- 172.21.15.146:0/3985243976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc637390 msgr2=0x55efcca35e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce9affd640 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc637390 0x55efcca35e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce9affd640 1 -- 172.21.15.146:0/3985243976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 msgr2=0x55efcca06500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce9affd640 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcca06500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce9affd640 1 -- 172.21.15.146:0/3985243976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efcc7197d0 con 0x55efcc60e4d0 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce9b7fe640 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc637390 0x55efcca35e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce9affd640 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca05fc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fce8c060570 tx=0x7fce8c063920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a200a9042ab09a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.114+0000 7fce79ffb640 1 -- 172.21.15.146:0/3985243976 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c063300 con 0x55efcc60e4d0 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fce79ffb640 1 -- 172.21.15.146:0/3985243976 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fce8c062560 con 0x55efcc60e4d0 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fcea87e0740 1 -- 172.21.15.146:0/3985243976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce84003a20 con 0x55efcc60e4d0 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fce79ffb640 1 -- 172.21.15.146:0/3985243976 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fce8c067de0 con 0x55efcc60e4d0 2024-09-17T03:35:53.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fcea87e0740 10 client.5859 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fcea87e0740 1 -- 172.21.15.146:0/3985243976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55efcca349e0 con 0x55efcc60e4d0 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fce79ffb640 1 -- 172.21.15.146:0/3985243976 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce84003a20 con 0x55efcc60e4d0 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fce79ffb640 1 -- 172.21.15.146:0/3985243976 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fce8c00fb20 con 0x55efcc60e4d0 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fcea87e0740 10 client.5859 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fcea87e0740 10 client.5859 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fcea87e0740 20 client.5859 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fcea87e0740 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55efcc5f5f60 0x55efcca1c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fcea87e0740 4 client.5859 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fcea87e0740 1 -- 172.21.15.146:0/3985243976 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efcc953830 con 0x55efcc5f5f60 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fce927fc640 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55efcc5f5f60 0x55efcca1c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.115+0000 7fce79ffb640 10 client.5859 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fce927fc640 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55efcc5f5f60 0x55efcca1c790 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61abce1f26251e64 server_cookie=a9415d96dfcc0d74 in_seq=0 out_seq=0 2024-09-17T03:35:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fce79ffb640 1 -- 172.21.15.146:0/3985243976 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55efcc953830 con 0x55efcc5f5f60 2024-09-17T03:35:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fce79ffb640 10 client.5859 handle_command_reply: tid=0 2024-09-17T03:35:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fcea87e0740 1 client.5859 shutdown 2024-09-17T03:35:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fcea87e0740 1 -- 172.21.15.146:0/3985243976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 msgr2=0x55efcca05fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fcea87e0740 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca05fc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fce8c060570 tx=0x7fce8c063920 comp rx=0 tx=0).stop 2024-09-17T03:35:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fcea87e0740 1 -- 172.21.15.146:0/3985243976 shutdown_connections 2024-09-17T03:35:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fcea87e0740 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55efcc5f5f60 0x55efcca1c790 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fcea87e0740 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc637390 0x55efcca35e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fcea87e0740 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcca06500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fce79ffb640 0 client.5859 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fcea87e0740 1 --2- 172.21.15.146:0/3985243976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcca05fc0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fcea87e0740 1 -- 172.21.15.146:0/3985243976 >> 172.21.15.146:0/3985243976 conn(0x55efcc62b4e0 msgr2=0x55efcc9f8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.116+0000 7fcea87e0740 1 -- 172.21.15.146:0/3985243976 shutdown_connections 2024-09-17T03:35:53.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.117+0000 7fcea87e0740 1 -- 172.21.15.146:0/3985243976 wait complete. 2024-09-17T03:35:53.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.117+0000 7fcea87e0740 20 client.5859 trim_cache size 0 max 16384 2024-09-17T03:35:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.130+0000 7fcea87e0740 1 Processor -- start 2024-09-17T03:35:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.130+0000 7fcea87e0740 1 -- start start 2024-09-17T03:35:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.131+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc5f5f60 0x55efcca09680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.131+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcc9f8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.131+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcc9f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.131+0000 7fcea87e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c200250 con 0x55efcc60e4d0 2024-09-17T03:35:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.131+0000 7fcea87e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c1ff270 con 0x55efcc6166b0 2024-09-17T03:35:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.131+0000 7fcea87e0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c1f50b0 con 0x55efcc5f5f60 2024-09-17T03:35:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.131+0000 7fce927fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcc9f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.131+0000 7fce927fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcc9f8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53870/0 (socket says 172.21.15.146:53870) 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.131+0000 7fce927fc640 1 -- 172.21.15.146:0/525015299 learned_addr learned my addr 172.21.15.146:0/525015299 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.132+0000 7fce927fc640 1 -- 172.21.15.146:0/525015299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc5f5f60 msgr2=0x55efcca09680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.132+0000 7fce927fc640 1 --2- 172.21.15.146:0/525015299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc5f5f60 0x55efcca09680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.132+0000 7fce927fc640 1 -- 172.21.15.146:0/525015299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 msgr2=0x55efcc9f8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.132+0000 7fce927fc640 1 --2- 172.21.15.146:0/525015299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcc9f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.132+0000 7fce927fc640 1 -- 172.21.15.146:0/525015299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcca1c2e0 con 0x55efcc60e4d0 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.132+0000 7fce927fc640 1 --2- 172.21.15.146:0/525015299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcc9f8920 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fce84004540 tx=0x7fce84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fb6639a7fb9712 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.132+0000 7fce7bfff640 1 -- 172.21.15.146:0/525015299 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8403f070 con 0x55efcc60e4d0 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.132+0000 7fce7bfff640 1 -- 172.21.15.146:0/525015299 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce84003e50 con 0x55efcc60e4d0 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.132+0000 7fce7bfff640 1 -- 172.21.15.146:0/525015299 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8404c040 con 0x55efcc60e4d0 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.133+0000 7fcea87e0740 1 -- 172.21.15.146:0/525015299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 msgr2=0x55efcc9f8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.133+0000 7fcea87e0740 1 --2- 172.21.15.146:0/525015299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcc9f8920 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fce84004540 tx=0x7fce84004730 comp rx=0 tx=0).stop 2024-09-17T03:35:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.133+0000 7fcea87e0740 1 -- 172.21.15.146:0/525015299 shutdown_connections 2024-09-17T03:35:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.133+0000 7fcea87e0740 1 --2- 172.21.15.146:0/525015299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc6166b0 0x55efcc9f8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.133+0000 7fcea87e0740 1 --2- 172.21.15.146:0/525015299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc60e4d0 0x55efcc9f8920 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.133+0000 7fcea87e0740 1 --2- 172.21.15.146:0/525015299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc5f5f60 0x55efcca09680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.133+0000 7fcea87e0740 1 -- 172.21.15.146:0/525015299 >> 172.21.15.146:0/525015299 conn(0x55efcc62b4e0 msgr2=0x55efcca1b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.133+0000 7fcea87e0740 1 -- 172.21.15.146:0/525015299 shutdown_connections 2024-09-17T03:35:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.133+0000 7fcea87e0740 1 -- 172.21.15.146:0/525015299 wait complete. 2024-09-17T03:35:53.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.133+0000 7fcea87e0740 1 -- start start 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.134+0000 7fcea87e0740 1 Processor -- start 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc5f5f60 0x55efccaa2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc60e4d0 0x55efcca05e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fcea87e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc6166b0 0x55efcca063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fcea87e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c1f56d0 con 0x55efcc6166b0 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fcea87e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55efcca04940 con 0x55efcc60e4d0 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fcea87e0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55efcca3ee10 con 0x55efcc5f5f60 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fcea87e0740 10 client.0 _ll_register_callbacks cb 0x7fce8c00a570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce9b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc6166b0 0x55efcca063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce9b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc6166b0 0x55efcca063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53872/0 (socket says 172.21.15.146:53872) 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce9b7fe640 1 -- 172.21.15.146:0/1389434943 learned_addr learned my addr 172.21.15.146:0/1389434943 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce9affd640 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc5f5f60 0x55efccaa2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce927fc640 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc60e4d0 0x55efcca05e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce9b7fe640 1 -- 172.21.15.146:0/1389434943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc5f5f60 msgr2=0x55efccaa2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce9b7fe640 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc5f5f60 0x55efccaa2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce9b7fe640 1 -- 172.21.15.146:0/1389434943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc60e4d0 msgr2=0x55efcca05e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce9b7fe640 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc60e4d0 0x55efcca05e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce9b7fe640 1 -- 172.21.15.146:0/1389434943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efcca26090 con 0x55efcc6166b0 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce9b7fe640 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc6166b0 0x55efcca063c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fce94003fc0 tx=0x7fce94011620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555b2a65d30dd1a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.135+0000 7fce79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fce79ffb640 1 -- 172.21.15.146:0/1389434943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94019030 con 0x55efcc6166b0 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fce79ffb640 1 -- 172.21.15.146:0/1389434943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fce94010040 con 0x55efcc6166b0 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fcea87e0740 1 -- 172.21.15.146:0/1389434943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce84003e50 con 0x55efcc6166b0 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fce79ffb640 1 -- 172.21.15.146:0/1389434943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fce94022050 con 0x55efcc6166b0 2024-09-17T03:35:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fcea87e0740 10 client.5865 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fcea87e0740 1 -- 172.21.15.146:0/1389434943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55efccaa3540 con 0x55efcc6166b0 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fce79ffb640 1 -- 172.21.15.146:0/1389434943 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce84003e50 con 0x55efcc6166b0 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fce79ffb640 1 -- 172.21.15.146:0/1389434943 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fce94025020 con 0x55efcc6166b0 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fcea87e0740 10 client.5865 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fcea87e0740 10 client.5865 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fcea87e0740 20 client.5865 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fcea87e0740 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55efcc5cb3a0 0x55efcca473f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fcea87e0740 4 client.5865 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fcea87e0740 1 -- 172.21.15.146:0/1389434943 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55efcc9d5140 con 0x55efcc5cb3a0 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fce9affd640 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55efcc5cb3a0 0x55efcca473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.136+0000 7fce79ffb640 10 client.5865 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fce9affd640 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55efcc5cb3a0 0x55efcca473f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13419e43a4f49f6a server_cookie=ecfd6293aab3be5d in_seq=0 out_seq=0 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fce79ffb640 1 -- 172.21.15.146:0/1389434943 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x55efcc9d5140 con 0x55efcc5cb3a0 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fce79ffb640 10 client.5865 handle_command_reply: tid=0 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 1 client.5865 shutdown 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 1 -- 172.21.15.146:0/1389434943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc6166b0 msgr2=0x55efcca063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc6166b0 0x55efcca063c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fce94003fc0 tx=0x7fce94011620 comp rx=0 tx=0).stop 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 1 -- 172.21.15.146:0/1389434943 shutdown_connections 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55efcc5cb3a0 0x55efcca473f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55efcc6166b0 0x55efcca063c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55efcc60e4d0 0x55efcca05e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fce79ffb640 0 client.5865 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 1 --2- 172.21.15.146:0/1389434943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55efcc5f5f60 0x55efccaa2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 1 -- 172.21.15.146:0/1389434943 >> 172.21.15.146:0/1389434943 conn(0x55efcc62b4e0 msgr2=0x55efcc9f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 1 -- 172.21.15.146:0/1389434943 shutdown_connections 2024-09-17T03:35:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 1 -- 172.21.15.146:0/1389434943 wait complete. 2024-09-17T03:35:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.137+0000 7fcea87e0740 20 client.5865 trim_cache size 0 max 16384 2024-09-17T03:35:53.146 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:35:53.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:35:53.146 INFO:teuthology.orchestra.run.smithi146.stdout: "damage_type": "backtrace", 2024-09-17T03:35:53.146 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 3858452917, 2024-09-17T03:35:53.146 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 1099511630412, 2024-09-17T03:35:53.146 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-09-17T03:35:53.146 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:53.147 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:35:53.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 -- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce7c078bc0 msgr2=0x7fce7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce7c078bc0 0x7fce7c07b0d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fce84034000 tx=0x7fce840046c0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 -- 172.21.15.146:0/601933035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce9c0b3b60 msgr2=0x7fce9c14d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce9c0b3b60 0x7fce9c14d9b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c9a0 tx=0x7fce8c00ce60 comp rx=0 tx=0).stop 2024-09-17T03:35:53.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 -- 172.21.15.146:0/601933035 shutdown_connections 2024-09-17T03:35:53.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fce7c078bc0 0x7fce7c07b0d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce9c0b5ce0 0x7fce9c1f7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fce9c0b5750 0x7fce9c1f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 --2- 172.21.15.146:0/601933035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce9c0b3b60 0x7fce9c14d9b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 -- 172.21.15.146:0/601933035 >> 172.21.15.146:0/601933035 conn(0x7fce9c0b7b20 msgr2=0x7fce9c071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 -- 172.21.15.146:0/601933035 shutdown_connections 2024-09-17T03:35:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.138+0000 7fcea1790640 1 -- 172.21.15.146:0/601933035 wait complete. 2024-09-17T03:35:53.149 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:35:53.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.262+0000 7fb57e183640 1 -- 172.21.15.146:0/143215258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5780701e0 msgr2=0x7fb5780cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.262+0000 7fb57e183640 1 --2- 172.21.15.146:0/143215258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5780701e0 0x7fb5780cfea0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb57815d000 tx=0x7fb57002a890 comp rx=0 tx=0).stop 2024-09-17T03:35:53.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.262+0000 7fb57e183640 1 -- 172.21.15.146:0/143215258 shutdown_connections 2024-09-17T03:35:53.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.262+0000 7fb57e183640 1 --2- 172.21.15.146:0/143215258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5780701e0 0x7fb5780cfea0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.262+0000 7fb57e183640 1 --2- 172.21.15.146:0/143215258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb57815c9f0 0x7fb5781526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.262+0000 7fb57e183640 1 -- 172.21.15.146:0/143215258 >> 172.21.15.146:0/143215258 conn(0x7fb57806d3c0 msgr2=0x7fb5780b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.262+0000 7fb57e183640 1 -- 172.21.15.146:0/143215258 shutdown_connections 2024-09-17T03:35:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.262+0000 7fb57e183640 1 -- 172.21.15.146:0/143215258 wait complete. 2024-09-17T03:35:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.264+0000 7fb57e183640 1 Processor -- start 2024-09-17T03:35:53.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.264+0000 7fb57e183640 1 -- start start 2024-09-17T03:35:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb57e183640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5780b4100 0x7fb578155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb57e183640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5781483e0 0x7fb5780b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb57e183640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5781487f0 0x7fb5780b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb57e183640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780d0770 con 0x7fb5781487f0 2024-09-17T03:35:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb57e183640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780d05f0 con 0x7fb5781483e0 2024-09-17T03:35:53.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb57e183640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb5780d08f0 con 0x7fb5780b4100 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb577fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5781487f0 0x7fb5780b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb577fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5781487f0 0x7fb5780b2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53896/0 (socket says 172.21.15.146:53896) 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb577fff640 1 -- 172.21.15.146:0/829590542 learned_addr learned my addr 172.21.15.146:0/829590542 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb5777fe640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5780b4100 0x7fb578155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb576ffd640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5781483e0 0x7fb5780b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb577fff640 1 -- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5780b4100 msgr2=0x7fb578155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb577fff640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5780b4100 0x7fb578155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb577fff640 1 -- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5781483e0 msgr2=0x7fb5780b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb577fff640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5781483e0 0x7fb5780b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb577fff640 1 -- 172.21.15.146:0/829590542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5781f6510 con 0x7fb5781487f0 2024-09-17T03:35:53.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb577fff640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5781487f0 0x7fb5780b2430 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb57002ae80 tx=0x7fb570033f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.266+0000 7fb55ffff640 1 -- 172.21.15.146:0/829590542 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570031970 con 0x7fb5781487f0 2024-09-17T03:35:53.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.267+0000 7fb55ffff640 1 -- 172.21.15.146:0/829590542 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb570031c00 con 0x7fb5781487f0 2024-09-17T03:35:53.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.267+0000 7fb55ffff640 1 -- 172.21.15.146:0/829590542 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700330d0 con 0x7fb5781487f0 2024-09-17T03:35:53.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.267+0000 7fb57e183640 1 -- 172.21.15.146:0/829590542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5781f67f0 con 0x7fb5781487f0 2024-09-17T03:35:53.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.267+0000 7fb57e183640 1 -- 172.21.15.146:0/829590542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5781e4c70 con 0x7fb5781487f0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.268+0000 7fb57e183640 1 -- 172.21.15.146:0/829590542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5781e4ed0 con 0x7fb5781487f0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.268+0000 7fb55ffff640 1 -- 172.21.15.146:0/829590542 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb570033270 con 0x7fb5781487f0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.269+0000 7fb55ffff640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb564078bc0 0x7fb56407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.269+0000 7fb55ffff640 1 -- 172.21.15.146:0/829590542 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fb5700bc0b0 con 0x7fb5781487f0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.269+0000 7fb5777fe640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb564078bc0 0x7fb56407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.270+0000 7fb5777fe640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb564078bc0 0x7fb56407b0d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb568005fd0 tx=0x7fb568005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.274+0000 7fb55ffff640 1 -- 172.21.15.146:0/829590542 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb57003f030 con 0x7fb5781487f0 2024-09-17T03:35:53.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.480+0000 7fb57e183640 1 -- 172.21.15.146:0/829590542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb57815c9f0 con 0x7fb5781487f0 2024-09-17T03:35:53.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.481+0000 7fb55ffff640 1 -- 172.21.15.146:0/829590542 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5229 (secure 0 0 0) 0x7fb5700844b0 con 0x7fb5781487f0 2024-09-17T03:35:53.480 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:35:53.480 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":21,"btime":"2024-09-17T03:35:33:398538+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2310307824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2310307824},{"type":"v1","addr":"172.21.15.179:6836","nonce":2310307824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/422393296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":422393296},{"type":"v1","addr":"172.21.15.179:6837","nonce":422393296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3793010114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3793010114},{"type":"v1","addr":"172.21.15.146:6833","nonce":3793010114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:30.743460+0000","modified":"2024-09-17T03:35:32.751716+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/924109004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":924109004},{"type":"v1","addr":"172.21.15.146:6835","nonce":924109004}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5400,"qdb_cluster":[5400]},"id":3}]} 2024-09-17T03:35:53.480 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 21 2024-09-17T03:35:53.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 -- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb564078bc0 msgr2=0x7fb56407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb564078bc0 0x7fb56407b0d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb568005fd0 tx=0x7fb568005850 comp rx=0 tx=0).stop 2024-09-17T03:35:53.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 -- 172.21.15.146:0/829590542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5781487f0 msgr2=0x7fb5780b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5781487f0 0x7fb5780b2430 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb57002ae80 tx=0x7fb570033f30 comp rx=0 tx=0).stop 2024-09-17T03:35:53.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 -- 172.21.15.146:0/829590542 shutdown_connections 2024-09-17T03:35:53.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb564078bc0 0x7fb56407b0d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5781487f0 0x7fb5780b2430 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5781483e0 0x7fb5780b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 --2- 172.21.15.146:0/829590542 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5780b4100 0x7fb578155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 -- 172.21.15.146:0/829590542 >> 172.21.15.146:0/829590542 conn(0x7fb57806d3c0 msgr2=0x7fb578072c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 -- 172.21.15.146:0/829590542 shutdown_connections 2024-09-17T03:35:53.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.483+0000 7fb57e183640 1 -- 172.21.15.146:0/829590542 wait complete. 2024-09-17T03:35:53.493 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 3858452917 2024-09-17T03:35:53.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.610+0000 7f1bbd79d640 1 -- 172.21.15.146:0/1356076336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80cfd00 msgr2=0x7f1bb815ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.610+0000 7f1bbd79d640 1 --2- 172.21.15.146:0/1356076336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80cfd00 0x7f1bb815ead0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0098e0 tx=0x7f1bac02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.610+0000 7f1bbd79d640 1 -- 172.21.15.146:0/1356076336 shutdown_connections 2024-09-17T03:35:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.610+0000 7f1bbd79d640 1 --2- 172.21.15.146:0/1356076336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb80cef10 0x7f1bb80d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.610+0000 7f1bbd79d640 1 --2- 172.21.15.146:0/1356076336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80cfd00 0x7f1bb815ead0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.610+0000 7f1bbd79d640 1 -- 172.21.15.146:0/1356076336 >> 172.21.15.146:0/1356076336 conn(0x7f1bb80d10a0 msgr2=0x7f1bb80d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.610+0000 7f1bbd79d640 1 -- 172.21.15.146:0/1356076336 shutdown_connections 2024-09-17T03:35:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.610+0000 7f1bbd79d640 1 -- 172.21.15.146:0/1356076336 wait complete. 2024-09-17T03:35:53.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.612+0000 7f1bbd79d640 1 Processor -- start 2024-09-17T03:35:53.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.612+0000 7f1bbd79d640 1 -- start start 2024-09-17T03:35:53.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.613+0000 7f1bbd79d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80cef10 0x7f1bb80ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.613+0000 7f1bbd79d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb80d26b0 0x7f1bb80cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.613+0000 7f1bbd79d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb81f5ce0 0x7f1bb8161b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.613+0000 7f1bbd79d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80d3950 con 0x7f1bb80cef10 2024-09-17T03:35:53.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.613+0000 7f1bbd79d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80d37d0 con 0x7f1bb80d26b0 2024-09-17T03:35:53.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.613+0000 7f1bbd79d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb80d3ad0 con 0x7f1bb81f5ce0 2024-09-17T03:35:53.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.613+0000 7f1bb7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80cef10 0x7f1bb80ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.613+0000 7f1bb7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80cef10 0x7f1bb80ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53910/0 (socket says 172.21.15.146:53910) 2024-09-17T03:35:53.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bb7fff640 1 -- 172.21.15.146:0/2637726073 learned_addr learned my addr 172.21.15.146:0/2637726073 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb80d26b0 0x7f1bb80cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bbcf9c640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb81f5ce0 0x7f1bb8161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bb7fff640 1 -- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb81f5ce0 msgr2=0x7f1bb8161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb81f5ce0 0x7f1bb8161b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bb7fff640 1 -- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb80d26b0 msgr2=0x7f1bb80cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb80d26b0 0x7f1bb80cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bb7fff640 1 -- 172.21.15.146:0/2637726073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb8160d80 con 0x7f1bb80cef10 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80cef10 0x7f1bb80ccc90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800c3a0 tx=0x7f1ba800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/2637726073 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8017070 con 0x7f1bb80cef10 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/2637726073 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ba80053c0 con 0x7f1bb80cef10 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bbd79d640 1 -- 172.21.15.146:0/2637726073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb8161060 con 0x7f1bb80cef10 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/2637726073 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8003850 con 0x7f1bb80cef10 2024-09-17T03:35:53.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.614+0000 7f1bbd79d640 1 -- 172.21.15.146:0/2637726073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb8161620 con 0x7f1bb80cef10 2024-09-17T03:35:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.616+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/2637726073 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ba801a070 con 0x7f1bb80cef10 2024-09-17T03:35:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.617+0000 7f1bb4ff9640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba4078b90 0x7f1ba407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.617+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/2637726073 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f1ba809a110 con 0x7f1bb80cef10 2024-09-17T03:35:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.617+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba4078b90 0x7f1ba407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.617+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba4078b90 0x7f1ba407b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1bac034000 tx=0x7f1bac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.617+0000 7f1bc5a43740 1 Processor -- start 2024-09-17T03:35:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.618+0000 7f1bc5a43740 1 -- start start 2024-09-17T03:35:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0fb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbce33e0 0x55ddfc0de450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbceb5c0 0x55ddfc0de990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ddfc026910 con 0x55ddfbce33e0 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ddfc015d40 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ddfc019b50 con 0x55ddfbceb5c0 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbce33e0 0x55ddfc0de450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbce33e0 0x55ddfc0de450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53912/0 (socket says 172.21.15.146:53912) 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bb77fe640 1 -- 172.21.15.146:0/4112063188 learned_addr learned my addr 172.21.15.146:0/4112063188 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/4112063188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0fb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bbcf9c640 1 --2- 172.21.15.146:0/4112063188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbceb5c0 0x55ddfc0de990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bb77fe640 1 -- 172.21.15.146:0/4112063188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbceb5c0 msgr2=0x55ddfc0de990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/4112063188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbceb5c0 0x55ddfc0de990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bb77fe640 1 -- 172.21.15.146:0/4112063188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 msgr2=0x55ddfc0fb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/4112063188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0fb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bb77fe640 1 -- 172.21.15.146:0/4112063188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddfbdf0710 con 0x55ddfbce33e0 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.619+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/4112063188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbce33e0 0x55ddfc0de450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1bac005660 tx=0x7f1bac03e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0d0a5e1216ce0d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1b9dffb640 1 -- 172.21.15.146:0/4112063188 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac004250 con 0x55ddfbce33e0 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1b9dffb640 1 -- 172.21.15.146:0/4112063188 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bac04b030 con 0x55ddfbce33e0 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1b9dffb640 1 -- 172.21.15.146:0/4112063188 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac004bc0 con 0x55ddfbce33e0 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1bc5a43740 1 -- 172.21.15.146:0/4112063188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbce33e0 msgr2=0x55ddfc0de450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/4112063188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbce33e0 0x55ddfc0de450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1bac005660 tx=0x7f1bac03e040 comp rx=0 tx=0).stop 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1bc5a43740 1 -- 172.21.15.146:0/4112063188 shutdown_connections 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/4112063188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbceb5c0 0x55ddfc0de990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/4112063188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbce33e0 0x55ddfc0de450 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/4112063188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0fb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1bc5a43740 1 -- 172.21.15.146:0/4112063188 >> 172.21.15.146:0/4112063188 conn(0x55ddfbd003f0 msgr2=0x55ddfc0b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1bc5a43740 1 -- 172.21.15.146:0/4112063188 shutdown_connections 2024-09-17T03:35:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.620+0000 7f1bc5a43740 1 -- 172.21.15.146:0/4112063188 wait complete. 2024-09-17T03:35:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.621+0000 7f1bc5a43740 1 -- start start 2024-09-17T03:35:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.622+0000 7f1bc5a43740 1 Processor -- start 2024-09-17T03:35:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc0f6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbceb5c0 0x55ddfc107e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbd86650 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbf9c5f0 con 0x55ddfbceb5c0 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ddfc0f68c0 con 0x55ddfbce33e0 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bc5a43740 10 client.0 _ll_register_callbacks cb 0x55ddfc010060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bbcf9c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bbcf9c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0fbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53928/0 (socket says 172.21.15.146:53928) 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bbcf9c640 1 -- 172.21.15.146:0/21975026 learned_addr learned my addr 172.21.15.146:0/21975026 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbceb5c0 0x55ddfc107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc0f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bbcf9c640 1 -- 172.21.15.146:0/21975026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 msgr2=0x55ddfc0f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bbcf9c640 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc0f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bbcf9c640 1 -- 172.21.15.146:0/21975026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbceb5c0 msgr2=0x55ddfc107e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bbcf9c640 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbceb5c0 0x55ddfc107e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.623+0000 7f1bbcf9c640 1 -- 172.21.15.146:0/21975026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddfbe50ea0 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1bbcf9c640 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0fbd50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0013990 tx=0x7f1bb0013d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90db1d6fff93828 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1b96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:53.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1b96ffd640 1 -- 172.21.15.146:0/21975026 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0011e90 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1b96ffd640 1 -- 172.21.15.146:0/21975026 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f1bb0003970 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1bc5a43740 1 -- 172.21.15.146:0/21975026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ddfbff3b60 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1b96ffd640 1 -- 172.21.15.146:0/21975026 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1bb0024050 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1bc5a43740 10 client.5886 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:53.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1bc5a43740 1 -- 172.21.15.146:0/21975026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55ddfbd555b0 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1b96ffd640 1 -- 172.21.15.146:0/21975026 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ddfbff3b60 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1b96ffd640 1 -- 172.21.15.146:0/21975026 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f1bb001a020 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1bc5a43740 10 client.5886 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:53.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1bc5a43740 10 client.5886 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:35:53.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1bc5a43740 20 client.5886 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:53.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55ddfbccb080 0x55ddfc10bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1bc5a43740 4 client.5886 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:53.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1bc5a43740 1 -- 172.21.15.146:0/21975026 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddfc028860 con 0x55ddfbccb080 2024-09-17T03:35:53.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.624+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55ddfbccb080 0x55ddfc10bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.625+0000 7f1b96ffd640 10 client.5886 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.625+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55ddfbccb080 0x55ddfc10bdb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b32b85b510030a4b server_cookie=af787be8e03ecd88 in_seq=0 out_seq=0 2024-09-17T03:35:53.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.625+0000 7f1b96ffd640 1 -- 172.21.15.146:0/21975026 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ddfc028860 con 0x55ddfbccb080 2024-09-17T03:35:53.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.625+0000 7f1b96ffd640 10 client.5886 handle_command_reply: tid=0 2024-09-17T03:35:53.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.625+0000 7f1bc5a43740 1 client.5886 shutdown 2024-09-17T03:35:53.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1bc5a43740 1 -- 172.21.15.146:0/21975026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbd0c2a0 msgr2=0x55ddfc0fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0fbd50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0013990 tx=0x7f1bb0013d90 comp rx=0 tx=0).stop 2024-09-17T03:35:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1bc5a43740 1 -- 172.21.15.146:0/21975026 shutdown_connections 2024-09-17T03:35:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55ddfbccb080 0x55ddfc10bdb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0fbd50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1b96ffd640 0 client.5886 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbceb5c0 0x55ddfc107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/21975026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc0f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1bc5a43740 1 -- 172.21.15.146:0/21975026 >> 172.21.15.146:0/21975026 conn(0x55ddfbd003f0 msgr2=0x55ddfc0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1bc5a43740 1 -- 172.21.15.146:0/21975026 shutdown_connections 2024-09-17T03:35:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1bc5a43740 1 -- 172.21.15.146:0/21975026 wait complete. 2024-09-17T03:35:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.626+0000 7f1bc5a43740 20 client.5886 trim_cache size 0 max 16384 2024-09-17T03:35:53.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.640+0000 7f1bc5a43740 1 Processor -- start 2024-09-17T03:35:53.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.640+0000 7f1bc5a43740 1 -- start start 2024-09-17T03:35:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc0f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb8201200 con 0x55ddfbceb5c0 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb814d150 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb8200be0 con 0x55ddfbce33e0 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc0b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53940/0 (socket says 172.21.15.146:53940) 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bb77fe640 1 -- 172.21.15.146:0/48317793 learned_addr learned my addr 172.21.15.146:0/48317793 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/48317793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc0f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bbcf9c640 1 --2- 172.21.15.146:0/48317793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bb77fe640 1 -- 172.21.15.146:0/48317793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 msgr2=0x55ddfc0f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/48317793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc0f8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bb77fe640 1 -- 172.21.15.146:0/48317793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 msgr2=0x55ddfc0b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/48317793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bb77fe640 1 -- 172.21.15.146:0/48317793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddfc0a9600 con 0x55ddfbceb5c0 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.641+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/48317793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc0b5350 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1bac02aa90 tx=0x7f1bac0091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bc42cc209d0b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1b9d7fa640 1 -- 172.21.15.146:0/48317793 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac05e070 con 0x55ddfbceb5c0 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1b9d7fa640 1 -- 172.21.15.146:0/48317793 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bac004960 con 0x55ddfbceb5c0 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1b9d7fa640 1 -- 172.21.15.146:0/48317793 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac004d30 con 0x55ddfbceb5c0 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1bc5a43740 1 -- 172.21.15.146:0/48317793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 msgr2=0x55ddfc0b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/48317793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc0b5350 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1bac02aa90 tx=0x7f1bac0091e0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1bc5a43740 1 -- 172.21.15.146:0/48317793 shutdown_connections 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/48317793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc0b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/48317793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc0b5350 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/48317793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc0f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1bc5a43740 1 -- 172.21.15.146:0/48317793 >> 172.21.15.146:0/48317793 conn(0x55ddfbd003f0 msgr2=0x55ddfc0de450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1bc5a43740 1 -- 172.21.15.146:0/48317793 shutdown_connections 2024-09-17T03:35:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.642+0000 7f1bc5a43740 1 -- 172.21.15.146:0/48317793 wait complete. 2024-09-17T03:35:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.643+0000 7f1bc5a43740 1 -- start start 2024-09-17T03:35:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.644+0000 7f1bc5a43740 1 Processor -- start 2024-09-17T03:35:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc177e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc10a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bc5a43740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc10ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ddfc0fc2e0 con 0x55ddfbceb5c0 2024-09-17T03:35:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ddfc0f4230 con 0x55ddfbd0c2a0 2024-09-17T03:35:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bc5a43740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ddfc0f6d80 con 0x55ddfbce33e0 2024-09-17T03:35:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bc5a43740 10 client.0 _ll_register_callbacks cb 0x7f1bb0009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc10a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc10a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53942/0 (socket says 172.21.15.146:53942) 2024-09-17T03:35:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bb77fe640 1 -- 172.21.15.146:0/3751804312 learned_addr learned my addr 172.21.15.146:0/3751804312 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc177e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bbcf9c640 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc10ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bb77fe640 1 -- 172.21.15.146:0/3751804312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 msgr2=0x55ddfc177e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc177e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bb77fe640 1 -- 172.21.15.146:0/3751804312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 msgr2=0x55ddfc10ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc10ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bb77fe640 1 -- 172.21.15.146:0/3751804312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddfc0ddf50 con 0x55ddfbceb5c0 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bbcf9c640 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc10ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc10a730 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1bac02aa90 tx=0x7f1bac004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee93eab627e0c177 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.645+0000 7f1b96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1b96ffd640 1 -- 172.21.15.146:0/3751804312 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac067060 con 0x55ddfbceb5c0 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1b96ffd640 1 -- 172.21.15.146:0/3751804312 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f1bac050620 con 0x55ddfbceb5c0 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1bc5a43740 1 -- 172.21.15.146:0/3751804312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bac004960 con 0x55ddfbceb5c0 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1b96ffd640 1 -- 172.21.15.146:0/3751804312 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1bac06d050 con 0x55ddfbceb5c0 2024-09-17T03:35:53.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1bc5a43740 10 client.5892 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1bc5a43740 1 -- 172.21.15.146:0/3751804312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55ddfc0da900 con 0x55ddfbceb5c0 2024-09-17T03:35:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1b96ffd640 1 -- 172.21.15.146:0/3751804312 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bac004960 con 0x55ddfbceb5c0 2024-09-17T03:35:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1b96ffd640 1 -- 172.21.15.146:0/3751804312 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f1bac070020 con 0x55ddfbceb5c0 2024-09-17T03:35:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1bc5a43740 10 client.5892 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1bc5a43740 10 client.5892 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:35:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1bc5a43740 20 client.5892 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55ddfc0b5350 0x55ddfc0b5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1bc5a43740 4 client.5892 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 3858452917}] 2024-09-17T03:35:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1bc5a43740 1 -- 172.21.15.146:0/3751804312 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3858452917}) -- 0x55ddfc024310 con 0x55ddfc0b5350 2024-09-17T03:35:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.646+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55ddfc0b5350 0x55ddfc0b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1b96ffd640 10 client.5892 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55ddfc0b5350 0x55ddfc0b5760 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e32a28b9bd0a6d45 server_cookie=459e82de3ccabc2e in_seq=0 out_seq=0 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1b96ffd640 1 -- 172.21.15.146:0/3751804312 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55ddfc024310 con 0x55ddfc0b5350 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1b96ffd640 10 client.5892 handle_command_reply: tid=0 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 1 client.5892 shutdown 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 1 -- 172.21.15.146:0/3751804312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 msgr2=0x55ddfc10a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc10a730 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1bac02aa90 tx=0x7f1bac004ef0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 1 -- 172.21.15.146:0/3751804312 shutdown_connections 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55ddfc0b5350 0x55ddfc0b5760 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ddfbd0c2a0 0x55ddfc10ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ddfbceb5c0 0x55ddfc10a730 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 1 --2- 172.21.15.146:0/3751804312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ddfbce33e0 0x55ddfc177e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1b96ffd640 0 client.5892 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 1 -- 172.21.15.146:0/3751804312 >> 172.21.15.146:0/3751804312 conn(0x55ddfbd003f0 msgr2=0x55ddfc0f4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 1 -- 172.21.15.146:0/3751804312 shutdown_connections 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 1 -- 172.21.15.146:0/3751804312 wait complete. 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.647+0000 7f1bc5a43740 20 client.5892 trim_cache size 0 max 16384 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 -- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba4078b90 msgr2=0x7f1ba407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba4078b90 0x7f1ba407b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1bac034000 tx=0x7f1bac004730 comp rx=0 tx=0).stop 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 -- 172.21.15.146:0/2637726073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80cef10 msgr2=0x7f1bb80ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80cef10 0x7f1bb80ccc90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800c3a0 tx=0x7f1ba800c860 comp rx=0 tx=0).stop 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 -- 172.21.15.146:0/2637726073 shutdown_connections 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ba4078b90 0x7f1ba407b0a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb81f5ce0 0x7f1bb8161b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb80d26b0 0x7f1bb80cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 --2- 172.21.15.146:0/2637726073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80cef10 0x7f1bb80ccc90 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 -- 172.21.15.146:0/2637726073 >> 172.21.15.146:0/2637726073 conn(0x7f1bb80d10a0 msgr2=0x7f1bb815d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 -- 172.21.15.146:0/2637726073 shutdown_connections 2024-09-17T03:35:53.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.648+0000 7f1bbd79d640 1 -- 172.21.15.146:0/2637726073 wait complete. 2024-09-17T03:35:53.658 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-17T03:35:53.658 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-17T03:35:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.774+0000 7f6de360e640 1 -- 172.21.15.146:0/710915047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dc8004d40 msgr2=0x7f6dc8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.774+0000 7f6de360e640 1 --2- 172.21.15.146:0/710915047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dc8004d40 0x7f6dc8005150 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400c730 tx=0x7f6dc8005830 comp rx=0 tx=0).stop 2024-09-17T03:35:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.774+0000 7f6de1bab640 1 -- 172.21.15.146:0/710915047 reap_dead start 2024-09-17T03:35:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.774+0000 7f6de360e640 1 -- 172.21.15.146:0/710915047 shutdown_connections 2024-09-17T03:35:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.774+0000 7f6de360e640 1 -- 172.21.15.146:0/710915047 >> 172.21.15.146:0/710915047 conn(0x7f6ddc0d4be0 msgr2=0x7f6ddc0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.774+0000 7f6de360e640 1 -- 172.21.15.146:0/710915047 shutdown_connections 2024-09-17T03:35:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.774+0000 7f6de360e640 1 -- 172.21.15.146:0/710915047 wait complete. 2024-09-17T03:35:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.776+0000 7f6de360e640 1 Processor -- start 2024-09-17T03:35:53.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.776+0000 7f6de360e640 1 -- start start 2024-09-17T03:35:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.777+0000 7f6de360e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dc8004d40 0x7f6ddc1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.777+0000 7f6de360e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc1f6450 0x7f6ddc0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.777+0000 7f6de360e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ddc1f6860 0x7f6ddc0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.777+0000 7f6de360e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc0cf370 con 0x7f6dc8004d40 2024-09-17T03:35:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.777+0000 7f6de360e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc0d43b0 con 0x7f6ddc1f6860 2024-09-17T03:35:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.777+0000 7f6de360e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6ddc0cf4f0 con 0x7f6ddc1f6450 2024-09-17T03:35:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.777+0000 7f6de13aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dc8004d40 0x7f6ddc1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.777+0000 7f6de13aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dc8004d40 0x7f6ddc1577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53958/0 (socket says 172.21.15.146:53958) 2024-09-17T03:35:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.777+0000 7f6de13aa640 1 -- 172.21.15.146:0/4026351933 learned_addr learned my addr 172.21.15.146:0/4026351933 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.777+0000 7f6de1bab640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ddc1f6860 0x7f6ddc0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc1f6450 0x7f6ddc0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6de13aa640 1 -- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc1f6450 msgr2=0x7f6ddc0ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6de13aa640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc1f6450 0x7f6ddc0ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6de13aa640 1 -- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ddc1f6860 msgr2=0x7f6ddc0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6de13aa640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ddc1f6860 0x7f6ddc0ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6de13aa640 1 -- 172.21.15.146:0/4026351933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ddc156110 con 0x7f6dc8004d40 2024-09-17T03:35:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6de13aa640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dc8004d40 0x7f6ddc1577a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8011b10 tx=0x7f6dd8009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6dd1ffb640 1 -- 172.21.15.146:0/4026351933 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd801e070 con 0x7f6dc8004d40 2024-09-17T03:35:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6dd1ffb640 1 -- 172.21.15.146:0/4026351933 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dd8004050 con 0x7f6dc8004d40 2024-09-17T03:35:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6de360e640 1 -- 172.21.15.146:0/4026351933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ddc0cbc80 con 0x7f6dc8004d40 2024-09-17T03:35:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6dd1ffb640 1 -- 172.21.15.146:0/4026351933 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800fea0 con 0x7f6dc8004d40 2024-09-17T03:35:53.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.778+0000 7f6de360e640 1 -- 172.21.15.146:0/4026351933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ddc0cc240 con 0x7f6dc8004d40 2024-09-17T03:35:53.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.780+0000 7f6dd1ffb640 1 -- 172.21.15.146:0/4026351933 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6dd8021070 con 0x7f6dc8004d40 2024-09-17T03:35:53.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.781+0000 7f6dd1ffb640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6dc0078bc0 0x7f6dc007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.781+0000 7f6dd1ffb640 1 -- 172.21.15.146:0/4026351933 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f6dd809b6e0 con 0x7f6dc8004d40 2024-09-17T03:35:53.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.781+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6dc0078bc0 0x7f6dc007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.781+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6dc0078bc0 0x7f6dc007b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0cf0e0 tx=0x7f6dcc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.781+0000 7f6dea65a740 1 Processor -- start 2024-09-17T03:35:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.781+0000 7f6dea65a740 1 -- start start 2024-09-17T03:35:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a61c1e0 0x562b4a9ee070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5f3320 0x562b4a9ee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a5fb500 0x562b4aa0b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6dea65a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562b4a9368f0 con 0x562b4a61c1e0 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6dea65a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562b4a925d20 con 0x562b4a5fb500 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6dea65a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562b4a929b30 con 0x562b4a5f3320 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6de13aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a61c1e0 0x562b4a9ee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6de13aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a61c1e0 0x562b4a9ee070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53962/0 (socket says 172.21.15.146:53962) 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6de13aa640 1 -- 172.21.15.146:0/4290841067 learned_addr learned my addr 172.21.15.146:0/4290841067 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6de1bab640 1 --2- 172.21.15.146:0/4290841067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a5fb500 0x562b4aa0b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/4290841067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5f3320 0x562b4a9ee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6de13aa640 1 -- 172.21.15.146:0/4290841067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5f3320 msgr2=0x562b4a9ee5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6de13aa640 1 --2- 172.21.15.146:0/4290841067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5f3320 0x562b4a9ee5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6de13aa640 1 -- 172.21.15.146:0/4290841067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a5fb500 msgr2=0x562b4aa0b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6de13aa640 1 --2- 172.21.15.146:0/4290841067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a5fb500 0x562b4aa0b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6de13aa640 1 -- 172.21.15.146:0/4290841067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b4a6877c0 con 0x562b4a61c1e0 2024-09-17T03:35:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6de13aa640 1 --2- 172.21.15.146:0/4290841067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a61c1e0 0x562b4a9ee070 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8063600 tx=0x7f6dd8063180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37337f02cee1fbca server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6dc6ffd640 1 -- 172.21.15.146:0/4290841067 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8089030 con 0x562b4a61c1e0 2024-09-17T03:35:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6dc6ffd640 1 -- 172.21.15.146:0/4290841067 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dd80680a0 con 0x562b4a61c1e0 2024-09-17T03:35:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.783+0000 7f6dc6ffd640 1 -- 172.21.15.146:0/4290841067 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8085e20 con 0x562b4a61c1e0 2024-09-17T03:35:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.784+0000 7f6dea65a740 1 -- 172.21.15.146:0/4290841067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a61c1e0 msgr2=0x562b4a9ee070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.784+0000 7f6dea65a740 1 --2- 172.21.15.146:0/4290841067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a61c1e0 0x562b4a9ee070 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8063600 tx=0x7f6dd8063180 comp rx=0 tx=0).stop 2024-09-17T03:35:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.784+0000 7f6dea65a740 1 -- 172.21.15.146:0/4290841067 shutdown_connections 2024-09-17T03:35:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.784+0000 7f6dea65a740 1 --2- 172.21.15.146:0/4290841067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a5fb500 0x562b4aa0b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.784+0000 7f6dea65a740 1 --2- 172.21.15.146:0/4290841067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5f3320 0x562b4a9ee5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.784+0000 7f6dea65a740 1 --2- 172.21.15.146:0/4290841067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a61c1e0 0x562b4a9ee070 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.784+0000 7f6dea65a740 1 -- 172.21.15.146:0/4290841067 >> 172.21.15.146:0/4290841067 conn(0x562b4a610330 msgr2=0x562b4a9c4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.784+0000 7f6dea65a740 1 -- 172.21.15.146:0/4290841067 shutdown_connections 2024-09-17T03:35:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.784+0000 7f6dea65a740 1 -- 172.21.15.146:0/4290841067 wait complete. 2024-09-17T03:35:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.785+0000 7f6dea65a740 1 -- start start 2024-09-17T03:35:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.785+0000 7f6dea65a740 1 Processor -- start 2024-09-17T03:35:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5f3320 0x562b4a9ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5fb500 0x562b4a9ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a61c1e0 0x562b4a9cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dea65a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562b4a696590 con 0x562b4a5f3320 2024-09-17T03:35:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dea65a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562b4a8cb6c0 con 0x562b4a61c1e0 2024-09-17T03:35:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dea65a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562b4a9eeaf0 con 0x562b4a5fb500 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dea65a740 10 client.0 _ll_register_callbacks cb 0x562b4a8cf170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6de13aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5f3320 0x562b4a9ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6de13aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5f3320 0x562b4a9ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53974/0 (socket says 172.21.15.146:53974) 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6de13aa640 1 -- 172.21.15.146:0/4071186337 learned_addr learned my addr 172.21.15.146:0/4071186337 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5fb500 0x562b4a9ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6de1bab640 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a61c1e0 0x562b4a9cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6de13aa640 1 -- 172.21.15.146:0/4071186337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5fb500 msgr2=0x562b4a9ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6de13aa640 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5fb500 0x562b4a9ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6de13aa640 1 -- 172.21.15.146:0/4071186337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a61c1e0 msgr2=0x562b4a9cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6de13aa640 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a61c1e0 0x562b4a9cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6de13aa640 1 -- 172.21.15.146:0/4071186337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b4a6fe620 con 0x562b4a5f3320 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6de13aa640 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5f3320 0x562b4a9ca5c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8063600 tx=0x7f6dd8085e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7092dba9b0dcf736 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dbbfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dbbfff640 1 -- 172.21.15.146:0/4071186337 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8089050 con 0x562b4a5f3320 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dbbfff640 1 -- 172.21.15.146:0/4071186337 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f6dd806a2b0 con 0x562b4a5f3320 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dea65a740 1 -- 172.21.15.146:0/4071186337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dd80680a0 con 0x562b4a5f3320 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dbbfff640 1 -- 172.21.15.146:0/4071186337 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6dd806cf50 con 0x562b4a5f3320 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.787+0000 7f6dea65a740 10 client.5904 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6dea65a740 1 -- 172.21.15.146:0/4071186337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x562b4aa18e00 con 0x562b4a5f3320 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6dbbfff640 1 -- 172.21.15.146:0/4071186337 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dd80680a0 con 0x562b4a5f3320 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6dbbfff640 1 -- 172.21.15.146:0/4071186337 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f6dd8089ae0 con 0x562b4a5f3320 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6dea65a740 10 client.5904 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6dea65a740 10 client.5904 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6dea65a740 20 client.5904 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6dea65a740 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b4a5dafc0 0x562b4a9dd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6dea65a740 4 client.5904 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6dea65a740 1 -- 172.21.15.146:0/4071186337 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b4a938840 con 0x562b4a5dafc0 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b4a5dafc0 0x562b4a9dd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6dbbfff640 10 client.5904 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.788+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b4a5dafc0 0x562b4a9dd810 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56fabfef74b4698c server_cookie=860638a5eccba701 in_seq=0 out_seq=0 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dbbfff640 1 -- 172.21.15.146:0/4071186337 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b4a938840 con 0x562b4a5dafc0 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dbbfff640 10 client.5904 handle_command_reply: tid=0 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 1 client.5904 shutdown 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 1 -- 172.21.15.146:0/4071186337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5f3320 msgr2=0x562b4a9ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5f3320 0x562b4a9ca5c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8063600 tx=0x7f6dd8085e90 comp rx=0 tx=0).stop 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 1 -- 172.21.15.146:0/4071186337 shutdown_connections 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b4a5dafc0 0x562b4a9dd810 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a61c1e0 0x562b4a9cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dbbfff640 0 client.5904 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5fb500 0x562b4a9ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 1 --2- 172.21.15.146:0/4071186337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5f3320 0x562b4a9ca5c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 1 -- 172.21.15.146:0/4071186337 >> 172.21.15.146:0/4071186337 conn(0x562b4a610330 msgr2=0x562b4aa0aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 1 -- 172.21.15.146:0/4071186337 shutdown_connections 2024-09-17T03:35:53.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 1 -- 172.21.15.146:0/4071186337 wait complete. 2024-09-17T03:35:53.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.789+0000 7f6dea65a740 20 client.5904 trim_cache size 0 max 16384 2024-09-17T03:35:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.804+0000 7f6dea65a740 1 Processor -- start 2024-09-17T03:35:53.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.804+0000 7f6dea65a740 1 -- start start 2024-09-17T03:35:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.805+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a5f3320 0x562b4a9ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.805+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.805+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a61c1e0 0x562b4a9cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.805+0000 7f6dea65a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc202c10 con 0x562b4a5fb500 2024-09-17T03:35:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.805+0000 7f6dea65a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc155800 con 0x562b4a5f3320 2024-09-17T03:35:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.805+0000 7f6dea65a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6ddc1f9d10 con 0x562b4a61c1e0 2024-09-17T03:35:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6de0ba9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6de0ba9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53982/0 (socket says 172.21.15.146:53982) 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6de0ba9640 1 -- 172.21.15.146:0/1755864797 learned_addr learned my addr 172.21.15.146:0/1755864797 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6de0ba9640 1 -- 172.21.15.146:0/1755864797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a61c1e0 msgr2=0x562b4a9cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/1755864797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a61c1e0 0x562b4a9cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6de0ba9640 1 -- 172.21.15.146:0/1755864797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a5f3320 msgr2=0x562b4a9ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/1755864797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a5f3320 0x562b4a9ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6de0ba9640 1 -- 172.21.15.146:0/1755864797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b4a9e78d0 con 0x562b4a5fb500 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/1755864797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9ccbf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc013010 tx=0x7f6dcc022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9d8b7203e969cc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6dc67fc640 1 -- 172.21.15.146:0/1755864797 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc004460 con 0x562b4a5fb500 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6dc67fc640 1 -- 172.21.15.146:0/1755864797 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dcc003a70 con 0x562b4a5fb500 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.806+0000 7f6dc67fc640 1 -- 172.21.15.146:0/1755864797 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc003ea0 con 0x562b4a5fb500 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.807+0000 7f6dea65a740 1 -- 172.21.15.146:0/1755864797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 msgr2=0x562b4a9ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.807+0000 7f6dea65a740 1 --2- 172.21.15.146:0/1755864797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9ccbf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc013010 tx=0x7f6dcc022040 comp rx=0 tx=0).stop 2024-09-17T03:35:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.807+0000 7f6dea65a740 1 -- 172.21.15.146:0/1755864797 shutdown_connections 2024-09-17T03:35:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.807+0000 7f6dea65a740 1 --2- 172.21.15.146:0/1755864797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a61c1e0 0x562b4a9cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.807+0000 7f6dea65a740 1 --2- 172.21.15.146:0/1755864797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9ccbf0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.807+0000 7f6dea65a740 1 --2- 172.21.15.146:0/1755864797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a5f3320 0x562b4a9ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.807+0000 7f6dea65a740 1 -- 172.21.15.146:0/1755864797 >> 172.21.15.146:0/1755864797 conn(0x562b4a610330 msgr2=0x562b4a9b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.807+0000 7f6dea65a740 1 -- 172.21.15.146:0/1755864797 shutdown_connections 2024-09-17T03:35:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.807+0000 7f6dea65a740 1 -- 172.21.15.146:0/1755864797 wait complete. 2024-09-17T03:35:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.808+0000 7f6dea65a740 1 -- start start 2024-09-17T03:35:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.808+0000 7f6dea65a740 1 Processor -- start 2024-09-17T03:35:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.809+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5f3320 0x562b4a9ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.809+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.809+0000 7f6dea65a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a61c1e0 0x562b4aa93240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.809+0000 7f6dea65a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562b4a8a8300 con 0x562b4a5fb500 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.809+0000 7f6dea65a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc1551b0 con 0x562b4a61c1e0 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.809+0000 7f6dea65a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562b4aa8ffb0 con 0x562b4a5f3320 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.809+0000 7f6dea65a740 10 client.0 _ll_register_callbacks cb 0x7f6dc80036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.809+0000 7f6de0ba9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.809+0000 7f6de0ba9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53992/0 (socket says 172.21.15.146:53992) 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.809+0000 7f6de0ba9640 1 -- 172.21.15.146:0/1802376455 learned_addr learned my addr 172.21.15.146:0/1802376455 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.809+0000 7f6de13aa640 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5f3320 0x562b4a9ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6de1bab640 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a61c1e0 0x562b4aa93240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6de0ba9640 1 -- 172.21.15.146:0/1802376455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5f3320 msgr2=0x562b4a9ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5f3320 0x562b4a9ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6de0ba9640 1 -- 172.21.15.146:0/1802376455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a61c1e0 msgr2=0x562b4aa93240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a61c1e0 0x562b4aa93240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6de0ba9640 1 -- 172.21.15.146:0/1802376455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b4a9cc1b0 con 0x562b4a5fb500 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6de13aa640 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5f3320 0x562b4a9ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6de0ba9640 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9cd050 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc004150 tx=0x7f6dcc004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95be5215ad076181 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dbbfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dbbfff640 1 -- 172.21.15.146:0/1802376455 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc005020 con 0x562b4a5fb500 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dbbfff640 1 -- 172.21.15.146:0/1802376455 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f6dcc03cae0 con 0x562b4a5fb500 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dea65a740 1 -- 172.21.15.146:0/1802376455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dcc003a70 con 0x562b4a5fb500 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dbbfff640 1 -- 172.21.15.146:0/1802376455 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6dcc03cd20 con 0x562b4a5fb500 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dea65a740 10 client.5910 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dea65a740 1 -- 172.21.15.146:0/1802376455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x562b4aa17d50 con 0x562b4a5fb500 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dbbfff640 1 -- 172.21.15.146:0/1802376455 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dcc003a70 con 0x562b4a5fb500 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dbbfff640 1 -- 172.21.15.146:0/1802376455 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f6dcc043050 con 0x562b4a5fb500 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dea65a740 10 client.5910 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dea65a740 10 client.5910 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dea65a740 20 client.5910 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:53.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dea65a740 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b4aa86770 0x562b4aa93780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:53.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dea65a740 4 client.5910 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-17T03:35:53.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.810+0000 7f6dea65a740 1 -- 172.21.15.146:0/1802376455 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x562b4a9e7530 con 0x562b4aa86770 2024-09-17T03:35:53.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.811+0000 7f6de13aa640 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b4aa86770 0x562b4aa93780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:53.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.811+0000 7f6dbbfff640 10 client.5910 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.811+0000 7f6de13aa640 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b4aa86770 0x562b4aa93780 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f517738058e5f22f server_cookie=bfc7660878dca9dd in_seq=0 out_seq=0 2024-09-17T03:35:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.813+0000 7f6dbbfff640 1 -- 172.21.15.146:0/1802376455 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b4a9e7530 con 0x562b4aa86770 2024-09-17T03:35:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.813+0000 7f6dbbfff640 10 client.5910 handle_command_reply: tid=0 2024-09-17T03:35:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.813+0000 7f6dea65a740 1 client.5910 shutdown 2024-09-17T03:35:53.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dea65a740 1 -- 172.21.15.146:0/1802376455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 msgr2=0x562b4a9cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dea65a740 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9cd050 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc004150 tx=0x7f6dcc004550 comp rx=0 tx=0).stop 2024-09-17T03:35:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dea65a740 1 -- 172.21.15.146:0/1802376455 shutdown_connections 2024-09-17T03:35:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dea65a740 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x562b4aa86770 0x562b4aa93780 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dea65a740 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562b4a61c1e0 0x562b4aa93240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dbbfff640 0 client.5910 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dea65a740 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562b4a5fb500 0x562b4a9cd050 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dea65a740 1 --2- 172.21.15.146:0/1802376455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562b4a5f3320 0x562b4a9ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dea65a740 1 -- 172.21.15.146:0/1802376455 >> 172.21.15.146:0/1802376455 conn(0x562b4a610330 msgr2=0x562b4a9e6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dea65a740 1 -- 172.21.15.146:0/1802376455 shutdown_connections 2024-09-17T03:35:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dea65a740 1 -- 172.21.15.146:0/1802376455 wait complete. 2024-09-17T03:35:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6dea65a740 20 client.5910 trim_cache size 0 max 16384 2024-09-17T03:35:53.817 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:53.817 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:35:53.817 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:35:53.817 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6de360e640 1 -- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6dc0078bc0 msgr2=0x7f6dc007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6de360e640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6dc0078bc0 0x7f6dc007b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0cf0e0 tx=0x7f6dcc005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6de360e640 1 -- 172.21.15.146:0/4026351933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dc8004d40 msgr2=0x7f6ddc1577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.814+0000 7f6de360e640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dc8004d40 0x7f6ddc1577a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8011b10 tx=0x7f6dd8009e90 comp rx=0 tx=0).stop 2024-09-17T03:35:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.815+0000 7f6de360e640 1 -- 172.21.15.146:0/4026351933 shutdown_connections 2024-09-17T03:35:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.815+0000 7f6de360e640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6dc0078bc0 0x7f6dc007b0d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.815+0000 7f6de360e640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ddc1f6860 0x7f6ddc0ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.815+0000 7f6de360e640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ddc1f6450 0x7f6ddc0ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.815+0000 7f6de360e640 1 --2- 172.21.15.146:0/4026351933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dc8004d40 0x7f6ddc1577a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.815+0000 7f6de360e640 1 -- 172.21.15.146:0/4026351933 >> 172.21.15.146:0/4026351933 conn(0x7f6ddc0d4be0 msgr2=0x7f6ddc0b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:53.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.815+0000 7f6de360e640 1 -- 172.21.15.146:0/4026351933 shutdown_connections 2024-09-17T03:35:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53.815+0000 7f6de360e640 1 -- 172.21.15.146:0/4026351933 wait complete. 2024-09-17T03:35:53.824 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-17T03:35:53.824 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-17T03:35:53.825 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-17T03:35:53.825 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-17T03:35:53.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:53.825 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> import json 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> import sys 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> try: 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> except OSError as e: 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> sys.exit(e.errno) 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:35:53.841 DEBUG:teuthology.orchestra.run.smithi146:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-17T03:35:53.842 DEBUG:teuthology.orchestra.run.smithi146:> print(json.dumps( 2024-09-17T03:35:53.842 DEBUG:teuthology.orchestra.run.smithi146:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-17T03:35:53.842 DEBUG:teuthology.orchestra.run.smithi146:> indent=2)) 2024-09-17T03:35:53.842 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:35:53.947 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:53.947 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mode": 16877, 2024-09-17T03:35:53.948 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ino": 1099511627777, 2024-09-17T03:35:53.948 INFO:teuthology.orchestra.run.smithi146.stdout: "st_dev": 41, 2024-09-17T03:35:53.948 INFO:teuthology.orchestra.run.smithi146.stdout: "st_nlink": 16, 2024-09-17T03:35:53.948 INFO:teuthology.orchestra.run.smithi146.stdout: "st_uid": 1000, 2024-09-17T03:35:53.948 INFO:teuthology.orchestra.run.smithi146.stdout: "st_gid": 1333, 2024-09-17T03:35:53.948 INFO:teuthology.orchestra.run.smithi146.stdout: "st_size": 18, 2024-09-17T03:35:53.948 INFO:teuthology.orchestra.run.smithi146.stdout: "st_atime": 1726544141.8522563, 2024-09-17T03:35:53.948 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mtime": 1726544146.8971784, 2024-09-17T03:35:53.948 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ctime": 1726544146.8971784 2024-09-17T03:35:53.948 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:53.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:53.957 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-09-17T03:35:53.957 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-17T03:35:53.957 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-17T03:35:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.112+0000 7f19abc9d640 1 -- 172.21.15.146:0/2779643807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a40b5750 msgr2=0x7f19a40b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.112+0000 7f19abc9d640 1 --2- 172.21.15.146:0/2779643807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a40b5750 0x7f19a40b3620 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f19a40b1a60 tx=0x7f199402a560 comp rx=0 tx=0).stop 2024-09-17T03:35:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.112+0000 7f19abc9d640 1 -- 172.21.15.146:0/2779643807 shutdown_connections 2024-09-17T03:35:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.112+0000 7f19abc9d640 1 --2- 172.21.15.146:0/2779643807 >> v2:172.21.15.179:3300/0 conn(0x7f19a40b3b60 0x7f19a415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.112+0000 7f19abc9d640 1 --2- 172.21.15.146:0/2779643807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a40b5750 0x7f19a40b3620 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.112+0000 7f19abc9d640 1 -- 172.21.15.146:0/2779643807 >> 172.21.15.146:0/2779643807 conn(0x7f19a40b7b20 msgr2=0x7f19a409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.112+0000 7f19abc9d640 1 -- 172.21.15.146:0/2779643807 shutdown_connections 2024-09-17T03:35:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.112+0000 7f19abc9d640 1 -- 172.21.15.146:0/2779643807 wait complete. 2024-09-17T03:35:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.114+0000 7f19abc9d640 1 Processor -- start 2024-09-17T03:35:54.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.114+0000 7f19abc9d640 1 -- start start 2024-09-17T03:35:54.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.115+0000 7f19abc9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a40b3b60 0x7f19a409c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.115+0000 7f19abc9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a40b5750 0x7f19a4155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.115+0000 7f19abc9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a40b5ce0 0x7f19a4158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.115+0000 7f19abc9d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f19a415d420 con 0x7f19a40b3b60 2024-09-17T03:35:54.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.115+0000 7f19abc9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f19a415d2a0 con 0x7f19a40b5ce0 2024-09-17T03:35:54.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.115+0000 7f19abc9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f19a415d5a0 con 0x7f19a40b5750 2024-09-17T03:35:54.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19a9a39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a40b3b60 0x7f19a409c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19a9a39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a40b3b60 0x7f19a409c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54016/0 (socket says 172.21.15.146:54016) 2024-09-17T03:35:54.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19a9a39640 1 -- 172.21.15.146:0/2906066073 learned_addr learned my addr 172.21.15.146:0/2906066073 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19aa23a640 1 --2- 172.21.15.146:0/2906066073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a40b5ce0 0x7f19a4158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19a9238640 1 --2- 172.21.15.146:0/2906066073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a40b5750 0x7f19a4155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19a9a39640 1 -- 172.21.15.146:0/2906066073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a40b5750 msgr2=0x7f19a4155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19a9a39640 1 --2- 172.21.15.146:0/2906066073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19a40b5750 0x7f19a4155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19a9a39640 1 -- 172.21.15.146:0/2906066073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a40b5ce0 msgr2=0x7f19a4158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19a9a39640 1 --2- 172.21.15.146:0/2906066073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19a40b5ce0 0x7f19a4158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19a9a39640 1 -- 172.21.15.146:0/2906066073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a41f7e70 con 0x7f19a40b3b60 2024-09-17T03:35:54.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19a9a39640 1 --2- 172.21.15.146:0/2906066073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a40b3b60 0x7f19a409c5f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c3d0 tx=0x7f19a000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f199a7fc640 1 -- 172.21.15.146:0/2906066073 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0017070 con 0x7f19a40b3b60 2024-09-17T03:35:54.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f199a7fc640 1 -- 172.21.15.146:0/2906066073 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19a00053c0 con 0x7f19a40b3b60 2024-09-17T03:35:54.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19abc9d640 1 -- 172.21.15.146:0/2906066073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a409cb30 con 0x7f19a40b3b60 2024-09-17T03:35:54.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f199a7fc640 1 -- 172.21.15.146:0/2906066073 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0003850 con 0x7f19a40b3b60 2024-09-17T03:35:54.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.116+0000 7f19abc9d640 1 -- 172.21.15.146:0/2906066073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a41f75d0 con 0x7f19a40b3b60 2024-09-17T03:35:54.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.118+0000 7f199a7fc640 1 -- 172.21.15.146:0/2906066073 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19a001a070 con 0x7f19a40b3b60 2024-09-17T03:35:54.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.118+0000 7f199a7fc640 1 --2- 172.21.15.146:0/2906066073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1988078b90 0x7f198807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.118+0000 7f199a7fc640 1 -- 172.21.15.146:0/2906066073 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f19a009a020 con 0x7f19a40b3b60 2024-09-17T03:35:54.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.119+0000 7f19a9238640 1 --2- 172.21.15.146:0/2906066073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1988078b90 0x7f198807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.119+0000 7f19a9238640 1 --2- 172.21.15.146:0/2906066073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1988078b90 0x7f198807b0a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1994033000 tx=0x7f1994004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.119+0000 7f19b2c08740 1 Processor -- start 2024-09-17T03:35:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.120+0000 7f19b2c08740 1 -- start start 2024-09-17T03:35:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfae3530 0x55f8cfed25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfeb5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfac2850 0x55f8cfeb57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19b2c08740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f8cfdfdc40 con 0x55f8cfaba670 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19b2c08740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f8cfded070 con 0x55f8cfac2850 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19b2c08740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f8cfdf0e80 con 0x55f8cfae3530 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19a9238640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfeb5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19a9238640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfeb5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54032/0 (socket says 172.21.15.146:54032) 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19a9238640 1 -- 172.21.15.146:0/1032811841 learned_addr learned my addr 172.21.15.146:0/1032811841 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19a9a39640 1 --2- 172.21.15.146:0/1032811841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfae3530 0x55f8cfed25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19aa23a640 1 --2- 172.21.15.146:0/1032811841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfac2850 0x55f8cfeb57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19a9238640 1 -- 172.21.15.146:0/1032811841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfae3530 msgr2=0x55f8cfed25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19a9238640 1 --2- 172.21.15.146:0/1032811841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfae3530 0x55f8cfed25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19a9238640 1 -- 172.21.15.146:0/1032811841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfac2850 msgr2=0x55f8cfeb57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19a9238640 1 --2- 172.21.15.146:0/1032811841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfac2850 0x55f8cfeb57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19a9238640 1 -- 172.21.15.146:0/1032811841 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8cfda68b0 con 0x55f8cfaba670 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19a9238640 1 --2- 172.21.15.146:0/1032811841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfeb5290 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1994005fd0 tx=0x7f199403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c296f5f97f851eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.121+0000 7f19877fe640 1 -- 172.21.15.146:0/1032811841 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994035040 con 0x55f8cfaba670 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.122+0000 7f19877fe640 1 -- 172.21.15.146:0/1032811841 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f199404e070 con 0x55f8cfaba670 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.122+0000 7f19877fe640 1 -- 172.21.15.146:0/1032811841 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994003d20 con 0x55f8cfaba670 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.122+0000 7f19b2c08740 1 -- 172.21.15.146:0/1032811841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 msgr2=0x55f8cfeb5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.122+0000 7f19b2c08740 1 --2- 172.21.15.146:0/1032811841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfeb5290 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1994005fd0 tx=0x7f199403d000 comp rx=0 tx=0).stop 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.122+0000 7f19b2c08740 1 -- 172.21.15.146:0/1032811841 shutdown_connections 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.122+0000 7f19b2c08740 1 --2- 172.21.15.146:0/1032811841 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfac2850 0x55f8cfeb57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.122+0000 7f19b2c08740 1 --2- 172.21.15.146:0/1032811841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfeb5290 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.122+0000 7f19b2c08740 1 --2- 172.21.15.146:0/1032811841 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfae3530 0x55f8cfed25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.122+0000 7f19b2c08740 1 -- 172.21.15.146:0/1032811841 >> 172.21.15.146:0/1032811841 conn(0x55f8cfad7680 msgr2=0x55f8cfe8b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.122+0000 7f19b2c08740 1 -- 172.21.15.146:0/1032811841 shutdown_connections 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.122+0000 7f19b2c08740 1 -- 172.21.15.146:0/1032811841 wait complete. 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.123+0000 7f19b2c08740 1 -- start start 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.123+0000 7f19b2c08740 1 Processor -- start 2024-09-17T03:35:54.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfecc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfac2850 0x55f8cfec6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfae3530 0x55f8cfea3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19b2c08740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f8cfb5d8e0 con 0x55f8cfaba670 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19b2c08740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f8cfd92a50 con 0x55f8cfae3530 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19b2c08740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f8cfec7500 con 0x55f8cfac2850 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19b2c08740 10 client.0 _ll_register_callbacks cb 0x55f8cfde6c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19a9a39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfecc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19a9a39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfecc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54048/0 (socket says 172.21.15.146:54048) 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19a9a39640 1 -- 172.21.15.146:0/654205145 learned_addr learned my addr 172.21.15.146:0/654205145 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19aa23a640 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfae3530 0x55f8cfea3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19a9238640 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfac2850 0x55f8cfec6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19a9a39640 1 -- 172.21.15.146:0/654205145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfac2850 msgr2=0x55f8cfec6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19a9a39640 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfac2850 0x55f8cfec6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19a9a39640 1 -- 172.21.15.146:0/654205145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfae3530 msgr2=0x55f8cfea3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19a9a39640 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfae3530 0x55f8cfea3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19a9a39640 1 -- 172.21.15.146:0/654205145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8cfadf590 con 0x55f8cfaba670 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19aa23a640 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfae3530 0x55f8cfea3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19a9238640 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfac2850 0x55f8cfec6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f19a9a39640 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfecc740 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c3a0 tx=0x7f19a00615d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99623d899be7191 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f1984ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.125+0000 7f1984ff9640 1 -- 172.21.15.146:0/654205145 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0088070 con 0x55f8cfaba670 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f1984ff9640 1 -- 172.21.15.146:0/654205145 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f19a005d7b0 con 0x55f8cfaba670 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f19b2c08740 1 -- 172.21.15.146:0/654205145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f8cfe05f40 con 0x55f8cfaba670 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f1984ff9640 1 -- 172.21.15.146:0/654205145 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f19a0066890 con 0x55f8cfaba670 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f19b2c08740 10 client.5922 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f19b2c08740 1 -- 172.21.15.146:0/654205145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55f8cfb4eb10 con 0x55f8cfaba670 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f1984ff9640 1 -- 172.21.15.146:0/654205145 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f8cfe05f40 con 0x55f8cfaba670 2024-09-17T03:35:54.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f1984ff9640 1 -- 172.21.15.146:0/654205145 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f19a005d9b0 con 0x55f8cfaba670 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f19b2c08740 10 client.5922 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f19b2c08740 10 client.5922 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f19b2c08740 20 client.5922 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f19b2c08740 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f8cfaa2100 0x55f8cfe8ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f19b2c08740 4 client.5922 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f19b2c08740 1 -- 172.21.15.146:0/654205145 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8cfdffb90 con 0x55f8cfaa2100 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f19a9238640 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f8cfaa2100 0x55f8cfe8ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.126+0000 7f1984ff9640 10 client.5922 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19a9238640 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f8cfaa2100 0x55f8cfe8ab10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b3375d1722b0315 server_cookie=fc6e252854de4c46 in_seq=0 out_seq=0 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f1984ff9640 1 -- 172.21.15.146:0/654205145 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8cfdffb90 con 0x55f8cfaa2100 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f1984ff9640 10 client.5922 handle_command_reply: tid=0 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19b2c08740 1 client.5922 shutdown 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19b2c08740 1 -- 172.21.15.146:0/654205145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 msgr2=0x55f8cfecc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19b2c08740 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfecc740 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c3a0 tx=0x7f19a00615d0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19b2c08740 1 -- 172.21.15.146:0/654205145 shutdown_connections 2024-09-17T03:35:54.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19b2c08740 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f8cfaa2100 0x55f8cfe8ab10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19b2c08740 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfae3530 0x55f8cfea3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19b2c08740 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfac2850 0x55f8cfec6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f1984ff9640 0 client.5922 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19b2c08740 1 --2- 172.21.15.146:0/654205145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfaba670 0x55f8cfecc740 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19b2c08740 1 -- 172.21.15.146:0/654205145 >> 172.21.15.146:0/654205145 conn(0x55f8cfad7680 msgr2=0x55f8cfed3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19b2c08740 1 -- 172.21.15.146:0/654205145 shutdown_connections 2024-09-17T03:35:54.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.127+0000 7f19b2c08740 1 -- 172.21.15.146:0/654205145 wait complete. 2024-09-17T03:35:54.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.128+0000 7f19b2c08740 20 client.5922 trim_cache size 0 max 16384 2024-09-17T03:35:54.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.143+0000 7f19b2c08740 1 Processor -- start 2024-09-17T03:35:54.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.143+0000 7f19b2c08740 1 -- start start 2024-09-17T03:35:54.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfaba670 0x55f8cfecb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfac2850 0x55f8cfea4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfae3530 0x55f8cfea47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19b2c08740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f19a41fff80 con 0x55f8cfac2850 2024-09-17T03:35:54.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19b2c08740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f19a40a06a0 con 0x55f8cfae3530 2024-09-17T03:35:54.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19b2c08740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f19a4153530 con 0x55f8cfaba670 2024-09-17T03:35:54.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19a9238640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfac2850 0x55f8cfea4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19a9238640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfac2850 0x55f8cfea4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54050/0 (socket says 172.21.15.146:54050) 2024-09-17T03:35:54.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19a9238640 1 -- 172.21.15.146:0/1301104872 learned_addr learned my addr 172.21.15.146:0/1301104872 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19a9238640 1 -- 172.21.15.146:0/1301104872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfaba670 msgr2=0x55f8cfecb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19a9238640 1 --2- 172.21.15.146:0/1301104872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfaba670 0x55f8cfecb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19a9238640 1 -- 172.21.15.146:0/1301104872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfae3530 msgr2=0x55f8cfea47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19a9238640 1 --2- 172.21.15.146:0/1301104872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfae3530 0x55f8cfea47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19a9238640 1 -- 172.21.15.146:0/1301104872 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8cfbc5970 con 0x55f8cfac2850 2024-09-17T03:35:54.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.144+0000 7f19a9238640 1 --2- 172.21.15.146:0/1301104872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfac2850 0x55f8cfea4270 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1994009230 tx=0x7f1994009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86ebaccd99c652a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f1986ffd640 1 -- 172.21.15.146:0/1301104872 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994035040 con 0x55f8cfac2850 2024-09-17T03:35:54.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f1986ffd640 1 -- 172.21.15.146:0/1301104872 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1994063070 con 0x55f8cfac2850 2024-09-17T03:35:54.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f1986ffd640 1 -- 172.21.15.146:0/1301104872 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994004a00 con 0x55f8cfac2850 2024-09-17T03:35:54.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f19b2c08740 1 -- 172.21.15.146:0/1301104872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfac2850 msgr2=0x55f8cfea4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f19b2c08740 1 --2- 172.21.15.146:0/1301104872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfac2850 0x55f8cfea4270 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1994009230 tx=0x7f1994009260 comp rx=0 tx=0).stop 2024-09-17T03:35:54.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f19b2c08740 1 -- 172.21.15.146:0/1301104872 shutdown_connections 2024-09-17T03:35:54.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f19b2c08740 1 --2- 172.21.15.146:0/1301104872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfae3530 0x55f8cfea47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f19b2c08740 1 --2- 172.21.15.146:0/1301104872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfac2850 0x55f8cfea4270 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f19b2c08740 1 --2- 172.21.15.146:0/1301104872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfaba670 0x55f8cfecb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f19b2c08740 1 -- 172.21.15.146:0/1301104872 >> 172.21.15.146:0/1301104872 conn(0x55f8cfad7680 msgr2=0x55f8cfed0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f19b2c08740 1 -- 172.21.15.146:0/1301104872 shutdown_connections 2024-09-17T03:35:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.145+0000 7f19b2c08740 1 -- 172.21.15.146:0/1301104872 wait complete. 2024-09-17T03:35:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.146+0000 7f19b2c08740 1 -- start start 2024-09-17T03:35:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.146+0000 7f19b2c08740 1 Processor -- start 2024-09-17T03:35:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfaba670 0x55f8cff4fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfac2850 0x55f8cfea31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19b2c08740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfae3530 0x55f8cfeb1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19b2c08740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f19a40a0050 con 0x55f8cfae3530 2024-09-17T03:35:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19b2c08740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f8cff50650 con 0x55f8cfaba670 2024-09-17T03:35:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19b2c08740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f8cfeca7f0 con 0x55f8cfac2850 2024-09-17T03:35:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19b2c08740 10 client.0 _ll_register_callbacks cb 0x7f19a00617b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19aa23a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfae3530 0x55f8cfeb1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19aa23a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfae3530 0x55f8cfeb1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54064/0 (socket says 172.21.15.146:54064) 2024-09-17T03:35:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19aa23a640 1 -- 172.21.15.146:0/3137547149 learned_addr learned my addr 172.21.15.146:0/3137547149 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19aa23a640 1 -- 172.21.15.146:0/3137547149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfac2850 msgr2=0x55f8cfea31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19aa23a640 1 --2- 172.21.15.146:0/3137547149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfac2850 0x55f8cfea31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19aa23a640 1 -- 172.21.15.146:0/3137547149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfaba670 msgr2=0x55f8cff4fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19aa23a640 1 --2- 172.21.15.146:0/3137547149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfaba670 0x55f8cff4fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19aa23a640 1 -- 172.21.15.146:0/3137547149 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8cff533f0 con 0x55f8cfae3530 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f19aa23a640 1 --2- 172.21.15.146:0/3137547149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfae3530 0x55f8cfeb1d90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f19a40b79f0 tx=0x7f199c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed1384098470b3f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f1984ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.148+0000 7f1984ff9640 1 -- 172.21.15.146:0/3137547149 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c00fe30 con 0x55f8cfae3530 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f1984ff9640 1 -- 172.21.15.146:0/3137547149 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f199c0120d0 con 0x55f8cfae3530 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f19b2c08740 1 -- 172.21.15.146:0/3137547149 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1994063070 con 0x55f8cfae3530 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f1984ff9640 1 -- 172.21.15.146:0/3137547149 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f199c010430 con 0x55f8cfae3530 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f19b2c08740 10 client.5928 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f19b2c08740 1 -- 172.21.15.146:0/3137547149 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55f8cfeb22d0 con 0x55f8cfae3530 2024-09-17T03:35:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f1984ff9640 1 -- 172.21.15.146:0/3137547149 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1994063070 con 0x55f8cfae3530 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f1984ff9640 1 -- 172.21.15.146:0/3137547149 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f199c024050 con 0x55f8cfae3530 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f19b2c08740 10 client.5928 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f19b2c08740 10 client.5928 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f19b2c08740 20 client.5928 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f19b2c08740 1 --2- 172.21.15.146:0/3137547149 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f8cff53b70 0x55f8cff46330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f19b2c08740 4 client.5928 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f19b2c08740 1 -- 172.21.15.146:0/3137547149 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55f8cfeca0f0 con 0x55f8cff53b70 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f19a9a39640 1 --2- 172.21.15.146:0/3137547149 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f8cff53b70 0x55f8cff46330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.149+0000 7f1984ff9640 10 client.5928 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19a9a39640 1 --2- 172.21.15.146:0/3137547149 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f8cff53b70 0x55f8cff46330 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47b78b6aa7671c72 server_cookie=ccf74234c65d6368 in_seq=0 out_seq=0 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f1984ff9640 1 -- 172.21.15.146:0/3137547149 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x55f8cfeca0f0 con 0x55f8cff53b70 2024-09-17T03:35:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f1984ff9640 10 client.5928 handle_command_reply: tid=0 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 1 client.5928 shutdown 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 1 -- 172.21.15.146:0/3137547149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfae3530 msgr2=0x55f8cfeb1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 1 --2- 172.21.15.146:0/3137547149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfae3530 0x55f8cfeb1d90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f19a40b79f0 tx=0x7f199c00f790 comp rx=0 tx=0).stop 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 1 -- 172.21.15.146:0/3137547149 shutdown_connections 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 1 --2- 172.21.15.146:0/3137547149 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55f8cff53b70 0x55f8cff46330 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 1 --2- 172.21.15.146:0/3137547149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f8cfae3530 0x55f8cfeb1d90 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 1 --2- 172.21.15.146:0/3137547149 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f8cfac2850 0x55f8cfea31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f1984ff9640 0 client.5928 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 1 --2- 172.21.15.146:0/3137547149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f8cfaba670 0x55f8cff4fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 1 -- 172.21.15.146:0/3137547149 >> 172.21.15.146:0/3137547149 conn(0x55f8cfad7680 msgr2=0x55f8cfec8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 1 -- 172.21.15.146:0/3137547149 shutdown_connections 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 1 -- 172.21.15.146:0/3137547149 wait complete. 2024-09-17T03:35:54.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.150+0000 7f19b2c08740 20 client.5928 trim_cache size 0 max 16384 2024-09-17T03:35:54.155 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:54.155 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:35:54.155 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": -2 2024-09-17T03:35:54.155 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:54.156 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T03:35:54.156 INFO:teuthology.orchestra.run.smithi146.stderr:Error ENOENT: 2024-09-17T03:35:54.156 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-17T03:35:54.156 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-17T03:35:54.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-17T03:35:54.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.276+0000 7ffb35352640 1 -- 172.21.15.146:0/2878026289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb3006f440 msgr2=0x7ffb30169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.276+0000 7ffb35352640 1 --2- 172.21.15.146:0/2878026289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb3006f440 0x7ffb30169c10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffb28005fd0 tx=0x7ffb2802a540 comp rx=0 tx=0).stop 2024-09-17T03:35:54.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.276+0000 7ffb35352640 1 -- 172.21.15.146:0/2878026289 shutdown_connections 2024-09-17T03:35:54.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.276+0000 7ffb35352640 1 --2- 172.21.15.146:0/2878026289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb3006f440 0x7ffb30169c10 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.276+0000 7ffb35352640 1 -- 172.21.15.146:0/2878026289 >> 172.21.15.146:0/2878026289 conn(0x7ffb300d4be0 msgr2=0x7ffb300d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.276+0000 7ffb35352640 1 -- 172.21.15.146:0/2878026289 shutdown_connections 2024-09-17T03:35:54.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.276+0000 7ffb35352640 1 -- 172.21.15.146:0/2878026289 wait complete. 2024-09-17T03:35:54.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.278+0000 7ffb35352640 1 Processor -- start 2024-09-17T03:35:54.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.278+0000 7ffb35352640 1 -- start start 2024-09-17T03:35:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb35352640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb300b3870 0x7ffb30163970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb35352640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb300cf370 0x7ffb3014a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb35352640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb3014a820 0x7ffb300cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb35352640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3016a2d0 con 0x7ffb300b3870 2024-09-17T03:35:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb35352640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3016a150 con 0x7ffb3014a820 2024-09-17T03:35:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb35352640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffb3016a450 con 0x7ffb300cf370 2024-09-17T03:35:54.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb2effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb300b3870 0x7ffb30163970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb2effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb300b3870 0x7ffb30163970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54084/0 (socket says 172.21.15.146:54084) 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb2effd640 1 -- 172.21.15.146:0/2306316421 learned_addr learned my addr 172.21.15.146:0/2306316421 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb3014a820 0x7ffb300cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb2e7fc640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb300cf370 0x7ffb3014a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb2effd640 1 -- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb300cf370 msgr2=0x7ffb3014a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb2effd640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb300cf370 0x7ffb3014a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb2effd640 1 -- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb3014a820 msgr2=0x7ffb300cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb2effd640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb3014a820 0x7ffb300cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb2effd640 1 -- 172.21.15.146:0/2306316421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3014ac30 con 0x7ffb300b3870 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.279+0000 7ffb2effd640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb300b3870 0x7ffb30163970 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000ba50 tx=0x7ffb2000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.280+0000 7ffb177fe640 1 -- 172.21.15.146:0/2306316421 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20019070 con 0x7ffb300b3870 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.280+0000 7ffb177fe640 1 -- 172.21.15.146:0/2306316421 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb2000cd10 con 0x7ffb300b3870 2024-09-17T03:35:54.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.280+0000 7ffb35352640 1 -- 172.21.15.146:0/2306316421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb30163eb0 con 0x7ffb300b3870 2024-09-17T03:35:54.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.280+0000 7ffb177fe640 1 -- 172.21.15.146:0/2306316421 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb200146a0 con 0x7ffb300b3870 2024-09-17T03:35:54.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.280+0000 7ffb35352640 1 -- 172.21.15.146:0/2306316421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb301f9710 con 0x7ffb300b3870 2024-09-17T03:35:54.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.282+0000 7ffb177fe640 1 -- 172.21.15.146:0/2306316421 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb2001c070 con 0x7ffb300b3870 2024-09-17T03:35:54.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.282+0000 7ffb177fe640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb1c078b90 0x7ffb1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.282+0000 7ffb177fe640 1 -- 172.21.15.146:0/2306316421 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ffb2009aaa0 con 0x7ffb300b3870 2024-09-17T03:35:54.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.283+0000 7ffb2e7fc640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb1c078b90 0x7ffb1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.283+0000 7ffb2e7fc640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb1c078b90 0x7ffb1c07b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffb24000f60 tx=0x7ffb24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.283+0000 7ffb3c2b6740 1 Processor -- start 2024-09-17T03:35:54.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.283+0000 7ffb3c2b6740 1 -- start start 2024-09-17T03:35:54.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddba0d580 0x560ddbdde910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbddee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddb9ec8a0 0x560ddbdfbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560ddbd27cc0 con 0x560ddb9ec8a0 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560ddbd170f0 con 0x560ddb9e46c0 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x560ddbd1af00 con 0x560ddba0d580 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb2f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddb9ec8a0 0x560ddbdfbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb2f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddb9ec8a0 0x560ddbdfbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54096/0 (socket says 172.21.15.146:54096) 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/3185542465 learned_addr learned my addr 172.21.15.146:0/3185542465 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb2effd640 1 --2- 172.21.15.146:0/3185542465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddba0d580 0x560ddbdde910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb2e7fc640 1 --2- 172.21.15.146:0/3185542465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbddee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/3185542465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddba0d580 msgr2=0x560ddbdde910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/3185542465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddba0d580 0x560ddbdde910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/3185542465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 msgr2=0x560ddbddee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/3185542465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbddee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/3185542465 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ddbaf19f0 con 0x560ddb9ec8a0 2024-09-17T03:35:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/3185542465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddb9ec8a0 0x560ddbdfbd50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ffb28006010 tx=0x7ffb280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b293ec50d0b286c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb14ff9640 1 -- 172.21.15.146:0/3185542465 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28040070 con 0x560ddb9ec8a0 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb14ff9640 1 -- 172.21.15.146:0/3185542465 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb28004320 con 0x560ddb9ec8a0 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.285+0000 7ffb14ff9640 1 -- 172.21.15.146:0/3185542465 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28035040 con 0x560ddb9ec8a0 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.286+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/3185542465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddb9ec8a0 msgr2=0x560ddbdfbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.286+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/3185542465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddb9ec8a0 0x560ddbdfbd50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ffb28006010 tx=0x7ffb280046c0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.286+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/3185542465 shutdown_connections 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.286+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/3185542465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddb9ec8a0 0x560ddbdfbd50 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.286+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/3185542465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbddee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.286+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/3185542465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddba0d580 0x560ddbdde910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.286+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/3185542465 >> 172.21.15.146:0/3185542465 conn(0x560ddba016d0 msgr2=0x560ddbdb4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.286+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/3185542465 shutdown_connections 2024-09-17T03:35:54.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.286+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/3185542465 wait complete. 2024-09-17T03:35:54.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.287+0000 7ffb3c2b6740 1 -- start start 2024-09-17T03:35:54.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.287+0000 7ffb3c2b6740 1 Processor -- start 2024-09-17T03:35:54.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbe0c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbdb3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbdf2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560ddba87930 con 0x560ddba0d580 2024-09-17T03:35:54.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560ddbc9d720 con 0x560ddb9e46c0 2024-09-17T03:35:54.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x560ddbddf390 con 0x560ddb9ec8a0 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb3c2b6740 10 client.0 _ll_register_callbacks cb 0x560ddbc9b490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbdf2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbdf2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54098/0 (socket says 172.21.15.146:54098) 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/2884173850 learned_addr learned my addr 172.21.15.146:0/2884173850 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2e7fc640 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbdb3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2effd640 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbe0c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/2884173850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 msgr2=0x560ddbdb3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbdb3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/2884173850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 msgr2=0x560ddbe0c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbe0c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/2884173850 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ddba56890 con 0x560ddba0d580 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2effd640 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbe0c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:54.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbdf2e00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ffb28006010 tx=0x7ffb28003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e8f03f5c48bab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb0dffb640 1 -- 172.21.15.146:0/2884173850 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28035030 con 0x560ddba0d580 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb0dffb640 1 -- 172.21.15.146:0/2884173850 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ffb28003c20 con 0x560ddba0d580 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.289+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/2884173850 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb28004320 con 0x560ddba0d580 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb0dffb640 1 -- 172.21.15.146:0/2884173850 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffb28055050 con 0x560ddba0d580 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb3c2b6740 10 client.5943 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/2884173850 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x560ddbb52180 con 0x560ddba0d580 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb0dffb640 1 -- 172.21.15.146:0/2884173850 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb28004320 con 0x560ddba0d580 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb0dffb640 1 -- 172.21.15.146:0/2884173850 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7ffb28058020 con 0x560ddba0d580 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb3c2b6740 10 client.5943 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb3c2b6740 10 client.5943 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:54.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb3c2b6740 20 client.5943 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560ddb9cc150 0x560ddbdf3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb3c2b6740 4 client.5943 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/2884173850 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ddbd29c10 con 0x560ddb9cc150 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb2effd640 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560ddb9cc150 0x560ddbdf3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb0dffb640 10 client.5943 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.290+0000 7ffb2effd640 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560ddb9cc150 0x560ddbdf3680 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33a35fc2073aac58 server_cookie=200fd4b15e6ab259 in_seq=0 out_seq=0 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb0dffb640 1 -- 172.21.15.146:0/2884173850 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560ddbd29c10 con 0x560ddb9cc150 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb0dffb640 10 client.5943 handle_command_reply: tid=0 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 1 client.5943 shutdown 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/2884173850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 msgr2=0x560ddbdf2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbdf2e00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ffb28006010 tx=0x7ffb28003820 comp rx=0 tx=0).stop 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/2884173850 shutdown_connections 2024-09-17T03:35:54.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560ddb9cc150 0x560ddbdf3680 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbdf2e00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbdb3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/2884173850 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbe0c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/2884173850 >> 172.21.15.146:0/2884173850 conn(0x560ddba016d0 msgr2=0x560ddbdaf260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb0dffb640 0 client.5943 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/2884173850 shutdown_connections 2024-09-17T03:35:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/2884173850 wait complete. 2024-09-17T03:35:54.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.291+0000 7ffb3c2b6740 20 client.5943 trim_cache size 0 max 16384 2024-09-17T03:35:54.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.309+0000 7ffb3c2b6740 1 Processor -- start 2024-09-17T03:35:54.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.309+0000 7ffb3c2b6740 1 -- start start 2024-09-17T03:35:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.310+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbdf0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.310+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbdde910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.310+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbddee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.310+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560ddbdb0fa0 con 0x560ddba0d580 2024-09-17T03:35:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.310+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffb30202130 con 0x560ddb9e46c0 2024-09-17T03:35:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.310+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffb30201170 con 0x560ddb9ec8a0 2024-09-17T03:35:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.310+0000 7ffb2f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbddee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.310+0000 7ffb2f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbddee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54104/0 (socket says 172.21.15.146:54104) 2024-09-17T03:35:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.310+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/3473049985 learned_addr learned my addr 172.21.15.146:0/3473049985 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.311+0000 7ffb2e7fc640 1 --2- 172.21.15.146:0/3473049985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbdde910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.310+0000 7ffb2effd640 1 --2- 172.21.15.146:0/3473049985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbdf0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.311+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/3473049985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 msgr2=0x560ddbdde910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.311+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/3473049985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbdde910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.311+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/3473049985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 msgr2=0x560ddbdf0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.311+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/3473049985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbdf0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.311+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/3473049985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ddbaefcf0 con 0x560ddba0d580 2024-09-17T03:35:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.311+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/3473049985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbddee50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009830 tx=0x7ffb2802acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcbd8f8c0f7fb7f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.311+0000 7ffb0ffff640 1 -- 172.21.15.146:0/3473049985 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28035040 con 0x560ddba0d580 2024-09-17T03:35:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.311+0000 7ffb0ffff640 1 -- 172.21.15.146:0/3473049985 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb28004320 con 0x560ddba0d580 2024-09-17T03:35:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.311+0000 7ffb0ffff640 1 -- 172.21.15.146:0/3473049985 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28040040 con 0x560ddba0d580 2024-09-17T03:35:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.312+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/3473049985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 msgr2=0x560ddbddee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.312+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/3473049985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbddee50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009830 tx=0x7ffb2802acf0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.312+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/3473049985 shutdown_connections 2024-09-17T03:35:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.312+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/3473049985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbddee50 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.312+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/3473049985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbdde910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.312+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/3473049985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbdf0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.312+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/3473049985 >> 172.21.15.146:0/3473049985 conn(0x560ddba016d0 msgr2=0x560ddbdaa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.312+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/3473049985 shutdown_connections 2024-09-17T03:35:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.312+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/3473049985 wait complete. 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.313+0000 7ffb3c2b6740 1 -- start start 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.313+0000 7ffb3c2b6740 1 Processor -- start 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbdde910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbddee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb3c2b6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbe7b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffb30200b50 con 0x560ddba0d580 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffb30200500 con 0x560ddb9e46c0 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb3c2b6740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x560ddbdb40b0 con 0x560ddb9ec8a0 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb3c2b6740 10 client.0 _ll_register_callbacks cb 0x7ffb24007d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb2f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbe7b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb2f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbe7b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54108/0 (socket says 172.21.15.146:54108) 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/771649074 learned_addr learned my addr 172.21.15.146:0/771649074 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb2effd640 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbdde910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb2e7fc640 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbddee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/771649074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 msgr2=0x560ddbddee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbddee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/771649074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 msgr2=0x560ddbdde910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbdde910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.314+0000 7ffb2f7fe640 1 -- 172.21.15.146:0/771649074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ddbe1bd60 con 0x560ddba0d580 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb2f7fe640 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbe7b790 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009230 tx=0x7ffb280049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12038a1084acae66 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb0dffb640 1 -- 172.21.15.146:0/771649074 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2805e060 con 0x560ddba0d580 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb0dffb640 1 -- 172.21.15.146:0/771649074 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ffb28004d60 con 0x560ddba0d580 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/771649074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb28004320 con 0x560ddba0d580 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb0dffb640 1 -- 172.21.15.146:0/771649074 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffb28064050 con 0x560ddba0d580 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb3c2b6740 10 client.5949 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/771649074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x560ddbdb5280 con 0x560ddba0d580 2024-09-17T03:35:54.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb0dffb640 1 -- 172.21.15.146:0/771649074 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb28004320 con 0x560ddba0d580 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb0dffb640 1 -- 172.21.15.146:0/771649074 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7ffb28067020 con 0x560ddba0d580 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb3c2b6740 10 client.5949 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb3c2b6740 10 client.5949 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb3c2b6740 20 client.5949 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560ddbe7b200 0x560ddbe7bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb3c2b6740 4 client.5949 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/771649074 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x560ddbd256c0 con 0x560ddbe7b200 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.315+0000 7ffb2effd640 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560ddbe7b200 0x560ddbe7bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb0dffb640 10 client.5949 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb2effd640 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560ddbe7b200 0x560ddbe7bcd0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6c4c14383c8726 server_cookie=283c1d67e46d64a2 in_seq=0 out_seq=0 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb0dffb640 1 -- 172.21.15.146:0/771649074 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x560ddbd256c0 con 0x560ddbe7b200 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb0dffb640 10 client.5949 handle_command_reply: tid=0 2024-09-17T03:35:54.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 1 client.5949 shutdown 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/771649074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 msgr2=0x560ddbe7b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbe7b790 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009230 tx=0x7ffb280049e0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/771649074 shutdown_connections 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560ddbe7b200 0x560ddbe7bcd0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560ddba0d580 0x560ddbe7b790 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560ddb9ec8a0 0x560ddbddee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 1 --2- 172.21.15.146:0/771649074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560ddb9e46c0 0x560ddbdde910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb0dffb640 0 client.5949 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/771649074 >> 172.21.15.146:0/771649074 conn(0x560ddba016d0 msgr2=0x560ddbe0bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/771649074 shutdown_connections 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 1 -- 172.21.15.146:0/771649074 wait complete. 2024-09-17T03:35:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.316+0000 7ffb3c2b6740 20 client.5949 trim_cache size 0 max 16384 2024-09-17T03:35:54.322 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:54.322 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": -2 2024-09-17T03:35:54.322 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 -- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb1c078b90 msgr2=0x7ffb1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb1c078b90 0x7ffb1c07b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffb24000f60 tx=0x7ffb24009040 comp rx=0 tx=0).stop 2024-09-17T03:35:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 -- 172.21.15.146:0/2306316421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb300b3870 msgr2=0x7ffb30163970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb300b3870 0x7ffb30163970 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000ba50 tx=0x7ffb2000bf10 comp rx=0 tx=0).stop 2024-09-17T03:35:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 -- 172.21.15.146:0/2306316421 shutdown_connections 2024-09-17T03:35:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb1c078b90 0x7ffb1c07b0a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb3014a820 0x7ffb300cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb300cf370 0x7ffb3014a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 --2- 172.21.15.146:0/2306316421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb300b3870 0x7ffb30163970 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 -- 172.21.15.146:0/2306316421 >> 172.21.15.146:0/2306316421 conn(0x7ffb300d4be0 msgr2=0x7ffb3006ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 -- 172.21.15.146:0/2306316421 shutdown_connections 2024-09-17T03:35:54.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.317+0000 7ffb35352640 1 -- 172.21.15.146:0/2306316421 wait complete. 2024-09-17T03:35:54.327 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-17T03:35:54.327 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-17T03:35:54.327 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-17T03:35:54.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.445+0000 7f5bbad5e640 1 -- 172.21.15.146:0/3139189074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bb406f270 msgr2=0x7f5bb41628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.445+0000 7f5bbad5e640 1 --2- 172.21.15.146:0/3139189074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bb406f270 0x7f5bb41628a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5bb408d2b0 tx=0x7f5bac02a980 comp rx=0 tx=0).stop 2024-09-17T03:35:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.445+0000 7f5bbad5e640 1 -- 172.21.15.146:0/3139189074 shutdown_connections 2024-09-17T03:35:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.445+0000 7f5bbad5e640 1 --2- 172.21.15.146:0/3139189074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bb406f270 0x7f5bb41628a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.445+0000 7f5bbad5e640 1 --2- 172.21.15.146:0/3139189074 >> v2:172.21.15.179:3300/0 conn(0x7f5bb41620f0 0x7f5bb406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.445+0000 7f5bbad5e640 1 --2- 172.21.15.146:0/3139189074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb40b3870 0x7f5bb40cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.445+0000 7f5bbad5e640 1 -- 172.21.15.146:0/3139189074 >> 172.21.15.146:0/3139189074 conn(0x7f5bb40d4be0 msgr2=0x7f5bb40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.445+0000 7f5bbad5e640 1 -- 172.21.15.146:0/3139189074 shutdown_connections 2024-09-17T03:35:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.445+0000 7f5bbad5e640 1 -- 172.21.15.146:0/3139189074 wait complete. 2024-09-17T03:35:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.446+0000 7f5bbad5e640 1 Processor -- start 2024-09-17T03:35:54.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.446+0000 7f5bbad5e640 1 -- start start 2024-09-17T03:35:54.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bbad5e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bb406f270 0x7f5bb40ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bbad5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb40b3870 0x7f5bb41f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bbad5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb41620f0 0x7f5bb40ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bbad5e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4163170 con 0x7f5bb406f270 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bbad5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4162ff0 con 0x7f5bb41620f0 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bbad5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb41632f0 con 0x7f5bb40b3870 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bb8afa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bb406f270 0x7f5bb40ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bb8afa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bb406f270 0x7f5bb40ab230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54128/0 (socket says 172.21.15.146:54128) 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bb8afa640 1 -- 172.21.15.146:0/2599967757 learned_addr learned my addr 172.21.15.146:0/2599967757 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb40b3870 0x7f5bb41f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bb92fb640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb41620f0 0x7f5bb40ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bb8afa640 1 -- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb40b3870 msgr2=0x7f5bb41f7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bb8afa640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb40b3870 0x7f5bb41f7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bb8afa640 1 -- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb41620f0 msgr2=0x7f5bb40ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bb8afa640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb41620f0 0x7f5bb40ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bb8afa640 1 -- 172.21.15.146:0/2599967757 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb40c9810 con 0x7f5bb406f270 2024-09-17T03:35:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.448+0000 7f5bb8afa640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bb406f270 0x7f5bb40ab230 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800e7c0 tx=0x7f5ba800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.449+0000 7f5bb17fa640 1 -- 172.21.15.146:0/2599967757 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba800ccc0 con 0x7f5bb406f270 2024-09-17T03:35:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.449+0000 7f5bb17fa640 1 -- 172.21.15.146:0/2599967757 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ba800ce80 con 0x7f5bb406f270 2024-09-17T03:35:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.449+0000 7f5bbad5e640 1 -- 172.21.15.146:0/2599967757 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb40c9af0 con 0x7f5bb406f270 2024-09-17T03:35:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.449+0000 7f5bb17fa640 1 -- 172.21.15.146:0/2599967757 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8005280 con 0x7f5bb406f270 2024-09-17T03:35:54.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.449+0000 7f5bbad5e640 1 -- 172.21.15.146:0/2599967757 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb40ca0b0 con 0x7f5bb406f270 2024-09-17T03:35:54.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.450+0000 7f5bb17fa640 1 -- 172.21.15.146:0/2599967757 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ba8005420 con 0x7f5bb406f270 2024-09-17T03:35:54.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.451+0000 7f5bb17fa640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b98078b90 0x7f5b9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.451+0000 7f5bb17fa640 1 -- 172.21.15.146:0/2599967757 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f5ba809b760 con 0x7f5bb406f270 2024-09-17T03:35:54.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.451+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b98078b90 0x7f5b9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.452+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b98078b90 0x7f5b9807b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40b4080 tx=0x7f5ba0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.452+0000 7f5bc1ccc740 1 Processor -- start 2024-09-17T03:35:54.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.452+0000 7f5bc1ccc740 1 -- start start 2024-09-17T03:35:54.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.453+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2d08690 0x555da30d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.453+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 0x555da30d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.453+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.453+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555da3022b00 con 0x555da2ce79b0 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.453+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555da3011f30 con 0x555da2d08690 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.453+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x555da3015d40 con 0x555da2cdf7d0 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.453+0000 7f5bb92fb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.453+0000 7f5bb92fb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54140/0 (socket says 172.21.15.146:54140) 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.453+0000 7f5bb92fb640 1 -- 172.21.15.146:0/1192376033 learned_addr learned my addr 172.21.15.146:0/1192376033 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.453+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/1192376033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 0x555da30d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.453+0000 7f5bb8afa640 1 --2- 172.21.15.146:0/1192376033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2d08690 0x555da30d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.454+0000 7f5bb92fb640 1 -- 172.21.15.146:0/1192376033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 msgr2=0x555da30d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.454+0000 7f5bb92fb640 1 --2- 172.21.15.146:0/1192376033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 0x555da30d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.454+0000 7f5bb92fb640 1 -- 172.21.15.146:0/1192376033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2d08690 msgr2=0x555da30d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.454+0000 7f5bb92fb640 1 --2- 172.21.15.146:0/1192376033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2d08690 0x555da30d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.454+0000 7f5bb92fb640 1 -- 172.21.15.146:0/1192376033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555da2decb00 con 0x555da2ce79b0 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.454+0000 7f5bb92fb640 1 --2- 172.21.15.146:0/1192376033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d9290 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009bf0 tx=0x7f5bac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3023854e977c68de server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.454+0000 7f5b9e7fc640 1 -- 172.21.15.146:0/1192376033 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac034040 con 0x555da2ce79b0 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.454+0000 7f5b9e7fc640 1 -- 172.21.15.146:0/1192376033 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bac030b70 con 0x555da2ce79b0 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.454+0000 7f5b9e7fc640 1 -- 172.21.15.146:0/1192376033 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac003970 con 0x555da2ce79b0 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.455+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1192376033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 msgr2=0x555da30d9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.455+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/1192376033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d9290 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009bf0 tx=0x7f5bac004a40 comp rx=0 tx=0).stop 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.455+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1192376033 shutdown_connections 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.455+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/1192376033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d9290 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.455+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/1192376033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 0x555da30d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.455+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/1192376033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2d08690 0x555da30d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.455+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1192376033 >> 172.21.15.146:0/1192376033 conn(0x555da2cfc7e0 msgr2=0x555da30af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.455+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1192376033 shutdown_connections 2024-09-17T03:35:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.455+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1192376033 wait complete. 2024-09-17T03:35:54.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.456+0000 7f5bc1ccc740 1 -- start start 2024-09-17T03:35:54.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.456+0000 7f5bc1ccc740 1 Processor -- start 2024-09-17T03:35:54.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.457+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2cdf7d0 0x555da30cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.457+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.457+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2d08690 0x555da30d92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.457+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555da2d82a40 con 0x555da2ce79b0 2024-09-17T03:35:54.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.457+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555da2f98680 con 0x555da2cdf7d0 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.457+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x555da30eb420 con 0x555da2d08690 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.457+0000 7f5bc1ccc740 10 client.0 _ll_register_callbacks cb 0x555da300ad50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.457+0000 7f5bb3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.457+0000 7f5bb3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54144/0 (socket says 172.21.15.146:54144) 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.457+0000 7f5bb3fff640 1 -- 172.21.15.146:0/699617122 learned_addr learned my addr 172.21.15.146:0/699617122 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bb8afa640 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2cdf7d0 0x555da30cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bb92fb640 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2d08690 0x555da30d92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bb3fff640 1 -- 172.21.15.146:0/699617122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2d08690 msgr2=0x555da30d92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2d08690 0x555da30d92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bb3fff640 1 -- 172.21.15.146:0/699617122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2cdf7d0 msgr2=0x555da30cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2cdf7d0 0x555da30cfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bb3fff640 1 -- 172.21.15.146:0/699617122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555da2d519a0 con 0x555da2ce79b0 2024-09-17T03:35:54.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d8db0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00045f0 tx=0x7f5ba0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e067f2628f18304b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5b937fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5b937fe640 1 -- 172.21.15.146:0/699617122 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0012650 con 0x555da2ce79b0 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5b937fe640 1 -- 172.21.15.146:0/699617122 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f5ba00127f0 con 0x555da2ce79b0 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699617122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bac030b70 con 0x555da2ce79b0 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5b937fe640 1 -- 172.21.15.146:0/699617122 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5ba0031050 con 0x555da2ce79b0 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bc1ccc740 10 client.5961 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699617122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x555da2e4d290 con 0x555da2ce79b0 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5b937fe640 1 -- 172.21.15.146:0/699617122 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bac030b70 con 0x555da2ce79b0 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5b937fe640 1 -- 172.21.15.146:0/699617122 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f5ba0034020 con 0x555da2ce79b0 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bc1ccc740 10 client.5961 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bc1ccc740 10 client.5961 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.458+0000 7f5bc1ccc740 20 client.5961 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.459+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555da2cc7260 0x555da30da660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.459+0000 7f5bc1ccc740 4 client.5961 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:54.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.459+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699617122 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555da3024a50 con 0x555da2cc7260 2024-09-17T03:35:54.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.459+0000 7f5bb8afa640 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555da2cc7260 0x555da30da660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.459+0000 7f5b937fe640 10 client.5961 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.459+0000 7f5bb8afa640 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555da2cc7260 0x555da30da660 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=938da7b523c67c37 server_cookie=c32d4c5099289976 in_seq=0 out_seq=0 2024-09-17T03:35:54.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5b937fe640 1 -- 172.21.15.146:0/699617122 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555da3024a50 con 0x555da2cc7260 2024-09-17T03:35:54.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5b937fe640 10 client.5961 handle_command_reply: tid=0 2024-09-17T03:35:54.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 1 client.5961 shutdown 2024-09-17T03:35:54.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699617122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 msgr2=0x555da30d8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d8db0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00045f0 tx=0x7f5ba0004730 comp rx=0 tx=0).stop 2024-09-17T03:35:54.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699617122 shutdown_connections 2024-09-17T03:35:54.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555da2cc7260 0x555da30da660 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2d08690 0x555da30d92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30d8db0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5b937fe640 0 client.5961 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/699617122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2cdf7d0 0x555da30cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699617122 >> 172.21.15.146:0/699617122 conn(0x555da2cfc7e0 msgr2=0x555da30a86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699617122 shutdown_connections 2024-09-17T03:35:54.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699617122 wait complete. 2024-09-17T03:35:54.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.460+0000 7f5bc1ccc740 20 client.5961 trim_cache size 0 max 16384 2024-09-17T03:35:54.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.478+0000 7f5bc1ccc740 1 Processor -- start 2024-09-17T03:35:54.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.478+0000 7f5bc1ccc740 1 -- start start 2024-09-17T03:35:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 0x555da30af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2d08690 0x555da30d6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4202450 con 0x555da2ce79b0 2024-09-17T03:35:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41f6c40 con 0x555da2d08690 2024-09-17T03:35:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb4151220 con 0x555da2cdf7d0 2024-09-17T03:35:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bb3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bb3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54160/0 (socket says 172.21.15.146:54160) 2024-09-17T03:35:54.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bb3fff640 1 -- 172.21.15.146:0/699904972 learned_addr learned my addr 172.21.15.146:0/699904972 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bb3fff640 1 -- 172.21.15.146:0/699904972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 msgr2=0x555da30af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/699904972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 0x555da30af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bb3fff640 1 -- 172.21.15.146:0/699904972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2d08690 msgr2=0x555da30d6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/699904972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2d08690 0x555da30d6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.479+0000 7f5bb3fff640 1 -- 172.21.15.146:0/699904972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555da2deae00 con 0x555da2ce79b0 2024-09-17T03:35:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.480+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/699904972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30af580 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00043d0 tx=0x7f5ba0004400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1534b2b598aee05e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.480+0000 7f5b9dffb640 1 -- 172.21.15.146:0/699904972 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0012e10 con 0x555da2ce79b0 2024-09-17T03:35:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.480+0000 7f5b9dffb640 1 -- 172.21.15.146:0/699904972 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ba0039030 con 0x555da2ce79b0 2024-09-17T03:35:54.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.480+0000 7f5b9dffb640 1 -- 172.21.15.146:0/699904972 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00126b0 con 0x555da2ce79b0 2024-09-17T03:35:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.480+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699904972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 msgr2=0x555da30af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.480+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/699904972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30af580 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00043d0 tx=0x7f5ba0004400 comp rx=0 tx=0).stop 2024-09-17T03:35:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.481+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699904972 shutdown_connections 2024-09-17T03:35:54.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.481+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/699904972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2d08690 0x555da30d6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.481+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/699904972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2ce79b0 0x555da30af580 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.481+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/699904972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 0x555da30af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.481+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699904972 >> 172.21.15.146:0/699904972 conn(0x555da2cfc7e0 msgr2=0x555da30cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.481+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699904972 shutdown_connections 2024-09-17T03:35:54.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.481+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/699904972 wait complete. 2024-09-17T03:35:54.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.481+0000 7f5bc1ccc740 1 -- start start 2024-09-17T03:35:54.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.482+0000 7f5bc1ccc740 1 Processor -- start 2024-09-17T03:35:54.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 0x555da30db000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2ce79b0 0x555da3176ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bc1ccc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2d08690 0x555da30d9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41f65f0 con 0x555da2d08690 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555da30ab260 con 0x555da2ce79b0 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bc1ccc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x555da31777f0 con 0x555da2cdf7d0 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bc1ccc740 10 client.0 _ll_register_callbacks cb 0x7f5ba0011bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb92fb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2d08690 0x555da30d9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb92fb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2d08690 0x555da30d9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54168/0 (socket says 172.21.15.146:54168) 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb92fb640 1 -- 172.21.15.146:0/1255694795 learned_addr learned my addr 172.21.15.146:0/1255694795 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb8afa640 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 0x555da30db000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2ce79b0 0x555da3176ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb92fb640 1 -- 172.21.15.146:0/1255694795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 msgr2=0x555da30db000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb92fb640 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 0x555da30db000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb92fb640 1 -- 172.21.15.146:0/1255694795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2ce79b0 msgr2=0x555da3176ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb92fb640 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2ce79b0 0x555da3176ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb92fb640 1 -- 172.21.15.146:0/1255694795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555da30a4e70 con 0x555da2d08690 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2ce79b0 0x555da3176ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5bb92fb640 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2d08690 0x555da30d9040 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009d60 tx=0x7f5bac005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ad3233b8c2e209 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.483+0000 7f5b937fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5b937fe640 1 -- 172.21.15.146:0/1255694795 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac053060 con 0x555da2d08690 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5b937fe640 1 -- 172.21.15.146:0/1255694795 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f5bac003b80 con 0x555da2d08690 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1255694795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ba0039030 con 0x555da2d08690 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5b937fe640 1 -- 172.21.15.146:0/1255694795 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5bac059050 con 0x555da2d08690 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5bc1ccc740 10 client.5967 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1255694795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x555da3177530 con 0x555da2d08690 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5b937fe640 1 -- 172.21.15.146:0/1255694795 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ba0039030 con 0x555da2d08690 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5b937fe640 1 -- 172.21.15.146:0/1255694795 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f5bac05c020 con 0x555da2d08690 2024-09-17T03:35:54.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5bc1ccc740 10 client.5967 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5bc1ccc740 10 client.5967 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5bc1ccc740 20 client.5967 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555da3177010 0x555da30d9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5bc1ccc740 4 client.5967 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-17T03:35:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1255694795 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x555da3020500 con 0x555da3177010 2024-09-17T03:35:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.484+0000 7f5bb8afa640 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555da3177010 0x555da30d9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.485+0000 7f5b937fe640 10 client.5967 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.485+0000 7f5bb8afa640 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555da3177010 0x555da30d9580 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44249af3ede0b161 server_cookie=1547b20cd6d6763d in_seq=0 out_seq=0 2024-09-17T03:35:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.485+0000 7f5b937fe640 1 -- 172.21.15.146:0/1255694795 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555da3020500 con 0x555da3177010 2024-09-17T03:35:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.485+0000 7f5b937fe640 10 client.5967 handle_command_reply: tid=0 2024-09-17T03:35:54.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.485+0000 7f5bc1ccc740 1 client.5967 shutdown 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.485+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1255694795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2d08690 msgr2=0x555da30d9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.485+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2d08690 0x555da30d9040 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009d60 tx=0x7f5bac005c70 comp rx=0 tx=0).stop 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1255694795 shutdown_connections 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555da3177010 0x555da30d9580 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555da2d08690 0x555da30d9040 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555da2ce79b0 0x555da3176ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bc1ccc740 1 --2- 172.21.15.146:0/1255694795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555da2cdf7d0 0x555da30db000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1255694795 >> 172.21.15.146:0/1255694795 conn(0x555da2cfc7e0 msgr2=0x555da30b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5b937fe640 0 client.5967 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1255694795 shutdown_connections 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bc1ccc740 1 -- 172.21.15.146:0/1255694795 wait complete. 2024-09-17T03:35:54.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bc1ccc740 20 client.5967 trim_cache size 0 max 16384 2024-09-17T03:35:54.491 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:54.491 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:35:54.491 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "7d980207-f21b-4228-8400-5f563b3039a8", 2024-09-17T03:35:54.491 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:35:54.491 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:54.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bbad5e640 1 -- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b98078b90 msgr2=0x7f5b9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bbad5e640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b98078b90 0x7f5b9807b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40b4080 tx=0x7f5ba0005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:54.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bbad5e640 1 -- 172.21.15.146:0/2599967757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bb406f270 msgr2=0x7f5bb40ab230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bbad5e640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bb406f270 0x7f5bb40ab230 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800e7c0 tx=0x7f5ba800ec80 comp rx=0 tx=0).stop 2024-09-17T03:35:54.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bbad5e640 1 -- 172.21.15.146:0/2599967757 shutdown_connections 2024-09-17T03:35:54.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bbad5e640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b98078b90 0x7f5b9807b0a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bbad5e640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bb41620f0 0x7f5bb40ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bbad5e640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bb40b3870 0x7f5bb41f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bbad5e640 1 --2- 172.21.15.146:0/2599967757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bb406f270 0x7f5bb40ab230 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.486+0000 7f5bbad5e640 1 -- 172.21.15.146:0/2599967757 >> 172.21.15.146:0/2599967757 conn(0x7f5bb40d4be0 msgr2=0x7f5bb40b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.487+0000 7f5bbad5e640 1 -- 172.21.15.146:0/2599967757 shutdown_connections 2024-09-17T03:35:54.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.487+0000 7f5bbad5e640 1 -- 172.21.15.146:0/2599967757 wait complete. 2024-09-17T03:35:54.497 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '7d980207-f21b-4228-8400-5f563b3039a8', 'mode': 'asynchronous'}' 2024-09-17T03:35:54.497 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-17T03:35:54.497 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-17T03:35:54.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.614+0000 7f70ba520640 1 -- 172.21.15.146:0/808501331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40b3d30 msgr2=0x7f70b415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.614+0000 7f70ba520640 1 --2- 172.21.15.146:0/808501331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40b3d30 0x7f70b415caa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f70ac005fd0 tx=0x7f70ac02a830 comp rx=0 tx=0).stop 2024-09-17T03:35:54.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.614+0000 7f70ba520640 1 -- 172.21.15.146:0/808501331 shutdown_connections 2024-09-17T03:35:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.614+0000 7f70ba520640 1 --2- 172.21.15.146:0/808501331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40b3d30 0x7f70b415caa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.614+0000 7f70ba520640 1 --2- 172.21.15.146:0/808501331 >> v2:172.21.15.179:3300/0 conn(0x7f70b40b5ce0 0x7f70b40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.614+0000 7f70ba520640 1 -- 172.21.15.146:0/808501331 >> 172.21.15.146:0/808501331 conn(0x7f70b40b7b20 msgr2=0x7f70b409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.614+0000 7f70ba520640 1 -- 172.21.15.146:0/808501331 shutdown_connections 2024-09-17T03:35:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.614+0000 7f70ba520640 1 -- 172.21.15.146:0/808501331 wait complete. 2024-09-17T03:35:54.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.616+0000 7f70ba520640 1 Processor -- start 2024-09-17T03:35:54.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.616+0000 7f70ba520640 1 -- start start 2024-09-17T03:35:54.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.617+0000 7f70ba520640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b40b5750 0x7f70b41f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.617+0000 7f70ba520640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40b5ce0 0x7f70b41f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.617+0000 7f70ba520640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b41539d0 0x7f70b4155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.617+0000 7f70ba520640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f70b415d420 con 0x7f70b40b5750 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.617+0000 7f70ba520640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f70b415d2a0 con 0x7f70b41539d0 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.617+0000 7f70ba520640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f70b415d5a0 con 0x7f70b40b5ce0 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.617+0000 7f70b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b40b5750 0x7f70b41f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.617+0000 7f70b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b40b5750 0x7f70b41f3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54170/0 (socket says 172.21.15.146:54170) 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.617+0000 7f70b3fff640 1 -- 172.21.15.146:0/2516284498 learned_addr learned my addr 172.21.15.146:0/2516284498 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.617+0000 7f70b37fe640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40b5ce0 0x7f70b41f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.617+0000 7f70b8abd640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b41539d0 0x7f70b4155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.618+0000 7f70b3fff640 1 -- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40b5ce0 msgr2=0x7f70b41f0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.618+0000 7f70b3fff640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40b5ce0 0x7f70b41f0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.618+0000 7f70b3fff640 1 -- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b41539d0 msgr2=0x7f70b4155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.618+0000 7f70b3fff640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b41539d0 0x7f70b4155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.618+0000 7f70b3fff640 1 -- 172.21.15.146:0/2516284498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b41f0960 con 0x7f70b40b5750 2024-09-17T03:35:54.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.618+0000 7f70b3fff640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b40b5750 0x7f70b41f3a40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f70a400e9f0 tx=0x7f70a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.618+0000 7f70b0ff9640 1 -- 172.21.15.146:0/2516284498 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a400cd80 con 0x7f70b40b5750 2024-09-17T03:35:54.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.618+0000 7f70ba520640 1 -- 172.21.15.146:0/2516284498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b41422b0 con 0x7f70b40b5750 2024-09-17T03:35:54.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.618+0000 7f70b0ff9640 1 -- 172.21.15.146:0/2516284498 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70a4004020 con 0x7f70b40b5750 2024-09-17T03:35:54.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.618+0000 7f70b0ff9640 1 -- 172.21.15.146:0/2516284498 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4004470 con 0x7f70b40b5750 2024-09-17T03:35:54.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.618+0000 7f70ba520640 1 -- 172.21.15.146:0/2516284498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b4142870 con 0x7f70b40b5750 2024-09-17T03:35:54.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.620+0000 7f70b0ff9640 1 -- 172.21.15.146:0/2516284498 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f70a40035f0 con 0x7f70b40b5750 2024-09-17T03:35:54.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.620+0000 7f70b0ff9640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70a0078bc0 0x7f70a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.620+0000 7f70b0ff9640 1 -- 172.21.15.146:0/2516284498 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f70a409b620 con 0x7f70b40b5750 2024-09-17T03:35:54.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.620+0000 7f70b37fe640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70a0078bc0 0x7f70a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.621+0000 7f70b37fe640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70a0078bc0 0x7f70a007b0d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f70b4155a70 tx=0x7f70a8001db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.621+0000 7f70c148c740 1 Processor -- start 2024-09-17T03:35:54.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.621+0000 7f70c148c740 1 -- start start 2024-09-17T03:35:54.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.622+0000 7f70c148c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eaded30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.622+0000 7f70c148c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadeb5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.622+0000 7f70c148c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eadeb62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.622+0000 7f70c148c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555eaddfef20 con 0x555eadac3db0 2024-09-17T03:35:54.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.622+0000 7f70c148c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555eaddee350 con 0x555eadae4a90 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.622+0000 7f70c148c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x555eaddf2160 con 0x555eadabbbd0 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.622+0000 7f70b8abd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eadeb62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.622+0000 7f70b8abd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eadeb62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54180/0 (socket says 172.21.15.146:54180) 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.622+0000 7f70b8abd640 1 -- 172.21.15.146:0/2979120695 learned_addr learned my addr 172.21.15.146:0/2979120695 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.623+0000 7f70b37fe640 1 --2- 172.21.15.146:0/2979120695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadeb5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.623+0000 7f70b3fff640 1 --2- 172.21.15.146:0/2979120695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eaded30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.623+0000 7f70b8abd640 1 -- 172.21.15.146:0/2979120695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 msgr2=0x555eadeb5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.623+0000 7f70b8abd640 1 --2- 172.21.15.146:0/2979120695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadeb5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.623+0000 7f70b8abd640 1 -- 172.21.15.146:0/2979120695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 msgr2=0x555eaded30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.623+0000 7f70b8abd640 1 --2- 172.21.15.146:0/2979120695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eaded30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.623+0000 7f70b8abd640 1 -- 172.21.15.146:0/2979120695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eadd9a660 con 0x555eadac3db0 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.623+0000 7f70b8abd640 1 --2- 172.21.15.146:0/2979120695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eadeb62e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009cd0 tx=0x7f70ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8375d2b74ae4e049 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.623+0000 7f7099ffb640 1 -- 172.21.15.146:0/2979120695 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac041070 con 0x555eadac3db0 2024-09-17T03:35:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.623+0000 7f7099ffb640 1 -- 172.21.15.146:0/2979120695 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70ac003d80 con 0x555eadac3db0 2024-09-17T03:35:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.623+0000 7f7099ffb640 1 -- 172.21.15.146:0/2979120695 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac036040 con 0x555eadac3db0 2024-09-17T03:35:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.624+0000 7f70c148c740 1 -- 172.21.15.146:0/2979120695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 msgr2=0x555eadeb62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.624+0000 7f70c148c740 1 --2- 172.21.15.146:0/2979120695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eadeb62e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009cd0 tx=0x7f70ac004a40 comp rx=0 tx=0).stop 2024-09-17T03:35:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.624+0000 7f70c148c740 1 -- 172.21.15.146:0/2979120695 shutdown_connections 2024-09-17T03:35:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.624+0000 7f70c148c740 1 --2- 172.21.15.146:0/2979120695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eadeb62e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.624+0000 7f70c148c740 1 --2- 172.21.15.146:0/2979120695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadeb5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.624+0000 7f70c148c740 1 --2- 172.21.15.146:0/2979120695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eaded30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.624+0000 7f70c148c740 1 -- 172.21.15.146:0/2979120695 >> 172.21.15.146:0/2979120695 conn(0x555eadad8be0 msgr2=0x555eade8bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.624+0000 7f70c148c740 1 -- 172.21.15.146:0/2979120695 shutdown_connections 2024-09-17T03:35:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.624+0000 7f70c148c740 1 -- 172.21.15.146:0/2979120695 wait complete. 2024-09-17T03:35:54.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.625+0000 7f70c148c740 1 -- start start 2024-09-17T03:35:54.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.625+0000 7f70c148c740 1 Processor -- start 2024-09-17T03:35:54.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.626+0000 7f70c148c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadea3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.626+0000 7f70c148c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadac3db0 0x555eadee3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.626+0000 7f70c148c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadae4a90 0x555eadeb4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.626+0000 7f70c148c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555eadb5ee40 con 0x555eadae4a90 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.626+0000 7f70c148c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555eadd93850 con 0x555eadac3db0 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.626+0000 7f70c148c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x555eadecf720 con 0x555eadabbbd0 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.626+0000 7f70c148c740 10 client.0 _ll_register_callbacks cb 0x555eadde75d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.626+0000 7f70b8abd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadae4a90 0x555eadeb4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.626+0000 7f70b8abd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadae4a90 0x555eadeb4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54186/0 (socket says 172.21.15.146:54186) 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.626+0000 7f70b8abd640 1 -- 172.21.15.146:0/3438256636 learned_addr learned my addr 172.21.15.146:0/3438256636 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70b3fff640 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadea3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70b37fe640 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadac3db0 0x555eadee3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70b8abd640 1 -- 172.21.15.146:0/3438256636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 msgr2=0x555eadea3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70b8abd640 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadea3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70b8abd640 1 -- 172.21.15.146:0/3438256636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadac3db0 msgr2=0x555eadee3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70b8abd640 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadac3db0 0x555eadee3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70b8abd640 1 -- 172.21.15.146:0/3438256636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eadbc8f00 con 0x555eadae4a90 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70b37fe640 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadac3db0 0x555eadee3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70b8abd640 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadae4a90 0x555eadeb4a00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009b30 tx=0x7f70ac009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca742ff1fa4eb0f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f7092ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f7092ffd640 1 -- 172.21.15.146:0/3438256636 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac036050 con 0x555eadae4a90 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f7092ffd640 1 -- 172.21.15.146:0/3438256636 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f70ac031940 con 0x555eadae4a90 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70c148c740 1 -- 172.21.15.146:0/3438256636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70ac003d80 con 0x555eadae4a90 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f7092ffd640 1 -- 172.21.15.146:0/3438256636 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f70ac058050 con 0x555eadae4a90 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70c148c740 10 client.5979 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f70c148c740 1 -- 172.21.15.146:0/3438256636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x555eadb2dda0 con 0x555eadae4a90 2024-09-17T03:35:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f7092ffd640 1 -- 172.21.15.146:0/3438256636 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70ac003d80 con 0x555eadae4a90 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.627+0000 7f7092ffd640 1 -- 172.21.15.146:0/3438256636 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f70ac05b020 con 0x555eadae4a90 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.628+0000 7f70c148c740 10 client.5979 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.628+0000 7f70c148c740 10 client.5979 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.628+0000 7f70c148c740 20 client.5979 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.628+0000 7f70c148c740 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555eadaa3660 0x555eadeb4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.628+0000 7f70c148c740 4 client.5979 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.628+0000 7f70c148c740 1 -- 172.21.15.146:0/3438256636 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555eade00e70 con 0x555eadaa3660 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.628+0000 7f70b3fff640 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555eadaa3660 0x555eadeb4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.628+0000 7f7092ffd640 10 client.5979 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.628+0000 7f70b3fff640 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555eadaa3660 0x555eadeb4f40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bb8f9c1ab47dcc3 server_cookie=449bebe41ec928e1 in_seq=0 out_seq=0 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f7092ffd640 1 -- 172.21.15.146:0/3438256636 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555eade00e70 con 0x555eadaa3660 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f7092ffd640 10 client.5979 handle_command_reply: tid=0 2024-09-17T03:35:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 1 client.5979 shutdown 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 1 -- 172.21.15.146:0/3438256636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadae4a90 msgr2=0x555eadeb4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadae4a90 0x555eadeb4a00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009b30 tx=0x7f70ac009280 comp rx=0 tx=0).stop 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 1 -- 172.21.15.146:0/3438256636 shutdown_connections 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555eadaa3660 0x555eadeb4f40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadae4a90 0x555eadeb4a00 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadac3db0 0x555eadee3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f7092ffd640 0 client.5979 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 1 --2- 172.21.15.146:0/3438256636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadea3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 1 -- 172.21.15.146:0/3438256636 >> 172.21.15.146:0/3438256636 conn(0x555eadad8be0 msgr2=0x555eade8bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 1 -- 172.21.15.146:0/3438256636 shutdown_connections 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 1 -- 172.21.15.146:0/3438256636 wait complete. 2024-09-17T03:35:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.629+0000 7f70c148c740 20 client.5979 trim_cache size 0 max 16384 2024-09-17T03:35:54.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.647+0000 7f70c148c740 1 Processor -- start 2024-09-17T03:35:54.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.647+0000 7f70c148c740 1 -- start start 2024-09-17T03:35:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70c148c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eaded14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70c148c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70c148c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eade8bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70c148c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f70b42000d0 con 0x555eadac3db0 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70c148c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f70b41ff110 con 0x555eadae4a90 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70c148c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f70b41f70e0 con 0x555eadabbbd0 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54192/0 (socket says 172.21.15.146:54192) 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70b37fe640 1 -- 172.21.15.146:0/2028843399 learned_addr learned my addr 172.21.15.146:0/2028843399 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70b3fff640 1 --2- 172.21.15.146:0/2028843399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eaded14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70b8abd640 1 --2- 172.21.15.146:0/2028843399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eade8bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70b37fe640 1 -- 172.21.15.146:0/2028843399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 msgr2=0x555eaded14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70b37fe640 1 --2- 172.21.15.146:0/2028843399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eaded14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70b37fe640 1 -- 172.21.15.146:0/2028843399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 msgr2=0x555eade8bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70b37fe640 1 --2- 172.21.15.146:0/2028843399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eade8bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.648+0000 7f70b37fe640 1 -- 172.21.15.146:0/2028843399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eadc29690 con 0x555eadac3db0 2024-09-17T03:35:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.649+0000 7f70b37fe640 1 --2- 172.21.15.146:0/2028843399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8ba30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f70b40b7fe0 tx=0x7f70a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb9ced8568feb6f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.649+0000 7f70997fa640 1 -- 172.21.15.146:0/2028843399 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a801b040 con 0x555eadac3db0 2024-09-17T03:35:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.649+0000 7f70997fa640 1 -- 172.21.15.146:0/2028843399 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70a801c040 con 0x555eadac3db0 2024-09-17T03:35:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.649+0000 7f70997fa640 1 -- 172.21.15.146:0/2028843399 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8023670 con 0x555eadac3db0 2024-09-17T03:35:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.649+0000 7f70c148c740 1 -- 172.21.15.146:0/2028843399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 msgr2=0x555eade8ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.649+0000 7f70c148c740 1 --2- 172.21.15.146:0/2028843399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8ba30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f70b40b7fe0 tx=0x7f70a8015000 comp rx=0 tx=0).stop 2024-09-17T03:35:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.650+0000 7f70c148c740 1 -- 172.21.15.146:0/2028843399 shutdown_connections 2024-09-17T03:35:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.650+0000 7f70c148c740 1 --2- 172.21.15.146:0/2028843399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eade8bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.650+0000 7f70c148c740 1 --2- 172.21.15.146:0/2028843399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8ba30 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.650+0000 7f70c148c740 1 --2- 172.21.15.146:0/2028843399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eaded14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.650+0000 7f70c148c740 1 -- 172.21.15.146:0/2028843399 >> 172.21.15.146:0/2028843399 conn(0x555eadad8be0 msgr2=0x555eadecef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.650+0000 7f70c148c740 1 -- 172.21.15.146:0/2028843399 shutdown_connections 2024-09-17T03:35:54.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.650+0000 7f70c148c740 1 -- 172.21.15.146:0/2028843399 wait complete. 2024-09-17T03:35:54.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.650+0000 7f70c148c740 1 -- start start 2024-09-17T03:35:54.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.651+0000 7f70c148c740 1 Processor -- start 2024-09-17T03:35:54.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70c148c740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadf46a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70c148c740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70c148c740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eade8d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70c148c740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555eadef4080 con 0x555eadac3db0 2024-09-17T03:35:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70c148c740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f70b41feac0 con 0x555eadae4a90 2024-09-17T03:35:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70c148c740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x555eadf50660 con 0x555eadabbbd0 2024-09-17T03:35:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70c148c740 10 client.0 _ll_register_callbacks cb 0x7f70a400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54204/0 (socket says 172.21.15.146:54204) 2024-09-17T03:35:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70b37fe640 1 -- 172.21.15.146:0/2075984801 learned_addr learned my addr 172.21.15.146:0/2075984801 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70b3fff640 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadf46a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70b8abd640 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eade8d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70b37fe640 1 -- 172.21.15.146:0/2075984801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 msgr2=0x555eadf46a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70b37fe640 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadf46a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70b37fe640 1 -- 172.21.15.146:0/2075984801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 msgr2=0x555eade8d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70b37fe640 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eade8d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.652+0000 7f70b37fe640 1 -- 172.21.15.146:0/2075984801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eadbc7200 con 0x555eadac3db0 2024-09-17T03:35:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f70b37fe640 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8cca0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f70a8011010 tx=0x7f70a8023470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bab8836a64a9778 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f7092ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f7092ffd640 1 -- 172.21.15.146:0/2075984801 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a801b040 con 0x555eadac3db0 2024-09-17T03:35:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f7092ffd640 1 -- 172.21.15.146:0/2075984801 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f70a8004220 con 0x555eadac3db0 2024-09-17T03:35:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f70c148c740 1 -- 172.21.15.146:0/2075984801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a801c040 con 0x555eadac3db0 2024-09-17T03:35:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f7092ffd640 1 -- 172.21.15.146:0/2075984801 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f70a803a050 con 0x555eadac3db0 2024-09-17T03:35:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f70c148c740 10 client.5985 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f70c148c740 1 -- 172.21.15.146:0/2075984801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x555eadf503a0 con 0x555eadac3db0 2024-09-17T03:35:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f7092ffd640 1 -- 172.21.15.146:0/2075984801 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70a801c040 con 0x555eadac3db0 2024-09-17T03:35:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f7092ffd640 1 -- 172.21.15.146:0/2075984801 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f70a803d020 con 0x555eadac3db0 2024-09-17T03:35:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f70c148c740 10 client.5985 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f70c148c740 10 client.5985 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f70c148c740 20 client.5985 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f70c148c740 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555eade86e30 0x555eadf53980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f70c148c740 4 client.5985 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-17T03:35:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f70c148c740 1 -- 172.21.15.146:0/2075984801 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x555eaddfc920 con 0x555eade86e30 2024-09-17T03:35:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.653+0000 7f70b3fff640 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555eade86e30 0x555eadf53980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.654+0000 7f7092ffd640 10 client.5985 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.654+0000 7f70b3fff640 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555eade86e30 0x555eadf53980 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=229ee523512fcbed server_cookie=3feae2722bc6d176 in_seq=0 out_seq=0 2024-09-17T03:35:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f7092ffd640 1 -- 172.21.15.146:0/2075984801 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555eaddfc920 con 0x555eade86e30 2024-09-17T03:35:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f7092ffd640 10 client.5985 handle_command_reply: tid=0 2024-09-17T03:35:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 1 client.5985 shutdown 2024-09-17T03:35:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 1 -- 172.21.15.146:0/2075984801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 msgr2=0x555eade8cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8cca0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f70a8011010 tx=0x7f70a8023470 comp rx=0 tx=0).stop 2024-09-17T03:35:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 1 -- 172.21.15.146:0/2075984801 shutdown_connections 2024-09-17T03:35:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555eade86e30 0x555eadf53980 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555eadae4a90 0x555eade8d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555eadac3db0 0x555eade8cca0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 1 --2- 172.21.15.146:0/2075984801 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555eadabbbd0 0x555eadf46a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 1 -- 172.21.15.146:0/2075984801 >> 172.21.15.146:0/2075984801 conn(0x555eadad8be0 msgr2=0x555eadea4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f7092ffd640 0 client.5985 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 1 -- 172.21.15.146:0/2075984801 shutdown_connections 2024-09-17T03:35:54.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 1 -- 172.21.15.146:0/2075984801 wait complete. 2024-09-17T03:35:54.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.655+0000 7f70c148c740 20 client.5985 trim_cache size 0 max 16384 2024-09-17T03:35:54.664 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:54.664 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:35:54.664 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "8c57da53-316b-417c-92f0-f4d2d8dbb831", 2024-09-17T03:35:54.664 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:35:54.665 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 -- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70a0078bc0 msgr2=0x7f70a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70a0078bc0 0x7f70a007b0d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f70b4155a70 tx=0x7f70a8001db0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 -- 172.21.15.146:0/2516284498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b40b5750 msgr2=0x7f70b41f3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b40b5750 0x7f70b41f3a40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f70a400e9f0 tx=0x7f70a400eeb0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 -- 172.21.15.146:0/2516284498 shutdown_connections 2024-09-17T03:35:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70a0078bc0 0x7f70a007b0d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70b41539d0 0x7f70b4155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70b40b5ce0 0x7f70b41f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 --2- 172.21.15.146:0/2516284498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b40b5750 0x7f70b41f3a40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 -- 172.21.15.146:0/2516284498 >> 172.21.15.146:0/2516284498 conn(0x7f70b40b7b20 msgr2=0x7f70b40b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 -- 172.21.15.146:0/2516284498 shutdown_connections 2024-09-17T03:35:54.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.656+0000 7f70ba520640 1 -- 172.21.15.146:0/2516284498 wait complete. 2024-09-17T03:35:54.668 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '8c57da53-316b-417c-92f0-f4d2d8dbb831', 'mode': 'asynchronous'}' 2024-09-17T03:35:54.668 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-17T03:35:54.668 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-17T03:35:54.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.787+0000 7fe786f33640 1 -- 172.21.15.146:0/4179652905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe768004d40 msgr2=0x7fe768005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.787+0000 7fe786f33640 1 --2- 172.21.15.146:0/4179652905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe768004d40 0x7fe768005150 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe778009b20 tx=0x7fe768005830 comp rx=0 tx=0).stop 2024-09-17T03:35:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.787+0000 7fe7854d0640 1 -- 172.21.15.146:0/4179652905 reap_dead start 2024-09-17T03:35:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.787+0000 7fe786f33640 1 -- 172.21.15.146:0/4179652905 shutdown_connections 2024-09-17T03:35:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.787+0000 7fe786f33640 1 -- 172.21.15.146:0/4179652905 >> 172.21.15.146:0/4179652905 conn(0x7fe7800d4be0 msgr2=0x7fe7800d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.787+0000 7fe786f33640 1 -- 172.21.15.146:0/4179652905 shutdown_connections 2024-09-17T03:35:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.787+0000 7fe786f33640 1 -- 172.21.15.146:0/4179652905 wait complete. 2024-09-17T03:35:54.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.789+0000 7fe786f33640 1 Processor -- start 2024-09-17T03:35:54.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.789+0000 7fe786f33640 1 -- start start 2024-09-17T03:35:54.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.790+0000 7fe786f33640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe768004d40 0x7fe7800ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.790+0000 7fe786f33640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe78015ee10 0x7fe78015f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.790+0000 7fe786f33640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7800b9210 0x7fe7800b9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.790+0000 7fe786f33640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe7800cf7e0 con 0x7fe78015ee10 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.790+0000 7fe786f33640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe7800cf660 con 0x7fe768004d40 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.790+0000 7fe786f33640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe7800d36d0 con 0x7fe7800b9210 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.790+0000 7fe777fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe78015ee10 0x7fe78015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.790+0000 7fe777fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe78015ee10 0x7fe78015f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54216/0 (socket says 172.21.15.146:54216) 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.790+0000 7fe777fff640 1 -- 172.21.15.146:0/1410240386 learned_addr learned my addr 172.21.15.146:0/1410240386 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe784ccf640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe768004d40 0x7fe7800ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe7854d0640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7800b9210 0x7fe7800b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe777fff640 1 -- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7800b9210 msgr2=0x7fe7800b9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe777fff640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7800b9210 0x7fe7800b9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe777fff640 1 -- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe768004d40 msgr2=0x7fe7800ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe777fff640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe768004d40 0x7fe7800ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe777fff640 1 -- 172.21.15.146:0/1410240386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7800b9b60 con 0x7fe78015ee10 2024-09-17T03:35:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe7854d0640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7800b9210 0x7fe7800b9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe777fff640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe78015ee10 0x7fe78015f220 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe77000e930 tx=0x7fe77000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe7757fa640 1 -- 172.21.15.146:0/1410240386 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770015070 con 0x7fe78015ee10 2024-09-17T03:35:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe7757fa640 1 -- 172.21.15.146:0/1410240386 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe77000cd40 con 0x7fe78015ee10 2024-09-17T03:35:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe786f33640 1 -- 172.21.15.146:0/1410240386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe780160310 con 0x7fe78015ee10 2024-09-17T03:35:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe7757fa640 1 -- 172.21.15.146:0/1410240386 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7700116c0 con 0x7fe78015ee10 2024-09-17T03:35:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.791+0000 7fe786f33640 1 -- 172.21.15.146:0/1410240386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7801608d0 con 0x7fe78015ee10 2024-09-17T03:35:54.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.793+0000 7fe7757fa640 1 -- 172.21.15.146:0/1410240386 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe770018070 con 0x7fe78015ee10 2024-09-17T03:35:54.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.793+0000 7fe7757fa640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe76c078b90 0x7fe76c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.794+0000 7fe7757fa640 1 -- 172.21.15.146:0/1410240386 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe77009b220 con 0x7fe78015ee10 2024-09-17T03:35:54.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.794+0000 7fe784ccf640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe76c078b90 0x7fe76c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.794+0000 7fe784ccf640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe76c078b90 0x7fe76c07b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe77c005fd0 tx=0x7fe77c009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.794+0000 7fe78de9d740 1 Processor -- start 2024-09-17T03:35:54.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.794+0000 7fe78de9d740 1 -- start start 2024-09-17T03:35:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.795+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047cb2220 0x5650480832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.795+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047c89360 0x565048083800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.795+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c91540 0x5650480a0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.795+0000 7fe78de9d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x565047fccad0 con 0x565047cb2220 2024-09-17T03:35:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.795+0000 7fe78de9d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x565047fbbf00 con 0x565047c89360 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.795+0000 7fe78de9d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x565047fbfd10 con 0x565047c91540 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe784ccf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047cb2220 0x5650480832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe784ccf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047cb2220 0x5650480832c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54226/0 (socket says 172.21.15.146:54226) 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe784ccf640 1 -- 172.21.15.146:0/4174394802 learned_addr learned my addr 172.21.15.146:0/4174394802 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe7854d0640 1 --2- 172.21.15.146:0/4174394802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c91540 0x5650480a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe777fff640 1 --2- 172.21.15.146:0/4174394802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047c89360 0x565048083800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe784ccf640 1 -- 172.21.15.146:0/4174394802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c91540 msgr2=0x5650480a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe784ccf640 1 --2- 172.21.15.146:0/4174394802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c91540 0x5650480a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe784ccf640 1 -- 172.21.15.146:0/4174394802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047c89360 msgr2=0x565048083800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe784ccf640 1 --2- 172.21.15.146:0/4174394802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047c89360 0x565048083800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe784ccf640 1 -- 172.21.15.146:0/4174394802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565047cae280 con 0x565047cb2220 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe777fff640 1 --2- 172.21.15.146:0/4174394802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047c89360 0x565048083800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe784ccf640 1 --2- 172.21.15.146:0/4174394802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047cb2220 0x5650480832c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe77c01d7b0 tx=0x7fe77c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848be108e498b975 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe7667fc640 1 -- 172.21.15.146:0/4174394802 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c01de60 con 0x565047cb2220 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe7667fc640 1 -- 172.21.15.146:0/4174394802 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe77c01d020 con 0x565047cb2220 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.796+0000 7fe7667fc640 1 -- 172.21.15.146:0/4174394802 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c01d1f0 con 0x565047cb2220 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.797+0000 7fe78de9d740 1 -- 172.21.15.146:0/4174394802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047cb2220 msgr2=0x5650480832c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.797+0000 7fe78de9d740 1 --2- 172.21.15.146:0/4174394802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047cb2220 0x5650480832c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe77c01d7b0 tx=0x7fe77c016000 comp rx=0 tx=0).stop 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.797+0000 7fe78de9d740 1 -- 172.21.15.146:0/4174394802 shutdown_connections 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.797+0000 7fe78de9d740 1 --2- 172.21.15.146:0/4174394802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c91540 0x5650480a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.797+0000 7fe78de9d740 1 --2- 172.21.15.146:0/4174394802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047c89360 0x565048083800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.797+0000 7fe78de9d740 1 --2- 172.21.15.146:0/4174394802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047cb2220 0x5650480832c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.797+0000 7fe78de9d740 1 -- 172.21.15.146:0/4174394802 >> 172.21.15.146:0/4174394802 conn(0x565047ca6370 msgr2=0x565048059580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.797+0000 7fe78de9d740 1 -- 172.21.15.146:0/4174394802 shutdown_connections 2024-09-17T03:35:54.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.797+0000 7fe78de9d740 1 -- 172.21.15.146:0/4174394802 wait complete. 2024-09-17T03:35:54.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.798+0000 7fe78de9d740 1 -- start start 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.798+0000 7fe78de9d740 1 Processor -- start 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.799+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c89360 0x565048096440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.799+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c91540 0x565048094090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.799+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047cb2220 0x5650480b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.799+0000 7fe78de9d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x565047d2c5d0 con 0x565047c89360 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.799+0000 7fe78de9d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x565047f61460 con 0x565047cb2220 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.799+0000 7fe78de9d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x565048083d40 con 0x565047c91540 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe78de9d740 10 client.0 _ll_register_callbacks cb 0x565047f70b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe784ccf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c89360 0x565048096440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe784ccf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c89360 0x565048096440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54234/0 (socket says 172.21.15.146:54234) 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe784ccf640 1 -- 172.21.15.146:0/145311568 learned_addr learned my addr 172.21.15.146:0/145311568 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe777fff640 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c91540 0x565048094090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe7854d0640 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047cb2220 0x5650480b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe784ccf640 1 -- 172.21.15.146:0/145311568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c91540 msgr2=0x565048094090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe784ccf640 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c91540 0x565048094090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe784ccf640 1 -- 172.21.15.146:0/145311568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047cb2220 msgr2=0x5650480b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe784ccf640 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047cb2220 0x5650480b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe784ccf640 1 -- 172.21.15.146:0/145311568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565047d96690 con 0x565047c89360 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe784ccf640 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c89360 0x565048096440 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe77c018040 tx=0x7fe77c01ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e39bbb3c7bec548 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe75f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe75f7fe640 1 -- 172.21.15.146:0/145311568 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c037020 con 0x565047c89360 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe75f7fe640 1 -- 172.21.15.146:0/145311568 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe77c028760 con 0x565047c89360 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe78de9d740 1 -- 172.21.15.146:0/145311568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe77c01d020 con 0x565047c89360 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.800+0000 7fe75f7fe640 1 -- 172.21.15.146:0/145311568 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe77c041050 con 0x565047c89360 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe78de9d740 10 client.5997 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe78de9d740 1 -- 172.21.15.146:0/145311568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x565047df6e20 con 0x565047c89360 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe75f7fe640 1 -- 172.21.15.146:0/145311568 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe77c01d020 con 0x565047c89360 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe75f7fe640 1 -- 172.21.15.146:0/145311568 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fe77c044020 con 0x565047c89360 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe78de9d740 10 client.5997 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe78de9d740 10 client.5997 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe78de9d740 20 client.5997 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe78de9d740 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x565047c71000 0x565048071d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe78de9d740 4 client.5997 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe78de9d740 1 -- 172.21.15.146:0/145311568 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565047fcea20 con 0x565047c71000 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe777fff640 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x565047c71000 0x565048071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe75f7fe640 10 client.5997 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.801+0000 7fe777fff640 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x565047c71000 0x565048071d70 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=682478e8c46e305 server_cookie=df1befd749d21023 in_seq=0 out_seq=0 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe75f7fe640 1 -- 172.21.15.146:0/145311568 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565047fcea20 con 0x565047c71000 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe75f7fe640 10 client.5997 handle_command_reply: tid=0 2024-09-17T03:35:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe78de9d740 1 client.5997 shutdown 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe78de9d740 1 -- 172.21.15.146:0/145311568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c89360 msgr2=0x565048096440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe78de9d740 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c89360 0x565048096440 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe77c018040 tx=0x7fe77c01ded0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe78de9d740 1 -- 172.21.15.146:0/145311568 shutdown_connections 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe78de9d740 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x565047c71000 0x565048071d70 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe78de9d740 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047cb2220 0x5650480b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe78de9d740 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c91540 0x565048094090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe75f7fe640 0 client.5997 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe78de9d740 1 --2- 172.21.15.146:0/145311568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c89360 0x565048096440 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe78de9d740 1 -- 172.21.15.146:0/145311568 >> 172.21.15.146:0/145311568 conn(0x565047ca6370 msgr2=0x56504809fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe78de9d740 1 -- 172.21.15.146:0/145311568 shutdown_connections 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.802+0000 7fe78de9d740 1 -- 172.21.15.146:0/145311568 wait complete. 2024-09-17T03:35:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.803+0000 7fe78de9d740 20 client.5997 trim_cache size 0 max 16384 2024-09-17T03:35:54.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.820+0000 7fe78de9d740 1 Processor -- start 2024-09-17T03:35:54.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.820+0000 7fe78de9d740 1 -- start start 2024-09-17T03:35:54.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.821+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047c89360 0x5650480998a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.821+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x565048093a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.821+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047cb2220 0x565048093f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.821+0000 7fe78de9d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe780202410 con 0x565047c91540 2024-09-17T03:35:54.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.821+0000 7fe78de9d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe780201470 con 0x565047c89360 2024-09-17T03:35:54.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.821+0000 7fe78de9d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe7801f9470 con 0x565047cb2220 2024-09-17T03:35:54.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe777fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x565048093a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe777fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x565048093a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54238/0 (socket says 172.21.15.146:54238) 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe777fff640 1 -- 172.21.15.146:0/2834073258 learned_addr learned my addr 172.21.15.146:0/2834073258 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe7854d0640 1 --2- 172.21.15.146:0/2834073258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047cb2220 0x565048093f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe777fff640 1 -- 172.21.15.146:0/2834073258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047cb2220 msgr2=0x565048093f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe777fff640 1 --2- 172.21.15.146:0/2834073258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047cb2220 0x565048093f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe777fff640 1 -- 172.21.15.146:0/2834073258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047c89360 msgr2=0x5650480998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe784ccf640 1 --2- 172.21.15.146:0/2834073258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047c89360 0x5650480998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe777fff640 1 --2- 172.21.15.146:0/2834073258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047c89360 0x5650480998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe777fff640 1 -- 172.21.15.146:0/2834073258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565047cfb530 con 0x565047c91540 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe777fff640 1 --2- 172.21.15.146:0/2834073258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x565048093a40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe770001eb0 tx=0x7fe77009b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997e86959d74125a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe765ffb640 1 -- 172.21.15.146:0/2834073258 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77004e030 con 0x565047c91540 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe765ffb640 1 -- 172.21.15.146:0/2834073258 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe770067b20 con 0x565047c91540 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.822+0000 7fe765ffb640 1 -- 172.21.15.146:0/2834073258 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77001f040 con 0x565047c91540 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.823+0000 7fe78de9d740 1 -- 172.21.15.146:0/2834073258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 msgr2=0x565048093a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.823+0000 7fe78de9d740 1 --2- 172.21.15.146:0/2834073258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x565048093a40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe770001eb0 tx=0x7fe77009b040 comp rx=0 tx=0).stop 2024-09-17T03:35:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.823+0000 7fe78de9d740 1 -- 172.21.15.146:0/2834073258 shutdown_connections 2024-09-17T03:35:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.823+0000 7fe78de9d740 1 --2- 172.21.15.146:0/2834073258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047cb2220 0x565048093f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.823+0000 7fe78de9d740 1 --2- 172.21.15.146:0/2834073258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x565048093a40 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.823+0000 7fe78de9d740 1 --2- 172.21.15.146:0/2834073258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047c89360 0x5650480998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.823+0000 7fe78de9d740 1 -- 172.21.15.146:0/2834073258 >> 172.21.15.146:0/2834073258 conn(0x565047ca6370 msgr2=0x56504804f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.823+0000 7fe78de9d740 1 -- 172.21.15.146:0/2834073258 shutdown_connections 2024-09-17T03:35:54.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.823+0000 7fe78de9d740 1 -- 172.21.15.146:0/2834073258 wait complete. 2024-09-17T03:35:54.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.824+0000 7fe78de9d740 1 -- start start 2024-09-17T03:35:54.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.824+0000 7fe78de9d740 1 Processor -- start 2024-09-17T03:35:54.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.825+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c89360 0x5650481139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.825+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x5650481204b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.825+0000 7fe78de9d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047cb2220 0x565048083400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.825+0000 7fe78de9d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe780200e50 con 0x565047c91540 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.825+0000 7fe78de9d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x565048120d00 con 0x565047cb2220 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.825+0000 7fe78de9d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5650480c1a50 con 0x565047c89360 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.825+0000 7fe78de9d740 10 client.0 _ll_register_callbacks cb 0x7fe778036070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.825+0000 7fe777fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x5650481204b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.825+0000 7fe777fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x5650481204b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54252/0 (socket says 172.21.15.146:54252) 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.825+0000 7fe777fff640 1 -- 172.21.15.146:0/1458923756 learned_addr learned my addr 172.21.15.146:0/1458923756 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe784ccf640 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c89360 0x5650481139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe7854d0640 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047cb2220 0x565048083400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe777fff640 1 -- 172.21.15.146:0/1458923756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c89360 msgr2=0x5650481139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe777fff640 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c89360 0x5650481139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe777fff640 1 -- 172.21.15.146:0/1458923756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047cb2220 msgr2=0x565048083400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe777fff640 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047cb2220 0x565048083400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe777fff640 1 -- 172.21.15.146:0/1458923756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565048053c60 con 0x565047c91540 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe777fff640 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x5650481204b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe77000c630 tx=0x7fe770063270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec81c8e4c78a1b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe75f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe75f7fe640 1 -- 172.21.15.146:0/1458923756 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77001f030 con 0x565047c91540 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe75f7fe640 1 -- 172.21.15.146:0/1458923756 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe770099b30 con 0x565047c91540 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe78de9d740 1 -- 172.21.15.146:0/1458923756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe770067b20 con 0x565047c91540 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe75f7fe640 1 -- 172.21.15.146:0/1458923756 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe77004e070 con 0x565047c91540 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe78de9d740 10 client.6003 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe78de9d740 1 -- 172.21.15.146:0/1458923756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5650480958d0 con 0x565047c91540 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe75f7fe640 1 -- 172.21.15.146:0/1458923756 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe770067b20 con 0x565047c91540 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.826+0000 7fe75f7fe640 1 -- 172.21.15.146:0/1458923756 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fe77007d040 con 0x565047c91540 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.827+0000 7fe78de9d740 10 client.6003 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.827+0000 7fe78de9d740 10 client.6003 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:54.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.827+0000 7fe78de9d740 20 client.6003 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.827+0000 7fe78de9d740 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x565048083940 0x5650480b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.827+0000 7fe78de9d740 4 client.6003 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.827+0000 7fe78de9d740 1 -- 172.21.15.146:0/1458923756 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x565047fca4d0 con 0x565048083940 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.827+0000 7fe784ccf640 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x565048083940 0x5650480b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.827+0000 7fe75f7fe640 10 client.6003 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.827+0000 7fe784ccf640 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x565048083940 0x5650480b0690 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69d94eff4c3f0787 server_cookie=330b13066bf08b09 in_seq=0 out_seq=0 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe75f7fe640 1 -- 172.21.15.146:0/1458923756 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x565047fca4d0 con 0x565048083940 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe75f7fe640 10 client.6003 handle_command_reply: tid=0 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 1 client.6003 shutdown 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 1 -- 172.21.15.146:0/1458923756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 msgr2=0x5650481204b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x5650481204b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe77000c630 tx=0x7fe770063270 comp rx=0 tx=0).stop 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 1 -- 172.21.15.146:0/1458923756 shutdown_connections 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x565048083940 0x5650480b0690 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565047cb2220 0x565048083400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565047c91540 0x5650481204b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe75f7fe640 0 client.6003 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:54.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 1 --2- 172.21.15.146:0/1458923756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565047c89360 0x5650481139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 1 -- 172.21.15.146:0/1458923756 >> 172.21.15.146:0/1458923756 conn(0x565047ca6370 msgr2=0x565048093a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 1 -- 172.21.15.146:0/1458923756 shutdown_connections 2024-09-17T03:35:54.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 1 -- 172.21.15.146:0/1458923756 wait complete. 2024-09-17T03:35:54.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.828+0000 7fe78de9d740 20 client.6003 trim_cache size 0 max 16384 2024-09-17T03:35:54.832 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:54.832 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:35:54.833 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "d30771c4-5098-4b0b-8120-122396d8fc4a", 2024-09-17T03:35:54.833 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:35:54.833 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:54.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 -- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe76c078b90 msgr2=0x7fe76c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe76c078b90 0x7fe76c07b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe77c005fd0 tx=0x7fe77c009500 comp rx=0 tx=0).stop 2024-09-17T03:35:54.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 -- 172.21.15.146:0/1410240386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe78015ee10 msgr2=0x7fe78015f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:54.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe78015ee10 0x7fe78015f220 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe77000e930 tx=0x7fe77000edf0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 -- 172.21.15.146:0/1410240386 shutdown_connections 2024-09-17T03:35:54.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe76c078b90 0x7fe76c07b0a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7800b9210 0x7fe7800b9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe78015ee10 0x7fe78015f220 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 --2- 172.21.15.146:0/1410240386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe768004d40 0x7fe7800ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:54.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 -- 172.21.15.146:0/1410240386 >> 172.21.15.146:0/1410240386 conn(0x7fe7800d4be0 msgr2=0x7fe7800ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:54.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 -- 172.21.15.146:0/1410240386 shutdown_connections 2024-09-17T03:35:54.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:54.829+0000 7fe786f33640 1 -- 172.21.15.146:0/1410240386 wait complete. 2024-09-17T03:35:54.839 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'd30771c4-5098-4b0b-8120-122396d8fc4a', 'mode': 'asynchronous'}' 2024-09-17T03:35:54.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:54.839 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-09-17T03:35:54.856 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-09-17T03:35:54.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-09-17T03:35:55.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.013+0000 7f89b15c6640 1 -- 172.21.15.146:0/1970834150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ac0b4f20 msgr2=0x7f89ac0b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.013+0000 7f89b15c6640 1 --2- 172.21.15.146:0/1970834150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ac0b4f20 0x7f89ac0b5600 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0d1250 tx=0x7f899c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:35:55.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.013+0000 7f89b15c6640 1 -- 172.21.15.146:0/1970834150 shutdown_connections 2024-09-17T03:35:55.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.013+0000 7f89b15c6640 1 --2- 172.21.15.146:0/1970834150 >> v2:172.21.15.179:3300/0 conn(0x7f89ac0b08d0 0x7f89ac0b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.013+0000 7f89b15c6640 1 --2- 172.21.15.146:0/1970834150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ac0b4f20 0x7f89ac0b5600 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.013+0000 7f89b15c6640 1 -- 172.21.15.146:0/1970834150 >> 172.21.15.146:0/1970834150 conn(0x7f89ac09ba20 msgr2=0x7f89ac0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.014+0000 7f89b15c6640 1 -- 172.21.15.146:0/1970834150 shutdown_connections 2024-09-17T03:35:55.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.014+0000 7f89b15c6640 1 -- 172.21.15.146:0/1970834150 wait complete. 2024-09-17T03:35:55.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.015+0000 7f89b15c6640 1 Processor -- start 2024-09-17T03:35:55.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.015+0000 7f89b15c6640 1 -- start start 2024-09-17T03:35:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89b15c6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89ac0b08d0 0x7f89ac147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89b15c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ac0b3250 0x7f89ac1f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89b15c6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0b4f20 0x7f89ac1f9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89b15c6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0b1430 con 0x7f89ac0b3250 2024-09-17T03:35:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89b15c6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac160b70 con 0x7f89ac0b08d0 2024-09-17T03:35:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89b15c6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac09fb10 con 0x7f89ac0b4f20 2024-09-17T03:35:55.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89aa7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ac0b3250 0x7f89ac1f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89aa7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ac0b3250 0x7f89ac1f93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54276/0 (socket says 172.21.15.146:54276) 2024-09-17T03:35:55.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89aa7fc640 1 -- 172.21.15.146:0/355168785 learned_addr learned my addr 172.21.15.146:0/355168785 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89aaffd640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89ac0b08d0 0x7f89ac147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89ab7fe640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0b4f20 0x7f89ac1f9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89aa7fc640 1 -- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0b4f20 msgr2=0x7f89ac1f9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0b4f20 0x7f89ac1f9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89aa7fc640 1 -- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89ac0b08d0 msgr2=0x7f89ac147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89ac0b08d0 0x7f89ac147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89aa7fc640 1 -- 172.21.15.146:0/355168785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac160900 con 0x7f89ac0b3250 2024-09-17T03:35:55.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.017+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ac0b3250 0x7f89ac1f93c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f89a000b3f0 tx=0x7f89a000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.018+0000 7f89937fe640 1 -- 172.21.15.146:0/355168785 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0015020 con 0x7f89ac0b3250 2024-09-17T03:35:55.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.018+0000 7f89937fe640 1 -- 172.21.15.146:0/355168785 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89a0011920 con 0x7f89ac0b3250 2024-09-17T03:35:55.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.018+0000 7f89b15c6640 1 -- 172.21.15.146:0/355168785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac160350 con 0x7f89ac0b3250 2024-09-17T03:35:55.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.018+0000 7f89937fe640 1 -- 172.21.15.146:0/355168785 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0011d50 con 0x7f89ac0b3250 2024-09-17T03:35:55.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.018+0000 7f89b15c6640 1 -- 172.21.15.146:0/355168785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ac09dfd0 con 0x7f89ac0b3250 2024-09-17T03:35:55.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.020+0000 7f89937fe640 1 -- 172.21.15.146:0/355168785 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f89a0018020 con 0x7f89ac0b3250 2024-09-17T03:35:55.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.020+0000 7f89937fe640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8998078b90 0x7f899807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.020+0000 7f89937fe640 1 -- 172.21.15.146:0/355168785 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f89a009aca0 con 0x7f89ac0b3250 2024-09-17T03:35:55.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.020+0000 7f89aaffd640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8998078b90 0x7f899807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.021+0000 7f89b8615740 1 Processor -- start 2024-09-17T03:35:55.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.021+0000 7f89aaffd640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8998078b90 0x7f899807b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f899c035000 tx=0x7f899c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.021+0000 7f89b8615740 1 -- start start 2024-09-17T03:35:55.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.022+0000 7f89b8615740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8e5750 0x56062bcd2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.022+0000 7f89b8615740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bc878d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.022+0000 7f89b8615740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8c4a70 0x56062bc87e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.022+0000 7f89b8615740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56062bbffb20 con 0x56062b8bc890 2024-09-17T03:35:55.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.022+0000 7f89b8615740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56062bbeef50 con 0x56062b8c4a70 2024-09-17T03:35:55.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.022+0000 7f89b8615740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56062bbf2d60 con 0x56062b8e5750 2024-09-17T03:35:55.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.022+0000 7f89aa7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bc878d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.022+0000 7f89aa7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bc878d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54284/0 (socket says 172.21.15.146:54284) 2024-09-17T03:35:55.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f89aa7fc640 1 -- 172.21.15.146:0/2523700944 learned_addr learned my addr 172.21.15.146:0/2523700944 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f89aaffd640 1 --2- 172.21.15.146:0/2523700944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8e5750 0x56062bcd2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f89ab7fe640 1 --2- 172.21.15.146:0/2523700944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8c4a70 0x56062bc87e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f89aa7fc640 1 -- 172.21.15.146:0/2523700944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8e5750 msgr2=0x56062bcd2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/2523700944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8e5750 0x56062bcd2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f89aa7fc640 1 -- 172.21.15.146:0/2523700944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8c4a70 msgr2=0x56062bc87e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/2523700944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8c4a70 0x56062bc87e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f89aa7fc640 1 -- 172.21.15.146:0/2523700944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56062b950d30 con 0x56062b8bc890 2024-09-17T03:35:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/2523700944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bc878d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f89a00629c0 tx=0x7f89a0062480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632c3674caa70925 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f8990ff9640 1 -- 172.21.15.146:0/2523700944 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0062a30 con 0x56062b8bc890 2024-09-17T03:35:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f8990ff9640 1 -- 172.21.15.146:0/2523700944 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89a0067510 con 0x56062b8bc890 2024-09-17T03:35:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.023+0000 7f8990ff9640 1 -- 172.21.15.146:0/2523700944 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a006c3c0 con 0x56062b8bc890 2024-09-17T03:35:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.024+0000 7f89b8615740 1 -- 172.21.15.146:0/2523700944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 msgr2=0x56062bc878d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.024+0000 7f89b8615740 1 --2- 172.21.15.146:0/2523700944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bc878d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f89a00629c0 tx=0x7f89a0062480 comp rx=0 tx=0).stop 2024-09-17T03:35:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.024+0000 7f89b8615740 1 -- 172.21.15.146:0/2523700944 shutdown_connections 2024-09-17T03:35:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.024+0000 7f89b8615740 1 --2- 172.21.15.146:0/2523700944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8c4a70 0x56062bc87e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.024+0000 7f89b8615740 1 --2- 172.21.15.146:0/2523700944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bc878d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.024+0000 7f89b8615740 1 --2- 172.21.15.146:0/2523700944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8e5750 0x56062bcd2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.024+0000 7f89b8615740 1 -- 172.21.15.146:0/2523700944 >> 172.21.15.146:0/2523700944 conn(0x56062b8d98a0 msgr2=0x56062bc8cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.024+0000 7f89b8615740 1 -- 172.21.15.146:0/2523700944 shutdown_connections 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.024+0000 7f89b8615740 1 -- 172.21.15.146:0/2523700944 wait complete. 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.025+0000 7f89b8615740 1 -- start start 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.025+0000 7f89b8615740 1 Processor -- start 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.026+0000 7f89b8615740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8bc890 0x56062bcb1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.026+0000 7f89b8615740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8c4a70 0x56062bce0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.026+0000 7f89b8615740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8e5750 0x56062bce43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.026+0000 7f89b8615740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56062b95fb00 con 0x56062b8e5750 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.026+0000 7f89b8615740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56062bb947c0 con 0x56062b8bc890 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.026+0000 7f89b8615740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56062bc9cc50 con 0x56062b8c4a70 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.026+0000 7f89b8615740 10 client.0 _ll_register_callbacks cb 0x56062bbec5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.026+0000 7f89ab7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8e5750 0x56062bce43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89ab7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8e5750 0x56062bce43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54296/0 (socket says 172.21.15.146:54296) 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89ab7fe640 1 -- 172.21.15.146:0/1343878637 learned_addr learned my addr 172.21.15.146:0/1343878637 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89aaffd640 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8bc890 0x56062bcb1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8c4a70 0x56062bce0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89ab7fe640 1 -- 172.21.15.146:0/1343878637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8c4a70 msgr2=0x56062bce0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89ab7fe640 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8c4a70 0x56062bce0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89ab7fe640 1 -- 172.21.15.146:0/1343878637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8bc890 msgr2=0x56062bcb1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89ab7fe640 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8bc890 0x56062bcb1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89ab7fe640 1 -- 172.21.15.146:0/1343878637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56062b9c7b90 con 0x56062b8e5750 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89ab7fe640 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8e5750 0x56062bce43f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f89a40116f0 tx=0x7f89a4011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c744bad7c5e919 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f8989ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f8989ffb640 1 -- 172.21.15.146:0/1343878637 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a401e060 con 0x56062b8e5750 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f8989ffb640 1 -- 172.21.15.146:0/1343878637 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f89a400fbb0 con 0x56062b8e5750 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89b8615740 1 -- 172.21.15.146:0/1343878637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89a0067510 con 0x56062b8e5750 2024-09-17T03:35:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f8989ffb640 1 -- 172.21.15.146:0/1343878637 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f89a4024050 con 0x56062b8e5750 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89b8615740 10 client.6015 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f89b8615740 1 -- 172.21.15.146:0/1343878637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x56062bcc94d0 con 0x56062b8e5750 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.027+0000 7f8989ffb640 1 -- 172.21.15.146:0/1343878637 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89a0067510 con 0x56062b8e5750 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.028+0000 7f8989ffb640 1 -- 172.21.15.146:0/1343878637 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f89a4027020 con 0x56062b8e5750 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.028+0000 7f89b8615740 10 client.6015 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.028+0000 7f89b8615740 10 client.6015 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.028+0000 7f89b8615740 20 client.6015 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.028+0000 7f89b8615740 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x56062b8a4320 0x56062bc9ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.028+0000 7f89b8615740 4 client.6015 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.028+0000 7f89b8615740 1 -- 172.21.15.146:0/1343878637 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56062bc01a70 con 0x56062b8a4320 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.028+0000 7f89aaffd640 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x56062b8a4320 0x56062bc9ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.028+0000 7f8989ffb640 10 client.6015 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.028+0000 7f89aaffd640 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x56062b8a4320 0x56062bc9ef70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c927d899895e87b2 server_cookie=93db3bd16cfde244 in_seq=0 out_seq=0 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f8989ffb640 1 -- 172.21.15.146:0/1343878637 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56062bc01a70 con 0x56062b8a4320 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f8989ffb640 10 client.6015 handle_command_reply: tid=0 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 1 client.6015 shutdown 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 1 -- 172.21.15.146:0/1343878637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8e5750 msgr2=0x56062bce43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8e5750 0x56062bce43f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f89a40116f0 tx=0x7f89a4011bb0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 1 -- 172.21.15.146:0/1343878637 shutdown_connections 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x56062b8a4320 0x56062bc9ef70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8e5750 0x56062bce43f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8c4a70 0x56062bce0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f8989ffb640 0 client.6015 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 1 --2- 172.21.15.146:0/1343878637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8bc890 0x56062bcb1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 1 -- 172.21.15.146:0/1343878637 >> 172.21.15.146:0/1343878637 conn(0x56062b8d98a0 msgr2=0x56062bc878d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 1 -- 172.21.15.146:0/1343878637 shutdown_connections 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 1 -- 172.21.15.146:0/1343878637 wait complete. 2024-09-17T03:35:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.029+0000 7f89b8615740 20 client.6015 trim_cache size 0 max 16384 2024-09-17T03:35:55.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.044+0000 7f89b8615740 1 Processor -- start 2024-09-17T03:35:55.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.044+0000 7f89b8615740 1 -- start start 2024-09-17T03:35:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.045+0000 7f89b8615740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bcf4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.045+0000 7f89b8615740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8c4a70 0x56062bcd24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.045+0000 7f89b8615740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 0x56062bcd29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89b8615740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac202230 con 0x56062b8bc890 2024-09-17T03:35:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89b8615740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac09f470 con 0x56062b8e5750 2024-09-17T03:35:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89b8615740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac09e7d0 con 0x56062b8c4a70 2024-09-17T03:35:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89aaffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bcf4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89aaffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bcf4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54312/0 (socket says 172.21.15.146:54312) 2024-09-17T03:35:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89aaffd640 1 -- 172.21.15.146:0/3652782078 learned_addr learned my addr 172.21.15.146:0/3652782078 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/3652782078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8c4a70 0x56062bcd24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89ab7fe640 1 --2- 172.21.15.146:0/3652782078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 0x56062bcd29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89aaffd640 1 -- 172.21.15.146:0/3652782078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8c4a70 msgr2=0x56062bcd24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89aaffd640 1 --2- 172.21.15.146:0/3652782078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8c4a70 0x56062bcd24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89aaffd640 1 -- 172.21.15.146:0/3652782078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 msgr2=0x56062bcd29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89aaffd640 1 --2- 172.21.15.146:0/3652782078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 0x56062bcd29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89aaffd640 1 -- 172.21.15.146:0/3652782078 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56062bc8a550 con 0x56062b8bc890 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/3652782078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8c4a70 0x56062bcd24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89ab7fe640 1 --2- 172.21.15.146:0/3652782078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 0x56062bcd29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f89aaffd640 1 --2- 172.21.15.146:0/3652782078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bcf4df0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d60 tx=0x7f899c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497db649929f9fba server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f898bfff640 1 -- 172.21.15.146:0/3652782078 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c054070 con 0x56062b8bc890 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f898bfff640 1 -- 172.21.15.146:0/3652782078 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f899c003dc0 con 0x56062b8bc890 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.046+0000 7f898bfff640 1 -- 172.21.15.146:0/3652782078 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c004770 con 0x56062b8bc890 2024-09-17T03:35:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.047+0000 7f89b8615740 1 -- 172.21.15.146:0/3652782078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 msgr2=0x56062bcf4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.047+0000 7f89b8615740 1 --2- 172.21.15.146:0/3652782078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bcf4df0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d60 tx=0x7f899c03e000 comp rx=0 tx=0).stop 2024-09-17T03:35:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.047+0000 7f89b8615740 1 -- 172.21.15.146:0/3652782078 shutdown_connections 2024-09-17T03:35:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.047+0000 7f89b8615740 1 --2- 172.21.15.146:0/3652782078 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 0x56062bcd29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.047+0000 7f89b8615740 1 --2- 172.21.15.146:0/3652782078 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8c4a70 0x56062bcd24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.047+0000 7f89b8615740 1 --2- 172.21.15.146:0/3652782078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8bc890 0x56062bcf4df0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.047+0000 7f89b8615740 1 -- 172.21.15.146:0/3652782078 >> 172.21.15.146:0/3652782078 conn(0x56062b8d98a0 msgr2=0x56062bcd3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.047+0000 7f89b8615740 1 -- 172.21.15.146:0/3652782078 shutdown_connections 2024-09-17T03:35:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.047+0000 7f89b8615740 1 -- 172.21.15.146:0/3652782078 wait complete. 2024-09-17T03:35:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.048+0000 7f89b8615740 1 -- start start 2024-09-17T03:35:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.048+0000 7f89b8615740 1 Processor -- start 2024-09-17T03:35:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89b8615740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8bc890 0x56062bcb1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89b8615740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8c4a70 0x56062bcd24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89b8615740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 0x56062bcd29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89b8615740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac09ee20 con 0x56062b8c4a70 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89b8615740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56062bd51de0 con 0x56062b8e5750 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89b8615740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56062bc9d560 con 0x56062b8bc890 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89b8615740 10 client.0 _ll_register_callbacks cb 0x7f89a400c590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89aa7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8c4a70 0x56062bcd24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89aa7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8c4a70 0x56062bcd24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54318/0 (socket says 172.21.15.146:54318) 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89aa7fc640 1 -- 172.21.15.146:0/4102961684 learned_addr learned my addr 172.21.15.146:0/4102961684 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89aaffd640 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8bc890 0x56062bcb1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.049+0000 7f89ab7fe640 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 0x56062bcd29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89aa7fc640 1 -- 172.21.15.146:0/4102961684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8bc890 msgr2=0x56062bcb1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8bc890 0x56062bcb1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89aa7fc640 1 -- 172.21.15.146:0/4102961684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 msgr2=0x56062bcd29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 0x56062bcd29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89aa7fc640 1 -- 172.21.15.146:0/4102961684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56062bcb19a0 con 0x56062b8c4a70 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89ab7fe640 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 0x56062bcd29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89aa7fc640 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8c4a70 0x56062bcd24b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f89a0062730 tx=0x7f89a005ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd96d51a3cc590a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f8989ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f8989ffb640 1 -- 172.21.15.146:0/4102961684 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0078d50 con 0x56062b8c4a70 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f8989ffb640 1 -- 172.21.15.146:0/4102961684 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f89a0061c90 con 0x56062b8c4a70 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89b8615740 1 -- 172.21.15.146:0/4102961684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f899c003dc0 con 0x56062b8c4a70 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f8989ffb640 1 -- 172.21.15.146:0/4102961684 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f89a0073050 con 0x56062b8c4a70 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89b8615740 10 client.6021 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89b8615740 1 -- 172.21.15.146:0/4102961684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x56062bc87560 con 0x56062b8c4a70 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f8989ffb640 1 -- 172.21.15.146:0/4102961684 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f899c003dc0 con 0x56062b8c4a70 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f8989ffb640 1 -- 172.21.15.146:0/4102961684 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f89a0076020 con 0x56062b8c4a70 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89b8615740 10 client.6021 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89b8615740 10 client.6021 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89b8615740 20 client.6021 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89b8615740 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x56062bcdf4e0 0x56062bcdf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89b8615740 4 client.6021 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}] 2024-09-17T03:35:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89b8615740 1 -- 172.21.15.146:0/4102961684 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}) -- 0x56062bbfd520 con 0x56062bcdf4e0 2024-09-17T03:35:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.050+0000 7f89aaffd640 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x56062bcdf4e0 0x56062bcdf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.051+0000 7f8989ffb640 10 client.6021 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.051+0000 7f89aaffd640 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x56062bcdf4e0 0x56062bcdf8f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4f255d6cfff6e2 server_cookie=36046b84e04cde27 in_seq=0 out_seq=0 2024-09-17T03:35:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.055+0000 7f8989ffb640 1 -- 172.21.15.146:0/4102961684 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56062bbfd520 con 0x56062bcdf4e0 2024-09-17T03:35:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.055+0000 7f8989ffb640 10 client.6021 handle_command_reply: tid=0 2024-09-17T03:35:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 1 client.6021 shutdown 2024-09-17T03:35:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 1 -- 172.21.15.146:0/4102961684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8c4a70 msgr2=0x56062bcd24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8c4a70 0x56062bcd24b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f89a0062730 tx=0x7f89a005ef30 comp rx=0 tx=0).stop 2024-09-17T03:35:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 1 -- 172.21.15.146:0/4102961684 shutdown_connections 2024-09-17T03:35:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x56062bcdf4e0 0x56062bcdf8f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56062b8e5750 0x56062bcd29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56062b8c4a70 0x56062bcd24b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f8989ffb640 0 client.6021 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 1 --2- 172.21.15.146:0/4102961684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56062b8bc890 0x56062bcb1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 1 -- 172.21.15.146:0/4102961684 >> 172.21.15.146:0/4102961684 conn(0x56062b8d98a0 msgr2=0x56062bc87d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 1 -- 172.21.15.146:0/4102961684 shutdown_connections 2024-09-17T03:35:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 1 -- 172.21.15.146:0/4102961684 wait complete. 2024-09-17T03:35:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b8615740 20 client.6021 trim_cache size 0 max 16384 2024-09-17T03:35:55.056 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:55.057 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:35:55.057 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:35:55.057 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b15c6640 1 -- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8998078b90 msgr2=0x7f899807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b15c6640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8998078b90 0x7f899807b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f899c035000 tx=0x7f899c004ab0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b15c6640 1 -- 172.21.15.146:0/355168785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ac0b3250 msgr2=0x7f89ac1f93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b15c6640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ac0b3250 0x7f89ac1f93c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f89a000b3f0 tx=0x7f89a000b8b0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b15c6640 1 -- 172.21.15.146:0/355168785 shutdown_connections 2024-09-17T03:35:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b15c6640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8998078b90 0x7f899807b0a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b15c6640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89ac0b4f20 0x7f89ac1f9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b15c6640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89ac0b3250 0x7f89ac1f93c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b15c6640 1 --2- 172.21.15.146:0/355168785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89ac0b08d0 0x7f89ac147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.056+0000 7f89b15c6640 1 -- 172.21.15.146:0/355168785 >> 172.21.15.146:0/355168785 conn(0x7f89ac09ba20 msgr2=0x7f89ac070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.057+0000 7f89b15c6640 1 -- 172.21.15.146:0/355168785 shutdown_connections 2024-09-17T03:35:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.057+0000 7f89b15c6640 1 -- 172.21.15.146:0/355168785 wait complete. 2024-09-17T03:35:55.066 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' returned '{'message': '', 'return_code': 0}' 2024-09-17T03:35:55.066 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:35:55.066 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:35:55.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:35:55.082 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T03:35:55.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:35:55.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:35:55.146 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066309 s, 158 MB/s 2024-09-17T03:35:55.146 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-17T03:35:55.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-17T03:35:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.302+0000 7f294efc6640 1 -- 172.21.15.146:0/3008173817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948073480 msgr2=0x7f2948073890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.302+0000 7f294efc6640 1 --2- 172.21.15.146:0/3008173817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948073480 0x7f2948073890 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2940005fd0 tx=0x7f294002a8a0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.302+0000 7f294efc6640 1 -- 172.21.15.146:0/3008173817 shutdown_connections 2024-09-17T03:35:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.302+0000 7f294efc6640 1 --2- 172.21.15.146:0/3008173817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948073480 0x7f2948073890 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.302+0000 7f294efc6640 1 --2- 172.21.15.146:0/3008173817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2948160c00 0x7f294815d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.302+0000 7f294efc6640 1 -- 172.21.15.146:0/3008173817 >> 172.21.15.146:0/3008173817 conn(0x7f29480b2060 msgr2=0x7f29480b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.302+0000 7f294efc6640 1 -- 172.21.15.146:0/3008173817 shutdown_connections 2024-09-17T03:35:55.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.302+0000 7f294efc6640 1 -- 172.21.15.146:0/3008173817 wait complete. 2024-09-17T03:35:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.304+0000 7f294efc6640 1 Processor -- start 2024-09-17T03:35:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.304+0000 7f294efc6640 1 -- start start 2024-09-17T03:35:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.305+0000 7f294efc6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948073480 0x7f294815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.305+0000 7f294efc6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2948153a60 0x7f294815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.305+0000 7f294efc6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f294815f7a0 0x7f2948148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.305+0000 7f294efc6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2948073f50 con 0x7f2948073480 2024-09-17T03:35:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.305+0000 7f294efc6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2948073dd0 con 0x7f2948153a60 2024-09-17T03:35:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.305+0000 7f294efc6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f29480740d0 con 0x7f294815f7a0 2024-09-17T03:35:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.305+0000 7f294cd62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948073480 0x7f294815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.305+0000 7f294cd62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948073480 0x7f294815b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54344/0 (socket says 172.21.15.146:54344) 2024-09-17T03:35:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.305+0000 7f294cd62640 1 -- 172.21.15.146:0/3606303634 learned_addr learned my addr 172.21.15.146:0/3606303634 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f294d563640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f294815f7a0 0x7f2948148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f293ffff640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2948153a60 0x7f294815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f294cd62640 1 -- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f294815f7a0 msgr2=0x7f2948148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f294cd62640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f294815f7a0 0x7f2948148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f294cd62640 1 -- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2948153a60 msgr2=0x7f294815f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f294cd62640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2948153a60 0x7f294815f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f294cd62640 1 -- 172.21.15.146:0/3606303634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294815bfb0 con 0x7f2948073480 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f294d563640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f294815f7a0 0x7f2948148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f294cd62640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948073480 0x7f294815b3a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f294400c3f0 tx=0x7f294400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f293d7fa640 1 -- 172.21.15.146:0/3606303634 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944017070 con 0x7f2948073480 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f293d7fa640 1 -- 172.21.15.146:0/3606303634 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29440035f0 con 0x7f2948073480 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f294efc6640 1 -- 172.21.15.146:0/3606303634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29481f5740 con 0x7f2948073480 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f293d7fa640 1 -- 172.21.15.146:0/3606303634 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944003a40 con 0x7f2948073480 2024-09-17T03:35:55.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.306+0000 7f294efc6640 1 -- 172.21.15.146:0/3606303634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29481f5d00 con 0x7f2948073480 2024-09-17T03:35:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.308+0000 7f293d7fa640 1 -- 172.21.15.146:0/3606303634 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f294401a070 con 0x7f2948073480 2024-09-17T03:35:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.308+0000 7f293d7fa640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2934078b90 0x7f293407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.308+0000 7f293d7fa640 1 -- 172.21.15.146:0/3606303634 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f294409a060 con 0x7f2948073480 2024-09-17T03:35:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.309+0000 7f293ffff640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2934078b90 0x7f293407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.309+0000 7f293ffff640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2934078b90 0x7f293407b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f294815c7e0 tx=0x7f2938005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.309+0000 7f2956018740 1 Processor -- start 2024-09-17T03:35:55.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.310+0000 7f2956018740 1 -- start start 2024-09-17T03:35:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f2956018740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d956c750 0x5632d9959a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f2956018740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d9543890 0x5632d990e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f2956018740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d954ba70 0x5632d990ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f2956018740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5632d9886b20 con 0x5632d956c750 2024-09-17T03:35:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f2956018740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5632d9875f50 con 0x5632d954ba70 2024-09-17T03:35:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f2956018740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5632d9879d60 con 0x5632d9543890 2024-09-17T03:35:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f294cd62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d956c750 0x5632d9959a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f294cd62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d956c750 0x5632d9959a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54358/0 (socket says 172.21.15.146:54358) 2024-09-17T03:35:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f294cd62640 1 -- 172.21.15.146:0/637950354 learned_addr learned my addr 172.21.15.146:0/637950354 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f294d563640 1 --2- 172.21.15.146:0/637950354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d954ba70 0x5632d990ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f293ffff640 1 --2- 172.21.15.146:0/637950354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d9543890 0x5632d990e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f294cd62640 1 -- 172.21.15.146:0/637950354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d9543890 msgr2=0x5632d990e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f294cd62640 1 --2- 172.21.15.146:0/637950354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d9543890 0x5632d990e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f294cd62640 1 -- 172.21.15.146:0/637950354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d954ba70 msgr2=0x5632d990ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f294cd62640 1 --2- 172.21.15.146:0/637950354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d954ba70 0x5632d990ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f294cd62640 1 -- 172.21.15.146:0/637950354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d95d7d30 con 0x5632d956c750 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f294cd62640 1 --2- 172.21.15.146:0/637950354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d956c750 0x5632d9959a60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2944098490 tx=0x7f294405dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77f82c1eac86f34 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f292e7fc640 1 -- 172.21.15.146:0/637950354 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944061d60 con 0x5632d956c750 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f292e7fc640 1 -- 172.21.15.146:0/637950354 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2944066840 con 0x5632d956c750 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.311+0000 7f292e7fc640 1 -- 172.21.15.146:0/637950354 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294406b550 con 0x5632d956c750 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.312+0000 7f2956018740 1 -- 172.21.15.146:0/637950354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d956c750 msgr2=0x5632d9959a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.312+0000 7f2956018740 1 --2- 172.21.15.146:0/637950354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d956c750 0x5632d9959a60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2944098490 tx=0x7f294405dd30 comp rx=0 tx=0).stop 2024-09-17T03:35:55.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.312+0000 7f2956018740 1 -- 172.21.15.146:0/637950354 shutdown_connections 2024-09-17T03:35:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.312+0000 7f2956018740 1 --2- 172.21.15.146:0/637950354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d954ba70 0x5632d990ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.312+0000 7f2956018740 1 --2- 172.21.15.146:0/637950354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d9543890 0x5632d990e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.312+0000 7f2956018740 1 --2- 172.21.15.146:0/637950354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d956c750 0x5632d9959a60 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.312+0000 7f2956018740 1 -- 172.21.15.146:0/637950354 >> 172.21.15.146:0/637950354 conn(0x5632d95608a0 msgr2=0x5632d9913d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.312+0000 7f2956018740 1 -- 172.21.15.146:0/637950354 shutdown_connections 2024-09-17T03:35:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.312+0000 7f2956018740 1 -- 172.21.15.146:0/637950354 wait complete. 2024-09-17T03:35:55.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.313+0000 7f2956018740 1 -- start start 2024-09-17T03:35:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.313+0000 7f2956018740 1 Processor -- start 2024-09-17T03:35:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f2956018740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d994e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f2956018740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d954ba70 0x5632d993a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f2956018740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d996b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f2956018740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5632d95e6b00 con 0x5632d9543890 2024-09-17T03:35:55.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f2956018740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5632d981b7c0 con 0x5632d956c750 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f2956018740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5632d99254a0 con 0x5632d954ba70 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f2956018740 10 client.0 _ll_register_callbacks cb 0x5632d98735e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f294cd62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d994e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f294cd62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d994e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54366/0 (socket says 172.21.15.146:54366) 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f294cd62640 1 -- 172.21.15.146:0/3246543313 learned_addr learned my addr 172.21.15.146:0/3246543313 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f294d563640 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d996b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f293ffff640 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d954ba70 0x5632d993a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f294cd62640 1 -- 172.21.15.146:0/3246543313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d954ba70 msgr2=0x5632d993a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f294cd62640 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d954ba70 0x5632d993a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f294cd62640 1 -- 172.21.15.146:0/3246543313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 msgr2=0x5632d996b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f294cd62640 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d996b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f294cd62640 1 -- 172.21.15.146:0/3246543313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632d964eb90 con 0x5632d9543890 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.315+0000 7f293ffff640 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d954ba70 0x5632d993a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f294cd62640 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d994e790 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f29440985a0 tx=0x7f294406b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31543509597be725 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f29277fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f29277fe640 1 -- 172.21.15.146:0/3246543313 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944069dc0 con 0x5632d9543890 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f29277fe640 1 -- 172.21.15.146:0/3246543313 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f2944060fc0 con 0x5632d9543890 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f2956018740 1 -- 172.21.15.146:0/3246543313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2944066840 con 0x5632d9543890 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f29277fe640 1 -- 172.21.15.146:0/3246543313 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f294406b780 con 0x5632d9543890 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f2956018740 10 client.6036 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f2956018740 1 -- 172.21.15.146:0/3246543313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5632d99522b0 con 0x5632d9543890 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f29277fe640 1 -- 172.21.15.146:0/3246543313 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2944066840 con 0x5632d9543890 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f29277fe640 1 -- 172.21.15.146:0/3246543313 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f294405d6b0 con 0x5632d9543890 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f2956018740 10 client.6036 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f2956018740 10 client.6036 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f2956018740 20 client.6036 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f2956018740 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5632d952b320 0x5632d9924160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f2956018740 4 client.6036 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f2956018740 1 -- 172.21.15.146:0/3246543313 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632d9888a70 con 0x5632d952b320 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.316+0000 7f293ffff640 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5632d952b320 0x5632d9924160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.317+0000 7f29277fe640 10 client.6036 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.317+0000 7f293ffff640 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5632d952b320 0x5632d9924160 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c533f877992e53d0 server_cookie=879800797a30a640 in_seq=0 out_seq=0 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.317+0000 7f29277fe640 1 -- 172.21.15.146:0/3246543313 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5632d9888a70 con 0x5632d952b320 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.317+0000 7f29277fe640 10 client.6036 handle_command_reply: tid=0 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.317+0000 7f2956018740 1 client.6036 shutdown 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f2956018740 1 -- 172.21.15.146:0/3246543313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 msgr2=0x5632d994e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f2956018740 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d994e790 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f29440985a0 tx=0x7f294406b5a0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f2956018740 1 -- 172.21.15.146:0/3246543313 shutdown_connections 2024-09-17T03:35:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f2956018740 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5632d952b320 0x5632d9924160 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f2956018740 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d996b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f2956018740 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d954ba70 0x5632d993a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f29277fe640 0 client.6036 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f2956018740 1 --2- 172.21.15.146:0/3246543313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d994e790 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f2956018740 1 -- 172.21.15.146:0/3246543313 >> 172.21.15.146:0/3246543313 conn(0x5632d95608a0 msgr2=0x5632d99131a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f2956018740 1 -- 172.21.15.146:0/3246543313 shutdown_connections 2024-09-17T03:35:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f2956018740 1 -- 172.21.15.146:0/3246543313 wait complete. 2024-09-17T03:35:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.318+0000 7f2956018740 20 client.6036 trim_cache size 0 max 16384 2024-09-17T03:35:55.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.333+0000 7f2956018740 1 Processor -- start 2024-09-17T03:35:55.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.333+0000 7f2956018740 1 -- start start 2024-09-17T03:35:55.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f2956018740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d9543890 0x5632d994e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f2956018740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d954ba70 0x5632d996adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f2956018740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d99119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f2956018740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f29482022a0 con 0x5632d954ba70 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f2956018740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2948201320 con 0x5632d956c750 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f2956018740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f29480b4d40 con 0x5632d9543890 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f293ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d954ba70 0x5632d996adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f293ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d954ba70 0x5632d996adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54378/0 (socket says 172.21.15.146:54378) 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f293ffff640 1 -- 172.21.15.146:0/3806800551 learned_addr learned my addr 172.21.15.146:0/3806800551 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f294cd62640 1 --2- 172.21.15.146:0/3806800551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d9543890 0x5632d994e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f294d563640 1 --2- 172.21.15.146:0/3806800551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d99119b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f293ffff640 1 -- 172.21.15.146:0/3806800551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d9543890 msgr2=0x5632d994e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f293ffff640 1 --2- 172.21.15.146:0/3806800551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d9543890 0x5632d994e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f293ffff640 1 -- 172.21.15.146:0/3806800551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 msgr2=0x5632d99119b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f293ffff640 1 --2- 172.21.15.146:0/3806800551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d99119b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f293ffff640 1 -- 172.21.15.146:0/3806800551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632d9909980 con 0x5632d954ba70 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.334+0000 7f294d563640 1 --2- 172.21.15.146:0/3806800551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d99119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.335+0000 7f293ffff640 1 --2- 172.21.15.146:0/3806800551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d954ba70 0x5632d996adc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f29480cc5d0 tx=0x7f2938014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4d141c53941f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.335+0000 7f292dffb640 1 -- 172.21.15.146:0/3806800551 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293802e070 con 0x5632d954ba70 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.335+0000 7f292dffb640 1 -- 172.21.15.146:0/3806800551 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29380206f0 con 0x5632d954ba70 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.335+0000 7f292dffb640 1 -- 172.21.15.146:0/3806800551 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938020aa0 con 0x5632d954ba70 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.335+0000 7f2956018740 1 -- 172.21.15.146:0/3806800551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d954ba70 msgr2=0x5632d996adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.335+0000 7f2956018740 1 --2- 172.21.15.146:0/3806800551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d954ba70 0x5632d996adc0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f29480cc5d0 tx=0x7f2938014000 comp rx=0 tx=0).stop 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.335+0000 7f2956018740 1 -- 172.21.15.146:0/3806800551 shutdown_connections 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.335+0000 7f2956018740 1 --2- 172.21.15.146:0/3806800551 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d99119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.335+0000 7f2956018740 1 --2- 172.21.15.146:0/3806800551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d954ba70 0x5632d996adc0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.335+0000 7f2956018740 1 --2- 172.21.15.146:0/3806800551 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d9543890 0x5632d994e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.335+0000 7f2956018740 1 -- 172.21.15.146:0/3806800551 >> 172.21.15.146:0/3806800551 conn(0x5632d95608a0 msgr2=0x5632d9924a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.336+0000 7f2956018740 1 -- 172.21.15.146:0/3806800551 shutdown_connections 2024-09-17T03:35:55.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.336+0000 7f2956018740 1 -- 172.21.15.146:0/3806800551 wait complete. 2024-09-17T03:35:55.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.336+0000 7f2956018740 1 -- start start 2024-09-17T03:35:55.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.337+0000 7f2956018740 1 Processor -- start 2024-09-17T03:35:55.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f2956018740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d99ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f2956018740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d954ba70 0x5632d997a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f2956018740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d997aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f2956018740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5632d9938f40 con 0x5632d9543890 2024-09-17T03:35:55.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f2956018740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f29480b5390 con 0x5632d956c750 2024-09-17T03:35:55.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f2956018740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5632d9910840 con 0x5632d954ba70 2024-09-17T03:35:55.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f2956018740 10 client.0 _ll_register_callbacks cb 0x7f29440616b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:55.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f294cd62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d99ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f294cd62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d99ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54386/0 (socket says 172.21.15.146:54386) 2024-09-17T03:35:55.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f294cd62640 1 -- 172.21.15.146:0/1152136118 learned_addr learned my addr 172.21.15.146:0/1152136118 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f294d563640 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d997aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f293ffff640 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d954ba70 0x5632d997a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f294cd62640 1 -- 172.21.15.146:0/1152136118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d954ba70 msgr2=0x5632d997a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f294cd62640 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d954ba70 0x5632d997a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f294cd62640 1 -- 172.21.15.146:0/1152136118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 msgr2=0x5632d997aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f294cd62640 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d997aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f294cd62640 1 -- 172.21.15.146:0/1152136118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632d990a280 con 0x5632d9543890 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f294d563640 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d997aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f294cd62640 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d99ce390 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2944061780 tx=0x7f2944001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e00711005fc911c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.338+0000 7f29277fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f29277fe640 1 -- 172.21.15.146:0/1152136118 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29440611c0 con 0x5632d9543890 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f29277fe640 1 -- 172.21.15.146:0/1152136118 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f2944060a30 con 0x5632d9543890 2024-09-17T03:35:55.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f2956018740 1 -- 172.21.15.146:0/1152136118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29380206f0 con 0x5632d9543890 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f29277fe640 1 -- 172.21.15.146:0/1152136118 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2944061870 con 0x5632d9543890 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f2956018740 10 client.6042 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f2956018740 1 -- 172.21.15.146:0/1152136118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5632d99ce8d0 con 0x5632d9543890 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f29277fe640 1 -- 172.21.15.146:0/1152136118 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29380206f0 con 0x5632d9543890 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f29277fe640 1 -- 172.21.15.146:0/1152136118 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f2944072070 con 0x5632d9543890 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f2956018740 10 client.6042 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f2956018740 10 client.6042 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f2956018740 20 client.6042 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f2956018740 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5632d99dbb80 0x5632d99d7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f2956018740 4 client.6042 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f2956018740 1 -- 172.21.15.146:0/1152136118 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x5632d9884520 con 0x5632d99dbb80 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f293ffff640 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5632d99dbb80 0x5632d99d7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.339+0000 7f29277fe640 10 client.6042 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.340+0000 7f293ffff640 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5632d99dbb80 0x5632d99d7930 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e5bf87f56c18156 server_cookie=affbf8b8cf1f522f in_seq=0 out_seq=0 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f29277fe640 1 -- 172.21.15.146:0/1152136118 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5632d9884520 con 0x5632d99dbb80 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f29277fe640 10 client.6042 handle_command_reply: tid=0 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f2956018740 1 client.6042 shutdown 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f2956018740 1 -- 172.21.15.146:0/1152136118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 msgr2=0x5632d99ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f2956018740 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d99ce390 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2944061780 tx=0x7f2944001120 comp rx=0 tx=0).stop 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f2956018740 1 -- 172.21.15.146:0/1152136118 shutdown_connections 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f2956018740 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5632d99dbb80 0x5632d99d7930 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f2956018740 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5632d956c750 0x5632d997aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f2956018740 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5632d954ba70 0x5632d997a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f29277fe640 0 client.6042 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f2956018740 1 --2- 172.21.15.146:0/1152136118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5632d9543890 0x5632d99ce390 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f2956018740 1 -- 172.21.15.146:0/1152136118 >> 172.21.15.146:0/1152136118 conn(0x5632d95608a0 msgr2=0x5632d990e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f2956018740 1 -- 172.21.15.146:0/1152136118 shutdown_connections 2024-09-17T03:35:55.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.344+0000 7f2956018740 1 -- 172.21.15.146:0/1152136118 wait complete. 2024-09-17T03:35:55.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f2956018740 20 client.6042 trim_cache size 0 max 16384 2024-09-17T03:35:55.346 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:35:55.346 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:35:55.346 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 -- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2934078b90 msgr2=0x7f293407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2934078b90 0x7f293407b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f294815c7e0 tx=0x7f2938005f30 comp rx=0 tx=0).stop 2024-09-17T03:35:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 -- 172.21.15.146:0/3606303634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948073480 msgr2=0x7f294815b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948073480 0x7f294815b3a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f294400c3f0 tx=0x7f294400c8b0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 -- 172.21.15.146:0/3606303634 shutdown_connections 2024-09-17T03:35:55.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2934078b90 0x7f293407b0a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f294815f7a0 0x7f2948148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2948153a60 0x7f294815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 --2- 172.21.15.146:0/3606303634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2948073480 0x7f294815b3a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 -- 172.21.15.146:0/3606303634 >> 172.21.15.146:0/3606303634 conn(0x7f29480b2060 msgr2=0x7f29480b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 -- 172.21.15.146:0/3606303634 shutdown_connections 2024-09-17T03:35:55.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.345+0000 7f294efc6640 1 -- 172.21.15.146:0/3606303634 wait complete. 2024-09-17T03:35:55.355 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'message': '', 'return_code': 0}' 2024-09-17T03:35:55.355 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:35:55.355 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:35:55.355 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-09-17T03:35:55.355 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:35:55.356 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-09-17T03:35:55.356 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:35:55.423 INFO:teuthology.orchestra.run.smithi146.stdout:1099511630414 2024-09-17T03:35:55.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:35:55.432 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-17T03:35:55.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.587+0000 7ff24c47e640 1 -- 172.21.15.146:0/1793469990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff244144380 msgr2=0x7ff2440b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.587+0000 7ff24c47e640 1 --2- 172.21.15.146:0/1793469990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff244144380 0x7ff2440b3b60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff23400a940 tx=0x7ff23402b850 comp rx=0 tx=0).stop 2024-09-17T03:35:55.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.587+0000 7ff24c47e640 1 -- 172.21.15.146:0/1793469990 shutdown_connections 2024-09-17T03:35:55.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.587+0000 7ff24c47e640 1 --2- 172.21.15.146:0/1793469990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2440b40a0 0x7ff244073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.587+0000 7ff24c47e640 1 --2- 172.21.15.146:0/1793469990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff244144380 0x7ff2440b3b60 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.587+0000 7ff24c47e640 1 -- 172.21.15.146:0/1793469990 >> 172.21.15.146:0/1793469990 conn(0x7ff24406d3c0 msgr2=0x7ff2440b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.587+0000 7ff24c47e640 1 -- 172.21.15.146:0/1793469990 shutdown_connections 2024-09-17T03:35:55.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.587+0000 7ff24c47e640 1 -- 172.21.15.146:0/1793469990 wait complete. 2024-09-17T03:35:55.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.589+0000 7ff24c47e640 1 Processor -- start 2024-09-17T03:35:55.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.589+0000 7ff24c47e640 1 -- start start 2024-09-17T03:35:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.590+0000 7ff24c47e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2440b40a0 0x7ff2441f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.590+0000 7ff24c47e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff244144380 0x7ff2441408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.590+0000 7ff24c47e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff244144900 0x7ff244142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.590+0000 7ff24c47e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff2440692f0 con 0x7ff2440b40a0 2024-09-17T03:35:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.590+0000 7ff24c47e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff244069170 con 0x7ff244144900 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.590+0000 7ff24c47e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff244073940 con 0x7ff244144380 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.590+0000 7ff24a21a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2440b40a0 0x7ff2441f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff24a21a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2440b40a0 0x7ff2441f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54412/0 (socket says 172.21.15.146:54412) 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff24a21a640 1 -- 172.21.15.146:0/2951194564 learned_addr learned my addr 172.21.15.146:0/2951194564 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff249a19640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff244144380 0x7ff2441408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff24aa1b640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff244144900 0x7ff244142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff24a21a640 1 -- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff244144380 msgr2=0x7ff2441408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff24a21a640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff244144380 0x7ff2441408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff24a21a640 1 -- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff244144900 msgr2=0x7ff244142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff24a21a640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff244144900 0x7ff244142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff24a21a640 1 -- 172.21.15.146:0/2951194564 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff244140e10 con 0x7ff2440b40a0 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff24a21a640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2440b40a0 0x7ff2441f3cf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff24000c370 tx=0x7ff24000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff23affd640 1 -- 172.21.15.146:0/2951194564 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240006890 con 0x7ff2440b40a0 2024-09-17T03:35:55.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff23affd640 1 -- 172.21.15.146:0/2951194564 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff240006b20 con 0x7ff2440b40a0 2024-09-17T03:35:55.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff24c47e640 1 -- 172.21.15.146:0/2951194564 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2441f45e0 con 0x7ff2440b40a0 2024-09-17T03:35:55.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff23affd640 1 -- 172.21.15.146:0/2951194564 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240007020 con 0x7ff2440b40a0 2024-09-17T03:35:55.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.591+0000 7ff24c47e640 1 -- 172.21.15.146:0/2951194564 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2441f4ba0 con 0x7ff2440b40a0 2024-09-17T03:35:55.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.593+0000 7ff23affd640 1 -- 172.21.15.146:0/2951194564 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff240019020 con 0x7ff2440b40a0 2024-09-17T03:35:55.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.594+0000 7ff23affd640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff228078bc0 0x7ff22807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.594+0000 7ff23affd640 1 -- 172.21.15.146:0/2951194564 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff24009a2b0 con 0x7ff2440b40a0 2024-09-17T03:35:55.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.594+0000 7ff249a19640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff228078bc0 0x7ff22807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.595+0000 7ff249a19640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff228078bc0 0x7ff22807b0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff234036000 tx=0x7ff234004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.595+0000 7ff2533ea740 1 Processor -- start 2024-09-17T03:35:55.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.595+0000 7ff2533ea740 1 -- start start 2024-09-17T03:35:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.596+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda92390 0x5617fde52ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.596+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde610a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.596+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.596+0000 7ff2533ea740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5617fddac8e0 con 0x5617fda716b0 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.596+0000 7ff2533ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5617fdd9bd10 con 0x5617fda694d0 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.596+0000 7ff2533ea740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5617fdd9fb20 con 0x5617fda92390 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.596+0000 7ff24aa1b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.596+0000 7ff24aa1b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54426/0 (socket says 172.21.15.146:54426) 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.596+0000 7ff24aa1b640 1 -- 172.21.15.146:0/1717243452 learned_addr learned my addr 172.21.15.146:0/1717243452 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.596+0000 7ff24a21a640 1 --2- 172.21.15.146:0/1717243452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda92390 0x5617fde52ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.596+0000 7ff249a19640 1 --2- 172.21.15.146:0/1717243452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.597+0000 7ff24aa1b640 1 -- 172.21.15.146:0/1717243452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda92390 msgr2=0x5617fde52ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.597+0000 7ff24aa1b640 1 --2- 172.21.15.146:0/1717243452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda92390 0x5617fde52ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.597+0000 7ff24aa1b640 1 -- 172.21.15.146:0/1717243452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 msgr2=0x5617fde610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.597+0000 7ff24aa1b640 1 --2- 172.21.15.146:0/1717243452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.597+0000 7ff24aa1b640 1 -- 172.21.15.146:0/1717243452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fdafd970 con 0x5617fda716b0 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.597+0000 7ff24aa1b640 1 --2- 172.21.15.146:0/1717243452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde615e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009e10 tx=0x7ff23c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c1e5606c6e610b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.597+0000 7ff227fff640 1 -- 172.21.15.146:0/1717243452 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c016070 con 0x5617fda716b0 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.597+0000 7ff227fff640 1 -- 172.21.15.146:0/1717243452 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff23c004e10 con 0x5617fda716b0 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.597+0000 7ff227fff640 1 -- 172.21.15.146:0/1717243452 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c005260 con 0x5617fda716b0 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.598+0000 7ff2533ea740 1 -- 172.21.15.146:0/1717243452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 msgr2=0x5617fde615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.598+0000 7ff2533ea740 1 --2- 172.21.15.146:0/1717243452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde615e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009e10 tx=0x7ff23c010740 comp rx=0 tx=0).stop 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.598+0000 7ff2533ea740 1 -- 172.21.15.146:0/1717243452 shutdown_connections 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.598+0000 7ff2533ea740 1 --2- 172.21.15.146:0/1717243452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde615e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.598+0000 7ff2533ea740 1 --2- 172.21.15.146:0/1717243452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.598+0000 7ff2533ea740 1 --2- 172.21.15.146:0/1717243452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda92390 0x5617fde52ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.598+0000 7ff2533ea740 1 -- 172.21.15.146:0/1717243452 >> 172.21.15.146:0/1717243452 conn(0x5617fda864e0 msgr2=0x5617fde3a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.598+0000 7ff2533ea740 1 -- 172.21.15.146:0/1717243452 shutdown_connections 2024-09-17T03:35:55.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.598+0000 7ff2533ea740 1 -- 172.21.15.146:0/1717243452 wait complete. 2024-09-17T03:35:55.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.599+0000 7ff2533ea740 1 -- start start 2024-09-17T03:35:55.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.599+0000 7ff2533ea740 1 Processor -- start 2024-09-17T03:35:55.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.600+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde786a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.600+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde93ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.600+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda92390 0x5617fde94010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.600+0000 7ff2533ea740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5617fdb0c740 con 0x5617fda716b0 2024-09-17T03:35:55.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.600+0000 7ff2533ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5617fdd417f0 con 0x5617fda694d0 2024-09-17T03:35:55.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.600+0000 7ff2533ea740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5617fde949f0 con 0x5617fda92390 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff249a19640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde93ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.600+0000 7ff2533ea740 10 client.0 _ll_register_callbacks cb 0x5617fdd452a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff249a19640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde93ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54438/0 (socket says 172.21.15.146:54438) 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff249a19640 1 -- 172.21.15.146:0/3321156106 learned_addr learned my addr 172.21.15.146:0/3321156106 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff24a21a640 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff24aa1b640 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda92390 0x5617fde94010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff249a19640 1 -- 172.21.15.146:0/3321156106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda92390 msgr2=0x5617fde94010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff249a19640 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda92390 0x5617fde94010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff249a19640 1 -- 172.21.15.146:0/3321156106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 msgr2=0x5617fde786a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff249a19640 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde786a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff249a19640 1 -- 172.21.15.146:0/3321156106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617fdb747d0 con 0x5617fda716b0 2024-09-17T03:35:55.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff24a21a640 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde786a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff249a19640 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde93ad0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff23400a940 tx=0x7ff234005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409521a4fb542fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff2257fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff2257fa640 1 -- 172.21.15.146:0/3321156106 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234050070 con 0x5617fda716b0 2024-09-17T03:35:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff2257fa640 1 -- 172.21.15.146:0/3321156106 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff2340319e0 con 0x5617fda716b0 2024-09-17T03:35:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff2533ea740 1 -- 172.21.15.146:0/3321156106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff23c004e10 con 0x5617fda716b0 2024-09-17T03:35:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff2257fa640 1 -- 172.21.15.146:0/3321156106 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff23405b050 con 0x5617fda716b0 2024-09-17T03:35:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff2533ea740 10 client.6057 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.601+0000 7ff2533ea740 1 -- 172.21.15.146:0/3321156106 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5617fde77800 con 0x5617fda716b0 2024-09-17T03:35:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.602+0000 7ff2257fa640 1 -- 172.21.15.146:0/3321156106 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff23c004e10 con 0x5617fda716b0 2024-09-17T03:35:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.602+0000 7ff2257fa640 1 -- 172.21.15.146:0/3321156106 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7ff23405e020 con 0x5617fda716b0 2024-09-17T03:35:55.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.602+0000 7ff2533ea740 10 client.6057 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.602+0000 7ff2533ea740 10 client.6057 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.602+0000 7ff2533ea740 20 client.6057 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.602+0000 7ff2533ea740 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5617fda50f60 0x5617fde95f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.602+0000 7ff2533ea740 4 client.6057 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.602+0000 7ff2533ea740 1 -- 172.21.15.146:0/3321156106 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617fddae830 con 0x5617fda50f60 2024-09-17T03:35:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.602+0000 7ff24a21a640 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5617fda50f60 0x5617fde95f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.602+0000 7ff2257fa640 10 client.6057 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.602+0000 7ff24a21a640 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5617fda50f60 0x5617fde95f10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28a039053b7eb76a server_cookie=6bc956a32f8a2aec in_seq=0 out_seq=0 2024-09-17T03:35:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2257fa640 1 -- 172.21.15.146:0/3321156106 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5617fddae830 con 0x5617fda50f60 2024-09-17T03:35:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2257fa640 10 client.6057 handle_command_reply: tid=0 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 1 client.6057 shutdown 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 1 -- 172.21.15.146:0/3321156106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 msgr2=0x5617fde93ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde93ad0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff23400a940 tx=0x7ff234005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 1 -- 172.21.15.146:0/3321156106 shutdown_connections 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5617fda50f60 0x5617fde95f10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda92390 0x5617fde94010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda716b0 0x5617fde93ad0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 1 --2- 172.21.15.146:0/3321156106 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde786a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2257fa640 0 client.6057 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 1 -- 172.21.15.146:0/3321156106 >> 172.21.15.146:0/3321156106 conn(0x5617fda864e0 msgr2=0x5617fde61010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 1 -- 172.21.15.146:0/3321156106 shutdown_connections 2024-09-17T03:35:55.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 1 -- 172.21.15.146:0/3321156106 wait complete. 2024-09-17T03:35:55.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.603+0000 7ff2533ea740 20 client.6057 trim_cache size 0 max 16384 2024-09-17T03:35:55.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.617+0000 7ff2533ea740 1 Processor -- start 2024-09-17T03:35:55.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.617+0000 7ff2533ea740 1 -- start start 2024-09-17T03:35:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.618+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda694d0 0x5617fde35ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.618+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda716b0 0x5617fde33eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.618+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda92390 0x5617fde91920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.618+0000 7ff2533ea740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff2441e2b20 con 0x5617fda694d0 2024-09-17T03:35:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.618+0000 7ff2533ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff2441e1b00 con 0x5617fda92390 2024-09-17T03:35:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.618+0000 7ff2533ea740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff2441f7db0 con 0x5617fda716b0 2024-09-17T03:35:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.618+0000 7ff24a21a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda694d0 0x5617fde35ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.618+0000 7ff24a21a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda694d0 0x5617fde35ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54442/0 (socket says 172.21.15.146:54442) 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.618+0000 7ff24a21a640 1 -- 172.21.15.146:0/3101925826 learned_addr learned my addr 172.21.15.146:0/3101925826 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.618+0000 7ff249a19640 1 --2- 172.21.15.146:0/3101925826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda716b0 0x5617fde33eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.618+0000 7ff24aa1b640 1 --2- 172.21.15.146:0/3101925826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda92390 0x5617fde91920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.619+0000 7ff24a21a640 1 -- 172.21.15.146:0/3101925826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda716b0 msgr2=0x5617fde33eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.619+0000 7ff24a21a640 1 --2- 172.21.15.146:0/3101925826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda716b0 0x5617fde33eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.619+0000 7ff24a21a640 1 -- 172.21.15.146:0/3101925826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda92390 msgr2=0x5617fde91920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.619+0000 7ff24a21a640 1 --2- 172.21.15.146:0/3101925826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda92390 0x5617fde91920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.619+0000 7ff24a21a640 1 -- 172.21.15.146:0/3101925826 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fde77ed0 con 0x5617fda694d0 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.619+0000 7ff24a21a640 1 --2- 172.21.15.146:0/3101925826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda694d0 0x5617fde35ea0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff240061cf0 tx=0x7ff240005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c4e21b009de63b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.619+0000 7ff2277fe640 1 -- 172.21.15.146:0/3101925826 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24007c300 con 0x5617fda694d0 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.619+0000 7ff2277fe640 1 -- 172.21.15.146:0/3101925826 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff240066b20 con 0x5617fda694d0 2024-09-17T03:35:55.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.619+0000 7ff2277fe640 1 -- 172.21.15.146:0/3101925826 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24006b9d0 con 0x5617fda694d0 2024-09-17T03:35:55.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.620+0000 7ff2533ea740 1 -- 172.21.15.146:0/3101925826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda694d0 msgr2=0x5617fde35ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.620+0000 7ff2533ea740 1 --2- 172.21.15.146:0/3101925826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda694d0 0x5617fde35ea0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff240061cf0 tx=0x7ff240005040 comp rx=0 tx=0).stop 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.620+0000 7ff2533ea740 1 -- 172.21.15.146:0/3101925826 shutdown_connections 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.620+0000 7ff2533ea740 1 --2- 172.21.15.146:0/3101925826 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda92390 0x5617fde91920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.620+0000 7ff2533ea740 1 --2- 172.21.15.146:0/3101925826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda716b0 0x5617fde33eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.620+0000 7ff2533ea740 1 --2- 172.21.15.146:0/3101925826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda694d0 0x5617fde35ea0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.620+0000 7ff2533ea740 1 -- 172.21.15.146:0/3101925826 >> 172.21.15.146:0/3101925826 conn(0x5617fda864e0 msgr2=0x5617fde640c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.620+0000 7ff2533ea740 1 -- 172.21.15.146:0/3101925826 shutdown_connections 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.620+0000 7ff2533ea740 1 -- 172.21.15.146:0/3101925826 wait complete. 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.620+0000 7ff2533ea740 1 -- start start 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.621+0000 7ff2533ea740 1 Processor -- start 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde33a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda716b0 0x5617fde88760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff2533ea740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda92390 0x5617fde88ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff2533ea740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff2441e14b0 con 0x5617fda92390 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff2533ea740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5617fde343f0 con 0x5617fda694d0 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff2533ea740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5617fde951a0 con 0x5617fda716b0 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff2533ea740 10 client.0 _ll_register_callbacks cb 0x7ff2340043b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff24aa1b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda92390 0x5617fde88ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff24aa1b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda92390 0x5617fde88ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54454/0 (socket says 172.21.15.146:54454) 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff24aa1b640 1 -- 172.21.15.146:0/2437355289 learned_addr learned my addr 172.21.15.146:0/2437355289 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff24a21a640 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde33a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff249a19640 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda716b0 0x5617fde88760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff24aa1b640 1 -- 172.21.15.146:0/2437355289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda716b0 msgr2=0x5617fde88760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff24aa1b640 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda716b0 0x5617fde88760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff24aa1b640 1 -- 172.21.15.146:0/2437355289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 msgr2=0x5617fde33a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff24aa1b640 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde33a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.622+0000 7ff24aa1b640 1 -- 172.21.15.146:0/2437355289 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617fde764b0 con 0x5617fda92390 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff24aa1b640 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda92390 0x5617fde88ca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009de0 tx=0x7ff23c009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343d586a7dfac72b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2257fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2257fa640 1 -- 172.21.15.146:0/2437355289 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c016040 con 0x5617fda92390 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2257fa640 1 -- 172.21.15.146:0/2437355289 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff23c004b20 con 0x5617fda92390 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2533ea740 1 -- 172.21.15.146:0/2437355289 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff240066b20 con 0x5617fda92390 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2257fa640 1 -- 172.21.15.146:0/2437355289 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff23c031050 con 0x5617fda92390 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2533ea740 10 client.6063 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2533ea740 1 -- 172.21.15.146:0/2437355289 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5617fde9c340 con 0x5617fda92390 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2257fa640 1 -- 172.21.15.146:0/2437355289 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff240066b20 con 0x5617fda92390 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2257fa640 1 -- 172.21.15.146:0/2437355289 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7ff23c034020 con 0x5617fda92390 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2533ea740 10 client.6063 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:55.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2533ea740 10 client.6063 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2533ea740 20 client.6063 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2533ea740 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5617fde5ac70 0x5617fde5b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2533ea740 4 client.6063 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff2533ea740 1 -- 172.21.15.146:0/2437355289 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5617fddaa2e0 con 0x5617fde5ac70 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.623+0000 7ff24a21a640 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5617fde5ac70 0x5617fde5b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2257fa640 10 client.6063 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff24a21a640 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5617fde5ac70 0x5617fde5b080 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a9262bdf6da1e9b server_cookie=f5a1d0a5ce8f1014 in_seq=0 out_seq=0 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2257fa640 1 -- 172.21.15.146:0/2437355289 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5617fddaa2e0 con 0x5617fde5ac70 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2257fa640 10 client.6063 handle_command_reply: tid=0 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 1 client.6063 shutdown 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 1 -- 172.21.15.146:0/2437355289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda92390 msgr2=0x5617fde88ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda92390 0x5617fde88ca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009de0 tx=0x7ff23c009d70 comp rx=0 tx=0).stop 2024-09-17T03:35:55.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 1 -- 172.21.15.146:0/2437355289 shutdown_connections 2024-09-17T03:35:55.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x5617fde5ac70 0x5617fde5b080 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617fda92390 0x5617fde88ca0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617fda716b0 0x5617fde88760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2257fa640 0 client.6063 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 1 --2- 172.21.15.146:0/2437355289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617fda694d0 0x5617fde33a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 1 -- 172.21.15.146:0/2437355289 >> 172.21.15.146:0/2437355289 conn(0x5617fda864e0 msgr2=0x5617fde39f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 1 -- 172.21.15.146:0/2437355289 shutdown_connections 2024-09-17T03:35:55.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 1 -- 172.21.15.146:0/2437355289 wait complete. 2024-09-17T03:35:55.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.624+0000 7ff2533ea740 20 client.6063 trim_cache size 0 max 16384 2024-09-17T03:35:55.629 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2024-09-17T03:35:55.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 -- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff228078bc0 msgr2=0x7ff22807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff228078bc0 0x7ff22807b0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff234036000 tx=0x7ff234004730 comp rx=0 tx=0).stop 2024-09-17T03:35:55.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 -- 172.21.15.146:0/2951194564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2440b40a0 msgr2=0x7ff2441f3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2440b40a0 0x7ff2441f3cf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff24000c370 tx=0x7ff24000c830 comp rx=0 tx=0).stop 2024-09-17T03:35:55.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 -- 172.21.15.146:0/2951194564 shutdown_connections 2024-09-17T03:35:55.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff228078bc0 0x7ff22807b0d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff244144900 0x7ff244142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff244144380 0x7ff2441408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 --2- 172.21.15.146:0/2951194564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2440b40a0 0x7ff2441f3cf0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 -- 172.21.15.146:0/2951194564 >> 172.21.15.146:0/2951194564 conn(0x7ff24406d3c0 msgr2=0x7ff2440ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 -- 172.21.15.146:0/2951194564 shutdown_connections 2024-09-17T03:35:55.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.625+0000 7ff24c47e640 1 -- 172.21.15.146:0/2951194564 wait complete. 2024-09-17T03:35:55.635 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4e.00000000 parent 2024-09-17T03:35:55.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.691+0000 7fe358091f40 1 Processor -- start 2024-09-17T03:35:55.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.691+0000 7fe358091f40 1 -- start start 2024-09-17T03:35:55.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe358091f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33c003b40 0x562c5ce2e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe358091f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 0x562c5ce2c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe358091f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c5ce2c740 0x562c5cd9e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe358091f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562c5cd20430 con 0x562c5ce2d980 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe358091f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562c5cd2d1f0 con 0x562c5ce2c740 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe358091f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562c5ccc1d60 con 0x7fe33c003b40 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe35134a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 0x562c5ce2c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe35134a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 0x562c5ce2c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54472/0 (socket says 172.21.15.146:54472) 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe35134a640 1 -- 172.21.15.146:0/326344041 learned_addr learned my addr 172.21.15.146:0/326344041 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe35134a640 1 -- 172.21.15.146:0/326344041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33c003b40 msgr2=0x562c5ce2e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe35134a640 1 --2- 172.21.15.146:0/326344041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33c003b40 0x562c5ce2e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe35134a640 1 -- 172.21.15.146:0/326344041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c5ce2c740 msgr2=0x562c5cd9e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe35134a640 1 --2- 172.21.15.146:0/326344041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c5ce2c740 0x562c5cd9e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe35134a640 1 -- 172.21.15.146:0/326344041 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5cd9c960 con 0x562c5ce2d980 2024-09-17T03:35:55.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe35134a640 1 --2- 172.21.15.146:0/326344041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 0x562c5ce2c200 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe34800b4c0 tx=0x7fe34800b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7c5a0e7c0b4be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe343fff640 1 -- 172.21.15.146:0/326344041 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34800aa40 con 0x562c5ce2d980 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe343fff640 1 -- 172.21.15.146:0/326344041 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe34800abe0 con 0x562c5ce2d980 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.693+0000 7fe343fff640 1 -- 172.21.15.146:0/326344041 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348008420 con 0x562c5ce2d980 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.694+0000 7fe358091f40 1 -- 172.21.15.146:0/326344041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 msgr2=0x562c5ce2c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.694+0000 7fe358091f40 1 --2- 172.21.15.146:0/326344041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 0x562c5ce2c200 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe34800b4c0 tx=0x7fe34800b980 comp rx=0 tx=0).stop 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.694+0000 7fe358091f40 1 -- 172.21.15.146:0/326344041 shutdown_connections 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.694+0000 7fe358091f40 1 --2- 172.21.15.146:0/326344041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c5ce2c740 0x562c5cd9e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.694+0000 7fe358091f40 1 --2- 172.21.15.146:0/326344041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 0x562c5ce2c200 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.694+0000 7fe358091f40 1 --2- 172.21.15.146:0/326344041 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33c003b40 0x562c5ce2e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.694+0000 7fe358091f40 1 -- 172.21.15.146:0/326344041 >> 172.21.15.146:0/326344041 conn(0x562c5cc92ac0 msgr2=0x562c5cd9c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.694+0000 7fe358091f40 1 -- 172.21.15.146:0/326344041 shutdown_connections 2024-09-17T03:35:55.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.694+0000 7fe358091f40 1 -- 172.21.15.146:0/326344041 wait complete. 2024-09-17T03:35:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.695+0000 7fe358091f40 1 Processor -- start 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.695+0000 7fe358091f40 1 -- start start 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.696+0000 7fe358091f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c5ce2c740 0x562c5cd71350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.696+0000 7fe358091f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 0x562c5ce2a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.696+0000 7fe358091f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33c003b40 0x562c5cee41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.696+0000 7fe358091f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562c5ce2f560 con 0x562c5ce2d980 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.696+0000 7fe358091f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562c5ce45d60 con 0x562c5ce2c740 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.696+0000 7fe358091f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562c5cd73010 con 0x7fe33c003b40 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.696+0000 7fe35134a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 0x562c5ce2a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.696+0000 7fe35134a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 0x562c5ce2a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54488/0 (socket says 172.21.15.146:54488) 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.696+0000 7fe35134a640 1 -- 172.21.15.146:0/957318649 learned_addr learned my addr 172.21.15.146:0/957318649 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe35234c640 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33c003b40 0x562c5cee41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.696+0000 7fe351b4b640 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c5ce2c740 0x562c5cd71350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe35134a640 1 -- 172.21.15.146:0/957318649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33c003b40 msgr2=0x562c5cee41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe35134a640 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33c003b40 0x562c5cee41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe35134a640 1 -- 172.21.15.146:0/957318649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c5ce2c740 msgr2=0x562c5cd71350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe35134a640 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562c5ce2c740 0x562c5cd71350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe35134a640 1 -- 172.21.15.146:0/957318649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5cd72400 con 0x562c5ce2d980 2024-09-17T03:35:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe35134a640 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 0x562c5ce2a240 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x562c5ce439c0 tx=0x7fe348017a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe342ffd640 1 -- 172.21.15.146:0/957318649 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348022020 con 0x562c5ce2d980 2024-09-17T03:35:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe342ffd640 1 -- 172.21.15.146:0/957318649 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe348004c70 con 0x562c5ce2d980 2024-09-17T03:35:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe342ffd640 1 -- 172.21.15.146:0/957318649 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34801e640 con 0x562c5ce2d980 2024-09-17T03:35:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe358091f40 1 -- 172.21.15.146:0/957318649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c5cd726e0 con 0x562c5ce2d980 2024-09-17T03:35:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.697+0000 7fe358091f40 1 -- 172.21.15.146:0/957318649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c5cd72ca0 con 0x562c5ce2d980 2024-09-17T03:35:55.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.699+0000 7fe342ffd640 1 -- 172.21.15.146:0/957318649 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe348025020 con 0x562c5ce2d980 2024-09-17T03:35:55.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.699+0000 7fe342ffd640 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3340775a0 0x7fe334079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.699+0000 7fe342ffd640 1 -- 172.21.15.146:0/957318649 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe34809bbf0 con 0x562c5ce2d980 2024-09-17T03:35:55.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.699+0000 7fe351b4b640 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3340775a0 0x7fe334079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.699+0000 7fe358091f40 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x562c5cd734a0 0x562c5cd738b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.699+0000 7fe358091f40 1 -- 172.21.15.146:0/957318649 --> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] -- osd_op(unknown.0.0:1 7.2 7:43adcc81:::10000000a4e.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47) -- 0x562c5cd73df0 con 0x562c5cd734a0 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.700+0000 7fe35234c640 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x562c5cd734a0 0x562c5cd738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.700+0000 7fe351b4b640 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3340775a0 0x7fe334079ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe344001550 tx=0x7fe344003040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.700+0000 7fe35234c640 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x562c5cd734a0 0x562c5cd738b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe35234c640 1 -- 172.21.15.146:0/957318649 <== osd.3 v2:172.21.15.146:6800/99103729 1 ==== osd_op_reply(1 10000000a4e.00000000 [rmxattr] v47'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe34c001430 con 0x562c5cd734a0 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe358091f40 1 -- 172.21.15.146:0/957318649 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x562c5cd734a0 msgr2=0x562c5cd738b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe358091f40 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x562c5cd734a0 0x562c5cd738b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe358091f40 1 -- 172.21.15.146:0/957318649 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3340775a0 msgr2=0x7fe334079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe358091f40 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3340775a0 0x7fe334079ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe344001550 tx=0x7fe344003040 comp rx=0 tx=0).stop 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe358091f40 1 -- 172.21.15.146:0/957318649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 msgr2=0x562c5ce2a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe358091f40 1 --2- 172.21.15.146:0/957318649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562c5ce2d980 0x562c5ce2a240 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x562c5ce439c0 tx=0x7fe348017a30 comp rx=0 tx=0).stop 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe35234c640 1 -- 172.21.15.146:0/957318649 reap_dead start 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe358091f40 1 -- 172.21.15.146:0/957318649 shutdown_connections 2024-09-17T03:35:55.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe358091f40 1 -- 172.21.15.146:0/957318649 >> 172.21.15.146:0/957318649 conn(0x562c5cc92ac0 msgr2=0x562c5ce2cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe358091f40 1 -- 172.21.15.146:0/957318649 shutdown_connections 2024-09-17T03:35:55.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.701+0000 7fe358091f40 1 -- 172.21.15.146:0/957318649 wait complete. 2024-09-17T03:35:55.703 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-17T03:35:55.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-17T03:35:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.821+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2601674291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d0004800 msgr2=0x7fc1d0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.821+0000 7fc1eb2cc640 1 --2- 172.21.15.146:0/2601674291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d0004800 0x7fc1d0004c10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40b7fe0 tx=0x7fc1d0005830 comp rx=0 tx=0).stop 2024-09-17T03:35:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.821+0000 7fc1e9869640 1 -- 172.21.15.146:0/2601674291 reap_dead start 2024-09-17T03:35:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.821+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2601674291 shutdown_connections 2024-09-17T03:35:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.821+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2601674291 >> 172.21.15.146:0/2601674291 conn(0x7fc1e40b7b20 msgr2=0x7fc1e409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.821+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2601674291 shutdown_connections 2024-09-17T03:35:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.821+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2601674291 wait complete. 2024-09-17T03:35:55.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.822+0000 7fc1eb2cc640 1 Processor -- start 2024-09-17T03:35:55.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.823+0000 7fc1eb2cc640 1 -- start start 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1eb2cc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d0004800 0x7fc1e41f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1eb2cc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e41f43e0 0x7fc1e409fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1eb2cc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e40a0390 0x7fc1e41549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1eb2cc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41657b0 con 0x7fc1d0004800 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1eb2cc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e415dcc0 con 0x7fc1e41f43e0 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1eb2cc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e4165930 con 0x7fc1e40a0390 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1e9068640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d0004800 0x7fc1e41f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1e9068640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d0004800 0x7fc1e41f3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54508/0 (socket says 172.21.15.146:54508) 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1e9068640 1 -- 172.21.15.146:0/2880927512 learned_addr learned my addr 172.21.15.146:0/2880927512 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1e9068640 1 -- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e40a0390 msgr2=0x7fc1e41549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1e9068640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e40a0390 0x7fc1e41549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1e9068640 1 -- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e41f43e0 msgr2=0x7fc1e409fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1e9068640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e41f43e0 0x7fc1e409fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1e9068640 1 -- 172.21.15.146:0/2880927512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e413f810 con 0x7fc1d0004800 2024-09-17T03:35:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1e9068640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d0004800 0x7fc1e41f3ea0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000e630 tx=0x7fc1e000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1d9ffb640 1 -- 172.21.15.146:0/2880927512 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0015070 con 0x7fc1d0004800 2024-09-17T03:35:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1d9ffb640 1 -- 172.21.15.146:0/2880927512 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1e000ca90 con 0x7fc1d0004800 2024-09-17T03:35:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2880927512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e41f49c0 con 0x7fc1d0004800 2024-09-17T03:35:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.824+0000 7fc1d9ffb640 1 -- 172.21.15.146:0/2880927512 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000ce80 con 0x7fc1d0004800 2024-09-17T03:35:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.825+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2880927512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e41f4f80 con 0x7fc1d0004800 2024-09-17T03:35:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.826+0000 7fc1d9ffb640 1 -- 172.21.15.146:0/2880927512 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1e0018070 con 0x7fc1d0004800 2024-09-17T03:35:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.827+0000 7fc1d9ffb640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c8078bc0 0x7fc1c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.827+0000 7fc1d9ffb640 1 -- 172.21.15.146:0/2880927512 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc1e009b1a0 con 0x7fc1d0004800 2024-09-17T03:35:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.828+0000 7fc1e8867640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c8078bc0 0x7fc1c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.828+0000 7fc1e8867640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c8078bc0 0x7fc1c807b0d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40b7fe0 tx=0x7fc1d4001120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.828+0000 7fc1f2238740 1 Processor -- start 2024-09-17T03:35:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.828+0000 7fc1f2238740 1 -- start start 2024-09-17T03:35:55.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.829+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edece98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.829+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8d38d0 0x555edec9e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.829+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8dbab0 0x555edec9e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.829+0000 7fc1f2238740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555edec16c80 con 0x555ede8fc790 2024-09-17T03:35:55.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.829+0000 7fc1f2238740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555edec060b0 con 0x555ede8dbab0 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.829+0000 7fc1f2238740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x555edec09ec0 con 0x555ede8d38d0 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e9068640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edece98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e9068640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edece98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54516/0 (socket says 172.21.15.146:54516) 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e9068640 1 -- 172.21.15.146:0/2815692734 learned_addr learned my addr 172.21.15.146:0/2815692734 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e8867640 1 --2- 172.21.15.146:0/2815692734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8d38d0 0x555edec9e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e9869640 1 --2- 172.21.15.146:0/2815692734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8dbab0 0x555edec9e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e9068640 1 -- 172.21.15.146:0/2815692734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8d38d0 msgr2=0x555edec9e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e9068640 1 --2- 172.21.15.146:0/2815692734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8d38d0 0x555edec9e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e9068640 1 -- 172.21.15.146:0/2815692734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8dbab0 msgr2=0x555edec9e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e9068640 1 --2- 172.21.15.146:0/2815692734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8dbab0 0x555edec9e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e9068640 1 -- 172.21.15.146:0/2815692734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ede9e0c00 con 0x555ede8fc790 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e8867640 1 --2- 172.21.15.146:0/2815692734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8d38d0 0x555edec9e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e9869640 1 --2- 172.21.15.146:0/2815692734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8dbab0 0x555edec9e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:55.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1e9068640 1 --2- 172.21.15.146:0/2815692734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edece98e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000c260 tx=0x7fc1e00627b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91722825758d2c13 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1ceffd640 1 -- 172.21.15.146:0/2815692734 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e001f040 con 0x555ede8fc790 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1ceffd640 1 -- 172.21.15.146:0/2815692734 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1e00679f0 con 0x555ede8fc790 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.830+0000 7fc1ceffd640 1 -- 172.21.15.146:0/2815692734 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e006c8a0 con 0x555ede8fc790 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.831+0000 7fc1f2238740 1 -- 172.21.15.146:0/2815692734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 msgr2=0x555edece98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.831+0000 7fc1f2238740 1 --2- 172.21.15.146:0/2815692734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edece98e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000c260 tx=0x7fc1e00627b0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.831+0000 7fc1f2238740 1 -- 172.21.15.146:0/2815692734 shutdown_connections 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.831+0000 7fc1f2238740 1 --2- 172.21.15.146:0/2815692734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8dbab0 0x555edec9e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.831+0000 7fc1f2238740 1 --2- 172.21.15.146:0/2815692734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8d38d0 0x555edec9e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.831+0000 7fc1f2238740 1 --2- 172.21.15.146:0/2815692734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edece98e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.831+0000 7fc1f2238740 1 -- 172.21.15.146:0/2815692734 >> 172.21.15.146:0/2815692734 conn(0x555ede8f08e0 msgr2=0x555edeca3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.831+0000 7fc1f2238740 1 -- 172.21.15.146:0/2815692734 shutdown_connections 2024-09-17T03:35:55.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.831+0000 7fc1f2238740 1 -- 172.21.15.146:0/2815692734 wait complete. 2024-09-17T03:35:55.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.832+0000 7fc1f2238740 1 -- start start 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.832+0000 7fc1f2238740 1 Processor -- start 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.833+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 0x555edece5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.833+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8dbab0 0x555edecbdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.833+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edeceb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.833+0000 7fc1f2238740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x555ede976b40 con 0x555ede8fc790 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.833+0000 7fc1f2238740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555edebab620 con 0x555ede8d38d0 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.833+0000 7fc1f2238740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x555edece7ed0 con 0x555ede8dbab0 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1f2238740 10 client.0 _ll_register_callbacks cb 0x555edebfef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1e9869640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edeceb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1e9869640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edeceb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54530/0 (socket says 172.21.15.146:54530) 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1e9869640 1 -- 172.21.15.146:0/2597312810 learned_addr learned my addr 172.21.15.146:0/2597312810 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1e9068640 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 0x555edece5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1e8867640 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8dbab0 0x555edecbdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1e9869640 1 -- 172.21.15.146:0/2597312810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8dbab0 msgr2=0x555edecbdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1e9869640 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8dbab0 0x555edecbdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1e9869640 1 -- 172.21.15.146:0/2597312810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 msgr2=0x555edece5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1e9869640 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 0x555edece5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1e9869640 1 -- 172.21.15.146:0/2597312810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ede945aa0 con 0x555ede8fc790 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1e9869640 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edeceb760 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0004780 tx=0x7fc1dc0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885dd20fed9f400c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1c3fff640 1 -- 172.21.15.146:0/2597312810 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc004840 con 0x555ede8fc790 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1c3fff640 1 -- 172.21.15.146:0/2597312810 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc1dc01cb70 con 0x555ede8fc790 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1f2238740 1 -- 172.21.15.146:0/2597312810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1e00679f0 con 0x555ede8fc790 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1c3fff640 1 -- 172.21.15.146:0/2597312810 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc1dc011e70 con 0x555ede8fc790 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1f2238740 10 client.6084 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.834+0000 7fc1f2238740 1 -- 172.21.15.146:0/2597312810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x555edea41390 con 0x555ede8fc790 2024-09-17T03:35:55.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.835+0000 7fc1c3fff640 1 -- 172.21.15.146:0/2597312810 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1e00679f0 con 0x555ede8fc790 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.835+0000 7fc1c3fff640 1 -- 172.21.15.146:0/2597312810 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fc1dc01c020 con 0x555ede8fc790 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.835+0000 7fc1f2238740 10 client.6084 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.835+0000 7fc1f2238740 10 client.6084 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.835+0000 7fc1f2238740 20 client.6084 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.835+0000 7fc1f2238740 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555ede8bb360 0x555edecebca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.835+0000 7fc1f2238740 4 client.6084 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.835+0000 7fc1f2238740 1 -- 172.21.15.146:0/2597312810 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555edec18bd0 con 0x555ede8bb360 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.835+0000 7fc1e9068640 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555ede8bb360 0x555edecebca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.835+0000 7fc1c3fff640 10 client.6084 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.835+0000 7fc1e9068640 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555ede8bb360 0x555edecebca0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68173e3d7b93294b server_cookie=e28f70e4e43f4a14 in_seq=0 out_seq=0 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1c3fff640 1 -- 172.21.15.146:0/2597312810 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555edec18bd0 con 0x555ede8bb360 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1c3fff640 10 client.6084 handle_command_reply: tid=0 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 1 client.6084 shutdown 2024-09-17T03:35:55.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 1 -- 172.21.15.146:0/2597312810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 msgr2=0x555edeceb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edeceb760 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0004780 tx=0x7fc1dc0117b0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 1 -- 172.21.15.146:0/2597312810 shutdown_connections 2024-09-17T03:35:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555ede8bb360 0x555edecebca0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8fc790 0x555edeceb760 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1c3fff640 0 client.6084 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8dbab0 0x555edecbdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 1 --2- 172.21.15.146:0/2597312810 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 0x555edece5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 1 -- 172.21.15.146:0/2597312810 >> 172.21.15.146:0/2597312810 conn(0x555ede8f08e0 msgr2=0x555edecc3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 1 -- 172.21.15.146:0/2597312810 shutdown_connections 2024-09-17T03:35:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 1 -- 172.21.15.146:0/2597312810 wait complete. 2024-09-17T03:35:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.836+0000 7fc1f2238740 20 client.6084 trim_cache size 0 max 16384 2024-09-17T03:35:55.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.854+0000 7fc1f2238740 1 Processor -- start 2024-09-17T03:35:55.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.854+0000 7fc1f2238740 1 -- start start 2024-09-17T03:35:55.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.855+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8bb360 0x555edec9cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 0x555edece9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8dbab0 0x555edece7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1f2238740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4200440 con 0x555ede8bb360 2024-09-17T03:35:55.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1f2238740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41ff420 con 0x555ede8d38d0 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1f2238740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e41f6370 con 0x555ede8dbab0 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1e9068640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8bb360 0x555edec9cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1e9068640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8bb360 0x555edec9cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54546/0 (socket says 172.21.15.146:54546) 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1e9068640 1 -- 172.21.15.146:0/707979359 learned_addr learned my addr 172.21.15.146:0/707979359 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1e9068640 1 -- 172.21.15.146:0/707979359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8dbab0 msgr2=0x555edece7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1e9068640 1 --2- 172.21.15.146:0/707979359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8dbab0 0x555edece7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1e9068640 1 -- 172.21.15.146:0/707979359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 msgr2=0x555edece9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1e9068640 1 --2- 172.21.15.146:0/707979359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 0x555edece9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1e9068640 1 -- 172.21.15.146:0/707979359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ede9def00 con 0x555ede8bb360 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1e9068640 1 --2- 172.21.15.146:0/707979359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8bb360 0x555edec9cfd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000c260 tx=0x7fc1e001c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a975ca9a42bc1987 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1ce7fc640 1 -- 172.21.15.146:0/707979359 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e001f040 con 0x555ede8bb360 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1ce7fc640 1 -- 172.21.15.146:0/707979359 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1e007d070 con 0x555ede8bb360 2024-09-17T03:35:55.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.856+0000 7fc1ce7fc640 1 -- 172.21.15.146:0/707979359 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e005edb0 con 0x555ede8bb360 2024-09-17T03:35:55.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.857+0000 7fc1f2238740 1 -- 172.21.15.146:0/707979359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8bb360 msgr2=0x555edec9cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.857+0000 7fc1f2238740 1 --2- 172.21.15.146:0/707979359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8bb360 0x555edec9cfd0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000c260 tx=0x7fc1e001c070 comp rx=0 tx=0).stop 2024-09-17T03:35:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.857+0000 7fc1f2238740 1 -- 172.21.15.146:0/707979359 shutdown_connections 2024-09-17T03:35:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.857+0000 7fc1f2238740 1 --2- 172.21.15.146:0/707979359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8dbab0 0x555edece7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.857+0000 7fc1f2238740 1 --2- 172.21.15.146:0/707979359 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 0x555edece9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.857+0000 7fc1f2238740 1 --2- 172.21.15.146:0/707979359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8bb360 0x555edec9cfd0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.857+0000 7fc1f2238740 1 -- 172.21.15.146:0/707979359 >> 172.21.15.146:0/707979359 conn(0x555ede8f08e0 msgr2=0x555edeca4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.857+0000 7fc1f2238740 1 -- 172.21.15.146:0/707979359 shutdown_connections 2024-09-17T03:35:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.857+0000 7fc1f2238740 1 -- 172.21.15.146:0/707979359 wait complete. 2024-09-17T03:35:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.858+0000 7fc1f2238740 1 -- start start 2024-09-17T03:35:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.858+0000 7fc1f2238740 1 Processor -- start 2024-09-17T03:35:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.859+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8bb360 0x555eded6fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.859+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 0x555eded096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.859+0000 7fc1f2238740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8dbab0 0x555eded6b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.859+0000 7fc1f2238740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41f69c0 con 0x555ede8dbab0 2024-09-17T03:35:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.859+0000 7fc1f2238740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x555edecc9550 con 0x555ede8d38d0 2024-09-17T03:35:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.859+0000 7fc1f2238740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x555eded0a1d0 con 0x555ede8bb360 2024-09-17T03:35:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.859+0000 7fc1f2238740 10 client.0 _ll_register_callbacks cb 0x7fc1dc003be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.859+0000 7fc1e9869640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8dbab0 0x555eded6b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1e9869640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8dbab0 0x555eded6b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54560/0 (socket says 172.21.15.146:54560) 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1e9869640 1 -- 172.21.15.146:0/233162774 learned_addr learned my addr 172.21.15.146:0/233162774 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1e8867640 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 0x555eded096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1e9068640 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8bb360 0x555eded6fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1e9869640 1 -- 172.21.15.146:0/233162774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8bb360 msgr2=0x555eded6fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1e9869640 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8bb360 0x555eded6fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1e9869640 1 -- 172.21.15.146:0/233162774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 msgr2=0x555eded096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1e9869640 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 0x555eded096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1e9869640 1 -- 172.21.15.146:0/233162774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555edece9e60 con 0x555ede8dbab0 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1e9068640 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8bb360 0x555eded6fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1e9869640 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8dbab0 0x555eded6b5b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc01c800 tx=0x7fc1dc011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7daa76be91b085 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1c3fff640 1 -- 172.21.15.146:0/233162774 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc004d20 con 0x555ede8dbab0 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1c3fff640 1 -- 172.21.15.146:0/233162774 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc1dc01c960 con 0x555ede8dbab0 2024-09-17T03:35:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1f2238740 1 -- 172.21.15.146:0/233162774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1e007d070 con 0x555ede8dbab0 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1c3fff640 1 -- 172.21.15.146:0/233162774 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc1dc01cb80 con 0x555ede8dbab0 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1f2238740 10 client.6090 fetch_fsmap learned FSMap version 21 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1f2238740 1 -- 172.21.15.146:0/233162774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x555eded09c20 con 0x555ede8dbab0 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.860+0000 7fc1c3fff640 1 -- 172.21.15.146:0/233162774 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1e007d070 con 0x555ede8dbab0 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.861+0000 7fc1c3fff640 1 -- 172.21.15.146:0/233162774 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fc1dc005020 con 0x555ede8dbab0 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.861+0000 7fc1f2238740 10 client.6090 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.861+0000 7fc1f2238740 10 client.6090 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.861+0000 7fc1f2238740 20 client.6090 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.861+0000 7fc1f2238740 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555ede8907a0 0x555edece72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.861+0000 7fc1f2238740 4 client.6090 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.861+0000 7fc1f2238740 1 -- 172.21.15.146:0/233162774 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x555edec14680 con 0x555ede8907a0 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.861+0000 7fc1e9068640 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555ede8907a0 0x555edece72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.861+0000 7fc1c3fff640 10 client.6090 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.861+0000 7fc1e9068640 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555ede8907a0 0x555edece72d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ff86b1fdca1c04a server_cookie=cdea9e0894b36baa in_seq=0 out_seq=0 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1c3fff640 1 -- 172.21.15.146:0/233162774 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555edec14680 con 0x555ede8907a0 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1c3fff640 10 client.6090 handle_command_reply: tid=0 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 1 client.6090 shutdown 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 1 -- 172.21.15.146:0/233162774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8dbab0 msgr2=0x555eded6b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8dbab0 0x555eded6b5b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc01c800 tx=0x7fc1dc011cb0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 1 -- 172.21.15.146:0/233162774 shutdown_connections 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x555ede8907a0 0x555edece72d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1c3fff640 0 client.6090 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555ede8dbab0 0x555eded6b5b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x555ede8d38d0 0x555eded096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 1 --2- 172.21.15.146:0/233162774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x555ede8bb360 0x555eded6fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 1 -- 172.21.15.146:0/233162774 >> 172.21.15.146:0/233162774 conn(0x555ede8f08e0 msgr2=0x555edece4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 1 -- 172.21.15.146:0/233162774 shutdown_connections 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 1 -- 172.21.15.146:0/233162774 wait complete. 2024-09-17T03:35:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.862+0000 7fc1f2238740 20 client.6090 trim_cache size 0 max 16384 2024-09-17T03:35:55.866 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:35:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "ab26b3ca-7d40-4d6f-89f7-ddbcb1b234d8", 2024-09-17T03:35:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:35:55.866 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:55.866 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-09-17T03:35:55.863+0000 7f57ae247640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4e [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v472 pv474 ap=4 s=0 n(v0 1=1+0)->n(v0 rc2024-09-17T03:35:55.142051+0000 b1048576 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={5102=0-4194304@1} caps={5102=pAsxLsXsxFcb/pAsxXsxFxwb@3},l=5102 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=0 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x55b0daa90680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000a4e:[<0x10000000001/new_file_1 v472>,<0x10000000000/ceph-qa-suite v57>,<0x1/scrub_test_path v19>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-17T03:35:55.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c8078bc0 msgr2=0x7fc1c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c8078bc0 0x7fc1c807b0d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40b7fe0 tx=0x7fc1d4001120 comp rx=0 tx=0).stop 2024-09-17T03:35:55.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2880927512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d0004800 msgr2=0x7fc1e41f3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d0004800 0x7fc1e41f3ea0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000e630 tx=0x7fc1e000eaf0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2880927512 shutdown_connections 2024-09-17T03:35:55.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc1c8078bc0 0x7fc1c807b0d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1e40a0390 0x7fc1e41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc1e41f43e0 0x7fc1e409fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 --2- 172.21.15.146:0/2880927512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1d0004800 0x7fc1e41f3ea0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2880927512 >> 172.21.15.146:0/2880927512 conn(0x7fc1e40b7b20 msgr2=0x7fc1e40b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2880927512 shutdown_connections 2024-09-17T03:35:55.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.863+0000 7fc1eb2cc640 1 -- 172.21.15.146:0/2880927512 wait complete. 2024-09-17T03:35:55.874 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': 'ab26b3ca-7d40-4d6f-89f7-ddbcb1b234d8', 'mode': 'asynchronous'}' 2024-09-17T03:35:55.874 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:35:55.874 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-17T03:35:55.906 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:35:55.907+0000 7f82d8420640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T03:35:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.990+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/1372560624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c0003fd0 msgr2=0x7fc3c0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.990+0000 7fc3d8d5e640 1 --2- 172.21.15.146:0/1372560624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3c0003fd0 0x7fc3c0004800 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009b50 tx=0x7fc3c0005830 comp rx=0 tx=0).stop 2024-09-17T03:35:55.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.990+0000 7fc3d2d9d640 1 -- 172.21.15.146:0/1372560624 reap_dead start 2024-09-17T03:35:55.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.990+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/1372560624 shutdown_connections 2024-09-17T03:35:55.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.990+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/1372560624 >> 172.21.15.146:0/1372560624 conn(0x7fc3d40b7b20 msgr2=0x7fc3d409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:55.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.990+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/1372560624 shutdown_connections 2024-09-17T03:35:55.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.990+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/1372560624 wait complete. 2024-09-17T03:35:55.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.992+0000 7fc3d8d5e640 1 Processor -- start 2024-09-17T03:35:55.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.992+0000 7fc3d8d5e640 1 -- start start 2024-09-17T03:35:55.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d8d5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3c0003fd0 0x7fc3d40b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d8d5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b2ab0 0x7fc3d41f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d8d5e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d41f7280 0x7fc3d413fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d8d5e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d40afff0 con 0x7fc3d41f7280 2024-09-17T03:35:55.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d8d5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d415dcc0 con 0x7fc3c0003fd0 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d8d5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d40b3620 con 0x7fc3d40b2ab0 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d41f7280 0x7fc3d413fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d41f7280 0x7fc3d413fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54574/0 (socket says 172.21.15.146:54574) 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d2d9d640 1 -- 172.21.15.146:0/3224512756 learned_addr learned my addr 172.21.15.146:0/3224512756 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d259c640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3c0003fd0 0x7fc3d40b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3c9d9b640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b2ab0 0x7fc3d41f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d2d9d640 1 -- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b2ab0 msgr2=0x7fc3d41f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d2d9d640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b2ab0 0x7fc3d41f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d2d9d640 1 -- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3c0003fd0 msgr2=0x7fc3d40b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d2d9d640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3c0003fd0 0x7fc3d40b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d2d9d640 1 -- 172.21.15.146:0/3224512756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d41f7a70 con 0x7fc3d41f7280 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.994+0000 7fc3d2d9d640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d41f7280 0x7fc3d413fe70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40b7980 tx=0x7fc3cc006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.995+0000 7fc3cb7fe640 1 -- 172.21.15.146:0/3224512756 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00fa20 con 0x7fc3d41f7280 2024-09-17T03:35:55.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.995+0000 7fc3cb7fe640 1 -- 172.21.15.146:0/3224512756 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3cc019070 con 0x7fc3d41f7280 2024-09-17T03:35:55.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.995+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/3224512756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d40c8510 con 0x7fc3d41f7280 2024-09-17T03:35:55.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.995+0000 7fc3cb7fe640 1 -- 172.21.15.146:0/3224512756 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00fe60 con 0x7fc3d41f7280 2024-09-17T03:35:55.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.995+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/3224512756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d40ca070 con 0x7fc3d41f7280 2024-09-17T03:35:55.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.996+0000 7fc3cb7fe640 1 -- 172.21.15.146:0/3224512756 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc3cc01e460 con 0x7fc3d41f7280 2024-09-17T03:35:55.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.997+0000 7fc3cb7fe640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc3b4078b90 0x7fc3b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.997+0000 7fc3cb7fe640 1 -- 172.21.15.146:0/3224512756 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc3cc09b0e0 con 0x7fc3d41f7280 2024-09-17T03:35:55.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.997+0000 7fc3d259c640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc3b4078b90 0x7fc3b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:55.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.998+0000 7fc3dfccc740 1 Processor -- start 2024-09-17T03:35:55.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.998+0000 7fc3d259c640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc3b4078b90 0x7fc3b407b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009d70 tx=0x7fc3c4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:55.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.998+0000 7fc3dfccc740 1 -- start start 2024-09-17T03:35:55.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e521a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 0x55807e4f6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e1146b0 0x55807e4f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:55.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55807e44fa60 con 0x55807e135390 2024-09-17T03:35:55.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55807e43ee90 con 0x55807e1146b0 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55807e442ca0 con 0x55807e10c4d0 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3d259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e521a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3d259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e521a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54584/0 (socket says 172.21.15.146:54584) 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3d259c640 1 -- 172.21.15.146:0/1149266735 learned_addr learned my addr 172.21.15.146:0/1149266735 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3d2d9d640 1 --2- 172.21.15.146:0/1149266735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e1146b0 0x55807e4f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3c9d9b640 1 --2- 172.21.15.146:0/1149266735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 0x55807e4f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3d259c640 1 -- 172.21.15.146:0/1149266735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 msgr2=0x55807e4f6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3d259c640 1 --2- 172.21.15.146:0/1149266735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 0x55807e4f6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3d259c640 1 -- 172.21.15.146:0/1149266735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e1146b0 msgr2=0x55807e4f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:55.999+0000 7fc3d259c640 1 --2- 172.21.15.146:0/1149266735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e1146b0 0x55807e4f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.000+0000 7fc3d259c640 1 -- 172.21.15.146:0/1149266735 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807e2177d0 con 0x55807e135390 2024-09-17T03:35:56.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.000+0000 7fc3d259c640 1 --2- 172.21.15.146:0/1149266735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e521a10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40205c0 tx=0x7fc3c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da97c3a2d90ed06 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:56.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.000+0000 7fc3b3fff640 1 -- 172.21.15.146:0/1149266735 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4011500 con 0x55807e135390 2024-09-17T03:35:56.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.000+0000 7fc3b3fff640 1 -- 172.21.15.146:0/1149266735 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3c40116a0 con 0x55807e135390 2024-09-17T03:35:56.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.000+0000 7fc3b3fff640 1 -- 172.21.15.146:0/1149266735 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4011870 con 0x55807e135390 2024-09-17T03:35:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.001+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1149266735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 msgr2=0x55807e521a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.001+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1149266735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e521a10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40205c0 tx=0x7fc3c4017000 comp rx=0 tx=0).stop 2024-09-17T03:35:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.001+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1149266735 shutdown_connections 2024-09-17T03:35:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.001+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1149266735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e1146b0 0x55807e4f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.001+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1149266735 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 0x55807e4f6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.001+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1149266735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e521a10 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.001+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1149266735 >> 172.21.15.146:0/1149266735 conn(0x55807e1294e0 msgr2=0x55807e4dcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.001+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1149266735 shutdown_connections 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.001+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1149266735 wait complete. 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.002+0000 7fc3dfccc740 1 -- start start 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.002+0000 7fc3dfccc740 1 Processor -- start 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.003+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 0x55807e4f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.003+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e1146b0 0x55807e4f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.003+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e135390 0x55807e4dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.003+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55807e1af740 con 0x55807e1146b0 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.003+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55807e3e4970 con 0x55807e135390 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.003+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55807e4f4cb0 con 0x55807e10c4d0 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.003+0000 7fc3dfccc740 10 client.0 _ll_register_callbacks cb 0x55807e3f3780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.003+0000 7fc3c9d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e1146b0 0x55807e4f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.003+0000 7fc3c9d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e1146b0 0x55807e4f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54596/0 (socket says 172.21.15.146:54596) 2024-09-17T03:35:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.003+0000 7fc3c9d9b640 1 -- 172.21.15.146:0/2311762350 learned_addr learned my addr 172.21.15.146:0/2311762350 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.003+0000 7fc3d259c640 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 0x55807e4f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3d2d9d640 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e135390 0x55807e4dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3c9d9b640 1 -- 172.21.15.146:0/2311762350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 msgr2=0x55807e4f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3c9d9b640 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 0x55807e4f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3c9d9b640 1 -- 172.21.15.146:0/2311762350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e135390 msgr2=0x55807e4dbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3c9d9b640 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e135390 0x55807e4dbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3c9d9b640 1 -- 172.21.15.146:0/2311762350 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807e1a0970 con 0x55807e1146b0 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3c9d9b640 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e1146b0 0x55807e4f56a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009c70 tx=0x7fc3bc004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c9624d19879f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3b17fa640 1 -- 172.21.15.146:0/2311762350 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc043070 con 0x55807e1146b0 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3b17fa640 1 -- 172.21.15.146:0/2311762350 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc3bc02b9e0 con 0x55807e1146b0 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3dfccc740 1 -- 172.21.15.146:0/2311762350 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3c40116a0 con 0x55807e1146b0 2024-09-17T03:35:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3b17fa640 1 -- 172.21.15.146:0/2311762350 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc3bc050050 con 0x55807e1146b0 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3dfccc740 10 client.6102 fetch_fsmap learned FSMap version 22 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3dfccc740 1 -- 172.21.15.146:0/2311762350 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55807e17e6a0 con 0x55807e1146b0 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3b17fa640 1 -- 172.21.15.146:0/2311762350 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3c40116a0 con 0x55807e1146b0 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3b17fa640 1 -- 172.21.15.146:0/2311762350 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7fc3bc053020 con 0x55807e1146b0 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.004+0000 7fc3dfccc740 10 client.6102 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.005+0000 7fc3dfccc740 10 client.6102 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.005+0000 7fc3dfccc740 20 client.6102 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.005+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55807e0f3f60 0x55807e4f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.005+0000 7fc3dfccc740 4 client.6102 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.005+0000 7fc3dfccc740 1 -- 172.21.15.146:0/2311762350 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55807e4519b0 con 0x55807e0f3f60 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.005+0000 7fc3d259c640 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55807e0f3f60 0x55807e4f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.005+0000 7fc3b17fa640 10 client.6102 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.005+0000 7fc3d259c640 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55807e0f3f60 0x55807e4f3db0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81ec3644ee0f0e1c server_cookie=554efd78948b4c6f in_seq=0 out_seq=0 2024-09-17T03:35:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3b17fa640 1 -- 172.21.15.146:0/2311762350 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55807e4519b0 con 0x55807e0f3f60 2024-09-17T03:35:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3b17fa640 10 client.6102 handle_command_reply: tid=0 2024-09-17T03:35:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 1 client.6102 shutdown 2024-09-17T03:35:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 1 -- 172.21.15.146:0/2311762350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e1146b0 msgr2=0x55807e4f56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e1146b0 0x55807e4f56a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009c70 tx=0x7fc3bc004460 comp rx=0 tx=0).stop 2024-09-17T03:35:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 1 -- 172.21.15.146:0/2311762350 shutdown_connections 2024-09-17T03:35:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55807e0f3f60 0x55807e4f3db0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e135390 0x55807e4dbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e1146b0 0x55807e4f56a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/2311762350 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 0x55807e4f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3b17fa640 0 client.6102 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 1 -- 172.21.15.146:0/2311762350 >> 172.21.15.146:0/2311762350 conn(0x55807e1294e0 msgr2=0x55807e4d7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 1 -- 172.21.15.146:0/2311762350 shutdown_connections 2024-09-17T03:35:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 1 -- 172.21.15.146:0/2311762350 wait complete. 2024-09-17T03:35:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.006+0000 7fc3dfccc740 20 client.6102 trim_cache size 0 max 16384 2024-09-17T03:35:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.024+0000 7fc3dfccc740 1 Processor -- start 2024-09-17T03:35:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.024+0000 7fc3dfccc740 1 -- start start 2024-09-17T03:35:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e10c4d0 0x55807e4f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e1146b0 0x55807e4d7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e135390 0x55807e5447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d4200720 con 0x55807e10c4d0 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d41ff780 con 0x55807e135390 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d40c9b40 con 0x55807e1146b0 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3d259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e10c4d0 0x55807e4f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3d259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e10c4d0 0x55807e4f57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54612/0 (socket says 172.21.15.146:54612) 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3d259c640 1 -- 172.21.15.146:0/1571147702 learned_addr learned my addr 172.21.15.146:0/1571147702 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3d259c640 1 -- 172.21.15.146:0/1571147702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e1146b0 msgr2=0x55807e4d7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3d259c640 1 --2- 172.21.15.146:0/1571147702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e1146b0 0x55807e4d7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3d259c640 1 -- 172.21.15.146:0/1571147702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e135390 msgr2=0x55807e5447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3d259c640 1 --2- 172.21.15.146:0/1571147702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e135390 0x55807e5447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3d259c640 1 -- 172.21.15.146:0/1571147702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807e5249b0 con 0x55807e10c4d0 2024-09-17T03:35:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.025+0000 7fc3d259c640 1 --2- 172.21.15.146:0/1571147702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e10c4d0 0x55807e4f57e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4004650 tx=0x7fc3c4022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e6593eb2438201 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3b37fe640 1 -- 172.21.15.146:0/1571147702 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4040070 con 0x55807e10c4d0 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3b37fe640 1 -- 172.21.15.146:0/1571147702 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3c4004030 con 0x55807e10c4d0 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3b37fe640 1 -- 172.21.15.146:0/1571147702 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4004460 con 0x55807e10c4d0 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1571147702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e10c4d0 msgr2=0x55807e4f57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1571147702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e10c4d0 0x55807e4f57e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4004650 tx=0x7fc3c4022040 comp rx=0 tx=0).stop 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1571147702 shutdown_connections 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1571147702 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e135390 0x55807e5447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1571147702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e1146b0 0x55807e4d7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1571147702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e10c4d0 0x55807e4f57e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1571147702 >> 172.21.15.146:0/1571147702 conn(0x55807e1294e0 msgr2=0x55807e51b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1571147702 shutdown_connections 2024-09-17T03:35:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.026+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1571147702 wait complete. 2024-09-17T03:35:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.027+0000 7fc3dfccc740 1 -- start start 2024-09-17T03:35:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.027+0000 7fc3dfccc740 1 Processor -- start 2024-09-17T03:35:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 0x55807e59f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e1146b0 0x55807e534d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3dfccc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e5a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d41ff1c0 con 0x55807e135390 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55807e535760 con 0x55807e1146b0 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3dfccc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55807e59f9e0 con 0x55807e10c4d0 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3dfccc740 10 client.0 _ll_register_callbacks cb 0x7fc3c000b9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3d2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e5a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3d2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e5a5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54624/0 (socket says 172.21.15.146:54624) 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3d2d9d640 1 -- 172.21.15.146:0/1493539713 learned_addr learned my addr 172.21.15.146:0/1493539713 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3d2d9d640 1 -- 172.21.15.146:0/1493539713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 msgr2=0x55807e59f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3d2d9d640 1 --2- 172.21.15.146:0/1493539713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 0x55807e59f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3d2d9d640 1 -- 172.21.15.146:0/1493539713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e1146b0 msgr2=0x55807e534d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3d2d9d640 1 --2- 172.21.15.146:0/1493539713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e1146b0 0x55807e534d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3d2d9d640 1 -- 172.21.15.146:0/1493539713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807e544ae0 con 0x55807e135390 2024-09-17T03:35:56.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3d2d9d640 1 --2- 172.21.15.146:0/1493539713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e5a5d10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc062e90 tx=0x7fc3cc0634a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688dc5bbc52bce30 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3b17fa640 1 -- 172.21.15.146:0/1493539713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc062360 con 0x55807e135390 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3b17fa640 1 -- 172.21.15.146:0/1493539713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc3cc05e850 con 0x55807e135390 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.029+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1493539713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3c4004030 con 0x55807e135390 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3b17fa640 1 -- 172.21.15.146:0/1493539713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc3cc062a10 con 0x55807e135390 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3dfccc740 10 client.6108 fetch_fsmap learned FSMap version 22 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1493539713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55807e4d81b0 con 0x55807e135390 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3b17fa640 1 -- 172.21.15.146:0/1493539713 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3c4004030 con 0x55807e135390 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3b17fa640 1 -- 172.21.15.146:0/1493539713 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7fc3cc061bd0 con 0x55807e135390 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3dfccc740 10 client.6108 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3dfccc740 10 client.6108 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3dfccc740 20 client.6108 populate_metadata read hostname 'smithi146' 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1493539713 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55807e5a6250 0x55807e4d5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:35:56.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3dfccc740 4 client.6108 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1493539713 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55807e44d460 con 0x55807e5a6250 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3d259c640 1 --2- 172.21.15.146:0/1493539713 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55807e5a6250 0x55807e4d5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.030+0000 7fc3b17fa640 10 client.6108 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3d259c640 1 --2- 172.21.15.146:0/1493539713 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55807e5a6250 0x55807e4d5dd0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d62f7b5c35f3369 server_cookie=54a53138fff4537 in_seq=0 out_seq=0 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3b17fa640 1 -- 172.21.15.146:0/1493539713 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3494 (crc 0 0 0) 0x55807e44d460 con 0x55807e5a6250 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3b17fa640 10 client.6108 handle_command_reply: tid=0 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 1 client.6108 shutdown 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1493539713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 msgr2=0x55807e5a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1493539713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e5a5d10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc062e90 tx=0x7fc3cc0634a0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1493539713 shutdown_connections 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1493539713 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55807e5a6250 0x55807e4d5dd0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1493539713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55807e135390 0x55807e5a5d10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3b17fa640 0 client.6108 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:35:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1493539713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55807e1146b0 0x55807e534d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 1 --2- 172.21.15.146:0/1493539713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55807e10c4d0 0x55807e59f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1493539713 >> 172.21.15.146:0/1493539713 conn(0x55807e1294e0 msgr2=0x55807e51b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1493539713 shutdown_connections 2024-09-17T03:35:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 1 -- 172.21.15.146:0/1493539713 wait complete. 2024-09-17T03:35:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.031+0000 7fc3dfccc740 20 client.6108 trim_cache size 0 max 16384 2024-09-17T03:35:56.035 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:35:56.035 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:35:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:35:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: "7d980207-f21b-4228-8400-5f563b3039a8": { 2024-09-17T03:35:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T03:35:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "7d980207-f21b-4228-8400-5f563b3039a8", 2024-09-17T03:35:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "" 2024-09-17T03:35:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: "8c57da53-316b-417c-92f0-f4d2d8dbb831": { 2024-09-17T03:35:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T03:35:56.036 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "8c57da53-316b-417c-92f0-f4d2d8dbb831", 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "" 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: "ab26b3ca-7d40-4d6f-89f7-ddbcb1b234d8": { 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "ab26b3ca-7d40-4d6f-89f7-ddbcb1b234d8", 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "" 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: "d30771c4-5098-4b0b-8120-122396d8fc4a": { 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "d30771c4-5098-4b0b-8120-122396d8fc4a", 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "" 2024-09-17T03:35:56.037 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: "ab26b3ca-7d40-4d6f-89f7-ddbcb1b234d8": { 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:55.861039+0000", 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: "8c57da53-316b-417c-92f0-f4d2d8dbb831": { 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:54.654058+0000", 2024-09-17T03:35:56.038 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "7d980207-f21b-4228-8400-5f563b3039a8": { 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:54.485061+0000", 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "f9d6b976-53b1-4d14-bae0-a072551d0c46": { 2024-09-17T03:35:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:47.625167+0000", 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "d30771c4-5098-4b0b-8120-122396d8fc4a": { 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:54.827055+0000", 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:56.040 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: "adfb75e5-b911-4f8d-a47c-c41436f4748a": { 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:46.587183+0000", 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: "d88b3f93-07b9-4851-80e0-841d2041b343": { 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:46.231188+0000", 2024-09-17T03:35:56.041 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: "dee09f00-18b7-4525-8418-50d2c01a47aa": { 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:45.892193+0000", 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:35:56.042 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:56.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:35:56.043 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:35:56.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc3b4078b90 msgr2=0x7fc3b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc3b4078b90 0x7fc3b407b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009d70 tx=0x7fc3c4005f90 comp rx=0 tx=0).stop 2024-09-17T03:35:56.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/3224512756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d41f7280 msgr2=0x7fc3d413fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:35:56.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d41f7280 0x7fc3d413fe70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40b7980 tx=0x7fc3cc006660 comp rx=0 tx=0).stop 2024-09-17T03:35:56.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/3224512756 shutdown_connections 2024-09-17T03:35:56.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc3b4078b90 0x7fc3b407b0a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d41f7280 0x7fc3d413fe70 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3d40b2ab0 0x7fc3d41f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 --2- 172.21.15.146:0/3224512756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3c0003fd0 0x7fc3d40b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:35:56.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/3224512756 >> 172.21.15.146:0/3224512756 conn(0x7fc3d40b7b20 msgr2=0x7fc3d415f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:35:56.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/3224512756 shutdown_connections 2024-09-17T03:35:56.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:35:56.032+0000 7fc3d8d5e640 1 -- 172.21.15.146:0/3224512756 wait complete. 2024-09-17T03:35:56.918 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:35:56.921 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:36:01.047 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:36:01.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-17T03:36:01.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.176+0000 7f8f43307640 1 -- 172.21.15.146:0/1664349173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c06e990 msgr2=0x7f8f3c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.176+0000 7f8f43307640 1 --2- 172.21.15.146:0/1664349173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c06e990 0x7f8f3c06eda0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009830 tx=0x7f8f3002a510 comp rx=0 tx=0).stop 2024-09-17T03:36:01.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.176+0000 7f8f43307640 1 -- 172.21.15.146:0/1664349173 shutdown_connections 2024-09-17T03:36:01.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.176+0000 7f8f43307640 1 --2- 172.21.15.146:0/1664349173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c06e990 0x7f8f3c06eda0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.176+0000 7f8f43307640 1 -- 172.21.15.146:0/1664349173 >> 172.21.15.146:0/1664349173 conn(0x7f8f3c0b7b20 msgr2=0x7f8f3c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.176+0000 7f8f43307640 1 -- 172.21.15.146:0/1664349173 shutdown_connections 2024-09-17T03:36:01.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.176+0000 7f8f43307640 1 -- 172.21.15.146:0/1664349173 wait complete. 2024-09-17T03:36:01.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.178+0000 7f8f43307640 1 Processor -- start 2024-09-17T03:36:01.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.178+0000 7f8f43307640 1 -- start start 2024-09-17T03:36:01.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f43307640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c06e990 0x7f8f3c166d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f43307640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f3c15ef10 0x7f8f3c1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f43307640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f3c1668a0 0x7f8f3c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f43307640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c0b75f0 con 0x7f8f3c06e990 2024-09-17T03:36:01.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f43307640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c0b7470 con 0x7f8f3c15ef10 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f43307640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c16a3e0 con 0x7f8f3c1668a0 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f410a3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c06e990 0x7f8f3c166d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f410a3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c06e990 0x7f8f3c166d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39942/0 (socket says 172.21.15.146:39942) 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f410a3640 1 -- 172.21.15.146:0/1810084195 learned_addr learned my addr 172.21.15.146:0/1810084195 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f408a2640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f3c15ef10 0x7f8f3c1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f410a3640 1 -- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f3c1668a0 msgr2=0x7f8f3c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f410a3640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f3c1668a0 0x7f8f3c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f410a3640 1 -- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f3c15ef10 msgr2=0x7f8f3c1520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f410a3640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f3c15ef10 0x7f8f3c1520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.179+0000 7f8f410a3640 1 -- 172.21.15.146:0/1810084195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c15b0d0 con 0x7f8f3c06e990 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.180+0000 7f8f410a3640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c06e990 0x7f8f3c166d20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00ba80 tx=0x7f8f2c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.180+0000 7f8f39ffb640 1 -- 172.21.15.146:0/1810084195 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c019070 con 0x7f8f3c06e990 2024-09-17T03:36:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.180+0000 7f8f39ffb640 1 -- 172.21.15.146:0/1810084195 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f2c00cd20 con 0x7f8f3c06e990 2024-09-17T03:36:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.180+0000 7f8f43307640 1 -- 172.21.15.146:0/1810084195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3c169250 con 0x7f8f3c06e990 2024-09-17T03:36:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.180+0000 7f8f39ffb640 1 -- 172.21.15.146:0/1810084195 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0146a0 con 0x7f8f3c06e990 2024-09-17T03:36:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.180+0000 7f8f43307640 1 -- 172.21.15.146:0/1810084195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3c169810 con 0x7f8f3c06e990 2024-09-17T03:36:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.182+0000 7f8f39ffb640 1 -- 172.21.15.146:0/1810084195 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f2c01c070 con 0x7f8f3c06e990 2024-09-17T03:36:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.182+0000 7f8f39ffb640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f28078b90 0x7f8f2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.182+0000 7f8f39ffb640 1 -- 172.21.15.146:0/1810084195 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f8f2c09abf0 con 0x7f8f3c06e990 2024-09-17T03:36:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.183+0000 7f8f408a2640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f28078b90 0x7f8f2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.183+0000 7f8f408a2640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f28078b90 0x7f8f2807b0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f30034000 tx=0x7f8f30004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.183+0000 7f8f4a272740 1 Processor -- start 2024-09-17T03:36:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.183+0000 7f8f4a272740 1 -- start start 2024-09-17T03:36:01.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d00766390 0x563d00b37740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d0073d4d0 0x563d00b37c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d007456b0 0x563d00b54b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f4a272740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563d00a80a60 con 0x563d00766390 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f4a272740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563d00a6fe90 con 0x563d0073d4d0 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f4a272740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x563d00a73ca0 con 0x563d007456b0 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f410a3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d00766390 0x563d00b37740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f410a3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d00766390 0x563d00b37740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39944/0 (socket says 172.21.15.146:39944) 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f410a3640 1 -- 172.21.15.146:0/154837795 learned_addr learned my addr 172.21.15.146:0/154837795 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f408a2640 1 --2- 172.21.15.146:0/154837795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d0073d4d0 0x563d00b37c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f418a4640 1 --2- 172.21.15.146:0/154837795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d007456b0 0x563d00b54b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f410a3640 1 -- 172.21.15.146:0/154837795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d007456b0 msgr2=0x563d00b54b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f410a3640 1 --2- 172.21.15.146:0/154837795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d007456b0 0x563d00b54b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f410a3640 1 -- 172.21.15.146:0/154837795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d0073d4d0 msgr2=0x563d00b37c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f410a3640 1 --2- 172.21.15.146:0/154837795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d0073d4d0 0x563d00b37c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f410a3640 1 -- 172.21.15.146:0/154837795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d008487d0 con 0x563d00766390 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f410a3640 1 --2- 172.21.15.146:0/154837795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d00766390 0x563d00b37740 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c099080 tx=0x7f8f2c062120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1690e236a9db877 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f22ffd640 1 -- 172.21.15.146:0/154837795 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0628f0 con 0x563d00766390 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f22ffd640 1 -- 172.21.15.146:0/154837795 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f2c0673d0 con 0x563d00766390 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.185+0000 7f8f22ffd640 1 -- 172.21.15.146:0/154837795 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c06c0e0 con 0x563d00766390 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.186+0000 7f8f4a272740 1 -- 172.21.15.146:0/154837795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d00766390 msgr2=0x563d00b37740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.186+0000 7f8f4a272740 1 --2- 172.21.15.146:0/154837795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d00766390 0x563d00b37740 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c099080 tx=0x7f8f2c062120 comp rx=0 tx=0).stop 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.186+0000 7f8f4a272740 1 -- 172.21.15.146:0/154837795 shutdown_connections 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.186+0000 7f8f4a272740 1 --2- 172.21.15.146:0/154837795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d007456b0 0x563d00b54b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.186+0000 7f8f4a272740 1 --2- 172.21.15.146:0/154837795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d0073d4d0 0x563d00b37c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.186+0000 7f8f4a272740 1 --2- 172.21.15.146:0/154837795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d00766390 0x563d00b37740 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.186+0000 7f8f4a272740 1 -- 172.21.15.146:0/154837795 >> 172.21.15.146:0/154837795 conn(0x563d0075a4e0 msgr2=0x563d00b0da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.186+0000 7f8f4a272740 1 -- 172.21.15.146:0/154837795 shutdown_connections 2024-09-17T03:36:01.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.186+0000 7f8f4a272740 1 -- 172.21.15.146:0/154837795 wait complete. 2024-09-17T03:36:01.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.187+0000 7f8f4a272740 1 -- start start 2024-09-17T03:36:01.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.187+0000 7f8f4a272740 1 Processor -- start 2024-09-17T03:36:01.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00b49330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d007456b0 0x563d00b4b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d00766390 0x563d00b4db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f4a272740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563d007e0740 con 0x563d0073d4d0 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f4a272740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563d00a15970 con 0x563d007456b0 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f4a272740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x563d00b381c0 con 0x563d00766390 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f4a272740 10 client.0 _ll_register_callbacks cb 0x563d00a18be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f410a3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00b49330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f410a3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00b49330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39956/0 (socket says 172.21.15.146:39956) 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f410a3640 1 -- 172.21.15.146:0/860000618 learned_addr learned my addr 172.21.15.146:0/860000618 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f408a2640 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d007456b0 0x563d00b4b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f418a4640 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d00766390 0x563d00b4db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f410a3640 1 -- 172.21.15.146:0/860000618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d00766390 msgr2=0x563d00b4db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f410a3640 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d00766390 0x563d00b4db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f410a3640 1 -- 172.21.15.146:0/860000618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d007456b0 msgr2=0x563d00b4b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f410a3640 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d007456b0 0x563d00b4b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f410a3640 1 -- 172.21.15.146:0/860000618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d007d1970 con 0x563d0073d4d0 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f418a4640 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d00766390 0x563d00b4db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f410a3640 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00b49330 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c013000 tx=0x7f8f2c06c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f4657f66995672 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f1bfff640 1 -- 172.21.15.146:0/860000618 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c05e240 con 0x563d0073d4d0 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f1bfff640 1 -- 172.21.15.146:0/860000618 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f8f2c05e3e0 con 0x563d0073d4d0 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.189+0000 7f8f4a272740 1 -- 172.21.15.146:0/860000618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f2c0673d0 con 0x563d0073d4d0 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f1bfff640 1 -- 172.21.15.146:0/860000618 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8f2c0615c0 con 0x563d0073d4d0 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f4a272740 10 client.6123 fetch_fsmap learned FSMap version 22 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f4a272740 1 -- 172.21.15.146:0/860000618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x563d007af6a0 con 0x563d0073d4d0 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f1bfff640 1 -- 172.21.15.146:0/860000618 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f2c0673d0 con 0x563d0073d4d0 2024-09-17T03:36:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f1bfff640 1 -- 172.21.15.146:0/860000618 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f8f2c061760 con 0x563d0073d4d0 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f4a272740 10 client.6123 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f4a272740 10 client.6123 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f4a272740 20 client.6123 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f4a272740 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x563d00724f60 0x563d00b4b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f4a272740 4 client.6123 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f4a272740 1 -- 172.21.15.146:0/860000618 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d00a829b0 con 0x563d00724f60 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f408a2640 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x563d00724f60 0x563d00b4b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f1bfff640 10 client.6123 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.190+0000 7f8f408a2640 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x563d00724f60 0x563d00b4b730 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6133483556eee68 server_cookie=131d31a9f6daae66 in_seq=0 out_seq=0 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f1bfff640 1 -- 172.21.15.146:0/860000618 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d00a829b0 con 0x563d00724f60 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f1bfff640 10 client.6123 handle_command_reply: tid=0 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f4a272740 1 client.6123 shutdown 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f4a272740 1 -- 172.21.15.146:0/860000618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 msgr2=0x563d00b49330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f4a272740 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00b49330 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c013000 tx=0x7f8f2c06c130 comp rx=0 tx=0).stop 2024-09-17T03:36:01.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f4a272740 1 -- 172.21.15.146:0/860000618 shutdown_connections 2024-09-17T03:36:01.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f4a272740 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x563d00724f60 0x563d00b4b730 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f4a272740 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d00766390 0x563d00b4db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f4a272740 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d007456b0 0x563d00b4b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f1bfff640 0 client.6123 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f4a272740 1 --2- 172.21.15.146:0/860000618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00b49330 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f4a272740 1 -- 172.21.15.146:0/860000618 >> 172.21.15.146:0/860000618 conn(0x563d0075a4e0 msgr2=0x563d00b54150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.191+0000 7f8f4a272740 1 -- 172.21.15.146:0/860000618 shutdown_connections 2024-09-17T03:36:01.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.192+0000 7f8f4a272740 1 -- 172.21.15.146:0/860000618 wait complete. 2024-09-17T03:36:01.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.192+0000 7f8f4a272740 20 client.6123 trim_cache size 0 max 16384 2024-09-17T03:36:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.209+0000 7f8f4a272740 1 Processor -- start 2024-09-17T03:36:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.209+0000 7f8f4a272740 1 -- start start 2024-09-17T03:36:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.210+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d0073d4d0 0x563d00b08740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d007456b0 0x563d00b4edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d00766390 0x563d00b61c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f4a272740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c2025c0 con 0x563d007456b0 2024-09-17T03:36:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f4a272740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c2015e0 con 0x563d0073d4d0 2024-09-17T03:36:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f4a272740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c1512c0 con 0x563d00766390 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f408a2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d007456b0 0x563d00b4edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f408a2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d007456b0 0x563d00b4edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39970/0 (socket says 172.21.15.146:39970) 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f408a2640 1 -- 172.21.15.146:0/3308428455 learned_addr learned my addr 172.21.15.146:0/3308428455 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f408a2640 1 -- 172.21.15.146:0/3308428455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d00766390 msgr2=0x563d00b61c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f408a2640 1 --2- 172.21.15.146:0/3308428455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d00766390 0x563d00b61c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f408a2640 1 -- 172.21.15.146:0/3308428455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d0073d4d0 msgr2=0x563d00b08740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f410a3640 1 --2- 172.21.15.146:0/3308428455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d0073d4d0 0x563d00b08740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f408a2640 1 --2- 172.21.15.146:0/3308428455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d0073d4d0 0x563d00b08740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f408a2640 1 -- 172.21.15.146:0/3308428455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d00b611f0 con 0x563d007456b0 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f408a2640 1 --2- 172.21.15.146:0/3308428455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d007456b0 0x563d00b4edd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009920 tx=0x7f8f3003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4317b50a88420d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f227fc640 1 -- 172.21.15.146:0/3308428455 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30003b80 con 0x563d007456b0 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f227fc640 1 -- 172.21.15.146:0/3308428455 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f30003d20 con 0x563d007456b0 2024-09-17T03:36:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.211+0000 7f8f227fc640 1 -- 172.21.15.146:0/3308428455 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30048640 con 0x563d007456b0 2024-09-17T03:36:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.212+0000 7f8f4a272740 1 -- 172.21.15.146:0/3308428455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d007456b0 msgr2=0x563d00b4edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.212+0000 7f8f4a272740 1 --2- 172.21.15.146:0/3308428455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d007456b0 0x563d00b4edd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009920 tx=0x7f8f3003c000 comp rx=0 tx=0).stop 2024-09-17T03:36:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.212+0000 7f8f4a272740 1 -- 172.21.15.146:0/3308428455 shutdown_connections 2024-09-17T03:36:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.212+0000 7f8f4a272740 1 --2- 172.21.15.146:0/3308428455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d00766390 0x563d00b61c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.212+0000 7f8f4a272740 1 --2- 172.21.15.146:0/3308428455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d007456b0 0x563d00b4edd0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.212+0000 7f8f4a272740 1 --2- 172.21.15.146:0/3308428455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d0073d4d0 0x563d00b08740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.212+0000 7f8f4a272740 1 -- 172.21.15.146:0/3308428455 >> 172.21.15.146:0/3308428455 conn(0x563d0075a4e0 msgr2=0x563d00b4b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.212+0000 7f8f4a272740 1 -- 172.21.15.146:0/3308428455 shutdown_connections 2024-09-17T03:36:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.212+0000 7f8f4a272740 1 -- 172.21.15.146:0/3308428455 wait complete. 2024-09-17T03:36:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.213+0000 7f8f4a272740 1 -- start start 2024-09-17T03:36:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.213+0000 7f8f4a272740 1 Processor -- start 2024-09-17T03:36:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.214+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00bcbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.214+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d007456b0 0x563d00b61bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.214+0000 7f8f4a272740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d00766390 0x563d00b62110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.214+0000 7f8f4a272740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563d00b4dac0 con 0x563d0073d4d0 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.214+0000 7f8f4a272740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c201060 con 0x563d00766390 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.214+0000 7f8f4a272740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x563d00b4a740 con 0x563d007456b0 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f4a272740 10 client.0 _ll_register_callbacks cb 0x7f8f2c0622d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f410a3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00bcbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f410a3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00bcbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39984/0 (socket says 172.21.15.146:39984) 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f410a3640 1 -- 172.21.15.146:0/259880913 learned_addr learned my addr 172.21.15.146:0/259880913 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f418a4640 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d00766390 0x563d00b62110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f408a2640 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d007456b0 0x563d00b61bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f410a3640 1 -- 172.21.15.146:0/259880913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d007456b0 msgr2=0x563d00b61bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f410a3640 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d007456b0 0x563d00b61bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f410a3640 1 -- 172.21.15.146:0/259880913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d00766390 msgr2=0x563d00b62110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f410a3640 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d00766390 0x563d00b62110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f410a3640 1 -- 172.21.15.146:0/259880913 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d00b37690 con 0x563d0073d4d0 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f410a3640 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00bcbb00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00bfd0 tx=0x7f8f2c00c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162c7298a77dc3a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f1bfff640 1 -- 172.21.15.146:0/259880913 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0673d0 con 0x563d0073d4d0 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f1bfff640 1 -- 172.21.15.146:0/259880913 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f8f2c05e450 con 0x563d0073d4d0 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f4a272740 1 -- 172.21.15.146:0/259880913 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f30003d20 con 0x563d0073d4d0 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f1bfff640 1 -- 172.21.15.146:0/259880913 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8f2c078af0 con 0x563d0073d4d0 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f4a272740 10 client.6129 fetch_fsmap learned FSMap version 22 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f4a272740 1 -- 172.21.15.146:0/259880913 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x563d00bd30b0 con 0x563d0073d4d0 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.215+0000 7f8f1bfff640 1 -- 172.21.15.146:0/259880913 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f30003d20 con 0x563d0073d4d0 2024-09-17T03:36:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f1bfff640 1 -- 172.21.15.146:0/259880913 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f8f2c078c90 con 0x563d0073d4d0 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f4a272740 10 client.6129 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f4a272740 10 client.6129 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f4a272740 20 client.6129 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f4a272740 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x563d00bd2c10 0x563d00bd54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f4a272740 4 client.6129 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f4a272740 1 -- 172.21.15.146:0/259880913 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563d00a7e460 con 0x563d00bd2c10 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f408a2640 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x563d00bd2c10 0x563d00bd54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f1bfff640 10 client.6129 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f408a2640 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x563d00bd2c10 0x563d00bd54d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ce2038c81264b64 server_cookie=10707a524f1be5dd in_seq=0 out_seq=0 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f1bfff640 1 -- 172.21.15.146:0/259880913 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2654 (crc 0 0 0) 0x563d00a7e460 con 0x563d00bd2c10 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.216+0000 7f8f1bfff640 10 client.6129 handle_command_reply: tid=0 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 1 client.6129 shutdown 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 1 -- 172.21.15.146:0/259880913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 msgr2=0x563d00bcbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00bcbb00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00bfd0 tx=0x7f8f2c00c6c0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 1 -- 172.21.15.146:0/259880913 shutdown_connections 2024-09-17T03:36:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x563d00bd2c10 0x563d00bd54d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d00766390 0x563d00b62110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d007456b0 0x563d00b61bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 1 --2- 172.21.15.146:0/259880913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d0073d4d0 0x563d00bcbb00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 1 -- 172.21.15.146:0/259880913 >> 172.21.15.146:0/259880913 conn(0x563d0075a4e0 msgr2=0x563d00b4c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f1bfff640 0 client.6129 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 1 -- 172.21.15.146:0/259880913 shutdown_connections 2024-09-17T03:36:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 1 -- 172.21.15.146:0/259880913 wait complete. 2024-09-17T03:36:01.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f4a272740 20 client.6129 trim_cache size 0 max 16384 2024-09-17T03:36:01.222 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {}, 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: "ab26b3ca-7d40-4d6f-89f7-ddbcb1b234d8": { 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:55.861039+0000", 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:01.223 INFO:teuthology.orchestra.run.smithi146.stdout: "8c57da53-316b-417c-92f0-f4d2d8dbb831": { 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:54.654058+0000", 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "7d980207-f21b-4228-8400-5f563b3039a8": { 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:54.485061+0000", 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:36:01.224 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "f9d6b976-53b1-4d14-bae0-a072551d0c46": { 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:47.625167+0000", 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "d30771c4-5098-4b0b-8120-122396d8fc4a": { 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:54.827055+0000", 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:36:01.225 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "adfb75e5-b911-4f8d-a47c-c41436f4748a": { 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:46.587183+0000", 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "d88b3f93-07b9-4851-80e0-841d2041b343": { 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:46.231188+0000", 2024-09-17T03:36:01.226 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: "dee09f00-18b7-4525-8418-50d2c01a47aa": { 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:35:45.892193+0000", 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:01.227 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:36:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f43307640 1 -- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f28078b90 msgr2=0x7f8f2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f43307640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f28078b90 0x7f8f2807b0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f30034000 tx=0x7f8f30004730 comp rx=0 tx=0).stop 2024-09-17T03:36:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f43307640 1 -- 172.21.15.146:0/1810084195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c06e990 msgr2=0x7f8f3c166d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f43307640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c06e990 0x7f8f3c166d20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00ba80 tx=0x7f8f2c00bf40 comp rx=0 tx=0).stop 2024-09-17T03:36:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f43307640 1 -- 172.21.15.146:0/1810084195 shutdown_connections 2024-09-17T03:36:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f43307640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f28078b90 0x7f8f2807b0a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f43307640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f3c1668a0 0x7f8f3c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f43307640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f3c15ef10 0x7f8f3c1520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.217+0000 7f8f43307640 1 --2- 172.21.15.146:0/1810084195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c06e990 0x7f8f3c166d20 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.218+0000 7f8f43307640 1 -- 172.21.15.146:0/1810084195 >> 172.21.15.146:0/1810084195 conn(0x7f8f3c0b7b20 msgr2=0x7f8f3c072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.218+0000 7f8f43307640 1 -- 172.21.15.146:0/1810084195 shutdown_connections 2024-09-17T03:36:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.218+0000 7f8f43307640 1 -- 172.21.15.146:0/1810084195 wait complete. 2024-09-17T03:36:01.230 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:36:01.230 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-17T03:36:01.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.344+0000 7f50a0b58640 1 -- 172.21.15.146:0/4091664567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f509c0cd840 msgr2=0x7f509c0b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.344+0000 7f50a0b58640 1 --2- 172.21.15.146:0/4091664567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f509c0cd840 0x7f509c0b5680 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5084005fd0 tx=0x7f508402a540 comp rx=0 tx=0).stop 2024-09-17T03:36:01.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.344+0000 7f50a0b58640 1 -- 172.21.15.146:0/4091664567 shutdown_connections 2024-09-17T03:36:01.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.344+0000 7f50a0b58640 1 --2- 172.21.15.146:0/4091664567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f509c0cd840 0x7f509c0b5680 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.344+0000 7f50a0b58640 1 --2- 172.21.15.146:0/4091664567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f509c15c8e0 0x7f509c06f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.344+0000 7f50a0b58640 1 -- 172.21.15.146:0/4091664567 >> 172.21.15.146:0/4091664567 conn(0x7f509c0b3150 msgr2=0x7f509c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.344+0000 7f50a0b58640 1 -- 172.21.15.146:0/4091664567 shutdown_connections 2024-09-17T03:36:01.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.344+0000 7f50a0b58640 1 -- 172.21.15.146:0/4091664567 wait complete. 2024-09-17T03:36:01.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.346+0000 7f50a0b58640 1 Processor -- start 2024-09-17T03:36:01.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.346+0000 7f50a0b58640 1 -- start start 2024-09-17T03:36:01.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f50a0b58640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f509c0cd840 0x7f509c1f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f50a0b58640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f509c0cdc50 0x7f509c0b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f50a0b58640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f509c15c8e0 0x7f509c14de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f50a0b58640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f509c0b5f50 con 0x7f509c0cd840 2024-09-17T03:36:01.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f50a0b58640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f509c0b5dd0 con 0x7f509c15c8e0 2024-09-17T03:36:01.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f50a0b58640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f509c073580 con 0x7f509c0cdc50 2024-09-17T03:36:01.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f509a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f509c0cd840 0x7f509c1f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f509a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f509c0cd840 0x7f509c1f4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40012/0 (socket says 172.21.15.146:40012) 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f509a59c640 1 -- 172.21.15.146:0/2518566383 learned_addr learned my addr 172.21.15.146:0/2518566383 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f5091d9b640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f509c0cdc50 0x7f509c0b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f509ad9d640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f509c15c8e0 0x7f509c14de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f509a59c640 1 -- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f509c0cdc50 msgr2=0x7f509c0b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f509a59c640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f509c0cdc50 0x7f509c0b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f509a59c640 1 -- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f509c15c8e0 msgr2=0x7f509c14de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f509a59c640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f509c15c8e0 0x7f509c14de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f509a59c640 1 -- 172.21.15.146:0/2518566383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c0aeaa0 con 0x7f509c0cd840 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f509a59c640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f509c0cd840 0x7f509c1f4140 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c970 tx=0x7f508c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f50937fe640 1 -- 172.21.15.146:0/2518566383 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c007bb0 con 0x7f509c0cd840 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f50937fe640 1 -- 172.21.15.146:0/2518566383 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f508c007e40 con 0x7f509c0cd840 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f50a0b58640 1 -- 172.21.15.146:0/2518566383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509c0aed80 con 0x7f509c0cd840 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f50937fe640 1 -- 172.21.15.146:0/2518566383 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c005280 con 0x7f509c0cd840 2024-09-17T03:36:01.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.348+0000 7f50a0b58640 1 -- 172.21.15.146:0/2518566383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509c1f3c20 con 0x7f509c0cd840 2024-09-17T03:36:01.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.351+0000 7f50937fe640 1 -- 172.21.15.146:0/2518566383 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f508c005420 con 0x7f509c0cd840 2024-09-17T03:36:01.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.351+0000 7f50937fe640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f507c078b90 0x7f507c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.351+0000 7f50937fe640 1 -- 172.21.15.146:0/2518566383 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f508c09b300 con 0x7f509c0cd840 2024-09-17T03:36:01.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.351+0000 7f5091d9b640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f507c078b90 0x7f507c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.352+0000 7f5091d9b640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f507c078b90 0x7f507c07b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5084033000 tx=0x7f5084004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.352+0000 7f50a7abf740 1 Processor -- start 2024-09-17T03:36:01.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.352+0000 7f50a7abf740 1 -- start start 2024-09-17T03:36:01.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.353+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb85a390 0x560adbc2c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.353+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8314d0 0x560adbc2c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.353+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8396b0 0x560adbc49610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.353+0000 7f50a7abf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560adbb748e0 con 0x560adb8396b0 2024-09-17T03:36:01.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.353+0000 7f50a7abf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560adbb63d10 con 0x560adb8314d0 2024-09-17T03:36:01.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.353+0000 7f50a7abf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x560adbb67b20 con 0x560adb85a390 2024-09-17T03:36:01.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.353+0000 7f509ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8396b0 0x560adbc49610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f509ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8396b0 0x560adbc49610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40026/0 (socket says 172.21.15.146:40026) 2024-09-17T03:36:01.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f509ad9d640 1 -- 172.21.15.146:0/3928529802 learned_addr learned my addr 172.21.15.146:0/3928529802 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f5091d9b640 1 --2- 172.21.15.146:0/3928529802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8314d0 0x560adbc2c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f509a59c640 1 --2- 172.21.15.146:0/3928529802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb85a390 0x560adbc2c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f509ad9d640 1 -- 172.21.15.146:0/3928529802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb85a390 msgr2=0x560adbc2c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f509ad9d640 1 --2- 172.21.15.146:0/3928529802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb85a390 0x560adbc2c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f509ad9d640 1 -- 172.21.15.146:0/3928529802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8314d0 msgr2=0x560adbc2c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f509ad9d640 1 --2- 172.21.15.146:0/3928529802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8314d0 0x560adbc2c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f509ad9d640 1 -- 172.21.15.146:0/3928529802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560adb8c5970 con 0x560adb8396b0 2024-09-17T03:36:01.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f509ad9d640 1 --2- 172.21.15.146:0/3928529802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8396b0 0x560adbc49610 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5094001d10 tx=0x7f50940021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9ef94f5f8a8e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f507bfff640 1 -- 172.21.15.146:0/3928529802 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094018070 con 0x560adb8396b0 2024-09-17T03:36:01.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f507bfff640 1 -- 172.21.15.146:0/3928529802 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f509400d910 con 0x560adb8396b0 2024-09-17T03:36:01.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.354+0000 7f507bfff640 1 -- 172.21.15.146:0/3928529802 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509400dce0 con 0x560adb8396b0 2024-09-17T03:36:01.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.355+0000 7f50a7abf740 1 -- 172.21.15.146:0/3928529802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8396b0 msgr2=0x560adbc49610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.355+0000 7f50a7abf740 1 --2- 172.21.15.146:0/3928529802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8396b0 0x560adbc49610 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5094001d10 tx=0x7f50940021d0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.355+0000 7f50a7abf740 1 -- 172.21.15.146:0/3928529802 shutdown_connections 2024-09-17T03:36:01.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.355+0000 7f50a7abf740 1 --2- 172.21.15.146:0/3928529802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8396b0 0x560adbc49610 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.355+0000 7f50a7abf740 1 --2- 172.21.15.146:0/3928529802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8314d0 0x560adbc2c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.355+0000 7f50a7abf740 1 --2- 172.21.15.146:0/3928529802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb85a390 0x560adbc2c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.355+0000 7f50a7abf740 1 -- 172.21.15.146:0/3928529802 >> 172.21.15.146:0/3928529802 conn(0x560adb84e4e0 msgr2=0x560adbc02490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.355+0000 7f50a7abf740 1 -- 172.21.15.146:0/3928529802 shutdown_connections 2024-09-17T03:36:01.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.355+0000 7f50a7abf740 1 -- 172.21.15.146:0/3928529802 wait complete. 2024-09-17T03:36:01.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.356+0000 7f50a7abf740 1 -- start start 2024-09-17T03:36:01.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.356+0000 7f50a7abf740 1 Processor -- start 2024-09-17T03:36:01.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.357+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8314d0 0x560adbc560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.357+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb8396b0 0x560adbc1a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.357+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb85a390 0x560adbc47790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.357+0000 7f50a7abf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560adb8d4740 con 0x560adb85a390 2024-09-17T03:36:01.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.357+0000 7f50a7abf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560adbb097f0 con 0x560adb8314d0 2024-09-17T03:36:01.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f50a7abf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x560adbc2cc50 con 0x560adb8396b0 2024-09-17T03:36:01.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f50a7abf740 10 client.0 _ll_register_callbacks cb 0x560adbb0d2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:01.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f509ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb85a390 0x560adbc47790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f509ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb85a390 0x560adbc47790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40038/0 (socket says 172.21.15.146:40038) 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f509ad9d640 1 -- 172.21.15.146:0/3754139681 learned_addr learned my addr 172.21.15.146:0/3754139681 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f509a59c640 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8314d0 0x560adbc560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f5091d9b640 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb8396b0 0x560adbc1a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f509ad9d640 1 -- 172.21.15.146:0/3754139681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb8396b0 msgr2=0x560adbc1a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f509ad9d640 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb8396b0 0x560adbc1a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f509ad9d640 1 -- 172.21.15.146:0/3754139681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8314d0 msgr2=0x560adbc560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f509ad9d640 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8314d0 0x560adbc560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f509ad9d640 1 -- 172.21.15.146:0/3754139681 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560adb93c7d0 con 0x560adb85a390 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f509ad9d640 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb85a390 0x560adbc47790 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5094009010 tx=0x7f5094006f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13d22fac495f4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f50797fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f50797fa640 1 -- 172.21.15.146:0/3754139681 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094021020 con 0x560adb85a390 2024-09-17T03:36:01.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f50797fa640 1 -- 172.21.15.146:0/3754139681 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f509400dac0 con 0x560adb85a390 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f50a7abf740 1 -- 172.21.15.146:0/3754139681 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f509400d910 con 0x560adb85a390 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f50797fa640 1 -- 172.21.15.146:0/3754139681 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f509402b050 con 0x560adb85a390 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f50a7abf740 10 client.6144 fetch_fsmap learned FSMap version 22 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.358+0000 7f50a7abf740 1 -- 172.21.15.146:0/3754139681 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x560adbc3f7c0 con 0x560adb85a390 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.359+0000 7f50797fa640 1 -- 172.21.15.146:0/3754139681 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f509400d910 con 0x560adb85a390 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.359+0000 7f50797fa640 1 -- 172.21.15.146:0/3754139681 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f509402e020 con 0x560adb85a390 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.359+0000 7f50a7abf740 10 client.6144 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.359+0000 7f50a7abf740 10 client.6144 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.359+0000 7f50a7abf740 20 client.6144 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.359+0000 7f50a7abf740 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560adb818f60 0x560adbc2b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.359+0000 7f50a7abf740 4 client.6144 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.359+0000 7f50a7abf740 1 -- 172.21.15.146:0/3754139681 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560adbb76830 con 0x560adb818f60 2024-09-17T03:36:01.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.359+0000 7f509a59c640 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560adb818f60 0x560adbc2b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.359+0000 7f50797fa640 10 client.6144 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.359+0000 7f509a59c640 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560adb818f60 0x560adbc2b380 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aa602f9a7842dd9 server_cookie=df48671417b0bef3 in_seq=0 out_seq=0 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50797fa640 1 -- 172.21.15.146:0/3754139681 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560adbb76830 con 0x560adb818f60 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50797fa640 10 client.6144 handle_command_reply: tid=0 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 1 client.6144 shutdown 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 1 -- 172.21.15.146:0/3754139681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb85a390 msgr2=0x560adbc47790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb85a390 0x560adbc47790 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5094009010 tx=0x7f5094006f10 comp rx=0 tx=0).stop 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 1 -- 172.21.15.146:0/3754139681 shutdown_connections 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560adb818f60 0x560adbc2b380 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb85a390 0x560adbc47790 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb8396b0 0x560adbc1a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50797fa640 0 client.6144 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 1 --2- 172.21.15.146:0/3754139681 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8314d0 0x560adbc560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 1 -- 172.21.15.146:0/3754139681 >> 172.21.15.146:0/3754139681 conn(0x560adb84e4e0 msgr2=0x560adbbfcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 1 -- 172.21.15.146:0/3754139681 shutdown_connections 2024-09-17T03:36:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 1 -- 172.21.15.146:0/3754139681 wait complete. 2024-09-17T03:36:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.360+0000 7f50a7abf740 20 client.6144 trim_cache size 0 max 16384 2024-09-17T03:36:01.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.374+0000 7f50a7abf740 1 Processor -- start 2024-09-17T03:36:01.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.374+0000 7f50a7abf740 1 -- start start 2024-09-17T03:36:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.375+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb818f60 0x560adbc69c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.375+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb8314d0 0x560adbc42c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.375+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8396b0 0x560adbc43170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.375+0000 7f50a7abf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f509c200250 con 0x560adb818f60 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.375+0000 7f50a7abf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1ff270 con 0x560adb8396b0 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.375+0000 7f50a7abf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f509c15a4f0 con 0x560adb8314d0 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.375+0000 7f509a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb818f60 0x560adbc69c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.375+0000 7f509a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb818f60 0x560adbc69c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40040/0 (socket says 172.21.15.146:40040) 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.375+0000 7f509a59c640 1 -- 172.21.15.146:0/2490867129 learned_addr learned my addr 172.21.15.146:0/2490867129 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.375+0000 7f5091d9b640 1 --2- 172.21.15.146:0/2490867129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb8314d0 0x560adbc42c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f509ad9d640 1 --2- 172.21.15.146:0/2490867129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8396b0 0x560adbc43170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f509a59c640 1 -- 172.21.15.146:0/2490867129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb8314d0 msgr2=0x560adbc42c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f509a59c640 1 --2- 172.21.15.146:0/2490867129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb8314d0 0x560adbc42c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f509a59c640 1 -- 172.21.15.146:0/2490867129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8396b0 msgr2=0x560adbc43170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f509a59c640 1 --2- 172.21.15.146:0/2490867129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8396b0 0x560adbc43170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f509a59c640 1 -- 172.21.15.146:0/2490867129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560adbc4ade0 con 0x560adb818f60 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f5091d9b640 1 --2- 172.21.15.146:0/2490867129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb8314d0 0x560adbc42c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f509ad9d640 1 --2- 172.21.15.146:0/2490867129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8396b0 0x560adbc43170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f509a59c640 1 --2- 172.21.15.146:0/2490867129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb818f60 0x560adbc69c80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f508c062dd0 tx=0x7f508c05f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c7901bfe6f5cbb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f507b7fe640 1 -- 172.21.15.146:0/2490867129 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c01d040 con 0x560adb818f60 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f507b7fe640 1 -- 172.21.15.146:0/2490867129 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f508c04e030 con 0x560adb818f60 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.376+0000 7f507b7fe640 1 -- 172.21.15.146:0/2490867129 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c05f340 con 0x560adb818f60 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.377+0000 7f50a7abf740 1 -- 172.21.15.146:0/2490867129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb818f60 msgr2=0x560adbc69c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.377+0000 7f50a7abf740 1 --2- 172.21.15.146:0/2490867129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb818f60 0x560adbc69c80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f508c062dd0 tx=0x7f508c05f850 comp rx=0 tx=0).stop 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.377+0000 7f50a7abf740 1 -- 172.21.15.146:0/2490867129 shutdown_connections 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.377+0000 7f50a7abf740 1 --2- 172.21.15.146:0/2490867129 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8396b0 0x560adbc43170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.377+0000 7f50a7abf740 1 --2- 172.21.15.146:0/2490867129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb8314d0 0x560adbc42c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.377+0000 7f50a7abf740 1 --2- 172.21.15.146:0/2490867129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb818f60 0x560adbc69c80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.377+0000 7f50a7abf740 1 -- 172.21.15.146:0/2490867129 >> 172.21.15.146:0/2490867129 conn(0x560adb84e4e0 msgr2=0x560adbbfcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.377+0000 7f50a7abf740 1 -- 172.21.15.146:0/2490867129 shutdown_connections 2024-09-17T03:36:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.377+0000 7f50a7abf740 1 -- 172.21.15.146:0/2490867129 wait complete. 2024-09-17T03:36:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.377+0000 7f50a7abf740 1 -- start start 2024-09-17T03:36:01.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.378+0000 7f50a7abf740 1 Processor -- start 2024-09-17T03:36:01.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb818f60 0x560adbcc3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8314d0 0x560adbcc9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f50a7abf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8396b0 0x560adbcca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f50a7abf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1f78c0 con 0x560adb8314d0 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f50a7abf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560adbcc6c40 con 0x560adb8396b0 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f50a7abf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x560adbcc40a0 con 0x560adb818f60 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f50a7abf740 10 client.0 _ll_register_callbacks cb 0x7f5094016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f5091d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8314d0 0x560adbcc9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f5091d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8314d0 0x560adbcc9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40048/0 (socket says 172.21.15.146:40048) 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f5091d9b640 1 -- 172.21.15.146:0/614709534 learned_addr learned my addr 172.21.15.146:0/614709534 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f509ad9d640 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8396b0 0x560adbcca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f509a59c640 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb818f60 0x560adbcc3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f5091d9b640 1 -- 172.21.15.146:0/614709534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb818f60 msgr2=0x560adbcc3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f5091d9b640 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb818f60 0x560adbcc3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f5091d9b640 1 -- 172.21.15.146:0/614709534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8396b0 msgr2=0x560adbcca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f5091d9b640 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8396b0 0x560adbcca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.379+0000 7f5091d9b640 1 -- 172.21.15.146:0/614709534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560adbc03df0 con 0x560adb8314d0 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f5091d9b640 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8314d0 0x560adbcc9fb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5084034040 tx=0x7f5084009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a54e92c4ff4be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50797fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50797fa640 1 -- 172.21.15.146:0/614709534 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084035050 con 0x560adb8314d0 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50797fa640 1 -- 172.21.15.146:0/614709534 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f50840049a0 con 0x560adb8314d0 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50a7abf740 1 -- 172.21.15.146:0/614709534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f508c04e030 con 0x560adb8314d0 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50797fa640 1 -- 172.21.15.146:0/614709534 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5084058050 con 0x560adb8314d0 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50a7abf740 10 client.6150 fetch_fsmap learned FSMap version 22 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50a7abf740 1 -- 172.21.15.146:0/614709534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x560adbc43a90 con 0x560adb8314d0 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50797fa640 1 -- 172.21.15.146:0/614709534 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f508c04e030 con 0x560adb8314d0 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50797fa640 1 -- 172.21.15.146:0/614709534 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f508405b020 con 0x560adb8314d0 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50a7abf740 10 client.6150 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T03:36:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50a7abf740 10 client.6150 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50a7abf740 20 client.6150 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50a7abf740 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560adb7ee3a0 0x560adbc2b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50a7abf740 4 client.6150 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f50a7abf740 1 -- 172.21.15.146:0/614709534 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560adbb722e0 con 0x560adb7ee3a0 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.380+0000 7f509a59c640 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560adb7ee3a0 0x560adbc2b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50797fa640 10 client.6150 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f509a59c640 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560adb7ee3a0 0x560adbc2b7e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=167f327a17995dfe server_cookie=5d4e460a867904d7 in_seq=0 out_seq=0 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50797fa640 1 -- 172.21.15.146:0/614709534 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+167 (crc 0 0 0) 0x560adbb722e0 con 0x560adb7ee3a0 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50797fa640 10 client.6150 handle_command_reply: tid=0 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 1 client.6150 shutdown 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 1 -- 172.21.15.146:0/614709534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8314d0 msgr2=0x560adbcc9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8314d0 0x560adbcc9fb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5084034040 tx=0x7f5084009260 comp rx=0 tx=0).stop 2024-09-17T03:36:01.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 1 -- 172.21.15.146:0/614709534 shutdown_connections 2024-09-17T03:36:01.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x560adb7ee3a0 0x560adbc2b7e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560adb8396b0 0x560adbcca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560adb8314d0 0x560adbcc9fb0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50797fa640 0 client.6150 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 1 --2- 172.21.15.146:0/614709534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560adb818f60 0x560adbcc3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 1 -- 172.21.15.146:0/614709534 >> 172.21.15.146:0/614709534 conn(0x560adb84e4e0 msgr2=0x560adbc3e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 1 -- 172.21.15.146:0/614709534 shutdown_connections 2024-09-17T03:36:01.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 1 -- 172.21.15.146:0/614709534 wait complete. 2024-09-17T03:36:01.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.381+0000 7f50a7abf740 20 client.6150 trim_cache size 0 max 16384 2024-09-17T03:36:01.389 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:36:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "damage_type": "backtrace", 2024-09-17T03:36:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 686696521, 2024-09-17T03:36:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 1099511630414, 2024-09-17T03:36:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-09-17T03:36:01.389 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:01.389 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:36:01.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 -- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f507c078b90 msgr2=0x7f507c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f507c078b90 0x7f507c07b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5084033000 tx=0x7f5084004730 comp rx=0 tx=0).stop 2024-09-17T03:36:01.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 -- 172.21.15.146:0/2518566383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f509c0cd840 msgr2=0x7f509c1f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f509c0cd840 0x7f509c1f4140 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c970 tx=0x7f508c00ce30 comp rx=0 tx=0).stop 2024-09-17T03:36:01.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 -- 172.21.15.146:0/2518566383 shutdown_connections 2024-09-17T03:36:01.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f507c078b90 0x7f507c07b0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f509c15c8e0 0x7f509c14de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f509c0cdc50 0x7f509c0b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 --2- 172.21.15.146:0/2518566383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f509c0cd840 0x7f509c1f4140 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 -- 172.21.15.146:0/2518566383 >> 172.21.15.146:0/2518566383 conn(0x7f509c0b3150 msgr2=0x7f509c15e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 -- 172.21.15.146:0/2518566383 shutdown_connections 2024-09-17T03:36:01.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.382+0000 7f50a0b58640 1 -- 172.21.15.146:0/2518566383 wait complete. 2024-09-17T03:36:01.394 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:01.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.506+0000 7f018cc30640 1 -- 172.21.15.146:0/963075397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01880b47c0 msgr2=0x7f0188161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.506+0000 7f018cc30640 1 --2- 172.21.15.146:0/963075397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01880b47c0 0x7f0188161930 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0180005fd0 tx=0x7f018002aa10 comp rx=0 tx=0).stop 2024-09-17T03:36:01.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.506+0000 7f018cc30640 1 -- 172.21.15.146:0/963075397 shutdown_connections 2024-09-17T03:36:01.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.506+0000 7f018cc30640 1 --2- 172.21.15.146:0/963075397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01880b47c0 0x7f0188161930 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.506+0000 7f018cc30640 1 --2- 172.21.15.146:0/963075397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880d0710 0x7f01880cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.506+0000 7f018cc30640 1 -- 172.21.15.146:0/963075397 >> 172.21.15.146:0/963075397 conn(0x7f018809ba20 msgr2=0x7f01880b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.506+0000 7f018cc30640 1 -- 172.21.15.146:0/963075397 shutdown_connections 2024-09-17T03:36:01.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.506+0000 7f018cc30640 1 -- 172.21.15.146:0/963075397 wait complete. 2024-09-17T03:36:01.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.508+0000 7f018cc30640 1 Processor -- start 2024-09-17T03:36:01.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.508+0000 7f018cc30640 1 -- start start 2024-09-17T03:36:01.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f018cc30640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01880b47c0 0x7f01881f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f018cc30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01880cf6b0 0x7f01881f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f018cc30640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880d0710 0x7f01880cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f018cc30640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f01880b1de0 con 0x7f01880cf6b0 2024-09-17T03:36:01.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f018cc30640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0188162080 con 0x7f01880b47c0 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f018cc30640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f01880b1f60 con 0x7f01880d0710 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01880cf6b0 0x7f01881f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01880cf6b0 0x7f01881f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40060/0 (socket says 172.21.15.146:40060) 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017dd9b640 1 -- 172.21.15.146:0/2393719719 learned_addr learned my addr 172.21.15.146:0/2393719719 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f018659c640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01880b47c0 0x7f01881f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017dd9b640 1 -- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880d0710 msgr2=0x7f01880cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017dd9b640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880d0710 0x7f01880cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017dd9b640 1 -- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01880b47c0 msgr2=0x7f01881f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017dd9b640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01880b47c0 0x7f01881f9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017dd9b640 1 -- 172.21.15.146:0/2393719719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01880cbb80 con 0x7f01880cf6b0 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017dd9b640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01880cf6b0 0x7f01881f5500 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f017000c3d0 tx=0x7f017000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017f7fe640 1 -- 172.21.15.146:0/2393719719 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170017070 con 0x7f01880cf6b0 2024-09-17T03:36:01.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017f7fe640 1 -- 172.21.15.146:0/2393719719 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01700053c0 con 0x7f01880cf6b0 2024-09-17T03:36:01.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f018cc30640 1 -- 172.21.15.146:0/2393719719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01880cbe60 con 0x7f01880cf6b0 2024-09-17T03:36:01.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f017f7fe640 1 -- 172.21.15.146:0/2393719719 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170003850 con 0x7f01880cf6b0 2024-09-17T03:36:01.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.510+0000 7f018cc30640 1 -- 172.21.15.146:0/2393719719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01880ca640 con 0x7f01880cf6b0 2024-09-17T03:36:01.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.512+0000 7f018cc30640 1 -- 172.21.15.146:0/2393719719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01880cf170 con 0x7f01880cf6b0 2024-09-17T03:36:01.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.512+0000 7f017f7fe640 1 -- 172.21.15.146:0/2393719719 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f017001a070 con 0x7f01880cf6b0 2024-09-17T03:36:01.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.512+0000 7f017f7fe640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0168078b90 0x7f016807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.513+0000 7f017f7fe640 1 -- 172.21.15.146:0/2393719719 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f017009a150 con 0x7f01880cf6b0 2024-09-17T03:36:01.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.513+0000 7f018659c640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0168078b90 0x7f016807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.513+0000 7f018659c640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0168078b90 0x7f016807b0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f01780058c0 tx=0x7f0178005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.517+0000 7f017f7fe640 1 -- 172.21.15.146:0/2393719719 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01700624d0 con 0x7f01880cf6b0 2024-09-17T03:36:01.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.733+0000 7f018cc30640 1 -- 172.21.15.146:0/2393719719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01880ced70 con 0x7f01880cf6b0 2024-09-17T03:36:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.734+0000 7f017f7fe640 1 -- 172.21.15.146:0/2393719719 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5229 (secure 0 0 0) 0x7f0170061dd0 con 0x7f01880cf6b0 2024-09-17T03:36:01.734 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:01.734 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":22,"btime":"2024-09-17T03:35:55:908000+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2310307824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2310307824},{"type":"v1","addr":"172.21.15.179:6836","nonce":2310307824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/422393296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":422393296},{"type":"v1","addr":"172.21.15.179:6837","nonce":422393296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3793010114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3793010114},{"type":"v1","addr":"172.21.15.146:6833","nonce":3793010114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:30.743460+0000","modified":"2024-09-17T03:35:55.423178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/924109004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":924109004},{"type":"v1","addr":"172.21.15.146:6835","nonce":924109004}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5400,"qdb_cluster":[5400]},"id":3}]} 2024-09-17T03:36:01.734 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 22 2024-09-17T03:36:01.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 -- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0168078b90 msgr2=0x7f016807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0168078b90 0x7f016807b0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f01780058c0 tx=0x7f0178005850 comp rx=0 tx=0).stop 2024-09-17T03:36:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 -- 172.21.15.146:0/2393719719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01880cf6b0 msgr2=0x7f01881f5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01880cf6b0 0x7f01881f5500 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f017000c3d0 tx=0x7f017000c890 comp rx=0 tx=0).stop 2024-09-17T03:36:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 -- 172.21.15.146:0/2393719719 shutdown_connections 2024-09-17T03:36:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0168078b90 0x7f016807b0a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01880d0710 0x7f01880cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01880cf6b0 0x7f01881f5500 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 --2- 172.21.15.146:0/2393719719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01880b47c0 0x7f01881f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 -- 172.21.15.146:0/2393719719 >> 172.21.15.146:0/2393719719 conn(0x7f018809ba20 msgr2=0x7f01880b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 -- 172.21.15.146:0/2393719719 shutdown_connections 2024-09-17T03:36:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.736+0000 7f018cc30640 1 -- 172.21.15.146:0/2393719719 wait complete. 2024-09-17T03:36:01.748 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 686696521 2024-09-17T03:36:01.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.864+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/810069736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b98073480 msgr2=0x7f9b98073890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.864+0000 7f9b9ca1d640 1 --2- 172.21.15.146:0/810069736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b98073480 0x7f9b98073890 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9b98070850 tx=0x7f9b9002aa00 comp rx=0 tx=0).stop 2024-09-17T03:36:01.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.864+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/810069736 shutdown_connections 2024-09-17T03:36:01.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.864+0000 7f9b9ca1d640 1 --2- 172.21.15.146:0/810069736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b98073480 0x7f9b98073890 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.864+0000 7f9b9ca1d640 1 --2- 172.21.15.146:0/810069736 >> v2:172.21.15.179:3300/0 conn(0x7f9b98153a60 0x7f9b9815d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.864+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/810069736 >> 172.21.15.146:0/810069736 conn(0x7f9b980b2060 msgr2=0x7f9b980b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.864+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/810069736 shutdown_connections 2024-09-17T03:36:01.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.864+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/810069736 wait complete. 2024-09-17T03:36:01.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.866+0000 7f9b9ca1d640 1 Processor -- start 2024-09-17T03:36:01.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.866+0000 7f9b9ca1d640 1 -- start start 2024-09-17T03:36:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.867+0000 7f9b9ca1d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b98073480 0x7f9b981f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.867+0000 7f9b9ca1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b98153a60 0x7f9b981558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.867+0000 7f9b9ca1d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b981604f0 0x7f9b98155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.867+0000 7f9b9ca1d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98073f50 con 0x7f9b981604f0 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.867+0000 7f9b9ca1d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98073dd0 con 0x7f9b98073480 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.867+0000 7f9b9ca1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9b980740d0 con 0x7f9b98153a60 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.867+0000 7f9b96d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b981604f0 0x7f9b98155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.867+0000 7f9b96d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b981604f0 0x7f9b98155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40080/0 (socket says 172.21.15.146:40080) 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.867+0000 7f9b96d9d640 1 -- 172.21.15.146:0/102770663 learned_addr learned my addr 172.21.15.146:0/102770663 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.867+0000 7f9b9659c640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b98073480 0x7f9b981f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.867+0000 7f9b8dd9b640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b98153a60 0x7f9b981558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.868+0000 7f9b96d9d640 1 -- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b98153a60 msgr2=0x7f9b981558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.868+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b98153a60 0x7f9b981558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.868+0000 7f9b96d9d640 1 -- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b98073480 msgr2=0x7f9b981f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.868+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b98073480 0x7f9b981f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.868+0000 7f9b96d9d640 1 -- 172.21.15.146:0/102770663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b981f9730 con 0x7f9b981604f0 2024-09-17T03:36:01.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.868+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b981604f0 0x7f9b98155de0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9b980d1400 tx=0x7f9b90003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.868+0000 7f9b8f7fe640 1 -- 172.21.15.146:0/102770663 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90033050 con 0x7f9b981604f0 2024-09-17T03:36:01.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.868+0000 7f9b8f7fe640 1 -- 172.21.15.146:0/102770663 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b90004450 con 0x7f9b981604f0 2024-09-17T03:36:01.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.868+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/102770663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b981f9a10 con 0x7f9b981604f0 2024-09-17T03:36:01.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.868+0000 7f9b8f7fe640 1 -- 172.21.15.146:0/102770663 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90038450 con 0x7f9b981604f0 2024-09-17T03:36:01.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.868+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/102770663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b9815c910 con 0x7f9b981604f0 2024-09-17T03:36:01.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.870+0000 7f9b8f7fe640 1 -- 172.21.15.146:0/102770663 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b90036070 con 0x7f9b981604f0 2024-09-17T03:36:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.871+0000 7f9b8f7fe640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b78078bc0 0x7f9b7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.871+0000 7f9b8f7fe640 1 -- 172.21.15.146:0/102770663 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9b900bbf50 con 0x7f9b981604f0 2024-09-17T03:36:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.871+0000 7f9b9659c640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b78078bc0 0x7f9b7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.872+0000 7f9b9659c640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b78078bc0 0x7f9b7807b0d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9b88004630 tx=0x7f9b8800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.872+0000 7f9ba3a63740 1 Processor -- start 2024-09-17T03:36:01.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.872+0000 7f9ba3a63740 1 -- start start 2024-09-17T03:36:01.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.873+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c030920490 0x55c030d0cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.873+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0308f75d0 0x55c030ce1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.873+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030ce22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.873+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c030c3a9b0 con 0x55c0308ff7b0 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.873+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c030c29de0 con 0x55c0308f75d0 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.873+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c030c2dbf0 con 0x55c030920490 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.873+0000 7f9b96d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030ce22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.873+0000 7f9b96d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030ce22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40088/0 (socket says 172.21.15.146:40088) 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.873+0000 7f9b96d9d640 1 -- 172.21.15.146:0/1971981893 learned_addr learned my addr 172.21.15.146:0/1971981893 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.873+0000 7f9b9659c640 1 --2- 172.21.15.146:0/1971981893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c030920490 0x55c030d0cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.873+0000 7f9b8dd9b640 1 --2- 172.21.15.146:0/1971981893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0308f75d0 0x55c030ce1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.874+0000 7f9b96d9d640 1 -- 172.21.15.146:0/1971981893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c030920490 msgr2=0x55c030d0cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.874+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/1971981893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c030920490 0x55c030d0cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.874+0000 7f9b96d9d640 1 -- 172.21.15.146:0/1971981893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0308f75d0 msgr2=0x55c030ce1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.874+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/1971981893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0308f75d0 0x55c030ce1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.874+0000 7f9b96d9d640 1 -- 172.21.15.146:0/1971981893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c030a04900 con 0x55c0308ff7b0 2024-09-17T03:36:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.874+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/1971981893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030ce22d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9b900ba380 tx=0x7f9b900805a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80835c0e5e51d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.874+0000 7f9b77fff640 1 -- 172.21.15.146:0/1971981893 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b900aa030 con 0x55c0308ff7b0 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.874+0000 7f9b77fff640 1 -- 172.21.15.146:0/1971981893 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b90088070 con 0x55c0308ff7b0 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.874+0000 7f9b77fff640 1 -- 172.21.15.146:0/1971981893 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90083e20 con 0x55c0308ff7b0 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.875+0000 7f9ba3a63740 1 -- 172.21.15.146:0/1971981893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 msgr2=0x55c030ce22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.875+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/1971981893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030ce22d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9b900ba380 tx=0x7f9b900805a0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.875+0000 7f9ba3a63740 1 -- 172.21.15.146:0/1971981893 shutdown_connections 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.875+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/1971981893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030ce22d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.875+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/1971981893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0308f75d0 0x55c030ce1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.875+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/1971981893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c030920490 0x55c030d0cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.875+0000 7f9ba3a63740 1 -- 172.21.15.146:0/1971981893 >> 172.21.15.146:0/1971981893 conn(0x55c0309145e0 msgr2=0x55c030cc8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.875+0000 7f9ba3a63740 1 -- 172.21.15.146:0/1971981893 shutdown_connections 2024-09-17T03:36:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.875+0000 7f9ba3a63740 1 -- 172.21.15.146:0/1971981893 wait complete. 2024-09-17T03:36:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.876+0000 7f9ba3a63740 1 -- start start 2024-09-17T03:36:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.876+0000 7f9ba3a63740 1 Processor -- start 2024-09-17T03:36:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.877+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030ce0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.877+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0308ff7b0 0x55c030d059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.877+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c030920490 0x55c030d05f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.877+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c03099a840 con 0x55c030920490 2024-09-17T03:36:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.877+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c030bb0710 con 0x55c0308ff7b0 2024-09-17T03:36:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.877+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c030c29de0 con 0x55c0308f75d0 2024-09-17T03:36:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.877+0000 7f9ba3a63740 10 client.0 _ll_register_callbacks cb 0x55c030c234e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b96d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c030920490 0x55c030d05f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b96d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c030920490 0x55c030d05f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40098/0 (socket says 172.21.15.146:40098) 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b96d9d640 1 -- 172.21.15.146:0/620529815 learned_addr learned my addr 172.21.15.146:0/620529815 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b8dd9b640 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0308ff7b0 0x55c030d059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b9659c640 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030ce0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b96d9d640 1 -- 172.21.15.146:0/620529815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 msgr2=0x55c030ce0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030ce0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b96d9d640 1 -- 172.21.15.146:0/620529815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0308ff7b0 msgr2=0x55c030d059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0308ff7b0 0x55c030d059f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b96d9d640 1 -- 172.21.15.146:0/620529815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0309697a0 con 0x55c030920490 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c030920490 0x55c030d05f30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9b900ba490 tx=0x7f9b90083a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32b20265bedc39a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b757fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b757fa640 1 -- 172.21.15.146:0/620529815 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9008d700 con 0x55c030920490 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b757fa640 1 -- 172.21.15.146:0/620529815 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9b9006f330 con 0x55c030920490 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9ba3a63740 1 -- 172.21.15.146:0/620529815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b90088070 con 0x55c030920490 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b757fa640 1 -- 172.21.15.146:0/620529815 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9b90083e20 con 0x55c030920490 2024-09-17T03:36:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9ba3a63740 10 client.6168 fetch_fsmap learned FSMap version 22 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9ba3a63740 1 -- 172.21.15.146:0/620529815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55c030a65090 con 0x55c030920490 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.878+0000 7f9b757fa640 1 -- 172.21.15.146:0/620529815 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b90088070 con 0x55c030920490 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.879+0000 7f9b757fa640 1 -- 172.21.15.146:0/620529815 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f9b900a2060 con 0x55c030920490 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.879+0000 7f9ba3a63740 10 client.6168 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.879+0000 7f9ba3a63740 10 client.6168 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.879+0000 7f9ba3a63740 20 client.6168 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.879+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c0308df060 0x55c030d04520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.879+0000 7f9ba3a63740 4 client.6168 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.879+0000 7f9ba3a63740 1 -- 172.21.15.146:0/620529815 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c030c3c900 con 0x55c0308df060 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.879+0000 7f9b9659c640 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c0308df060 0x55c030d04520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.879+0000 7f9b757fa640 10 client.6168 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.879+0000 7f9b9659c640 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c0308df060 0x55c030d04520 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38fcfe28ef31309b server_cookie=1ecd4cb3f59a74e in_seq=0 out_seq=0 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9b757fa640 1 -- 172.21.15.146:0/620529815 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c030c3c900 con 0x55c0308df060 2024-09-17T03:36:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9b757fa640 10 client.6168 handle_command_reply: tid=0 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 1 client.6168 shutdown 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 1 -- 172.21.15.146:0/620529815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c030920490 msgr2=0x55c030d05f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c030920490 0x55c030d05f30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9b900ba490 tx=0x7f9b90083a40 comp rx=0 tx=0).stop 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 1 -- 172.21.15.146:0/620529815 shutdown_connections 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c0308df060 0x55c030d04520 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c030920490 0x55c030d05f30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0308ff7b0 0x55c030d059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9b757fa640 0 client.6168 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/620529815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030ce0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 1 -- 172.21.15.146:0/620529815 >> 172.21.15.146:0/620529815 conn(0x55c0309145e0 msgr2=0x55c030cef0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 1 -- 172.21.15.146:0/620529815 shutdown_connections 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 1 -- 172.21.15.146:0/620529815 wait complete. 2024-09-17T03:36:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.880+0000 7f9ba3a63740 20 client.6168 trim_cache size 0 max 16384 2024-09-17T03:36:01.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.894+0000 7f9ba3a63740 1 Processor -- start 2024-09-17T03:36:01.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.894+0000 7f9ba3a63740 1 -- start start 2024-09-17T03:36:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030d85a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030d07210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 0x55c030d07750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98202270 con 0x55c0308ff7b0 2024-09-17T03:36:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98201330 con 0x55c030920490 2024-09-17T03:36:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9b98200ce0 con 0x55c0308f75d0 2024-09-17T03:36:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9b8dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030d07210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9b8dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030d07210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40102/0 (socket says 172.21.15.146:40102) 2024-09-17T03:36:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9b8dd9b640 1 -- 172.21.15.146:0/3136656557 learned_addr learned my addr 172.21.15.146:0/3136656557 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9b9659c640 1 --2- 172.21.15.146:0/3136656557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030d85a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/3136656557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 0x55c030d07750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9b8dd9b640 1 -- 172.21.15.146:0/3136656557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 msgr2=0x55c030d85a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9b8dd9b640 1 --2- 172.21.15.146:0/3136656557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030d85a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9b8dd9b640 1 -- 172.21.15.146:0/3136656557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 msgr2=0x55c030d07750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9b8dd9b640 1 --2- 172.21.15.146:0/3136656557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 0x55c030d07750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9b8dd9b640 1 -- 172.21.15.146:0/3136656557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c030ceff50 con 0x55c0308ff7b0 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.895+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/3136656557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 0x55c030d07750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.896+0000 7f9b8dd9b640 1 --2- 172.21.15.146:0/3136656557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030d07210 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009a70 tx=0x7f9b80009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1824232df8730fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.896+0000 7f9b777fe640 1 -- 172.21.15.146:0/3136656557 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80014d60 con 0x55c0308ff7b0 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.896+0000 7f9b777fe640 1 -- 172.21.15.146:0/3136656557 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b80019070 con 0x55c0308ff7b0 2024-09-17T03:36:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.896+0000 7f9b777fe640 1 -- 172.21.15.146:0/3136656557 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80004280 con 0x55c0308ff7b0 2024-09-17T03:36:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.896+0000 7f9ba3a63740 1 -- 172.21.15.146:0/3136656557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 msgr2=0x55c030d07210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.896+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/3136656557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030d07210 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009a70 tx=0x7f9b80009f30 comp rx=0 tx=0).stop 2024-09-17T03:36:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.897+0000 7f9ba3a63740 1 -- 172.21.15.146:0/3136656557 shutdown_connections 2024-09-17T03:36:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.897+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/3136656557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 0x55c030d07750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.897+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/3136656557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030d07210 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.897+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/3136656557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030d85a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.897+0000 7f9ba3a63740 1 -- 172.21.15.146:0/3136656557 >> 172.21.15.146:0/3136656557 conn(0x55c0309145e0 msgr2=0x55c030ce0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.897+0000 7f9ba3a63740 1 -- 172.21.15.146:0/3136656557 shutdown_connections 2024-09-17T03:36:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.897+0000 7f9ba3a63740 1 -- 172.21.15.146:0/3136656557 wait complete. 2024-09-17T03:36:01.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.897+0000 7f9ba3a63740 1 -- start start 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.897+0000 7f9ba3a63740 1 Processor -- start 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030d7f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030cf0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9ba3a63740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 0x55c030d05a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c03099a840 con 0x55c0308ff7b0 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c030c3a9b0 con 0x55c030920490 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9ba3a63740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c030cf18e0 con 0x55c0308f75d0 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9ba3a63740 10 client.0 _ll_register_callbacks cb 0x7f9b9006f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b8dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030cf0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b8dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030cf0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40110/0 (socket says 172.21.15.146:40110) 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b8dd9b640 1 -- 172.21.15.146:0/2362946354 learned_addr learned my addr 172.21.15.146:0/2362946354 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b9659c640 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030d7f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 0x55c030d05a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b8dd9b640 1 -- 172.21.15.146:0/2362946354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 msgr2=0x55c030d7f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b8dd9b640 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030d7f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b8dd9b640 1 -- 172.21.15.146:0/2362946354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 msgr2=0x55c030d05a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b8dd9b640 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 0x55c030d05a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b8dd9b640 1 -- 172.21.15.146:0/2362946354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c030a02c00 con 0x55c0308ff7b0 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b96d9d640 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 0x55c030d05a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b8dd9b640 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030cf0e90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9b80014840 tx=0x7f9b80014da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11384c88c9ab477 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.899+0000 7f9b757fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9b757fa640 1 -- 172.21.15.146:0/2362946354 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80004230 con 0x55c0308ff7b0 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9b757fa640 1 -- 172.21.15.146:0/2362946354 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9b800043d0 con 0x55c0308ff7b0 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9ba3a63740 1 -- 172.21.15.146:0/2362946354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b80019070 con 0x55c0308ff7b0 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9b757fa640 1 -- 172.21.15.146:0/2362946354 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9b8002f050 con 0x55c0308ff7b0 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9ba3a63740 10 client.6174 fetch_fsmap learned FSMap version 22 2024-09-17T03:36:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9ba3a63740 1 -- 172.21.15.146:0/2362946354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55c030d7fc60 con 0x55c0308ff7b0 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9b757fa640 1 -- 172.21.15.146:0/2362946354 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b80019070 con 0x55c0308ff7b0 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9b757fa640 1 -- 172.21.15.146:0/2362946354 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f9b80032020 con 0x55c0308ff7b0 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9ba3a63740 10 client.6174 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9ba3a63740 10 client.6174 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9ba3a63740 20 client.6174 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c030d0fbf0 0x55c030d14440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9ba3a63740 4 client.6174 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 686696521}] 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9ba3a63740 1 -- 172.21.15.146:0/2362946354 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "damage rm", "damage_id": 686696521}) -- 0x55c030c383b0 con 0x55c030d0fbf0 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.900+0000 7f9b9659c640 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c030d0fbf0 0x55c030d14440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9b757fa640 10 client.6174 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9b9659c640 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c030d0fbf0 0x55c030d14440 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e359b7d8a128831 server_cookie=6fa5fd46b69804a5 in_seq=0 out_seq=0 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9b757fa640 1 -- 172.21.15.146:0/2362946354 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55c030c383b0 con 0x55c030d0fbf0 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9b757fa640 10 client.6174 handle_command_reply: tid=0 2024-09-17T03:36:01.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9ba3a63740 1 client.6174 shutdown 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9ba3a63740 1 -- 172.21.15.146:0/2362946354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 msgr2=0x55c030cf0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030cf0e90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9b80014840 tx=0x7f9b80014da0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9ba3a63740 1 -- 172.21.15.146:0/2362946354 shutdown_connections 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x55c030d0fbf0 0x55c030d14440 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c030920490 0x55c030d05a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0308ff7b0 0x55c030cf0e90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9b757fa640 0 client.6174 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9ba3a63740 1 --2- 172.21.15.146:0/2362946354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0308f75d0 0x55c030d7f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9ba3a63740 1 -- 172.21.15.146:0/2362946354 >> 172.21.15.146:0/2362946354 conn(0x55c0309145e0 msgr2=0x55c030cef330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9ba3a63740 1 -- 172.21.15.146:0/2362946354 shutdown_connections 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.901+0000 7f9ba3a63740 1 -- 172.21.15.146:0/2362946354 wait complete. 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9ba3a63740 20 client.6174 trim_cache size 0 max 16384 2024-09-17T03:36:01.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b78078bc0 msgr2=0x7f9b7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b78078bc0 0x7f9b7807b0d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9b88004630 tx=0x7f9b8800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/102770663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b981604f0 msgr2=0x7f9b98155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b981604f0 0x7f9b98155de0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9b980d1400 tx=0x7f9b90003f90 comp rx=0 tx=0).stop 2024-09-17T03:36:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/102770663 shutdown_connections 2024-09-17T03:36:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b78078bc0 0x7f9b7807b0d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b981604f0 0x7f9b98155de0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b98153a60 0x7f9b981558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 --2- 172.21.15.146:0/102770663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b98073480 0x7f9b981f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/102770663 >> 172.21.15.146:0/102770663 conn(0x7f9b980b2060 msgr2=0x7f9b980b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/102770663 shutdown_connections 2024-09-17T03:36:01.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:01.902+0000 7f9b9ca1d640 1 -- 172.21.15.146:0/102770663 wait complete. 2024-09-17T03:36:01.913 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-17T03:36:01.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-17T03:36:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.029+0000 7f9a3f520640 1 -- 172.21.15.146:0/815629949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a240053f0 msgr2=0x7f9a2400ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.029+0000 7f9a3f520640 1 --2- 172.21.15.146:0/815629949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a240053f0 0x7f9a2400ba80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000c640 tx=0x7f9a24005830 comp rx=0 tx=0).stop 2024-09-17T03:36:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.029+0000 7f9a3f520640 1 -- 172.21.15.146:0/815629949 shutdown_connections 2024-09-17T03:36:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.029+0000 7f9a3f520640 1 --2- 172.21.15.146:0/815629949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a240053f0 0x7f9a2400ba80 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.029+0000 7f9a3f520640 1 -- 172.21.15.146:0/815629949 >> 172.21.15.146:0/815629949 conn(0x7f9a380d11f0 msgr2=0x7f9a380d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.029+0000 7f9a3f520640 1 -- 172.21.15.146:0/815629949 shutdown_connections 2024-09-17T03:36:02.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.029+0000 7f9a3f520640 1 -- 172.21.15.146:0/815629949 wait complete. 2024-09-17T03:36:02.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.031+0000 7f9a3f520640 1 Processor -- start 2024-09-17T03:36:02.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.031+0000 7f9a3f520640 1 -- start start 2024-09-17T03:36:02.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.032+0000 7f9a3f520640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a380c9260 0x7f9a3815b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.032+0000 7f9a3f520640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ca940 0x7f9a3815deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.032+0000 7f9a3f520640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a380cad50 0x7f9a3815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.032+0000 7f9a3f520640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a381631a0 con 0x7f9a380c9260 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.032+0000 7f9a3f520640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9a380b6a90 con 0x7f9a380cad50 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.032+0000 7f9a3f520640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9a38163320 con 0x7f9a380ca940 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.032+0000 7f9a3d2bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a380c9260 0x7f9a3815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.032+0000 7f9a3d2bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a380c9260 0x7f9a3815b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40130/0 (socket says 172.21.15.146:40130) 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.032+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/1882701656 learned_addr learned my addr 172.21.15.146:0/1882701656 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.032+0000 7f9a3cabb640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ca940 0x7f9a3815deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a3dabd640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a380cad50 0x7f9a3815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ca940 msgr2=0x7f9a3815deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ca940 0x7f9a3815deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a380cad50 msgr2=0x7f9a3815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a380cad50 0x7f9a3815e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/1882701656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a381f9000 con 0x7f9a380c9260 2024-09-17T03:36:02.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a380c9260 0x7f9a3815b990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9a34003e10 tx=0x7f9a34001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a2dffb640 1 -- 172.21.15.146:0/1882701656 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34015070 con 0x7f9a380c9260 2024-09-17T03:36:02.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a2dffb640 1 -- 172.21.15.146:0/1882701656 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a34011840 con 0x7f9a380c9260 2024-09-17T03:36:02.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a3f520640 1 -- 172.21.15.146:0/1882701656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a381f92e0 con 0x7f9a380c9260 2024-09-17T03:36:02.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a2dffb640 1 -- 172.21.15.146:0/1882701656 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34011c70 con 0x7f9a380c9260 2024-09-17T03:36:02.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.033+0000 7f9a3f520640 1 -- 172.21.15.146:0/1882701656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a381f98a0 con 0x7f9a380c9260 2024-09-17T03:36:02.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.035+0000 7f9a2dffb640 1 -- 172.21.15.146:0/1882701656 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a34018070 con 0x7f9a380c9260 2024-09-17T03:36:02.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.035+0000 7f9a2dffb640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a1c078b90 0x7f9a1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.036+0000 7f9a2dffb640 1 -- 172.21.15.146:0/1882701656 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9a3409b770 con 0x7f9a380c9260 2024-09-17T03:36:02.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.036+0000 7f9a3cabb640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a1c078b90 0x7f9a1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.036+0000 7f9a3cabb640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a1c078b90 0x7f9a1c07b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800db30 tx=0x7f9a2800d2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.037+0000 7f9a4648d740 1 Processor -- start 2024-09-17T03:36:02.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.037+0000 7f9a4648d740 1 -- start start 2024-09-17T03:36:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad786070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad7865b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad7a34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a4648d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557bad6ce8f0 con 0x557bad3b41e0 2024-09-17T03:36:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a4648d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557bad6bdd20 con 0x557bad38b320 2024-09-17T03:36:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a4648d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x557bad6c1b30 con 0x557bad393500 2024-09-17T03:36:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a3d2bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad786070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a3d2bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad786070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40136/0 (socket says 172.21.15.146:40136) 2024-09-17T03:36:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/549099554 learned_addr learned my addr 172.21.15.146:0/549099554 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a3cabb640 1 --2- 172.21.15.146:0/549099554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad7865b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a3dabd640 1 --2- 172.21.15.146:0/549099554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad7a34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/549099554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 msgr2=0x557bad7a34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/549099554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad7a34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/549099554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 msgr2=0x557bad7865b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/549099554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad7865b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.038+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/549099554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bad41f7c0 con 0x557bad3b41e0 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.039+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/549099554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad786070 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9a34099c90 tx=0x7f9a34062e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31a0a4998cd5aa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.039+0000 7f9a22ffd640 1 -- 172.21.15.146:0/549099554 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3401f040 con 0x557bad3b41e0 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.039+0000 7f9a22ffd640 1 -- 172.21.15.146:0/549099554 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a34068070 con 0x557bad3b41e0 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.039+0000 7f9a22ffd640 1 -- 172.21.15.146:0/549099554 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3406ccf0 con 0x557bad3b41e0 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.039+0000 7f9a4648d740 1 -- 172.21.15.146:0/549099554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 msgr2=0x557bad786070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.039+0000 7f9a4648d740 1 --2- 172.21.15.146:0/549099554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad786070 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9a34099c90 tx=0x7f9a34062e70 comp rx=0 tx=0).stop 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.039+0000 7f9a4648d740 1 -- 172.21.15.146:0/549099554 shutdown_connections 2024-09-17T03:36:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.039+0000 7f9a4648d740 1 --2- 172.21.15.146:0/549099554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad7a34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.039+0000 7f9a4648d740 1 --2- 172.21.15.146:0/549099554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad7865b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.039+0000 7f9a4648d740 1 --2- 172.21.15.146:0/549099554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad786070 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.040+0000 7f9a4648d740 1 -- 172.21.15.146:0/549099554 >> 172.21.15.146:0/549099554 conn(0x557bad3a8330 msgr2=0x557bad75c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.040+0000 7f9a4648d740 1 -- 172.21.15.146:0/549099554 shutdown_connections 2024-09-17T03:36:02.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.040+0000 7f9a4648d740 1 -- 172.21.15.146:0/549099554 wait complete. 2024-09-17T03:36:02.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.040+0000 7f9a4648d740 1 -- start start 2024-09-17T03:36:02.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.040+0000 7f9a4648d740 1 Processor -- start 2024-09-17T03:36:02.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad766bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad7b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a4648d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x557bad42e590 con 0x557bad3b41e0 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a4648d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557bad6636c0 con 0x557bad38b320 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a4648d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x557bad786af0 con 0x557bad393500 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a4648d740 10 client.0 _ll_register_callbacks cb 0x557bad667170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3dabd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3dabd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40152/0 (socket says 172.21.15.146:40152) 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3dabd640 1 -- 172.21.15.146:0/1945852990 learned_addr learned my addr 172.21.15.146:0/1945852990 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3cabb640 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad7b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad766bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3dabd640 1 -- 172.21.15.146:0/1945852990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 msgr2=0x557bad7b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3dabd640 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad7b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3dabd640 1 -- 172.21.15.146:0/1945852990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 msgr2=0x557bad766bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3dabd640 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad766bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3dabd640 1 -- 172.21.15.146:0/1945852990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bad496620 con 0x557bad3b41e0 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad766bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.042+0000 7f9a3cabb640 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad7b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a3dabd640 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a3210 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000c760 tx=0x7f9a30002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd73d7630add327 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a17fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a17fff640 1 -- 172.21.15.146:0/1945852990 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30039040 con 0x557bad3b41e0 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a17fff640 1 -- 172.21.15.146:0/1945852990 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9a30003b70 con 0x557bad3b41e0 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a4648d740 1 -- 172.21.15.146:0/1945852990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a34068070 con 0x557bad3b41e0 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a17fff640 1 -- 172.21.15.146:0/1945852990 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9a3004b050 con 0x557bad3b41e0 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a4648d740 10 client.6186 fetch_fsmap learned FSMap version 22 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a4648d740 1 -- 172.21.15.146:0/1945852990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x557bad7b00f0 con 0x557bad3b41e0 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a17fff640 1 -- 172.21.15.146:0/1945852990 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a34068070 con 0x557bad3b41e0 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a17fff640 1 -- 172.21.15.146:0/1945852990 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f9a3004e020 con 0x557bad3b41e0 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a4648d740 10 client.6186 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T03:36:02.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a4648d740 10 client.6186 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a4648d740 20 client.6186 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a4648d740 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557bad372fc0 0x557bad7a3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a4648d740 4 client.6186 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a4648d740 1 -- 172.21.15.146:0/1945852990 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bad6d0840 con 0x557bad372fc0 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.043+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557bad372fc0 0x557bad7a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a17fff640 10 client.6186 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557bad372fc0 0x557bad7a3750 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44b9d67f767c8c73 server_cookie=6d6c72e9a0286c7b in_seq=0 out_seq=0 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a17fff640 1 -- 172.21.15.146:0/1945852990 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557bad6d0840 con 0x557bad372fc0 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a17fff640 10 client.6186 handle_command_reply: tid=0 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a4648d740 1 client.6186 shutdown 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a4648d740 1 -- 172.21.15.146:0/1945852990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 msgr2=0x557bad7a3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a4648d740 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a3210 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000c760 tx=0x7f9a30002120 comp rx=0 tx=0).stop 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a4648d740 1 -- 172.21.15.146:0/1945852990 shutdown_connections 2024-09-17T03:36:02.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a4648d740 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557bad372fc0 0x557bad7a3750 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a4648d740 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a3210 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a4648d740 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad7b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a17fff640 0 client.6186 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:02.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.044+0000 7f9a4648d740 1 --2- 172.21.15.146:0/1945852990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad766bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.045+0000 7f9a4648d740 1 -- 172.21.15.146:0/1945852990 >> 172.21.15.146:0/1945852990 conn(0x557bad3a8330 msgr2=0x557bad7a2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.045+0000 7f9a4648d740 1 -- 172.21.15.146:0/1945852990 shutdown_connections 2024-09-17T03:36:02.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.045+0000 7f9a4648d740 1 -- 172.21.15.146:0/1945852990 wait complete. 2024-09-17T03:36:02.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.045+0000 7f9a4648d740 20 client.6186 trim_cache size 0 max 16384 2024-09-17T03:36:02.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.059+0000 7f9a4648d740 1 Processor -- start 2024-09-17T03:36:02.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.060+0000 7f9a4648d740 1 -- start start 2024-09-17T03:36:02.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad38b320 0x557bad751bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad393500 0x557bad756780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad3b41e0 0x557bad756cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a4648d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a38202c60 con 0x557bad38b320 2024-09-17T03:36:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a4648d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9a38201cc0 con 0x557bad393500 2024-09-17T03:36:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a4648d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9a38201020 con 0x557bad3b41e0 2024-09-17T03:36:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a3d2bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad38b320 0x557bad751bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a3d2bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad38b320 0x557bad751bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40168/0 (socket says 172.21.15.146:40168) 2024-09-17T03:36:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/255634177 learned_addr learned my addr 172.21.15.146:0/255634177 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/255634177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad3b41e0 msgr2=0x557bad756cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:02.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/255634177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad3b41e0 0x557bad756cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/255634177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad393500 msgr2=0x557bad756780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/255634177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad393500 0x557bad756780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a3d2bc640 1 -- 172.21.15.146:0/255634177 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bad7b2e80 con 0x557bad38b320 2024-09-17T03:36:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/255634177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad38b320 0x557bad751bf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9a34001b30 tx=0x7f9a34066040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6cb7f1258ed19a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a227fc640 1 -- 172.21.15.146:0/255634177 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3401f040 con 0x557bad38b320 2024-09-17T03:36:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a227fc640 1 -- 172.21.15.146:0/255634177 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a34011e10 con 0x557bad38b320 2024-09-17T03:36:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.061+0000 7f9a227fc640 1 -- 172.21.15.146:0/255634177 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3406ccf0 con 0x557bad38b320 2024-09-17T03:36:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.062+0000 7f9a4648d740 1 -- 172.21.15.146:0/255634177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad38b320 msgr2=0x557bad751bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.062+0000 7f9a4648d740 1 --2- 172.21.15.146:0/255634177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad38b320 0x557bad751bf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9a34001b30 tx=0x7f9a34066040 comp rx=0 tx=0).stop 2024-09-17T03:36:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.062+0000 7f9a4648d740 1 -- 172.21.15.146:0/255634177 shutdown_connections 2024-09-17T03:36:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.062+0000 7f9a4648d740 1 --2- 172.21.15.146:0/255634177 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad3b41e0 0x557bad756cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.062+0000 7f9a4648d740 1 --2- 172.21.15.146:0/255634177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad393500 0x557bad756780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.062+0000 7f9a4648d740 1 --2- 172.21.15.146:0/255634177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad38b320 0x557bad751bf0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.062+0000 7f9a4648d740 1 -- 172.21.15.146:0/255634177 >> 172.21.15.146:0/255634177 conn(0x557bad3a8330 msgr2=0x557bad79c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.062+0000 7f9a4648d740 1 -- 172.21.15.146:0/255634177 shutdown_connections 2024-09-17T03:36:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.062+0000 7f9a4648d740 1 -- 172.21.15.146:0/255634177 wait complete. 2024-09-17T03:36:02.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.063+0000 7f9a4648d740 1 -- start start 2024-09-17T03:36:02.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.063+0000 7f9a4648d740 1 Processor -- start 2024-09-17T03:36:02.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.064+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad81fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad755e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a4648d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a4648d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a38201670 con 0x557bad3b41e0 2024-09-17T03:36:02.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a4648d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x557bad8203b0 con 0x557bad38b320 2024-09-17T03:36:02.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a4648d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x557bad765f60 con 0x557bad393500 2024-09-17T03:36:02.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a4648d740 10 client.0 _ll_register_callbacks cb 0x7f9a240052d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:02.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a3dabd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a3dabd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40184/0 (socket says 172.21.15.146:40184) 2024-09-17T03:36:02.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a3dabd640 1 -- 172.21.15.146:0/2405383401 learned_addr learned my addr 172.21.15.146:0/2405383401 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:02.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad81fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a3cabb640 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad755e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a3dabd640 1 -- 172.21.15.146:0/2405383401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 msgr2=0x557bad755e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:02.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a3dabd640 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad755e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a3dabd640 1 -- 172.21.15.146:0/2405383401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 msgr2=0x557bad81fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a3dabd640 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad81fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a3dabd640 1 -- 172.21.15.146:0/2405383401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bad7661b0 con 0x557bad3b41e0 2024-09-17T03:36:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a3dabd640 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a2b50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9a30003f80 tx=0x7f9a3002dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668531dacb04ea10 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a17fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a17fff640 1 -- 172.21.15.146:0/2405383401 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30039040 con 0x557bad3b41e0 2024-09-17T03:36:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a17fff640 1 -- 172.21.15.146:0/2405383401 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9a30040b40 con 0x557bad3b41e0 2024-09-17T03:36:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a4648d740 1 -- 172.21.15.146:0/2405383401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a34011e10 con 0x557bad3b41e0 2024-09-17T03:36:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a17fff640 1 -- 172.21.15.146:0/2405383401 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9a3002b520 con 0x557bad3b41e0 2024-09-17T03:36:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a4648d740 10 client.6192 fetch_fsmap learned FSMap version 22 2024-09-17T03:36:02.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.065+0000 7f9a4648d740 1 -- 172.21.15.146:0/2405383401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x557bad7564b0 con 0x557bad3b41e0 2024-09-17T03:36:02.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.066+0000 7f9a17fff640 1 -- 172.21.15.146:0/2405383401 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a34011e10 con 0x557bad3b41e0 2024-09-17T03:36:02.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.066+0000 7f9a17fff640 1 -- 172.21.15.146:0/2405383401 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f9a3004e070 con 0x557bad3b41e0 2024-09-17T03:36:02.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.066+0000 7f9a4648d740 10 client.6192 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T03:36:02.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.066+0000 7f9a4648d740 10 client.6192 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T03:36:02.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.066+0000 7f9a4648d740 20 client.6192 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.066+0000 7f9a4648d740 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557bad8237b0 0x557bad823bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.066+0000 7f9a4648d740 4 client.6192 mds_command: new command op to 5400 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.066+0000 7f9a4648d740 1 -- 172.21.15.146:0/2405383401 --> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x557bad6cc2f0 con 0x557bad8237b0 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.066+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557bad8237b0 0x557bad823bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.066+0000 7f9a17fff640 10 client.6192 ms_handle_connect on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.066+0000 7f9a3d2bc640 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557bad8237b0 0x557bad823bc0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed92685c17bd046b server_cookie=c701b4d5e60b247b in_seq=0 out_seq=0 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a17fff640 1 -- 172.21.15.146:0/2405383401 <== mds.0 v2:172.21.15.146:6834/924109004 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557bad6cc2f0 con 0x557bad8237b0 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a17fff640 10 client.6192 handle_command_reply: tid=0 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 1 client.6192 shutdown 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 1 -- 172.21.15.146:0/2405383401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 msgr2=0x557bad7a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a2b50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9a30003f80 tx=0x7f9a3002dbf0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 1 -- 172.21.15.146:0/2405383401 shutdown_connections 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.146:6834/924109004,v1:172.21.15.146:6835/924109004] conn(0x557bad8237b0 0x557bad823bc0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557bad3b41e0 0x557bad7a2b50 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x557bad393500 0x557bad755e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a17fff640 0 client.6192 ms_handle_reset on v2:172.21.15.146:6834/924109004 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 1 --2- 172.21.15.146:0/2405383401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x557bad38b320 0x557bad81fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 1 -- 172.21.15.146:0/2405383401 >> 172.21.15.146:0/2405383401 conn(0x557bad3a8330 msgr2=0x557bad775af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 1 -- 172.21.15.146:0/2405383401 shutdown_connections 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 1 -- 172.21.15.146:0/2405383401 wait complete. 2024-09-17T03:36:02.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.069+0000 7f9a4648d740 20 client.6192 trim_cache size 0 max 16384 2024-09-17T03:36:02.083 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:36:02.083 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:36:02.083 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:36:02.083 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 -- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a1c078b90 msgr2=0x7f9a1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a1c078b90 0x7f9a1c07b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800db30 tx=0x7f9a2800d2e0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 -- 172.21.15.146:0/1882701656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a380c9260 msgr2=0x7f9a3815b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a380c9260 0x7f9a3815b990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9a34003e10 tx=0x7f9a34001630 comp rx=0 tx=0).stop 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 -- 172.21.15.146:0/1882701656 shutdown_connections 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a1c078b90 0x7f9a1c07b0a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a380cad50 0x7f9a3815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a380ca940 0x7f9a3815deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 --2- 172.21.15.146:0/1882701656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a380c9260 0x7f9a3815b990 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 -- 172.21.15.146:0/1882701656 >> 172.21.15.146:0/1882701656 conn(0x7f9a380d11f0 msgr2=0x7f9a380b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 -- 172.21.15.146:0/1882701656 shutdown_connections 2024-09-17T03:36:02.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.070+0000 7f9a3f520640 1 -- 172.21.15.146:0/1882701656 wait complete. 2024-09-17T03:36:02.086 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-17T03:36:02.086 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:36:02.086 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:36:02.126 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:36:02.176 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:36:02.176 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:36:02.176 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:02.177 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:02.192 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:02.192 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:02.248 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:36:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.403+0000 7fc845fda640 1 -- 172.21.15.146:0/690930739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8400cd7a0 msgr2=0x7fc8400cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.403+0000 7fc845fda640 1 --2- 172.21.15.146:0/690930739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8400cd7a0 0x7fc8400cdbb0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc838005fd0 tx=0x7fc83802aaa0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.403+0000 7fc845fda640 1 -- 172.21.15.146:0/690930739 shutdown_connections 2024-09-17T03:36:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.403+0000 7fc845fda640 1 --2- 172.21.15.146:0/690930739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8400cd7a0 0x7fc8400cdbb0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.403+0000 7fc845fda640 1 -- 172.21.15.146:0/690930739 >> 172.21.15.146:0/690930739 conn(0x7fc84009ba20 msgr2=0x7fc8400b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.403+0000 7fc845fda640 1 -- 172.21.15.146:0/690930739 shutdown_connections 2024-09-17T03:36:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.403+0000 7fc845fda640 1 -- 172.21.15.146:0/690930739 wait complete. 2024-09-17T03:36:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.405+0000 7fc845fda640 1 Processor -- start 2024-09-17T03:36:02.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.405+0000 7fc845fda640 1 -- start start 2024-09-17T03:36:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.406+0000 7fc845fda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8400b47c0 0x7fc84015ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.406+0000 7fc845fda640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8400cd7a0 0x7fc8400b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.406+0000 7fc845fda640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8400d0710 0x7fc8400caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.406+0000 7fc845fda640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc8400b2ed0 con 0x7fc8400d0710 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.406+0000 7fc845fda640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc8400b80a0 con 0x7fc8400b47c0 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.406+0000 7fc845fda640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc840168470 con 0x7fc8400cd7a0 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc83ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8400d0710 0x7fc8400caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc83ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8400d0710 0x7fc8400caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40212/0 (socket says 172.21.15.146:40212) 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc83ffff640 1 -- 172.21.15.146:0/2315143936 learned_addr learned my addr 172.21.15.146:0/2315143936 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc83f7fe640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8400b47c0 0x7fc84015ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc83effd640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8400cd7a0 0x7fc8400b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc83ffff640 1 -- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8400cd7a0 msgr2=0x7fc8400b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc83ffff640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8400cd7a0 0x7fc8400b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc83ffff640 1 -- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8400b47c0 msgr2=0x7fc84015ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc83ffff640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8400b47c0 0x7fc84015ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc83ffff640 1 -- 172.21.15.146:0/2315143936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84015db40 con 0x7fc8400d0710 2024-09-17T03:36:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc83ffff640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8400d0710 0x7fc8400caf50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc838009d90 tx=0x7fc838003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc827fff640 1 -- 172.21.15.146:0/2315143936 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838044070 con 0x7fc8400d0710 2024-09-17T03:36:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc827fff640 1 -- 172.21.15.146:0/2315143936 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc838004250 con 0x7fc8400d0710 2024-09-17T03:36:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc845fda640 1 -- 172.21.15.146:0/2315143936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84015b050 con 0x7fc8400d0710 2024-09-17T03:36:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc827fff640 1 -- 172.21.15.146:0/2315143936 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc838004660 con 0x7fc8400d0710 2024-09-17T03:36:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.407+0000 7fc845fda640 1 -- 172.21.15.146:0/2315143936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8400c7bc0 con 0x7fc8400d0710 2024-09-17T03:36:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.408+0000 7fc845fda640 1 -- 172.21.15.146:0/2315143936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8400cdbb0 con 0x7fc8400d0710 2024-09-17T03:36:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.409+0000 7fc827fff640 1 -- 172.21.15.146:0/2315143936 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc838047070 con 0x7fc8400d0710 2024-09-17T03:36:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.410+0000 7fc827fff640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc82c078b90 0x7fc82c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.410+0000 7fc827fff640 1 -- 172.21.15.146:0/2315143936 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc8380bbda0 con 0x7fc8400d0710 2024-09-17T03:36:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.410+0000 7fc83f7fe640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc82c078b90 0x7fc82c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.410+0000 7fc83f7fe640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc82c078b90 0x7fc82c07b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc830000f60 tx=0x7fc830009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:02.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.414+0000 7fc827fff640 1 -- 172.21.15.146:0/2315143936 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc84015db40 con 0x7fc8400d0710 2024-09-17T03:36:02.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.600+0000 7fc845fda640 1 -- 172.21.15.146:0/2315143936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc8400ced70 con 0x7fc8400d0710 2024-09-17T03:36:02.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.600+0000 7fc827fff640 1 -- 172.21.15.146:0/2315143936 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) ==== 80+0+0 (secure 0 0 0) 0x7fc838032030 con 0x7fc8400d0710 2024-09-17T03:36:02.600 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:36:02.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 -- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc82c078b90 msgr2=0x7fc82c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc82c078b90 0x7fc82c07b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc830000f60 tx=0x7fc830009040 comp rx=0 tx=0).stop 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 -- 172.21.15.146:0/2315143936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8400d0710 msgr2=0x7fc8400caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8400d0710 0x7fc8400caf50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc838009d90 tx=0x7fc838003d00 comp rx=0 tx=0).stop 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 -- 172.21.15.146:0/2315143936 shutdown_connections 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc82c078b90 0x7fc82c07b0a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8400d0710 0x7fc8400caf50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8400cd7a0 0x7fc8400b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 --2- 172.21.15.146:0/2315143936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8400b47c0 0x7fc84015ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 -- 172.21.15.146:0/2315143936 >> 172.21.15.146:0/2315143936 conn(0x7fc84009ba20 msgr2=0x7fc8400b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 -- 172.21.15.146:0/2315143936 shutdown_connections 2024-09-17T03:36:02.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:02.602+0000 7fc845fda640 1 -- 172.21.15.146:0/2315143936 wait complete. 2024-09-17T03:36:02.613 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:36:02.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:02.614 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:04.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:36:04.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:04.049 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:36:04.064 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:36:04.065 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:36:04.065 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:04.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:36:04.081 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:36:04.081 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:04.081 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:04.120 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:36:04.120 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:36:04.120 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:36:04.120 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:04.136 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:36:04.136 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.273+0000 7fc4d6358640 1 -- 172.21.15.146:0/2254406416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4d00b5ce0 msgr2=0x7fc4d00b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.273+0000 7fc4d6358640 1 --2- 172.21.15.146:0/2254406416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4d00b5ce0 0x7fc4d00b1320 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00b6120 tx=0x7fc4c002a530 comp rx=0 tx=0).stop 2024-09-17T03:36:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.273+0000 7fc4d6358640 1 -- 172.21.15.146:0/2254406416 shutdown_connections 2024-09-17T03:36:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.273+0000 7fc4d6358640 1 --2- 172.21.15.146:0/2254406416 >> v2:172.21.15.179:3300/0 conn(0x7fc4d00b3d30 0x7fc4d015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.273+0000 7fc4d6358640 1 --2- 172.21.15.146:0/2254406416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4d00b5ce0 0x7fc4d00b1320 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.273+0000 7fc4d6358640 1 -- 172.21.15.146:0/2254406416 >> 172.21.15.146:0/2254406416 conn(0x7fc4d00b7b20 msgr2=0x7fc4d009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:04.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.273+0000 7fc4d6358640 1 -- 172.21.15.146:0/2254406416 shutdown_connections 2024-09-17T03:36:04.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.273+0000 7fc4d6358640 1 -- 172.21.15.146:0/2254406416 wait complete. 2024-09-17T03:36:04.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.274+0000 7fc4d6358640 1 Processor -- start 2024-09-17T03:36:04.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.275+0000 7fc4d6358640 1 -- start start 2024-09-17T03:36:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4d6358640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4d00b5750 0x7fc4d014f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4d6358640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d00b5ce0 0x7fc4d0153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4d6358640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4d01537b0 0x7fc4d0153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4d6358640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d015d3f0 con 0x7fc4d00b5750 2024-09-17T03:36:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4d6358640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d015d270 con 0x7fc4d01537b0 2024-09-17T03:36:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4d6358640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d015d570 con 0x7fc4d00b5ce0 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4cffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4d00b5750 0x7fc4d014f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4cffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4d00b5750 0x7fc4d014f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40224/0 (socket says 172.21.15.146:40224) 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4cffff640 1 -- 172.21.15.146:0/2117741606 learned_addr learned my addr 172.21.15.146:0/2117741606 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4d48f5640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4d01537b0 0x7fc4d0153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4cf7fe640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d00b5ce0 0x7fc4d0153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4cffff640 1 -- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d00b5ce0 msgr2=0x7fc4d0153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4cffff640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d00b5ce0 0x7fc4d0153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4cffff640 1 -- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4d01537b0 msgr2=0x7fc4d0153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4cffff640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4d01537b0 0x7fc4d0153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.276+0000 7fc4cffff640 1 -- 172.21.15.146:0/2117741606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d014fee0 con 0x7fc4d00b5750 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.277+0000 7fc4cffff640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4d00b5750 0x7fc4d014f240 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc4c002ab20 tx=0x7fc4c0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.277+0000 7fc4ccff9640 1 -- 172.21.15.146:0/2117741606 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0031d60 con 0x7fc4d00b5750 2024-09-17T03:36:04.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.277+0000 7fc4ccff9640 1 -- 172.21.15.146:0/2117741606 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4c0033e10 con 0x7fc4d00b5750 2024-09-17T03:36:04.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.277+0000 7fc4d6358640 1 -- 172.21.15.146:0/2117741606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d014fc40 con 0x7fc4d00b5750 2024-09-17T03:36:04.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.277+0000 7fc4ccff9640 1 -- 172.21.15.146:0/2117741606 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0005260 con 0x7fc4d00b5750 2024-09-17T03:36:04.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.277+0000 7fc4d6358640 1 -- 172.21.15.146:0/2117741606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d0154870 con 0x7fc4d00b5750 2024-09-17T03:36:04.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.278+0000 7fc4d6358640 1 -- 172.21.15.146:0/2117741606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d015ec50 con 0x7fc4d00b5750 2024-09-17T03:36:04.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.278+0000 7fc4ccff9640 1 -- 172.21.15.146:0/2117741606 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc4c0005400 con 0x7fc4d00b5750 2024-09-17T03:36:04.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.279+0000 7fc4ccff9640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4bc078b90 0x7fc4bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.279+0000 7fc4ccff9640 1 -- 172.21.15.146:0/2117741606 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc4c00bbdd0 con 0x7fc4d00b5750 2024-09-17T03:36:04.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.279+0000 7fc4cf7fe640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4bc078b90 0x7fc4bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.280+0000 7fc4cf7fe640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4bc078b90 0x7fc4bc07b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0152fc0 tx=0x7fc4c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:04.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.284+0000 7fc4ccff9640 1 -- 172.21.15.146:0/2117741606 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc4c003f030 con 0x7fc4d00b5750 2024-09-17T03:36:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.497+0000 7fc4d6358640 1 -- 172.21.15.146:0/2117741606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4d015b790 con 0x7fc4d00b5750 2024-09-17T03:36:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.498+0000 7fc4ccff9640 1 -- 172.21.15.146:0/2117741606 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5229 (secure 0 0 0) 0x7fc4c00bd090 con 0x7fc4d00b5750 2024-09-17T03:36:04.498 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:04.498 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":22,"btime":"2024-09-17T03:35:55:908000+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2310307824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2310307824},{"type":"v1","addr":"172.21.15.179:6836","nonce":2310307824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/422393296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":422393296},{"type":"v1","addr":"172.21.15.179:6837","nonce":422393296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3793010114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3793010114},{"type":"v1","addr":"172.21.15.146:6833","nonce":3793010114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:30.743460+0000","modified":"2024-09-17T03:35:55.423178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/924109004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":924109004},{"type":"v1","addr":"172.21.15.146:6835","nonce":924109004}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5400,"qdb_cluster":[5400]},"id":3}]} 2024-09-17T03:36:04.498 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 22 2024-09-17T03:36:04.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 -- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4bc078b90 msgr2=0x7fc4bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4bc078b90 0x7fc4bc07b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0152fc0 tx=0x7fc4c4009040 comp rx=0 tx=0).stop 2024-09-17T03:36:04.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 -- 172.21.15.146:0/2117741606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4d00b5750 msgr2=0x7fc4d014f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4d00b5750 0x7fc4d014f240 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc4c002ab20 tx=0x7fc4c0033c20 comp rx=0 tx=0).stop 2024-09-17T03:36:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 -- 172.21.15.146:0/2117741606 shutdown_connections 2024-09-17T03:36:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4bc078b90 0x7fc4bc07b0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4d01537b0 0x7fc4d0153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc4d00b5ce0 0x7fc4d0153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 --2- 172.21.15.146:0/2117741606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4d00b5750 0x7fc4d014f240 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 -- 172.21.15.146:0/2117741606 >> 172.21.15.146:0/2117741606 conn(0x7fc4d00b7b20 msgr2=0x7fc4d015bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 -- 172.21.15.146:0/2117741606 shutdown_connections 2024-09-17T03:36:04.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.500+0000 7fc4d6358640 1 -- 172.21.15.146:0/2117741606 wait complete. 2024-09-17T03:36:04.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:04.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.624+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3501435877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c40b5380 msgr2=0x7fb9c4166460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.624+0000 7fb9c8b5f640 1 --2- 172.21.15.146:0/3501435877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c40b5380 0x7fb9c4166460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009be0 tx=0x7fb9bc02a820 comp rx=0 tx=0).stop 2024-09-17T03:36:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.624+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3501435877 shutdown_connections 2024-09-17T03:36:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.624+0000 7fb9c8b5f640 1 --2- 172.21.15.146:0/3501435877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c40b5380 0x7fb9c4166460 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.624+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3501435877 >> 172.21.15.146:0/3501435877 conn(0x7fb9c40b2060 msgr2=0x7fb9c40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.624+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3501435877 shutdown_connections 2024-09-17T03:36:04.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.624+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3501435877 wait complete. 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.626+0000 7fb9c8b5f640 1 Processor -- start 2024-09-17T03:36:04.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.626+0000 7fb9c8b5f640 1 -- start start 2024-09-17T03:36:04.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.627+0000 7fb9c8b5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c4072680 0x7fb9c414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.627+0000 7fb9c8b5f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c40b5380 0x7fb9c4146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.627+0000 7fb9c8b5f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c415b770 0x7fb9c4153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.627+0000 7fb9c8b5f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c4166d30 con 0x7fb9c40b5380 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.627+0000 7fb9c8b5f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c4166bb0 con 0x7fb9c4072680 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.627+0000 7fb9c8b5f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c4166eb0 con 0x7fb9c415b770 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.627+0000 7fb9c1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c40b5380 0x7fb9c4146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.627+0000 7fb9c1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c40b5380 0x7fb9c4146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40232/0 (socket says 172.21.15.146:40232) 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.627+0000 7fb9c1d9b640 1 -- 172.21.15.146:0/3643413207 learned_addr learned my addr 172.21.15.146:0/3643413207 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.627+0000 7fb9c259c640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c4072680 0x7fb9c414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9c2d9d640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c415b770 0x7fb9c4153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9c1d9b640 1 -- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c415b770 msgr2=0x7fb9c4153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9c1d9b640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c415b770 0x7fb9c4153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9c1d9b640 1 -- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c4072680 msgr2=0x7fb9c414eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9c1d9b640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c4072680 0x7fb9c414eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9c1d9b640 1 -- 172.21.15.146:0/3643413207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c414da70 con 0x7fb9c40b5380 2024-09-17T03:36:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9c1d9b640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c40b5380 0x7fb9c4146990 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800e660 tx=0x7fb9b800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9b2ffd640 1 -- 172.21.15.146:0/3643413207 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80052d0 con 0x7fb9c40b5380 2024-09-17T03:36:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3643413207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c414dd50 con 0x7fb9c40b5380 2024-09-17T03:36:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9b2ffd640 1 -- 172.21.15.146:0/3643413207 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9b800c850 con 0x7fb9c40b5380 2024-09-17T03:36:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9b2ffd640 1 -- 172.21.15.146:0/3643413207 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b800cce0 con 0x7fb9c40b5380 2024-09-17T03:36:04.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.628+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3643413207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c414e310 con 0x7fb9c40b5380 2024-09-17T03:36:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.629+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3643413207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c415ae70 con 0x7fb9c40b5380 2024-09-17T03:36:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.630+0000 7fb9b2ffd640 1 -- 172.21.15.146:0/3643413207 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb9b8003640 con 0x7fb9c40b5380 2024-09-17T03:36:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.630+0000 7fb9b2ffd640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9a4078bc0 0x7fb9a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.631+0000 7fb9b2ffd640 1 -- 172.21.15.146:0/3643413207 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fb9b809d330 con 0x7fb9c40b5380 2024-09-17T03:36:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.631+0000 7fb9c259c640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9a4078bc0 0x7fb9a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.631+0000 7fb9c259c640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9a4078bc0 0x7fb9a407b0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4000c00 tx=0x7fb9b4004600 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:04.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.635+0000 7fb9b2ffd640 1 -- 172.21.15.146:0/3643413207 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9b80651b0 con 0x7fb9c40b5380 2024-09-17T03:36:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.847+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3643413207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9c415ab90 con 0x7fb9c40b5380 2024-09-17T03:36:04.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.847+0000 7fb9b2ffd640 1 -- 172.21.15.146:0/3643413207 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5229 (secure 0 0 0) 0x7fb9b8069be0 con 0x7fb9c40b5380 2024-09-17T03:36:04.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:04.848 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":22,"btime":"2024-09-17T03:35:55:908000+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2310307824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2310307824},{"type":"v1","addr":"172.21.15.179:6836","nonce":2310307824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/422393296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":422393296},{"type":"v1","addr":"172.21.15.179:6837","nonce":422393296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3793010114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3793010114},{"type":"v1","addr":"172.21.15.146:6833","nonce":3793010114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:30.743460+0000","modified":"2024-09-17T03:35:55.423178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/924109004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":924109004},{"type":"v1","addr":"172.21.15.146:6835","nonce":924109004}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5400,"qdb_cluster":[5400]},"id":3}]} 2024-09-17T03:36:04.848 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 22 2024-09-17T03:36:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9a4078bc0 msgr2=0x7fb9a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9a4078bc0 0x7fb9a407b0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4000c00 tx=0x7fb9b4004600 comp rx=0 tx=0).stop 2024-09-17T03:36:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3643413207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c40b5380 msgr2=0x7fb9c4146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c40b5380 0x7fb9c4146990 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800e660 tx=0x7fb9b800eb20 comp rx=0 tx=0).stop 2024-09-17T03:36:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3643413207 shutdown_connections 2024-09-17T03:36:04.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9a4078bc0 0x7fb9a407b0d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9c415b770 0x7fb9c4153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c40b5380 0x7fb9c4146990 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 --2- 172.21.15.146:0/3643413207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9c4072680 0x7fb9c414eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3643413207 >> 172.21.15.146:0/3643413207 conn(0x7fb9c40b2060 msgr2=0x7fb9c40affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:04.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3643413207 shutdown_connections 2024-09-17T03:36:04.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.850+0000 7fb9c8b5f640 1 -- 172.21.15.146:0/3643413207 wait complete. 2024-09-17T03:36:04.861 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.974+0000 7ff49e17b640 1 -- 172.21.15.146:0/455834872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4980b3870 msgr2=0x7ff4980cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.974+0000 7ff49e17b640 1 --2- 172.21.15.146:0/455834872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4980b3870 0x7ff4980cf370 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff488009830 tx=0x7ff48802a480 comp rx=0 tx=0).stop 2024-09-17T03:36:04.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.974+0000 7ff49e17b640 1 -- 172.21.15.146:0/455834872 shutdown_connections 2024-09-17T03:36:04.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.974+0000 7ff49e17b640 1 --2- 172.21.15.146:0/455834872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4981620f0 0x7ff49806ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.974+0000 7ff49e17b640 1 --2- 172.21.15.146:0/455834872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4980b3870 0x7ff4980cf370 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.974+0000 7ff49e17b640 1 -- 172.21.15.146:0/455834872 >> 172.21.15.146:0/455834872 conn(0x7ff4980d4be0 msgr2=0x7ff4980d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:04.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.974+0000 7ff49e17b640 1 -- 172.21.15.146:0/455834872 shutdown_connections 2024-09-17T03:36:04.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.974+0000 7ff49e17b640 1 -- 172.21.15.146:0/455834872 wait complete. 2024-09-17T03:36:04.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.976+0000 7ff49e17b640 1 Processor -- start 2024-09-17T03:36:04.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.976+0000 7ff49e17b640 1 -- start start 2024-09-17T03:36:04.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.977+0000 7ff49e17b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff49806f270 0x7ff4980c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.977+0000 7ff49e17b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4980b3870 0x7ff49814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.977+0000 7ff49e17b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4981620f0 0x7ff49815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.977+0000 7ff49e17b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff4980d43b0 con 0x7ff4981620f0 2024-09-17T03:36:04.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.977+0000 7ff49e17b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff498162fb0 con 0x7ff49806f270 2024-09-17T03:36:04.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.977+0000 7ff49e17b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff4980ca4e0 con 0x7ff4980b3870 2024-09-17T03:36:04.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.977+0000 7ff497fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4981620f0 0x7ff49815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.977+0000 7ff497fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4981620f0 0x7ff49815c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40250/0 (socket says 172.21.15.146:40250) 2024-09-17T03:36:04.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.977+0000 7ff497fff640 1 -- 172.21.15.146:0/27548880 learned_addr learned my addr 172.21.15.146:0/27548880 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:04.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.977+0000 7ff48ffff640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4980b3870 0x7ff49814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff4977fe640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff49806f270 0x7ff4980c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff497fff640 1 -- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4980b3870 msgr2=0x7ff49814eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff497fff640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4980b3870 0x7ff49814eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff497fff640 1 -- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff49806f270 msgr2=0x7ff4980c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:04.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff497fff640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff49806f270 0x7ff4980c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:04.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff497fff640 1 -- 172.21.15.146:0/27548880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4980ca220 con 0x7ff4981620f0 2024-09-17T03:36:04.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff497fff640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4981620f0 0x7ff49815c2d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff49000caa0 tx=0x7ff49000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:04.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff494ff9640 1 -- 172.21.15.146:0/27548880 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490016020 con 0x7ff4981620f0 2024-09-17T03:36:04.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff494ff9640 1 -- 172.21.15.146:0/27548880 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff49000ac90 con 0x7ff4981620f0 2024-09-17T03:36:04.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff49e17b640 1 -- 172.21.15.146:0/27548880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4981f9410 con 0x7ff4981620f0 2024-09-17T03:36:04.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff494ff9640 1 -- 172.21.15.146:0/27548880 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff490012680 con 0x7ff4981620f0 2024-09-17T03:36:04.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.978+0000 7ff49e17b640 1 -- 172.21.15.146:0/27548880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4981f99d0 con 0x7ff4981620f0 2024-09-17T03:36:04.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.979+0000 7ff49e17b640 1 -- 172.21.15.146:0/27548880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff498163460 con 0x7ff4981620f0 2024-09-17T03:36:04.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.980+0000 7ff494ff9640 1 -- 172.21.15.146:0/27548880 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff490019020 con 0x7ff4981620f0 2024-09-17T03:36:04.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.980+0000 7ff494ff9640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff478078bc0 0x7ff47807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:04.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.981+0000 7ff494ff9640 1 -- 172.21.15.146:0/27548880 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff49009b100 con 0x7ff4981620f0 2024-09-17T03:36:04.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.981+0000 7ff4977fe640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff478078bc0 0x7ff47807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:04.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.981+0000 7ff4977fe640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff478078bc0 0x7ff47807b0d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff488034000 tx=0x7ff488004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:04.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:04.985+0000 7ff494ff9640 1 -- 172.21.15.146:0/27548880 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff490020020 con 0x7ff4981620f0 2024-09-17T03:36:05.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.160+0000 7ff49e17b640 1 -- 172.21.15.146:0/27548880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4980d2bd0 con 0x7ff4981620f0 2024-09-17T03:36:05.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.161+0000 7ff494ff9640 1 -- 172.21.15.146:0/27548880 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16872 (secure 0 0 0) 0x7ff49806f680 con 0x7ff4981620f0 2024-09-17T03:36:05.161 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:05.161 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":47,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:35:41.615956+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:28.420197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:29.707406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:05.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 -- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff478078bc0 msgr2=0x7ff47807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff478078bc0 0x7ff47807b0d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff488034000 tx=0x7ff488004730 comp rx=0 tx=0).stop 2024-09-17T03:36:05.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 -- 172.21.15.146:0/27548880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4981620f0 msgr2=0x7ff49815c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4981620f0 0x7ff49815c2d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff49000caa0 tx=0x7ff49000cf60 comp rx=0 tx=0).stop 2024-09-17T03:36:05.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 -- 172.21.15.146:0/27548880 shutdown_connections 2024-09-17T03:36:05.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff478078bc0 0x7ff47807b0d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4981620f0 0x7ff49815c2d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4980b3870 0x7ff49814eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 --2- 172.21.15.146:0/27548880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff49806f270 0x7ff4980c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 -- 172.21.15.146:0/27548880 >> 172.21.15.146:0/27548880 conn(0x7ff4980d4be0 msgr2=0x7ff49815e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:05.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 -- 172.21.15.146:0/27548880 shutdown_connections 2024-09-17T03:36:05.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.163+0000 7ff49e17b640 1 -- 172.21.15.146:0/27548880 wait complete. 2024-09-17T03:36:05.175 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:36:05.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:05.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.287+0000 7ff1e497b640 1 -- 172.21.15.146:0/3015731903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e00cdc50 msgr2=0x7ff1e00b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.287+0000 7ff1e497b640 1 --2- 172.21.15.146:0/3015731903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e00cdc50 0x7ff1e00b4ba0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00b45d0 tx=0x7ff1d802a800 comp rx=0 tx=0).stop 2024-09-17T03:36:05.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.287+0000 7ff1e497b640 1 -- 172.21.15.146:0/3015731903 shutdown_connections 2024-09-17T03:36:05.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.287+0000 7ff1e497b640 1 --2- 172.21.15.146:0/3015731903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e00cdc50 0x7ff1e00b4ba0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.287+0000 7ff1e497b640 1 -- 172.21.15.146:0/3015731903 >> 172.21.15.146:0/3015731903 conn(0x7ff1e00b3150 msgr2=0x7ff1e00b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:05.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.287+0000 7ff1e497b640 1 -- 172.21.15.146:0/3015731903 shutdown_connections 2024-09-17T03:36:05.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.287+0000 7ff1e497b640 1 -- 172.21.15.146:0/3015731903 wait complete. 2024-09-17T03:36:05.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.289+0000 7ff1e497b640 1 Processor -- start 2024-09-17T03:36:05.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.289+0000 7ff1e497b640 1 -- start start 2024-09-17T03:36:05.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1e497b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1e00cd840 0x7ff1e01f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1e497b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1e00cdc50 0x7ff1e0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1e497b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e015c8e0 0x7ff1e01f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1e497b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0073700 con 0x7ff1e015c8e0 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1e497b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0073580 con 0x7ff1e00cdc50 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1e497b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e0073880 con 0x7ff1e00cd840 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1ded9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e015c8e0 0x7ff1e01f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1ded9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e015c8e0 0x7ff1e01f9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40266/0 (socket says 172.21.15.146:40266) 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1ded9d640 1 -- 172.21.15.146:0/2475816357 learned_addr learned my addr 172.21.15.146:0/2475816357 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1d5d9b640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1e00cdc50 0x7ff1e0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1de59c640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1e00cd840 0x7ff1e01f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1ded9d640 1 -- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1e00cd840 msgr2=0x7ff1e01f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1ded9d640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1e00cd840 0x7ff1e01f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1ded9d640 1 -- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1e00cdc50 msgr2=0x7ff1e0156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1ded9d640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1e00cdc50 0x7ff1e0156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1ded9d640 1 -- 172.21.15.146:0/2475816357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e01f5af0 con 0x7ff1e015c8e0 2024-09-17T03:36:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1d5d9b640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1e00cdc50 0x7ff1e0156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:05.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1de59c640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1e00cd840 0x7ff1e01f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:05.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.291+0000 7ff1ded9d640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e015c8e0 0x7ff1e01f9970 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009ca0 tx=0x7ff1d8033f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:05.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.292+0000 7ff1d77fe640 1 -- 172.21.15.146:0/2475816357 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8042020 con 0x7ff1e015c8e0 2024-09-17T03:36:05.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.292+0000 7ff1d77fe640 1 -- 172.21.15.146:0/2475816357 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1d8004330 con 0x7ff1e015c8e0 2024-09-17T03:36:05.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.292+0000 7ff1e497b640 1 -- 172.21.15.146:0/2475816357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e0156a80 con 0x7ff1e015c8e0 2024-09-17T03:36:05.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.292+0000 7ff1d77fe640 1 -- 172.21.15.146:0/2475816357 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8037040 con 0x7ff1e015c8e0 2024-09-17T03:36:05.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.292+0000 7ff1e497b640 1 -- 172.21.15.146:0/2475816357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e01f6040 con 0x7ff1e015c8e0 2024-09-17T03:36:05.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.293+0000 7ff1e497b640 1 -- 172.21.15.146:0/2475816357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e0073d90 con 0x7ff1e015c8e0 2024-09-17T03:36:05.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.293+0000 7ff1d77fe640 1 -- 172.21.15.146:0/2475816357 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1d8045020 con 0x7ff1e015c8e0 2024-09-17T03:36:05.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.294+0000 7ff1d77fe640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1c0078bc0 0x7ff1c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.294+0000 7ff1d77fe640 1 -- 172.21.15.146:0/2475816357 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff1d80bbe90 con 0x7ff1e015c8e0 2024-09-17T03:36:05.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.294+0000 7ff1de59c640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1c0078bc0 0x7ff1c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.295+0000 7ff1de59c640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1c0078bc0 0x7ff1c007b0d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0000f60 tx=0x7ff1d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:05.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.298+0000 7ff1d77fe640 1 -- 172.21.15.146:0/2475816357 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff1d804c030 con 0x7ff1e015c8e0 2024-09-17T03:36:05.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.510+0000 7ff1e497b640 1 -- 172.21.15.146:0/2475816357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1e015e950 con 0x7ff1e015c8e0 2024-09-17T03:36:05.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.510+0000 7ff1d77fe640 1 -- 172.21.15.146:0/2475816357 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5229 (secure 0 0 0) 0x7ff1d802f070 con 0x7ff1e015c8e0 2024-09-17T03:36:05.510 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:05.510 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":22,"btime":"2024-09-17T03:35:55:908000+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2310307824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2310307824},{"type":"v1","addr":"172.21.15.179:6836","nonce":2310307824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/422393296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":422393296},{"type":"v1","addr":"172.21.15.179:6837","nonce":422393296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3793010114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3793010114},{"type":"v1","addr":"172.21.15.146:6833","nonce":3793010114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:30.743460+0000","modified":"2024-09-17T03:35:55.423178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/924109004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":924109004},{"type":"v1","addr":"172.21.15.146:6835","nonce":924109004}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5400,"qdb_cluster":[5400]},"id":3}]} 2024-09-17T03:36:05.511 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 22 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 -- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1c0078bc0 msgr2=0x7ff1c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1c0078bc0 0x7ff1c007b0d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0000f60 tx=0x7ff1d0009040 comp rx=0 tx=0).stop 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 -- 172.21.15.146:0/2475816357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e015c8e0 msgr2=0x7ff1e01f9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e015c8e0 0x7ff1e01f9970 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8009ca0 tx=0x7ff1d8033f00 comp rx=0 tx=0).stop 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 -- 172.21.15.146:0/2475816357 shutdown_connections 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1c0078bc0 0x7ff1c007b0d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1e015c8e0 0x7ff1e01f9970 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1e00cdc50 0x7ff1e0156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 --2- 172.21.15.146:0/2475816357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1e00cd840 0x7ff1e01f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 -- 172.21.15.146:0/2475816357 >> 172.21.15.146:0/2475816357 conn(0x7ff1e00b3150 msgr2=0x7ff1e00b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 -- 172.21.15.146:0/2475816357 shutdown_connections 2024-09-17T03:36:05.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.512+0000 7ff1e497b640 1 -- 172.21.15.146:0/2475816357 wait complete. 2024-09-17T03:36:05.523 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:05.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.636+0000 7fe56968b640 1 -- 172.21.15.146:0/3970150744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640b47c0 msgr2=0x7fe5640cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.636+0000 7fe56968b640 1 --2- 172.21.15.146:0/3970150744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640b47c0 0x7fe5640cd090 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe558005fd0 tx=0x7fe55802a540 comp rx=0 tx=0).stop 2024-09-17T03:36:05.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.636+0000 7fe56968b640 1 -- 172.21.15.146:0/3970150744 shutdown_connections 2024-09-17T03:36:05.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.636+0000 7fe56968b640 1 --2- 172.21.15.146:0/3970150744 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5640cd5d0 0x7fe5640cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.636+0000 7fe56968b640 1 --2- 172.21.15.146:0/3970150744 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640b47c0 0x7fe5640cd090 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.636+0000 7fe56968b640 1 -- 172.21.15.146:0/3970150744 >> 172.21.15.146:0/3970150744 conn(0x7fe56409ba20 msgr2=0x7fe5640b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:05.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.636+0000 7fe56968b640 1 -- 172.21.15.146:0/3970150744 shutdown_connections 2024-09-17T03:36:05.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.636+0000 7fe56968b640 1 -- 172.21.15.146:0/3970150744 wait complete. 2024-09-17T03:36:05.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.638+0000 7fe56968b640 1 Processor -- start 2024-09-17T03:36:05.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.638+0000 7fe56968b640 1 -- start start 2024-09-17T03:36:05.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.639+0000 7fe56968b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5640b47c0 0x7fe5640c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.639+0000 7fe56968b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640cd5d0 0x7fe5641dc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.639+0000 7fe56968b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5640d0710 0x7fe5641f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.639+0000 7fe56968b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe5640b1de0 con 0x7fe5640cd5d0 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.639+0000 7fe56968b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe5640b80a0 con 0x7fe5640d0710 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.639+0000 7fe56968b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe5640b1f60 con 0x7fe5640b47c0 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.639+0000 7fe5627fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640cd5d0 0x7fe5641dc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.639+0000 7fe5627fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640cd5d0 0x7fe5641dc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40292/0 (socket says 172.21.15.146:40292) 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.639+0000 7fe5627fc640 1 -- 172.21.15.146:0/2277512915 learned_addr learned my addr 172.21.15.146:0/2277512915 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe562ffd640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5640b47c0 0x7fe5640c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe5637fe640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5640d0710 0x7fe5641f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe5627fc640 1 -- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5640b47c0 msgr2=0x7fe5640c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe5627fc640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5640b47c0 0x7fe5640c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe5627fc640 1 -- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5640d0710 msgr2=0x7fe5641f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe5627fc640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5640d0710 0x7fe5641f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe5627fc640 1 -- 172.21.15.146:0/2277512915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5641dcbc0 con 0x7fe5640cd5d0 2024-09-17T03:36:05.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe562ffd640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5640b47c0 0x7fe5640c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:05.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe5627fc640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640cd5d0 0x7fe5641dc680 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe558006010 tx=0x7fe5580038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:05.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe54b7fe640 1 -- 172.21.15.146:0/2277512915 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55803e030 con 0x7fe5640cd5d0 2024-09-17T03:36:05.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe54b7fe640 1 -- 172.21.15.146:0/2277512915 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe558003d90 con 0x7fe5640cd5d0 2024-09-17T03:36:05.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe54b7fe640 1 -- 172.21.15.146:0/2277512915 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558035040 con 0x7fe5640cd5d0 2024-09-17T03:36:05.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe56968b640 1 -- 172.21.15.146:0/2277512915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5641f43c0 con 0x7fe5640cd5d0 2024-09-17T03:36:05.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.640+0000 7fe56968b640 1 -- 172.21.15.146:0/2277512915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5641f4b20 con 0x7fe5640cd5d0 2024-09-17T03:36:05.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.641+0000 7fe56968b640 1 -- 172.21.15.146:0/2277512915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5641f4590 con 0x7fe5640cd5d0 2024-09-17T03:36:05.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.642+0000 7fe54b7fe640 1 -- 172.21.15.146:0/2277512915 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe558041030 con 0x7fe5640cd5d0 2024-09-17T03:36:05.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.642+0000 7fe54b7fe640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe550078b90 0x7fe55007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.642+0000 7fe54b7fe640 1 -- 172.21.15.146:0/2277512915 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe5580bb520 con 0x7fe5640cd5d0 2024-09-17T03:36:05.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.643+0000 7fe562ffd640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe550078b90 0x7fe55007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.643+0000 7fe562ffd640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe550078b90 0x7fe55007b0a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe554001da0 tx=0x7fe554009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:05.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.647+0000 7fe54b7fe640 1 -- 172.21.15.146:0/2277512915 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe5580839b0 con 0x7fe5640cd5d0 2024-09-17T03:36:05.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.854+0000 7fe56968b640 1 -- 172.21.15.146:0/2277512915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5640cd090 con 0x7fe5640cd5d0 2024-09-17T03:36:05.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.855+0000 7fe54b7fe640 1 -- 172.21.15.146:0/2277512915 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5229 (secure 0 0 0) 0x7fe5580832b0 con 0x7fe5640cd5d0 2024-09-17T03:36:05.855 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:05.855 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":22,"btime":"2024-09-17T03:35:55:908000+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2310307824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2310307824},{"type":"v1","addr":"172.21.15.179:6836","nonce":2310307824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/422393296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":422393296},{"type":"v1","addr":"172.21.15.179:6837","nonce":422393296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3793010114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3793010114},{"type":"v1","addr":"172.21.15.146:6833","nonce":3793010114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:35:30.743460+0000","modified":"2024-09-17T03:35:55.423178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5400":{"gid":5400,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6835/924109004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":924109004},{"type":"v1","addr":"172.21.15.146:6835","nonce":924109004}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5400,"qdb_cluster":[5400]},"id":3}]} 2024-09-17T03:36:05.855 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 22 2024-09-17T03:36:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 -- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe550078b90 msgr2=0x7fe55007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe550078b90 0x7fe55007b0a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe554001da0 tx=0x7fe554009040 comp rx=0 tx=0).stop 2024-09-17T03:36:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 -- 172.21.15.146:0/2277512915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640cd5d0 msgr2=0x7fe5641dc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640cd5d0 0x7fe5641dc680 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe558006010 tx=0x7fe5580038a0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 -- 172.21.15.146:0/2277512915 shutdown_connections 2024-09-17T03:36:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe550078b90 0x7fe55007b0a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5640d0710 0x7fe5641f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5640cd5d0 0x7fe5641dc680 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 --2- 172.21.15.146:0/2277512915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5640b47c0 0x7fe5640c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 -- 172.21.15.146:0/2277512915 >> 172.21.15.146:0/2277512915 conn(0x7fe56409ba20 msgr2=0x7fe5640b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:05.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 -- 172.21.15.146:0/2277512915 shutdown_connections 2024-09-17T03:36:05.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.857+0000 7fe56968b640 1 -- 172.21.15.146:0/2277512915 wait complete. 2024-09-17T03:36:05.868 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:05.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.981+0000 7f762b4bd640 1 -- 172.21.15.146:0/4105733370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762406f270 msgr2=0x7f76240d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.981+0000 7f762b4bd640 1 --2- 172.21.15.146:0/4105733370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762406f270 0x7f76240d3190 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f76240b3d00 tx=0x7f761c02a980 comp rx=0 tx=0).stop 2024-09-17T03:36:05.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.981+0000 7f762b4bd640 1 -- 172.21.15.146:0/4105733370 shutdown_connections 2024-09-17T03:36:05.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.981+0000 7f762b4bd640 1 --2- 172.21.15.146:0/4105733370 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762406f270 0x7f76240d3190 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.981+0000 7f762b4bd640 1 --2- 172.21.15.146:0/4105733370 >> v2:172.21.15.179:3300/0 conn(0x7f76240cf370 0x7f762406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.981+0000 7f762b4bd640 1 -- 172.21.15.146:0/4105733370 >> 172.21.15.146:0/4105733370 conn(0x7f76240d4be0 msgr2=0x7f76240d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:05.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.981+0000 7f762b4bd640 1 -- 172.21.15.146:0/4105733370 shutdown_connections 2024-09-17T03:36:05.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.981+0000 7f762b4bd640 1 -- 172.21.15.146:0/4105733370 wait complete. 2024-09-17T03:36:05.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.983+0000 7f762b4bd640 1 Processor -- start 2024-09-17T03:36:05.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.983+0000 7f762b4bd640 1 -- start start 2024-09-17T03:36:05.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.984+0000 7f762b4bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762406f270 0x7f76240c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.984+0000 7f762b4bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76240b3870 0x7f76240cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.984+0000 7f762b4bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76240cf370 0x7f76241507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.984+0000 7f762b4bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f76240d3a60 con 0x7f762406f270 2024-09-17T03:36:05.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.984+0000 7f762b4bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f76240d38e0 con 0x7f76240b3870 2024-09-17T03:36:05.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.984+0000 7f762b4bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f76240d3be0 con 0x7f76240cf370 2024-09-17T03:36:05.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.984+0000 7f7629259640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762406f270 0x7f76240c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.984+0000 7f7629259640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762406f270 0x7f76240c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40304/0 (socket says 172.21.15.146:40304) 2024-09-17T03:36:05.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7629259640 1 -- 172.21.15.146:0/1232851094 learned_addr learned my addr 172.21.15.146:0/1232851094 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:05.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7628a58640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76240b3870 0x7f76240cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7629a5a640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76240cf370 0x7f76241507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7629259640 1 -- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76240cf370 msgr2=0x7f76241507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7629259640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76240cf370 0x7f76241507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7629259640 1 -- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76240b3870 msgr2=0x7f76240cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7629259640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76240b3870 0x7f76240cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7629259640 1 -- 172.21.15.146:0/1232851094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76240ccdd0 con 0x7f762406f270 2024-09-17T03:36:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7629259640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762406f270 0x7f76240c97b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f761400b420 tx=0x7f761400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7621ffb640 1 -- 172.21.15.146:0/1232851094 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614011830 con 0x7f762406f270 2024-09-17T03:36:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7621ffb640 1 -- 172.21.15.146:0/1232851094 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7614016070 con 0x7f762406f270 2024-09-17T03:36:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f762b4bd640 1 -- 172.21.15.146:0/1232851094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76240cc5d0 con 0x7f762406f270 2024-09-17T03:36:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f7621ffb640 1 -- 172.21.15.146:0/1232851094 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614011d60 con 0x7f762406f270 2024-09-17T03:36:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.985+0000 7f762b4bd640 1 -- 172.21.15.146:0/1232851094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76240cd370 con 0x7f762406f270 2024-09-17T03:36:05.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.987+0000 7f762b4bd640 1 -- 172.21.15.146:0/1232851094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76240d3190 con 0x7f762406f270 2024-09-17T03:36:05.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.987+0000 7f7621ffb640 1 -- 172.21.15.146:0/1232851094 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f761401b460 con 0x7f762406f270 2024-09-17T03:36:05.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.988+0000 7f7621ffb640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7610078b90 0x7f761007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:05.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.988+0000 7f7621ffb640 1 -- 172.21.15.146:0/1232851094 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f761409a870 con 0x7f762406f270 2024-09-17T03:36:05.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.988+0000 7f7628a58640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7610078b90 0x7f761007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:05.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.988+0000 7f7628a58640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7610078b90 0x7f761007b0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7618005fd0 tx=0x7f7618005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:05.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:05.992+0000 7f7621ffb640 1 -- 172.21.15.146:0/1232851094 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7614020020 con 0x7f762406f270 2024-09-17T03:36:06.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.168+0000 7f762b4bd640 1 -- 172.21.15.146:0/1232851094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76240d2bd0 con 0x7f762406f270 2024-09-17T03:36:06.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.169+0000 7f7621ffb640 1 -- 172.21.15.146:0/1232851094 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16872 (secure 0 0 0) 0x7f7614062c80 con 0x7f762406f270 2024-09-17T03:36:06.170 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:06.170 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":47,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:35:41.615956+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:35:28.420197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T03:35:29.707406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:06.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 -- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7610078b90 msgr2=0x7f761007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7610078b90 0x7f761007b0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7618005fd0 tx=0x7f7618005850 comp rx=0 tx=0).stop 2024-09-17T03:36:06.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 -- 172.21.15.146:0/1232851094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762406f270 msgr2=0x7f76240c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762406f270 0x7f76240c97b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f761400b420 tx=0x7f761400b8e0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 -- 172.21.15.146:0/1232851094 shutdown_connections 2024-09-17T03:36:06.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7610078b90 0x7f761007b0a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f76240cf370 0x7f76241507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f76240b3870 0x7f76240cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 --2- 172.21.15.146:0/1232851094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f762406f270 0x7f76240c97b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 -- 172.21.15.146:0/1232851094 >> 172.21.15.146:0/1232851094 conn(0x7f76240d4be0 msgr2=0x7f76240b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:06.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 -- 172.21.15.146:0/1232851094 shutdown_connections 2024-09-17T03:36:06.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.172+0000 7f762b4bd640 1 -- 172.21.15.146:0/1232851094 wait complete. 2024-09-17T03:36:06.183 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:36:06.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.296+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/2007183106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b9c06e470 msgr2=0x7f9b9c0b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.296+0000 7f9ba0fdf640 1 --2- 172.21.15.146:0/2007183106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b9c06e470 0x7f9b9c0b4940 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009830 tx=0x7f9b9402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.296+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/2007183106 shutdown_connections 2024-09-17T03:36:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.296+0000 7f9ba0fdf640 1 --2- 172.21.15.146:0/2007183106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b9c06e470 0x7f9b9c0b4940 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.296+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/2007183106 >> 172.21.15.146:0/2007183106 conn(0x7f9b9c0b3410 msgr2=0x7f9b9c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.296+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/2007183106 shutdown_connections 2024-09-17T03:36:06.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.296+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/2007183106 wait complete. 2024-09-17T03:36:06.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.298+0000 7f9ba0fdf640 1 Processor -- start 2024-09-17T03:36:06.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.298+0000 7f9ba0fdf640 1 -- start start 2024-09-17T03:36:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9ba0fdf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b9c0b4530 0x7f9b9c0aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9ba0fdf640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b9c0b55f0 0x7f9b9c1ea980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9ba0fdf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b9c1f8cf0 0x7f9b9c1f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9ba0fdf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9c15c0a0 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9ba0fdf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9c15bf20 con 0x7f9b9c0b4530 2024-09-17T03:36:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9ba0fdf640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9b9c15c220 con 0x7f9b9c0b55f0 2024-09-17T03:36:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b9ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b9c1f8cf0 0x7f9b9c1f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b9ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b9c1f8cf0 0x7f9b9c1f9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40320/0 (socket says 172.21.15.146:40320) 2024-09-17T03:36:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b9ad9d640 1 -- 172.21.15.146:0/529873476 learned_addr learned my addr 172.21.15.146:0/529873476 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b99d9b640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b9c0b55f0 0x7f9b9c1ea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b9a59c640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b9c0b4530 0x7f9b9c0aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b9ad9d640 1 -- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b9c0b55f0 msgr2=0x7f9b9c1ea980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b9ad9d640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b9c0b55f0 0x7f9b9c1ea980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b9ad9d640 1 -- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b9c0b4530 msgr2=0x7f9b9c0aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b9ad9d640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b9c0b4530 0x7f9b9c0aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b9ad9d640 1 -- 172.21.15.146:0/529873476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9c1f9640 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b9ad9d640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b9c1f8cf0 0x7f9b9c1f9100 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9b9402abb0 tx=0x7f9b94033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b8affd640 1 -- 172.21.15.146:0/529873476 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94031d60 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b8affd640 1 -- 172.21.15.146:0/529873476 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b94005020 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9b8affd640 1 -- 172.21.15.146:0/529873476 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94005450 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/529873476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b9c1549b0 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.300+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/529873476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b9c154f70 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.302+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/529873476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b9c15c6d0 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.302+0000 7f9b8affd640 1 -- 172.21.15.146:0/529873476 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b940047a0 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.303+0000 7f9b8affd640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b7c078b90 0x7f9b7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.303+0000 7f9b8affd640 1 -- 172.21.15.146:0/529873476 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f9b940bbe80 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.303+0000 7f9b9a59c640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b7c078b90 0x7f9b7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.303+0000 7f9b9a59c640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b7c078b90 0x7f9b7c07b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0012e0 tx=0x7f9b8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:06.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.307+0000 7f9b8affd640 1 -- 172.21.15.146:0/529873476 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b9c1f9640 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.517+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/529873476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9b9c154740 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.517 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:36:06.517+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:36:06.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.519+0000 7f9b8affd640 1 -- 172.21.15.146:0/529873476 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) ==== 161+0+0 (secure 0 0 0) 0x7f9b9403f030 con 0x7f9b9c1f8cf0 2024-09-17T03:36:06.519 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:36:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b7c078b90 msgr2=0x7f9b7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b7c078b90 0x7f9b7c07b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0012e0 tx=0x7f9b8c009040 comp rx=0 tx=0).stop 2024-09-17T03:36:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/529873476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b9c1f8cf0 msgr2=0x7f9b9c1f9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b9c1f8cf0 0x7f9b9c1f9100 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9b9402abb0 tx=0x7f9b94033ce0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/529873476 shutdown_connections 2024-09-17T03:36:06.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b7c078b90 0x7f9b7c07b0a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b9c1f8cf0 0x7f9b9c1f9100 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b9c0b55f0 0x7f9b9c1ea980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 --2- 172.21.15.146:0/529873476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b9c0b4530 0x7f9b9c0aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/529873476 >> 172.21.15.146:0/529873476 conn(0x7f9b9c0b3410 msgr2=0x7f9b9c0734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:06.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/529873476 shutdown_connections 2024-09-17T03:36:06.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.522+0000 7f9ba0fdf640 1 -- 172.21.15.146:0/529873476 wait complete. 2024-09-17T03:36:06.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:36:06.589 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:36:06.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.654+0000 7f1273a1f640 1 -- 172.21.15.146:0/3008916916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c0b3870 msgr2=0x7f126c0cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.654+0000 7f1273a1f640 1 --2- 172.21.15.146:0/3008916916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c0b3870 0x7f126c0cf370 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f126c0b3790 tx=0x7f126802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.654+0000 7f1273a1f640 1 -- 172.21.15.146:0/3008916916 shutdown_connections 2024-09-17T03:36:06.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.654+0000 7f1273a1f640 1 --2- 172.21.15.146:0/3008916916 >> v2:172.21.15.179:3300/0 conn(0x7f126c06f440 0x7f126c0d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.654+0000 7f1273a1f640 1 --2- 172.21.15.146:0/3008916916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c0b3870 0x7f126c0cf370 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.654+0000 7f1273a1f640 1 -- 172.21.15.146:0/3008916916 >> 172.21.15.146:0/3008916916 conn(0x7f126c0d4be0 msgr2=0x7f126c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:06.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.654+0000 7f1273a1f640 1 -- 172.21.15.146:0/3008916916 shutdown_connections 2024-09-17T03:36:06.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.654+0000 7f1273a1f640 1 -- 172.21.15.146:0/3008916916 wait complete. 2024-09-17T03:36:06.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.656+0000 7f1273a1f640 1 Processor -- start 2024-09-17T03:36:06.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.656+0000 7f1273a1f640 1 -- start start 2024-09-17T03:36:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.657+0000 7f1273a1f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c0b3870 0x7f126c154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.657+0000 7f1273a1f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c1620f0 0x7f126c1f93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.657+0000 7f1273a1f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c0c9410 0x7f126c15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.657+0000 7f1273a1f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f126c0d3a60 con 0x7f126c0c9410 2024-09-17T03:36:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.657+0000 7f1273a1f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f126c0d38e0 con 0x7f126c0b3870 2024-09-17T03:36:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.657+0000 7f1273a1f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f126c0d3be0 con 0x7f126c1620f0 2024-09-17T03:36:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.657+0000 7f1271fbc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c0c9410 0x7f126c15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.657+0000 7f1271fbc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c0c9410 0x7f126c15fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40344/0 (socket says 172.21.15.146:40344) 2024-09-17T03:36:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f1271fbc640 1 -- 172.21.15.146:0/1085445100 learned_addr learned my addr 172.21.15.146:0/1085445100 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f12717bb640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c0b3870 0x7f126c154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f1270fba640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c1620f0 0x7f126c1f93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f1271fbc640 1 -- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c1620f0 msgr2=0x7f126c1f93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f1271fbc640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c1620f0 0x7f126c1f93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f1271fbc640 1 -- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c0b3870 msgr2=0x7f126c154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f1271fbc640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c0b3870 0x7f126c154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f1271fbc640 1 -- 172.21.15.146:0/1085445100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c0ce530 con 0x7f126c0c9410 2024-09-17T03:36:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f1271fbc640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c0c9410 0x7f126c15fa30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f126400cad0 tx=0x7f126400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f125dffb640 1 -- 172.21.15.146:0/1085445100 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126400ae20 con 0x7f126c0c9410 2024-09-17T03:36:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f125dffb640 1 -- 172.21.15.146:0/1085445100 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f126400f540 con 0x7f126c0c9410 2024-09-17T03:36:06.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f1273a1f640 1 -- 172.21.15.146:0/1085445100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126c0ce810 con 0x7f126c0c9410 2024-09-17T03:36:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f125dffb640 1 -- 172.21.15.146:0/1085445100 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126400f990 con 0x7f126c0c9410 2024-09-17T03:36:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.658+0000 7f1273a1f640 1 -- 172.21.15.146:0/1085445100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f126c1f8eb0 con 0x7f126c0c9410 2024-09-17T03:36:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.660+0000 7f1273a1f640 1 -- 172.21.15.146:0/1085445100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f126c0d3190 con 0x7f126c0c9410 2024-09-17T03:36:06.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.660+0000 7f125dffb640 1 -- 172.21.15.146:0/1085445100 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f126400fb30 con 0x7f126c0c9410 2024-09-17T03:36:06.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.660+0000 7f125dffb640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1250078b90 0x7f125007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:06.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.660+0000 7f125dffb640 1 -- 172.21.15.146:0/1085445100 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f126409b910 con 0x7f126c0c9410 2024-09-17T03:36:06.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.660+0000 7f12717bb640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1250078b90 0x7f125007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:06.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.661+0000 7f12717bb640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1250078b90 0x7f125007b0a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1268034000 tx=0x7f1268004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:06.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.665+0000 7f125dffb640 1 -- 172.21.15.146:0/1085445100 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1264014030 con 0x7f126c0c9410 2024-09-17T03:36:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:06.875+0000 7f1273a1f640 1 -- 172.21.15.146:0/1085445100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f126c0d2bd0 con 0x7f126c0c9410 2024-09-17T03:36:07.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.520+0000 7f125dffb640 1 -- 172.21.15.146:0/1085445100 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f126400fe20 con 0x7f126c0c9410 2024-09-17T03:36:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 -- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1250078b90 msgr2=0x7f125007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1250078b90 0x7f125007b0a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1268034000 tx=0x7f1268004730 comp rx=0 tx=0).stop 2024-09-17T03:36:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 -- 172.21.15.146:0/1085445100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c0c9410 msgr2=0x7f126c15fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c0c9410 0x7f126c15fa30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f126400cad0 tx=0x7f126400cf90 comp rx=0 tx=0).stop 2024-09-17T03:36:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 -- 172.21.15.146:0/1085445100 shutdown_connections 2024-09-17T03:36:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1250078b90 0x7f125007b0a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c0c9410 0x7f126c15fa30 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c1620f0 0x7f126c1f93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 --2- 172.21.15.146:0/1085445100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c0b3870 0x7f126c154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 -- 172.21.15.146:0/1085445100 >> 172.21.15.146:0/1085445100 conn(0x7f126c0d4be0 msgr2=0x7f126c15dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 -- 172.21.15.146:0/1085445100 shutdown_connections 2024-09-17T03:36:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.523+0000 7f1273a1f640 1 -- 172.21.15.146:0/1085445100 wait complete. 2024-09-17T03:36:07.536 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:36:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.654+0000 7fa3b827e640 1 -- 172.21.15.146:0/844347839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa39c004800 msgr2=0x7fa39c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.654+0000 7fa3b827e640 1 --2- 172.21.15.146:0/844347839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa39c004800 0x7fa39c004c10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00b7fe0 tx=0x7fa39c005830 comp rx=0 tx=0).stop 2024-09-17T03:36:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.654+0000 7fa3b681b640 1 -- 172.21.15.146:0/844347839 reap_dead start 2024-09-17T03:36:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.655+0000 7fa3b827e640 1 -- 172.21.15.146:0/844347839 shutdown_connections 2024-09-17T03:36:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.655+0000 7fa3b827e640 1 -- 172.21.15.146:0/844347839 >> 172.21.15.146:0/844347839 conn(0x7fa3b00b7b20 msgr2=0x7fa3b009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.655+0000 7fa3b827e640 1 -- 172.21.15.146:0/844347839 shutdown_connections 2024-09-17T03:36:07.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.655+0000 7fa3b827e640 1 -- 172.21.15.146:0/844347839 wait complete. 2024-09-17T03:36:07.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.656+0000 7fa3b827e640 1 Processor -- start 2024-09-17T03:36:07.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.656+0000 7fa3b827e640 1 -- start start 2024-09-17T03:36:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b827e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa39c004800 0x7fa3b015be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b827e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3b015b770 0x7fa3b014de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b827e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b006f3d0 0x7fa3b006f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b827e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b01657b0 con 0x7fa3b006f3d0 2024-09-17T03:36:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b827e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b015dcc0 con 0x7fa3b015b770 2024-09-17T03:36:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b827e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b0165930 con 0x7fa39c004800 2024-09-17T03:36:07.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b681b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b006f3d0 0x7fa3b006f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b681b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b006f3d0 0x7fa3b006f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37302/0 (socket says 172.21.15.146:37302) 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b681b640 1 -- 172.21.15.146:0/283096638 learned_addr learned my addr 172.21.15.146:0/283096638 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b601a640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa39c004800 0x7fa3b015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b5819640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3b015b770 0x7fa3b014de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b681b640 1 -- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa39c004800 msgr2=0x7fa3b015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b681b640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa39c004800 0x7fa3b015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b681b640 1 -- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3b015b770 msgr2=0x7fa3b014de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b681b640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3b015b770 0x7fa3b014de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b681b640 1 -- 172.21.15.146:0/283096638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b006fd20 con 0x7fa3b006f3d0 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b681b640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b006f3d0 0x7fa3b006f7e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8005fd0 tx=0x7fa3a8010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3a6ffd640 1 -- 172.21.15.146:0/283096638 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a800eca0 con 0x7fa3b006f3d0 2024-09-17T03:36:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3a6ffd640 1 -- 172.21.15.146:0/283096638 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3a800ee40 con 0x7fa3b006f3d0 2024-09-17T03:36:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b827e640 1 -- 172.21.15.146:0/283096638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b006dd60 con 0x7fa3b006f3d0 2024-09-17T03:36:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3a6ffd640 1 -- 172.21.15.146:0/283096638 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8004d80 con 0x7fa3b006f3d0 2024-09-17T03:36:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.658+0000 7fa3b827e640 1 -- 172.21.15.146:0/283096638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b01f8f80 con 0x7fa3b006f3d0 2024-09-17T03:36:07.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.660+0000 7fa3b827e640 1 -- 172.21.15.146:0/283096638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b006df30 con 0x7fa3b006f3d0 2024-09-17T03:36:07.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.660+0000 7fa3a6ffd640 1 -- 172.21.15.146:0/283096638 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3a801c020 con 0x7fa3b006f3d0 2024-09-17T03:36:07.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.661+0000 7fa3a6ffd640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa394078bc0 0x7fa39407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:07.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.661+0000 7fa3a6ffd640 1 -- 172.21.15.146:0/283096638 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7fa3a809af80 con 0x7fa3b006f3d0 2024-09-17T03:36:07.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.661+0000 7fa3b601a640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa394078bc0 0x7fa39407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:07.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.662+0000 7fa3b601a640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa394078bc0 0x7fa39407b0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac006b70 tx=0x7fa3ac006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.666+0000 7fa3a6ffd640 1 -- 172.21.15.146:0/283096638 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa3b006fd20 con 0x7fa3b006f3d0 2024-09-17T03:36:07.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:07.843+0000 7fa3b827e640 1 -- 172.21.15.146:0/283096638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa3b00b3620 con 0x7fa3b006f3d0 2024-09-17T03:36:08.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.522+0000 7fa3a6ffd640 1 -- 172.21.15.146:0/283096638 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) ==== 181+0+0 (secure 0 0 0) 0x7fa3a8062d70 con 0x7fa3b006f3d0 2024-09-17T03:36:08.523 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:36:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.525+0000 7fa3b827e640 1 -- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa394078bc0 msgr2=0x7fa39407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.525+0000 7fa3b827e640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa394078bc0 0x7fa39407b0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac006b70 tx=0x7fa3ac006720 comp rx=0 tx=0).stop 2024-09-17T03:36:08.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.525+0000 7fa3b827e640 1 -- 172.21.15.146:0/283096638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b006f3d0 msgr2=0x7fa3b006f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:08.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.525+0000 7fa3b827e640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b006f3d0 0x7fa3b006f7e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8005fd0 tx=0x7fa3a8010f00 comp rx=0 tx=0).stop 2024-09-17T03:36:08.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.526+0000 7fa3b827e640 1 -- 172.21.15.146:0/283096638 shutdown_connections 2024-09-17T03:36:08.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.526+0000 7fa3b827e640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa394078bc0 0x7fa39407b0d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.526+0000 7fa3b827e640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3b006f3d0 0x7fa3b006f7e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.526+0000 7fa3b827e640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3b015b770 0x7fa3b014de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.526+0000 7fa3b827e640 1 --2- 172.21.15.146:0/283096638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa39c004800 0x7fa3b015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.526+0000 7fa3b827e640 1 -- 172.21.15.146:0/283096638 >> 172.21.15.146:0/283096638 conn(0x7fa3b00b7b20 msgr2=0x7fa3b00b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:08.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.526+0000 7fa3b827e640 1 -- 172.21.15.146:0/283096638 shutdown_connections 2024-09-17T03:36:08.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.526+0000 7fa3b827e640 1 -- 172.21.15.146:0/283096638 wait complete. 2024-09-17T03:36:08.540 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:36:08.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.660+0000 7f88ef0f2640 1 -- 172.21.15.146:0/2847630638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88e80b5ce0 msgr2=0x7f88e80b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.660+0000 7f88ef0f2640 1 --2- 172.21.15.146:0/2847630638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88e80b5ce0 0x7f88e80b1320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009830 tx=0x7f88e402a510 comp rx=0 tx=0).stop 2024-09-17T03:36:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.660+0000 7f88ef0f2640 1 -- 172.21.15.146:0/2847630638 shutdown_connections 2024-09-17T03:36:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.660+0000 7f88ef0f2640 1 --2- 172.21.15.146:0/2847630638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88e80b3d30 0x7f88e815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.660+0000 7f88ef0f2640 1 --2- 172.21.15.146:0/2847630638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88e80b5ce0 0x7f88e80b1320 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.660+0000 7f88ef0f2640 1 -- 172.21.15.146:0/2847630638 >> 172.21.15.146:0/2847630638 conn(0x7f88e80b7b20 msgr2=0x7f88e809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.660+0000 7f88ef0f2640 1 -- 172.21.15.146:0/2847630638 shutdown_connections 2024-09-17T03:36:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.660+0000 7f88ef0f2640 1 -- 172.21.15.146:0/2847630638 wait complete. 2024-09-17T03:36:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.662+0000 7f88ef0f2640 1 Processor -- start 2024-09-17T03:36:08.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.662+0000 7f88ef0f2640 1 -- start start 2024-09-17T03:36:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.663+0000 7f88ef0f2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88e80b5750 0x7f88e806e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.663+0000 7f88ef0f2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88e80b5ce0 0x7f88e8153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.663+0000 7f88ef0f2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88e8154600 0x7f88e815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.663+0000 7f88ef0f2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f88e815d4b0 con 0x7f88e8154600 2024-09-17T03:36:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.663+0000 7f88ef0f2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f88e815d330 con 0x7f88e80b5ce0 2024-09-17T03:36:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.663+0000 7f88ef0f2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f88e815d630 con 0x7f88e80b5750 2024-09-17T03:36:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ed68f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88e8154600 0x7f88e815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ed68f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88e8154600 0x7f88e815b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37314/0 (socket says 172.21.15.146:37314) 2024-09-17T03:36:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ed68f640 1 -- 172.21.15.146:0/399441295 learned_addr learned my addr 172.21.15.146:0/399441295 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88dffff640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88e80b5ce0 0x7f88e8153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:08.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ece8e640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88e80b5750 0x7f88e806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ed68f640 1 -- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88e80b5750 msgr2=0x7f88e806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ed68f640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88e80b5750 0x7f88e806e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ed68f640 1 -- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88e80b5ce0 msgr2=0x7f88e8153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ed68f640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88e80b5ce0 0x7f88e8153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ed68f640 1 -- 172.21.15.146:0/399441295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e806f8b0 con 0x7f88e8154600 2024-09-17T03:36:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ed68f640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88e8154600 0x7f88e815b9d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f88e000eab0 tx=0x7f88e000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88dd7fa640 1 -- 172.21.15.146:0/399441295 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e000cea0 con 0x7f88e8154600 2024-09-17T03:36:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88dd7fa640 1 -- 172.21.15.146:0/399441295 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88e0004b20 con 0x7f88e8154600 2024-09-17T03:36:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ef0f2640 1 -- 172.21.15.146:0/399441295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e806fb50 con 0x7f88e8154600 2024-09-17T03:36:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88dd7fa640 1 -- 172.21.15.146:0/399441295 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e0005020 con 0x7f88e8154600 2024-09-17T03:36:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.664+0000 7f88ef0f2640 1 -- 172.21.15.146:0/399441295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e806e1e0 con 0x7f88e8154600 2024-09-17T03:36:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.665+0000 7f88ef0f2640 1 -- 172.21.15.146:0/399441295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e806fd90 con 0x7f88e8154600 2024-09-17T03:36:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.666+0000 7f88dd7fa640 1 -- 172.21.15.146:0/399441295 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f88e00051c0 con 0x7f88e8154600 2024-09-17T03:36:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.667+0000 7f88dd7fa640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f88d4078b90 0x7f88d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.667+0000 7f88dd7fa640 1 -- 172.21.15.146:0/399441295 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5415+0+0 (secure 0 0 0) 0x7f88e009b800 con 0x7f88e8154600 2024-09-17T03:36:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.667+0000 7f88ece8e640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f88d4078b90 0x7f88d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.667+0000 7f88ece8e640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f88d4078b90 0x7f88d407b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f88e4034000 tx=0x7f88e4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:08.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.671+0000 7f88dd7fa640 1 -- 172.21.15.146:0/399441295 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88e806fd90 con 0x7f88e8154600 2024-09-17T03:36:08.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:08.846+0000 7f88ef0f2640 1 -- 172.21.15.146:0/399441295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f88e815db50 con 0x7f88e8154600 2024-09-17T03:36:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.531+0000 7f88dd7fa640 1 -- 172.21.15.146:0/399441295 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) ==== 169+0+0 (secure 0 0 0) 0x7f88e0063d70 con 0x7f88e8154600 2024-09-17T03:36:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:36:09.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.534+0000 7f88ef0f2640 1 -- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f88d4078b90 msgr2=0x7f88d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:09.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.534+0000 7f88ef0f2640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f88d4078b90 0x7f88d407b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f88e4034000 tx=0x7f88e4004730 comp rx=0 tx=0).stop 2024-09-17T03:36:09.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.534+0000 7f88ef0f2640 1 -- 172.21.15.146:0/399441295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88e8154600 msgr2=0x7f88e815b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:09.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.534+0000 7f88ef0f2640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88e8154600 0x7f88e815b9d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f88e000eab0 tx=0x7f88e000ef70 comp rx=0 tx=0).stop 2024-09-17T03:36:09.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.536+0000 7f88ef0f2640 1 -- 172.21.15.146:0/399441295 shutdown_connections 2024-09-17T03:36:09.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.536+0000 7f88ef0f2640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f88d4078b90 0x7f88d407b0a0 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f88e4034000 tx=0x7f88e4004730 comp rx=0 tx=0).stop 2024-09-17T03:36:09.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.536+0000 7f88ef0f2640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88e8154600 0x7f88e815b9d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:09.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.536+0000 7f88ef0f2640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88e80b5ce0 0x7f88e8153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:09.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.536+0000 7f88ef0f2640 1 --2- 172.21.15.146:0/399441295 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88e80b5750 0x7f88e806e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:09.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.536+0000 7f88ef0f2640 1 -- 172.21.15.146:0/399441295 >> 172.21.15.146:0/399441295 conn(0x7f88e80b7b20 msgr2=0x7f88e80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:09.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.538+0000 7f88ef0f2640 1 -- 172.21.15.146:0/399441295 shutdown_connections 2024-09-17T03:36:09.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.538+0000 7f88ef0f2640 1 -- 172.21.15.146:0/399441295 wait complete. 2024-09-17T03:36:09.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:36:09.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.673+0000 7fab2004a640 1 -- 172.21.15.146:0/2204289574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab00005250 msgr2=0x7fab0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:09.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.673+0000 7fab2004a640 1 --2- 172.21.15.146:0/2204289574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab00005250 0x7fab0000b9c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fab10001690 tx=0x7fab00005830 comp rx=0 tx=0).stop 2024-09-17T03:36:09.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.673+0000 7fab2004a640 1 -- 172.21.15.146:0/2204289574 shutdown_connections 2024-09-17T03:36:09.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.673+0000 7fab2004a640 1 --2- 172.21.15.146:0/2204289574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab00005250 0x7fab0000b9c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.673+0000 7fab2004a640 1 -- 172.21.15.146:0/2204289574 >> 172.21.15.146:0/2204289574 conn(0x7fab180b3410 msgr2=0x7fab180b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.673+0000 7fab2004a640 1 -- 172.21.15.146:0/2204289574 shutdown_connections 2024-09-17T03:36:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.673+0000 7fab2004a640 1 -- 172.21.15.146:0/2204289574 wait complete. 2024-09-17T03:36:09.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.675+0000 7fab2004a640 1 Processor -- start 2024-09-17T03:36:09.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.675+0000 7fab2004a640 1 -- start start 2024-09-17T03:36:09.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab2004a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab00005250 0x7fab181e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab2004a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab181e49b0 0x7fab18142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab2004a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18153e40 0x7fab18154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab2004a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab1806e2f0 con 0x7fab18153e40 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab2004a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab1806e170 con 0x7fab00005250 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab2004a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fab1806e470 con 0x7fab181e49b0 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab1e5e7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18153e40 0x7fab18154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab1e5e7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18153e40 0x7fab18154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37336/0 (socket says 172.21.15.146:37336) 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab1e5e7640 1 -- 172.21.15.146:0/705993570 learned_addr learned my addr 172.21.15.146:0/705993570 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab1dde6640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab00005250 0x7fab181e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab1d5e5640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab181e49b0 0x7fab18142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab1e5e7640 1 -- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab181e49b0 msgr2=0x7fab18142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.676+0000 7fab1e5e7640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab181e49b0 0x7fab18142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.677+0000 7fab1e5e7640 1 -- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab00005250 msgr2=0x7fab181e6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.677+0000 7fab1e5e7640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab00005250 0x7fab181e6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.677+0000 7fab1e5e7640 1 -- 172.21.15.146:0/705993570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab18143400 con 0x7fab18153e40 2024-09-17T03:36:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.677+0000 7fab1dde6640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab00005250 0x7fab181e6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.677+0000 7fab1e5e7640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18153e40 0x7fab18154250 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fab10001690 tx=0x7fab100063b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.677+0000 7fab167fc640 1 -- 172.21.15.146:0/705993570 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10037070 con 0x7fab18153e40 2024-09-17T03:36:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.677+0000 7fab167fc640 1 -- 172.21.15.146:0/705993570 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab10003b10 con 0x7fab18153e40 2024-09-17T03:36:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.677+0000 7fab2004a640 1 -- 172.21.15.146:0/705993570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab18154790 con 0x7fab18153e40 2024-09-17T03:36:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.677+0000 7fab167fc640 1 -- 172.21.15.146:0/705993570 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10032410 con 0x7fab18153e40 2024-09-17T03:36:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.677+0000 7fab2004a640 1 -- 172.21.15.146:0/705993570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab181e7810 con 0x7fab18153e40 2024-09-17T03:36:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.678+0000 7fab2004a640 1 -- 172.21.15.146:0/705993570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab180b4530 con 0x7fab18153e40 2024-09-17T03:36:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.679+0000 7fab167fc640 1 -- 172.21.15.146:0/705993570 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab10030020 con 0x7fab18153e40 2024-09-17T03:36:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.679+0000 7fab167fc640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab04078b90 0x7fab0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.679+0000 7fab167fc640 1 -- 172.21.15.146:0/705993570 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fab100b9f60 con 0x7fab18153e40 2024-09-17T03:36:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.679+0000 7fab1dde6640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab04078b90 0x7fab0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:09.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.680+0000 7fab1dde6640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab04078b90 0x7fab0407b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fab08005fd0 tx=0x7fab08009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:09.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.684+0000 7fab167fc640 1 -- 172.21.15.146:0/705993570 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fab18154790 con 0x7fab18153e40 2024-09-17T03:36:09.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.859+0000 7fab2004a640 1 -- 172.21.15.146:0/705993570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fab180699c0 con 0x7fab18153e40 2024-09-17T03:36:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.863+0000 7fab167fc640 1 -- 172.21.15.146:0/705993570 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7fab18143400 con 0x7fab18153e40 2024-09-17T03:36:09.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 -- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab04078b90 msgr2=0x7fab0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:09.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab04078b90 0x7fab0407b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fab08005fd0 tx=0x7fab08009500 comp rx=0 tx=0).stop 2024-09-17T03:36:09.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 -- 172.21.15.146:0/705993570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18153e40 msgr2=0x7fab18154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18153e40 0x7fab18154250 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fab10001690 tx=0x7fab100063b0 comp rx=0 tx=0).stop 2024-09-17T03:36:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 -- 172.21.15.146:0/705993570 shutdown_connections 2024-09-17T03:36:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab04078b90 0x7fab0407b0a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab18153e40 0x7fab18154250 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab181e49b0 0x7fab18142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 --2- 172.21.15.146:0/705993570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab00005250 0x7fab181e6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 -- 172.21.15.146:0/705993570 >> 172.21.15.146:0/705993570 conn(0x7fab180b3410 msgr2=0x7fab18154d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 -- 172.21.15.146:0/705993570 shutdown_connections 2024-09-17T03:36:09.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:09.865+0000 7fab2004a640 1 -- 172.21.15.146:0/705993570 wait complete. 2024-09-17T03:36:09.876 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-17T03:36:10.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.000+0000 7f1af1320640 1 -- 172.21.15.146:0/3159246791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec1631a0 msgr2=0x7f1aec0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.000+0000 7f1af1320640 1 --2- 172.21.15.146:0/3159246791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec1631a0 0x7f1aec0cef40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1aec08da50 tx=0x7f1ad402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.000+0000 7f1af1320640 1 -- 172.21.15.146:0/3159246791 shutdown_connections 2024-09-17T03:36:10.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.000+0000 7f1af1320640 1 --2- 172.21.15.146:0/3159246791 >> v2:172.21.15.179:3300/0 conn(0x7f1aec0b61f0 0x7f1aec0b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.000+0000 7f1af1320640 1 --2- 172.21.15.146:0/3159246791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec1631a0 0x7f1aec0cef40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.000+0000 7f1af1320640 1 --2- 172.21.15.146:0/3159246791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1aec15f1a0 0x7f1aec0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.000+0000 7f1af1320640 1 -- 172.21.15.146:0/3159246791 >> 172.21.15.146:0/3159246791 conn(0x7f1aec0d11f0 msgr2=0x7f1aec0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:10.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.000+0000 7f1af1320640 1 -- 172.21.15.146:0/3159246791 shutdown_connections 2024-09-17T03:36:10.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.000+0000 7f1af1320640 1 -- 172.21.15.146:0/3159246791 wait complete. 2024-09-17T03:36:10.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.002+0000 7f1af1320640 1 Processor -- start 2024-09-17T03:36:10.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.002+0000 7f1af1320640 1 -- start start 2024-09-17T03:36:10.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1af1320640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aec0b61f0 0x7f1aec1f9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1af1320640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec15f1a0 0x7f1aec15e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1af1320640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1aec1631a0 0x7f1aec156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1af1320640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec0693a0 con 0x7f1aec15f1a0 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1af1320640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1aec069220 con 0x7f1aec0b61f0 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1af1320640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1aec069520 con 0x7f1aec1631a0 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1aea7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec15f1a0 0x7f1aec15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1aea7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec15f1a0 0x7f1aec15e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37362/0 (socket says 172.21.15.146:37362) 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1aea7fc640 1 -- 172.21.15.146:0/301429037 learned_addr learned my addr 172.21.15.146:0/301429037 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1aeaffd640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aec0b61f0 0x7f1aec1f9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1aeb7fe640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1aec1631a0 0x7f1aec156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1aea7fc640 1 -- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1aec1631a0 msgr2=0x7f1aec156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1aea7fc640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1aec1631a0 0x7f1aec156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1aea7fc640 1 -- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aec0b61f0 msgr2=0x7f1aec1f9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.003+0000 7f1aea7fc640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aec0b61f0 0x7f1aec1f9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.004+0000 7f1aea7fc640 1 -- 172.21.15.146:0/301429037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aec0cac60 con 0x7f1aec15f1a0 2024-09-17T03:36:10.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.004+0000 7f1aea7fc640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec15f1a0 0x7f1aec15e170 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4034040 tx=0x7f1ad40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:10.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.004+0000 7f1ae37fe640 1 -- 172.21.15.146:0/301429037 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad403e030 con 0x7f1aec15f1a0 2024-09-17T03:36:10.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.004+0000 7f1ae37fe640 1 -- 172.21.15.146:0/301429037 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ad40047a0 con 0x7f1aec15f1a0 2024-09-17T03:36:10.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.004+0000 7f1af1320640 1 -- 172.21.15.146:0/301429037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aec0caf40 con 0x7f1aec15f1a0 2024-09-17T03:36:10.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.004+0000 7f1ae37fe640 1 -- 172.21.15.146:0/301429037 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4035040 con 0x7f1aec15f1a0 2024-09-17T03:36:10.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.004+0000 7f1af1320640 1 -- 172.21.15.146:0/301429037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aec0cbb30 con 0x7f1aec15f1a0 2024-09-17T03:36:10.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.005+0000 7f1af1320640 1 -- 172.21.15.146:0/301429037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aec0ca9d0 con 0x7f1aec15f1a0 2024-09-17T03:36:10.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.006+0000 7f1ae37fe640 1 -- 172.21.15.146:0/301429037 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ad4041030 con 0x7f1aec15f1a0 2024-09-17T03:36:10.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.006+0000 7f1ae37fe640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 0x7f1acc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.006+0000 7f1ae37fe640 1 -- 172.21.15.146:0/301429037 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f1ad40bb130 con 0x7f1aec15f1a0 2024-09-17T03:36:10.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.006+0000 7f1aeaffd640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 0x7f1acc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.007+0000 7f1aeaffd640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 0x7f1acc07b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1adc005fd0 tx=0x7f1adc00a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:10.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.010+0000 7f1ae37fe640 1 -- 172.21.15.146:0/301429037 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ad40832b0 con 0x7f1aec15f1a0 2024-09-17T03:36:10.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.259+0000 7f1af1320640 1 -- 172.21.15.146:0/301429037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f1aec0cbf60 con 0x7f1aec15f1a0 2024-09-17T03:36:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.538+0000 7f1ae37fe640 1 -- 172.21.15.146:0/301429037 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v158) ==== 143+0+0 (secure 0 0 0) 0x7f1ad4087ce0 con 0x7f1aec15f1a0 2024-09-17T03:36:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 -- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 msgr2=0x7f1acc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 0x7f1acc07b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1adc005fd0 tx=0x7f1adc00a250 comp rx=0 tx=0).stop 2024-09-17T03:36:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 -- 172.21.15.146:0/301429037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec15f1a0 msgr2=0x7f1aec15e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec15f1a0 0x7f1aec15e170 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4034040 tx=0x7f1ad40039e0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 -- 172.21.15.146:0/301429037 shutdown_connections 2024-09-17T03:36:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 0x7f1acc07b0a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1aec1631a0 0x7f1aec156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1aec15f1a0 0x7f1aec15e170 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 --2- 172.21.15.146:0/301429037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aec0b61f0 0x7f1aec1f9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 -- 172.21.15.146:0/301429037 >> 172.21.15.146:0/301429037 conn(0x7f1aec0d11f0 msgr2=0x7f1aec15d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 -- 172.21.15.146:0/301429037 shutdown_connections 2024-09-17T03:36:10.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.540+0000 7f1af1320640 1 -- 172.21.15.146:0/301429037 wait complete. 2024-09-17T03:36:10.551 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-17T03:36:10.552 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is merged during scrub. 2024-09-17T03:36:10.552 INFO:tasks.cephfs_test_runner:test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T03:36:10.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.666+0000 7fbed641d640 1 -- 172.21.15.146:0/2458384332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbeb80039e0 msgr2=0x7fbeb8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.666+0000 7fbed641d640 1 --2- 172.21.15.146:0/2458384332 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbeb80039e0 0x7fbeb8003e10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbec000c290 tx=0x7fbeb8005830 comp rx=0 tx=0).stop 2024-09-17T03:36:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.666+0000 7fbed49ba640 1 -- 172.21.15.146:0/2458384332 reap_dead start 2024-09-17T03:36:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.666+0000 7fbed641d640 1 -- 172.21.15.146:0/2458384332 shutdown_connections 2024-09-17T03:36:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.666+0000 7fbed641d640 1 -- 172.21.15.146:0/2458384332 >> 172.21.15.146:0/2458384332 conn(0x7fbed00b2060 msgr2=0x7fbed00b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.666+0000 7fbed641d640 1 -- 172.21.15.146:0/2458384332 shutdown_connections 2024-09-17T03:36:10.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.666+0000 7fbed641d640 1 -- 172.21.15.146:0/2458384332 wait complete. 2024-09-17T03:36:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.667+0000 7fbed641d640 1 Processor -- start 2024-09-17T03:36:10.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.668+0000 7fbed641d640 1 -- start start 2024-09-17T03:36:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed641d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb80039e0 0x7fbed014e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed641d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbed0150070 0x7fbed015ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed641d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbed014ebd0 0x7fbed015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed641d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0073fa0 con 0x7fbed014ebd0 2024-09-17T03:36:10.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed641d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0160e10 con 0x7fbed0150070 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed641d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbed0074120 con 0x7fbeb80039e0 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed49ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbed014ebd0 0x7fbed015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed49ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbed014ebd0 0x7fbed015f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37368/0 (socket says 172.21.15.146:37368) 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed49ba640 1 -- 172.21.15.146:0/2133021578 learned_addr learned my addr 172.21.15.146:0/2133021578 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbecffff640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb80039e0 0x7fbed014e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbecf7fe640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbed0150070 0x7fbed015ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed49ba640 1 -- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb80039e0 msgr2=0x7fbed014e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed49ba640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb80039e0 0x7fbed014e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed49ba640 1 -- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbed0150070 msgr2=0x7fbed015ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed49ba640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbed0150070 0x7fbed015ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed49ba640 1 -- 172.21.15.146:0/2133021578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed0150610 con 0x7fbed014ebd0 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbecffff640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb80039e0 0x7fbed014e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbecf7fe640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbed0150070 0x7fbed015ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:10.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.669+0000 7fbed49ba640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbed014ebd0 0x7fbed015f4a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbec8000f80 tx=0x7fbec8001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.670+0000 7fbeccff9640 1 -- 172.21.15.146:0/2133021578 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8011870 con 0x7fbed014ebd0 2024-09-17T03:36:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.670+0000 7fbeccff9640 1 -- 172.21.15.146:0/2133021578 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbec8017070 con 0x7fbed014ebd0 2024-09-17T03:36:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.670+0000 7fbed641d640 1 -- 172.21.15.146:0/2133021578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed01508f0 con 0x7fbed014ebd0 2024-09-17T03:36:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.670+0000 7fbeccff9640 1 -- 172.21.15.146:0/2133021578 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8011da0 con 0x7fbed014ebd0 2024-09-17T03:36:10.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.670+0000 7fbed641d640 1 -- 172.21.15.146:0/2133021578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed0150eb0 con 0x7fbed014ebd0 2024-09-17T03:36:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.671+0000 7fbed641d640 1 -- 172.21.15.146:0/2133021578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed00cd290 con 0x7fbed014ebd0 2024-09-17T03:36:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.671+0000 7fbeccff9640 1 -- 172.21.15.146:0/2133021578 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbec801c460 con 0x7fbed014ebd0 2024-09-17T03:36:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.672+0000 7fbeccff9640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbebc078bc0 0x7fbebc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.672+0000 7fbeccff9640 1 -- 172.21.15.146:0/2133021578 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fbec809b220 con 0x7fbed014ebd0 2024-09-17T03:36:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.672+0000 7fbecffff640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbebc078bc0 0x7fbebc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.673+0000 7fbecffff640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbebc078bc0 0x7fbebc07b0d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbec0033000 tx=0x7fbed0070640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:10.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.677+0000 7fbeccff9640 1 -- 172.21.15.146:0/2133021578 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbed00cd290 con 0x7fbed014ebd0 2024-09-17T03:36:10.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.851+0000 7fbed641d640 1 -- 172.21.15.146:0/2133021578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbed00cfa50 con 0x7fbed014ebd0 2024-09-17T03:36:10.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.852+0000 7fbeccff9640 1 -- 172.21.15.146:0/2133021578 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+13080 (secure 0 0 0) 0x7fbec8063960 con 0x7fbed014ebd0 2024-09-17T03:36:10.852 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:10.852 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":50,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:36:09.531714+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/924109004":"2024-09-18T03:36:06.518991+0000","172.21.15.146:6834/924109004":"2024-09-18T03:36:06.518991+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.854+0000 7fbed641d640 1 -- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbebc078bc0 msgr2=0x7fbebc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.854+0000 7fbed641d640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbebc078bc0 0x7fbebc07b0d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbec0033000 tx=0x7fbed0070640 comp rx=0 tx=0).stop 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.854+0000 7fbed641d640 1 -- 172.21.15.146:0/2133021578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbed014ebd0 msgr2=0x7fbed015f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.854+0000 7fbed641d640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbed014ebd0 0x7fbed015f4a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbec8000f80 tx=0x7fbec8001a30 comp rx=0 tx=0).stop 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.854+0000 7fbed641d640 1 -- 172.21.15.146:0/2133021578 shutdown_connections 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.854+0000 7fbed641d640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbebc078bc0 0x7fbebc07b0d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.854+0000 7fbed641d640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbed014ebd0 0x7fbed015f4a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.854+0000 7fbed641d640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbed0150070 0x7fbed015ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.854+0000 7fbed641d640 1 --2- 172.21.15.146:0/2133021578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbeb80039e0 0x7fbed014e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.854+0000 7fbed641d640 1 -- 172.21.15.146:0/2133021578 >> 172.21.15.146:0/2133021578 conn(0x7fbed00b2060 msgr2=0x7fbed01e82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.855+0000 7fbed641d640 1 -- 172.21.15.146:0/2133021578 shutdown_connections 2024-09-17T03:36:10.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.855+0000 7fbed641d640 1 -- 172.21.15.146:0/2133021578 wait complete. 2024-09-17T03:36:10.866 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:36:10.866 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:36:10.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.981+0000 7f26e903f640 1 -- 172.21.15.146:0/3817517533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26e40cdc50 msgr2=0x7f26e40b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.981+0000 7f26e903f640 1 --2- 172.21.15.146:0/3817517533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26e40cdc50 0x7f26e40b4ba0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f26e4073030 tx=0x7f26dc02a980 comp rx=0 tx=0).stop 2024-09-17T03:36:10.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.982+0000 7f26e903f640 1 -- 172.21.15.146:0/3817517533 shutdown_connections 2024-09-17T03:36:10.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.982+0000 7f26e903f640 1 --2- 172.21.15.146:0/3817517533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26e40cdc50 0x7f26e40b4ba0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.982+0000 7f26e903f640 1 --2- 172.21.15.146:0/3817517533 >> v2:172.21.15.179:3300/0 conn(0x7f26e415c8e0 0x7f26e406f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.982+0000 7f26e903f640 1 -- 172.21.15.146:0/3817517533 >> 172.21.15.146:0/3817517533 conn(0x7f26e40b3150 msgr2=0x7f26e40b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.982+0000 7f26e903f640 1 -- 172.21.15.146:0/3817517533 shutdown_connections 2024-09-17T03:36:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.982+0000 7f26e903f640 1 -- 172.21.15.146:0/3817517533 wait complete. 2024-09-17T03:36:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.983+0000 7f26e903f640 1 Processor -- start 2024-09-17T03:36:10.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.984+0000 7f26e903f640 1 -- start start 2024-09-17T03:36:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26e903f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40cd840 0x7f26e40ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26e903f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26e40cdc50 0x7f26e41f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26e903f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26e415c8e0 0x7f26e41f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26e903f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f26e4073580 con 0x7f26e40cdc50 2024-09-17T03:36:10.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26e903f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f26e40b5370 con 0x7f26e415c8e0 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26e903f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f26e4073700 con 0x7f26e40cd840 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26da59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26e40cdc50 0x7f26e41f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26da59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26e40cdc50 0x7f26e41f7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37382/0 (socket says 172.21.15.146:37382) 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26da59c640 1 -- 172.21.15.146:0/517194438 learned_addr learned my addr 172.21.15.146:0/517194438 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26e2d9d640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40cd840 0x7f26e40ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26e359e640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26e415c8e0 0x7f26e41f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26da59c640 1 -- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40cd840 msgr2=0x7f26e40ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26da59c640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40cd840 0x7f26e40ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26da59c640 1 -- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26e415c8e0 msgr2=0x7f26e41f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26da59c640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26e415c8e0 0x7f26e41f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.985+0000 7f26da59c640 1 -- 172.21.15.146:0/517194438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e414fc00 con 0x7f26e40cdc50 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.986+0000 7f26da59c640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26e40cdc50 0x7f26e41f7450 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009fd0 tx=0x7f26cc00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:10.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.986+0000 7f26dbfff640 1 -- 172.21.15.146:0/517194438 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc015020 con 0x7f26e40cdc50 2024-09-17T03:36:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.986+0000 7f26dbfff640 1 -- 172.21.15.146:0/517194438 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26cc011920 con 0x7f26e40cdc50 2024-09-17T03:36:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.986+0000 7f26e903f640 1 -- 172.21.15.146:0/517194438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e414fee0 con 0x7f26e40cdc50 2024-09-17T03:36:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.986+0000 7f26dbfff640 1 -- 172.21.15.146:0/517194438 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc011d50 con 0x7f26e40cdc50 2024-09-17T03:36:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.986+0000 7f26e903f640 1 -- 172.21.15.146:0/517194438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e41504a0 con 0x7f26e40cdc50 2024-09-17T03:36:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.987+0000 7f26e903f640 1 -- 172.21.15.146:0/517194438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e4073bb0 con 0x7f26e40cdc50 2024-09-17T03:36:10.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.988+0000 7f26dbfff640 1 -- 172.21.15.146:0/517194438 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f26cc018020 con 0x7f26e40cdc50 2024-09-17T03:36:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.988+0000 7f26dbfff640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f26c4078bc0 0x7f26c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.988+0000 7f26dbfff640 1 -- 172.21.15.146:0/517194438 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f26cc09a860 con 0x7f26e40cdc50 2024-09-17T03:36:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.988+0000 7f26e2d9d640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f26c4078bc0 0x7f26c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.989+0000 7f26e2d9d640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f26c4078bc0 0x7f26c407b0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f26d4005fd0 tx=0x7f26d400a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:10.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:10.993+0000 7f26dbfff640 1 -- 172.21.15.146:0/517194438 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f26cc01f020 con 0x7f26e40cdc50 2024-09-17T03:36:11.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.167+0000 7f26e903f640 1 -- 172.21.15.146:0/517194438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f26e4070af0 con 0x7f26e40cdc50 2024-09-17T03:36:11.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.167+0000 7f26dbfff640 1 -- 172.21.15.146:0/517194438 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7f26cc062950 con 0x7f26e40cdc50 2024-09-17T03:36:11.168 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:36:11.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 -- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f26c4078bc0 msgr2=0x7f26c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:11.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f26c4078bc0 0x7f26c407b0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f26d4005fd0 tx=0x7f26d400a250 comp rx=0 tx=0).stop 2024-09-17T03:36:11.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 -- 172.21.15.146:0/517194438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26e40cdc50 msgr2=0x7f26e41f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:11.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26e40cdc50 0x7f26e41f7450 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009fd0 tx=0x7f26cc00b870 comp rx=0 tx=0).stop 2024-09-17T03:36:11.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 -- 172.21.15.146:0/517194438 shutdown_connections 2024-09-17T03:36:11.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f26c4078bc0 0x7f26c407b0d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:11.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26e415c8e0 0x7f26e41f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:11.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26e40cdc50 0x7f26e41f7450 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:11.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 --2- 172.21.15.146:0/517194438 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f26e40cd840 0x7f26e40ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:11.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 -- 172.21.15.146:0/517194438 >> 172.21.15.146:0/517194438 conn(0x7f26e40b3150 msgr2=0x7f26e415e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:11.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 -- 172.21.15.146:0/517194438 shutdown_connections 2024-09-17T03:36:11.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.170+0000 7f26e903f640 1 -- 172.21.15.146:0/517194438 wait complete. 2024-09-17T03:36:11.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-17T03:36:11.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.294+0000 7fa5f227e640 1 -- 172.21.15.146:0/3791394531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5ec06e470 msgr2=0x7fa5ec0b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:11.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.294+0000 7fa5f227e640 1 --2- 172.21.15.146:0/3791394531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5ec06e470 0x7fa5ec0b4940 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4005fd0 tx=0x7fa5e402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:11.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.294+0000 7fa5f227e640 1 -- 172.21.15.146:0/3791394531 shutdown_connections 2024-09-17T03:36:11.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.294+0000 7fa5f227e640 1 --2- 172.21.15.146:0/3791394531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5ec06e470 0x7fa5ec0b4940 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:11.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.294+0000 7fa5f227e640 1 -- 172.21.15.146:0/3791394531 >> 172.21.15.146:0/3791394531 conn(0x7fa5ec0b3410 msgr2=0x7fa5ec0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:11.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.295+0000 7fa5f227e640 1 -- 172.21.15.146:0/3791394531 shutdown_connections 2024-09-17T03:36:11.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.295+0000 7fa5f227e640 1 -- 172.21.15.146:0/3791394531 wait complete. 2024-09-17T03:36:11.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.296+0000 7fa5f227e640 1 Processor -- start 2024-09-17T03:36:11.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.296+0000 7fa5f227e640 1 -- start start 2024-09-17T03:36:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5f227e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5ec0b4530 0x7fa5ec147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5f227e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5ec0b55f0 0x7fa5ec15ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5f227e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5ec0d0e90 0x7fa5ec0d12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5f227e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec15c0a0 con 0x7fa5ec0b55f0 2024-09-17T03:36:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5f227e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec15bf20 con 0x7fa5ec0b4530 2024-09-17T03:36:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5f227e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa5ec15c220 con 0x7fa5ec0d0e90 2024-09-17T03:36:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5eb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5ec0b55f0 0x7fa5ec15ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5eb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5ec0b55f0 0x7fa5ec15ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37394/0 (socket says 172.21.15.146:37394) 2024-09-17T03:36:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5eb7fe640 1 -- 172.21.15.146:0/305631171 learned_addr learned my addr 172.21.15.146:0/305631171 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5ebfff640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5ec0b4530 0x7fa5ec147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5f081b640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5ec0d0e90 0x7fa5ec0d12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5eb7fe640 1 -- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5ec0d0e90 msgr2=0x7fa5ec0d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5eb7fe640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5ec0d0e90 0x7fa5ec0d12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:11.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5eb7fe640 1 -- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5ec0b4530 msgr2=0x7fa5ec147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:11.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5eb7fe640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5ec0b4530 0x7fa5ec147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:11.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5eb7fe640 1 -- 172.21.15.146:0/305631171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ec0d17e0 con 0x7fa5ec0b55f0 2024-09-17T03:36:11.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5f081b640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5ec0d0e90 0x7fa5ec0d12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:11.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5ebfff640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5ec0b4530 0x7fa5ec147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:11.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5eb7fe640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5ec0b55f0 0x7fa5ec15ab20 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000b3f0 tx=0x7fa5e000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:11.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.298+0000 7fa5e8ff9640 1 -- 172.21.15.146:0/305631171 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0015020 con 0x7fa5ec0b55f0 2024-09-17T03:36:11.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.299+0000 7fa5e8ff9640 1 -- 172.21.15.146:0/305631171 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5e0011920 con 0x7fa5ec0b55f0 2024-09-17T03:36:11.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.299+0000 7fa5f227e640 1 -- 172.21.15.146:0/305631171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5ec1f8cf0 con 0x7fa5ec0b55f0 2024-09-17T03:36:11.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.299+0000 7fa5e8ff9640 1 -- 172.21.15.146:0/305631171 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0011d70 con 0x7fa5ec0b55f0 2024-09-17T03:36:11.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.299+0000 7fa5f227e640 1 -- 172.21.15.146:0/305631171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5ec1f92b0 con 0x7fa5ec0b55f0 2024-09-17T03:36:11.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.300+0000 7fa5f227e640 1 -- 172.21.15.146:0/305631171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5ec15c6d0 con 0x7fa5ec0b55f0 2024-09-17T03:36:11.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.300+0000 7fa5e8ff9640 1 -- 172.21.15.146:0/305631171 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa5e0018020 con 0x7fa5ec0b55f0 2024-09-17T03:36:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.301+0000 7fa5e8ff9640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa5d8078bc0 0x7fa5d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.301+0000 7fa5e8ff9640 1 -- 172.21.15.146:0/305631171 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fa5e009a960 con 0x7fa5ec0b55f0 2024-09-17T03:36:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.301+0000 7fa5ebfff640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa5d8078bc0 0x7fa5d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:11.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.302+0000 7fa5ebfff640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa5d8078bc0 0x7fa5d807b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0b1140 tx=0x7fa5dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:11.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.305+0000 7fa5e8ff9640 1 -- 172.21.15.146:0/305631171 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa5e001f020 con 0x7fa5ec0b55f0 2024-09-17T03:36:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:11.548+0000 7fa5f227e640 1 -- 172.21.15.146:0/305631171 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7fa5ec15fe40 con 0x7fa5ec0b55f0 2024-09-17T03:36:12.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.547+0000 7fa5e8ff9640 1 -- 172.21.15.146:0/305631171 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v160) ==== 154+0+0 (secure 0 0 0) 0x7fa5ec0d17e0 con 0x7fa5ec0b55f0 2024-09-17T03:36:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 -- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa5d8078bc0 msgr2=0x7fa5d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa5d8078bc0 0x7fa5d807b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0b1140 tx=0x7fa5dc009040 comp rx=0 tx=0).stop 2024-09-17T03:36:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 -- 172.21.15.146:0/305631171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5ec0b55f0 msgr2=0x7fa5ec15ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5ec0b55f0 0x7fa5ec15ab20 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000b3f0 tx=0x7fa5e000b8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 -- 172.21.15.146:0/305631171 shutdown_connections 2024-09-17T03:36:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa5d8078bc0 0x7fa5d807b0d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa5ec0d0e90 0x7fa5ec0d12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5ec0b55f0 0x7fa5ec15ab20 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 --2- 172.21.15.146:0/305631171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa5ec0b4530 0x7fa5ec147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 -- 172.21.15.146:0/305631171 >> 172.21.15.146:0/305631171 conn(0x7fa5ec0b3410 msgr2=0x7fa5ec0734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 -- 172.21.15.146:0/305631171 shutdown_connections 2024-09-17T03:36:12.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.550+0000 7fa5f227e640 1 -- 172.21.15.146:0/305631171 wait complete. 2024-09-17T03:36:12.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:36:12.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.681+0000 7f3d18182640 1 -- 172.21.15.146:0/4229317988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d100b47c0 msgr2=0x7f3d10161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.681+0000 7f3d18182640 1 --2- 172.21.15.146:0/4229317988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d100b47c0 0x7f3d10161760 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3d100740d0 tx=0x7f3d0802a4f0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.681+0000 7f3d18182640 1 -- 172.21.15.146:0/4229317988 shutdown_connections 2024-09-17T03:36:12.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.681+0000 7f3d18182640 1 --2- 172.21.15.146:0/4229317988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d100b47c0 0x7f3d10161760 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.681+0000 7f3d18182640 1 --2- 172.21.15.146:0/4229317988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d100cf6b0 0x7f3d10161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.681+0000 7f3d18182640 1 --2- 172.21.15.146:0/4229317988 >> v2:172.21.15.179:3300/0 conn(0x7f3d100d0710 0x7f3d100cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.681+0000 7f3d18182640 1 -- 172.21.15.146:0/4229317988 >> 172.21.15.146:0/4229317988 conn(0x7f3d1009ba20 msgr2=0x7f3d100b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:12.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.681+0000 7f3d18182640 1 -- 172.21.15.146:0/4229317988 shutdown_connections 2024-09-17T03:36:12.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.681+0000 7f3d18182640 1 -- 172.21.15.146:0/4229317988 wait complete. 2024-09-17T03:36:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.683+0000 7f3d18182640 1 Processor -- start 2024-09-17T03:36:12.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.683+0000 7f3d18182640 1 -- start start 2024-09-17T03:36:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.684+0000 7f3d18182640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d100b47c0 0x7f3d10156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.684+0000 7f3d18182640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d100cf6b0 0x7f3d1015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.684+0000 7f3d18182640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d100d0710 0x7f3d1015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.684+0000 7f3d18182640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3d10162030 con 0x7f3d100b47c0 2024-09-17T03:36:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.684+0000 7f3d18182640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3d10161eb0 con 0x7f3d100cf6b0 2024-09-17T03:36:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.684+0000 7f3d18182640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3d100cd090 con 0x7f3d100d0710 2024-09-17T03:36:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d15f1e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d100b47c0 0x7f3d10156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d15f1e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d100b47c0 0x7f3d10156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37414/0 (socket says 172.21.15.146:37414) 2024-09-17T03:36:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d15f1e640 1 -- 172.21.15.146:0/3696192397 learned_addr learned my addr 172.21.15.146:0/3696192397 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d1671f640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d100d0710 0x7f3d1015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:12.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d1571d640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d100cf6b0 0x7f3d1015cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d15f1e640 1 -- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d100d0710 msgr2=0x7f3d1015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d15f1e640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d100d0710 0x7f3d1015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d15f1e640 1 -- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d100cf6b0 msgr2=0x7f3d1015cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d15f1e640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d100cf6b0 0x7f3d1015cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d15f1e640 1 -- 172.21.15.146:0/3696192397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d101f4da0 con 0x7f3d100b47c0 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d1671f640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d100d0710 0x7f3d1015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d15f1e640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d100b47c0 0x7f3d10156d60 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000ea20 tx=0x7f3d0000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d0e7fc640 1 -- 172.21.15.146:0/3696192397 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000cd80 con 0x7f3d100b47c0 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d0e7fc640 1 -- 172.21.15.146:0/3696192397 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d00011560 con 0x7f3d100b47c0 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d18182640 1 -- 172.21.15.146:0/3696192397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d101f3fe0 con 0x7f3d100b47c0 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d0e7fc640 1 -- 172.21.15.146:0/3696192397 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00011990 con 0x7f3d100b47c0 2024-09-17T03:36:12.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.685+0000 7f3d18182640 1 -- 172.21.15.146:0/3696192397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d101f45a0 con 0x7f3d100b47c0 2024-09-17T03:36:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.686+0000 7f3d18182640 1 -- 172.21.15.146:0/3696192397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d100a03e0 con 0x7f3d100b47c0 2024-09-17T03:36:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.687+0000 7f3d0e7fc640 1 -- 172.21.15.146:0/3696192397 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d00011b30 con 0x7f3d100b47c0 2024-09-17T03:36:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.688+0000 7f3d0e7fc640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3cfc078bc0 0x7f3cfc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.688+0000 7f3d0e7fc640 1 -- 172.21.15.146:0/3696192397 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f3d0009b5b0 con 0x7f3d100b47c0 2024-09-17T03:36:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.688+0000 7f3d1571d640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3cfc078bc0 0x7f3cfc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:12.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.689+0000 7f3d1571d640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3cfc078bc0 0x7f3cfc07b0d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3d10158990 tx=0x7f3d04005d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:12.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.692+0000 7f3d0e7fc640 1 -- 172.21.15.146:0/3696192397 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3d00016030 con 0x7f3d100b47c0 2024-09-17T03:36:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.866+0000 7f3d18182640 1 -- 172.21.15.146:0/3696192397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f3d100cf170 con 0x7f3d100b47c0 2024-09-17T03:36:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.867+0000 7f3d0e7fc640 1 -- 172.21.15.146:0/3696192397 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+2294 (secure 0 0 0) 0x7f3d00011e20 con 0x7f3d100b47c0 2024-09-17T03:36:12.867 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:36:12.867 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:36:12.867 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:36:12.867 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:36:12.867 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:36:12.868 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:36:12.868 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:36:12.868 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:36:12.868 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:36:12.868 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:36:12.868 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:36:12.868 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:36:12.868 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:36:12.868 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:36:12.869 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:36:12.870 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:36:12.870 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:36:12.870 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:36:12.870 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:36:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 -- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3cfc078bc0 msgr2=0x7f3cfc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3cfc078bc0 0x7f3cfc07b0d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3d10158990 tx=0x7f3d04005d70 comp rx=0 tx=0).stop 2024-09-17T03:36:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 -- 172.21.15.146:0/3696192397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d100b47c0 msgr2=0x7f3d10156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d100b47c0 0x7f3d10156d60 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000ea20 tx=0x7f3d0000eee0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 -- 172.21.15.146:0/3696192397 shutdown_connections 2024-09-17T03:36:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3cfc078bc0 0x7f3cfc07b0d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3d100d0710 0x7f3d1015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d100cf6b0 0x7f3d1015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 --2- 172.21.15.146:0/3696192397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d100b47c0 0x7f3d10156d60 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 -- 172.21.15.146:0/3696192397 >> 172.21.15.146:0/3696192397 conn(0x7f3d1009ba20 msgr2=0x7f3d100ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 -- 172.21.15.146:0/3696192397 shutdown_connections 2024-09-17T03:36:12.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.869+0000 7f3d18182640 1 -- 172.21.15.146:0/3696192397 wait complete. 2024-09-17T03:36:12.880 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:36:12.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.996+0000 7f7261c0a640 1 -- 172.21.15.146:0/2464415194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f725c0b5750 msgr2=0x7f725c0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:12.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.996+0000 7f7261c0a640 1 --2- 172.21.15.146:0/2464415194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f725c0b5750 0x7f725c0b3620 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7250009830 tx=0x7f725002a530 comp rx=0 tx=0).stop 2024-09-17T03:36:12.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.996+0000 7f7261c0a640 1 -- 172.21.15.146:0/2464415194 shutdown_connections 2024-09-17T03:36:12.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.996+0000 7f7261c0a640 1 --2- 172.21.15.146:0/2464415194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f725c0b5750 0x7f725c0b3620 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:12.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.996+0000 7f7261c0a640 1 -- 172.21.15.146:0/2464415194 >> 172.21.15.146:0/2464415194 conn(0x7f725c0b7b20 msgr2=0x7f725c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:12.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.996+0000 7f7261c0a640 1 -- 172.21.15.146:0/2464415194 shutdown_connections 2024-09-17T03:36:12.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.996+0000 7f7261c0a640 1 -- 172.21.15.146:0/2464415194 wait complete. 2024-09-17T03:36:12.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.998+0000 7f7261c0a640 1 Processor -- start 2024-09-17T03:36:12.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.998+0000 7f7261c0a640 1 -- start start 2024-09-17T03:36:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f7261c0a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f725c0b3b60 0x7f725c09c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f7261c0a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f725c0b5750 0x7f725c14b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f7261c0a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f725c0b5ce0 0x7f725c0a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f7261c0a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f725c15d650 con 0x7f725c0b3b60 2024-09-17T03:36:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f7261c0a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f725c15d4d0 con 0x7f725c0b5ce0 2024-09-17T03:36:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f7261c0a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f725c15d7d0 con 0x7f725c0b5750 2024-09-17T03:36:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f725b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f725c0b3b60 0x7f725c09c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f725b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f725c0b3b60 0x7f725c09c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37444/0 (socket says 172.21.15.146:37444) 2024-09-17T03:36:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f725b7fe640 1 -- 172.21.15.146:0/2375612567 learned_addr learned my addr 172.21.15.146:0/2375612567 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f725affd640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f725c0b5750 0x7f725c14b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f725bfff640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f725c0b5ce0 0x7f725c0a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f725b7fe640 1 -- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f725c0b5750 msgr2=0x7f725c14b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f725b7fe640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f725c0b5750 0x7f725c14b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f725b7fe640 1 -- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f725c0b5ce0 msgr2=0x7f725c0a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f725b7fe640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f725c0b5ce0 0x7f725c0a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:12.999+0000 7f725b7fe640 1 -- 172.21.15.146:0/2375612567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725c14b6f0 con 0x7f725c0b3b60 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.000+0000 7f725b7fe640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f725c0b3b60 0x7f725c09c6f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f724c00c3d0 tx=0x7f724c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.000+0000 7f7243fff640 1 -- 172.21.15.146:0/2375612567 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c017070 con 0x7f725c0b3b60 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.000+0000 7f7243fff640 1 -- 172.21.15.146:0/2375612567 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f724c0053c0 con 0x7f725c0b3b60 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.000+0000 7f7261c0a640 1 -- 172.21.15.146:0/2375612567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725c0a06b0 con 0x7f725c0b3b60 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.000+0000 7f7243fff640 1 -- 172.21.15.146:0/2375612567 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c003850 con 0x7f725c0b3b60 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.000+0000 7f7261c0a640 1 -- 172.21.15.146:0/2375612567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f725c06f960 con 0x7f725c0b3b60 2024-09-17T03:36:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.001+0000 7f7261c0a640 1 -- 172.21.15.146:0/2375612567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f725c15dcf0 con 0x7f725c0b3b60 2024-09-17T03:36:13.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.002+0000 7f7243fff640 1 -- 172.21.15.146:0/2375612567 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f724c01a070 con 0x7f725c0b3b60 2024-09-17T03:36:13.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.002+0000 7f7243fff640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7248078b90 0x7f724807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.002+0000 7f7243fff640 1 -- 172.21.15.146:0/2375612567 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f724c099d90 con 0x7f725c0b3b60 2024-09-17T03:36:13.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.002+0000 7f725affd640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7248078b90 0x7f724807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.003+0000 7f725affd640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7248078b90 0x7f724807b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7250034000 tx=0x7f7250004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:13.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.007+0000 7f7243fff640 1 -- 172.21.15.146:0/2375612567 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f724c061e80 con 0x7f725c0b3b60 2024-09-17T03:36:13.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.181+0000 7f7261c0a640 1 -- 172.21.15.146:0/2375612567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f725c076260 con 0x7f725c0b3b60 2024-09-17T03:36:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.185+0000 7f7243fff640 1 -- 172.21.15.146:0/2375612567 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f724c0668b0 con 0x7f725c0b3b60 2024-09-17T03:36:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 -- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7248078b90 msgr2=0x7f724807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7248078b90 0x7f724807b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7250034000 tx=0x7f7250004730 comp rx=0 tx=0).stop 2024-09-17T03:36:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 -- 172.21.15.146:0/2375612567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f725c0b3b60 msgr2=0x7f725c09c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f725c0b3b60 0x7f725c09c6f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f724c00c3d0 tx=0x7f724c00c890 comp rx=0 tx=0).stop 2024-09-17T03:36:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 -- 172.21.15.146:0/2375612567 shutdown_connections 2024-09-17T03:36:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7248078b90 0x7f724807b0a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f725c0b5ce0 0x7f725c0a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f725c0b5750 0x7f725c14b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 --2- 172.21.15.146:0/2375612567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f725c0b3b60 0x7f725c09c6f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 -- 172.21.15.146:0/2375612567 >> 172.21.15.146:0/2375612567 conn(0x7f725c0b7b20 msgr2=0x7f725c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 -- 172.21.15.146:0/2375612567 shutdown_connections 2024-09-17T03:36:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.187+0000 7f7261c0a640 1 -- 172.21.15.146:0/2375612567 wait complete. 2024-09-17T03:36:13.199 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:36:13.199 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:36:13.233 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:36:13.279 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:36:13.279 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:13.279 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:13.295 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:36:13.295 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:36:13.295 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:13.313 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:36:13.313 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:13.314 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:13.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:36:13.350 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:36:13.350 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:13.370 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:36:13.371 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:36:13.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:13.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.502+0000 7fd26fade640 1 -- 172.21.15.146:0/2097148163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd26815c8e0 msgr2=0x7fd26806f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.502+0000 7fd26fade640 1 --2- 172.21.15.146:0/2097148163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd26815c8e0 0x7fd26806f580 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd264005fd0 tx=0x7fd26402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.502+0000 7fd26fade640 1 -- 172.21.15.146:0/2097148163 shutdown_connections 2024-09-17T03:36:13.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.502+0000 7fd26fade640 1 --2- 172.21.15.146:0/2097148163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2680cd840 0x7fd2680b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.502+0000 7fd26fade640 1 --2- 172.21.15.146:0/2097148163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd26815c8e0 0x7fd26806f580 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.502+0000 7fd26fade640 1 -- 172.21.15.146:0/2097148163 >> 172.21.15.146:0/2097148163 conn(0x7fd2680b3150 msgr2=0x7fd2680b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:13.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.502+0000 7fd26fade640 1 -- 172.21.15.146:0/2097148163 shutdown_connections 2024-09-17T03:36:13.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.502+0000 7fd26fade640 1 -- 172.21.15.146:0/2097148163 wait complete. 2024-09-17T03:36:13.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.504+0000 7fd26fade640 1 Processor -- start 2024-09-17T03:36:13.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.504+0000 7fd26fade640 1 -- start start 2024-09-17T03:36:13.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26fade640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2680cd840 0x7fd268155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26fade640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2680cdc50 0x7fd26813b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26fade640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd26815c8e0 0x7fd26813e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26fade640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd268073580 con 0x7fd2680cd840 2024-09-17T03:36:13.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26fade640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd2680b5e10 con 0x7fd2680cdc50 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26fade640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd268073700 con 0x7fd26815c8e0 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26d87a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2680cd840 0x7fd268155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26d87a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2680cd840 0x7fd268155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37476/0 (socket says 172.21.15.146:37476) 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26d87a640 1 -- 172.21.15.146:0/2533990087 learned_addr learned my addr 172.21.15.146:0/2533990087 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26e07b640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd26815c8e0 0x7fd26813e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26d079640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2680cdc50 0x7fd26813b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26d87a640 1 -- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd26815c8e0 msgr2=0x7fd26813e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26d87a640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd26815c8e0 0x7fd26813e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26d87a640 1 -- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2680cdc50 msgr2=0x7fd26813b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26d87a640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2680cdc50 0x7fd26813b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.505+0000 7fd26d87a640 1 -- 172.21.15.146:0/2533990087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26814f590 con 0x7fd2680cd840 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.506+0000 7fd26d87a640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2680cd840 0x7fd268155c60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd264034040 tx=0x7fd2640039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.506+0000 7fd25e7fc640 1 -- 172.21.15.146:0/2533990087 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26403e030 con 0x7fd2680cd840 2024-09-17T03:36:13.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.506+0000 7fd25e7fc640 1 -- 172.21.15.146:0/2533990087 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2640047a0 con 0x7fd2680cd840 2024-09-17T03:36:13.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.506+0000 7fd26fade640 1 -- 172.21.15.146:0/2533990087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26814f870 con 0x7fd2680cd840 2024-09-17T03:36:13.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.506+0000 7fd25e7fc640 1 -- 172.21.15.146:0/2533990087 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264035040 con 0x7fd2680cd840 2024-09-17T03:36:13.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.506+0000 7fd26fade640 1 -- 172.21.15.146:0/2533990087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd26814fe30 con 0x7fd2680cd840 2024-09-17T03:36:13.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.507+0000 7fd26fade640 1 -- 172.21.15.146:0/2533990087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26813c300 con 0x7fd2680cd840 2024-09-17T03:36:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.507+0000 7fd25e7fc640 1 -- 172.21.15.146:0/2533990087 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd264041030 con 0x7fd2680cd840 2024-09-17T03:36:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.508+0000 7fd25e7fc640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd24c078b90 0x7fd24c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.508+0000 7fd25e7fc640 1 -- 172.21.15.146:0/2533990087 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fd2640bb310 con 0x7fd2680cd840 2024-09-17T03:36:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.508+0000 7fd26d079640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd24c078b90 0x7fd24c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.509+0000 7fd26d079640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd24c078b90 0x7fd24c07b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd25800a490 tx=0x7fd25800a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.513+0000 7fd25e7fc640 1 -- 172.21.15.146:0/2533990087 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd264083400 con 0x7fd2680cd840 2024-09-17T03:36:13.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.723+0000 7fd26fade640 1 -- 172.21.15.146:0/2533990087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd268073bb0 con 0x7fd2680cd840 2024-09-17T03:36:13.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.724+0000 7fd25e7fc640 1 -- 172.21.15.146:0/2533990087 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+3920 (secure 0 0 0) 0x7fd26408c020 con 0x7fd2680cd840 2024-09-17T03:36:13.724 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:13.724 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":24,"btime":"2024-09-17T03:36:07:520818+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4991,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2310307824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2310307824},{"type":"v1","addr":"172.21.15.179:6836","nonce":2310307824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":4994,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/422393296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":422393296},{"type":"v1","addr":"172.21.15.179:6837","nonce":422393296}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3793010114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3793010114},{"type":"v1","addr":"172.21.15.146:6833","nonce":3793010114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":6264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3784193983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3784193983},{"type":"v1","addr":"172.21.15.146:6835","nonce":3784193983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[]} 2024-09-17T03:36:13.724 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 24 2024-09-17T03:36:13.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 -- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd24c078b90 msgr2=0x7fd24c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd24c078b90 0x7fd24c07b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd25800a490 tx=0x7fd25800a420 comp rx=0 tx=0).stop 2024-09-17T03:36:13.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 -- 172.21.15.146:0/2533990087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2680cd840 msgr2=0x7fd268155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2680cd840 0x7fd268155c60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd264034040 tx=0x7fd2640039e0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 -- 172.21.15.146:0/2533990087 shutdown_connections 2024-09-17T03:36:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd24c078b90 0x7fd24c07b0a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd26815c8e0 0x7fd26813e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2680cdc50 0x7fd26813b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 --2- 172.21.15.146:0/2533990087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2680cd840 0x7fd268155c60 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 -- 172.21.15.146:0/2533990087 >> 172.21.15.146:0/2533990087 conn(0x7fd2680b3150 msgr2=0x7fd2680b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 -- 172.21.15.146:0/2533990087 shutdown_connections 2024-09-17T03:36:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.726+0000 7fd26fade640 1 -- 172.21.15.146:0/2533990087 wait complete. 2024-09-17T03:36:13.737 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:36:13.737 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:36:13.738 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:36:13.738 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:13.738 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:36:13.738 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:36:13.738 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:36:13.738 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:13.739 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:36:13.739 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:36:13.739 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:36:13.739 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:13.739 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:36:13.739 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:36:13.739 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:36:13.739 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:13.747 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:36:13.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:36:13.750 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:36:13.750 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:36:13.751 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:36:13.752 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:36:13.752 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:36:13.752 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:36:13.793 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:36:13.793 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:13.794 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:36:13.794 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:13.795 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:36:13.795 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:36:13.795 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:13.795 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:13.796 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:36:13.880 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:36:13.881 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:36:13.890 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:36:13.890 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:36:13.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.916+0000 7fcac9415640 1 -- 172.21.15.146:0/952884454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac406dd60 msgr2=0x7fcac406e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.916+0000 7fcac9415640 1 --2- 172.21.15.146:0/952884454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac406dd60 0x7fcac406e170 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcabc005fd0 tx=0x7fcabc02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.916+0000 7fcac9415640 1 -- 172.21.15.146:0/952884454 shutdown_connections 2024-09-17T03:36:13.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.916+0000 7fcac9415640 1 --2- 172.21.15.146:0/952884454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac406dd60 0x7fcac406e170 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.916+0000 7fcac9415640 1 --2- 172.21.15.146:0/952884454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac40b4530 0x7fcac40b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.916+0000 7fcac9415640 1 -- 172.21.15.146:0/952884454 >> 172.21.15.146:0/952884454 conn(0x7fcac40b3410 msgr2=0x7fcac40b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:13.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.916+0000 7fcac9415640 1 -- 172.21.15.146:0/952884454 shutdown_connections 2024-09-17T03:36:13.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.916+0000 7fcac9415640 1 -- 172.21.15.146:0/952884454 wait complete. 2024-09-17T03:36:13.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.918+0000 7fcac9415640 1 Processor -- start 2024-09-17T03:36:13.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.918+0000 7fcac9415640 1 -- start start 2024-09-17T03:36:13.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac9415640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac406dd60 0x7fcac41f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac9415640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac40b4530 0x7fcac41413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac9415640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac40b55f0 0x7fcac40d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac9415640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcac415be90 con 0x7fcac406dd60 2024-09-17T03:36:13.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac9415640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcac415bd10 con 0x7fcac40b55f0 2024-09-17T03:36:13.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac9415640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcac415c010 con 0x7fcac40b4530 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac406dd60 0x7fcac41f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac406dd60 0x7fcac41f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37520/0 (socket says 172.21.15.146:37520) 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac2ffd640 1 -- 172.21.15.146:0/3414651621 learned_addr learned my addr 172.21.15.146:0/3414651621 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac27fc640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac40b4530 0x7fcac41413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac37fe640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac40b55f0 0x7fcac40d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac2ffd640 1 -- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac40b4530 msgr2=0x7fcac41413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac2ffd640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac40b4530 0x7fcac41413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac2ffd640 1 -- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac40b55f0 msgr2=0x7fcac40d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac2ffd640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac40b55f0 0x7fcac40d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.919+0000 7fcac2ffd640 1 -- 172.21.15.146:0/3414651621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac4141900 con 0x7fcac406dd60 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.920+0000 7fcac2ffd640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac406dd60 0x7fcac41f1ee0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcab400e760 tx=0x7fcab400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:13.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.920+0000 7fcaab7fe640 1 -- 172.21.15.146:0/3414651621 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab4001a10 con 0x7fcac406dd60 2024-09-17T03:36:13.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.920+0000 7fcaab7fe640 1 -- 172.21.15.146:0/3414651621 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcab4001ca0 con 0x7fcac406dd60 2024-09-17T03:36:13.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.920+0000 7fcac9415640 1 -- 172.21.15.146:0/3414651621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac41f5e20 con 0x7fcac406dd60 2024-09-17T03:36:13.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.920+0000 7fcaab7fe640 1 -- 172.21.15.146:0/3414651621 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab40116d0 con 0x7fcac406dd60 2024-09-17T03:36:13.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.920+0000 7fcac9415640 1 -- 172.21.15.146:0/3414651621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac41f63e0 con 0x7fcac406dd60 2024-09-17T03:36:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.921+0000 7fcac9415640 1 -- 172.21.15.146:0/3414651621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac415c570 con 0x7fcac406dd60 2024-09-17T03:36:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.922+0000 7fcaab7fe640 1 -- 172.21.15.146:0/3414651621 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcab4011930 con 0x7fcac406dd60 2024-09-17T03:36:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.922+0000 7fcaab7fe640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab0078b90 0x7fcab007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.922+0000 7fcaab7fe640 1 -- 172.21.15.146:0/3414651621 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fcab409d090 con 0x7fcac406dd60 2024-09-17T03:36:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.922+0000 7fcac27fc640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab0078b90 0x7fcab007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:13.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.923+0000 7fcac27fc640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab0078b90 0x7fcab007b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcac40b4bc0 tx=0x7fcab8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:13.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:13.927+0000 7fcaab7fe640 1 -- 172.21.15.146:0/3414651621 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcab4016030 con 0x7fcac406dd60 2024-09-17T03:36:14.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.113+0000 7fcac9415640 1 -- 172.21.15.146:0/3414651621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fcac415f9a0 con 0x7fcac406dd60 2024-09-17T03:36:14.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.559+0000 7fcaab7fe640 1 -- 172.21.15.146:0/3414651621 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v52) ==== 97+0+0 (secure 0 0 0) 0x7fcac406e6b0 con 0x7fcac406dd60 2024-09-17T03:36:14.559 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:36:14.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 -- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab0078b90 msgr2=0x7fcab007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:14.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab0078b90 0x7fcab007b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcac40b4bc0 tx=0x7fcab8005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:14.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 -- 172.21.15.146:0/3414651621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac406dd60 msgr2=0x7fcac41f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:14.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac406dd60 0x7fcac41f1ee0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcab400e760 tx=0x7fcab400ec20 comp rx=0 tx=0).stop 2024-09-17T03:36:14.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 -- 172.21.15.146:0/3414651621 shutdown_connections 2024-09-17T03:36:14.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab0078b90 0x7fcab007b0a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac40b55f0 0x7fcac40d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac40b4530 0x7fcac41413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 --2- 172.21.15.146:0/3414651621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac406dd60 0x7fcac41f1ee0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 -- 172.21.15.146:0/3414651621 >> 172.21.15.146:0/3414651621 conn(0x7fcac40b3410 msgr2=0x7fcac4154e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:14.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 -- 172.21.15.146:0/3414651621 shutdown_connections 2024-09-17T03:36:14.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.562+0000 7fcac9415640 1 -- 172.21.15.146:0/3414651621 wait complete. 2024-09-17T03:36:14.576 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:36:14.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.692+0000 7f1e8780e640 1 -- 172.21.15.146:0/2835270022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e6c003a00 msgr2=0x7f1e6c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:14.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.692+0000 7f1e8780e640 1 --2- 172.21.15.146:0/2835270022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e6c003a00 0x7f1e6c003e70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c009b30 tx=0x7f1e6c005830 comp rx=0 tx=0).stop 2024-09-17T03:36:14.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.692+0000 7f1e85dab640 1 -- 172.21.15.146:0/2835270022 reap_dead start 2024-09-17T03:36:14.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.692+0000 7f1e8780e640 1 -- 172.21.15.146:0/2835270022 shutdown_connections 2024-09-17T03:36:14.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.692+0000 7f1e8780e640 1 -- 172.21.15.146:0/2835270022 >> 172.21.15.146:0/2835270022 conn(0x7f1e800d11f0 msgr2=0x7f1e800d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:14.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.693+0000 7f1e8780e640 1 -- 172.21.15.146:0/2835270022 shutdown_connections 2024-09-17T03:36:14.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.693+0000 7f1e8780e640 1 -- 172.21.15.146:0/2835270022 wait complete. 2024-09-17T03:36:14.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.694+0000 7f1e8780e640 1 Processor -- start 2024-09-17T03:36:14.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.694+0000 7f1e8780e640 1 -- start start 2024-09-17T03:36:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e8780e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e6c003a00 0x7f1e801f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e8780e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e801f6a90 0x7f1e800ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e8780e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e80157bb0 0x7f1e800cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e8780e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e800d0030 con 0x7f1e6c003a00 2024-09-17T03:36:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e8780e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1e800cfeb0 con 0x7f1e80157bb0 2024-09-17T03:36:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e8780e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1e800d01b0 con 0x7f1e801f6a90 2024-09-17T03:36:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e855aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e6c003a00 0x7f1e801f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e855aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e6c003a00 0x7f1e801f9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37548/0 (socket says 172.21.15.146:37548) 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e855aa640 1 -- 172.21.15.146:0/2612226997 learned_addr learned my addr 172.21.15.146:0/2612226997 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e84da9640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e801f6a90 0x7f1e800ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e85dab640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e80157bb0 0x7f1e800cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e855aa640 1 -- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e801f6a90 msgr2=0x7f1e800ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e855aa640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e801f6a90 0x7f1e800ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e855aa640 1 -- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e80157bb0 msgr2=0x7f1e800cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e855aa640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e80157bb0 0x7f1e800cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e855aa640 1 -- 172.21.15.146:0/2612226997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e800cb7b0 con 0x7f1e6c003a00 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e855aa640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e6c003a00 0x7f1e801f9430 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c009c50 tx=0x7f1e7c02b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e75ffb640 1 -- 172.21.15.146:0/2612226997 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c042070 con 0x7f1e6c003a00 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e75ffb640 1 -- 172.21.15.146:0/2612226997 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e7c0047a0 con 0x7f1e6c003a00 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e8780e640 1 -- 172.21.15.146:0/2612226997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e801f9c80 con 0x7f1e6c003a00 2024-09-17T03:36:14.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.696+0000 7f1e75ffb640 1 -- 172.21.15.146:0/2612226997 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c004bd0 con 0x7f1e6c003a00 2024-09-17T03:36:14.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.697+0000 7f1e8780e640 1 -- 172.21.15.146:0/2612226997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e801fa240 con 0x7f1e6c003a00 2024-09-17T03:36:14.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.698+0000 7f1e8780e640 1 -- 172.21.15.146:0/2612226997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e80069f00 con 0x7f1e6c003a00 2024-09-17T03:36:14.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.698+0000 7f1e75ffb640 1 -- 172.21.15.146:0/2612226997 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1e7c045070 con 0x7f1e6c003a00 2024-09-17T03:36:14.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.699+0000 7f1e75ffb640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e64078b90 0x7f1e6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:14.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.699+0000 7f1e75ffb640 1 -- 172.21.15.146:0/2612226997 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4857+0+0 (secure 0 0 0) 0x7f1e7c0bbc00 con 0x7f1e6c003a00 2024-09-17T03:36:14.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.699+0000 7f1e84da9640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e64078b90 0x7f1e6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:14.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.700+0000 7f1e84da9640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e64078b90 0x7f1e6407b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1e800b3a40 tx=0x7f1e70006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:14.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.703+0000 7f1e75ffb640 1 -- 172.21.15.146:0/2612226997 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1e7c0c2080 con 0x7f1e6c003a00 2024-09-17T03:36:14.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.946+0000 7f1e8780e640 1 -- 172.21.15.146:0/2612226997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f1e801609a0 con 0x7f1e6c003a00 2024-09-17T03:36:14.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.946+0000 7f1e75ffb640 1 -- 172.21.15.146:0/2612226997 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f1e801609a0 con 0x7f1e6c003a00 2024-09-17T03:36:14.947 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:14.947 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:36:14.947 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:36:14.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.947 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:36:14.947 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:36:14.947 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.947 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:14.947 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:36:14.947 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:36:14.949 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.950 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.951 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:14.953 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.954 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:36:14.955 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:36:14.957 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:36:14.958 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:14.959 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:36:14.960 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:36:14.960 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:14.960 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:36:14.960 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:36:14.960 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:14.960 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.960 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:14.960 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:36:14.960 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:36:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 -- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e64078b90 msgr2=0x7f1e6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e64078b90 0x7f1e6407b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1e800b3a40 tx=0x7f1e70006040 comp rx=0 tx=0).stop 2024-09-17T03:36:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 -- 172.21.15.146:0/2612226997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e6c003a00 msgr2=0x7f1e801f9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e6c003a00 0x7f1e801f9430 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c009c50 tx=0x7f1e7c02b9c0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 -- 172.21.15.146:0/2612226997 shutdown_connections 2024-09-17T03:36:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e64078b90 0x7f1e6407b0a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e80157bb0 0x7f1e800cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e801f6a90 0x7f1e800ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 --2- 172.21.15.146:0/2612226997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e6c003a00 0x7f1e801f9430 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 -- 172.21.15.146:0/2612226997 >> 172.21.15.146:0/2612226997 conn(0x7f1e800d11f0 msgr2=0x7f1e800694c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 -- 172.21.15.146:0/2612226997 shutdown_connections 2024-09-17T03:36:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:14.949+0000 7f1e8780e640 1 -- 172.21.15.146:0/2612226997 wait complete. 2024-09-17T03:36:14.963 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:36:15.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.077+0000 7fb3e23c6640 1 -- 172.21.15.146:0/2310353161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3c8004d40 msgr2=0x7fb3c8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:15.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.077+0000 7fb3e23c6640 1 --2- 172.21.15.146:0/2310353161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3c8004d40 0x7fb3c8005150 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc071540 tx=0x7fb3c8005830 comp rx=0 tx=0).stop 2024-09-17T03:36:15.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.077+0000 7fb3e0963640 1 -- 172.21.15.146:0/2310353161 reap_dead start 2024-09-17T03:36:15.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.077+0000 7fb3e23c6640 1 -- 172.21.15.146:0/2310353161 shutdown_connections 2024-09-17T03:36:15.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.077+0000 7fb3e23c6640 1 -- 172.21.15.146:0/2310353161 >> 172.21.15.146:0/2310353161 conn(0x7fb3dc0b3150 msgr2=0x7fb3dc0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:15.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.077+0000 7fb3e23c6640 1 -- 172.21.15.146:0/2310353161 shutdown_connections 2024-09-17T03:36:15.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.077+0000 7fb3e23c6640 1 -- 172.21.15.146:0/2310353161 wait complete. 2024-09-17T03:36:15.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.078+0000 7fb3e23c6640 1 Processor -- start 2024-09-17T03:36:15.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.079+0000 7fb3e23c6640 1 -- start start 2024-09-17T03:36:15.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3e23c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3c8004d40 0x7fb3dc1f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:15.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3e23c6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc1f7280 0x7fb3dc14ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:15.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3e23c6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3dc1e3eb0 0x7fb3dc1e42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:15.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3e23c6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc0b5010 con 0x7fb3c8004d40 2024-09-17T03:36:15.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3e23c6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc0b4e90 con 0x7fb3dc1f7280 2024-09-17T03:36:15.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3e23c6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb3dc0b5190 con 0x7fb3dc1e3eb0 2024-09-17T03:36:15.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3dbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3c8004d40 0x7fb3dc1f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3dbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3c8004d40 0x7fb3dc1f3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37560/0 (socket says 172.21.15.146:37560) 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3dbfff640 1 -- 172.21.15.146:0/662979134 learned_addr learned my addr 172.21.15.146:0/662979134 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3d3fff640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc1f7280 0x7fb3dc14ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3e0963640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3dc1e3eb0 0x7fb3dc1e42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3dbfff640 1 -- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3dc1e3eb0 msgr2=0x7fb3dc1e42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3dbfff640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3dc1e3eb0 0x7fb3dc1e42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3dbfff640 1 -- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc1f7280 msgr2=0x7fb3dc14ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3dbfff640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc1f7280 0x7fb3dc14ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3dbfff640 1 -- 172.21.15.146:0/662979134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3dc14d3f0 con 0x7fb3c8004d40 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3d3fff640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc1f7280 0x7fb3dc14ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3dbfff640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3c8004d40 0x7fb3dc1f3ea0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc011a80 tx=0x7fb3cc011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.080+0000 7fb3d97fa640 1 -- 172.21.15.146:0/662979134 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00fe70 con 0x7fb3c8004d40 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.081+0000 7fb3d97fa640 1 -- 172.21.15.146:0/662979134 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3cc016070 con 0x7fb3c8004d40 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.081+0000 7fb3e23c6640 1 -- 172.21.15.146:0/662979134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3dc14f6b0 con 0x7fb3c8004d40 2024-09-17T03:36:15.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.081+0000 7fb3d97fa640 1 -- 172.21.15.146:0/662979134 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc0127c0 con 0x7fb3c8004d40 2024-09-17T03:36:15.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.081+0000 7fb3e23c6640 1 -- 172.21.15.146:0/662979134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3dc1f33c0 con 0x7fb3c8004d40 2024-09-17T03:36:15.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.082+0000 7fb3e23c6640 1 -- 172.21.15.146:0/662979134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3dc06f580 con 0x7fb3c8004d40 2024-09-17T03:36:15.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.082+0000 7fb3d97fa640 1 -- 172.21.15.146:0/662979134 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3cc018030 con 0x7fb3c8004d40 2024-09-17T03:36:15.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.083+0000 7fb3d97fa640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3bc078bc0 0x7fb3bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:15.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.083+0000 7fb3d97fa640 1 -- 172.21.15.146:0/662979134 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4857+0+0 (secure 0 0 0) 0x7fb3cc09b330 con 0x7fb3c8004d40 2024-09-17T03:36:15.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.083+0000 7fb3d3fff640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3bc078bc0 0x7fb3bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:15.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.084+0000 7fb3d3fff640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3bc078bc0 0x7fb3bc07b0d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4001860 tx=0x7fb3c4004cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:15.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.087+0000 7fb3d97fa640 1 -- 172.21.15.146:0/662979134 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb3cc063b50 con 0x7fb3c8004d40 2024-09-17T03:36:15.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.262+0000 7fb3e23c6640 1 -- 172.21.15.146:0/662979134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb3dc15d0f0 con 0x7fb3c8004d40 2024-09-17T03:36:15.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.263+0000 7fb3d97fa640 1 -- 172.21.15.146:0/662979134 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) ==== 84+0+65 (secure 0 0 0) 0x7fb3cc063450 con 0x7fb3c8004d40 2024-09-17T03:36:15.263 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:15.263 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:36:15.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:15.263 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:36:15.263 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:36:15.263 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:15.263 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:36:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 -- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3bc078bc0 msgr2=0x7fb3bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3bc078bc0 0x7fb3bc07b0d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4001860 tx=0x7fb3c4004cd0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 -- 172.21.15.146:0/662979134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3c8004d40 msgr2=0x7fb3dc1f3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3c8004d40 0x7fb3dc1f3ea0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc011a80 tx=0x7fb3cc011f40 comp rx=0 tx=0).stop 2024-09-17T03:36:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 -- 172.21.15.146:0/662979134 shutdown_connections 2024-09-17T03:36:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3bc078bc0 0x7fb3bc07b0d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3dc1e3eb0 0x7fb3dc1e42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3dc1f7280 0x7fb3dc14ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 --2- 172.21.15.146:0/662979134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3c8004d40 0x7fb3dc1f3ea0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 -- 172.21.15.146:0/662979134 >> 172.21.15.146:0/662979134 conn(0x7fb3dc0b3150 msgr2=0x7fb3dc0d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 -- 172.21.15.146:0/662979134 shutdown_connections 2024-09-17T03:36:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.265+0000 7fb3e23c6640 1 -- 172.21.15.146:0/662979134 wait complete. 2024-09-17T03:36:15.276 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:36:15.277 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:36:15.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.393+0000 7fdd42d20640 1 -- 172.21.15.146:0/2508019368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd24003a00 msgr2=0x7fdd24003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:15.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.393+0000 7fdd42d20640 1 --2- 172.21.15.146:0/2508019368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd24003a00 0x7fdd24003e70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009b50 tx=0x7fdd24005830 comp rx=0 tx=0).stop 2024-09-17T03:36:15.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.393+0000 7fdd412bd640 1 -- 172.21.15.146:0/2508019368 reap_dead start 2024-09-17T03:36:15.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.393+0000 7fdd42d20640 1 -- 172.21.15.146:0/2508019368 shutdown_connections 2024-09-17T03:36:15.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.393+0000 7fdd42d20640 1 -- 172.21.15.146:0/2508019368 >> 172.21.15.146:0/2508019368 conn(0x7fdd3c0d4960 msgr2=0x7fdd3c0d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:15.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.393+0000 7fdd42d20640 1 -- 172.21.15.146:0/2508019368 shutdown_connections 2024-09-17T03:36:15.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.393+0000 7fdd42d20640 1 -- 172.21.15.146:0/2508019368 wait complete. 2024-09-17T03:36:15.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.395+0000 7fdd42d20640 1 Processor -- start 2024-09-17T03:36:15.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.395+0000 7fdd42d20640 1 -- start start 2024-09-17T03:36:15.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd42d20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd24003a00 0x7fdd3c14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:15.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd42d20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c14b030 0x7fdd3c14b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd42d20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd3c159670 0x7fdd3c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd42d20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c069090 con 0x7fdd3c159670 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd42d20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c068f10 con 0x7fdd3c14b030 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd42d20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3c0d33e0 con 0x7fdd24003a00 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd412bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd3c159670 0x7fdd3c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd412bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd3c159670 0x7fdd3c159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37568/0 (socket says 172.21.15.146:37568) 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd412bd640 1 -- 172.21.15.146:0/204852074 learned_addr learned my addr 172.21.15.146:0/204852074 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd33fff640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c14b030 0x7fdd3c14b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd40abc640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd24003a00 0x7fdd3c14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd412bd640 1 -- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd24003a00 msgr2=0x7fdd3c14cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd412bd640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd24003a00 0x7fdd3c14cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd412bd640 1 -- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c14b030 msgr2=0x7fdd3c14b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:15.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd412bd640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c14b030 0x7fdd3c14b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:15.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.396+0000 7fdd412bd640 1 -- 172.21.15.146:0/204852074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3c149a90 con 0x7fdd3c159670 2024-09-17T03:36:15.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.397+0000 7fdd412bd640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd3c159670 0x7fdd3c159a80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0d11d0 tx=0x7fdd34004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:15.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.397+0000 7fdd317fa640 1 -- 172.21.15.146:0/204852074 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34010890 con 0x7fdd3c159670 2024-09-17T03:36:15.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.397+0000 7fdd317fa640 1 -- 172.21.15.146:0/204852074 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd34017070 con 0x7fdd3c159670 2024-09-17T03:36:15.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.397+0000 7fdd317fa640 1 -- 172.21.15.146:0/204852074 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34010dc0 con 0x7fdd3c159670 2024-09-17T03:36:15.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.397+0000 7fdd42d20640 1 -- 172.21.15.146:0/204852074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3c149f90 con 0x7fdd3c159670 2024-09-17T03:36:15.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.397+0000 7fdd42d20640 1 -- 172.21.15.146:0/204852074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd3c14a550 con 0x7fdd3c159670 2024-09-17T03:36:15.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.398+0000 7fdd42d20640 1 -- 172.21.15.146:0/204852074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3c0b3c00 con 0x7fdd3c159670 2024-09-17T03:36:15.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.399+0000 7fdd317fa640 1 -- 172.21.15.146:0/204852074 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd3401c460 con 0x7fdd3c159670 2024-09-17T03:36:15.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.399+0000 7fdd317fa640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd28078bc0 0x7fdd2807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:15.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.399+0000 7fdd317fa640 1 -- 172.21.15.146:0/204852074 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4857+0+0 (secure 0 0 0) 0x7fdd3409b330 con 0x7fdd3c159670 2024-09-17T03:36:15.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.399+0000 7fdd40abc640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd28078bc0 0x7fdd2807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:15.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.400+0000 7fdd40abc640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd28078bc0 0x7fdd2807b0d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdd38035000 tx=0x7fdd3802d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:15.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.404+0000 7fdd317fa640 1 -- 172.21.15.146:0/204852074 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdd3c069650 con 0x7fdd3c159670 2024-09-17T03:36:15.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:15.581+0000 7fdd42d20640 1 -- 172.21.15.146:0/204852074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdd3c149d20 con 0x7fdd3c159670 2024-09-17T03:36:16.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.566+0000 7fdd317fa640 1 -- 172.21.15.146:0/204852074 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v55) ==== 138+0+0 (secure 0 0 0) 0x7fdd34063470 con 0x7fdd3c159670 2024-09-17T03:36:16.567 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.569+0000 7fdd42d20640 1 -- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd28078bc0 msgr2=0x7fdd2807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.569+0000 7fdd42d20640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd28078bc0 0x7fdd2807b0d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdd38035000 tx=0x7fdd3802d040 comp rx=0 tx=0).stop 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.569+0000 7fdd42d20640 1 -- 172.21.15.146:0/204852074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd3c159670 msgr2=0x7fdd3c159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.569+0000 7fdd42d20640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd3c159670 0x7fdd3c159a80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0d11d0 tx=0x7fdd34004f90 comp rx=0 tx=0).stop 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.569+0000 7fdd42d20640 1 -- 172.21.15.146:0/204852074 shutdown_connections 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.569+0000 7fdd42d20640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd28078bc0 0x7fdd2807b0d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.569+0000 7fdd42d20640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd3c159670 0x7fdd3c159a80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.569+0000 7fdd42d20640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd3c14b030 0x7fdd3c14b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.569+0000 7fdd42d20640 1 --2- 172.21.15.146:0/204852074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd24003a00 0x7fdd3c14cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.570+0000 7fdd42d20640 1 -- 172.21.15.146:0/204852074 >> 172.21.15.146:0/204852074 conn(0x7fdd3c0d4960 msgr2=0x7fdd3c0d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.570+0000 7fdd42d20640 1 -- 172.21.15.146:0/204852074 shutdown_connections 2024-09-17T03:36:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.570+0000 7fdd42d20640 1 -- 172.21.15.146:0/204852074 wait complete. 2024-09-17T03:36:16.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:36:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.714+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/1601289037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0415c8e0 msgr2=0x7fbe040b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.714+0000 7fbe0c7a8640 1 --2- 172.21.15.146:0/1601289037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0415c8e0 0x7fbe040b1120 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fbe00005fd0 tx=0x7fbe0002a820 comp rx=0 tx=0).stop 2024-09-17T03:36:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.714+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/1601289037 shutdown_connections 2024-09-17T03:36:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.714+0000 7fbe0c7a8640 1 --2- 172.21.15.146:0/1601289037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0415c8e0 0x7fbe040b1120 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.714+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/1601289037 >> 172.21.15.146:0/1601289037 conn(0x7fbe0409ba20 msgr2=0x7fbe040b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.714+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/1601289037 shutdown_connections 2024-09-17T03:36:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.714+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/1601289037 wait complete. 2024-09-17T03:36:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.715+0000 7fbe0c7a8640 1 Processor -- start 2024-09-17T03:36:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.716+0000 7fbe0c7a8640 1 -- start start 2024-09-17T03:36:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0c7a8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe040b6590 0x7fbe0414d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0c7a8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe0415c8e0 0x7fbe04156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0c7a8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0414dac0 0x7fbe04156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0c7a8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040b2370 con 0x7fbe0414dac0 2024-09-17T03:36:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0c7a8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040b6e50 con 0x7fbe040b6590 2024-09-17T03:36:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0c7a8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbe040b24f0 con 0x7fbe0415c8e0 2024-09-17T03:36:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0ad45640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0414dac0 0x7fbe04156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0ad45640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0414dac0 0x7fbe04156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37592/0 (socket says 172.21.15.146:37592) 2024-09-17T03:36:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0ad45640 1 -- 172.21.15.146:0/4171661172 learned_addr learned my addr 172.21.15.146:0/4171661172 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0a544640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe040b6590 0x7fbe0414d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe09d43640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe0415c8e0 0x7fbe04156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0ad45640 1 -- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe0415c8e0 msgr2=0x7fbe04156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0ad45640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe0415c8e0 0x7fbe04156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0ad45640 1 -- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe040b6590 msgr2=0x7fbe0414d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0ad45640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe040b6590 0x7fbe0414d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0ad45640 1 -- 172.21.15.146:0/4171661172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0415e2d0 con 0x7fbe0414dac0 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbe0ad45640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0414dac0 0x7fbe04156a80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c3f0 tx=0x7fbdfc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.717+0000 7fbdfaffd640 1 -- 172.21.15.146:0/4171661172 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc011790 con 0x7fbe0414dac0 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.718+0000 7fbdfaffd640 1 -- 172.21.15.146:0/4171661172 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdfc017070 con 0x7fbe0414dac0 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.718+0000 7fbdfaffd640 1 -- 172.21.15.146:0/4171661172 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc011ca0 con 0x7fbe0414dac0 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.718+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/4171661172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0415e5b0 con 0x7fbe0414dac0 2024-09-17T03:36:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.718+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/4171661172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0415eb70 con 0x7fbe0414dac0 2024-09-17T03:36:16.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.718+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/4171661172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe040b29e0 con 0x7fbe0414dac0 2024-09-17T03:36:16.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.719+0000 7fbdfaffd640 1 -- 172.21.15.146:0/4171661172 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbdfc01c460 con 0x7fbe0414dac0 2024-09-17T03:36:16.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.720+0000 7fbdfaffd640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbde8078b90 0x7fbde807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:16.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.720+0000 7fbdfaffd640 1 -- 172.21.15.146:0/4171661172 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5227+0+0 (secure 0 0 0) 0x7fbdfc09a900 con 0x7fbe0414dac0 2024-09-17T03:36:16.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.720+0000 7fbe0a544640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbde8078b90 0x7fbde807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:16.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.721+0000 7fbe0a544640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbde8078b90 0x7fbde807b0a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbe00034000 tx=0x7fbe00004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:16.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.724+0000 7fbdfaffd640 1 -- 172.21.15.146:0/4171661172 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbdfc062f20 con 0x7fbe0414dac0 2024-09-17T03:36:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:16.899+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/4171661172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbe040b43e0 con 0x7fbe0414dac0 2024-09-17T03:36:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.569+0000 7fbdfaffd640 1 -- 172.21.15.146:0/4171661172 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v56) ==== 170+0+0 (secure 0 0 0) 0x7fbdfc001080 con 0x7fbe0414dac0 2024-09-17T03:36:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:36:17.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.571+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbde8078b90 msgr2=0x7fbde807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:17.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.571+0000 7fbe0c7a8640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbde8078b90 0x7fbde807b0a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbe00034000 tx=0x7fbe00004ab0 comp rx=0 tx=0).stop 2024-09-17T03:36:17.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.571+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/4171661172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0414dac0 msgr2=0x7fbe04156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:17.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.571+0000 7fbe0c7a8640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0414dac0 0x7fbe04156a80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c3f0 tx=0x7fbdfc00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:17.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.571+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/4171661172 shutdown_connections 2024-09-17T03:36:17.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.571+0000 7fbe0c7a8640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbde8078b90 0x7fbde807b0a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:17.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.571+0000 7fbe0c7a8640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe0414dac0 0x7fbe04156a80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:17.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.571+0000 7fbe0c7a8640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe0415c8e0 0x7fbe04156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:17.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.571+0000 7fbe0c7a8640 1 --2- 172.21.15.146:0/4171661172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe040b6590 0x7fbe0414d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:17.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.571+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/4171661172 >> 172.21.15.146:0/4171661172 conn(0x7fbe0409ba20 msgr2=0x7fbe04158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:17.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.571+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/4171661172 shutdown_connections 2024-09-17T03:36:17.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.572+0000 7fbe0c7a8640 1 -- 172.21.15.146:0/4171661172 wait complete. 2024-09-17T03:36:17.593 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:36:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.710+0000 7f80c9bb0640 1 -- 172.21.15.146:0/2468014473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c40b5ce0 msgr2=0x7f80c40b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.710+0000 7f80c9bb0640 1 --2- 172.21.15.146:0/2468014473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c40b5ce0 0x7f80c40b1320 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f80c40b8440 tx=0x7f80b402a560 comp rx=0 tx=0).stop 2024-09-17T03:36:17.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.710+0000 7f80c9bb0640 1 -- 172.21.15.146:0/2468014473 shutdown_connections 2024-09-17T03:36:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.710+0000 7f80c9bb0640 1 --2- 172.21.15.146:0/2468014473 >> v2:172.21.15.179:3300/0 conn(0x7f80c40b5750 0x7f80c40b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.710+0000 7f80c9bb0640 1 --2- 172.21.15.146:0/2468014473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c40b5ce0 0x7f80c40b1320 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.710+0000 7f80c9bb0640 1 -- 172.21.15.146:0/2468014473 >> 172.21.15.146:0/2468014473 conn(0x7f80c40b7b20 msgr2=0x7f80c409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.710+0000 7f80c9bb0640 1 -- 172.21.15.146:0/2468014473 shutdown_connections 2024-09-17T03:36:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.710+0000 7f80c9bb0640 1 -- 172.21.15.146:0/2468014473 wait complete. 2024-09-17T03:36:17.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.712+0000 7f80c9bb0640 1 Processor -- start 2024-09-17T03:36:17.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.712+0000 7f80c9bb0640 1 -- start start 2024-09-17T03:36:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.713+0000 7f80c9bb0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c40b3b60 0x7f80c409fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.713+0000 7f80c9bb0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c40b5750 0x7f80c40a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:17.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.713+0000 7f80c9bb0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c40b5ce0 0x7f80c41f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.713+0000 7f80c9bb0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f80c40b27b0 con 0x7f80c40b5750 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.713+0000 7f80c9bb0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f80c415dcc0 con 0x7f80c40b3b60 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.713+0000 7f80c9bb0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f80c40b2930 con 0x7f80c40b5ce0 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.713+0000 7f80c2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c40b5750 0x7f80c40a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.713+0000 7f80c2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c40b5750 0x7f80c40a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48012/0 (socket says 172.21.15.146:48012) 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.713+0000 7f80c2ffd640 1 -- 172.21.15.146:0/3166884736 learned_addr learned my addr 172.21.15.146:0/3166884736 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.713+0000 7f80c37fe640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c40b3b60 0x7f80c409fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.713+0000 7f80c3fff640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c40b5ce0 0x7f80c41f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.714+0000 7f80c2ffd640 1 -- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c40b5ce0 msgr2=0x7f80c41f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.714+0000 7f80c2ffd640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c40b5ce0 0x7f80c41f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.714+0000 7f80c2ffd640 1 -- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c40b3b60 msgr2=0x7f80c409fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.714+0000 7f80c2ffd640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c40b3b60 0x7f80c409fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.714+0000 7f80c2ffd640 1 -- 172.21.15.146:0/3166884736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c4156970 con 0x7f80c40b5750 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.714+0000 7f80c2ffd640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c40b5750 0x7f80c40a0100 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f80b800d720 tx=0x7f80b800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:17.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.714+0000 7f80abfff640 1 -- 172.21.15.146:0/3166884736 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b8017070 con 0x7f80c40b5750 2024-09-17T03:36:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.714+0000 7f80abfff640 1 -- 172.21.15.146:0/3166884736 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80b8009b10 con 0x7f80c40b5750 2024-09-17T03:36:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.714+0000 7f80c9bb0640 1 -- 172.21.15.146:0/3166884736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c41560d0 con 0x7f80c40b5750 2024-09-17T03:36:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.714+0000 7f80abfff640 1 -- 172.21.15.146:0/3166884736 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b8010460 con 0x7f80c40b5750 2024-09-17T03:36:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.714+0000 7f80c9bb0640 1 -- 172.21.15.146:0/3166884736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c4156690 con 0x7f80c40b5750 2024-09-17T03:36:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.715+0000 7f80c9bb0640 1 -- 172.21.15.146:0/3166884736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c40b2e60 con 0x7f80c40b5750 2024-09-17T03:36:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.717+0000 7f80abfff640 1 -- 172.21.15.146:0/3166884736 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f80b801a070 con 0x7f80c40b5750 2024-09-17T03:36:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.717+0000 7f80abfff640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80b0078b90 0x7f80b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.717+0000 7f80abfff640 1 -- 172.21.15.146:0/3166884736 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5609+0+0 (secure 0 0 0) 0x7f80b809b260 con 0x7f80c40b5750 2024-09-17T03:36:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.717+0000 7f80c37fe640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80b0078b90 0x7f80b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:17.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.718+0000 7f80c37fe640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80b0078b90 0x7f80b007b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f80b4033000 tx=0x7f80b4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:17.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.721+0000 7f80abfff640 1 -- 172.21.15.146:0/3166884736 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f80b80630b0 con 0x7f80c40b5750 2024-09-17T03:36:17.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:17.930+0000 7f80c9bb0640 1 -- 172.21.15.146:0/3166884736 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f80c415ab80 con 0x7f80c40b5750 2024-09-17T03:36:18.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.604+0000 7f80abfff640 1 -- 172.21.15.146:0/3166884736 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v27) ==== 172+0+0 (secure 0 0 0) 0x7f80b8067ae0 con 0x7f80c40b5750 2024-09-17T03:36:18.606 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 8 and data pool 9 2024-09-17T03:36:18.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 -- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80b0078b90 msgr2=0x7f80b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80b0078b90 0x7f80b007b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f80b4033000 tx=0x7f80b4004730 comp rx=0 tx=0).stop 2024-09-17T03:36:18.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 -- 172.21.15.146:0/3166884736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c40b5750 msgr2=0x7f80c40a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c40b5750 0x7f80c40a0100 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f80b800d720 tx=0x7f80b800dbe0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 -- 172.21.15.146:0/3166884736 shutdown_connections 2024-09-17T03:36:18.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80b0078b90 0x7f80b007b0a0 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f80b4033000 tx=0x7f80b4004730 comp rx=0 tx=0).stop 2024-09-17T03:36:18.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80c40b5ce0 0x7f80c41f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c40b5750 0x7f80c40a0100 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 --2- 172.21.15.146:0/3166884736 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80c40b3b60 0x7f80c409fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 -- 172.21.15.146:0/3166884736 >> 172.21.15.146:0/3166884736 conn(0x7f80c40b7b20 msgr2=0x7f80c4075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:18.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 -- 172.21.15.146:0/3166884736 shutdown_connections 2024-09-17T03:36:18.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.612+0000 7f80c9bb0640 1 -- 172.21.15.146:0/3166884736 wait complete. 2024-09-17T03:36:18.629 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:18.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.741+0000 7fa20772b640 1 -- 172.21.15.146:0/440161973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa20006f440 msgr2=0x7fa2000d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.741+0000 7fa20772b640 1 --2- 172.21.15.146:0/440161973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa20006f440 0x7fa2000d3190 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8005fd0 tx=0x7fa1f802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.741+0000 7fa20772b640 1 -- 172.21.15.146:0/440161973 shutdown_connections 2024-09-17T03:36:18.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.741+0000 7fa20772b640 1 --2- 172.21.15.146:0/440161973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa20006f440 0x7fa2000d3190 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.741+0000 7fa20772b640 1 --2- 172.21.15.146:0/440161973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2000b3870 0x7fa2000cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.741+0000 7fa20772b640 1 -- 172.21.15.146:0/440161973 >> 172.21.15.146:0/440161973 conn(0x7fa2000d4be0 msgr2=0x7fa2000d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:18.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.741+0000 7fa20772b640 1 -- 172.21.15.146:0/440161973 shutdown_connections 2024-09-17T03:36:18.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.741+0000 7fa20772b640 1 -- 172.21.15.146:0/440161973 wait complete. 2024-09-17T03:36:18.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.743+0000 7fa20772b640 1 Processor -- start 2024-09-17T03:36:18.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.743+0000 7fa20772b640 1 -- start start 2024-09-17T03:36:18.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.744+0000 7fa20772b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2000b3870 0x7fa2000cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:18.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.744+0000 7fa20772b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2001620f0 0x7fa2000ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:18.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.744+0000 7fa20772b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2000b56b0 0x7fa20015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:18.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.744+0000 7fa20772b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa2000d3ae0 con 0x7fa2000b3870 2024-09-17T03:36:18.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.744+0000 7fa20772b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa2000d3960 con 0x7fa2000b56b0 2024-09-17T03:36:18.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.744+0000 7fa20772b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa2000d3c60 con 0x7fa2001620f0 2024-09-17T03:36:18.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.744+0000 7fa2054c7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2000b3870 0x7fa2000cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:18.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.744+0000 7fa2054c7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2000b3870 0x7fa2000cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48028/0 (socket says 172.21.15.146:48028) 2024-09-17T03:36:18.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.744+0000 7fa2054c7640 1 -- 172.21.15.146:0/88964765 learned_addr learned my addr 172.21.15.146:0/88964765 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa205cc8640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2000b56b0 0x7fa20015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa204cc6640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2001620f0 0x7fa2000ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa2054c7640 1 -- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2001620f0 msgr2=0x7fa2000ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa2054c7640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2001620f0 0x7fa2000ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa2054c7640 1 -- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2000b56b0 msgr2=0x7fa20015c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa2054c7640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2000b56b0 0x7fa20015c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa2054c7640 1 -- 172.21.15.146:0/88964765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2000cbf20 con 0x7fa2000b3870 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa205cc8640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2000b56b0 0x7fa20015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa2054c7640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2000b3870 0x7fa2000cb9e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00cd10 tx=0x7fa1fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa1f5ffb640 1 -- 172.21.15.146:0/88964765 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00f450 con 0x7fa2000b3870 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa1f5ffb640 1 -- 172.21.15.146:0/88964765 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1fc00f6e0 con 0x7fa2000b3870 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa20772b640 1 -- 172.21.15.146:0/88964765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2000c9ed0 con 0x7fa2000b3870 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa1f5ffb640 1 -- 172.21.15.146:0/88964765 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00fb10 con 0x7fa2000b3870 2024-09-17T03:36:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.745+0000 7fa20772b640 1 -- 172.21.15.146:0/88964765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2000ca1b0 con 0x7fa2000b3870 2024-09-17T03:36:18.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.746+0000 7fa20772b640 1 -- 172.21.15.146:0/88964765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2000d3190 con 0x7fa2000b3870 2024-09-17T03:36:18.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.747+0000 7fa1f5ffb640 1 -- 172.21.15.146:0/88964765 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa1fc00fcb0 con 0x7fa2000b3870 2024-09-17T03:36:18.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.747+0000 7fa1f5ffb640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1e4078b90 0x7fa1e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:18.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.747+0000 7fa1f5ffb640 1 -- 172.21.15.146:0/88964765 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa1fc09b850 con 0x7fa2000b3870 2024-09-17T03:36:18.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.748+0000 7fa204cc6640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1e4078b90 0x7fa1e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:18.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.748+0000 7fa204cc6640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1e4078b90 0x7fa1e407b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0006fd0 tx=0x7fa1f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.752+0000 7fa1f5ffb640 1 -- 172.21.15.146:0/88964765 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa1fc014030 con 0x7fa2000b3870 2024-09-17T03:36:18.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.927+0000 7fa20772b640 1 -- 172.21.15.146:0/88964765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2000d2bd0 con 0x7fa2000b3870 2024-09-17T03:36:18.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.929+0000 7fa1f5ffb640 1 -- 172.21.15.146:0/88964765 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16786 (secure 0 0 0) 0x7fa1fc063db0 con 0x7fa2000b3870 2024-09-17T03:36:18.929 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:18.929 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":57,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:36:17.932446+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:15.586131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:16.904862+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:18.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 -- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1e4078b90 msgr2=0x7fa1e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1e4078b90 0x7fa1e407b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0006fd0 tx=0x7fa1f0008040 comp rx=0 tx=0).stop 2024-09-17T03:36:18.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 -- 172.21.15.146:0/88964765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2000b3870 msgr2=0x7fa2000cb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:18.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2000b3870 0x7fa2000cb9e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00cd10 tx=0x7fa1fc00a620 comp rx=0 tx=0).stop 2024-09-17T03:36:18.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 -- 172.21.15.146:0/88964765 shutdown_connections 2024-09-17T03:36:18.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa1e4078b90 0x7fa1e407b0a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2000b56b0 0x7fa20015c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa2001620f0 0x7fa2000ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 --2- 172.21.15.146:0/88964765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2000b3870 0x7fa2000cb9e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:18.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 -- 172.21.15.146:0/88964765 >> 172.21.15.146:0/88964765 conn(0x7fa2000d4be0 msgr2=0x7fa200075d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:18.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 -- 172.21.15.146:0/88964765 shutdown_connections 2024-09-17T03:36:18.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:18.931+0000 7fa20772b640 1 -- 172.21.15.146:0/88964765 wait complete. 2024-09-17T03:36:18.943 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.056+0000 7f6b03f24640 1 -- 172.21.15.146:0/2567144667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae8003a30 msgr2=0x7f6ae8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.056+0000 7f6b03f24640 1 --2- 172.21.15.146:0/2567144667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ae8003a30 0x7f6ae8003ea0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c470 tx=0x7f6ae8005830 comp rx=0 tx=0).stop 2024-09-17T03:36:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.056+0000 7f6b024c1640 1 -- 172.21.15.146:0/2567144667 reap_dead start 2024-09-17T03:36:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.056+0000 7f6b03f24640 1 -- 172.21.15.146:0/2567144667 shutdown_connections 2024-09-17T03:36:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.056+0000 7f6b03f24640 1 -- 172.21.15.146:0/2567144667 >> 172.21.15.146:0/2567144667 conn(0x7f6afc0d4be0 msgr2=0x7f6afc0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.057+0000 7f6b03f24640 1 -- 172.21.15.146:0/2567144667 shutdown_connections 2024-09-17T03:36:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.057+0000 7f6b03f24640 1 -- 172.21.15.146:0/2567144667 wait complete. 2024-09-17T03:36:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.058+0000 7f6b03f24640 1 Processor -- start 2024-09-17T03:36:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.058+0000 7f6b03f24640 1 -- start start 2024-09-17T03:36:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b03f24640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8003a30 0x7f6afc1f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b03f24640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cb8a0 0x7f6afc0cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b03f24640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0cd020 0x7f6afc1e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b03f24640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc0d38a0 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b03f24640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc06efd0 con 0x7f6ae8003a30 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b03f24640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6afc0d3a20 con 0x7f6afc0cd020 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b014bf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cb8a0 0x7f6afc0cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b014bf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cb8a0 0x7f6afc0cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48044/0 (socket says 172.21.15.146:48044) 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b014bf640 1 -- 172.21.15.146:0/2756219102 learned_addr learned my addr 172.21.15.146:0/2756219102 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b01cc0640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8003a30 0x7f6afc1f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b024c1640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0cd020 0x7f6afc1e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b014bf640 1 -- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0cd020 msgr2=0x7f6afc1e91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b014bf640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0cd020 0x7f6afc1e91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b014bf640 1 -- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8003a30 msgr2=0x7f6afc1f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b014bf640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8003a30 0x7f6afc1f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b014bf640 1 -- 172.21.15.146:0/2756219102 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6afc0cbf80 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b024c1640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0cd020 0x7f6afc1e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b014bf640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cb8a0 0x7f6afc0cea20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00f650 tx=0x7f6aec00fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6af27fc640 1 -- 172.21.15.146:0/2756219102 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec00baa0 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6af27fc640 1 -- 172.21.15.146:0/2756219102 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6aec00bd30 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b03f24640 1 -- 172.21.15.146:0/2756219102 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6afc0cc260 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6af27fc640 1 -- 172.21.15.146:0/2756219102 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0116a0 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.060+0000 7f6b03f24640 1 -- 172.21.15.146:0/2756219102 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6afc0cc820 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.061+0000 7f6b03f24640 1 -- 172.21.15.146:0/2756219102 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6afc0d3fb0 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.062+0000 7f6af27fc640 1 -- 172.21.15.146:0/2756219102 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6aec019020 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.063+0000 7f6af27fc640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ae0078b90 0x7f6ae007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.063+0000 7f6af27fc640 1 -- 172.21.15.146:0/2756219102 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f6aec09b4d0 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.063+0000 7f6b01cc0640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ae0078b90 0x7f6ae007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.063+0000 7f6b01cc0640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ae0078b90 0x7f6ae007b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6af8033000 tx=0x7f6afc069120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:19.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.067+0000 7f6af27fc640 1 -- 172.21.15.146:0/2756219102 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6aec0639a0 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.241+0000 7f6b03f24640 1 -- 172.21.15.146:0/2756219102 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6afc0d2bd0 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.242+0000 7f6af27fc640 1 -- 172.21.15.146:0/2756219102 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16786 (secure 0 0 0) 0x7f6aec0632a0 con 0x7f6afc0cb8a0 2024-09-17T03:36:19.243 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:19.243 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":57,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:36:17.932446+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:15.586131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:16.904862+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:19.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 -- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ae0078b90 msgr2=0x7f6ae007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ae0078b90 0x7f6ae007b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6af8033000 tx=0x7f6afc069120 comp rx=0 tx=0).stop 2024-09-17T03:36:19.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 -- 172.21.15.146:0/2756219102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cb8a0 msgr2=0x7f6afc0cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cb8a0 0x7f6afc0cea20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00f650 tx=0x7f6aec00fb10 comp rx=0 tx=0).stop 2024-09-17T03:36:19.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 -- 172.21.15.146:0/2756219102 shutdown_connections 2024-09-17T03:36:19.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ae0078b90 0x7f6ae007b0a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6afc0cd020 0x7f6afc1e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6afc0cb8a0 0x7f6afc0cea20 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 --2- 172.21.15.146:0/2756219102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ae8003a30 0x7f6afc1f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 -- 172.21.15.146:0/2756219102 >> 172.21.15.146:0/2756219102 conn(0x7f6afc0d4be0 msgr2=0x7f6afc160650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 -- 172.21.15.146:0/2756219102 shutdown_connections 2024-09-17T03:36:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.244+0000 7f6b03f24640 1 -- 172.21.15.146:0/2756219102 wait complete. 2024-09-17T03:36:19.256 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:36:19.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.372+0000 7fa984007640 1 -- 172.21.15.146:0/1090866296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c06f440 msgr2=0x7fa97c0d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.372+0000 7fa984007640 1 --2- 172.21.15.146:0/1090866296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c06f440 0x7fa97c0d3190 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0b73c0 tx=0x7fa97402a560 comp rx=0 tx=0).stop 2024-09-17T03:36:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.372+0000 7fa984007640 1 -- 172.21.15.146:0/1090866296 shutdown_connections 2024-09-17T03:36:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.372+0000 7fa984007640 1 --2- 172.21.15.146:0/1090866296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c06f440 0x7fa97c0d3190 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.372+0000 7fa984007640 1 --2- 172.21.15.146:0/1090866296 >> v2:172.21.15.179:3300/0 conn(0x7fa97c0b3870 0x7fa97c0cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.372+0000 7fa984007640 1 -- 172.21.15.146:0/1090866296 >> 172.21.15.146:0/1090866296 conn(0x7fa97c0d4be0 msgr2=0x7fa97c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.372+0000 7fa984007640 1 -- 172.21.15.146:0/1090866296 shutdown_connections 2024-09-17T03:36:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.372+0000 7fa984007640 1 -- 172.21.15.146:0/1090866296 wait complete. 2024-09-17T03:36:19.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.374+0000 7fa984007640 1 Processor -- start 2024-09-17T03:36:19.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.374+0000 7fa984007640 1 -- start start 2024-09-17T03:36:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.375+0000 7fa984007640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa97c0b3870 0x7fa97c1f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.375+0000 7fa984007640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c1620f0 0x7fa97c1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.375+0000 7fa984007640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa97c157130 0x7fa97c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.375+0000 7fa984007640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c0d3a60 con 0x7fa97c1620f0 2024-09-17T03:36:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.375+0000 7fa984007640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa97c0d38e0 con 0x7fa97c157130 2024-09-17T03:36:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.375+0000 7fa984007640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa97c0d3be0 con 0x7fa97c0b3870 2024-09-17T03:36:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.375+0000 7fa9815a2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c1620f0 0x7fa97c1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.375+0000 7fa9815a2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c1620f0 0x7fa97c1537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48050/0 (socket says 172.21.15.146:48050) 2024-09-17T03:36:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.375+0000 7fa9815a2640 1 -- 172.21.15.146:0/3327680196 learned_addr learned my addr 172.21.15.146:0/3327680196 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.375+0000 7fa981da3640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa97c0b3870 0x7fa97c1f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.375+0000 7fa9825a4640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa97c157130 0x7fa97c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.376+0000 7fa9815a2640 1 -- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa97c0b3870 msgr2=0x7fa97c1f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.376+0000 7fa9815a2640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa97c0b3870 0x7fa97c1f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.376+0000 7fa9815a2640 1 -- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa97c157130 msgr2=0x7fa97c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.376+0000 7fa9815a2640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa97c157130 0x7fa97c0b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.376+0000 7fa9815a2640 1 -- 172.21.15.146:0/3327680196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97c157c90 con 0x7fa97c1620f0 2024-09-17T03:36:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.376+0000 7fa9815a2640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c1620f0 0x7fa97c1537a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa97000c3a0 tx=0x7fa97000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.376+0000 7fa97a7fc640 1 -- 172.21.15.146:0/3327680196 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970017070 con 0x7fa97c1620f0 2024-09-17T03:36:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.376+0000 7fa97a7fc640 1 -- 172.21.15.146:0/3327680196 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9700053c0 con 0x7fa97c1620f0 2024-09-17T03:36:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.376+0000 7fa984007640 1 -- 172.21.15.146:0/3327680196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97c157f70 con 0x7fa97c1620f0 2024-09-17T03:36:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.376+0000 7fa97a7fc640 1 -- 172.21.15.146:0/3327680196 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970003850 con 0x7fa97c1620f0 2024-09-17T03:36:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.376+0000 7fa984007640 1 -- 172.21.15.146:0/3327680196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa97c158530 con 0x7fa97c1620f0 2024-09-17T03:36:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.377+0000 7fa984007640 1 -- 172.21.15.146:0/3327680196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa97c0d3190 con 0x7fa97c1620f0 2024-09-17T03:36:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.378+0000 7fa97a7fc640 1 -- 172.21.15.146:0/3327680196 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa97001a070 con 0x7fa97c1620f0 2024-09-17T03:36:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.378+0000 7fa97a7fc640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa968078b90 0x7fa96807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.378+0000 7fa97a7fc640 1 -- 172.21.15.146:0/3327680196 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa97009a0a0 con 0x7fa97c1620f0 2024-09-17T03:36:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.379+0000 7fa981da3640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa968078b90 0x7fa96807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.379+0000 7fa981da3640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa968078b90 0x7fa96807b0a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa96c005fd0 tx=0x7fa96c009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:19.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.383+0000 7fa97a7fc640 1 -- 172.21.15.146:0/3327680196 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa970061e10 con 0x7fa97c1620f0 2024-09-17T03:36:19.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.597+0000 7fa984007640 1 -- 172.21.15.146:0/3327680196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa97c0d2bd0 con 0x7fa97c1620f0 2024-09-17T03:36:19.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.604+0000 7fa97a7fc640 1 -- 172.21.15.146:0/3327680196 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7fa970066840 con 0x7fa97c1620f0 2024-09-17T03:36:19.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.606+0000 7fa984007640 1 -- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa968078b90 msgr2=0x7fa96807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.606+0000 7fa984007640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa968078b90 0x7fa96807b0a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa96c005fd0 tx=0x7fa96c009500 comp rx=0 tx=0).stop 2024-09-17T03:36:19.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.606+0000 7fa984007640 1 -- 172.21.15.146:0/3327680196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c1620f0 msgr2=0x7fa97c1537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.606+0000 7fa984007640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c1620f0 0x7fa97c1537a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa97000c3a0 tx=0x7fa97000c860 comp rx=0 tx=0).stop 2024-09-17T03:36:19.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.607+0000 7fa984007640 1 -- 172.21.15.146:0/3327680196 shutdown_connections 2024-09-17T03:36:19.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.607+0000 7fa984007640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa968078b90 0x7fa96807b0a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.607+0000 7fa984007640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa97c157130 0x7fa97c0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.607+0000 7fa984007640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa97c1620f0 0x7fa97c1537a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.607+0000 7fa984007640 1 --2- 172.21.15.146:0/3327680196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa97c0b3870 0x7fa97c1f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.607+0000 7fa984007640 1 -- 172.21.15.146:0/3327680196 >> 172.21.15.146:0/3327680196 conn(0x7fa97c0d4be0 msgr2=0x7fa97c075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:19.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.607+0000 7fa984007640 1 -- 172.21.15.146:0/3327680196 shutdown_connections 2024-09-17T03:36:19.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.607+0000 7fa984007640 1 -- 172.21.15.146:0/3327680196 wait complete. 2024-09-17T03:36:19.619 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:36:19.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:36:19.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.735+0000 7f9494701640 1 -- 172.21.15.146:0/647840883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948c15b770 msgr2=0x7f948c06fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.735+0000 7f9494701640 1 --2- 172.21.15.146:0/647840883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948c15b770 0x7f948c06fe10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9488005fd0 tx=0x7f948802a540 comp rx=0 tx=0).stop 2024-09-17T03:36:19.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.735+0000 7f9494701640 1 -- 172.21.15.146:0/647840883 shutdown_connections 2024-09-17T03:36:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.735+0000 7f9494701640 1 --2- 172.21.15.146:0/647840883 >> v2:172.21.15.179:3300/0 conn(0x7f948c072d90 0x7f948c0b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.735+0000 7f9494701640 1 --2- 172.21.15.146:0/647840883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948c15b770 0x7f948c06fe10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.735+0000 7f9494701640 1 -- 172.21.15.146:0/647840883 >> 172.21.15.146:0/647840883 conn(0x7f948c0b2060 msgr2=0x7f948c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.735+0000 7f9494701640 1 -- 172.21.15.146:0/647840883 shutdown_connections 2024-09-17T03:36:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.735+0000 7f9494701640 1 -- 172.21.15.146:0/647840883 wait complete. 2024-09-17T03:36:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.737+0000 7f9494701640 1 Processor -- start 2024-09-17T03:36:19.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.737+0000 7f9494701640 1 -- start start 2024-09-17T03:36:19.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9494701640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c070350 0x7f948c1f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9494701640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f948c15b770 0x7f948c148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9494701640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948c1f70e0 0x7f948c148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9494701640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0b4db0 con 0x7f948c15b770 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9494701640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0b4c30 con 0x7f948c070350 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9494701640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f948c0b4f30 con 0x7f948c1f70e0 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9491c9c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f948c15b770 0x7f948c148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9491c9c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f948c15b770 0x7f948c148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48066/0 (socket says 172.21.15.146:48066) 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9491c9c640 1 -- 172.21.15.146:0/1233249627 learned_addr learned my addr 172.21.15.146:0/1233249627 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f949249d640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c070350 0x7f948c1f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9492c9e640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948c1f70e0 0x7f948c148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9491c9c640 1 -- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948c1f70e0 msgr2=0x7f948c148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9491c9c640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948c1f70e0 0x7f948c148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9491c9c640 1 -- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c070350 msgr2=0x7f948c1f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:19.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9491c9c640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c070350 0x7f948c1f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:19.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9491c9c640 1 -- 172.21.15.146:0/1233249627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c15d7c0 con 0x7f948c15b770 2024-09-17T03:36:19.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9491c9c640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f948c15b770 0x7f948c148a60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c390 tx=0x7f947c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:19.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9482ffd640 1 -- 172.21.15.146:0/1233249627 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c017070 con 0x7f948c15b770 2024-09-17T03:36:19.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9482ffd640 1 -- 172.21.15.146:0/1233249627 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f947c0053c0 con 0x7f948c15b770 2024-09-17T03:36:19.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9494701640 1 -- 172.21.15.146:0/1233249627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948c150540 con 0x7f948c15b770 2024-09-17T03:36:19.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9482ffd640 1 -- 172.21.15.146:0/1233249627 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c003880 con 0x7f948c15b770 2024-09-17T03:36:19.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.739+0000 7f9494701640 1 -- 172.21.15.146:0/1233249627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948c150b00 con 0x7f948c15b770 2024-09-17T03:36:19.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.740+0000 7f9494701640 1 -- 172.21.15.146:0/1233249627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f948c0b5450 con 0x7f948c15b770 2024-09-17T03:36:19.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.741+0000 7f9482ffd640 1 -- 172.21.15.146:0/1233249627 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f947c01a070 con 0x7f948c15b770 2024-09-17T03:36:19.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.742+0000 7f9482ffd640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9470078b90 0x7f947007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:19.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.742+0000 7f9482ffd640 1 -- 172.21.15.146:0/1233249627 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f947c09a320 con 0x7f948c15b770 2024-09-17T03:36:19.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.742+0000 7f949249d640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9470078b90 0x7f947007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:19.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.743+0000 7f949249d640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9470078b90 0x7f947007b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9488033000 tx=0x7f9488004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:19.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.745+0000 7f9482ffd640 1 -- 172.21.15.146:0/1233249627 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f947c021020 con 0x7f948c15b770 2024-09-17T03:36:19.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:19.959+0000 7f9494701640 1 -- 172.21.15.146:0/1233249627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f948c15d550 con 0x7f948c15b770 2024-09-17T03:36:20.569 INFO:tasks.ceph.mds.d.smithi179.stderr:2024-09-17T03:36:20.570+0000 7f922a526640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:36:20.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.616+0000 7f9482ffd640 1 -- 172.21.15.146:0/1233249627 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v29) ==== 122+0+0 (secure 0 0 0) 0x7f948c15bb80 con 0x7f948c15b770 2024-09-17T03:36:20.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 -- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9470078b90 msgr2=0x7f947007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:20.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9470078b90 0x7f947007b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9488033000 tx=0x7f9488004730 comp rx=0 tx=0).stop 2024-09-17T03:36:20.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 -- 172.21.15.146:0/1233249627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f948c15b770 msgr2=0x7f948c148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:20.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f948c15b770 0x7f948c148a60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c390 tx=0x7f947c00c790 comp rx=0 tx=0).stop 2024-09-17T03:36:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 -- 172.21.15.146:0/1233249627 shutdown_connections 2024-09-17T03:36:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9470078b90 0x7f947007b0a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f948c1f70e0 0x7f948c148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f948c15b770 0x7f948c148a60 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 --2- 172.21.15.146:0/1233249627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948c070350 0x7f948c1f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 -- 172.21.15.146:0/1233249627 >> 172.21.15.146:0/1233249627 conn(0x7f948c0b2060 msgr2=0x7f948c0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 -- 172.21.15.146:0/1233249627 shutdown_connections 2024-09-17T03:36:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.619+0000 7f9494701640 1 -- 172.21.15.146:0/1233249627 wait complete. 2024-09-17T03:36:20.632 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:36:20.632 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.748+0000 7f2f670de640 1 -- 172.21.15.146:0/3824767711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f600b5ce0 msgr2=0x7f2f600b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.748+0000 7f2f670de640 1 --2- 172.21.15.146:0/3824767711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f600b5ce0 0x7f2f600b1320 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c005fd0 tx=0x7f2f5c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.748+0000 7f2f670de640 1 -- 172.21.15.146:0/3824767711 shutdown_connections 2024-09-17T03:36:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.748+0000 7f2f670de640 1 --2- 172.21.15.146:0/3824767711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f600b3d30 0x7f2f6015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.748+0000 7f2f670de640 1 --2- 172.21.15.146:0/3824767711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f600b5ce0 0x7f2f600b1320 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.748+0000 7f2f670de640 1 -- 172.21.15.146:0/3824767711 >> 172.21.15.146:0/3824767711 conn(0x7f2f600b7b20 msgr2=0x7f2f6009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.748+0000 7f2f670de640 1 -- 172.21.15.146:0/3824767711 shutdown_connections 2024-09-17T03:36:20.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.748+0000 7f2f670de640 1 -- 172.21.15.146:0/3824767711 wait complete. 2024-09-17T03:36:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.750+0000 7f2f670de640 1 Processor -- start 2024-09-17T03:36:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.750+0000 7f2f670de640 1 -- start start 2024-09-17T03:36:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f670de640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f600b5750 0x7f2f60141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f670de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f600b5ce0 0x7f2f6015edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f670de640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f601503a0 0x7f2f6015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f670de640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6015d4b0 con 0x7f2f600b5750 2024-09-17T03:36:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f670de640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6015d330 con 0x7f2f601503a0 2024-09-17T03:36:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f670de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6015d630 con 0x7f2f600b5ce0 2024-09-17T03:36:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f64e7a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f600b5750 0x7f2f60141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f64e7a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f600b5750 0x7f2f60141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48082/0 (socket says 172.21.15.146:48082) 2024-09-17T03:36:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f64e7a640 1 -- 172.21.15.146:0/2699891400 learned_addr learned my addr 172.21.15.146:0/2699891400 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f57fff640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f600b5ce0 0x7f2f6015edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f6567b640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f601503a0 0x7f2f6015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f64e7a640 1 -- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f600b5ce0 msgr2=0x7f2f6015edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f64e7a640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f600b5ce0 0x7f2f6015edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f64e7a640 1 -- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f601503a0 msgr2=0x7f2f6015f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f64e7a640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f601503a0 0x7f2f6015f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f64e7a640 1 -- 172.21.15.146:0/2699891400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f60151040 con 0x7f2f600b5750 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f6567b640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f601503a0 0x7f2f6015f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f64e7a640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f600b5750 0x7f2f60141080 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c034040 tx=0x7f2f5c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f557fa640 1 -- 172.21.15.146:0/2699891400 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c03e030 con 0x7f2f600b5750 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.752+0000 7f2f557fa640 1 -- 172.21.15.146:0/2699891400 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f5c003ca0 con 0x7f2f600b5750 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.753+0000 7f2f557fa640 1 -- 172.21.15.146:0/2699891400 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c035040 con 0x7f2f600b5750 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.753+0000 7f2f670de640 1 -- 172.21.15.146:0/2699891400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f601512b0 con 0x7f2f600b5750 2024-09-17T03:36:20.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.753+0000 7f2f670de640 1 -- 172.21.15.146:0/2699891400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f60151870 con 0x7f2f600b5750 2024-09-17T03:36:20.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.754+0000 7f2f670de640 1 -- 172.21.15.146:0/2699891400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6015db50 con 0x7f2f600b5750 2024-09-17T03:36:20.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.754+0000 7f2f557fa640 1 -- 172.21.15.146:0/2699891400 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f5c041030 con 0x7f2f600b5750 2024-09-17T03:36:20.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.755+0000 7f2f557fa640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f4c078bc0 0x7f2f4c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:20.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.755+0000 7f2f557fa640 1 -- 172.21.15.146:0/2699891400 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f2f5c0bb2e0 con 0x7f2f600b5750 2024-09-17T03:36:20.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.755+0000 7f2f57fff640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f4c078bc0 0x7f2f4c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:20.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.756+0000 7f2f57fff640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f4c078bc0 0x7f2f4c07b0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f601508a0 tx=0x7f2f50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:20.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.759+0000 7f2f557fa640 1 -- 172.21.15.146:0/2699891400 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f5c0830e0 con 0x7f2f600b5750 2024-09-17T03:36:20.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.967+0000 7f2f670de640 1 -- 172.21.15.146:0/2699891400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f6015b4b0 con 0x7f2f600b5750 2024-09-17T03:36:20.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.968+0000 7f2f557fa640 1 -- 172.21.15.146:0/2699891400 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5226 (secure 0 0 0) 0x7f2f5c087b10 con 0x7f2f600b5750 2024-09-17T03:36:20.968 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:20.968 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"btime":"2024-09-17T03:36:20:610421+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1042067483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1042067483},{"type":"v1","addr":"172.21.15.179:6837","nonce":1042067483}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5875,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3725156879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3725156879},{"type":"v1","addr":"172.21.15.146:6834","nonce":3725156879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/6455506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":6455506},{"type":"v1","addr":"172.21.15.146:6835","nonce":6455506}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:19.961005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/2016497882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2016497882},{"type":"v1","addr":"172.21.15.179:6836","nonce":2016497882}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5890,"qdb_cluster":[5890]},"id":4}]} 2024-09-17T03:36:20.968 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 29 2024-09-17T03:36:20.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 -- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f4c078bc0 msgr2=0x7f2f4c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:20.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f4c078bc0 0x7f2f4c07b0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2f601508a0 tx=0x7f2f50009040 comp rx=0 tx=0).stop 2024-09-17T03:36:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 -- 172.21.15.146:0/2699891400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f600b5750 msgr2=0x7f2f60141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f600b5750 0x7f2f60141080 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c034040 tx=0x7f2f5c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 -- 172.21.15.146:0/2699891400 shutdown_connections 2024-09-17T03:36:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f4c078bc0 0x7f2f4c07b0d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f601503a0 0x7f2f6015f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f600b5ce0 0x7f2f6015edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 --2- 172.21.15.146:0/2699891400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f600b5750 0x7f2f60141080 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 -- 172.21.15.146:0/2699891400 >> 172.21.15.146:0/2699891400 conn(0x7f2f600b7b20 msgr2=0x7f2f601e5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 -- 172.21.15.146:0/2699891400 shutdown_connections 2024-09-17T03:36:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:20.970+0000 7f2f670de640 1 -- 172.21.15.146:0/2699891400 wait complete. 2024-09-17T03:36:20.982 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.094+0000 7fe218d3a640 1 -- 172.21.15.146:0/2242021043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21415f1a0 msgr2=0x7fe2140cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.094+0000 7fe218d3a640 1 --2- 172.21.15.146:0/2242021043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21415f1a0 0x7fe2140cfca0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe204005fd0 tx=0x7fe20402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.094+0000 7fe218d3a640 1 -- 172.21.15.146:0/2242021043 shutdown_connections 2024-09-17T03:36:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.094+0000 7fe218d3a640 1 --2- 172.21.15.146:0/2242021043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2140b61f0 0x7fe2140b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.094+0000 7fe218d3a640 1 --2- 172.21.15.146:0/2242021043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21415f1a0 0x7fe2140cfca0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.094+0000 7fe218d3a640 1 -- 172.21.15.146:0/2242021043 >> 172.21.15.146:0/2242021043 conn(0x7fe2140d11f0 msgr2=0x7fe2140d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.094+0000 7fe218d3a640 1 -- 172.21.15.146:0/2242021043 shutdown_connections 2024-09-17T03:36:21.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.094+0000 7fe218d3a640 1 -- 172.21.15.146:0/2242021043 wait complete. 2024-09-17T03:36:21.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.096+0000 7fe218d3a640 1 Processor -- start 2024-09-17T03:36:21.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.096+0000 7fe218d3a640 1 -- start start 2024-09-17T03:36:21.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe218d3a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2140b61f0 0x7fe21414fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe218d3a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21415f1a0 0x7fe21415baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe218d3a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2141631a0 0x7fe21415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe218d3a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe2140695b0 con 0x7fe21415f1a0 2024-09-17T03:36:21.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe218d3a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe214069430 con 0x7fe2140b61f0 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe218d3a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe214069730 con 0x7fe2141631a0 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe209d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21415f1a0 0x7fe21415baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe209d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21415f1a0 0x7fe21415baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48092/0 (socket says 172.21.15.146:48092) 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe209d9b640 1 -- 172.21.15.146:0/2737659808 learned_addr learned my addr 172.21.15.146:0/2737659808 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe21259c640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2140b61f0 0x7fe21414fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe212d9d640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2141631a0 0x7fe21415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe209d9b640 1 -- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2141631a0 msgr2=0x7fe21415c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe209d9b640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2141631a0 0x7fe21415c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe209d9b640 1 -- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2140b61f0 msgr2=0x7fe21414fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe209d9b640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2140b61f0 0x7fe21414fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe209d9b640 1 -- 172.21.15.146:0/2737659808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21415b810 con 0x7fe21415f1a0 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe212d9d640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2141631a0 0x7fe21415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:21.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.098+0000 7fe209d9b640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21415f1a0 0x7fe21415baf0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00b3f0 tx=0x7fe1fc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.099+0000 7fe20b7fe640 1 -- 172.21.15.146:0/2737659808 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc015020 con 0x7fe21415f1a0 2024-09-17T03:36:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.099+0000 7fe20b7fe640 1 -- 172.21.15.146:0/2737659808 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1fc011920 con 0x7fe21415f1a0 2024-09-17T03:36:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.099+0000 7fe218d3a640 1 -- 172.21.15.146:0/2737659808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21415aa50 con 0x7fe21415f1a0 2024-09-17T03:36:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.099+0000 7fe20b7fe640 1 -- 172.21.15.146:0/2737659808 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc011d70 con 0x7fe21415f1a0 2024-09-17T03:36:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.099+0000 7fe218d3a640 1 -- 172.21.15.146:0/2737659808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21415b010 con 0x7fe21415f1a0 2024-09-17T03:36:21.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.100+0000 7fe218d3a640 1 -- 172.21.15.146:0/2737659808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe214069c20 con 0x7fe21415f1a0 2024-09-17T03:36:21.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.100+0000 7fe20b7fe640 1 -- 172.21.15.146:0/2737659808 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1fc018020 con 0x7fe21415f1a0 2024-09-17T03:36:21.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.101+0000 7fe20b7fe640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f4078b90 0x7fe1f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.101+0000 7fe20b7fe640 1 -- 172.21.15.146:0/2737659808 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fe1fc09a5f0 con 0x7fe21415f1a0 2024-09-17T03:36:21.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.101+0000 7fe21259c640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f4078b90 0x7fe1f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.102+0000 7fe21259c640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f4078b90 0x7fe1f407b0a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe204033000 tx=0x7fe204004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:21.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.105+0000 7fe20b7fe640 1 -- 172.21.15.146:0/2737659808 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe1fc01f070 con 0x7fe21415f1a0 2024-09-17T03:36:21.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.280+0000 7fe218d3a640 1 -- 172.21.15.146:0/2737659808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe21415c5d0 con 0x7fe21415f1a0 2024-09-17T03:36:21.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.282+0000 7fe20b7fe640 1 -- 172.21.15.146:0/2737659808 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16773 (secure 0 0 0) 0x7fe1fc062a10 con 0x7fe21415f1a0 2024-09-17T03:36:21.282 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:21.282 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":58,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:36:19.591431+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:15.586131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:16.904862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 -- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f4078b90 msgr2=0x7fe1f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f4078b90 0x7fe1f407b0a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe204033000 tx=0x7fe204004730 comp rx=0 tx=0).stop 2024-09-17T03:36:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 -- 172.21.15.146:0/2737659808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21415f1a0 msgr2=0x7fe21415baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21415f1a0 0x7fe21415baf0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00b3f0 tx=0x7fe1fc00b8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 -- 172.21.15.146:0/2737659808 shutdown_connections 2024-09-17T03:36:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f4078b90 0x7fe1f407b0a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2141631a0 0x7fe21415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21415f1a0 0x7fe21415baf0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 --2- 172.21.15.146:0/2737659808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2140b61f0 0x7fe21414fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 -- 172.21.15.146:0/2737659808 >> 172.21.15.146:0/2737659808 conn(0x7fe2140d11f0 msgr2=0x7fe2140b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 -- 172.21.15.146:0/2737659808 shutdown_connections 2024-09-17T03:36:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.284+0000 7fe218d3a640 1 -- 172.21.15.146:0/2737659808 wait complete. 2024-09-17T03:36:21.296 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:36:21.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:21.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.410+0000 7f6ad6f69640 1 -- 172.21.15.146:0/2406867653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ac0004d90 msgr2=0x7f6ac0005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.410+0000 7f6ad6f69640 1 --2- 172.21.15.146:0/2406867653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ac0004d90 0x7f6ac0005220 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c710 tx=0x7f6ac0005830 comp rx=0 tx=0).stop 2024-09-17T03:36:21.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.410+0000 7f6ad5506640 1 -- 172.21.15.146:0/2406867653 reap_dead start 2024-09-17T03:36:21.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.410+0000 7f6ad6f69640 1 -- 172.21.15.146:0/2406867653 shutdown_connections 2024-09-17T03:36:21.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.410+0000 7f6ad6f69640 1 -- 172.21.15.146:0/2406867653 >> 172.21.15.146:0/2406867653 conn(0x7f6ad00b7b20 msgr2=0x7f6ad009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:21.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.410+0000 7f6ad6f69640 1 -- 172.21.15.146:0/2406867653 shutdown_connections 2024-09-17T03:36:21.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.410+0000 7f6ad6f69640 1 -- 172.21.15.146:0/2406867653 wait complete. 2024-09-17T03:36:21.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.412+0000 7f6ad6f69640 1 Processor -- start 2024-09-17T03:36:21.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.412+0000 7f6ad6f69640 1 -- start start 2024-09-17T03:36:21.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.413+0000 7f6ad6f69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ac0004d90 0x7f6ad01f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.413+0000 7f6ad6f69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad0150200 0x7f6ad01533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.413+0000 7f6ad6f69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad01538f0 0x7f6ad015daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.413+0000 7f6ad6f69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad015d1b0 con 0x7f6ad0150200 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.413+0000 7f6ad6f69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad00b38b0 con 0x7f6ad01538f0 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.413+0000 7f6ad6f69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad015d330 con 0x7f6ac0004d90 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.413+0000 7f6acffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad0150200 0x7f6ad01533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.413+0000 7f6acffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad0150200 0x7f6ad01533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48112/0 (socket says 172.21.15.146:48112) 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.413+0000 7f6acffff640 1 -- 172.21.15.146:0/341562579 learned_addr learned my addr 172.21.15.146:0/341562579 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6ad5506640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad01538f0 0x7f6ad015daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6acffff640 1 -- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ac0004d90 msgr2=0x7f6ad01f9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6ad4d05640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ac0004d90 0x7f6ad01f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6acffff640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ac0004d90 0x7f6ad01f9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6acffff640 1 -- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad01538f0 msgr2=0x7f6ad015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6acffff640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad01538f0 0x7f6ad015daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6acffff640 1 -- 172.21.15.146:0/341562579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad0153d00 con 0x7f6ad0150200 2024-09-17T03:36:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6ad5506640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad01538f0 0x7f6ad015daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6acffff640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad0150200 0x7f6ad01533b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6abc011ae0 tx=0x7f6abc009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6acd7fa640 1 -- 172.21.15.146:0/341562579 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc01e070 con 0x7f6ad0150200 2024-09-17T03:36:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6acd7fa640 1 -- 172.21.15.146:0/341562579 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6abc00fe70 con 0x7f6ad0150200 2024-09-17T03:36:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6ad6f69640 1 -- 172.21.15.146:0/341562579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad01529f0 con 0x7f6ad0150200 2024-09-17T03:36:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6acd7fa640 1 -- 172.21.15.146:0/341562579 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc004290 con 0x7f6ad0150200 2024-09-17T03:36:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.414+0000 7f6ad6f69640 1 -- 172.21.15.146:0/341562579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad0151c30 con 0x7f6ad0150200 2024-09-17T03:36:21.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.415+0000 7f6ad6f69640 1 -- 172.21.15.146:0/341562579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad00af890 con 0x7f6ad0150200 2024-09-17T03:36:21.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.416+0000 7f6acd7fa640 1 -- 172.21.15.146:0/341562579 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6abc021070 con 0x7f6ad0150200 2024-09-17T03:36:21.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.416+0000 7f6acd7fa640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ab4078b90 0x7f6ab407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.417+0000 7f6acd7fa640 1 -- 172.21.15.146:0/341562579 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f6abc09b7d0 con 0x7f6ad0150200 2024-09-17T03:36:21.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.417+0000 7f6ad4d05640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ab4078b90 0x7f6ab407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.417+0000 7f6ad4d05640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ab4078b90 0x7f6ab407b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4006460 tx=0x7f6ac4006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:21.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.421+0000 7f6acd7fa640 1 -- 172.21.15.146:0/341562579 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ad00af890 con 0x7f6ad0150200 2024-09-17T03:36:21.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.595+0000 7f6ad6f69640 1 -- 172.21.15.146:0/341562579 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ad015d890 con 0x7f6ab4078b90 2024-09-17T03:36:21.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.600+0000 7f6acd7fa640 1 -- 172.21.15.146:0/341562579 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248070 (secure 0 0 0) 0x7f6ad015d890 con 0x7f6ab4078b90 2024-09-17T03:36:21.603 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:21.604 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:36:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 -- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ab4078b90 msgr2=0x7f6ab407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ab4078b90 0x7f6ab407b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4006460 tx=0x7f6ac4006b10 comp rx=0 tx=0).stop 2024-09-17T03:36:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 -- 172.21.15.146:0/341562579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad0150200 msgr2=0x7f6ad01533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad0150200 0x7f6ad01533b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6abc011ae0 tx=0x7f6abc009e90 comp rx=0 tx=0).stop 2024-09-17T03:36:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 -- 172.21.15.146:0/341562579 shutdown_connections 2024-09-17T03:36:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ab4078b90 0x7f6ab407b0a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ad01538f0 0x7f6ad015daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ad0150200 0x7f6ad01533b0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 --2- 172.21.15.146:0/341562579 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ac0004d90 0x7f6ad01f9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 -- 172.21.15.146:0/341562579 >> 172.21.15.146:0/341562579 conn(0x7f6ad00b7b20 msgr2=0x7f6ad015c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:21.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 -- 172.21.15.146:0/341562579 shutdown_connections 2024-09-17T03:36:21.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.603+0000 7f6ad6f69640 1 -- 172.21.15.146:0/341562579 wait complete. 2024-09-17T03:36:21.615 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-17T03:36:19.839957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592652,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":136,"num_write_kb":1633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289252,"kb_used_data":6440,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685468,"statfs":{"total":773094113280,"available":772797919232,"internally_reserved":0,"allocated":6594560,"data_stored":3403004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":289394225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2284,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000777"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613350+0000","last_change":"2024-09-17T03:36:18.607189+0000","last_active":"2024-09-17T03:36:18.613350+0000","last_peered":"2024-09-17T03:36:18.613350+0000","last_clean":"2024-09-17T03:36:18.613350+0000","last_became_active":"2024-09-17T03:36:18.606849+0000","last_became_peered":"2024-09-17T03:36:18.606849+0000","last_unstale":"2024-09-17T03:36:18.613350+0000","last_undegraded":"2024-09-17T03:36:18.613350+0000","last_fullsized":"2024-09-17T03:36:18.613350+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:17.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628270+0000","last_change":"2024-09-17T03:36:18.621325+0000","last_active":"2024-09-17T03:36:18.628270+0000","last_peered":"2024-09-17T03:36:18.628270+0000","last_clean":"2024-09-17T03:36:18.628270+0000","last_became_active":"2024-09-17T03:36:18.621005+0000","last_became_peered":"2024-09-17T03:36:18.621005+0000","last_unstale":"2024-09-17T03:36:18.628270+0000","last_undegraded":"2024-09-17T03:36:18.628270+0000","last_fullsized":"2024-09-17T03:36:18.628270+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:20.384727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622390+0000","last_change":"2024-09-17T03:36:18.620461+0000","last_active":"2024-09-17T03:36:18.622390+0000","last_peered":"2024-09-17T03:36:18.622390+0000","last_clean":"2024-09-17T03:36:18.622390+0000","last_became_active":"2024-09-17T03:36:18.620111+0000","last_became_peered":"2024-09-17T03:36:18.620111+0000","last_unstale":"2024-09-17T03:36:18.622390+0000","last_undegraded":"2024-09-17T03:36:18.622390+0000","last_fullsized":"2024-09-17T03:36:18.622390+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:45.896532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.602336+0000","last_change":"2024-09-17T03:36:18.601730+0000","last_active":"2024-09-17T03:36:18.602336+0000","last_peered":"2024-09-17T03:36:18.602336+0000","last_clean":"2024-09-17T03:36:18.602336+0000","last_became_active":"2024-09-17T03:36:18.601442+0000","last_became_peered":"2024-09-17T03:36:18.601442+0000","last_unstale":"2024-09-17T03:36:18.602336+0000","last_undegraded":"2024-09-17T03:36:18.602336+0000","last_fullsized":"2024-09-17T03:36:18.602336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:04.496122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620920+0000","last_change":"2024-09-17T03:36:18.617518+0000","last_active":"2024-09-17T03:36:18.620920+0000","last_peered":"2024-09-17T03:36:18.620920+0000","last_clean":"2024-09-17T03:36:18.620920+0000","last_became_active":"2024-09-17T03:36:18.617017+0000","last_became_peered":"2024-09-17T03:36:18.617017+0000","last_unstale":"2024-09-17T03:36:18.620920+0000","last_undegraded":"2024-09-17T03:36:18.620920+0000","last_fullsized":"2024-09-17T03:36:18.620920+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:43.171594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.618982+0000","last_change":"2024-09-17T03:36:18.611502+0000","last_active":"2024-09-17T03:36:18.618982+0000","last_peered":"2024-09-17T03:36:18.618982+0000","last_clean":"2024-09-17T03:36:18.618982+0000","last_became_active":"2024-09-17T03:36:18.611076+0000","last_became_peered":"2024-09-17T03:36:18.611076+0000","last_unstale":"2024-09-17T03:36:18.618982+0000","last_undegraded":"2024-09-17T03:36:18.618982+0000","last_fullsized":"2024-09-17T03:36:18.618982+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.201611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612835+0000","last_change":"2024-09-17T03:36:18.608871+0000","last_active":"2024-09-17T03:36:18.612835+0000","last_peered":"2024-09-17T03:36:18.612835+0000","last_clean":"2024-09-17T03:36:18.612835+0000","last_became_active":"2024-09-17T03:36:18.608525+0000","last_became_peered":"2024-09-17T03:36:18.608525+0000","last_unstale":"2024-09-17T03:36:18.612835+0000","last_undegraded":"2024-09-17T03:36:18.612835+0000","last_fullsized":"2024-09-17T03:36:18.612835+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:52.745381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612940+0000","last_change":"2024-09-17T03:36:18.607137+0000","last_active":"2024-09-17T03:36:18.612940+0000","last_peered":"2024-09-17T03:36:18.612940+0000","last_clean":"2024-09-17T03:36:18.612940+0000","last_became_active":"2024-09-17T03:36:18.606832+0000","last_became_peered":"2024-09-17T03:36:18.606832+0000","last_unstale":"2024-09-17T03:36:18.612940+0000","last_undegraded":"2024-09-17T03:36:18.612940+0000","last_fullsized":"2024-09-17T03:36:18.612940+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:23.498137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.614985+0000","last_change":"2024-09-17T03:36:18.606718+0000","last_active":"2024-09-17T03:36:18.614985+0000","last_peered":"2024-09-17T03:36:18.614985+0000","last_clean":"2024-09-17T03:36:18.614985+0000","last_became_active":"2024-09-17T03:36:18.606359+0000","last_became_peered":"2024-09-17T03:36:18.606359+0000","last_unstale":"2024-09-17T03:36:18.614985+0000","last_undegraded":"2024-09-17T03:36:18.614985+0000","last_fullsized":"2024-09-17T03:36:18.614985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:28.969026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619137+0000","last_change":"2024-09-17T03:36:18.609437+0000","last_active":"2024-09-17T03:36:18.619137+0000","last_peered":"2024-09-17T03:36:18.619137+0000","last_clean":"2024-09-17T03:36:18.619137+0000","last_became_active":"2024-09-17T03:36:18.609134+0000","last_became_peered":"2024-09-17T03:36:18.609134+0000","last_unstale":"2024-09-17T03:36:18.619137+0000","last_undegraded":"2024-09-17T03:36:18.619137+0000","last_fullsized":"2024-09-17T03:36:18.619137+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:17.878524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.618987+0000","last_change":"2024-09-17T03:36:18.614518+0000","last_active":"2024-09-17T03:36:18.618987+0000","last_peered":"2024-09-17T03:36:18.618987+0000","last_clean":"2024-09-17T03:36:18.618987+0000","last_became_active":"2024-09-17T03:36:18.614218+0000","last_became_peered":"2024-09-17T03:36:18.614218+0000","last_unstale":"2024-09-17T03:36:18.618987+0000","last_undegraded":"2024-09-17T03:36:18.618987+0000","last_fullsized":"2024-09-17T03:36:18.618987+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:48.495098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613398+0000","last_change":"2024-09-17T03:36:18.608914+0000","last_active":"2024-09-17T03:36:18.613398+0000","last_peered":"2024-09-17T03:36:18.613398+0000","last_clean":"2024-09-17T03:36:18.613398+0000","last_became_active":"2024-09-17T03:36:18.608524+0000","last_became_peered":"2024-09-17T03:36:18.608524+0000","last_unstale":"2024-09-17T03:36:18.613398+0000","last_undegraded":"2024-09-17T03:36:18.613398+0000","last_fullsized":"2024-09-17T03:36:18.613398+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:13.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620634+0000","last_change":"2024-09-17T03:36:18.616908+0000","last_active":"2024-09-17T03:36:18.620634+0000","last_peered":"2024-09-17T03:36:18.620634+0000","last_clean":"2024-09-17T03:36:18.620634+0000","last_became_active":"2024-09-17T03:36:18.616582+0000","last_became_peered":"2024-09-17T03:36:18.616582+0000","last_unstale":"2024-09-17T03:36:18.620634+0000","last_undegraded":"2024-09-17T03:36:18.620634+0000","last_fullsized":"2024-09-17T03:36:18.620634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:13.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.611420+0000","last_change":"2024-09-17T03:36:18.607199+0000","last_active":"2024-09-17T03:36:18.611420+0000","last_peered":"2024-09-17T03:36:18.611420+0000","last_clean":"2024-09-17T03:36:18.611420+0000","last_became_active":"2024-09-17T03:36:18.606912+0000","last_became_peered":"2024-09-17T03:36:18.606912+0000","last_unstale":"2024-09-17T03:36:18.611420+0000","last_undegraded":"2024-09-17T03:36:18.611420+0000","last_fullsized":"2024-09-17T03:36:18.611420+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:24.342808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628326+0000","last_change":"2024-09-17T03:36:18.623471+0000","last_active":"2024-09-17T03:36:18.628326+0000","last_peered":"2024-09-17T03:36:18.628326+0000","last_clean":"2024-09-17T03:36:18.628326+0000","last_became_active":"2024-09-17T03:36:18.622892+0000","last_became_peered":"2024-09-17T03:36:18.622892+0000","last_unstale":"2024-09-17T03:36:18.628326+0000","last_undegraded":"2024-09-17T03:36:18.628326+0000","last_fullsized":"2024-09-17T03:36:18.628326+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:28.096453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628199+0000","last_change":"2024-09-17T03:36:18.622572+0000","last_active":"2024-09-17T03:36:18.628199+0000","last_peered":"2024-09-17T03:36:18.628199+0000","last_clean":"2024-09-17T03:36:18.628199+0000","last_became_active":"2024-09-17T03:36:18.618178+0000","last_became_peered":"2024-09-17T03:36:18.618178+0000","last_unstale":"2024-09-17T03:36:18.628199+0000","last_undegraded":"2024-09-17T03:36:18.628199+0000","last_fullsized":"2024-09-17T03:36:18.628199+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:11.516431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.615066+0000","last_change":"2024-09-17T03:36:18.607221+0000","last_active":"2024-09-17T03:36:18.615066+0000","last_peered":"2024-09-17T03:36:18.615066+0000","last_clean":"2024-09-17T03:36:18.615066+0000","last_became_active":"2024-09-17T03:36:18.606526+0000","last_became_peered":"2024-09-17T03:36:18.606526+0000","last_unstale":"2024-09-17T03:36:18.615066+0000","last_undegraded":"2024-09-17T03:36:18.615066+0000","last_fullsized":"2024-09-17T03:36:18.615066+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:40.215862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.607883+0000","last_change":"2024-09-17T03:36:18.604164+0000","last_active":"2024-09-17T03:36:18.607883+0000","last_peered":"2024-09-17T03:36:18.607883+0000","last_clean":"2024-09-17T03:36:18.607883+0000","last_became_active":"2024-09-17T03:36:18.603876+0000","last_became_peered":"2024-09-17T03:36:18.603876+0000","last_unstale":"2024-09-17T03:36:18.607883+0000","last_undegraded":"2024-09-17T03:36:18.607883+0000","last_fullsized":"2024-09-17T03:36:18.607883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:54.083331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613350+0000","last_change":"2024-09-17T03:36:18.606583+0000","last_active":"2024-09-17T03:36:18.613350+0000","last_peered":"2024-09-17T03:36:18.613350+0000","last_clean":"2024-09-17T03:36:18.613350+0000","last_became_active":"2024-09-17T03:36:18.606264+0000","last_became_peered":"2024-09-17T03:36:18.606264+0000","last_unstale":"2024-09-17T03:36:18.613350+0000","last_undegraded":"2024-09-17T03:36:18.613350+0000","last_fullsized":"2024-09-17T03:36:18.613350+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:25.923247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622790+0000","last_change":"2024-09-17T03:36:18.621086+0000","last_active":"2024-09-17T03:36:18.622790+0000","last_peered":"2024-09-17T03:36:18.622790+0000","last_clean":"2024-09-17T03:36:18.622790+0000","last_became_active":"2024-09-17T03:36:18.620045+0000","last_became_peered":"2024-09-17T03:36:18.620045+0000","last_unstale":"2024-09-17T03:36:18.622790+0000","last_undegraded":"2024-09-17T03:36:18.622790+0000","last_fullsized":"2024-09-17T03:36:18.622790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:35.879493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620597+0000","last_change":"2024-09-17T03:36:18.619190+0000","last_active":"2024-09-17T03:36:18.620597+0000","last_peered":"2024-09-17T03:36:18.620597+0000","last_clean":"2024-09-17T03:36:18.620597+0000","last_became_active":"2024-09-17T03:36:18.618556+0000","last_became_peered":"2024-09-17T03:36:18.618556+0000","last_unstale":"2024-09-17T03:36:18.620597+0000","last_undegraded":"2024-09-17T03:36:18.620597+0000","last_fullsized":"2024-09-17T03:36:18.620597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.833899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601512+0000","last_change":"2024-09-17T03:36:18.600605+0000","last_active":"2024-09-17T03:36:18.601512+0000","last_peered":"2024-09-17T03:36:18.601512+0000","last_clean":"2024-09-17T03:36:18.601512+0000","last_became_active":"2024-09-17T03:36:18.600314+0000","last_became_peered":"2024-09-17T03:36:18.600314+0000","last_unstale":"2024-09-17T03:36:18.601512+0000","last_undegraded":"2024-09-17T03:36:18.601512+0000","last_fullsized":"2024-09-17T03:36:18.601512+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:19.575514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613424+0000","last_change":"2024-09-17T03:36:18.607175+0000","last_active":"2024-09-17T03:36:18.613424+0000","last_peered":"2024-09-17T03:36:18.613424+0000","last_clean":"2024-09-17T03:36:18.613424+0000","last_became_active":"2024-09-17T03:36:18.606339+0000","last_became_peered":"2024-09-17T03:36:18.606339+0000","last_unstale":"2024-09-17T03:36:18.613424+0000","last_undegraded":"2024-09-17T03:36:18.613424+0000","last_fullsized":"2024-09-17T03:36:18.613424+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:51.093115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623309+0000","last_change":"2024-09-17T03:36:18.622508+0000","last_active":"2024-09-17T03:36:18.623309+0000","last_peered":"2024-09-17T03:36:18.623309+0000","last_clean":"2024-09-17T03:36:18.623309+0000","last_became_active":"2024-09-17T03:36:18.622066+0000","last_became_peered":"2024-09-17T03:36:18.622066+0000","last_unstale":"2024-09-17T03:36:18.623309+0000","last_undegraded":"2024-09-17T03:36:18.623309+0000","last_fullsized":"2024-09-17T03:36:18.623309+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:20.384727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.630390+0000","last_change":"2024-09-17T03:36:17.585943+0000","last_active":"2024-09-17T03:36:18.630390+0000","last_peered":"2024-09-17T03:36:18.630390+0000","last_clean":"2024-09-17T03:36:18.630390+0000","last_became_active":"2024-09-17T03:36:17.585591+0000","last_became_peered":"2024-09-17T03:36:17.585591+0000","last_unstale":"2024-09-17T03:36:18.630390+0000","last_undegraded":"2024-09-17T03:36:18.630390+0000","last_fullsized":"2024-09-17T03:36:18.630390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:09.421144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622564+0000","last_change":"2024-09-17T03:36:18.620989+0000","last_active":"2024-09-17T03:36:18.622564+0000","last_peered":"2024-09-17T03:36:18.622564+0000","last_clean":"2024-09-17T03:36:18.622564+0000","last_became_active":"2024-09-17T03:36:18.620523+0000","last_became_peered":"2024-09-17T03:36:18.620523+0000","last_unstale":"2024-09-17T03:36:18.622564+0000","last_undegraded":"2024-09-17T03:36:18.622564+0000","last_fullsized":"2024-09-17T03:36:18.622564+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:04.316587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.578169+0000","last_change":"2024-09-17T03:36:16.578169+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.578169+0000","last_undegraded":"2024-09-17T03:36:16.578169+0000","last_fullsized":"2024-09-17T03:36:16.578169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613311+0000","last_change":"2024-09-17T03:36:18.608183+0000","last_active":"2024-09-17T03:36:18.613311+0000","last_peered":"2024-09-17T03:36:18.613311+0000","last_clean":"2024-09-17T03:36:18.613311+0000","last_became_active":"2024-09-17T03:36:18.607081+0000","last_became_peered":"2024-09-17T03:36:18.607081+0000","last_unstale":"2024-09-17T03:36:18.613311+0000","last_undegraded":"2024-09-17T03:36:18.613311+0000","last_fullsized":"2024-09-17T03:36:18.613311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:20.151030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628537+0000","last_change":"2024-09-17T03:36:17.586129+0000","last_active":"2024-09-17T03:36:18.628537+0000","last_peered":"2024-09-17T03:36:18.628537+0000","last_clean":"2024-09-17T03:36:18.628537+0000","last_became_active":"2024-09-17T03:36:17.585850+0000","last_became_peered":"2024-09-17T03:36:17.585850+0000","last_unstale":"2024-09-17T03:36:18.628537+0000","last_undegraded":"2024-09-17T03:36:18.628537+0000","last_fullsized":"2024-09-17T03:36:18.628537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:13.936211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623112+0000","last_change":"2024-09-17T03:36:18.620952+0000","last_active":"2024-09-17T03:36:18.623112+0000","last_peered":"2024-09-17T03:36:18.623112+0000","last_clean":"2024-09-17T03:36:18.623112+0000","last_became_active":"2024-09-17T03:36:18.620286+0000","last_became_peered":"2024-09-17T03:36:18.620286+0000","last_unstale":"2024-09-17T03:36:18.623112+0000","last_undegraded":"2024-09-17T03:36:18.623112+0000","last_fullsized":"2024-09-17T03:36:18.623112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:48.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576151+0000","last_change":"2024-09-17T03:36:16.576151+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576151+0000","last_undegraded":"2024-09-17T03:36:16.576151+0000","last_fullsized":"2024-09-17T03:36:16.576151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.631561+0000","last_change":"2024-09-17T03:36:17.585520+0000","last_active":"2024-09-17T03:36:18.631561+0000","last_peered":"2024-09-17T03:36:18.631561+0000","last_clean":"2024-09-17T03:36:18.631561+0000","last_became_active":"2024-09-17T03:36:17.585226+0000","last_became_peered":"2024-09-17T03:36:17.585226+0000","last_unstale":"2024-09-17T03:36:18.631561+0000","last_undegraded":"2024-09-17T03:36:18.631561+0000","last_fullsized":"2024-09-17T03:36:18.631561+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:48.714528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628298+0000","last_change":"2024-09-17T03:36:17.584532+0000","last_active":"2024-09-17T03:36:18.628298+0000","last_peered":"2024-09-17T03:36:18.628298+0000","last_clean":"2024-09-17T03:36:18.628298+0000","last_became_active":"2024-09-17T03:36:17.584217+0000","last_became_peered":"2024-09-17T03:36:17.584217+0000","last_unstale":"2024-09-17T03:36:18.628298+0000","last_undegraded":"2024-09-17T03:36:18.628298+0000","last_fullsized":"2024-09-17T03:36:18.628298+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:49.597521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619975+0000","last_change":"2024-09-17T03:36:18.617026+0000","last_active":"2024-09-17T03:36:18.619975+0000","last_peered":"2024-09-17T03:36:18.619975+0000","last_clean":"2024-09-17T03:36:18.619975+0000","last_became_active":"2024-09-17T03:36:18.616713+0000","last_became_peered":"2024-09-17T03:36:18.616713+0000","last_unstale":"2024-09-17T03:36:18.619975+0000","last_undegraded":"2024-09-17T03:36:18.619975+0000","last_fullsized":"2024-09-17T03:36:18.619975+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:04.592223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576263+0000","last_change":"2024-09-17T03:36:16.576263+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576263+0000","last_undegraded":"2024-09-17T03:36:16.576263+0000","last_fullsized":"2024-09-17T03:36:16.576263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601290+0000","last_change":"2024-09-17T03:36:17.595365+0000","last_active":"2024-09-17T03:36:18.601290+0000","last_peered":"2024-09-17T03:36:18.601290+0000","last_clean":"2024-09-17T03:36:18.601290+0000","last_became_active":"2024-09-17T03:36:17.595025+0000","last_became_peered":"2024-09-17T03:36:17.595025+0000","last_unstale":"2024-09-17T03:36:18.601290+0000","last_undegraded":"2024-09-17T03:36:18.601290+0000","last_fullsized":"2024-09-17T03:36:18.601290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:44.064718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619111+0000","last_change":"2024-09-17T03:36:18.613594+0000","last_active":"2024-09-17T03:36:18.619111+0000","last_peered":"2024-09-17T03:36:18.619111+0000","last_clean":"2024-09-17T03:36:18.619111+0000","last_became_active":"2024-09-17T03:36:18.613277+0000","last_became_peered":"2024-09-17T03:36:18.613277+0000","last_unstale":"2024-09-17T03:36:18.619111+0000","last_undegraded":"2024-09-17T03:36:18.619111+0000","last_fullsized":"2024-09-17T03:36:18.619111+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:52.293464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.610739+0000","last_change":"2024-09-17T03:36:17.595227+0000","last_active":"2024-09-17T03:36:18.610739+0000","last_peered":"2024-09-17T03:36:18.610739+0000","last_clean":"2024-09-17T03:36:18.610739+0000","last_became_active":"2024-09-17T03:36:17.594734+0000","last_became_peered":"2024-09-17T03:36:17.594734+0000","last_unstale":"2024-09-17T03:36:18.610739+0000","last_undegraded":"2024-09-17T03:36:18.610739+0000","last_fullsized":"2024-09-17T03:36:18.610739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:19.145953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.621716+0000","last_change":"2024-09-17T03:36:18.617682+0000","last_active":"2024-09-17T03:36:18.621716+0000","last_peered":"2024-09-17T03:36:18.621716+0000","last_clean":"2024-09-17T03:36:18.621716+0000","last_became_active":"2024-09-17T03:36:18.617304+0000","last_became_peered":"2024-09-17T03:36:18.617304+0000","last_unstale":"2024-09-17T03:36:18.621716+0000","last_undegraded":"2024-09-17T03:36:18.621716+0000","last_fullsized":"2024-09-17T03:36:18.621716+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:36.010214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.577512+0000","last_change":"2024-09-17T03:36:16.577512+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.577512+0000","last_undegraded":"2024-09-17T03:36:16.577512+0000","last_fullsized":"2024-09-17T03:36:16.577512+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612891+0000","last_change":"2024-09-17T03:36:18.605255+0000","last_active":"2024-09-17T03:36:18.612891+0000","last_peered":"2024-09-17T03:36:18.612891+0000","last_clean":"2024-09-17T03:36:18.612891+0000","last_became_active":"2024-09-17T03:36:18.604989+0000","last_became_peered":"2024-09-17T03:36:18.604989+0000","last_unstale":"2024-09-17T03:36:18.612891+0000","last_undegraded":"2024-09-17T03:36:18.612891+0000","last_fullsized":"2024-09-17T03:36:18.612891+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:09.275600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.631749+0000","last_change":"2024-09-17T03:36:17.590026+0000","last_active":"2024-09-17T03:36:18.631749+0000","last_peered":"2024-09-17T03:36:18.631749+0000","last_clean":"2024-09-17T03:36:18.631749+0000","last_became_active":"2024-09-17T03:36:17.589545+0000","last_became_peered":"2024-09-17T03:36:17.589545+0000","last_unstale":"2024-09-17T03:36:18.631749+0000","last_undegraded":"2024-09-17T03:36:18.631749+0000","last_fullsized":"2024-09-17T03:36:18.631749+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:50.088038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628375+0000","last_change":"2024-09-17T03:36:18.621917+0000","last_active":"2024-09-17T03:36:18.628375+0000","last_peered":"2024-09-17T03:36:18.628375+0000","last_clean":"2024-09-17T03:36:18.628375+0000","last_became_active":"2024-09-17T03:36:18.621591+0000","last_became_peered":"2024-09-17T03:36:18.621591+0000","last_unstale":"2024-09-17T03:36:18.628375+0000","last_undegraded":"2024-09-17T03:36:18.628375+0000","last_fullsized":"2024-09-17T03:36:18.628375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:48.539605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.634430+0000","last_change":"2024-09-17T03:36:17.585567+0000","last_active":"2024-09-17T03:36:18.634430+0000","last_peered":"2024-09-17T03:36:18.634430+0000","last_clean":"2024-09-17T03:36:18.634430+0000","last_became_active":"2024-09-17T03:36:17.584661+0000","last_became_peered":"2024-09-17T03:36:17.584661+0000","last_unstale":"2024-09-17T03:36:18.634430+0000","last_undegraded":"2024-09-17T03:36:18.634430+0000","last_fullsized":"2024-09-17T03:36:18.634430+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:48.556283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.577486+0000","last_change":"2024-09-17T03:36:16.577486+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.577486+0000","last_undegraded":"2024-09-17T03:36:16.577486+0000","last_fullsized":"2024-09-17T03:36:16.577486+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628308+0000","last_change":"2024-09-17T03:36:18.623279+0000","last_active":"2024-09-17T03:36:18.628308+0000","last_peered":"2024-09-17T03:36:18.628308+0000","last_clean":"2024-09-17T03:36:18.628308+0000","last_became_active":"2024-09-17T03:36:18.622907+0000","last_became_peered":"2024-09-17T03:36:18.622907+0000","last_unstale":"2024-09-17T03:36:18.628308+0000","last_undegraded":"2024-09-17T03:36:18.628308+0000","last_fullsized":"2024-09-17T03:36:18.628308+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:49.263474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604610+0000","last_change":"2024-09-17T03:36:17.582775+0000","last_active":"2024-09-17T03:36:18.604610+0000","last_peered":"2024-09-17T03:36:18.604610+0000","last_clean":"2024-09-17T03:36:18.604610+0000","last_became_active":"2024-09-17T03:36:17.582451+0000","last_became_peered":"2024-09-17T03:36:17.582451+0000","last_unstale":"2024-09-17T03:36:18.604610+0000","last_undegraded":"2024-09-17T03:36:18.604610+0000","last_fullsized":"2024-09-17T03:36:18.604610+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:55.225494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620916+0000","last_change":"2024-09-17T03:36:18.617154+0000","last_active":"2024-09-17T03:36:18.620916+0000","last_peered":"2024-09-17T03:36:18.620916+0000","last_clean":"2024-09-17T03:36:18.620916+0000","last_became_active":"2024-09-17T03:36:18.616817+0000","last_became_peered":"2024-09-17T03:36:18.616817+0000","last_unstale":"2024-09-17T03:36:18.620916+0000","last_undegraded":"2024-09-17T03:36:18.620916+0000","last_fullsized":"2024-09-17T03:36:18.620916+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:22.975493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575434+0000","last_change":"2024-09-17T03:36:16.575434+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575434+0000","last_undegraded":"2024-09-17T03:36:16.575434+0000","last_fullsized":"2024-09-17T03:36:16.575434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623796+0000","last_change":"2024-09-17T03:36:18.620650+0000","last_active":"2024-09-17T03:36:18.623796+0000","last_peered":"2024-09-17T03:36:18.623796+0000","last_clean":"2024-09-17T03:36:18.623796+0000","last_became_active":"2024-09-17T03:36:18.617859+0000","last_became_peered":"2024-09-17T03:36:18.617859+0000","last_unstale":"2024-09-17T03:36:18.623796+0000","last_undegraded":"2024-09-17T03:36:18.623796+0000","last_fullsized":"2024-09-17T03:36:18.623796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:01.225617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.634663+0000","last_change":"2024-09-17T03:36:17.586177+0000","last_active":"2024-09-17T03:36:18.634663+0000","last_peered":"2024-09-17T03:36:18.634663+0000","last_clean":"2024-09-17T03:36:18.634663+0000","last_became_active":"2024-09-17T03:36:17.585819+0000","last_became_peered":"2024-09-17T03:36:17.585819+0000","last_unstale":"2024-09-17T03:36:18.634663+0000","last_undegraded":"2024-09-17T03:36:18.634663+0000","last_fullsized":"2024-09-17T03:36:18.634663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:24.918171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.627961+0000","last_change":"2024-09-17T03:36:18.622200+0000","last_active":"2024-09-17T03:36:18.627961+0000","last_peered":"2024-09-17T03:36:18.627961+0000","last_clean":"2024-09-17T03:36:18.627961+0000","last_became_active":"2024-09-17T03:36:18.621839+0000","last_became_peered":"2024-09-17T03:36:18.621839+0000","last_unstale":"2024-09-17T03:36:18.627961+0000","last_undegraded":"2024-09-17T03:36:18.627961+0000","last_fullsized":"2024-09-17T03:36:18.627961+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:44.384105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576728+0000","last_change":"2024-09-17T03:36:16.576728+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576728+0000","last_undegraded":"2024-09-17T03:36:16.576728+0000","last_fullsized":"2024-09-17T03:36:16.576728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628263+0000","last_change":"2024-09-17T03:36:17.590872+0000","last_active":"2024-09-17T03:36:18.628263+0000","last_peered":"2024-09-17T03:36:18.628263+0000","last_clean":"2024-09-17T03:36:18.628263+0000","last_became_active":"2024-09-17T03:36:17.590501+0000","last_became_peered":"2024-09-17T03:36:17.590501+0000","last_unstale":"2024-09-17T03:36:18.628263+0000","last_undegraded":"2024-09-17T03:36:18.628263+0000","last_fullsized":"2024-09-17T03:36:18.628263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:28.794329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575557+0000","last_change":"2024-09-17T03:36:16.575557+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575557+0000","last_undegraded":"2024-09-17T03:36:16.575557+0000","last_fullsized":"2024-09-17T03:36:16.575557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.621198+0000","last_change":"2024-09-17T03:36:18.618941+0000","last_active":"2024-09-17T03:36:18.621198+0000","last_peered":"2024-09-17T03:36:18.621198+0000","last_clean":"2024-09-17T03:36:18.621198+0000","last_became_active":"2024-09-17T03:36:18.618611+0000","last_became_peered":"2024-09-17T03:36:18.618611+0000","last_unstale":"2024-09-17T03:36:18.621198+0000","last_undegraded":"2024-09-17T03:36:18.621198+0000","last_fullsized":"2024-09-17T03:36:18.621198+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:48.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601821+0000","last_change":"2024-09-17T03:36:17.595452+0000","last_active":"2024-09-17T03:36:18.601821+0000","last_peered":"2024-09-17T03:36:18.601821+0000","last_clean":"2024-09-17T03:36:18.601821+0000","last_became_active":"2024-09-17T03:36:17.595094+0000","last_became_peered":"2024-09-17T03:36:17.595094+0000","last_unstale":"2024-09-17T03:36:18.601821+0000","last_undegraded":"2024-09-17T03:36:18.601821+0000","last_fullsized":"2024-09-17T03:36:18.601821+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:12.654766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576728+0000","last_change":"2024-09-17T03:36:16.576728+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576728+0000","last_undegraded":"2024-09-17T03:36:16.576728+0000","last_fullsized":"2024-09-17T03:36:16.576728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.615017+0000","last_change":"2024-09-17T03:36:18.610121+0000","last_active":"2024-09-17T03:36:18.615017+0000","last_peered":"2024-09-17T03:36:18.615017+0000","last_clean":"2024-09-17T03:36:18.615017+0000","last_became_active":"2024-09-17T03:36:18.606903+0000","last_became_peered":"2024-09-17T03:36:18.606903+0000","last_unstale":"2024-09-17T03:36:18.615017+0000","last_undegraded":"2024-09-17T03:36:18.615017+0000","last_fullsized":"2024-09-17T03:36:18.615017+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:36.010214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593684+0000","last_change":"2024-09-17T03:36:17.588176+0000","last_active":"2024-09-17T03:36:18.593684+0000","last_peered":"2024-09-17T03:36:18.593684+0000","last_clean":"2024-09-17T03:36:18.593684+0000","last_became_active":"2024-09-17T03:36:17.587563+0000","last_became_peered":"2024-09-17T03:36:17.587563+0000","last_unstale":"2024-09-17T03:36:18.593684+0000","last_undegraded":"2024-09-17T03:36:18.593684+0000","last_fullsized":"2024-09-17T03:36:18.593684+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:27.963949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623117+0000","last_change":"2024-09-17T03:36:18.622275+0000","last_active":"2024-09-17T03:36:18.623117+0000","last_peered":"2024-09-17T03:36:18.623117+0000","last_clean":"2024-09-17T03:36:18.623117+0000","last_became_active":"2024-09-17T03:36:18.621983+0000","last_became_peered":"2024-09-17T03:36:18.621983+0000","last_unstale":"2024-09-17T03:36:18.623117+0000","last_undegraded":"2024-09-17T03:36:18.623117+0000","last_fullsized":"2024-09-17T03:36:18.623117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:01.225617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575452+0000","last_change":"2024-09-17T03:36:16.575452+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575452+0000","last_undegraded":"2024-09-17T03:36:16.575452+0000","last_fullsized":"2024-09-17T03:36:16.575452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.629109+0000","last_change":"2024-09-17T03:36:17.594225+0000","last_active":"2024-09-17T03:36:18.629109+0000","last_peered":"2024-09-17T03:36:18.629109+0000","last_clean":"2024-09-17T03:36:18.629109+0000","last_became_active":"2024-09-17T03:36:17.593916+0000","last_became_peered":"2024-09-17T03:36:17.593916+0000","last_unstale":"2024-09-17T03:36:18.629109+0000","last_undegraded":"2024-09-17T03:36:18.629109+0000","last_fullsized":"2024-09-17T03:36:18.629109+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:03.587147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.599453+0000","last_change":"2024-09-17T03:36:17.589681+0000","last_active":"2024-09-17T03:36:18.599453+0000","last_peered":"2024-09-17T03:36:18.599453+0000","last_clean":"2024-09-17T03:36:18.599453+0000","last_became_active":"2024-09-17T03:36:17.582742+0000","last_became_peered":"2024-09-17T03:36:17.582742+0000","last_unstale":"2024-09-17T03:36:18.599453+0000","last_undegraded":"2024-09-17T03:36:18.599453+0000","last_fullsized":"2024-09-17T03:36:18.599453+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:34.514226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612864+0000","last_change":"2024-09-17T03:36:18.604528+0000","last_active":"2024-09-17T03:36:18.612864+0000","last_peered":"2024-09-17T03:36:18.612864+0000","last_clean":"2024-09-17T03:36:18.612864+0000","last_became_active":"2024-09-17T03:36:18.604264+0000","last_became_peered":"2024-09-17T03:36:18.604264+0000","last_unstale":"2024-09-17T03:36:18.612864+0000","last_undegraded":"2024-09-17T03:36:18.612864+0000","last_fullsized":"2024-09-17T03:36:18.612864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:08.252388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604689+0000","last_change":"2024-09-17T03:36:17.580793+0000","last_active":"2024-09-17T03:36:18.604689+0000","last_peered":"2024-09-17T03:36:18.604689+0000","last_clean":"2024-09-17T03:36:18.604689+0000","last_became_active":"2024-09-17T03:36:17.580470+0000","last_became_peered":"2024-09-17T03:36:17.580470+0000","last_unstale":"2024-09-17T03:36:18.604689+0000","last_undegraded":"2024-09-17T03:36:18.604689+0000","last_fullsized":"2024-09-17T03:36:18.604689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:25.063641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622663+0000","last_change":"2024-09-17T03:36:18.621036+0000","last_active":"2024-09-17T03:36:18.622663+0000","last_peered":"2024-09-17T03:36:18.622663+0000","last_clean":"2024-09-17T03:36:18.622663+0000","last_became_active":"2024-09-17T03:36:18.620667+0000","last_became_peered":"2024-09-17T03:36:18.620667+0000","last_unstale":"2024-09-17T03:36:18.622663+0000","last_undegraded":"2024-09-17T03:36:18.622663+0000","last_fullsized":"2024-09-17T03:36:18.622663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.833899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575534+0000","last_change":"2024-09-17T03:36:16.575534+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575534+0000","last_undegraded":"2024-09-17T03:36:16.575534+0000","last_fullsized":"2024-09-17T03:36:16.575534+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593735+0000","last_change":"2024-09-17T03:36:17.587591+0000","last_active":"2024-09-17T03:36:18.593735+0000","last_peered":"2024-09-17T03:36:18.593735+0000","last_clean":"2024-09-17T03:36:18.593735+0000","last_became_active":"2024-09-17T03:36:17.586959+0000","last_became_peered":"2024-09-17T03:36:17.586959+0000","last_unstale":"2024-09-17T03:36:18.593735+0000","last_undegraded":"2024-09-17T03:36:18.593735+0000","last_fullsized":"2024-09-17T03:36:18.593735+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:39.210785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628007+0000","last_change":"2024-09-17T03:36:18.622306+0000","last_active":"2024-09-17T03:36:18.628007+0000","last_peered":"2024-09-17T03:36:18.628007+0000","last_clean":"2024-09-17T03:36:18.628007+0000","last_became_active":"2024-09-17T03:36:18.619448+0000","last_became_peered":"2024-09-17T03:36:18.619448+0000","last_unstale":"2024-09-17T03:36:18.628007+0000","last_undegraded":"2024-09-17T03:36:18.628007+0000","last_fullsized":"2024-09-17T03:36:18.628007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:58.826782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.603333+0000","last_change":"2024-09-17T03:36:17.578097+0000","last_active":"2024-09-17T03:36:18.603333+0000","last_peered":"2024-09-17T03:36:18.603333+0000","last_clean":"2024-09-17T03:36:18.603333+0000","last_became_active":"2024-09-17T03:36:17.577678+0000","last_became_peered":"2024-09-17T03:36:17.577678+0000","last_unstale":"2024-09-17T03:36:18.603333+0000","last_undegraded":"2024-09-17T03:36:18.603333+0000","last_fullsized":"2024-09-17T03:36:18.603333+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:16.042540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613221+0000","last_change":"2024-09-17T03:36:18.609081+0000","last_active":"2024-09-17T03:36:18.613221+0000","last_peered":"2024-09-17T03:36:18.613221+0000","last_clean":"2024-09-17T03:36:18.613221+0000","last_became_active":"2024-09-17T03:36:18.608778+0000","last_became_peered":"2024-09-17T03:36:18.608778+0000","last_unstale":"2024-09-17T03:36:18.613221+0000","last_undegraded":"2024-09-17T03:36:18.613221+0000","last_fullsized":"2024-09-17T03:36:18.613221+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:10.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593669+0000","last_change":"2024-09-17T03:36:17.595198+0000","last_active":"2024-09-17T03:36:18.593669+0000","last_peered":"2024-09-17T03:36:18.593669+0000","last_clean":"2024-09-17T03:36:18.593669+0000","last_became_active":"2024-09-17T03:36:17.594848+0000","last_became_peered":"2024-09-17T03:36:17.594848+0000","last_unstale":"2024-09-17T03:36:18.593669+0000","last_undegraded":"2024-09-17T03:36:18.593669+0000","last_fullsized":"2024-09-17T03:36:18.593669+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.483843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576072+0000","last_change":"2024-09-17T03:36:16.576072+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576072+0000","last_undegraded":"2024-09-17T03:36:16.576072+0000","last_fullsized":"2024-09-17T03:36:16.576072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604804+0000","last_change":"2024-09-17T03:36:17.587385+0000","last_active":"2024-09-17T03:36:18.604804+0000","last_peered":"2024-09-17T03:36:18.604804+0000","last_clean":"2024-09-17T03:36:18.604804+0000","last_became_active":"2024-09-17T03:36:17.586929+0000","last_became_peered":"2024-09-17T03:36:17.586929+0000","last_unstale":"2024-09-17T03:36:18.604804+0000","last_undegraded":"2024-09-17T03:36:18.604804+0000","last_fullsized":"2024-09-17T03:36:18.604804+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.483843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":178,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.608022+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:36:18.608022+0000","last_peered":"2024-09-17T03:36:18.608022+0000","last_clean":"2024-09-17T03:36:18.608022+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:36:18.608022+0000","last_undegraded":"2024-09-17T03:36:18.608022+0000","last_fullsized":"2024-09-17T03:36:18.608022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2284,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36604,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335236,"statfs":{"total":96636764160,"available":96599281664,"internally_reserved":0,"allocated":1277952,"data_stored":871058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":675840,"data_stored":280530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40188,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331652,"statfs":{"total":96636764160,"available":96595611648,"internally_reserved":0,"allocated":688128,"data_stored":282142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36024,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335816,"statfs":{"total":96636764160,"available":96599875584,"internally_reserved":0,"allocated":684032,"data_stored":280586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":679936,"data_stored":280620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":873092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":267488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":267488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:21.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.766+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/4210314781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad40b61f0 msgr2=0x7f7ad40b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.766+0000 7f7ad9ae5640 1 --2- 172.21.15.146:0/4210314781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad40b61f0 0x7f7ad40b6600 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7ad415cd70 tx=0x7f7acc02aa30 comp rx=0 tx=0).stop 2024-09-17T03:36:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.766+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/4210314781 shutdown_connections 2024-09-17T03:36:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.766+0000 7f7ad9ae5640 1 --2- 172.21.15.146:0/4210314781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad40b61f0 0x7f7ad40b6600 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.766+0000 7f7ad9ae5640 1 --2- 172.21.15.146:0/4210314781 >> v2:172.21.15.179:3300/0 conn(0x7f7ad40cfca0 0x7f7ad40cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.766+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/4210314781 >> 172.21.15.146:0/4210314781 conn(0x7f7ad40d11f0 msgr2=0x7f7ad40d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.766+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/4210314781 shutdown_connections 2024-09-17T03:36:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.767+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/4210314781 wait complete. 2024-09-17T03:36:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.768+0000 7f7ad9ae5640 1 Processor -- start 2024-09-17T03:36:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.768+0000 7f7ad9ae5640 1 -- start start 2024-09-17T03:36:21.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad9ae5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ad40b61f0 0x7f7ad40cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad9ae5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad40cfca0 0x7f7ad40b9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad9ae5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ad415f1a0 0x7f7ad40b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad9ae5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad40695b0 con 0x7f7ad40cfca0 2024-09-17T03:36:21.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad9ae5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad4069430 con 0x7f7ad40b61f0 2024-09-17T03:36:21.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad9ae5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad4069730 con 0x7f7ad415f1a0 2024-09-17T03:36:21.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad40cfca0 0x7f7ad40b9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad40cfca0 0x7f7ad40b9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48130/0 (socket says 172.21.15.146:48130) 2024-09-17T03:36:21.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad2ffd640 1 -- 172.21.15.146:0/1181825992 learned_addr learned my addr 172.21.15.146:0/1181825992 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad37fe640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ad40b61f0 0x7f7ad40cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad3fff640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ad415f1a0 0x7f7ad40b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad2ffd640 1 -- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ad415f1a0 msgr2=0x7f7ad40b9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad2ffd640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ad415f1a0 0x7f7ad40b9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad2ffd640 1 -- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ad40b61f0 msgr2=0x7f7ad40cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad2ffd640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ad40b61f0 0x7f7ad40cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad2ffd640 1 -- 172.21.15.146:0/1181825992 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad41f6200 con 0x7f7ad40cfca0 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7ad2ffd640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad40cfca0 0x7f7ad40b9980 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c970 tx=0x7f7ac800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7abbfff640 1 -- 172.21.15.146:0/1181825992 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8007bb0 con 0x7f7ad40cfca0 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.770+0000 7f7abbfff640 1 -- 172.21.15.146:0/1181825992 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ac8007e40 con 0x7f7ad40cfca0 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.771+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/1181825992 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad41f64e0 con 0x7f7ad40cfca0 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.771+0000 7f7abbfff640 1 -- 172.21.15.146:0/1181825992 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8005280 con 0x7f7ad40cfca0 2024-09-17T03:36:21.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.771+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/1181825992 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad40c9400 con 0x7f7ad40cfca0 2024-09-17T03:36:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.771+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/1181825992 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad41f5f70 con 0x7f7ad40cfca0 2024-09-17T03:36:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.772+0000 7f7abbfff640 1 -- 172.21.15.146:0/1181825992 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ac8005420 con 0x7f7ad40cfca0 2024-09-17T03:36:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.773+0000 7f7abbfff640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7ac0078bc0 0x7f7ac007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.773+0000 7f7abbfff640 1 -- 172.21.15.146:0/1181825992 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f7ac809b100 con 0x7f7ad40cfca0 2024-09-17T03:36:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.773+0000 7f7ad37fe640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7ac0078bc0 0x7f7ac007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.774+0000 7f7ad37fe640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7ac0078bc0 0x7f7ac007b0d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4001720 tx=0x7f7ac4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:21.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.777+0000 7f7abbfff640 1 -- 172.21.15.146:0/1181825992 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ac8014030 con 0x7f7ad40cfca0 2024-09-17T03:36:21.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.950+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/1181825992 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ad41f6a00 con 0x7f7ac0078bc0 2024-09-17T03:36:21.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.955+0000 7f7abbfff640 1 -- 172.21.15.146:0/1181825992 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248070 (secure 0 0 0) 0x7f7ad41f6a00 con 0x7f7ac0078bc0 2024-09-17T03:36:21.958 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:21.959 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:36:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7ac0078bc0 msgr2=0x7f7ac007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7ac0078bc0 0x7f7ac007b0d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4001720 tx=0x7f7ac4009040 comp rx=0 tx=0).stop 2024-09-17T03:36:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/1181825992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad40cfca0 msgr2=0x7f7ad40b9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad40cfca0 0x7f7ad40b9980 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c970 tx=0x7f7ac800ce30 comp rx=0 tx=0).stop 2024-09-17T03:36:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/1181825992 shutdown_connections 2024-09-17T03:36:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7ac0078bc0 0x7f7ac007b0d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7ad415f1a0 0x7f7ad40b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad40cfca0 0x7f7ad40b9980 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 --2- 172.21.15.146:0/1181825992 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7ad40b61f0 0x7f7ad40cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/1181825992 >> 172.21.15.146:0/1181825992 conn(0x7f7ad40d11f0 msgr2=0x7f7ad4158c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/1181825992 shutdown_connections 2024-09-17T03:36:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:21.958+0000 7f7ad9ae5640 1 -- 172.21.15.146:0/1181825992 wait complete. 2024-09-17T03:36:21.969 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-17T03:36:21.840418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592652,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":136,"num_write_kb":1633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289252,"kb_used_data":6440,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685468,"statfs":{"total":773094113280,"available":772797919232,"internally_reserved":0,"allocated":6594560,"data_stored":3403004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":289394225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2284,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.271619"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613350+0000","last_change":"2024-09-17T03:36:18.607189+0000","last_active":"2024-09-17T03:36:18.613350+0000","last_peered":"2024-09-17T03:36:18.613350+0000","last_clean":"2024-09-17T03:36:18.613350+0000","last_became_active":"2024-09-17T03:36:18.606849+0000","last_became_peered":"2024-09-17T03:36:18.606849+0000","last_unstale":"2024-09-17T03:36:18.613350+0000","last_undegraded":"2024-09-17T03:36:18.613350+0000","last_fullsized":"2024-09-17T03:36:18.613350+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:17.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628270+0000","last_change":"2024-09-17T03:36:18.621325+0000","last_active":"2024-09-17T03:36:18.628270+0000","last_peered":"2024-09-17T03:36:18.628270+0000","last_clean":"2024-09-17T03:36:18.628270+0000","last_became_active":"2024-09-17T03:36:18.621005+0000","last_became_peered":"2024-09-17T03:36:18.621005+0000","last_unstale":"2024-09-17T03:36:18.628270+0000","last_undegraded":"2024-09-17T03:36:18.628270+0000","last_fullsized":"2024-09-17T03:36:18.628270+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:20.384727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622390+0000","last_change":"2024-09-17T03:36:18.620461+0000","last_active":"2024-09-17T03:36:18.622390+0000","last_peered":"2024-09-17T03:36:18.622390+0000","last_clean":"2024-09-17T03:36:18.622390+0000","last_became_active":"2024-09-17T03:36:18.620111+0000","last_became_peered":"2024-09-17T03:36:18.620111+0000","last_unstale":"2024-09-17T03:36:18.622390+0000","last_undegraded":"2024-09-17T03:36:18.622390+0000","last_fullsized":"2024-09-17T03:36:18.622390+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:45.896532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.602336+0000","last_change":"2024-09-17T03:36:18.601730+0000","last_active":"2024-09-17T03:36:18.602336+0000","last_peered":"2024-09-17T03:36:18.602336+0000","last_clean":"2024-09-17T03:36:18.602336+0000","last_became_active":"2024-09-17T03:36:18.601442+0000","last_became_peered":"2024-09-17T03:36:18.601442+0000","last_unstale":"2024-09-17T03:36:18.602336+0000","last_undegraded":"2024-09-17T03:36:18.602336+0000","last_fullsized":"2024-09-17T03:36:18.602336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:04.496122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620920+0000","last_change":"2024-09-17T03:36:18.617518+0000","last_active":"2024-09-17T03:36:18.620920+0000","last_peered":"2024-09-17T03:36:18.620920+0000","last_clean":"2024-09-17T03:36:18.620920+0000","last_became_active":"2024-09-17T03:36:18.617017+0000","last_became_peered":"2024-09-17T03:36:18.617017+0000","last_unstale":"2024-09-17T03:36:18.620920+0000","last_undegraded":"2024-09-17T03:36:18.620920+0000","last_fullsized":"2024-09-17T03:36:18.620920+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:43.171594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.618982+0000","last_change":"2024-09-17T03:36:18.611502+0000","last_active":"2024-09-17T03:36:18.618982+0000","last_peered":"2024-09-17T03:36:18.618982+0000","last_clean":"2024-09-17T03:36:18.618982+0000","last_became_active":"2024-09-17T03:36:18.611076+0000","last_became_peered":"2024-09-17T03:36:18.611076+0000","last_unstale":"2024-09-17T03:36:18.618982+0000","last_undegraded":"2024-09-17T03:36:18.618982+0000","last_fullsized":"2024-09-17T03:36:18.618982+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.201611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612835+0000","last_change":"2024-09-17T03:36:18.608871+0000","last_active":"2024-09-17T03:36:18.612835+0000","last_peered":"2024-09-17T03:36:18.612835+0000","last_clean":"2024-09-17T03:36:18.612835+0000","last_became_active":"2024-09-17T03:36:18.608525+0000","last_became_peered":"2024-09-17T03:36:18.608525+0000","last_unstale":"2024-09-17T03:36:18.612835+0000","last_undegraded":"2024-09-17T03:36:18.612835+0000","last_fullsized":"2024-09-17T03:36:18.612835+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:52.745381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612940+0000","last_change":"2024-09-17T03:36:18.607137+0000","last_active":"2024-09-17T03:36:18.612940+0000","last_peered":"2024-09-17T03:36:18.612940+0000","last_clean":"2024-09-17T03:36:18.612940+0000","last_became_active":"2024-09-17T03:36:18.606832+0000","last_became_peered":"2024-09-17T03:36:18.606832+0000","last_unstale":"2024-09-17T03:36:18.612940+0000","last_undegraded":"2024-09-17T03:36:18.612940+0000","last_fullsized":"2024-09-17T03:36:18.612940+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:23.498137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.614985+0000","last_change":"2024-09-17T03:36:18.606718+0000","last_active":"2024-09-17T03:36:18.614985+0000","last_peered":"2024-09-17T03:36:18.614985+0000","last_clean":"2024-09-17T03:36:18.614985+0000","last_became_active":"2024-09-17T03:36:18.606359+0000","last_became_peered":"2024-09-17T03:36:18.606359+0000","last_unstale":"2024-09-17T03:36:18.614985+0000","last_undegraded":"2024-09-17T03:36:18.614985+0000","last_fullsized":"2024-09-17T03:36:18.614985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:28.969026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619137+0000","last_change":"2024-09-17T03:36:18.609437+0000","last_active":"2024-09-17T03:36:18.619137+0000","last_peered":"2024-09-17T03:36:18.619137+0000","last_clean":"2024-09-17T03:36:18.619137+0000","last_became_active":"2024-09-17T03:36:18.609134+0000","last_became_peered":"2024-09-17T03:36:18.609134+0000","last_unstale":"2024-09-17T03:36:18.619137+0000","last_undegraded":"2024-09-17T03:36:18.619137+0000","last_fullsized":"2024-09-17T03:36:18.619137+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:17.878524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.618987+0000","last_change":"2024-09-17T03:36:18.614518+0000","last_active":"2024-09-17T03:36:18.618987+0000","last_peered":"2024-09-17T03:36:18.618987+0000","last_clean":"2024-09-17T03:36:18.618987+0000","last_became_active":"2024-09-17T03:36:18.614218+0000","last_became_peered":"2024-09-17T03:36:18.614218+0000","last_unstale":"2024-09-17T03:36:18.618987+0000","last_undegraded":"2024-09-17T03:36:18.618987+0000","last_fullsized":"2024-09-17T03:36:18.618987+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:48.495098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613398+0000","last_change":"2024-09-17T03:36:18.608914+0000","last_active":"2024-09-17T03:36:18.613398+0000","last_peered":"2024-09-17T03:36:18.613398+0000","last_clean":"2024-09-17T03:36:18.613398+0000","last_became_active":"2024-09-17T03:36:18.608524+0000","last_became_peered":"2024-09-17T03:36:18.608524+0000","last_unstale":"2024-09-17T03:36:18.613398+0000","last_undegraded":"2024-09-17T03:36:18.613398+0000","last_fullsized":"2024-09-17T03:36:18.613398+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:13.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620634+0000","last_change":"2024-09-17T03:36:18.616908+0000","last_active":"2024-09-17T03:36:18.620634+0000","last_peered":"2024-09-17T03:36:18.620634+0000","last_clean":"2024-09-17T03:36:18.620634+0000","last_became_active":"2024-09-17T03:36:18.616582+0000","last_became_peered":"2024-09-17T03:36:18.616582+0000","last_unstale":"2024-09-17T03:36:18.620634+0000","last_undegraded":"2024-09-17T03:36:18.620634+0000","last_fullsized":"2024-09-17T03:36:18.620634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:13.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.611420+0000","last_change":"2024-09-17T03:36:18.607199+0000","last_active":"2024-09-17T03:36:18.611420+0000","last_peered":"2024-09-17T03:36:18.611420+0000","last_clean":"2024-09-17T03:36:18.611420+0000","last_became_active":"2024-09-17T03:36:18.606912+0000","last_became_peered":"2024-09-17T03:36:18.606912+0000","last_unstale":"2024-09-17T03:36:18.611420+0000","last_undegraded":"2024-09-17T03:36:18.611420+0000","last_fullsized":"2024-09-17T03:36:18.611420+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:24.342808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628326+0000","last_change":"2024-09-17T03:36:18.623471+0000","last_active":"2024-09-17T03:36:18.628326+0000","last_peered":"2024-09-17T03:36:18.628326+0000","last_clean":"2024-09-17T03:36:18.628326+0000","last_became_active":"2024-09-17T03:36:18.622892+0000","last_became_peered":"2024-09-17T03:36:18.622892+0000","last_unstale":"2024-09-17T03:36:18.628326+0000","last_undegraded":"2024-09-17T03:36:18.628326+0000","last_fullsized":"2024-09-17T03:36:18.628326+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:28.096453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628199+0000","last_change":"2024-09-17T03:36:18.622572+0000","last_active":"2024-09-17T03:36:18.628199+0000","last_peered":"2024-09-17T03:36:18.628199+0000","last_clean":"2024-09-17T03:36:18.628199+0000","last_became_active":"2024-09-17T03:36:18.618178+0000","last_became_peered":"2024-09-17T03:36:18.618178+0000","last_unstale":"2024-09-17T03:36:18.628199+0000","last_undegraded":"2024-09-17T03:36:18.628199+0000","last_fullsized":"2024-09-17T03:36:18.628199+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:11.516431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.615066+0000","last_change":"2024-09-17T03:36:18.607221+0000","last_active":"2024-09-17T03:36:18.615066+0000","last_peered":"2024-09-17T03:36:18.615066+0000","last_clean":"2024-09-17T03:36:18.615066+0000","last_became_active":"2024-09-17T03:36:18.606526+0000","last_became_peered":"2024-09-17T03:36:18.606526+0000","last_unstale":"2024-09-17T03:36:18.615066+0000","last_undegraded":"2024-09-17T03:36:18.615066+0000","last_fullsized":"2024-09-17T03:36:18.615066+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:40.215862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.607883+0000","last_change":"2024-09-17T03:36:18.604164+0000","last_active":"2024-09-17T03:36:18.607883+0000","last_peered":"2024-09-17T03:36:18.607883+0000","last_clean":"2024-09-17T03:36:18.607883+0000","last_became_active":"2024-09-17T03:36:18.603876+0000","last_became_peered":"2024-09-17T03:36:18.603876+0000","last_unstale":"2024-09-17T03:36:18.607883+0000","last_undegraded":"2024-09-17T03:36:18.607883+0000","last_fullsized":"2024-09-17T03:36:18.607883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:54.083331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613350+0000","last_change":"2024-09-17T03:36:18.606583+0000","last_active":"2024-09-17T03:36:18.613350+0000","last_peered":"2024-09-17T03:36:18.613350+0000","last_clean":"2024-09-17T03:36:18.613350+0000","last_became_active":"2024-09-17T03:36:18.606264+0000","last_became_peered":"2024-09-17T03:36:18.606264+0000","last_unstale":"2024-09-17T03:36:18.613350+0000","last_undegraded":"2024-09-17T03:36:18.613350+0000","last_fullsized":"2024-09-17T03:36:18.613350+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:25.923247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622790+0000","last_change":"2024-09-17T03:36:18.621086+0000","last_active":"2024-09-17T03:36:18.622790+0000","last_peered":"2024-09-17T03:36:18.622790+0000","last_clean":"2024-09-17T03:36:18.622790+0000","last_became_active":"2024-09-17T03:36:18.620045+0000","last_became_peered":"2024-09-17T03:36:18.620045+0000","last_unstale":"2024-09-17T03:36:18.622790+0000","last_undegraded":"2024-09-17T03:36:18.622790+0000","last_fullsized":"2024-09-17T03:36:18.622790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:35.879493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620597+0000","last_change":"2024-09-17T03:36:18.619190+0000","last_active":"2024-09-17T03:36:18.620597+0000","last_peered":"2024-09-17T03:36:18.620597+0000","last_clean":"2024-09-17T03:36:18.620597+0000","last_became_active":"2024-09-17T03:36:18.618556+0000","last_became_peered":"2024-09-17T03:36:18.618556+0000","last_unstale":"2024-09-17T03:36:18.620597+0000","last_undegraded":"2024-09-17T03:36:18.620597+0000","last_fullsized":"2024-09-17T03:36:18.620597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.833899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601512+0000","last_change":"2024-09-17T03:36:18.600605+0000","last_active":"2024-09-17T03:36:18.601512+0000","last_peered":"2024-09-17T03:36:18.601512+0000","last_clean":"2024-09-17T03:36:18.601512+0000","last_became_active":"2024-09-17T03:36:18.600314+0000","last_became_peered":"2024-09-17T03:36:18.600314+0000","last_unstale":"2024-09-17T03:36:18.601512+0000","last_undegraded":"2024-09-17T03:36:18.601512+0000","last_fullsized":"2024-09-17T03:36:18.601512+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:19.575514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613424+0000","last_change":"2024-09-17T03:36:18.607175+0000","last_active":"2024-09-17T03:36:18.613424+0000","last_peered":"2024-09-17T03:36:18.613424+0000","last_clean":"2024-09-17T03:36:18.613424+0000","last_became_active":"2024-09-17T03:36:18.606339+0000","last_became_peered":"2024-09-17T03:36:18.606339+0000","last_unstale":"2024-09-17T03:36:18.613424+0000","last_undegraded":"2024-09-17T03:36:18.613424+0000","last_fullsized":"2024-09-17T03:36:18.613424+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:51.093115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623309+0000","last_change":"2024-09-17T03:36:18.622508+0000","last_active":"2024-09-17T03:36:18.623309+0000","last_peered":"2024-09-17T03:36:18.623309+0000","last_clean":"2024-09-17T03:36:18.623309+0000","last_became_active":"2024-09-17T03:36:18.622066+0000","last_became_peered":"2024-09-17T03:36:18.622066+0000","last_unstale":"2024-09-17T03:36:18.623309+0000","last_undegraded":"2024-09-17T03:36:18.623309+0000","last_fullsized":"2024-09-17T03:36:18.623309+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:20.384727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.630390+0000","last_change":"2024-09-17T03:36:17.585943+0000","last_active":"2024-09-17T03:36:18.630390+0000","last_peered":"2024-09-17T03:36:18.630390+0000","last_clean":"2024-09-17T03:36:18.630390+0000","last_became_active":"2024-09-17T03:36:17.585591+0000","last_became_peered":"2024-09-17T03:36:17.585591+0000","last_unstale":"2024-09-17T03:36:18.630390+0000","last_undegraded":"2024-09-17T03:36:18.630390+0000","last_fullsized":"2024-09-17T03:36:18.630390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:09.421144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622564+0000","last_change":"2024-09-17T03:36:18.620989+0000","last_active":"2024-09-17T03:36:18.622564+0000","last_peered":"2024-09-17T03:36:18.622564+0000","last_clean":"2024-09-17T03:36:18.622564+0000","last_became_active":"2024-09-17T03:36:18.620523+0000","last_became_peered":"2024-09-17T03:36:18.620523+0000","last_unstale":"2024-09-17T03:36:18.622564+0000","last_undegraded":"2024-09-17T03:36:18.622564+0000","last_fullsized":"2024-09-17T03:36:18.622564+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:04.316587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.578169+0000","last_change":"2024-09-17T03:36:16.578169+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.578169+0000","last_undegraded":"2024-09-17T03:36:16.578169+0000","last_fullsized":"2024-09-17T03:36:16.578169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613311+0000","last_change":"2024-09-17T03:36:18.608183+0000","last_active":"2024-09-17T03:36:18.613311+0000","last_peered":"2024-09-17T03:36:18.613311+0000","last_clean":"2024-09-17T03:36:18.613311+0000","last_became_active":"2024-09-17T03:36:18.607081+0000","last_became_peered":"2024-09-17T03:36:18.607081+0000","last_unstale":"2024-09-17T03:36:18.613311+0000","last_undegraded":"2024-09-17T03:36:18.613311+0000","last_fullsized":"2024-09-17T03:36:18.613311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:20.151030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628537+0000","last_change":"2024-09-17T03:36:17.586129+0000","last_active":"2024-09-17T03:36:18.628537+0000","last_peered":"2024-09-17T03:36:18.628537+0000","last_clean":"2024-09-17T03:36:18.628537+0000","last_became_active":"2024-09-17T03:36:17.585850+0000","last_became_peered":"2024-09-17T03:36:17.585850+0000","last_unstale":"2024-09-17T03:36:18.628537+0000","last_undegraded":"2024-09-17T03:36:18.628537+0000","last_fullsized":"2024-09-17T03:36:18.628537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:13.936211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623112+0000","last_change":"2024-09-17T03:36:18.620952+0000","last_active":"2024-09-17T03:36:18.623112+0000","last_peered":"2024-09-17T03:36:18.623112+0000","last_clean":"2024-09-17T03:36:18.623112+0000","last_became_active":"2024-09-17T03:36:18.620286+0000","last_became_peered":"2024-09-17T03:36:18.620286+0000","last_unstale":"2024-09-17T03:36:18.623112+0000","last_undegraded":"2024-09-17T03:36:18.623112+0000","last_fullsized":"2024-09-17T03:36:18.623112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:48.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576151+0000","last_change":"2024-09-17T03:36:16.576151+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576151+0000","last_undegraded":"2024-09-17T03:36:16.576151+0000","last_fullsized":"2024-09-17T03:36:16.576151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.631561+0000","last_change":"2024-09-17T03:36:17.585520+0000","last_active":"2024-09-17T03:36:18.631561+0000","last_peered":"2024-09-17T03:36:18.631561+0000","last_clean":"2024-09-17T03:36:18.631561+0000","last_became_active":"2024-09-17T03:36:17.585226+0000","last_became_peered":"2024-09-17T03:36:17.585226+0000","last_unstale":"2024-09-17T03:36:18.631561+0000","last_undegraded":"2024-09-17T03:36:18.631561+0000","last_fullsized":"2024-09-17T03:36:18.631561+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:48.714528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628298+0000","last_change":"2024-09-17T03:36:17.584532+0000","last_active":"2024-09-17T03:36:18.628298+0000","last_peered":"2024-09-17T03:36:18.628298+0000","last_clean":"2024-09-17T03:36:18.628298+0000","last_became_active":"2024-09-17T03:36:17.584217+0000","last_became_peered":"2024-09-17T03:36:17.584217+0000","last_unstale":"2024-09-17T03:36:18.628298+0000","last_undegraded":"2024-09-17T03:36:18.628298+0000","last_fullsized":"2024-09-17T03:36:18.628298+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:49.597521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619975+0000","last_change":"2024-09-17T03:36:18.617026+0000","last_active":"2024-09-17T03:36:18.619975+0000","last_peered":"2024-09-17T03:36:18.619975+0000","last_clean":"2024-09-17T03:36:18.619975+0000","last_became_active":"2024-09-17T03:36:18.616713+0000","last_became_peered":"2024-09-17T03:36:18.616713+0000","last_unstale":"2024-09-17T03:36:18.619975+0000","last_undegraded":"2024-09-17T03:36:18.619975+0000","last_fullsized":"2024-09-17T03:36:18.619975+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:04.592223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576263+0000","last_change":"2024-09-17T03:36:16.576263+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576263+0000","last_undegraded":"2024-09-17T03:36:16.576263+0000","last_fullsized":"2024-09-17T03:36:16.576263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601290+0000","last_change":"2024-09-17T03:36:17.595365+0000","last_active":"2024-09-17T03:36:18.601290+0000","last_peered":"2024-09-17T03:36:18.601290+0000","last_clean":"2024-09-17T03:36:18.601290+0000","last_became_active":"2024-09-17T03:36:17.595025+0000","last_became_peered":"2024-09-17T03:36:17.595025+0000","last_unstale":"2024-09-17T03:36:18.601290+0000","last_undegraded":"2024-09-17T03:36:18.601290+0000","last_fullsized":"2024-09-17T03:36:18.601290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:44.064718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619111+0000","last_change":"2024-09-17T03:36:18.613594+0000","last_active":"2024-09-17T03:36:18.619111+0000","last_peered":"2024-09-17T03:36:18.619111+0000","last_clean":"2024-09-17T03:36:18.619111+0000","last_became_active":"2024-09-17T03:36:18.613277+0000","last_became_peered":"2024-09-17T03:36:18.613277+0000","last_unstale":"2024-09-17T03:36:18.619111+0000","last_undegraded":"2024-09-17T03:36:18.619111+0000","last_fullsized":"2024-09-17T03:36:18.619111+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:52.293464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.610739+0000","last_change":"2024-09-17T03:36:17.595227+0000","last_active":"2024-09-17T03:36:18.610739+0000","last_peered":"2024-09-17T03:36:18.610739+0000","last_clean":"2024-09-17T03:36:18.610739+0000","last_became_active":"2024-09-17T03:36:17.594734+0000","last_became_peered":"2024-09-17T03:36:17.594734+0000","last_unstale":"2024-09-17T03:36:18.610739+0000","last_undegraded":"2024-09-17T03:36:18.610739+0000","last_fullsized":"2024-09-17T03:36:18.610739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:19.145953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.621716+0000","last_change":"2024-09-17T03:36:18.617682+0000","last_active":"2024-09-17T03:36:18.621716+0000","last_peered":"2024-09-17T03:36:18.621716+0000","last_clean":"2024-09-17T03:36:18.621716+0000","last_became_active":"2024-09-17T03:36:18.617304+0000","last_became_peered":"2024-09-17T03:36:18.617304+0000","last_unstale":"2024-09-17T03:36:18.621716+0000","last_undegraded":"2024-09-17T03:36:18.621716+0000","last_fullsized":"2024-09-17T03:36:18.621716+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:36.010214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.577512+0000","last_change":"2024-09-17T03:36:16.577512+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.577512+0000","last_undegraded":"2024-09-17T03:36:16.577512+0000","last_fullsized":"2024-09-17T03:36:16.577512+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612891+0000","last_change":"2024-09-17T03:36:18.605255+0000","last_active":"2024-09-17T03:36:18.612891+0000","last_peered":"2024-09-17T03:36:18.612891+0000","last_clean":"2024-09-17T03:36:18.612891+0000","last_became_active":"2024-09-17T03:36:18.604989+0000","last_became_peered":"2024-09-17T03:36:18.604989+0000","last_unstale":"2024-09-17T03:36:18.612891+0000","last_undegraded":"2024-09-17T03:36:18.612891+0000","last_fullsized":"2024-09-17T03:36:18.612891+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:09.275600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.631749+0000","last_change":"2024-09-17T03:36:17.590026+0000","last_active":"2024-09-17T03:36:18.631749+0000","last_peered":"2024-09-17T03:36:18.631749+0000","last_clean":"2024-09-17T03:36:18.631749+0000","last_became_active":"2024-09-17T03:36:17.589545+0000","last_became_peered":"2024-09-17T03:36:17.589545+0000","last_unstale":"2024-09-17T03:36:18.631749+0000","last_undegraded":"2024-09-17T03:36:18.631749+0000","last_fullsized":"2024-09-17T03:36:18.631749+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:50.088038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628375+0000","last_change":"2024-09-17T03:36:18.621917+0000","last_active":"2024-09-17T03:36:18.628375+0000","last_peered":"2024-09-17T03:36:18.628375+0000","last_clean":"2024-09-17T03:36:18.628375+0000","last_became_active":"2024-09-17T03:36:18.621591+0000","last_became_peered":"2024-09-17T03:36:18.621591+0000","last_unstale":"2024-09-17T03:36:18.628375+0000","last_undegraded":"2024-09-17T03:36:18.628375+0000","last_fullsized":"2024-09-17T03:36:18.628375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:48.539605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.634430+0000","last_change":"2024-09-17T03:36:17.585567+0000","last_active":"2024-09-17T03:36:18.634430+0000","last_peered":"2024-09-17T03:36:18.634430+0000","last_clean":"2024-09-17T03:36:18.634430+0000","last_became_active":"2024-09-17T03:36:17.584661+0000","last_became_peered":"2024-09-17T03:36:17.584661+0000","last_unstale":"2024-09-17T03:36:18.634430+0000","last_undegraded":"2024-09-17T03:36:18.634430+0000","last_fullsized":"2024-09-17T03:36:18.634430+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:48.556283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.577486+0000","last_change":"2024-09-17T03:36:16.577486+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.577486+0000","last_undegraded":"2024-09-17T03:36:16.577486+0000","last_fullsized":"2024-09-17T03:36:16.577486+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628308+0000","last_change":"2024-09-17T03:36:18.623279+0000","last_active":"2024-09-17T03:36:18.628308+0000","last_peered":"2024-09-17T03:36:18.628308+0000","last_clean":"2024-09-17T03:36:18.628308+0000","last_became_active":"2024-09-17T03:36:18.622907+0000","last_became_peered":"2024-09-17T03:36:18.622907+0000","last_unstale":"2024-09-17T03:36:18.628308+0000","last_undegraded":"2024-09-17T03:36:18.628308+0000","last_fullsized":"2024-09-17T03:36:18.628308+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:49.263474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604610+0000","last_change":"2024-09-17T03:36:17.582775+0000","last_active":"2024-09-17T03:36:18.604610+0000","last_peered":"2024-09-17T03:36:18.604610+0000","last_clean":"2024-09-17T03:36:18.604610+0000","last_became_active":"2024-09-17T03:36:17.582451+0000","last_became_peered":"2024-09-17T03:36:17.582451+0000","last_unstale":"2024-09-17T03:36:18.604610+0000","last_undegraded":"2024-09-17T03:36:18.604610+0000","last_fullsized":"2024-09-17T03:36:18.604610+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:55.225494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620916+0000","last_change":"2024-09-17T03:36:18.617154+0000","last_active":"2024-09-17T03:36:18.620916+0000","last_peered":"2024-09-17T03:36:18.620916+0000","last_clean":"2024-09-17T03:36:18.620916+0000","last_became_active":"2024-09-17T03:36:18.616817+0000","last_became_peered":"2024-09-17T03:36:18.616817+0000","last_unstale":"2024-09-17T03:36:18.620916+0000","last_undegraded":"2024-09-17T03:36:18.620916+0000","last_fullsized":"2024-09-17T03:36:18.620916+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:22.975493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575434+0000","last_change":"2024-09-17T03:36:16.575434+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575434+0000","last_undegraded":"2024-09-17T03:36:16.575434+0000","last_fullsized":"2024-09-17T03:36:16.575434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623796+0000","last_change":"2024-09-17T03:36:18.620650+0000","last_active":"2024-09-17T03:36:18.623796+0000","last_peered":"2024-09-17T03:36:18.623796+0000","last_clean":"2024-09-17T03:36:18.623796+0000","last_became_active":"2024-09-17T03:36:18.617859+0000","last_became_peered":"2024-09-17T03:36:18.617859+0000","last_unstale":"2024-09-17T03:36:18.623796+0000","last_undegraded":"2024-09-17T03:36:18.623796+0000","last_fullsized":"2024-09-17T03:36:18.623796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:01.225617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.634663+0000","last_change":"2024-09-17T03:36:17.586177+0000","last_active":"2024-09-17T03:36:18.634663+0000","last_peered":"2024-09-17T03:36:18.634663+0000","last_clean":"2024-09-17T03:36:18.634663+0000","last_became_active":"2024-09-17T03:36:17.585819+0000","last_became_peered":"2024-09-17T03:36:17.585819+0000","last_unstale":"2024-09-17T03:36:18.634663+0000","last_undegraded":"2024-09-17T03:36:18.634663+0000","last_fullsized":"2024-09-17T03:36:18.634663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:24.918171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.627961+0000","last_change":"2024-09-17T03:36:18.622200+0000","last_active":"2024-09-17T03:36:18.627961+0000","last_peered":"2024-09-17T03:36:18.627961+0000","last_clean":"2024-09-17T03:36:18.627961+0000","last_became_active":"2024-09-17T03:36:18.621839+0000","last_became_peered":"2024-09-17T03:36:18.621839+0000","last_unstale":"2024-09-17T03:36:18.627961+0000","last_undegraded":"2024-09-17T03:36:18.627961+0000","last_fullsized":"2024-09-17T03:36:18.627961+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:44.384105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576728+0000","last_change":"2024-09-17T03:36:16.576728+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576728+0000","last_undegraded":"2024-09-17T03:36:16.576728+0000","last_fullsized":"2024-09-17T03:36:16.576728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628263+0000","last_change":"2024-09-17T03:36:17.590872+0000","last_active":"2024-09-17T03:36:18.628263+0000","last_peered":"2024-09-17T03:36:18.628263+0000","last_clean":"2024-09-17T03:36:18.628263+0000","last_became_active":"2024-09-17T03:36:17.590501+0000","last_became_peered":"2024-09-17T03:36:17.590501+0000","last_unstale":"2024-09-17T03:36:18.628263+0000","last_undegraded":"2024-09-17T03:36:18.628263+0000","last_fullsized":"2024-09-17T03:36:18.628263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:28.794329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575557+0000","last_change":"2024-09-17T03:36:16.575557+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575557+0000","last_undegraded":"2024-09-17T03:36:16.575557+0000","last_fullsized":"2024-09-17T03:36:16.575557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.621198+0000","last_change":"2024-09-17T03:36:18.618941+0000","last_active":"2024-09-17T03:36:18.621198+0000","last_peered":"2024-09-17T03:36:18.621198+0000","last_clean":"2024-09-17T03:36:18.621198+0000","last_became_active":"2024-09-17T03:36:18.618611+0000","last_became_peered":"2024-09-17T03:36:18.618611+0000","last_unstale":"2024-09-17T03:36:18.621198+0000","last_undegraded":"2024-09-17T03:36:18.621198+0000","last_fullsized":"2024-09-17T03:36:18.621198+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:48.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601821+0000","last_change":"2024-09-17T03:36:17.595452+0000","last_active":"2024-09-17T03:36:18.601821+0000","last_peered":"2024-09-17T03:36:18.601821+0000","last_clean":"2024-09-17T03:36:18.601821+0000","last_became_active":"2024-09-17T03:36:17.595094+0000","last_became_peered":"2024-09-17T03:36:17.595094+0000","last_unstale":"2024-09-17T03:36:18.601821+0000","last_undegraded":"2024-09-17T03:36:18.601821+0000","last_fullsized":"2024-09-17T03:36:18.601821+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:12.654766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576728+0000","last_change":"2024-09-17T03:36:16.576728+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576728+0000","last_undegraded":"2024-09-17T03:36:16.576728+0000","last_fullsized":"2024-09-17T03:36:16.576728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.615017+0000","last_change":"2024-09-17T03:36:18.610121+0000","last_active":"2024-09-17T03:36:18.615017+0000","last_peered":"2024-09-17T03:36:18.615017+0000","last_clean":"2024-09-17T03:36:18.615017+0000","last_became_active":"2024-09-17T03:36:18.606903+0000","last_became_peered":"2024-09-17T03:36:18.606903+0000","last_unstale":"2024-09-17T03:36:18.615017+0000","last_undegraded":"2024-09-17T03:36:18.615017+0000","last_fullsized":"2024-09-17T03:36:18.615017+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:36.010214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593684+0000","last_change":"2024-09-17T03:36:17.588176+0000","last_active":"2024-09-17T03:36:18.593684+0000","last_peered":"2024-09-17T03:36:18.593684+0000","last_clean":"2024-09-17T03:36:18.593684+0000","last_became_active":"2024-09-17T03:36:17.587563+0000","last_became_peered":"2024-09-17T03:36:17.587563+0000","last_unstale":"2024-09-17T03:36:18.593684+0000","last_undegraded":"2024-09-17T03:36:18.593684+0000","last_fullsized":"2024-09-17T03:36:18.593684+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:27.963949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623117+0000","last_change":"2024-09-17T03:36:18.622275+0000","last_active":"2024-09-17T03:36:18.623117+0000","last_peered":"2024-09-17T03:36:18.623117+0000","last_clean":"2024-09-17T03:36:18.623117+0000","last_became_active":"2024-09-17T03:36:18.621983+0000","last_became_peered":"2024-09-17T03:36:18.621983+0000","last_unstale":"2024-09-17T03:36:18.623117+0000","last_undegraded":"2024-09-17T03:36:18.623117+0000","last_fullsized":"2024-09-17T03:36:18.623117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:01.225617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575452+0000","last_change":"2024-09-17T03:36:16.575452+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575452+0000","last_undegraded":"2024-09-17T03:36:16.575452+0000","last_fullsized":"2024-09-17T03:36:16.575452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.629109+0000","last_change":"2024-09-17T03:36:17.594225+0000","last_active":"2024-09-17T03:36:18.629109+0000","last_peered":"2024-09-17T03:36:18.629109+0000","last_clean":"2024-09-17T03:36:18.629109+0000","last_became_active":"2024-09-17T03:36:17.593916+0000","last_became_peered":"2024-09-17T03:36:17.593916+0000","last_unstale":"2024-09-17T03:36:18.629109+0000","last_undegraded":"2024-09-17T03:36:18.629109+0000","last_fullsized":"2024-09-17T03:36:18.629109+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:03.587147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.599453+0000","last_change":"2024-09-17T03:36:17.589681+0000","last_active":"2024-09-17T03:36:18.599453+0000","last_peered":"2024-09-17T03:36:18.599453+0000","last_clean":"2024-09-17T03:36:18.599453+0000","last_became_active":"2024-09-17T03:36:17.582742+0000","last_became_peered":"2024-09-17T03:36:17.582742+0000","last_unstale":"2024-09-17T03:36:18.599453+0000","last_undegraded":"2024-09-17T03:36:18.599453+0000","last_fullsized":"2024-09-17T03:36:18.599453+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:34.514226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612864+0000","last_change":"2024-09-17T03:36:18.604528+0000","last_active":"2024-09-17T03:36:18.612864+0000","last_peered":"2024-09-17T03:36:18.612864+0000","last_clean":"2024-09-17T03:36:18.612864+0000","last_became_active":"2024-09-17T03:36:18.604264+0000","last_became_peered":"2024-09-17T03:36:18.604264+0000","last_unstale":"2024-09-17T03:36:18.612864+0000","last_undegraded":"2024-09-17T03:36:18.612864+0000","last_fullsized":"2024-09-17T03:36:18.612864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:08.252388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604689+0000","last_change":"2024-09-17T03:36:17.580793+0000","last_active":"2024-09-17T03:36:18.604689+0000","last_peered":"2024-09-17T03:36:18.604689+0000","last_clean":"2024-09-17T03:36:18.604689+0000","last_became_active":"2024-09-17T03:36:17.580470+0000","last_became_peered":"2024-09-17T03:36:17.580470+0000","last_unstale":"2024-09-17T03:36:18.604689+0000","last_undegraded":"2024-09-17T03:36:18.604689+0000","last_fullsized":"2024-09-17T03:36:18.604689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:25.063641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622663+0000","last_change":"2024-09-17T03:36:18.621036+0000","last_active":"2024-09-17T03:36:18.622663+0000","last_peered":"2024-09-17T03:36:18.622663+0000","last_clean":"2024-09-17T03:36:18.622663+0000","last_became_active":"2024-09-17T03:36:18.620667+0000","last_became_peered":"2024-09-17T03:36:18.620667+0000","last_unstale":"2024-09-17T03:36:18.622663+0000","last_undegraded":"2024-09-17T03:36:18.622663+0000","last_fullsized":"2024-09-17T03:36:18.622663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.833899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575534+0000","last_change":"2024-09-17T03:36:16.575534+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575534+0000","last_undegraded":"2024-09-17T03:36:16.575534+0000","last_fullsized":"2024-09-17T03:36:16.575534+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593735+0000","last_change":"2024-09-17T03:36:17.587591+0000","last_active":"2024-09-17T03:36:18.593735+0000","last_peered":"2024-09-17T03:36:18.593735+0000","last_clean":"2024-09-17T03:36:18.593735+0000","last_became_active":"2024-09-17T03:36:17.586959+0000","last_became_peered":"2024-09-17T03:36:17.586959+0000","last_unstale":"2024-09-17T03:36:18.593735+0000","last_undegraded":"2024-09-17T03:36:18.593735+0000","last_fullsized":"2024-09-17T03:36:18.593735+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:39.210785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628007+0000","last_change":"2024-09-17T03:36:18.622306+0000","last_active":"2024-09-17T03:36:18.628007+0000","last_peered":"2024-09-17T03:36:18.628007+0000","last_clean":"2024-09-17T03:36:18.628007+0000","last_became_active":"2024-09-17T03:36:18.619448+0000","last_became_peered":"2024-09-17T03:36:18.619448+0000","last_unstale":"2024-09-17T03:36:18.628007+0000","last_undegraded":"2024-09-17T03:36:18.628007+0000","last_fullsized":"2024-09-17T03:36:18.628007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:58.826782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.603333+0000","last_change":"2024-09-17T03:36:17.578097+0000","last_active":"2024-09-17T03:36:18.603333+0000","last_peered":"2024-09-17T03:36:18.603333+0000","last_clean":"2024-09-17T03:36:18.603333+0000","last_became_active":"2024-09-17T03:36:17.577678+0000","last_became_peered":"2024-09-17T03:36:17.577678+0000","last_unstale":"2024-09-17T03:36:18.603333+0000","last_undegraded":"2024-09-17T03:36:18.603333+0000","last_fullsized":"2024-09-17T03:36:18.603333+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:16.042540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613221+0000","last_change":"2024-09-17T03:36:18.609081+0000","last_active":"2024-09-17T03:36:18.613221+0000","last_peered":"2024-09-17T03:36:18.613221+0000","last_clean":"2024-09-17T03:36:18.613221+0000","last_became_active":"2024-09-17T03:36:18.608778+0000","last_became_peered":"2024-09-17T03:36:18.608778+0000","last_unstale":"2024-09-17T03:36:18.613221+0000","last_undegraded":"2024-09-17T03:36:18.613221+0000","last_fullsized":"2024-09-17T03:36:18.613221+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:10.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593669+0000","last_change":"2024-09-17T03:36:17.595198+0000","last_active":"2024-09-17T03:36:18.593669+0000","last_peered":"2024-09-17T03:36:18.593669+0000","last_clean":"2024-09-17T03:36:18.593669+0000","last_became_active":"2024-09-17T03:36:17.594848+0000","last_became_peered":"2024-09-17T03:36:17.594848+0000","last_unstale":"2024-09-17T03:36:18.593669+0000","last_undegraded":"2024-09-17T03:36:18.593669+0000","last_fullsized":"2024-09-17T03:36:18.593669+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.483843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576072+0000","last_change":"2024-09-17T03:36:16.576072+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576072+0000","last_undegraded":"2024-09-17T03:36:16.576072+0000","last_fullsized":"2024-09-17T03:36:16.576072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604804+0000","last_change":"2024-09-17T03:36:17.587385+0000","last_active":"2024-09-17T03:36:18.604804+0000","last_peered":"2024-09-17T03:36:18.604804+0000","last_clean":"2024-09-17T03:36:18.604804+0000","last_became_active":"2024-09-17T03:36:17.586929+0000","last_became_peered":"2024-09-17T03:36:17.586929+0000","last_unstale":"2024-09-17T03:36:18.604804+0000","last_undegraded":"2024-09-17T03:36:18.604804+0000","last_fullsized":"2024-09-17T03:36:18.604804+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.483843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":178,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.608022+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:36:18.608022+0000","last_peered":"2024-09-17T03:36:18.608022+0000","last_clean":"2024-09-17T03:36:18.608022+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:36:18.608022+0000","last_undegraded":"2024-09-17T03:36:18.608022+0000","last_fullsized":"2024-09-17T03:36:18.608022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2284,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36604,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335236,"statfs":{"total":96636764160,"available":96599281664,"internally_reserved":0,"allocated":1277952,"data_stored":871058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":675840,"data_stored":280530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40188,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331652,"statfs":{"total":96636764160,"available":96595611648,"internally_reserved":0,"allocated":688128,"data_stored":282142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36024,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335816,"statfs":{"total":96636764160,"available":96599875584,"internally_reserved":0,"allocated":684032,"data_stored":280586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":679936,"data_stored":280620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":873092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":267488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":267488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:21.972 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:22.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.122+0000 7fb8ac084640 1 -- 172.21.15.146:0/732649783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb88c004800 msgr2=0x7fb88c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.122+0000 7fb8ac084640 1 --2- 172.21.15.146:0/732649783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb88c004800 0x7fb88c004c10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb89800c3c0 tx=0x7fb88c005830 comp rx=0 tx=0).stop 2024-09-17T03:36:22.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.122+0000 7fb8aa621640 1 -- 172.21.15.146:0/732649783 reap_dead start 2024-09-17T03:36:22.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.122+0000 7fb8ac084640 1 -- 172.21.15.146:0/732649783 shutdown_connections 2024-09-17T03:36:22.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.122+0000 7fb8ac084640 1 -- 172.21.15.146:0/732649783 >> 172.21.15.146:0/732649783 conn(0x7fb8a40b2060 msgr2=0x7fb8a40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:22.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.122+0000 7fb8ac084640 1 -- 172.21.15.146:0/732649783 shutdown_connections 2024-09-17T03:36:22.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.123+0000 7fb8ac084640 1 -- 172.21.15.146:0/732649783 wait complete. 2024-09-17T03:36:22.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.124+0000 7fb8ac084640 1 Processor -- start 2024-09-17T03:36:22.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.124+0000 7fb8ac084640 1 -- start start 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.125+0000 7fb8ac084640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c004800 0x7fb8a415e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.125+0000 7fb8ac084640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8a41f84e0 0x7fb8a41e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8ac084640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a4152da0 0x7fb8a41f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8ac084640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a40b4c00 con 0x7fb8a4152da0 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8ac084640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a40b4a80 con 0x7fb8a41f84e0 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8ac084640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a40b4d80 con 0x7fb88c004800 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8aa621640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a4152da0 0x7fb8a41f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8aa621640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a4152da0 0x7fb8a41f56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48146/0 (socket says 172.21.15.146:48146) 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8aa621640 1 -- 172.21.15.146:0/3830644733 learned_addr learned my addr 172.21.15.146:0/3830644733 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8a961f640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8a41f84e0 0x7fb8a41e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8a9e20640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c004800 0x7fb8a415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8aa621640 1 -- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c004800 msgr2=0x7fb8a415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8aa621640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c004800 0x7fb8a415e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8aa621640 1 -- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8a41f84e0 msgr2=0x7fb8a41e3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8aa621640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8a41f84e0 0x7fb8a41e3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8aa621640 1 -- 172.21.15.146:0/3830644733 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a41e44a0 con 0x7fb8a4152da0 2024-09-17T03:36:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8aa621640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a4152da0 0x7fb8a41f56d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40b2cc0 tx=0x7fb89c001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8a27fc640 1 -- 172.21.15.146:0/3830644733 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c011630 con 0x7fb8a4152da0 2024-09-17T03:36:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8a27fc640 1 -- 172.21.15.146:0/3830644733 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb89c001d30 con 0x7fb8a4152da0 2024-09-17T03:36:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8ac084640 1 -- 172.21.15.146:0/3830644733 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a41f4ef0 con 0x7fb8a4152da0 2024-09-17T03:36:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8a27fc640 1 -- 172.21.15.146:0/3830644733 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c011a90 con 0x7fb8a4152da0 2024-09-17T03:36:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.126+0000 7fb8ac084640 1 -- 172.21.15.146:0/3830644733 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a41f8f30 con 0x7fb8a4152da0 2024-09-17T03:36:22.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.127+0000 7fb8ac084640 1 -- 172.21.15.146:0/3830644733 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a41f89c0 con 0x7fb8a4152da0 2024-09-17T03:36:22.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.128+0000 7fb8a27fc640 1 -- 172.21.15.146:0/3830644733 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb89c011c30 con 0x7fb8a4152da0 2024-09-17T03:36:22.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.129+0000 7fb8a27fc640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb890078b90 0x7fb89007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.129+0000 7fb8a27fc640 1 -- 172.21.15.146:0/3830644733 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fb89c09b560 con 0x7fb8a4152da0 2024-09-17T03:36:22.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.129+0000 7fb8a9e20640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb890078b90 0x7fb89007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.129+0000 7fb8a9e20640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb890078b90 0x7fb89007b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb894005fd0 tx=0x7fb894009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:22.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.133+0000 7fb8a27fc640 1 -- 172.21.15.146:0/3830644733 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb89c063a30 con 0x7fb8a4152da0 2024-09-17T03:36:22.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.305+0000 7fb8ac084640 1 -- 172.21.15.146:0/3830644733 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8a40b46b0 con 0x7fb890078b90 2024-09-17T03:36:22.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.310+0000 7fb8a27fc640 1 -- 172.21.15.146:0/3830644733 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248070 (secure 0 0 0) 0x7fb8a40b46b0 con 0x7fb890078b90 2024-09-17T03:36:22.312 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:22.313 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:36:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.312+0000 7fb8ac084640 1 -- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb890078b90 msgr2=0x7fb89007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.312+0000 7fb8ac084640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb890078b90 0x7fb89007b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb894005fd0 tx=0x7fb894009500 comp rx=0 tx=0).stop 2024-09-17T03:36:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.312+0000 7fb8ac084640 1 -- 172.21.15.146:0/3830644733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a4152da0 msgr2=0x7fb8a41f56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.312+0000 7fb8ac084640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a4152da0 0x7fb8a41f56d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40b2cc0 tx=0x7fb89c001730 comp rx=0 tx=0).stop 2024-09-17T03:36:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.312+0000 7fb8ac084640 1 -- 172.21.15.146:0/3830644733 shutdown_connections 2024-09-17T03:36:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.312+0000 7fb8ac084640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb890078b90 0x7fb89007b0a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.312+0000 7fb8ac084640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8a4152da0 0x7fb8a41f56d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.312+0000 7fb8ac084640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8a41f84e0 0x7fb8a41e3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.312+0000 7fb8ac084640 1 --2- 172.21.15.146:0/3830644733 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb88c004800 0x7fb8a415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.312+0000 7fb8ac084640 1 -- 172.21.15.146:0/3830644733 >> 172.21.15.146:0/3830644733 conn(0x7fb8a40b2060 msgr2=0x7fb8a40cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:22.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.313+0000 7fb8ac084640 1 -- 172.21.15.146:0/3830644733 shutdown_connections 2024-09-17T03:36:22.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.313+0000 7fb8ac084640 1 -- 172.21.15.146:0/3830644733 wait complete. 2024-09-17T03:36:22.324 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-17T03:36:21.840418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592652,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":136,"num_write_kb":1633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289252,"kb_used_data":6440,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685468,"statfs":{"total":773094113280,"available":772797919232,"internally_reserved":0,"allocated":6594560,"data_stored":3403004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":289394225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2284,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.271619"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613350+0000","last_change":"2024-09-17T03:36:18.607189+0000","last_active":"2024-09-17T03:36:18.613350+0000","last_peered":"2024-09-17T03:36:18.613350+0000","last_clean":"2024-09-17T03:36:18.613350+0000","last_became_active":"2024-09-17T03:36:18.606849+0000","last_became_peered":"2024-09-17T03:36:18.606849+0000","last_unstale":"2024-09-17T03:36:18.613350+0000","last_undegraded":"2024-09-17T03:36:18.613350+0000","last_fullsized":"2024-09-17T03:36:18.613350+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:17.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628270+0000","last_change":"2024-09-17T03:36:18.621325+0000","last_active":"2024-09-17T03:36:18.628270+0000","last_peered":"2024-09-17T03:36:18.628270+0000","last_clean":"2024-09-17T03:36:18.628270+0000","last_became_active":"2024-09-17T03:36:18.621005+0000","last_became_peered":"2024-09-17T03:36:18.621005+0000","last_unstale":"2024-09-17T03:36:18.628270+0000","last_undegraded":"2024-09-17T03:36:18.628270+0000","last_fullsized":"2024-09-17T03:36:18.628270+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:20.384727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622390+0000","last_change":"2024-09-17T03:36:18.620461+0000","last_active":"2024-09-17T03:36:18.622390+0000","last_peered":"2024-09-17T03:36:18.622390+0000","last_clean":"2024-09-17T03:36:18.622390+0000","last_became_active":"2024-09-17T03:36:18.620111+0000","last_became_peered":"2024-09-17T03:36:18.620111+0000","last_unstale":"2024-09-17T03:36:18.622390+0000","last_undegraded":"2024-09-17T03:36:18.622390+0000","last_fullsized":"2024-09-17T03:36:18.622390+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:45.896532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.602336+0000","last_change":"2024-09-17T03:36:18.601730+0000","last_active":"2024-09-17T03:36:18.602336+0000","last_peered":"2024-09-17T03:36:18.602336+0000","last_clean":"2024-09-17T03:36:18.602336+0000","last_became_active":"2024-09-17T03:36:18.601442+0000","last_became_peered":"2024-09-17T03:36:18.601442+0000","last_unstale":"2024-09-17T03:36:18.602336+0000","last_undegraded":"2024-09-17T03:36:18.602336+0000","last_fullsized":"2024-09-17T03:36:18.602336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:04.496122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620920+0000","last_change":"2024-09-17T03:36:18.617518+0000","last_active":"2024-09-17T03:36:18.620920+0000","last_peered":"2024-09-17T03:36:18.620920+0000","last_clean":"2024-09-17T03:36:18.620920+0000","last_became_active":"2024-09-17T03:36:18.617017+0000","last_became_peered":"2024-09-17T03:36:18.617017+0000","last_unstale":"2024-09-17T03:36:18.620920+0000","last_undegraded":"2024-09-17T03:36:18.620920+0000","last_fullsized":"2024-09-17T03:36:18.620920+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:43.171594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.618982+0000","last_change":"2024-09-17T03:36:18.611502+0000","last_active":"2024-09-17T03:36:18.618982+0000","last_peered":"2024-09-17T03:36:18.618982+0000","last_clean":"2024-09-17T03:36:18.618982+0000","last_became_active":"2024-09-17T03:36:18.611076+0000","last_became_peered":"2024-09-17T03:36:18.611076+0000","last_unstale":"2024-09-17T03:36:18.618982+0000","last_undegraded":"2024-09-17T03:36:18.618982+0000","last_fullsized":"2024-09-17T03:36:18.618982+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.201611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612835+0000","last_change":"2024-09-17T03:36:18.608871+0000","last_active":"2024-09-17T03:36:18.612835+0000","last_peered":"2024-09-17T03:36:18.612835+0000","last_clean":"2024-09-17T03:36:18.612835+0000","last_became_active":"2024-09-17T03:36:18.608525+0000","last_became_peered":"2024-09-17T03:36:18.608525+0000","last_unstale":"2024-09-17T03:36:18.612835+0000","last_undegraded":"2024-09-17T03:36:18.612835+0000","last_fullsized":"2024-09-17T03:36:18.612835+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:52.745381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612940+0000","last_change":"2024-09-17T03:36:18.607137+0000","last_active":"2024-09-17T03:36:18.612940+0000","last_peered":"2024-09-17T03:36:18.612940+0000","last_clean":"2024-09-17T03:36:18.612940+0000","last_became_active":"2024-09-17T03:36:18.606832+0000","last_became_peered":"2024-09-17T03:36:18.606832+0000","last_unstale":"2024-09-17T03:36:18.612940+0000","last_undegraded":"2024-09-17T03:36:18.612940+0000","last_fullsized":"2024-09-17T03:36:18.612940+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:23.498137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.614985+0000","last_change":"2024-09-17T03:36:18.606718+0000","last_active":"2024-09-17T03:36:18.614985+0000","last_peered":"2024-09-17T03:36:18.614985+0000","last_clean":"2024-09-17T03:36:18.614985+0000","last_became_active":"2024-09-17T03:36:18.606359+0000","last_became_peered":"2024-09-17T03:36:18.606359+0000","last_unstale":"2024-09-17T03:36:18.614985+0000","last_undegraded":"2024-09-17T03:36:18.614985+0000","last_fullsized":"2024-09-17T03:36:18.614985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:28.969026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619137+0000","last_change":"2024-09-17T03:36:18.609437+0000","last_active":"2024-09-17T03:36:18.619137+0000","last_peered":"2024-09-17T03:36:18.619137+0000","last_clean":"2024-09-17T03:36:18.619137+0000","last_became_active":"2024-09-17T03:36:18.609134+0000","last_became_peered":"2024-09-17T03:36:18.609134+0000","last_unstale":"2024-09-17T03:36:18.619137+0000","last_undegraded":"2024-09-17T03:36:18.619137+0000","last_fullsized":"2024-09-17T03:36:18.619137+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:17.878524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.618987+0000","last_change":"2024-09-17T03:36:18.614518+0000","last_active":"2024-09-17T03:36:18.618987+0000","last_peered":"2024-09-17T03:36:18.618987+0000","last_clean":"2024-09-17T03:36:18.618987+0000","last_became_active":"2024-09-17T03:36:18.614218+0000","last_became_peered":"2024-09-17T03:36:18.614218+0000","last_unstale":"2024-09-17T03:36:18.618987+0000","last_undegraded":"2024-09-17T03:36:18.618987+0000","last_fullsized":"2024-09-17T03:36:18.618987+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:48.495098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613398+0000","last_change":"2024-09-17T03:36:18.608914+0000","last_active":"2024-09-17T03:36:18.613398+0000","last_peered":"2024-09-17T03:36:18.613398+0000","last_clean":"2024-09-17T03:36:18.613398+0000","last_became_active":"2024-09-17T03:36:18.608524+0000","last_became_peered":"2024-09-17T03:36:18.608524+0000","last_unstale":"2024-09-17T03:36:18.613398+0000","last_undegraded":"2024-09-17T03:36:18.613398+0000","last_fullsized":"2024-09-17T03:36:18.613398+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:13.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620634+0000","last_change":"2024-09-17T03:36:18.616908+0000","last_active":"2024-09-17T03:36:18.620634+0000","last_peered":"2024-09-17T03:36:18.620634+0000","last_clean":"2024-09-17T03:36:18.620634+0000","last_became_active":"2024-09-17T03:36:18.616582+0000","last_became_peered":"2024-09-17T03:36:18.616582+0000","last_unstale":"2024-09-17T03:36:18.620634+0000","last_undegraded":"2024-09-17T03:36:18.620634+0000","last_fullsized":"2024-09-17T03:36:18.620634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:13.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.611420+0000","last_change":"2024-09-17T03:36:18.607199+0000","last_active":"2024-09-17T03:36:18.611420+0000","last_peered":"2024-09-17T03:36:18.611420+0000","last_clean":"2024-09-17T03:36:18.611420+0000","last_became_active":"2024-09-17T03:36:18.606912+0000","last_became_peered":"2024-09-17T03:36:18.606912+0000","last_unstale":"2024-09-17T03:36:18.611420+0000","last_undegraded":"2024-09-17T03:36:18.611420+0000","last_fullsized":"2024-09-17T03:36:18.611420+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:24.342808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628326+0000","last_change":"2024-09-17T03:36:18.623471+0000","last_active":"2024-09-17T03:36:18.628326+0000","last_peered":"2024-09-17T03:36:18.628326+0000","last_clean":"2024-09-17T03:36:18.628326+0000","last_became_active":"2024-09-17T03:36:18.622892+0000","last_became_peered":"2024-09-17T03:36:18.622892+0000","last_unstale":"2024-09-17T03:36:18.628326+0000","last_undegraded":"2024-09-17T03:36:18.628326+0000","last_fullsized":"2024-09-17T03:36:18.628326+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:28.096453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628199+0000","last_change":"2024-09-17T03:36:18.622572+0000","last_active":"2024-09-17T03:36:18.628199+0000","last_peered":"2024-09-17T03:36:18.628199+0000","last_clean":"2024-09-17T03:36:18.628199+0000","last_became_active":"2024-09-17T03:36:18.618178+0000","last_became_peered":"2024-09-17T03:36:18.618178+0000","last_unstale":"2024-09-17T03:36:18.628199+0000","last_undegraded":"2024-09-17T03:36:18.628199+0000","last_fullsized":"2024-09-17T03:36:18.628199+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:11.516431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.615066+0000","last_change":"2024-09-17T03:36:18.607221+0000","last_active":"2024-09-17T03:36:18.615066+0000","last_peered":"2024-09-17T03:36:18.615066+0000","last_clean":"2024-09-17T03:36:18.615066+0000","last_became_active":"2024-09-17T03:36:18.606526+0000","last_became_peered":"2024-09-17T03:36:18.606526+0000","last_unstale":"2024-09-17T03:36:18.615066+0000","last_undegraded":"2024-09-17T03:36:18.615066+0000","last_fullsized":"2024-09-17T03:36:18.615066+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:40.215862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.607883+0000","last_change":"2024-09-17T03:36:18.604164+0000","last_active":"2024-09-17T03:36:18.607883+0000","last_peered":"2024-09-17T03:36:18.607883+0000","last_clean":"2024-09-17T03:36:18.607883+0000","last_became_active":"2024-09-17T03:36:18.603876+0000","last_became_peered":"2024-09-17T03:36:18.603876+0000","last_unstale":"2024-09-17T03:36:18.607883+0000","last_undegraded":"2024-09-17T03:36:18.607883+0000","last_fullsized":"2024-09-17T03:36:18.607883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:54.083331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613350+0000","last_change":"2024-09-17T03:36:18.606583+0000","last_active":"2024-09-17T03:36:18.613350+0000","last_peered":"2024-09-17T03:36:18.613350+0000","last_clean":"2024-09-17T03:36:18.613350+0000","last_became_active":"2024-09-17T03:36:18.606264+0000","last_became_peered":"2024-09-17T03:36:18.606264+0000","last_unstale":"2024-09-17T03:36:18.613350+0000","last_undegraded":"2024-09-17T03:36:18.613350+0000","last_fullsized":"2024-09-17T03:36:18.613350+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:25.923247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622790+0000","last_change":"2024-09-17T03:36:18.621086+0000","last_active":"2024-09-17T03:36:18.622790+0000","last_peered":"2024-09-17T03:36:18.622790+0000","last_clean":"2024-09-17T03:36:18.622790+0000","last_became_active":"2024-09-17T03:36:18.620045+0000","last_became_peered":"2024-09-17T03:36:18.620045+0000","last_unstale":"2024-09-17T03:36:18.622790+0000","last_undegraded":"2024-09-17T03:36:18.622790+0000","last_fullsized":"2024-09-17T03:36:18.622790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:35.879493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620597+0000","last_change":"2024-09-17T03:36:18.619190+0000","last_active":"2024-09-17T03:36:18.620597+0000","last_peered":"2024-09-17T03:36:18.620597+0000","last_clean":"2024-09-17T03:36:18.620597+0000","last_became_active":"2024-09-17T03:36:18.618556+0000","last_became_peered":"2024-09-17T03:36:18.618556+0000","last_unstale":"2024-09-17T03:36:18.620597+0000","last_undegraded":"2024-09-17T03:36:18.620597+0000","last_fullsized":"2024-09-17T03:36:18.620597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.833899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601512+0000","last_change":"2024-09-17T03:36:18.600605+0000","last_active":"2024-09-17T03:36:18.601512+0000","last_peered":"2024-09-17T03:36:18.601512+0000","last_clean":"2024-09-17T03:36:18.601512+0000","last_became_active":"2024-09-17T03:36:18.600314+0000","last_became_peered":"2024-09-17T03:36:18.600314+0000","last_unstale":"2024-09-17T03:36:18.601512+0000","last_undegraded":"2024-09-17T03:36:18.601512+0000","last_fullsized":"2024-09-17T03:36:18.601512+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:19.575514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613424+0000","last_change":"2024-09-17T03:36:18.607175+0000","last_active":"2024-09-17T03:36:18.613424+0000","last_peered":"2024-09-17T03:36:18.613424+0000","last_clean":"2024-09-17T03:36:18.613424+0000","last_became_active":"2024-09-17T03:36:18.606339+0000","last_became_peered":"2024-09-17T03:36:18.606339+0000","last_unstale":"2024-09-17T03:36:18.613424+0000","last_undegraded":"2024-09-17T03:36:18.613424+0000","last_fullsized":"2024-09-17T03:36:18.613424+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:51.093115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623309+0000","last_change":"2024-09-17T03:36:18.622508+0000","last_active":"2024-09-17T03:36:18.623309+0000","last_peered":"2024-09-17T03:36:18.623309+0000","last_clean":"2024-09-17T03:36:18.623309+0000","last_became_active":"2024-09-17T03:36:18.622066+0000","last_became_peered":"2024-09-17T03:36:18.622066+0000","last_unstale":"2024-09-17T03:36:18.623309+0000","last_undegraded":"2024-09-17T03:36:18.623309+0000","last_fullsized":"2024-09-17T03:36:18.623309+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:20.384727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.630390+0000","last_change":"2024-09-17T03:36:17.585943+0000","last_active":"2024-09-17T03:36:18.630390+0000","last_peered":"2024-09-17T03:36:18.630390+0000","last_clean":"2024-09-17T03:36:18.630390+0000","last_became_active":"2024-09-17T03:36:17.585591+0000","last_became_peered":"2024-09-17T03:36:17.585591+0000","last_unstale":"2024-09-17T03:36:18.630390+0000","last_undegraded":"2024-09-17T03:36:18.630390+0000","last_fullsized":"2024-09-17T03:36:18.630390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:09.421144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622564+0000","last_change":"2024-09-17T03:36:18.620989+0000","last_active":"2024-09-17T03:36:18.622564+0000","last_peered":"2024-09-17T03:36:18.622564+0000","last_clean":"2024-09-17T03:36:18.622564+0000","last_became_active":"2024-09-17T03:36:18.620523+0000","last_became_peered":"2024-09-17T03:36:18.620523+0000","last_unstale":"2024-09-17T03:36:18.622564+0000","last_undegraded":"2024-09-17T03:36:18.622564+0000","last_fullsized":"2024-09-17T03:36:18.622564+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:04.316587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.578169+0000","last_change":"2024-09-17T03:36:16.578169+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.578169+0000","last_undegraded":"2024-09-17T03:36:16.578169+0000","last_fullsized":"2024-09-17T03:36:16.578169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613311+0000","last_change":"2024-09-17T03:36:18.608183+0000","last_active":"2024-09-17T03:36:18.613311+0000","last_peered":"2024-09-17T03:36:18.613311+0000","last_clean":"2024-09-17T03:36:18.613311+0000","last_became_active":"2024-09-17T03:36:18.607081+0000","last_became_peered":"2024-09-17T03:36:18.607081+0000","last_unstale":"2024-09-17T03:36:18.613311+0000","last_undegraded":"2024-09-17T03:36:18.613311+0000","last_fullsized":"2024-09-17T03:36:18.613311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:20.151030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628537+0000","last_change":"2024-09-17T03:36:17.586129+0000","last_active":"2024-09-17T03:36:18.628537+0000","last_peered":"2024-09-17T03:36:18.628537+0000","last_clean":"2024-09-17T03:36:18.628537+0000","last_became_active":"2024-09-17T03:36:17.585850+0000","last_became_peered":"2024-09-17T03:36:17.585850+0000","last_unstale":"2024-09-17T03:36:18.628537+0000","last_undegraded":"2024-09-17T03:36:18.628537+0000","last_fullsized":"2024-09-17T03:36:18.628537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:13.936211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623112+0000","last_change":"2024-09-17T03:36:18.620952+0000","last_active":"2024-09-17T03:36:18.623112+0000","last_peered":"2024-09-17T03:36:18.623112+0000","last_clean":"2024-09-17T03:36:18.623112+0000","last_became_active":"2024-09-17T03:36:18.620286+0000","last_became_peered":"2024-09-17T03:36:18.620286+0000","last_unstale":"2024-09-17T03:36:18.623112+0000","last_undegraded":"2024-09-17T03:36:18.623112+0000","last_fullsized":"2024-09-17T03:36:18.623112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:48.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576151+0000","last_change":"2024-09-17T03:36:16.576151+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576151+0000","last_undegraded":"2024-09-17T03:36:16.576151+0000","last_fullsized":"2024-09-17T03:36:16.576151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.631561+0000","last_change":"2024-09-17T03:36:17.585520+0000","last_active":"2024-09-17T03:36:18.631561+0000","last_peered":"2024-09-17T03:36:18.631561+0000","last_clean":"2024-09-17T03:36:18.631561+0000","last_became_active":"2024-09-17T03:36:17.585226+0000","last_became_peered":"2024-09-17T03:36:17.585226+0000","last_unstale":"2024-09-17T03:36:18.631561+0000","last_undegraded":"2024-09-17T03:36:18.631561+0000","last_fullsized":"2024-09-17T03:36:18.631561+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:48.714528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628298+0000","last_change":"2024-09-17T03:36:17.584532+0000","last_active":"2024-09-17T03:36:18.628298+0000","last_peered":"2024-09-17T03:36:18.628298+0000","last_clean":"2024-09-17T03:36:18.628298+0000","last_became_active":"2024-09-17T03:36:17.584217+0000","last_became_peered":"2024-09-17T03:36:17.584217+0000","last_unstale":"2024-09-17T03:36:18.628298+0000","last_undegraded":"2024-09-17T03:36:18.628298+0000","last_fullsized":"2024-09-17T03:36:18.628298+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:49.597521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619975+0000","last_change":"2024-09-17T03:36:18.617026+0000","last_active":"2024-09-17T03:36:18.619975+0000","last_peered":"2024-09-17T03:36:18.619975+0000","last_clean":"2024-09-17T03:36:18.619975+0000","last_became_active":"2024-09-17T03:36:18.616713+0000","last_became_peered":"2024-09-17T03:36:18.616713+0000","last_unstale":"2024-09-17T03:36:18.619975+0000","last_undegraded":"2024-09-17T03:36:18.619975+0000","last_fullsized":"2024-09-17T03:36:18.619975+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:04.592223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576263+0000","last_change":"2024-09-17T03:36:16.576263+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576263+0000","last_undegraded":"2024-09-17T03:36:16.576263+0000","last_fullsized":"2024-09-17T03:36:16.576263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601290+0000","last_change":"2024-09-17T03:36:17.595365+0000","last_active":"2024-09-17T03:36:18.601290+0000","last_peered":"2024-09-17T03:36:18.601290+0000","last_clean":"2024-09-17T03:36:18.601290+0000","last_became_active":"2024-09-17T03:36:17.595025+0000","last_became_peered":"2024-09-17T03:36:17.595025+0000","last_unstale":"2024-09-17T03:36:18.601290+0000","last_undegraded":"2024-09-17T03:36:18.601290+0000","last_fullsized":"2024-09-17T03:36:18.601290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:44.064718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619111+0000","last_change":"2024-09-17T03:36:18.613594+0000","last_active":"2024-09-17T03:36:18.619111+0000","last_peered":"2024-09-17T03:36:18.619111+0000","last_clean":"2024-09-17T03:36:18.619111+0000","last_became_active":"2024-09-17T03:36:18.613277+0000","last_became_peered":"2024-09-17T03:36:18.613277+0000","last_unstale":"2024-09-17T03:36:18.619111+0000","last_undegraded":"2024-09-17T03:36:18.619111+0000","last_fullsized":"2024-09-17T03:36:18.619111+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:52.293464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.610739+0000","last_change":"2024-09-17T03:36:17.595227+0000","last_active":"2024-09-17T03:36:18.610739+0000","last_peered":"2024-09-17T03:36:18.610739+0000","last_clean":"2024-09-17T03:36:18.610739+0000","last_became_active":"2024-09-17T03:36:17.594734+0000","last_became_peered":"2024-09-17T03:36:17.594734+0000","last_unstale":"2024-09-17T03:36:18.610739+0000","last_undegraded":"2024-09-17T03:36:18.610739+0000","last_fullsized":"2024-09-17T03:36:18.610739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:19.145953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.621716+0000","last_change":"2024-09-17T03:36:18.617682+0000","last_active":"2024-09-17T03:36:18.621716+0000","last_peered":"2024-09-17T03:36:18.621716+0000","last_clean":"2024-09-17T03:36:18.621716+0000","last_became_active":"2024-09-17T03:36:18.617304+0000","last_became_peered":"2024-09-17T03:36:18.617304+0000","last_unstale":"2024-09-17T03:36:18.621716+0000","last_undegraded":"2024-09-17T03:36:18.621716+0000","last_fullsized":"2024-09-17T03:36:18.621716+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:36.010214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.577512+0000","last_change":"2024-09-17T03:36:16.577512+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.577512+0000","last_undegraded":"2024-09-17T03:36:16.577512+0000","last_fullsized":"2024-09-17T03:36:16.577512+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612891+0000","last_change":"2024-09-17T03:36:18.605255+0000","last_active":"2024-09-17T03:36:18.612891+0000","last_peered":"2024-09-17T03:36:18.612891+0000","last_clean":"2024-09-17T03:36:18.612891+0000","last_became_active":"2024-09-17T03:36:18.604989+0000","last_became_peered":"2024-09-17T03:36:18.604989+0000","last_unstale":"2024-09-17T03:36:18.612891+0000","last_undegraded":"2024-09-17T03:36:18.612891+0000","last_fullsized":"2024-09-17T03:36:18.612891+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:09.275600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.631749+0000","last_change":"2024-09-17T03:36:17.590026+0000","last_active":"2024-09-17T03:36:18.631749+0000","last_peered":"2024-09-17T03:36:18.631749+0000","last_clean":"2024-09-17T03:36:18.631749+0000","last_became_active":"2024-09-17T03:36:17.589545+0000","last_became_peered":"2024-09-17T03:36:17.589545+0000","last_unstale":"2024-09-17T03:36:18.631749+0000","last_undegraded":"2024-09-17T03:36:18.631749+0000","last_fullsized":"2024-09-17T03:36:18.631749+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:50.088038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628375+0000","last_change":"2024-09-17T03:36:18.621917+0000","last_active":"2024-09-17T03:36:18.628375+0000","last_peered":"2024-09-17T03:36:18.628375+0000","last_clean":"2024-09-17T03:36:18.628375+0000","last_became_active":"2024-09-17T03:36:18.621591+0000","last_became_peered":"2024-09-17T03:36:18.621591+0000","last_unstale":"2024-09-17T03:36:18.628375+0000","last_undegraded":"2024-09-17T03:36:18.628375+0000","last_fullsized":"2024-09-17T03:36:18.628375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:48.539605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.634430+0000","last_change":"2024-09-17T03:36:17.585567+0000","last_active":"2024-09-17T03:36:18.634430+0000","last_peered":"2024-09-17T03:36:18.634430+0000","last_clean":"2024-09-17T03:36:18.634430+0000","last_became_active":"2024-09-17T03:36:17.584661+0000","last_became_peered":"2024-09-17T03:36:17.584661+0000","last_unstale":"2024-09-17T03:36:18.634430+0000","last_undegraded":"2024-09-17T03:36:18.634430+0000","last_fullsized":"2024-09-17T03:36:18.634430+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:48.556283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.577486+0000","last_change":"2024-09-17T03:36:16.577486+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.577486+0000","last_undegraded":"2024-09-17T03:36:16.577486+0000","last_fullsized":"2024-09-17T03:36:16.577486+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628308+0000","last_change":"2024-09-17T03:36:18.623279+0000","last_active":"2024-09-17T03:36:18.628308+0000","last_peered":"2024-09-17T03:36:18.628308+0000","last_clean":"2024-09-17T03:36:18.628308+0000","last_became_active":"2024-09-17T03:36:18.622907+0000","last_became_peered":"2024-09-17T03:36:18.622907+0000","last_unstale":"2024-09-17T03:36:18.628308+0000","last_undegraded":"2024-09-17T03:36:18.628308+0000","last_fullsized":"2024-09-17T03:36:18.628308+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:49.263474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604610+0000","last_change":"2024-09-17T03:36:17.582775+0000","last_active":"2024-09-17T03:36:18.604610+0000","last_peered":"2024-09-17T03:36:18.604610+0000","last_clean":"2024-09-17T03:36:18.604610+0000","last_became_active":"2024-09-17T03:36:17.582451+0000","last_became_peered":"2024-09-17T03:36:17.582451+0000","last_unstale":"2024-09-17T03:36:18.604610+0000","last_undegraded":"2024-09-17T03:36:18.604610+0000","last_fullsized":"2024-09-17T03:36:18.604610+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:55.225494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620916+0000","last_change":"2024-09-17T03:36:18.617154+0000","last_active":"2024-09-17T03:36:18.620916+0000","last_peered":"2024-09-17T03:36:18.620916+0000","last_clean":"2024-09-17T03:36:18.620916+0000","last_became_active":"2024-09-17T03:36:18.616817+0000","last_became_peered":"2024-09-17T03:36:18.616817+0000","last_unstale":"2024-09-17T03:36:18.620916+0000","last_undegraded":"2024-09-17T03:36:18.620916+0000","last_fullsized":"2024-09-17T03:36:18.620916+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:22.975493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575434+0000","last_change":"2024-09-17T03:36:16.575434+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575434+0000","last_undegraded":"2024-09-17T03:36:16.575434+0000","last_fullsized":"2024-09-17T03:36:16.575434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623796+0000","last_change":"2024-09-17T03:36:18.620650+0000","last_active":"2024-09-17T03:36:18.623796+0000","last_peered":"2024-09-17T03:36:18.623796+0000","last_clean":"2024-09-17T03:36:18.623796+0000","last_became_active":"2024-09-17T03:36:18.617859+0000","last_became_peered":"2024-09-17T03:36:18.617859+0000","last_unstale":"2024-09-17T03:36:18.623796+0000","last_undegraded":"2024-09-17T03:36:18.623796+0000","last_fullsized":"2024-09-17T03:36:18.623796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:01.225617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.634663+0000","last_change":"2024-09-17T03:36:17.586177+0000","last_active":"2024-09-17T03:36:18.634663+0000","last_peered":"2024-09-17T03:36:18.634663+0000","last_clean":"2024-09-17T03:36:18.634663+0000","last_became_active":"2024-09-17T03:36:17.585819+0000","last_became_peered":"2024-09-17T03:36:17.585819+0000","last_unstale":"2024-09-17T03:36:18.634663+0000","last_undegraded":"2024-09-17T03:36:18.634663+0000","last_fullsized":"2024-09-17T03:36:18.634663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:24.918171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.627961+0000","last_change":"2024-09-17T03:36:18.622200+0000","last_active":"2024-09-17T03:36:18.627961+0000","last_peered":"2024-09-17T03:36:18.627961+0000","last_clean":"2024-09-17T03:36:18.627961+0000","last_became_active":"2024-09-17T03:36:18.621839+0000","last_became_peered":"2024-09-17T03:36:18.621839+0000","last_unstale":"2024-09-17T03:36:18.627961+0000","last_undegraded":"2024-09-17T03:36:18.627961+0000","last_fullsized":"2024-09-17T03:36:18.627961+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:44.384105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576728+0000","last_change":"2024-09-17T03:36:16.576728+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576728+0000","last_undegraded":"2024-09-17T03:36:16.576728+0000","last_fullsized":"2024-09-17T03:36:16.576728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628263+0000","last_change":"2024-09-17T03:36:17.590872+0000","last_active":"2024-09-17T03:36:18.628263+0000","last_peered":"2024-09-17T03:36:18.628263+0000","last_clean":"2024-09-17T03:36:18.628263+0000","last_became_active":"2024-09-17T03:36:17.590501+0000","last_became_peered":"2024-09-17T03:36:17.590501+0000","last_unstale":"2024-09-17T03:36:18.628263+0000","last_undegraded":"2024-09-17T03:36:18.628263+0000","last_fullsized":"2024-09-17T03:36:18.628263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:28.794329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575557+0000","last_change":"2024-09-17T03:36:16.575557+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575557+0000","last_undegraded":"2024-09-17T03:36:16.575557+0000","last_fullsized":"2024-09-17T03:36:16.575557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.621198+0000","last_change":"2024-09-17T03:36:18.618941+0000","last_active":"2024-09-17T03:36:18.621198+0000","last_peered":"2024-09-17T03:36:18.621198+0000","last_clean":"2024-09-17T03:36:18.621198+0000","last_became_active":"2024-09-17T03:36:18.618611+0000","last_became_peered":"2024-09-17T03:36:18.618611+0000","last_unstale":"2024-09-17T03:36:18.621198+0000","last_undegraded":"2024-09-17T03:36:18.621198+0000","last_fullsized":"2024-09-17T03:36:18.621198+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:48.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601821+0000","last_change":"2024-09-17T03:36:17.595452+0000","last_active":"2024-09-17T03:36:18.601821+0000","last_peered":"2024-09-17T03:36:18.601821+0000","last_clean":"2024-09-17T03:36:18.601821+0000","last_became_active":"2024-09-17T03:36:17.595094+0000","last_became_peered":"2024-09-17T03:36:17.595094+0000","last_unstale":"2024-09-17T03:36:18.601821+0000","last_undegraded":"2024-09-17T03:36:18.601821+0000","last_fullsized":"2024-09-17T03:36:18.601821+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:12.654766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576728+0000","last_change":"2024-09-17T03:36:16.576728+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576728+0000","last_undegraded":"2024-09-17T03:36:16.576728+0000","last_fullsized":"2024-09-17T03:36:16.576728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.615017+0000","last_change":"2024-09-17T03:36:18.610121+0000","last_active":"2024-09-17T03:36:18.615017+0000","last_peered":"2024-09-17T03:36:18.615017+0000","last_clean":"2024-09-17T03:36:18.615017+0000","last_became_active":"2024-09-17T03:36:18.606903+0000","last_became_peered":"2024-09-17T03:36:18.606903+0000","last_unstale":"2024-09-17T03:36:18.615017+0000","last_undegraded":"2024-09-17T03:36:18.615017+0000","last_fullsized":"2024-09-17T03:36:18.615017+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:36.010214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593684+0000","last_change":"2024-09-17T03:36:17.588176+0000","last_active":"2024-09-17T03:36:18.593684+0000","last_peered":"2024-09-17T03:36:18.593684+0000","last_clean":"2024-09-17T03:36:18.593684+0000","last_became_active":"2024-09-17T03:36:17.587563+0000","last_became_peered":"2024-09-17T03:36:17.587563+0000","last_unstale":"2024-09-17T03:36:18.593684+0000","last_undegraded":"2024-09-17T03:36:18.593684+0000","last_fullsized":"2024-09-17T03:36:18.593684+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:27.963949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623117+0000","last_change":"2024-09-17T03:36:18.622275+0000","last_active":"2024-09-17T03:36:18.623117+0000","last_peered":"2024-09-17T03:36:18.623117+0000","last_clean":"2024-09-17T03:36:18.623117+0000","last_became_active":"2024-09-17T03:36:18.621983+0000","last_became_peered":"2024-09-17T03:36:18.621983+0000","last_unstale":"2024-09-17T03:36:18.623117+0000","last_undegraded":"2024-09-17T03:36:18.623117+0000","last_fullsized":"2024-09-17T03:36:18.623117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:01.225617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575452+0000","last_change":"2024-09-17T03:36:16.575452+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575452+0000","last_undegraded":"2024-09-17T03:36:16.575452+0000","last_fullsized":"2024-09-17T03:36:16.575452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.629109+0000","last_change":"2024-09-17T03:36:17.594225+0000","last_active":"2024-09-17T03:36:18.629109+0000","last_peered":"2024-09-17T03:36:18.629109+0000","last_clean":"2024-09-17T03:36:18.629109+0000","last_became_active":"2024-09-17T03:36:17.593916+0000","last_became_peered":"2024-09-17T03:36:17.593916+0000","last_unstale":"2024-09-17T03:36:18.629109+0000","last_undegraded":"2024-09-17T03:36:18.629109+0000","last_fullsized":"2024-09-17T03:36:18.629109+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:03.587147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.599453+0000","last_change":"2024-09-17T03:36:17.589681+0000","last_active":"2024-09-17T03:36:18.599453+0000","last_peered":"2024-09-17T03:36:18.599453+0000","last_clean":"2024-09-17T03:36:18.599453+0000","last_became_active":"2024-09-17T03:36:17.582742+0000","last_became_peered":"2024-09-17T03:36:17.582742+0000","last_unstale":"2024-09-17T03:36:18.599453+0000","last_undegraded":"2024-09-17T03:36:18.599453+0000","last_fullsized":"2024-09-17T03:36:18.599453+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:34.514226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612864+0000","last_change":"2024-09-17T03:36:18.604528+0000","last_active":"2024-09-17T03:36:18.612864+0000","last_peered":"2024-09-17T03:36:18.612864+0000","last_clean":"2024-09-17T03:36:18.612864+0000","last_became_active":"2024-09-17T03:36:18.604264+0000","last_became_peered":"2024-09-17T03:36:18.604264+0000","last_unstale":"2024-09-17T03:36:18.612864+0000","last_undegraded":"2024-09-17T03:36:18.612864+0000","last_fullsized":"2024-09-17T03:36:18.612864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:08.252388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604689+0000","last_change":"2024-09-17T03:36:17.580793+0000","last_active":"2024-09-17T03:36:18.604689+0000","last_peered":"2024-09-17T03:36:18.604689+0000","last_clean":"2024-09-17T03:36:18.604689+0000","last_became_active":"2024-09-17T03:36:17.580470+0000","last_became_peered":"2024-09-17T03:36:17.580470+0000","last_unstale":"2024-09-17T03:36:18.604689+0000","last_undegraded":"2024-09-17T03:36:18.604689+0000","last_fullsized":"2024-09-17T03:36:18.604689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:25.063641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622663+0000","last_change":"2024-09-17T03:36:18.621036+0000","last_active":"2024-09-17T03:36:18.622663+0000","last_peered":"2024-09-17T03:36:18.622663+0000","last_clean":"2024-09-17T03:36:18.622663+0000","last_became_active":"2024-09-17T03:36:18.620667+0000","last_became_peered":"2024-09-17T03:36:18.620667+0000","last_unstale":"2024-09-17T03:36:18.622663+0000","last_undegraded":"2024-09-17T03:36:18.622663+0000","last_fullsized":"2024-09-17T03:36:18.622663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.833899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575534+0000","last_change":"2024-09-17T03:36:16.575534+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575534+0000","last_undegraded":"2024-09-17T03:36:16.575534+0000","last_fullsized":"2024-09-17T03:36:16.575534+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593735+0000","last_change":"2024-09-17T03:36:17.587591+0000","last_active":"2024-09-17T03:36:18.593735+0000","last_peered":"2024-09-17T03:36:18.593735+0000","last_clean":"2024-09-17T03:36:18.593735+0000","last_became_active":"2024-09-17T03:36:17.586959+0000","last_became_peered":"2024-09-17T03:36:17.586959+0000","last_unstale":"2024-09-17T03:36:18.593735+0000","last_undegraded":"2024-09-17T03:36:18.593735+0000","last_fullsized":"2024-09-17T03:36:18.593735+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:39.210785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628007+0000","last_change":"2024-09-17T03:36:18.622306+0000","last_active":"2024-09-17T03:36:18.628007+0000","last_peered":"2024-09-17T03:36:18.628007+0000","last_clean":"2024-09-17T03:36:18.628007+0000","last_became_active":"2024-09-17T03:36:18.619448+0000","last_became_peered":"2024-09-17T03:36:18.619448+0000","last_unstale":"2024-09-17T03:36:18.628007+0000","last_undegraded":"2024-09-17T03:36:18.628007+0000","last_fullsized":"2024-09-17T03:36:18.628007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:58.826782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.603333+0000","last_change":"2024-09-17T03:36:17.578097+0000","last_active":"2024-09-17T03:36:18.603333+0000","last_peered":"2024-09-17T03:36:18.603333+0000","last_clean":"2024-09-17T03:36:18.603333+0000","last_became_active":"2024-09-17T03:36:17.577678+0000","last_became_peered":"2024-09-17T03:36:17.577678+0000","last_unstale":"2024-09-17T03:36:18.603333+0000","last_undegraded":"2024-09-17T03:36:18.603333+0000","last_fullsized":"2024-09-17T03:36:18.603333+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:16.042540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613221+0000","last_change":"2024-09-17T03:36:18.609081+0000","last_active":"2024-09-17T03:36:18.613221+0000","last_peered":"2024-09-17T03:36:18.613221+0000","last_clean":"2024-09-17T03:36:18.613221+0000","last_became_active":"2024-09-17T03:36:18.608778+0000","last_became_peered":"2024-09-17T03:36:18.608778+0000","last_unstale":"2024-09-17T03:36:18.613221+0000","last_undegraded":"2024-09-17T03:36:18.613221+0000","last_fullsized":"2024-09-17T03:36:18.613221+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:10.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593669+0000","last_change":"2024-09-17T03:36:17.595198+0000","last_active":"2024-09-17T03:36:18.593669+0000","last_peered":"2024-09-17T03:36:18.593669+0000","last_clean":"2024-09-17T03:36:18.593669+0000","last_became_active":"2024-09-17T03:36:17.594848+0000","last_became_peered":"2024-09-17T03:36:17.594848+0000","last_unstale":"2024-09-17T03:36:18.593669+0000","last_undegraded":"2024-09-17T03:36:18.593669+0000","last_fullsized":"2024-09-17T03:36:18.593669+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.483843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576072+0000","last_change":"2024-09-17T03:36:16.576072+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576072+0000","last_undegraded":"2024-09-17T03:36:16.576072+0000","last_fullsized":"2024-09-17T03:36:16.576072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604804+0000","last_change":"2024-09-17T03:36:17.587385+0000","last_active":"2024-09-17T03:36:18.604804+0000","last_peered":"2024-09-17T03:36:18.604804+0000","last_clean":"2024-09-17T03:36:18.604804+0000","last_became_active":"2024-09-17T03:36:17.586929+0000","last_became_peered":"2024-09-17T03:36:17.586929+0000","last_unstale":"2024-09-17T03:36:18.604804+0000","last_undegraded":"2024-09-17T03:36:18.604804+0000","last_fullsized":"2024-09-17T03:36:18.604804+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.483843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":178,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.608022+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:36:18.608022+0000","last_peered":"2024-09-17T03:36:18.608022+0000","last_clean":"2024-09-17T03:36:18.608022+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:36:18.608022+0000","last_undegraded":"2024-09-17T03:36:18.608022+0000","last_fullsized":"2024-09-17T03:36:18.608022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2284,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36604,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335236,"statfs":{"total":96636764160,"available":96599281664,"internally_reserved":0,"allocated":1277952,"data_stored":871058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":675840,"data_stored":280530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40188,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331652,"statfs":{"total":96636764160,"available":96595611648,"internally_reserved":0,"allocated":688128,"data_stored":282142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36024,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335816,"statfs":{"total":96636764160,"available":96599875584,"internally_reserved":0,"allocated":684032,"data_stored":280586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":679936,"data_stored":280620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":873092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":267488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":267488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:22.327 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-09-17T03:36:22.327 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.328 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3c is not active+clean 2024-09-17T03:36:22.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.328 INFO:tasks.ceph.ceph_manager.ceph:PG 9.38 is not active+clean 2024-09-17T03:36:22.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.328 INFO:tasks.ceph.ceph_manager.ceph:PG 9.34 is not active+clean 2024-09-17T03:36:22.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.328 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2f is not active+clean 2024-09-17T03:36:22.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.328 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-09-17T03:36:22.328 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:PG 9.26 is not active+clean 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:PG 9.23 is not active+clean 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.578169+0000', 'last_change': '2024-09-17T03:36:16.578169+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.578169+0000', 'last_undegraded': '2024-09-17T03:36:16.578169+0000', 'last_fullsized': '2024-09-17T03:36:16.578169+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.576151+0000', 'last_change': '2024-09-17T03:36:16.576151+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.576151+0000', 'last_undegraded': '2024-09-17T03:36:16.576151+0000', 'last_fullsized': '2024-09-17T03:36:16.576151+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-09-17T03:36:22.329 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.330 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-09-17T03:36:22.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.330 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-17T03:36:22.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.576263+0000', 'last_change': '2024-09-17T03:36:16.576263+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.576263+0000', 'last_undegraded': '2024-09-17T03:36:16.576263+0000', 'last_fullsized': '2024-09-17T03:36:16.576263+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:36:22.330 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-09-17T03:36:22.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.330 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-09-17T03:36:22.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.577512+0000', 'last_change': '2024-09-17T03:36:16.577512+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.577512+0000', 'last_undegraded': '2024-09-17T03:36:16.577512+0000', 'last_fullsized': '2024-09-17T03:36:16.577512+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:36:22.330 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-09-17T03:36:22.330 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.577486+0000', 'last_change': '2024-09-17T03:36:16.577486+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.577486+0000', 'last_undegraded': '2024-09-17T03:36:16.577486+0000', 'last_fullsized': '2024-09-17T03:36:16.577486+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.575434+0000', 'last_change': '2024-09-17T03:36:16.575434+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.575434+0000', 'last_undegraded': '2024-09-17T03:36:16.575434+0000', 'last_fullsized': '2024-09-17T03:36:16.575434+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.576728+0000', 'last_change': '2024-09-17T03:36:16.576728+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.576728+0000', 'last_undegraded': '2024-09-17T03:36:16.576728+0000', 'last_fullsized': '2024-09-17T03:36:16.576728+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-17T03:36:22.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.575557+0000', 'last_change': '2024-09-17T03:36:16.575557+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.575557+0000', 'last_undegraded': '2024-09-17T03:36:16.575557+0000', 'last_fullsized': '2024-09-17T03:36:16.575557+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.576728+0000', 'last_change': '2024-09-17T03:36:16.576728+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.576728+0000', 'last_undegraded': '2024-09-17T03:36:16.576728+0000', 'last_fullsized': '2024-09-17T03:36:16.576728+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.575452+0000', 'last_change': '2024-09-17T03:36:16.575452+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.575452+0000', 'last_undegraded': '2024-09-17T03:36:16.575452+0000', 'last_fullsized': '2024-09-17T03:36:16.575452+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-17T03:36:22.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.575534+0000', 'last_change': '2024-09-17T03:36:16.575534+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.575534+0000', 'last_undegraded': '2024-09-17T03:36:16.575534+0000', 'last_fullsized': '2024-09-17T03:36:16.575534+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:36:22.333 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-09-17T03:36:22.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.333 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-09-17T03:36:22.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.333 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-09-17T03:36:22.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:16.576072+0000', 'last_change': '2024-09-17T03:36:16.576072+0000', 'last_active': '2024-09-17T03:36:16.562941+0000', 'last_peered': '2024-09-17T03:36:16.562941+0000', 'last_clean': '2024-09-17T03:36:16.562941+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:16.576072+0000', 'last_undegraded': '2024-09-17T03:36:16.576072+0000', 'last_fullsized': '2024-09-17T03:36:16.576072+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:16.562941+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:36:22.333 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-09-17T03:36:22.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:17.568018+0000', 'last_change': '2024-09-17T03:36:17.568018+0000', 'last_active': '2024-09-17T03:36:17.568018+0000', 'last_peered': '2024-09-17T03:36:17.568018+0000', 'last_clean': '2024-09-17T03:36:17.568018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:17.568018+0000', 'last_undegraded': '2024-09-17T03:36:17.568018+0000', 'last_fullsized': '2024-09-17T03:36:17.568018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:17.568018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:36:22.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:36:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.476+0000 7f440aa15640 1 -- 172.21.15.146:0/1865868124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4404072df0 msgr2=0x7f440415ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.476+0000 7f440aa15640 1 --2- 172.21.15.146:0/1865868124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4404072df0 0x7f440415ead0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009820 tx=0x7f43f802a510 comp rx=0 tx=0).stop 2024-09-17T03:36:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.476+0000 7f440aa15640 1 -- 172.21.15.146:0/1865868124 shutdown_connections 2024-09-17T03:36:22.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.476+0000 7f440aa15640 1 --2- 172.21.15.146:0/1865868124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f440415f010 0x7f44041515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.476+0000 7f440aa15640 1 --2- 172.21.15.146:0/1865868124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4404072df0 0x7f440415ead0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.476+0000 7f440aa15640 1 -- 172.21.15.146:0/1865868124 >> 172.21.15.146:0/1865868124 conn(0x7f44040b2060 msgr2=0x7f44040b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.476+0000 7f440aa15640 1 -- 172.21.15.146:0/1865868124 shutdown_connections 2024-09-17T03:36:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.476+0000 7f440aa15640 1 -- 172.21.15.146:0/1865868124 wait complete. 2024-09-17T03:36:22.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.478+0000 7f440aa15640 1 Processor -- start 2024-09-17T03:36:22.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.478+0000 7f440aa15640 1 -- start start 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.479+0000 7f440aa15640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4404072df0 0x7f4404142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.479+0000 7f440aa15640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44040b3360 0x7f440414b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.479+0000 7f440aa15640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f440415f010 0x7f44040ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.479+0000 7f440aa15640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f440406e9a0 con 0x7f44040b3360 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.479+0000 7f440aa15640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f440406e820 con 0x7f4404072df0 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.479+0000 7f440aa15640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f440406eb20 con 0x7f440415f010 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.479+0000 7f44037fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44040b3360 0x7f440414b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.479+0000 7f44037fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44040b3360 0x7f440414b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48158/0 (socket says 172.21.15.146:48158) 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.479+0000 7f44037fe640 1 -- 172.21.15.146:0/971540918 learned_addr learned my addr 172.21.15.146:0/971540918 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f4408fb2640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f440415f010 0x7f44040ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f4403fff640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4404072df0 0x7f4404142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f44037fe640 1 -- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f440415f010 msgr2=0x7f44040ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f44037fe640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f440415f010 0x7f44040ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f44037fe640 1 -- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4404072df0 msgr2=0x7f4404142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f44037fe640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4404072df0 0x7f4404142990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f44037fe640 1 -- 172.21.15.146:0/971540918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44041f9a10 con 0x7f44040b3360 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f4408fb2640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f440415f010 0x7f44040ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f4403fff640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4404072df0 0x7f4404142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f44037fe640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44040b3360 0x7f440414b840 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009940 tx=0x7f43f8005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f4400ff9640 1 -- 172.21.15.146:0/971540918 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f803f070 con 0x7f44040b3360 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f4400ff9640 1 -- 172.21.15.146:0/971540918 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43f8004340 con 0x7f44040b3360 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f440aa15640 1 -- 172.21.15.146:0/971540918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4404142ed0 con 0x7f44040b3360 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f4400ff9640 1 -- 172.21.15.146:0/971540918 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8031bb0 con 0x7f44040b3360 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.480+0000 7f440aa15640 1 -- 172.21.15.146:0/971540918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44041f9170 con 0x7f44040b3360 2024-09-17T03:36:22.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.481+0000 7f440aa15640 1 -- 172.21.15.146:0/971540918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440415ead0 con 0x7f44040b3360 2024-09-17T03:36:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.482+0000 7f4400ff9640 1 -- 172.21.15.146:0/971540918 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43f8042070 con 0x7f44040b3360 2024-09-17T03:36:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.482+0000 7f4400ff9640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43f0078bc0 0x7f43f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.482+0000 7f4400ff9640 1 -- 172.21.15.146:0/971540918 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f43f80bbf00 con 0x7f44040b3360 2024-09-17T03:36:22.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.483+0000 7f4403fff640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43f0078bc0 0x7f43f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.483+0000 7f4403fff640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43f0078bc0 0x7f43f007b0d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f43f40013f0 tx=0x7f43f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.487+0000 7f4400ff9640 1 -- 172.21.15.146:0/971540918 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f43f80843e0 con 0x7f44040b3360 2024-09-17T03:36:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.733+0000 7f440aa15640 1 -- 172.21.15.146:0/971540918 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f44040699f0 con 0x7f44040b3360 2024-09-17T03:36:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.734+0000 7f4400ff9640 1 -- 172.21.15.146:0/971540918 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1764 (secure 0 0 0) 0x7f43f8031770 con 0x7f44040b3360 2024-09-17T03:36:22.734 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:22.734 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":227,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":64},{"state_name":"unknown","count":21},{"state_name":"creating+peering","count":12}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":592652,"bytes_used":296194048,"bytes_avail":772797919232,"bytes_total":773094113280,"unknown_pgs_ratio":0.2164948433637619,"inactive_pgs_ratio":0.12371134012937546,"write_bytes_sec":971,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":29,"btime":"2024-09-17T03:36:20:610421+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":5890}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-17T03:35:59.835195+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:36:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 -- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43f0078bc0 msgr2=0x7f43f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43f0078bc0 0x7f43f007b0d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f43f40013f0 tx=0x7f43f4009040 comp rx=0 tx=0).stop 2024-09-17T03:36:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 -- 172.21.15.146:0/971540918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44040b3360 msgr2=0x7f440414b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44040b3360 0x7f440414b840 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009940 tx=0x7f43f8005270 comp rx=0 tx=0).stop 2024-09-17T03:36:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 -- 172.21.15.146:0/971540918 shutdown_connections 2024-09-17T03:36:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43f0078bc0 0x7f43f007b0d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f440415f010 0x7f44040ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44040b3360 0x7f440414b840 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 --2- 172.21.15.146:0/971540918 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4404072df0 0x7f4404142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 -- 172.21.15.146:0/971540918 >> 172.21.15.146:0/971540918 conn(0x7f44040b2060 msgr2=0x7f440415d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:22.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 -- 172.21.15.146:0/971540918 shutdown_connections 2024-09-17T03:36:22.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.736+0000 7f440aa15640 1 -- 172.21.15.146:0/971540918 wait complete. 2024-09-17T03:36:22.747 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:36:22.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.860+0000 7f05435ba640 1 -- 172.21.15.146:0/704965205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c15f1a0 msgr2=0x7f053c0cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.860+0000 7f05435ba640 1 --2- 172.21.15.146:0/704965205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c15f1a0 0x7f053c0cfca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f052c005fd0 tx=0x7f052c02a540 comp rx=0 tx=0).stop 2024-09-17T03:36:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.861+0000 7f05435ba640 1 -- 172.21.15.146:0/704965205 shutdown_connections 2024-09-17T03:36:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.861+0000 7f05435ba640 1 --2- 172.21.15.146:0/704965205 >> v2:172.21.15.179:3300/0 conn(0x7f053c1631a0 0x7f053c0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.861+0000 7f05435ba640 1 --2- 172.21.15.146:0/704965205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c15f1a0 0x7f053c0cfca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.861+0000 7f05435ba640 1 -- 172.21.15.146:0/704965205 >> 172.21.15.146:0/704965205 conn(0x7f053c0d11f0 msgr2=0x7f053c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.861+0000 7f05435ba640 1 -- 172.21.15.146:0/704965205 shutdown_connections 2024-09-17T03:36:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.861+0000 7f05435ba640 1 -- 172.21.15.146:0/704965205 wait complete. 2024-09-17T03:36:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.862+0000 7f05435ba640 1 Processor -- start 2024-09-17T03:36:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.862+0000 7f05435ba640 1 -- start start 2024-09-17T03:36:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f05435ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c0b61f0 0x7f053c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f05435ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f053c15f1a0 0x7f053c0ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f05435ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c1631a0 0x7f053c14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f05435ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f053c0695b0 con 0x7f053c15f1a0 2024-09-17T03:36:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f05435ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f053c069430 con 0x7f053c1631a0 2024-09-17T03:36:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f05435ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f053c069730 con 0x7f053c0b61f0 2024-09-17T03:36:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0540b55640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f053c15f1a0 0x7f053c0ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0540b55640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f053c15f1a0 0x7f053c0ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48162/0 (socket says 172.21.15.146:48162) 2024-09-17T03:36:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0540b55640 1 -- 172.21.15.146:0/80409228 learned_addr learned my addr 172.21.15.146:0/80409228 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0541356640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c0b61f0 0x7f053c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0541b57640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c1631a0 0x7f053c14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0540b55640 1 -- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c0b61f0 msgr2=0x7f053c0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0540b55640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c0b61f0 0x7f053c0cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0540b55640 1 -- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c1631a0 msgr2=0x7f053c14ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0540b55640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c1631a0 0x7f053c14ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0540b55640 1 -- 172.21.15.146:0/80409228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c1f93d0 con 0x7f053c15f1a0 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0540b55640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f053c15f1a0 0x7f053c0ce2d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f053000e9f0 tx=0x7f053000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0539ffb640 1 -- 172.21.15.146:0/80409228 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053000cd80 con 0x7f053c15f1a0 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0539ffb640 1 -- 172.21.15.146:0/80409228 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0530004020 con 0x7f053c15f1a0 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f0539ffb640 1 -- 172.21.15.146:0/80409228 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530004470 con 0x7f053c15f1a0 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.864+0000 7f05435ba640 1 -- 172.21.15.146:0/80409228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f053c1f96b0 con 0x7f053c15f1a0 2024-09-17T03:36:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.865+0000 7f05435ba640 1 -- 172.21.15.146:0/80409228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f053c1f9c70 con 0x7f053c15f1a0 2024-09-17T03:36:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.866+0000 7f05435ba640 1 -- 172.21.15.146:0/80409228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f053c0cfed0 con 0x7f053c15f1a0 2024-09-17T03:36:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.866+0000 7f0539ffb640 1 -- 172.21.15.146:0/80409228 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f05300035f0 con 0x7f053c15f1a0 2024-09-17T03:36:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.867+0000 7f0539ffb640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0528078bc0 0x7f052807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.867+0000 7f0539ffb640 1 -- 172.21.15.146:0/80409228 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f053009b690 con 0x7f053c15f1a0 2024-09-17T03:36:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.867+0000 7f0541356640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0528078bc0 0x7f052807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.868+0000 7f0541356640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0528078bc0 0x7f052807b0d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f052c033000 tx=0x7f052c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:22.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:22.871+0000 7f0539ffb640 1 -- 172.21.15.146:0/80409228 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f053c0cfed0 con 0x7f053c15f1a0 2024-09-17T03:36:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.043+0000 7f05435ba640 1 -- 172.21.15.146:0/80409228 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f053c069be0 con 0x7f0528078bc0 2024-09-17T03:36:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.048+0000 7f0539ffb640 1 -- 172.21.15.146:0/80409228 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248070 (secure 0 0 0) 0x7f053c069be0 con 0x7f0528078bc0 2024-09-17T03:36:23.050 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:23.052 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:36:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 -- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0528078bc0 msgr2=0x7f052807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0528078bc0 0x7f052807b0d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f052c033000 tx=0x7f052c004730 comp rx=0 tx=0).stop 2024-09-17T03:36:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 -- 172.21.15.146:0/80409228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f053c15f1a0 msgr2=0x7f053c0ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f053c15f1a0 0x7f053c0ce2d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f053000e9f0 tx=0x7f053000eeb0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 -- 172.21.15.146:0/80409228 shutdown_connections 2024-09-17T03:36:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0528078bc0 0x7f052807b0d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f053c1631a0 0x7f053c14ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f053c15f1a0 0x7f053c0ce2d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 --2- 172.21.15.146:0/80409228 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f053c0b61f0 0x7f053c0cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 -- 172.21.15.146:0/80409228 >> 172.21.15.146:0/80409228 conn(0x7f053c0d11f0 msgr2=0x7f053c162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 -- 172.21.15.146:0/80409228 shutdown_connections 2024-09-17T03:36:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:23.051+0000 7f05435ba640 1 -- 172.21.15.146:0/80409228 wait complete. 2024-09-17T03:36:23.063 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-17T03:36:21.840418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592652,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":136,"num_write_kb":1633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":152,"acting":152,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289252,"kb_used_data":6440,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685468,"statfs":{"total":773094113280,"available":772797919232,"internally_reserved":0,"allocated":6594560,"data_stored":3403004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":289394225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2284,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.271619"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613350+0000","last_change":"2024-09-17T03:36:18.607189+0000","last_active":"2024-09-17T03:36:18.613350+0000","last_peered":"2024-09-17T03:36:18.613350+0000","last_clean":"2024-09-17T03:36:18.613350+0000","last_became_active":"2024-09-17T03:36:18.606849+0000","last_became_peered":"2024-09-17T03:36:18.606849+0000","last_unstale":"2024-09-17T03:36:18.613350+0000","last_undegraded":"2024-09-17T03:36:18.613350+0000","last_fullsized":"2024-09-17T03:36:18.613350+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:17.991308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628270+0000","last_change":"2024-09-17T03:36:18.621325+0000","last_active":"2024-09-17T03:36:18.628270+0000","last_peered":"2024-09-17T03:36:18.628270+0000","last_clean":"2024-09-17T03:36:18.628270+0000","last_became_active":"2024-09-17T03:36:18.621005+0000","last_became_peered":"2024-09-17T03:36:18.621005+0000","last_unstale":"2024-09-17T03:36:18.628270+0000","last_undegraded":"2024-09-17T03:36:18.628270+0000","last_fullsized":"2024-09-17T03:36:18.628270+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:20.384727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622390+0000","last_change":"2024-09-17T03:36:18.620461+0000","last_active":"2024-09-17T03:36:18.622390+0000","last_peered":"2024-09-17T03:36:18.622390+0000","last_clean":"2024-09-17T03:36:18.622390+0000","last_became_active":"2024-09-17T03:36:18.620111+0000","last_became_peered":"2024-09-17T03:36:18.620111+0000","last_unstale":"2024-09-17T03:36:18.622390+0000","last_undegraded":"2024-09-17T03:36:18.622390+0000","last_fullsized":"2024-09-17T03:36:18.622390+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:45.896532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.602336+0000","last_change":"2024-09-17T03:36:18.601730+0000","last_active":"2024-09-17T03:36:18.602336+0000","last_peered":"2024-09-17T03:36:18.602336+0000","last_clean":"2024-09-17T03:36:18.602336+0000","last_became_active":"2024-09-17T03:36:18.601442+0000","last_became_peered":"2024-09-17T03:36:18.601442+0000","last_unstale":"2024-09-17T03:36:18.602336+0000","last_undegraded":"2024-09-17T03:36:18.602336+0000","last_fullsized":"2024-09-17T03:36:18.602336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:04.496122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620920+0000","last_change":"2024-09-17T03:36:18.617518+0000","last_active":"2024-09-17T03:36:18.620920+0000","last_peered":"2024-09-17T03:36:18.620920+0000","last_clean":"2024-09-17T03:36:18.620920+0000","last_became_active":"2024-09-17T03:36:18.617017+0000","last_became_peered":"2024-09-17T03:36:18.617017+0000","last_unstale":"2024-09-17T03:36:18.620920+0000","last_undegraded":"2024-09-17T03:36:18.620920+0000","last_fullsized":"2024-09-17T03:36:18.620920+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:43.171594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.618982+0000","last_change":"2024-09-17T03:36:18.611502+0000","last_active":"2024-09-17T03:36:18.618982+0000","last_peered":"2024-09-17T03:36:18.618982+0000","last_clean":"2024-09-17T03:36:18.618982+0000","last_became_active":"2024-09-17T03:36:18.611076+0000","last_became_peered":"2024-09-17T03:36:18.611076+0000","last_unstale":"2024-09-17T03:36:18.618982+0000","last_undegraded":"2024-09-17T03:36:18.618982+0000","last_fullsized":"2024-09-17T03:36:18.618982+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:39.201611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612835+0000","last_change":"2024-09-17T03:36:18.608871+0000","last_active":"2024-09-17T03:36:18.612835+0000","last_peered":"2024-09-17T03:36:18.612835+0000","last_clean":"2024-09-17T03:36:18.612835+0000","last_became_active":"2024-09-17T03:36:18.608525+0000","last_became_peered":"2024-09-17T03:36:18.608525+0000","last_unstale":"2024-09-17T03:36:18.612835+0000","last_undegraded":"2024-09-17T03:36:18.612835+0000","last_fullsized":"2024-09-17T03:36:18.612835+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:52.745381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612940+0000","last_change":"2024-09-17T03:36:18.607137+0000","last_active":"2024-09-17T03:36:18.612940+0000","last_peered":"2024-09-17T03:36:18.612940+0000","last_clean":"2024-09-17T03:36:18.612940+0000","last_became_active":"2024-09-17T03:36:18.606832+0000","last_became_peered":"2024-09-17T03:36:18.606832+0000","last_unstale":"2024-09-17T03:36:18.612940+0000","last_undegraded":"2024-09-17T03:36:18.612940+0000","last_fullsized":"2024-09-17T03:36:18.612940+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:23.498137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.614985+0000","last_change":"2024-09-17T03:36:18.606718+0000","last_active":"2024-09-17T03:36:18.614985+0000","last_peered":"2024-09-17T03:36:18.614985+0000","last_clean":"2024-09-17T03:36:18.614985+0000","last_became_active":"2024-09-17T03:36:18.606359+0000","last_became_peered":"2024-09-17T03:36:18.606359+0000","last_unstale":"2024-09-17T03:36:18.614985+0000","last_undegraded":"2024-09-17T03:36:18.614985+0000","last_fullsized":"2024-09-17T03:36:18.614985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:28.969026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619137+0000","last_change":"2024-09-17T03:36:18.609437+0000","last_active":"2024-09-17T03:36:18.619137+0000","last_peered":"2024-09-17T03:36:18.619137+0000","last_clean":"2024-09-17T03:36:18.619137+0000","last_became_active":"2024-09-17T03:36:18.609134+0000","last_became_peered":"2024-09-17T03:36:18.609134+0000","last_unstale":"2024-09-17T03:36:18.619137+0000","last_undegraded":"2024-09-17T03:36:18.619137+0000","last_fullsized":"2024-09-17T03:36:18.619137+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:17.878524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.618987+0000","last_change":"2024-09-17T03:36:18.614518+0000","last_active":"2024-09-17T03:36:18.618987+0000","last_peered":"2024-09-17T03:36:18.618987+0000","last_clean":"2024-09-17T03:36:18.618987+0000","last_became_active":"2024-09-17T03:36:18.614218+0000","last_became_peered":"2024-09-17T03:36:18.614218+0000","last_unstale":"2024-09-17T03:36:18.618987+0000","last_undegraded":"2024-09-17T03:36:18.618987+0000","last_fullsized":"2024-09-17T03:36:18.618987+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:48.495098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613398+0000","last_change":"2024-09-17T03:36:18.608914+0000","last_active":"2024-09-17T03:36:18.613398+0000","last_peered":"2024-09-17T03:36:18.613398+0000","last_clean":"2024-09-17T03:36:18.613398+0000","last_became_active":"2024-09-17T03:36:18.608524+0000","last_became_peered":"2024-09-17T03:36:18.608524+0000","last_unstale":"2024-09-17T03:36:18.613398+0000","last_undegraded":"2024-09-17T03:36:18.613398+0000","last_fullsized":"2024-09-17T03:36:18.613398+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:13.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620634+0000","last_change":"2024-09-17T03:36:18.616908+0000","last_active":"2024-09-17T03:36:18.620634+0000","last_peered":"2024-09-17T03:36:18.620634+0000","last_clean":"2024-09-17T03:36:18.620634+0000","last_became_active":"2024-09-17T03:36:18.616582+0000","last_became_peered":"2024-09-17T03:36:18.616582+0000","last_unstale":"2024-09-17T03:36:18.620634+0000","last_undegraded":"2024-09-17T03:36:18.620634+0000","last_fullsized":"2024-09-17T03:36:18.620634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:13.367926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.611420+0000","last_change":"2024-09-17T03:36:18.607199+0000","last_active":"2024-09-17T03:36:18.611420+0000","last_peered":"2024-09-17T03:36:18.611420+0000","last_clean":"2024-09-17T03:36:18.611420+0000","last_became_active":"2024-09-17T03:36:18.606912+0000","last_became_peered":"2024-09-17T03:36:18.606912+0000","last_unstale":"2024-09-17T03:36:18.611420+0000","last_undegraded":"2024-09-17T03:36:18.611420+0000","last_fullsized":"2024-09-17T03:36:18.611420+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:24.342808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628326+0000","last_change":"2024-09-17T03:36:18.623471+0000","last_active":"2024-09-17T03:36:18.628326+0000","last_peered":"2024-09-17T03:36:18.628326+0000","last_clean":"2024-09-17T03:36:18.628326+0000","last_became_active":"2024-09-17T03:36:18.622892+0000","last_became_peered":"2024-09-17T03:36:18.622892+0000","last_unstale":"2024-09-17T03:36:18.628326+0000","last_undegraded":"2024-09-17T03:36:18.628326+0000","last_fullsized":"2024-09-17T03:36:18.628326+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:28.096453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628199+0000","last_change":"2024-09-17T03:36:18.622572+0000","last_active":"2024-09-17T03:36:18.628199+0000","last_peered":"2024-09-17T03:36:18.628199+0000","last_clean":"2024-09-17T03:36:18.628199+0000","last_became_active":"2024-09-17T03:36:18.618178+0000","last_became_peered":"2024-09-17T03:36:18.618178+0000","last_unstale":"2024-09-17T03:36:18.628199+0000","last_undegraded":"2024-09-17T03:36:18.628199+0000","last_fullsized":"2024-09-17T03:36:18.628199+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:11.516431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.615066+0000","last_change":"2024-09-17T03:36:18.607221+0000","last_active":"2024-09-17T03:36:18.615066+0000","last_peered":"2024-09-17T03:36:18.615066+0000","last_clean":"2024-09-17T03:36:18.615066+0000","last_became_active":"2024-09-17T03:36:18.606526+0000","last_became_peered":"2024-09-17T03:36:18.606526+0000","last_unstale":"2024-09-17T03:36:18.615066+0000","last_undegraded":"2024-09-17T03:36:18.615066+0000","last_fullsized":"2024-09-17T03:36:18.615066+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:40.215862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.607883+0000","last_change":"2024-09-17T03:36:18.604164+0000","last_active":"2024-09-17T03:36:18.607883+0000","last_peered":"2024-09-17T03:36:18.607883+0000","last_clean":"2024-09-17T03:36:18.607883+0000","last_became_active":"2024-09-17T03:36:18.603876+0000","last_became_peered":"2024-09-17T03:36:18.603876+0000","last_unstale":"2024-09-17T03:36:18.607883+0000","last_undegraded":"2024-09-17T03:36:18.607883+0000","last_fullsized":"2024-09-17T03:36:18.607883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:54.083331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613350+0000","last_change":"2024-09-17T03:36:18.606583+0000","last_active":"2024-09-17T03:36:18.613350+0000","last_peered":"2024-09-17T03:36:18.613350+0000","last_clean":"2024-09-17T03:36:18.613350+0000","last_became_active":"2024-09-17T03:36:18.606264+0000","last_became_peered":"2024-09-17T03:36:18.606264+0000","last_unstale":"2024-09-17T03:36:18.613350+0000","last_undegraded":"2024-09-17T03:36:18.613350+0000","last_fullsized":"2024-09-17T03:36:18.613350+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:25.923247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622790+0000","last_change":"2024-09-17T03:36:18.621086+0000","last_active":"2024-09-17T03:36:18.622790+0000","last_peered":"2024-09-17T03:36:18.622790+0000","last_clean":"2024-09-17T03:36:18.622790+0000","last_became_active":"2024-09-17T03:36:18.620045+0000","last_became_peered":"2024-09-17T03:36:18.620045+0000","last_unstale":"2024-09-17T03:36:18.622790+0000","last_undegraded":"2024-09-17T03:36:18.622790+0000","last_fullsized":"2024-09-17T03:36:18.622790+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:35.879493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620597+0000","last_change":"2024-09-17T03:36:18.619190+0000","last_active":"2024-09-17T03:36:18.620597+0000","last_peered":"2024-09-17T03:36:18.620597+0000","last_clean":"2024-09-17T03:36:18.620597+0000","last_became_active":"2024-09-17T03:36:18.618556+0000","last_became_peered":"2024-09-17T03:36:18.618556+0000","last_unstale":"2024-09-17T03:36:18.620597+0000","last_undegraded":"2024-09-17T03:36:18.620597+0000","last_fullsized":"2024-09-17T03:36:18.620597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.833899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601512+0000","last_change":"2024-09-17T03:36:18.600605+0000","last_active":"2024-09-17T03:36:18.601512+0000","last_peered":"2024-09-17T03:36:18.601512+0000","last_clean":"2024-09-17T03:36:18.601512+0000","last_became_active":"2024-09-17T03:36:18.600314+0000","last_became_peered":"2024-09-17T03:36:18.600314+0000","last_unstale":"2024-09-17T03:36:18.601512+0000","last_undegraded":"2024-09-17T03:36:18.601512+0000","last_fullsized":"2024-09-17T03:36:18.601512+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:19.575514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613424+0000","last_change":"2024-09-17T03:36:18.607175+0000","last_active":"2024-09-17T03:36:18.613424+0000","last_peered":"2024-09-17T03:36:18.613424+0000","last_clean":"2024-09-17T03:36:18.613424+0000","last_became_active":"2024-09-17T03:36:18.606339+0000","last_became_peered":"2024-09-17T03:36:18.606339+0000","last_unstale":"2024-09-17T03:36:18.613424+0000","last_undegraded":"2024-09-17T03:36:18.613424+0000","last_fullsized":"2024-09-17T03:36:18.613424+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:51.093115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623309+0000","last_change":"2024-09-17T03:36:18.622508+0000","last_active":"2024-09-17T03:36:18.623309+0000","last_peered":"2024-09-17T03:36:18.623309+0000","last_clean":"2024-09-17T03:36:18.623309+0000","last_became_active":"2024-09-17T03:36:18.622066+0000","last_became_peered":"2024-09-17T03:36:18.622066+0000","last_unstale":"2024-09-17T03:36:18.623309+0000","last_undegraded":"2024-09-17T03:36:18.623309+0000","last_fullsized":"2024-09-17T03:36:18.623309+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:20.384727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.630390+0000","last_change":"2024-09-17T03:36:17.585943+0000","last_active":"2024-09-17T03:36:18.630390+0000","last_peered":"2024-09-17T03:36:18.630390+0000","last_clean":"2024-09-17T03:36:18.630390+0000","last_became_active":"2024-09-17T03:36:17.585591+0000","last_became_peered":"2024-09-17T03:36:17.585591+0000","last_unstale":"2024-09-17T03:36:18.630390+0000","last_undegraded":"2024-09-17T03:36:18.630390+0000","last_fullsized":"2024-09-17T03:36:18.630390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:09.421144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622564+0000","last_change":"2024-09-17T03:36:18.620989+0000","last_active":"2024-09-17T03:36:18.622564+0000","last_peered":"2024-09-17T03:36:18.622564+0000","last_clean":"2024-09-17T03:36:18.622564+0000","last_became_active":"2024-09-17T03:36:18.620523+0000","last_became_peered":"2024-09-17T03:36:18.620523+0000","last_unstale":"2024-09-17T03:36:18.622564+0000","last_undegraded":"2024-09-17T03:36:18.622564+0000","last_fullsized":"2024-09-17T03:36:18.622564+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:04.316587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.578169+0000","last_change":"2024-09-17T03:36:16.578169+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.578169+0000","last_undegraded":"2024-09-17T03:36:16.578169+0000","last_fullsized":"2024-09-17T03:36:16.578169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613311+0000","last_change":"2024-09-17T03:36:18.608183+0000","last_active":"2024-09-17T03:36:18.613311+0000","last_peered":"2024-09-17T03:36:18.613311+0000","last_clean":"2024-09-17T03:36:18.613311+0000","last_became_active":"2024-09-17T03:36:18.607081+0000","last_became_peered":"2024-09-17T03:36:18.607081+0000","last_unstale":"2024-09-17T03:36:18.613311+0000","last_undegraded":"2024-09-17T03:36:18.613311+0000","last_fullsized":"2024-09-17T03:36:18.613311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:20.151030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628537+0000","last_change":"2024-09-17T03:36:17.586129+0000","last_active":"2024-09-17T03:36:18.628537+0000","last_peered":"2024-09-17T03:36:18.628537+0000","last_clean":"2024-09-17T03:36:18.628537+0000","last_became_active":"2024-09-17T03:36:17.585850+0000","last_became_peered":"2024-09-17T03:36:17.585850+0000","last_unstale":"2024-09-17T03:36:18.628537+0000","last_undegraded":"2024-09-17T03:36:18.628537+0000","last_fullsized":"2024-09-17T03:36:18.628537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:13.936211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623112+0000","last_change":"2024-09-17T03:36:18.620952+0000","last_active":"2024-09-17T03:36:18.623112+0000","last_peered":"2024-09-17T03:36:18.623112+0000","last_clean":"2024-09-17T03:36:18.623112+0000","last_became_active":"2024-09-17T03:36:18.620286+0000","last_became_peered":"2024-09-17T03:36:18.620286+0000","last_unstale":"2024-09-17T03:36:18.623112+0000","last_undegraded":"2024-09-17T03:36:18.623112+0000","last_fullsized":"2024-09-17T03:36:18.623112+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:48.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576151+0000","last_change":"2024-09-17T03:36:16.576151+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576151+0000","last_undegraded":"2024-09-17T03:36:16.576151+0000","last_fullsized":"2024-09-17T03:36:16.576151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.631561+0000","last_change":"2024-09-17T03:36:17.585520+0000","last_active":"2024-09-17T03:36:18.631561+0000","last_peered":"2024-09-17T03:36:18.631561+0000","last_clean":"2024-09-17T03:36:18.631561+0000","last_became_active":"2024-09-17T03:36:17.585226+0000","last_became_peered":"2024-09-17T03:36:17.585226+0000","last_unstale":"2024-09-17T03:36:18.631561+0000","last_undegraded":"2024-09-17T03:36:18.631561+0000","last_fullsized":"2024-09-17T03:36:18.631561+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:48.714528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628298+0000","last_change":"2024-09-17T03:36:17.584532+0000","last_active":"2024-09-17T03:36:18.628298+0000","last_peered":"2024-09-17T03:36:18.628298+0000","last_clean":"2024-09-17T03:36:18.628298+0000","last_became_active":"2024-09-17T03:36:17.584217+0000","last_became_peered":"2024-09-17T03:36:17.584217+0000","last_unstale":"2024-09-17T03:36:18.628298+0000","last_undegraded":"2024-09-17T03:36:18.628298+0000","last_fullsized":"2024-09-17T03:36:18.628298+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:49.597521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619975+0000","last_change":"2024-09-17T03:36:18.617026+0000","last_active":"2024-09-17T03:36:18.619975+0000","last_peered":"2024-09-17T03:36:18.619975+0000","last_clean":"2024-09-17T03:36:18.619975+0000","last_became_active":"2024-09-17T03:36:18.616713+0000","last_became_peered":"2024-09-17T03:36:18.616713+0000","last_unstale":"2024-09-17T03:36:18.619975+0000","last_undegraded":"2024-09-17T03:36:18.619975+0000","last_fullsized":"2024-09-17T03:36:18.619975+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:04.592223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576263+0000","last_change":"2024-09-17T03:36:16.576263+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576263+0000","last_undegraded":"2024-09-17T03:36:16.576263+0000","last_fullsized":"2024-09-17T03:36:16.576263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601290+0000","last_change":"2024-09-17T03:36:17.595365+0000","last_active":"2024-09-17T03:36:18.601290+0000","last_peered":"2024-09-17T03:36:18.601290+0000","last_clean":"2024-09-17T03:36:18.601290+0000","last_became_active":"2024-09-17T03:36:17.595025+0000","last_became_peered":"2024-09-17T03:36:17.595025+0000","last_unstale":"2024-09-17T03:36:18.601290+0000","last_undegraded":"2024-09-17T03:36:18.601290+0000","last_fullsized":"2024-09-17T03:36:18.601290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:44.064718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.619111+0000","last_change":"2024-09-17T03:36:18.613594+0000","last_active":"2024-09-17T03:36:18.619111+0000","last_peered":"2024-09-17T03:36:18.619111+0000","last_clean":"2024-09-17T03:36:18.619111+0000","last_became_active":"2024-09-17T03:36:18.613277+0000","last_became_peered":"2024-09-17T03:36:18.613277+0000","last_unstale":"2024-09-17T03:36:18.619111+0000","last_undegraded":"2024-09-17T03:36:18.619111+0000","last_fullsized":"2024-09-17T03:36:18.619111+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:52.293464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.610739+0000","last_change":"2024-09-17T03:36:17.595227+0000","last_active":"2024-09-17T03:36:18.610739+0000","last_peered":"2024-09-17T03:36:18.610739+0000","last_clean":"2024-09-17T03:36:18.610739+0000","last_became_active":"2024-09-17T03:36:17.594734+0000","last_became_peered":"2024-09-17T03:36:17.594734+0000","last_unstale":"2024-09-17T03:36:18.610739+0000","last_undegraded":"2024-09-17T03:36:18.610739+0000","last_fullsized":"2024-09-17T03:36:18.610739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:19.145953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.621716+0000","last_change":"2024-09-17T03:36:18.617682+0000","last_active":"2024-09-17T03:36:18.621716+0000","last_peered":"2024-09-17T03:36:18.621716+0000","last_clean":"2024-09-17T03:36:18.621716+0000","last_became_active":"2024-09-17T03:36:18.617304+0000","last_became_peered":"2024-09-17T03:36:18.617304+0000","last_unstale":"2024-09-17T03:36:18.621716+0000","last_undegraded":"2024-09-17T03:36:18.621716+0000","last_fullsized":"2024-09-17T03:36:18.621716+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:36.010214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.577512+0000","last_change":"2024-09-17T03:36:16.577512+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.577512+0000","last_undegraded":"2024-09-17T03:36:16.577512+0000","last_fullsized":"2024-09-17T03:36:16.577512+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612891+0000","last_change":"2024-09-17T03:36:18.605255+0000","last_active":"2024-09-17T03:36:18.612891+0000","last_peered":"2024-09-17T03:36:18.612891+0000","last_clean":"2024-09-17T03:36:18.612891+0000","last_became_active":"2024-09-17T03:36:18.604989+0000","last_became_peered":"2024-09-17T03:36:18.604989+0000","last_unstale":"2024-09-17T03:36:18.612891+0000","last_undegraded":"2024-09-17T03:36:18.612891+0000","last_fullsized":"2024-09-17T03:36:18.612891+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:09.275600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.631749+0000","last_change":"2024-09-17T03:36:17.590026+0000","last_active":"2024-09-17T03:36:18.631749+0000","last_peered":"2024-09-17T03:36:18.631749+0000","last_clean":"2024-09-17T03:36:18.631749+0000","last_became_active":"2024-09-17T03:36:17.589545+0000","last_became_peered":"2024-09-17T03:36:17.589545+0000","last_unstale":"2024-09-17T03:36:18.631749+0000","last_undegraded":"2024-09-17T03:36:18.631749+0000","last_fullsized":"2024-09-17T03:36:18.631749+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:50.088038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628375+0000","last_change":"2024-09-17T03:36:18.621917+0000","last_active":"2024-09-17T03:36:18.628375+0000","last_peered":"2024-09-17T03:36:18.628375+0000","last_clean":"2024-09-17T03:36:18.628375+0000","last_became_active":"2024-09-17T03:36:18.621591+0000","last_became_peered":"2024-09-17T03:36:18.621591+0000","last_unstale":"2024-09-17T03:36:18.628375+0000","last_undegraded":"2024-09-17T03:36:18.628375+0000","last_fullsized":"2024-09-17T03:36:18.628375+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:48.539605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.634430+0000","last_change":"2024-09-17T03:36:17.585567+0000","last_active":"2024-09-17T03:36:18.634430+0000","last_peered":"2024-09-17T03:36:18.634430+0000","last_clean":"2024-09-17T03:36:18.634430+0000","last_became_active":"2024-09-17T03:36:17.584661+0000","last_became_peered":"2024-09-17T03:36:17.584661+0000","last_unstale":"2024-09-17T03:36:18.634430+0000","last_undegraded":"2024-09-17T03:36:18.634430+0000","last_fullsized":"2024-09-17T03:36:18.634430+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:48.556283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.577486+0000","last_change":"2024-09-17T03:36:16.577486+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.577486+0000","last_undegraded":"2024-09-17T03:36:16.577486+0000","last_fullsized":"2024-09-17T03:36:16.577486+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628308+0000","last_change":"2024-09-17T03:36:18.623279+0000","last_active":"2024-09-17T03:36:18.628308+0000","last_peered":"2024-09-17T03:36:18.628308+0000","last_clean":"2024-09-17T03:36:18.628308+0000","last_became_active":"2024-09-17T03:36:18.622907+0000","last_became_peered":"2024-09-17T03:36:18.622907+0000","last_unstale":"2024-09-17T03:36:18.628308+0000","last_undegraded":"2024-09-17T03:36:18.628308+0000","last_fullsized":"2024-09-17T03:36:18.628308+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:49.263474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604610+0000","last_change":"2024-09-17T03:36:17.582775+0000","last_active":"2024-09-17T03:36:18.604610+0000","last_peered":"2024-09-17T03:36:18.604610+0000","last_clean":"2024-09-17T03:36:18.604610+0000","last_became_active":"2024-09-17T03:36:17.582451+0000","last_became_peered":"2024-09-17T03:36:17.582451+0000","last_unstale":"2024-09-17T03:36:18.604610+0000","last_undegraded":"2024-09-17T03:36:18.604610+0000","last_fullsized":"2024-09-17T03:36:18.604610+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:55.225494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.620916+0000","last_change":"2024-09-17T03:36:18.617154+0000","last_active":"2024-09-17T03:36:18.620916+0000","last_peered":"2024-09-17T03:36:18.620916+0000","last_clean":"2024-09-17T03:36:18.620916+0000","last_became_active":"2024-09-17T03:36:18.616817+0000","last_became_peered":"2024-09-17T03:36:18.616817+0000","last_unstale":"2024-09-17T03:36:18.620916+0000","last_undegraded":"2024-09-17T03:36:18.620916+0000","last_fullsized":"2024-09-17T03:36:18.620916+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:22.975493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575434+0000","last_change":"2024-09-17T03:36:16.575434+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575434+0000","last_undegraded":"2024-09-17T03:36:16.575434+0000","last_fullsized":"2024-09-17T03:36:16.575434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623796+0000","last_change":"2024-09-17T03:36:18.620650+0000","last_active":"2024-09-17T03:36:18.623796+0000","last_peered":"2024-09-17T03:36:18.623796+0000","last_clean":"2024-09-17T03:36:18.623796+0000","last_became_active":"2024-09-17T03:36:18.617859+0000","last_became_peered":"2024-09-17T03:36:18.617859+0000","last_unstale":"2024-09-17T03:36:18.623796+0000","last_undegraded":"2024-09-17T03:36:18.623796+0000","last_fullsized":"2024-09-17T03:36:18.623796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:01.225617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.634663+0000","last_change":"2024-09-17T03:36:17.586177+0000","last_active":"2024-09-17T03:36:18.634663+0000","last_peered":"2024-09-17T03:36:18.634663+0000","last_clean":"2024-09-17T03:36:18.634663+0000","last_became_active":"2024-09-17T03:36:17.585819+0000","last_became_peered":"2024-09-17T03:36:17.585819+0000","last_unstale":"2024-09-17T03:36:18.634663+0000","last_undegraded":"2024-09-17T03:36:18.634663+0000","last_fullsized":"2024-09-17T03:36:18.634663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:24.918171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.627961+0000","last_change":"2024-09-17T03:36:18.622200+0000","last_active":"2024-09-17T03:36:18.627961+0000","last_peered":"2024-09-17T03:36:18.627961+0000","last_clean":"2024-09-17T03:36:18.627961+0000","last_became_active":"2024-09-17T03:36:18.621839+0000","last_became_peered":"2024-09-17T03:36:18.621839+0000","last_unstale":"2024-09-17T03:36:18.627961+0000","last_undegraded":"2024-09-17T03:36:18.627961+0000","last_fullsized":"2024-09-17T03:36:18.627961+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:44.384105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576728+0000","last_change":"2024-09-17T03:36:16.576728+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576728+0000","last_undegraded":"2024-09-17T03:36:16.576728+0000","last_fullsized":"2024-09-17T03:36:16.576728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628263+0000","last_change":"2024-09-17T03:36:17.590872+0000","last_active":"2024-09-17T03:36:18.628263+0000","last_peered":"2024-09-17T03:36:18.628263+0000","last_clean":"2024-09-17T03:36:18.628263+0000","last_became_active":"2024-09-17T03:36:17.590501+0000","last_became_peered":"2024-09-17T03:36:17.590501+0000","last_unstale":"2024-09-17T03:36:18.628263+0000","last_undegraded":"2024-09-17T03:36:18.628263+0000","last_fullsized":"2024-09-17T03:36:18.628263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:28.794329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575557+0000","last_change":"2024-09-17T03:36:16.575557+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575557+0000","last_undegraded":"2024-09-17T03:36:16.575557+0000","last_fullsized":"2024-09-17T03:36:16.575557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.621198+0000","last_change":"2024-09-17T03:36:18.618941+0000","last_active":"2024-09-17T03:36:18.621198+0000","last_peered":"2024-09-17T03:36:18.621198+0000","last_clean":"2024-09-17T03:36:18.621198+0000","last_became_active":"2024-09-17T03:36:18.618611+0000","last_became_peered":"2024-09-17T03:36:18.618611+0000","last_unstale":"2024-09-17T03:36:18.621198+0000","last_undegraded":"2024-09-17T03:36:18.621198+0000","last_fullsized":"2024-09-17T03:36:18.621198+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:48.095260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.601821+0000","last_change":"2024-09-17T03:36:17.595452+0000","last_active":"2024-09-17T03:36:18.601821+0000","last_peered":"2024-09-17T03:36:18.601821+0000","last_clean":"2024-09-17T03:36:18.601821+0000","last_became_active":"2024-09-17T03:36:17.595094+0000","last_became_peered":"2024-09-17T03:36:17.595094+0000","last_unstale":"2024-09-17T03:36:18.601821+0000","last_undegraded":"2024-09-17T03:36:18.601821+0000","last_fullsized":"2024-09-17T03:36:18.601821+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:12.654766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576728+0000","last_change":"2024-09-17T03:36:16.576728+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576728+0000","last_undegraded":"2024-09-17T03:36:16.576728+0000","last_fullsized":"2024-09-17T03:36:16.576728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.615017+0000","last_change":"2024-09-17T03:36:18.610121+0000","last_active":"2024-09-17T03:36:18.615017+0000","last_peered":"2024-09-17T03:36:18.615017+0000","last_clean":"2024-09-17T03:36:18.615017+0000","last_became_active":"2024-09-17T03:36:18.606903+0000","last_became_peered":"2024-09-17T03:36:18.606903+0000","last_unstale":"2024-09-17T03:36:18.615017+0000","last_undegraded":"2024-09-17T03:36:18.615017+0000","last_fullsized":"2024-09-17T03:36:18.615017+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:36.010214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593684+0000","last_change":"2024-09-17T03:36:17.588176+0000","last_active":"2024-09-17T03:36:18.593684+0000","last_peered":"2024-09-17T03:36:18.593684+0000","last_clean":"2024-09-17T03:36:18.593684+0000","last_became_active":"2024-09-17T03:36:17.587563+0000","last_became_peered":"2024-09-17T03:36:17.587563+0000","last_unstale":"2024-09-17T03:36:18.593684+0000","last_undegraded":"2024-09-17T03:36:18.593684+0000","last_fullsized":"2024-09-17T03:36:18.593684+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:27.963949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.623117+0000","last_change":"2024-09-17T03:36:18.622275+0000","last_active":"2024-09-17T03:36:18.623117+0000","last_peered":"2024-09-17T03:36:18.623117+0000","last_clean":"2024-09-17T03:36:18.623117+0000","last_became_active":"2024-09-17T03:36:18.621983+0000","last_became_peered":"2024-09-17T03:36:18.621983+0000","last_unstale":"2024-09-17T03:36:18.623117+0000","last_undegraded":"2024-09-17T03:36:18.623117+0000","last_fullsized":"2024-09-17T03:36:18.623117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:01.225617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575452+0000","last_change":"2024-09-17T03:36:16.575452+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575452+0000","last_undegraded":"2024-09-17T03:36:16.575452+0000","last_fullsized":"2024-09-17T03:36:16.575452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.629109+0000","last_change":"2024-09-17T03:36:17.594225+0000","last_active":"2024-09-17T03:36:18.629109+0000","last_peered":"2024-09-17T03:36:18.629109+0000","last_clean":"2024-09-17T03:36:18.629109+0000","last_became_active":"2024-09-17T03:36:17.593916+0000","last_became_peered":"2024-09-17T03:36:17.593916+0000","last_unstale":"2024-09-17T03:36:18.629109+0000","last_undegraded":"2024-09-17T03:36:18.629109+0000","last_fullsized":"2024-09-17T03:36:18.629109+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:03.587147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.599453+0000","last_change":"2024-09-17T03:36:17.589681+0000","last_active":"2024-09-17T03:36:18.599453+0000","last_peered":"2024-09-17T03:36:18.599453+0000","last_clean":"2024-09-17T03:36:18.599453+0000","last_became_active":"2024-09-17T03:36:17.582742+0000","last_became_peered":"2024-09-17T03:36:17.582742+0000","last_unstale":"2024-09-17T03:36:18.599453+0000","last_undegraded":"2024-09-17T03:36:18.599453+0000","last_fullsized":"2024-09-17T03:36:18.599453+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:34.514226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.612864+0000","last_change":"2024-09-17T03:36:18.604528+0000","last_active":"2024-09-17T03:36:18.612864+0000","last_peered":"2024-09-17T03:36:18.612864+0000","last_clean":"2024-09-17T03:36:18.612864+0000","last_became_active":"2024-09-17T03:36:18.604264+0000","last_became_peered":"2024-09-17T03:36:18.604264+0000","last_unstale":"2024-09-17T03:36:18.612864+0000","last_undegraded":"2024-09-17T03:36:18.612864+0000","last_fullsized":"2024-09-17T03:36:18.612864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:08.252388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604689+0000","last_change":"2024-09-17T03:36:17.580793+0000","last_active":"2024-09-17T03:36:18.604689+0000","last_peered":"2024-09-17T03:36:18.604689+0000","last_clean":"2024-09-17T03:36:18.604689+0000","last_became_active":"2024-09-17T03:36:17.580470+0000","last_became_peered":"2024-09-17T03:36:17.580470+0000","last_unstale":"2024-09-17T03:36:18.604689+0000","last_undegraded":"2024-09-17T03:36:18.604689+0000","last_fullsized":"2024-09-17T03:36:18.604689+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:25.063641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.622663+0000","last_change":"2024-09-17T03:36:18.621036+0000","last_active":"2024-09-17T03:36:18.622663+0000","last_peered":"2024-09-17T03:36:18.622663+0000","last_clean":"2024-09-17T03:36:18.622663+0000","last_became_active":"2024-09-17T03:36:18.620667+0000","last_became_peered":"2024-09-17T03:36:18.620667+0000","last_unstale":"2024-09-17T03:36:18.622663+0000","last_undegraded":"2024-09-17T03:36:18.622663+0000","last_fullsized":"2024-09-17T03:36:18.622663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.833899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.575534+0000","last_change":"2024-09-17T03:36:16.575534+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.575534+0000","last_undegraded":"2024-09-17T03:36:16.575534+0000","last_fullsized":"2024-09-17T03:36:16.575534+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593735+0000","last_change":"2024-09-17T03:36:17.587591+0000","last_active":"2024-09-17T03:36:18.593735+0000","last_peered":"2024-09-17T03:36:18.593735+0000","last_clean":"2024-09-17T03:36:18.593735+0000","last_became_active":"2024-09-17T03:36:17.586959+0000","last_became_peered":"2024-09-17T03:36:17.586959+0000","last_unstale":"2024-09-17T03:36:18.593735+0000","last_undegraded":"2024-09-17T03:36:18.593735+0000","last_fullsized":"2024-09-17T03:36:18.593735+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:39.210785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.628007+0000","last_change":"2024-09-17T03:36:18.622306+0000","last_active":"2024-09-17T03:36:18.628007+0000","last_peered":"2024-09-17T03:36:18.628007+0000","last_clean":"2024-09-17T03:36:18.628007+0000","last_became_active":"2024-09-17T03:36:18.619448+0000","last_became_peered":"2024-09-17T03:36:18.619448+0000","last_unstale":"2024-09-17T03:36:18.628007+0000","last_undegraded":"2024-09-17T03:36:18.628007+0000","last_fullsized":"2024-09-17T03:36:18.628007+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:58.826782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.603333+0000","last_change":"2024-09-17T03:36:17.578097+0000","last_active":"2024-09-17T03:36:18.603333+0000","last_peered":"2024-09-17T03:36:18.603333+0000","last_clean":"2024-09-17T03:36:18.603333+0000","last_became_active":"2024-09-17T03:36:17.577678+0000","last_became_peered":"2024-09-17T03:36:17.577678+0000","last_unstale":"2024-09-17T03:36:18.603333+0000","last_undegraded":"2024-09-17T03:36:18.603333+0000","last_fullsized":"2024-09-17T03:36:18.603333+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:16.042540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.613221+0000","last_change":"2024-09-17T03:36:18.609081+0000","last_active":"2024-09-17T03:36:18.613221+0000","last_peered":"2024-09-17T03:36:18.613221+0000","last_clean":"2024-09-17T03:36:18.613221+0000","last_became_active":"2024-09-17T03:36:18.608778+0000","last_became_peered":"2024-09-17T03:36:18.608778+0000","last_unstale":"2024-09-17T03:36:18.613221+0000","last_undegraded":"2024-09-17T03:36:18.613221+0000","last_fullsized":"2024-09-17T03:36:18.613221+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:10.837612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.593669+0000","last_change":"2024-09-17T03:36:17.595198+0000","last_active":"2024-09-17T03:36:18.593669+0000","last_peered":"2024-09-17T03:36:18.593669+0000","last_clean":"2024-09-17T03:36:18.593669+0000","last_became_active":"2024-09-17T03:36:17.594848+0000","last_became_peered":"2024-09-17T03:36:17.594848+0000","last_unstale":"2024-09-17T03:36:18.593669+0000","last_undegraded":"2024-09-17T03:36:18.593669+0000","last_fullsized":"2024-09-17T03:36:18.593669+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.483843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:36:16.576072+0000","last_change":"2024-09-17T03:36:16.576072+0000","last_active":"2024-09-17T03:36:16.562941+0000","last_peered":"2024-09-17T03:36:16.562941+0000","last_clean":"2024-09-17T03:36:16.562941+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:16.576072+0000","last_undegraded":"2024-09-17T03:36:16.576072+0000","last_fullsized":"2024-09-17T03:36:16.576072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:17.568018+0000","last_change":"2024-09-17T03:36:17.568018+0000","last_active":"2024-09-17T03:36:17.568018+0000","last_peered":"2024-09-17T03:36:17.568018+0000","last_clean":"2024-09-17T03:36:17.568018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:17.568018+0000","last_undegraded":"2024-09-17T03:36:17.568018+0000","last_fullsized":"2024-09-17T03:36:17.568018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.604804+0000","last_change":"2024-09-17T03:36:17.587385+0000","last_active":"2024-09-17T03:36:18.604804+0000","last_peered":"2024-09-17T03:36:18.604804+0000","last_clean":"2024-09-17T03:36:18.604804+0000","last_became_active":"2024-09-17T03:36:17.586929+0000","last_became_peered":"2024-09-17T03:36:17.586929+0000","last_unstale":"2024-09-17T03:36:18.604804+0000","last_undegraded":"2024-09-17T03:36:18.604804+0000","last_fullsized":"2024-09-17T03:36:18.604804+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.483843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":178,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:36:18.608022+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:36:18.608022+0000","last_peered":"2024-09-17T03:36:18.608022+0000","last_clean":"2024-09-17T03:36:18.608022+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:36:18.608022+0000","last_undegraded":"2024-09-17T03:36:18.608022+0000","last_fullsized":"2024-09-17T03:36:18.608022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2284,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36604,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335236,"statfs":{"total":96636764160,"available":96599281664,"internally_reserved":0,"allocated":1277952,"data_stored":871058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":675840,"data_stored":280530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40188,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331652,"statfs":{"total":96636764160,"available":96595611648,"internally_reserved":0,"allocated":688128,"data_stored":282142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36024,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335816,"statfs":{"total":96636764160,"available":96599875584,"internally_reserved":0,"allocated":684032,"data_stored":280586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":679936,"data_stored":280620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":873092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":267488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":267488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:26.067 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:36:26.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.193+0000 7fdf1e107640 1 -- 172.21.15.146:0/1613741683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf18153a60 msgr2=0x7fdf1815d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.193+0000 7fdf1e107640 1 --2- 172.21.15.146:0/1613741683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf18153a60 0x7fdf1815d980 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdf18071c40 tx=0x7fdf0802a560 comp rx=0 tx=0).stop 2024-09-17T03:36:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.193+0000 7fdf1e107640 1 -- 172.21.15.146:0/1613741683 shutdown_connections 2024-09-17T03:36:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.193+0000 7fdf1e107640 1 --2- 172.21.15.146:0/1613741683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf18073480 0x7fdf18073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.193+0000 7fdf1e107640 1 --2- 172.21.15.146:0/1613741683 >> v2:172.21.15.179:3300/0 conn(0x7fdf181604f0 0x7fdf18160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.193+0000 7fdf1e107640 1 --2- 172.21.15.146:0/1613741683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf18153a60 0x7fdf1815d980 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.193+0000 7fdf1e107640 1 -- 172.21.15.146:0/1613741683 >> 172.21.15.146:0/1613741683 conn(0x7fdf180b2060 msgr2=0x7fdf180b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.193+0000 7fdf1e107640 1 -- 172.21.15.146:0/1613741683 shutdown_connections 2024-09-17T03:36:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.193+0000 7fdf1e107640 1 -- 172.21.15.146:0/1613741683 wait complete. 2024-09-17T03:36:26.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.195+0000 7fdf1e107640 1 Processor -- start 2024-09-17T03:36:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.195+0000 7fdf1e107640 1 -- start start 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf1e107640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf18073480 0x7fdf180b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf1e107640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf18153a60 0x7fdf181f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf1e107640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf181604f0 0x7fdf18148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf1e107640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdf18073dd0 con 0x7fdf18073480 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf1e107640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1806f830 con 0x7fdf18153a60 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf1e107640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdf18073f50 con 0x7fdf181604f0 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf177fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf18073480 0x7fdf180b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf177fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf18073480 0x7fdf180b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48176/0 (socket says 172.21.15.146:48176) 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf177fe640 1 -- 172.21.15.146:0/608253376 learned_addr learned my addr 172.21.15.146:0/608253376 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf16ffd640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf18153a60 0x7fdf181f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf17fff640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf181604f0 0x7fdf18148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf177fe640 1 -- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf181604f0 msgr2=0x7fdf18148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf177fe640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf181604f0 0x7fdf18148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf177fe640 1 -- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf18153a60 msgr2=0x7fdf181f6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf177fe640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf18153a60 0x7fdf181f6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf177fe640 1 -- 172.21.15.146:0/608253376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf181493b0 con 0x7fdf18073480 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.196+0000 7fdf16ffd640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf18153a60 0x7fdf181f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.197+0000 7fdf177fe640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf18073480 0x7fdf180b3460 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdf08034040 tx=0x7fdf08003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.197+0000 7fdefffff640 1 -- 172.21.15.146:0/608253376 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0803e030 con 0x7fdf18073480 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.197+0000 7fdefffff640 1 -- 172.21.15.146:0/608253376 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf08003e00 con 0x7fdf18073480 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.197+0000 7fdf1e107640 1 -- 172.21.15.146:0/608253376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf180d03f0 con 0x7fdf18073480 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.197+0000 7fdefffff640 1 -- 172.21.15.146:0/608253376 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08035040 con 0x7fdf18073480 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.197+0000 7fdf1e107640 1 -- 172.21.15.146:0/608253376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf18154120 con 0x7fdf18073480 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.198+0000 7fdf1e107640 1 -- 172.21.15.146:0/608253376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf1815d980 con 0x7fdf18073480 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.199+0000 7fdefffff640 1 -- 172.21.15.146:0/608253376 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf08041030 con 0x7fdf18073480 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.199+0000 7fdefffff640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf04078bc0 0x7fdf0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.199+0000 7fdefffff640 1 -- 172.21.15.146:0/608253376 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fdf080bb910 con 0x7fdf18073480 2024-09-17T03:36:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.200+0000 7fdf16ffd640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf04078bc0 0x7fdf0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.200+0000 7fdf16ffd640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf04078bc0 0x7fdf0407b0d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c005d20 tx=0x7fdf0c005e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:26.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.203+0000 7fdefffff640 1 -- 172.21.15.146:0/608253376 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdf181493b0 con 0x7fdf18073480 2024-09-17T03:36:26.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.373+0000 7fdf1e107640 1 -- 172.21.15.146:0/608253376 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf180d0b40 con 0x7fdf04078bc0 2024-09-17T03:36:26.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.378+0000 7fdefffff640 1 -- 172.21.15.146:0/608253376 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251892 (secure 0 0 0) 0x7fdf180d0b40 con 0x7fdf04078bc0 2024-09-17T03:36:26.381 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:26.382 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:36:26.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 -- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf04078bc0 msgr2=0x7fdf0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf04078bc0 0x7fdf0407b0d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c005d20 tx=0x7fdf0c005e20 comp rx=0 tx=0).stop 2024-09-17T03:36:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 -- 172.21.15.146:0/608253376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf18073480 msgr2=0x7fdf180b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf18073480 0x7fdf180b3460 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdf08034040 tx=0x7fdf08003910 comp rx=0 tx=0).stop 2024-09-17T03:36:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 -- 172.21.15.146:0/608253376 shutdown_connections 2024-09-17T03:36:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf04078bc0 0x7fdf0407b0d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf181604f0 0x7fdf18148e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf18153a60 0x7fdf181f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 --2- 172.21.15.146:0/608253376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf18073480 0x7fdf180b3460 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 -- 172.21.15.146:0/608253376 >> 172.21.15.146:0/608253376 conn(0x7fdf180b2060 msgr2=0x7fdf1806e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 -- 172.21.15.146:0/608253376 shutdown_connections 2024-09-17T03:36:26.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.382+0000 7fdf1e107640 1 -- 172.21.15.146:0/608253376 wait complete. 2024-09-17T03:36:26.393 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-17T03:36:25.841552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289400,"kb_used_data":6600,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685320,"statfs":{"total":773094113280,"available":772797767680,"internally_reserved":0,"allocated":6758400,"data_stored":3480196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":289394225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002026"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.594543+0000","last_change":"2024-09-17T03:36:18.607189+0000","last_active":"2024-09-17T03:36:19.594543+0000","last_peered":"2024-09-17T03:36:19.594543+0000","last_clean":"2024-09-17T03:36:19.594543+0000","last_became_active":"2024-09-17T03:36:18.606849+0000","last_became_peered":"2024-09-17T03:36:18.606849+0000","last_unstale":"2024-09-17T03:36:19.594543+0000","last_undegraded":"2024-09-17T03:36:19.594543+0000","last_fullsized":"2024-09-17T03:36:19.594543+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:54.521318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845858+0000","last_change":"2024-09-17T03:36:18.605059+0000","last_active":"2024-09-17T03:36:19.845858+0000","last_peered":"2024-09-17T03:36:19.845858+0000","last_clean":"2024-09-17T03:36:19.845858+0000","last_became_active":"2024-09-17T03:36:18.604766+0000","last_became_peered":"2024-09-17T03:36:18.604766+0000","last_unstale":"2024-09-17T03:36:19.845858+0000","last_undegraded":"2024-09-17T03:36:19.845858+0000","last_fullsized":"2024-09-17T03:36:19.845858+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:32.612113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.597569+0000","last_change":"2024-09-17T03:36:18.621325+0000","last_active":"2024-09-17T03:36:19.597569+0000","last_peered":"2024-09-17T03:36:19.597569+0000","last_clean":"2024-09-17T03:36:19.597569+0000","last_became_active":"2024-09-17T03:36:18.621005+0000","last_became_peered":"2024-09-17T03:36:18.621005+0000","last_unstale":"2024-09-17T03:36:19.597569+0000","last_undegraded":"2024-09-17T03:36:19.597569+0000","last_fullsized":"2024-09-17T03:36:19.597569+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:18.995516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.847030+0000","last_change":"2024-09-17T03:36:18.619468+0000","last_active":"2024-09-17T03:36:19.847030+0000","last_peered":"2024-09-17T03:36:19.847030+0000","last_clean":"2024-09-17T03:36:19.847030+0000","last_became_active":"2024-09-17T03:36:18.619161+0000","last_became_peered":"2024-09-17T03:36:18.619161+0000","last_unstale":"2024-09-17T03:36:19.847030+0000","last_undegraded":"2024-09-17T03:36:19.847030+0000","last_fullsized":"2024-09-17T03:36:19.847030+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:54.684223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.594556+0000","last_change":"2024-09-17T03:36:18.620461+0000","last_active":"2024-09-17T03:36:19.594556+0000","last_peered":"2024-09-17T03:36:19.594556+0000","last_clean":"2024-09-17T03:36:19.594556+0000","last_became_active":"2024-09-17T03:36:18.620111+0000","last_became_peered":"2024-09-17T03:36:18.620111+0000","last_unstale":"2024-09-17T03:36:19.594556+0000","last_undegraded":"2024-09-17T03:36:19.594556+0000","last_fullsized":"2024-09-17T03:36:19.594556+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:15.659339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614284+0000","last_change":"2024-09-17T03:36:18.601730+0000","last_active":"2024-09-17T03:36:19.614284+0000","last_peered":"2024-09-17T03:36:19.614284+0000","last_clean":"2024-09-17T03:36:19.614284+0000","last_became_active":"2024-09-17T03:36:18.601442+0000","last_became_peered":"2024-09-17T03:36:18.601442+0000","last_unstale":"2024-09-17T03:36:19.614284+0000","last_undegraded":"2024-09-17T03:36:19.614284+0000","last_fullsized":"2024-09-17T03:36:19.614284+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:58.826782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845884+0000","last_change":"2024-09-17T03:36:18.617518+0000","last_active":"2024-09-17T03:36:19.845884+0000","last_peered":"2024-09-17T03:36:19.845884+0000","last_clean":"2024-09-17T03:36:19.845884+0000","last_became_active":"2024-09-17T03:36:18.617017+0000","last_became_peered":"2024-09-17T03:36:18.617017+0000","last_unstale":"2024-09-17T03:36:19.845884+0000","last_undegraded":"2024-09-17T03:36:19.845884+0000","last_fullsized":"2024-09-17T03:36:19.845884+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:50.745884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845052+0000","last_change":"2024-09-17T03:36:18.605256+0000","last_active":"2024-09-17T03:36:19.845052+0000","last_peered":"2024-09-17T03:36:19.845052+0000","last_clean":"2024-09-17T03:36:19.845052+0000","last_became_active":"2024-09-17T03:36:18.604860+0000","last_became_peered":"2024-09-17T03:36:18.604860+0000","last_unstale":"2024-09-17T03:36:19.845052+0000","last_undegraded":"2024-09-17T03:36:19.845052+0000","last_fullsized":"2024-09-17T03:36:19.845052+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:01.602353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846606+0000","last_change":"2024-09-17T03:36:18.611502+0000","last_active":"2024-09-17T03:36:19.846606+0000","last_peered":"2024-09-17T03:36:19.846606+0000","last_clean":"2024-09-17T03:36:19.846606+0000","last_became_active":"2024-09-17T03:36:18.611076+0000","last_became_peered":"2024-09-17T03:36:18.611076+0000","last_unstale":"2024-09-17T03:36:19.846606+0000","last_undegraded":"2024-09-17T03:36:19.846606+0000","last_fullsized":"2024-09-17T03:36:19.846606+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:33.402441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845248+0000","last_change":"2024-09-17T03:36:18.608871+0000","last_active":"2024-09-17T03:36:19.845248+0000","last_peered":"2024-09-17T03:36:19.845248+0000","last_clean":"2024-09-17T03:36:19.845248+0000","last_became_active":"2024-09-17T03:36:18.608525+0000","last_became_peered":"2024-09-17T03:36:18.608525+0000","last_unstale":"2024-09-17T03:36:19.845248+0000","last_undegraded":"2024-09-17T03:36:19.845248+0000","last_fullsized":"2024-09-17T03:36:19.845248+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:42.472935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845454+0000","last_change":"2024-09-17T03:36:18.607137+0000","last_active":"2024-09-17T03:36:19.845454+0000","last_peered":"2024-09-17T03:36:19.845454+0000","last_clean":"2024-09-17T03:36:19.845454+0000","last_became_active":"2024-09-17T03:36:18.606832+0000","last_became_peered":"2024-09-17T03:36:18.606832+0000","last_unstale":"2024-09-17T03:36:19.845454+0000","last_undegraded":"2024-09-17T03:36:19.845454+0000","last_fullsized":"2024-09-17T03:36:19.845454+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:25.548298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846975+0000","last_change":"2024-09-17T03:36:18.623905+0000","last_active":"2024-09-17T03:36:19.846975+0000","last_peered":"2024-09-17T03:36:19.846975+0000","last_clean":"2024-09-17T03:36:19.846975+0000","last_became_active":"2024-09-17T03:36:18.623593+0000","last_became_peered":"2024-09-17T03:36:18.623593+0000","last_unstale":"2024-09-17T03:36:19.846975+0000","last_undegraded":"2024-09-17T03:36:19.846975+0000","last_fullsized":"2024-09-17T03:36:19.846975+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:08.699305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.596107+0000","last_change":"2024-09-17T03:36:18.606718+0000","last_active":"2024-09-17T03:36:19.596107+0000","last_peered":"2024-09-17T03:36:19.596107+0000","last_clean":"2024-09-17T03:36:19.596107+0000","last_became_active":"2024-09-17T03:36:18.606359+0000","last_became_peered":"2024-09-17T03:36:18.606359+0000","last_unstale":"2024-09-17T03:36:19.596107+0000","last_undegraded":"2024-09-17T03:36:19.596107+0000","last_fullsized":"2024-09-17T03:36:19.596107+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:54.654060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845810+0000","last_change":"2024-09-17T03:36:18.609437+0000","last_active":"2024-09-17T03:36:19.845810+0000","last_peered":"2024-09-17T03:36:19.845810+0000","last_clean":"2024-09-17T03:36:19.845810+0000","last_became_active":"2024-09-17T03:36:18.609134+0000","last_became_peered":"2024-09-17T03:36:18.609134+0000","last_unstale":"2024-09-17T03:36:19.845810+0000","last_undegraded":"2024-09-17T03:36:19.845810+0000","last_fullsized":"2024-09-17T03:36:19.845810+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:41.216339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846067+0000","last_change":"2024-09-17T03:36:18.614518+0000","last_active":"2024-09-17T03:36:19.846067+0000","last_peered":"2024-09-17T03:36:19.846067+0000","last_clean":"2024-09-17T03:36:19.846067+0000","last_became_active":"2024-09-17T03:36:18.614218+0000","last_became_peered":"2024-09-17T03:36:18.614218+0000","last_unstale":"2024-09-17T03:36:19.846067+0000","last_undegraded":"2024-09-17T03:36:19.846067+0000","last_fullsized":"2024-09-17T03:36:19.846067+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:57.823541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614259+0000","last_change":"2024-09-17T03:36:18.608914+0000","last_active":"2024-09-17T03:36:19.614259+0000","last_peered":"2024-09-17T03:36:19.614259+0000","last_clean":"2024-09-17T03:36:19.614259+0000","last_became_active":"2024-09-17T03:36:18.608524+0000","last_became_peered":"2024-09-17T03:36:18.608524+0000","last_unstale":"2024-09-17T03:36:19.614259+0000","last_undegraded":"2024-09-17T03:36:19.614259+0000","last_fullsized":"2024-09-17T03:36:19.614259+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:48.539605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845529+0000","last_change":"2024-09-17T03:36:18.607704+0000","last_active":"2024-09-17T03:36:19.845529+0000","last_peered":"2024-09-17T03:36:19.845529+0000","last_clean":"2024-09-17T03:36:19.845529+0000","last_became_active":"2024-09-17T03:36:18.607408+0000","last_became_peered":"2024-09-17T03:36:18.607408+0000","last_unstale":"2024-09-17T03:36:19.845529+0000","last_undegraded":"2024-09-17T03:36:19.845529+0000","last_fullsized":"2024-09-17T03:36:19.845529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:49.395527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.596949+0000","last_change":"2024-09-17T03:36:18.616908+0000","last_active":"2024-09-17T03:36:19.596949+0000","last_peered":"2024-09-17T03:36:19.596949+0000","last_clean":"2024-09-17T03:36:19.596949+0000","last_became_active":"2024-09-17T03:36:18.616582+0000","last_became_peered":"2024-09-17T03:36:18.616582+0000","last_unstale":"2024-09-17T03:36:19.596949+0000","last_undegraded":"2024-09-17T03:36:19.596949+0000","last_fullsized":"2024-09-17T03:36:19.596949+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:55.899911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.594706+0000","last_change":"2024-09-17T03:36:18.607199+0000","last_active":"2024-09-17T03:36:19.594706+0000","last_peered":"2024-09-17T03:36:19.594706+0000","last_clean":"2024-09-17T03:36:19.594706+0000","last_became_active":"2024-09-17T03:36:18.606912+0000","last_became_peered":"2024-09-17T03:36:18.606912+0000","last_unstale":"2024-09-17T03:36:19.594706+0000","last_undegraded":"2024-09-17T03:36:19.594706+0000","last_fullsized":"2024-09-17T03:36:19.594706+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:41.340347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845438+0000","last_change":"2024-09-17T03:36:18.608607+0000","last_active":"2024-09-17T03:36:19.845438+0000","last_peered":"2024-09-17T03:36:19.845438+0000","last_clean":"2024-09-17T03:36:19.845438+0000","last_became_active":"2024-09-17T03:36:18.608314+0000","last_became_peered":"2024-09-17T03:36:18.608314+0000","last_unstale":"2024-09-17T03:36:19.845438+0000","last_undegraded":"2024-09-17T03:36:19.845438+0000","last_fullsized":"2024-09-17T03:36:19.845438+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:32.351140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.596739+0000","last_change":"2024-09-17T03:36:18.623471+0000","last_active":"2024-09-17T03:36:19.596739+0000","last_peered":"2024-09-17T03:36:19.596739+0000","last_clean":"2024-09-17T03:36:19.596739+0000","last_became_active":"2024-09-17T03:36:18.622892+0000","last_became_peered":"2024-09-17T03:36:18.622892+0000","last_unstale":"2024-09-17T03:36:19.596739+0000","last_undegraded":"2024-09-17T03:36:19.596739+0000","last_fullsized":"2024-09-17T03:36:19.596739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:00.539092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845974+0000","last_change":"2024-09-17T03:36:18.610507+0000","last_active":"2024-09-17T03:36:19.845974+0000","last_peered":"2024-09-17T03:36:19.845974+0000","last_clean":"2024-09-17T03:36:19.845974+0000","last_became_active":"2024-09-17T03:36:18.610243+0000","last_became_peered":"2024-09-17T03:36:18.610243+0000","last_unstale":"2024-09-17T03:36:19.845974+0000","last_undegraded":"2024-09-17T03:36:19.845974+0000","last_fullsized":"2024-09-17T03:36:19.845974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:13.875219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.597217+0000","last_change":"2024-09-17T03:36:18.622572+0000","last_active":"2024-09-17T03:36:19.597217+0000","last_peered":"2024-09-17T03:36:19.597217+0000","last_clean":"2024-09-17T03:36:19.597217+0000","last_became_active":"2024-09-17T03:36:18.618178+0000","last_became_peered":"2024-09-17T03:36:18.618178+0000","last_unstale":"2024-09-17T03:36:19.597217+0000","last_undegraded":"2024-09-17T03:36:19.597217+0000","last_fullsized":"2024-09-17T03:36:19.597217+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:29.600214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.595953+0000","last_change":"2024-09-17T03:36:18.607221+0000","last_active":"2024-09-17T03:36:19.595953+0000","last_peered":"2024-09-17T03:36:19.595953+0000","last_clean":"2024-09-17T03:36:19.595953+0000","last_became_active":"2024-09-17T03:36:18.606526+0000","last_became_peered":"2024-09-17T03:36:18.606526+0000","last_unstale":"2024-09-17T03:36:19.595953+0000","last_undegraded":"2024-09-17T03:36:19.595953+0000","last_fullsized":"2024-09-17T03:36:19.595953+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:46.544837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.594767+0000","last_change":"2024-09-17T03:36:18.604164+0000","last_active":"2024-09-17T03:36:19.594767+0000","last_peered":"2024-09-17T03:36:19.594767+0000","last_clean":"2024-09-17T03:36:19.594767+0000","last_became_active":"2024-09-17T03:36:18.603876+0000","last_became_peered":"2024-09-17T03:36:18.603876+0000","last_unstale":"2024-09-17T03:36:19.594767+0000","last_undegraded":"2024-09-17T03:36:19.594767+0000","last_fullsized":"2024-09-17T03:36:19.594767+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:34.426493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846823+0000","last_change":"2024-09-17T03:36:18.620715+0000","last_active":"2024-09-17T03:36:19.846823+0000","last_peered":"2024-09-17T03:36:19.846823+0000","last_clean":"2024-09-17T03:36:19.846823+0000","last_became_active":"2024-09-17T03:36:18.620096+0000","last_became_peered":"2024-09-17T03:36:18.620096+0000","last_unstale":"2024-09-17T03:36:19.846823+0000","last_undegraded":"2024-09-17T03:36:19.846823+0000","last_fullsized":"2024-09-17T03:36:19.846823+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:41.034192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614580+0000","last_change":"2024-09-17T03:36:18.606583+0000","last_active":"2024-09-17T03:36:19.614580+0000","last_peered":"2024-09-17T03:36:19.614580+0000","last_clean":"2024-09-17T03:36:19.614580+0000","last_became_active":"2024-09-17T03:36:18.606264+0000","last_became_peered":"2024-09-17T03:36:18.606264+0000","last_unstale":"2024-09-17T03:36:19.614580+0000","last_undegraded":"2024-09-17T03:36:19.614580+0000","last_fullsized":"2024-09-17T03:36:19.614580+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:28.827568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.594706+0000","last_change":"2024-09-17T03:36:18.621086+0000","last_active":"2024-09-17T03:36:19.594706+0000","last_peered":"2024-09-17T03:36:19.594706+0000","last_clean":"2024-09-17T03:36:19.594706+0000","last_became_active":"2024-09-17T03:36:18.620045+0000","last_became_peered":"2024-09-17T03:36:18.620045+0000","last_unstale":"2024-09-17T03:36:19.594706+0000","last_undegraded":"2024-09-17T03:36:19.594706+0000","last_fullsized":"2024-09-17T03:36:19.594706+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:47.893207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846461+0000","last_change":"2024-09-17T03:36:18.622325+0000","last_active":"2024-09-17T03:36:19.846461+0000","last_peered":"2024-09-17T03:36:19.846461+0000","last_clean":"2024-09-17T03:36:19.846461+0000","last_became_active":"2024-09-17T03:36:18.622069+0000","last_became_peered":"2024-09-17T03:36:18.622069+0000","last_unstale":"2024-09-17T03:36:19.846461+0000","last_undegraded":"2024-09-17T03:36:19.846461+0000","last_fullsized":"2024-09-17T03:36:19.846461+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:30.459324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.596349+0000","last_change":"2024-09-17T03:36:18.619190+0000","last_active":"2024-09-17T03:36:19.596349+0000","last_peered":"2024-09-17T03:36:19.596349+0000","last_clean":"2024-09-17T03:36:19.596349+0000","last_became_active":"2024-09-17T03:36:18.618556+0000","last_became_peered":"2024-09-17T03:36:18.618556+0000","last_unstale":"2024-09-17T03:36:19.596349+0000","last_undegraded":"2024-09-17T03:36:19.596349+0000","last_fullsized":"2024-09-17T03:36:19.596349+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:36.451682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.594401+0000","last_change":"2024-09-17T03:36:18.600605+0000","last_active":"2024-09-17T03:36:19.594401+0000","last_peered":"2024-09-17T03:36:19.594401+0000","last_clean":"2024-09-17T03:36:19.594401+0000","last_became_active":"2024-09-17T03:36:18.600314+0000","last_became_peered":"2024-09-17T03:36:18.600314+0000","last_unstale":"2024-09-17T03:36:19.594401+0000","last_undegraded":"2024-09-17T03:36:19.594401+0000","last_fullsized":"2024-09-17T03:36:19.594401+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:41.045275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614271+0000","last_change":"2024-09-17T03:36:18.607175+0000","last_active":"2024-09-17T03:36:19.614271+0000","last_peered":"2024-09-17T03:36:19.614271+0000","last_clean":"2024-09-17T03:36:19.614271+0000","last_became_active":"2024-09-17T03:36:18.606339+0000","last_became_peered":"2024-09-17T03:36:18.606339+0000","last_unstale":"2024-09-17T03:36:19.614271+0000","last_undegraded":"2024-09-17T03:36:19.614271+0000","last_fullsized":"2024-09-17T03:36:19.614271+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:53.419307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614702+0000","last_change":"2024-09-17T03:36:18.622508+0000","last_active":"2024-09-17T03:36:19.614702+0000","last_peered":"2024-09-17T03:36:19.614702+0000","last_clean":"2024-09-17T03:36:19.614702+0000","last_became_active":"2024-09-17T03:36:18.622066+0000","last_became_peered":"2024-09-17T03:36:18.622066+0000","last_unstale":"2024-09-17T03:36:19.614702+0000","last_undegraded":"2024-09-17T03:36:19.614702+0000","last_fullsized":"2024-09-17T03:36:19.614702+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:57.956100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614603+0000","last_change":"2024-09-17T03:36:17.585943+0000","last_active":"2024-09-17T03:36:19.614603+0000","last_peered":"2024-09-17T03:36:19.614603+0000","last_clean":"2024-09-17T03:36:19.614603+0000","last_became_active":"2024-09-17T03:36:17.585591+0000","last_became_peered":"2024-09-17T03:36:17.585591+0000","last_unstale":"2024-09-17T03:36:19.614603+0000","last_undegraded":"2024-09-17T03:36:19.614603+0000","last_fullsized":"2024-09-17T03:36:19.614603+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:09.421144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846031+0000","last_change":"2024-09-17T03:36:18.620989+0000","last_active":"2024-09-17T03:36:19.846031+0000","last_peered":"2024-09-17T03:36:19.846031+0000","last_clean":"2024-09-17T03:36:19.846031+0000","last_became_active":"2024-09-17T03:36:18.620523+0000","last_became_peered":"2024-09-17T03:36:18.620523+0000","last_unstale":"2024-09-17T03:36:19.846031+0000","last_undegraded":"2024-09-17T03:36:19.846031+0000","last_fullsized":"2024-09-17T03:36:19.846031+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:29.799406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845928+0000","last_change":"2024-09-17T03:36:17.597278+0000","last_active":"2024-09-17T03:36:19.845928+0000","last_peered":"2024-09-17T03:36:19.845928+0000","last_clean":"2024-09-17T03:36:19.845928+0000","last_became_active":"2024-09-17T03:36:17.596964+0000","last_became_peered":"2024-09-17T03:36:17.596964+0000","last_unstale":"2024-09-17T03:36:19.845928+0000","last_undegraded":"2024-09-17T03:36:19.845928+0000","last_fullsized":"2024-09-17T03:36:19.845928+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:49.991583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614549+0000","last_change":"2024-09-17T03:36:18.608183+0000","last_active":"2024-09-17T03:36:19.614549+0000","last_peered":"2024-09-17T03:36:19.614549+0000","last_clean":"2024-09-17T03:36:19.614549+0000","last_became_active":"2024-09-17T03:36:18.607081+0000","last_became_peered":"2024-09-17T03:36:18.607081+0000","last_unstale":"2024-09-17T03:36:19.614549+0000","last_undegraded":"2024-09-17T03:36:19.614549+0000","last_fullsized":"2024-09-17T03:36:19.614549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:49.263474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614801+0000","last_change":"2024-09-17T03:36:17.586129+0000","last_active":"2024-09-17T03:36:19.614801+0000","last_peered":"2024-09-17T03:36:19.614801+0000","last_clean":"2024-09-17T03:36:19.614801+0000","last_became_active":"2024-09-17T03:36:17.585850+0000","last_became_peered":"2024-09-17T03:36:17.585850+0000","last_unstale":"2024-09-17T03:36:19.614801+0000","last_undegraded":"2024-09-17T03:36:19.614801+0000","last_fullsized":"2024-09-17T03:36:19.614801+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:13.936211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614652+0000","last_change":"2024-09-17T03:36:18.620952+0000","last_active":"2024-09-17T03:36:19.614652+0000","last_peered":"2024-09-17T03:36:19.614652+0000","last_clean":"2024-09-17T03:36:19.614652+0000","last_became_active":"2024-09-17T03:36:18.620286+0000","last_became_peered":"2024-09-17T03:36:18.620286+0000","last_unstale":"2024-09-17T03:36:19.614652+0000","last_undegraded":"2024-09-17T03:36:19.614652+0000","last_fullsized":"2024-09-17T03:36:19.614652+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:09.083091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.847044+0000","last_change":"2024-09-17T03:36:17.590121+0000","last_active":"2024-09-17T03:36:19.847044+0000","last_peered":"2024-09-17T03:36:19.847044+0000","last_clean":"2024-09-17T03:36:19.847044+0000","last_became_active":"2024-09-17T03:36:17.589732+0000","last_became_peered":"2024-09-17T03:36:17.589732+0000","last_unstale":"2024-09-17T03:36:19.847044+0000","last_undegraded":"2024-09-17T03:36:19.847044+0000","last_fullsized":"2024-09-17T03:36:19.847044+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:24.387737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846144+0000","last_change":"2024-09-17T03:36:18.606753+0000","last_active":"2024-09-17T03:36:19.846144+0000","last_peered":"2024-09-17T03:36:19.846144+0000","last_clean":"2024-09-17T03:36:19.846144+0000","last_became_active":"2024-09-17T03:36:18.606452+0000","last_became_peered":"2024-09-17T03:36:18.606452+0000","last_unstale":"2024-09-17T03:36:19.846144+0000","last_undegraded":"2024-09-17T03:36:19.846144+0000","last_fullsized":"2024-09-17T03:36:19.846144+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:53.250978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846200+0000","last_change":"2024-09-17T03:36:17.585520+0000","last_active":"2024-09-17T03:36:19.846200+0000","last_peered":"2024-09-17T03:36:19.846200+0000","last_clean":"2024-09-17T03:36:19.846200+0000","last_became_active":"2024-09-17T03:36:17.585226+0000","last_became_peered":"2024-09-17T03:36:17.585226+0000","last_unstale":"2024-09-17T03:36:19.846200+0000","last_undegraded":"2024-09-17T03:36:19.846200+0000","last_fullsized":"2024-09-17T03:36:19.846200+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:48.714528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846311+0000","last_change":"2024-09-17T03:36:18.603833+0000","last_active":"2024-09-17T03:36:19.846311+0000","last_peered":"2024-09-17T03:36:19.846311+0000","last_clean":"2024-09-17T03:36:19.846311+0000","last_became_active":"2024-09-17T03:36:18.603537+0000","last_became_peered":"2024-09-17T03:36:18.603537+0000","last_unstale":"2024-09-17T03:36:19.846311+0000","last_undegraded":"2024-09-17T03:36:19.846311+0000","last_fullsized":"2024-09-17T03:36:19.846311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:20.450372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614416+0000","last_change":"2024-09-17T03:36:17.584532+0000","last_active":"2024-09-17T03:36:19.614416+0000","last_peered":"2024-09-17T03:36:19.614416+0000","last_clean":"2024-09-17T03:36:19.614416+0000","last_became_active":"2024-09-17T03:36:17.584217+0000","last_became_peered":"2024-09-17T03:36:17.584217+0000","last_unstale":"2024-09-17T03:36:19.614416+0000","last_undegraded":"2024-09-17T03:36:19.614416+0000","last_fullsized":"2024-09-17T03:36:19.614416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:49.597521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.596220+0000","last_change":"2024-09-17T03:36:18.617026+0000","last_active":"2024-09-17T03:36:19.596220+0000","last_peered":"2024-09-17T03:36:19.596220+0000","last_clean":"2024-09-17T03:36:19.596220+0000","last_became_active":"2024-09-17T03:36:18.616713+0000","last_became_peered":"2024-09-17T03:36:18.616713+0000","last_unstale":"2024-09-17T03:36:19.596220+0000","last_undegraded":"2024-09-17T03:36:19.596220+0000","last_fullsized":"2024-09-17T03:36:19.596220+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:40.512403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845774+0000","last_change":"2024-09-17T03:36:17.588334+0000","last_active":"2024-09-17T03:36:19.845774+0000","last_peered":"2024-09-17T03:36:19.845774+0000","last_clean":"2024-09-17T03:36:19.845774+0000","last_became_active":"2024-09-17T03:36:17.587215+0000","last_became_peered":"2024-09-17T03:36:17.587215+0000","last_unstale":"2024-09-17T03:36:19.845774+0000","last_undegraded":"2024-09-17T03:36:19.845774+0000","last_fullsized":"2024-09-17T03:36:19.845774+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:36.733909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845951+0000","last_change":"2024-09-17T03:36:18.611226+0000","last_active":"2024-09-17T03:36:19.845951+0000","last_peered":"2024-09-17T03:36:19.845951+0000","last_clean":"2024-09-17T03:36:19.845951+0000","last_became_active":"2024-09-17T03:36:18.610774+0000","last_became_peered":"2024-09-17T03:36:18.610774+0000","last_unstale":"2024-09-17T03:36:19.845951+0000","last_undegraded":"2024-09-17T03:36:19.845951+0000","last_fullsized":"2024-09-17T03:36:19.845951+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:57.385501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845518+0000","last_change":"2024-09-17T03:36:17.595365+0000","last_active":"2024-09-17T03:36:19.845518+0000","last_peered":"2024-09-17T03:36:19.845518+0000","last_clean":"2024-09-17T03:36:19.845518+0000","last_became_active":"2024-09-17T03:36:17.595025+0000","last_became_peered":"2024-09-17T03:36:17.595025+0000","last_unstale":"2024-09-17T03:36:19.845518+0000","last_undegraded":"2024-09-17T03:36:19.845518+0000","last_fullsized":"2024-09-17T03:36:19.845518+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:44.064718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846788+0000","last_change":"2024-09-17T03:36:18.613594+0000","last_active":"2024-09-17T03:36:19.846788+0000","last_peered":"2024-09-17T03:36:19.846788+0000","last_clean":"2024-09-17T03:36:19.846788+0000","last_became_active":"2024-09-17T03:36:18.613277+0000","last_became_peered":"2024-09-17T03:36:18.613277+0000","last_unstale":"2024-09-17T03:36:19.846788+0000","last_undegraded":"2024-09-17T03:36:19.846788+0000","last_fullsized":"2024-09-17T03:36:19.846788+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:08.508458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.596839+0000","last_change":"2024-09-17T03:36:17.595227+0000","last_active":"2024-09-17T03:36:19.596839+0000","last_peered":"2024-09-17T03:36:19.596839+0000","last_clean":"2024-09-17T03:36:19.596839+0000","last_became_active":"2024-09-17T03:36:17.594734+0000","last_became_peered":"2024-09-17T03:36:17.594734+0000","last_unstale":"2024-09-17T03:36:19.596839+0000","last_undegraded":"2024-09-17T03:36:19.596839+0000","last_fullsized":"2024-09-17T03:36:19.596839+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:19.145953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.596643+0000","last_change":"2024-09-17T03:36:18.617682+0000","last_active":"2024-09-17T03:36:19.596643+0000","last_peered":"2024-09-17T03:36:19.596643+0000","last_clean":"2024-09-17T03:36:19.596643+0000","last_became_active":"2024-09-17T03:36:18.617304+0000","last_became_peered":"2024-09-17T03:36:18.617304+0000","last_unstale":"2024-09-17T03:36:19.596643+0000","last_undegraded":"2024-09-17T03:36:19.596643+0000","last_fullsized":"2024-09-17T03:36:19.596643+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:42.608188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846037+0000","last_change":"2024-09-17T03:36:17.592409+0000","last_active":"2024-09-17T03:36:19.846037+0000","last_peered":"2024-09-17T03:36:19.846037+0000","last_clean":"2024-09-17T03:36:19.846037+0000","last_became_active":"2024-09-17T03:36:17.592054+0000","last_became_peered":"2024-09-17T03:36:17.592054+0000","last_unstale":"2024-09-17T03:36:19.846037+0000","last_undegraded":"2024-09-17T03:36:19.846037+0000","last_fullsized":"2024-09-17T03:36:19.846037+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:43.859107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845224+0000","last_change":"2024-09-17T03:36:18.605255+0000","last_active":"2024-09-17T03:36:19.845224+0000","last_peered":"2024-09-17T03:36:19.845224+0000","last_clean":"2024-09-17T03:36:19.845224+0000","last_became_active":"2024-09-17T03:36:18.604989+0000","last_became_peered":"2024-09-17T03:36:18.604989+0000","last_unstale":"2024-09-17T03:36:19.845224+0000","last_undegraded":"2024-09-17T03:36:19.845224+0000","last_fullsized":"2024-09-17T03:36:19.845224+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:10.554413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.597894+0000","last_change":"2024-09-17T03:36:17.590026+0000","last_active":"2024-09-17T03:36:19.597894+0000","last_peered":"2024-09-17T03:36:19.597894+0000","last_clean":"2024-09-17T03:36:19.597894+0000","last_became_active":"2024-09-17T03:36:17.589545+0000","last_became_peered":"2024-09-17T03:36:17.589545+0000","last_unstale":"2024-09-17T03:36:19.597894+0000","last_undegraded":"2024-09-17T03:36:19.597894+0000","last_fullsized":"2024-09-17T03:36:19.597894+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:50.088038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.597615+0000","last_change":"2024-09-17T03:36:18.621917+0000","last_active":"2024-09-17T03:36:19.597615+0000","last_peered":"2024-09-17T03:36:19.597615+0000","last_clean":"2024-09-17T03:36:19.597615+0000","last_became_active":"2024-09-17T03:36:18.621591+0000","last_became_peered":"2024-09-17T03:36:18.621591+0000","last_unstale":"2024-09-17T03:36:19.597615+0000","last_undegraded":"2024-09-17T03:36:19.597615+0000","last_fullsized":"2024-09-17T03:36:19.597615+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:41.700611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":21,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846285+0000","last_change":"2024-09-17T03:36:17.585567+0000","last_active":"2024-09-17T03:36:19.846285+0000","last_peered":"2024-09-17T03:36:19.846285+0000","last_clean":"2024-09-17T03:36:19.846285+0000","last_became_active":"2024-09-17T03:36:17.584661+0000","last_became_peered":"2024-09-17T03:36:17.584661+0000","last_unstale":"2024-09-17T03:36:19.846285+0000","last_undegraded":"2024-09-17T03:36:19.846285+0000","last_fullsized":"2024-09-17T03:36:19.846285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:48.556283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846462+0000","last_change":"2024-09-17T03:36:18.616020+0000","last_active":"2024-09-17T03:36:19.846462+0000","last_peered":"2024-09-17T03:36:19.846462+0000","last_clean":"2024-09-17T03:36:19.846462+0000","last_became_active":"2024-09-17T03:36:18.615693+0000","last_became_peered":"2024-09-17T03:36:18.615693+0000","last_unstale":"2024-09-17T03:36:19.846462+0000","last_undegraded":"2024-09-17T03:36:19.846462+0000","last_fullsized":"2024-09-17T03:36:19.846462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:34.008463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846259+0000","last_change":"2024-09-17T03:36:17.593448+0000","last_active":"2024-09-17T03:36:19.846259+0000","last_peered":"2024-09-17T03:36:19.846259+0000","last_clean":"2024-09-17T03:36:19.846259+0000","last_became_active":"2024-09-17T03:36:17.592913+0000","last_became_peered":"2024-09-17T03:36:17.592913+0000","last_unstale":"2024-09-17T03:36:19.846259+0000","last_undegraded":"2024-09-17T03:36:19.846259+0000","last_fullsized":"2024-09-17T03:36:19.846259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:33.003386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.597097+0000","last_change":"2024-09-17T03:36:18.623279+0000","last_active":"2024-09-17T03:36:19.597097+0000","last_peered":"2024-09-17T03:36:19.597097+0000","last_clean":"2024-09-17T03:36:19.597097+0000","last_became_active":"2024-09-17T03:36:18.622907+0000","last_became_peered":"2024-09-17T03:36:18.622907+0000","last_unstale":"2024-09-17T03:36:19.597097+0000","last_undegraded":"2024-09-17T03:36:19.597097+0000","last_fullsized":"2024-09-17T03:36:19.597097+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:51.990803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.596671+0000","last_change":"2024-09-17T03:36:17.582775+0000","last_active":"2024-09-17T03:36:19.596671+0000","last_peered":"2024-09-17T03:36:19.596671+0000","last_clean":"2024-09-17T03:36:19.596671+0000","last_became_active":"2024-09-17T03:36:17.582451+0000","last_became_peered":"2024-09-17T03:36:17.582451+0000","last_unstale":"2024-09-17T03:36:19.596671+0000","last_undegraded":"2024-09-17T03:36:19.596671+0000","last_fullsized":"2024-09-17T03:36:19.596671+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:55.225494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845515+0000","last_change":"2024-09-17T03:36:18.617154+0000","last_active":"2024-09-17T03:36:19.845515+0000","last_peered":"2024-09-17T03:36:19.845515+0000","last_clean":"2024-09-17T03:36:19.845515+0000","last_became_active":"2024-09-17T03:36:18.616817+0000","last_became_peered":"2024-09-17T03:36:18.616817+0000","last_unstale":"2024-09-17T03:36:19.845515+0000","last_undegraded":"2024-09-17T03:36:19.845515+0000","last_fullsized":"2024-09-17T03:36:19.845515+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:04.496122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845920+0000","last_change":"2024-09-17T03:36:17.589731+0000","last_active":"2024-09-17T03:36:19.845920+0000","last_peered":"2024-09-17T03:36:19.845920+0000","last_clean":"2024-09-17T03:36:19.845920+0000","last_became_active":"2024-09-17T03:36:17.589362+0000","last_became_peered":"2024-09-17T03:36:17.589362+0000","last_unstale":"2024-09-17T03:36:19.845920+0000","last_undegraded":"2024-09-17T03:36:19.845920+0000","last_fullsized":"2024-09-17T03:36:19.845920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:52.391183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.597561+0000","last_change":"2024-09-17T03:36:18.620650+0000","last_active":"2024-09-17T03:36:19.597561+0000","last_peered":"2024-09-17T03:36:19.597561+0000","last_clean":"2024-09-17T03:36:19.597561+0000","last_became_active":"2024-09-17T03:36:18.617859+0000","last_became_peered":"2024-09-17T03:36:18.617859+0000","last_unstale":"2024-09-17T03:36:19.597561+0000","last_undegraded":"2024-09-17T03:36:19.597561+0000","last_fullsized":"2024-09-17T03:36:19.597561+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:13.600060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.597194+0000","last_change":"2024-09-17T03:36:17.586177+0000","last_active":"2024-09-17T03:36:19.597194+0000","last_peered":"2024-09-17T03:36:19.597194+0000","last_clean":"2024-09-17T03:36:19.597194+0000","last_became_active":"2024-09-17T03:36:17.585819+0000","last_became_peered":"2024-09-17T03:36:17.585819+0000","last_unstale":"2024-09-17T03:36:19.597194+0000","last_undegraded":"2024-09-17T03:36:19.597194+0000","last_fullsized":"2024-09-17T03:36:19.597194+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:24.918171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.597227+0000","last_change":"2024-09-17T03:36:18.622200+0000","last_active":"2024-09-17T03:36:19.597227+0000","last_peered":"2024-09-17T03:36:19.597227+0000","last_clean":"2024-09-17T03:36:19.597227+0000","last_became_active":"2024-09-17T03:36:18.621839+0000","last_became_peered":"2024-09-17T03:36:18.621839+0000","last_unstale":"2024-09-17T03:36:19.597227+0000","last_undegraded":"2024-09-17T03:36:19.597227+0000","last_fullsized":"2024-09-17T03:36:19.597227+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:32.952094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845596+0000","last_change":"2024-09-17T03:36:17.597124+0000","last_active":"2024-09-17T03:36:19.845596+0000","last_peered":"2024-09-17T03:36:19.845596+0000","last_clean":"2024-09-17T03:36:19.845596+0000","last_became_active":"2024-09-17T03:36:17.596819+0000","last_became_peered":"2024-09-17T03:36:17.596819+0000","last_unstale":"2024-09-17T03:36:19.845596+0000","last_undegraded":"2024-09-17T03:36:19.845596+0000","last_fullsized":"2024-09-17T03:36:19.845596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:04.572410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846260+0000","last_change":"2024-09-17T03:36:18.619025+0000","last_active":"2024-09-17T03:36:19.846260+0000","last_peered":"2024-09-17T03:36:19.846260+0000","last_clean":"2024-09-17T03:36:19.846260+0000","last_became_active":"2024-09-17T03:36:18.618380+0000","last_became_peered":"2024-09-17T03:36:18.618380+0000","last_unstale":"2024-09-17T03:36:19.846260+0000","last_undegraded":"2024-09-17T03:36:19.846260+0000","last_fullsized":"2024-09-17T03:36:19.846260+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:05.577486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614692+0000","last_change":"2024-09-17T03:36:17.590872+0000","last_active":"2024-09-17T03:36:19.614692+0000","last_peered":"2024-09-17T03:36:19.614692+0000","last_clean":"2024-09-17T03:36:19.614692+0000","last_became_active":"2024-09-17T03:36:17.590501+0000","last_became_peered":"2024-09-17T03:36:17.590501+0000","last_unstale":"2024-09-17T03:36:19.614692+0000","last_undegraded":"2024-09-17T03:36:19.614692+0000","last_fullsized":"2024-09-17T03:36:19.614692+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:28.794329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845694+0000","last_change":"2024-09-17T03:36:18.606146+0000","last_active":"2024-09-17T03:36:19.845694+0000","last_peered":"2024-09-17T03:36:19.845694+0000","last_clean":"2024-09-17T03:36:19.845694+0000","last_became_active":"2024-09-17T03:36:18.605804+0000","last_became_peered":"2024-09-17T03:36:18.605804+0000","last_unstale":"2024-09-17T03:36:19.845694+0000","last_undegraded":"2024-09-17T03:36:19.845694+0000","last_fullsized":"2024-09-17T03:36:19.845694+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:21.621541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846003+0000","last_change":"2024-09-17T03:36:17.590167+0000","last_active":"2024-09-17T03:36:19.846003+0000","last_peered":"2024-09-17T03:36:19.846003+0000","last_clean":"2024-09-17T03:36:19.846003+0000","last_became_active":"2024-09-17T03:36:17.589343+0000","last_became_peered":"2024-09-17T03:36:17.589343+0000","last_unstale":"2024-09-17T03:36:19.846003+0000","last_undegraded":"2024-09-17T03:36:19.846003+0000","last_fullsized":"2024-09-17T03:36:19.846003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:50.756722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.597839+0000","last_change":"2024-09-17T03:36:18.618941+0000","last_active":"2024-09-17T03:36:19.597839+0000","last_peered":"2024-09-17T03:36:19.597839+0000","last_clean":"2024-09-17T03:36:19.597839+0000","last_became_active":"2024-09-17T03:36:18.618611+0000","last_became_peered":"2024-09-17T03:36:18.618611+0000","last_unstale":"2024-09-17T03:36:19.597839+0000","last_undegraded":"2024-09-17T03:36:19.597839+0000","last_fullsized":"2024-09-17T03:36:19.597839+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:30.710113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614587+0000","last_change":"2024-09-17T03:36:17.595452+0000","last_active":"2024-09-17T03:36:19.614587+0000","last_peered":"2024-09-17T03:36:19.614587+0000","last_clean":"2024-09-17T03:36:19.614587+0000","last_became_active":"2024-09-17T03:36:17.595094+0000","last_became_peered":"2024-09-17T03:36:17.595094+0000","last_unstale":"2024-09-17T03:36:19.614587+0000","last_undegraded":"2024-09-17T03:36:19.614587+0000","last_fullsized":"2024-09-17T03:36:19.614587+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:12.654766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846688+0000","last_change":"2024-09-17T03:36:18.616177+0000","last_active":"2024-09-17T03:36:19.846688+0000","last_peered":"2024-09-17T03:36:19.846688+0000","last_clean":"2024-09-17T03:36:19.846688+0000","last_became_active":"2024-09-17T03:36:18.615754+0000","last_became_peered":"2024-09-17T03:36:18.615754+0000","last_unstale":"2024-09-17T03:36:19.846688+0000","last_undegraded":"2024-09-17T03:36:19.846688+0000","last_fullsized":"2024-09-17T03:36:19.846688+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:44.864184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846370+0000","last_change":"2024-09-17T03:36:17.596424+0000","last_active":"2024-09-17T03:36:19.846370+0000","last_peered":"2024-09-17T03:36:19.846370+0000","last_clean":"2024-09-17T03:36:19.846370+0000","last_became_active":"2024-09-17T03:36:17.596093+0000","last_became_peered":"2024-09-17T03:36:17.596093+0000","last_unstale":"2024-09-17T03:36:19.846370+0000","last_undegraded":"2024-09-17T03:36:19.846370+0000","last_fullsized":"2024-09-17T03:36:19.846370+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:15.797803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614950+0000","last_change":"2024-09-17T03:36:18.610121+0000","last_active":"2024-09-17T03:36:19.614950+0000","last_peered":"2024-09-17T03:36:19.614950+0000","last_clean":"2024-09-17T03:36:19.614950+0000","last_became_active":"2024-09-17T03:36:18.606903+0000","last_became_peered":"2024-09-17T03:36:18.606903+0000","last_unstale":"2024-09-17T03:36:19.614950+0000","last_undegraded":"2024-09-17T03:36:19.614950+0000","last_fullsized":"2024-09-17T03:36:19.614950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:33.548627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845056+0000","last_change":"2024-09-17T03:36:17.588176+0000","last_active":"2024-09-17T03:36:19.845056+0000","last_peered":"2024-09-17T03:36:19.845056+0000","last_clean":"2024-09-17T03:36:19.845056+0000","last_became_active":"2024-09-17T03:36:17.587563+0000","last_became_peered":"2024-09-17T03:36:17.587563+0000","last_unstale":"2024-09-17T03:36:19.845056+0000","last_undegraded":"2024-09-17T03:36:19.845056+0000","last_fullsized":"2024-09-17T03:36:19.845056+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:27.963949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614284+0000","last_change":"2024-09-17T03:36:18.622275+0000","last_active":"2024-09-17T03:36:19.614284+0000","last_peered":"2024-09-17T03:36:19.614284+0000","last_clean":"2024-09-17T03:36:19.614284+0000","last_became_active":"2024-09-17T03:36:18.621983+0000","last_became_peered":"2024-09-17T03:36:18.621983+0000","last_unstale":"2024-09-17T03:36:19.614284+0000","last_undegraded":"2024-09-17T03:36:19.614284+0000","last_fullsized":"2024-09-17T03:36:19.614284+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:11.516431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845647+0000","last_change":"2024-09-17T03:36:17.595421+0000","last_active":"2024-09-17T03:36:19.845647+0000","last_peered":"2024-09-17T03:36:19.845647+0000","last_clean":"2024-09-17T03:36:19.845647+0000","last_became_active":"2024-09-17T03:36:17.595079+0000","last_became_peered":"2024-09-17T03:36:17.595079+0000","last_unstale":"2024-09-17T03:36:19.845647+0000","last_undegraded":"2024-09-17T03:36:19.845647+0000","last_fullsized":"2024-09-17T03:36:19.845647+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:47.729791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846591+0000","last_change":"2024-09-17T03:36:18.613710+0000","last_active":"2024-09-17T03:36:19.846591+0000","last_peered":"2024-09-17T03:36:19.846591+0000","last_clean":"2024-09-17T03:36:19.846591+0000","last_became_active":"2024-09-17T03:36:18.612061+0000","last_became_peered":"2024-09-17T03:36:18.612061+0000","last_unstale":"2024-09-17T03:36:19.846591+0000","last_undegraded":"2024-09-17T03:36:19.846591+0000","last_fullsized":"2024-09-17T03:36:19.846591+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:16.802880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845864+0000","last_change":"2024-09-17T03:36:17.594225+0000","last_active":"2024-09-17T03:36:19.845864+0000","last_peered":"2024-09-17T03:36:19.845864+0000","last_clean":"2024-09-17T03:36:19.845864+0000","last_became_active":"2024-09-17T03:36:17.593916+0000","last_became_peered":"2024-09-17T03:36:17.593916+0000","last_unstale":"2024-09-17T03:36:19.845864+0000","last_undegraded":"2024-09-17T03:36:19.845864+0000","last_fullsized":"2024-09-17T03:36:19.845864+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:03.587147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846576+0000","last_change":"2024-09-17T03:36:18.619360+0000","last_active":"2024-09-17T03:36:19.846576+0000","last_peered":"2024-09-17T03:36:19.846576+0000","last_clean":"2024-09-17T03:36:19.846576+0000","last_became_active":"2024-09-17T03:36:18.617994+0000","last_became_peered":"2024-09-17T03:36:18.617994+0000","last_unstale":"2024-09-17T03:36:19.846576+0000","last_undegraded":"2024-09-17T03:36:19.846576+0000","last_fullsized":"2024-09-17T03:36:19.846576+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:59.917961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"58'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614860+0000","last_change":"2024-09-17T03:36:17.589681+0000","last_active":"2024-09-17T03:36:19.614860+0000","last_peered":"2024-09-17T03:36:19.614860+0000","last_clean":"2024-09-17T03:36:19.614860+0000","last_became_active":"2024-09-17T03:36:17.582742+0000","last_became_peered":"2024-09-17T03:36:17.582742+0000","last_unstale":"2024-09-17T03:36:19.614860+0000","last_undegraded":"2024-09-17T03:36:19.614860+0000","last_fullsized":"2024-09-17T03:36:19.614860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:34.514226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845447+0000","last_change":"2024-09-17T03:36:18.604528+0000","last_active":"2024-09-17T03:36:19.845447+0000","last_peered":"2024-09-17T03:36:19.845447+0000","last_clean":"2024-09-17T03:36:19.845447+0000","last_became_active":"2024-09-17T03:36:18.604264+0000","last_became_peered":"2024-09-17T03:36:18.604264+0000","last_unstale":"2024-09-17T03:36:19.845447+0000","last_undegraded":"2024-09-17T03:36:19.845447+0000","last_fullsized":"2024-09-17T03:36:19.845447+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:28.223913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.596336+0000","last_change":"2024-09-17T03:36:17.580793+0000","last_active":"2024-09-17T03:36:19.596336+0000","last_peered":"2024-09-17T03:36:19.596336+0000","last_clean":"2024-09-17T03:36:19.596336+0000","last_became_active":"2024-09-17T03:36:17.580470+0000","last_became_peered":"2024-09-17T03:36:17.580470+0000","last_unstale":"2024-09-17T03:36:19.596336+0000","last_undegraded":"2024-09-17T03:36:19.596336+0000","last_fullsized":"2024-09-17T03:36:19.596336+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:25.063641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.614807+0000","last_change":"2024-09-17T03:36:18.621036+0000","last_active":"2024-09-17T03:36:19.614807+0000","last_peered":"2024-09-17T03:36:19.614807+0000","last_clean":"2024-09-17T03:36:19.614807+0000","last_became_active":"2024-09-17T03:36:18.620667+0000","last_became_peered":"2024-09-17T03:36:18.620667+0000","last_unstale":"2024-09-17T03:36:19.614807+0000","last_undegraded":"2024-09-17T03:36:19.614807+0000","last_fullsized":"2024-09-17T03:36:19.614807+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:00.100003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.847101+0000","last_change":"2024-09-17T03:36:17.588380+0000","last_active":"2024-09-17T03:36:19.847101+0000","last_peered":"2024-09-17T03:36:19.847101+0000","last_clean":"2024-09-17T03:36:19.847101+0000","last_became_active":"2024-09-17T03:36:17.588059+0000","last_became_peered":"2024-09-17T03:36:17.588059+0000","last_unstale":"2024-09-17T03:36:19.847101+0000","last_undegraded":"2024-09-17T03:36:19.847101+0000","last_fullsized":"2024-09-17T03:36:19.847101+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:51.470157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846211+0000","last_change":"2024-09-17T03:36:18.612039+0000","last_active":"2024-09-17T03:36:19.846211+0000","last_peered":"2024-09-17T03:36:19.846211+0000","last_clean":"2024-09-17T03:36:19.846211+0000","last_became_active":"2024-09-17T03:36:18.610118+0000","last_became_peered":"2024-09-17T03:36:18.610118+0000","last_unstale":"2024-09-17T03:36:19.846211+0000","last_undegraded":"2024-09-17T03:36:19.846211+0000","last_fullsized":"2024-09-17T03:36:19.846211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:16.106206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.844993+0000","last_change":"2024-09-17T03:36:17.587591+0000","last_active":"2024-09-17T03:36:19.844993+0000","last_peered":"2024-09-17T03:36:19.844993+0000","last_clean":"2024-09-17T03:36:19.844993+0000","last_became_active":"2024-09-17T03:36:17.586959+0000","last_became_peered":"2024-09-17T03:36:17.586959+0000","last_unstale":"2024-09-17T03:36:19.844993+0000","last_undegraded":"2024-09-17T03:36:19.844993+0000","last_fullsized":"2024-09-17T03:36:19.844993+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:39.210785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.597593+0000","last_change":"2024-09-17T03:36:18.622306+0000","last_active":"2024-09-17T03:36:19.597593+0000","last_peered":"2024-09-17T03:36:19.597593+0000","last_clean":"2024-09-17T03:36:19.597593+0000","last_became_active":"2024-09-17T03:36:18.619448+0000","last_became_peered":"2024-09-17T03:36:18.619448+0000","last_unstale":"2024-09-17T03:36:19.597593+0000","last_undegraded":"2024-09-17T03:36:19.597593+0000","last_fullsized":"2024-09-17T03:36:19.597593+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:14.884504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846972+0000","last_change":"2024-09-17T03:36:17.578097+0000","last_active":"2024-09-17T03:36:19.846972+0000","last_peered":"2024-09-17T03:36:19.846972+0000","last_clean":"2024-09-17T03:36:19.846972+0000","last_became_active":"2024-09-17T03:36:17.577678+0000","last_became_peered":"2024-09-17T03:36:17.577678+0000","last_unstale":"2024-09-17T03:36:19.846972+0000","last_undegraded":"2024-09-17T03:36:19.846972+0000","last_fullsized":"2024-09-17T03:36:19.846972+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:16.042540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.844805+0000","last_change":"2024-09-17T03:36:18.609081+0000","last_active":"2024-09-17T03:36:19.844805+0000","last_peered":"2024-09-17T03:36:19.844805+0000","last_clean":"2024-09-17T03:36:19.844805+0000","last_became_active":"2024-09-17T03:36:18.608778+0000","last_became_peered":"2024-09-17T03:36:18.608778+0000","last_unstale":"2024-09-17T03:36:19.844805+0000","last_undegraded":"2024-09-17T03:36:19.844805+0000","last_fullsized":"2024-09-17T03:36:19.844805+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:13.518906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.844952+0000","last_change":"2024-09-17T03:36:17.595198+0000","last_active":"2024-09-17T03:36:19.844952+0000","last_peered":"2024-09-17T03:36:19.844952+0000","last_clean":"2024-09-17T03:36:19.844952+0000","last_became_active":"2024-09-17T03:36:17.594848+0000","last_became_peered":"2024-09-17T03:36:17.594848+0000","last_unstale":"2024-09-17T03:36:19.844952+0000","last_undegraded":"2024-09-17T03:36:19.844952+0000","last_fullsized":"2024-09-17T03:36:19.844952+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.483843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.846179+0000","last_change":"2024-09-17T03:36:18.606181+0000","last_active":"2024-09-17T03:36:19.846179+0000","last_peered":"2024-09-17T03:36:19.846179+0000","last_clean":"2024-09-17T03:36:19.846179+0000","last_became_active":"2024-09-17T03:36:18.605763+0000","last_became_peered":"2024-09-17T03:36:18.605763+0000","last_unstale":"2024-09-17T03:36:19.846179+0000","last_undegraded":"2024-09-17T03:36:19.846179+0000","last_fullsized":"2024-09-17T03:36:19.846179+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:02.201527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845193+0000","last_change":"2024-09-17T03:36:17.594130+0000","last_active":"2024-09-17T03:36:19.845193+0000","last_peered":"2024-09-17T03:36:19.845193+0000","last_clean":"2024-09-17T03:36:19.845193+0000","last_became_active":"2024-09-17T03:36:17.593795+0000","last_became_peered":"2024-09-17T03:36:17.593795+0000","last_unstale":"2024-09-17T03:36:19.845193+0000","last_undegraded":"2024-09-17T03:36:19.845193+0000","last_fullsized":"2024-09-17T03:36:19.845193+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:58.912884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.845808+0000","last_change":"2024-09-17T03:36:18.604249+0000","last_active":"2024-09-17T03:36:19.845808+0000","last_peered":"2024-09-17T03:36:19.845808+0000","last_clean":"2024-09-17T03:36:19.845808+0000","last_became_active":"2024-09-17T03:36:18.603691+0000","last_became_peered":"2024-09-17T03:36:18.603691+0000","last_unstale":"2024-09-17T03:36:19.845808+0000","last_undegraded":"2024-09-17T03:36:19.845808+0000","last_fullsized":"2024-09-17T03:36:19.845808+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:17.568018+0000","last_clean_scrub_stamp":"2024-09-17T03:36:17.568018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:39.972488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.596010+0000","last_change":"2024-09-17T03:36:17.587385+0000","last_active":"2024-09-17T03:36:19.596010+0000","last_peered":"2024-09-17T03:36:19.596010+0000","last_clean":"2024-09-17T03:36:19.596010+0000","last_became_active":"2024-09-17T03:36:17.586929+0000","last_became_peered":"2024-09-17T03:36:17.586929+0000","last_unstale":"2024-09-17T03:36:19.596010+0000","last_undegraded":"2024-09-17T03:36:19.596010+0000","last_fullsized":"2024-09-17T03:36:19.596010+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:16.562941+0000","last_clean_scrub_stamp":"2024-09-17T03:36:16.562941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.483843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":180,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:36:19.597192+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:36:19.597192+0000","last_peered":"2024-09-17T03:36:19.597192+0000","last_clean":"2024-09-17T03:36:19.597192+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:36:19.597192+0000","last_undegraded":"2024-09-17T03:36:19.597192+0000","last_fullsized":"2024-09-17T03:36:19.597192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36608,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335232,"statfs":{"total":96636764160,"available":96599277568,"internally_reserved":0,"allocated":1290240,"data_stored":877358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36028,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335812,"statfs":{"total":96636764160,"available":96599871488,"internally_reserved":0,"allocated":688128,"data_stored":286830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509487,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40192,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331648,"statfs":{"total":96636764160,"available":96595607552,"internally_reserved":0,"allocated":700416,"data_stored":288442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36028,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335812,"statfs":{"total":96636764160,"available":96599871488,"internally_reserved":0,"allocated":696320,"data_stored":286886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36028,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335812,"statfs":{"total":96636764160,"available":96599871488,"internally_reserved":0,"allocated":692224,"data_stored":286920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509488,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1298432,"data_stored":879392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36028,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335812,"statfs":{"total":96636764160,"available":96599871488,"internally_reserved":0,"allocated":696320,"data_stored":287482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36028,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335812,"statfs":{"total":96636764160,"available":96599871488,"internally_reserved":0,"allocated":696320,"data_stored":286886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:36:26.397 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:36:26.397 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:36:26.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.555+0000 7fc31c60e640 1 -- 172.21.15.146:0/4149822286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc31415ed50 msgr2=0x7fc31415f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.555+0000 7fc31c60e640 1 --2- 172.21.15.146:0/4149822286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc31415ed50 0x7fc31415f160 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc30c005fd0 tx=0x7fc30c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.555+0000 7fc31c60e640 1 -- 172.21.15.146:0/4149822286 shutdown_connections 2024-09-17T03:36:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.555+0000 7fc31c60e640 1 --2- 172.21.15.146:0/4149822286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc31415ed50 0x7fc31415f160 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.555+0000 7fc31c60e640 1 --2- 172.21.15.146:0/4149822286 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc31415e400 0x7fc31415e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.555+0000 7fc31c60e640 1 -- 172.21.15.146:0/4149822286 >> 172.21.15.146:0/4149822286 conn(0x7fc3140749f0 msgr2=0x7fc31409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.555+0000 7fc31c60e640 1 -- 172.21.15.146:0/4149822286 shutdown_connections 2024-09-17T03:36:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.555+0000 7fc31c60e640 1 -- 172.21.15.146:0/4149822286 wait complete. 2024-09-17T03:36:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.557+0000 7fc31c60e640 1 Processor -- start 2024-09-17T03:36:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.557+0000 7fc31c60e640 1 -- start start 2024-09-17T03:36:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc31c60e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3140b5700 0x7fc31414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc31c60e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc31415e400 0x7fc3140aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc31c60e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31415ed50 0x7fc3141f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc31c60e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc314166c60 con 0x7fc31415e400 2024-09-17T03:36:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc31c60e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc314166ae0 con 0x7fc31415ed50 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc31c60e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc314166de0 con 0x7fc3140b5700 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc319ba9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc31415e400 0x7fc3140aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc319ba9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc31415e400 0x7fc3140aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48190/0 (socket says 172.21.15.146:48190) 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc319ba9640 1 -- 172.21.15.146:0/806324654 learned_addr learned my addr 172.21.15.146:0/806324654 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc31a3aa640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3140b5700 0x7fc31414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc31abab640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31415ed50 0x7fc3141f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc319ba9640 1 -- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3140b5700 msgr2=0x7fc31414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc319ba9640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3140b5700 0x7fc31414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc319ba9640 1 -- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31415ed50 msgr2=0x7fc3141f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc319ba9640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31415ed50 0x7fc3141f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.558+0000 7fc319ba9640 1 -- 172.21.15.146:0/806324654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3140b0450 con 0x7fc31415e400 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.559+0000 7fc319ba9640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc31415e400 0x7fc3140aff10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc30400b410 tx=0x7fc30400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.559+0000 7fc30affd640 1 -- 172.21.15.146:0/806324654 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc304015020 con 0x7fc31415e400 2024-09-17T03:36:26.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.559+0000 7fc30affd640 1 -- 172.21.15.146:0/806324654 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc304011940 con 0x7fc31415e400 2024-09-17T03:36:26.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.559+0000 7fc31c60e640 1 -- 172.21.15.146:0/806324654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3140b3070 con 0x7fc31415e400 2024-09-17T03:36:26.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.559+0000 7fc30affd640 1 -- 172.21.15.146:0/806324654 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc304011d90 con 0x7fc31415e400 2024-09-17T03:36:26.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.559+0000 7fc31c60e640 1 -- 172.21.15.146:0/806324654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3140a02c0 con 0x7fc31415e400 2024-09-17T03:36:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.560+0000 7fc31c60e640 1 -- 172.21.15.146:0/806324654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc31415e810 con 0x7fc31415e400 2024-09-17T03:36:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.560+0000 7fc30affd640 1 -- 172.21.15.146:0/806324654 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc304018020 con 0x7fc31415e400 2024-09-17T03:36:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.561+0000 7fc30affd640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f8078b90 0x7fc2f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.561+0000 7fc30affd640 1 -- 172.21.15.146:0/806324654 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fc30409ad00 con 0x7fc31415e400 2024-09-17T03:36:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.561+0000 7fc31a3aa640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f8078b90 0x7fc2f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.562+0000 7fc31a3aa640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f8078b90 0x7fc2f807b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc3100046b0 tx=0x7fc310009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.565+0000 7fc30affd640 1 -- 172.21.15.146:0/806324654 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc30401f020 con 0x7fc31415e400 2024-09-17T03:36:26.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.812+0000 7fc31c60e640 1 -- 172.21.15.146:0/806324654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc3140a0050 con 0x7fc31415e400 2024-09-17T03:36:26.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.815+0000 7fc30affd640 1 -- 172.21.15.146:0/806324654 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fc3040630c0 con 0x7fc31415e400 2024-09-17T03:36:26.815 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:36:26.815 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:36:26.816 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:36:26.816 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:36:26.816 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:36:26.816 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:36:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.817+0000 7fc31c60e640 1 -- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f8078b90 msgr2=0x7fc2f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.817+0000 7fc31c60e640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f8078b90 0x7fc2f807b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc3100046b0 tx=0x7fc310009040 comp rx=0 tx=0).stop 2024-09-17T03:36:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.817+0000 7fc31c60e640 1 -- 172.21.15.146:0/806324654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc31415e400 msgr2=0x7fc3140aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.817+0000 7fc31c60e640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc31415e400 0x7fc3140aff10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc30400b410 tx=0x7fc30400b8d0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.818+0000 7fc31c60e640 1 -- 172.21.15.146:0/806324654 shutdown_connections 2024-09-17T03:36:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.818+0000 7fc31c60e640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f8078b90 0x7fc2f807b0a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.818+0000 7fc31c60e640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc31415ed50 0x7fc3141f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.818+0000 7fc31c60e640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc31415e400 0x7fc3140aff10 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.818+0000 7fc31c60e640 1 --2- 172.21.15.146:0/806324654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3140b5700 0x7fc31414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.818+0000 7fc31c60e640 1 -- 172.21.15.146:0/806324654 >> 172.21.15.146:0/806324654 conn(0x7fc3140749f0 msgr2=0x7fc314152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.818+0000 7fc31c60e640 1 -- 172.21.15.146:0/806324654 shutdown_connections 2024-09-17T03:36:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.818+0000 7fc31c60e640 1 -- 172.21.15.146:0/806324654 wait complete. 2024-09-17T03:36:26.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.943+0000 7f7b87782640 1 -- 172.21.15.146:0/4226677423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b800b5750 msgr2=0x7f7b800b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.943+0000 7f7b87782640 1 --2- 172.21.15.146:0/4226677423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b800b5750 0x7f7b800b3620 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009830 tx=0x7f7b7002a480 comp rx=0 tx=0).stop 2024-09-17T03:36:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.943+0000 7f7b87782640 1 -- 172.21.15.146:0/4226677423 shutdown_connections 2024-09-17T03:36:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.943+0000 7f7b87782640 1 --2- 172.21.15.146:0/4226677423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b800b5750 0x7f7b800b3620 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.943+0000 7f7b87782640 1 -- 172.21.15.146:0/4226677423 >> 172.21.15.146:0/4226677423 conn(0x7f7b800b7b20 msgr2=0x7f7b8009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.943+0000 7f7b87782640 1 -- 172.21.15.146:0/4226677423 shutdown_connections 2024-09-17T03:36:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.943+0000 7f7b87782640 1 -- 172.21.15.146:0/4226677423 wait complete. 2024-09-17T03:36:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.945+0000 7f7b87782640 1 Processor -- start 2024-09-17T03:36:26.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.945+0000 7f7b87782640 1 -- start start 2024-09-17T03:36:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.946+0000 7f7b87782640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b800b3b60 0x7f7b801462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.946+0000 7f7b87782640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b800b5750 0x7f7b80143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.946+0000 7f7b87782640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b800b5ce0 0x7f7b801e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.946+0000 7f7b87782640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8015d650 con 0x7f7b800b3b60 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.946+0000 7f7b87782640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8015d4d0 con 0x7f7b800b5750 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.946+0000 7f7b87782640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7b8015d7d0 con 0x7f7b800b5ce0 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.946+0000 7f7b8551e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b800b3b60 0x7f7b801462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.946+0000 7f7b8551e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b800b3b60 0x7f7b801462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48214/0 (socket says 172.21.15.146:48214) 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.946+0000 7f7b8551e640 1 -- 172.21.15.146:0/3765766723 learned_addr learned my addr 172.21.15.146:0/3765766723 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.946+0000 7f7b85d1f640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b800b5ce0 0x7f7b801e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.946+0000 7f7b84d1d640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b800b5750 0x7f7b80143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.947+0000 7f7b8551e640 1 -- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b800b5ce0 msgr2=0x7f7b801e4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.947+0000 7f7b8551e640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b800b5ce0 0x7f7b801e4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.947+0000 7f7b8551e640 1 -- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b800b5750 msgr2=0x7f7b80143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.947+0000 7f7b8551e640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b800b5750 0x7f7b80143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.947+0000 7f7b8551e640 1 -- 172.21.15.146:0/3765766723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b801467e0 con 0x7f7b800b3b60 2024-09-17T03:36:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.947+0000 7f7b8551e640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b800b3b60 0x7f7b801462a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00b3f0 tx=0x7f7b7c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.947+0000 7f7b75ffb640 1 -- 172.21.15.146:0/3765766723 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c015020 con 0x7f7b800b3b60 2024-09-17T03:36:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.947+0000 7f7b75ffb640 1 -- 172.21.15.146:0/3765766723 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b7c011920 con 0x7f7b800b3b60 2024-09-17T03:36:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.947+0000 7f7b87782640 1 -- 172.21.15.146:0/3765766723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b80146a90 con 0x7f7b800b3b60 2024-09-17T03:36:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.947+0000 7f7b75ffb640 1 -- 172.21.15.146:0/3765766723 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c011d70 con 0x7f7b800b3b60 2024-09-17T03:36:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.947+0000 7f7b87782640 1 -- 172.21.15.146:0/3765766723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b80147050 con 0x7f7b800b3b60 2024-09-17T03:36:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.948+0000 7f7b87782640 1 -- 172.21.15.146:0/3765766723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b80076840 con 0x7f7b800b3b60 2024-09-17T03:36:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.949+0000 7f7b75ffb640 1 -- 172.21.15.146:0/3765766723 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b7c018020 con 0x7f7b800b3b60 2024-09-17T03:36:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.949+0000 7f7b75ffb640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b64078b90 0x7f7b6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.949+0000 7f7b75ffb640 1 -- 172.21.15.146:0/3765766723 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f7b7c09a9d0 con 0x7f7b800b3b60 2024-09-17T03:36:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.950+0000 7f7b84d1d640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b64078b90 0x7f7b6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.950+0000 7f7b84d1d640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b64078b90 0x7f7b6407b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7b70034000 tx=0x7f7b70004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:26.954+0000 7f7b75ffb640 1 -- 172.21.15.146:0/3765766723 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b7c01f030 con 0x7f7b800b3b60 2024-09-17T03:36:27.104 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:36:27.106 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:36:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.167+0000 7f7b87782640 1 -- 172.21.15.146:0/3765766723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b80071440 con 0x7f7b800b3b60 2024-09-17T03:36:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.167+0000 7f7b75ffb640 1 -- 172.21.15.146:0/3765766723 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5226 (secure 0 0 0) 0x7f7b7c062e10 con 0x7f7b800b3b60 2024-09-17T03:36:27.168 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:27.168 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"btime":"2024-09-17T03:36:20:610421+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1042067483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1042067483},{"type":"v1","addr":"172.21.15.179:6837","nonce":1042067483}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5875,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3725156879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3725156879},{"type":"v1","addr":"172.21.15.146:6834","nonce":3725156879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/6455506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":6455506},{"type":"v1","addr":"172.21.15.146:6835","nonce":6455506}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:19.961005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/2016497882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2016497882},{"type":"v1","addr":"172.21.15.179:6836","nonce":2016497882}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5890,"qdb_cluster":[5890]},"id":4}]} 2024-09-17T03:36:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 29 2024-09-17T03:36:27.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 -- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b64078b90 msgr2=0x7f7b6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b64078b90 0x7f7b6407b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7b70034000 tx=0x7f7b70004730 comp rx=0 tx=0).stop 2024-09-17T03:36:27.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 -- 172.21.15.146:0/3765766723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b800b3b60 msgr2=0x7f7b801462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b800b3b60 0x7f7b801462a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00b3f0 tx=0x7f7b7c00b8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 -- 172.21.15.146:0/3765766723 shutdown_connections 2024-09-17T03:36:27.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b64078b90 0x7f7b6407b0a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b800b5ce0 0x7f7b801e4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b800b5750 0x7f7b80143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 --2- 172.21.15.146:0/3765766723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b800b3b60 0x7f7b801462a0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 -- 172.21.15.146:0/3765766723 >> 172.21.15.146:0/3765766723 conn(0x7f7b800b7b20 msgr2=0x7f7b8015df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:27.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 -- 172.21.15.146:0/3765766723 shutdown_connections 2024-09-17T03:36:27.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.170+0000 7f7b87782640 1 -- 172.21.15.146:0/3765766723 wait complete. 2024-09-17T03:36:27.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:36:17.932398+0000', 'modified': '2024-09-17T03:36:19.961005+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5890}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5890': {'gid': 5890, 'name': 'd', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6836/2016497882', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 2016497882}, {'type': 'v1', 'addr': '172.21.15.179:6836', 'nonce': 2016497882}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5890, 'qdb_cluster': [5890]} 2024-09-17T03:36:27.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:36:27.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:36:27.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.699+0000 7f619cbda640 1 -- 172.21.15.146:0/2748320665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6180003a30 msgr2=0x7f6180003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.699+0000 7f619cbda640 1 --2- 172.21.15.146:0/2748320665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6180003a30 0x7f6180003ea0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f61880016c0 tx=0x7f6180005830 comp rx=0 tx=0).stop 2024-09-17T03:36:27.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.699+0000 7f6196d9d640 1 -- 172.21.15.146:0/2748320665 reap_dead start 2024-09-17T03:36:27.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.699+0000 7f619cbda640 1 -- 172.21.15.146:0/2748320665 shutdown_connections 2024-09-17T03:36:27.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.699+0000 7f619cbda640 1 -- 172.21.15.146:0/2748320665 >> 172.21.15.146:0/2748320665 conn(0x7f619809ba20 msgr2=0x7f61980b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:27.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.699+0000 7f619cbda640 1 -- 172.21.15.146:0/2748320665 shutdown_connections 2024-09-17T03:36:27.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.699+0000 7f619cbda640 1 -- 172.21.15.146:0/2748320665 wait complete. 2024-09-17T03:36:27.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.701+0000 7f619cbda640 1 Processor -- start 2024-09-17T03:36:27.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.701+0000 7f619cbda640 1 -- start start 2024-09-17T03:36:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619cbda640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6180003a30 0x7f61980ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619cbda640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61980af390 0x7f61981e18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619cbda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61980c9130 0x7f61981f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619cbda640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f61980b2f30 con 0x7f6180003a30 2024-09-17T03:36:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619cbda640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f61980b80a0 con 0x7f61980c9130 2024-09-17T03:36:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619cbda640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f61980cdbb0 con 0x7f61980af390 2024-09-17T03:36:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6180003a30 0x7f61980ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6180003a30 0x7f61980ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57028/0 (socket says 172.21.15.146:57028) 2024-09-17T03:36:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619659c640 1 -- 172.21.15.146:0/512203087 learned_addr learned my addr 172.21.15.146:0/512203087 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f6196d9d640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61980c9130 0x7f61981f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619659c640 1 -- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61980af390 msgr2=0x7f61981e18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619659c640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61980af390 0x7f61981e18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619659c640 1 -- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61980c9130 msgr2=0x7f61981f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619659c640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61980c9130 0x7f61981f74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619659c640 1 -- 172.21.15.146:0/512203087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61981e2390 con 0x7f6180003a30 2024-09-17T03:36:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619659c640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6180003a30 0x7f61980ca760 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f61880017e0 tx=0x7f6188006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f6186ffd640 1 -- 172.21.15.146:0/512203087 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6188038070 con 0x7f6180003a30 2024-09-17T03:36:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f6186ffd640 1 -- 172.21.15.146:0/512203087 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6188003af0 con 0x7f6180003a30 2024-09-17T03:36:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619cbda640 1 -- 172.21.15.146:0/512203087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61981f6ce0 con 0x7f6180003a30 2024-09-17T03:36:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f6186ffd640 1 -- 172.21.15.146:0/512203087 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6188033420 con 0x7f6180003a30 2024-09-17T03:36:27.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.703+0000 7f619cbda640 1 -- 172.21.15.146:0/512203087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61980aff60 con 0x7f6180003a30 2024-09-17T03:36:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.705+0000 7f6186ffd640 1 -- 172.21.15.146:0/512203087 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6188030070 con 0x7f6180003a30 2024-09-17T03:36:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.705+0000 7f6186ffd640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6178078b90 0x7f617807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.706+0000 7f6186ffd640 1 -- 172.21.15.146:0/512203087 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f61880ba180 con 0x7f6180003a30 2024-09-17T03:36:27.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.706+0000 7f6195d9b640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6178078b90 0x7f617807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.706+0000 7f6195d9b640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6178078b90 0x7f617807b0a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f618c000f60 tx=0x7f618c000ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.707+0000 7f61a3c23740 1 Processor -- start 2024-09-17T03:36:27.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.707+0000 7f61a3c23740 1 -- start start 2024-09-17T03:36:27.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.708+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f017d270 0x5590f054efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.708+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01543b0 0x5590f054f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.708+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f056c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.708+0000 7f61a3c23740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5590f0497820 con 0x5590f015c590 2024-09-17T03:36:27.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.708+0000 7f61a3c23740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5590f0486c50 con 0x5590f01543b0 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.708+0000 7f61a3c23740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5590f048aa60 con 0x5590f017d270 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.708+0000 7f6196d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f056c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.708+0000 7f6196d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f056c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57036/0 (socket says 172.21.15.146:57036) 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.708+0000 7f6196d9d640 1 -- 172.21.15.146:0/3252352004 learned_addr learned my addr 172.21.15.146:0/3252352004 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.708+0000 7f619659c640 1 --2- 172.21.15.146:0/3252352004 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f017d270 0x5590f054efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.709+0000 7f6195d9b640 1 --2- 172.21.15.146:0/3252352004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01543b0 0x5590f054f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.709+0000 7f6196d9d640 1 -- 172.21.15.146:0/3252352004 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f017d270 msgr2=0x5590f054efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.709+0000 7f6196d9d640 1 --2- 172.21.15.146:0/3252352004 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f017d270 0x5590f054efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.709+0000 7f6196d9d640 1 -- 172.21.15.146:0/3252352004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01543b0 msgr2=0x5590f054f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.709+0000 7f6196d9d640 1 --2- 172.21.15.146:0/3252352004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01543b0 0x5590f054f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.709+0000 7f6196d9d640 1 -- 172.21.15.146:0/3252352004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590f01e8850 con 0x5590f015c590 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.709+0000 7f6196d9d640 1 --2- 172.21.15.146:0/3252352004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f056c3e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f61980b34c0 tx=0x7f6190009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663ec2dfabe1781 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.709+0000 7f6177fff640 1 -- 172.21.15.146:0/3252352004 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190004570 con 0x5590f015c590 2024-09-17T03:36:27.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.709+0000 7f6177fff640 1 -- 172.21.15.146:0/3252352004 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6190016070 con 0x5590f015c590 2024-09-17T03:36:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.709+0000 7f6177fff640 1 -- 172.21.15.146:0/3252352004 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619001b470 con 0x5590f015c590 2024-09-17T03:36:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.710+0000 7f61a3c23740 1 -- 172.21.15.146:0/3252352004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 msgr2=0x5590f056c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.710+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3252352004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f056c3e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f61980b34c0 tx=0x7f6190009cb0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.710+0000 7f61a3c23740 1 -- 172.21.15.146:0/3252352004 shutdown_connections 2024-09-17T03:36:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.710+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3252352004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f056c3e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.710+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3252352004 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01543b0 0x5590f054f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.710+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3252352004 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f017d270 0x5590f054efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.710+0000 7f61a3c23740 1 -- 172.21.15.146:0/3252352004 >> 172.21.15.146:0/3252352004 conn(0x5590f01713c0 msgr2=0x5590f0525260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.710+0000 7f61a3c23740 1 -- 172.21.15.146:0/3252352004 shutdown_connections 2024-09-17T03:36:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.710+0000 7f61a3c23740 1 -- 172.21.15.146:0/3252352004 wait complete. 2024-09-17T03:36:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.711+0000 7f61a3c23740 1 -- start start 2024-09-17T03:36:27.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.711+0000 7f61a3c23740 1 Processor -- start 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.712+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f01543b0 0x5590f057c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.712+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f015c590 0x5590f057cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.712+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f017d270 0x5590f057b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.712+0000 7f61a3c23740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5590f01f7620 con 0x5590f017d270 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.712+0000 7f61a3c23740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5590f042c5f0 con 0x5590f015c590 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.712+0000 7f61a3c23740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5590f054fa20 con 0x5590f01543b0 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.712+0000 7f61a3c23740 10 client.0 _ll_register_callbacks cb 0x5590f04300a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f6196d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f017d270 0x5590f057b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f6196d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f017d270 0x5590f057b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57046/0 (socket says 172.21.15.146:57046) 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f6196d9d640 1 -- 172.21.15.146:0/3880112388 learned_addr learned my addr 172.21.15.146:0/3880112388 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f619659c640 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f01543b0 0x5590f057c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f6195d9b640 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f015c590 0x5590f057cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f6196d9d640 1 -- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f01543b0 msgr2=0x5590f057c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f6196d9d640 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f01543b0 0x5590f057c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f6196d9d640 1 -- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f015c590 msgr2=0x5590f057cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f6196d9d640 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f015c590 0x5590f057cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f6196d9d640 1 -- 172.21.15.146:0/3880112388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590f025f6b0 con 0x5590f017d270 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f6196d9d640 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f017d270 0x5590f057b1b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x5590f0526e30 tx=0x7f619001da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3610a962278167a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f61757fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f61757fa640 1 -- 172.21.15.146:0/3880112388 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190004570 con 0x5590f017d270 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f61757fa640 1 -- 172.21.15.146:0/3880112388 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f6190009de0 con 0x5590f017d270 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f61a3c23740 1 -- 172.21.15.146:0/3880112388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6190016070 con 0x5590f017d270 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f61757fa640 1 -- 172.21.15.146:0/3880112388 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6190030050 con 0x5590f017d270 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f61a3c23740 10 client.6501 fetch_fsmap learned FSMap version 29 2024-09-17T03:36:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f61a3c23740 1 -- 172.21.15.146:0/3880112388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5590f057c230 con 0x5590f017d270 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.713+0000 7f61757fa640 1 -- 172.21.15.146:0/3880112388 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6190016070 con 0x5590f017d270 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.714+0000 7f61757fa640 1 -- 172.21.15.146:0/3880112388 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f6190033020 con 0x5590f017d270 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.714+0000 7f61a3c23740 10 client.6501 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.714+0000 7f61a3c23740 10 client.6501 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.714+0000 7f61a3c23740 20 client.6501 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.714+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x5590f013be40 0x5590f0579270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.714+0000 7f61a3c23740 4 client.6501 mds_command: new command op to 5890 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.714+0000 7f61a3c23740 1 -- 172.21.15.146:0/3880112388 --> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590f0499770 con 0x5590f013be40 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.714+0000 7f619659c640 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x5590f013be40 0x5590f0579270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.714+0000 7f61757fa640 10 client.6501 ms_handle_connect on v2:172.21.15.179:6834/2016497882 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.714+0000 7f619659c640 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x5590f013be40 0x5590f0579270 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9263e08b6cc92fe server_cookie=8fed005661b0bbae in_seq=0 out_seq=0 2024-09-17T03:36:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.715+0000 7f61757fa640 1 -- 172.21.15.146:0/3880112388 <== mds.0 v2:172.21.15.179:6834/2016497882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5590f0499770 con 0x5590f013be40 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.715+0000 7f61757fa640 10 client.6501 handle_command_reply: tid=0 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.715+0000 7f61a3c23740 1 client.6501 shutdown 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.715+0000 7f61a3c23740 1 -- 172.21.15.146:0/3880112388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f017d270 msgr2=0x5590f057b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.715+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f017d270 0x5590f057b1b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x5590f0526e30 tx=0x7f619001da10 comp rx=0 tx=0).stop 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.716+0000 7f61a3c23740 1 -- 172.21.15.146:0/3880112388 shutdown_connections 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.716+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x5590f013be40 0x5590f0579270 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.716+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f017d270 0x5590f057b1b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.716+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f015c590 0x5590f057cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.716+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3880112388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f01543b0 0x5590f057c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.716+0000 7f61757fa640 0 client.6501 ms_handle_reset on v2:172.21.15.179:6834/2016497882 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.716+0000 7f61a3c23740 1 -- 172.21.15.146:0/3880112388 >> 172.21.15.146:0/3880112388 conn(0x5590f01713c0 msgr2=0x5590f056c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.716+0000 7f61a3c23740 1 -- 172.21.15.146:0/3880112388 shutdown_connections 2024-09-17T03:36:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.716+0000 7f61a3c23740 1 -- 172.21.15.146:0/3880112388 wait complete. 2024-09-17T03:36:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.716+0000 7f61a3c23740 20 client.6501 trim_cache size 0 max 16384 2024-09-17T03:36:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.734+0000 7f61a3c23740 1 Processor -- start 2024-09-17T03:36:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.734+0000 7f61a3c23740 1 -- start start 2024-09-17T03:36:27.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01713c0 0x5590f057c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f01543b0 0x5590f057cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f015c590 0x5590f052f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f61a3c23740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f61981ff5f0 con 0x5590f01543b0 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f61a3c23740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f61980c9f40 con 0x5590f01713c0 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f61a3c23740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f61981ff070 con 0x5590f015c590 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f6195d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f01543b0 0x5590f057cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f6195d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f01543b0 0x5590f057cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57054/0 (socket says 172.21.15.146:57054) 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f6195d9b640 1 -- 172.21.15.146:0/3910275258 learned_addr learned my addr 172.21.15.146:0/3910275258 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f619659c640 1 --2- 172.21.15.146:0/3910275258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01713c0 0x5590f057c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f6196d9d640 1 --2- 172.21.15.146:0/3910275258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f015c590 0x5590f052f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f6195d9b640 1 -- 172.21.15.146:0/3910275258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f015c590 msgr2=0x5590f052f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.735+0000 7f6195d9b640 1 --2- 172.21.15.146:0/3910275258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f015c590 0x5590f052f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.736+0000 7f6195d9b640 1 -- 172.21.15.146:0/3910275258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01713c0 msgr2=0x5590f057c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.736+0000 7f6195d9b640 1 --2- 172.21.15.146:0/3910275258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01713c0 0x5590f057c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.736+0000 7f6195d9b640 1 -- 172.21.15.146:0/3910275258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590f0562290 con 0x5590f01543b0 2024-09-17T03:36:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.736+0000 7f6196d9d640 1 --2- 172.21.15.146:0/3910275258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f015c590 0x5590f052f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.736+0000 7f6195d9b640 1 --2- 172.21.15.146:0/3910275258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f01543b0 0x5590f057cd80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f618c003bb0 tx=0x7f618c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b54edc7dc3b7818 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.736+0000 7f61777fe640 1 -- 172.21.15.146:0/3910275258 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c01fb80 con 0x5590f01543b0 2024-09-17T03:36:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.736+0000 7f61777fe640 1 -- 172.21.15.146:0/3910275258 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f618c01fd20 con 0x5590f01543b0 2024-09-17T03:36:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.736+0000 7f61777fe640 1 -- 172.21.15.146:0/3910275258 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c011430 con 0x5590f01543b0 2024-09-17T03:36:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.736+0000 7f61a3c23740 1 -- 172.21.15.146:0/3910275258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f01543b0 msgr2=0x5590f057cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.737+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3910275258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f01543b0 0x5590f057cd80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f618c003bb0 tx=0x7f618c012000 comp rx=0 tx=0).stop 2024-09-17T03:36:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.737+0000 7f61a3c23740 1 -- 172.21.15.146:0/3910275258 shutdown_connections 2024-09-17T03:36:27.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.737+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3910275258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f015c590 0x5590f052f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.737+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3910275258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f01543b0 0x5590f057cd80 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.737+0000 7f61a3c23740 1 --2- 172.21.15.146:0/3910275258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01713c0 0x5590f057c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.737+0000 7f61a3c23740 1 -- 172.21.15.146:0/3910275258 >> 172.21.15.146:0/3910275258 conn(0x5590f057b2e0 msgr2=0x5590f054c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.737+0000 7f61a3c23740 1 -- 172.21.15.146:0/3910275258 shutdown_connections 2024-09-17T03:36:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.737+0000 7f61a3c23740 1 -- 172.21.15.146:0/3910275258 wait complete. 2024-09-17T03:36:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.737+0000 7f61a3c23740 1 -- start start 2024-09-17T03:36:27.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.737+0000 7f61a3c23740 1 Processor -- start 2024-09-17T03:36:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01543b0 0x5590f05ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f057c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f61a3c23740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f01713c0 0x5590f057cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f61a3c23740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5590f057c060 con 0x5590f015c590 2024-09-17T03:36:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f61a3c23740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5590f057bbc0 con 0x5590f01543b0 2024-09-17T03:36:27.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f61a3c23740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5590f0562480 con 0x5590f01713c0 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f61a3c23740 10 client.0 _ll_register_callbacks cb 0x7f618c0015d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f6195d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f057c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f6195d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f057c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57070/0 (socket says 172.21.15.146:57070) 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f6195d9b640 1 -- 172.21.15.146:0/1462749972 learned_addr learned my addr 172.21.15.146:0/1462749972 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f6196d9d640 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f01713c0 0x5590f057cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f619659c640 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01543b0 0x5590f05ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f6195d9b640 1 -- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f01713c0 msgr2=0x5590f057cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f6195d9b640 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f01713c0 0x5590f057cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f6195d9b640 1 -- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01543b0 msgr2=0x5590f05ed6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f6195d9b640 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01543b0 0x5590f05ed6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.739+0000 7f6195d9b640 1 -- 172.21.15.146:0/1462749972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590f05edc20 con 0x5590f015c590 2024-09-17T03:36:27.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f6195d9b640 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f057c840 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f618c01f8d0 tx=0x7f618c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a52853f760bb829 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61757fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61757fa640 1 -- 172.21.15.146:0/1462749972 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c011640 con 0x5590f015c590 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61757fa640 1 -- 172.21.15.146:0/1462749972 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f618c025070 con 0x5590f015c590 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61a3c23740 1 -- 172.21.15.146:0/1462749972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f618c01fd20 con 0x5590f015c590 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61757fa640 1 -- 172.21.15.146:0/1462749972 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f618c03c050 con 0x5590f015c590 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61a3c23740 10 client.6507 fetch_fsmap learned FSMap version 29 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61a3c23740 1 -- 172.21.15.146:0/1462749972 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5590f05672e0 con 0x5590f015c590 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61757fa640 1 -- 172.21.15.146:0/1462749972 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f618c01fd20 con 0x5590f015c590 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61757fa640 1 -- 172.21.15.146:0/1462749972 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f618c03f020 con 0x5590f015c590 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61a3c23740 10 client.6507 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61a3c23740 10 client.6507 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61a3c23740 20 client.6507 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61a3c23740 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x5590f0111280 0x5590f05f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61a3c23740 4 client.6507 mds_command: new command op to 5890 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:36:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f61a3c23740 1 -- 172.21.15.146:0/1462749972 --> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] -- command(tid 0: {"prefix": "status"}) -- 0x5590f0495220 con 0x5590f0111280 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.740+0000 7f619659c640 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x5590f0111280 0x5590f05f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61757fa640 10 client.6507 ms_handle_connect on v2:172.21.15.179:6834/2016497882 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f619659c640 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x5590f0111280 0x5590f05f1f10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc25e162454b5c28 server_cookie=e9380bb818364c8c in_seq=0 out_seq=0 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61757fa640 1 -- 172.21.15.146:0/1462749972 <== mds.0 v2:172.21.15.179:6834/2016497882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5590f0495220 con 0x5590f0111280 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61757fa640 10 client.6507 handle_command_reply: tid=0 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 1 client.6507 shutdown 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 1 -- 172.21.15.146:0/1462749972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 msgr2=0x5590f057c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f057c840 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f618c01f8d0 tx=0x7f618c0039b0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 1 -- 172.21.15.146:0/1462749972 shutdown_connections 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x5590f0111280 0x5590f05f1f10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5590f01713c0 0x5590f057cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5590f015c590 0x5590f057c840 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 1 --2- 172.21.15.146:0/1462749972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5590f01543b0 0x5590f05ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61757fa640 0 client.6507 ms_handle_reset on v2:172.21.15.179:6834/2016497882 2024-09-17T03:36:27.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 1 -- 172.21.15.146:0/1462749972 >> 172.21.15.146:0/1462749972 conn(0x5590f057b2e0 msgr2=0x5590f0563c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:27.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 1 -- 172.21.15.146:0/1462749972 shutdown_connections 2024-09-17T03:36:27.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 1 -- 172.21.15.146:0/1462749972 wait complete. 2024-09-17T03:36:27.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.741+0000 7f61a3c23740 20 client.6507 trim_cache size 0 max 16384 2024-09-17T03:36:27.748 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:36:27.748 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:36:27.748 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:36:27.748 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5890, 2024-09-17T03:36:27.748 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:36:27.748 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:36:27.748 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:36:27.749 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 9.1369452199999994, 2024-09-17T03:36:27.749 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 29, 2024-09-17T03:36:27.749 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 58, 2024-09-17T03:36:27.749 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 58, 2024-09-17T03:36:27.749 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 13.850047198 2024-09-17T03:36:27.749 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:36:27.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 -- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6178078b90 msgr2=0x7f617807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6178078b90 0x7f617807b0a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f618c000f60 tx=0x7f618c000ef0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 -- 172.21.15.146:0/512203087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6180003a30 msgr2=0x7f61980ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6180003a30 0x7f61980ca760 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f61880017e0 tx=0x7f6188006360 comp rx=0 tx=0).stop 2024-09-17T03:36:27.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 -- 172.21.15.146:0/512203087 shutdown_connections 2024-09-17T03:36:27.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6178078b90 0x7f617807b0a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f61980c9130 0x7f61981f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f61980af390 0x7f61981e18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 --2- 172.21.15.146:0/512203087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6180003a30 0x7f61980ca760 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 -- 172.21.15.146:0/512203087 >> 172.21.15.146:0/512203087 conn(0x7f619809ba20 msgr2=0x7f61980706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:27.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 -- 172.21.15.146:0/512203087 shutdown_connections 2024-09-17T03:36:27.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.742+0000 7f619cbda640 1 -- 172.21.15.146:0/512203087 wait complete. 2024-09-17T03:36:27.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:36:27.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.866+0000 7f43ecdda640 1 -- 172.21.15.146:0/2878639069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43e80cd840 msgr2=0x7f43e80b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.866+0000 7f43ecdda640 1 --2- 172.21.15.146:0/2878639069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43e80cd840 0x7f43e80b5680 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f43e8073030 tx=0x7f43dc02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.866+0000 7f43ecdda640 1 -- 172.21.15.146:0/2878639069 shutdown_connections 2024-09-17T03:36:27.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.866+0000 7f43ecdda640 1 --2- 172.21.15.146:0/2878639069 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43e80cdc50 0x7f43e80b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.866+0000 7f43ecdda640 1 --2- 172.21.15.146:0/2878639069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43e80cd840 0x7f43e80b5680 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.866+0000 7f43ecdda640 1 --2- 172.21.15.146:0/2878639069 >> v2:172.21.15.179:3300/0 conn(0x7f43e815c8e0 0x7f43e806f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.866+0000 7f43ecdda640 1 -- 172.21.15.146:0/2878639069 >> 172.21.15.146:0/2878639069 conn(0x7f43e80b3150 msgr2=0x7f43e80b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:27.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.866+0000 7f43ecdda640 1 -- 172.21.15.146:0/2878639069 shutdown_connections 2024-09-17T03:36:27.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.866+0000 7f43ecdda640 1 -- 172.21.15.146:0/2878639069 wait complete. 2024-09-17T03:36:27.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.868+0000 7f43ecdda640 1 Processor -- start 2024-09-17T03:36:27.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.868+0000 7f43ecdda640 1 -- start start 2024-09-17T03:36:27.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.869+0000 7f43ecdda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43e80cd840 0x7f43e81f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.869+0000 7f43ecdda640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43e80cdc50 0x7f43e80cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.869+0000 7f43ecdda640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43e815c8e0 0x7f43e80cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.869+0000 7f43ecdda640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f43e80b5470 con 0x7f43e815c8e0 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.869+0000 7f43ecdda640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f43e80b52f0 con 0x7f43e80cd840 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.869+0000 7f43ecdda640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f43e8073580 con 0x7f43e80cdc50 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.869+0000 7f43e6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43e815c8e0 0x7f43e80cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43e6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43e815c8e0 0x7f43e80cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57086/0 (socket says 172.21.15.146:57086) 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43e6d9d640 1 -- 172.21.15.146:0/1511280549 learned_addr learned my addr 172.21.15.146:0/1511280549 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43e659c640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43e80cd840 0x7f43e81f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43e5d9b640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43e80cdc50 0x7f43e80cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43e6d9d640 1 -- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43e80cdc50 msgr2=0x7f43e80cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43e6d9d640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43e80cdc50 0x7f43e80cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43e6d9d640 1 -- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43e80cd840 msgr2=0x7f43e81f65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43e6d9d640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43e80cd840 0x7f43e81f65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:27.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43e6d9d640 1 -- 172.21.15.146:0/1511280549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e8167540 con 0x7f43e815c8e0 2024-09-17T03:36:27.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43e6d9d640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43e815c8e0 0x7f43e80cfc80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f43e000e9c0 tx=0x7f43e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:27.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43d6ffd640 1 -- 172.21.15.146:0/1511280549 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0004d20 con 0x7f43e815c8e0 2024-09-17T03:36:27.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43d6ffd640 1 -- 172.21.15.146:0/1511280549 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43e000cac0 con 0x7f43e815c8e0 2024-09-17T03:36:27.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43d6ffd640 1 -- 172.21.15.146:0/1511280549 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0005020 con 0x7f43e815c8e0 2024-09-17T03:36:27.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43ecdda640 1 -- 172.21.15.146:0/1511280549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e8167820 con 0x7f43e815c8e0 2024-09-17T03:36:27.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.870+0000 7f43ecdda640 1 -- 172.21.15.146:0/1511280549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e8167de0 con 0x7f43e815c8e0 2024-09-17T03:36:27.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.871+0000 7f43ecdda640 1 -- 172.21.15.146:0/1511280549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e80b1a00 con 0x7f43e815c8e0 2024-09-17T03:36:27.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.872+0000 7f43d6ffd640 1 -- 172.21.15.146:0/1511280549 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43e00051c0 con 0x7f43e815c8e0 2024-09-17T03:36:27.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.872+0000 7f43d6ffd640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43c8078bc0 0x7f43c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:27.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.873+0000 7f43d6ffd640 1 -- 172.21.15.146:0/1511280549 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f43e009b450 con 0x7f43e815c8e0 2024-09-17T03:36:27.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.873+0000 7f43e659c640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43c8078bc0 0x7f43c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:27.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.873+0000 7f43e659c640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43c8078bc0 0x7f43c807b0d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009a40 tx=0x7f43d8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:27.877+0000 7f43d6ffd640 1 -- 172.21.15.146:0/1511280549 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f43e80b1a00 con 0x7f43e815c8e0 2024-09-17T03:36:28.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.089+0000 7f43ecdda640 1 -- 172.21.15.146:0/1511280549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f43e81f6b40 con 0x7f43e815c8e0 2024-09-17T03:36:28.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.089+0000 7f43d6ffd640 1 -- 172.21.15.146:0/1511280549 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+73 (secure 0 0 0) 0x7f43e0016030 con 0x7f43e815c8e0 2024-09-17T03:36:28.089 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:36:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 -- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43c8078bc0 msgr2=0x7f43c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43c8078bc0 0x7f43c807b0d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009a40 tx=0x7f43d8005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 -- 172.21.15.146:0/1511280549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43e815c8e0 msgr2=0x7f43e80cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43e815c8e0 0x7f43e80cfc80 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f43e000e9c0 tx=0x7f43e000ee80 comp rx=0 tx=0).stop 2024-09-17T03:36:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 -- 172.21.15.146:0/1511280549 shutdown_connections 2024-09-17T03:36:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f43c8078bc0 0x7f43c807b0d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43e815c8e0 0x7f43e80cfc80 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43e80cdc50 0x7f43e80cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 --2- 172.21.15.146:0/1511280549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43e80cd840 0x7f43e81f65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 -- 172.21.15.146:0/1511280549 >> 172.21.15.146:0/1511280549 conn(0x7f43e80b3150 msgr2=0x7f43e80b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:28.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 -- 172.21.15.146:0/1511280549 shutdown_connections 2024-09-17T03:36:28.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.091+0000 7f43ecdda640 1 -- 172.21.15.146:0/1511280549 wait complete. 2024-09-17T03:36:28.103 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:36:28.103 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:36:28.103 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:36:28.103 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:36:28.103 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:28.103 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:36:28.103 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:36:28.103 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:36:28.103 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:36:28.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:28.104 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:36:28.120 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:36:28.120 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:36:28.120 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:36:28.120 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:28.120 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:36:28.120 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:28.121 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:28.121 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:28.121 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:36:28.121 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:28.121 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:28.121 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:36:28.121 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:36:28.121 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:28.121 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:36:28.121 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:28.121 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42584sec preferred_lft 42584sec 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:36:28.122 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:36:28.123 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:28.123 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:36:28.123 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:36:28.123 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:36:28.123 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:36:28.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:28.123 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:36:28.184 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:36:28.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:28.186 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:36:28.241 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:36:28.241 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:36:28.242 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:36:28.242 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:36:28.242 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:36:28.242 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:36:28.242 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:36:28.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:36:28.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:36:28.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:36:28.242 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:36:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:36:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:28.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:28.368 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:36:28.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:36:28.383 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:36:28.383 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:36:28.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:28.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:36:28.449 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:28.449 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:28.504 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:36:28.504 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:36:28.505 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:28.562 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:36:28.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:28.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:28.656 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:28.656 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:36:28.656 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:36:28.667 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:28.667 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:36:28.667 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:36:28.667 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:36:28.667 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:28.686 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:36:28.686 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:36:28.686 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:36:28.686 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:36:28.686 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:36:28.687 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:36:28.687 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:36:28.687 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:36:28.687 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:36:28.687 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:36:28.687 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:36:28.687 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:36:28.687 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:36:28.689 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:36:28.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:28.689 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:28.714 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:36:28.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:36:28.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:28.817 INFO:teuthology.orchestra.run.smithi146.stdout:client6010 2024-09-17T03:36:28.818 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:28.818 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:28.834 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-17T03:36:28.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.990+0000 7f8690a7e640 1 -- 172.21.15.146:0/970957336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f868c06e0d0 msgr2=0x7f868c06e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:28.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.990+0000 7f8690a7e640 1 --2- 172.21.15.146:0/970957336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f868c06e0d0 0x7f868c06e4e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f868c0d2620 tx=0x7f867402a560 comp rx=0 tx=0).stop 2024-09-17T03:36:28.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.990+0000 7f8690a7e640 1 -- 172.21.15.146:0/970957336 shutdown_connections 2024-09-17T03:36:28.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.990+0000 7f8690a7e640 1 --2- 172.21.15.146:0/970957336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f868c06e0d0 0x7f868c06e4e0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.990+0000 7f8690a7e640 1 --2- 172.21.15.146:0/970957336 >> v2:172.21.15.179:3300/0 conn(0x7f868c155dc0 0x7f868c06f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.990+0000 7f8690a7e640 1 -- 172.21.15.146:0/970957336 >> 172.21.15.146:0/970957336 conn(0x7f868c0b3720 msgr2=0x7f868c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:28.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.990+0000 7f8690a7e640 1 -- 172.21.15.146:0/970957336 shutdown_connections 2024-09-17T03:36:28.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.990+0000 7f8690a7e640 1 -- 172.21.15.146:0/970957336 wait complete. 2024-09-17T03:36:28.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.992+0000 7f8690a7e640 1 Processor -- start 2024-09-17T03:36:28.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.992+0000 7f8690a7e640 1 -- start start 2024-09-17T03:36:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.993+0000 7f8690a7e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f868c06e0d0 0x7f868c150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.993+0000 7f8690a7e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f868c0734f0 0x7f868c14b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f8690a7e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f868c155dc0 0x7f868c14b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:28.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f8690a7e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f868c0b5540 con 0x7f868c155dc0 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f8690a7e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f868c0b53c0 con 0x7f868c06e0d0 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f8690a7e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f868c0b56c0 con 0x7f868c0734f0 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f868ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f868c155dc0 0x7f868c14b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f868ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f868c155dc0 0x7f868c14b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57108/0 (socket says 172.21.15.146:57108) 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f868ad9d640 1 -- 172.21.15.146:0/894800357 learned_addr learned my addr 172.21.15.146:0/894800357 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f8689d9b640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f868c0734f0 0x7f868c14b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f868a59c640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f868c06e0d0 0x7f868c150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f868ad9d640 1 -- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f868c0734f0 msgr2=0x7f868c14b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f868ad9d640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f868c0734f0 0x7f868c14b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f868ad9d640 1 -- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f868c06e0d0 msgr2=0x7f868c150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f868ad9d640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f868c06e0d0 0x7f868c150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:28.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f868ad9d640 1 -- 172.21.15.146:0/894800357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c1370d0 con 0x7f868c155dc0 2024-09-17T03:36:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f868a59c640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f868c06e0d0 0x7f868c150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f868ad9d640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f868c155dc0 0x7f868c14b720 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f868400c3c0 tx=0x7f868400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f8682ffd640 1 -- 172.21.15.146:0/894800357 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684017070 con 0x7f868c155dc0 2024-09-17T03:36:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f8682ffd640 1 -- 172.21.15.146:0/894800357 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86840053c0 con 0x7f868c155dc0 2024-09-17T03:36:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f8690a7e640 1 -- 172.21.15.146:0/894800357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868c14c080 con 0x7f868c155dc0 2024-09-17T03:36:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f8682ffd640 1 -- 172.21.15.146:0/894800357 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684003850 con 0x7f868c155dc0 2024-09-17T03:36:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.994+0000 7f8690a7e640 1 -- 172.21.15.146:0/894800357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868c15d3f0 con 0x7f868c155dc0 2024-09-17T03:36:28.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.995+0000 7f8690a7e640 1 -- 172.21.15.146:0/894800357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f868c14bdf0 con 0x7f868c155dc0 2024-09-17T03:36:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.996+0000 7f8682ffd640 1 -- 172.21.15.146:0/894800357 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f868401a070 con 0x7f868c155dc0 2024-09-17T03:36:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.997+0000 7f8682ffd640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f866c078b90 0x7f866c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.997+0000 7f8682ffd640 1 -- 172.21.15.146:0/894800357 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f8684099f60 con 0x7f868c155dc0 2024-09-17T03:36:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.997+0000 7f868a59c640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f866c078b90 0x7f866c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:28.997+0000 7f868a59c640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f866c078b90 0x7f866c07b0a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f867c005fd0 tx=0x7f867c009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:29.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.001+0000 7f8682ffd640 1 -- 172.21.15.146:0/894800357 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f868c06ea20 con 0x7f868c155dc0 2024-09-17T03:36:29.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.175+0000 7f8690a7e640 1 -- 172.21.15.146:0/894800357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f868c1372a0 con 0x7f868c155dc0 2024-09-17T03:36:29.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.178+0000 7f8682ffd640 1 -- 172.21.15.146:0/894800357 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v37)=0 v37) ==== 117+0+0 (secure 0 0 0) 0x7f8684061d50 con 0x7f868c155dc0 2024-09-17T03:36:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 -- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f866c078b90 msgr2=0x7f866c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f866c078b90 0x7f866c07b0a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f867c005fd0 tx=0x7f867c009500 comp rx=0 tx=0).stop 2024-09-17T03:36:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 -- 172.21.15.146:0/894800357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f868c155dc0 msgr2=0x7f868c14b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f868c155dc0 0x7f868c14b720 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f868400c3c0 tx=0x7f868400c880 comp rx=0 tx=0).stop 2024-09-17T03:36:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 -- 172.21.15.146:0/894800357 shutdown_connections 2024-09-17T03:36:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f866c078b90 0x7f866c07b0a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f868c155dc0 0x7f868c14b720 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f868c0734f0 0x7f868c14b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 --2- 172.21.15.146:0/894800357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f868c06e0d0 0x7f868c150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 -- 172.21.15.146:0/894800357 >> 172.21.15.146:0/894800357 conn(0x7f868c0b3720 msgr2=0x7f868c070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 -- 172.21.15.146:0/894800357 shutdown_connections 2024-09-17T03:36:29.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.181+0000 7f8690a7e640 1 -- 172.21.15.146:0/894800357 wait complete. 2024-09-17T03:36:29.192 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-17T03:36:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.307+0000 7f776dda1640 1 -- 172.21.15.146:0/3798491458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77680cd990 msgr2=0x7f7768074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.307+0000 7f776dda1640 1 --2- 172.21.15.146:0/3798491458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77680cd990 0x7f7768074740 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f77680727a0 tx=0x7f775802a410 comp rx=0 tx=0).stop 2024-09-17T03:36:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.307+0000 7f776dda1640 1 -- 172.21.15.146:0/3798491458 shutdown_connections 2024-09-17T03:36:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.307+0000 7f776dda1640 1 --2- 172.21.15.146:0/3798491458 >> v2:172.21.15.179:3300/0 conn(0x7f7768070090 0x7f776815f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.307+0000 7f776dda1640 1 --2- 172.21.15.146:0/3798491458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77680cd990 0x7f7768074740 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.307+0000 7f776dda1640 1 -- 172.21.15.146:0/3798491458 >> 172.21.15.146:0/3798491458 conn(0x7f77680b2950 msgr2=0x7f77680b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.307+0000 7f776dda1640 1 -- 172.21.15.146:0/3798491458 shutdown_connections 2024-09-17T03:36:29.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.307+0000 7f776dda1640 1 -- 172.21.15.146:0/3798491458 wait complete. 2024-09-17T03:36:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.309+0000 7f776dda1640 1 Processor -- start 2024-09-17T03:36:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.309+0000 7f776dda1640 1 -- start start 2024-09-17T03:36:29.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f776dda1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77680cd990 0x7f7768155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f776dda1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f776815b8c0 0x7f77680aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f776dda1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77681f3c90 0x7f77680aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f776dda1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f776815fb80 con 0x7f77681f3c90 2024-09-17T03:36:29.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f776dda1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f776815fa00 con 0x7f77680cd990 2024-09-17T03:36:29.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f776dda1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f776815fd00 con 0x7f776815b8c0 2024-09-17T03:36:29.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f7767fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77681f3c90 0x7f77680aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f7767fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77681f3c90 0x7f77680aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57124/0 (socket says 172.21.15.146:57124) 2024-09-17T03:36:29.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f7767fff640 1 -- 172.21.15.146:0/2188663723 learned_addr learned my addr 172.21.15.146:0/2188663723 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f7766ffd640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f776815b8c0 0x7f77680aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f7767fff640 1 -- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f776815b8c0 msgr2=0x7f77680aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f7767fff640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f776815b8c0 0x7f77680aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f7767fff640 1 -- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77680cd990 msgr2=0x7f7768155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f77677fe640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77680cd990 0x7f7768155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f7767fff640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77680cd990 0x7f7768155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f7767fff640 1 -- 172.21.15.146:0/2188663723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776815f460 con 0x7f77681f3c90 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f7767fff640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77681f3c90 0x7f77680aae50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f776000e990 tx=0x7f776000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f774ffff640 1 -- 172.21.15.146:0/2188663723 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760004d20 con 0x7f77681f3c90 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f774ffff640 1 -- 172.21.15.146:0/2188663723 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f776000caa0 con 0x7f77681f3c90 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f774ffff640 1 -- 172.21.15.146:0/2188663723 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760005020 con 0x7f77681f3c90 2024-09-17T03:36:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f776dda1640 1 -- 172.21.15.146:0/2188663723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77681f31b0 con 0x7f77681f3c90 2024-09-17T03:36:29.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.311+0000 7f776dda1640 1 -- 172.21.15.146:0/2188663723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77680ab500 con 0x7f77681f3c90 2024-09-17T03:36:29.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.312+0000 7f776dda1640 1 -- 172.21.15.146:0/2188663723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77680ab760 con 0x7f77681f3c90 2024-09-17T03:36:29.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.313+0000 7f774ffff640 1 -- 172.21.15.146:0/2188663723 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77600051c0 con 0x7f77681f3c90 2024-09-17T03:36:29.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.314+0000 7f774ffff640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7754078b90 0x7f775407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.314+0000 7f774ffff640 1 -- 172.21.15.146:0/2188663723 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f776009b590 con 0x7f77681f3c90 2024-09-17T03:36:29.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.314+0000 7f77677fe640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7754078b90 0x7f775407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.315+0000 7f77677fe640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7754078b90 0x7f775407b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7758034000 tx=0x7f7758004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.319+0000 7f774ffff640 1 -- 172.21.15.146:0/2188663723 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7760016030 con 0x7f77681f3c90 2024-09-17T03:36:29.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.492+0000 7f776dda1640 1 -- 172.21.15.146:0/2188663723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f7768160220 con 0x7f77681f3c90 2024-09-17T03:36:29.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.497+0000 7f774ffff640 1 -- 172.21.15.146:0/2188663723 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v38)=0 v38) ==== 116+0+0 (secure 0 0 0) 0x7f7760063af0 con 0x7f77681f3c90 2024-09-17T03:36:29.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 -- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7754078b90 msgr2=0x7f775407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7754078b90 0x7f775407b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7758034000 tx=0x7f7758004730 comp rx=0 tx=0).stop 2024-09-17T03:36:29.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 -- 172.21.15.146:0/2188663723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77681f3c90 msgr2=0x7f77680aae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77681f3c90 0x7f77680aae50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f776000e990 tx=0x7f776000ee50 comp rx=0 tx=0).stop 2024-09-17T03:36:29.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 -- 172.21.15.146:0/2188663723 shutdown_connections 2024-09-17T03:36:29.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7754078b90 0x7f775407b0a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77681f3c90 0x7f77680aae50 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f776815b8c0 0x7f77680aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 --2- 172.21.15.146:0/2188663723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77680cd990 0x7f7768155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 -- 172.21.15.146:0/2188663723 >> 172.21.15.146:0/2188663723 conn(0x7f77680b2950 msgr2=0x7f77681573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:29.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 -- 172.21.15.146:0/2188663723 shutdown_connections 2024-09-17T03:36:29.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.500+0000 7f776dda1640 1 -- 172.21.15.146:0/2188663723 wait complete. 2024-09-17T03:36:29.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-17T03:36:29.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.627+0000 7fb7954a2640 1 -- 172.21.15.146:0/3700857021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb778003fd0 msgr2=0x7fb778004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.627+0000 7fb7954a2640 1 --2- 172.21.15.146:0/3700857021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb778003fd0 0x7fb778004800 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb7900d0fa0 tx=0x7fb778005830 comp rx=0 tx=0).stop 2024-09-17T03:36:29.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.627+0000 7fb78f7fe640 1 -- 172.21.15.146:0/3700857021 reap_dead start 2024-09-17T03:36:29.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.627+0000 7fb7954a2640 1 -- 172.21.15.146:0/3700857021 shutdown_connections 2024-09-17T03:36:29.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.627+0000 7fb7954a2640 1 -- 172.21.15.146:0/3700857021 >> 172.21.15.146:0/3700857021 conn(0x7fb7900d4be0 msgr2=0x7fb7900d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:29.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.627+0000 7fb7954a2640 1 -- 172.21.15.146:0/3700857021 shutdown_connections 2024-09-17T03:36:29.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.627+0000 7fb7954a2640 1 -- 172.21.15.146:0/3700857021 wait complete. 2024-09-17T03:36:29.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.629+0000 7fb7954a2640 1 Processor -- start 2024-09-17T03:36:29.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.629+0000 7fb7954a2640 1 -- start start 2024-09-17T03:36:29.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb7954a2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb778003fd0 0x7fb790154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb7954a2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb790153830 0x7fb7900cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb7954a2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7900cd960 0x7fb7901f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb7954a2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb7900cf370 con 0x7fb7900cd960 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb7954a2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb7900d43b0 con 0x7fb778003fd0 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb7954a2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb7900cf4f0 con 0x7fb790153830 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7900cd960 0x7fb7901f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7900cd960 0x7fb7901f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57138/0 (socket says 172.21.15.146:57138) 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78f7fe640 1 -- 172.21.15.146:0/3741761525 learned_addr learned my addr 172.21.15.146:0/3741761525 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78effd640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb778003fd0 0x7fb790154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78e7fc640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb790153830 0x7fb7900cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78f7fe640 1 -- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb790153830 msgr2=0x7fb7900cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78f7fe640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb790153830 0x7fb7900cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78f7fe640 1 -- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb778003fd0 msgr2=0x7fb790154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78f7fe640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb778003fd0 0x7fb790154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78f7fe640 1 -- 172.21.15.146:0/3741761525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79015abd0 con 0x7fb7900cd960 2024-09-17T03:36:29.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78effd640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb778003fd0 0x7fb790154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:29.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb78f7fe640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7900cd960 0x7fb7901f66a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b37b0 tx=0x7fb788006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:29.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb7777fe640 1 -- 172.21.15.146:0/3741761525 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788010950 con 0x7fb7900cd960 2024-09-17T03:36:29.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb7777fe640 1 -- 172.21.15.146:0/3741761525 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb788016070 con 0x7fb7900cd960 2024-09-17T03:36:29.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb7954a2640 1 -- 172.21.15.146:0/3741761525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79015aeb0 con 0x7fb7900cd960 2024-09-17T03:36:29.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.631+0000 7fb7777fe640 1 -- 172.21.15.146:0/3741761525 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788010e20 con 0x7fb7900cd960 2024-09-17T03:36:29.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.632+0000 7fb7954a2640 1 -- 172.21.15.146:0/3741761525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7901f6180 con 0x7fb7900cd960 2024-09-17T03:36:29.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.633+0000 7fb7954a2640 1 -- 172.21.15.146:0/3741761525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7900cf190 con 0x7fb7900cd960 2024-09-17T03:36:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.633+0000 7fb7777fe640 1 -- 172.21.15.146:0/3741761525 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb78801b460 con 0x7fb7900cd960 2024-09-17T03:36:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.634+0000 7fb7777fe640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb77c078b90 0x7fb77c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.634+0000 7fb7777fe640 1 -- 172.21.15.146:0/3741761525 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fb78809b7d0 con 0x7fb7900cd960 2024-09-17T03:36:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.634+0000 7fb78effd640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb77c078b90 0x7fb77c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:29.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.635+0000 7fb78effd640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb77c078b90 0x7fb77c07b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb780009bb0 tx=0x7fb780005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:29.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.638+0000 7fb7777fe640 1 -- 172.21.15.146:0/3741761525 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb7900cf190 con 0x7fb7900cd960 2024-09-17T03:36:29.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.813+0000 7fb7954a2640 1 -- 172.21.15.146:0/3741761525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fb79015a6f0 con 0x7fb7900cd960 2024-09-17T03:36:29.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.817+0000 7fb7777fe640 1 -- 172.21.15.146:0/3741761525 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v39)=0 v39) ==== 116+0+0 (secure 0 0 0) 0x7fb79015a6f0 con 0x7fb7900cd960 2024-09-17T03:36:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 -- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb77c078b90 msgr2=0x7fb77c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb77c078b90 0x7fb77c07b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb780009bb0 tx=0x7fb780005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 -- 172.21.15.146:0/3741761525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7900cd960 msgr2=0x7fb7901f66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7900cd960 0x7fb7901f66a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b37b0 tx=0x7fb788006420 comp rx=0 tx=0).stop 2024-09-17T03:36:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 -- 172.21.15.146:0/3741761525 shutdown_connections 2024-09-17T03:36:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb77c078b90 0x7fb77c07b0a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7900cd960 0x7fb7901f66a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb790153830 0x7fb7900cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 --2- 172.21.15.146:0/3741761525 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb778003fd0 0x7fb790154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:29.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 -- 172.21.15.146:0/3741761525 >> 172.21.15.146:0/3741761525 conn(0x7fb7900d4be0 msgr2=0x7fb7900cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:29.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 -- 172.21.15.146:0/3741761525 shutdown_connections 2024-09-17T03:36:29.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29.820+0000 7fb7954a2640 1 -- 172.21.15.146:0/3741761525 wait complete. 2024-09-17T03:36:29.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:29.832 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-17T03:36:29.851 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:36:29.852 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:36:29.852 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-09-17T03:36:29.852 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:36:29.852 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-17T03:36:29.852 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:36:29.956 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627776 2024-09-17T03:36:29.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:29.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.119+0000 7f834109b640 1 -- 172.21.15.146:0/1541608627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f833c0b3d30 msgr2=0x7f833c1677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.119+0000 7f834109b640 1 --2- 172.21.15.146:0/1541608627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f833c0b3d30 0x7f833c1677c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8334005fd0 tx=0x7f833402a820 comp rx=0 tx=0).stop 2024-09-17T03:36:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.119+0000 7f834109b640 1 -- 172.21.15.146:0/1541608627 shutdown_connections 2024-09-17T03:36:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.119+0000 7f834109b640 1 --2- 172.21.15.146:0/1541608627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f833c0b3d30 0x7f833c1677c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.119+0000 7f834109b640 1 -- 172.21.15.146:0/1541608627 >> 172.21.15.146:0/1541608627 conn(0x7f833c0b7b20 msgr2=0x7f833c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.119+0000 7f834109b640 1 -- 172.21.15.146:0/1541608627 shutdown_connections 2024-09-17T03:36:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.120+0000 7f834109b640 1 -- 172.21.15.146:0/1541608627 wait complete. 2024-09-17T03:36:30.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.122+0000 7f834109b640 1 Processor -- start 2024-09-17T03:36:30.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.122+0000 7f834109b640 1 -- start start 2024-09-17T03:36:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f834109b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833c0b5750 0x7f833c13bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f834109b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f833c0b5ce0 0x7f833c156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f834109b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f833c156bc0 0x7f833c1f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f834109b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f833c167e80 con 0x7f833c0b5ce0 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f834109b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f833c167d00 con 0x7f833c156bc0 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f834109b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f833c168000 con 0x7f833c0b5750 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f833c0b5ce0 0x7f833c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f833c0b5ce0 0x7f833c156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57150/0 (socket says 172.21.15.146:57150) 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833a59c640 1 -- 172.21.15.146:0/3799641317 learned_addr learned my addr 172.21.15.146:0/3799641317 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833b59e640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f833c156bc0 0x7f833c1f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833ad9d640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833c0b5750 0x7f833c13bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833a59c640 1 -- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833c0b5750 msgr2=0x7f833c13bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833a59c640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833c0b5750 0x7f833c13bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833a59c640 1 -- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f833c156bc0 msgr2=0x7f833c1f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833a59c640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f833c156bc0 0x7f833c1f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833a59c640 1 -- 172.21.15.146:0/3799641317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c13c500 con 0x7f833c0b5ce0 2024-09-17T03:36:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833b59e640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f833c156bc0 0x7f833c1f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.123+0000 7f833a59c640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f833c0b5ce0 0x7f833c156680 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f833000c3f0 tx=0x7f833000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.124+0000 7f83237fe640 1 -- 172.21.15.146:0/3799641317 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330017070 con 0x7f833c0b5ce0 2024-09-17T03:36:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.124+0000 7f83237fe640 1 -- 172.21.15.146:0/3799641317 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83300035f0 con 0x7f833c0b5ce0 2024-09-17T03:36:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.124+0000 7f834109b640 1 -- 172.21.15.146:0/3799641317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833c150c60 con 0x7f833c0b5ce0 2024-09-17T03:36:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.124+0000 7f83237fe640 1 -- 172.21.15.146:0/3799641317 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330003a40 con 0x7f833c0b5ce0 2024-09-17T03:36:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.124+0000 7f834109b640 1 -- 172.21.15.146:0/3799641317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833c151220 con 0x7f833c0b5ce0 2024-09-17T03:36:30.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.125+0000 7f834109b640 1 -- 172.21.15.146:0/3799641317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833c0b1320 con 0x7f833c0b5ce0 2024-09-17T03:36:30.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.126+0000 7f83237fe640 1 -- 172.21.15.146:0/3799641317 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f833001a070 con 0x7f833c0b5ce0 2024-09-17T03:36:30.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.126+0000 7f83237fe640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8328078b90 0x7f832807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.126+0000 7f83237fe640 1 -- 172.21.15.146:0/3799641317 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f8330099f60 con 0x7f833c0b5ce0 2024-09-17T03:36:30.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.126+0000 7f833ad9d640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8328078b90 0x7f832807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.127+0000 7f833ad9d640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8328078b90 0x7f832807b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f832c006fd0 tx=0x7f832c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.130+0000 7f83237fe640 1 -- 172.21.15.146:0/3799641317 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f833c13c500 con 0x7f833c0b5ce0 2024-09-17T03:36:30.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.338+0000 7f834109b640 1 -- 172.21.15.146:0/3799641317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f833c0b65d0 con 0x7f833c0b5ce0 2024-09-17T03:36:30.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.338+0000 7f83237fe640 1 -- 172.21.15.146:0/3799641317 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5226 (secure 0 0 0) 0x7f83300624f0 con 0x7f833c0b5ce0 2024-09-17T03:36:30.339 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:30.339 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"btime":"2024-09-17T03:36:20:610421+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1042067483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1042067483},{"type":"v1","addr":"172.21.15.179:6837","nonce":1042067483}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5875,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3725156879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3725156879},{"type":"v1","addr":"172.21.15.146:6834","nonce":3725156879}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/6455506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":6455506},{"type":"v1","addr":"172.21.15.146:6835","nonce":6455506}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:19.961005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5890},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5890":{"gid":5890,"name":"d","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/2016497882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2016497882},{"type":"v1","addr":"172.21.15.179:6836","nonce":2016497882}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5890,"qdb_cluster":[5890]},"id":4}]} 2024-09-17T03:36:30.339 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 29 2024-09-17T03:36:30.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 -- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8328078b90 msgr2=0x7f832807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8328078b90 0x7f832807b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f832c006fd0 tx=0x7f832c008040 comp rx=0 tx=0).stop 2024-09-17T03:36:30.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 -- 172.21.15.146:0/3799641317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f833c0b5ce0 msgr2=0x7f833c156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f833c0b5ce0 0x7f833c156680 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f833000c3f0 tx=0x7f833000c8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 -- 172.21.15.146:0/3799641317 shutdown_connections 2024-09-17T03:36:30.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8328078b90 0x7f832807b0a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f833c156bc0 0x7f833c1f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f833c0b5ce0 0x7f833c156680 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 --2- 172.21.15.146:0/3799641317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f833c0b5750 0x7f833c13bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 -- 172.21.15.146:0/3799641317 >> 172.21.15.146:0/3799641317 conn(0x7f833c0b7b20 msgr2=0x7f833c0b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:30.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 -- 172.21.15.146:0/3799641317 shutdown_connections 2024-09-17T03:36:30.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.341+0000 7f834109b640 1 -- 172.21.15.146:0/3799641317 wait complete. 2024-09-17T03:36:30.352 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump inode 1099511627776 2024-09-17T03:36:30.488 INFO:teuthology.orchestra.run.smithi179.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T03:36:29.848515+0000","btime":"2024-09-17T03:36:29.848515+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T03:36:29.848515+0000","atime":"2024-09-17T03:36:29.848515+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6010,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6010,"want_loner":6010,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T03:36:30.489 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T03:36:29.848515+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-17T03:36:29.848515+0000", "change_attr": 0, "client_caps": [ { "client_id": 6010, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-17T03:36:29.848515+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6010, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T03:36:29.848515+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6010, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T03:36:30.489 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:30.489 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:30.505 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:36:30.505 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> n = 40 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> if 0 > 0: 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:36:30.506 DEBUG:teuthology.orchestra.run.smithi146:> try: 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2024-09-17T03:36:30.507 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(0): 2024-09-17T03:36:30.508 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-17T03:36:30.508 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:36:30.508 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-09-17T03:36:30.508 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2024-09-17T03:36:30.508 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2024-09-17T03:36:30.508 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:36:30.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:36:30.690 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:30.690 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:30.746 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:30.746 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:30.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:36:30.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.956+0000 7f83aff7b640 1 -- 172.21.15.146:0/202702855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a80b4100 msgr2=0x7f83a806fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.956+0000 7f83aff7b640 1 --2- 172.21.15.146:0/202702855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a80b4100 0x7f83a806fad0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f83a8069500 tx=0x7f839c02a530 comp rx=0 tx=0).stop 2024-09-17T03:36:30.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.956+0000 7f83aff7b640 1 -- 172.21.15.146:0/202702855 shutdown_connections 2024-09-17T03:36:30.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.956+0000 7f83aff7b640 1 --2- 172.21.15.146:0/202702855 >> v2:172.21.15.179:3300/0 conn(0x7f83a80b4510 0x7f83a8070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.956+0000 7f83aff7b640 1 --2- 172.21.15.146:0/202702855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a80b4100 0x7f83a806fad0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.956+0000 7f83aff7b640 1 -- 172.21.15.146:0/202702855 >> 172.21.15.146:0/202702855 conn(0x7f83a806d3c0 msgr2=0x7f83a80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:30.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.956+0000 7f83aff7b640 1 -- 172.21.15.146:0/202702855 shutdown_connections 2024-09-17T03:36:30.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.956+0000 7f83aff7b640 1 -- 172.21.15.146:0/202702855 wait complete. 2024-09-17T03:36:30.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.958+0000 7f83aff7b640 1 Processor -- start 2024-09-17T03:36:30.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.958+0000 7f83aff7b640 1 -- start start 2024-09-17T03:36:30.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83aff7b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a80b4100 0x7f83a80ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83aff7b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a80b4510 0x7f83a814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83aff7b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a81f65f0 0x7f83a81f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83aff7b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f83a80d0670 con 0x7f83a81f65f0 2024-09-17T03:36:30.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83aff7b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f83a80d04f0 con 0x7f83a80b4100 2024-09-17T03:36:30.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83aff7b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f83a80d07f0 con 0x7f83a80b4510 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83ae518640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a81f65f0 0x7f83a81f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83ae518640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a81f65f0 0x7f83a81f6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57166/0 (socket says 172.21.15.146:57166) 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83ae518640 1 -- 172.21.15.146:0/880625775 learned_addr learned my addr 172.21.15.146:0/880625775 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83add17640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a80b4100 0x7f83a80ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83ad516640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a80b4510 0x7f83a814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83ae518640 1 -- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a80b4510 msgr2=0x7f83a814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83ae518640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a80b4510 0x7f83a814f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83ae518640 1 -- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a80b4100 msgr2=0x7f83a80ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83ae518640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a80b4100 0x7f83a80ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83ae518640 1 -- 172.21.15.146:0/880625775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a80ad930 con 0x7f83a81f65f0 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.959+0000 7f83add17640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a80b4100 0x7f83a80ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:30.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.960+0000 7f83ae518640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a81f65f0 0x7f83a81f6a00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f83a000e960 tx=0x7f83a000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:30.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.960+0000 7f83a67fc640 1 -- 172.21.15.146:0/880625775 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0004d20 con 0x7f83a81f65f0 2024-09-17T03:36:30.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.960+0000 7f83a67fc640 1 -- 172.21.15.146:0/880625775 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83a000cb20 con 0x7f83a81f65f0 2024-09-17T03:36:30.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.960+0000 7f83a67fc640 1 -- 172.21.15.146:0/880625775 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0005020 con 0x7f83a81f65f0 2024-09-17T03:36:30.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.960+0000 7f83aff7b640 1 -- 172.21.15.146:0/880625775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a80adc10 con 0x7f83a81f65f0 2024-09-17T03:36:30.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.960+0000 7f83aff7b640 1 -- 172.21.15.146:0/880625775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a80ae1d0 con 0x7f83a81f65f0 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.961+0000 7f83aff7b640 1 -- 172.21.15.146:0/880625775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a815c9f0 con 0x7f83a81f65f0 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.962+0000 7f83a67fc640 1 -- 172.21.15.146:0/880625775 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f83a00051c0 con 0x7f83a81f65f0 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.962+0000 7f83a67fc640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8394078bc0 0x7f839407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.962+0000 7f83a67fc640 1 -- 172.21.15.146:0/880625775 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f83a009b620 con 0x7f83a81f65f0 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.962+0000 7f83add17640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8394078bc0 0x7f839407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:30.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.963+0000 7f83add17640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8394078bc0 0x7f839407b0d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8398007fd0 tx=0x7f8398009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:30.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:30.967+0000 7f83a67fc640 1 -- 172.21.15.146:0/880625775 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f83a0016030 con 0x7f83a81f65f0 2024-09-17T03:36:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.154+0000 7f83aff7b640 1 -- 172.21.15.146:0/880625775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f83a815ecb0 con 0x7f83a81f65f0 2024-09-17T03:36:31.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.155+0000 7f83a67fc640 1 -- 172.21.15.146:0/880625775 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) ==== 80+0+0 (secure 0 0 0) 0x7f83a0063af0 con 0x7f83a81f65f0 2024-09-17T03:36:31.155 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:36:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 -- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8394078bc0 msgr2=0x7f839407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8394078bc0 0x7f839407b0d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8398007fd0 tx=0x7f8398009040 comp rx=0 tx=0).stop 2024-09-17T03:36:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 -- 172.21.15.146:0/880625775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a81f65f0 msgr2=0x7f83a81f6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a81f65f0 0x7f83a81f6a00 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f83a000e960 tx=0x7f83a000ee20 comp rx=0 tx=0).stop 2024-09-17T03:36:31.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 -- 172.21.15.146:0/880625775 shutdown_connections 2024-09-17T03:36:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8394078bc0 0x7f839407b0d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83a81f65f0 0x7f83a81f6a00 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83a80b4510 0x7f83a814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 --2- 172.21.15.146:0/880625775 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83a80b4100 0x7f83a80ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 -- 172.21.15.146:0/880625775 >> 172.21.15.146:0/880625775 conn(0x7f83a806d3c0 msgr2=0x7f83a8151840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 -- 172.21.15.146:0/880625775 shutdown_connections 2024-09-17T03:36:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.157+0000 7f83aff7b640 1 -- 172.21.15.146:0/880625775 wait complete. 2024-09-17T03:36:31.168 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:36:31.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:31.168 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:36:31.270 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:36:31.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:31.271 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:36:31.286 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-17T03:36:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.442+0000 7f0f53320640 1 -- 172.21.15.146:0/2644979997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f4c15f1a0 msgr2=0x7f0f4c0cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.442+0000 7f0f53320640 1 --2- 172.21.15.146:0/2644979997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f4c15f1a0 0x7f0f4c0cfca0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c15cd70 tx=0x7f0f4802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.442+0000 7f0f53320640 1 -- 172.21.15.146:0/2644979997 shutdown_connections 2024-09-17T03:36:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.442+0000 7f0f53320640 1 --2- 172.21.15.146:0/2644979997 >> v2:172.21.15.179:3300/0 conn(0x7f0f4c1631a0 0x7f0f4c0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.442+0000 7f0f53320640 1 --2- 172.21.15.146:0/2644979997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f4c15f1a0 0x7f0f4c0cfca0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.442+0000 7f0f53320640 1 -- 172.21.15.146:0/2644979997 >> 172.21.15.146:0/2644979997 conn(0x7f0f4c0d11f0 msgr2=0x7f0f4c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.442+0000 7f0f53320640 1 -- 172.21.15.146:0/2644979997 shutdown_connections 2024-09-17T03:36:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.442+0000 7f0f53320640 1 -- 172.21.15.146:0/2644979997 wait complete. 2024-09-17T03:36:31.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.444+0000 7f0f53320640 1 Processor -- start 2024-09-17T03:36:31.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.444+0000 7f0f53320640 1 -- start start 2024-09-17T03:36:31.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.445+0000 7f0f53320640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f4c0b61f0 0x7f0f4c0c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.445+0000 7f0f53320640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f4c15f1a0 0x7f0f4c0cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.445+0000 7f0f53320640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f4c1631a0 0x7f0f4c160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.445+0000 7f0f53320640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c0695b0 con 0x7f0f4c0b61f0 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.445+0000 7f0f53320640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c069430 con 0x7f0f4c1631a0 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.445+0000 7f0f53320640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c069730 con 0x7f0f4c15f1a0 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.445+0000 7f0f510bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f4c0b61f0 0x7f0f4c0c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.445+0000 7f0f510bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f4c0b61f0 0x7f0f4c0c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57190/0 (socket says 172.21.15.146:57190) 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.445+0000 7f0f510bc640 1 -- 172.21.15.146:0/3742887626 learned_addr learned my addr 172.21.15.146:0/3742887626 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f518bd640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f4c1631a0 0x7f0f4c160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f508bb640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f4c15f1a0 0x7f0f4c0cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f510bc640 1 -- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f4c15f1a0 msgr2=0x7f0f4c0cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f510bc640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f4c15f1a0 0x7f0f4c0cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f510bc640 1 -- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f4c1631a0 msgr2=0x7f0f4c160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f510bc640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f4c1631a0 0x7f0f4c160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f510bc640 1 -- 172.21.15.146:0/3742887626 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c1f32c0 con 0x7f0f4c0b61f0 2024-09-17T03:36:31.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f510bc640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f4c0b61f0 0x7f0f4c0c74b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0f4802aa90 tx=0x7f0f48033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f41ffb640 1 -- 172.21.15.146:0/3742887626 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48005c90 con 0x7f0f4c0b61f0 2024-09-17T03:36:31.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f41ffb640 1 -- 172.21.15.146:0/3742887626 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f48031e50 con 0x7f0f4c0b61f0 2024-09-17T03:36:31.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f53320640 1 -- 172.21.15.146:0/3742887626 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4c1f6a90 con 0x7f0f4c0b61f0 2024-09-17T03:36:31.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f41ffb640 1 -- 172.21.15.146:0/3742887626 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48005260 con 0x7f0f4c0b61f0 2024-09-17T03:36:31.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.446+0000 7f0f53320640 1 -- 172.21.15.146:0/3742887626 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4c1f7050 con 0x7f0f4c0b61f0 2024-09-17T03:36:31.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.448+0000 7f0f41ffb640 1 -- 172.21.15.146:0/3742887626 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f48005400 con 0x7f0f4c0b61f0 2024-09-17T03:36:31.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.448+0000 7f0f41ffb640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f30078b90 0x7f0f3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.449+0000 7f0f41ffb640 1 -- 172.21.15.146:0/3742887626 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f0f480bbec0 con 0x7f0f4c0b61f0 2024-09-17T03:36:31.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.449+0000 7f0f508bb640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f30078b90 0x7f0f3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.449+0000 7f0f508bb640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f30078b90 0x7f0f3007b0a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c005d00 tx=0x7f0f3c005c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.449+0000 7f0f5a291740 1 Processor -- start 2024-09-17T03:36:31.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.449+0000 7f0f5a291740 1 -- start start 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a97b390 0x55713ad67a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad3c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad3cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f5a291740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55713ac95a60 con 0x55713a9524d0 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f5a291740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55713ac84e90 con 0x55713a95a6b0 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f5a291740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55713ac88ca0 con 0x55713a97b390 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f508bb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad3c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f508bb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad3c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57202/0 (socket says 172.21.15.146:57202) 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f508bb640 1 -- 172.21.15.146:0/3411865018 learned_addr learned my addr 172.21.15.146:0/3411865018 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f510bc640 1 --2- 172.21.15.146:0/3411865018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a97b390 0x55713ad67a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f518bd640 1 --2- 172.21.15.146:0/3411865018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad3cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f508bb640 1 -- 172.21.15.146:0/3411865018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a97b390 msgr2=0x55713ad67a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f508bb640 1 --2- 172.21.15.146:0/3411865018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a97b390 0x55713ad67a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f508bb640 1 -- 172.21.15.146:0/3411865018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 msgr2=0x55713ad3cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f508bb640 1 --2- 172.21.15.146:0/3411865018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad3cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f508bb640 1 -- 172.21.15.146:0/3411865018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713aa5d7d0 con 0x55713a9524d0 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f508bb640 1 --2- 172.21.15.146:0/3411865018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad3c860 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00ed00 tx=0x7f0f3c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84dc069a7efd4bfc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f36ffd640 1 -- 172.21.15.146:0/3411865018 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c01e440 con 0x55713a9524d0 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f36ffd640 1 -- 172.21.15.146:0/3411865018 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f3c023070 con 0x55713a9524d0 2024-09-17T03:36:31.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.451+0000 7f0f36ffd640 1 -- 172.21.15.146:0/3411865018 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c01e910 con 0x55713a9524d0 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.452+0000 7f0f5a291740 1 -- 172.21.15.146:0/3411865018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 msgr2=0x55713ad3c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.452+0000 7f0f5a291740 1 --2- 172.21.15.146:0/3411865018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad3c860 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00ed00 tx=0x7f0f3c011000 comp rx=0 tx=0).stop 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.452+0000 7f0f5a291740 1 -- 172.21.15.146:0/3411865018 shutdown_connections 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.452+0000 7f0f5a291740 1 --2- 172.21.15.146:0/3411865018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad3cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.452+0000 7f0f5a291740 1 --2- 172.21.15.146:0/3411865018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad3c860 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.452+0000 7f0f5a291740 1 --2- 172.21.15.146:0/3411865018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a97b390 0x55713ad67a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.452+0000 7f0f5a291740 1 -- 172.21.15.146:0/3411865018 >> 172.21.15.146:0/3411865018 conn(0x55713a96f4e0 msgr2=0x55713ad22d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.452+0000 7f0f5a291740 1 -- 172.21.15.146:0/3411865018 shutdown_connections 2024-09-17T03:36:31.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.452+0000 7f0f5a291740 1 -- 172.21.15.146:0/3411865018 wait complete. 2024-09-17T03:36:31.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.453+0000 7f0f5a291740 1 -- start start 2024-09-17T03:36:31.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.453+0000 7f0f5a291740 1 Processor -- start 2024-09-17T03:36:31.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad5e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad24a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a97b390 0x55713ad24f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f5a291740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55713a9f5740 con 0x55713a9524d0 2024-09-17T03:36:31.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f5a291740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55713ac2a970 con 0x55713a95a6b0 2024-09-17T03:36:31.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f5a291740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55713ad25e10 con 0x55713a97b390 2024-09-17T03:36:31.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f5a291740 10 client.0 _ll_register_callbacks cb 0x55713ac39780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:31.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f510bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad5e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f510bc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad5e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57218/0 (socket says 172.21.15.146:57218) 2024-09-17T03:36:31.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f510bc640 1 -- 172.21.15.146:0/262353114 learned_addr learned my addr 172.21.15.146:0/262353114 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f508bb640 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad24a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f518bd640 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a97b390 0x55713ad24f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f510bc640 1 -- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a97b390 msgr2=0x55713ad24f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f510bc640 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a97b390 0x55713ad24f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f510bc640 1 -- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 msgr2=0x55713ad24a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f510bc640 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad24a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f510bc640 1 -- 172.21.15.146:0/262353114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713a9e6970 con 0x55713a9524d0 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f518bd640 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a97b390 0x55713ad24f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f510bc640 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad5e260 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0f48083900 tx=0x7f0f48084220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcde9d89c332825 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:31.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f2bfff640 1 -- 172.21.15.146:0/262353114 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48048070 con 0x55713a9524d0 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f2bfff640 1 -- 172.21.15.146:0/262353114 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f0f48082e60 con 0x55713a9524d0 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.455+0000 7f0f5a291740 1 -- 172.21.15.146:0/262353114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f3c023070 con 0x55713a9524d0 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f2bfff640 1 -- 172.21.15.146:0/262353114 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0f48031770 con 0x55713a9524d0 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f5a291740 10 client.6567 fetch_fsmap learned FSMap version 29 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f5a291740 1 -- 172.21.15.146:0/262353114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55713a9c46a0 con 0x55713a9524d0 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f2bfff640 1 -- 172.21.15.146:0/262353114 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f3c023070 con 0x55713a9524d0 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f2bfff640 1 -- 172.21.15.146:0/262353114 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f0f4807f550 con 0x55713a9524d0 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f5a291740 10 client.6567 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f5a291740 10 client.6567 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f5a291740 20 client.6567 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f5a291740 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x55713a939f60 0x55713ad63070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f5a291740 4 client.6567 mds_command: new command op to 5890 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f5a291740 1 -- 172.21.15.146:0/262353114 --> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55713ac979b0 con 0x55713a939f60 2024-09-17T03:36:31.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f508bb640 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x55713a939f60 0x55713ad63070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.456+0000 7f0f2bfff640 10 client.6567 ms_handle_connect on v2:172.21.15.179:6834/2016497882 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f508bb640 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x55713a939f60 0x55713ad63070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92496edadcf67de7 server_cookie=3d14777ea11149aa in_seq=0 out_seq=0 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f2bfff640 1 -- 172.21.15.146:0/262353114 <== mds.0 v2:172.21.15.179:6834/2016497882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55713ac979b0 con 0x55713a939f60 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f2bfff640 10 client.6567 handle_command_reply: tid=0 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f5a291740 1 client.6567 shutdown 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f5a291740 1 -- 172.21.15.146:0/262353114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 msgr2=0x55713ad5e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f5a291740 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad5e260 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0f48083900 tx=0x7f0f48084220 comp rx=0 tx=0).stop 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f5a291740 1 -- 172.21.15.146:0/262353114 shutdown_connections 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f5a291740 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x55713a939f60 0x55713ad63070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f5a291740 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a97b390 0x55713ad24f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f5a291740 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad24a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f2bfff640 0 client.6567 ms_handle_reset on v2:172.21.15.179:6834/2016497882 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f5a291740 1 --2- 172.21.15.146:0/262353114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a9524d0 0x55713ad5e260 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.457+0000 7f0f5a291740 1 -- 172.21.15.146:0/262353114 >> 172.21.15.146:0/262353114 conn(0x55713a96f4e0 msgr2=0x55713ad67a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.458+0000 7f0f5a291740 1 -- 172.21.15.146:0/262353114 shutdown_connections 2024-09-17T03:36:31.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.458+0000 7f0f5a291740 1 -- 172.21.15.146:0/262353114 wait complete. 2024-09-17T03:36:31.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.458+0000 7f0f5a291740 20 client.6567 trim_cache size 0 max 16384 2024-09-17T03:36:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.472+0000 7f0f5a291740 1 Processor -- start 2024-09-17T03:36:31.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.472+0000 7f0f5a291740 1 -- start start 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a9524d0 0x55713ad66ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad271c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ad642f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f5a291740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c202190 con 0x55713a97b390 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f5a291740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c201250 con 0x55713a95a6b0 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f5a291740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c1f88f0 con 0x55713a9524d0 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f518bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ad642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f518bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ad642f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57220/0 (socket says 172.21.15.146:57220) 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f518bd640 1 -- 172.21.15.146:0/1501538509 learned_addr learned my addr 172.21.15.146:0/1501538509 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f508bb640 1 --2- 172.21.15.146:0/1501538509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad271c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f510bc640 1 --2- 172.21.15.146:0/1501538509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a9524d0 0x55713ad66ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f518bd640 1 -- 172.21.15.146:0/1501538509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a9524d0 msgr2=0x55713ad66ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f518bd640 1 --2- 172.21.15.146:0/1501538509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a9524d0 0x55713ad66ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f518bd640 1 -- 172.21.15.146:0/1501538509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 msgr2=0x55713ad271c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f518bd640 1 --2- 172.21.15.146:0/1501538509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad271c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f518bd640 1 -- 172.21.15.146:0/1501538509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713ad27a70 con 0x55713a97b390 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f518bd640 1 --2- 172.21.15.146:0/1501538509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ad642f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0f44002150 tx=0x7f0f44012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e58bdf74ee15d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f367fc640 1 -- 172.21.15.146:0/1501538509 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4401a070 con 0x55713a97b390 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f367fc640 1 -- 172.21.15.146:0/1501538509 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f44012e10 con 0x55713a97b390 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.474+0000 7f0f367fc640 1 -- 172.21.15.146:0/1501538509 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f440166a0 con 0x55713a97b390 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.475+0000 7f0f5a291740 1 -- 172.21.15.146:0/1501538509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 msgr2=0x55713ad642f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.475+0000 7f0f5a291740 1 --2- 172.21.15.146:0/1501538509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ad642f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0f44002150 tx=0x7f0f44012630 comp rx=0 tx=0).stop 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.475+0000 7f0f5a291740 1 -- 172.21.15.146:0/1501538509 shutdown_connections 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.475+0000 7f0f5a291740 1 --2- 172.21.15.146:0/1501538509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ad642f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.475+0000 7f0f5a291740 1 --2- 172.21.15.146:0/1501538509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a95a6b0 0x55713ad271c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.475+0000 7f0f5a291740 1 --2- 172.21.15.146:0/1501538509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a9524d0 0x55713ad66ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.475+0000 7f0f5a291740 1 -- 172.21.15.146:0/1501538509 >> 172.21.15.146:0/1501538509 conn(0x55713a96f4e0 msgr2=0x55713ad48a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.475+0000 7f0f5a291740 1 -- 172.21.15.146:0/1501538509 shutdown_connections 2024-09-17T03:36:31.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.475+0000 7f0f5a291740 1 -- 172.21.15.146:0/1501538509 wait complete. 2024-09-17T03:36:31.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.476+0000 7f0f5a291740 1 -- start start 2024-09-17T03:36:31.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.476+0000 7f0f5a291740 1 Processor -- start 2024-09-17T03:36:31.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.477+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a9524d0 0x55713ad68420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a95a6b0 0x55713ad65e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f5a291740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ade6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f5a291740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c1f98b0 con 0x55713a97b390 2024-09-17T03:36:31.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f5a291740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55713ad49dd0 con 0x55713a9524d0 2024-09-17T03:36:31.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f5a291740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55713ad26a60 con 0x55713a95a6b0 2024-09-17T03:36:31.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f5a291740 10 client.0 _ll_register_callbacks cb 0x7f0f48080290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f518bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ade6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f518bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ade6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57232/0 (socket says 172.21.15.146:57232) 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f518bd640 1 -- 172.21.15.146:0/125253300 learned_addr learned my addr 172.21.15.146:0/125253300 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f508bb640 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a95a6b0 0x55713ad65e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f510bc640 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a9524d0 0x55713ad68420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f518bd640 1 -- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a95a6b0 msgr2=0x55713ad65e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f518bd640 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a95a6b0 0x55713ad65e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f518bd640 1 -- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a9524d0 msgr2=0x55713ad68420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f518bd640 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a9524d0 0x55713ad68420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f518bd640 1 -- 172.21.15.146:0/125253300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713ad25110 con 0x55713a97b390 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f518bd640 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ade6760 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0f44019000 tx=0x7f0f44017a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5349c202d1c37e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f2bfff640 1 -- 172.21.15.146:0/125253300 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44025070 con 0x55713a97b390 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f2bfff640 1 -- 172.21.15.146:0/125253300 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f0f4401f650 con 0x55713a97b390 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f5a291740 1 -- 172.21.15.146:0/125253300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f44012e10 con 0x55713a97b390 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f2bfff640 1 -- 172.21.15.146:0/125253300 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0f4401a040 con 0x55713a97b390 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f5a291740 10 client.6573 fetch_fsmap learned FSMap version 29 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.478+0000 7f0f5a291740 1 -- 172.21.15.146:0/125253300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55713ad66b30 con 0x55713a97b390 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.479+0000 7f0f2bfff640 1 -- 172.21.15.146:0/125253300 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f44012e10 con 0x55713a97b390 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.479+0000 7f0f2bfff640 1 -- 172.21.15.146:0/125253300 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f0f44036080 con 0x55713a97b390 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.479+0000 7f0f5a291740 10 client.6573 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.479+0000 7f0f5a291740 10 client.6573 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.479+0000 7f0f5a291740 20 client.6573 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.479+0000 7f0f5a291740 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x55713ad61b30 0x55713ad24540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.479+0000 7f0f5a291740 4 client.6573 mds_command: new command op to 5890 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.479+0000 7f0f5a291740 1 -- 172.21.15.146:0/125253300 --> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55713ac93460 con 0x55713ad61b30 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.479+0000 7f0f510bc640 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x55713ad61b30 0x55713ad24540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.479+0000 7f0f510bc640 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x55713ad61b30 0x55713ad24540 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d94b88af76cac09c server_cookie=614a4adb23c96058 in_seq=0 out_seq=0 2024-09-17T03:36:31.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.479+0000 7f0f2bfff640 10 client.6573 ms_handle_connect on v2:172.21.15.179:6834/2016497882 2024-09-17T03:36:31.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f2bfff640 1 -- 172.21.15.146:0/125253300 <== mds.0 v2:172.21.15.179:6834/2016497882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55713ac93460 con 0x55713ad61b30 2024-09-17T03:36:31.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f2bfff640 10 client.6573 handle_command_reply: tid=0 2024-09-17T03:36:31.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f5a291740 1 client.6573 shutdown 2024-09-17T03:36:31.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f5a291740 1 -- 172.21.15.146:0/125253300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 msgr2=0x55713ade6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f5a291740 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ade6760 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0f44019000 tx=0x7f0f44017a20 comp rx=0 tx=0).stop 2024-09-17T03:36:31.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f5a291740 1 -- 172.21.15.146:0/125253300 shutdown_connections 2024-09-17T03:36:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f5a291740 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:6834/2016497882,v1:172.21.15.179:6836/2016497882] conn(0x55713ad61b30 0x55713ad24540 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f5a291740 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55713a97b390 0x55713ade6760 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f5a291740 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55713a95a6b0 0x55713ad65e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f2bfff640 0 client.6573 ms_handle_reset on v2:172.21.15.179:6834/2016497882 2024-09-17T03:36:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f5a291740 1 --2- 172.21.15.146:0/125253300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55713a9524d0 0x55713ad68420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.493+0000 7f0f5a291740 1 -- 172.21.15.146:0/125253300 >> 172.21.15.146:0/125253300 conn(0x55713a96f4e0 msgr2=0x55713ad635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f5a291740 1 -- 172.21.15.146:0/125253300 shutdown_connections 2024-09-17T03:36:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f5a291740 1 -- 172.21.15.146:0/125253300 wait complete. 2024-09-17T03:36:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f5a291740 20 client.6573 trim_cache size 0 max 16384 2024-09-17T03:36:31.495 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:36:31.496 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:36:31.496 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:36:31.496 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 -- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f30078b90 msgr2=0x7f0f3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f30078b90 0x7f0f3007b0a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c005d00 tx=0x7f0f3c005c70 comp rx=0 tx=0).stop 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 -- 172.21.15.146:0/3742887626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f4c0b61f0 msgr2=0x7f0f4c0c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f4c0b61f0 0x7f0f4c0c74b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0f4802aa90 tx=0x7f0f48033c20 comp rx=0 tx=0).stop 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 -- 172.21.15.146:0/3742887626 shutdown_connections 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f30078b90 0x7f0f3007b0a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f4c1631a0 0x7f0f4c160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f4c15f1a0 0x7f0f4c0cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 --2- 172.21.15.146:0/3742887626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f4c0b61f0 0x7f0f4c0c74b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 -- 172.21.15.146:0/3742887626 >> 172.21.15.146:0/3742887626 conn(0x7f0f4c0d11f0 msgr2=0x7f0f4c161d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 -- 172.21.15.146:0/3742887626 shutdown_connections 2024-09-17T03:36:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.494+0000 7f0f53320640 1 -- 172.21.15.146:0/3742887626 wait complete. 2024-09-17T03:36:31.506 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:36:31.506 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:31.506 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:36:31.506 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:31.507 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:36:31.507 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:31.507 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:36:31.507 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:31.516 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:36:31.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-17T03:36:31.517 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:36:31.517 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-17T03:36:31.518 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:36:31.518 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-17T03:36:31.519 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:36:31.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-17T03:36:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.685+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2852013319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e540cfc40 msgr2=0x7f0e5415ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.685+0000 7f0e5a8a9640 1 --2- 172.21.15.146:0/2852013319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e540cfc40 0x7f0e5415ead0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0e540713a0 tx=0x7f0e4802b910 comp rx=0 tx=0).stop 2024-09-17T03:36:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.685+0000 7f8673e55640 1 -- 172.21.15.146:0/1975285459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06f7c0 msgr2=0x7f866c166810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.685+0000 7f8673e55640 1 --2- 172.21.15.146:0/1975285459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06f7c0 0x7f866c166810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8664005fd0 tx=0x7f866402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.685+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2852013319 shutdown_connections 2024-09-17T03:36:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.685+0000 7f0e5a8a9640 1 --2- 172.21.15.146:0/2852013319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e540cfc40 0x7f0e5415ead0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.685+0000 7f0e5a8a9640 1 --2- 172.21.15.146:0/2852013319 >> v2:172.21.15.179:3300/0 conn(0x7f0e540b3360 0x7f0e54072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.685+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2852013319 >> 172.21.15.146:0/2852013319 conn(0x7f0e540b2060 msgr2=0x7f0e540b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.685+0000 7f8673e55640 1 -- 172.21.15.146:0/1975285459 shutdown_connections 2024-09-17T03:36:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.685+0000 7f8673e55640 1 --2- 172.21.15.146:0/1975285459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06f7c0 0x7f866c166810 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f8673e55640 1 -- 172.21.15.146:0/1975285459 >> 172.21.15.146:0/1975285459 conn(0x7f866c06d070 msgr2=0x7f866c06d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2852013319 shutdown_connections 2024-09-17T03:36:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f8673e55640 1 -- 172.21.15.146:0/1975285459 shutdown_connections 2024-09-17T03:36:31.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2852013319 wait complete. 2024-09-17T03:36:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f8673e55640 1 -- 172.21.15.146:0/1975285459 wait complete. 2024-09-17T03:36:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f44a2afa640 1 -- 172.21.15.146:0/2256604713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f448c0037a0 msgr2=0x7f448c003bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f44a2afa640 1 --2- 172.21.15.146:0/2256604713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f448c0037a0 0x7f448c003bb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4488009b50 tx=0x7f448c005830 comp rx=0 tx=0).stop 2024-09-17T03:36:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f97f99b0640 1 -- 172.21.15.146:0/4143207098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97dc004800 msgr2=0x7f97dc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f97f99b0640 1 --2- 172.21.15.146:0/4143207098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97dc004800 0x7f97dc004c10 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f97e8001740 tx=0x7f97dc005830 comp rx=0 tx=0).stop 2024-09-17T03:36:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f97f37fe640 1 -- 172.21.15.146:0/4143207098 reap_dead start 2024-09-17T03:36:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f44a2afa640 1 -- 172.21.15.146:0/2256604713 shutdown_connections 2024-09-17T03:36:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f44a2afa640 1 --2- 172.21.15.146:0/2256604713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f448c0037a0 0x7f448c003bb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.686+0000 7f44a2afa640 1 -- 172.21.15.146:0/2256604713 >> 172.21.15.146:0/2256604713 conn(0x7f449c0d4be0 msgr2=0x7f449c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.687+0000 7f97f99b0640 1 -- 172.21.15.146:0/4143207098 shutdown_connections 2024-09-17T03:36:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.687+0000 7f97f99b0640 1 -- 172.21.15.146:0/4143207098 >> 172.21.15.146:0/4143207098 conn(0x7f97f40b3510 msgr2=0x7f97f40b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.687+0000 7f44a2afa640 1 -- 172.21.15.146:0/2256604713 shutdown_connections 2024-09-17T03:36:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.687+0000 7f44a2afa640 1 -- 172.21.15.146:0/2256604713 wait complete. 2024-09-17T03:36:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.687+0000 7f97f99b0640 1 -- 172.21.15.146:0/4143207098 shutdown_connections 2024-09-17T03:36:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.687+0000 7f97f99b0640 1 -- 172.21.15.146:0/4143207098 wait complete. 2024-09-17T03:36:31.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.688+0000 7f8673e55640 1 Processor -- start 2024-09-17T03:36:31.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.688+0000 7f8673e55640 1 -- start start 2024-09-17T03:36:31.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.688+0000 7f0e5a8a9640 1 Processor -- start 2024-09-17T03:36:31.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.688+0000 7f0e5a8a9640 1 -- start start 2024-09-17T03:36:31.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.688+0000 7f97f99b0640 1 Processor -- start 2024-09-17T03:36:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f97f99b0640 1 -- start start 2024-09-17T03:36:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f8673e55640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06f7c0 0x7f866c13c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f8673e55640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f866c0d0d00 0x7f866c1f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f8673e55640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f866c144d90 0x7f866c1f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f8673e55640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f866c0cd680 con 0x7f866c0d0d00 2024-09-17T03:36:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f8673e55640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f866c0cd500 con 0x7f866c06f7c0 2024-09-17T03:36:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f8673e55640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f866c0cd800 con 0x7f866c144d90 2024-09-17T03:36:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f8671bf1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06f7c0 0x7f866c13c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f86713f0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f866c0d0d00 0x7f866c1f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f8671bf1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06f7c0 0x7f866c13c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:60406/0 (socket says 172.21.15.146:60406) 2024-09-17T03:36:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f8671bf1640 1 -- 172.21.15.146:0/496968617 learned_addr learned my addr 172.21.15.146:0/496968617 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.689+0000 7f86723f2640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f866c144d90 0x7f866c1f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f44a2afa640 1 Processor -- start 2024-09-17T03:36:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f44a2afa640 1 -- start start 2024-09-17T03:36:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f8671bf1640 1 -- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f866c144d90 msgr2=0x7f866c1f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f8671bf1640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f866c144d90 0x7f866c1f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f8671bf1640 1 -- 172.21.15.146:0/496968617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f866c0d0d00 msgr2=0x7f866c1f7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f8671bf1640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f866c0d0d00 0x7f866c1f7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f8671bf1640 1 -- 172.21.15.146:0/496968617 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866c1f7d50 con 0x7f866c06f7c0 2024-09-17T03:36:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f86713f0640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f866c0d0d00 0x7f866c1f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f8671bf1640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06f7c0 0x7f866c13c0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8668001660 tx=0x7f8668001b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f86627fc640 1 -- 172.21.15.146:0/496968617 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668010630 con 0x7f866c06f7c0 2024-09-17T03:36:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f97f99b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97f40b4dc0 0x7f97f4158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f86627fc640 1 -- 172.21.15.146:0/496968617 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86680107d0 con 0x7f866c06f7c0 2024-09-17T03:36:31.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f8673e55640 1 -- 172.21.15.146:0/496968617 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f866c158f70 con 0x7f866c06f7c0 2024-09-17T03:36:31.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f97f99b0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f415e930 0x7f97f40b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f97f2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97f40b4dc0 0x7f97f4158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f97f2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97f40b4dc0 0x7f97f4158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57280/0 (socket says 172.21.15.146:57280) 2024-09-17T03:36:31.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f97f99b0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f414fb90 0x7f97f414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.690+0000 7f97f27fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f415e930 0x7f97f40b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f27fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f415e930 0x7f97f40b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:37842/0 (socket says 172.21.15.146:37842) 2024-09-17T03:36:31.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f86627fc640 1 -- 172.21.15.146:0/496968617 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668010be0 con 0x7f866c06f7c0 2024-09-17T03:36:31.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f8673e55640 1 -- 172.21.15.146:0/496968617 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f866c159530 con 0x7f866c06f7c0 2024-09-17T03:36:31.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f2ffd640 1 -- 172.21.15.146:0/295869012 learned_addr learned my addr 172.21.15.146:0/295869012 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:31.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f97f4156160 con 0x7f97f40b4dc0 2024-09-17T03:36:31.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f97f4155fe0 con 0x7f97f414fb90 2024-09-17T03:36:31.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f97f40b6830 con 0x7f97f415e930 2024-09-17T03:36:31.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f37fe640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f414fb90 0x7f97f414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f0e5a8a9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e540b3360 0x7f0e54145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f0e53fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e540b3360 0x7f0e54145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f0e53fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e540b3360 0x7f0e54145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57282/0 (socket says 172.21.15.146:57282) 2024-09-17T03:36:31.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f27fc640 1 -- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f414fb90 msgr2=0x7f97f414ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f27fc640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f414fb90 0x7f97f414ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f0e53fff640 1 -- 172.21.15.146:0/2639357419 learned_addr learned my addr 172.21.15.146:0/2639357419 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f27fc640 1 -- 172.21.15.146:0/295869012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97f40b4dc0 msgr2=0x7f97f4158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f27fc640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97f40b4dc0 0x7f97f4158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f27fc640 1 -- 172.21.15.146:0/295869012 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f41504e0 con 0x7f97f415e930 2024-09-17T03:36:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f2ffd640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97f40b4dc0 0x7f97f4158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:31.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f0e5a8a9640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5415f010 0x7f0e541496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f0e5a8a9640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e5414c860 0x7f0e5414cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f97f27fc640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f415e930 0x7f97f40b1b00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00c160 tx=0x7f97e8006220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.691+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5406e800 con 0x7f0e540b3360 2024-09-17T03:36:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f0e537fe640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5415f010 0x7f0e541496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5406e680 con 0x7f0e5414c860 2024-09-17T03:36:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5406e980 con 0x7f0e5415f010 2024-09-17T03:36:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f0e58e46640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e5414c860 0x7f0e5414cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f97dbfff640 1 -- 172.21.15.146:0/295869012 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8004640 con 0x7f97f415e930 2024-09-17T03:36:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f97dbfff640 1 -- 172.21.15.146:0/295869012 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97e8038040 con 0x7f97f415e930 2024-09-17T03:36:31.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f97dbfff640 1 -- 172.21.15.146:0/295869012 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8004db0 con 0x7f97f415e930 2024-09-17T03:36:31.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f41f68f0 con 0x7f97f415e930 2024-09-17T03:36:31.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f8673e55640 1 -- 172.21.15.146:0/496968617 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f866c15f990 con 0x7f866c06f7c0 2024-09-17T03:36:31.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f41f6eb0 con 0x7f97f415e930 2024-09-17T03:36:31.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f44a2afa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f448c0037a0 0x7f449c0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f0e58e46640 1 -- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5415f010 msgr2=0x7f0e541496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f0e58e46640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5415f010 0x7f0e541496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f44a2afa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449c14fa70 0x7f449c14fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f0e58e46640 1 -- 172.21.15.146:0/2639357419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e540b3360 msgr2=0x7f0e54145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f44a2afa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c1503c0 0x7f449c1f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f0e58e46640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e540b3360 0x7f0e54145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f44a2afa640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f449c06f0c0 con 0x7f449c14fa70 2024-09-17T03:36:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.692+0000 7f449bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449c14fa70 0x7f449c14fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f449bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449c14fa70 0x7f449c14fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57296/0 (socket says 172.21.15.146:57296) 2024-09-17T03:36:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f449bfff640 1 -- 172.21.15.146:0/4174618522 learned_addr learned my addr 172.21.15.146:0/4174618522 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f0e58e46640 1 -- 172.21.15.146:0/2639357419 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5414d1b0 con 0x7f0e5414c860 2024-09-17T03:36:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f449c06ef40 con 0x7f448c0037a0 2024-09-17T03:36:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f44a0896640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f448c0037a0 0x7f449c0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f449c1620f0 con 0x7f449c1503c0 2024-09-17T03:36:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f0e537fe640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5415f010 0x7f0e541496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:31.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f0e53fff640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e540b3360 0x7f0e54145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:36:31.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f44a1097640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c1503c0 0x7f449c1f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f86627fc640 1 -- 172.21.15.146:0/496968617 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f866800c450 con 0x7f866c06f7c0 2024-09-17T03:36:31.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f0e58e46640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e5414c860 0x7f0e5414cc70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c730 tx=0x7f0e4c00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f44a0896640 1 -- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c1503c0 msgr2=0x7f449c1f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f44a0896640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c1503c0 0x7f449c1f8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f44a0896640 1 -- 172.21.15.146:0/4174618522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449c14fa70 msgr2=0x7f449c14fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f44a0896640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449c14fa70 0x7f449c14fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f44a0896640 1 -- 172.21.15.146:0/4174618522 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c0cd680 con 0x7f448c0037a0 2024-09-17T03:36:31.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f86627fc640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8650078bc0 0x7f865007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f415dd10 con 0x7f97f415e930 2024-09-17T03:36:31.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.693+0000 7f44a0896640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f448c0037a0 0x7f449c0b2ea0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4490006670 tx=0x7f44900039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.694+0000 7f86713f0640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8650078bc0 0x7f865007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.694+0000 7f86627fc640 1 -- 172.21.15.146:0/496968617 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f866809e8e0 con 0x7f866c06f7c0 2024-09-17T03:36:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.694+0000 7f86713f0640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8650078bc0 0x7f865007b0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f866c15eb70 tx=0x7f865c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.695+0000 7f97dbfff640 1 -- 172.21.15.146:0/295869012 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f97e8061d10 con 0x7f97f415e930 2024-09-17T03:36:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.695+0000 7f97dbfff640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f97e0078b90 0x7f97e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.695+0000 7f97dbfff640 1 -- 172.21.15.146:0/295869012 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f97e80bb020 con 0x7f97f415e930 2024-09-17T03:36:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.695+0000 7f97f2ffd640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f97e0078b90 0x7f97e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.696+0000 7f97f2ffd640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f97e0078b90 0x7f97e007b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f97e4003670 tx=0x7f97e4001e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.698+0000 7f0e50ff9640 1 -- 172.21.15.146:0/2639357419 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c003b70 con 0x7f0e5414c860 2024-09-17T03:36:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.698+0000 7f44997fa640 1 -- 172.21.15.146:0/4174618522 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490015070 con 0x7f448c0037a0 2024-09-17T03:36:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.698+0000 7f44997fa640 1 -- 172.21.15.146:0/4174618522 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4490011900 con 0x7f448c0037a0 2024-09-17T03:36:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.698+0000 7f44997fa640 1 -- 172.21.15.146:0/4174618522 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490011d30 con 0x7f448c0037a0 2024-09-17T03:36:31.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.698+0000 7f0e50ff9640 1 -- 172.21.15.146:0/2639357419 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e4c003d10 con 0x7f0e5414c860 2024-09-17T03:36:31.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.698+0000 7f0e50ff9640 1 -- 172.21.15.146:0/2639357419 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c003b70 con 0x7f0e5414c860 2024-09-17T03:36:31.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.698+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e541f6ca0 con 0x7f0e5414c860 2024-09-17T03:36:31.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.698+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e541f7260 con 0x7f0e5414c860 2024-09-17T03:36:31.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.698+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449c0cd960 con 0x7f448c0037a0 2024-09-17T03:36:31.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.698+0000 7f86627fc640 1 -- 172.21.15.146:0/496968617 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8668066740 con 0x7f866c06f7c0 2024-09-17T03:36:31.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.699+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449c0cdf20 con 0x7f448c0037a0 2024-09-17T03:36:31.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.700+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5415ead0 con 0x7f0e5414c860 2024-09-17T03:36:31.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.700+0000 7f97dbfff640 1 -- 172.21.15.146:0/295869012 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f97e8082f00 con 0x7f97f415e930 2024-09-17T03:36:31.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.700+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449c162570 con 0x7f448c0037a0 2024-09-17T03:36:31.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.700+0000 7f0e50ff9640 1 -- 172.21.15.146:0/2639357419 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e4c0052e0 con 0x7f0e5414c860 2024-09-17T03:36:31.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.701+0000 7f44997fa640 1 -- 172.21.15.146:0/4174618522 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4490018070 con 0x7f448c0037a0 2024-09-17T03:36:31.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.701+0000 7f0e50ff9640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e40078d90 0x7f0e4007b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.701+0000 7f0e50ff9640 1 -- 172.21.15.146:0/2639357419 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f0e4c09a790 con 0x7f0e5414c860 2024-09-17T03:36:31.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.701+0000 7f44997fa640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4480078b90 0x7f448007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:31.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.701+0000 7f44997fa640 1 -- 172.21.15.146:0/4174618522 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f449009bb80 con 0x7f448c0037a0 2024-09-17T03:36:31.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.701+0000 7f449bfff640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4480078b90 0x7f448007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.701+0000 7f0e53fff640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e40078d90 0x7f0e4007b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:31.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.702+0000 7f0e53fff640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e40078d90 0x7f0e4007b2a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0e44011440 tx=0x7f0e44005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.702+0000 7f449bfff640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4480078b90 0x7f448007b0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4488009b50 tx=0x7f44880046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:31.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.706+0000 7f0e50ff9640 1 -- 172.21.15.146:0/2639357419 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0e5414d1b0 con 0x7f0e5414c860 2024-09-17T03:36:31.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.710+0000 7f44997fa640 1 -- 172.21.15.146:0/4174618522 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4490063960 con 0x7f448c0037a0 2024-09-17T03:36:31.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.956+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f97f4070d60 con 0x7f97f415e930 2024-09-17T03:36:31.957 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:36:31.958+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:36:31.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.963+0000 7f97dbfff640 1 -- 172.21.15.146:0/295869012 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5890 v30) ==== 95+0+0 (secure 0 0 0) 0x7f97e8087930 con 0x7f97f415e930 2024-09-17T03:36:31.963 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 5890 2024-09-17T03:36:31.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.963+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f0e54146350 con 0x7f0e5414c860 2024-09-17T03:36:31.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f97e0078b90 msgr2=0x7f97e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f97e0078b90 0x7f97e007b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f97e4003670 tx=0x7f97e4001e70 comp rx=0 tx=0).stop 2024-09-17T03:36:31.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f415e930 msgr2=0x7f97f40b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f415e930 0x7f97f40b1b00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00c160 tx=0x7f97e8006220 comp rx=0 tx=0).stop 2024-09-17T03:36:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 shutdown_connections 2024-09-17T03:36:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f97e0078b90 0x7f97e007b0a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97f414fb90 0x7f97f414ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97f415e930 0x7f97f40b1b00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 --2- 172.21.15.146:0/295869012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97f40b4dc0 0x7f97f4158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 >> 172.21.15.146:0/295869012 conn(0x7f97f40b3510 msgr2=0x7f97f40b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 shutdown_connections 2024-09-17T03:36:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.965+0000 7f97f99b0640 1 -- 172.21.15.146:0/295869012 wait complete. 2024-09-17T03:36:31.967 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:36:31.968+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:36:31.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.973+0000 7f0e50ff9640 1 -- 172.21.15.146:0/2639357419 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5878 v32) ==== 95+0+0 (secure 0 0 0) 0x7f0e5415f420 con 0x7f0e5414c860 2024-09-17T03:36:31.973 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 5878 2024-09-17T03:36:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e40078d90 msgr2=0x7f0e4007b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e40078d90 0x7f0e4007b2a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0e44011440 tx=0x7f0e44005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e5414c860 msgr2=0x7f0e5414cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e5414c860 0x7f0e5414cc70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c730 tx=0x7f0e4c00cbf0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 shutdown_connections 2024-09-17T03:36:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e40078d90 0x7f0e4007b2a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e5414c860 0x7f0e5414cc70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e5415f010 0x7f0e541496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 --2- 172.21.15.146:0/2639357419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e540b3360 0x7f0e54145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:31.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 >> 172.21.15.146:0/2639357419 conn(0x7f0e540b2060 msgr2=0x7f0e54150f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:31.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 shutdown_connections 2024-09-17T03:36:31.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.977+0000 7f0e5a8a9640 1 -- 172.21.15.146:0/2639357419 wait complete. 2024-09-17T03:36:31.980 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:36:31.980 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:36:31.982 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:36:31.982 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:31.986+0000 7f8673e55640 1 -- 172.21.15.146:0/496968617 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f866c0cff10 con 0x7f866c06f7c0 2024-09-17T03:36:31.993 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:36:31.993 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:36:32.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.010+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f449c15e090 con 0x7f448c0037a0 2024-09-17T03:36:32.012 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:36:32.012 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:32.065 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:36:32.095 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:36:32.183 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:36:32.183+0000 7f82d3416640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:36:32.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.189+0000 7f44997fa640 1 -- 172.21.15.146:0/4174618522 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5875 v34) ==== 95+0+0 (secure 0 0 0) 0x7f4490068390 con 0x7f448c0037a0 2024-09-17T03:36:32.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.189+0000 7f86627fc640 1 -- 172.21.15.146:0/496968617 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5603 v34) ==== 95+0+0 (secure 0 0 0) 0x7f866806b170 con 0x7f866c06f7c0 2024-09-17T03:36:32.189 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 5875 2024-09-17T03:36:32.189 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 5603 2024-09-17T03:36:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 -- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8650078bc0 msgr2=0x7f865007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8650078bc0 0x7f865007b0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f866c15eb70 tx=0x7f865c009040 comp rx=0 tx=0).stop 2024-09-17T03:36:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 -- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06f7c0 msgr2=0x7f866c13c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06f7c0 0x7f866c13c0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8668001660 tx=0x7f8668001b20 comp rx=0 tx=0).stop 2024-09-17T03:36:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 -- 172.21.15.146:0/496968617 shutdown_connections 2024-09-17T03:36:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8650078bc0 0x7f865007b0d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f866c144d90 0x7f866c1f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f866c0d0d00 0x7f866c1f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 --2- 172.21.15.146:0/496968617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f866c06f7c0 0x7f866c13c0a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 -- 172.21.15.146:0/496968617 >> 172.21.15.146:0/496968617 conn(0x7f866c06d070 msgr2=0x7f866c0afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 -- 172.21.15.146:0/496968617 shutdown_connections 2024-09-17T03:36:32.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.191+0000 7f8673e55640 1 -- 172.21.15.146:0/496968617 wait complete. 2024-09-17T03:36:32.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4480078b90 msgr2=0x7f448007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4480078b90 0x7f448007b0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4488009b50 tx=0x7f44880046c0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f448c0037a0 msgr2=0x7f449c0b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f448c0037a0 0x7f449c0b2ea0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4490006670 tx=0x7f44900039c0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 shutdown_connections 2024-09-17T03:36:32.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4480078b90 0x7f448007b0a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f449c1503c0 0x7f449c1f8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f449c14fa70 0x7f449c14fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 --2- 172.21.15.146:0/4174618522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f448c0037a0 0x7f449c0b2ea0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 >> 172.21.15.146:0/4174618522 conn(0x7f449c0d4be0 msgr2=0x7f449c0d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:32.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 shutdown_connections 2024-09-17T03:36:32.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.192+0000 7f44a2afa640 1 -- 172.21.15.146:0/4174618522 wait complete. 2024-09-17T03:36:32.209 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:36:32.209 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:36:32.210 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:36:32.210 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:36:32.213 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:36:32.213 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:32.252 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:36:32.252 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:32.252 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:32.294 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:36:32.338 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:36:32.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.368+0000 7f5e853c6640 1 -- 172.21.15.146:0/110367272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e800b55f0 msgr2=0x7f5e80070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.368+0000 7f5e853c6640 1 --2- 172.21.15.146:0/110367272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e800b55f0 0x7f5e80070be0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009830 tx=0x7f5e7002a510 comp rx=0 tx=0).stop 2024-09-17T03:36:32.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.368+0000 7f5e853c6640 1 -- 172.21.15.146:0/110367272 shutdown_connections 2024-09-17T03:36:32.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.368+0000 7f5e853c6640 1 --2- 172.21.15.146:0/110367272 >> v2:172.21.15.179:3300/0 conn(0x7f5e8006dd60 0x7f5e8006e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.368+0000 7f5e853c6640 1 --2- 172.21.15.146:0/110367272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e800b55f0 0x7f5e80070be0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.368+0000 7f5e853c6640 1 -- 172.21.15.146:0/110367272 >> 172.21.15.146:0/110367272 conn(0x7f5e800b3410 msgr2=0x7f5e800b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:32.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.368+0000 7f5e853c6640 1 -- 172.21.15.146:0/110367272 shutdown_connections 2024-09-17T03:36:32.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.368+0000 7f5e853c6640 1 -- 172.21.15.146:0/110367272 wait complete. 2024-09-17T03:36:32.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.370+0000 7f5e853c6640 1 Processor -- start 2024-09-17T03:36:32.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.370+0000 7f5e853c6640 1 -- start start 2024-09-17T03:36:32.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e853c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8006dd60 0x7f5e80140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:32.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e853c6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e80071120 0x7f5e801e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:32.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e853c6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e800b55f0 0x7f5e80156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:32.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e853c6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8015be90 con 0x7f5e8006dd60 2024-09-17T03:36:32.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e853c6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8015bd10 con 0x7f5e80071120 2024-09-17T03:36:32.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e853c6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5e8015c010 con 0x7f5e800b55f0 2024-09-17T03:36:32.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e7effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8006dd60 0x7f5e80140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:32.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e7effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8006dd60 0x7f5e80140790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57346/0 (socket says 172.21.15.146:57346) 2024-09-17T03:36:32.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e7effd640 1 -- 172.21.15.146:0/1209663902 learned_addr learned my addr 172.21.15.146:0/1209663902 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:32.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e7f7fe640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e800b55f0 0x7f5e80156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:32.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e7e7fc640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e80071120 0x7f5e801e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:32.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e7effd640 1 -- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e800b55f0 msgr2=0x7f5e80156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e7effd640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e800b55f0 0x7f5e80156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e7effd640 1 -- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e80071120 msgr2=0x7f5e801e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e7effd640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e80071120 0x7f5e801e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e7effd640 1 -- 172.21.15.146:0/1209663902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e80143160 con 0x7f5e8006dd60 2024-09-17T03:36:32.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e7effd640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8006dd60 0x7f5e80140790 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5e7002ab00 tx=0x7f5e70033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:32.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.372+0000 7f5e677fe640 1 -- 172.21.15.146:0/1209663902 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70005c90 con 0x7f5e8006dd60 2024-09-17T03:36:32.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.373+0000 7f5e677fe640 1 -- 172.21.15.146:0/1209663902 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e70031e50 con 0x7f5e8006dd60 2024-09-17T03:36:32.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.373+0000 7f5e853c6640 1 -- 172.21.15.146:0/1209663902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e80143400 con 0x7f5e8006dd60 2024-09-17T03:36:32.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.373+0000 7f5e677fe640 1 -- 172.21.15.146:0/1209663902 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70005260 con 0x7f5e8006dd60 2024-09-17T03:36:32.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.373+0000 7f5e853c6640 1 -- 172.21.15.146:0/1209663902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e801439c0 con 0x7f5e8006dd60 2024-09-17T03:36:32.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.374+0000 7f5e853c6640 1 -- 172.21.15.146:0/1209663902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e8006e170 con 0x7f5e8006dd60 2024-09-17T03:36:32.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.374+0000 7f5e677fe640 1 -- 172.21.15.146:0/1209663902 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e70005400 con 0x7f5e8006dd60 2024-09-17T03:36:32.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.375+0000 7f5e677fe640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e6c078b90 0x7f5e6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:32.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.375+0000 7f5e677fe640 1 -- 172.21.15.146:0/1209663902 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7f5e700bbdd0 con 0x7f5e8006dd60 2024-09-17T03:36:32.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.375+0000 7f5e7e7fc640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e6c078b90 0x7f5e6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:32.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.375+0000 7f5e7e7fc640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e6c078b90 0x7f5e6c07b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5e74001050 tx=0x7f5e74000fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:32.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.379+0000 7f5e677fe640 1 -- 172.21.15.146:0/1209663902 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e7003f030 con 0x7f5e8006dd60 2024-09-17T03:36:32.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.589+0000 7f5e853c6640 1 -- 172.21.15.146:0/1209663902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e80155ab0 con 0x7f5e8006dd60 2024-09-17T03:36:32.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.589+0000 7f5e677fe640 1 -- 172.21.15.146:0/1209663902 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+3570 (secure 0 0 0) 0x7f5e700bde10 con 0x7f5e8006dd60 2024-09-17T03:36:32.590 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:32.590 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":35,"btime":"2024-09-17T03:36:32:192624+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3651488273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3651488273},{"type":"v1","addr":"172.21.15.179:6835","nonce":3651488273}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:32.192604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"a","rank":0,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.146:6833/477965307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":477965307},{"type":"v1","addr":"172.21.15.146:6833","nonce":477965307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-17T03:36:32.590 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 35 2024-09-17T03:36:32.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 -- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e6c078b90 msgr2=0x7f5e6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e6c078b90 0x7f5e6c07b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5e74001050 tx=0x7f5e74000fe0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 -- 172.21.15.146:0/1209663902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8006dd60 msgr2=0x7f5e80140790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:32.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8006dd60 0x7f5e80140790 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5e7002ab00 tx=0x7f5e70033c20 comp rx=0 tx=0).stop 2024-09-17T03:36:32.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 -- 172.21.15.146:0/1209663902 shutdown_connections 2024-09-17T03:36:32.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e6c078b90 0x7f5e6c07b0a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e800b55f0 0x7f5e80156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e80071120 0x7f5e801e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 --2- 172.21.15.146:0/1209663902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e8006dd60 0x7f5e80140790 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:32.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 -- 172.21.15.146:0/1209663902 >> 172.21.15.146:0/1209663902 conn(0x7f5e800b3410 msgr2=0x7f5e8015f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:32.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 -- 172.21.15.146:0/1209663902 shutdown_connections 2024-09-17T03:36:32.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:32.591+0000 7f5e853c6640 1 -- 172.21.15.146:0/1209663902 wait complete. 2024-09-17T03:36:33.005 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:36:17.932398+0000', 'modified': '2024-09-17T03:36:32.192604+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 62, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6612}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6612': {'gid': 6612, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.146:6833/477965307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 477965307}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 477965307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:36:33.006 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6612:up:replay 2024-09-17T03:36:34.007 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.136+0000 7f8099630640 1 -- 172.21.15.146:0/236558514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f809406f440 msgr2=0x7f80940d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.136+0000 7f8099630640 1 --2- 172.21.15.146:0/236558514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f809406f440 0x7f80940d3190 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f80940b73c0 tx=0x7f808c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.136+0000 7f8099630640 1 -- 172.21.15.146:0/236558514 shutdown_connections 2024-09-17T03:36:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.136+0000 7f8099630640 1 --2- 172.21.15.146:0/236558514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f809406f440 0x7f80940d3190 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.136+0000 7f8099630640 1 --2- 172.21.15.146:0/236558514 >> v2:172.21.15.179:3300/0 conn(0x7f80940b3870 0x7f80940cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.136+0000 7f8099630640 1 -- 172.21.15.146:0/236558514 >> 172.21.15.146:0/236558514 conn(0x7f80940d4be0 msgr2=0x7f80940d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.136+0000 7f8099630640 1 -- 172.21.15.146:0/236558514 shutdown_connections 2024-09-17T03:36:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.136+0000 7f8099630640 1 -- 172.21.15.146:0/236558514 wait complete. 2024-09-17T03:36:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.138+0000 7f8099630640 1 Processor -- start 2024-09-17T03:36:34.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.138+0000 7f8099630640 1 -- start start 2024-09-17T03:36:34.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8099630640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80940b3870 0x7f80940b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:34.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8099630640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80941620f0 0x7f809415a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:34.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8099630640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80941f5c40 0x7f80940c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:34.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8099630640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f80940d3a60 con 0x7f80940b3870 2024-09-17T03:36:34.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8099630640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f80940d38e0 con 0x7f80941f5c40 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8099630640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f80940d3be0 con 0x7f80941620f0 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8092ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80940b3870 0x7f80940b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8092ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80940b3870 0x7f80940b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57366/0 (socket says 172.21.15.146:57366) 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8092ffd640 1 -- 172.21.15.146:0/1985506443 learned_addr learned my addr 172.21.15.146:0/1985506443 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f80937fe640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80941f5c40 0x7f80940c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f80927fc640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80941620f0 0x7f809415a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8092ffd640 1 -- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80941620f0 msgr2=0x7f809415a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8092ffd640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80941620f0 0x7f809415a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8092ffd640 1 -- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80941f5c40 msgr2=0x7f80940c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8092ffd640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80941f5c40 0x7f80940c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.139+0000 7f8092ffd640 1 -- 172.21.15.146:0/1985506443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80941f66e0 con 0x7f80940b3870 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.140+0000 7f8092ffd640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80940b3870 0x7f80940b4250 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f808400ea50 tx=0x7f808400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.140+0000 7f807b7fe640 1 -- 172.21.15.146:0/1985506443 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808400cdc0 con 0x7f80940b3870 2024-09-17T03:36:34.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.140+0000 7f807b7fe640 1 -- 172.21.15.146:0/1985506443 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8084011560 con 0x7f80940b3870 2024-09-17T03:36:34.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.140+0000 7f8099630640 1 -- 172.21.15.146:0/1985506443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80941f69c0 con 0x7f80940b3870 2024-09-17T03:36:34.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.140+0000 7f807b7fe640 1 -- 172.21.15.146:0/1985506443 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084011990 con 0x7f80940b3870 2024-09-17T03:36:34.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.140+0000 7f8099630640 1 -- 172.21.15.146:0/1985506443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80940b4890 con 0x7f80940b3870 2024-09-17T03:36:34.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.141+0000 7f8099630640 1 -- 172.21.15.146:0/1985506443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80940b4010 con 0x7f80940b3870 2024-09-17T03:36:34.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.142+0000 7f807b7fe640 1 -- 172.21.15.146:0/1985506443 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8084011b30 con 0x7f80940b3870 2024-09-17T03:36:34.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.142+0000 7f807b7fe640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8080078b90 0x7f808007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:34.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.142+0000 7f807b7fe640 1 -- 172.21.15.146:0/1985506443 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7f808409b960 con 0x7f80940b3870 2024-09-17T03:36:34.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.143+0000 7f80927fc640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8080078b90 0x7f808007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:34.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.143+0000 7f80927fc640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8080078b90 0x7f808007b0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f809415df20 tx=0x7f8088009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:34.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.147+0000 7f807b7fe640 1 -- 172.21.15.146:0/1985506443 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f80940b4010 con 0x7f80940b3870 2024-09-17T03:36:34.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.361+0000 7f8099630640 1 -- 172.21.15.146:0/1985506443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80940d3190 con 0x7f80940b3870 2024-09-17T03:36:34.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.362+0000 7f807b7fe640 1 -- 172.21.15.146:0/1985506443 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5223 (secure 0 0 0) 0x7f808409b020 con 0x7f80940b3870 2024-09-17T03:36:34.362 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:34.362 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":37,"btime":"2024-09-17T03:36:34:199557+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3651488273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3651488273},{"type":"v1","addr":"172.21.15.179:6835","nonce":3651488273}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5753,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/497091008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":497091008},{"type":"v1","addr":"172.21.15.179:6837","nonce":497091008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2037796810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2037796810},{"type":"v1","addr":"172.21.15.146:6835","nonce":2037796810}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:33.202047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"a","rank":0,"incarnation":35,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.146:6833/477965307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":477965307},{"type":"v1","addr":"172.21.15.146:6833","nonce":477965307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-17T03:36:34.362 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 37 2024-09-17T03:36:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 -- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8080078b90 msgr2=0x7f808007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8080078b90 0x7f808007b0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f809415df20 tx=0x7f8088009060 comp rx=0 tx=0).stop 2024-09-17T03:36:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 -- 172.21.15.146:0/1985506443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80940b3870 msgr2=0x7f80940b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80940b3870 0x7f80940b4250 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f808400ea50 tx=0x7f808400ef10 comp rx=0 tx=0).stop 2024-09-17T03:36:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 -- 172.21.15.146:0/1985506443 shutdown_connections 2024-09-17T03:36:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8080078b90 0x7f808007b0a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80941f5c40 0x7f80940c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80941620f0 0x7f809415a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 --2- 172.21.15.146:0/1985506443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80940b3870 0x7f80940b4250 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 -- 172.21.15.146:0/1985506443 >> 172.21.15.146:0/1985506443 conn(0x7f80940d4be0 msgr2=0x7f809415cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 -- 172.21.15.146:0/1985506443 shutdown_connections 2024-09-17T03:36:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:34.364+0000 7f8099630640 1 -- 172.21.15.146:0/1985506443 wait complete. 2024-09-17T03:36:34.779 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:36:17.932398+0000', 'modified': '2024-09-17T03:36:33.202047+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 62, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6612}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6612': {'gid': 6612, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.146:6833/477965307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 477965307}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 477965307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:36:34.779 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6612:up:rejoin 2024-09-17T03:36:35.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:35.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.907+0000 7efe59212640 1 -- 172.21.15.146:0/1392454699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe5415c8e0 msgr2=0x7efe5406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:35.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.907+0000 7efe59212640 1 --2- 172.21.15.146:0/1392454699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe5415c8e0 0x7efe5406f580 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7efe54071500 tx=0x7efe4402a560 comp rx=0 tx=0).stop 2024-09-17T03:36:35.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.907+0000 7efe59212640 1 -- 172.21.15.146:0/1392454699 shutdown_connections 2024-09-17T03:36:35.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.907+0000 7efe59212640 1 --2- 172.21.15.146:0/1392454699 >> v2:172.21.15.179:3300/0 conn(0x7efe540cdc50 0x7efe540b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:35.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.907+0000 7efe59212640 1 --2- 172.21.15.146:0/1392454699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe5415c8e0 0x7efe5406f580 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:35.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.907+0000 7efe59212640 1 -- 172.21.15.146:0/1392454699 >> 172.21.15.146:0/1392454699 conn(0x7efe540b3150 msgr2=0x7efe540b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.907+0000 7efe59212640 1 -- 172.21.15.146:0/1392454699 shutdown_connections 2024-09-17T03:36:35.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.907+0000 7efe59212640 1 -- 172.21.15.146:0/1392454699 wait complete. 2024-09-17T03:36:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.909+0000 7efe59212640 1 Processor -- start 2024-09-17T03:36:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.909+0000 7efe59212640 1 -- start start 2024-09-17T03:36:35.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.910+0000 7efe59212640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe540cd840 0x7efe541473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.910+0000 7efe59212640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe540cdc50 0x7efe541566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.910+0000 7efe59212640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe5415c8e0 0x7efe540cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.910+0000 7efe59212640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efe54073580 con 0x7efe5415c8e0 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.910+0000 7efe59212640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efe540b5400 con 0x7efe540cdc50 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.910+0000 7efe59212640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efe54073700 con 0x7efe540cd840 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.910+0000 7efe5359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe5415c8e0 0x7efe540cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.910+0000 7efe5359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe5415c8e0 0x7efe540cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57392/0 (socket says 172.21.15.146:57392) 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.910+0000 7efe5359e640 1 -- 172.21.15.146:0/4083243666 learned_addr learned my addr 172.21.15.146:0/4083243666 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.910+0000 7efe5259c640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe540cdc50 0x7efe541566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.910+0000 7efe52d9d640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe540cd840 0x7efe541473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.911+0000 7efe5359e640 1 -- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe540cd840 msgr2=0x7efe541473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.911+0000 7efe5359e640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe540cd840 0x7efe541473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.911+0000 7efe5359e640 1 -- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe540cdc50 msgr2=0x7efe541566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.911+0000 7efe5359e640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe540cdc50 0x7efe541566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.911+0000 7efe5359e640 1 -- 172.21.15.146:0/4083243666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe54159270 con 0x7efe5415c8e0 2024-09-17T03:36:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.911+0000 7efe5359e640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe5415c8e0 0x7efe540cf930 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00e9c0 tx=0x7efe4c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.911+0000 7efe3b7fe640 1 -- 172.21.15.146:0/4083243666 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c004d20 con 0x7efe5415c8e0 2024-09-17T03:36:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.911+0000 7efe3b7fe640 1 -- 172.21.15.146:0/4083243666 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe4c00cac0 con 0x7efe5415c8e0 2024-09-17T03:36:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.911+0000 7efe59212640 1 -- 172.21.15.146:0/4083243666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe54159550 con 0x7efe5415c8e0 2024-09-17T03:36:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.911+0000 7efe3b7fe640 1 -- 172.21.15.146:0/4083243666 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c005020 con 0x7efe5415c8e0 2024-09-17T03:36:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.911+0000 7efe59212640 1 -- 172.21.15.146:0/4083243666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe54159b10 con 0x7efe5415c8e0 2024-09-17T03:36:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.912+0000 7efe59212640 1 -- 172.21.15.146:0/4083243666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe54070af0 con 0x7efe5415c8e0 2024-09-17T03:36:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.913+0000 7efe3b7fe640 1 -- 172.21.15.146:0/4083243666 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efe4c0051c0 con 0x7efe5415c8e0 2024-09-17T03:36:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.913+0000 7efe3b7fe640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efe40078bc0 0x7efe4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.913+0000 7efe3b7fe640 1 -- 172.21.15.146:0/4083243666 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7efe4c09b6b0 con 0x7efe5415c8e0 2024-09-17T03:36:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.914+0000 7efe52d9d640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efe40078bc0 0x7efe4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.914+0000 7efe52d9d640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efe40078bc0 0x7efe4007b0d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efe44033000 tx=0x7efe44004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:35.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:35.918+0000 7efe3b7fe640 1 -- 172.21.15.146:0/4083243666 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efe54070af0 con 0x7efe5415c8e0 2024-09-17T03:36:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.126+0000 7efe59212640 1 -- 172.21.15.146:0/4083243666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe54147910 con 0x7efe5415c8e0 2024-09-17T03:36:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.126+0000 7efe3b7fe640 1 -- 172.21.15.146:0/4083243666 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7efe4c016030 con 0x7efe5415c8e0 2024-09-17T03:36:36.126 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:36.126 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":38,"btime":"2024-09-17T03:36:35:207813+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3651488273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3651488273},{"type":"v1","addr":"172.21.15.179:6835","nonce":3651488273}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5753,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/497091008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":497091008},{"type":"v1","addr":"172.21.15.179:6837","nonce":497091008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2037796810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2037796810},{"type":"v1","addr":"172.21.15.146:6835","nonce":2037796810}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:35.207804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/477965307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":477965307},{"type":"v1","addr":"172.21.15.146:6833","nonce":477965307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6612,"qdb_cluster":[6612]},"id":4}]} 2024-09-17T03:36:36.126 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 38 2024-09-17T03:36:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.128+0000 7efe59212640 1 -- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efe40078bc0 msgr2=0x7efe4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.128+0000 7efe59212640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efe40078bc0 0x7efe4007b0d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efe44033000 tx=0x7efe44004730 comp rx=0 tx=0).stop 2024-09-17T03:36:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.128+0000 7efe59212640 1 -- 172.21.15.146:0/4083243666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe5415c8e0 msgr2=0x7efe540cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.128+0000 7efe59212640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe5415c8e0 0x7efe540cf930 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00e9c0 tx=0x7efe4c00ee80 comp rx=0 tx=0).stop 2024-09-17T03:36:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.128+0000 7efe59212640 1 -- 172.21.15.146:0/4083243666 shutdown_connections 2024-09-17T03:36:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.128+0000 7efe59212640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efe40078bc0 0x7efe4007b0d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.128+0000 7efe59212640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe5415c8e0 0x7efe540cf930 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.128+0000 7efe59212640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efe540cdc50 0x7efe541566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.128+0000 7efe59212640 1 --2- 172.21.15.146:0/4083243666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efe540cd840 0x7efe541473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.128+0000 7efe59212640 1 -- 172.21.15.146:0/4083243666 >> 172.21.15.146:0/4083243666 conn(0x7efe540b3150 msgr2=0x7efe540ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:36.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.129+0000 7efe59212640 1 -- 172.21.15.146:0/4083243666 shutdown_connections 2024-09-17T03:36:36.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.129+0000 7efe59212640 1 -- 172.21.15.146:0/4083243666 wait complete. 2024-09-17T03:36:36.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:36:17.932398+0000', 'modified': '2024-09-17T03:36:35.207804+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 62, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6612}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6612': {'gid': 6612, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.146:6833/477965307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 477965307}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 477965307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6612, 'qdb_cluster': [6612]} 2024-09-17T03:36:36.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:36:36.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:36:36.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.659+0000 7fb6099ba640 1 -- 172.21.15.146:0/1749310073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6040b4530 msgr2=0x7fb6040b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.659+0000 7fb6099ba640 1 --2- 172.21.15.146:0/1749310073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6040b4530 0x7fb6040b4940 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009830 tx=0x7fb5f802a510 comp rx=0 tx=0).stop 2024-09-17T03:36:36.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.659+0000 7fb6099ba640 1 -- 172.21.15.146:0/1749310073 shutdown_connections 2024-09-17T03:36:36.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.659+0000 7fb6099ba640 1 --2- 172.21.15.146:0/1749310073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6040b4530 0x7fb6040b4940 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.659+0000 7fb6099ba640 1 -- 172.21.15.146:0/1749310073 >> 172.21.15.146:0/1749310073 conn(0x7fb6040b3410 msgr2=0x7fb6040b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:36.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.659+0000 7fb6099ba640 1 -- 172.21.15.146:0/1749310073 shutdown_connections 2024-09-17T03:36:36.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.659+0000 7fb6099ba640 1 -- 172.21.15.146:0/1749310073 wait complete. 2024-09-17T03:36:36.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.661+0000 7fb6099ba640 1 Processor -- start 2024-09-17T03:36:36.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.661+0000 7fb6099ba640 1 -- start start 2024-09-17T03:36:36.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.662+0000 7fb6099ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb60406dd60 0x7fb60415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.662+0000 7fb6099ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6040b4530 0x7fb60415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.662+0000 7fb6099ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6040b55f0 0x7fb604151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.662+0000 7fb6099ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb60415c0a0 con 0x7fb6040b55f0 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.662+0000 7fb6099ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb60415bf20 con 0x7fb60406dd60 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.662+0000 7fb6099ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb60415c220 con 0x7fb6040b4530 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.662+0000 7fb6037fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6040b55f0 0x7fb604151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.662+0000 7fb6037fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6040b55f0 0x7fb604151520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57422/0 (socket says 172.21.15.146:57422) 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb6037fe640 1 -- 172.21.15.146:0/1754432845 learned_addr learned my addr 172.21.15.146:0/1754432845 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb602ffd640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb60406dd60 0x7fb60415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb6027fc640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6040b4530 0x7fb60415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb6037fe640 1 -- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6040b4530 msgr2=0x7fb60415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb6037fe640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6040b4530 0x7fb60415adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb6037fe640 1 -- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb60406dd60 msgr2=0x7fb60415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb6037fe640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb60406dd60 0x7fb60415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb6037fe640 1 -- 172.21.15.146:0/1754432845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6041429f0 con 0x7fb6040b55f0 2024-09-17T03:36:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb6037fe640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6040b55f0 0x7fb604151520 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c390 tx=0x7fb5fc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb5ebfff640 1 -- 172.21.15.146:0/1754432845 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc011790 con 0x7fb6040b55f0 2024-09-17T03:36:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb5ebfff640 1 -- 172.21.15.146:0/1754432845 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5fc017070 con 0x7fb6040b55f0 2024-09-17T03:36:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb6099ba640 1 -- 172.21.15.146:0/1754432845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6041f37c0 con 0x7fb6040b55f0 2024-09-17T03:36:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb5ebfff640 1 -- 172.21.15.146:0/1754432845 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc011ca0 con 0x7fb6040b55f0 2024-09-17T03:36:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.663+0000 7fb6099ba640 1 -- 172.21.15.146:0/1754432845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6041f3d80 con 0x7fb6040b55f0 2024-09-17T03:36:36.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.665+0000 7fb5ebfff640 1 -- 172.21.15.146:0/1754432845 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb5fc01c460 con 0x7fb6040b55f0 2024-09-17T03:36:36.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.665+0000 7fb5ebfff640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5f0078b90 0x7fb5f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.666+0000 7fb5ebfff640 1 -- 172.21.15.146:0/1754432845 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7fb5fc09ab00 con 0x7fb6040b55f0 2024-09-17T03:36:36.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.666+0000 7fb602ffd640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5f0078b90 0x7fb5f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.666+0000 7fb602ffd640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5f0078b90 0x7fb5f007b0a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009f20 tx=0x7fb5f40094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:36.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.667+0000 7fb610a04740 1 Processor -- start 2024-09-17T03:36:36.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.667+0000 7fb610a04740 1 -- start start 2024-09-17T03:36:36.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb610a04740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6bc4270 0x5561f6f95fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb610a04740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6f964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb610a04740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6ba3590 0x5561f6fb33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb610a04740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5561f6ede820 con 0x5561f6b9b3b0 2024-09-17T03:36:36.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb610a04740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5561f6ecdc50 con 0x5561f6ba3590 2024-09-17T03:36:36.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb610a04740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5561f6ed1a60 con 0x5561f6bc4270 2024-09-17T03:36:36.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb6027fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6f964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb6027fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6f964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57428/0 (socket says 172.21.15.146:57428) 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb6027fc640 1 -- 172.21.15.146:0/3272595128 learned_addr learned my addr 172.21.15.146:0/3272595128 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb602ffd640 1 --2- 172.21.15.146:0/3272595128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6bc4270 0x5561f6f95fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb6037fe640 1 --2- 172.21.15.146:0/3272595128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6ba3590 0x5561f6fb33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb6027fc640 1 -- 172.21.15.146:0/3272595128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6bc4270 msgr2=0x5561f6f95fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb6027fc640 1 --2- 172.21.15.146:0/3272595128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6bc4270 0x5561f6f95fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb6027fc640 1 -- 172.21.15.146:0/3272595128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6ba3590 msgr2=0x5561f6fb33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb6027fc640 1 --2- 172.21.15.146:0/3272595128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6ba3590 0x5561f6fb33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.668+0000 7fb6027fc640 1 -- 172.21.15.146:0/3272595128 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f6c2f850 con 0x5561f6b9b3b0 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.669+0000 7fb6027fc640 1 --2- 172.21.15.146:0/3272595128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6f964e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8000c00 tx=0x7fb5f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd29f86da845ef9e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.669+0000 7fb5e97fa640 1 -- 172.21.15.146:0/3272595128 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80037f0 con 0x5561f6b9b3b0 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.669+0000 7fb5e97fa640 1 -- 172.21.15.146:0/3272595128 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5f8009470 con 0x5561f6b9b3b0 2024-09-17T03:36:36.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.669+0000 7fb5e97fa640 1 -- 172.21.15.146:0/3272595128 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8003c30 con 0x5561f6b9b3b0 2024-09-17T03:36:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.670+0000 7fb610a04740 1 -- 172.21.15.146:0/3272595128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 msgr2=0x5561f6f964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.670+0000 7fb610a04740 1 --2- 172.21.15.146:0/3272595128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6f964e0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8000c00 tx=0x7fb5f80046c0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.670+0000 7fb610a04740 1 -- 172.21.15.146:0/3272595128 shutdown_connections 2024-09-17T03:36:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.670+0000 7fb610a04740 1 --2- 172.21.15.146:0/3272595128 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6ba3590 0x5561f6fb33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.670+0000 7fb610a04740 1 --2- 172.21.15.146:0/3272595128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6f964e0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.670+0000 7fb610a04740 1 --2- 172.21.15.146:0/3272595128 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6bc4270 0x5561f6f95fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.670+0000 7fb610a04740 1 -- 172.21.15.146:0/3272595128 >> 172.21.15.146:0/3272595128 conn(0x5561f6bb83c0 msgr2=0x5561f6f6c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.670+0000 7fb610a04740 1 -- 172.21.15.146:0/3272595128 shutdown_connections 2024-09-17T03:36:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.670+0000 7fb610a04740 1 -- 172.21.15.146:0/3272595128 wait complete. 2024-09-17T03:36:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.671+0000 7fb610a04740 1 -- start start 2024-09-17T03:36:36.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.671+0000 7fb610a04740 1 Processor -- start 2024-09-17T03:36:36.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb610a04740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6b9b3b0 0x5561f6f8f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb610a04740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6ba3590 0x5561f6fc0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb610a04740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6bc4270 0x5561f6fa8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb610a04740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5561f6c3e620 con 0x5561f6ba3590 2024-09-17T03:36:36.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb610a04740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5561f6e735f0 con 0x5561f6bc4270 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb610a04740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5561f6f96a20 con 0x5561f6b9b3b0 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb610a04740 10 client.0 _ll_register_callbacks cb 0x5561f6e770a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb6027fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6ba3590 0x5561f6fc0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb6027fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6ba3590 0x5561f6fc0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57442/0 (socket says 172.21.15.146:57442) 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb6027fc640 1 -- 172.21.15.146:0/3549027495 learned_addr learned my addr 172.21.15.146:0/3549027495 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb602ffd640 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6b9b3b0 0x5561f6f8f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb6037fe640 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6bc4270 0x5561f6fa8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb6027fc640 1 -- 172.21.15.146:0/3549027495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6b9b3b0 msgr2=0x5561f6f8f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb6027fc640 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6b9b3b0 0x5561f6f8f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb6027fc640 1 -- 172.21.15.146:0/3549027495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6bc4270 msgr2=0x5561f6fa8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb6027fc640 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6bc4270 0x5561f6fa8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.672+0000 7fb6027fc640 1 -- 172.21.15.146:0/3549027495 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f6ca66b0 con 0x5561f6ba3590 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb6027fc640 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6ba3590 0x5561f6fc0160 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009950 tx=0x7fb5f80045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7280324132c7877b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb5e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb5e27fc640 1 -- 172.21.15.146:0/3549027495 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f804a070 con 0x5561f6ba3590 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb5e27fc640 1 -- 172.21.15.146:0/3549027495 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7fb5f804fbc0 con 0x5561f6ba3590 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb610a04740 1 -- 172.21.15.146:0/3549027495 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f8009470 con 0x5561f6ba3590 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb5e27fc640 1 -- 172.21.15.146:0/3549027495 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb5f8056050 con 0x5561f6ba3590 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb610a04740 10 client.6654 fetch_fsmap learned FSMap version 38 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb610a04740 1 -- 172.21.15.146:0/3549027495 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x5561f6fa7d30 con 0x5561f6ba3590 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb5e27fc640 1 -- 172.21.15.146:0/3549027495 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5f8009470 con 0x5561f6ba3590 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb5e27fc640 1 -- 172.21.15.146:0/3549027495 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7fb5f8059020 con 0x5561f6ba3590 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb610a04740 10 client.6654 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb610a04740 10 client.6654 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:36:36.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb610a04740 20 client.6654 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb610a04740 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x5561f6b82e40 0x5561f6f84030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb610a04740 4 client.6654 mds_command: new command op to 6612 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb610a04740 1 -- 172.21.15.146:0/3549027495 --> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561f6ee0770 con 0x5561f6b82e40 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.673+0000 7fb602ffd640 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x5561f6b82e40 0x5561f6f84030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.674+0000 7fb5e27fc640 10 client.6654 ms_handle_connect on v2:172.21.15.146:6832/477965307 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.674+0000 7fb602ffd640 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x5561f6b82e40 0x5561f6f84030 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57b45e34a659bae2 server_cookie=3a0df4906c2f621e in_seq=0 out_seq=0 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.674+0000 7fb5e27fc640 1 -- 172.21.15.146:0/3549027495 <== mds.0 v2:172.21.15.146:6832/477965307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561f6ee0770 con 0x5561f6b82e40 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.674+0000 7fb5e27fc640 10 client.6654 handle_command_reply: tid=0 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.674+0000 7fb610a04740 1 client.6654 shutdown 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb610a04740 1 -- 172.21.15.146:0/3549027495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6ba3590 msgr2=0x5561f6fc0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb610a04740 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6ba3590 0x5561f6fc0160 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009950 tx=0x7fb5f80045a0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb610a04740 1 -- 172.21.15.146:0/3549027495 shutdown_connections 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb610a04740 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x5561f6b82e40 0x5561f6f84030 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb610a04740 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6bc4270 0x5561f6fa8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb610a04740 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6ba3590 0x5561f6fc0160 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb610a04740 1 --2- 172.21.15.146:0/3549027495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6b9b3b0 0x5561f6f8f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb5e27fc640 0 client.6654 ms_handle_reset on v2:172.21.15.146:6832/477965307 2024-09-17T03:36:36.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb610a04740 1 -- 172.21.15.146:0/3549027495 >> 172.21.15.146:0/3549027495 conn(0x5561f6bb83c0 msgr2=0x5561f6f85760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:36.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb610a04740 1 -- 172.21.15.146:0/3549027495 shutdown_connections 2024-09-17T03:36:36.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb610a04740 1 -- 172.21.15.146:0/3549027495 wait complete. 2024-09-17T03:36:36.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.675+0000 7fb610a04740 20 client.6654 trim_cache size 0 max 16384 2024-09-17T03:36:36.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.693+0000 7fb610a04740 1 Processor -- start 2024-09-17T03:36:36.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.693+0000 7fb610a04740 1 -- start start 2024-09-17T03:36:36.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.694+0000 7fb610a04740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6fd4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb610a04740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6ba3590 0x5561f6fbf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb610a04740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6bc4270 0x5561f6f8ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb610a04740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb60406d2a0 con 0x5561f6b9b3b0 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb610a04740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb6041435d0 con 0x5561f6bc4270 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb610a04740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb60406cc50 con 0x5561f6ba3590 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb602ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6fd4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb602ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6fd4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57458/0 (socket says 172.21.15.146:57458) 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb602ffd640 1 -- 172.21.15.146:0/1131397757 learned_addr learned my addr 172.21.15.146:0/1131397757 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb6027fc640 1 --2- 172.21.15.146:0/1131397757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6ba3590 0x5561f6fbf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb6037fe640 1 --2- 172.21.15.146:0/1131397757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6bc4270 0x5561f6f8ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb602ffd640 1 -- 172.21.15.146:0/1131397757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6ba3590 msgr2=0x5561f6fbf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb602ffd640 1 --2- 172.21.15.146:0/1131397757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6ba3590 0x5561f6fbf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb602ffd640 1 -- 172.21.15.146:0/1131397757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6bc4270 msgr2=0x5561f6f8ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:36.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb602ffd640 1 --2- 172.21.15.146:0/1131397757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6bc4270 0x5561f6f8ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb602ffd640 1 -- 172.21.15.146:0/1131397757 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f6fb4bd0 con 0x5561f6b9b3b0 2024-09-17T03:36:36.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb602ffd640 1 --2- 172.21.15.146:0/1131397757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6fd4db0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40176a0 tx=0x7fb5f4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a297efbcc027bc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:36.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb5e8ff9640 1 -- 172.21.15.146:0/1131397757 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4003970 con 0x5561f6b9b3b0 2024-09-17T03:36:36.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb5e8ff9640 1 -- 172.21.15.146:0/1131397757 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5f4003b10 con 0x5561f6b9b3b0 2024-09-17T03:36:36.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.695+0000 7fb5e8ff9640 1 -- 172.21.15.146:0/1131397757 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4003d00 con 0x5561f6b9b3b0 2024-09-17T03:36:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.696+0000 7fb610a04740 1 -- 172.21.15.146:0/1131397757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 msgr2=0x5561f6fd4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.696+0000 7fb610a04740 1 --2- 172.21.15.146:0/1131397757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6fd4db0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40176a0 tx=0x7fb5f4015000 comp rx=0 tx=0).stop 2024-09-17T03:36:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.696+0000 7fb610a04740 1 -- 172.21.15.146:0/1131397757 shutdown_connections 2024-09-17T03:36:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.696+0000 7fb610a04740 1 --2- 172.21.15.146:0/1131397757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6bc4270 0x5561f6f8ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.696+0000 7fb610a04740 1 --2- 172.21.15.146:0/1131397757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6ba3590 0x5561f6fbf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.696+0000 7fb610a04740 1 --2- 172.21.15.146:0/1131397757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6b9b3b0 0x5561f6fd4db0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.696+0000 7fb610a04740 1 -- 172.21.15.146:0/1131397757 >> 172.21.15.146:0/1131397757 conn(0x5561f6bb83c0 msgr2=0x5561f6f68090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.696+0000 7fb610a04740 1 -- 172.21.15.146:0/1131397757 shutdown_connections 2024-09-17T03:36:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.696+0000 7fb610a04740 1 -- 172.21.15.146:0/1131397757 wait complete. 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.697+0000 7fb610a04740 1 -- start start 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.697+0000 7fb610a04740 1 Processor -- start 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.698+0000 7fb610a04740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6b9b3b0 0x5561f7012540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.698+0000 7fb610a04740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6ba3590 0x5561f6faa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.698+0000 7fb610a04740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6bc4270 0x5561f6faa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.698+0000 7fb610a04740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5561f6fa9b80 con 0x5561f6bc4270 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.698+0000 7fb610a04740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5561f6fa8a70 con 0x5561f6b9b3b0 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.698+0000 7fb610a04740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5561f6fb46f0 con 0x5561f6ba3590 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.698+0000 7fb610a04740 10 client.0 _ll_register_callbacks cb 0x7fb5fc05eea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.698+0000 7fb6037fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6bc4270 0x5561f6faa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb6037fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6bc4270 0x5561f6faa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57464/0 (socket says 172.21.15.146:57464) 2024-09-17T03:36:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb6037fe640 1 -- 172.21.15.146:0/2475339313 learned_addr learned my addr 172.21.15.146:0/2475339313 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb6027fc640 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6ba3590 0x5561f6faa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb602ffd640 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6b9b3b0 0x5561f7012540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb6037fe640 1 -- 172.21.15.146:0/2475339313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6ba3590 msgr2=0x5561f6faa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb6037fe640 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6ba3590 0x5561f6faa0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb6037fe640 1 -- 172.21.15.146:0/2475339313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6b9b3b0 msgr2=0x5561f7012540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb6037fe640 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6b9b3b0 0x5561f7012540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb6037fe640 1 -- 172.21.15.146:0/2475339313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f6fd4630 con 0x5561f6bc4270 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb6037fe640 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6bc4270 0x5561f6faa620 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc062760 tx=0x7fb5fc011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eeed0c1a5de0ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb5e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb5e27fc640 1 -- 172.21.15.146:0/2475339313 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0627d0 con 0x5561f6bc4270 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb5e27fc640 1 -- 172.21.15.146:0/2475339313 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7fb5fc063b00 con 0x5561f6bc4270 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb610a04740 1 -- 172.21.15.146:0/2475339313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f4003b10 con 0x5561f6bc4270 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb5e27fc640 1 -- 172.21.15.146:0/2475339313 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb5fc0672b0 con 0x5561f6bc4270 2024-09-17T03:36:36.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb610a04740 10 client.6660 fetch_fsmap learned FSMap version 38 2024-09-17T03:36:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb610a04740 1 -- 172.21.15.146:0/2475339313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x5561f7026de0 con 0x5561f6bc4270 2024-09-17T03:36:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.699+0000 7fb5e27fc640 1 -- 172.21.15.146:0/2475339313 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5f4003b10 con 0x5561f6bc4270 2024-09-17T03:36:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb5e27fc640 1 -- 172.21.15.146:0/2475339313 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7fb5fc05e120 con 0x5561f6bc4270 2024-09-17T03:36:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb610a04740 10 client.6660 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:36:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb610a04740 10 client.6660 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:36:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb610a04740 20 client.6660 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb610a04740 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x5561f6fb3400 0x5561f7029140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb610a04740 4 client.6660 mds_command: new command op to 6612 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:36:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb610a04740 1 -- 172.21.15.146:0/2475339313 --> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] -- command(tid 0: {"prefix": "status"}) -- 0x5561f6edc220 con 0x5561f6fb3400 2024-09-17T03:36:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb602ffd640 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x5561f6fb3400 0x5561f7029140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb5e27fc640 10 client.6660 ms_handle_connect on v2:172.21.15.146:6832/477965307 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb602ffd640 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x5561f6fb3400 0x5561f7029140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e32a4ce2cf95dc1f server_cookie=a6065716bc68677e in_seq=0 out_seq=0 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb5e27fc640 1 -- 172.21.15.146:0/2475339313 <== mds.0 v2:172.21.15.146:6832/477965307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5561f6edc220 con 0x5561f6fb3400 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb5e27fc640 10 client.6660 handle_command_reply: tid=0 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb610a04740 1 client.6660 shutdown 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.700+0000 7fb610a04740 1 -- 172.21.15.146:0/2475339313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6bc4270 msgr2=0x5561f6faa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb610a04740 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6bc4270 0x5561f6faa620 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc062760 tx=0x7fb5fc011f00 comp rx=0 tx=0).stop 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb610a04740 1 -- 172.21.15.146:0/2475339313 shutdown_connections 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb610a04740 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561f6bc4270 0x5561f6faa620 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb610a04740 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5561f6ba3590 0x5561f6faa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb610a04740 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x5561f6fb3400 0x5561f7029140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb610a04740 1 --2- 172.21.15.146:0/2475339313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5561f6b9b3b0 0x5561f7012540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb5e27fc640 0 client.6660 ms_handle_reset on v2:172.21.15.146:6832/477965307 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb610a04740 1 -- 172.21.15.146:0/2475339313 >> 172.21.15.146:0/2475339313 conn(0x5561f6bb83c0 msgr2=0x5561f6f68090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb610a04740 1 -- 172.21.15.146:0/2475339313 shutdown_connections 2024-09-17T03:36:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb610a04740 1 -- 172.21.15.146:0/2475339313 wait complete. 2024-09-17T03:36:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb610a04740 20 client.6660 trim_cache size 0 max 16384 2024-09-17T03:36:36.706 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:36:36.706 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:36:36.706 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:36:36.706 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6612, 2024-09-17T03:36:36.706 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:36:36.706 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:36:36.706 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:36:36.706 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 4.5028354940000002, 2024-09-17T03:36:36.706 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 38, 2024-09-17T03:36:36.707 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 62, 2024-09-17T03:36:36.707 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 62, 2024-09-17T03:36:36.707 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 4.6028233570000001 2024-09-17T03:36:36.707 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 -- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5f0078b90 msgr2=0x7fb5f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5f0078b90 0x7fb5f007b0a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009f20 tx=0x7fb5f40094d0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 -- 172.21.15.146:0/1754432845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6040b55f0 msgr2=0x7fb604151520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6040b55f0 0x7fb604151520 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c390 tx=0x7fb5fc00c850 comp rx=0 tx=0).stop 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 -- 172.21.15.146:0/1754432845 shutdown_connections 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5f0078b90 0x7fb5f007b0a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6040b55f0 0x7fb604151520 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6040b4530 0x7fb60415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 --2- 172.21.15.146:0/1754432845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb60406dd60 0x7fb60415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 -- 172.21.15.146:0/1754432845 >> 172.21.15.146:0/1754432845 conn(0x7fb6040b3410 msgr2=0x7fb6040b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 -- 172.21.15.146:0/1754432845 shutdown_connections 2024-09-17T03:36:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.701+0000 7fb6099ba640 1 -- 172.21.15.146:0/1754432845 wait complete. 2024-09-17T03:36:36.712 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-17T03:36:36.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.829+0000 7f66066cc640 1 -- 172.21.15.146:0/1847531560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66001631a0 msgr2=0x7f66000cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.829+0000 7f66066cc640 1 --2- 172.21.15.146:0/1847531560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66001631a0 0x7f66000cef40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009830 tx=0x7f65f402a480 comp rx=0 tx=0).stop 2024-09-17T03:36:36.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.829+0000 7f66066cc640 1 -- 172.21.15.146:0/1847531560 shutdown_connections 2024-09-17T03:36:36.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.829+0000 7f66066cc640 1 --2- 172.21.15.146:0/1847531560 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66001631a0 0x7f66000cef40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.829+0000 7f66066cc640 1 --2- 172.21.15.146:0/1847531560 >> v2:172.21.15.179:3300/0 conn(0x7f660015f1a0 0x7f66000cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.829+0000 7f66066cc640 1 -- 172.21.15.146:0/1847531560 >> 172.21.15.146:0/1847531560 conn(0x7f66000d11f0 msgr2=0x7f66000d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:36.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.829+0000 7f66066cc640 1 -- 172.21.15.146:0/1847531560 shutdown_connections 2024-09-17T03:36:36.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.829+0000 7f66066cc640 1 -- 172.21.15.146:0/1847531560 wait complete. 2024-09-17T03:36:36.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.831+0000 7f66066cc640 1 Processor -- start 2024-09-17T03:36:36.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.831+0000 7f66066cc640 1 -- start start 2024-09-17T03:36:36.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f66066cc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66000b61f0 0x7f66001f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f66066cc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660015f1a0 0x7f660015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f66066cc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66001631a0 0x7f66001f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f66066cc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66000695b0 con 0x7f66000b61f0 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f66066cc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6600069430 con 0x7f66001631a0 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f66066cc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6600069730 con 0x7f660015f1a0 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66000b61f0 0x7f66001f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66000b61f0 0x7f66001f61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57476/0 (socket says 172.21.15.146:57476) 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fffff640 1 -- 172.21.15.146:0/794687305 learned_addr learned my addr 172.21.15.146:0/794687305 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65ff7fe640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660015f1a0 0x7f660015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f6604c69640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66001631a0 0x7f66001f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fffff640 1 -- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660015f1a0 msgr2=0x7f660015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fffff640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660015f1a0 0x7f660015c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fffff640 1 -- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66001631a0 msgr2=0x7f66001f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fffff640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66001631a0 0x7f66001f8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fffff640 1 -- 172.21.15.146:0/794687305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66000cd930 con 0x7f66000b61f0 2024-09-17T03:36:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f6604c69640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66001631a0 0x7f66001f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fffff640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66000b61f0 0x7f66001f61e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f65f000ea20 tx=0x7f65f000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fcff9640 1 -- 172.21.15.146:0/794687305 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f000ce40 con 0x7f66000b61f0 2024-09-17T03:36:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f66066cc640 1 -- 172.21.15.146:0/794687305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66001f97f0 con 0x7f66000b61f0 2024-09-17T03:36:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fcff9640 1 -- 172.21.15.146:0/794687305 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65f0004020 con 0x7f66000b61f0 2024-09-17T03:36:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f65fcff9640 1 -- 172.21.15.146:0/794687305 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0004470 con 0x7f66000b61f0 2024-09-17T03:36:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.833+0000 7f66066cc640 1 -- 172.21.15.146:0/794687305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66001f59e0 con 0x7f66000b61f0 2024-09-17T03:36:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.834+0000 7f66066cc640 1 -- 172.21.15.146:0/794687305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6600069be0 con 0x7f66000b61f0 2024-09-17T03:36:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.835+0000 7f65fcff9640 1 -- 172.21.15.146:0/794687305 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f65f00035f0 con 0x7f66000b61f0 2024-09-17T03:36:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.836+0000 7f65fcff9640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65ec078b90 0x7f65ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.836+0000 7f65fcff9640 1 -- 172.21.15.146:0/794687305 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7f65f009bf60 con 0x7f66000b61f0 2024-09-17T03:36:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.836+0000 7f65ff7fe640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65ec078b90 0x7f65ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.837+0000 7f65ff7fe640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65ec078b90 0x7f65ec07b0a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f65f4034000 tx=0x7f65f4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:36.840+0000 7f65fcff9640 1 -- 172.21.15.146:0/794687305 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f65f0064330 con 0x7f66000b61f0 2024-09-17T03:36:37.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.016+0000 7f66066cc640 1 -- 172.21.15.146:0/794687305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f66000d3ed0 con 0x7f66000b61f0 2024-09-17T03:36:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.020+0000 7f65fcff9640 1 -- 172.21.15.146:0/794687305 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v40)=0 v40) ==== 118+0+0 (secure 0 0 0) 0x7f65f0063c30 con 0x7f66000b61f0 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 -- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65ec078b90 msgr2=0x7f65ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65ec078b90 0x7f65ec07b0a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f65f4034000 tx=0x7f65f4004730 comp rx=0 tx=0).stop 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 -- 172.21.15.146:0/794687305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66000b61f0 msgr2=0x7f66001f61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66000b61f0 0x7f66001f61e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f65f000ea20 tx=0x7f65f000eee0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 -- 172.21.15.146:0/794687305 shutdown_connections 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65ec078b90 0x7f65ec07b0a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66001631a0 0x7f66001f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f660015f1a0 0x7f660015c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 --2- 172.21.15.146:0/794687305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66000b61f0 0x7f66001f61e0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 -- 172.21.15.146:0/794687305 >> 172.21.15.146:0/794687305 conn(0x7f66000d11f0 msgr2=0x7f660015d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 -- 172.21.15.146:0/794687305 shutdown_connections 2024-09-17T03:36:37.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.022+0000 7f66066cc640 1 -- 172.21.15.146:0/794687305 wait complete. 2024-09-17T03:36:37.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 30 2024-09-17T03:36:37.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.150+0000 7f38e5369640 1 -- 172.21.15.146:0/2511190178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38cc003a50 msgr2=0x7f38cc003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.150+0000 7f38e5369640 1 --2- 172.21.15.146:0/2511190178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38cc003a50 0x7f38cc003ec0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f38d00016c0 tx=0x7f38cc005830 comp rx=0 tx=0).stop 2024-09-17T03:36:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.150+0000 7f38e5369640 1 -- 172.21.15.146:0/2511190178 shutdown_connections 2024-09-17T03:36:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.150+0000 7f38e5369640 1 --2- 172.21.15.146:0/2511190178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38cc003a50 0x7f38cc003ec0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.150+0000 7f38e5369640 1 -- 172.21.15.146:0/2511190178 >> 172.21.15.146:0/2511190178 conn(0x7f38e00d4be0 msgr2=0x7f38e00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.150+0000 7f38e5369640 1 -- 172.21.15.146:0/2511190178 shutdown_connections 2024-09-17T03:36:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.150+0000 7f38e5369640 1 -- 172.21.15.146:0/2511190178 wait complete. 2024-09-17T03:36:37.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.152+0000 7f38e5369640 1 Processor -- start 2024-09-17T03:36:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.152+0000 7f38e5369640 1 -- start start 2024-09-17T03:36:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.153+0000 7f38e5369640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38cc003a50 0x7f38e01e8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.153+0000 7f38e5369640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e014a950 0x7f38e0149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.153+0000 7f38e5369640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38e014a420 0x7f38e0160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.153+0000 7f38e5369640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f38e0162640 con 0x7f38e014a950 2024-09-17T03:36:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.153+0000 7f38e5369640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f38e01624c0 con 0x7f38e014a420 2024-09-17T03:36:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.153+0000 7f38e5369640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f38e006ed30 con 0x7f38cc003a50 2024-09-17T03:36:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.153+0000 7f38d67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e014a950 0x7f38e0149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.153+0000 7f38d67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e014a950 0x7f38e0149ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35920/0 (socket says 172.21.15.146:35920) 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.153+0000 7f38d67fc640 1 -- 172.21.15.146:0/4213831787 learned_addr learned my addr 172.21.15.146:0/4213831787 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38deffd640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38cc003a50 0x7f38e01e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38df7fe640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38e014a420 0x7f38e0160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38d67fc640 1 -- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38cc003a50 msgr2=0x7f38e01e8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38d67fc640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38cc003a50 0x7f38e01e8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38d67fc640 1 -- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38e014a420 msgr2=0x7f38e0160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38d67fc640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38e014a420 0x7f38e0160ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38d67fc640 1 -- 172.21.15.146:0/4213831787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e01ead40 con 0x7f38e014a950 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38df7fe640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38e014a420 0x7f38e0160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38d67fc640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e014a950 0x7f38e0149ee0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f38c80066e0 tx=0x7f38c80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38d7fff640 1 -- 172.21.15.146:0/4213831787 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8015070 con 0x7f38e014a950 2024-09-17T03:36:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38d7fff640 1 -- 172.21.15.146:0/4213831787 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38c8011900 con 0x7f38e014a950 2024-09-17T03:36:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38e5369640 1 -- 172.21.15.146:0/4213831787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e01eb020 con 0x7f38e014a950 2024-09-17T03:36:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38d7fff640 1 -- 172.21.15.146:0/4213831787 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8011d50 con 0x7f38e014a950 2024-09-17T03:36:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.154+0000 7f38e5369640 1 -- 172.21.15.146:0/4213831787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e01eb5e0 con 0x7f38e014a950 2024-09-17T03:36:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.155+0000 7f38e5369640 1 -- 172.21.15.146:0/4213831787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e006f290 con 0x7f38e014a950 2024-09-17T03:36:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.156+0000 7f38d7fff640 1 -- 172.21.15.146:0/4213831787 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38c8018070 con 0x7f38e014a950 2024-09-17T03:36:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.156+0000 7f38d7fff640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38c0078b90 0x7f38c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.156+0000 7f38d7fff640 1 -- 172.21.15.146:0/4213831787 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7f38c809bb30 con 0x7f38e014a950 2024-09-17T03:36:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.157+0000 7f38deffd640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38c0078b90 0x7f38c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.157+0000 7f38deffd640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38c0078b90 0x7f38c007b0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f38d0032000 tx=0x7f38d002c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.161+0000 7f38d7fff640 1 -- 172.21.15.146:0/4213831787 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f38c8063980 con 0x7f38e014a950 2024-09-17T03:36:37.198 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-09-17T03:36:37.199+0000 7fe1560bd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:36:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.338+0000 7f38e5369640 1 -- 172.21.15.146:0/4213831787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f38e01e8c40 con 0x7f38e014a950 2024-09-17T03:36:37.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.341+0000 7f38d7fff640 1 -- 172.21.15.146:0/4213831787 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v41)=0 v41) ==== 117+0+0 (secure 0 0 0) 0x7f38c80683b0 con 0x7f38e014a950 2024-09-17T03:36:37.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 -- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38c0078b90 msgr2=0x7f38c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38c0078b90 0x7f38c007b0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f38d0032000 tx=0x7f38d002c040 comp rx=0 tx=0).stop 2024-09-17T03:36:37.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 -- 172.21.15.146:0/4213831787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e014a950 msgr2=0x7f38e0149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e014a950 0x7f38e0149ee0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f38c80066e0 tx=0x7f38c80039c0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 -- 172.21.15.146:0/4213831787 shutdown_connections 2024-09-17T03:36:37.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38c0078b90 0x7f38c007b0a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38e014a420 0x7f38e0160ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e014a950 0x7f38e0149ee0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 --2- 172.21.15.146:0/4213831787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38cc003a50 0x7f38e01e8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 -- 172.21.15.146:0/4213831787 >> 172.21.15.146:0/4213831787 conn(0x7f38e00d4be0 msgr2=0x7f38e00ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 -- 172.21.15.146:0/4213831787 shutdown_connections 2024-09-17T03:36:37.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.344+0000 7f38e5369640 1 -- 172.21.15.146:0/4213831787 wait complete. 2024-09-17T03:36:37.354 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.467+0000 7fbc198f9640 1 -- 172.21.15.146:0/1137919862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc140b47c0 msgr2=0x7fbc14161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.467+0000 7fbc198f9640 1 --2- 172.21.15.146:0/1137919862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc140b47c0 0x7fbc14161930 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c005fd0 tx=0x7fbc0c02aa10 comp rx=0 tx=0).stop 2024-09-17T03:36:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.467+0000 7fbc198f9640 1 -- 172.21.15.146:0/1137919862 shutdown_connections 2024-09-17T03:36:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.467+0000 7fbc198f9640 1 --2- 172.21.15.146:0/1137919862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc140b47c0 0x7fbc14161930 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.467+0000 7fbc198f9640 1 --2- 172.21.15.146:0/1137919862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc140d0710 0x7fbc140cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.467+0000 7fbc198f9640 1 -- 172.21.15.146:0/1137919862 >> 172.21.15.146:0/1137919862 conn(0x7fbc1409ba20 msgr2=0x7fbc140b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.467+0000 7fbc198f9640 1 -- 172.21.15.146:0/1137919862 shutdown_connections 2024-09-17T03:36:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.467+0000 7fbc198f9640 1 -- 172.21.15.146:0/1137919862 wait complete. 2024-09-17T03:36:37.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.469+0000 7fbc198f9640 1 Processor -- start 2024-09-17T03:36:37.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.469+0000 7fbc198f9640 1 -- start start 2024-09-17T03:36:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc198f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc140b47c0 0x7fbc1415f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc198f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc140cf6b0 0x7fbc1415d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc198f9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc140d0710 0x7fbc141563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc198f9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbc140b1de0 con 0x7fbc140cf6b0 2024-09-17T03:36:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc198f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbc14162080 con 0x7fbc140b47c0 2024-09-17T03:36:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc198f9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbc140b1f60 con 0x7fbc140d0710 2024-09-17T03:36:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc127fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc140cf6b0 0x7fbc1415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc127fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc140cf6b0 0x7fbc1415d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35932/0 (socket says 172.21.15.146:35932) 2024-09-17T03:36:37.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc127fc640 1 -- 172.21.15.146:0/2487193760 learned_addr learned my addr 172.21.15.146:0/2487193760 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc137fe640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc140d0710 0x7fbc141563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc12ffd640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc140b47c0 0x7fbc1415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc127fc640 1 -- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc140d0710 msgr2=0x7fbc141563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc127fc640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc140d0710 0x7fbc141563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc127fc640 1 -- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc140b47c0 msgr2=0x7fbc1415f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc127fc640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc140b47c0 0x7fbc1415f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc127fc640 1 -- 172.21.15.146:0/2487193760 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc14157a90 con 0x7fbc140cf6b0 2024-09-17T03:36:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc12ffd640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc140b47c0 0x7fbc1415f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc127fc640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc140cf6b0 0x7fbc1415d940 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800c3a0 tx=0x7fbc0800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbbfbfff640 1 -- 172.21.15.146:0/2487193760 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08017070 con 0x7fbc140cf6b0 2024-09-17T03:36:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbbfbfff640 1 -- 172.21.15.146:0/2487193760 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc080053c0 con 0x7fbc140cf6b0 2024-09-17T03:36:37.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbbfbfff640 1 -- 172.21.15.146:0/2487193760 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08003850 con 0x7fbc140cf6b0 2024-09-17T03:36:37.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc198f9640 1 -- 172.21.15.146:0/2487193760 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc14157d70 con 0x7fbc140cf6b0 2024-09-17T03:36:37.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.471+0000 7fbc198f9640 1 -- 172.21.15.146:0/2487193760 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc14158330 con 0x7fbc140cf6b0 2024-09-17T03:36:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.472+0000 7fbc198f9640 1 -- 172.21.15.146:0/2487193760 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc140cf170 con 0x7fbc140cf6b0 2024-09-17T03:36:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.473+0000 7fbbfbfff640 1 -- 172.21.15.146:0/2487193760 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc0801a070 con 0x7fbc140cf6b0 2024-09-17T03:36:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.474+0000 7fbbfbfff640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbc00078b90 0x7fbc0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.474+0000 7fbbfbfff640 1 -- 172.21.15.146:0/2487193760 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7fbc0809a160 con 0x7fbc140cf6b0 2024-09-17T03:36:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.474+0000 7fbc12ffd640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbc00078b90 0x7fbc0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.474+0000 7fbc12ffd640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbc00078b90 0x7fbc0007b0a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400bbc0 tx=0x7fbc04005ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.478+0000 7fbbfbfff640 1 -- 172.21.15.146:0/2487193760 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbc08061e50 con 0x7fbc140cf6b0 2024-09-17T03:36:37.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.688+0000 7fbc198f9640 1 -- 172.21.15.146:0/2487193760 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc140cfd50 con 0x7fbc140cf6b0 2024-09-17T03:36:37.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.688+0000 7fbbfbfff640 1 -- 172.21.15.146:0/2487193760 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7fbc08066880 con 0x7fbc140cf6b0 2024-09-17T03:36:37.687 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:37.688 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":38,"btime":"2024-09-17T03:36:35:207813+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3651488273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3651488273},{"type":"v1","addr":"172.21.15.179:6835","nonce":3651488273}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5753,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/497091008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":497091008},{"type":"v1","addr":"172.21.15.179:6837","nonce":497091008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2037796810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2037796810},{"type":"v1","addr":"172.21.15.146:6835","nonce":2037796810}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:35.207804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/477965307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":477965307},{"type":"v1","addr":"172.21.15.146:6833","nonce":477965307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6612,"qdb_cluster":[6612]},"id":4}]} 2024-09-17T03:36:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 38 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.690+0000 7fbc198f9640 1 -- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbc00078b90 msgr2=0x7fbc0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.690+0000 7fbc198f9640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbc00078b90 0x7fbc0007b0a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400bbc0 tx=0x7fbc04005ef0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.690+0000 7fbc198f9640 1 -- 172.21.15.146:0/2487193760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc140cf6b0 msgr2=0x7fbc1415d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.690+0000 7fbc198f9640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc140cf6b0 0x7fbc1415d940 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800c3a0 tx=0x7fbc0800c860 comp rx=0 tx=0).stop 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.690+0000 7fbc198f9640 1 -- 172.21.15.146:0/2487193760 shutdown_connections 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.691+0000 7fbc198f9640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbc00078b90 0x7fbc0007b0a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.691+0000 7fbc198f9640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbc140d0710 0x7fbc141563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.691+0000 7fbc198f9640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc140cf6b0 0x7fbc1415d940 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.691+0000 7fbc198f9640 1 --2- 172.21.15.146:0/2487193760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbc140b47c0 0x7fbc1415f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.691+0000 7fbc198f9640 1 -- 172.21.15.146:0/2487193760 >> 172.21.15.146:0/2487193760 conn(0x7fbc1409ba20 msgr2=0x7fbc14160c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.691+0000 7fbc198f9640 1 -- 172.21.15.146:0/2487193760 shutdown_connections 2024-09-17T03:36:37.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.691+0000 7fbc198f9640 1 -- 172.21.15.146:0/2487193760 wait complete. 2024-09-17T03:36:37.702 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-17T03:36:37.824 INFO:teuthology.orchestra.run.smithi146.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T03:36:30.678502+0000","btime":"2024-09-17T03:36:29.848515+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T03:36:30.678502+0000","atime":"2024-09-17T03:36:29.848515+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T03:36:30.678502+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:36:30.680502+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:36:30.680502+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T03:36:37.825 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-17T03:36:30.680502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T03:36:29.848515+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T03:36:29.848515+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T03:36:30.678502+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-17T03:36:30.678502+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T03:36:30.678502+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-17T03:36:30.680502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T03:36:37.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:36:37.826 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /testdir recursive 2024-09-17T03:36:37.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.943+0000 7fc5e35ad640 1 -- 172.21.15.146:0/2635665117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc0b5ce0 msgr2=0x7fc5dc0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.943+0000 7fc5e35ad640 1 --2- 172.21.15.146:0/2635665117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc0b5ce0 0x7fc5dc0b1320 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009830 tx=0x7fc5d802a510 comp rx=0 tx=0).stop 2024-09-17T03:36:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.943+0000 7fc5e35ad640 1 -- 172.21.15.146:0/2635665117 shutdown_connections 2024-09-17T03:36:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.943+0000 7fc5e35ad640 1 --2- 172.21.15.146:0/2635665117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5dc0b3d30 0x7fc5dc15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.943+0000 7fc5e35ad640 1 --2- 172.21.15.146:0/2635665117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc0b5ce0 0x7fc5dc0b1320 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.943+0000 7fc5e35ad640 1 -- 172.21.15.146:0/2635665117 >> 172.21.15.146:0/2635665117 conn(0x7fc5dc0b7b20 msgr2=0x7fc5dc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.943+0000 7fc5e35ad640 1 -- 172.21.15.146:0/2635665117 shutdown_connections 2024-09-17T03:36:37.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.943+0000 7fc5e35ad640 1 -- 172.21.15.146:0/2635665117 wait complete. 2024-09-17T03:36:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.945+0000 7fc5e35ad640 1 Processor -- start 2024-09-17T03:36:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.945+0000 7fc5e35ad640 1 -- start start 2024-09-17T03:36:37.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.946+0000 7fc5e35ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5dc0b5750 0x7fc5dc1e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.946+0000 7fc5e35ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5dc0b5ce0 0x7fc5dc1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.946+0000 7fc5e35ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1f3e30 0x7fc5dc152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.946+0000 7fc5e35ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc15d4b0 con 0x7fc5dc1f3e30 2024-09-17T03:36:37.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.946+0000 7fc5e35ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc15d330 con 0x7fc5dc0b5750 2024-09-17T03:36:37.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.946+0000 7fc5e35ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc5dc15d630 con 0x7fc5dc0b5ce0 2024-09-17T03:36:37.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.946+0000 7fc5e1b4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1f3e30 0x7fc5dc152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.946+0000 7fc5e1b4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1f3e30 0x7fc5dc152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35950/0 (socket says 172.21.15.146:35950) 2024-09-17T03:36:37.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.946+0000 7fc5e1b4a640 1 -- 172.21.15.146:0/3472279155 learned_addr learned my addr 172.21.15.146:0/3472279155 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:37.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5e0b48640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5dc0b5ce0 0x7fc5dc1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5e1349640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5dc0b5750 0x7fc5dc1e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5e1b4a640 1 -- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5dc0b5ce0 msgr2=0x7fc5dc1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5e1b4a640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5dc0b5ce0 0x7fc5dc1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5e1b4a640 1 -- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5dc0b5750 msgr2=0x7fc5dc1e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5e1b4a640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5dc0b5750 0x7fc5dc1e7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5e1b4a640 1 -- 172.21.15.146:0/3472279155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5dc1e8190 con 0x7fc5dc1f3e30 2024-09-17T03:36:37.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5e1b4a640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1f3e30 0x7fc5dc152e00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400cad0 tx=0x7fc5d400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5d1ffb640 1 -- 172.21.15.146:0/3472279155 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d400ae20 con 0x7fc5dc1f3e30 2024-09-17T03:36:37.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5d1ffb640 1 -- 172.21.15.146:0/3472279155 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5d400f450 con 0x7fc5dc1f3e30 2024-09-17T03:36:37.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5e35ad640 1 -- 172.21.15.146:0/3472279155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5dc151130 con 0x7fc5dc1f3e30 2024-09-17T03:36:37.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5d1ffb640 1 -- 172.21.15.146:0/3472279155 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d400f8c0 con 0x7fc5dc1f3e30 2024-09-17T03:36:37.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.947+0000 7fc5e35ad640 1 -- 172.21.15.146:0/3472279155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5dc1516f0 con 0x7fc5dc1f3e30 2024-09-17T03:36:37.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.949+0000 7fc5d1ffb640 1 -- 172.21.15.146:0/3472279155 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc5d400fa60 con 0x7fc5dc1f3e30 2024-09-17T03:36:37.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.950+0000 7fc5d1ffb640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5c0078b90 0x7fc5c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.950+0000 7fc5d1ffb640 1 -- 172.21.15.146:0/3472279155 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7fc5d409b880 con 0x7fc5dc1f3e30 2024-09-17T03:36:37.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.950+0000 7fc5e1349640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5c0078b90 0x7fc5c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.951+0000 7fc5e1349640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5c0078b90 0x7fc5c007b0a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8034000 tx=0x7fc5d8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.951+0000 7fc5ea5fd740 1 Processor -- start 2024-09-17T03:36:37.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.951+0000 7fc5ea5fd740 1 -- start start 2024-09-17T03:36:37.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.952+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5565b0 0x556f3b945070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.952+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b52d6f0 0x556f3b927d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.952+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5358d0 0x556f3b928280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.952+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556f3b870a80 con 0x556f3b5565b0 2024-09-17T03:36:37.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.952+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556f3b85feb0 con 0x556f3b52d6f0 2024-09-17T03:36:37.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.952+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x556f3b863cc0 con 0x556f3b5358d0 2024-09-17T03:36:37.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.952+0000 7fc5e1349640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5565b0 0x556f3b945070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.952+0000 7fc5e1349640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5565b0 0x556f3b945070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35956/0 (socket says 172.21.15.146:35956) 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.952+0000 7fc5e1349640 1 -- 172.21.15.146:0/1159406696 learned_addr learned my addr 172.21.15.146:0/1159406696 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.952+0000 7fc5e0b48640 1 --2- 172.21.15.146:0/1159406696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b52d6f0 0x556f3b927d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.952+0000 7fc5e1b4a640 1 --2- 172.21.15.146:0/1159406696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5358d0 0x556f3b928280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.953+0000 7fc5e1349640 1 -- 172.21.15.146:0/1159406696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5358d0 msgr2=0x556f3b928280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.953+0000 7fc5e1349640 1 --2- 172.21.15.146:0/1159406696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5358d0 0x556f3b928280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.953+0000 7fc5e1349640 1 -- 172.21.15.146:0/1159406696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b52d6f0 msgr2=0x556f3b927d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.953+0000 7fc5e1349640 1 --2- 172.21.15.146:0/1159406696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b52d6f0 0x556f3b927d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.953+0000 7fc5e1349640 1 -- 172.21.15.146:0/1159406696 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3b63aa20 con 0x556f3b5565b0 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.953+0000 7fc5e1349640 1 --2- 172.21.15.146:0/1159406696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5565b0 0x556f3b945070 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8005930 tx=0x7fc5d803e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70bcc9f73218d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.953+0000 7fc5c6ffd640 1 -- 172.21.15.146:0/1159406696 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d803c420 con 0x556f3b5565b0 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.953+0000 7fc5c6ffd640 1 -- 172.21.15.146:0/1159406696 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5d803c6b0 con 0x556f3b5565b0 2024-09-17T03:36:37.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.953+0000 7fc5c6ffd640 1 -- 172.21.15.146:0/1159406696 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d803ca60 con 0x556f3b5565b0 2024-09-17T03:36:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.954+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1159406696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5565b0 msgr2=0x556f3b945070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.954+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/1159406696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5565b0 0x556f3b945070 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8005930 tx=0x7fc5d803e070 comp rx=0 tx=0).stop 2024-09-17T03:36:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.954+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1159406696 shutdown_connections 2024-09-17T03:36:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.954+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/1159406696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5358d0 0x556f3b928280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.954+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/1159406696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b52d6f0 0x556f3b927d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.954+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/1159406696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5565b0 0x556f3b945070 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.954+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1159406696 >> 172.21.15.146:0/1159406696 conn(0x556f3b54a700 msgr2=0x556f3b8fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.954+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1159406696 shutdown_connections 2024-09-17T03:36:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.954+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1159406696 wait complete. 2024-09-17T03:36:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.955+0000 7fc5ea5fd740 1 -- start start 2024-09-17T03:36:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.955+0000 7fc5ea5fd740 1 Processor -- start 2024-09-17T03:36:37.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b52d6f0 0x556f3b93c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5565b0 0x556f3b9247b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556f3b5d0960 con 0x556f3b5358d0 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556f3b7e6670 con 0x556f3b52d6f0 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x556f3b939ca0 con 0x556f3b5565b0 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5ea5fd740 10 client.0 _ll_register_callbacks cb 0x556f3b8593e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5e0b48640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5e0b48640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35972/0 (socket says 172.21.15.146:35972) 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5e0b48640 1 -- 172.21.15.146:0/1090244018 learned_addr learned my addr 172.21.15.146:0/1090244018 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5e1b4a640 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5565b0 0x556f3b9247b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.956+0000 7fc5e1349640 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b52d6f0 0x556f3b93c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5e0b48640 1 -- 172.21.15.146:0/1090244018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5565b0 msgr2=0x556f3b9247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5e0b48640 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5565b0 0x556f3b9247b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5e0b48640 1 -- 172.21.15.146:0/1090244018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b52d6f0 msgr2=0x556f3b93c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:37.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5e0b48640 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b52d6f0 0x556f3b93c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5e0b48640 1 -- 172.21.15.146:0/1090244018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f3b59f8c0 con 0x556f3b5358d0 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5e0b48640 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9556d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc072e10 tx=0x7fc5cc011620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10253abdb7d2457d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5bbfff640 1 -- 172.21.15.146:0/1090244018 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc0050d0 con 0x556f3b5358d0 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5bbfff640 1 -- 172.21.15.146:0/1090244018 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7fc5cc005270 con 0x556f3b5358d0 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1090244018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5d803c6b0 con 0x556f3b5358d0 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5bbfff640 1 -- 172.21.15.146:0/1090244018 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc5cc022050 con 0x556f3b5358d0 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5ea5fd740 10 client.6693 fetch_fsmap learned FSMap version 38 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1090244018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x556f3b69b1b0 con 0x556f3b5358d0 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5bbfff640 1 -- 172.21.15.146:0/1090244018 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5d803c6b0 con 0x556f3b5358d0 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5bbfff640 1 -- 172.21.15.146:0/1090244018 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7fc5cc025020 con 0x556f3b5358d0 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5ea5fd740 10 client.6693 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5ea5fd740 10 client.6693 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-17T03:36:37.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5ea5fd740 20 client.6693 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x556f3b515180 0x556f3b924cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5ea5fd740 4 client.6693 mds_command: new command op to 6612 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:36:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.957+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1090244018 --> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f3b8729d0 con 0x556f3b515180 2024-09-17T03:36:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.958+0000 7fc5e1349640 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x556f3b515180 0x556f3b924cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.958+0000 7fc5bbfff640 10 client.6693 ms_handle_connect on v2:172.21.15.146:6832/477965307 2024-09-17T03:36:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.958+0000 7fc5e1349640 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x556f3b515180 0x556f3b924cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3647ce6a6f8c2eb server_cookie=2f4a220c9adaf0eb in_seq=0 out_seq=0 2024-09-17T03:36:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5bbfff640 1 -- 172.21.15.146:0/1090244018 <== mds.0 v2:172.21.15.146:6832/477965307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f3b8729d0 con 0x556f3b515180 2024-09-17T03:36:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5bbfff640 10 client.6693 handle_command_reply: tid=0 2024-09-17T03:36:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 1 client.6693 shutdown 2024-09-17T03:36:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1090244018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 msgr2=0x556f3b9556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9556d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc072e10 tx=0x7fc5cc011620 comp rx=0 tx=0).stop 2024-09-17T03:36:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1090244018 shutdown_connections 2024-09-17T03:36:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5565b0 0x556f3b9247b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9556d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x556f3b515180 0x556f3b924cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/1090244018 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b52d6f0 0x556f3b93c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1090244018 >> 172.21.15.146:0/1090244018 conn(0x556f3b54a700 msgr2=0x556f3b8f71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5bbfff640 0 client.6693 ms_handle_reset on v2:172.21.15.146:6832/477965307 2024-09-17T03:36:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1090244018 shutdown_connections 2024-09-17T03:36:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/1090244018 wait complete. 2024-09-17T03:36:37.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.959+0000 7fc5ea5fd740 20 client.6693 trim_cache size 0 max 16384 2024-09-17T03:36:37.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.977+0000 7fc5ea5fd740 1 Processor -- start 2024-09-17T03:36:37.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.977+0000 7fc5ea5fd740 1 -- start start 2024-09-17T03:36:37.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b52d6f0 0x556f3b955270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b5358d0 0x556f3b943140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5565b0 0x556f3b943680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc200220 con 0x556f3b52d6f0 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc1ff200 con 0x556f3b5358d0 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc5dc1f7210 con 0x556f3b5565b0 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e1349640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b52d6f0 0x556f3b955270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e1349640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b52d6f0 0x556f3b955270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35976/0 (socket says 172.21.15.146:35976) 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e1349640 1 -- 172.21.15.146:0/3680939440 learned_addr learned my addr 172.21.15.146:0/3680939440 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e1b4a640 1 --2- 172.21.15.146:0/3680939440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5565b0 0x556f3b943680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e0b48640 1 --2- 172.21.15.146:0/3680939440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b5358d0 0x556f3b943140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e1349640 1 -- 172.21.15.146:0/3680939440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5565b0 msgr2=0x556f3b943680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e1349640 1 --2- 172.21.15.146:0/3680939440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5565b0 0x556f3b943680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e1349640 1 -- 172.21.15.146:0/3680939440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b5358d0 msgr2=0x556f3b943140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e1349640 1 --2- 172.21.15.146:0/3680939440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b5358d0 0x556f3b943140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e1349640 1 -- 172.21.15.146:0/3680939440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f3b638d20 con 0x556f3b52d6f0 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e1b4a640 1 --2- 172.21.15.146:0/3680939440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5565b0 0x556f3b943680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e0b48640 1 --2- 172.21.15.146:0/3680939440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b5358d0 0x556f3b943140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.978+0000 7fc5e1349640 1 --2- 172.21.15.146:0/3680939440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b52d6f0 0x556f3b955270 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8000c00 tx=0x7fc5d8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c8919f9680194c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5c67fc640 1 -- 172.21.15.146:0/3680939440 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d803c6b0 con 0x556f3b52d6f0 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5c67fc640 1 -- 172.21.15.146:0/3680939440 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5d806a070 con 0x556f3b52d6f0 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5c67fc640 1 -- 172.21.15.146:0/3680939440 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d803cad0 con 0x556f3b52d6f0 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/3680939440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b52d6f0 msgr2=0x556f3b955270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/3680939440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b52d6f0 0x556f3b955270 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8000c00 tx=0x7fc5d8005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:37.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/3680939440 shutdown_connections 2024-09-17T03:36:37.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/3680939440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b5565b0 0x556f3b943680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/3680939440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b5358d0 0x556f3b943140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/3680939440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b52d6f0 0x556f3b955270 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/3680939440 >> 172.21.15.146:0/3680939440 conn(0x556f3b54a700 msgr2=0x556f3b8feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/3680939440 shutdown_connections 2024-09-17T03:36:37.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.979+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/3680939440 wait complete. 2024-09-17T03:36:37.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.980+0000 7fc5ea5fd740 1 -- start start 2024-09-17T03:36:37.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.980+0000 7fc5ea5fd740 1 Processor -- start 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b52d6f0 0x556f3b93a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5ea5fd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b5565b0 0x556f3b9c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556f3b9557b0 con 0x556f3b5358d0 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5dc1febc0 con 0x556f3b5565b0 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5ea5fd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x556f3b9c3b70 con 0x556f3b52d6f0 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5ea5fd740 10 client.0 _ll_register_callbacks cb 0x7fc5cc001a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5e0b48640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5e0b48640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9c2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35992/0 (socket says 172.21.15.146:35992) 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5e0b48640 1 -- 172.21.15.146:0/2582617200 learned_addr learned my addr 172.21.15.146:0/2582617200 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5e1349640 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b52d6f0 0x556f3b93a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5e1b4a640 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b5565b0 0x556f3b9c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5e0b48640 1 -- 172.21.15.146:0/2582617200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b52d6f0 msgr2=0x556f3b93a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5e0b48640 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b52d6f0 0x556f3b93a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5e0b48640 1 -- 172.21.15.146:0/2582617200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b5565b0 msgr2=0x556f3b9c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5e0b48640 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b5565b0 0x556f3b9c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5e0b48640 1 -- 172.21.15.146:0/2582617200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f3b9c75b0 con 0x556f3b5358d0 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5e0b48640 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9c2db0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc011ba0 tx=0x7fc5cc0010e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d18b29d4c8c0297 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.982+0000 7fc5bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5bbfff640 1 -- 172.21.15.146:0/2582617200 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc02b030 con 0x556f3b5358d0 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5bbfff640 1 -- 172.21.15.146:0/2582617200 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7fc5cc010070 con 0x556f3b5358d0 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/2582617200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5d806a070 con 0x556f3b5358d0 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5bbfff640 1 -- 172.21.15.146:0/2582617200 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc5cc003b40 con 0x556f3b5358d0 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5ea5fd740 10 client.6699 fetch_fsmap learned FSMap version 38 2024-09-17T03:36:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/2582617200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x556f3b8fd530 con 0x556f3b5358d0 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5bbfff640 1 -- 172.21.15.146:0/2582617200 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5d806a070 con 0x556f3b5358d0 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5bbfff640 1 -- 172.21.15.146:0/2582617200 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7fc5cc025040 con 0x556f3b5358d0 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5ea5fd740 10 client.6699 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5ea5fd740 10 client.6699 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5ea5fd740 20 client.6699 populate_metadata read hostname 'smithi146' 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x556f3b9528a0 0x556f3b943260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5ea5fd740 4 client.6699 mds_command: new command op to 6612 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/2582617200 --> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x556f3b86e480 con 0x556f3b9528a0 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.983+0000 7fc5e1349640 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x556f3b9528a0 0x556f3b943260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.984+0000 7fc5bbfff640 10 client.6699 ms_handle_connect on v2:172.21.15.146:6832/477965307 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.984+0000 7fc5e1349640 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x556f3b9528a0 0x556f3b943260 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d826fbdd6e2a94bc server_cookie=b019e4cf2794d2a9 in_seq=0 out_seq=0 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.984+0000 7fc5bbfff640 1 -- 172.21.15.146:0/2582617200 <== mds.0 v2:172.21.15.146:6832/477965307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556f3b86e480 con 0x556f3b9528a0 2024-09-17T03:36:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.984+0000 7fc5bbfff640 10 client.6699 handle_command_reply: tid=0 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.984+0000 7fc5ea5fd740 1 client.6699 shutdown 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.984+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/2582617200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 msgr2=0x556f3b9c2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.984+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9c2db0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc011ba0 tx=0x7fc5cc0010e0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/2582617200 shutdown_connections 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.146:6832/477965307,v1:172.21.15.146:6833/477965307] conn(0x556f3b9528a0 0x556f3b943260 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556f3b5565b0 0x556f3b9c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5bbfff640 0 client.6699 ms_handle_reset on v2:172.21.15.146:6832/477965307 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556f3b5358d0 0x556f3b9c2db0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5ea5fd740 1 --2- 172.21.15.146:0/2582617200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556f3b52d6f0 0x556f3b93a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/2582617200 >> 172.21.15.146:0/2582617200 conn(0x556f3b54a700 msgr2=0x556f3b955030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/2582617200 shutdown_connections 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5ea5fd740 1 -- 172.21.15.146:0/2582617200 wait complete. 2024-09-17T03:36:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5ea5fd740 20 client.6699 trim_cache size 0 max 16384 2024-09-17T03:36:37.992 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:36:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:36:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "4daa9006-390f-4f7e-ac53-e7b57a598b9d", 2024-09-17T03:36:37.992 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:36:37.992 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:36:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5e35ad640 1 -- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5c0078b90 msgr2=0x7fc5c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5e35ad640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5c0078b90 0x7fc5c007b0a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8034000 tx=0x7fc5d8004730 comp rx=0 tx=0).stop 2024-09-17T03:36:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5e35ad640 1 -- 172.21.15.146:0/3472279155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1f3e30 msgr2=0x7fc5dc152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5e35ad640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1f3e30 0x7fc5dc152e00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400cad0 tx=0x7fc5d400cf90 comp rx=0 tx=0).stop 2024-09-17T03:36:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5e35ad640 1 -- 172.21.15.146:0/3472279155 shutdown_connections 2024-09-17T03:36:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5e35ad640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5c0078b90 0x7fc5c007b0a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5e35ad640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5dc1f3e30 0x7fc5dc152e00 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5e35ad640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5dc0b5ce0 0x7fc5dc1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5e35ad640 1 --2- 172.21.15.146:0/3472279155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5dc0b5750 0x7fc5dc1e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.985+0000 7fc5e35ad640 1 -- 172.21.15.146:0/3472279155 >> 172.21.15.146:0/3472279155 conn(0x7fc5dc0b7b20 msgr2=0x7fc5dc0b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.986+0000 7fc5e35ad640 1 -- 172.21.15.146:0/3472279155 shutdown_connections 2024-09-17T03:36:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:37.986+0000 7fc5e35ad640 1 -- 172.21.15.146:0/3472279155 wait complete. 2024-09-17T03:36:37.997 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:38.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.111+0000 7fb5c34bd640 1 -- 172.21.15.146:0/4055139574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5bc0cd7a0 msgr2=0x7fb5bc0cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.111+0000 7fb5c34bd640 1 --2- 172.21.15.146:0/4055139574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5bc0cd7a0 0x7fb5bc0cdbb0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4005fd0 tx=0x7fb5b402a820 comp rx=0 tx=0).stop 2024-09-17T03:36:38.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.111+0000 7fb5c34bd640 1 -- 172.21.15.146:0/4055139574 shutdown_connections 2024-09-17T03:36:38.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.111+0000 7fb5c34bd640 1 --2- 172.21.15.146:0/4055139574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5bc0cd7a0 0x7fb5bc0cdbb0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.111+0000 7fb5c34bd640 1 -- 172.21.15.146:0/4055139574 >> 172.21.15.146:0/4055139574 conn(0x7fb5bc09ba20 msgr2=0x7fb5bc0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:38.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.111+0000 7fb5c34bd640 1 -- 172.21.15.146:0/4055139574 shutdown_connections 2024-09-17T03:36:38.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.111+0000 7fb5c34bd640 1 -- 172.21.15.146:0/4055139574 wait complete. 2024-09-17T03:36:38.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.113+0000 7fb5c34bd640 1 Processor -- start 2024-09-17T03:36:38.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.113+0000 7fb5c34bd640 1 -- start start 2024-09-17T03:36:38.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.114+0000 7fb5c34bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5bc0b47c0 0x7fb5bc160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.114+0000 7fb5c34bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5bc0cd7a0 0x7fb5bc1f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.114+0000 7fb5c34bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5bc0d0710 0x7fb5bc1f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.114+0000 7fb5c34bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc0b2ed0 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.114+0000 7fb5c34bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc0b80a0 con 0x7fb5bc0d0710 2024-09-17T03:36:38.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.114+0000 7fb5c34bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc168470 con 0x7fb5bc0cd7a0 2024-09-17T03:36:38.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.114+0000 7fb5c1259640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5bc0b47c0 0x7fb5bc160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.114+0000 7fb5c1259640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5bc0b47c0 0x7fb5bc160ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36010/0 (socket says 172.21.15.146:36010) 2024-09-17T03:36:38.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.114+0000 7fb5c1259640 1 -- 172.21.15.146:0/2343514170 learned_addr learned my addr 172.21.15.146:0/2343514170 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:38.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5c1a5a640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5bc0d0710 0x7fb5bc1f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5c0a58640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5bc0cd7a0 0x7fb5bc1f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5c1259640 1 -- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5bc0cd7a0 msgr2=0x7fb5bc1f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5c1259640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5bc0cd7a0 0x7fb5bc1f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5c1259640 1 -- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5bc0d0710 msgr2=0x7fb5bc1f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5c1259640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5bc0d0710 0x7fb5bc1f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5c1259640 1 -- 172.21.15.146:0/2343514170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc0c9610 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5c1259640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5bc0b47c0 0x7fb5bc160ba0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c3c0 tx=0x7fb5b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5b1ffb640 1 -- 172.21.15.146:0/2343514170 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8017070 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5b1ffb640 1 -- 172.21.15.146:0/2343514170 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5b80035f0 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5c34bd640 1 -- 172.21.15.146:0/2343514170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5bc0cbbe0 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5b1ffb640 1 -- 172.21.15.146:0/2343514170 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8003a80 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.115+0000 7fb5c34bd640 1 -- 172.21.15.146:0/2343514170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5bc0c9a80 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.116+0000 7fb5c34bd640 1 -- 172.21.15.146:0/2343514170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5bc0cdbb0 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.117+0000 7fb5b1ffb640 1 -- 172.21.15.146:0/2343514170 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb5b801a070 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.117+0000 7fb5b1ffb640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5a0078b90 0x7fb5a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.117+0000 7fb5b1ffb640 1 -- 172.21.15.146:0/2343514170 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7fb5b809a080 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.117+0000 7fb5c0a58640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5a0078b90 0x7fb5a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:38.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.118+0000 7fb5c0a58640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5a0078b90 0x7fb5a007b0a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc160b30 tx=0x7fb5ac009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:38.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.122+0000 7fb5b1ffb640 1 -- 172.21.15.146:0/2343514170 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb5b8061e00 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.331+0000 7fb5c34bd640 1 -- 172.21.15.146:0/2343514170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5bc0ced70 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.331+0000 7fb5b1ffb640 1 -- 172.21.15.146:0/2343514170 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7fb5b8066830 con 0x7fb5bc0b47c0 2024-09-17T03:36:38.330 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:38.331 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":38,"btime":"2024-09-17T03:36:35:207813+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3651488273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3651488273},{"type":"v1","addr":"172.21.15.179:6835","nonce":3651488273}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5753,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/497091008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":497091008},{"type":"v1","addr":"172.21.15.179:6837","nonce":497091008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2037796810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2037796810},{"type":"v1","addr":"172.21.15.146:6835","nonce":2037796810}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:35.207804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/477965307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":477965307},{"type":"v1","addr":"172.21.15.146:6833","nonce":477965307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6612,"qdb_cluster":[6612]},"id":4}]} 2024-09-17T03:36:38.331 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 38 2024-09-17T03:36:38.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.333+0000 7fb5c34bd640 1 -- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5a0078b90 msgr2=0x7fb5a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.333+0000 7fb5c34bd640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5a0078b90 0x7fb5a007b0a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc160b30 tx=0x7fb5ac009060 comp rx=0 tx=0).stop 2024-09-17T03:36:38.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.333+0000 7fb5c34bd640 1 -- 172.21.15.146:0/2343514170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5bc0b47c0 msgr2=0x7fb5bc160ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:38.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.333+0000 7fb5c34bd640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5bc0b47c0 0x7fb5bc160ba0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c3c0 tx=0x7fb5b800c880 comp rx=0 tx=0).stop 2024-09-17T03:36:38.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.333+0000 7fb5c34bd640 1 -- 172.21.15.146:0/2343514170 shutdown_connections 2024-09-17T03:36:38.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.333+0000 7fb5c34bd640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb5a0078b90 0x7fb5a007b0a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.333+0000 7fb5c34bd640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5bc0d0710 0x7fb5bc1f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.333+0000 7fb5c34bd640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5bc0cd7a0 0x7fb5bc1f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.333+0000 7fb5c34bd640 1 --2- 172.21.15.146:0/2343514170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5bc0b47c0 0x7fb5bc160ba0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:38.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.333+0000 7fb5c34bd640 1 -- 172.21.15.146:0/2343514170 >> 172.21.15.146:0/2343514170 conn(0x7fb5bc09ba20 msgr2=0x7fb5bc0b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:38.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.334+0000 7fb5c34bd640 1 -- 172.21.15.146:0/2343514170 shutdown_connections 2024-09-17T03:36:38.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:38.334+0000 7fb5c34bd640 1 -- 172.21.15.146:0/2343514170 wait complete. 2024-09-17T03:36:38.344 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-17T03:36:38.464 INFO:teuthology.orchestra.run.smithi146.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T03:36:30.678502+0000","btime":"2024-09-17T03:36:29.848515+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T03:36:30.678502+0000","atime":"2024-09-17T03:36:29.848515+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T03:36:30.678502+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:36:30.680502+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:36:30.680502+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"authpin":0,"scrubqueue":0},"nref":2,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T03:36:38.465 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-17T03:36:30.680502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T03:36:29.848515+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T03:36:29.848515+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T03:36:30.678502+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-17T03:36:30.678502+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T03:36:30.678502+0000", "nestlock": {}, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-17T03:36:30.680502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T03:36:38.465 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-17T03:36:43.467 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:43.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.595+0000 7f92c124d640 1 -- 172.21.15.146:0/4241828578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92a8005250 msgr2=0x7f92a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:43.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.595+0000 7f92c124d640 1 --2- 172.21.15.146:0/4241828578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92a8005250 0x7f92a800b9c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0b79f0 tx=0x7f92a8005830 comp rx=0 tx=0).stop 2024-09-17T03:36:43.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.595+0000 7f92c124d640 1 -- 172.21.15.146:0/4241828578 shutdown_connections 2024-09-17T03:36:43.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.595+0000 7f92c124d640 1 --2- 172.21.15.146:0/4241828578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92a8005250 0x7f92a800b9c0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.595+0000 7f92c124d640 1 -- 172.21.15.146:0/4241828578 >> 172.21.15.146:0/4241828578 conn(0x7f92bc0b7b20 msgr2=0x7f92bc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:43.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.595+0000 7f92c124d640 1 -- 172.21.15.146:0/4241828578 shutdown_connections 2024-09-17T03:36:43.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.595+0000 7f92c124d640 1 -- 172.21.15.146:0/4241828578 wait complete. 2024-09-17T03:36:43.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.597+0000 7f92c124d640 1 Processor -- start 2024-09-17T03:36:43.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.598+0000 7f92c124d640 1 -- start start 2024-09-17T03:36:43.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92c124d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a8005250 0x7f92bc15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:43.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92c124d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92bc15ebd0 0x7f92bc1f7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:43.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92c124d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc1f7540 0x7f92bc150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:43.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92c124d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc0b1920 con 0x7f92bc1f7540 2024-09-17T03:36:43.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92c124d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc0b17a0 con 0x7f92a8005250 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92c124d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f92bc0b3620 con 0x7f92bc15ebd0 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92bb59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc1f7540 0x7f92bc150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92bb59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc1f7540 0x7f92bc150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36028/0 (socket says 172.21.15.146:36028) 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92bb59e640 1 -- 172.21.15.146:0/465167631 learned_addr learned my addr 172.21.15.146:0/465167631 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92b259c640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92bc15ebd0 0x7f92bc1f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92bad9d640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a8005250 0x7f92bc15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92bb59e640 1 -- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92bc15ebd0 msgr2=0x7f92bc1f7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92bb59e640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92bc15ebd0 0x7f92bc1f7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92bb59e640 1 -- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a8005250 msgr2=0x7f92bc15e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92bb59e640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a8005250 0x7f92bc15e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.599+0000 7f92bb59e640 1 -- 172.21.15.146:0/465167631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc15ccb0 con 0x7f92bc1f7540 2024-09-17T03:36:43.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.600+0000 7f92bb59e640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc1f7540 0x7f92bc150fd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f92b4001330 tx=0x7f92b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:43.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.600+0000 7f92b3fff640 1 -- 172.21.15.146:0/465167631 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4039070 con 0x7f92bc1f7540 2024-09-17T03:36:43.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.600+0000 7f92b3fff640 1 -- 172.21.15.146:0/465167631 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92b402bd80 con 0x7f92bc1f7540 2024-09-17T03:36:43.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.600+0000 7f92c124d640 1 -- 172.21.15.146:0/465167631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92bc15cf90 con 0x7f92bc1f7540 2024-09-17T03:36:43.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.600+0000 7f92b3fff640 1 -- 172.21.15.146:0/465167631 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4006290 con 0x7f92bc1f7540 2024-09-17T03:36:43.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.600+0000 7f92c124d640 1 -- 172.21.15.146:0/465167631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92bc151b10 con 0x7f92bc1f7540 2024-09-17T03:36:43.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.601+0000 7f92c124d640 1 -- 172.21.15.146:0/465167631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92bc15f050 con 0x7f92bc1f7540 2024-09-17T03:36:43.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.602+0000 7f92b3fff640 1 -- 172.21.15.146:0/465167631 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92b4006430 con 0x7f92bc1f7540 2024-09-17T03:36:43.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.602+0000 7f92b3fff640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f929c078b90 0x7f929c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:43.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.602+0000 7f92b3fff640 1 -- 172.21.15.146:0/465167631 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7f92b40ba590 con 0x7f92bc1f7540 2024-09-17T03:36:43.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.602+0000 7f92bad9d640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f929c078b90 0x7f929c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:43.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.603+0000 7f92bad9d640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f929c078b90 0x7f929c07b0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009bd0 tx=0x7f92ac005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:43.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.607+0000 7f92b3fff640 1 -- 172.21.15.146:0/465167631 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f92b4082a20 con 0x7f92bc1f7540 2024-09-17T03:36:43.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.813+0000 7f92c124d640 1 -- 172.21.15.146:0/465167631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92bc151d70 con 0x7f92bc1f7540 2024-09-17T03:36:43.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.814+0000 7f92b3fff640 1 -- 172.21.15.146:0/465167631 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f92b4082320 con 0x7f92bc1f7540 2024-09-17T03:36:43.813 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:43.813 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":38,"btime":"2024-09-17T03:36:35:207813+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3651488273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3651488273},{"type":"v1","addr":"172.21.15.179:6835","nonce":3651488273}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5753,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/497091008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":497091008},{"type":"v1","addr":"172.21.15.179:6837","nonce":497091008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2037796810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2037796810},{"type":"v1","addr":"172.21.15.146:6835","nonce":2037796810}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:35.207804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/477965307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":477965307},{"type":"v1","addr":"172.21.15.146:6833","nonce":477965307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6612,"qdb_cluster":[6612]},"id":4}]} 2024-09-17T03:36:43.814 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 38 2024-09-17T03:36:43.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 -- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f929c078b90 msgr2=0x7f929c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:43.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f929c078b90 0x7f929c07b0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009bd0 tx=0x7f92ac005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:43.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 -- 172.21.15.146:0/465167631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc1f7540 msgr2=0x7f92bc150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:43.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc1f7540 0x7f92bc150fd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f92b4001330 tx=0x7f92b400c2d0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 -- 172.21.15.146:0/465167631 shutdown_connections 2024-09-17T03:36:43.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f929c078b90 0x7f929c07b0a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92bc1f7540 0x7f92bc150fd0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92bc15ebd0 0x7f92bc1f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 --2- 172.21.15.146:0/465167631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92a8005250 0x7f92bc15e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:43.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 -- 172.21.15.146:0/465167631 >> 172.21.15.146:0/465167631 conn(0x7f92bc0b7b20 msgr2=0x7f92bc15be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:43.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 -- 172.21.15.146:0/465167631 shutdown_connections 2024-09-17T03:36:43.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:43.816+0000 7f92c124d640 1 -- 172.21.15.146:0/465167631 wait complete. 2024-09-17T03:36:43.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-17T03:36:43.949 INFO:teuthology.orchestra.run.smithi146.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T03:36:30.678502+0000","btime":"2024-09-17T03:36:29.848515+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T03:36:30.678502+0000","atime":"2024-09-17T03:36:29.848515+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T03:36:30.678502+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:36:30.680502+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:36:30.680502+0000"},"version":247,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-17T03:36:37.986937+0000","last_scrub_version":244,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T03:36:43.950 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-17T03:36:30.680502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T03:36:29.848515+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T03:36:29.848515+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T03:36:30.678502+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-17T03:36:30.678502+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-17T03:36:37.986937+0000", "last_scrub_version": 244, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T03:36:30.678502+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-17T03:36:30.680502+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 247, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T03:36:43.950 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-17T03:36:43.950 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:36:43.950 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:36:43.994 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:36:44.041 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:36:44.041 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:36:44.041 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:44.041 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:44.057 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:36:44.057 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:36:44.057 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:36:44.057 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:44.076 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:36:44.077 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:36:44.077 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:44.077 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:44.115 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:36:44.115 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:36:44.115 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:36:44.115 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:44.135 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:36:44.136 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:44.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.271+0000 7fcad8464640 1 -- 172.21.15.146:0/2806232829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcabc005150 msgr2=0x7fcabc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.271+0000 7fcad8464640 1 --2- 172.21.15.146:0/2806232829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcabc005150 0x7fcabc00b9c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fcad00b37b0 tx=0x7fcabc005830 comp rx=0 tx=0).stop 2024-09-17T03:36:44.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.271+0000 7fcad6a01640 1 -- 172.21.15.146:0/2806232829 reap_dead start 2024-09-17T03:36:44.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.271+0000 7fcad8464640 1 -- 172.21.15.146:0/2806232829 shutdown_connections 2024-09-17T03:36:44.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.271+0000 7fcad8464640 1 -- 172.21.15.146:0/2806232829 >> 172.21.15.146:0/2806232829 conn(0x7fcad00d4be0 msgr2=0x7fcad00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.271+0000 7fcad8464640 1 -- 172.21.15.146:0/2806232829 shutdown_connections 2024-09-17T03:36:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.271+0000 7fcad8464640 1 -- 172.21.15.146:0/2806232829 wait complete. 2024-09-17T03:36:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.273+0000 7fcad8464640 1 Processor -- start 2024-09-17T03:36:44.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.273+0000 7fcad8464640 1 -- start start 2024-09-17T03:36:44.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad8464640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcabc005150 0x7fcad00cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad8464640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcad01f9a70 0x7fcad00c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad8464640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcad01f64b0 0x7fcad0160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad8464640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcad00d3190 con 0x7fcad01f64b0 2024-09-17T03:36:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad8464640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcad006f650 con 0x7fcad01f9a70 2024-09-17T03:36:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad8464640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcad00d3310 con 0x7fcabc005150 2024-09-17T03:36:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad6a01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcad01f64b0 0x7fcad0160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad6a01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcad01f64b0 0x7fcad0160810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36042/0 (socket says 172.21.15.146:36042) 2024-09-17T03:36:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad6a01640 1 -- 172.21.15.146:0/4007165858 learned_addr learned my addr 172.21.15.146:0/4007165858 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad6200640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcabc005150 0x7fcad00cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad59ff640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcad01f9a70 0x7fcad00c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad6a01640 1 -- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcabc005150 msgr2=0x7fcad00cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad6a01640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcabc005150 0x7fcad00cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad6a01640 1 -- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcad01f9a70 msgr2=0x7fcad00c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad6a01640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcad01f9a70 0x7fcad00c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad6a01640 1 -- 172.21.15.146:0/4007165858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad00ce310 con 0x7fcad01f64b0 2024-09-17T03:36:44.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.274+0000 7fcad6200640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcabc005150 0x7fcad00cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:44.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.275+0000 7fcad6a01640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcad01f64b0 0x7fcad0160810 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009c80 tx=0x7fcac8034c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:44.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.275+0000 7fcac6ffd640 1 -- 172.21.15.146:0/4007165858 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8041020 con 0x7fcad01f64b0 2024-09-17T03:36:44.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.275+0000 7fcac6ffd640 1 -- 172.21.15.146:0/4007165858 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcac8034db0 con 0x7fcad01f64b0 2024-09-17T03:36:44.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.275+0000 7fcac6ffd640 1 -- 172.21.15.146:0/4007165858 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8038040 con 0x7fcad01f64b0 2024-09-17T03:36:44.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.275+0000 7fcad8464640 1 -- 172.21.15.146:0/4007165858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad01f59d0 con 0x7fcad01f64b0 2024-09-17T03:36:44.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.275+0000 7fcad8464640 1 -- 172.21.15.146:0/4007165858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad00c9bd0 con 0x7fcad01f64b0 2024-09-17T03:36:44.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.276+0000 7fcad8464640 1 -- 172.21.15.146:0/4007165858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad01f57c0 con 0x7fcad01f64b0 2024-09-17T03:36:44.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.276+0000 7fcac6ffd640 1 -- 172.21.15.146:0/4007165858 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcac8004280 con 0x7fcad01f64b0 2024-09-17T03:36:44.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.277+0000 7fcac6ffd640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab4078bc0 0x7fcab407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.277+0000 7fcac6ffd640 1 -- 172.21.15.146:0/4007165858 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7fcac80bb660 con 0x7fcad01f64b0 2024-09-17T03:36:44.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.277+0000 7fcad6200640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab4078bc0 0x7fcab407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.278+0000 7fcad6200640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab4078bc0 0x7fcab407b0d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcacc005fd0 tx=0x7fcacc009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:44.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.281+0000 7fcac6ffd640 1 -- 172.21.15.146:0/4007165858 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcac804b020 con 0x7fcad01f64b0 2024-09-17T03:36:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.492+0000 7fcad8464640 1 -- 172.21.15.146:0/4007165858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcad00d2bd0 con 0x7fcad01f64b0 2024-09-17T03:36:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.492+0000 7fcac6ffd640 1 -- 172.21.15.146:0/4007165858 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7fcac8083ac0 con 0x7fcad01f64b0 2024-09-17T03:36:44.492 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:44.492 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":38,"btime":"2024-09-17T03:36:35:207813+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3651488273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3651488273},{"type":"v1","addr":"172.21.15.179:6835","nonce":3651488273}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5753,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/497091008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":497091008},{"type":"v1","addr":"172.21.15.179:6837","nonce":497091008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2037796810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2037796810},{"type":"v1","addr":"172.21.15.146:6835","nonce":2037796810}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:35.207804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/477965307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":477965307},{"type":"v1","addr":"172.21.15.146:6833","nonce":477965307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6612,"qdb_cluster":[6612]},"id":4}]} 2024-09-17T03:36:44.492 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 38 2024-09-17T03:36:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 -- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab4078bc0 msgr2=0x7fcab407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab4078bc0 0x7fcab407b0d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcacc005fd0 tx=0x7fcacc009500 comp rx=0 tx=0).stop 2024-09-17T03:36:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 -- 172.21.15.146:0/4007165858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcad01f64b0 msgr2=0x7fcad0160810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcad01f64b0 0x7fcad0160810 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009c80 tx=0x7fcac8034c40 comp rx=0 tx=0).stop 2024-09-17T03:36:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 -- 172.21.15.146:0/4007165858 shutdown_connections 2024-09-17T03:36:44.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcab4078bc0 0x7fcab407b0d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcad01f64b0 0x7fcad0160810 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcad01f9a70 0x7fcad00c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 --2- 172.21.15.146:0/4007165858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcabc005150 0x7fcad00cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 -- 172.21.15.146:0/4007165858 >> 172.21.15.146:0/4007165858 conn(0x7fcad00d4be0 msgr2=0x7fcad00b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 -- 172.21.15.146:0/4007165858 shutdown_connections 2024-09-17T03:36:44.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.495+0000 7fcad8464640 1 -- 172.21.15.146:0/4007165858 wait complete. 2024-09-17T03:36:44.505 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.619+0000 7fb896ea2640 1 -- 172.21.15.146:0/183569984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb890145ce0 msgr2=0x7fb8900cfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.619+0000 7fb896ea2640 1 --2- 172.21.15.146:0/183569984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb890145ce0 0x7fb8900cfb90 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb890071ce0 tx=0x7fb88802aa80 comp rx=0 tx=0).stop 2024-09-17T03:36:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.619+0000 7fb896ea2640 1 -- 172.21.15.146:0/183569984 shutdown_connections 2024-09-17T03:36:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.619+0000 7fb896ea2640 1 --2- 172.21.15.146:0/183569984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb890145ce0 0x7fb8900cfb90 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.619+0000 7fb896ea2640 1 --2- 172.21.15.146:0/183569984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb89006d360 0x7fb8900cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.619+0000 7fb896ea2640 1 -- 172.21.15.146:0/183569984 >> 172.21.15.146:0/183569984 conn(0x7fb8900b3150 msgr2=0x7fb8900b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.619+0000 7fb896ea2640 1 -- 172.21.15.146:0/183569984 shutdown_connections 2024-09-17T03:36:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.619+0000 7fb896ea2640 1 -- 172.21.15.146:0/183569984 wait complete. 2024-09-17T03:36:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.620+0000 7fb896ea2640 1 Processor -- start 2024-09-17T03:36:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.621+0000 7fb896ea2640 1 -- start start 2024-09-17T03:36:44.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb896ea2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb890145ce0 0x7fb8901539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb896ea2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb890146230 0x7fb89013f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb896ea2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8901542e0 0x7fb8901546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb896ea2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb8900d0460 con 0x7fb890146230 2024-09-17T03:36:44.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb896ea2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb8900d02e0 con 0x7fb8901542e0 2024-09-17T03:36:44.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb896ea2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb8900d05e0 con 0x7fb890145ce0 2024-09-17T03:36:44.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb887fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb890146230 0x7fb89013f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb887fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb890146230 0x7fb89013f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36058/0 (socket says 172.21.15.146:36058) 2024-09-17T03:36:44.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb887fff640 1 -- 172.21.15.146:0/971888761 learned_addr learned my addr 172.21.15.146:0/971888761 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:44.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb89543f640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8901542e0 0x7fb8901546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb894c3e640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb890145ce0 0x7fb8901539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb887fff640 1 -- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb890145ce0 msgr2=0x7fb8901539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb887fff640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb890145ce0 0x7fb8901539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb887fff640 1 -- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8901542e0 msgr2=0x7fb8901546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb887fff640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8901542e0 0x7fb8901546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.622+0000 7fb887fff640 1 -- 172.21.15.146:0/971888761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb890140300 con 0x7fb890146230 2024-09-17T03:36:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.623+0000 7fb887fff640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb890146230 0x7fb89013f820 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb88000d720 tx=0x7fb88000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.623+0000 7fb8857fa640 1 -- 172.21.15.146:0/971888761 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880017070 con 0x7fb890146230 2024-09-17T03:36:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.623+0000 7fb8857fa640 1 -- 172.21.15.146:0/971888761 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb880004310 con 0x7fb890146230 2024-09-17T03:36:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.623+0000 7fb896ea2640 1 -- 172.21.15.146:0/971888761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb890152f00 con 0x7fb890146230 2024-09-17T03:36:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.623+0000 7fb8857fa640 1 -- 172.21.15.146:0/971888761 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880009c30 con 0x7fb890146230 2024-09-17T03:36:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.623+0000 7fb896ea2640 1 -- 172.21.15.146:0/971888761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8901534c0 con 0x7fb890146230 2024-09-17T03:36:44.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.624+0000 7fb896ea2640 1 -- 172.21.15.146:0/971888761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8900cf650 con 0x7fb890146230 2024-09-17T03:36:44.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.625+0000 7fb8857fa640 1 -- 172.21.15.146:0/971888761 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb8800047a0 con 0x7fb890146230 2024-09-17T03:36:44.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.625+0000 7fb8857fa640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb87c078b90 0x7fb87c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.625+0000 7fb8857fa640 1 -- 172.21.15.146:0/971888761 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7fb88009b140 con 0x7fb890146230 2024-09-17T03:36:44.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.625+0000 7fb894c3e640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb87c078b90 0x7fb87c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.626+0000 7fb894c3e640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb87c078b90 0x7fb87c07b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb88c001720 tx=0x7fb88c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:44.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.630+0000 7fb8857fa640 1 -- 172.21.15.146:0/971888761 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb880020020 con 0x7fb890146230 2024-09-17T03:36:44.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.836+0000 7fb896ea2640 1 -- 172.21.15.146:0/971888761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8900cdc50 con 0x7fb890146230 2024-09-17T03:36:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.837+0000 7fb8857fa640 1 -- 172.21.15.146:0/971888761 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7fb880062db0 con 0x7fb890146230 2024-09-17T03:36:44.836 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:44.836 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":38,"btime":"2024-09-17T03:36:35:207813+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3651488273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3651488273},{"type":"v1","addr":"172.21.15.179:6835","nonce":3651488273}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5753,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/497091008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":497091008},{"type":"v1","addr":"172.21.15.179:6837","nonce":497091008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2037796810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2037796810},{"type":"v1","addr":"172.21.15.146:6835","nonce":2037796810}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:35.207804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/477965307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":477965307},{"type":"v1","addr":"172.21.15.146:6833","nonce":477965307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6612,"qdb_cluster":[6612]},"id":4}]} 2024-09-17T03:36:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 38 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 -- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb87c078b90 msgr2=0x7fb87c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb87c078b90 0x7fb87c07b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb88c001720 tx=0x7fb88c009040 comp rx=0 tx=0).stop 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 -- 172.21.15.146:0/971888761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb890146230 msgr2=0x7fb89013f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb890146230 0x7fb89013f820 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb88000d720 tx=0x7fb88000dbe0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 -- 172.21.15.146:0/971888761 shutdown_connections 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb87c078b90 0x7fb87c07b0a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8901542e0 0x7fb8901546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb890146230 0x7fb89013f820 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 --2- 172.21.15.146:0/971888761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb890145ce0 0x7fb8901539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 -- 172.21.15.146:0/971888761 >> 172.21.15.146:0/971888761 conn(0x7fb8900b3150 msgr2=0x7fb8901450b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 -- 172.21.15.146:0/971888761 shutdown_connections 2024-09-17T03:36:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.839+0000 7fb896ea2640 1 -- 172.21.15.146:0/971888761 wait complete. 2024-09-17T03:36:44.850 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.964+0000 7f5de3438640 1 -- 172.21.15.146:0/3034654608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dc4005910 msgr2=0x7f5dc4005d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.964+0000 7f5de3438640 1 --2- 172.21.15.146:0/3034654608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dc4005910 0x7f5dc4005d20 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc073130 tx=0x7f5dc4006940 comp rx=0 tx=0).stop 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.964+0000 7f5de3438640 1 -- 172.21.15.146:0/3034654608 shutdown_connections 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.964+0000 7f5de3438640 1 --2- 172.21.15.146:0/3034654608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dc4005910 0x7f5dc4005d20 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.964+0000 7f5de3438640 1 -- 172.21.15.146:0/3034654608 >> 172.21.15.146:0/3034654608 conn(0x7f5ddc0b2060 msgr2=0x7f5ddc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.965+0000 7f5de3438640 1 -- 172.21.15.146:0/3034654608 shutdown_connections 2024-09-17T03:36:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.965+0000 7f5de3438640 1 -- 172.21.15.146:0/3034654608 wait complete. 2024-09-17T03:36:44.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.966+0000 7f5de3438640 1 Processor -- start 2024-09-17T03:36:44.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.966+0000 7f5de3438640 1 -- start start 2024-09-17T03:36:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de3438640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc4005910 0x7f5ddc0d0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de3438640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ddc1e6030 0x7f5ddc1e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de3438640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ddc0ccdc0 0x7f5ddc0cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de3438640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc06e5f0 con 0x7f5ddc1e6030 2024-09-17T03:36:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de3438640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc06e470 con 0x7f5ddc0ccdc0 2024-09-17T03:36:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de3438640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5ddc06e770 con 0x7f5dc4005910 2024-09-17T03:36:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de09d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ddc1e6030 0x7f5ddc1e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de09d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ddc1e6030 0x7f5ddc1e6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36080/0 (socket says 172.21.15.146:36080) 2024-09-17T03:36:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de09d3640 1 -- 172.21.15.146:0/1340390530 learned_addr learned my addr 172.21.15.146:0/1340390530 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de19d5640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ddc0ccdc0 0x7f5ddc0cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de11d4640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc4005910 0x7f5ddc0d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de09d3640 1 -- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc4005910 msgr2=0x7f5ddc0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de09d3640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc4005910 0x7f5ddc0d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de09d3640 1 -- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ddc0ccdc0 msgr2=0x7f5ddc0cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de09d3640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ddc0ccdc0 0x7f5ddc0cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de09d3640 1 -- 172.21.15.146:0/1340390530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ddc0ce1e0 con 0x7f5ddc1e6030 2024-09-17T03:36:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5de09d3640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ddc1e6030 0x7f5ddc1e6440 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f5dd002a8d0 tx=0x7f5dd0006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5dd9ffb640 1 -- 172.21.15.146:0/1340390530 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0003a50 con 0x7f5ddc1e6030 2024-09-17T03:36:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.968+0000 7f5dd9ffb640 1 -- 172.21.15.146:0/1340390530 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dd0039070 con 0x7f5ddc1e6030 2024-09-17T03:36:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.969+0000 7f5dd9ffb640 1 -- 172.21.15.146:0/1340390530 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0006550 con 0x7f5ddc1e6030 2024-09-17T03:36:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.969+0000 7f5de3438640 1 -- 172.21.15.146:0/1340390530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ddc0ce4c0 con 0x7f5ddc1e6030 2024-09-17T03:36:44.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.969+0000 7f5de3438640 1 -- 172.21.15.146:0/1340390530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ddc0d0020 con 0x7f5ddc1e6030 2024-09-17T03:36:44.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.970+0000 7f5de3438640 1 -- 172.21.15.146:0/1340390530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ddc06ec60 con 0x7f5ddc1e6030 2024-09-17T03:36:44.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.971+0000 7f5dd9ffb640 1 -- 172.21.15.146:0/1340390530 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5dd0044020 con 0x7f5ddc1e6030 2024-09-17T03:36:44.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.971+0000 7f5dd9ffb640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5dc8078b90 0x7f5dc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:44.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.971+0000 7f5dd9ffb640 1 -- 172.21.15.146:0/1340390530 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7f5dd00ba450 con 0x7f5ddc1e6030 2024-09-17T03:36:44.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.971+0000 7f5de11d4640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5dc8078b90 0x7f5dc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.972+0000 7f5de11d4640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5dc8078b90 0x7f5dc807b0a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc06c6a0 tx=0x7f5dcc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:44.975+0000 7f5dd9ffb640 1 -- 172.21.15.146:0/1340390530 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5dd0082970 con 0x7f5ddc1e6030 2024-09-17T03:36:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.151+0000 7f5de3438640 1 -- 172.21.15.146:0/1340390530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ddc0d1010 con 0x7f5ddc1e6030 2024-09-17T03:36:45.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.152+0000 7f5dd9ffb640 1 -- 172.21.15.146:0/1340390530 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+17162 (secure 0 0 0) 0x7f5dd0082270 con 0x7f5ddc1e6030 2024-09-17T03:36:45.151 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:45.152 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":62,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:36:32.184548+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:15.586131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:16.904862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6832/3725156879":"2024-09-18T03:36:32.184525+0000","172.21.15.146:6835/6455506":"2024-09-18T03:36:31.969247+0000","172.21.15.146:6833/6455506":"2024-09-18T03:36:31.969247+0000","172.21.15.179:6836/2016497882":"2024-09-18T03:36:31.958975+0000","172.21.15.146:6834/3725156879":"2024-09-18T03:36:32.184525+0000","172.21.15.179:6834/2016497882":"2024-09-18T03:36:31.958975+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.154+0000 7f5de3438640 1 -- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5dc8078b90 msgr2=0x7f5dc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.154+0000 7f5de3438640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5dc8078b90 0x7f5dc807b0a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc06c6a0 tx=0x7f5dcc005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.154+0000 7f5de3438640 1 -- 172.21.15.146:0/1340390530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ddc1e6030 msgr2=0x7f5ddc1e6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.154+0000 7f5de3438640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ddc1e6030 0x7f5ddc1e6440 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f5dd002a8d0 tx=0x7f5dd0006360 comp rx=0 tx=0).stop 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.155+0000 7f5de3438640 1 -- 172.21.15.146:0/1340390530 shutdown_connections 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.155+0000 7f5de3438640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5dc8078b90 0x7f5dc807b0a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.155+0000 7f5de3438640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ddc0ccdc0 0x7f5ddc0cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.155+0000 7f5de3438640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ddc1e6030 0x7f5ddc1e6440 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.155+0000 7f5de3438640 1 --2- 172.21.15.146:0/1340390530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5dc4005910 0x7f5ddc0d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.155+0000 7f5de3438640 1 -- 172.21.15.146:0/1340390530 >> 172.21.15.146:0/1340390530 conn(0x7f5ddc0b2060 msgr2=0x7f5ddc154360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.155+0000 7f5de3438640 1 -- 172.21.15.146:0/1340390530 shutdown_connections 2024-09-17T03:36:45.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.155+0000 7f5de3438640 1 -- 172.21.15.146:0/1340390530 wait complete. 2024-09-17T03:36:45.165 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:36:45.165 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.280+0000 7fcc50f0b640 1 -- 172.21.15.146:0/2500853154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc38004b60 msgr2=0x7fcc38004fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.280+0000 7fcc50f0b640 1 --2- 172.21.15.146:0/2500853154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc38004b60 0x7fcc38004fd0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0016c0 tx=0x7fcc38006940 comp rx=0 tx=0).stop 2024-09-17T03:36:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.280+0000 7fcc50f0b640 1 -- 172.21.15.146:0/2500853154 shutdown_connections 2024-09-17T03:36:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.280+0000 7fcc50f0b640 1 --2- 172.21.15.146:0/2500853154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc38004b60 0x7fcc38004fd0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.280+0000 7fcc50f0b640 1 -- 172.21.15.146:0/2500853154 >> 172.21.15.146:0/2500853154 conn(0x7fcc4c0b2060 msgr2=0x7fcc4c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.280+0000 7fcc50f0b640 1 -- 172.21.15.146:0/2500853154 shutdown_connections 2024-09-17T03:36:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.280+0000 7fcc50f0b640 1 -- 172.21.15.146:0/2500853154 wait complete. 2024-09-17T03:36:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.282+0000 7fcc50f0b640 1 Processor -- start 2024-09-17T03:36:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.282+0000 7fcc50f0b640 1 -- start start 2024-09-17T03:36:45.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.283+0000 7fcc50f0b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc38004b60 0x7fcc4c15a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.283+0000 7fcc50f0b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc4c1f6620 0x7fcc4c1f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.283+0000 7fcc50f0b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4c152b60 0x7fcc4c152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.283+0000 7fcc50f0b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c06e470 con 0x7fcc4c152b60 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.283+0000 7fcc50f0b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c0d0130 con 0x7fcc4c1f6620 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.283+0000 7fcc50f0b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcc4c06e5f0 con 0x7fcc38004b60 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.283+0000 7fcc4ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4c152b60 0x7fcc4c152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.283+0000 7fcc4ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4c152b60 0x7fcc4c152f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36094/0 (socket says 172.21.15.146:36094) 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.283+0000 7fcc4ad9d640 1 -- 172.21.15.146:0/4035071320 learned_addr learned my addr 172.21.15.146:0/4035071320 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc4a59c640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc38004b60 0x7fcc4c15a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc41d9b640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc4c1f6620 0x7fcc4c1f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc4ad9d640 1 -- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc38004b60 msgr2=0x7fcc4c15a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc4ad9d640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc38004b60 0x7fcc4c15a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc4ad9d640 1 -- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc4c1f6620 msgr2=0x7fcc4c1f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc4ad9d640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc4c1f6620 0x7fcc4c1f6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc4ad9d640 1 -- 172.21.15.146:0/4035071320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4c1534b0 con 0x7fcc4c152b60 2024-09-17T03:36:45.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc4ad9d640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4c152b60 0x7fcc4c152f70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c070370 tx=0x7fcc44009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:45.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc437fe640 1 -- 172.21.15.146:0/4035071320 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44004b20 con 0x7fcc4c152b60 2024-09-17T03:36:45.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc437fe640 1 -- 172.21.15.146:0/4035071320 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc44004db0 con 0x7fcc4c152b60 2024-09-17T03:36:45.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc50f0b640 1 -- 172.21.15.146:0/4035071320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4c1f7310 con 0x7fcc4c152b60 2024-09-17T03:36:45.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc437fe640 1 -- 172.21.15.146:0/4035071320 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400f9f0 con 0x7fcc4c152b60 2024-09-17T03:36:45.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.284+0000 7fcc50f0b640 1 -- 172.21.15.146:0/4035071320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc4c14b9e0 con 0x7fcc4c152b60 2024-09-17T03:36:45.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.285+0000 7fcc50f0b640 1 -- 172.21.15.146:0/4035071320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc4c1f7080 con 0x7fcc4c152b60 2024-09-17T03:36:45.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.286+0000 7fcc437fe640 1 -- 172.21.15.146:0/4035071320 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc4401b020 con 0x7fcc4c152b60 2024-09-17T03:36:45.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.286+0000 7fcc437fe640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcc2c078b90 0x7fcc2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.286+0000 7fcc437fe640 1 -- 172.21.15.146:0/4035071320 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7fcc4409ae10 con 0x7fcc4c152b60 2024-09-17T03:36:45.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.287+0000 7fcc4a59c640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcc2c078b90 0x7fcc2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.287+0000 7fcc4a59c640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcc2c078b90 0x7fcc2c07b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c032000 tx=0x7fcc3c02c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:45.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.291+0000 7fcc437fe640 1 -- 172.21.15.146:0/4035071320 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc4c1534b0 con 0x7fcc4c152b60 2024-09-17T03:36:45.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.502+0000 7fcc50f0b640 1 -- 172.21.15.146:0/4035071320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc4c15ead0 con 0x7fcc4c152b60 2024-09-17T03:36:45.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.502+0000 7fcc437fe640 1 -- 172.21.15.146:0/4035071320 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7fcc44062b00 con 0x7fcc4c152b60 2024-09-17T03:36:45.501 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:45.501 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":38,"btime":"2024-09-17T03:36:35:207813+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3651488273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3651488273},{"type":"v1","addr":"172.21.15.179:6835","nonce":3651488273}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5753,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/497091008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":497091008},{"type":"v1","addr":"172.21.15.179:6837","nonce":497091008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2037796810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2037796810},{"type":"v1","addr":"172.21.15.146:6835","nonce":2037796810}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:35.207804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/477965307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":477965307},{"type":"v1","addr":"172.21.15.146:6833","nonce":477965307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6612,"qdb_cluster":[6612]},"id":4}]} 2024-09-17T03:36:45.502 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 38 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.504+0000 7fcc50f0b640 1 -- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcc2c078b90 msgr2=0x7fcc2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.504+0000 7fcc50f0b640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcc2c078b90 0x7fcc2c07b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c032000 tx=0x7fcc3c02c040 comp rx=0 tx=0).stop 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.504+0000 7fcc50f0b640 1 -- 172.21.15.146:0/4035071320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4c152b60 msgr2=0x7fcc4c152f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.504+0000 7fcc50f0b640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4c152b60 0x7fcc4c152f70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c070370 tx=0x7fcc44009b00 comp rx=0 tx=0).stop 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.504+0000 7fcc50f0b640 1 -- 172.21.15.146:0/4035071320 shutdown_connections 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.504+0000 7fcc50f0b640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcc2c078b90 0x7fcc2c07b0a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.504+0000 7fcc50f0b640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc4c152b60 0x7fcc4c152f70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.504+0000 7fcc50f0b640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc4c1f6620 0x7fcc4c1f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.504+0000 7fcc50f0b640 1 --2- 172.21.15.146:0/4035071320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcc38004b60 0x7fcc4c15a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.504+0000 7fcc50f0b640 1 -- 172.21.15.146:0/4035071320 >> 172.21.15.146:0/4035071320 conn(0x7fcc4c0b2060 msgr2=0x7fcc4c0b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.505+0000 7fcc50f0b640 1 -- 172.21.15.146:0/4035071320 shutdown_connections 2024-09-17T03:36:45.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.505+0000 7fcc50f0b640 1 -- 172.21.15.146:0/4035071320 wait complete. 2024-09-17T03:36:45.515 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.628+0000 7f7c46539640 1 -- 172.21.15.146:0/3904269526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c400b5ce0 msgr2=0x7f7c400b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.628+0000 7f7c46539640 1 --2- 172.21.15.146:0/3904269526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c400b5ce0 0x7f7c400b1320 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009830 tx=0x7f7c3002a510 comp rx=0 tx=0).stop 2024-09-17T03:36:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.628+0000 7f7c46539640 1 -- 172.21.15.146:0/3904269526 shutdown_connections 2024-09-17T03:36:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.628+0000 7f7c46539640 1 --2- 172.21.15.146:0/3904269526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c400b5ce0 0x7f7c400b1320 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.628+0000 7f7c46539640 1 -- 172.21.15.146:0/3904269526 >> 172.21.15.146:0/3904269526 conn(0x7f7c400b7b20 msgr2=0x7f7c4009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.628+0000 7f7c46539640 1 -- 172.21.15.146:0/3904269526 shutdown_connections 2024-09-17T03:36:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.628+0000 7f7c46539640 1 -- 172.21.15.146:0/3904269526 wait complete. 2024-09-17T03:36:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.629+0000 7f7c46539640 1 Processor -- start 2024-09-17T03:36:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.630+0000 7f7c46539640 1 -- start start 2024-09-17T03:36:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c46539640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c400b5750 0x7f7c401545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c46539640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c400b5ce0 0x7f7c401f9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c46539640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c401f6180 0x7f7c4015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c46539640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4015d6e0 con 0x7f7c400b5750 2024-09-17T03:36:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c46539640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4015d560 con 0x7f7c400b5ce0 2024-09-17T03:36:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c46539640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4015d860 con 0x7f7c401f6180 2024-09-17T03:36:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c3ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c400b5750 0x7f7c401545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c3ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c400b5750 0x7f7c401545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36116/0 (socket says 172.21.15.146:36116) 2024-09-17T03:36:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c3ffff640 1 -- 172.21.15.146:0/3855591766 learned_addr learned my addr 172.21.15.146:0/3855591766 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c3f7fe640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c400b5ce0 0x7f7c401f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c44ad6640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c401f6180 0x7f7c4015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c3ffff640 1 -- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c401f6180 msgr2=0x7f7c4015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c3ffff640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c401f6180 0x7f7c4015b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c3ffff640 1 -- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c400b5ce0 msgr2=0x7f7c401f9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c3ffff640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c400b5ce0 0x7f7c401f9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c3ffff640 1 -- 172.21.15.146:0/3855591766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c40154e20 con 0x7f7c400b5750 2024-09-17T03:36:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c44ad6640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c401f6180 0x7f7c4015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.631+0000 7f7c3ffff640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c400b5750 0x7f7c401545d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009950 tx=0x7f7c30033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.632+0000 7f7c3cff9640 1 -- 172.21.15.146:0/3855591766 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30031d60 con 0x7f7c400b5750 2024-09-17T03:36:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.632+0000 7f7c3cff9640 1 -- 172.21.15.146:0/3855591766 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c30033e10 con 0x7f7c400b5750 2024-09-17T03:36:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.632+0000 7f7c46539640 1 -- 172.21.15.146:0/3855591766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c401f56a0 con 0x7f7c400b5750 2024-09-17T03:36:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.632+0000 7f7c3cff9640 1 -- 172.21.15.146:0/3855591766 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30005260 con 0x7f7c400b5750 2024-09-17T03:36:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.632+0000 7f7c46539640 1 -- 172.21.15.146:0/3855591766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c401f5c60 con 0x7f7c400b5750 2024-09-17T03:36:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.633+0000 7f7c46539640 1 -- 172.21.15.146:0/3855591766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c400b1320 con 0x7f7c400b5750 2024-09-17T03:36:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.633+0000 7f7c3cff9640 1 -- 172.21.15.146:0/3855591766 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c30005400 con 0x7f7c400b5750 2024-09-17T03:36:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.634+0000 7f7c3cff9640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c2c078b90 0x7f7c2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.634+0000 7f7c3cff9640 1 -- 172.21.15.146:0/3855591766 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7f7c300bc110 con 0x7f7c400b5750 2024-09-17T03:36:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.634+0000 7f7c3f7fe640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c2c078b90 0x7f7c2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.635+0000 7f7c3f7fe640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c2c078b90 0x7f7c2c07b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c34006fd0 tx=0x7f7c34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:45.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.638+0000 7f7c3cff9640 1 -- 172.21.15.146:0/3855591766 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7c3003f030 con 0x7f7c400b5750 2024-09-17T03:36:45.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.849+0000 7f7c46539640 1 -- 172.21.15.146:0/3855591766 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c40157cf0 con 0x7f7c400b5750 2024-09-17T03:36:45.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.849+0000 7f7c3cff9640 1 -- 172.21.15.146:0/3855591766 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f7c30084450 con 0x7f7c400b5750 2024-09-17T03:36:45.849 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:45.849 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":38,"btime":"2024-09-17T03:36:35:207813+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3651488273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3651488273},{"type":"v1","addr":"172.21.15.179:6835","nonce":3651488273}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5753,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/497091008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":497091008},{"type":"v1","addr":"172.21.15.179:6837","nonce":497091008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2037796810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2037796810},{"type":"v1","addr":"172.21.15.146:6835","nonce":2037796810}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:17.932398+0000","modified":"2024-09-17T03:36:35.207804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":62,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/477965307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":477965307},{"type":"v1","addr":"172.21.15.146:6833","nonce":477965307}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6612,"qdb_cluster":[6612]},"id":4}]} 2024-09-17T03:36:45.849 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 38 2024-09-17T03:36:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 -- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c2c078b90 msgr2=0x7f7c2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c2c078b90 0x7f7c2c07b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c34006fd0 tx=0x7f7c34008040 comp rx=0 tx=0).stop 2024-09-17T03:36:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 -- 172.21.15.146:0/3855591766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c400b5750 msgr2=0x7f7c401545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c400b5750 0x7f7c401545d0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009950 tx=0x7f7c30033c20 comp rx=0 tx=0).stop 2024-09-17T03:36:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 -- 172.21.15.146:0/3855591766 shutdown_connections 2024-09-17T03:36:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c2c078b90 0x7f7c2c07b0a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c401f6180 0x7f7c4015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c400b5ce0 0x7f7c401f9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 --2- 172.21.15.146:0/3855591766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c400b5750 0x7f7c401545d0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 -- 172.21.15.146:0/3855591766 >> 172.21.15.146:0/3855591766 conn(0x7f7c400b7b20 msgr2=0x7f7c40159690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:45.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 -- 172.21.15.146:0/3855591766 shutdown_connections 2024-09-17T03:36:45.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.852+0000 7f7c46539640 1 -- 172.21.15.146:0/3855591766 wait complete. 2024-09-17T03:36:45.862 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:45.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.977+0000 7f825015e640 1 -- 172.21.15.146:0/3371548376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8230004800 msgr2=0x7f8230004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.977+0000 7f825015e640 1 --2- 172.21.15.146:0/3371548376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8230004800 0x7f8230004c10 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f823c0016c0 tx=0x7f8230005830 comp rx=0 tx=0).stop 2024-09-17T03:36:45.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.977+0000 7f824e6fb640 1 -- 172.21.15.146:0/3371548376 reap_dead start 2024-09-17T03:36:45.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.977+0000 7f825015e640 1 -- 172.21.15.146:0/3371548376 shutdown_connections 2024-09-17T03:36:45.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.977+0000 7f825015e640 1 -- 172.21.15.146:0/3371548376 >> 172.21.15.146:0/3371548376 conn(0x7f824809ba20 msgr2=0x7f82480b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:45.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.977+0000 7f825015e640 1 -- 172.21.15.146:0/3371548376 shutdown_connections 2024-09-17T03:36:45.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.977+0000 7f825015e640 1 -- 172.21.15.146:0/3371548376 wait complete. 2024-09-17T03:36:45.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.978+0000 7f825015e640 1 Processor -- start 2024-09-17T03:36:45.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.979+0000 7f825015e640 1 -- start start 2024-09-17T03:36:45.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f825015e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8230004800 0x7f82480cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f825015e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82480ca680 0x7f8248160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f825015e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82481605d0 0x7f824815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f825015e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f82480b2f30 con 0x7f82480ca680 2024-09-17T03:36:45.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f825015e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f82480b80a0 con 0x7f82481605d0 2024-09-17T03:36:45.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f825015e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f82480cf170 con 0x7f8230004800 2024-09-17T03:36:45.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f824d6f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82480ca680 0x7f8248160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f824d6f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82480ca680 0x7f8248160090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36132/0 (socket says 172.21.15.146:36132) 2024-09-17T03:36:45.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f824d6f9640 1 -- 172.21.15.146:0/1405278462 learned_addr learned my addr 172.21.15.146:0/1405278462 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:45.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f824defa640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8230004800 0x7f82480cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f824e6fb640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82481605d0 0x7f824815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f824d6f9640 1 -- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8230004800 msgr2=0x7f82480cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f824d6f9640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8230004800 0x7f82480cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f824d6f9640 1 -- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82481605d0 msgr2=0x7f824815e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:45.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f824d6f9640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82481605d0 0x7f824815e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:45.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f824d6f9640 1 -- 172.21.15.146:0/1405278462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82480cadb0 con 0x7f82480ca680 2024-09-17T03:36:45.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.980+0000 7f824d6f9640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82480ca680 0x7f8248160090 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f823c02a930 tx=0x7f823c006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:45.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.981+0000 7f82467fc640 1 -- 172.21.15.146:0/1405278462 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c041070 con 0x7f82480ca680 2024-09-17T03:36:45.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.981+0000 7f82467fc640 1 -- 172.21.15.146:0/1405278462 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f823c003a00 con 0x7f82480ca680 2024-09-17T03:36:45.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.981+0000 7f82467fc640 1 -- 172.21.15.146:0/1405278462 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c038070 con 0x7f82480ca680 2024-09-17T03:36:45.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.981+0000 7f825015e640 1 -- 172.21.15.146:0/1405278462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82480cb090 con 0x7f82480ca680 2024-09-17T03:36:45.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.981+0000 7f825015e640 1 -- 172.21.15.146:0/1405278462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82480c6d30 con 0x7f82480ca680 2024-09-17T03:36:45.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.982+0000 7f825015e640 1 -- 172.21.15.146:0/1405278462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82480cab20 con 0x7f82480ca680 2024-09-17T03:36:45.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.982+0000 7f82467fc640 1 -- 172.21.15.146:0/1405278462 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f823c030070 con 0x7f82480ca680 2024-09-17T03:36:45.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.983+0000 7f82467fc640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8234078b90 0x7f823407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:45.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.983+0000 7f82467fc640 1 -- 172.21.15.146:0/1405278462 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7f823c0ba350 con 0x7f82480ca680 2024-09-17T03:36:45.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.983+0000 7f824defa640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8234078b90 0x7f823407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:45.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.984+0000 7f824defa640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8234078b90 0x7f823407b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8238009c50 tx=0x7f8238005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:45.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:45.987+0000 7f82467fc640 1 -- 172.21.15.146:0/1405278462 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f823c006500 con 0x7f82480ca680 2024-09-17T03:36:46.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.160+0000 7f825015e640 1 -- 172.21.15.146:0/1405278462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8248161220 con 0x7f82480ca680 2024-09-17T03:36:46.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.161+0000 7f82467fc640 1 -- 172.21.15.146:0/1405278462 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+17162 (secure 0 0 0) 0x7f823c0a2e20 con 0x7f82480ca680 2024-09-17T03:36:46.161 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:46.161 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":62,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:36:32.184548+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:15.586131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:16.904862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6832/3725156879":"2024-09-18T03:36:32.184525+0000","172.21.15.146:6835/6455506":"2024-09-18T03:36:31.969247+0000","172.21.15.146:6833/6455506":"2024-09-18T03:36:31.969247+0000","172.21.15.179:6836/2016497882":"2024-09-18T03:36:31.958975+0000","172.21.15.146:6834/3725156879":"2024-09-18T03:36:32.184525+0000","172.21.15.179:6834/2016497882":"2024-09-18T03:36:31.958975+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:46.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 -- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8234078b90 msgr2=0x7f823407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8234078b90 0x7f823407b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8238009c50 tx=0x7f8238005f90 comp rx=0 tx=0).stop 2024-09-17T03:36:46.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 -- 172.21.15.146:0/1405278462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82480ca680 msgr2=0x7f8248160090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82480ca680 0x7f8248160090 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f823c02a930 tx=0x7f823c006310 comp rx=0 tx=0).stop 2024-09-17T03:36:46.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 -- 172.21.15.146:0/1405278462 shutdown_connections 2024-09-17T03:36:46.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8234078b90 0x7f823407b0a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82481605d0 0x7f824815e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82480ca680 0x7f8248160090 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 --2- 172.21.15.146:0/1405278462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8230004800 0x7f82480cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 -- 172.21.15.146:0/1405278462 >> 172.21.15.146:0/1405278462 conn(0x7f824809ba20 msgr2=0x7f82480b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 -- 172.21.15.146:0/1405278462 shutdown_connections 2024-09-17T03:36:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.163+0000 7f825015e640 1 -- 172.21.15.146:0/1405278462 wait complete. 2024-09-17T03:36:46.174 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:36:46.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.290+0000 7f556fcde640 1 -- 172.21.15.146:0/874027491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f556815c8e0 msgr2=0x7f556806f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.290+0000 7f556fcde640 1 --2- 172.21.15.146:0/874027491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f556815c8e0 0x7f556806f580 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f55680b45d0 tx=0x7f555802a820 comp rx=0 tx=0).stop 2024-09-17T03:36:46.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.290+0000 7f556fcde640 1 -- 172.21.15.146:0/874027491 shutdown_connections 2024-09-17T03:36:46.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.290+0000 7f556fcde640 1 --2- 172.21.15.146:0/874027491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f556815c8e0 0x7f556806f580 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.290+0000 7f556fcde640 1 -- 172.21.15.146:0/874027491 >> 172.21.15.146:0/874027491 conn(0x7f55680b3150 msgr2=0x7f55680b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:46.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.290+0000 7f556fcde640 1 -- 172.21.15.146:0/874027491 shutdown_connections 2024-09-17T03:36:46.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.290+0000 7f556fcde640 1 -- 172.21.15.146:0/874027491 wait complete. 2024-09-17T03:36:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.292+0000 7f556fcde640 1 Processor -- start 2024-09-17T03:36:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.292+0000 7f556fcde640 1 -- start start 2024-09-17T03:36:46.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.293+0000 7f556fcde640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55680cd840 0x7f5568155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.293+0000 7f556fcde640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680cdc50 0x7f5568141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556fcde640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f556815c8e0 0x7f5568142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556fcde640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5568073700 con 0x7f55680cdc50 2024-09-17T03:36:46.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556fcde640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5568073580 con 0x7f556815c8e0 2024-09-17T03:36:46.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556fcde640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5568073880 con 0x7f55680cd840 2024-09-17T03:36:46.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556d279640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680cdc50 0x7f5568141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:46.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556d279640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680cdc50 0x7f5568141a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36146/0 (socket says 172.21.15.146:36146) 2024-09-17T03:36:46.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556d279640 1 -- 172.21.15.146:0/785757819 learned_addr learned my addr 172.21.15.146:0/785757819 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:46.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556da7a640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55680cd840 0x7f5568155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:46.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556e27b640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f556815c8e0 0x7f5568142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:46.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556d279640 1 -- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55680cd840 msgr2=0x7f5568155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556d279640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55680cd840 0x7f5568155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556d279640 1 -- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f556815c8e0 msgr2=0x7f5568142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556d279640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f556815c8e0 0x7f5568142330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556d279640 1 -- 172.21.15.146:0/785757819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55681542a0 con 0x7f55680cdc50 2024-09-17T03:36:46.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556d279640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680cdc50 0x7f5568141a40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f555c00c4d0 tx=0x7f555c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:46.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f55667fc640 1 -- 172.21.15.146:0/785757819 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c012830 con 0x7f55680cdc50 2024-09-17T03:36:46.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f55667fc640 1 -- 172.21.15.146:0/785757819 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f555c017070 con 0x7f55680cdc50 2024-09-17T03:36:46.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556fcde640 1 -- 172.21.15.146:0/785757819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5568154580 con 0x7f55680cdc50 2024-09-17T03:36:46.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f55667fc640 1 -- 172.21.15.146:0/785757819 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c012d40 con 0x7f55680cdc50 2024-09-17T03:36:46.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.294+0000 7f556fcde640 1 -- 172.21.15.146:0/785757819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5568154b40 con 0x7f55680cdc50 2024-09-17T03:36:46.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.296+0000 7f556fcde640 1 -- 172.21.15.146:0/785757819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5568154010 con 0x7f55680cdc50 2024-09-17T03:36:46.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.296+0000 7f55667fc640 1 -- 172.21.15.146:0/785757819 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f555c01c460 con 0x7f55680cdc50 2024-09-17T03:36:46.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.296+0000 7f55667fc640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5554078b90 0x7f555407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.297+0000 7f55667fc640 1 -- 172.21.15.146:0/785757819 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5967+0+0 (secure 0 0 0) 0x7f555c09ac90 con 0x7f55680cdc50 2024-09-17T03:36:46.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.297+0000 7f556da7a640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5554078b90 0x7f555407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:46.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.297+0000 7f556da7a640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5554078b90 0x7f555407b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5558033000 tx=0x7f5558004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:46.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.301+0000 7f55667fc640 1 -- 172.21.15.146:0/785757819 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f555c062fe0 con 0x7f55680cdc50 2024-09-17T03:36:46.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.513+0000 7f556fcde640 1 -- 172.21.15.146:0/785757819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5568073d50 con 0x7f55680cdc50 2024-09-17T03:36:46.513 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:36:46.514+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:36:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.516+0000 7f55667fc640 1 -- 172.21.15.146:0/785757819 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) ==== 161+0+0 (secure 0 0 0) 0x7f555c0628e0 con 0x7f55680cdc50 2024-09-17T03:36:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:36:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 -- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5554078b90 msgr2=0x7f555407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5554078b90 0x7f555407b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5558033000 tx=0x7f5558004ab0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 -- 172.21.15.146:0/785757819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680cdc50 msgr2=0x7f5568141a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680cdc50 0x7f5568141a40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f555c00c4d0 tx=0x7f555c00c990 comp rx=0 tx=0).stop 2024-09-17T03:36:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 -- 172.21.15.146:0/785757819 shutdown_connections 2024-09-17T03:36:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5554078b90 0x7f555407b0a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f556815c8e0 0x7f5568142330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680cdc50 0x7f5568141a40 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 --2- 172.21.15.146:0/785757819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55680cd840 0x7f5568155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 -- 172.21.15.146:0/785757819 >> 172.21.15.146:0/785757819 conn(0x7f55680b3150 msgr2=0x7f556815d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 -- 172.21.15.146:0/785757819 shutdown_connections 2024-09-17T03:36:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.519+0000 7f556fcde640 1 -- 172.21.15.146:0/785757819 wait complete. 2024-09-17T03:36:46.521 INFO:tasks.ceph.mds.a.smithi146.stderr: -5261> 2024-09-17T03:36:37.199+0000 7fe1560bd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:36:46.530 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:36:46.577 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:36:46.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.648+0000 7fbd7932b640 1 -- 172.21.15.146:0/601874158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7406f440 msgr2=0x7fbd74169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.648+0000 7fbd7932b640 1 --2- 172.21.15.146:0/601874158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7406f440 0x7fbd74169c10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c005fd0 tx=0x7fbd6c02a820 comp rx=0 tx=0).stop 2024-09-17T03:36:46.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.648+0000 7fbd7932b640 1 -- 172.21.15.146:0/601874158 shutdown_connections 2024-09-17T03:36:46.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.648+0000 7fbd7932b640 1 --2- 172.21.15.146:0/601874158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7406f440 0x7fbd74169c10 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.649+0000 7fbd7932b640 1 -- 172.21.15.146:0/601874158 >> 172.21.15.146:0/601874158 conn(0x7fbd740d4be0 msgr2=0x7fbd740d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:46.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.649+0000 7fbd7932b640 1 -- 172.21.15.146:0/601874158 shutdown_connections 2024-09-17T03:36:46.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.649+0000 7fbd7932b640 1 -- 172.21.15.146:0/601874158 wait complete. 2024-09-17T03:36:46.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.650+0000 7fbd7932b640 1 Processor -- start 2024-09-17T03:36:46.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.650+0000 7fbd7932b640 1 -- start start 2024-09-17T03:36:46.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd7932b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd740b3870 0x7fbd7415b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd7932b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd740cf370 0x7fbd740cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd7932b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd74163970 0x7fbd740cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd7932b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7416a2d0 con 0x7fbd740cf370 2024-09-17T03:36:46.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd7932b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7416a150 con 0x7fbd74163970 2024-09-17T03:36:46.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd7932b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbd7416a450 con 0x7fbd740b3870 2024-09-17T03:36:46.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd727fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd740cf370 0x7fbd740cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:46.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd727fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd740cf370 0x7fbd740cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36166/0 (socket says 172.21.15.146:36166) 2024-09-17T03:36:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd727fc640 1 -- 172.21.15.146:0/1069403540 learned_addr learned my addr 172.21.15.146:0/1069403540 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd727fc640 1 -- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd740b3870 msgr2=0x7fbd7415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd727fc640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd740b3870 0x7fbd7415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd727fc640 1 -- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd74163970 msgr2=0x7fbd740cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd727fc640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd74163970 0x7fbd740cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd727fc640 1 -- 172.21.15.146:0/1069403540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7415bbf0 con 0x7fbd740cf370 2024-09-17T03:36:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd727fc640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd740cf370 0x7fbd740cda70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800c420 tx=0x7fbd6800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd5b7fe640 1 -- 172.21.15.146:0/1069403540 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68017070 con 0x7fbd740cf370 2024-09-17T03:36:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd5b7fe640 1 -- 172.21.15.146:0/1069403540 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd680035f0 con 0x7fbd740cf370 2024-09-17T03:36:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd5b7fe640 1 -- 172.21.15.146:0/1069403540 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68003a40 con 0x7fbd740cf370 2024-09-17T03:36:46.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.652+0000 7fbd7932b640 1 -- 172.21.15.146:0/1069403540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd74147c10 con 0x7fbd740cf370 2024-09-17T03:36:46.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.653+0000 7fbd7932b640 1 -- 172.21.15.146:0/1069403540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd741481d0 con 0x7fbd740cf370 2024-09-17T03:36:46.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.654+0000 7fbd7932b640 1 -- 172.21.15.146:0/1069403540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd7414a860 con 0x7fbd740cf370 2024-09-17T03:36:46.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.654+0000 7fbd5b7fe640 1 -- 172.21.15.146:0/1069403540 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd6801a070 con 0x7fbd740cf370 2024-09-17T03:36:46.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.655+0000 7fbd5b7fe640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd60078bc0 0x7fbd6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:46.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.655+0000 7fbd5b7fe640 1 -- 172.21.15.146:0/1069403540 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6053+0+0 (secure 0 0 0) 0x7fbd6809a100 con 0x7fbd740cf370 2024-09-17T03:36:46.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.655+0000 7fbd72ffd640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd60078bc0 0x7fbd6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:46.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.656+0000 7fbd72ffd640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd60078bc0 0x7fbd6007b0d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbd64006fd0 tx=0x7fbd64006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:46.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.659+0000 7fbd5b7fe640 1 -- 172.21.15.146:0/1069403540 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd68062470 con 0x7fbd740cf370 2024-09-17T03:36:46.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:46.872+0000 7fbd7932b640 1 -- 172.21.15.146:0/1069403540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbd741620f0 con 0x7fbd740cf370 2024-09-17T03:36:47.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.517+0000 7fbd5b7fe640 1 -- 172.21.15.146:0/1069403540 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) ==== 104+0+0 (secure 0 0 0) 0x7fbd68061d70 con 0x7fbd740cf370 2024-09-17T03:36:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 -- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd60078bc0 msgr2=0x7fbd6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd60078bc0 0x7fbd6007b0d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbd64006fd0 tx=0x7fbd64006bc0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 -- 172.21.15.146:0/1069403540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd740cf370 msgr2=0x7fbd740cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd740cf370 0x7fbd740cda70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800c420 tx=0x7fbd6800c8e0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 -- 172.21.15.146:0/1069403540 shutdown_connections 2024-09-17T03:36:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd60078bc0 0x7fbd6007b0d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd74163970 0x7fbd740cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd740cf370 0x7fbd740cda70 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 --2- 172.21.15.146:0/1069403540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd740b3870 0x7fbd7415b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 -- 172.21.15.146:0/1069403540 >> 172.21.15.146:0/1069403540 conn(0x7fbd740d4be0 msgr2=0x7fbd740b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:47.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 -- 172.21.15.146:0/1069403540 shutdown_connections 2024-09-17T03:36:47.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.520+0000 7fbd7932b640 1 -- 172.21.15.146:0/1069403540 wait complete. 2024-09-17T03:36:47.532 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:36:47.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.652+0000 7eff4af5e640 1 -- 172.21.15.146:0/304476552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff440cd840 msgr2=0x7eff440b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.652+0000 7eff4af5e640 1 --2- 172.21.15.146:0/304476552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff440cd840 0x7eff440b5680 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7eff44073030 tx=0x7eff3402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.652+0000 7eff4af5e640 1 -- 172.21.15.146:0/304476552 shutdown_connections 2024-09-17T03:36:47.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.652+0000 7eff4af5e640 1 --2- 172.21.15.146:0/304476552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff440cd840 0x7eff440b5680 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.652+0000 7eff4af5e640 1 --2- 172.21.15.146:0/304476552 >> v2:172.21.15.179:3300/0 conn(0x7eff4415c8e0 0x7eff4406f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.652+0000 7eff4af5e640 1 -- 172.21.15.146:0/304476552 >> 172.21.15.146:0/304476552 conn(0x7eff440b3150 msgr2=0x7eff440b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:47.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.652+0000 7eff4af5e640 1 -- 172.21.15.146:0/304476552 shutdown_connections 2024-09-17T03:36:47.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.652+0000 7eff4af5e640 1 -- 172.21.15.146:0/304476552 wait complete. 2024-09-17T03:36:47.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.653+0000 7eff4af5e640 1 Processor -- start 2024-09-17T03:36:47.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.653+0000 7eff4af5e640 1 -- start start 2024-09-17T03:36:47.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff4af5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440cd840 0x7eff44151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff4af5e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff440cdc50 0x7eff44159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff4af5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff4415c8e0 0x7eff441e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff4af5e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7eff44073580 con 0x7eff440cdc50 2024-09-17T03:36:47.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff4af5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7eff440b5e50 con 0x7eff440cd840 2024-09-17T03:36:47.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff4af5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7eff44073700 con 0x7eff4415c8e0 2024-09-17T03:36:47.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff440cdc50 0x7eff44159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff3bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff440cdc50 0x7eff44159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42626/0 (socket says 172.21.15.146:42626) 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff3bfff640 1 -- 172.21.15.146:0/803899540 learned_addr learned my addr 172.21.15.146:0/803899540 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff48cfa640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440cd840 0x7eff44151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff494fb640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff4415c8e0 0x7eff441e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff3bfff640 1 -- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff4415c8e0 msgr2=0x7eff441e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff3bfff640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff4415c8e0 0x7eff441e3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff3bfff640 1 -- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440cd840 msgr2=0x7eff44151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff3bfff640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440cd840 0x7eff44151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff3bfff640 1 -- 172.21.15.146:0/803899540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff44151850 con 0x7eff440cdc50 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff48cfa640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440cd840 0x7eff44151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.655+0000 7eff3bfff640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff440cdc50 0x7eff44159940 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7eff34034040 tx=0x7eff34003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.656+0000 7eff397fa640 1 -- 172.21.15.146:0/803899540 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3403e030 con 0x7eff440cdc50 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.656+0000 7eff397fa640 1 -- 172.21.15.146:0/803899540 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff34003e00 con 0x7eff440cdc50 2024-09-17T03:36:47.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.656+0000 7eff4af5e640 1 -- 172.21.15.146:0/803899540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff441f4910 con 0x7eff440cdc50 2024-09-17T03:36:47.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.656+0000 7eff397fa640 1 -- 172.21.15.146:0/803899540 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34035040 con 0x7eff440cdc50 2024-09-17T03:36:47.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.656+0000 7eff4af5e640 1 -- 172.21.15.146:0/803899540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff44159420 con 0x7eff440cdc50 2024-09-17T03:36:47.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.657+0000 7eff4af5e640 1 -- 172.21.15.146:0/803899540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff44158f30 con 0x7eff440cdc50 2024-09-17T03:36:47.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.657+0000 7eff397fa640 1 -- 172.21.15.146:0/803899540 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff34041030 con 0x7eff440cdc50 2024-09-17T03:36:47.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.658+0000 7eff397fa640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff30078bc0 0x7eff3007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:47.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.658+0000 7eff397fa640 1 -- 172.21.15.146:0/803899540 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6053+0+0 (secure 0 0 0) 0x7eff340bb680 con 0x7eff440cdc50 2024-09-17T03:36:47.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.658+0000 7eff48cfa640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff30078bc0 0x7eff3007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:47.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.658+0000 7eff48cfa640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff30078bc0 0x7eff3007b0d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7eff40005fd0 tx=0x7eff4000f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:47.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.662+0000 7eff397fa640 1 -- 172.21.15.146:0/803899540 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7eff34083970 con 0x7eff440cdc50 2024-09-17T03:36:47.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:47.838+0000 7eff4af5e640 1 -- 172.21.15.146:0/803899540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7eff44073b80 con 0x7eff440cdc50 2024-09-17T03:36:48.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.522+0000 7eff397fa640 1 -- 172.21.15.146:0/803899540 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v64) ==== 181+0+0 (secure 0 0 0) 0x7eff34083270 con 0x7eff440cdc50 2024-09-17T03:36:48.521 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:36:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.526+0000 7eff4af5e640 1 -- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff30078bc0 msgr2=0x7eff3007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.526+0000 7eff4af5e640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff30078bc0 0x7eff3007b0d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7eff40005fd0 tx=0x7eff4000f360 comp rx=0 tx=0).stop 2024-09-17T03:36:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.526+0000 7eff4af5e640 1 -- 172.21.15.146:0/803899540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff440cdc50 msgr2=0x7eff44159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.526+0000 7eff4af5e640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff440cdc50 0x7eff44159940 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7eff34034040 tx=0x7eff34003910 comp rx=0 tx=0).stop 2024-09-17T03:36:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.527+0000 7eff4af5e640 1 -- 172.21.15.146:0/803899540 shutdown_connections 2024-09-17T03:36:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.527+0000 7eff4af5e640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff30078bc0 0x7eff3007b0d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.527+0000 7eff4af5e640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7eff4415c8e0 0x7eff441e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.527+0000 7eff4af5e640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff440cdc50 0x7eff44159940 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.527+0000 7eff4af5e640 1 --2- 172.21.15.146:0/803899540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7eff440cd840 0x7eff44151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.527+0000 7eff4af5e640 1 -- 172.21.15.146:0/803899540 >> 172.21.15.146:0/803899540 conn(0x7eff440b3150 msgr2=0x7eff4415d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.527+0000 7eff4af5e640 1 -- 172.21.15.146:0/803899540 shutdown_connections 2024-09-17T03:36:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.527+0000 7eff4af5e640 1 -- 172.21.15.146:0/803899540 wait complete. 2024-09-17T03:36:48.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:36:48.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.661+0000 7f7a98c25640 1 -- 172.21.15.146:0/3164017974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a940b61f0 msgr2=0x7f7a940b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.661+0000 7f7a98c25640 1 --2- 172.21.15.146:0/3164017974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a940b61f0 0x7f7a940b6600 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c005fd0 tx=0x7f7a8c02a820 comp rx=0 tx=0).stop 2024-09-17T03:36:48.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.662+0000 7f7a98c25640 1 -- 172.21.15.146:0/3164017974 shutdown_connections 2024-09-17T03:36:48.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.662+0000 7f7a98c25640 1 --2- 172.21.15.146:0/3164017974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a940b61f0 0x7f7a940b6600 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.662+0000 7f7a98c25640 1 --2- 172.21.15.146:0/3164017974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a9415f1a0 0x7f7a940cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.662+0000 7f7a98c25640 1 -- 172.21.15.146:0/3164017974 >> 172.21.15.146:0/3164017974 conn(0x7f7a940d11f0 msgr2=0x7f7a940d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:48.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.662+0000 7f7a98c25640 1 -- 172.21.15.146:0/3164017974 shutdown_connections 2024-09-17T03:36:48.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.662+0000 7f7a98c25640 1 -- 172.21.15.146:0/3164017974 wait complete. 2024-09-17T03:36:48.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.663+0000 7f7a98c25640 1 Processor -- start 2024-09-17T03:36:48.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.664+0000 7f7a98c25640 1 -- start start 2024-09-17T03:36:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a98c25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a940b61f0 0x7f7a940cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a98c25640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9415f1a0 0x7f7a941e9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a98c25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a941631a0 0x7f7a940cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a98c25640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7a940695b0 con 0x7f7a9415f1a0 2024-09-17T03:36:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a98c25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7a94069430 con 0x7f7a941631a0 2024-09-17T03:36:48.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a98c25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7a94069730 con 0x7f7a940b61f0 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a91d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9415f1a0 0x7f7a941e9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a91d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9415f1a0 0x7f7a941e9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42634/0 (socket says 172.21.15.146:42634) 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a91d9b640 1 -- 172.21.15.146:0/3290217578 learned_addr learned my addr 172.21.15.146:0/3290217578 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a9259c640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a940b61f0 0x7f7a940cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a92d9d640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a941631a0 0x7f7a940cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a91d9b640 1 -- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a940b61f0 msgr2=0x7f7a940cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a91d9b640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a940b61f0 0x7f7a940cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a91d9b640 1 -- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a941631a0 msgr2=0x7f7a940cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a91d9b640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a941631a0 0x7f7a940cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a91d9b640 1 -- 172.21.15.146:0/3290217578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a940ce4f0 con 0x7f7a9415f1a0 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.665+0000 7f7a91d9b640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9415f1a0 0x7f7a941e9310 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c400 tx=0x7f7a8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.666+0000 7f7a82ffd640 1 -- 172.21.15.146:0/3290217578 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88017070 con 0x7f7a9415f1a0 2024-09-17T03:36:48.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.666+0000 7f7a82ffd640 1 -- 172.21.15.146:0/3290217578 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a880053c0 con 0x7f7a9415f1a0 2024-09-17T03:36:48.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.666+0000 7f7a98c25640 1 -- 172.21.15.146:0/3290217578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a940cea00 con 0x7f7a9415f1a0 2024-09-17T03:36:48.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.666+0000 7f7a82ffd640 1 -- 172.21.15.146:0/3290217578 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88003850 con 0x7f7a9415f1a0 2024-09-17T03:36:48.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.666+0000 7f7a98c25640 1 -- 172.21.15.146:0/3290217578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a940cbb30 con 0x7f7a9415f1a0 2024-09-17T03:36:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.667+0000 7f7a98c25640 1 -- 172.21.15.146:0/3290217578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a940ce770 con 0x7f7a9415f1a0 2024-09-17T03:36:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.667+0000 7f7a82ffd640 1 -- 172.21.15.146:0/3290217578 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a8801a070 con 0x7f7a9415f1a0 2024-09-17T03:36:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.668+0000 7f7a82ffd640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a74078b90 0x7f7a7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.668+0000 7f7a82ffd640 1 -- 172.21.15.146:0/3290217578 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5615+0+0 (secure 0 0 0) 0x7f7a8809a0e0 con 0x7f7a9415f1a0 2024-09-17T03:36:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.668+0000 7f7a9259c640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a74078b90 0x7f7a7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:48.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.669+0000 7f7a9259c640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a74078b90 0x7f7a7407b0a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7a84005fd0 tx=0x7f7a84009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:48.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.672+0000 7f7a82ffd640 1 -- 172.21.15.146:0/3290217578 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7a940b6b40 con 0x7f7a9415f1a0 2024-09-17T03:36:48.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:48.846+0000 7f7a98c25640 1 -- 172.21.15.146:0/3290217578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7a94069b90 con 0x7f7a9415f1a0 2024-09-17T03:36:49.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.524+0000 7f7a82ffd640 1 -- 172.21.15.146:0/3290217578 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v65) ==== 169+0+0 (secure 0 0 0) 0x7f7a88062580 con 0x7f7a9415f1a0 2024-09-17T03:36:49.523 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:36:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 -- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a74078b90 msgr2=0x7f7a7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a74078b90 0x7f7a7407b0a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7a84005fd0 tx=0x7f7a84009260 comp rx=0 tx=0).stop 2024-09-17T03:36:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 -- 172.21.15.146:0/3290217578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9415f1a0 msgr2=0x7f7a941e9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9415f1a0 0x7f7a941e9310 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c400 tx=0x7f7a8800c8c0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 -- 172.21.15.146:0/3290217578 shutdown_connections 2024-09-17T03:36:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a74078b90 0x7f7a7407b0a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a941631a0 0x7f7a940cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a9415f1a0 0x7f7a941e9310 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 --2- 172.21.15.146:0/3290217578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a940b61f0 0x7f7a940cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 -- 172.21.15.146:0/3290217578 >> 172.21.15.146:0/3290217578 conn(0x7f7a940d11f0 msgr2=0x7f7a94160e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:49.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 -- 172.21.15.146:0/3290217578 shutdown_connections 2024-09-17T03:36:49.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.527+0000 7f7a98c25640 1 -- 172.21.15.146:0/3290217578 wait complete. 2024-09-17T03:36:49.545 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:36:49.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.664+0000 7f184c3ba640 1 -- 172.21.15.146:0/987117599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440cd840 msgr2=0x7f18440b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.664+0000 7f184c3ba640 1 --2- 172.21.15.146:0/987117599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440cd840 0x7f18440b5680 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1844071500 tx=0x7f183402a560 comp rx=0 tx=0).stop 2024-09-17T03:36:49.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.664+0000 7f184c3ba640 1 -- 172.21.15.146:0/987117599 shutdown_connections 2024-09-17T03:36:49.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.664+0000 7f184c3ba640 1 --2- 172.21.15.146:0/987117599 >> v2:172.21.15.179:3300/0 conn(0x7f18440cdc50 0x7f18440b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.664+0000 7f184c3ba640 1 --2- 172.21.15.146:0/987117599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440cd840 0x7f18440b5680 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.664+0000 7f184c3ba640 1 -- 172.21.15.146:0/987117599 >> 172.21.15.146:0/987117599 conn(0x7f18440b3150 msgr2=0x7f18440b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:49.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.664+0000 7f184c3ba640 1 -- 172.21.15.146:0/987117599 shutdown_connections 2024-09-17T03:36:49.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.664+0000 7f184c3ba640 1 -- 172.21.15.146:0/987117599 wait complete. 2024-09-17T03:36:49.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.666+0000 7f184c3ba640 1 Processor -- start 2024-09-17T03:36:49.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.666+0000 7f184c3ba640 1 -- start start 2024-09-17T03:36:49.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.667+0000 7f184c3ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18440cd840 0x7f18441e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.667+0000 7f184c3ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440cdc50 0x7f1844140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.667+0000 7f184c3ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f184415c8e0 0x7f18441f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.667+0000 7f184c3ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1844073580 con 0x7f18440cdc50 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.667+0000 7f184c3ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f18440b53b0 con 0x7f184415c8e0 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.667+0000 7f184c3ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1844073700 con 0x7f18440cd840 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.667+0000 7f1849955640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440cdc50 0x7f1844140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.667+0000 7f1849955640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440cdc50 0x7f1844140bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42658/0 (socket says 172.21.15.146:42658) 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.667+0000 7f1849955640 1 -- 172.21.15.146:0/4135134316 learned_addr learned my addr 172.21.15.146:0/4135134316 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.667+0000 7f184a156640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18440cd840 0x7f18441e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.667+0000 7f184a957640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f184415c8e0 0x7f18441f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.668+0000 7f1849955640 1 -- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18440cd840 msgr2=0x7f18441e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.668+0000 7f1849955640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18440cd840 0x7f18441e3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.668+0000 7f1849955640 1 -- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f184415c8e0 msgr2=0x7f18441f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.668+0000 7f1849955640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f184415c8e0 0x7f18441f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.668+0000 7f1849955640 1 -- 172.21.15.146:0/4135134316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18441570e0 con 0x7f18440cdc50 2024-09-17T03:36:49.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.668+0000 7f1849955640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440cdc50 0x7f1844140bc0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f18340099c0 tx=0x7f18340039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:49.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.668+0000 7f183affd640 1 -- 172.21.15.146:0/4135134316 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183403e030 con 0x7f18440cdc50 2024-09-17T03:36:49.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.668+0000 7f183affd640 1 -- 172.21.15.146:0/4135134316 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18340047a0 con 0x7f18440cdc50 2024-09-17T03:36:49.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.668+0000 7f184c3ba640 1 -- 172.21.15.146:0/4135134316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18441573c0 con 0x7f18440cdc50 2024-09-17T03:36:49.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.668+0000 7f183affd640 1 -- 172.21.15.146:0/4135134316 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834035040 con 0x7f18440cdc50 2024-09-17T03:36:49.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.668+0000 7f184c3ba640 1 -- 172.21.15.146:0/4135134316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1844157980 con 0x7f18440cdc50 2024-09-17T03:36:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.669+0000 7f184c3ba640 1 -- 172.21.15.146:0/4135134316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1844073bb0 con 0x7f18440cdc50 2024-09-17T03:36:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.670+0000 7f183affd640 1 -- 172.21.15.146:0/4135134316 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1834041030 con 0x7f18440cdc50 2024-09-17T03:36:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.670+0000 7f183affd640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1828078bc0 0x7f182807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.671+0000 7f183affd640 1 -- 172.21.15.146:0/4135134316 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5201+0+0 (secure 0 0 0) 0x7f18340bb330 con 0x7f18440cdc50 2024-09-17T03:36:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.671+0000 7f184a156640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1828078bc0 0x7f182807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.671+0000 7f184a156640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1828078bc0 0x7f182807b0d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1840001e20 tx=0x7f1840009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:49.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.675+0000 7f183affd640 1 -- 172.21.15.146:0/4135134316 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1834083270 con 0x7f18440cdc50 2024-09-17T03:36:49.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.850+0000 7f184c3ba640 1 -- 172.21.15.146:0/4135134316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f184415bd40 con 0x7f18440cdc50 2024-09-17T03:36:49.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.854+0000 7f183affd640 1 -- 172.21.15.146:0/4135134316 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v42) ==== 71+0+0 (secure 0 0 0) 0x7f1834087ca0 con 0x7f18440cdc50 2024-09-17T03:36:49.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 -- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1828078bc0 msgr2=0x7f182807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1828078bc0 0x7f182807b0d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1840001e20 tx=0x7f1840009040 comp rx=0 tx=0).stop 2024-09-17T03:36:49.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 -- 172.21.15.146:0/4135134316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440cdc50 msgr2=0x7f1844140bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440cdc50 0x7f1844140bc0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f18340099c0 tx=0x7f18340039e0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 -- 172.21.15.146:0/4135134316 shutdown_connections 2024-09-17T03:36:49.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1828078bc0 0x7f182807b0d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f184415c8e0 0x7f18441f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440cdc50 0x7f1844140bc0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 --2- 172.21.15.146:0/4135134316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f18440cd840 0x7f18441e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 -- 172.21.15.146:0/4135134316 >> 172.21.15.146:0/4135134316 conn(0x7f18440b3150 msgr2=0x7f184415b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:49.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 -- 172.21.15.146:0/4135134316 shutdown_connections 2024-09-17T03:36:49.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.857+0000 7f184c3ba640 1 -- 172.21.15.146:0/4135134316 wait complete. 2024-09-17T03:36:49.867 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-17T03:36:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.981+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1029969262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb694004800 msgr2=0x7fb694004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.982+0000 7fb6af3cc640 1 --2- 172.21.15.146:0/1029969262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb694004800 0x7fb694004c10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fb69800c310 tx=0x7fb694005830 comp rx=0 tx=0).stop 2024-09-17T03:36:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.982+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1029969262 shutdown_connections 2024-09-17T03:36:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.982+0000 7fb6af3cc640 1 --2- 172.21.15.146:0/1029969262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb694004800 0x7fb694004c10 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.982+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1029969262 >> 172.21.15.146:0/1029969262 conn(0x7fb6a80d11f0 msgr2=0x7fb6a80d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.982+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1029969262 shutdown_connections 2024-09-17T03:36:49.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.982+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1029969262 wait complete. 2024-09-17T03:36:49.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.983+0000 7fb6af3cc640 1 Processor -- start 2024-09-17T03:36:49.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.983+0000 7fb6af3cc640 1 -- start start 2024-09-17T03:36:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6af3cc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb694004800 0x7fb6a80ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6af3cc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a815c110 0x7fb6a80cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6af3cc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a815ab50 0x7fb6a81f9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6af3cc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a80b6600 con 0x7fb6a815ab50 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6af3cc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a80d00c0 con 0x7fb694004800 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6af3cc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a80b6780 con 0x7fb6a815c110 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ad969640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a815ab50 0x7fb6a81f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ad969640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a815ab50 0x7fb6a81f9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42666/0 (socket says 172.21.15.146:42666) 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ad969640 1 -- 172.21.15.146:0/1664843880 learned_addr learned my addr 172.21.15.146:0/1664843880 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ad168640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb694004800 0x7fb6a80ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ac967640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a815c110 0x7fb6a80cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ad969640 1 -- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a815c110 msgr2=0x7fb6a80cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ad969640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a815c110 0x7fb6a80cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ad969640 1 -- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb694004800 msgr2=0x7fb6a80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ad969640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb694004800 0x7fb6a80ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ad969640 1 -- 172.21.15.146:0/1664843880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a80cd160 con 0x7fb6a815ab50 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ad168640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb694004800 0x7fb6a80ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:49.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ac967640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a815c110 0x7fb6a80cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6ad969640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a815ab50 0x7fb6a81f9280 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80d0870 tx=0x7fb6a0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb69dffb640 1 -- 172.21.15.146:0/1664843880 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0011870 con 0x7fb6a815ab50 2024-09-17T03:36:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb69dffb640 1 -- 172.21.15.146:0/1664843880 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6a0017070 con 0x7fb6a815ab50 2024-09-17T03:36:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1664843880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a8159ab0 con 0x7fb6a815ab50 2024-09-17T03:36:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.985+0000 7fb69dffb640 1 -- 172.21.15.146:0/1664843880 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0011dc0 con 0x7fb6a815ab50 2024-09-17T03:36:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.986+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1664843880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a815a070 con 0x7fb6a815ab50 2024-09-17T03:36:49.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.987+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1664843880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a80cef40 con 0x7fb6a815ab50 2024-09-17T03:36:49.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.987+0000 7fb69dffb640 1 -- 172.21.15.146:0/1664843880 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6a001c460 con 0x7fb6a815ab50 2024-09-17T03:36:49.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.988+0000 7fb69dffb640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb68c078bc0 0x7fb68c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:49.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.988+0000 7fb69dffb640 1 -- 172.21.15.146:0/1664843880 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5201+0+0 (secure 0 0 0) 0x7fb6a009b3f0 con 0x7fb6a815ab50 2024-09-17T03:36:49.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.988+0000 7fb6ad168640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb68c078bc0 0x7fb68c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:49.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.989+0000 7fb6ad168640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb68c078bc0 0x7fb68c07b0d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4005fd0 tx=0x7fb6a40113e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:49.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:49.993+0000 7fb69dffb640 1 -- 172.21.15.146:0/1664843880 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6a0063a20 con 0x7fb6a815ab50 2024-09-17T03:36:50.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.239+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1664843880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7fb6a815dd30 con 0x7fb6a815ab50 2024-09-17T03:36:50.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.541+0000 7fb69dffb640 1 -- 172.21.15.146:0/1664843880 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v194) ==== 151+0+0 (secure 0 0 0) 0x7fb6a0063320 con 0x7fb6a815ab50 2024-09-17T03:36:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb68c078bc0 msgr2=0x7fb68c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb68c078bc0 0x7fb68c07b0d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4005fd0 tx=0x7fb6a40113e0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1664843880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a815ab50 msgr2=0x7fb6a81f9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a815ab50 0x7fb6a81f9280 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80d0870 tx=0x7fb6a0001a70 comp rx=0 tx=0).stop 2024-09-17T03:36:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1664843880 shutdown_connections 2024-09-17T03:36:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb68c078bc0 0x7fb68c07b0d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a815ab50 0x7fb6a81f9280 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6a815c110 0x7fb6a80cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 --2- 172.21.15.146:0/1664843880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb694004800 0x7fb6a80ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1664843880 >> 172.21.15.146:0/1664843880 conn(0x7fb6a80d11f0 msgr2=0x7fb6a8069190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:50.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1664843880 shutdown_connections 2024-09-17T03:36:50.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.543+0000 7fb6af3cc640 1 -- 172.21.15.146:0/1664843880 wait complete. 2024-09-17T03:36:50.554 INFO:tasks.cephfs_test_runner:That a directory is merged during scrub. ... ok 2024-09-17T03:36:50.554 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T03:36:50.554 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:50.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.670+0000 7f01c6c20640 1 -- 172.21.15.146:0/3087959355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c015f1e0 msgr2=0x7f01c01515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.670+0000 7f01c6c20640 1 --2- 172.21.15.146:0/3087959355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c015f1e0 0x7f01c01515a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f01c00713a0 tx=0x7f01b802aa30 comp rx=0 tx=0).stop 2024-09-17T03:36:50.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.670+0000 7f01c6c20640 1 -- 172.21.15.146:0/3087959355 shutdown_connections 2024-09-17T03:36:50.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.670+0000 7f01c6c20640 1 --2- 172.21.15.146:0/3087959355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c015f1e0 0x7f01c01515a0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.670+0000 7f01c6c20640 1 --2- 172.21.15.146:0/3087959355 >> v2:172.21.15.179:3300/0 conn(0x7f01c00b3360 0x7f01c0072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.670+0000 7f01c6c20640 1 -- 172.21.15.146:0/3087959355 >> 172.21.15.146:0/3087959355 conn(0x7f01c00b2060 msgr2=0x7f01c00b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:50.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.670+0000 7f01c6c20640 1 -- 172.21.15.146:0/3087959355 shutdown_connections 2024-09-17T03:36:50.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.670+0000 7f01c6c20640 1 -- 172.21.15.146:0/3087959355 wait complete. 2024-09-17T03:36:50.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.672+0000 7f01c6c20640 1 Processor -- start 2024-09-17T03:36:50.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.672+0000 7f01c6c20640 1 -- start start 2024-09-17T03:36:50.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.673+0000 7f01c6c20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c00b3360 0x7f01c0146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.673+0000 7f01c6c20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01c00cfc40 0x7f01c014a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.673+0000 7f01c6c20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c014ab70 0x7f01c01492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.673+0000 7f01c6c20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f01c006e970 con 0x7f01c014ab70 2024-09-17T03:36:50.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.673+0000 7f01c6c20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f01c006e7f0 con 0x7f01c00cfc40 2024-09-17T03:36:50.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.673+0000 7f01c6c20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f01c006eaf0 con 0x7f01c00b3360 2024-09-17T03:36:50.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.673+0000 7f01c51bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c014ab70 0x7f01c01492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:50.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.673+0000 7f01c51bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c014ab70 0x7f01c01492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42686/0 (socket says 172.21.15.146:42686) 2024-09-17T03:36:50.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.673+0000 7f01c51bd640 1 -- 172.21.15.146:0/103687917 learned_addr learned my addr 172.21.15.146:0/103687917 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:50.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01bffff640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01c00cfc40 0x7f01c014a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:50.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01c49bc640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c00b3360 0x7f01c0146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:50.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01c51bd640 1 -- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c00b3360 msgr2=0x7f01c0146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01c51bd640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c00b3360 0x7f01c0146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01c51bd640 1 -- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01c00cfc40 msgr2=0x7f01c014a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01c51bd640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01c00cfc40 0x7f01c014a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01c51bd640 1 -- 172.21.15.146:0/103687917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c00acb20 con 0x7f01c014ab70 2024-09-17T03:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01c51bd640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c014ab70 0x7f01c01492c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009d60 tx=0x7f01b8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01bd7fa640 1 -- 172.21.15.146:0/103687917 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8033050 con 0x7f01c014ab70 2024-09-17T03:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01bd7fa640 1 -- 172.21.15.146:0/103687917 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01b8004450 con 0x7f01c014ab70 2024-09-17T03:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01c6c20640 1 -- 172.21.15.146:0/103687917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c014b320 con 0x7f01c014ab70 2024-09-17T03:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01bd7fa640 1 -- 172.21.15.146:0/103687917 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8038450 con 0x7f01c014ab70 2024-09-17T03:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.674+0000 7f01c6c20640 1 -- 172.21.15.146:0/103687917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c014bb40 con 0x7f01c014ab70 2024-09-17T03:36:50.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.675+0000 7f01c6c20640 1 -- 172.21.15.146:0/103687917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c0072df0 con 0x7f01c014ab70 2024-09-17T03:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.676+0000 7f01bd7fa640 1 -- 172.21.15.146:0/103687917 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01b8036070 con 0x7f01c014ab70 2024-09-17T03:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.676+0000 7f01bd7fa640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01a4078b90 0x7f01a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.677+0000 7f01bd7fa640 1 -- 172.21.15.146:0/103687917 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5201+0+0 (secure 0 0 0) 0x7f01b80bbf90 con 0x7f01c014ab70 2024-09-17T03:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.677+0000 7f01c49bc640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01a4078b90 0x7f01a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:50.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.677+0000 7f01c49bc640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01a4078b90 0x7f01a407b0a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f01b400bc50 tx=0x7f01b400b3e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:50.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.681+0000 7f01bd7fa640 1 -- 172.21.15.146:0/103687917 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01b8084000 con 0x7f01c014ab70 2024-09-17T03:36:50.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.861+0000 7f01c6c20640 1 -- 172.21.15.146:0/103687917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01c014b0b0 con 0x7f01c014ab70 2024-09-17T03:36:50.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.861+0000 7f01bd7fa640 1 -- 172.21.15.146:0/103687917 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+13470 (secure 0 0 0) 0x7f01b8088a30 con 0x7f01c014ab70 2024-09-17T03:36:50.861 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:50.861 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":65,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:36:49.522937+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6832/477965307":"2024-09-18T03:36:46.514644+0000","172.21.15.146:6832/3725156879":"2024-09-18T03:36:32.184525+0000","172.21.15.146:6835/6455506":"2024-09-18T03:36:31.969247+0000","172.21.15.146:6833/477965307":"2024-09-18T03:36:46.514644+0000","172.21.15.146:6833/6455506":"2024-09-18T03:36:31.969247+0000","172.21.15.179:6836/2016497882":"2024-09-18T03:36:31.958975+0000","172.21.15.146:6834/3725156879":"2024-09-18T03:36:32.184525+0000","172.21.15.179:6834/2016497882":"2024-09-18T03:36:31.958975+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.863+0000 7f01c6c20640 1 -- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01a4078b90 msgr2=0x7f01a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.863+0000 7f01c6c20640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01a4078b90 0x7f01a407b0a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f01b400bc50 tx=0x7f01b400b3e0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.863+0000 7f01c6c20640 1 -- 172.21.15.146:0/103687917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c014ab70 msgr2=0x7f01c01492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.863+0000 7f01c6c20640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c014ab70 0x7f01c01492c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009d60 tx=0x7f01b8003f10 comp rx=0 tx=0).stop 2024-09-17T03:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.864+0000 7f01c6c20640 1 -- 172.21.15.146:0/103687917 shutdown_connections 2024-09-17T03:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.864+0000 7f01c6c20640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01a4078b90 0x7f01a407b0a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.864+0000 7f01c6c20640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c014ab70 0x7f01c01492c0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.864+0000 7f01c6c20640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01c00cfc40 0x7f01c014a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.864+0000 7f01c6c20640 1 --2- 172.21.15.146:0/103687917 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01c00b3360 0x7f01c0146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.864+0000 7f01c6c20640 1 -- 172.21.15.146:0/103687917 >> 172.21.15.146:0/103687917 conn(0x7f01c00b2060 msgr2=0x7f01c00b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.864+0000 7f01c6c20640 1 -- 172.21.15.146:0/103687917 shutdown_connections 2024-09-17T03:36:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.864+0000 7f01c6c20640 1 -- 172.21.15.146:0/103687917 wait complete. 2024-09-17T03:36:50.874 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:36:50.874 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:36:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.991+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/2505757643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80b3b60 msgr2=0x7f1bb815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.991+0000 7f1bbe3c3640 1 --2- 172.21.15.146:0/2505757643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80b3b60 0x7f1bb815caa0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80b8440 tx=0x7f1bb002aa30 comp rx=0 tx=0).stop 2024-09-17T03:36:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.991+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/2505757643 shutdown_connections 2024-09-17T03:36:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.991+0000 7f1bbe3c3640 1 --2- 172.21.15.146:0/2505757643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80b3b60 0x7f1bb815caa0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.991+0000 7f1bbe3c3640 1 --2- 172.21.15.146:0/2505757643 >> v2:172.21.15.179:3300/0 conn(0x7f1bb80b5750 0x7f1bb80b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.991+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/2505757643 >> 172.21.15.146:0/2505757643 conn(0x7f1bb80b7b20 msgr2=0x7f1bb809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.992+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/2505757643 shutdown_connections 2024-09-17T03:36:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.992+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/2505757643 wait complete. 2024-09-17T03:36:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.993+0000 7f1bbe3c3640 1 Processor -- start 2024-09-17T03:36:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.993+0000 7f1bbe3c3640 1 -- start start 2024-09-17T03:36:50.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bbe3c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb80b3b60 0x7f1bb81523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bbe3c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80b5750 0x7f1bb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bbe3c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb80b5ce0 0x7f1bb806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bbe3c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb815d420 con 0x7f1bb80b5750 2024-09-17T03:36:50.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bbe3c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb815d2a0 con 0x7f1bb80b3b60 2024-09-17T03:36:50.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bbe3c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb815d5a0 con 0x7f1bb80b5ce0 2024-09-17T03:36:50.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80b5750 0x7f1bb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80b5750 0x7f1bb806edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42698/0 (socket says 172.21.15.146:42698) 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bb77fe640 1 -- 172.21.15.146:0/3587310031 learned_addr learned my addr 172.21.15.146:0/3587310031 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb80b3b60 0x7f1bb81523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bbc960640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb80b5ce0 0x7f1bb806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bb77fe640 1 -- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb80b5ce0 msgr2=0x7f1bb806f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb80b5ce0 0x7f1bb806f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bb77fe640 1 -- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb80b3b60 msgr2=0x7f1bb81523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb80b3b60 0x7f1bb81523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bb77fe640 1 -- 172.21.15.146:0/3587310031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb81f9200 con 0x7f1bb80b5750 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.995+0000 7f1bb77fe640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80b5750 0x7f1bb806edb0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000d720 tx=0x7f1ba000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.996+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/3587310031 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0017070 con 0x7f1bb80b5750 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.996+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/3587310031 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ba0009b10 con 0x7f1bb80b5750 2024-09-17T03:36:50.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.996+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/3587310031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb81f94e0 con 0x7f1bb80b5750 2024-09-17T03:36:50.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.996+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/3587310031 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0010460 con 0x7f1bb80b5750 2024-09-17T03:36:50.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.996+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/3587310031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb81f9aa0 con 0x7f1bb80b5750 2024-09-17T03:36:50.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.997+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/3587310031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb81f8f70 con 0x7f1bb80b5750 2024-09-17T03:36:50.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.997+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/3587310031 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ba001a070 con 0x7f1bb80b5750 2024-09-17T03:36:50.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.998+0000 7f1bb4ff9640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b98078b90 0x7f1b9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:50.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.998+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/3587310031 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5201+0+0 (secure 0 0 0) 0x7f1ba009ac40 con 0x7f1bb80b5750 2024-09-17T03:36:50.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.998+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b98078b90 0x7f1b9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:50.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:50.999+0000 7f1bb7fff640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b98078b90 0x7f1b9807b0a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80015a0 tx=0x7f1ba8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:51.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.003+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/3587310031 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ba0063390 con 0x7f1bb80b5750 2024-09-17T03:36:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.175+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/3587310031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1bb80b3620 con 0x7f1bb80b5750 2024-09-17T03:36:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.175+0000 7f1bb4ff9640 1 -- 172.21.15.146:0/3587310031 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) ==== 93+0+10 (secure 0 0 0) 0x7f1ba0062c90 con 0x7f1bb80b5750 2024-09-17T03:36:51.175 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:36:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.177+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b98078b90 msgr2=0x7f1b9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.177+0000 7f1bbe3c3640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b98078b90 0x7f1b9807b0a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80015a0 tx=0x7f1ba8009040 comp rx=0 tx=0).stop 2024-09-17T03:36:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.177+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/3587310031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80b5750 msgr2=0x7f1bb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.177+0000 7f1bbe3c3640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80b5750 0x7f1bb806edb0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000d720 tx=0x7f1ba000dbe0 comp rx=0 tx=0).stop 2024-09-17T03:36:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.177+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/3587310031 shutdown_connections 2024-09-17T03:36:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.177+0000 7f1bbe3c3640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b98078b90 0x7f1b9807b0a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.177+0000 7f1bbe3c3640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1bb80b5ce0 0x7f1bb806f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.177+0000 7f1bbe3c3640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bb80b5750 0x7f1bb806edb0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.177+0000 7f1bbe3c3640 1 --2- 172.21.15.146:0/3587310031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1bb80b3b60 0x7f1bb81523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.178+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/3587310031 >> 172.21.15.146:0/3587310031 conn(0x7f1bb80b7b20 msgr2=0x7f1bb8070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.178+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/3587310031 shutdown_connections 2024-09-17T03:36:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.178+0000 7f1bbe3c3640 1 -- 172.21.15.146:0/3587310031 wait complete. 2024-09-17T03:36:51.188 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-17T03:36:51.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.302+0000 7f151989b640 1 -- 172.21.15.146:0/4163931875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15141620f0 msgr2=0x7f151406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:51.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.302+0000 7f151989b640 1 --2- 172.21.15.146:0/4163931875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15141620f0 0x7f151406ed30 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f15140b73c0 tx=0x7f14fc02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:36:51.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.302+0000 7f151989b640 1 -- 172.21.15.146:0/4163931875 shutdown_connections 2024-09-17T03:36:51.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.302+0000 7f151989b640 1 --2- 172.21.15.146:0/4163931875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15141620f0 0x7f151406ed30 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:51.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.302+0000 7f151989b640 1 --2- 172.21.15.146:0/4163931875 >> v2:172.21.15.179:3300/0 conn(0x7f15140b3870 0x7f15140cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:51.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.302+0000 7f151989b640 1 -- 172.21.15.146:0/4163931875 >> 172.21.15.146:0/4163931875 conn(0x7f15140d4be0 msgr2=0x7f15140d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:51.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.302+0000 7f151989b640 1 -- 172.21.15.146:0/4163931875 shutdown_connections 2024-09-17T03:36:51.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.302+0000 7f151989b640 1 -- 172.21.15.146:0/4163931875 wait complete. 2024-09-17T03:36:51.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.304+0000 7f151989b640 1 Processor -- start 2024-09-17T03:36:51.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.304+0000 7f151989b640 1 -- start start 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.305+0000 7f151989b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151406f270 0x7f15140cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.305+0000 7f151989b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15140b3870 0x7f1514159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.305+0000 7f151989b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15141620f0 0x7f15140cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.305+0000 7f151989b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1514162670 con 0x7f151406f270 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.305+0000 7f151989b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f15140d43b0 con 0x7f15140b3870 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.305+0000 7f151989b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1514162fb0 con 0x7f15141620f0 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.305+0000 7f1512ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151406f270 0x7f15140cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.305+0000 7f1512ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151406f270 0x7f15140cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42728/0 (socket says 172.21.15.146:42728) 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.305+0000 7f1512ffd640 1 -- 172.21.15.146:0/1017718037 learned_addr learned my addr 172.21.15.146:0/1017718037 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.305+0000 7f150a7fc640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15140b3870 0x7f1514159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.305+0000 7f15137fe640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15141620f0 0x7f15140cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:51.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f1512ffd640 1 -- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15141620f0 msgr2=0x7f15140cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f1512ffd640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15141620f0 0x7f15140cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f1512ffd640 1 -- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15140b3870 msgr2=0x7f1514159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f1512ffd640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15140b3870 0x7f1514159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f1512ffd640 1 -- 172.21.15.146:0/1017718037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15140ce8d0 con 0x7f151406f270 2024-09-17T03:36:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f15137fe640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15141620f0 0x7f15140cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f1512ffd640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151406f270 0x7f15140cad50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f150400d6d0 tx=0x7f150400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f1510ff9640 1 -- 172.21.15.146:0/1017718037 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504017070 con 0x7f151406f270 2024-09-17T03:36:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f1510ff9640 1 -- 172.21.15.146:0/1017718037 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1504005330 con 0x7f151406f270 2024-09-17T03:36:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f151989b640 1 -- 172.21.15.146:0/1017718037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15140cebb0 con 0x7f151406f270 2024-09-17T03:36:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f1510ff9640 1 -- 172.21.15.146:0/1017718037 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504009820 con 0x7f151406f270 2024-09-17T03:36:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.306+0000 7f151989b640 1 -- 172.21.15.146:0/1017718037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15140b45d0 con 0x7f151406f270 2024-09-17T03:36:51.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.307+0000 7f151989b640 1 -- 172.21.15.146:0/1017718037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15140ba6d0 con 0x7f151406f270 2024-09-17T03:36:51.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.308+0000 7f1510ff9640 1 -- 172.21.15.146:0/1017718037 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1504009bd0 con 0x7f151406f270 2024-09-17T03:36:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.308+0000 7f1510ff9640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14f4078bc0 0x7f14f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.308+0000 7f1510ff9640 1 -- 172.21.15.146:0/1017718037 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5201+0+0 (secure 0 0 0) 0x7f150409ae60 con 0x7f151406f270 2024-09-17T03:36:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.308+0000 7f150a7fc640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14f4078bc0 0x7f14f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.309+0000 7f150a7fc640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14f4078bc0 0x7f14f407b0d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f14fc033000 tx=0x7f14fc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:51.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.313+0000 7f1510ff9640 1 -- 172.21.15.146:0/1017718037 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f15140ba6d0 con 0x7f151406f270 2024-09-17T03:36:51.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:51.554+0000 7f151989b640 1 -- 172.21.15.146:0/1017718037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f151415f000 con 0x7f151406f270 2024-09-17T03:36:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.547+0000 7f1510ff9640 1 -- 172.21.15.146:0/1017718037 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v196) ==== 146+0+0 (secure 0 0 0) 0x7f151415f000 con 0x7f151406f270 2024-09-17T03:36:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.550+0000 7f151989b640 1 -- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14f4078bc0 msgr2=0x7f14f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.550+0000 7f151989b640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14f4078bc0 0x7f14f407b0d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f14fc033000 tx=0x7f14fc004730 comp rx=0 tx=0).stop 2024-09-17T03:36:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.550+0000 7f151989b640 1 -- 172.21.15.146:0/1017718037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151406f270 msgr2=0x7f15140cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.550+0000 7f151989b640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151406f270 0x7f15140cad50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f150400d6d0 tx=0x7f150400db90 comp rx=0 tx=0).stop 2024-09-17T03:36:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.550+0000 7f151989b640 1 -- 172.21.15.146:0/1017718037 shutdown_connections 2024-09-17T03:36:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.550+0000 7f151989b640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14f4078bc0 0x7f14f407b0d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.550+0000 7f151989b640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15141620f0 0x7f15140cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.550+0000 7f151989b640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15140b3870 0x7f1514159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.550+0000 7f151989b640 1 --2- 172.21.15.146:0/1017718037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f151406f270 0x7f15140cad50 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.550+0000 7f151989b640 1 -- 172.21.15.146:0/1017718037 >> 172.21.15.146:0/1017718037 conn(0x7f15140d4be0 msgr2=0x7f15140b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:52.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.551+0000 7f151989b640 1 -- 172.21.15.146:0/1017718037 shutdown_connections 2024-09-17T03:36:52.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.551+0000 7f151989b640 1 -- 172.21.15.146:0/1017718037 wait complete. 2024-09-17T03:36:52.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:36:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.684+0000 7fc15b0d3640 1 -- 172.21.15.146:0/357145037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc13c003a00 msgr2=0x7fc13c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.684+0000 7fc15b0d3640 1 --2- 172.21.15.146:0/357145037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc13c003a00 0x7fc13c003e70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc150009b50 tx=0x7fc13c005830 comp rx=0 tx=0).stop 2024-09-17T03:36:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.684+0000 7fc159670640 1 -- 172.21.15.146:0/357145037 reap_dead start 2024-09-17T03:36:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.684+0000 7fc15b0d3640 1 -- 172.21.15.146:0/357145037 shutdown_connections 2024-09-17T03:36:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.684+0000 7fc15b0d3640 1 -- 172.21.15.146:0/357145037 >> 172.21.15.146:0/357145037 conn(0x7fc1540b7b20 msgr2=0x7fc15409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.685+0000 7fc15b0d3640 1 -- 172.21.15.146:0/357145037 shutdown_connections 2024-09-17T03:36:52.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.685+0000 7fc15b0d3640 1 -- 172.21.15.146:0/357145037 wait complete. 2024-09-17T03:36:52.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.686+0000 7fc15b0d3640 1 Processor -- start 2024-09-17T03:36:52.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.686+0000 7fc15b0d3640 1 -- start start 2024-09-17T03:36:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc15b0d3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc13c003a00 0x7fc15409c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc15b0d3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1541461c0 0x7fc154142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc15b0d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc154143480 0x7fc15406ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc15b0d3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc1540b1920 con 0x7fc154143480 2024-09-17T03:36:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc15b0d3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc1540b17a0 con 0x7fc13c003a00 2024-09-17T03:36:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc15b0d3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc15415cfe0 con 0x7fc1541461c0 2024-09-17T03:36:52.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc159670640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc154143480 0x7fc15406ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc159670640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc154143480 0x7fc15406ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42750/0 (socket says 172.21.15.146:42750) 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc159670640 1 -- 172.21.15.146:0/947219649 learned_addr learned my addr 172.21.15.146:0/947219649 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc14bfff640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1541461c0 0x7fc154142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc158e6f640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc13c003a00 0x7fc15409c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc159670640 1 -- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1541461c0 msgr2=0x7fc154142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc159670640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1541461c0 0x7fc154142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc159670640 1 -- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc13c003a00 msgr2=0x7fc15409c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc159670640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc13c003a00 0x7fc15409c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc159670640 1 -- 172.21.15.146:0/947219649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15409cda0 con 0x7fc154143480 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc158e6f640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc13c003a00 0x7fc15409c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc159670640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc154143480 0x7fc15406ef30 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc14c005fd0 tx=0x7fc14c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc1497fa640 1 -- 172.21.15.146:0/947219649 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c004b20 con 0x7fc154143480 2024-09-17T03:36:52.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.689+0000 7fc15b0d3640 1 -- 172.21.15.146:0/947219649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15406de90 con 0x7fc154143480 2024-09-17T03:36:52.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.688+0000 7fc1497fa640 1 -- 172.21.15.146:0/947219649 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc14c004cc0 con 0x7fc154143480 2024-09-17T03:36:52.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.689+0000 7fc1497fa640 1 -- 172.21.15.146:0/947219649 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c003bd0 con 0x7fc154143480 2024-09-17T03:36:52.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.689+0000 7fc15b0d3640 1 -- 172.21.15.146:0/947219649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15406e450 con 0x7fc154143480 2024-09-17T03:36:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.689+0000 7fc15b0d3640 1 -- 172.21.15.146:0/947219649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15415caa0 con 0x7fc154143480 2024-09-17T03:36:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.690+0000 7fc1497fa640 1 -- 172.21.15.146:0/947219649 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc14c004030 con 0x7fc154143480 2024-09-17T03:36:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.691+0000 7fc1497fa640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc140078b90 0x7fc14007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.691+0000 7fc1497fa640 1 -- 172.21.15.146:0/947219649 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5201+0+0 (secure 0 0 0) 0x7fc14c09ba30 con 0x7fc154143480 2024-09-17T03:36:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.691+0000 7fc158e6f640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc140078b90 0x7fc14007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:52.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.692+0000 7fc158e6f640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc140078b90 0x7fc14007b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc150009b50 tx=0x7fc15002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:52.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.695+0000 7fc1497fa640 1 -- 172.21.15.146:0/947219649 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc14c01f060 con 0x7fc154143480 2024-09-17T03:36:52.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.869+0000 7fc15b0d3640 1 -- 172.21.15.146:0/947219649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc1540b2bd0 con 0x7fc154143480 2024-09-17T03:36:52.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.870+0000 7fc1497fa640 1 -- 172.21.15.146:0/947219649 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v42) ==== 59+0+2294 (secure 0 0 0) 0x7fc14c0640f0 con 0x7fc154143480 2024-09-17T03:36:52.869 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:36:52.869 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:36:52.870 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:36:52.871 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:36:52.872 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:36:52.872 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:36:52.872 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:36:52.872 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:36:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 -- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc140078b90 msgr2=0x7fc14007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc140078b90 0x7fc14007b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc150009b50 tx=0x7fc15002d040 comp rx=0 tx=0).stop 2024-09-17T03:36:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 -- 172.21.15.146:0/947219649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc154143480 msgr2=0x7fc15406ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc154143480 0x7fc15406ef30 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc14c005fd0 tx=0x7fc14c011f80 comp rx=0 tx=0).stop 2024-09-17T03:36:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 -- 172.21.15.146:0/947219649 shutdown_connections 2024-09-17T03:36:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc140078b90 0x7fc14007b0a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc154143480 0x7fc15406ef30 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc1541461c0 0x7fc154142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 --2- 172.21.15.146:0/947219649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc13c003a00 0x7fc15409c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 -- 172.21.15.146:0/947219649 >> 172.21.15.146:0/947219649 conn(0x7fc1540b7b20 msgr2=0x7fc1540b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 -- 172.21.15.146:0/947219649 shutdown_connections 2024-09-17T03:36:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.872+0000 7fc15b0d3640 1 -- 172.21.15.146:0/947219649 wait complete. 2024-09-17T03:36:52.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:36:52.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.999+0000 7ffb12cf9640 1 -- 172.21.15.146:0/164759383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c0b5750 msgr2=0x7ffb0c0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:52.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.999+0000 7ffb12cf9640 1 --2- 172.21.15.146:0/164759383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c0b5750 0x7ffb0c0b3620 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ffafc005fd0 tx=0x7ffafc02a540 comp rx=0 tx=0).stop 2024-09-17T03:36:52.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.999+0000 7ffb12cf9640 1 -- 172.21.15.146:0/164759383 shutdown_connections 2024-09-17T03:36:52.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.999+0000 7ffb12cf9640 1 --2- 172.21.15.146:0/164759383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c0b5750 0x7ffb0c0b3620 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:52.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.999+0000 7ffb12cf9640 1 -- 172.21.15.146:0/164759383 >> 172.21.15.146:0/164759383 conn(0x7ffb0c0b7b20 msgr2=0x7ffb0c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:52.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.999+0000 7ffb12cf9640 1 -- 172.21.15.146:0/164759383 shutdown_connections 2024-09-17T03:36:52.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:52.999+0000 7ffb12cf9640 1 -- 172.21.15.146:0/164759383 wait complete. 2024-09-17T03:36:53.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.001+0000 7ffb12cf9640 1 Processor -- start 2024-09-17T03:36:53.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.001+0000 7ffb12cf9640 1 -- start start 2024-09-17T03:36:53.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.002+0000 7ffb12cf9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb0c0b3b60 0x7ffb0c1f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.002+0000 7ffb12cf9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb0c0b5750 0x7ffb0c158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.002+0000 7ffb12cf9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c0b5ce0 0x7ffb0c1f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.002+0000 7ffb12cf9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c15d650 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.002+0000 7ffb12cf9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0c15d4d0 con 0x7ffb0c0b3b60 2024-09-17T03:36:53.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.002+0000 7ffb12cf9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0c15d7d0 con 0x7ffb0c0b5750 2024-09-17T03:36:53.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.002+0000 7ffb11296640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c0b5ce0 0x7ffb0c1f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.002+0000 7ffb11296640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c0b5ce0 0x7ffb0c1f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42774/0 (socket says 172.21.15.146:42774) 2024-09-17T03:36:53.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.002+0000 7ffb11296640 1 -- 172.21.15.146:0/2405861714 learned_addr learned my addr 172.21.15.146:0/2405861714 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:53.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb03fff640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb0c0b5750 0x7ffb0c158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb10a95640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb0c0b3b60 0x7ffb0c1f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb11296640 1 -- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb0c0b5750 msgr2=0x7ffb0c158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb11296640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb0c0b5750 0x7ffb0c158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb11296640 1 -- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb0c0b3b60 msgr2=0x7ffb0c1f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb11296640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb0c0b3b60 0x7ffb0c1f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb11296640 1 -- 172.21.15.146:0/2405861714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0c1f84d0 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb10a95640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb0c0b3b60 0x7ffb0c1f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb11296640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c0b5ce0 0x7ffb0c1f0f20 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400b9e0 tx=0x7ffb0400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb017fa640 1 -- 172.21.15.146:0/2405861714 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04003b70 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb017fa640 1 -- 172.21.15.146:0/2405861714 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb04003e00 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb12cf9640 1 -- 172.21.15.146:0/2405861714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0c1f43e0 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb017fa640 1 -- 172.21.15.146:0/2405861714 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400cb80 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.003+0000 7ffb12cf9640 1 -- 172.21.15.146:0/2405861714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb0c1f49a0 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.004+0000 7ffb12cf9640 1 -- 172.21.15.146:0/2405861714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb0c1f4150 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.005+0000 7ffb017fa640 1 -- 172.21.15.146:0/2405861714 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb04004000 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.005+0000 7ffb017fa640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffaf8078b90 0x7ffaf807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.006+0000 7ffb017fa640 1 -- 172.21.15.146:0/2405861714 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5201+0+0 (secure 0 0 0) 0x7ffb0409a9d0 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.006+0000 7ffb10a95640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffaf8078b90 0x7ffaf807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.006+0000 7ffb10a95640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffaf8078b90 0x7ffaf807b0a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffb08007fd0 tx=0x7ffb08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:53.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.010+0000 7ffb017fa640 1 -- 172.21.15.146:0/2405861714 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffb0c1f84d0 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.184+0000 7ffb12cf9640 1 -- 172.21.15.146:0/2405861714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ffb0c15dd30 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.187+0000 7ffb017fa640 1 -- 172.21.15.146:0/2405861714 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v43)=0 v43) ==== 122+0+0 (secure 0 0 0) 0x7ffb04062930 con 0x7ffb0c0b5ce0 2024-09-17T03:36:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 -- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffaf8078b90 msgr2=0x7ffaf807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffaf8078b90 0x7ffaf807b0a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ffb08007fd0 tx=0x7ffb08009040 comp rx=0 tx=0).stop 2024-09-17T03:36:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 -- 172.21.15.146:0/2405861714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c0b5ce0 msgr2=0x7ffb0c1f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c0b5ce0 0x7ffb0c1f0f20 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400b9e0 tx=0x7ffb0400bea0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 -- 172.21.15.146:0/2405861714 shutdown_connections 2024-09-17T03:36:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffaf8078b90 0x7ffaf807b0a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb0c0b5ce0 0x7ffb0c1f0f20 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb0c0b5750 0x7ffb0c158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 --2- 172.21.15.146:0/2405861714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb0c0b3b60 0x7ffb0c1f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 -- 172.21.15.146:0/2405861714 >> 172.21.15.146:0/2405861714 conn(0x7ffb0c0b7b20 msgr2=0x7ffb0c09bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 -- 172.21.15.146:0/2405861714 shutdown_connections 2024-09-17T03:36:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.190+0000 7ffb12cf9640 1 -- 172.21.15.146:0/2405861714 wait complete. 2024-09-17T03:36:53.200 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:36:53.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:36:53.238 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:36:53.298 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:36:53.298 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:53.298 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:53.314 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:36:53.314 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:36:53.314 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:53.332 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:36:53.332 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:36:53.332 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:53.369 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:36:53.369 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:36:53.369 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:36:53.390 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:36:53.390 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:36:53.390 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:36:53.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.523+0000 7f4995a39640 1 -- 172.21.15.146:0/1139694813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499006f440 msgr2=0x7f4990169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.523+0000 7f4995a39640 1 --2- 172.21.15.146:0/1139694813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499006f440 0x7f4990169c10 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4988005fd0 tx=0x7f498802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.523+0000 7f4995a39640 1 -- 172.21.15.146:0/1139694813 shutdown_connections 2024-09-17T03:36:53.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.523+0000 7f4995a39640 1 --2- 172.21.15.146:0/1139694813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499006f440 0x7f4990169c10 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.523+0000 7f4995a39640 1 -- 172.21.15.146:0/1139694813 >> 172.21.15.146:0/1139694813 conn(0x7f49900d4be0 msgr2=0x7f49900d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:53.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.523+0000 7f4995a39640 1 -- 172.21.15.146:0/1139694813 shutdown_connections 2024-09-17T03:36:53.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.523+0000 7f4995a39640 1 -- 172.21.15.146:0/1139694813 wait complete. 2024-09-17T03:36:53.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.525+0000 7f4995a39640 1 Processor -- start 2024-09-17T03:36:53.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.525+0000 7f4995a39640 1 -- start start 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.526+0000 7f4995a39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49900b3870 0x7f499015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.526+0000 7f4995a39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49900cf370 0x7f49900caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.526+0000 7f4995a39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49900cb000 0x7f49900c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.526+0000 7f4995a39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f499016a2d0 con 0x7f49900cf370 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.526+0000 7f4995a39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f499016a150 con 0x7f49900b3870 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.526+0000 7f4995a39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f499016a450 con 0x7f49900cb000 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f498e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49900cf370 0x7f49900caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f498e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49900cf370 0x7f49900caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42790/0 (socket says 172.21.15.146:42790) 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f498e7fc640 1 -- 172.21.15.146:0/613360303 learned_addr learned my addr 172.21.15.146:0/613360303 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f498effd640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49900b3870 0x7f499015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f498f7fe640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49900cb000 0x7f49900c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f498e7fc640 1 -- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49900cb000 msgr2=0x7f49900c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f498e7fc640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49900cb000 0x7f49900c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f498e7fc640 1 -- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49900b3870 msgr2=0x7f499015adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f498e7fc640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49900b3870 0x7f499015adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f498e7fc640 1 -- 172.21.15.146:0/613360303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49900b5540 con 0x7f49900cf370 2024-09-17T03:36:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f498e7fc640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49900cf370 0x7f49900caac0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f498400c370 tx=0x7f498400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f4977fff640 1 -- 172.21.15.146:0/613360303 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4984017070 con 0x7f49900cf370 2024-09-17T03:36:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f4977fff640 1 -- 172.21.15.146:0/613360303 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49840035f0 con 0x7f49900cf370 2024-09-17T03:36:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f4995a39640 1 -- 172.21.15.146:0/613360303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49900b5820 con 0x7f49900cf370 2024-09-17T03:36:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f4977fff640 1 -- 172.21.15.146:0/613360303 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4984003a40 con 0x7f49900cf370 2024-09-17T03:36:53.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.527+0000 7f4995a39640 1 -- 172.21.15.146:0/613360303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49900b5de0 con 0x7f49900cf370 2024-09-17T03:36:53.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.528+0000 7f4995a39640 1 -- 172.21.15.146:0/613360303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49901620f0 con 0x7f49900cf370 2024-09-17T03:36:53.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.529+0000 7f4977fff640 1 -- 172.21.15.146:0/613360303 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f498401a070 con 0x7f49900cf370 2024-09-17T03:36:53.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.530+0000 7f4977fff640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f497c078bc0 0x7f497c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.530+0000 7f4977fff640 1 -- 172.21.15.146:0/613360303 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5201+0+0 (secure 0 0 0) 0x7f4984099c00 con 0x7f49900cf370 2024-09-17T03:36:53.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.530+0000 7f498effd640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f497c078bc0 0x7f497c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.531+0000 7f498effd640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f497c078bc0 0x7f497c07b0d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4980000f60 tx=0x7f4980009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:53.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.535+0000 7f4977fff640 1 -- 172.21.15.146:0/613360303 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f49840a0080 con 0x7f49900cf370 2024-09-17T03:36:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.746+0000 7f4995a39640 1 -- 172.21.15.146:0/613360303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f499015f2b0 con 0x7f49900cf370 2024-09-17T03:36:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.746+0000 7f4977fff640 1 -- 172.21.15.146:0/613360303 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3914 (secure 0 0 0) 0x7f4984061d00 con 0x7f49900cf370 2024-09-17T03:36:53.746 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:53.746 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":40,"btime":"2024-09-17T03:36:47:516484+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3651488273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3651488273},{"type":"v1","addr":"172.21.15.179:6835","nonce":3651488273}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5753,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/497091008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":497091008},{"type":"v1","addr":"172.21.15.179:6837","nonce":497091008}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2037796810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2037796810},{"type":"v1","addr":"172.21.15.146:6835","nonce":2037796810}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6765,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/34515174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":34515174},{"type":"v1","addr":"172.21.15.146:6833","nonce":34515174}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[]} 2024-09-17T03:36:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 40 2024-09-17T03:36:53.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.748+0000 7f4995a39640 1 -- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f497c078bc0 msgr2=0x7f497c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.748+0000 7f4995a39640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f497c078bc0 0x7f497c07b0d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4980000f60 tx=0x7f4980009040 comp rx=0 tx=0).stop 2024-09-17T03:36:53.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.748+0000 7f4995a39640 1 -- 172.21.15.146:0/613360303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49900cf370 msgr2=0x7f49900caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.748+0000 7f4995a39640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49900cf370 0x7f49900caac0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f498400c370 tx=0x7f498400c830 comp rx=0 tx=0).stop 2024-09-17T03:36:53.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.748+0000 7f4995a39640 1 -- 172.21.15.146:0/613360303 shutdown_connections 2024-09-17T03:36:53.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.748+0000 7f4995a39640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f497c078bc0 0x7f497c07b0d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.748+0000 7f4995a39640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49900cb000 0x7f49900c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.748+0000 7f4995a39640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49900cf370 0x7f49900caac0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.749+0000 7f4995a39640 1 --2- 172.21.15.146:0/613360303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49900b3870 0x7f499015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.749+0000 7f4995a39640 1 -- 172.21.15.146:0/613360303 >> 172.21.15.146:0/613360303 conn(0x7f49900d4be0 msgr2=0x7f4990160f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:53.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.749+0000 7f4995a39640 1 -- 172.21.15.146:0/613360303 shutdown_connections 2024-09-17T03:36:53.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.749+0000 7f4995a39640 1 -- 172.21.15.146:0/613360303 wait complete. 2024-09-17T03:36:53.759 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:36:53.759 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:36:53.759 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:36:53.760 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:53.760 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:36:53.760 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:36:53.760 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:36:53.760 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:53.760 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:36:53.760 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:36:53.761 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:36:53.761 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:53.761 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:36:53.761 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:36:53.761 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:36:53.761 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:36:53.770 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:36:53.770 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:36:53.772 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:36:53.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:36:53.773 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:36:53.773 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:36:53.774 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:36:53.774 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:36:53.813 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:36:53.814 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:53.815 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:36:53.816 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:53.816 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:36:53.816 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:53.817 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:36:53.817 DEBUG:teuthology.parallel:result is None 2024-09-17T03:36:53.817 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:36:53.901 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:36:53.902 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:36:53.908 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:36:53.908 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:36:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.939+0000 7f2ff7189640 1 -- 172.21.15.146:0/768045947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff006dd60 msgr2=0x7f2ff006e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.939+0000 7f2ff7189640 1 --2- 172.21.15.146:0/768045947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff006dd60 0x7f2ff006e170 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8005fd0 tx=0x7f2fe802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.939+0000 7f2ff7189640 1 -- 172.21.15.146:0/768045947 shutdown_connections 2024-09-17T03:36:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.939+0000 7f2ff7189640 1 --2- 172.21.15.146:0/768045947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff006dd60 0x7f2ff006e170 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.939+0000 7f2ff7189640 1 --2- 172.21.15.146:0/768045947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff00b55f0 0x7f2ff0070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.939+0000 7f2ff7189640 1 -- 172.21.15.146:0/768045947 >> 172.21.15.146:0/768045947 conn(0x7f2ff00b3410 msgr2=0x7f2ff00b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.939+0000 7f2ff7189640 1 -- 172.21.15.146:0/768045947 shutdown_connections 2024-09-17T03:36:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.939+0000 7f2ff7189640 1 -- 172.21.15.146:0/768045947 wait complete. 2024-09-17T03:36:53.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.941+0000 7f2ff7189640 1 Processor -- start 2024-09-17T03:36:53.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.941+0000 7f2ff7189640 1 -- start start 2024-09-17T03:36:53.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff7189640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ff006dd60 0x7f2ff014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff7189640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff0071120 0x7f2ff014d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff7189640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff00b55f0 0x7f2ff0150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff7189640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff015be90 con 0x7f2ff006dd60 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff7189640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff015bd10 con 0x7f2ff0071120 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff7189640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff015c010 con 0x7f2ff00b55f0 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff4f25640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ff006dd60 0x7f2ff014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff4f25640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ff006dd60 0x7f2ff014f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42838/0 (socket says 172.21.15.146:42838) 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff4f25640 1 -- 172.21.15.146:0/3195281924 learned_addr learned my addr 172.21.15.146:0/3195281924 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff5726640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff00b55f0 0x7f2ff0150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff4f25640 1 -- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff00b55f0 msgr2=0x7f2ff0150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff4f25640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff00b55f0 0x7f2ff0150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff4f25640 1 -- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff0071120 msgr2=0x7f2ff014d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff4f25640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff0071120 0x7f2ff014d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff4f25640 1 -- 172.21.15.146:0/3195281924 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff014da20 con 0x7f2ff006dd60 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2ff4f25640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ff006dd60 0x7f2ff014f760 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400e790 tx=0x7f2fe400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2fed7fa640 1 -- 172.21.15.146:0/3195281924 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400eea0 con 0x7f2ff006dd60 2024-09-17T03:36:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2fed7fa640 1 -- 172.21.15.146:0/3195281924 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fe400cdb0 con 0x7f2ff006dd60 2024-09-17T03:36:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.943+0000 7f2fed7fa640 1 -- 172.21.15.146:0/3195281924 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4010690 con 0x7f2ff006dd60 2024-09-17T03:36:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.944+0000 7f2ff7189640 1 -- 172.21.15.146:0/3195281924 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff014fff0 con 0x7f2ff006dd60 2024-09-17T03:36:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.944+0000 7f2ff7189640 1 -- 172.21.15.146:0/3195281924 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff0153320 con 0x7f2ff006dd60 2024-09-17T03:36:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.945+0000 7f2ff7189640 1 -- 172.21.15.146:0/3195281924 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff0070be0 con 0x7f2ff006dd60 2024-09-17T03:36:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.945+0000 7f2fed7fa640 1 -- 172.21.15.146:0/3195281924 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2fe4010830 con 0x7f2ff006dd60 2024-09-17T03:36:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.946+0000 7f2fed7fa640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2fd4078bc0 0x7f2fd407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.946+0000 7f2fed7fa640 1 -- 172.21.15.146:0/3195281924 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5201+0+0 (secure 0 0 0) 0x7f2fe409b430 con 0x7f2ff006dd60 2024-09-17T03:36:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.946+0000 7f2feffff640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2fd4078bc0 0x7f2fd407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.947+0000 7f2feffff640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2fd4078bc0 0x7f2fd407b0d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc001410 tx=0x7f2fdc0012a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:53.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:53.950+0000 7f2fed7fa640 1 -- 172.21.15.146:0/3195281924 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2fe4063b80 con 0x7f2ff006dd60 2024-09-17T03:36:54.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.137+0000 7f2ff7189640 1 -- 172.21.15.146:0/3195281924 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2ff0152df0 con 0x7f2ff006dd60 2024-09-17T03:36:54.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.560+0000 7f2fed7fa640 1 -- 172.21.15.146:0/3195281924 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v67) ==== 97+0+0 (secure 0 0 0) 0x7f2fe4063480 con 0x7f2ff006dd60 2024-09-17T03:36:54.559 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:36:54.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 -- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2fd4078bc0 msgr2=0x7f2fd407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2fd4078bc0 0x7f2fd407b0d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc001410 tx=0x7f2fdc0012a0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 -- 172.21.15.146:0/3195281924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ff006dd60 msgr2=0x7f2ff014f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ff006dd60 0x7f2ff014f760 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400e790 tx=0x7f2fe400ec50 comp rx=0 tx=0).stop 2024-09-17T03:36:54.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 -- 172.21.15.146:0/3195281924 shutdown_connections 2024-09-17T03:36:54.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2fd4078bc0 0x7f2fd407b0d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ff00b55f0 0x7f2ff0150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ff0071120 0x7f2ff014d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 --2- 172.21.15.146:0/3195281924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ff006dd60 0x7f2ff014f760 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 -- 172.21.15.146:0/3195281924 >> 172.21.15.146:0/3195281924 conn(0x7f2ff00b3410 msgr2=0x7f2ff00b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:54.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 -- 172.21.15.146:0/3195281924 shutdown_connections 2024-09-17T03:36:54.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.563+0000 7f2ff7189640 1 -- 172.21.15.146:0/3195281924 wait complete. 2024-09-17T03:36:54.577 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:36:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.691+0000 7feeaecb2640 1 -- 172.21.15.146:0/528839948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea80b4370 msgr2=0x7feea80b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.691+0000 7feeaecb2640 1 --2- 172.21.15.146:0/528839948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea80b4370 0x7feea80b4780 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7feea0005fd0 tx=0x7feea002aa10 comp rx=0 tx=0).stop 2024-09-17T03:36:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.691+0000 7feeaecb2640 1 -- 172.21.15.146:0/528839948 shutdown_connections 2024-09-17T03:36:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.691+0000 7feeaecb2640 1 --2- 172.21.15.146:0/528839948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea80b4370 0x7feea80b4780 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.692+0000 7feeaecb2640 1 --2- 172.21.15.146:0/528839948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feea8072680 0x7feea8072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.692+0000 7feeaecb2640 1 -- 172.21.15.146:0/528839948 >> 172.21.15.146:0/528839948 conn(0x7feea80b2060 msgr2=0x7feea80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.692+0000 7feeaecb2640 1 -- 172.21.15.146:0/528839948 shutdown_connections 2024-09-17T03:36:54.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.692+0000 7feeaecb2640 1 -- 172.21.15.146:0/528839948 wait complete. 2024-09-17T03:36:54.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.693+0000 7feeaecb2640 1 Processor -- start 2024-09-17T03:36:54.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.693+0000 7feeaecb2640 1 -- start start 2024-09-17T03:36:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feeaecb2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feea8072680 0x7feea80aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feeaecb2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feea80b4370 0x7feea81511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feeaecb2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea815b770 0x7feea81e8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feeaecb2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feea80b4e40 con 0x7feea815b770 2024-09-17T03:36:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feeaecb2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feea80b4cc0 con 0x7feea80b4370 2024-09-17T03:36:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feeaecb2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7feea80b4fc0 con 0x7feea8072680 2024-09-17T03:36:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feead24f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea815b770 0x7feea81e8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feead24f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea815b770 0x7feea81e8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42844/0 (socket says 172.21.15.146:42844) 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feead24f640 1 -- 172.21.15.146:0/1689927853 learned_addr learned my addr 172.21.15.146:0/1689927853 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feeaca4e640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feea8072680 0x7feea80aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7fee9ffff640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feea80b4370 0x7feea81511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feead24f640 1 -- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feea8072680 msgr2=0x7feea80aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feead24f640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feea8072680 0x7feea80aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feead24f640 1 -- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feea80b4370 msgr2=0x7feea81511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feead24f640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feea80b4370 0x7feea81511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feead24f640 1 -- 172.21.15.146:0/1689927853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea80ab2b0 con 0x7feea815b770 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7fee9ffff640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feea80b4370 0x7feea81511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.695+0000 7feead24f640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea815b770 0x7feea81e8370 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feea0006010 tx=0x7feea0009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.696+0000 7fee9d7fa640 1 -- 172.21.15.146:0/1689927853 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0046070 con 0x7feea815b770 2024-09-17T03:36:54.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.696+0000 7fee9d7fa640 1 -- 172.21.15.146:0/1689927853 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feea0004540 con 0x7feea815b770 2024-09-17T03:36:54.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.696+0000 7feeaecb2640 1 -- 172.21.15.146:0/1689927853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea81f9d20 con 0x7feea815b770 2024-09-17T03:36:54.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.696+0000 7fee9d7fa640 1 -- 172.21.15.146:0/1689927853 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0033070 con 0x7feea815b770 2024-09-17T03:36:54.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.696+0000 7feeaecb2640 1 -- 172.21.15.146:0/1689927853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea80aa620 con 0x7feea815b770 2024-09-17T03:36:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.697+0000 7feeaecb2640 1 -- 172.21.15.146:0/1689927853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea815aa40 con 0x7feea815b770 2024-09-17T03:36:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.697+0000 7fee9d7fa640 1 -- 172.21.15.146:0/1689927853 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feea0049070 con 0x7feea815b770 2024-09-17T03:36:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.698+0000 7fee9d7fa640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee94078b90 0x7fee9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.698+0000 7fee9d7fa640 1 -- 172.21.15.146:0/1689927853 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4857+0+0 (secure 0 0 0) 0x7feea00bbb30 con 0x7feea815b770 2024-09-17T03:36:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.698+0000 7feeaca4e640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee94078b90 0x7fee9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.699+0000 7feeaca4e640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee94078b90 0x7fee9407b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feea4007fd0 tx=0x7feea4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:54.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.702+0000 7fee9d7fa640 1 -- 172.21.15.146:0/1689927853 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feea815aa40 con 0x7feea815b770 2024-09-17T03:36:54.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.947+0000 7feeaecb2640 1 -- 172.21.15.146:0/1689927853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7feea80b5580 con 0x7feea815b770 2024-09-17T03:36:54.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.948+0000 7fee9d7fa640 1 -- 172.21.15.146:0/1689927853 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7feea003e070 con 0x7feea815b770 2024-09-17T03:36:54.947 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:54.947 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:36:54.947 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:36:54.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.947 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:36:54.947 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:36:54.947 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:54.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.949 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:36:54.950 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:54.951 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.952 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:54.953 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.954 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.955 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.956 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.957 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:36:54.958 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.959 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:36:54.960 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:36:54.961 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:36:54.961 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:36:54.961 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:36:54.961 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:36:54.961 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.961 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:54.961 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:36:54.961 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:36:54.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 -- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee94078b90 msgr2=0x7fee9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee94078b90 0x7fee9407b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feea4007fd0 tx=0x7feea4009040 comp rx=0 tx=0).stop 2024-09-17T03:36:54.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 -- 172.21.15.146:0/1689927853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea815b770 msgr2=0x7feea81e8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:54.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea815b770 0x7feea81e8370 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feea0006010 tx=0x7feea0009360 comp rx=0 tx=0).stop 2024-09-17T03:36:54.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 -- 172.21.15.146:0/1689927853 shutdown_connections 2024-09-17T03:36:54.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee94078b90 0x7fee9407b0a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea815b770 0x7feea81e8370 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feea80b4370 0x7feea81511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 --2- 172.21.15.146:0/1689927853 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feea8072680 0x7feea80aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:54.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 -- 172.21.15.146:0/1689927853 >> 172.21.15.146:0/1689927853 conn(0x7feea80b2060 msgr2=0x7feea8156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:54.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 -- 172.21.15.146:0/1689927853 shutdown_connections 2024-09-17T03:36:54.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:54.950+0000 7feeaecb2640 1 -- 172.21.15.146:0/1689927853 wait complete. 2024-09-17T03:36:54.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:36:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.079+0000 7f669dc70640 1 -- 172.21.15.146:0/221558582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66980cfca0 msgr2=0x7f66980cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.079+0000 7f669dc70640 1 --2- 172.21.15.146:0/221558582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66980cfca0 0x7f66980cef40 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6698068f10 tx=0x7f668002a510 comp rx=0 tx=0).stop 2024-09-17T03:36:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.079+0000 7f669dc70640 1 -- 172.21.15.146:0/221558582 shutdown_connections 2024-09-17T03:36:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.079+0000 7f669dc70640 1 --2- 172.21.15.146:0/221558582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66980cfca0 0x7f66980cef40 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.079+0000 7f669dc70640 1 -- 172.21.15.146:0/221558582 >> 172.21.15.146:0/221558582 conn(0x7f66980d11f0 msgr2=0x7f66980d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.079+0000 7f669dc70640 1 -- 172.21.15.146:0/221558582 shutdown_connections 2024-09-17T03:36:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.079+0000 7f669dc70640 1 -- 172.21.15.146:0/221558582 wait complete. 2024-09-17T03:36:55.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.081+0000 7f669dc70640 1 Processor -- start 2024-09-17T03:36:55.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.081+0000 7f669dc70640 1 -- start start 2024-09-17T03:36:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.082+0000 7f669dc70640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66980b61f0 0x7f66981f6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.082+0000 7f669dc70640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66980cfca0 0x7f66980cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.082+0000 7f669dc70640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669815f1a0 0x7f6698152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.082+0000 7f669dc70640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6698069660 con 0x7f669815f1a0 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.082+0000 7f669dc70640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f66980694e0 con 0x7f66980b61f0 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.082+0000 7f669dc70640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f66980697e0 con 0x7f66980cfca0 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.082+0000 7f6697fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669815f1a0 0x7f6698152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.082+0000 7f6697fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669815f1a0 0x7f6698152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42860/0 (socket says 172.21.15.146:42860) 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.082+0000 7f6697fff640 1 -- 172.21.15.146:0/3061294088 learned_addr learned my addr 172.21.15.146:0/3061294088 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f66977fe640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66980b61f0 0x7f66981f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f668ffff640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66980cfca0 0x7f66980cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f6697fff640 1 -- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66980cfca0 msgr2=0x7f66980cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f6697fff640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66980cfca0 0x7f66980cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f6697fff640 1 -- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66980b61f0 msgr2=0x7f66981f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f6697fff640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66980b61f0 0x7f66981f6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f6697fff640 1 -- 172.21.15.146:0/3061294088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66980ccfa0 con 0x7f669815f1a0 2024-09-17T03:36:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f6697fff640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669815f1a0 0x7f6698152710 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f669000c760 tx=0x7f669000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f6694ff9640 1 -- 172.21.15.146:0/3061294088 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690003b70 con 0x7f669815f1a0 2024-09-17T03:36:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f6694ff9640 1 -- 172.21.15.146:0/3061294088 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6690003d10 con 0x7f669815f1a0 2024-09-17T03:36:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f669dc70640 1 -- 172.21.15.146:0/3061294088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66980cd280 con 0x7f669815f1a0 2024-09-17T03:36:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f6694ff9640 1 -- 172.21.15.146:0/3061294088 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900052d0 con 0x7f669815f1a0 2024-09-17T03:36:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.083+0000 7f669dc70640 1 -- 172.21.15.146:0/3061294088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66980c85b0 con 0x7f669815f1a0 2024-09-17T03:36:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.084+0000 7f669dc70640 1 -- 172.21.15.146:0/3061294088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6698069c30 con 0x7f669815f1a0 2024-09-17T03:36:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.085+0000 7f6694ff9640 1 -- 172.21.15.146:0/3061294088 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6690005470 con 0x7f669815f1a0 2024-09-17T03:36:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.085+0000 7f6694ff9640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6678078bc0 0x7f667807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.085+0000 7f6694ff9640 1 -- 172.21.15.146:0/3061294088 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4857+0+0 (secure 0 0 0) 0x7f669009a620 con 0x7f669815f1a0 2024-09-17T03:36:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.086+0000 7f66977fe640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6678078bc0 0x7f667807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.086+0000 7f66977fe640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6678078bc0 0x7f667807b0d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6688000f60 tx=0x7f6688009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.090+0000 7f6694ff9640 1 -- 172.21.15.146:0/3061294088 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f66900627f0 con 0x7f669815f1a0 2024-09-17T03:36:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.266+0000 7f669dc70640 1 -- 172.21.15.146:0/3061294088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6698076180 con 0x7f669815f1a0 2024-09-17T03:36:55.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.266+0000 7f6694ff9640 1 -- 172.21.15.146:0/3061294088 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7f6690067220 con 0x7f669815f1a0 2024-09-17T03:36:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:55.266 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:36:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:36:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:36:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:36:55.266 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:36:55.266 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:36:55.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 -- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6678078bc0 msgr2=0x7f667807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6678078bc0 0x7f667807b0d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6688000f60 tx=0x7f6688009040 comp rx=0 tx=0).stop 2024-09-17T03:36:55.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 -- 172.21.15.146:0/3061294088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669815f1a0 msgr2=0x7f6698152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669815f1a0 0x7f6698152710 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f669000c760 tx=0x7f669000cb60 comp rx=0 tx=0).stop 2024-09-17T03:36:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 -- 172.21.15.146:0/3061294088 shutdown_connections 2024-09-17T03:36:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6678078bc0 0x7f667807b0d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f669815f1a0 0x7f6698152710 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66980cfca0 0x7f66980cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 --2- 172.21.15.146:0/3061294088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66980b61f0 0x7f66981f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 -- 172.21.15.146:0/3061294088 >> 172.21.15.146:0/3061294088 conn(0x7f66980d11f0 msgr2=0x7f6698161480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 -- 172.21.15.146:0/3061294088 shutdown_connections 2024-09-17T03:36:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.269+0000 7f669dc70640 1 -- 172.21.15.146:0/3061294088 wait complete. 2024-09-17T03:36:55.279 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:36:55.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:36:55.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.399+0000 7f8886ea9640 1 -- 172.21.15.146:0/3176672260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8868004d40 msgr2=0x7f8868005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.399+0000 7f8886ea9640 1 --2- 172.21.15.146:0/3176672260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8868004d40 0x7f8868005150 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f8878005fd0 tx=0x7f8868005830 comp rx=0 tx=0).stop 2024-09-17T03:36:55.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.399+0000 7f8885446640 1 -- 172.21.15.146:0/3176672260 reap_dead start 2024-09-17T03:36:55.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.399+0000 7f8886ea9640 1 -- 172.21.15.146:0/3176672260 shutdown_connections 2024-09-17T03:36:55.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.399+0000 7f8886ea9640 1 -- 172.21.15.146:0/3176672260 >> 172.21.15.146:0/3176672260 conn(0x7f88800b7b20 msgr2=0x7f888009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:55.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.399+0000 7f8886ea9640 1 -- 172.21.15.146:0/3176672260 shutdown_connections 2024-09-17T03:36:55.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.399+0000 7f8886ea9640 1 -- 172.21.15.146:0/3176672260 wait complete. 2024-09-17T03:36:55.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.401+0000 7f8886ea9640 1 Processor -- start 2024-09-17T03:36:55.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.401+0000 7f8886ea9640 1 -- start start 2024-09-17T03:36:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8886ea9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88801541e0 0x7f88801e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8886ea9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880145770 0x7f8880145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8886ea9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88801460c0 0x7f88801f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8886ea9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f88800b39b0 con 0x7f8880145770 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8886ea9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f88800b3830 con 0x7f88801460c0 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8886ea9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f888015cfe0 con 0x7f88801541e0 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8877fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880145770 0x7f8880145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8877fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880145770 0x7f8880145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42882/0 (socket says 172.21.15.146:42882) 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8877fff640 1 -- 172.21.15.146:0/410694513 learned_addr learned my addr 172.21.15.146:0/410694513 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8884c45640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88801541e0 0x7f88801e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8885446640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88801460c0 0x7f88801f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8877fff640 1 -- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88801541e0 msgr2=0x7f88801e9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8877fff640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88801541e0 0x7f88801e9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8877fff640 1 -- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88801460c0 msgr2=0x7f88801f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8877fff640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88801460c0 0x7f88801f6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8877fff640 1 -- 172.21.15.146:0/410694513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88801464d0 con 0x7f8880145770 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8877fff640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880145770 0x7f8880145b80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8870011ae0 tx=0x7f8870009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f88757fa640 1 -- 172.21.15.146:0/410694513 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887001e070 con 0x7f8880145770 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f88757fa640 1 -- 172.21.15.146:0/410694513 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f887000fe70 con 0x7f8880145770 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.403+0000 7f8886ea9640 1 -- 172.21.15.146:0/410694513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8880156d70 con 0x7f8880145770 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.404+0000 7f88757fa640 1 -- 172.21.15.146:0/410694513 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870004290 con 0x7f8880145770 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.404+0000 7f8886ea9640 1 -- 172.21.15.146:0/410694513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8880157330 con 0x7f8880145770 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.404+0000 7f8886ea9640 1 -- 172.21.15.146:0/410694513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88800afb10 con 0x7f8880145770 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.405+0000 7f88757fa640 1 -- 172.21.15.146:0/410694513 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8870021070 con 0x7f8880145770 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.406+0000 7f88757fa640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f886c078bc0 0x7f886c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.406+0000 7f88757fa640 1 -- 172.21.15.146:0/410694513 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4857+0+0 (secure 0 0 0) 0x7f887009b360 con 0x7f8880145770 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.406+0000 7f8884c45640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f886c078bc0 0x7f886c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.407+0000 7f8884c45640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f886c078bc0 0x7f886c07b0d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f887c001330 tx=0x7f887c006910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.410+0000 7f88757fa640 1 -- 172.21.15.146:0/410694513 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88800afb10 con 0x7f8880145770 2024-09-17T03:36:55.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:55.590+0000 7f8886ea9640 1 -- 172.21.15.146:0/410694513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f888009d250 con 0x7f8880145770 2024-09-17T03:36:56.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.566+0000 7f88757fa640 1 -- 172.21.15.146:0/410694513 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7f8870063680 con 0x7f8880145770 2024-09-17T03:36:56.566 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:36:56.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 -- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f886c078bc0 msgr2=0x7f886c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:56.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f886c078bc0 0x7f886c07b0d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f887c001330 tx=0x7f887c006910 comp rx=0 tx=0).stop 2024-09-17T03:36:56.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 -- 172.21.15.146:0/410694513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880145770 msgr2=0x7f8880145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:56.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880145770 0x7f8880145b80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8870011ae0 tx=0x7f8870009e90 comp rx=0 tx=0).stop 2024-09-17T03:36:56.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 -- 172.21.15.146:0/410694513 shutdown_connections 2024-09-17T03:36:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f886c078bc0 0x7f886c07b0d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88801460c0 0x7f88801f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880145770 0x7f8880145b80 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 --2- 172.21.15.146:0/410694513 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88801541e0 0x7f88801e9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 -- 172.21.15.146:0/410694513 >> 172.21.15.146:0/410694513 conn(0x7f88800b7b20 msgr2=0x7f8880075ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 -- 172.21.15.146:0/410694513 shutdown_connections 2024-09-17T03:36:56.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.570+0000 7f8886ea9640 1 -- 172.21.15.146:0/410694513 wait complete. 2024-09-17T03:36:56.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:36:56.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.713+0000 7f8376af4640 1 -- 172.21.15.146:0/8373489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83700d2330 msgr2=0x7f8370068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.713+0000 7f8376af4640 1 --2- 172.21.15.146:0/8373489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83700d2330 0x7f8370068d00 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f83700b4220 tx=0x7f836802a560 comp rx=0 tx=0).stop 2024-09-17T03:36:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.713+0000 7f8376af4640 1 -- 172.21.15.146:0/8373489 shutdown_connections 2024-09-17T03:36:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.713+0000 7f8376af4640 1 --2- 172.21.15.146:0/8373489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83700cefc0 0x7f83700cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.713+0000 7f8376af4640 1 --2- 172.21.15.146:0/8373489 >> v2:172.21.15.179:3300/0 conn(0x7f837015eda0 0x7f8370069240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.713+0000 7f8376af4640 1 --2- 172.21.15.146:0/8373489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83700d2330 0x7f8370068d00 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.713+0000 7f8376af4640 1 -- 172.21.15.146:0/8373489 >> 172.21.15.146:0/8373489 conn(0x7f837006d070 msgr2=0x7f837006d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.713+0000 7f8376af4640 1 -- 172.21.15.146:0/8373489 shutdown_connections 2024-09-17T03:36:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.713+0000 7f8376af4640 1 -- 172.21.15.146:0/8373489 wait complete. 2024-09-17T03:36:56.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.715+0000 7f8376af4640 1 Processor -- start 2024-09-17T03:36:56.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.715+0000 7f8376af4640 1 -- start start 2024-09-17T03:36:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.716+0000 7f8376af4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83700cefc0 0x7f8370152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.716+0000 7f8376af4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83700d2330 0x7f83700b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:56.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.716+0000 7f8376af4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837015eda0 0x7f837015c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.716+0000 7f8376af4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f83700cf910 con 0x7f837015eda0 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.716+0000 7f8376af4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8370069ab0 con 0x7f83700cefc0 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.716+0000 7f8376af4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f83700cfa90 con 0x7f83700d2330 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.716+0000 7f8375091640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837015eda0 0x7f837015c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.716+0000 7f8375091640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837015eda0 0x7f837015c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42892/0 (socket says 172.21.15.146:42892) 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.716+0000 7f8375091640 1 -- 172.21.15.146:0/2834913861 learned_addr learned my addr 172.21.15.146:0/2834913861 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.716+0000 7f8374890640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83700cefc0 0x7f8370152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.716+0000 7f836ffff640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83700d2330 0x7f83700b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.717+0000 7f8375091640 1 -- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83700d2330 msgr2=0x7f83700b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.717+0000 7f8375091640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83700d2330 0x7f83700b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.717+0000 7f8375091640 1 -- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83700cefc0 msgr2=0x7f8370152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:56.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.717+0000 7f8375091640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83700cefc0 0x7f8370152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.717+0000 7f8375091640 1 -- 172.21.15.146:0/2834913861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8370153120 con 0x7f837015eda0 2024-09-17T03:36:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.717+0000 7f8375091640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837015eda0 0x7f837015c5b0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f83580058c0 tx=0x7f835800da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.717+0000 7f836d7fa640 1 -- 172.21.15.146:0/2834913861 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358017070 con 0x7f837015eda0 2024-09-17T03:36:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.717+0000 7f836d7fa640 1 -- 172.21.15.146:0/2834913861 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8358005310 con 0x7f837015eda0 2024-09-17T03:36:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.717+0000 7f8376af4640 1 -- 172.21.15.146:0/2834913861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83700b54f0 con 0x7f837015eda0 2024-09-17T03:36:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.717+0000 7f836d7fa640 1 -- 172.21.15.146:0/2834913861 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83580047a0 con 0x7f837015eda0 2024-09-17T03:36:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.717+0000 7f8376af4640 1 -- 172.21.15.146:0/2834913861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83700b5ab0 con 0x7f837015eda0 2024-09-17T03:36:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.718+0000 7f8376af4640 1 -- 172.21.15.146:0/2834913861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f837006a010 con 0x7f837015eda0 2024-09-17T03:36:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.719+0000 7f836d7fa640 1 -- 172.21.15.146:0/2834913861 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8358004940 con 0x7f837015eda0 2024-09-17T03:36:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.719+0000 7f836d7fa640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8350078b90 0x7f835007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.720+0000 7f836d7fa640 1 -- 172.21.15.146:0/2834913861 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5227+0+0 (secure 0 0 0) 0x7f835809af10 con 0x7f837015eda0 2024-09-17T03:36:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.720+0000 7f8374890640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8350078b90 0x7f835007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.720+0000 7f8374890640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8350078b90 0x7f835007b0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8368033000 tx=0x7f8368004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:56.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.723+0000 7f836d7fa640 1 -- 172.21.15.146:0/2834913861 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8358062fc0 con 0x7f837015eda0 2024-09-17T03:36:56.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:56.899+0000 7f8376af4640 1 -- 172.21.15.146:0/2834913861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f83700b97b0 con 0x7f837015eda0 2024-09-17T03:36:57.239 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:36:57.241 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:36:57.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.569+0000 7f836d7fa640 1 -- 172.21.15.146:0/2834913861 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7f83580679f0 con 0x7f837015eda0 2024-09-17T03:36:57.568 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:36:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 -- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8350078b90 msgr2=0x7f835007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8350078b90 0x7f835007b0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8368033000 tx=0x7f8368004730 comp rx=0 tx=0).stop 2024-09-17T03:36:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 -- 172.21.15.146:0/2834913861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837015eda0 msgr2=0x7f837015c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837015eda0 0x7f837015c5b0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f83580058c0 tx=0x7f835800da70 comp rx=0 tx=0).stop 2024-09-17T03:36:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 -- 172.21.15.146:0/2834913861 shutdown_connections 2024-09-17T03:36:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8350078b90 0x7f835007b0a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f837015eda0 0x7f837015c5b0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83700d2330 0x7f83700b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 --2- 172.21.15.146:0/2834913861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83700cefc0 0x7f8370152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 -- 172.21.15.146:0/2834913861 >> 172.21.15.146:0/2834913861 conn(0x7f837006d070 msgr2=0x7f837015e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 -- 172.21.15.146:0/2834913861 shutdown_connections 2024-09-17T03:36:57.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.572+0000 7f8376af4640 1 -- 172.21.15.146:0/2834913861 wait complete. 2024-09-17T03:36:57.591 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:36:57.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.709+0000 7f289e7ba640 1 -- 172.21.15.146:0/764569304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980cd840 msgr2=0x7f28980b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:57.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.709+0000 7f289e7ba640 1 --2- 172.21.15.146:0/764569304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980cd840 0x7f28980b5680 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2898073030 tx=0x7f288c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.709+0000 7f289e7ba640 1 -- 172.21.15.146:0/764569304 shutdown_connections 2024-09-17T03:36:57.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.709+0000 7f289e7ba640 1 --2- 172.21.15.146:0/764569304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28980cdc50 0x7f28980b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.709+0000 7f289e7ba640 1 --2- 172.21.15.146:0/764569304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980cd840 0x7f28980b5680 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.709+0000 7f289e7ba640 1 --2- 172.21.15.146:0/764569304 >> v2:172.21.15.179:3300/0 conn(0x7f289815c8e0 0x7f289806f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.709+0000 7f289e7ba640 1 -- 172.21.15.146:0/764569304 >> 172.21.15.146:0/764569304 conn(0x7f28980b3150 msgr2=0x7f28980b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:57.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.709+0000 7f289e7ba640 1 -- 172.21.15.146:0/764569304 shutdown_connections 2024-09-17T03:36:57.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.709+0000 7f289e7ba640 1 -- 172.21.15.146:0/764569304 wait complete. 2024-09-17T03:36:57.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.711+0000 7f289e7ba640 1 Processor -- start 2024-09-17T03:36:57.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.711+0000 7f289e7ba640 1 -- start start 2024-09-17T03:36:57.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f289e7ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980cd840 0x7f2898145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:57.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f289e7ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28980cdc50 0x7f28980cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f289e7ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f289815c8e0 0x7f28980cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f289e7ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f28980b5470 con 0x7f28980cd840 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f289e7ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f28980b52f0 con 0x7f28980cdc50 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f289e7ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2898073580 con 0x7f289815c8e0 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2897fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980cd840 0x7f2898145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2897fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980cd840 0x7f2898145c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38030/0 (socket says 172.21.15.146:38030) 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2897fff640 1 -- 172.21.15.146:0/1574747806 learned_addr learned my addr 172.21.15.146:0/1574747806 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f289cd57640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f289815c8e0 0x7f28980cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f28977fe640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28980cdc50 0x7f28980cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2897fff640 1 -- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f289815c8e0 msgr2=0x7f28980cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2897fff640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f289815c8e0 0x7f28980cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2897fff640 1 -- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28980cdc50 msgr2=0x7f28980cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2897fff640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28980cdc50 0x7f28980cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:57.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2897fff640 1 -- 172.21.15.146:0/1574747806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2898154850 con 0x7f28980cd840 2024-09-17T03:36:57.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f289cd57640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f289815c8e0 0x7f28980cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:57.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2897fff640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980cd840 0x7f2898145c10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f288800d770 tx=0x7f288800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:57.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2894ff9640 1 -- 172.21.15.146:0/1574747806 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888017070 con 0x7f28980cd840 2024-09-17T03:36:57.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2894ff9640 1 -- 172.21.15.146:0/1574747806 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2888009d20 con 0x7f28980cd840 2024-09-17T03:36:57.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f289e7ba640 1 -- 172.21.15.146:0/1574747806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2898154b30 con 0x7f28980cd840 2024-09-17T03:36:57.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f2894ff9640 1 -- 172.21.15.146:0/1574747806 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28880106c0 con 0x7f28980cd840 2024-09-17T03:36:57.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.713+0000 7f289e7ba640 1 -- 172.21.15.146:0/1574747806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28981550f0 con 0x7f28980cd840 2024-09-17T03:36:57.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.715+0000 7f289e7ba640 1 -- 172.21.15.146:0/1574747806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28980b4ba0 con 0x7f28980cd840 2024-09-17T03:36:57.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.715+0000 7f2894ff9640 1 -- 172.21.15.146:0/1574747806 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f288801a070 con 0x7f28980cd840 2024-09-17T03:36:57.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.716+0000 7f2894ff9640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2884078b90 0x7f288407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:57.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.716+0000 7f2894ff9640 1 -- 172.21.15.146:0/1574747806 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5609+0+0 (secure 0 0 0) 0x7f288809ae60 con 0x7f28980cd840 2024-09-17T03:36:57.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.716+0000 7f28977fe640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2884078b90 0x7f288407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:57.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.716+0000 7f28977fe640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2884078b90 0x7f288407b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f288c033000 tx=0x7f288c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:57.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.720+0000 7f2894ff9640 1 -- 172.21.15.146:0/1574747806 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2888063280 con 0x7f28980cd840 2024-09-17T03:36:57.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:57.934+0000 7f289e7ba640 1 -- 172.21.15.146:0/1574747806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f289814cc70 con 0x7f28980cd840 2024-09-17T03:36:58.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.595+0000 7f2894ff9640 1 -- 172.21.15.146:0/1574747806 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v43) ==== 174+0+0 (secure 0 0 0) 0x7f2888062b80 con 0x7f28980cd840 2024-09-17T03:36:58.598 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 10 and data pool 11 2024-09-17T03:36:58.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.600+0000 7f289e7ba640 1 -- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2884078b90 msgr2=0x7f288407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:58.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.600+0000 7f289e7ba640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2884078b90 0x7f288407b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f288c033000 tx=0x7f288c004730 comp rx=0 tx=0).stop 2024-09-17T03:36:58.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.600+0000 7f289e7ba640 1 -- 172.21.15.146:0/1574747806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980cd840 msgr2=0x7f2898145c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:58.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.600+0000 7f289e7ba640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980cd840 0x7f2898145c10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f288800d770 tx=0x7f288800dc30 comp rx=0 tx=0).stop 2024-09-17T03:36:58.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.602+0000 7f289e7ba640 1 -- 172.21.15.146:0/1574747806 shutdown_connections 2024-09-17T03:36:58.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.602+0000 7f289e7ba640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2884078b90 0x7f288407b0a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.602+0000 7f289e7ba640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f289815c8e0 0x7f28980cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.602+0000 7f289e7ba640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28980cdc50 0x7f28980cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.602+0000 7f289e7ba640 1 --2- 172.21.15.146:0/1574747806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28980cd840 0x7f2898145c10 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.602+0000 7f289e7ba640 1 -- 172.21.15.146:0/1574747806 >> 172.21.15.146:0/1574747806 conn(0x7f28980b3150 msgr2=0x7f289814d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:58.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.603+0000 7f289e7ba640 1 -- 172.21.15.146:0/1574747806 shutdown_connections 2024-09-17T03:36:58.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.604+0000 7f289e7ba640 1 -- 172.21.15.146:0/1574747806 wait complete. 2024-09-17T03:36:58.625 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.741+0000 7f55ea15f640 1 -- 172.21.15.146:0/914431635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55e40b5750 msgr2=0x7f55e40b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.741+0000 7f55ea15f640 1 --2- 172.21.15.146:0/914431635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55e40b5750 0x7f55e40b3620 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f55d8005fd0 tx=0x7f55d802a540 comp rx=0 tx=0).stop 2024-09-17T03:36:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.741+0000 7f55ea15f640 1 -- 172.21.15.146:0/914431635 shutdown_connections 2024-09-17T03:36:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.741+0000 7f55ea15f640 1 --2- 172.21.15.146:0/914431635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55e40b5750 0x7f55e40b3620 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.741+0000 7f55ea15f640 1 -- 172.21.15.146:0/914431635 >> 172.21.15.146:0/914431635 conn(0x7f55e40b7b20 msgr2=0x7f55e409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.741+0000 7f55ea15f640 1 -- 172.21.15.146:0/914431635 shutdown_connections 2024-09-17T03:36:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.741+0000 7f55ea15f640 1 -- 172.21.15.146:0/914431635 wait complete. 2024-09-17T03:36:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.742+0000 7f55ea15f640 1 Processor -- start 2024-09-17T03:36:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.743+0000 7f55ea15f640 1 -- start start 2024-09-17T03:36:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55ea15f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e40b3b60 0x7f55e41f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55ea15f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55e40b5750 0x7f55e4158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55ea15f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55e40b5ce0 0x7f55e41f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55ea15f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f55e415d650 con 0x7f55e40b5ce0 2024-09-17T03:36:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55ea15f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f55e415d4d0 con 0x7f55e40b3b60 2024-09-17T03:36:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55ea15f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f55e415d7d0 con 0x7f55e40b5750 2024-09-17T03:36:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55e40b5ce0 0x7f55e41f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55e40b5ce0 0x7f55e41f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38038/0 (socket says 172.21.15.146:38038) 2024-09-17T03:36:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55e3fff640 1 -- 172.21.15.146:0/3459663839 learned_addr learned my addr 172.21.15.146:0/3459663839 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55e37fe640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e40b3b60 0x7f55e41f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55e2ffd640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55e40b5750 0x7f55e4158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55e3fff640 1 -- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55e40b5750 msgr2=0x7f55e4158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55e3fff640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55e40b5750 0x7f55e4158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55e3fff640 1 -- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e40b3b60 msgr2=0x7f55e41f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55e3fff640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e40b3b60 0x7f55e41f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55e3fff640 1 -- 172.21.15.146:0/3459663839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e41f84d0 con 0x7f55e40b5ce0 2024-09-17T03:36:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.744+0000 7f55e37fe640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e40b3b60 0x7f55e41f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.745+0000 7f55e3fff640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55e40b5ce0 0x7f55e41f0f20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00b9e0 tx=0x7f55dc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.745+0000 7f55cbfff640 1 -- 172.21.15.146:0/3459663839 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc003b70 con 0x7f55e40b5ce0 2024-09-17T03:36:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.745+0000 7f55cbfff640 1 -- 172.21.15.146:0/3459663839 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55dc003e00 con 0x7f55e40b5ce0 2024-09-17T03:36:58.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.745+0000 7f55ea15f640 1 -- 172.21.15.146:0/3459663839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e41f43e0 con 0x7f55e40b5ce0 2024-09-17T03:36:58.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.745+0000 7f55cbfff640 1 -- 172.21.15.146:0/3459663839 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00cb80 con 0x7f55e40b5ce0 2024-09-17T03:36:58.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.745+0000 7f55ea15f640 1 -- 172.21.15.146:0/3459663839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41f49a0 con 0x7f55e40b5ce0 2024-09-17T03:36:58.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.746+0000 7f55ea15f640 1 -- 172.21.15.146:0/3459663839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e41f4150 con 0x7f55e40b5ce0 2024-09-17T03:36:58.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.746+0000 7f55cbfff640 1 -- 172.21.15.146:0/3459663839 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55dc004000 con 0x7f55e40b5ce0 2024-09-17T03:36:58.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.747+0000 7f55cbfff640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f55d0078b90 0x7f55d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:58.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.747+0000 7f55cbfff640 1 -- 172.21.15.146:0/3459663839 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f55dc09ab10 con 0x7f55e40b5ce0 2024-09-17T03:36:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.747+0000 7f55e37fe640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f55d0078b90 0x7f55d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.748+0000 7f55e37fe640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f55d0078b90 0x7f55d007b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f55d4007fd0 tx=0x7f55d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:58.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.752+0000 7f55cbfff640 1 -- 172.21.15.146:0/3459663839 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55e41f84d0 con 0x7f55e40b5ce0 2024-09-17T03:36:58.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.929+0000 7f55ea15f640 1 -- 172.21.15.146:0/3459663839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55e415dd30 con 0x7f55e40b5ce0 2024-09-17T03:36:58.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.930+0000 7f55cbfff640 1 -- 172.21.15.146:0/3459663839 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16789 (secure 0 0 0) 0x7f55dc062900 con 0x7f55e40b5ce0 2024-09-17T03:36:58.929 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:58.930 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":72,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:36:57.935672+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:55.594323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:56.904167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:58.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.932+0000 7f55ea15f640 1 -- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f55d0078b90 msgr2=0x7f55d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:58.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.932+0000 7f55ea15f640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f55d0078b90 0x7f55d007b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f55d4007fd0 tx=0x7f55d4009040 comp rx=0 tx=0).stop 2024-09-17T03:36:58.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.932+0000 7f55ea15f640 1 -- 172.21.15.146:0/3459663839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55e40b5ce0 msgr2=0x7f55e41f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:58.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.932+0000 7f55ea15f640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55e40b5ce0 0x7f55e41f0f20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00b9e0 tx=0x7f55dc00bea0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.932+0000 7f55ea15f640 1 -- 172.21.15.146:0/3459663839 shutdown_connections 2024-09-17T03:36:58.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.932+0000 7f55ea15f640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f55d0078b90 0x7f55d007b0a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.932+0000 7f55ea15f640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55e40b5ce0 0x7f55e41f0f20 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.932+0000 7f55ea15f640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55e40b5750 0x7f55e4158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.932+0000 7f55ea15f640 1 --2- 172.21.15.146:0/3459663839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55e40b3b60 0x7f55e41f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:58.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.932+0000 7f55ea15f640 1 -- 172.21.15.146:0/3459663839 >> 172.21.15.146:0/3459663839 conn(0x7f55e40b7b20 msgr2=0x7f55e409bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:58.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.933+0000 7f55ea15f640 1 -- 172.21.15.146:0/3459663839 shutdown_connections 2024-09-17T03:36:58.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:58.933+0000 7f55ea15f640 1 -- 172.21.15.146:0/3459663839 wait complete. 2024-09-17T03:36:58.944 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:36:59.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.058+0000 7feb9dc7e640 1 -- 172.21.15.146:0/3953855991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb80003a30 msgr2=0x7feb80003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.058+0000 7feb9dc7e640 1 --2- 172.21.15.146:0/3953855991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb80003a30 0x7feb80003ea0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7feb88006fc0 tx=0x7feb80005830 comp rx=0 tx=0).stop 2024-09-17T03:36:59.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.058+0000 7feb97fff640 1 -- 172.21.15.146:0/3953855991 reap_dead start 2024-09-17T03:36:59.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.058+0000 7feb9dc7e640 1 -- 172.21.15.146:0/3953855991 shutdown_connections 2024-09-17T03:36:59.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.058+0000 7feb9dc7e640 1 -- 172.21.15.146:0/3953855991 >> 172.21.15.146:0/3953855991 conn(0x7feb980b3150 msgr2=0x7feb980b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:59.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.058+0000 7feb9dc7e640 1 -- 172.21.15.146:0/3953855991 shutdown_connections 2024-09-17T03:36:59.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.058+0000 7feb9dc7e640 1 -- 172.21.15.146:0/3953855991 wait complete. 2024-09-17T03:36:59.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.060+0000 7feb9dc7e640 1 Processor -- start 2024-09-17T03:36:59.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.060+0000 7feb9dc7e640 1 -- start start 2024-09-17T03:36:59.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.061+0000 7feb9dc7e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb80003a30 0x7feb981f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.061+0000 7feb9dc7e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb981f4210 0x7feb981e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.061+0000 7feb9dc7e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb981e43f0 0x7feb9806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.061+0000 7feb9dc7e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feb980b52c0 con 0x7feb981e43f0 2024-09-17T03:36:59.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.061+0000 7feb9dc7e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feb980b5140 con 0x7feb80003a30 2024-09-17T03:36:59.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.061+0000 7feb9dc7e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7feb980b5440 con 0x7feb981f4210 2024-09-17T03:36:59.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.061+0000 7feb97fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb981e43f0 0x7feb9806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.061+0000 7feb97fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb981e43f0 0x7feb9806cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38048/0 (socket says 172.21.15.146:38048) 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.061+0000 7feb97fff640 1 -- 172.21.15.146:0/1461703755 learned_addr learned my addr 172.21.15.146:0/1461703755 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb96ffd640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb981f4210 0x7feb981e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb977fe640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb80003a30 0x7feb981f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb97fff640 1 -- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb981f4210 msgr2=0x7feb981e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb97fff640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb981f4210 0x7feb981e3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb97fff640 1 -- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb80003a30 msgr2=0x7feb981f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb97fff640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb80003a30 0x7feb981f3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb97fff640 1 -- 172.21.15.146:0/1461703755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb981e4800 con 0x7feb981e43f0 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb97fff640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb981e43f0 0x7feb9806cc80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7feb98071540 tx=0x7feb90010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb7ffff640 1 -- 172.21.15.146:0/1461703755 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90003970 con 0x7feb981e43f0 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb7ffff640 1 -- 172.21.15.146:0/1461703755 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb90015070 con 0x7feb981e43f0 2024-09-17T03:36:59.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb7ffff640 1 -- 172.21.15.146:0/1461703755 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90004030 con 0x7feb981e43f0 2024-09-17T03:36:59.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb9dc7e640 1 -- 172.21.15.146:0/1461703755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb98154af0 con 0x7feb981e43f0 2024-09-17T03:36:59.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.062+0000 7feb9dc7e640 1 -- 172.21.15.146:0/1461703755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb98153d30 con 0x7feb981e43f0 2024-09-17T03:36:59.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.063+0000 7feb9dc7e640 1 -- 172.21.15.146:0/1461703755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb980b5680 con 0x7feb981e43f0 2024-09-17T03:36:59.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.064+0000 7feb7ffff640 1 -- 172.21.15.146:0/1461703755 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb900041d0 con 0x7feb981e43f0 2024-09-17T03:36:59.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.065+0000 7feb7ffff640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb84078b90 0x7feb8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.065+0000 7feb7ffff640 1 -- 172.21.15.146:0/1461703755 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7feb9009b380 con 0x7feb981e43f0 2024-09-17T03:36:59.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.065+0000 7feb977fe640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb84078b90 0x7feb8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.065+0000 7feb977fe640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb84078b90 0x7feb8407b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feb88033000 tx=0x7feb88038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:59.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.069+0000 7feb7ffff640 1 -- 172.21.15.146:0/1461703755 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feb981e4800 con 0x7feb981e43f0 2024-09-17T03:36:59.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.243+0000 7feb9dc7e640 1 -- 172.21.15.146:0/1461703755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb980699f0 con 0x7feb981e43f0 2024-09-17T03:36:59.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.245+0000 7feb7ffff640 1 -- 172.21.15.146:0/1461703755 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16789 (secure 0 0 0) 0x7feb90063200 con 0x7feb981e43f0 2024-09-17T03:36:59.244 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:36:59.244 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":72,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:36:57.935672+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:55.594323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:56.904167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:36:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 -- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb84078b90 msgr2=0x7feb8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb84078b90 0x7feb8407b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feb88033000 tx=0x7feb88038040 comp rx=0 tx=0).stop 2024-09-17T03:36:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 -- 172.21.15.146:0/1461703755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb981e43f0 msgr2=0x7feb9806cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb981e43f0 0x7feb9806cc80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7feb98071540 tx=0x7feb90010f40 comp rx=0 tx=0).stop 2024-09-17T03:36:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 -- 172.21.15.146:0/1461703755 shutdown_connections 2024-09-17T03:36:59.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb84078b90 0x7feb8407b0a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb981e43f0 0x7feb9806cc80 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb981f4210 0x7feb981e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 --2- 172.21.15.146:0/1461703755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb80003a30 0x7feb981f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 -- 172.21.15.146:0/1461703755 >> 172.21.15.146:0/1461703755 conn(0x7feb980b3150 msgr2=0x7feb980d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 -- 172.21.15.146:0/1461703755 shutdown_connections 2024-09-17T03:36:59.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.247+0000 7feb9dc7e640 1 -- 172.21.15.146:0/1461703755 wait complete. 2024-09-17T03:36:59.258 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:36:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.374+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/2079997273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3a4003a00 msgr2=0x7fb3a4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.374+0000 7fb3c1e8b640 1 --2- 172.21.15.146:0/2079997273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3a4003a00 0x7fb3a4003e70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009b50 tx=0x7fb3a4005830 comp rx=0 tx=0).stop 2024-09-17T03:36:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.374+0000 7fb3bbfff640 1 -- 172.21.15.146:0/2079997273 reap_dead start 2024-09-17T03:36:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.375+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/2079997273 shutdown_connections 2024-09-17T03:36:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.375+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/2079997273 >> 172.21.15.146:0/2079997273 conn(0x7fb3bc0b3150 msgr2=0x7fb3bc0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:36:59.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.375+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/2079997273 shutdown_connections 2024-09-17T03:36:59.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.375+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/2079997273 wait complete. 2024-09-17T03:36:59.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.376+0000 7fb3c1e8b640 1 Processor -- start 2024-09-17T03:36:59.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.377+0000 7fb3c1e8b640 1 -- start start 2024-09-17T03:36:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3c1e8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a4003a00 0x7fb3bc0aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3c1e8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3bc1437a0 0x7fb3bc143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3c1e8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3bc1444a0 0x7fb3bc1f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3c1e8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc0b5a10 con 0x7fb3bc1444a0 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3c1e8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc0b5890 con 0x7fb3bc1437a0 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3c1e8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc0b5b90 con 0x7fb3a4003a00 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3bbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3bc1444a0 0x7fb3bc1f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3bbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3bc1444a0 0x7fb3bc1f5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38078/0 (socket says 172.21.15.146:38078) 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3bbfff640 1 -- 172.21.15.146:0/158703914 learned_addr learned my addr 172.21.15.146:0/158703914 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3bb7fe640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a4003a00 0x7fb3bc0aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3baffd640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3bc1437a0 0x7fb3bc143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3bbfff640 1 -- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a4003a00 msgr2=0x7fb3bc0aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3bbfff640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a4003a00 0x7fb3bc0aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3bbfff640 1 -- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3bc1437a0 msgr2=0x7fb3bc143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:36:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3bbfff640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3bc1437a0 0x7fb3bc143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:36:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3bbfff640 1 -- 172.21.15.146:0/158703914 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc154e20 con 0x7fb3bc1444a0 2024-09-17T03:36:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3baffd640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3bc1437a0 0x7fb3bc143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:36:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.378+0000 7fb3bbfff640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3bc1444a0 0x7fb3bc1f5be0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0b3f50 tx=0x7fb3b4006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.379+0000 7fb3a3fff640 1 -- 172.21.15.146:0/158703914 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b400fa80 con 0x7fb3bc1444a0 2024-09-17T03:36:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.379+0000 7fb3a3fff640 1 -- 172.21.15.146:0/158703914 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3b400fc40 con 0x7fb3bc1444a0 2024-09-17T03:36:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.379+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/158703914 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3bc155100 con 0x7fb3bc1444a0 2024-09-17T03:36:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.379+0000 7fb3a3fff640 1 -- 172.21.15.146:0/158703914 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4011430 con 0x7fb3bc1444a0 2024-09-17T03:36:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.379+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/158703914 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3bc155be0 con 0x7fb3bc1444a0 2024-09-17T03:36:59.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.380+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/158703914 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3bc06f580 con 0x7fb3bc1444a0 2024-09-17T03:36:59.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.380+0000 7fb3a3fff640 1 -- 172.21.15.146:0/158703914 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3b40115d0 con 0x7fb3bc1444a0 2024-09-17T03:36:59.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.381+0000 7fb3a3fff640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3a8078bb0 0x7fb3a807b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:36:59.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.381+0000 7fb3a3fff640 1 -- 172.21.15.146:0/158703914 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fb3b409b500 con 0x7fb3bc1444a0 2024-09-17T03:36:59.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.381+0000 7fb3bb7fe640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3a8078bb0 0x7fb3a807b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:36:59.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.382+0000 7fb3bb7fe640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3a8078bb0 0x7fb3a807b0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac035000 tx=0x7fb3ac0046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:36:59.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.386+0000 7fb3a3fff640 1 -- 172.21.15.146:0/158703914 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb3b4063950 con 0x7fb3bc1444a0 2024-09-17T03:36:59.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:36:59.597+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/158703914 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb3bc0d0600 con 0x7fb3bc1444a0 2024-09-17T03:37:00.565 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-09-17T03:37:00.566+0000 7f95a8e94640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:37:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.607+0000 7fb3a3fff640 1 -- 172.21.15.146:0/158703914 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) ==== 118+0+0 (secure 0 0 0) 0x7fb3b4063250 con 0x7fb3bc1444a0 2024-09-17T03:37:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.610+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3a8078bb0 msgr2=0x7fb3a807b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.610+0000 7fb3c1e8b640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3a8078bb0 0x7fb3a807b0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac035000 tx=0x7fb3ac0046c0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.610+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/158703914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3bc1444a0 msgr2=0x7fb3bc1f5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.610+0000 7fb3c1e8b640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3bc1444a0 0x7fb3bc1f5be0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0b3f50 tx=0x7fb3b4006720 comp rx=0 tx=0).stop 2024-09-17T03:37:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.610+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/158703914 shutdown_connections 2024-09-17T03:37:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.610+0000 7fb3c1e8b640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3a8078bb0 0x7fb3a807b0c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.610+0000 7fb3c1e8b640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3bc1444a0 0x7fb3bc1f5be0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.611+0000 7fb3c1e8b640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3bc1437a0 0x7fb3bc143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.611+0000 7fb3c1e8b640 1 --2- 172.21.15.146:0/158703914 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3a4003a00 0x7fb3bc0aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.611+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/158703914 >> 172.21.15.146:0/158703914 conn(0x7fb3bc0b3150 msgr2=0x7fb3bc0b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.611+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/158703914 shutdown_connections 2024-09-17T03:37:00.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.611+0000 7fb3c1e8b640 1 -- 172.21.15.146:0/158703914 wait complete. 2024-09-17T03:37:00.622 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:37:00.622 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:37:00.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.743+0000 7fb58debe640 1 -- 172.21.15.146:0/3015950737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb574003a00 msgr2=0x7fb574003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.743+0000 7fb58debe640 1 --2- 172.21.15.146:0/3015950737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb574003a00 0x7fb574003e70 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb578005fd0 tx=0x7fb574005830 comp rx=0 tx=0).stop 2024-09-17T03:37:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.743+0000 7fb587fff640 1 -- 172.21.15.146:0/3015950737 reap_dead start 2024-09-17T03:37:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.743+0000 7fb58debe640 1 -- 172.21.15.146:0/3015950737 shutdown_connections 2024-09-17T03:37:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.743+0000 7fb58debe640 1 -- 172.21.15.146:0/3015950737 >> 172.21.15.146:0/3015950737 conn(0x7fb5880b3510 msgr2=0x7fb5880b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.743+0000 7fb58debe640 1 -- 172.21.15.146:0/3015950737 shutdown_connections 2024-09-17T03:37:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.743+0000 7fb58debe640 1 -- 172.21.15.146:0/3015950737 wait complete. 2024-09-17T03:37:00.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.745+0000 7fb58debe640 1 Processor -- start 2024-09-17T03:37:00.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.745+0000 7fb58debe640 1 -- start start 2024-09-17T03:37:00.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.746+0000 7fb58debe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb574003a00 0x7fb58815e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:00.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.746+0000 7fb58debe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58815e5e0 0x7fb5881f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.746+0000 7fb58debe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5881f6780 0x7fb588142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.746+0000 7fb58debe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb58815c7b0 con 0x7fb574003a00 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.746+0000 7fb58debe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb5880b67f0 con 0x7fb58815e5e0 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.746+0000 7fb58debe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb58815c930 con 0x7fb5881f6780 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.746+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb574003a00 0x7fb58815e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.746+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb574003a00 0x7fb58815e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38104/0 (socket says 172.21.15.146:38104) 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.746+0000 7fb5877fe640 1 -- 172.21.15.146:0/141724622 learned_addr learned my addr 172.21.15.146:0/141724622 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.746+0000 7fb587fff640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5881f6780 0x7fb588142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.746+0000 7fb586ffd640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58815e5e0 0x7fb5881f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.747+0000 7fb5877fe640 1 -- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5881f6780 msgr2=0x7fb588142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.747+0000 7fb5877fe640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5881f6780 0x7fb588142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.747+0000 7fb5877fe640 1 -- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58815e5e0 msgr2=0x7fb5881f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:00.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.747+0000 7fb5877fe640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58815e5e0 0x7fb5881f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:00.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.747+0000 7fb5877fe640 1 -- 172.21.15.146:0/141724622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb588156510 con 0x7fb574003a00 2024-09-17T03:37:00.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.747+0000 7fb5877fe640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb574003a00 0x7fb58815e0a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fb578036040 tx=0x7fb578033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:00.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.747+0000 7fb57ffff640 1 -- 172.21.15.146:0/141724622 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578038040 con 0x7fb574003a00 2024-09-17T03:37:00.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.747+0000 7fb57ffff640 1 -- 172.21.15.146:0/141724622 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb57802bc10 con 0x7fb574003a00 2024-09-17T03:37:00.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.747+0000 7fb58debe640 1 -- 172.21.15.146:0/141724622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5881567f0 con 0x7fb574003a00 2024-09-17T03:37:00.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.747+0000 7fb57ffff640 1 -- 172.21.15.146:0/141724622 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578004b20 con 0x7fb574003a00 2024-09-17T03:37:00.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.747+0000 7fb58debe640 1 -- 172.21.15.146:0/141724622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb588156db0 con 0x7fb574003a00 2024-09-17T03:37:00.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.748+0000 7fb58debe640 1 -- 172.21.15.146:0/141724622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb588073a00 con 0x7fb574003a00 2024-09-17T03:37:00.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.749+0000 7fb57ffff640 1 -- 172.21.15.146:0/141724622 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb578045020 con 0x7fb574003a00 2024-09-17T03:37:00.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.749+0000 7fb57ffff640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb568078b90 0x7fb56807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:00.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.749+0000 7fb57ffff640 1 -- 172.21.15.146:0/141724622 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7fb5780bbc10 con 0x7fb574003a00 2024-09-17T03:37:00.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.749+0000 7fb586ffd640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb568078b90 0x7fb56807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:00.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.750+0000 7fb586ffd640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb568078b90 0x7fb56807b0a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb570005eb0 tx=0x7fb570005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:00.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.754+0000 7fb57ffff640 1 -- 172.21.15.146:0/141724622 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb57802bde0 con 0x7fb574003a00 2024-09-17T03:37:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:00.964+0000 7fb58debe640 1 -- 172.21.15.146:0/141724622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb588070d60 con 0x7fb574003a00 2024-09-17T03:37:01.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.609+0000 7fb57ffff640 1 -- 172.21.15.146:0/141724622 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7fb578083fd0 con 0x7fb574003a00 2024-09-17T03:37:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 -- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb568078b90 msgr2=0x7fb56807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb568078b90 0x7fb56807b0a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb570005eb0 tx=0x7fb570005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 -- 172.21.15.146:0/141724622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb574003a00 msgr2=0x7fb58815e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb574003a00 0x7fb58815e0a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fb578036040 tx=0x7fb578033c10 comp rx=0 tx=0).stop 2024-09-17T03:37:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 -- 172.21.15.146:0/141724622 shutdown_connections 2024-09-17T03:37:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb568078b90 0x7fb56807b0a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5881f6780 0x7fb588142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb58815e5e0 0x7fb5881f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 --2- 172.21.15.146:0/141724622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb574003a00 0x7fb58815e0a0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 -- 172.21.15.146:0/141724622 >> 172.21.15.146:0/141724622 conn(0x7fb5880b3510 msgr2=0x7fb5880b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:01.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 -- 172.21.15.146:0/141724622 shutdown_connections 2024-09-17T03:37:01.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.612+0000 7fb58debe640 1 -- 172.21.15.146:0/141724622 wait complete. 2024-09-17T03:37:01.624 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:37:01.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.741+0000 7f7b10add640 1 -- 172.21.15.146:0/470044996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b0c0b5750 msgr2=0x7f7b0c0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.741+0000 7f7b10add640 1 --2- 172.21.15.146:0/470044996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b0c0b5750 0x7f7b0c0b3620 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0b5390 tx=0x7f7b0002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.741+0000 7f7b10add640 1 -- 172.21.15.146:0/470044996 shutdown_connections 2024-09-17T03:37:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.741+0000 7f7b10add640 1 --2- 172.21.15.146:0/470044996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b0c0b5750 0x7f7b0c0b3620 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.741+0000 7f7b10add640 1 --2- 172.21.15.146:0/470044996 >> v2:172.21.15.179:3300/0 conn(0x7f7b0c0b5ce0 0x7f7b0c0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.741+0000 7f7b10add640 1 -- 172.21.15.146:0/470044996 >> 172.21.15.146:0/470044996 conn(0x7f7b0c0b7b20 msgr2=0x7f7b0c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.741+0000 7f7b10add640 1 -- 172.21.15.146:0/470044996 shutdown_connections 2024-09-17T03:37:01.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.741+0000 7f7b10add640 1 -- 172.21.15.146:0/470044996 wait complete. 2024-09-17T03:37:01.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.743+0000 7f7b10add640 1 Processor -- start 2024-09-17T03:37:01.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.743+0000 7f7b10add640 1 -- start start 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.744+0000 7f7b10add640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b0c0b3b60 0x7f7b0c0a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.744+0000 7f7b10add640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b0c0b5750 0x7f7b0c09c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.744+0000 7f7b10add640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b0c0b5ce0 0x7f7b0c0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.744+0000 7f7b10add640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0c0b27b0 con 0x7f7b0c0b5750 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.744+0000 7f7b10add640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0c15dcc0 con 0x7f7b0c0b5ce0 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.744+0000 7f7b10add640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0c0b2930 con 0x7f7b0c0b3b60 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b09d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b0c0b5750 0x7f7b0c09c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b09d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b0c0b5750 0x7f7b0c09c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38108/0 (socket says 172.21.15.146:38108) 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b09d9b640 1 -- 172.21.15.146:0/1773550734 learned_addr learned my addr 172.21.15.146:0/1773550734 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b0ad9d640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b0c0b5ce0 0x7f7b0c0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b0a59c640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b0c0b3b60 0x7f7b0c0a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b09d9b640 1 -- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b0c0b3b60 msgr2=0x7f7b0c0a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b09d9b640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b0c0b3b60 0x7f7b0c0a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b09d9b640 1 -- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b0c0b5ce0 msgr2=0x7f7b0c0c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b09d9b640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b0c0b5ce0 0x7f7b0c0c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b09d9b640 1 -- 172.21.15.146:0/1773550734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0c09f0a0 con 0x7f7b0c0b5750 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b09d9b640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b0c0b5750 0x7f7b0c09c6f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f7b00034040 tx=0x7f7b000039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7afaffd640 1 -- 172.21.15.146:0/1773550734 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0003e030 con 0x7f7b0c0b5750 2024-09-17T03:37:01.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7afaffd640 1 -- 172.21.15.146:0/1773550734 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b000047a0 con 0x7f7b0c0b5750 2024-09-17T03:37:01.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7afaffd640 1 -- 172.21.15.146:0/1773550734 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00035040 con 0x7f7b0c0b5750 2024-09-17T03:37:01.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b10add640 1 -- 172.21.15.146:0/1773550734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0c09f380 con 0x7f7b0c0b5750 2024-09-17T03:37:01.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.745+0000 7f7b10add640 1 -- 172.21.15.146:0/1773550734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b0c09f940 con 0x7f7b0c0b5750 2024-09-17T03:37:01.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.746+0000 7f7b10add640 1 -- 172.21.15.146:0/1773550734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b0c0b2e60 con 0x7f7b0c0b5750 2024-09-17T03:37:01.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.747+0000 7f7afaffd640 1 -- 172.21.15.146:0/1773550734 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b00041030 con 0x7f7b0c0b5750 2024-09-17T03:37:01.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.747+0000 7f7afaffd640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078bc0 0x7f7aec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:01.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.748+0000 7f7afaffd640 1 -- 172.21.15.146:0/1773550734 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f7b000bb5e0 con 0x7f7b0c0b5750 2024-09-17T03:37:01.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.748+0000 7f7b0a59c640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078bc0 0x7f7aec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:01.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.748+0000 7f7b0a59c640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078bc0 0x7f7aec07b0d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009f20 tx=0x7f7afc0094f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:01.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.752+0000 7f7afaffd640 1 -- 172.21.15.146:0/1773550734 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b00083a20 con 0x7f7b0c0b5750 2024-09-17T03:37:01.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.963+0000 7f7b10add640 1 -- 172.21.15.146:0/1773550734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b0c071700 con 0x7f7b0c0b5750 2024-09-17T03:37:01.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.963+0000 7f7afaffd640 1 -- 172.21.15.146:0/1773550734 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5237 (secure 0 0 0) 0x7f7b00083320 con 0x7f7b0c0b5750 2024-09-17T03:37:01.962 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:01.963 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":46,"btime":"2024-09-17T03:37:01:608193+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1279251216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1279251216},{"type":"v1","addr":"172.21.15.179:6836","nonce":1279251216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1852599543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1852599543},{"type":"v1","addr":"172.21.15.179:6837","nonce":1852599543}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3440108509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3440108509},{"type":"v1","addr":"172.21.15.146:6833","nonce":3440108509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:57.935632+0000","modified":"2024-09-17T03:37:00.965187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6855":{"gid":6855,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2258631125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2258631125},{"type":"v1","addr":"172.21.15.146:6835","nonce":2258631125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6855,"qdb_cluster":[6855]},"id":5}]} 2024-09-17T03:37:01.963 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 46 2024-09-17T03:37:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 -- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078bc0 msgr2=0x7f7aec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078bc0 0x7f7aec07b0d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009f20 tx=0x7f7afc0094f0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 -- 172.21.15.146:0/1773550734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b0c0b5750 msgr2=0x7f7b0c09c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b0c0b5750 0x7f7b0c09c6f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f7b00034040 tx=0x7f7b000039e0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 -- 172.21.15.146:0/1773550734 shutdown_connections 2024-09-17T03:37:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078bc0 0x7f7aec07b0d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b0c0b5ce0 0x7f7b0c0c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b0c0b5750 0x7f7b0c09c6f0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 --2- 172.21.15.146:0/1773550734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b0c0b3b60 0x7f7b0c0a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:01.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 -- 172.21.15.146:0/1773550734 >> 172.21.15.146:0/1773550734 conn(0x7f7b0c0b7b20 msgr2=0x7f7b0c071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:01.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 -- 172.21.15.146:0/1773550734 shutdown_connections 2024-09-17T03:37:01.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:01.966+0000 7f7b10add640 1 -- 172.21.15.146:0/1773550734 wait complete. 2024-09-17T03:37:01.977 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:02.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.091+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/4190041255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0815b770 msgr2=0x7f0c0806fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.091+0000 7f0c0f9e6640 1 --2- 172.21.15.146:0/4190041255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0815b770 0x7f0c0806fe10 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0c04005fd0 tx=0x7f0c0402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.091+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/4190041255 shutdown_connections 2024-09-17T03:37:02.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.091+0000 7f0c0f9e6640 1 --2- 172.21.15.146:0/4190041255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0815b770 0x7f0c0806fe10 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.091+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/4190041255 >> 172.21.15.146:0/4190041255 conn(0x7f0c080b2060 msgr2=0x7f0c080b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:02.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.091+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/4190041255 shutdown_connections 2024-09-17T03:37:02.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.091+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/4190041255 wait complete. 2024-09-17T03:37:02.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.092+0000 7f0c0f9e6640 1 Processor -- start 2024-09-17T03:37:02.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.093+0000 7f0c0f9e6640 1 -- start start 2024-09-17T03:37:02.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0f9e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c08070350 0x7f0c081f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0f9e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0815b770 0x7f0c08146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0f9e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c08147250 0x7f0c0815df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0f9e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0c080b5080 con 0x7f0c0815b770 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0f9e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0c080b4f00 con 0x7f0c08070350 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0f9e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0c080b5200 con 0x7f0c08147250 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0cf81640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0815b770 0x7f0c08146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0cf81640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0815b770 0x7f0c08146960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38128/0 (socket says 172.21.15.146:38128) 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0cf81640 1 -- 172.21.15.146:0/2540683257 learned_addr learned my addr 172.21.15.146:0/2540683257 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0d782640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c08070350 0x7f0c081f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0df83640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c08147250 0x7f0c0815df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0cf81640 1 -- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c08147250 msgr2=0x7f0c0815df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0cf81640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c08147250 0x7f0c0815df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0cf81640 1 -- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c08070350 msgr2=0x7f0c081f7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0cf81640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c08070350 0x7f0c081f7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0cf81640 1 -- 172.21.15.146:0/2540683257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c081492b0 con 0x7f0c0815b770 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.094+0000 7f0c0cf81640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0815b770 0x7f0c08146960 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800c390 tx=0x7f0bf800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:02.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.095+0000 7f0bfdffb640 1 -- 172.21.15.146:0/2540683257 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8017070 con 0x7f0c0815b770 2024-09-17T03:37:02.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.095+0000 7f0bfdffb640 1 -- 172.21.15.146:0/2540683257 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bf80035f0 con 0x7f0c0815b770 2024-09-17T03:37:02.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.095+0000 7f0bfdffb640 1 -- 172.21.15.146:0/2540683257 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8003a40 con 0x7f0c0815b770 2024-09-17T03:37:02.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.095+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/2540683257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c081f3190 con 0x7f0c0815b770 2024-09-17T03:37:02.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.095+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/2540683257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c081f3970 con 0x7f0c0815b770 2024-09-17T03:37:02.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.096+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/2540683257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c0806fe10 con 0x7f0c0815b770 2024-09-17T03:37:02.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.096+0000 7f0bfdffb640 1 -- 172.21.15.146:0/2540683257 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0bf801a070 con 0x7f0c0815b770 2024-09-17T03:37:02.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.097+0000 7f0bfdffb640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bec078b90 0x7f0bec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.097+0000 7f0bfdffb640 1 -- 172.21.15.146:0/2540683257 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f0bf8099f80 con 0x7f0c0815b770 2024-09-17T03:37:02.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.097+0000 7f0c0d782640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bec078b90 0x7f0bec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.098+0000 7f0c0d782640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bec078b90 0x7f0bec07b0a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0c04033000 tx=0x7f0c04004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:02.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.102+0000 7f0bfdffb640 1 -- 172.21.15.146:0/2540683257 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c081492b0 con 0x7f0c0815b770 2024-09-17T03:37:02.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.276+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/2540683257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c081f3420 con 0x7f0c0815b770 2024-09-17T03:37:02.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.277+0000 7f0bfdffb640 1 -- 172.21.15.146:0/2540683257 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+16776 (secure 0 0 0) 0x7f0c0815bb80 con 0x7f0c0815b770 2024-09-17T03:37:02.276 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:02.277 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":73,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:36:59.594991+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:55.594323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:56.904167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.279+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bec078b90 msgr2=0x7f0bec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.279+0000 7f0c0f9e6640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bec078b90 0x7f0bec07b0a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0c04033000 tx=0x7f0c04004730 comp rx=0 tx=0).stop 2024-09-17T03:37:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.280+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/2540683257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0815b770 msgr2=0x7f0c08146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.280+0000 7f0c0f9e6640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0815b770 0x7f0c08146960 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800c390 tx=0x7f0bf800c850 comp rx=0 tx=0).stop 2024-09-17T03:37:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.280+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/2540683257 shutdown_connections 2024-09-17T03:37:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.280+0000 7f0c0f9e6640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bec078b90 0x7f0bec07b0a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.280+0000 7f0c0f9e6640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c08147250 0x7f0c0815df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.280+0000 7f0c0f9e6640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c0815b770 0x7f0c08146960 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.280+0000 7f0c0f9e6640 1 --2- 172.21.15.146:0/2540683257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c08070350 0x7f0c081f7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.280+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/2540683257 >> 172.21.15.146:0/2540683257 conn(0x7f0c080b2060 msgr2=0x7f0c080cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.280+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/2540683257 shutdown_connections 2024-09-17T03:37:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.280+0000 7f0c0f9e6640 1 -- 172.21.15.146:0/2540683257 wait complete. 2024-09-17T03:37:02.290 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:37:02.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.403+0000 7f46b0c1d640 1 -- 172.21.15.146:0/4094661629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac0cd840 msgr2=0x7f46ac0b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.403+0000 7f46b0c1d640 1 --2- 172.21.15.146:0/4094661629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac0cd840 0x7f46ac0b5680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4694009830 tx=0x7f469402a480 comp rx=0 tx=0).stop 2024-09-17T03:37:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.403+0000 7f46b0c1d640 1 -- 172.21.15.146:0/4094661629 shutdown_connections 2024-09-17T03:37:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.403+0000 7f46b0c1d640 1 --2- 172.21.15.146:0/4094661629 >> v2:172.21.15.179:3300/0 conn(0x7f46ac0cdc50 0x7f46ac0b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.403+0000 7f46b0c1d640 1 --2- 172.21.15.146:0/4094661629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac0cd840 0x7f46ac0b5680 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.403+0000 7f46b0c1d640 1 -- 172.21.15.146:0/4094661629 >> 172.21.15.146:0/4094661629 conn(0x7f46ac0b3150 msgr2=0x7f46ac0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.403+0000 7f46b0c1d640 1 -- 172.21.15.146:0/4094661629 shutdown_connections 2024-09-17T03:37:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.403+0000 7f46b0c1d640 1 -- 172.21.15.146:0/4094661629 wait complete. 2024-09-17T03:37:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.405+0000 7f46b0c1d640 1 Processor -- start 2024-09-17T03:37:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.405+0000 7f46b0c1d640 1 -- start start 2024-09-17T03:37:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46b0c1d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46ac0cd840 0x7f46ac1e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46b0c1d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac0cdc50 0x7f46ac1f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46b0c1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac15c8e0 0x7f46ac1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46b0c1d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac073580 con 0x7f46ac0cdc50 2024-09-17T03:37:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46b0c1d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac0b5400 con 0x7f46ac0cd840 2024-09-17T03:37:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46b0c1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f46ac073700 con 0x7f46ac15c8e0 2024-09-17T03:37:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46a1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac0cdc50 0x7f46ac1f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46a1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac0cdc50 0x7f46ac1f7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38130/0 (socket says 172.21.15.146:38130) 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46a1d9b640 1 -- 172.21.15.146:0/2338338298 learned_addr learned my addr 172.21.15.146:0/2338338298 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46aad9d640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac15c8e0 0x7f46ac1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46aa59c640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46ac0cd840 0x7f46ac1e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46a1d9b640 1 -- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac15c8e0 msgr2=0x7f46ac1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46a1d9b640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac15c8e0 0x7f46ac1573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46a1d9b640 1 -- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46ac0cd840 msgr2=0x7f46ac1e4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46a1d9b640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46ac0cd840 0x7f46ac1e4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46a1d9b640 1 -- 172.21.15.146:0/2338338298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac1e40c0 con 0x7f46ac0cdc50 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.407+0000 7f46a1d9b640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac0cdc50 0x7f46ac1f7100 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f4694009950 tx=0x7f4694033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.408+0000 7f46a37fe640 1 -- 172.21.15.146:0/2338338298 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694005c90 con 0x7f46ac0cdc50 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.408+0000 7f46a37fe640 1 -- 172.21.15.146:0/2338338298 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4694031e50 con 0x7f46ac0cdc50 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.408+0000 7f46b0c1d640 1 -- 172.21.15.146:0/2338338298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ac1e43a0 con 0x7f46ac0cdc50 2024-09-17T03:37:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.408+0000 7f46a37fe640 1 -- 172.21.15.146:0/2338338298 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694005260 con 0x7f46ac0cdc50 2024-09-17T03:37:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.408+0000 7f46b0c1d640 1 -- 172.21.15.146:0/2338338298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ac157ee0 con 0x7f46ac0cdc50 2024-09-17T03:37:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.409+0000 7f46b0c1d640 1 -- 172.21.15.146:0/2338338298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ac073bb0 con 0x7f46ac0cdc50 2024-09-17T03:37:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.410+0000 7f46a37fe640 1 -- 172.21.15.146:0/2338338298 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4694005400 con 0x7f46ac0cdc50 2024-09-17T03:37:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.410+0000 7f46a37fe640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f468c078b90 0x7f468c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.410+0000 7f46a37fe640 1 -- 172.21.15.146:0/2338338298 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f46940bbce0 con 0x7f46ac0cdc50 2024-09-17T03:37:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.410+0000 7f46aa59c640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f468c078b90 0x7f468c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.411+0000 7f46aa59c640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f468c078b90 0x7f468c07b0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f469c007fd0 tx=0x7f469c001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.414+0000 7f46a37fe640 1 -- 172.21.15.146:0/2338338298 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f469403f030 con 0x7f46ac0cdc50 2024-09-17T03:37:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.588+0000 7f46b0c1d640 1 -- 172.21.15.146:0/2338338298 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46ac15b190 con 0x7f468c078b90 2024-09-17T03:37:02.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.593+0000 7f46a37fe640 1 -- 172.21.15.146:0/2338338298 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249429 (secure 0 0 0) 0x7f46ac15b190 con 0x7f468c078b90 2024-09-17T03:37:02.595 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:37:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 -- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f468c078b90 msgr2=0x7f468c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f468c078b90 0x7f468c07b0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f469c007fd0 tx=0x7f469c001370 comp rx=0 tx=0).stop 2024-09-17T03:37:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 -- 172.21.15.146:0/2338338298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac0cdc50 msgr2=0x7f46ac1f7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac0cdc50 0x7f46ac1f7100 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f4694009950 tx=0x7f4694033c20 comp rx=0 tx=0).stop 2024-09-17T03:37:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 -- 172.21.15.146:0/2338338298 shutdown_connections 2024-09-17T03:37:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f468c078b90 0x7f468c07b0a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46ac15c8e0 0x7f46ac1573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46ac0cdc50 0x7f46ac1f7100 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 --2- 172.21.15.146:0/2338338298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46ac0cd840 0x7f46ac1e4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 -- 172.21.15.146:0/2338338298 >> 172.21.15.146:0/2338338298 conn(0x7f46ac0b3150 msgr2=0x7f46ac070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 -- 172.21.15.146:0/2338338298 shutdown_connections 2024-09-17T03:37:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.596+0000 7f46b0c1d640 1 -- 172.21.15.146:0/2338338298 wait complete. 2024-09-17T03:37:02.607 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-17T03:37:01.851457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592688,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":141,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":290720,"kb_used_data":7916,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754684000,"statfs":{"total":773094113280,"available":772796416000,"internally_reserved":0,"allocated":8105984,"data_stored":4103002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":289394225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2320,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.283468"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.622136+0000","last_change":"2024-09-17T03:36:58.617054+0000","last_active":"2024-09-17T03:36:58.622136+0000","last_peered":"2024-09-17T03:36:58.622136+0000","last_clean":"2024-09-17T03:36:58.622136+0000","last_became_active":"2024-09-17T03:36:58.616715+0000","last_became_peered":"2024-09-17T03:36:58.616715+0000","last_unstale":"2024-09-17T03:36:58.622136+0000","last_undegraded":"2024-09-17T03:36:58.622136+0000","last_fullsized":"2024-09-17T03:36:58.622136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:27.445679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.616794+0000","last_change":"2024-09-17T03:36:58.613591+0000","last_active":"2024-09-17T03:36:58.616794+0000","last_peered":"2024-09-17T03:36:58.616794+0000","last_clean":"2024-09-17T03:36:58.616794+0000","last_became_active":"2024-09-17T03:36:58.613190+0000","last_became_peered":"2024-09-17T03:36:58.613190+0000","last_unstale":"2024-09-17T03:36:58.616794+0000","last_undegraded":"2024-09-17T03:36:58.616794+0000","last_fullsized":"2024-09-17T03:36:58.616794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:35.898980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.607671+0000","last_change":"2024-09-17T03:36:58.605913+0000","last_active":"2024-09-17T03:36:58.607671+0000","last_peered":"2024-09-17T03:36:58.607671+0000","last_clean":"2024-09-17T03:36:58.607671+0000","last_became_active":"2024-09-17T03:36:58.605551+0000","last_became_peered":"2024-09-17T03:36:58.605551+0000","last_unstale":"2024-09-17T03:36:58.607671+0000","last_undegraded":"2024-09-17T03:36:58.607671+0000","last_fullsized":"2024-09-17T03:36:58.607671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:25.911924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619985+0000","last_change":"2024-09-17T03:36:58.616318+0000","last_active":"2024-09-17T03:36:58.619985+0000","last_peered":"2024-09-17T03:36:58.619985+0000","last_clean":"2024-09-17T03:36:58.619985+0000","last_became_active":"2024-09-17T03:36:58.615972+0000","last_became_peered":"2024-09-17T03:36:58.615972+0000","last_unstale":"2024-09-17T03:36:58.619985+0000","last_undegraded":"2024-09-17T03:36:58.619985+0000","last_fullsized":"2024-09-17T03:36:58.619985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:09.798475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.616821+0000","last_change":"2024-09-17T03:36:58.613048+0000","last_active":"2024-09-17T03:36:58.616821+0000","last_peered":"2024-09-17T03:36:58.616821+0000","last_clean":"2024-09-17T03:36:58.616821+0000","last_became_active":"2024-09-17T03:36:58.612726+0000","last_became_peered":"2024-09-17T03:36:58.612726+0000","last_unstale":"2024-09-17T03:36:58.616821+0000","last_undegraded":"2024-09-17T03:36:58.616821+0000","last_fullsized":"2024-09-17T03:36:58.616821+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.538161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615310+0000","last_change":"2024-09-17T03:36:58.608044+0000","last_active":"2024-09-17T03:36:58.615310+0000","last_peered":"2024-09-17T03:36:58.615310+0000","last_clean":"2024-09-17T03:36:58.615310+0000","last_became_active":"2024-09-17T03:36:58.607155+0000","last_became_peered":"2024-09-17T03:36:58.607155+0000","last_unstale":"2024-09-17T03:36:58.615310+0000","last_undegraded":"2024-09-17T03:36:58.615310+0000","last_fullsized":"2024-09-17T03:36:58.615310+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:08.826637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619374+0000","last_change":"2024-09-17T03:36:58.614210+0000","last_active":"2024-09-17T03:36:58.619374+0000","last_peered":"2024-09-17T03:36:58.619374+0000","last_clean":"2024-09-17T03:36:58.619374+0000","last_became_active":"2024-09-17T03:36:58.613913+0000","last_became_peered":"2024-09-17T03:36:58.613913+0000","last_unstale":"2024-09-17T03:36:58.619374+0000","last_undegraded":"2024-09-17T03:36:58.619374+0000","last_fullsized":"2024-09-17T03:36:58.619374+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:25.068863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.611663+0000","last_change":"2024-09-17T03:36:58.607751+0000","last_active":"2024-09-17T03:36:58.611663+0000","last_peered":"2024-09-17T03:36:58.611663+0000","last_clean":"2024-09-17T03:36:58.611663+0000","last_became_active":"2024-09-17T03:36:58.607444+0000","last_became_peered":"2024-09-17T03:36:58.607444+0000","last_unstale":"2024-09-17T03:36:58.611663+0000","last_undegraded":"2024-09-17T03:36:58.611663+0000","last_fullsized":"2024-09-17T03:36:58.611663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:09.197304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615443+0000","last_change":"2024-09-17T03:36:58.612036+0000","last_active":"2024-09-17T03:36:58.615443+0000","last_peered":"2024-09-17T03:36:58.615443+0000","last_clean":"2024-09-17T03:36:58.615443+0000","last_became_active":"2024-09-17T03:36:58.611664+0000","last_became_peered":"2024-09-17T03:36:58.611664+0000","last_unstale":"2024-09-17T03:36:58.615443+0000","last_undegraded":"2024-09-17T03:36:58.615443+0000","last_fullsized":"2024-09-17T03:36:58.615443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:47.066196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.605298+0000","last_change":"2024-09-17T03:36:58.603439+0000","last_active":"2024-09-17T03:36:58.605298+0000","last_peered":"2024-09-17T03:36:58.605298+0000","last_clean":"2024-09-17T03:36:58.605298+0000","last_became_active":"2024-09-17T03:36:58.603155+0000","last_became_peered":"2024-09-17T03:36:58.603155+0000","last_unstale":"2024-09-17T03:36:58.605298+0000","last_undegraded":"2024-09-17T03:36:58.605298+0000","last_fullsized":"2024-09-17T03:36:58.605298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:33.418376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614721+0000","last_change":"2024-09-17T03:36:58.611787+0000","last_active":"2024-09-17T03:36:58.614721+0000","last_peered":"2024-09-17T03:36:58.614721+0000","last_clean":"2024-09-17T03:36:58.614721+0000","last_became_active":"2024-09-17T03:36:58.611492+0000","last_became_peered":"2024-09-17T03:36:58.611492+0000","last_unstale":"2024-09-17T03:36:58.614721+0000","last_undegraded":"2024-09-17T03:36:58.614721+0000","last_fullsized":"2024-09-17T03:36:58.614721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:20.680288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618331+0000","last_change":"2024-09-17T03:36:58.612245+0000","last_active":"2024-09-17T03:36:58.618331+0000","last_peered":"2024-09-17T03:36:58.618331+0000","last_clean":"2024-09-17T03:36:58.618331+0000","last_became_active":"2024-09-17T03:36:58.611923+0000","last_became_peered":"2024-09-17T03:36:58.611923+0000","last_unstale":"2024-09-17T03:36:58.618331+0000","last_undegraded":"2024-09-17T03:36:58.618331+0000","last_fullsized":"2024-09-17T03:36:58.618331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:29.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613136+0000","last_change":"2024-09-17T03:36:58.605653+0000","last_active":"2024-09-17T03:36:58.613136+0000","last_peered":"2024-09-17T03:36:58.613136+0000","last_clean":"2024-09-17T03:36:58.613136+0000","last_became_active":"2024-09-17T03:36:58.605358+0000","last_became_peered":"2024-09-17T03:36:58.605358+0000","last_unstale":"2024-09-17T03:36:58.613136+0000","last_undegraded":"2024-09-17T03:36:58.613136+0000","last_fullsized":"2024-09-17T03:36:58.613136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:38.335687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609157+0000","last_change":"2024-09-17T03:36:58.603629+0000","last_active":"2024-09-17T03:36:58.609157+0000","last_peered":"2024-09-17T03:36:58.609157+0000","last_clean":"2024-09-17T03:36:58.609157+0000","last_became_active":"2024-09-17T03:36:58.602937+0000","last_became_peered":"2024-09-17T03:36:58.602937+0000","last_unstale":"2024-09-17T03:36:58.609157+0000","last_undegraded":"2024-09-17T03:36:58.609157+0000","last_fullsized":"2024-09-17T03:36:58.609157+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:50.782400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618660+0000","last_change":"2024-09-17T03:36:58.611332+0000","last_active":"2024-09-17T03:36:58.618660+0000","last_peered":"2024-09-17T03:36:58.618660+0000","last_clean":"2024-09-17T03:36:58.618660+0000","last_became_active":"2024-09-17T03:36:58.611024+0000","last_became_peered":"2024-09-17T03:36:58.611024+0000","last_unstale":"2024-09-17T03:36:58.618660+0000","last_undegraded":"2024-09-17T03:36:58.618660+0000","last_fullsized":"2024-09-17T03:36:58.618660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:44.315656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615625+0000","last_change":"2024-09-17T03:36:58.609578+0000","last_active":"2024-09-17T03:36:58.615625+0000","last_peered":"2024-09-17T03:36:58.615625+0000","last_clean":"2024-09-17T03:36:58.615625+0000","last_became_active":"2024-09-17T03:36:58.609270+0000","last_became_peered":"2024-09-17T03:36:58.609270+0000","last_unstale":"2024-09-17T03:36:58.615625+0000","last_undegraded":"2024-09-17T03:36:58.615625+0000","last_fullsized":"2024-09-17T03:36:58.615625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:34.917655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614907+0000","last_change":"2024-09-17T03:36:58.604940+0000","last_active":"2024-09-17T03:36:58.614907+0000","last_peered":"2024-09-17T03:36:58.614907+0000","last_clean":"2024-09-17T03:36:58.614907+0000","last_became_active":"2024-09-17T03:36:58.604635+0000","last_became_peered":"2024-09-17T03:36:58.604635+0000","last_unstale":"2024-09-17T03:36:58.614907+0000","last_undegraded":"2024-09-17T03:36:58.614907+0000","last_fullsized":"2024-09-17T03:36:58.614907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:34.917655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613174+0000","last_change":"2024-09-17T03:36:58.604263+0000","last_active":"2024-09-17T03:36:58.613174+0000","last_peered":"2024-09-17T03:36:58.613174+0000","last_clean":"2024-09-17T03:36:58.613174+0000","last_became_active":"2024-09-17T03:36:58.603672+0000","last_became_peered":"2024-09-17T03:36:58.603672+0000","last_unstale":"2024-09-17T03:36:58.613174+0000","last_undegraded":"2024-09-17T03:36:58.613174+0000","last_fullsized":"2024-09-17T03:36:58.613174+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:30.276913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.611765+0000","last_change":"2024-09-17T03:36:58.601622+0000","last_active":"2024-09-17T03:36:58.611765+0000","last_peered":"2024-09-17T03:36:58.611765+0000","last_clean":"2024-09-17T03:36:58.611765+0000","last_became_active":"2024-09-17T03:36:58.601303+0000","last_became_peered":"2024-09-17T03:36:58.601303+0000","last_unstale":"2024-09-17T03:36:58.611765+0000","last_undegraded":"2024-09-17T03:36:58.611765+0000","last_fullsized":"2024-09-17T03:36:58.611765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:31.989872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613826+0000","last_change":"2024-09-17T03:36:58.610601+0000","last_active":"2024-09-17T03:36:58.613826+0000","last_peered":"2024-09-17T03:36:58.613826+0000","last_clean":"2024-09-17T03:36:58.613826+0000","last_became_active":"2024-09-17T03:36:58.610255+0000","last_became_peered":"2024-09-17T03:36:58.610255+0000","last_unstale":"2024-09-17T03:36:58.613826+0000","last_undegraded":"2024-09-17T03:36:58.613826+0000","last_fullsized":"2024-09-17T03:36:58.613826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:54.883572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.607235+0000","last_change":"2024-09-17T03:36:58.604903+0000","last_active":"2024-09-17T03:36:58.607235+0000","last_peered":"2024-09-17T03:36:58.607235+0000","last_clean":"2024-09-17T03:36:58.607235+0000","last_became_active":"2024-09-17T03:36:58.604570+0000","last_became_peered":"2024-09-17T03:36:58.604570+0000","last_unstale":"2024-09-17T03:36:58.607235+0000","last_undegraded":"2024-09-17T03:36:58.607235+0000","last_fullsized":"2024-09-17T03:36:58.607235+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:32.468155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615436+0000","last_change":"2024-09-17T03:36:58.611647+0000","last_active":"2024-09-17T03:36:58.615436+0000","last_peered":"2024-09-17T03:36:58.615436+0000","last_clean":"2024-09-17T03:36:58.615436+0000","last_became_active":"2024-09-17T03:36:58.611306+0000","last_became_peered":"2024-09-17T03:36:58.611306+0000","last_unstale":"2024-09-17T03:36:58.615436+0000","last_undegraded":"2024-09-17T03:36:58.615436+0000","last_fullsized":"2024-09-17T03:36:58.615436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:44.377859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609013+0000","last_change":"2024-09-17T03:36:58.601635+0000","last_active":"2024-09-17T03:36:58.609013+0000","last_peered":"2024-09-17T03:36:58.609013+0000","last_clean":"2024-09-17T03:36:58.609013+0000","last_became_active":"2024-09-17T03:36:58.601341+0000","last_became_peered":"2024-09-17T03:36:58.601341+0000","last_unstale":"2024-09-17T03:36:58.609013+0000","last_undegraded":"2024-09-17T03:36:58.609013+0000","last_fullsized":"2024-09-17T03:36:58.609013+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:39.072061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613572+0000","last_change":"2024-09-17T03:36:58.610689+0000","last_active":"2024-09-17T03:36:58.613572+0000","last_peered":"2024-09-17T03:36:58.613572+0000","last_clean":"2024-09-17T03:36:58.613572+0000","last_became_active":"2024-09-17T03:36:58.610241+0000","last_became_peered":"2024-09-17T03:36:58.610241+0000","last_unstale":"2024-09-17T03:36:58.613572+0000","last_undegraded":"2024-09-17T03:36:58.613572+0000","last_fullsized":"2024-09-17T03:36:58.613572+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:29.450418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615569+0000","last_change":"2024-09-17T03:36:58.610171+0000","last_active":"2024-09-17T03:36:58.615569+0000","last_peered":"2024-09-17T03:36:58.615569+0000","last_clean":"2024-09-17T03:36:58.615569+0000","last_became_active":"2024-09-17T03:36:58.609749+0000","last_became_peered":"2024-09-17T03:36:58.609749+0000","last_unstale":"2024-09-17T03:36:58.615569+0000","last_undegraded":"2024-09-17T03:36:58.615569+0000","last_fullsized":"2024-09-17T03:36:58.615569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:22.607257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.621860+0000","last_change":"2024-09-17T03:36:58.616100+0000","last_active":"2024-09-17T03:36:58.621860+0000","last_peered":"2024-09-17T03:36:58.621860+0000","last_clean":"2024-09-17T03:36:58.621860+0000","last_became_active":"2024-09-17T03:36:58.615736+0000","last_became_peered":"2024-09-17T03:36:58.615736+0000","last_unstale":"2024-09-17T03:36:58.621860+0000","last_undegraded":"2024-09-17T03:36:58.621860+0000","last_fullsized":"2024-09-17T03:36:58.621860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:05.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.622050+0000","last_change":"2024-09-17T03:36:57.593446+0000","last_active":"2024-09-17T03:36:58.622050+0000","last_peered":"2024-09-17T03:36:58.622050+0000","last_clean":"2024-09-17T03:36:58.622050+0000","last_became_active":"2024-09-17T03:36:57.592914+0000","last_became_peered":"2024-09-17T03:36:57.592914+0000","last_unstale":"2024-09-17T03:36:58.622050+0000","last_undegraded":"2024-09-17T03:36:58.622050+0000","last_fullsized":"2024-09-17T03:36:58.622050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:04.448726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618631+0000","last_change":"2024-09-17T03:36:58.610586+0000","last_active":"2024-09-17T03:36:58.618631+0000","last_peered":"2024-09-17T03:36:58.618631+0000","last_clean":"2024-09-17T03:36:58.618631+0000","last_became_active":"2024-09-17T03:36:58.610274+0000","last_became_peered":"2024-09-17T03:36:58.610274+0000","last_unstale":"2024-09-17T03:36:58.618631+0000","last_undegraded":"2024-09-17T03:36:58.618631+0000","last_fullsized":"2024-09-17T03:36:58.618631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:50.836681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.620215+0000","last_change":"2024-09-17T03:36:57.585526+0000","last_active":"2024-09-17T03:36:58.620215+0000","last_peered":"2024-09-17T03:36:58.620215+0000","last_clean":"2024-09-17T03:36:58.620215+0000","last_became_active":"2024-09-17T03:36:57.585185+0000","last_became_peered":"2024-09-17T03:36:57.585185+0000","last_unstale":"2024-09-17T03:36:58.620215+0000","last_undegraded":"2024-09-17T03:36:58.620215+0000","last_fullsized":"2024-09-17T03:36:58.620215+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:01.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615168+0000","last_change":"2024-09-17T03:36:58.604536+0000","last_active":"2024-09-17T03:36:58.615168+0000","last_peered":"2024-09-17T03:36:58.615168+0000","last_clean":"2024-09-17T03:36:58.615168+0000","last_became_active":"2024-09-17T03:36:58.604117+0000","last_became_peered":"2024-09-17T03:36:58.604117+0000","last_unstale":"2024-09-17T03:36:58.615168+0000","last_undegraded":"2024-09-17T03:36:58.615168+0000","last_fullsized":"2024-09-17T03:36:58.615168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:42.334459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624127+0000","last_change":"2024-09-17T03:36:57.584256+0000","last_active":"2024-09-17T03:36:58.624127+0000","last_peered":"2024-09-17T03:36:58.624127+0000","last_clean":"2024-09-17T03:36:58.624127+0000","last_became_active":"2024-09-17T03:36:57.583832+0000","last_became_peered":"2024-09-17T03:36:57.583832+0000","last_unstale":"2024-09-17T03:36:58.624127+0000","last_undegraded":"2024-09-17T03:36:58.624127+0000","last_fullsized":"2024-09-17T03:36:58.624127+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:48.077004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610216+0000","last_change":"2024-09-17T03:36:58.608312+0000","last_active":"2024-09-17T03:36:58.610216+0000","last_peered":"2024-09-17T03:36:58.610216+0000","last_clean":"2024-09-17T03:36:58.610216+0000","last_became_active":"2024-09-17T03:36:58.607981+0000","last_became_peered":"2024-09-17T03:36:58.607981+0000","last_unstale":"2024-09-17T03:36:58.610216+0000","last_undegraded":"2024-09-17T03:36:58.610216+0000","last_fullsized":"2024-09-17T03:36:58.610216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:26.016580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623739+0000","last_change":"2024-09-17T03:36:57.593693+0000","last_active":"2024-09-17T03:36:58.623739+0000","last_peered":"2024-09-17T03:36:58.623739+0000","last_clean":"2024-09-17T03:36:58.623739+0000","last_became_active":"2024-09-17T03:36:57.593350+0000","last_became_peered":"2024-09-17T03:36:57.593350+0000","last_unstale":"2024-09-17T03:36:58.623739+0000","last_undegraded":"2024-09-17T03:36:58.623739+0000","last_fullsized":"2024-09-17T03:36:58.623739+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:32.413220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.576417+0000","last_change":"2024-09-17T03:36:56.576417+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.576417+0000","last_undegraded":"2024-09-17T03:36:56.576417+0000","last_fullsized":"2024-09-17T03:36:56.576417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614506+0000","last_change":"2024-09-17T03:36:58.612378+0000","last_active":"2024-09-17T03:36:58.614506+0000","last_peered":"2024-09-17T03:36:58.614506+0000","last_clean":"2024-09-17T03:36:58.614506+0000","last_became_active":"2024-09-17T03:36:58.612031+0000","last_became_peered":"2024-09-17T03:36:58.612031+0000","last_unstale":"2024-09-17T03:36:58.614506+0000","last_undegraded":"2024-09-17T03:36:58.614506+0000","last_fullsized":"2024-09-17T03:36:58.614506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:08.513728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623848+0000","last_change":"2024-09-17T03:36:57.590622+0000","last_active":"2024-09-17T03:36:58.623848+0000","last_peered":"2024-09-17T03:36:58.623848+0000","last_clean":"2024-09-17T03:36:58.623848+0000","last_became_active":"2024-09-17T03:36:57.590266+0000","last_became_peered":"2024-09-17T03:36:57.590266+0000","last_unstale":"2024-09-17T03:36:58.623848+0000","last_undegraded":"2024-09-17T03:36:58.623848+0000","last_fullsized":"2024-09-17T03:36:58.623848+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:55.095810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619669+0000","last_change":"2024-09-17T03:36:58.612013+0000","last_active":"2024-09-17T03:36:58.619669+0000","last_peered":"2024-09-17T03:36:58.619669+0000","last_clean":"2024-09-17T03:36:58.619669+0000","last_became_active":"2024-09-17T03:36:58.611745+0000","last_became_peered":"2024-09-17T03:36:58.611745+0000","last_unstale":"2024-09-17T03:36:58.619669+0000","last_undegraded":"2024-09-17T03:36:58.619669+0000","last_fullsized":"2024-09-17T03:36:58.619669+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:57.877593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.589675+0000","last_change":"2024-09-17T03:36:57.590493+0000","last_active":"2024-09-17T03:36:58.589675+0000","last_peered":"2024-09-17T03:36:58.589675+0000","last_clean":"2024-09-17T03:36:58.589675+0000","last_became_active":"2024-09-17T03:36:57.590157+0000","last_became_peered":"2024-09-17T03:36:57.590157+0000","last_unstale":"2024-09-17T03:36:58.589675+0000","last_undegraded":"2024-09-17T03:36:58.589675+0000","last_fullsized":"2024-09-17T03:36:58.589675+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:45.348233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613107+0000","last_change":"2024-09-17T03:36:58.604882+0000","last_active":"2024-09-17T03:36:58.613107+0000","last_peered":"2024-09-17T03:36:58.613107+0000","last_clean":"2024-09-17T03:36:58.613107+0000","last_became_active":"2024-09-17T03:36:58.604597+0000","last_became_peered":"2024-09-17T03:36:58.604597+0000","last_unstale":"2024-09-17T03:36:58.613107+0000","last_undegraded":"2024-09-17T03:36:58.613107+0000","last_fullsized":"2024-09-17T03:36:58.613107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:26.075265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.595824+0000","last_change":"2024-09-17T03:36:57.586393+0000","last_active":"2024-09-17T03:36:58.595824+0000","last_peered":"2024-09-17T03:36:58.595824+0000","last_clean":"2024-09-17T03:36:58.595824+0000","last_became_active":"2024-09-17T03:36:57.586120+0000","last_became_peered":"2024-09-17T03:36:57.586120+0000","last_unstale":"2024-09-17T03:36:58.595824+0000","last_undegraded":"2024-09-17T03:36:58.595824+0000","last_fullsized":"2024-09-17T03:36:58.595824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:47.246300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597464+0000","last_change":"2024-09-17T03:36:57.589422+0000","last_active":"2024-09-17T03:36:58.597464+0000","last_peered":"2024-09-17T03:36:58.597464+0000","last_clean":"2024-09-17T03:36:58.597464+0000","last_became_active":"2024-09-17T03:36:57.589098+0000","last_became_peered":"2024-09-17T03:36:57.589098+0000","last_unstale":"2024-09-17T03:36:58.597464+0000","last_undegraded":"2024-09-17T03:36:58.597464+0000","last_fullsized":"2024-09-17T03:36:58.597464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:39.093916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.606985+0000","last_change":"2024-09-17T03:36:58.604411+0000","last_active":"2024-09-17T03:36:58.606985+0000","last_peered":"2024-09-17T03:36:58.606985+0000","last_clean":"2024-09-17T03:36:58.606985+0000","last_became_active":"2024-09-17T03:36:58.604012+0000","last_became_peered":"2024-09-17T03:36:58.604012+0000","last_unstale":"2024-09-17T03:36:58.606985+0000","last_undegraded":"2024-09-17T03:36:58.606985+0000","last_fullsized":"2024-09-17T03:36:58.606985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:12.827748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598400+0000","last_change":"2024-09-17T03:36:57.596267+0000","last_active":"2024-09-17T03:36:58.598400+0000","last_peered":"2024-09-17T03:36:58.598400+0000","last_clean":"2024-09-17T03:36:58.598400+0000","last_became_active":"2024-09-17T03:36:57.595964+0000","last_became_peered":"2024-09-17T03:36:57.595964+0000","last_unstale":"2024-09-17T03:36:58.598400+0000","last_undegraded":"2024-09-17T03:36:58.598400+0000","last_fullsized":"2024-09-17T03:36:58.598400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:52.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.617051+0000","last_change":"2024-09-17T03:36:58.613987+0000","last_active":"2024-09-17T03:36:58.617051+0000","last_peered":"2024-09-17T03:36:58.617051+0000","last_clean":"2024-09-17T03:36:58.617051+0000","last_became_active":"2024-09-17T03:36:58.612963+0000","last_became_peered":"2024-09-17T03:36:58.612963+0000","last_unstale":"2024-09-17T03:36:58.617051+0000","last_undegraded":"2024-09-17T03:36:58.617051+0000","last_fullsized":"2024-09-17T03:36:58.617051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:31.989872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.576586+0000","last_change":"2024-09-17T03:36:56.576586+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.576586+0000","last_undegraded":"2024-09-17T03:36:56.576586+0000","last_fullsized":"2024-09-17T03:36:56.576586+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609397+0000","last_change":"2024-09-17T03:36:58.606960+0000","last_active":"2024-09-17T03:36:58.609397+0000","last_peered":"2024-09-17T03:36:58.609397+0000","last_clean":"2024-09-17T03:36:58.609397+0000","last_became_active":"2024-09-17T03:36:58.606534+0000","last_became_peered":"2024-09-17T03:36:58.606534+0000","last_unstale":"2024-09-17T03:36:58.609397+0000","last_undegraded":"2024-09-17T03:36:58.609397+0000","last_fullsized":"2024-09-17T03:36:58.609397+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:32.744450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623982+0000","last_change":"2024-09-17T03:36:57.583631+0000","last_active":"2024-09-17T03:36:58.623982+0000","last_peered":"2024-09-17T03:36:58.623982+0000","last_clean":"2024-09-17T03:36:58.623982+0000","last_became_active":"2024-09-17T03:36:57.583303+0000","last_became_peered":"2024-09-17T03:36:57.583303+0000","last_unstale":"2024-09-17T03:36:58.623982+0000","last_undegraded":"2024-09-17T03:36:58.623982+0000","last_fullsized":"2024-09-17T03:36:58.623982+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:52.808091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610116+0000","last_change":"2024-09-17T03:36:58.608223+0000","last_active":"2024-09-17T03:36:58.610116+0000","last_peered":"2024-09-17T03:36:58.610116+0000","last_clean":"2024-09-17T03:36:58.610116+0000","last_became_active":"2024-09-17T03:36:58.607909+0000","last_became_peered":"2024-09-17T03:36:58.607909+0000","last_unstale":"2024-09-17T03:36:58.610116+0000","last_undegraded":"2024-09-17T03:36:58.610116+0000","last_fullsized":"2024-09-17T03:36:58.610116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:40.743100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619256+0000","last_change":"2024-09-17T03:36:57.594639+0000","last_active":"2024-09-17T03:36:58.619256+0000","last_peered":"2024-09-17T03:36:58.619256+0000","last_clean":"2024-09-17T03:36:58.619256+0000","last_became_active":"2024-09-17T03:36:57.594225+0000","last_became_peered":"2024-09-17T03:36:57.594225+0000","last_unstale":"2024-09-17T03:36:58.619256+0000","last_undegraded":"2024-09-17T03:36:58.619256+0000","last_fullsized":"2024-09-17T03:36:58.619256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.745067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597196+0000","last_change":"2024-09-17T03:36:57.582416+0000","last_active":"2024-09-17T03:36:58.597196+0000","last_peered":"2024-09-17T03:36:58.597196+0000","last_clean":"2024-09-17T03:36:58.597196+0000","last_became_active":"2024-09-17T03:36:57.582075+0000","last_became_peered":"2024-09-17T03:36:57.582075+0000","last_unstale":"2024-09-17T03:36:58.597196+0000","last_undegraded":"2024-09-17T03:36:58.597196+0000","last_fullsized":"2024-09-17T03:36:58.597196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:39.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615044+0000","last_change":"2024-09-17T03:36:58.614063+0000","last_active":"2024-09-17T03:36:58.615044+0000","last_peered":"2024-09-17T03:36:58.615044+0000","last_clean":"2024-09-17T03:36:58.615044+0000","last_became_active":"2024-09-17T03:36:58.613765+0000","last_became_peered":"2024-09-17T03:36:58.613765+0000","last_unstale":"2024-09-17T03:36:58.615044+0000","last_undegraded":"2024-09-17T03:36:58.615044+0000","last_fullsized":"2024-09-17T03:36:58.615044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:19.612415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.578179+0000","last_change":"2024-09-17T03:36:56.578179+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.578179+0000","last_undegraded":"2024-09-17T03:36:56.578179+0000","last_fullsized":"2024-09-17T03:36:56.578179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619653+0000","last_change":"2024-09-17T03:36:58.615101+0000","last_active":"2024-09-17T03:36:58.619653+0000","last_peered":"2024-09-17T03:36:58.619653+0000","last_clean":"2024-09-17T03:36:58.619653+0000","last_became_active":"2024-09-17T03:36:58.614759+0000","last_became_peered":"2024-09-17T03:36:58.614759+0000","last_unstale":"2024-09-17T03:36:58.619653+0000","last_undegraded":"2024-09-17T03:36:58.619653+0000","last_fullsized":"2024-09-17T03:36:58.619653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:57.046686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.626931+0000","last_change":"2024-09-17T03:36:57.590811+0000","last_active":"2024-09-17T03:36:58.626931+0000","last_peered":"2024-09-17T03:36:58.626931+0000","last_clean":"2024-09-17T03:36:58.626931+0000","last_became_active":"2024-09-17T03:36:57.590493+0000","last_became_peered":"2024-09-17T03:36:57.590493+0000","last_unstale":"2024-09-17T03:36:58.626931+0000","last_undegraded":"2024-09-17T03:36:58.626931+0000","last_fullsized":"2024-09-17T03:36:58.626931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:36.950013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.608959+0000","last_change":"2024-09-17T03:36:58.603205+0000","last_active":"2024-09-17T03:36:58.608959+0000","last_peered":"2024-09-17T03:36:58.608959+0000","last_clean":"2024-09-17T03:36:58.608959+0000","last_became_active":"2024-09-17T03:36:58.602879+0000","last_became_peered":"2024-09-17T03:36:58.602879+0000","last_unstale":"2024-09-17T03:36:58.608959+0000","last_undegraded":"2024-09-17T03:36:58.608959+0000","last_fullsized":"2024-09-17T03:36:58.608959+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:15.337006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624130+0000","last_change":"2024-09-17T03:36:57.591724+0000","last_active":"2024-09-17T03:36:58.624130+0000","last_peered":"2024-09-17T03:36:58.624130+0000","last_clean":"2024-09-17T03:36:58.624130+0000","last_became_active":"2024-09-17T03:36:57.591423+0000","last_became_peered":"2024-09-17T03:36:57.591423+0000","last_unstale":"2024-09-17T03:36:58.624130+0000","last_undegraded":"2024-09-17T03:36:58.624130+0000","last_fullsized":"2024-09-17T03:36:58.624130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:47.502370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.608531+0000","last_change":"2024-09-17T03:36:58.606423+0000","last_active":"2024-09-17T03:36:58.608531+0000","last_peered":"2024-09-17T03:36:58.608531+0000","last_clean":"2024-09-17T03:36:58.608531+0000","last_became_active":"2024-09-17T03:36:58.606054+0000","last_became_peered":"2024-09-17T03:36:58.606054+0000","last_unstale":"2024-09-17T03:36:58.608531+0000","last_undegraded":"2024-09-17T03:36:58.608531+0000","last_fullsized":"2024-09-17T03:36:58.608531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:37.194170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623685+0000","last_change":"2024-09-17T03:36:57.584163+0000","last_active":"2024-09-17T03:36:58.623685+0000","last_peered":"2024-09-17T03:36:58.623685+0000","last_clean":"2024-09-17T03:36:58.623685+0000","last_became_active":"2024-09-17T03:36:57.583706+0000","last_became_peered":"2024-09-17T03:36:57.583706+0000","last_unstale":"2024-09-17T03:36:58.623685+0000","last_undegraded":"2024-09-17T03:36:58.623685+0000","last_fullsized":"2024-09-17T03:36:58.623685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:12.542540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.605257+0000","last_change":"2024-09-17T03:36:58.603373+0000","last_active":"2024-09-17T03:36:58.605257+0000","last_peered":"2024-09-17T03:36:58.605257+0000","last_clean":"2024-09-17T03:36:58.605257+0000","last_became_active":"2024-09-17T03:36:58.602742+0000","last_became_peered":"2024-09-17T03:36:58.602742+0000","last_unstale":"2024-09-17T03:36:58.605257+0000","last_undegraded":"2024-09-17T03:36:58.605257+0000","last_fullsized":"2024-09-17T03:36:58.605257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:53.456094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624389+0000","last_change":"2024-09-17T03:36:57.597237+0000","last_active":"2024-09-17T03:36:58.624389+0000","last_peered":"2024-09-17T03:36:58.624389+0000","last_clean":"2024-09-17T03:36:58.624389+0000","last_became_active":"2024-09-17T03:36:57.596927+0000","last_became_peered":"2024-09-17T03:36:57.596927+0000","last_unstale":"2024-09-17T03:36:58.624389+0000","last_undegraded":"2024-09-17T03:36:58.624389+0000","last_fullsized":"2024-09-17T03:36:58.624389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:45.348233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619628+0000","last_change":"2024-09-17T03:36:58.615051+0000","last_active":"2024-09-17T03:36:58.619628+0000","last_peered":"2024-09-17T03:36:58.619628+0000","last_clean":"2024-09-17T03:36:58.619628+0000","last_became_active":"2024-09-17T03:36:58.614727+0000","last_became_peered":"2024-09-17T03:36:58.614727+0000","last_unstale":"2024-09-17T03:36:58.619628+0000","last_undegraded":"2024-09-17T03:36:58.619628+0000","last_fullsized":"2024-09-17T03:36:58.619628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:29.560429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597705+0000","last_change":"2024-09-17T03:36:57.592743+0000","last_active":"2024-09-17T03:36:58.597705+0000","last_peered":"2024-09-17T03:36:58.597705+0000","last_clean":"2024-09-17T03:36:58.597705+0000","last_became_active":"2024-09-17T03:36:57.592410+0000","last_became_peered":"2024-09-17T03:36:57.592410+0000","last_unstale":"2024-09-17T03:36:58.597705+0000","last_undegraded":"2024-09-17T03:36:58.597705+0000","last_fullsized":"2024-09-17T03:36:58.597705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:37.445030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598168+0000","last_change":"2024-09-17T03:36:57.589575+0000","last_active":"2024-09-17T03:36:58.598168+0000","last_peered":"2024-09-17T03:36:58.598168+0000","last_clean":"2024-09-17T03:36:58.598168+0000","last_became_active":"2024-09-17T03:36:57.589106+0000","last_became_peered":"2024-09-17T03:36:57.589106+0000","last_unstale":"2024-09-17T03:36:58.598168+0000","last_undegraded":"2024-09-17T03:36:58.598168+0000","last_fullsized":"2024-09-17T03:36:58.598168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.745067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.577559+0000","last_change":"2024-09-17T03:36:56.577559+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.577559+0000","last_undegraded":"2024-09-17T03:36:56.577559+0000","last_fullsized":"2024-09-17T03:36:56.577559+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.594386+0000","last_change":"2024-09-17T03:36:57.588964+0000","last_active":"2024-09-17T03:36:58.594386+0000","last_peered":"2024-09-17T03:36:58.594386+0000","last_clean":"2024-09-17T03:36:58.594386+0000","last_became_active":"2024-09-17T03:36:57.588619+0000","last_became_peered":"2024-09-17T03:36:57.588619+0000","last_unstale":"2024-09-17T03:36:58.594386+0000","last_undegraded":"2024-09-17T03:36:58.594386+0000","last_fullsized":"2024-09-17T03:36:58.594386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:47.054594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.606961+0000","last_change":"2024-09-17T03:36:58.602742+0000","last_active":"2024-09-17T03:36:58.606961+0000","last_peered":"2024-09-17T03:36:58.606961+0000","last_clean":"2024-09-17T03:36:58.606961+0000","last_became_active":"2024-09-17T03:36:58.602421+0000","last_became_peered":"2024-09-17T03:36:58.602421+0000","last_unstale":"2024-09-17T03:36:58.606961+0000","last_undegraded":"2024-09-17T03:36:58.606961+0000","last_fullsized":"2024-09-17T03:36:58.606961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:17.471850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623980+0000","last_change":"2024-09-17T03:36:57.590905+0000","last_active":"2024-09-17T03:36:58.623980+0000","last_peered":"2024-09-17T03:36:58.623980+0000","last_clean":"2024-09-17T03:36:58.623980+0000","last_became_active":"2024-09-17T03:36:57.590517+0000","last_became_peered":"2024-09-17T03:36:57.590517+0000","last_unstale":"2024-09-17T03:36:58.623980+0000","last_undegraded":"2024-09-17T03:36:58.623980+0000","last_fullsized":"2024-09-17T03:36:58.623980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:24.906768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.577611+0000","last_change":"2024-09-17T03:36:56.577611+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.577611+0000","last_undegraded":"2024-09-17T03:36:56.577611+0000","last_fullsized":"2024-09-17T03:36:56.577611+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.621811+0000","last_change":"2024-09-17T03:36:58.616039+0000","last_active":"2024-09-17T03:36:58.621811+0000","last_peered":"2024-09-17T03:36:58.621811+0000","last_clean":"2024-09-17T03:36:58.621811+0000","last_became_active":"2024-09-17T03:36:58.615707+0000","last_became_peered":"2024-09-17T03:36:58.615707+0000","last_unstale":"2024-09-17T03:36:58.621811+0000","last_undegraded":"2024-09-17T03:36:58.621811+0000","last_fullsized":"2024-09-17T03:36:58.621811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:55.971111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598228+0000","last_change":"2024-09-17T03:36:57.585618+0000","last_active":"2024-09-17T03:36:58.598228+0000","last_peered":"2024-09-17T03:36:58.598228+0000","last_clean":"2024-09-17T03:36:58.598228+0000","last_became_active":"2024-09-17T03:36:57.585282+0000","last_became_peered":"2024-09-17T03:36:57.585282+0000","last_unstale":"2024-09-17T03:36:58.598228+0000","last_undegraded":"2024-09-17T03:36:58.598228+0000","last_fullsized":"2024-09-17T03:36:58.598228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:48.269513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610246+0000","last_change":"2024-09-17T03:36:58.608926+0000","last_active":"2024-09-17T03:36:58.610246+0000","last_peered":"2024-09-17T03:36:58.610246+0000","last_clean":"2024-09-17T03:36:58.610246+0000","last_became_active":"2024-09-17T03:36:58.608553+0000","last_became_peered":"2024-09-17T03:36:58.608553+0000","last_unstale":"2024-09-17T03:36:58.610246+0000","last_undegraded":"2024-09-17T03:36:58.610246+0000","last_fullsized":"2024-09-17T03:36:58.610246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.226689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.596785+0000","last_change":"2024-09-17T03:36:57.586327+0000","last_active":"2024-09-17T03:36:58.596785+0000","last_peered":"2024-09-17T03:36:58.596785+0000","last_clean":"2024-09-17T03:36:58.596785+0000","last_became_active":"2024-09-17T03:36:57.586003+0000","last_became_peered":"2024-09-17T03:36:57.586003+0000","last_unstale":"2024-09-17T03:36:58.596785+0000","last_undegraded":"2024-09-17T03:36:58.596785+0000","last_fullsized":"2024-09-17T03:36:58.596785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:12.716534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.620040+0000","last_change":"2024-09-17T03:36:58.616301+0000","last_active":"2024-09-17T03:36:58.620040+0000","last_peered":"2024-09-17T03:36:58.620040+0000","last_clean":"2024-09-17T03:36:58.620040+0000","last_became_active":"2024-09-17T03:36:58.615909+0000","last_became_peered":"2024-09-17T03:36:58.615909+0000","last_unstale":"2024-09-17T03:36:58.620040+0000","last_undegraded":"2024-09-17T03:36:58.620040+0000","last_fullsized":"2024-09-17T03:36:58.620040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:19.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.602015+0000","last_change":"2024-09-17T03:36:57.591187+0000","last_active":"2024-09-17T03:36:58.602015+0000","last_peered":"2024-09-17T03:36:58.602015+0000","last_clean":"2024-09-17T03:36:58.602015+0000","last_became_active":"2024-09-17T03:36:57.590899+0000","last_became_peered":"2024-09-17T03:36:57.590899+0000","last_unstale":"2024-09-17T03:36:58.602015+0000","last_undegraded":"2024-09-17T03:36:58.602015+0000","last_fullsized":"2024-09-17T03:36:58.602015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:02.492050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615388+0000","last_change":"2024-09-17T03:36:58.608391+0000","last_active":"2024-09-17T03:36:58.615388+0000","last_peered":"2024-09-17T03:36:58.615388+0000","last_clean":"2024-09-17T03:36:58.615388+0000","last_became_active":"2024-09-17T03:36:58.608055+0000","last_became_peered":"2024-09-17T03:36:58.608055+0000","last_unstale":"2024-09-17T03:36:58.615388+0000","last_undegraded":"2024-09-17T03:36:58.615388+0000","last_fullsized":"2024-09-17T03:36:58.615388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:22.120747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.589696+0000","last_change":"2024-09-17T03:36:57.590878+0000","last_active":"2024-09-17T03:36:58.589696+0000","last_peered":"2024-09-17T03:36:58.589696+0000","last_clean":"2024-09-17T03:36:58.589696+0000","last_became_active":"2024-09-17T03:36:57.590524+0000","last_became_peered":"2024-09-17T03:36:57.590524+0000","last_unstale":"2024-09-17T03:36:58.589696+0000","last_undegraded":"2024-09-17T03:36:58.589696+0000","last_fullsized":"2024-09-17T03:36:58.589696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:39.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615450+0000","last_change":"2024-09-17T03:36:58.608629+0000","last_active":"2024-09-17T03:36:58.615450+0000","last_peered":"2024-09-17T03:36:58.615450+0000","last_clean":"2024-09-17T03:36:58.615450+0000","last_became_active":"2024-09-17T03:36:58.608327+0000","last_became_peered":"2024-09-17T03:36:58.608327+0000","last_unstale":"2024-09-17T03:36:58.615450+0000","last_undegraded":"2024-09-17T03:36:58.615450+0000","last_fullsized":"2024-09-17T03:36:58.615450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:42.334459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.590574+0000","last_change":"2024-09-17T03:36:57.594939+0000","last_active":"2024-09-17T03:36:58.590574+0000","last_peered":"2024-09-17T03:36:58.590574+0000","last_clean":"2024-09-17T03:36:58.590574+0000","last_became_active":"2024-09-17T03:36:57.594242+0000","last_became_peered":"2024-09-17T03:36:57.594242+0000","last_unstale":"2024-09-17T03:36:58.590574+0000","last_undegraded":"2024-09-17T03:36:58.590574+0000","last_fullsized":"2024-09-17T03:36:58.590574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:07.090365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614864+0000","last_change":"2024-09-17T03:36:58.609686+0000","last_active":"2024-09-17T03:36:58.614864+0000","last_peered":"2024-09-17T03:36:58.614864+0000","last_clean":"2024-09-17T03:36:58.614864+0000","last_became_active":"2024-09-17T03:36:58.609366+0000","last_became_peered":"2024-09-17T03:36:58.609366+0000","last_unstale":"2024-09-17T03:36:58.614864+0000","last_undegraded":"2024-09-17T03:36:58.614864+0000","last_fullsized":"2024-09-17T03:36:58.614864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:16.450751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.593723+0000","last_change":"2024-09-17T03:36:57.593661+0000","last_active":"2024-09-17T03:36:58.593723+0000","last_peered":"2024-09-17T03:36:58.593723+0000","last_clean":"2024-09-17T03:36:58.593723+0000","last_became_active":"2024-09-17T03:36:57.593336+0000","last_became_peered":"2024-09-17T03:36:57.593336+0000","last_unstale":"2024-09-17T03:36:58.593723+0000","last_undegraded":"2024-09-17T03:36:58.593723+0000","last_fullsized":"2024-09-17T03:36:58.593723+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:20.210252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624276+0000","last_change":"2024-09-17T03:36:57.593881+0000","last_active":"2024-09-17T03:36:58.624276+0000","last_peered":"2024-09-17T03:36:58.624276+0000","last_clean":"2024-09-17T03:36:58.624276+0000","last_became_active":"2024-09-17T03:36:57.593412+0000","last_became_peered":"2024-09-17T03:36:57.593412+0000","last_unstale":"2024-09-17T03:36:58.624276+0000","last_undegraded":"2024-09-17T03:36:58.624276+0000","last_fullsized":"2024-09-17T03:36:58.624276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:52.808091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":204,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.596710+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:36:58.596710+0000","last_peered":"2024-09-17T03:36:58.596710+0000","last_clean":"2024-09-17T03:36:58.596710+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:36:58.596710+0000","last_undegraded":"2024-09-17T03:36:58.596710+0000","last_fullsized":"2024-09-17T03:36:58.596710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36784,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335056,"statfs":{"total":96636764160,"available":96599097344,"internally_reserved":0,"allocated":1470464,"data_stored":960538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36184,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335656,"statfs":{"total":96636764160,"available":96599711744,"internally_reserved":0,"allocated":856064,"data_stored":362779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40360,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331480,"statfs":{"total":96636764160,"available":96595435520,"internally_reserved":0,"allocated":872448,"data_stored":369624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36208,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335632,"statfs":{"total":96636764160,"available":96599687168,"internally_reserved":0,"allocated":880640,"data_stored":371166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":888832,"data_stored":371782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1462272,"data_stored":959922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335676,"statfs":{"total":96636764160,"available":96599732224,"internally_reserved":0,"allocated":831488,"data_stored":350687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36180,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335660,"statfs":{"total":96636764160,"available":96599715840,"internally_reserved":0,"allocated":843776,"data_stored":356504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:02.611 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:02.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.761+0000 7f49077ba640 1 -- 172.21.15.146:0/1683413302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49000b3d30 msgr2=0x7f49001677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.761+0000 7f49077ba640 1 --2- 172.21.15.146:0/1683413302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49000b3d30 0x7f49001677c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f48f8005fd0 tx=0x7f48f802a820 comp rx=0 tx=0).stop 2024-09-17T03:37:02.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.761+0000 7f49077ba640 1 -- 172.21.15.146:0/1683413302 shutdown_connections 2024-09-17T03:37:02.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.761+0000 7f49077ba640 1 --2- 172.21.15.146:0/1683413302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49000b3d30 0x7f49001677c0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.761+0000 7f49077ba640 1 -- 172.21.15.146:0/1683413302 >> 172.21.15.146:0/1683413302 conn(0x7f49000b7b20 msgr2=0x7f490009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.761+0000 7f49077ba640 1 -- 172.21.15.146:0/1683413302 shutdown_connections 2024-09-17T03:37:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.761+0000 7f49077ba640 1 -- 172.21.15.146:0/1683413302 wait complete. 2024-09-17T03:37:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.763+0000 7f49077ba640 1 Processor -- start 2024-09-17T03:37:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.763+0000 7f49077ba640 1 -- start start 2024-09-17T03:37:02.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f49077ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49000b5750 0x7f4900156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f49077ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49000b5ce0 0x7f490006f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f49077ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4900152940 0x7f490009dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f49077ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4900167e80 con 0x7f49000b5750 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f49077ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4900167d00 con 0x7f4900152940 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f49077ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4900168000 con 0x7f49000b5ce0 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f4905556640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49000b5750 0x7f4900156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f4905556640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49000b5750 0x7f4900156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38158/0 (socket says 172.21.15.146:38158) 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f4905556640 1 -- 172.21.15.146:0/4104878146 learned_addr learned my addr 172.21.15.146:0/4104878146 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f4904d55640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49000b5ce0 0x7f490006f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f4905d57640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4900152940 0x7f490009dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f4905556640 1 -- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49000b5ce0 msgr2=0x7f490006f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f4905556640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49000b5ce0 0x7f490006f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f4905556640 1 -- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4900152940 msgr2=0x7f490009dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f4905556640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4900152940 0x7f490009dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.764+0000 7f4905556640 1 -- 172.21.15.146:0/4104878146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490006f200 con 0x7f49000b5750 2024-09-17T03:37:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.765+0000 7f4905556640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49000b5750 0x7f4900156b20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00b420 tx=0x7f48fc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.765+0000 7f48f5ffb640 1 -- 172.21.15.146:0/4104878146 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc011830 con 0x7f49000b5750 2024-09-17T03:37:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.765+0000 7f48f5ffb640 1 -- 172.21.15.146:0/4104878146 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48fc016070 con 0x7f49000b5750 2024-09-17T03:37:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.765+0000 7f49077ba640 1 -- 172.21.15.146:0/4104878146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f490006ef20 con 0x7f49000b5750 2024-09-17T03:37:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.765+0000 7f48f5ffb640 1 -- 172.21.15.146:0/4104878146 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc011d60 con 0x7f49000b5750 2024-09-17T03:37:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.765+0000 7f49077ba640 1 -- 172.21.15.146:0/4104878146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4900156320 con 0x7f49000b5750 2024-09-17T03:37:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.766+0000 7f49077ba640 1 -- 172.21.15.146:0/4104878146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49000b1320 con 0x7f49000b5750 2024-09-17T03:37:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.767+0000 7f48f5ffb640 1 -- 172.21.15.146:0/4104878146 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f48fc01b460 con 0x7f49000b5750 2024-09-17T03:37:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.767+0000 7f48f5ffb640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48e4078bc0 0x7f48e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.768+0000 7f48f5ffb640 1 -- 172.21.15.146:0/4104878146 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f48fc09a620 con 0x7f49000b5750 2024-09-17T03:37:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.768+0000 7f4904d55640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48e4078bc0 0x7f48e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.768+0000 7f4904d55640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48e4078bc0 0x7f48e407b0d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4900167cd0 tx=0x7f48f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.772+0000 7f48f5ffb640 1 -- 172.21.15.146:0/4104878146 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f48fc020020 con 0x7f49000b5750 2024-09-17T03:37:02.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.944+0000 7f49077ba640 1 -- 172.21.15.146:0/4104878146 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49000b65d0 con 0x7f48e4078bc0 2024-09-17T03:37:02.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.949+0000 7f48f5ffb640 1 -- 172.21.15.146:0/4104878146 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249429 (secure 0 0 0) 0x7f49000b65d0 con 0x7f48e4078bc0 2024-09-17T03:37:02.951 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:02.953 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:37:02.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.952+0000 7f49077ba640 1 -- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48e4078bc0 msgr2=0x7f48e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.952+0000 7f49077ba640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48e4078bc0 0x7f48e407b0d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4900167cd0 tx=0x7f48f0009040 comp rx=0 tx=0).stop 2024-09-17T03:37:02.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.952+0000 7f49077ba640 1 -- 172.21.15.146:0/4104878146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49000b5750 msgr2=0x7f4900156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:02.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.952+0000 7f49077ba640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49000b5750 0x7f4900156b20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00b420 tx=0x7f48fc00b8e0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.953+0000 7f49077ba640 1 -- 172.21.15.146:0/4104878146 shutdown_connections 2024-09-17T03:37:02.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.953+0000 7f49077ba640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f48e4078bc0 0x7f48e407b0d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.953+0000 7f49077ba640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4900152940 0x7f490009dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.953+0000 7f49077ba640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49000b5ce0 0x7f490006f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.953+0000 7f49077ba640 1 --2- 172.21.15.146:0/4104878146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49000b5750 0x7f4900156b20 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:02.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.953+0000 7f49077ba640 1 -- 172.21.15.146:0/4104878146 >> 172.21.15.146:0/4104878146 conn(0x7f49000b7b20 msgr2=0x7f49000b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:02.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.953+0000 7f49077ba640 1 -- 172.21.15.146:0/4104878146 shutdown_connections 2024-09-17T03:37:02.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:02.953+0000 7f49077ba640 1 -- 172.21.15.146:0/4104878146 wait complete. 2024-09-17T03:37:02.963 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-17T03:37:01.851457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592688,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":141,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":290720,"kb_used_data":7916,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754684000,"statfs":{"total":773094113280,"available":772796416000,"internally_reserved":0,"allocated":8105984,"data_stored":4103002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":289394225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2320,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.283468"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.622136+0000","last_change":"2024-09-17T03:36:58.617054+0000","last_active":"2024-09-17T03:36:58.622136+0000","last_peered":"2024-09-17T03:36:58.622136+0000","last_clean":"2024-09-17T03:36:58.622136+0000","last_became_active":"2024-09-17T03:36:58.616715+0000","last_became_peered":"2024-09-17T03:36:58.616715+0000","last_unstale":"2024-09-17T03:36:58.622136+0000","last_undegraded":"2024-09-17T03:36:58.622136+0000","last_fullsized":"2024-09-17T03:36:58.622136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:27.445679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.616794+0000","last_change":"2024-09-17T03:36:58.613591+0000","last_active":"2024-09-17T03:36:58.616794+0000","last_peered":"2024-09-17T03:36:58.616794+0000","last_clean":"2024-09-17T03:36:58.616794+0000","last_became_active":"2024-09-17T03:36:58.613190+0000","last_became_peered":"2024-09-17T03:36:58.613190+0000","last_unstale":"2024-09-17T03:36:58.616794+0000","last_undegraded":"2024-09-17T03:36:58.616794+0000","last_fullsized":"2024-09-17T03:36:58.616794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:35.898980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.607671+0000","last_change":"2024-09-17T03:36:58.605913+0000","last_active":"2024-09-17T03:36:58.607671+0000","last_peered":"2024-09-17T03:36:58.607671+0000","last_clean":"2024-09-17T03:36:58.607671+0000","last_became_active":"2024-09-17T03:36:58.605551+0000","last_became_peered":"2024-09-17T03:36:58.605551+0000","last_unstale":"2024-09-17T03:36:58.607671+0000","last_undegraded":"2024-09-17T03:36:58.607671+0000","last_fullsized":"2024-09-17T03:36:58.607671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:25.911924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619985+0000","last_change":"2024-09-17T03:36:58.616318+0000","last_active":"2024-09-17T03:36:58.619985+0000","last_peered":"2024-09-17T03:36:58.619985+0000","last_clean":"2024-09-17T03:36:58.619985+0000","last_became_active":"2024-09-17T03:36:58.615972+0000","last_became_peered":"2024-09-17T03:36:58.615972+0000","last_unstale":"2024-09-17T03:36:58.619985+0000","last_undegraded":"2024-09-17T03:36:58.619985+0000","last_fullsized":"2024-09-17T03:36:58.619985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:09.798475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.616821+0000","last_change":"2024-09-17T03:36:58.613048+0000","last_active":"2024-09-17T03:36:58.616821+0000","last_peered":"2024-09-17T03:36:58.616821+0000","last_clean":"2024-09-17T03:36:58.616821+0000","last_became_active":"2024-09-17T03:36:58.612726+0000","last_became_peered":"2024-09-17T03:36:58.612726+0000","last_unstale":"2024-09-17T03:36:58.616821+0000","last_undegraded":"2024-09-17T03:36:58.616821+0000","last_fullsized":"2024-09-17T03:36:58.616821+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.538161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615310+0000","last_change":"2024-09-17T03:36:58.608044+0000","last_active":"2024-09-17T03:36:58.615310+0000","last_peered":"2024-09-17T03:36:58.615310+0000","last_clean":"2024-09-17T03:36:58.615310+0000","last_became_active":"2024-09-17T03:36:58.607155+0000","last_became_peered":"2024-09-17T03:36:58.607155+0000","last_unstale":"2024-09-17T03:36:58.615310+0000","last_undegraded":"2024-09-17T03:36:58.615310+0000","last_fullsized":"2024-09-17T03:36:58.615310+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:08.826637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619374+0000","last_change":"2024-09-17T03:36:58.614210+0000","last_active":"2024-09-17T03:36:58.619374+0000","last_peered":"2024-09-17T03:36:58.619374+0000","last_clean":"2024-09-17T03:36:58.619374+0000","last_became_active":"2024-09-17T03:36:58.613913+0000","last_became_peered":"2024-09-17T03:36:58.613913+0000","last_unstale":"2024-09-17T03:36:58.619374+0000","last_undegraded":"2024-09-17T03:36:58.619374+0000","last_fullsized":"2024-09-17T03:36:58.619374+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:25.068863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.611663+0000","last_change":"2024-09-17T03:36:58.607751+0000","last_active":"2024-09-17T03:36:58.611663+0000","last_peered":"2024-09-17T03:36:58.611663+0000","last_clean":"2024-09-17T03:36:58.611663+0000","last_became_active":"2024-09-17T03:36:58.607444+0000","last_became_peered":"2024-09-17T03:36:58.607444+0000","last_unstale":"2024-09-17T03:36:58.611663+0000","last_undegraded":"2024-09-17T03:36:58.611663+0000","last_fullsized":"2024-09-17T03:36:58.611663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:09.197304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615443+0000","last_change":"2024-09-17T03:36:58.612036+0000","last_active":"2024-09-17T03:36:58.615443+0000","last_peered":"2024-09-17T03:36:58.615443+0000","last_clean":"2024-09-17T03:36:58.615443+0000","last_became_active":"2024-09-17T03:36:58.611664+0000","last_became_peered":"2024-09-17T03:36:58.611664+0000","last_unstale":"2024-09-17T03:36:58.615443+0000","last_undegraded":"2024-09-17T03:36:58.615443+0000","last_fullsized":"2024-09-17T03:36:58.615443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:47.066196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.605298+0000","last_change":"2024-09-17T03:36:58.603439+0000","last_active":"2024-09-17T03:36:58.605298+0000","last_peered":"2024-09-17T03:36:58.605298+0000","last_clean":"2024-09-17T03:36:58.605298+0000","last_became_active":"2024-09-17T03:36:58.603155+0000","last_became_peered":"2024-09-17T03:36:58.603155+0000","last_unstale":"2024-09-17T03:36:58.605298+0000","last_undegraded":"2024-09-17T03:36:58.605298+0000","last_fullsized":"2024-09-17T03:36:58.605298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:33.418376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614721+0000","last_change":"2024-09-17T03:36:58.611787+0000","last_active":"2024-09-17T03:36:58.614721+0000","last_peered":"2024-09-17T03:36:58.614721+0000","last_clean":"2024-09-17T03:36:58.614721+0000","last_became_active":"2024-09-17T03:36:58.611492+0000","last_became_peered":"2024-09-17T03:36:58.611492+0000","last_unstale":"2024-09-17T03:36:58.614721+0000","last_undegraded":"2024-09-17T03:36:58.614721+0000","last_fullsized":"2024-09-17T03:36:58.614721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:20.680288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618331+0000","last_change":"2024-09-17T03:36:58.612245+0000","last_active":"2024-09-17T03:36:58.618331+0000","last_peered":"2024-09-17T03:36:58.618331+0000","last_clean":"2024-09-17T03:36:58.618331+0000","last_became_active":"2024-09-17T03:36:58.611923+0000","last_became_peered":"2024-09-17T03:36:58.611923+0000","last_unstale":"2024-09-17T03:36:58.618331+0000","last_undegraded":"2024-09-17T03:36:58.618331+0000","last_fullsized":"2024-09-17T03:36:58.618331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:29.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613136+0000","last_change":"2024-09-17T03:36:58.605653+0000","last_active":"2024-09-17T03:36:58.613136+0000","last_peered":"2024-09-17T03:36:58.613136+0000","last_clean":"2024-09-17T03:36:58.613136+0000","last_became_active":"2024-09-17T03:36:58.605358+0000","last_became_peered":"2024-09-17T03:36:58.605358+0000","last_unstale":"2024-09-17T03:36:58.613136+0000","last_undegraded":"2024-09-17T03:36:58.613136+0000","last_fullsized":"2024-09-17T03:36:58.613136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:38.335687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609157+0000","last_change":"2024-09-17T03:36:58.603629+0000","last_active":"2024-09-17T03:36:58.609157+0000","last_peered":"2024-09-17T03:36:58.609157+0000","last_clean":"2024-09-17T03:36:58.609157+0000","last_became_active":"2024-09-17T03:36:58.602937+0000","last_became_peered":"2024-09-17T03:36:58.602937+0000","last_unstale":"2024-09-17T03:36:58.609157+0000","last_undegraded":"2024-09-17T03:36:58.609157+0000","last_fullsized":"2024-09-17T03:36:58.609157+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:50.782400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618660+0000","last_change":"2024-09-17T03:36:58.611332+0000","last_active":"2024-09-17T03:36:58.618660+0000","last_peered":"2024-09-17T03:36:58.618660+0000","last_clean":"2024-09-17T03:36:58.618660+0000","last_became_active":"2024-09-17T03:36:58.611024+0000","last_became_peered":"2024-09-17T03:36:58.611024+0000","last_unstale":"2024-09-17T03:36:58.618660+0000","last_undegraded":"2024-09-17T03:36:58.618660+0000","last_fullsized":"2024-09-17T03:36:58.618660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:44.315656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615625+0000","last_change":"2024-09-17T03:36:58.609578+0000","last_active":"2024-09-17T03:36:58.615625+0000","last_peered":"2024-09-17T03:36:58.615625+0000","last_clean":"2024-09-17T03:36:58.615625+0000","last_became_active":"2024-09-17T03:36:58.609270+0000","last_became_peered":"2024-09-17T03:36:58.609270+0000","last_unstale":"2024-09-17T03:36:58.615625+0000","last_undegraded":"2024-09-17T03:36:58.615625+0000","last_fullsized":"2024-09-17T03:36:58.615625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:34.917655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614907+0000","last_change":"2024-09-17T03:36:58.604940+0000","last_active":"2024-09-17T03:36:58.614907+0000","last_peered":"2024-09-17T03:36:58.614907+0000","last_clean":"2024-09-17T03:36:58.614907+0000","last_became_active":"2024-09-17T03:36:58.604635+0000","last_became_peered":"2024-09-17T03:36:58.604635+0000","last_unstale":"2024-09-17T03:36:58.614907+0000","last_undegraded":"2024-09-17T03:36:58.614907+0000","last_fullsized":"2024-09-17T03:36:58.614907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:34.917655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613174+0000","last_change":"2024-09-17T03:36:58.604263+0000","last_active":"2024-09-17T03:36:58.613174+0000","last_peered":"2024-09-17T03:36:58.613174+0000","last_clean":"2024-09-17T03:36:58.613174+0000","last_became_active":"2024-09-17T03:36:58.603672+0000","last_became_peered":"2024-09-17T03:36:58.603672+0000","last_unstale":"2024-09-17T03:36:58.613174+0000","last_undegraded":"2024-09-17T03:36:58.613174+0000","last_fullsized":"2024-09-17T03:36:58.613174+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:30.276913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.611765+0000","last_change":"2024-09-17T03:36:58.601622+0000","last_active":"2024-09-17T03:36:58.611765+0000","last_peered":"2024-09-17T03:36:58.611765+0000","last_clean":"2024-09-17T03:36:58.611765+0000","last_became_active":"2024-09-17T03:36:58.601303+0000","last_became_peered":"2024-09-17T03:36:58.601303+0000","last_unstale":"2024-09-17T03:36:58.611765+0000","last_undegraded":"2024-09-17T03:36:58.611765+0000","last_fullsized":"2024-09-17T03:36:58.611765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:31.989872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613826+0000","last_change":"2024-09-17T03:36:58.610601+0000","last_active":"2024-09-17T03:36:58.613826+0000","last_peered":"2024-09-17T03:36:58.613826+0000","last_clean":"2024-09-17T03:36:58.613826+0000","last_became_active":"2024-09-17T03:36:58.610255+0000","last_became_peered":"2024-09-17T03:36:58.610255+0000","last_unstale":"2024-09-17T03:36:58.613826+0000","last_undegraded":"2024-09-17T03:36:58.613826+0000","last_fullsized":"2024-09-17T03:36:58.613826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:54.883572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.607235+0000","last_change":"2024-09-17T03:36:58.604903+0000","last_active":"2024-09-17T03:36:58.607235+0000","last_peered":"2024-09-17T03:36:58.607235+0000","last_clean":"2024-09-17T03:36:58.607235+0000","last_became_active":"2024-09-17T03:36:58.604570+0000","last_became_peered":"2024-09-17T03:36:58.604570+0000","last_unstale":"2024-09-17T03:36:58.607235+0000","last_undegraded":"2024-09-17T03:36:58.607235+0000","last_fullsized":"2024-09-17T03:36:58.607235+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:32.468155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615436+0000","last_change":"2024-09-17T03:36:58.611647+0000","last_active":"2024-09-17T03:36:58.615436+0000","last_peered":"2024-09-17T03:36:58.615436+0000","last_clean":"2024-09-17T03:36:58.615436+0000","last_became_active":"2024-09-17T03:36:58.611306+0000","last_became_peered":"2024-09-17T03:36:58.611306+0000","last_unstale":"2024-09-17T03:36:58.615436+0000","last_undegraded":"2024-09-17T03:36:58.615436+0000","last_fullsized":"2024-09-17T03:36:58.615436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:44.377859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609013+0000","last_change":"2024-09-17T03:36:58.601635+0000","last_active":"2024-09-17T03:36:58.609013+0000","last_peered":"2024-09-17T03:36:58.609013+0000","last_clean":"2024-09-17T03:36:58.609013+0000","last_became_active":"2024-09-17T03:36:58.601341+0000","last_became_peered":"2024-09-17T03:36:58.601341+0000","last_unstale":"2024-09-17T03:36:58.609013+0000","last_undegraded":"2024-09-17T03:36:58.609013+0000","last_fullsized":"2024-09-17T03:36:58.609013+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:39.072061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613572+0000","last_change":"2024-09-17T03:36:58.610689+0000","last_active":"2024-09-17T03:36:58.613572+0000","last_peered":"2024-09-17T03:36:58.613572+0000","last_clean":"2024-09-17T03:36:58.613572+0000","last_became_active":"2024-09-17T03:36:58.610241+0000","last_became_peered":"2024-09-17T03:36:58.610241+0000","last_unstale":"2024-09-17T03:36:58.613572+0000","last_undegraded":"2024-09-17T03:36:58.613572+0000","last_fullsized":"2024-09-17T03:36:58.613572+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:29.450418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615569+0000","last_change":"2024-09-17T03:36:58.610171+0000","last_active":"2024-09-17T03:36:58.615569+0000","last_peered":"2024-09-17T03:36:58.615569+0000","last_clean":"2024-09-17T03:36:58.615569+0000","last_became_active":"2024-09-17T03:36:58.609749+0000","last_became_peered":"2024-09-17T03:36:58.609749+0000","last_unstale":"2024-09-17T03:36:58.615569+0000","last_undegraded":"2024-09-17T03:36:58.615569+0000","last_fullsized":"2024-09-17T03:36:58.615569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:22.607257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.621860+0000","last_change":"2024-09-17T03:36:58.616100+0000","last_active":"2024-09-17T03:36:58.621860+0000","last_peered":"2024-09-17T03:36:58.621860+0000","last_clean":"2024-09-17T03:36:58.621860+0000","last_became_active":"2024-09-17T03:36:58.615736+0000","last_became_peered":"2024-09-17T03:36:58.615736+0000","last_unstale":"2024-09-17T03:36:58.621860+0000","last_undegraded":"2024-09-17T03:36:58.621860+0000","last_fullsized":"2024-09-17T03:36:58.621860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:05.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.622050+0000","last_change":"2024-09-17T03:36:57.593446+0000","last_active":"2024-09-17T03:36:58.622050+0000","last_peered":"2024-09-17T03:36:58.622050+0000","last_clean":"2024-09-17T03:36:58.622050+0000","last_became_active":"2024-09-17T03:36:57.592914+0000","last_became_peered":"2024-09-17T03:36:57.592914+0000","last_unstale":"2024-09-17T03:36:58.622050+0000","last_undegraded":"2024-09-17T03:36:58.622050+0000","last_fullsized":"2024-09-17T03:36:58.622050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:04.448726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618631+0000","last_change":"2024-09-17T03:36:58.610586+0000","last_active":"2024-09-17T03:36:58.618631+0000","last_peered":"2024-09-17T03:36:58.618631+0000","last_clean":"2024-09-17T03:36:58.618631+0000","last_became_active":"2024-09-17T03:36:58.610274+0000","last_became_peered":"2024-09-17T03:36:58.610274+0000","last_unstale":"2024-09-17T03:36:58.618631+0000","last_undegraded":"2024-09-17T03:36:58.618631+0000","last_fullsized":"2024-09-17T03:36:58.618631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:50.836681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.620215+0000","last_change":"2024-09-17T03:36:57.585526+0000","last_active":"2024-09-17T03:36:58.620215+0000","last_peered":"2024-09-17T03:36:58.620215+0000","last_clean":"2024-09-17T03:36:58.620215+0000","last_became_active":"2024-09-17T03:36:57.585185+0000","last_became_peered":"2024-09-17T03:36:57.585185+0000","last_unstale":"2024-09-17T03:36:58.620215+0000","last_undegraded":"2024-09-17T03:36:58.620215+0000","last_fullsized":"2024-09-17T03:36:58.620215+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:01.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615168+0000","last_change":"2024-09-17T03:36:58.604536+0000","last_active":"2024-09-17T03:36:58.615168+0000","last_peered":"2024-09-17T03:36:58.615168+0000","last_clean":"2024-09-17T03:36:58.615168+0000","last_became_active":"2024-09-17T03:36:58.604117+0000","last_became_peered":"2024-09-17T03:36:58.604117+0000","last_unstale":"2024-09-17T03:36:58.615168+0000","last_undegraded":"2024-09-17T03:36:58.615168+0000","last_fullsized":"2024-09-17T03:36:58.615168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:42.334459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624127+0000","last_change":"2024-09-17T03:36:57.584256+0000","last_active":"2024-09-17T03:36:58.624127+0000","last_peered":"2024-09-17T03:36:58.624127+0000","last_clean":"2024-09-17T03:36:58.624127+0000","last_became_active":"2024-09-17T03:36:57.583832+0000","last_became_peered":"2024-09-17T03:36:57.583832+0000","last_unstale":"2024-09-17T03:36:58.624127+0000","last_undegraded":"2024-09-17T03:36:58.624127+0000","last_fullsized":"2024-09-17T03:36:58.624127+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:48.077004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610216+0000","last_change":"2024-09-17T03:36:58.608312+0000","last_active":"2024-09-17T03:36:58.610216+0000","last_peered":"2024-09-17T03:36:58.610216+0000","last_clean":"2024-09-17T03:36:58.610216+0000","last_became_active":"2024-09-17T03:36:58.607981+0000","last_became_peered":"2024-09-17T03:36:58.607981+0000","last_unstale":"2024-09-17T03:36:58.610216+0000","last_undegraded":"2024-09-17T03:36:58.610216+0000","last_fullsized":"2024-09-17T03:36:58.610216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:26.016580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623739+0000","last_change":"2024-09-17T03:36:57.593693+0000","last_active":"2024-09-17T03:36:58.623739+0000","last_peered":"2024-09-17T03:36:58.623739+0000","last_clean":"2024-09-17T03:36:58.623739+0000","last_became_active":"2024-09-17T03:36:57.593350+0000","last_became_peered":"2024-09-17T03:36:57.593350+0000","last_unstale":"2024-09-17T03:36:58.623739+0000","last_undegraded":"2024-09-17T03:36:58.623739+0000","last_fullsized":"2024-09-17T03:36:58.623739+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:32.413220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.576417+0000","last_change":"2024-09-17T03:36:56.576417+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.576417+0000","last_undegraded":"2024-09-17T03:36:56.576417+0000","last_fullsized":"2024-09-17T03:36:56.576417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614506+0000","last_change":"2024-09-17T03:36:58.612378+0000","last_active":"2024-09-17T03:36:58.614506+0000","last_peered":"2024-09-17T03:36:58.614506+0000","last_clean":"2024-09-17T03:36:58.614506+0000","last_became_active":"2024-09-17T03:36:58.612031+0000","last_became_peered":"2024-09-17T03:36:58.612031+0000","last_unstale":"2024-09-17T03:36:58.614506+0000","last_undegraded":"2024-09-17T03:36:58.614506+0000","last_fullsized":"2024-09-17T03:36:58.614506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:08.513728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623848+0000","last_change":"2024-09-17T03:36:57.590622+0000","last_active":"2024-09-17T03:36:58.623848+0000","last_peered":"2024-09-17T03:36:58.623848+0000","last_clean":"2024-09-17T03:36:58.623848+0000","last_became_active":"2024-09-17T03:36:57.590266+0000","last_became_peered":"2024-09-17T03:36:57.590266+0000","last_unstale":"2024-09-17T03:36:58.623848+0000","last_undegraded":"2024-09-17T03:36:58.623848+0000","last_fullsized":"2024-09-17T03:36:58.623848+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:55.095810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619669+0000","last_change":"2024-09-17T03:36:58.612013+0000","last_active":"2024-09-17T03:36:58.619669+0000","last_peered":"2024-09-17T03:36:58.619669+0000","last_clean":"2024-09-17T03:36:58.619669+0000","last_became_active":"2024-09-17T03:36:58.611745+0000","last_became_peered":"2024-09-17T03:36:58.611745+0000","last_unstale":"2024-09-17T03:36:58.619669+0000","last_undegraded":"2024-09-17T03:36:58.619669+0000","last_fullsized":"2024-09-17T03:36:58.619669+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:57.877593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.589675+0000","last_change":"2024-09-17T03:36:57.590493+0000","last_active":"2024-09-17T03:36:58.589675+0000","last_peered":"2024-09-17T03:36:58.589675+0000","last_clean":"2024-09-17T03:36:58.589675+0000","last_became_active":"2024-09-17T03:36:57.590157+0000","last_became_peered":"2024-09-17T03:36:57.590157+0000","last_unstale":"2024-09-17T03:36:58.589675+0000","last_undegraded":"2024-09-17T03:36:58.589675+0000","last_fullsized":"2024-09-17T03:36:58.589675+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:45.348233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613107+0000","last_change":"2024-09-17T03:36:58.604882+0000","last_active":"2024-09-17T03:36:58.613107+0000","last_peered":"2024-09-17T03:36:58.613107+0000","last_clean":"2024-09-17T03:36:58.613107+0000","last_became_active":"2024-09-17T03:36:58.604597+0000","last_became_peered":"2024-09-17T03:36:58.604597+0000","last_unstale":"2024-09-17T03:36:58.613107+0000","last_undegraded":"2024-09-17T03:36:58.613107+0000","last_fullsized":"2024-09-17T03:36:58.613107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:26.075265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.595824+0000","last_change":"2024-09-17T03:36:57.586393+0000","last_active":"2024-09-17T03:36:58.595824+0000","last_peered":"2024-09-17T03:36:58.595824+0000","last_clean":"2024-09-17T03:36:58.595824+0000","last_became_active":"2024-09-17T03:36:57.586120+0000","last_became_peered":"2024-09-17T03:36:57.586120+0000","last_unstale":"2024-09-17T03:36:58.595824+0000","last_undegraded":"2024-09-17T03:36:58.595824+0000","last_fullsized":"2024-09-17T03:36:58.595824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:47.246300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597464+0000","last_change":"2024-09-17T03:36:57.589422+0000","last_active":"2024-09-17T03:36:58.597464+0000","last_peered":"2024-09-17T03:36:58.597464+0000","last_clean":"2024-09-17T03:36:58.597464+0000","last_became_active":"2024-09-17T03:36:57.589098+0000","last_became_peered":"2024-09-17T03:36:57.589098+0000","last_unstale":"2024-09-17T03:36:58.597464+0000","last_undegraded":"2024-09-17T03:36:58.597464+0000","last_fullsized":"2024-09-17T03:36:58.597464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:39.093916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.606985+0000","last_change":"2024-09-17T03:36:58.604411+0000","last_active":"2024-09-17T03:36:58.606985+0000","last_peered":"2024-09-17T03:36:58.606985+0000","last_clean":"2024-09-17T03:36:58.606985+0000","last_became_active":"2024-09-17T03:36:58.604012+0000","last_became_peered":"2024-09-17T03:36:58.604012+0000","last_unstale":"2024-09-17T03:36:58.606985+0000","last_undegraded":"2024-09-17T03:36:58.606985+0000","last_fullsized":"2024-09-17T03:36:58.606985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:12.827748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598400+0000","last_change":"2024-09-17T03:36:57.596267+0000","last_active":"2024-09-17T03:36:58.598400+0000","last_peered":"2024-09-17T03:36:58.598400+0000","last_clean":"2024-09-17T03:36:58.598400+0000","last_became_active":"2024-09-17T03:36:57.595964+0000","last_became_peered":"2024-09-17T03:36:57.595964+0000","last_unstale":"2024-09-17T03:36:58.598400+0000","last_undegraded":"2024-09-17T03:36:58.598400+0000","last_fullsized":"2024-09-17T03:36:58.598400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:52.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.617051+0000","last_change":"2024-09-17T03:36:58.613987+0000","last_active":"2024-09-17T03:36:58.617051+0000","last_peered":"2024-09-17T03:36:58.617051+0000","last_clean":"2024-09-17T03:36:58.617051+0000","last_became_active":"2024-09-17T03:36:58.612963+0000","last_became_peered":"2024-09-17T03:36:58.612963+0000","last_unstale":"2024-09-17T03:36:58.617051+0000","last_undegraded":"2024-09-17T03:36:58.617051+0000","last_fullsized":"2024-09-17T03:36:58.617051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:31.989872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.576586+0000","last_change":"2024-09-17T03:36:56.576586+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.576586+0000","last_undegraded":"2024-09-17T03:36:56.576586+0000","last_fullsized":"2024-09-17T03:36:56.576586+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609397+0000","last_change":"2024-09-17T03:36:58.606960+0000","last_active":"2024-09-17T03:36:58.609397+0000","last_peered":"2024-09-17T03:36:58.609397+0000","last_clean":"2024-09-17T03:36:58.609397+0000","last_became_active":"2024-09-17T03:36:58.606534+0000","last_became_peered":"2024-09-17T03:36:58.606534+0000","last_unstale":"2024-09-17T03:36:58.609397+0000","last_undegraded":"2024-09-17T03:36:58.609397+0000","last_fullsized":"2024-09-17T03:36:58.609397+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:32.744450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623982+0000","last_change":"2024-09-17T03:36:57.583631+0000","last_active":"2024-09-17T03:36:58.623982+0000","last_peered":"2024-09-17T03:36:58.623982+0000","last_clean":"2024-09-17T03:36:58.623982+0000","last_became_active":"2024-09-17T03:36:57.583303+0000","last_became_peered":"2024-09-17T03:36:57.583303+0000","last_unstale":"2024-09-17T03:36:58.623982+0000","last_undegraded":"2024-09-17T03:36:58.623982+0000","last_fullsized":"2024-09-17T03:36:58.623982+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:52.808091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610116+0000","last_change":"2024-09-17T03:36:58.608223+0000","last_active":"2024-09-17T03:36:58.610116+0000","last_peered":"2024-09-17T03:36:58.610116+0000","last_clean":"2024-09-17T03:36:58.610116+0000","last_became_active":"2024-09-17T03:36:58.607909+0000","last_became_peered":"2024-09-17T03:36:58.607909+0000","last_unstale":"2024-09-17T03:36:58.610116+0000","last_undegraded":"2024-09-17T03:36:58.610116+0000","last_fullsized":"2024-09-17T03:36:58.610116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:40.743100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619256+0000","last_change":"2024-09-17T03:36:57.594639+0000","last_active":"2024-09-17T03:36:58.619256+0000","last_peered":"2024-09-17T03:36:58.619256+0000","last_clean":"2024-09-17T03:36:58.619256+0000","last_became_active":"2024-09-17T03:36:57.594225+0000","last_became_peered":"2024-09-17T03:36:57.594225+0000","last_unstale":"2024-09-17T03:36:58.619256+0000","last_undegraded":"2024-09-17T03:36:58.619256+0000","last_fullsized":"2024-09-17T03:36:58.619256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.745067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597196+0000","last_change":"2024-09-17T03:36:57.582416+0000","last_active":"2024-09-17T03:36:58.597196+0000","last_peered":"2024-09-17T03:36:58.597196+0000","last_clean":"2024-09-17T03:36:58.597196+0000","last_became_active":"2024-09-17T03:36:57.582075+0000","last_became_peered":"2024-09-17T03:36:57.582075+0000","last_unstale":"2024-09-17T03:36:58.597196+0000","last_undegraded":"2024-09-17T03:36:58.597196+0000","last_fullsized":"2024-09-17T03:36:58.597196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:39.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615044+0000","last_change":"2024-09-17T03:36:58.614063+0000","last_active":"2024-09-17T03:36:58.615044+0000","last_peered":"2024-09-17T03:36:58.615044+0000","last_clean":"2024-09-17T03:36:58.615044+0000","last_became_active":"2024-09-17T03:36:58.613765+0000","last_became_peered":"2024-09-17T03:36:58.613765+0000","last_unstale":"2024-09-17T03:36:58.615044+0000","last_undegraded":"2024-09-17T03:36:58.615044+0000","last_fullsized":"2024-09-17T03:36:58.615044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:19.612415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.578179+0000","last_change":"2024-09-17T03:36:56.578179+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.578179+0000","last_undegraded":"2024-09-17T03:36:56.578179+0000","last_fullsized":"2024-09-17T03:36:56.578179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619653+0000","last_change":"2024-09-17T03:36:58.615101+0000","last_active":"2024-09-17T03:36:58.619653+0000","last_peered":"2024-09-17T03:36:58.619653+0000","last_clean":"2024-09-17T03:36:58.619653+0000","last_became_active":"2024-09-17T03:36:58.614759+0000","last_became_peered":"2024-09-17T03:36:58.614759+0000","last_unstale":"2024-09-17T03:36:58.619653+0000","last_undegraded":"2024-09-17T03:36:58.619653+0000","last_fullsized":"2024-09-17T03:36:58.619653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:57.046686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.626931+0000","last_change":"2024-09-17T03:36:57.590811+0000","last_active":"2024-09-17T03:36:58.626931+0000","last_peered":"2024-09-17T03:36:58.626931+0000","last_clean":"2024-09-17T03:36:58.626931+0000","last_became_active":"2024-09-17T03:36:57.590493+0000","last_became_peered":"2024-09-17T03:36:57.590493+0000","last_unstale":"2024-09-17T03:36:58.626931+0000","last_undegraded":"2024-09-17T03:36:58.626931+0000","last_fullsized":"2024-09-17T03:36:58.626931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:36.950013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.608959+0000","last_change":"2024-09-17T03:36:58.603205+0000","last_active":"2024-09-17T03:36:58.608959+0000","last_peered":"2024-09-17T03:36:58.608959+0000","last_clean":"2024-09-17T03:36:58.608959+0000","last_became_active":"2024-09-17T03:36:58.602879+0000","last_became_peered":"2024-09-17T03:36:58.602879+0000","last_unstale":"2024-09-17T03:36:58.608959+0000","last_undegraded":"2024-09-17T03:36:58.608959+0000","last_fullsized":"2024-09-17T03:36:58.608959+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:15.337006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624130+0000","last_change":"2024-09-17T03:36:57.591724+0000","last_active":"2024-09-17T03:36:58.624130+0000","last_peered":"2024-09-17T03:36:58.624130+0000","last_clean":"2024-09-17T03:36:58.624130+0000","last_became_active":"2024-09-17T03:36:57.591423+0000","last_became_peered":"2024-09-17T03:36:57.591423+0000","last_unstale":"2024-09-17T03:36:58.624130+0000","last_undegraded":"2024-09-17T03:36:58.624130+0000","last_fullsized":"2024-09-17T03:36:58.624130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:47.502370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.608531+0000","last_change":"2024-09-17T03:36:58.606423+0000","last_active":"2024-09-17T03:36:58.608531+0000","last_peered":"2024-09-17T03:36:58.608531+0000","last_clean":"2024-09-17T03:36:58.608531+0000","last_became_active":"2024-09-17T03:36:58.606054+0000","last_became_peered":"2024-09-17T03:36:58.606054+0000","last_unstale":"2024-09-17T03:36:58.608531+0000","last_undegraded":"2024-09-17T03:36:58.608531+0000","last_fullsized":"2024-09-17T03:36:58.608531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:37.194170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623685+0000","last_change":"2024-09-17T03:36:57.584163+0000","last_active":"2024-09-17T03:36:58.623685+0000","last_peered":"2024-09-17T03:36:58.623685+0000","last_clean":"2024-09-17T03:36:58.623685+0000","last_became_active":"2024-09-17T03:36:57.583706+0000","last_became_peered":"2024-09-17T03:36:57.583706+0000","last_unstale":"2024-09-17T03:36:58.623685+0000","last_undegraded":"2024-09-17T03:36:58.623685+0000","last_fullsized":"2024-09-17T03:36:58.623685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:12.542540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.605257+0000","last_change":"2024-09-17T03:36:58.603373+0000","last_active":"2024-09-17T03:36:58.605257+0000","last_peered":"2024-09-17T03:36:58.605257+0000","last_clean":"2024-09-17T03:36:58.605257+0000","last_became_active":"2024-09-17T03:36:58.602742+0000","last_became_peered":"2024-09-17T03:36:58.602742+0000","last_unstale":"2024-09-17T03:36:58.605257+0000","last_undegraded":"2024-09-17T03:36:58.605257+0000","last_fullsized":"2024-09-17T03:36:58.605257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:53.456094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624389+0000","last_change":"2024-09-17T03:36:57.597237+0000","last_active":"2024-09-17T03:36:58.624389+0000","last_peered":"2024-09-17T03:36:58.624389+0000","last_clean":"2024-09-17T03:36:58.624389+0000","last_became_active":"2024-09-17T03:36:57.596927+0000","last_became_peered":"2024-09-17T03:36:57.596927+0000","last_unstale":"2024-09-17T03:36:58.624389+0000","last_undegraded":"2024-09-17T03:36:58.624389+0000","last_fullsized":"2024-09-17T03:36:58.624389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:45.348233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619628+0000","last_change":"2024-09-17T03:36:58.615051+0000","last_active":"2024-09-17T03:36:58.619628+0000","last_peered":"2024-09-17T03:36:58.619628+0000","last_clean":"2024-09-17T03:36:58.619628+0000","last_became_active":"2024-09-17T03:36:58.614727+0000","last_became_peered":"2024-09-17T03:36:58.614727+0000","last_unstale":"2024-09-17T03:36:58.619628+0000","last_undegraded":"2024-09-17T03:36:58.619628+0000","last_fullsized":"2024-09-17T03:36:58.619628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:29.560429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597705+0000","last_change":"2024-09-17T03:36:57.592743+0000","last_active":"2024-09-17T03:36:58.597705+0000","last_peered":"2024-09-17T03:36:58.597705+0000","last_clean":"2024-09-17T03:36:58.597705+0000","last_became_active":"2024-09-17T03:36:57.592410+0000","last_became_peered":"2024-09-17T03:36:57.592410+0000","last_unstale":"2024-09-17T03:36:58.597705+0000","last_undegraded":"2024-09-17T03:36:58.597705+0000","last_fullsized":"2024-09-17T03:36:58.597705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:37.445030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598168+0000","last_change":"2024-09-17T03:36:57.589575+0000","last_active":"2024-09-17T03:36:58.598168+0000","last_peered":"2024-09-17T03:36:58.598168+0000","last_clean":"2024-09-17T03:36:58.598168+0000","last_became_active":"2024-09-17T03:36:57.589106+0000","last_became_peered":"2024-09-17T03:36:57.589106+0000","last_unstale":"2024-09-17T03:36:58.598168+0000","last_undegraded":"2024-09-17T03:36:58.598168+0000","last_fullsized":"2024-09-17T03:36:58.598168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.745067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.577559+0000","last_change":"2024-09-17T03:36:56.577559+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.577559+0000","last_undegraded":"2024-09-17T03:36:56.577559+0000","last_fullsized":"2024-09-17T03:36:56.577559+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.594386+0000","last_change":"2024-09-17T03:36:57.588964+0000","last_active":"2024-09-17T03:36:58.594386+0000","last_peered":"2024-09-17T03:36:58.594386+0000","last_clean":"2024-09-17T03:36:58.594386+0000","last_became_active":"2024-09-17T03:36:57.588619+0000","last_became_peered":"2024-09-17T03:36:57.588619+0000","last_unstale":"2024-09-17T03:36:58.594386+0000","last_undegraded":"2024-09-17T03:36:58.594386+0000","last_fullsized":"2024-09-17T03:36:58.594386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:47.054594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.606961+0000","last_change":"2024-09-17T03:36:58.602742+0000","last_active":"2024-09-17T03:36:58.606961+0000","last_peered":"2024-09-17T03:36:58.606961+0000","last_clean":"2024-09-17T03:36:58.606961+0000","last_became_active":"2024-09-17T03:36:58.602421+0000","last_became_peered":"2024-09-17T03:36:58.602421+0000","last_unstale":"2024-09-17T03:36:58.606961+0000","last_undegraded":"2024-09-17T03:36:58.606961+0000","last_fullsized":"2024-09-17T03:36:58.606961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:17.471850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623980+0000","last_change":"2024-09-17T03:36:57.590905+0000","last_active":"2024-09-17T03:36:58.623980+0000","last_peered":"2024-09-17T03:36:58.623980+0000","last_clean":"2024-09-17T03:36:58.623980+0000","last_became_active":"2024-09-17T03:36:57.590517+0000","last_became_peered":"2024-09-17T03:36:57.590517+0000","last_unstale":"2024-09-17T03:36:58.623980+0000","last_undegraded":"2024-09-17T03:36:58.623980+0000","last_fullsized":"2024-09-17T03:36:58.623980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:24.906768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.577611+0000","last_change":"2024-09-17T03:36:56.577611+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.577611+0000","last_undegraded":"2024-09-17T03:36:56.577611+0000","last_fullsized":"2024-09-17T03:36:56.577611+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.621811+0000","last_change":"2024-09-17T03:36:58.616039+0000","last_active":"2024-09-17T03:36:58.621811+0000","last_peered":"2024-09-17T03:36:58.621811+0000","last_clean":"2024-09-17T03:36:58.621811+0000","last_became_active":"2024-09-17T03:36:58.615707+0000","last_became_peered":"2024-09-17T03:36:58.615707+0000","last_unstale":"2024-09-17T03:36:58.621811+0000","last_undegraded":"2024-09-17T03:36:58.621811+0000","last_fullsized":"2024-09-17T03:36:58.621811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:55.971111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598228+0000","last_change":"2024-09-17T03:36:57.585618+0000","last_active":"2024-09-17T03:36:58.598228+0000","last_peered":"2024-09-17T03:36:58.598228+0000","last_clean":"2024-09-17T03:36:58.598228+0000","last_became_active":"2024-09-17T03:36:57.585282+0000","last_became_peered":"2024-09-17T03:36:57.585282+0000","last_unstale":"2024-09-17T03:36:58.598228+0000","last_undegraded":"2024-09-17T03:36:58.598228+0000","last_fullsized":"2024-09-17T03:36:58.598228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:48.269513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610246+0000","last_change":"2024-09-17T03:36:58.608926+0000","last_active":"2024-09-17T03:36:58.610246+0000","last_peered":"2024-09-17T03:36:58.610246+0000","last_clean":"2024-09-17T03:36:58.610246+0000","last_became_active":"2024-09-17T03:36:58.608553+0000","last_became_peered":"2024-09-17T03:36:58.608553+0000","last_unstale":"2024-09-17T03:36:58.610246+0000","last_undegraded":"2024-09-17T03:36:58.610246+0000","last_fullsized":"2024-09-17T03:36:58.610246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.226689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.596785+0000","last_change":"2024-09-17T03:36:57.586327+0000","last_active":"2024-09-17T03:36:58.596785+0000","last_peered":"2024-09-17T03:36:58.596785+0000","last_clean":"2024-09-17T03:36:58.596785+0000","last_became_active":"2024-09-17T03:36:57.586003+0000","last_became_peered":"2024-09-17T03:36:57.586003+0000","last_unstale":"2024-09-17T03:36:58.596785+0000","last_undegraded":"2024-09-17T03:36:58.596785+0000","last_fullsized":"2024-09-17T03:36:58.596785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:12.716534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.620040+0000","last_change":"2024-09-17T03:36:58.616301+0000","last_active":"2024-09-17T03:36:58.620040+0000","last_peered":"2024-09-17T03:36:58.620040+0000","last_clean":"2024-09-17T03:36:58.620040+0000","last_became_active":"2024-09-17T03:36:58.615909+0000","last_became_peered":"2024-09-17T03:36:58.615909+0000","last_unstale":"2024-09-17T03:36:58.620040+0000","last_undegraded":"2024-09-17T03:36:58.620040+0000","last_fullsized":"2024-09-17T03:36:58.620040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:19.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.602015+0000","last_change":"2024-09-17T03:36:57.591187+0000","last_active":"2024-09-17T03:36:58.602015+0000","last_peered":"2024-09-17T03:36:58.602015+0000","last_clean":"2024-09-17T03:36:58.602015+0000","last_became_active":"2024-09-17T03:36:57.590899+0000","last_became_peered":"2024-09-17T03:36:57.590899+0000","last_unstale":"2024-09-17T03:36:58.602015+0000","last_undegraded":"2024-09-17T03:36:58.602015+0000","last_fullsized":"2024-09-17T03:36:58.602015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:02.492050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615388+0000","last_change":"2024-09-17T03:36:58.608391+0000","last_active":"2024-09-17T03:36:58.615388+0000","last_peered":"2024-09-17T03:36:58.615388+0000","last_clean":"2024-09-17T03:36:58.615388+0000","last_became_active":"2024-09-17T03:36:58.608055+0000","last_became_peered":"2024-09-17T03:36:58.608055+0000","last_unstale":"2024-09-17T03:36:58.615388+0000","last_undegraded":"2024-09-17T03:36:58.615388+0000","last_fullsized":"2024-09-17T03:36:58.615388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:22.120747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.589696+0000","last_change":"2024-09-17T03:36:57.590878+0000","last_active":"2024-09-17T03:36:58.589696+0000","last_peered":"2024-09-17T03:36:58.589696+0000","last_clean":"2024-09-17T03:36:58.589696+0000","last_became_active":"2024-09-17T03:36:57.590524+0000","last_became_peered":"2024-09-17T03:36:57.590524+0000","last_unstale":"2024-09-17T03:36:58.589696+0000","last_undegraded":"2024-09-17T03:36:58.589696+0000","last_fullsized":"2024-09-17T03:36:58.589696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:39.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615450+0000","last_change":"2024-09-17T03:36:58.608629+0000","last_active":"2024-09-17T03:36:58.615450+0000","last_peered":"2024-09-17T03:36:58.615450+0000","last_clean":"2024-09-17T03:36:58.615450+0000","last_became_active":"2024-09-17T03:36:58.608327+0000","last_became_peered":"2024-09-17T03:36:58.608327+0000","last_unstale":"2024-09-17T03:36:58.615450+0000","last_undegraded":"2024-09-17T03:36:58.615450+0000","last_fullsized":"2024-09-17T03:36:58.615450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:42.334459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.590574+0000","last_change":"2024-09-17T03:36:57.594939+0000","last_active":"2024-09-17T03:36:58.590574+0000","last_peered":"2024-09-17T03:36:58.590574+0000","last_clean":"2024-09-17T03:36:58.590574+0000","last_became_active":"2024-09-17T03:36:57.594242+0000","last_became_peered":"2024-09-17T03:36:57.594242+0000","last_unstale":"2024-09-17T03:36:58.590574+0000","last_undegraded":"2024-09-17T03:36:58.590574+0000","last_fullsized":"2024-09-17T03:36:58.590574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:07.090365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614864+0000","last_change":"2024-09-17T03:36:58.609686+0000","last_active":"2024-09-17T03:36:58.614864+0000","last_peered":"2024-09-17T03:36:58.614864+0000","last_clean":"2024-09-17T03:36:58.614864+0000","last_became_active":"2024-09-17T03:36:58.609366+0000","last_became_peered":"2024-09-17T03:36:58.609366+0000","last_unstale":"2024-09-17T03:36:58.614864+0000","last_undegraded":"2024-09-17T03:36:58.614864+0000","last_fullsized":"2024-09-17T03:36:58.614864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:16.450751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.593723+0000","last_change":"2024-09-17T03:36:57.593661+0000","last_active":"2024-09-17T03:36:58.593723+0000","last_peered":"2024-09-17T03:36:58.593723+0000","last_clean":"2024-09-17T03:36:58.593723+0000","last_became_active":"2024-09-17T03:36:57.593336+0000","last_became_peered":"2024-09-17T03:36:57.593336+0000","last_unstale":"2024-09-17T03:36:58.593723+0000","last_undegraded":"2024-09-17T03:36:58.593723+0000","last_fullsized":"2024-09-17T03:36:58.593723+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:20.210252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624276+0000","last_change":"2024-09-17T03:36:57.593881+0000","last_active":"2024-09-17T03:36:58.624276+0000","last_peered":"2024-09-17T03:36:58.624276+0000","last_clean":"2024-09-17T03:36:58.624276+0000","last_became_active":"2024-09-17T03:36:57.593412+0000","last_became_peered":"2024-09-17T03:36:57.593412+0000","last_unstale":"2024-09-17T03:36:58.624276+0000","last_undegraded":"2024-09-17T03:36:58.624276+0000","last_fullsized":"2024-09-17T03:36:58.624276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:52.808091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":204,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.596710+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:36:58.596710+0000","last_peered":"2024-09-17T03:36:58.596710+0000","last_clean":"2024-09-17T03:36:58.596710+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:36:58.596710+0000","last_undegraded":"2024-09-17T03:36:58.596710+0000","last_fullsized":"2024-09-17T03:36:58.596710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36784,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335056,"statfs":{"total":96636764160,"available":96599097344,"internally_reserved":0,"allocated":1470464,"data_stored":960538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36184,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335656,"statfs":{"total":96636764160,"available":96599711744,"internally_reserved":0,"allocated":856064,"data_stored":362779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40360,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331480,"statfs":{"total":96636764160,"available":96595435520,"internally_reserved":0,"allocated":872448,"data_stored":369624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36208,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335632,"statfs":{"total":96636764160,"available":96599687168,"internally_reserved":0,"allocated":880640,"data_stored":371166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":888832,"data_stored":371782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1462272,"data_stored":959922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335676,"statfs":{"total":96636764160,"available":96599732224,"internally_reserved":0,"allocated":831488,"data_stored":350687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36180,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335660,"statfs":{"total":96636764160,"available":96599715840,"internally_reserved":0,"allocated":843776,"data_stored":356504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:02.967 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:03.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.116+0000 7fe3846b6640 1 -- 172.21.15.146:0/532938382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe37c0b5380 msgr2=0x7fe37c166460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.116+0000 7fe3846b6640 1 --2- 172.21.15.146:0/532938382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe37c0b5380 0x7fe37c166460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe374009be0 tx=0x7fe37402a820 comp rx=0 tx=0).stop 2024-09-17T03:37:03.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.116+0000 7fe3846b6640 1 -- 172.21.15.146:0/532938382 shutdown_connections 2024-09-17T03:37:03.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.116+0000 7fe3846b6640 1 --2- 172.21.15.146:0/532938382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe37c0b5380 0x7fe37c166460 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.116+0000 7fe3846b6640 1 -- 172.21.15.146:0/532938382 >> 172.21.15.146:0/532938382 conn(0x7fe37c0b2060 msgr2=0x7fe37c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:03.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.116+0000 7fe3846b6640 1 -- 172.21.15.146:0/532938382 shutdown_connections 2024-09-17T03:37:03.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.116+0000 7fe3846b6640 1 -- 172.21.15.146:0/532938382 wait complete. 2024-09-17T03:37:03.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.118+0000 7fe3846b6640 1 Processor -- start 2024-09-17T03:37:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.118+0000 7fe3846b6640 1 -- start start 2024-09-17T03:37:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.119+0000 7fe3846b6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe37c072680 0x7fe37c144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.119+0000 7fe3846b6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe37c0b5380 0x7fe37c0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.119+0000 7fe3846b6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe37c15b770 0x7fe37c0aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.119+0000 7fe3846b6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c166d30 con 0x7fe37c0b5380 2024-09-17T03:37:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.119+0000 7fe3846b6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c166bb0 con 0x7fe37c072680 2024-09-17T03:37:03.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.119+0000 7fe3846b6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe37c166eb0 con 0x7fe37c15b770 2024-09-17T03:37:03.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.119+0000 7fe381c51640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe37c0b5380 0x7fe37c0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe381c51640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe37c0b5380 0x7fe37c0ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38160/0 (socket says 172.21.15.146:38160) 2024-09-17T03:37:03.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe381c51640 1 -- 172.21.15.146:0/708667578 learned_addr learned my addr 172.21.15.146:0/708667578 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:03.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe382c53640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe37c15b770 0x7fe37c0aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe382452640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe37c072680 0x7fe37c144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe381c51640 1 -- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe37c15b770 msgr2=0x7fe37c0aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe381c51640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe37c15b770 0x7fe37c0aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe381c51640 1 -- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe37c072680 msgr2=0x7fe37c144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe381c51640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe37c072680 0x7fe37c144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe381c51640 1 -- 172.21.15.146:0/708667578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c1f92d0 con 0x7fe37c0b5380 2024-09-17T03:37:03.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe382c53640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe37c15b770 0x7fe37c0aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:03.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe382452640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe37c072680 0x7fe37c144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:03.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe381c51640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe37c0b5380 0x7fe37c0ae890 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c3f0 tx=0x7fe36c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:03.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe372ffd640 1 -- 172.21.15.146:0/708667578 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c017070 con 0x7fe37c0b5380 2024-09-17T03:37:03.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe372ffd640 1 -- 172.21.15.146:0/708667578 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe36c0053e0 con 0x7fe37c0b5380 2024-09-17T03:37:03.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe3846b6640 1 -- 172.21.15.146:0/708667578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37c1547e0 con 0x7fe37c0b5380 2024-09-17T03:37:03.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe372ffd640 1 -- 172.21.15.146:0/708667578 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c0038a0 con 0x7fe37c0b5380 2024-09-17T03:37:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.120+0000 7fe3846b6640 1 -- 172.21.15.146:0/708667578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37c0cef20 con 0x7fe37c0b5380 2024-09-17T03:37:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.121+0000 7fe3846b6640 1 -- 172.21.15.146:0/708667578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe37c06fe10 con 0x7fe37c0b5380 2024-09-17T03:37:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.122+0000 7fe372ffd640 1 -- 172.21.15.146:0/708667578 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe36c01a070 con 0x7fe37c0b5380 2024-09-17T03:37:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.122+0000 7fe372ffd640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe360078b90 0x7fe36007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.123+0000 7fe372ffd640 1 -- 172.21.15.146:0/708667578 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7fe36c09a0f0 con 0x7fe37c0b5380 2024-09-17T03:37:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.123+0000 7fe382452640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe360078b90 0x7fe36007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.123+0000 7fe382452640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe360078b90 0x7fe36007b0a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe378007b00 tx=0x7fe378009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:03.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.127+0000 7fe372ffd640 1 -- 172.21.15.146:0/708667578 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe36c062530 con 0x7fe37c0b5380 2024-09-17T03:37:03.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.298+0000 7fe3846b6640 1 -- 172.21.15.146:0/708667578 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe37c1f97d0 con 0x7fe360078b90 2024-09-17T03:37:03.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.302+0000 7fe372ffd640 1 -- 172.21.15.146:0/708667578 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249429 (secure 0 0 0) 0x7fe37c1f97d0 con 0x7fe360078b90 2024-09-17T03:37:03.305 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.305+0000 7fe3846b6640 1 -- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe360078b90 msgr2=0x7fe36007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.305+0000 7fe3846b6640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe360078b90 0x7fe36007b0a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe378007b00 tx=0x7fe378009040 comp rx=0 tx=0).stop 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.305+0000 7fe3846b6640 1 -- 172.21.15.146:0/708667578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe37c0b5380 msgr2=0x7fe37c0ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.305+0000 7fe3846b6640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe37c0b5380 0x7fe37c0ae890 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c3f0 tx=0x7fe36c00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.305+0000 7fe3846b6640 1 -- 172.21.15.146:0/708667578 shutdown_connections 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.306+0000 7fe3846b6640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe360078b90 0x7fe36007b0a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.306+0000 7fe3846b6640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe37c15b770 0x7fe37c0aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.306+0000 7fe3846b6640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe37c0b5380 0x7fe37c0ae890 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.306+0000 7fe3846b6640 1 --2- 172.21.15.146:0/708667578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe37c072680 0x7fe37c144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.306+0000 7fe3846b6640 1 -- 172.21.15.146:0/708667578 >> 172.21.15.146:0/708667578 conn(0x7fe37c0b2060 msgr2=0x7fe37c0b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.306+0000 7fe3846b6640 1 -- 172.21.15.146:0/708667578 shutdown_connections 2024-09-17T03:37:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.306+0000 7fe3846b6640 1 -- 172.21.15.146:0/708667578 wait complete. 2024-09-17T03:37:03.317 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-17T03:37:01.851457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592688,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":141,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":290720,"kb_used_data":7916,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754684000,"statfs":{"total":773094113280,"available":772796416000,"internally_reserved":0,"allocated":8105984,"data_stored":4103002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":289394225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2320,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.283468"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.622136+0000","last_change":"2024-09-17T03:36:58.617054+0000","last_active":"2024-09-17T03:36:58.622136+0000","last_peered":"2024-09-17T03:36:58.622136+0000","last_clean":"2024-09-17T03:36:58.622136+0000","last_became_active":"2024-09-17T03:36:58.616715+0000","last_became_peered":"2024-09-17T03:36:58.616715+0000","last_unstale":"2024-09-17T03:36:58.622136+0000","last_undegraded":"2024-09-17T03:36:58.622136+0000","last_fullsized":"2024-09-17T03:36:58.622136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:27.445679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.616794+0000","last_change":"2024-09-17T03:36:58.613591+0000","last_active":"2024-09-17T03:36:58.616794+0000","last_peered":"2024-09-17T03:36:58.616794+0000","last_clean":"2024-09-17T03:36:58.616794+0000","last_became_active":"2024-09-17T03:36:58.613190+0000","last_became_peered":"2024-09-17T03:36:58.613190+0000","last_unstale":"2024-09-17T03:36:58.616794+0000","last_undegraded":"2024-09-17T03:36:58.616794+0000","last_fullsized":"2024-09-17T03:36:58.616794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:35.898980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.607671+0000","last_change":"2024-09-17T03:36:58.605913+0000","last_active":"2024-09-17T03:36:58.607671+0000","last_peered":"2024-09-17T03:36:58.607671+0000","last_clean":"2024-09-17T03:36:58.607671+0000","last_became_active":"2024-09-17T03:36:58.605551+0000","last_became_peered":"2024-09-17T03:36:58.605551+0000","last_unstale":"2024-09-17T03:36:58.607671+0000","last_undegraded":"2024-09-17T03:36:58.607671+0000","last_fullsized":"2024-09-17T03:36:58.607671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:25.911924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619985+0000","last_change":"2024-09-17T03:36:58.616318+0000","last_active":"2024-09-17T03:36:58.619985+0000","last_peered":"2024-09-17T03:36:58.619985+0000","last_clean":"2024-09-17T03:36:58.619985+0000","last_became_active":"2024-09-17T03:36:58.615972+0000","last_became_peered":"2024-09-17T03:36:58.615972+0000","last_unstale":"2024-09-17T03:36:58.619985+0000","last_undegraded":"2024-09-17T03:36:58.619985+0000","last_fullsized":"2024-09-17T03:36:58.619985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:09.798475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.616821+0000","last_change":"2024-09-17T03:36:58.613048+0000","last_active":"2024-09-17T03:36:58.616821+0000","last_peered":"2024-09-17T03:36:58.616821+0000","last_clean":"2024-09-17T03:36:58.616821+0000","last_became_active":"2024-09-17T03:36:58.612726+0000","last_became_peered":"2024-09-17T03:36:58.612726+0000","last_unstale":"2024-09-17T03:36:58.616821+0000","last_undegraded":"2024-09-17T03:36:58.616821+0000","last_fullsized":"2024-09-17T03:36:58.616821+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.538161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615310+0000","last_change":"2024-09-17T03:36:58.608044+0000","last_active":"2024-09-17T03:36:58.615310+0000","last_peered":"2024-09-17T03:36:58.615310+0000","last_clean":"2024-09-17T03:36:58.615310+0000","last_became_active":"2024-09-17T03:36:58.607155+0000","last_became_peered":"2024-09-17T03:36:58.607155+0000","last_unstale":"2024-09-17T03:36:58.615310+0000","last_undegraded":"2024-09-17T03:36:58.615310+0000","last_fullsized":"2024-09-17T03:36:58.615310+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:08.826637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619374+0000","last_change":"2024-09-17T03:36:58.614210+0000","last_active":"2024-09-17T03:36:58.619374+0000","last_peered":"2024-09-17T03:36:58.619374+0000","last_clean":"2024-09-17T03:36:58.619374+0000","last_became_active":"2024-09-17T03:36:58.613913+0000","last_became_peered":"2024-09-17T03:36:58.613913+0000","last_unstale":"2024-09-17T03:36:58.619374+0000","last_undegraded":"2024-09-17T03:36:58.619374+0000","last_fullsized":"2024-09-17T03:36:58.619374+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:25.068863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.611663+0000","last_change":"2024-09-17T03:36:58.607751+0000","last_active":"2024-09-17T03:36:58.611663+0000","last_peered":"2024-09-17T03:36:58.611663+0000","last_clean":"2024-09-17T03:36:58.611663+0000","last_became_active":"2024-09-17T03:36:58.607444+0000","last_became_peered":"2024-09-17T03:36:58.607444+0000","last_unstale":"2024-09-17T03:36:58.611663+0000","last_undegraded":"2024-09-17T03:36:58.611663+0000","last_fullsized":"2024-09-17T03:36:58.611663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:09.197304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615443+0000","last_change":"2024-09-17T03:36:58.612036+0000","last_active":"2024-09-17T03:36:58.615443+0000","last_peered":"2024-09-17T03:36:58.615443+0000","last_clean":"2024-09-17T03:36:58.615443+0000","last_became_active":"2024-09-17T03:36:58.611664+0000","last_became_peered":"2024-09-17T03:36:58.611664+0000","last_unstale":"2024-09-17T03:36:58.615443+0000","last_undegraded":"2024-09-17T03:36:58.615443+0000","last_fullsized":"2024-09-17T03:36:58.615443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:47.066196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.605298+0000","last_change":"2024-09-17T03:36:58.603439+0000","last_active":"2024-09-17T03:36:58.605298+0000","last_peered":"2024-09-17T03:36:58.605298+0000","last_clean":"2024-09-17T03:36:58.605298+0000","last_became_active":"2024-09-17T03:36:58.603155+0000","last_became_peered":"2024-09-17T03:36:58.603155+0000","last_unstale":"2024-09-17T03:36:58.605298+0000","last_undegraded":"2024-09-17T03:36:58.605298+0000","last_fullsized":"2024-09-17T03:36:58.605298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:33.418376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614721+0000","last_change":"2024-09-17T03:36:58.611787+0000","last_active":"2024-09-17T03:36:58.614721+0000","last_peered":"2024-09-17T03:36:58.614721+0000","last_clean":"2024-09-17T03:36:58.614721+0000","last_became_active":"2024-09-17T03:36:58.611492+0000","last_became_peered":"2024-09-17T03:36:58.611492+0000","last_unstale":"2024-09-17T03:36:58.614721+0000","last_undegraded":"2024-09-17T03:36:58.614721+0000","last_fullsized":"2024-09-17T03:36:58.614721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:20.680288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618331+0000","last_change":"2024-09-17T03:36:58.612245+0000","last_active":"2024-09-17T03:36:58.618331+0000","last_peered":"2024-09-17T03:36:58.618331+0000","last_clean":"2024-09-17T03:36:58.618331+0000","last_became_active":"2024-09-17T03:36:58.611923+0000","last_became_peered":"2024-09-17T03:36:58.611923+0000","last_unstale":"2024-09-17T03:36:58.618331+0000","last_undegraded":"2024-09-17T03:36:58.618331+0000","last_fullsized":"2024-09-17T03:36:58.618331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:29.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613136+0000","last_change":"2024-09-17T03:36:58.605653+0000","last_active":"2024-09-17T03:36:58.613136+0000","last_peered":"2024-09-17T03:36:58.613136+0000","last_clean":"2024-09-17T03:36:58.613136+0000","last_became_active":"2024-09-17T03:36:58.605358+0000","last_became_peered":"2024-09-17T03:36:58.605358+0000","last_unstale":"2024-09-17T03:36:58.613136+0000","last_undegraded":"2024-09-17T03:36:58.613136+0000","last_fullsized":"2024-09-17T03:36:58.613136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:38.335687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609157+0000","last_change":"2024-09-17T03:36:58.603629+0000","last_active":"2024-09-17T03:36:58.609157+0000","last_peered":"2024-09-17T03:36:58.609157+0000","last_clean":"2024-09-17T03:36:58.609157+0000","last_became_active":"2024-09-17T03:36:58.602937+0000","last_became_peered":"2024-09-17T03:36:58.602937+0000","last_unstale":"2024-09-17T03:36:58.609157+0000","last_undegraded":"2024-09-17T03:36:58.609157+0000","last_fullsized":"2024-09-17T03:36:58.609157+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:50.782400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618660+0000","last_change":"2024-09-17T03:36:58.611332+0000","last_active":"2024-09-17T03:36:58.618660+0000","last_peered":"2024-09-17T03:36:58.618660+0000","last_clean":"2024-09-17T03:36:58.618660+0000","last_became_active":"2024-09-17T03:36:58.611024+0000","last_became_peered":"2024-09-17T03:36:58.611024+0000","last_unstale":"2024-09-17T03:36:58.618660+0000","last_undegraded":"2024-09-17T03:36:58.618660+0000","last_fullsized":"2024-09-17T03:36:58.618660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:44.315656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615625+0000","last_change":"2024-09-17T03:36:58.609578+0000","last_active":"2024-09-17T03:36:58.615625+0000","last_peered":"2024-09-17T03:36:58.615625+0000","last_clean":"2024-09-17T03:36:58.615625+0000","last_became_active":"2024-09-17T03:36:58.609270+0000","last_became_peered":"2024-09-17T03:36:58.609270+0000","last_unstale":"2024-09-17T03:36:58.615625+0000","last_undegraded":"2024-09-17T03:36:58.615625+0000","last_fullsized":"2024-09-17T03:36:58.615625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:34.917655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614907+0000","last_change":"2024-09-17T03:36:58.604940+0000","last_active":"2024-09-17T03:36:58.614907+0000","last_peered":"2024-09-17T03:36:58.614907+0000","last_clean":"2024-09-17T03:36:58.614907+0000","last_became_active":"2024-09-17T03:36:58.604635+0000","last_became_peered":"2024-09-17T03:36:58.604635+0000","last_unstale":"2024-09-17T03:36:58.614907+0000","last_undegraded":"2024-09-17T03:36:58.614907+0000","last_fullsized":"2024-09-17T03:36:58.614907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:34.917655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613174+0000","last_change":"2024-09-17T03:36:58.604263+0000","last_active":"2024-09-17T03:36:58.613174+0000","last_peered":"2024-09-17T03:36:58.613174+0000","last_clean":"2024-09-17T03:36:58.613174+0000","last_became_active":"2024-09-17T03:36:58.603672+0000","last_became_peered":"2024-09-17T03:36:58.603672+0000","last_unstale":"2024-09-17T03:36:58.613174+0000","last_undegraded":"2024-09-17T03:36:58.613174+0000","last_fullsized":"2024-09-17T03:36:58.613174+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:30.276913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.611765+0000","last_change":"2024-09-17T03:36:58.601622+0000","last_active":"2024-09-17T03:36:58.611765+0000","last_peered":"2024-09-17T03:36:58.611765+0000","last_clean":"2024-09-17T03:36:58.611765+0000","last_became_active":"2024-09-17T03:36:58.601303+0000","last_became_peered":"2024-09-17T03:36:58.601303+0000","last_unstale":"2024-09-17T03:36:58.611765+0000","last_undegraded":"2024-09-17T03:36:58.611765+0000","last_fullsized":"2024-09-17T03:36:58.611765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:31.989872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613826+0000","last_change":"2024-09-17T03:36:58.610601+0000","last_active":"2024-09-17T03:36:58.613826+0000","last_peered":"2024-09-17T03:36:58.613826+0000","last_clean":"2024-09-17T03:36:58.613826+0000","last_became_active":"2024-09-17T03:36:58.610255+0000","last_became_peered":"2024-09-17T03:36:58.610255+0000","last_unstale":"2024-09-17T03:36:58.613826+0000","last_undegraded":"2024-09-17T03:36:58.613826+0000","last_fullsized":"2024-09-17T03:36:58.613826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:54.883572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.607235+0000","last_change":"2024-09-17T03:36:58.604903+0000","last_active":"2024-09-17T03:36:58.607235+0000","last_peered":"2024-09-17T03:36:58.607235+0000","last_clean":"2024-09-17T03:36:58.607235+0000","last_became_active":"2024-09-17T03:36:58.604570+0000","last_became_peered":"2024-09-17T03:36:58.604570+0000","last_unstale":"2024-09-17T03:36:58.607235+0000","last_undegraded":"2024-09-17T03:36:58.607235+0000","last_fullsized":"2024-09-17T03:36:58.607235+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:32.468155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615436+0000","last_change":"2024-09-17T03:36:58.611647+0000","last_active":"2024-09-17T03:36:58.615436+0000","last_peered":"2024-09-17T03:36:58.615436+0000","last_clean":"2024-09-17T03:36:58.615436+0000","last_became_active":"2024-09-17T03:36:58.611306+0000","last_became_peered":"2024-09-17T03:36:58.611306+0000","last_unstale":"2024-09-17T03:36:58.615436+0000","last_undegraded":"2024-09-17T03:36:58.615436+0000","last_fullsized":"2024-09-17T03:36:58.615436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:44.377859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609013+0000","last_change":"2024-09-17T03:36:58.601635+0000","last_active":"2024-09-17T03:36:58.609013+0000","last_peered":"2024-09-17T03:36:58.609013+0000","last_clean":"2024-09-17T03:36:58.609013+0000","last_became_active":"2024-09-17T03:36:58.601341+0000","last_became_peered":"2024-09-17T03:36:58.601341+0000","last_unstale":"2024-09-17T03:36:58.609013+0000","last_undegraded":"2024-09-17T03:36:58.609013+0000","last_fullsized":"2024-09-17T03:36:58.609013+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:39.072061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613572+0000","last_change":"2024-09-17T03:36:58.610689+0000","last_active":"2024-09-17T03:36:58.613572+0000","last_peered":"2024-09-17T03:36:58.613572+0000","last_clean":"2024-09-17T03:36:58.613572+0000","last_became_active":"2024-09-17T03:36:58.610241+0000","last_became_peered":"2024-09-17T03:36:58.610241+0000","last_unstale":"2024-09-17T03:36:58.613572+0000","last_undegraded":"2024-09-17T03:36:58.613572+0000","last_fullsized":"2024-09-17T03:36:58.613572+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:29.450418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615569+0000","last_change":"2024-09-17T03:36:58.610171+0000","last_active":"2024-09-17T03:36:58.615569+0000","last_peered":"2024-09-17T03:36:58.615569+0000","last_clean":"2024-09-17T03:36:58.615569+0000","last_became_active":"2024-09-17T03:36:58.609749+0000","last_became_peered":"2024-09-17T03:36:58.609749+0000","last_unstale":"2024-09-17T03:36:58.615569+0000","last_undegraded":"2024-09-17T03:36:58.615569+0000","last_fullsized":"2024-09-17T03:36:58.615569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:22.607257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.621860+0000","last_change":"2024-09-17T03:36:58.616100+0000","last_active":"2024-09-17T03:36:58.621860+0000","last_peered":"2024-09-17T03:36:58.621860+0000","last_clean":"2024-09-17T03:36:58.621860+0000","last_became_active":"2024-09-17T03:36:58.615736+0000","last_became_peered":"2024-09-17T03:36:58.615736+0000","last_unstale":"2024-09-17T03:36:58.621860+0000","last_undegraded":"2024-09-17T03:36:58.621860+0000","last_fullsized":"2024-09-17T03:36:58.621860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:05.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.622050+0000","last_change":"2024-09-17T03:36:57.593446+0000","last_active":"2024-09-17T03:36:58.622050+0000","last_peered":"2024-09-17T03:36:58.622050+0000","last_clean":"2024-09-17T03:36:58.622050+0000","last_became_active":"2024-09-17T03:36:57.592914+0000","last_became_peered":"2024-09-17T03:36:57.592914+0000","last_unstale":"2024-09-17T03:36:58.622050+0000","last_undegraded":"2024-09-17T03:36:58.622050+0000","last_fullsized":"2024-09-17T03:36:58.622050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:04.448726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618631+0000","last_change":"2024-09-17T03:36:58.610586+0000","last_active":"2024-09-17T03:36:58.618631+0000","last_peered":"2024-09-17T03:36:58.618631+0000","last_clean":"2024-09-17T03:36:58.618631+0000","last_became_active":"2024-09-17T03:36:58.610274+0000","last_became_peered":"2024-09-17T03:36:58.610274+0000","last_unstale":"2024-09-17T03:36:58.618631+0000","last_undegraded":"2024-09-17T03:36:58.618631+0000","last_fullsized":"2024-09-17T03:36:58.618631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:50.836681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.620215+0000","last_change":"2024-09-17T03:36:57.585526+0000","last_active":"2024-09-17T03:36:58.620215+0000","last_peered":"2024-09-17T03:36:58.620215+0000","last_clean":"2024-09-17T03:36:58.620215+0000","last_became_active":"2024-09-17T03:36:57.585185+0000","last_became_peered":"2024-09-17T03:36:57.585185+0000","last_unstale":"2024-09-17T03:36:58.620215+0000","last_undegraded":"2024-09-17T03:36:58.620215+0000","last_fullsized":"2024-09-17T03:36:58.620215+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:01.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615168+0000","last_change":"2024-09-17T03:36:58.604536+0000","last_active":"2024-09-17T03:36:58.615168+0000","last_peered":"2024-09-17T03:36:58.615168+0000","last_clean":"2024-09-17T03:36:58.615168+0000","last_became_active":"2024-09-17T03:36:58.604117+0000","last_became_peered":"2024-09-17T03:36:58.604117+0000","last_unstale":"2024-09-17T03:36:58.615168+0000","last_undegraded":"2024-09-17T03:36:58.615168+0000","last_fullsized":"2024-09-17T03:36:58.615168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:42.334459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624127+0000","last_change":"2024-09-17T03:36:57.584256+0000","last_active":"2024-09-17T03:36:58.624127+0000","last_peered":"2024-09-17T03:36:58.624127+0000","last_clean":"2024-09-17T03:36:58.624127+0000","last_became_active":"2024-09-17T03:36:57.583832+0000","last_became_peered":"2024-09-17T03:36:57.583832+0000","last_unstale":"2024-09-17T03:36:58.624127+0000","last_undegraded":"2024-09-17T03:36:58.624127+0000","last_fullsized":"2024-09-17T03:36:58.624127+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:48.077004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610216+0000","last_change":"2024-09-17T03:36:58.608312+0000","last_active":"2024-09-17T03:36:58.610216+0000","last_peered":"2024-09-17T03:36:58.610216+0000","last_clean":"2024-09-17T03:36:58.610216+0000","last_became_active":"2024-09-17T03:36:58.607981+0000","last_became_peered":"2024-09-17T03:36:58.607981+0000","last_unstale":"2024-09-17T03:36:58.610216+0000","last_undegraded":"2024-09-17T03:36:58.610216+0000","last_fullsized":"2024-09-17T03:36:58.610216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:26.016580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623739+0000","last_change":"2024-09-17T03:36:57.593693+0000","last_active":"2024-09-17T03:36:58.623739+0000","last_peered":"2024-09-17T03:36:58.623739+0000","last_clean":"2024-09-17T03:36:58.623739+0000","last_became_active":"2024-09-17T03:36:57.593350+0000","last_became_peered":"2024-09-17T03:36:57.593350+0000","last_unstale":"2024-09-17T03:36:58.623739+0000","last_undegraded":"2024-09-17T03:36:58.623739+0000","last_fullsized":"2024-09-17T03:36:58.623739+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:32.413220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.576417+0000","last_change":"2024-09-17T03:36:56.576417+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.576417+0000","last_undegraded":"2024-09-17T03:36:56.576417+0000","last_fullsized":"2024-09-17T03:36:56.576417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614506+0000","last_change":"2024-09-17T03:36:58.612378+0000","last_active":"2024-09-17T03:36:58.614506+0000","last_peered":"2024-09-17T03:36:58.614506+0000","last_clean":"2024-09-17T03:36:58.614506+0000","last_became_active":"2024-09-17T03:36:58.612031+0000","last_became_peered":"2024-09-17T03:36:58.612031+0000","last_unstale":"2024-09-17T03:36:58.614506+0000","last_undegraded":"2024-09-17T03:36:58.614506+0000","last_fullsized":"2024-09-17T03:36:58.614506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:08.513728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623848+0000","last_change":"2024-09-17T03:36:57.590622+0000","last_active":"2024-09-17T03:36:58.623848+0000","last_peered":"2024-09-17T03:36:58.623848+0000","last_clean":"2024-09-17T03:36:58.623848+0000","last_became_active":"2024-09-17T03:36:57.590266+0000","last_became_peered":"2024-09-17T03:36:57.590266+0000","last_unstale":"2024-09-17T03:36:58.623848+0000","last_undegraded":"2024-09-17T03:36:58.623848+0000","last_fullsized":"2024-09-17T03:36:58.623848+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:55.095810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619669+0000","last_change":"2024-09-17T03:36:58.612013+0000","last_active":"2024-09-17T03:36:58.619669+0000","last_peered":"2024-09-17T03:36:58.619669+0000","last_clean":"2024-09-17T03:36:58.619669+0000","last_became_active":"2024-09-17T03:36:58.611745+0000","last_became_peered":"2024-09-17T03:36:58.611745+0000","last_unstale":"2024-09-17T03:36:58.619669+0000","last_undegraded":"2024-09-17T03:36:58.619669+0000","last_fullsized":"2024-09-17T03:36:58.619669+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:57.877593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.589675+0000","last_change":"2024-09-17T03:36:57.590493+0000","last_active":"2024-09-17T03:36:58.589675+0000","last_peered":"2024-09-17T03:36:58.589675+0000","last_clean":"2024-09-17T03:36:58.589675+0000","last_became_active":"2024-09-17T03:36:57.590157+0000","last_became_peered":"2024-09-17T03:36:57.590157+0000","last_unstale":"2024-09-17T03:36:58.589675+0000","last_undegraded":"2024-09-17T03:36:58.589675+0000","last_fullsized":"2024-09-17T03:36:58.589675+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:45.348233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613107+0000","last_change":"2024-09-17T03:36:58.604882+0000","last_active":"2024-09-17T03:36:58.613107+0000","last_peered":"2024-09-17T03:36:58.613107+0000","last_clean":"2024-09-17T03:36:58.613107+0000","last_became_active":"2024-09-17T03:36:58.604597+0000","last_became_peered":"2024-09-17T03:36:58.604597+0000","last_unstale":"2024-09-17T03:36:58.613107+0000","last_undegraded":"2024-09-17T03:36:58.613107+0000","last_fullsized":"2024-09-17T03:36:58.613107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:26.075265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.595824+0000","last_change":"2024-09-17T03:36:57.586393+0000","last_active":"2024-09-17T03:36:58.595824+0000","last_peered":"2024-09-17T03:36:58.595824+0000","last_clean":"2024-09-17T03:36:58.595824+0000","last_became_active":"2024-09-17T03:36:57.586120+0000","last_became_peered":"2024-09-17T03:36:57.586120+0000","last_unstale":"2024-09-17T03:36:58.595824+0000","last_undegraded":"2024-09-17T03:36:58.595824+0000","last_fullsized":"2024-09-17T03:36:58.595824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:47.246300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597464+0000","last_change":"2024-09-17T03:36:57.589422+0000","last_active":"2024-09-17T03:36:58.597464+0000","last_peered":"2024-09-17T03:36:58.597464+0000","last_clean":"2024-09-17T03:36:58.597464+0000","last_became_active":"2024-09-17T03:36:57.589098+0000","last_became_peered":"2024-09-17T03:36:57.589098+0000","last_unstale":"2024-09-17T03:36:58.597464+0000","last_undegraded":"2024-09-17T03:36:58.597464+0000","last_fullsized":"2024-09-17T03:36:58.597464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:39.093916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.606985+0000","last_change":"2024-09-17T03:36:58.604411+0000","last_active":"2024-09-17T03:36:58.606985+0000","last_peered":"2024-09-17T03:36:58.606985+0000","last_clean":"2024-09-17T03:36:58.606985+0000","last_became_active":"2024-09-17T03:36:58.604012+0000","last_became_peered":"2024-09-17T03:36:58.604012+0000","last_unstale":"2024-09-17T03:36:58.606985+0000","last_undegraded":"2024-09-17T03:36:58.606985+0000","last_fullsized":"2024-09-17T03:36:58.606985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:12.827748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598400+0000","last_change":"2024-09-17T03:36:57.596267+0000","last_active":"2024-09-17T03:36:58.598400+0000","last_peered":"2024-09-17T03:36:58.598400+0000","last_clean":"2024-09-17T03:36:58.598400+0000","last_became_active":"2024-09-17T03:36:57.595964+0000","last_became_peered":"2024-09-17T03:36:57.595964+0000","last_unstale":"2024-09-17T03:36:58.598400+0000","last_undegraded":"2024-09-17T03:36:58.598400+0000","last_fullsized":"2024-09-17T03:36:58.598400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:52.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.617051+0000","last_change":"2024-09-17T03:36:58.613987+0000","last_active":"2024-09-17T03:36:58.617051+0000","last_peered":"2024-09-17T03:36:58.617051+0000","last_clean":"2024-09-17T03:36:58.617051+0000","last_became_active":"2024-09-17T03:36:58.612963+0000","last_became_peered":"2024-09-17T03:36:58.612963+0000","last_unstale":"2024-09-17T03:36:58.617051+0000","last_undegraded":"2024-09-17T03:36:58.617051+0000","last_fullsized":"2024-09-17T03:36:58.617051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:31.989872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.576586+0000","last_change":"2024-09-17T03:36:56.576586+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.576586+0000","last_undegraded":"2024-09-17T03:36:56.576586+0000","last_fullsized":"2024-09-17T03:36:56.576586+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609397+0000","last_change":"2024-09-17T03:36:58.606960+0000","last_active":"2024-09-17T03:36:58.609397+0000","last_peered":"2024-09-17T03:36:58.609397+0000","last_clean":"2024-09-17T03:36:58.609397+0000","last_became_active":"2024-09-17T03:36:58.606534+0000","last_became_peered":"2024-09-17T03:36:58.606534+0000","last_unstale":"2024-09-17T03:36:58.609397+0000","last_undegraded":"2024-09-17T03:36:58.609397+0000","last_fullsized":"2024-09-17T03:36:58.609397+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:32.744450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623982+0000","last_change":"2024-09-17T03:36:57.583631+0000","last_active":"2024-09-17T03:36:58.623982+0000","last_peered":"2024-09-17T03:36:58.623982+0000","last_clean":"2024-09-17T03:36:58.623982+0000","last_became_active":"2024-09-17T03:36:57.583303+0000","last_became_peered":"2024-09-17T03:36:57.583303+0000","last_unstale":"2024-09-17T03:36:58.623982+0000","last_undegraded":"2024-09-17T03:36:58.623982+0000","last_fullsized":"2024-09-17T03:36:58.623982+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:52.808091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610116+0000","last_change":"2024-09-17T03:36:58.608223+0000","last_active":"2024-09-17T03:36:58.610116+0000","last_peered":"2024-09-17T03:36:58.610116+0000","last_clean":"2024-09-17T03:36:58.610116+0000","last_became_active":"2024-09-17T03:36:58.607909+0000","last_became_peered":"2024-09-17T03:36:58.607909+0000","last_unstale":"2024-09-17T03:36:58.610116+0000","last_undegraded":"2024-09-17T03:36:58.610116+0000","last_fullsized":"2024-09-17T03:36:58.610116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:40.743100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619256+0000","last_change":"2024-09-17T03:36:57.594639+0000","last_active":"2024-09-17T03:36:58.619256+0000","last_peered":"2024-09-17T03:36:58.619256+0000","last_clean":"2024-09-17T03:36:58.619256+0000","last_became_active":"2024-09-17T03:36:57.594225+0000","last_became_peered":"2024-09-17T03:36:57.594225+0000","last_unstale":"2024-09-17T03:36:58.619256+0000","last_undegraded":"2024-09-17T03:36:58.619256+0000","last_fullsized":"2024-09-17T03:36:58.619256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.745067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597196+0000","last_change":"2024-09-17T03:36:57.582416+0000","last_active":"2024-09-17T03:36:58.597196+0000","last_peered":"2024-09-17T03:36:58.597196+0000","last_clean":"2024-09-17T03:36:58.597196+0000","last_became_active":"2024-09-17T03:36:57.582075+0000","last_became_peered":"2024-09-17T03:36:57.582075+0000","last_unstale":"2024-09-17T03:36:58.597196+0000","last_undegraded":"2024-09-17T03:36:58.597196+0000","last_fullsized":"2024-09-17T03:36:58.597196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:39.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615044+0000","last_change":"2024-09-17T03:36:58.614063+0000","last_active":"2024-09-17T03:36:58.615044+0000","last_peered":"2024-09-17T03:36:58.615044+0000","last_clean":"2024-09-17T03:36:58.615044+0000","last_became_active":"2024-09-17T03:36:58.613765+0000","last_became_peered":"2024-09-17T03:36:58.613765+0000","last_unstale":"2024-09-17T03:36:58.615044+0000","last_undegraded":"2024-09-17T03:36:58.615044+0000","last_fullsized":"2024-09-17T03:36:58.615044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:19.612415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.578179+0000","last_change":"2024-09-17T03:36:56.578179+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.578179+0000","last_undegraded":"2024-09-17T03:36:56.578179+0000","last_fullsized":"2024-09-17T03:36:56.578179+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619653+0000","last_change":"2024-09-17T03:36:58.615101+0000","last_active":"2024-09-17T03:36:58.619653+0000","last_peered":"2024-09-17T03:36:58.619653+0000","last_clean":"2024-09-17T03:36:58.619653+0000","last_became_active":"2024-09-17T03:36:58.614759+0000","last_became_peered":"2024-09-17T03:36:58.614759+0000","last_unstale":"2024-09-17T03:36:58.619653+0000","last_undegraded":"2024-09-17T03:36:58.619653+0000","last_fullsized":"2024-09-17T03:36:58.619653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:57.046686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.626931+0000","last_change":"2024-09-17T03:36:57.590811+0000","last_active":"2024-09-17T03:36:58.626931+0000","last_peered":"2024-09-17T03:36:58.626931+0000","last_clean":"2024-09-17T03:36:58.626931+0000","last_became_active":"2024-09-17T03:36:57.590493+0000","last_became_peered":"2024-09-17T03:36:57.590493+0000","last_unstale":"2024-09-17T03:36:58.626931+0000","last_undegraded":"2024-09-17T03:36:58.626931+0000","last_fullsized":"2024-09-17T03:36:58.626931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:36.950013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.608959+0000","last_change":"2024-09-17T03:36:58.603205+0000","last_active":"2024-09-17T03:36:58.608959+0000","last_peered":"2024-09-17T03:36:58.608959+0000","last_clean":"2024-09-17T03:36:58.608959+0000","last_became_active":"2024-09-17T03:36:58.602879+0000","last_became_peered":"2024-09-17T03:36:58.602879+0000","last_unstale":"2024-09-17T03:36:58.608959+0000","last_undegraded":"2024-09-17T03:36:58.608959+0000","last_fullsized":"2024-09-17T03:36:58.608959+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:15.337006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624130+0000","last_change":"2024-09-17T03:36:57.591724+0000","last_active":"2024-09-17T03:36:58.624130+0000","last_peered":"2024-09-17T03:36:58.624130+0000","last_clean":"2024-09-17T03:36:58.624130+0000","last_became_active":"2024-09-17T03:36:57.591423+0000","last_became_peered":"2024-09-17T03:36:57.591423+0000","last_unstale":"2024-09-17T03:36:58.624130+0000","last_undegraded":"2024-09-17T03:36:58.624130+0000","last_fullsized":"2024-09-17T03:36:58.624130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:47.502370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.608531+0000","last_change":"2024-09-17T03:36:58.606423+0000","last_active":"2024-09-17T03:36:58.608531+0000","last_peered":"2024-09-17T03:36:58.608531+0000","last_clean":"2024-09-17T03:36:58.608531+0000","last_became_active":"2024-09-17T03:36:58.606054+0000","last_became_peered":"2024-09-17T03:36:58.606054+0000","last_unstale":"2024-09-17T03:36:58.608531+0000","last_undegraded":"2024-09-17T03:36:58.608531+0000","last_fullsized":"2024-09-17T03:36:58.608531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:37.194170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623685+0000","last_change":"2024-09-17T03:36:57.584163+0000","last_active":"2024-09-17T03:36:58.623685+0000","last_peered":"2024-09-17T03:36:58.623685+0000","last_clean":"2024-09-17T03:36:58.623685+0000","last_became_active":"2024-09-17T03:36:57.583706+0000","last_became_peered":"2024-09-17T03:36:57.583706+0000","last_unstale":"2024-09-17T03:36:58.623685+0000","last_undegraded":"2024-09-17T03:36:58.623685+0000","last_fullsized":"2024-09-17T03:36:58.623685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:12.542540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.605257+0000","last_change":"2024-09-17T03:36:58.603373+0000","last_active":"2024-09-17T03:36:58.605257+0000","last_peered":"2024-09-17T03:36:58.605257+0000","last_clean":"2024-09-17T03:36:58.605257+0000","last_became_active":"2024-09-17T03:36:58.602742+0000","last_became_peered":"2024-09-17T03:36:58.602742+0000","last_unstale":"2024-09-17T03:36:58.605257+0000","last_undegraded":"2024-09-17T03:36:58.605257+0000","last_fullsized":"2024-09-17T03:36:58.605257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:53.456094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624389+0000","last_change":"2024-09-17T03:36:57.597237+0000","last_active":"2024-09-17T03:36:58.624389+0000","last_peered":"2024-09-17T03:36:58.624389+0000","last_clean":"2024-09-17T03:36:58.624389+0000","last_became_active":"2024-09-17T03:36:57.596927+0000","last_became_peered":"2024-09-17T03:36:57.596927+0000","last_unstale":"2024-09-17T03:36:58.624389+0000","last_undegraded":"2024-09-17T03:36:58.624389+0000","last_fullsized":"2024-09-17T03:36:58.624389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:45.348233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619628+0000","last_change":"2024-09-17T03:36:58.615051+0000","last_active":"2024-09-17T03:36:58.619628+0000","last_peered":"2024-09-17T03:36:58.619628+0000","last_clean":"2024-09-17T03:36:58.619628+0000","last_became_active":"2024-09-17T03:36:58.614727+0000","last_became_peered":"2024-09-17T03:36:58.614727+0000","last_unstale":"2024-09-17T03:36:58.619628+0000","last_undegraded":"2024-09-17T03:36:58.619628+0000","last_fullsized":"2024-09-17T03:36:58.619628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:29.560429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597705+0000","last_change":"2024-09-17T03:36:57.592743+0000","last_active":"2024-09-17T03:36:58.597705+0000","last_peered":"2024-09-17T03:36:58.597705+0000","last_clean":"2024-09-17T03:36:58.597705+0000","last_became_active":"2024-09-17T03:36:57.592410+0000","last_became_peered":"2024-09-17T03:36:57.592410+0000","last_unstale":"2024-09-17T03:36:58.597705+0000","last_undegraded":"2024-09-17T03:36:58.597705+0000","last_fullsized":"2024-09-17T03:36:58.597705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:37.445030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598168+0000","last_change":"2024-09-17T03:36:57.589575+0000","last_active":"2024-09-17T03:36:58.598168+0000","last_peered":"2024-09-17T03:36:58.598168+0000","last_clean":"2024-09-17T03:36:58.598168+0000","last_became_active":"2024-09-17T03:36:57.589106+0000","last_became_peered":"2024-09-17T03:36:57.589106+0000","last_unstale":"2024-09-17T03:36:58.598168+0000","last_undegraded":"2024-09-17T03:36:58.598168+0000","last_fullsized":"2024-09-17T03:36:58.598168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.745067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.577559+0000","last_change":"2024-09-17T03:36:56.577559+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.577559+0000","last_undegraded":"2024-09-17T03:36:56.577559+0000","last_fullsized":"2024-09-17T03:36:56.577559+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.594386+0000","last_change":"2024-09-17T03:36:57.588964+0000","last_active":"2024-09-17T03:36:58.594386+0000","last_peered":"2024-09-17T03:36:58.594386+0000","last_clean":"2024-09-17T03:36:58.594386+0000","last_became_active":"2024-09-17T03:36:57.588619+0000","last_became_peered":"2024-09-17T03:36:57.588619+0000","last_unstale":"2024-09-17T03:36:58.594386+0000","last_undegraded":"2024-09-17T03:36:58.594386+0000","last_fullsized":"2024-09-17T03:36:58.594386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:47.054594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.606961+0000","last_change":"2024-09-17T03:36:58.602742+0000","last_active":"2024-09-17T03:36:58.606961+0000","last_peered":"2024-09-17T03:36:58.606961+0000","last_clean":"2024-09-17T03:36:58.606961+0000","last_became_active":"2024-09-17T03:36:58.602421+0000","last_became_peered":"2024-09-17T03:36:58.602421+0000","last_unstale":"2024-09-17T03:36:58.606961+0000","last_undegraded":"2024-09-17T03:36:58.606961+0000","last_fullsized":"2024-09-17T03:36:58.606961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:17.471850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623980+0000","last_change":"2024-09-17T03:36:57.590905+0000","last_active":"2024-09-17T03:36:58.623980+0000","last_peered":"2024-09-17T03:36:58.623980+0000","last_clean":"2024-09-17T03:36:58.623980+0000","last_became_active":"2024-09-17T03:36:57.590517+0000","last_became_peered":"2024-09-17T03:36:57.590517+0000","last_unstale":"2024-09-17T03:36:58.623980+0000","last_undegraded":"2024-09-17T03:36:58.623980+0000","last_fullsized":"2024-09-17T03:36:58.623980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:24.906768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-09-17T03:36:56.577611+0000","last_change":"2024-09-17T03:36:56.577611+0000","last_active":"2024-09-17T03:36:56.561931+0000","last_peered":"2024-09-17T03:36:56.561931+0000","last_clean":"2024-09-17T03:36:56.561931+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:56.577611+0000","last_undegraded":"2024-09-17T03:36:56.577611+0000","last_fullsized":"2024-09-17T03:36:56.577611+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.621811+0000","last_change":"2024-09-17T03:36:58.616039+0000","last_active":"2024-09-17T03:36:58.621811+0000","last_peered":"2024-09-17T03:36:58.621811+0000","last_clean":"2024-09-17T03:36:58.621811+0000","last_became_active":"2024-09-17T03:36:58.615707+0000","last_became_peered":"2024-09-17T03:36:58.615707+0000","last_unstale":"2024-09-17T03:36:58.621811+0000","last_undegraded":"2024-09-17T03:36:58.621811+0000","last_fullsized":"2024-09-17T03:36:58.621811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:55.971111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598228+0000","last_change":"2024-09-17T03:36:57.585618+0000","last_active":"2024-09-17T03:36:58.598228+0000","last_peered":"2024-09-17T03:36:58.598228+0000","last_clean":"2024-09-17T03:36:58.598228+0000","last_became_active":"2024-09-17T03:36:57.585282+0000","last_became_peered":"2024-09-17T03:36:57.585282+0000","last_unstale":"2024-09-17T03:36:58.598228+0000","last_undegraded":"2024-09-17T03:36:58.598228+0000","last_fullsized":"2024-09-17T03:36:58.598228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:48.269513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610246+0000","last_change":"2024-09-17T03:36:58.608926+0000","last_active":"2024-09-17T03:36:58.610246+0000","last_peered":"2024-09-17T03:36:58.610246+0000","last_clean":"2024-09-17T03:36:58.610246+0000","last_became_active":"2024-09-17T03:36:58.608553+0000","last_became_peered":"2024-09-17T03:36:58.608553+0000","last_unstale":"2024-09-17T03:36:58.610246+0000","last_undegraded":"2024-09-17T03:36:58.610246+0000","last_fullsized":"2024-09-17T03:36:58.610246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.226689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.596785+0000","last_change":"2024-09-17T03:36:57.586327+0000","last_active":"2024-09-17T03:36:58.596785+0000","last_peered":"2024-09-17T03:36:58.596785+0000","last_clean":"2024-09-17T03:36:58.596785+0000","last_became_active":"2024-09-17T03:36:57.586003+0000","last_became_peered":"2024-09-17T03:36:57.586003+0000","last_unstale":"2024-09-17T03:36:58.596785+0000","last_undegraded":"2024-09-17T03:36:58.596785+0000","last_fullsized":"2024-09-17T03:36:58.596785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:12.716534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.620040+0000","last_change":"2024-09-17T03:36:58.616301+0000","last_active":"2024-09-17T03:36:58.620040+0000","last_peered":"2024-09-17T03:36:58.620040+0000","last_clean":"2024-09-17T03:36:58.620040+0000","last_became_active":"2024-09-17T03:36:58.615909+0000","last_became_peered":"2024-09-17T03:36:58.615909+0000","last_unstale":"2024-09-17T03:36:58.620040+0000","last_undegraded":"2024-09-17T03:36:58.620040+0000","last_fullsized":"2024-09-17T03:36:58.620040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:19.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.602015+0000","last_change":"2024-09-17T03:36:57.591187+0000","last_active":"2024-09-17T03:36:58.602015+0000","last_peered":"2024-09-17T03:36:58.602015+0000","last_clean":"2024-09-17T03:36:58.602015+0000","last_became_active":"2024-09-17T03:36:57.590899+0000","last_became_peered":"2024-09-17T03:36:57.590899+0000","last_unstale":"2024-09-17T03:36:58.602015+0000","last_undegraded":"2024-09-17T03:36:58.602015+0000","last_fullsized":"2024-09-17T03:36:58.602015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:02.492050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615388+0000","last_change":"2024-09-17T03:36:58.608391+0000","last_active":"2024-09-17T03:36:58.615388+0000","last_peered":"2024-09-17T03:36:58.615388+0000","last_clean":"2024-09-17T03:36:58.615388+0000","last_became_active":"2024-09-17T03:36:58.608055+0000","last_became_peered":"2024-09-17T03:36:58.608055+0000","last_unstale":"2024-09-17T03:36:58.615388+0000","last_undegraded":"2024-09-17T03:36:58.615388+0000","last_fullsized":"2024-09-17T03:36:58.615388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:22.120747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.589696+0000","last_change":"2024-09-17T03:36:57.590878+0000","last_active":"2024-09-17T03:36:58.589696+0000","last_peered":"2024-09-17T03:36:58.589696+0000","last_clean":"2024-09-17T03:36:58.589696+0000","last_became_active":"2024-09-17T03:36:57.590524+0000","last_became_peered":"2024-09-17T03:36:57.590524+0000","last_unstale":"2024-09-17T03:36:58.589696+0000","last_undegraded":"2024-09-17T03:36:58.589696+0000","last_fullsized":"2024-09-17T03:36:58.589696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:39.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615450+0000","last_change":"2024-09-17T03:36:58.608629+0000","last_active":"2024-09-17T03:36:58.615450+0000","last_peered":"2024-09-17T03:36:58.615450+0000","last_clean":"2024-09-17T03:36:58.615450+0000","last_became_active":"2024-09-17T03:36:58.608327+0000","last_became_peered":"2024-09-17T03:36:58.608327+0000","last_unstale":"2024-09-17T03:36:58.615450+0000","last_undegraded":"2024-09-17T03:36:58.615450+0000","last_fullsized":"2024-09-17T03:36:58.615450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:42.334459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.590574+0000","last_change":"2024-09-17T03:36:57.594939+0000","last_active":"2024-09-17T03:36:58.590574+0000","last_peered":"2024-09-17T03:36:58.590574+0000","last_clean":"2024-09-17T03:36:58.590574+0000","last_became_active":"2024-09-17T03:36:57.594242+0000","last_became_peered":"2024-09-17T03:36:57.594242+0000","last_unstale":"2024-09-17T03:36:58.590574+0000","last_undegraded":"2024-09-17T03:36:58.590574+0000","last_fullsized":"2024-09-17T03:36:58.590574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:07.090365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614864+0000","last_change":"2024-09-17T03:36:58.609686+0000","last_active":"2024-09-17T03:36:58.614864+0000","last_peered":"2024-09-17T03:36:58.614864+0000","last_clean":"2024-09-17T03:36:58.614864+0000","last_became_active":"2024-09-17T03:36:58.609366+0000","last_became_peered":"2024-09-17T03:36:58.609366+0000","last_unstale":"2024-09-17T03:36:58.614864+0000","last_undegraded":"2024-09-17T03:36:58.614864+0000","last_fullsized":"2024-09-17T03:36:58.614864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:16.450751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.593723+0000","last_change":"2024-09-17T03:36:57.593661+0000","last_active":"2024-09-17T03:36:58.593723+0000","last_peered":"2024-09-17T03:36:58.593723+0000","last_clean":"2024-09-17T03:36:58.593723+0000","last_became_active":"2024-09-17T03:36:57.593336+0000","last_became_peered":"2024-09-17T03:36:57.593336+0000","last_unstale":"2024-09-17T03:36:58.593723+0000","last_undegraded":"2024-09-17T03:36:58.593723+0000","last_fullsized":"2024-09-17T03:36:58.593723+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:20.210252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:36:57.567087+0000","last_change":"2024-09-17T03:36:57.567087+0000","last_active":"2024-09-17T03:36:57.567087+0000","last_peered":"2024-09-17T03:36:57.567087+0000","last_clean":"2024-09-17T03:36:57.567087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:36:57.567087+0000","last_undegraded":"2024-09-17T03:36:57.567087+0000","last_fullsized":"2024-09-17T03:36:57.567087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624276+0000","last_change":"2024-09-17T03:36:57.593881+0000","last_active":"2024-09-17T03:36:58.624276+0000","last_peered":"2024-09-17T03:36:58.624276+0000","last_clean":"2024-09-17T03:36:58.624276+0000","last_became_active":"2024-09-17T03:36:57.593412+0000","last_became_peered":"2024-09-17T03:36:57.593412+0000","last_unstale":"2024-09-17T03:36:58.624276+0000","last_undegraded":"2024-09-17T03:36:58.624276+0000","last_fullsized":"2024-09-17T03:36:58.624276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:52.808091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":204,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.596710+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:36:58.596710+0000","last_peered":"2024-09-17T03:36:58.596710+0000","last_clean":"2024-09-17T03:36:58.596710+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:36:58.596710+0000","last_undegraded":"2024-09-17T03:36:58.596710+0000","last_fullsized":"2024-09-17T03:36:58.596710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36784,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335056,"statfs":{"total":96636764160,"available":96599097344,"internally_reserved":0,"allocated":1470464,"data_stored":960538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36184,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335656,"statfs":{"total":96636764160,"available":96599711744,"internally_reserved":0,"allocated":856064,"data_stored":362779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40360,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331480,"statfs":{"total":96636764160,"available":96595435520,"internally_reserved":0,"allocated":872448,"data_stored":369624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36208,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335632,"statfs":{"total":96636764160,"available":96599687168,"internally_reserved":0,"allocated":880640,"data_stored":371166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":888832,"data_stored":371782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1462272,"data_stored":959922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335676,"statfs":{"total":96636764160,"available":96599732224,"internally_reserved":0,"allocated":831488,"data_stored":350687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36180,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335660,"statfs":{"total":96636764160,"available":96599715840,"internally_reserved":0,"allocated":843776,"data_stored":356504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:03.320 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3d is not active+clean 2024-09-17T03:37:03.320 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.321 INFO:tasks.ceph.ceph_manager.ceph:PG 11.39 is not active+clean 2024-09-17T03:37:03.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.321 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-09-17T03:37:03.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.321 INFO:tasks.ceph.ceph_manager.ceph:PG 11.25 is not active+clean 2024-09-17T03:37:03.321 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.321 INFO:tasks.ceph.ceph_manager.ceph:PG 11.23 is not active+clean 2024-09-17T03:37:03.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.322 INFO:tasks.ceph.ceph_manager.ceph:PG 11.22 is not active+clean 2024-09-17T03:37:03.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.322 INFO:tasks.ceph.ceph_manager.ceph:PG 11.21 is not active+clean 2024-09-17T03:37:03.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.322 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-09-17T03:37:03.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.322 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1b is not active+clean 2024-09-17T03:37:03.322 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:56.576417+0000', 'last_change': '2024-09-17T03:36:56.576417+0000', 'last_active': '2024-09-17T03:36:56.561931+0000', 'last_peered': '2024-09-17T03:36:56.561931+0000', 'last_clean': '2024-09-17T03:36:56.561931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:56.576417+0000', 'last_undegraded': '2024-09-17T03:36:56.576417+0000', 'last_fullsized': '2024-09-17T03:36:56.576417+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:PG 11.16 is not active+clean 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:PG 10.15 is not active+clean 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:56.576586+0000', 'last_change': '2024-09-17T03:36:56.576586+0000', 'last_active': '2024-09-17T03:36:56.561931+0000', 'last_peered': '2024-09-17T03:36:56.561931+0000', 'last_clean': '2024-09-17T03:36:56.561931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:56.576586+0000', 'last_undegraded': '2024-09-17T03:36:56.576586+0000', 'last_fullsized': '2024-09-17T03:36:56.576586+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:PG 11.13 is not active+clean 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:56.578179+0000', 'last_change': '2024-09-17T03:36:56.578179+0000', 'last_active': '2024-09-17T03:36:56.561931+0000', 'last_peered': '2024-09-17T03:36:56.561931+0000', 'last_clean': '2024-09-17T03:36:56.561931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:56.578179+0000', 'last_undegraded': '2024-09-17T03:36:56.578179+0000', 'last_fullsized': '2024-09-17T03:36:56.578179+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:PG 11.b is not active+clean 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:PG 11.8 is not active+clean 2024-09-17T03:37:03.323 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.324 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-09-17T03:37:03.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:56.577559+0000', 'last_change': '2024-09-17T03:36:56.577559+0000', 'last_active': '2024-09-17T03:36:56.561931+0000', 'last_peered': '2024-09-17T03:36:56.561931+0000', 'last_clean': '2024-09-17T03:36:56.561931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:56.577559+0000', 'last_undegraded': '2024-09-17T03:36:56.577559+0000', 'last_fullsized': '2024-09-17T03:36:56.577559+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:37:03.324 INFO:tasks.ceph.ceph_manager.ceph:PG 11.9 is not active+clean 2024-09-17T03:37:03.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.324 INFO:tasks.ceph.ceph_manager.ceph:PG 11.7 is not active+clean 2024-09-17T03:37:03.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.324 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-09-17T03:37:03.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:36:56.577611+0000', 'last_change': '2024-09-17T03:36:56.577611+0000', 'last_active': '2024-09-17T03:36:56.561931+0000', 'last_peered': '2024-09-17T03:36:56.561931+0000', 'last_clean': '2024-09-17T03:36:56.561931+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:56.577611+0000', 'last_undegraded': '2024-09-17T03:36:56.577611+0000', 'last_fullsized': '2024-09-17T03:36:56.577611+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:56.561931+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:37:03.324 INFO:tasks.ceph.ceph_manager.ceph:PG 11.a is not active+clean 2024-09-17T03:37:03.324 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:36:57.567087+0000', 'last_change': '2024-09-17T03:36:57.567087+0000', 'last_active': '2024-09-17T03:36:57.567087+0000', 'last_peered': '2024-09-17T03:36:57.567087+0000', 'last_clean': '2024-09-17T03:36:57.567087+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:36:57.567087+0000', 'last_undegraded': '2024-09-17T03:36:57.567087+0000', 'last_fullsized': '2024-09-17T03:36:57.567087+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'last_clean_scrub_stamp': '2024-09-17T03:36:57.567087+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:37:03.325 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:37:03.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.469+0000 7fe8a7084640 1 -- 172.21.15.146:0/1219753955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a00b3d30 msgr2=0x7fe8a015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.469+0000 7fe8a7084640 1 --2- 172.21.15.146:0/1219753955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a00b3d30 0x7fe8a015caa0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe898005fd0 tx=0x7fe89802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.469+0000 7fe8a7084640 1 -- 172.21.15.146:0/1219753955 shutdown_connections 2024-09-17T03:37:03.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.469+0000 7fe8a7084640 1 --2- 172.21.15.146:0/1219753955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a00b3d30 0x7fe8a015caa0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.469+0000 7fe8a7084640 1 --2- 172.21.15.146:0/1219753955 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a00b5ce0 0x7fe8a00b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.469+0000 7fe8a7084640 1 -- 172.21.15.146:0/1219753955 >> 172.21.15.146:0/1219753955 conn(0x7fe8a00b7b20 msgr2=0x7fe8a009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:03.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.469+0000 7fe8a7084640 1 -- 172.21.15.146:0/1219753955 shutdown_connections 2024-09-17T03:37:03.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.469+0000 7fe8a7084640 1 -- 172.21.15.146:0/1219753955 wait complete. 2024-09-17T03:37:03.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.471+0000 7fe8a7084640 1 Processor -- start 2024-09-17T03:37:03.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.471+0000 7fe8a7084640 1 -- start start 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.472+0000 7fe8a7084640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a00b5750 0x7fe8a0142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.472+0000 7fe8a7084640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a00b5ce0 0x7fe8a01f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.472+0000 7fe8a7084640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a013f710 0x7fe8a015f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.472+0000 7fe8a7084640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a015d460 con 0x7fe8a013f710 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.472+0000 7fe8a7084640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a015d2e0 con 0x7fe8a00b5ce0 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.472+0000 7fe8a7084640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a015d5e0 con 0x7fe8a00b5750 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.472+0000 7fe8a5621640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a013f710 0x7fe8a015f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe8a5621640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a013f710 0x7fe8a015f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38178/0 (socket says 172.21.15.146:38178) 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe8a5621640 1 -- 172.21.15.146:0/3458281558 learned_addr learned my addr 172.21.15.146:0/3458281558 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe89ffff640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a00b5ce0 0x7fe8a01f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe8a4e20640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a00b5750 0x7fe8a0142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe8a5621640 1 -- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a00b5750 msgr2=0x7fe8a0142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe8a5621640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a00b5750 0x7fe8a0142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe8a5621640 1 -- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a00b5ce0 msgr2=0x7fe8a01f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe8a5621640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a00b5ce0 0x7fe8a01f3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe8a5621640 1 -- 172.21.15.146:0/3458281558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a0152840 con 0x7fe8a013f710 2024-09-17T03:37:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe8a5621640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a013f710 0x7fe8a015f2a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe898034040 tx=0x7fe898003670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe89d7fa640 1 -- 172.21.15.146:0/3458281558 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89803e030 con 0x7fe8a013f710 2024-09-17T03:37:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe89d7fa640 1 -- 172.21.15.146:0/3458281558 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe898003b60 con 0x7fe8a013f710 2024-09-17T03:37:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe8a7084640 1 -- 172.21.15.146:0/3458281558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a01420c0 con 0x7fe8a013f710 2024-09-17T03:37:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe89d7fa640 1 -- 172.21.15.146:0/3458281558 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898035040 con 0x7fe8a013f710 2024-09-17T03:37:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.473+0000 7fe8a7084640 1 -- 172.21.15.146:0/3458281558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a0142680 con 0x7fe8a013f710 2024-09-17T03:37:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.474+0000 7fe8a7084640 1 -- 172.21.15.146:0/3458281558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a015daa0 con 0x7fe8a013f710 2024-09-17T03:37:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.475+0000 7fe89d7fa640 1 -- 172.21.15.146:0/3458281558 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe898041030 con 0x7fe8a013f710 2024-09-17T03:37:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.476+0000 7fe89d7fa640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe88c078bc0 0x7fe88c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.476+0000 7fe89d7fa640 1 -- 172.21.15.146:0/3458281558 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7fe8980bb300 con 0x7fe8a013f710 2024-09-17T03:37:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.476+0000 7fe8a4e20640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe88c078bc0 0x7fe88c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.476+0000 7fe8a4e20640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe88c078bc0 0x7fe88c07b0d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe890004630 tx=0x7fe89000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:03.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.480+0000 7fe89d7fa640 1 -- 172.21.15.146:0/3458281558 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe898083070 con 0x7fe8a013f710 2024-09-17T03:37:03.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.726+0000 7fe8a7084640 1 -- 172.21.15.146:0/3458281558 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe8a0155a10 con 0x7fe8a013f710 2024-09-17T03:37:03.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.726+0000 7fe89d7fa640 1 -- 172.21.15.146:0/3458281558 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1766 (secure 0 0 0) 0x7fe89808ae20 con 0x7fe8a013f710 2024-09-17T03:37:03.726 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:03.727 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":268,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":73,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":77},{"state_name":"unknown","count":15},{"state_name":"creating+peering","count":5}],"num_pgs":97,"num_pools":3,"num_objects":21,"data_bytes":592688,"bytes_used":297697280,"bytes_avail":772796416000,"bytes_total":773094113280,"unknown_pgs_ratio":0.15463916957378387,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2519,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":46,"btime":"2024-09-17T03:37:01:608193+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6855}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-17T03:35:59.835195+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:37:03.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.728+0000 7fe8a7084640 1 -- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe88c078bc0 msgr2=0x7fe88c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.728+0000 7fe8a7084640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe88c078bc0 0x7fe88c07b0d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe890004630 tx=0x7fe89000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.728+0000 7fe8a7084640 1 -- 172.21.15.146:0/3458281558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a013f710 msgr2=0x7fe8a015f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.728+0000 7fe8a7084640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a013f710 0x7fe8a015f2a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe898034040 tx=0x7fe898003670 comp rx=0 tx=0).stop 2024-09-17T03:37:03.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.728+0000 7fe8a7084640 1 -- 172.21.15.146:0/3458281558 shutdown_connections 2024-09-17T03:37:03.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.728+0000 7fe8a7084640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe88c078bc0 0x7fe88c07b0d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.728+0000 7fe8a7084640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8a013f710 0x7fe8a015f2a0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.728+0000 7fe8a7084640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8a00b5ce0 0x7fe8a01f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.728+0000 7fe8a7084640 1 --2- 172.21.15.146:0/3458281558 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8a00b5750 0x7fe8a0142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.728+0000 7fe8a7084640 1 -- 172.21.15.146:0/3458281558 >> 172.21.15.146:0/3458281558 conn(0x7fe8a00b7b20 msgr2=0x7fe8a00b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:03.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.729+0000 7fe8a7084640 1 -- 172.21.15.146:0/3458281558 shutdown_connections 2024-09-17T03:37:03.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.729+0000 7fe8a7084640 1 -- 172.21.15.146:0/3458281558 wait complete. 2024-09-17T03:37:03.740 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:37:03.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.853+0000 7f393cad5640 1 -- 172.21.15.146:0/2626461261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39380b3d30 msgr2=0x7f393815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.853+0000 7f393cad5640 1 --2- 172.21.15.146:0/2626461261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39380b3d30 0x7f393815caa0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3928005fd0 tx=0x7f392802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.853+0000 7f393cad5640 1 -- 172.21.15.146:0/2626461261 shutdown_connections 2024-09-17T03:37:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.853+0000 7f393cad5640 1 --2- 172.21.15.146:0/2626461261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39380b3d30 0x7f393815caa0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.853+0000 7f393cad5640 1 --2- 172.21.15.146:0/2626461261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39380b5ce0 0x7f39380b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.853+0000 7f393cad5640 1 -- 172.21.15.146:0/2626461261 >> 172.21.15.146:0/2626461261 conn(0x7f39380b7b20 msgr2=0x7f393809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:03.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.853+0000 7f393cad5640 1 -- 172.21.15.146:0/2626461261 shutdown_connections 2024-09-17T03:37:03.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.853+0000 7f393cad5640 1 -- 172.21.15.146:0/2626461261 wait complete. 2024-09-17T03:37:03.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.855+0000 7f393cad5640 1 Processor -- start 2024-09-17T03:37:03.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.855+0000 7f393cad5640 1 -- start start 2024-09-17T03:37:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f393cad5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39380b5750 0x7f39381e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f393cad5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39380b5ce0 0x7f39381f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f393cad5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39381f8a60 0x7f39381f8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f393cad5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f393815d3e0 con 0x7f39380b5ce0 2024-09-17T03:37:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f393cad5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f393815d260 con 0x7f39380b5750 2024-09-17T03:37:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f393cad5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f393815d560 con 0x7f39381f8a60 2024-09-17T03:37:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f3935d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39380b5ce0 0x7f39381f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f3935d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39380b5ce0 0x7f39381f4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38188/0 (socket says 172.21.15.146:38188) 2024-09-17T03:37:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f3935d9b640 1 -- 172.21.15.146:0/1717655144 learned_addr learned my addr 172.21.15.146:0/1717655144 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f393659c640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39380b5750 0x7f39381e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f3936d9d640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39381f8a60 0x7f39381f8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f3935d9b640 1 -- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39381f8a60 msgr2=0x7f39381f8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f3935d9b640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39381f8a60 0x7f39381f8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.856+0000 7f3935d9b640 1 -- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39380b5750 msgr2=0x7f39381e7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.857+0000 7f3935d9b640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39380b5750 0x7f39381e7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.857+0000 7f3935d9b640 1 -- 172.21.15.146:0/1717655144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393806ef80 con 0x7f39380b5ce0 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.857+0000 7f3935d9b640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39380b5ce0 0x7f39381f4be0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f392000c3a0 tx=0x7f392000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.857+0000 7f392effd640 1 -- 172.21.15.146:0/1717655144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920017070 con 0x7f39380b5ce0 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.857+0000 7f392effd640 1 -- 172.21.15.146:0/1717655144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39200053c0 con 0x7f39380b5ce0 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.857+0000 7f393cad5640 1 -- 172.21.15.146:0/1717655144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f393806f260 con 0x7f39380b5ce0 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.857+0000 7f392effd640 1 -- 172.21.15.146:0/1717655144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920003850 con 0x7f39380b5ce0 2024-09-17T03:37:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.857+0000 7f393cad5640 1 -- 172.21.15.146:0/1717655144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3938156c60 con 0x7f39380b5ce0 2024-09-17T03:37:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.858+0000 7f393cad5640 1 -- 172.21.15.146:0/1717655144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39381f9830 con 0x7f39380b5ce0 2024-09-17T03:37:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.859+0000 7f392effd640 1 -- 172.21.15.146:0/1717655144 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f392001a070 con 0x7f39380b5ce0 2024-09-17T03:37:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.859+0000 7f392effd640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078b90 0x7f391807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:03.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.859+0000 7f392effd640 1 -- 172.21.15.146:0/1717655144 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f3920099fa0 con 0x7f39380b5ce0 2024-09-17T03:37:03.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.859+0000 7f393659c640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078b90 0x7f391807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:03.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.860+0000 7f393659c640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078b90 0x7f391807b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3930005fd0 tx=0x7f3930009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:03.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:03.864+0000 7f392effd640 1 -- 172.21.15.146:0/1717655144 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3920061e20 con 0x7f39380b5ce0 2024-09-17T03:37:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.036+0000 7f393cad5640 1 -- 172.21.15.146:0/1717655144 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f393815da80 con 0x7f3918078b90 2024-09-17T03:37:04.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.040+0000 7f392effd640 1 -- 172.21.15.146:0/1717655144 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252056 (secure 0 0 0) 0x7f393815da80 con 0x7f3918078b90 2024-09-17T03:37:04.044 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:04.045 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:37:04.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 -- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078b90 msgr2=0x7f391807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:04.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078b90 0x7f391807b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3930005fd0 tx=0x7f3930009500 comp rx=0 tx=0).stop 2024-09-17T03:37:04.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 -- 172.21.15.146:0/1717655144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39380b5ce0 msgr2=0x7f39381f4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:04.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39380b5ce0 0x7f39381f4be0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f392000c3a0 tx=0x7f392000c860 comp rx=0 tx=0).stop 2024-09-17T03:37:04.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 -- 172.21.15.146:0/1717655144 shutdown_connections 2024-09-17T03:37:04.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078b90 0x7f391807b0a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:04.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39381f8a60 0x7f39381f8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:04.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39380b5ce0 0x7f39381f4be0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:04.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 --2- 172.21.15.146:0/1717655144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39380b5750 0x7f39381e7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:04.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 -- 172.21.15.146:0/1717655144 >> 172.21.15.146:0/1717655144 conn(0x7f39380b7b20 msgr2=0x7f3938075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:04.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 -- 172.21.15.146:0/1717655144 shutdown_connections 2024-09-17T03:37:04.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:04.044+0000 7f393cad5640 1 -- 172.21.15.146:0/1717655144 wait complete. 2024-09-17T03:37:04.056 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-09-17T03:37:03.851995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294972,"kb_used_data":8012,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754679748,"statfs":{"total":773094113280,"available":772792061952,"internally_reserved":0,"allocated":8204288,"data_stored":4147721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":293654065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.278931"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.622136+0000","last_change":"2024-09-17T03:36:58.617054+0000","last_active":"2024-09-17T03:36:58.622136+0000","last_peered":"2024-09-17T03:36:58.622136+0000","last_clean":"2024-09-17T03:36:58.622136+0000","last_became_active":"2024-09-17T03:36:58.616715+0000","last_became_peered":"2024-09-17T03:36:58.616715+0000","last_unstale":"2024-09-17T03:36:58.622136+0000","last_undegraded":"2024-09-17T03:36:58.622136+0000","last_fullsized":"2024-09-17T03:36:58.622136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:27.445679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.616794+0000","last_change":"2024-09-17T03:36:58.613591+0000","last_active":"2024-09-17T03:36:58.616794+0000","last_peered":"2024-09-17T03:36:58.616794+0000","last_clean":"2024-09-17T03:36:58.616794+0000","last_became_active":"2024-09-17T03:36:58.613190+0000","last_became_peered":"2024-09-17T03:36:58.613190+0000","last_unstale":"2024-09-17T03:36:58.616794+0000","last_undegraded":"2024-09-17T03:36:58.616794+0000","last_fullsized":"2024-09-17T03:36:58.616794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:35.898980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659725+0000","last_change":"2024-09-17T03:36:58.608680+0000","last_active":"2024-09-17T03:37:00.659725+0000","last_peered":"2024-09-17T03:37:00.659725+0000","last_clean":"2024-09-17T03:37:00.659725+0000","last_became_active":"2024-09-17T03:36:58.608372+0000","last_became_peered":"2024-09-17T03:36:58.608372+0000","last_unstale":"2024-09-17T03:37:00.659725+0000","last_undegraded":"2024-09-17T03:37:00.659725+0000","last_fullsized":"2024-09-17T03:37:00.659725+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:17.599786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.607671+0000","last_change":"2024-09-17T03:36:58.605913+0000","last_active":"2024-09-17T03:36:58.607671+0000","last_peered":"2024-09-17T03:36:58.607671+0000","last_clean":"2024-09-17T03:36:58.607671+0000","last_became_active":"2024-09-17T03:36:58.605551+0000","last_became_peered":"2024-09-17T03:36:58.605551+0000","last_unstale":"2024-09-17T03:36:58.607671+0000","last_undegraded":"2024-09-17T03:36:58.607671+0000","last_fullsized":"2024-09-17T03:36:58.607671+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:25.911924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619985+0000","last_change":"2024-09-17T03:36:58.616318+0000","last_active":"2024-09-17T03:36:58.619985+0000","last_peered":"2024-09-17T03:36:58.619985+0000","last_clean":"2024-09-17T03:36:58.619985+0000","last_became_active":"2024-09-17T03:36:58.615972+0000","last_became_peered":"2024-09-17T03:36:58.615972+0000","last_unstale":"2024-09-17T03:36:58.619985+0000","last_undegraded":"2024-09-17T03:36:58.619985+0000","last_fullsized":"2024-09-17T03:36:58.619985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:09.798475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.616821+0000","last_change":"2024-09-17T03:36:58.613048+0000","last_active":"2024-09-17T03:36:58.616821+0000","last_peered":"2024-09-17T03:36:58.616821+0000","last_clean":"2024-09-17T03:36:58.616821+0000","last_became_active":"2024-09-17T03:36:58.612726+0000","last_became_peered":"2024-09-17T03:36:58.612726+0000","last_unstale":"2024-09-17T03:36:58.616821+0000","last_undegraded":"2024-09-17T03:36:58.616821+0000","last_fullsized":"2024-09-17T03:36:58.616821+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.538161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600912+0000","last_change":"2024-09-17T03:36:58.606362+0000","last_active":"2024-09-17T03:36:59.600912+0000","last_peered":"2024-09-17T03:36:59.600912+0000","last_clean":"2024-09-17T03:36:59.600912+0000","last_became_active":"2024-09-17T03:36:58.606052+0000","last_became_peered":"2024-09-17T03:36:58.606052+0000","last_unstale":"2024-09-17T03:36:59.600912+0000","last_undegraded":"2024-09-17T03:36:59.600912+0000","last_fullsized":"2024-09-17T03:36:59.600912+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:57.314386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615310+0000","last_change":"2024-09-17T03:36:58.608044+0000","last_active":"2024-09-17T03:36:58.615310+0000","last_peered":"2024-09-17T03:36:58.615310+0000","last_clean":"2024-09-17T03:36:58.615310+0000","last_became_active":"2024-09-17T03:36:58.607155+0000","last_became_peered":"2024-09-17T03:36:58.607155+0000","last_unstale":"2024-09-17T03:36:58.615310+0000","last_undegraded":"2024-09-17T03:36:58.615310+0000","last_fullsized":"2024-09-17T03:36:58.615310+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:08.826637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619374+0000","last_change":"2024-09-17T03:36:58.614210+0000","last_active":"2024-09-17T03:36:58.619374+0000","last_peered":"2024-09-17T03:36:58.619374+0000","last_clean":"2024-09-17T03:36:58.619374+0000","last_became_active":"2024-09-17T03:36:58.613913+0000","last_became_peered":"2024-09-17T03:36:58.613913+0000","last_unstale":"2024-09-17T03:36:58.619374+0000","last_undegraded":"2024-09-17T03:36:58.619374+0000","last_fullsized":"2024-09-17T03:36:58.619374+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:25.068863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.611663+0000","last_change":"2024-09-17T03:36:58.607751+0000","last_active":"2024-09-17T03:36:58.611663+0000","last_peered":"2024-09-17T03:36:58.611663+0000","last_clean":"2024-09-17T03:36:58.611663+0000","last_became_active":"2024-09-17T03:36:58.607444+0000","last_became_peered":"2024-09-17T03:36:58.607444+0000","last_unstale":"2024-09-17T03:36:58.611663+0000","last_undegraded":"2024-09-17T03:36:58.611663+0000","last_fullsized":"2024-09-17T03:36:58.611663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:09.197304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615443+0000","last_change":"2024-09-17T03:36:58.612036+0000","last_active":"2024-09-17T03:36:58.615443+0000","last_peered":"2024-09-17T03:36:58.615443+0000","last_clean":"2024-09-17T03:36:58.615443+0000","last_became_active":"2024-09-17T03:36:58.611664+0000","last_became_peered":"2024-09-17T03:36:58.611664+0000","last_unstale":"2024-09-17T03:36:58.615443+0000","last_undegraded":"2024-09-17T03:36:58.615443+0000","last_fullsized":"2024-09-17T03:36:58.615443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:47.066196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.605298+0000","last_change":"2024-09-17T03:36:58.603439+0000","last_active":"2024-09-17T03:36:58.605298+0000","last_peered":"2024-09-17T03:36:58.605298+0000","last_clean":"2024-09-17T03:36:58.605298+0000","last_became_active":"2024-09-17T03:36:58.603155+0000","last_became_peered":"2024-09-17T03:36:58.603155+0000","last_unstale":"2024-09-17T03:36:58.605298+0000","last_undegraded":"2024-09-17T03:36:58.605298+0000","last_fullsized":"2024-09-17T03:36:58.605298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:33.418376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614721+0000","last_change":"2024-09-17T03:36:58.611787+0000","last_active":"2024-09-17T03:36:58.614721+0000","last_peered":"2024-09-17T03:36:58.614721+0000","last_clean":"2024-09-17T03:36:58.614721+0000","last_became_active":"2024-09-17T03:36:58.611492+0000","last_became_peered":"2024-09-17T03:36:58.611492+0000","last_unstale":"2024-09-17T03:36:58.614721+0000","last_undegraded":"2024-09-17T03:36:58.614721+0000","last_fullsized":"2024-09-17T03:36:58.614721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:20.680288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618331+0000","last_change":"2024-09-17T03:36:58.612245+0000","last_active":"2024-09-17T03:36:58.618331+0000","last_peered":"2024-09-17T03:36:58.618331+0000","last_clean":"2024-09-17T03:36:58.618331+0000","last_became_active":"2024-09-17T03:36:58.611923+0000","last_became_peered":"2024-09-17T03:36:58.611923+0000","last_unstale":"2024-09-17T03:36:58.618331+0000","last_undegraded":"2024-09-17T03:36:58.618331+0000","last_fullsized":"2024-09-17T03:36:58.618331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:29.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613136+0000","last_change":"2024-09-17T03:36:58.605653+0000","last_active":"2024-09-17T03:36:58.613136+0000","last_peered":"2024-09-17T03:36:58.613136+0000","last_clean":"2024-09-17T03:36:58.613136+0000","last_became_active":"2024-09-17T03:36:58.605358+0000","last_became_peered":"2024-09-17T03:36:58.605358+0000","last_unstale":"2024-09-17T03:36:58.613136+0000","last_undegraded":"2024-09-17T03:36:58.613136+0000","last_fullsized":"2024-09-17T03:36:58.613136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:38.335687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609157+0000","last_change":"2024-09-17T03:36:58.603629+0000","last_active":"2024-09-17T03:36:58.609157+0000","last_peered":"2024-09-17T03:36:58.609157+0000","last_clean":"2024-09-17T03:36:58.609157+0000","last_became_active":"2024-09-17T03:36:58.602937+0000","last_became_peered":"2024-09-17T03:36:58.602937+0000","last_unstale":"2024-09-17T03:36:58.609157+0000","last_undegraded":"2024-09-17T03:36:58.609157+0000","last_fullsized":"2024-09-17T03:36:58.609157+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:50.782400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618660+0000","last_change":"2024-09-17T03:36:58.611332+0000","last_active":"2024-09-17T03:36:58.618660+0000","last_peered":"2024-09-17T03:36:58.618660+0000","last_clean":"2024-09-17T03:36:58.618660+0000","last_became_active":"2024-09-17T03:36:58.611024+0000","last_became_peered":"2024-09-17T03:36:58.611024+0000","last_unstale":"2024-09-17T03:36:58.618660+0000","last_undegraded":"2024-09-17T03:36:58.618660+0000","last_fullsized":"2024-09-17T03:36:58.618660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:44.315656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615625+0000","last_change":"2024-09-17T03:36:58.609578+0000","last_active":"2024-09-17T03:36:58.615625+0000","last_peered":"2024-09-17T03:36:58.615625+0000","last_clean":"2024-09-17T03:36:58.615625+0000","last_became_active":"2024-09-17T03:36:58.609270+0000","last_became_peered":"2024-09-17T03:36:58.609270+0000","last_unstale":"2024-09-17T03:36:58.615625+0000","last_undegraded":"2024-09-17T03:36:58.615625+0000","last_fullsized":"2024-09-17T03:36:58.615625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:34.917655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614907+0000","last_change":"2024-09-17T03:36:58.604940+0000","last_active":"2024-09-17T03:36:58.614907+0000","last_peered":"2024-09-17T03:36:58.614907+0000","last_clean":"2024-09-17T03:36:58.614907+0000","last_became_active":"2024-09-17T03:36:58.604635+0000","last_became_peered":"2024-09-17T03:36:58.604635+0000","last_unstale":"2024-09-17T03:36:58.614907+0000","last_undegraded":"2024-09-17T03:36:58.614907+0000","last_fullsized":"2024-09-17T03:36:58.614907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:34.917655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613174+0000","last_change":"2024-09-17T03:36:58.604263+0000","last_active":"2024-09-17T03:36:58.613174+0000","last_peered":"2024-09-17T03:36:58.613174+0000","last_clean":"2024-09-17T03:36:58.613174+0000","last_became_active":"2024-09-17T03:36:58.603672+0000","last_became_peered":"2024-09-17T03:36:58.603672+0000","last_unstale":"2024-09-17T03:36:58.613174+0000","last_undegraded":"2024-09-17T03:36:58.613174+0000","last_fullsized":"2024-09-17T03:36:58.613174+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:30.276913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.611765+0000","last_change":"2024-09-17T03:36:58.601622+0000","last_active":"2024-09-17T03:36:58.611765+0000","last_peered":"2024-09-17T03:36:58.611765+0000","last_clean":"2024-09-17T03:36:58.611765+0000","last_became_active":"2024-09-17T03:36:58.601303+0000","last_became_peered":"2024-09-17T03:36:58.601303+0000","last_unstale":"2024-09-17T03:36:58.611765+0000","last_undegraded":"2024-09-17T03:36:58.611765+0000","last_fullsized":"2024-09-17T03:36:58.611765+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:31.989872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613826+0000","last_change":"2024-09-17T03:36:58.610601+0000","last_active":"2024-09-17T03:36:58.613826+0000","last_peered":"2024-09-17T03:36:58.613826+0000","last_clean":"2024-09-17T03:36:58.613826+0000","last_became_active":"2024-09-17T03:36:58.610255+0000","last_became_peered":"2024-09-17T03:36:58.610255+0000","last_unstale":"2024-09-17T03:36:58.613826+0000","last_undegraded":"2024-09-17T03:36:58.613826+0000","last_fullsized":"2024-09-17T03:36:58.613826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:54.883572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.607235+0000","last_change":"2024-09-17T03:36:58.604903+0000","last_active":"2024-09-17T03:36:58.607235+0000","last_peered":"2024-09-17T03:36:58.607235+0000","last_clean":"2024-09-17T03:36:58.607235+0000","last_became_active":"2024-09-17T03:36:58.604570+0000","last_became_peered":"2024-09-17T03:36:58.604570+0000","last_unstale":"2024-09-17T03:36:58.607235+0000","last_undegraded":"2024-09-17T03:36:58.607235+0000","last_fullsized":"2024-09-17T03:36:58.607235+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:32.468155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615436+0000","last_change":"2024-09-17T03:36:58.611647+0000","last_active":"2024-09-17T03:36:58.615436+0000","last_peered":"2024-09-17T03:36:58.615436+0000","last_clean":"2024-09-17T03:36:58.615436+0000","last_became_active":"2024-09-17T03:36:58.611306+0000","last_became_peered":"2024-09-17T03:36:58.611306+0000","last_unstale":"2024-09-17T03:36:58.615436+0000","last_undegraded":"2024-09-17T03:36:58.615436+0000","last_fullsized":"2024-09-17T03:36:58.615436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:44.377859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609013+0000","last_change":"2024-09-17T03:36:58.601635+0000","last_active":"2024-09-17T03:36:58.609013+0000","last_peered":"2024-09-17T03:36:58.609013+0000","last_clean":"2024-09-17T03:36:58.609013+0000","last_became_active":"2024-09-17T03:36:58.601341+0000","last_became_peered":"2024-09-17T03:36:58.601341+0000","last_unstale":"2024-09-17T03:36:58.609013+0000","last_undegraded":"2024-09-17T03:36:58.609013+0000","last_fullsized":"2024-09-17T03:36:58.609013+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:39.072061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.601170+0000","last_change":"2024-09-17T03:36:58.607547+0000","last_active":"2024-09-17T03:36:59.601170+0000","last_peered":"2024-09-17T03:36:59.601170+0000","last_clean":"2024-09-17T03:36:59.601170+0000","last_became_active":"2024-09-17T03:36:58.606970+0000","last_became_peered":"2024-09-17T03:36:58.606970+0000","last_unstale":"2024-09-17T03:36:59.601170+0000","last_undegraded":"2024-09-17T03:36:59.601170+0000","last_fullsized":"2024-09-17T03:36:59.601170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:08.286039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659754+0000","last_change":"2024-09-17T03:36:58.609461+0000","last_active":"2024-09-17T03:37:00.659754+0000","last_peered":"2024-09-17T03:37:00.659754+0000","last_clean":"2024-09-17T03:37:00.659754+0000","last_became_active":"2024-09-17T03:36:58.609161+0000","last_became_peered":"2024-09-17T03:36:58.609161+0000","last_unstale":"2024-09-17T03:37:00.659754+0000","last_undegraded":"2024-09-17T03:37:00.659754+0000","last_fullsized":"2024-09-17T03:37:00.659754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:46.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613572+0000","last_change":"2024-09-17T03:36:58.610689+0000","last_active":"2024-09-17T03:36:58.613572+0000","last_peered":"2024-09-17T03:36:58.613572+0000","last_clean":"2024-09-17T03:36:58.613572+0000","last_became_active":"2024-09-17T03:36:58.610241+0000","last_became_peered":"2024-09-17T03:36:58.610241+0000","last_unstale":"2024-09-17T03:36:58.613572+0000","last_undegraded":"2024-09-17T03:36:58.613572+0000","last_fullsized":"2024-09-17T03:36:58.613572+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:29.450418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660122+0000","last_change":"2024-09-17T03:36:58.608380+0000","last_active":"2024-09-17T03:37:00.660122+0000","last_peered":"2024-09-17T03:37:00.660122+0000","last_clean":"2024-09-17T03:37:00.660122+0000","last_became_active":"2024-09-17T03:36:58.608043+0000","last_became_peered":"2024-09-17T03:36:58.608043+0000","last_unstale":"2024-09-17T03:37:00.660122+0000","last_undegraded":"2024-09-17T03:37:00.660122+0000","last_fullsized":"2024-09-17T03:37:00.660122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:58.813301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600393+0000","last_change":"2024-09-17T03:36:58.605495+0000","last_active":"2024-09-17T03:36:59.600393+0000","last_peered":"2024-09-17T03:36:59.600393+0000","last_clean":"2024-09-17T03:36:59.600393+0000","last_became_active":"2024-09-17T03:36:58.605160+0000","last_became_peered":"2024-09-17T03:36:58.605160+0000","last_unstale":"2024-09-17T03:36:59.600393+0000","last_undegraded":"2024-09-17T03:36:59.600393+0000","last_fullsized":"2024-09-17T03:36:59.600393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:10.458393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.601118+0000","last_change":"2024-09-17T03:36:58.610990+0000","last_active":"2024-09-17T03:36:59.601118+0000","last_peered":"2024-09-17T03:36:59.601118+0000","last_clean":"2024-09-17T03:36:59.601118+0000","last_became_active":"2024-09-17T03:36:58.610679+0000","last_became_peered":"2024-09-17T03:36:58.610679+0000","last_unstale":"2024-09-17T03:36:59.601118+0000","last_undegraded":"2024-09-17T03:36:59.601118+0000","last_fullsized":"2024-09-17T03:36:59.601118+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:34.914105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615569+0000","last_change":"2024-09-17T03:36:58.610171+0000","last_active":"2024-09-17T03:36:58.615569+0000","last_peered":"2024-09-17T03:36:58.615569+0000","last_clean":"2024-09-17T03:36:58.615569+0000","last_became_active":"2024-09-17T03:36:58.609749+0000","last_became_peered":"2024-09-17T03:36:58.609749+0000","last_unstale":"2024-09-17T03:36:58.615569+0000","last_undegraded":"2024-09-17T03:36:58.615569+0000","last_fullsized":"2024-09-17T03:36:58.615569+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:22.607257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.621860+0000","last_change":"2024-09-17T03:36:58.616100+0000","last_active":"2024-09-17T03:36:58.621860+0000","last_peered":"2024-09-17T03:36:58.621860+0000","last_clean":"2024-09-17T03:36:58.621860+0000","last_became_active":"2024-09-17T03:36:58.615736+0000","last_became_peered":"2024-09-17T03:36:58.615736+0000","last_unstale":"2024-09-17T03:36:58.621860+0000","last_undegraded":"2024-09-17T03:36:58.621860+0000","last_fullsized":"2024-09-17T03:36:58.621860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:05.303700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.622050+0000","last_change":"2024-09-17T03:36:57.593446+0000","last_active":"2024-09-17T03:36:58.622050+0000","last_peered":"2024-09-17T03:36:58.622050+0000","last_clean":"2024-09-17T03:36:58.622050+0000","last_became_active":"2024-09-17T03:36:57.592914+0000","last_became_peered":"2024-09-17T03:36:57.592914+0000","last_unstale":"2024-09-17T03:36:58.622050+0000","last_undegraded":"2024-09-17T03:36:58.622050+0000","last_fullsized":"2024-09-17T03:36:58.622050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:04.448726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.618631+0000","last_change":"2024-09-17T03:36:58.610586+0000","last_active":"2024-09-17T03:36:58.618631+0000","last_peered":"2024-09-17T03:36:58.618631+0000","last_clean":"2024-09-17T03:36:58.618631+0000","last_became_active":"2024-09-17T03:36:58.610274+0000","last_became_peered":"2024-09-17T03:36:58.610274+0000","last_unstale":"2024-09-17T03:36:58.618631+0000","last_undegraded":"2024-09-17T03:36:58.618631+0000","last_fullsized":"2024-09-17T03:36:58.618631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:50.836681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.620215+0000","last_change":"2024-09-17T03:36:57.585526+0000","last_active":"2024-09-17T03:36:58.620215+0000","last_peered":"2024-09-17T03:36:58.620215+0000","last_clean":"2024-09-17T03:36:58.620215+0000","last_became_active":"2024-09-17T03:36:57.585185+0000","last_became_peered":"2024-09-17T03:36:57.585185+0000","last_unstale":"2024-09-17T03:36:58.620215+0000","last_undegraded":"2024-09-17T03:36:58.620215+0000","last_fullsized":"2024-09-17T03:36:58.620215+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:01.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615168+0000","last_change":"2024-09-17T03:36:58.604536+0000","last_active":"2024-09-17T03:36:58.615168+0000","last_peered":"2024-09-17T03:36:58.615168+0000","last_clean":"2024-09-17T03:36:58.615168+0000","last_became_active":"2024-09-17T03:36:58.604117+0000","last_became_peered":"2024-09-17T03:36:58.604117+0000","last_unstale":"2024-09-17T03:36:58.615168+0000","last_undegraded":"2024-09-17T03:36:58.615168+0000","last_fullsized":"2024-09-17T03:36:58.615168+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:42.334459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624127+0000","last_change":"2024-09-17T03:36:57.584256+0000","last_active":"2024-09-17T03:36:58.624127+0000","last_peered":"2024-09-17T03:36:58.624127+0000","last_clean":"2024-09-17T03:36:58.624127+0000","last_became_active":"2024-09-17T03:36:57.583832+0000","last_became_peered":"2024-09-17T03:36:57.583832+0000","last_unstale":"2024-09-17T03:36:58.624127+0000","last_undegraded":"2024-09-17T03:36:58.624127+0000","last_fullsized":"2024-09-17T03:36:58.624127+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:48.077004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610216+0000","last_change":"2024-09-17T03:36:58.608312+0000","last_active":"2024-09-17T03:36:58.610216+0000","last_peered":"2024-09-17T03:36:58.610216+0000","last_clean":"2024-09-17T03:36:58.610216+0000","last_became_active":"2024-09-17T03:36:58.607981+0000","last_became_peered":"2024-09-17T03:36:58.607981+0000","last_unstale":"2024-09-17T03:36:58.610216+0000","last_undegraded":"2024-09-17T03:36:58.610216+0000","last_fullsized":"2024-09-17T03:36:58.610216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:26.016580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623739+0000","last_change":"2024-09-17T03:36:57.593693+0000","last_active":"2024-09-17T03:36:58.623739+0000","last_peered":"2024-09-17T03:36:58.623739+0000","last_clean":"2024-09-17T03:36:58.623739+0000","last_became_active":"2024-09-17T03:36:57.593350+0000","last_became_peered":"2024-09-17T03:36:57.593350+0000","last_unstale":"2024-09-17T03:36:58.623739+0000","last_undegraded":"2024-09-17T03:36:58.623739+0000","last_fullsized":"2024-09-17T03:36:58.623739+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:32.413220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600612+0000","last_change":"2024-09-17T03:36:58.613986+0000","last_active":"2024-09-17T03:36:59.600612+0000","last_peered":"2024-09-17T03:36:59.600612+0000","last_clean":"2024-09-17T03:36:59.600612+0000","last_became_active":"2024-09-17T03:36:58.613638+0000","last_became_peered":"2024-09-17T03:36:58.613638+0000","last_unstale":"2024-09-17T03:36:59.600612+0000","last_undegraded":"2024-09-17T03:36:59.600612+0000","last_fullsized":"2024-09-17T03:36:59.600612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:52.994434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660439+0000","last_change":"2024-09-17T03:36:57.590634+0000","last_active":"2024-09-17T03:37:00.660439+0000","last_peered":"2024-09-17T03:37:00.660439+0000","last_clean":"2024-09-17T03:37:00.660439+0000","last_became_active":"2024-09-17T03:36:57.590292+0000","last_became_peered":"2024-09-17T03:36:57.590292+0000","last_unstale":"2024-09-17T03:37:00.660439+0000","last_undegraded":"2024-09-17T03:37:00.660439+0000","last_fullsized":"2024-09-17T03:37:00.660439+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:08.486412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614506+0000","last_change":"2024-09-17T03:36:58.612378+0000","last_active":"2024-09-17T03:36:58.614506+0000","last_peered":"2024-09-17T03:36:58.614506+0000","last_clean":"2024-09-17T03:36:58.614506+0000","last_became_active":"2024-09-17T03:36:58.612031+0000","last_became_peered":"2024-09-17T03:36:58.612031+0000","last_unstale":"2024-09-17T03:36:58.614506+0000","last_undegraded":"2024-09-17T03:36:58.614506+0000","last_fullsized":"2024-09-17T03:36:58.614506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:08.513728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623848+0000","last_change":"2024-09-17T03:36:57.590622+0000","last_active":"2024-09-17T03:36:58.623848+0000","last_peered":"2024-09-17T03:36:58.623848+0000","last_clean":"2024-09-17T03:36:58.623848+0000","last_became_active":"2024-09-17T03:36:57.590266+0000","last_became_peered":"2024-09-17T03:36:57.590266+0000","last_unstale":"2024-09-17T03:36:58.623848+0000","last_undegraded":"2024-09-17T03:36:58.623848+0000","last_fullsized":"2024-09-17T03:36:58.623848+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:55.095810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619669+0000","last_change":"2024-09-17T03:36:58.612013+0000","last_active":"2024-09-17T03:36:58.619669+0000","last_peered":"2024-09-17T03:36:58.619669+0000","last_clean":"2024-09-17T03:36:58.619669+0000","last_became_active":"2024-09-17T03:36:58.611745+0000","last_became_peered":"2024-09-17T03:36:58.611745+0000","last_unstale":"2024-09-17T03:36:58.619669+0000","last_undegraded":"2024-09-17T03:36:58.619669+0000","last_fullsized":"2024-09-17T03:36:58.619669+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:57.877593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.589675+0000","last_change":"2024-09-17T03:36:57.590493+0000","last_active":"2024-09-17T03:36:58.589675+0000","last_peered":"2024-09-17T03:36:58.589675+0000","last_clean":"2024-09-17T03:36:58.589675+0000","last_became_active":"2024-09-17T03:36:57.590157+0000","last_became_peered":"2024-09-17T03:36:57.590157+0000","last_unstale":"2024-09-17T03:36:58.589675+0000","last_undegraded":"2024-09-17T03:36:58.589675+0000","last_fullsized":"2024-09-17T03:36:58.589675+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:45.348233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.613107+0000","last_change":"2024-09-17T03:36:58.604882+0000","last_active":"2024-09-17T03:36:58.613107+0000","last_peered":"2024-09-17T03:36:58.613107+0000","last_clean":"2024-09-17T03:36:58.613107+0000","last_became_active":"2024-09-17T03:36:58.604597+0000","last_became_peered":"2024-09-17T03:36:58.604597+0000","last_unstale":"2024-09-17T03:36:58.613107+0000","last_undegraded":"2024-09-17T03:36:58.613107+0000","last_fullsized":"2024-09-17T03:36:58.613107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:26.075265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.595824+0000","last_change":"2024-09-17T03:36:57.586393+0000","last_active":"2024-09-17T03:36:58.595824+0000","last_peered":"2024-09-17T03:36:58.595824+0000","last_clean":"2024-09-17T03:36:58.595824+0000","last_became_active":"2024-09-17T03:36:57.586120+0000","last_became_peered":"2024-09-17T03:36:57.586120+0000","last_unstale":"2024-09-17T03:36:58.595824+0000","last_undegraded":"2024-09-17T03:36:58.595824+0000","last_fullsized":"2024-09-17T03:36:58.595824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:47.246300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.601111+0000","last_change":"2024-09-17T03:36:58.607869+0000","last_active":"2024-09-17T03:36:59.601111+0000","last_peered":"2024-09-17T03:36:59.601111+0000","last_clean":"2024-09-17T03:36:59.601111+0000","last_became_active":"2024-09-17T03:36:58.607004+0000","last_became_peered":"2024-09-17T03:36:58.607004+0000","last_unstale":"2024-09-17T03:36:59.601111+0000","last_undegraded":"2024-09-17T03:36:59.601111+0000","last_fullsized":"2024-09-17T03:36:59.601111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:41.348721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597464+0000","last_change":"2024-09-17T03:36:57.589422+0000","last_active":"2024-09-17T03:36:58.597464+0000","last_peered":"2024-09-17T03:36:58.597464+0000","last_clean":"2024-09-17T03:36:58.597464+0000","last_became_active":"2024-09-17T03:36:57.589098+0000","last_became_peered":"2024-09-17T03:36:57.589098+0000","last_unstale":"2024-09-17T03:36:58.597464+0000","last_undegraded":"2024-09-17T03:36:58.597464+0000","last_fullsized":"2024-09-17T03:36:58.597464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:39.093916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.606985+0000","last_change":"2024-09-17T03:36:58.604411+0000","last_active":"2024-09-17T03:36:58.606985+0000","last_peered":"2024-09-17T03:36:58.606985+0000","last_clean":"2024-09-17T03:36:58.606985+0000","last_became_active":"2024-09-17T03:36:58.604012+0000","last_became_peered":"2024-09-17T03:36:58.604012+0000","last_unstale":"2024-09-17T03:36:58.606985+0000","last_undegraded":"2024-09-17T03:36:58.606985+0000","last_fullsized":"2024-09-17T03:36:58.606985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:12.827748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598400+0000","last_change":"2024-09-17T03:36:57.596267+0000","last_active":"2024-09-17T03:36:58.598400+0000","last_peered":"2024-09-17T03:36:58.598400+0000","last_clean":"2024-09-17T03:36:58.598400+0000","last_became_active":"2024-09-17T03:36:57.595964+0000","last_became_peered":"2024-09-17T03:36:57.595964+0000","last_unstale":"2024-09-17T03:36:58.598400+0000","last_undegraded":"2024-09-17T03:36:58.598400+0000","last_fullsized":"2024-09-17T03:36:58.598400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:52.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.617051+0000","last_change":"2024-09-17T03:36:58.613987+0000","last_active":"2024-09-17T03:36:58.617051+0000","last_peered":"2024-09-17T03:36:58.617051+0000","last_clean":"2024-09-17T03:36:58.617051+0000","last_became_active":"2024-09-17T03:36:58.612963+0000","last_became_peered":"2024-09-17T03:36:58.612963+0000","last_unstale":"2024-09-17T03:36:58.617051+0000","last_undegraded":"2024-09-17T03:36:58.617051+0000","last_fullsized":"2024-09-17T03:36:58.617051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:31.989872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659806+0000","last_change":"2024-09-17T03:36:57.587577+0000","last_active":"2024-09-17T03:37:00.659806+0000","last_peered":"2024-09-17T03:37:00.659806+0000","last_clean":"2024-09-17T03:37:00.659806+0000","last_became_active":"2024-09-17T03:36:57.587300+0000","last_became_peered":"2024-09-17T03:36:57.587300+0000","last_unstale":"2024-09-17T03:37:00.659806+0000","last_undegraded":"2024-09-17T03:37:00.659806+0000","last_fullsized":"2024-09-17T03:37:00.659806+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:36.106844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.609397+0000","last_change":"2024-09-17T03:36:58.606960+0000","last_active":"2024-09-17T03:36:58.609397+0000","last_peered":"2024-09-17T03:36:58.609397+0000","last_clean":"2024-09-17T03:36:58.609397+0000","last_became_active":"2024-09-17T03:36:58.606534+0000","last_became_peered":"2024-09-17T03:36:58.606534+0000","last_unstale":"2024-09-17T03:36:58.609397+0000","last_undegraded":"2024-09-17T03:36:58.609397+0000","last_fullsized":"2024-09-17T03:36:58.609397+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:32.744450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623982+0000","last_change":"2024-09-17T03:36:57.583631+0000","last_active":"2024-09-17T03:36:58.623982+0000","last_peered":"2024-09-17T03:36:58.623982+0000","last_clean":"2024-09-17T03:36:58.623982+0000","last_became_active":"2024-09-17T03:36:57.583303+0000","last_became_peered":"2024-09-17T03:36:57.583303+0000","last_unstale":"2024-09-17T03:36:58.623982+0000","last_undegraded":"2024-09-17T03:36:58.623982+0000","last_fullsized":"2024-09-17T03:36:58.623982+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:52.808091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610116+0000","last_change":"2024-09-17T03:36:58.608223+0000","last_active":"2024-09-17T03:36:58.610116+0000","last_peered":"2024-09-17T03:36:58.610116+0000","last_clean":"2024-09-17T03:36:58.610116+0000","last_became_active":"2024-09-17T03:36:58.607909+0000","last_became_peered":"2024-09-17T03:36:58.607909+0000","last_unstale":"2024-09-17T03:36:58.610116+0000","last_undegraded":"2024-09-17T03:36:58.610116+0000","last_fullsized":"2024-09-17T03:36:58.610116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:40.743100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619256+0000","last_change":"2024-09-17T03:36:57.594639+0000","last_active":"2024-09-17T03:36:58.619256+0000","last_peered":"2024-09-17T03:36:58.619256+0000","last_clean":"2024-09-17T03:36:58.619256+0000","last_became_active":"2024-09-17T03:36:57.594225+0000","last_became_peered":"2024-09-17T03:36:57.594225+0000","last_unstale":"2024-09-17T03:36:58.619256+0000","last_undegraded":"2024-09-17T03:36:58.619256+0000","last_fullsized":"2024-09-17T03:36:58.619256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.745067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599577+0000","last_change":"2024-09-17T03:36:58.612756+0000","last_active":"2024-09-17T03:36:59.599577+0000","last_peered":"2024-09-17T03:36:59.599577+0000","last_clean":"2024-09-17T03:36:59.599577+0000","last_became_active":"2024-09-17T03:36:58.612422+0000","last_became_peered":"2024-09-17T03:36:58.612422+0000","last_unstale":"2024-09-17T03:36:59.599577+0000","last_undegraded":"2024-09-17T03:36:59.599577+0000","last_fullsized":"2024-09-17T03:36:59.599577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:56.105275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597196+0000","last_change":"2024-09-17T03:36:57.582416+0000","last_active":"2024-09-17T03:36:58.597196+0000","last_peered":"2024-09-17T03:36:58.597196+0000","last_clean":"2024-09-17T03:36:58.597196+0000","last_became_active":"2024-09-17T03:36:57.582075+0000","last_became_peered":"2024-09-17T03:36:57.582075+0000","last_unstale":"2024-09-17T03:36:58.597196+0000","last_undegraded":"2024-09-17T03:36:58.597196+0000","last_fullsized":"2024-09-17T03:36:58.597196+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:39.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615044+0000","last_change":"2024-09-17T03:36:58.614063+0000","last_active":"2024-09-17T03:36:58.615044+0000","last_peered":"2024-09-17T03:36:58.615044+0000","last_clean":"2024-09-17T03:36:58.615044+0000","last_became_active":"2024-09-17T03:36:58.613765+0000","last_became_peered":"2024-09-17T03:36:58.613765+0000","last_unstale":"2024-09-17T03:36:58.615044+0000","last_undegraded":"2024-09-17T03:36:58.615044+0000","last_fullsized":"2024-09-17T03:36:58.615044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:19.612415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600776+0000","last_change":"2024-09-17T03:36:57.592819+0000","last_active":"2024-09-17T03:36:59.600776+0000","last_peered":"2024-09-17T03:36:59.600776+0000","last_clean":"2024-09-17T03:36:59.600776+0000","last_became_active":"2024-09-17T03:36:57.592526+0000","last_became_peered":"2024-09-17T03:36:57.592526+0000","last_unstale":"2024-09-17T03:36:59.600776+0000","last_undegraded":"2024-09-17T03:36:59.600776+0000","last_fullsized":"2024-09-17T03:36:59.600776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:47.878879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619653+0000","last_change":"2024-09-17T03:36:58.615101+0000","last_active":"2024-09-17T03:36:58.619653+0000","last_peered":"2024-09-17T03:36:58.619653+0000","last_clean":"2024-09-17T03:36:58.619653+0000","last_became_active":"2024-09-17T03:36:58.614759+0000","last_became_peered":"2024-09-17T03:36:58.614759+0000","last_unstale":"2024-09-17T03:36:58.619653+0000","last_undegraded":"2024-09-17T03:36:58.619653+0000","last_fullsized":"2024-09-17T03:36:58.619653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:57.046686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.626931+0000","last_change":"2024-09-17T03:36:57.590811+0000","last_active":"2024-09-17T03:36:58.626931+0000","last_peered":"2024-09-17T03:36:58.626931+0000","last_clean":"2024-09-17T03:36:58.626931+0000","last_became_active":"2024-09-17T03:36:57.590493+0000","last_became_peered":"2024-09-17T03:36:57.590493+0000","last_unstale":"2024-09-17T03:36:58.626931+0000","last_undegraded":"2024-09-17T03:36:58.626931+0000","last_fullsized":"2024-09-17T03:36:58.626931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:36.950013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.608959+0000","last_change":"2024-09-17T03:36:58.603205+0000","last_active":"2024-09-17T03:36:58.608959+0000","last_peered":"2024-09-17T03:36:58.608959+0000","last_clean":"2024-09-17T03:36:58.608959+0000","last_became_active":"2024-09-17T03:36:58.602879+0000","last_became_peered":"2024-09-17T03:36:58.602879+0000","last_unstale":"2024-09-17T03:36:58.608959+0000","last_undegraded":"2024-09-17T03:36:58.608959+0000","last_fullsized":"2024-09-17T03:36:58.608959+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:15.337006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624130+0000","last_change":"2024-09-17T03:36:57.591724+0000","last_active":"2024-09-17T03:36:58.624130+0000","last_peered":"2024-09-17T03:36:58.624130+0000","last_clean":"2024-09-17T03:36:58.624130+0000","last_became_active":"2024-09-17T03:36:57.591423+0000","last_became_peered":"2024-09-17T03:36:57.591423+0000","last_unstale":"2024-09-17T03:36:58.624130+0000","last_undegraded":"2024-09-17T03:36:58.624130+0000","last_fullsized":"2024-09-17T03:36:58.624130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:47.502370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.608531+0000","last_change":"2024-09-17T03:36:58.606423+0000","last_active":"2024-09-17T03:36:58.608531+0000","last_peered":"2024-09-17T03:36:58.608531+0000","last_clean":"2024-09-17T03:36:58.608531+0000","last_became_active":"2024-09-17T03:36:58.606054+0000","last_became_peered":"2024-09-17T03:36:58.606054+0000","last_unstale":"2024-09-17T03:36:58.608531+0000","last_undegraded":"2024-09-17T03:36:58.608531+0000","last_fullsized":"2024-09-17T03:36:58.608531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:37.194170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623685+0000","last_change":"2024-09-17T03:36:57.584163+0000","last_active":"2024-09-17T03:36:58.623685+0000","last_peered":"2024-09-17T03:36:58.623685+0000","last_clean":"2024-09-17T03:36:58.623685+0000","last_became_active":"2024-09-17T03:36:57.583706+0000","last_became_peered":"2024-09-17T03:36:57.583706+0000","last_unstale":"2024-09-17T03:36:58.623685+0000","last_undegraded":"2024-09-17T03:36:58.623685+0000","last_fullsized":"2024-09-17T03:36:58.623685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:12.542540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.605257+0000","last_change":"2024-09-17T03:36:58.603373+0000","last_active":"2024-09-17T03:36:58.605257+0000","last_peered":"2024-09-17T03:36:58.605257+0000","last_clean":"2024-09-17T03:36:58.605257+0000","last_became_active":"2024-09-17T03:36:58.602742+0000","last_became_peered":"2024-09-17T03:36:58.602742+0000","last_unstale":"2024-09-17T03:36:58.605257+0000","last_undegraded":"2024-09-17T03:36:58.605257+0000","last_fullsized":"2024-09-17T03:36:58.605257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:53.456094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":14,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624389+0000","last_change":"2024-09-17T03:36:57.597237+0000","last_active":"2024-09-17T03:36:58.624389+0000","last_peered":"2024-09-17T03:36:58.624389+0000","last_clean":"2024-09-17T03:36:58.624389+0000","last_became_active":"2024-09-17T03:36:57.596927+0000","last_became_peered":"2024-09-17T03:36:57.596927+0000","last_unstale":"2024-09-17T03:36:58.624389+0000","last_undegraded":"2024-09-17T03:36:58.624389+0000","last_fullsized":"2024-09-17T03:36:58.624389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:45.348233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.619628+0000","last_change":"2024-09-17T03:36:58.615051+0000","last_active":"2024-09-17T03:36:58.619628+0000","last_peered":"2024-09-17T03:36:58.619628+0000","last_clean":"2024-09-17T03:36:58.619628+0000","last_became_active":"2024-09-17T03:36:58.614727+0000","last_became_peered":"2024-09-17T03:36:58.614727+0000","last_unstale":"2024-09-17T03:36:58.619628+0000","last_undegraded":"2024-09-17T03:36:58.619628+0000","last_fullsized":"2024-09-17T03:36:58.619628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:29.560429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.597705+0000","last_change":"2024-09-17T03:36:57.592743+0000","last_active":"2024-09-17T03:36:58.597705+0000","last_peered":"2024-09-17T03:36:58.597705+0000","last_clean":"2024-09-17T03:36:58.597705+0000","last_became_active":"2024-09-17T03:36:57.592410+0000","last_became_peered":"2024-09-17T03:36:57.592410+0000","last_unstale":"2024-09-17T03:36:58.597705+0000","last_undegraded":"2024-09-17T03:36:58.597705+0000","last_fullsized":"2024-09-17T03:36:58.597705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:37.445030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660362+0000","last_change":"2024-09-17T03:36:58.611912+0000","last_active":"2024-09-17T03:37:00.660362+0000","last_peered":"2024-09-17T03:37:00.660362+0000","last_clean":"2024-09-17T03:37:00.660362+0000","last_became_active":"2024-09-17T03:36:58.611607+0000","last_became_peered":"2024-09-17T03:36:58.611607+0000","last_unstale":"2024-09-17T03:37:00.660362+0000","last_undegraded":"2024-09-17T03:37:00.660362+0000","last_fullsized":"2024-09-17T03:37:00.660362+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:24.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598168+0000","last_change":"2024-09-17T03:36:57.589575+0000","last_active":"2024-09-17T03:36:58.598168+0000","last_peered":"2024-09-17T03:36:58.598168+0000","last_clean":"2024-09-17T03:36:58.598168+0000","last_became_active":"2024-09-17T03:36:57.589106+0000","last_became_peered":"2024-09-17T03:36:57.589106+0000","last_unstale":"2024-09-17T03:36:58.598168+0000","last_undegraded":"2024-09-17T03:36:58.598168+0000","last_fullsized":"2024-09-17T03:36:58.598168+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.745067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659525+0000","last_change":"2024-09-17T03:36:58.607183+0000","last_active":"2024-09-17T03:37:00.659525+0000","last_peered":"2024-09-17T03:37:00.659525+0000","last_clean":"2024-09-17T03:37:00.659525+0000","last_became_active":"2024-09-17T03:36:58.606205+0000","last_became_peered":"2024-09-17T03:36:58.606205+0000","last_unstale":"2024-09-17T03:37:00.659525+0000","last_undegraded":"2024-09-17T03:37:00.659525+0000","last_fullsized":"2024-09-17T03:37:00.659525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:21.411340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600996+0000","last_change":"2024-09-17T03:36:57.596093+0000","last_active":"2024-09-17T03:36:59.600996+0000","last_peered":"2024-09-17T03:36:59.600996+0000","last_clean":"2024-09-17T03:36:59.600996+0000","last_became_active":"2024-09-17T03:36:57.595632+0000","last_became_peered":"2024-09-17T03:36:57.595632+0000","last_unstale":"2024-09-17T03:36:59.600996+0000","last_undegraded":"2024-09-17T03:36:59.600996+0000","last_fullsized":"2024-09-17T03:36:59.600996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:37.258173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659608+0000","last_change":"2024-09-17T03:36:58.605976+0000","last_active":"2024-09-17T03:37:00.659608+0000","last_peered":"2024-09-17T03:37:00.659608+0000","last_clean":"2024-09-17T03:37:00.659608+0000","last_became_active":"2024-09-17T03:36:58.605684+0000","last_became_peered":"2024-09-17T03:36:58.605684+0000","last_unstale":"2024-09-17T03:37:00.659608+0000","last_undegraded":"2024-09-17T03:37:00.659608+0000","last_fullsized":"2024-09-17T03:37:00.659608+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:44.626056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.594386+0000","last_change":"2024-09-17T03:36:57.588964+0000","last_active":"2024-09-17T03:36:58.594386+0000","last_peered":"2024-09-17T03:36:58.594386+0000","last_clean":"2024-09-17T03:36:58.594386+0000","last_became_active":"2024-09-17T03:36:57.588619+0000","last_became_peered":"2024-09-17T03:36:57.588619+0000","last_unstale":"2024-09-17T03:36:58.594386+0000","last_undegraded":"2024-09-17T03:36:58.594386+0000","last_fullsized":"2024-09-17T03:36:58.594386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:47.054594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.606961+0000","last_change":"2024-09-17T03:36:58.602742+0000","last_active":"2024-09-17T03:36:58.606961+0000","last_peered":"2024-09-17T03:36:58.606961+0000","last_clean":"2024-09-17T03:36:58.606961+0000","last_became_active":"2024-09-17T03:36:58.602421+0000","last_became_peered":"2024-09-17T03:36:58.602421+0000","last_unstale":"2024-09-17T03:36:58.606961+0000","last_undegraded":"2024-09-17T03:36:58.606961+0000","last_fullsized":"2024-09-17T03:36:58.606961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:17.471850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.623980+0000","last_change":"2024-09-17T03:36:57.590905+0000","last_active":"2024-09-17T03:36:58.623980+0000","last_peered":"2024-09-17T03:36:58.623980+0000","last_clean":"2024-09-17T03:36:58.623980+0000","last_became_active":"2024-09-17T03:36:57.590517+0000","last_became_peered":"2024-09-17T03:36:57.590517+0000","last_unstale":"2024-09-17T03:36:58.623980+0000","last_undegraded":"2024-09-17T03:36:58.623980+0000","last_fullsized":"2024-09-17T03:36:58.623980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:24.906768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600048+0000","last_change":"2024-09-17T03:36:58.606404+0000","last_active":"2024-09-17T03:36:59.600048+0000","last_peered":"2024-09-17T03:36:59.600048+0000","last_clean":"2024-09-17T03:36:59.600048+0000","last_became_active":"2024-09-17T03:36:58.606065+0000","last_became_peered":"2024-09-17T03:36:58.606065+0000","last_unstale":"2024-09-17T03:36:59.600048+0000","last_undegraded":"2024-09-17T03:36:59.600048+0000","last_fullsized":"2024-09-17T03:36:59.600048+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:00.449441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"73'1","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.601249+0000","last_change":"2024-09-17T03:36:57.593712+0000","last_active":"2024-09-17T03:36:59.601249+0000","last_peered":"2024-09-17T03:36:59.601249+0000","last_clean":"2024-09-17T03:36:59.601249+0000","last_became_active":"2024-09-17T03:36:57.593387+0000","last_became_peered":"2024-09-17T03:36:57.593387+0000","last_unstale":"2024-09-17T03:36:59.601249+0000","last_undegraded":"2024-09-17T03:36:59.601249+0000","last_fullsized":"2024-09-17T03:36:59.601249+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:13.300120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.621811+0000","last_change":"2024-09-17T03:36:58.616039+0000","last_active":"2024-09-17T03:36:58.621811+0000","last_peered":"2024-09-17T03:36:58.621811+0000","last_clean":"2024-09-17T03:36:58.621811+0000","last_became_active":"2024-09-17T03:36:58.615707+0000","last_became_peered":"2024-09-17T03:36:58.615707+0000","last_unstale":"2024-09-17T03:36:58.621811+0000","last_undegraded":"2024-09-17T03:36:58.621811+0000","last_fullsized":"2024-09-17T03:36:58.621811+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:55.971111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.598228+0000","last_change":"2024-09-17T03:36:57.585618+0000","last_active":"2024-09-17T03:36:58.598228+0000","last_peered":"2024-09-17T03:36:58.598228+0000","last_clean":"2024-09-17T03:36:58.598228+0000","last_became_active":"2024-09-17T03:36:57.585282+0000","last_became_peered":"2024-09-17T03:36:57.585282+0000","last_unstale":"2024-09-17T03:36:58.598228+0000","last_undegraded":"2024-09-17T03:36:58.598228+0000","last_fullsized":"2024-09-17T03:36:58.598228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:48.269513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.610246+0000","last_change":"2024-09-17T03:36:58.608926+0000","last_active":"2024-09-17T03:36:58.610246+0000","last_peered":"2024-09-17T03:36:58.610246+0000","last_clean":"2024-09-17T03:36:58.610246+0000","last_became_active":"2024-09-17T03:36:58.608553+0000","last_became_peered":"2024-09-17T03:36:58.608553+0000","last_unstale":"2024-09-17T03:36:58.610246+0000","last_undegraded":"2024-09-17T03:36:58.610246+0000","last_fullsized":"2024-09-17T03:36:58.610246+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:10.226689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.596785+0000","last_change":"2024-09-17T03:36:57.586327+0000","last_active":"2024-09-17T03:36:58.596785+0000","last_peered":"2024-09-17T03:36:58.596785+0000","last_clean":"2024-09-17T03:36:58.596785+0000","last_became_active":"2024-09-17T03:36:57.586003+0000","last_became_peered":"2024-09-17T03:36:57.586003+0000","last_unstale":"2024-09-17T03:36:58.596785+0000","last_undegraded":"2024-09-17T03:36:58.596785+0000","last_fullsized":"2024-09-17T03:36:58.596785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:12.716534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.620040+0000","last_change":"2024-09-17T03:36:58.616301+0000","last_active":"2024-09-17T03:36:58.620040+0000","last_peered":"2024-09-17T03:36:58.620040+0000","last_clean":"2024-09-17T03:36:58.620040+0000","last_became_active":"2024-09-17T03:36:58.615909+0000","last_became_peered":"2024-09-17T03:36:58.615909+0000","last_unstale":"2024-09-17T03:36:58.620040+0000","last_undegraded":"2024-09-17T03:36:58.620040+0000","last_fullsized":"2024-09-17T03:36:58.620040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:19.200680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.602015+0000","last_change":"2024-09-17T03:36:57.591187+0000","last_active":"2024-09-17T03:36:58.602015+0000","last_peered":"2024-09-17T03:36:58.602015+0000","last_clean":"2024-09-17T03:36:58.602015+0000","last_became_active":"2024-09-17T03:36:57.590899+0000","last_became_peered":"2024-09-17T03:36:57.590899+0000","last_unstale":"2024-09-17T03:36:58.602015+0000","last_undegraded":"2024-09-17T03:36:58.602015+0000","last_fullsized":"2024-09-17T03:36:58.602015+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:02.492050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615388+0000","last_change":"2024-09-17T03:36:58.608391+0000","last_active":"2024-09-17T03:36:58.615388+0000","last_peered":"2024-09-17T03:36:58.615388+0000","last_clean":"2024-09-17T03:36:58.615388+0000","last_became_active":"2024-09-17T03:36:58.608055+0000","last_became_peered":"2024-09-17T03:36:58.608055+0000","last_unstale":"2024-09-17T03:36:58.615388+0000","last_undegraded":"2024-09-17T03:36:58.615388+0000","last_fullsized":"2024-09-17T03:36:58.615388+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:22.120747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.589696+0000","last_change":"2024-09-17T03:36:57.590878+0000","last_active":"2024-09-17T03:36:58.589696+0000","last_peered":"2024-09-17T03:36:58.589696+0000","last_clean":"2024-09-17T03:36:58.589696+0000","last_became_active":"2024-09-17T03:36:57.590524+0000","last_became_peered":"2024-09-17T03:36:57.590524+0000","last_unstale":"2024-09-17T03:36:58.589696+0000","last_undegraded":"2024-09-17T03:36:58.589696+0000","last_fullsized":"2024-09-17T03:36:58.589696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:39.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.615450+0000","last_change":"2024-09-17T03:36:58.608629+0000","last_active":"2024-09-17T03:36:58.615450+0000","last_peered":"2024-09-17T03:36:58.615450+0000","last_clean":"2024-09-17T03:36:58.615450+0000","last_became_active":"2024-09-17T03:36:58.608327+0000","last_became_peered":"2024-09-17T03:36:58.608327+0000","last_unstale":"2024-09-17T03:36:58.615450+0000","last_undegraded":"2024-09-17T03:36:58.615450+0000","last_fullsized":"2024-09-17T03:36:58.615450+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:42.334459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.590574+0000","last_change":"2024-09-17T03:36:57.594939+0000","last_active":"2024-09-17T03:36:58.590574+0000","last_peered":"2024-09-17T03:36:58.590574+0000","last_clean":"2024-09-17T03:36:58.590574+0000","last_became_active":"2024-09-17T03:36:57.594242+0000","last_became_peered":"2024-09-17T03:36:57.594242+0000","last_unstale":"2024-09-17T03:36:58.590574+0000","last_undegraded":"2024-09-17T03:36:58.590574+0000","last_fullsized":"2024-09-17T03:36:58.590574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:07.090365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.614864+0000","last_change":"2024-09-17T03:36:58.609686+0000","last_active":"2024-09-17T03:36:58.614864+0000","last_peered":"2024-09-17T03:36:58.614864+0000","last_clean":"2024-09-17T03:36:58.614864+0000","last_became_active":"2024-09-17T03:36:58.609366+0000","last_became_peered":"2024-09-17T03:36:58.609366+0000","last_unstale":"2024-09-17T03:36:58.614864+0000","last_undegraded":"2024-09-17T03:36:58.614864+0000","last_fullsized":"2024-09-17T03:36:58.614864+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:16.450751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.593723+0000","last_change":"2024-09-17T03:36:57.593661+0000","last_active":"2024-09-17T03:36:58.593723+0000","last_peered":"2024-09-17T03:36:58.593723+0000","last_clean":"2024-09-17T03:36:58.593723+0000","last_became_active":"2024-09-17T03:36:57.593336+0000","last_became_peered":"2024-09-17T03:36:57.593336+0000","last_unstale":"2024-09-17T03:36:58.593723+0000","last_undegraded":"2024-09-17T03:36:58.593723+0000","last_fullsized":"2024-09-17T03:36:58.593723+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:20.210252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660022+0000","last_change":"2024-09-17T03:36:58.605957+0000","last_active":"2024-09-17T03:37:00.660022+0000","last_peered":"2024-09-17T03:37:00.660022+0000","last_clean":"2024-09-17T03:37:00.660022+0000","last_became_active":"2024-09-17T03:36:58.605530+0000","last_became_peered":"2024-09-17T03:36:58.605530+0000","last_unstale":"2024-09-17T03:37:00.660022+0000","last_undegraded":"2024-09-17T03:37:00.660022+0000","last_fullsized":"2024-09-17T03:37:00.660022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:23.438911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.624276+0000","last_change":"2024-09-17T03:36:57.593881+0000","last_active":"2024-09-17T03:36:58.624276+0000","last_peered":"2024-09-17T03:36:58.624276+0000","last_clean":"2024-09-17T03:36:58.624276+0000","last_became_active":"2024-09-17T03:36:57.593412+0000","last_became_peered":"2024-09-17T03:36:57.593412+0000","last_unstale":"2024-09-17T03:36:58.624276+0000","last_undegraded":"2024-09-17T03:36:58.624276+0000","last_fullsized":"2024-09-17T03:36:58.624276+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:52.808091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":204,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-17T03:36:58.596710+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:36:58.596710+0000","last_peered":"2024-09-17T03:36:58.596710+0000","last_clean":"2024-09-17T03:36:58.596710+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:36:58.596710+0000","last_undegraded":"2024-09-17T03:36:58.596710+0000","last_fullsized":"2024-09-17T03:36:58.596710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36784,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335056,"statfs":{"total":96636764160,"available":96599097344,"internally_reserved":0,"allocated":1470464,"data_stored":960538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36184,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335656,"statfs":{"total":96636764160,"available":96599711744,"internally_reserved":0,"allocated":856064,"data_stored":362779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40360,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331480,"statfs":{"total":96636764160,"available":96595435520,"internally_reserved":0,"allocated":872448,"data_stored":369624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36208,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335632,"statfs":{"total":96636764160,"available":96599687168,"internally_reserved":0,"allocated":880640,"data_stored":371166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335620,"statfs":{"total":96636764160,"available":96599674880,"internally_reserved":0,"allocated":888832,"data_stored":371782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1462272,"data_stored":959922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36216,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335624,"statfs":{"total":96636764160,"available":96599678976,"internally_reserved":0,"allocated":884736,"data_stored":375944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40380,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331460,"statfs":{"total":96636764160,"available":96595415040,"internally_reserved":0,"allocated":888832,"data_stored":375966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:07.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:07.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.191+0000 7f0666582640 1 -- 172.21.15.146:0/2048753593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0648004800 msgr2=0x7f0648004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.191+0000 7f0666582640 1 --2- 172.21.15.146:0/2048753593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0648004800 0x7f0648004c10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f0654001850 tx=0x7f0648005830 comp rx=0 tx=0).stop 2024-09-17T03:37:07.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.191+0000 7f0666582640 1 -- 172.21.15.146:0/2048753593 shutdown_connections 2024-09-17T03:37:07.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.191+0000 7f0666582640 1 --2- 172.21.15.146:0/2048753593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0648004800 0x7f0648004c10 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.191+0000 7f0666582640 1 -- 172.21.15.146:0/2048753593 >> 172.21.15.146:0/2048753593 conn(0x7f06600b2060 msgr2=0x7f06600b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:07.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.191+0000 7f0666582640 1 -- 172.21.15.146:0/2048753593 shutdown_connections 2024-09-17T03:37:07.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.191+0000 7f0666582640 1 -- 172.21.15.146:0/2048753593 wait complete. 2024-09-17T03:37:07.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.193+0000 7f0666582640 1 Processor -- start 2024-09-17T03:37:07.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.193+0000 7f0666582640 1 -- start start 2024-09-17T03:37:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.194+0000 7f0666582640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0648004800 0x7f06600cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.194+0000 7f0666582640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06600acc90 0x7f0660152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.194+0000 7f0666582640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06600ad0a0 0x7f0660152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.194+0000 7f0666582640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f066015db00 con 0x7f06600ad0a0 2024-09-17T03:37:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.194+0000 7f0666582640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f066015d980 con 0x7f06600acc90 2024-09-17T03:37:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.194+0000 7f0666582640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f066015dc80 con 0x7f0648004800 2024-09-17T03:37:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.194+0000 7f0664b1f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06600ad0a0 0x7f0660152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.194+0000 7f0664b1f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06600ad0a0 0x7f0660152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37722/0 (socket says 172.21.15.146:37722) 2024-09-17T03:37:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.194+0000 7f0664b1f640 1 -- 172.21.15.146:0/2487908045 learned_addr learned my addr 172.21.15.146:0/2487908045 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f065f7fe640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06600acc90 0x7f0660152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f065ffff640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0648004800 0x7f06600cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f0664b1f640 1 -- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0648004800 msgr2=0x7f06600cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f0664b1f640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0648004800 0x7f06600cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f0664b1f640 1 -- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06600acc90 msgr2=0x7f0660152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f0664b1f640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06600acc90 0x7f0660152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f0664b1f640 1 -- 172.21.15.146:0/2487908045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06601f6b70 con 0x7f06600ad0a0 2024-09-17T03:37:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f0664b1f640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06600ad0a0 0x7f0660152c60 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f06600aff70 tx=0x7f0658010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f065cff9640 1 -- 172.21.15.146:0/2487908045 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065800ee10 con 0x7f06600ad0a0 2024-09-17T03:37:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f065cff9640 1 -- 172.21.15.146:0/2487908045 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0658015070 con 0x7f06600ad0a0 2024-09-17T03:37:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f0666582640 1 -- 172.21.15.146:0/2487908045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06601f6e50 con 0x7f06600ad0a0 2024-09-17T03:37:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f065cff9640 1 -- 172.21.15.146:0/2487908045 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0658003d00 con 0x7f06600ad0a0 2024-09-17T03:37:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.195+0000 7f0666582640 1 -- 172.21.15.146:0/2487908045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06601f7410 con 0x7f06600ad0a0 2024-09-17T03:37:07.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.196+0000 7f0666582640 1 -- 172.21.15.146:0/2487908045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06601606b0 con 0x7f06600ad0a0 2024-09-17T03:37:07.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.197+0000 7f065cff9640 1 -- 172.21.15.146:0/2487908045 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0658004030 con 0x7f06600ad0a0 2024-09-17T03:37:07.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.198+0000 7f065cff9640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f064c078b90 0x7f064c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.198+0000 7f065cff9640 1 -- 172.21.15.146:0/2487908045 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f065809b650 con 0x7f06600ad0a0 2024-09-17T03:37:07.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.198+0000 7f065ffff640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f064c078b90 0x7f064c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.198+0000 7f065ffff640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f064c078b90 0x7f064c07b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0650001220 tx=0x7f0650001110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:07.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.202+0000 7f065cff9640 1 -- 172.21.15.146:0/2487908045 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06580634d0 con 0x7f06600ad0a0 2024-09-17T03:37:07.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.375+0000 7f0666582640 1 -- 172.21.15.146:0/2487908045 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06600cca80 con 0x7f064c078b90 2024-09-17T03:37:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.380+0000 7f065cff9640 1 -- 172.21.15.146:0/2487908045 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252022 (secure 0 0 0) 0x7f06600cca80 con 0x7f064c078b90 2024-09-17T03:37:07.383 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:07.384 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:37:07.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 -- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f064c078b90 msgr2=0x7f064c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f064c078b90 0x7f064c07b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0650001220 tx=0x7f0650001110 comp rx=0 tx=0).stop 2024-09-17T03:37:07.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 -- 172.21.15.146:0/2487908045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06600ad0a0 msgr2=0x7f0660152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06600ad0a0 0x7f0660152c60 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f06600aff70 tx=0x7f0658010e80 comp rx=0 tx=0).stop 2024-09-17T03:37:07.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 -- 172.21.15.146:0/2487908045 shutdown_connections 2024-09-17T03:37:07.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f064c078b90 0x7f064c07b0a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06600ad0a0 0x7f0660152c60 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06600acc90 0x7f0660152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 --2- 172.21.15.146:0/2487908045 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0648004800 0x7f06600cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 -- 172.21.15.146:0/2487908045 >> 172.21.15.146:0/2487908045 conn(0x7f06600b2060 msgr2=0x7f0660075f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:07.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 -- 172.21.15.146:0/2487908045 shutdown_connections 2024-09-17T03:37:07.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.383+0000 7f0666582640 1 -- 172.21.15.146:0/2487908045 wait complete. 2024-09-17T03:37:07.395 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-17T03:37:05.852492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295076,"kb_used_data":8104,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754679644,"statfs":{"total":773094113280,"available":772791955456,"internally_reserved":0,"allocated":8298496,"data_stored":4192388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":293654065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002123"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660229+0000","last_change":"2024-09-17T03:36:58.617054+0000","last_active":"2024-09-17T03:37:00.660229+0000","last_peered":"2024-09-17T03:37:00.660229+0000","last_clean":"2024-09-17T03:37:00.660229+0000","last_became_active":"2024-09-17T03:36:58.616715+0000","last_became_peered":"2024-09-17T03:36:58.616715+0000","last_unstale":"2024-09-17T03:37:00.660229+0000","last_undegraded":"2024-09-17T03:37:00.660229+0000","last_fullsized":"2024-09-17T03:37:00.660229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:02.442973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600248+0000","last_change":"2024-09-17T03:36:58.613591+0000","last_active":"2024-09-17T03:36:59.600248+0000","last_peered":"2024-09-17T03:36:59.600248+0000","last_clean":"2024-09-17T03:36:59.600248+0000","last_became_active":"2024-09-17T03:36:58.613190+0000","last_became_peered":"2024-09-17T03:36:58.613190+0000","last_unstale":"2024-09-17T03:36:59.600248+0000","last_undegraded":"2024-09-17T03:36:59.600248+0000","last_fullsized":"2024-09-17T03:36:59.600248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:10.709182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659725+0000","last_change":"2024-09-17T03:36:58.608680+0000","last_active":"2024-09-17T03:37:00.659725+0000","last_peered":"2024-09-17T03:37:00.659725+0000","last_clean":"2024-09-17T03:37:00.659725+0000","last_became_active":"2024-09-17T03:36:58.608372+0000","last_became_peered":"2024-09-17T03:36:58.608372+0000","last_unstale":"2024-09-17T03:37:00.659725+0000","last_undegraded":"2024-09-17T03:37:00.659725+0000","last_fullsized":"2024-09-17T03:37:00.659725+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:17.599786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600759+0000","last_change":"2024-09-17T03:36:58.605913+0000","last_active":"2024-09-17T03:36:59.600759+0000","last_peered":"2024-09-17T03:36:59.600759+0000","last_clean":"2024-09-17T03:36:59.600759+0000","last_became_active":"2024-09-17T03:36:58.605551+0000","last_became_peered":"2024-09-17T03:36:58.605551+0000","last_unstale":"2024-09-17T03:36:59.600759+0000","last_undegraded":"2024-09-17T03:36:59.600759+0000","last_fullsized":"2024-09-17T03:36:59.600759+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:16.450751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659934+0000","last_change":"2024-09-17T03:36:58.616318+0000","last_active":"2024-09-17T03:37:00.659934+0000","last_peered":"2024-09-17T03:37:00.659934+0000","last_clean":"2024-09-17T03:37:00.659934+0000","last_became_active":"2024-09-17T03:36:58.615972+0000","last_became_peered":"2024-09-17T03:36:58.615972+0000","last_unstale":"2024-09-17T03:37:00.659934+0000","last_undegraded":"2024-09-17T03:37:00.659934+0000","last_fullsized":"2024-09-17T03:37:00.659934+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:50.425290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600564+0000","last_change":"2024-09-17T03:36:58.613048+0000","last_active":"2024-09-17T03:36:59.600564+0000","last_peered":"2024-09-17T03:36:59.600564+0000","last_clean":"2024-09-17T03:36:59.600564+0000","last_became_active":"2024-09-17T03:36:58.612726+0000","last_became_peered":"2024-09-17T03:36:58.612726+0000","last_unstale":"2024-09-17T03:36:59.600564+0000","last_undegraded":"2024-09-17T03:36:59.600564+0000","last_fullsized":"2024-09-17T03:36:59.600564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:38.162469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600912+0000","last_change":"2024-09-17T03:36:58.606362+0000","last_active":"2024-09-17T03:36:59.600912+0000","last_peered":"2024-09-17T03:36:59.600912+0000","last_clean":"2024-09-17T03:36:59.600912+0000","last_became_active":"2024-09-17T03:36:58.606052+0000","last_became_peered":"2024-09-17T03:36:58.606052+0000","last_unstale":"2024-09-17T03:36:59.600912+0000","last_undegraded":"2024-09-17T03:36:59.600912+0000","last_fullsized":"2024-09-17T03:36:59.600912+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:57.314386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599822+0000","last_change":"2024-09-17T03:36:58.608044+0000","last_active":"2024-09-17T03:36:59.599822+0000","last_peered":"2024-09-17T03:36:59.599822+0000","last_clean":"2024-09-17T03:36:59.599822+0000","last_became_active":"2024-09-17T03:36:58.607155+0000","last_became_peered":"2024-09-17T03:36:58.607155+0000","last_unstale":"2024-09-17T03:36:59.599822+0000","last_undegraded":"2024-09-17T03:36:59.599822+0000","last_fullsized":"2024-09-17T03:36:59.599822+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:40.168891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660263+0000","last_change":"2024-09-17T03:36:58.614210+0000","last_active":"2024-09-17T03:37:00.660263+0000","last_peered":"2024-09-17T03:37:00.660263+0000","last_clean":"2024-09-17T03:37:00.660263+0000","last_became_active":"2024-09-17T03:36:58.613913+0000","last_became_peered":"2024-09-17T03:36:58.613913+0000","last_unstale":"2024-09-17T03:37:00.660263+0000","last_undegraded":"2024-09-17T03:37:00.660263+0000","last_fullsized":"2024-09-17T03:37:00.660263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:31.092184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.219132+0000","last_change":"2024-09-17T03:36:58.607751+0000","last_active":"2024-09-17T03:37:00.219132+0000","last_peered":"2024-09-17T03:37:00.219132+0000","last_clean":"2024-09-17T03:37:00.219132+0000","last_became_active":"2024-09-17T03:36:58.607444+0000","last_became_peered":"2024-09-17T03:36:58.607444+0000","last_unstale":"2024-09-17T03:37:00.219132+0000","last_undegraded":"2024-09-17T03:37:00.219132+0000","last_fullsized":"2024-09-17T03:37:00.219132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:43.104211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660034+0000","last_change":"2024-09-17T03:36:58.612036+0000","last_active":"2024-09-17T03:37:00.660034+0000","last_peered":"2024-09-17T03:37:00.660034+0000","last_clean":"2024-09-17T03:37:00.660034+0000","last_became_active":"2024-09-17T03:36:58.611664+0000","last_became_peered":"2024-09-17T03:36:58.611664+0000","last_unstale":"2024-09-17T03:37:00.660034+0000","last_undegraded":"2024-09-17T03:37:00.660034+0000","last_fullsized":"2024-09-17T03:37:00.660034+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:19.666675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600793+0000","last_change":"2024-09-17T03:36:58.603439+0000","last_active":"2024-09-17T03:36:59.600793+0000","last_peered":"2024-09-17T03:36:59.600793+0000","last_clean":"2024-09-17T03:36:59.600793+0000","last_became_active":"2024-09-17T03:36:58.603155+0000","last_became_peered":"2024-09-17T03:36:58.603155+0000","last_unstale":"2024-09-17T03:36:59.600793+0000","last_undegraded":"2024-09-17T03:36:59.600793+0000","last_fullsized":"2024-09-17T03:36:59.600793+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:22.607257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.604166+0000","last_change":"2024-09-17T03:36:58.611787+0000","last_active":"2024-09-17T03:37:00.604166+0000","last_peered":"2024-09-17T03:37:00.604166+0000","last_clean":"2024-09-17T03:37:00.604166+0000","last_became_active":"2024-09-17T03:36:58.611492+0000","last_became_peered":"2024-09-17T03:36:58.611492+0000","last_unstale":"2024-09-17T03:37:00.604166+0000","last_undegraded":"2024-09-17T03:37:00.604166+0000","last_fullsized":"2024-09-17T03:37:00.604166+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:15.069939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659728+0000","last_change":"2024-09-17T03:36:58.612245+0000","last_active":"2024-09-17T03:37:00.659728+0000","last_peered":"2024-09-17T03:37:00.659728+0000","last_clean":"2024-09-17T03:37:00.659728+0000","last_became_active":"2024-09-17T03:36:58.611923+0000","last_became_peered":"2024-09-17T03:36:58.611923+0000","last_unstale":"2024-09-17T03:37:00.659728+0000","last_undegraded":"2024-09-17T03:37:00.659728+0000","last_fullsized":"2024-09-17T03:37:00.659728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:53.658911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.603986+0000","last_change":"2024-09-17T03:36:58.605653+0000","last_active":"2024-09-17T03:37:00.603986+0000","last_peered":"2024-09-17T03:37:00.603986+0000","last_clean":"2024-09-17T03:37:00.603986+0000","last_became_active":"2024-09-17T03:36:58.605358+0000","last_became_peered":"2024-09-17T03:36:58.605358+0000","last_unstale":"2024-09-17T03:37:00.603986+0000","last_undegraded":"2024-09-17T03:37:00.603986+0000","last_fullsized":"2024-09-17T03:37:00.603986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:13:39.877705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.218743+0000","last_change":"2024-09-17T03:36:58.603629+0000","last_active":"2024-09-17T03:37:00.218743+0000","last_peered":"2024-09-17T03:37:00.218743+0000","last_clean":"2024-09-17T03:37:00.218743+0000","last_became_active":"2024-09-17T03:36:58.602937+0000","last_became_peered":"2024-09-17T03:36:58.602937+0000","last_unstale":"2024-09-17T03:37:00.218743+0000","last_undegraded":"2024-09-17T03:37:00.218743+0000","last_fullsized":"2024-09-17T03:37:00.218743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:02.462120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660508+0000","last_change":"2024-09-17T03:36:58.611332+0000","last_active":"2024-09-17T03:37:00.660508+0000","last_peered":"2024-09-17T03:37:00.660508+0000","last_clean":"2024-09-17T03:37:00.660508+0000","last_became_active":"2024-09-17T03:36:58.611024+0000","last_became_peered":"2024-09-17T03:36:58.611024+0000","last_unstale":"2024-09-17T03:37:00.660508+0000","last_undegraded":"2024-09-17T03:37:00.660508+0000","last_fullsized":"2024-09-17T03:37:00.660508+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:53.366995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600672+0000","last_change":"2024-09-17T03:36:58.609578+0000","last_active":"2024-09-17T03:36:59.600672+0000","last_peered":"2024-09-17T03:36:59.600672+0000","last_clean":"2024-09-17T03:36:59.600672+0000","last_became_active":"2024-09-17T03:36:58.609270+0000","last_became_peered":"2024-09-17T03:36:58.609270+0000","last_unstale":"2024-09-17T03:36:59.600672+0000","last_undegraded":"2024-09-17T03:36:59.600672+0000","last_fullsized":"2024-09-17T03:36:59.600672+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:22.120747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599718+0000","last_change":"2024-09-17T03:36:58.604940+0000","last_active":"2024-09-17T03:36:59.599718+0000","last_peered":"2024-09-17T03:36:59.599718+0000","last_clean":"2024-09-17T03:36:59.599718+0000","last_became_active":"2024-09-17T03:36:58.604635+0000","last_became_peered":"2024-09-17T03:36:58.604635+0000","last_unstale":"2024-09-17T03:36:59.599718+0000","last_undegraded":"2024-09-17T03:36:59.599718+0000","last_fullsized":"2024-09-17T03:36:59.599718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:53.599129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.604110+0000","last_change":"2024-09-17T03:36:58.604263+0000","last_active":"2024-09-17T03:37:00.604110+0000","last_peered":"2024-09-17T03:37:00.604110+0000","last_clean":"2024-09-17T03:37:00.604110+0000","last_became_active":"2024-09-17T03:36:58.603672+0000","last_became_peered":"2024-09-17T03:36:58.603672+0000","last_unstale":"2024-09-17T03:37:00.604110+0000","last_undegraded":"2024-09-17T03:37:00.604110+0000","last_fullsized":"2024-09-17T03:37:00.604110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:01.326763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.218946+0000","last_change":"2024-09-17T03:36:58.601622+0000","last_active":"2024-09-17T03:37:00.218946+0000","last_peered":"2024-09-17T03:37:00.218946+0000","last_clean":"2024-09-17T03:37:00.218946+0000","last_became_active":"2024-09-17T03:36:58.601303+0000","last_became_peered":"2024-09-17T03:36:58.601303+0000","last_unstale":"2024-09-17T03:37:00.218946+0000","last_undegraded":"2024-09-17T03:37:00.218946+0000","last_fullsized":"2024-09-17T03:37:00.218946+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:58.588185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.218761+0000","last_change":"2024-09-17T03:36:58.610601+0000","last_active":"2024-09-17T03:37:00.218761+0000","last_peered":"2024-09-17T03:37:00.218761+0000","last_clean":"2024-09-17T03:37:00.218761+0000","last_became_active":"2024-09-17T03:36:58.610255+0000","last_became_peered":"2024-09-17T03:36:58.610255+0000","last_unstale":"2024-09-17T03:37:00.218761+0000","last_undegraded":"2024-09-17T03:37:00.218761+0000","last_fullsized":"2024-09-17T03:37:00.218761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:48.059751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659834+0000","last_change":"2024-09-17T03:36:58.604903+0000","last_active":"2024-09-17T03:37:00.659834+0000","last_peered":"2024-09-17T03:37:00.659834+0000","last_clean":"2024-09-17T03:37:00.659834+0000","last_became_active":"2024-09-17T03:36:58.604570+0000","last_became_peered":"2024-09-17T03:36:58.604570+0000","last_unstale":"2024-09-17T03:37:00.659834+0000","last_undegraded":"2024-09-17T03:37:00.659834+0000","last_fullsized":"2024-09-17T03:37:00.659834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:48.509028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659751+0000","last_change":"2024-09-17T03:36:58.611647+0000","last_active":"2024-09-17T03:37:00.659751+0000","last_peered":"2024-09-17T03:37:00.659751+0000","last_clean":"2024-09-17T03:37:00.659751+0000","last_became_active":"2024-09-17T03:36:58.611306+0000","last_became_peered":"2024-09-17T03:36:58.611306+0000","last_unstale":"2024-09-17T03:37:00.659751+0000","last_undegraded":"2024-09-17T03:37:00.659751+0000","last_fullsized":"2024-09-17T03:37:00.659751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:10.016413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.219298+0000","last_change":"2024-09-17T03:36:58.601635+0000","last_active":"2024-09-17T03:37:00.219298+0000","last_peered":"2024-09-17T03:37:00.219298+0000","last_clean":"2024-09-17T03:37:00.219298+0000","last_became_active":"2024-09-17T03:36:58.601341+0000","last_became_peered":"2024-09-17T03:36:58.601341+0000","last_unstale":"2024-09-17T03:37:00.219298+0000","last_undegraded":"2024-09-17T03:37:00.219298+0000","last_fullsized":"2024-09-17T03:37:00.219298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:07.580219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.601170+0000","last_change":"2024-09-17T03:36:58.607547+0000","last_active":"2024-09-17T03:36:59.601170+0000","last_peered":"2024-09-17T03:36:59.601170+0000","last_clean":"2024-09-17T03:36:59.601170+0000","last_became_active":"2024-09-17T03:36:58.606970+0000","last_became_peered":"2024-09-17T03:36:58.606970+0000","last_unstale":"2024-09-17T03:36:59.601170+0000","last_undegraded":"2024-09-17T03:36:59.601170+0000","last_fullsized":"2024-09-17T03:36:59.601170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:08.286039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659754+0000","last_change":"2024-09-17T03:36:58.609461+0000","last_active":"2024-09-17T03:37:00.659754+0000","last_peered":"2024-09-17T03:37:00.659754+0000","last_clean":"2024-09-17T03:37:00.659754+0000","last_became_active":"2024-09-17T03:36:58.609161+0000","last_became_peered":"2024-09-17T03:36:58.609161+0000","last_unstale":"2024-09-17T03:37:00.659754+0000","last_undegraded":"2024-09-17T03:37:00.659754+0000","last_fullsized":"2024-09-17T03:37:00.659754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:46.902706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.219182+0000","last_change":"2024-09-17T03:36:58.610689+0000","last_active":"2024-09-17T03:37:00.219182+0000","last_peered":"2024-09-17T03:37:00.219182+0000","last_clean":"2024-09-17T03:37:00.219182+0000","last_became_active":"2024-09-17T03:36:58.610241+0000","last_became_peered":"2024-09-17T03:36:58.610241+0000","last_unstale":"2024-09-17T03:37:00.219182+0000","last_undegraded":"2024-09-17T03:37:00.219182+0000","last_fullsized":"2024-09-17T03:37:00.219182+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:00.003815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660122+0000","last_change":"2024-09-17T03:36:58.608380+0000","last_active":"2024-09-17T03:37:00.660122+0000","last_peered":"2024-09-17T03:37:00.660122+0000","last_clean":"2024-09-17T03:37:00.660122+0000","last_became_active":"2024-09-17T03:36:58.608043+0000","last_became_peered":"2024-09-17T03:36:58.608043+0000","last_unstale":"2024-09-17T03:37:00.660122+0000","last_undegraded":"2024-09-17T03:37:00.660122+0000","last_fullsized":"2024-09-17T03:37:00.660122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:58.813301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600393+0000","last_change":"2024-09-17T03:36:58.605495+0000","last_active":"2024-09-17T03:36:59.600393+0000","last_peered":"2024-09-17T03:36:59.600393+0000","last_clean":"2024-09-17T03:36:59.600393+0000","last_became_active":"2024-09-17T03:36:58.605160+0000","last_became_peered":"2024-09-17T03:36:58.605160+0000","last_unstale":"2024-09-17T03:36:59.600393+0000","last_undegraded":"2024-09-17T03:36:59.600393+0000","last_fullsized":"2024-09-17T03:36:59.600393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:10.458393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.601118+0000","last_change":"2024-09-17T03:36:58.610990+0000","last_active":"2024-09-17T03:36:59.601118+0000","last_peered":"2024-09-17T03:36:59.601118+0000","last_clean":"2024-09-17T03:36:59.601118+0000","last_became_active":"2024-09-17T03:36:58.610679+0000","last_became_peered":"2024-09-17T03:36:58.610679+0000","last_unstale":"2024-09-17T03:36:59.601118+0000","last_undegraded":"2024-09-17T03:36:59.601118+0000","last_fullsized":"2024-09-17T03:36:59.601118+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:34.914105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600342+0000","last_change":"2024-09-17T03:36:58.610171+0000","last_active":"2024-09-17T03:36:59.600342+0000","last_peered":"2024-09-17T03:36:59.600342+0000","last_clean":"2024-09-17T03:36:59.600342+0000","last_became_active":"2024-09-17T03:36:58.609749+0000","last_became_peered":"2024-09-17T03:36:58.609749+0000","last_unstale":"2024-09-17T03:36:59.600342+0000","last_undegraded":"2024-09-17T03:36:59.600342+0000","last_fullsized":"2024-09-17T03:36:59.600342+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:02.462120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660279+0000","last_change":"2024-09-17T03:36:58.616100+0000","last_active":"2024-09-17T03:37:00.660279+0000","last_peered":"2024-09-17T03:37:00.660279+0000","last_clean":"2024-09-17T03:37:00.660279+0000","last_became_active":"2024-09-17T03:36:58.615736+0000","last_became_peered":"2024-09-17T03:36:58.615736+0000","last_unstale":"2024-09-17T03:37:00.660279+0000","last_undegraded":"2024-09-17T03:37:00.660279+0000","last_fullsized":"2024-09-17T03:37:00.660279+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:45.829733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660465+0000","last_change":"2024-09-17T03:36:57.593446+0000","last_active":"2024-09-17T03:37:00.660465+0000","last_peered":"2024-09-17T03:37:00.660465+0000","last_clean":"2024-09-17T03:37:00.660465+0000","last_became_active":"2024-09-17T03:36:57.592914+0000","last_became_peered":"2024-09-17T03:36:57.592914+0000","last_unstale":"2024-09-17T03:37:00.660465+0000","last_undegraded":"2024-09-17T03:37:00.660465+0000","last_fullsized":"2024-09-17T03:37:00.660465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:04.448726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660752+0000","last_change":"2024-09-17T03:36:58.610586+0000","last_active":"2024-09-17T03:37:00.660752+0000","last_peered":"2024-09-17T03:37:00.660752+0000","last_clean":"2024-09-17T03:37:00.660752+0000","last_became_active":"2024-09-17T03:36:58.610274+0000","last_became_peered":"2024-09-17T03:36:58.610274+0000","last_unstale":"2024-09-17T03:37:00.660752+0000","last_undegraded":"2024-09-17T03:37:00.660752+0000","last_fullsized":"2024-09-17T03:37:00.660752+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:16.009283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.604495+0000","last_change":"2024-09-17T03:36:57.585526+0000","last_active":"2024-09-17T03:37:00.604495+0000","last_peered":"2024-09-17T03:37:00.604495+0000","last_clean":"2024-09-17T03:37:00.604495+0000","last_became_active":"2024-09-17T03:36:57.585185+0000","last_became_peered":"2024-09-17T03:36:57.585185+0000","last_unstale":"2024-09-17T03:37:00.604495+0000","last_undegraded":"2024-09-17T03:37:00.604495+0000","last_fullsized":"2024-09-17T03:37:00.604495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:01.710972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599590+0000","last_change":"2024-09-17T03:36:58.604536+0000","last_active":"2024-09-17T03:36:59.599590+0000","last_peered":"2024-09-17T03:36:59.599590+0000","last_clean":"2024-09-17T03:36:59.599590+0000","last_became_active":"2024-09-17T03:36:58.604117+0000","last_became_peered":"2024-09-17T03:36:58.604117+0000","last_unstale":"2024-09-17T03:36:59.599590+0000","last_undegraded":"2024-09-17T03:36:59.599590+0000","last_fullsized":"2024-09-17T03:36:59.599590+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:12.951163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.219076+0000","last_change":"2024-09-17T03:36:57.584256+0000","last_active":"2024-09-17T03:37:00.219076+0000","last_peered":"2024-09-17T03:37:00.219076+0000","last_clean":"2024-09-17T03:37:00.219076+0000","last_became_active":"2024-09-17T03:36:57.583832+0000","last_became_peered":"2024-09-17T03:36:57.583832+0000","last_unstale":"2024-09-17T03:37:00.219076+0000","last_undegraded":"2024-09-17T03:37:00.219076+0000","last_fullsized":"2024-09-17T03:37:00.219076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:48.077004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660229+0000","last_change":"2024-09-17T03:36:58.608312+0000","last_active":"2024-09-17T03:37:00.660229+0000","last_peered":"2024-09-17T03:37:00.660229+0000","last_clean":"2024-09-17T03:37:00.660229+0000","last_became_active":"2024-09-17T03:36:58.607981+0000","last_became_peered":"2024-09-17T03:36:58.607981+0000","last_unstale":"2024-09-17T03:37:00.660229+0000","last_undegraded":"2024-09-17T03:37:00.660229+0000","last_fullsized":"2024-09-17T03:37:00.660229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:08.628216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599926+0000","last_change":"2024-09-17T03:36:57.593693+0000","last_active":"2024-09-17T03:36:59.599926+0000","last_peered":"2024-09-17T03:36:59.599926+0000","last_clean":"2024-09-17T03:36:59.599926+0000","last_became_active":"2024-09-17T03:36:57.593350+0000","last_became_peered":"2024-09-17T03:36:57.593350+0000","last_unstale":"2024-09-17T03:36:59.599926+0000","last_undegraded":"2024-09-17T03:36:59.599926+0000","last_fullsized":"2024-09-17T03:36:59.599926+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:32.413220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600612+0000","last_change":"2024-09-17T03:36:58.613986+0000","last_active":"2024-09-17T03:36:59.600612+0000","last_peered":"2024-09-17T03:36:59.600612+0000","last_clean":"2024-09-17T03:36:59.600612+0000","last_became_active":"2024-09-17T03:36:58.613638+0000","last_became_peered":"2024-09-17T03:36:58.613638+0000","last_unstale":"2024-09-17T03:36:59.600612+0000","last_undegraded":"2024-09-17T03:36:59.600612+0000","last_fullsized":"2024-09-17T03:36:59.600612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:52.994434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660439+0000","last_change":"2024-09-17T03:36:57.590634+0000","last_active":"2024-09-17T03:37:00.660439+0000","last_peered":"2024-09-17T03:37:00.660439+0000","last_clean":"2024-09-17T03:37:00.660439+0000","last_became_active":"2024-09-17T03:36:57.590292+0000","last_became_peered":"2024-09-17T03:36:57.590292+0000","last_unstale":"2024-09-17T03:37:00.660439+0000","last_undegraded":"2024-09-17T03:37:00.660439+0000","last_fullsized":"2024-09-17T03:37:00.660439+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:08.486412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.219076+0000","last_change":"2024-09-17T03:36:58.612378+0000","last_active":"2024-09-17T03:37:00.219076+0000","last_peered":"2024-09-17T03:37:00.219076+0000","last_clean":"2024-09-17T03:37:00.219076+0000","last_became_active":"2024-09-17T03:36:58.612031+0000","last_became_peered":"2024-09-17T03:36:58.612031+0000","last_unstale":"2024-09-17T03:37:00.219076+0000","last_undegraded":"2024-09-17T03:37:00.219076+0000","last_fullsized":"2024-09-17T03:37:00.219076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:05.236744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599829+0000","last_change":"2024-09-17T03:36:57.590622+0000","last_active":"2024-09-17T03:36:59.599829+0000","last_peered":"2024-09-17T03:36:59.599829+0000","last_clean":"2024-09-17T03:36:59.599829+0000","last_became_active":"2024-09-17T03:36:57.590266+0000","last_became_peered":"2024-09-17T03:36:57.590266+0000","last_unstale":"2024-09-17T03:36:59.599829+0000","last_undegraded":"2024-09-17T03:36:59.599829+0000","last_fullsized":"2024-09-17T03:36:59.599829+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:55.095810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659519+0000","last_change":"2024-09-17T03:36:58.612013+0000","last_active":"2024-09-17T03:37:00.659519+0000","last_peered":"2024-09-17T03:37:00.659519+0000","last_clean":"2024-09-17T03:37:00.659519+0000","last_became_active":"2024-09-17T03:36:58.611745+0000","last_became_peered":"2024-09-17T03:36:58.611745+0000","last_unstale":"2024-09-17T03:37:00.659519+0000","last_undegraded":"2024-09-17T03:37:00.659519+0000","last_fullsized":"2024-09-17T03:37:00.659519+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:54.940357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600376+0000","last_change":"2024-09-17T03:36:57.590493+0000","last_active":"2024-09-17T03:36:59.600376+0000","last_peered":"2024-09-17T03:36:59.600376+0000","last_clean":"2024-09-17T03:36:59.600376+0000","last_became_active":"2024-09-17T03:36:57.590157+0000","last_became_peered":"2024-09-17T03:36:57.590157+0000","last_unstale":"2024-09-17T03:36:59.600376+0000","last_undegraded":"2024-09-17T03:36:59.600376+0000","last_fullsized":"2024-09-17T03:36:59.600376+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:45.348233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.604136+0000","last_change":"2024-09-17T03:36:58.604882+0000","last_active":"2024-09-17T03:37:00.604136+0000","last_peered":"2024-09-17T03:37:00.604136+0000","last_clean":"2024-09-17T03:37:00.604136+0000","last_became_active":"2024-09-17T03:36:58.604597+0000","last_became_peered":"2024-09-17T03:36:58.604597+0000","last_unstale":"2024-09-17T03:37:00.604136+0000","last_undegraded":"2024-09-17T03:37:00.604136+0000","last_fullsized":"2024-09-17T03:37:00.604136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:08.859789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659758+0000","last_change":"2024-09-17T03:36:57.586393+0000","last_active":"2024-09-17T03:37:00.659758+0000","last_peered":"2024-09-17T03:37:00.659758+0000","last_clean":"2024-09-17T03:37:00.659758+0000","last_became_active":"2024-09-17T03:36:57.586120+0000","last_became_peered":"2024-09-17T03:36:57.586120+0000","last_unstale":"2024-09-17T03:37:00.659758+0000","last_undegraded":"2024-09-17T03:37:00.659758+0000","last_fullsized":"2024-09-17T03:37:00.659758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:47.246300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.601111+0000","last_change":"2024-09-17T03:36:58.607869+0000","last_active":"2024-09-17T03:36:59.601111+0000","last_peered":"2024-09-17T03:36:59.601111+0000","last_clean":"2024-09-17T03:36:59.601111+0000","last_became_active":"2024-09-17T03:36:58.607004+0000","last_became_peered":"2024-09-17T03:36:58.607004+0000","last_unstale":"2024-09-17T03:36:59.601111+0000","last_undegraded":"2024-09-17T03:36:59.601111+0000","last_fullsized":"2024-09-17T03:36:59.601111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:41.348721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.219239+0000","last_change":"2024-09-17T03:36:57.589422+0000","last_active":"2024-09-17T03:37:00.219239+0000","last_peered":"2024-09-17T03:37:00.219239+0000","last_clean":"2024-09-17T03:37:00.219239+0000","last_became_active":"2024-09-17T03:36:57.589098+0000","last_became_peered":"2024-09-17T03:36:57.589098+0000","last_unstale":"2024-09-17T03:37:00.219239+0000","last_undegraded":"2024-09-17T03:37:00.219239+0000","last_fullsized":"2024-09-17T03:37:00.219239+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:39.093916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660231+0000","last_change":"2024-09-17T03:36:58.604411+0000","last_active":"2024-09-17T03:37:00.660231+0000","last_peered":"2024-09-17T03:37:00.660231+0000","last_clean":"2024-09-17T03:37:00.660231+0000","last_became_active":"2024-09-17T03:36:58.604012+0000","last_became_peered":"2024-09-17T03:36:58.604012+0000","last_unstale":"2024-09-17T03:37:00.660231+0000","last_undegraded":"2024-09-17T03:37:00.660231+0000","last_fullsized":"2024-09-17T03:37:00.660231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:54.567723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600428+0000","last_change":"2024-09-17T03:36:57.596267+0000","last_active":"2024-09-17T03:36:59.600428+0000","last_peered":"2024-09-17T03:36:59.600428+0000","last_clean":"2024-09-17T03:36:59.600428+0000","last_became_active":"2024-09-17T03:36:57.595964+0000","last_became_peered":"2024-09-17T03:36:57.595964+0000","last_unstale":"2024-09-17T03:36:59.600428+0000","last_undegraded":"2024-09-17T03:36:59.600428+0000","last_fullsized":"2024-09-17T03:36:59.600428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:52.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600165+0000","last_change":"2024-09-17T03:36:58.613987+0000","last_active":"2024-09-17T03:36:59.600165+0000","last_peered":"2024-09-17T03:36:59.600165+0000","last_clean":"2024-09-17T03:36:59.600165+0000","last_became_active":"2024-09-17T03:36:58.612963+0000","last_became_peered":"2024-09-17T03:36:58.612963+0000","last_unstale":"2024-09-17T03:36:59.600165+0000","last_undegraded":"2024-09-17T03:36:59.600165+0000","last_fullsized":"2024-09-17T03:36:59.600165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:21.699680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659806+0000","last_change":"2024-09-17T03:36:57.587577+0000","last_active":"2024-09-17T03:37:00.659806+0000","last_peered":"2024-09-17T03:37:00.659806+0000","last_clean":"2024-09-17T03:37:00.659806+0000","last_became_active":"2024-09-17T03:36:57.587300+0000","last_became_peered":"2024-09-17T03:36:57.587300+0000","last_unstale":"2024-09-17T03:37:00.659806+0000","last_undegraded":"2024-09-17T03:37:00.659806+0000","last_fullsized":"2024-09-17T03:37:00.659806+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:36.106844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660064+0000","last_change":"2024-09-17T03:36:58.606960+0000","last_active":"2024-09-17T03:37:00.660064+0000","last_peered":"2024-09-17T03:37:00.660064+0000","last_clean":"2024-09-17T03:37:00.660064+0000","last_became_active":"2024-09-17T03:36:58.606534+0000","last_became_peered":"2024-09-17T03:36:58.606534+0000","last_unstale":"2024-09-17T03:37:00.660064+0000","last_undegraded":"2024-09-17T03:37:00.660064+0000","last_fullsized":"2024-09-17T03:37:00.660064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:05.922316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600898+0000","last_change":"2024-09-17T03:36:57.583631+0000","last_active":"2024-09-17T03:36:59.600898+0000","last_peered":"2024-09-17T03:36:59.600898+0000","last_clean":"2024-09-17T03:36:59.600898+0000","last_became_active":"2024-09-17T03:36:57.583303+0000","last_became_peered":"2024-09-17T03:36:57.583303+0000","last_unstale":"2024-09-17T03:36:59.600898+0000","last_undegraded":"2024-09-17T03:36:59.600898+0000","last_fullsized":"2024-09-17T03:36:59.600898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:52.808091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659901+0000","last_change":"2024-09-17T03:36:58.608223+0000","last_active":"2024-09-17T03:37:00.659901+0000","last_peered":"2024-09-17T03:37:00.659901+0000","last_clean":"2024-09-17T03:37:00.659901+0000","last_became_active":"2024-09-17T03:36:58.607909+0000","last_became_peered":"2024-09-17T03:36:58.607909+0000","last_unstale":"2024-09-17T03:37:00.659901+0000","last_undegraded":"2024-09-17T03:37:00.659901+0000","last_fullsized":"2024-09-17T03:37:00.659901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:39.249255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600522+0000","last_change":"2024-09-17T03:36:57.594639+0000","last_active":"2024-09-17T03:36:59.600522+0000","last_peered":"2024-09-17T03:36:59.600522+0000","last_clean":"2024-09-17T03:36:59.600522+0000","last_became_active":"2024-09-17T03:36:57.594225+0000","last_became_peered":"2024-09-17T03:36:57.594225+0000","last_unstale":"2024-09-17T03:36:59.600522+0000","last_undegraded":"2024-09-17T03:36:59.600522+0000","last_fullsized":"2024-09-17T03:36:59.600522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.745067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599577+0000","last_change":"2024-09-17T03:36:58.612756+0000","last_active":"2024-09-17T03:36:59.599577+0000","last_peered":"2024-09-17T03:36:59.599577+0000","last_clean":"2024-09-17T03:36:59.599577+0000","last_became_active":"2024-09-17T03:36:58.612422+0000","last_became_peered":"2024-09-17T03:36:58.612422+0000","last_unstale":"2024-09-17T03:36:59.599577+0000","last_undegraded":"2024-09-17T03:36:59.599577+0000","last_fullsized":"2024-09-17T03:36:59.599577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:56.105275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599989+0000","last_change":"2024-09-17T03:36:57.582416+0000","last_active":"2024-09-17T03:36:59.599989+0000","last_peered":"2024-09-17T03:36:59.599989+0000","last_clean":"2024-09-17T03:36:59.599989+0000","last_became_active":"2024-09-17T03:36:57.582075+0000","last_became_peered":"2024-09-17T03:36:57.582075+0000","last_unstale":"2024-09-17T03:36:59.599989+0000","last_undegraded":"2024-09-17T03:36:59.599989+0000","last_fullsized":"2024-09-17T03:36:59.599989+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:39.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.603978+0000","last_change":"2024-09-17T03:36:58.614063+0000","last_active":"2024-09-17T03:37:00.603978+0000","last_peered":"2024-09-17T03:37:00.603978+0000","last_clean":"2024-09-17T03:37:00.603978+0000","last_became_active":"2024-09-17T03:36:58.613765+0000","last_became_peered":"2024-09-17T03:36:58.613765+0000","last_unstale":"2024-09-17T03:37:00.603978+0000","last_undegraded":"2024-09-17T03:37:00.603978+0000","last_fullsized":"2024-09-17T03:37:00.603978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:20.837938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600776+0000","last_change":"2024-09-17T03:36:57.592819+0000","last_active":"2024-09-17T03:36:59.600776+0000","last_peered":"2024-09-17T03:36:59.600776+0000","last_clean":"2024-09-17T03:36:59.600776+0000","last_became_active":"2024-09-17T03:36:57.592526+0000","last_became_peered":"2024-09-17T03:36:57.592526+0000","last_unstale":"2024-09-17T03:36:59.600776+0000","last_undegraded":"2024-09-17T03:36:59.600776+0000","last_fullsized":"2024-09-17T03:36:59.600776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:47.878879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659689+0000","last_change":"2024-09-17T03:36:58.615101+0000","last_active":"2024-09-17T03:37:00.659689+0000","last_peered":"2024-09-17T03:37:00.659689+0000","last_clean":"2024-09-17T03:37:00.659689+0000","last_became_active":"2024-09-17T03:36:58.614759+0000","last_became_peered":"2024-09-17T03:36:58.614759+0000","last_unstale":"2024-09-17T03:37:00.659689+0000","last_undegraded":"2024-09-17T03:37:00.659689+0000","last_fullsized":"2024-09-17T03:37:00.659689+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:15.518372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.218720+0000","last_change":"2024-09-17T03:36:57.590811+0000","last_active":"2024-09-17T03:37:00.218720+0000","last_peered":"2024-09-17T03:37:00.218720+0000","last_clean":"2024-09-17T03:37:00.218720+0000","last_became_active":"2024-09-17T03:36:57.590493+0000","last_became_peered":"2024-09-17T03:36:57.590493+0000","last_unstale":"2024-09-17T03:37:00.218720+0000","last_undegraded":"2024-09-17T03:37:00.218720+0000","last_fullsized":"2024-09-17T03:37:00.218720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:36.950013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.219247+0000","last_change":"2024-09-17T03:36:58.603205+0000","last_active":"2024-09-17T03:37:00.219247+0000","last_peered":"2024-09-17T03:37:00.219247+0000","last_clean":"2024-09-17T03:37:00.219247+0000","last_became_active":"2024-09-17T03:36:58.602879+0000","last_became_peered":"2024-09-17T03:36:58.602879+0000","last_unstale":"2024-09-17T03:37:00.219247+0000","last_undegraded":"2024-09-17T03:37:00.219247+0000","last_fullsized":"2024-09-17T03:37:00.219247+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:46.257503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599911+0000","last_change":"2024-09-17T03:36:57.591724+0000","last_active":"2024-09-17T03:36:59.599911+0000","last_peered":"2024-09-17T03:36:59.599911+0000","last_clean":"2024-09-17T03:36:59.599911+0000","last_became_active":"2024-09-17T03:36:57.591423+0000","last_became_peered":"2024-09-17T03:36:57.591423+0000","last_unstale":"2024-09-17T03:36:59.599911+0000","last_undegraded":"2024-09-17T03:36:59.599911+0000","last_fullsized":"2024-09-17T03:36:59.599911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:47.502370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660544+0000","last_change":"2024-09-17T03:36:58.606423+0000","last_active":"2024-09-17T03:37:00.660544+0000","last_peered":"2024-09-17T03:37:00.660544+0000","last_clean":"2024-09-17T03:37:00.660544+0000","last_became_active":"2024-09-17T03:36:58.606054+0000","last_became_peered":"2024-09-17T03:36:58.606054+0000","last_unstale":"2024-09-17T03:37:00.660544+0000","last_undegraded":"2024-09-17T03:37:00.660544+0000","last_fullsized":"2024-09-17T03:37:00.660544+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:13.864593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.219375+0000","last_change":"2024-09-17T03:36:57.584163+0000","last_active":"2024-09-17T03:37:00.219375+0000","last_peered":"2024-09-17T03:37:00.219375+0000","last_clean":"2024-09-17T03:37:00.219375+0000","last_became_active":"2024-09-17T03:36:57.583706+0000","last_became_peered":"2024-09-17T03:36:57.583706+0000","last_unstale":"2024-09-17T03:37:00.219375+0000","last_undegraded":"2024-09-17T03:37:00.219375+0000","last_fullsized":"2024-09-17T03:37:00.219375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:12.542540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600894+0000","last_change":"2024-09-17T03:36:58.603373+0000","last_active":"2024-09-17T03:36:59.600894+0000","last_peered":"2024-09-17T03:36:59.600894+0000","last_clean":"2024-09-17T03:36:59.600894+0000","last_became_active":"2024-09-17T03:36:58.602742+0000","last_became_peered":"2024-09-17T03:36:58.602742+0000","last_unstale":"2024-09-17T03:36:59.600894+0000","last_undegraded":"2024-09-17T03:36:59.600894+0000","last_fullsized":"2024-09-17T03:36:59.600894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:40.538161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599908+0000","last_change":"2024-09-17T03:36:57.597237+0000","last_active":"2024-09-17T03:36:59.599908+0000","last_peered":"2024-09-17T03:36:59.599908+0000","last_clean":"2024-09-17T03:36:59.599908+0000","last_became_active":"2024-09-17T03:36:57.596927+0000","last_became_peered":"2024-09-17T03:36:57.596927+0000","last_unstale":"2024-09-17T03:36:59.599908+0000","last_undegraded":"2024-09-17T03:36:59.599908+0000","last_fullsized":"2024-09-17T03:36:59.599908+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:45.348233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660289+0000","last_change":"2024-09-17T03:36:58.615051+0000","last_active":"2024-09-17T03:37:00.660289+0000","last_peered":"2024-09-17T03:37:00.660289+0000","last_clean":"2024-09-17T03:37:00.660289+0000","last_became_active":"2024-09-17T03:36:58.614727+0000","last_became_peered":"2024-09-17T03:36:58.614727+0000","last_unstale":"2024-09-17T03:37:00.660289+0000","last_undegraded":"2024-09-17T03:37:00.660289+0000","last_fullsized":"2024-09-17T03:37:00.660289+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:00.150099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660028+0000","last_change":"2024-09-17T03:36:57.592743+0000","last_active":"2024-09-17T03:37:00.660028+0000","last_peered":"2024-09-17T03:37:00.660028+0000","last_clean":"2024-09-17T03:37:00.660028+0000","last_became_active":"2024-09-17T03:36:57.592410+0000","last_became_peered":"2024-09-17T03:36:57.592410+0000","last_unstale":"2024-09-17T03:37:00.660028+0000","last_undegraded":"2024-09-17T03:37:00.660028+0000","last_fullsized":"2024-09-17T03:37:00.660028+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:37.445030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660362+0000","last_change":"2024-09-17T03:36:58.611912+0000","last_active":"2024-09-17T03:37:00.660362+0000","last_peered":"2024-09-17T03:37:00.660362+0000","last_clean":"2024-09-17T03:37:00.660362+0000","last_became_active":"2024-09-17T03:36:58.611607+0000","last_became_peered":"2024-09-17T03:36:58.611607+0000","last_unstale":"2024-09-17T03:37:00.660362+0000","last_undegraded":"2024-09-17T03:37:00.660362+0000","last_fullsized":"2024-09-17T03:37:00.660362+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:24.479041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600557+0000","last_change":"2024-09-17T03:36:57.589575+0000","last_active":"2024-09-17T03:36:59.600557+0000","last_peered":"2024-09-17T03:36:59.600557+0000","last_clean":"2024-09-17T03:36:59.600557+0000","last_became_active":"2024-09-17T03:36:57.589106+0000","last_became_peered":"2024-09-17T03:36:57.589106+0000","last_unstale":"2024-09-17T03:36:59.600557+0000","last_undegraded":"2024-09-17T03:36:59.600557+0000","last_fullsized":"2024-09-17T03:36:59.600557+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.745067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659525+0000","last_change":"2024-09-17T03:36:58.607183+0000","last_active":"2024-09-17T03:37:00.659525+0000","last_peered":"2024-09-17T03:37:00.659525+0000","last_clean":"2024-09-17T03:37:00.659525+0000","last_became_active":"2024-09-17T03:36:58.606205+0000","last_became_peered":"2024-09-17T03:36:58.606205+0000","last_unstale":"2024-09-17T03:37:00.659525+0000","last_undegraded":"2024-09-17T03:37:00.659525+0000","last_fullsized":"2024-09-17T03:37:00.659525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:21.411340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600996+0000","last_change":"2024-09-17T03:36:57.596093+0000","last_active":"2024-09-17T03:36:59.600996+0000","last_peered":"2024-09-17T03:36:59.600996+0000","last_clean":"2024-09-17T03:36:59.600996+0000","last_became_active":"2024-09-17T03:36:57.595632+0000","last_became_peered":"2024-09-17T03:36:57.595632+0000","last_unstale":"2024-09-17T03:36:59.600996+0000","last_undegraded":"2024-09-17T03:36:59.600996+0000","last_fullsized":"2024-09-17T03:36:59.600996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:37.258173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659608+0000","last_change":"2024-09-17T03:36:58.605976+0000","last_active":"2024-09-17T03:37:00.659608+0000","last_peered":"2024-09-17T03:37:00.659608+0000","last_clean":"2024-09-17T03:37:00.659608+0000","last_became_active":"2024-09-17T03:36:58.605684+0000","last_became_peered":"2024-09-17T03:36:58.605684+0000","last_unstale":"2024-09-17T03:37:00.659608+0000","last_undegraded":"2024-09-17T03:37:00.659608+0000","last_fullsized":"2024-09-17T03:37:00.659608+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:44.626056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.603798+0000","last_change":"2024-09-17T03:36:57.588964+0000","last_active":"2024-09-17T03:37:00.603798+0000","last_peered":"2024-09-17T03:37:00.603798+0000","last_clean":"2024-09-17T03:37:00.603798+0000","last_became_active":"2024-09-17T03:36:57.588619+0000","last_became_peered":"2024-09-17T03:36:57.588619+0000","last_unstale":"2024-09-17T03:37:00.603798+0000","last_undegraded":"2024-09-17T03:37:00.603798+0000","last_fullsized":"2024-09-17T03:37:00.603798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:47.054594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.604372+0000","last_change":"2024-09-17T03:36:58.602742+0000","last_active":"2024-09-17T03:37:00.604372+0000","last_peered":"2024-09-17T03:37:00.604372+0000","last_clean":"2024-09-17T03:37:00.604372+0000","last_became_active":"2024-09-17T03:36:58.602421+0000","last_became_peered":"2024-09-17T03:36:58.602421+0000","last_unstale":"2024-09-17T03:37:00.604372+0000","last_undegraded":"2024-09-17T03:37:00.604372+0000","last_fullsized":"2024-09-17T03:37:00.604372+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:53.885195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600050+0000","last_change":"2024-09-17T03:36:57.590905+0000","last_active":"2024-09-17T03:36:59.600050+0000","last_peered":"2024-09-17T03:36:59.600050+0000","last_clean":"2024-09-17T03:36:59.600050+0000","last_became_active":"2024-09-17T03:36:57.590517+0000","last_became_peered":"2024-09-17T03:36:57.590517+0000","last_unstale":"2024-09-17T03:36:59.600050+0000","last_undegraded":"2024-09-17T03:36:59.600050+0000","last_fullsized":"2024-09-17T03:36:59.600050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:24.906768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600048+0000","last_change":"2024-09-17T03:36:58.606404+0000","last_active":"2024-09-17T03:36:59.600048+0000","last_peered":"2024-09-17T03:36:59.600048+0000","last_clean":"2024-09-17T03:36:59.600048+0000","last_became_active":"2024-09-17T03:36:58.606065+0000","last_became_peered":"2024-09-17T03:36:58.606065+0000","last_unstale":"2024-09-17T03:36:59.600048+0000","last_undegraded":"2024-09-17T03:36:59.600048+0000","last_fullsized":"2024-09-17T03:36:59.600048+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:00.449441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"73'1","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.601249+0000","last_change":"2024-09-17T03:36:57.593712+0000","last_active":"2024-09-17T03:36:59.601249+0000","last_peered":"2024-09-17T03:36:59.601249+0000","last_clean":"2024-09-17T03:36:59.601249+0000","last_became_active":"2024-09-17T03:36:57.593387+0000","last_became_peered":"2024-09-17T03:36:57.593387+0000","last_unstale":"2024-09-17T03:36:59.601249+0000","last_undegraded":"2024-09-17T03:36:59.601249+0000","last_fullsized":"2024-09-17T03:36:59.601249+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:13.300120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659977+0000","last_change":"2024-09-17T03:36:58.616039+0000","last_active":"2024-09-17T03:37:00.659977+0000","last_peered":"2024-09-17T03:37:00.659977+0000","last_clean":"2024-09-17T03:37:00.659977+0000","last_became_active":"2024-09-17T03:36:58.615707+0000","last_became_peered":"2024-09-17T03:36:58.615707+0000","last_unstale":"2024-09-17T03:37:00.659977+0000","last_undegraded":"2024-09-17T03:37:00.659977+0000","last_fullsized":"2024-09-17T03:37:00.659977+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:42.074873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660458+0000","last_change":"2024-09-17T03:36:57.585618+0000","last_active":"2024-09-17T03:37:00.660458+0000","last_peered":"2024-09-17T03:37:00.660458+0000","last_clean":"2024-09-17T03:37:00.660458+0000","last_became_active":"2024-09-17T03:36:57.585282+0000","last_became_peered":"2024-09-17T03:36:57.585282+0000","last_unstale":"2024-09-17T03:37:00.660458+0000","last_undegraded":"2024-09-17T03:37:00.660458+0000","last_fullsized":"2024-09-17T03:37:00.660458+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:48.269513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660336+0000","last_change":"2024-09-17T03:36:58.608926+0000","last_active":"2024-09-17T03:37:00.660336+0000","last_peered":"2024-09-17T03:37:00.660336+0000","last_clean":"2024-09-17T03:37:00.660336+0000","last_became_active":"2024-09-17T03:36:58.608553+0000","last_became_peered":"2024-09-17T03:36:58.608553+0000","last_unstale":"2024-09-17T03:37:00.660336+0000","last_undegraded":"2024-09-17T03:37:00.660336+0000","last_fullsized":"2024-09-17T03:37:00.660336+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:48.122317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.604089+0000","last_change":"2024-09-17T03:36:57.586327+0000","last_active":"2024-09-17T03:37:00.604089+0000","last_peered":"2024-09-17T03:37:00.604089+0000","last_clean":"2024-09-17T03:37:00.604089+0000","last_became_active":"2024-09-17T03:36:57.586003+0000","last_became_peered":"2024-09-17T03:36:57.586003+0000","last_unstale":"2024-09-17T03:37:00.604089+0000","last_undegraded":"2024-09-17T03:37:00.604089+0000","last_fullsized":"2024-09-17T03:37:00.604089+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:12.716534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659914+0000","last_change":"2024-09-17T03:36:58.616301+0000","last_active":"2024-09-17T03:37:00.659914+0000","last_peered":"2024-09-17T03:37:00.659914+0000","last_clean":"2024-09-17T03:37:00.659914+0000","last_became_active":"2024-09-17T03:36:58.615909+0000","last_became_peered":"2024-09-17T03:36:58.615909+0000","last_unstale":"2024-09-17T03:37:00.659914+0000","last_undegraded":"2024-09-17T03:37:00.659914+0000","last_fullsized":"2024-09-17T03:37:00.659914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:14.878225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660109+0000","last_change":"2024-09-17T03:36:57.591187+0000","last_active":"2024-09-17T03:37:00.660109+0000","last_peered":"2024-09-17T03:37:00.660109+0000","last_clean":"2024-09-17T03:37:00.660109+0000","last_became_active":"2024-09-17T03:36:57.590899+0000","last_became_peered":"2024-09-17T03:36:57.590899+0000","last_unstale":"2024-09-17T03:37:00.660109+0000","last_undegraded":"2024-09-17T03:37:00.660109+0000","last_fullsized":"2024-09-17T03:37:00.660109+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:02.492050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599500+0000","last_change":"2024-09-17T03:36:58.608391+0000","last_active":"2024-09-17T03:36:59.599500+0000","last_peered":"2024-09-17T03:36:59.599500+0000","last_clean":"2024-09-17T03:36:59.599500+0000","last_became_active":"2024-09-17T03:36:58.608055+0000","last_became_peered":"2024-09-17T03:36:58.608055+0000","last_unstale":"2024-09-17T03:36:59.599500+0000","last_undegraded":"2024-09-17T03:36:59.599500+0000","last_fullsized":"2024-09-17T03:36:59.599500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:09.599283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600351+0000","last_change":"2024-09-17T03:36:57.590878+0000","last_active":"2024-09-17T03:36:59.600351+0000","last_peered":"2024-09-17T03:36:59.600351+0000","last_clean":"2024-09-17T03:36:59.600351+0000","last_became_active":"2024-09-17T03:36:57.590524+0000","last_became_peered":"2024-09-17T03:36:57.590524+0000","last_unstale":"2024-09-17T03:36:59.600351+0000","last_undegraded":"2024-09-17T03:36:59.600351+0000","last_fullsized":"2024-09-17T03:36:59.600351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:39.909044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600526+0000","last_change":"2024-09-17T03:36:58.608629+0000","last_active":"2024-09-17T03:36:59.600526+0000","last_peered":"2024-09-17T03:36:59.600526+0000","last_clean":"2024-09-17T03:36:59.600526+0000","last_became_active":"2024-09-17T03:36:58.608327+0000","last_became_peered":"2024-09-17T03:36:58.608327+0000","last_unstale":"2024-09-17T03:36:59.600526+0000","last_undegraded":"2024-09-17T03:36:59.600526+0000","last_fullsized":"2024-09-17T03:36:59.600526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:08.826637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.218642+0000","last_change":"2024-09-17T03:36:57.594939+0000","last_active":"2024-09-17T03:37:00.218642+0000","last_peered":"2024-09-17T03:37:00.218642+0000","last_clean":"2024-09-17T03:37:00.218642+0000","last_became_active":"2024-09-17T03:36:57.594242+0000","last_became_peered":"2024-09-17T03:36:57.594242+0000","last_unstale":"2024-09-17T03:37:00.218642+0000","last_undegraded":"2024-09-17T03:37:00.218642+0000","last_fullsized":"2024-09-17T03:37:00.218642+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:07.090365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599632+0000","last_change":"2024-09-17T03:36:58.609686+0000","last_active":"2024-09-17T03:36:59.599632+0000","last_peered":"2024-09-17T03:36:59.599632+0000","last_clean":"2024-09-17T03:36:59.599632+0000","last_became_active":"2024-09-17T03:36:58.609366+0000","last_became_peered":"2024-09-17T03:36:58.609366+0000","last_unstale":"2024-09-17T03:36:59.599632+0000","last_undegraded":"2024-09-17T03:36:59.599632+0000","last_fullsized":"2024-09-17T03:36:59.599632+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:58.994585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.600286+0000","last_change":"2024-09-17T03:36:57.593661+0000","last_active":"2024-09-17T03:36:59.600286+0000","last_peered":"2024-09-17T03:36:59.600286+0000","last_clean":"2024-09-17T03:36:59.600286+0000","last_became_active":"2024-09-17T03:36:57.593336+0000","last_became_peered":"2024-09-17T03:36:57.593336+0000","last_unstale":"2024-09-17T03:36:59.600286+0000","last_undegraded":"2024-09-17T03:36:59.600286+0000","last_fullsized":"2024-09-17T03:36:59.600286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:20.210252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.660022+0000","last_change":"2024-09-17T03:36:58.605957+0000","last_active":"2024-09-17T03:37:00.660022+0000","last_peered":"2024-09-17T03:37:00.660022+0000","last_clean":"2024-09-17T03:37:00.660022+0000","last_became_active":"2024-09-17T03:36:58.605530+0000","last_became_peered":"2024-09-17T03:36:58.605530+0000","last_unstale":"2024-09-17T03:37:00.660022+0000","last_undegraded":"2024-09-17T03:37:00.660022+0000","last_fullsized":"2024-09-17T03:37:00.660022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:57.567087+0000","last_clean_scrub_stamp":"2024-09-17T03:36:57.567087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:23.438911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:36:59.599356+0000","last_change":"2024-09-17T03:36:57.593881+0000","last_active":"2024-09-17T03:36:59.599356+0000","last_peered":"2024-09-17T03:36:59.599356+0000","last_clean":"2024-09-17T03:36:59.599356+0000","last_became_active":"2024-09-17T03:36:57.593412+0000","last_became_peered":"2024-09-17T03:36:57.593412+0000","last_unstale":"2024-09-17T03:36:59.599356+0000","last_undegraded":"2024-09-17T03:36:59.599356+0000","last_fullsized":"2024-09-17T03:36:59.599356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:36:56.561931+0000","last_clean_scrub_stamp":"2024-09-17T03:36:56.561931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:52.808091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":206,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-17T03:37:00.659725+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:37:00.659725+0000","last_peered":"2024-09-17T03:37:00.659725+0000","last_clean":"2024-09-17T03:37:00.659725+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:37:00.659725+0000","last_undegraded":"2024-09-17T03:37:00.659725+0000","last_fullsized":"2024-09-17T03:37:00.659725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36800,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335040,"statfs":{"total":96636764160,"available":96599080960,"internally_reserved":0,"allocated":1482752,"data_stored":966838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36216,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335624,"statfs":{"total":96636764160,"available":96599678976,"internally_reserved":0,"allocated":888832,"data_stored":375946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40376,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331464,"statfs":{"total":96636764160,"available":96595419136,"internally_reserved":0,"allocated":884736,"data_stored":375924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36224,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335616,"statfs":{"total":96636764160,"available":96599670784,"internally_reserved":0,"allocated":892928,"data_stored":377466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36236,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335604,"statfs":{"total":96636764160,"available":96599658496,"internally_reserved":0,"allocated":901120,"data_stored":378082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1474560,"data_stored":966222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36216,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335624,"statfs":{"total":96636764160,"available":96599678976,"internally_reserved":0,"allocated":884736,"data_stored":375944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40380,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331460,"statfs":{"total":96636764160,"available":96595415040,"internally_reserved":0,"allocated":888832,"data_stored":375966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:07.399 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:37:07.399 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:37:07.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.555+0000 7f32f805c640 1 -- 172.21.15.146:0/1303533092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f0069410 msgr2=0x7f32f00b7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.555+0000 7f32f805c640 1 --2- 172.21.15.146:0/1303533092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f0069410 0x7f32f00b7e90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009830 tx=0x7f32e002a510 comp rx=0 tx=0).stop 2024-09-17T03:37:07.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.555+0000 7f32f805c640 1 -- 172.21.15.146:0/1303533092 shutdown_connections 2024-09-17T03:37:07.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.555+0000 7f32f805c640 1 --2- 172.21.15.146:0/1303533092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f015eda0 0x7f32f00b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.555+0000 7f32f805c640 1 --2- 172.21.15.146:0/1303533092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f0069410 0x7f32f00b7e90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.555+0000 7f32f805c640 1 -- 172.21.15.146:0/1303533092 >> 172.21.15.146:0/1303533092 conn(0x7f32f006d070 msgr2=0x7f32f006d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:07.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.556+0000 7f32f805c640 1 -- 172.21.15.146:0/1303533092 shutdown_connections 2024-09-17T03:37:07.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.556+0000 7f32f805c640 1 -- 172.21.15.146:0/1303533092 wait complete. 2024-09-17T03:37:07.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.557+0000 7f32f805c640 1 Processor -- start 2024-09-17T03:37:07.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.557+0000 7f32f805c640 1 -- start start 2024-09-17T03:37:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f805c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f00d2330 0x7f32f014d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f805c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f015eda0 0x7f32f014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f805c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f01501f0 0x7f32f0150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f805c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00b8a90 con 0x7f32f00d2330 2024-09-17T03:37:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f805c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00b8910 con 0x7f32f015eda0 2024-09-17T03:37:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f805c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f32f00b8c10 con 0x7f32f01501f0 2024-09-17T03:37:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f5df8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f00d2330 0x7f32f014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f5df8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f00d2330 0x7f32f014d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37734/0 (socket says 172.21.15.146:37734) 2024-09-17T03:37:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f5df8640 1 -- 172.21.15.146:0/942564840 learned_addr learned my addr 172.21.15.146:0/942564840 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f65f9640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f01501f0 0x7f32f0150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f55f7640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f015eda0 0x7f32f014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f5df8640 1 -- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f01501f0 msgr2=0x7f32f0150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f5df8640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f01501f0 0x7f32f0150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f5df8640 1 -- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f015eda0 msgr2=0x7f32f014fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f5df8640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f015eda0 0x7f32f014fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f5df8640 1 -- 172.21.15.146:0/942564840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f00c89c0 con 0x7f32f00d2330 2024-09-17T03:37:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f5df8640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f00d2330 0x7f32f014d330 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c3d0 tx=0x7f32ec00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32e67fc640 1 -- 172.21.15.146:0/942564840 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec011790 con 0x7f32f00d2330 2024-09-17T03:37:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32e67fc640 1 -- 172.21.15.146:0/942564840 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32ec017070 con 0x7f32f00d2330 2024-09-17T03:37:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f805c640 1 -- 172.21.15.146:0/942564840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f00c8ca0 con 0x7f32f00d2330 2024-09-17T03:37:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32e67fc640 1 -- 172.21.15.146:0/942564840 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec011cc0 con 0x7f32f00d2330 2024-09-17T03:37:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.559+0000 7f32f805c640 1 -- 172.21.15.146:0/942564840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f00ce080 con 0x7f32f00d2330 2024-09-17T03:37:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.560+0000 7f32f805c640 1 -- 172.21.15.146:0/942564840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f006a010 con 0x7f32f00d2330 2024-09-17T03:37:07.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.561+0000 7f32e67fc640 1 -- 172.21.15.146:0/942564840 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32ec01c460 con 0x7f32f00d2330 2024-09-17T03:37:07.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.562+0000 7f32e67fc640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f32d4078b90 0x7f32d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.562+0000 7f32e67fc640 1 -- 172.21.15.146:0/942564840 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f32ec09a9f0 con 0x7f32f00d2330 2024-09-17T03:37:07.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.562+0000 7f32f55f7640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f32d4078b90 0x7f32d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.563+0000 7f32f55f7640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f32d4078b90 0x7f32d407b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f32e0034000 tx=0x7f32e0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:07.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.566+0000 7f32e67fc640 1 -- 172.21.15.146:0/942564840 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f32ec062f50 con 0x7f32f00d2330 2024-09-17T03:37:07.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.806+0000 7f32f805c640 1 -- 172.21.15.146:0/942564840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f32f00ce2e0 con 0x7f32f00d2330 2024-09-17T03:37:07.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.809+0000 7f32e67fc640 1 -- 172.21.15.146:0/942564840 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f32ec062850 con 0x7f32f00d2330 2024-09-17T03:37:07.809 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:37:07.810 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:37:07.810 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:37:07.810 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:37:07.810 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:37:07.810 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:37:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.811+0000 7f32f805c640 1 -- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f32d4078b90 msgr2=0x7f32d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.811+0000 7f32f805c640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f32d4078b90 0x7f32d407b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f32e0034000 tx=0x7f32e0004730 comp rx=0 tx=0).stop 2024-09-17T03:37:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.811+0000 7f32f805c640 1 -- 172.21.15.146:0/942564840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f00d2330 msgr2=0x7f32f014d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.811+0000 7f32f805c640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f00d2330 0x7f32f014d330 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c3d0 tx=0x7f32ec00c890 comp rx=0 tx=0).stop 2024-09-17T03:37:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.811+0000 7f32f805c640 1 -- 172.21.15.146:0/942564840 shutdown_connections 2024-09-17T03:37:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.811+0000 7f32f805c640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f32d4078b90 0x7f32d407b0a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.811+0000 7f32f805c640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32f01501f0 0x7f32f0150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.811+0000 7f32f805c640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32f015eda0 0x7f32f014fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.811+0000 7f32f805c640 1 --2- 172.21.15.146:0/942564840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32f00d2330 0x7f32f014d330 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.811+0000 7f32f805c640 1 -- 172.21.15.146:0/942564840 >> 172.21.15.146:0/942564840 conn(0x7f32f006d070 msgr2=0x7f32f015f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.812+0000 7f32f805c640 1 -- 172.21.15.146:0/942564840 shutdown_connections 2024-09-17T03:37:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.812+0000 7f32f805c640 1 -- 172.21.15.146:0/942564840 wait complete. 2024-09-17T03:37:07.823 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:07.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.936+0000 7f3dd1238640 1 -- 172.21.15.146:0/2805594304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc0b5ce0 msgr2=0x7f3dcc0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.936+0000 7f3dd1238640 1 --2- 172.21.15.146:0/2805594304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc0b5ce0 0x7f3dcc0b1320 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc005fd0 tx=0x7f3dbc02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.936+0000 7f3dd1238640 1 -- 172.21.15.146:0/2805594304 shutdown_connections 2024-09-17T03:37:07.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.936+0000 7f3dd1238640 1 --2- 172.21.15.146:0/2805594304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dcc0b5750 0x7f3dcc0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.936+0000 7f3dd1238640 1 --2- 172.21.15.146:0/2805594304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc0b5ce0 0x7f3dcc0b1320 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.936+0000 7f3dd1238640 1 -- 172.21.15.146:0/2805594304 >> 172.21.15.146:0/2805594304 conn(0x7f3dcc0b7b20 msgr2=0x7f3dcc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:07.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.937+0000 7f3dd1238640 1 -- 172.21.15.146:0/2805594304 shutdown_connections 2024-09-17T03:37:07.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.937+0000 7f3dd1238640 1 -- 172.21.15.146:0/2805594304 wait complete. 2024-09-17T03:37:07.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.938+0000 7f3dd1238640 1 Processor -- start 2024-09-17T03:37:07.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.939+0000 7f3dd1238640 1 -- start start 2024-09-17T03:37:07.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dd1238640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dcc0b3b60 0x7f3dcc147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dd1238640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc0b5750 0x7f3dcc144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dd1238640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dcc0b5ce0 0x7f3dcc1f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dd1238640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc0b27b0 con 0x7f3dcc0b5750 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dd1238640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc15dd00 con 0x7f3dcc0b3b60 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dd1238640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3dcc0b2930 con 0x7f3dcc0b5ce0 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dc259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc0b5750 0x7f3dcc144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dc259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc0b5750 0x7f3dcc144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37742/0 (socket says 172.21.15.146:37742) 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dc259c640 1 -- 172.21.15.146:0/1526455990 learned_addr learned my addr 172.21.15.146:0/1526455990 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dcad9d640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dcc0b3b60 0x7f3dcc147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dcb59e640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dcc0b5ce0 0x7f3dcc1f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dc259c640 1 -- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dcc0b5ce0 msgr2=0x7f3dcc1f35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dc259c640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dcc0b5ce0 0x7f3dcc1f35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dc259c640 1 -- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dcc0b3b60 msgr2=0x7f3dcc147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.940+0000 7f3dc259c640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dcc0b3b60 0x7f3dcc147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.941+0000 7f3dc259c640 1 -- 172.21.15.146:0/1526455990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc1589f0 con 0x7f3dcc0b5750 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.941+0000 7f3dc259c640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc0b5750 0x7f3dcc144760 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3db400d6d0 tx=0x7f3db400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:07.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.941+0000 7f3dc3fff640 1 -- 172.21.15.146:0/1526455990 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4017070 con 0x7f3dcc0b5750 2024-09-17T03:37:07.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.941+0000 7f3dc3fff640 1 -- 172.21.15.146:0/1526455990 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3db4005330 con 0x7f3dcc0b5750 2024-09-17T03:37:07.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.941+0000 7f3dd1238640 1 -- 172.21.15.146:0/1526455990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dcc1f4290 con 0x7f3dcc0b5750 2024-09-17T03:37:07.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.941+0000 7f3dc3fff640 1 -- 172.21.15.146:0/1526455990 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4009820 con 0x7f3dcc0b5750 2024-09-17T03:37:07.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.941+0000 7f3dd1238640 1 -- 172.21.15.146:0/1526455990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dcc147480 con 0x7f3dcc0b5750 2024-09-17T03:37:07.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.942+0000 7f3dd1238640 1 -- 172.21.15.146:0/1526455990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dcc1f4000 con 0x7f3dcc0b5750 2024-09-17T03:37:07.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.943+0000 7f3dc3fff640 1 -- 172.21.15.146:0/1526455990 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3db40099c0 con 0x7f3dcc0b5750 2024-09-17T03:37:07.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.943+0000 7f3dc3fff640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3dac078bc0 0x7f3dac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:07.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.943+0000 7f3dc3fff640 1 -- 172.21.15.146:0/1526455990 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f3db409adc0 con 0x7f3dcc0b5750 2024-09-17T03:37:07.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.944+0000 7f3dcad9d640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3dac078bc0 0x7f3dac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:07.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.944+0000 7f3dcad9d640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3dac078bc0 0x7f3dac07b0d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc033000 tx=0x7f3dbc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:07.948+0000 7f3dc3fff640 1 -- 172.21.15.146:0/1526455990 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3dcc1589f0 con 0x7f3dcc0b5750 2024-09-17T03:37:08.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.158+0000 7f3dd1238640 1 -- 172.21.15.146:0/1526455990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dcc0b2de0 con 0x7f3dcc0b5750 2024-09-17T03:37:08.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.159+0000 7f3dc3fff640 1 -- 172.21.15.146:0/1526455990 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5237 (secure 0 0 0) 0x7f3db4062b30 con 0x7f3dcc0b5750 2024-09-17T03:37:08.159 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:08.159 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":46,"btime":"2024-09-17T03:37:01:608193+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1279251216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1279251216},{"type":"v1","addr":"172.21.15.179:6836","nonce":1279251216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1852599543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1852599543},{"type":"v1","addr":"172.21.15.179:6837","nonce":1852599543}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3440108509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3440108509},{"type":"v1","addr":"172.21.15.146:6833","nonce":3440108509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:57.935632+0000","modified":"2024-09-17T03:37:00.965187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6855":{"gid":6855,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2258631125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2258631125},{"type":"v1","addr":"172.21.15.146:6835","nonce":2258631125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6855,"qdb_cluster":[6855]},"id":5}]} 2024-09-17T03:37:08.159 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 46 2024-09-17T03:37:08.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 -- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3dac078bc0 msgr2=0x7f3dac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3dac078bc0 0x7f3dac07b0d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc033000 tx=0x7f3dbc004730 comp rx=0 tx=0).stop 2024-09-17T03:37:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 -- 172.21.15.146:0/1526455990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc0b5750 msgr2=0x7f3dcc144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc0b5750 0x7f3dcc144760 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f3db400d6d0 tx=0x7f3db400db90 comp rx=0 tx=0).stop 2024-09-17T03:37:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 -- 172.21.15.146:0/1526455990 shutdown_connections 2024-09-17T03:37:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3dac078bc0 0x7f3dac07b0d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3dcc0b5ce0 0x7f3dcc1f35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dcc0b5750 0x7f3dcc144760 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 --2- 172.21.15.146:0/1526455990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3dcc0b3b60 0x7f3dcc147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 -- 172.21.15.146:0/1526455990 >> 172.21.15.146:0/1526455990 conn(0x7f3dcc0b7b20 msgr2=0x7f3dcc0b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 -- 172.21.15.146:0/1526455990 shutdown_connections 2024-09-17T03:37:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.161+0000 7f3dd1238640 1 -- 172.21.15.146:0/1526455990 wait complete. 2024-09-17T03:37:08.575 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:36:57.935632+0000', 'modified': '2024-09-17T03:37:00.965187+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6855}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6855': {'gid': 6855, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/2258631125', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2258631125}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2258631125}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6855, 'qdb_cluster': [6855]} 2024-09-17T03:37:08.576 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:37:08.576 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:37:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.690+0000 7f767896e640 1 -- 172.21.15.146:0/2627332311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7660003a00 msgr2=0x7f7660003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.690+0000 7f767896e640 1 --2- 172.21.15.146:0/2627332311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7660003a00 0x7f7660003e70 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7664009ed0 tx=0x7f7660005830 comp rx=0 tx=0).stop 2024-09-17T03:37:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.690+0000 7f7672d9d640 1 -- 172.21.15.146:0/2627332311 reap_dead start 2024-09-17T03:37:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.690+0000 7f767896e640 1 -- 172.21.15.146:0/2627332311 shutdown_connections 2024-09-17T03:37:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.690+0000 7f767896e640 1 -- 172.21.15.146:0/2627332311 >> 172.21.15.146:0/2627332311 conn(0x7f76740b7b20 msgr2=0x7f767409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.690+0000 7f767896e640 1 -- 172.21.15.146:0/2627332311 shutdown_connections 2024-09-17T03:37:08.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.690+0000 7f767896e640 1 -- 172.21.15.146:0/2627332311 wait complete. 2024-09-17T03:37:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.692+0000 7f767896e640 1 Processor -- start 2024-09-17T03:37:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.692+0000 7f767896e640 1 -- start start 2024-09-17T03:37:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f767896e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7660003a00 0x7f7674150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f767896e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7674141bd0 0x7f767415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f767896e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7674141fe0 0x7f767415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f767896e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f76740b1920 con 0x7f7674141bd0 2024-09-17T03:37:08.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f767896e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f76740b17a0 con 0x7f7660003a00 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f767896e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f767415cfe0 con 0x7f7674141fe0 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f7669d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7674141bd0 0x7f767415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f7669d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7674141bd0 0x7f767415e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37762/0 (socket says 172.21.15.146:37762) 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f7669d9b640 1 -- 172.21.15.146:0/166084221 learned_addr learned my addr 172.21.15.146:0/166084221 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f767259c640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7660003a00 0x7f7674150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f7672d9d640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7674141fe0 0x7f767415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f7669d9b640 1 -- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7674141fe0 msgr2=0x7f767415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f7669d9b640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7674141fe0 0x7f767415eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f7669d9b640 1 -- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7660003a00 msgr2=0x7f7674150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f7669d9b640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7660003a00 0x7f7674150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f7669d9b640 1 -- 172.21.15.146:0/166084221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76741574b0 con 0x7f7674141bd0 2024-09-17T03:37:08.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.694+0000 7f7669d9b640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7674141bd0 0x7f767415e570 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f765c00e5c0 tx=0x7f765c00ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.695+0000 7f766b7fe640 1 -- 172.21.15.146:0/166084221 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c015070 con 0x7f7674141bd0 2024-09-17T03:37:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.695+0000 7f766b7fe640 1 -- 172.21.15.146:0/166084221 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f765c00c9e0 con 0x7f7674141bd0 2024-09-17T03:37:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.695+0000 7f767896e640 1 -- 172.21.15.146:0/166084221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7674151970 con 0x7f7674141bd0 2024-09-17T03:37:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.695+0000 7f766b7fe640 1 -- 172.21.15.146:0/166084221 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c00ce10 con 0x7f7674141bd0 2024-09-17T03:37:08.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.695+0000 7f767896e640 1 -- 172.21.15.146:0/166084221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7674151f30 con 0x7f7674141bd0 2024-09-17T03:37:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.697+0000 7f766b7fe640 1 -- 172.21.15.146:0/166084221 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f765c018070 con 0x7f7674141bd0 2024-09-17T03:37:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.697+0000 7f766b7fe640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7654078bc0 0x7f765407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.697+0000 7f766b7fe640 1 -- 172.21.15.146:0/166084221 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f765c09b060 con 0x7f7674141bd0 2024-09-17T03:37:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.697+0000 7f767259c640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7654078bc0 0x7f765407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.698+0000 7f767f9bd740 1 Processor -- start 2024-09-17T03:37:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.698+0000 7f767259c640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7654078bc0 0x7f765407b0d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7664009ed0 tx=0x7f766402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.698+0000 7f767f9bd740 1 -- start start 2024-09-17T03:37:08.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.699+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b66209270 0x561b665dafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.699+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665db4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.699+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b665f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.699+0000 7f767f9bd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b66523820 con 0x561b661e03b0 2024-09-17T03:37:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.699+0000 7f767f9bd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561b66512c50 con 0x561b66209270 2024-09-17T03:37:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.699+0000 7f767f9bd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561b66516a60 con 0x561b661e8590 2024-09-17T03:37:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7669d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665db4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7669d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665db4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37764/0 (socket says 172.21.15.146:37764) 2024-09-17T03:37:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7669d9b640 1 -- 172.21.15.146:0/3574904435 learned_addr learned my addr 172.21.15.146:0/3574904435 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7672d9d640 1 --2- 172.21.15.146:0/3574904435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b665f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f767259c640 1 --2- 172.21.15.146:0/3574904435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b66209270 0x561b665dafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7669d9b640 1 -- 172.21.15.146:0/3574904435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 msgr2=0x561b665f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7669d9b640 1 --2- 172.21.15.146:0/3574904435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b665f83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7669d9b640 1 -- 172.21.15.146:0/3574904435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b66209270 msgr2=0x561b665dafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7669d9b640 1 --2- 172.21.15.146:0/3574904435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b66209270 0x561b665dafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7669d9b640 1 -- 172.21.15.146:0/3574904435 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b66274850 con 0x561b661e03b0 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7669d9b640 1 --2- 172.21.15.146:0/3574904435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665db4e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f765c0995b0 tx=0x7f765c062940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3ddb36cf103d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7653fff640 1 -- 172.21.15.146:0/3574904435 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c01f040 con 0x561b661e03b0 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7653fff640 1 -- 172.21.15.146:0/3574904435 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f765c0891d0 con 0x561b661e03b0 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.700+0000 7f7653fff640 1 -- 172.21.15.146:0/3574904435 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c062360 con 0x561b661e03b0 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.701+0000 7f767f9bd740 1 -- 172.21.15.146:0/3574904435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 msgr2=0x561b665db4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.701+0000 7f767f9bd740 1 --2- 172.21.15.146:0/3574904435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665db4e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f765c0995b0 tx=0x7f765c062940 comp rx=0 tx=0).stop 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.701+0000 7f767f9bd740 1 -- 172.21.15.146:0/3574904435 shutdown_connections 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.701+0000 7f767f9bd740 1 --2- 172.21.15.146:0/3574904435 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b665f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.701+0000 7f767f9bd740 1 --2- 172.21.15.146:0/3574904435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665db4e0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.701+0000 7f767f9bd740 1 --2- 172.21.15.146:0/3574904435 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b66209270 0x561b665dafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.701+0000 7f767f9bd740 1 -- 172.21.15.146:0/3574904435 >> 172.21.15.146:0/3574904435 conn(0x561b661fd3c0 msgr2=0x561b665b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.701+0000 7f767f9bd740 1 -- 172.21.15.146:0/3574904435 shutdown_connections 2024-09-17T03:37:08.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.701+0000 7f767f9bd740 1 -- 172.21.15.146:0/3574904435 wait complete. 2024-09-17T03:37:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.702+0000 7f767f9bd740 1 -- start start 2024-09-17T03:37:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.702+0000 7f767f9bd740 1 Processor -- start 2024-09-17T03:37:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b661e03b0 0x561b665ef960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e8590 0x561b66608070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b66209270 0x561b665ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767f9bd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b66283620 con 0x561b661e8590 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767f9bd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561b664b85f0 con 0x561b661e03b0 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767f9bd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561b665dba20 con 0x561b66209270 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767f9bd740 10 client.0 _ll_register_callbacks cb 0x561b664bc0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f7669d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e8590 0x561b66608070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f7669d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e8590 0x561b66608070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37772/0 (socket says 172.21.15.146:37772) 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f7669d9b640 1 -- 172.21.15.146:0/3011216466 learned_addr learned my addr 172.21.15.146:0/3011216466 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f7672d9d640 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b66209270 0x561b665ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767259c640 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b661e03b0 0x561b665ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f7669d9b640 1 -- 172.21.15.146:0/3011216466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b66209270 msgr2=0x561b665ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f7669d9b640 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b66209270 0x561b665ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f7669d9b640 1 -- 172.21.15.146:0/3011216466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b661e03b0 msgr2=0x561b665ef960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f7669d9b640 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b661e03b0 0x561b665ef960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f7669d9b640 1 -- 172.21.15.146:0/3011216466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b662eb6b0 con 0x561b661e8590 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767259c640 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b661e03b0 0x561b665ef960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f7669d9b640 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e8590 0x561b66608070 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f765c05f460 tx=0x7f765c0623f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab6b8e339714d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f76517fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f76517fa640 1 -- 172.21.15.146:0/3011216466 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c07d060 con 0x561b661e8590 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f76517fa640 1 -- 172.21.15.146:0/3011216466 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f765c04e310 con 0x561b661e8590 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767f9bd740 1 -- 172.21.15.146:0/3011216466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b66525770 con 0x561b661e8590 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f76517fa640 1 -- 172.21.15.146:0/3011216466 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f765c01f040 con 0x561b661e8590 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767f9bd740 10 client.7005 fetch_fsmap learned FSMap version 46 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.704+0000 7f767f9bd740 1 -- 172.21.15.146:0/3011216466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x561b665efea0 con 0x561b661e8590 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.705+0000 7f76517fa640 1 -- 172.21.15.146:0/3011216466 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561b66525770 con 0x561b661e8590 2024-09-17T03:37:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.705+0000 7f76517fa640 1 -- 172.21.15.146:0/3011216466 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f765c07e030 con 0x561b661e8590 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.705+0000 7f767f9bd740 10 client.7005 fetch_fsmap finished waiting for FSMap version 46 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.705+0000 7f767f9bd740 10 client.7005 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.705+0000 7f767f9bd740 20 client.7005 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.705+0000 7f767f9bd740 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.146:6834/2258631125,v1:172.21.15.146:6835/2258631125] conn(0x561b661c7e40 0x561b66604a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.705+0000 7f767f9bd740 4 client.7005 mds_command: new command op to 6855 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.705+0000 7f767f9bd740 1 -- 172.21.15.146:0/3011216466 --> [v2:172.21.15.146:6834/2258631125,v1:172.21.15.146:6835/2258631125] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b66521220 con 0x561b661c7e40 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.705+0000 7f767259c640 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.146:6834/2258631125,v1:172.21.15.146:6835/2258631125] conn(0x561b661c7e40 0x561b66604a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.705+0000 7f76517fa640 10 client.7005 ms_handle_connect on v2:172.21.15.146:6834/2258631125 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.705+0000 7f767259c640 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.146:6834/2258631125,v1:172.21.15.146:6835/2258631125] conn(0x561b661c7e40 0x561b66604a30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc332a32956519fb server_cookie=daca618f4e7012e5 in_seq=0 out_seq=0 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f76517fa640 1 -- 172.21.15.146:0/3011216466 <== mds.0 v2:172.21.15.146:6834/2258631125 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b66521220 con 0x561b661c7e40 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f76517fa640 10 client.7005 handle_command_reply: tid=0 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 1 client.7005 shutdown 2024-09-17T03:37:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 1 -- 172.21.15.146:0/3011216466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e8590 msgr2=0x561b66608070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e8590 0x561b66608070 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f765c05f460 tx=0x7f765c0623f0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 1 -- 172.21.15.146:0/3011216466 shutdown_connections 2024-09-17T03:37:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.146:6834/2258631125,v1:172.21.15.146:6835/2258631125] conn(0x561b661c7e40 0x561b66604a30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b66209270 0x561b665ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e8590 0x561b66608070 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f76517fa640 0 client.7005 ms_handle_reset on v2:172.21.15.146:6834/2258631125 2024-09-17T03:37:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 1 --2- 172.21.15.146:0/3011216466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b661e03b0 0x561b665ef960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 1 -- 172.21.15.146:0/3011216466 >> 172.21.15.146:0/3011216466 conn(0x561b661fd3c0 msgr2=0x561b665abb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 1 -- 172.21.15.146:0/3011216466 shutdown_connections 2024-09-17T03:37:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 1 -- 172.21.15.146:0/3011216466 wait complete. 2024-09-17T03:37:08.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.706+0000 7f767f9bd740 20 client.7005 trim_cache size 0 max 16384 2024-09-17T03:37:08.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.725+0000 7f767f9bd740 1 Processor -- start 2024-09-17T03:37:08.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.725+0000 7f767f9bd740 1 -- start start 2024-09-17T03:37:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b661e03b0 0x561b665b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b665b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b66209270 0x561b665f1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f767f9bd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f76741ff320 con 0x561b66209270 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f767f9bd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f76741f7320 con 0x561b661e03b0 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f767f9bd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f76741fecd0 con 0x561b661e8590 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f7672d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b66209270 0x561b665f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f7672d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b66209270 0x561b665f1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37776/0 (socket says 172.21.15.146:37776) 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f7672d9d640 1 -- 172.21.15.146:0/885718487 learned_addr learned my addr 172.21.15.146:0/885718487 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f7669d9b640 1 --2- 172.21.15.146:0/885718487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b665b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f767259c640 1 --2- 172.21.15.146:0/885718487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b661e03b0 0x561b665b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f7672d9d640 1 -- 172.21.15.146:0/885718487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 msgr2=0x561b665b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f7672d9d640 1 --2- 172.21.15.146:0/885718487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b665b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f7672d9d640 1 -- 172.21.15.146:0/885718487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b661e03b0 msgr2=0x561b665b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f7672d9d640 1 --2- 172.21.15.146:0/885718487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b661e03b0 0x561b665b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.726+0000 7f7672d9d640 1 -- 172.21.15.146:0/885718487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b665eed60 con 0x561b66209270 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f7672d9d640 1 --2- 172.21.15.146:0/885718487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b66209270 0x561b665f1000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f766c009be0 tx=0x7f766c013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32e5775a229c129 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f76537fe640 1 -- 172.21.15.146:0/885718487 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c023070 con 0x561b66209270 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f76537fe640 1 -- 172.21.15.146:0/885718487 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f766c004030 con 0x561b66209270 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f76537fe640 1 -- 172.21.15.146:0/885718487 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c004400 con 0x561b66209270 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f767f9bd740 1 -- 172.21.15.146:0/885718487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b66209270 msgr2=0x561b665f1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f767f9bd740 1 --2- 172.21.15.146:0/885718487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b66209270 0x561b665f1000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f766c009be0 tx=0x7f766c013830 comp rx=0 tx=0).stop 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f767f9bd740 1 -- 172.21.15.146:0/885718487 shutdown_connections 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f767f9bd740 1 --2- 172.21.15.146:0/885718487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b66209270 0x561b665f1000 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f767f9bd740 1 --2- 172.21.15.146:0/885718487 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b665b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f767f9bd740 1 --2- 172.21.15.146:0/885718487 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b661e03b0 0x561b665b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f767f9bd740 1 -- 172.21.15.146:0/885718487 >> 172.21.15.146:0/885718487 conn(0x561b661fd3c0 msgr2=0x561b665f2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.727+0000 7f767f9bd740 1 -- 172.21.15.146:0/885718487 shutdown_connections 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.728+0000 7f767f9bd740 1 -- 172.21.15.146:0/885718487 wait complete. 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.728+0000 7f767f9bd740 1 -- start start 2024-09-17T03:37:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.728+0000 7f767f9bd740 1 Processor -- start 2024-09-17T03:37:08.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665f5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b66678130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767f9bd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b66209270 0x561b665c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767f9bd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561b66283620 con 0x561b661e03b0 2024-09-17T03:37:08.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767f9bd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561b664b85f0 con 0x561b66209270 2024-09-17T03:37:08.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767f9bd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561b665cad40 con 0x561b661e8590 2024-09-17T03:37:08.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767f9bd740 10 client.0 _ll_register_callbacks cb 0x7f76600036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:08.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37784/0 (socket says 172.21.15.146:37784) 2024-09-17T03:37:08.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767259c640 1 -- 172.21.15.146:0/403037865 learned_addr learned my addr 172.21.15.146:0/403037865 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:08.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f7672d9d640 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b66209270 0x561b665c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f7669d9b640 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b66678130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767259c640 1 -- 172.21.15.146:0/403037865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 msgr2=0x561b66678130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767259c640 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b66678130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767259c640 1 -- 172.21.15.146:0/403037865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b66209270 msgr2=0x561b665c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767259c640 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b66209270 0x561b665c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767259c640 1 -- 172.21.15.146:0/403037865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b665ef950 con 0x561b661e03b0 2024-09-17T03:37:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f7672d9d640 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b66209270 0x561b665c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f7669d9b640 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b66678130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:08.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f767259c640 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665f5110 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7664009c40 tx=0x7f7664009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4435f428538a5820 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.730+0000 7f76517fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f76517fa640 1 -- 172.21.15.146:0/403037865 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664059060 con 0x561b661e03b0 2024-09-17T03:37:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f76517fa640 1 -- 172.21.15.146:0/403037865 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f7664033440 con 0x561b661e03b0 2024-09-17T03:37:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f767f9bd740 1 -- 172.21.15.146:0/403037865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f766c004030 con 0x561b661e03b0 2024-09-17T03:37:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f76517fa640 1 -- 172.21.15.146:0/403037865 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f766405f050 con 0x561b661e03b0 2024-09-17T03:37:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f767f9bd740 10 client.7011 fetch_fsmap learned FSMap version 46 2024-09-17T03:37:08.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f767f9bd740 1 -- 172.21.15.146:0/403037865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x561b665f5be0 con 0x561b661e03b0 2024-09-17T03:37:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f76517fa640 1 -- 172.21.15.146:0/403037865 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f766c004030 con 0x561b661e03b0 2024-09-17T03:37:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f76517fa640 1 -- 172.21.15.146:0/403037865 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f7664062020 con 0x561b661e03b0 2024-09-17T03:37:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f767f9bd740 10 client.7011 fetch_fsmap finished waiting for FSMap version 46 2024-09-17T03:37:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f767f9bd740 10 client.7011 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:37:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f767f9bd740 20 client.7011 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f767f9bd740 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.146:6834/2258631125,v1:172.21.15.146:6835/2258631125] conn(0x561b665f77b0 0x561b665f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f767f9bd740 4 client.7011 mds_command: new command op to 6855 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:37:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f767f9bd740 1 -- 172.21.15.146:0/403037865 --> [v2:172.21.15.146:6834/2258631125,v1:172.21.15.146:6835/2258631125] -- command(tid 0: {"prefix": "status"}) -- 0x561b6651e650 con 0x561b665f77b0 2024-09-17T03:37:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.731+0000 7f7669d9b640 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.146:6834/2258631125,v1:172.21.15.146:6835/2258631125] conn(0x561b665f77b0 0x561b665f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f76517fa640 10 client.7011 ms_handle_connect on v2:172.21.15.146:6834/2258631125 2024-09-17T03:37:08.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f7669d9b640 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.146:6834/2258631125,v1:172.21.15.146:6835/2258631125] conn(0x561b665f77b0 0x561b665f7bc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c9556574e5a6cd3 server_cookie=595badb3be65baf in_seq=0 out_seq=0 2024-09-17T03:37:08.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f76517fa640 1 -- 172.21.15.146:0/403037865 <== mds.0 v2:172.21.15.146:6834/2258631125 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x561b6651e650 con 0x561b665f77b0 2024-09-17T03:37:08.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f76517fa640 10 client.7011 handle_command_reply: tid=0 2024-09-17T03:37:08.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 1 client.7011 shutdown 2024-09-17T03:37:08.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 1 -- 172.21.15.146:0/403037865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 msgr2=0x561b665f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665f5110 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f7664009c40 tx=0x7f7664009500 comp rx=0 tx=0).stop 2024-09-17T03:37:08.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 1 -- 172.21.15.146:0/403037865 shutdown_connections 2024-09-17T03:37:08.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.146:6834/2258631125,v1:172.21.15.146:6835/2258631125] conn(0x561b665f77b0 0x561b665f7bc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561b66209270 0x561b665c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561b661e8590 0x561b66678130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f76517fa640 0 client.7011 ms_handle_reset on v2:172.21.15.146:6834/2258631125 2024-09-17T03:37:08.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 1 --2- 172.21.15.146:0/403037865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561b661e03b0 0x561b665f5110 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 1 -- 172.21.15.146:0/403037865 >> 172.21.15.146:0/403037865 conn(0x561b661fd3c0 msgr2=0x561b666188e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:08.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 1 -- 172.21.15.146:0/403037865 shutdown_connections 2024-09-17T03:37:08.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 1 -- 172.21.15.146:0/403037865 wait complete. 2024-09-17T03:37:08.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.732+0000 7f767f9bd740 20 client.7011 trim_cache size 0 max 16384 2024-09-17T03:37:08.746 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:37:08.747 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:37:08.747 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:37:08.747 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6855, 2024-09-17T03:37:08.747 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:37:08.748 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:37:08.748 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:37:08.748 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.137473914999999, 2024-09-17T03:37:08.748 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 46, 2024-09-17T03:37:08.748 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 73, 2024-09-17T03:37:08.748 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 73, 2024-09-17T03:37:08.748 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 14.827721708 2024-09-17T03:37:08.748 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:37:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 -- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7654078bc0 msgr2=0x7f765407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7654078bc0 0x7f765407b0d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7664009ed0 tx=0x7f766402d040 comp rx=0 tx=0).stop 2024-09-17T03:37:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 -- 172.21.15.146:0/166084221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7674141bd0 msgr2=0x7f767415e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7674141bd0 0x7f767415e570 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f765c00e5c0 tx=0x7f765c00ea80 comp rx=0 tx=0).stop 2024-09-17T03:37:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 -- 172.21.15.146:0/166084221 shutdown_connections 2024-09-17T03:37:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7654078bc0 0x7f765407b0d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7674141fe0 0x7f767415eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7674141bd0 0x7f767415e570 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 --2- 172.21.15.146:0/166084221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7660003a00 0x7f7674150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 -- 172.21.15.146:0/166084221 >> 172.21.15.146:0/166084221 conn(0x7f76740b7b20 msgr2=0x7f767415b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:08.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 -- 172.21.15.146:0/166084221 shutdown_connections 2024-09-17T03:37:08.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.733+0000 7f767896e640 1 -- 172.21.15.146:0/166084221 wait complete. 2024-09-17T03:37:08.751 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:37:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.864+0000 7f12ecd39640 1 -- 172.21.15.146:0/1078112224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80b3360 msgr2=0x7f12e8072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.864+0000 7f12ecd39640 1 --2- 172.21.15.146:0/1078112224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80b3360 0x7f12e8072df0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f12d8005fd0 tx=0x7f12d802b910 comp rx=0 tx=0).stop 2024-09-17T03:37:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.865+0000 7f12ecd39640 1 -- 172.21.15.146:0/1078112224 shutdown_connections 2024-09-17T03:37:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.865+0000 7f12ecd39640 1 --2- 172.21.15.146:0/1078112224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e815f1e0 0x7f12e81515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.865+0000 7f12ecd39640 1 --2- 172.21.15.146:0/1078112224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80b3360 0x7f12e8072df0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.865+0000 7f12ecd39640 1 -- 172.21.15.146:0/1078112224 >> 172.21.15.146:0/1078112224 conn(0x7f12e80b2060 msgr2=0x7f12e80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.865+0000 7f12ecd39640 1 -- 172.21.15.146:0/1078112224 shutdown_connections 2024-09-17T03:37:08.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.865+0000 7f12ecd39640 1 -- 172.21.15.146:0/1078112224 wait complete. 2024-09-17T03:37:08.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.867+0000 7f12ecd39640 1 Processor -- start 2024-09-17T03:37:08.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.867+0000 7f12ecd39640 1 -- start start 2024-09-17T03:37:08.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12ecd39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80b3360 0x7f12e814ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12ecd39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e80cfc40 0x7f12e8149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12ecd39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e814a7c0 0x7f12e815ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12ecd39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f12e806ea50 con 0x7f12e80b3360 2024-09-17T03:37:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12ecd39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12e806e8d0 con 0x7f12e814a7c0 2024-09-17T03:37:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12ecd39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f12e8151ae0 con 0x7f12e80cfc40 2024-09-17T03:37:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12e659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80b3360 0x7f12e814ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12e659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80b3360 0x7f12e814ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37794/0 (socket says 172.21.15.146:37794) 2024-09-17T03:37:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12e659c640 1 -- 172.21.15.146:0/94154285 learned_addr learned my addr 172.21.15.146:0/94154285 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12e5d9b640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e80cfc40 0x7f12e8149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12e6d9d640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e814a7c0 0x7f12e815ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12e659c640 1 -- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e80cfc40 msgr2=0x7f12e8149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12e659c640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e80cfc40 0x7f12e8149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12e659c640 1 -- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e814a7c0 msgr2=0x7f12e815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12e659c640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e814a7c0 0x7f12e815ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.868+0000 7f12e659c640 1 -- 172.21.15.146:0/94154285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e814a4c0 con 0x7f12e80b3360 2024-09-17T03:37:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.869+0000 7f12e659c640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80b3360 0x7f12e814ccb0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f12d8006010 tx=0x7f12d8004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.869+0000 7f12d6ffd640 1 -- 172.21.15.146:0/94154285 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d803f070 con 0x7f12e80b3360 2024-09-17T03:37:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.869+0000 7f12d6ffd640 1 -- 172.21.15.146:0/94154285 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12d8031610 con 0x7f12e80b3360 2024-09-17T03:37:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.869+0000 7f12ecd39640 1 -- 172.21.15.146:0/94154285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e81f4b90 con 0x7f12e80b3360 2024-09-17T03:37:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.869+0000 7f12d6ffd640 1 -- 172.21.15.146:0/94154285 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8031a40 con 0x7f12e80b3360 2024-09-17T03:37:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.869+0000 7f12ecd39640 1 -- 172.21.15.146:0/94154285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e81f5150 con 0x7f12e80b3360 2024-09-17T03:37:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.870+0000 7f12ecd39640 1 -- 172.21.15.146:0/94154285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e8072df0 con 0x7f12e80b3360 2024-09-17T03:37:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.870+0000 7f12d6ffd640 1 -- 172.21.15.146:0/94154285 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f12d8038070 con 0x7f12e80b3360 2024-09-17T03:37:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.871+0000 7f12d6ffd640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12c8078bc0 0x7f12c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.871+0000 7f12d6ffd640 1 -- 172.21.15.146:0/94154285 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f12d80bd370 con 0x7f12e80b3360 2024-09-17T03:37:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.871+0000 7f12e5d9b640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12c8078bc0 0x7f12c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.872+0000 7f12e5d9b640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12c8078bc0 0x7f12c807b0d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f12e8072d80 tx=0x7f12dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:08.875+0000 7f12d6ffd640 1 -- 172.21.15.146:0/94154285 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f12d8049060 con 0x7f12e80b3360 2024-09-17T03:37:09.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.086+0000 7f12ecd39640 1 -- 172.21.15.146:0/94154285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f12e8150c40 con 0x7f12e80b3360 2024-09-17T03:37:09.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.087+0000 7f12d6ffd640 1 -- 172.21.15.146:0/94154285 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) ==== 53+0+73 (secure 0 0 0) 0x7f12d80851f0 con 0x7f12e80b3360 2024-09-17T03:37:09.087 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:37:09.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 -- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12c8078bc0 msgr2=0x7f12c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:09.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12c8078bc0 0x7f12c807b0d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f12e8072d80 tx=0x7f12dc009040 comp rx=0 tx=0).stop 2024-09-17T03:37:09.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 -- 172.21.15.146:0/94154285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80b3360 msgr2=0x7f12e814ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80b3360 0x7f12e814ccb0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f12d8006010 tx=0x7f12d8004820 comp rx=0 tx=0).stop 2024-09-17T03:37:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 -- 172.21.15.146:0/94154285 shutdown_connections 2024-09-17T03:37:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12c8078bc0 0x7f12c807b0d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12e814a7c0 0x7f12e815ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12e80cfc40 0x7f12e8149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 --2- 172.21.15.146:0/94154285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12e80b3360 0x7f12e814ccb0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 -- 172.21.15.146:0/94154285 >> 172.21.15.146:0/94154285 conn(0x7f12e80b2060 msgr2=0x7f12e80b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 -- 172.21.15.146:0/94154285 shutdown_connections 2024-09-17T03:37:09.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09.089+0000 7f12ecd39640 1 -- 172.21.15.146:0/94154285 wait complete. 2024-09-17T03:37:09.100 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:37:09.101 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:37:09.101 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:37:09.101 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:37:09.101 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:09.101 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:37:09.101 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:37:09.101 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:37:09.101 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:09.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:09.101 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:37:09.117 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:37:09.117 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:37:09.117 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:09.118 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42543sec preferred_lft 42543sec 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:09.119 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:09.120 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:37:09.120 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:37:09.120 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:09.120 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:09.120 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:37:09.120 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:37:09.120 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:09.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:09.120 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:37:09.181 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:37:09.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:09.183 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:37:09.239 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:37:09.239 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:37:09.239 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:37:09.239 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:37:09.239 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:37:09.239 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:37:09.240 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:37:09.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:37:09.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:37:09.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:37:09.240 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:37:09.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:37:09.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:09.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:09.364 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:37:09.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:37:09.379 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:37:09.380 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:09.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:09.380 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:37:09.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:09.445 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:09.500 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:09.501 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:09.501 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:09.556 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:37:09.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:09.556 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:09.650 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:09.650 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:09.650 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:37:09.661 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:09.661 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:09.661 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:37:09.661 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:37:09.661 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:09.666 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:09.666 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:09.666 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:37:09.666 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:37:09.666 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:09.666 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:37:09.666 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:37:09.666 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:37:09.667 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:37:09.667 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:37:09.667 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:37:09.667 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:37:09.667 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:37:09.668 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:37:09.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:09.668 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:09.693 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:37:09.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:37:09.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:09.794 INFO:teuthology.orchestra.run.smithi146.stdout:client7020 2024-09-17T03:37:09.794 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:09.794 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:09.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:09.810 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-09-17T03:37:09.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:09.870 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-09-17T03:37:09.928 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:37:09.928 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:37:09.928 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-09-17T03:37:09.928 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:37:09.928 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-09-17T03:37:09.929 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:37:10.033 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627776 2024-09-17T03:37:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:10.042 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:10.042 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:10.098 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:10.098 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:10.154 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:37:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.308+0000 7fa40cc30640 1 -- 172.21.15.146:0/4025875041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4080b5750 msgr2=0x7fa4080b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.308+0000 7fa40cc30640 1 --2- 172.21.15.146:0/4025875041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4080b5750 0x7fa4080b3620 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fa4080b1a60 tx=0x7fa3fc02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.308+0000 7fa40cc30640 1 -- 172.21.15.146:0/4025875041 shutdown_connections 2024-09-17T03:37:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.308+0000 7fa40cc30640 1 --2- 172.21.15.146:0/4025875041 >> v2:172.21.15.179:3300/0 conn(0x7fa4080b3b60 0x7fa40815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.308+0000 7fa40cc30640 1 --2- 172.21.15.146:0/4025875041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4080b5750 0x7fa4080b3620 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.308+0000 7fa40cc30640 1 -- 172.21.15.146:0/4025875041 >> 172.21.15.146:0/4025875041 conn(0x7fa4080b7b20 msgr2=0x7fa40809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.308+0000 7fa40cc30640 1 -- 172.21.15.146:0/4025875041 shutdown_connections 2024-09-17T03:37:10.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.308+0000 7fa40cc30640 1 -- 172.21.15.146:0/4025875041 wait complete. 2024-09-17T03:37:10.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.310+0000 7fa40cc30640 1 Processor -- start 2024-09-17T03:37:10.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.310+0000 7fa40cc30640 1 -- start start 2024-09-17T03:37:10.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.311+0000 7fa40cc30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4080b3b60 0x7fa40809ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.311+0000 7fa40cc30640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4080b5750 0x7fa408156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.311+0000 7fa40cc30640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4080b5ce0 0x7fa4081565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.311+0000 7fa40cc30640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa40815d420 con 0x7fa4080b3b60 2024-09-17T03:37:10.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.311+0000 7fa40cc30640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa40815d2a0 con 0x7fa4080b5750 2024-09-17T03:37:10.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.311+0000 7fa40cc30640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa40815d5a0 con 0x7fa4080b5ce0 2024-09-17T03:37:10.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.311+0000 7fa40659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4080b3b60 0x7fa40809ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa40659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4080b3b60 0x7fa40809ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37814/0 (socket says 172.21.15.146:37814) 2024-09-17T03:37:10.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa40659c640 1 -- 172.21.15.146:0/3016105874 learned_addr learned my addr 172.21.15.146:0/3016105874 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:10.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa405d9b640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4080b5750 0x7fa408156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa406d9d640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4080b5ce0 0x7fa4081565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa40659c640 1 -- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4080b5ce0 msgr2=0x7fa4081565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa40659c640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4080b5ce0 0x7fa4081565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa40659c640 1 -- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4080b5750 msgr2=0x7fa408156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa40659c640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4080b5750 0x7fa408156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa40659c640 1 -- 172.21.15.146:0/3016105874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4080a0440 con 0x7fa4080b3b60 2024-09-17T03:37:10.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa40659c640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4080b3b60 0x7fa40809ff00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800c3f0 tx=0x7fa3f800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa3f6ffd640 1 -- 172.21.15.146:0/3016105874 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8017070 con 0x7fa4080b3b60 2024-09-17T03:37:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa3f6ffd640 1 -- 172.21.15.146:0/3016105874 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3f80035f0 con 0x7fa4080b3b60 2024-09-17T03:37:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa40cc30640 1 -- 172.21.15.146:0/3016105874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa408147910 con 0x7fa4080b3b60 2024-09-17T03:37:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa3f6ffd640 1 -- 172.21.15.146:0/3016105874 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8003a40 con 0x7fa4080b3b60 2024-09-17T03:37:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.312+0000 7fa40cc30640 1 -- 172.21.15.146:0/3016105874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa408147ed0 con 0x7fa4080b3b60 2024-09-17T03:37:10.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.313+0000 7fa40cc30640 1 -- 172.21.15.146:0/3016105874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4080b3620 con 0x7fa4080b3b60 2024-09-17T03:37:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.314+0000 7fa3f6ffd640 1 -- 172.21.15.146:0/3016105874 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3f801a070 con 0x7fa4080b3b60 2024-09-17T03:37:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.314+0000 7fa3f6ffd640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3e8078b90 0x7fa3e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.315+0000 7fa3f6ffd640 1 -- 172.21.15.146:0/3016105874 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7fa3f809a080 con 0x7fa4080b3b60 2024-09-17T03:37:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.315+0000 7fa405d9b640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3e8078b90 0x7fa3e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.315+0000 7fa405d9b640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3e8078b90 0x7fa3e807b0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc034000 tx=0x7fa3fc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:10.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.319+0000 7fa3f6ffd640 1 -- 172.21.15.146:0/3016105874 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa4080b3f70 con 0x7fa4080b3b60 2024-09-17T03:37:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.504+0000 7fa40cc30640 1 -- 172.21.15.146:0/3016105874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa4080721e0 con 0x7fa4080b3b60 2024-09-17T03:37:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.505+0000 7fa3f6ffd640 1 -- 172.21.15.146:0/3016105874 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) ==== 80+0+0 (secure 0 0 0) 0x7fa3f8061df0 con 0x7fa4080b3b60 2024-09-17T03:37:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:37:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 -- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3e8078b90 msgr2=0x7fa3e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3e8078b90 0x7fa3e807b0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc034000 tx=0x7fa3fc004730 comp rx=0 tx=0).stop 2024-09-17T03:37:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 -- 172.21.15.146:0/3016105874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4080b3b60 msgr2=0x7fa40809ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4080b3b60 0x7fa40809ff00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800c3f0 tx=0x7fa3f800c8b0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 -- 172.21.15.146:0/3016105874 shutdown_connections 2024-09-17T03:37:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3e8078b90 0x7fa3e807b0a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4080b5ce0 0x7fa4081565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4080b5750 0x7fa408156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 --2- 172.21.15.146:0/3016105874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4080b3b60 0x7fa40809ff00 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 -- 172.21.15.146:0/3016105874 >> 172.21.15.146:0/3016105874 conn(0x7fa4080b7b20 msgr2=0x7fa40815b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:10.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 -- 172.21.15.146:0/3016105874 shutdown_connections 2024-09-17T03:37:10.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.507+0000 7fa40cc30640 1 -- 172.21.15.146:0/3016105874 wait complete. 2024-09-17T03:37:10.518 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:37:10.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:10.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:10.564 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:37:10.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:10.564 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:37:10.593 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.748+0000 7fec2bb19640 1 -- 172.21.15.146:0/3067762664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec2415f010 msgr2=0x7fec241515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.748+0000 7fec2bb19640 1 --2- 172.21.15.146:0/3067762664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec2415f010 0x7fec241515a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00a940 tx=0x7fec1c02b850 comp rx=0 tx=0).stop 2024-09-17T03:37:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.748+0000 7fec2bb19640 1 -- 172.21.15.146:0/3067762664 shutdown_connections 2024-09-17T03:37:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.748+0000 7fec2bb19640 1 --2- 172.21.15.146:0/3067762664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec2415f010 0x7fec241515a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.748+0000 7fec2bb19640 1 --2- 172.21.15.146:0/3067762664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec24072df0 0x7fec2415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.748+0000 7fec2bb19640 1 -- 172.21.15.146:0/3067762664 >> 172.21.15.146:0/3067762664 conn(0x7fec240b2060 msgr2=0x7fec240b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.748+0000 7fec2bb19640 1 -- 172.21.15.146:0/3067762664 shutdown_connections 2024-09-17T03:37:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.748+0000 7fec2bb19640 1 -- 172.21.15.146:0/3067762664 wait complete. 2024-09-17T03:37:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.750+0000 7fec2bb19640 1 Processor -- start 2024-09-17T03:37:10.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.750+0000 7fec2bb19640 1 -- start start 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.751+0000 7fec2bb19640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec24072df0 0x7fec24147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.751+0000 7fec2bb19640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b3360 0x7fec24140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.751+0000 7fec2bb19640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2415f010 0x7fec2414a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.751+0000 7fec2bb19640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fec2406ea50 con 0x7fec2415f010 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.751+0000 7fec2bb19640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec2406e8d0 con 0x7fec24072df0 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.751+0000 7fec2bb19640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fec24151ae0 con 0x7fec240b3360 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec2a0b6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2415f010 0x7fec2414a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec2a0b6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2415f010 0x7fec2414a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37822/0 (socket says 172.21.15.146:37822) 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec2a0b6640 1 -- 172.21.15.146:0/1370959619 learned_addr learned my addr 172.21.15.146:0/1370959619 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec290b4640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b3360 0x7fec24140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec298b5640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec24072df0 0x7fec24147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec2a0b6640 1 -- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b3360 msgr2=0x7fec24140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec2a0b6640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b3360 0x7fec24140f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec2a0b6640 1 -- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec24072df0 msgr2=0x7fec24147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec2a0b6640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec24072df0 0x7fec24147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec2a0b6640 1 -- 172.21.15.146:0/1370959619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec241f6ae0 con 0x7fec2415f010 2024-09-17T03:37:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec2a0b6640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2415f010 0x7fec2414a0e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fec1c02be40 tx=0x7fec1c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec1a7fc640 1 -- 172.21.15.146:0/1370959619 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c005c90 con 0x7fec2415f010 2024-09-17T03:37:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec1a7fc640 1 -- 172.21.15.146:0/1370959619 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec1c043070 con 0x7fec2415f010 2024-09-17T03:37:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec2bb19640 1 -- 172.21.15.146:0/1370959619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec24146c90 con 0x7fec2415f010 2024-09-17T03:37:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec1a7fc640 1 -- 172.21.15.146:0/1370959619 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c031ad0 con 0x7fec2415f010 2024-09-17T03:37:10.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.752+0000 7fec2bb19640 1 -- 172.21.15.146:0/1370959619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec24146f30 con 0x7fec2415f010 2024-09-17T03:37:10.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.753+0000 7fec2bb19640 1 -- 172.21.15.146:0/1370959619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec2415ead0 con 0x7fec2415f010 2024-09-17T03:37:10.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.754+0000 7fec1a7fc640 1 -- 172.21.15.146:0/1370959619 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec1c03b040 con 0x7fec2415f010 2024-09-17T03:37:10.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.755+0000 7fec1a7fc640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec08078bc0 0x7fec0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:10.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.755+0000 7fec1a7fc640 1 -- 172.21.15.146:0/1370959619 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7fec1c0bba90 con 0x7fec2415f010 2024-09-17T03:37:10.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.755+0000 7fec298b5640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec08078bc0 0x7fec0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:10.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.756+0000 7fec298b5640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec08078bc0 0x7fec0807b0d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fec20002200 tx=0x7fec200019f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.759+0000 7fec1a7fc640 1 -- 172.21.15.146:0/1370959619 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec1c083880 con 0x7fec2415f010 2024-09-17T03:37:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.969+0000 7fec2bb19640 1 -- 172.21.15.146:0/1370959619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec2415f600 con 0x7fec2415f010 2024-09-17T03:37:10.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.969+0000 7fec1a7fc640 1 -- 172.21.15.146:0/1370959619 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5237 (secure 0 0 0) 0x7fec1c0882b0 con 0x7fec2415f010 2024-09-17T03:37:10.970 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:10.970 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":46,"btime":"2024-09-17T03:37:01:608193+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5900,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1279251216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1279251216},{"type":"v1","addr":"172.21.15.179:6836","nonce":1279251216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/1852599543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1852599543},{"type":"v1","addr":"172.21.15.179:6837","nonce":1852599543}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6304,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3440108509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3440108509},{"type":"v1","addr":"172.21.15.146:6833","nonce":3440108509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:57.935632+0000","modified":"2024-09-17T03:37:00.965187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6855":{"gid":6855,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2258631125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2258631125},{"type":"v1","addr":"172.21.15.146:6835","nonce":2258631125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6855,"qdb_cluster":[6855]},"id":5}]} 2024-09-17T03:37:10.970 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 46 2024-09-17T03:37:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 -- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec08078bc0 msgr2=0x7fec0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec08078bc0 0x7fec0807b0d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fec20002200 tx=0x7fec200019f0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 -- 172.21.15.146:0/1370959619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2415f010 msgr2=0x7fec2414a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2415f010 0x7fec2414a0e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fec1c02be40 tx=0x7fec1c003c10 comp rx=0 tx=0).stop 2024-09-17T03:37:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 -- 172.21.15.146:0/1370959619 shutdown_connections 2024-09-17T03:37:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec08078bc0 0x7fec0807b0d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2415f010 0x7fec2414a0e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b3360 0x7fec24140f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 --2- 172.21.15.146:0/1370959619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec24072df0 0x7fec24147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 -- 172.21.15.146:0/1370959619 >> 172.21.15.146:0/1370959619 conn(0x7fec240b2060 msgr2=0x7fec240b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 -- 172.21.15.146:0/1370959619 shutdown_connections 2024-09-17T03:37:10.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:10.972+0000 7fec2bb19640 1 -- 172.21.15.146:0/1370959619 wait complete. 2024-09-17T03:37:10.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-17T03:37:11.117 INFO:teuthology.orchestra.run.smithi146.stdout:{"message":"","return_code":0} 2024-09-17T03:37:11.117 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T03:37:11.118 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:37:11.118 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:11.118 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:37:11.118 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:11.119 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:37:11.119 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:11.119 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:37:11.119 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:11.128 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:37:11.128 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:11.129 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:37:11.129 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:11.132 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:37:11.132 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:11.133 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:37:11.133 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:11.133 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-09-17T03:37:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.225+0000 7f56df179f40 1 Processor -- start 2024-09-17T03:37:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.225+0000 7f56df179f40 1 -- start start 2024-09-17T03:37:11.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56df179f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56177b2e4fe0 0x56177b3ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56df179f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 0x56177b326360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56df179f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56177b32e300 0x56177b3268a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56df179f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56177b32e710 con 0x56177b32d9b0 2024-09-17T03:37:11.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56df179f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56177b236d60 con 0x56177b32e300 2024-09-17T03:37:11.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56df179f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56177b3bb470 con 0x56177b2e4fe0 2024-09-17T03:37:11.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d8434640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 0x56177b326360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d8434640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 0x56177b326360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37842/0 (socket says 172.21.15.146:37842) 2024-09-17T03:37:11.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d8434640 1 -- 172.21.15.146:0/1424300877 learned_addr learned my addr 172.21.15.146:0/1424300877 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:11.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d8c35640 1 --2- 172.21.15.146:0/1424300877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56177b2e4fe0 0x56177b3ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d9436640 1 --2- 172.21.15.146:0/1424300877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56177b32e300 0x56177b3268a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d8434640 1 -- 172.21.15.146:0/1424300877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56177b2e4fe0 msgr2=0x56177b3ba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d8434640 1 --2- 172.21.15.146:0/1424300877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56177b2e4fe0 0x56177b3ba4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d8434640 1 -- 172.21.15.146:0/1424300877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56177b32e300 msgr2=0x56177b3268a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d8434640 1 --2- 172.21.15.146:0/1424300877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56177b32e300 0x56177b3268a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d8434640 1 -- 172.21.15.146:0/1424300877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177b3b43c0 con 0x56177b32d9b0 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d8c35640 1 --2- 172.21.15.146:0/1424300877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56177b2e4fe0 0x56177b3ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.226+0000 7f56d9436640 1 --2- 172.21.15.146:0/1424300877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56177b32e300 0x56177b3268a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56d8434640 1 --2- 172.21.15.146:0/1424300877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 0x56177b326360 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00b630 tx=0x7f56cc00baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12a15a79f41ab6c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56d7432640 1 -- 172.21.15.146:0/1424300877 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc019070 con 0x56177b32d9b0 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56d7432640 1 -- 172.21.15.146:0/1424300877 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56cc00b2e0 con 0x56177b32d9b0 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56d7432640 1 -- 172.21.15.146:0/1424300877 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0097d0 con 0x56177b32d9b0 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56df179f40 1 -- 172.21.15.146:0/1424300877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 msgr2=0x56177b326360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56df179f40 1 --2- 172.21.15.146:0/1424300877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 0x56177b326360 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00b630 tx=0x7f56cc00baf0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56df179f40 1 -- 172.21.15.146:0/1424300877 shutdown_connections 2024-09-17T03:37:11.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56df179f40 1 --2- 172.21.15.146:0/1424300877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56177b32e300 0x56177b3268a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56df179f40 1 --2- 172.21.15.146:0/1424300877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 0x56177b326360 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56df179f40 1 --2- 172.21.15.146:0/1424300877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56177b2e4fe0 0x56177b3ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56df179f40 1 -- 172.21.15.146:0/1424300877 >> 172.21.15.146:0/1424300877 conn(0x56177b207ac0 msgr2=0x56177b32d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56df179f40 1 -- 172.21.15.146:0/1424300877 shutdown_connections 2024-09-17T03:37:11.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.227+0000 7f56df179f40 1 -- 172.21.15.146:0/1424300877 wait complete. 2024-09-17T03:37:11.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.228+0000 7f56df179f40 1 Processor -- start 2024-09-17T03:37:11.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.228+0000 7f56df179f40 1 -- start start 2024-09-17T03:37:11.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56df179f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56177b2e4fe0 0x56177b3a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56df179f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 0x56177b3b9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56df179f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56177b32e300 0x56177b3b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56df179f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56177b316220 con 0x56177b32d9b0 2024-09-17T03:37:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56df179f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56177b3b3be0 con 0x56177b2e4fe0 2024-09-17T03:37:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56df179f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56177b3af2c0 con 0x56177b32e300 2024-09-17T03:37:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d8434640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 0x56177b3b9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d8434640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 0x56177b3b9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37856/0 (socket says 172.21.15.146:37856) 2024-09-17T03:37:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d8434640 1 -- 172.21.15.146:0/3044026631 learned_addr learned my addr 172.21.15.146:0/3044026631 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d9436640 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56177b32e300 0x56177b3b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d8c35640 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56177b2e4fe0 0x56177b3a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d8434640 1 -- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56177b32e300 msgr2=0x56177b3b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d8434640 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56177b32e300 0x56177b3b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d8434640 1 -- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56177b2e4fe0 msgr2=0x56177b3a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d8434640 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56177b2e4fe0 0x56177b3a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d8434640 1 -- 172.21.15.146:0/3044026631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177b444880 con 0x56177b32d9b0 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d8434640 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 0x56177b3b9590 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f56cc004260 tx=0x7f56cc006c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d6430640 1 -- 172.21.15.146:0/3044026631 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc022070 con 0x56177b32d9b0 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d6430640 1 -- 172.21.15.146:0/3044026631 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56cc01d450 con 0x56177b32d9b0 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56df179f40 1 -- 172.21.15.146:0/3044026631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56177b444b60 con 0x56177b32d9b0 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56d6430640 1 -- 172.21.15.146:0/3044026631 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc019070 con 0x56177b32d9b0 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.230+0000 7f56df179f40 1 -- 172.21.15.146:0/3044026631 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177b3b9070 con 0x56177b32d9b0 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.232+0000 7f56d6430640 1 -- 172.21.15.146:0/3044026631 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f56cc008410 con 0x56177b32d9b0 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.232+0000 7f56d6430640 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56c4077570 0x7f56c4079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.233+0000 7f56d6430640 1 -- 172.21.15.146:0/3044026631 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f56cc099fb0 con 0x56177b32d9b0 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.233+0000 7f56d8c35640 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56c4077570 0x7f56c4079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.233+0000 7f56df179f40 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x56177b3b2610 0x56177b3262b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.233+0000 7f56df179f40 1 -- 172.21.15.146:0/3044026631 --> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x56177b3267f0 con 0x56177b3b2610 2024-09-17T03:37:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.233+0000 7f56d9436640 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x56177b3b2610 0x56177b3262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.233+0000 7f56d8c35640 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56c4077570 0x7f56c4079a80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c5b0 tx=0x7f56c8005730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.233+0000 7f56d9436640 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x56177b3b2610 0x56177b3262b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56d9436640 1 -- 172.21.15.146:0/3044026631 <== osd.4 v2:172.21.15.179:6818/3302933995 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v73'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f56d000b040 con 0x56177b3b2610 2024-09-17T03:37:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56df179f40 1 -- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x56177b3b2610 msgr2=0x56177b3262b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56df179f40 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x56177b3b2610 0x56177b3262b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56df179f40 1 -- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56c4077570 msgr2=0x7f56c4079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56df179f40 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56c4077570 0x7f56c4079a80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c5b0 tx=0x7f56c8005730 comp rx=0 tx=0).stop 2024-09-17T03:37:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56df179f40 1 -- 172.21.15.146:0/3044026631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 msgr2=0x56177b3b9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56df179f40 1 --2- 172.21.15.146:0/3044026631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56177b32d9b0 0x56177b3b9590 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f56cc004260 tx=0x7f56cc006c20 comp rx=0 tx=0).stop 2024-09-17T03:37:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56d9436640 1 -- 172.21.15.146:0/3044026631 reap_dead start 2024-09-17T03:37:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56df179f40 1 -- 172.21.15.146:0/3044026631 shutdown_connections 2024-09-17T03:37:11.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56df179f40 1 -- 172.21.15.146:0/3044026631 >> 172.21.15.146:0/3044026631 conn(0x56177b207ac0 msgr2=0x56177b311e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56df179f40 1 -- 172.21.15.146:0/3044026631 shutdown_connections 2024-09-17T03:37:11.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.235+0000 7f56df179f40 1 -- 172.21.15.146:0/3044026631 wait complete. 2024-09-17T03:37:11.240 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-09-17T03:37:11.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-17T03:37:11.241 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-09-17T03:37:11.241 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-17T03:37:11.241 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-09-17T03:37:11.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-17T03:37:11.242 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-09-17T03:37:11.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-17T03:37:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f07a7f5e640 1 -- 172.21.15.146:0/4240137425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07a00b3d30 msgr2=0x7f07a01677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f07a7f5e640 1 --2- 172.21.15.146:0/4240137425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07a00b3d30 0x7f07a01677c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0798009be0 tx=0x7f079802a920 comp rx=0 tx=0).stop 2024-09-17T03:37:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f07a7f5e640 1 -- 172.21.15.146:0/4240137425 shutdown_connections 2024-09-17T03:37:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f07a7f5e640 1 --2- 172.21.15.146:0/4240137425 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07a00b3d30 0x7f07a01677c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f07a7f5e640 1 -- 172.21.15.146:0/4240137425 >> 172.21.15.146:0/4240137425 conn(0x7f07a00b7b20 msgr2=0x7f07a009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f977a1b6640 1 -- 172.21.15.146:0/3756002685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977406f270 msgr2=0x7f97740d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f977a1b6640 1 --2- 172.21.15.146:0/3756002685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977406f270 0x7f97740d3190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f976c005fd0 tx=0x7f976c02a820 comp rx=0 tx=0).stop 2024-09-17T03:37:11.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f07a7f5e640 1 -- 172.21.15.146:0/4240137425 shutdown_connections 2024-09-17T03:37:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f977a1b6640 1 -- 172.21.15.146:0/3756002685 shutdown_connections 2024-09-17T03:37:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f977a1b6640 1 --2- 172.21.15.146:0/3756002685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f977406f270 0x7f97740d3190 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f977a1b6640 1 --2- 172.21.15.146:0/3756002685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97740cf370 0x7f977406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f977a1b6640 1 -- 172.21.15.146:0/3756002685 >> 172.21.15.146:0/3756002685 conn(0x7f97740d4be0 msgr2=0x7f97740d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f977a1b6640 1 -- 172.21.15.146:0/3756002685 shutdown_connections 2024-09-17T03:37:11.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f977a1b6640 1 -- 172.21.15.146:0/3756002685 wait complete. 2024-09-17T03:37:11.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.369+0000 7f07a7f5e640 1 -- 172.21.15.146:0/4240137425 wait complete. 2024-09-17T03:37:11.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7faf7a113640 1 -- 172.21.15.146:0/2310697896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf740b3250 msgr2=0x7faf740b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7f99f428b640 1 -- 172.21.15.146:0/3691522739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8004800 msgr2=0x7f99d8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7faf7a113640 1 --2- 172.21.15.146:0/2310697896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf740b3250 0x7faf740b1f40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faf68009830 tx=0x7faf6802a510 comp rx=0 tx=0).stop 2024-09-17T03:37:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7f99f428b640 1 --2- 172.21.15.146:0/3691522739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8004800 0x7f99d8004c10 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00c640 tx=0x7f99d8005830 comp rx=0 tx=0).stop 2024-09-17T03:37:11.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7f99f2828640 1 -- 172.21.15.146:0/3691522739 reap_dead start 2024-09-17T03:37:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7faf7a113640 1 -- 172.21.15.146:0/2310697896 shutdown_connections 2024-09-17T03:37:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7faf7a113640 1 --2- 172.21.15.146:0/2310697896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf740b2480 0x7faf740b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7faf7a113640 1 --2- 172.21.15.146:0/2310697896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf740b3250 0x7faf740b1f40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7faf7a113640 1 -- 172.21.15.146:0/2310697896 >> 172.21.15.146:0/2310697896 conn(0x7faf7409ba20 msgr2=0x7faf740b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7f99f428b640 1 -- 172.21.15.146:0/3691522739 shutdown_connections 2024-09-17T03:37:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7f99f428b640 1 -- 172.21.15.146:0/3691522739 >> 172.21.15.146:0/3691522739 conn(0x7f99ec0d11f0 msgr2=0x7f99ec0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7f99f428b640 1 -- 172.21.15.146:0/3691522739 shutdown_connections 2024-09-17T03:37:11.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7f99f428b640 1 -- 172.21.15.146:0/3691522739 wait complete. 2024-09-17T03:37:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7faf7a113640 1 -- 172.21.15.146:0/2310697896 shutdown_connections 2024-09-17T03:37:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.370+0000 7faf7a113640 1 -- 172.21.15.146:0/2310697896 wait complete. 2024-09-17T03:37:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.371+0000 7f977a1b6640 1 Processor -- start 2024-09-17T03:37:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.372+0000 7f977a1b6640 1 -- start start 2024-09-17T03:37:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.372+0000 7f99f428b640 1 Processor -- start 2024-09-17T03:37:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.372+0000 7f99f428b640 1 -- start start 2024-09-17T03:37:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.372+0000 7f07a7f5e640 1 Processor -- start 2024-09-17T03:37:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.372+0000 7f07a7f5e640 1 -- start start 2024-09-17T03:37:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7f977a1b6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977406f270 0x7f9774149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7faf7a113640 1 Processor -- start 2024-09-17T03:37:11.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7f977a1b6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97740b3870 0x7f97741f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7f977a1b6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97740cf370 0x7f97741f9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7f977a1b6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f97740d3b40 con 0x7f97740b3870 2024-09-17T03:37:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7f977a1b6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f97740d39c0 con 0x7f97740cf370 2024-09-17T03:37:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7f977a1b6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f97740d3cc0 con 0x7f977406f270 2024-09-17T03:37:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7f9772ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97740b3870 0x7f97741f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7f9772ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97740b3870 0x7f97741f94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37884/0 (socket says 172.21.15.146:37884) 2024-09-17T03:37:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7f9772ffd640 1 -- 172.21.15.146:0/1879369760 learned_addr learned my addr 172.21.15.146:0/1879369760 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7f9773fff640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97740cf370 0x7f97741f9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7f97737fe640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977406f270 0x7f9774149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.373+0000 7faf7a113640 1 -- start start 2024-09-17T03:37:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f9772ffd640 1 -- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977406f270 msgr2=0x7f9774149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f9772ffd640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977406f270 0x7f9774149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f9772ffd640 1 -- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97740cf370 msgr2=0x7f97741f9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f9772ffd640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97740cf370 0x7f97741f9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f9772ffd640 1 -- 172.21.15.146:0/1879369760 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97740cd4d0 con 0x7f97740b3870 2024-09-17T03:37:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f9772ffd640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97740b3870 0x7f97741f94f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f976800e9c0 tx=0x7f976800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f99f428b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8004800 0x7f99ec15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f975bfff640 1 -- 172.21.15.146:0/1879369760 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976800cd80 con 0x7f97740b3870 2024-09-17T03:37:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f977a1b6640 1 -- 172.21.15.146:0/1879369760 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97740c9350 con 0x7f97740b3870 2024-09-17T03:37:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f99f2027640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8004800 0x7f99ec15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f99f2027640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8004800 0x7f99ec15c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37898/0 (socket says 172.21.15.146:37898) 2024-09-17T03:37:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f975bfff640 1 -- 172.21.15.146:0/1879369760 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9768004030 con 0x7f97740b3870 2024-09-17T03:37:11.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f977a1b6640 1 -- 172.21.15.146:0/1879369760 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f977414a190 con 0x7f97740b3870 2024-09-17T03:37:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f99f428b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99ec1f6180 0x7f99ec1f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f99f2027640 1 -- 172.21.15.146:0/2273658243 learned_addr learned my addr 172.21.15.146:0/2273658243 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.374+0000 7f99f428b640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99ec0c9fb0 0x7f99ec0ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f99f1826640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99ec1f6180 0x7f99ec1f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec0b6990 con 0x7f99d8004800 2024-09-17T03:37:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f99f2828640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99ec0c9fb0 0x7f99ec0ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec0b6810 con 0x7f99ec1f6180 2024-09-17T03:37:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99ec1636c0 con 0x7f99ec0c9fb0 2024-09-17T03:37:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f07a7f5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07a00b5750 0x7f07a0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f07a7f5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07a00b5ce0 0x7f07a014d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f07a7f5e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a009c6f0 0x7f07a009cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f07a7f5e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f07a0167f10 con 0x7f07a009c6f0 2024-09-17T03:37:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f07a54f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07a00b5ce0 0x7f07a014d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f07a54f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07a00b5ce0 0x7f07a014d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:46448/0 (socket says 172.21.15.146:46448) 2024-09-17T03:37:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f07a54f9640 1 -- 172.21.15.146:0/372997084 learned_addr learned my addr 172.21.15.146:0/372997084 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f07a5cfa640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07a00b5750 0x7f07a0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f07a64fb640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a009c6f0 0x7f07a009cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f975bfff640 1 -- 172.21.15.146:0/1879369760 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976800cd80 con 0x7f97740b3870 2024-09-17T03:37:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f977a1b6640 1 -- 172.21.15.146:0/1879369760 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97740cd240 con 0x7f97740b3870 2024-09-17T03:37:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f07a015de10 con 0x7f07a00b5ce0 2024-09-17T03:37:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f99f2027640 1 -- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99ec0c9fb0 msgr2=0x7f99ec0ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f99f2027640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99ec0c9fb0 0x7f99ec0ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f99f2027640 1 -- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99ec1f6180 msgr2=0x7f99ec1f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.375+0000 7f99f2027640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99ec1f6180 0x7f99ec1f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f99f2027640 1 -- 172.21.15.146:0/2273658243 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ec0ca900 con 0x7f99d8004800 2024-09-17T03:37:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f07a0168090 con 0x7f07a00b5750 2024-09-17T03:37:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f99f1826640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99ec1f6180 0x7f99ec1f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:37:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf7a113640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf740b2480 0x7faf741fa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf7a113640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf740b3250 0x7faf741fcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f99f2027640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8004800 0x7f99ec15c200 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f99e80109d0 tx=0x7f99e8010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf7a113640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf740b4f20 0x7faf741e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf737fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf740b2480 0x7faf741fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f99e2ffd640 1 -- 172.21.15.146:0/2273658243 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e800ee00 con 0x7f99d8004800 2024-09-17T03:37:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf7a113640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf74160b70 con 0x7faf740b3250 2024-09-17T03:37:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf7a113640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faf740b1330 con 0x7faf740b2480 2024-09-17T03:37:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf737fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf740b2480 0x7faf741fa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:46454/0 (socket says 172.21.15.146:46454) 2024-09-17T03:37:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf737fe640 1 -- 172.21.15.146:0/3619781893 learned_addr learned my addr 172.21.15.146:0/3619781893 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf72ffd640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf740b3250 0x7faf741fcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf7a113640 1 -- 172.21.15.146:0/3619781893 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7faf74160cf0 con 0x7faf740b4f20 2024-09-17T03:37:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ec0c93a0 con 0x7f99d8004800 2024-09-17T03:37:11.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf73fff640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf740b4f20 0x7faf741e6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf72ffd640 1 -- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf740b4f20 msgr2=0x7faf741e6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf72ffd640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf740b4f20 0x7faf741e6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf72ffd640 1 -- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf740b2480 msgr2=0x7faf741fa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7faf72ffd640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf740b2480 0x7faf741fa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.377+0000 7faf72ffd640 1 -- 172.21.15.146:0/3619781893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf741fd9f0 con 0x7faf740b3250 2024-09-17T03:37:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.377+0000 7faf73fff640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf740b4f20 0x7faf741e6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:37:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f99e2ffd640 1 -- 172.21.15.146:0/2273658243 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99e8004030 con 0x7f99d8004800 2024-09-17T03:37:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ec0c85e0 con 0x7f99d8004800 2024-09-17T03:37:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.377+0000 7faf72ffd640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf740b3250 0x7faf741fcf30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7faf68031000 tx=0x7faf68033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f07a64fb640 1 -- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07a00b5750 msgr2=0x7f07a0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f07a64fb640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07a00b5750 0x7f07a0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f07a64fb640 1 -- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07a00b5ce0 msgr2=0x7f07a014d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f07a64fb640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07a00b5ce0 0x7f07a014d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.376+0000 7f07a64fb640 1 -- 172.21.15.146:0/372997084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a009d040 con 0x7f07a009c6f0 2024-09-17T03:37:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.377+0000 7f07a64fb640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a009c6f0 0x7f07a009cb00 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0798009000 tx=0x7f0798009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.377+0000 7f99e2ffd640 1 -- 172.21.15.146:0/2273658243 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e800ee00 con 0x7f99d8004800 2024-09-17T03:37:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.377+0000 7f975bfff640 1 -- 172.21.15.146:0/1879369760 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9768004200 con 0x7f97740b3870 2024-09-17T03:37:11.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.378+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ec0c7ff0 con 0x7f99d8004800 2024-09-17T03:37:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.378+0000 7f975bfff640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9760078d90 0x7f976007b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.378+0000 7f975bfff640 1 -- 172.21.15.146:0/1879369760 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f976809b300 con 0x7f97740b3870 2024-09-17T03:37:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.378+0000 7f97737fe640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9760078d90 0x7f976007b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.378+0000 7f97737fe640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9760078d90 0x7f976007b2a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9764000f60 tx=0x7f9764009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.382+0000 7f975bfff640 1 -- 172.21.15.146:0/1879369760 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9768063170 con 0x7f97740b3870 2024-09-17T03:37:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.382+0000 7faf5bfff640 1 -- 172.21.15.146:0/3619781893 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68031b50 con 0x7faf740b3250 2024-09-17T03:37:11.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.382+0000 7faf7a113640 1 -- 172.21.15.146:0/3619781893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf741fdcd0 con 0x7faf740b3250 2024-09-17T03:37:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.382+0000 7f07967fc640 1 -- 172.21.15.146:0/372997084 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798003e60 con 0x7f07a009c6f0 2024-09-17T03:37:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.382+0000 7f07967fc640 1 -- 172.21.15.146:0/372997084 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0798042070 con 0x7f07a009c6f0 2024-09-17T03:37:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.382+0000 7f07967fc640 1 -- 172.21.15.146:0/372997084 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079803ea50 con 0x7f07a009c6f0 2024-09-17T03:37:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.382+0000 7faf5bfff640 1 -- 172.21.15.146:0/3619781893 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf68031e00 con 0x7faf740b3250 2024-09-17T03:37:11.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.382+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a014df30 con 0x7f07a009c6f0 2024-09-17T03:37:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.382+0000 7faf5bfff640 1 -- 172.21.15.146:0/3619781893 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68033330 con 0x7faf740b3250 2024-09-17T03:37:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.382+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a014e4b0 con 0x7f07a009c6f0 2024-09-17T03:37:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.383+0000 7faf7a113640 1 -- 172.21.15.146:0/3619781893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf741f9f50 con 0x7faf740b3250 2024-09-17T03:37:11.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.383+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a009f970 con 0x7f07a009c6f0 2024-09-17T03:37:11.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.384+0000 7faf7a113640 1 -- 172.21.15.146:0/3619781893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf740b08d0 con 0x7faf740b3250 2024-09-17T03:37:11.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.385+0000 7f99e2ffd640 1 -- 172.21.15.146:0/2273658243 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99e8004200 con 0x7f99d8004800 2024-09-17T03:37:11.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.385+0000 7f99e2ffd640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99d0078d90 0x7f99d007b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.385+0000 7f99e2ffd640 1 -- 172.21.15.146:0/2273658243 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f99e809c140 con 0x7f99d8004800 2024-09-17T03:37:11.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.386+0000 7f99f1826640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99d0078d90 0x7f99d007b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.386+0000 7f99f1826640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99d0078d90 0x7f99d007b2a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00c640 tx=0x7f99dc02d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.387+0000 7f99e2ffd640 1 -- 172.21.15.146:0/2273658243 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99e8028070 con 0x7f99d8004800 2024-09-17T03:37:11.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.389+0000 7f07967fc640 1 -- 172.21.15.146:0/372997084 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f079803ebf0 con 0x7f07a009c6f0 2024-09-17T03:37:11.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.389+0000 7faf5bfff640 1 -- 172.21.15.146:0/3619781893 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf680334d0 con 0x7faf740b3250 2024-09-17T03:37:11.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.389+0000 7f07967fc640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0784078b90 0x7f078407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.389+0000 7f07967fc640 1 -- 172.21.15.146:0/372997084 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7f07980c0d30 con 0x7f07a009c6f0 2024-09-17T03:37:11.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.390+0000 7f07a5cfa640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0784078b90 0x7f078407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.390+0000 7faf5bfff640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf60078b90 0x7faf6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:11.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.390+0000 7faf5bfff640 1 -- 172.21.15.146:0/3619781893 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5709+0+0 (secure 0 0 0) 0x7faf680bc380 con 0x7faf740b3250 2024-09-17T03:37:11.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.390+0000 7faf737fe640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf60078b90 0x7faf6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:11.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.390+0000 7f07a5cfa640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0784078b90 0x7f078407b0a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f079c001720 tx=0x7f079c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.390+0000 7faf737fe640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf60078b90 0x7faf6007b0a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faf64007fd0 tx=0x7faf64001450 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:11.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.393+0000 7f07967fc640 1 -- 172.21.15.146:0/372997084 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0798056080 con 0x7f07a009c6f0 2024-09-17T03:37:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.398+0000 7faf5bfff640 1 -- 172.21.15.146:0/3619781893 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf68052080 con 0x7faf740b3250 2024-09-17T03:37:11.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.648+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f07a00b1320 con 0x7f07a009c6f0 2024-09-17T03:37:11.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.653+0000 7faf7a113640 1 -- 172.21.15.146:0/3619781893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7faf7415cfa0 con 0x7faf740b3250 2024-09-17T03:37:11.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.710+0000 7f977a1b6640 1 -- 172.21.15.146:0/1879369760 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f97740d4170 con 0x7f97740b3870 2024-09-17T03:37:11.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.712+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f99ec0b3ef0 con 0x7f99d8004800 2024-09-17T03:37:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.925+0000 7f07967fc640 1 -- 172.21.15.146:0/372997084 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5903 v47) ==== 95+0+0 (secure 0 0 0) 0x7f07a009d040 con 0x7f07a009c6f0 2024-09-17T03:37:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 5903 2024-09-17T03:37:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0784078b90 msgr2=0x7f078407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0784078b90 0x7f078407b0a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f079c001720 tx=0x7f079c009040 comp rx=0 tx=0).stop 2024-09-17T03:37:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a009c6f0 msgr2=0x7f07a009cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a009c6f0 0x7f07a009cb00 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0798009000 tx=0x7f0798009310 comp rx=0 tx=0).stop 2024-09-17T03:37:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 shutdown_connections 2024-09-17T03:37:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0784078b90 0x7f078407b0a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07a009c6f0 0x7f07a009cb00 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07a00b5ce0 0x7f07a014d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 --2- 172.21.15.146:0/372997084 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07a00b5750 0x7f07a0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 >> 172.21.15.146:0/372997084 conn(0x7f07a00b7b20 msgr2=0x7f07a0157460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 shutdown_connections 2024-09-17T03:37:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.928+0000 7f07a7f5e640 1 -- 172.21.15.146:0/372997084 wait complete. 2024-09-17T03:37:11.933 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:37:11.933+0000 7f82d3416640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:37:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.935+0000 7faf5bfff640 1 -- 172.21.15.146:0/3619781893 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5900 v48) ==== 95+0+0 (secure 0 0 0) 0x7faf6803f030 con 0x7faf740b3250 2024-09-17T03:37:11.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.935+0000 7f975bfff640 1 -- 172.21.15.146:0/1879369760 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6855 v48) ==== 95+0+0 (secure 0 0 0) 0x7f976806a0c0 con 0x7f97740b3870 2024-09-17T03:37:11.935 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 5900 2024-09-17T03:37:11.935 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 6855 2024-09-17T03:37:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.938+0000 7f977a1b6640 1 -- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9760078d90 msgr2=0x7f976007b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.938+0000 7f977a1b6640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9760078d90 0x7f976007b2a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9764000f60 tx=0x7f9764009040 comp rx=0 tx=0).stop 2024-09-17T03:37:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.938+0000 7f977a1b6640 1 -- 172.21.15.146:0/1879369760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97740b3870 msgr2=0x7f97741f94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.938+0000 7f977a1b6640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97740b3870 0x7f97741f94f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f976800e9c0 tx=0x7f976800ee80 comp rx=0 tx=0).stop 2024-09-17T03:37:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.938+0000 7f977a1b6640 1 -- 172.21.15.146:0/1879369760 shutdown_connections 2024-09-17T03:37:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.938+0000 7faf7a113640 1 -- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf60078b90 msgr2=0x7faf6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7faf7a113640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf60078b90 0x7faf6007b0a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faf64007fd0 tx=0x7faf64001450 comp rx=0 tx=0).stop 2024-09-17T03:37:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7faf7a113640 1 -- 172.21.15.146:0/3619781893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf740b3250 msgr2=0x7faf741fcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7faf7a113640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf740b3250 0x7faf741fcf30 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7faf68031000 tx=0x7faf68033ba0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.938+0000 7f977a1b6640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9760078d90 0x7f976007b2a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.938+0000 7f977a1b6640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97740cf370 0x7f97741f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7f977a1b6640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f97740b3870 0x7f97741f94f0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7f977a1b6640 1 --2- 172.21.15.146:0/1879369760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f977406f270 0x7f9774149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7f977a1b6640 1 -- 172.21.15.146:0/1879369760 >> 172.21.15.146:0/1879369760 conn(0x7f97740d4be0 msgr2=0x7f97741620f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7faf7a113640 1 -- 172.21.15.146:0/3619781893 shutdown_connections 2024-09-17T03:37:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7faf7a113640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf60078b90 0x7faf6007b0a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7faf7a113640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf740b4f20 0x7faf741e6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7faf7a113640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf740b3250 0x7faf741fcf30 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7faf7a113640 1 --2- 172.21.15.146:0/3619781893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf740b2480 0x7faf741fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7faf7a113640 1 -- 172.21.15.146:0/3619781893 >> 172.21.15.146:0/3619781893 conn(0x7faf7409ba20 msgr2=0x7faf740b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7faf7a113640 1 -- 172.21.15.146:0/3619781893 shutdown_connections 2024-09-17T03:37:11.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7faf7a113640 1 -- 172.21.15.146:0/3619781893 wait complete. 2024-09-17T03:37:11.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7f977a1b6640 1 -- 172.21.15.146:0/1879369760 shutdown_connections 2024-09-17T03:37:11.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:11.939+0000 7f977a1b6640 1 -- 172.21.15.146:0/1879369760 wait complete. 2024-09-17T03:37:11.943 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:37:11.943 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:37:11.945 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:37:11.946 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:11.954 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:37:11.954 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:37:11.955 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:37:11.955 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:37:11.957 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:37:11.957 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:11.996 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:37:11.997 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:12.037 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:37:12.047 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:37:12.079 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:37:12.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.938+0000 7f99e2ffd640 1 -- 172.21.15.146:0/2273658243 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6304 v49) ==== 95+0+0 (secure 0 0 0) 0x7f99ec0ca900 con 0x7f99d8004800 2024-09-17T03:37:12.939 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 6304 2024-09-17T03:37:12.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.941+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99d0078d90 msgr2=0x7f99d007b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.941+0000 7f99f428b640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99d0078d90 0x7f99d007b2a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00c640 tx=0x7f99dc02d000 comp rx=0 tx=0).stop 2024-09-17T03:37:12.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.941+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8004800 msgr2=0x7f99ec15c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:12.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.941+0000 7f99f428b640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8004800 0x7f99ec15c200 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f99e80109d0 tx=0x7f99e8010e90 comp rx=0 tx=0).stop 2024-09-17T03:37:12.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.941+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 shutdown_connections 2024-09-17T03:37:12.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.941+0000 7f99f428b640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99d0078d90 0x7f99d007b2a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.941+0000 7f99f428b640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99ec0c9fb0 0x7f99ec0ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.941+0000 7f99f428b640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99ec1f6180 0x7f99ec1f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.941+0000 7f99f428b640 1 --2- 172.21.15.146:0/2273658243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99d8004800 0x7f99ec15c200 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:12.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.941+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 >> 172.21.15.146:0/2273658243 conn(0x7f99ec0d11f0 msgr2=0x7f99ec0694e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:12.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.941+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 shutdown_connections 2024-09-17T03:37:12.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:12.942+0000 7f99f428b640 1 -- 172.21.15.146:0/2273658243 wait complete. 2024-09-17T03:37:12.957 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:37:12.957 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:37:13.000 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:37:13.001 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:13.001 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:13.094 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:37:13.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.123+0000 7fe8d457b640 1 -- 172.21.15.146:0/2246345755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8cc071120 msgr2=0x7fe8cc0b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.123+0000 7fe8d457b640 1 --2- 172.21.15.146:0/2246345755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8cc071120 0x7fe8cc0b4530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0005fd0 tx=0x7fe8c002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.123+0000 7fe8d457b640 1 -- 172.21.15.146:0/2246345755 shutdown_connections 2024-09-17T03:37:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.123+0000 7fe8d457b640 1 --2- 172.21.15.146:0/2246345755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8cc071120 0x7fe8cc0b4530 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.123+0000 7fe8d457b640 1 --2- 172.21.15.146:0/2246345755 >> v2:172.21.15.179:3300/0 conn(0x7fe8cc0b55f0 0x7fe8cc070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.123+0000 7fe8d457b640 1 -- 172.21.15.146:0/2246345755 >> 172.21.15.146:0/2246345755 conn(0x7fe8cc0b3410 msgr2=0x7fe8cc0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.123+0000 7fe8d457b640 1 -- 172.21.15.146:0/2246345755 shutdown_connections 2024-09-17T03:37:13.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.123+0000 7fe8d457b640 1 -- 172.21.15.146:0/2246345755 wait complete. 2024-09-17T03:37:13.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.125+0000 7fe8d457b640 1 Processor -- start 2024-09-17T03:37:13.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.125+0000 7fe8d457b640 1 -- start start 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.126+0000 7fe8d457b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc071120 0x7fe8cc143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.126+0000 7fe8d457b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8cc0b4a70 0x7fe8cc1f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.126+0000 7fe8d457b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc0b55f0 0x7fe8cc140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.126+0000 7fe8d457b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc15bd10 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.126+0000 7fe8d457b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc06e710 con 0x7fe8cc071120 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.126+0000 7fe8d457b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe8cc15be90 con 0x7fe8cc0b4a70 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.126+0000 7fe8d2b18640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc0b55f0 0x7fe8cc140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.126+0000 7fe8d2b18640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc0b55f0 0x7fe8cc140790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37946/0 (socket says 172.21.15.146:37946) 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.126+0000 7fe8d2b18640 1 -- 172.21.15.146:0/3080635847 learned_addr learned my addr 172.21.15.146:0/3080635847 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8d2317640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc071120 0x7fe8cc143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8d1b16640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8cc0b4a70 0x7fe8cc1f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8d2b18640 1 -- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8cc0b4a70 msgr2=0x7fe8cc1f78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8d2b18640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8cc0b4a70 0x7fe8cc1f78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8d2b18640 1 -- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc071120 msgr2=0x7fe8cc143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8d2b18640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc071120 0x7fe8cc143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8d2b18640 1 -- 172.21.15.146:0/3080635847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8cc0ce810 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8d2317640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc071120 0x7fe8cc143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8d2b18640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc0b55f0 0x7fe8cc140790 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c3f0 tx=0x7fe8c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8caffd640 1 -- 172.21.15.146:0/3080635847 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4017070 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8caffd640 1 -- 172.21.15.146:0/3080635847 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8c40053e0 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8d457b640 1 -- 172.21.15.146:0/3080635847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8cc0cead0 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8caffd640 1 -- 172.21.15.146:0/3080635847 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4003870 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.127+0000 7fe8d457b640 1 -- 172.21.15.146:0/3080635847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8cc1432c0 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.128+0000 7fe8d457b640 1 -- 172.21.15.146:0/3080635847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8cc0b4530 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.129+0000 7fe8caffd640 1 -- 172.21.15.146:0/3080635847 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8c401a070 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.130+0000 7fe8caffd640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8b8078bc0 0x7fe8b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:13.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.130+0000 7fe8caffd640 1 -- 172.21.15.146:0/3080635847 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7fe8c409a010 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.130+0000 7fe8d2317640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8b8078bc0 0x7fe8b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:13.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.130+0000 7fe8d2317640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8b8078bc0 0x7fe8b807b0d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc005fd0 tx=0x7fe8bc009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:13.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.134+0000 7fe8caffd640 1 -- 172.21.15.146:0/3080635847 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8c40623f0 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.346+0000 7fe8d457b640 1 -- 172.21.15.146:0/3080635847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8cc15ea50 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.346+0000 7fe8caffd640 1 -- 172.21.15.146:0/3080635847 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+4400 (secure 0 0 0) 0x7fe8c4061cf0 con 0x7fe8cc0b55f0 2024-09-17T03:37:13.347 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:13.347 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":50,"btime":"2024-09-17T03:37:12:943008+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4258283164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4258283164},{"type":"v1","addr":"172.21.15.179:6835","nonce":4258283164}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2636836918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2636836918},{"type":"v1","addr":"172.21.15.179:6837","nonce":2636836918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:57.935632+0000","modified":"2024-09-17T03:37:12.942995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":50,"state":"up:replay","state_seq":1,"addr":"172.21.15.146:6833/749858742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":749858742},{"type":"v1","addr":"172.21.15.146:6833","nonce":749858742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-17T03:37:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 50 2024-09-17T03:37:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 -- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8b8078bc0 msgr2=0x7fe8b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8b8078bc0 0x7fe8b807b0d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc005fd0 tx=0x7fe8bc009500 comp rx=0 tx=0).stop 2024-09-17T03:37:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 -- 172.21.15.146:0/3080635847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc0b55f0 msgr2=0x7fe8cc140790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc0b55f0 0x7fe8cc140790 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c3f0 tx=0x7fe8c400c8b0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 -- 172.21.15.146:0/3080635847 shutdown_connections 2024-09-17T03:37:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8b8078bc0 0x7fe8b807b0d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8cc0b55f0 0x7fe8cc140790 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8cc0b4a70 0x7fe8cc1f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 --2- 172.21.15.146:0/3080635847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8cc071120 0x7fe8cc143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 -- 172.21.15.146:0/3080635847 >> 172.21.15.146:0/3080635847 conn(0x7fe8cc0b3410 msgr2=0x7fe8cc0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 -- 172.21.15.146:0/3080635847 shutdown_connections 2024-09-17T03:37:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:13.349+0000 7fe8d457b640 1 -- 172.21.15.146:0/3080635847 wait complete. 2024-09-17T03:37:13.764 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:36:57.935632+0000', 'modified': '2024-09-17T03:37:12.942995+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7083}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7083': {'gid': 7083, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.146:6833/749858742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 749858742}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 749858742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:37:13.764 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7083:up:replay 2024-09-17T03:37:14.765 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.892+0000 7fec04694640 1 -- 172.21.15.146:0/1328493627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe8003a00 msgr2=0x7febe8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.892+0000 7fec04694640 1 --2- 172.21.15.146:0/1328493627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe8003a00 0x7febe8003e70 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7febf8009b50 tx=0x7febe8005830 comp rx=0 tx=0).stop 2024-09-17T03:37:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.892+0000 7fec02c31640 1 -- 172.21.15.146:0/1328493627 reap_dead start 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.892+0000 7fec04694640 1 -- 172.21.15.146:0/1328493627 shutdown_connections 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.892+0000 7fec04694640 1 -- 172.21.15.146:0/1328493627 >> 172.21.15.146:0/1328493627 conn(0x7febfc09ba20 msgr2=0x7febfc0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.892+0000 7fec04694640 1 -- 172.21.15.146:0/1328493627 shutdown_connections 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.892+0000 7fec04694640 1 -- 172.21.15.146:0/1328493627 wait complete. 2024-09-17T03:37:14.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.894+0000 7fec04694640 1 Processor -- start 2024-09-17T03:37:14.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.894+0000 7fec04694640 1 -- start start 2024-09-17T03:37:14.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec04694640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febe8003a00 0x7febfc1f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:14.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec04694640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febfc15aab0 0x7febfc1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:14.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec04694640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc0c9e90 0x7febfc0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:14.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec04694640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7febfc161220 con 0x7febfc0c9e90 2024-09-17T03:37:14.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec04694640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7febfc162080 con 0x7febe8003a00 2024-09-17T03:37:14.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec04694640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7febfc1613a0 con 0x7febfc15aab0 2024-09-17T03:37:14.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec02c31640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc0c9e90 0x7febfc0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:14.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec02c31640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc0c9e90 0x7febfc0ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37964/0 (socket says 172.21.15.146:37964) 2024-09-17T03:37:14.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec02c31640 1 -- 172.21.15.146:0/3858098962 learned_addr learned my addr 172.21.15.146:0/3858098962 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec01c2f640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febfc15aab0 0x7febfc1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec02430640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febe8003a00 0x7febfc1f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec02c31640 1 -- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febfc15aab0 msgr2=0x7febfc1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec02c31640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febfc15aab0 0x7febfc1508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec02c31640 1 -- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febe8003a00 msgr2=0x7febfc1f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec02c31640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febe8003a00 0x7febfc1f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.895+0000 7fec02c31640 1 -- 172.21.15.146:0/3858098962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febfc0c96d0 con 0x7febfc0c9e90 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.896+0000 7fec02c31640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc0c9e90 0x7febfc0ca2a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7febf4002010 tx=0x7febf400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.896+0000 7febf2ffd640 1 -- 172.21.15.146:0/3858098962 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf400cba0 con 0x7febfc0c9e90 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.896+0000 7febf2ffd640 1 -- 172.21.15.146:0/3858098962 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febf4018070 con 0x7febfc0c9e90 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.896+0000 7febf2ffd640 1 -- 172.21.15.146:0/3858098962 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf40116c0 con 0x7febfc0c9e90 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.896+0000 7fec04694640 1 -- 172.21.15.146:0/3858098962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febfc0cc960 con 0x7febfc0c9e90 2024-09-17T03:37:14.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.896+0000 7fec04694640 1 -- 172.21.15.146:0/3858098962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febfc0c8390 con 0x7febfc0c9e90 2024-09-17T03:37:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.897+0000 7fec04694640 1 -- 172.21.15.146:0/3858098962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febfc0c7e20 con 0x7febfc0c9e90 2024-09-17T03:37:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.898+0000 7febf2ffd640 1 -- 172.21.15.146:0/3858098962 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7febf4011860 con 0x7febfc0c9e90 2024-09-17T03:37:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.898+0000 7febf2ffd640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7febe0078b90 0x7febe007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:14.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.898+0000 7febf2ffd640 1 -- 172.21.15.146:0/3858098962 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7febf409b420 con 0x7febfc0c9e90 2024-09-17T03:37:14.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.898+0000 7fec02430640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7febe0078b90 0x7febe007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:14.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.899+0000 7fec02430640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7febe0078b90 0x7febe007b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7febf8035000 tx=0x7febf802d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:14.903+0000 7febf2ffd640 1 -- 172.21.15.146:0/3858098962 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7febf40631b0 con 0x7febfc0c9e90 2024-09-17T03:37:15.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.113+0000 7fec04694640 1 -- 172.21.15.146:0/3858098962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febfc0cf170 con 0x7febfc0c9e90 2024-09-17T03:37:15.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.113+0000 7febf2ffd640 1 -- 172.21.15.146:0/3858098962 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5225 (secure 0 0 0) 0x7febf4067be0 con 0x7febfc0c9e90 2024-09-17T03:37:15.113 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:15.114 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":52,"btime":"2024-09-17T03:37:14:958150+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4258283164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4258283164},{"type":"v1","addr":"172.21.15.179:6835","nonce":4258283164}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2636836918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2636836918},{"type":"v1","addr":"172.21.15.179:6837","nonce":2636836918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":7089,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/850685229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":850685229},{"type":"v1","addr":"172.21.15.146:6835","nonce":850685229}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:57.935632+0000","modified":"2024-09-17T03:37:13.959684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":50,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.146:6833/749858742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":749858742},{"type":"v1","addr":"172.21.15.146:6833","nonce":749858742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-17T03:37:15.114 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 52 2024-09-17T03:37:15.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 -- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7febe0078b90 msgr2=0x7febe007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:15.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7febe0078b90 0x7febe007b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7febf8035000 tx=0x7febf802d040 comp rx=0 tx=0).stop 2024-09-17T03:37:15.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 -- 172.21.15.146:0/3858098962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc0c9e90 msgr2=0x7febfc0ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:15.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc0c9e90 0x7febfc0ca2a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7febf4002010 tx=0x7febf400ed10 comp rx=0 tx=0).stop 2024-09-17T03:37:15.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 -- 172.21.15.146:0/3858098962 shutdown_connections 2024-09-17T03:37:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7febe0078b90 0x7febe007b0a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc0c9e90 0x7febfc0ca2a0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7febfc15aab0 0x7febfc1508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 --2- 172.21.15.146:0/3858098962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febe8003a00 0x7febfc1f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 -- 172.21.15.146:0/3858098962 >> 172.21.15.146:0/3858098962 conn(0x7febfc09ba20 msgr2=0x7febfc0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 -- 172.21.15.146:0/3858098962 shutdown_connections 2024-09-17T03:37:15.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:15.115+0000 7fec04694640 1 -- 172.21.15.146:0/3858098962 wait complete. 2024-09-17T03:37:15.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:36:57.935632+0000', 'modified': '2024-09-17T03:37:13.959684+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7083}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7083': {'gid': 7083, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.146:6833/749858742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 749858742}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 749858742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:37:15.530 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7083:up:rejoin 2024-09-17T03:37:16.531 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:16.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.658+0000 7f34d33e4640 1 -- 172.21.15.146:0/2962125664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34cc15b770 msgr2=0x7f34cc06fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:16.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.658+0000 7f34d33e4640 1 --2- 172.21.15.146:0/2962125664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34cc15b770 0x7f34cc06fe10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f34c8005fd0 tx=0x7f34c802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.658+0000 7f34d33e4640 1 -- 172.21.15.146:0/2962125664 shutdown_connections 2024-09-17T03:37:16.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.658+0000 7f34d33e4640 1 --2- 172.21.15.146:0/2962125664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34cc072d90 0x7f34cc0b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.658+0000 7f34d33e4640 1 --2- 172.21.15.146:0/2962125664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34cc15b770 0x7f34cc06fe10 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.658+0000 7f34d33e4640 1 -- 172.21.15.146:0/2962125664 >> 172.21.15.146:0/2962125664 conn(0x7f34cc0b2060 msgr2=0x7f34cc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:16.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.658+0000 7f34d33e4640 1 -- 172.21.15.146:0/2962125664 shutdown_connections 2024-09-17T03:37:16.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.658+0000 7f34d33e4640 1 -- 172.21.15.146:0/2962125664 wait complete. 2024-09-17T03:37:16.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.660+0000 7f34d33e4640 1 Processor -- start 2024-09-17T03:37:16.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.660+0000 7f34d33e4640 1 -- start start 2024-09-17T03:37:16.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.661+0000 7f34d33e4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34cc070350 0x7f34cc1e67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:16.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.661+0000 7f34d33e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34cc15b770 0x7f34cc06ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.661+0000 7f34d33e4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34cc1409e0 0x7f34cc06f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.661+0000 7f34d33e4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0b4e90 con 0x7f34cc1409e0 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.661+0000 7f34d33e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0b4d10 con 0x7f34cc15b770 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.661+0000 7f34d33e4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc0b5010 con 0x7f34cc070350 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.661+0000 7f34d1981640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34cc1409e0 0x7f34cc06f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.661+0000 7f34d1981640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34cc1409e0 0x7f34cc06f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37974/0 (socket says 172.21.15.146:37974) 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.661+0000 7f34d1981640 1 -- 172.21.15.146:0/3139794553 learned_addr learned my addr 172.21.15.146:0/3139794553 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.661+0000 7f34d1180640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34cc070350 0x7f34cc1e67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.661+0000 7f34d097f640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34cc15b770 0x7f34cc06ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34d1981640 1 -- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34cc070350 msgr2=0x7f34cc1e67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34d1981640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34cc070350 0x7f34cc1e67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34d1981640 1 -- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34cc15b770 msgr2=0x7f34cc06ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:16.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34d1981640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34cc15b770 0x7f34cc06ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34d1981640 1 -- 172.21.15.146:0/3139794553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc1522b0 con 0x7f34cc1409e0 2024-09-17T03:37:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34d097f640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34cc15b770 0x7f34cc06ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34d1981640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34cc1409e0 0x7f34cc06f240 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f34c400caa0 tx=0x7f34c400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34c1ffb640 1 -- 172.21.15.146:0/3139794553 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c400adf0 con 0x7f34cc1409e0 2024-09-17T03:37:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34c1ffb640 1 -- 172.21.15.146:0/3139794553 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34c400f540 con 0x7f34cc1409e0 2024-09-17T03:37:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34d33e4640 1 -- 172.21.15.146:0/3139794553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc15d4d0 con 0x7f34cc1409e0 2024-09-17T03:37:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34c1ffb640 1 -- 172.21.15.146:0/3139794553 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c400f990 con 0x7f34cc1409e0 2024-09-17T03:37:16.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.662+0000 7f34d33e4640 1 -- 172.21.15.146:0/3139794553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc15da90 con 0x7f34cc1409e0 2024-09-17T03:37:16.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.663+0000 7f34d33e4640 1 -- 172.21.15.146:0/3139794553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34cc0b5570 con 0x7f34cc1409e0 2024-09-17T03:37:16.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.664+0000 7f34c1ffb640 1 -- 172.21.15.146:0/3139794553 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34c400fb30 con 0x7f34cc1409e0 2024-09-17T03:37:16.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.664+0000 7f34c1ffb640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34b0078bc0 0x7f34b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:16.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.665+0000 7f34c1ffb640 1 -- 172.21.15.146:0/3139794553 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7f34c409b8d0 con 0x7f34cc1409e0 2024-09-17T03:37:16.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.665+0000 7f34d1180640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34b0078bc0 0x7f34b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:16.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.665+0000 7f34d1180640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34b0078bc0 0x7f34b007b0d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f34c8033000 tx=0x7f34c8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:16.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.669+0000 7f34c1ffb640 1 -- 172.21.15.146:0/3139794553 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f34c4014030 con 0x7f34cc1409e0 2024-09-17T03:37:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.876+0000 7f34d33e4640 1 -- 172.21.15.146:0/3139794553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34cc072cf0 con 0x7f34cc1409e0 2024-09-17T03:37:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.877+0000 7f34c1ffb640 1 -- 172.21.15.146:0/3139794553 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5232 (secure 0 0 0) 0x7f34c400fe20 con 0x7f34cc1409e0 2024-09-17T03:37:16.877 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:16.877 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":53,"btime":"2024-09-17T03:37:15:965946+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4258283164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4258283164},{"type":"v1","addr":"172.21.15.179:6835","nonce":4258283164}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2636836918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2636836918},{"type":"v1","addr":"172.21.15.179:6837","nonce":2636836918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":7089,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/850685229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":850685229},{"type":"v1","addr":"172.21.15.146:6835","nonce":850685229}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:57.935632+0000","modified":"2024-09-17T03:37:15.965937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/749858742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":749858742},{"type":"v1","addr":"172.21.15.146:6833","nonce":749858742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7083,"qdb_cluster":[7083]},"id":5}]} 2024-09-17T03:37:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 53 2024-09-17T03:37:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 -- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34b0078bc0 msgr2=0x7f34b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34b0078bc0 0x7f34b007b0d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f34c8033000 tx=0x7f34c8004730 comp rx=0 tx=0).stop 2024-09-17T03:37:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 -- 172.21.15.146:0/3139794553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34cc1409e0 msgr2=0x7f34cc06f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34cc1409e0 0x7f34cc06f240 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f34c400caa0 tx=0x7f34c400cf60 comp rx=0 tx=0).stop 2024-09-17T03:37:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 -- 172.21.15.146:0/3139794553 shutdown_connections 2024-09-17T03:37:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34b0078bc0 0x7f34b007b0d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34cc1409e0 0x7f34cc06f240 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34cc15b770 0x7f34cc06ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 --2- 172.21.15.146:0/3139794553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34cc070350 0x7f34cc1e67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 -- 172.21.15.146:0/3139794553 >> 172.21.15.146:0/3139794553 conn(0x7f34cc0b2060 msgr2=0x7f34cc159020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 -- 172.21.15.146:0/3139794553 shutdown_connections 2024-09-17T03:37:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:16.879+0000 7f34d33e4640 1 -- 172.21.15.146:0/3139794553 wait complete. 2024-09-17T03:37:17.294 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:36:57.935632+0000', 'modified': '2024-09-17T03:37:15.965937+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 76, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7083}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7083': {'gid': 7083, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.146:6833/749858742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 749858742}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 749858742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7083, 'qdb_cluster': [7083]} 2024-09-17T03:37:17.294 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:37:17.294 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:37:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.408+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/4087055501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc006dd60 msgr2=0x7fcbc006e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.408+0000 7fcbc4bc3640 1 --2- 172.21.15.146:0/4087055501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc006dd60 0x7fcbc006e170 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8005fd0 tx=0x7fcbb802aa90 comp rx=0 tx=0).stop 2024-09-17T03:37:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.408+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/4087055501 shutdown_connections 2024-09-17T03:37:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.408+0000 7fcbc4bc3640 1 --2- 172.21.15.146:0/4087055501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc006dd60 0x7fcbc006e170 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.408+0000 7fcbc4bc3640 1 --2- 172.21.15.146:0/4087055501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbc00b55f0 0x7fcbc0070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.409+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/4087055501 >> 172.21.15.146:0/4087055501 conn(0x7fcbc00b3410 msgr2=0x7fcbc00b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.409+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/4087055501 shutdown_connections 2024-09-17T03:37:17.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.409+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/4087055501 wait complete. 2024-09-17T03:37:17.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.411+0000 7fcbc4bc3640 1 Processor -- start 2024-09-17T03:37:17.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.411+0000 7fcbc4bc3640 1 -- start start 2024-09-17T03:37:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbc4bc3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbc006dd60 0x7fcbc0140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbc4bc3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc0071120 0x7fcbc0142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbc4bc3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbc00b55f0 0x7fcbc0143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbc4bc3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc015be90 con 0x7fcbc0071120 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbc4bc3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc015bd10 con 0x7fcbc006dd60 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbc4bc3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc015c010 con 0x7fcbc00b55f0 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbb5d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc0071120 0x7fcbc0142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbb5d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc0071120 0x7fcbc0142ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59074/0 (socket says 172.21.15.146:59074) 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbb5d9b640 1 -- 172.21.15.146:0/2996323774 learned_addr learned my addr 172.21.15.146:0/2996323774 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbbed9d640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbc00b55f0 0x7fcbc0143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbc006dd60 0x7fcbc0140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbb5d9b640 1 -- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbc00b55f0 msgr2=0x7fcbc0143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbb5d9b640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbc00b55f0 0x7fcbc0143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbb5d9b640 1 -- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbc006dd60 msgr2=0x7fcbc0140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbb5d9b640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbc006dd60 0x7fcbc0140790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.412+0000 7fcbb5d9b640 1 -- 172.21.15.146:0/2996323774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc0156b10 con 0x7fcbc0071120 2024-09-17T03:37:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.413+0000 7fcbb5d9b640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc0071120 0x7fcbc0142ec0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c3c0 tx=0x7fcba800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.413+0000 7fcbb77fe640 1 -- 172.21.15.146:0/2996323774 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba80052d0 con 0x7fcbc0071120 2024-09-17T03:37:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.413+0000 7fcbb77fe640 1 -- 172.21.15.146:0/2996323774 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcba8007020 con 0x7fcbc0071120 2024-09-17T03:37:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.413+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/2996323774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc0156550 con 0x7fcbc0071120 2024-09-17T03:37:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.413+0000 7fcbb77fe640 1 -- 172.21.15.146:0/2996323774 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba8007470 con 0x7fcbc0071120 2024-09-17T03:37:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.413+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/2996323774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc00d0e20 con 0x7fcbc0071120 2024-09-17T03:37:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.415+0000 7fcbb77fe640 1 -- 172.21.15.146:0/2996323774 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcba80067d0 con 0x7fcbc0071120 2024-09-17T03:37:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.416+0000 7fcbb77fe640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcba0078bc0 0x7fcba007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.416+0000 7fcbb77fe640 1 -- 172.21.15.146:0/2996323774 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7fcba809a000 con 0x7fcbc0071120 2024-09-17T03:37:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.416+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcba0078bc0 0x7fcba007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.416+0000 7fcbcbc13740 1 Processor -- start 2024-09-17T03:37:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.417+0000 7fcbcbc13740 1 -- start start 2024-09-17T03:37:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.417+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcba0078bc0 0x7fcba007b0d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000bb50 tx=0x7fcbb000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fe1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534be73b0 0x564534fe24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534bef590 0x564534fff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564534f2a820 con 0x564534c10270 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564534f19c50 con 0x564534bef590 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564534f1da60 con 0x564534be73b0 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbbe59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fe1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbbe59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fe1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59084/0 (socket says 172.21.15.146:59084) 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbbe59c640 1 -- 172.21.15.146:0/2262411624 learned_addr learned my addr 172.21.15.146:0/2262411624 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbbed9d640 1 --2- 172.21.15.146:0/2262411624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534bef590 0x564534fff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbb5d9b640 1 --2- 172.21.15.146:0/2262411624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534be73b0 0x564534fe24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbbe59c640 1 -- 172.21.15.146:0/2262411624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534be73b0 msgr2=0x564534fe24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/2262411624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534be73b0 0x564534fe24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbbe59c640 1 -- 172.21.15.146:0/2262411624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534bef590 msgr2=0x564534fff3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/2262411624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534bef590 0x564534fff3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbbe59c640 1 -- 172.21.15.146:0/2262411624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564534c7b850 con 0x564534c10270 2024-09-17T03:37:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbbed9d640 1 --2- 172.21.15.146:0/2262411624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534bef590 0x564534fff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.418+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/2262411624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fe1fa0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0005d00 tx=0x7fcbb0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e703172f5bdee2e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.419+0000 7fcb9ffff640 1 -- 172.21.15.146:0/2262411624 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb001e620 con 0x564534c10270 2024-09-17T03:37:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.419+0000 7fcb9ffff640 1 -- 172.21.15.146:0/2262411624 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbb001e7c0 con 0x564534c10270 2024-09-17T03:37:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.419+0000 7fcb9ffff640 1 -- 172.21.15.146:0/2262411624 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb001ebb0 con 0x564534c10270 2024-09-17T03:37:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.419+0000 7fcbcbc13740 1 -- 172.21.15.146:0/2262411624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 msgr2=0x564534fe1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.419+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/2262411624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fe1fa0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0005d00 tx=0x7fcbb0013000 comp rx=0 tx=0).stop 2024-09-17T03:37:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.419+0000 7fcbcbc13740 1 -- 172.21.15.146:0/2262411624 shutdown_connections 2024-09-17T03:37:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.419+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/2262411624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534bef590 0x564534fff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.419+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/2262411624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534be73b0 0x564534fe24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.419+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/2262411624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fe1fa0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.419+0000 7fcbcbc13740 1 -- 172.21.15.146:0/2262411624 >> 172.21.15.146:0/2262411624 conn(0x564534c043c0 msgr2=0x564534fb8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.420+0000 7fcbcbc13740 1 -- 172.21.15.146:0/2262411624 shutdown_connections 2024-09-17T03:37:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.420+0000 7fcbcbc13740 1 -- 172.21.15.146:0/2262411624 wait complete. 2024-09-17T03:37:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.420+0000 7fcbcbc13740 1 -- start start 2024-09-17T03:37:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.420+0000 7fcbcbc13740 1 Processor -- start 2024-09-17T03:37:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534be73b0 0x564534fb6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x564534fca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534c10270 0x564534fb17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564534c8a620 con 0x564534be73b0 2024-09-17T03:37:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564534ebf5f0 con 0x564534c10270 2024-09-17T03:37:17.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564534fe2a20 con 0x564534bef590 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbcbc13740 10 client.0 _ll_register_callbacks cb 0x564534ec30a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbbe59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534be73b0 0x564534fb6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbbe59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534be73b0 0x564534fb6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59090/0 (socket says 172.21.15.146:59090) 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbbe59c640 1 -- 172.21.15.146:0/3342937196 learned_addr learned my addr 172.21.15.146:0/3342937196 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbb5d9b640 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x564534fca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbbed9d640 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534c10270 0x564534fb17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbbe59c640 1 -- 172.21.15.146:0/3342937196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 msgr2=0x564534fca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x564534fca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbbe59c640 1 -- 172.21.15.146:0/3342937196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534c10270 msgr2=0x564534fb17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534c10270 0x564534fb17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.422+0000 7fcbbe59c640 1 -- 172.21.15.146:0/3342937196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564534cf26b0 con 0x564534be73b0 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534be73b0 0x564534fb6a70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x564534fb9e30 tx=0x7fcbb001e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ff53e09bbdeac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcb9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:17.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3342937196 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0034060 con 0x564534be73b0 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3342937196 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7fcbb001ecc0 con 0x564534be73b0 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3342937196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbb001e7c0 con 0x564534be73b0 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3342937196 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fcbb003a050 con 0x564534be73b0 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcbcbc13740 10 client.7116 fetch_fsmap learned FSMap version 53 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3342937196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x564534ff6570 con 0x564534be73b0 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3342937196 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbb001e7c0 con 0x564534be73b0 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3342937196 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7fcbb003d020 con 0x564534be73b0 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcbcbc13740 10 client.7116 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcbcbc13740 10 client.7116 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcbcbc13740 20 client.7116 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x564534bcee40 0x56453500f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcbcbc13740 4 client.7116 mds_command: new command op to 7083 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:37:17.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3342937196 --> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564534f2c770 con 0x564534bcee40 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.423+0000 7fcbb5d9b640 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x564534bcee40 0x56453500f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.424+0000 7fcb9d7fa640 10 client.7116 ms_handle_connect on v2:172.21.15.146:6832/749858742 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.424+0000 7fcbb5d9b640 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x564534bcee40 0x56453500f590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a73034217e9eeede server_cookie=45d80cf0bf141d42 in_seq=0 out_seq=0 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.424+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3342937196 <== mds.0 v2:172.21.15.146:6832/749858742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564534f2c770 con 0x564534bcee40 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.424+0000 7fcb9d7fa640 10 client.7116 handle_command_reply: tid=0 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 1 client.7116 shutdown 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3342937196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534be73b0 msgr2=0x564534fb6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534be73b0 0x564534fb6a70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x564534fb9e30 tx=0x7fcbb001e650 comp rx=0 tx=0).stop 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3342937196 shutdown_connections 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534c10270 0x564534fb17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x564534fca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x564534bcee40 0x56453500f590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3342937196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534be73b0 0x564534fb6a70 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcb9d7fa640 0 client.7116 ms_handle_reset on v2:172.21.15.146:6832/749858742 2024-09-17T03:37:17.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3342937196 >> 172.21.15.146:0/3342937196 conn(0x564534c043c0 msgr2=0x564534ffe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:17.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3342937196 shutdown_connections 2024-09-17T03:37:17.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3342937196 wait complete. 2024-09-17T03:37:17.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.425+0000 7fcbcbc13740 20 client.7116 trim_cache size 0 max 16384 2024-09-17T03:37:17.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.443+0000 7fcbcbc13740 1 Processor -- start 2024-09-17T03:37:17.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.443+0000 7fcbcbc13740 1 -- start start 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534be73b0 0x56453500b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x56453500b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fd0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc01ff410 con 0x564534c10270 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc01f74e0 con 0x564534be73b0 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc01f7b30 con 0x564534bef590 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbbed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fd0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbbed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fd0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59104/0 (socket says 172.21.15.146:59104) 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbbed9d640 1 -- 172.21.15.146:0/2182913617 learned_addr learned my addr 172.21.15.146:0/2182913617 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbbed9d640 1 -- 172.21.15.146:0/2182913617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 msgr2=0x56453500b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbb5d9b640 1 --2- 172.21.15.146:0/2182913617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x56453500b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbbed9d640 1 --2- 172.21.15.146:0/2182913617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x56453500b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbbed9d640 1 -- 172.21.15.146:0/2182913617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534be73b0 msgr2=0x56453500b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:17.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbbed9d640 1 --2- 172.21.15.146:0/2182913617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534be73b0 0x56453500b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbbed9d640 1 -- 172.21.15.146:0/2182913617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564535017530 con 0x564534c10270 2024-09-17T03:37:17.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcbbed9d640 1 --2- 172.21.15.146:0/2182913617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fd0710 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009d90 tx=0x7fcbb8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c7357899f58d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:17.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcb9f7fe640 1 -- 172.21.15.146:0/2182913617 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb802e650 con 0x564534c10270 2024-09-17T03:37:17.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcb9f7fe640 1 -- 172.21.15.146:0/2182913617 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbb802e7f0 con 0x564534c10270 2024-09-17T03:37:17.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.445+0000 7fcb9f7fe640 1 -- 172.21.15.146:0/2182913617 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb802ebe0 con 0x564534c10270 2024-09-17T03:37:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.446+0000 7fcbcbc13740 1 -- 172.21.15.146:0/2182913617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 msgr2=0x564534fd0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.446+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/2182913617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fd0710 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009d90 tx=0x7fcbb8004ab0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.446+0000 7fcbcbc13740 1 -- 172.21.15.146:0/2182913617 shutdown_connections 2024-09-17T03:37:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.446+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/2182913617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x564534fd0710 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.446+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/2182913617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x56453500b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.446+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/2182913617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534be73b0 0x56453500b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.446+0000 7fcbcbc13740 1 -- 172.21.15.146:0/2182913617 >> 172.21.15.146:0/2182913617 conn(0x564534c043c0 msgr2=0x564534fb1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.446+0000 7fcbcbc13740 1 -- 172.21.15.146:0/2182913617 shutdown_connections 2024-09-17T03:37:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.446+0000 7fcbcbc13740 1 -- 172.21.15.146:0/2182913617 wait complete. 2024-09-17T03:37:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.447+0000 7fcbcbc13740 1 -- start start 2024-09-17T03:37:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.447+0000 7fcbcbc13740 1 Processor -- start 2024-09-17T03:37:17.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534be73b0 0x564534fe2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x56453507b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbcbc13740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x56453500b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564534ff5810 con 0x564534c10270 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564534fcab40 con 0x564534be73b0 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbcbc13740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564534ff48b0 con 0x564534bef590 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbcbc13740 10 client.0 _ll_register_callbacks cb 0x7fcbb0010eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbbed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x56453500b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbbed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x56453500b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59110/0 (socket says 172.21.15.146:59110) 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbbed9d640 1 -- 172.21.15.146:0/3501245305 learned_addr learned my addr 172.21.15.146:0/3501245305 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbb5d9b640 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x56453507b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534be73b0 0x564534fe2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbbed9d640 1 -- 172.21.15.146:0/3501245305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 msgr2=0x56453507b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbbed9d640 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x56453507b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbbed9d640 1 -- 172.21.15.146:0/3501245305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534be73b0 msgr2=0x564534fe2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbbed9d640 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534be73b0 0x564534fe2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbbed9d640 1 -- 172.21.15.146:0/3501245305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564534ffef20 con 0x564534c10270 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534be73b0 0x564534fe2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbbed9d640 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x56453500b1a0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8006010 tx=0x7fcbb8043690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2996d89b36729bc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcb9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3501245305 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8051020 con 0x564534c10270 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3501245305 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7fcbb8043c90 con 0x564534c10270 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3501245305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbb802e7f0 con 0x564534c10270 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3501245305 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fcbb805b050 con 0x564534c10270 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.449+0000 7fcbcbc13740 10 client.7122 fetch_fsmap learned FSMap version 53 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3501245305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x56453507ba90 con 0x564534c10270 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3501245305 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbb802e7f0 con 0x564534c10270 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3501245305 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7fcbb805e020 con 0x564534c10270 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcbcbc13740 10 client.7122 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcbcbc13740 10 client.7122 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:37:17.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcbcbc13740 20 client.7122 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x56453500b6e0 0x564534fcef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcbcbc13740 4 client.7122 mds_command: new command op to 7083 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3501245305 --> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] -- command(tid 0: {"prefix": "status"}) -- 0x564534f28220 con 0x56453500b6e0 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x56453500b6e0 0x564534fcef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcb9d7fa640 10 client.7122 ms_handle_connect on v2:172.21.15.146:6832/749858742 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.450+0000 7fcbbe59c640 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x56453500b6e0 0x564534fcef10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e1166b6189774c0 server_cookie=729854599333ec29 in_seq=0 out_seq=0 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcb9d7fa640 1 -- 172.21.15.146:0/3501245305 <== mds.0 v2:172.21.15.146:6832/749858742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564534f28220 con 0x56453500b6e0 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcb9d7fa640 10 client.7122 handle_command_reply: tid=0 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 1 client.7122 shutdown 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3501245305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 msgr2=0x56453500b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x56453500b1a0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8006010 tx=0x7fcbb8043690 comp rx=0 tx=0).stop 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3501245305 shutdown_connections 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x56453500b6e0 0x564534fcef10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564534c10270 0x56453500b1a0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564534bef590 0x56453507b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcb9d7fa640 0 client.7122 ms_handle_reset on v2:172.21.15.146:6832/749858742 2024-09-17T03:37:17.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 1 --2- 172.21.15.146:0/3501245305 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564534be73b0 0x564534fe2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3501245305 >> 172.21.15.146:0/3501245305 conn(0x564534c043c0 msgr2=0x564534fdee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:17.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3501245305 shutdown_connections 2024-09-17T03:37:17.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 1 -- 172.21.15.146:0/3501245305 wait complete. 2024-09-17T03:37:17.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.451+0000 7fcbcbc13740 20 client.7122 trim_cache size 0 max 16384 2024-09-17T03:37:17.456 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:37:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:37:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:37:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 7083, 2024-09-17T03:37:17.456 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:37:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:37:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:37:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 4.4990867129999996, 2024-09-17T03:37:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 53, 2024-09-17T03:37:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 77, 2024-09-17T03:37:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 77, 2024-09-17T03:37:17.457 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 5.3699842049999997 2024-09-17T03:37:17.457 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:37:17.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcba0078bc0 msgr2=0x7fcba007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcba0078bc0 0x7fcba007b0d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000bb50 tx=0x7fcbb000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/2996323774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc0071120 msgr2=0x7fcbc0142ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc0071120 0x7fcbc0142ec0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c3c0 tx=0x7fcba800c880 comp rx=0 tx=0).stop 2024-09-17T03:37:17.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/2996323774 shutdown_connections 2024-09-17T03:37:17.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcba0078bc0 0x7fcba007b0d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbc00b55f0 0x7fcbc0143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc0071120 0x7fcbc0142ec0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 --2- 172.21.15.146:0/2996323774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbc006dd60 0x7fcbc0140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/2996323774 >> 172.21.15.146:0/2996323774 conn(0x7fcbc00b3410 msgr2=0x7fcbc00b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:17.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/2996323774 shutdown_connections 2024-09-17T03:37:17.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.452+0000 7fcbc4bc3640 1 -- 172.21.15.146:0/2996323774 wait complete. 2024-09-17T03:37:17.463 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:37:17.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.575+0000 7f2b98a30640 1 -- 172.21.15.146:0/1649352875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b9415c8e0 msgr2=0x7f2b9406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.575+0000 7f2b98a30640 1 --2- 172.21.15.146:0/1649352875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b9415c8e0 0x7f2b9406f580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009be0 tx=0x7f2b8402a890 comp rx=0 tx=0).stop 2024-09-17T03:37:17.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.575+0000 7f2b98a30640 1 -- 172.21.15.146:0/1649352875 shutdown_connections 2024-09-17T03:37:17.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.575+0000 7f2b98a30640 1 --2- 172.21.15.146:0/1649352875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b9415c8e0 0x7f2b9406f580 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.575+0000 7f2b98a30640 1 -- 172.21.15.146:0/1649352875 >> 172.21.15.146:0/1649352875 conn(0x7f2b940b3150 msgr2=0x7f2b940b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:17.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.575+0000 7f2b98a30640 1 -- 172.21.15.146:0/1649352875 shutdown_connections 2024-09-17T03:37:17.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.575+0000 7f2b98a30640 1 -- 172.21.15.146:0/1649352875 wait complete. 2024-09-17T03:37:17.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.577+0000 7f2b98a30640 1 Processor -- start 2024-09-17T03:37:17.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.577+0000 7f2b98a30640 1 -- start start 2024-09-17T03:37:17.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.578+0000 7f2b98a30640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b940cd840 0x7f2b941f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.578+0000 7f2b98a30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b940cdc50 0x7f2b941f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.578+0000 7f2b98a30640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b9415c8e0 0x7f2b94151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.578+0000 7f2b98a30640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b94073700 con 0x7f2b940cdc50 2024-09-17T03:37:17.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.578+0000 7f2b98a30640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2b94073580 con 0x7f2b9415c8e0 2024-09-17T03:37:17.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.578+0000 7f2b98a30640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2b94073880 con 0x7f2b940cd840 2024-09-17T03:37:17.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.578+0000 7f2b91d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b940cdc50 0x7f2b941f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.578+0000 7f2b91d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b940cdc50 0x7f2b941f6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59114/0 (socket says 172.21.15.146:59114) 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.578+0000 7f2b91d9b640 1 -- 172.21.15.146:0/4234034905 learned_addr learned my addr 172.21.15.146:0/4234034905 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b9259c640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b940cd840 0x7f2b941f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b92d9d640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b9415c8e0 0x7f2b94151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b91d9b640 1 -- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b940cd840 msgr2=0x7f2b941f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b91d9b640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b940cd840 0x7f2b941f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b91d9b640 1 -- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b9415c8e0 msgr2=0x7f2b94151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b91d9b640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b9415c8e0 0x7f2b94151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b91d9b640 1 -- 172.21.15.146:0/4234034905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b941f2d40 con 0x7f2b940cdc50 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b91d9b640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b940cdc50 0x7f2b941f6240 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c400 tx=0x7f2b8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b82ffd640 1 -- 172.21.15.146:0/4234034905 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88017070 con 0x7f2b940cdc50 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b82ffd640 1 -- 172.21.15.146:0/4234034905 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b880053c0 con 0x7f2b940cdc50 2024-09-17T03:37:17.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b98a30640 1 -- 172.21.15.146:0/4234034905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b941f3020 con 0x7f2b940cdc50 2024-09-17T03:37:17.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b82ffd640 1 -- 172.21.15.146:0/4234034905 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88003850 con 0x7f2b940cdc50 2024-09-17T03:37:17.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.579+0000 7f2b98a30640 1 -- 172.21.15.146:0/4234034905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b94154b70 con 0x7f2b940cdc50 2024-09-17T03:37:17.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.580+0000 7f2b98a30640 1 -- 172.21.15.146:0/4234034905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b941f2ab0 con 0x7f2b940cdc50 2024-09-17T03:37:17.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.581+0000 7f2b82ffd640 1 -- 172.21.15.146:0/4234034905 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b8801a070 con 0x7f2b940cdc50 2024-09-17T03:37:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.581+0000 7f2b82ffd640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 0x7f2b7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.582+0000 7f2b82ffd640 1 -- 172.21.15.146:0/4234034905 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7f2b8809a4b0 con 0x7f2b940cdc50 2024-09-17T03:37:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.582+0000 7f2b9259c640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 0x7f2b7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:17.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.582+0000 7f2b9259c640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 0x7f2b7407b0d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2b84034000 tx=0x7f2b84004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:17.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.585+0000 7f2b82ffd640 1 -- 172.21.15.146:0/4234034905 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2b88021020 con 0x7f2b940cdc50 2024-09-17T03:37:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.796+0000 7f2b98a30640 1 -- 172.21.15.146:0/4234034905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2b94073d70 con 0x7f2b940cdc50 2024-09-17T03:37:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.796+0000 7f2b82ffd640 1 -- 172.21.15.146:0/4234034905 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) ==== 53+0+73 (secure 0 0 0) 0x7f2b880622b0 con 0x7f2b940cdc50 2024-09-17T03:37:17.796 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:37:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 -- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 msgr2=0x7f2b7407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 0x7f2b7407b0d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2b84034000 tx=0x7f2b84004ab0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 -- 172.21.15.146:0/4234034905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b940cdc50 msgr2=0x7f2b941f6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b940cdc50 0x7f2b941f6240 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c400 tx=0x7f2b8800c8c0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 -- 172.21.15.146:0/4234034905 shutdown_connections 2024-09-17T03:37:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 0x7f2b7407b0d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b9415c8e0 0x7f2b94151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b940cdc50 0x7f2b941f6240 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 --2- 172.21.15.146:0/4234034905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b940cd840 0x7f2b941f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 -- 172.21.15.146:0/4234034905 >> 172.21.15.146:0/4234034905 conn(0x7f2b940b3150 msgr2=0x7f2b940b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 -- 172.21.15.146:0/4234034905 shutdown_connections 2024-09-17T03:37:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:17.798+0000 7f2b98a30640 1 -- 172.21.15.146:0/4234034905 wait complete. 2024-09-17T03:37:17.810 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:37:17.810 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:37:17.810 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:37:17.810 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:37:17.810 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:17.810 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:37:17.810 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:37:17.810 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:37:17.810 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:17.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:17.810 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:37:17.826 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:37:17.826 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:37:17.826 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:37:17.826 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:17.827 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:37:17.828 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42534sec preferred_lft 42534sec 2024-09-17T03:37:17.828 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:37:17.828 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:17.828 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:37:17.828 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:17.828 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:37:17.828 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:17.828 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:37:17.828 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:17.828 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:17.829 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:37:17.829 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:37:17.829 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:17.829 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:17.829 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:37:17.829 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:37:17.829 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:17.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:17.829 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:37:17.890 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:37:17.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:17.892 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:37:17.948 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:37:17.949 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:37:17.949 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:37:17.949 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:37:17.949 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:37:17.949 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:37:17.949 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:37:17.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:37:17.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:37:17.950 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:37:17.950 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:37:18.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:37:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:18.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:18.075 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:37:18.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:37:18.091 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:37:18.091 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:18.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:18.091 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:37:18.155 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:18.155 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:18.211 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:18.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:18.211 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:18.266 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:37:18.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:18.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:18.361 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:18.361 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:18.362 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:37:18.372 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:18.372 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:18.373 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:37:18.373 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:37:18.373 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:18.379 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:18.379 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:18.379 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:37:18.379 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:37:18.379 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:18.380 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:37:18.380 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:37:18.380 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:37:18.380 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:37:18.380 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:37:18.380 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:37:18.380 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:37:18.380 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:37:18.382 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:37:18.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:18.382 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:18.406 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:37:18.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:37:18.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:18.503 INFO:teuthology.orchestra.run.smithi146.stdout:client6113 2024-09-17T03:37:18.503 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:18.503 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:18.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:18.519 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-17T03:37:18.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:37:18.575 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-09-17T03:37:18.576 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-09-17T03:37:18.576 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /scrub_repair_path repair 2024-09-17T03:37:18.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.733+0000 7fc17224d640 1 -- 172.21.15.146:0/4083577021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc16c0b47c0 msgr2=0x7fc16c0cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:18.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.733+0000 7fc17224d640 1 --2- 172.21.15.146:0/4083577021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc16c0b47c0 0x7fc16c0cd090 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fc154009830 tx=0x7fc15402a480 comp rx=0 tx=0).stop 2024-09-17T03:37:18.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.733+0000 7fc17224d640 1 -- 172.21.15.146:0/4083577021 shutdown_connections 2024-09-17T03:37:18.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.733+0000 7fc17224d640 1 --2- 172.21.15.146:0/4083577021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc16c0cd5d0 0x7fc16c0cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.733+0000 7fc17224d640 1 --2- 172.21.15.146:0/4083577021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc16c0b47c0 0x7fc16c0cd090 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.733+0000 7fc17224d640 1 -- 172.21.15.146:0/4083577021 >> 172.21.15.146:0/4083577021 conn(0x7fc16c09ba20 msgr2=0x7fc16c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:18.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.733+0000 7fc17224d640 1 -- 172.21.15.146:0/4083577021 shutdown_connections 2024-09-17T03:37:18.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.733+0000 7fc17224d640 1 -- 172.21.15.146:0/4083577021 wait complete. 2024-09-17T03:37:18.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.735+0000 7fc17224d640 1 Processor -- start 2024-09-17T03:37:18.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.735+0000 7fc17224d640 1 -- start start 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc17224d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc16c0b47c0 0x7fc16c1d6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc17224d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc16c0cd5d0 0x7fc16c0c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc17224d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc16c0d0710 0x7fc16c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc17224d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c0b1de0 con 0x7fc16c0b47c0 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc17224d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c0b80a0 con 0x7fc16c0cd5d0 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc17224d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc16c0b1f60 con 0x7fc16c0d0710 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc16c0b47c0 0x7fc16c1d6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc16c0b47c0 0x7fc16c1d6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59126/0 (socket says 172.21.15.146:59126) 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16b7fe640 1 -- 172.21.15.146:0/846372703 learned_addr learned my addr 172.21.15.146:0/846372703 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16affd640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc16c0cd5d0 0x7fc16c0c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16bfff640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc16c0d0710 0x7fc16c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16b7fe640 1 -- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc16c0d0710 msgr2=0x7fc16c0c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc16c0d0710 0x7fc16c0c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16b7fe640 1 -- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc16c0cd5d0 msgr2=0x7fc16c0c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc16c0cd5d0 0x7fc16c0c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16b7fe640 1 -- 172.21.15.146:0/846372703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16c0b1650 con 0x7fc16c0b47c0 2024-09-17T03:37:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16affd640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc16c0cd5d0 0x7fc16c0c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc16c0b47c0 0x7fc16c1d6690 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00c3c0 tx=0x7fc15c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc163fff640 1 -- 172.21.15.146:0/846372703 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c017070 con 0x7fc16c0b47c0 2024-09-17T03:37:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc163fff640 1 -- 172.21.15.146:0/846372703 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc15c0035f0 con 0x7fc16c0b47c0 2024-09-17T03:37:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc17224d640 1 -- 172.21.15.146:0/846372703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16c0c6bd0 con 0x7fc16c0b47c0 2024-09-17T03:37:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc163fff640 1 -- 172.21.15.146:0/846372703 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c003a80 con 0x7fc16c0b47c0 2024-09-17T03:37:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.737+0000 7fc17224d640 1 -- 172.21.15.146:0/846372703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16c0c7190 con 0x7fc16c0b47c0 2024-09-17T03:37:18.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.739+0000 7fc163fff640 1 -- 172.21.15.146:0/846372703 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc15c01a070 con 0x7fc16c0b47c0 2024-09-17T03:37:18.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.740+0000 7fc163fff640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc14c078bc0 0x7fc14c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.740+0000 7fc163fff640 1 -- 172.21.15.146:0/846372703 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7fc15c099f00 con 0x7fc16c0b47c0 2024-09-17T03:37:18.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.740+0000 7fc16affd640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc14c078bc0 0x7fc14c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.741+0000 7fc16affd640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc14c078bc0 0x7fc14c07b0d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc154034000 tx=0x7fc154004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:18.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.741+0000 7fc1791c6740 1 Processor -- start 2024-09-17T03:37:18.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.741+0000 7fc1791c6740 1 -- start start 2024-09-17T03:37:18.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.742+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721ff4680 0x55b7223e18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.742+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fcb7c0 0x55b722396260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.742+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fd39a0 0x55b7223967a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.742+0000 7fc1791c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b72230ec30 con 0x55b721fd39a0 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.742+0000 7fc1791c6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b7222fe060 con 0x55b721ff4680 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.742+0000 7fc1791c6740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55b722301e70 con 0x55b721fcb7c0 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fd39a0 0x55b7223967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fd39a0 0x55b7223967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59134/0 (socket says 172.21.15.146:59134) 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16bfff640 1 -- 172.21.15.146:0/3132421691 learned_addr learned my addr 172.21.15.146:0/3132421691 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16affd640 1 --2- 172.21.15.146:0/3132421691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fcb7c0 0x55b722396260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/3132421691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721ff4680 0x55b7223e18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16bfff640 1 -- 172.21.15.146:0/3132421691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fcb7c0 msgr2=0x55b722396260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16bfff640 1 --2- 172.21.15.146:0/3132421691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fcb7c0 0x55b722396260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16bfff640 1 -- 172.21.15.146:0/3132421691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721ff4680 msgr2=0x55b7223e18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16bfff640 1 --2- 172.21.15.146:0/3132421691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721ff4680 0x55b7223e18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16bfff640 1 -- 172.21.15.146:0/3132421691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7220d8af0 con 0x55b721fd39a0 2024-09-17T03:37:18.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/3132421691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721ff4680 0x55b7223e18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:18.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc16bfff640 1 --2- 172.21.15.146:0/3132421691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fd39a0 0x55b7223967a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fc164009f20 tx=0x7fc164010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e79df33ac95623 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:18.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc1617fa640 1 -- 172.21.15.146:0/3132421691 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164016070 con 0x55b721fd39a0 2024-09-17T03:37:18.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc1617fa640 1 -- 172.21.15.146:0/3132421691 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc164004e10 con 0x55b721fd39a0 2024-09-17T03:37:18.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.743+0000 7fc1617fa640 1 -- 172.21.15.146:0/3132421691 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164005260 con 0x55b721fd39a0 2024-09-17T03:37:18.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.744+0000 7fc1791c6740 1 -- 172.21.15.146:0/3132421691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fd39a0 msgr2=0x55b7223967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:18.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.744+0000 7fc1791c6740 1 --2- 172.21.15.146:0/3132421691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fd39a0 0x55b7223967a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fc164009f20 tx=0x7fc164010800 comp rx=0 tx=0).stop 2024-09-17T03:37:18.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.744+0000 7fc1791c6740 1 -- 172.21.15.146:0/3132421691 shutdown_connections 2024-09-17T03:37:18.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.744+0000 7fc1791c6740 1 --2- 172.21.15.146:0/3132421691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fd39a0 0x55b7223967a0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.744+0000 7fc1791c6740 1 --2- 172.21.15.146:0/3132421691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fcb7c0 0x55b722396260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.744+0000 7fc1791c6740 1 --2- 172.21.15.146:0/3132421691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721ff4680 0x55b7223e18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.744+0000 7fc1791c6740 1 -- 172.21.15.146:0/3132421691 >> 172.21.15.146:0/3132421691 conn(0x55b721fe87d0 msgr2=0x55b72239bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.744+0000 7fc1791c6740 1 -- 172.21.15.146:0/3132421691 shutdown_connections 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.744+0000 7fc1791c6740 1 -- 172.21.15.146:0/3132421691 wait complete. 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.745+0000 7fc1791c6740 1 -- start start 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.745+0000 7fc1791c6740 1 Processor -- start 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.746+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b7223db250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.746+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721fd39a0 0x55b7223966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.746+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721ff4680 0x55b722396be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.746+0000 7fc1791c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b72206ea30 con 0x55b721fcb7c0 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.746+0000 7fc1791c6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b7222a35d0 con 0x55b721fd39a0 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.746+0000 7fc1791c6740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55b7223a2400 con 0x55b721ff4680 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.746+0000 7fc1791c6740 10 client.0 _ll_register_callbacks cb 0x55b7222f6eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.746+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b7223db250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.746+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b7223db250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59144/0 (socket says 172.21.15.146:59144) 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.746+0000 7fc16b7fe640 1 -- 172.21.15.146:0/3794833979 learned_addr learned my addr 172.21.15.146:0/3794833979 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc16affd640 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721fd39a0 0x55b7223966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc16bfff640 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721ff4680 0x55b722396be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc16b7fe640 1 -- 172.21.15.146:0/3794833979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721ff4680 msgr2=0x55b722396be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721ff4680 0x55b722396be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc16b7fe640 1 -- 172.21.15.146:0/3794833979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721fd39a0 msgr2=0x55b7223966a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721fd39a0 0x55b7223966a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc16b7fe640 1 -- 172.21.15.146:0/3794833979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72203d990 con 0x55b721fcb7c0 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b7223db250 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0983f0 tx=0x7fc15c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63b2a17f3a73b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc14a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc14a7fc640 1 -- 172.21.15.146:0/3794833979 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c066750 con 0x55b721fcb7c0 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc14a7fc640 1 -- 172.21.15.146:0/3794833979 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7fc15c060f80 con 0x55b721fcb7c0 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc1791c6740 1 -- 172.21.15.146:0/3794833979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc164004e10 con 0x55b721fcb7c0 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc14a7fc640 1 -- 172.21.15.146:0/3794833979 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fc15c06b600 con 0x55b721fcb7c0 2024-09-17T03:37:18.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc1791c6740 10 client.7143 fetch_fsmap learned FSMap version 53 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc1791c6740 1 -- 172.21.15.146:0/3794833979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55b722139280 con 0x55b721fcb7c0 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc14a7fc640 1 -- 172.21.15.146:0/3794833979 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc164004e10 con 0x55b721fcb7c0 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc14a7fc640 1 -- 172.21.15.146:0/3794833979 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7fc15c05d670 con 0x55b721fcb7c0 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc1791c6740 10 client.7143 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.747+0000 7fc1791c6740 10 client.7143 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.748+0000 7fc1791c6740 20 client.7143 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.748+0000 7fc1791c6740 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x55b721fb3250 0x55b7223a3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.748+0000 7fc1791c6740 4 client.7143 mds_command: new command op to 7083 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.748+0000 7fc1791c6740 1 -- 172.21.15.146:0/3794833979 --> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b722310b80 con 0x55b721fb3250 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.748+0000 7fc16affd640 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x55b721fb3250 0x55b7223a3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.748+0000 7fc14a7fc640 10 client.7143 ms_handle_connect on v2:172.21.15.146:6832/749858742 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.748+0000 7fc16affd640 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x55b721fb3250 0x55b7223a3d60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a3335ee47680590 server_cookie=d7c664c9e4efee36 in_seq=0 out_seq=0 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc14a7fc640 1 -- 172.21.15.146:0/3794833979 <== mds.0 v2:172.21.15.146:6832/749858742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b722310b80 con 0x55b721fb3250 2024-09-17T03:37:18.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc14a7fc640 10 client.7143 handle_command_reply: tid=0 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 1 client.7143 shutdown 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 1 -- 172.21.15.146:0/3794833979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 msgr2=0x55b7223db250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b7223db250 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0983f0 tx=0x7fc15c003f90 comp rx=0 tx=0).stop 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 1 -- 172.21.15.146:0/3794833979 shutdown_connections 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721ff4680 0x55b722396be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721fd39a0 0x55b7223966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x55b721fb3250 0x55b7223a3d60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 1 --2- 172.21.15.146:0/3794833979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b7223db250 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc14a7fc640 0 client.7143 ms_handle_reset on v2:172.21.15.146:6832/749858742 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 1 -- 172.21.15.146:0/3794833979 >> 172.21.15.146:0/3794833979 conn(0x55b721fe87d0 msgr2=0x55b72239bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 1 -- 172.21.15.146:0/3794833979 shutdown_connections 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 1 -- 172.21.15.146:0/3794833979 wait complete. 2024-09-17T03:37:18.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.749+0000 7fc1791c6740 20 client.7143 trim_cache size 0 max 16384 2024-09-17T03:37:18.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.767+0000 7fc1791c6740 1 Processor -- start 2024-09-17T03:37:18.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.767+0000 7fc1791c6740 1 -- start start 2024-09-17T03:37:18.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.768+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721fcb7c0 0x55b722396870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.768+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fd39a0 0x55b7223a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.768+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721ff4680 0x55b7223a4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.768+0000 7fc1791c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c2000e0 con 0x55b721ff4680 2024-09-17T03:37:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.768+0000 7fc1791c6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1ff160 con 0x55b721fcb7c0 2024-09-17T03:37:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.768+0000 7fc1791c6740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc16c1fe510 con 0x55b721fd39a0 2024-09-17T03:37:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.768+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721ff4680 0x55b7223a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc16bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721ff4680 0x55b7223a4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59148/0 (socket says 172.21.15.146:59148) 2024-09-17T03:37:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc16bfff640 1 -- 172.21.15.146:0/621202167 learned_addr learned my addr 172.21.15.146:0/621202167 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/621202167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721fcb7c0 0x55b722396870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc16affd640 1 --2- 172.21.15.146:0/621202167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fd39a0 0x55b7223a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc16bfff640 1 -- 172.21.15.146:0/621202167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fd39a0 msgr2=0x55b7223a3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc16bfff640 1 --2- 172.21.15.146:0/621202167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fd39a0 0x55b7223a3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc16bfff640 1 -- 172.21.15.146:0/621202167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721fcb7c0 msgr2=0x55b722396870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc16bfff640 1 --2- 172.21.15.146:0/621202167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721fcb7c0 0x55b722396870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc16bfff640 1 -- 172.21.15.146:0/621202167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7220d6df0 con 0x55b721ff4680 2024-09-17T03:37:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc16bfff640 1 --2- 172.21.15.146:0/621202167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721ff4680 0x55b7223a4130 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fc164010d00 tx=0x7fc164004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc59743e385b6a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:18.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc160ff9640 1 -- 172.21.15.146:0/621202167 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164016040 con 0x55b721ff4680 2024-09-17T03:37:18.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc160ff9640 1 -- 172.21.15.146:0/621202167 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc164003c30 con 0x55b721ff4680 2024-09-17T03:37:18.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.769+0000 7fc160ff9640 1 -- 172.21.15.146:0/621202167 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164004290 con 0x55b721ff4680 2024-09-17T03:37:18.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.770+0000 7fc1791c6740 1 -- 172.21.15.146:0/621202167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721ff4680 msgr2=0x55b7223a4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:18.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.770+0000 7fc1791c6740 1 --2- 172.21.15.146:0/621202167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721ff4680 0x55b7223a4130 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fc164010d00 tx=0x7fc164004ab0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.770+0000 7fc1791c6740 1 -- 172.21.15.146:0/621202167 shutdown_connections 2024-09-17T03:37:18.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.770+0000 7fc1791c6740 1 --2- 172.21.15.146:0/621202167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721ff4680 0x55b7223a4130 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.770+0000 7fc1791c6740 1 --2- 172.21.15.146:0/621202167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fd39a0 0x55b7223a3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.770+0000 7fc1791c6740 1 --2- 172.21.15.146:0/621202167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721fcb7c0 0x55b722396870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.770+0000 7fc1791c6740 1 -- 172.21.15.146:0/621202167 >> 172.21.15.146:0/621202167 conn(0x55b721fe87d0 msgr2=0x55b72239bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:18.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.770+0000 7fc1791c6740 1 -- 172.21.15.146:0/621202167 shutdown_connections 2024-09-17T03:37:18.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.770+0000 7fc1791c6740 1 -- 172.21.15.146:0/621202167 wait complete. 2024-09-17T03:37:18.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.771+0000 7fc1791c6740 1 -- start start 2024-09-17T03:37:18.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.771+0000 7fc1791c6740 1 Processor -- start 2024-09-17T03:37:18.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.772+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b722463060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.772+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fd39a0 0x55b7223a2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.772+0000 7fc1791c6740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721ff4680 0x55b7223f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.772+0000 7fc1791c6740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1feb10 con 0x55b721fcb7c0 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.772+0000 7fc1791c6740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b7223e3ae0 con 0x55b721ff4680 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.772+0000 7fc1791c6740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55b7223e03f0 con 0x55b721fd39a0 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.772+0000 7fc1791c6740 10 client.0 _ll_register_callbacks cb 0x7fc15c0011a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.772+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b722463060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.772+0000 7fc16b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b722463060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59158/0 (socket says 172.21.15.146:59158) 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.772+0000 7fc16b7fe640 1 -- 172.21.15.146:0/1693682818 learned_addr learned my addr 172.21.15.146:0/1693682818 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.772+0000 7fc16affd640 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fd39a0 0x55b7223a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc16bfff640 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721ff4680 0x55b7223f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc16b7fe640 1 -- 172.21.15.146:0/1693682818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fd39a0 msgr2=0x55b7223a2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fd39a0 0x55b7223a2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc16b7fe640 1 -- 172.21.15.146:0/1693682818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721ff4680 msgr2=0x55b7223f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721ff4680 0x55b7223f8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc16b7fe640 1 -- 172.21.15.146:0/1693682818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7224635a0 con 0x55b721fcb7c0 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc16b7fe640 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b722463060 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fc15c05ef90 tx=0x7fc15c066660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f098238d67e1e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc14a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc14a7fc640 1 -- 172.21.15.146:0/1693682818 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c066750 con 0x55b721fcb7c0 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc14a7fc640 1 -- 172.21.15.146:0/1693682818 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7fc15c0609f0 con 0x55b721fcb7c0 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc1791c6740 1 -- 172.21.15.146:0/1693682818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc164003c30 con 0x55b721fcb7c0 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc14a7fc640 1 -- 172.21.15.146:0/1693682818 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fc15c05e370 con 0x55b721fcb7c0 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc1791c6740 10 client.7149 fetch_fsmap learned FSMap version 53 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc1791c6740 1 -- 172.21.15.146:0/1693682818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55b7223dff20 con 0x55b721fcb7c0 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc14a7fc640 1 -- 172.21.15.146:0/1693682818 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc164003c30 con 0x55b721fcb7c0 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc14a7fc640 1 -- 172.21.15.146:0/1693682818 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7fc15c060bf0 con 0x55b721fcb7c0 2024-09-17T03:37:18.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc1791c6740 10 client.7149 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc1791c6740 10 client.7149 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc1791c6740 20 client.7149 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc1791c6740 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x55b7223f9630 0x55b7223f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc1791c6740 4 client.7149 mds_command: new command op to 7083 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.773+0000 7fc1791c6740 1 -- 172.21.15.146:0/1693682818 --> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) -- 0x55b72230c630 con 0x55b7223f9630 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.774+0000 7fc16affd640 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x55b7223f9630 0x55b7223f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.774+0000 7fc14a7fc640 10 client.7149 ms_handle_connect on v2:172.21.15.146:6832/749858742 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.774+0000 7fc16affd640 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x55b7223f9630 0x55b7223f8fb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7953f9400ad39132 server_cookie=85e9f4136d88dd0b in_seq=0 out_seq=0 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc14a7fc640 1 -- 172.21.15.146:0/1693682818 <== mds.0 v2:172.21.15.146:6832/749858742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b72230c630 con 0x55b7223f9630 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc14a7fc640 10 client.7149 handle_command_reply: tid=0 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 1 client.7149 shutdown 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 1 -- 172.21.15.146:0/1693682818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 msgr2=0x55b722463060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:18.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b722463060 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fc15c05ef90 tx=0x7fc15c066660 comp rx=0 tx=0).stop 2024-09-17T03:37:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 1 -- 172.21.15.146:0/1693682818 shutdown_connections 2024-09-17T03:37:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b721ff4680 0x55b7223f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b721fd39a0 0x55b7223a2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.146:6832/749858742,v1:172.21.15.146:6833/749858742] conn(0x55b7223f9630 0x55b7223f8fb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 1 --2- 172.21.15.146:0/1693682818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b721fcb7c0 0x55b722463060 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc14a7fc640 0 client.7149 ms_handle_reset on v2:172.21.15.146:6832/749858742 2024-09-17T03:37:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 1 -- 172.21.15.146:0/1693682818 >> 172.21.15.146:0/1693682818 conn(0x55b721fe87d0 msgr2=0x55b72239ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:18.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 1 -- 172.21.15.146:0/1693682818 shutdown_connections 2024-09-17T03:37:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 1 -- 172.21.15.146:0/1693682818 wait complete. 2024-09-17T03:37:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc1791c6740 20 client.7149 trim_cache size 0 max 16384 2024-09-17T03:37:18.785 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:37:18.785 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:37:18.785 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "092456c4-6154-4ec0-9981-f4af12a1eb93", 2024-09-17T03:37:18.785 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:37:18.785 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:37:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc17224d640 1 -- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc14c078bc0 msgr2=0x7fc14c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc17224d640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc14c078bc0 0x7fc14c07b0d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc154034000 tx=0x7fc154004730 comp rx=0 tx=0).stop 2024-09-17T03:37:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc17224d640 1 -- 172.21.15.146:0/846372703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc16c0b47c0 msgr2=0x7fc16c1d6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc17224d640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc16c0b47c0 0x7fc16c1d6690 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00c3c0 tx=0x7fc15c00c880 comp rx=0 tx=0).stop 2024-09-17T03:37:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc17224d640 1 -- 172.21.15.146:0/846372703 shutdown_connections 2024-09-17T03:37:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc17224d640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc14c078bc0 0x7fc14c07b0d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc17224d640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc16c0d0710 0x7fc16c0c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc17224d640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc16c0cd5d0 0x7fc16c0c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc17224d640 1 --2- 172.21.15.146:0/846372703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc16c0b47c0 0x7fc16c1d6690 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.775+0000 7fc17224d640 1 -- 172.21.15.146:0/846372703 >> 172.21.15.146:0/846372703 conn(0x7fc16c09ba20 msgr2=0x7fc16c0cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.776+0000 7fc17224d640 1 -- 172.21.15.146:0/846372703 shutdown_connections 2024-09-17T03:37:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:18.776+0000 7fc17224d640 1 -- 172.21.15.146:0/846372703 wait complete. 2024-09-17T03:37:18.788 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '092456c4-6154-4ec0-9981-f4af12a1eb93', 'mode': 'asynchronous'}' 2024-09-17T03:37:18.946 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-09-17T03:37:18.946+0000 7f61791eb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:37:27.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:37:27.365 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:37:28.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:28.789 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-17T03:37:28.810 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:37:28.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:28.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:28.932 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:37:28.932 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:28.932 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:28.932 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:28.950 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:28.950 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:29.008 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:37:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.166+0000 7faf55b19640 1 -- 172.21.15.146:0/1804806943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf500cdc50 msgr2=0x7faf500b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.166+0000 7faf55b19640 1 --2- 172.21.15.146:0/1804806943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf500cdc50 0x7faf500b4ba0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7faf50073030 tx=0x7faf4802a820 comp rx=0 tx=0).stop 2024-09-17T03:37:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.166+0000 7faf55b19640 1 -- 172.21.15.146:0/1804806943 shutdown_connections 2024-09-17T03:37:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.166+0000 7faf55b19640 1 --2- 172.21.15.146:0/1804806943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf500cdc50 0x7faf500b4ba0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.166+0000 7faf55b19640 1 --2- 172.21.15.146:0/1804806943 >> v2:172.21.15.179:3300/0 conn(0x7faf5015c8e0 0x7faf5006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.166+0000 7faf55b19640 1 -- 172.21.15.146:0/1804806943 >> 172.21.15.146:0/1804806943 conn(0x7faf500b3150 msgr2=0x7faf500b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:29.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.166+0000 7faf55b19640 1 -- 172.21.15.146:0/1804806943 shutdown_connections 2024-09-17T03:37:29.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.166+0000 7faf55b19640 1 -- 172.21.15.146:0/1804806943 wait complete. 2024-09-17T03:37:29.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.167+0000 7faf55b19640 1 Processor -- start 2024-09-17T03:37:29.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.168+0000 7faf55b19640 1 -- start start 2024-09-17T03:37:29.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf55b19640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf500cd840 0x7faf5015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf55b19640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf500cdc50 0x7faf501f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf55b19640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5015c8e0 0x7faf5015d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf55b19640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf500b5470 con 0x7faf5015c8e0 2024-09-17T03:37:29.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf55b19640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faf500b52f0 con 0x7faf500cd840 2024-09-17T03:37:29.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf55b19640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7faf50073580 con 0x7faf500cdc50 2024-09-17T03:37:29.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf4ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5015c8e0 0x7faf5015d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf4ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5015c8e0 0x7faf5015d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39988/0 (socket says 172.21.15.146:39988) 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf4ffff640 1 -- 172.21.15.146:0/807691611 learned_addr learned my addr 172.21.15.146:0/807691611 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf4ffff640 1 -- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf500cdc50 msgr2=0x7faf501f7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf4ffff640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf500cdc50 0x7faf501f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf4ffff640 1 -- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf500cd840 msgr2=0x7faf5015a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf4ffff640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf500cd840 0x7faf5015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.169+0000 7faf4ffff640 1 -- 172.21.15.146:0/807691611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf501f3850 con 0x7faf5015c8e0 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.170+0000 7faf4ffff640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5015c8e0 0x7faf5015d610 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7faf48009ca0 tx=0x7faf48032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.170+0000 7faf37fff640 1 -- 172.21.15.146:0/807691611 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48037040 con 0x7faf5015c8e0 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.170+0000 7faf37fff640 1 -- 172.21.15.146:0/807691611 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf48042070 con 0x7faf5015c8e0 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.170+0000 7faf55b19640 1 -- 172.21.15.146:0/807691611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5015ab60 con 0x7faf5015c8e0 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.170+0000 7faf37fff640 1 -- 172.21.15.146:0/807691611 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf480042a0 con 0x7faf5015c8e0 2024-09-17T03:37:29.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.170+0000 7faf55b19640 1 -- 172.21.15.146:0/807691611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf501f3df0 con 0x7faf5015c8e0 2024-09-17T03:37:29.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.171+0000 7faf55b19640 1 -- 172.21.15.146:0/807691611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf500b4ba0 con 0x7faf5015c8e0 2024-09-17T03:37:29.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.171+0000 7faf37fff640 1 -- 172.21.15.146:0/807691611 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf48004440 con 0x7faf5015c8e0 2024-09-17T03:37:29.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.172+0000 7faf37fff640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf3c078bc0 0x7faf3c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.172+0000 7faf37fff640 1 -- 172.21.15.146:0/807691611 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7faf480bbb60 con 0x7faf5015c8e0 2024-09-17T03:37:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.172+0000 7faf4f7fe640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf3c078bc0 0x7faf3c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.173+0000 7faf4f7fe640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf3c078bc0 0x7faf3c07b0d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf40009670 tx=0x7faf40006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:29.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.177+0000 7faf37fff640 1 -- 172.21.15.146:0/807691611 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf48004730 con 0x7faf5015c8e0 2024-09-17T03:37:29.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.361+0000 7faf55b19640 1 -- 172.21.15.146:0/807691611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faf50070dd0 con 0x7faf5015c8e0 2024-09-17T03:37:29.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.361+0000 7faf37fff640 1 -- 172.21.15.146:0/807691611 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v77) ==== 80+0+124 (secure 0 0 0) 0x7faf48083fd0 con 0x7faf5015c8e0 2024-09-17T03:37:29.362 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6835/2258631125 2024-09-18T03:37:11.934848+0000 2024-09-17T03:37:29.362 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6834/2258631125 2024-09-18T03:37:11.934848+0000 2024-09-17T03:37:29.362 INFO:teuthology.orchestra.run.smithi146.stderr:listed 2 entries 2024-09-17T03:37:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 -- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf3c078bc0 msgr2=0x7faf3c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf3c078bc0 0x7faf3c07b0d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf40009670 tx=0x7faf40006bf0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 -- 172.21.15.146:0/807691611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5015c8e0 msgr2=0x7faf5015d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5015c8e0 0x7faf5015d610 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7faf48009ca0 tx=0x7faf48032d10 comp rx=0 tx=0).stop 2024-09-17T03:37:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 -- 172.21.15.146:0/807691611 shutdown_connections 2024-09-17T03:37:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf3c078bc0 0x7faf3c07b0d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf5015c8e0 0x7faf5015d610 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf500cdc50 0x7faf501f7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 --2- 172.21.15.146:0/807691611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf500cd840 0x7faf5015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 -- 172.21.15.146:0/807691611 >> 172.21.15.146:0/807691611 conn(0x7faf500b3150 msgr2=0x7faf500b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 -- 172.21.15.146:0/807691611 shutdown_connections 2024-09-17T03:37:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.364+0000 7faf55b19640 1 -- 172.21.15.146:0/807691611 wait complete. 2024-09-17T03:37:29.375 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:37:29.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:29.375 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:29.406 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:37:29.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:29.406 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:37:29.461 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:29.462 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:37:29.462 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:29.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:37:29.481 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:29.482 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:29.482 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:29.518 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:37:29.518 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:37:29.518 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:37:29.518 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:29.539 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:37:29.540 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.671+0000 7f0d2400e640 1 -- 172.21.15.146:0/547590024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d08004800 msgr2=0x7f0d08004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.671+0000 7f0d2400e640 1 --2- 172.21.15.146:0/547590024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d08004800 0x7f0d08004c10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0016c0 tx=0x7f0d08005830 comp rx=0 tx=0).stop 2024-09-17T03:37:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.671+0000 7f0d2400e640 1 -- 172.21.15.146:0/547590024 shutdown_connections 2024-09-17T03:37:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.671+0000 7f0d2400e640 1 --2- 172.21.15.146:0/547590024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d08004800 0x7f0d08004c10 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.671+0000 7f0d2400e640 1 -- 172.21.15.146:0/547590024 >> 172.21.15.146:0/547590024 conn(0x7f0d1c06d3c0 msgr2=0x7f0d1c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.671+0000 7f0d2400e640 1 -- 172.21.15.146:0/547590024 shutdown_connections 2024-09-17T03:37:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.671+0000 7f0d2400e640 1 -- 172.21.15.146:0/547590024 wait complete. 2024-09-17T03:37:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.673+0000 7f0d2400e640 1 Processor -- start 2024-09-17T03:37:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.673+0000 7f0d2400e640 1 -- start start 2024-09-17T03:37:29.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.674+0000 7f0d2400e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d08004800 0x7f0d1c0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.674+0000 7f0d2400e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d1c15a960 0x7f0d1c14f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.674+0000 7f0d2400e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d1c15ad70 0x7f0d1c14af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.674+0000 7f0d2400e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1c1526a0 con 0x7f0d1c15ad70 2024-09-17T03:37:29.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.674+0000 7f0d2400e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1c0b4720 con 0x7f0d08004800 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.674+0000 7f0d2400e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0d1c152820 con 0x7f0d1c15a960 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d225ab640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d1c15ad70 0x7f0d1c14af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d225ab640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d1c15ad70 0x7f0d1c14af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40014/0 (socket says 172.21.15.146:40014) 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d225ab640 1 -- 172.21.15.146:0/548486589 learned_addr learned my addr 172.21.15.146:0/548486589 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d215a9640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d1c15a960 0x7f0d1c14f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d21daa640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d08004800 0x7f0d1c0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d225ab640 1 -- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d1c15a960 msgr2=0x7f0d1c14f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d225ab640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d1c15a960 0x7f0d1c14f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d225ab640 1 -- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d08004800 msgr2=0x7f0d1c0cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d225ab640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d08004800 0x7f0d1c0cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d225ab640 1 -- 172.21.15.146:0/548486589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1c14bc90 con 0x7f0d1c15ad70 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d21daa640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d08004800 0x7f0d1c0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:29.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d215a9640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d1c15a960 0x7f0d1c14f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:29.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d225ab640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d1c15ad70 0x7f0d1c14af40 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0b5f50 tx=0x7f0d14006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:29.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d127fc640 1 -- 172.21.15.146:0/548486589 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400fa80 con 0x7f0d1c15ad70 2024-09-17T03:37:29.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d127fc640 1 -- 172.21.15.146:0/548486589 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d14018070 con 0x7f0d1c15ad70 2024-09-17T03:37:29.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d127fc640 1 -- 172.21.15.146:0/548486589 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d14011430 con 0x7f0d1c15ad70 2024-09-17T03:37:29.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d2400e640 1 -- 172.21.15.146:0/548486589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d1c14eec0 con 0x7f0d1c15ad70 2024-09-17T03:37:29.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.675+0000 7f0d2400e640 1 -- 172.21.15.146:0/548486589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d1c14f480 con 0x7f0d1c15ad70 2024-09-17T03:37:29.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.676+0000 7f0d2400e640 1 -- 172.21.15.146:0/548486589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d1c06fb60 con 0x7f0d1c15ad70 2024-09-17T03:37:29.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.677+0000 7f0d127fc640 1 -- 172.21.15.146:0/548486589 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d140115d0 con 0x7f0d1c15ad70 2024-09-17T03:37:29.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.677+0000 7f0d127fc640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d00078b90 0x7f0d0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:29.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.677+0000 7f0d127fc640 1 -- 172.21.15.146:0/548486589 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7f0d1409b560 con 0x7f0d1c15ad70 2024-09-17T03:37:29.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.678+0000 7f0d21daa640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d00078b90 0x7f0d0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:29.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.678+0000 7f0d21daa640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d00078b90 0x7f0d0007b0a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c06c6a0 tx=0x7f0d18005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:29.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.682+0000 7f0d127fc640 1 -- 172.21.15.146:0/548486589 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0d140639d0 con 0x7f0d1c15ad70 2024-09-17T03:37:29.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.892+0000 7f0d2400e640 1 -- 172.21.15.146:0/548486589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d1c15c2a0 con 0x7f0d1c15ad70 2024-09-17T03:37:29.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.893+0000 7f0d127fc640 1 -- 172.21.15.146:0/548486589 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5232 (secure 0 0 0) 0x7f0d140632d0 con 0x7f0d1c15ad70 2024-09-17T03:37:29.893 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:29.893 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":53,"btime":"2024-09-17T03:37:15:965946+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4258283164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4258283164},{"type":"v1","addr":"172.21.15.179:6835","nonce":4258283164}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2636836918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2636836918},{"type":"v1","addr":"172.21.15.179:6837","nonce":2636836918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":7089,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/850685229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":850685229},{"type":"v1","addr":"172.21.15.146:6835","nonce":850685229}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:57.935632+0000","modified":"2024-09-17T03:37:15.965937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/749858742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":749858742},{"type":"v1","addr":"172.21.15.146:6833","nonce":749858742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7083,"qdb_cluster":[7083]},"id":5}]} 2024-09-17T03:37:29.893 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 53 2024-09-17T03:37:29.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 -- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d00078b90 msgr2=0x7f0d0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d00078b90 0x7f0d0007b0a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c06c6a0 tx=0x7f0d18005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 -- 172.21.15.146:0/548486589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d1c15ad70 msgr2=0x7f0d1c14af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d1c15ad70 0x7f0d1c14af40 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0b5f50 tx=0x7f0d14006720 comp rx=0 tx=0).stop 2024-09-17T03:37:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 -- 172.21.15.146:0/548486589 shutdown_connections 2024-09-17T03:37:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d00078b90 0x7f0d0007b0a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d1c15ad70 0x7f0d1c14af40 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d1c15a960 0x7f0d1c14f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 --2- 172.21.15.146:0/548486589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d08004800 0x7f0d1c0cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 -- 172.21.15.146:0/548486589 >> 172.21.15.146:0/548486589 conn(0x7f0d1c06d3c0 msgr2=0x7f0d1c0cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 -- 172.21.15.146:0/548486589 shutdown_connections 2024-09-17T03:37:29.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:29.895+0000 7f0d2400e640 1 -- 172.21.15.146:0/548486589 wait complete. 2024-09-17T03:37:29.907 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:30.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.025+0000 7f7c77598640 1 -- 172.21.15.146:0/2581702488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c5c004d40 msgr2=0x7f7c5c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.025+0000 7f7c77598640 1 --2- 172.21.15.146:0/2581702488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c5c004d40 0x7f7c5c005150 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f7c68005fd0 tx=0x7f7c5c005830 comp rx=0 tx=0).stop 2024-09-17T03:37:30.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.025+0000 7f7c75b35640 1 -- 172.21.15.146:0/2581702488 reap_dead start 2024-09-17T03:37:30.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.025+0000 7f7c77598640 1 -- 172.21.15.146:0/2581702488 shutdown_connections 2024-09-17T03:37:30.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.025+0000 7f7c77598640 1 -- 172.21.15.146:0/2581702488 >> 172.21.15.146:0/2581702488 conn(0x7f7c700b3150 msgr2=0x7f7c700b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:30.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.025+0000 7f7c77598640 1 -- 172.21.15.146:0/2581702488 shutdown_connections 2024-09-17T03:37:30.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.025+0000 7f7c77598640 1 -- 172.21.15.146:0/2581702488 wait complete. 2024-09-17T03:37:30.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.027+0000 7f7c77598640 1 Processor -- start 2024-09-17T03:37:30.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.027+0000 7f7c77598640 1 -- start start 2024-09-17T03:37:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.028+0000 7f7c77598640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c701f63b0 0x7f7c701f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.028+0000 7f7c77598640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c7015ef50 0x7f7c7014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.028+0000 7f7c77598640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7006cc50 0x7f7c7006d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.028+0000 7f7c77598640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c70155d10 con 0x7f7c7015ef50 2024-09-17T03:37:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.028+0000 7f7c77598640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7c70155b90 con 0x7f7c701f63b0 2024-09-17T03:37:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.028+0000 7f7c77598640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7c70155e90 con 0x7f7c7006cc50 2024-09-17T03:37:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.028+0000 7f7c74b33640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c7015ef50 0x7f7c7014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.028+0000 7f7c74b33640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c7015ef50 0x7f7c7014df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40042/0 (socket says 172.21.15.146:40042) 2024-09-17T03:37:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.028+0000 7f7c74b33640 1 -- 172.21.15.146:0/2078166429 learned_addr learned my addr 172.21.15.146:0/2078166429 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.028+0000 7f7c75b35640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7006cc50 0x7f7c7006d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.028+0000 7f7c75334640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c701f63b0 0x7f7c701f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.029+0000 7f7c74b33640 1 -- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7006cc50 msgr2=0x7f7c7006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.029+0000 7f7c74b33640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7006cc50 0x7f7c7006d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.029+0000 7f7c74b33640 1 -- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c701f63b0 msgr2=0x7f7c701f9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.029+0000 7f7c74b33640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c701f63b0 0x7f7c701f9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.029+0000 7f7c74b33640 1 -- 172.21.15.146:0/2078166429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7006d5a0 con 0x7f7c7015ef50 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.029+0000 7f7c74b33640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c7015ef50 0x7f7c7014df30 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f7c60003670 tx=0x7f7c60003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.029+0000 7f7c65ffb640 1 -- 172.21.15.146:0/2078166429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60015070 con 0x7f7c7015ef50 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.029+0000 7f7c65ffb640 1 -- 172.21.15.146:0/2078166429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c60011900 con 0x7f7c7015ef50 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.029+0000 7f7c77598640 1 -- 172.21.15.146:0/2078166429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7015f6a0 con 0x7f7c7015ef50 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.029+0000 7f7c65ffb640 1 -- 172.21.15.146:0/2078166429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60011d50 con 0x7f7c7015ef50 2024-09-17T03:37:30.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.029+0000 7f7c77598640 1 -- 172.21.15.146:0/2078166429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c701f5bb0 con 0x7f7c7015ef50 2024-09-17T03:37:30.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.030+0000 7f7c77598640 1 -- 172.21.15.146:0/2078166429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c701f56e0 con 0x7f7c7015ef50 2024-09-17T03:37:30.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.031+0000 7f7c65ffb640 1 -- 172.21.15.146:0/2078166429 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c60018070 con 0x7f7c7015ef50 2024-09-17T03:37:30.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.031+0000 7f7c65ffb640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c54078bc0 0x7f7c5407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.031+0000 7f7c65ffb640 1 -- 172.21.15.146:0/2078166429 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7f7c6009ba40 con 0x7f7c7015ef50 2024-09-17T03:37:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.032+0000 7f7c75334640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c54078bc0 0x7f7c5407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.032+0000 7f7c75334640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c54078bc0 0x7f7c5407b0d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009c50 tx=0x7f7c6c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:30.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.036+0000 7f7c65ffb640 1 -- 172.21.15.146:0/2078166429 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7c7006d5a0 con 0x7f7c7015ef50 2024-09-17T03:37:30.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.245+0000 7f7c77598640 1 -- 172.21.15.146:0/2078166429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c700b5bb0 con 0x7f7c7015ef50 2024-09-17T03:37:30.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.246+0000 7f7c65ffb640 1 -- 172.21.15.146:0/2078166429 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5232 (secure 0 0 0) 0x7f7c6009be20 con 0x7f7c7015ef50 2024-09-17T03:37:30.246 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:30.246 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":53,"btime":"2024-09-17T03:37:15:965946+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4258283164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4258283164},{"type":"v1","addr":"172.21.15.179:6835","nonce":4258283164}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2636836918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2636836918},{"type":"v1","addr":"172.21.15.179:6837","nonce":2636836918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":7089,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/850685229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":850685229},{"type":"v1","addr":"172.21.15.146:6835","nonce":850685229}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:57.935632+0000","modified":"2024-09-17T03:37:15.965937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/749858742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":749858742},{"type":"v1","addr":"172.21.15.146:6833","nonce":749858742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7083,"qdb_cluster":[7083]},"id":5}]} 2024-09-17T03:37:30.246 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 53 2024-09-17T03:37:30.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 -- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c54078bc0 msgr2=0x7f7c5407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c54078bc0 0x7f7c5407b0d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009c50 tx=0x7f7c6c005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 -- 172.21.15.146:0/2078166429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c7015ef50 msgr2=0x7f7c7014df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c7015ef50 0x7f7c7014df30 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f7c60003670 tx=0x7f7c60003aa0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 -- 172.21.15.146:0/2078166429 shutdown_connections 2024-09-17T03:37:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c54078bc0 0x7f7c5407b0d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c7006cc50 0x7f7c7006d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c7015ef50 0x7f7c7014df30 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 --2- 172.21.15.146:0/2078166429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c701f63b0 0x7f7c701f9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 -- 172.21.15.146:0/2078166429 >> 172.21.15.146:0/2078166429 conn(0x7f7c700b3150 msgr2=0x7f7c70154340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 -- 172.21.15.146:0/2078166429 shutdown_connections 2024-09-17T03:37:30.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.248+0000 7f7c77598640 1 -- 172.21.15.146:0/2078166429 wait complete. 2024-09-17T03:37:30.260 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:30.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.372+0000 7f5439113640 1 -- 172.21.15.146:0/510792373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409be30 msgr2=0x7f54340b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.372+0000 7f5439113640 1 --2- 172.21.15.146:0/510792373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409be30 0x7f54340b6130 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f5428009830 tx=0x7f542802a510 comp rx=0 tx=0).stop 2024-09-17T03:37:30.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.372+0000 7f5439113640 1 -- 172.21.15.146:0/510792373 shutdown_connections 2024-09-17T03:37:30.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.372+0000 7f5439113640 1 --2- 172.21.15.146:0/510792373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54340b6670 0x7f54340b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.372+0000 7f5439113640 1 --2- 172.21.15.146:0/510792373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409be30 0x7f54340b6130 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.372+0000 7f5439113640 1 -- 172.21.15.146:0/510792373 >> 172.21.15.146:0/510792373 conn(0x7f543409ba20 msgr2=0x7f54340b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:30.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.372+0000 7f5439113640 1 -- 172.21.15.146:0/510792373 shutdown_connections 2024-09-17T03:37:30.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.372+0000 7f5439113640 1 -- 172.21.15.146:0/510792373 wait complete. 2024-09-17T03:37:30.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.374+0000 7f5439113640 1 Processor -- start 2024-09-17T03:37:30.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.374+0000 7f5439113640 1 -- start start 2024-09-17T03:37:30.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5439113640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409be30 0x7f54340c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5439113640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54340b5be0 0x7f543414e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5439113640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54340b6670 0x7f54340d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5439113640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f54340b0ed0 con 0x7f543409be30 2024-09-17T03:37:30.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5439113640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f54340b0d50 con 0x7f54340b6670 2024-09-17T03:37:30.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5439113640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f54340b1050 con 0x7f54340b5be0 2024-09-17T03:37:30.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5432d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409be30 0x7f54340c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5432d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409be30 0x7f54340c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40064/0 (socket says 172.21.15.146:40064) 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5432d9d640 1 -- 172.21.15.146:0/4279832578 learned_addr learned my addr 172.21.15.146:0/4279832578 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f543259c640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54340b5be0 0x7f543414e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f543359e640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54340b6670 0x7f54340d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5432d9d640 1 -- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54340b5be0 msgr2=0x7f543414e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5432d9d640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54340b5be0 0x7f543414e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5432d9d640 1 -- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54340b6670 msgr2=0x7f54340d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5432d9d640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54340b6670 0x7f54340d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5432d9d640 1 -- 172.21.15.146:0/4279832578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54340c7a40 con 0x7f543409be30 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f5432d9d640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409be30 0x7f54340c7500 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f542400c3f0 tx=0x7f542400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.376+0000 7f541b7fe640 1 -- 172.21.15.146:0/4279832578 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424017070 con 0x7f543409be30 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.377+0000 7f541b7fe640 1 -- 172.21.15.146:0/4279832578 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54240035f0 con 0x7f543409be30 2024-09-17T03:37:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.377+0000 7f5439113640 1 -- 172.21.15.146:0/4279832578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f543409c820 con 0x7f543409be30 2024-09-17T03:37:30.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.377+0000 7f541b7fe640 1 -- 172.21.15.146:0/4279832578 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424003a40 con 0x7f543409be30 2024-09-17T03:37:30.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.377+0000 7f5439113640 1 -- 172.21.15.146:0/4279832578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f543409cde0 con 0x7f543409be30 2024-09-17T03:37:30.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.378+0000 7f5439113640 1 -- 172.21.15.146:0/4279832578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54340b1500 con 0x7f543409be30 2024-09-17T03:37:30.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.379+0000 7f541b7fe640 1 -- 172.21.15.146:0/4279832578 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f542401a070 con 0x7f543409be30 2024-09-17T03:37:30.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.379+0000 7f541b7fe640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5420078b90 0x7f542007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.379+0000 7f541b7fe640 1 -- 172.21.15.146:0/4279832578 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7f542409a4e0 con 0x7f543409be30 2024-09-17T03:37:30.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.379+0000 7f543259c640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5420078b90 0x7f542007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.380+0000 7f543259c640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5420078b90 0x7f542007b0a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5428034000 tx=0x7f5428004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.383+0000 7f541b7fe640 1 -- 172.21.15.146:0/4279832578 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5424021020 con 0x7f543409be30 2024-09-17T03:37:30.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.560+0000 7f5439113640 1 -- 172.21.15.146:0/4279832578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54341500d0 con 0x7f543409be30 2024-09-17T03:37:30.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.561+0000 7f541b7fe640 1 -- 172.21.15.146:0/4279832578 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+16907 (secure 0 0 0) 0x7f54340b6a80 con 0x7f543409be30 2024-09-17T03:37:30.561 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:30.561 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":77,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:37:11.940443+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:55.594323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:56.904167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/2258631125":"2024-09-18T03:37:11.934848+0000","172.21.15.146:6834/2258631125":"2024-09-18T03:37:11.934848+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 -- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5420078b90 msgr2=0x7f542007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5420078b90 0x7f542007b0a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5428034000 tx=0x7f5428004730 comp rx=0 tx=0).stop 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 -- 172.21.15.146:0/4279832578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409be30 msgr2=0x7f54340c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409be30 0x7f54340c7500 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f542400c3f0 tx=0x7f542400c8b0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 -- 172.21.15.146:0/4279832578 shutdown_connections 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5420078b90 0x7f542007b0a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54340b6670 0x7f54340d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54340b5be0 0x7f543414e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 --2- 172.21.15.146:0/4279832578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f543409be30 0x7f54340c7500 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 -- 172.21.15.146:0/4279832578 >> 172.21.15.146:0/4279832578 conn(0x7f543409ba20 msgr2=0x7f54340d25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 -- 172.21.15.146:0/4279832578 shutdown_connections 2024-09-17T03:37:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.563+0000 7f5439113640 1 -- 172.21.15.146:0/4279832578 wait complete. 2024-09-17T03:37:30.575 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:37:30.575 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.690+0000 7f0d37670640 1 -- 172.21.15.146:0/3746859523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d300b50f0 msgr2=0x7f0d30072470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.690+0000 7f0d37670640 1 --2- 172.21.15.146:0/3746859523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d300b50f0 0x7f0d30072470 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f0d300affa0 tx=0x7f0d2c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.690+0000 7f0d37670640 1 -- 172.21.15.146:0/3746859523 shutdown_connections 2024-09-17T03:37:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.690+0000 7f0d37670640 1 --2- 172.21.15.146:0/3746859523 >> v2:172.21.15.179:3300/0 conn(0x7f0d300b4370 0x7f0d300729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.690+0000 7f0d37670640 1 --2- 172.21.15.146:0/3746859523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d300b50f0 0x7f0d30072470 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.690+0000 7f0d37670640 1 -- 172.21.15.146:0/3746859523 >> 172.21.15.146:0/3746859523 conn(0x7f0d300b2060 msgr2=0x7f0d300b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:30.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.690+0000 7f0d37670640 1 -- 172.21.15.146:0/3746859523 shutdown_connections 2024-09-17T03:37:30.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.690+0000 7f0d37670640 1 -- 172.21.15.146:0/3746859523 wait complete. 2024-09-17T03:37:30.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.691+0000 7f0d37670640 1 Processor -- start 2024-09-17T03:37:30.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.692+0000 7f0d37670640 1 -- start start 2024-09-17T03:37:30.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d37670640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d300704f0 0x7f0d30156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d37670640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d300b50f0 0x7f0d301f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d37670640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d301f5ec0 0x7f0d301f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d37670640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3015f110 con 0x7f0d300b50f0 2024-09-17T03:37:30.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d37670640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3015ef90 con 0x7f0d301f5ec0 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d37670640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3015f290 con 0x7f0d300704f0 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d34c0b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d300b50f0 0x7f0d301f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d34c0b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d300b50f0 0x7f0d301f5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40076/0 (socket says 172.21.15.146:40076) 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d34c0b640 1 -- 172.21.15.146:0/1780537845 learned_addr learned my addr 172.21.15.146:0/1780537845 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d3540c640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d300704f0 0x7f0d30156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d35c0d640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d301f5ec0 0x7f0d301f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d34c0b640 1 -- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d300704f0 msgr2=0x7f0d30156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d34c0b640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d300704f0 0x7f0d30156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d34c0b640 1 -- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d301f5ec0 msgr2=0x7f0d301f3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d34c0b640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d301f5ec0 0x7f0d301f3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d34c0b640 1 -- 172.21.15.146:0/1780537845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d301f62d0 con 0x7f0d300b50f0 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.693+0000 7f0d34c0b640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d300b50f0 0x7f0d301f5980 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000c390 tx=0x7f0d2000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.694+0000 7f0d25ffb640 1 -- 172.21.15.146:0/1780537845 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20017070 con 0x7f0d300b50f0 2024-09-17T03:37:30.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.694+0000 7f0d25ffb640 1 -- 172.21.15.146:0/1780537845 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d200035f0 con 0x7f0d300b50f0 2024-09-17T03:37:30.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.694+0000 7f0d37670640 1 -- 172.21.15.146:0/1780537845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d30156690 con 0x7f0d300b50f0 2024-09-17T03:37:30.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.694+0000 7f0d25ffb640 1 -- 172.21.15.146:0/1780537845 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20003a40 con 0x7f0d300b50f0 2024-09-17T03:37:30.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.694+0000 7f0d37670640 1 -- 172.21.15.146:0/1780537845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d30156e80 con 0x7f0d300b50f0 2024-09-17T03:37:30.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.695+0000 7f0d37670640 1 -- 172.21.15.146:0/1780537845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d30156910 con 0x7f0d300b50f0 2024-09-17T03:37:30.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.695+0000 7f0d25ffb640 1 -- 172.21.15.146:0/1780537845 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d2001a070 con 0x7f0d300b50f0 2024-09-17T03:37:30.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.696+0000 7f0d25ffb640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 0x7f0d1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:30.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.696+0000 7f0d25ffb640 1 -- 172.21.15.146:0/1780537845 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7f0d2009a020 con 0x7f0d300b50f0 2024-09-17T03:37:30.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.696+0000 7f0d3540c640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 0x7f0d1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:30.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.697+0000 7f0d3540c640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 0x7f0d1407b0a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c033000 tx=0x7f0d2c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:30.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.700+0000 7f0d25ffb640 1 -- 172.21.15.146:0/1780537845 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0d301f62d0 con 0x7f0d300b50f0 2024-09-17T03:37:30.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.909+0000 7f0d37670640 1 -- 172.21.15.146:0/1780537845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d30154f40 con 0x7f0d300b50f0 2024-09-17T03:37:30.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.909+0000 7f0d25ffb640 1 -- 172.21.15.146:0/1780537845 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5232 (secure 0 0 0) 0x7f0d30154f40 con 0x7f0d300b50f0 2024-09-17T03:37:30.909 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:30.909 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":53,"btime":"2024-09-17T03:37:15:965946+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4258283164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4258283164},{"type":"v1","addr":"172.21.15.179:6835","nonce":4258283164}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2636836918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2636836918},{"type":"v1","addr":"172.21.15.179:6837","nonce":2636836918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":7089,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/850685229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":850685229},{"type":"v1","addr":"172.21.15.146:6835","nonce":850685229}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:57.935632+0000","modified":"2024-09-17T03:37:15.965937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/749858742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":749858742},{"type":"v1","addr":"172.21.15.146:6833","nonce":749858742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7083,"qdb_cluster":[7083]},"id":5}]} 2024-09-17T03:37:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 53 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 -- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 msgr2=0x7f0d1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 0x7f0d1407b0a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c033000 tx=0x7f0d2c004730 comp rx=0 tx=0).stop 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 -- 172.21.15.146:0/1780537845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d300b50f0 msgr2=0x7f0d301f5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d300b50f0 0x7f0d301f5980 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000c390 tx=0x7f0d2000c850 comp rx=0 tx=0).stop 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 -- 172.21.15.146:0/1780537845 shutdown_connections 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 0x7f0d1407b0a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d301f5ec0 0x7f0d301f3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d300b50f0 0x7f0d301f5980 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 --2- 172.21.15.146:0/1780537845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d300704f0 0x7f0d30156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 -- 172.21.15.146:0/1780537845 >> 172.21.15.146:0/1780537845 conn(0x7f0d300b2060 msgr2=0x7f0d3006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 -- 172.21.15.146:0/1780537845 shutdown_connections 2024-09-17T03:37:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:30.911+0000 7f0d37670640 1 -- 172.21.15.146:0/1780537845 wait complete. 2024-09-17T03:37:30.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:31.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.037+0000 7f309564d640 1 -- 172.21.15.146:0/2524065099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f307c004800 msgr2=0x7f307c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.037+0000 7f309564d640 1 --2- 172.21.15.146:0/2524065099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f307c004800 0x7f307c004c10 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f30780016c0 tx=0x7f307c005830 comp rx=0 tx=0).stop 2024-09-17T03:37:31.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.037+0000 7f308f7fe640 1 -- 172.21.15.146:0/2524065099 reap_dead start 2024-09-17T03:37:31.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.038+0000 7f309564d640 1 -- 172.21.15.146:0/2524065099 shutdown_connections 2024-09-17T03:37:31.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.038+0000 7f309564d640 1 -- 172.21.15.146:0/2524065099 >> 172.21.15.146:0/2524065099 conn(0x7f30900d11f0 msgr2=0x7f30900d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:31.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.038+0000 7f309564d640 1 -- 172.21.15.146:0/2524065099 shutdown_connections 2024-09-17T03:37:31.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.038+0000 7f309564d640 1 -- 172.21.15.146:0/2524065099 wait complete. 2024-09-17T03:37:31.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.039+0000 7f309564d640 1 Processor -- start 2024-09-17T03:37:31.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.039+0000 7f309564d640 1 -- start start 2024-09-17T03:37:31.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f309564d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f307c004800 0x7f3090159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f309564d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3090157900 0x7f30900cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f309564d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309014a8d0 0x7f309014ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f309564d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3090069220 con 0x7f309014a8d0 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f309564d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f30900d00a0 con 0x7f307c004800 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f309564d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f30900693a0 con 0x7f3090157900 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f308f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309014a8d0 0x7f309014ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f308f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309014a8d0 0x7f309014ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40096/0 (socket says 172.21.15.146:40096) 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f308f7fe640 1 -- 172.21.15.146:0/224020081 learned_addr learned my addr 172.21.15.146:0/224020081 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f308effd640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f307c004800 0x7f3090159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f30867fc640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3090157900 0x7f30900cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f308f7fe640 1 -- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3090157900 msgr2=0x7f30900cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f308f7fe640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3090157900 0x7f30900cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f308f7fe640 1 -- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f307c004800 msgr2=0x7f3090159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f308f7fe640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f307c004800 0x7f3090159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f308f7fe640 1 -- 172.21.15.146:0/224020081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30901f5850 con 0x7f309014a8d0 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f308f7fe640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309014a8d0 0x7f309014ace0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f3088000f80 tx=0x7f308800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.041+0000 7f3087fff640 1 -- 172.21.15.146:0/224020081 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308800ca10 con 0x7f309014a8d0 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.042+0000 7f3087fff640 1 -- 172.21.15.146:0/224020081 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3088018070 con 0x7f309014a8d0 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.042+0000 7f3087fff640 1 -- 172.21.15.146:0/224020081 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088011460 con 0x7f309014a8d0 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.042+0000 7f309564d640 1 -- 172.21.15.146:0/224020081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3090148a50 con 0x7f309014a8d0 2024-09-17T03:37:31.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.042+0000 7f309564d640 1 -- 172.21.15.146:0/224020081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3090149010 con 0x7f309014a8d0 2024-09-17T03:37:31.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.043+0000 7f309564d640 1 -- 172.21.15.146:0/224020081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3090148840 con 0x7f309014a8d0 2024-09-17T03:37:31.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.043+0000 7f3087fff640 1 -- 172.21.15.146:0/224020081 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3088011600 con 0x7f309014a8d0 2024-09-17T03:37:31.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.044+0000 7f3087fff640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3070078b90 0x7f307007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.044+0000 7f3087fff640 1 -- 172.21.15.146:0/224020081 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7f308809b0d0 con 0x7f309014a8d0 2024-09-17T03:37:31.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.044+0000 7f308effd640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3070078b90 0x7f307007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.044+0000 7f308effd640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3070078b90 0x7f307007b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3080009c50 tx=0x7f3080005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:31.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.048+0000 7f3087fff640 1 -- 172.21.15.146:0/224020081 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30880634b0 con 0x7f309014a8d0 2024-09-17T03:37:31.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.259+0000 7f309564d640 1 -- 172.21.15.146:0/224020081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f309014b6c0 con 0x7f309014a8d0 2024-09-17T03:37:31.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.259+0000 7f3087fff640 1 -- 172.21.15.146:0/224020081 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5232 (secure 0 0 0) 0x7f3088062db0 con 0x7f309014a8d0 2024-09-17T03:37:31.260 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:31.260 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":53,"btime":"2024-09-17T03:37:15:965946+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4258283164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4258283164},{"type":"v1","addr":"172.21.15.179:6835","nonce":4258283164}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2636836918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2636836918},{"type":"v1","addr":"172.21.15.179:6837","nonce":2636836918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":7089,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/850685229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":850685229},{"type":"v1","addr":"172.21.15.146:6835","nonce":850685229}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:36:57.935632+0000","modified":"2024-09-17T03:37:15.965937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":76,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6833/749858742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":749858742},{"type":"v1","addr":"172.21.15.146:6833","nonce":749858742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7083,"qdb_cluster":[7083]},"id":5}]} 2024-09-17T03:37:31.260 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 53 2024-09-17T03:37:31.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 -- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3070078b90 msgr2=0x7f307007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3070078b90 0x7f307007b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3080009c50 tx=0x7f3080005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:31.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 -- 172.21.15.146:0/224020081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309014a8d0 msgr2=0x7f309014ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309014a8d0 0x7f309014ace0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f3088000f80 tx=0x7f308800ec50 comp rx=0 tx=0).stop 2024-09-17T03:37:31.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 -- 172.21.15.146:0/224020081 shutdown_connections 2024-09-17T03:37:31.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3070078b90 0x7f307007b0a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309014a8d0 0x7f309014ace0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3090157900 0x7f30900cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 --2- 172.21.15.146:0/224020081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f307c004800 0x7f3090159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 -- 172.21.15.146:0/224020081 >> 172.21.15.146:0/224020081 conn(0x7f30900d11f0 msgr2=0x7f30900d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:31.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 -- 172.21.15.146:0/224020081 shutdown_connections 2024-09-17T03:37:31.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.262+0000 7f309564d640 1 -- 172.21.15.146:0/224020081 wait complete. 2024-09-17T03:37:31.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:31.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.387+0000 7f4677377640 1 -- 172.21.15.146:0/823940650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700b3b60 msgr2=0x7f46700b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.387+0000 7f4677377640 1 --2- 172.21.15.146:0/823940650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700b3b60 0x7f46700b20a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f4670075630 tx=0x7f466802aa30 comp rx=0 tx=0).stop 2024-09-17T03:37:31.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.387+0000 7f4677377640 1 -- 172.21.15.146:0/823940650 shutdown_connections 2024-09-17T03:37:31.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.387+0000 7f4677377640 1 --2- 172.21.15.146:0/823940650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700b3b60 0x7f46700b20a0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.387+0000 7f4677377640 1 --2- 172.21.15.146:0/823940650 >> v2:172.21.15.179:3300/0 conn(0x7f46700b5750 0x7f46700b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.387+0000 7f4677377640 1 --2- 172.21.15.146:0/823940650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46700b5ce0 0x7f46700b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.387+0000 7f4677377640 1 -- 172.21.15.146:0/823940650 >> 172.21.15.146:0/823940650 conn(0x7f46700b7b20 msgr2=0x7f467009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:31.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.387+0000 7f4677377640 1 -- 172.21.15.146:0/823940650 shutdown_connections 2024-09-17T03:37:31.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.387+0000 7f4677377640 1 -- 172.21.15.146:0/823940650 wait complete. 2024-09-17T03:37:31.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.389+0000 7f4677377640 1 Processor -- start 2024-09-17T03:37:31.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.389+0000 7f4677377640 1 -- start start 2024-09-17T03:37:31.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4677377640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46700b3b60 0x7f467015df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4677377640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46700b5750 0x7f467009fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4677377640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700b5ce0 0x7f46701f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4677377640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f46700b2970 con 0x7f46700b5ce0 2024-09-17T03:37:31.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4677377640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f46700b27f0 con 0x7f46700b3b60 2024-09-17T03:37:31.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4677377640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f46700b2af0 con 0x7f46700b5750 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4675914640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700b5ce0 0x7f46701f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4675914640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700b5ce0 0x7f46701f6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40118/0 (socket says 172.21.15.146:40118) 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4675914640 1 -- 172.21.15.146:0/1775008097 learned_addr learned my addr 172.21.15.146:0/1775008097 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4674912640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46700b5750 0x7f467009fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4675113640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46700b3b60 0x7f467015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4675914640 1 -- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46700b5750 msgr2=0x7f467009fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4675914640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46700b5750 0x7f467009fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4675914640 1 -- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46700b3b60 msgr2=0x7f467015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4675914640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46700b3b60 0x7f467015df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4675914640 1 -- 172.21.15.146:0/1775008097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467015f900 con 0x7f46700b5ce0 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.390+0000 7f4675113640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46700b3b60 0x7f467015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.391+0000 7f4675914640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700b5ce0 0x7f46701f6b70 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f4668009d60 tx=0x7f4668003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:31.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.391+0000 7f4665ffb640 1 -- 172.21.15.146:0/1775008097 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668033050 con 0x7f46700b5ce0 2024-09-17T03:37:31.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.391+0000 7f4665ffb640 1 -- 172.21.15.146:0/1775008097 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4668004450 con 0x7f46700b5ce0 2024-09-17T03:37:31.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.391+0000 7f4665ffb640 1 -- 172.21.15.146:0/1775008097 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668038450 con 0x7f46700b5ce0 2024-09-17T03:37:31.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.391+0000 7f4677377640 1 -- 172.21.15.146:0/1775008097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467015e860 con 0x7f46700b5ce0 2024-09-17T03:37:31.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.391+0000 7f4677377640 1 -- 172.21.15.146:0/1775008097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467015ee20 con 0x7f46700b5ce0 2024-09-17T03:37:31.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.392+0000 7f4677377640 1 -- 172.21.15.146:0/1775008097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467015e5d0 con 0x7f46700b5ce0 2024-09-17T03:37:31.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.393+0000 7f4665ffb640 1 -- 172.21.15.146:0/1775008097 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4668036070 con 0x7f46700b5ce0 2024-09-17T03:37:31.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.393+0000 7f4665ffb640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4654078b90 0x7f465407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.393+0000 7f4665ffb640 1 -- 172.21.15.146:0/1775008097 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7f46680bc2b0 con 0x7f46700b5ce0 2024-09-17T03:37:31.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.394+0000 7f4675113640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4654078b90 0x7f465407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.394+0000 7f4675113640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4654078b90 0x7f465407b0a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f466c005fd0 tx=0x7f466c00f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:31.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.398+0000 7f4665ffb640 1 -- 172.21.15.146:0/1775008097 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4668084610 con 0x7f46700b5ce0 2024-09-17T03:37:31.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.572+0000 7f4677377640 1 -- 172.21.15.146:0/1775008097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f467015c690 con 0x7f46700b5ce0 2024-09-17T03:37:31.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.573+0000 7f4665ffb640 1 -- 172.21.15.146:0/1775008097 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+16907 (secure 0 0 0) 0x7f467015c690 con 0x7f46700b5ce0 2024-09-17T03:37:31.573 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:31.573 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":77,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:37:11.940443+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:36:55.594323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T03:36:56.904167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/2258631125":"2024-09-18T03:37:11.934848+0000","172.21.15.146:6834/2258631125":"2024-09-18T03:37:11.934848+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:31.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 -- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4654078b90 msgr2=0x7f465407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4654078b90 0x7f465407b0a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f466c005fd0 tx=0x7f466c00f360 comp rx=0 tx=0).stop 2024-09-17T03:37:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 -- 172.21.15.146:0/1775008097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700b5ce0 msgr2=0x7f46701f6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700b5ce0 0x7f46701f6b70 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f4668009d60 tx=0x7f4668003f10 comp rx=0 tx=0).stop 2024-09-17T03:37:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 -- 172.21.15.146:0/1775008097 shutdown_connections 2024-09-17T03:37:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4654078b90 0x7f465407b0a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700b5ce0 0x7f46701f6b70 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46700b5750 0x7f467009fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 --2- 172.21.15.146:0/1775008097 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46700b3b60 0x7f467015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 -- 172.21.15.146:0/1775008097 >> 172.21.15.146:0/1775008097 conn(0x7f46700b7b20 msgr2=0x7f4670155b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 -- 172.21.15.146:0/1775008097 shutdown_connections 2024-09-17T03:37:31.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.575+0000 7f4677377640 1 -- 172.21.15.146:0/1775008097 wait complete. 2024-09-17T03:37:31.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:37:31.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.701+0000 7f631ff12640 1 -- 172.21.15.146:0/2106341142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63180b5750 msgr2=0x7f63180b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.701+0000 7f631ff12640 1 --2- 172.21.15.146:0/2106341142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63180b5750 0x7f63180b3620 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6318074610 tx=0x7f630802a560 comp rx=0 tx=0).stop 2024-09-17T03:37:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.701+0000 7f631ff12640 1 -- 172.21.15.146:0/2106341142 shutdown_connections 2024-09-17T03:37:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.701+0000 7f631ff12640 1 --2- 172.21.15.146:0/2106341142 >> v2:172.21.15.179:3300/0 conn(0x7f63180b3b60 0x7f63180b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.701+0000 7f631ff12640 1 --2- 172.21.15.146:0/2106341142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63180b5750 0x7f63180b3620 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.701+0000 7f631ff12640 1 --2- 172.21.15.146:0/2106341142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63180b5ce0 0x7f63180b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.701+0000 7f631ff12640 1 -- 172.21.15.146:0/2106341142 >> 172.21.15.146:0/2106341142 conn(0x7f63180b7b20 msgr2=0x7f631809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.701+0000 7f631ff12640 1 -- 172.21.15.146:0/2106341142 shutdown_connections 2024-09-17T03:37:31.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.701+0000 7f631ff12640 1 -- 172.21.15.146:0/2106341142 wait complete. 2024-09-17T03:37:31.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.703+0000 7f631ff12640 1 Processor -- start 2024-09-17T03:37:31.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.703+0000 7f631ff12640 1 -- start start 2024-09-17T03:37:31.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631ff12640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63180b3b60 0x7f63181440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631ff12640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63180b5750 0x7f63181e5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631ff12640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63180b5ce0 0x7f63181f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631ff12640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f63180b2970 con 0x7f63180b3b60 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631ff12640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f63180b27f0 con 0x7f63180b5750 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631ff12640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f63180b2af0 con 0x7f63180b5ce0 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631dcae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63180b3b60 0x7f63181440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631dcae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63180b3b60 0x7f63181440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40136/0 (socket says 172.21.15.146:40136) 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631dcae640 1 -- 172.21.15.146:0/4170210728 learned_addr learned my addr 172.21.15.146:0/4170210728 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631d4ad640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63180b5750 0x7f63181e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631e4af640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63180b5ce0 0x7f63181f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631dcae640 1 -- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63180b5ce0 msgr2=0x7f63181f6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631dcae640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63180b5ce0 0x7f63181f6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631dcae640 1 -- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63180b5750 msgr2=0x7f63181e5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631dcae640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63180b5750 0x7f63181e5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.704+0000 7f631dcae640 1 -- 172.21.15.146:0/4170210728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631809dd50 con 0x7f63180b3b60 2024-09-17T03:37:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.705+0000 7f631dcae640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63180b3b60 0x7f63181440d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f631400c970 tx=0x7f631400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.705+0000 7f630e7fc640 1 -- 172.21.15.146:0/4170210728 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314007bb0 con 0x7f63180b3b60 2024-09-17T03:37:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.705+0000 7f630e7fc640 1 -- 172.21.15.146:0/4170210728 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6314005020 con 0x7f63180b3b60 2024-09-17T03:37:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.705+0000 7f631ff12640 1 -- 172.21.15.146:0/4170210728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631809e030 con 0x7f63180b3b60 2024-09-17T03:37:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.705+0000 7f630e7fc640 1 -- 172.21.15.146:0/4170210728 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314007e60 con 0x7f63180b3b60 2024-09-17T03:37:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.705+0000 7f631ff12640 1 -- 172.21.15.146:0/4170210728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63181e5670 con 0x7f63180b3b60 2024-09-17T03:37:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.706+0000 7f631ff12640 1 -- 172.21.15.146:0/4170210728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f631806d140 con 0x7f63180b3b60 2024-09-17T03:37:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.706+0000 7f630e7fc640 1 -- 172.21.15.146:0/4170210728 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6314005470 con 0x7f63180b3b60 2024-09-17T03:37:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.707+0000 7f630e7fc640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62fc078b90 0x7f62fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.707+0000 7f630e7fc640 1 -- 172.21.15.146:0/4170210728 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5795+0+0 (secure 0 0 0) 0x7f631409b160 con 0x7f63180b3b60 2024-09-17T03:37:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.707+0000 7f631d4ad640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62fc078b90 0x7f62fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.708+0000 7f631d4ad640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62fc078b90 0x7f62fc07b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6308033000 tx=0x7f6308004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:31.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.711+0000 7f630e7fc640 1 -- 172.21.15.146:0/4170210728 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f631806d140 con 0x7f63180b3b60 2024-09-17T03:37:31.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.919+0000 7f631ff12640 1 -- 172.21.15.146:0/4170210728 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f63180b3620 con 0x7f63180b3b60 2024-09-17T03:37:31.920 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:37:31.920+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:37:31.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.921+0000 7f630e7fc640 1 -- 172.21.15.146:0/4170210728 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) ==== 161+0+0 (secure 0 0 0) 0x7f6314014030 con 0x7f63180b3b60 2024-09-17T03:37:31.921 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:37:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 -- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62fc078b90 msgr2=0x7f62fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62fc078b90 0x7f62fc07b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6308033000 tx=0x7f6308004730 comp rx=0 tx=0).stop 2024-09-17T03:37:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 -- 172.21.15.146:0/4170210728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63180b3b60 msgr2=0x7f63181440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63180b3b60 0x7f63181440d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f631400c970 tx=0x7f631400ce30 comp rx=0 tx=0).stop 2024-09-17T03:37:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 -- 172.21.15.146:0/4170210728 shutdown_connections 2024-09-17T03:37:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62fc078b90 0x7f62fc07b0a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63180b5ce0 0x7f63181f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63180b5750 0x7f63181e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 --2- 172.21.15.146:0/4170210728 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63180b3b60 0x7f63181440d0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:31.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 -- 172.21.15.146:0/4170210728 >> 172.21.15.146:0/4170210728 conn(0x7f63180b7b20 msgr2=0x7f63180710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:31.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 -- 172.21.15.146:0/4170210728 shutdown_connections 2024-09-17T03:37:31.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:31.924+0000 7f631ff12640 1 -- 172.21.15.146:0/4170210728 wait complete. 2024-09-17T03:37:31.927 INFO:tasks.ceph.mds.c.smithi146.stderr: -1650> 2024-09-17T03:37:18.946+0000 7f61791eb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:37:31.937 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:37:31.980 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:37:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.056+0000 7fc253357640 1 -- 172.21.15.146:0/487595790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c144380 msgr2=0x7fc24c0b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.056+0000 7fc253357640 1 --2- 172.21.15.146:0/487595790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c144380 0x7fc24c0b3b60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc24800a940 tx=0x7fc24802b850 comp rx=0 tx=0).stop 2024-09-17T03:37:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.056+0000 7fc253357640 1 -- 172.21.15.146:0/487595790 shutdown_connections 2024-09-17T03:37:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.056+0000 7fc253357640 1 --2- 172.21.15.146:0/487595790 >> v2:172.21.15.179:3300/0 conn(0x7fc24c0b40a0 0x7fc24c073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.056+0000 7fc253357640 1 --2- 172.21.15.146:0/487595790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c144380 0x7fc24c0b3b60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.056+0000 7fc253357640 1 -- 172.21.15.146:0/487595790 >> 172.21.15.146:0/487595790 conn(0x7fc24c06d3c0 msgr2=0x7fc24c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.056+0000 7fc253357640 1 -- 172.21.15.146:0/487595790 shutdown_connections 2024-09-17T03:37:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.056+0000 7fc253357640 1 -- 172.21.15.146:0/487595790 wait complete. 2024-09-17T03:37:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.058+0000 7fc253357640 1 Processor -- start 2024-09-17T03:37:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.058+0000 7fc253357640 1 -- start start 2024-09-17T03:37:32.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.059+0000 7fc253357640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c0b40a0 0x7fc24c1f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.059+0000 7fc253357640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc24c144380 0x7fc24c1f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.059+0000 7fc253357640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc24c144900 0x7fc24c1e58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.059+0000 7fc253357640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c0692d0 con 0x7fc24c144380 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.059+0000 7fc253357640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c069150 con 0x7fc24c144900 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.059+0000 7fc253357640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc24c073940 con 0x7fc24c0b40a0 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.059+0000 7fc2508f2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc24c144380 0x7fc24c1f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.059+0000 7fc2508f2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc24c144380 0x7fc24c1f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40174/0 (socket says 172.21.15.146:40174) 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.059+0000 7fc2508f2640 1 -- 172.21.15.146:0/1009875303 learned_addr learned my addr 172.21.15.146:0/1009875303 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.059+0000 7fc2510f3640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c0b40a0 0x7fc24c1f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc2518f4640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc24c144900 0x7fc24c1e58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc2508f2640 1 -- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c0b40a0 msgr2=0x7fc24c1f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc2508f2640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c0b40a0 0x7fc24c1f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc2508f2640 1 -- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc24c144900 msgr2=0x7fc24c1e58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc2508f2640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc24c144900 0x7fc24c1e58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc2508f2640 1 -- 172.21.15.146:0/1009875303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c1f4cb0 con 0x7fc24c144380 2024-09-17T03:37:32.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc2508f2640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc24c144380 0x7fc24c1f4770 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fc24802be40 tx=0x7fc248003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:32.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc23dffb640 1 -- 172.21.15.146:0/1009875303 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248005c90 con 0x7fc24c144380 2024-09-17T03:37:32.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc23dffb640 1 -- 172.21.15.146:0/1009875303 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc248003e00 con 0x7fc24c144380 2024-09-17T03:37:32.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc253357640 1 -- 172.21.15.146:0/1009875303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc24c140e90 con 0x7fc24c144380 2024-09-17T03:37:32.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc23dffb640 1 -- 172.21.15.146:0/1009875303 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248005280 con 0x7fc24c144380 2024-09-17T03:37:32.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.060+0000 7fc253357640 1 -- 172.21.15.146:0/1009875303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24c142b50 con 0x7fc24c144380 2024-09-17T03:37:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.061+0000 7fc253357640 1 -- 172.21.15.146:0/1009875303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc24c073400 con 0x7fc24c144380 2024-09-17T03:37:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.062+0000 7fc23dffb640 1 -- 172.21.15.146:0/1009875303 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc248046020 con 0x7fc24c144380 2024-09-17T03:37:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.063+0000 7fc23dffb640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc230078b90 0x7fc23007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.063+0000 7fc23dffb640 1 -- 172.21.15.146:0/1009875303 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5881+0+0 (secure 0 0 0) 0x7fc2480bb890 con 0x7fc24c144380 2024-09-17T03:37:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.063+0000 7fc2510f3640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc230078b90 0x7fc23007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.063+0000 7fc2510f3640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc230078b90 0x7fc23007b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc2400017e0 tx=0x7fc240009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.067+0000 7fc23dffb640 1 -- 172.21.15.146:0/1009875303 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc24804d020 con 0x7fc24c144380 2024-09-17T03:37:32.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.277+0000 7fc253357640 1 -- 172.21.15.146:0/1009875303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc24c0b4820 con 0x7fc24c144380 2024-09-17T03:37:32.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.923+0000 7fc23dffb640 1 -- 172.21.15.146:0/1009875303 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) ==== 104+0+0 (secure 0 0 0) 0x7fc24c1f4cb0 con 0x7fc24c144380 2024-09-17T03:37:32.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 -- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc230078b90 msgr2=0x7fc23007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc230078b90 0x7fc23007b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc2400017e0 tx=0x7fc240009040 comp rx=0 tx=0).stop 2024-09-17T03:37:32.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 -- 172.21.15.146:0/1009875303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc24c144380 msgr2=0x7fc24c1f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:32.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc24c144380 0x7fc24c1f4770 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fc24802be40 tx=0x7fc248003c10 comp rx=0 tx=0).stop 2024-09-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 -- 172.21.15.146:0/1009875303 shutdown_connections 2024-09-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc230078b90 0x7fc23007b0a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc24c144900 0x7fc24c1e58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc24c144380 0x7fc24c1f4770 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 --2- 172.21.15.146:0/1009875303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc24c0b40a0 0x7fc24c1f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 -- 172.21.15.146:0/1009875303 >> 172.21.15.146:0/1009875303 conn(0x7fc24c06d3c0 msgr2=0x7fc24c13a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 -- 172.21.15.146:0/1009875303 shutdown_connections 2024-09-17T03:37:32.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:32.927+0000 7fc253357640 1 -- 172.21.15.146:0/1009875303 wait complete. 2024-09-17T03:37:32.940 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:37:33.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.102+0000 7ff81910b640 1 -- 172.21.15.146:0/147611690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8140b47c0 msgr2=0x7ff814161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.102+0000 7ff81910b640 1 --2- 172.21.15.146:0/147611690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8140b47c0 0x7ff814161930 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7ff80c005fd0 tx=0x7ff80c02aa10 comp rx=0 tx=0).stop 2024-09-17T03:37:33.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.102+0000 7ff81910b640 1 -- 172.21.15.146:0/147611690 shutdown_connections 2024-09-17T03:37:33.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.102+0000 7ff81910b640 1 --2- 172.21.15.146:0/147611690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8140b47c0 0x7ff814161930 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.102+0000 7ff81910b640 1 --2- 172.21.15.146:0/147611690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140d0710 0x7ff8140cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.102+0000 7ff81910b640 1 -- 172.21.15.146:0/147611690 >> 172.21.15.146:0/147611690 conn(0x7ff81409ba20 msgr2=0x7ff8140b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:33.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.102+0000 7ff81910b640 1 -- 172.21.15.146:0/147611690 shutdown_connections 2024-09-17T03:37:33.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.102+0000 7ff81910b640 1 -- 172.21.15.146:0/147611690 wait complete. 2024-09-17T03:37:33.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.104+0000 7ff81910b640 1 Processor -- start 2024-09-17T03:37:33.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.104+0000 7ff81910b640 1 -- start start 2024-09-17T03:37:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81910b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8140b47c0 0x7ff8141f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81910b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8140cf6b0 0x7ff8141f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81910b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140d0710 0x7ff8140cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81910b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8140b1de0 con 0x7ff8140cf6b0 2024-09-17T03:37:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81910b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff814162080 con 0x7ff8140b47c0 2024-09-17T03:37:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81910b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff8140b1f60 con 0x7ff8140d0710 2024-09-17T03:37:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8140cf6b0 0x7ff8141f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8140cf6b0 0x7ff8141f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40192/0 (socket says 172.21.15.146:40192) 2024-09-17T03:37:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81259c640 1 -- 172.21.15.146:0/3922589440 learned_addr learned my addr 172.21.15.146:0/3922589440 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81359e640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140d0710 0x7ff8140cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff812d9d640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8140b47c0 0x7ff8141f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81259c640 1 -- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140d0710 msgr2=0x7ff8140cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81259c640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140d0710 0x7ff8140cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81259c640 1 -- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8140b47c0 msgr2=0x7ff8141f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81259c640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8140b47c0 0x7ff8141f9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81259c640 1 -- 172.21.15.146:0/3922589440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8140cbb80 con 0x7ff8140cf6b0 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81259c640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8140cf6b0 0x7ff8141f5500 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7ff80800c3d0 tx=0x7ff80800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff7fb7fe640 1 -- 172.21.15.146:0/3922589440 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808017070 con 0x7ff8140cf6b0 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff7fb7fe640 1 -- 172.21.15.146:0/3922589440 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8080053c0 con 0x7ff8140cf6b0 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff81910b640 1 -- 172.21.15.146:0/3922589440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8140cbe60 con 0x7ff8140cf6b0 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.106+0000 7ff7fb7fe640 1 -- 172.21.15.146:0/3922589440 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808003850 con 0x7ff8140cf6b0 2024-09-17T03:37:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.107+0000 7ff81910b640 1 -- 172.21.15.146:0/3922589440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8140ca640 con 0x7ff8140cf6b0 2024-09-17T03:37:33.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.107+0000 7ff81910b640 1 -- 172.21.15.146:0/3922589440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8140cf170 con 0x7ff8140cf6b0 2024-09-17T03:37:33.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.108+0000 7ff7fb7fe640 1 -- 172.21.15.146:0/3922589440 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff80801a070 con 0x7ff8140cf6b0 2024-09-17T03:37:33.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.109+0000 7ff7fb7fe640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff800078b90 0x7ff80007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:33.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.109+0000 7ff7fb7fe640 1 -- 172.21.15.146:0/3922589440 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5881+0+0 (secure 0 0 0) 0x7ff80809a190 con 0x7ff8140cf6b0 2024-09-17T03:37:33.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.109+0000 7ff812d9d640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff800078b90 0x7ff80007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:33.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.110+0000 7ff812d9d640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff800078b90 0x7ff80007b0a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff804004630 tx=0x7ff80400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:33.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.113+0000 7ff7fb7fe640 1 -- 172.21.15.146:0/3922589440 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff808061df0 con 0x7ff8140cf6b0 2024-09-17T03:37:33.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:33.288+0000 7ff81910b640 1 -- 172.21.15.146:0/3922589440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff8140ced70 con 0x7ff8140cf6b0 2024-09-17T03:37:34.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.018+0000 7ff7fb7fe640 1 -- 172.21.15.146:0/3922589440 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) ==== 181+0+0 (secure 0 0 0) 0x7ff808066820 con 0x7ff8140cf6b0 2024-09-17T03:37:34.018 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.021+0000 7ff81910b640 1 -- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff800078b90 msgr2=0x7ff80007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.021+0000 7ff81910b640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff800078b90 0x7ff80007b0a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff804004630 tx=0x7ff80400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.021+0000 7ff81910b640 1 -- 172.21.15.146:0/3922589440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8140cf6b0 msgr2=0x7ff8141f5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.021+0000 7ff81910b640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8140cf6b0 0x7ff8141f5500 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7ff80800c3d0 tx=0x7ff80800c890 comp rx=0 tx=0).stop 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.021+0000 7ff81910b640 1 -- 172.21.15.146:0/3922589440 shutdown_connections 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.021+0000 7ff81910b640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff800078b90 0x7ff80007b0a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.021+0000 7ff81910b640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8140d0710 0x7ff8140cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.021+0000 7ff81910b640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8140cf6b0 0x7ff8141f5500 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.021+0000 7ff81910b640 1 --2- 172.21.15.146:0/3922589440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8140b47c0 0x7ff8141f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.021+0000 7ff81910b640 1 -- 172.21.15.146:0/3922589440 >> 172.21.15.146:0/3922589440 conn(0x7ff81409ba20 msgr2=0x7ff8140b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.022+0000 7ff81910b640 1 -- 172.21.15.146:0/3922589440 shutdown_connections 2024-09-17T03:37:34.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.022+0000 7ff81910b640 1 -- 172.21.15.146:0/3922589440 wait complete. 2024-09-17T03:37:34.035 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:37:34.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.157+0000 7f1b7c339640 1 -- 172.21.15.146:0/2169610699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b5c004800 msgr2=0x7f1b5c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:34.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.157+0000 7f1b7c339640 1 --2- 172.21.15.146:0/2169610699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b5c004800 0x7f1b5c004c10 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f1b68006fd0 tx=0x7f1b5c005830 comp rx=0 tx=0).stop 2024-09-17T03:37:34.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.157+0000 7f1b7c339640 1 -- 172.21.15.146:0/2169610699 shutdown_connections 2024-09-17T03:37:34.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.157+0000 7f1b7c339640 1 --2- 172.21.15.146:0/2169610699 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b5c004800 0x7f1b5c004c10 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:34.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.157+0000 7f1b7c339640 1 -- 172.21.15.146:0/2169610699 >> 172.21.15.146:0/2169610699 conn(0x7f1b740d4be0 msgr2=0x7f1b740d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:34.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.157+0000 7f1b7c339640 1 -- 172.21.15.146:0/2169610699 shutdown_connections 2024-09-17T03:37:34.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.157+0000 7f1b7c339640 1 -- 172.21.15.146:0/2169610699 wait complete. 2024-09-17T03:37:34.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.159+0000 7f1b7c339640 1 Processor -- start 2024-09-17T03:37:34.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.159+0000 7f1b7c339640 1 -- start start 2024-09-17T03:37:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.160+0000 7f1b7c339640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5c004800 0x7f1b740b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.160+0000 7f1b7c339640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7414c900 0x7f1b7414cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.160+0000 7f1b7c339640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b7414d250 0x7f1b741f9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.160+0000 7f1b7c339640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b741625e0 con 0x7f1b7414c900 2024-09-17T03:37:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.160+0000 7f1b7c339640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b74162460 con 0x7f1b7414d250 2024-09-17T03:37:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.160+0000 7f1b7c339640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7406ed30 con 0x7f1b5c004800 2024-09-17T03:37:34.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.160+0000 7f1b798d4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7414c900 0x7f1b7414cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.160+0000 7f1b798d4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7414c900 0x7f1b7414cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40204/0 (socket says 172.21.15.146:40204) 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.160+0000 7f1b798d4640 1 -- 172.21.15.146:0/2123582787 learned_addr learned my addr 172.21.15.146:0/2123582787 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.160+0000 7f1b7a0d5640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5c004800 0x7f1b740b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.160+0000 7f1b7a8d6640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b7414d250 0x7f1b741f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.161+0000 7f1b798d4640 1 -- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5c004800 msgr2=0x7f1b740b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.161+0000 7f1b798d4640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5c004800 0x7f1b740b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.161+0000 7f1b798d4640 1 -- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b7414d250 msgr2=0x7f1b741f9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.161+0000 7f1b798d4640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b7414d250 0x7f1b741f9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.161+0000 7f1b798d4640 1 -- 172.21.15.146:0/2123582787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b74161a60 con 0x7f1b7414c900 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.161+0000 7f1b798d4640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7414c900 0x7f1b7414cd10 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f1b68000f60 tx=0x7f1b68006ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.161+0000 7f1b72ffd640 1 -- 172.21.15.146:0/2123582787 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68032030 con 0x7f1b7414c900 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.161+0000 7f1b72ffd640 1 -- 172.21.15.146:0/2123582787 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b680038e0 con 0x7f1b7414c900 2024-09-17T03:37:34.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.161+0000 7f1b72ffd640 1 -- 172.21.15.146:0/2123582787 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68003cf0 con 0x7f1b7414c900 2024-09-17T03:37:34.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.161+0000 7f1b7c339640 1 -- 172.21.15.146:0/2123582787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7415eb90 con 0x7f1b7414c900 2024-09-17T03:37:34.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.161+0000 7f1b7c339640 1 -- 172.21.15.146:0/2123582787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b74161260 con 0x7f1b7414c900 2024-09-17T03:37:34.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.162+0000 7f1b7c339640 1 -- 172.21.15.146:0/2123582787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b740c8800 con 0x7f1b7414c900 2024-09-17T03:37:34.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.163+0000 7f1b72ffd640 1 -- 172.21.15.146:0/2123582787 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b68035020 con 0x7f1b7414c900 2024-09-17T03:37:34.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.163+0000 7f1b72ffd640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b60078b90 0x7f1b6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:34.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.163+0000 7f1b72ffd640 1 -- 172.21.15.146:0/2123582787 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5443+0+0 (secure 0 0 0) 0x7f1b680bb2c0 con 0x7f1b7414c900 2024-09-17T03:37:34.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.164+0000 7f1b7a0d5640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b60078b90 0x7f1b6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:34.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.164+0000 7f1b7a0d5640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b60078b90 0x7f1b6007b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1b640036b0 tx=0x7f1b64006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:34.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.168+0000 7f1b72ffd640 1 -- 172.21.15.146:0/2123582787 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b740c8800 con 0x7f1b7414c900 2024-09-17T03:37:34.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:34.348+0000 7f1b7c339640 1 -- 172.21.15.146:0/2123582787 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1b7406f290 con 0x7f1b7414c900 2024-09-17T03:37:35.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.019+0000 7f1b72ffd640 1 -- 172.21.15.146:0/2123582787 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) ==== 169+0+0 (secure 0 0 0) 0x7f1b68047030 con 0x7f1b7414c900 2024-09-17T03:37:35.020 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:37:35.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.024+0000 7f1b7c339640 1 -- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b60078b90 msgr2=0x7f1b6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:35.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.024+0000 7f1b7c339640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b60078b90 0x7f1b6007b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1b640036b0 tx=0x7f1b64006b70 comp rx=0 tx=0).stop 2024-09-17T03:37:35.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.024+0000 7f1b7c339640 1 -- 172.21.15.146:0/2123582787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7414c900 msgr2=0x7f1b7414cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.024+0000 7f1b7c339640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7414c900 0x7f1b7414cd10 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f1b68000f60 tx=0x7f1b68006ce0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.024+0000 7f1b7c339640 1 -- 172.21.15.146:0/2123582787 shutdown_connections 2024-09-17T03:37:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.024+0000 7f1b7c339640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b60078b90 0x7f1b6007b0a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.024+0000 7f1b7c339640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b7414d250 0x7f1b741f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.024+0000 7f1b7c339640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b7414c900 0x7f1b7414cd10 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.024+0000 7f1b7c339640 1 --2- 172.21.15.146:0/2123582787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b5c004800 0x7f1b740b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.024+0000 7f1b7c339640 1 -- 172.21.15.146:0/2123582787 >> 172.21.15.146:0/2123582787 conn(0x7f1b740d4be0 msgr2=0x7f1b7415ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.024+0000 7f1b7c339640 1 -- 172.21.15.146:0/2123582787 shutdown_connections 2024-09-17T03:37:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.025+0000 7f1b7c339640 1 -- 172.21.15.146:0/2123582787 wait complete. 2024-09-17T03:37:35.041 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:37:35.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.160+0000 7f2218e2e640 1 -- 172.21.15.146:0/4252764820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22140b4100 msgr2=0x7f221406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:35.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.160+0000 7f2218e2e640 1 --2- 172.21.15.146:0/4252764820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22140b4100 0x7f221406fad0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f2208009830 tx=0x7f220802a510 comp rx=0 tx=0).stop 2024-09-17T03:37:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.160+0000 7f2218e2e640 1 -- 172.21.15.146:0/4252764820 shutdown_connections 2024-09-17T03:37:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.160+0000 7f2218e2e640 1 --2- 172.21.15.146:0/4252764820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22140b4510 0x7f2214070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.160+0000 7f2218e2e640 1 --2- 172.21.15.146:0/4252764820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22140b4100 0x7f221406fad0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.160+0000 7f2218e2e640 1 -- 172.21.15.146:0/4252764820 >> 172.21.15.146:0/4252764820 conn(0x7f221406d3c0 msgr2=0x7f22140b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.160+0000 7f2218e2e640 1 -- 172.21.15.146:0/4252764820 shutdown_connections 2024-09-17T03:37:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.160+0000 7f2218e2e640 1 -- 172.21.15.146:0/4252764820 wait complete. 2024-09-17T03:37:35.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.162+0000 7f2218e2e640 1 Processor -- start 2024-09-17T03:37:35.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.162+0000 7f2218e2e640 1 -- start start 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.163+0000 7f2218e2e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22140b4100 0x7f22141526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.163+0000 7f2218e2e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22140b4510 0x7f221415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.163+0000 7f2218e2e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221414ba00 0x7f221406e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.163+0000 7f2218e2e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f22140d06d0 con 0x7f22140b4100 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.163+0000 7f2218e2e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f22140d0550 con 0x7f221414ba00 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.163+0000 7f2218e2e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f22140d0850 con 0x7f22140b4510 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.163+0000 7f221259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22140b4100 0x7f22141526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.163+0000 7f221259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22140b4100 0x7f22141526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40220/0 (socket says 172.21.15.146:40220) 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.163+0000 7f221259c640 1 -- 172.21.15.146:0/3750720289 learned_addr learned my addr 172.21.15.146:0/3750720289 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.163+0000 7f2211d9b640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22140b4510 0x7f221415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.163+0000 7f2212d9d640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221414ba00 0x7f221406e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:35.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f221259c640 1 -- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22140b4510 msgr2=0x7f221415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f221259c640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22140b4510 0x7f221415a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f221259c640 1 -- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221414ba00 msgr2=0x7f221406e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f221259c640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221414ba00 0x7f221406e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f221259c640 1 -- 172.21.15.146:0/3750720289 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221415ad30 con 0x7f22140b4100 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f2211d9b640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22140b4510 0x7f221415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f2212d9d640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221414ba00 0x7f221406e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f221259c640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22140b4100 0x7f22141526a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f220400c740 tx=0x7f220400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f2202ffd640 1 -- 172.21.15.146:0/3750720289 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204017070 con 0x7f22140b4100 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f2202ffd640 1 -- 172.21.15.146:0/3750720289 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f220400ce50 con 0x7f22140b4100 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f2218e2e640 1 -- 172.21.15.146:0/3750720289 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2214152f80 con 0x7f22140b4100 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f2202ffd640 1 -- 172.21.15.146:0/3750720289 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22040052d0 con 0x7f22140b4100 2024-09-17T03:37:35.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.164+0000 7f2218e2e640 1 -- 172.21.15.146:0/3750720289 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2214153540 con 0x7f22140b4100 2024-09-17T03:37:35.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.165+0000 7f2218e2e640 1 -- 172.21.15.146:0/3750720289 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f221415c9f0 con 0x7f22140b4100 2024-09-17T03:37:35.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.166+0000 7f2202ffd640 1 -- 172.21.15.146:0/3750720289 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f220401a070 con 0x7f22140b4100 2024-09-17T03:37:35.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.166+0000 7f2202ffd640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21f4078bc0 0x7f21f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:35.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.166+0000 7f2202ffd640 1 -- 172.21.15.146:0/3750720289 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5029+0+0 (secure 0 0 0) 0x7f220409a050 con 0x7f22140b4100 2024-09-17T03:37:35.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.167+0000 7f2211d9b640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21f4078bc0 0x7f21f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:35.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.167+0000 7f2211d9b640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21f4078bc0 0x7f21f407b0d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2208034000 tx=0x7f2208004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:35.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.171+0000 7f2202ffd640 1 -- 172.21.15.146:0/3750720289 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f22040627c0 con 0x7f22140b4100 2024-09-17T03:37:35.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.349+0000 7f2218e2e640 1 -- 172.21.15.146:0/3750720289 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f221414f830 con 0x7f22140b4100 2024-09-17T03:37:35.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.353+0000 7f2202ffd640 1 -- 172.21.15.146:0/3750720289 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v44) ==== 71+0+0 (secure 0 0 0) 0x7f22040690c0 con 0x7f22140b4100 2024-09-17T03:37:35.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 -- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21f4078bc0 msgr2=0x7f21f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:35.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21f4078bc0 0x7f21f407b0d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2208034000 tx=0x7f2208004730 comp rx=0 tx=0).stop 2024-09-17T03:37:35.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 -- 172.21.15.146:0/3750720289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22140b4100 msgr2=0x7f22141526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:35.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22140b4100 0x7f22141526a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f220400c740 tx=0x7f220400cc00 comp rx=0 tx=0).stop 2024-09-17T03:37:35.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 -- 172.21.15.146:0/3750720289 shutdown_connections 2024-09-17T03:37:35.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21f4078bc0 0x7f21f407b0d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f221414ba00 0x7f221406e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22140b4510 0x7f221415a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 --2- 172.21.15.146:0/3750720289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22140b4100 0x7f22141526a0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 -- 172.21.15.146:0/3750720289 >> 172.21.15.146:0/3750720289 conn(0x7f221406d3c0 msgr2=0x7f2214151340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:35.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 -- 172.21.15.146:0/3750720289 shutdown_connections 2024-09-17T03:37:35.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.355+0000 7f2218e2e640 1 -- 172.21.15.146:0/3750720289 wait complete. 2024-09-17T03:37:35.368 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-17T03:37:35.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.481+0000 7faba3b13640 1 -- 172.21.15.146:0/2740169607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab9c15c8e0 msgr2=0x7fab9c06f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.481+0000 7faba3b13640 1 --2- 172.21.15.146:0/2740169607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab9c15c8e0 0x7fab9c06f580 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fab8c005fd0 tx=0x7fab8c02a970 comp rx=0 tx=0).stop 2024-09-17T03:37:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.481+0000 7faba3b13640 1 -- 172.21.15.146:0/2740169607 shutdown_connections 2024-09-17T03:37:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.481+0000 7faba3b13640 1 --2- 172.21.15.146:0/2740169607 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab9c0cdc50 0x7fab9c0b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.481+0000 7faba3b13640 1 --2- 172.21.15.146:0/2740169607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab9c15c8e0 0x7fab9c06f580 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.481+0000 7faba3b13640 1 -- 172.21.15.146:0/2740169607 >> 172.21.15.146:0/2740169607 conn(0x7fab9c0b3150 msgr2=0x7fab9c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.481+0000 7faba3b13640 1 -- 172.21.15.146:0/2740169607 shutdown_connections 2024-09-17T03:37:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.481+0000 7faba3b13640 1 -- 172.21.15.146:0/2740169607 wait complete. 2024-09-17T03:37:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.483+0000 7faba3b13640 1 Processor -- start 2024-09-17T03:37:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.483+0000 7faba3b13640 1 -- start start 2024-09-17T03:37:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.484+0000 7faba3b13640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab9c0cd840 0x7fab9c0aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.484+0000 7faba3b13640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab9c0cdc50 0x7fab9c1f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.484+0000 7faba3b13640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab9c15c8e0 0x7fab9c1473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.484+0000 7faba3b13640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c073580 con 0x7fab9c0cd840 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.484+0000 7faba3b13640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c0b5460 con 0x7fab9c0cdc50 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.484+0000 7faba3b13640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fab9c073700 con 0x7fab9c15c8e0 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.484+0000 7faba18af640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab9c0cd840 0x7fab9c0aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.484+0000 7faba18af640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab9c0cd840 0x7fab9c0aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40240/0 (socket says 172.21.15.146:40240) 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.484+0000 7faba18af640 1 -- 172.21.15.146:0/3075610497 learned_addr learned my addr 172.21.15.146:0/3075610497 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7faba10ae640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab9c0cdc50 0x7fab9c1f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7faba20b0640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab9c15c8e0 0x7fab9c1473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7faba18af640 1 -- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab9c15c8e0 msgr2=0x7fab9c1473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7faba18af640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab9c15c8e0 0x7fab9c1473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7faba18af640 1 -- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab9c0cdc50 msgr2=0x7fab9c1f9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7faba18af640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab9c0cdc50 0x7fab9c1f9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7faba18af640 1 -- 172.21.15.146:0/3075610497 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9c0aaad0 con 0x7fab9c0cd840 2024-09-17T03:37:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7faba18af640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab9c0cd840 0x7fab9c0aa480 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fab8c006010 tx=0x7fab8c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7fab9a7fc640 1 -- 172.21.15.146:0/3075610497 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c034040 con 0x7fab9c0cd840 2024-09-17T03:37:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7fab9a7fc640 1 -- 172.21.15.146:0/3075610497 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab8c0045c0 con 0x7fab9c0cd840 2024-09-17T03:37:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7faba3b13640 1 -- 172.21.15.146:0/3075610497 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab9c0aadb0 con 0x7fab9c0cd840 2024-09-17T03:37:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7fab9a7fc640 1 -- 172.21.15.146:0/3075610497 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c045480 con 0x7fab9c0cd840 2024-09-17T03:37:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.485+0000 7faba3b13640 1 -- 172.21.15.146:0/3075610497 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab9c1f9650 con 0x7fab9c0cd840 2024-09-17T03:37:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.486+0000 7faba3b13640 1 -- 172.21.15.146:0/3075610497 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab9c050fc0 con 0x7fab9c0cd840 2024-09-17T03:37:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.487+0000 7fab9a7fc640 1 -- 172.21.15.146:0/3075610497 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab8c037020 con 0x7fab9c0cd840 2024-09-17T03:37:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.487+0000 7fab9a7fc640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab88078b90 0x7fab8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.487+0000 7fab9a7fc640 1 -- 172.21.15.146:0/3075610497 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5029+0+0 (secure 0 0 0) 0x7fab8c0bc200 con 0x7fab9c0cd840 2024-09-17T03:37:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.488+0000 7faba10ae640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab88078b90 0x7fab8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.488+0000 7faba10ae640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab88078b90 0x7fab8807b0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b1c10 tx=0x7fab90009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.492+0000 7fab9a7fc640 1 -- 172.21.15.146:0/3075610497 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fab9c050fc0 con 0x7fab9c0cd840 2024-09-17T03:37:35.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:35.734+0000 7faba3b13640 1 -- 172.21.15.146:0/3075610497 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7fab9c1f9160 con 0x7fab9c0cd840 2024-09-17T03:37:36.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.027+0000 7fab9a7fc640 1 -- 172.21.15.146:0/3075610497 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v234) ==== 143+0+0 (secure 0 0 0) 0x7fab8c084320 con 0x7fab9c0cd840 2024-09-17T03:37:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.029+0000 7faba3b13640 1 -- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab88078b90 msgr2=0x7fab8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.029+0000 7faba3b13640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab88078b90 0x7fab8807b0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b1c10 tx=0x7fab90009060 comp rx=0 tx=0).stop 2024-09-17T03:37:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.029+0000 7faba3b13640 1 -- 172.21.15.146:0/3075610497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab9c0cd840 msgr2=0x7fab9c0aa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.029+0000 7faba3b13640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab9c0cd840 0x7fab9c0aa480 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fab8c006010 tx=0x7fab8c003f10 comp rx=0 tx=0).stop 2024-09-17T03:37:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.029+0000 7faba3b13640 1 -- 172.21.15.146:0/3075610497 shutdown_connections 2024-09-17T03:37:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.029+0000 7faba3b13640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fab88078b90 0x7fab8807b0a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.029+0000 7faba3b13640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fab9c15c8e0 0x7fab9c1473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.029+0000 7faba3b13640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab9c0cdc50 0x7fab9c1f9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.029+0000 7faba3b13640 1 --2- 172.21.15.146:0/3075610497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab9c0cd840 0x7fab9c0aa480 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.029+0000 7faba3b13640 1 -- 172.21.15.146:0/3075610497 >> 172.21.15.146:0/3075610497 conn(0x7fab9c0b3150 msgr2=0x7fab9c15b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.029+0000 7faba3b13640 1 -- 172.21.15.146:0/3075610497 shutdown_connections 2024-09-17T03:37:36.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.030+0000 7faba3b13640 1 -- 172.21.15.146:0/3075610497 wait complete. 2024-09-17T03:37:36.042 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-17T03:37:36.042 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is split during scrub. 2024-09-17T03:37:36.042 INFO:tasks.cephfs_test_runner:test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T03:37:36.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.156+0000 7f42ace69640 1 -- 172.21.15.146:0/2652634402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8146230 msgr2=0x7f42a806cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.156+0000 7f42ace69640 1 --2- 172.21.15.146:0/2652634402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8146230 0x7f42a806cc50 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f42a8071ce0 tx=0x7f429802a870 comp rx=0 tx=0).stop 2024-09-17T03:37:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.156+0000 7f42ace69640 1 -- 172.21.15.146:0/2652634402 shutdown_connections 2024-09-17T03:37:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.156+0000 7f42ace69640 1 --2- 172.21.15.146:0/2652634402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42a8145ce0 0x7f42a806d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.156+0000 7f42ace69640 1 --2- 172.21.15.146:0/2652634402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8146230 0x7f42a806cc50 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.156+0000 7f42ace69640 1 -- 172.21.15.146:0/2652634402 >> 172.21.15.146:0/2652634402 conn(0x7f42a80b3150 msgr2=0x7f42a80b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.156+0000 7f42ace69640 1 -- 172.21.15.146:0/2652634402 shutdown_connections 2024-09-17T03:37:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.156+0000 7f42ace69640 1 -- 172.21.15.146:0/2652634402 wait complete. 2024-09-17T03:37:36.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.158+0000 7f42ace69640 1 Processor -- start 2024-09-17T03:37:36.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.159+0000 7f42ace69640 1 -- start start 2024-09-17T03:37:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42ace69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8073580 0x7f42a8070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42ace69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42a8145ce0 0x7f42a80b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42ace69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42a8146230 0x7f42a8158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42ace69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f42a80d0660 con 0x7f42a8073580 2024-09-17T03:37:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42ace69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f42a80742b0 con 0x7f42a8145ce0 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42ace69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f42a80d07e0 con 0x7f42a8146230 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42a659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8073580 0x7f42a8070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42a659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8073580 0x7f42a8070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40248/0 (socket says 172.21.15.146:40248) 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42a659c640 1 -- 172.21.15.146:0/3649867588 learned_addr learned my addr 172.21.15.146:0/3649867588 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42a6d9d640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42a8146230 0x7f42a8158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f429dd9b640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42a8145ce0 0x7f42a80b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42a659c640 1 -- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42a8146230 msgr2=0x7f42a8158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42a659c640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42a8146230 0x7f42a8158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42a659c640 1 -- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42a8145ce0 msgr2=0x7f42a80b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42a659c640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42a8145ce0 0x7f42a80b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42a659c640 1 -- 172.21.15.146:0/3649867588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a81f9410 con 0x7f42a8073580 2024-09-17T03:37:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.160+0000 7f42a659c640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8073580 0x7f42a8070df0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f429802ae60 tx=0x7f4298003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.161+0000 7f429f7fe640 1 -- 172.21.15.146:0/3649867588 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298031d60 con 0x7f42a8073580 2024-09-17T03:37:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.161+0000 7f429f7fe640 1 -- 172.21.15.146:0/3649867588 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4298003e10 con 0x7f42a8073580 2024-09-17T03:37:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.161+0000 7f42ace69640 1 -- 172.21.15.146:0/3649867588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a81f96f0 con 0x7f42a8073580 2024-09-17T03:37:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.161+0000 7f429f7fe640 1 -- 172.21.15.146:0/3649867588 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298033310 con 0x7f42a8073580 2024-09-17T03:37:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.161+0000 7f42ace69640 1 -- 172.21.15.146:0/3649867588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a80cb6d0 con 0x7f42a8073580 2024-09-17T03:37:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.162+0000 7f42ace69640 1 -- 172.21.15.146:0/3649867588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a8073990 con 0x7f42a8073580 2024-09-17T03:37:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.162+0000 7f429f7fe640 1 -- 172.21.15.146:0/3649867588 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4298030070 con 0x7f42a8073580 2024-09-17T03:37:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.163+0000 7f429f7fe640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4288078b90 0x7f428807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.163+0000 7f429f7fe640 1 -- 172.21.15.146:0/3649867588 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5029+0+0 (secure 0 0 0) 0x7f42980bbc50 con 0x7f42a8073580 2024-09-17T03:37:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.163+0000 7f429dd9b640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4288078b90 0x7f428807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.164+0000 7f429dd9b640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4288078b90 0x7f428807b0a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4290005fd0 tx=0x7f4290005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:36.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.167+0000 7f429f7fe640 1 -- 172.21.15.146:0/3649867588 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42980c1020 con 0x7f42a8073580 2024-09-17T03:37:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.344+0000 7f42ace69640 1 -- 172.21.15.146:0/3649867588 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42a80cdc50 con 0x7f42a8073580 2024-09-17T03:37:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.345+0000 7f429f7fe640 1 -- 172.21.15.146:0/3649867588 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+13213 (secure 0 0 0) 0x7f429803f030 con 0x7f42a8073580 2024-09-17T03:37:36.345 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:36.345 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":80,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:37:35.019400+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6833/749858742":"2024-09-18T03:37:31.921418+0000","172.21.15.146:6832/749858742":"2024-09-18T03:37:31.921418+0000","172.21.15.146:6835/2258631125":"2024-09-18T03:37:11.934848+0000","172.21.15.146:6834/2258631125":"2024-09-18T03:37:11.934848+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:36.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 -- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4288078b90 msgr2=0x7f428807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4288078b90 0x7f428807b0a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4290005fd0 tx=0x7f4290005850 comp rx=0 tx=0).stop 2024-09-17T03:37:36.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 -- 172.21.15.146:0/3649867588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8073580 msgr2=0x7f42a8070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8073580 0x7f42a8070df0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f429802ae60 tx=0x7f4298003c20 comp rx=0 tx=0).stop 2024-09-17T03:37:36.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 -- 172.21.15.146:0/3649867588 shutdown_connections 2024-09-17T03:37:36.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4288078b90 0x7f428807b0a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42a8146230 0x7f42a8158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42a8145ce0 0x7f42a80b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 --2- 172.21.15.146:0/3649867588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8073580 0x7f42a8070df0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 -- 172.21.15.146:0/3649867588 >> 172.21.15.146:0/3649867588 conn(0x7f42a80b3150 msgr2=0x7f42a815c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:36.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 -- 172.21.15.146:0/3649867588 shutdown_connections 2024-09-17T03:37:36.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.347+0000 7f42ace69640 1 -- 172.21.15.146:0/3649867588 wait complete. 2024-09-17T03:37:36.359 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:37:36.359 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:37:36.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.477+0000 7f6e70b9d640 1 -- 172.21.15.146:0/2172846120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e58005250 msgr2=0x7f6e5800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.477+0000 7f6e70b9d640 1 --2- 172.21.15.146:0/2172846120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e58005250 0x7f6e5800b9c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f6e64001d90 tx=0x7f6e58005830 comp rx=0 tx=0).stop 2024-09-17T03:37:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.477+0000 7f6e70b9d640 1 -- 172.21.15.146:0/2172846120 shutdown_connections 2024-09-17T03:37:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.477+0000 7f6e70b9d640 1 --2- 172.21.15.146:0/2172846120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e58005250 0x7f6e5800b9c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.477+0000 7f6e70b9d640 1 -- 172.21.15.146:0/2172846120 >> 172.21.15.146:0/2172846120 conn(0x7f6e6c0d1200 msgr2=0x7f6e6c0d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.477+0000 7f6e70b9d640 1 -- 172.21.15.146:0/2172846120 shutdown_connections 2024-09-17T03:37:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.477+0000 7f6e70b9d640 1 -- 172.21.15.146:0/2172846120 wait complete. 2024-09-17T03:37:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.479+0000 7f6e70b9d640 1 Processor -- start 2024-09-17T03:37:36.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.479+0000 7f6e70b9d640 1 -- start start 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e70b9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e58005250 0x7f6e6c0b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e70b9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e6c1494a0 0x7f6e6c1498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e70b9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e6c149df0 0x7f6e6c14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e70b9d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c0d2ce0 con 0x7f6e58005250 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e70b9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c0d2b60 con 0x7f6e6c1494a0 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e70b9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6e6c0d2e60 con 0x7f6e6c149df0 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e6b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e58005250 0x7f6e6c0b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e6b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e58005250 0x7f6e6c0b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40268/0 (socket says 172.21.15.146:40268) 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e6b7fe640 1 -- 172.21.15.146:0/3613446552 learned_addr learned my addr 172.21.15.146:0/3613446552 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e6bfff640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e6c149df0 0x7f6e6c14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e63fff640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e6c1494a0 0x7f6e6c1498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e6b7fe640 1 -- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e6c149df0 msgr2=0x7f6e6c14aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e6b7fe640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e6c149df0 0x7f6e6c14aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e6b7fe640 1 -- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e6c1494a0 msgr2=0x7f6e6c1498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e6b7fe640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e6c1494a0 0x7f6e6c1498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e6b7fe640 1 -- 172.21.15.146:0/3613446552 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6c15bda0 con 0x7f6e58005250 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e6bfff640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e6c149df0 0x7f6e6c14aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.480+0000 7f6e63fff640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e6c1494a0 0x7f6e6c1498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.481+0000 7f6e6b7fe640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e58005250 0x7f6e6c0b3320 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00e590 tx=0x7f6e5c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.481+0000 7f6e68ff9640 1 -- 172.21.15.146:0/3613446552 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c015070 con 0x7f6e58005250 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.481+0000 7f6e68ff9640 1 -- 172.21.15.146:0/3613446552 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e5c00c9e0 con 0x7f6e58005250 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.481+0000 7f6e70b9d640 1 -- 172.21.15.146:0/3613446552 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6c0cdc20 con 0x7f6e58005250 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.481+0000 7f6e68ff9640 1 -- 172.21.15.146:0/3613446552 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c00ce30 con 0x7f6e58005250 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.481+0000 7f6e70b9d640 1 -- 172.21.15.146:0/3613446552 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6c1489c0 con 0x7f6e58005250 2024-09-17T03:37:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.482+0000 7f6e70b9d640 1 -- 172.21.15.146:0/3613446552 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6c06d160 con 0x7f6e58005250 2024-09-17T03:37:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.482+0000 7f6e68ff9640 1 -- 172.21.15.146:0/3613446552 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e5c018070 con 0x7f6e58005250 2024-09-17T03:37:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.483+0000 7f6e68ff9640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e4c078b90 0x7f6e4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.483+0000 7f6e68ff9640 1 -- 172.21.15.146:0/3613446552 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5029+0+0 (secure 0 0 0) 0x7f6e5c09af10 con 0x7f6e58005250 2024-09-17T03:37:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.483+0000 7f6e63fff640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e4c078b90 0x7f6e4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.484+0000 7f6e63fff640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e4c078b90 0x7f6e4c07b0a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009ae0 tx=0x7f6e54005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:36.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.488+0000 7f6e68ff9640 1 -- 172.21.15.146:0/3613446552 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e6c0b6970 con 0x7f6e58005250 2024-09-17T03:37:36.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.661+0000 7f6e70b9d640 1 -- 172.21.15.146:0/3613446552 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6e6c0cf3e0 con 0x7f6e58005250 2024-09-17T03:37:36.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.661+0000 7f6e68ff9640 1 -- 172.21.15.146:0/3613446552 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f6e5c0635f0 con 0x7f6e58005250 2024-09-17T03:37:36.661 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:37:36.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 -- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e4c078b90 msgr2=0x7f6e4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e4c078b90 0x7f6e4c07b0a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009ae0 tx=0x7f6e54005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 -- 172.21.15.146:0/3613446552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e58005250 msgr2=0x7f6e6c0b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e58005250 0x7f6e6c0b3320 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00e590 tx=0x7f6e5c00ea50 comp rx=0 tx=0).stop 2024-09-17T03:37:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 -- 172.21.15.146:0/3613446552 shutdown_connections 2024-09-17T03:37:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e4c078b90 0x7f6e4c07b0a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e6c149df0 0x7f6e6c14aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e6c1494a0 0x7f6e6c1498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 --2- 172.21.15.146:0/3613446552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e58005250 0x7f6e6c0b3320 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 -- 172.21.15.146:0/3613446552 >> 172.21.15.146:0/3613446552 conn(0x7f6e6c0d1200 msgr2=0x7f6e6c0b8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 -- 172.21.15.146:0/3613446552 shutdown_connections 2024-09-17T03:37:36.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.663+0000 7f6e70b9d640 1 -- 172.21.15.146:0/3613446552 wait complete. 2024-09-17T03:37:36.675 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-17T03:37:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.788+0000 7f3bcfb39640 1 -- 172.21.15.146:0/78327601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bb4004d40 msgr2=0x7f3bb4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.788+0000 7f3bcfb39640 1 --2- 172.21.15.146:0/78327601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bb4004d40 0x7f3bb4005150 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c730 tx=0x7f3bb4005830 comp rx=0 tx=0).stop 2024-09-17T03:37:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.788+0000 7f3bce0d6640 1 -- 172.21.15.146:0/78327601 reap_dead start 2024-09-17T03:37:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.788+0000 7f3bcfb39640 1 -- 172.21.15.146:0/78327601 shutdown_connections 2024-09-17T03:37:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.788+0000 7f3bcfb39640 1 -- 172.21.15.146:0/78327601 >> 172.21.15.146:0/78327601 conn(0x7f3bc80b7b20 msgr2=0x7f3bc809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.789+0000 7f3bcfb39640 1 -- 172.21.15.146:0/78327601 shutdown_connections 2024-09-17T03:37:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.789+0000 7f3bcfb39640 1 -- 172.21.15.146:0/78327601 wait complete. 2024-09-17T03:37:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.790+0000 7f3bcfb39640 1 Processor -- start 2024-09-17T03:37:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.790+0000 7f3bcfb39640 1 -- start start 2024-09-17T03:37:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bcfb39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb4004d40 0x7f3bc81f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bcfb39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc806f310 0x7f3bc809cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bcfb39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc809d0f0 0x7f3bc81559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bcfb39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc80affe0 con 0x7f3bc809d0f0 2024-09-17T03:37:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bcfb39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc815dcc0 con 0x7f3bc806f310 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bcfb39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc80b3620 con 0x7f3bb4004d40 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bce0d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc809d0f0 0x7f3bc81559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bce0d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc809d0f0 0x7f3bc81559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40288/0 (socket says 172.21.15.146:40288) 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bce0d6640 1 -- 172.21.15.146:0/1724402597 learned_addr learned my addr 172.21.15.146:0/1724402597 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bcd0d4640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc806f310 0x7f3bc809cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bcd8d5640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb4004d40 0x7f3bc81f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bce0d6640 1 -- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb4004d40 msgr2=0x7f3bc81f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bce0d6640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb4004d40 0x7f3bc81f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bce0d6640 1 -- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc806f310 msgr2=0x7f3bc809cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bce0d6640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc806f310 0x7f3bc809cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bce0d6640 1 -- 172.21.15.146:0/1724402597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc809d500 con 0x7f3bc809d0f0 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bce0d6640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc809d0f0 0x7f3bc81559d0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c310 tx=0x7f3bc00012e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bbe7fc640 1 -- 172.21.15.146:0/1724402597 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0001a40 con 0x7f3bc809d0f0 2024-09-17T03:37:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bbe7fc640 1 -- 172.21.15.146:0/1724402597 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bc0001be0 con 0x7f3bc809d0f0 2024-09-17T03:37:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bbe7fc640 1 -- 172.21.15.146:0/1724402597 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc002bbb0 con 0x7f3bc809d0f0 2024-09-17T03:37:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.792+0000 7f3bcfb39640 1 -- 172.21.15.146:0/1724402597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc809f4f0 con 0x7f3bc809d0f0 2024-09-17T03:37:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.793+0000 7f3bcfb39640 1 -- 172.21.15.146:0/1724402597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc809fab0 con 0x7f3bc809d0f0 2024-09-17T03:37:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.793+0000 7f3bcfb39640 1 -- 172.21.15.146:0/1724402597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc80b1320 con 0x7f3bc809d0f0 2024-09-17T03:37:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.794+0000 7f3bbe7fc640 1 -- 172.21.15.146:0/1724402597 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3bc0006030 con 0x7f3bc809d0f0 2024-09-17T03:37:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.795+0000 7f3bbe7fc640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bac078b90 0x7f3bac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.795+0000 7f3bbe7fc640 1 -- 172.21.15.146:0/1724402597 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5029+0+0 (secure 0 0 0) 0x7f3bc00baa40 con 0x7f3bc809d0f0 2024-09-17T03:37:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.795+0000 7f3bcd8d5640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bac078b90 0x7f3bac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.795+0000 7f3bcd8d5640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bac078b90 0x7f3bac07b0a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009cd0 tx=0x7f3bc4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:36.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:36.799+0000 7f3bbe7fc640 1 -- 172.21.15.146:0/1724402597 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3bc0045060 con 0x7f3bc809d0f0 2024-09-17T03:37:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:37.040+0000 7f3bcfb39640 1 -- 172.21.15.146:0/1724402597 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f3bc809f280 con 0x7f3bc809d0f0 2024-09-17T03:37:38.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.033+0000 7f3bbe7fc640 1 -- 172.21.15.146:0/1724402597 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v236) ==== 154+0+0 (secure 0 0 0) 0x7f3bc00bae20 con 0x7f3bc809d0f0 2024-09-17T03:37:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.036+0000 7f3bcfb39640 1 -- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bac078b90 msgr2=0x7f3bac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.036+0000 7f3bcfb39640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bac078b90 0x7f3bac07b0a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009cd0 tx=0x7f3bc4005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.036+0000 7f3bcfb39640 1 -- 172.21.15.146:0/1724402597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc809d0f0 msgr2=0x7f3bc81559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.036+0000 7f3bcfb39640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc809d0f0 0x7f3bc81559d0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c310 tx=0x7f3bc00012e0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.037+0000 7f3bcfb39640 1 -- 172.21.15.146:0/1724402597 shutdown_connections 2024-09-17T03:37:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.037+0000 7f3bcfb39640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bac078b90 0x7f3bac07b0a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.037+0000 7f3bcfb39640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc809d0f0 0x7f3bc81559d0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.037+0000 7f3bcfb39640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3bc806f310 0x7f3bc809cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.037+0000 7f3bcfb39640 1 --2- 172.21.15.146:0/1724402597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3bb4004d40 0x7f3bc81f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.037+0000 7f3bcfb39640 1 -- 172.21.15.146:0/1724402597 >> 172.21.15.146:0/1724402597 conn(0x7f3bc80b7b20 msgr2=0x7f3bc815e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:38.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.037+0000 7f3bcfb39640 1 -- 172.21.15.146:0/1724402597 shutdown_connections 2024-09-17T03:37:38.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.037+0000 7f3bcfb39640 1 -- 172.21.15.146:0/1724402597 wait complete. 2024-09-17T03:37:38.051 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:37:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.171+0000 7f2e64be4640 1 -- 172.21.15.146:0/2629708868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e4c004d40 msgr2=0x7f2e4c0051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.171+0000 7f2e64be4640 1 --2- 172.21.15.146:0/2629708868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e4c004d40 0x7f2e4c0051b0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2e58005fd0 tx=0x7f2e4c005830 comp rx=0 tx=0).stop 2024-09-17T03:37:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.171+0000 7f2e5ed9d640 1 -- 172.21.15.146:0/2629708868 reap_dead start 2024-09-17T03:37:38.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.171+0000 7f2e64be4640 1 -- 172.21.15.146:0/2629708868 shutdown_connections 2024-09-17T03:37:38.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.171+0000 7f2e64be4640 1 -- 172.21.15.146:0/2629708868 >> 172.21.15.146:0/2629708868 conn(0x7f2e6009ba20 msgr2=0x7f2e600b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:38.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.171+0000 7f2e64be4640 1 -- 172.21.15.146:0/2629708868 shutdown_connections 2024-09-17T03:37:38.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.171+0000 7f2e64be4640 1 -- 172.21.15.146:0/2629708868 wait complete. 2024-09-17T03:37:38.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.173+0000 7f2e64be4640 1 Processor -- start 2024-09-17T03:37:38.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.173+0000 7f2e64be4640 1 -- start start 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.174+0000 7f2e64be4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e60155650 0x7f2e601f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.174+0000 7f2e64be4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600cfc30 0x7f2e601f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.174+0000 7f2e64be4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e601f74d0 0x7f2e600ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.174+0000 7f2e64be4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2e600b0f90 con 0x7f2e601f74d0 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.174+0000 7f2e64be4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2e600b0e10 con 0x7f2e600cfc30 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.174+0000 7f2e64be4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2e600b1110 con 0x7f2e60155650 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.174+0000 7f2e5ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e601f74d0 0x7f2e600ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.174+0000 7f2e5ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e601f74d0 0x7f2e600ccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52992/0 (socket says 172.21.15.146:52992) 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e5ed9d640 1 -- 172.21.15.146:0/322544035 learned_addr learned my addr 172.21.15.146:0/322544035 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e55d9b640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600cfc30 0x7f2e601f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e5e59c640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e60155650 0x7f2e601f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e5ed9d640 1 -- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e60155650 msgr2=0x7f2e601f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e5ed9d640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e60155650 0x7f2e601f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e5ed9d640 1 -- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600cfc30 msgr2=0x7f2e601f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e5ed9d640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600cfc30 0x7f2e601f6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e5ed9d640 1 -- 172.21.15.146:0/322544035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e601545b0 con 0x7f2e601f74d0 2024-09-17T03:37:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e55d9b640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600cfc30 0x7f2e601f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e5ed9d640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e601f74d0 0x7f2e600ccf40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f2e58002230 tx=0x7f2e58003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e577fe640 1 -- 172.21.15.146:0/322544035 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58031050 con 0x7f2e601f74d0 2024-09-17T03:37:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e577fe640 1 -- 172.21.15.146:0/322544035 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e58004b20 con 0x7f2e601f74d0 2024-09-17T03:37:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e64be4640 1 -- 172.21.15.146:0/322544035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e60154890 con 0x7f2e601f74d0 2024-09-17T03:37:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e577fe640 1 -- 172.21.15.146:0/322544035 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58035610 con 0x7f2e601f74d0 2024-09-17T03:37:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.175+0000 7f2e64be4640 1 -- 172.21.15.146:0/322544035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e60154e50 con 0x7f2e601f74d0 2024-09-17T03:37:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.176+0000 7f2e64be4640 1 -- 172.21.15.146:0/322544035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e600b08d0 con 0x7f2e601f74d0 2024-09-17T03:37:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.177+0000 7f2e577fe640 1 -- 172.21.15.146:0/322544035 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2e58046060 con 0x7f2e601f74d0 2024-09-17T03:37:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.177+0000 7f2e577fe640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e40078b90 0x7f2e4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.178+0000 7f2e577fe640 1 -- 172.21.15.146:0/322544035 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5029+0+0 (secure 0 0 0) 0x7f2e580babe0 con 0x7f2e601f74d0 2024-09-17T03:37:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.178+0000 7f2e5e59c640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e40078b90 0x7f2e4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.178+0000 7f2e5e59c640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e40078b90 0x7f2e4007b0a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2e50003670 tx=0x7f2e500067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:38.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.182+0000 7f2e577fe640 1 -- 172.21.15.146:0/322544035 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2e580832c0 con 0x7f2e601f74d0 2024-09-17T03:37:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.359+0000 7f2e64be4640 1 -- 172.21.15.146:0/322544035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f2e60075f50 con 0x7f2e601f74d0 2024-09-17T03:37:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.359+0000 7f2e577fe640 1 -- 172.21.15.146:0/322544035 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v44) ==== 59+0+2294 (secure 0 0 0) 0x7f2e58082bc0 con 0x7f2e601f74d0 2024-09-17T03:37:38.359 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:37:38.360 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:37:38.361 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:37:38.362 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:37:38.362 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:37:38.362 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:37:38.362 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 -- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e40078b90 msgr2=0x7f2e4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e40078b90 0x7f2e4007b0a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2e50003670 tx=0x7f2e500067a0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 -- 172.21.15.146:0/322544035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e601f74d0 msgr2=0x7f2e600ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e601f74d0 0x7f2e600ccf40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f2e58002230 tx=0x7f2e58003ba0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 -- 172.21.15.146:0/322544035 shutdown_connections 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e40078b90 0x7f2e4007b0a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e601f74d0 0x7f2e600ccf40 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e600cfc30 0x7f2e601f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 --2- 172.21.15.146:0/322544035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e60155650 0x7f2e601f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 -- 172.21.15.146:0/322544035 >> 172.21.15.146:0/322544035 conn(0x7f2e6009ba20 msgr2=0x7f2e600b7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 -- 172.21.15.146:0/322544035 shutdown_connections 2024-09-17T03:37:38.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.362+0000 7f2e64be4640 1 -- 172.21.15.146:0/322544035 wait complete. 2024-09-17T03:37:38.374 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:37:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.492+0000 7f24e76d5640 1 -- 172.21.15.146:0/3079721538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24cc003a50 msgr2=0x7f24cc003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.492+0000 7f24e76d5640 1 --2- 172.21.15.146:0/3079721538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24cc003a50 0x7f24cc003ec0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0016c0 tx=0x7f24cc005830 comp rx=0 tx=0).stop 2024-09-17T03:37:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.492+0000 7f24e76d5640 1 -- 172.21.15.146:0/3079721538 shutdown_connections 2024-09-17T03:37:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.492+0000 7f24e76d5640 1 --2- 172.21.15.146:0/3079721538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24cc003a50 0x7f24cc003ec0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.492+0000 7f24e76d5640 1 -- 172.21.15.146:0/3079721538 >> 172.21.15.146:0/3079721538 conn(0x7f24e00b7b20 msgr2=0x7f24e009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.492+0000 7f24e76d5640 1 -- 172.21.15.146:0/3079721538 shutdown_connections 2024-09-17T03:37:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.492+0000 7f24e76d5640 1 -- 172.21.15.146:0/3079721538 wait complete. 2024-09-17T03:37:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.493+0000 7f24e76d5640 1 Processor -- start 2024-09-17T03:37:38.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.493+0000 7f24e76d5640 1 -- start start 2024-09-17T03:37:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e76d5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24cc003a50 0x7f24e01e8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e76d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e015f8b0 0x7f24e01f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e76d5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24e01f6d30 0x7f24e009c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e76d5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f24e00b3620 con 0x7f24e015f8b0 2024-09-17T03:37:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e76d5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24e00b1750 con 0x7f24e01f6d30 2024-09-17T03:37:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e76d5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f24e00b37a0 con 0x7f24cc003a50 2024-09-17T03:37:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e4c70640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e015f8b0 0x7f24e01f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e4c70640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e015f8b0 0x7f24e01f67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53010/0 (socket says 172.21.15.146:53010) 2024-09-17T03:37:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e4c70640 1 -- 172.21.15.146:0/2081023290 learned_addr learned my addr 172.21.15.146:0/2081023290 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e5c72640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24e01f6d30 0x7f24e009c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e5471640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24cc003a50 0x7f24e01e8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e4c70640 1 -- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24cc003a50 msgr2=0x7f24e01e8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e4c70640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24cc003a50 0x7f24e01e8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e4c70640 1 -- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24e01f6d30 msgr2=0x7f24e009c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e4c70640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24e01f6d30 0x7f24e009c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e4c70640 1 -- 172.21.15.146:0/2081023290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e015f1c0 con 0x7f24e015f8b0 2024-09-17T03:37:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e5471640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24cc003a50 0x7f24e01e8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24e4c70640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e015f8b0 0x7f24e01f67f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f24d0006680 tx=0x7f24d00066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24d5ffb640 1 -- 172.21.15.146:0/2081023290 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0015070 con 0x7f24e015f8b0 2024-09-17T03:37:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.495+0000 7f24d5ffb640 1 -- 172.21.15.146:0/2081023290 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24d0011920 con 0x7f24e015f8b0 2024-09-17T03:37:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.496+0000 7f24e76d5640 1 -- 172.21.15.146:0/2081023290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e009fdf0 con 0x7f24e015f8b0 2024-09-17T03:37:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.496+0000 7f24d5ffb640 1 -- 172.21.15.146:0/2081023290 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0011d70 con 0x7f24e015f8b0 2024-09-17T03:37:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.496+0000 7f24e76d5640 1 -- 172.21.15.146:0/2081023290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e00a00b0 con 0x7f24e015f8b0 2024-09-17T03:37:38.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.497+0000 7f24e76d5640 1 -- 172.21.15.146:0/2081023290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e00b3d00 con 0x7f24e015f8b0 2024-09-17T03:37:38.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.497+0000 7f24d5ffb640 1 -- 172.21.15.146:0/2081023290 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24d0010420 con 0x7f24e015f8b0 2024-09-17T03:37:38.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.498+0000 7f24d5ffb640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24c4078bc0 0x7f24c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:38.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.498+0000 7f24d5ffb640 1 -- 172.21.15.146:0/2081023290 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5029+0+0 (secure 0 0 0) 0x7f24d009b790 con 0x7f24e015f8b0 2024-09-17T03:37:38.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.498+0000 7f24e5471640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24c4078bc0 0x7f24c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:38.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.498+0000 7f24e5471640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24c4078bc0 0x7f24c407b0d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f24dc032000 tx=0x7f24dc001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:38.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.503+0000 7f24d5ffb640 1 -- 172.21.15.146:0/2081023290 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f24d0063e80 con 0x7f24e015f8b0 2024-09-17T03:37:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.678+0000 7f24e76d5640 1 -- 172.21.15.146:0/2081023290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f24e00b25d0 con 0x7f24e015f8b0 2024-09-17T03:37:38.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.682+0000 7f24d5ffb640 1 -- 172.21.15.146:0/2081023290 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v45)=0 v45) ==== 122+0+0 (secure 0 0 0) 0x7f24d0063780 con 0x7f24e015f8b0 2024-09-17T03:37:38.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 -- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24c4078bc0 msgr2=0x7f24c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24c4078bc0 0x7f24c407b0d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f24dc032000 tx=0x7f24dc001190 comp rx=0 tx=0).stop 2024-09-17T03:37:38.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 -- 172.21.15.146:0/2081023290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e015f8b0 msgr2=0x7f24e01f67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:38.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e015f8b0 0x7f24e01f67f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f24d0006680 tx=0x7f24d00066b0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 -- 172.21.15.146:0/2081023290 shutdown_connections 2024-09-17T03:37:38.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24c4078bc0 0x7f24c407b0d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24e01f6d30 0x7f24e009c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e015f8b0 0x7f24e01f67f0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 --2- 172.21.15.146:0/2081023290 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24cc003a50 0x7f24e01e8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:38.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 -- 172.21.15.146:0/2081023290 >> 172.21.15.146:0/2081023290 conn(0x7f24e00b7b20 msgr2=0x7f24e0153ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:38.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 -- 172.21.15.146:0/2081023290 shutdown_connections 2024-09-17T03:37:38.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:38.685+0000 7f24e76d5640 1 -- 172.21.15.146:0/2081023290 wait complete. 2024-09-17T03:37:38.696 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:37:38.696 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:38.737 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:37:38.778 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:37:38.778 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:38.778 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:38.794 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:37:38.794 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:37:38.794 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:38.836 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:37:38.837 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:38.837 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:38.852 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:37:38.852 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:37:38.853 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:38.894 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:37:38.894 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:37:38.895 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:39.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.007+0000 7fd99acf9640 1 -- 172.21.15.146:0/2127014960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9940cd840 msgr2=0x7fd9940b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.007+0000 7fd99acf9640 1 --2- 172.21.15.146:0/2127014960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9940cd840 0x7fd9940b5680 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009830 tx=0x7fd97c02a480 comp rx=0 tx=0).stop 2024-09-17T03:37:39.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.007+0000 7fd99acf9640 1 -- 172.21.15.146:0/2127014960 shutdown_connections 2024-09-17T03:37:39.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.007+0000 7fd99acf9640 1 --2- 172.21.15.146:0/2127014960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9940cdc50 0x7fd9940b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.007+0000 7fd99acf9640 1 --2- 172.21.15.146:0/2127014960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9940cd840 0x7fd9940b5680 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.007+0000 7fd99acf9640 1 -- 172.21.15.146:0/2127014960 >> 172.21.15.146:0/2127014960 conn(0x7fd9940b3150 msgr2=0x7fd9940b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:39.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.007+0000 7fd99acf9640 1 -- 172.21.15.146:0/2127014960 shutdown_connections 2024-09-17T03:37:39.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.007+0000 7fd99acf9640 1 -- 172.21.15.146:0/2127014960 wait complete. 2024-09-17T03:37:39.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.009+0000 7fd99acf9640 1 Processor -- start 2024-09-17T03:37:39.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.009+0000 7fd99acf9640 1 -- start start 2024-09-17T03:37:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.010+0000 7fd99acf9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9940cd840 0x7fd994151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.010+0000 7fd99acf9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9940cdc50 0x7fd994159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.010+0000 7fd99acf9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd99415c8e0 0x7fd9940aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.010+0000 7fd99acf9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd994073580 con 0x7fd9940cd840 2024-09-17T03:37:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.010+0000 7fd99acf9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd9940b5430 con 0x7fd99415c8e0 2024-09-17T03:37:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.010+0000 7fd99acf9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd994073700 con 0x7fd9940cdc50 2024-09-17T03:37:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.010+0000 7fd998a95640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9940cd840 0x7fd994151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.010+0000 7fd998a95640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9940cd840 0x7fd994151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53026/0 (socket says 172.21.15.146:53026) 2024-09-17T03:37:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.010+0000 7fd998a95640 1 -- 172.21.15.146:0/3550316754 learned_addr learned my addr 172.21.15.146:0/3550316754 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd993fff640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9940cdc50 0x7fd994159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd999296640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd99415c8e0 0x7fd9940aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd998a95640 1 -- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9940cdc50 msgr2=0x7fd994159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd998a95640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9940cdc50 0x7fd994159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd998a95640 1 -- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd99415c8e0 msgr2=0x7fd9940aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd998a95640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd99415c8e0 0x7fd9940aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd998a95640 1 -- 172.21.15.146:0/3550316754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd994159940 con 0x7fd9940cd840 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd993fff640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9940cdc50 0x7fd994159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd999296640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd99415c8e0 0x7fd9940aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd998a95640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9940cd840 0x7fd994151ab0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fd98400c7a0 tx=0x7fd98400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd9917fa640 1 -- 172.21.15.146:0/3550316754 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd984017070 con 0x7fd9940cd840 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd9917fa640 1 -- 172.21.15.146:0/3550316754 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd984005070 con 0x7fd9940cd840 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd99acf9640 1 -- 172.21.15.146:0/3550316754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9940aaf30 con 0x7fd9940cd840 2024-09-17T03:37:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd9917fa640 1 -- 172.21.15.146:0/3550316754 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9840054a0 con 0x7fd9940cd840 2024-09-17T03:37:39.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.011+0000 7fd99acf9640 1 -- 172.21.15.146:0/3550316754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9940ab4f0 con 0x7fd9940cd840 2024-09-17T03:37:39.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.012+0000 7fd99acf9640 1 -- 172.21.15.146:0/3550316754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9940b5680 con 0x7fd9940cd840 2024-09-17T03:37:39.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.013+0000 7fd9917fa640 1 -- 172.21.15.146:0/3550316754 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd98401a070 con 0x7fd9940cd840 2024-09-17T03:37:39.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.013+0000 7fd9917fa640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd974078b90 0x7fd97407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.013+0000 7fd9917fa640 1 -- 172.21.15.146:0/3550316754 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5029+0+0 (secure 0 0 0) 0x7fd98409a120 con 0x7fd9940cd840 2024-09-17T03:37:39.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.014+0000 7fd993fff640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd974078b90 0x7fd97407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.014+0000 7fd993fff640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd974078b90 0x7fd97407b0a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd97c034000 tx=0x7fd97c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.018+0000 7fd9917fa640 1 -- 172.21.15.146:0/3550316754 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd984062800 con 0x7fd9940cd840 2024-09-17T03:37:39.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.227+0000 7fd99acf9640 1 -- 172.21.15.146:0/3550316754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd99415d820 con 0x7fd9940cd840 2024-09-17T03:37:39.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.227+0000 7fd9917fa640 1 -- 172.21.15.146:0/3550316754 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+3920 (secure 0 0 0) 0x7fd984062100 con 0x7fd9940cd840 2024-09-17T03:37:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:39.228 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":55,"btime":"2024-09-17T03:37:32:923334+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/4258283164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4258283164},{"type":"v1","addr":"172.21.15.179:6835","nonce":4258283164}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2636836918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2636836918},{"type":"v1","addr":"172.21.15.179:6837","nonce":2636836918}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":7089,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/850685229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":850685229},{"type":"v1","addr":"172.21.15.146:6835","nonce":850685229}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3598085995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3598085995},{"type":"v1","addr":"172.21.15.146:6833","nonce":3598085995}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[]} 2024-09-17T03:37:39.228 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 55 2024-09-17T03:37:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.229+0000 7fd99acf9640 1 -- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd974078b90 msgr2=0x7fd97407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.229+0000 7fd99acf9640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd974078b90 0x7fd97407b0a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd97c034000 tx=0x7fd97c004730 comp rx=0 tx=0).stop 2024-09-17T03:37:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.229+0000 7fd99acf9640 1 -- 172.21.15.146:0/3550316754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9940cd840 msgr2=0x7fd994151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.229+0000 7fd99acf9640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9940cd840 0x7fd994151ab0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fd98400c7a0 tx=0x7fd98400cc60 comp rx=0 tx=0).stop 2024-09-17T03:37:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.229+0000 7fd99acf9640 1 -- 172.21.15.146:0/3550316754 shutdown_connections 2024-09-17T03:37:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.229+0000 7fd99acf9640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd974078b90 0x7fd97407b0a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.229+0000 7fd99acf9640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd99415c8e0 0x7fd9940aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.229+0000 7fd99acf9640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9940cdc50 0x7fd994159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.229+0000 7fd99acf9640 1 --2- 172.21.15.146:0/3550316754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9940cd840 0x7fd994151ab0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.229+0000 7fd99acf9640 1 -- 172.21.15.146:0/3550316754 >> 172.21.15.146:0/3550316754 conn(0x7fd9940b3150 msgr2=0x7fd9940d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.230+0000 7fd99acf9640 1 -- 172.21.15.146:0/3550316754 shutdown_connections 2024-09-17T03:37:39.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.230+0000 7fd99acf9640 1 -- 172.21.15.146:0/3550316754 wait complete. 2024-09-17T03:37:39.241 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:37:39.241 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:37:39.242 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:37:39.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:39.242 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:37:39.242 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:37:39.243 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:37:39.243 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:39.243 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:37:39.243 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:37:39.243 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:37:39.244 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:39.244 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:37:39.244 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:37:39.244 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:37:39.244 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:39.251 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:37:39.251 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:37:39.257 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:37:39.258 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:37:39.258 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:37:39.258 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:37:39.259 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:37:39.259 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:37:39.299 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:37:39.300 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:39.300 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:37:39.300 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:39.301 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:37:39.301 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:37:39.301 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:39.302 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:39.302 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:37:39.388 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:37:39.388 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:37:39.389 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-09-17T03:37:39.389+0000 7f5f291b5640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-17T03:37:39.394 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:37:39.395 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:37:39.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.422+0000 7fdba207e640 1 -- 172.21.15.146:0/1299080538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c06f440 msgr2=0x7fdb9c0d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.422+0000 7fdba207e640 1 --2- 172.21.15.146:0/1299080538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c06f440 0x7fdb9c0d3190 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0b73c0 tx=0x7fdb9402aa50 comp rx=0 tx=0).stop 2024-09-17T03:37:39.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.422+0000 7fdba207e640 1 -- 172.21.15.146:0/1299080538 shutdown_connections 2024-09-17T03:37:39.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.422+0000 7fdba207e640 1 --2- 172.21.15.146:0/1299080538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c06f440 0x7fdb9c0d3190 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.422+0000 7fdba207e640 1 --2- 172.21.15.146:0/1299080538 >> v2:172.21.15.179:3300/0 conn(0x7fdb9c0b3870 0x7fdb9c0cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.422+0000 7fdba207e640 1 -- 172.21.15.146:0/1299080538 >> 172.21.15.146:0/1299080538 conn(0x7fdb9c0d4be0 msgr2=0x7fdb9c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:39.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.422+0000 7fdba207e640 1 -- 172.21.15.146:0/1299080538 shutdown_connections 2024-09-17T03:37:39.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.422+0000 7fdba207e640 1 -- 172.21.15.146:0/1299080538 wait complete. 2024-09-17T03:37:39.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.424+0000 7fdba207e640 1 Processor -- start 2024-09-17T03:37:39.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.424+0000 7fdba207e640 1 -- start start 2024-09-17T03:37:39.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdba207e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0b3870 0x7fdb9c0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdba207e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c1620f0 0x7fdb9c0c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdba207e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb9c14fa80 0x7fdb9c0cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdba207e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c0d3a60 con 0x7fdb9c1620f0 2024-09-17T03:37:39.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdba207e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c0d38e0 con 0x7fdb9c14fa80 2024-09-17T03:37:39.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdba207e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdb9c0d3be0 con 0x7fdb9c0b3870 2024-09-17T03:37:39.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb9affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c1620f0 0x7fdb9c0c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb9affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c1620f0 0x7fdb9c0c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53060/0 (socket says 172.21.15.146:53060) 2024-09-17T03:37:39.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb9affd640 1 -- 172.21.15.146:0/4212453381 learned_addr learned my addr 172.21.15.146:0/4212453381 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb9bfff640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb9c14fa80 0x7fdb9c0cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb9b7fe640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0b3870 0x7fdb9c0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb9affd640 1 -- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0b3870 msgr2=0x7fdb9c0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb9affd640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0b3870 0x7fdb9c0b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb9affd640 1 -- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb9c14fa80 msgr2=0x7fdb9c0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb9affd640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb9c14fa80 0x7fdb9c0cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb9affd640 1 -- 172.21.15.146:0/4212453381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9c0b70e0 con 0x7fdb9c1620f0 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb9affd640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c1620f0 0x7fdb9c0c8a90 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000c3d0 tx=0x7fdb9000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb83fff640 1 -- 172.21.15.146:0/4212453381 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90017070 con 0x7fdb9c1620f0 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb83fff640 1 -- 172.21.15.146:0/4212453381 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb900053c0 con 0x7fdb9c1620f0 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdba207e640 1 -- 172.21.15.146:0/4212453381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9c0c8fd0 con 0x7fdb9c1620f0 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdb83fff640 1 -- 172.21.15.146:0/4212453381 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90003850 con 0x7fdb9c1620f0 2024-09-17T03:37:39.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.426+0000 7fdba207e640 1 -- 172.21.15.146:0/4212453381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb9c0c7fb0 con 0x7fdb9c1620f0 2024-09-17T03:37:39.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.428+0000 7fdba207e640 1 -- 172.21.15.146:0/4212453381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb9c0d3190 con 0x7fdb9c1620f0 2024-09-17T03:37:39.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.428+0000 7fdb83fff640 1 -- 172.21.15.146:0/4212453381 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdb9001a070 con 0x7fdb9c1620f0 2024-09-17T03:37:39.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.429+0000 7fdb83fff640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb88078bc0 0x7fdb8807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:39.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.429+0000 7fdb83fff640 1 -- 172.21.15.146:0/4212453381 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5029+0+0 (secure 0 0 0) 0x7fdb90099df0 con 0x7fdb9c1620f0 2024-09-17T03:37:39.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.429+0000 7fdb9b7fe640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb88078bc0 0x7fdb8807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:39.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.429+0000 7fdb9b7fe640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb88078bc0 0x7fdb8807b0d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009b30 tx=0x7fdb8c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:39.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.433+0000 7fdb83fff640 1 -- 172.21.15.146:0/4212453381 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdb90061e80 con 0x7fdb9c1620f0 2024-09-17T03:37:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:39.621+0000 7fdba207e640 1 -- 172.21.15.146:0/4212453381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fdb9c0d2bd0 con 0x7fdb9c1620f0 2024-09-17T03:37:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.046+0000 7fdb83fff640 1 -- 172.21.15.146:0/4212453381 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v82) ==== 97+0+0 (secure 0 0 0) 0x7fdb900668b0 con 0x7fdb9c1620f0 2024-09-17T03:37:40.045 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:37:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 -- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb88078bc0 msgr2=0x7fdb8807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb88078bc0 0x7fdb8807b0d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009b30 tx=0x7fdb8c005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 -- 172.21.15.146:0/4212453381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c1620f0 msgr2=0x7fdb9c0c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c1620f0 0x7fdb9c0c8a90 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000c3d0 tx=0x7fdb9000c890 comp rx=0 tx=0).stop 2024-09-17T03:37:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 -- 172.21.15.146:0/4212453381 shutdown_connections 2024-09-17T03:37:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb88078bc0 0x7fdb8807b0d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb9c14fa80 0x7fdb9c0cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb9c1620f0 0x7fdb9c0c8a90 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 --2- 172.21.15.146:0/4212453381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb9c0b3870 0x7fdb9c0b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 -- 172.21.15.146:0/4212453381 >> 172.21.15.146:0/4212453381 conn(0x7fdb9c0d4be0 msgr2=0x7fdb9c0b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 -- 172.21.15.146:0/4212453381 shutdown_connections 2024-09-17T03:37:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.050+0000 7fdba207e640 1 -- 172.21.15.146:0/4212453381 wait complete. 2024-09-17T03:37:40.062 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:37:40.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.177+0000 7f4da54da640 1 -- 172.21.15.146:0/2286991308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4da00b3870 msgr2=0x7f4da00cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.177+0000 7f4da54da640 1 --2- 172.21.15.146:0/2286991308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4da00b3870 0x7f4da00cf370 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4da008d590 tx=0x7f4d9002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.177+0000 7f4da54da640 1 -- 172.21.15.146:0/2286991308 shutdown_connections 2024-09-17T03:37:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.177+0000 7f4da54da640 1 --2- 172.21.15.146:0/2286991308 >> v2:172.21.15.179:3300/0 conn(0x7f4da006f270 0x7f4da01628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.177+0000 7f4da54da640 1 --2- 172.21.15.146:0/2286991308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4da01620f0 0x7f4da006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.177+0000 7f4da54da640 1 --2- 172.21.15.146:0/2286991308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4da00b3870 0x7f4da00cf370 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.177+0000 7f4da54da640 1 -- 172.21.15.146:0/2286991308 >> 172.21.15.146:0/2286991308 conn(0x7f4da00d4be0 msgr2=0x7f4da00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.177+0000 7f4da54da640 1 -- 172.21.15.146:0/2286991308 shutdown_connections 2024-09-17T03:37:40.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.177+0000 7f4da54da640 1 -- 172.21.15.146:0/2286991308 wait complete. 2024-09-17T03:37:40.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.179+0000 7f4da54da640 1 Processor -- start 2024-09-17T03:37:40.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.179+0000 7f4da54da640 1 -- start start 2024-09-17T03:37:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.180+0000 7f4da54da640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4da006f270 0x7f4da0157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.180+0000 7f4da54da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4da00b3870 0x7f4da015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.180+0000 7f4da54da640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4da01620f0 0x7f4da00c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.180+0000 7f4da54da640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4da0163170 con 0x7f4da01620f0 2024-09-17T03:37:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.180+0000 7f4da54da640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4da0162ff0 con 0x7f4da00b3870 2024-09-17T03:37:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.180+0000 7f4da54da640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4da01632f0 con 0x7f4da006f270 2024-09-17T03:37:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.180+0000 7f4d9f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4da01620f0 0x7f4da00c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.180+0000 7f4d9f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4da01620f0 0x7f4da00c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53072/0 (socket says 172.21.15.146:53072) 2024-09-17T03:37:40.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.180+0000 7f4d9f7fe640 1 -- 172.21.15.146:0/3446600743 learned_addr learned my addr 172.21.15.146:0/3446600743 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4d9effd640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4da006f270 0x7f4da0157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4d9e7fc640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4da00b3870 0x7f4da015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4d9f7fe640 1 -- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4da006f270 msgr2=0x7f4da0157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4d9f7fe640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4da006f270 0x7f4da0157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4d9f7fe640 1 -- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4da00b3870 msgr2=0x7f4da015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4d9f7fe640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4da00b3870 0x7f4da015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4d9f7fe640 1 -- 172.21.15.146:0/3446600743 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da00ccce0 con 0x7f4da01620f0 2024-09-17T03:37:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4d9f7fe640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4da01620f0 0x7f4da00c9fb0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800ea70 tx=0x7f4d9800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4d877fe640 1 -- 172.21.15.146:0/3446600743 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9800ce40 con 0x7f4da01620f0 2024-09-17T03:37:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4d877fe640 1 -- 172.21.15.146:0/3446600743 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d98004c10 con 0x7f4da01620f0 2024-09-17T03:37:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4da54da640 1 -- 172.21.15.146:0/3446600743 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da00cbc40 con 0x7f4da01620f0 2024-09-17T03:37:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4d877fe640 1 -- 172.21.15.146:0/3446600743 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d98005020 con 0x7f4da01620f0 2024-09-17T03:37:40.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.181+0000 7f4da54da640 1 -- 172.21.15.146:0/3446600743 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da00cc200 con 0x7f4da01620f0 2024-09-17T03:37:40.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.182+0000 7f4da54da640 1 -- 172.21.15.146:0/3446600743 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da00cb9a0 con 0x7f4da01620f0 2024-09-17T03:37:40.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.183+0000 7f4d877fe640 1 -- 172.21.15.146:0/3446600743 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d980051c0 con 0x7f4da01620f0 2024-09-17T03:37:40.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.183+0000 7f4d877fe640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d8c078b90 0x7f4d8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.183+0000 7f4d877fe640 1 -- 172.21.15.146:0/3446600743 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4857+0+0 (secure 0 0 0) 0x7f4d9809b8e0 con 0x7f4da01620f0 2024-09-17T03:37:40.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.184+0000 7f4d9effd640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d8c078b90 0x7f4d8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.184+0000 7f4d9effd640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d8c078b90 0x7f4d8c07b0a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4d90033000 tx=0x7f4d90004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:40.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.188+0000 7f4d877fe640 1 -- 172.21.15.146:0/3446600743 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4da00cb9a0 con 0x7f4da01620f0 2024-09-17T03:37:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.428+0000 7f4da54da640 1 -- 172.21.15.146:0/3446600743 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4da00d2bd0 con 0x7f4da01620f0 2024-09-17T03:37:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.429+0000 7f4d877fe640 1 -- 172.21.15.146:0/3446600743 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f4d98064070 con 0x7f4da01620f0 2024-09-17T03:37:40.428 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:40.428 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:37:40.428 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:37:40.428 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.428 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:37:40.428 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:37:40.428 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.429 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:37:40.429 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:37:40.429 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:37:40.429 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.429 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:37:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:37:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:37:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:37:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:37:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.431 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:37:40.432 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:37:40.432 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.432 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:37:40.432 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:37:40.432 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:37:40.432 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.432 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.432 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.432 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.432 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:37:40.432 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:40.433 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:37:40.435 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:37:40.436 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.436 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:40.436 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:37:40.436 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.436 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.436 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:37:40.436 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:37:40.436 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.436 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:40.437 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:37:40.437 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.437 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.437 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:37:40.437 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:37:40.437 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.437 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:40.437 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:37:40.437 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.438 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.438 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:37:40.438 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:37:40.438 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.438 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:37:40.438 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:37:40.438 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.438 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.439 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:37:40.439 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:37:40.439 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.439 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:37:40.439 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:37:40.439 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:37:40.439 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.439 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:37:40.440 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:37:40.440 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.440 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:37:40.440 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:37:40.440 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:37:40.440 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:37:40.440 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.440 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:37:40.440 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:37:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:37:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:37:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:37:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:37:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:37:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:37:40.441 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:37:40.442 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:37:40.443 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:37:40.443 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.443 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.443 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:37:40.443 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:37:40.443 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.443 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:37:40.443 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:37:40.443 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.444 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:37:40.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.444 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:37:40.444 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:37:40.444 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:37:40.444 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:37:40.444 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:37:40.444 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:37:40.444 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.444 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.445 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:37:40.445 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:37:40.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 -- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d8c078b90 msgr2=0x7f4d8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d8c078b90 0x7f4d8c07b0a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4d90033000 tx=0x7f4d90004730 comp rx=0 tx=0).stop 2024-09-17T03:37:40.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 -- 172.21.15.146:0/3446600743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4da01620f0 msgr2=0x7f4da00c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4da01620f0 0x7f4da00c9fb0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800ea70 tx=0x7f4d9800ef30 comp rx=0 tx=0).stop 2024-09-17T03:37:40.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 -- 172.21.15.146:0/3446600743 shutdown_connections 2024-09-17T03:37:40.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d8c078b90 0x7f4d8c07b0a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4da01620f0 0x7f4da00c9fb0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4da00b3870 0x7f4da015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 --2- 172.21.15.146:0/3446600743 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4da006f270 0x7f4da0157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 -- 172.21.15.146:0/3446600743 >> 172.21.15.146:0/3446600743 conn(0x7f4da00d4be0 msgr2=0x7f4da00b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:40.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 -- 172.21.15.146:0/3446600743 shutdown_connections 2024-09-17T03:37:40.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.431+0000 7f4da54da640 1 -- 172.21.15.146:0/3446600743 wait complete. 2024-09-17T03:37:40.448 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:37:40.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.563+0000 7f5b20415640 1 -- 172.21.15.146:0/2040174657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b180b3360 msgr2=0x7f5b18072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.563+0000 7f5b20415640 1 --2- 172.21.15.146:0/2040174657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b180b3360 0x7f5b18072df0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5b180b3120 tx=0x7f5b1402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.563+0000 7f5b20415640 1 -- 172.21.15.146:0/2040174657 shutdown_connections 2024-09-17T03:37:40.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.563+0000 7f5b20415640 1 --2- 172.21.15.146:0/2040174657 >> v2:172.21.15.179:3300/0 conn(0x7f5b180cfc40 0x7f5b1815ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.563+0000 7f5b20415640 1 --2- 172.21.15.146:0/2040174657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b180b3360 0x7f5b18072df0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.563+0000 7f5b20415640 1 -- 172.21.15.146:0/2040174657 >> 172.21.15.146:0/2040174657 conn(0x7f5b180b2060 msgr2=0x7f5b180b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:40.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.563+0000 7f5b20415640 1 -- 172.21.15.146:0/2040174657 shutdown_connections 2024-09-17T03:37:40.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.563+0000 7f5b20415640 1 -- 172.21.15.146:0/2040174657 wait complete. 2024-09-17T03:37:40.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.565+0000 7f5b20415640 1 Processor -- start 2024-09-17T03:37:40.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.565+0000 7f5b20415640 1 -- start start 2024-09-17T03:37:40.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b20415640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b180b3360 0x7f5b181f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b20415640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b180cfc40 0x7f5b1815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b20415640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1815f010 0x7f5b1815d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b20415640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5b18152040 con 0x7f5b180cfc40 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b20415640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5b18151ec0 con 0x7f5b180b3360 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b20415640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5b181521c0 con 0x7f5b1815f010 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1d9b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b180cfc40 0x7f5b1815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1d9b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b180cfc40 0x7f5b1815d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53080/0 (socket says 172.21.15.146:53080) 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1d9b0640 1 -- 172.21.15.146:0/3227656044 learned_addr learned my addr 172.21.15.146:0/3227656044 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1e1b1640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b180b3360 0x7f5b181f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1e9b2640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1815f010 0x7f5b1815d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1d9b0640 1 -- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1815f010 msgr2=0x7f5b1815d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1d9b0640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1815f010 0x7f5b1815d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1d9b0640 1 -- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b180b3360 msgr2=0x7f5b181f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1d9b0640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b180b3360 0x7f5b181f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1d9b0640 1 -- 172.21.15.146:0/3227656044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b181f3c70 con 0x7f5b180cfc40 2024-09-17T03:37:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1e1b1640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b180b3360 0x7f5b181f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.566+0000 7f5b1e9b2640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1815f010 0x7f5b1815d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.567+0000 7f5b1d9b0640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b180cfc40 0x7f5b1815d3b0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800d750 tx=0x7f5b0800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.567+0000 7f5b0effd640 1 -- 172.21.15.146:0/3227656044 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08017070 con 0x7f5b180cfc40 2024-09-17T03:37:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.567+0000 7f5b20415640 1 -- 172.21.15.146:0/3227656044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b181389e0 con 0x7f5b180cfc40 2024-09-17T03:37:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.567+0000 7f5b0effd640 1 -- 172.21.15.146:0/3227656044 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b08009d40 con 0x7f5b180cfc40 2024-09-17T03:37:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.567+0000 7f5b0effd640 1 -- 172.21.15.146:0/3227656044 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b080106c0 con 0x7f5b180cfc40 2024-09-17T03:37:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.567+0000 7f5b20415640 1 -- 172.21.15.146:0/3227656044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b18138fa0 con 0x7f5b180cfc40 2024-09-17T03:37:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.568+0000 7f5b20415640 1 -- 172.21.15.146:0/3227656044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b181f7000 con 0x7f5b180cfc40 2024-09-17T03:37:40.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.569+0000 7f5b0effd640 1 -- 172.21.15.146:0/3227656044 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b0801a070 con 0x7f5b180cfc40 2024-09-17T03:37:40.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.569+0000 7f5b0effd640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5afc078b90 0x7f5afc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.569+0000 7f5b0effd640 1 -- 172.21.15.146:0/3227656044 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4857+0+0 (secure 0 0 0) 0x7f5b0809ab20 con 0x7f5b180cfc40 2024-09-17T03:37:40.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.569+0000 7f5b1e1b1640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5afc078b90 0x7f5afc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.570+0000 7f5b1e1b1640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5afc078b90 0x7f5afc07b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5b14033000 tx=0x7f5b14004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:40.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.574+0000 7f5b0effd640 1 -- 172.21.15.146:0/3227656044 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5b0800de60 con 0x7f5b180cfc40 2024-09-17T03:37:40.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.749+0000 7f5b20415640 1 -- 172.21.15.146:0/3227656044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5b18072df0 con 0x7f5b180cfc40 2024-09-17T03:37:40.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.750+0000 7f5b0effd640 1 -- 172.21.15.146:0/3227656044 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) ==== 84+0+65 (secure 0 0 0) 0x7f5b080632c0 con 0x7f5b180cfc40 2024-09-17T03:37:40.749 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:40.749 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:37:40.749 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:37:40.749 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:37:40.749 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:37:40.749 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:37:40.749 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:37:40.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 -- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5afc078b90 msgr2=0x7f5afc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5afc078b90 0x7f5afc07b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5b14033000 tx=0x7f5b14004730 comp rx=0 tx=0).stop 2024-09-17T03:37:40.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 -- 172.21.15.146:0/3227656044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b180cfc40 msgr2=0x7f5b1815d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b180cfc40 0x7f5b1815d3b0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800d750 tx=0x7f5b0800dc10 comp rx=0 tx=0).stop 2024-09-17T03:37:40.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 -- 172.21.15.146:0/3227656044 shutdown_connections 2024-09-17T03:37:40.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5afc078b90 0x7f5afc07b0a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b1815f010 0x7f5b1815d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b180cfc40 0x7f5b1815d3b0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 --2- 172.21.15.146:0/3227656044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b180b3360 0x7f5b181f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 -- 172.21.15.146:0/3227656044 >> 172.21.15.146:0/3227656044 conn(0x7f5b180b2060 msgr2=0x7f5b180b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:40.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 -- 172.21.15.146:0/3227656044 shutdown_connections 2024-09-17T03:37:40.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.752+0000 7f5b20415640 1 -- 172.21.15.146:0/3227656044 wait complete. 2024-09-17T03:37:40.762 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:37:40.763 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:37:40.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.882+0000 7f80be558640 1 -- 172.21.15.146:0/2103007327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b815c9f0 msgr2=0x7f80b81526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.882+0000 7f80be558640 1 --2- 172.21.15.146:0/2103007327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b815c9f0 0x7f80b81526a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f80b8069500 tx=0x7f80a802a560 comp rx=0 tx=0).stop 2024-09-17T03:37:40.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.882+0000 7f80be558640 1 -- 172.21.15.146:0/2103007327 shutdown_connections 2024-09-17T03:37:40.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.882+0000 7f80be558640 1 --2- 172.21.15.146:0/2103007327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b80b4510 0x7f80b8070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.882+0000 7f80be558640 1 --2- 172.21.15.146:0/2103007327 >> v2:172.21.15.179:3300/0 conn(0x7f80b80b4100 0x7f80b806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.882+0000 7f80be558640 1 --2- 172.21.15.146:0/2103007327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b815c9f0 0x7f80b81526a0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.882+0000 7f80be558640 1 -- 172.21.15.146:0/2103007327 >> 172.21.15.146:0/2103007327 conn(0x7f80b806d3c0 msgr2=0x7f80b80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:40.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.882+0000 7f80be558640 1 -- 172.21.15.146:0/2103007327 shutdown_connections 2024-09-17T03:37:40.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.882+0000 7f80be558640 1 -- 172.21.15.146:0/2103007327 wait complete. 2024-09-17T03:37:40.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.884+0000 7f80be558640 1 Processor -- start 2024-09-17T03:37:40.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.884+0000 7f80be558640 1 -- start start 2024-09-17T03:37:40.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.885+0000 7f80be558640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b80b4100 0x7f80b8168a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.885+0000 7f80be558640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80b80b4510 0x7f80b8167440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.885+0000 7f80be558640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b81483d0 0x7f80b814aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.885+0000 7f80be558640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f80b80d04e0 con 0x7f80b80b4100 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.885+0000 7f80be558640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f80b80d0360 con 0x7f80b80b4510 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.885+0000 7f80be558640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f80b80d0660 con 0x7f80b81483d0 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.885+0000 7f80b7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b80b4100 0x7f80b8168a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.885+0000 7f80b7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b80b4100 0x7f80b8168a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53084/0 (socket says 172.21.15.146:53084) 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.885+0000 7f80b7fff640 1 -- 172.21.15.146:0/2435181461 learned_addr learned my addr 172.21.15.146:0/2435181461 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.885+0000 7f80b77fe640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80b80b4510 0x7f80b8167440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80bcaf5640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b81483d0 0x7f80b814aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80b7fff640 1 -- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b81483d0 msgr2=0x7f80b814aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80b7fff640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b81483d0 0x7f80b814aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80b7fff640 1 -- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80b80b4510 msgr2=0x7f80b8167440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80b7fff640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80b80b4510 0x7f80b8167440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80b7fff640 1 -- 172.21.15.146:0/2435181461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b8167980 con 0x7f80b80b4100 2024-09-17T03:37:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80b77fe640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80b80b4510 0x7f80b8167440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80b7fff640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b80b4100 0x7f80b8168a40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f80a8034040 tx=0x7f80a80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80b4ff9640 1 -- 172.21.15.146:0/2435181461 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a803e030 con 0x7f80b80b4100 2024-09-17T03:37:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80b4ff9640 1 -- 172.21.15.146:0/2435181461 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80a80047a0 con 0x7f80b80b4100 2024-09-17T03:37:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80be558640 1 -- 172.21.15.146:0/2435181461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b8147960 con 0x7f80b80b4100 2024-09-17T03:37:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80b4ff9640 1 -- 172.21.15.146:0/2435181461 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8035040 con 0x7f80b80b4100 2024-09-17T03:37:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.886+0000 7f80be558640 1 -- 172.21.15.146:0/2435181461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b8169370 con 0x7f80b80b4100 2024-09-17T03:37:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.887+0000 7f80be558640 1 -- 172.21.15.146:0/2435181461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b815ef80 con 0x7f80b80b4100 2024-09-17T03:37:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.888+0000 7f80b4ff9640 1 -- 172.21.15.146:0/2435181461 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f80a8041030 con 0x7f80b80b4100 2024-09-17T03:37:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.888+0000 7f80b4ff9640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80a4078bc0 0x7f80a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.888+0000 7f80b4ff9640 1 -- 172.21.15.146:0/2435181461 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4857+0+0 (secure 0 0 0) 0x7f80a80bb220 con 0x7f80b80b4100 2024-09-17T03:37:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.888+0000 7f80b77fe640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80a4078bc0 0x7f80a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:40.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.889+0000 7f80b77fe640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80a4078bc0 0x7f80a407b0d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f80b81f88a0 tx=0x7f80ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:40.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:40.893+0000 7f80b4ff9640 1 -- 172.21.15.146:0/2435181461 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f80b815ef80 con 0x7f80b80b4100 2024-09-17T03:37:41.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:41.069+0000 7f80be558640 1 -- 172.21.15.146:0/2435181461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f80b815c9f0 con 0x7f80b80b4100 2024-09-17T03:37:42.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.056+0000 7f80b4ff9640 1 -- 172.21.15.146:0/2435181461 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) ==== 138+0+0 (secure 0 0 0) 0x7f80a8083a40 con 0x7f80b80b4100 2024-09-17T03:37:42.055 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:37:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 -- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80a4078bc0 msgr2=0x7f80a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80a4078bc0 0x7f80a407b0d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f80b81f88a0 tx=0x7f80ac008040 comp rx=0 tx=0).stop 2024-09-17T03:37:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 -- 172.21.15.146:0/2435181461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b80b4100 msgr2=0x7f80b8168a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b80b4100 0x7f80b8168a40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f80a8034040 tx=0x7f80a80039e0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 -- 172.21.15.146:0/2435181461 shutdown_connections 2024-09-17T03:37:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80a4078bc0 0x7f80a407b0d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80b81483d0 0x7f80b814aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80b80b4510 0x7f80b8167440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 --2- 172.21.15.146:0/2435181461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80b80b4100 0x7f80b8168a40 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 -- 172.21.15.146:0/2435181461 >> 172.21.15.146:0/2435181461 conn(0x7f80b806d3c0 msgr2=0x7f80b806f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 -- 172.21.15.146:0/2435181461 shutdown_connections 2024-09-17T03:37:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.059+0000 7f80be558640 1 -- 172.21.15.146:0/2435181461 wait complete. 2024-09-17T03:37:42.074 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:37:42.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.198+0000 7f523aca4640 1 -- 172.21.15.146:0/2101081638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5234071320 msgr2=0x7f5234151f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:42.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.198+0000 7f523aca4640 1 --2- 172.21.15.146:0/2101081638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5234071320 0x7f5234151f10 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f5234072950 tx=0x7f522c02aac0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.198+0000 7f523aca4640 1 -- 172.21.15.146:0/2101081638 shutdown_connections 2024-09-17T03:37:42.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.198+0000 7f523aca4640 1 --2- 172.21.15.146:0/2101081638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5234071320 0x7f5234151f10 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.198+0000 7f523aca4640 1 --2- 172.21.15.146:0/2101081638 >> v2:172.21.15.179:3300/0 conn(0x7f52340b56e0 0x7f52340af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.198+0000 7f523aca4640 1 -- 172.21.15.146:0/2101081638 >> 172.21.15.146:0/2101081638 conn(0x7f52340b2fe0 msgr2=0x7f52340b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:42.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.198+0000 7f523aca4640 1 -- 172.21.15.146:0/2101081638 shutdown_connections 2024-09-17T03:37:42.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.198+0000 7f523aca4640 1 -- 172.21.15.146:0/2101081638 wait complete. 2024-09-17T03:37:42.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.200+0000 7f523aca4640 1 Processor -- start 2024-09-17T03:37:42.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.200+0000 7f523aca4640 1 -- start start 2024-09-17T03:37:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.201+0000 7f523aca4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52340b56e0 0x7f5234155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.201+0000 7f523aca4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f523415c7d0 0x7f52341f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.201+0000 7f523aca4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52341f5c60 0x7f5234154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.201+0000 7f523aca4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f52341527e0 con 0x7f52341f5c60 2024-09-17T03:37:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.201+0000 7f523aca4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5234152660 con 0x7f523415c7d0 2024-09-17T03:37:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.201+0000 7f523aca4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5234152960 con 0x7f52340b56e0 2024-09-17T03:37:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.201+0000 7f5239241640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52341f5c60 0x7f5234154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.201+0000 7f5239241640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52341f5c60 0x7f5234154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53102/0 (socket says 172.21.15.146:53102) 2024-09-17T03:37:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.201+0000 7f5239241640 1 -- 172.21.15.146:0/3757711799 learned_addr learned my addr 172.21.15.146:0/3757711799 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f522bfff640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f523415c7d0 0x7f52341f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f5238a40640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52340b56e0 0x7f5234155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f5239241640 1 -- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52340b56e0 msgr2=0x7f5234155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f5239241640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52340b56e0 0x7f5234155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f5239241640 1 -- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f523415c7d0 msgr2=0x7f52341f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f5239241640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f523415c7d0 0x7f52341f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f5239241640 1 -- 172.21.15.146:0/3757711799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52340d0580 con 0x7f52341f5c60 2024-09-17T03:37:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f5239241640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52341f5c60 0x7f5234154eb0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f522c009d60 tx=0x7f522c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f52297fa640 1 -- 172.21.15.146:0/3757711799 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522c044070 con 0x7f52341f5c60 2024-09-17T03:37:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f52297fa640 1 -- 172.21.15.146:0/3757711799 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f522c004250 con 0x7f52341f5c60 2024-09-17T03:37:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f523aca4640 1 -- 172.21.15.146:0/3757711799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52340ce450 con 0x7f52341f5c60 2024-09-17T03:37:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f52297fa640 1 -- 172.21.15.146:0/3757711799 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522c004680 con 0x7f52341f5c60 2024-09-17T03:37:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.202+0000 7f523aca4640 1 -- 172.21.15.146:0/3757711799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52341561a0 con 0x7f52341f5c60 2024-09-17T03:37:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.203+0000 7f523aca4640 1 -- 172.21.15.146:0/3757711799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52340d02f0 con 0x7f52341f5c60 2024-09-17T03:37:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.204+0000 7f52297fa640 1 -- 172.21.15.146:0/3757711799 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f522c036400 con 0x7f52341f5c60 2024-09-17T03:37:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.204+0000 7f52297fa640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5220078b90 0x7f522007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.204+0000 7f52297fa640 1 -- 172.21.15.146:0/3757711799 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5227+0+0 (secure 0 0 0) 0x7f522c0bb150 con 0x7f52341f5c60 2024-09-17T03:37:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.205+0000 7f5238a40640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5220078b90 0x7f522007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.205+0000 7f5238a40640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5220078b90 0x7f522007b0a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f523000bb50 tx=0x7f523000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:42.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.209+0000 7f52297fa640 1 -- 172.21.15.146:0/3757711799 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f522c032030 con 0x7f52341f5c60 2024-09-17T03:37:42.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:42.384+0000 7f523aca4640 1 -- 172.21.15.146:0/3757711799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f523406b100 con 0x7f52341f5c60 2024-09-17T03:37:43.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.058+0000 7f52297fa640 1 -- 172.21.15.146:0/3757711799 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) ==== 170+0+0 (secure 0 0 0) 0x7f523406b100 con 0x7f52341f5c60 2024-09-17T03:37:43.058 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:37:43.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 -- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5220078b90 msgr2=0x7f522007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:43.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5220078b90 0x7f522007b0a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f523000bb50 tx=0x7f523000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 -- 172.21.15.146:0/3757711799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52341f5c60 msgr2=0x7f5234154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:43.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52341f5c60 0x7f5234154eb0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f522c009d60 tx=0x7f522c003f10 comp rx=0 tx=0).stop 2024-09-17T03:37:43.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 -- 172.21.15.146:0/3757711799 shutdown_connections 2024-09-17T03:37:43.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5220078b90 0x7f522007b0a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52341f5c60 0x7f5234154eb0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f523415c7d0 0x7f52341f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 --2- 172.21.15.146:0/3757711799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52340b56e0 0x7f5234155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 -- 172.21.15.146:0/3757711799 >> 172.21.15.146:0/3757711799 conn(0x7f52340b2fe0 msgr2=0x7f52340b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:43.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 -- 172.21.15.146:0/3757711799 shutdown_connections 2024-09-17T03:37:43.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.062+0000 7f523aca4640 1 -- 172.21.15.146:0/3757711799 wait complete. 2024-09-17T03:37:43.088 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:37:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.207+0000 7fd18ec2e640 1 -- 172.21.15.146:0/1058192103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1880b47c0 msgr2=0x7fd188161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.207+0000 7fd18ec2e640 1 --2- 172.21.15.146:0/1058192103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1880b47c0 0x7fd188161760 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fd1880740d0 tx=0x7fd18002a4f0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.207+0000 7fd18ec2e640 1 -- 172.21.15.146:0/1058192103 shutdown_connections 2024-09-17T03:37:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.207+0000 7fd18ec2e640 1 --2- 172.21.15.146:0/1058192103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1880b47c0 0x7fd188161760 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.207+0000 7fd18ec2e640 1 --2- 172.21.15.146:0/1058192103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1880cf6b0 0x7fd188161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.207+0000 7fd18ec2e640 1 --2- 172.21.15.146:0/1058192103 >> v2:172.21.15.179:3300/0 conn(0x7fd1880d0710 0x7fd1880cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.207+0000 7fd18ec2e640 1 -- 172.21.15.146:0/1058192103 >> 172.21.15.146:0/1058192103 conn(0x7fd18809ba20 msgr2=0x7fd1880b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.207+0000 7fd18ec2e640 1 -- 172.21.15.146:0/1058192103 shutdown_connections 2024-09-17T03:37:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.207+0000 7fd18ec2e640 1 -- 172.21.15.146:0/1058192103 wait complete. 2024-09-17T03:37:43.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.209+0000 7fd18ec2e640 1 Processor -- start 2024-09-17T03:37:43.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.209+0000 7fd18ec2e640 1 -- start start 2024-09-17T03:37:43.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18ec2e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1880b47c0 0x7fd188156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:43.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18ec2e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1880cf6b0 0x7fd1880cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:43.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18ec2e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1880d0710 0x7fd188159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:43.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18ec2e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd188162030 con 0x7fd1880b47c0 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18ec2e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd188161eb0 con 0x7fd1880d0710 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18ec2e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd1880cd090 con 0x7fd1880cf6b0 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18c9ca640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1880b47c0 0x7fd188156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18c9ca640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1880b47c0 0x7fd188156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53122/0 (socket says 172.21.15.146:53122) 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18c9ca640 1 -- 172.21.15.146:0/3938305456 learned_addr learned my addr 172.21.15.146:0/3938305456 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18d1cb640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1880d0710 0x7fd188159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd17ffff640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1880cf6b0 0x7fd1880cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18c9ca640 1 -- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1880cf6b0 msgr2=0x7fd1880cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18c9ca640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1880cf6b0 0x7fd1880cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18c9ca640 1 -- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1880d0710 msgr2=0x7fd188159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18c9ca640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1880d0710 0x7fd188159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:43.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18c9ca640 1 -- 172.21.15.146:0/3938305456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18806dd60 con 0x7fd1880b47c0 2024-09-17T03:37:43.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18d1cb640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1880d0710 0x7fd188159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:43.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18c9ca640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1880b47c0 0x7fd188156ad0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd18400cd10 tx=0x7fd184007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:43.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd17d7fa640 1 -- 172.21.15.146:0/3938305456 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184004b20 con 0x7fd1880b47c0 2024-09-17T03:37:43.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd17d7fa640 1 -- 172.21.15.146:0/3938305456 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd184004db0 con 0x7fd1880b47c0 2024-09-17T03:37:43.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd17d7fa640 1 -- 172.21.15.146:0/3938305456 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184005280 con 0x7fd1880b47c0 2024-09-17T03:37:43.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.211+0000 7fd18ec2e640 1 -- 172.21.15.146:0/3938305456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1881f9810 con 0x7fd1880b47c0 2024-09-17T03:37:43.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.212+0000 7fd18ec2e640 1 -- 172.21.15.146:0/3938305456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1881f9dd0 con 0x7fd1880b47c0 2024-09-17T03:37:43.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.212+0000 7fd18ec2e640 1 -- 172.21.15.146:0/3938305456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1880cf170 con 0x7fd1880b47c0 2024-09-17T03:37:43.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.213+0000 7fd17d7fa640 1 -- 172.21.15.146:0/3938305456 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd184005420 con 0x7fd1880b47c0 2024-09-17T03:37:43.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.214+0000 7fd17d7fa640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd174078bc0 0x7fd17407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:43.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.214+0000 7fd17d7fa640 1 -- 172.21.15.146:0/3938305456 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5609+0+0 (secure 0 0 0) 0x7fd18409b870 con 0x7fd1880b47c0 2024-09-17T03:37:43.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.214+0000 7fd17ffff640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd174078bc0 0x7fd17407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:43.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.215+0000 7fd17ffff640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd174078bc0 0x7fd17407b0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd178005fd0 tx=0x7fd178005bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:43.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.218+0000 7fd17d7fa640 1 -- 172.21.15.146:0/3938305456 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd184014030 con 0x7fd1880b47c0 2024-09-17T03:37:43.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:43.427+0000 7fd18ec2e640 1 -- 172.21.15.146:0/3938305456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd1880ced70 con 0x7fd1880b47c0 2024-09-17T03:37:44.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.086+0000 7fd17d7fa640 1 -- 172.21.15.146:0/3938305456 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v58) ==== 174+0+0 (secure 0 0 0) 0x7fd184063df0 con 0x7fd1880b47c0 2024-09-17T03:37:44.086 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 12 and data pool 13 2024-09-17T03:37:44.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.094+0000 7fd18ec2e640 1 -- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd174078bc0 msgr2=0x7fd17407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.095+0000 7fd18ec2e640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd174078bc0 0x7fd17407b0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd178005fd0 tx=0x7fd178005bc0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.095+0000 7fd18ec2e640 1 -- 172.21.15.146:0/3938305456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1880b47c0 msgr2=0x7fd188156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.095+0000 7fd18ec2e640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1880b47c0 0x7fd188156ad0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd18400cd10 tx=0x7fd184007610 comp rx=0 tx=0).stop 2024-09-17T03:37:44.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.098+0000 7fd18ec2e640 1 -- 172.21.15.146:0/3938305456 shutdown_connections 2024-09-17T03:37:44.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.098+0000 7fd18ec2e640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd174078bc0 0x7fd17407b0d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.098+0000 7fd18ec2e640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1880d0710 0x7fd188159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.098+0000 7fd18ec2e640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1880cf6b0 0x7fd1880cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.098+0000 7fd18ec2e640 1 --2- 172.21.15.146:0/3938305456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1880b47c0 0x7fd188156ad0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.099+0000 7fd18ec2e640 1 -- 172.21.15.146:0/3938305456 >> 172.21.15.146:0/3938305456 conn(0x7fd18809ba20 msgr2=0x7fd1880706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:44.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.099+0000 7fd18ec2e640 1 -- 172.21.15.146:0/3938305456 shutdown_connections 2024-09-17T03:37:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.100+0000 7fd18ec2e640 1 -- 172.21.15.146:0/3938305456 wait complete. 2024-09-17T03:37:44.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.237+0000 7f45460d3640 1 -- 172.21.15.146:0/3527197897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4528004800 msgr2=0x7f4528004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.237+0000 7f45460d3640 1 --2- 172.21.15.146:0/3527197897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4528004800 0x7f4528004c10 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f4540073530 tx=0x7f4528005830 comp rx=0 tx=0).stop 2024-09-17T03:37:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.237+0000 7f453ffff640 1 -- 172.21.15.146:0/3527197897 reap_dead start 2024-09-17T03:37:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.237+0000 7f45460d3640 1 -- 172.21.15.146:0/3527197897 shutdown_connections 2024-09-17T03:37:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.237+0000 7f45460d3640 1 -- 172.21.15.146:0/3527197897 >> 172.21.15.146:0/3527197897 conn(0x7f45400b3150 msgr2=0x7f45400b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.237+0000 7f45460d3640 1 -- 172.21.15.146:0/3527197897 shutdown_connections 2024-09-17T03:37:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.237+0000 7f45460d3640 1 -- 172.21.15.146:0/3527197897 wait complete. 2024-09-17T03:37:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.239+0000 7f45460d3640 1 Processor -- start 2024-09-17T03:37:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.239+0000 7f45460d3640 1 -- start start 2024-09-17T03:37:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.240+0000 7f45460d3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4528004800 0x7f45401f72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.240+0000 7f45460d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45401f32b0 0x7f45400aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.240+0000 7f45460d3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45401457c0 0x7f45400aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.240+0000 7f45460d3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f45400b5a10 con 0x7f45401f32b0 2024-09-17T03:37:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.240+0000 7f45460d3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f45400b5890 con 0x7f4528004800 2024-09-17T03:37:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.240+0000 7f45460d3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f45400b5b90 con 0x7f45401457c0 2024-09-17T03:37:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f453effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45401f32b0 0x7f45400aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f453effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45401f32b0 0x7f45400aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53134/0 (socket says 172.21.15.146:53134) 2024-09-17T03:37:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f453effd640 1 -- 172.21.15.146:0/2451379769 learned_addr learned my addr 172.21.15.146:0/2451379769 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f453f7fe640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4528004800 0x7f45401f72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f453ffff640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45401457c0 0x7f45400aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f453effd640 1 -- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45401457c0 msgr2=0x7f45400aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f453effd640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45401457c0 0x7f45400aa9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f453effd640 1 -- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4528004800 msgr2=0x7f45401f72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f453effd640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4528004800 0x7f45401f72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f453effd640 1 -- 172.21.15.146:0/2451379769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45401f7830 con 0x7f45401f32b0 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f453effd640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45401f32b0 0x7f45400aa480 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f4534009a70 tx=0x7f4534033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f4527fff640 1 -- 172.21.15.146:0/2451379769 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534038040 con 0x7f45401f32b0 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f4527fff640 1 -- 172.21.15.146:0/2451379769 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4534033860 con 0x7f45401f32b0 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f4527fff640 1 -- 172.21.15.146:0/2451379769 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534033c70 con 0x7f45401f32b0 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f45460d3640 1 -- 172.21.15.146:0/2451379769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45401f37e0 con 0x7f45401f32b0 2024-09-17T03:37:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.241+0000 7f45460d3640 1 -- 172.21.15.146:0/2451379769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45401f3da0 con 0x7f45401f32b0 2024-09-17T03:37:44.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.243+0000 7f45460d3640 1 -- 172.21.15.146:0/2451379769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454006f580 con 0x7f45401f32b0 2024-09-17T03:37:44.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.243+0000 7f4527fff640 1 -- 172.21.15.146:0/2451379769 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4534045020 con 0x7f45401f32b0 2024-09-17T03:37:44.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.244+0000 7f4527fff640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f452c078b90 0x7f452c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.244+0000 7f4527fff640 1 -- 172.21.15.146:0/2451379769 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f45340bb400 con 0x7f45401f32b0 2024-09-17T03:37:44.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.244+0000 7f453f7fe640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f452c078b90 0x7f452c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.245+0000 7f453f7fe640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f452c078b90 0x7f452c07b0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4530005fd0 tx=0x7f4530009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:44.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.249+0000 7f4527fff640 1 -- 172.21.15.146:0/2451379769 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f453404c020 con 0x7f45401f32b0 2024-09-17T03:37:44.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.425+0000 7f45460d3640 1 -- 172.21.15.146:0/2451379769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4540073fa0 con 0x7f45401f32b0 2024-09-17T03:37:44.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.426+0000 7f4527fff640 1 -- 172.21.15.146:0/2451379769 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16781 (secure 0 0 0) 0x7f45401f7830 con 0x7f45401f32b0 2024-09-17T03:37:44.425 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:44.425 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:37:43.428793+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:41.074046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:42.389031+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:44.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 -- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f452c078b90 msgr2=0x7f452c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f452c078b90 0x7f452c07b0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4530005fd0 tx=0x7f4530009500 comp rx=0 tx=0).stop 2024-09-17T03:37:44.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 -- 172.21.15.146:0/2451379769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45401f32b0 msgr2=0x7f45400aa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45401f32b0 0x7f45400aa480 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f4534009a70 tx=0x7f4534033670 comp rx=0 tx=0).stop 2024-09-17T03:37:44.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 -- 172.21.15.146:0/2451379769 shutdown_connections 2024-09-17T03:37:44.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f452c078b90 0x7f452c07b0a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45401457c0 0x7f45400aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45401f32b0 0x7f45400aa480 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 --2- 172.21.15.146:0/2451379769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4528004800 0x7f45401f72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 -- 172.21.15.146:0/2451379769 >> 172.21.15.146:0/2451379769 conn(0x7f45400b3150 msgr2=0x7f454015ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:44.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 -- 172.21.15.146:0/2451379769 shutdown_connections 2024-09-17T03:37:44.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.428+0000 7f45460d3640 1 -- 172.21.15.146:0/2451379769 wait complete. 2024-09-17T03:37:44.439 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:44.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.554+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/4043586238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b780b4100 msgr2=0x7f6b7806fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.554+0000 7f6b7f8b6640 1 --2- 172.21.15.146:0/4043586238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b780b4100 0x7f6b7806fad0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6b78070660 tx=0x7f6b6802a560 comp rx=0 tx=0).stop 2024-09-17T03:37:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.554+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/4043586238 shutdown_connections 2024-09-17T03:37:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.554+0000 7f6b7f8b6640 1 --2- 172.21.15.146:0/4043586238 >> v2:172.21.15.179:3300/0 conn(0x7f6b780b4510 0x7f6b78070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.554+0000 7f6b7f8b6640 1 --2- 172.21.15.146:0/4043586238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b780b4100 0x7f6b7806fad0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.554+0000 7f6b7f8b6640 1 --2- 172.21.15.146:0/4043586238 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b7815c9f0 0x7f6b781526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.554+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/4043586238 >> 172.21.15.146:0/4043586238 conn(0x7f6b7806d3c0 msgr2=0x7f6b780b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.554+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/4043586238 shutdown_connections 2024-09-17T03:37:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.554+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/4043586238 wait complete. 2024-09-17T03:37:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.556+0000 7f6b7f8b6640 1 Processor -- start 2024-09-17T03:37:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.556+0000 7f6b7f8b6640 1 -- start start 2024-09-17T03:37:44.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7f8b6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b780b4100 0x7f6b78140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7f8b6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b780b4510 0x7f6b7814e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7f8b6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b7814ef10 0x7f6b7814a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7f8b6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6b780d04e0 con 0x7f6b780b4100 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7f8b6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6b780d0360 con 0x7f6b7814ef10 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7f8b6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6b780d0660 con 0x7f6b780b4510 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7d652640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b780b4100 0x7f6b78140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7d652640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b780b4100 0x7f6b78140ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53162/0 (socket says 172.21.15.146:53162) 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7d652640 1 -- 172.21.15.146:0/1573784242 learned_addr learned my addr 172.21.15.146:0/1573784242 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7de53640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b7814ef10 0x7f6b7814a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7ce51640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b780b4510 0x7f6b7814e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7d652640 1 -- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b780b4510 msgr2=0x7f6b7814e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7d652640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b780b4510 0x7f6b7814e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7d652640 1 -- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b7814ef10 msgr2=0x7f6b7814a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7d652640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b7814ef10 0x7f6b7814a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7d652640 1 -- 172.21.15.146:0/1573784242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7814f770 con 0x7f6b780b4100 2024-09-17T03:37:44.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7de53640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b7814ef10 0x7f6b7814a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:44.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.557+0000 7f6b7ce51640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b780b4510 0x7f6b7814e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:44.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.558+0000 7f6b7d652640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b780b4100 0x7f6b78140ad0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6b740097b0 tx=0x7f6b74009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:44.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.558+0000 7f6b6dffb640 1 -- 172.21.15.146:0/1573784242 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7401d070 con 0x7f6b780b4100 2024-09-17T03:37:44.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.558+0000 7f6b6dffb640 1 -- 172.21.15.146:0/1573784242 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b740077a0 con 0x7f6b780b4100 2024-09-17T03:37:44.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.558+0000 7f6b6dffb640 1 -- 172.21.15.146:0/1573784242 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74007bf0 con 0x7f6b780b4100 2024-09-17T03:37:44.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.558+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/1573784242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b78149880 con 0x7f6b780b4100 2024-09-17T03:37:44.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.558+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/1573784242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b78149e40 con 0x7f6b780b4100 2024-09-17T03:37:44.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.559+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/1573784242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b7815c9f0 con 0x7f6b780b4100 2024-09-17T03:37:44.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.560+0000 7f6b6dffb640 1 -- 172.21.15.146:0/1573784242 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b74020070 con 0x7f6b780b4100 2024-09-17T03:37:44.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.560+0000 7f6b6dffb640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b5c078b90 0x7f6b5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.560+0000 7f6b6dffb640 1 -- 172.21.15.146:0/1573784242 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f6b7409c580 con 0x7f6b780b4100 2024-09-17T03:37:44.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.560+0000 7f6b7ce51640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b5c078b90 0x7f6b5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.561+0000 7f6b7ce51640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b5c078b90 0x7f6b5c07b0a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6b68033000 tx=0x7f6b68004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:44.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.565+0000 7f6b6dffb640 1 -- 172.21.15.146:0/1573784242 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6b74064a50 con 0x7f6b780b4100 2024-09-17T03:37:44.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.738+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/1573784242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b7806b100 con 0x7f6b780b4100 2024-09-17T03:37:44.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.739+0000 7f6b6dffb640 1 -- 172.21.15.146:0/1573784242 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16781 (secure 0 0 0) 0x7f6b74064350 con 0x7f6b780b4100 2024-09-17T03:37:44.738 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:44.738 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:37:43.428793+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:41.074046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:42.389031+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:44.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.741+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b5c078b90 msgr2=0x7f6b5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.741+0000 7f6b7f8b6640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b5c078b90 0x7f6b5c07b0a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6b68033000 tx=0x7f6b68004730 comp rx=0 tx=0).stop 2024-09-17T03:37:44.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.741+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/1573784242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b780b4100 msgr2=0x7f6b78140ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.741+0000 7f6b7f8b6640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b780b4100 0x7f6b78140ad0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6b740097b0 tx=0x7f6b74009c70 comp rx=0 tx=0).stop 2024-09-17T03:37:44.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.741+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/1573784242 shutdown_connections 2024-09-17T03:37:44.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.741+0000 7f6b7f8b6640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b5c078b90 0x7f6b5c07b0a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.741+0000 7f6b7f8b6640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b7814ef10 0x7f6b7814a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.741+0000 7f6b7f8b6640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b780b4510 0x7f6b7814e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.741+0000 7f6b7f8b6640 1 --2- 172.21.15.146:0/1573784242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b780b4100 0x7f6b78140ad0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.741+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/1573784242 >> 172.21.15.146:0/1573784242 conn(0x7f6b7806d3c0 msgr2=0x7f6b78150130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:44.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.742+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/1573784242 shutdown_connections 2024-09-17T03:37:44.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.742+0000 7f6b7f8b6640 1 -- 172.21.15.146:0/1573784242 wait complete. 2024-09-17T03:37:44.752 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:37:44.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.869+0000 7f7f809ad640 1 -- 172.21.15.146:0/1954323478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f64005350 msgr2=0x7f7f6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.869+0000 7f7f809ad640 1 --2- 172.21.15.146:0/1954323478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f64005350 0x7f7f6400b9c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7f74001690 tx=0x7f7f64005830 comp rx=0 tx=0).stop 2024-09-17T03:37:44.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.869+0000 7f7f809ad640 1 -- 172.21.15.146:0/1954323478 shutdown_connections 2024-09-17T03:37:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.869+0000 7f7f809ad640 1 --2- 172.21.15.146:0/1954323478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f64005350 0x7f7f6400b9c0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.869+0000 7f7f809ad640 1 -- 172.21.15.146:0/1954323478 >> 172.21.15.146:0/1954323478 conn(0x7f7f7c0b3150 msgr2=0x7f7f7c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.869+0000 7f7f809ad640 1 -- 172.21.15.146:0/1954323478 shutdown_connections 2024-09-17T03:37:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.869+0000 7f7f809ad640 1 -- 172.21.15.146:0/1954323478 wait complete. 2024-09-17T03:37:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.871+0000 7f7f809ad640 1 Processor -- start 2024-09-17T03:37:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.871+0000 7f7f809ad640 1 -- start start 2024-09-17T03:37:44.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f809ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f64005350 0x7f7f7c142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f809ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f7c1563c0 0x7f7f7c1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f809ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c06cc50 0x7f7f7c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f809ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c0b5a10 con 0x7f7f7c06cc50 2024-09-17T03:37:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f809ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c0b5890 con 0x7f7f7c1563c0 2024-09-17T03:37:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f809ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7c0b5b90 con 0x7f7f64005350 2024-09-17T03:37:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f7ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c06cc50 0x7f7f7c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f7ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c06cc50 0x7f7f7c06d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53170/0 (socket says 172.21.15.146:53170) 2024-09-17T03:37:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f7ad9d640 1 -- 172.21.15.146:0/3771619708 learned_addr learned my addr 172.21.15.146:0/3771619708 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f7a59c640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f64005350 0x7f7f7c142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f79d9b640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f7c1563c0 0x7f7f7c1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.872+0000 7f7f7ad9d640 1 -- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f64005350 msgr2=0x7f7f7c142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.873+0000 7f7f7ad9d640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f64005350 0x7f7f7c142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.873+0000 7f7f7ad9d640 1 -- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f7c1563c0 msgr2=0x7f7f7c1567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.873+0000 7f7f7ad9d640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f7c1563c0 0x7f7f7c1567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.873+0000 7f7f7ad9d640 1 -- 172.21.15.146:0/3771619708 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c06d5a0 con 0x7f7f7c06cc50 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.873+0000 7f7f7ad9d640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c06cc50 0x7f7f7c06d060 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f7f740017b0 tx=0x7f7f740063b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.873+0000 7f7f6affd640 1 -- 172.21.15.146:0/3771619708 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74037070 con 0x7f7f7c06cc50 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.873+0000 7f7f6affd640 1 -- 172.21.15.146:0/3771619708 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f74003b10 con 0x7f7f7c06cc50 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.873+0000 7f7f809ad640 1 -- 172.21.15.146:0/3771619708 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7c157130 con 0x7f7f7c06cc50 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.873+0000 7f7f6affd640 1 -- 172.21.15.146:0/3771619708 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74032410 con 0x7f7f7c06cc50 2024-09-17T03:37:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.873+0000 7f7f809ad640 1 -- 172.21.15.146:0/3771619708 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7c143380 con 0x7f7f7c06cc50 2024-09-17T03:37:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.874+0000 7f7f809ad640 1 -- 172.21.15.146:0/3771619708 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7c156ea0 con 0x7f7f7c06cc50 2024-09-17T03:37:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.875+0000 7f7f6affd640 1 -- 172.21.15.146:0/3771619708 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7f74030020 con 0x7f7f7c06cc50 2024-09-17T03:37:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.875+0000 7f7f6affd640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f5c078b90 0x7f7f5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.876+0000 7f7f6affd640 1 -- 172.21.15.146:0/3771619708 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f7f740ba550 con 0x7f7f7c06cc50 2024-09-17T03:37:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.876+0000 7f7f7a59c640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f5c078b90 0x7f7f5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.876+0000 7f7f7a59c640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f5c078b90 0x7f7f5c07b0a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c005fd0 tx=0x7f7f6c009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:44.880+0000 7f7f6affd640 1 -- 172.21.15.146:0/3771619708 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7f7c06d5a0 con 0x7f7f7c06cc50 2024-09-17T03:37:45.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:45.088+0000 7f7f809ad640 1 -- 172.21.15.146:0/3771619708 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7f7c157910 con 0x7f7f7c06cc50 2024-09-17T03:37:46.055 INFO:tasks.ceph.mds.b.smithi179.stderr:2024-09-17T03:37:46.055+0000 7fc26df6e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:37:46.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.092+0000 7f7f6affd640 1 -- 172.21.15.146:0/3771619708 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) ==== 118+0+0 (secure 0 0 0) 0x7f7f7c157910 con 0x7f7f7c06cc50 2024-09-17T03:37:46.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 -- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f5c078b90 msgr2=0x7f7f5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f5c078b90 0x7f7f5c07b0a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c005fd0 tx=0x7f7f6c009500 comp rx=0 tx=0).stop 2024-09-17T03:37:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 -- 172.21.15.146:0/3771619708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c06cc50 msgr2=0x7f7f7c06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c06cc50 0x7f7f7c06d060 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f7f740017b0 tx=0x7f7f740063b0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 -- 172.21.15.146:0/3771619708 shutdown_connections 2024-09-17T03:37:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7f5c078b90 0x7f7f5c07b0a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f7c06cc50 0x7f7f7c06d060 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f7c1563c0 0x7f7f7c1567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 --2- 172.21.15.146:0/3771619708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f64005350 0x7f7f7c142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 -- 172.21.15.146:0/3771619708 >> 172.21.15.146:0/3771619708 conn(0x7f7f7c0b3150 msgr2=0x7f7f7c155b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 -- 172.21.15.146:0/3771619708 shutdown_connections 2024-09-17T03:37:46.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.095+0000 7f7f809ad640 1 -- 172.21.15.146:0/3771619708 wait complete. 2024-09-17T03:37:46.108 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:37:46.108 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:37:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.231+0000 7fcfbc957640 1 -- 172.21.15.146:0/1474658113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8145ce0 msgr2=0x7fcfb80cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.231+0000 7fcfbc957640 1 --2- 172.21.15.146:0/1474658113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8145ce0 0x7fcfb80cfd60 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009830 tx=0x7fcfb002a510 comp rx=0 tx=0).stop 2024-09-17T03:37:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.232+0000 7fcfbc957640 1 -- 172.21.15.146:0/1474658113 shutdown_connections 2024-09-17T03:37:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.232+0000 7fcfbc957640 1 --2- 172.21.15.146:0/1474658113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8145ce0 0x7fcfb80cfd60 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.232+0000 7fcfbc957640 1 -- 172.21.15.146:0/1474658113 >> 172.21.15.146:0/1474658113 conn(0x7fcfb80b3150 msgr2=0x7fcfb80b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.232+0000 7fcfbc957640 1 -- 172.21.15.146:0/1474658113 shutdown_connections 2024-09-17T03:37:46.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.232+0000 7fcfbc957640 1 -- 172.21.15.146:0/1474658113 wait complete. 2024-09-17T03:37:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.234+0000 7fcfbc957640 1 Processor -- start 2024-09-17T03:37:46.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.234+0000 7fcfbc957640 1 -- start start 2024-09-17T03:37:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfbc957640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8145ce0 0x7fcfb80b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfbc957640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfb8146230 0x7fcfb815b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfbc957640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb8143fa0 0x7fcfb8144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfbc957640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb80d0630 con 0x7fcfb8145ce0 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfbc957640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb80d04b0 con 0x7fcfb8143fa0 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfbc957640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb80d07b0 con 0x7fcfb8146230 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfb659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8145ce0 0x7fcfb80b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfb659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8145ce0 0x7fcfb80b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53186/0 (socket says 172.21.15.146:53186) 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfb659c640 1 -- 172.21.15.146:0/3570793059 learned_addr learned my addr 172.21.15.146:0/3570793059 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfb6d9d640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb8143fa0 0x7fcfb8144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfb5d9b640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfb8146230 0x7fcfb815b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfb659c640 1 -- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfb8146230 msgr2=0x7fcfb815b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfb659c640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfb8146230 0x7fcfb815b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfb659c640 1 -- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb8143fa0 msgr2=0x7fcfb8144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfb659c640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb8143fa0 0x7fcfb8144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfb659c640 1 -- 172.21.15.146:0/3570793059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb81444d0 con 0x7fcfb8145ce0 2024-09-17T03:37:46.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.235+0000 7fcfb659c640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8145ce0 0x7fcfb80b5170 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800c7d0 tx=0x7fcfa800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.236+0000 7fcfa6ffd640 1 -- 172.21.15.146:0/3570793059 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8017070 con 0x7fcfb8145ce0 2024-09-17T03:37:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.236+0000 7fcfa6ffd640 1 -- 172.21.15.146:0/3570793059 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfa8005070 con 0x7fcfb8145ce0 2024-09-17T03:37:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.236+0000 7fcfbc957640 1 -- 172.21.15.146:0/3570793059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb80aeae0 con 0x7fcfb8145ce0 2024-09-17T03:37:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.236+0000 7fcfa6ffd640 1 -- 172.21.15.146:0/3570793059 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80054a0 con 0x7fcfb8145ce0 2024-09-17T03:37:46.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.236+0000 7fcfbc957640 1 -- 172.21.15.146:0/3570793059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb80af0a0 con 0x7fcfb8145ce0 2024-09-17T03:37:46.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.237+0000 7fcfbc957640 1 -- 172.21.15.146:0/3570793059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb806cc50 con 0x7fcfb8145ce0 2024-09-17T03:37:46.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.237+0000 7fcfa6ffd640 1 -- 172.21.15.146:0/3570793059 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcfa801a070 con 0x7fcfb8145ce0 2024-09-17T03:37:46.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.238+0000 7fcfa6ffd640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf98078b90 0x7fcf9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:46.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.238+0000 7fcfa6ffd640 1 -- 172.21.15.146:0/3570793059 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fcfa809a330 con 0x7fcfb8145ce0 2024-09-17T03:37:46.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.238+0000 7fcfb5d9b640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf98078b90 0x7fcf9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:46.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.239+0000 7fcfb5d9b640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf98078b90 0x7fcf9807b0a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcfac006fd0 tx=0x7fcfac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:46.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.243+0000 7fcfa6ffd640 1 -- 172.21.15.146:0/3570793059 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcfa8062800 con 0x7fcfb8145ce0 2024-09-17T03:37:46.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:46.458+0000 7fcfbc957640 1 -- 172.21.15.146:0/3570793059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcfb8142ba0 con 0x7fcfb8145ce0 2024-09-17T03:37:47.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.102+0000 7fcfa6ffd640 1 -- 172.21.15.146:0/3570793059 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) ==== 122+0+0 (secure 0 0 0) 0x7fcfa8062100 con 0x7fcfb8145ce0 2024-09-17T03:37:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 -- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf98078b90 msgr2=0x7fcf9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf98078b90 0x7fcf9807b0a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcfac006fd0 tx=0x7fcfac008040 comp rx=0 tx=0).stop 2024-09-17T03:37:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 -- 172.21.15.146:0/3570793059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8145ce0 msgr2=0x7fcfb80b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8145ce0 0x7fcfb80b5170 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800c7d0 tx=0x7fcfa800cc90 comp rx=0 tx=0).stop 2024-09-17T03:37:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 -- 172.21.15.146:0/3570793059 shutdown_connections 2024-09-17T03:37:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf98078b90 0x7fcf9807b0a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb8143fa0 0x7fcfb8144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcfb8146230 0x7fcfb815b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 --2- 172.21.15.146:0/3570793059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfb8145ce0 0x7fcfb80b5170 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 -- 172.21.15.146:0/3570793059 >> 172.21.15.146:0/3570793059 conn(0x7fcfb80b3150 msgr2=0x7fcfb813f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 -- 172.21.15.146:0/3570793059 shutdown_connections 2024-09-17T03:37:47.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.106+0000 7fcfbc957640 1 -- 172.21.15.146:0/3570793059 wait complete. 2024-09-17T03:37:47.117 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:37:47.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:47.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.231+0000 7f9487bc3640 1 -- 172.21.15.146:0/29500336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9480072680 msgr2=0x7f9480072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.231+0000 7f9487bc3640 1 --2- 172.21.15.146:0/29500336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9480072680 0x7f9480072a90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f94700098e0 tx=0x7f947002a530 comp rx=0 tx=0).stop 2024-09-17T03:37:47.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.231+0000 7f9487bc3640 1 -- 172.21.15.146:0/29500336 shutdown_connections 2024-09-17T03:37:47.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.231+0000 7f9487bc3640 1 --2- 172.21.15.146:0/29500336 >> v2:172.21.15.179:3300/0 conn(0x7f94800b4370 0x7f94800b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.231+0000 7f9487bc3640 1 --2- 172.21.15.146:0/29500336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9480072680 0x7f9480072a90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.231+0000 7f9487bc3640 1 -- 172.21.15.146:0/29500336 >> 172.21.15.146:0/29500336 conn(0x7f94800b2060 msgr2=0x7f94800b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:47.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.231+0000 7f9487bc3640 1 -- 172.21.15.146:0/29500336 shutdown_connections 2024-09-17T03:37:47.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.231+0000 7f9487bc3640 1 -- 172.21.15.146:0/29500336 wait complete. 2024-09-17T03:37:47.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.233+0000 7f9487bc3640 1 Processor -- start 2024-09-17T03:37:47.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.233+0000 7f9487bc3640 1 -- start start 2024-09-17T03:37:47.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.234+0000 7f9487bc3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9480072680 0x7f9480148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.234+0000 7f9487bc3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94800b4370 0x7f948015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.234+0000 7f9487bc3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948015b770 0x7f948015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.234+0000 7f9487bc3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f94800b4e40 con 0x7f9480072680 2024-09-17T03:37:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.234+0000 7f9487bc3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f94800b4cc0 con 0x7f948015b770 2024-09-17T03:37:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.234+0000 7f9487bc3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f94800b4fc0 con 0x7f94800b4370 2024-09-17T03:37:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.234+0000 7f948595f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9480072680 0x7f9480148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.234+0000 7f948595f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9480072680 0x7f9480148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56236/0 (socket says 172.21.15.146:56236) 2024-09-17T03:37:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.234+0000 7f948595f640 1 -- 172.21.15.146:0/2812488960 learned_addr learned my addr 172.21.15.146:0/2812488960 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f9486160640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948015b770 0x7f948015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f948515e640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94800b4370 0x7f948015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f948595f640 1 -- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94800b4370 msgr2=0x7f948015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f948595f640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94800b4370 0x7f948015dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f948595f640 1 -- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948015b770 msgr2=0x7f948015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f948595f640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948015b770 0x7f948015e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f948595f640 1 -- 172.21.15.146:0/2812488960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94800aabf0 con 0x7f9480072680 2024-09-17T03:37:47.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f948595f640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9480072680 0x7f9480148d70 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c3a0 tx=0x7f947c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:47.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f94767fc640 1 -- 172.21.15.146:0/2812488960 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c017070 con 0x7f9480072680 2024-09-17T03:37:47.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f94767fc640 1 -- 172.21.15.146:0/2812488960 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f947c0053c0 con 0x7f9480072680 2024-09-17T03:37:47.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f9487bc3640 1 -- 172.21.15.146:0/2812488960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94800aaed0 con 0x7f9480072680 2024-09-17T03:37:47.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f94767fc640 1 -- 172.21.15.146:0/2812488960 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c003850 con 0x7f9480072680 2024-09-17T03:37:47.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.235+0000 7f9487bc3640 1 -- 172.21.15.146:0/2812488960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94800ab490 con 0x7f9480072680 2024-09-17T03:37:47.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.236+0000 7f9487bc3640 1 -- 172.21.15.146:0/2812488960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94800b5580 con 0x7f9480072680 2024-09-17T03:37:47.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.237+0000 7f94767fc640 1 -- 172.21.15.146:0/2812488960 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f947c01a070 con 0x7f9480072680 2024-09-17T03:37:47.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.238+0000 7f94767fc640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9464078b90 0x7f946407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.238+0000 7f94767fc640 1 -- 172.21.15.146:0/2812488960 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f947c099fa0 con 0x7f9480072680 2024-09-17T03:37:47.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.238+0000 7f948515e640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9464078b90 0x7f946407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.238+0000 7f948515e640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9464078b90 0x7f946407b0a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9470034000 tx=0x7f9470004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:47.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.242+0000 7f94767fc640 1 -- 172.21.15.146:0/2812488960 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f948015bb80 con 0x7f9480072680 2024-09-17T03:37:47.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.452+0000 7f9487bc3640 1 -- 172.21.15.146:0/2812488960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94800adc70 con 0x7f9480072680 2024-09-17T03:37:47.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.453+0000 7f94767fc640 1 -- 172.21.15.146:0/2812488960 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5228 (secure 0 0 0) 0x7f947c061d90 con 0x7f9480072680 2024-09-17T03:37:47.452 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:47.452 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":62,"btime":"2024-09-17T03:37:47:097700+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2333155525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2333155525},{"type":"v1","addr":"172.21.15.179:6837","nonce":2333155525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2732155214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2732155214},{"type":"v1","addr":"172.21.15.146:6834","nonce":2732155214}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1878440937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1878440937},{"type":"v1","addr":"172.21.15.146:6835","nonce":1878440937}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:46.459184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7311":{"gid":7311,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/9562532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":9562532},{"type":"v1","addr":"172.21.15.179:6836","nonce":9562532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7311,"qdb_cluster":[7311]},"id":6}]} 2024-09-17T03:37:47.452 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 62 2024-09-17T03:37:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 -- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9464078b90 msgr2=0x7f946407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9464078b90 0x7f946407b0a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9470034000 tx=0x7f9470004730 comp rx=0 tx=0).stop 2024-09-17T03:37:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 -- 172.21.15.146:0/2812488960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9480072680 msgr2=0x7f9480148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9480072680 0x7f9480148d70 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c3a0 tx=0x7f947c00c7a0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 -- 172.21.15.146:0/2812488960 shutdown_connections 2024-09-17T03:37:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9464078b90 0x7f946407b0a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f948015b770 0x7f948015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94800b4370 0x7f948015dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 --2- 172.21.15.146:0/2812488960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9480072680 0x7f9480148d70 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 -- 172.21.15.146:0/2812488960 >> 172.21.15.146:0/2812488960 conn(0x7f94800b2060 msgr2=0x7f9480159c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:47.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 -- 172.21.15.146:0/2812488960 shutdown_connections 2024-09-17T03:37:47.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.455+0000 7f9487bc3640 1 -- 172.21.15.146:0/2812488960 wait complete. 2024-09-17T03:37:47.466 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:37:47.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.579+0000 7fd8615c3640 1 -- 172.21.15.146:0/1142055567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd848003a00 msgr2=0x7fd848003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.579+0000 7fd8615c3640 1 --2- 172.21.15.146:0/1142055567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd848003a00 0x7fd848003e70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009b50 tx=0x7fd848005830 comp rx=0 tx=0).stop 2024-09-17T03:37:47.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.579+0000 7fd85b7fe640 1 -- 172.21.15.146:0/1142055567 reap_dead start 2024-09-17T03:37:47.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.580+0000 7fd8615c3640 1 -- 172.21.15.146:0/1142055567 shutdown_connections 2024-09-17T03:37:47.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.580+0000 7fd8615c3640 1 -- 172.21.15.146:0/1142055567 >> 172.21.15.146:0/1142055567 conn(0x7fd85c0d11f0 msgr2=0x7fd85c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:47.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.580+0000 7fd8615c3640 1 -- 172.21.15.146:0/1142055567 shutdown_connections 2024-09-17T03:37:47.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.580+0000 7fd8615c3640 1 -- 172.21.15.146:0/1142055567 wait complete. 2024-09-17T03:37:47.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.581+0000 7fd8615c3640 1 Processor -- start 2024-09-17T03:37:47.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.582+0000 7fd8615c3640 1 -- start start 2024-09-17T03:37:47.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8615c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd848003a00 0x7fd85c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8615c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd85c0cdd90 0x7fd85c0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8615c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd85c0ce1a0 0x7fd85c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8615c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c0cf3e0 con 0x7fd85c0cdd90 2024-09-17T03:37:47.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8615c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c0cf260 con 0x7fd848003a00 2024-09-17T03:37:47.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8615c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c0cf560 con 0x7fd85c0ce1a0 2024-09-17T03:37:47.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8527fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd85c0cdd90 0x7fd85c0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8527fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd85c0cdd90 0x7fd85c0b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56260/0 (socket says 172.21.15.146:56260) 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8527fc640 1 -- 172.21.15.146:0/287836747 learned_addr learned my addr 172.21.15.146:0/287836747 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd85affd640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd848003a00 0x7fd85c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd85b7fe640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd85c0ce1a0 0x7fd85c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8527fc640 1 -- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd85c0ce1a0 msgr2=0x7fd85c0b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8527fc640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd85c0ce1a0 0x7fd85c0b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8527fc640 1 -- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd848003a00 msgr2=0x7fd85c156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8527fc640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd848003a00 0x7fd85c156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8527fc640 1 -- 172.21.15.146:0/287836747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85c1f62c0 con 0x7fd85c0cdd90 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.583+0000 7fd8527fc640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd85c0cdd90 0x7fd85c0b4800 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd844011a50 tx=0x7fd844011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.584+0000 7fd853fff640 1 -- 172.21.15.146:0/287836747 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84401f070 con 0x7fd85c0cdd90 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.584+0000 7fd853fff640 1 -- 172.21.15.146:0/287836747 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd84400fdc0 con 0x7fd85c0cdd90 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.584+0000 7fd8615c3640 1 -- 172.21.15.146:0/287836747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85c1f65a0 con 0x7fd85c0cdd90 2024-09-17T03:37:47.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.584+0000 7fd853fff640 1 -- 172.21.15.146:0/287836747 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8440126b0 con 0x7fd85c0cdd90 2024-09-17T03:37:47.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.584+0000 7fd8615c3640 1 -- 172.21.15.146:0/287836747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85c1f6b60 con 0x7fd85c0cdd90 2024-09-17T03:37:47.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.585+0000 7fd8615c3640 1 -- 172.21.15.146:0/287836747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85c0cfca0 con 0x7fd85c0cdd90 2024-09-17T03:37:47.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.586+0000 7fd853fff640 1 -- 172.21.15.146:0/287836747 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd844022070 con 0x7fd85c0cdd90 2024-09-17T03:37:47.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.586+0000 7fd853fff640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd83c078b90 0x7fd83c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.586+0000 7fd853fff640 1 -- 172.21.15.146:0/287836747 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fd84409b780 con 0x7fd85c0cdd90 2024-09-17T03:37:47.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.586+0000 7fd85affd640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd83c078b90 0x7fd83c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.587+0000 7fd85affd640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd83c078b90 0x7fd83c07b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd84c035000 tx=0x7fd84c0046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.591+0000 7fd853fff640 1 -- 172.21.15.146:0/287836747 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd844063570 con 0x7fd85c0cdd90 2024-09-17T03:37:47.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.767+0000 7fd8615c3640 1 -- 172.21.15.146:0/287836747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd85c0b5810 con 0x7fd85c0cdd90 2024-09-17T03:37:47.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.769+0000 7fd853fff640 1 -- 172.21.15.146:0/287836747 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+16768 (secure 0 0 0) 0x7fd844067fa0 con 0x7fd85c0cdd90 2024-09-17T03:37:47.768 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":88,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:37:45.085176+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:41.074046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:42.389031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:37:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 -- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd83c078b90 msgr2=0x7fd83c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd83c078b90 0x7fd83c07b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd84c035000 tx=0x7fd84c0046c0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 -- 172.21.15.146:0/287836747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd85c0cdd90 msgr2=0x7fd85c0b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd85c0cdd90 0x7fd85c0b4800 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fd844011a50 tx=0x7fd844011f10 comp rx=0 tx=0).stop 2024-09-17T03:37:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 -- 172.21.15.146:0/287836747 shutdown_connections 2024-09-17T03:37:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd83c078b90 0x7fd83c07b0a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd85c0ce1a0 0x7fd85c0b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd85c0cdd90 0x7fd85c0b4800 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 --2- 172.21.15.146:0/287836747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd848003a00 0x7fd85c156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 -- 172.21.15.146:0/287836747 >> 172.21.15.146:0/287836747 conn(0x7fd85c0d11f0 msgr2=0x7fd85c069550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 -- 172.21.15.146:0/287836747 shutdown_connections 2024-09-17T03:37:47.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.771+0000 7fd8615c3640 1 -- 172.21.15.146:0/287836747 wait complete. 2024-09-17T03:37:47.781 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:37:47.782 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:47.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.895+0000 7f27484e6640 1 -- 172.21.15.146:0/2702603345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272c003a30 msgr2=0x7f272c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.895+0000 7f27484e6640 1 --2- 172.21.15.146:0/2702603345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272c003a30 0x7f272c003ea0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f273c006fd0 tx=0x7f272c005830 comp rx=0 tx=0).stop 2024-09-17T03:37:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.895+0000 7f2746a83640 1 -- 172.21.15.146:0/2702603345 reap_dead start 2024-09-17T03:37:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.895+0000 7f27484e6640 1 -- 172.21.15.146:0/2702603345 shutdown_connections 2024-09-17T03:37:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.895+0000 7f27484e6640 1 -- 172.21.15.146:0/2702603345 >> 172.21.15.146:0/2702603345 conn(0x7f27400b7b20 msgr2=0x7f274009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.895+0000 7f27484e6640 1 -- 172.21.15.146:0/2702603345 shutdown_connections 2024-09-17T03:37:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.895+0000 7f27484e6640 1 -- 172.21.15.146:0/2702603345 wait complete. 2024-09-17T03:37:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.897+0000 7f27484e6640 1 Processor -- start 2024-09-17T03:37:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.897+0000 7f27484e6640 1 -- start start 2024-09-17T03:37:47.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.898+0000 7f27484e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272c003a30 0x7f2740142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.898+0000 7f27484e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2740159810 0x7f274009cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.898+0000 7f27484e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f274009d110 0x7f274009d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.898+0000 7f27484e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f27401657b0 con 0x7f272c003a30 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.898+0000 7f27484e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f274015dcc0 con 0x7f2740159810 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.898+0000 7f27484e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2740165930 con 0x7f274009d110 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.898+0000 7f2746282640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272c003a30 0x7f2740142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.898+0000 7f2746282640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272c003a30 0x7f2740142fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56268/0 (socket says 172.21.15.146:56268) 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.898+0000 7f2746282640 1 -- 172.21.15.146:0/422701405 learned_addr learned my addr 172.21.15.146:0/422701405 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.898+0000 7f2746a83640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f274009d110 0x7f274009d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.898+0000 7f2745a81640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2740159810 0x7f274009cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.899+0000 7f2746282640 1 -- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f274009d110 msgr2=0x7f274009d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.899+0000 7f2746282640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f274009d110 0x7f274009d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.899+0000 7f2746282640 1 -- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2740159810 msgr2=0x7f274009cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:47.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.899+0000 7f2746282640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2740159810 0x7f274009cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:47.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.899+0000 7f2746282640 1 -- 172.21.15.146:0/422701405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274009da60 con 0x7f272c003a30 2024-09-17T03:37:47.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.899+0000 7f2746282640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272c003a30 0x7f2740142fa0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f273c00c350 tx=0x7f273c001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:47.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.899+0000 7f2736ffd640 1 -- 172.21.15.146:0/422701405 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c031040 con 0x7f272c003a30 2024-09-17T03:37:47.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.899+0000 7f2736ffd640 1 -- 172.21.15.146:0/422701405 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f273c0035f0 con 0x7f272c003a30 2024-09-17T03:37:47.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.899+0000 7f2736ffd640 1 -- 172.21.15.146:0/422701405 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c003a40 con 0x7f272c003a30 2024-09-17T03:37:47.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.899+0000 7f27484e6640 1 -- 172.21.15.146:0/422701405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274009c6f0 con 0x7f272c003a30 2024-09-17T03:37:47.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.899+0000 7f27484e6640 1 -- 172.21.15.146:0/422701405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27401584c0 con 0x7f272c003a30 2024-09-17T03:37:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.900+0000 7f27484e6640 1 -- 172.21.15.146:0/422701405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27400b3620 con 0x7f272c003a30 2024-09-17T03:37:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.901+0000 7f2736ffd640 1 -- 172.21.15.146:0/422701405 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f273c034070 con 0x7f272c003a30 2024-09-17T03:37:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.901+0000 7f2736ffd640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2724078bc0 0x7f272407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.901+0000 7f2736ffd640 1 -- 172.21.15.146:0/422701405 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f273c0babb0 con 0x7f272c003a30 2024-09-17T03:37:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.901+0000 7f2745a81640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2724078bc0 0x7f272407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.902+0000 7f2745a81640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2724078bc0 0x7f272407b0d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f274015f120 tx=0x7f2730006d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:47.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:47.906+0000 7f2736ffd640 1 -- 172.21.15.146:0/422701405 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f273c0c1080 con 0x7f272c003a30 2024-09-17T03:37:48.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.077+0000 7f27484e6640 1 -- 172.21.15.146:0/422701405 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f274015f430 con 0x7f2724078bc0 2024-09-17T03:37:48.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.082+0000 7f2736ffd640 1 -- 172.21.15.146:0/422701405 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252069 (secure 0 0 0) 0x7f274015f430 con 0x7f2724078bc0 2024-09-17T03:37:48.083 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:48.085 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:37:48.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.084+0000 7f27484e6640 1 -- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2724078bc0 msgr2=0x7f272407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.084+0000 7f27484e6640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2724078bc0 0x7f272407b0d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f274015f120 tx=0x7f2730006d90 comp rx=0 tx=0).stop 2024-09-17T03:37:48.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.085+0000 7f27484e6640 1 -- 172.21.15.146:0/422701405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272c003a30 msgr2=0x7f2740142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.085+0000 7f27484e6640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272c003a30 0x7f2740142fa0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f273c00c350 tx=0x7f273c001c70 comp rx=0 tx=0).stop 2024-09-17T03:37:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.085+0000 7f27484e6640 1 -- 172.21.15.146:0/422701405 shutdown_connections 2024-09-17T03:37:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.085+0000 7f27484e6640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2724078bc0 0x7f272407b0d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.085+0000 7f27484e6640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f274009d110 0x7f274009d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.085+0000 7f27484e6640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2740159810 0x7f274009cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.085+0000 7f27484e6640 1 --2- 172.21.15.146:0/422701405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272c003a30 0x7f2740142fa0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.085+0000 7f27484e6640 1 -- 172.21.15.146:0/422701405 >> 172.21.15.146:0/422701405 conn(0x7f27400b7b20 msgr2=0x7f274015e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.085+0000 7f27484e6640 1 -- 172.21.15.146:0/422701405 shutdown_connections 2024-09-17T03:37:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.085+0000 7f27484e6640 1 -- 172.21.15.146:0/422701405 wait complete. 2024-09-17T03:37:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-09-17T03:37:47.864271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":313088,"kb_used_data":9476,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754661632,"statfs":{"total":773094113280,"available":772773511168,"internally_reserved":0,"allocated":9703424,"data_stored":4826866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":310693425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.801555"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112797+0000","last_change":"2024-09-17T03:37:44.110725+0000","last_active":"2024-09-17T03:37:44.112797+0000","last_peered":"2024-09-17T03:37:44.112797+0000","last_clean":"2024-09-17T03:37:44.112797+0000","last_became_active":"2024-09-17T03:37:44.109150+0000","last_became_peered":"2024-09-17T03:37:44.109150+0000","last_unstale":"2024-09-17T03:37:44.112797+0000","last_undegraded":"2024-09-17T03:37:44.112797+0000","last_fullsized":"2024-09-17T03:37:44.112797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:46.022248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093364+0000","last_change":"2024-09-17T03:37:44.088486+0000","last_active":"2024-09-17T03:37:44.093364+0000","last_peered":"2024-09-17T03:37:44.093364+0000","last_clean":"2024-09-17T03:37:44.093364+0000","last_became_active":"2024-09-17T03:37:44.088155+0000","last_became_peered":"2024-09-17T03:37:44.088155+0000","last_unstale":"2024-09-17T03:37:44.093364+0000","last_undegraded":"2024-09-17T03:37:44.093364+0000","last_fullsized":"2024-09-17T03:37:44.093364+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:31.747262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098111+0000","last_change":"2024-09-17T03:37:44.090253+0000","last_active":"2024-09-17T03:37:44.098111+0000","last_peered":"2024-09-17T03:37:44.098111+0000","last_clean":"2024-09-17T03:37:44.098111+0000","last_became_active":"2024-09-17T03:37:44.089930+0000","last_became_peered":"2024-09-17T03:37:44.089930+0000","last_unstale":"2024-09-17T03:37:44.098111+0000","last_undegraded":"2024-09-17T03:37:44.098111+0000","last_fullsized":"2024-09-17T03:37:44.098111+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:38.717244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.100863+0000","last_change":"2024-09-17T03:37:44.097090+0000","last_active":"2024-09-17T03:37:44.100863+0000","last_peered":"2024-09-17T03:37:44.100863+0000","last_clean":"2024-09-17T03:37:44.100863+0000","last_became_active":"2024-09-17T03:37:44.096771+0000","last_became_peered":"2024-09-17T03:37:44.096771+0000","last_unstale":"2024-09-17T03:37:44.100863+0000","last_undegraded":"2024-09-17T03:37:44.100863+0000","last_fullsized":"2024-09-17T03:37:44.100863+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:24.561821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112119+0000","last_change":"2024-09-17T03:37:44.109031+0000","last_active":"2024-09-17T03:37:44.112119+0000","last_peered":"2024-09-17T03:37:44.112119+0000","last_clean":"2024-09-17T03:37:44.112119+0000","last_became_active":"2024-09-17T03:37:44.108678+0000","last_became_peered":"2024-09-17T03:37:44.108678+0000","last_unstale":"2024-09-17T03:37:44.112119+0000","last_undegraded":"2024-09-17T03:37:44.112119+0000","last_fullsized":"2024-09-17T03:37:44.112119+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:15.900840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463400+0000","last_change":"2024-09-17T03:37:44.095512+0000","last_active":"2024-09-17T03:37:45.463400+0000","last_peered":"2024-09-17T03:37:45.463400+0000","last_clean":"2024-09-17T03:37:45.463400+0000","last_became_active":"2024-09-17T03:37:44.094585+0000","last_became_peered":"2024-09-17T03:37:44.094585+0000","last_unstale":"2024-09-17T03:37:45.463400+0000","last_undegraded":"2024-09-17T03:37:45.463400+0000","last_fullsized":"2024-09-17T03:37:45.463400+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:44.303060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093659+0000","last_change":"2024-09-17T03:37:44.091518+0000","last_active":"2024-09-17T03:37:44.093659+0000","last_peered":"2024-09-17T03:37:44.093659+0000","last_clean":"2024-09-17T03:37:44.093659+0000","last_became_active":"2024-09-17T03:37:44.091158+0000","last_became_peered":"2024-09-17T03:37:44.091158+0000","last_unstale":"2024-09-17T03:37:44.093659+0000","last_undegraded":"2024-09-17T03:37:44.093659+0000","last_fullsized":"2024-09-17T03:37:44.093659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:25.588832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463622+0000","last_change":"2024-09-17T03:37:44.100424+0000","last_active":"2024-09-17T03:37:45.463622+0000","last_peered":"2024-09-17T03:37:45.463622+0000","last_clean":"2024-09-17T03:37:45.463622+0000","last_became_active":"2024-09-17T03:37:44.100119+0000","last_became_peered":"2024-09-17T03:37:44.100119+0000","last_unstale":"2024-09-17T03:37:45.463622+0000","last_undegraded":"2024-09-17T03:37:45.463622+0000","last_fullsized":"2024-09-17T03:37:45.463622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:45.247988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463594+0000","last_change":"2024-09-17T03:37:44.097865+0000","last_active":"2024-09-17T03:37:45.463594+0000","last_peered":"2024-09-17T03:37:45.463594+0000","last_clean":"2024-09-17T03:37:45.463594+0000","last_became_active":"2024-09-17T03:37:44.097551+0000","last_became_peered":"2024-09-17T03:37:44.097551+0000","last_unstale":"2024-09-17T03:37:45.463594+0000","last_undegraded":"2024-09-17T03:37:45.463594+0000","last_fullsized":"2024-09-17T03:37:45.463594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:18.451231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.104100+0000","last_change":"2024-09-17T03:37:44.092687+0000","last_active":"2024-09-17T03:37:44.104100+0000","last_peered":"2024-09-17T03:37:44.104100+0000","last_clean":"2024-09-17T03:37:44.104100+0000","last_became_active":"2024-09-17T03:37:44.092284+0000","last_became_peered":"2024-09-17T03:37:44.092284+0000","last_unstale":"2024-09-17T03:37:44.104100+0000","last_undegraded":"2024-09-17T03:37:44.104100+0000","last_fullsized":"2024-09-17T03:37:44.104100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:57.560354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.101281+0000","last_change":"2024-09-17T03:37:44.095570+0000","last_active":"2024-09-17T03:37:44.101281+0000","last_peered":"2024-09-17T03:37:44.101281+0000","last_clean":"2024-09-17T03:37:44.101281+0000","last_became_active":"2024-09-17T03:37:44.095236+0000","last_became_peered":"2024-09-17T03:37:44.095236+0000","last_unstale":"2024-09-17T03:37:44.101281+0000","last_undegraded":"2024-09-17T03:37:44.101281+0000","last_fullsized":"2024-09-17T03:37:44.101281+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:26.232860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.102019+0000","last_change":"2024-09-17T03:37:44.092582+0000","last_active":"2024-09-17T03:37:44.102019+0000","last_peered":"2024-09-17T03:37:44.102019+0000","last_clean":"2024-09-17T03:37:44.102019+0000","last_became_active":"2024-09-17T03:37:44.092187+0000","last_became_peered":"2024-09-17T03:37:44.092187+0000","last_unstale":"2024-09-17T03:37:44.102019+0000","last_undegraded":"2024-09-17T03:37:44.102019+0000","last_fullsized":"2024-09-17T03:37:44.102019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:31.319493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.108725+0000","last_change":"2024-09-17T03:37:44.105691+0000","last_active":"2024-09-17T03:37:44.108725+0000","last_peered":"2024-09-17T03:37:44.108725+0000","last_clean":"2024-09-17T03:37:44.108725+0000","last_became_active":"2024-09-17T03:37:44.105338+0000","last_became_peered":"2024-09-17T03:37:44.105338+0000","last_unstale":"2024-09-17T03:37:44.108725+0000","last_undegraded":"2024-09-17T03:37:44.108725+0000","last_fullsized":"2024-09-17T03:37:44.108725+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:54.586063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.102349+0000","last_change":"2024-09-17T03:37:44.097584+0000","last_active":"2024-09-17T03:37:44.102349+0000","last_peered":"2024-09-17T03:37:44.102349+0000","last_clean":"2024-09-17T03:37:44.102349+0000","last_became_active":"2024-09-17T03:37:44.096898+0000","last_became_peered":"2024-09-17T03:37:44.096898+0000","last_unstale":"2024-09-17T03:37:44.102349+0000","last_undegraded":"2024-09-17T03:37:44.102349+0000","last_fullsized":"2024-09-17T03:37:44.102349+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:00.826765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544455+0000","last_change":"2024-09-17T03:37:44.087407+0000","last_active":"2024-09-17T03:37:45.544455+0000","last_peered":"2024-09-17T03:37:45.544455+0000","last_clean":"2024-09-17T03:37:45.544455+0000","last_became_active":"2024-09-17T03:37:44.087103+0000","last_became_peered":"2024-09-17T03:37:44.087103+0000","last_unstale":"2024-09-17T03:37:45.544455+0000","last_undegraded":"2024-09-17T03:37:45.544455+0000","last_fullsized":"2024-09-17T03:37:45.544455+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:26.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106856+0000","last_change":"2024-09-17T03:37:44.102572+0000","last_active":"2024-09-17T03:37:44.106856+0000","last_peered":"2024-09-17T03:37:44.106856+0000","last_clean":"2024-09-17T03:37:44.106856+0000","last_became_active":"2024-09-17T03:37:44.102263+0000","last_became_peered":"2024-09-17T03:37:44.102263+0000","last_unstale":"2024-09-17T03:37:44.106856+0000","last_undegraded":"2024-09-17T03:37:44.106856+0000","last_fullsized":"2024-09-17T03:37:44.106856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:37.293968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112118+0000","last_change":"2024-09-17T03:37:44.107433+0000","last_active":"2024-09-17T03:37:44.112118+0000","last_peered":"2024-09-17T03:37:44.112118+0000","last_clean":"2024-09-17T03:37:44.112118+0000","last_became_active":"2024-09-17T03:37:44.107073+0000","last_became_peered":"2024-09-17T03:37:44.107073+0000","last_unstale":"2024-09-17T03:37:44.112118+0000","last_undegraded":"2024-09-17T03:37:44.112118+0000","last_fullsized":"2024-09-17T03:37:44.112118+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:15.991292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093270+0000","last_change":"2024-09-17T03:37:44.088746+0000","last_active":"2024-09-17T03:37:44.093270+0000","last_peered":"2024-09-17T03:37:44.093270+0000","last_clean":"2024-09-17T03:37:44.093270+0000","last_became_active":"2024-09-17T03:37:44.088418+0000","last_became_peered":"2024-09-17T03:37:44.088418+0000","last_unstale":"2024-09-17T03:37:44.093270+0000","last_undegraded":"2024-09-17T03:37:44.093270+0000","last_fullsized":"2024-09-17T03:37:44.093270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:34.571919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.100210+0000","last_change":"2024-09-17T03:37:44.095559+0000","last_active":"2024-09-17T03:37:44.100210+0000","last_peered":"2024-09-17T03:37:44.100210+0000","last_clean":"2024-09-17T03:37:44.100210+0000","last_became_active":"2024-09-17T03:37:44.095256+0000","last_became_peered":"2024-09-17T03:37:44.095256+0000","last_unstale":"2024-09-17T03:37:44.100210+0000","last_undegraded":"2024-09-17T03:37:44.100210+0000","last_fullsized":"2024-09-17T03:37:44.100210+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:32.028535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.100891+0000","last_change":"2024-09-17T03:37:44.098083+0000","last_active":"2024-09-17T03:37:44.100891+0000","last_peered":"2024-09-17T03:37:44.100891+0000","last_clean":"2024-09-17T03:37:44.100891+0000","last_became_active":"2024-09-17T03:37:44.097792+0000","last_became_peered":"2024-09-17T03:37:44.097792+0000","last_unstale":"2024-09-17T03:37:44.100891+0000","last_undegraded":"2024-09-17T03:37:44.100891+0000","last_fullsized":"2024-09-17T03:37:44.100891+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:36.272159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093254+0000","last_change":"2024-09-17T03:37:44.091256+0000","last_active":"2024-09-17T03:37:44.093254+0000","last_peered":"2024-09-17T03:37:44.093254+0000","last_clean":"2024-09-17T03:37:44.093254+0000","last_became_active":"2024-09-17T03:37:44.090861+0000","last_became_peered":"2024-09-17T03:37:44.090861+0000","last_unstale":"2024-09-17T03:37:44.093254+0000","last_undegraded":"2024-09-17T03:37:44.093254+0000","last_fullsized":"2024-09-17T03:37:44.093254+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:23.444929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.101149+0000","last_change":"2024-09-17T03:37:44.096395+0000","last_active":"2024-09-17T03:37:44.101149+0000","last_peered":"2024-09-17T03:37:44.101149+0000","last_clean":"2024-09-17T03:37:44.101149+0000","last_became_active":"2024-09-17T03:37:44.095686+0000","last_became_peered":"2024-09-17T03:37:44.095686+0000","last_unstale":"2024-09-17T03:37:44.101149+0000","last_undegraded":"2024-09-17T03:37:44.101149+0000","last_fullsized":"2024-09-17T03:37:44.101149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:11.506339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.101776+0000","last_change":"2024-09-17T03:37:44.091782+0000","last_active":"2024-09-17T03:37:44.101776+0000","last_peered":"2024-09-17T03:37:44.101776+0000","last_clean":"2024-09-17T03:37:44.101776+0000","last_became_active":"2024-09-17T03:37:44.091465+0000","last_became_peered":"2024-09-17T03:37:44.091465+0000","last_unstale":"2024-09-17T03:37:44.101776+0000","last_undegraded":"2024-09-17T03:37:44.101776+0000","last_fullsized":"2024-09-17T03:37:44.101776+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:54.117975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.103096+0000","last_change":"2024-09-17T03:37:44.100306+0000","last_active":"2024-09-17T03:37:44.103096+0000","last_peered":"2024-09-17T03:37:44.103096+0000","last_clean":"2024-09-17T03:37:44.103096+0000","last_became_active":"2024-09-17T03:37:44.099180+0000","last_became_peered":"2024-09-17T03:37:44.099180+0000","last_unstale":"2024-09-17T03:37:44.103096+0000","last_undegraded":"2024-09-17T03:37:44.103096+0000","last_fullsized":"2024-09-17T03:37:44.103096+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:54.687063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093405+0000","last_change":"2024-09-17T03:37:44.090051+0000","last_active":"2024-09-17T03:37:44.093405+0000","last_peered":"2024-09-17T03:37:44.093405+0000","last_clean":"2024-09-17T03:37:44.093405+0000","last_became_active":"2024-09-17T03:37:44.089763+0000","last_became_peered":"2024-09-17T03:37:44.089763+0000","last_unstale":"2024-09-17T03:37:44.093405+0000","last_undegraded":"2024-09-17T03:37:44.093405+0000","last_fullsized":"2024-09-17T03:37:44.093405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:50.943642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.100301+0000","last_change":"2024-09-17T03:37:44.099240+0000","last_active":"2024-09-17T03:37:44.100301+0000","last_peered":"2024-09-17T03:37:44.100301+0000","last_clean":"2024-09-17T03:37:44.100301+0000","last_became_active":"2024-09-17T03:37:44.098922+0000","last_became_peered":"2024-09-17T03:37:44.098922+0000","last_unstale":"2024-09-17T03:37:44.100301+0000","last_undegraded":"2024-09-17T03:37:44.100301+0000","last_fullsized":"2024-09-17T03:37:44.100301+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:17.280954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106904+0000","last_change":"2024-09-17T03:37:44.100525+0000","last_active":"2024-09-17T03:37:44.106904+0000","last_peered":"2024-09-17T03:37:44.106904+0000","last_clean":"2024-09-17T03:37:44.106904+0000","last_became_active":"2024-09-17T03:37:44.100232+0000","last_became_peered":"2024-09-17T03:37:44.100232+0000","last_unstale":"2024-09-17T03:37:44.106904+0000","last_undegraded":"2024-09-17T03:37:44.106904+0000","last_fullsized":"2024-09-17T03:37:44.106904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.559816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.108145+0000","last_change":"2024-09-17T03:37:44.106347+0000","last_active":"2024-09-17T03:37:44.108145+0000","last_peered":"2024-09-17T03:37:44.108145+0000","last_clean":"2024-09-17T03:37:44.108145+0000","last_became_active":"2024-09-17T03:37:44.105500+0000","last_became_peered":"2024-09-17T03:37:44.105500+0000","last_unstale":"2024-09-17T03:37:44.108145+0000","last_undegraded":"2024-09-17T03:37:44.108145+0000","last_fullsized":"2024-09-17T03:37:44.108145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:08.254699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.105967+0000","last_change":"2024-09-17T03:37:44.101407+0000","last_active":"2024-09-17T03:37:44.105967+0000","last_peered":"2024-09-17T03:37:44.105967+0000","last_clean":"2024-09-17T03:37:44.105967+0000","last_became_active":"2024-09-17T03:37:44.101060+0000","last_became_peered":"2024-09-17T03:37:44.101060+0000","last_unstale":"2024-09-17T03:37:44.105967+0000","last_undegraded":"2024-09-17T03:37:44.105967+0000","last_fullsized":"2024-09-17T03:37:44.105967+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:55.716448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093474+0000","last_change":"2024-09-17T03:37:44.090135+0000","last_active":"2024-09-17T03:37:44.093474+0000","last_peered":"2024-09-17T03:37:44.093474+0000","last_clean":"2024-09-17T03:37:44.093474+0000","last_became_active":"2024-09-17T03:37:44.089333+0000","last_became_peered":"2024-09-17T03:37:44.089333+0000","last_unstale":"2024-09-17T03:37:44.093474+0000","last_undegraded":"2024-09-17T03:37:44.093474+0000","last_fullsized":"2024-09-17T03:37:44.093474+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.939946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106994+0000","last_change":"2024-09-17T03:37:44.103363+0000","last_active":"2024-09-17T03:37:44.106994+0000","last_peered":"2024-09-17T03:37:44.106994+0000","last_clean":"2024-09-17T03:37:44.106994+0000","last_became_active":"2024-09-17T03:37:44.103043+0000","last_became_peered":"2024-09-17T03:37:44.103043+0000","last_unstale":"2024-09-17T03:37:44.106994+0000","last_undegraded":"2024-09-17T03:37:44.106994+0000","last_fullsized":"2024-09-17T03:37:44.106994+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:43.979074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.104228+0000","last_change":"2024-09-17T03:37:44.098601+0000","last_active":"2024-09-17T03:37:44.104228+0000","last_peered":"2024-09-17T03:37:44.104228+0000","last_clean":"2024-09-17T03:37:44.104228+0000","last_became_active":"2024-09-17T03:37:44.098272+0000","last_became_peered":"2024-09-17T03:37:44.098272+0000","last_unstale":"2024-09-17T03:37:44.104228+0000","last_undegraded":"2024-09-17T03:37:44.104228+0000","last_fullsized":"2024-09-17T03:37:44.104228+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:37.234077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.109577+0000","last_change":"2024-09-17T03:37:44.105912+0000","last_active":"2024-09-17T03:37:44.109577+0000","last_peered":"2024-09-17T03:37:44.109577+0000","last_clean":"2024-09-17T03:37:44.109577+0000","last_became_active":"2024-09-17T03:37:44.105559+0000","last_became_peered":"2024-09-17T03:37:44.105559+0000","last_unstale":"2024-09-17T03:37:44.109577+0000","last_undegraded":"2024-09-17T03:37:44.109577+0000","last_fullsized":"2024-09-17T03:37:44.109577+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:35.638102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"87'4","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112715+0000","last_change":"2024-09-17T03:37:43.074302+0000","last_active":"2024-09-17T03:37:44.112715+0000","last_peered":"2024-09-17T03:37:44.112715+0000","last_clean":"2024-09-17T03:37:44.112715+0000","last_became_active":"2024-09-17T03:37:43.073881+0000","last_became_peered":"2024-09-17T03:37:43.073881+0000","last_unstale":"2024-09-17T03:37:44.112715+0000","last_undegraded":"2024-09-17T03:37:44.112715+0000","last_fullsized":"2024-09-17T03:37:44.112715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:54.499982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.102197+0000","last_change":"2024-09-17T03:37:44.094142+0000","last_active":"2024-09-17T03:37:44.102197+0000","last_peered":"2024-09-17T03:37:44.102197+0000","last_clean":"2024-09-17T03:37:44.102197+0000","last_became_active":"2024-09-17T03:37:44.093800+0000","last_became_peered":"2024-09-17T03:37:44.093800+0000","last_unstale":"2024-09-17T03:37:44.102197+0000","last_undegraded":"2024-09-17T03:37:44.102197+0000","last_fullsized":"2024-09-17T03:37:44.102197+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:33.612077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106734+0000","last_change":"2024-09-17T03:37:43.083801+0000","last_active":"2024-09-17T03:37:44.106734+0000","last_peered":"2024-09-17T03:37:44.106734+0000","last_clean":"2024-09-17T03:37:44.106734+0000","last_became_active":"2024-09-17T03:37:43.083072+0000","last_became_peered":"2024-09-17T03:37:43.083072+0000","last_unstale":"2024-09-17T03:37:44.106734+0000","last_undegraded":"2024-09-17T03:37:44.106734+0000","last_fullsized":"2024-09-17T03:37:44.106734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:40.879393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.102049+0000","last_change":"2024-09-17T03:37:44.094802+0000","last_active":"2024-09-17T03:37:44.102049+0000","last_peered":"2024-09-17T03:37:44.102049+0000","last_clean":"2024-09-17T03:37:44.102049+0000","last_became_active":"2024-09-17T03:37:44.094510+0000","last_became_peered":"2024-09-17T03:37:44.094510+0000","last_unstale":"2024-09-17T03:37:44.102049+0000","last_undegraded":"2024-09-17T03:37:44.102049+0000","last_fullsized":"2024-09-17T03:37:44.102049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:59.354352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112513+0000","last_change":"2024-09-17T03:37:43.081180+0000","last_active":"2024-09-17T03:37:44.112513+0000","last_peered":"2024-09-17T03:37:44.112513+0000","last_clean":"2024-09-17T03:37:44.112513+0000","last_became_active":"2024-09-17T03:37:43.080887+0000","last_became_peered":"2024-09-17T03:37:43.080887+0000","last_unstale":"2024-09-17T03:37:44.112513+0000","last_undegraded":"2024-09-17T03:37:44.112513+0000","last_fullsized":"2024-09-17T03:37:44.112513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:42.972884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098175+0000","last_change":"2024-09-17T03:37:44.093608+0000","last_active":"2024-09-17T03:37:44.098175+0000","last_peered":"2024-09-17T03:37:44.098175+0000","last_clean":"2024-09-17T03:37:44.098175+0000","last_became_active":"2024-09-17T03:37:44.093297+0000","last_became_peered":"2024-09-17T03:37:44.093297+0000","last_unstale":"2024-09-17T03:37:44.098175+0000","last_undegraded":"2024-09-17T03:37:44.098175+0000","last_fullsized":"2024-09-17T03:37:44.098175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:28.096100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"87'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112690+0000","last_change":"2024-09-17T03:37:43.082252+0000","last_active":"2024-09-17T03:37:44.112690+0000","last_peered":"2024-09-17T03:37:44.112690+0000","last_clean":"2024-09-17T03:37:44.112690+0000","last_became_active":"2024-09-17T03:37:43.081564+0000","last_became_peered":"2024-09-17T03:37:43.081564+0000","last_unstale":"2024-09-17T03:37:44.112690+0000","last_undegraded":"2024-09-17T03:37:44.112690+0000","last_fullsized":"2024-09-17T03:37:44.112690+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:47.847292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093447+0000","last_change":"2024-09-17T03:37:44.089644+0000","last_active":"2024-09-17T03:37:44.093447+0000","last_peered":"2024-09-17T03:37:44.093447+0000","last_clean":"2024-09-17T03:37:44.093447+0000","last_became_active":"2024-09-17T03:37:44.088950+0000","last_became_peered":"2024-09-17T03:37:44.088950+0000","last_unstale":"2024-09-17T03:37:44.093447+0000","last_undegraded":"2024-09-17T03:37:44.093447+0000","last_fullsized":"2024-09-17T03:37:44.093447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:53.069978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.109120+0000","last_change":"2024-09-17T03:37:43.080554+0000","last_active":"2024-09-17T03:37:44.109120+0000","last_peered":"2024-09-17T03:37:44.109120+0000","last_clean":"2024-09-17T03:37:44.109120+0000","last_became_active":"2024-09-17T03:37:43.080014+0000","last_became_peered":"2024-09-17T03:37:43.080014+0000","last_unstale":"2024-09-17T03:37:44.109120+0000","last_undegraded":"2024-09-17T03:37:44.109120+0000","last_fullsized":"2024-09-17T03:37:44.109120+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:04.513094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.107009+0000","last_change":"2024-09-17T03:37:44.104073+0000","last_active":"2024-09-17T03:37:44.107009+0000","last_peered":"2024-09-17T03:37:44.107009+0000","last_clean":"2024-09-17T03:37:44.107009+0000","last_became_active":"2024-09-17T03:37:44.103752+0000","last_became_peered":"2024-09-17T03:37:44.103752+0000","last_unstale":"2024-09-17T03:37:44.107009+0000","last_undegraded":"2024-09-17T03:37:44.107009+0000","last_fullsized":"2024-09-17T03:37:44.107009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:20.422849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106635+0000","last_change":"2024-09-17T03:37:43.083649+0000","last_active":"2024-09-17T03:37:44.106635+0000","last_peered":"2024-09-17T03:37:44.106635+0000","last_clean":"2024-09-17T03:37:44.106635+0000","last_became_active":"2024-09-17T03:37:43.083312+0000","last_became_peered":"2024-09-17T03:37:43.083312+0000","last_unstale":"2024-09-17T03:37:44.106635+0000","last_undegraded":"2024-09-17T03:37:44.106635+0000","last_fullsized":"2024-09-17T03:37:44.106635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:04.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098550+0000","last_change":"2024-09-17T03:37:44.094597+0000","last_active":"2024-09-17T03:37:44.098550+0000","last_peered":"2024-09-17T03:37:44.098550+0000","last_clean":"2024-09-17T03:37:44.098550+0000","last_became_active":"2024-09-17T03:37:44.094342+0000","last_became_peered":"2024-09-17T03:37:44.094342+0000","last_unstale":"2024-09-17T03:37:44.098550+0000","last_undegraded":"2024-09-17T03:37:44.098550+0000","last_fullsized":"2024-09-17T03:37:44.098550+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:44.065416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.080793+0000","last_change":"2024-09-17T03:37:43.078784+0000","last_active":"2024-09-17T03:37:44.080793+0000","last_peered":"2024-09-17T03:37:44.080793+0000","last_clean":"2024-09-17T03:37:44.080793+0000","last_became_active":"2024-09-17T03:37:43.078385+0000","last_became_peered":"2024-09-17T03:37:43.078385+0000","last_unstale":"2024-09-17T03:37:44.080793+0000","last_undegraded":"2024-09-17T03:37:44.080793+0000","last_fullsized":"2024-09-17T03:37:44.080793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:25.003657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544493+0000","last_change":"2024-09-17T03:37:44.086536+0000","last_active":"2024-09-17T03:37:45.544493+0000","last_peered":"2024-09-17T03:37:45.544493+0000","last_clean":"2024-09-17T03:37:45.544493+0000","last_became_active":"2024-09-17T03:37:44.086167+0000","last_became_peered":"2024-09-17T03:37:44.086167+0000","last_unstale":"2024-09-17T03:37:45.544493+0000","last_undegraded":"2024-09-17T03:37:45.544493+0000","last_fullsized":"2024-09-17T03:37:45.544493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:02.911294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.083596+0000","last_change":"2024-09-17T03:37:43.080632+0000","last_active":"2024-09-17T03:37:44.083596+0000","last_peered":"2024-09-17T03:37:44.083596+0000","last_clean":"2024-09-17T03:37:44.083596+0000","last_became_active":"2024-09-17T03:37:43.080264+0000","last_became_peered":"2024-09-17T03:37:43.080264+0000","last_unstale":"2024-09-17T03:37:44.083596+0000","last_undegraded":"2024-09-17T03:37:44.083596+0000","last_fullsized":"2024-09-17T03:37:44.083596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:44.487384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544755+0000","last_change":"2024-09-17T03:37:44.091930+0000","last_active":"2024-09-17T03:37:45.544755+0000","last_peered":"2024-09-17T03:37:45.544755+0000","last_clean":"2024-09-17T03:37:45.544755+0000","last_became_active":"2024-09-17T03:37:44.091624+0000","last_became_peered":"2024-09-17T03:37:44.091624+0000","last_unstale":"2024-09-17T03:37:45.544755+0000","last_undegraded":"2024-09-17T03:37:45.544755+0000","last_fullsized":"2024-09-17T03:37:45.544755+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:57.946065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.084613+0000","last_change":"2024-09-17T03:37:43.076322+0000","last_active":"2024-09-17T03:37:44.084613+0000","last_peered":"2024-09-17T03:37:44.084613+0000","last_clean":"2024-09-17T03:37:44.084613+0000","last_became_active":"2024-09-17T03:37:43.074095+0000","last_became_peered":"2024-09-17T03:37:43.074095+0000","last_unstale":"2024-09-17T03:37:44.084613+0000","last_undegraded":"2024-09-17T03:37:44.084613+0000","last_fullsized":"2024-09-17T03:37:44.084613+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:32.992597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463538+0000","last_change":"2024-09-17T03:37:44.093625+0000","last_active":"2024-09-17T03:37:45.463538+0000","last_peered":"2024-09-17T03:37:45.463538+0000","last_clean":"2024-09-17T03:37:45.463538+0000","last_became_active":"2024-09-17T03:37:44.093288+0000","last_became_peered":"2024-09-17T03:37:44.093288+0000","last_unstale":"2024-09-17T03:37:45.463538+0000","last_undegraded":"2024-09-17T03:37:45.463538+0000","last_fullsized":"2024-09-17T03:37:45.463538+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:31.974418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.081560+0000","last_change":"2024-09-17T03:37:43.079008+0000","last_active":"2024-09-17T03:37:44.081560+0000","last_peered":"2024-09-17T03:37:44.081560+0000","last_clean":"2024-09-17T03:37:44.081560+0000","last_became_active":"2024-09-17T03:37:43.078669+0000","last_became_peered":"2024-09-17T03:37:43.078669+0000","last_unstale":"2024-09-17T03:37:44.081560+0000","last_undegraded":"2024-09-17T03:37:44.081560+0000","last_fullsized":"2024-09-17T03:37:44.081560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:35.305660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.091652+0000","last_change":"2024-09-17T03:37:44.089938+0000","last_active":"2024-09-17T03:37:44.091652+0000","last_peered":"2024-09-17T03:37:44.091652+0000","last_clean":"2024-09-17T03:37:44.091652+0000","last_became_active":"2024-09-17T03:37:44.089631+0000","last_became_peered":"2024-09-17T03:37:44.089631+0000","last_unstale":"2024-09-17T03:37:44.091652+0000","last_undegraded":"2024-09-17T03:37:44.091652+0000","last_fullsized":"2024-09-17T03:37:44.091652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:15.900840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"87'3","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.113090+0000","last_change":"2024-09-17T03:37:43.078933+0000","last_active":"2024-09-17T03:37:44.113090+0000","last_peered":"2024-09-17T03:37:44.113090+0000","last_clean":"2024-09-17T03:37:44.113090+0000","last_became_active":"2024-09-17T03:37:43.078547+0000","last_became_peered":"2024-09-17T03:37:43.078547+0000","last_unstale":"2024-09-17T03:37:44.113090+0000","last_undegraded":"2024-09-17T03:37:44.113090+0000","last_fullsized":"2024-09-17T03:37:44.113090+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:28.861428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106875+0000","last_change":"2024-09-17T03:37:44.099816+0000","last_active":"2024-09-17T03:37:44.106875+0000","last_peered":"2024-09-17T03:37:44.106875+0000","last_clean":"2024-09-17T03:37:44.106875+0000","last_became_active":"2024-09-17T03:37:44.099408+0000","last_became_peered":"2024-09-17T03:37:44.099408+0000","last_unstale":"2024-09-17T03:37:44.106875+0000","last_undegraded":"2024-09-17T03:37:44.106875+0000","last_fullsized":"2024-09-17T03:37:44.106875+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:40.057482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"87'6","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463368+0000","last_change":"2024-09-17T03:37:43.073464+0000","last_active":"2024-09-17T03:37:45.463368+0000","last_peered":"2024-09-17T03:37:45.463368+0000","last_clean":"2024-09-17T03:37:45.463368+0000","last_became_active":"2024-09-17T03:37:43.072996+0000","last_became_peered":"2024-09-17T03:37:43.072996+0000","last_unstale":"2024-09-17T03:37:45.463368+0000","last_undegraded":"2024-09-17T03:37:45.463368+0000","last_fullsized":"2024-09-17T03:37:45.463368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:17.956546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106235+0000","last_change":"2024-09-17T03:37:44.105334+0000","last_active":"2024-09-17T03:37:44.106235+0000","last_peered":"2024-09-17T03:37:44.106235+0000","last_clean":"2024-09-17T03:37:44.106235+0000","last_became_active":"2024-09-17T03:37:44.104467+0000","last_became_peered":"2024-09-17T03:37:44.104467+0000","last_unstale":"2024-09-17T03:37:44.106235+0000","last_undegraded":"2024-09-17T03:37:44.106235+0000","last_fullsized":"2024-09-17T03:37:44.106235+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:17.106513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"87'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.111350+0000","last_change":"2024-09-17T03:37:43.081673+0000","last_active":"2024-09-17T03:37:44.111350+0000","last_peered":"2024-09-17T03:37:44.111350+0000","last_clean":"2024-09-17T03:37:44.111350+0000","last_became_active":"2024-09-17T03:37:43.081164+0000","last_became_peered":"2024-09-17T03:37:43.081164+0000","last_unstale":"2024-09-17T03:37:44.111350+0000","last_undegraded":"2024-09-17T03:37:44.111350+0000","last_fullsized":"2024-09-17T03:37:44.111350+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:43.071755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098497+0000","last_change":"2024-09-17T03:37:44.095378+0000","last_active":"2024-09-17T03:37:44.098497+0000","last_peered":"2024-09-17T03:37:44.098497+0000","last_clean":"2024-09-17T03:37:44.098497+0000","last_became_active":"2024-09-17T03:37:44.095100+0000","last_became_peered":"2024-09-17T03:37:44.095100+0000","last_unstale":"2024-09-17T03:37:44.098497+0000","last_undegraded":"2024-09-17T03:37:44.098497+0000","last_fullsized":"2024-09-17T03:37:44.098497+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:32.491921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544389+0000","last_change":"2024-09-17T03:37:43.078733+0000","last_active":"2024-09-17T03:37:45.544389+0000","last_peered":"2024-09-17T03:37:45.544389+0000","last_clean":"2024-09-17T03:37:45.544389+0000","last_became_active":"2024-09-17T03:37:43.078292+0000","last_became_peered":"2024-09-17T03:37:43.078292+0000","last_unstale":"2024-09-17T03:37:45.544389+0000","last_undegraded":"2024-09-17T03:37:45.544389+0000","last_fullsized":"2024-09-17T03:37:45.544389+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:58.361913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.100068+0000","last_change":"2024-09-17T03:37:44.095166+0000","last_active":"2024-09-17T03:37:44.100068+0000","last_peered":"2024-09-17T03:37:44.100068+0000","last_clean":"2024-09-17T03:37:44.100068+0000","last_became_active":"2024-09-17T03:37:44.094865+0000","last_became_peered":"2024-09-17T03:37:44.094865+0000","last_unstale":"2024-09-17T03:37:44.100068+0000","last_undegraded":"2024-09-17T03:37:44.100068+0000","last_fullsized":"2024-09-17T03:37:44.100068+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:22.683930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463474+0000","last_change":"2024-09-17T03:37:43.083234+0000","last_active":"2024-09-17T03:37:45.463474+0000","last_peered":"2024-09-17T03:37:45.463474+0000","last_clean":"2024-09-17T03:37:45.463474+0000","last_became_active":"2024-09-17T03:37:43.082742+0000","last_became_peered":"2024-09-17T03:37:43.082742+0000","last_unstale":"2024-09-17T03:37:45.463474+0000","last_undegraded":"2024-09-17T03:37:45.463474+0000","last_fullsized":"2024-09-17T03:37:45.463474+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:39.356845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.097159+0000","last_change":"2024-09-17T03:37:44.094347+0000","last_active":"2024-09-17T03:37:44.097159+0000","last_peered":"2024-09-17T03:37:44.097159+0000","last_clean":"2024-09-17T03:37:44.097159+0000","last_became_active":"2024-09-17T03:37:44.094007+0000","last_became_peered":"2024-09-17T03:37:44.094007+0000","last_unstale":"2024-09-17T03:37:44.097159+0000","last_undegraded":"2024-09-17T03:37:44.097159+0000","last_fullsized":"2024-09-17T03:37:44.097159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:58.317507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"87'8","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.115208+0000","last_change":"2024-09-17T03:37:43.079520+0000","last_active":"2024-09-17T03:37:44.115208+0000","last_peered":"2024-09-17T03:37:44.115208+0000","last_clean":"2024-09-17T03:37:44.115208+0000","last_became_active":"2024-09-17T03:37:43.079207+0000","last_became_peered":"2024-09-17T03:37:43.079207+0000","last_unstale":"2024-09-17T03:37:44.115208+0000","last_undegraded":"2024-09-17T03:37:44.115208+0000","last_fullsized":"2024-09-17T03:37:44.115208+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:36.287778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098127+0000","last_change":"2024-09-17T03:37:44.091658+0000","last_active":"2024-09-17T03:37:44.098127+0000","last_peered":"2024-09-17T03:37:44.098127+0000","last_clean":"2024-09-17T03:37:44.098127+0000","last_became_active":"2024-09-17T03:37:44.091314+0000","last_became_peered":"2024-09-17T03:37:44.091314+0000","last_unstale":"2024-09-17T03:37:44.098127+0000","last_undegraded":"2024-09-17T03:37:44.098127+0000","last_fullsized":"2024-09-17T03:37:44.098127+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:35.035453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112628+0000","last_change":"2024-09-17T03:37:43.072647+0000","last_active":"2024-09-17T03:37:44.112628+0000","last_peered":"2024-09-17T03:37:44.112628+0000","last_clean":"2024-09-17T03:37:44.112628+0000","last_became_active":"2024-09-17T03:37:43.072305+0000","last_became_peered":"2024-09-17T03:37:43.072305+0000","last_unstale":"2024-09-17T03:37:44.112628+0000","last_undegraded":"2024-09-17T03:37:44.112628+0000","last_fullsized":"2024-09-17T03:37:44.112628+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:23.732825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.089909+0000","last_change":"2024-09-17T03:37:44.088245+0000","last_active":"2024-09-17T03:37:44.089909+0000","last_peered":"2024-09-17T03:37:44.089909+0000","last_clean":"2024-09-17T03:37:44.089909+0000","last_became_active":"2024-09-17T03:37:44.087873+0000","last_became_peered":"2024-09-17T03:37:44.087873+0000","last_unstale":"2024-09-17T03:37:44.089909+0000","last_undegraded":"2024-09-17T03:37:44.089909+0000","last_fullsized":"2024-09-17T03:37:44.089909+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:05.156434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.114956+0000","last_change":"2024-09-17T03:37:43.082830+0000","last_active":"2024-09-17T03:37:44.114956+0000","last_peered":"2024-09-17T03:37:44.114956+0000","last_clean":"2024-09-17T03:37:44.114956+0000","last_became_active":"2024-09-17T03:37:43.080627+0000","last_became_peered":"2024-09-17T03:37:43.080627+0000","last_unstale":"2024-09-17T03:37:44.114956+0000","last_undegraded":"2024-09-17T03:37:44.114956+0000","last_fullsized":"2024-09-17T03:37:44.114956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:19.416659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.109652+0000","last_change":"2024-09-17T03:37:44.104822+0000","last_active":"2024-09-17T03:37:44.109652+0000","last_peered":"2024-09-17T03:37:44.109652+0000","last_clean":"2024-09-17T03:37:44.109652+0000","last_became_active":"2024-09-17T03:37:44.104517+0000","last_became_peered":"2024-09-17T03:37:44.104517+0000","last_unstale":"2024-09-17T03:37:44.109652+0000","last_undegraded":"2024-09-17T03:37:44.109652+0000","last_fullsized":"2024-09-17T03:37:44.109652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:48.853482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.082500+0000","last_change":"2024-09-17T03:37:43.078794+0000","last_active":"2024-09-17T03:37:44.082500+0000","last_peered":"2024-09-17T03:37:44.082500+0000","last_clean":"2024-09-17T03:37:44.082500+0000","last_became_active":"2024-09-17T03:37:43.078487+0000","last_became_peered":"2024-09-17T03:37:43.078487+0000","last_unstale":"2024-09-17T03:37:44.082500+0000","last_undegraded":"2024-09-17T03:37:44.082500+0000","last_fullsized":"2024-09-17T03:37:44.082500+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.631912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.102319+0000","last_change":"2024-09-17T03:37:44.097206+0000","last_active":"2024-09-17T03:37:44.102319+0000","last_peered":"2024-09-17T03:37:44.102319+0000","last_clean":"2024-09-17T03:37:44.102319+0000","last_became_active":"2024-09-17T03:37:44.096442+0000","last_became_peered":"2024-09-17T03:37:44.096442+0000","last_unstale":"2024-09-17T03:37:44.102319+0000","last_undegraded":"2024-09-17T03:37:44.102319+0000","last_fullsized":"2024-09-17T03:37:44.102319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:10.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"87'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544535+0000","last_change":"2024-09-17T03:37:43.074982+0000","last_active":"2024-09-17T03:37:45.544535+0000","last_peered":"2024-09-17T03:37:45.544535+0000","last_clean":"2024-09-17T03:37:45.544535+0000","last_became_active":"2024-09-17T03:37:43.074615+0000","last_became_peered":"2024-09-17T03:37:43.074615+0000","last_unstale":"2024-09-17T03:37:45.544535+0000","last_undegraded":"2024-09-17T03:37:45.544535+0000","last_fullsized":"2024-09-17T03:37:45.544535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:46.903215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463503+0000","last_change":"2024-09-17T03:37:44.092073+0000","last_active":"2024-09-17T03:37:45.463503+0000","last_peered":"2024-09-17T03:37:45.463503+0000","last_clean":"2024-09-17T03:37:45.463503+0000","last_became_active":"2024-09-17T03:37:44.091437+0000","last_became_peered":"2024-09-17T03:37:44.091437+0000","last_unstale":"2024-09-17T03:37:45.463503+0000","last_undegraded":"2024-09-17T03:37:45.463503+0000","last_fullsized":"2024-09-17T03:37:45.463503+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:09.968801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.082176+0000","last_change":"2024-09-17T03:37:43.075755+0000","last_active":"2024-09-17T03:37:44.082176+0000","last_peered":"2024-09-17T03:37:44.082176+0000","last_clean":"2024-09-17T03:37:44.082176+0000","last_became_active":"2024-09-17T03:37:43.074780+0000","last_became_peered":"2024-09-17T03:37:43.074780+0000","last_unstale":"2024-09-17T03:37:44.082176+0000","last_undegraded":"2024-09-17T03:37:44.082176+0000","last_fullsized":"2024-09-17T03:37:44.082176+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:52.579091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.094171+0000","last_change":"2024-09-17T03:37:44.092607+0000","last_active":"2024-09-17T03:37:44.094171+0000","last_peered":"2024-09-17T03:37:44.094171+0000","last_clean":"2024-09-17T03:37:44.094171+0000","last_became_active":"2024-09-17T03:37:44.092296+0000","last_became_peered":"2024-09-17T03:37:44.092296+0000","last_unstale":"2024-09-17T03:37:44.094171+0000","last_undegraded":"2024-09-17T03:37:44.094171+0000","last_fullsized":"2024-09-17T03:37:44.094171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:59.037456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.081117+0000","last_change":"2024-09-17T03:37:43.077047+0000","last_active":"2024-09-17T03:37:44.081117+0000","last_peered":"2024-09-17T03:37:44.081117+0000","last_clean":"2024-09-17T03:37:44.081117+0000","last_became_active":"2024-09-17T03:37:43.076471+0000","last_became_peered":"2024-09-17T03:37:43.076471+0000","last_unstale":"2024-09-17T03:37:44.081117+0000","last_undegraded":"2024-09-17T03:37:44.081117+0000","last_fullsized":"2024-09-17T03:37:44.081117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:13.746113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463362+0000","last_change":"2024-09-17T03:37:44.098601+0000","last_active":"2024-09-17T03:37:45.463362+0000","last_peered":"2024-09-17T03:37:45.463362+0000","last_clean":"2024-09-17T03:37:45.463362+0000","last_became_active":"2024-09-17T03:37:44.098292+0000","last_became_peered":"2024-09-17T03:37:44.098292+0000","last_unstale":"2024-09-17T03:37:45.463362+0000","last_undegraded":"2024-09-17T03:37:45.463362+0000","last_fullsized":"2024-09-17T03:37:45.463362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:08.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544250+0000","last_change":"2024-09-17T03:37:43.073634+0000","last_active":"2024-09-17T03:37:45.544250+0000","last_peered":"2024-09-17T03:37:45.544250+0000","last_clean":"2024-09-17T03:37:45.544250+0000","last_became_active":"2024-09-17T03:37:43.073329+0000","last_became_peered":"2024-09-17T03:37:43.073329+0000","last_unstale":"2024-09-17T03:37:45.544250+0000","last_undegraded":"2024-09-17T03:37:45.544250+0000","last_fullsized":"2024-09-17T03:37:45.544250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:37.920574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.114635+0000","last_change":"2024-09-17T03:37:44.109337+0000","last_active":"2024-09-17T03:37:44.114635+0000","last_peered":"2024-09-17T03:37:44.114635+0000","last_clean":"2024-09-17T03:37:44.114635+0000","last_became_active":"2024-09-17T03:37:44.108734+0000","last_became_peered":"2024-09-17T03:37:44.108734+0000","last_unstale":"2024-09-17T03:37:44.114635+0000","last_undegraded":"2024-09-17T03:37:44.114635+0000","last_fullsized":"2024-09-17T03:37:44.114635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:32.028535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"87'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.109580+0000","last_change":"2024-09-17T03:37:43.081946+0000","last_active":"2024-09-17T03:37:44.109580+0000","last_peered":"2024-09-17T03:37:44.109580+0000","last_clean":"2024-09-17T03:37:44.109580+0000","last_became_active":"2024-09-17T03:37:43.081603+0000","last_became_peered":"2024-09-17T03:37:43.081603+0000","last_unstale":"2024-09-17T03:37:44.109580+0000","last_undegraded":"2024-09-17T03:37:44.109580+0000","last_fullsized":"2024-09-17T03:37:44.109580+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:49.720313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098149+0000","last_change":"2024-09-17T03:37:44.091170+0000","last_active":"2024-09-17T03:37:44.098149+0000","last_peered":"2024-09-17T03:37:44.098149+0000","last_clean":"2024-09-17T03:37:44.098149+0000","last_became_active":"2024-09-17T03:37:44.090825+0000","last_became_peered":"2024-09-17T03:37:44.090825+0000","last_unstale":"2024-09-17T03:37:44.098149+0000","last_undegraded":"2024-09-17T03:37:44.098149+0000","last_fullsized":"2024-09-17T03:37:44.098149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:38.767185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.083383+0000","last_change":"2024-09-17T03:37:43.084594+0000","last_active":"2024-09-17T03:37:44.083383+0000","last_peered":"2024-09-17T03:37:44.083383+0000","last_clean":"2024-09-17T03:37:44.083383+0000","last_became_active":"2024-09-17T03:37:43.084239+0000","last_became_peered":"2024-09-17T03:37:43.084239+0000","last_unstale":"2024-09-17T03:37:44.083383+0000","last_undegraded":"2024-09-17T03:37:44.083383+0000","last_fullsized":"2024-09-17T03:37:44.083383+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:27.587780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093095+0000","last_change":"2024-09-17T03:37:44.089231+0000","last_active":"2024-09-17T03:37:44.093095+0000","last_peered":"2024-09-17T03:37:44.093095+0000","last_clean":"2024-09-17T03:37:44.093095+0000","last_became_active":"2024-09-17T03:37:44.088885+0000","last_became_peered":"2024-09-17T03:37:44.088885+0000","last_unstale":"2024-09-17T03:37:44.093095+0000","last_undegraded":"2024-09-17T03:37:44.093095+0000","last_fullsized":"2024-09-17T03:37:44.093095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:47.932733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.082726+0000","last_change":"2024-09-17T03:37:43.069873+0000","last_active":"2024-09-17T03:37:44.082726+0000","last_peered":"2024-09-17T03:37:44.082726+0000","last_clean":"2024-09-17T03:37:44.082726+0000","last_became_active":"2024-09-17T03:37:43.069506+0000","last_became_peered":"2024-09-17T03:37:43.069506+0000","last_unstale":"2024-09-17T03:37:44.082726+0000","last_undegraded":"2024-09-17T03:37:44.082726+0000","last_fullsized":"2024-09-17T03:37:44.082726+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:49.787269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106927+0000","last_change":"2024-09-17T03:37:44.102634+0000","last_active":"2024-09-17T03:37:44.106927+0000","last_peered":"2024-09-17T03:37:44.106927+0000","last_clean":"2024-09-17T03:37:44.106927+0000","last_became_active":"2024-09-17T03:37:44.102326+0000","last_became_peered":"2024-09-17T03:37:44.102326+0000","last_unstale":"2024-09-17T03:37:44.106927+0000","last_undegraded":"2024-09-17T03:37:44.106927+0000","last_fullsized":"2024-09-17T03:37:44.106927+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:26.009847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.084325+0000","last_change":"2024-09-17T03:37:43.075136+0000","last_active":"2024-09-17T03:37:44.084325+0000","last_peered":"2024-09-17T03:37:44.084325+0000","last_clean":"2024-09-17T03:37:44.084325+0000","last_became_active":"2024-09-17T03:37:43.074556+0000","last_became_peered":"2024-09-17T03:37:43.074556+0000","last_unstale":"2024-09-17T03:37:44.084325+0000","last_undegraded":"2024-09-17T03:37:44.084325+0000","last_fullsized":"2024-09-17T03:37:44.084325+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:11.929248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463582+0000","last_change":"2024-09-17T03:37:44.101181+0000","last_active":"2024-09-17T03:37:45.463582+0000","last_peered":"2024-09-17T03:37:45.463582+0000","last_clean":"2024-09-17T03:37:45.463582+0000","last_became_active":"2024-09-17T03:37:44.100883+0000","last_became_peered":"2024-09-17T03:37:44.100883+0000","last_unstale":"2024-09-17T03:37:45.463582+0000","last_undegraded":"2024-09-17T03:37:45.463582+0000","last_fullsized":"2024-09-17T03:37:45.463582+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:39.075827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.082531+0000","last_change":"2024-09-17T03:37:43.077937+0000","last_active":"2024-09-17T03:37:44.082531+0000","last_peered":"2024-09-17T03:37:44.082531+0000","last_clean":"2024-09-17T03:37:44.082531+0000","last_became_active":"2024-09-17T03:37:43.077448+0000","last_became_peered":"2024-09-17T03:37:43.077448+0000","last_unstale":"2024-09-17T03:37:44.082531+0000","last_undegraded":"2024-09-17T03:37:44.082531+0000","last_fullsized":"2024-09-17T03:37:44.082531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:14.985102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.108238+0000","last_change":"2024-09-17T03:37:44.105949+0000","last_active":"2024-09-17T03:37:44.108238+0000","last_peered":"2024-09-17T03:37:44.108238+0000","last_clean":"2024-09-17T03:37:44.108238+0000","last_became_active":"2024-09-17T03:37:44.105568+0000","last_became_peered":"2024-09-17T03:37:44.105568+0000","last_unstale":"2024-09-17T03:37:44.108238+0000","last_undegraded":"2024-09-17T03:37:44.108238+0000","last_fullsized":"2024-09-17T03:37:44.108238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:16.151976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098312+0000","last_change":"2024-09-17T03:37:43.082042+0000","last_active":"2024-09-17T03:37:44.098312+0000","last_peered":"2024-09-17T03:37:44.098312+0000","last_clean":"2024-09-17T03:37:44.098312+0000","last_became_active":"2024-09-17T03:37:43.081655+0000","last_became_peered":"2024-09-17T03:37:43.081655+0000","last_unstale":"2024-09-17T03:37:44.098312+0000","last_undegraded":"2024-09-17T03:37:44.098312+0000","last_fullsized":"2024-09-17T03:37:44.098312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:41.819083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.101667+0000","last_change":"2024-09-17T03:37:44.100050+0000","last_active":"2024-09-17T03:37:44.101667+0000","last_peered":"2024-09-17T03:37:44.101667+0000","last_clean":"2024-09-17T03:37:44.101667+0000","last_became_active":"2024-09-17T03:37:44.099740+0000","last_became_peered":"2024-09-17T03:37:44.099740+0000","last_unstale":"2024-09-17T03:37:44.101667+0000","last_undegraded":"2024-09-17T03:37:44.101667+0000","last_fullsized":"2024-09-17T03:37:44.101667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:11.986628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.082512+0000","last_change":"2024-09-17T03:37:43.072216+0000","last_active":"2024-09-17T03:37:44.082512+0000","last_peered":"2024-09-17T03:37:44.082512+0000","last_clean":"2024-09-17T03:37:44.082512+0000","last_became_active":"2024-09-17T03:37:43.071857+0000","last_became_peered":"2024-09-17T03:37:43.071857+0000","last_unstale":"2024-09-17T03:37:44.082512+0000","last_undegraded":"2024-09-17T03:37:44.082512+0000","last_fullsized":"2024-09-17T03:37:44.082512+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:40.454681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.088638+0000","last_change":"2024-09-17T03:37:44.086364+0000","last_active":"2024-09-17T03:37:44.088638+0000","last_peered":"2024-09-17T03:37:44.088638+0000","last_clean":"2024-09-17T03:37:44.088638+0000","last_became_active":"2024-09-17T03:37:44.085830+0000","last_became_peered":"2024-09-17T03:37:44.085830+0000","last_unstale":"2024-09-17T03:37:44.088638+0000","last_undegraded":"2024-09-17T03:37:44.088638+0000","last_fullsized":"2024-09-17T03:37:44.088638+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:27.564632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.090216+0000","last_change":"2024-09-17T03:37:43.082507+0000","last_active":"2024-09-17T03:37:44.090216+0000","last_peered":"2024-09-17T03:37:44.090216+0000","last_clean":"2024-09-17T03:37:44.090216+0000","last_became_active":"2024-09-17T03:37:43.081888+0000","last_became_peered":"2024-09-17T03:37:43.081888+0000","last_unstale":"2024-09-17T03:37:44.090216+0000","last_undegraded":"2024-09-17T03:37:44.090216+0000","last_fullsized":"2024-09-17T03:37:44.090216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:00.619644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.097340+0000","last_change":"2024-09-17T03:37:44.094826+0000","last_active":"2024-09-17T03:37:44.097340+0000","last_peered":"2024-09-17T03:37:44.097340+0000","last_clean":"2024-09-17T03:37:44.097340+0000","last_became_active":"2024-09-17T03:37:44.094433+0000","last_became_peered":"2024-09-17T03:37:44.094433+0000","last_unstale":"2024-09-17T03:37:44.097340+0000","last_undegraded":"2024-09-17T03:37:44.097340+0000","last_fullsized":"2024-09-17T03:37:44.097340+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:17.957915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.108375+0000","last_change":"2024-09-17T03:37:43.077586+0000","last_active":"2024-09-17T03:37:44.108375+0000","last_peered":"2024-09-17T03:37:44.108375+0000","last_clean":"2024-09-17T03:37:44.108375+0000","last_became_active":"2024-09-17T03:37:43.077272+0000","last_became_peered":"2024-09-17T03:37:43.077272+0000","last_unstale":"2024-09-17T03:37:44.108375+0000","last_undegraded":"2024-09-17T03:37:44.108375+0000","last_fullsized":"2024-09-17T03:37:44.108375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:14.929040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":231,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.083620+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:37:44.083620+0000","last_peered":"2024-09-17T03:37:44.083620+0000","last_clean":"2024-09-17T03:37:44.083620+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:37:44.083620+0000","last_undegraded":"2024-09-17T03:37:44.083620+0000","last_fullsized":"2024-09-17T03:37:44.083620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36952,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334888,"statfs":{"total":96636764160,"available":96598925312,"internally_reserved":0,"allocated":1642496,"data_stored":1040655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40564,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331276,"statfs":{"total":96636764160,"available":96595226624,"internally_reserved":0,"allocated":1073152,"data_stored":457756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509503,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1048576,"data_stored":450287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36376,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335464,"statfs":{"total":96636764160,"available":96599515136,"internally_reserved":0,"allocated":1048576,"data_stored":450287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40560,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331280,"statfs":{"total":96636764160,"available":96595230720,"internally_reserved":0,"allocated":1073152,"data_stored":457256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36952,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334888,"statfs":{"total":96636764160,"available":96598925312,"internally_reserved":0,"allocated":1642496,"data_stored":1040655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40576,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331264,"statfs":{"total":96636764160,"available":96595214336,"internally_reserved":0,"allocated":1089536,"data_stored":464996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40572,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331268,"statfs":{"total":96636764160,"available":96595218432,"internally_reserved":0,"allocated":1085440,"data_stored":464974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:48.099 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:37:48.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.249+0000 7f05eb983640 1 -- 172.21.15.146:0/73607169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05cc003fd0 msgr2=0x7f05cc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.249+0000 7f05eb983640 1 --2- 172.21.15.146:0/73607169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05cc003fd0 0x7f05cc004800 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f05e4069fa0 tx=0x7f05cc005830 comp rx=0 tx=0).stop 2024-09-17T03:37:48.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.249+0000 7f05e9f20640 1 -- 172.21.15.146:0/73607169 reap_dead start 2024-09-17T03:37:48.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.249+0000 7f05eb983640 1 -- 172.21.15.146:0/73607169 shutdown_connections 2024-09-17T03:37:48.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.249+0000 7f05eb983640 1 -- 172.21.15.146:0/73607169 >> 172.21.15.146:0/73607169 conn(0x7f05e40b2db0 msgr2=0x7f05e40b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:48.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.249+0000 7f05eb983640 1 -- 172.21.15.146:0/73607169 shutdown_connections 2024-09-17T03:37:48.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.249+0000 7f05eb983640 1 -- 172.21.15.146:0/73607169 wait complete. 2024-09-17T03:37:48.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.251+0000 7f05eb983640 1 Processor -- start 2024-09-17T03:37:48.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.251+0000 7f05eb983640 1 -- start start 2024-09-17T03:37:48.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.252+0000 7f05eb983640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05cc003fd0 0x7f05e41f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.252+0000 7f05eb983640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4146950 0x7f05e4140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.252+0000 7f05eb983640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05e41e6990 0x7f05e41e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.252+0000 7f05eb983640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40af250 con 0x7f05cc003fd0 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.252+0000 7f05eb983640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f05e40af0d0 con 0x7f05e4146950 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.252+0000 7f05eb983640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f05e40712a0 con 0x7f05e41e6990 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.252+0000 7f05e971f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05cc003fd0 0x7f05e41f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.252+0000 7f05e971f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05cc003fd0 0x7f05e41f7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56300/0 (socket says 172.21.15.146:56300) 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.252+0000 7f05e971f640 1 -- 172.21.15.146:0/245838193 learned_addr learned my addr 172.21.15.146:0/245838193 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.253+0000 7f05e971f640 1 -- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05e41e6990 msgr2=0x7f05e41e6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.253+0000 7f05e971f640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05e41e6990 0x7f05e41e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.253+0000 7f05e971f640 1 -- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4146950 msgr2=0x7f05e4140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.253+0000 7f05e971f640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4146950 0x7f05e4140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.253+0000 7f05e971f640 1 -- 172.21.15.146:0/245838193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e41f7fc0 con 0x7f05cc003fd0 2024-09-17T03:37:48.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.253+0000 7f05e971f640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05cc003fd0 0x7f05e41f7a80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f05d4011d90 tx=0x7f05d400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:48.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.253+0000 7f05e1ffb640 1 -- 172.21.15.146:0/245838193 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4004d20 con 0x7f05cc003fd0 2024-09-17T03:37:48.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.253+0000 7f05e1ffb640 1 -- 172.21.15.146:0/245838193 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05d4003970 con 0x7f05cc003fd0 2024-09-17T03:37:48.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.253+0000 7f05eb983640 1 -- 172.21.15.146:0/245838193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e41e72e0 con 0x7f05cc003fd0 2024-09-17T03:37:48.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.253+0000 7f05e1ffb640 1 -- 172.21.15.146:0/245838193 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4003d60 con 0x7f05cc003fd0 2024-09-17T03:37:48.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.253+0000 7f05eb983640 1 -- 172.21.15.146:0/245838193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e41446c0 con 0x7f05cc003fd0 2024-09-17T03:37:48.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.254+0000 7f05eb983640 1 -- 172.21.15.146:0/245838193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e415ea80 con 0x7f05cc003fd0 2024-09-17T03:37:48.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.255+0000 7f05e1ffb640 1 -- 172.21.15.146:0/245838193 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f05d4004260 con 0x7f05cc003fd0 2024-09-17T03:37:48.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.255+0000 7f05e1ffb640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f05d0078bc0 0x7f05d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.255+0000 7f05e1ffb640 1 -- 172.21.15.146:0/245838193 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f05d409bfe0 con 0x7f05cc003fd0 2024-09-17T03:37:48.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.256+0000 7f05e8f1e640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f05d0078bc0 0x7f05d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:48.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.256+0000 7f05e8f1e640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f05d0078bc0 0x7f05d007b0d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f05d8035000 tx=0x7f05d8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:48.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.260+0000 7f05e1ffb640 1 -- 172.21.15.146:0/245838193 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f05e41e72e0 con 0x7f05cc003fd0 2024-09-17T03:37:48.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.431+0000 7f05eb983640 1 -- 172.21.15.146:0/245838193 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f05e4073f80 con 0x7f05d0078bc0 2024-09-17T03:37:48.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.436+0000 7f05e1ffb640 1 -- 172.21.15.146:0/245838193 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252069 (secure 0 0 0) 0x7f05e4073f80 con 0x7f05d0078bc0 2024-09-17T03:37:48.437 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:48.439 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:37:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.439+0000 7f05eb983640 1 -- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f05d0078bc0 msgr2=0x7f05d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.439+0000 7f05eb983640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f05d0078bc0 0x7f05d007b0d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f05d8035000 tx=0x7f05d8004730 comp rx=0 tx=0).stop 2024-09-17T03:37:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.439+0000 7f05eb983640 1 -- 172.21.15.146:0/245838193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05cc003fd0 msgr2=0x7f05e41f7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.439+0000 7f05eb983640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05cc003fd0 0x7f05e41f7a80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f05d4011d90 tx=0x7f05d400f790 comp rx=0 tx=0).stop 2024-09-17T03:37:48.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.439+0000 7f05eb983640 1 -- 172.21.15.146:0/245838193 shutdown_connections 2024-09-17T03:37:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.439+0000 7f05eb983640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f05d0078bc0 0x7f05d007b0d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.439+0000 7f05eb983640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f05e41e6990 0x7f05e41e6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.439+0000 7f05eb983640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05e4146950 0x7f05e4140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.439+0000 7f05eb983640 1 --2- 172.21.15.146:0/245838193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05cc003fd0 0x7f05e41f7a80 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.439+0000 7f05eb983640 1 -- 172.21.15.146:0/245838193 >> 172.21.15.146:0/245838193 conn(0x7f05e40b2db0 msgr2=0x7f05e40b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.440+0000 7f05eb983640 1 -- 172.21.15.146:0/245838193 shutdown_connections 2024-09-17T03:37:48.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.440+0000 7f05eb983640 1 -- 172.21.15.146:0/245838193 wait complete. 2024-09-17T03:37:48.450 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-09-17T03:37:47.864271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":313088,"kb_used_data":9476,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754661632,"statfs":{"total":773094113280,"available":772773511168,"internally_reserved":0,"allocated":9703424,"data_stored":4826866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":310693425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.801555"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112797+0000","last_change":"2024-09-17T03:37:44.110725+0000","last_active":"2024-09-17T03:37:44.112797+0000","last_peered":"2024-09-17T03:37:44.112797+0000","last_clean":"2024-09-17T03:37:44.112797+0000","last_became_active":"2024-09-17T03:37:44.109150+0000","last_became_peered":"2024-09-17T03:37:44.109150+0000","last_unstale":"2024-09-17T03:37:44.112797+0000","last_undegraded":"2024-09-17T03:37:44.112797+0000","last_fullsized":"2024-09-17T03:37:44.112797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:46.022248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093364+0000","last_change":"2024-09-17T03:37:44.088486+0000","last_active":"2024-09-17T03:37:44.093364+0000","last_peered":"2024-09-17T03:37:44.093364+0000","last_clean":"2024-09-17T03:37:44.093364+0000","last_became_active":"2024-09-17T03:37:44.088155+0000","last_became_peered":"2024-09-17T03:37:44.088155+0000","last_unstale":"2024-09-17T03:37:44.093364+0000","last_undegraded":"2024-09-17T03:37:44.093364+0000","last_fullsized":"2024-09-17T03:37:44.093364+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:31.747262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098111+0000","last_change":"2024-09-17T03:37:44.090253+0000","last_active":"2024-09-17T03:37:44.098111+0000","last_peered":"2024-09-17T03:37:44.098111+0000","last_clean":"2024-09-17T03:37:44.098111+0000","last_became_active":"2024-09-17T03:37:44.089930+0000","last_became_peered":"2024-09-17T03:37:44.089930+0000","last_unstale":"2024-09-17T03:37:44.098111+0000","last_undegraded":"2024-09-17T03:37:44.098111+0000","last_fullsized":"2024-09-17T03:37:44.098111+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:38.717244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.100863+0000","last_change":"2024-09-17T03:37:44.097090+0000","last_active":"2024-09-17T03:37:44.100863+0000","last_peered":"2024-09-17T03:37:44.100863+0000","last_clean":"2024-09-17T03:37:44.100863+0000","last_became_active":"2024-09-17T03:37:44.096771+0000","last_became_peered":"2024-09-17T03:37:44.096771+0000","last_unstale":"2024-09-17T03:37:44.100863+0000","last_undegraded":"2024-09-17T03:37:44.100863+0000","last_fullsized":"2024-09-17T03:37:44.100863+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:24.561821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112119+0000","last_change":"2024-09-17T03:37:44.109031+0000","last_active":"2024-09-17T03:37:44.112119+0000","last_peered":"2024-09-17T03:37:44.112119+0000","last_clean":"2024-09-17T03:37:44.112119+0000","last_became_active":"2024-09-17T03:37:44.108678+0000","last_became_peered":"2024-09-17T03:37:44.108678+0000","last_unstale":"2024-09-17T03:37:44.112119+0000","last_undegraded":"2024-09-17T03:37:44.112119+0000","last_fullsized":"2024-09-17T03:37:44.112119+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:15.900840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463400+0000","last_change":"2024-09-17T03:37:44.095512+0000","last_active":"2024-09-17T03:37:45.463400+0000","last_peered":"2024-09-17T03:37:45.463400+0000","last_clean":"2024-09-17T03:37:45.463400+0000","last_became_active":"2024-09-17T03:37:44.094585+0000","last_became_peered":"2024-09-17T03:37:44.094585+0000","last_unstale":"2024-09-17T03:37:45.463400+0000","last_undegraded":"2024-09-17T03:37:45.463400+0000","last_fullsized":"2024-09-17T03:37:45.463400+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:44.303060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093659+0000","last_change":"2024-09-17T03:37:44.091518+0000","last_active":"2024-09-17T03:37:44.093659+0000","last_peered":"2024-09-17T03:37:44.093659+0000","last_clean":"2024-09-17T03:37:44.093659+0000","last_became_active":"2024-09-17T03:37:44.091158+0000","last_became_peered":"2024-09-17T03:37:44.091158+0000","last_unstale":"2024-09-17T03:37:44.093659+0000","last_undegraded":"2024-09-17T03:37:44.093659+0000","last_fullsized":"2024-09-17T03:37:44.093659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:25.588832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463622+0000","last_change":"2024-09-17T03:37:44.100424+0000","last_active":"2024-09-17T03:37:45.463622+0000","last_peered":"2024-09-17T03:37:45.463622+0000","last_clean":"2024-09-17T03:37:45.463622+0000","last_became_active":"2024-09-17T03:37:44.100119+0000","last_became_peered":"2024-09-17T03:37:44.100119+0000","last_unstale":"2024-09-17T03:37:45.463622+0000","last_undegraded":"2024-09-17T03:37:45.463622+0000","last_fullsized":"2024-09-17T03:37:45.463622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:45.247988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463594+0000","last_change":"2024-09-17T03:37:44.097865+0000","last_active":"2024-09-17T03:37:45.463594+0000","last_peered":"2024-09-17T03:37:45.463594+0000","last_clean":"2024-09-17T03:37:45.463594+0000","last_became_active":"2024-09-17T03:37:44.097551+0000","last_became_peered":"2024-09-17T03:37:44.097551+0000","last_unstale":"2024-09-17T03:37:45.463594+0000","last_undegraded":"2024-09-17T03:37:45.463594+0000","last_fullsized":"2024-09-17T03:37:45.463594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:18.451231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.104100+0000","last_change":"2024-09-17T03:37:44.092687+0000","last_active":"2024-09-17T03:37:44.104100+0000","last_peered":"2024-09-17T03:37:44.104100+0000","last_clean":"2024-09-17T03:37:44.104100+0000","last_became_active":"2024-09-17T03:37:44.092284+0000","last_became_peered":"2024-09-17T03:37:44.092284+0000","last_unstale":"2024-09-17T03:37:44.104100+0000","last_undegraded":"2024-09-17T03:37:44.104100+0000","last_fullsized":"2024-09-17T03:37:44.104100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:57.560354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.101281+0000","last_change":"2024-09-17T03:37:44.095570+0000","last_active":"2024-09-17T03:37:44.101281+0000","last_peered":"2024-09-17T03:37:44.101281+0000","last_clean":"2024-09-17T03:37:44.101281+0000","last_became_active":"2024-09-17T03:37:44.095236+0000","last_became_peered":"2024-09-17T03:37:44.095236+0000","last_unstale":"2024-09-17T03:37:44.101281+0000","last_undegraded":"2024-09-17T03:37:44.101281+0000","last_fullsized":"2024-09-17T03:37:44.101281+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:26.232860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.102019+0000","last_change":"2024-09-17T03:37:44.092582+0000","last_active":"2024-09-17T03:37:44.102019+0000","last_peered":"2024-09-17T03:37:44.102019+0000","last_clean":"2024-09-17T03:37:44.102019+0000","last_became_active":"2024-09-17T03:37:44.092187+0000","last_became_peered":"2024-09-17T03:37:44.092187+0000","last_unstale":"2024-09-17T03:37:44.102019+0000","last_undegraded":"2024-09-17T03:37:44.102019+0000","last_fullsized":"2024-09-17T03:37:44.102019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:31.319493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.108725+0000","last_change":"2024-09-17T03:37:44.105691+0000","last_active":"2024-09-17T03:37:44.108725+0000","last_peered":"2024-09-17T03:37:44.108725+0000","last_clean":"2024-09-17T03:37:44.108725+0000","last_became_active":"2024-09-17T03:37:44.105338+0000","last_became_peered":"2024-09-17T03:37:44.105338+0000","last_unstale":"2024-09-17T03:37:44.108725+0000","last_undegraded":"2024-09-17T03:37:44.108725+0000","last_fullsized":"2024-09-17T03:37:44.108725+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:54.586063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.102349+0000","last_change":"2024-09-17T03:37:44.097584+0000","last_active":"2024-09-17T03:37:44.102349+0000","last_peered":"2024-09-17T03:37:44.102349+0000","last_clean":"2024-09-17T03:37:44.102349+0000","last_became_active":"2024-09-17T03:37:44.096898+0000","last_became_peered":"2024-09-17T03:37:44.096898+0000","last_unstale":"2024-09-17T03:37:44.102349+0000","last_undegraded":"2024-09-17T03:37:44.102349+0000","last_fullsized":"2024-09-17T03:37:44.102349+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:00.826765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544455+0000","last_change":"2024-09-17T03:37:44.087407+0000","last_active":"2024-09-17T03:37:45.544455+0000","last_peered":"2024-09-17T03:37:45.544455+0000","last_clean":"2024-09-17T03:37:45.544455+0000","last_became_active":"2024-09-17T03:37:44.087103+0000","last_became_peered":"2024-09-17T03:37:44.087103+0000","last_unstale":"2024-09-17T03:37:45.544455+0000","last_undegraded":"2024-09-17T03:37:45.544455+0000","last_fullsized":"2024-09-17T03:37:45.544455+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:26.003156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106856+0000","last_change":"2024-09-17T03:37:44.102572+0000","last_active":"2024-09-17T03:37:44.106856+0000","last_peered":"2024-09-17T03:37:44.106856+0000","last_clean":"2024-09-17T03:37:44.106856+0000","last_became_active":"2024-09-17T03:37:44.102263+0000","last_became_peered":"2024-09-17T03:37:44.102263+0000","last_unstale":"2024-09-17T03:37:44.106856+0000","last_undegraded":"2024-09-17T03:37:44.106856+0000","last_fullsized":"2024-09-17T03:37:44.106856+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:37.293968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112118+0000","last_change":"2024-09-17T03:37:44.107433+0000","last_active":"2024-09-17T03:37:44.112118+0000","last_peered":"2024-09-17T03:37:44.112118+0000","last_clean":"2024-09-17T03:37:44.112118+0000","last_became_active":"2024-09-17T03:37:44.107073+0000","last_became_peered":"2024-09-17T03:37:44.107073+0000","last_unstale":"2024-09-17T03:37:44.112118+0000","last_undegraded":"2024-09-17T03:37:44.112118+0000","last_fullsized":"2024-09-17T03:37:44.112118+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:15.991292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093270+0000","last_change":"2024-09-17T03:37:44.088746+0000","last_active":"2024-09-17T03:37:44.093270+0000","last_peered":"2024-09-17T03:37:44.093270+0000","last_clean":"2024-09-17T03:37:44.093270+0000","last_became_active":"2024-09-17T03:37:44.088418+0000","last_became_peered":"2024-09-17T03:37:44.088418+0000","last_unstale":"2024-09-17T03:37:44.093270+0000","last_undegraded":"2024-09-17T03:37:44.093270+0000","last_fullsized":"2024-09-17T03:37:44.093270+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:34.571919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.100210+0000","last_change":"2024-09-17T03:37:44.095559+0000","last_active":"2024-09-17T03:37:44.100210+0000","last_peered":"2024-09-17T03:37:44.100210+0000","last_clean":"2024-09-17T03:37:44.100210+0000","last_became_active":"2024-09-17T03:37:44.095256+0000","last_became_peered":"2024-09-17T03:37:44.095256+0000","last_unstale":"2024-09-17T03:37:44.100210+0000","last_undegraded":"2024-09-17T03:37:44.100210+0000","last_fullsized":"2024-09-17T03:37:44.100210+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:32.028535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.100891+0000","last_change":"2024-09-17T03:37:44.098083+0000","last_active":"2024-09-17T03:37:44.100891+0000","last_peered":"2024-09-17T03:37:44.100891+0000","last_clean":"2024-09-17T03:37:44.100891+0000","last_became_active":"2024-09-17T03:37:44.097792+0000","last_became_peered":"2024-09-17T03:37:44.097792+0000","last_unstale":"2024-09-17T03:37:44.100891+0000","last_undegraded":"2024-09-17T03:37:44.100891+0000","last_fullsized":"2024-09-17T03:37:44.100891+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:36.272159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093254+0000","last_change":"2024-09-17T03:37:44.091256+0000","last_active":"2024-09-17T03:37:44.093254+0000","last_peered":"2024-09-17T03:37:44.093254+0000","last_clean":"2024-09-17T03:37:44.093254+0000","last_became_active":"2024-09-17T03:37:44.090861+0000","last_became_peered":"2024-09-17T03:37:44.090861+0000","last_unstale":"2024-09-17T03:37:44.093254+0000","last_undegraded":"2024-09-17T03:37:44.093254+0000","last_fullsized":"2024-09-17T03:37:44.093254+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:23.444929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.101149+0000","last_change":"2024-09-17T03:37:44.096395+0000","last_active":"2024-09-17T03:37:44.101149+0000","last_peered":"2024-09-17T03:37:44.101149+0000","last_clean":"2024-09-17T03:37:44.101149+0000","last_became_active":"2024-09-17T03:37:44.095686+0000","last_became_peered":"2024-09-17T03:37:44.095686+0000","last_unstale":"2024-09-17T03:37:44.101149+0000","last_undegraded":"2024-09-17T03:37:44.101149+0000","last_fullsized":"2024-09-17T03:37:44.101149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:11.506339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.101776+0000","last_change":"2024-09-17T03:37:44.091782+0000","last_active":"2024-09-17T03:37:44.101776+0000","last_peered":"2024-09-17T03:37:44.101776+0000","last_clean":"2024-09-17T03:37:44.101776+0000","last_became_active":"2024-09-17T03:37:44.091465+0000","last_became_peered":"2024-09-17T03:37:44.091465+0000","last_unstale":"2024-09-17T03:37:44.101776+0000","last_undegraded":"2024-09-17T03:37:44.101776+0000","last_fullsized":"2024-09-17T03:37:44.101776+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:54.117975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.103096+0000","last_change":"2024-09-17T03:37:44.100306+0000","last_active":"2024-09-17T03:37:44.103096+0000","last_peered":"2024-09-17T03:37:44.103096+0000","last_clean":"2024-09-17T03:37:44.103096+0000","last_became_active":"2024-09-17T03:37:44.099180+0000","last_became_peered":"2024-09-17T03:37:44.099180+0000","last_unstale":"2024-09-17T03:37:44.103096+0000","last_undegraded":"2024-09-17T03:37:44.103096+0000","last_fullsized":"2024-09-17T03:37:44.103096+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:54.687063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093405+0000","last_change":"2024-09-17T03:37:44.090051+0000","last_active":"2024-09-17T03:37:44.093405+0000","last_peered":"2024-09-17T03:37:44.093405+0000","last_clean":"2024-09-17T03:37:44.093405+0000","last_became_active":"2024-09-17T03:37:44.089763+0000","last_became_peered":"2024-09-17T03:37:44.089763+0000","last_unstale":"2024-09-17T03:37:44.093405+0000","last_undegraded":"2024-09-17T03:37:44.093405+0000","last_fullsized":"2024-09-17T03:37:44.093405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:50.943642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.100301+0000","last_change":"2024-09-17T03:37:44.099240+0000","last_active":"2024-09-17T03:37:44.100301+0000","last_peered":"2024-09-17T03:37:44.100301+0000","last_clean":"2024-09-17T03:37:44.100301+0000","last_became_active":"2024-09-17T03:37:44.098922+0000","last_became_peered":"2024-09-17T03:37:44.098922+0000","last_unstale":"2024-09-17T03:37:44.100301+0000","last_undegraded":"2024-09-17T03:37:44.100301+0000","last_fullsized":"2024-09-17T03:37:44.100301+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:17.280954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106904+0000","last_change":"2024-09-17T03:37:44.100525+0000","last_active":"2024-09-17T03:37:44.106904+0000","last_peered":"2024-09-17T03:37:44.106904+0000","last_clean":"2024-09-17T03:37:44.106904+0000","last_became_active":"2024-09-17T03:37:44.100232+0000","last_became_peered":"2024-09-17T03:37:44.100232+0000","last_unstale":"2024-09-17T03:37:44.106904+0000","last_undegraded":"2024-09-17T03:37:44.106904+0000","last_fullsized":"2024-09-17T03:37:44.106904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.559816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.108145+0000","last_change":"2024-09-17T03:37:44.106347+0000","last_active":"2024-09-17T03:37:44.108145+0000","last_peered":"2024-09-17T03:37:44.108145+0000","last_clean":"2024-09-17T03:37:44.108145+0000","last_became_active":"2024-09-17T03:37:44.105500+0000","last_became_peered":"2024-09-17T03:37:44.105500+0000","last_unstale":"2024-09-17T03:37:44.108145+0000","last_undegraded":"2024-09-17T03:37:44.108145+0000","last_fullsized":"2024-09-17T03:37:44.108145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:08.254699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.105967+0000","last_change":"2024-09-17T03:37:44.101407+0000","last_active":"2024-09-17T03:37:44.105967+0000","last_peered":"2024-09-17T03:37:44.105967+0000","last_clean":"2024-09-17T03:37:44.105967+0000","last_became_active":"2024-09-17T03:37:44.101060+0000","last_became_peered":"2024-09-17T03:37:44.101060+0000","last_unstale":"2024-09-17T03:37:44.105967+0000","last_undegraded":"2024-09-17T03:37:44.105967+0000","last_fullsized":"2024-09-17T03:37:44.105967+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:55.716448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093474+0000","last_change":"2024-09-17T03:37:44.090135+0000","last_active":"2024-09-17T03:37:44.093474+0000","last_peered":"2024-09-17T03:37:44.093474+0000","last_clean":"2024-09-17T03:37:44.093474+0000","last_became_active":"2024-09-17T03:37:44.089333+0000","last_became_peered":"2024-09-17T03:37:44.089333+0000","last_unstale":"2024-09-17T03:37:44.093474+0000","last_undegraded":"2024-09-17T03:37:44.093474+0000","last_fullsized":"2024-09-17T03:37:44.093474+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.939946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106994+0000","last_change":"2024-09-17T03:37:44.103363+0000","last_active":"2024-09-17T03:37:44.106994+0000","last_peered":"2024-09-17T03:37:44.106994+0000","last_clean":"2024-09-17T03:37:44.106994+0000","last_became_active":"2024-09-17T03:37:44.103043+0000","last_became_peered":"2024-09-17T03:37:44.103043+0000","last_unstale":"2024-09-17T03:37:44.106994+0000","last_undegraded":"2024-09-17T03:37:44.106994+0000","last_fullsized":"2024-09-17T03:37:44.106994+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:43.979074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.104228+0000","last_change":"2024-09-17T03:37:44.098601+0000","last_active":"2024-09-17T03:37:44.104228+0000","last_peered":"2024-09-17T03:37:44.104228+0000","last_clean":"2024-09-17T03:37:44.104228+0000","last_became_active":"2024-09-17T03:37:44.098272+0000","last_became_peered":"2024-09-17T03:37:44.098272+0000","last_unstale":"2024-09-17T03:37:44.104228+0000","last_undegraded":"2024-09-17T03:37:44.104228+0000","last_fullsized":"2024-09-17T03:37:44.104228+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:37.234077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.109577+0000","last_change":"2024-09-17T03:37:44.105912+0000","last_active":"2024-09-17T03:37:44.109577+0000","last_peered":"2024-09-17T03:37:44.109577+0000","last_clean":"2024-09-17T03:37:44.109577+0000","last_became_active":"2024-09-17T03:37:44.105559+0000","last_became_peered":"2024-09-17T03:37:44.105559+0000","last_unstale":"2024-09-17T03:37:44.109577+0000","last_undegraded":"2024-09-17T03:37:44.109577+0000","last_fullsized":"2024-09-17T03:37:44.109577+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:35.638102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"87'4","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112715+0000","last_change":"2024-09-17T03:37:43.074302+0000","last_active":"2024-09-17T03:37:44.112715+0000","last_peered":"2024-09-17T03:37:44.112715+0000","last_clean":"2024-09-17T03:37:44.112715+0000","last_became_active":"2024-09-17T03:37:43.073881+0000","last_became_peered":"2024-09-17T03:37:43.073881+0000","last_unstale":"2024-09-17T03:37:44.112715+0000","last_undegraded":"2024-09-17T03:37:44.112715+0000","last_fullsized":"2024-09-17T03:37:44.112715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:54.499982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.102197+0000","last_change":"2024-09-17T03:37:44.094142+0000","last_active":"2024-09-17T03:37:44.102197+0000","last_peered":"2024-09-17T03:37:44.102197+0000","last_clean":"2024-09-17T03:37:44.102197+0000","last_became_active":"2024-09-17T03:37:44.093800+0000","last_became_peered":"2024-09-17T03:37:44.093800+0000","last_unstale":"2024-09-17T03:37:44.102197+0000","last_undegraded":"2024-09-17T03:37:44.102197+0000","last_fullsized":"2024-09-17T03:37:44.102197+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:33.612077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106734+0000","last_change":"2024-09-17T03:37:43.083801+0000","last_active":"2024-09-17T03:37:44.106734+0000","last_peered":"2024-09-17T03:37:44.106734+0000","last_clean":"2024-09-17T03:37:44.106734+0000","last_became_active":"2024-09-17T03:37:43.083072+0000","last_became_peered":"2024-09-17T03:37:43.083072+0000","last_unstale":"2024-09-17T03:37:44.106734+0000","last_undegraded":"2024-09-17T03:37:44.106734+0000","last_fullsized":"2024-09-17T03:37:44.106734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:40.879393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.102049+0000","last_change":"2024-09-17T03:37:44.094802+0000","last_active":"2024-09-17T03:37:44.102049+0000","last_peered":"2024-09-17T03:37:44.102049+0000","last_clean":"2024-09-17T03:37:44.102049+0000","last_became_active":"2024-09-17T03:37:44.094510+0000","last_became_peered":"2024-09-17T03:37:44.094510+0000","last_unstale":"2024-09-17T03:37:44.102049+0000","last_undegraded":"2024-09-17T03:37:44.102049+0000","last_fullsized":"2024-09-17T03:37:44.102049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:59.354352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112513+0000","last_change":"2024-09-17T03:37:43.081180+0000","last_active":"2024-09-17T03:37:44.112513+0000","last_peered":"2024-09-17T03:37:44.112513+0000","last_clean":"2024-09-17T03:37:44.112513+0000","last_became_active":"2024-09-17T03:37:43.080887+0000","last_became_peered":"2024-09-17T03:37:43.080887+0000","last_unstale":"2024-09-17T03:37:44.112513+0000","last_undegraded":"2024-09-17T03:37:44.112513+0000","last_fullsized":"2024-09-17T03:37:44.112513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:42.972884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098175+0000","last_change":"2024-09-17T03:37:44.093608+0000","last_active":"2024-09-17T03:37:44.098175+0000","last_peered":"2024-09-17T03:37:44.098175+0000","last_clean":"2024-09-17T03:37:44.098175+0000","last_became_active":"2024-09-17T03:37:44.093297+0000","last_became_peered":"2024-09-17T03:37:44.093297+0000","last_unstale":"2024-09-17T03:37:44.098175+0000","last_undegraded":"2024-09-17T03:37:44.098175+0000","last_fullsized":"2024-09-17T03:37:44.098175+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:28.096100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"87'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112690+0000","last_change":"2024-09-17T03:37:43.082252+0000","last_active":"2024-09-17T03:37:44.112690+0000","last_peered":"2024-09-17T03:37:44.112690+0000","last_clean":"2024-09-17T03:37:44.112690+0000","last_became_active":"2024-09-17T03:37:43.081564+0000","last_became_peered":"2024-09-17T03:37:43.081564+0000","last_unstale":"2024-09-17T03:37:44.112690+0000","last_undegraded":"2024-09-17T03:37:44.112690+0000","last_fullsized":"2024-09-17T03:37:44.112690+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:47.847292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093447+0000","last_change":"2024-09-17T03:37:44.089644+0000","last_active":"2024-09-17T03:37:44.093447+0000","last_peered":"2024-09-17T03:37:44.093447+0000","last_clean":"2024-09-17T03:37:44.093447+0000","last_became_active":"2024-09-17T03:37:44.088950+0000","last_became_peered":"2024-09-17T03:37:44.088950+0000","last_unstale":"2024-09-17T03:37:44.093447+0000","last_undegraded":"2024-09-17T03:37:44.093447+0000","last_fullsized":"2024-09-17T03:37:44.093447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:53.069978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.109120+0000","last_change":"2024-09-17T03:37:43.080554+0000","last_active":"2024-09-17T03:37:44.109120+0000","last_peered":"2024-09-17T03:37:44.109120+0000","last_clean":"2024-09-17T03:37:44.109120+0000","last_became_active":"2024-09-17T03:37:43.080014+0000","last_became_peered":"2024-09-17T03:37:43.080014+0000","last_unstale":"2024-09-17T03:37:44.109120+0000","last_undegraded":"2024-09-17T03:37:44.109120+0000","last_fullsized":"2024-09-17T03:37:44.109120+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:04.513094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.107009+0000","last_change":"2024-09-17T03:37:44.104073+0000","last_active":"2024-09-17T03:37:44.107009+0000","last_peered":"2024-09-17T03:37:44.107009+0000","last_clean":"2024-09-17T03:37:44.107009+0000","last_became_active":"2024-09-17T03:37:44.103752+0000","last_became_peered":"2024-09-17T03:37:44.103752+0000","last_unstale":"2024-09-17T03:37:44.107009+0000","last_undegraded":"2024-09-17T03:37:44.107009+0000","last_fullsized":"2024-09-17T03:37:44.107009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:20.422849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106635+0000","last_change":"2024-09-17T03:37:43.083649+0000","last_active":"2024-09-17T03:37:44.106635+0000","last_peered":"2024-09-17T03:37:44.106635+0000","last_clean":"2024-09-17T03:37:44.106635+0000","last_became_active":"2024-09-17T03:37:43.083312+0000","last_became_peered":"2024-09-17T03:37:43.083312+0000","last_unstale":"2024-09-17T03:37:44.106635+0000","last_undegraded":"2024-09-17T03:37:44.106635+0000","last_fullsized":"2024-09-17T03:37:44.106635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:04.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098550+0000","last_change":"2024-09-17T03:37:44.094597+0000","last_active":"2024-09-17T03:37:44.098550+0000","last_peered":"2024-09-17T03:37:44.098550+0000","last_clean":"2024-09-17T03:37:44.098550+0000","last_became_active":"2024-09-17T03:37:44.094342+0000","last_became_peered":"2024-09-17T03:37:44.094342+0000","last_unstale":"2024-09-17T03:37:44.098550+0000","last_undegraded":"2024-09-17T03:37:44.098550+0000","last_fullsized":"2024-09-17T03:37:44.098550+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:44.065416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.080793+0000","last_change":"2024-09-17T03:37:43.078784+0000","last_active":"2024-09-17T03:37:44.080793+0000","last_peered":"2024-09-17T03:37:44.080793+0000","last_clean":"2024-09-17T03:37:44.080793+0000","last_became_active":"2024-09-17T03:37:43.078385+0000","last_became_peered":"2024-09-17T03:37:43.078385+0000","last_unstale":"2024-09-17T03:37:44.080793+0000","last_undegraded":"2024-09-17T03:37:44.080793+0000","last_fullsized":"2024-09-17T03:37:44.080793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:25.003657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544493+0000","last_change":"2024-09-17T03:37:44.086536+0000","last_active":"2024-09-17T03:37:45.544493+0000","last_peered":"2024-09-17T03:37:45.544493+0000","last_clean":"2024-09-17T03:37:45.544493+0000","last_became_active":"2024-09-17T03:37:44.086167+0000","last_became_peered":"2024-09-17T03:37:44.086167+0000","last_unstale":"2024-09-17T03:37:45.544493+0000","last_undegraded":"2024-09-17T03:37:45.544493+0000","last_fullsized":"2024-09-17T03:37:45.544493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:02.911294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.083596+0000","last_change":"2024-09-17T03:37:43.080632+0000","last_active":"2024-09-17T03:37:44.083596+0000","last_peered":"2024-09-17T03:37:44.083596+0000","last_clean":"2024-09-17T03:37:44.083596+0000","last_became_active":"2024-09-17T03:37:43.080264+0000","last_became_peered":"2024-09-17T03:37:43.080264+0000","last_unstale":"2024-09-17T03:37:44.083596+0000","last_undegraded":"2024-09-17T03:37:44.083596+0000","last_fullsized":"2024-09-17T03:37:44.083596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:44.487384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544755+0000","last_change":"2024-09-17T03:37:44.091930+0000","last_active":"2024-09-17T03:37:45.544755+0000","last_peered":"2024-09-17T03:37:45.544755+0000","last_clean":"2024-09-17T03:37:45.544755+0000","last_became_active":"2024-09-17T03:37:44.091624+0000","last_became_peered":"2024-09-17T03:37:44.091624+0000","last_unstale":"2024-09-17T03:37:45.544755+0000","last_undegraded":"2024-09-17T03:37:45.544755+0000","last_fullsized":"2024-09-17T03:37:45.544755+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:57.946065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.084613+0000","last_change":"2024-09-17T03:37:43.076322+0000","last_active":"2024-09-17T03:37:44.084613+0000","last_peered":"2024-09-17T03:37:44.084613+0000","last_clean":"2024-09-17T03:37:44.084613+0000","last_became_active":"2024-09-17T03:37:43.074095+0000","last_became_peered":"2024-09-17T03:37:43.074095+0000","last_unstale":"2024-09-17T03:37:44.084613+0000","last_undegraded":"2024-09-17T03:37:44.084613+0000","last_fullsized":"2024-09-17T03:37:44.084613+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:32.992597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463538+0000","last_change":"2024-09-17T03:37:44.093625+0000","last_active":"2024-09-17T03:37:45.463538+0000","last_peered":"2024-09-17T03:37:45.463538+0000","last_clean":"2024-09-17T03:37:45.463538+0000","last_became_active":"2024-09-17T03:37:44.093288+0000","last_became_peered":"2024-09-17T03:37:44.093288+0000","last_unstale":"2024-09-17T03:37:45.463538+0000","last_undegraded":"2024-09-17T03:37:45.463538+0000","last_fullsized":"2024-09-17T03:37:45.463538+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:31.974418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.081560+0000","last_change":"2024-09-17T03:37:43.079008+0000","last_active":"2024-09-17T03:37:44.081560+0000","last_peered":"2024-09-17T03:37:44.081560+0000","last_clean":"2024-09-17T03:37:44.081560+0000","last_became_active":"2024-09-17T03:37:43.078669+0000","last_became_peered":"2024-09-17T03:37:43.078669+0000","last_unstale":"2024-09-17T03:37:44.081560+0000","last_undegraded":"2024-09-17T03:37:44.081560+0000","last_fullsized":"2024-09-17T03:37:44.081560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:35.305660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.091652+0000","last_change":"2024-09-17T03:37:44.089938+0000","last_active":"2024-09-17T03:37:44.091652+0000","last_peered":"2024-09-17T03:37:44.091652+0000","last_clean":"2024-09-17T03:37:44.091652+0000","last_became_active":"2024-09-17T03:37:44.089631+0000","last_became_peered":"2024-09-17T03:37:44.089631+0000","last_unstale":"2024-09-17T03:37:44.091652+0000","last_undegraded":"2024-09-17T03:37:44.091652+0000","last_fullsized":"2024-09-17T03:37:44.091652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:15.900840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"87'3","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.113090+0000","last_change":"2024-09-17T03:37:43.078933+0000","last_active":"2024-09-17T03:37:44.113090+0000","last_peered":"2024-09-17T03:37:44.113090+0000","last_clean":"2024-09-17T03:37:44.113090+0000","last_became_active":"2024-09-17T03:37:43.078547+0000","last_became_peered":"2024-09-17T03:37:43.078547+0000","last_unstale":"2024-09-17T03:37:44.113090+0000","last_undegraded":"2024-09-17T03:37:44.113090+0000","last_fullsized":"2024-09-17T03:37:44.113090+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:28.861428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106875+0000","last_change":"2024-09-17T03:37:44.099816+0000","last_active":"2024-09-17T03:37:44.106875+0000","last_peered":"2024-09-17T03:37:44.106875+0000","last_clean":"2024-09-17T03:37:44.106875+0000","last_became_active":"2024-09-17T03:37:44.099408+0000","last_became_peered":"2024-09-17T03:37:44.099408+0000","last_unstale":"2024-09-17T03:37:44.106875+0000","last_undegraded":"2024-09-17T03:37:44.106875+0000","last_fullsized":"2024-09-17T03:37:44.106875+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:40.057482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"87'6","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463368+0000","last_change":"2024-09-17T03:37:43.073464+0000","last_active":"2024-09-17T03:37:45.463368+0000","last_peered":"2024-09-17T03:37:45.463368+0000","last_clean":"2024-09-17T03:37:45.463368+0000","last_became_active":"2024-09-17T03:37:43.072996+0000","last_became_peered":"2024-09-17T03:37:43.072996+0000","last_unstale":"2024-09-17T03:37:45.463368+0000","last_undegraded":"2024-09-17T03:37:45.463368+0000","last_fullsized":"2024-09-17T03:37:45.463368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:17.956546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106235+0000","last_change":"2024-09-17T03:37:44.105334+0000","last_active":"2024-09-17T03:37:44.106235+0000","last_peered":"2024-09-17T03:37:44.106235+0000","last_clean":"2024-09-17T03:37:44.106235+0000","last_became_active":"2024-09-17T03:37:44.104467+0000","last_became_peered":"2024-09-17T03:37:44.104467+0000","last_unstale":"2024-09-17T03:37:44.106235+0000","last_undegraded":"2024-09-17T03:37:44.106235+0000","last_fullsized":"2024-09-17T03:37:44.106235+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:17.106513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"87'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.111350+0000","last_change":"2024-09-17T03:37:43.081673+0000","last_active":"2024-09-17T03:37:44.111350+0000","last_peered":"2024-09-17T03:37:44.111350+0000","last_clean":"2024-09-17T03:37:44.111350+0000","last_became_active":"2024-09-17T03:37:43.081164+0000","last_became_peered":"2024-09-17T03:37:43.081164+0000","last_unstale":"2024-09-17T03:37:44.111350+0000","last_undegraded":"2024-09-17T03:37:44.111350+0000","last_fullsized":"2024-09-17T03:37:44.111350+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:43.071755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098497+0000","last_change":"2024-09-17T03:37:44.095378+0000","last_active":"2024-09-17T03:37:44.098497+0000","last_peered":"2024-09-17T03:37:44.098497+0000","last_clean":"2024-09-17T03:37:44.098497+0000","last_became_active":"2024-09-17T03:37:44.095100+0000","last_became_peered":"2024-09-17T03:37:44.095100+0000","last_unstale":"2024-09-17T03:37:44.098497+0000","last_undegraded":"2024-09-17T03:37:44.098497+0000","last_fullsized":"2024-09-17T03:37:44.098497+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:32.491921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544389+0000","last_change":"2024-09-17T03:37:43.078733+0000","last_active":"2024-09-17T03:37:45.544389+0000","last_peered":"2024-09-17T03:37:45.544389+0000","last_clean":"2024-09-17T03:37:45.544389+0000","last_became_active":"2024-09-17T03:37:43.078292+0000","last_became_peered":"2024-09-17T03:37:43.078292+0000","last_unstale":"2024-09-17T03:37:45.544389+0000","last_undegraded":"2024-09-17T03:37:45.544389+0000","last_fullsized":"2024-09-17T03:37:45.544389+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:58.361913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.100068+0000","last_change":"2024-09-17T03:37:44.095166+0000","last_active":"2024-09-17T03:37:44.100068+0000","last_peered":"2024-09-17T03:37:44.100068+0000","last_clean":"2024-09-17T03:37:44.100068+0000","last_became_active":"2024-09-17T03:37:44.094865+0000","last_became_peered":"2024-09-17T03:37:44.094865+0000","last_unstale":"2024-09-17T03:37:44.100068+0000","last_undegraded":"2024-09-17T03:37:44.100068+0000","last_fullsized":"2024-09-17T03:37:44.100068+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:22.683930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463474+0000","last_change":"2024-09-17T03:37:43.083234+0000","last_active":"2024-09-17T03:37:45.463474+0000","last_peered":"2024-09-17T03:37:45.463474+0000","last_clean":"2024-09-17T03:37:45.463474+0000","last_became_active":"2024-09-17T03:37:43.082742+0000","last_became_peered":"2024-09-17T03:37:43.082742+0000","last_unstale":"2024-09-17T03:37:45.463474+0000","last_undegraded":"2024-09-17T03:37:45.463474+0000","last_fullsized":"2024-09-17T03:37:45.463474+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:39.356845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.097159+0000","last_change":"2024-09-17T03:37:44.094347+0000","last_active":"2024-09-17T03:37:44.097159+0000","last_peered":"2024-09-17T03:37:44.097159+0000","last_clean":"2024-09-17T03:37:44.097159+0000","last_became_active":"2024-09-17T03:37:44.094007+0000","last_became_peered":"2024-09-17T03:37:44.094007+0000","last_unstale":"2024-09-17T03:37:44.097159+0000","last_undegraded":"2024-09-17T03:37:44.097159+0000","last_fullsized":"2024-09-17T03:37:44.097159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:58.317507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"87'8","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.115208+0000","last_change":"2024-09-17T03:37:43.079520+0000","last_active":"2024-09-17T03:37:44.115208+0000","last_peered":"2024-09-17T03:37:44.115208+0000","last_clean":"2024-09-17T03:37:44.115208+0000","last_became_active":"2024-09-17T03:37:43.079207+0000","last_became_peered":"2024-09-17T03:37:43.079207+0000","last_unstale":"2024-09-17T03:37:44.115208+0000","last_undegraded":"2024-09-17T03:37:44.115208+0000","last_fullsized":"2024-09-17T03:37:44.115208+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:36.287778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098127+0000","last_change":"2024-09-17T03:37:44.091658+0000","last_active":"2024-09-17T03:37:44.098127+0000","last_peered":"2024-09-17T03:37:44.098127+0000","last_clean":"2024-09-17T03:37:44.098127+0000","last_became_active":"2024-09-17T03:37:44.091314+0000","last_became_peered":"2024-09-17T03:37:44.091314+0000","last_unstale":"2024-09-17T03:37:44.098127+0000","last_undegraded":"2024-09-17T03:37:44.098127+0000","last_fullsized":"2024-09-17T03:37:44.098127+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:35.035453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.112628+0000","last_change":"2024-09-17T03:37:43.072647+0000","last_active":"2024-09-17T03:37:44.112628+0000","last_peered":"2024-09-17T03:37:44.112628+0000","last_clean":"2024-09-17T03:37:44.112628+0000","last_became_active":"2024-09-17T03:37:43.072305+0000","last_became_peered":"2024-09-17T03:37:43.072305+0000","last_unstale":"2024-09-17T03:37:44.112628+0000","last_undegraded":"2024-09-17T03:37:44.112628+0000","last_fullsized":"2024-09-17T03:37:44.112628+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:23.732825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.089909+0000","last_change":"2024-09-17T03:37:44.088245+0000","last_active":"2024-09-17T03:37:44.089909+0000","last_peered":"2024-09-17T03:37:44.089909+0000","last_clean":"2024-09-17T03:37:44.089909+0000","last_became_active":"2024-09-17T03:37:44.087873+0000","last_became_peered":"2024-09-17T03:37:44.087873+0000","last_unstale":"2024-09-17T03:37:44.089909+0000","last_undegraded":"2024-09-17T03:37:44.089909+0000","last_fullsized":"2024-09-17T03:37:44.089909+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:05.156434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.114956+0000","last_change":"2024-09-17T03:37:43.082830+0000","last_active":"2024-09-17T03:37:44.114956+0000","last_peered":"2024-09-17T03:37:44.114956+0000","last_clean":"2024-09-17T03:37:44.114956+0000","last_became_active":"2024-09-17T03:37:43.080627+0000","last_became_peered":"2024-09-17T03:37:43.080627+0000","last_unstale":"2024-09-17T03:37:44.114956+0000","last_undegraded":"2024-09-17T03:37:44.114956+0000","last_fullsized":"2024-09-17T03:37:44.114956+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:19.416659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.109652+0000","last_change":"2024-09-17T03:37:44.104822+0000","last_active":"2024-09-17T03:37:44.109652+0000","last_peered":"2024-09-17T03:37:44.109652+0000","last_clean":"2024-09-17T03:37:44.109652+0000","last_became_active":"2024-09-17T03:37:44.104517+0000","last_became_peered":"2024-09-17T03:37:44.104517+0000","last_unstale":"2024-09-17T03:37:44.109652+0000","last_undegraded":"2024-09-17T03:37:44.109652+0000","last_fullsized":"2024-09-17T03:37:44.109652+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:48.853482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.082500+0000","last_change":"2024-09-17T03:37:43.078794+0000","last_active":"2024-09-17T03:37:44.082500+0000","last_peered":"2024-09-17T03:37:44.082500+0000","last_clean":"2024-09-17T03:37:44.082500+0000","last_became_active":"2024-09-17T03:37:43.078487+0000","last_became_peered":"2024-09-17T03:37:43.078487+0000","last_unstale":"2024-09-17T03:37:44.082500+0000","last_undegraded":"2024-09-17T03:37:44.082500+0000","last_fullsized":"2024-09-17T03:37:44.082500+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.631912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.102319+0000","last_change":"2024-09-17T03:37:44.097206+0000","last_active":"2024-09-17T03:37:44.102319+0000","last_peered":"2024-09-17T03:37:44.102319+0000","last_clean":"2024-09-17T03:37:44.102319+0000","last_became_active":"2024-09-17T03:37:44.096442+0000","last_became_peered":"2024-09-17T03:37:44.096442+0000","last_unstale":"2024-09-17T03:37:44.102319+0000","last_undegraded":"2024-09-17T03:37:44.102319+0000","last_fullsized":"2024-09-17T03:37:44.102319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:10.175021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"87'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544535+0000","last_change":"2024-09-17T03:37:43.074982+0000","last_active":"2024-09-17T03:37:45.544535+0000","last_peered":"2024-09-17T03:37:45.544535+0000","last_clean":"2024-09-17T03:37:45.544535+0000","last_became_active":"2024-09-17T03:37:43.074615+0000","last_became_peered":"2024-09-17T03:37:43.074615+0000","last_unstale":"2024-09-17T03:37:45.544535+0000","last_undegraded":"2024-09-17T03:37:45.544535+0000","last_fullsized":"2024-09-17T03:37:45.544535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:46.903215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463503+0000","last_change":"2024-09-17T03:37:44.092073+0000","last_active":"2024-09-17T03:37:45.463503+0000","last_peered":"2024-09-17T03:37:45.463503+0000","last_clean":"2024-09-17T03:37:45.463503+0000","last_became_active":"2024-09-17T03:37:44.091437+0000","last_became_peered":"2024-09-17T03:37:44.091437+0000","last_unstale":"2024-09-17T03:37:45.463503+0000","last_undegraded":"2024-09-17T03:37:45.463503+0000","last_fullsized":"2024-09-17T03:37:45.463503+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:09.968801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.082176+0000","last_change":"2024-09-17T03:37:43.075755+0000","last_active":"2024-09-17T03:37:44.082176+0000","last_peered":"2024-09-17T03:37:44.082176+0000","last_clean":"2024-09-17T03:37:44.082176+0000","last_became_active":"2024-09-17T03:37:43.074780+0000","last_became_peered":"2024-09-17T03:37:43.074780+0000","last_unstale":"2024-09-17T03:37:44.082176+0000","last_undegraded":"2024-09-17T03:37:44.082176+0000","last_fullsized":"2024-09-17T03:37:44.082176+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:52.579091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.094171+0000","last_change":"2024-09-17T03:37:44.092607+0000","last_active":"2024-09-17T03:37:44.094171+0000","last_peered":"2024-09-17T03:37:44.094171+0000","last_clean":"2024-09-17T03:37:44.094171+0000","last_became_active":"2024-09-17T03:37:44.092296+0000","last_became_peered":"2024-09-17T03:37:44.092296+0000","last_unstale":"2024-09-17T03:37:44.094171+0000","last_undegraded":"2024-09-17T03:37:44.094171+0000","last_fullsized":"2024-09-17T03:37:44.094171+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:59.037456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.081117+0000","last_change":"2024-09-17T03:37:43.077047+0000","last_active":"2024-09-17T03:37:44.081117+0000","last_peered":"2024-09-17T03:37:44.081117+0000","last_clean":"2024-09-17T03:37:44.081117+0000","last_became_active":"2024-09-17T03:37:43.076471+0000","last_became_peered":"2024-09-17T03:37:43.076471+0000","last_unstale":"2024-09-17T03:37:44.081117+0000","last_undegraded":"2024-09-17T03:37:44.081117+0000","last_fullsized":"2024-09-17T03:37:44.081117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:13.746113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463362+0000","last_change":"2024-09-17T03:37:44.098601+0000","last_active":"2024-09-17T03:37:45.463362+0000","last_peered":"2024-09-17T03:37:45.463362+0000","last_clean":"2024-09-17T03:37:45.463362+0000","last_became_active":"2024-09-17T03:37:44.098292+0000","last_became_peered":"2024-09-17T03:37:44.098292+0000","last_unstale":"2024-09-17T03:37:45.463362+0000","last_undegraded":"2024-09-17T03:37:45.463362+0000","last_fullsized":"2024-09-17T03:37:45.463362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:08.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.544250+0000","last_change":"2024-09-17T03:37:43.073634+0000","last_active":"2024-09-17T03:37:45.544250+0000","last_peered":"2024-09-17T03:37:45.544250+0000","last_clean":"2024-09-17T03:37:45.544250+0000","last_became_active":"2024-09-17T03:37:43.073329+0000","last_became_peered":"2024-09-17T03:37:43.073329+0000","last_unstale":"2024-09-17T03:37:45.544250+0000","last_undegraded":"2024-09-17T03:37:45.544250+0000","last_fullsized":"2024-09-17T03:37:45.544250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:37.920574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.114635+0000","last_change":"2024-09-17T03:37:44.109337+0000","last_active":"2024-09-17T03:37:44.114635+0000","last_peered":"2024-09-17T03:37:44.114635+0000","last_clean":"2024-09-17T03:37:44.114635+0000","last_became_active":"2024-09-17T03:37:44.108734+0000","last_became_peered":"2024-09-17T03:37:44.108734+0000","last_unstale":"2024-09-17T03:37:44.114635+0000","last_undegraded":"2024-09-17T03:37:44.114635+0000","last_fullsized":"2024-09-17T03:37:44.114635+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:32.028535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"87'2","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.109580+0000","last_change":"2024-09-17T03:37:43.081946+0000","last_active":"2024-09-17T03:37:44.109580+0000","last_peered":"2024-09-17T03:37:44.109580+0000","last_clean":"2024-09-17T03:37:44.109580+0000","last_became_active":"2024-09-17T03:37:43.081603+0000","last_became_peered":"2024-09-17T03:37:43.081603+0000","last_unstale":"2024-09-17T03:37:44.109580+0000","last_undegraded":"2024-09-17T03:37:44.109580+0000","last_fullsized":"2024-09-17T03:37:44.109580+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:49.720313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098149+0000","last_change":"2024-09-17T03:37:44.091170+0000","last_active":"2024-09-17T03:37:44.098149+0000","last_peered":"2024-09-17T03:37:44.098149+0000","last_clean":"2024-09-17T03:37:44.098149+0000","last_became_active":"2024-09-17T03:37:44.090825+0000","last_became_peered":"2024-09-17T03:37:44.090825+0000","last_unstale":"2024-09-17T03:37:44.098149+0000","last_undegraded":"2024-09-17T03:37:44.098149+0000","last_fullsized":"2024-09-17T03:37:44.098149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:38.767185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.083383+0000","last_change":"2024-09-17T03:37:43.084594+0000","last_active":"2024-09-17T03:37:44.083383+0000","last_peered":"2024-09-17T03:37:44.083383+0000","last_clean":"2024-09-17T03:37:44.083383+0000","last_became_active":"2024-09-17T03:37:43.084239+0000","last_became_peered":"2024-09-17T03:37:43.084239+0000","last_unstale":"2024-09-17T03:37:44.083383+0000","last_undegraded":"2024-09-17T03:37:44.083383+0000","last_fullsized":"2024-09-17T03:37:44.083383+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:27.587780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.093095+0000","last_change":"2024-09-17T03:37:44.089231+0000","last_active":"2024-09-17T03:37:44.093095+0000","last_peered":"2024-09-17T03:37:44.093095+0000","last_clean":"2024-09-17T03:37:44.093095+0000","last_became_active":"2024-09-17T03:37:44.088885+0000","last_became_peered":"2024-09-17T03:37:44.088885+0000","last_unstale":"2024-09-17T03:37:44.093095+0000","last_undegraded":"2024-09-17T03:37:44.093095+0000","last_fullsized":"2024-09-17T03:37:44.093095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:47.932733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.082726+0000","last_change":"2024-09-17T03:37:43.069873+0000","last_active":"2024-09-17T03:37:44.082726+0000","last_peered":"2024-09-17T03:37:44.082726+0000","last_clean":"2024-09-17T03:37:44.082726+0000","last_became_active":"2024-09-17T03:37:43.069506+0000","last_became_peered":"2024-09-17T03:37:43.069506+0000","last_unstale":"2024-09-17T03:37:44.082726+0000","last_undegraded":"2024-09-17T03:37:44.082726+0000","last_fullsized":"2024-09-17T03:37:44.082726+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:49.787269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.106927+0000","last_change":"2024-09-17T03:37:44.102634+0000","last_active":"2024-09-17T03:37:44.106927+0000","last_peered":"2024-09-17T03:37:44.106927+0000","last_clean":"2024-09-17T03:37:44.106927+0000","last_became_active":"2024-09-17T03:37:44.102326+0000","last_became_peered":"2024-09-17T03:37:44.102326+0000","last_unstale":"2024-09-17T03:37:44.106927+0000","last_undegraded":"2024-09-17T03:37:44.106927+0000","last_fullsized":"2024-09-17T03:37:44.106927+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:26.009847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.084325+0000","last_change":"2024-09-17T03:37:43.075136+0000","last_active":"2024-09-17T03:37:44.084325+0000","last_peered":"2024-09-17T03:37:44.084325+0000","last_clean":"2024-09-17T03:37:44.084325+0000","last_became_active":"2024-09-17T03:37:43.074556+0000","last_became_peered":"2024-09-17T03:37:43.074556+0000","last_unstale":"2024-09-17T03:37:44.084325+0000","last_undegraded":"2024-09-17T03:37:44.084325+0000","last_fullsized":"2024-09-17T03:37:44.084325+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:11.929248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-17T03:37:45.463582+0000","last_change":"2024-09-17T03:37:44.101181+0000","last_active":"2024-09-17T03:37:45.463582+0000","last_peered":"2024-09-17T03:37:45.463582+0000","last_clean":"2024-09-17T03:37:45.463582+0000","last_became_active":"2024-09-17T03:37:44.100883+0000","last_became_peered":"2024-09-17T03:37:44.100883+0000","last_unstale":"2024-09-17T03:37:45.463582+0000","last_undegraded":"2024-09-17T03:37:45.463582+0000","last_fullsized":"2024-09-17T03:37:45.463582+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:39.075827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.082531+0000","last_change":"2024-09-17T03:37:43.077937+0000","last_active":"2024-09-17T03:37:44.082531+0000","last_peered":"2024-09-17T03:37:44.082531+0000","last_clean":"2024-09-17T03:37:44.082531+0000","last_became_active":"2024-09-17T03:37:43.077448+0000","last_became_peered":"2024-09-17T03:37:43.077448+0000","last_unstale":"2024-09-17T03:37:44.082531+0000","last_undegraded":"2024-09-17T03:37:44.082531+0000","last_fullsized":"2024-09-17T03:37:44.082531+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:14.985102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.108238+0000","last_change":"2024-09-17T03:37:44.105949+0000","last_active":"2024-09-17T03:37:44.108238+0000","last_peered":"2024-09-17T03:37:44.108238+0000","last_clean":"2024-09-17T03:37:44.108238+0000","last_became_active":"2024-09-17T03:37:44.105568+0000","last_became_peered":"2024-09-17T03:37:44.105568+0000","last_unstale":"2024-09-17T03:37:44.108238+0000","last_undegraded":"2024-09-17T03:37:44.108238+0000","last_fullsized":"2024-09-17T03:37:44.108238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:16.151976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.098312+0000","last_change":"2024-09-17T03:37:43.082042+0000","last_active":"2024-09-17T03:37:44.098312+0000","last_peered":"2024-09-17T03:37:44.098312+0000","last_clean":"2024-09-17T03:37:44.098312+0000","last_became_active":"2024-09-17T03:37:43.081655+0000","last_became_peered":"2024-09-17T03:37:43.081655+0000","last_unstale":"2024-09-17T03:37:44.098312+0000","last_undegraded":"2024-09-17T03:37:44.098312+0000","last_fullsized":"2024-09-17T03:37:44.098312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:41.819083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.101667+0000","last_change":"2024-09-17T03:37:44.100050+0000","last_active":"2024-09-17T03:37:44.101667+0000","last_peered":"2024-09-17T03:37:44.101667+0000","last_clean":"2024-09-17T03:37:44.101667+0000","last_became_active":"2024-09-17T03:37:44.099740+0000","last_became_peered":"2024-09-17T03:37:44.099740+0000","last_unstale":"2024-09-17T03:37:44.101667+0000","last_undegraded":"2024-09-17T03:37:44.101667+0000","last_fullsized":"2024-09-17T03:37:44.101667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:11.986628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.082512+0000","last_change":"2024-09-17T03:37:43.072216+0000","last_active":"2024-09-17T03:37:44.082512+0000","last_peered":"2024-09-17T03:37:44.082512+0000","last_clean":"2024-09-17T03:37:44.082512+0000","last_became_active":"2024-09-17T03:37:43.071857+0000","last_became_peered":"2024-09-17T03:37:43.071857+0000","last_unstale":"2024-09-17T03:37:44.082512+0000","last_undegraded":"2024-09-17T03:37:44.082512+0000","last_fullsized":"2024-09-17T03:37:44.082512+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:40.454681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.088638+0000","last_change":"2024-09-17T03:37:44.086364+0000","last_active":"2024-09-17T03:37:44.088638+0000","last_peered":"2024-09-17T03:37:44.088638+0000","last_clean":"2024-09-17T03:37:44.088638+0000","last_became_active":"2024-09-17T03:37:44.085830+0000","last_became_peered":"2024-09-17T03:37:44.085830+0000","last_unstale":"2024-09-17T03:37:44.088638+0000","last_undegraded":"2024-09-17T03:37:44.088638+0000","last_fullsized":"2024-09-17T03:37:44.088638+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:27.564632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.090216+0000","last_change":"2024-09-17T03:37:43.082507+0000","last_active":"2024-09-17T03:37:44.090216+0000","last_peered":"2024-09-17T03:37:44.090216+0000","last_clean":"2024-09-17T03:37:44.090216+0000","last_became_active":"2024-09-17T03:37:43.081888+0000","last_became_peered":"2024-09-17T03:37:43.081888+0000","last_unstale":"2024-09-17T03:37:44.090216+0000","last_undegraded":"2024-09-17T03:37:44.090216+0000","last_fullsized":"2024-09-17T03:37:44.090216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:00.619644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.097340+0000","last_change":"2024-09-17T03:37:44.094826+0000","last_active":"2024-09-17T03:37:44.097340+0000","last_peered":"2024-09-17T03:37:44.097340+0000","last_clean":"2024-09-17T03:37:44.097340+0000","last_became_active":"2024-09-17T03:37:44.094433+0000","last_became_peered":"2024-09-17T03:37:44.094433+0000","last_unstale":"2024-09-17T03:37:44.097340+0000","last_undegraded":"2024-09-17T03:37:44.097340+0000","last_fullsized":"2024-09-17T03:37:44.097340+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:43.056846+0000","last_clean_scrub_stamp":"2024-09-17T03:37:43.056846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:17.957915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.108375+0000","last_change":"2024-09-17T03:37:43.077586+0000","last_active":"2024-09-17T03:37:44.108375+0000","last_peered":"2024-09-17T03:37:44.108375+0000","last_clean":"2024-09-17T03:37:44.108375+0000","last_became_active":"2024-09-17T03:37:43.077272+0000","last_became_peered":"2024-09-17T03:37:43.077272+0000","last_unstale":"2024-09-17T03:37:44.108375+0000","last_undegraded":"2024-09-17T03:37:44.108375+0000","last_fullsized":"2024-09-17T03:37:44.108375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:37:42.050656+0000","last_clean_scrub_stamp":"2024-09-17T03:37:42.050656+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:14.929040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":231,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-17T03:37:44.083620+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:37:44.083620+0000","last_peered":"2024-09-17T03:37:44.083620+0000","last_clean":"2024-09-17T03:37:44.083620+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:37:44.083620+0000","last_undegraded":"2024-09-17T03:37:44.083620+0000","last_fullsized":"2024-09-17T03:37:44.083620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36952,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334888,"statfs":{"total":96636764160,"available":96598925312,"internally_reserved":0,"allocated":1642496,"data_stored":1040655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40564,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331276,"statfs":{"total":96636764160,"available":96595226624,"internally_reserved":0,"allocated":1073152,"data_stored":457756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509503,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1048576,"data_stored":450287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36376,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335464,"statfs":{"total":96636764160,"available":96599515136,"internally_reserved":0,"allocated":1048576,"data_stored":450287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40560,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331280,"statfs":{"total":96636764160,"available":96595230720,"internally_reserved":0,"allocated":1073152,"data_stored":457256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36952,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334888,"statfs":{"total":96636764160,"available":96598925312,"internally_reserved":0,"allocated":1642496,"data_stored":1040655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40576,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331264,"statfs":{"total":96636764160,"available":96595214336,"internally_reserved":0,"allocated":1089536,"data_stored":464996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40572,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331268,"statfs":{"total":96636764160,"available":96595218432,"internally_reserved":0,"allocated":1085440,"data_stored":464974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:37:48.454 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:37:48.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:37:48.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.611+0000 7fc6deea9640 1 -- 172.21.15.146:0/3722099483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d80b8ea0 msgr2=0x7fc6d8069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.611+0000 7fc6deea9640 1 --2- 172.21.15.146:0/3722099483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d80b8ea0 0x7fc6d8069240 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0005fd0 tx=0x7fc6d002aa90 comp rx=0 tx=0).stop 2024-09-17T03:37:48.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.611+0000 7fc6deea9640 1 -- 172.21.15.146:0/3722099483 shutdown_connections 2024-09-17T03:37:48.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.611+0000 7fc6deea9640 1 --2- 172.21.15.146:0/3722099483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d80b8ea0 0x7fc6d8069240 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.611+0000 7fc6deea9640 1 --2- 172.21.15.146:0/3722099483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6d80d2330 0x7fc6d8068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.611+0000 7fc6deea9640 1 -- 172.21.15.146:0/3722099483 >> 172.21.15.146:0/3722099483 conn(0x7fc6d806d070 msgr2=0x7fc6d806d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:48.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.611+0000 7fc6deea9640 1 -- 172.21.15.146:0/3722099483 shutdown_connections 2024-09-17T03:37:48.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.611+0000 7fc6deea9640 1 -- 172.21.15.146:0/3722099483 wait complete. 2024-09-17T03:37:48.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.613+0000 7fc6deea9640 1 Processor -- start 2024-09-17T03:37:48.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.613+0000 7fc6deea9640 1 -- start start 2024-09-17T03:37:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.614+0000 7fc6deea9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d80b8ea0 0x7fc6d80ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.614+0000 7fc6deea9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6d80d2330 0x7fc6d80b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.614+0000 7fc6deea9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6d815eda0 0x7fc6d81f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.614+0000 7fc6deea9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d80cf6d0 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.614+0000 7fc6deea9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d8069ab0 con 0x7fc6d80d2330 2024-09-17T03:37:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.614+0000 7fc6deea9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d80cf850 con 0x7fc6d815eda0 2024-09-17T03:37:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.614+0000 7fc6dcc45640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d80b8ea0 0x7fc6d80ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6dcc45640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d80b8ea0 0x7fc6d80ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56322/0 (socket says 172.21.15.146:56322) 2024-09-17T03:37:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6dcc45640 1 -- 172.21.15.146:0/1107472546 learned_addr learned my addr 172.21.15.146:0/1107472546 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6dd446640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6d815eda0 0x7fc6d81f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:48.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6cffff640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6d80d2330 0x7fc6d80b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6dcc45640 1 -- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6d815eda0 msgr2=0x7fc6d81f8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6dcc45640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6d815eda0 0x7fc6d81f8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6dcc45640 1 -- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6d80d2330 msgr2=0x7fc6d80b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6dcc45640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6d80d2330 0x7fc6d80b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6dcc45640 1 -- 172.21.15.146:0/1107472546 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d80caad0 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6dcc45640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d80b8ea0 0x7fc6d80ca590 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400d6d0 tx=0x7fc6d400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6cd7fa640 1 -- 172.21.15.146:0/1107472546 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4017070 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6cd7fa640 1 -- 172.21.15.146:0/1107472546 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6d4005330 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6deea9640 1 -- 172.21.15.146:0/1107472546 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d80c8b60 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6cd7fa640 1 -- 172.21.15.146:0/1107472546 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4009820 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.615+0000 7fc6deea9640 1 -- 172.21.15.146:0/1107472546 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d80c9120 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.616+0000 7fc6deea9640 1 -- 172.21.15.146:0/1107472546 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d806a010 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.617+0000 7fc6cd7fa640 1 -- 172.21.15.146:0/1107472546 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6d40099c0 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.617+0000 7fc6cd7fa640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6c4078b90 0x7fc6c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.618+0000 7fc6cd7fa640 1 -- 172.21.15.146:0/1107472546 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fc6d409ae20 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.618+0000 7fc6cffff640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6c4078b90 0x7fc6c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:48.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.618+0000 7fc6cffff640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6c4078b90 0x7fc6c407b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8000f60 tx=0x7fc6c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:48.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.622+0000 7fc6cd7fa640 1 -- 172.21.15.146:0/1107472546 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc6d4062c10 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.867+0000 7fc6deea9640 1 -- 172.21.15.146:0/1107472546 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc6d80b4690 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.870+0000 7fc6cd7fa640 1 -- 172.21.15.146:0/1107472546 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7fc6d4067640 con 0x7fc6d80b8ea0 2024-09-17T03:37:48.869 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:37:48.869 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:37:48.869 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:37:48.869 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:37:48.869 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:37:48.869 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:37:48.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.872+0000 7fc6deea9640 1 -- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6c4078b90 msgr2=0x7fc6c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.872+0000 7fc6deea9640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6c4078b90 0x7fc6c407b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8000f60 tx=0x7fc6c8009040 comp rx=0 tx=0).stop 2024-09-17T03:37:48.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.872+0000 7fc6deea9640 1 -- 172.21.15.146:0/1107472546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d80b8ea0 msgr2=0x7fc6d80ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.872+0000 7fc6deea9640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d80b8ea0 0x7fc6d80ca590 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400d6d0 tx=0x7fc6d400db90 comp rx=0 tx=0).stop 2024-09-17T03:37:48.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.872+0000 7fc6deea9640 1 -- 172.21.15.146:0/1107472546 shutdown_connections 2024-09-17T03:37:48.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.872+0000 7fc6deea9640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6c4078b90 0x7fc6c407b0a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.872+0000 7fc6deea9640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6d815eda0 0x7fc6d81f8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.872+0000 7fc6deea9640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6d80d2330 0x7fc6d80b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.872+0000 7fc6deea9640 1 --2- 172.21.15.146:0/1107472546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d80b8ea0 0x7fc6d80ca590 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.873+0000 7fc6deea9640 1 -- 172.21.15.146:0/1107472546 >> 172.21.15.146:0/1107472546 conn(0x7fc6d806d070 msgr2=0x7fc6d8075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.873+0000 7fc6deea9640 1 -- 172.21.15.146:0/1107472546 shutdown_connections 2024-09-17T03:37:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.873+0000 7fc6deea9640 1 -- 172.21.15.146:0/1107472546 wait complete. 2024-09-17T03:37:48.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.997+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/107285886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc004d40 msgr2=0x7f6fcc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.997+0000 7f6fe9e4d640 1 --2- 172.21.15.146:0/107285886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc004d40 0x7f6fcc005150 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc005fd0 tx=0x7f6fcc005830 comp rx=0 tx=0).stop 2024-09-17T03:37:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.997+0000 7f6fe3fff640 1 -- 172.21.15.146:0/107285886 reap_dead start 2024-09-17T03:37:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.998+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/107285886 shutdown_connections 2024-09-17T03:37:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.998+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/107285886 >> 172.21.15.146:0/107285886 conn(0x7f6fe40b7b20 msgr2=0x7f6fe409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.998+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/107285886 shutdown_connections 2024-09-17T03:37:48.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.998+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/107285886 wait complete. 2024-09-17T03:37:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:48.999+0000 7f6fe9e4d640 1 Processor -- start 2024-09-17T03:37:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.000+0000 7f6fe9e4d640 1 -- start start 2024-09-17T03:37:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe9e4d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc004d40 0x7f6fe4150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe9e4d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fe41e7820 0x7f6fe4153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe9e4d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fe41e7c30 0x7f6fe4153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe9e4d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe40b1920 con 0x7f6fcc004d40 2024-09-17T03:37:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe9e4d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe40b17a0 con 0x7f6fe41e7820 2024-09-17T03:37:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe9e4d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe415cfe0 con 0x7f6fe41e7c30 2024-09-17T03:37:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc004d40 0x7f6fe4150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc004d40 0x7f6fe4150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56344/0 (socket says 172.21.15.146:56344) 2024-09-17T03:37:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe37fe640 1 -- 172.21.15.146:0/1508401711 learned_addr learned my addr 172.21.15.146:0/1508401711 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe37fe640 1 -- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fe41e7c30 msgr2=0x7f6fe4153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe37fe640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fe41e7c30 0x7f6fe4153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe37fe640 1 -- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fe41e7820 msgr2=0x7f6fe4153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe37fe640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fe41e7820 0x7f6fe4153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe37fe640 1 -- 172.21.15.146:0/1508401711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe41e5f90 con 0x7f6fcc004d40 2024-09-17T03:37:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe37fe640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc004d40 0x7f6fe4150540 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4011a60 tx=0x7f6fd4011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fcbfff640 1 -- 172.21.15.146:0/1508401711 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd401e070 con 0x7f6fcc004d40 2024-09-17T03:37:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fcbfff640 1 -- 172.21.15.146:0/1508401711 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fd4004460 con 0x7f6fcc004d40 2024-09-17T03:37:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fcbfff640 1 -- 172.21.15.146:0/1508401711 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400fc00 con 0x7f6fcc004d40 2024-09-17T03:37:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.001+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/1508401711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe41517b0 con 0x7f6fcc004d40 2024-09-17T03:37:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.002+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/1508401711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe4151c20 con 0x7f6fcc004d40 2024-09-17T03:37:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.003+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/1508401711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe415caa0 con 0x7f6fcc004d40 2024-09-17T03:37:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.003+0000 7f6fcbfff640 1 -- 172.21.15.146:0/1508401711 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6fd4021070 con 0x7f6fcc004d40 2024-09-17T03:37:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.004+0000 7f6fcbfff640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6fd0078b90 0x7f6fd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.004+0000 7f6fcbfff640 1 -- 172.21.15.146:0/1508401711 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f6fd409b780 con 0x7f6fcc004d40 2024-09-17T03:37:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.004+0000 7f6fe2ffd640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6fd0078b90 0x7f6fd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.005+0000 7f6fe2ffd640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6fd0078b90 0x7f6fd007b0a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6fe41e5d40 tx=0x7f6fd8000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.008+0000 7f6fcbfff640 1 -- 172.21.15.146:0/1508401711 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6fe41e5f90 con 0x7f6fcc004d40 2024-09-17T03:37:49.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.220+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/1508401711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fe415c2f0 con 0x7f6fcc004d40 2024-09-17T03:37:49.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.220+0000 7f6fcbfff640 1 -- 172.21.15.146:0/1508401711 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5228 (secure 0 0 0) 0x7f6fd4063570 con 0x7f6fcc004d40 2024-09-17T03:37:49.220 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:49.220 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":62,"btime":"2024-09-17T03:37:47:097700+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2333155525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2333155525},{"type":"v1","addr":"172.21.15.179:6837","nonce":2333155525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2732155214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2732155214},{"type":"v1","addr":"172.21.15.146:6834","nonce":2732155214}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1878440937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1878440937},{"type":"v1","addr":"172.21.15.146:6835","nonce":1878440937}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:46.459184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7311":{"gid":7311,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/9562532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":9562532},{"type":"v1","addr":"172.21.15.179:6836","nonce":9562532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7311,"qdb_cluster":[7311]},"id":6}]} 2024-09-17T03:37:49.220 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 62 2024-09-17T03:37:49.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6fd0078b90 msgr2=0x7f6fd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6fd0078b90 0x7f6fd007b0a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6fe41e5d40 tx=0x7f6fd8000ed0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/1508401711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc004d40 msgr2=0x7f6fe4150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc004d40 0x7f6fe4150540 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4011a60 tx=0x7f6fd4011f20 comp rx=0 tx=0).stop 2024-09-17T03:37:49.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/1508401711 shutdown_connections 2024-09-17T03:37:49.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6fd0078b90 0x7f6fd007b0a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fe41e7c30 0x7f6fe4153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fe41e7820 0x7f6fe4153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 --2- 172.21.15.146:0/1508401711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fcc004d40 0x7f6fe4150540 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/1508401711 >> 172.21.15.146:0/1508401711 conn(0x7f6fe40b7b20 msgr2=0x7f6fe415a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:49.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/1508401711 shutdown_connections 2024-09-17T03:37:49.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.223+0000 7f6fe9e4d640 1 -- 172.21.15.146:0/1508401711 wait complete. 2024-09-17T03:37:49.636 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:37:43.428752+0000', 'modified': '2024-09-17T03:37:46.459184+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7311}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7311': {'gid': 7311, 'name': 'b', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6836/9562532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 9562532}, {'type': 'v1', 'addr': '172.21.15.179:6836', 'nonce': 9562532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7311, 'qdb_cluster': [7311]} 2024-09-17T03:37:49.636 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:37:49.636 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T03:37:49.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.752+0000 7fc0ab215640 1 -- 172.21.15.146:0/3322823186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a40b47c0 msgr2=0x7fc0a4161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.752+0000 7fc0ab215640 1 --2- 172.21.15.146:0/3322823186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a40b47c0 0x7fc0a4161930 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40740d0 tx=0x7fc09c02a560 comp rx=0 tx=0).stop 2024-09-17T03:37:49.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.752+0000 7fc0ab215640 1 -- 172.21.15.146:0/3322823186 shutdown_connections 2024-09-17T03:37:49.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.752+0000 7fc0ab215640 1 --2- 172.21.15.146:0/3322823186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a40b47c0 0x7fc0a4161930 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.752+0000 7fc0ab215640 1 --2- 172.21.15.146:0/3322823186 >> v2:172.21.15.179:3300/0 conn(0x7fc0a40d0710 0x7fc0a40cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.752+0000 7fc0ab215640 1 -- 172.21.15.146:0/3322823186 >> 172.21.15.146:0/3322823186 conn(0x7fc0a409ba20 msgr2=0x7fc0a40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:49.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.752+0000 7fc0ab215640 1 -- 172.21.15.146:0/3322823186 shutdown_connections 2024-09-17T03:37:49.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.752+0000 7fc0ab215640 1 -- 172.21.15.146:0/3322823186 wait complete. 2024-09-17T03:37:49.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.754+0000 7fc0ab215640 1 Processor -- start 2024-09-17T03:37:49.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.754+0000 7fc0ab215640 1 -- start start 2024-09-17T03:37:49.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0ab215640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a40b47c0 0x7fc0a414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0ab215640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0a40cf6b0 0x7fc0a41f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0ab215640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0a40d0710 0x7fc0a41f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0ab215640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a40b1de0 con 0x7fc0a40b47c0 2024-09-17T03:37:49.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0ab215640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a4162080 con 0x7fc0a40d0710 2024-09-17T03:37:49.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0ab215640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a40b1f60 con 0x7fc0a40cf6b0 2024-09-17T03:37:49.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a8fb1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a40b47c0 0x7fc0a414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a8fb1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a40b47c0 0x7fc0a414e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56358/0 (socket says 172.21.15.146:56358) 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a8fb1640 1 -- 172.21.15.146:0/3629347723 learned_addr learned my addr 172.21.15.146:0/3629347723 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a8fb1640 1 -- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0a40cf6b0 msgr2=0x7fc0a41f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a8fb1640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0a40cf6b0 0x7fc0a41f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a8fb1640 1 -- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0a40d0710 msgr2=0x7fc0a41f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a8fb1640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0a40d0710 0x7fc0a41f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a8fb1640 1 -- 172.21.15.146:0/3629347723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a4151d40 con 0x7fc0a40b47c0 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a8fb1640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a40b47c0 0x7fc0a414e930 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc09400eb60 tx=0x7fc09400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a17fa640 1 -- 172.21.15.146:0/3629347723 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094010630 con 0x7fc0a40b47c0 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a17fa640 1 -- 172.21.15.146:0/3629347723 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0940108c0 con 0x7fc0a40b47c0 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0ab215640 1 -- 172.21.15.146:0/3629347723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a414f200 con 0x7fc0a40b47c0 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0a17fa640 1 -- 172.21.15.146:0/3629347723 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094010d10 con 0x7fc0a40b47c0 2024-09-17T03:37:49.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.756+0000 7fc0ab215640 1 -- 172.21.15.146:0/3629347723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a41e7190 con 0x7fc0a40b47c0 2024-09-17T03:37:49.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.758+0000 7fc0a17fa640 1 -- 172.21.15.146:0/3629347723 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc094018420 con 0x7fc0a40b47c0 2024-09-17T03:37:49.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.759+0000 7fc0a17fa640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc084078b90 0x7fc08407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.759+0000 7fc0a17fa640 1 -- 172.21.15.146:0/3629347723 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fc09409bbd0 con 0x7fc0a40b47c0 2024-09-17T03:37:49.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.759+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc084078b90 0x7fc08407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.760+0000 7fc0b2262740 1 Processor -- start 2024-09-17T03:37:49.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.760+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc084078b90 0x7fc08407b0a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc0a41e9120 tx=0x7fc08c007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.760+0000 7fc0b2262740 1 -- start start 2024-09-17T03:37:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd02210270 0x55dd025e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025e24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd021ef590 0x55dd025ff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0b2262740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dd0252a820 con 0x55dd021e73b0 2024-09-17T03:37:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0b2262740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55dd02519c50 con 0x55dd021ef590 2024-09-17T03:37:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0b2262740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55dd0251da60 con 0x55dd02210270 2024-09-17T03:37:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025e24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025e24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56360/0 (socket says 172.21.15.146:56360) 2024-09-17T03:37:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0a3fff640 1 -- 172.21.15.146:0/3669933151 learned_addr learned my addr 172.21.15.146:0/3669933151 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:49.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0a97b2640 1 --2- 172.21.15.146:0/3669933151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd021ef590 0x55dd025ff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0a8fb1640 1 --2- 172.21.15.146:0/3669933151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd02210270 0x55dd025e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0a3fff640 1 -- 172.21.15.146:0/3669933151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd02210270 msgr2=0x55dd025e1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/3669933151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd02210270 0x55dd025e1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0a3fff640 1 -- 172.21.15.146:0/3669933151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd021ef590 msgr2=0x55dd025ff3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/3669933151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd021ef590 0x55dd025ff3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.761+0000 7fc0a3fff640 1 -- 172.21.15.146:0/3669933151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd0227b850 con 0x55dd021e73b0 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.762+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/3669933151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025e24e0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc08c016840 tx=0x7fc08c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c20fb482239953 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.762+0000 7fc09a7fc640 1 -- 172.21.15.146:0/3669933151 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0162e0 con 0x55dd021e73b0 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.762+0000 7fc09a7fc640 1 -- 172.21.15.146:0/3669933151 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc08c005110 con 0x55dd021e73b0 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.762+0000 7fc09a7fc640 1 -- 172.21.15.146:0/3669933151 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0138b0 con 0x55dd021e73b0 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.762+0000 7fc0b2262740 1 -- 172.21.15.146:0/3669933151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 msgr2=0x55dd025e24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.762+0000 7fc0b2262740 1 --2- 172.21.15.146:0/3669933151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025e24e0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc08c016840 tx=0x7fc08c00f000 comp rx=0 tx=0).stop 2024-09-17T03:37:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.763+0000 7fc0b2262740 1 -- 172.21.15.146:0/3669933151 shutdown_connections 2024-09-17T03:37:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.763+0000 7fc0b2262740 1 --2- 172.21.15.146:0/3669933151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd021ef590 0x55dd025ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.763+0000 7fc0b2262740 1 --2- 172.21.15.146:0/3669933151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025e24e0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.763+0000 7fc0b2262740 1 --2- 172.21.15.146:0/3669933151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd02210270 0x55dd025e1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.763+0000 7fc0b2262740 1 -- 172.21.15.146:0/3669933151 >> 172.21.15.146:0/3669933151 conn(0x55dd022043c0 msgr2=0x55dd025b8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.763+0000 7fc0b2262740 1 -- 172.21.15.146:0/3669933151 shutdown_connections 2024-09-17T03:37:49.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.763+0000 7fc0b2262740 1 -- 172.21.15.146:0/3669933151 wait complete. 2024-09-17T03:37:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.763+0000 7fc0b2262740 1 -- start start 2024-09-17T03:37:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.764+0000 7fc0b2262740 1 Processor -- start 2024-09-17T03:37:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd021ef590 0x55dd0260f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd02210270 0x55dd0260f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0b2262740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dd0228a620 con 0x55dd021e73b0 2024-09-17T03:37:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0b2262740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55dd024bf5f0 con 0x55dd02210270 2024-09-17T03:37:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0b2262740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55dd025e2a20 con 0x55dd021ef590 2024-09-17T03:37:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0b2262740 10 client.0 _ll_register_callbacks cb 0x55dd024c30a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:49.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0a8fb1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0a8fb1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56376/0 (socket says 172.21.15.146:56376) 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0a8fb1640 1 -- 172.21.15.146:0/3091378536 learned_addr learned my addr 172.21.15.146:0/3091378536 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0a97b2640 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd02210270 0x55dd0260f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd021ef590 0x55dd0260f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0a8fb1640 1 -- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd021ef590 msgr2=0x55dd0260f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0a8fb1640 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd021ef590 0x55dd0260f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0a8fb1640 1 -- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd02210270 msgr2=0x55dd0260f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0a8fb1640 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd02210270 0x55dd0260f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.765+0000 7fc0a8fb1640 1 -- 172.21.15.146:0/3091378536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd022f26b0 con 0x55dd021e73b0 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0a8fb1640 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025d01b0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc094063610 tx=0x7fc094063f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6965f85aa591ce04 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0837fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0837fe640 1 -- 172.21.15.146:0/3091378536 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09407de60 con 0x55dd021e73b0 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0837fe640 1 -- 172.21.15.146:0/3091378536 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fc09405f460 con 0x55dd021e73b0 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0b2262740 1 -- 172.21.15.146:0/3091378536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc08c005110 con 0x55dd021e73b0 2024-09-17T03:37:49.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0837fe640 1 -- 172.21.15.146:0/3091378536 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fc094088070 con 0x55dd021e73b0 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0b2262740 10 client.7422 fetch_fsmap learned FSMap version 62 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0b2262740 1 -- 172.21.15.146:0/3091378536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55dd025f5fe0 con 0x55dd021e73b0 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0837fe640 1 -- 172.21.15.146:0/3091378536 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc08c005110 con 0x55dd021e73b0 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0837fe640 1 -- 172.21.15.146:0/3091378536 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7fc094079ac0 con 0x55dd021e73b0 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0b2262740 10 client.7422 fetch_fsmap finished waiting for FSMap version 62 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0b2262740 10 client.7422 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0b2262740 20 client.7422 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0b2262740 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x55dd021cee40 0x55dd025f4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0b2262740 4 client.7422 mds_command: new command op to 7311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0b2262740 1 -- 172.21.15.146:0/3091378536 --> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd0252c770 con 0x55dd021cee40 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.766+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x55dd021cee40 0x55dd025f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.767+0000 7fc0837fe640 10 client.7422 ms_handle_connect on v2:172.21.15.179:6834/9562532 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.767+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x55dd021cee40 0x55dd025f4540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2e5acb83dca221f server_cookie=acf0770d0a70cf57 in_seq=0 out_seq=0 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0837fe640 1 -- 172.21.15.146:0/3091378536 <== mds.0 v2:172.21.15.179:6834/9562532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dd0252c770 con 0x55dd021cee40 2024-09-17T03:37:49.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0837fe640 10 client.7422 handle_command_reply: tid=0 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 1 client.7422 shutdown 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 1 -- 172.21.15.146:0/3091378536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 msgr2=0x55dd025d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025d01b0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc094063610 tx=0x7fc094063f30 comp rx=0 tx=0).stop 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 1 -- 172.21.15.146:0/3091378536 shutdown_connections 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x55dd021cee40 0x55dd025f4540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd02210270 0x55dd0260f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd021ef590 0x55dd0260f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0837fe640 0 client.7422 ms_handle_reset on v2:172.21.15.179:6834/9562532 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 1 --2- 172.21.15.146:0/3091378536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021e73b0 0x55dd025d01b0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 1 -- 172.21.15.146:0/3091378536 >> 172.21.15.146:0/3091378536 conn(0x55dd022043c0 msgr2=0x55dd025d1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 1 -- 172.21.15.146:0/3091378536 shutdown_connections 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 1 -- 172.21.15.146:0/3091378536 wait complete. 2024-09-17T03:37:49.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.768+0000 7fc0b2262740 20 client.7422 trim_cache size 0 max 16384 2024-09-17T03:37:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.786+0000 7fc0b2262740 1 Processor -- start 2024-09-17T03:37:49.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.786+0000 7fc0b2262740 1 -- start start 2024-09-17T03:37:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.787+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd021e73b0 0x55dd025f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.787+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.787+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd02210270 0x55dd025d9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.787+0000 7fc0b2262740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a41e8870 con 0x55dd021ef590 2024-09-17T03:37:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.787+0000 7fc0b2262740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a41e7bd0 con 0x55dd021e73b0 2024-09-17T03:37:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.787+0000 7fc0b2262740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a41e8220 con 0x55dd02210270 2024-09-17T03:37:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.787+0000 7fc0a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.787+0000 7fc0a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56388/0 (socket says 172.21.15.146:56388) 2024-09-17T03:37:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.787+0000 7fc0a3fff640 1 -- 172.21.15.146:0/927396975 learned_addr learned my addr 172.21.15.146:0/927396975 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.788+0000 7fc0a3fff640 1 -- 172.21.15.146:0/927396975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd02210270 msgr2=0x55dd025d9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.788+0000 7fc0a97b2640 1 --2- 172.21.15.146:0/927396975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd02210270 0x55dd025d9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.788+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/927396975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd02210270 0x55dd025d9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.788+0000 7fc0a3fff640 1 -- 172.21.15.146:0/927396975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd021e73b0 msgr2=0x55dd025f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.788+0000 7fc0a8fb1640 1 --2- 172.21.15.146:0/927396975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd021e73b0 0x55dd025f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.788+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/927396975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd021e73b0 0x55dd025f2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.788+0000 7fc0a3fff640 1 -- 172.21.15.146:0/927396975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd02600140 con 0x55dd021ef590 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.788+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/927396975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f32d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x55dd025b9e30 tx=0x7fc08c0010f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622c0025e4cce848 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.788+0000 7fc099ffb640 1 -- 172.21.15.146:0/927396975 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0050a0 con 0x55dd021ef590 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.788+0000 7fc099ffb640 1 -- 172.21.15.146:0/927396975 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc08c0162e0 con 0x55dd021ef590 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.788+0000 7fc099ffb640 1 -- 172.21.15.146:0/927396975 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c013830 con 0x55dd021ef590 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.789+0000 7fc0b2262740 1 -- 172.21.15.146:0/927396975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 msgr2=0x55dd025f32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.789+0000 7fc0b2262740 1 --2- 172.21.15.146:0/927396975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f32d0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x55dd025b9e30 tx=0x7fc08c0010f0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.789+0000 7fc0b2262740 1 -- 172.21.15.146:0/927396975 shutdown_connections 2024-09-17T03:37:49.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.789+0000 7fc0b2262740 1 --2- 172.21.15.146:0/927396975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd02210270 0x55dd025d9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.789+0000 7fc0b2262740 1 --2- 172.21.15.146:0/927396975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f32d0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.789+0000 7fc0b2262740 1 --2- 172.21.15.146:0/927396975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd021e73b0 0x55dd025f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.789+0000 7fc0b2262740 1 -- 172.21.15.146:0/927396975 >> 172.21.15.146:0/927396975 conn(0x55dd022043c0 msgr2=0x55dd025d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:49.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.789+0000 7fc0b2262740 1 -- 172.21.15.146:0/927396975 shutdown_connections 2024-09-17T03:37:49.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.789+0000 7fc0b2262740 1 -- 172.21.15.146:0/927396975 wait complete. 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.789+0000 7fc0b2262740 1 -- start start 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.790+0000 7fc0b2262740 1 Processor -- start 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd021e73b0 0x55dd0267bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0b2262740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd02210270 0x55dd025f4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0b2262740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55dd02610160 con 0x55dd021ef590 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0b2262740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55dd0260fdb0 con 0x55dd02210270 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0b2262740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55dd025dd9d0 con 0x55dd021e73b0 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0b2262740 10 client.0 _ll_register_callbacks cb 0x7fc094063260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56398/0 (socket says 172.21.15.146:56398) 2024-09-17T03:37:49.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0a3fff640 1 -- 172.21.15.146:0/2881856170 learned_addr learned my addr 172.21.15.146:0/2881856170 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0a97b2640 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd02210270 0x55dd025f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0a8fb1640 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd021e73b0 0x55dd0267bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0a3fff640 1 -- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd021e73b0 msgr2=0x55dd0267bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd021e73b0 0x55dd0267bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0a3fff640 1 -- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd02210270 msgr2=0x55dd025f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd02210270 0x55dd025f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.791+0000 7fc0a3fff640 1 -- 172.21.15.146:0/2881856170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd025dbf00 con 0x55dd021ef590 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0a3fff640 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f3de0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fc08c001eb0 tx=0x7fc08c016490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f1111e6175058a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0837fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0837fe640 1 -- 172.21.15.146:0/2881856170 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c013830 con 0x55dd021ef590 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0837fe640 1 -- 172.21.15.146:0/2881856170 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fc08c0139d0 con 0x55dd021ef590 2024-09-17T03:37:49.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0b2262740 1 -- 172.21.15.146:0/2881856170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc08c0162e0 con 0x55dd021ef590 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0837fe640 1 -- 172.21.15.146:0/2881856170 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fc08c03f050 con 0x55dd021ef590 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0b2262740 10 client.7428 fetch_fsmap learned FSMap version 62 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0b2262740 1 -- 172.21.15.146:0/2881856170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55dd0267f630 con 0x55dd021ef590 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0837fe640 1 -- 172.21.15.146:0/2881856170 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc08c0162e0 con 0x55dd021ef590 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0837fe640 1 -- 172.21.15.146:0/2881856170 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7fc08c042020 con 0x55dd021ef590 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0b2262740 10 client.7428 fetch_fsmap finished waiting for FSMap version 62 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0b2262740 10 client.7428 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0b2262740 20 client.7428 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0b2262740 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x55dd025e2080 0x55dd025e2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0b2262740 4 client.7428 mds_command: new command op to 7311 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0b2262740 1 -- 172.21.15.146:0/2881856170 --> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] -- command(tid 0: {"prefix": "status"}) -- 0x55dd02528220 con 0x55dd025e2080 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.792+0000 7fc0a8fb1640 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x55dd025e2080 0x55dd025e2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0837fe640 10 client.7428 ms_handle_connect on v2:172.21.15.179:6834/9562532 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0a8fb1640 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x55dd025e2080 0x55dd025e2490 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=826b2de60b7a47ce server_cookie=ce67ac49b724cdf4 in_seq=0 out_seq=0 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0837fe640 1 -- 172.21.15.146:0/2881856170 <== mds.0 v2:172.21.15.179:6834/9562532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55dd02528220 con 0x55dd025e2080 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0837fe640 10 client.7428 handle_command_reply: tid=0 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0b2262740 1 client.7428 shutdown 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0b2262740 1 -- 172.21.15.146:0/2881856170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 msgr2=0x55dd025f3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0b2262740 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f3de0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fc08c001eb0 tx=0x7fc08c016490 comp rx=0 tx=0).stop 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0b2262740 1 -- 172.21.15.146:0/2881856170 shutdown_connections 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0b2262740 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x55dd025e2080 0x55dd025e2490 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0b2262740 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55dd02210270 0x55dd025f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0b2262740 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dd021ef590 0x55dd025f3de0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0837fe640 0 client.7428 ms_handle_reset on v2:172.21.15.179:6834/9562532 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0b2262740 1 --2- 172.21.15.146:0/2881856170 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55dd021e73b0 0x55dd0267bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0b2262740 1 -- 172.21.15.146:0/2881856170 >> 172.21.15.146:0/2881856170 conn(0x55dd022043c0 msgr2=0x55dd025f2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0b2262740 1 -- 172.21.15.146:0/2881856170 shutdown_connections 2024-09-17T03:37:49.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.793+0000 7fc0b2262740 1 -- 172.21.15.146:0/2881856170 wait complete. 2024-09-17T03:37:49.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0b2262740 20 client.7428 trim_cache size 0 max 16384 2024-09-17T03:37:49.798 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:37:49.798 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:37:49.798 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:37:49.798 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 7311, 2024-09-17T03:37:49.798 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:37:49.798 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:37:49.798 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:37:49.799 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 5.706296558, 2024-09-17T03:37:49.799 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 62, 2024-09-17T03:37:49.799 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 88, 2024-09-17T03:37:49.799 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 88, 2024-09-17T03:37:49.799 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 10.396232256999999 2024-09-17T03:37:49.799 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:37:49.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 -- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc084078b90 msgr2=0x7fc08407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc084078b90 0x7fc08407b0a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc0a41e9120 tx=0x7fc08c007970 comp rx=0 tx=0).stop 2024-09-17T03:37:49.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 -- 172.21.15.146:0/3629347723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a40b47c0 msgr2=0x7fc0a414e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a40b47c0 0x7fc0a414e930 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc09400eb60 tx=0x7fc09400c6a0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 -- 172.21.15.146:0/3629347723 shutdown_connections 2024-09-17T03:37:49.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc084078b90 0x7fc08407b0a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0a40d0710 0x7fc0a41f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0a40cf6b0 0x7fc0a41f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 --2- 172.21.15.146:0/3629347723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0a40b47c0 0x7fc0a414e930 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 -- 172.21.15.146:0/3629347723 >> 172.21.15.146:0/3629347723 conn(0x7fc0a409ba20 msgr2=0x7fc0a40b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:49.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 -- 172.21.15.146:0/3629347723 shutdown_connections 2024-09-17T03:37:49.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.794+0000 7fc0ab215640 1 -- 172.21.15.146:0/3629347723 wait complete. 2024-09-17T03:37:49.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:37:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.918+0000 7f1ae5dad640 1 -- 172.21.15.146:0/2166314856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae00b4100 msgr2=0x7f1ae006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.918+0000 7f1ae5dad640 1 --2- 172.21.15.146:0/2166314856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae00b4100 0x7f1ae006fad0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009830 tx=0x7f1ad402a510 comp rx=0 tx=0).stop 2024-09-17T03:37:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.918+0000 7f1ae5dad640 1 -- 172.21.15.146:0/2166314856 shutdown_connections 2024-09-17T03:37:49.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.918+0000 7f1ae5dad640 1 --2- 172.21.15.146:0/2166314856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae00b4100 0x7f1ae006fad0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.918+0000 7f1ae5dad640 1 -- 172.21.15.146:0/2166314856 >> 172.21.15.146:0/2166314856 conn(0x7f1ae006d3c0 msgr2=0x7f1ae00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:49.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.918+0000 7f1ae5dad640 1 -- 172.21.15.146:0/2166314856 shutdown_connections 2024-09-17T03:37:49.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.918+0000 7f1ae5dad640 1 -- 172.21.15.146:0/2166314856 wait complete. 2024-09-17T03:37:49.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.919+0000 7f1ae5dad640 1 Processor -- start 2024-09-17T03:37:49.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.920+0000 7f1ae5dad640 1 -- start start 2024-09-17T03:37:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1ae5dad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae00b4100 0x7f1ae0140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1ae5dad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b4510 0x7f1ae0143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1ae5dad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00ce960 0x7f1ae00ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1ae5dad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae0070460 con 0x7f1ae00b4100 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1ae5dad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae00702e0 con 0x7f1ae00b4510 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1ae5dad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae00d05b0 con 0x7f1ae00ce960 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1adf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae00b4100 0x7f1ae0140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1adf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae00b4100 0x7f1ae0140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56422/0 (socket says 172.21.15.146:56422) 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1adf7fe640 1 -- 172.21.15.146:0/439273409 learned_addr learned my addr 172.21.15.146:0/439273409 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1adeffd640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b4510 0x7f1ae0143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1adffff640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00ce960 0x7f1ae00ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1adf7fe640 1 -- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00ce960 msgr2=0x7f1ae00ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1adf7fe640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00ce960 0x7f1ae00ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1adf7fe640 1 -- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b4510 msgr2=0x7f1ae0143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1adf7fe640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b4510 0x7f1ae0143540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.921+0000 7f1adf7fe640 1 -- 172.21.15.146:0/439273409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae0143a80 con 0x7f1ae00b4100 2024-09-17T03:37:49.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.922+0000 7f1adf7fe640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae00b4100 0x7f1ae0140360 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000cb10 tx=0x7f1ad000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.922+0000 7f1ac7fff640 1 -- 172.21.15.146:0/439273409 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0016020 con 0x7f1ae00b4100 2024-09-17T03:37:49.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.922+0000 7f1ac7fff640 1 -- 172.21.15.146:0/439273409 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ad000ad60 con 0x7f1ae00b4100 2024-09-17T03:37:49.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.922+0000 7f1ae5dad640 1 -- 172.21.15.146:0/439273409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae00cf2b0 con 0x7f1ae00b4100 2024-09-17T03:37:49.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.922+0000 7f1ac7fff640 1 -- 172.21.15.146:0/439273409 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0012680 con 0x7f1ae00b4100 2024-09-17T03:37:49.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.922+0000 7f1ae5dad640 1 -- 172.21.15.146:0/439273409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae00acdb0 con 0x7f1ae00b4100 2024-09-17T03:37:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.923+0000 7f1ae5dad640 1 -- 172.21.15.146:0/439273409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae015c9f0 con 0x7f1ae00b4100 2024-09-17T03:37:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.923+0000 7f1ac7fff640 1 -- 172.21.15.146:0/439273409 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ad0019020 con 0x7f1ae00b4100 2024-09-17T03:37:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.924+0000 7f1ac7fff640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 0x7f1acc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.924+0000 7f1ac7fff640 1 -- 172.21.15.146:0/439273409 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f1ad009b1c0 con 0x7f1ae00b4100 2024-09-17T03:37:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.924+0000 7f1adeffd640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 0x7f1acc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.925+0000 7f1adeffd640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 0x7f1acc07b0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4034000 tx=0x7f1ad4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:49.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:49.928+0000 7f1ac7fff640 1 -- 172.21.15.146:0/439273409 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ad0020020 con 0x7f1ae00b4100 2024-09-17T03:37:50.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.138+0000 7f1ae5dad640 1 -- 172.21.15.146:0/439273409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1ae015e3c0 con 0x7f1ae00b4100 2024-09-17T03:37:50.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.139+0000 7f1ac7fff640 1 -- 172.21.15.146:0/439273409 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) ==== 53+0+73 (secure 0 0 0) 0x7f1ae00cf2b0 con 0x7f1ae00b4100 2024-09-17T03:37:50.138 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:37:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 -- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 msgr2=0x7f1acc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 0x7f1acc07b0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4034000 tx=0x7f1ad4004730 comp rx=0 tx=0).stop 2024-09-17T03:37:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 -- 172.21.15.146:0/439273409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae00b4100 msgr2=0x7f1ae0140360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae00b4100 0x7f1ae0140360 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000cb10 tx=0x7f1ad000a060 comp rx=0 tx=0).stop 2024-09-17T03:37:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 -- 172.21.15.146:0/439273409 shutdown_connections 2024-09-17T03:37:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1acc078b90 0x7f1acc07b0a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ae00ce960 0x7f1ae00ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ae00b4510 0x7f1ae0143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 --2- 172.21.15.146:0/439273409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ae00b4100 0x7f1ae0140360 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 -- 172.21.15.146:0/439273409 >> 172.21.15.146:0/439273409 conn(0x7f1ae006d3c0 msgr2=0x7f1ae015dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 -- 172.21.15.146:0/439273409 shutdown_connections 2024-09-17T03:37:50.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50.141+0000 7f1ae5dad640 1 -- 172.21.15.146:0/439273409 wait complete. 2024-09-17T03:37:50.151 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:37:50.151 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:37:50.152 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:37:50.152 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:37:50.152 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:50.152 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:37:50.152 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:37:50.152 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:37:50.152 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:50.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:50.152 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:50.169 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42502sec preferred_lft 42502sec 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:50.170 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:37:50.171 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:50.171 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:37:50.171 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:37:50.171 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:50.171 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:37:50.171 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:37:50.171 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:37:50.171 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:37:50.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:50.171 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:37:50.232 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:37:50.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:50.234 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:37:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:37:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:37:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:37:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:37:50.290 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:37:50.290 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:37:50.290 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:37:50.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:37:50.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:37:50.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:37:50.291 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:37:50.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:37:50.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:50.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:50.416 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:37:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:37:50.432 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:37:50.432 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:50.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:50.432 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:37:50.497 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:50.497 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:50.552 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:37:50.553 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:37:50.553 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:50.608 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:37:50.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:50.608 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:50.702 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:37:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:37:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:37:50.713 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:37:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:37:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:37:50.720 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:37:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:37:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:37:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:37:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:37:50.721 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:37:50.721 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:37:50.721 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:37:50.721 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:37:50.722 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:37:50.722 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:37:50.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:50.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:50.748 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:37:50.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:37:50.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:50.850 INFO:teuthology.orchestra.run.smithi146.stdout:client6769 2024-09-17T03:37:50.851 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:50.851 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:50.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:50.867 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-17T03:37:50.928 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:37:50.929 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:37:50.929 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-09-17T03:37:50.929 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:37:50.929 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-17T03:37:50.929 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:37:51.034 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627776 2024-09-17T03:37:51.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:51.043 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:51.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.200+0000 7f1e2def2640 1 -- 172.21.15.146:0/978684428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e28146230 msgr2=0x7f1e2806cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.200+0000 7f1e2def2640 1 --2- 172.21.15.146:0/978684428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e28146230 0x7f1e2806cc50 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009830 tx=0x7f1e1802a500 comp rx=0 tx=0).stop 2024-09-17T03:37:51.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.200+0000 7f1e2def2640 1 -- 172.21.15.146:0/978684428 shutdown_connections 2024-09-17T03:37:51.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.200+0000 7f1e2def2640 1 --2- 172.21.15.146:0/978684428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e280d0660 0x7f1e2806d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.200+0000 7f1e2def2640 1 --2- 172.21.15.146:0/978684428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e28146230 0x7f1e2806cc50 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.200+0000 7f1e2def2640 1 -- 172.21.15.146:0/978684428 >> 172.21.15.146:0/978684428 conn(0x7f1e280b3150 msgr2=0x7f1e280b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:51.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.200+0000 7f1e2def2640 1 -- 172.21.15.146:0/978684428 shutdown_connections 2024-09-17T03:37:51.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.200+0000 7f1e2def2640 1 -- 172.21.15.146:0/978684428 wait complete. 2024-09-17T03:37:51.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.202+0000 7f1e2def2640 1 Processor -- start 2024-09-17T03:37:51.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.202+0000 7f1e2def2640 1 -- start start 2024-09-17T03:37:51.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e2def2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e280d0660 0x7f1e280af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e2def2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e28145ce0 0x7f1e280afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e2def2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e28146230 0x7f1e281f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e2def2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28073e10 con 0x7f1e28145ce0 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e2def2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28073c90 con 0x7f1e280d0660 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e2def2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1e28073f90 con 0x7f1e28146230 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e26ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e28145ce0 0x7f1e280afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e26ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e28145ce0 0x7f1e280afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56442/0 (socket says 172.21.15.146:56442) 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e26ffd640 1 -- 172.21.15.146:0/2078178532 learned_addr learned my addr 172.21.15.146:0/2078178532 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e27fff640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e28146230 0x7f1e281f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e277fe640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e280d0660 0x7f1e280af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e26ffd640 1 -- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e28146230 msgr2=0x7f1e281f7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e26ffd640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e28146230 0x7f1e281f7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e26ffd640 1 -- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e280d0660 msgr2=0x7f1e280af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e26ffd640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e280d0660 0x7f1e280af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e26ffd640 1 -- 172.21.15.146:0/2078178532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2813f250 con 0x7f1e28145ce0 2024-09-17T03:37:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.203+0000 7f1e27fff640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e28146230 0x7f1e281f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.204+0000 7f1e26ffd640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e28145ce0 0x7f1e280afad0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c3c0 tx=0x7f1e1c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.204+0000 7f1e0ffff640 1 -- 172.21.15.146:0/2078178532 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c017070 con 0x7f1e28145ce0 2024-09-17T03:37:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.204+0000 7f1e0ffff640 1 -- 172.21.15.146:0/2078178532 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e1c0035f0 con 0x7f1e28145ce0 2024-09-17T03:37:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.204+0000 7f1e2def2640 1 -- 172.21.15.146:0/2078178532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e28141e60 con 0x7f1e28145ce0 2024-09-17T03:37:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.204+0000 7f1e0ffff640 1 -- 172.21.15.146:0/2078178532 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c003a80 con 0x7f1e28145ce0 2024-09-17T03:37:51.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.204+0000 7f1e2def2640 1 -- 172.21.15.146:0/2078178532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e2815d110 con 0x7f1e28145ce0 2024-09-17T03:37:51.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.205+0000 7f1e2def2640 1 -- 172.21.15.146:0/2078178532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e28141bd0 con 0x7f1e28145ce0 2024-09-17T03:37:51.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.206+0000 7f1e0ffff640 1 -- 172.21.15.146:0/2078178532 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1e1c01a070 con 0x7f1e28145ce0 2024-09-17T03:37:51.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.206+0000 7f1e0ffff640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e14078b90 0x7f1e1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:51.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.206+0000 7f1e0ffff640 1 -- 172.21.15.146:0/2078178532 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f1e1c09a000 con 0x7f1e28145ce0 2024-09-17T03:37:51.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.206+0000 7f1e277fe640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e14078b90 0x7f1e1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:51.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.207+0000 7f1e277fe640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e14078b90 0x7f1e1407b0a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1e18034000 tx=0x7f1e18004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:51.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.211+0000 7f1e0ffff640 1 -- 172.21.15.146:0/2078178532 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1e1c0624d0 con 0x7f1e28145ce0 2024-09-17T03:37:51.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.420+0000 7f1e2def2640 1 -- 172.21.15.146:0/2078178532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e2815d600 con 0x7f1e28145ce0 2024-09-17T03:37:51.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.421+0000 7f1e0ffff640 1 -- 172.21.15.146:0/2078178532 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5228 (secure 0 0 0) 0x7f1e1c061dd0 con 0x7f1e28145ce0 2024-09-17T03:37:51.420 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:51.420 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":62,"btime":"2024-09-17T03:37:47:097700+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2333155525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2333155525},{"type":"v1","addr":"172.21.15.179:6837","nonce":2333155525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2732155214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2732155214},{"type":"v1","addr":"172.21.15.146:6834","nonce":2732155214}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1878440937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1878440937},{"type":"v1","addr":"172.21.15.146:6835","nonce":1878440937}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:46.459184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7311":{"gid":7311,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6836/9562532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":9562532},{"type":"v1","addr":"172.21.15.179:6836","nonce":9562532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7311,"qdb_cluster":[7311]},"id":6}]} 2024-09-17T03:37:51.420 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 62 2024-09-17T03:37:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 -- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e14078b90 msgr2=0x7f1e1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e14078b90 0x7f1e1407b0a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1e18034000 tx=0x7f1e18004730 comp rx=0 tx=0).stop 2024-09-17T03:37:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 -- 172.21.15.146:0/2078178532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e28145ce0 msgr2=0x7f1e280afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e28145ce0 0x7f1e280afad0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c3c0 tx=0x7f1e1c00c880 comp rx=0 tx=0).stop 2024-09-17T03:37:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 -- 172.21.15.146:0/2078178532 shutdown_connections 2024-09-17T03:37:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e14078b90 0x7f1e1407b0a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e28146230 0x7f1e281f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e28145ce0 0x7f1e280afad0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 --2- 172.21.15.146:0/2078178532 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e280d0660 0x7f1e280af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 -- 172.21.15.146:0/2078178532 >> 172.21.15.146:0/2078178532 conn(0x7f1e280b3150 msgr2=0x7f1e28160540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 -- 172.21.15.146:0/2078178532 shutdown_connections 2024-09-17T03:37:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.423+0000 7f1e2def2640 1 -- 172.21.15.146:0/2078178532 wait complete. 2024-09-17T03:37:51.434 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 1099511627776 2024-09-17T03:37:51.569 INFO:teuthology.orchestra.run.smithi179.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T03:37:50.925255+0000","btime":"2024-09-17T03:37:50.925255+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T03:37:50.925255+0000","atime":"2024-09-17T03:37:50.925255+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6769,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6769,"want_loner":6769,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T03:37:51.570 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T03:37:50.925255+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-17T03:37:50.925255+0000", "change_attr": 0, "client_caps": [ { "client_id": 6769, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-17T03:37:50.925255+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6769, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T03:37:50.925255+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6769, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T03:37:51.570 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:51.570 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:51.587 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:37:51.587 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:37:51.587 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2024-09-17T03:37:51.587 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:37:51.587 DEBUG:teuthology.orchestra.run.smithi146:> n = 21 2024-09-17T03:37:51.587 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2024-09-17T03:37:51.587 DEBUG:teuthology.orchestra.run.smithi146:> if 0 > 0: 2024-09-17T03:37:51.587 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2024-09-17T03:37:51.588 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-17T03:37:51.588 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:37:51.588 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2024-09-17T03:37:51.588 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2024-09-17T03:37:51.588 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2024-09-17T03:37:51.588 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:37:51.588 DEBUG:teuthology.orchestra.run.smithi146:> try: 2024-09-17T03:37:51.588 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-17T03:37:51.588 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:37:51.588 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(0): 2024-09-17T03:37:51.589 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-17T03:37:51.590 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:37:51.590 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-09-17T03:37:51.590 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2024-09-17T03:37:51.590 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2024-09-17T03:37:51.590 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:37:51.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:37:51.731 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:51.731 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:51.787 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:37:51.787 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:37:51.843 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:37:51.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.997+0000 7f18494de640 1 -- 172.21.15.146:0/1431563562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1830004800 msgr2=0x7f1830004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.997+0000 7f18494de640 1 --2- 172.21.15.146:0/1431563562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1830004800 0x7f1830004c10 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f184406ff10 tx=0x7f1830005830 comp rx=0 tx=0).stop 2024-09-17T03:37:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.997+0000 7f18437fe640 1 -- 172.21.15.146:0/1431563562 reap_dead start 2024-09-17T03:37:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.997+0000 7f18494de640 1 -- 172.21.15.146:0/1431563562 shutdown_connections 2024-09-17T03:37:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.997+0000 7f18494de640 1 -- 172.21.15.146:0/1431563562 >> 172.21.15.146:0/1431563562 conn(0x7f18440d4be0 msgr2=0x7f18440d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.997+0000 7f18494de640 1 -- 172.21.15.146:0/1431563562 shutdown_connections 2024-09-17T03:37:51.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.997+0000 7f18494de640 1 -- 172.21.15.146:0/1431563562 wait complete. 2024-09-17T03:37:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.999+0000 7f18494de640 1 Processor -- start 2024-09-17T03:37:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:51.999+0000 7f18494de640 1 -- start start 2024-09-17T03:37:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.000+0000 7f18494de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1830004800 0x7f184414cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.000+0000 7f18494de640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440b6920 0x7f18440c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.000+0000 7f18494de640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18440c9890 0x7f18441f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.000+0000 7f18494de640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f18440d38a0 con 0x7f18440b6920 2024-09-17T03:37:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.000+0000 7f18494de640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f184406efc0 con 0x7f18440c9890 2024-09-17T03:37:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.000+0000 7f18494de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f18440d3a20 con 0x7f1830004800 2024-09-17T03:37:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.000+0000 7f183a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440b6920 0x7f18440c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.000+0000 7f183a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440b6920 0x7f18440c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56458/0 (socket says 172.21.15.146:56458) 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f183a7fc640 1 -- 172.21.15.146:0/372802299 learned_addr learned my addr 172.21.15.146:0/372802299 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f1842ffd640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1830004800 0x7f184414cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f183a7fc640 1 -- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1830004800 msgr2=0x7f184414cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f18437fe640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18440c9890 0x7f18441f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f183a7fc640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1830004800 0x7f184414cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f183a7fc640 1 -- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18440c9890 msgr2=0x7f18441f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f183a7fc640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18440c9890 0x7f18441f5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f183a7fc640 1 -- 172.21.15.146:0/372802299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18440b5880 con 0x7f18440b6920 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f183a7fc640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440b6920 0x7f18440c9350 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f18440d0fa0 tx=0x7f182c034680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f183bfff640 1 -- 172.21.15.146:0/372802299 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c038040 con 0x7f18440b6920 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f183bfff640 1 -- 172.21.15.146:0/372802299 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f182c034870 con 0x7f18440b6920 2024-09-17T03:37:52.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f18494de640 1 -- 172.21.15.146:0/372802299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18440b5b60 con 0x7f18440b6920 2024-09-17T03:37:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f183bfff640 1 -- 172.21.15.146:0/372802299 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182c034c80 con 0x7f18440b6920 2024-09-17T03:37:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.001+0000 7f18494de640 1 -- 172.21.15.146:0/372802299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18440b6120 con 0x7f18440b6920 2024-09-17T03:37:52.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.002+0000 7f18494de640 1 -- 172.21.15.146:0/372802299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18440d3fb0 con 0x7f18440b6920 2024-09-17T03:37:52.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.003+0000 7f183bfff640 1 -- 172.21.15.146:0/372802299 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f182c045020 con 0x7f18440b6920 2024-09-17T03:37:52.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.003+0000 7f183bfff640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1824078bc0 0x7f182407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.004+0000 7f183bfff640 1 -- 172.21.15.146:0/372802299 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f182c0bc130 con 0x7f18440b6920 2024-09-17T03:37:52.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.004+0000 7f1842ffd640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1824078bc0 0x7f182407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.004+0000 7f1842ffd640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1824078bc0 0x7f182407b0d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f18340010e0 tx=0x7f18340068d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.007+0000 7f183bfff640 1 -- 172.21.15.146:0/372802299 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f182c04c020 con 0x7f18440b6920 2024-09-17T03:37:52.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.197+0000 7f18494de640 1 -- 172.21.15.146:0/372802299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f18440d2bd0 con 0x7f18440b6920 2024-09-17T03:37:52.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.197+0000 7f183bfff640 1 -- 172.21.15.146:0/372802299 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v88) ==== 80+0+0 (secure 0 0 0) 0x7f182c034e20 con 0x7f18440b6920 2024-09-17T03:37:52.197 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:37:52.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.199+0000 7f18494de640 1 -- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1824078bc0 msgr2=0x7f182407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.199+0000 7f18494de640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1824078bc0 0x7f182407b0d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f18340010e0 tx=0x7f18340068d0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.199+0000 7f18494de640 1 -- 172.21.15.146:0/372802299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440b6920 msgr2=0x7f18440c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.199+0000 7f18494de640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440b6920 0x7f18440c9350 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f18440d0fa0 tx=0x7f182c034680 comp rx=0 tx=0).stop 2024-09-17T03:37:52.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.199+0000 7f18494de640 1 -- 172.21.15.146:0/372802299 shutdown_connections 2024-09-17T03:37:52.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.199+0000 7f18494de640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1824078bc0 0x7f182407b0d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.199+0000 7f18494de640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18440c9890 0x7f18441f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.200+0000 7f18494de640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18440b6920 0x7f18440c9350 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.200+0000 7f18494de640 1 --2- 172.21.15.146:0/372802299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1830004800 0x7f184414cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.200+0000 7f18494de640 1 -- 172.21.15.146:0/372802299 >> 172.21.15.146:0/372802299 conn(0x7f18440d4be0 msgr2=0x7f184415e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.200+0000 7f18494de640 1 -- 172.21.15.146:0/372802299 shutdown_connections 2024-09-17T03:37:52.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.200+0000 7f18494de640 1 -- 172.21.15.146:0/372802299 wait complete. 2024-09-17T03:37:52.210 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:37:52.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:52.210 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:37:52.295 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:37:52.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:37:52.295 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:37:52.313 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-17T03:37:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.470+0000 7f73bc719640 1 -- 172.21.15.146:0/3488067248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b40b3870 msgr2=0x7f73b40cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.470+0000 7f73bc719640 1 --2- 172.21.15.146:0/3488067248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b40b3870 0x7f73b40cf370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f73a4009be0 tx=0x7f73a402a890 comp rx=0 tx=0).stop 2024-09-17T03:37:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.470+0000 7f73bc719640 1 -- 172.21.15.146:0/3488067248 shutdown_connections 2024-09-17T03:37:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.470+0000 7f73bc719640 1 --2- 172.21.15.146:0/3488067248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b40b3870 0x7f73b40cf370 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.470+0000 7f73bc719640 1 -- 172.21.15.146:0/3488067248 >> 172.21.15.146:0/3488067248 conn(0x7f73b40d4be0 msgr2=0x7f73b40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.470+0000 7f73bc719640 1 -- 172.21.15.146:0/3488067248 shutdown_connections 2024-09-17T03:37:52.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.470+0000 7f73bc719640 1 -- 172.21.15.146:0/3488067248 wait complete. 2024-09-17T03:37:52.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.472+0000 7f73bc719640 1 Processor -- start 2024-09-17T03:37:52.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.472+0000 7f73bc719640 1 -- start start 2024-09-17T03:37:52.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.473+0000 7f73bc719640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b40b3870 0x7f73b414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.473+0000 7f73bc719640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73b41620f0 0x7f73b415e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.473+0000 7f73bc719640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b40cb8a0 0x7f73b415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.473+0000 7f73bc719640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40d3d40 con 0x7f73b41620f0 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.473+0000 7f73bc719640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40d3bc0 con 0x7f73b40cb8a0 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.473+0000 7f73bc719640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f73b40d3ec0 con 0x7f73b40b3870 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b9cb4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73b41620f0 0x7f73b415e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b9cb4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73b41620f0 0x7f73b415e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56462/0 (socket says 172.21.15.146:56462) 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b9cb4640 1 -- 172.21.15.146:0/3164844617 learned_addr learned my addr 172.21.15.146:0/3164844617 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b40b3870 0x7f73b414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73bacb6640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b40cb8a0 0x7f73b415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b9cb4640 1 -- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b40b3870 msgr2=0x7f73b414ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b9cb4640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b40b3870 0x7f73b414ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b9cb4640 1 -- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b40cb8a0 msgr2=0x7f73b415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b9cb4640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b40cb8a0 0x7f73b415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b9cb4640 1 -- 172.21.15.146:0/3164844617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b40cc010 con 0x7f73b41620f0 2024-09-17T03:37:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b9cb4640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73b41620f0 0x7f73b415e640 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f73a800c430 tx=0x7f73a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b2ffd640 1 -- 172.21.15.146:0/3164844617 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8011790 con 0x7f73b41620f0 2024-09-17T03:37:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b2ffd640 1 -- 172.21.15.146:0/3164844617 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73a8017070 con 0x7f73b41620f0 2024-09-17T03:37:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73bc719640 1 -- 172.21.15.146:0/3164844617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b40cc2f0 con 0x7f73b41620f0 2024-09-17T03:37:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73b2ffd640 1 -- 172.21.15.146:0/3164844617 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8011cc0 con 0x7f73b41620f0 2024-09-17T03:37:52.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.474+0000 7f73bc719640 1 -- 172.21.15.146:0/3164844617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b40b4380 con 0x7f73b41620f0 2024-09-17T03:37:52.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.476+0000 7f73b2ffd640 1 -- 172.21.15.146:0/3164844617 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f73a801c460 con 0x7f73b41620f0 2024-09-17T03:37:52.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.476+0000 7f73b2ffd640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f73a0078bc0 0x7f73a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.477+0000 7f73b2ffd640 1 -- 172.21.15.146:0/3164844617 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f73a809a7d0 con 0x7f73b41620f0 2024-09-17T03:37:52.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.477+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f73a0078bc0 0x7f73a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.477+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f73a0078bc0 0x7f73a007b0d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f73a4034000 tx=0x7f73a4004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.477+0000 7f73c3687740 1 Processor -- start 2024-09-17T03:37:52.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.478+0000 7f73c3687740 1 -- start start 2024-09-17T03:37:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73c3687740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73c3687740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73c3687740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x5646624e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73c3687740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56466240da60 con 0x5646620f3390 2024-09-17T03:37:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73c3687740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5646623fce90 con 0x5646620d26b0 2024-09-17T03:37:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73c3687740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564662400ca0 con 0x5646620ca4d0 2024-09-17T03:37:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73ba4b5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73ba4b5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56472/0 (socket says 172.21.15.146:56472) 2024-09-17T03:37:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73ba4b5640 1 -- 172.21.15.146:0/1130288770 learned_addr learned my addr 172.21.15.146:0/1130288770 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73b9cb4640 1 --2- 172.21.15.146:0/1130288770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73bacb6640 1 --2- 172.21.15.146:0/1130288770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x5646624e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73ba4b5640 1 -- 172.21.15.146:0/1130288770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 msgr2=0x5646624c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/1130288770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73ba4b5640 1 -- 172.21.15.146:0/1130288770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 msgr2=0x5646624e1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/1130288770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x5646624e1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73ba4b5640 1 -- 172.21.15.146:0/1130288770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646621d57d0 con 0x5646620f3390 2024-09-17T03:37:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73b9cb4640 1 --2- 172.21.15.146:0/1130288770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.479+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/1130288770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624c4740 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f73a40099a0 tx=0x7f73a403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4f82cfb4eebb64 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.480+0000 7f739bfff640 1 -- 172.21.15.146:0/1130288770 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4004850 con 0x5646620f3390 2024-09-17T03:37:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.480+0000 7f739bfff640 1 -- 172.21.15.146:0/1130288770 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73a4045460 con 0x5646620f3390 2024-09-17T03:37:52.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.480+0000 7f739bfff640 1 -- 172.21.15.146:0/1130288770 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4045890 con 0x5646620f3390 2024-09-17T03:37:52.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.480+0000 7f73c3687740 1 -- 172.21.15.146:0/1130288770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 msgr2=0x5646624c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.480+0000 7f73c3687740 1 --2- 172.21.15.146:0/1130288770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624c4740 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f73a40099a0 tx=0x7f73a403e040 comp rx=0 tx=0).stop 2024-09-17T03:37:52.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.480+0000 7f73c3687740 1 -- 172.21.15.146:0/1130288770 shutdown_connections 2024-09-17T03:37:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.480+0000 7f73c3687740 1 --2- 172.21.15.146:0/1130288770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x5646624e1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.480+0000 7f73c3687740 1 --2- 172.21.15.146:0/1130288770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.480+0000 7f73c3687740 1 --2- 172.21.15.146:0/1130288770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624c4740 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.480+0000 7f73c3687740 1 -- 172.21.15.146:0/1130288770 >> 172.21.15.146:0/1130288770 conn(0x5646620e74e0 msgr2=0x56466249aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.481+0000 7f73c3687740 1 -- 172.21.15.146:0/1130288770 shutdown_connections 2024-09-17T03:37:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.481+0000 7f73c3687740 1 -- 172.21.15.146:0/1130288770 wait complete. 2024-09-17T03:37:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.481+0000 7f73c3687740 1 -- start start 2024-09-17T03:37:52.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.482+0000 7f73c3687740 1 Processor -- start 2024-09-17T03:37:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73c3687740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624d6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73c3687740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x5646624b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73c3687740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624e18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73c3687740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56466216d740 con 0x5646620f3390 2024-09-17T03:37:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73c3687740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5646623a2970 con 0x5646620d26b0 2024-09-17T03:37:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73c3687740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5646624c51c0 con 0x5646620ca4d0 2024-09-17T03:37:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73c3687740 10 client.0 _ll_register_callbacks cb 0x5646623a5be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73bacb6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624e18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73ba4b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624d6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73bacb6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624e18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56482/0 (socket says 172.21.15.146:56482) 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73bacb6640 1 -- 172.21.15.146:0/1922423015 learned_addr learned my addr 172.21.15.146:0/1922423015 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73b9cb4640 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x5646624b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73bacb6640 1 -- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 msgr2=0x5646624d6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73bacb6640 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624d6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73bacb6640 1 -- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 msgr2=0x5646624b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73bacb6640 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x5646624b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73bacb6640 1 -- 172.21.15.146:0/1922423015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56466215e970 con 0x5646620f3390 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.483+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624d6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73bacb6640 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624e18e0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f73ac007b60 tx=0x7f73ac0014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52c4e814afe6116 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73997fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73997fa640 1 -- 172.21.15.146:0/1922423015 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac001ce0 con 0x5646620f3390 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73997fa640 1 -- 172.21.15.146:0/1922423015 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f73ac014400 con 0x5646620f3390 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73c3687740 1 -- 172.21.15.146:0/1922423015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73a4045460 con 0x5646620f3390 2024-09-17T03:37:52.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73997fa640 1 -- 172.21.15.146:0/1922423015 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f73ac021050 con 0x5646620f3390 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73c3687740 10 client.7464 fetch_fsmap learned FSMap version 62 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73c3687740 1 -- 172.21.15.146:0/1922423015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x56466213c6a0 con 0x5646620f3390 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73997fa640 1 -- 172.21.15.146:0/1922423015 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73a4045460 con 0x5646620f3390 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73997fa640 1 -- 172.21.15.146:0/1922423015 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7f73ac024020 con 0x5646620f3390 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73c3687740 10 client.7464 fetch_fsmap finished waiting for FSMap version 62 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73c3687740 10 client.7464 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73c3687740 20 client.7464 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73c3687740 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x5646620b1f60 0x5646624f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73c3687740 4 client.7464 mds_command: new command op to 7311 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73c3687740 1 -- 172.21.15.146:0/1922423015 --> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56466240f9b0 con 0x5646620b1f60 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.484+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x5646620b1f60 0x5646624f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.485+0000 7f73997fa640 10 client.7464 ms_handle_connect on v2:172.21.15.179:6834/9562532 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.485+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x5646620b1f60 0x5646624f1da0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccfab2d90a002079 server_cookie=55b93cb5919dcb7e in_seq=0 out_seq=0 2024-09-17T03:37:52.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73997fa640 1 -- 172.21.15.146:0/1922423015 <== mds.0 v2:172.21.15.179:6834/9562532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56466240f9b0 con 0x5646620b1f60 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73997fa640 10 client.7464 handle_command_reply: tid=0 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 1 client.7464 shutdown 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 1 -- 172.21.15.146:0/1922423015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 msgr2=0x5646624e18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624e18e0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f73ac007b60 tx=0x7f73ac0014b0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 1 -- 172.21.15.146:0/1922423015 shutdown_connections 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x5646620b1f60 0x5646624f1da0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x5646624e18e0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73997fa640 0 client.7464 ms_handle_reset on v2:172.21.15.179:6834/9562532 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x5646624b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 1 --2- 172.21.15.146:0/1922423015 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624d6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 1 -- 172.21.15.146:0/1922423015 >> 172.21.15.146:0/1922423015 conn(0x5646620e74e0 msgr2=0x5646624e1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 1 -- 172.21.15.146:0/1922423015 shutdown_connections 2024-09-17T03:37:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 1 -- 172.21.15.146:0/1922423015 wait complete. 2024-09-17T03:37:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.486+0000 7f73c3687740 20 client.7464 trim_cache size 0 max 16384 2024-09-17T03:37:52.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.501+0000 7f73c3687740 1 Processor -- start 2024-09-17T03:37:52.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.501+0000 7f73c3687740 1 -- start start 2024-09-17T03:37:52.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.502+0000 7f73c3687740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624e1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.502+0000 7f73c3687740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x564662494f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.502+0000 7f73c3687740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x564662495490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.502+0000 7f73c3687740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f73b4201f00 con 0x5646620f3390 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.502+0000 7f73c3687740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40b5250 con 0x5646620d26b0 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.502+0000 7f73c3687740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f73b41fa030 con 0x5646620ca4d0 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f73bacb6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x564662495490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f73bacb6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x564662495490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56488/0 (socket says 172.21.15.146:56488) 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f73bacb6640 1 -- 172.21.15.146:0/237490788 learned_addr learned my addr 172.21.15.146:0/237490788 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/237490788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624e1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f73bacb6640 1 -- 172.21.15.146:0/237490788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 msgr2=0x5646624e1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f73b9cb4640 1 --2- 172.21.15.146:0/237490788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x564662494f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f73bacb6640 1 --2- 172.21.15.146:0/237490788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624e1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f73bacb6640 1 -- 172.21.15.146:0/237490788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 msgr2=0x564662494f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f73bacb6640 1 --2- 172.21.15.146:0/237490788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x564662494f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f73bacb6640 1 -- 172.21.15.146:0/237490788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56466240d700 con 0x5646620f3390 2024-09-17T03:37:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f73bacb6640 1 --2- 172.21.15.146:0/237490788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x564662495490 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f73ac005250 tx=0x7f73ac003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814ffdadcff16cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f739b7fe640 1 -- 172.21.15.146:0/237490788 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0019b0 con 0x5646620f3390 2024-09-17T03:37:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f739b7fe640 1 -- 172.21.15.146:0/237490788 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73ac019070 con 0x5646620f3390 2024-09-17T03:37:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.503+0000 7f739b7fe640 1 -- 172.21.15.146:0/237490788 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac014990 con 0x5646620f3390 2024-09-17T03:37:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.504+0000 7f73c3687740 1 -- 172.21.15.146:0/237490788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 msgr2=0x564662495490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.504+0000 7f73c3687740 1 --2- 172.21.15.146:0/237490788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x564662495490 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f73ac005250 tx=0x7f73ac003ea0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.504+0000 7f73c3687740 1 -- 172.21.15.146:0/237490788 shutdown_connections 2024-09-17T03:37:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.504+0000 7f73c3687740 1 --2- 172.21.15.146:0/237490788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620f3390 0x564662495490 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.504+0000 7f73c3687740 1 --2- 172.21.15.146:0/237490788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620d26b0 0x564662494f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.504+0000 7f73c3687740 1 --2- 172.21.15.146:0/237490788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646624e1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.504+0000 7f73c3687740 1 -- 172.21.15.146:0/237490788 >> 172.21.15.146:0/237490788 conn(0x5646620e74e0 msgr2=0x5646624905f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.504+0000 7f73c3687740 1 -- 172.21.15.146:0/237490788 shutdown_connections 2024-09-17T03:37:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.504+0000 7f73c3687740 1 -- 172.21.15.146:0/237490788 wait complete. 2024-09-17T03:37:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.505+0000 7f73c3687740 1 -- start start 2024-09-17T03:37:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.505+0000 7f73c3687740 1 Processor -- start 2024-09-17T03:37:52.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.506+0000 7f73c3687740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646625617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.506+0000 7f73c3687740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620d26b0 0x564662558190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.506+0000 7f73c3687740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620f3390 0x5646624d8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.506+0000 7f73c3687740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5646624d7530 con 0x5646620d26b0 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.506+0000 7f73c3687740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40b4c00 con 0x5646620f3390 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.506+0000 7f73c3687740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564662562120 con 0x5646620ca4d0 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.506+0000 7f73c3687740 10 client.0 _ll_register_callbacks cb 0x7f73ac007ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.506+0000 7f73b9cb4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620d26b0 0x564662558190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73b9cb4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620d26b0 0x564662558190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56492/0 (socket says 172.21.15.146:56492) 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73b9cb4640 1 -- 172.21.15.146:0/1085530928 learned_addr learned my addr 172.21.15.146:0/1085530928 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646625617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73bacb6640 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620f3390 0x5646624d8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73b9cb4640 1 -- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 msgr2=0x5646625617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73b9cb4640 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646625617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73b9cb4640 1 -- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620f3390 msgr2=0x5646624d8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73b9cb4640 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620f3390 0x5646624d8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73b9cb4640 1 -- 172.21.15.146:0/1085530928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56466249af00 con 0x5646620d26b0 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73b9cb4640 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620d26b0 0x564662558190 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f73a8062690 tx=0x7f73a800c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92205d0d4cfb2fd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73997fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73997fa640 1 -- 172.21.15.146:0/1085530928 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a80671e0 con 0x5646620d26b0 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73997fa640 1 -- 172.21.15.146:0/1085530928 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f73a80693e0 con 0x5646620d26b0 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73c3687740 1 -- 172.21.15.146:0/1085530928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73ac019070 con 0x5646620d26b0 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73997fa640 1 -- 172.21.15.146:0/1085530928 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f73a806c090 con 0x5646620d26b0 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73c3687740 10 client.7470 fetch_fsmap learned FSMap version 62 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73c3687740 1 -- 172.21.15.146:0/1085530928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x5646624d64d0 con 0x5646620d26b0 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73997fa640 1 -- 172.21.15.146:0/1085530928 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73ac019070 con 0x5646620d26b0 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73997fa640 1 -- 172.21.15.146:0/1085530928 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7f73a806b040 con 0x5646620d26b0 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73c3687740 10 client.7470 fetch_fsmap finished waiting for FSMap version 62 2024-09-17T03:37:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73c3687740 10 client.7470 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2024-09-17T03:37:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73c3687740 20 client.7470 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73c3687740 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x56466249a240 0x5646624b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.507+0000 7f73c3687740 4 client.7470 mds_command: new command op to 7311 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:37:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.508+0000 7f73c3687740 1 -- 172.21.15.146:0/1085530928 --> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56466240b460 con 0x56466249a240 2024-09-17T03:37:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.508+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x56466249a240 0x5646624b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.508+0000 7f73ba4b5640 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x56466249a240 0x5646624b2a80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6429aa6646701d6 server_cookie=d6c231a5f38db8c3 in_seq=0 out_seq=0 2024-09-17T03:37:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.508+0000 7f73997fa640 10 client.7470 ms_handle_connect on v2:172.21.15.179:6834/9562532 2024-09-17T03:37:52.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73997fa640 1 -- 172.21.15.146:0/1085530928 <== mds.0 v2:172.21.15.179:6834/9562532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56466240b460 con 0x56466249a240 2024-09-17T03:37:52.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73997fa640 10 client.7470 handle_command_reply: tid=0 2024-09-17T03:37:52.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 1 client.7470 shutdown 2024-09-17T03:37:52.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 1 -- 172.21.15.146:0/1085530928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620d26b0 msgr2=0x564662558190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620d26b0 0x564662558190 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f73a8062690 tx=0x7f73a800c380 comp rx=0 tx=0).stop 2024-09-17T03:37:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 1 -- 172.21.15.146:0/1085530928 shutdown_connections 2024-09-17T03:37:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:6834/9562532,v1:172.21.15.179:6836/9562532] conn(0x56466249a240 0x5646624b2a80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5646620f3390 0x5646624d8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646620d26b0 0x564662558190 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73997fa640 0 client.7470 ms_handle_reset on v2:172.21.15.179:6834/9562532 2024-09-17T03:37:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 1 --2- 172.21.15.146:0/1085530928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5646620ca4d0 0x5646625617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 1 -- 172.21.15.146:0/1085530928 >> 172.21.15.146:0/1085530928 conn(0x5646620e74e0 msgr2=0x5646624d9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 1 -- 172.21.15.146:0/1085530928 shutdown_connections 2024-09-17T03:37:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 1 -- 172.21.15.146:0/1085530928 wait complete. 2024-09-17T03:37:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.520+0000 7f73c3687740 20 client.7470 trim_cache size 0 max 16384 2024-09-17T03:37:52.520 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:37:52.521 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:37:52.521 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:37:52.521 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:37:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 -- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f73a0078bc0 msgr2=0x7f73a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f73a0078bc0 0x7f73a007b0d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f73a4034000 tx=0x7f73a4004ab0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 -- 172.21.15.146:0/3164844617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73b41620f0 msgr2=0x7f73b415e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73b41620f0 0x7f73b415e640 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f73a800c430 tx=0x7f73a800c8f0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 -- 172.21.15.146:0/3164844617 shutdown_connections 2024-09-17T03:37:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f73a0078bc0 0x7f73a007b0d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73b40cb8a0 0x7f73b415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73b41620f0 0x7f73b415e640 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 --2- 172.21.15.146:0/3164844617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73b40b3870 0x7f73b414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 -- 172.21.15.146:0/3164844617 >> 172.21.15.146:0/3164844617 conn(0x7f73b40d4be0 msgr2=0x7f73b41ea690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 -- 172.21.15.146:0/3164844617 shutdown_connections 2024-09-17T03:37:52.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.521+0000 7f73bc719640 1 -- 172.21.15.146:0/3164844617 wait complete. 2024-09-17T03:37:52.531 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:37:52.531 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:52.532 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:37:52.532 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:52.532 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:37:52.532 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:52.532 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:37:52.533 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:37:52.541 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:37:52.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-17T03:37:52.542 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:37:52.542 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-17T03:37:52.543 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:37:52.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-17T03:37:52.544 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:37:52.545 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-17T03:37:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fc508fb0640 1 -- 172.21.15.146:0/2695611623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc504070350 msgr2=0x7fc504072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fc508fb0640 1 --2- 172.21.15.146:0/2695611623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc504070350 0x7fc504072680 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80098e0 tx=0x7fc4f802a530 comp rx=0 tx=0).stop 2024-09-17T03:37:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fd000c94640 1 -- 172.21.15.146:0/2136779274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc072680 msgr2=0x7fcffc072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fd000c94640 1 --2- 172.21.15.146:0/2136779274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc072680 0x7fcffc072a90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009820 tx=0x7fcff002a410 comp rx=0 tx=0).stop 2024-09-17T03:37:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fc508fb0640 1 -- 172.21.15.146:0/2695611623 shutdown_connections 2024-09-17T03:37:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fd000c94640 1 -- 172.21.15.146:0/2136779274 shutdown_connections 2024-09-17T03:37:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fd000c94640 1 --2- 172.21.15.146:0/2136779274 >> v2:172.21.15.146:3300/0 conn(0x7fcffc0b4370 0x7fcffc0b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f5000358640 1 -- 172.21.15.146:0/1531434419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff80b3870 msgr2=0x7f4ff80cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fc508fb0640 1 --2- 172.21.15.146:0/2695611623 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc504070350 0x7fc504072680 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fc508fb0640 1 --2- 172.21.15.146:0/2695611623 >> v2:172.21.15.146:3300/0 conn(0x7fc50415b770 0x7fc50406fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fd000c94640 1 --2- 172.21.15.146:0/2136779274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc072680 0x7fcffc072a90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fd000c94640 1 -- 172.21.15.146:0/2136779274 >> 172.21.15.146:0/2136779274 conn(0x7fcffc0b2060 msgr2=0x7fcffc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f5000358640 1 --2- 172.21.15.146:0/1531434419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff80b3870 0x7f4ff80cf370 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80b73c0 tx=0x7f4ff402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fc508fb0640 1 -- 172.21.15.146:0/2695611623 >> 172.21.15.146:0/2695611623 conn(0x7fc5040b2060 msgr2=0x7fc5040b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fd000c94640 1 -- 172.21.15.146:0/2136779274 shutdown_connections 2024-09-17T03:37:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f0973f52640 1 -- 172.21.15.146:0/1477179269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f096c15f010 msgr2=0x7f096c1515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fd000c94640 1 -- 172.21.15.146:0/2136779274 wait complete. 2024-09-17T03:37:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f0973f52640 1 --2- 172.21.15.146:0/1477179269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f096c15f010 0x7f096c1515a0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f096c0713a0 tx=0x7f096402a810 comp rx=0 tx=0).stop 2024-09-17T03:37:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fc508fb0640 1 -- 172.21.15.146:0/2695611623 shutdown_connections 2024-09-17T03:37:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7fc508fb0640 1 -- 172.21.15.146:0/2695611623 wait complete. 2024-09-17T03:37:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f0973f52640 1 -- 172.21.15.146:0/1477179269 shutdown_connections 2024-09-17T03:37:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f0973f52640 1 --2- 172.21.15.146:0/1477179269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f096c15f010 0x7f096c1515a0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f0973f52640 1 --2- 172.21.15.146:0/1477179269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f096c0cfc40 0x7f096c15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f0973f52640 1 --2- 172.21.15.146:0/1477179269 >> v2:172.21.15.179:3300/0 conn(0x7f096c0b3360 0x7f096c072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f0973f52640 1 -- 172.21.15.146:0/1477179269 >> 172.21.15.146:0/1477179269 conn(0x7f096c0b2060 msgr2=0x7f096c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f0973f52640 1 -- 172.21.15.146:0/1477179269 shutdown_connections 2024-09-17T03:37:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f5000358640 1 -- 172.21.15.146:0/1531434419 shutdown_connections 2024-09-17T03:37:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f5000358640 1 --2- 172.21.15.146:0/1531434419 >> v2:172.21.15.146:3300/0 conn(0x7f4ff806f270 0x7f4ff81628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f5000358640 1 --2- 172.21.15.146:0/1531434419 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff81620f0 0x7f4ff806ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f5000358640 1 --2- 172.21.15.146:0/1531434419 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff80b3870 0x7f4ff80cf370 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f0973f52640 1 -- 172.21.15.146:0/1477179269 wait complete. 2024-09-17T03:37:52.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.710+0000 7f5000358640 1 -- 172.21.15.146:0/1531434419 >> 172.21.15.146:0/1531434419 conn(0x7f4ff80d4be0 msgr2=0x7f4ff80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:52.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.711+0000 7f5000358640 1 -- 172.21.15.146:0/1531434419 shutdown_connections 2024-09-17T03:37:52.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.711+0000 7f5000358640 1 -- 172.21.15.146:0/1531434419 wait complete. 2024-09-17T03:37:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.712+0000 7fd000c94640 1 Processor -- start 2024-09-17T03:37:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.712+0000 7fc508fb0640 1 Processor -- start 2024-09-17T03:37:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.712+0000 7fd000c94640 1 -- start start 2024-09-17T03:37:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.712+0000 7fc508fb0640 1 -- start start 2024-09-17T03:37:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.713+0000 7f5000358640 1 Processor -- start 2024-09-17T03:37:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.713+0000 7f0973f52640 1 Processor -- start 2024-09-17T03:37:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.713+0000 7f5000358640 1 -- start start 2024-09-17T03:37:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fd000c94640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc072680 0x7fcffc1458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fc508fb0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc504070350 0x7fc5041f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7f0973f52640 1 -- start start 2024-09-17T03:37:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fd000c94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc0b4370 0x7fcffc151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fc508fb0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc504072bc0 0x7fc504145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fd000c94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcffc15b770 0x7fcffc0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fd000c94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc0b5050 con 0x7fcffc15b770 2024-09-17T03:37:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fd000c94640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc0b4ed0 con 0x7fcffc0b4370 2024-09-17T03:37:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fd000c94640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc0b51d0 con 0x7fcffc072680 2024-09-17T03:37:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fc508fb0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc50415b770 0x7fc5040ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fc508fb0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc50415f9f0 con 0x7fc504070350 2024-09-17T03:37:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fcffad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcffc15b770 0x7fcffc0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fc508fb0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5040b5590 con 0x7fc504072bc0 2024-09-17T03:37:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fc508fb0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc50415fb70 con 0x7fc50415b770 2024-09-17T03:37:52.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fcffad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcffc15b770 0x7fcffc0ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56542/0 (socket says 172.21.15.146:56542) 2024-09-17T03:37:52.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fcffad9d640 1 -- 172.21.15.146:0/1950174953 learned_addr learned my addr 172.21.15.146:0/1950174953 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:52.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fcff9d9b640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc0b4370 0x7fcffc151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fc50259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc504070350 0x7fc5041f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fcffa59c640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc072680 0x7fcffc1458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fc501d9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc504072bc0 0x7fc504145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fc50259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc504070350 0x7fc5041f64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56540/0 (socket says 172.21.15.146:56540) 2024-09-17T03:37:52.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fc50259c640 1 -- 172.21.15.146:0/3527833480 learned_addr learned my addr 172.21.15.146:0/3527833480 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fc502d9d640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc50415b770 0x7fc5040ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fcffad9d640 1 -- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc072680 msgr2=0x7fcffc1458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fcffad9d640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc072680 0x7fcffc1458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fcffad9d640 1 -- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc0b4370 msgr2=0x7fcffc151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fcffad9d640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc0b4370 0x7fcffc151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fcffad9d640 1 -- 172.21.15.146:0/1950174953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc14bbb0 con 0x7fcffc15b770 2024-09-17T03:37:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.714+0000 7fcffa59c640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc072680 0x7fcffc1458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fc502d9d640 1 -- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc504072bc0 msgr2=0x7fc504145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fc502d9d640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc504072bc0 0x7fc504145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fc502d9d640 1 -- 172.21.15.146:0/3527833480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc504070350 msgr2=0x7fc5041f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fc502d9d640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc504070350 0x7fc5041f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fc502d9d640 1 -- 172.21.15.146:0/3527833480 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5041484a0 con 0x7fc50415b770 2024-09-17T03:37:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fcffad9d640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcffc15b770 0x7fcffc0ae890 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fcff400eab0 tx=0x7fcff400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fcfeaffd640 1 -- 172.21.15.146:0/1950174953 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff400cea0 con 0x7fcffc15b770 2024-09-17T03:37:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fcfeaffd640 1 -- 172.21.15.146:0/1950174953 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcff4004b20 con 0x7fcffc15b770 2024-09-17T03:37:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fd000c94640 1 -- 172.21.15.146:0/1950174953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc14be90 con 0x7fcffc15b770 2024-09-17T03:37:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fc502d9d640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc50415b770 0x7fc5040ae890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00c700 tx=0x7fc4fc00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fcfeaffd640 1 -- 172.21.15.146:0/1950174953 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4005020 con 0x7fcffc15b770 2024-09-17T03:37:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fd000c94640 1 -- 172.21.15.146:0/1950174953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc14c450 con 0x7fcffc15b770 2024-09-17T03:37:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fc4f2ffd640 1 -- 172.21.15.146:0/3527833480 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc003b70 con 0x7fc50415b770 2024-09-17T03:37:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fc4f2ffd640 1 -- 172.21.15.146:0/3527833480 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4fc003d10 con 0x7fc50415b770 2024-09-17T03:37:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.715+0000 7fc4f2ffd640 1 -- 172.21.15.146:0/3527833480 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc005330 con 0x7fc50415b770 2024-09-17T03:37:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f5000358640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff806f270 0x7f4ff8157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f5000358640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff80b3870 0x7f4ff80b9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f5000358640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff81620f0 0x7f4ff80b9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7fc508fb0640 1 -- 172.21.15.146:0/3527833480 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc504146150 con 0x7fc50415b770 2024-09-17T03:37:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7fc508fb0640 1 -- 172.21.15.146:0/3527833480 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5041f9790 con 0x7fc50415b770 2024-09-17T03:37:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f0973f52640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f096c0b3360 0x7f096c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f4ffd8f3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff80b3870 0x7f4ff80b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f4ffe0f4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff806f270 0x7f4ff8157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f0973f52640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f096c0cfc40 0x7f096c141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f4ffe0f4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff806f270 0x7f4ff8157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56552/0 (socket says 172.21.15.146:56552) 2024-09-17T03:37:52.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f4ffd8f3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff80b3870 0x7f4ff80b9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:37414/0 (socket says 172.21.15.146:37414) 2024-09-17T03:37:52.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f0973f52640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f096c15f010 0x7f096c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f4ffd8f3640 1 -- 172.21.15.146:0/643861266 learned_addr learned my addr 172.21.15.146:0/643861266 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:52.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f0973f52640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f096c06e800 con 0x7f096c0cfc40 2024-09-17T03:37:52.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f09714ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f096c0cfc40 0x7f096c141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f09714ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f096c0cfc40 0x7f096c141e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56556/0 (socket says 172.21.15.146:56556) 2024-09-17T03:37:52.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f09714ed640 1 -- 172.21.15.146:0/2584134520 learned_addr learned my addr 172.21.15.146:0/2584134520 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:52.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f4ffe8f5640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff81620f0 0x7f4ff80b9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8163170 con 0x7f4ff806f270 2024-09-17T03:37:52.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8162ff0 con 0x7f4ff80b3870 2024-09-17T03:37:52.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff81632f0 con 0x7f4ff81620f0 2024-09-17T03:37:52.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f09724ef640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f096c15f010 0x7f096c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f096c06e680 con 0x7f096c0b3360 2024-09-17T03:37:52.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f096c06e980 con 0x7f096c15f010 2024-09-17T03:37:52.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.716+0000 7f0971cee640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f096c0b3360 0x7f096c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f4ffd8f3640 1 -- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff81620f0 msgr2=0x7f4ff80b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f4ffd8f3640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff81620f0 0x7f4ff80b9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f4ffd8f3640 1 -- 172.21.15.146:0/643861266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff806f270 msgr2=0x7f4ff8157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f4ffd8f3640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff806f270 0x7f4ff8157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f4ffd8f3640 1 -- 172.21.15.146:0/643861266 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff81577b0 con 0x7f4ff80b3870 2024-09-17T03:37:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f4ffe0f4640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff806f270 0x7f4ff8157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:52.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f4ffe8f5640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff81620f0 0x7f4ff80b9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:52.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f0971cee640 1 -- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f096c15f010 msgr2=0x7f096c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f0971cee640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f096c15f010 0x7f096c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f0971cee640 1 -- 172.21.15.146:0/2584134520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f096c0cfc40 msgr2=0x7f096c141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:52.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f0971cee640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f096c0cfc40 0x7f096c141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:52.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f0971cee640 1 -- 172.21.15.146:0/2584134520 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c0aede0 con 0x7f096c0b3360 2024-09-17T03:37:52.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f4ffd8f3640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff80b3870 0x7f4ff80b9500 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800e790 tx=0x7f4fe800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7fd000c94640 1 -- 172.21.15.146:0/1950174953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcffc15b030 con 0x7fcffc15b770 2024-09-17T03:37:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f4feeffd640 1 -- 172.21.15.146:0/643861266 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe800eea0 con 0x7f4ff80b3870 2024-09-17T03:37:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f0971cee640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f096c0b3360 0x7f096c1530b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f096800e650 tx=0x7f096800eb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f4feeffd640 1 -- 172.21.15.146:0/643861266 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fe800ccc0 con 0x7f4ff80b3870 2024-09-17T03:37:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7fc508fb0640 1 -- 172.21.15.146:0/3527833480 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5041f9220 con 0x7fc50415b770 2024-09-17T03:37:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f4feeffd640 1 -- 172.21.15.146:0/643861266 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8005280 con 0x7f4ff80b3870 2024-09-17T03:37:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f09627fc640 1 -- 172.21.15.146:0/2584134520 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096800cab0 con 0x7f096c0b3360 2024-09-17T03:37:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f09627fc640 1 -- 172.21.15.146:0/2584134520 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f096800cd40 con 0x7f096c0b3360 2024-09-17T03:37:52.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.717+0000 7f09627fc640 1 -- 172.21.15.146:0/2584134520 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0968010690 con 0x7f096c0b3360 2024-09-17T03:37:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.718+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff81579c0 con 0x7f4ff80b3870 2024-09-17T03:37:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.718+0000 7fcfeaffd640 1 -- 172.21.15.146:0/1950174953 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcff40051c0 con 0x7fcffc15b770 2024-09-17T03:37:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.718+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff81f9d70 con 0x7f4ff80b3870 2024-09-17T03:37:52.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.719+0000 7fc4f2ffd640 1 -- 172.21.15.146:0/3527833480 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc4fc0054d0 con 0x7fc50415b770 2024-09-17T03:37:52.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.718+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096c152010 con 0x7f096c0b3360 2024-09-17T03:37:52.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.718+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096c1525d0 con 0x7f096c0b3360 2024-09-17T03:37:52.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.718+0000 7fcfeaffd640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcfdc078b90 0x7fcfdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.718+0000 7fcfeaffd640 1 -- 172.21.15.146:0/1950174953 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fcff409ba10 con 0x7fcffc15b770 2024-09-17T03:37:52.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.718+0000 7fcffa59c640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcfdc078b90 0x7fcfdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.719+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f096c15ead0 con 0x7f096c0b3360 2024-09-17T03:37:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.719+0000 7fcffa59c640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcfdc078b90 0x7fcfdc07b0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0015d0 tx=0x7fcfec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.719+0000 7fc4f2ffd640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4e4078c10 0x7fc4e407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.720+0000 7fc4f2ffd640 1 -- 172.21.15.146:0/3527833480 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7fc4fc09a800 con 0x7fc50415b770 2024-09-17T03:37:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.720+0000 7fc50259c640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4e4078c10 0x7fc4e407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.720+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff80cf370 con 0x7f4ff80b3870 2024-09-17T03:37:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.720+0000 7f4feeffd640 1 -- 172.21.15.146:0/643861266 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4fe8005420 con 0x7f4ff80b3870 2024-09-17T03:37:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.720+0000 7f09627fc640 1 -- 172.21.15.146:0/2584134520 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0968010830 con 0x7f096c0b3360 2024-09-17T03:37:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.720+0000 7fc50259c640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4e4078c10 0x7fc4e407b120 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400bc00 tx=0x7fc4f400b410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.721+0000 7f4feeffd640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fdc078b90 0x7f4fdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.721+0000 7f09627fc640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0950078b90 0x7f095007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:52.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.721+0000 7f4ffe0f4640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fdc078b90 0x7f4fdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.721+0000 7f09627fc640 1 -- 172.21.15.146:0/2584134520 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f096809b630 con 0x7f096c0b3360 2024-09-17T03:37:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.721+0000 7f09714ed640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0950078b90 0x7f095007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.721+0000 7f4ffe0f4640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fdc078b90 0x7f4fdc07b0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4033000 tx=0x7f4ff4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.722+0000 7f09714ed640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0950078b90 0x7f095007b0a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f096c1f2430 tx=0x7f095c00d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.724+0000 7fcfeaffd640 1 -- 172.21.15.146:0/1950174953 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcffc15b030 con 0x7fcffc15b770 2024-09-17T03:37:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.728+0000 7fc4f2ffd640 1 -- 172.21.15.146:0/3527833480 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc50415bb80 con 0x7fc50415b770 2024-09-17T03:37:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.729+0000 7f4feeffd640 1 -- 172.21.15.146:0/643861266 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5709+0+0 (secure 0 0 0) 0x7f4fe80995b0 con 0x7f4ff80b3870 2024-09-17T03:37:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.729+0000 7f09627fc640 1 -- 172.21.15.146:0/2584134520 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0968063a60 con 0x7f096c0b3360 2024-09-17T03:37:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.734+0000 7f4feeffd640 1 -- 172.21.15.146:0/643861266 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4fe80633b0 con 0x7f4ff80b3870 2024-09-17T03:37:52.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.985+0000 7fc508fb0640 1 -- 172.21.15.146:0/3527833480 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fc5041600a0 con 0x7fc50415b770 2024-09-17T03:37:52.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:52.986+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f096c0b55c0 con 0x7f096c0b3360 2024-09-17T03:37:53.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.002+0000 7fd000c94640 1 -- 172.21.15.146:0/1950174953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7fcffc072a90 con 0x7fcffc15b770 2024-09-17T03:37:53.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.008+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f4ff8157c50 con 0x7f4ff80b3870 2024-09-17T03:37:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.129+0000 7f09627fc640 1 -- 172.21.15.146:0/2584134520 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7293 v63) ==== 95+0+0 (secure 0 0 0) 0x7f0968063360 con 0x7f096c0b3360 2024-09-17T03:37:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 7293 2024-09-17T03:37:53.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0950078b90 msgr2=0x7f095007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0950078b90 0x7f095007b0a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f096c1f2430 tx=0x7f095c00d040 comp rx=0 tx=0).stop 2024-09-17T03:37:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f096c0b3360 msgr2=0x7f096c1530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f096c0b3360 0x7f096c1530b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f096800e650 tx=0x7f096800eb10 comp rx=0 tx=0).stop 2024-09-17T03:37:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 shutdown_connections 2024-09-17T03:37:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0950078b90 0x7f095007b0a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f096c15f010 0x7f096c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f096c0cfc40 0x7f096c141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 --2- 172.21.15.146:0/2584134520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f096c0b3360 0x7f096c1530b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 >> 172.21.15.146:0/2584134520 conn(0x7f096c0b2060 msgr2=0x7f096c151230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 shutdown_connections 2024-09-17T03:37:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.132+0000 7f0973f52640 1 -- 172.21.15.146:0/2584134520 wait complete. 2024-09-17T03:37:53.136 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:37:53.137+0000 7f82d3416640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:37:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.143+0000 7fcfeaffd640 1 -- 172.21.15.146:0/1950174953 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6239 v64) ==== 95+0+0 (secure 0 0 0) 0x7fcff4063dd0 con 0x7fcffc15b770 2024-09-17T03:37:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 6239 2024-09-17T03:37:53.144 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:37:53.145 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:37:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.146+0000 7fd000c94640 1 -- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcfdc078b90 msgr2=0x7fcfdc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.146+0000 7fd000c94640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcfdc078b90 0x7fcfdc07b0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0015d0 tx=0x7fcfec009040 comp rx=0 tx=0).stop 2024-09-17T03:37:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.146+0000 7fd000c94640 1 -- 172.21.15.146:0/1950174953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcffc15b770 msgr2=0x7fcffc0ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.146+0000 7fd000c94640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcffc15b770 0x7fcffc0ae890 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fcff400eab0 tx=0x7fcff400ef70 comp rx=0 tx=0).stop 2024-09-17T03:37:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.146+0000 7fd000c94640 1 -- 172.21.15.146:0/1950174953 shutdown_connections 2024-09-17T03:37:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.146+0000 7fd000c94640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcfdc078b90 0x7fcfdc07b0a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.146+0000 7fd000c94640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcffc15b770 0x7fcffc0ae890 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.146+0000 7fd000c94640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcffc0b4370 0x7fcffc151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.146+0000 7fd000c94640 1 --2- 172.21.15.146:0/1950174953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcffc072680 0x7fcffc1458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.146+0000 7fd000c94640 1 -- 172.21.15.146:0/1950174953 >> 172.21.15.146:0/1950174953 conn(0x7fcffc0b2060 msgr2=0x7fcffc1571c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:53.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.146+0000 7fd000c94640 1 -- 172.21.15.146:0/1950174953 shutdown_connections 2024-09-17T03:37:53.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.147+0000 7fd000c94640 1 -- 172.21.15.146:0/1950174953 wait complete. 2024-09-17T03:37:53.148 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:37:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.149+0000 7fc4f2ffd640 1 -- 172.21.15.146:0/3527833480 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6652 v64) ==== 95+0+0 (secure 0 0 0) 0x7fc4fc062760 con 0x7fc50415b770 2024-09-17T03:37:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 6652 2024-09-17T03:37:53.149 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:53.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7f4feeffd640 1 -- 172.21.15.146:0/643861266 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7311 v64) ==== 95+0+0 (secure 0 0 0) 0x7f4fe8062cb0 con 0x7f4ff80b3870 2024-09-17T03:37:53.152 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 7311 2024-09-17T03:37:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 -- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4e4078c10 msgr2=0x7fc4e407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4e4078c10 0x7fc4e407b120 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400bc00 tx=0x7fc4f400b410 comp rx=0 tx=0).stop 2024-09-17T03:37:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 -- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc50415b770 msgr2=0x7fc5040ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc50415b770 0x7fc5040ae890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00c700 tx=0x7fc4fc00cbc0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 -- 172.21.15.146:0/3527833480 shutdown_connections 2024-09-17T03:37:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc4e4078c10 0x7fc4e407b120 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc50415b770 0x7fc5040ae890 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc504072bc0 0x7fc504145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 --2- 172.21.15.146:0/3527833480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc504070350 0x7fc5041f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 -- 172.21.15.146:0/3527833480 >> 172.21.15.146:0/3527833480 conn(0x7fc5040b2060 msgr2=0x7fc5040b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 -- 172.21.15.146:0/3527833480 shutdown_connections 2024-09-17T03:37:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.153+0000 7fc508fb0640 1 -- 172.21.15.146:0/3527833480 wait complete. 2024-09-17T03:37:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fdc078b90 msgr2=0x7f4fdc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fdc078b90 0x7f4fdc07b0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4033000 tx=0x7f4ff4004730 comp rx=0 tx=0).stop 2024-09-17T03:37:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff80b3870 msgr2=0x7f4ff80b9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff80b3870 0x7f4ff80b9500 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800e790 tx=0x7f4fe800ec50 comp rx=0 tx=0).stop 2024-09-17T03:37:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 shutdown_connections 2024-09-17T03:37:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fdc078b90 0x7f4fdc07b0a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ff81620f0 0x7f4ff80b9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ff80b3870 0x7f4ff80b9500 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 --2- 172.21.15.146:0/643861266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ff806f270 0x7f4ff8157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 >> 172.21.15.146:0/643861266 conn(0x7f4ff80d4be0 msgr2=0x7f4ff80d3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:53.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 shutdown_connections 2024-09-17T03:37:53.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.155+0000 7f5000358640 1 -- 172.21.15.146:0/643861266 wait complete. 2024-09-17T03:37:53.161 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:37:53.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:37:53.164 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:37:53.164 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:53.168 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:37:53.168 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:37:53.169 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:37:53.169 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:37:53.171 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:37:53.171 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:53.210 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:37:53.211 DEBUG:teuthology.parallel:result is None 2024-09-17T03:37:53.211 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:53.234 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:37:53.288 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:37:53.288 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:37:53.297 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:37:53.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.330+0000 7fd487230640 1 -- 172.21.15.146:0/880827752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4801620f0 msgr2=0x7fd48006ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.330+0000 7fd487230640 1 --2- 172.21.15.146:0/880827752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4801620f0 0x7fd48006ed30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fd480069ce0 tx=0x7fd47402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.330+0000 7fd487230640 1 -- 172.21.15.146:0/880827752 shutdown_connections 2024-09-17T03:37:53.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.330+0000 7fd487230640 1 --2- 172.21.15.146:0/880827752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd48006f270 0x7fd4801628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.330+0000 7fd487230640 1 --2- 172.21.15.146:0/880827752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4801620f0 0x7fd48006ed30 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.330+0000 7fd487230640 1 --2- 172.21.15.146:0/880827752 >> v2:172.21.15.179:3300/0 conn(0x7fd4800b3870 0x7fd4800cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.330+0000 7fd487230640 1 -- 172.21.15.146:0/880827752 >> 172.21.15.146:0/880827752 conn(0x7fd4800d4be0 msgr2=0x7fd4800d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:53.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.330+0000 7fd487230640 1 -- 172.21.15.146:0/880827752 shutdown_connections 2024-09-17T03:37:53.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.330+0000 7fd487230640 1 -- 172.21.15.146:0/880827752 wait complete. 2024-09-17T03:37:53.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.332+0000 7fd487230640 1 Processor -- start 2024-09-17T03:37:53.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.332+0000 7fd487230640 1 -- start start 2024-09-17T03:37:53.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.333+0000 7fd487230640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd48006f270 0x7fd48015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.333+0000 7fd487230640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4800b3870 0x7fd4800ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.333+0000 7fd487230640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4801620f0 0x7fd4800ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.333+0000 7fd487230640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd480163170 con 0x7fd4801620f0 2024-09-17T03:37:53.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.333+0000 7fd487230640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd480162ff0 con 0x7fd4800b3870 2024-09-17T03:37:53.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.333+0000 7fd487230640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd4801632f0 con 0x7fd48006f270 2024-09-17T03:37:53.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.333+0000 7fd4857cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4801620f0 0x7fd4800ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.333+0000 7fd4857cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4801620f0 0x7fd4800ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56606/0 (socket says 172.21.15.146:56606) 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.333+0000 7fd4857cd640 1 -- 172.21.15.146:0/2595387969 learned_addr learned my addr 172.21.15.146:0/2595387969 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.333+0000 7fd484fcc640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd48006f270 0x7fd48015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.333+0000 7fd47ffff640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4800b3870 0x7fd4800ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.334+0000 7fd4857cd640 1 -- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd48006f270 msgr2=0x7fd48015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.334+0000 7fd4857cd640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd48006f270 0x7fd48015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.334+0000 7fd4857cd640 1 -- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4800b3870 msgr2=0x7fd4800ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.334+0000 7fd4857cd640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4800b3870 0x7fd4800ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.334+0000 7fd4857cd640 1 -- 172.21.15.146:0/2595387969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48015d340 con 0x7fd4801620f0 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.334+0000 7fd4857cd640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4801620f0 0x7fd4800ca5b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fd47800ea40 tx=0x7fd47800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.334+0000 7fd47d7fa640 1 -- 172.21.15.146:0/2595387969 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47800ce40 con 0x7fd4801620f0 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.334+0000 7fd47d7fa640 1 -- 172.21.15.146:0/2595387969 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd478004c10 con 0x7fd4801620f0 2024-09-17T03:37:53.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.334+0000 7fd487230640 1 -- 172.21.15.146:0/2595387969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4800ce720 con 0x7fd4801620f0 2024-09-17T03:37:53.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.334+0000 7fd47d7fa640 1 -- 172.21.15.146:0/2595387969 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478005020 con 0x7fd4801620f0 2024-09-17T03:37:53.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.334+0000 7fd487230640 1 -- 172.21.15.146:0/2595387969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4800cc730 con 0x7fd4801620f0 2024-09-17T03:37:53.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.335+0000 7fd487230640 1 -- 172.21.15.146:0/2595387969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4800cf370 con 0x7fd4801620f0 2024-09-17T03:37:53.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.336+0000 7fd47d7fa640 1 -- 172.21.15.146:0/2595387969 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd4780051c0 con 0x7fd4801620f0 2024-09-17T03:37:53.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.336+0000 7fd47d7fa640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd46c078b90 0x7fd46c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:53.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.337+0000 7fd47d7fa640 1 -- 172.21.15.146:0/2595387969 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7fd47809ba70 con 0x7fd4801620f0 2024-09-17T03:37:53.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.337+0000 7fd484fcc640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd46c078b90 0x7fd46c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:53.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.337+0000 7fd484fcc640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd46c078b90 0x7fd46c07b0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd470009ab0 tx=0x7fd470005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:53.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.341+0000 7fd47d7fa640 1 -- 172.21.15.146:0/2595387969 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd478063800 con 0x7fd4801620f0 2024-09-17T03:37:53.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.551+0000 7fd487230640 1 -- 172.21.15.146:0/2595387969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd48015e2a0 con 0x7fd4801620f0 2024-09-17T03:37:53.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.551+0000 7fd47d7fa640 1 -- 172.21.15.146:0/2595387969 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+1911 (secure 0 0 0) 0x7fd478068230 con 0x7fd4801620f0 2024-09-17T03:37:53.550 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:53.550 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":64,"btime":"2024-09-17T03:37:53:137732+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:53.137729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-17T03:37:53.551 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 64 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 -- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd46c078b90 msgr2=0x7fd46c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd46c078b90 0x7fd46c07b0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd470009ab0 tx=0x7fd470005f90 comp rx=0 tx=0).stop 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 -- 172.21.15.146:0/2595387969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4801620f0 msgr2=0x7fd4800ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4801620f0 0x7fd4800ca5b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fd47800ea40 tx=0x7fd47800ef00 comp rx=0 tx=0).stop 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 -- 172.21.15.146:0/2595387969 shutdown_connections 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd46c078b90 0x7fd46c07b0a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4801620f0 0x7fd4800ca5b0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4800b3870 0x7fd4800ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 --2- 172.21.15.146:0/2595387969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd48006f270 0x7fd48015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 -- 172.21.15.146:0/2595387969 >> 172.21.15.146:0/2595387969 conn(0x7fd4800d4be0 msgr2=0x7fd4800b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 -- 172.21.15.146:0/2595387969 shutdown_connections 2024-09-17T03:37:53.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:53.553+0000 7fd487230640 1 -- 172.21.15.146:0/2595387969 wait complete. 2024-09-17T03:37:53.966 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:37:43.428752+0000', 'modified': '2024-09-17T03:37:53.137729+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:37:53.966 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-17T03:37:54.967 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.095+0000 7f906f101640 1 -- 172.21.15.146:0/2869919765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9050004800 msgr2=0x7f9050004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.095+0000 7f906f101640 1 --2- 172.21.15.146:0/2869919765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9050004800 0x7f9050004c10 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f90680b7fe0 tx=0x7f9050005830 comp rx=0 tx=0).stop 2024-09-17T03:37:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.096+0000 7f906f101640 1 -- 172.21.15.146:0/2869919765 shutdown_connections 2024-09-17T03:37:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.096+0000 7f906f101640 1 --2- 172.21.15.146:0/2869919765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9050004800 0x7f9050004c10 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.096+0000 7f906f101640 1 -- 172.21.15.146:0/2869919765 >> 172.21.15.146:0/2869919765 conn(0x7f90680b7b20 msgr2=0x7f906809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.096+0000 7f906f101640 1 -- 172.21.15.146:0/2869919765 shutdown_connections 2024-09-17T03:37:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.096+0000 7f906f101640 1 -- 172.21.15.146:0/2869919765 wait complete. 2024-09-17T03:37:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.097+0000 7f906f101640 1 Processor -- start 2024-09-17T03:37:55.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.097+0000 7f906f101640 1 -- start start 2024-09-17T03:37:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906f101640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9050004800 0x7f906806f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906f101640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f906815d200 0x7f906806e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906f101640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9068159440 0x7f90680b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906f101640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90680b3620 con 0x7f9050004800 2024-09-17T03:37:55.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906f101640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f90680b1750 con 0x7f906815d200 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906f101640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f90680b37a0 con 0x7f9068159440 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906ce9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9050004800 0x7f906806f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906ce9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9050004800 0x7f906806f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56618/0 (socket says 172.21.15.146:56618) 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906ce9d640 1 -- 172.21.15.146:0/945638104 learned_addr learned my addr 172.21.15.146:0/945638104 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f905ffff640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f906815d200 0x7f906806e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906d69e640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9068159440 0x7f90680b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906ce9d640 1 -- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9068159440 msgr2=0x7f90680b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906ce9d640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9068159440 0x7f90680b61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906ce9d640 1 -- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f906815d200 msgr2=0x7f906806e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906ce9d640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f906815d200 0x7f906806e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906ce9d640 1 -- 172.21.15.146:0/945638104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906806fd60 con 0x7f9050004800 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f905ffff640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f906815d200 0x7f906806e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.099+0000 7f906d69e640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9068159440 0x7f90680b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.100+0000 7f906ce9d640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9050004800 0x7f906806f820 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f9064004d90 tx=0x7f9064001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.100+0000 7f905d7fa640 1 -- 172.21.15.146:0/945638104 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064017070 con 0x7f9050004800 2024-09-17T03:37:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.100+0000 7f905d7fa640 1 -- 172.21.15.146:0/945638104 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90640108c0 con 0x7f9050004800 2024-09-17T03:37:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.100+0000 7f906f101640 1 -- 172.21.15.146:0/945638104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906815dcc0 con 0x7f9050004800 2024-09-17T03:37:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.100+0000 7f905d7fa640 1 -- 172.21.15.146:0/945638104 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064001d40 con 0x7f9050004800 2024-09-17T03:37:55.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.100+0000 7f906f101640 1 -- 172.21.15.146:0/945638104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9068158c40 con 0x7f9050004800 2024-09-17T03:37:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.101+0000 7f906f101640 1 -- 172.21.15.146:0/945638104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90680b3d00 con 0x7f9050004800 2024-09-17T03:37:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.102+0000 7f905d7fa640 1 -- 172.21.15.146:0/945638104 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f906401a070 con 0x7f9050004800 2024-09-17T03:37:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.102+0000 7f905d7fa640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9054078b90 0x7f905407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.102+0000 7f905d7fa640 1 -- 172.21.15.146:0/945638104 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f906409a9c0 con 0x7f9050004800 2024-09-17T03:37:55.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.102+0000 7f905ffff640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9054078b90 0x7f905407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:55.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.103+0000 7f905ffff640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9054078b90 0x7f905407b0a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9058033000 tx=0x7f90680b6180 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:55.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.107+0000 7f905d7fa640 1 -- 172.21.15.146:0/945638104 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f906409ce20 con 0x7f9050004800 2024-09-17T03:37:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.323+0000 7f906f101640 1 -- 172.21.15.146:0/945638104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9068071710 con 0x7f9050004800 2024-09-17T03:37:55.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.323+0000 7f905d7fa640 1 -- 172.21.15.146:0/945638104 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5234 (secure 0 0 0) 0x7f9064062ec0 con 0x7f9050004800 2024-09-17T03:37:55.322 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:55.323 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":67,"btime":"2024-09-17T03:37:55:156699+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2734448758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2734448758},{"type":"v1","addr":"172.21.15.179:6837","nonce":2734448758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7497,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1302041078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1302041078},{"type":"v1","addr":"172.21.15.146:6833","nonce":1302041078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7506,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3947229505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3947229505},{"type":"v1","addr":"172.21.15.179:6835","nonce":3947229505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:54.166150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7515":{"gid":7515,"name":"a","rank":0,"incarnation":66,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.146:6835/2040023606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2040023606},{"type":"v1","addr":"172.21.15.146:6835","nonce":2040023606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-17T03:37:55.323 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 67 2024-09-17T03:37:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.325+0000 7f906f101640 1 -- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9054078b90 msgr2=0x7f905407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.325+0000 7f906f101640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9054078b90 0x7f905407b0a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9058033000 tx=0x7f90680b6180 comp rx=0 tx=0).stop 2024-09-17T03:37:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.325+0000 7f906f101640 1 -- 172.21.15.146:0/945638104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9050004800 msgr2=0x7f906806f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.325+0000 7f906f101640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9050004800 0x7f906806f820 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f9064004d90 tx=0x7f9064001630 comp rx=0 tx=0).stop 2024-09-17T03:37:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.325+0000 7f906f101640 1 -- 172.21.15.146:0/945638104 shutdown_connections 2024-09-17T03:37:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.325+0000 7f906f101640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9054078b90 0x7f905407b0a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.326+0000 7f906f101640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9068159440 0x7f90680b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.326+0000 7f906f101640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f906815d200 0x7f906806e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.326+0000 7f906f101640 1 --2- 172.21.15.146:0/945638104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9050004800 0x7f906806f820 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.326+0000 7f906f101640 1 -- 172.21.15.146:0/945638104 >> 172.21.15.146:0/945638104 conn(0x7f90680b7b20 msgr2=0x7f906815be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:55.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.326+0000 7f906f101640 1 -- 172.21.15.146:0/945638104 shutdown_connections 2024-09-17T03:37:55.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:55.326+0000 7f906f101640 1 -- 172.21.15.146:0/945638104 wait complete. 2024-09-17T03:37:55.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:37:43.428752+0000', 'modified': '2024-09-17T03:37:54.166150+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7515}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7515': {'gid': 7515, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.146:6835/2040023606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2040023606}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2040023606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:37:55.739 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7515:up:reconnect 2024-09-17T03:37:56.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.867+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/3589176122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e680701e0 msgr2=0x7f7e680cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.867+0000 7f7e6fe9b640 1 --2- 172.21.15.146:0/3589176122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e680701e0 0x7f7e680cfea0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f7e60005fd0 tx=0x7f7e6002a940 comp rx=0 tx=0).stop 2024-09-17T03:37:56.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.867+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/3589176122 shutdown_connections 2024-09-17T03:37:56.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.867+0000 7f7e6fe9b640 1 --2- 172.21.15.146:0/3589176122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e680701e0 0x7f7e680cfea0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.867+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/3589176122 >> 172.21.15.146:0/3589176122 conn(0x7f7e6806d3c0 msgr2=0x7f7e680b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:56.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.867+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/3589176122 shutdown_connections 2024-09-17T03:37:56.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.867+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/3589176122 wait complete. 2024-09-17T03:37:56.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.869+0000 7f7e6fe9b640 1 Processor -- start 2024-09-17T03:37:56.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.869+0000 7f7e6fe9b640 1 -- start start 2024-09-17T03:37:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.870+0000 7f7e6fe9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e680b4100 0x7f7e681481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.870+0000 7f7e6fe9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e681487d0 0x7f7e680aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.870+0000 7f7e6fe9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e680ab240 0x7f7e6814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.870+0000 7f7e6fe9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7e680d0560 con 0x7f7e681487d0 2024-09-17T03:37:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.870+0000 7f7e6fe9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7e680d03e0 con 0x7f7e680ab240 2024-09-17T03:37:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.870+0000 7f7e6fe9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7e680d06e0 con 0x7f7e680b4100 2024-09-17T03:37:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6d436640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e681487d0 0x7f7e680aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6d436640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e681487d0 0x7f7e680aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56634/0 (socket says 172.21.15.146:56634) 2024-09-17T03:37:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6d436640 1 -- 172.21.15.146:0/1598694322 learned_addr learned my addr 172.21.15.146:0/1598694322 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6dc37640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e680b4100 0x7f7e681481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6e438640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e680ab240 0x7f7e6814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6d436640 1 -- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e680b4100 msgr2=0x7f7e681481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6d436640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e680b4100 0x7f7e681481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6d436640 1 -- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e680ab240 msgr2=0x7f7e6814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6d436640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e680ab240 0x7f7e6814e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6d436640 1 -- 172.21.15.146:0/1598694322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e680ab650 con 0x7f7e681487d0 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6d436640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e681487d0 0x7f7e680aad00 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f7e5800c3a0 tx=0x7f7e5800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e5e7fc640 1 -- 172.21.15.146:0/1598694322 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e58017070 con 0x7f7e681487d0 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e5e7fc640 1 -- 172.21.15.146:0/1598694322 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e580053c0 con 0x7f7e681487d0 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/1598694322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e681f65e0 con 0x7f7e681487d0 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e5e7fc640 1 -- 172.21.15.146:0/1598694322 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e58003850 con 0x7f7e681487d0 2024-09-17T03:37:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.871+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/1598694322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e681f6ba0 con 0x7f7e681487d0 2024-09-17T03:37:56.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.872+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/1598694322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e680aa760 con 0x7f7e681487d0 2024-09-17T03:37:56.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.873+0000 7f7e5e7fc640 1 -- 172.21.15.146:0/1598694322 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e5801a070 con 0x7f7e681487d0 2024-09-17T03:37:56.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.873+0000 7f7e5e7fc640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e4c078b90 0x7f7e4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:56.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.874+0000 7f7e5e7fc640 1 -- 172.21.15.146:0/1598694322 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f7e58099fe0 con 0x7f7e681487d0 2024-09-17T03:37:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.874+0000 7f7e6dc37640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e4c078b90 0x7f7e4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.874+0000 7f7e6dc37640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e4c078b90 0x7f7e4c07b0a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7e640046b0 tx=0x7f7e64007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:56.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:56.878+0000 7f7e5e7fc640 1 -- 172.21.15.146:0/1598694322 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e680ab650 con 0x7f7e681487d0 2024-09-17T03:37:57.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.086+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/1598694322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e6815c9f0 con 0x7f7e681487d0 2024-09-17T03:37:57.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.087+0000 7f7e5e7fc640 1 -- 172.21.15.146:0/1598694322 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5231 (secure 0 0 0) 0x7f7e58061e00 con 0x7f7e681487d0 2024-09-17T03:37:57.086 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:57.086 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":68,"btime":"2024-09-17T03:37:56:158351+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2734448758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2734448758},{"type":"v1","addr":"172.21.15.179:6837","nonce":2734448758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7497,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1302041078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1302041078},{"type":"v1","addr":"172.21.15.146:6833","nonce":1302041078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7506,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3947229505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3947229505},{"type":"v1","addr":"172.21.15.179:6835","nonce":3947229505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:55.161682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7515":{"gid":7515,"name":"a","rank":0,"incarnation":66,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.146:6835/2040023606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2040023606},{"type":"v1","addr":"172.21.15.146:6835","nonce":2040023606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-17T03:37:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 68 2024-09-17T03:37:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e4c078b90 msgr2=0x7f7e4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e4c078b90 0x7f7e4c07b0a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7e640046b0 tx=0x7f7e64007e90 comp rx=0 tx=0).stop 2024-09-17T03:37:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/1598694322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e681487d0 msgr2=0x7f7e680aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e681487d0 0x7f7e680aad00 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f7e5800c3a0 tx=0x7f7e5800c860 comp rx=0 tx=0).stop 2024-09-17T03:37:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/1598694322 shutdown_connections 2024-09-17T03:37:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e4c078b90 0x7f7e4c07b0a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e680ab240 0x7f7e6814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e681487d0 0x7f7e680aad00 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 --2- 172.21.15.146:0/1598694322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e680b4100 0x7f7e681481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/1598694322 >> 172.21.15.146:0/1598694322 conn(0x7f7e6806d3c0 msgr2=0x7f7e680d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/1598694322 shutdown_connections 2024-09-17T03:37:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:57.089+0000 7f7e6fe9b640 1 -- 172.21.15.146:0/1598694322 wait complete. 2024-09-17T03:37:57.500 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:37:57.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:37:43.428752+0000', 'modified': '2024-09-17T03:37:55.161682+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7515}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7515': {'gid': 7515, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.146:6835/2040023606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2040023606}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2040023606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:37:57.503 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7515:up:rejoin 2024-09-17T03:37:57.503 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:37:58.503 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:37:58.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.631+0000 7f24a6464640 1 -- 172.21.15.146:0/873351348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a015c9f0 msgr2=0x7f24a01526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:58.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.631+0000 7f24a6464640 1 --2- 172.21.15.146:0/873351348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a015c9f0 0x7f24a01526a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f24a0069500 tx=0x7f249002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.631+0000 7f24a6464640 1 -- 172.21.15.146:0/873351348 shutdown_connections 2024-09-17T03:37:58.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.631+0000 7f24a6464640 1 --2- 172.21.15.146:0/873351348 >> v2:172.21.15.179:3300/0 conn(0x7f24a00b4100 0x7f24a006fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.631+0000 7f24a6464640 1 --2- 172.21.15.146:0/873351348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a015c9f0 0x7f24a01526a0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.631+0000 7f24a6464640 1 -- 172.21.15.146:0/873351348 >> 172.21.15.146:0/873351348 conn(0x7f24a006d3c0 msgr2=0x7f24a00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.631+0000 7f24a6464640 1 -- 172.21.15.146:0/873351348 shutdown_connections 2024-09-17T03:37:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.631+0000 7f24a6464640 1 -- 172.21.15.146:0/873351348 wait complete. 2024-09-17T03:37:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.633+0000 7f24a6464640 1 Processor -- start 2024-09-17T03:37:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.633+0000 7f24a6464640 1 -- start start 2024-09-17T03:37:58.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.634+0000 7f24a6464640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a00b4100 0x7f24a01f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.634+0000 7f24a6464640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00b4510 0x7f24a00cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.634+0000 7f24a6464640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a00cbbe0 0x7f24a006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.634+0000 7f24a6464640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f24a00d0730 con 0x7f24a00b4510 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.634+0000 7f24a6464640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24a00d05b0 con 0x7f24a00b4100 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.634+0000 7f24a6464640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f24a00d08b0 con 0x7f24a00cbbe0 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.634+0000 7f249f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00b4510 0x7f24a00cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.634+0000 7f249f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00b4510 0x7f24a00cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35332/0 (socket says 172.21.15.146:35332) 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.634+0000 7f249f7fe640 1 -- 172.21.15.146:0/2229474441 learned_addr learned my addr 172.21.15.146:0/2229474441 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.634+0000 7f249ffff640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a00b4100 0x7f24a01f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.634+0000 7f24a4a01640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a00cbbe0 0x7f24a006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f249f7fe640 1 -- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a00cbbe0 msgr2=0x7f24a006e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f249f7fe640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a00cbbe0 0x7f24a006e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f249f7fe640 1 -- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a00b4100 msgr2=0x7f24a01f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f249f7fe640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a00b4100 0x7f24a01f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f249f7fe640 1 -- 172.21.15.146:0/2229474441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a01f52c0 con 0x7f24a00b4510 2024-09-17T03:37:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f24a4a01640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a00cbbe0 0x7f24a006e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f249f7fe640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00b4510 0x7f24a00cb6a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f249400d700 tx=0x7f249400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f249cff9640 1 -- 172.21.15.146:0/2229474441 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494017070 con 0x7f24a00b4510 2024-09-17T03:37:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f249cff9640 1 -- 172.21.15.146:0/2229474441 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2494005310 con 0x7f24a00b4510 2024-09-17T03:37:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f249cff9640 1 -- 172.21.15.146:0/2229474441 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24940097c0 con 0x7f24a00b4510 2024-09-17T03:37:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f24a6464640 1 -- 172.21.15.146:0/2229474441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a01f55a0 con 0x7f24a00b4510 2024-09-17T03:37:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.635+0000 7f24a6464640 1 -- 172.21.15.146:0/2229474441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a00cc340 con 0x7f24a00b4510 2024-09-17T03:37:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.636+0000 7f24a6464640 1 -- 172.21.15.146:0/2229474441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a015c9f0 con 0x7f24a00b4510 2024-09-17T03:37:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.637+0000 7f249cff9640 1 -- 172.21.15.146:0/2229474441 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2494009960 con 0x7f24a00b4510 2024-09-17T03:37:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.638+0000 7f249cff9640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f248c078b90 0x7f248c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.638+0000 7f249cff9640 1 -- 172.21.15.146:0/2229474441 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f249409adb0 con 0x7f24a00b4510 2024-09-17T03:37:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.638+0000 7f249ffff640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f248c078b90 0x7f248c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:58.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.638+0000 7f249ffff640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f248c078b90 0x7f248c07b0a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2490033000 tx=0x7f2490004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:58.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.642+0000 7f249cff9640 1 -- 172.21.15.146:0/2229474441 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2494062b40 con 0x7f24a00b4510 2024-09-17T03:37:58.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.851+0000 7f24a6464640 1 -- 172.21.15.146:0/2229474441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24a00cefa0 con 0x7f24a00b4510 2024-09-17T03:37:58.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.851+0000 7f249cff9640 1 -- 172.21.15.146:0/2229474441 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5238 (secure 0 0 0) 0x7f2494067570 con 0x7f24a00b4510 2024-09-17T03:37:58.850 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:37:58.851 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":69,"btime":"2024-09-17T03:37:57:164566+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2734448758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2734448758},{"type":"v1","addr":"172.21.15.179:6837","nonce":2734448758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7497,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1302041078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1302041078},{"type":"v1","addr":"172.21.15.146:6833","nonce":1302041078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7506,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3947229505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3947229505},{"type":"v1","addr":"172.21.15.179:6835","nonce":3947229505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:57.164556+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7515":{"gid":7515,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2040023606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2040023606},{"type":"v1","addr":"172.21.15.146:6835","nonce":2040023606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7515,"qdb_cluster":[7515]},"id":6}]} 2024-09-17T03:37:58.851 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 69 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.853+0000 7f24a6464640 1 -- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f248c078b90 msgr2=0x7f248c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.853+0000 7f24a6464640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f248c078b90 0x7f248c07b0a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2490033000 tx=0x7f2490004730 comp rx=0 tx=0).stop 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.853+0000 7f24a6464640 1 -- 172.21.15.146:0/2229474441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00b4510 msgr2=0x7f24a00cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.853+0000 7f24a6464640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00b4510 0x7f24a00cb6a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f249400d700 tx=0x7f249400dbc0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.853+0000 7f24a6464640 1 -- 172.21.15.146:0/2229474441 shutdown_connections 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.853+0000 7f24a6464640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f248c078b90 0x7f248c07b0a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.853+0000 7f24a6464640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24a00cbbe0 0x7f24a006e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.853+0000 7f24a6464640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24a00b4510 0x7f24a00cb6a0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.853+0000 7f24a6464640 1 --2- 172.21.15.146:0/2229474441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24a00b4100 0x7f24a01f8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.853+0000 7f24a6464640 1 -- 172.21.15.146:0/2229474441 >> 172.21.15.146:0/2229474441 conn(0x7f24a006d3c0 msgr2=0x7f24a0151860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.853+0000 7f24a6464640 1 -- 172.21.15.146:0/2229474441 shutdown_connections 2024-09-17T03:37:58.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:58.854+0000 7f24a6464640 1 -- 172.21.15.146:0/2229474441 wait complete. 2024-09-17T03:37:59.266 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:37:43.428752+0000', 'modified': '2024-09-17T03:37:57.164556+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7515}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7515': {'gid': 7515, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.146:6835/2040023606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2040023606}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2040023606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7515, 'qdb_cluster': [7515]} 2024-09-17T03:37:59.267 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:37:59.267 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:37:59.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.383+0000 7f4d496c5640 1 -- 172.21.15.146:0/696191893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4406f270 msgr2=0x7f4d440d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.383+0000 7f4d496c5640 1 --2- 172.21.15.146:0/696191893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4406f270 0x7f4d440d3190 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c005fd0 tx=0x7f4d3c02a820 comp rx=0 tx=0).stop 2024-09-17T03:37:59.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.383+0000 7f4d496c5640 1 -- 172.21.15.146:0/696191893 shutdown_connections 2024-09-17T03:37:59.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.383+0000 7f4d496c5640 1 --2- 172.21.15.146:0/696191893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d4406f270 0x7f4d440d3190 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.383+0000 7f4d496c5640 1 --2- 172.21.15.146:0/696191893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d440cf370 0x7f4d4406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.383+0000 7f4d496c5640 1 -- 172.21.15.146:0/696191893 >> 172.21.15.146:0/696191893 conn(0x7f4d440d4be0 msgr2=0x7f4d440d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:59.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.384+0000 7f4d496c5640 1 -- 172.21.15.146:0/696191893 shutdown_connections 2024-09-17T03:37:59.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.384+0000 7f4d496c5640 1 -- 172.21.15.146:0/696191893 wait complete. 2024-09-17T03:37:59.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.385+0000 7f4d496c5640 1 Processor -- start 2024-09-17T03:37:59.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.385+0000 7f4d496c5640 1 -- start start 2024-09-17T03:37:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d496c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d4406f270 0x7f4d440ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d496c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d440b3870 0x7f4d44154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d496c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d440cf370 0x7f4d440ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d496c5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d440d3a60 con 0x7f4d440cf370 2024-09-17T03:37:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d496c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4d440d38e0 con 0x7f4d440b3870 2024-09-17T03:37:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d496c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4d440d3be0 con 0x7f4d4406f270 2024-09-17T03:37:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d437fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d440cf370 0x7f4d440ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d437fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d440cf370 0x7f4d440ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35348/0 (socket says 172.21.15.146:35348) 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d437fe640 1 -- 172.21.15.146:0/179566543 learned_addr learned my addr 172.21.15.146:0/179566543 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d3a7fc640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d440b3870 0x7f4d44154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d4406f270 0x7f4d440ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d437fe640 1 -- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d4406f270 msgr2=0x7f4d440ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d437fe640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d4406f270 0x7f4d440ab230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d437fe640 1 -- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d440b3870 msgr2=0x7f4d44154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d437fe640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d440b3870 0x7f4d44154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d437fe640 1 -- 172.21.15.146:0/179566543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d441f9910 con 0x7f4d440cf370 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.387+0000 7f4d437fe640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d440cf370 0x7f4d440ca230 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c006010 tx=0x7f4d3c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.388+0000 7f4d3bfff640 1 -- 172.21.15.146:0/179566543 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c037040 con 0x7f4d440cf370 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.388+0000 7f4d3bfff640 1 -- 172.21.15.146:0/179566543 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d3c042070 con 0x7f4d440cf370 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.388+0000 7f4d496c5640 1 -- 172.21.15.146:0/179566543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d441f9bf0 con 0x7f4d440cf370 2024-09-17T03:37:59.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.388+0000 7f4d3bfff640 1 -- 172.21.15.146:0/179566543 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0042a0 con 0x7f4d440cf370 2024-09-17T03:37:59.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.388+0000 7f4d496c5640 1 -- 172.21.15.146:0/179566543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d441fa1b0 con 0x7f4d440cf370 2024-09-17T03:37:59.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.389+0000 7f4d3bfff640 1 -- 172.21.15.146:0/179566543 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d3c004440 con 0x7f4d440cf370 2024-09-17T03:37:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.390+0000 7f4d3bfff640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d24078b90 0x7f4d2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.390+0000 7f4d3bfff640 1 -- 172.21.15.146:0/179566543 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f4d3c0bbad0 con 0x7f4d440cf370 2024-09-17T03:37:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.390+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d24078b90 0x7f4d2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.391+0000 7f4d50631740 1 Processor -- start 2024-09-17T03:37:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.391+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d24078b90 0x7f4d2407b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d440b3cb0 tx=0x7f4d34007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.391+0000 7f4d50631740 1 -- start start 2024-09-17T03:37:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.392+0000 7f4d50631740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cf6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.392+0000 7f4d50631740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f9038fc3b0 0x55f903cf74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.392+0000 7f4d50631740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903904590 0x55f903d143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.392+0000 7f4d50631740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f903c3f820 con 0x55f903925270 2024-09-17T03:37:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.392+0000 7f4d50631740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f903c2ec50 con 0x55f903904590 2024-09-17T03:37:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.392+0000 7f4d50631740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f903c32a60 con 0x55f9038fc3b0 2024-09-17T03:37:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.392+0000 7f4d42ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cf6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.392+0000 7f4d42ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cf6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35360/0 (socket says 172.21.15.146:35360) 2024-09-17T03:37:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.392+0000 7f4d42ffd640 1 -- 172.21.15.146:0/1931505754 learned_addr learned my addr 172.21.15.146:0/1931505754 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:59.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d3a7fc640 1 --2- 172.21.15.146:0/1931505754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f9038fc3b0 0x55f903cf74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d437fe640 1 --2- 172.21.15.146:0/1931505754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903904590 0x55f903d143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d42ffd640 1 -- 172.21.15.146:0/1931505754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f9038fc3b0 msgr2=0x55f903cf74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/1931505754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f9038fc3b0 0x55f903cf74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d42ffd640 1 -- 172.21.15.146:0/1931505754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903904590 msgr2=0x55f903d143e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/1931505754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903904590 0x55f903d143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d42ffd640 1 -- 172.21.15.146:0/1931505754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f903990850 con 0x55f903925270 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d3a7fc640 1 --2- 172.21.15.146:0/1931505754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f9038fc3b0 0x55f903cf74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/1931505754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cf6fa0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400fb20 tx=0x7f4d34012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91666886ef19acb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d38ff9640 1 -- 172.21.15.146:0/1931505754 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3401b050 con 0x55f903925270 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d38ff9640 1 -- 172.21.15.146:0/1931505754 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d34025070 con 0x55f903925270 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.393+0000 7f4d38ff9640 1 -- 172.21.15.146:0/1931505754 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34020440 con 0x55f903925270 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.394+0000 7f4d50631740 1 -- 172.21.15.146:0/1931505754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 msgr2=0x55f903cf6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.394+0000 7f4d50631740 1 --2- 172.21.15.146:0/1931505754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cf6fa0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400fb20 tx=0x7f4d34012000 comp rx=0 tx=0).stop 2024-09-17T03:37:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.394+0000 7f4d50631740 1 -- 172.21.15.146:0/1931505754 shutdown_connections 2024-09-17T03:37:59.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.394+0000 7f4d50631740 1 --2- 172.21.15.146:0/1931505754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903904590 0x55f903d143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.394+0000 7f4d50631740 1 --2- 172.21.15.146:0/1931505754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f9038fc3b0 0x55f903cf74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.394+0000 7f4d50631740 1 --2- 172.21.15.146:0/1931505754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cf6fa0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.394+0000 7f4d50631740 1 -- 172.21.15.146:0/1931505754 >> 172.21.15.146:0/1931505754 conn(0x55f9039193c0 msgr2=0x55f903ccd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:59.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.394+0000 7f4d50631740 1 -- 172.21.15.146:0/1931505754 shutdown_connections 2024-09-17T03:37:59.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.394+0000 7f4d50631740 1 -- 172.21.15.146:0/1931505754 wait complete. 2024-09-17T03:37:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.395+0000 7f4d50631740 1 -- start start 2024-09-17T03:37:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.395+0000 7f4d50631740 1 Processor -- start 2024-09-17T03:37:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d50631740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f9038fc3b0 0x55f903d097a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d50631740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903904590 0x55f903d0ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d50631740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903d20fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d50631740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f90399f620 con 0x55f903925270 2024-09-17T03:37:59.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d50631740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f903bd45f0 con 0x55f903904590 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d50631740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f903cf7a20 con 0x55f9038fc3b0 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d50631740 10 client.0 _ll_register_callbacks cb 0x55f903bd80a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d437fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903d20fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d437fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903d20fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35362/0 (socket says 172.21.15.146:35362) 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d437fe640 1 -- 172.21.15.146:0/3304450021 learned_addr learned my addr 172.21.15.146:0/3304450021 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f9038fc3b0 0x55f903d097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.396+0000 7f4d3a7fc640 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903904590 0x55f903d0ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d437fe640 1 -- 172.21.15.146:0/3304450021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f9038fc3b0 msgr2=0x55f903d097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d437fe640 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f9038fc3b0 0x55f903d097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d437fe640 1 -- 172.21.15.146:0/3304450021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903904590 msgr2=0x55f903d0ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d437fe640 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903904590 0x55f903d0ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d437fe640 1 -- 172.21.15.146:0/3304450021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f903a076b0 con 0x55f903925270 2024-09-17T03:37:59.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d437fe640 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903d20fd0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0b9fc0 tx=0x7f4d3c083090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675a40018ed8f731 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3304450021 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c009280 con 0x55f903925270 2024-09-17T03:37:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3304450021 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f4d3c082ac0 con 0x55f903925270 2024-09-17T03:37:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d50631740 1 -- 172.21.15.146:0/3304450021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d34025070 con 0x55f903925270 2024-09-17T03:37:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3304450021 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f4d3c083860 con 0x55f903925270 2024-09-17T03:37:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d50631740 10 client.7557 fetch_fsmap learned FSMap version 69 2024-09-17T03:37:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d50631740 1 -- 172.21.15.146:0/3304450021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55f903d08fa0 con 0x55f903925270 2024-09-17T03:37:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3304450021 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d34025070 con 0x55f903925270 2024-09-17T03:37:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3304450021 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f4d3c03a030 con 0x55f903925270 2024-09-17T03:37:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d50631740 10 client.7557 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T03:37:59.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d50631740 10 client.7557 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d50631740 20 client.7557 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d50631740 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x55f9038e3e40 0x55f903ce4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d50631740 4 client.7557 mds_command: new command op to 7515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.397+0000 7f4d50631740 1 -- 172.21.15.146:0/3304450021 --> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f903c41770 con 0x55f9038e3e40 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.398+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x55f9038e3e40 0x55f903ce4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.398+0000 7f4d21ffb640 10 client.7557 ms_handle_connect on v2:172.21.15.146:6834/2040023606 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.398+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x55f9038e3e40 0x55f903ce4fc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf0a504e201915f server_cookie=5bcd84a4b44aaed in_seq=0 out_seq=0 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3304450021 <== mds.0 v2:172.21.15.146:6834/2040023606 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f903c41770 con 0x55f9038e3e40 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d21ffb640 10 client.7557 handle_command_reply: tid=0 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 1 client.7557 shutdown 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 1 -- 172.21.15.146:0/3304450021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 msgr2=0x55f903d20fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903d20fd0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0b9fc0 tx=0x7f4d3c083090 comp rx=0 tx=0).stop 2024-09-17T03:37:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 1 -- 172.21.15.146:0/3304450021 shutdown_connections 2024-09-17T03:37:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x55f9038e3e40 0x55f903ce4fc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903d20fd0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903904590 0x55f903d0ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 1 --2- 172.21.15.146:0/3304450021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f9038fc3b0 0x55f903d097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d21ffb640 0 client.7557 ms_handle_reset on v2:172.21.15.146:6834/2040023606 2024-09-17T03:37:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 1 -- 172.21.15.146:0/3304450021 >> 172.21.15.146:0/3304450021 conn(0x55f9039193c0 msgr2=0x55f903d139b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 1 -- 172.21.15.146:0/3304450021 shutdown_connections 2024-09-17T03:37:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 1 -- 172.21.15.146:0/3304450021 wait complete. 2024-09-17T03:37:59.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.399+0000 7f4d50631740 20 client.7557 trim_cache size 0 max 16384 2024-09-17T03:37:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.417+0000 7f4d50631740 1 Processor -- start 2024-09-17T03:37:59.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.417+0000 7f4d50631740 1 -- start start 2024-09-17T03:37:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.418+0000 7f4d50631740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9038fc3b0 0x55f903cef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.418+0000 7f4d50631740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f903904590 0x55f903cf01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.418+0000 7f4d50631740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903925270 0x55f903cf3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.418+0000 7f4d50631740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d442012a0 con 0x55f9038fc3b0 2024-09-17T03:37:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.418+0000 7f4d50631740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4d44200630 con 0x55f903925270 2024-09-17T03:37:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.418+0000 7f4d50631740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4d44200c80 con 0x55f903904590 2024-09-17T03:37:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d42ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9038fc3b0 0x55f903cef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d42ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9038fc3b0 0x55f903cef2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35378/0 (socket says 172.21.15.146:35378) 2024-09-17T03:37:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d42ffd640 1 -- 172.21.15.146:0/1853806690 learned_addr learned my addr 172.21.15.146:0/1853806690 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d42ffd640 1 -- 172.21.15.146:0/1853806690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f903904590 msgr2=0x55f903cf01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:59.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/1853806690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f903904590 0x55f903cf01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d42ffd640 1 -- 172.21.15.146:0/1853806690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903925270 msgr2=0x55f903cf3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d437fe640 1 --2- 172.21.15.146:0/1853806690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903925270 0x55f903cf3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/1853806690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903925270 0x55f903cf3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d42ffd640 1 -- 172.21.15.146:0/1853806690 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f903d129d0 con 0x55f9038fc3b0 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d437fe640 1 --2- 172.21.15.146:0/1853806690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903925270 0x55f903cf3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/1853806690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9038fc3b0 0x55f903cef2b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f4d34001550 tx=0x7f4d34000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37df0c4749f7f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d23fff640 1 -- 172.21.15.146:0/1853806690 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3401b070 con 0x55f9038fc3b0 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d23fff640 1 -- 172.21.15.146:0/1853806690 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d34025040 con 0x55f9038fc3b0 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.419+0000 7f4d23fff640 1 -- 172.21.15.146:0/1853806690 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34020990 con 0x55f9038fc3b0 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.420+0000 7f4d50631740 1 -- 172.21.15.146:0/1853806690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9038fc3b0 msgr2=0x55f903cef2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.420+0000 7f4d50631740 1 --2- 172.21.15.146:0/1853806690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9038fc3b0 0x55f903cef2b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f4d34001550 tx=0x7f4d34000bc0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.420+0000 7f4d50631740 1 -- 172.21.15.146:0/1853806690 shutdown_connections 2024-09-17T03:37:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.420+0000 7f4d50631740 1 --2- 172.21.15.146:0/1853806690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f903925270 0x55f903cf3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.420+0000 7f4d50631740 1 --2- 172.21.15.146:0/1853806690 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f903904590 0x55f903cf01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.420+0000 7f4d50631740 1 --2- 172.21.15.146:0/1853806690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9038fc3b0 0x55f903cef2b0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.420+0000 7f4d50631740 1 -- 172.21.15.146:0/1853806690 >> 172.21.15.146:0/1853806690 conn(0x55f9039193c0 msgr2=0x55f903d2bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:59.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.420+0000 7f4d50631740 1 -- 172.21.15.146:0/1853806690 shutdown_connections 2024-09-17T03:37:59.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.420+0000 7f4d50631740 1 -- 172.21.15.146:0/1853806690 wait complete. 2024-09-17T03:37:59.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.421+0000 7f4d50631740 1 -- start start 2024-09-17T03:37:59.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.421+0000 7f4d50631740 1 Processor -- start 2024-09-17T03:37:59.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d50631740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f9038fc3b0 0x55f903d34db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d50631740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f903904590 0x55f903d90660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d50631740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cee1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d50631740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f903d0b1b0 con 0x55f903925270 2024-09-17T03:37:59.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d50631740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f90399f620 con 0x55f9038fc3b0 2024-09-17T03:37:59.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d50631740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f903d0abb0 con 0x55f903904590 2024-09-17T03:37:59.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d50631740 10 client.0 _ll_register_callbacks cb 0x7f4d3c009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d437fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cee1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d437fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cee1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35380/0 (socket says 172.21.15.146:35380) 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d437fe640 1 -- 172.21.15.146:0/3712365424 learned_addr learned my addr 172.21.15.146:0/3712365424 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f9038fc3b0 0x55f903d34db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.422+0000 7f4d3a7fc640 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f903904590 0x55f903d90660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d437fe640 1 -- 172.21.15.146:0/3712365424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f903904590 msgr2=0x55f903d90660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d437fe640 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f903904590 0x55f903d90660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d437fe640 1 -- 172.21.15.146:0/3712365424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f9038fc3b0 msgr2=0x55f903d34db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d437fe640 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f9038fc3b0 0x55f903d34db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d437fe640 1 -- 172.21.15.146:0/3712365424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f903d352f0 con 0x55f903925270 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d3a7fc640 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f903904590 0x55f903d90660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d437fe640 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cee1b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c083510 tx=0x7f4d3c082ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbeb20242371e70 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:37:59.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3712365424 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c009280 con 0x55f903925270 2024-09-17T03:37:59.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3712365424 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f4d3c084cf0 con 0x55f903925270 2024-09-17T03:37:59.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d50631740 1 -- 172.21.15.146:0/3712365424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d34025040 con 0x55f903925270 2024-09-17T03:37:59.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3712365424 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f4d3c095050 con 0x55f903925270 2024-09-17T03:37:59.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d50631740 10 client.7563 fetch_fsmap learned FSMap version 69 2024-09-17T03:37:59.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d50631740 1 -- 172.21.15.146:0/3712365424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55f903d352f0 con 0x55f903925270 2024-09-17T03:37:59.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3712365424 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d34025040 con 0x55f903925270 2024-09-17T03:37:59.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3712365424 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f4d3c098020 con 0x55f903925270 2024-09-17T03:37:59.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d50631740 10 client.7563 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T03:37:59.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d50631740 10 client.7563 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d50631740 20 client.7563 populate_metadata read hostname 'smithi146' 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d50631740 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x55f903d0b860 0x55f903ce4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d50631740 4 client.7563 mds_command: new command op to 7515 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.423+0000 7f4d50631740 1 -- 172.21.15.146:0/3712365424 --> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] -- command(tid 0: {"prefix": "status"}) -- 0x55f903c3d220 con 0x55f903d0b860 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x55f903d0b860 0x55f903ce4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d21ffb640 10 client.7563 ms_handle_connect on v2:172.21.15.146:6834/2040023606 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d42ffd640 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x55f903d0b860 0x55f903ce4f10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52f6b920bc0ec23d server_cookie=cffcc31476e74742 in_seq=0 out_seq=0 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d21ffb640 1 -- 172.21.15.146:0/3712365424 <== mds.0 v2:172.21.15.146:6834/2040023606 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f903c3d220 con 0x55f903d0b860 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d21ffb640 10 client.7563 handle_command_reply: tid=0 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 1 client.7563 shutdown 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 1 -- 172.21.15.146:0/3712365424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 msgr2=0x55f903cee1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cee1b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c083510 tx=0x7f4d3c082ec0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 1 -- 172.21.15.146:0/3712365424 shutdown_connections 2024-09-17T03:37:59.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x55f903d0b860 0x55f903ce4f10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f903925270 0x55f903cee1b0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d21ffb640 0 client.7563 ms_handle_reset on v2:172.21.15.146:6834/2040023606 2024-09-17T03:37:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f903904590 0x55f903d90660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 1 --2- 172.21.15.146:0/3712365424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f9038fc3b0 0x55f903d34db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 1 -- 172.21.15.146:0/3712365424 >> 172.21.15.146:0/3712365424 conn(0x55f9039193c0 msgr2=0x55f903cce180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 1 -- 172.21.15.146:0/3712365424 shutdown_connections 2024-09-17T03:37:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 1 -- 172.21.15.146:0/3712365424 wait complete. 2024-09-17T03:37:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.424+0000 7f4d50631740 20 client.7563 trim_cache size 0 max 16384 2024-09-17T03:37:59.430 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:37:59.430 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:37:59.431 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:37:59.431 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 7515, 2024-09-17T03:37:59.431 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:37:59.431 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:37:59.431 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:37:59.431 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 5.2667580330000003, 2024-09-17T03:37:59.431 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 69, 2024-09-17T03:37:59.431 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 92, 2024-09-17T03:37:59.431 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 92, 2024-09-17T03:37:59.431 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 6.1246021170000002 2024-09-17T03:37:59.431 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:37:59.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 -- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d24078b90 msgr2=0x7f4d2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d24078b90 0x7f4d2407b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d440b3cb0 tx=0x7f4d34007eb0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 -- 172.21.15.146:0/179566543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d440cf370 msgr2=0x7f4d440ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d440cf370 0x7f4d440ca230 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c006010 tx=0x7f4d3c032d10 comp rx=0 tx=0).stop 2024-09-17T03:37:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 -- 172.21.15.146:0/179566543 shutdown_connections 2024-09-17T03:37:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d24078b90 0x7f4d2407b0a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d440cf370 0x7f4d440ca230 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d440b3870 0x7f4d44154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 --2- 172.21.15.146:0/179566543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d4406f270 0x7f4d440ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 -- 172.21.15.146:0/179566543 >> 172.21.15.146:0/179566543 conn(0x7f4d440d4be0 msgr2=0x7f4d441603d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 -- 172.21.15.146:0/179566543 shutdown_connections 2024-09-17T03:37:59.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.425+0000 7f4d496c5640 1 -- 172.21.15.146:0/179566543 wait complete. 2024-09-17T03:37:59.435 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-17T03:37:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.552+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4115696826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ef4003a00 msgr2=0x7f2ef4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.552+0000 7f2f0f7ad640 1 --2- 172.21.15.146:0/4115696826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ef4003a00 0x7f2ef4003e50 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009b50 tx=0x7f2ef4005830 comp rx=0 tx=0).stop 2024-09-17T03:37:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.553+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4115696826 shutdown_connections 2024-09-17T03:37:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.553+0000 7f2f0f7ad640 1 --2- 172.21.15.146:0/4115696826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ef4003a00 0x7f2ef4003e50 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.553+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4115696826 >> 172.21.15.146:0/4115696826 conn(0x7f2f080b3150 msgr2=0x7f2f080b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.553+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4115696826 shutdown_connections 2024-09-17T03:37:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.553+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4115696826 wait complete. 2024-09-17T03:37:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.554+0000 7f2f0f7ad640 1 Processor -- start 2024-09-17T03:37:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.554+0000 7f2f0f7ad640 1 -- start start 2024-09-17T03:37:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0f7ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef4003a00 0x7f2f080b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0f7ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f080aa480 0x7f2f08158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0f7ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f08158a60 0x7f2f08158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0f7ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f080b5a10 con 0x7f2f08158a60 2024-09-17T03:37:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0f7ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2f080b5890 con 0x7f2f080aa480 2024-09-17T03:37:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0f7ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2f080b5b90 con 0x7f2ef4003a00 2024-09-17T03:37:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0dd4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f08158a60 0x7f2f08158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0dd4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f08158a60 0x7f2f08158e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35404/0 (socket says 172.21.15.146:35404) 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0dd4a640 1 -- 172.21.15.146:0/4246795710 learned_addr learned my addr 172.21.15.146:0/4246795710 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0dd4a640 1 -- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef4003a00 msgr2=0x7f2f080b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0d549640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef4003a00 0x7f2f080b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0cd48640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f080aa480 0x7f2f08158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0dd4a640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef4003a00 0x7f2f080b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0dd4a640 1 -- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f080aa480 msgr2=0x7f2f08158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0dd4a640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f080aa480 0x7f2f08158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0dd4a640 1 -- 172.21.15.146:0/4246795710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f080aaa20 con 0x7f2f08158a60 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0dd4a640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f08158a60 0x7f2f08158e70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2f08071a90 tx=0x7f2f0000e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2efdffb640 1 -- 172.21.15.146:0/4246795710 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00010890 con 0x7f2f08158a60 2024-09-17T03:37:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2efdffb640 1 -- 172.21.15.146:0/4246795710 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f00018070 con 0x7f2f08158a60 2024-09-17T03:37:59.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4246795710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f080aad00 con 0x7f2f08158a60 2024-09-17T03:37:59.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.556+0000 7f2efdffb640 1 -- 172.21.15.146:0/4246795710 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00010e00 con 0x7f2f08158a60 2024-09-17T03:37:59.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.557+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4246795710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f080ab2c0 con 0x7f2f08158a60 2024-09-17T03:37:59.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.558+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4246795710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f080b4ba0 con 0x7f2f08158a60 2024-09-17T03:37:59.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.558+0000 7f2efdffb640 1 -- 172.21.15.146:0/4246795710 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f0001d460 con 0x7f2f08158a60 2024-09-17T03:37:59.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.559+0000 7f2efdffb640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2eec078b90 0x7f2eec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.559+0000 7f2efdffb640 1 -- 172.21.15.146:0/4246795710 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f2f0009afe0 con 0x7f2f08158a60 2024-09-17T03:37:59.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.559+0000 7f2f0d549640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2eec078b90 0x7f2eec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.560+0000 7f2f0d549640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2eec078b90 0x7f2eec07b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2f04035000 tx=0x7f2f040046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.563+0000 7f2efdffb640 1 -- 172.21.15.146:0/4246795710 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f000633c0 con 0x7f2f08158a60 2024-09-17T03:37:59.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.737+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4246795710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f2f0815e980 con 0x7f2f08158a60 2024-09-17T03:37:59.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.741+0000 7f2efdffb640 1 -- 172.21.15.146:0/4246795710 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v46)=0 v46) ==== 117+0+0 (secure 0 0 0) 0x7f2f00062cc0 con 0x7f2f08158a60 2024-09-17T03:37:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.743+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2eec078b90 msgr2=0x7f2eec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.743+0000 7f2f0f7ad640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2eec078b90 0x7f2eec07b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2f04035000 tx=0x7f2f040046c0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.743+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4246795710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f08158a60 msgr2=0x7f2f08158e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.743+0000 7f2f0f7ad640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f08158a60 0x7f2f08158e70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2f08071a90 tx=0x7f2f0000e9a0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.743+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4246795710 shutdown_connections 2024-09-17T03:37:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.743+0000 7f2f0f7ad640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2eec078b90 0x7f2eec07b0a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.743+0000 7f2f0f7ad640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f08158a60 0x7f2f08158e70 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.743+0000 7f2f0f7ad640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f080aa480 0x7f2f08158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.743+0000 7f2f0f7ad640 1 --2- 172.21.15.146:0/4246795710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ef4003a00 0x7f2f080b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.743+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4246795710 >> 172.21.15.146:0/4246795710 conn(0x7f2f080b3150 msgr2=0x7f2f080b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.744+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4246795710 shutdown_connections 2024-09-17T03:37:59.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.744+0000 7f2f0f7ad640 1 -- 172.21.15.146:0/4246795710 wait complete. 2024-09-17T03:37:59.754 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-17T03:37:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.871+0000 7f33a42f2640 1 -- 172.21.15.146:0/3035391593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f339c0d0710 msgr2=0x7f339c0cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.871+0000 7f33a42f2640 1 --2- 172.21.15.146:0/3035391593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f339c0d0710 0x7f339c0cf170 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f3398005fd0 tx=0x7f339802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.871+0000 7f33a42f2640 1 -- 172.21.15.146:0/3035391593 shutdown_connections 2024-09-17T03:37:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.871+0000 7f33a42f2640 1 --2- 172.21.15.146:0/3035391593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f339c0b47c0 0x7f339c161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.871+0000 7f33a42f2640 1 --2- 172.21.15.146:0/3035391593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f339c0d0710 0x7f339c0cf170 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.871+0000 7f33a42f2640 1 -- 172.21.15.146:0/3035391593 >> 172.21.15.146:0/3035391593 conn(0x7f339c09ba20 msgr2=0x7f339c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:37:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.871+0000 7f33a42f2640 1 -- 172.21.15.146:0/3035391593 shutdown_connections 2024-09-17T03:37:59.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.871+0000 7f33a42f2640 1 -- 172.21.15.146:0/3035391593 wait complete. 2024-09-17T03:37:59.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.873+0000 7f33a42f2640 1 Processor -- start 2024-09-17T03:37:59.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.873+0000 7f33a42f2640 1 -- start start 2024-09-17T03:37:59.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.874+0000 7f33a42f2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f339c0b47c0 0x7f339c1e6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.874+0000 7f33a42f2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f339c0cf6b0 0x7f339c0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.874+0000 7f33a42f2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f339c0d0710 0x7f339c0b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.874+0000 7f33a42f2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f339c0b1de0 con 0x7f339c0d0710 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.874+0000 7f33a42f2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f339c162080 con 0x7f339c0cf6b0 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.874+0000 7f33a42f2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f339c0b1f60 con 0x7f339c0b47c0 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a288f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f339c0d0710 0x7f339c0b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a288f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f339c0d0710 0x7f339c0b0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35426/0 (socket says 172.21.15.146:35426) 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a288f640 1 -- 172.21.15.146:0/607266139 learned_addr learned my addr 172.21.15.146:0/607266139 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a208e640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f339c0b47c0 0x7f339c1e6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a188d640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f339c0cf6b0 0x7f339c0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a288f640 1 -- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f339c0b47c0 msgr2=0x7f339c1e6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a288f640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f339c0b47c0 0x7f339c1e6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a288f640 1 -- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f339c0cf6b0 msgr2=0x7f339c0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:37:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a288f640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f339c0cf6b0 0x7f339c0c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:37:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a288f640 1 -- 172.21.15.146:0/607266139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c0c8e00 con 0x7f339c0d0710 2024-09-17T03:37:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a208e640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f339c0b47c0 0x7f339c1e6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:37:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a288f640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f339c0d0710 0x7f339c0b0b50 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f339400cae0 tx=0x7f33940071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f3392ffd640 1 -- 172.21.15.146:0/607266139 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394007da0 con 0x7f339c0d0710 2024-09-17T03:37:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f3392ffd640 1 -- 172.21.15.146:0/607266139 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3394003990 con 0x7f339c0d0710 2024-09-17T03:37:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a42f2640 1 -- 172.21.15.146:0/607266139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339c06fad0 con 0x7f339c0d0710 2024-09-17T03:37:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f3392ffd640 1 -- 172.21.15.146:0/607266139 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394003e00 con 0x7f339c0d0710 2024-09-17T03:37:59.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.875+0000 7f33a42f2640 1 -- 172.21.15.146:0/607266139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f339c0c7520 con 0x7f339c0d0710 2024-09-17T03:37:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.876+0000 7f33a42f2640 1 -- 172.21.15.146:0/607266139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f339c0cf170 con 0x7f339c0d0710 2024-09-17T03:37:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.877+0000 7f3392ffd640 1 -- 172.21.15.146:0/607266139 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3394004030 con 0x7f339c0d0710 2024-09-17T03:37:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.878+0000 7f3392ffd640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3380078b90 0x7f338007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:37:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.878+0000 7f3392ffd640 1 -- 172.21.15.146:0/607266139 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f339409b390 con 0x7f339c0d0710 2024-09-17T03:37:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.878+0000 7f33a208e640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3380078b90 0x7f338007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:37:59.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.879+0000 7f33a208e640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3380078b90 0x7f338007b0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3398033000 tx=0x7f3398004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:37:59.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:37:59.882+0000 7f3392ffd640 1 -- 172.21.15.146:0/607266139 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3394014070 con 0x7f339c0d0710 2024-09-17T03:38:00.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.057+0000 7f33a42f2640 1 -- 172.21.15.146:0/607266139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f339c0ced70 con 0x7f339c0d0710 2024-09-17T03:38:00.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.063+0000 7f3392ffd640 1 -- 172.21.15.146:0/607266139 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v47)=0 v47) ==== 116+0+0 (secure 0 0 0) 0x7f3394063890 con 0x7f339c0d0710 2024-09-17T03:38:00.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 -- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3380078b90 msgr2=0x7f338007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3380078b90 0x7f338007b0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3398033000 tx=0x7f3398004730 comp rx=0 tx=0).stop 2024-09-17T03:38:00.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 -- 172.21.15.146:0/607266139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f339c0d0710 msgr2=0x7f339c0b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f339c0d0710 0x7f339c0b0b50 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f339400cae0 tx=0x7f33940071c0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 -- 172.21.15.146:0/607266139 shutdown_connections 2024-09-17T03:38:00.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3380078b90 0x7f338007b0a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f339c0d0710 0x7f339c0b0b50 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f339c0cf6b0 0x7f339c0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 --2- 172.21.15.146:0/607266139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f339c0b47c0 0x7f339c1e6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 -- 172.21.15.146:0/607266139 >> 172.21.15.146:0/607266139 conn(0x7f339c09ba20 msgr2=0x7f339c0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:00.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 -- 172.21.15.146:0/607266139 shutdown_connections 2024-09-17T03:38:00.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.065+0000 7f33a42f2640 1 -- 172.21.15.146:0/607266139 wait complete. 2024-09-17T03:38:00.076 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-17T03:38:00.156 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-09-17T03:38:00.157+0000 7f311ecfc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:38:00.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.196+0000 7f70ceaf2640 1 -- 172.21.15.146:0/3907117288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b0004d40 msgr2=0x7f70b0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.196+0000 7f70ceaf2640 1 --2- 172.21.15.146:0/3907117288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70b0004d40 0x7f70b0005150 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009ed0 tx=0x7f70b0005830 comp rx=0 tx=0).stop 2024-09-17T03:38:00.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.196+0000 7f70cd08f640 1 -- 172.21.15.146:0/3907117288 reap_dead start 2024-09-17T03:38:00.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.196+0000 7f70ceaf2640 1 -- 172.21.15.146:0/3907117288 shutdown_connections 2024-09-17T03:38:00.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.196+0000 7f70ceaf2640 1 -- 172.21.15.146:0/3907117288 >> 172.21.15.146:0/3907117288 conn(0x7f70c80b7b20 msgr2=0x7f70c809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:00.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.196+0000 7f70ceaf2640 1 -- 172.21.15.146:0/3907117288 shutdown_connections 2024-09-17T03:38:00.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.196+0000 7f70ceaf2640 1 -- 172.21.15.146:0/3907117288 wait complete. 2024-09-17T03:38:00.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.198+0000 7f70ceaf2640 1 Processor -- start 2024-09-17T03:38:00.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.198+0000 7f70ceaf2640 1 -- start start 2024-09-17T03:38:00.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70ceaf2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70c8142f30 0x7f70c8150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70ceaf2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70c8157780 0x7f70c8157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70ceaf2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70c8144fc0 0x7f70c81453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70ceaf2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f70c815cee0 con 0x7f70c8157780 2024-09-17T03:38:00.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70ceaf2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f70c815cd60 con 0x7f70c8144fc0 2024-09-17T03:38:00.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70ceaf2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f70c815d060 con 0x7f70c8142f30 2024-09-17T03:38:00.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70c7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70c8157780 0x7f70c8157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70c7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70c8157780 0x7f70c8157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35456/0 (socket says 172.21.15.146:35456) 2024-09-17T03:38:00.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70c7fff640 1 -- 172.21.15.146:0/1496734282 learned_addr learned my addr 172.21.15.146:0/1496734282 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:00.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70cd08f640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70c8144fc0 0x7f70c81453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70cc88e640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70c8142f30 0x7f70c8150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70c7fff640 1 -- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70c8142f30 msgr2=0x7f70c8150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70c7fff640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70c8142f30 0x7f70c8150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70c7fff640 1 -- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70c8144fc0 msgr2=0x7f70c81453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70c7fff640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70c8144fc0 0x7f70c81453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.199+0000 7f70c7fff640 1 -- 172.21.15.146:0/1496734282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c8145910 con 0x7f70c8157780 2024-09-17T03:38:00.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.200+0000 7f70c7fff640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70c8157780 0x7f70c8157b90 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f70bc011ae0 tx=0x7f70bc009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:00.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.200+0000 7f70c57fa640 1 -- 172.21.15.146:0/1496734282 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc00fc70 con 0x7f70c8157780 2024-09-17T03:38:00.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.200+0000 7f70c57fa640 1 -- 172.21.15.146:0/1496734282 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70bc00fe10 con 0x7f70c8157780 2024-09-17T03:38:00.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.200+0000 7f70ceaf2640 1 -- 172.21.15.146:0/1496734282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c8152750 con 0x7f70c8157780 2024-09-17T03:38:00.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.200+0000 7f70c57fa640 1 -- 172.21.15.146:0/1496734282 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc004280 con 0x7f70c8157780 2024-09-17T03:38:00.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.200+0000 7f70ceaf2640 1 -- 172.21.15.146:0/1496734282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c8152ff0 con 0x7f70c8157780 2024-09-17T03:38:00.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.201+0000 7f70ceaf2640 1 -- 172.21.15.146:0/1496734282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c80b3620 con 0x7f70c8157780 2024-09-17T03:38:00.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.202+0000 7f70c57fa640 1 -- 172.21.15.146:0/1496734282 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f70bc0035f0 con 0x7f70c8157780 2024-09-17T03:38:00.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.202+0000 7f70c57fa640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70b4078b90 0x7f70b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.202+0000 7f70c57fa640 1 -- 172.21.15.146:0/1496734282 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f70bc09b740 con 0x7f70c8157780 2024-09-17T03:38:00.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.202+0000 7f70cc88e640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70b4078b90 0x7f70b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.203+0000 7f70cc88e640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70b4078b90 0x7f70b407b0a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f70c80a0710 tx=0x7f70b8001270 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:00.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.207+0000 7f70c57fa640 1 -- 172.21.15.146:0/1496734282 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f70c8145910 con 0x7f70c8157780 2024-09-17T03:38:00.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.381+0000 7f70ceaf2640 1 -- 172.21.15.146:0/1496734282 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f70c8158400 con 0x7f70c8157780 2024-09-17T03:38:00.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.387+0000 7f70c57fa640 1 -- 172.21.15.146:0/1496734282 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v48)=0 v48) ==== 116+0+0 (secure 0 0 0) 0x7f70bc063560 con 0x7f70c8157780 2024-09-17T03:38:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.389+0000 7f70ceaf2640 1 -- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70b4078b90 msgr2=0x7f70b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.389+0000 7f70ceaf2640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70b4078b90 0x7f70b407b0a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f70c80a0710 tx=0x7f70b8001270 comp rx=0 tx=0).stop 2024-09-17T03:38:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.389+0000 7f70ceaf2640 1 -- 172.21.15.146:0/1496734282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70c8157780 msgr2=0x7f70c8157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.389+0000 7f70ceaf2640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70c8157780 0x7f70c8157b90 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f70bc011ae0 tx=0x7f70bc009e80 comp rx=0 tx=0).stop 2024-09-17T03:38:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.389+0000 7f70ceaf2640 1 -- 172.21.15.146:0/1496734282 shutdown_connections 2024-09-17T03:38:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.389+0000 7f70ceaf2640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f70b4078b90 0x7f70b407b0a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.390+0000 7f70ceaf2640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f70c8144fc0 0x7f70c81453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.390+0000 7f70ceaf2640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70c8157780 0x7f70c8157b90 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.390+0000 7f70ceaf2640 1 --2- 172.21.15.146:0/1496734282 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f70c8142f30 0x7f70c8150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.390+0000 7f70ceaf2640 1 -- 172.21.15.146:0/1496734282 >> 172.21.15.146:0/1496734282 conn(0x7f70c80b7b20 msgr2=0x7f70c8070820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.390+0000 7f70ceaf2640 1 -- 172.21.15.146:0/1496734282 shutdown_connections 2024-09-17T03:38:00.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.390+0000 7f70ceaf2640 1 -- 172.21.15.146:0/1496734282 wait complete. 2024-09-17T03:38:00.400 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:00.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.514+0000 7f9202884640 1 -- 172.21.15.146:0/3572199263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91fc0b5750 msgr2=0x7f91fc0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.514+0000 7f9202884640 1 --2- 172.21.15.146:0/3572199263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91fc0b5750 0x7f91fc0b3620 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009830 tx=0x7f91f002a510 comp rx=0 tx=0).stop 2024-09-17T03:38:00.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.514+0000 7f9202884640 1 -- 172.21.15.146:0/3572199263 shutdown_connections 2024-09-17T03:38:00.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.514+0000 7f9202884640 1 --2- 172.21.15.146:0/3572199263 >> v2:172.21.15.179:3300/0 conn(0x7f91fc0b3b60 0x7f91fc15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.514+0000 7f9202884640 1 --2- 172.21.15.146:0/3572199263 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91fc0b5750 0x7f91fc0b3620 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.514+0000 7f9202884640 1 -- 172.21.15.146:0/3572199263 >> 172.21.15.146:0/3572199263 conn(0x7f91fc0b7b20 msgr2=0x7f91fc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:00.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.514+0000 7f9202884640 1 -- 172.21.15.146:0/3572199263 shutdown_connections 2024-09-17T03:38:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.514+0000 7f9202884640 1 -- 172.21.15.146:0/3572199263 wait complete. 2024-09-17T03:38:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.516+0000 7f9202884640 1 Processor -- start 2024-09-17T03:38:00.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.516+0000 7f9202884640 1 -- start start 2024-09-17T03:38:00.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.517+0000 7f9202884640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91fc0b3b60 0x7f91fc0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.517+0000 7f9202884640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc0b5750 0x7f91fc1f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f9202884640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91fc0b5ce0 0x7f91fc157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f9202884640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc15d460 con 0x7f91fc0b5750 2024-09-17T03:38:00.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f9202884640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc15d2e0 con 0x7f91fc0b5ce0 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f9202884640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f91fc15d5e0 con 0x7f91fc0b3b60 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91fb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc0b5750 0x7f91fc1f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91fb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc0b5750 0x7f91fc1f3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35466/0 (socket says 172.21.15.146:35466) 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91fb7fe640 1 -- 172.21.15.146:0/1711886506 learned_addr learned my addr 172.21.15.146:0/1711886506 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91fbfff640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91fc0b3b60 0x7f91fc0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f9200e21640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91fc0b5ce0 0x7f91fc157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91fb7fe640 1 -- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91fc0b3b60 msgr2=0x7f91fc0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91fb7fe640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91fc0b3b60 0x7f91fc0c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91fb7fe640 1 -- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91fc0b5ce0 msgr2=0x7f91fc157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91fb7fe640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91fc0b5ce0 0x7f91fc157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91fb7fe640 1 -- 172.21.15.146:0/1711886506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc0a06f0 con 0x7f91fc0b5750 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f9200e21640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91fc0b5ce0 0x7f91fc157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91fb7fe640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc0b5750 0x7f91fc1f3fb0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009950 tx=0x7f91f0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91f8ff9640 1 -- 172.21.15.146:0/1711886506 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f0005c90 con 0x7f91fc0b5750 2024-09-17T03:38:00.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f9202884640 1 -- 172.21.15.146:0/1711886506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91fc1f44f0 con 0x7f91fc0b5750 2024-09-17T03:38:00.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91f8ff9640 1 -- 172.21.15.146:0/1711886506 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91f0031e50 con 0x7f91fc0b5750 2024-09-17T03:38:00.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.518+0000 7f91f8ff9640 1 -- 172.21.15.146:0/1711886506 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f0005260 con 0x7f91fc0b5750 2024-09-17T03:38:00.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.519+0000 7f9202884640 1 -- 172.21.15.146:0/1711886506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91fc0c76a0 con 0x7f91fc0b5750 2024-09-17T03:38:00.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.520+0000 7f9202884640 1 -- 172.21.15.146:0/1711886506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91fc09fc60 con 0x7f91fc0b5750 2024-09-17T03:38:00.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.520+0000 7f91f8ff9640 1 -- 172.21.15.146:0/1711886506 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f91f0005400 con 0x7f91fc0b5750 2024-09-17T03:38:00.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.521+0000 7f91f8ff9640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f91e8078bc0 0x7f91e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.521+0000 7f91f8ff9640 1 -- 172.21.15.146:0/1711886506 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f91f00bbee0 con 0x7f91fc0b5750 2024-09-17T03:38:00.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.521+0000 7f91fbfff640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f91e8078bc0 0x7f91e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.521+0000 7f91fbfff640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f91e8078bc0 0x7f91e807b0d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0013f0 tx=0x7f91ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:00.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.525+0000 7f91f8ff9640 1 -- 172.21.15.146:0/1711886506 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f91fc1f44f0 con 0x7f91fc0b5750 2024-09-17T03:38:00.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.733+0000 7f9202884640 1 -- 172.21.15.146:0/1711886506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91fc15caa0 con 0x7f91fc0b5750 2024-09-17T03:38:00.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.734+0000 7f91f8ff9640 1 -- 172.21.15.146:0/1711886506 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5238 (secure 0 0 0) 0x7f91f003f030 con 0x7f91fc0b5750 2024-09-17T03:38:00.733 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:00.733 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":69,"btime":"2024-09-17T03:37:57:164566+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2734448758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2734448758},{"type":"v1","addr":"172.21.15.179:6837","nonce":2734448758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7497,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1302041078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1302041078},{"type":"v1","addr":"172.21.15.146:6833","nonce":1302041078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7506,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3947229505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3947229505},{"type":"v1","addr":"172.21.15.179:6835","nonce":3947229505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:57.164556+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7515":{"gid":7515,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2040023606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2040023606},{"type":"v1","addr":"172.21.15.146:6835","nonce":2040023606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7515,"qdb_cluster":[7515]},"id":6}]} 2024-09-17T03:38:00.733 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 69 2024-09-17T03:38:00.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 -- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f91e8078bc0 msgr2=0x7f91e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f91e8078bc0 0x7f91e807b0d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0013f0 tx=0x7f91ec009040 comp rx=0 tx=0).stop 2024-09-17T03:38:00.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 -- 172.21.15.146:0/1711886506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc0b5750 msgr2=0x7f91fc1f3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc0b5750 0x7f91fc1f3fb0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009950 tx=0x7f91f0033c20 comp rx=0 tx=0).stop 2024-09-17T03:38:00.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 -- 172.21.15.146:0/1711886506 shutdown_connections 2024-09-17T03:38:00.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f91e8078bc0 0x7f91e807b0d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91fc0b5ce0 0x7f91fc157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91fc0b5750 0x7f91fc1f3fb0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 --2- 172.21.15.146:0/1711886506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91fc0b3b60 0x7f91fc0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 -- 172.21.15.146:0/1711886506 >> 172.21.15.146:0/1711886506 conn(0x7f91fc0b7b20 msgr2=0x7f91fc15f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 -- 172.21.15.146:0/1711886506 shutdown_connections 2024-09-17T03:38:00.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.736+0000 7f9202884640 1 -- 172.21.15.146:0/1711886506 wait complete. 2024-09-17T03:38:00.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-17T03:38:00.868 INFO:teuthology.orchestra.run.smithi146.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T03:37:51.721243+0000","btime":"2024-09-17T03:37:50.925255+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T03:37:51.721243+0000","atime":"2024-09-17T03:37:50.925255+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T03:37:51.721243+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:37:51.722243+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:37:51.722243+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T03:38:00.869 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-17T03:37:51.722243+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T03:37:50.925255+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T03:37:50.925255+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T03:37:51.721243+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-17T03:37:51.721243+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T03:37:51.721243+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-17T03:37:51.722243+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T03:38:00.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:00.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /testdir recursive 2024-09-17T03:38:00.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.987+0000 7f6f30fc3640 1 -- 172.21.15.146:0/1010415751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2c0b47c0 msgr2=0x7f6f2c161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.987+0000 7f6f30fc3640 1 --2- 172.21.15.146:0/1010415751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2c0b47c0 0x7f6f2c161930 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f6f24005fd0 tx=0x7f6f2402a820 comp rx=0 tx=0).stop 2024-09-17T03:38:00.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.987+0000 7f6f30fc3640 1 -- 172.21.15.146:0/1010415751 shutdown_connections 2024-09-17T03:38:00.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.988+0000 7f6f30fc3640 1 --2- 172.21.15.146:0/1010415751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2c0b47c0 0x7f6f2c161930 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.988+0000 7f6f30fc3640 1 --2- 172.21.15.146:0/1010415751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f2c0d0710 0x7f6f2c0cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.988+0000 7f6f30fc3640 1 -- 172.21.15.146:0/1010415751 >> 172.21.15.146:0/1010415751 conn(0x7f6f2c09ba20 msgr2=0x7f6f2c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:00.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.988+0000 7f6f30fc3640 1 -- 172.21.15.146:0/1010415751 shutdown_connections 2024-09-17T03:38:00.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.988+0000 7f6f30fc3640 1 -- 172.21.15.146:0/1010415751 wait complete. 2024-09-17T03:38:00.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.989+0000 7f6f30fc3640 1 Processor -- start 2024-09-17T03:38:00.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.989+0000 7f6f30fc3640 1 -- start start 2024-09-17T03:38:00.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f30fc3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f2c0b47c0 0x7f6f2c15f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f30fc3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f2c0cf6b0 0x7f6f2c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f30fc3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2c0d0710 0x7f6f2c0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f30fc3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c0b1de0 con 0x7f6f2c0d0710 2024-09-17T03:38:00.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f30fc3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c162080 con 0x7f6f2c0b47c0 2024-09-17T03:38:00.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f30fc3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2c0b1f60 con 0x7f6f2c0cf6b0 2024-09-17T03:38:00.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f2ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2c0d0710 0x7f6f2c0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f2ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2c0d0710 0x7f6f2c0cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35482/0 (socket says 172.21.15.146:35482) 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/3808847713 learned_addr learned my addr 172.21.15.146:0/3808847713 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f29d9b640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f2c0cf6b0 0x7f6f2c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f2c0b47c0 0x7f6f2c15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f2c0cf6b0 msgr2=0x7f6f2c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f2ad9d640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f2c0cf6b0 0x7f6f2c0cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f2c0b47c0 msgr2=0x7f6f2c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f2ad9d640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f2c0b47c0 0x7f6f2c15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/3808847713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2c1f9060 con 0x7f6f2c0d0710 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f29d9b640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f2c0cf6b0 0x7f6f2c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f2c0b47c0 0x7f6f2c15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:00.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f2ad9d640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2c0d0710 0x7f6f2c0cb9f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f6f24006010 tx=0x7f6f24032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:00.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.991+0000 7f6f1affd640 1 -- 172.21.15.146:0/3808847713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24037040 con 0x7f6f2c0d0710 2024-09-17T03:38:00.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.992+0000 7f6f1affd640 1 -- 172.21.15.146:0/3808847713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f24042070 con 0x7f6f2c0d0710 2024-09-17T03:38:00.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.992+0000 7f6f30fc3640 1 -- 172.21.15.146:0/3808847713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2c06fa30 con 0x7f6f2c0d0710 2024-09-17T03:38:00.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.992+0000 7f6f1affd640 1 -- 172.21.15.146:0/3808847713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f240042a0 con 0x7f6f2c0d0710 2024-09-17T03:38:00.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.992+0000 7f6f30fc3640 1 -- 172.21.15.146:0/3808847713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2c1f95e0 con 0x7f6f2c0d0710 2024-09-17T03:38:00.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.993+0000 7f6f1affd640 1 -- 172.21.15.146:0/3808847713 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f24004440 con 0x7f6f2c0d0710 2024-09-17T03:38:00.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.994+0000 7f6f1affd640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6f0c078bc0 0x7f6f0c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.994+0000 7f6f1affd640 1 -- 172.21.15.146:0/3808847713 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f6f240bbbf0 con 0x7f6f2c0d0710 2024-09-17T03:38:00.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.994+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6f0c078bc0 0x7f6f0c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.995+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6f0c078bc0 0x7f6f0c07b0d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0058c0 tx=0x7f6f1c005c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:00.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.995+0000 7f6f38013740 1 Processor -- start 2024-09-17T03:38:00.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.995+0000 7f6f38013740 1 -- start start 2024-09-17T03:38:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.996+0000 7f6f38013740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073bbd5b0 0x562073fac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.996+0000 7f6f38013740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b946f0 0x562073f8ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.996+0000 7f6f38013740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073b9c8d0 0x562073f8f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.996+0000 7f6f38013740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562073ed7a80 con 0x562073b946f0 2024-09-17T03:38:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.996+0000 7f6f38013740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562073ec6eb0 con 0x562073bbd5b0 2024-09-17T03:38:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.996+0000 7f6f38013740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562073ecacc0 con 0x562073b9c8d0 2024-09-17T03:38:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.996+0000 7f6f29d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b946f0 0x562073f8ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.996+0000 7f6f29d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b946f0 0x562073f8ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35486/0 (socket says 172.21.15.146:35486) 2024-09-17T03:38:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.996+0000 7f6f29d9b640 1 -- 172.21.15.146:0/1960345056 learned_addr learned my addr 172.21.15.146:0/1960345056 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:00.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.996+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/1960345056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073bbd5b0 0x562073fac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.996+0000 7f6f2ad9d640 1 --2- 172.21.15.146:0/1960345056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073b9c8d0 0x562073f8f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.997+0000 7f6f29d9b640 1 -- 172.21.15.146:0/1960345056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073b9c8d0 msgr2=0x562073f8f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.997+0000 7f6f29d9b640 1 --2- 172.21.15.146:0/1960345056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073b9c8d0 0x562073f8f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.997+0000 7f6f29d9b640 1 -- 172.21.15.146:0/1960345056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073bbd5b0 msgr2=0x562073fac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.997+0000 7f6f29d9b640 1 --2- 172.21.15.146:0/1960345056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073bbd5b0 0x562073fac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.997+0000 7f6f29d9b640 1 -- 172.21.15.146:0/1960345056 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562073ca1a20 con 0x562073b946f0 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.997+0000 7f6f29d9b640 1 --2- 172.21.15.146:0/1960345056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b946f0 0x562073f8ed40 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6f200016f0 tx=0x7f6f20001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ba822ab0870c46 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.997+0000 7f6f0bfff640 1 -- 172.21.15.146:0/1960345056 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20018070 con 0x562073b946f0 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.997+0000 7f6f0bfff640 1 -- 172.21.15.146:0/1960345056 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f2000d730 con 0x562073b946f0 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.997+0000 7f6f0bfff640 1 -- 172.21.15.146:0/1960345056 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000db60 con 0x562073b946f0 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.998+0000 7f6f38013740 1 -- 172.21.15.146:0/1960345056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b946f0 msgr2=0x562073f8ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.998+0000 7f6f38013740 1 --2- 172.21.15.146:0/1960345056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b946f0 0x562073f8ed40 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6f200016f0 tx=0x7f6f20001bb0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.998+0000 7f6f38013740 1 -- 172.21.15.146:0/1960345056 shutdown_connections 2024-09-17T03:38:01.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.998+0000 7f6f38013740 1 --2- 172.21.15.146:0/1960345056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073b9c8d0 0x562073f8f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.998+0000 7f6f38013740 1 --2- 172.21.15.146:0/1960345056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b946f0 0x562073f8ed40 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.998+0000 7f6f38013740 1 --2- 172.21.15.146:0/1960345056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073bbd5b0 0x562073fac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.998+0000 7f6f38013740 1 -- 172.21.15.146:0/1960345056 >> 172.21.15.146:0/1960345056 conn(0x562073bb1700 msgr2=0x562073f64f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.998+0000 7f6f38013740 1 -- 172.21.15.146:0/1960345056 shutdown_connections 2024-09-17T03:38:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.998+0000 7f6f38013740 1 -- 172.21.15.146:0/1960345056 wait complete. 2024-09-17T03:38:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.999+0000 7f6f38013740 1 -- start start 2024-09-17T03:38:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:00.999+0000 7f6f38013740 1 Processor -- start 2024-09-17T03:38:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.000+0000 7f6f38013740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562073f7caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.000+0000 7f6f38013740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073b9c8d0 0x562073f64ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.000+0000 7f6f38013740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073bbd5b0 0x562073f65000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.000+0000 7f6f38013740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562073c37960 con 0x562073bbd5b0 2024-09-17T03:38:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.000+0000 7f6f38013740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562073e4d670 con 0x562073b946f0 2024-09-17T03:38:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.000+0000 7f6f38013740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562073fb9390 con 0x562073b9c8d0 2024-09-17T03:38:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.000+0000 7f6f38013740 10 client.0 _ll_register_callbacks cb 0x562073ec03e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:38:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.000+0000 7f6f2ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073bbd5b0 0x562073f65000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.000+0000 7f6f2ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073bbd5b0 0x562073f65000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35492/0 (socket says 172.21.15.146:35492) 2024-09-17T03:38:01.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.000+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/2975348234 learned_addr learned my addr 172.21.15.146:0/2975348234 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f29d9b640 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073b9c8d0 0x562073f64ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562073f7caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/2975348234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073b9c8d0 msgr2=0x562073f64ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f2ad9d640 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073b9c8d0 0x562073f64ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/2975348234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 msgr2=0x562073f7caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f2ad9d640 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562073f7caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/2975348234 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562073c068c0 con 0x562073bbd5b0 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f2ad9d640 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073bbd5b0 0x562073f65000 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6f24080b40 tx=0x7f6f24083350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52b484ce485c8d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f097fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f097fa640 1 -- 172.21.15.146:0/2975348234 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f240a8030 con 0x562073bbd5b0 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f097fa640 1 -- 172.21.15.146:0/2975348234 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f6f2408d070 con 0x562073bbd5b0 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f38013740 1 -- 172.21.15.146:0/2975348234 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f2000d730 con 0x562073bbd5b0 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f097fa640 1 -- 172.21.15.146:0/2975348234 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f6f24083fd0 con 0x562073bbd5b0 2024-09-17T03:38:01.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f38013740 10 client.7599 fetch_fsmap learned FSMap version 69 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f38013740 1 -- 172.21.15.146:0/2975348234 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x562073d021b0 con 0x562073bbd5b0 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.001+0000 7f6f097fa640 1 -- 172.21.15.146:0/2975348234 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f2000d730 con 0x562073bbd5b0 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.002+0000 7f6f097fa640 1 -- 172.21.15.146:0/2975348234 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f6f2403a030 con 0x562073bbd5b0 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.002+0000 7f6f38013740 10 client.7599 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.002+0000 7f6f38013740 10 client.7599 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.002+0000 7f6f38013740 20 client.7599 populate_metadata read hostname 'smithi146' 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.002+0000 7f6f38013740 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x562073b7c180 0x562073f87070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.002+0000 7f6f38013740 4 client.7599 mds_command: new command op to 7515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.002+0000 7f6f38013740 1 -- 172.21.15.146:0/2975348234 --> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562073ed99d0 con 0x562073b7c180 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.002+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x562073b7c180 0x562073f87070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.002+0000 7f6f097fa640 10 client.7599 ms_handle_connect on v2:172.21.15.146:6834/2040023606 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.002+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x562073b7c180 0x562073f87070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61c81fd4ac249d78 server_cookie=84b909288d2eb2e4 in_seq=0 out_seq=0 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f097fa640 1 -- 172.21.15.146:0/2975348234 <== mds.0 v2:172.21.15.146:6834/2040023606 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562073ed99d0 con 0x562073b7c180 2024-09-17T03:38:01.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f097fa640 10 client.7599 handle_command_reply: tid=0 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 1 client.7599 shutdown 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 1 -- 172.21.15.146:0/2975348234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073bbd5b0 msgr2=0x562073f65000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073bbd5b0 0x562073f65000 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6f24080b40 tx=0x7f6f24083350 comp rx=0 tx=0).stop 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 1 -- 172.21.15.146:0/2975348234 shutdown_connections 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x562073b7c180 0x562073f87070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073bbd5b0 0x562073f65000 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073b9c8d0 0x562073f64ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 1 --2- 172.21.15.146:0/2975348234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562073f7caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f097fa640 0 client.7599 ms_handle_reset on v2:172.21.15.146:6834/2040023606 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 1 -- 172.21.15.146:0/2975348234 >> 172.21.15.146:0/2975348234 conn(0x562073bb1700 msgr2=0x562073faa580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 1 -- 172.21.15.146:0/2975348234 shutdown_connections 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 1 -- 172.21.15.146:0/2975348234 wait complete. 2024-09-17T03:38:01.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.003+0000 7f6f38013740 20 client.7599 trim_cache size 0 max 16384 2024-09-17T03:38:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.021+0000 7f6f38013740 1 Processor -- start 2024-09-17T03:38:01.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.021+0000 7f6f38013740 1 -- start start 2024-09-17T03:38:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.022+0000 7f6f38013740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073bb1700 0x562073fcc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.022+0000 7f6f38013740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562073fa4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.022+0000 7f6f38013740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x562073f7c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.022+0000 7f6f38013740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c202120 con 0x562073b9c8d0 2024-09-17T03:38:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.022+0000 7f6f38013740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c06eb20 con 0x562073b946f0 2024-09-17T03:38:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.022+0000 7f6f38013740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2c06de80 con 0x562073bb1700 2024-09-17T03:38:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.022+0000 7f6f2ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x562073f7c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.022+0000 7f6f2ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x562073f7c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35506/0 (socket says 172.21.15.146:35506) 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.022+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/792538956 learned_addr learned my addr 172.21.15.146:0/792538956 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f29d9b640 1 --2- 172.21.15.146:0/792538956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562073fa4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/792538956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073bb1700 0x562073fcc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/792538956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073bb1700 msgr2=0x562073fcc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f2ad9d640 1 --2- 172.21.15.146:0/792538956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073bb1700 0x562073fcc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/792538956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 msgr2=0x562073fa4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f2ad9d640 1 --2- 172.21.15.146:0/792538956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562073fa4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f2ad9d640 1 -- 172.21.15.146:0/792538956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562073c9fd20 con 0x562073b9c8d0 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f29d9b640 1 --2- 172.21.15.146:0/792538956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562073fa4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f2ad9d640 1 --2- 172.21.15.146:0/792538956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x562073f7c680 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f6f24083860 tx=0x7f6f24005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f12fa76b1a7aced server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f0b7fe640 1 -- 172.21.15.146:0/792538956 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f240a8070 con 0x562073b9c8d0 2024-09-17T03:38:01.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f0b7fe640 1 -- 172.21.15.146:0/792538956 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f240883b0 con 0x562073b9c8d0 2024-09-17T03:38:01.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.023+0000 7f6f0b7fe640 1 -- 172.21.15.146:0/792538956 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24004d40 con 0x562073b9c8d0 2024-09-17T03:38:01.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.024+0000 7f6f38013740 1 -- 172.21.15.146:0/792538956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 msgr2=0x562073f7c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.024+0000 7f6f38013740 1 --2- 172.21.15.146:0/792538956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x562073f7c680 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f6f24083860 tx=0x7f6f24005f70 comp rx=0 tx=0).stop 2024-09-17T03:38:01.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.024+0000 7f6f38013740 1 -- 172.21.15.146:0/792538956 shutdown_connections 2024-09-17T03:38:01.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.024+0000 7f6f38013740 1 --2- 172.21.15.146:0/792538956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x562073f7c680 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.024+0000 7f6f38013740 1 --2- 172.21.15.146:0/792538956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562073fa4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.024+0000 7f6f38013740 1 --2- 172.21.15.146:0/792538956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073bb1700 0x562073fcc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.024+0000 7f6f38013740 1 -- 172.21.15.146:0/792538956 >> 172.21.15.146:0/792538956 conn(0x562073f5e4e0 msgr2=0x562073f87020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:01.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.024+0000 7f6f38013740 1 -- 172.21.15.146:0/792538956 shutdown_connections 2024-09-17T03:38:01.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.024+0000 7f6f38013740 1 -- 172.21.15.146:0/792538956 wait complete. 2024-09-17T03:38:01.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.025+0000 7f6f38013740 1 -- start start 2024-09-17T03:38:01.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.025+0000 7f6f38013740 1 Processor -- start 2024-09-17T03:38:01.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.026+0000 7f6f38013740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562074020700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.026+0000 7f6f38013740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x56207402d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.026+0000 7f6f38013740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073bb1700 0x562073f873b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.026+0000 7f6f38013740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562073f7d210 con 0x562073b9c8d0 2024-09-17T03:38:01.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.026+0000 7f6f38013740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c06e4d0 con 0x562073b946f0 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.026+0000 7f6f38013740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562073f60e80 con 0x562073bb1700 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.026+0000 7f6f38013740 10 client.0 _ll_register_callbacks cb 0x7f6f24009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.026+0000 7f6f29d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x56207402d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.026+0000 7f6f29d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x56207402d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35516/0 (socket says 172.21.15.146:35516) 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.026+0000 7f6f29d9b640 1 -- 172.21.15.146:0/907244523 learned_addr learned my addr 172.21.15.146:0/907244523 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562074020700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f2ad9d640 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073bb1700 0x562073f873b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f29d9b640 1 -- 172.21.15.146:0/907244523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073bb1700 msgr2=0x562073f873b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f29d9b640 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073bb1700 0x562073f873b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f29d9b640 1 -- 172.21.15.146:0/907244523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 msgr2=0x562074020700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f29d9b640 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562074020700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f29d9b640 1 -- 172.21.15.146:0/907244523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562073faa9f0 con 0x562073b9c8d0 2024-09-17T03:38:01.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562074020700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f29d9b640 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x56207402d320 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f6f20012000 tx=0x7f6f20001420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d05064695bb409 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f097fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f097fa640 1 -- 172.21.15.146:0/907244523 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20018040 con 0x562073b9c8d0 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f097fa640 1 -- 172.21.15.146:0/907244523 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f6f20007030 con 0x562073b9c8d0 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f38013740 1 -- 172.21.15.146:0/907244523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f240883b0 con 0x562073b9c8d0 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f097fa640 1 -- 172.21.15.146:0/907244523 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f6f2002c050 con 0x562073b9c8d0 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f38013740 10 client.7605 fetch_fsmap learned FSMap version 69 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f38013740 1 -- 172.21.15.146:0/907244523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x56207402dbc0 con 0x562073b9c8d0 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f097fa640 1 -- 172.21.15.146:0/907244523 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f240883b0 con 0x562073b9c8d0 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f097fa640 1 -- 172.21.15.146:0/907244523 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f6f2002f020 con 0x562073b9c8d0 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f38013740 10 client.7605 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f38013740 10 client.7605 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f38013740 20 client.7605 populate_metadata read hostname 'smithi146' 2024-09-17T03:38:01.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f38013740 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x562073b515c0 0x562073fa2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f38013740 4 client.7605 mds_command: new command op to 7515 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.027+0000 7f6f38013740 1 -- 172.21.15.146:0/907244523 --> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x562073ed5480 con 0x562073b515c0 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.028+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x562073b515c0 0x562073fa2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.028+0000 7f6f097fa640 10 client.7605 ms_handle_connect on v2:172.21.15.146:6834/2040023606 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.028+0000 7f6f2a59c640 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x562073b515c0 0x562073fa2c70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ea227e15549535a server_cookie=85bf90ee308c0388 in_seq=0 out_seq=0 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f097fa640 1 -- 172.21.15.146:0/907244523 <== mds.0 v2:172.21.15.146:6834/2040023606 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562073ed5480 con 0x562073b515c0 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f097fa640 10 client.7605 handle_command_reply: tid=0 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 1 client.7605 shutdown 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 1 -- 172.21.15.146:0/907244523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 msgr2=0x56207402d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x56207402d320 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f6f20012000 tx=0x7f6f20001420 comp rx=0 tx=0).stop 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 1 -- 172.21.15.146:0/907244523 shutdown_connections 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.146:6834/2040023606,v1:172.21.15.146:6835/2040023606] conn(0x562073b515c0 0x562073fa2c70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562073bb1700 0x562073f873b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562073b9c8d0 0x56207402d320 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f097fa640 0 client.7605 ms_handle_reset on v2:172.21.15.146:6834/2040023606 2024-09-17T03:38:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 1 --2- 172.21.15.146:0/907244523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562073b946f0 0x562074020700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 1 -- 172.21.15.146:0/907244523 >> 172.21.15.146:0/907244523 conn(0x562073f5e4e0 msgr2=0x562073fa4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 1 -- 172.21.15.146:0/907244523 shutdown_connections 2024-09-17T03:38:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 1 -- 172.21.15.146:0/907244523 wait complete. 2024-09-17T03:38:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.029+0000 7f6f38013740 20 client.7605 trim_cache size 0 max 16384 2024-09-17T03:38:01.033 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:38:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:38:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "3ee6089e-e958-4c3e-ac6e-59a3649fd433", 2024-09-17T03:38:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:38:01.034 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:38:01.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 -- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6f0c078bc0 msgr2=0x7f6f0c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6f0c078bc0 0x7f6f0c07b0d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0058c0 tx=0x7f6f1c005c90 comp rx=0 tx=0).stop 2024-09-17T03:38:01.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 -- 172.21.15.146:0/3808847713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2c0d0710 msgr2=0x7f6f2c0cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2c0d0710 0x7f6f2c0cb9f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f6f24006010 tx=0x7f6f24032c90 comp rx=0 tx=0).stop 2024-09-17T03:38:01.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 -- 172.21.15.146:0/3808847713 shutdown_connections 2024-09-17T03:38:01.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6f0c078bc0 0x7f6f0c07b0d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2c0d0710 0x7f6f2c0cb9f0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6f2c0cf6b0 0x7f6f2c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 --2- 172.21.15.146:0/3808847713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6f2c0b47c0 0x7f6f2c15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 -- 172.21.15.146:0/3808847713 >> 172.21.15.146:0/3808847713 conn(0x7f6f2c09ba20 msgr2=0x7f6f2c0b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:01.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 -- 172.21.15.146:0/3808847713 shutdown_connections 2024-09-17T03:38:01.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.030+0000 7f6f30fc3640 1 -- 172.21.15.146:0/3808847713 wait complete. 2024-09-17T03:38:01.041 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:01.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.155+0000 7fe1c718b640 1 -- 172.21.15.146:0/4021979453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c0072d90 msgr2=0x7fe1c00b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.155+0000 7fe1c718b640 1 --2- 172.21.15.146:0/4021979453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c0072d90 0x7fe1c00b4370 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0071f20 tx=0x7fe1b802a820 comp rx=0 tx=0).stop 2024-09-17T03:38:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.155+0000 7fe1c718b640 1 -- 172.21.15.146:0/4021979453 shutdown_connections 2024-09-17T03:38:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.155+0000 7fe1c718b640 1 --2- 172.21.15.146:0/4021979453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c0072d90 0x7fe1c00b4370 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.155+0000 7fe1c718b640 1 --2- 172.21.15.146:0/4021979453 >> v2:172.21.15.179:3300/0 conn(0x7fe1c015b770 0x7fe1c006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.155+0000 7fe1c718b640 1 -- 172.21.15.146:0/4021979453 >> 172.21.15.146:0/4021979453 conn(0x7fe1c00b2060 msgr2=0x7fe1c00b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.155+0000 7fe1c718b640 1 -- 172.21.15.146:0/4021979453 shutdown_connections 2024-09-17T03:38:01.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.155+0000 7fe1c718b640 1 -- 172.21.15.146:0/4021979453 wait complete. 2024-09-17T03:38:01.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.157+0000 7fe1c718b640 1 Processor -- start 2024-09-17T03:38:01.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.157+0000 7fe1c718b640 1 -- start start 2024-09-17T03:38:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.158+0000 7fe1c718b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1c0070350 0x7fe1c014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.158+0000 7fe1c718b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c015b770 0x7fe1c015e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.158+0000 7fe1c718b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1c014f1f0 0x7fe1c014f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.158+0000 7fe1c718b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c00b4e00 con 0x7fe1c015b770 2024-09-17T03:38:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.158+0000 7fe1c718b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c00b4c80 con 0x7fe1c014f1f0 2024-09-17T03:38:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.158+0000 7fe1c718b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c00b4f80 con 0x7fe1c0070350 2024-09-17T03:38:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.158+0000 7fe1bffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c015b770 0x7fe1c015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.158+0000 7fe1bffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c015b770 0x7fe1c015e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35528/0 (socket says 172.21.15.146:35528) 2024-09-17T03:38:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.158+0000 7fe1bffff640 1 -- 172.21.15.146:0/3056829621 learned_addr learned my addr 172.21.15.146:0/3056829621 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.158+0000 7fe1c5728640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1c014f1f0 0x7fe1c014f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.158+0000 7fe1c4f27640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1c0070350 0x7fe1c014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1bffff640 1 -- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1c0070350 msgr2=0x7fe1c014d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1bffff640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1c0070350 0x7fe1c014d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1bffff640 1 -- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1c014f1f0 msgr2=0x7fe1c014f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1bffff640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1c014f1f0 0x7fe1c014f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1bffff640 1 -- 172.21.15.146:0/3056829621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c015ec80 con 0x7fe1c015b770 2024-09-17T03:38:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1c4f27640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1c0070350 0x7fe1c014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:01.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1bffff640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c015b770 0x7fe1c015e740 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400c3f0 tx=0x7fe1b400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:01.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1bd7fa640 1 -- 172.21.15.146:0/3056829621 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4017070 con 0x7fe1c015b770 2024-09-17T03:38:01.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1bd7fa640 1 -- 172.21.15.146:0/3056829621 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1b40035f0 con 0x7fe1c015b770 2024-09-17T03:38:01.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1c718b640 1 -- 172.21.15.146:0/3056829621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c0150470 con 0x7fe1c015b770 2024-09-17T03:38:01.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1bd7fa640 1 -- 172.21.15.146:0/3056829621 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4003a40 con 0x7fe1c015b770 2024-09-17T03:38:01.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.159+0000 7fe1c718b640 1 -- 172.21.15.146:0/3056829621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c015c310 con 0x7fe1c015b770 2024-09-17T03:38:01.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.160+0000 7fe1c718b640 1 -- 172.21.15.146:0/3056829621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1c00b5510 con 0x7fe1c015b770 2024-09-17T03:38:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.161+0000 7fe1bd7fa640 1 -- 172.21.15.146:0/3056829621 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1b401a070 con 0x7fe1c015b770 2024-09-17T03:38:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.162+0000 7fe1bd7fa640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1ac078b90 0x7fe1ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.162+0000 7fe1bd7fa640 1 -- 172.21.15.146:0/3056829621 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7fe1b4099f60 con 0x7fe1c015b770 2024-09-17T03:38:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.162+0000 7fe1c4f27640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1ac078b90 0x7fe1ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.162+0000 7fe1c4f27640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1ac078b90 0x7fe1ac07b0a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000ab40 tx=0x7fe1b000a520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:01.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.166+0000 7fe1bd7fa640 1 -- 172.21.15.146:0/3056829621 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe1c015bb80 con 0x7fe1c015b770 2024-09-17T03:38:01.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.374+0000 7fe1c718b640 1 -- 172.21.15.146:0/3056829621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1c006ede0 con 0x7fe1c015b770 2024-09-17T03:38:01.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.375+0000 7fe1bd7fa640 1 -- 172.21.15.146:0/3056829621 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5238 (secure 0 0 0) 0x7fe1b4061cf0 con 0x7fe1c015b770 2024-09-17T03:38:01.374 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:01.374 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":69,"btime":"2024-09-17T03:37:57:164566+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2734448758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2734448758},{"type":"v1","addr":"172.21.15.179:6837","nonce":2734448758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7497,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1302041078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1302041078},{"type":"v1","addr":"172.21.15.146:6833","nonce":1302041078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7506,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3947229505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3947229505},{"type":"v1","addr":"172.21.15.179:6835","nonce":3947229505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:57.164556+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7515":{"gid":7515,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2040023606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2040023606},{"type":"v1","addr":"172.21.15.146:6835","nonce":2040023606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7515,"qdb_cluster":[7515]},"id":6}]} 2024-09-17T03:38:01.374 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 69 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 -- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1ac078b90 msgr2=0x7fe1ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1ac078b90 0x7fe1ac07b0a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000ab40 tx=0x7fe1b000a520 comp rx=0 tx=0).stop 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 -- 172.21.15.146:0/3056829621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c015b770 msgr2=0x7fe1c015e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c015b770 0x7fe1c015e740 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400c3f0 tx=0x7fe1b400c8b0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 -- 172.21.15.146:0/3056829621 shutdown_connections 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1ac078b90 0x7fe1ac07b0a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1c014f1f0 0x7fe1c014f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c015b770 0x7fe1c015e740 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 --2- 172.21.15.146:0/3056829621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1c0070350 0x7fe1c014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 -- 172.21.15.146:0/3056829621 >> 172.21.15.146:0/3056829621 conn(0x7fe1c00b2060 msgr2=0x7fe1c00cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 -- 172.21.15.146:0/3056829621 shutdown_connections 2024-09-17T03:38:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:01.377+0000 7fe1c718b640 1 -- 172.21.15.146:0/3056829621 wait complete. 2024-09-17T03:38:01.388 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-17T03:38:01.510 INFO:teuthology.orchestra.run.smithi146.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T03:37:51.721243+0000","btime":"2024-09-17T03:37:50.925255+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T03:37:51.721243+0000","atime":"2024-09-17T03:37:50.925255+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T03:37:51.721243+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:37:51.722243+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:37:51.722243+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"authpin":0,"scrubqueue":0},"nref":1,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T03:38:01.511 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-17T03:37:51.722243+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T03:37:50.925255+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T03:37:50.925255+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T03:37:51.721243+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-17T03:37:51.721243+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T03:37:51.721243+0000", "nestlock": {}, "nlink": 1, "nref": 1, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-17T03:37:51.722243+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T03:38:01.511 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-17T03:38:06.513 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.641+0000 7f06fb758640 1 -- 172.21.15.146:0/3204363373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f406f440 msgr2=0x7f06f40d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.641+0000 7f06fb758640 1 --2- 172.21.15.146:0/3204363373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f406f440 0x7f06f40d3190 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f06f40b73c0 tx=0x7f06ec02aa30 comp rx=0 tx=0).stop 2024-09-17T03:38:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.641+0000 7f06fb758640 1 -- 172.21.15.146:0/3204363373 shutdown_connections 2024-09-17T03:38:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.641+0000 7f06fb758640 1 --2- 172.21.15.146:0/3204363373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f406f440 0x7f06f40d3190 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.641+0000 7f06fb758640 1 --2- 172.21.15.146:0/3204363373 >> v2:172.21.15.179:3300/0 conn(0x7f06f40b3870 0x7f06f40cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.641+0000 7f06fb758640 1 -- 172.21.15.146:0/3204363373 >> 172.21.15.146:0/3204363373 conn(0x7f06f40d4be0 msgr2=0x7f06f40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.642+0000 7f06fb758640 1 -- 172.21.15.146:0/3204363373 shutdown_connections 2024-09-17T03:38:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.642+0000 7f06fb758640 1 -- 172.21.15.146:0/3204363373 wait complete. 2024-09-17T03:38:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.643+0000 7f06fb758640 1 Processor -- start 2024-09-17T03:38:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.643+0000 7f06fb758640 1 -- start start 2024-09-17T03:38:06.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06fb758640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40b3870 0x7f06f4152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06fb758640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f41620f0 0x7f06f40ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06fb758640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f40c9740 0x7f06f40cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06fb758640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f06f40d3a60 con 0x7f06f40c9740 2024-09-17T03:38:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06fb758640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f06f40d38e0 con 0x7f06f40b3870 2024-09-17T03:38:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06fb758640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f06f40d3be0 con 0x7f06f41620f0 2024-09-17T03:38:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06f9cf5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f40c9740 0x7f06f40cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06f9cf5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f40c9740 0x7f06f40cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35548/0 (socket says 172.21.15.146:35548) 2024-09-17T03:38:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06f9cf5640 1 -- 172.21.15.146:0/3428223960 learned_addr learned my addr 172.21.15.146:0/3428223960 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06f94f4640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40b3870 0x7f06f4152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06f8cf3640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f41620f0 0x7f06f40ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06f9cf5640 1 -- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f41620f0 msgr2=0x7f06f40ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06f9cf5640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f41620f0 0x7f06f40ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06f9cf5640 1 -- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40b3870 msgr2=0x7f06f4152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06f9cf5640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40b3870 0x7f06f4152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06f9cf5640 1 -- 172.21.15.146:0/3428223960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f40cd8b0 con 0x7f06f40c9740 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.645+0000 7f06f9cf5640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f40c9740 0x7f06f40cd220 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f06ec005fd0 tx=0x7f06ec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.646+0000 7f06e9ffb640 1 -- 172.21.15.146:0/3428223960 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec033050 con 0x7f06f40c9740 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.646+0000 7f06e9ffb640 1 -- 172.21.15.146:0/3428223960 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06ec004450 con 0x7f06f40c9740 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.646+0000 7f06fb758640 1 -- 172.21.15.146:0/3428223960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f40b44f0 con 0x7f06f40c9740 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.646+0000 7f06e9ffb640 1 -- 172.21.15.146:0/3428223960 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec004840 con 0x7f06f40c9740 2024-09-17T03:38:06.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.646+0000 7f06fb758640 1 -- 172.21.15.146:0/3428223960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f40cde70 con 0x7f06f40c9740 2024-09-17T03:38:06.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.647+0000 7f06fb758640 1 -- 172.21.15.146:0/3428223960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f40d3190 con 0x7f06f40c9740 2024-09-17T03:38:06.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.648+0000 7f06e9ffb640 1 -- 172.21.15.146:0/3428223960 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06ec036070 con 0x7f06f40c9740 2024-09-17T03:38:06.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.648+0000 7f06e9ffb640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d8078bc0 0x7f06d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:06.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.649+0000 7f06e9ffb640 1 -- 172.21.15.146:0/3428223960 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f06ec0bc1c0 con 0x7f06f40c9740 2024-09-17T03:38:06.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.649+0000 7f06f94f4640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d8078bc0 0x7f06d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:06.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.649+0000 7f06f94f4640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d8078bc0 0x7f06d807b0d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f06f0004590 tx=0x7f06f000b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:06.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.653+0000 7f06e9ffb640 1 -- 172.21.15.146:0/3428223960 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06ec083f50 con 0x7f06f40c9740 2024-09-17T03:38:06.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.862+0000 7f06fb758640 1 -- 172.21.15.146:0/3428223960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06f40d2bd0 con 0x7f06f40c9740 2024-09-17T03:38:06.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.862+0000 7f06e9ffb640 1 -- 172.21.15.146:0/3428223960 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5238 (secure 0 0 0) 0x7f06ec088980 con 0x7f06f40c9740 2024-09-17T03:38:06.861 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:06.862 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":69,"btime":"2024-09-17T03:37:57:164566+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2734448758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2734448758},{"type":"v1","addr":"172.21.15.179:6837","nonce":2734448758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7497,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1302041078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1302041078},{"type":"v1","addr":"172.21.15.146:6833","nonce":1302041078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7506,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3947229505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3947229505},{"type":"v1","addr":"172.21.15.179:6835","nonce":3947229505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:57.164556+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7515":{"gid":7515,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2040023606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2040023606},{"type":"v1","addr":"172.21.15.146:6835","nonce":2040023606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7515,"qdb_cluster":[7515]},"id":6}]} 2024-09-17T03:38:06.862 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 69 2024-09-17T03:38:06.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 -- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d8078bc0 msgr2=0x7f06d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d8078bc0 0x7f06d807b0d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f06f0004590 tx=0x7f06f000b390 comp rx=0 tx=0).stop 2024-09-17T03:38:06.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 -- 172.21.15.146:0/3428223960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f40c9740 msgr2=0x7f06f40cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:06.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f40c9740 0x7f06f40cd220 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f06ec005fd0 tx=0x7f06ec003f10 comp rx=0 tx=0).stop 2024-09-17T03:38:06.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 -- 172.21.15.146:0/3428223960 shutdown_connections 2024-09-17T03:38:06.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d8078bc0 0x7f06d807b0d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f40c9740 0x7f06f40cd220 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f41620f0 0x7f06f40ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 --2- 172.21.15.146:0/3428223960 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f40b3870 0x7f06f4152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:06.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 -- 172.21.15.146:0/3428223960 >> 172.21.15.146:0/3428223960 conn(0x7f06f40d4be0 msgr2=0x7f06f40cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:06.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 -- 172.21.15.146:0/3428223960 shutdown_connections 2024-09-17T03:38:06.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:06.865+0000 7f06fb758640 1 -- 172.21.15.146:0/3428223960 wait complete. 2024-09-17T03:38:06.875 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-17T03:38:06.999 INFO:teuthology.orchestra.run.smithi146.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T03:37:51.721243+0000","btime":"2024-09-17T03:37:50.925255+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T03:37:51.721243+0000","atime":"2024-09-17T03:37:50.925255+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T03:37:51.721243+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:37:51.722243+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T03:37:51.722243+0000"},"version":131,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-17T03:38:01.030316+0000","last_scrub_version":128,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T03:38:06.999 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-17T03:37:51.722243+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T03:37:50.925255+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T03:37:50.925255+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T03:37:51.721243+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-17T03:37:51.721243+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-17T03:38:01.030316+0000", "last_scrub_version": 128, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T03:37:51.721243+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-17T03:37:51.722243+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 131, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T03:38:07.000 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-17T03:38:07.000 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:38:07.000 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:38:07.042 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:38:07.084 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:38:07.084 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:38:07.084 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:38:07.084 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:07.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:38:07.100 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:38:07.100 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:38:07.100 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:07.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:38:07.143 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:38:07.143 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:38:07.144 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:07.159 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:38:07.159 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:38:07.159 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:38:07.159 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:07.201 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:38:07.201 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:07.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.316+0000 7ff4c91da640 1 -- 172.21.15.146:0/1818804872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4ac004d40 msgr2=0x7ff4ac005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.316+0000 7ff4c91da640 1 --2- 172.21.15.146:0/1818804872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4ac004d40 0x7ff4ac005150 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4160450 tx=0x7ff4ac005830 comp rx=0 tx=0).stop 2024-09-17T03:38:07.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.316+0000 7ff4c359e640 1 -- 172.21.15.146:0/1818804872 reap_dead start 2024-09-17T03:38:07.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.316+0000 7ff4c91da640 1 -- 172.21.15.146:0/1818804872 shutdown_connections 2024-09-17T03:38:07.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.316+0000 7ff4c91da640 1 -- 172.21.15.146:0/1818804872 >> 172.21.15.146:0/1818804872 conn(0x7ff4c40b2060 msgr2=0x7ff4c40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:07.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.316+0000 7ff4c91da640 1 -- 172.21.15.146:0/1818804872 shutdown_connections 2024-09-17T03:38:07.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.316+0000 7ff4c91da640 1 -- 172.21.15.146:0/1818804872 wait complete. 2024-09-17T03:38:07.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.318+0000 7ff4c91da640 1 Processor -- start 2024-09-17T03:38:07.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.318+0000 7ff4c91da640 1 -- start start 2024-09-17T03:38:07.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c91da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4ac004d40 0x7ff4c41f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c91da640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4c414ee90 0x7ff4c41f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c91da640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c413fe70 0x7ff4c4154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c91da640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c4073a10 con 0x7ff4c413fe70 2024-09-17T03:38:07.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c91da640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c4073890 con 0x7ff4ac004d40 2024-09-17T03:38:07.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c91da640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c4073b90 con 0x7ff4c414ee90 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c413fe70 0x7ff4c4154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c413fe70 0x7ff4c4154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48690/0 (socket says 172.21.15.146:48690) 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c359e640 1 -- 172.21.15.146:0/1586951026 learned_addr learned my addr 172.21.15.146:0/1586951026 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c2d9d640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4ac004d40 0x7ff4c41f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c259c640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4c414ee90 0x7ff4c41f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c359e640 1 -- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4c414ee90 msgr2=0x7ff4c41f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c359e640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4c414ee90 0x7ff4c41f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c359e640 1 -- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4ac004d40 msgr2=0x7ff4c41f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c359e640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4ac004d40 0x7ff4c41f7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c359e640 1 -- 172.21.15.146:0/1586951026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c414f6a0 con 0x7ff4c413fe70 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c2d9d640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4ac004d40 0x7ff4c41f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.320+0000 7ff4c359e640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c413fe70 0x7ff4c4154020 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009c10 tx=0x7ff4bc033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.321+0000 7ff4ab7fe640 1 -- 172.21.15.146:0/1586951026 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc038040 con 0x7ff4c413fe70 2024-09-17T03:38:07.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.321+0000 7ff4ab7fe640 1 -- 172.21.15.146:0/1586951026 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4bc042070 con 0x7ff4c413fe70 2024-09-17T03:38:07.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.321+0000 7ff4c91da640 1 -- 172.21.15.146:0/1586951026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c414f980 con 0x7ff4c413fe70 2024-09-17T03:38:07.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.321+0000 7ff4ab7fe640 1 -- 172.21.15.146:0/1586951026 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc033a30 con 0x7ff4c413fe70 2024-09-17T03:38:07.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.321+0000 7ff4c91da640 1 -- 172.21.15.146:0/1586951026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c41f3b80 con 0x7ff4c413fe70 2024-09-17T03:38:07.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.322+0000 7ff4c91da640 1 -- 172.21.15.146:0/1586951026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c4074120 con 0x7ff4c413fe70 2024-09-17T03:38:07.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.323+0000 7ff4ab7fe640 1 -- 172.21.15.146:0/1586951026 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4bc033bd0 con 0x7ff4c413fe70 2024-09-17T03:38:07.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.323+0000 7ff4ab7fe640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4b0078b90 0x7ff4b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.323+0000 7ff4ab7fe640 1 -- 172.21.15.146:0/1586951026 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7ff4bc0bb650 con 0x7ff4c413fe70 2024-09-17T03:38:07.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.323+0000 7ff4c2d9d640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4b0078b90 0x7ff4b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.324+0000 7ff4c2d9d640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4b0078b90 0x7ff4b007b0a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4005fd0 tx=0x7ff4b4009650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:07.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.327+0000 7ff4ab7fe640 1 -- 172.21.15.146:0/1586951026 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff4bc04b060 con 0x7ff4c413fe70 2024-09-17T03:38:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.533+0000 7ff4c91da640 1 -- 172.21.15.146:0/1586951026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4c406efb0 con 0x7ff4c413fe70 2024-09-17T03:38:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.534+0000 7ff4ab7fe640 1 -- 172.21.15.146:0/1586951026 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5238 (secure 0 0 0) 0x7ff4bc083c30 con 0x7ff4c413fe70 2024-09-17T03:38:07.537 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:07.538 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":69,"btime":"2024-09-17T03:37:57:164566+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2734448758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2734448758},{"type":"v1","addr":"172.21.15.179:6837","nonce":2734448758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7497,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1302041078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1302041078},{"type":"v1","addr":"172.21.15.146:6833","nonce":1302041078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7506,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3947229505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3947229505},{"type":"v1","addr":"172.21.15.179:6835","nonce":3947229505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:57.164556+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7515":{"gid":7515,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2040023606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2040023606},{"type":"v1","addr":"172.21.15.146:6835","nonce":2040023606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7515,"qdb_cluster":[7515]},"id":6}]} 2024-09-17T03:38:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 69 2024-09-17T03:38:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 -- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4b0078b90 msgr2=0x7ff4b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4b0078b90 0x7ff4b007b0a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4005fd0 tx=0x7ff4b4009650 comp rx=0 tx=0).stop 2024-09-17T03:38:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 -- 172.21.15.146:0/1586951026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c413fe70 msgr2=0x7ff4c4154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c413fe70 0x7ff4c4154020 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009c10 tx=0x7ff4bc033670 comp rx=0 tx=0).stop 2024-09-17T03:38:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 -- 172.21.15.146:0/1586951026 shutdown_connections 2024-09-17T03:38:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4b0078b90 0x7ff4b007b0a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c413fe70 0x7ff4c4154020 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4c414ee90 0x7ff4c41f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 --2- 172.21.15.146:0/1586951026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4ac004d40 0x7ff4c41f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 -- 172.21.15.146:0/1586951026 >> 172.21.15.146:0/1586951026 conn(0x7ff4c40b2060 msgr2=0x7ff4c40d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 -- 172.21.15.146:0/1586951026 shutdown_connections 2024-09-17T03:38:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.536+0000 7ff4c91da640 1 -- 172.21.15.146:0/1586951026 wait complete. 2024-09-17T03:38:07.547 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.660+0000 7f30f2e25640 1 -- 172.21.15.146:0/1702904615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30ec0b5750 msgr2=0x7f30ec0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.660+0000 7f30f2e25640 1 --2- 172.21.15.146:0/1702904615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30ec0b5750 0x7f30ec0b3620 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009830 tx=0x7f30dc02a510 comp rx=0 tx=0).stop 2024-09-17T03:38:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.660+0000 7f30f2e25640 1 -- 172.21.15.146:0/1702904615 shutdown_connections 2024-09-17T03:38:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.660+0000 7f30f2e25640 1 --2- 172.21.15.146:0/1702904615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30ec0b5750 0x7f30ec0b3620 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.660+0000 7f30f2e25640 1 --2- 172.21.15.146:0/1702904615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30ec0b5ce0 0x7f30ec0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.660+0000 7f30f2e25640 1 -- 172.21.15.146:0/1702904615 >> 172.21.15.146:0/1702904615 conn(0x7f30ec0b7b20 msgr2=0x7f30ec09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.660+0000 7f30f2e25640 1 -- 172.21.15.146:0/1702904615 shutdown_connections 2024-09-17T03:38:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.660+0000 7f30f2e25640 1 -- 172.21.15.146:0/1702904615 wait complete. 2024-09-17T03:38:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.661+0000 7f30f2e25640 1 Processor -- start 2024-09-17T03:38:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.661+0000 7f30f2e25640 1 -- start start 2024-09-17T03:38:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f2e25640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30ec0b3b60 0x7f30ec147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f2e25640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30ec0b5750 0x7f30ec152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f2e25640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30ec0b5ce0 0x7f30ec0718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f2e25640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec0b27b0 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f2e25640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec15dd00 con 0x7f30ec0b5750 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f2e25640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f30ec0b2930 con 0x7f30ec0b3b60 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f13c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30ec0b5ce0 0x7f30ec0718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f13c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30ec0b5ce0 0x7f30ec0718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48706/0 (socket says 172.21.15.146:48706) 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f13c2640 1 -- 172.21.15.146:0/1516143870 learned_addr learned my addr 172.21.15.146:0/1516143870 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f0bc1640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30ec0b3b60 0x7f30ec147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30e3fff640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30ec0b5750 0x7f30ec152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f13c2640 1 -- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30ec0b3b60 msgr2=0x7f30ec147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f13c2640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30ec0b3b60 0x7f30ec147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f13c2640 1 -- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30ec0b5750 msgr2=0x7f30ec152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f13c2640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30ec0b5750 0x7f30ec152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.663+0000 7f30f13c2640 1 -- 172.21.15.146:0/1516143870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ec154f90 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.664+0000 7f30f13c2640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30ec0b5ce0 0x7f30ec0718a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c730 tx=0x7f30e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.664+0000 7f30e17fa640 1 -- 172.21.15.146:0/1516143870 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4003b70 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.664+0000 7f30e17fa640 1 -- 172.21.15.146:0/1516143870 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30e4003d30 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.664+0000 7f30e17fa640 1 -- 172.21.15.146:0/1516143870 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e40052d0 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.664+0000 7f30f2e25640 1 -- 172.21.15.146:0/1516143870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ec155270 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.664+0000 7f30f2e25640 1 -- 172.21.15.146:0/1516143870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ec155830 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.665+0000 7f30f2e25640 1 -- 172.21.15.146:0/1516143870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ec152fc0 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.666+0000 7f30e17fa640 1 -- 172.21.15.146:0/1516143870 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30e4005680 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.666+0000 7f30e17fa640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30d8078bc0 0x7f30d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:07.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.666+0000 7f30e17fa640 1 -- 172.21.15.146:0/1516143870 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f30e409ac20 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.666+0000 7f30f0bc1640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30d8078bc0 0x7f30d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:07.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.667+0000 7f30f0bc1640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30d8078bc0 0x7f30d807b0d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f30e8005fd0 tx=0x7f30e800a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.671+0000 7f30e17fa640 1 -- 172.21.15.146:0/1516143870 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30ec0b3f70 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.879+0000 7f30f2e25640 1 -- 172.21.15.146:0/1516143870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30ec0b2de0 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.880+0000 7f30e17fa640 1 -- 172.21.15.146:0/1516143870 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5238 (secure 0 0 0) 0x7f30e40629b0 con 0x7f30ec0b5ce0 2024-09-17T03:38:07.880 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:07.880 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":69,"btime":"2024-09-17T03:37:57:164566+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2734448758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2734448758},{"type":"v1","addr":"172.21.15.179:6837","nonce":2734448758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7497,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1302041078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1302041078},{"type":"v1","addr":"172.21.15.146:6833","nonce":1302041078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7506,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3947229505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3947229505},{"type":"v1","addr":"172.21.15.179:6835","nonce":3947229505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:57.164556+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7515":{"gid":7515,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2040023606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2040023606},{"type":"v1","addr":"172.21.15.146:6835","nonce":2040023606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7515,"qdb_cluster":[7515]},"id":6}]} 2024-09-17T03:38:07.880 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 69 2024-09-17T03:38:07.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 -- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30d8078bc0 msgr2=0x7f30d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30d8078bc0 0x7f30d807b0d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f30e8005fd0 tx=0x7f30e800a250 comp rx=0 tx=0).stop 2024-09-17T03:38:07.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 -- 172.21.15.146:0/1516143870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30ec0b5ce0 msgr2=0x7f30ec0718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30ec0b5ce0 0x7f30ec0718a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c730 tx=0x7f30e400cbf0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 -- 172.21.15.146:0/1516143870 shutdown_connections 2024-09-17T03:38:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f30d8078bc0 0x7f30d807b0d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30ec0b5ce0 0x7f30ec0718a0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f30ec0b5750 0x7f30ec152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 --2- 172.21.15.146:0/1516143870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f30ec0b3b60 0x7f30ec147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 -- 172.21.15.146:0/1516143870 >> 172.21.15.146:0/1516143870 conn(0x7f30ec0b7b20 msgr2=0x7f30ec0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 -- 172.21.15.146:0/1516143870 shutdown_connections 2024-09-17T03:38:07.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:07.882+0000 7f30f2e25640 1 -- 172.21.15.146:0/1516143870 wait complete. 2024-09-17T03:38:07.894 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.006+0000 7efcc32de640 1 -- 172.21.15.146:0/2977529270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcbc0b3360 msgr2=0x7efcbc072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.006+0000 7efcc32de640 1 --2- 172.21.15.146:0/2977529270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcbc0b3360 0x7efcbc072df0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7efcac005fd0 tx=0x7efcac02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.006+0000 7efcc32de640 1 -- 172.21.15.146:0/2977529270 shutdown_connections 2024-09-17T03:38:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.006+0000 7efcc32de640 1 --2- 172.21.15.146:0/2977529270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcbc0b3360 0x7efcbc072df0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.006+0000 7efcc32de640 1 -- 172.21.15.146:0/2977529270 >> 172.21.15.146:0/2977529270 conn(0x7efcbc0b2060 msgr2=0x7efcbc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.006+0000 7efcc32de640 1 -- 172.21.15.146:0/2977529270 shutdown_connections 2024-09-17T03:38:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.006+0000 7efcc32de640 1 -- 172.21.15.146:0/2977529270 wait complete. 2024-09-17T03:38:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.008+0000 7efcc32de640 1 Processor -- start 2024-09-17T03:38:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.008+0000 7efcc32de640 1 -- start start 2024-09-17T03:38:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc32de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcbc0b3360 0x7efcbc0aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc32de640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcbc0cfc40 0x7efcbc1f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc32de640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcbc0aefb0 0x7efcbc13d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc32de640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc151e30 con 0x7efcbc0cfc40 2024-09-17T03:38:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc32de640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc151cb0 con 0x7efcbc0aefb0 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc32de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efcbc151fb0 con 0x7efcbc0b3360 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc0879640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcbc0cfc40 0x7efcbc1f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc0879640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcbc0cfc40 0x7efcbc1f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48720/0 (socket says 172.21.15.146:48720) 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc0879640 1 -- 172.21.15.146:0/3967344745 learned_addr learned my addr 172.21.15.146:0/3967344745 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc107a640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcbc0b3360 0x7efcbc0aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc187b640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcbc0aefb0 0x7efcbc13d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc0879640 1 -- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcbc0b3360 msgr2=0x7efcbc0aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc0879640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcbc0b3360 0x7efcbc0aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc0879640 1 -- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcbc0aefb0 msgr2=0x7efcbc13d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc0879640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcbc0aefb0 0x7efcbc13d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc0879640 1 -- 172.21.15.146:0/3967344745 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcbc1f54c0 con 0x7efcbc0cfc40 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.009+0000 7efcc107a640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcbc0b3360 0x7efcbc0aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.010+0000 7efcc0879640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcbc0cfc40 0x7efcbc1f8a60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7efcb000b3c0 tx=0x7efcb000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.010+0000 7efcb9ffb640 1 -- 172.21.15.146:0/3967344745 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0005920 con 0x7efcbc0cfc40 2024-09-17T03:38:08.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.010+0000 7efcb9ffb640 1 -- 172.21.15.146:0/3967344745 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcb0005bd0 con 0x7efcbc0cfc40 2024-09-17T03:38:08.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.010+0000 7efcc32de640 1 -- 172.21.15.146:0/3967344745 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcbc1f57a0 con 0x7efcbc0cfc40 2024-09-17T03:38:08.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.010+0000 7efcb9ffb640 1 -- 172.21.15.146:0/3967344745 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0006020 con 0x7efcbc0cfc40 2024-09-17T03:38:08.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.010+0000 7efcc32de640 1 -- 172.21.15.146:0/3967344745 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcbc1f8fa0 con 0x7efcbc0cfc40 2024-09-17T03:38:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.011+0000 7efcc32de640 1 -- 172.21.15.146:0/3967344745 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcbc1f9540 con 0x7efcbc0cfc40 2024-09-17T03:38:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.012+0000 7efcb9ffb640 1 -- 172.21.15.146:0/3967344745 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efcb0018070 con 0x7efcbc0cfc40 2024-09-17T03:38:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.012+0000 7efcb9ffb640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efca8078bc0 0x7efca807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.012+0000 7efcb9ffb640 1 -- 172.21.15.146:0/3967344745 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7efcb0099fd0 con 0x7efcbc0cfc40 2024-09-17T03:38:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.013+0000 7efcc107a640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efca8078bc0 0x7efca807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.013+0000 7efcc107a640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efca8078bc0 0x7efca807b0d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efcac034000 tx=0x7efcac004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.017+0000 7efcb9ffb640 1 -- 172.21.15.146:0/3967344745 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efcb00623b0 con 0x7efcbc0cfc40 2024-09-17T03:38:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.196+0000 7efcc32de640 1 -- 172.21.15.146:0/3967344745 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcbc072df0 con 0x7efcbc0cfc40 2024-09-17T03:38:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.198+0000 7efcb9ffb640 1 -- 172.21.15.146:0/3967344745 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16893 (secure 0 0 0) 0x7efcb0061cb0 con 0x7efcbc0cfc40 2024-09-17T03:38:08.198 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:08.198 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":92,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:37:53.137560+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:41.074046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:42.389031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6836/9562532":"2024-09-18T03:37:53.137528+0000","172.21.15.179:6834/9562532":"2024-09-18T03:37:53.137528+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:08.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 -- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efca8078bc0 msgr2=0x7efca807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efca8078bc0 0x7efca807b0d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efcac034000 tx=0x7efcac004ab0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 -- 172.21.15.146:0/3967344745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcbc0cfc40 msgr2=0x7efcbc1f8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcbc0cfc40 0x7efcbc1f8a60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7efcb000b3c0 tx=0x7efcb000b880 comp rx=0 tx=0).stop 2024-09-17T03:38:08.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 -- 172.21.15.146:0/3967344745 shutdown_connections 2024-09-17T03:38:08.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efca8078bc0 0x7efca807b0d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efcbc0aefb0 0x7efcbc13d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcbc0cfc40 0x7efcbc1f8a60 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 --2- 172.21.15.146:0/3967344745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efcbc0b3360 0x7efcbc0aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 -- 172.21.15.146:0/3967344745 >> 172.21.15.146:0/3967344745 conn(0x7efcbc0b2060 msgr2=0x7efcbc14b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:08.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 -- 172.21.15.146:0/3967344745 shutdown_connections 2024-09-17T03:38:08.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.200+0000 7efcc32de640 1 -- 172.21.15.146:0/3967344745 wait complete. 2024-09-17T03:38:08.211 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:38:08.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:08.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.325+0000 7f695d1f1640 1 -- 172.21.15.146:0/1612116200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695815f1a0 msgr2=0x7f69580cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.325+0000 7f695d1f1640 1 --2- 172.21.15.146:0/1612116200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695815f1a0 0x7f69580cfca0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f695808da50 tx=0x7f694802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.325+0000 7f695d1f1640 1 -- 172.21.15.146:0/1612116200 shutdown_connections 2024-09-17T03:38:08.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.325+0000 7f695d1f1640 1 --2- 172.21.15.146:0/1612116200 >> v2:172.21.15.179:3300/0 conn(0x7f69580b61f0 0x7f69580b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.325+0000 7f695d1f1640 1 --2- 172.21.15.146:0/1612116200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69581631a0 0x7f69580cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.325+0000 7f695d1f1640 1 --2- 172.21.15.146:0/1612116200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695815f1a0 0x7f69580cfca0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.325+0000 7f695d1f1640 1 -- 172.21.15.146:0/1612116200 >> 172.21.15.146:0/1612116200 conn(0x7f69580d11f0 msgr2=0x7f69580d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:08.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.325+0000 7f695d1f1640 1 -- 172.21.15.146:0/1612116200 shutdown_connections 2024-09-17T03:38:08.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.325+0000 7f695d1f1640 1 -- 172.21.15.146:0/1612116200 wait complete. 2024-09-17T03:38:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.328+0000 7f695d1f1640 1 Processor -- start 2024-09-17T03:38:08.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.328+0000 7f695d1f1640 1 -- start start 2024-09-17T03:38:08.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695d1f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69580b61f0 0x7f69580ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695d1f1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695815f1a0 0x7f6958157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695d1f1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69581631a0 0x7f695815b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695d1f1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69580693a0 con 0x7f695815f1a0 2024-09-17T03:38:08.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695d1f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6958069220 con 0x7f69580b61f0 2024-09-17T03:38:08.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695d1f1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6958069520 con 0x7f69581631a0 2024-09-17T03:38:08.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695815f1a0 0x7f6958157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695815f1a0 0x7f6958157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48736/0 (socket says 172.21.15.146:48736) 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695659c640 1 -- 172.21.15.146:0/821955368 learned_addr learned my addr 172.21.15.146:0/821955368 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f6956d9d640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69580b61f0 0x7f69580ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695759e640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69581631a0 0x7f695815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695659c640 1 -- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69581631a0 msgr2=0x7f695815b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695659c640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69581631a0 0x7f695815b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695659c640 1 -- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69580b61f0 msgr2=0x7f69580ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695659c640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69580b61f0 0x7f69580ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695659c640 1 -- 172.21.15.146:0/821955368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69580caa30 con 0x7f695815f1a0 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.329+0000 7f695759e640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69581631a0 0x7f695815b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.330+0000 7f695659c640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695815f1a0 0x7f6958157640 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f694c00cd10 tx=0x7f694c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.330+0000 7f693f7fe640 1 -- 172.21.15.146:0/821955368 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c00f450 con 0x7f695815f1a0 2024-09-17T03:38:08.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.330+0000 7f693f7fe640 1 -- 172.21.15.146:0/821955368 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f694c00f6e0 con 0x7f695815f1a0 2024-09-17T03:38:08.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.330+0000 7f695d1f1640 1 -- 172.21.15.146:0/821955368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69580cad10 con 0x7f695815f1a0 2024-09-17T03:38:08.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.330+0000 7f693f7fe640 1 -- 172.21.15.146:0/821955368 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c00fb10 con 0x7f695815f1a0 2024-09-17T03:38:08.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.330+0000 7f695d1f1640 1 -- 172.21.15.146:0/821955368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f695815bfb0 con 0x7f695815f1a0 2024-09-17T03:38:08.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.331+0000 7f695d1f1640 1 -- 172.21.15.146:0/821955368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6958069a40 con 0x7f695815f1a0 2024-09-17T03:38:08.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.332+0000 7f693f7fe640 1 -- 172.21.15.146:0/821955368 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f694c00fcb0 con 0x7f695815f1a0 2024-09-17T03:38:08.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.332+0000 7f693f7fe640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6944078b90 0x7f694407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.332+0000 7f693f7fe640 1 -- 172.21.15.146:0/821955368 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f694c09b7f0 con 0x7f695815f1a0 2024-09-17T03:38:08.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.333+0000 7f6956d9d640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6944078b90 0x7f694407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.333+0000 7f6956d9d640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6944078b90 0x7f694407b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6948033000 tx=0x7f6948004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:08.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.337+0000 7f693f7fe640 1 -- 172.21.15.146:0/821955368 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f694c014030 con 0x7f695815f1a0 2024-09-17T03:38:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.547+0000 7f695d1f1640 1 -- 172.21.15.146:0/821955368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69580cea20 con 0x7f695815f1a0 2024-09-17T03:38:08.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.547+0000 7f693f7fe640 1 -- 172.21.15.146:0/821955368 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5238 (secure 0 0 0) 0x7f694c063c60 con 0x7f695815f1a0 2024-09-17T03:38:08.548 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:08.548 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":69,"btime":"2024-09-17T03:37:57:164566+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2734448758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2734448758},{"type":"v1","addr":"172.21.15.179:6837","nonce":2734448758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7497,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1302041078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1302041078},{"type":"v1","addr":"172.21.15.146:6833","nonce":1302041078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7506,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3947229505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3947229505},{"type":"v1","addr":"172.21.15.179:6835","nonce":3947229505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:57.164556+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7515":{"gid":7515,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2040023606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2040023606},{"type":"v1","addr":"172.21.15.146:6835","nonce":2040023606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7515,"qdb_cluster":[7515]},"id":6}]} 2024-09-17T03:38:08.548 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 69 2024-09-17T03:38:08.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 -- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6944078b90 msgr2=0x7f694407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6944078b90 0x7f694407b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6948033000 tx=0x7f6948004730 comp rx=0 tx=0).stop 2024-09-17T03:38:08.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 -- 172.21.15.146:0/821955368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695815f1a0 msgr2=0x7f6958157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695815f1a0 0x7f6958157640 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f694c00cd10 tx=0x7f694c00a620 comp rx=0 tx=0).stop 2024-09-17T03:38:08.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 -- 172.21.15.146:0/821955368 shutdown_connections 2024-09-17T03:38:08.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6944078b90 0x7f694407b0a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69581631a0 0x7f695815b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f695815f1a0 0x7f6958157640 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 --2- 172.21.15.146:0/821955368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69580b61f0 0x7f69580ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 -- 172.21.15.146:0/821955368 >> 172.21.15.146:0/821955368 conn(0x7f69580d11f0 msgr2=0x7f6958160e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 -- 172.21.15.146:0/821955368 shutdown_connections 2024-09-17T03:38:08.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.550+0000 7f695d1f1640 1 -- 172.21.15.146:0/821955368 wait complete. 2024-09-17T03:38:08.562 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.675+0000 7f2dc6440640 1 -- 172.21.15.146:0/1631603578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc00b3d30 msgr2=0x7f2dc01677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.675+0000 7f2dc6440640 1 --2- 172.21.15.146:0/1631603578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc00b3d30 0x7f2dc01677c0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f2db8005fd0 tx=0x7f2db802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.675+0000 7f2dc6440640 1 -- 172.21.15.146:0/1631603578 shutdown_connections 2024-09-17T03:38:08.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.675+0000 7f2dc6440640 1 --2- 172.21.15.146:0/1631603578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc00b3d30 0x7f2dc01677c0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.675+0000 7f2dc6440640 1 -- 172.21.15.146:0/1631603578 >> 172.21.15.146:0/1631603578 conn(0x7f2dc00b7b20 msgr2=0x7f2dc009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.675+0000 7f2dc6440640 1 -- 172.21.15.146:0/1631603578 shutdown_connections 2024-09-17T03:38:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.675+0000 7f2dc6440640 1 -- 172.21.15.146:0/1631603578 wait complete. 2024-09-17T03:38:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.677+0000 7f2dc6440640 1 Processor -- start 2024-09-17T03:38:08.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.677+0000 7f2dc6440640 1 -- start start 2024-09-17T03:38:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.678+0000 7f2dc6440640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dc00b5750 0x7f2dc0166bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.678+0000 7f2dc6440640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc00b5ce0 0x7f2dc01f8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.678+0000 7f2dc6440640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dc0156ed0 0x7f2dc01572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.678+0000 7f2dc6440640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc0167f10 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.678+0000 7f2dc6440640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc015ddb0 con 0x7f2dc0156ed0 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.678+0000 7f2dc6440640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc0168090 con 0x7f2dc00b5750 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.678+0000 7f2dbf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc00b5ce0 0x7f2dc01f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.678+0000 7f2dbf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc00b5ce0 0x7f2dc01f8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48754/0 (socket says 172.21.15.146:48754) 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.678+0000 7f2dbf7fe640 1 -- 172.21.15.146:0/4209114718 learned_addr learned my addr 172.21.15.146:0/4209114718 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.678+0000 7f2dc49dd640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dc0156ed0 0x7f2dc01572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.678+0000 7f2dbffff640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dc00b5750 0x7f2dc0166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dbf7fe640 1 -- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dc00b5750 msgr2=0x7f2dc0166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dbf7fe640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dc00b5750 0x7f2dc0166bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dbf7fe640 1 -- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dc0156ed0 msgr2=0x7f2dc01572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dbf7fe640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dc0156ed0 0x7f2dc01572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dbf7fe640 1 -- 172.21.15.146:0/4209114718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc0150660 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dbffff640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dc00b5750 0x7f2dc0166bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:08.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dc49dd640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dc0156ed0 0x7f2dc01572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:08.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dbf7fe640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc00b5ce0 0x7f2dc01f8f10 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c3d0 tx=0x7f2db400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:08.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dbcff9640 1 -- 172.21.15.146:0/4209114718 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4017070 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dbcff9640 1 -- 172.21.15.146:0/4209114718 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2db40053c0 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dc6440640 1 -- 172.21.15.146:0/4209114718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc0157820 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dbcff9640 1 -- 172.21.15.146:0/4209114718 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4003850 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.679+0000 7f2dc6440640 1 -- 172.21.15.146:0/4209114718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc01f9af0 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.680+0000 7f2dc6440640 1 -- 172.21.15.146:0/4209114718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc01f9860 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.681+0000 7f2dbcff9640 1 -- 172.21.15.146:0/4209114718 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2db401a070 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.681+0000 7f2dbcff9640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dac078bc0 0x7f2dac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:08.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.681+0000 7f2dbcff9640 1 -- 172.21.15.146:0/4209114718 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7f2db409a010 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.681+0000 7f2dbffff640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dac078bc0 0x7f2dac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:08.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.682+0000 7f2dbffff640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dac078bc0 0x7f2dac07b0d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2db0007a50 tx=0x7f2db0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:08.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.686+0000 7f2dbcff9640 1 -- 172.21.15.146:0/4209114718 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2dc0157820 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.893+0000 7f2dc6440640 1 -- 172.21.15.146:0/4209114718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dc00b1320 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.894+0000 7f2dbcff9640 1 -- 172.21.15.146:0/4209114718 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5238 (secure 0 0 0) 0x7f2dc0150660 con 0x7f2dc00b5ce0 2024-09-17T03:38:08.894 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:08.894 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":69,"btime":"2024-09-17T03:37:57:164566+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2734448758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2734448758},{"type":"v1","addr":"172.21.15.179:6837","nonce":2734448758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7497,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1302041078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1302041078},{"type":"v1","addr":"172.21.15.146:6833","nonce":1302041078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7506,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3947229505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3947229505},{"type":"v1","addr":"172.21.15.179:6835","nonce":3947229505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:37:43.428752+0000","modified":"2024-09-17T03:37:57.164556+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7515":{"gid":7515,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2040023606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2040023606},{"type":"v1","addr":"172.21.15.146:6835","nonce":2040023606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7515,"qdb_cluster":[7515]},"id":6}]} 2024-09-17T03:38:08.895 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 69 2024-09-17T03:38:08.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 -- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dac078bc0 msgr2=0x7f2dac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dac078bc0 0x7f2dac07b0d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2db0007a50 tx=0x7f2db0009040 comp rx=0 tx=0).stop 2024-09-17T03:38:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 -- 172.21.15.146:0/4209114718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc00b5ce0 msgr2=0x7f2dc01f8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc00b5ce0 0x7f2dc01f8f10 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c3d0 tx=0x7f2db400c890 comp rx=0 tx=0).stop 2024-09-17T03:38:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 -- 172.21.15.146:0/4209114718 shutdown_connections 2024-09-17T03:38:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dac078bc0 0x7f2dac07b0d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2dc0156ed0 0x7f2dc01572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc00b5ce0 0x7f2dc01f8f10 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 --2- 172.21.15.146:0/4209114718 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2dc00b5750 0x7f2dc0166bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 -- 172.21.15.146:0/4209114718 >> 172.21.15.146:0/4209114718 conn(0x7f2dc00b7b20 msgr2=0x7f2dc0167380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 -- 172.21.15.146:0/4209114718 shutdown_connections 2024-09-17T03:38:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:08.896+0000 7f2dc6440640 1 -- 172.21.15.146:0/4209114718 wait complete. 2024-09-17T03:38:08.908 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.021+0000 7fe20ad69640 1 -- 172.21.15.146:0/1840994924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ec004800 msgr2=0x7fe1ec004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.021+0000 7fe20ad69640 1 --2- 172.21.15.146:0/1840994924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ec004800 0x7fe1ec004c10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fe2040b0700 tx=0x7fe1ec005830 comp rx=0 tx=0).stop 2024-09-17T03:38:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.021+0000 7fe209306640 1 -- 172.21.15.146:0/1840994924 reap_dead start 2024-09-17T03:38:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.021+0000 7fe20ad69640 1 -- 172.21.15.146:0/1840994924 shutdown_connections 2024-09-17T03:38:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.021+0000 7fe20ad69640 1 -- 172.21.15.146:0/1840994924 >> 172.21.15.146:0/1840994924 conn(0x7fe2040b3410 msgr2=0x7fe2040b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.021+0000 7fe20ad69640 1 -- 172.21.15.146:0/1840994924 shutdown_connections 2024-09-17T03:38:09.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.021+0000 7fe20ad69640 1 -- 172.21.15.146:0/1840994924 wait complete. 2024-09-17T03:38:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.023+0000 7fe20ad69640 1 Processor -- start 2024-09-17T03:38:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.023+0000 7fe20ad69640 1 -- start start 2024-09-17T03:38:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.024+0000 7fe20ad69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1ec004800 0x7fe2040af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.024+0000 7fe20ad69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe204150fb0 0x7fe20414afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.024+0000 7fe20ad69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2041f5840 0x7fe2041f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.024+0000 7fe20ad69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe2040b4940 con 0x7fe204150fb0 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.024+0000 7fe20ad69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe2040b5c10 con 0x7fe1ec004800 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.024+0000 7fe20ad69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe2040b4ac0 con 0x7fe2041f5840 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.024+0000 7fe203fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe204150fb0 0x7fe20414afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.024+0000 7fe203fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe204150fb0 0x7fe20414afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48772/0 (socket says 172.21.15.146:48772) 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.024+0000 7fe203fff640 1 -- 172.21.15.146:0/1901750365 learned_addr learned my addr 172.21.15.146:0/1901750365 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.024+0000 7fe208b05640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1ec004800 0x7fe2040af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.024+0000 7fe209306640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2041f5840 0x7fe2041f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.025+0000 7fe203fff640 1 -- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2041f5840 msgr2=0x7fe2041f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.025+0000 7fe203fff640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2041f5840 0x7fe2041f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.025+0000 7fe203fff640 1 -- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1ec004800 msgr2=0x7fe2040af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.025+0000 7fe203fff640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1ec004800 0x7fe2040af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.025+0000 7fe203fff640 1 -- 172.21.15.146:0/1901750365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2041f6190 con 0x7fe204150fb0 2024-09-17T03:38:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.025+0000 7fe203fff640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe204150fb0 0x7fe20414afb0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800bbe0 tx=0x7fe1f8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.025+0000 7fe2017fa640 1 -- 172.21.15.146:0/1901750365 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8041070 con 0x7fe204150fb0 2024-09-17T03:38:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.025+0000 7fe2017fa640 1 -- 172.21.15.146:0/1901750365 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1f8032c70 con 0x7fe204150fb0 2024-09-17T03:38:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.025+0000 7fe2017fa640 1 -- 172.21.15.146:0/1901750365 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8032e60 con 0x7fe204150fb0 2024-09-17T03:38:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.025+0000 7fe20ad69640 1 -- 172.21.15.146:0/1901750365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2040ae9c0 con 0x7fe204150fb0 2024-09-17T03:38:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.025+0000 7fe20ad69640 1 -- 172.21.15.146:0/1901750365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2040aef80 con 0x7fe204150fb0 2024-09-17T03:38:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.026+0000 7fe20ad69640 1 -- 172.21.15.146:0/1901750365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe20406e170 con 0x7fe204150fb0 2024-09-17T03:38:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.027+0000 7fe2017fa640 1 -- 172.21.15.146:0/1901750365 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1f8004290 con 0x7fe204150fb0 2024-09-17T03:38:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.027+0000 7fe2017fa640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078bc0 0x7fe1f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.027+0000 7fe2017fa640 1 -- 172.21.15.146:0/1901750365 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7fe1f80bb7b0 con 0x7fe204150fb0 2024-09-17T03:38:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.028+0000 7fe208b05640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078bc0 0x7fe1f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:09.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.028+0000 7fe208b05640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078bc0 0x7fe1f007b0d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4001370 tx=0x7fe1f40021b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:09.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.032+0000 7fe2017fa640 1 -- 172.21.15.146:0/1901750365 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe1f80834c0 con 0x7fe204150fb0 2024-09-17T03:38:09.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.211+0000 7fe20ad69640 1 -- 172.21.15.146:0/1901750365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe204076250 con 0x7fe204150fb0 2024-09-17T03:38:09.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.212+0000 7fe2017fa640 1 -- 172.21.15.146:0/1901750365 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16893 (secure 0 0 0) 0x7fe1f8087ef0 con 0x7fe204150fb0 2024-09-17T03:38:09.212 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:09.212 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":92,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:37:53.137560+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:37:41.074046+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T03:37:42.389031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6836/9562532":"2024-09-18T03:37:53.137528+0000","172.21.15.179:6834/9562532":"2024-09-18T03:37:53.137528+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 -- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078bc0 msgr2=0x7fe1f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078bc0 0x7fe1f007b0d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4001370 tx=0x7fe1f40021b0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 -- 172.21.15.146:0/1901750365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe204150fb0 msgr2=0x7fe20414afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe204150fb0 0x7fe20414afb0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800bbe0 tx=0x7fe1f8032670 comp rx=0 tx=0).stop 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 -- 172.21.15.146:0/1901750365 shutdown_connections 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1f0078bc0 0x7fe1f007b0d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2041f5840 0x7fe2041f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe204150fb0 0x7fe20414afb0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 --2- 172.21.15.146:0/1901750365 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1ec004800 0x7fe2040af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 -- 172.21.15.146:0/1901750365 >> 172.21.15.146:0/1901750365 conn(0x7fe2040b3410 msgr2=0x7fe2040b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 -- 172.21.15.146:0/1901750365 shutdown_connections 2024-09-17T03:38:09.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.214+0000 7fe20ad69640 1 -- 172.21.15.146:0/1901750365 wait complete. 2024-09-17T03:38:09.227 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:38:09.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.340+0000 7fe62e90b640 1 -- 172.21.15.146:0/164787837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6280b47c0 msgr2=0x7fe6280cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.340+0000 7fe62e90b640 1 --2- 172.21.15.146:0/164787837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6280b47c0 0x7fe6280cd090 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fe610009830 tx=0x7fe61002a480 comp rx=0 tx=0).stop 2024-09-17T03:38:09.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.340+0000 7fe62e90b640 1 -- 172.21.15.146:0/164787837 shutdown_connections 2024-09-17T03:38:09.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.340+0000 7fe62e90b640 1 --2- 172.21.15.146:0/164787837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6280b47c0 0x7fe6280cd090 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.340+0000 7fe62e90b640 1 -- 172.21.15.146:0/164787837 >> 172.21.15.146:0/164787837 conn(0x7fe62809ba20 msgr2=0x7fe6280b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:09.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.340+0000 7fe62e90b640 1 -- 172.21.15.146:0/164787837 shutdown_connections 2024-09-17T03:38:09.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.340+0000 7fe62e90b640 1 -- 172.21.15.146:0/164787837 wait complete. 2024-09-17T03:38:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.342+0000 7fe62e90b640 1 Processor -- start 2024-09-17T03:38:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.342+0000 7fe62e90b640 1 -- start start 2024-09-17T03:38:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe62e90b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6280b47c0 0x7fe62814da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe62e90b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6280cd5d0 0x7fe6280c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe62e90b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6280d0710 0x7fe6280c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe62e90b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe6280b2f30 con 0x7fe6280b47c0 2024-09-17T03:38:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe62e90b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe6280b80a0 con 0x7fe6280d0710 2024-09-17T03:38:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe62e90b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe628168470 con 0x7fe6280cd5d0 2024-09-17T03:38:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe627fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6280b47c0 0x7fe62814da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe627fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6280b47c0 0x7fe62814da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48796/0 (socket says 172.21.15.146:48796) 2024-09-17T03:38:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe627fff640 1 -- 172.21.15.146:0/341443405 learned_addr learned my addr 172.21.15.146:0/341443405 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe6277fe640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6280cd5d0 0x7fe6280c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:09.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe62cea8640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6280d0710 0x7fe6280c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe627fff640 1 -- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6280cd5d0 msgr2=0x7fe6280c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe627fff640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6280cd5d0 0x7fe6280c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe627fff640 1 -- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6280d0710 msgr2=0x7fe6280c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe627fff640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6280d0710 0x7fe6280c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe627fff640 1 -- 172.21.15.146:0/341443405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6280c9b50 con 0x7fe6280b47c0 2024-09-17T03:38:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe627fff640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6280b47c0 0x7fe62814da40 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe61800c3c0 tx=0x7fe61800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe624ff9640 1 -- 172.21.15.146:0/341443405 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618017070 con 0x7fe6280b47c0 2024-09-17T03:38:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe624ff9640 1 -- 172.21.15.146:0/341443405 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6180035f0 con 0x7fe6280b47c0 2024-09-17T03:38:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe62e90b640 1 -- 172.21.15.146:0/341443405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6280ca060 con 0x7fe6280b47c0 2024-09-17T03:38:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe624ff9640 1 -- 172.21.15.146:0/341443405 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618003a80 con 0x7fe6280b47c0 2024-09-17T03:38:09.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.344+0000 7fe62e90b640 1 -- 172.21.15.146:0/341443405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6280ca620 con 0x7fe6280b47c0 2024-09-17T03:38:09.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.345+0000 7fe62e90b640 1 -- 172.21.15.146:0/341443405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6280cd090 con 0x7fe6280b47c0 2024-09-17T03:38:09.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.346+0000 7fe624ff9640 1 -- 172.21.15.146:0/341443405 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe61801a070 con 0x7fe6280b47c0 2024-09-17T03:38:09.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.347+0000 7fe624ff9640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe608078bc0 0x7fe60807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.347+0000 7fe624ff9640 1 -- 172.21.15.146:0/341443405 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5795+0+0 (secure 0 0 0) 0x7fe618099fe0 con 0x7fe6280b47c0 2024-09-17T03:38:09.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.347+0000 7fe6277fe640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe608078bc0 0x7fe60807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:09.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.348+0000 7fe6277fe640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe608078bc0 0x7fe60807b0d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe610034000 tx=0x7fe610004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:09.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.351+0000 7fe624ff9640 1 -- 172.21.15.146:0/341443405 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe618061d70 con 0x7fe6280b47c0 2024-09-17T03:38:09.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.564+0000 7fe62e90b640 1 -- 172.21.15.146:0/341443405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe6280ced70 con 0x7fe6280b47c0 2024-09-17T03:38:09.564 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:38:09.564+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:38:09.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.566+0000 7fe624ff9640 1 -- 172.21.15.146:0/341443405 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) ==== 161+0+0 (secure 0 0 0) 0x7fe6180667a0 con 0x7fe6280b47c0 2024-09-17T03:38:09.566 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:38:09.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 -- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe608078bc0 msgr2=0x7fe60807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe608078bc0 0x7fe60807b0d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe610034000 tx=0x7fe610004730 comp rx=0 tx=0).stop 2024-09-17T03:38:09.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 -- 172.21.15.146:0/341443405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6280b47c0 msgr2=0x7fe62814da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6280b47c0 0x7fe62814da40 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe61800c3c0 tx=0x7fe61800c880 comp rx=0 tx=0).stop 2024-09-17T03:38:09.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 -- 172.21.15.146:0/341443405 shutdown_connections 2024-09-17T03:38:09.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe608078bc0 0x7fe60807b0d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6280d0710 0x7fe6280c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6280cd5d0 0x7fe6280c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 --2- 172.21.15.146:0/341443405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6280b47c0 0x7fe62814da40 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 -- 172.21.15.146:0/341443405 >> 172.21.15.146:0/341443405 conn(0x7fe62809ba20 msgr2=0x7fe6280cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:09.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 -- 172.21.15.146:0/341443405 shutdown_connections 2024-09-17T03:38:09.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.569+0000 7fe62e90b640 1 -- 172.21.15.146:0/341443405 wait complete. 2024-09-17T03:38:09.571 INFO:tasks.ceph.mds.a.smithi146.stderr: -3136> 2024-09-17T03:38:00.157+0000 7f311ecfc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:38:09.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:38:09.625 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:38:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.699+0000 7f220beb4640 1 -- 172.21.15.146:0/274748769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22040d0710 msgr2=0x7f22040cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.699+0000 7f220beb4640 1 --2- 172.21.15.146:0/274748769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22040d0710 0x7f22040cf170 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f22040d0b20 tx=0x7f220002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.699+0000 7f220beb4640 1 -- 172.21.15.146:0/274748769 shutdown_connections 2024-09-17T03:38:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.699+0000 7f220beb4640 1 --2- 172.21.15.146:0/274748769 >> v2:172.21.15.179:3300/0 conn(0x7f22040cf6b0 0x7f2204161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.699+0000 7f220beb4640 1 --2- 172.21.15.146:0/274748769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22040d0710 0x7f22040cf170 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.699+0000 7f220beb4640 1 -- 172.21.15.146:0/274748769 >> 172.21.15.146:0/274748769 conn(0x7f220409ba20 msgr2=0x7f22040b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.699+0000 7f220beb4640 1 -- 172.21.15.146:0/274748769 shutdown_connections 2024-09-17T03:38:09.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.699+0000 7f220beb4640 1 -- 172.21.15.146:0/274748769 wait complete. 2024-09-17T03:38:09.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.701+0000 7f220beb4640 1 Processor -- start 2024-09-17T03:38:09.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.701+0000 7f220beb4640 1 -- start start 2024-09-17T03:38:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.702+0000 7f220beb4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22040b47c0 0x7f22040cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.702+0000 7f220beb4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22040cf6b0 0x7f220415cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.702+0000 7f220beb4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22040d0710 0x7f22041f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.702+0000 7f220beb4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f22040b1de0 con 0x7f22040b47c0 2024-09-17T03:38:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.702+0000 7f220beb4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2204162080 con 0x7f22040cf6b0 2024-09-17T03:38:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.702+0000 7f220beb4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f22040b1f60 con 0x7f22040d0710 2024-09-17T03:38:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f2209c50640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22040b47c0 0x7f22040cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f2209c50640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22040b47c0 0x7f22040cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48840/0 (socket says 172.21.15.146:48840) 2024-09-17T03:38:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f2209c50640 1 -- 172.21.15.146:0/1217366693 learned_addr learned my addr 172.21.15.146:0/1217366693 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f2209c50640 1 -- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22040d0710 msgr2=0x7f22041f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f2209c50640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22040d0710 0x7f22041f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f2209c50640 1 -- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22040cf6b0 msgr2=0x7f220415cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f2209c50640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22040cf6b0 0x7f220415cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f2209c50640 1 -- 172.21.15.146:0/1217366693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220415d020 con 0x7f22040b47c0 2024-09-17T03:38:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f2209c50640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22040b47c0 0x7f22040cc610 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f2200009920 tx=0x7f2200033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f21fa7fc640 1 -- 172.21.15.146:0/1217366693 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200031e20 con 0x7f22040b47c0 2024-09-17T03:38:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f21fa7fc640 1 -- 172.21.15.146:0/1217366693 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2200005110 con 0x7f22040b47c0 2024-09-17T03:38:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f220beb4640 1 -- 172.21.15.146:0/1217366693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22040a0400 con 0x7f22040b47c0 2024-09-17T03:38:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f21fa7fc640 1 -- 172.21.15.146:0/1217366693 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200005560 con 0x7f22040b47c0 2024-09-17T03:38:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.703+0000 7f220beb4640 1 -- 172.21.15.146:0/1217366693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22040ca300 con 0x7f22040b47c0 2024-09-17T03:38:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.704+0000 7f220beb4640 1 -- 172.21.15.146:0/1217366693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22040cf170 con 0x7f22040b47c0 2024-09-17T03:38:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.705+0000 7f21fa7fc640 1 -- 172.21.15.146:0/1217366693 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f22000047a0 con 0x7f22040b47c0 2024-09-17T03:38:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.705+0000 7f21fa7fc640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21e8078bc0 0x7f21e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.706+0000 7f21fa7fc640 1 -- 172.21.15.146:0/1217366693 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5881+0+0 (secure 0 0 0) 0x7f22000bc180 con 0x7f22040b47c0 2024-09-17T03:38:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.706+0000 7f220944f640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21e8078bc0 0x7f21e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.706+0000 7f220944f640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21e8078bc0 0x7f21e807b0d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2204160570 tx=0x7f21f4005bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:09.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.710+0000 7f21fa7fc640 1 -- 172.21.15.146:0/1217366693 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f220003f030 con 0x7f22040b47c0 2024-09-17T03:38:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:09.923+0000 7f220beb4640 1 -- 172.21.15.146:0/1217366693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f22040ced70 con 0x7f22040b47c0 2024-09-17T03:38:10.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.575+0000 7f21fa7fc640 1 -- 172.21.15.146:0/1217366693 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) ==== 104+0+0 (secure 0 0 0) 0x7f2200084510 con 0x7f22040b47c0 2024-09-17T03:38:10.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 -- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21e8078bc0 msgr2=0x7f21e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21e8078bc0 0x7f21e807b0d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2204160570 tx=0x7f21f4005bd0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 -- 172.21.15.146:0/1217366693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22040b47c0 msgr2=0x7f22040cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22040b47c0 0x7f22040cc610 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f2200009920 tx=0x7f2200033d60 comp rx=0 tx=0).stop 2024-09-17T03:38:10.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 -- 172.21.15.146:0/1217366693 shutdown_connections 2024-09-17T03:38:10.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21e8078bc0 0x7f21e807b0d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22040d0710 0x7f22041f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22040cf6b0 0x7f220415cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 --2- 172.21.15.146:0/1217366693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22040b47c0 0x7f22040cc610 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 -- 172.21.15.146:0/1217366693 >> 172.21.15.146:0/1217366693 conn(0x7f220409ba20 msgr2=0x7f2204160e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:10.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 -- 172.21.15.146:0/1217366693 shutdown_connections 2024-09-17T03:38:10.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.578+0000 7f220beb4640 1 -- 172.21.15.146:0/1217366693 wait complete. 2024-09-17T03:38:10.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:38:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.707+0000 7ffa43162640 1 -- 172.21.15.146:0/2799135030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa3c071120 msgr2=0x7ffa3c0b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.707+0000 7ffa43162640 1 --2- 172.21.15.146:0/2799135030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa3c071120 0x7ffa3c0b4530 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c074730 tx=0x7ffa2402a520 comp rx=0 tx=0).stop 2024-09-17T03:38:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.707+0000 7ffa43162640 1 -- 172.21.15.146:0/2799135030 shutdown_connections 2024-09-17T03:38:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.707+0000 7ffa43162640 1 --2- 172.21.15.146:0/2799135030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa3c071120 0x7ffa3c0b4530 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.707+0000 7ffa43162640 1 --2- 172.21.15.146:0/2799135030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa3c0b55f0 0x7ffa3c070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.707+0000 7ffa43162640 1 -- 172.21.15.146:0/2799135030 >> 172.21.15.146:0/2799135030 conn(0x7ffa3c0b3410 msgr2=0x7ffa3c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.707+0000 7ffa43162640 1 -- 172.21.15.146:0/2799135030 shutdown_connections 2024-09-17T03:38:10.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.707+0000 7ffa43162640 1 -- 172.21.15.146:0/2799135030 wait complete. 2024-09-17T03:38:10.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.709+0000 7ffa43162640 1 Processor -- start 2024-09-17T03:38:10.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.709+0000 7ffa43162640 1 -- start start 2024-09-17T03:38:10.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.710+0000 7ffa43162640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa3c071120 0x7ffa3c1514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa43162640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa3c0b4a70 0x7ffa3c0cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa43162640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa3c0b55f0 0x7ffa3c0cf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa43162640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c15bd10 con 0x7ffa3c0b4a70 2024-09-17T03:38:10.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa43162640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c06e710 con 0x7ffa3c0b55f0 2024-09-17T03:38:10.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa43162640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3c15be90 con 0x7ffa3c071120 2024-09-17T03:38:10.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa3bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa3c0b4a70 0x7ffa3c0cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa3bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa3c0b4a70 0x7ffa3c0cf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48862/0 (socket says 172.21.15.146:48862) 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa3bfff640 1 -- 172.21.15.146:0/3601162727 learned_addr learned my addr 172.21.15.146:0/3601162727 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa416ff640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa3c0b55f0 0x7ffa3c0cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa40efe640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa3c071120 0x7ffa3c1514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa3bfff640 1 -- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa3c071120 msgr2=0x7ffa3c1514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa3bfff640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa3c071120 0x7ffa3c1514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa3bfff640 1 -- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa3c0b55f0 msgr2=0x7ffa3c0cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa3bfff640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa3c0b55f0 0x7ffa3c0cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa3bfff640 1 -- 172.21.15.146:0/3601162727 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c1f6ae0 con 0x7ffa3c0b4a70 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa3bfff640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa3c0b4a70 0x7ffa3c0cf450 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009850 tx=0x7ffa240039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa397fa640 1 -- 172.21.15.146:0/3601162727 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2403e030 con 0x7ffa3c0b4a70 2024-09-17T03:38:10.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa397fa640 1 -- 172.21.15.146:0/3601162727 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa240047a0 con 0x7ffa3c0b4a70 2024-09-17T03:38:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa43162640 1 -- 172.21.15.146:0/3601162727 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3c0cec90 con 0x7ffa3c0b4a70 2024-09-17T03:38:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.711+0000 7ffa397fa640 1 -- 172.21.15.146:0/3601162727 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24035040 con 0x7ffa3c0b4a70 2024-09-17T03:38:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.712+0000 7ffa43162640 1 -- 172.21.15.146:0/3601162727 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3c1f6800 con 0x7ffa3c0b4a70 2024-09-17T03:38:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.713+0000 7ffa43162640 1 -- 172.21.15.146:0/3601162727 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa3c0b4530 con 0x7ffa3c0b4a70 2024-09-17T03:38:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.713+0000 7ffa397fa640 1 -- 172.21.15.146:0/3601162727 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa24041030 con 0x7ffa3c0b4a70 2024-09-17T03:38:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.714+0000 7ffa397fa640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa1c078bc0 0x7ffa1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.714+0000 7ffa397fa640 1 -- 172.21.15.146:0/3601162727 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5881+0+0 (secure 0 0 0) 0x7ffa240bb4c0 con 0x7ffa3c0b4a70 2024-09-17T03:38:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.714+0000 7ffa40efe640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa1c078bc0 0x7ffa1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:10.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.715+0000 7ffa40efe640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa1c078bc0 0x7ffa1c07b0d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00ae50 tx=0x7ffa2c00a540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:10.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.718+0000 7ffa397fa640 1 -- 172.21.15.146:0/3601162727 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffa24083290 con 0x7ffa3c0b4a70 2024-09-17T03:38:10.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:10.894+0000 7ffa43162640 1 -- 172.21.15.146:0/3601162727 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffa3c151f50 con 0x7ffa3c0b4a70 2024-09-17T03:38:11.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.576+0000 7ffa397fa640 1 -- 172.21.15.146:0/3601162727 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7ffa24087cc0 con 0x7ffa3c0b4a70 2024-09-17T03:38:11.577 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:38:11.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 -- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa1c078bc0 msgr2=0x7ffa1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa1c078bc0 0x7ffa1c07b0d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00ae50 tx=0x7ffa2c00a540 comp rx=0 tx=0).stop 2024-09-17T03:38:11.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 -- 172.21.15.146:0/3601162727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa3c0b4a70 msgr2=0x7ffa3c0cf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa3c0b4a70 0x7ffa3c0cf450 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009850 tx=0x7ffa240039e0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 -- 172.21.15.146:0/3601162727 shutdown_connections 2024-09-17T03:38:11.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa1c078bc0 0x7ffa1c07b0d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa3c0b55f0 0x7ffa3c0cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa3c0b4a70 0x7ffa3c0cf450 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 --2- 172.21.15.146:0/3601162727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa3c071120 0x7ffa3c1514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 -- 172.21.15.146:0/3601162727 >> 172.21.15.146:0/3601162727 conn(0x7ffa3c0b3410 msgr2=0x7ffa3c15f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:11.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 -- 172.21.15.146:0/3601162727 shutdown_connections 2024-09-17T03:38:11.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.579+0000 7ffa43162640 1 -- 172.21.15.146:0/3601162727 wait complete. 2024-09-17T03:38:11.593 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:38:11.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.711+0000 7f664ccc4640 1 -- 172.21.15.146:0/2040509766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66480b61f0 msgr2=0x7f66480b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.711+0000 7f664ccc4640 1 --2- 172.21.15.146:0/2040509766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66480b61f0 0x7f66480b6600 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f664806e100 tx=0x7f664002a980 comp rx=0 tx=0).stop 2024-09-17T03:38:11.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.711+0000 7f664ccc4640 1 -- 172.21.15.146:0/2040509766 shutdown_connections 2024-09-17T03:38:11.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.711+0000 7f664ccc4640 1 --2- 172.21.15.146:0/2040509766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66480b61f0 0x7f66480b6600 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.711+0000 7f664ccc4640 1 --2- 172.21.15.146:0/2040509766 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66481631a0 0x7f66480cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.711+0000 7f664ccc4640 1 --2- 172.21.15.146:0/2040509766 >> v2:172.21.15.179:3300/0 conn(0x7f664815f1a0 0x7f66480cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.711+0000 7f664ccc4640 1 -- 172.21.15.146:0/2040509766 >> 172.21.15.146:0/2040509766 conn(0x7f66480d11f0 msgr2=0x7f66480d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:11.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.711+0000 7f664ccc4640 1 -- 172.21.15.146:0/2040509766 shutdown_connections 2024-09-17T03:38:11.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.711+0000 7f664ccc4640 1 -- 172.21.15.146:0/2040509766 wait complete. 2024-09-17T03:38:11.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.713+0000 7f664ccc4640 1 Processor -- start 2024-09-17T03:38:11.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.713+0000 7f664ccc4640 1 -- start start 2024-09-17T03:38:11.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.714+0000 7f664ccc4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66480b61f0 0x7f66480cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:11.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.714+0000 7f664ccc4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f664815f1a0 0x7f6648156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:11.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.714+0000 7f664ccc4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66481631a0 0x7f66480b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:11.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.714+0000 7f664ccc4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66480693a0 con 0x7f66480b61f0 2024-09-17T03:38:11.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.714+0000 7f664ccc4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6648069220 con 0x7f66481631a0 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.714+0000 7f664ccc4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6648069520 con 0x7f664815f1a0 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.714+0000 7f664659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66480b61f0 0x7f66480cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.714+0000 7f664659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66480b61f0 0x7f66480cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48878/0 (socket says 172.21.15.146:48878) 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.714+0000 7f664659c640 1 -- 172.21.15.146:0/1865912719 learned_addr learned my addr 172.21.15.146:0/1865912719 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.714+0000 7f6645d9b640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f664815f1a0 0x7f6648156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.714+0000 7f6646d9d640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66481631a0 0x7f66480b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f664659c640 1 -- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f664815f1a0 msgr2=0x7f6648156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f664659c640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f664815f1a0 0x7f6648156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f664659c640 1 -- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66481631a0 msgr2=0x7f66480b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f664659c640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66481631a0 0x7f66480b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f664659c640 1 -- 172.21.15.146:0/1865912719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66480b9d70 con 0x7f66480b61f0 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f6645d9b640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f664815f1a0 0x7f6648156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:11.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f664659c640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66480b61f0 0x7f66480cad70 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f663800d770 tx=0x7f663800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:11.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f6636ffd640 1 -- 172.21.15.146:0/1865912719 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638017070 con 0x7f66480b61f0 2024-09-17T03:38:11.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f664ccc4640 1 -- 172.21.15.146:0/1865912719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66481f9520 con 0x7f66480b61f0 2024-09-17T03:38:11.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f6636ffd640 1 -- 172.21.15.146:0/1865912719 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6638009d20 con 0x7f66480b61f0 2024-09-17T03:38:11.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f6636ffd640 1 -- 172.21.15.146:0/1865912719 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66380106c0 con 0x7f66480b61f0 2024-09-17T03:38:11.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.715+0000 7f664ccc4640 1 -- 172.21.15.146:0/1865912719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66481f9ae0 con 0x7f66480b61f0 2024-09-17T03:38:11.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.716+0000 7f664ccc4640 1 -- 172.21.15.146:0/1865912719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f664815d110 con 0x7f66480b61f0 2024-09-17T03:38:11.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.717+0000 7f6636ffd640 1 -- 172.21.15.146:0/1865912719 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f663801a070 con 0x7f66480b61f0 2024-09-17T03:38:11.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.717+0000 7f6636ffd640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6628078bc0 0x7f662807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:11.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.717+0000 7f6636ffd640 1 -- 172.21.15.146:0/1865912719 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5443+0+0 (secure 0 0 0) 0x7f663809ad30 con 0x7f66480b61f0 2024-09-17T03:38:11.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.718+0000 7f6645d9b640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6628078bc0 0x7f662807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:11.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.718+0000 7f6645d9b640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6628078bc0 0x7f662807b0d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f663c005fd0 tx=0x7f663c005cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:11.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.722+0000 7f6636ffd640 1 -- 172.21.15.146:0/1865912719 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6638062ba0 con 0x7f66480b61f0 2024-09-17T03:38:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:11.903+0000 7f664ccc4640 1 -- 172.21.15.146:0/1865912719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6648069a40 con 0x7f66480b61f0 2024-09-17T03:38:12.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.583+0000 7f6636ffd640 1 -- 172.21.15.146:0/1865912719 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7f66380675d0 con 0x7f66480b61f0 2024-09-17T03:38:12.584 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:38:12.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 -- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6628078bc0 msgr2=0x7f662807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6628078bc0 0x7f662807b0d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f663c005fd0 tx=0x7f663c005cf0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 -- 172.21.15.146:0/1865912719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66480b61f0 msgr2=0x7f66480cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66480b61f0 0x7f66480cad70 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f663800d770 tx=0x7f663800dc30 comp rx=0 tx=0).stop 2024-09-17T03:38:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 -- 172.21.15.146:0/1865912719 shutdown_connections 2024-09-17T03:38:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6628078bc0 0x7f662807b0d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66481631a0 0x7f66480b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f664815f1a0 0x7f6648156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 --2- 172.21.15.146:0/1865912719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66480b61f0 0x7f66480cad70 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 -- 172.21.15.146:0/1865912719 >> 172.21.15.146:0/1865912719 conn(0x7f66480d11f0 msgr2=0x7f664815d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 -- 172.21.15.146:0/1865912719 shutdown_connections 2024-09-17T03:38:12.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.586+0000 7f664ccc4640 1 -- 172.21.15.146:0/1865912719 wait complete. 2024-09-17T03:38:12.601 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:38:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.721+0000 7f59dba5c640 1 -- 172.21.15.146:0/3699107628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d40b5750 msgr2=0x7f59d40b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.721+0000 7f59dba5c640 1 --2- 172.21.15.146:0/3699107628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d40b5750 0x7f59d40b3620 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f59d40b5390 tx=0x7f59c402a560 comp rx=0 tx=0).stop 2024-09-17T03:38:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.721+0000 7f59dba5c640 1 -- 172.21.15.146:0/3699107628 shutdown_connections 2024-09-17T03:38:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.721+0000 7f59dba5c640 1 --2- 172.21.15.146:0/3699107628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59d40b3b60 0x7f59d40b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.721+0000 7f59dba5c640 1 --2- 172.21.15.146:0/3699107628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d40b5750 0x7f59d40b3620 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.721+0000 7f59dba5c640 1 --2- 172.21.15.146:0/3699107628 >> v2:172.21.15.179:3300/0 conn(0x7f59d40b5ce0 0x7f59d40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.721+0000 7f59dba5c640 1 -- 172.21.15.146:0/3699107628 >> 172.21.15.146:0/3699107628 conn(0x7f59d40b7b20 msgr2=0x7f59d409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.721+0000 7f59dba5c640 1 -- 172.21.15.146:0/3699107628 shutdown_connections 2024-09-17T03:38:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.721+0000 7f59dba5c640 1 -- 172.21.15.146:0/3699107628 wait complete. 2024-09-17T03:38:12.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.723+0000 7f59dba5c640 1 Processor -- start 2024-09-17T03:38:12.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.723+0000 7f59dba5c640 1 -- start start 2024-09-17T03:38:12.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.724+0000 7f59dba5c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d40b3b60 0x7f59d41568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:12.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.724+0000 7f59dba5c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d40b5750 0x7f59d415ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:12.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.724+0000 7f59dba5c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59d40b5ce0 0x7f59d415f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:12.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.724+0000 7f59dba5c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f59d40b2970 con 0x7f59d40b5750 2024-09-17T03:38:12.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.724+0000 7f59dba5c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f59d40b27f0 con 0x7f59d40b3b60 2024-09-17T03:38:12.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.724+0000 7f59dba5c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f59d40b2af0 con 0x7f59d40b5ce0 2024-09-17T03:38:12.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d8ff7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d40b5750 0x7f59d415ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:12.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d8ff7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d40b5750 0x7f59d415ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48900/0 (socket says 172.21.15.146:48900) 2024-09-17T03:38:12.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d8ff7640 1 -- 172.21.15.146:0/3913207308 learned_addr learned my addr 172.21.15.146:0/3913207308 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:12.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d9ff9640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59d40b5ce0 0x7f59d415f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d97f8640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d40b3b60 0x7f59d41568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d8ff7640 1 -- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59d40b5ce0 msgr2=0x7f59d415f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d8ff7640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59d40b5ce0 0x7f59d415f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d8ff7640 1 -- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d40b3b60 msgr2=0x7f59d41568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d8ff7640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d40b3b60 0x7f59d41568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d8ff7640 1 -- 172.21.15.146:0/3913207308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d4154ba0 con 0x7f59d40b5750 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d97f8640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d40b3b60 0x7f59d41568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59d8ff7640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d40b5750 0x7f59d415ec70 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f59c4034040 tx=0x7f59c4003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59c9ffb640 1 -- 172.21.15.146:0/3913207308 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c403e030 con 0x7f59d40b5750 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59c9ffb640 1 -- 172.21.15.146:0/3913207308 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59c4003c20 con 0x7f59d40b5750 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59dba5c640 1 -- 172.21.15.146:0/3913207308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d41527f0 con 0x7f59d40b5750 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.725+0000 7f59c9ffb640 1 -- 172.21.15.146:0/3913207308 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4035040 con 0x7f59d40b5750 2024-09-17T03:38:12.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.726+0000 7f59dba5c640 1 -- 172.21.15.146:0/3913207308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d4140b40 con 0x7f59d40b5750 2024-09-17T03:38:12.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.726+0000 7f59dba5c640 1 -- 172.21.15.146:0/3913207308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d40b3620 con 0x7f59d40b5750 2024-09-17T03:38:12.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.727+0000 7f59c9ffb640 1 -- 172.21.15.146:0/3913207308 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59c4041030 con 0x7f59d40b5750 2024-09-17T03:38:12.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.728+0000 7f59c9ffb640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59b8078b90 0x7f59b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:12.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.728+0000 7f59c9ffb640 1 -- 172.21.15.146:0/3913207308 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5029+0+0 (secure 0 0 0) 0x7f59c40bb480 con 0x7f59d40b5750 2024-09-17T03:38:12.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.728+0000 7f59d97f8640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59b8078b90 0x7f59b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:12.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.728+0000 7f59d97f8640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59b8078b90 0x7f59b807b0a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f59d000bbc0 tx=0x7f59d0005ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:12.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.732+0000 7f59c9ffb640 1 -- 172.21.15.146:0/3913207308 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f59c4083b60 con 0x7f59d40b5750 2024-09-17T03:38:12.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.908+0000 7f59dba5c640 1 -- 172.21.15.146:0/3913207308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f59d415bf50 con 0x7f59d40b5750 2024-09-17T03:38:12.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.912+0000 7f59c9ffb640 1 -- 172.21.15.146:0/3913207308 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v49) ==== 71+0+0 (secure 0 0 0) 0x7f59c4083460 con 0x7f59d40b5750 2024-09-17T03:38:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.914+0000 7f59dba5c640 1 -- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59b8078b90 msgr2=0x7f59b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.914+0000 7f59dba5c640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59b8078b90 0x7f59b807b0a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f59d000bbc0 tx=0x7f59d0005ef0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.914+0000 7f59dba5c640 1 -- 172.21.15.146:0/3913207308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d40b5750 msgr2=0x7f59d415ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.914+0000 7f59dba5c640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d40b5750 0x7f59d415ec70 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f59c4034040 tx=0x7f59c4003820 comp rx=0 tx=0).stop 2024-09-17T03:38:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.914+0000 7f59dba5c640 1 -- 172.21.15.146:0/3913207308 shutdown_connections 2024-09-17T03:38:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.914+0000 7f59dba5c640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59b8078b90 0x7f59b807b0a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.914+0000 7f59dba5c640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59d40b5ce0 0x7f59d415f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.914+0000 7f59dba5c640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59d40b5750 0x7f59d415ec70 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.914+0000 7f59dba5c640 1 --2- 172.21.15.146:0/3913207308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59d40b3b60 0x7f59d41568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:12.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.914+0000 7f59dba5c640 1 -- 172.21.15.146:0/3913207308 >> 172.21.15.146:0/3913207308 conn(0x7f59d40b7b20 msgr2=0x7f59d415b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:12.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.915+0000 7f59dba5c640 1 -- 172.21.15.146:0/3913207308 shutdown_connections 2024-09-17T03:38:12.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:12.915+0000 7f59dba5c640 1 -- 172.21.15.146:0/3913207308 wait complete. 2024-09-17T03:38:12.926 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-17T03:38:13.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.044+0000 7fe823615640 1 -- 172.21.15.146:0/3382860154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c0cf370 msgr2=0x7fe81c06ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.044+0000 7fe823615640 1 --2- 172.21.15.146:0/3382860154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c0cf370 0x7fe81c06ed30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe810009830 tx=0x7fe81002a480 comp rx=0 tx=0).stop 2024-09-17T03:38:13.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.044+0000 7fe823615640 1 -- 172.21.15.146:0/3382860154 shutdown_connections 2024-09-17T03:38:13.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.044+0000 7fe823615640 1 --2- 172.21.15.146:0/3382860154 >> v2:172.21.15.179:3300/0 conn(0x7fe81c06f270 0x7fe81c0d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.044+0000 7fe823615640 1 --2- 172.21.15.146:0/3382860154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c0cf370 0x7fe81c06ed30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.044+0000 7fe823615640 1 -- 172.21.15.146:0/3382860154 >> 172.21.15.146:0/3382860154 conn(0x7fe81c0d4be0 msgr2=0x7fe81c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:13.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.044+0000 7fe823615640 1 -- 172.21.15.146:0/3382860154 shutdown_connections 2024-09-17T03:38:13.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.044+0000 7fe823615640 1 -- 172.21.15.146:0/3382860154 wait complete. 2024-09-17T03:38:13.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.046+0000 7fe823615640 1 Processor -- start 2024-09-17T03:38:13.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.046+0000 7fe823615640 1 -- start start 2024-09-17T03:38:13.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe823615640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c06f270 0x7fe81c15a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe823615640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c0b3870 0x7fe81c14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe823615640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c0cf370 0x7fe81c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe823615640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe81c0d3ae0 con 0x7fe81c0cf370 2024-09-17T03:38:13.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe823615640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe81c0d3960 con 0x7fe81c06f270 2024-09-17T03:38:13.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe823615640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe81c0d3c60 con 0x7fe81c0b3870 2024-09-17T03:38:13.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe821bb2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c0cf370 0x7fe81c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe821bb2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c0cf370 0x7fe81c15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48902/0 (socket says 172.21.15.146:48902) 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe821bb2640 1 -- 172.21.15.146:0/1200587555 learned_addr learned my addr 172.21.15.146:0/1200587555 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe820bb0640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c0b3870 0x7fe81c14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe8213b1640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c06f270 0x7fe81c15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe821bb2640 1 -- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c0b3870 msgr2=0x7fe81c14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe821bb2640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c0b3870 0x7fe81c14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe821bb2640 1 -- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c06f270 msgr2=0x7fe81c15a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe821bb2640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c06f270 0x7fe81c15a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.047+0000 7fe821bb2640 1 -- 172.21.15.146:0/1200587555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81c0c9200 con 0x7fe81c0cf370 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.048+0000 7fe821bb2640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c0cf370 0x7fe81c15eb10 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fe81400e970 tx=0x7fe81400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.048+0000 7fe819ffb640 1 -- 172.21.15.146:0/1200587555 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81400ccc0 con 0x7fe81c0cf370 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.048+0000 7fe819ffb640 1 -- 172.21.15.146:0/1200587555 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe814004020 con 0x7fe81c0cf370 2024-09-17T03:38:13.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.048+0000 7fe823615640 1 -- 172.21.15.146:0/1200587555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe81c0c94e0 con 0x7fe81c0cf370 2024-09-17T03:38:13.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.048+0000 7fe819ffb640 1 -- 172.21.15.146:0/1200587555 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814004470 con 0x7fe81c0cf370 2024-09-17T03:38:13.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.048+0000 7fe823615640 1 -- 172.21.15.146:0/1200587555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe81c0c9aa0 con 0x7fe81c0cf370 2024-09-17T03:38:13.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.049+0000 7fe823615640 1 -- 172.21.15.146:0/1200587555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe81c0d4090 con 0x7fe81c0cf370 2024-09-17T03:38:13.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.050+0000 7fe819ffb640 1 -- 172.21.15.146:0/1200587555 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8140035f0 con 0x7fe81c0cf370 2024-09-17T03:38:13.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.050+0000 7fe819ffb640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe808078b90 0x7fe80807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.050+0000 7fe819ffb640 1 -- 172.21.15.146:0/1200587555 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5029+0+0 (secure 0 0 0) 0x7fe81409b210 con 0x7fe81c0cf370 2024-09-17T03:38:13.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.051+0000 7fe8213b1640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe808078b90 0x7fe80807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.051+0000 7fe8213b1640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe808078b90 0x7fe80807b0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0b3cb0 tx=0x7fe80c001a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:13.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.055+0000 7fe819ffb640 1 -- 172.21.15.146:0/1200587555 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe81c0d4090 con 0x7fe81c0cf370 2024-09-17T03:38:13.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.297+0000 7fe823615640 1 -- 172.21.15.146:0/1200587555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7fe81c0d44e0 con 0x7fe81c0cf370 2024-09-17T03:38:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.585+0000 7fe819ffb640 1 -- 172.21.15.146:0/1200587555 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v268) ==== 151+0+0 (secure 0 0 0) 0x7fe81c0d44e0 con 0x7fe81c0cf370 2024-09-17T03:38:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 -- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe808078b90 msgr2=0x7fe80807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe808078b90 0x7fe80807b0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0b3cb0 tx=0x7fe80c001a10 comp rx=0 tx=0).stop 2024-09-17T03:38:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 -- 172.21.15.146:0/1200587555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c0cf370 msgr2=0x7fe81c15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c0cf370 0x7fe81c15eb10 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fe81400e970 tx=0x7fe81400ee30 comp rx=0 tx=0).stop 2024-09-17T03:38:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 -- 172.21.15.146:0/1200587555 shutdown_connections 2024-09-17T03:38:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe808078b90 0x7fe80807b0a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe81c0cf370 0x7fe81c15eb10 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81c0b3870 0x7fe81c14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 --2- 172.21.15.146:0/1200587555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81c06f270 0x7fe81c15a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 -- 172.21.15.146:0/1200587555 >> 172.21.15.146:0/1200587555 conn(0x7fe81c0d4be0 msgr2=0x7fe81c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:13.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 -- 172.21.15.146:0/1200587555 shutdown_connections 2024-09-17T03:38:13.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.587+0000 7fe823615640 1 -- 172.21.15.146:0/1200587555 wait complete. 2024-09-17T03:38:13.599 INFO:tasks.cephfs_test_runner:That a directory is split during scrub. ... ok 2024-09-17T03:38:13.600 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-09-17T03:38:13.600 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T03:38:13.600 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:13.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.714+0000 7fc24d084640 1 -- 172.21.15.146:0/2413150061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2480b3b60 msgr2=0x7fc24815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.714+0000 7fc24d084640 1 --2- 172.21.15.146:0/2413150061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2480b3b60 0x7fc24815caa0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fc240005fd0 tx=0x7fc24002aa00 comp rx=0 tx=0).stop 2024-09-17T03:38:13.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.714+0000 7fc24d084640 1 -- 172.21.15.146:0/2413150061 shutdown_connections 2024-09-17T03:38:13.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.714+0000 7fc24d084640 1 --2- 172.21.15.146:0/2413150061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2480b3b60 0x7fc24815caa0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.714+0000 7fc24d084640 1 --2- 172.21.15.146:0/2413150061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2480b5750 0x7fc2480b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.714+0000 7fc24d084640 1 -- 172.21.15.146:0/2413150061 >> 172.21.15.146:0/2413150061 conn(0x7fc2480b7b20 msgr2=0x7fc24809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:13.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.714+0000 7fc24d084640 1 -- 172.21.15.146:0/2413150061 shutdown_connections 2024-09-17T03:38:13.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.714+0000 7fc24d084640 1 -- 172.21.15.146:0/2413150061 wait complete. 2024-09-17T03:38:13.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.716+0000 7fc24d084640 1 Processor -- start 2024-09-17T03:38:13.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.716+0000 7fc24d084640 1 -- start start 2024-09-17T03:38:13.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.717+0000 7fc24d084640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2480b3b60 0x7fc2481529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.717+0000 7fc24d084640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2480b5750 0x7fc2481f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.717+0000 7fc24d084640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2480b5ce0 0x7fc248153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.717+0000 7fc24d084640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc24815d460 con 0x7fc2480b3b60 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.717+0000 7fc24d084640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc24815d2e0 con 0x7fc2480b5ce0 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.717+0000 7fc24d084640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc24815d5e0 con 0x7fc2480b5750 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.717+0000 7fc246d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2480b3b60 0x7fc2481529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.717+0000 7fc246d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2480b3b60 0x7fc2481529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48928/0 (socket says 172.21.15.146:48928) 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.717+0000 7fc246d9d640 1 -- 172.21.15.146:0/552298291 learned_addr learned my addr 172.21.15.146:0/552298291 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.717+0000 7fc24759e640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2480b5ce0 0x7fc248153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.717+0000 7fc23e59c640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2480b5750 0x7fc2481f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.718+0000 7fc246d9d640 1 -- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2480b5750 msgr2=0x7fc2481f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.718+0000 7fc246d9d640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2480b5750 0x7fc2481f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.718+0000 7fc246d9d640 1 -- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2480b5ce0 msgr2=0x7fc248153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.718+0000 7fc246d9d640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2480b5ce0 0x7fc248153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.718+0000 7fc246d9d640 1 -- 172.21.15.146:0/552298291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc248152f10 con 0x7fc2480b3b60 2024-09-17T03:38:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.718+0000 7fc246d9d640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2480b3b60 0x7fc2481529d0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fc23800b420 tx=0x7fc23800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:13.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.718+0000 7fc23ffff640 1 -- 172.21.15.146:0/552298291 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238011830 con 0x7fc2480b3b60 2024-09-17T03:38:13.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.718+0000 7fc23ffff640 1 -- 172.21.15.146:0/552298291 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc238016070 con 0x7fc2480b3b60 2024-09-17T03:38:13.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.718+0000 7fc24d084640 1 -- 172.21.15.146:0/552298291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2481f5cc0 con 0x7fc2480b3b60 2024-09-17T03:38:13.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.718+0000 7fc23ffff640 1 -- 172.21.15.146:0/552298291 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238011d60 con 0x7fc2480b3b60 2024-09-17T03:38:13.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.718+0000 7fc24d084640 1 -- 172.21.15.146:0/552298291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2481f61d0 con 0x7fc2480b3b60 2024-09-17T03:38:13.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.719+0000 7fc24d084640 1 -- 172.21.15.146:0/552298291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc24815caa0 con 0x7fc2480b3b60 2024-09-17T03:38:13.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.720+0000 7fc23ffff640 1 -- 172.21.15.146:0/552298291 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc23801b460 con 0x7fc2480b3b60 2024-09-17T03:38:13.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.720+0000 7fc23ffff640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc228078b90 0x7fc22807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:13.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.720+0000 7fc23ffff640 1 -- 172.21.15.146:0/552298291 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5029+0+0 (secure 0 0 0) 0x7fc23809a4a0 con 0x7fc2480b3b60 2024-09-17T03:38:13.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.720+0000 7fc23e59c640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc228078b90 0x7fc22807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:13.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.721+0000 7fc23e59c640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc228078b90 0x7fc22807b0a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc248159d60 tx=0x7fc230005f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:13.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.725+0000 7fc23ffff640 1 -- 172.21.15.146:0/552298291 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc238020020 con 0x7fc2480b3b60 2024-09-17T03:38:13.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.899+0000 7fc24d084640 1 -- 172.21.15.146:0/552298291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc24815ac60 con 0x7fc2480b3b60 2024-09-17T03:38:13.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.900+0000 7fc23ffff640 1 -- 172.21.15.146:0/552298291 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+13209 (secure 0 0 0) 0x7fc238062530 con 0x7fc2480b3b60 2024-09-17T03:38:13.900 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:13.900 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:38:12.578381+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/2040023606":"2024-09-18T03:38:09.565957+0000","172.21.15.146:6834/2040023606":"2024-09-18T03:38:09.565957+0000","172.21.15.179:6836/9562532":"2024-09-18T03:37:53.137528+0000","172.21.15.179:6834/9562532":"2024-09-18T03:37:53.137528+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:13.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 -- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc228078b90 msgr2=0x7fc22807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc228078b90 0x7fc22807b0a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc248159d60 tx=0x7fc230005f60 comp rx=0 tx=0).stop 2024-09-17T03:38:13.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 -- 172.21.15.146:0/552298291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2480b3b60 msgr2=0x7fc2481529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:13.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2480b3b60 0x7fc2481529d0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fc23800b420 tx=0x7fc23800b8e0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 -- 172.21.15.146:0/552298291 shutdown_connections 2024-09-17T03:38:13.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc228078b90 0x7fc22807b0a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2480b5ce0 0x7fc248153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2480b5750 0x7fc2481f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 --2- 172.21.15.146:0/552298291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2480b3b60 0x7fc2481529d0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:13.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 -- 172.21.15.146:0/552298291 >> 172.21.15.146:0/552298291 conn(0x7fc2480b7b20 msgr2=0x7fc248071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:13.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 -- 172.21.15.146:0/552298291 shutdown_connections 2024-09-17T03:38:13.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:13.902+0000 7fc24d084640 1 -- 172.21.15.146:0/552298291 wait complete. 2024-09-17T03:38:13.914 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:38:13.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:38:14.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.031+0000 7f6e097f1640 1 -- 172.21.15.146:0/3169229307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dec003a00 msgr2=0x7f6dec003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.031+0000 7f6e097f1640 1 --2- 172.21.15.146:0/3169229307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dec003a00 0x7f6dec003e50 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009b50 tx=0x7f6dec005830 comp rx=0 tx=0).stop 2024-09-17T03:38:14.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.031+0000 7f6e097f1640 1 -- 172.21.15.146:0/3169229307 shutdown_connections 2024-09-17T03:38:14.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.031+0000 7f6e097f1640 1 --2- 172.21.15.146:0/3169229307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dec003a00 0x7f6dec003e50 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.031+0000 7f6e097f1640 1 -- 172.21.15.146:0/3169229307 >> 172.21.15.146:0/3169229307 conn(0x7f6e040d4be0 msgr2=0x7f6e040d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.031+0000 7f6e097f1640 1 -- 172.21.15.146:0/3169229307 shutdown_connections 2024-09-17T03:38:14.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.031+0000 7f6e097f1640 1 -- 172.21.15.146:0/3169229307 wait complete. 2024-09-17T03:38:14.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.033+0000 7f6e097f1640 1 Processor -- start 2024-09-17T03:38:14.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.033+0000 7f6e097f1640 1 -- start start 2024-09-17T03:38:14.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.034+0000 7f6e097f1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dec003a00 0x7f6e040cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.034+0000 7f6e097f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e0414d4d0 0x7f6e041612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.034+0000 7f6e097f1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e0414c7e0 0x7f6e0414cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.034+0000 7f6e097f1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6e040cf810 con 0x7f6dec003a00 2024-09-17T03:38:14.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.034+0000 7f6e097f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6e040cf690 con 0x7f6e0414d4d0 2024-09-17T03:38:14.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.034+0000 7f6e097f1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6e0406ed30 con 0x7f6e0414c7e0 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.034+0000 7f6e02ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dec003a00 0x7f6e040cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.034+0000 7f6e02ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dec003a00 0x7f6e040cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48942/0 (socket says 172.21.15.146:48942) 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.034+0000 7f6e02ffd640 1 -- 172.21.15.146:0/2869982240 learned_addr learned my addr 172.21.15.146:0/2869982240 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e027fc640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e0414d4d0 0x7f6e041612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e037fe640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e0414c7e0 0x7f6e0414cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e02ffd640 1 -- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e0414c7e0 msgr2=0x7f6e0414cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e02ffd640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e0414c7e0 0x7f6e0414cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e02ffd640 1 -- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e0414d4d0 msgr2=0x7f6e041612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e02ffd640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e0414d4d0 0x7f6e041612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e02ffd640 1 -- 172.21.15.146:0/2869982240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0414d130 con 0x7f6dec003a00 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e027fc640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e0414d4d0 0x7f6e041612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e037fe640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e0414c7e0 0x7f6e0414cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e02ffd640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dec003a00 0x7f6e040cb8a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009a70 tx=0x7f6df40336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6deb7fe640 1 -- 172.21.15.146:0/2869982240 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4038040 con 0x7f6dec003a00 2024-09-17T03:38:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6deb7fe640 1 -- 172.21.15.146:0/2869982240 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6df4041070 con 0x7f6dec003a00 2024-09-17T03:38:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e097f1640 1 -- 172.21.15.146:0/2869982240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e04161810 con 0x7f6dec003a00 2024-09-17T03:38:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6deb7fe640 1 -- 172.21.15.146:0/2869982240 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df403c430 con 0x7f6dec003a00 2024-09-17T03:38:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.035+0000 7f6e097f1640 1 -- 172.21.15.146:0/2869982240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e040b5d40 con 0x7f6dec003a00 2024-09-17T03:38:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.036+0000 7f6e097f1640 1 -- 172.21.15.146:0/2869982240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e0406f220 con 0x7f6dec003a00 2024-09-17T03:38:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.037+0000 7f6deb7fe640 1 -- 172.21.15.146:0/2869982240 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6df403c5d0 con 0x7f6dec003a00 2024-09-17T03:38:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.037+0000 7f6deb7fe640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6df0078b90 0x7f6df007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.037+0000 7f6deb7fe640 1 -- 172.21.15.146:0/2869982240 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5029+0+0 (secure 0 0 0) 0x7f6df40bb500 con 0x7f6dec003a00 2024-09-17T03:38:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.038+0000 7f6e027fc640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6df0078b90 0x7f6df007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.038+0000 7f6e027fc640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6df0078b90 0x7f6df007b0a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6e0415eda0 tx=0x7f6df8006aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.042+0000 7f6deb7fe640 1 -- 172.21.15.146:0/2869982240 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e0414d130 con 0x7f6dec003a00 2024-09-17T03:38:14.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.214+0000 7f6e097f1640 1 -- 172.21.15.146:0/2869982240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6e040b7120 con 0x7f6dec003a00 2024-09-17T03:38:14.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.214+0000 7f6deb7fe640 1 -- 172.21.15.146:0/2869982240 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f6df4083c70 con 0x7f6dec003a00 2024-09-17T03:38:14.215 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:38:14.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 -- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6df0078b90 msgr2=0x7f6df007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6df0078b90 0x7f6df007b0a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6e0415eda0 tx=0x7f6df8006aa0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 -- 172.21.15.146:0/2869982240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dec003a00 msgr2=0x7f6e040cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dec003a00 0x7f6e040cb8a0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009a70 tx=0x7f6df40336f0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 -- 172.21.15.146:0/2869982240 shutdown_connections 2024-09-17T03:38:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6df0078b90 0x7f6df007b0a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e0414c7e0 0x7f6e0414cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e0414d4d0 0x7f6e041612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 --2- 172.21.15.146:0/2869982240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dec003a00 0x7f6e040cb8a0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 -- 172.21.15.146:0/2869982240 >> 172.21.15.146:0/2869982240 conn(0x7f6e040d4be0 msgr2=0x7f6e041e8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 -- 172.21.15.146:0/2869982240 shutdown_connections 2024-09-17T03:38:14.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.216+0000 7f6e097f1640 1 -- 172.21.15.146:0/2869982240 wait complete. 2024-09-17T03:38:14.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-17T03:38:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.342+0000 7f2d0d12b640 1 -- 172.21.15.146:0/3457462892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d080b5ce0 msgr2=0x7f2d080b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.342+0000 7f2d0d12b640 1 --2- 172.21.15.146:0/3457462892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d080b5ce0 0x7f2d080b1320 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2d080b8440 tx=0x7f2cf802a530 comp rx=0 tx=0).stop 2024-09-17T03:38:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.342+0000 7f2d0d12b640 1 -- 172.21.15.146:0/3457462892 shutdown_connections 2024-09-17T03:38:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.342+0000 7f2d0d12b640 1 --2- 172.21.15.146:0/3457462892 >> v2:172.21.15.179:3300/0 conn(0x7f2d080b5750 0x7f2d080b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.342+0000 7f2d0d12b640 1 --2- 172.21.15.146:0/3457462892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d080b5ce0 0x7f2d080b1320 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.342+0000 7f2d0d12b640 1 -- 172.21.15.146:0/3457462892 >> 172.21.15.146:0/3457462892 conn(0x7f2d080b7b20 msgr2=0x7f2d0809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:14.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.342+0000 7f2d0d12b640 1 -- 172.21.15.146:0/3457462892 shutdown_connections 2024-09-17T03:38:14.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.342+0000 7f2d0d12b640 1 -- 172.21.15.146:0/3457462892 wait complete. 2024-09-17T03:38:14.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.344+0000 7f2d0d12b640 1 Processor -- start 2024-09-17T03:38:14.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.344+0000 7f2d0d12b640 1 -- start start 2024-09-17T03:38:14.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.345+0000 7f2d0d12b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d080b3b60 0x7f2d081f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.345+0000 7f2d0d12b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d080b5750 0x7f2d08152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.345+0000 7f2d0d12b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d080b5ce0 0x7f2d081f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.345+0000 7f2d0d12b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2d080b27b0 con 0x7f2d080b5750 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.345+0000 7f2d0d12b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0815dcc0 con 0x7f2d080b5ce0 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.345+0000 7f2d0d12b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2d080b2930 con 0x7f2d080b3b60 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.345+0000 7f2cfe59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d080b5750 0x7f2d08152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.345+0000 7f2cfe59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d080b5750 0x7f2d08152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48972/0 (socket says 172.21.15.146:48972) 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.345+0000 7f2cfe59c640 1 -- 172.21.15.146:0/4146744010 learned_addr learned my addr 172.21.15.146:0/4146744010 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.345+0000 7f2d06d9d640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d080b3b60 0x7f2d081f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.345+0000 7f2d0759e640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d080b5ce0 0x7f2d081f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.346+0000 7f2cfe59c640 1 -- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d080b3b60 msgr2=0x7f2d081f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.346+0000 7f2cfe59c640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d080b3b60 0x7f2d081f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.346+0000 7f2cfe59c640 1 -- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d080b5ce0 msgr2=0x7f2d081f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.346+0000 7f2cfe59c640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d080b5ce0 0x7f2d081f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.346+0000 7f2cfe59c640 1 -- 172.21.15.146:0/4146744010 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d081533c0 con 0x7f2d080b5750 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.346+0000 7f2cfe59c640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d080b5750 0x7f2d08152650 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000e7c0 tx=0x7f2cf000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.346+0000 7f2cfffff640 1 -- 172.21.15.146:0/4146744010 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000cc60 con 0x7f2d080b5750 2024-09-17T03:38:14.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.346+0000 7f2cfffff640 1 -- 172.21.15.146:0/4146744010 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cf000ce00 con 0x7f2d080b5750 2024-09-17T03:38:14.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.346+0000 7f2d0d12b640 1 -- 172.21.15.146:0/4146744010 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d081536a0 con 0x7f2d080b5750 2024-09-17T03:38:14.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.346+0000 7f2cfffff640 1 -- 172.21.15.146:0/4146744010 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0004280 con 0x7f2d080b5750 2024-09-17T03:38:14.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.346+0000 7f2d0d12b640 1 -- 172.21.15.146:0/4146744010 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d08153c60 con 0x7f2d080b5750 2024-09-17T03:38:14.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.347+0000 7f2d0d12b640 1 -- 172.21.15.146:0/4146744010 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d080b2e20 con 0x7f2d080b5750 2024-09-17T03:38:14.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.348+0000 7f2cfffff640 1 -- 172.21.15.146:0/4146744010 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2cf00035f0 con 0x7f2d080b5750 2024-09-17T03:38:14.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.348+0000 7f2cfffff640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ce8078bc0 0x7f2ce807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:14.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.348+0000 7f2cfffff640 1 -- 172.21.15.146:0/4146744010 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5029+0+0 (secure 0 0 0) 0x7f2cf009b330 con 0x7f2d080b5750 2024-09-17T03:38:14.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.348+0000 7f2d06d9d640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ce8078bc0 0x7f2ce807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:14.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.349+0000 7f2d06d9d640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ce8078bc0 0x7f2ce807b0d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8034000 tx=0x7f2cf8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:14.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.353+0000 7f2cfffff640 1 -- 172.21.15.146:0/4146744010 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2cf0063450 con 0x7f2d080b5750 2024-09-17T03:38:14.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:14.595+0000 7f2d0d12b640 1 -- 172.21.15.146:0/4146744010 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f2d0815ae60 con 0x7f2d080b5750 2024-09-17T03:38:15.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.591+0000 7f2cfffff640 1 -- 172.21.15.146:0/4146744010 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v270) ==== 161+0+0 (secure 0 0 0) 0x7f2cf0067e80 con 0x7f2d080b5750 2024-09-17T03:38:15.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 -- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ce8078bc0 msgr2=0x7f2ce807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ce8078bc0 0x7f2ce807b0d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8034000 tx=0x7f2cf8004730 comp rx=0 tx=0).stop 2024-09-17T03:38:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 -- 172.21.15.146:0/4146744010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d080b5750 msgr2=0x7f2d08152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d080b5750 0x7f2d08152650 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000e7c0 tx=0x7f2cf000ec80 comp rx=0 tx=0).stop 2024-09-17T03:38:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 -- 172.21.15.146:0/4146744010 shutdown_connections 2024-09-17T03:38:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ce8078bc0 0x7f2ce807b0d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2d080b5ce0 0x7f2d081f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d080b5750 0x7f2d08152650 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 --2- 172.21.15.146:0/4146744010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2d080b3b60 0x7f2d081f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 -- 172.21.15.146:0/4146744010 >> 172.21.15.146:0/4146744010 conn(0x7f2d080b7b20 msgr2=0x7f2d08075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 -- 172.21.15.146:0/4146744010 shutdown_connections 2024-09-17T03:38:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.594+0000 7f2d0d12b640 1 -- 172.21.15.146:0/4146744010 wait complete. 2024-09-17T03:38:15.608 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:38:15.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.726+0000 7f21b3c70640 1 -- 172.21.15.146:0/1583153642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac0b3b60 msgr2=0x7f21ac0b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.726+0000 7f21b3c70640 1 --2- 172.21.15.146:0/1583153642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac0b3b60 0x7f21ac0b20a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f21ac075630 tx=0x7f21a402aa30 comp rx=0 tx=0).stop 2024-09-17T03:38:15.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.726+0000 7f21b3c70640 1 -- 172.21.15.146:0/1583153642 shutdown_connections 2024-09-17T03:38:15.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.726+0000 7f21b3c70640 1 --2- 172.21.15.146:0/1583153642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac0b3b60 0x7f21ac0b20a0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.726+0000 7f21b3c70640 1 --2- 172.21.15.146:0/1583153642 >> v2:172.21.15.179:3300/0 conn(0x7f21ac0b5750 0x7f21ac0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.726+0000 7f21b3c70640 1 --2- 172.21.15.146:0/1583153642 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21ac0b5ce0 0x7f21ac0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.726+0000 7f21b3c70640 1 -- 172.21.15.146:0/1583153642 >> 172.21.15.146:0/1583153642 conn(0x7f21ac0b7b20 msgr2=0x7f21ac09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:15.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.726+0000 7f21b3c70640 1 -- 172.21.15.146:0/1583153642 shutdown_connections 2024-09-17T03:38:15.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.726+0000 7f21b3c70640 1 -- 172.21.15.146:0/1583153642 wait complete. 2024-09-17T03:38:15.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.728+0000 7f21b3c70640 1 Processor -- start 2024-09-17T03:38:15.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.728+0000 7f21b3c70640 1 -- start start 2024-09-17T03:38:15.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.729+0000 7f21b3c70640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21ac0b3b60 0x7f21ac0c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:15.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.729+0000 7f21b3c70640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21ac0b5750 0x7f21ac09ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:15.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.729+0000 7f21b3c70640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac0b5ce0 0x7f21ac14e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:15.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.729+0000 7f21b3c70640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac0b2970 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.729+0000 7f21b3c70640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac0b27f0 con 0x7f21ac0b3b60 2024-09-17T03:38:15.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.729+0000 7f21b3c70640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f21ac0b2af0 con 0x7f21ac0b5750 2024-09-17T03:38:15.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.729+0000 7f21b220d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac0b5ce0 0x7f21ac14e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:15.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.729+0000 7f21b220d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac0b5ce0 0x7f21ac14e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48984/0 (socket says 172.21.15.146:48984) 2024-09-17T03:38:15.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.729+0000 7f21b220d640 1 -- 172.21.15.146:0/2558935220 learned_addr learned my addr 172.21.15.146:0/2558935220 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:15.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.729+0000 7f21b1a0c640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21ac0b3b60 0x7f21ac0c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.729+0000 7f21b120b640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21ac0b5750 0x7f21ac09ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.730+0000 7f21b220d640 1 -- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21ac0b5750 msgr2=0x7f21ac09ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.730+0000 7f21b220d640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21ac0b5750 0x7f21ac09ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.730+0000 7f21b220d640 1 -- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21ac0b3b60 msgr2=0x7f21ac0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.730+0000 7f21b220d640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21ac0b3b60 0x7f21ac0c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.730+0000 7f21b220d640 1 -- 172.21.15.146:0/2558935220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac09f1b0 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.730+0000 7f21b220d640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac0b5ce0 0x7f21ac14e1e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009d60 tx=0x7f21a4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.730+0000 7f21a27fc640 1 -- 172.21.15.146:0/2558935220 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4033050 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.730+0000 7f21a27fc640 1 -- 172.21.15.146:0/2558935220 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21a4004550 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.730+0000 7f21b3c70640 1 -- 172.21.15.146:0/2558935220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ac14e720 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.730+0000 7f21a27fc640 1 -- 172.21.15.146:0/2558935220 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a4038450 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.730+0000 7f21b3c70640 1 -- 172.21.15.146:0/2558935220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ac09cc20 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.731+0000 7f21b3c70640 1 -- 172.21.15.146:0/2558935220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21ac0b3620 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.732+0000 7f21a27fc640 1 -- 172.21.15.146:0/2558935220 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21a4036070 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.733+0000 7f21a27fc640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2190078b90 0x7f219007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:15.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.733+0000 7f21a27fc640 1 -- 172.21.15.146:0/2558935220 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5029+0+0 (secure 0 0 0) 0x7f21a40bc160 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.733+0000 7f21b1a0c640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2190078b90 0x7f219007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:15.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.733+0000 7f21b1a0c640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2190078b90 0x7f219007b0a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f21a80058c0 tx=0x7f21a8005f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:15.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.736+0000 7f21a27fc640 1 -- 172.21.15.146:0/2558935220 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f21a4084360 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.911+0000 7f21b3c70640 1 -- 172.21.15.146:0/2558935220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f21ac157950 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.912+0000 7f21a27fc640 1 -- 172.21.15.146:0/2558935220 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v49) ==== 59+0+2294 (secure 0 0 0) 0x7f21a4088d90 con 0x7f21ac0b5ce0 2024-09-17T03:38:15.912 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:38:15.912 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:38:15.912 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:38:15.912 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:38:15.912 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:38:15.912 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:38:15.913 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:38:15.914 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:38:15.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 -- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2190078b90 msgr2=0x7f219007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2190078b90 0x7f219007b0a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f21a80058c0 tx=0x7f21a8005f60 comp rx=0 tx=0).stop 2024-09-17T03:38:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 -- 172.21.15.146:0/2558935220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac0b5ce0 msgr2=0x7f21ac14e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac0b5ce0 0x7f21ac14e1e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009d60 tx=0x7f21a4003f10 comp rx=0 tx=0).stop 2024-09-17T03:38:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 -- 172.21.15.146:0/2558935220 shutdown_connections 2024-09-17T03:38:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2190078b90 0x7f219007b0a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21ac0b5ce0 0x7f21ac14e1e0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f21ac0b5750 0x7f21ac09ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 --2- 172.21.15.146:0/2558935220 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f21ac0b3b60 0x7f21ac0c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 -- 172.21.15.146:0/2558935220 >> 172.21.15.146:0/2558935220 conn(0x7f21ac0b7b20 msgr2=0x7f21ac0712e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:15.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 -- 172.21.15.146:0/2558935220 shutdown_connections 2024-09-17T03:38:15.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:15.914+0000 7f21b3c70640 1 -- 172.21.15.146:0/2558935220 wait complete. 2024-09-17T03:38:15.926 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:38:16.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.041+0000 7f4b80a07640 1 -- 172.21.15.146:0/1131181505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c0cf370 msgr2=0x7f4b7c06ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.041+0000 7f4b80a07640 1 --2- 172.21.15.146:0/1131181505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c0cf370 0x7f4b7c06ed30 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f4b64005fd0 tx=0x7f4b6402a540 comp rx=0 tx=0).stop 2024-09-17T03:38:16.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.041+0000 7f4b80a07640 1 -- 172.21.15.146:0/1131181505 shutdown_connections 2024-09-17T03:38:16.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.041+0000 7f4b80a07640 1 --2- 172.21.15.146:0/1131181505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b7c06f270 0x7f4b7c0d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.041+0000 7f4b80a07640 1 --2- 172.21.15.146:0/1131181505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c0cf370 0x7f4b7c06ed30 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.041+0000 7f4b80a07640 1 -- 172.21.15.146:0/1131181505 >> 172.21.15.146:0/1131181505 conn(0x7f4b7c0d4be0 msgr2=0x7f4b7c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:16.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.041+0000 7f4b80a07640 1 -- 172.21.15.146:0/1131181505 shutdown_connections 2024-09-17T03:38:16.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.041+0000 7f4b80a07640 1 -- 172.21.15.146:0/1131181505 wait complete. 2024-09-17T03:38:16.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.043+0000 7f4b80a07640 1 Processor -- start 2024-09-17T03:38:16.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.043+0000 7f4b80a07640 1 -- start start 2024-09-17T03:38:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b80a07640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b7c06f270 0x7f4b7c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b80a07640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b7c0b3870 0x7f4b7c0c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b80a07640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c0cf370 0x7f4b7c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b80a07640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c0d3ae0 con 0x7f4b7c0cf370 2024-09-17T03:38:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b80a07640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c0d3960 con 0x7f4b7c06f270 2024-09-17T03:38:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b80a07640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c0d3c60 con 0x7f4b7c0b3870 2024-09-17T03:38:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b7ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c0cf370 0x7f4b7c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b7ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c0cf370 0x7f4b7c0cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48996/0 (socket says 172.21.15.146:48996) 2024-09-17T03:38:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b7ad9d640 1 -- 172.21.15.146:0/4226490659 learned_addr learned my addr 172.21.15.146:0/4226490659 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b7a59c640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b7c06f270 0x7f4b7c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b71d9b640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b7c0b3870 0x7f4b7c0c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b7ad9d640 1 -- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b7c0b3870 msgr2=0x7f4b7c0c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b7ad9d640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b7c0b3870 0x7f4b7c0c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b7ad9d640 1 -- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b7c06f270 msgr2=0x7f4b7c14ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b7ad9d640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b7c06f270 0x7f4b7c14ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b7ad9d640 1 -- 172.21.15.146:0/4226490659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c15b510 con 0x7f4b7c0cf370 2024-09-17T03:38:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b7ad9d640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c0cf370 0x7f4b7c0cd840 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400e960 tx=0x7f4b7400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b737fe640 1 -- 172.21.15.146:0/4226490659 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b74004d20 con 0x7f4b7c0cf370 2024-09-17T03:38:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b737fe640 1 -- 172.21.15.146:0/4226490659 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b7400cac0 con 0x7f4b7c0cf370 2024-09-17T03:38:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b80a07640 1 -- 172.21.15.146:0/4226490659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b7c14f170 con 0x7f4b7c0cf370 2024-09-17T03:38:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b737fe640 1 -- 172.21.15.146:0/4226490659 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b74005020 con 0x7f4b7c0cf370 2024-09-17T03:38:16.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.045+0000 7f4b80a07640 1 -- 172.21.15.146:0/4226490659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b7c0c8f20 con 0x7f4b7c0cf370 2024-09-17T03:38:16.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.046+0000 7f4b80a07640 1 -- 172.21.15.146:0/4226490659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b7c0d3190 con 0x7f4b7c0cf370 2024-09-17T03:38:16.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.047+0000 7f4b737fe640 1 -- 172.21.15.146:0/4226490659 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4b740051c0 con 0x7f4b7c0cf370 2024-09-17T03:38:16.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.048+0000 7f4b737fe640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b5c078bc0 0x7f4b5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.048+0000 7f4b7a59c640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b5c078bc0 0x7f4b5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.048+0000 7f4b737fe640 1 -- 172.21.15.146:0/4226490659 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5029+0+0 (secure 0 0 0) 0x7f4b7409b310 con 0x7f4b7c0cf370 2024-09-17T03:38:16.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.049+0000 7f4b7a59c640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b5c078bc0 0x7f4b5c07b0d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c000f60 tx=0x7f4b6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:16.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.053+0000 7f4b737fe640 1 -- 172.21.15.146:0/4226490659 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4b7c14f170 con 0x7f4b7c0cf370 2024-09-17T03:38:16.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.232+0000 7f4b80a07640 1 -- 172.21.15.146:0/4226490659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f4b7c0d2bd0 con 0x7f4b7c0cf370 2024-09-17T03:38:16.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.235+0000 7f4b737fe640 1 -- 172.21.15.146:0/4226490659 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v50)=0 v50) ==== 122+0+0 (secure 0 0 0) 0x7f4b7c15b510 con 0x7f4b7c0cf370 2024-09-17T03:38:16.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 -- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b5c078bc0 msgr2=0x7f4b5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b5c078bc0 0x7f4b5c07b0d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c000f60 tx=0x7f4b6c009040 comp rx=0 tx=0).stop 2024-09-17T03:38:16.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 -- 172.21.15.146:0/4226490659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c0cf370 msgr2=0x7f4b7c0cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c0cf370 0x7f4b7c0cd840 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400e960 tx=0x7f4b7400ee20 comp rx=0 tx=0).stop 2024-09-17T03:38:16.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 -- 172.21.15.146:0/4226490659 shutdown_connections 2024-09-17T03:38:16.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b5c078bc0 0x7f4b5c07b0d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b7c0cf370 0x7f4b7c0cd840 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b7c0b3870 0x7f4b7c0c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 --2- 172.21.15.146:0/4226490659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b7c06f270 0x7f4b7c14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 -- 172.21.15.146:0/4226490659 >> 172.21.15.146:0/4226490659 conn(0x7f4b7c0d4be0 msgr2=0x7f4b7c1620f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:16.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 -- 172.21.15.146:0/4226490659 shutdown_connections 2024-09-17T03:38:16.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.238+0000 7f4b80a07640 1 -- 172.21.15.146:0/4226490659 wait complete. 2024-09-17T03:38:16.250 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:38:16.250 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:38:16.288 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:38:16.343 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:38:16.343 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:38:16.344 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:16.359 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:38:16.360 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:38:16.360 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:16.379 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:38:16.379 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:38:16.379 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:16.415 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:38:16.415 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:38:16.415 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:16.436 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:38:16.436 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:38:16.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:16.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.568+0000 7fa43568c640 1 -- 172.21.15.146:0/3435913355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4300b3870 msgr2=0x7fa4300cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.568+0000 7fa43568c640 1 --2- 172.21.15.146:0/3435913355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4300b3870 0x7fa4300cf370 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fa4300b3d00 tx=0x7fa42002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.568+0000 7fa43568c640 1 -- 172.21.15.146:0/3435913355 shutdown_connections 2024-09-17T03:38:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.568+0000 7fa43568c640 1 --2- 172.21.15.146:0/3435913355 >> v2:172.21.15.179:3300/0 conn(0x7fa4301620f0 0x7fa43006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.568+0000 7fa43568c640 1 --2- 172.21.15.146:0/3435913355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4300b3870 0x7fa4300cf370 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.568+0000 7fa43568c640 1 -- 172.21.15.146:0/3435913355 >> 172.21.15.146:0/3435913355 conn(0x7fa4300d4be0 msgr2=0x7fa4300d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.568+0000 7fa43568c640 1 -- 172.21.15.146:0/3435913355 shutdown_connections 2024-09-17T03:38:16.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.568+0000 7fa43568c640 1 -- 172.21.15.146:0/3435913355 wait complete. 2024-09-17T03:38:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.570+0000 7fa43568c640 1 Processor -- start 2024-09-17T03:38:16.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.570+0000 7fa43568c640 1 -- start start 2024-09-17T03:38:16.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.571+0000 7fa43568c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa43006f270 0x7fa4301f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.571+0000 7fa43568c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4300b3870 0x7fa4301f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.571+0000 7fa43568c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4301620f0 0x7fa4301f9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.571+0000 7fa43568c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa430162640 con 0x7fa4300b3870 2024-09-17T03:38:16.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.571+0000 7fa43568c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300d43b0 con 0x7fa43006f270 2024-09-17T03:38:16.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa43568c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa430162fb0 con 0x7fa4301620f0 2024-09-17T03:38:16.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa4267fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4300b3870 0x7fa4301f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa4267fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4300b3870 0x7fa4301f99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49022/0 (socket says 172.21.15.146:49022) 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa4267fc640 1 -- 172.21.15.146:0/2421893266 learned_addr learned my addr 172.21.15.146:0/2421893266 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa42effd640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa43006f270 0x7fa4301f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa42f7fe640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4301620f0 0x7fa4301f9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa4267fc640 1 -- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4301620f0 msgr2=0x7fa4301f9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa4267fc640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4301620f0 0x7fa4301f9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa4267fc640 1 -- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa43006f270 msgr2=0x7fa4301f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa4267fc640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa43006f270 0x7fa4301f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa4267fc640 1 -- 172.21.15.146:0/2421893266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4300cb0c0 con 0x7fa4300b3870 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa42effd640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa43006f270 0x7fa4301f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa4267fc640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4300b3870 0x7fa4301f99b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fa41800b410 tx=0x7fa41800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa427fff640 1 -- 172.21.15.146:0/2421893266 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418015020 con 0x7fa4300b3870 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa427fff640 1 -- 172.21.15.146:0/2421893266 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa418011940 con 0x7fa4300b3870 2024-09-17T03:38:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa43568c640 1 -- 172.21.15.146:0/2421893266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4300cb3a0 con 0x7fa4300b3870 2024-09-17T03:38:16.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa427fff640 1 -- 172.21.15.146:0/2421893266 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418011d90 con 0x7fa4300b3870 2024-09-17T03:38:16.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.572+0000 7fa43568c640 1 -- 172.21.15.146:0/2421893266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4300c8360 con 0x7fa4300b3870 2024-09-17T03:38:16.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.573+0000 7fa43568c640 1 -- 172.21.15.146:0/2421893266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4301634e0 con 0x7fa4300b3870 2024-09-17T03:38:16.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.574+0000 7fa427fff640 1 -- 172.21.15.146:0/2421893266 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa418018020 con 0x7fa4300b3870 2024-09-17T03:38:16.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.575+0000 7fa427fff640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa410078b90 0x7fa41007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:16.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.575+0000 7fa427fff640 1 -- 172.21.15.146:0/2421893266 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5029+0+0 (secure 0 0 0) 0x7fa41809aa40 con 0x7fa4300b3870 2024-09-17T03:38:16.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.575+0000 7fa42effd640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa410078b90 0x7fa41007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:16.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.575+0000 7fa42effd640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa410078b90 0x7fa41007b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa420033000 tx=0x7fa420004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:16.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.579+0000 7fa427fff640 1 -- 172.21.15.146:0/2421893266 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa41809ce20 con 0x7fa4300b3870 2024-09-17T03:38:16.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.788+0000 7fa43568c640 1 -- 172.21.15.146:0/2421893266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4300cae10 con 0x7fa4300b3870 2024-09-17T03:38:16.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.789+0000 7fa427fff640 1 -- 172.21.15.146:0/2421893266 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+3923 (secure 0 0 0) 0x7fa41801f020 con 0x7fa4300b3870 2024-09-17T03:38:16.789 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:16.789 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":71,"btime":"2024-09-17T03:38:10:568033+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6835,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2734448758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2734448758},{"type":"v1","addr":"172.21.15.179:6837","nonce":2734448758}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7497,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1302041078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1302041078},{"type":"v1","addr":"172.21.15.146:6833","nonce":1302041078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7506,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/3947229505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3947229505},{"type":"v1","addr":"172.21.15.179:6835","nonce":3947229505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7683,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1870216448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1870216448},{"type":"v1","addr":"172.21.15.146:6835","nonce":1870216448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[]} 2024-09-17T03:38:16.789 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 71 2024-09-17T03:38:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 -- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa410078b90 msgr2=0x7fa41007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa410078b90 0x7fa41007b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa420033000 tx=0x7fa420004730 comp rx=0 tx=0).stop 2024-09-17T03:38:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 -- 172.21.15.146:0/2421893266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4300b3870 msgr2=0x7fa4301f99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4300b3870 0x7fa4301f99b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fa41800b410 tx=0x7fa41800b8d0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 -- 172.21.15.146:0/2421893266 shutdown_connections 2024-09-17T03:38:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa410078b90 0x7fa41007b0a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4301620f0 0x7fa4301f9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4300b3870 0x7fa4301f99b0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 --2- 172.21.15.146:0/2421893266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa43006f270 0x7fa4301f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 -- 172.21.15.146:0/2421893266 >> 172.21.15.146:0/2421893266 conn(0x7fa4300d4be0 msgr2=0x7fa430161210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 -- 172.21.15.146:0/2421893266 shutdown_connections 2024-09-17T03:38:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:16.791+0000 7fa43568c640 1 -- 172.21.15.146:0/2421893266 wait complete. 2024-09-17T03:38:16.803 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:38:16.803 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:38:16.803 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:38:16.803 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:38:16.803 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:38:16.804 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:38:16.804 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:38:16.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:38:16.804 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:38:16.804 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:38:16.804 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:38:16.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:38:16.805 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:38:16.805 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:38:16.805 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:38:16.805 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:38:16.814 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:38:16.815 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:38:16.817 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:38:16.817 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:38:16.819 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:38:16.819 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:38:16.860 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:38:16.860 DEBUG:teuthology.parallel:result is None 2024-09-17T03:38:16.861 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:38:16.861 DEBUG:teuthology.parallel:result is None 2024-09-17T03:38:16.862 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:38:16.862 DEBUG:teuthology.parallel:result is None 2024-09-17T03:38:16.945 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:38:16.945 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:38:16.949 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:38:18.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-17T03:38:22.818 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:38:22.818 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:38:22.821 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:38:22.821 DEBUG:teuthology.parallel:result is None 2024-09-17T03:38:22.821 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:38:22.918 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:38:22.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.953+0000 7f4d04794640 1 -- 172.21.15.146:0/1796652965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc0b3d30 msgr2=0x7f4cfc1677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:22.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.953+0000 7f4d04794640 1 --2- 172.21.15.146:0/1796652965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc0b3d30 0x7f4cfc1677c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4005fd0 tx=0x7f4cf402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:38:22.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.953+0000 7f4d04794640 1 -- 172.21.15.146:0/1796652965 shutdown_connections 2024-09-17T03:38:22.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.953+0000 7f4d04794640 1 --2- 172.21.15.146:0/1796652965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc0b3d30 0x7f4cfc1677c0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:22.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.953+0000 7f4d04794640 1 -- 172.21.15.146:0/1796652965 >> 172.21.15.146:0/1796652965 conn(0x7f4cfc0b7b20 msgr2=0x7f4cfc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:22.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.953+0000 7f4d04794640 1 -- 172.21.15.146:0/1796652965 shutdown_connections 2024-09-17T03:38:22.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.953+0000 7f4d04794640 1 -- 172.21.15.146:0/1796652965 wait complete. 2024-09-17T03:38:22.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.955+0000 7f4d04794640 1 Processor -- start 2024-09-17T03:38:22.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.955+0000 7f4d04794640 1 -- start start 2024-09-17T03:38:22.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d04794640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc0b5750 0x7f4cfc14e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:22.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d04794640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cfc0b5ce0 0x7f4cfc153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:22.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d04794640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cfc14f3c0 0x7f4cfc154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:22.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d04794640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc167f10 con 0x7f4cfc0b5750 2024-09-17T03:38:22.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d04794640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc15ddb0 con 0x7f4cfc0b5ce0 2024-09-17T03:38:22.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d04794640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4cfc168090 con 0x7f4cfc14f3c0 2024-09-17T03:38:22.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d02530640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc0b5750 0x7f4cfc14e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:22.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d02530640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc0b5750 0x7f4cfc14e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52420/0 (socket says 172.21.15.146:52420) 2024-09-17T03:38:22.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d02530640 1 -- 172.21.15.146:0/2581811144 learned_addr learned my addr 172.21.15.146:0/2581811144 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:22.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d01d2f640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cfc0b5ce0 0x7f4cfc153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:22.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d02d31640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cfc14f3c0 0x7f4cfc154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d02530640 1 -- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cfc14f3c0 msgr2=0x7f4cfc154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d02530640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cfc14f3c0 0x7f4cfc154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d02530640 1 -- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cfc0b5ce0 msgr2=0x7f4cfc153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d02530640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cfc0b5ce0 0x7f4cfc153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d02530640 1 -- 172.21.15.146:0/2581811144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc06fd20 con 0x7f4cfc0b5750 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.956+0000 7f4d02d31640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cfc14f3c0 0x7f4cfc154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.957+0000 7f4d02530640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc0b5750 0x7f4cfc14e6a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800c3a0 tx=0x7f4cf800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.957+0000 7f4cf2ffd640 1 -- 172.21.15.146:0/2581811144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8017070 con 0x7f4cfc0b5750 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.957+0000 7f4cf2ffd640 1 -- 172.21.15.146:0/2581811144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cf80035f0 con 0x7f4cfc0b5750 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.957+0000 7f4d04794640 1 -- 172.21.15.146:0/2581811144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cfc156d10 con 0x7f4cfc0b5750 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.957+0000 7f4cf2ffd640 1 -- 172.21.15.146:0/2581811144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8003a40 con 0x7f4cfc0b5750 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.957+0000 7f4d04794640 1 -- 172.21.15.146:0/2581811144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cfc1572d0 con 0x7f4cfc0b5750 2024-09-17T03:38:22.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.958+0000 7f4d04794640 1 -- 172.21.15.146:0/2581811144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cfc0b1320 con 0x7f4cfc0b5750 2024-09-17T03:38:22.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.959+0000 7f4cf2ffd640 1 -- 172.21.15.146:0/2581811144 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4cf801a070 con 0x7f4cfc0b5750 2024-09-17T03:38:22.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.959+0000 7f4cf2ffd640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ce0078b90 0x7f4ce007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:22.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.959+0000 7f4cf2ffd640 1 -- 172.21.15.146:0/2581811144 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5029+0+0 (secure 0 0 0) 0x7f4cf8099fe0 con 0x7f4cfc0b5750 2024-09-17T03:38:22.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.959+0000 7f4d01d2f640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ce0078b90 0x7f4ce007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:22.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.960+0000 7f4d01d2f640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ce0078b90 0x7f4ce007b0a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc1f6740 tx=0x7f4cec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:22.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:22.963+0000 7f4cf2ffd640 1 -- 172.21.15.146:0/2581811144 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4cf8021020 con 0x7f4cfc0b5750 2024-09-17T03:38:23.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.148+0000 7f4d04794640 1 -- 172.21.15.146:0/2581811144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4cfc15a5a0 con 0x7f4cfc0b5750 2024-09-17T03:38:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.940+0000 7f4cf2ffd640 1 -- 172.21.15.146:0/2581811144 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v100) ==== 97+0+0 (secure 0 0 0) 0x7f4cf80621e0 con 0x7f4cfc0b5750 2024-09-17T03:38:24.052 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:38:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 -- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ce0078b90 msgr2=0x7f4ce007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ce0078b90 0x7f4ce007b0a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc1f6740 tx=0x7f4cec009040 comp rx=0 tx=0).stop 2024-09-17T03:38:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 -- 172.21.15.146:0/2581811144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc0b5750 msgr2=0x7f4cfc14e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc0b5750 0x7f4cfc14e6a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800c3a0 tx=0x7f4cf800c860 comp rx=0 tx=0).stop 2024-09-17T03:38:24.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 -- 172.21.15.146:0/2581811144 shutdown_connections 2024-09-17T03:38:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ce0078b90 0x7f4ce007b0a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cfc14f3c0 0x7f4cfc154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cfc0b5ce0 0x7f4cfc153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 --2- 172.21.15.146:0/2581811144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cfc0b5750 0x7f4cfc14e6a0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 -- 172.21.15.146:0/2581811144 >> 172.21.15.146:0/2581811144 conn(0x7f4cfc0b7b20 msgr2=0x7f4cfc0b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 -- 172.21.15.146:0/2581811144 shutdown_connections 2024-09-17T03:38:24.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:23.944+0000 7f4d04794640 1 -- 172.21.15.146:0/2581811144 wait complete. 2024-09-17T03:38:24.055 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:38:24.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.178+0000 7fd5e580e640 1 -- 172.21.15.146:0/1068250503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5e00d0710 msgr2=0x7fd5e00cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.178+0000 7fd5e580e640 1 --2- 172.21.15.146:0/1068250503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5e00d0710 0x7fd5e00cf170 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009830 tx=0x7fd5d002a480 comp rx=0 tx=0).stop 2024-09-17T03:38:24.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.179+0000 7fd5e580e640 1 -- 172.21.15.146:0/1068250503 shutdown_connections 2024-09-17T03:38:24.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.179+0000 7fd5e580e640 1 --2- 172.21.15.146:0/1068250503 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5e00b47c0 0x7fd5e0161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.179+0000 7fd5e580e640 1 --2- 172.21.15.146:0/1068250503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5e00d0710 0x7fd5e00cf170 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.179+0000 7fd5e580e640 1 -- 172.21.15.146:0/1068250503 >> 172.21.15.146:0/1068250503 conn(0x7fd5e009ba20 msgr2=0x7fd5e00b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:24.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.179+0000 7fd5e580e640 1 -- 172.21.15.146:0/1068250503 shutdown_connections 2024-09-17T03:38:24.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.179+0000 7fd5e580e640 1 -- 172.21.15.146:0/1068250503 wait complete. 2024-09-17T03:38:24.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.180+0000 7fd5e580e640 1 Processor -- start 2024-09-17T03:38:24.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.180+0000 7fd5e580e640 1 -- start start 2024-09-17T03:38:24.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5e580e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5e00b47c0 0x7fd5e00ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5e580e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5e00cf6b0 0x7fd5e00c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5e580e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5e00d0710 0x7fd5e0156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5e580e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e00b1de0 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5e580e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e0162080 con 0x7fd5e00d0710 2024-09-17T03:38:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5e580e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e00b1f60 con 0x7fd5e00b47c0 2024-09-17T03:38:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5d7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5e00cf6b0 0x7fd5e00c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5d7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5e00cf6b0 0x7fd5e00c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52434/0 (socket says 172.21.15.146:52434) 2024-09-17T03:38:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5d7fff640 1 -- 172.21.15.146:0/4183873872 learned_addr learned my addr 172.21.15.146:0/4183873872 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5d7fff640 1 -- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5e00b47c0 msgr2=0x7fd5e00ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5deffd640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5e00b47c0 0x7fd5e00ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5df7fe640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5e00d0710 0x7fd5e0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5d7fff640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5e00b47c0 0x7fd5e00ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5d7fff640 1 -- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5e00d0710 msgr2=0x7fd5e0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5d7fff640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5e00d0710 0x7fd5e0156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5d7fff640 1 -- 172.21.15.146:0/4183873872 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e00c6680 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5deffd640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5e00b47c0 0x7fd5e00ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5df7fe640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5e00d0710 0x7fd5e0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5d7fff640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5e00cf6b0 0x7fd5e00c8c10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c430 tx=0x7fd5c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5dcff9640 1 -- 172.21.15.146:0/4183873872 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8011790 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.182+0000 7fd5dcff9640 1 -- 172.21.15.146:0/4183873872 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5c8017070 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.183+0000 7fd5e580e640 1 -- 172.21.15.146:0/4183873872 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e00c6960 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.183+0000 7fd5dcff9640 1 -- 172.21.15.146:0/4183873872 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8011ca0 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.183+0000 7fd5e580e640 1 -- 172.21.15.146:0/4183873872 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e00c6f20 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.183+0000 7fd5e580e640 1 -- 172.21.15.146:0/4183873872 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e00cf170 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.184+0000 7fd5dcff9640 1 -- 172.21.15.146:0/4183873872 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd5c801c460 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.185+0000 7fd5dcff9640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd5c0078b90 0x7fd5c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.185+0000 7fd5dcff9640 1 -- 172.21.15.146:0/4183873872 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7fd5c809a7c0 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.185+0000 7fd5deffd640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd5c0078b90 0x7fd5c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.186+0000 7fd5deffd640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd5c0078b90 0x7fd5c007b0a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0034000 tx=0x7fd5d0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:24.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.189+0000 7fd5dcff9640 1 -- 172.21.15.146:0/4183873872 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd5c8062fe0 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.431+0000 7fd5e580e640 1 -- 172.21.15.146:0/4183873872 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd5e00ced70 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.432+0000 7fd5dcff9640 1 -- 172.21.15.146:0/4183873872 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fd5c80628e0 con 0x7fd5e00cf6b0 2024-09-17T03:38:24.432 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:24.432 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.433 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:38:24.434 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.435 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:38:24.436 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.437 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.438 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:38:24.440 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:38:24.442 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:38:24.443 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:38:24.445 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:38:24.446 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:38:24.446 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:38:24.446 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:38:24.446 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.446 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.446 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:38:24.446 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:38:24.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.434+0000 7fd5e580e640 1 -- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd5c0078b90 msgr2=0x7fd5c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.434+0000 7fd5e580e640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd5c0078b90 0x7fd5c007b0a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0034000 tx=0x7fd5d0004730 comp rx=0 tx=0).stop 2024-09-17T03:38:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.434+0000 7fd5e580e640 1 -- 172.21.15.146:0/4183873872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5e00cf6b0 msgr2=0x7fd5e00c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.434+0000 7fd5e580e640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5e00cf6b0 0x7fd5e00c8c10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c430 tx=0x7fd5c800c8f0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.435+0000 7fd5e580e640 1 -- 172.21.15.146:0/4183873872 shutdown_connections 2024-09-17T03:38:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.435+0000 7fd5e580e640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd5c0078b90 0x7fd5c007b0a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.435+0000 7fd5e580e640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5e00d0710 0x7fd5e0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.435+0000 7fd5e580e640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5e00cf6b0 0x7fd5e00c8c10 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.435+0000 7fd5e580e640 1 --2- 172.21.15.146:0/4183873872 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5e00b47c0 0x7fd5e00ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.435+0000 7fd5e580e640 1 -- 172.21.15.146:0/4183873872 >> 172.21.15.146:0/4183873872 conn(0x7fd5e009ba20 msgr2=0x7fd5e00b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.435+0000 7fd5e580e640 1 -- 172.21.15.146:0/4183873872 shutdown_connections 2024-09-17T03:38:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.435+0000 7fd5e580e640 1 -- 172.21.15.146:0/4183873872 wait complete. 2024-09-17T03:38:24.449 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:38:24.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.564+0000 7f37534c5640 1 -- 172.21.15.146:0/1779370697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3738004800 msgr2=0x7f3738004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.564+0000 7f37534c5640 1 --2- 172.21.15.146:0/1779370697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3738004800 0x7f3738004c10 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f373c001050 tx=0x7f3738005830 comp rx=0 tx=0).stop 2024-09-17T03:38:24.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.564+0000 7f37534c5640 1 -- 172.21.15.146:0/1779370697 shutdown_connections 2024-09-17T03:38:24.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.564+0000 7f37534c5640 1 --2- 172.21.15.146:0/1779370697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3738004800 0x7f3738004c10 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.564+0000 7f37534c5640 1 -- 172.21.15.146:0/1779370697 >> 172.21.15.146:0/1779370697 conn(0x7f374c09ba20 msgr2=0x7f374c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:24.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.564+0000 7f37534c5640 1 -- 172.21.15.146:0/1779370697 shutdown_connections 2024-09-17T03:38:24.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.564+0000 7f37534c5640 1 -- 172.21.15.146:0/1779370697 wait complete. 2024-09-17T03:38:24.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.566+0000 7f37534c5640 1 Processor -- start 2024-09-17T03:38:24.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.566+0000 7f37534c5640 1 -- start start 2024-09-17T03:38:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.567+0000 7f37534c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3738004800 0x7f374c1e0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.567+0000 7f37534c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f374c1e0b70 0x7f374c0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.567+0000 7f37534c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f374c0b16a0 0x7f374c0b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.567+0000 7f37534c5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f374c0cdf40 con 0x7f374c0b16a0 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.567+0000 7f37534c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f374c0cddc0 con 0x7f3738004800 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.567+0000 7f37534c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f374c0cd090 con 0x7f374c1e0b70 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.567+0000 7f3751a62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f374c0b16a0 0x7f374c0b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.567+0000 7f3751a62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f374c0b16a0 0x7f374c0b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52456/0 (socket says 172.21.15.146:52456) 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.567+0000 7f3751a62640 1 -- 172.21.15.146:0/643977091 learned_addr learned my addr 172.21.15.146:0/643977091 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.567+0000 7f3750a60640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f374c1e0b70 0x7f374c0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.567+0000 7f3751261640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3738004800 0x7f374c1e0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f3751a62640 1 -- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f374c1e0b70 msgr2=0x7f374c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f3751a62640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f374c1e0b70 0x7f374c0cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f3751a62640 1 -- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3738004800 msgr2=0x7f374c1e0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f3751a62640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3738004800 0x7f374c1e0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f3751a62640 1 -- 172.21.15.146:0/643977091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c1e0970 con 0x7f374c0b16a0 2024-09-17T03:38:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f3751261640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3738004800 0x7f374c1e0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f3750a60640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f374c1e0b70 0x7f374c0cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f3751a62640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f374c0b16a0 0x7f374c0b0c80 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f3744005fd0 tx=0x7f3744010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f3741ffb640 1 -- 172.21.15.146:0/643977091 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374400ee40 con 0x7f374c0b16a0 2024-09-17T03:38:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f3741ffb640 1 -- 172.21.15.146:0/643977091 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3744015070 con 0x7f374c0b16a0 2024-09-17T03:38:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f37534c5640 1 -- 172.21.15.146:0/643977091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374c1f4230 con 0x7f374c0b16a0 2024-09-17T03:38:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f3741ffb640 1 -- 172.21.15.146:0/643977091 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744003d00 con 0x7f374c0b16a0 2024-09-17T03:38:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.568+0000 7f37534c5640 1 -- 172.21.15.146:0/643977091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374c0b0480 con 0x7f374c0b16a0 2024-09-17T03:38:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.569+0000 7f37534c5640 1 -- 172.21.15.146:0/643977091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f374c0cd590 con 0x7f374c0b16a0 2024-09-17T03:38:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.570+0000 7f3741ffb640 1 -- 172.21.15.146:0/643977091 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3744004030 con 0x7f374c0b16a0 2024-09-17T03:38:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.570+0000 7f3741ffb640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3730078b90 0x7f373007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.570+0000 7f3741ffb640 1 -- 172.21.15.146:0/643977091 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7f374409b600 con 0x7f374c0b16a0 2024-09-17T03:38:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.571+0000 7f3751261640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3730078b90 0x7f373007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.571+0000 7f3751261640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3730078b90 0x7f373007b0a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f37480035f0 tx=0x7f3748006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.575+0000 7f3741ffb640 1 -- 172.21.15.146:0/643977091 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f374c1e0970 con 0x7f374c0b16a0 2024-09-17T03:38:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.751+0000 7f37534c5640 1 -- 172.21.15.146:0/643977091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f374c0ced70 con 0x7f374c0b16a0 2024-09-17T03:38:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.751+0000 7f3741ffb640 1 -- 172.21.15.146:0/643977091 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v100) ==== 84+0+65 (secure 0 0 0) 0x7f3744063cf0 con 0x7f374c0b16a0 2024-09-17T03:38:24.752 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:24.752 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:38:24.752 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:38:24.752 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:38:24.752 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:38:24.752 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:38:24.752 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:38:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.753+0000 7f37534c5640 1 -- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3730078b90 msgr2=0x7f373007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.753+0000 7f37534c5640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3730078b90 0x7f373007b0a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f37480035f0 tx=0x7f3748006b70 comp rx=0 tx=0).stop 2024-09-17T03:38:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.753+0000 7f37534c5640 1 -- 172.21.15.146:0/643977091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f374c0b16a0 msgr2=0x7f374c0b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.753+0000 7f37534c5640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f374c0b16a0 0x7f374c0b0c80 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f3744005fd0 tx=0x7f3744010f40 comp rx=0 tx=0).stop 2024-09-17T03:38:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.753+0000 7f37534c5640 1 -- 172.21.15.146:0/643977091 shutdown_connections 2024-09-17T03:38:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.753+0000 7f37534c5640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3730078b90 0x7f373007b0a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.753+0000 7f37534c5640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f374c0b16a0 0x7f374c0b0c80 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.753+0000 7f37534c5640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f374c1e0b70 0x7f374c0cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.753+0000 7f37534c5640 1 --2- 172.21.15.146:0/643977091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3738004800 0x7f374c1e0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.754+0000 7f37534c5640 1 -- 172.21.15.146:0/643977091 >> 172.21.15.146:0/643977091 conn(0x7f374c09ba20 msgr2=0x7f374c1e5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:24.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.754+0000 7f37534c5640 1 -- 172.21.15.146:0/643977091 shutdown_connections 2024-09-17T03:38:24.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.754+0000 7f37534c5640 1 -- 172.21.15.146:0/643977091 wait complete. 2024-09-17T03:38:24.765 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:38:24.765 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:38:24.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.882+0000 7fde9c141640 1 -- 172.21.15.146:0/2477580984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b5ce0 msgr2=0x7fde940b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.882+0000 7fde9c141640 1 --2- 172.21.15.146:0/2477580984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b5ce0 0x7fde940b1320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde84009be0 tx=0x7fde8402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.882+0000 7fde9c141640 1 -- 172.21.15.146:0/2477580984 shutdown_connections 2024-09-17T03:38:24.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.882+0000 7fde9c141640 1 --2- 172.21.15.146:0/2477580984 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b5ce0 0x7fde940b1320 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.883+0000 7fde9c141640 1 -- 172.21.15.146:0/2477580984 >> 172.21.15.146:0/2477580984 conn(0x7fde940b7b20 msgr2=0x7fde9409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:24.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.883+0000 7fde9c141640 1 -- 172.21.15.146:0/2477580984 shutdown_connections 2024-09-17T03:38:24.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.883+0000 7fde9c141640 1 -- 172.21.15.146:0/2477580984 wait complete. 2024-09-17T03:38:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.884+0000 7fde9c141640 1 Processor -- start 2024-09-17T03:38:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.884+0000 7fde9c141640 1 -- start start 2024-09-17T03:38:24.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde9c141640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde940b5750 0x7fde94159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde9c141640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b5ce0 0x7fde941e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde9c141640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde94070d50 0x7fde94071160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde9c141640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fde9415d600 con 0x7fde940b5750 2024-09-17T03:38:24.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde9c141640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fde9415d480 con 0x7fde94070d50 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde9c141640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fde9415d780 con 0x7fde940b5ce0 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde99edd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde940b5750 0x7fde94159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde99edd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde940b5750 0x7fde94159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52470/0 (socket says 172.21.15.146:52470) 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde99edd640 1 -- 172.21.15.146:0/742014948 learned_addr learned my addr 172.21.15.146:0/742014948 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde9a6de640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde94070d50 0x7fde94071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde996dc640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b5ce0 0x7fde941e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde99edd640 1 -- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b5ce0 msgr2=0x7fde941e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde99edd640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b5ce0 0x7fde941e7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde99edd640 1 -- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde94070d50 msgr2=0x7fde94071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde99edd640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde94070d50 0x7fde94071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde99edd640 1 -- 172.21.15.146:0/742014948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde940716a0 con 0x7fde940b5750 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde996dc640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b5ce0 0x7fde941e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde99edd640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde940b5750 0x7fde94159660 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fde84009be0 tx=0x7fde84003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde927fc640 1 -- 172.21.15.146:0/742014948 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde84042020 con 0x7fde940b5750 2024-09-17T03:38:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde927fc640 1 -- 172.21.15.146:0/742014948 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde84033b80 con 0x7fde940b5750 2024-09-17T03:38:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde9c141640 1 -- 172.21.15.146:0/742014948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde94159ba0 con 0x7fde940b5750 2024-09-17T03:38:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.886+0000 7fde927fc640 1 -- 172.21.15.146:0/742014948 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde84037040 con 0x7fde940b5750 2024-09-17T03:38:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.887+0000 7fde9c141640 1 -- 172.21.15.146:0/742014948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde941f6f90 con 0x7fde940b5750 2024-09-17T03:38:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.888+0000 7fde9c141640 1 -- 172.21.15.146:0/742014948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde9415dc50 con 0x7fde940b5750 2024-09-17T03:38:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.888+0000 7fde927fc640 1 -- 172.21.15.146:0/742014948 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde84045020 con 0x7fde940b5750 2024-09-17T03:38:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.889+0000 7fde927fc640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde80078b90 0x7fde8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.889+0000 7fde927fc640 1 -- 172.21.15.146:0/742014948 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7fde840bae40 con 0x7fde940b5750 2024-09-17T03:38:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.889+0000 7fde996dc640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde80078b90 0x7fde8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.890+0000 7fde996dc640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde80078b90 0x7fde8007b0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fde88001220 tx=0x7fde88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:24.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:24.893+0000 7fde927fc640 1 -- 172.21.15.146:0/742014948 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde8404c020 con 0x7fde940b5750 2024-09-17T03:38:25.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.070+0000 7fde9c141640 1 -- 172.21.15.146:0/742014948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fde941e8fb0 con 0x7fde940b5750 2024-09-17T03:38:25.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-17T03:38:25.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.948+0000 7fde927fc640 1 -- 172.21.15.146:0/742014948 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v101) ==== 138+0+0 (secure 0 0 0) 0x7fde940716a0 con 0x7fde940b5750 2024-09-17T03:38:25.948 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:38:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 -- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde80078b90 msgr2=0x7fde8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde80078b90 0x7fde8007b0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fde88001220 tx=0x7fde88009040 comp rx=0 tx=0).stop 2024-09-17T03:38:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 -- 172.21.15.146:0/742014948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde940b5750 msgr2=0x7fde94159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde940b5750 0x7fde94159660 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fde84009be0 tx=0x7fde84003f00 comp rx=0 tx=0).stop 2024-09-17T03:38:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 -- 172.21.15.146:0/742014948 shutdown_connections 2024-09-17T03:38:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde80078b90 0x7fde8007b0a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde94070d50 0x7fde94071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:25.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde940b5ce0 0x7fde941e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:25.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 --2- 172.21.15.146:0/742014948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde940b5750 0x7fde94159660 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:25.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 -- 172.21.15.146:0/742014948 >> 172.21.15.146:0/742014948 conn(0x7fde940b7b20 msgr2=0x7fde940b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:25.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 -- 172.21.15.146:0/742014948 shutdown_connections 2024-09-17T03:38:25.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:25.951+0000 7fde9c141640 1 -- 172.21.15.146:0/742014948 wait complete. 2024-09-17T03:38:25.969 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:38:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.093+0000 7f11cec5c640 1 -- 172.21.15.146:0/947660747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b0003a70 msgr2=0x7f11b0003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.093+0000 7f11cec5c640 1 --2- 172.21.15.146:0/947660747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b0003a70 0x7f11b0003ee0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009b50 tx=0x7f11b0005830 comp rx=0 tx=0).stop 2024-09-17T03:38:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.093+0000 7f11cd1f9640 1 -- 172.21.15.146:0/947660747 reap_dead start 2024-09-17T03:38:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.093+0000 7f11cec5c640 1 -- 172.21.15.146:0/947660747 shutdown_connections 2024-09-17T03:38:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.093+0000 7f11cec5c640 1 -- 172.21.15.146:0/947660747 >> 172.21.15.146:0/947660747 conn(0x7f11c80749f0 msgr2=0x7f11c809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.093+0000 7f11cec5c640 1 -- 172.21.15.146:0/947660747 shutdown_connections 2024-09-17T03:38:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.093+0000 7f11cec5c640 1 -- 172.21.15.146:0/947660747 wait complete. 2024-09-17T03:38:26.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.095+0000 7f11cec5c640 1 Processor -- start 2024-09-17T03:38:26.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.095+0000 7f11cec5c640 1 -- start start 2024-09-17T03:38:26.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.096+0000 7f11cec5c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b0003a70 0x7f11c8159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.096+0000 7f11cec5c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c8158710 0x7f11c806f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.096+0000 7f11cec5c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c8152090 0x7f11c81524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.096+0000 7f11cec5c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11c8160680 con 0x7f11b0003a70 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.096+0000 7f11cec5c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f11c80b62a0 con 0x7f11c8152090 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.096+0000 7f11cec5c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f11c8160800 con 0x7f11c8158710 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.096+0000 7f11cc9f8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b0003a70 0x7f11c8159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.096+0000 7f11cc9f8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b0003a70 0x7f11c8159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52480/0 (socket says 172.21.15.146:52480) 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.096+0000 7f11cc9f8640 1 -- 172.21.15.146:0/1625349473 learned_addr learned my addr 172.21.15.146:0/1625349473 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11cc9f8640 1 -- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c8158710 msgr2=0x7f11c806f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11cc9f8640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c8158710 0x7f11c806f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11cd1f9640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c8152090 0x7f11c81524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11cc9f8640 1 -- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c8152090 msgr2=0x7f11c81524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11cc9f8640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c8152090 0x7f11c81524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11cc9f8640 1 -- 172.21.15.146:0/1625349473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c81529e0 con 0x7f11b0003a70 2024-09-17T03:38:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11cd1f9640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c8152090 0x7f11c81524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11cc9f8640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b0003a70 0x7f11c8159eb0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009c70 tx=0x7f11c4033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11bd7fa640 1 -- 172.21.15.146:0/1625349473 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4038040 con 0x7f11b0003a70 2024-09-17T03:38:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11bd7fa640 1 -- 172.21.15.146:0/1625349473 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11c4004020 con 0x7f11b0003a70 2024-09-17T03:38:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11bd7fa640 1 -- 172.21.15.146:0/1625349473 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4004470 con 0x7f11b0003a70 2024-09-17T03:38:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11cec5c640 1 -- 172.21.15.146:0/1625349473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c81f9760 con 0x7f11b0003a70 2024-09-17T03:38:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.097+0000 7f11cec5c640 1 -- 172.21.15.146:0/1625349473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c81f9d20 con 0x7f11b0003a70 2024-09-17T03:38:26.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.098+0000 7f11cec5c640 1 -- 172.21.15.146:0/1625349473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c815d4b0 con 0x7f11b0003a70 2024-09-17T03:38:26.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.099+0000 7f11bd7fa640 1 -- 172.21.15.146:0/1625349473 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f11c4045020 con 0x7f11b0003a70 2024-09-17T03:38:26.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.099+0000 7f11bd7fa640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11b4078bc0 0x7f11b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:26.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.100+0000 7f11bd7fa640 1 -- 172.21.15.146:0/1625349473 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5227+0+0 (secure 0 0 0) 0x7f11c40bc010 con 0x7f11b0003a70 2024-09-17T03:38:26.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.100+0000 7f11bffff640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11b4078bc0 0x7f11b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:26.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.100+0000 7f11bffff640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11b4078bc0 0x7f11b407b0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f11c8150db0 tx=0x7f11b8001c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.104+0000 7f11bd7fa640 1 -- 172.21.15.146:0/1625349473 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11c81529e0 con 0x7f11b0003a70 2024-09-17T03:38:26.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.280+0000 7f11cec5c640 1 -- 172.21.15.146:0/1625349473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f11c81f5d70 con 0x7f11b0003a70 2024-09-17T03:38:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.950+0000 7f11bd7fa640 1 -- 172.21.15.146:0/1625349473 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v102) ==== 170+0+0 (secure 0 0 0) 0x7f11c4084710 con 0x7f11b0003a70 2024-09-17T03:38:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:38:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 -- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11b4078bc0 msgr2=0x7f11b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11b4078bc0 0x7f11b407b0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f11c8150db0 tx=0x7f11b8001c90 comp rx=0 tx=0).stop 2024-09-17T03:38:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 -- 172.21.15.146:0/1625349473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b0003a70 msgr2=0x7f11c8159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b0003a70 0x7f11c8159eb0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009c70 tx=0x7f11c4033670 comp rx=0 tx=0).stop 2024-09-17T03:38:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 -- 172.21.15.146:0/1625349473 shutdown_connections 2024-09-17T03:38:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11b4078bc0 0x7f11b407b0d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11c8152090 0x7f11c81524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11c8158710 0x7f11c806f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 --2- 172.21.15.146:0/1625349473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11b0003a70 0x7f11c8159eb0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 -- 172.21.15.146:0/1625349473 >> 172.21.15.146:0/1625349473 conn(0x7f11c80749f0 msgr2=0x7f11c8156200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 -- 172.21.15.146:0/1625349473 shutdown_connections 2024-09-17T03:38:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:26.954+0000 7f11cec5c640 1 -- 172.21.15.146:0/1625349473 wait complete. 2024-09-17T03:38:26.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:38:27.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.102+0000 7f4d54bdf640 1 -- 172.21.15.146:0/2617986856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500cd840 msgr2=0x7f4d500b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:27.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.102+0000 7f4d54bdf640 1 --2- 172.21.15.146:0/2617986856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500cd840 0x7f4d500b5680 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f4d50071500 tx=0x7f4d4402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:38:27.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.102+0000 7f4d54bdf640 1 -- 172.21.15.146:0/2617986856 shutdown_connections 2024-09-17T03:38:27.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.102+0000 7f4d54bdf640 1 --2- 172.21.15.146:0/2617986856 >> v2:172.21.15.179:3300/0 conn(0x7f4d500cdc50 0x7f4d500b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:27.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.102+0000 7f4d54bdf640 1 --2- 172.21.15.146:0/2617986856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500cd840 0x7f4d500b5680 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:27.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.102+0000 7f4d54bdf640 1 -- 172.21.15.146:0/2617986856 >> 172.21.15.146:0/2617986856 conn(0x7f4d500b3150 msgr2=0x7f4d500b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:27.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.103+0000 7f4d54bdf640 1 -- 172.21.15.146:0/2617986856 shutdown_connections 2024-09-17T03:38:27.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.103+0000 7f4d54bdf640 1 -- 172.21.15.146:0/2617986856 wait complete. 2024-09-17T03:38:27.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.104+0000 7f4d54bdf640 1 Processor -- start 2024-09-17T03:38:27.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.104+0000 7f4d54bdf640 1 -- start start 2024-09-17T03:38:27.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d54bdf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500cd840 0x7f4d50139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:27.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d54bdf640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d500cdc50 0x7f4d5014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:27.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d54bdf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d5015c8e0 0x7f4d501500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:27.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d54bdf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d50073580 con 0x7f4d500cd840 2024-09-17T03:38:27.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d54bdf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4d500b53b0 con 0x7f4d5015c8e0 2024-09-17T03:38:27.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d54bdf640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4d50073700 con 0x7f4d500cdc50 2024-09-17T03:38:27.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500cd840 0x7f4d50139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:27.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500cd840 0x7f4d50139700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52496/0 (socket says 172.21.15.146:52496) 2024-09-17T03:38:27.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4e59c640 1 -- 172.21.15.146:0/636965405 learned_addr learned my addr 172.21.15.146:0/636965405 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:27.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4ed9d640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d5015c8e0 0x7f4d501500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:27.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4dd9b640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d500cdc50 0x7f4d5014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:27.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4e59c640 1 -- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d500cdc50 msgr2=0x7f4d5014fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:27.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4e59c640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d500cdc50 0x7f4d5014fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:27.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4e59c640 1 -- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d5015c8e0 msgr2=0x7f4d501500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:27.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4e59c640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d5015c8e0 0x7f4d501500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:27.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4e59c640 1 -- 172.21.15.146:0/636965405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d50153ac0 con 0x7f4d500cd840 2024-09-17T03:38:27.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4ed9d640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d5015c8e0 0x7f4d501500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:27.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d4e59c640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500cd840 0x7f4d50139700 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c3d0 tx=0x7f4d4000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:27.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.106+0000 7f4d3effd640 1 -- 172.21.15.146:0/636965405 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40011790 con 0x7f4d500cd840 2024-09-17T03:38:27.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.107+0000 7f4d3effd640 1 -- 172.21.15.146:0/636965405 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d40017070 con 0x7f4d500cd840 2024-09-17T03:38:27.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.107+0000 7f4d54bdf640 1 -- 172.21.15.146:0/636965405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d501e3fc0 con 0x7f4d500cd840 2024-09-17T03:38:27.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.107+0000 7f4d3effd640 1 -- 172.21.15.146:0/636965405 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40011cc0 con 0x7f4d500cd840 2024-09-17T03:38:27.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.107+0000 7f4d54bdf640 1 -- 172.21.15.146:0/636965405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d5013a080 con 0x7f4d500cd840 2024-09-17T03:38:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.108+0000 7f4d54bdf640 1 -- 172.21.15.146:0/636965405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d50073bb0 con 0x7f4d500cd840 2024-09-17T03:38:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.108+0000 7f4d3effd640 1 -- 172.21.15.146:0/636965405 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d4001c460 con 0x7f4d500cd840 2024-09-17T03:38:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.109+0000 7f4d3effd640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d30078b90 0x7f4d3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.109+0000 7f4d3effd640 1 -- 172.21.15.146:0/636965405 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5609+0+0 (secure 0 0 0) 0x7f4d4009ab30 con 0x7f4d500cd840 2024-09-17T03:38:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.109+0000 7f4d4dd9b640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d30078b90 0x7f4d3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.110+0000 7f4d4dd9b640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d30078b90 0x7f4d3007b0a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4d44034000 tx=0x7f4d44004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:27.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.114+0000 7f4d3effd640 1 -- 172.21.15.146:0/636965405 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4d40062f50 con 0x7f4d500cd840 2024-09-17T03:38:27.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.323+0000 7f4d54bdf640 1 -- 172.21.15.146:0/636965405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4d500b4bd0 con 0x7f4d500cd840 2024-09-17T03:38:27.556 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:38:27.559 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:38:27.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.961+0000 7f4d3effd640 1 -- 172.21.15.146:0/636965405 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v75) ==== 174+0+0 (secure 0 0 0) 0x7f4d40062850 con 0x7f4d500cd840 2024-09-17T03:38:27.962 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 14 and data pool 15 2024-09-17T03:38:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 -- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d30078b90 msgr2=0x7f4d3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d30078b90 0x7f4d3007b0a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4d44034000 tx=0x7f4d44004730 comp rx=0 tx=0).stop 2024-09-17T03:38:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 -- 172.21.15.146:0/636965405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500cd840 msgr2=0x7f4d50139700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:27.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500cd840 0x7f4d50139700 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000c3d0 tx=0x7f4d4000c890 comp rx=0 tx=0).stop 2024-09-17T03:38:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 -- 172.21.15.146:0/636965405 shutdown_connections 2024-09-17T03:38:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d30078b90 0x7f4d3007b0a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d5015c8e0 0x7f4d501500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d500cdc50 0x7f4d5014fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 --2- 172.21.15.146:0/636965405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500cd840 0x7f4d50139700 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 -- 172.21.15.146:0/636965405 >> 172.21.15.146:0/636965405 conn(0x7f4d500b3150 msgr2=0x7f4d500ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 -- 172.21.15.146:0/636965405 shutdown_connections 2024-09-17T03:38:27.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:27.965+0000 7f4d54bdf640 1 -- 172.21.15.146:0/636965405 wait complete. 2024-09-17T03:38:27.993 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.106+0000 7f3be8d57640 1 -- 172.21.15.146:0/1049382126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be41631a0 msgr2=0x7f3be40cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.106+0000 7f3be8d57640 1 --2- 172.21.15.146:0/1049382126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be41631a0 0x7f3be40cef40 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f3be406e100 tx=0x7f3bd802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.106+0000 7f3be8d57640 1 -- 172.21.15.146:0/1049382126 shutdown_connections 2024-09-17T03:38:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.106+0000 7f3be8d57640 1 --2- 172.21.15.146:0/1049382126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be41631a0 0x7f3be40cef40 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.106+0000 7f3be8d57640 1 --2- 172.21.15.146:0/1049382126 >> v2:172.21.15.179:3300/0 conn(0x7f3be415f1a0 0x7f3be40cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.106+0000 7f3be8d57640 1 -- 172.21.15.146:0/1049382126 >> 172.21.15.146:0/1049382126 conn(0x7f3be40d11f0 msgr2=0x7f3be40d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.106+0000 7f3be8d57640 1 -- 172.21.15.146:0/1049382126 shutdown_connections 2024-09-17T03:38:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.106+0000 7f3be8d57640 1 -- 172.21.15.146:0/1049382126 wait complete. 2024-09-17T03:38:28.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.108+0000 7f3be8d57640 1 Processor -- start 2024-09-17T03:38:28.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.108+0000 7f3be8d57640 1 -- start start 2024-09-17T03:38:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.109+0000 7f3be8d57640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be40b61f0 0x7f3be40ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be8d57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3be415f1a0 0x7f3be40cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be8d57640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be41631a0 0x7f3be41f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be8d57640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3be40695b0 con 0x7f3be41631a0 2024-09-17T03:38:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be8d57640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3be4069430 con 0x7f3be40b61f0 2024-09-17T03:38:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be8d57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3be4069730 con 0x7f3be415f1a0 2024-09-17T03:38:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be41631a0 0x7f3be41f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be41631a0 0x7f3be41f8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52752/0 (socket says 172.21.15.146:52752) 2024-09-17T03:38:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be2d9d640 1 -- 172.21.15.146:0/1955774156 learned_addr learned my addr 172.21.15.146:0/1955774156 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be259c640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be40b61f0 0x7f3be40ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be1d9b640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3be415f1a0 0x7f3be40cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be2d9d640 1 -- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3be415f1a0 msgr2=0x7f3be40cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be2d9d640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3be415f1a0 0x7f3be40cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be2d9d640 1 -- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be40b61f0 msgr2=0x7f3be40ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be2d9d640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be40b61f0 0x7f3be40ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be2d9d640 1 -- 172.21.15.146:0/1955774156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be40cdbd0 con 0x7f3be41631a0 2024-09-17T03:38:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be2d9d640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be41631a0 0x7f3be41f8ff0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00b410 tx=0x7f3bdc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3bd2ffd640 1 -- 172.21.15.146:0/1955774156 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc015030 con 0x7f3be41631a0 2024-09-17T03:38:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3bd2ffd640 1 -- 172.21.15.146:0/1955774156 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bdc004020 con 0x7f3be41631a0 2024-09-17T03:38:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be8d57640 1 -- 172.21.15.146:0/1955774156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3be40cdeb0 con 0x7f3be41631a0 2024-09-17T03:38:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3bd2ffd640 1 -- 172.21.15.146:0/1955774156 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc004470 con 0x7f3be41631a0 2024-09-17T03:38:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.110+0000 7f3be8d57640 1 -- 172.21.15.146:0/1955774156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3be40b8100 con 0x7f3be41631a0 2024-09-17T03:38:28.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.111+0000 7f3be8d57640 1 -- 172.21.15.146:0/1955774156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3be40b7c10 con 0x7f3be41631a0 2024-09-17T03:38:28.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.112+0000 7f3bd2ffd640 1 -- 172.21.15.146:0/1955774156 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3bdc018070 con 0x7f3be41631a0 2024-09-17T03:38:28.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.113+0000 7f3bd2ffd640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bc4078bc0 0x7f3bc407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.113+0000 7f3bd2ffd640 1 -- 172.21.15.146:0/1955774156 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f3bdc09a6c0 con 0x7f3be41631a0 2024-09-17T03:38:28.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.113+0000 7f3be259c640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bc4078bc0 0x7f3bc407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.113+0000 7f3be259c640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bc4078bc0 0x7f3bc407b0d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4005c40 tx=0x7f3bd400a530 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.117+0000 7f3bd2ffd640 1 -- 172.21.15.146:0/1955774156 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3bdc062540 con 0x7f3be41631a0 2024-09-17T03:38:28.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.291+0000 7f3be8d57640 1 -- 172.21.15.146:0/1955774156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3be40c7ff0 con 0x7f3be41631a0 2024-09-17T03:38:28.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.292+0000 7f3bd2ffd640 1 -- 172.21.15.146:0/1955774156 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16740 (secure 0 0 0) 0x7f3bdc066f70 con 0x7f3be41631a0 2024-09-17T03:38:28.293 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:28.293 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":103,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:38:27.325847+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:38:25.075763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:38:26.285571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.294+0000 7f3be8d57640 1 -- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bc4078bc0 msgr2=0x7f3bc407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.294+0000 7f3be8d57640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bc4078bc0 0x7f3bc407b0d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4005c40 tx=0x7f3bd400a530 comp rx=0 tx=0).stop 2024-09-17T03:38:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.294+0000 7f3be8d57640 1 -- 172.21.15.146:0/1955774156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be41631a0 msgr2=0x7f3be41f8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.294+0000 7f3be8d57640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be41631a0 0x7f3be41f8ff0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00b410 tx=0x7f3bdc00b8d0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.294+0000 7f3be8d57640 1 -- 172.21.15.146:0/1955774156 shutdown_connections 2024-09-17T03:38:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.294+0000 7f3be8d57640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3bc4078bc0 0x7f3bc407b0d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.294+0000 7f3be8d57640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3be41631a0 0x7f3be41f8ff0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.294+0000 7f3be8d57640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3be415f1a0 0x7f3be40cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.294+0000 7f3be8d57640 1 --2- 172.21.15.146:0/1955774156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3be40b61f0 0x7f3be40ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.294+0000 7f3be8d57640 1 -- 172.21.15.146:0/1955774156 >> 172.21.15.146:0/1955774156 conn(0x7f3be40d11f0 msgr2=0x7f3be41619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:28.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.294+0000 7f3be8d57640 1 -- 172.21.15.146:0/1955774156 shutdown_connections 2024-09-17T03:38:28.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.295+0000 7f3be8d57640 1 -- 172.21.15.146:0/1955774156 wait complete. 2024-09-17T03:38:28.307 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:28.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.419+0000 7fd9ee913640 1 -- 172.21.15.146:0/304548058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9e80b5ce0 msgr2=0x7fd9e80b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.419+0000 7fd9ee913640 1 --2- 172.21.15.146:0/304548058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9e80b5ce0 0x7fd9e80b1320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009860 tx=0x7fd9d802a5a0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.420+0000 7fd9ee913640 1 -- 172.21.15.146:0/304548058 shutdown_connections 2024-09-17T03:38:28.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.420+0000 7fd9ee913640 1 --2- 172.21.15.146:0/304548058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9e80b5ce0 0x7fd9e80b1320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.420+0000 7fd9ee913640 1 -- 172.21.15.146:0/304548058 >> 172.21.15.146:0/304548058 conn(0x7fd9e80b7b20 msgr2=0x7fd9e809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:28.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.420+0000 7fd9ee913640 1 -- 172.21.15.146:0/304548058 shutdown_connections 2024-09-17T03:38:28.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.420+0000 7fd9ee913640 1 -- 172.21.15.146:0/304548058 wait complete. 2024-09-17T03:38:28.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.421+0000 7fd9ee913640 1 Processor -- start 2024-09-17T03:38:28.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.422+0000 7fd9ee913640 1 -- start start 2024-09-17T03:38:28.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9ee913640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e80b5750 0x7fd9e8154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9ee913640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e80b5ce0 0x7fd9e80a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9ee913640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9e81f55a0 0x7fd9e8155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9ee913640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e815d650 con 0x7fd9e80b5750 2024-09-17T03:38:28.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9ee913640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e815d4d0 con 0x7fd9e80b5ce0 2024-09-17T03:38:28.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9ee913640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e815d7d0 con 0x7fd9e81f55a0 2024-09-17T03:38:28.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9e7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e80b5750 0x7fd9e8154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9e7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e80b5750 0x7fd9e8154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52760/0 (socket says 172.21.15.146:52760) 2024-09-17T03:38:28.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9e7fff640 1 -- 172.21.15.146:0/4150889280 learned_addr learned my addr 172.21.15.146:0/4150889280 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:28.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9eceb0640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9e81f55a0 0x7fd9e8155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9e77fe640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e80b5ce0 0x7fd9e80a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9e7fff640 1 -- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9e81f55a0 msgr2=0x7fd9e8155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9e7fff640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9e81f55a0 0x7fd9e8155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9e7fff640 1 -- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e80b5ce0 msgr2=0x7fd9e80a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9e7fff640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e80b5ce0 0x7fd9e80a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9e7fff640 1 -- 172.21.15.146:0/4150889280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e81578d0 con 0x7fd9e80b5750 2024-09-17T03:38:28.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9eceb0640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9e81f55a0 0x7fd9e8155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:28.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9e77fe640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e80b5ce0 0x7fd9e80a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:28.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.423+0000 7fd9e7fff640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e80b5750 0x7fd9e8154820 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009980 tx=0x7fd9d8033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:28.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.424+0000 7fd9e4ff9640 1 -- 172.21.15.146:0/4150889280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8031b50 con 0x7fd9e80b5750 2024-09-17T03:38:28.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.424+0000 7fd9e4ff9640 1 -- 172.21.15.146:0/4150889280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9d8031de0 con 0x7fd9e80b5750 2024-09-17T03:38:28.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.424+0000 7fd9e4ff9640 1 -- 172.21.15.146:0/4150889280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8033330 con 0x7fd9e80b5750 2024-09-17T03:38:28.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.424+0000 7fd9ee913640 1 -- 172.21.15.146:0/4150889280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e8157030 con 0x7fd9e80b5750 2024-09-17T03:38:28.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.424+0000 7fd9ee913640 1 -- 172.21.15.146:0/4150889280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e81575f0 con 0x7fd9e80b5750 2024-09-17T03:38:28.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.425+0000 7fd9ee913640 1 -- 172.21.15.146:0/4150889280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e815dc80 con 0x7fd9e80b5750 2024-09-17T03:38:28.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.425+0000 7fd9e4ff9640 1 -- 172.21.15.146:0/4150889280 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9d80334d0 con 0x7fd9e80b5750 2024-09-17T03:38:28.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.426+0000 7fd9e4ff9640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d4078b90 0x7fd9d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.426+0000 7fd9e4ff9640 1 -- 172.21.15.146:0/4150889280 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fd9d80bbf70 con 0x7fd9e80b5750 2024-09-17T03:38:28.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.426+0000 7fd9e77fe640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d4078b90 0x7fd9d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.427+0000 7fd9e77fe640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d4078b90 0x7fd9d407b0a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd9e809d920 tx=0x7fd9dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:28.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.430+0000 7fd9e4ff9640 1 -- 172.21.15.146:0/4150889280 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9d803f030 con 0x7fd9e80b5750 2024-09-17T03:38:28.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.607+0000 7fd9ee913640 1 -- 172.21.15.146:0/4150889280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9e8155b30 con 0x7fd9e80b5750 2024-09-17T03:38:28.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.608+0000 7fd9e4ff9640 1 -- 172.21.15.146:0/4150889280 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16740 (secure 0 0 0) 0x7fd9d80844d0 con 0x7fd9e80b5750 2024-09-17T03:38:28.608 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:28.608 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":103,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:38:27.325847+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:38:25.075763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:38:26.285571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:28.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 -- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d4078b90 msgr2=0x7fd9d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d4078b90 0x7fd9d407b0a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd9e809d920 tx=0x7fd9dc009040 comp rx=0 tx=0).stop 2024-09-17T03:38:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 -- 172.21.15.146:0/4150889280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e80b5750 msgr2=0x7fd9e8154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e80b5750 0x7fd9e8154820 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009980 tx=0x7fd9d8033ba0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 -- 172.21.15.146:0/4150889280 shutdown_connections 2024-09-17T03:38:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9d4078b90 0x7fd9d407b0a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9e81f55a0 0x7fd9e8155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9e80b5ce0 0x7fd9e80a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 --2- 172.21.15.146:0/4150889280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9e80b5750 0x7fd9e8154820 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 -- 172.21.15.146:0/4150889280 >> 172.21.15.146:0/4150889280 conn(0x7fd9e80b7b20 msgr2=0x7fd9e81593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 -- 172.21.15.146:0/4150889280 shutdown_connections 2024-09-17T03:38:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.610+0000 7fd9ee913640 1 -- 172.21.15.146:0/4150889280 wait complete. 2024-09-17T03:38:28.622 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:38:28.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.738+0000 7fe982c0e640 1 -- 172.21.15.146:0/2915087862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe97c0b3870 msgr2=0x7fe97c0cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.738+0000 7fe982c0e640 1 --2- 172.21.15.146:0/2915087862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe97c0b3870 0x7fe97c0cf370 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0b3790 tx=0x7fe96c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.738+0000 7fe982c0e640 1 -- 172.21.15.146:0/2915087862 shutdown_connections 2024-09-17T03:38:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.738+0000 7fe982c0e640 1 --2- 172.21.15.146:0/2915087862 >> v2:172.21.15.179:3300/0 conn(0x7fe97c06f440 0x7fe97c0d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.738+0000 7fe982c0e640 1 --2- 172.21.15.146:0/2915087862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe97c0b3870 0x7fe97c0cf370 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.738+0000 7fe982c0e640 1 -- 172.21.15.146:0/2915087862 >> 172.21.15.146:0/2915087862 conn(0x7fe97c0d4be0 msgr2=0x7fe97c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.738+0000 7fe982c0e640 1 -- 172.21.15.146:0/2915087862 shutdown_connections 2024-09-17T03:38:28.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.738+0000 7fe982c0e640 1 -- 172.21.15.146:0/2915087862 wait complete. 2024-09-17T03:38:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.740+0000 7fe982c0e640 1 Processor -- start 2024-09-17T03:38:28.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.740+0000 7fe982c0e640 1 -- start start 2024-09-17T03:38:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.741+0000 7fe982c0e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe97c0b3870 0x7fe97c0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.741+0000 7fe982c0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe97c1620f0 0x7fe97c14b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.741+0000 7fe982c0e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe97c0c9c50 0x7fe97c0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.741+0000 7fe982c0e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c0d3a60 con 0x7fe97c0c9c50 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.741+0000 7fe982c0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c0d38e0 con 0x7fe97c1620f0 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.741+0000 7fe982c0e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c0d3be0 con 0x7fe97c0b3870 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9811ab640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe97c0c9c50 0x7fe97c0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9811ab640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe97c0c9c50 0x7fe97c0ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52780/0 (socket says 172.21.15.146:52780) 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9811ab640 1 -- 172.21.15.146:0/1893397712 learned_addr learned my addr 172.21.15.146:0/1893397712 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe97bfff640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe97c1620f0 0x7fe97c14b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9809aa640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe97c0b3870 0x7fe97c0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9811ab640 1 -- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe97c0b3870 msgr2=0x7fe97c0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9811ab640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe97c0b3870 0x7fe97c0c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9811ab640 1 -- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe97c1620f0 msgr2=0x7fe97c14b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9811ab640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe97c1620f0 0x7fe97c14b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9811ab640 1 -- 172.21.15.146:0/1893397712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c0ca5a0 con 0x7fe97c0c9c50 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9809aa640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe97c0b3870 0x7fe97c0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9811ab640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe97c0c9c50 0x7fe97c0ca060 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fe97400c770 tx=0x7fe97400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9797fa640 1 -- 172.21.15.146:0/1893397712 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974007bb0 con 0x7fe97c0c9c50 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9797fa640 1 -- 172.21.15.146:0/1893397712 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe974007e40 con 0x7fe97c0c9c50 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe982c0e640 1 -- 172.21.15.146:0/1893397712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c0b9100 con 0x7fe97c0c9c50 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe9797fa640 1 -- 172.21.15.146:0/1893397712 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974005280 con 0x7fe97c0c9c50 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.742+0000 7fe982c0e640 1 -- 172.21.15.146:0/1893397712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97c0cb8a0 con 0x7fe97c0c9c50 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.743+0000 7fe982c0e640 1 -- 172.21.15.146:0/1893397712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe97c0d3190 con 0x7fe97c0c9c50 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.744+0000 7fe9797fa640 1 -- 172.21.15.146:0/1893397712 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe974005420 con 0x7fe97c0c9c50 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.744+0000 7fe9797fa640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe968078bc0 0x7fe96807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.745+0000 7fe9797fa640 1 -- 172.21.15.146:0/1893397712 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fe97409afa0 con 0x7fe97c0c9c50 2024-09-17T03:38:28.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.745+0000 7fe9809aa640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe968078bc0 0x7fe96807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:28.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.745+0000 7fe9809aa640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe968078bc0 0x7fe96807b0d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe96c034000 tx=0x7fe96c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:28.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.749+0000 7fe9797fa640 1 -- 172.21.15.146:0/1893397712 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe97c0ca5a0 con 0x7fe97c0c9c50 2024-09-17T03:38:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.956+0000 7fe982c0e640 1 -- 172.21.15.146:0/1893397712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe97c0b8e90 con 0x7fe97c0c9c50 2024-09-17T03:38:28.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.978+0000 7fe9797fa640 1 -- 172.21.15.146:0/1893397712 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v76) ==== 118+0+0 (secure 0 0 0) 0x7fe974014030 con 0x7fe97c0c9c50 2024-09-17T03:38:28.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 -- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe968078bc0 msgr2=0x7fe96807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe968078bc0 0x7fe96807b0d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe96c034000 tx=0x7fe96c004730 comp rx=0 tx=0).stop 2024-09-17T03:38:28.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 -- 172.21.15.146:0/1893397712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe97c0c9c50 msgr2=0x7fe97c0ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:28.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe97c0c9c50 0x7fe97c0ca060 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fe97400c770 tx=0x7fe97400cc30 comp rx=0 tx=0).stop 2024-09-17T03:38:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 -- 172.21.15.146:0/1893397712 shutdown_connections 2024-09-17T03:38:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe968078bc0 0x7fe96807b0d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe97c0c9c50 0x7fe97c0ca060 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe97c1620f0 0x7fe97c14b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 --2- 172.21.15.146:0/1893397712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe97c0b3870 0x7fe97c0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 -- 172.21.15.146:0/1893397712 >> 172.21.15.146:0/1893397712 conn(0x7fe97c0d4be0 msgr2=0x7fe97c15dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 -- 172.21.15.146:0/1893397712 shutdown_connections 2024-09-17T03:38:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:28.981+0000 7fe982c0e640 1 -- 172.21.15.146:0/1893397712 wait complete. 2024-09-17T03:38:28.993 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:38:28.993 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:38:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.108+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2703612622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb40d0710 msgr2=0x7f7eb40cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.108+0000 7f7ebb5e6640 1 --2- 172.21.15.146:0/2703612622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb40d0710 0x7f7eb40cf170 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40d0b20 tx=0x7f7eb002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:38:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.108+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2703612622 shutdown_connections 2024-09-17T03:38:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.108+0000 7f7ebb5e6640 1 --2- 172.21.15.146:0/2703612622 >> v2:172.21.15.179:3300/0 conn(0x7f7eb40cf6b0 0x7f7eb4161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.108+0000 7f7ebb5e6640 1 --2- 172.21.15.146:0/2703612622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb40d0710 0x7f7eb40cf170 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.108+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2703612622 >> 172.21.15.146:0/2703612622 conn(0x7f7eb409ba20 msgr2=0x7f7eb40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.108+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2703612622 shutdown_connections 2024-09-17T03:38:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.108+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2703612622 wait complete. 2024-09-17T03:38:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.110+0000 7f7ebb5e6640 1 Processor -- start 2024-09-17T03:38:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.110+0000 7f7ebb5e6640 1 -- start start 2024-09-17T03:38:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.111+0000 7f7ebb5e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7eb40b47c0 0x7f7eb415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.111+0000 7f7ebb5e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eb40cf6b0 0x7f7eb40706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.111+0000 7f7ebb5e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb40d0710 0x7f7eb4070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.111+0000 7f7ebb5e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb40b1de0 con 0x7f7eb40d0710 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.111+0000 7f7ebb5e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb4162080 con 0x7f7eb40b47c0 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.111+0000 7f7ebb5e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb40b1f60 con 0x7f7eb40cf6b0 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.111+0000 7f7eb9b83640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb40d0710 0x7f7eb4070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.111+0000 7f7eb9b83640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb40d0710 0x7f7eb4070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52808/0 (socket says 172.21.15.146:52808) 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.111+0000 7f7eb9b83640 1 -- 172.21.15.146:0/2726455372 learned_addr learned my addr 172.21.15.146:0/2726455372 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7eb9382640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7eb40b47c0 0x7f7eb415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7eb9b83640 1 -- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eb40cf6b0 msgr2=0x7f7eb40706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7eb8b81640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eb40cf6b0 0x7f7eb40706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7eb9b83640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eb40cf6b0 0x7f7eb40706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7eb9b83640 1 -- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7eb40b47c0 msgr2=0x7f7eb415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7eb9b83640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7eb40b47c0 0x7f7eb415cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7eb9b83640 1 -- 172.21.15.146:0/2726455372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb415f1e0 con 0x7f7eb40d0710 2024-09-17T03:38:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7eb9382640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7eb40b47c0 0x7f7eb415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7eb8b81640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eb40cf6b0 0x7f7eb40706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7eb9b83640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb40d0710 0x7f7eb4070c00 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00b9a0 tx=0x7f7eac00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7ea9ffb640 1 -- 172.21.15.146:0/2726455372 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac019070 con 0x7f7eb40d0710 2024-09-17T03:38:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7ea9ffb640 1 -- 172.21.15.146:0/2726455372 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7eac00cc90 con 0x7f7eb40d0710 2024-09-17T03:38:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2726455372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb41f75b0 con 0x7f7eb40d0710 2024-09-17T03:38:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7ea9ffb640 1 -- 172.21.15.146:0/2726455372 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0146a0 con 0x7f7eb40d0710 2024-09-17T03:38:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.112+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2726455372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb41f7b70 con 0x7f7eb40d0710 2024-09-17T03:38:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.113+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2726455372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb415ef50 con 0x7f7eb40d0710 2024-09-17T03:38:29.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.114+0000 7f7ea9ffb640 1 -- 172.21.15.146:0/2726455372 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7eac01c070 con 0x7f7eb40d0710 2024-09-17T03:38:29.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.115+0000 7f7ea9ffb640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078bc0 0x7f7e9807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:29.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.115+0000 7f7ea9ffb640 1 -- 172.21.15.146:0/2726455372 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f7eac09a9b0 con 0x7f7eb40d0710 2024-09-17T03:38:29.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.115+0000 7f7eb9382640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078bc0 0x7f7e9807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:29.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.116+0000 7f7eb9382640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078bc0 0x7f7e9807b0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0033000 tx=0x7f7eb0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.119+0000 7f7ea9ffb640 1 -- 172.21.15.146:0/2726455372 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7eac062df0 con 0x7f7eb40d0710 2024-09-17T03:38:29.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.332+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2726455372 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7eb40cf170 con 0x7f7eb40d0710 2024-09-17T03:38:29.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.989+0000 7f7ea9ffb640 1 -- 172.21.15.146:0/2726455372 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v77) ==== 122+0+0 (secure 0 0 0) 0x7f7eac0626f0 con 0x7f7eb40d0710 2024-09-17T03:38:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078bc0 msgr2=0x7f7e9807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078bc0 0x7f7e9807b0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0033000 tx=0x7f7eb0004730 comp rx=0 tx=0).stop 2024-09-17T03:38:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2726455372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb40d0710 msgr2=0x7f7eb4070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb40d0710 0x7f7eb4070c00 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00b9a0 tx=0x7f7eac00be60 comp rx=0 tx=0).stop 2024-09-17T03:38:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2726455372 shutdown_connections 2024-09-17T03:38:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e98078bc0 0x7f7e9807b0d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb40d0710 0x7f7eb4070c00 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7eb40cf6b0 0x7f7eb40706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 --2- 172.21.15.146:0/2726455372 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7eb40b47c0 0x7f7eb415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2726455372 >> 172.21.15.146:0/2726455372 conn(0x7f7eb409ba20 msgr2=0x7f7eb40b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2726455372 shutdown_connections 2024-09-17T03:38:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:29.992+0000 7f7ebb5e6640 1 -- 172.21.15.146:0/2726455372 wait complete. 2024-09-17T03:38:30.004 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:38:30.005 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.118+0000 7f9bf9640640 1 -- 172.21.15.146:0/2861546191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf40b38a0 msgr2=0x7f9bf406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.118+0000 7f9bf9640640 1 --2- 172.21.15.146:0/2861546191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf40b38a0 0x7f9bf406f080 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f9bec005fd0 tx=0x7f9bec02a9c0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.118+0000 7f9bf9640640 1 -- 172.21.15.146:0/2861546191 shutdown_connections 2024-09-17T03:38:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.118+0000 7f9bf9640640 1 --2- 172.21.15.146:0/2861546191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf40b38a0 0x7f9bf406f080 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.118+0000 7f9bf9640640 1 --2- 172.21.15.146:0/2861546191 >> v2:172.21.15.179:3300/0 conn(0x7f9bf40cef40 0x7f9bf40b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.118+0000 7f9bf9640640 1 --2- 172.21.15.146:0/2861546191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf40cfc60 0x7f9bf415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.118+0000 7f9bf9640640 1 -- 172.21.15.146:0/2861546191 >> 172.21.15.146:0/2861546191 conn(0x7f9bf40b2060 msgr2=0x7f9bf40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.118+0000 7f9bf9640640 1 -- 172.21.15.146:0/2861546191 shutdown_connections 2024-09-17T03:38:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.118+0000 7f9bf9640640 1 -- 172.21.15.146:0/2861546191 wait complete. 2024-09-17T03:38:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.120+0000 7f9bf9640640 1 Processor -- start 2024-09-17T03:38:30.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.120+0000 7f9bf9640640 1 -- start start 2024-09-17T03:38:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bf9640640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf40b38a0 0x7f9bf4146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bf9640640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf40cef40 0x7f9bf415fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bf9640640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf40cfc60 0x7f9bf415ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bf9640640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf4070430 con 0x7f9bf40cef40 2024-09-17T03:38:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bf9640640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf406f880 con 0x7f9bf40cfc60 2024-09-17T03:38:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bf9640640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf40705b0 con 0x7f9bf40b38a0 2024-09-17T03:38:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bea7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf40cef40 0x7f9bf415fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bea7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf40cef40 0x7f9bf415fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52812/0 (socket says 172.21.15.146:52812) 2024-09-17T03:38:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bea7fc640 1 -- 172.21.15.146:0/4112166980 learned_addr learned my addr 172.21.15.146:0/4112166980 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bf37fe640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf40cfc60 0x7f9bf415ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bf2ffd640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf40b38a0 0x7f9bf4146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bea7fc640 1 -- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf40b38a0 msgr2=0x7f9bf4146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bea7fc640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf40b38a0 0x7f9bf4146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bea7fc640 1 -- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf40cfc60 msgr2=0x7f9bf415ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bea7fc640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf40cfc60 0x7f9bf415ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bea7fc640 1 -- 172.21.15.146:0/4112166980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf41f6b10 con 0x7f9bf40cef40 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bf2ffd640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf40b38a0 0x7f9bf4146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bea7fc640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf40cef40 0x7f9bf415fa10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00e6e0 tx=0x7f9bdc00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bebfff640 1 -- 172.21.15.146:0/4112166980 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00cab0 con 0x7f9bf40cef40 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bebfff640 1 -- 172.21.15.146:0/4112166980 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bdc00cc50 con 0x7f9bf40cef40 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.122+0000 7f9bf9640640 1 -- 172.21.15.146:0/4112166980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf41f6df0 con 0x7f9bf40cef40 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.123+0000 7f9bebfff640 1 -- 172.21.15.146:0/4112166980 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc005280 con 0x7f9bf40cef40 2024-09-17T03:38:30.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.123+0000 7f9bf9640640 1 -- 172.21.15.146:0/4112166980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf41f73b0 con 0x7f9bf40cef40 2024-09-17T03:38:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.124+0000 7f9bf9640640 1 -- 172.21.15.146:0/4112166980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf41f6880 con 0x7f9bf40cef40 2024-09-17T03:38:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.124+0000 7f9bebfff640 1 -- 172.21.15.146:0/4112166980 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9bdc005420 con 0x7f9bf40cef40 2024-09-17T03:38:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.125+0000 7f9bebfff640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9bd4078b90 0x7f9bd407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.125+0000 7f9bebfff640 1 -- 172.21.15.146:0/4112166980 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f9bdc09b530 con 0x7f9bf40cef40 2024-09-17T03:38:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.125+0000 7f9bf2ffd640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9bd4078b90 0x7f9bd407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.126+0000 7f9bf2ffd640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9bd4078b90 0x7f9bd407b0a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009b80 tx=0x7f9be4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:30.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.129+0000 7f9bebfff640 1 -- 172.21.15.146:0/4112166980 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9bdc00ce20 con 0x7f9bf40cef40 2024-09-17T03:38:30.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.340+0000 7f9bf9640640 1 -- 172.21.15.146:0/4112166980 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bf4070a60 con 0x7f9bf40cef40 2024-09-17T03:38:30.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.340+0000 7f9bebfff640 1 -- 172.21.15.146:0/4112166980 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5225 (secure 0 0 0) 0x7f9bdc063a00 con 0x7f9bf40cef40 2024-09-17T03:38:30.341 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:30.341 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":77,"btime":"2024-09-17T03:38:29:984393+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/351223948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":351223948},{"type":"v1","addr":"172.21.15.146:6835","nonce":351223948}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/985271714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":985271714},{"type":"v1","addr":"172.21.15.179:6835","nonce":985271714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/781824323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":781824323},{"type":"v1","addr":"172.21.15.179:6837","nonce":781824323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:38:27.325806+0000","modified":"2024-09-17T03:38:29.334476+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7770},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7770":{"gid":7770,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/682941374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":682941374},{"type":"v1","addr":"172.21.15.146:6834","nonce":682941374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7770,"qdb_cluster":[7770]},"id":7}]} 2024-09-17T03:38:30.341 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 77 2024-09-17T03:38:30.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 -- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9bd4078b90 msgr2=0x7f9bd407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9bd4078b90 0x7f9bd407b0a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009b80 tx=0x7f9be4005f90 comp rx=0 tx=0).stop 2024-09-17T03:38:30.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 -- 172.21.15.146:0/4112166980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf40cef40 msgr2=0x7f9bf415fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf40cef40 0x7f9bf415fa10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00e6e0 tx=0x7f9bdc00eba0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 -- 172.21.15.146:0/4112166980 shutdown_connections 2024-09-17T03:38:30.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9bd4078b90 0x7f9bd407b0a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bf40cfc60 0x7f9bf415ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bf40cef40 0x7f9bf415fa10 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 --2- 172.21.15.146:0/4112166980 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bf40b38a0 0x7f9bf4146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 -- 172.21.15.146:0/4112166980 >> 172.21.15.146:0/4112166980 conn(0x7f9bf40b2060 msgr2=0x7f9bf4075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:30.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 -- 172.21.15.146:0/4112166980 shutdown_connections 2024-09-17T03:38:30.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.343+0000 7f9bf9640640 1 -- 172.21.15.146:0/4112166980 wait complete. 2024-09-17T03:38:30.354 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:38:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.469+0000 7fd6a305c640 1 -- 172.21.15.146:0/4064653447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd688004d40 msgr2=0x7fd688005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.469+0000 7fd6a305c640 1 --2- 172.21.15.146:0/4064653447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd688004d40 0x7fd688005190 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fd684001740 tx=0x7fd688005830 comp rx=0 tx=0).stop 2024-09-17T03:38:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.469+0000 7fd6a15f9640 1 -- 172.21.15.146:0/4064653447 reap_dead start 2024-09-17T03:38:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.469+0000 7fd6a305c640 1 -- 172.21.15.146:0/4064653447 shutdown_connections 2024-09-17T03:38:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.469+0000 7fd6a305c640 1 -- 172.21.15.146:0/4064653447 >> 172.21.15.146:0/4064653447 conn(0x7fd69c0b3150 msgr2=0x7fd69c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.469+0000 7fd6a305c640 1 -- 172.21.15.146:0/4064653447 shutdown_connections 2024-09-17T03:38:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.469+0000 7fd6a305c640 1 -- 172.21.15.146:0/4064653447 wait complete. 2024-09-17T03:38:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.471+0000 7fd6a305c640 1 Processor -- start 2024-09-17T03:38:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.471+0000 7fd6a305c640 1 -- start start 2024-09-17T03:38:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.472+0000 7fd6a305c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd688004d40 0x7fd69c1f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.472+0000 7fd6a305c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd69c1f64d0 0x7fd69c14a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.472+0000 7fd6a305c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c14b040 0x7fd69c150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.472+0000 7fd6a305c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c0b5cb0 con 0x7fd69c14b040 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.472+0000 7fd6a305c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c0b5b30 con 0x7fd688004d40 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.472+0000 7fd6a305c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c0b5e30 con 0x7fd69c1f64d0 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.472+0000 7fd6a15f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c14b040 0x7fd69c150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.472+0000 7fd6a15f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c14b040 0x7fd69c150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52830/0 (socket says 172.21.15.146:52830) 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.472+0000 7fd6a15f9640 1 -- 172.21.15.146:0/1294576445 learned_addr learned my addr 172.21.15.146:0/1294576445 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.472+0000 7fd6a0df8640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd688004d40 0x7fd69c1f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.472+0000 7fd69bfff640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd69c1f64d0 0x7fd69c14a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.473+0000 7fd6a15f9640 1 -- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd69c1f64d0 msgr2=0x7fd69c14a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.473+0000 7fd6a15f9640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd69c1f64d0 0x7fd69c14a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.473+0000 7fd6a15f9640 1 -- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd688004d40 msgr2=0x7fd69c1f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.473+0000 7fd6a15f9640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd688004d40 0x7fd69c1f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.473+0000 7fd6a15f9640 1 -- 172.21.15.146:0/1294576445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c0aab10 con 0x7fd69c14b040 2024-09-17T03:38:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.473+0000 7fd6a15f9640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c14b040 0x7fd69c150790 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fd68402a9d0 tx=0x7fd684001480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.473+0000 7fd6997fa640 1 -- 172.21.15.146:0/1294576445 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684044070 con 0x7fd69c14b040 2024-09-17T03:38:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.473+0000 7fd6997fa640 1 -- 172.21.15.146:0/1294576445 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd684038040 con 0x7fd69c14b040 2024-09-17T03:38:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.473+0000 7fd6a305c640 1 -- 172.21.15.146:0/1294576445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69c0aadf0 con 0x7fd69c14b040 2024-09-17T03:38:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.473+0000 7fd6997fa640 1 -- 172.21.15.146:0/1294576445 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684003ca0 con 0x7fd69c14b040 2024-09-17T03:38:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.473+0000 7fd6a305c640 1 -- 172.21.15.146:0/1294576445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69c1f5fb0 con 0x7fd69c14b040 2024-09-17T03:38:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.474+0000 7fd6a305c640 1 -- 172.21.15.146:0/1294576445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69c0aaff0 con 0x7fd69c14b040 2024-09-17T03:38:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.475+0000 7fd6997fa640 1 -- 172.21.15.146:0/1294576445 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd684032430 con 0x7fd69c14b040 2024-09-17T03:38:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.475+0000 7fd6997fa640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd67c078b90 0x7fd67c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.476+0000 7fd6997fa640 1 -- 172.21.15.146:0/1294576445 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fd6840bcbe0 con 0x7fd69c14b040 2024-09-17T03:38:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.476+0000 7fd6a0df8640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd67c078b90 0x7fd67c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.476+0000 7fd6a0df8640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd67c078b90 0x7fd67c07b0a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd694000fd0 tx=0x7fd694006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:30.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.480+0000 7fd6997fa640 1 -- 172.21.15.146:0/1294576445 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd69c0aaff0 con 0x7fd69c14b040 2024-09-17T03:38:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.654+0000 7fd6a305c640 1 -- 172.21.15.146:0/1294576445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd69c0b4ba0 con 0x7fd69c14b040 2024-09-17T03:38:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.656+0000 7fd6997fa640 1 -- 172.21.15.146:0/1294576445 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16727 (secure 0 0 0) 0x7fd684084950 con 0x7fd69c14b040 2024-09-17T03:38:30.656 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:30.656 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:38:28.963075+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:38:25.075763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:38:26.285571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:38:30.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 -- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd67c078b90 msgr2=0x7fd67c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd67c078b90 0x7fd67c07b0a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd694000fd0 tx=0x7fd694006040 comp rx=0 tx=0).stop 2024-09-17T03:38:30.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 -- 172.21.15.146:0/1294576445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c14b040 msgr2=0x7fd69c150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c14b040 0x7fd69c150790 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fd68402a9d0 tx=0x7fd684001480 comp rx=0 tx=0).stop 2024-09-17T03:38:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 -- 172.21.15.146:0/1294576445 shutdown_connections 2024-09-17T03:38:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd67c078b90 0x7fd67c07b0a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd69c14b040 0x7fd69c150790 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd69c1f64d0 0x7fd69c14a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 --2- 172.21.15.146:0/1294576445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd688004d40 0x7fd69c1f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 -- 172.21.15.146:0/1294576445 >> 172.21.15.146:0/1294576445 conn(0x7fd69c0b3150 msgr2=0x7fd69c0b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 -- 172.21.15.146:0/1294576445 shutdown_connections 2024-09-17T03:38:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.658+0000 7fd6a305c640 1 -- 172.21.15.146:0/1294576445 wait complete. 2024-09-17T03:38:30.670 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:38:30.670 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:38:30.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.783+0000 7f1b0c38b640 1 -- 172.21.15.146:0/49002649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b040b5ce0 msgr2=0x7f1b040b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.783+0000 7f1b0c38b640 1 --2- 172.21.15.146:0/49002649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b040b5ce0 0x7f1b040b1320 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009830 tx=0x7f1b0002a510 comp rx=0 tx=0).stop 2024-09-17T03:38:30.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.783+0000 7f1b0c38b640 1 -- 172.21.15.146:0/49002649 shutdown_connections 2024-09-17T03:38:30.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.783+0000 7f1b0c38b640 1 --2- 172.21.15.146:0/49002649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b040b5ce0 0x7f1b040b1320 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.783+0000 7f1b0c38b640 1 -- 172.21.15.146:0/49002649 >> 172.21.15.146:0/49002649 conn(0x7f1b040b7b20 msgr2=0x7f1b0409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:30.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.783+0000 7f1b0c38b640 1 -- 172.21.15.146:0/49002649 shutdown_connections 2024-09-17T03:38:30.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.783+0000 7f1b0c38b640 1 -- 172.21.15.146:0/49002649 wait complete. 2024-09-17T03:38:30.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.785+0000 7f1b0c38b640 1 Processor -- start 2024-09-17T03:38:30.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.785+0000 7f1b0c38b640 1 -- start start 2024-09-17T03:38:30.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0c38b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b040b5750 0x7f1b041546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0c38b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b040b5ce0 0x7f1b04153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0c38b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b041f6e10 0x7f1b041480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0c38b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0415d6e0 con 0x7f1b041f6e10 2024-09-17T03:38:30.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0c38b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0415d560 con 0x7f1b040b5ce0 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0c38b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0415d860 con 0x7f1b040b5750 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0a928640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b041f6e10 0x7f1b041480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0a928640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b041f6e10 0x7f1b041480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52860/0 (socket says 172.21.15.146:52860) 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0a928640 1 -- 172.21.15.146:0/1582705710 learned_addr learned my addr 172.21.15.146:0/1582705710 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b09926640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b040b5ce0 0x7f1b04153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0a127640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b040b5750 0x7f1b041546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0a928640 1 -- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b040b5750 msgr2=0x7f1b041546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0a928640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b040b5750 0x7f1b041546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0a928640 1 -- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b040b5ce0 msgr2=0x7f1b04153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0a928640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b040b5ce0 0x7f1b04153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0a928640 1 -- 172.21.15.146:0/1582705710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b041f7540 con 0x7f1b041f6e10 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.786+0000 7f1b0a127640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b040b5750 0x7f1b041546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:30.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.787+0000 7f1b0a928640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b041f6e10 0x7f1b041480d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00ba10 tx=0x7f1afc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:30.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.787+0000 7f1afaffd640 1 -- 172.21.15.146:0/1582705710 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc019070 con 0x7f1b041f6e10 2024-09-17T03:38:30.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.787+0000 7f1afaffd640 1 -- 172.21.15.146:0/1582705710 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1afc00cc30 con 0x7f1b041f6e10 2024-09-17T03:38:30.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.787+0000 7f1b0c38b640 1 -- 172.21.15.146:0/1582705710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b041f7820 con 0x7f1b041f6e10 2024-09-17T03:38:30.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.787+0000 7f1afaffd640 1 -- 172.21.15.146:0/1582705710 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc00ce60 con 0x7f1b041f6e10 2024-09-17T03:38:30.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.787+0000 7f1b0c38b640 1 -- 172.21.15.146:0/1582705710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b041f3a10 con 0x7f1b041f6e10 2024-09-17T03:38:30.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.788+0000 7f1b0c38b640 1 -- 172.21.15.146:0/1582705710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b041f72b0 con 0x7f1b041f6e10 2024-09-17T03:38:30.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.789+0000 7f1afaffd640 1 -- 172.21.15.146:0/1582705710 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1afc01c070 con 0x7f1b041f6e10 2024-09-17T03:38:30.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.789+0000 7f1afaffd640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ae8078b90 0x7f1ae807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:30.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.789+0000 7f1afaffd640 1 -- 172.21.15.146:0/1582705710 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1afc09aa10 con 0x7f1b041f6e10 2024-09-17T03:38:30.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.789+0000 7f1b0a127640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ae8078b90 0x7f1ae807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:30.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.790+0000 7f1b0a127640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ae8078b90 0x7f1ae807b0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1b00034000 tx=0x7f1b00004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:30.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.793+0000 7f1afaffd640 1 -- 172.21.15.146:0/1582705710 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1afc062780 con 0x7f1b041f6e10 2024-09-17T03:38:30.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.965+0000 7f1b0c38b640 1 -- 172.21.15.146:0/1582705710 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b041f7d40 con 0x7f1ae8078b90 2024-09-17T03:38:30.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.970+0000 7f1afaffd640 1 -- 172.21.15.146:0/1582705710 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251638 (secure 0 0 0) 0x7f1b041f7d40 con 0x7f1ae8078b90 2024-09-17T03:38:30.973 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:30.974 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 -- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ae8078b90 msgr2=0x7f1ae807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ae8078b90 0x7f1ae807b0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1b00034000 tx=0x7f1b00004730 comp rx=0 tx=0).stop 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 -- 172.21.15.146:0/1582705710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b041f6e10 msgr2=0x7f1b041480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b041f6e10 0x7f1b041480d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00ba10 tx=0x7f1afc00bed0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 -- 172.21.15.146:0/1582705710 shutdown_connections 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ae8078b90 0x7f1ae807b0a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b041f6e10 0x7f1b041480d0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b040b5ce0 0x7f1b04153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 --2- 172.21.15.146:0/1582705710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b040b5750 0x7f1b041546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 -- 172.21.15.146:0/1582705710 >> 172.21.15.146:0/1582705710 conn(0x7f1b040b7b20 msgr2=0x7f1b040b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 -- 172.21.15.146:0/1582705710 shutdown_connections 2024-09-17T03:38:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:30.973+0000 7f1b0c38b640 1 -- 172.21.15.146:0/1582705710 wait complete. 2024-09-17T03:38:30.984 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-17T03:38:29.875997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314680,"kb_used_data":11080,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754660040,"statfs":{"total":773094113280,"available":772771880960,"internally_reserved":0,"allocated":11345920,"data_stored":5577108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":310693425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000926"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261975+0000","last_change":"2024-09-17T03:38:27.989901+0000","last_active":"2024-09-17T03:38:29.261975+0000","last_peered":"2024-09-17T03:38:29.261975+0000","last_clean":"2024-09-17T03:38:29.261975+0000","last_became_active":"2024-09-17T03:38:27.989603+0000","last_became_peered":"2024-09-17T03:38:27.989603+0000","last_unstale":"2024-09-17T03:38:29.261975+0000","last_undegraded":"2024-09-17T03:38:29.261975+0000","last_fullsized":"2024-09-17T03:38:29.261975+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:54.011565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966935+0000","last_change":"2024-09-17T03:38:27.992267+0000","last_active":"2024-09-17T03:38:28.966935+0000","last_peered":"2024-09-17T03:38:28.966935+0000","last_clean":"2024-09-17T03:38:28.966935+0000","last_became_active":"2024-09-17T03:38:27.991901+0000","last_became_peered":"2024-09-17T03:38:27.991901+0000","last_unstale":"2024-09-17T03:38:28.966935+0000","last_undegraded":"2024-09-17T03:38:28.966935+0000","last_fullsized":"2024-09-17T03:38:28.966935+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:24.599439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262208+0000","last_change":"2024-09-17T03:38:27.988024+0000","last_active":"2024-09-17T03:38:29.262208+0000","last_peered":"2024-09-17T03:38:29.262208+0000","last_clean":"2024-09-17T03:38:29.262208+0000","last_became_active":"2024-09-17T03:38:27.987731+0000","last_became_peered":"2024-09-17T03:38:27.987731+0000","last_unstale":"2024-09-17T03:38:29.262208+0000","last_undegraded":"2024-09-17T03:38:29.262208+0000","last_fullsized":"2024-09-17T03:38:29.262208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:38.796206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.958780+0000","last_change":"2024-09-17T03:38:26.958780+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.958780+0000","last_undegraded":"2024-09-17T03:38:26.958780+0000","last_fullsized":"2024-09-17T03:38:26.958780+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968541+0000","last_change":"2024-09-17T03:38:27.993810+0000","last_active":"2024-09-17T03:38:28.968541+0000","last_peered":"2024-09-17T03:38:28.968541+0000","last_clean":"2024-09-17T03:38:28.968541+0000","last_became_active":"2024-09-17T03:38:27.993446+0000","last_became_peered":"2024-09-17T03:38:27.993446+0000","last_unstale":"2024-09-17T03:38:28.968541+0000","last_undegraded":"2024-09-17T03:38:28.968541+0000","last_fullsized":"2024-09-17T03:38:28.968541+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:42.250236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005643+0000","last_change":"2024-09-17T03:38:27.988181+0000","last_active":"2024-09-17T03:38:29.005643+0000","last_peered":"2024-09-17T03:38:29.005643+0000","last_clean":"2024-09-17T03:38:29.005643+0000","last_became_active":"2024-09-17T03:38:27.987858+0000","last_became_peered":"2024-09-17T03:38:27.987858+0000","last_unstale":"2024-09-17T03:38:29.005643+0000","last_undegraded":"2024-09-17T03:38:29.005643+0000","last_fullsized":"2024-09-17T03:38:29.005643+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:55.651386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005728+0000","last_change":"2024-09-17T03:38:27.988069+0000","last_active":"2024-09-17T03:38:29.005728+0000","last_peered":"2024-09-17T03:38:29.005728+0000","last_clean":"2024-09-17T03:38:29.005728+0000","last_became_active":"2024-09-17T03:38:27.987720+0000","last_became_peered":"2024-09-17T03:38:27.987720+0000","last_unstale":"2024-09-17T03:38:29.005728+0000","last_undegraded":"2024-09-17T03:38:29.005728+0000","last_fullsized":"2024-09-17T03:38:29.005728+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:18.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966482+0000","last_change":"2024-09-17T03:38:27.991610+0000","last_active":"2024-09-17T03:38:28.966482+0000","last_peered":"2024-09-17T03:38:28.966482+0000","last_clean":"2024-09-17T03:38:28.966482+0000","last_became_active":"2024-09-17T03:38:27.990044+0000","last_became_peered":"2024-09-17T03:38:27.990044+0000","last_unstale":"2024-09-17T03:38:28.966482+0000","last_undegraded":"2024-09-17T03:38:28.966482+0000","last_fullsized":"2024-09-17T03:38:28.966482+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:18.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968354+0000","last_change":"2024-09-17T03:38:27.993162+0000","last_active":"2024-09-17T03:38:28.968354+0000","last_peered":"2024-09-17T03:38:28.968354+0000","last_clean":"2024-09-17T03:38:28.968354+0000","last_became_active":"2024-09-17T03:38:27.992585+0000","last_became_peered":"2024-09-17T03:38:27.992585+0000","last_unstale":"2024-09-17T03:38:28.968354+0000","last_undegraded":"2024-09-17T03:38:28.968354+0000","last_fullsized":"2024-09-17T03:38:28.968354+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:38.584725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968584+0000","last_change":"2024-09-17T03:38:27.985267+0000","last_active":"2024-09-17T03:38:28.968584+0000","last_peered":"2024-09-17T03:38:28.968584+0000","last_clean":"2024-09-17T03:38:28.968584+0000","last_became_active":"2024-09-17T03:38:27.984946+0000","last_became_peered":"2024-09-17T03:38:27.984946+0000","last_unstale":"2024-09-17T03:38:28.968584+0000","last_undegraded":"2024-09-17T03:38:28.968584+0000","last_fullsized":"2024-09-17T03:38:28.968584+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:33.593178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005592+0000","last_change":"2024-09-17T03:38:27.986243+0000","last_active":"2024-09-17T03:38:29.005592+0000","last_peered":"2024-09-17T03:38:29.005592+0000","last_clean":"2024-09-17T03:38:29.005592+0000","last_became_active":"2024-09-17T03:38:27.985875+0000","last_became_peered":"2024-09-17T03:38:27.985875+0000","last_unstale":"2024-09-17T03:38:29.005592+0000","last_undegraded":"2024-09-17T03:38:29.005592+0000","last_fullsized":"2024-09-17T03:38:29.005592+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:57.833285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968135+0000","last_change":"2024-09-17T03:38:27.991607+0000","last_active":"2024-09-17T03:38:28.968135+0000","last_peered":"2024-09-17T03:38:28.968135+0000","last_clean":"2024-09-17T03:38:28.968135+0000","last_became_active":"2024-09-17T03:38:27.991049+0000","last_became_peered":"2024-09-17T03:38:27.991049+0000","last_unstale":"2024-09-17T03:38:28.968135+0000","last_undegraded":"2024-09-17T03:38:28.968135+0000","last_fullsized":"2024-09-17T03:38:28.968135+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:58.834471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959408+0000","last_change":"2024-09-17T03:38:26.959408+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959408+0000","last_undegraded":"2024-09-17T03:38:26.959408+0000","last_fullsized":"2024-09-17T03:38:26.959408+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191984+0000","last_change":"2024-09-17T03:38:27.988373+0000","last_active":"2024-09-17T03:38:29.191984+0000","last_peered":"2024-09-17T03:38:29.191984+0000","last_clean":"2024-09-17T03:38:29.191984+0000","last_became_active":"2024-09-17T03:38:27.988091+0000","last_became_peered":"2024-09-17T03:38:27.988091+0000","last_unstale":"2024-09-17T03:38:29.191984+0000","last_undegraded":"2024-09-17T03:38:29.191984+0000","last_fullsized":"2024-09-17T03:38:29.191984+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.485809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960995+0000","last_change":"2024-09-17T03:38:26.960995+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960995+0000","last_undegraded":"2024-09-17T03:38:26.960995+0000","last_fullsized":"2024-09-17T03:38:26.960995+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005545+0000","last_change":"2024-09-17T03:38:27.990603+0000","last_active":"2024-09-17T03:38:29.005545+0000","last_peered":"2024-09-17T03:38:29.005545+0000","last_clean":"2024-09-17T03:38:29.005545+0000","last_became_active":"2024-09-17T03:38:27.990229+0000","last_became_peered":"2024-09-17T03:38:27.990229+0000","last_unstale":"2024-09-17T03:38:29.005545+0000","last_undegraded":"2024-09-17T03:38:29.005545+0000","last_fullsized":"2024-09-17T03:38:29.005545+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:31.242849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966926+0000","last_change":"2024-09-17T03:38:27.992645+0000","last_active":"2024-09-17T03:38:28.966926+0000","last_peered":"2024-09-17T03:38:28.966926+0000","last_clean":"2024-09-17T03:38:28.966926+0000","last_became_active":"2024-09-17T03:38:27.992350+0000","last_became_peered":"2024-09-17T03:38:27.992350+0000","last_unstale":"2024-09-17T03:38:28.966926+0000","last_undegraded":"2024-09-17T03:38:28.966926+0000","last_fullsized":"2024-09-17T03:38:28.966926+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:55.651386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960276+0000","last_change":"2024-09-17T03:38:26.960276+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960276+0000","last_undegraded":"2024-09-17T03:38:26.960276+0000","last_fullsized":"2024-09-17T03:38:26.960276+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191664+0000","last_change":"2024-09-17T03:38:27.991367+0000","last_active":"2024-09-17T03:38:29.191664+0000","last_peered":"2024-09-17T03:38:29.191664+0000","last_clean":"2024-09-17T03:38:29.191664+0000","last_became_active":"2024-09-17T03:38:27.991060+0000","last_became_peered":"2024-09-17T03:38:27.991060+0000","last_unstale":"2024-09-17T03:38:29.191664+0000","last_undegraded":"2024-09-17T03:38:29.191664+0000","last_fullsized":"2024-09-17T03:38:29.191664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:00.999192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968504+0000","last_change":"2024-09-17T03:38:27.992955+0000","last_active":"2024-09-17T03:38:28.968504+0000","last_peered":"2024-09-17T03:38:28.968504+0000","last_clean":"2024-09-17T03:38:28.968504+0000","last_became_active":"2024-09-17T03:38:27.992544+0000","last_became_peered":"2024-09-17T03:38:27.992544+0000","last_unstale":"2024-09-17T03:38:28.968504+0000","last_undegraded":"2024-09-17T03:38:28.968504+0000","last_fullsized":"2024-09-17T03:38:28.968504+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:44.129667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191473+0000","last_change":"2024-09-17T03:38:27.988660+0000","last_active":"2024-09-17T03:38:29.191473+0000","last_peered":"2024-09-17T03:38:29.191473+0000","last_clean":"2024-09-17T03:38:29.191473+0000","last_became_active":"2024-09-17T03:38:27.988148+0000","last_became_peered":"2024-09-17T03:38:27.988148+0000","last_unstale":"2024-09-17T03:38:29.191473+0000","last_undegraded":"2024-09-17T03:38:29.191473+0000","last_fullsized":"2024-09-17T03:38:29.191473+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:59.883971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966458+0000","last_change":"2024-09-17T03:38:27.982263+0000","last_active":"2024-09-17T03:38:28.966458+0000","last_peered":"2024-09-17T03:38:28.966458+0000","last_clean":"2024-09-17T03:38:28.966458+0000","last_became_active":"2024-09-17T03:38:27.981955+0000","last_became_peered":"2024-09-17T03:38:27.981955+0000","last_unstale":"2024-09-17T03:38:28.966458+0000","last_undegraded":"2024-09-17T03:38:28.966458+0000","last_fullsized":"2024-09-17T03:38:28.966458+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:31.242849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966460+0000","last_change":"2024-09-17T03:38:27.993047+0000","last_active":"2024-09-17T03:38:28.966460+0000","last_peered":"2024-09-17T03:38:28.966460+0000","last_clean":"2024-09-17T03:38:28.966460+0000","last_became_active":"2024-09-17T03:38:27.992749+0000","last_became_peered":"2024-09-17T03:38:27.992749+0000","last_unstale":"2024-09-17T03:38:28.966460+0000","last_undegraded":"2024-09-17T03:38:28.966460+0000","last_fullsized":"2024-09-17T03:38:28.966460+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:54.635556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005751+0000","last_change":"2024-09-17T03:38:27.991865+0000","last_active":"2024-09-17T03:38:29.005751+0000","last_peered":"2024-09-17T03:38:29.005751+0000","last_clean":"2024-09-17T03:38:29.005751+0000","last_became_active":"2024-09-17T03:38:27.991014+0000","last_became_peered":"2024-09-17T03:38:27.991014+0000","last_unstale":"2024-09-17T03:38:29.005751+0000","last_undegraded":"2024-09-17T03:38:29.005751+0000","last_fullsized":"2024-09-17T03:38:29.005751+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:05.316147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969343+0000","last_change":"2024-09-17T03:38:27.977682+0000","last_active":"2024-09-17T03:38:28.969343+0000","last_peered":"2024-09-17T03:38:28.969343+0000","last_clean":"2024-09-17T03:38:28.969343+0000","last_became_active":"2024-09-17T03:38:27.974243+0000","last_became_peered":"2024-09-17T03:38:27.974243+0000","last_unstale":"2024-09-17T03:38:28.969343+0000","last_undegraded":"2024-09-17T03:38:28.969343+0000","last_fullsized":"2024-09-17T03:38:28.969343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:12.240397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966965+0000","last_change":"2024-09-17T03:38:27.987923+0000","last_active":"2024-09-17T03:38:28.966965+0000","last_peered":"2024-09-17T03:38:28.966965+0000","last_clean":"2024-09-17T03:38:28.966965+0000","last_became_active":"2024-09-17T03:38:27.987631+0000","last_became_peered":"2024-09-17T03:38:27.987631+0000","last_unstale":"2024-09-17T03:38:28.966965+0000","last_undegraded":"2024-09-17T03:38:28.966965+0000","last_fullsized":"2024-09-17T03:38:28.966965+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:46.786919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005825+0000","last_change":"2024-09-17T03:38:27.983480+0000","last_active":"2024-09-17T03:38:29.005825+0000","last_peered":"2024-09-17T03:38:29.005825+0000","last_clean":"2024-09-17T03:38:29.005825+0000","last_became_active":"2024-09-17T03:38:27.983180+0000","last_became_peered":"2024-09-17T03:38:27.983180+0000","last_unstale":"2024-09-17T03:38:29.005825+0000","last_undegraded":"2024-09-17T03:38:29.005825+0000","last_fullsized":"2024-09-17T03:38:29.005825+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:50.337088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969070+0000","last_change":"2024-09-17T03:38:27.994341+0000","last_active":"2024-09-17T03:38:28.969070+0000","last_peered":"2024-09-17T03:38:28.969070+0000","last_clean":"2024-09-17T03:38:28.969070+0000","last_became_active":"2024-09-17T03:38:27.993635+0000","last_became_peered":"2024-09-17T03:38:27.993635+0000","last_unstale":"2024-09-17T03:38:28.969070+0000","last_undegraded":"2024-09-17T03:38:28.969070+0000","last_fullsized":"2024-09-17T03:38:28.969070+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:44.101251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966630+0000","last_change":"2024-09-17T03:38:27.984348+0000","last_active":"2024-09-17T03:38:28.966630+0000","last_peered":"2024-09-17T03:38:28.966630+0000","last_clean":"2024-09-17T03:38:28.966630+0000","last_became_active":"2024-09-17T03:38:27.984035+0000","last_became_peered":"2024-09-17T03:38:27.984035+0000","last_unstale":"2024-09-17T03:38:28.966630+0000","last_undegraded":"2024-09-17T03:38:28.966630+0000","last_fullsized":"2024-09-17T03:38:28.966630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:22.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191435+0000","last_change":"2024-09-17T03:38:27.992196+0000","last_active":"2024-09-17T03:38:29.191435+0000","last_peered":"2024-09-17T03:38:29.191435+0000","last_clean":"2024-09-17T03:38:29.191435+0000","last_became_active":"2024-09-17T03:38:27.991893+0000","last_became_peered":"2024-09-17T03:38:27.991893+0000","last_unstale":"2024-09-17T03:38:29.191435+0000","last_undegraded":"2024-09-17T03:38:29.191435+0000","last_fullsized":"2024-09-17T03:38:29.191435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:19.530780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960203+0000","last_change":"2024-09-17T03:38:26.960203+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960203+0000","last_undegraded":"2024-09-17T03:38:26.960203+0000","last_fullsized":"2024-09-17T03:38:26.960203+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261054+0000","last_change":"2024-09-17T03:38:27.983421+0000","last_active":"2024-09-17T03:38:29.261054+0000","last_peered":"2024-09-17T03:38:29.261054+0000","last_clean":"2024-09-17T03:38:29.261054+0000","last_became_active":"2024-09-17T03:38:27.982752+0000","last_became_peered":"2024-09-17T03:38:27.982752+0000","last_unstale":"2024-09-17T03:38:29.261054+0000","last_undegraded":"2024-09-17T03:38:29.261054+0000","last_fullsized":"2024-09-17T03:38:29.261054+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:38.478741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191740+0000","last_change":"2024-09-17T03:38:27.990173+0000","last_active":"2024-09-17T03:38:29.191740+0000","last_peered":"2024-09-17T03:38:29.191740+0000","last_clean":"2024-09-17T03:38:29.191740+0000","last_became_active":"2024-09-17T03:38:27.989859+0000","last_became_peered":"2024-09-17T03:38:27.989859+0000","last_unstale":"2024-09-17T03:38:29.191740+0000","last_undegraded":"2024-09-17T03:38:29.191740+0000","last_fullsized":"2024-09-17T03:38:29.191740+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:00.044654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"103'4","reported_seq":19,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966829+0000","last_change":"2024-09-17T03:38:26.968498+0000","last_active":"2024-09-17T03:38:28.966829+0000","last_peered":"2024-09-17T03:38:28.966829+0000","last_clean":"2024-09-17T03:38:28.966829+0000","last_became_active":"2024-09-17T03:38:26.967685+0000","last_became_peered":"2024-09-17T03:38:26.967685+0000","last_unstale":"2024-09-17T03:38:28.966829+0000","last_undegraded":"2024-09-17T03:38:28.966829+0000","last_fullsized":"2024-09-17T03:38:28.966829+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:59.918075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959494+0000","last_change":"2024-09-17T03:38:26.959494+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959494+0000","last_undegraded":"2024-09-17T03:38:26.959494+0000","last_fullsized":"2024-09-17T03:38:26.959494+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005777+0000","last_change":"2024-09-17T03:38:26.978065+0000","last_active":"2024-09-17T03:38:29.005777+0000","last_peered":"2024-09-17T03:38:29.005777+0000","last_clean":"2024-09-17T03:38:29.005777+0000","last_became_active":"2024-09-17T03:38:26.977760+0000","last_became_peered":"2024-09-17T03:38:26.977760+0000","last_unstale":"2024-09-17T03:38:29.005777+0000","last_undegraded":"2024-09-17T03:38:29.005777+0000","last_fullsized":"2024-09-17T03:38:29.005777+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:59.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262053+0000","last_change":"2024-09-17T03:38:27.990981+0000","last_active":"2024-09-17T03:38:29.262053+0000","last_peered":"2024-09-17T03:38:29.262053+0000","last_clean":"2024-09-17T03:38:29.262053+0000","last_became_active":"2024-09-17T03:38:27.990155+0000","last_became_peered":"2024-09-17T03:38:27.990155+0000","last_unstale":"2024-09-17T03:38:29.262053+0000","last_undegraded":"2024-09-17T03:38:29.262053+0000","last_fullsized":"2024-09-17T03:38:29.262053+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:14.288116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966484+0000","last_change":"2024-09-17T03:38:26.972883+0000","last_active":"2024-09-17T03:38:28.966484+0000","last_peered":"2024-09-17T03:38:28.966484+0000","last_clean":"2024-09-17T03:38:28.966484+0000","last_became_active":"2024-09-17T03:38:26.972316+0000","last_became_peered":"2024-09-17T03:38:26.972316+0000","last_unstale":"2024-09-17T03:38:28.966484+0000","last_undegraded":"2024-09-17T03:38:28.966484+0000","last_fullsized":"2024-09-17T03:38:28.966484+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:43.780561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968147+0000","last_change":"2024-09-17T03:38:27.988250+0000","last_active":"2024-09-17T03:38:28.968147+0000","last_peered":"2024-09-17T03:38:28.968147+0000","last_clean":"2024-09-17T03:38:28.968147+0000","last_became_active":"2024-09-17T03:38:27.987938+0000","last_became_peered":"2024-09-17T03:38:27.987938+0000","last_unstale":"2024-09-17T03:38:28.968147+0000","last_undegraded":"2024-09-17T03:38:28.968147+0000","last_fullsized":"2024-09-17T03:38:28.968147+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:52.687194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966709+0000","last_change":"2024-09-17T03:38:26.967614+0000","last_active":"2024-09-17T03:38:28.966709+0000","last_peered":"2024-09-17T03:38:28.966709+0000","last_clean":"2024-09-17T03:38:28.966709+0000","last_became_active":"2024-09-17T03:38:26.967289+0000","last_became_peered":"2024-09-17T03:38:26.967289+0000","last_unstale":"2024-09-17T03:38:28.966709+0000","last_undegraded":"2024-09-17T03:38:28.966709+0000","last_fullsized":"2024-09-17T03:38:28.966709+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:26.552522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.967177+0000","last_change":"2024-09-17T03:38:26.967177+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.967177+0000","last_undegraded":"2024-09-17T03:38:26.967177+0000","last_fullsized":"2024-09-17T03:38:26.967177+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262081+0000","last_change":"2024-09-17T03:38:26.971419+0000","last_active":"2024-09-17T03:38:29.262081+0000","last_peered":"2024-09-17T03:38:29.262081+0000","last_clean":"2024-09-17T03:38:29.262081+0000","last_became_active":"2024-09-17T03:38:26.971104+0000","last_became_peered":"2024-09-17T03:38:26.971104+0000","last_unstale":"2024-09-17T03:38:29.262081+0000","last_undegraded":"2024-09-17T03:38:29.262081+0000","last_fullsized":"2024-09-17T03:38:29.262081+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:17.356881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005582+0000","last_change":"2024-09-17T03:38:27.983933+0000","last_active":"2024-09-17T03:38:29.005582+0000","last_peered":"2024-09-17T03:38:29.005582+0000","last_clean":"2024-09-17T03:38:29.005582+0000","last_became_active":"2024-09-17T03:38:27.983619+0000","last_became_peered":"2024-09-17T03:38:27.983619+0000","last_unstale":"2024-09-17T03:38:29.005582+0000","last_undegraded":"2024-09-17T03:38:29.005582+0000","last_fullsized":"2024-09-17T03:38:29.005582+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:33.661852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966904+0000","last_change":"2024-09-17T03:38:26.975874+0000","last_active":"2024-09-17T03:38:28.966904+0000","last_peered":"2024-09-17T03:38:28.966904+0000","last_clean":"2024-09-17T03:38:28.966904+0000","last_became_active":"2024-09-17T03:38:26.975546+0000","last_became_peered":"2024-09-17T03:38:26.975546+0000","last_unstale":"2024-09-17T03:38:28.966904+0000","last_undegraded":"2024-09-17T03:38:28.966904+0000","last_fullsized":"2024-09-17T03:38:28.966904+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:25.915484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959308+0000","last_change":"2024-09-17T03:38:26.959308+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959308+0000","last_undegraded":"2024-09-17T03:38:26.959308+0000","last_fullsized":"2024-09-17T03:38:26.959308+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967993+0000","last_change":"2024-09-17T03:38:26.968875+0000","last_active":"2024-09-17T03:38:28.967993+0000","last_peered":"2024-09-17T03:38:28.967993+0000","last_clean":"2024-09-17T03:38:28.967993+0000","last_became_active":"2024-09-17T03:38:26.968513+0000","last_became_peered":"2024-09-17T03:38:26.968513+0000","last_unstale":"2024-09-17T03:38:28.967993+0000","last_undegraded":"2024-09-17T03:38:28.967993+0000","last_fullsized":"2024-09-17T03:38:28.967993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:22.278430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968198+0000","last_change":"2024-09-17T03:38:27.987700+0000","last_active":"2024-09-17T03:38:28.968198+0000","last_peered":"2024-09-17T03:38:28.968198+0000","last_clean":"2024-09-17T03:38:28.968198+0000","last_became_active":"2024-09-17T03:38:27.987324+0000","last_became_peered":"2024-09-17T03:38:27.987324+0000","last_unstale":"2024-09-17T03:38:28.968198+0000","last_undegraded":"2024-09-17T03:38:28.968198+0000","last_fullsized":"2024-09-17T03:38:28.968198+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:52.164705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261246+0000","last_change":"2024-09-17T03:38:26.970105+0000","last_active":"2024-09-17T03:38:29.261246+0000","last_peered":"2024-09-17T03:38:29.261246+0000","last_clean":"2024-09-17T03:38:29.261246+0000","last_became_active":"2024-09-17T03:38:26.969797+0000","last_became_peered":"2024-09-17T03:38:26.969797+0000","last_unstale":"2024-09-17T03:38:29.261246+0000","last_undegraded":"2024-09-17T03:38:29.261246+0000","last_fullsized":"2024-09-17T03:38:29.261246+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:58.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967075+0000","last_change":"2024-09-17T03:38:27.973929+0000","last_active":"2024-09-17T03:38:28.967075+0000","last_peered":"2024-09-17T03:38:28.967075+0000","last_clean":"2024-09-17T03:38:28.967075+0000","last_became_active":"2024-09-17T03:38:27.973613+0000","last_became_peered":"2024-09-17T03:38:27.973613+0000","last_unstale":"2024-09-17T03:38:28.967075+0000","last_undegraded":"2024-09-17T03:38:28.967075+0000","last_fullsized":"2024-09-17T03:38:28.967075+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:22.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262126+0000","last_change":"2024-09-17T03:38:26.972647+0000","last_active":"2024-09-17T03:38:29.262126+0000","last_peered":"2024-09-17T03:38:29.262126+0000","last_clean":"2024-09-17T03:38:29.262126+0000","last_became_active":"2024-09-17T03:38:26.972292+0000","last_became_peered":"2024-09-17T03:38:26.972292+0000","last_unstale":"2024-09-17T03:38:29.262126+0000","last_undegraded":"2024-09-17T03:38:29.262126+0000","last_fullsized":"2024-09-17T03:38:29.262126+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:37.378067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968189+0000","last_change":"2024-09-17T03:38:27.987131+0000","last_active":"2024-09-17T03:38:28.968189+0000","last_peered":"2024-09-17T03:38:28.968189+0000","last_clean":"2024-09-17T03:38:28.968189+0000","last_became_active":"2024-09-17T03:38:27.985984+0000","last_became_peered":"2024-09-17T03:38:27.985984+0000","last_unstale":"2024-09-17T03:38:28.968189+0000","last_undegraded":"2024-09-17T03:38:28.968189+0000","last_fullsized":"2024-09-17T03:38:28.968189+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:29.538764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.978751+0000","last_change":"2024-09-17T03:38:26.969005+0000","last_active":"2024-09-17T03:38:26.978751+0000","last_peered":"2024-09-17T03:38:26.978751+0000","last_clean":"2024-09-17T03:38:26.978751+0000","last_became_active":"2024-09-17T03:38:26.968705+0000","last_became_peered":"2024-09-17T03:38:26.968705+0000","last_unstale":"2024-09-17T03:38:26.978751+0000","last_undegraded":"2024-09-17T03:38:26.978751+0000","last_fullsized":"2024-09-17T03:38:26.978751+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:56.364923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969036+0000","last_change":"2024-09-17T03:38:27.974699+0000","last_active":"2024-09-17T03:38:28.969036+0000","last_peered":"2024-09-17T03:38:28.969036+0000","last_clean":"2024-09-17T03:38:28.969036+0000","last_became_active":"2024-09-17T03:38:27.974349+0000","last_became_peered":"2024-09-17T03:38:27.974349+0000","last_unstale":"2024-09-17T03:38:28.969036+0000","last_undegraded":"2024-09-17T03:38:28.969036+0000","last_fullsized":"2024-09-17T03:38:28.969036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:35.927783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"103'3","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.006024+0000","last_change":"2024-09-17T03:38:26.976206+0000","last_active":"2024-09-17T03:38:29.006024+0000","last_peered":"2024-09-17T03:38:29.006024+0000","last_clean":"2024-09-17T03:38:29.006024+0000","last_became_active":"2024-09-17T03:38:26.975880+0000","last_became_peered":"2024-09-17T03:38:26.975880+0000","last_unstale":"2024-09-17T03:38:29.006024+0000","last_undegraded":"2024-09-17T03:38:29.006024+0000","last_fullsized":"2024-09-17T03:38:29.006024+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:35.608702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005888+0000","last_change":"2024-09-17T03:38:27.992658+0000","last_active":"2024-09-17T03:38:29.005888+0000","last_peered":"2024-09-17T03:38:29.005888+0000","last_clean":"2024-09-17T03:38:29.005888+0000","last_became_active":"2024-09-17T03:38:27.992329+0000","last_became_peered":"2024-09-17T03:38:27.992329+0000","last_unstale":"2024-09-17T03:38:29.005888+0000","last_undegraded":"2024-09-17T03:38:29.005888+0000","last_fullsized":"2024-09-17T03:38:29.005888+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:49.376138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"103'6","reported_seq":21,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968653+0000","last_change":"2024-09-17T03:38:26.970950+0000","last_active":"2024-09-17T03:38:28.968653+0000","last_peered":"2024-09-17T03:38:28.968653+0000","last_clean":"2024-09-17T03:38:28.968653+0000","last_became_active":"2024-09-17T03:38:26.970571+0000","last_became_peered":"2024-09-17T03:38:26.970571+0000","last_unstale":"2024-09-17T03:38:28.968653+0000","last_undegraded":"2024-09-17T03:38:28.968653+0000","last_fullsized":"2024-09-17T03:38:28.968653+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:19.026536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.958703+0000","last_change":"2024-09-17T03:38:26.958703+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.958703+0000","last_undegraded":"2024-09-17T03:38:26.958703+0000","last_fullsized":"2024-09-17T03:38:26.958703+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191737+0000","last_change":"2024-09-17T03:38:26.974447+0000","last_active":"2024-09-17T03:38:29.191737+0000","last_peered":"2024-09-17T03:38:29.191737+0000","last_clean":"2024-09-17T03:38:29.191737+0000","last_became_active":"2024-09-17T03:38:26.973897+0000","last_became_peered":"2024-09-17T03:38:26.973897+0000","last_unstale":"2024-09-17T03:38:29.191737+0000","last_undegraded":"2024-09-17T03:38:29.191737+0000","last_fullsized":"2024-09-17T03:38:29.191737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:15.443030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261947+0000","last_change":"2024-09-17T03:38:27.990618+0000","last_active":"2024-09-17T03:38:29.261947+0000","last_peered":"2024-09-17T03:38:29.261947+0000","last_clean":"2024-09-17T03:38:29.261947+0000","last_became_active":"2024-09-17T03:38:27.990303+0000","last_became_peered":"2024-09-17T03:38:27.990303+0000","last_unstale":"2024-09-17T03:38:29.261947+0000","last_undegraded":"2024-09-17T03:38:29.261947+0000","last_fullsized":"2024-09-17T03:38:29.261947+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:47.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.192048+0000","last_change":"2024-09-17T03:38:26.974800+0000","last_active":"2024-09-17T03:38:29.192048+0000","last_peered":"2024-09-17T03:38:29.192048+0000","last_clean":"2024-09-17T03:38:29.192048+0000","last_became_active":"2024-09-17T03:38:26.973636+0000","last_became_peered":"2024-09-17T03:38:26.973636+0000","last_unstale":"2024-09-17T03:38:29.192048+0000","last_undegraded":"2024-09-17T03:38:29.192048+0000","last_fullsized":"2024-09-17T03:38:29.192048+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:24.347945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967612+0000","last_change":"2024-09-17T03:38:27.981267+0000","last_active":"2024-09-17T03:38:28.967612+0000","last_peered":"2024-09-17T03:38:28.967612+0000","last_clean":"2024-09-17T03:38:28.967612+0000","last_became_active":"2024-09-17T03:38:27.980948+0000","last_became_peered":"2024-09-17T03:38:27.980948+0000","last_unstale":"2024-09-17T03:38:28.967612+0000","last_undegraded":"2024-09-17T03:38:28.967612+0000","last_fullsized":"2024-09-17T03:38:28.967612+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:00.923679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967685+0000","last_change":"2024-09-17T03:38:26.967641+0000","last_active":"2024-09-17T03:38:28.967685+0000","last_peered":"2024-09-17T03:38:28.967685+0000","last_clean":"2024-09-17T03:38:28.967685+0000","last_became_active":"2024-09-17T03:38:26.967327+0000","last_became_peered":"2024-09-17T03:38:26.967327+0000","last_unstale":"2024-09-17T03:38:28.967685+0000","last_undegraded":"2024-09-17T03:38:28.967685+0000","last_fullsized":"2024-09-17T03:38:28.967685+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:29.998335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191642+0000","last_change":"2024-09-17T03:38:27.996101+0000","last_active":"2024-09-17T03:38:29.191642+0000","last_peered":"2024-09-17T03:38:29.191642+0000","last_clean":"2024-09-17T03:38:29.191642+0000","last_became_active":"2024-09-17T03:38:27.995788+0000","last_became_peered":"2024-09-17T03:38:27.995788+0000","last_unstale":"2024-09-17T03:38:29.191642+0000","last_undegraded":"2024-09-17T03:38:29.191642+0000","last_fullsized":"2024-09-17T03:38:29.191642+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:15.921214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"103'8","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261364+0000","last_change":"2024-09-17T03:38:26.970998+0000","last_active":"2024-09-17T03:38:29.261364+0000","last_peered":"2024-09-17T03:38:29.261364+0000","last_clean":"2024-09-17T03:38:29.261364+0000","last_became_active":"2024-09-17T03:38:26.970693+0000","last_became_peered":"2024-09-17T03:38:26.970693+0000","last_unstale":"2024-09-17T03:38:29.261364+0000","last_undegraded":"2024-09-17T03:38:29.261364+0000","last_fullsized":"2024-09-17T03:38:29.261364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:21.604318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969341+0000","last_change":"2024-09-17T03:38:27.972622+0000","last_active":"2024-09-17T03:38:28.969341+0000","last_peered":"2024-09-17T03:38:28.969341+0000","last_clean":"2024-09-17T03:38:28.969341+0000","last_became_active":"2024-09-17T03:38:27.972170+0000","last_became_peered":"2024-09-17T03:38:27.972170+0000","last_unstale":"2024-09-17T03:38:28.969341+0000","last_undegraded":"2024-09-17T03:38:28.969341+0000","last_fullsized":"2024-09-17T03:38:28.969341+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:42.671301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968039+0000","last_change":"2024-09-17T03:38:26.974319+0000","last_active":"2024-09-17T03:38:28.968039+0000","last_peered":"2024-09-17T03:38:28.968039+0000","last_clean":"2024-09-17T03:38:28.968039+0000","last_became_active":"2024-09-17T03:38:26.974008+0000","last_became_peered":"2024-09-17T03:38:26.974008+0000","last_unstale":"2024-09-17T03:38:28.968039+0000","last_undegraded":"2024-09-17T03:38:28.968039+0000","last_fullsized":"2024-09-17T03:38:28.968039+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:15.506982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.965545+0000","last_change":"2024-09-17T03:38:26.965545+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.965545+0000","last_undegraded":"2024-09-17T03:38:26.965545+0000","last_fullsized":"2024-09-17T03:38:26.965545+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968860+0000","last_change":"2024-09-17T03:38:26.972839+0000","last_active":"2024-09-17T03:38:28.968860+0000","last_peered":"2024-09-17T03:38:28.968860+0000","last_clean":"2024-09-17T03:38:28.968860+0000","last_became_active":"2024-09-17T03:38:26.972478+0000","last_became_peered":"2024-09-17T03:38:26.972478+0000","last_unstale":"2024-09-17T03:38:28.968860+0000","last_undegraded":"2024-09-17T03:38:28.968860+0000","last_fullsized":"2024-09-17T03:38:28.968860+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:36.480429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005983+0000","last_change":"2024-09-17T03:38:27.991905+0000","last_active":"2024-09-17T03:38:29.005983+0000","last_peered":"2024-09-17T03:38:29.005983+0000","last_clean":"2024-09-17T03:38:29.005983+0000","last_became_active":"2024-09-17T03:38:27.991253+0000","last_became_peered":"2024-09-17T03:38:27.991253+0000","last_unstale":"2024-09-17T03:38:29.005983+0000","last_undegraded":"2024-09-17T03:38:29.005983+0000","last_fullsized":"2024-09-17T03:38:29.005983+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:47.703166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966712+0000","last_change":"2024-09-17T03:38:26.966582+0000","last_active":"2024-09-17T03:38:28.966712+0000","last_peered":"2024-09-17T03:38:28.966712+0000","last_clean":"2024-09-17T03:38:28.966712+0000","last_became_active":"2024-09-17T03:38:26.966236+0000","last_became_peered":"2024-09-17T03:38:26.966236+0000","last_unstale":"2024-09-17T03:38:28.966712+0000","last_undegraded":"2024-09-17T03:38:28.966712+0000","last_fullsized":"2024-09-17T03:38:28.966712+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.908196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191936+0000","last_change":"2024-09-17T03:38:27.998470+0000","last_active":"2024-09-17T03:38:29.191936+0000","last_peered":"2024-09-17T03:38:29.191936+0000","last_clean":"2024-09-17T03:38:29.191936+0000","last_became_active":"2024-09-17T03:38:27.998141+0000","last_became_peered":"2024-09-17T03:38:27.998141+0000","last_unstale":"2024-09-17T03:38:29.191936+0000","last_undegraded":"2024-09-17T03:38:29.191936+0000","last_fullsized":"2024-09-17T03:38:29.191936+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:21.927496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966717+0000","last_change":"2024-09-17T03:38:26.976542+0000","last_active":"2024-09-17T03:38:28.966717+0000","last_peered":"2024-09-17T03:38:28.966717+0000","last_clean":"2024-09-17T03:38:28.966717+0000","last_became_active":"2024-09-17T03:38:26.976209+0000","last_became_peered":"2024-09-17T03:38:26.976209+0000","last_unstale":"2024-09-17T03:38:28.966717+0000","last_undegraded":"2024-09-17T03:38:28.966717+0000","last_fullsized":"2024-09-17T03:38:28.966717+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:45.010470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191554+0000","last_change":"2024-09-17T03:38:27.989123+0000","last_active":"2024-09-17T03:38:29.191554+0000","last_peered":"2024-09-17T03:38:29.191554+0000","last_clean":"2024-09-17T03:38:29.191554+0000","last_became_active":"2024-09-17T03:38:27.987713+0000","last_became_peered":"2024-09-17T03:38:27.987713+0000","last_unstale":"2024-09-17T03:38:29.191554+0000","last_undegraded":"2024-09-17T03:38:29.191554+0000","last_fullsized":"2024-09-17T03:38:29.191554+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:59.793518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.974364+0000","last_change":"2024-09-17T03:38:26.973805+0000","last_active":"2024-09-17T03:38:26.974364+0000","last_peered":"2024-09-17T03:38:26.974364+0000","last_clean":"2024-09-17T03:38:26.974364+0000","last_became_active":"2024-09-17T03:38:26.973309+0000","last_became_peered":"2024-09-17T03:38:26.973309+0000","last_unstale":"2024-09-17T03:38:26.974364+0000","last_undegraded":"2024-09-17T03:38:26.974364+0000","last_fullsized":"2024-09-17T03:38:26.974364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:29.550285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191418+0000","last_change":"2024-09-17T03:38:27.998634+0000","last_active":"2024-09-17T03:38:29.191418+0000","last_peered":"2024-09-17T03:38:29.191418+0000","last_clean":"2024-09-17T03:38:29.191418+0000","last_became_active":"2024-09-17T03:38:27.998367+0000","last_became_peered":"2024-09-17T03:38:27.998367+0000","last_unstale":"2024-09-17T03:38:29.191418+0000","last_undegraded":"2024-09-17T03:38:29.191418+0000","last_fullsized":"2024-09-17T03:38:29.191418+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:21.126756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.973606+0000","last_change":"2024-09-17T03:38:26.971443+0000","last_active":"2024-09-17T03:38:26.973606+0000","last_peered":"2024-09-17T03:38:26.973606+0000","last_clean":"2024-09-17T03:38:26.973606+0000","last_became_active":"2024-09-17T03:38:26.971141+0000","last_became_peered":"2024-09-17T03:38:26.971141+0000","last_unstale":"2024-09-17T03:38:26.973606+0000","last_undegraded":"2024-09-17T03:38:26.973606+0000","last_fullsized":"2024-09-17T03:38:26.973606+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:16.383373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967668+0000","last_change":"2024-09-17T03:38:27.982133+0000","last_active":"2024-09-17T03:38:28.967668+0000","last_peered":"2024-09-17T03:38:28.967668+0000","last_clean":"2024-09-17T03:38:28.967668+0000","last_became_active":"2024-09-17T03:38:27.981801+0000","last_became_peered":"2024-09-17T03:38:27.981801+0000","last_unstale":"2024-09-17T03:38:28.967668+0000","last_undegraded":"2024-09-17T03:38:28.967668+0000","last_fullsized":"2024-09-17T03:38:28.967668+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:17.462936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966389+0000","last_change":"2024-09-17T03:38:26.974657+0000","last_active":"2024-09-17T03:38:28.966389+0000","last_peered":"2024-09-17T03:38:28.966389+0000","last_clean":"2024-09-17T03:38:28.966389+0000","last_became_active":"2024-09-17T03:38:26.973955+0000","last_became_peered":"2024-09-17T03:38:26.973955+0000","last_unstale":"2024-09-17T03:38:28.966389+0000","last_undegraded":"2024-09-17T03:38:28.966389+0000","last_fullsized":"2024-09-17T03:38:28.966389+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:23.286979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967097+0000","last_change":"2024-09-17T03:38:27.990530+0000","last_active":"2024-09-17T03:38:28.967097+0000","last_peered":"2024-09-17T03:38:28.967097+0000","last_clean":"2024-09-17T03:38:28.967097+0000","last_became_active":"2024-09-17T03:38:27.990225+0000","last_became_peered":"2024-09-17T03:38:27.990225+0000","last_unstale":"2024-09-17T03:38:28.967097+0000","last_undegraded":"2024-09-17T03:38:28.967097+0000","last_fullsized":"2024-09-17T03:38:28.967097+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:05.637779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.977151+0000","last_change":"2024-09-17T03:38:26.974776+0000","last_active":"2024-09-17T03:38:26.977151+0000","last_peered":"2024-09-17T03:38:26.977151+0000","last_clean":"2024-09-17T03:38:26.977151+0000","last_became_active":"2024-09-17T03:38:26.974459+0000","last_became_peered":"2024-09-17T03:38:26.974459+0000","last_unstale":"2024-09-17T03:38:26.977151+0000","last_undegraded":"2024-09-17T03:38:26.977151+0000","last_fullsized":"2024-09-17T03:38:26.977151+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:40.028883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262162+0000","last_change":"2024-09-17T03:38:27.990635+0000","last_active":"2024-09-17T03:38:29.262162+0000","last_peered":"2024-09-17T03:38:29.262162+0000","last_clean":"2024-09-17T03:38:29.262162+0000","last_became_active":"2024-09-17T03:38:27.990326+0000","last_became_peered":"2024-09-17T03:38:27.990326+0000","last_unstale":"2024-09-17T03:38:29.262162+0000","last_undegraded":"2024-09-17T03:38:29.262162+0000","last_fullsized":"2024-09-17T03:38:29.262162+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:11.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967149+0000","last_change":"2024-09-17T03:38:26.974661+0000","last_active":"2024-09-17T03:38:28.967149+0000","last_peered":"2024-09-17T03:38:28.967149+0000","last_clean":"2024-09-17T03:38:28.967149+0000","last_became_active":"2024-09-17T03:38:26.974345+0000","last_became_peered":"2024-09-17T03:38:26.974345+0000","last_unstale":"2024-09-17T03:38:28.967149+0000","last_undegraded":"2024-09-17T03:38:28.967149+0000","last_fullsized":"2024-09-17T03:38:28.967149+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:59.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262108+0000","last_change":"2024-09-17T03:38:27.983385+0000","last_active":"2024-09-17T03:38:29.262108+0000","last_peered":"2024-09-17T03:38:29.262108+0000","last_clean":"2024-09-17T03:38:29.262108+0000","last_became_active":"2024-09-17T03:38:27.982698+0000","last_became_peered":"2024-09-17T03:38:27.982698+0000","last_unstale":"2024-09-17T03:38:29.262108+0000","last_undegraded":"2024-09-17T03:38:29.262108+0000","last_fullsized":"2024-09-17T03:38:29.262108+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:13.426190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966637+0000","last_change":"2024-09-17T03:38:26.965679+0000","last_active":"2024-09-17T03:38:28.966637+0000","last_peered":"2024-09-17T03:38:28.966637+0000","last_clean":"2024-09-17T03:38:28.966637+0000","last_became_active":"2024-09-17T03:38:26.965356+0000","last_became_peered":"2024-09-17T03:38:26.965356+0000","last_unstale":"2024-09-17T03:38:28.966637+0000","last_undegraded":"2024-09-17T03:38:28.966637+0000","last_fullsized":"2024-09-17T03:38:28.966637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:04.970216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968941+0000","last_change":"2024-09-17T03:38:27.993766+0000","last_active":"2024-09-17T03:38:28.968941+0000","last_peered":"2024-09-17T03:38:28.968941+0000","last_clean":"2024-09-17T03:38:28.968941+0000","last_became_active":"2024-09-17T03:38:27.993432+0000","last_became_peered":"2024-09-17T03:38:27.993432+0000","last_unstale":"2024-09-17T03:38:28.968941+0000","last_undegraded":"2024-09-17T03:38:28.968941+0000","last_fullsized":"2024-09-17T03:38:28.968941+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:45.247320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969217+0000","last_change":"2024-09-17T03:38:26.970931+0000","last_active":"2024-09-17T03:38:28.969217+0000","last_peered":"2024-09-17T03:38:28.969217+0000","last_clean":"2024-09-17T03:38:28.969217+0000","last_became_active":"2024-09-17T03:38:26.970604+0000","last_became_peered":"2024-09-17T03:38:26.970604+0000","last_unstale":"2024-09-17T03:38:28.969217+0000","last_undegraded":"2024-09-17T03:38:28.969217+0000","last_fullsized":"2024-09-17T03:38:28.969217+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:52.328415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.192172+0000","last_change":"2024-09-17T03:38:27.994165+0000","last_active":"2024-09-17T03:38:29.192172+0000","last_peered":"2024-09-17T03:38:29.192172+0000","last_clean":"2024-09-17T03:38:29.192172+0000","last_became_active":"2024-09-17T03:38:27.993861+0000","last_became_peered":"2024-09-17T03:38:27.993861+0000","last_unstale":"2024-09-17T03:38:29.192172+0000","last_undegraded":"2024-09-17T03:38:29.192172+0000","last_fullsized":"2024-09-17T03:38:29.192172+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:33.720992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966741+0000","last_change":"2024-09-17T03:38:26.970499+0000","last_active":"2024-09-17T03:38:28.966741+0000","last_peered":"2024-09-17T03:38:28.966741+0000","last_clean":"2024-09-17T03:38:28.966741+0000","last_became_active":"2024-09-17T03:38:26.970128+0000","last_became_peered":"2024-09-17T03:38:26.970128+0000","last_unstale":"2024-09-17T03:38:28.966741+0000","last_undegraded":"2024-09-17T03:38:28.966741+0000","last_fullsized":"2024-09-17T03:38:28.966741+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:43.177282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967999+0000","last_change":"2024-09-17T03:38:27.971482+0000","last_active":"2024-09-17T03:38:28.967999+0000","last_peered":"2024-09-17T03:38:28.967999+0000","last_clean":"2024-09-17T03:38:28.967999+0000","last_became_active":"2024-09-17T03:38:27.971124+0000","last_became_peered":"2024-09-17T03:38:27.971124+0000","last_unstale":"2024-09-17T03:38:28.967999+0000","last_undegraded":"2024-09-17T03:38:28.967999+0000","last_fullsized":"2024-09-17T03:38:28.967999+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:00.365080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968381+0000","last_change":"2024-09-17T03:38:26.974041+0000","last_active":"2024-09-17T03:38:28.968381+0000","last_peered":"2024-09-17T03:38:28.968381+0000","last_clean":"2024-09-17T03:38:28.968381+0000","last_became_active":"2024-09-17T03:38:26.973115+0000","last_became_peered":"2024-09-17T03:38:26.973115+0000","last_unstale":"2024-09-17T03:38:28.968381+0000","last_undegraded":"2024-09-17T03:38:28.968381+0000","last_fullsized":"2024-09-17T03:38:28.968381+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:33.987282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191435+0000","last_change":"2024-09-17T03:38:27.996142+0000","last_active":"2024-09-17T03:38:29.191435+0000","last_peered":"2024-09-17T03:38:29.191435+0000","last_clean":"2024-09-17T03:38:29.191435+0000","last_became_active":"2024-09-17T03:38:27.995822+0000","last_became_peered":"2024-09-17T03:38:27.995822+0000","last_unstale":"2024-09-17T03:38:29.191435+0000","last_undegraded":"2024-09-17T03:38:29.191435+0000","last_fullsized":"2024-09-17T03:38:29.191435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:04.315528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.977968+0000","last_change":"2024-09-17T03:38:26.969822+0000","last_active":"2024-09-17T03:38:26.977968+0000","last_peered":"2024-09-17T03:38:26.977968+0000","last_clean":"2024-09-17T03:38:26.977968+0000","last_became_active":"2024-09-17T03:38:26.969461+0000","last_became_peered":"2024-09-17T03:38:26.969461+0000","last_unstale":"2024-09-17T03:38:26.977968+0000","last_undegraded":"2024-09-17T03:38:26.977968+0000","last_fullsized":"2024-09-17T03:38:26.977968+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:34.065975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967882+0000","last_change":"2024-09-17T03:38:27.993971+0000","last_active":"2024-09-17T03:38:28.967882+0000","last_peered":"2024-09-17T03:38:28.967882+0000","last_clean":"2024-09-17T03:38:28.967882+0000","last_became_active":"2024-09-17T03:38:27.993620+0000","last_became_peered":"2024-09-17T03:38:27.993620+0000","last_unstale":"2024-09-17T03:38:28.967882+0000","last_undegraded":"2024-09-17T03:38:28.967882+0000","last_fullsized":"2024-09-17T03:38:28.967882+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:44.121364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191565+0000","last_change":"2024-09-17T03:38:26.974988+0000","last_active":"2024-09-17T03:38:29.191565+0000","last_peered":"2024-09-17T03:38:29.191565+0000","last_clean":"2024-09-17T03:38:29.191565+0000","last_became_active":"2024-09-17T03:38:26.974315+0000","last_became_peered":"2024-09-17T03:38:26.974315+0000","last_unstale":"2024-09-17T03:38:29.191565+0000","last_undegraded":"2024-09-17T03:38:29.191565+0000","last_fullsized":"2024-09-17T03:38:29.191565+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:12.754692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191832+0000","last_change":"2024-09-17T03:38:27.998521+0000","last_active":"2024-09-17T03:38:29.191832+0000","last_peered":"2024-09-17T03:38:29.191832+0000","last_clean":"2024-09-17T03:38:29.191832+0000","last_became_active":"2024-09-17T03:38:27.998207+0000","last_became_peered":"2024-09-17T03:38:27.998207+0000","last_unstale":"2024-09-17T03:38:29.191832+0000","last_undegraded":"2024-09-17T03:38:29.191832+0000","last_fullsized":"2024-09-17T03:38:29.191832+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:22.891457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005652+0000","last_change":"2024-09-17T03:38:26.979932+0000","last_active":"2024-09-17T03:38:29.005652+0000","last_peered":"2024-09-17T03:38:29.005652+0000","last_clean":"2024-09-17T03:38:29.005652+0000","last_became_active":"2024-09-17T03:38:26.979630+0000","last_became_peered":"2024-09-17T03:38:26.979630+0000","last_unstale":"2024-09-17T03:38:29.005652+0000","last_undegraded":"2024-09-17T03:38:29.005652+0000","last_fullsized":"2024-09-17T03:38:29.005652+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:59.918075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":261,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005746+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:38:29.005746+0000","last_peered":"2024-09-17T03:38:29.005746+0000","last_clean":"2024-09-17T03:38:29.005746+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:38:29.005746+0000","last_undegraded":"2024-09-17T03:38:29.005746+0000","last_fullsized":"2024-09-17T03:38:29.005746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37184,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334656,"statfs":{"total":96636764160,"available":96598687744,"internally_reserved":0,"allocated":1880064,"data_stored":1146837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40756,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331084,"statfs":{"total":96636764160,"available":96595030016,"internally_reserved":0,"allocated":1273856,"data_stored":550709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40776,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331064,"statfs":{"total":96636764160,"available":96595009536,"internally_reserved":0,"allocated":1298432,"data_stored":558093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36596,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335244,"statfs":{"total":96636764160,"available":96599289856,"internally_reserved":0,"allocated":1269760,"data_stored":550091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40760,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331080,"statfs":{"total":96636764160,"available":96595025920,"internally_reserved":0,"allocated":1277952,"data_stored":556357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37168,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334672,"statfs":{"total":96636764160,"available":96598704128,"internally_reserved":0,"allocated":1863680,"data_stored":1141007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1241088,"data_stored":537007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1241088,"data_stored":537007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:38:30.989 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:38:31.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.138+0000 7f9194bad640 1 -- 172.21.15.146:0/103272122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91900b5750 msgr2=0x7f91900b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.138+0000 7f9194bad640 1 --2- 172.21.15.146:0/103272122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91900b5750 0x7f91900b3620 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f9178009830 tx=0x7f917802a510 comp rx=0 tx=0).stop 2024-09-17T03:38:31.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.138+0000 7f9194bad640 1 -- 172.21.15.146:0/103272122 shutdown_connections 2024-09-17T03:38:31.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.138+0000 7f9194bad640 1 --2- 172.21.15.146:0/103272122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91900b3b60 0x7f919015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.138+0000 7f9194bad640 1 --2- 172.21.15.146:0/103272122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91900b5750 0x7f91900b3620 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.138+0000 7f9194bad640 1 -- 172.21.15.146:0/103272122 >> 172.21.15.146:0/103272122 conn(0x7f91900b7b20 msgr2=0x7f919009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:31.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.138+0000 7f9194bad640 1 -- 172.21.15.146:0/103272122 shutdown_connections 2024-09-17T03:38:31.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.138+0000 7f9194bad640 1 -- 172.21.15.146:0/103272122 wait complete. 2024-09-17T03:38:31.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.140+0000 7f9194bad640 1 Processor -- start 2024-09-17T03:38:31.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.140+0000 7f9194bad640 1 -- start start 2024-09-17T03:38:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.141+0000 7f9194bad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91900b3b60 0x7f919014df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.141+0000 7f9194bad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91900b5750 0x7f9190155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.141+0000 7f9194bad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91900b5ce0 0x7f919015efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.141+0000 7f9194bad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f919015d4b0 con 0x7f91900b5750 2024-09-17T03:38:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.141+0000 7f9194bad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f919015d330 con 0x7f91900b5ce0 2024-09-17T03:38:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.141+0000 7f9194bad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f919015d630 con 0x7f91900b3b60 2024-09-17T03:38:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.141+0000 7f9185d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91900b5750 0x7f9190155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.141+0000 7f9185d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91900b5750 0x7f9190155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52874/0 (socket says 172.21.15.146:52874) 2024-09-17T03:38:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.141+0000 7f9185d9b640 1 -- 172.21.15.146:0/4025886379 learned_addr learned my addr 172.21.15.146:0/4025886379 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.141+0000 7f918ed9d640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91900b5ce0 0x7f919015efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.141+0000 7f918e59c640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91900b3b60 0x7f919014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.142+0000 7f9185d9b640 1 -- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91900b3b60 msgr2=0x7f919014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.142+0000 7f9185d9b640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91900b3b60 0x7f919014df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.142+0000 7f9185d9b640 1 -- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91900b5ce0 msgr2=0x7f919015efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.142+0000 7f9185d9b640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91900b5ce0 0x7f919015efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.142+0000 7f9185d9b640 1 -- 172.21.15.146:0/4025886379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919014e460 con 0x7f91900b5750 2024-09-17T03:38:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.142+0000 7f9185d9b640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91900b5750 0x7f9190155200 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f917802ab00 tx=0x7f9178033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.142+0000 7f91877fe640 1 -- 172.21.15.146:0/4025886379 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178031d60 con 0x7f91900b5750 2024-09-17T03:38:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.142+0000 7f91877fe640 1 -- 172.21.15.146:0/4025886379 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9178033e10 con 0x7f91900b5750 2024-09-17T03:38:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.142+0000 7f91877fe640 1 -- 172.21.15.146:0/4025886379 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178005260 con 0x7f91900b5750 2024-09-17T03:38:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.142+0000 7f9194bad640 1 -- 172.21.15.146:0/4025886379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9190155740 con 0x7f91900b5750 2024-09-17T03:38:31.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.142+0000 7f9194bad640 1 -- 172.21.15.146:0/4025886379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919014f410 con 0x7f91900b5750 2024-09-17T03:38:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.143+0000 7f9194bad640 1 -- 172.21.15.146:0/4025886379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919015dae0 con 0x7f91900b5750 2024-09-17T03:38:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.144+0000 7f91877fe640 1 -- 172.21.15.146:0/4025886379 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9178005400 con 0x7f91900b5750 2024-09-17T03:38:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.144+0000 7f91877fe640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9170078b90 0x7f917007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.144+0000 7f91877fe640 1 -- 172.21.15.146:0/4025886379 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f91780bbe20 con 0x7f91900b5750 2024-09-17T03:38:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.145+0000 7f918e59c640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9170078b90 0x7f917007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.145+0000 7f918e59c640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9170078b90 0x7f917007b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9180000f60 tx=0x7f9180009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.149+0000 7f91877fe640 1 -- 172.21.15.146:0/4025886379 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f917803f030 con 0x7f91900b5750 2024-09-17T03:38:31.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.320+0000 7f9194bad640 1 -- 172.21.15.146:0/4025886379 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9190156160 con 0x7f9170078b90 2024-09-17T03:38:31.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.325+0000 7f91877fe640 1 -- 172.21.15.146:0/4025886379 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251638 (secure 0 0 0) 0x7f9190156160 con 0x7f9170078b90 2024-09-17T03:38:31.327 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:38:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 -- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9170078b90 msgr2=0x7f917007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9170078b90 0x7f917007b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9180000f60 tx=0x7f9180009040 comp rx=0 tx=0).stop 2024-09-17T03:38:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 -- 172.21.15.146:0/4025886379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91900b5750 msgr2=0x7f9190155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91900b5750 0x7f9190155200 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f917802ab00 tx=0x7f9178033c20 comp rx=0 tx=0).stop 2024-09-17T03:38:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 -- 172.21.15.146:0/4025886379 shutdown_connections 2024-09-17T03:38:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9170078b90 0x7f917007b0a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91900b5ce0 0x7f919015efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91900b5750 0x7f9190155200 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 --2- 172.21.15.146:0/4025886379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91900b3b60 0x7f919014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 -- 172.21.15.146:0/4025886379 >> 172.21.15.146:0/4025886379 conn(0x7f91900b7b20 msgr2=0x7f9190156680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 -- 172.21.15.146:0/4025886379 shutdown_connections 2024-09-17T03:38:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.328+0000 7f9194bad640 1 -- 172.21.15.146:0/4025886379 wait complete. 2024-09-17T03:38:31.339 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-17T03:38:29.875997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314680,"kb_used_data":11080,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754660040,"statfs":{"total":773094113280,"available":772771880960,"internally_reserved":0,"allocated":11345920,"data_stored":5577108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":310693425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000926"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261975+0000","last_change":"2024-09-17T03:38:27.989901+0000","last_active":"2024-09-17T03:38:29.261975+0000","last_peered":"2024-09-17T03:38:29.261975+0000","last_clean":"2024-09-17T03:38:29.261975+0000","last_became_active":"2024-09-17T03:38:27.989603+0000","last_became_peered":"2024-09-17T03:38:27.989603+0000","last_unstale":"2024-09-17T03:38:29.261975+0000","last_undegraded":"2024-09-17T03:38:29.261975+0000","last_fullsized":"2024-09-17T03:38:29.261975+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:54.011565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966935+0000","last_change":"2024-09-17T03:38:27.992267+0000","last_active":"2024-09-17T03:38:28.966935+0000","last_peered":"2024-09-17T03:38:28.966935+0000","last_clean":"2024-09-17T03:38:28.966935+0000","last_became_active":"2024-09-17T03:38:27.991901+0000","last_became_peered":"2024-09-17T03:38:27.991901+0000","last_unstale":"2024-09-17T03:38:28.966935+0000","last_undegraded":"2024-09-17T03:38:28.966935+0000","last_fullsized":"2024-09-17T03:38:28.966935+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:24.599439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262208+0000","last_change":"2024-09-17T03:38:27.988024+0000","last_active":"2024-09-17T03:38:29.262208+0000","last_peered":"2024-09-17T03:38:29.262208+0000","last_clean":"2024-09-17T03:38:29.262208+0000","last_became_active":"2024-09-17T03:38:27.987731+0000","last_became_peered":"2024-09-17T03:38:27.987731+0000","last_unstale":"2024-09-17T03:38:29.262208+0000","last_undegraded":"2024-09-17T03:38:29.262208+0000","last_fullsized":"2024-09-17T03:38:29.262208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:38.796206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.958780+0000","last_change":"2024-09-17T03:38:26.958780+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.958780+0000","last_undegraded":"2024-09-17T03:38:26.958780+0000","last_fullsized":"2024-09-17T03:38:26.958780+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968541+0000","last_change":"2024-09-17T03:38:27.993810+0000","last_active":"2024-09-17T03:38:28.968541+0000","last_peered":"2024-09-17T03:38:28.968541+0000","last_clean":"2024-09-17T03:38:28.968541+0000","last_became_active":"2024-09-17T03:38:27.993446+0000","last_became_peered":"2024-09-17T03:38:27.993446+0000","last_unstale":"2024-09-17T03:38:28.968541+0000","last_undegraded":"2024-09-17T03:38:28.968541+0000","last_fullsized":"2024-09-17T03:38:28.968541+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:42.250236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005643+0000","last_change":"2024-09-17T03:38:27.988181+0000","last_active":"2024-09-17T03:38:29.005643+0000","last_peered":"2024-09-17T03:38:29.005643+0000","last_clean":"2024-09-17T03:38:29.005643+0000","last_became_active":"2024-09-17T03:38:27.987858+0000","last_became_peered":"2024-09-17T03:38:27.987858+0000","last_unstale":"2024-09-17T03:38:29.005643+0000","last_undegraded":"2024-09-17T03:38:29.005643+0000","last_fullsized":"2024-09-17T03:38:29.005643+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:55.651386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005728+0000","last_change":"2024-09-17T03:38:27.988069+0000","last_active":"2024-09-17T03:38:29.005728+0000","last_peered":"2024-09-17T03:38:29.005728+0000","last_clean":"2024-09-17T03:38:29.005728+0000","last_became_active":"2024-09-17T03:38:27.987720+0000","last_became_peered":"2024-09-17T03:38:27.987720+0000","last_unstale":"2024-09-17T03:38:29.005728+0000","last_undegraded":"2024-09-17T03:38:29.005728+0000","last_fullsized":"2024-09-17T03:38:29.005728+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:18.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966482+0000","last_change":"2024-09-17T03:38:27.991610+0000","last_active":"2024-09-17T03:38:28.966482+0000","last_peered":"2024-09-17T03:38:28.966482+0000","last_clean":"2024-09-17T03:38:28.966482+0000","last_became_active":"2024-09-17T03:38:27.990044+0000","last_became_peered":"2024-09-17T03:38:27.990044+0000","last_unstale":"2024-09-17T03:38:28.966482+0000","last_undegraded":"2024-09-17T03:38:28.966482+0000","last_fullsized":"2024-09-17T03:38:28.966482+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:18.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968354+0000","last_change":"2024-09-17T03:38:27.993162+0000","last_active":"2024-09-17T03:38:28.968354+0000","last_peered":"2024-09-17T03:38:28.968354+0000","last_clean":"2024-09-17T03:38:28.968354+0000","last_became_active":"2024-09-17T03:38:27.992585+0000","last_became_peered":"2024-09-17T03:38:27.992585+0000","last_unstale":"2024-09-17T03:38:28.968354+0000","last_undegraded":"2024-09-17T03:38:28.968354+0000","last_fullsized":"2024-09-17T03:38:28.968354+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:38.584725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968584+0000","last_change":"2024-09-17T03:38:27.985267+0000","last_active":"2024-09-17T03:38:28.968584+0000","last_peered":"2024-09-17T03:38:28.968584+0000","last_clean":"2024-09-17T03:38:28.968584+0000","last_became_active":"2024-09-17T03:38:27.984946+0000","last_became_peered":"2024-09-17T03:38:27.984946+0000","last_unstale":"2024-09-17T03:38:28.968584+0000","last_undegraded":"2024-09-17T03:38:28.968584+0000","last_fullsized":"2024-09-17T03:38:28.968584+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:33.593178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005592+0000","last_change":"2024-09-17T03:38:27.986243+0000","last_active":"2024-09-17T03:38:29.005592+0000","last_peered":"2024-09-17T03:38:29.005592+0000","last_clean":"2024-09-17T03:38:29.005592+0000","last_became_active":"2024-09-17T03:38:27.985875+0000","last_became_peered":"2024-09-17T03:38:27.985875+0000","last_unstale":"2024-09-17T03:38:29.005592+0000","last_undegraded":"2024-09-17T03:38:29.005592+0000","last_fullsized":"2024-09-17T03:38:29.005592+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:57.833285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968135+0000","last_change":"2024-09-17T03:38:27.991607+0000","last_active":"2024-09-17T03:38:28.968135+0000","last_peered":"2024-09-17T03:38:28.968135+0000","last_clean":"2024-09-17T03:38:28.968135+0000","last_became_active":"2024-09-17T03:38:27.991049+0000","last_became_peered":"2024-09-17T03:38:27.991049+0000","last_unstale":"2024-09-17T03:38:28.968135+0000","last_undegraded":"2024-09-17T03:38:28.968135+0000","last_fullsized":"2024-09-17T03:38:28.968135+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:58.834471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959408+0000","last_change":"2024-09-17T03:38:26.959408+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959408+0000","last_undegraded":"2024-09-17T03:38:26.959408+0000","last_fullsized":"2024-09-17T03:38:26.959408+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191984+0000","last_change":"2024-09-17T03:38:27.988373+0000","last_active":"2024-09-17T03:38:29.191984+0000","last_peered":"2024-09-17T03:38:29.191984+0000","last_clean":"2024-09-17T03:38:29.191984+0000","last_became_active":"2024-09-17T03:38:27.988091+0000","last_became_peered":"2024-09-17T03:38:27.988091+0000","last_unstale":"2024-09-17T03:38:29.191984+0000","last_undegraded":"2024-09-17T03:38:29.191984+0000","last_fullsized":"2024-09-17T03:38:29.191984+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.485809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960995+0000","last_change":"2024-09-17T03:38:26.960995+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960995+0000","last_undegraded":"2024-09-17T03:38:26.960995+0000","last_fullsized":"2024-09-17T03:38:26.960995+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005545+0000","last_change":"2024-09-17T03:38:27.990603+0000","last_active":"2024-09-17T03:38:29.005545+0000","last_peered":"2024-09-17T03:38:29.005545+0000","last_clean":"2024-09-17T03:38:29.005545+0000","last_became_active":"2024-09-17T03:38:27.990229+0000","last_became_peered":"2024-09-17T03:38:27.990229+0000","last_unstale":"2024-09-17T03:38:29.005545+0000","last_undegraded":"2024-09-17T03:38:29.005545+0000","last_fullsized":"2024-09-17T03:38:29.005545+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:31.242849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966926+0000","last_change":"2024-09-17T03:38:27.992645+0000","last_active":"2024-09-17T03:38:28.966926+0000","last_peered":"2024-09-17T03:38:28.966926+0000","last_clean":"2024-09-17T03:38:28.966926+0000","last_became_active":"2024-09-17T03:38:27.992350+0000","last_became_peered":"2024-09-17T03:38:27.992350+0000","last_unstale":"2024-09-17T03:38:28.966926+0000","last_undegraded":"2024-09-17T03:38:28.966926+0000","last_fullsized":"2024-09-17T03:38:28.966926+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:55.651386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960276+0000","last_change":"2024-09-17T03:38:26.960276+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960276+0000","last_undegraded":"2024-09-17T03:38:26.960276+0000","last_fullsized":"2024-09-17T03:38:26.960276+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191664+0000","last_change":"2024-09-17T03:38:27.991367+0000","last_active":"2024-09-17T03:38:29.191664+0000","last_peered":"2024-09-17T03:38:29.191664+0000","last_clean":"2024-09-17T03:38:29.191664+0000","last_became_active":"2024-09-17T03:38:27.991060+0000","last_became_peered":"2024-09-17T03:38:27.991060+0000","last_unstale":"2024-09-17T03:38:29.191664+0000","last_undegraded":"2024-09-17T03:38:29.191664+0000","last_fullsized":"2024-09-17T03:38:29.191664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:00.999192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968504+0000","last_change":"2024-09-17T03:38:27.992955+0000","last_active":"2024-09-17T03:38:28.968504+0000","last_peered":"2024-09-17T03:38:28.968504+0000","last_clean":"2024-09-17T03:38:28.968504+0000","last_became_active":"2024-09-17T03:38:27.992544+0000","last_became_peered":"2024-09-17T03:38:27.992544+0000","last_unstale":"2024-09-17T03:38:28.968504+0000","last_undegraded":"2024-09-17T03:38:28.968504+0000","last_fullsized":"2024-09-17T03:38:28.968504+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:44.129667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191473+0000","last_change":"2024-09-17T03:38:27.988660+0000","last_active":"2024-09-17T03:38:29.191473+0000","last_peered":"2024-09-17T03:38:29.191473+0000","last_clean":"2024-09-17T03:38:29.191473+0000","last_became_active":"2024-09-17T03:38:27.988148+0000","last_became_peered":"2024-09-17T03:38:27.988148+0000","last_unstale":"2024-09-17T03:38:29.191473+0000","last_undegraded":"2024-09-17T03:38:29.191473+0000","last_fullsized":"2024-09-17T03:38:29.191473+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:59.883971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966458+0000","last_change":"2024-09-17T03:38:27.982263+0000","last_active":"2024-09-17T03:38:28.966458+0000","last_peered":"2024-09-17T03:38:28.966458+0000","last_clean":"2024-09-17T03:38:28.966458+0000","last_became_active":"2024-09-17T03:38:27.981955+0000","last_became_peered":"2024-09-17T03:38:27.981955+0000","last_unstale":"2024-09-17T03:38:28.966458+0000","last_undegraded":"2024-09-17T03:38:28.966458+0000","last_fullsized":"2024-09-17T03:38:28.966458+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:31.242849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966460+0000","last_change":"2024-09-17T03:38:27.993047+0000","last_active":"2024-09-17T03:38:28.966460+0000","last_peered":"2024-09-17T03:38:28.966460+0000","last_clean":"2024-09-17T03:38:28.966460+0000","last_became_active":"2024-09-17T03:38:27.992749+0000","last_became_peered":"2024-09-17T03:38:27.992749+0000","last_unstale":"2024-09-17T03:38:28.966460+0000","last_undegraded":"2024-09-17T03:38:28.966460+0000","last_fullsized":"2024-09-17T03:38:28.966460+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:54.635556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005751+0000","last_change":"2024-09-17T03:38:27.991865+0000","last_active":"2024-09-17T03:38:29.005751+0000","last_peered":"2024-09-17T03:38:29.005751+0000","last_clean":"2024-09-17T03:38:29.005751+0000","last_became_active":"2024-09-17T03:38:27.991014+0000","last_became_peered":"2024-09-17T03:38:27.991014+0000","last_unstale":"2024-09-17T03:38:29.005751+0000","last_undegraded":"2024-09-17T03:38:29.005751+0000","last_fullsized":"2024-09-17T03:38:29.005751+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:05.316147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969343+0000","last_change":"2024-09-17T03:38:27.977682+0000","last_active":"2024-09-17T03:38:28.969343+0000","last_peered":"2024-09-17T03:38:28.969343+0000","last_clean":"2024-09-17T03:38:28.969343+0000","last_became_active":"2024-09-17T03:38:27.974243+0000","last_became_peered":"2024-09-17T03:38:27.974243+0000","last_unstale":"2024-09-17T03:38:28.969343+0000","last_undegraded":"2024-09-17T03:38:28.969343+0000","last_fullsized":"2024-09-17T03:38:28.969343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:12.240397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966965+0000","last_change":"2024-09-17T03:38:27.987923+0000","last_active":"2024-09-17T03:38:28.966965+0000","last_peered":"2024-09-17T03:38:28.966965+0000","last_clean":"2024-09-17T03:38:28.966965+0000","last_became_active":"2024-09-17T03:38:27.987631+0000","last_became_peered":"2024-09-17T03:38:27.987631+0000","last_unstale":"2024-09-17T03:38:28.966965+0000","last_undegraded":"2024-09-17T03:38:28.966965+0000","last_fullsized":"2024-09-17T03:38:28.966965+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:46.786919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005825+0000","last_change":"2024-09-17T03:38:27.983480+0000","last_active":"2024-09-17T03:38:29.005825+0000","last_peered":"2024-09-17T03:38:29.005825+0000","last_clean":"2024-09-17T03:38:29.005825+0000","last_became_active":"2024-09-17T03:38:27.983180+0000","last_became_peered":"2024-09-17T03:38:27.983180+0000","last_unstale":"2024-09-17T03:38:29.005825+0000","last_undegraded":"2024-09-17T03:38:29.005825+0000","last_fullsized":"2024-09-17T03:38:29.005825+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:50.337088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969070+0000","last_change":"2024-09-17T03:38:27.994341+0000","last_active":"2024-09-17T03:38:28.969070+0000","last_peered":"2024-09-17T03:38:28.969070+0000","last_clean":"2024-09-17T03:38:28.969070+0000","last_became_active":"2024-09-17T03:38:27.993635+0000","last_became_peered":"2024-09-17T03:38:27.993635+0000","last_unstale":"2024-09-17T03:38:28.969070+0000","last_undegraded":"2024-09-17T03:38:28.969070+0000","last_fullsized":"2024-09-17T03:38:28.969070+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:44.101251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966630+0000","last_change":"2024-09-17T03:38:27.984348+0000","last_active":"2024-09-17T03:38:28.966630+0000","last_peered":"2024-09-17T03:38:28.966630+0000","last_clean":"2024-09-17T03:38:28.966630+0000","last_became_active":"2024-09-17T03:38:27.984035+0000","last_became_peered":"2024-09-17T03:38:27.984035+0000","last_unstale":"2024-09-17T03:38:28.966630+0000","last_undegraded":"2024-09-17T03:38:28.966630+0000","last_fullsized":"2024-09-17T03:38:28.966630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:22.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191435+0000","last_change":"2024-09-17T03:38:27.992196+0000","last_active":"2024-09-17T03:38:29.191435+0000","last_peered":"2024-09-17T03:38:29.191435+0000","last_clean":"2024-09-17T03:38:29.191435+0000","last_became_active":"2024-09-17T03:38:27.991893+0000","last_became_peered":"2024-09-17T03:38:27.991893+0000","last_unstale":"2024-09-17T03:38:29.191435+0000","last_undegraded":"2024-09-17T03:38:29.191435+0000","last_fullsized":"2024-09-17T03:38:29.191435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:19.530780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960203+0000","last_change":"2024-09-17T03:38:26.960203+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960203+0000","last_undegraded":"2024-09-17T03:38:26.960203+0000","last_fullsized":"2024-09-17T03:38:26.960203+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261054+0000","last_change":"2024-09-17T03:38:27.983421+0000","last_active":"2024-09-17T03:38:29.261054+0000","last_peered":"2024-09-17T03:38:29.261054+0000","last_clean":"2024-09-17T03:38:29.261054+0000","last_became_active":"2024-09-17T03:38:27.982752+0000","last_became_peered":"2024-09-17T03:38:27.982752+0000","last_unstale":"2024-09-17T03:38:29.261054+0000","last_undegraded":"2024-09-17T03:38:29.261054+0000","last_fullsized":"2024-09-17T03:38:29.261054+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:38.478741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191740+0000","last_change":"2024-09-17T03:38:27.990173+0000","last_active":"2024-09-17T03:38:29.191740+0000","last_peered":"2024-09-17T03:38:29.191740+0000","last_clean":"2024-09-17T03:38:29.191740+0000","last_became_active":"2024-09-17T03:38:27.989859+0000","last_became_peered":"2024-09-17T03:38:27.989859+0000","last_unstale":"2024-09-17T03:38:29.191740+0000","last_undegraded":"2024-09-17T03:38:29.191740+0000","last_fullsized":"2024-09-17T03:38:29.191740+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:00.044654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"103'4","reported_seq":19,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966829+0000","last_change":"2024-09-17T03:38:26.968498+0000","last_active":"2024-09-17T03:38:28.966829+0000","last_peered":"2024-09-17T03:38:28.966829+0000","last_clean":"2024-09-17T03:38:28.966829+0000","last_became_active":"2024-09-17T03:38:26.967685+0000","last_became_peered":"2024-09-17T03:38:26.967685+0000","last_unstale":"2024-09-17T03:38:28.966829+0000","last_undegraded":"2024-09-17T03:38:28.966829+0000","last_fullsized":"2024-09-17T03:38:28.966829+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:59.918075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959494+0000","last_change":"2024-09-17T03:38:26.959494+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959494+0000","last_undegraded":"2024-09-17T03:38:26.959494+0000","last_fullsized":"2024-09-17T03:38:26.959494+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005777+0000","last_change":"2024-09-17T03:38:26.978065+0000","last_active":"2024-09-17T03:38:29.005777+0000","last_peered":"2024-09-17T03:38:29.005777+0000","last_clean":"2024-09-17T03:38:29.005777+0000","last_became_active":"2024-09-17T03:38:26.977760+0000","last_became_peered":"2024-09-17T03:38:26.977760+0000","last_unstale":"2024-09-17T03:38:29.005777+0000","last_undegraded":"2024-09-17T03:38:29.005777+0000","last_fullsized":"2024-09-17T03:38:29.005777+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:59.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262053+0000","last_change":"2024-09-17T03:38:27.990981+0000","last_active":"2024-09-17T03:38:29.262053+0000","last_peered":"2024-09-17T03:38:29.262053+0000","last_clean":"2024-09-17T03:38:29.262053+0000","last_became_active":"2024-09-17T03:38:27.990155+0000","last_became_peered":"2024-09-17T03:38:27.990155+0000","last_unstale":"2024-09-17T03:38:29.262053+0000","last_undegraded":"2024-09-17T03:38:29.262053+0000","last_fullsized":"2024-09-17T03:38:29.262053+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:14.288116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966484+0000","last_change":"2024-09-17T03:38:26.972883+0000","last_active":"2024-09-17T03:38:28.966484+0000","last_peered":"2024-09-17T03:38:28.966484+0000","last_clean":"2024-09-17T03:38:28.966484+0000","last_became_active":"2024-09-17T03:38:26.972316+0000","last_became_peered":"2024-09-17T03:38:26.972316+0000","last_unstale":"2024-09-17T03:38:28.966484+0000","last_undegraded":"2024-09-17T03:38:28.966484+0000","last_fullsized":"2024-09-17T03:38:28.966484+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:43.780561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968147+0000","last_change":"2024-09-17T03:38:27.988250+0000","last_active":"2024-09-17T03:38:28.968147+0000","last_peered":"2024-09-17T03:38:28.968147+0000","last_clean":"2024-09-17T03:38:28.968147+0000","last_became_active":"2024-09-17T03:38:27.987938+0000","last_became_peered":"2024-09-17T03:38:27.987938+0000","last_unstale":"2024-09-17T03:38:28.968147+0000","last_undegraded":"2024-09-17T03:38:28.968147+0000","last_fullsized":"2024-09-17T03:38:28.968147+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:52.687194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966709+0000","last_change":"2024-09-17T03:38:26.967614+0000","last_active":"2024-09-17T03:38:28.966709+0000","last_peered":"2024-09-17T03:38:28.966709+0000","last_clean":"2024-09-17T03:38:28.966709+0000","last_became_active":"2024-09-17T03:38:26.967289+0000","last_became_peered":"2024-09-17T03:38:26.967289+0000","last_unstale":"2024-09-17T03:38:28.966709+0000","last_undegraded":"2024-09-17T03:38:28.966709+0000","last_fullsized":"2024-09-17T03:38:28.966709+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:26.552522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.967177+0000","last_change":"2024-09-17T03:38:26.967177+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.967177+0000","last_undegraded":"2024-09-17T03:38:26.967177+0000","last_fullsized":"2024-09-17T03:38:26.967177+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262081+0000","last_change":"2024-09-17T03:38:26.971419+0000","last_active":"2024-09-17T03:38:29.262081+0000","last_peered":"2024-09-17T03:38:29.262081+0000","last_clean":"2024-09-17T03:38:29.262081+0000","last_became_active":"2024-09-17T03:38:26.971104+0000","last_became_peered":"2024-09-17T03:38:26.971104+0000","last_unstale":"2024-09-17T03:38:29.262081+0000","last_undegraded":"2024-09-17T03:38:29.262081+0000","last_fullsized":"2024-09-17T03:38:29.262081+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:17.356881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005582+0000","last_change":"2024-09-17T03:38:27.983933+0000","last_active":"2024-09-17T03:38:29.005582+0000","last_peered":"2024-09-17T03:38:29.005582+0000","last_clean":"2024-09-17T03:38:29.005582+0000","last_became_active":"2024-09-17T03:38:27.983619+0000","last_became_peered":"2024-09-17T03:38:27.983619+0000","last_unstale":"2024-09-17T03:38:29.005582+0000","last_undegraded":"2024-09-17T03:38:29.005582+0000","last_fullsized":"2024-09-17T03:38:29.005582+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:33.661852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966904+0000","last_change":"2024-09-17T03:38:26.975874+0000","last_active":"2024-09-17T03:38:28.966904+0000","last_peered":"2024-09-17T03:38:28.966904+0000","last_clean":"2024-09-17T03:38:28.966904+0000","last_became_active":"2024-09-17T03:38:26.975546+0000","last_became_peered":"2024-09-17T03:38:26.975546+0000","last_unstale":"2024-09-17T03:38:28.966904+0000","last_undegraded":"2024-09-17T03:38:28.966904+0000","last_fullsized":"2024-09-17T03:38:28.966904+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:25.915484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959308+0000","last_change":"2024-09-17T03:38:26.959308+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959308+0000","last_undegraded":"2024-09-17T03:38:26.959308+0000","last_fullsized":"2024-09-17T03:38:26.959308+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967993+0000","last_change":"2024-09-17T03:38:26.968875+0000","last_active":"2024-09-17T03:38:28.967993+0000","last_peered":"2024-09-17T03:38:28.967993+0000","last_clean":"2024-09-17T03:38:28.967993+0000","last_became_active":"2024-09-17T03:38:26.968513+0000","last_became_peered":"2024-09-17T03:38:26.968513+0000","last_unstale":"2024-09-17T03:38:28.967993+0000","last_undegraded":"2024-09-17T03:38:28.967993+0000","last_fullsized":"2024-09-17T03:38:28.967993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:22.278430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968198+0000","last_change":"2024-09-17T03:38:27.987700+0000","last_active":"2024-09-17T03:38:28.968198+0000","last_peered":"2024-09-17T03:38:28.968198+0000","last_clean":"2024-09-17T03:38:28.968198+0000","last_became_active":"2024-09-17T03:38:27.987324+0000","last_became_peered":"2024-09-17T03:38:27.987324+0000","last_unstale":"2024-09-17T03:38:28.968198+0000","last_undegraded":"2024-09-17T03:38:28.968198+0000","last_fullsized":"2024-09-17T03:38:28.968198+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:52.164705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261246+0000","last_change":"2024-09-17T03:38:26.970105+0000","last_active":"2024-09-17T03:38:29.261246+0000","last_peered":"2024-09-17T03:38:29.261246+0000","last_clean":"2024-09-17T03:38:29.261246+0000","last_became_active":"2024-09-17T03:38:26.969797+0000","last_became_peered":"2024-09-17T03:38:26.969797+0000","last_unstale":"2024-09-17T03:38:29.261246+0000","last_undegraded":"2024-09-17T03:38:29.261246+0000","last_fullsized":"2024-09-17T03:38:29.261246+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:58.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967075+0000","last_change":"2024-09-17T03:38:27.973929+0000","last_active":"2024-09-17T03:38:28.967075+0000","last_peered":"2024-09-17T03:38:28.967075+0000","last_clean":"2024-09-17T03:38:28.967075+0000","last_became_active":"2024-09-17T03:38:27.973613+0000","last_became_peered":"2024-09-17T03:38:27.973613+0000","last_unstale":"2024-09-17T03:38:28.967075+0000","last_undegraded":"2024-09-17T03:38:28.967075+0000","last_fullsized":"2024-09-17T03:38:28.967075+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:22.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262126+0000","last_change":"2024-09-17T03:38:26.972647+0000","last_active":"2024-09-17T03:38:29.262126+0000","last_peered":"2024-09-17T03:38:29.262126+0000","last_clean":"2024-09-17T03:38:29.262126+0000","last_became_active":"2024-09-17T03:38:26.972292+0000","last_became_peered":"2024-09-17T03:38:26.972292+0000","last_unstale":"2024-09-17T03:38:29.262126+0000","last_undegraded":"2024-09-17T03:38:29.262126+0000","last_fullsized":"2024-09-17T03:38:29.262126+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:37.378067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968189+0000","last_change":"2024-09-17T03:38:27.987131+0000","last_active":"2024-09-17T03:38:28.968189+0000","last_peered":"2024-09-17T03:38:28.968189+0000","last_clean":"2024-09-17T03:38:28.968189+0000","last_became_active":"2024-09-17T03:38:27.985984+0000","last_became_peered":"2024-09-17T03:38:27.985984+0000","last_unstale":"2024-09-17T03:38:28.968189+0000","last_undegraded":"2024-09-17T03:38:28.968189+0000","last_fullsized":"2024-09-17T03:38:28.968189+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:29.538764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.978751+0000","last_change":"2024-09-17T03:38:26.969005+0000","last_active":"2024-09-17T03:38:26.978751+0000","last_peered":"2024-09-17T03:38:26.978751+0000","last_clean":"2024-09-17T03:38:26.978751+0000","last_became_active":"2024-09-17T03:38:26.968705+0000","last_became_peered":"2024-09-17T03:38:26.968705+0000","last_unstale":"2024-09-17T03:38:26.978751+0000","last_undegraded":"2024-09-17T03:38:26.978751+0000","last_fullsized":"2024-09-17T03:38:26.978751+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:56.364923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969036+0000","last_change":"2024-09-17T03:38:27.974699+0000","last_active":"2024-09-17T03:38:28.969036+0000","last_peered":"2024-09-17T03:38:28.969036+0000","last_clean":"2024-09-17T03:38:28.969036+0000","last_became_active":"2024-09-17T03:38:27.974349+0000","last_became_peered":"2024-09-17T03:38:27.974349+0000","last_unstale":"2024-09-17T03:38:28.969036+0000","last_undegraded":"2024-09-17T03:38:28.969036+0000","last_fullsized":"2024-09-17T03:38:28.969036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:35.927783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"103'3","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.006024+0000","last_change":"2024-09-17T03:38:26.976206+0000","last_active":"2024-09-17T03:38:29.006024+0000","last_peered":"2024-09-17T03:38:29.006024+0000","last_clean":"2024-09-17T03:38:29.006024+0000","last_became_active":"2024-09-17T03:38:26.975880+0000","last_became_peered":"2024-09-17T03:38:26.975880+0000","last_unstale":"2024-09-17T03:38:29.006024+0000","last_undegraded":"2024-09-17T03:38:29.006024+0000","last_fullsized":"2024-09-17T03:38:29.006024+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:35.608702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005888+0000","last_change":"2024-09-17T03:38:27.992658+0000","last_active":"2024-09-17T03:38:29.005888+0000","last_peered":"2024-09-17T03:38:29.005888+0000","last_clean":"2024-09-17T03:38:29.005888+0000","last_became_active":"2024-09-17T03:38:27.992329+0000","last_became_peered":"2024-09-17T03:38:27.992329+0000","last_unstale":"2024-09-17T03:38:29.005888+0000","last_undegraded":"2024-09-17T03:38:29.005888+0000","last_fullsized":"2024-09-17T03:38:29.005888+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:49.376138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"103'6","reported_seq":21,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968653+0000","last_change":"2024-09-17T03:38:26.970950+0000","last_active":"2024-09-17T03:38:28.968653+0000","last_peered":"2024-09-17T03:38:28.968653+0000","last_clean":"2024-09-17T03:38:28.968653+0000","last_became_active":"2024-09-17T03:38:26.970571+0000","last_became_peered":"2024-09-17T03:38:26.970571+0000","last_unstale":"2024-09-17T03:38:28.968653+0000","last_undegraded":"2024-09-17T03:38:28.968653+0000","last_fullsized":"2024-09-17T03:38:28.968653+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:19.026536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.958703+0000","last_change":"2024-09-17T03:38:26.958703+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.958703+0000","last_undegraded":"2024-09-17T03:38:26.958703+0000","last_fullsized":"2024-09-17T03:38:26.958703+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191737+0000","last_change":"2024-09-17T03:38:26.974447+0000","last_active":"2024-09-17T03:38:29.191737+0000","last_peered":"2024-09-17T03:38:29.191737+0000","last_clean":"2024-09-17T03:38:29.191737+0000","last_became_active":"2024-09-17T03:38:26.973897+0000","last_became_peered":"2024-09-17T03:38:26.973897+0000","last_unstale":"2024-09-17T03:38:29.191737+0000","last_undegraded":"2024-09-17T03:38:29.191737+0000","last_fullsized":"2024-09-17T03:38:29.191737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:15.443030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261947+0000","last_change":"2024-09-17T03:38:27.990618+0000","last_active":"2024-09-17T03:38:29.261947+0000","last_peered":"2024-09-17T03:38:29.261947+0000","last_clean":"2024-09-17T03:38:29.261947+0000","last_became_active":"2024-09-17T03:38:27.990303+0000","last_became_peered":"2024-09-17T03:38:27.990303+0000","last_unstale":"2024-09-17T03:38:29.261947+0000","last_undegraded":"2024-09-17T03:38:29.261947+0000","last_fullsized":"2024-09-17T03:38:29.261947+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:47.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.192048+0000","last_change":"2024-09-17T03:38:26.974800+0000","last_active":"2024-09-17T03:38:29.192048+0000","last_peered":"2024-09-17T03:38:29.192048+0000","last_clean":"2024-09-17T03:38:29.192048+0000","last_became_active":"2024-09-17T03:38:26.973636+0000","last_became_peered":"2024-09-17T03:38:26.973636+0000","last_unstale":"2024-09-17T03:38:29.192048+0000","last_undegraded":"2024-09-17T03:38:29.192048+0000","last_fullsized":"2024-09-17T03:38:29.192048+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:24.347945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967612+0000","last_change":"2024-09-17T03:38:27.981267+0000","last_active":"2024-09-17T03:38:28.967612+0000","last_peered":"2024-09-17T03:38:28.967612+0000","last_clean":"2024-09-17T03:38:28.967612+0000","last_became_active":"2024-09-17T03:38:27.980948+0000","last_became_peered":"2024-09-17T03:38:27.980948+0000","last_unstale":"2024-09-17T03:38:28.967612+0000","last_undegraded":"2024-09-17T03:38:28.967612+0000","last_fullsized":"2024-09-17T03:38:28.967612+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:00.923679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967685+0000","last_change":"2024-09-17T03:38:26.967641+0000","last_active":"2024-09-17T03:38:28.967685+0000","last_peered":"2024-09-17T03:38:28.967685+0000","last_clean":"2024-09-17T03:38:28.967685+0000","last_became_active":"2024-09-17T03:38:26.967327+0000","last_became_peered":"2024-09-17T03:38:26.967327+0000","last_unstale":"2024-09-17T03:38:28.967685+0000","last_undegraded":"2024-09-17T03:38:28.967685+0000","last_fullsized":"2024-09-17T03:38:28.967685+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:29.998335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191642+0000","last_change":"2024-09-17T03:38:27.996101+0000","last_active":"2024-09-17T03:38:29.191642+0000","last_peered":"2024-09-17T03:38:29.191642+0000","last_clean":"2024-09-17T03:38:29.191642+0000","last_became_active":"2024-09-17T03:38:27.995788+0000","last_became_peered":"2024-09-17T03:38:27.995788+0000","last_unstale":"2024-09-17T03:38:29.191642+0000","last_undegraded":"2024-09-17T03:38:29.191642+0000","last_fullsized":"2024-09-17T03:38:29.191642+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:15.921214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"103'8","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261364+0000","last_change":"2024-09-17T03:38:26.970998+0000","last_active":"2024-09-17T03:38:29.261364+0000","last_peered":"2024-09-17T03:38:29.261364+0000","last_clean":"2024-09-17T03:38:29.261364+0000","last_became_active":"2024-09-17T03:38:26.970693+0000","last_became_peered":"2024-09-17T03:38:26.970693+0000","last_unstale":"2024-09-17T03:38:29.261364+0000","last_undegraded":"2024-09-17T03:38:29.261364+0000","last_fullsized":"2024-09-17T03:38:29.261364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:21.604318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969341+0000","last_change":"2024-09-17T03:38:27.972622+0000","last_active":"2024-09-17T03:38:28.969341+0000","last_peered":"2024-09-17T03:38:28.969341+0000","last_clean":"2024-09-17T03:38:28.969341+0000","last_became_active":"2024-09-17T03:38:27.972170+0000","last_became_peered":"2024-09-17T03:38:27.972170+0000","last_unstale":"2024-09-17T03:38:28.969341+0000","last_undegraded":"2024-09-17T03:38:28.969341+0000","last_fullsized":"2024-09-17T03:38:28.969341+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:42.671301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968039+0000","last_change":"2024-09-17T03:38:26.974319+0000","last_active":"2024-09-17T03:38:28.968039+0000","last_peered":"2024-09-17T03:38:28.968039+0000","last_clean":"2024-09-17T03:38:28.968039+0000","last_became_active":"2024-09-17T03:38:26.974008+0000","last_became_peered":"2024-09-17T03:38:26.974008+0000","last_unstale":"2024-09-17T03:38:28.968039+0000","last_undegraded":"2024-09-17T03:38:28.968039+0000","last_fullsized":"2024-09-17T03:38:28.968039+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:15.506982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.965545+0000","last_change":"2024-09-17T03:38:26.965545+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.965545+0000","last_undegraded":"2024-09-17T03:38:26.965545+0000","last_fullsized":"2024-09-17T03:38:26.965545+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968860+0000","last_change":"2024-09-17T03:38:26.972839+0000","last_active":"2024-09-17T03:38:28.968860+0000","last_peered":"2024-09-17T03:38:28.968860+0000","last_clean":"2024-09-17T03:38:28.968860+0000","last_became_active":"2024-09-17T03:38:26.972478+0000","last_became_peered":"2024-09-17T03:38:26.972478+0000","last_unstale":"2024-09-17T03:38:28.968860+0000","last_undegraded":"2024-09-17T03:38:28.968860+0000","last_fullsized":"2024-09-17T03:38:28.968860+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:36.480429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005983+0000","last_change":"2024-09-17T03:38:27.991905+0000","last_active":"2024-09-17T03:38:29.005983+0000","last_peered":"2024-09-17T03:38:29.005983+0000","last_clean":"2024-09-17T03:38:29.005983+0000","last_became_active":"2024-09-17T03:38:27.991253+0000","last_became_peered":"2024-09-17T03:38:27.991253+0000","last_unstale":"2024-09-17T03:38:29.005983+0000","last_undegraded":"2024-09-17T03:38:29.005983+0000","last_fullsized":"2024-09-17T03:38:29.005983+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:47.703166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966712+0000","last_change":"2024-09-17T03:38:26.966582+0000","last_active":"2024-09-17T03:38:28.966712+0000","last_peered":"2024-09-17T03:38:28.966712+0000","last_clean":"2024-09-17T03:38:28.966712+0000","last_became_active":"2024-09-17T03:38:26.966236+0000","last_became_peered":"2024-09-17T03:38:26.966236+0000","last_unstale":"2024-09-17T03:38:28.966712+0000","last_undegraded":"2024-09-17T03:38:28.966712+0000","last_fullsized":"2024-09-17T03:38:28.966712+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.908196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191936+0000","last_change":"2024-09-17T03:38:27.998470+0000","last_active":"2024-09-17T03:38:29.191936+0000","last_peered":"2024-09-17T03:38:29.191936+0000","last_clean":"2024-09-17T03:38:29.191936+0000","last_became_active":"2024-09-17T03:38:27.998141+0000","last_became_peered":"2024-09-17T03:38:27.998141+0000","last_unstale":"2024-09-17T03:38:29.191936+0000","last_undegraded":"2024-09-17T03:38:29.191936+0000","last_fullsized":"2024-09-17T03:38:29.191936+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:21.927496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966717+0000","last_change":"2024-09-17T03:38:26.976542+0000","last_active":"2024-09-17T03:38:28.966717+0000","last_peered":"2024-09-17T03:38:28.966717+0000","last_clean":"2024-09-17T03:38:28.966717+0000","last_became_active":"2024-09-17T03:38:26.976209+0000","last_became_peered":"2024-09-17T03:38:26.976209+0000","last_unstale":"2024-09-17T03:38:28.966717+0000","last_undegraded":"2024-09-17T03:38:28.966717+0000","last_fullsized":"2024-09-17T03:38:28.966717+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:45.010470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191554+0000","last_change":"2024-09-17T03:38:27.989123+0000","last_active":"2024-09-17T03:38:29.191554+0000","last_peered":"2024-09-17T03:38:29.191554+0000","last_clean":"2024-09-17T03:38:29.191554+0000","last_became_active":"2024-09-17T03:38:27.987713+0000","last_became_peered":"2024-09-17T03:38:27.987713+0000","last_unstale":"2024-09-17T03:38:29.191554+0000","last_undegraded":"2024-09-17T03:38:29.191554+0000","last_fullsized":"2024-09-17T03:38:29.191554+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:59.793518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.974364+0000","last_change":"2024-09-17T03:38:26.973805+0000","last_active":"2024-09-17T03:38:26.974364+0000","last_peered":"2024-09-17T03:38:26.974364+0000","last_clean":"2024-09-17T03:38:26.974364+0000","last_became_active":"2024-09-17T03:38:26.973309+0000","last_became_peered":"2024-09-17T03:38:26.973309+0000","last_unstale":"2024-09-17T03:38:26.974364+0000","last_undegraded":"2024-09-17T03:38:26.974364+0000","last_fullsized":"2024-09-17T03:38:26.974364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:29.550285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191418+0000","last_change":"2024-09-17T03:38:27.998634+0000","last_active":"2024-09-17T03:38:29.191418+0000","last_peered":"2024-09-17T03:38:29.191418+0000","last_clean":"2024-09-17T03:38:29.191418+0000","last_became_active":"2024-09-17T03:38:27.998367+0000","last_became_peered":"2024-09-17T03:38:27.998367+0000","last_unstale":"2024-09-17T03:38:29.191418+0000","last_undegraded":"2024-09-17T03:38:29.191418+0000","last_fullsized":"2024-09-17T03:38:29.191418+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:21.126756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.973606+0000","last_change":"2024-09-17T03:38:26.971443+0000","last_active":"2024-09-17T03:38:26.973606+0000","last_peered":"2024-09-17T03:38:26.973606+0000","last_clean":"2024-09-17T03:38:26.973606+0000","last_became_active":"2024-09-17T03:38:26.971141+0000","last_became_peered":"2024-09-17T03:38:26.971141+0000","last_unstale":"2024-09-17T03:38:26.973606+0000","last_undegraded":"2024-09-17T03:38:26.973606+0000","last_fullsized":"2024-09-17T03:38:26.973606+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:16.383373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967668+0000","last_change":"2024-09-17T03:38:27.982133+0000","last_active":"2024-09-17T03:38:28.967668+0000","last_peered":"2024-09-17T03:38:28.967668+0000","last_clean":"2024-09-17T03:38:28.967668+0000","last_became_active":"2024-09-17T03:38:27.981801+0000","last_became_peered":"2024-09-17T03:38:27.981801+0000","last_unstale":"2024-09-17T03:38:28.967668+0000","last_undegraded":"2024-09-17T03:38:28.967668+0000","last_fullsized":"2024-09-17T03:38:28.967668+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:17.462936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966389+0000","last_change":"2024-09-17T03:38:26.974657+0000","last_active":"2024-09-17T03:38:28.966389+0000","last_peered":"2024-09-17T03:38:28.966389+0000","last_clean":"2024-09-17T03:38:28.966389+0000","last_became_active":"2024-09-17T03:38:26.973955+0000","last_became_peered":"2024-09-17T03:38:26.973955+0000","last_unstale":"2024-09-17T03:38:28.966389+0000","last_undegraded":"2024-09-17T03:38:28.966389+0000","last_fullsized":"2024-09-17T03:38:28.966389+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:23.286979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967097+0000","last_change":"2024-09-17T03:38:27.990530+0000","last_active":"2024-09-17T03:38:28.967097+0000","last_peered":"2024-09-17T03:38:28.967097+0000","last_clean":"2024-09-17T03:38:28.967097+0000","last_became_active":"2024-09-17T03:38:27.990225+0000","last_became_peered":"2024-09-17T03:38:27.990225+0000","last_unstale":"2024-09-17T03:38:28.967097+0000","last_undegraded":"2024-09-17T03:38:28.967097+0000","last_fullsized":"2024-09-17T03:38:28.967097+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:05.637779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.977151+0000","last_change":"2024-09-17T03:38:26.974776+0000","last_active":"2024-09-17T03:38:26.977151+0000","last_peered":"2024-09-17T03:38:26.977151+0000","last_clean":"2024-09-17T03:38:26.977151+0000","last_became_active":"2024-09-17T03:38:26.974459+0000","last_became_peered":"2024-09-17T03:38:26.974459+0000","last_unstale":"2024-09-17T03:38:26.977151+0000","last_undegraded":"2024-09-17T03:38:26.977151+0000","last_fullsized":"2024-09-17T03:38:26.977151+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:40.028883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262162+0000","last_change":"2024-09-17T03:38:27.990635+0000","last_active":"2024-09-17T03:38:29.262162+0000","last_peered":"2024-09-17T03:38:29.262162+0000","last_clean":"2024-09-17T03:38:29.262162+0000","last_became_active":"2024-09-17T03:38:27.990326+0000","last_became_peered":"2024-09-17T03:38:27.990326+0000","last_unstale":"2024-09-17T03:38:29.262162+0000","last_undegraded":"2024-09-17T03:38:29.262162+0000","last_fullsized":"2024-09-17T03:38:29.262162+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:11.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967149+0000","last_change":"2024-09-17T03:38:26.974661+0000","last_active":"2024-09-17T03:38:28.967149+0000","last_peered":"2024-09-17T03:38:28.967149+0000","last_clean":"2024-09-17T03:38:28.967149+0000","last_became_active":"2024-09-17T03:38:26.974345+0000","last_became_peered":"2024-09-17T03:38:26.974345+0000","last_unstale":"2024-09-17T03:38:28.967149+0000","last_undegraded":"2024-09-17T03:38:28.967149+0000","last_fullsized":"2024-09-17T03:38:28.967149+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:59.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262108+0000","last_change":"2024-09-17T03:38:27.983385+0000","last_active":"2024-09-17T03:38:29.262108+0000","last_peered":"2024-09-17T03:38:29.262108+0000","last_clean":"2024-09-17T03:38:29.262108+0000","last_became_active":"2024-09-17T03:38:27.982698+0000","last_became_peered":"2024-09-17T03:38:27.982698+0000","last_unstale":"2024-09-17T03:38:29.262108+0000","last_undegraded":"2024-09-17T03:38:29.262108+0000","last_fullsized":"2024-09-17T03:38:29.262108+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:13.426190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966637+0000","last_change":"2024-09-17T03:38:26.965679+0000","last_active":"2024-09-17T03:38:28.966637+0000","last_peered":"2024-09-17T03:38:28.966637+0000","last_clean":"2024-09-17T03:38:28.966637+0000","last_became_active":"2024-09-17T03:38:26.965356+0000","last_became_peered":"2024-09-17T03:38:26.965356+0000","last_unstale":"2024-09-17T03:38:28.966637+0000","last_undegraded":"2024-09-17T03:38:28.966637+0000","last_fullsized":"2024-09-17T03:38:28.966637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:04.970216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968941+0000","last_change":"2024-09-17T03:38:27.993766+0000","last_active":"2024-09-17T03:38:28.968941+0000","last_peered":"2024-09-17T03:38:28.968941+0000","last_clean":"2024-09-17T03:38:28.968941+0000","last_became_active":"2024-09-17T03:38:27.993432+0000","last_became_peered":"2024-09-17T03:38:27.993432+0000","last_unstale":"2024-09-17T03:38:28.968941+0000","last_undegraded":"2024-09-17T03:38:28.968941+0000","last_fullsized":"2024-09-17T03:38:28.968941+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:45.247320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969217+0000","last_change":"2024-09-17T03:38:26.970931+0000","last_active":"2024-09-17T03:38:28.969217+0000","last_peered":"2024-09-17T03:38:28.969217+0000","last_clean":"2024-09-17T03:38:28.969217+0000","last_became_active":"2024-09-17T03:38:26.970604+0000","last_became_peered":"2024-09-17T03:38:26.970604+0000","last_unstale":"2024-09-17T03:38:28.969217+0000","last_undegraded":"2024-09-17T03:38:28.969217+0000","last_fullsized":"2024-09-17T03:38:28.969217+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:52.328415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.192172+0000","last_change":"2024-09-17T03:38:27.994165+0000","last_active":"2024-09-17T03:38:29.192172+0000","last_peered":"2024-09-17T03:38:29.192172+0000","last_clean":"2024-09-17T03:38:29.192172+0000","last_became_active":"2024-09-17T03:38:27.993861+0000","last_became_peered":"2024-09-17T03:38:27.993861+0000","last_unstale":"2024-09-17T03:38:29.192172+0000","last_undegraded":"2024-09-17T03:38:29.192172+0000","last_fullsized":"2024-09-17T03:38:29.192172+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:33.720992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966741+0000","last_change":"2024-09-17T03:38:26.970499+0000","last_active":"2024-09-17T03:38:28.966741+0000","last_peered":"2024-09-17T03:38:28.966741+0000","last_clean":"2024-09-17T03:38:28.966741+0000","last_became_active":"2024-09-17T03:38:26.970128+0000","last_became_peered":"2024-09-17T03:38:26.970128+0000","last_unstale":"2024-09-17T03:38:28.966741+0000","last_undegraded":"2024-09-17T03:38:28.966741+0000","last_fullsized":"2024-09-17T03:38:28.966741+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:43.177282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967999+0000","last_change":"2024-09-17T03:38:27.971482+0000","last_active":"2024-09-17T03:38:28.967999+0000","last_peered":"2024-09-17T03:38:28.967999+0000","last_clean":"2024-09-17T03:38:28.967999+0000","last_became_active":"2024-09-17T03:38:27.971124+0000","last_became_peered":"2024-09-17T03:38:27.971124+0000","last_unstale":"2024-09-17T03:38:28.967999+0000","last_undegraded":"2024-09-17T03:38:28.967999+0000","last_fullsized":"2024-09-17T03:38:28.967999+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:00.365080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968381+0000","last_change":"2024-09-17T03:38:26.974041+0000","last_active":"2024-09-17T03:38:28.968381+0000","last_peered":"2024-09-17T03:38:28.968381+0000","last_clean":"2024-09-17T03:38:28.968381+0000","last_became_active":"2024-09-17T03:38:26.973115+0000","last_became_peered":"2024-09-17T03:38:26.973115+0000","last_unstale":"2024-09-17T03:38:28.968381+0000","last_undegraded":"2024-09-17T03:38:28.968381+0000","last_fullsized":"2024-09-17T03:38:28.968381+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:33.987282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191435+0000","last_change":"2024-09-17T03:38:27.996142+0000","last_active":"2024-09-17T03:38:29.191435+0000","last_peered":"2024-09-17T03:38:29.191435+0000","last_clean":"2024-09-17T03:38:29.191435+0000","last_became_active":"2024-09-17T03:38:27.995822+0000","last_became_peered":"2024-09-17T03:38:27.995822+0000","last_unstale":"2024-09-17T03:38:29.191435+0000","last_undegraded":"2024-09-17T03:38:29.191435+0000","last_fullsized":"2024-09-17T03:38:29.191435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:04.315528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.977968+0000","last_change":"2024-09-17T03:38:26.969822+0000","last_active":"2024-09-17T03:38:26.977968+0000","last_peered":"2024-09-17T03:38:26.977968+0000","last_clean":"2024-09-17T03:38:26.977968+0000","last_became_active":"2024-09-17T03:38:26.969461+0000","last_became_peered":"2024-09-17T03:38:26.969461+0000","last_unstale":"2024-09-17T03:38:26.977968+0000","last_undegraded":"2024-09-17T03:38:26.977968+0000","last_fullsized":"2024-09-17T03:38:26.977968+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:34.065975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967882+0000","last_change":"2024-09-17T03:38:27.993971+0000","last_active":"2024-09-17T03:38:28.967882+0000","last_peered":"2024-09-17T03:38:28.967882+0000","last_clean":"2024-09-17T03:38:28.967882+0000","last_became_active":"2024-09-17T03:38:27.993620+0000","last_became_peered":"2024-09-17T03:38:27.993620+0000","last_unstale":"2024-09-17T03:38:28.967882+0000","last_undegraded":"2024-09-17T03:38:28.967882+0000","last_fullsized":"2024-09-17T03:38:28.967882+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:44.121364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191565+0000","last_change":"2024-09-17T03:38:26.974988+0000","last_active":"2024-09-17T03:38:29.191565+0000","last_peered":"2024-09-17T03:38:29.191565+0000","last_clean":"2024-09-17T03:38:29.191565+0000","last_became_active":"2024-09-17T03:38:26.974315+0000","last_became_peered":"2024-09-17T03:38:26.974315+0000","last_unstale":"2024-09-17T03:38:29.191565+0000","last_undegraded":"2024-09-17T03:38:29.191565+0000","last_fullsized":"2024-09-17T03:38:29.191565+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:12.754692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191832+0000","last_change":"2024-09-17T03:38:27.998521+0000","last_active":"2024-09-17T03:38:29.191832+0000","last_peered":"2024-09-17T03:38:29.191832+0000","last_clean":"2024-09-17T03:38:29.191832+0000","last_became_active":"2024-09-17T03:38:27.998207+0000","last_became_peered":"2024-09-17T03:38:27.998207+0000","last_unstale":"2024-09-17T03:38:29.191832+0000","last_undegraded":"2024-09-17T03:38:29.191832+0000","last_fullsized":"2024-09-17T03:38:29.191832+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:22.891457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005652+0000","last_change":"2024-09-17T03:38:26.979932+0000","last_active":"2024-09-17T03:38:29.005652+0000","last_peered":"2024-09-17T03:38:29.005652+0000","last_clean":"2024-09-17T03:38:29.005652+0000","last_became_active":"2024-09-17T03:38:26.979630+0000","last_became_peered":"2024-09-17T03:38:26.979630+0000","last_unstale":"2024-09-17T03:38:29.005652+0000","last_undegraded":"2024-09-17T03:38:29.005652+0000","last_fullsized":"2024-09-17T03:38:29.005652+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:59.918075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":261,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005746+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:38:29.005746+0000","last_peered":"2024-09-17T03:38:29.005746+0000","last_clean":"2024-09-17T03:38:29.005746+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:38:29.005746+0000","last_undegraded":"2024-09-17T03:38:29.005746+0000","last_fullsized":"2024-09-17T03:38:29.005746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37184,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334656,"statfs":{"total":96636764160,"available":96598687744,"internally_reserved":0,"allocated":1880064,"data_stored":1146837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40756,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331084,"statfs":{"total":96636764160,"available":96595030016,"internally_reserved":0,"allocated":1273856,"data_stored":550709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40776,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331064,"statfs":{"total":96636764160,"available":96595009536,"internally_reserved":0,"allocated":1298432,"data_stored":558093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36596,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335244,"statfs":{"total":96636764160,"available":96599289856,"internally_reserved":0,"allocated":1269760,"data_stored":550091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40760,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331080,"statfs":{"total":96636764160,"available":96595025920,"internally_reserved":0,"allocated":1277952,"data_stored":556357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37168,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334672,"statfs":{"total":96636764160,"available":96598704128,"internally_reserved":0,"allocated":1863680,"data_stored":1141007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1241088,"data_stored":537007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1241088,"data_stored":537007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:38:31.344 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:38:31.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.492+0000 7f82dc1f1640 1 -- 172.21.15.146:0/1998370530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82d415f010 msgr2=0x7f82d41515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.492+0000 7f82dc1f1640 1 --2- 172.21.15.146:0/1998370530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82d415f010 0x7f82d41515a0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f82d40b3120 tx=0x7f82cc02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.492+0000 7f82dc1f1640 1 -- 172.21.15.146:0/1998370530 shutdown_connections 2024-09-17T03:38:31.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.492+0000 7f82dc1f1640 1 --2- 172.21.15.146:0/1998370530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82d415f010 0x7f82d41515a0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.492+0000 7f82dc1f1640 1 --2- 172.21.15.146:0/1998370530 >> v2:172.21.15.179:3300/0 conn(0x7f82d4072df0 0x7f82d415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.492+0000 7f82dc1f1640 1 -- 172.21.15.146:0/1998370530 >> 172.21.15.146:0/1998370530 conn(0x7f82d40b2060 msgr2=0x7f82d40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:31.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.492+0000 7f82dc1f1640 1 -- 172.21.15.146:0/1998370530 shutdown_connections 2024-09-17T03:38:31.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.492+0000 7f82dc1f1640 1 -- 172.21.15.146:0/1998370530 wait complete. 2024-09-17T03:38:31.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.494+0000 7f82dc1f1640 1 Processor -- start 2024-09-17T03:38:31.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.494+0000 7f82dc1f1640 1 -- start start 2024-09-17T03:38:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82dc1f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d4072df0 0x7f82d40ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82dc1f1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82d40b3360 0x7f82d414b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82dc1f1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d415f010 0x7f82d41f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82dc1f1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f82d406e9a0 con 0x7f82d40b3360 2024-09-17T03:38:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82dc1f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f82d406e820 con 0x7f82d4072df0 2024-09-17T03:38:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82dc1f1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f82d406eb20 con 0x7f82d415f010 2024-09-17T03:38:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82d978c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82d40b3360 0x7f82d414b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82d978c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82d40b3360 0x7f82d414b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52896/0 (socket says 172.21.15.146:52896) 2024-09-17T03:38:31.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82d978c640 1 -- 172.21.15.146:0/4120792094 learned_addr learned my addr 172.21.15.146:0/4120792094 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:31.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82d9f8d640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d4072df0 0x7f82d40ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82da78e640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d415f010 0x7f82d41f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.495+0000 7f82d978c640 1 -- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d415f010 msgr2=0x7f82d41f6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.496+0000 7f82d978c640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d415f010 0x7f82d41f6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.496+0000 7f82d978c640 1 -- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d4072df0 msgr2=0x7f82d40ab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.496+0000 7f82d978c640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d4072df0 0x7f82d40ab000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.496+0000 7f82d978c640 1 -- 172.21.15.146:0/4120792094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d41f79d0 con 0x7f82d40b3360 2024-09-17T03:38:31.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.496+0000 7f82da78e640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d415f010 0x7f82d41f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:31.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.496+0000 7f82d978c640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82d40b3360 0x7f82d414b6d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f82c400c970 tx=0x7f82c400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:31.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.496+0000 7f82ca7fc640 1 -- 172.21.15.146:0/4120792094 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c4004220 con 0x7f82d40b3360 2024-09-17T03:38:31.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.496+0000 7f82ca7fc640 1 -- 172.21.15.146:0/4120792094 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82c40079b0 con 0x7f82d40b3360 2024-09-17T03:38:31.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.496+0000 7f82dc1f1640 1 -- 172.21.15.146:0/4120792094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d41f7cb0 con 0x7f82d40b3360 2024-09-17T03:38:31.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.496+0000 7f82ca7fc640 1 -- 172.21.15.146:0/4120792094 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c4007e00 con 0x7f82d40b3360 2024-09-17T03:38:31.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.496+0000 7f82dc1f1640 1 -- 172.21.15.146:0/4120792094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d40aa800 con 0x7f82d40b3360 2024-09-17T03:38:31.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.497+0000 7f82dc1f1640 1 -- 172.21.15.146:0/4120792094 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d415ead0 con 0x7f82d40b3360 2024-09-17T03:38:31.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.498+0000 7f82ca7fc640 1 -- 172.21.15.146:0/4120792094 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82c4005030 con 0x7f82d40b3360 2024-09-17T03:38:31.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.499+0000 7f82ca7fc640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82b8078b90 0x7f82b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.499+0000 7f82ca7fc640 1 -- 172.21.15.146:0/4120792094 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f82c409b130 con 0x7f82d40b3360 2024-09-17T03:38:31.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.499+0000 7f82d9f8d640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82b8078b90 0x7f82b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.499+0000 7f82d9f8d640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82b8078b90 0x7f82b807b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f82d0007fd0 tx=0x7f82d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:31.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.503+0000 7f82ca7fc640 1 -- 172.21.15.146:0/4120792094 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f82c4014070 con 0x7f82d40b3360 2024-09-17T03:38:31.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.673+0000 7f82dc1f1640 1 -- 172.21.15.146:0/4120792094 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82d414bc10 con 0x7f82b8078b90 2024-09-17T03:38:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.678+0000 7f82ca7fc640 1 -- 172.21.15.146:0/4120792094 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251638 (secure 0 0 0) 0x7f82d414bc10 con 0x7f82b8078b90 2024-09-17T03:38:31.681 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:31.682 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:38:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 -- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82b8078b90 msgr2=0x7f82b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82b8078b90 0x7f82b807b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f82d0007fd0 tx=0x7f82d0009040 comp rx=0 tx=0).stop 2024-09-17T03:38:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 -- 172.21.15.146:0/4120792094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82d40b3360 msgr2=0x7f82d414b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82d40b3360 0x7f82d414b6d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f82c400c970 tx=0x7f82c400ce30 comp rx=0 tx=0).stop 2024-09-17T03:38:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 -- 172.21.15.146:0/4120792094 shutdown_connections 2024-09-17T03:38:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f82b8078b90 0x7f82b807b0a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f82d415f010 0x7f82d41f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82d40b3360 0x7f82d414b6d0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 --2- 172.21.15.146:0/4120792094 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f82d4072df0 0x7f82d40ab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 -- 172.21.15.146:0/4120792094 >> 172.21.15.146:0/4120792094 conn(0x7f82d40b2060 msgr2=0x7f82d40affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 -- 172.21.15.146:0/4120792094 shutdown_connections 2024-09-17T03:38:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.682+0000 7f82dc1f1640 1 -- 172.21.15.146:0/4120792094 wait complete. 2024-09-17T03:38:31.693 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-17T03:38:29.875997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314680,"kb_used_data":11080,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754660040,"statfs":{"total":773094113280,"available":772771880960,"internally_reserved":0,"allocated":11345920,"data_stored":5577108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":310693425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000926"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261975+0000","last_change":"2024-09-17T03:38:27.989901+0000","last_active":"2024-09-17T03:38:29.261975+0000","last_peered":"2024-09-17T03:38:29.261975+0000","last_clean":"2024-09-17T03:38:29.261975+0000","last_became_active":"2024-09-17T03:38:27.989603+0000","last_became_peered":"2024-09-17T03:38:27.989603+0000","last_unstale":"2024-09-17T03:38:29.261975+0000","last_undegraded":"2024-09-17T03:38:29.261975+0000","last_fullsized":"2024-09-17T03:38:29.261975+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:54.011565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966935+0000","last_change":"2024-09-17T03:38:27.992267+0000","last_active":"2024-09-17T03:38:28.966935+0000","last_peered":"2024-09-17T03:38:28.966935+0000","last_clean":"2024-09-17T03:38:28.966935+0000","last_became_active":"2024-09-17T03:38:27.991901+0000","last_became_peered":"2024-09-17T03:38:27.991901+0000","last_unstale":"2024-09-17T03:38:28.966935+0000","last_undegraded":"2024-09-17T03:38:28.966935+0000","last_fullsized":"2024-09-17T03:38:28.966935+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:24.599439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262208+0000","last_change":"2024-09-17T03:38:27.988024+0000","last_active":"2024-09-17T03:38:29.262208+0000","last_peered":"2024-09-17T03:38:29.262208+0000","last_clean":"2024-09-17T03:38:29.262208+0000","last_became_active":"2024-09-17T03:38:27.987731+0000","last_became_peered":"2024-09-17T03:38:27.987731+0000","last_unstale":"2024-09-17T03:38:29.262208+0000","last_undegraded":"2024-09-17T03:38:29.262208+0000","last_fullsized":"2024-09-17T03:38:29.262208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:38.796206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.958780+0000","last_change":"2024-09-17T03:38:26.958780+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.958780+0000","last_undegraded":"2024-09-17T03:38:26.958780+0000","last_fullsized":"2024-09-17T03:38:26.958780+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968541+0000","last_change":"2024-09-17T03:38:27.993810+0000","last_active":"2024-09-17T03:38:28.968541+0000","last_peered":"2024-09-17T03:38:28.968541+0000","last_clean":"2024-09-17T03:38:28.968541+0000","last_became_active":"2024-09-17T03:38:27.993446+0000","last_became_peered":"2024-09-17T03:38:27.993446+0000","last_unstale":"2024-09-17T03:38:28.968541+0000","last_undegraded":"2024-09-17T03:38:28.968541+0000","last_fullsized":"2024-09-17T03:38:28.968541+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:42.250236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005643+0000","last_change":"2024-09-17T03:38:27.988181+0000","last_active":"2024-09-17T03:38:29.005643+0000","last_peered":"2024-09-17T03:38:29.005643+0000","last_clean":"2024-09-17T03:38:29.005643+0000","last_became_active":"2024-09-17T03:38:27.987858+0000","last_became_peered":"2024-09-17T03:38:27.987858+0000","last_unstale":"2024-09-17T03:38:29.005643+0000","last_undegraded":"2024-09-17T03:38:29.005643+0000","last_fullsized":"2024-09-17T03:38:29.005643+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:55.651386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005728+0000","last_change":"2024-09-17T03:38:27.988069+0000","last_active":"2024-09-17T03:38:29.005728+0000","last_peered":"2024-09-17T03:38:29.005728+0000","last_clean":"2024-09-17T03:38:29.005728+0000","last_became_active":"2024-09-17T03:38:27.987720+0000","last_became_peered":"2024-09-17T03:38:27.987720+0000","last_unstale":"2024-09-17T03:38:29.005728+0000","last_undegraded":"2024-09-17T03:38:29.005728+0000","last_fullsized":"2024-09-17T03:38:29.005728+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:18.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966482+0000","last_change":"2024-09-17T03:38:27.991610+0000","last_active":"2024-09-17T03:38:28.966482+0000","last_peered":"2024-09-17T03:38:28.966482+0000","last_clean":"2024-09-17T03:38:28.966482+0000","last_became_active":"2024-09-17T03:38:27.990044+0000","last_became_peered":"2024-09-17T03:38:27.990044+0000","last_unstale":"2024-09-17T03:38:28.966482+0000","last_undegraded":"2024-09-17T03:38:28.966482+0000","last_fullsized":"2024-09-17T03:38:28.966482+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:18.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968354+0000","last_change":"2024-09-17T03:38:27.993162+0000","last_active":"2024-09-17T03:38:28.968354+0000","last_peered":"2024-09-17T03:38:28.968354+0000","last_clean":"2024-09-17T03:38:28.968354+0000","last_became_active":"2024-09-17T03:38:27.992585+0000","last_became_peered":"2024-09-17T03:38:27.992585+0000","last_unstale":"2024-09-17T03:38:28.968354+0000","last_undegraded":"2024-09-17T03:38:28.968354+0000","last_fullsized":"2024-09-17T03:38:28.968354+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:38.584725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968584+0000","last_change":"2024-09-17T03:38:27.985267+0000","last_active":"2024-09-17T03:38:28.968584+0000","last_peered":"2024-09-17T03:38:28.968584+0000","last_clean":"2024-09-17T03:38:28.968584+0000","last_became_active":"2024-09-17T03:38:27.984946+0000","last_became_peered":"2024-09-17T03:38:27.984946+0000","last_unstale":"2024-09-17T03:38:28.968584+0000","last_undegraded":"2024-09-17T03:38:28.968584+0000","last_fullsized":"2024-09-17T03:38:28.968584+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:33.593178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005592+0000","last_change":"2024-09-17T03:38:27.986243+0000","last_active":"2024-09-17T03:38:29.005592+0000","last_peered":"2024-09-17T03:38:29.005592+0000","last_clean":"2024-09-17T03:38:29.005592+0000","last_became_active":"2024-09-17T03:38:27.985875+0000","last_became_peered":"2024-09-17T03:38:27.985875+0000","last_unstale":"2024-09-17T03:38:29.005592+0000","last_undegraded":"2024-09-17T03:38:29.005592+0000","last_fullsized":"2024-09-17T03:38:29.005592+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:57.833285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968135+0000","last_change":"2024-09-17T03:38:27.991607+0000","last_active":"2024-09-17T03:38:28.968135+0000","last_peered":"2024-09-17T03:38:28.968135+0000","last_clean":"2024-09-17T03:38:28.968135+0000","last_became_active":"2024-09-17T03:38:27.991049+0000","last_became_peered":"2024-09-17T03:38:27.991049+0000","last_unstale":"2024-09-17T03:38:28.968135+0000","last_undegraded":"2024-09-17T03:38:28.968135+0000","last_fullsized":"2024-09-17T03:38:28.968135+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:58.834471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959408+0000","last_change":"2024-09-17T03:38:26.959408+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959408+0000","last_undegraded":"2024-09-17T03:38:26.959408+0000","last_fullsized":"2024-09-17T03:38:26.959408+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191984+0000","last_change":"2024-09-17T03:38:27.988373+0000","last_active":"2024-09-17T03:38:29.191984+0000","last_peered":"2024-09-17T03:38:29.191984+0000","last_clean":"2024-09-17T03:38:29.191984+0000","last_became_active":"2024-09-17T03:38:27.988091+0000","last_became_peered":"2024-09-17T03:38:27.988091+0000","last_unstale":"2024-09-17T03:38:29.191984+0000","last_undegraded":"2024-09-17T03:38:29.191984+0000","last_fullsized":"2024-09-17T03:38:29.191984+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.485809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960995+0000","last_change":"2024-09-17T03:38:26.960995+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960995+0000","last_undegraded":"2024-09-17T03:38:26.960995+0000","last_fullsized":"2024-09-17T03:38:26.960995+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005545+0000","last_change":"2024-09-17T03:38:27.990603+0000","last_active":"2024-09-17T03:38:29.005545+0000","last_peered":"2024-09-17T03:38:29.005545+0000","last_clean":"2024-09-17T03:38:29.005545+0000","last_became_active":"2024-09-17T03:38:27.990229+0000","last_became_peered":"2024-09-17T03:38:27.990229+0000","last_unstale":"2024-09-17T03:38:29.005545+0000","last_undegraded":"2024-09-17T03:38:29.005545+0000","last_fullsized":"2024-09-17T03:38:29.005545+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:31.242849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966926+0000","last_change":"2024-09-17T03:38:27.992645+0000","last_active":"2024-09-17T03:38:28.966926+0000","last_peered":"2024-09-17T03:38:28.966926+0000","last_clean":"2024-09-17T03:38:28.966926+0000","last_became_active":"2024-09-17T03:38:27.992350+0000","last_became_peered":"2024-09-17T03:38:27.992350+0000","last_unstale":"2024-09-17T03:38:28.966926+0000","last_undegraded":"2024-09-17T03:38:28.966926+0000","last_fullsized":"2024-09-17T03:38:28.966926+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:55.651386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960276+0000","last_change":"2024-09-17T03:38:26.960276+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960276+0000","last_undegraded":"2024-09-17T03:38:26.960276+0000","last_fullsized":"2024-09-17T03:38:26.960276+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191664+0000","last_change":"2024-09-17T03:38:27.991367+0000","last_active":"2024-09-17T03:38:29.191664+0000","last_peered":"2024-09-17T03:38:29.191664+0000","last_clean":"2024-09-17T03:38:29.191664+0000","last_became_active":"2024-09-17T03:38:27.991060+0000","last_became_peered":"2024-09-17T03:38:27.991060+0000","last_unstale":"2024-09-17T03:38:29.191664+0000","last_undegraded":"2024-09-17T03:38:29.191664+0000","last_fullsized":"2024-09-17T03:38:29.191664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:00.999192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968504+0000","last_change":"2024-09-17T03:38:27.992955+0000","last_active":"2024-09-17T03:38:28.968504+0000","last_peered":"2024-09-17T03:38:28.968504+0000","last_clean":"2024-09-17T03:38:28.968504+0000","last_became_active":"2024-09-17T03:38:27.992544+0000","last_became_peered":"2024-09-17T03:38:27.992544+0000","last_unstale":"2024-09-17T03:38:28.968504+0000","last_undegraded":"2024-09-17T03:38:28.968504+0000","last_fullsized":"2024-09-17T03:38:28.968504+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:44.129667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191473+0000","last_change":"2024-09-17T03:38:27.988660+0000","last_active":"2024-09-17T03:38:29.191473+0000","last_peered":"2024-09-17T03:38:29.191473+0000","last_clean":"2024-09-17T03:38:29.191473+0000","last_became_active":"2024-09-17T03:38:27.988148+0000","last_became_peered":"2024-09-17T03:38:27.988148+0000","last_unstale":"2024-09-17T03:38:29.191473+0000","last_undegraded":"2024-09-17T03:38:29.191473+0000","last_fullsized":"2024-09-17T03:38:29.191473+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:59.883971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966458+0000","last_change":"2024-09-17T03:38:27.982263+0000","last_active":"2024-09-17T03:38:28.966458+0000","last_peered":"2024-09-17T03:38:28.966458+0000","last_clean":"2024-09-17T03:38:28.966458+0000","last_became_active":"2024-09-17T03:38:27.981955+0000","last_became_peered":"2024-09-17T03:38:27.981955+0000","last_unstale":"2024-09-17T03:38:28.966458+0000","last_undegraded":"2024-09-17T03:38:28.966458+0000","last_fullsized":"2024-09-17T03:38:28.966458+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:31.242849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966460+0000","last_change":"2024-09-17T03:38:27.993047+0000","last_active":"2024-09-17T03:38:28.966460+0000","last_peered":"2024-09-17T03:38:28.966460+0000","last_clean":"2024-09-17T03:38:28.966460+0000","last_became_active":"2024-09-17T03:38:27.992749+0000","last_became_peered":"2024-09-17T03:38:27.992749+0000","last_unstale":"2024-09-17T03:38:28.966460+0000","last_undegraded":"2024-09-17T03:38:28.966460+0000","last_fullsized":"2024-09-17T03:38:28.966460+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:54.635556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005751+0000","last_change":"2024-09-17T03:38:27.991865+0000","last_active":"2024-09-17T03:38:29.005751+0000","last_peered":"2024-09-17T03:38:29.005751+0000","last_clean":"2024-09-17T03:38:29.005751+0000","last_became_active":"2024-09-17T03:38:27.991014+0000","last_became_peered":"2024-09-17T03:38:27.991014+0000","last_unstale":"2024-09-17T03:38:29.005751+0000","last_undegraded":"2024-09-17T03:38:29.005751+0000","last_fullsized":"2024-09-17T03:38:29.005751+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:05.316147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969343+0000","last_change":"2024-09-17T03:38:27.977682+0000","last_active":"2024-09-17T03:38:28.969343+0000","last_peered":"2024-09-17T03:38:28.969343+0000","last_clean":"2024-09-17T03:38:28.969343+0000","last_became_active":"2024-09-17T03:38:27.974243+0000","last_became_peered":"2024-09-17T03:38:27.974243+0000","last_unstale":"2024-09-17T03:38:28.969343+0000","last_undegraded":"2024-09-17T03:38:28.969343+0000","last_fullsized":"2024-09-17T03:38:28.969343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:12.240397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966965+0000","last_change":"2024-09-17T03:38:27.987923+0000","last_active":"2024-09-17T03:38:28.966965+0000","last_peered":"2024-09-17T03:38:28.966965+0000","last_clean":"2024-09-17T03:38:28.966965+0000","last_became_active":"2024-09-17T03:38:27.987631+0000","last_became_peered":"2024-09-17T03:38:27.987631+0000","last_unstale":"2024-09-17T03:38:28.966965+0000","last_undegraded":"2024-09-17T03:38:28.966965+0000","last_fullsized":"2024-09-17T03:38:28.966965+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:46.786919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005825+0000","last_change":"2024-09-17T03:38:27.983480+0000","last_active":"2024-09-17T03:38:29.005825+0000","last_peered":"2024-09-17T03:38:29.005825+0000","last_clean":"2024-09-17T03:38:29.005825+0000","last_became_active":"2024-09-17T03:38:27.983180+0000","last_became_peered":"2024-09-17T03:38:27.983180+0000","last_unstale":"2024-09-17T03:38:29.005825+0000","last_undegraded":"2024-09-17T03:38:29.005825+0000","last_fullsized":"2024-09-17T03:38:29.005825+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:50.337088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969070+0000","last_change":"2024-09-17T03:38:27.994341+0000","last_active":"2024-09-17T03:38:28.969070+0000","last_peered":"2024-09-17T03:38:28.969070+0000","last_clean":"2024-09-17T03:38:28.969070+0000","last_became_active":"2024-09-17T03:38:27.993635+0000","last_became_peered":"2024-09-17T03:38:27.993635+0000","last_unstale":"2024-09-17T03:38:28.969070+0000","last_undegraded":"2024-09-17T03:38:28.969070+0000","last_fullsized":"2024-09-17T03:38:28.969070+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:44.101251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966630+0000","last_change":"2024-09-17T03:38:27.984348+0000","last_active":"2024-09-17T03:38:28.966630+0000","last_peered":"2024-09-17T03:38:28.966630+0000","last_clean":"2024-09-17T03:38:28.966630+0000","last_became_active":"2024-09-17T03:38:27.984035+0000","last_became_peered":"2024-09-17T03:38:27.984035+0000","last_unstale":"2024-09-17T03:38:28.966630+0000","last_undegraded":"2024-09-17T03:38:28.966630+0000","last_fullsized":"2024-09-17T03:38:28.966630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:22.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191435+0000","last_change":"2024-09-17T03:38:27.992196+0000","last_active":"2024-09-17T03:38:29.191435+0000","last_peered":"2024-09-17T03:38:29.191435+0000","last_clean":"2024-09-17T03:38:29.191435+0000","last_became_active":"2024-09-17T03:38:27.991893+0000","last_became_peered":"2024-09-17T03:38:27.991893+0000","last_unstale":"2024-09-17T03:38:29.191435+0000","last_undegraded":"2024-09-17T03:38:29.191435+0000","last_fullsized":"2024-09-17T03:38:29.191435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:19.530780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960203+0000","last_change":"2024-09-17T03:38:26.960203+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960203+0000","last_undegraded":"2024-09-17T03:38:26.960203+0000","last_fullsized":"2024-09-17T03:38:26.960203+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261054+0000","last_change":"2024-09-17T03:38:27.983421+0000","last_active":"2024-09-17T03:38:29.261054+0000","last_peered":"2024-09-17T03:38:29.261054+0000","last_clean":"2024-09-17T03:38:29.261054+0000","last_became_active":"2024-09-17T03:38:27.982752+0000","last_became_peered":"2024-09-17T03:38:27.982752+0000","last_unstale":"2024-09-17T03:38:29.261054+0000","last_undegraded":"2024-09-17T03:38:29.261054+0000","last_fullsized":"2024-09-17T03:38:29.261054+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:38.478741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191740+0000","last_change":"2024-09-17T03:38:27.990173+0000","last_active":"2024-09-17T03:38:29.191740+0000","last_peered":"2024-09-17T03:38:29.191740+0000","last_clean":"2024-09-17T03:38:29.191740+0000","last_became_active":"2024-09-17T03:38:27.989859+0000","last_became_peered":"2024-09-17T03:38:27.989859+0000","last_unstale":"2024-09-17T03:38:29.191740+0000","last_undegraded":"2024-09-17T03:38:29.191740+0000","last_fullsized":"2024-09-17T03:38:29.191740+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:00.044654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"103'4","reported_seq":19,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966829+0000","last_change":"2024-09-17T03:38:26.968498+0000","last_active":"2024-09-17T03:38:28.966829+0000","last_peered":"2024-09-17T03:38:28.966829+0000","last_clean":"2024-09-17T03:38:28.966829+0000","last_became_active":"2024-09-17T03:38:26.967685+0000","last_became_peered":"2024-09-17T03:38:26.967685+0000","last_unstale":"2024-09-17T03:38:28.966829+0000","last_undegraded":"2024-09-17T03:38:28.966829+0000","last_fullsized":"2024-09-17T03:38:28.966829+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:59.918075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959494+0000","last_change":"2024-09-17T03:38:26.959494+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959494+0000","last_undegraded":"2024-09-17T03:38:26.959494+0000","last_fullsized":"2024-09-17T03:38:26.959494+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005777+0000","last_change":"2024-09-17T03:38:26.978065+0000","last_active":"2024-09-17T03:38:29.005777+0000","last_peered":"2024-09-17T03:38:29.005777+0000","last_clean":"2024-09-17T03:38:29.005777+0000","last_became_active":"2024-09-17T03:38:26.977760+0000","last_became_peered":"2024-09-17T03:38:26.977760+0000","last_unstale":"2024-09-17T03:38:29.005777+0000","last_undegraded":"2024-09-17T03:38:29.005777+0000","last_fullsized":"2024-09-17T03:38:29.005777+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:59.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262053+0000","last_change":"2024-09-17T03:38:27.990981+0000","last_active":"2024-09-17T03:38:29.262053+0000","last_peered":"2024-09-17T03:38:29.262053+0000","last_clean":"2024-09-17T03:38:29.262053+0000","last_became_active":"2024-09-17T03:38:27.990155+0000","last_became_peered":"2024-09-17T03:38:27.990155+0000","last_unstale":"2024-09-17T03:38:29.262053+0000","last_undegraded":"2024-09-17T03:38:29.262053+0000","last_fullsized":"2024-09-17T03:38:29.262053+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:14.288116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966484+0000","last_change":"2024-09-17T03:38:26.972883+0000","last_active":"2024-09-17T03:38:28.966484+0000","last_peered":"2024-09-17T03:38:28.966484+0000","last_clean":"2024-09-17T03:38:28.966484+0000","last_became_active":"2024-09-17T03:38:26.972316+0000","last_became_peered":"2024-09-17T03:38:26.972316+0000","last_unstale":"2024-09-17T03:38:28.966484+0000","last_undegraded":"2024-09-17T03:38:28.966484+0000","last_fullsized":"2024-09-17T03:38:28.966484+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:43.780561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968147+0000","last_change":"2024-09-17T03:38:27.988250+0000","last_active":"2024-09-17T03:38:28.968147+0000","last_peered":"2024-09-17T03:38:28.968147+0000","last_clean":"2024-09-17T03:38:28.968147+0000","last_became_active":"2024-09-17T03:38:27.987938+0000","last_became_peered":"2024-09-17T03:38:27.987938+0000","last_unstale":"2024-09-17T03:38:28.968147+0000","last_undegraded":"2024-09-17T03:38:28.968147+0000","last_fullsized":"2024-09-17T03:38:28.968147+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:52.687194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966709+0000","last_change":"2024-09-17T03:38:26.967614+0000","last_active":"2024-09-17T03:38:28.966709+0000","last_peered":"2024-09-17T03:38:28.966709+0000","last_clean":"2024-09-17T03:38:28.966709+0000","last_became_active":"2024-09-17T03:38:26.967289+0000","last_became_peered":"2024-09-17T03:38:26.967289+0000","last_unstale":"2024-09-17T03:38:28.966709+0000","last_undegraded":"2024-09-17T03:38:28.966709+0000","last_fullsized":"2024-09-17T03:38:28.966709+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:26.552522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.967177+0000","last_change":"2024-09-17T03:38:26.967177+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.967177+0000","last_undegraded":"2024-09-17T03:38:26.967177+0000","last_fullsized":"2024-09-17T03:38:26.967177+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262081+0000","last_change":"2024-09-17T03:38:26.971419+0000","last_active":"2024-09-17T03:38:29.262081+0000","last_peered":"2024-09-17T03:38:29.262081+0000","last_clean":"2024-09-17T03:38:29.262081+0000","last_became_active":"2024-09-17T03:38:26.971104+0000","last_became_peered":"2024-09-17T03:38:26.971104+0000","last_unstale":"2024-09-17T03:38:29.262081+0000","last_undegraded":"2024-09-17T03:38:29.262081+0000","last_fullsized":"2024-09-17T03:38:29.262081+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:17.356881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005582+0000","last_change":"2024-09-17T03:38:27.983933+0000","last_active":"2024-09-17T03:38:29.005582+0000","last_peered":"2024-09-17T03:38:29.005582+0000","last_clean":"2024-09-17T03:38:29.005582+0000","last_became_active":"2024-09-17T03:38:27.983619+0000","last_became_peered":"2024-09-17T03:38:27.983619+0000","last_unstale":"2024-09-17T03:38:29.005582+0000","last_undegraded":"2024-09-17T03:38:29.005582+0000","last_fullsized":"2024-09-17T03:38:29.005582+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:33.661852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966904+0000","last_change":"2024-09-17T03:38:26.975874+0000","last_active":"2024-09-17T03:38:28.966904+0000","last_peered":"2024-09-17T03:38:28.966904+0000","last_clean":"2024-09-17T03:38:28.966904+0000","last_became_active":"2024-09-17T03:38:26.975546+0000","last_became_peered":"2024-09-17T03:38:26.975546+0000","last_unstale":"2024-09-17T03:38:28.966904+0000","last_undegraded":"2024-09-17T03:38:28.966904+0000","last_fullsized":"2024-09-17T03:38:28.966904+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:25.915484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959308+0000","last_change":"2024-09-17T03:38:26.959308+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959308+0000","last_undegraded":"2024-09-17T03:38:26.959308+0000","last_fullsized":"2024-09-17T03:38:26.959308+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967993+0000","last_change":"2024-09-17T03:38:26.968875+0000","last_active":"2024-09-17T03:38:28.967993+0000","last_peered":"2024-09-17T03:38:28.967993+0000","last_clean":"2024-09-17T03:38:28.967993+0000","last_became_active":"2024-09-17T03:38:26.968513+0000","last_became_peered":"2024-09-17T03:38:26.968513+0000","last_unstale":"2024-09-17T03:38:28.967993+0000","last_undegraded":"2024-09-17T03:38:28.967993+0000","last_fullsized":"2024-09-17T03:38:28.967993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:22.278430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968198+0000","last_change":"2024-09-17T03:38:27.987700+0000","last_active":"2024-09-17T03:38:28.968198+0000","last_peered":"2024-09-17T03:38:28.968198+0000","last_clean":"2024-09-17T03:38:28.968198+0000","last_became_active":"2024-09-17T03:38:27.987324+0000","last_became_peered":"2024-09-17T03:38:27.987324+0000","last_unstale":"2024-09-17T03:38:28.968198+0000","last_undegraded":"2024-09-17T03:38:28.968198+0000","last_fullsized":"2024-09-17T03:38:28.968198+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:52.164705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261246+0000","last_change":"2024-09-17T03:38:26.970105+0000","last_active":"2024-09-17T03:38:29.261246+0000","last_peered":"2024-09-17T03:38:29.261246+0000","last_clean":"2024-09-17T03:38:29.261246+0000","last_became_active":"2024-09-17T03:38:26.969797+0000","last_became_peered":"2024-09-17T03:38:26.969797+0000","last_unstale":"2024-09-17T03:38:29.261246+0000","last_undegraded":"2024-09-17T03:38:29.261246+0000","last_fullsized":"2024-09-17T03:38:29.261246+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:58.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967075+0000","last_change":"2024-09-17T03:38:27.973929+0000","last_active":"2024-09-17T03:38:28.967075+0000","last_peered":"2024-09-17T03:38:28.967075+0000","last_clean":"2024-09-17T03:38:28.967075+0000","last_became_active":"2024-09-17T03:38:27.973613+0000","last_became_peered":"2024-09-17T03:38:27.973613+0000","last_unstale":"2024-09-17T03:38:28.967075+0000","last_undegraded":"2024-09-17T03:38:28.967075+0000","last_fullsized":"2024-09-17T03:38:28.967075+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:22.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262126+0000","last_change":"2024-09-17T03:38:26.972647+0000","last_active":"2024-09-17T03:38:29.262126+0000","last_peered":"2024-09-17T03:38:29.262126+0000","last_clean":"2024-09-17T03:38:29.262126+0000","last_became_active":"2024-09-17T03:38:26.972292+0000","last_became_peered":"2024-09-17T03:38:26.972292+0000","last_unstale":"2024-09-17T03:38:29.262126+0000","last_undegraded":"2024-09-17T03:38:29.262126+0000","last_fullsized":"2024-09-17T03:38:29.262126+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:37.378067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968189+0000","last_change":"2024-09-17T03:38:27.987131+0000","last_active":"2024-09-17T03:38:28.968189+0000","last_peered":"2024-09-17T03:38:28.968189+0000","last_clean":"2024-09-17T03:38:28.968189+0000","last_became_active":"2024-09-17T03:38:27.985984+0000","last_became_peered":"2024-09-17T03:38:27.985984+0000","last_unstale":"2024-09-17T03:38:28.968189+0000","last_undegraded":"2024-09-17T03:38:28.968189+0000","last_fullsized":"2024-09-17T03:38:28.968189+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:29.538764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.978751+0000","last_change":"2024-09-17T03:38:26.969005+0000","last_active":"2024-09-17T03:38:26.978751+0000","last_peered":"2024-09-17T03:38:26.978751+0000","last_clean":"2024-09-17T03:38:26.978751+0000","last_became_active":"2024-09-17T03:38:26.968705+0000","last_became_peered":"2024-09-17T03:38:26.968705+0000","last_unstale":"2024-09-17T03:38:26.978751+0000","last_undegraded":"2024-09-17T03:38:26.978751+0000","last_fullsized":"2024-09-17T03:38:26.978751+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:56.364923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969036+0000","last_change":"2024-09-17T03:38:27.974699+0000","last_active":"2024-09-17T03:38:28.969036+0000","last_peered":"2024-09-17T03:38:28.969036+0000","last_clean":"2024-09-17T03:38:28.969036+0000","last_became_active":"2024-09-17T03:38:27.974349+0000","last_became_peered":"2024-09-17T03:38:27.974349+0000","last_unstale":"2024-09-17T03:38:28.969036+0000","last_undegraded":"2024-09-17T03:38:28.969036+0000","last_fullsized":"2024-09-17T03:38:28.969036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:35.927783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"103'3","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.006024+0000","last_change":"2024-09-17T03:38:26.976206+0000","last_active":"2024-09-17T03:38:29.006024+0000","last_peered":"2024-09-17T03:38:29.006024+0000","last_clean":"2024-09-17T03:38:29.006024+0000","last_became_active":"2024-09-17T03:38:26.975880+0000","last_became_peered":"2024-09-17T03:38:26.975880+0000","last_unstale":"2024-09-17T03:38:29.006024+0000","last_undegraded":"2024-09-17T03:38:29.006024+0000","last_fullsized":"2024-09-17T03:38:29.006024+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:35.608702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005888+0000","last_change":"2024-09-17T03:38:27.992658+0000","last_active":"2024-09-17T03:38:29.005888+0000","last_peered":"2024-09-17T03:38:29.005888+0000","last_clean":"2024-09-17T03:38:29.005888+0000","last_became_active":"2024-09-17T03:38:27.992329+0000","last_became_peered":"2024-09-17T03:38:27.992329+0000","last_unstale":"2024-09-17T03:38:29.005888+0000","last_undegraded":"2024-09-17T03:38:29.005888+0000","last_fullsized":"2024-09-17T03:38:29.005888+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:49.376138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"103'6","reported_seq":21,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968653+0000","last_change":"2024-09-17T03:38:26.970950+0000","last_active":"2024-09-17T03:38:28.968653+0000","last_peered":"2024-09-17T03:38:28.968653+0000","last_clean":"2024-09-17T03:38:28.968653+0000","last_became_active":"2024-09-17T03:38:26.970571+0000","last_became_peered":"2024-09-17T03:38:26.970571+0000","last_unstale":"2024-09-17T03:38:28.968653+0000","last_undegraded":"2024-09-17T03:38:28.968653+0000","last_fullsized":"2024-09-17T03:38:28.968653+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:19.026536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.958703+0000","last_change":"2024-09-17T03:38:26.958703+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.958703+0000","last_undegraded":"2024-09-17T03:38:26.958703+0000","last_fullsized":"2024-09-17T03:38:26.958703+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191737+0000","last_change":"2024-09-17T03:38:26.974447+0000","last_active":"2024-09-17T03:38:29.191737+0000","last_peered":"2024-09-17T03:38:29.191737+0000","last_clean":"2024-09-17T03:38:29.191737+0000","last_became_active":"2024-09-17T03:38:26.973897+0000","last_became_peered":"2024-09-17T03:38:26.973897+0000","last_unstale":"2024-09-17T03:38:29.191737+0000","last_undegraded":"2024-09-17T03:38:29.191737+0000","last_fullsized":"2024-09-17T03:38:29.191737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:15.443030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261947+0000","last_change":"2024-09-17T03:38:27.990618+0000","last_active":"2024-09-17T03:38:29.261947+0000","last_peered":"2024-09-17T03:38:29.261947+0000","last_clean":"2024-09-17T03:38:29.261947+0000","last_became_active":"2024-09-17T03:38:27.990303+0000","last_became_peered":"2024-09-17T03:38:27.990303+0000","last_unstale":"2024-09-17T03:38:29.261947+0000","last_undegraded":"2024-09-17T03:38:29.261947+0000","last_fullsized":"2024-09-17T03:38:29.261947+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:47.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.192048+0000","last_change":"2024-09-17T03:38:26.974800+0000","last_active":"2024-09-17T03:38:29.192048+0000","last_peered":"2024-09-17T03:38:29.192048+0000","last_clean":"2024-09-17T03:38:29.192048+0000","last_became_active":"2024-09-17T03:38:26.973636+0000","last_became_peered":"2024-09-17T03:38:26.973636+0000","last_unstale":"2024-09-17T03:38:29.192048+0000","last_undegraded":"2024-09-17T03:38:29.192048+0000","last_fullsized":"2024-09-17T03:38:29.192048+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:24.347945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967612+0000","last_change":"2024-09-17T03:38:27.981267+0000","last_active":"2024-09-17T03:38:28.967612+0000","last_peered":"2024-09-17T03:38:28.967612+0000","last_clean":"2024-09-17T03:38:28.967612+0000","last_became_active":"2024-09-17T03:38:27.980948+0000","last_became_peered":"2024-09-17T03:38:27.980948+0000","last_unstale":"2024-09-17T03:38:28.967612+0000","last_undegraded":"2024-09-17T03:38:28.967612+0000","last_fullsized":"2024-09-17T03:38:28.967612+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:00.923679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967685+0000","last_change":"2024-09-17T03:38:26.967641+0000","last_active":"2024-09-17T03:38:28.967685+0000","last_peered":"2024-09-17T03:38:28.967685+0000","last_clean":"2024-09-17T03:38:28.967685+0000","last_became_active":"2024-09-17T03:38:26.967327+0000","last_became_peered":"2024-09-17T03:38:26.967327+0000","last_unstale":"2024-09-17T03:38:28.967685+0000","last_undegraded":"2024-09-17T03:38:28.967685+0000","last_fullsized":"2024-09-17T03:38:28.967685+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:29.998335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191642+0000","last_change":"2024-09-17T03:38:27.996101+0000","last_active":"2024-09-17T03:38:29.191642+0000","last_peered":"2024-09-17T03:38:29.191642+0000","last_clean":"2024-09-17T03:38:29.191642+0000","last_became_active":"2024-09-17T03:38:27.995788+0000","last_became_peered":"2024-09-17T03:38:27.995788+0000","last_unstale":"2024-09-17T03:38:29.191642+0000","last_undegraded":"2024-09-17T03:38:29.191642+0000","last_fullsized":"2024-09-17T03:38:29.191642+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:15.921214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"103'8","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261364+0000","last_change":"2024-09-17T03:38:26.970998+0000","last_active":"2024-09-17T03:38:29.261364+0000","last_peered":"2024-09-17T03:38:29.261364+0000","last_clean":"2024-09-17T03:38:29.261364+0000","last_became_active":"2024-09-17T03:38:26.970693+0000","last_became_peered":"2024-09-17T03:38:26.970693+0000","last_unstale":"2024-09-17T03:38:29.261364+0000","last_undegraded":"2024-09-17T03:38:29.261364+0000","last_fullsized":"2024-09-17T03:38:29.261364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:21.604318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969341+0000","last_change":"2024-09-17T03:38:27.972622+0000","last_active":"2024-09-17T03:38:28.969341+0000","last_peered":"2024-09-17T03:38:28.969341+0000","last_clean":"2024-09-17T03:38:28.969341+0000","last_became_active":"2024-09-17T03:38:27.972170+0000","last_became_peered":"2024-09-17T03:38:27.972170+0000","last_unstale":"2024-09-17T03:38:28.969341+0000","last_undegraded":"2024-09-17T03:38:28.969341+0000","last_fullsized":"2024-09-17T03:38:28.969341+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:42.671301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968039+0000","last_change":"2024-09-17T03:38:26.974319+0000","last_active":"2024-09-17T03:38:28.968039+0000","last_peered":"2024-09-17T03:38:28.968039+0000","last_clean":"2024-09-17T03:38:28.968039+0000","last_became_active":"2024-09-17T03:38:26.974008+0000","last_became_peered":"2024-09-17T03:38:26.974008+0000","last_unstale":"2024-09-17T03:38:28.968039+0000","last_undegraded":"2024-09-17T03:38:28.968039+0000","last_fullsized":"2024-09-17T03:38:28.968039+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:15.506982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.965545+0000","last_change":"2024-09-17T03:38:26.965545+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.965545+0000","last_undegraded":"2024-09-17T03:38:26.965545+0000","last_fullsized":"2024-09-17T03:38:26.965545+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968860+0000","last_change":"2024-09-17T03:38:26.972839+0000","last_active":"2024-09-17T03:38:28.968860+0000","last_peered":"2024-09-17T03:38:28.968860+0000","last_clean":"2024-09-17T03:38:28.968860+0000","last_became_active":"2024-09-17T03:38:26.972478+0000","last_became_peered":"2024-09-17T03:38:26.972478+0000","last_unstale":"2024-09-17T03:38:28.968860+0000","last_undegraded":"2024-09-17T03:38:28.968860+0000","last_fullsized":"2024-09-17T03:38:28.968860+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:36.480429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005983+0000","last_change":"2024-09-17T03:38:27.991905+0000","last_active":"2024-09-17T03:38:29.005983+0000","last_peered":"2024-09-17T03:38:29.005983+0000","last_clean":"2024-09-17T03:38:29.005983+0000","last_became_active":"2024-09-17T03:38:27.991253+0000","last_became_peered":"2024-09-17T03:38:27.991253+0000","last_unstale":"2024-09-17T03:38:29.005983+0000","last_undegraded":"2024-09-17T03:38:29.005983+0000","last_fullsized":"2024-09-17T03:38:29.005983+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:47.703166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966712+0000","last_change":"2024-09-17T03:38:26.966582+0000","last_active":"2024-09-17T03:38:28.966712+0000","last_peered":"2024-09-17T03:38:28.966712+0000","last_clean":"2024-09-17T03:38:28.966712+0000","last_became_active":"2024-09-17T03:38:26.966236+0000","last_became_peered":"2024-09-17T03:38:26.966236+0000","last_unstale":"2024-09-17T03:38:28.966712+0000","last_undegraded":"2024-09-17T03:38:28.966712+0000","last_fullsized":"2024-09-17T03:38:28.966712+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.908196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191936+0000","last_change":"2024-09-17T03:38:27.998470+0000","last_active":"2024-09-17T03:38:29.191936+0000","last_peered":"2024-09-17T03:38:29.191936+0000","last_clean":"2024-09-17T03:38:29.191936+0000","last_became_active":"2024-09-17T03:38:27.998141+0000","last_became_peered":"2024-09-17T03:38:27.998141+0000","last_unstale":"2024-09-17T03:38:29.191936+0000","last_undegraded":"2024-09-17T03:38:29.191936+0000","last_fullsized":"2024-09-17T03:38:29.191936+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:21.927496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966717+0000","last_change":"2024-09-17T03:38:26.976542+0000","last_active":"2024-09-17T03:38:28.966717+0000","last_peered":"2024-09-17T03:38:28.966717+0000","last_clean":"2024-09-17T03:38:28.966717+0000","last_became_active":"2024-09-17T03:38:26.976209+0000","last_became_peered":"2024-09-17T03:38:26.976209+0000","last_unstale":"2024-09-17T03:38:28.966717+0000","last_undegraded":"2024-09-17T03:38:28.966717+0000","last_fullsized":"2024-09-17T03:38:28.966717+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:45.010470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191554+0000","last_change":"2024-09-17T03:38:27.989123+0000","last_active":"2024-09-17T03:38:29.191554+0000","last_peered":"2024-09-17T03:38:29.191554+0000","last_clean":"2024-09-17T03:38:29.191554+0000","last_became_active":"2024-09-17T03:38:27.987713+0000","last_became_peered":"2024-09-17T03:38:27.987713+0000","last_unstale":"2024-09-17T03:38:29.191554+0000","last_undegraded":"2024-09-17T03:38:29.191554+0000","last_fullsized":"2024-09-17T03:38:29.191554+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:59.793518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.974364+0000","last_change":"2024-09-17T03:38:26.973805+0000","last_active":"2024-09-17T03:38:26.974364+0000","last_peered":"2024-09-17T03:38:26.974364+0000","last_clean":"2024-09-17T03:38:26.974364+0000","last_became_active":"2024-09-17T03:38:26.973309+0000","last_became_peered":"2024-09-17T03:38:26.973309+0000","last_unstale":"2024-09-17T03:38:26.974364+0000","last_undegraded":"2024-09-17T03:38:26.974364+0000","last_fullsized":"2024-09-17T03:38:26.974364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:29.550285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191418+0000","last_change":"2024-09-17T03:38:27.998634+0000","last_active":"2024-09-17T03:38:29.191418+0000","last_peered":"2024-09-17T03:38:29.191418+0000","last_clean":"2024-09-17T03:38:29.191418+0000","last_became_active":"2024-09-17T03:38:27.998367+0000","last_became_peered":"2024-09-17T03:38:27.998367+0000","last_unstale":"2024-09-17T03:38:29.191418+0000","last_undegraded":"2024-09-17T03:38:29.191418+0000","last_fullsized":"2024-09-17T03:38:29.191418+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:21.126756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.973606+0000","last_change":"2024-09-17T03:38:26.971443+0000","last_active":"2024-09-17T03:38:26.973606+0000","last_peered":"2024-09-17T03:38:26.973606+0000","last_clean":"2024-09-17T03:38:26.973606+0000","last_became_active":"2024-09-17T03:38:26.971141+0000","last_became_peered":"2024-09-17T03:38:26.971141+0000","last_unstale":"2024-09-17T03:38:26.973606+0000","last_undegraded":"2024-09-17T03:38:26.973606+0000","last_fullsized":"2024-09-17T03:38:26.973606+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:16.383373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967668+0000","last_change":"2024-09-17T03:38:27.982133+0000","last_active":"2024-09-17T03:38:28.967668+0000","last_peered":"2024-09-17T03:38:28.967668+0000","last_clean":"2024-09-17T03:38:28.967668+0000","last_became_active":"2024-09-17T03:38:27.981801+0000","last_became_peered":"2024-09-17T03:38:27.981801+0000","last_unstale":"2024-09-17T03:38:28.967668+0000","last_undegraded":"2024-09-17T03:38:28.967668+0000","last_fullsized":"2024-09-17T03:38:28.967668+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:17.462936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966389+0000","last_change":"2024-09-17T03:38:26.974657+0000","last_active":"2024-09-17T03:38:28.966389+0000","last_peered":"2024-09-17T03:38:28.966389+0000","last_clean":"2024-09-17T03:38:28.966389+0000","last_became_active":"2024-09-17T03:38:26.973955+0000","last_became_peered":"2024-09-17T03:38:26.973955+0000","last_unstale":"2024-09-17T03:38:28.966389+0000","last_undegraded":"2024-09-17T03:38:28.966389+0000","last_fullsized":"2024-09-17T03:38:28.966389+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:23.286979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967097+0000","last_change":"2024-09-17T03:38:27.990530+0000","last_active":"2024-09-17T03:38:28.967097+0000","last_peered":"2024-09-17T03:38:28.967097+0000","last_clean":"2024-09-17T03:38:28.967097+0000","last_became_active":"2024-09-17T03:38:27.990225+0000","last_became_peered":"2024-09-17T03:38:27.990225+0000","last_unstale":"2024-09-17T03:38:28.967097+0000","last_undegraded":"2024-09-17T03:38:28.967097+0000","last_fullsized":"2024-09-17T03:38:28.967097+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:05.637779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.977151+0000","last_change":"2024-09-17T03:38:26.974776+0000","last_active":"2024-09-17T03:38:26.977151+0000","last_peered":"2024-09-17T03:38:26.977151+0000","last_clean":"2024-09-17T03:38:26.977151+0000","last_became_active":"2024-09-17T03:38:26.974459+0000","last_became_peered":"2024-09-17T03:38:26.974459+0000","last_unstale":"2024-09-17T03:38:26.977151+0000","last_undegraded":"2024-09-17T03:38:26.977151+0000","last_fullsized":"2024-09-17T03:38:26.977151+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:40.028883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262162+0000","last_change":"2024-09-17T03:38:27.990635+0000","last_active":"2024-09-17T03:38:29.262162+0000","last_peered":"2024-09-17T03:38:29.262162+0000","last_clean":"2024-09-17T03:38:29.262162+0000","last_became_active":"2024-09-17T03:38:27.990326+0000","last_became_peered":"2024-09-17T03:38:27.990326+0000","last_unstale":"2024-09-17T03:38:29.262162+0000","last_undegraded":"2024-09-17T03:38:29.262162+0000","last_fullsized":"2024-09-17T03:38:29.262162+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:11.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967149+0000","last_change":"2024-09-17T03:38:26.974661+0000","last_active":"2024-09-17T03:38:28.967149+0000","last_peered":"2024-09-17T03:38:28.967149+0000","last_clean":"2024-09-17T03:38:28.967149+0000","last_became_active":"2024-09-17T03:38:26.974345+0000","last_became_peered":"2024-09-17T03:38:26.974345+0000","last_unstale":"2024-09-17T03:38:28.967149+0000","last_undegraded":"2024-09-17T03:38:28.967149+0000","last_fullsized":"2024-09-17T03:38:28.967149+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:59.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262108+0000","last_change":"2024-09-17T03:38:27.983385+0000","last_active":"2024-09-17T03:38:29.262108+0000","last_peered":"2024-09-17T03:38:29.262108+0000","last_clean":"2024-09-17T03:38:29.262108+0000","last_became_active":"2024-09-17T03:38:27.982698+0000","last_became_peered":"2024-09-17T03:38:27.982698+0000","last_unstale":"2024-09-17T03:38:29.262108+0000","last_undegraded":"2024-09-17T03:38:29.262108+0000","last_fullsized":"2024-09-17T03:38:29.262108+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:13.426190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966637+0000","last_change":"2024-09-17T03:38:26.965679+0000","last_active":"2024-09-17T03:38:28.966637+0000","last_peered":"2024-09-17T03:38:28.966637+0000","last_clean":"2024-09-17T03:38:28.966637+0000","last_became_active":"2024-09-17T03:38:26.965356+0000","last_became_peered":"2024-09-17T03:38:26.965356+0000","last_unstale":"2024-09-17T03:38:28.966637+0000","last_undegraded":"2024-09-17T03:38:28.966637+0000","last_fullsized":"2024-09-17T03:38:28.966637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:04.970216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968941+0000","last_change":"2024-09-17T03:38:27.993766+0000","last_active":"2024-09-17T03:38:28.968941+0000","last_peered":"2024-09-17T03:38:28.968941+0000","last_clean":"2024-09-17T03:38:28.968941+0000","last_became_active":"2024-09-17T03:38:27.993432+0000","last_became_peered":"2024-09-17T03:38:27.993432+0000","last_unstale":"2024-09-17T03:38:28.968941+0000","last_undegraded":"2024-09-17T03:38:28.968941+0000","last_fullsized":"2024-09-17T03:38:28.968941+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:45.247320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969217+0000","last_change":"2024-09-17T03:38:26.970931+0000","last_active":"2024-09-17T03:38:28.969217+0000","last_peered":"2024-09-17T03:38:28.969217+0000","last_clean":"2024-09-17T03:38:28.969217+0000","last_became_active":"2024-09-17T03:38:26.970604+0000","last_became_peered":"2024-09-17T03:38:26.970604+0000","last_unstale":"2024-09-17T03:38:28.969217+0000","last_undegraded":"2024-09-17T03:38:28.969217+0000","last_fullsized":"2024-09-17T03:38:28.969217+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:52.328415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.192172+0000","last_change":"2024-09-17T03:38:27.994165+0000","last_active":"2024-09-17T03:38:29.192172+0000","last_peered":"2024-09-17T03:38:29.192172+0000","last_clean":"2024-09-17T03:38:29.192172+0000","last_became_active":"2024-09-17T03:38:27.993861+0000","last_became_peered":"2024-09-17T03:38:27.993861+0000","last_unstale":"2024-09-17T03:38:29.192172+0000","last_undegraded":"2024-09-17T03:38:29.192172+0000","last_fullsized":"2024-09-17T03:38:29.192172+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:33.720992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966741+0000","last_change":"2024-09-17T03:38:26.970499+0000","last_active":"2024-09-17T03:38:28.966741+0000","last_peered":"2024-09-17T03:38:28.966741+0000","last_clean":"2024-09-17T03:38:28.966741+0000","last_became_active":"2024-09-17T03:38:26.970128+0000","last_became_peered":"2024-09-17T03:38:26.970128+0000","last_unstale":"2024-09-17T03:38:28.966741+0000","last_undegraded":"2024-09-17T03:38:28.966741+0000","last_fullsized":"2024-09-17T03:38:28.966741+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:43.177282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967999+0000","last_change":"2024-09-17T03:38:27.971482+0000","last_active":"2024-09-17T03:38:28.967999+0000","last_peered":"2024-09-17T03:38:28.967999+0000","last_clean":"2024-09-17T03:38:28.967999+0000","last_became_active":"2024-09-17T03:38:27.971124+0000","last_became_peered":"2024-09-17T03:38:27.971124+0000","last_unstale":"2024-09-17T03:38:28.967999+0000","last_undegraded":"2024-09-17T03:38:28.967999+0000","last_fullsized":"2024-09-17T03:38:28.967999+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:00.365080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968381+0000","last_change":"2024-09-17T03:38:26.974041+0000","last_active":"2024-09-17T03:38:28.968381+0000","last_peered":"2024-09-17T03:38:28.968381+0000","last_clean":"2024-09-17T03:38:28.968381+0000","last_became_active":"2024-09-17T03:38:26.973115+0000","last_became_peered":"2024-09-17T03:38:26.973115+0000","last_unstale":"2024-09-17T03:38:28.968381+0000","last_undegraded":"2024-09-17T03:38:28.968381+0000","last_fullsized":"2024-09-17T03:38:28.968381+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:33.987282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191435+0000","last_change":"2024-09-17T03:38:27.996142+0000","last_active":"2024-09-17T03:38:29.191435+0000","last_peered":"2024-09-17T03:38:29.191435+0000","last_clean":"2024-09-17T03:38:29.191435+0000","last_became_active":"2024-09-17T03:38:27.995822+0000","last_became_peered":"2024-09-17T03:38:27.995822+0000","last_unstale":"2024-09-17T03:38:29.191435+0000","last_undegraded":"2024-09-17T03:38:29.191435+0000","last_fullsized":"2024-09-17T03:38:29.191435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:04.315528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.977968+0000","last_change":"2024-09-17T03:38:26.969822+0000","last_active":"2024-09-17T03:38:26.977968+0000","last_peered":"2024-09-17T03:38:26.977968+0000","last_clean":"2024-09-17T03:38:26.977968+0000","last_became_active":"2024-09-17T03:38:26.969461+0000","last_became_peered":"2024-09-17T03:38:26.969461+0000","last_unstale":"2024-09-17T03:38:26.977968+0000","last_undegraded":"2024-09-17T03:38:26.977968+0000","last_fullsized":"2024-09-17T03:38:26.977968+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:34.065975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967882+0000","last_change":"2024-09-17T03:38:27.993971+0000","last_active":"2024-09-17T03:38:28.967882+0000","last_peered":"2024-09-17T03:38:28.967882+0000","last_clean":"2024-09-17T03:38:28.967882+0000","last_became_active":"2024-09-17T03:38:27.993620+0000","last_became_peered":"2024-09-17T03:38:27.993620+0000","last_unstale":"2024-09-17T03:38:28.967882+0000","last_undegraded":"2024-09-17T03:38:28.967882+0000","last_fullsized":"2024-09-17T03:38:28.967882+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:44.121364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191565+0000","last_change":"2024-09-17T03:38:26.974988+0000","last_active":"2024-09-17T03:38:29.191565+0000","last_peered":"2024-09-17T03:38:29.191565+0000","last_clean":"2024-09-17T03:38:29.191565+0000","last_became_active":"2024-09-17T03:38:26.974315+0000","last_became_peered":"2024-09-17T03:38:26.974315+0000","last_unstale":"2024-09-17T03:38:29.191565+0000","last_undegraded":"2024-09-17T03:38:29.191565+0000","last_fullsized":"2024-09-17T03:38:29.191565+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:12.754692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191832+0000","last_change":"2024-09-17T03:38:27.998521+0000","last_active":"2024-09-17T03:38:29.191832+0000","last_peered":"2024-09-17T03:38:29.191832+0000","last_clean":"2024-09-17T03:38:29.191832+0000","last_became_active":"2024-09-17T03:38:27.998207+0000","last_became_peered":"2024-09-17T03:38:27.998207+0000","last_unstale":"2024-09-17T03:38:29.191832+0000","last_undegraded":"2024-09-17T03:38:29.191832+0000","last_fullsized":"2024-09-17T03:38:29.191832+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:22.891457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005652+0000","last_change":"2024-09-17T03:38:26.979932+0000","last_active":"2024-09-17T03:38:29.005652+0000","last_peered":"2024-09-17T03:38:29.005652+0000","last_clean":"2024-09-17T03:38:29.005652+0000","last_became_active":"2024-09-17T03:38:26.979630+0000","last_became_peered":"2024-09-17T03:38:26.979630+0000","last_unstale":"2024-09-17T03:38:29.005652+0000","last_undegraded":"2024-09-17T03:38:29.005652+0000","last_fullsized":"2024-09-17T03:38:29.005652+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:59.918075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":261,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005746+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:38:29.005746+0000","last_peered":"2024-09-17T03:38:29.005746+0000","last_clean":"2024-09-17T03:38:29.005746+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:38:29.005746+0000","last_undegraded":"2024-09-17T03:38:29.005746+0000","last_fullsized":"2024-09-17T03:38:29.005746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37184,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334656,"statfs":{"total":96636764160,"available":96598687744,"internally_reserved":0,"allocated":1880064,"data_stored":1146837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40756,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331084,"statfs":{"total":96636764160,"available":96595030016,"internally_reserved":0,"allocated":1273856,"data_stored":550709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40776,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331064,"statfs":{"total":96636764160,"available":96595009536,"internally_reserved":0,"allocated":1298432,"data_stored":558093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36596,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335244,"statfs":{"total":96636764160,"available":96599289856,"internally_reserved":0,"allocated":1269760,"data_stored":550091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40760,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331080,"statfs":{"total":96636764160,"available":96595025920,"internally_reserved":0,"allocated":1277952,"data_stored":556357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37168,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334672,"statfs":{"total":96636764160,"available":96598704128,"internally_reserved":0,"allocated":1863680,"data_stored":1141007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1241088,"data_stored":537007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1241088,"data_stored":537007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:38:31.697 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3c is not active+clean 2024-09-17T03:38:31.697 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:38:26.958780+0000', 'last_change': '2024-09-17T03:38:26.958780+0000', 'last_active': '2024-09-17T03:38:26.949525+0000', 'last_peered': '2024-09-17T03:38:26.949525+0000', 'last_clean': '2024-09-17T03:38:26.949525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:38:26.958780+0000', 'last_undegraded': '2024-09-17T03:38:26.958780+0000', 'last_fullsized': '2024-09-17T03:38:26.958780+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_clean_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:38:31.697 INFO:tasks.ceph.ceph_manager.ceph:PG 15.33 is not active+clean 2024-09-17T03:38:31.697 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:38:26.959408+0000', 'last_change': '2024-09-17T03:38:26.959408+0000', 'last_active': '2024-09-17T03:38:26.949525+0000', 'last_peered': '2024-09-17T03:38:26.949525+0000', 'last_clean': '2024-09-17T03:38:26.949525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:38:26.959408+0000', 'last_undegraded': '2024-09-17T03:38:26.959408+0000', 'last_fullsized': '2024-09-17T03:38:26.959408+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_clean_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:38:31.697 INFO:tasks.ceph.ceph_manager.ceph:PG 15.31 is not active+clean 2024-09-17T03:38:31.698 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:38:26.960995+0000', 'last_change': '2024-09-17T03:38:26.960995+0000', 'last_active': '2024-09-17T03:38:26.949525+0000', 'last_peered': '2024-09-17T03:38:26.949525+0000', 'last_clean': '2024-09-17T03:38:26.949525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:38:26.960995+0000', 'last_undegraded': '2024-09-17T03:38:26.960995+0000', 'last_fullsized': '2024-09-17T03:38:26.960995+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_clean_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:38:31.698 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2e is not active+clean 2024-09-17T03:38:31.698 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:38:26.960276+0000', 'last_change': '2024-09-17T03:38:26.960276+0000', 'last_active': '2024-09-17T03:38:26.949525+0000', 'last_peered': '2024-09-17T03:38:26.949525+0000', 'last_clean': '2024-09-17T03:38:26.949525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:38:26.960276+0000', 'last_undegraded': '2024-09-17T03:38:26.960276+0000', 'last_fullsized': '2024-09-17T03:38:26.960276+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_clean_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:38:31.698 INFO:tasks.ceph.ceph_manager.ceph:PG 15.21 is not active+clean 2024-09-17T03:38:31.698 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:38:26.960203+0000', 'last_change': '2024-09-17T03:38:26.960203+0000', 'last_active': '2024-09-17T03:38:26.949525+0000', 'last_peered': '2024-09-17T03:38:26.949525+0000', 'last_clean': '2024-09-17T03:38:26.949525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:38:26.960203+0000', 'last_undegraded': '2024-09-17T03:38:26.960203+0000', 'last_fullsized': '2024-09-17T03:38:26.960203+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_clean_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:38:31.698 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1f is not active+clean 2024-09-17T03:38:31.698 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:38:26.959494+0000', 'last_change': '2024-09-17T03:38:26.959494+0000', 'last_active': '2024-09-17T03:38:26.949525+0000', 'last_peered': '2024-09-17T03:38:26.949525+0000', 'last_clean': '2024-09-17T03:38:26.949525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:38:26.959494+0000', 'last_undegraded': '2024-09-17T03:38:26.959494+0000', 'last_fullsized': '2024-09-17T03:38:26.959494+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_clean_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:38:31.698 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1a is not active+clean 2024-09-17T03:38:31.698 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:38:26.967177+0000', 'last_change': '2024-09-17T03:38:26.967177+0000', 'last_active': '2024-09-17T03:38:26.949525+0000', 'last_peered': '2024-09-17T03:38:26.949525+0000', 'last_clean': '2024-09-17T03:38:26.949525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:38:26.967177+0000', 'last_undegraded': '2024-09-17T03:38:26.967177+0000', 'last_fullsized': '2024-09-17T03:38:26.967177+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_clean_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:38:31.698 INFO:tasks.ceph.ceph_manager.ceph:PG 15.18 is not active+clean 2024-09-17T03:38:31.698 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:38:26.959308+0000', 'last_change': '2024-09-17T03:38:26.959308+0000', 'last_active': '2024-09-17T03:38:26.949525+0000', 'last_peered': '2024-09-17T03:38:26.949525+0000', 'last_clean': '2024-09-17T03:38:26.949525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:38:26.959308+0000', 'last_undegraded': '2024-09-17T03:38:26.959308+0000', 'last_fullsized': '2024-09-17T03:38:26.959308+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_clean_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:38:31.699 INFO:tasks.ceph.ceph_manager.ceph:PG 15.12 is not active+clean 2024-09-17T03:38:31.699 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:38:26.958703+0000', 'last_change': '2024-09-17T03:38:26.958703+0000', 'last_active': '2024-09-17T03:38:26.949525+0000', 'last_peered': '2024-09-17T03:38:26.949525+0000', 'last_clean': '2024-09-17T03:38:26.949525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:38:26.958703+0000', 'last_undegraded': '2024-09-17T03:38:26.958703+0000', 'last_fullsized': '2024-09-17T03:38:26.958703+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_clean_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:38:31.699 INFO:tasks.ceph.ceph_manager.ceph:PG 15.c is not active+clean 2024-09-17T03:38:31.699 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:38:26.965545+0000', 'last_change': '2024-09-17T03:38:26.965545+0000', 'last_active': '2024-09-17T03:38:26.949525+0000', 'last_peered': '2024-09-17T03:38:26.949525+0000', 'last_clean': '2024-09-17T03:38:26.949525+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:38:26.965545+0000', 'last_undegraded': '2024-09-17T03:38:26.965545+0000', 'last_fullsized': '2024-09-17T03:38:26.965545+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'last_clean_scrub_stamp': '2024-09-17T03:38:26.949525+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:38:31.699 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:38:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.846+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/2067954457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af4003a50 msgr2=0x7f7af4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.846+0000 7f7b0ff4a640 1 --2- 172.21.15.146:0/2067954457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af4003a50 0x7f7af4003ec0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f7b04001dc0 tx=0x7f7af4005830 comp rx=0 tx=0).stop 2024-09-17T03:38:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.846+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/2067954457 shutdown_connections 2024-09-17T03:38:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.846+0000 7f7b0ff4a640 1 --2- 172.21.15.146:0/2067954457 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af4003a50 0x7f7af4003ec0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.847+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/2067954457 >> 172.21.15.146:0/2067954457 conn(0x7f7b080b2060 msgr2=0x7f7b080b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.847+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/2067954457 shutdown_connections 2024-09-17T03:38:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.847+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/2067954457 wait complete. 2024-09-17T03:38:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.848+0000 7f7b0ff4a640 1 Processor -- start 2024-09-17T03:38:31.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.848+0000 7f7b0ff4a640 1 -- start start 2024-09-17T03:38:31.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0ff4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af4003a50 0x7f7b081f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0ff4a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b08152030 0x7f7b08154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0ff4a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b08152440 0x7f7b08154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0ff4a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0806fe10 con 0x7f7af4003a50 2024-09-17T03:38:31.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0ff4a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7b08072cf0 con 0x7f7b08152030 2024-09-17T03:38:31.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0ff4a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0806ff90 con 0x7f7b08152440 2024-09-17T03:38:31.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0dce6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af4003a50 0x7f7b081f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0dce6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af4003a50 0x7f7b081f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52918/0 (socket says 172.21.15.146:52918) 2024-09-17T03:38:31.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0dce6640 1 -- 172.21.15.146:0/3332402363 learned_addr learned my addr 172.21.15.146:0/3332402363 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0d4e5640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b08152030 0x7f7b08154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0e4e7640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b08152440 0x7f7b08154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0dce6640 1 -- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b08152440 msgr2=0x7f7b08154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0dce6640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b08152440 0x7f7b08154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0dce6640 1 -- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b08152030 msgr2=0x7f7b08154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0dce6640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b08152030 0x7f7b08154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0dce6640 1 -- 172.21.15.146:0/3332402363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b08152ad0 con 0x7f7af4003a50 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0d4e5640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b08152030 0x7f7b08154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0dce6640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af4003a50 0x7f7b081f2c70 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f7b04001ee0 tx=0x7f7b04003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7afe7fc640 1 -- 172.21.15.146:0/3332402363 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04006460 con 0x7f7af4003a50 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7afe7fc640 1 -- 172.21.15.146:0/3332402363 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b040066f0 con 0x7f7af4003a50 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/3332402363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b08152db0 con 0x7f7af4003a50 2024-09-17T03:38:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7afe7fc640 1 -- 172.21.15.146:0/3332402363 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b040336e0 con 0x7f7af4003a50 2024-09-17T03:38:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.850+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/3332402363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b08153370 con 0x7f7af4003a50 2024-09-17T03:38:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.851+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/3332402363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b080704f0 con 0x7f7af4003a50 2024-09-17T03:38:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.852+0000 7f7afe7fc640 1 -- 172.21.15.146:0/3332402363 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b04046020 con 0x7f7af4003a50 2024-09-17T03:38:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.853+0000 7f7afe7fc640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078b90 0x7f7aec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.853+0000 7f7afe7fc640 1 -- 172.21.15.146:0/3332402363 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f7b040bb0b0 con 0x7f7af4003a50 2024-09-17T03:38:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.853+0000 7f7b0d4e5640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078b90 0x7f7aec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:31.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.854+0000 7f7b0d4e5640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078b90 0x7f7aec07b0a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7af8005e50 tx=0x7f7af8005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:31.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:31.858+0000 7f7afe7fc640 1 -- 172.21.15.146:0/3332402363 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b08072fd0 con 0x7f7af4003a50 2024-09-17T03:38:32.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.104+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/3332402363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7b0815b020 con 0x7f7af4003a50 2024-09-17T03:38:32.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.104+0000 7f7afe7fc640 1 -- 172.21.15.146:0/3332402363 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1562 (secure 0 0 0) 0x7f7b04083470 con 0x7f7af4003a50 2024-09-17T03:38:32.105 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:32.105 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":356,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":104,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":87},{"state_name":"creating+peering","count":10}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":322232320,"bytes_avail":772771880960,"bytes_total":773094113280,"inactive_pgs_ratio":0.10309278219938278,"write_bytes_sec":2419,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":77,"btime":"2024-09-17T03:38:29:984393+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":7770}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-17T03:38:09.870898+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:38:32.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078b90 msgr2=0x7f7aec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:32.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078b90 0x7f7aec07b0a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7af8005e50 tx=0x7f7af8005f30 comp rx=0 tx=0).stop 2024-09-17T03:38:32.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/3332402363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af4003a50 msgr2=0x7f7b081f2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:32.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af4003a50 0x7f7b081f2c70 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f7b04001ee0 tx=0x7f7b04003aa0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/3332402363 shutdown_connections 2024-09-17T03:38:32.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7aec078b90 0x7f7aec07b0a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b08152440 0x7f7b08154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b08152030 0x7f7b08154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 --2- 172.21.15.146:0/3332402363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7af4003a50 0x7f7b081f2c70 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/3332402363 >> 172.21.15.146:0/3332402363 conn(0x7f7b080b2060 msgr2=0x7f7b0815dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:32.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/3332402363 shutdown_connections 2024-09-17T03:38:32.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.107+0000 7f7b0ff4a640 1 -- 172.21.15.146:0/3332402363 wait complete. 2024-09-17T03:38:32.118 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:38:32.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:38:32.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.231+0000 7f1086df1640 1 -- 172.21.15.146:0/3038616983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f108015b770 msgr2=0x7f108006fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:32.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.231+0000 7f1086df1640 1 --2- 172.21.15.146:0/3038616983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f108015b770 0x7f108006fe10 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f1080073c00 tx=0x7f107802aa30 comp rx=0 tx=0).stop 2024-09-17T03:38:32.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.231+0000 7f1086df1640 1 -- 172.21.15.146:0/3038616983 shutdown_connections 2024-09-17T03:38:32.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.231+0000 7f1086df1640 1 --2- 172.21.15.146:0/3038616983 >> v2:172.21.15.179:3300/0 conn(0x7f1080070350 0x7f1080072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.231+0000 7f1086df1640 1 --2- 172.21.15.146:0/3038616983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f108015b770 0x7f108006fe10 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.231+0000 7f1086df1640 1 -- 172.21.15.146:0/3038616983 >> 172.21.15.146:0/3038616983 conn(0x7f10800b2060 msgr2=0x7f10800b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:32.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.231+0000 7f1086df1640 1 -- 172.21.15.146:0/3038616983 shutdown_connections 2024-09-17T03:38:32.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.231+0000 7f1086df1640 1 -- 172.21.15.146:0/3038616983 wait complete. 2024-09-17T03:38:32.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.233+0000 7f1086df1640 1 Processor -- start 2024-09-17T03:38:32.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.233+0000 7f1086df1640 1 -- start start 2024-09-17T03:38:32.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f1086df1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1080070350 0x7f10801f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f1086df1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1080072bc0 0x7f108013f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f1086df1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f108015b770 0x7f1080155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f1086df1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f108015f9f0 con 0x7f108015b770 2024-09-17T03:38:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f1086df1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10800b5590 con 0x7f1080072bc0 2024-09-17T03:38:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f1086df1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f108015fb70 con 0x7f1080070350 2024-09-17T03:38:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f108538e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f108015b770 0x7f1080155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f108538e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f108015b770 0x7f1080155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52946/0 (socket says 172.21.15.146:52946) 2024-09-17T03:38:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f108538e640 1 -- 172.21.15.146:0/4103758751 learned_addr learned my addr 172.21.15.146:0/4103758751 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f107ffff640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1080072bc0 0x7f108013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f1084b8d640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1080070350 0x7f10801f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f108538e640 1 -- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1080070350 msgr2=0x7f10801f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f108538e640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1080070350 0x7f10801f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f108538e640 1 -- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1080072bc0 msgr2=0x7f108013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f108538e640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1080072bc0 0x7f108013f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.234+0000 7f108538e640 1 -- 172.21.15.146:0/4103758751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1080142620 con 0x7f108015b770 2024-09-17T03:38:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.235+0000 7f108538e640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f108015b770 0x7f1080155fa0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f107000c3c0 tx=0x7f107000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.235+0000 7f107d7fa640 1 -- 172.21.15.146:0/4103758751 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070017070 con 0x7f108015b770 2024-09-17T03:38:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.235+0000 7f107d7fa640 1 -- 172.21.15.146:0/4103758751 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10700053c0 con 0x7f108015b770 2024-09-17T03:38:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.235+0000 7f1086df1640 1 -- 172.21.15.146:0/4103758751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1080142900 con 0x7f108015b770 2024-09-17T03:38:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.235+0000 7f107d7fa640 1 -- 172.21.15.146:0/4103758751 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070003850 con 0x7f108015b770 2024-09-17T03:38:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.235+0000 7f1086df1640 1 -- 172.21.15.146:0/4103758751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1080142ec0 con 0x7f108015b770 2024-09-17T03:38:32.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.236+0000 7f1086df1640 1 -- 172.21.15.146:0/4103758751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1080160070 con 0x7f108015b770 2024-09-17T03:38:32.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.237+0000 7f107d7fa640 1 -- 172.21.15.146:0/4103758751 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f107001a070 con 0x7f108015b770 2024-09-17T03:38:32.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.237+0000 7f107d7fa640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 0x7f106c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:32.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.238+0000 7f107d7fa640 1 -- 172.21.15.146:0/4103758751 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1070099f50 con 0x7f108015b770 2024-09-17T03:38:32.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.238+0000 7f1084b8d640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 0x7f106c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:32.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.238+0000 7f1084b8d640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 0x7f106c07b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1078035000 tx=0x7f107803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:32.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.242+0000 7f107d7fa640 1 -- 172.21.15.146:0/4103758751 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f108015bb80 con 0x7f108015b770 2024-09-17T03:38:32.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.413+0000 7f1086df1640 1 -- 172.21.15.146:0/4103758751 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f10801f7be0 con 0x7f106c078b90 2024-09-17T03:38:32.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.417+0000 7f107d7fa640 1 -- 172.21.15.146:0/4103758751 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251638 (secure 0 0 0) 0x7f1078003970 con 0x7f106c078b90 2024-09-17T03:38:32.420 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:32.421 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:38:32.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.420+0000 7f1086df1640 1 -- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 msgr2=0x7f106c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:32.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.420+0000 7f1086df1640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 0x7f106c07b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1078035000 tx=0x7f107803b040 comp rx=0 tx=0).stop 2024-09-17T03:38:32.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.420+0000 7f1086df1640 1 -- 172.21.15.146:0/4103758751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f108015b770 msgr2=0x7f1080155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:32.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.420+0000 7f1086df1640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f108015b770 0x7f1080155fa0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f107000c3c0 tx=0x7f107000c880 comp rx=0 tx=0).stop 2024-09-17T03:38:32.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.421+0000 7f1086df1640 1 -- 172.21.15.146:0/4103758751 shutdown_connections 2024-09-17T03:38:32.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.421+0000 7f1086df1640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 0x7f106c07b0a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.421+0000 7f1086df1640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f108015b770 0x7f1080155fa0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.421+0000 7f1086df1640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1080072bc0 0x7f108013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.421+0000 7f1086df1640 1 --2- 172.21.15.146:0/4103758751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1080070350 0x7f10801f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:32.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.421+0000 7f1086df1640 1 -- 172.21.15.146:0/4103758751 >> 172.21.15.146:0/4103758751 conn(0x7f10800b2060 msgr2=0x7f108006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:32.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.421+0000 7f1086df1640 1 -- 172.21.15.146:0/4103758751 shutdown_connections 2024-09-17T03:38:32.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:32.421+0000 7f1086df1640 1 -- 172.21.15.146:0/4103758751 wait complete. 2024-09-17T03:38:32.432 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-09-17T03:38:31.876572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314680,"kb_used_data":11080,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754660040,"statfs":{"total":773094113280,"available":772771880960,"internally_reserved":0,"allocated":11345920,"data_stored":5577108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":310693425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.925759"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261975+0000","last_change":"2024-09-17T03:38:27.989901+0000","last_active":"2024-09-17T03:38:29.261975+0000","last_peered":"2024-09-17T03:38:29.261975+0000","last_clean":"2024-09-17T03:38:29.261975+0000","last_became_active":"2024-09-17T03:38:27.989603+0000","last_became_peered":"2024-09-17T03:38:27.989603+0000","last_unstale":"2024-09-17T03:38:29.261975+0000","last_undegraded":"2024-09-17T03:38:29.261975+0000","last_fullsized":"2024-09-17T03:38:29.261975+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:54.011565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966935+0000","last_change":"2024-09-17T03:38:27.992267+0000","last_active":"2024-09-17T03:38:28.966935+0000","last_peered":"2024-09-17T03:38:28.966935+0000","last_clean":"2024-09-17T03:38:28.966935+0000","last_became_active":"2024-09-17T03:38:27.991901+0000","last_became_peered":"2024-09-17T03:38:27.991901+0000","last_unstale":"2024-09-17T03:38:28.966935+0000","last_undegraded":"2024-09-17T03:38:28.966935+0000","last_fullsized":"2024-09-17T03:38:28.966935+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:24.599439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262208+0000","last_change":"2024-09-17T03:38:27.988024+0000","last_active":"2024-09-17T03:38:29.262208+0000","last_peered":"2024-09-17T03:38:29.262208+0000","last_clean":"2024-09-17T03:38:29.262208+0000","last_became_active":"2024-09-17T03:38:27.987731+0000","last_became_peered":"2024-09-17T03:38:27.987731+0000","last_unstale":"2024-09-17T03:38:29.262208+0000","last_undegraded":"2024-09-17T03:38:29.262208+0000","last_fullsized":"2024-09-17T03:38:29.262208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:38.796206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.958780+0000","last_change":"2024-09-17T03:38:26.958780+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.958780+0000","last_undegraded":"2024-09-17T03:38:26.958780+0000","last_fullsized":"2024-09-17T03:38:26.958780+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968541+0000","last_change":"2024-09-17T03:38:27.993810+0000","last_active":"2024-09-17T03:38:28.968541+0000","last_peered":"2024-09-17T03:38:28.968541+0000","last_clean":"2024-09-17T03:38:28.968541+0000","last_became_active":"2024-09-17T03:38:27.993446+0000","last_became_peered":"2024-09-17T03:38:27.993446+0000","last_unstale":"2024-09-17T03:38:28.968541+0000","last_undegraded":"2024-09-17T03:38:28.968541+0000","last_fullsized":"2024-09-17T03:38:28.968541+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:42.250236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005643+0000","last_change":"2024-09-17T03:38:27.988181+0000","last_active":"2024-09-17T03:38:29.005643+0000","last_peered":"2024-09-17T03:38:29.005643+0000","last_clean":"2024-09-17T03:38:29.005643+0000","last_became_active":"2024-09-17T03:38:27.987858+0000","last_became_peered":"2024-09-17T03:38:27.987858+0000","last_unstale":"2024-09-17T03:38:29.005643+0000","last_undegraded":"2024-09-17T03:38:29.005643+0000","last_fullsized":"2024-09-17T03:38:29.005643+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:55.651386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005728+0000","last_change":"2024-09-17T03:38:27.988069+0000","last_active":"2024-09-17T03:38:29.005728+0000","last_peered":"2024-09-17T03:38:29.005728+0000","last_clean":"2024-09-17T03:38:29.005728+0000","last_became_active":"2024-09-17T03:38:27.987720+0000","last_became_peered":"2024-09-17T03:38:27.987720+0000","last_unstale":"2024-09-17T03:38:29.005728+0000","last_undegraded":"2024-09-17T03:38:29.005728+0000","last_fullsized":"2024-09-17T03:38:29.005728+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:18.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966482+0000","last_change":"2024-09-17T03:38:27.991610+0000","last_active":"2024-09-17T03:38:28.966482+0000","last_peered":"2024-09-17T03:38:28.966482+0000","last_clean":"2024-09-17T03:38:28.966482+0000","last_became_active":"2024-09-17T03:38:27.990044+0000","last_became_peered":"2024-09-17T03:38:27.990044+0000","last_unstale":"2024-09-17T03:38:28.966482+0000","last_undegraded":"2024-09-17T03:38:28.966482+0000","last_fullsized":"2024-09-17T03:38:28.966482+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:18.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968354+0000","last_change":"2024-09-17T03:38:27.993162+0000","last_active":"2024-09-17T03:38:28.968354+0000","last_peered":"2024-09-17T03:38:28.968354+0000","last_clean":"2024-09-17T03:38:28.968354+0000","last_became_active":"2024-09-17T03:38:27.992585+0000","last_became_peered":"2024-09-17T03:38:27.992585+0000","last_unstale":"2024-09-17T03:38:28.968354+0000","last_undegraded":"2024-09-17T03:38:28.968354+0000","last_fullsized":"2024-09-17T03:38:28.968354+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:38.584725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968584+0000","last_change":"2024-09-17T03:38:27.985267+0000","last_active":"2024-09-17T03:38:28.968584+0000","last_peered":"2024-09-17T03:38:28.968584+0000","last_clean":"2024-09-17T03:38:28.968584+0000","last_became_active":"2024-09-17T03:38:27.984946+0000","last_became_peered":"2024-09-17T03:38:27.984946+0000","last_unstale":"2024-09-17T03:38:28.968584+0000","last_undegraded":"2024-09-17T03:38:28.968584+0000","last_fullsized":"2024-09-17T03:38:28.968584+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:33.593178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005592+0000","last_change":"2024-09-17T03:38:27.986243+0000","last_active":"2024-09-17T03:38:29.005592+0000","last_peered":"2024-09-17T03:38:29.005592+0000","last_clean":"2024-09-17T03:38:29.005592+0000","last_became_active":"2024-09-17T03:38:27.985875+0000","last_became_peered":"2024-09-17T03:38:27.985875+0000","last_unstale":"2024-09-17T03:38:29.005592+0000","last_undegraded":"2024-09-17T03:38:29.005592+0000","last_fullsized":"2024-09-17T03:38:29.005592+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:57.833285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968135+0000","last_change":"2024-09-17T03:38:27.991607+0000","last_active":"2024-09-17T03:38:28.968135+0000","last_peered":"2024-09-17T03:38:28.968135+0000","last_clean":"2024-09-17T03:38:28.968135+0000","last_became_active":"2024-09-17T03:38:27.991049+0000","last_became_peered":"2024-09-17T03:38:27.991049+0000","last_unstale":"2024-09-17T03:38:28.968135+0000","last_undegraded":"2024-09-17T03:38:28.968135+0000","last_fullsized":"2024-09-17T03:38:28.968135+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:58.834471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959408+0000","last_change":"2024-09-17T03:38:26.959408+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959408+0000","last_undegraded":"2024-09-17T03:38:26.959408+0000","last_fullsized":"2024-09-17T03:38:26.959408+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191984+0000","last_change":"2024-09-17T03:38:27.988373+0000","last_active":"2024-09-17T03:38:29.191984+0000","last_peered":"2024-09-17T03:38:29.191984+0000","last_clean":"2024-09-17T03:38:29.191984+0000","last_became_active":"2024-09-17T03:38:27.988091+0000","last_became_peered":"2024-09-17T03:38:27.988091+0000","last_unstale":"2024-09-17T03:38:29.191984+0000","last_undegraded":"2024-09-17T03:38:29.191984+0000","last_fullsized":"2024-09-17T03:38:29.191984+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.485809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960995+0000","last_change":"2024-09-17T03:38:26.960995+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960995+0000","last_undegraded":"2024-09-17T03:38:26.960995+0000","last_fullsized":"2024-09-17T03:38:26.960995+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005545+0000","last_change":"2024-09-17T03:38:27.990603+0000","last_active":"2024-09-17T03:38:29.005545+0000","last_peered":"2024-09-17T03:38:29.005545+0000","last_clean":"2024-09-17T03:38:29.005545+0000","last_became_active":"2024-09-17T03:38:27.990229+0000","last_became_peered":"2024-09-17T03:38:27.990229+0000","last_unstale":"2024-09-17T03:38:29.005545+0000","last_undegraded":"2024-09-17T03:38:29.005545+0000","last_fullsized":"2024-09-17T03:38:29.005545+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:31.242849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966926+0000","last_change":"2024-09-17T03:38:27.992645+0000","last_active":"2024-09-17T03:38:28.966926+0000","last_peered":"2024-09-17T03:38:28.966926+0000","last_clean":"2024-09-17T03:38:28.966926+0000","last_became_active":"2024-09-17T03:38:27.992350+0000","last_became_peered":"2024-09-17T03:38:27.992350+0000","last_unstale":"2024-09-17T03:38:28.966926+0000","last_undegraded":"2024-09-17T03:38:28.966926+0000","last_fullsized":"2024-09-17T03:38:28.966926+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:55.651386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960276+0000","last_change":"2024-09-17T03:38:26.960276+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960276+0000","last_undegraded":"2024-09-17T03:38:26.960276+0000","last_fullsized":"2024-09-17T03:38:26.960276+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191664+0000","last_change":"2024-09-17T03:38:27.991367+0000","last_active":"2024-09-17T03:38:29.191664+0000","last_peered":"2024-09-17T03:38:29.191664+0000","last_clean":"2024-09-17T03:38:29.191664+0000","last_became_active":"2024-09-17T03:38:27.991060+0000","last_became_peered":"2024-09-17T03:38:27.991060+0000","last_unstale":"2024-09-17T03:38:29.191664+0000","last_undegraded":"2024-09-17T03:38:29.191664+0000","last_fullsized":"2024-09-17T03:38:29.191664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:00.999192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968504+0000","last_change":"2024-09-17T03:38:27.992955+0000","last_active":"2024-09-17T03:38:28.968504+0000","last_peered":"2024-09-17T03:38:28.968504+0000","last_clean":"2024-09-17T03:38:28.968504+0000","last_became_active":"2024-09-17T03:38:27.992544+0000","last_became_peered":"2024-09-17T03:38:27.992544+0000","last_unstale":"2024-09-17T03:38:28.968504+0000","last_undegraded":"2024-09-17T03:38:28.968504+0000","last_fullsized":"2024-09-17T03:38:28.968504+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:44.129667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191473+0000","last_change":"2024-09-17T03:38:27.988660+0000","last_active":"2024-09-17T03:38:29.191473+0000","last_peered":"2024-09-17T03:38:29.191473+0000","last_clean":"2024-09-17T03:38:29.191473+0000","last_became_active":"2024-09-17T03:38:27.988148+0000","last_became_peered":"2024-09-17T03:38:27.988148+0000","last_unstale":"2024-09-17T03:38:29.191473+0000","last_undegraded":"2024-09-17T03:38:29.191473+0000","last_fullsized":"2024-09-17T03:38:29.191473+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:59.883971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966458+0000","last_change":"2024-09-17T03:38:27.982263+0000","last_active":"2024-09-17T03:38:28.966458+0000","last_peered":"2024-09-17T03:38:28.966458+0000","last_clean":"2024-09-17T03:38:28.966458+0000","last_became_active":"2024-09-17T03:38:27.981955+0000","last_became_peered":"2024-09-17T03:38:27.981955+0000","last_unstale":"2024-09-17T03:38:28.966458+0000","last_undegraded":"2024-09-17T03:38:28.966458+0000","last_fullsized":"2024-09-17T03:38:28.966458+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:31.242849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966460+0000","last_change":"2024-09-17T03:38:27.993047+0000","last_active":"2024-09-17T03:38:28.966460+0000","last_peered":"2024-09-17T03:38:28.966460+0000","last_clean":"2024-09-17T03:38:28.966460+0000","last_became_active":"2024-09-17T03:38:27.992749+0000","last_became_peered":"2024-09-17T03:38:27.992749+0000","last_unstale":"2024-09-17T03:38:28.966460+0000","last_undegraded":"2024-09-17T03:38:28.966460+0000","last_fullsized":"2024-09-17T03:38:28.966460+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:54.635556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005751+0000","last_change":"2024-09-17T03:38:27.991865+0000","last_active":"2024-09-17T03:38:29.005751+0000","last_peered":"2024-09-17T03:38:29.005751+0000","last_clean":"2024-09-17T03:38:29.005751+0000","last_became_active":"2024-09-17T03:38:27.991014+0000","last_became_peered":"2024-09-17T03:38:27.991014+0000","last_unstale":"2024-09-17T03:38:29.005751+0000","last_undegraded":"2024-09-17T03:38:29.005751+0000","last_fullsized":"2024-09-17T03:38:29.005751+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:05.316147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969343+0000","last_change":"2024-09-17T03:38:27.977682+0000","last_active":"2024-09-17T03:38:28.969343+0000","last_peered":"2024-09-17T03:38:28.969343+0000","last_clean":"2024-09-17T03:38:28.969343+0000","last_became_active":"2024-09-17T03:38:27.974243+0000","last_became_peered":"2024-09-17T03:38:27.974243+0000","last_unstale":"2024-09-17T03:38:28.969343+0000","last_undegraded":"2024-09-17T03:38:28.969343+0000","last_fullsized":"2024-09-17T03:38:28.969343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:12.240397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966965+0000","last_change":"2024-09-17T03:38:27.987923+0000","last_active":"2024-09-17T03:38:28.966965+0000","last_peered":"2024-09-17T03:38:28.966965+0000","last_clean":"2024-09-17T03:38:28.966965+0000","last_became_active":"2024-09-17T03:38:27.987631+0000","last_became_peered":"2024-09-17T03:38:27.987631+0000","last_unstale":"2024-09-17T03:38:28.966965+0000","last_undegraded":"2024-09-17T03:38:28.966965+0000","last_fullsized":"2024-09-17T03:38:28.966965+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:46.786919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005825+0000","last_change":"2024-09-17T03:38:27.983480+0000","last_active":"2024-09-17T03:38:29.005825+0000","last_peered":"2024-09-17T03:38:29.005825+0000","last_clean":"2024-09-17T03:38:29.005825+0000","last_became_active":"2024-09-17T03:38:27.983180+0000","last_became_peered":"2024-09-17T03:38:27.983180+0000","last_unstale":"2024-09-17T03:38:29.005825+0000","last_undegraded":"2024-09-17T03:38:29.005825+0000","last_fullsized":"2024-09-17T03:38:29.005825+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:50.337088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969070+0000","last_change":"2024-09-17T03:38:27.994341+0000","last_active":"2024-09-17T03:38:28.969070+0000","last_peered":"2024-09-17T03:38:28.969070+0000","last_clean":"2024-09-17T03:38:28.969070+0000","last_became_active":"2024-09-17T03:38:27.993635+0000","last_became_peered":"2024-09-17T03:38:27.993635+0000","last_unstale":"2024-09-17T03:38:28.969070+0000","last_undegraded":"2024-09-17T03:38:28.969070+0000","last_fullsized":"2024-09-17T03:38:28.969070+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:44.101251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966630+0000","last_change":"2024-09-17T03:38:27.984348+0000","last_active":"2024-09-17T03:38:28.966630+0000","last_peered":"2024-09-17T03:38:28.966630+0000","last_clean":"2024-09-17T03:38:28.966630+0000","last_became_active":"2024-09-17T03:38:27.984035+0000","last_became_peered":"2024-09-17T03:38:27.984035+0000","last_unstale":"2024-09-17T03:38:28.966630+0000","last_undegraded":"2024-09-17T03:38:28.966630+0000","last_fullsized":"2024-09-17T03:38:28.966630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:22.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191435+0000","last_change":"2024-09-17T03:38:27.992196+0000","last_active":"2024-09-17T03:38:29.191435+0000","last_peered":"2024-09-17T03:38:29.191435+0000","last_clean":"2024-09-17T03:38:29.191435+0000","last_became_active":"2024-09-17T03:38:27.991893+0000","last_became_peered":"2024-09-17T03:38:27.991893+0000","last_unstale":"2024-09-17T03:38:29.191435+0000","last_undegraded":"2024-09-17T03:38:29.191435+0000","last_fullsized":"2024-09-17T03:38:29.191435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:19.530780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.960203+0000","last_change":"2024-09-17T03:38:26.960203+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.960203+0000","last_undegraded":"2024-09-17T03:38:26.960203+0000","last_fullsized":"2024-09-17T03:38:26.960203+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261054+0000","last_change":"2024-09-17T03:38:27.983421+0000","last_active":"2024-09-17T03:38:29.261054+0000","last_peered":"2024-09-17T03:38:29.261054+0000","last_clean":"2024-09-17T03:38:29.261054+0000","last_became_active":"2024-09-17T03:38:27.982752+0000","last_became_peered":"2024-09-17T03:38:27.982752+0000","last_unstale":"2024-09-17T03:38:29.261054+0000","last_undegraded":"2024-09-17T03:38:29.261054+0000","last_fullsized":"2024-09-17T03:38:29.261054+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:38.478741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191740+0000","last_change":"2024-09-17T03:38:27.990173+0000","last_active":"2024-09-17T03:38:29.191740+0000","last_peered":"2024-09-17T03:38:29.191740+0000","last_clean":"2024-09-17T03:38:29.191740+0000","last_became_active":"2024-09-17T03:38:27.989859+0000","last_became_peered":"2024-09-17T03:38:27.989859+0000","last_unstale":"2024-09-17T03:38:29.191740+0000","last_undegraded":"2024-09-17T03:38:29.191740+0000","last_fullsized":"2024-09-17T03:38:29.191740+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:00.044654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"103'4","reported_seq":19,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966829+0000","last_change":"2024-09-17T03:38:26.968498+0000","last_active":"2024-09-17T03:38:28.966829+0000","last_peered":"2024-09-17T03:38:28.966829+0000","last_clean":"2024-09-17T03:38:28.966829+0000","last_became_active":"2024-09-17T03:38:26.967685+0000","last_became_peered":"2024-09-17T03:38:26.967685+0000","last_unstale":"2024-09-17T03:38:28.966829+0000","last_undegraded":"2024-09-17T03:38:28.966829+0000","last_fullsized":"2024-09-17T03:38:28.966829+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:59.918075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959494+0000","last_change":"2024-09-17T03:38:26.959494+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959494+0000","last_undegraded":"2024-09-17T03:38:26.959494+0000","last_fullsized":"2024-09-17T03:38:26.959494+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005777+0000","last_change":"2024-09-17T03:38:26.978065+0000","last_active":"2024-09-17T03:38:29.005777+0000","last_peered":"2024-09-17T03:38:29.005777+0000","last_clean":"2024-09-17T03:38:29.005777+0000","last_became_active":"2024-09-17T03:38:26.977760+0000","last_became_peered":"2024-09-17T03:38:26.977760+0000","last_unstale":"2024-09-17T03:38:29.005777+0000","last_undegraded":"2024-09-17T03:38:29.005777+0000","last_fullsized":"2024-09-17T03:38:29.005777+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:59.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262053+0000","last_change":"2024-09-17T03:38:27.990981+0000","last_active":"2024-09-17T03:38:29.262053+0000","last_peered":"2024-09-17T03:38:29.262053+0000","last_clean":"2024-09-17T03:38:29.262053+0000","last_became_active":"2024-09-17T03:38:27.990155+0000","last_became_peered":"2024-09-17T03:38:27.990155+0000","last_unstale":"2024-09-17T03:38:29.262053+0000","last_undegraded":"2024-09-17T03:38:29.262053+0000","last_fullsized":"2024-09-17T03:38:29.262053+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:14.288116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966484+0000","last_change":"2024-09-17T03:38:26.972883+0000","last_active":"2024-09-17T03:38:28.966484+0000","last_peered":"2024-09-17T03:38:28.966484+0000","last_clean":"2024-09-17T03:38:28.966484+0000","last_became_active":"2024-09-17T03:38:26.972316+0000","last_became_peered":"2024-09-17T03:38:26.972316+0000","last_unstale":"2024-09-17T03:38:28.966484+0000","last_undegraded":"2024-09-17T03:38:28.966484+0000","last_fullsized":"2024-09-17T03:38:28.966484+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:43.780561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968147+0000","last_change":"2024-09-17T03:38:27.988250+0000","last_active":"2024-09-17T03:38:28.968147+0000","last_peered":"2024-09-17T03:38:28.968147+0000","last_clean":"2024-09-17T03:38:28.968147+0000","last_became_active":"2024-09-17T03:38:27.987938+0000","last_became_peered":"2024-09-17T03:38:27.987938+0000","last_unstale":"2024-09-17T03:38:28.968147+0000","last_undegraded":"2024-09-17T03:38:28.968147+0000","last_fullsized":"2024-09-17T03:38:28.968147+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:52.687194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966709+0000","last_change":"2024-09-17T03:38:26.967614+0000","last_active":"2024-09-17T03:38:28.966709+0000","last_peered":"2024-09-17T03:38:28.966709+0000","last_clean":"2024-09-17T03:38:28.966709+0000","last_became_active":"2024-09-17T03:38:26.967289+0000","last_became_peered":"2024-09-17T03:38:26.967289+0000","last_unstale":"2024-09-17T03:38:28.966709+0000","last_undegraded":"2024-09-17T03:38:28.966709+0000","last_fullsized":"2024-09-17T03:38:28.966709+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:26.552522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.967177+0000","last_change":"2024-09-17T03:38:26.967177+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.967177+0000","last_undegraded":"2024-09-17T03:38:26.967177+0000","last_fullsized":"2024-09-17T03:38:26.967177+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262081+0000","last_change":"2024-09-17T03:38:26.971419+0000","last_active":"2024-09-17T03:38:29.262081+0000","last_peered":"2024-09-17T03:38:29.262081+0000","last_clean":"2024-09-17T03:38:29.262081+0000","last_became_active":"2024-09-17T03:38:26.971104+0000","last_became_peered":"2024-09-17T03:38:26.971104+0000","last_unstale":"2024-09-17T03:38:29.262081+0000","last_undegraded":"2024-09-17T03:38:29.262081+0000","last_fullsized":"2024-09-17T03:38:29.262081+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:17.356881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005582+0000","last_change":"2024-09-17T03:38:27.983933+0000","last_active":"2024-09-17T03:38:29.005582+0000","last_peered":"2024-09-17T03:38:29.005582+0000","last_clean":"2024-09-17T03:38:29.005582+0000","last_became_active":"2024-09-17T03:38:27.983619+0000","last_became_peered":"2024-09-17T03:38:27.983619+0000","last_unstale":"2024-09-17T03:38:29.005582+0000","last_undegraded":"2024-09-17T03:38:29.005582+0000","last_fullsized":"2024-09-17T03:38:29.005582+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:33.661852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966904+0000","last_change":"2024-09-17T03:38:26.975874+0000","last_active":"2024-09-17T03:38:28.966904+0000","last_peered":"2024-09-17T03:38:28.966904+0000","last_clean":"2024-09-17T03:38:28.966904+0000","last_became_active":"2024-09-17T03:38:26.975546+0000","last_became_peered":"2024-09-17T03:38:26.975546+0000","last_unstale":"2024-09-17T03:38:28.966904+0000","last_undegraded":"2024-09-17T03:38:28.966904+0000","last_fullsized":"2024-09-17T03:38:28.966904+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:25.915484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.959308+0000","last_change":"2024-09-17T03:38:26.959308+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.959308+0000","last_undegraded":"2024-09-17T03:38:26.959308+0000","last_fullsized":"2024-09-17T03:38:26.959308+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967993+0000","last_change":"2024-09-17T03:38:26.968875+0000","last_active":"2024-09-17T03:38:28.967993+0000","last_peered":"2024-09-17T03:38:28.967993+0000","last_clean":"2024-09-17T03:38:28.967993+0000","last_became_active":"2024-09-17T03:38:26.968513+0000","last_became_peered":"2024-09-17T03:38:26.968513+0000","last_unstale":"2024-09-17T03:38:28.967993+0000","last_undegraded":"2024-09-17T03:38:28.967993+0000","last_fullsized":"2024-09-17T03:38:28.967993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:22.278430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968198+0000","last_change":"2024-09-17T03:38:27.987700+0000","last_active":"2024-09-17T03:38:28.968198+0000","last_peered":"2024-09-17T03:38:28.968198+0000","last_clean":"2024-09-17T03:38:28.968198+0000","last_became_active":"2024-09-17T03:38:27.987324+0000","last_became_peered":"2024-09-17T03:38:27.987324+0000","last_unstale":"2024-09-17T03:38:28.968198+0000","last_undegraded":"2024-09-17T03:38:28.968198+0000","last_fullsized":"2024-09-17T03:38:28.968198+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:52.164705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261246+0000","last_change":"2024-09-17T03:38:26.970105+0000","last_active":"2024-09-17T03:38:29.261246+0000","last_peered":"2024-09-17T03:38:29.261246+0000","last_clean":"2024-09-17T03:38:29.261246+0000","last_became_active":"2024-09-17T03:38:26.969797+0000","last_became_peered":"2024-09-17T03:38:26.969797+0000","last_unstale":"2024-09-17T03:38:29.261246+0000","last_undegraded":"2024-09-17T03:38:29.261246+0000","last_fullsized":"2024-09-17T03:38:29.261246+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:58.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967075+0000","last_change":"2024-09-17T03:38:27.973929+0000","last_active":"2024-09-17T03:38:28.967075+0000","last_peered":"2024-09-17T03:38:28.967075+0000","last_clean":"2024-09-17T03:38:28.967075+0000","last_became_active":"2024-09-17T03:38:27.973613+0000","last_became_peered":"2024-09-17T03:38:27.973613+0000","last_unstale":"2024-09-17T03:38:28.967075+0000","last_undegraded":"2024-09-17T03:38:28.967075+0000","last_fullsized":"2024-09-17T03:38:28.967075+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:22.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262126+0000","last_change":"2024-09-17T03:38:26.972647+0000","last_active":"2024-09-17T03:38:29.262126+0000","last_peered":"2024-09-17T03:38:29.262126+0000","last_clean":"2024-09-17T03:38:29.262126+0000","last_became_active":"2024-09-17T03:38:26.972292+0000","last_became_peered":"2024-09-17T03:38:26.972292+0000","last_unstale":"2024-09-17T03:38:29.262126+0000","last_undegraded":"2024-09-17T03:38:29.262126+0000","last_fullsized":"2024-09-17T03:38:29.262126+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:37.378067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968189+0000","last_change":"2024-09-17T03:38:27.987131+0000","last_active":"2024-09-17T03:38:28.968189+0000","last_peered":"2024-09-17T03:38:28.968189+0000","last_clean":"2024-09-17T03:38:28.968189+0000","last_became_active":"2024-09-17T03:38:27.985984+0000","last_became_peered":"2024-09-17T03:38:27.985984+0000","last_unstale":"2024-09-17T03:38:28.968189+0000","last_undegraded":"2024-09-17T03:38:28.968189+0000","last_fullsized":"2024-09-17T03:38:28.968189+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:29.538764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.978751+0000","last_change":"2024-09-17T03:38:26.969005+0000","last_active":"2024-09-17T03:38:26.978751+0000","last_peered":"2024-09-17T03:38:26.978751+0000","last_clean":"2024-09-17T03:38:26.978751+0000","last_became_active":"2024-09-17T03:38:26.968705+0000","last_became_peered":"2024-09-17T03:38:26.968705+0000","last_unstale":"2024-09-17T03:38:26.978751+0000","last_undegraded":"2024-09-17T03:38:26.978751+0000","last_fullsized":"2024-09-17T03:38:26.978751+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:56.364923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969036+0000","last_change":"2024-09-17T03:38:27.974699+0000","last_active":"2024-09-17T03:38:28.969036+0000","last_peered":"2024-09-17T03:38:28.969036+0000","last_clean":"2024-09-17T03:38:28.969036+0000","last_became_active":"2024-09-17T03:38:27.974349+0000","last_became_peered":"2024-09-17T03:38:27.974349+0000","last_unstale":"2024-09-17T03:38:28.969036+0000","last_undegraded":"2024-09-17T03:38:28.969036+0000","last_fullsized":"2024-09-17T03:38:28.969036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:35.927783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"103'3","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.006024+0000","last_change":"2024-09-17T03:38:26.976206+0000","last_active":"2024-09-17T03:38:29.006024+0000","last_peered":"2024-09-17T03:38:29.006024+0000","last_clean":"2024-09-17T03:38:29.006024+0000","last_became_active":"2024-09-17T03:38:26.975880+0000","last_became_peered":"2024-09-17T03:38:26.975880+0000","last_unstale":"2024-09-17T03:38:29.006024+0000","last_undegraded":"2024-09-17T03:38:29.006024+0000","last_fullsized":"2024-09-17T03:38:29.006024+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:35.608702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005888+0000","last_change":"2024-09-17T03:38:27.992658+0000","last_active":"2024-09-17T03:38:29.005888+0000","last_peered":"2024-09-17T03:38:29.005888+0000","last_clean":"2024-09-17T03:38:29.005888+0000","last_became_active":"2024-09-17T03:38:27.992329+0000","last_became_peered":"2024-09-17T03:38:27.992329+0000","last_unstale":"2024-09-17T03:38:29.005888+0000","last_undegraded":"2024-09-17T03:38:29.005888+0000","last_fullsized":"2024-09-17T03:38:29.005888+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:49.376138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"103'6","reported_seq":21,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968653+0000","last_change":"2024-09-17T03:38:26.970950+0000","last_active":"2024-09-17T03:38:28.968653+0000","last_peered":"2024-09-17T03:38:28.968653+0000","last_clean":"2024-09-17T03:38:28.968653+0000","last_became_active":"2024-09-17T03:38:26.970571+0000","last_became_peered":"2024-09-17T03:38:26.970571+0000","last_unstale":"2024-09-17T03:38:28.968653+0000","last_undegraded":"2024-09-17T03:38:28.968653+0000","last_fullsized":"2024-09-17T03:38:28.968653+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:19.026536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.958703+0000","last_change":"2024-09-17T03:38:26.958703+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.958703+0000","last_undegraded":"2024-09-17T03:38:26.958703+0000","last_fullsized":"2024-09-17T03:38:26.958703+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191737+0000","last_change":"2024-09-17T03:38:26.974447+0000","last_active":"2024-09-17T03:38:29.191737+0000","last_peered":"2024-09-17T03:38:29.191737+0000","last_clean":"2024-09-17T03:38:29.191737+0000","last_became_active":"2024-09-17T03:38:26.973897+0000","last_became_peered":"2024-09-17T03:38:26.973897+0000","last_unstale":"2024-09-17T03:38:29.191737+0000","last_undegraded":"2024-09-17T03:38:29.191737+0000","last_fullsized":"2024-09-17T03:38:29.191737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:15.443030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261947+0000","last_change":"2024-09-17T03:38:27.990618+0000","last_active":"2024-09-17T03:38:29.261947+0000","last_peered":"2024-09-17T03:38:29.261947+0000","last_clean":"2024-09-17T03:38:29.261947+0000","last_became_active":"2024-09-17T03:38:27.990303+0000","last_became_peered":"2024-09-17T03:38:27.990303+0000","last_unstale":"2024-09-17T03:38:29.261947+0000","last_undegraded":"2024-09-17T03:38:29.261947+0000","last_fullsized":"2024-09-17T03:38:29.261947+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:47.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.192048+0000","last_change":"2024-09-17T03:38:26.974800+0000","last_active":"2024-09-17T03:38:29.192048+0000","last_peered":"2024-09-17T03:38:29.192048+0000","last_clean":"2024-09-17T03:38:29.192048+0000","last_became_active":"2024-09-17T03:38:26.973636+0000","last_became_peered":"2024-09-17T03:38:26.973636+0000","last_unstale":"2024-09-17T03:38:29.192048+0000","last_undegraded":"2024-09-17T03:38:29.192048+0000","last_fullsized":"2024-09-17T03:38:29.192048+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:24.347945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967612+0000","last_change":"2024-09-17T03:38:27.981267+0000","last_active":"2024-09-17T03:38:28.967612+0000","last_peered":"2024-09-17T03:38:28.967612+0000","last_clean":"2024-09-17T03:38:28.967612+0000","last_became_active":"2024-09-17T03:38:27.980948+0000","last_became_peered":"2024-09-17T03:38:27.980948+0000","last_unstale":"2024-09-17T03:38:28.967612+0000","last_undegraded":"2024-09-17T03:38:28.967612+0000","last_fullsized":"2024-09-17T03:38:28.967612+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:00.923679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967685+0000","last_change":"2024-09-17T03:38:26.967641+0000","last_active":"2024-09-17T03:38:28.967685+0000","last_peered":"2024-09-17T03:38:28.967685+0000","last_clean":"2024-09-17T03:38:28.967685+0000","last_became_active":"2024-09-17T03:38:26.967327+0000","last_became_peered":"2024-09-17T03:38:26.967327+0000","last_unstale":"2024-09-17T03:38:28.967685+0000","last_undegraded":"2024-09-17T03:38:28.967685+0000","last_fullsized":"2024-09-17T03:38:28.967685+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:29.998335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191642+0000","last_change":"2024-09-17T03:38:27.996101+0000","last_active":"2024-09-17T03:38:29.191642+0000","last_peered":"2024-09-17T03:38:29.191642+0000","last_clean":"2024-09-17T03:38:29.191642+0000","last_became_active":"2024-09-17T03:38:27.995788+0000","last_became_peered":"2024-09-17T03:38:27.995788+0000","last_unstale":"2024-09-17T03:38:29.191642+0000","last_undegraded":"2024-09-17T03:38:29.191642+0000","last_fullsized":"2024-09-17T03:38:29.191642+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:15.921214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"103'8","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261364+0000","last_change":"2024-09-17T03:38:26.970998+0000","last_active":"2024-09-17T03:38:29.261364+0000","last_peered":"2024-09-17T03:38:29.261364+0000","last_clean":"2024-09-17T03:38:29.261364+0000","last_became_active":"2024-09-17T03:38:26.970693+0000","last_became_peered":"2024-09-17T03:38:26.970693+0000","last_unstale":"2024-09-17T03:38:29.261364+0000","last_undegraded":"2024-09-17T03:38:29.261364+0000","last_fullsized":"2024-09-17T03:38:29.261364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:21.604318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969341+0000","last_change":"2024-09-17T03:38:27.972622+0000","last_active":"2024-09-17T03:38:28.969341+0000","last_peered":"2024-09-17T03:38:28.969341+0000","last_clean":"2024-09-17T03:38:28.969341+0000","last_became_active":"2024-09-17T03:38:27.972170+0000","last_became_peered":"2024-09-17T03:38:27.972170+0000","last_unstale":"2024-09-17T03:38:28.969341+0000","last_undegraded":"2024-09-17T03:38:28.969341+0000","last_fullsized":"2024-09-17T03:38:28.969341+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:42.671301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968039+0000","last_change":"2024-09-17T03:38:26.974319+0000","last_active":"2024-09-17T03:38:28.968039+0000","last_peered":"2024-09-17T03:38:28.968039+0000","last_clean":"2024-09-17T03:38:28.968039+0000","last_became_active":"2024-09-17T03:38:26.974008+0000","last_became_peered":"2024-09-17T03:38:26.974008+0000","last_unstale":"2024-09-17T03:38:28.968039+0000","last_undegraded":"2024-09-17T03:38:28.968039+0000","last_fullsized":"2024-09-17T03:38:28.968039+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:15.506982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T03:38:26.965545+0000","last_change":"2024-09-17T03:38:26.965545+0000","last_active":"2024-09-17T03:38:26.949525+0000","last_peered":"2024-09-17T03:38:26.949525+0000","last_clean":"2024-09-17T03:38:26.949525+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:38:26.965545+0000","last_undegraded":"2024-09-17T03:38:26.965545+0000","last_fullsized":"2024-09-17T03:38:26.965545+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968860+0000","last_change":"2024-09-17T03:38:26.972839+0000","last_active":"2024-09-17T03:38:28.968860+0000","last_peered":"2024-09-17T03:38:28.968860+0000","last_clean":"2024-09-17T03:38:28.968860+0000","last_became_active":"2024-09-17T03:38:26.972478+0000","last_became_peered":"2024-09-17T03:38:26.972478+0000","last_unstale":"2024-09-17T03:38:28.968860+0000","last_undegraded":"2024-09-17T03:38:28.968860+0000","last_fullsized":"2024-09-17T03:38:28.968860+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:36.480429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005983+0000","last_change":"2024-09-17T03:38:27.991905+0000","last_active":"2024-09-17T03:38:29.005983+0000","last_peered":"2024-09-17T03:38:29.005983+0000","last_clean":"2024-09-17T03:38:29.005983+0000","last_became_active":"2024-09-17T03:38:27.991253+0000","last_became_peered":"2024-09-17T03:38:27.991253+0000","last_unstale":"2024-09-17T03:38:29.005983+0000","last_undegraded":"2024-09-17T03:38:29.005983+0000","last_fullsized":"2024-09-17T03:38:29.005983+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:47.703166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966712+0000","last_change":"2024-09-17T03:38:26.966582+0000","last_active":"2024-09-17T03:38:28.966712+0000","last_peered":"2024-09-17T03:38:28.966712+0000","last_clean":"2024-09-17T03:38:28.966712+0000","last_became_active":"2024-09-17T03:38:26.966236+0000","last_became_peered":"2024-09-17T03:38:26.966236+0000","last_unstale":"2024-09-17T03:38:28.966712+0000","last_undegraded":"2024-09-17T03:38:28.966712+0000","last_fullsized":"2024-09-17T03:38:28.966712+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.908196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191936+0000","last_change":"2024-09-17T03:38:27.998470+0000","last_active":"2024-09-17T03:38:29.191936+0000","last_peered":"2024-09-17T03:38:29.191936+0000","last_clean":"2024-09-17T03:38:29.191936+0000","last_became_active":"2024-09-17T03:38:27.998141+0000","last_became_peered":"2024-09-17T03:38:27.998141+0000","last_unstale":"2024-09-17T03:38:29.191936+0000","last_undegraded":"2024-09-17T03:38:29.191936+0000","last_fullsized":"2024-09-17T03:38:29.191936+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:21.927496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966717+0000","last_change":"2024-09-17T03:38:26.976542+0000","last_active":"2024-09-17T03:38:28.966717+0000","last_peered":"2024-09-17T03:38:28.966717+0000","last_clean":"2024-09-17T03:38:28.966717+0000","last_became_active":"2024-09-17T03:38:26.976209+0000","last_became_peered":"2024-09-17T03:38:26.976209+0000","last_unstale":"2024-09-17T03:38:28.966717+0000","last_undegraded":"2024-09-17T03:38:28.966717+0000","last_fullsized":"2024-09-17T03:38:28.966717+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:45.010470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191554+0000","last_change":"2024-09-17T03:38:27.989123+0000","last_active":"2024-09-17T03:38:29.191554+0000","last_peered":"2024-09-17T03:38:29.191554+0000","last_clean":"2024-09-17T03:38:29.191554+0000","last_became_active":"2024-09-17T03:38:27.987713+0000","last_became_peered":"2024-09-17T03:38:27.987713+0000","last_unstale":"2024-09-17T03:38:29.191554+0000","last_undegraded":"2024-09-17T03:38:29.191554+0000","last_fullsized":"2024-09-17T03:38:29.191554+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:59.793518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.974364+0000","last_change":"2024-09-17T03:38:26.973805+0000","last_active":"2024-09-17T03:38:26.974364+0000","last_peered":"2024-09-17T03:38:26.974364+0000","last_clean":"2024-09-17T03:38:26.974364+0000","last_became_active":"2024-09-17T03:38:26.973309+0000","last_became_peered":"2024-09-17T03:38:26.973309+0000","last_unstale":"2024-09-17T03:38:26.974364+0000","last_undegraded":"2024-09-17T03:38:26.974364+0000","last_fullsized":"2024-09-17T03:38:26.974364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:29.550285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191418+0000","last_change":"2024-09-17T03:38:27.998634+0000","last_active":"2024-09-17T03:38:29.191418+0000","last_peered":"2024-09-17T03:38:29.191418+0000","last_clean":"2024-09-17T03:38:29.191418+0000","last_became_active":"2024-09-17T03:38:27.998367+0000","last_became_peered":"2024-09-17T03:38:27.998367+0000","last_unstale":"2024-09-17T03:38:29.191418+0000","last_undegraded":"2024-09-17T03:38:29.191418+0000","last_fullsized":"2024-09-17T03:38:29.191418+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:21.126756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.973606+0000","last_change":"2024-09-17T03:38:26.971443+0000","last_active":"2024-09-17T03:38:26.973606+0000","last_peered":"2024-09-17T03:38:26.973606+0000","last_clean":"2024-09-17T03:38:26.973606+0000","last_became_active":"2024-09-17T03:38:26.971141+0000","last_became_peered":"2024-09-17T03:38:26.971141+0000","last_unstale":"2024-09-17T03:38:26.973606+0000","last_undegraded":"2024-09-17T03:38:26.973606+0000","last_fullsized":"2024-09-17T03:38:26.973606+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:16.383373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967668+0000","last_change":"2024-09-17T03:38:27.982133+0000","last_active":"2024-09-17T03:38:28.967668+0000","last_peered":"2024-09-17T03:38:28.967668+0000","last_clean":"2024-09-17T03:38:28.967668+0000","last_became_active":"2024-09-17T03:38:27.981801+0000","last_became_peered":"2024-09-17T03:38:27.981801+0000","last_unstale":"2024-09-17T03:38:28.967668+0000","last_undegraded":"2024-09-17T03:38:28.967668+0000","last_fullsized":"2024-09-17T03:38:28.967668+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:17.462936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966389+0000","last_change":"2024-09-17T03:38:26.974657+0000","last_active":"2024-09-17T03:38:28.966389+0000","last_peered":"2024-09-17T03:38:28.966389+0000","last_clean":"2024-09-17T03:38:28.966389+0000","last_became_active":"2024-09-17T03:38:26.973955+0000","last_became_peered":"2024-09-17T03:38:26.973955+0000","last_unstale":"2024-09-17T03:38:28.966389+0000","last_undegraded":"2024-09-17T03:38:28.966389+0000","last_fullsized":"2024-09-17T03:38:28.966389+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:23.286979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967097+0000","last_change":"2024-09-17T03:38:27.990530+0000","last_active":"2024-09-17T03:38:28.967097+0000","last_peered":"2024-09-17T03:38:28.967097+0000","last_clean":"2024-09-17T03:38:28.967097+0000","last_became_active":"2024-09-17T03:38:27.990225+0000","last_became_peered":"2024-09-17T03:38:27.990225+0000","last_unstale":"2024-09-17T03:38:28.967097+0000","last_undegraded":"2024-09-17T03:38:28.967097+0000","last_fullsized":"2024-09-17T03:38:28.967097+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:05.637779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.977151+0000","last_change":"2024-09-17T03:38:26.974776+0000","last_active":"2024-09-17T03:38:26.977151+0000","last_peered":"2024-09-17T03:38:26.977151+0000","last_clean":"2024-09-17T03:38:26.977151+0000","last_became_active":"2024-09-17T03:38:26.974459+0000","last_became_peered":"2024-09-17T03:38:26.974459+0000","last_unstale":"2024-09-17T03:38:26.977151+0000","last_undegraded":"2024-09-17T03:38:26.977151+0000","last_fullsized":"2024-09-17T03:38:26.977151+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:40.028883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262162+0000","last_change":"2024-09-17T03:38:27.990635+0000","last_active":"2024-09-17T03:38:29.262162+0000","last_peered":"2024-09-17T03:38:29.262162+0000","last_clean":"2024-09-17T03:38:29.262162+0000","last_became_active":"2024-09-17T03:38:27.990326+0000","last_became_peered":"2024-09-17T03:38:27.990326+0000","last_unstale":"2024-09-17T03:38:29.262162+0000","last_undegraded":"2024-09-17T03:38:29.262162+0000","last_fullsized":"2024-09-17T03:38:29.262162+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:11.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967149+0000","last_change":"2024-09-17T03:38:26.974661+0000","last_active":"2024-09-17T03:38:28.967149+0000","last_peered":"2024-09-17T03:38:28.967149+0000","last_clean":"2024-09-17T03:38:28.967149+0000","last_became_active":"2024-09-17T03:38:26.974345+0000","last_became_peered":"2024-09-17T03:38:26.974345+0000","last_unstale":"2024-09-17T03:38:28.967149+0000","last_undegraded":"2024-09-17T03:38:28.967149+0000","last_fullsized":"2024-09-17T03:38:28.967149+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:59.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262108+0000","last_change":"2024-09-17T03:38:27.983385+0000","last_active":"2024-09-17T03:38:29.262108+0000","last_peered":"2024-09-17T03:38:29.262108+0000","last_clean":"2024-09-17T03:38:29.262108+0000","last_became_active":"2024-09-17T03:38:27.982698+0000","last_became_peered":"2024-09-17T03:38:27.982698+0000","last_unstale":"2024-09-17T03:38:29.262108+0000","last_undegraded":"2024-09-17T03:38:29.262108+0000","last_fullsized":"2024-09-17T03:38:29.262108+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:13.426190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966637+0000","last_change":"2024-09-17T03:38:26.965679+0000","last_active":"2024-09-17T03:38:28.966637+0000","last_peered":"2024-09-17T03:38:28.966637+0000","last_clean":"2024-09-17T03:38:28.966637+0000","last_became_active":"2024-09-17T03:38:26.965356+0000","last_became_peered":"2024-09-17T03:38:26.965356+0000","last_unstale":"2024-09-17T03:38:28.966637+0000","last_undegraded":"2024-09-17T03:38:28.966637+0000","last_fullsized":"2024-09-17T03:38:28.966637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:04.970216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968941+0000","last_change":"2024-09-17T03:38:27.993766+0000","last_active":"2024-09-17T03:38:28.968941+0000","last_peered":"2024-09-17T03:38:28.968941+0000","last_clean":"2024-09-17T03:38:28.968941+0000","last_became_active":"2024-09-17T03:38:27.993432+0000","last_became_peered":"2024-09-17T03:38:27.993432+0000","last_unstale":"2024-09-17T03:38:28.968941+0000","last_undegraded":"2024-09-17T03:38:28.968941+0000","last_fullsized":"2024-09-17T03:38:28.968941+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:45.247320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969217+0000","last_change":"2024-09-17T03:38:26.970931+0000","last_active":"2024-09-17T03:38:28.969217+0000","last_peered":"2024-09-17T03:38:28.969217+0000","last_clean":"2024-09-17T03:38:28.969217+0000","last_became_active":"2024-09-17T03:38:26.970604+0000","last_became_peered":"2024-09-17T03:38:26.970604+0000","last_unstale":"2024-09-17T03:38:28.969217+0000","last_undegraded":"2024-09-17T03:38:28.969217+0000","last_fullsized":"2024-09-17T03:38:28.969217+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:52.328415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.192172+0000","last_change":"2024-09-17T03:38:27.994165+0000","last_active":"2024-09-17T03:38:29.192172+0000","last_peered":"2024-09-17T03:38:29.192172+0000","last_clean":"2024-09-17T03:38:29.192172+0000","last_became_active":"2024-09-17T03:38:27.993861+0000","last_became_peered":"2024-09-17T03:38:27.993861+0000","last_unstale":"2024-09-17T03:38:29.192172+0000","last_undegraded":"2024-09-17T03:38:29.192172+0000","last_fullsized":"2024-09-17T03:38:29.192172+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:33.720992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966741+0000","last_change":"2024-09-17T03:38:26.970499+0000","last_active":"2024-09-17T03:38:28.966741+0000","last_peered":"2024-09-17T03:38:28.966741+0000","last_clean":"2024-09-17T03:38:28.966741+0000","last_became_active":"2024-09-17T03:38:26.970128+0000","last_became_peered":"2024-09-17T03:38:26.970128+0000","last_unstale":"2024-09-17T03:38:28.966741+0000","last_undegraded":"2024-09-17T03:38:28.966741+0000","last_fullsized":"2024-09-17T03:38:28.966741+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:43.177282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967999+0000","last_change":"2024-09-17T03:38:27.971482+0000","last_active":"2024-09-17T03:38:28.967999+0000","last_peered":"2024-09-17T03:38:28.967999+0000","last_clean":"2024-09-17T03:38:28.967999+0000","last_became_active":"2024-09-17T03:38:27.971124+0000","last_became_peered":"2024-09-17T03:38:27.971124+0000","last_unstale":"2024-09-17T03:38:28.967999+0000","last_undegraded":"2024-09-17T03:38:28.967999+0000","last_fullsized":"2024-09-17T03:38:28.967999+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:00.365080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968381+0000","last_change":"2024-09-17T03:38:26.974041+0000","last_active":"2024-09-17T03:38:28.968381+0000","last_peered":"2024-09-17T03:38:28.968381+0000","last_clean":"2024-09-17T03:38:28.968381+0000","last_became_active":"2024-09-17T03:38:26.973115+0000","last_became_peered":"2024-09-17T03:38:26.973115+0000","last_unstale":"2024-09-17T03:38:28.968381+0000","last_undegraded":"2024-09-17T03:38:28.968381+0000","last_fullsized":"2024-09-17T03:38:28.968381+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:33.987282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191435+0000","last_change":"2024-09-17T03:38:27.996142+0000","last_active":"2024-09-17T03:38:29.191435+0000","last_peered":"2024-09-17T03:38:29.191435+0000","last_clean":"2024-09-17T03:38:29.191435+0000","last_became_active":"2024-09-17T03:38:27.995822+0000","last_became_peered":"2024-09-17T03:38:27.995822+0000","last_unstale":"2024-09-17T03:38:29.191435+0000","last_undegraded":"2024-09-17T03:38:29.191435+0000","last_fullsized":"2024-09-17T03:38:29.191435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:04.315528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T03:38:26.977968+0000","last_change":"2024-09-17T03:38:26.969822+0000","last_active":"2024-09-17T03:38:26.977968+0000","last_peered":"2024-09-17T03:38:26.977968+0000","last_clean":"2024-09-17T03:38:26.977968+0000","last_became_active":"2024-09-17T03:38:26.969461+0000","last_became_peered":"2024-09-17T03:38:26.969461+0000","last_unstale":"2024-09-17T03:38:26.977968+0000","last_undegraded":"2024-09-17T03:38:26.977968+0000","last_fullsized":"2024-09-17T03:38:26.977968+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:34.065975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967882+0000","last_change":"2024-09-17T03:38:27.993971+0000","last_active":"2024-09-17T03:38:28.967882+0000","last_peered":"2024-09-17T03:38:28.967882+0000","last_clean":"2024-09-17T03:38:28.967882+0000","last_became_active":"2024-09-17T03:38:27.993620+0000","last_became_peered":"2024-09-17T03:38:27.993620+0000","last_unstale":"2024-09-17T03:38:28.967882+0000","last_undegraded":"2024-09-17T03:38:28.967882+0000","last_fullsized":"2024-09-17T03:38:28.967882+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:44.121364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191565+0000","last_change":"2024-09-17T03:38:26.974988+0000","last_active":"2024-09-17T03:38:29.191565+0000","last_peered":"2024-09-17T03:38:29.191565+0000","last_clean":"2024-09-17T03:38:29.191565+0000","last_became_active":"2024-09-17T03:38:26.974315+0000","last_became_peered":"2024-09-17T03:38:26.974315+0000","last_unstale":"2024-09-17T03:38:29.191565+0000","last_undegraded":"2024-09-17T03:38:29.191565+0000","last_fullsized":"2024-09-17T03:38:29.191565+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:12.754692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191832+0000","last_change":"2024-09-17T03:38:27.998521+0000","last_active":"2024-09-17T03:38:29.191832+0000","last_peered":"2024-09-17T03:38:29.191832+0000","last_clean":"2024-09-17T03:38:29.191832+0000","last_became_active":"2024-09-17T03:38:27.998207+0000","last_became_peered":"2024-09-17T03:38:27.998207+0000","last_unstale":"2024-09-17T03:38:29.191832+0000","last_undegraded":"2024-09-17T03:38:29.191832+0000","last_fullsized":"2024-09-17T03:38:29.191832+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:22.891457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005652+0000","last_change":"2024-09-17T03:38:26.979932+0000","last_active":"2024-09-17T03:38:29.005652+0000","last_peered":"2024-09-17T03:38:29.005652+0000","last_clean":"2024-09-17T03:38:29.005652+0000","last_became_active":"2024-09-17T03:38:26.979630+0000","last_became_peered":"2024-09-17T03:38:26.979630+0000","last_unstale":"2024-09-17T03:38:29.005652+0000","last_undegraded":"2024-09-17T03:38:29.005652+0000","last_fullsized":"2024-09-17T03:38:29.005652+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:59.918075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":261,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005746+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:38:29.005746+0000","last_peered":"2024-09-17T03:38:29.005746+0000","last_clean":"2024-09-17T03:38:29.005746+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:38:29.005746+0000","last_undegraded":"2024-09-17T03:38:29.005746+0000","last_fullsized":"2024-09-17T03:38:29.005746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37184,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334656,"statfs":{"total":96636764160,"available":96598687744,"internally_reserved":0,"allocated":1880064,"data_stored":1146837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40756,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331084,"statfs":{"total":96636764160,"available":96595030016,"internally_reserved":0,"allocated":1273856,"data_stored":550709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40776,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331064,"statfs":{"total":96636764160,"available":96595009536,"internally_reserved":0,"allocated":1298432,"data_stored":558093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36596,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335244,"statfs":{"total":96636764160,"available":96599289856,"internally_reserved":0,"allocated":1269760,"data_stored":550091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40760,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331080,"statfs":{"total":96636764160,"available":96595025920,"internally_reserved":0,"allocated":1277952,"data_stored":556357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37168,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334672,"statfs":{"total":96636764160,"available":96598704128,"internally_reserved":0,"allocated":1863680,"data_stored":1141007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1241088,"data_stored":537007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1241088,"data_stored":537007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:38:32.610 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-09-17T03:38:32.610+0000 7f9f1224d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:38:35.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:38:35.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.565+0000 7f1a51ab6640 1 -- 172.21.15.146:0/1121598558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4c068d00 msgr2=0x7f1a4c0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.565+0000 7f1a51ab6640 1 --2- 172.21.15.146:0/1121598558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4c068d00 0x7f1a4c0cf310 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c08d1e0 tx=0x7f1a3c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.565+0000 7f1a51ab6640 1 -- 172.21.15.146:0/1121598558 shutdown_connections 2024-09-17T03:38:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.565+0000 7f1a51ab6640 1 --2- 172.21.15.146:0/1121598558 >> v2:172.21.15.179:3300/0 conn(0x7f1a4c15ebd0 0x7f1a4c06ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.565+0000 7f1a51ab6640 1 --2- 172.21.15.146:0/1121598558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4c068d00 0x7f1a4c0cf310 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.565+0000 7f1a51ab6640 1 -- 172.21.15.146:0/1121598558 >> 172.21.15.146:0/1121598558 conn(0x7f1a4c0d4b80 msgr2=0x7f1a4c0d4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.565+0000 7f1a51ab6640 1 -- 172.21.15.146:0/1121598558 shutdown_connections 2024-09-17T03:38:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.565+0000 7f1a51ab6640 1 -- 172.21.15.146:0/1121598558 wait complete. 2024-09-17T03:38:35.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.567+0000 7f1a51ab6640 1 Processor -- start 2024-09-17T03:38:35.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.567+0000 7f1a51ab6640 1 -- start start 2024-09-17T03:38:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a51ab6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a4c068d00 0x7f1a4c0ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a51ab6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c06f250 0x7f1a4c0cf260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a51ab6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4c15ebd0 0x7f1a4c1f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a51ab6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d45c0 con 0x7f1a4c15ebd0 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a51ab6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d4440 con 0x7f1a4c068d00 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a51ab6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4c162f10 con 0x7f1a4c06f250 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a4bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4c15ebd0 0x7f1a4c1f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a4bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4c15ebd0 0x7f1a4c1f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52972/0 (socket says 172.21.15.146:52972) 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a4bfff640 1 -- 172.21.15.146:0/2604039002 learned_addr learned my addr 172.21.15.146:0/2604039002 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a4affd640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c06f250 0x7f1a4c0cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a4b7fe640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a4c068d00 0x7f1a4c0ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a4bfff640 1 -- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c06f250 msgr2=0x7f1a4c0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a4bfff640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c06f250 0x7f1a4c0cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a4bfff640 1 -- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a4c068d00 msgr2=0x7f1a4c0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a4bfff640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a4c068d00 0x7f1a4c0ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a4bfff640 1 -- 172.21.15.146:0/2604039002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c150850 con 0x7f1a4c15ebd0 2024-09-17T03:38:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a4bfff640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4c15ebd0 0x7f1a4c1f5d50 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c6b0 tx=0x7f1a4400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:35.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.569+0000 7f1a33fff640 1 -- 172.21.15.146:0/2604039002 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44003b70 con 0x7f1a4c15ebd0 2024-09-17T03:38:35.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.570+0000 7f1a33fff640 1 -- 172.21.15.146:0/2604039002 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a44003d30 con 0x7f1a4c15ebd0 2024-09-17T03:38:35.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.570+0000 7f1a51ab6640 1 -- 172.21.15.146:0/2604039002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4c150b30 con 0x7f1a4c15ebd0 2024-09-17T03:38:35.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.570+0000 7f1a33fff640 1 -- 172.21.15.146:0/2604039002 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44005330 con 0x7f1a4c15ebd0 2024-09-17T03:38:35.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.570+0000 7f1a51ab6640 1 -- 172.21.15.146:0/2604039002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4c0ad8f0 con 0x7f1a4c15ebd0 2024-09-17T03:38:35.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.571+0000 7f1a51ab6640 1 -- 172.21.15.146:0/2604039002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a4c0ad400 con 0x7f1a4c15ebd0 2024-09-17T03:38:35.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.571+0000 7f1a33fff640 1 -- 172.21.15.146:0/2604039002 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a440054d0 con 0x7f1a4c15ebd0 2024-09-17T03:38:35.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.572+0000 7f1a33fff640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 0x7f1a3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:35.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.572+0000 7f1a33fff640 1 -- 172.21.15.146:0/2604039002 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1a4409a9d0 con 0x7f1a4c15ebd0 2024-09-17T03:38:35.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.572+0000 7f1a4b7fe640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 0x7f1a3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:35.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.573+0000 7f1a4b7fe640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 0x7f1a3807b0a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c033000 tx=0x7f1a3c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:35.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.576+0000 7f1a33fff640 1 -- 172.21.15.146:0/2604039002 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1a4c0b3ab0 con 0x7f1a4c15ebd0 2024-09-17T03:38:35.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.750+0000 7f1a51ab6640 1 -- 172.21.15.146:0/2604039002 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a4c1505e0 con 0x7f1a38078b90 2024-09-17T03:38:35.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.755+0000 7f1a33fff640 1 -- 172.21.15.146:0/2604039002 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252473 (secure 0 0 0) 0x7f1a4c1505e0 con 0x7f1a38078b90 2024-09-17T03:38:35.758 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:35.759 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:38:35.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 -- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 msgr2=0x7f1a3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:35.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 0x7f1a3807b0a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c033000 tx=0x7f1a3c004730 comp rx=0 tx=0).stop 2024-09-17T03:38:35.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 -- 172.21.15.146:0/2604039002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4c15ebd0 msgr2=0x7f1a4c1f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4c15ebd0 0x7f1a4c1f5d50 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c6b0 tx=0x7f1a4400cb70 comp rx=0 tx=0).stop 2024-09-17T03:38:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 -- 172.21.15.146:0/2604039002 shutdown_connections 2024-09-17T03:38:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 0x7f1a3807b0a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4c15ebd0 0x7f1a4c1f5d50 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a4c06f250 0x7f1a4c0cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 --2- 172.21.15.146:0/2604039002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a4c068d00 0x7f1a4c0ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 -- 172.21.15.146:0/2604039002 >> 172.21.15.146:0/2604039002 conn(0x7f1a4c0d4b80 msgr2=0x7f1a4c0d4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:35.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 -- 172.21.15.146:0/2604039002 shutdown_connections 2024-09-17T03:38:35.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.758+0000 7f1a51ab6640 1 -- 172.21.15.146:0/2604039002 wait complete. 2024-09-17T03:38:35.770 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2024-09-17T03:38:33.876956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314772,"kb_used_data":11172,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754659948,"statfs":{"total":773094113280,"available":772771786752,"internally_reserved":0,"allocated":11440128,"data_stored":5617512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":310693425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.921587"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261975+0000","last_change":"2024-09-17T03:38:27.989901+0000","last_active":"2024-09-17T03:38:29.261975+0000","last_peered":"2024-09-17T03:38:29.261975+0000","last_clean":"2024-09-17T03:38:29.261975+0000","last_became_active":"2024-09-17T03:38:27.989603+0000","last_became_peered":"2024-09-17T03:38:27.989603+0000","last_unstale":"2024-09-17T03:38:29.261975+0000","last_undegraded":"2024-09-17T03:38:29.261975+0000","last_fullsized":"2024-09-17T03:38:29.261975+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:54.011565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966935+0000","last_change":"2024-09-17T03:38:27.992267+0000","last_active":"2024-09-17T03:38:28.966935+0000","last_peered":"2024-09-17T03:38:28.966935+0000","last_clean":"2024-09-17T03:38:28.966935+0000","last_became_active":"2024-09-17T03:38:27.991901+0000","last_became_peered":"2024-09-17T03:38:27.991901+0000","last_unstale":"2024-09-17T03:38:28.966935+0000","last_undegraded":"2024-09-17T03:38:28.966935+0000","last_fullsized":"2024-09-17T03:38:28.966935+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:24.599439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262208+0000","last_change":"2024-09-17T03:38:27.988024+0000","last_active":"2024-09-17T03:38:29.262208+0000","last_peered":"2024-09-17T03:38:29.262208+0000","last_clean":"2024-09-17T03:38:29.262208+0000","last_became_active":"2024-09-17T03:38:27.987731+0000","last_became_peered":"2024-09-17T03:38:27.987731+0000","last_unstale":"2024-09-17T03:38:29.262208+0000","last_undegraded":"2024-09-17T03:38:29.262208+0000","last_fullsized":"2024-09-17T03:38:29.262208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:38.796206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261129+0000","last_change":"2024-09-17T03:38:27.986664+0000","last_active":"2024-09-17T03:38:29.261129+0000","last_peered":"2024-09-17T03:38:29.261129+0000","last_clean":"2024-09-17T03:38:29.261129+0000","last_became_active":"2024-09-17T03:38:27.986305+0000","last_became_peered":"2024-09-17T03:38:27.986305+0000","last_unstale":"2024-09-17T03:38:29.261129+0000","last_undegraded":"2024-09-17T03:38:29.261129+0000","last_fullsized":"2024-09-17T03:38:29.261129+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:50.872832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968541+0000","last_change":"2024-09-17T03:38:27.993810+0000","last_active":"2024-09-17T03:38:28.968541+0000","last_peered":"2024-09-17T03:38:28.968541+0000","last_clean":"2024-09-17T03:38:28.968541+0000","last_became_active":"2024-09-17T03:38:27.993446+0000","last_became_peered":"2024-09-17T03:38:27.993446+0000","last_unstale":"2024-09-17T03:38:28.968541+0000","last_undegraded":"2024-09-17T03:38:28.968541+0000","last_fullsized":"2024-09-17T03:38:28.968541+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:42.250236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005643+0000","last_change":"2024-09-17T03:38:27.988181+0000","last_active":"2024-09-17T03:38:29.005643+0000","last_peered":"2024-09-17T03:38:29.005643+0000","last_clean":"2024-09-17T03:38:29.005643+0000","last_became_active":"2024-09-17T03:38:27.987858+0000","last_became_peered":"2024-09-17T03:38:27.987858+0000","last_unstale":"2024-09-17T03:38:29.005643+0000","last_undegraded":"2024-09-17T03:38:29.005643+0000","last_fullsized":"2024-09-17T03:38:29.005643+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:55.651386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005728+0000","last_change":"2024-09-17T03:38:27.988069+0000","last_active":"2024-09-17T03:38:29.005728+0000","last_peered":"2024-09-17T03:38:29.005728+0000","last_clean":"2024-09-17T03:38:29.005728+0000","last_became_active":"2024-09-17T03:38:27.987720+0000","last_became_peered":"2024-09-17T03:38:27.987720+0000","last_unstale":"2024-09-17T03:38:29.005728+0000","last_undegraded":"2024-09-17T03:38:29.005728+0000","last_fullsized":"2024-09-17T03:38:29.005728+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:18.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966482+0000","last_change":"2024-09-17T03:38:27.991610+0000","last_active":"2024-09-17T03:38:28.966482+0000","last_peered":"2024-09-17T03:38:28.966482+0000","last_clean":"2024-09-17T03:38:28.966482+0000","last_became_active":"2024-09-17T03:38:27.990044+0000","last_became_peered":"2024-09-17T03:38:27.990044+0000","last_unstale":"2024-09-17T03:38:28.966482+0000","last_undegraded":"2024-09-17T03:38:28.966482+0000","last_fullsized":"2024-09-17T03:38:28.966482+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:18.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968354+0000","last_change":"2024-09-17T03:38:27.993162+0000","last_active":"2024-09-17T03:38:28.968354+0000","last_peered":"2024-09-17T03:38:28.968354+0000","last_clean":"2024-09-17T03:38:28.968354+0000","last_became_active":"2024-09-17T03:38:27.992585+0000","last_became_peered":"2024-09-17T03:38:27.992585+0000","last_unstale":"2024-09-17T03:38:28.968354+0000","last_undegraded":"2024-09-17T03:38:28.968354+0000","last_fullsized":"2024-09-17T03:38:28.968354+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:38.584725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968584+0000","last_change":"2024-09-17T03:38:27.985267+0000","last_active":"2024-09-17T03:38:28.968584+0000","last_peered":"2024-09-17T03:38:28.968584+0000","last_clean":"2024-09-17T03:38:28.968584+0000","last_became_active":"2024-09-17T03:38:27.984946+0000","last_became_peered":"2024-09-17T03:38:27.984946+0000","last_unstale":"2024-09-17T03:38:28.968584+0000","last_undegraded":"2024-09-17T03:38:28.968584+0000","last_fullsized":"2024-09-17T03:38:28.968584+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:33.593178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005592+0000","last_change":"2024-09-17T03:38:27.986243+0000","last_active":"2024-09-17T03:38:29.005592+0000","last_peered":"2024-09-17T03:38:29.005592+0000","last_clean":"2024-09-17T03:38:29.005592+0000","last_became_active":"2024-09-17T03:38:27.985875+0000","last_became_peered":"2024-09-17T03:38:27.985875+0000","last_unstale":"2024-09-17T03:38:29.005592+0000","last_undegraded":"2024-09-17T03:38:29.005592+0000","last_fullsized":"2024-09-17T03:38:29.005592+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:57.833285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968135+0000","last_change":"2024-09-17T03:38:27.991607+0000","last_active":"2024-09-17T03:38:28.968135+0000","last_peered":"2024-09-17T03:38:28.968135+0000","last_clean":"2024-09-17T03:38:28.968135+0000","last_became_active":"2024-09-17T03:38:27.991049+0000","last_became_peered":"2024-09-17T03:38:27.991049+0000","last_unstale":"2024-09-17T03:38:28.968135+0000","last_undegraded":"2024-09-17T03:38:28.968135+0000","last_fullsized":"2024-09-17T03:38:28.968135+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:58.834471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.260903+0000","last_change":"2024-09-17T03:38:27.994621+0000","last_active":"2024-09-17T03:38:29.260903+0000","last_peered":"2024-09-17T03:38:29.260903+0000","last_clean":"2024-09-17T03:38:29.260903+0000","last_became_active":"2024-09-17T03:38:27.994294+0000","last_became_peered":"2024-09-17T03:38:27.994294+0000","last_unstale":"2024-09-17T03:38:29.260903+0000","last_undegraded":"2024-09-17T03:38:29.260903+0000","last_fullsized":"2024-09-17T03:38:29.260903+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:20.451829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191984+0000","last_change":"2024-09-17T03:38:27.988373+0000","last_active":"2024-09-17T03:38:29.191984+0000","last_peered":"2024-09-17T03:38:29.191984+0000","last_clean":"2024-09-17T03:38:29.191984+0000","last_became_active":"2024-09-17T03:38:27.988091+0000","last_became_peered":"2024-09-17T03:38:27.988091+0000","last_unstale":"2024-09-17T03:38:29.191984+0000","last_undegraded":"2024-09-17T03:38:29.191984+0000","last_fullsized":"2024-09-17T03:38:29.191984+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.485809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.260848+0000","last_change":"2024-09-17T03:38:27.997092+0000","last_active":"2024-09-17T03:38:29.260848+0000","last_peered":"2024-09-17T03:38:29.260848+0000","last_clean":"2024-09-17T03:38:29.260848+0000","last_became_active":"2024-09-17T03:38:27.993228+0000","last_became_peered":"2024-09-17T03:38:27.993228+0000","last_unstale":"2024-09-17T03:38:29.260848+0000","last_undegraded":"2024-09-17T03:38:29.260848+0000","last_fullsized":"2024-09-17T03:38:29.260848+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:46.946376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005545+0000","last_change":"2024-09-17T03:38:27.990603+0000","last_active":"2024-09-17T03:38:29.005545+0000","last_peered":"2024-09-17T03:38:29.005545+0000","last_clean":"2024-09-17T03:38:29.005545+0000","last_became_active":"2024-09-17T03:38:27.990229+0000","last_became_peered":"2024-09-17T03:38:27.990229+0000","last_unstale":"2024-09-17T03:38:29.005545+0000","last_undegraded":"2024-09-17T03:38:29.005545+0000","last_fullsized":"2024-09-17T03:38:29.005545+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:31.242849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966926+0000","last_change":"2024-09-17T03:38:27.992645+0000","last_active":"2024-09-17T03:38:28.966926+0000","last_peered":"2024-09-17T03:38:28.966926+0000","last_clean":"2024-09-17T03:38:28.966926+0000","last_became_active":"2024-09-17T03:38:27.992350+0000","last_became_peered":"2024-09-17T03:38:27.992350+0000","last_unstale":"2024-09-17T03:38:28.966926+0000","last_undegraded":"2024-09-17T03:38:28.966926+0000","last_fullsized":"2024-09-17T03:38:28.966926+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:55.651386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261635+0000","last_change":"2024-09-17T03:38:27.992680+0000","last_active":"2024-09-17T03:38:29.261635+0000","last_peered":"2024-09-17T03:38:29.261635+0000","last_clean":"2024-09-17T03:38:29.261635+0000","last_became_active":"2024-09-17T03:38:27.992367+0000","last_became_peered":"2024-09-17T03:38:27.992367+0000","last_unstale":"2024-09-17T03:38:29.261635+0000","last_undegraded":"2024-09-17T03:38:29.261635+0000","last_fullsized":"2024-09-17T03:38:29.261635+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:20.936429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191664+0000","last_change":"2024-09-17T03:38:27.991367+0000","last_active":"2024-09-17T03:38:29.191664+0000","last_peered":"2024-09-17T03:38:29.191664+0000","last_clean":"2024-09-17T03:38:29.191664+0000","last_became_active":"2024-09-17T03:38:27.991060+0000","last_became_peered":"2024-09-17T03:38:27.991060+0000","last_unstale":"2024-09-17T03:38:29.191664+0000","last_undegraded":"2024-09-17T03:38:29.191664+0000","last_fullsized":"2024-09-17T03:38:29.191664+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:00.999192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968504+0000","last_change":"2024-09-17T03:38:27.992955+0000","last_active":"2024-09-17T03:38:28.968504+0000","last_peered":"2024-09-17T03:38:28.968504+0000","last_clean":"2024-09-17T03:38:28.968504+0000","last_became_active":"2024-09-17T03:38:27.992544+0000","last_became_peered":"2024-09-17T03:38:27.992544+0000","last_unstale":"2024-09-17T03:38:28.968504+0000","last_undegraded":"2024-09-17T03:38:28.968504+0000","last_fullsized":"2024-09-17T03:38:28.968504+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:44.129667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191473+0000","last_change":"2024-09-17T03:38:27.988660+0000","last_active":"2024-09-17T03:38:29.191473+0000","last_peered":"2024-09-17T03:38:29.191473+0000","last_clean":"2024-09-17T03:38:29.191473+0000","last_became_active":"2024-09-17T03:38:27.988148+0000","last_became_peered":"2024-09-17T03:38:27.988148+0000","last_unstale":"2024-09-17T03:38:29.191473+0000","last_undegraded":"2024-09-17T03:38:29.191473+0000","last_fullsized":"2024-09-17T03:38:29.191473+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:59.883971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966458+0000","last_change":"2024-09-17T03:38:27.982263+0000","last_active":"2024-09-17T03:38:28.966458+0000","last_peered":"2024-09-17T03:38:28.966458+0000","last_clean":"2024-09-17T03:38:28.966458+0000","last_became_active":"2024-09-17T03:38:27.981955+0000","last_became_peered":"2024-09-17T03:38:27.981955+0000","last_unstale":"2024-09-17T03:38:28.966458+0000","last_undegraded":"2024-09-17T03:38:28.966458+0000","last_fullsized":"2024-09-17T03:38:28.966458+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:31.242849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966460+0000","last_change":"2024-09-17T03:38:27.993047+0000","last_active":"2024-09-17T03:38:28.966460+0000","last_peered":"2024-09-17T03:38:28.966460+0000","last_clean":"2024-09-17T03:38:28.966460+0000","last_became_active":"2024-09-17T03:38:27.992749+0000","last_became_peered":"2024-09-17T03:38:27.992749+0000","last_unstale":"2024-09-17T03:38:28.966460+0000","last_undegraded":"2024-09-17T03:38:28.966460+0000","last_fullsized":"2024-09-17T03:38:28.966460+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:54.635556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005751+0000","last_change":"2024-09-17T03:38:27.991865+0000","last_active":"2024-09-17T03:38:29.005751+0000","last_peered":"2024-09-17T03:38:29.005751+0000","last_clean":"2024-09-17T03:38:29.005751+0000","last_became_active":"2024-09-17T03:38:27.991014+0000","last_became_peered":"2024-09-17T03:38:27.991014+0000","last_unstale":"2024-09-17T03:38:29.005751+0000","last_undegraded":"2024-09-17T03:38:29.005751+0000","last_fullsized":"2024-09-17T03:38:29.005751+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:05.316147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969343+0000","last_change":"2024-09-17T03:38:27.977682+0000","last_active":"2024-09-17T03:38:28.969343+0000","last_peered":"2024-09-17T03:38:28.969343+0000","last_clean":"2024-09-17T03:38:28.969343+0000","last_became_active":"2024-09-17T03:38:27.974243+0000","last_became_peered":"2024-09-17T03:38:27.974243+0000","last_unstale":"2024-09-17T03:38:28.969343+0000","last_undegraded":"2024-09-17T03:38:28.969343+0000","last_fullsized":"2024-09-17T03:38:28.969343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:12.240397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966965+0000","last_change":"2024-09-17T03:38:27.987923+0000","last_active":"2024-09-17T03:38:28.966965+0000","last_peered":"2024-09-17T03:38:28.966965+0000","last_clean":"2024-09-17T03:38:28.966965+0000","last_became_active":"2024-09-17T03:38:27.987631+0000","last_became_peered":"2024-09-17T03:38:27.987631+0000","last_unstale":"2024-09-17T03:38:28.966965+0000","last_undegraded":"2024-09-17T03:38:28.966965+0000","last_fullsized":"2024-09-17T03:38:28.966965+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:46.786919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005825+0000","last_change":"2024-09-17T03:38:27.983480+0000","last_active":"2024-09-17T03:38:29.005825+0000","last_peered":"2024-09-17T03:38:29.005825+0000","last_clean":"2024-09-17T03:38:29.005825+0000","last_became_active":"2024-09-17T03:38:27.983180+0000","last_became_peered":"2024-09-17T03:38:27.983180+0000","last_unstale":"2024-09-17T03:38:29.005825+0000","last_undegraded":"2024-09-17T03:38:29.005825+0000","last_fullsized":"2024-09-17T03:38:29.005825+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:50.337088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969070+0000","last_change":"2024-09-17T03:38:27.994341+0000","last_active":"2024-09-17T03:38:28.969070+0000","last_peered":"2024-09-17T03:38:28.969070+0000","last_clean":"2024-09-17T03:38:28.969070+0000","last_became_active":"2024-09-17T03:38:27.993635+0000","last_became_peered":"2024-09-17T03:38:27.993635+0000","last_unstale":"2024-09-17T03:38:28.969070+0000","last_undegraded":"2024-09-17T03:38:28.969070+0000","last_fullsized":"2024-09-17T03:38:28.969070+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:44.101251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966630+0000","last_change":"2024-09-17T03:38:27.984348+0000","last_active":"2024-09-17T03:38:28.966630+0000","last_peered":"2024-09-17T03:38:28.966630+0000","last_clean":"2024-09-17T03:38:28.966630+0000","last_became_active":"2024-09-17T03:38:27.984035+0000","last_became_peered":"2024-09-17T03:38:27.984035+0000","last_unstale":"2024-09-17T03:38:28.966630+0000","last_undegraded":"2024-09-17T03:38:28.966630+0000","last_fullsized":"2024-09-17T03:38:28.966630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:22.857953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191435+0000","last_change":"2024-09-17T03:38:27.992196+0000","last_active":"2024-09-17T03:38:29.191435+0000","last_peered":"2024-09-17T03:38:29.191435+0000","last_clean":"2024-09-17T03:38:29.191435+0000","last_became_active":"2024-09-17T03:38:27.991893+0000","last_became_peered":"2024-09-17T03:38:27.991893+0000","last_unstale":"2024-09-17T03:38:29.191435+0000","last_undegraded":"2024-09-17T03:38:29.191435+0000","last_fullsized":"2024-09-17T03:38:29.191435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:19.530780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261106+0000","last_change":"2024-09-17T03:38:27.982263+0000","last_active":"2024-09-17T03:38:29.261106+0000","last_peered":"2024-09-17T03:38:29.261106+0000","last_clean":"2024-09-17T03:38:29.261106+0000","last_became_active":"2024-09-17T03:38:27.981955+0000","last_became_peered":"2024-09-17T03:38:27.981955+0000","last_unstale":"2024-09-17T03:38:29.261106+0000","last_undegraded":"2024-09-17T03:38:29.261106+0000","last_fullsized":"2024-09-17T03:38:29.261106+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:39.140017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261054+0000","last_change":"2024-09-17T03:38:27.983421+0000","last_active":"2024-09-17T03:38:29.261054+0000","last_peered":"2024-09-17T03:38:29.261054+0000","last_clean":"2024-09-17T03:38:29.261054+0000","last_became_active":"2024-09-17T03:38:27.982752+0000","last_became_peered":"2024-09-17T03:38:27.982752+0000","last_unstale":"2024-09-17T03:38:29.261054+0000","last_undegraded":"2024-09-17T03:38:29.261054+0000","last_fullsized":"2024-09-17T03:38:29.261054+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:38.478741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191740+0000","last_change":"2024-09-17T03:38:27.990173+0000","last_active":"2024-09-17T03:38:29.191740+0000","last_peered":"2024-09-17T03:38:29.191740+0000","last_clean":"2024-09-17T03:38:29.191740+0000","last_became_active":"2024-09-17T03:38:27.989859+0000","last_became_peered":"2024-09-17T03:38:27.989859+0000","last_unstale":"2024-09-17T03:38:29.191740+0000","last_undegraded":"2024-09-17T03:38:29.191740+0000","last_fullsized":"2024-09-17T03:38:29.191740+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:00.044654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"103'4","reported_seq":19,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966829+0000","last_change":"2024-09-17T03:38:26.968498+0000","last_active":"2024-09-17T03:38:28.966829+0000","last_peered":"2024-09-17T03:38:28.966829+0000","last_clean":"2024-09-17T03:38:28.966829+0000","last_became_active":"2024-09-17T03:38:26.967685+0000","last_became_peered":"2024-09-17T03:38:26.967685+0000","last_unstale":"2024-09-17T03:38:28.966829+0000","last_undegraded":"2024-09-17T03:38:28.966829+0000","last_fullsized":"2024-09-17T03:38:28.966829+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:59.918075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261357+0000","last_change":"2024-09-17T03:38:27.986605+0000","last_active":"2024-09-17T03:38:29.261357+0000","last_peered":"2024-09-17T03:38:29.261357+0000","last_clean":"2024-09-17T03:38:29.261357+0000","last_became_active":"2024-09-17T03:38:27.986191+0000","last_became_peered":"2024-09-17T03:38:27.986191+0000","last_unstale":"2024-09-17T03:38:29.261357+0000","last_undegraded":"2024-09-17T03:38:29.261357+0000","last_fullsized":"2024-09-17T03:38:29.261357+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:35.378776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005777+0000","last_change":"2024-09-17T03:38:26.978065+0000","last_active":"2024-09-17T03:38:29.005777+0000","last_peered":"2024-09-17T03:38:29.005777+0000","last_clean":"2024-09-17T03:38:29.005777+0000","last_became_active":"2024-09-17T03:38:26.977760+0000","last_became_peered":"2024-09-17T03:38:26.977760+0000","last_unstale":"2024-09-17T03:38:29.005777+0000","last_undegraded":"2024-09-17T03:38:29.005777+0000","last_fullsized":"2024-09-17T03:38:29.005777+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:59.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262053+0000","last_change":"2024-09-17T03:38:27.990981+0000","last_active":"2024-09-17T03:38:29.262053+0000","last_peered":"2024-09-17T03:38:29.262053+0000","last_clean":"2024-09-17T03:38:29.262053+0000","last_became_active":"2024-09-17T03:38:27.990155+0000","last_became_peered":"2024-09-17T03:38:27.990155+0000","last_unstale":"2024-09-17T03:38:29.262053+0000","last_undegraded":"2024-09-17T03:38:29.262053+0000","last_fullsized":"2024-09-17T03:38:29.262053+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:14.288116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966484+0000","last_change":"2024-09-17T03:38:26.972883+0000","last_active":"2024-09-17T03:38:28.966484+0000","last_peered":"2024-09-17T03:38:28.966484+0000","last_clean":"2024-09-17T03:38:28.966484+0000","last_became_active":"2024-09-17T03:38:26.972316+0000","last_became_peered":"2024-09-17T03:38:26.972316+0000","last_unstale":"2024-09-17T03:38:28.966484+0000","last_undegraded":"2024-09-17T03:38:28.966484+0000","last_fullsized":"2024-09-17T03:38:28.966484+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:43.780561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968147+0000","last_change":"2024-09-17T03:38:27.988250+0000","last_active":"2024-09-17T03:38:28.968147+0000","last_peered":"2024-09-17T03:38:28.968147+0000","last_clean":"2024-09-17T03:38:28.968147+0000","last_became_active":"2024-09-17T03:38:27.987938+0000","last_became_peered":"2024-09-17T03:38:27.987938+0000","last_unstale":"2024-09-17T03:38:28.968147+0000","last_undegraded":"2024-09-17T03:38:28.968147+0000","last_fullsized":"2024-09-17T03:38:28.968147+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:52.687194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966709+0000","last_change":"2024-09-17T03:38:26.967614+0000","last_active":"2024-09-17T03:38:28.966709+0000","last_peered":"2024-09-17T03:38:28.966709+0000","last_clean":"2024-09-17T03:38:28.966709+0000","last_became_active":"2024-09-17T03:38:26.967289+0000","last_became_peered":"2024-09-17T03:38:26.967289+0000","last_unstale":"2024-09-17T03:38:28.966709+0000","last_undegraded":"2024-09-17T03:38:28.966709+0000","last_fullsized":"2024-09-17T03:38:28.966709+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:26.552522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261343+0000","last_change":"2024-09-17T03:38:27.990186+0000","last_active":"2024-09-17T03:38:29.261343+0000","last_peered":"2024-09-17T03:38:29.261343+0000","last_clean":"2024-09-17T03:38:29.261343+0000","last_became_active":"2024-09-17T03:38:27.989886+0000","last_became_peered":"2024-09-17T03:38:27.989886+0000","last_unstale":"2024-09-17T03:38:29.261343+0000","last_undegraded":"2024-09-17T03:38:29.261343+0000","last_fullsized":"2024-09-17T03:38:29.261343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:35.387474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262081+0000","last_change":"2024-09-17T03:38:26.971419+0000","last_active":"2024-09-17T03:38:29.262081+0000","last_peered":"2024-09-17T03:38:29.262081+0000","last_clean":"2024-09-17T03:38:29.262081+0000","last_became_active":"2024-09-17T03:38:26.971104+0000","last_became_peered":"2024-09-17T03:38:26.971104+0000","last_unstale":"2024-09-17T03:38:29.262081+0000","last_undegraded":"2024-09-17T03:38:29.262081+0000","last_fullsized":"2024-09-17T03:38:29.262081+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:17.356881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005582+0000","last_change":"2024-09-17T03:38:27.983933+0000","last_active":"2024-09-17T03:38:29.005582+0000","last_peered":"2024-09-17T03:38:29.005582+0000","last_clean":"2024-09-17T03:38:29.005582+0000","last_became_active":"2024-09-17T03:38:27.983619+0000","last_became_peered":"2024-09-17T03:38:27.983619+0000","last_unstale":"2024-09-17T03:38:29.005582+0000","last_undegraded":"2024-09-17T03:38:29.005582+0000","last_fullsized":"2024-09-17T03:38:29.005582+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:33.661852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966904+0000","last_change":"2024-09-17T03:38:26.975874+0000","last_active":"2024-09-17T03:38:28.966904+0000","last_peered":"2024-09-17T03:38:28.966904+0000","last_clean":"2024-09-17T03:38:28.966904+0000","last_became_active":"2024-09-17T03:38:26.975546+0000","last_became_peered":"2024-09-17T03:38:26.975546+0000","last_unstale":"2024-09-17T03:38:28.966904+0000","last_undegraded":"2024-09-17T03:38:28.966904+0000","last_fullsized":"2024-09-17T03:38:28.966904+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:25.915484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.260776+0000","last_change":"2024-09-17T03:38:27.996368+0000","last_active":"2024-09-17T03:38:29.260776+0000","last_peered":"2024-09-17T03:38:29.260776+0000","last_clean":"2024-09-17T03:38:29.260776+0000","last_became_active":"2024-09-17T03:38:27.995671+0000","last_became_peered":"2024-09-17T03:38:27.995671+0000","last_unstale":"2024-09-17T03:38:29.260776+0000","last_undegraded":"2024-09-17T03:38:29.260776+0000","last_fullsized":"2024-09-17T03:38:29.260776+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:45.957895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967993+0000","last_change":"2024-09-17T03:38:26.968875+0000","last_active":"2024-09-17T03:38:28.967993+0000","last_peered":"2024-09-17T03:38:28.967993+0000","last_clean":"2024-09-17T03:38:28.967993+0000","last_became_active":"2024-09-17T03:38:26.968513+0000","last_became_peered":"2024-09-17T03:38:26.968513+0000","last_unstale":"2024-09-17T03:38:28.967993+0000","last_undegraded":"2024-09-17T03:38:28.967993+0000","last_fullsized":"2024-09-17T03:38:28.967993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:22.278430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968198+0000","last_change":"2024-09-17T03:38:27.987700+0000","last_active":"2024-09-17T03:38:28.968198+0000","last_peered":"2024-09-17T03:38:28.968198+0000","last_clean":"2024-09-17T03:38:28.968198+0000","last_became_active":"2024-09-17T03:38:27.987324+0000","last_became_peered":"2024-09-17T03:38:27.987324+0000","last_unstale":"2024-09-17T03:38:28.968198+0000","last_undegraded":"2024-09-17T03:38:28.968198+0000","last_fullsized":"2024-09-17T03:38:28.968198+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:52.164705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261246+0000","last_change":"2024-09-17T03:38:26.970105+0000","last_active":"2024-09-17T03:38:29.261246+0000","last_peered":"2024-09-17T03:38:29.261246+0000","last_clean":"2024-09-17T03:38:29.261246+0000","last_became_active":"2024-09-17T03:38:26.969797+0000","last_became_peered":"2024-09-17T03:38:26.969797+0000","last_unstale":"2024-09-17T03:38:29.261246+0000","last_undegraded":"2024-09-17T03:38:29.261246+0000","last_fullsized":"2024-09-17T03:38:29.261246+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:58.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967075+0000","last_change":"2024-09-17T03:38:27.973929+0000","last_active":"2024-09-17T03:38:28.967075+0000","last_peered":"2024-09-17T03:38:28.967075+0000","last_clean":"2024-09-17T03:38:28.967075+0000","last_became_active":"2024-09-17T03:38:27.973613+0000","last_became_peered":"2024-09-17T03:38:27.973613+0000","last_unstale":"2024-09-17T03:38:28.967075+0000","last_undegraded":"2024-09-17T03:38:28.967075+0000","last_fullsized":"2024-09-17T03:38:28.967075+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:22.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262126+0000","last_change":"2024-09-17T03:38:26.972647+0000","last_active":"2024-09-17T03:38:29.262126+0000","last_peered":"2024-09-17T03:38:29.262126+0000","last_clean":"2024-09-17T03:38:29.262126+0000","last_became_active":"2024-09-17T03:38:26.972292+0000","last_became_peered":"2024-09-17T03:38:26.972292+0000","last_unstale":"2024-09-17T03:38:29.262126+0000","last_undegraded":"2024-09-17T03:38:29.262126+0000","last_fullsized":"2024-09-17T03:38:29.262126+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:37.378067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968189+0000","last_change":"2024-09-17T03:38:27.987131+0000","last_active":"2024-09-17T03:38:28.968189+0000","last_peered":"2024-09-17T03:38:28.968189+0000","last_clean":"2024-09-17T03:38:28.968189+0000","last_became_active":"2024-09-17T03:38:27.985984+0000","last_became_peered":"2024-09-17T03:38:27.985984+0000","last_unstale":"2024-09-17T03:38:28.968189+0000","last_undegraded":"2024-09-17T03:38:28.968189+0000","last_fullsized":"2024-09-17T03:38:28.968189+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:29.538764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261797+0000","last_change":"2024-09-17T03:38:26.969005+0000","last_active":"2024-09-17T03:38:29.261797+0000","last_peered":"2024-09-17T03:38:29.261797+0000","last_clean":"2024-09-17T03:38:29.261797+0000","last_became_active":"2024-09-17T03:38:26.968705+0000","last_became_peered":"2024-09-17T03:38:26.968705+0000","last_unstale":"2024-09-17T03:38:29.261797+0000","last_undegraded":"2024-09-17T03:38:29.261797+0000","last_fullsized":"2024-09-17T03:38:29.261797+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:51.446782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969036+0000","last_change":"2024-09-17T03:38:27.974699+0000","last_active":"2024-09-17T03:38:28.969036+0000","last_peered":"2024-09-17T03:38:28.969036+0000","last_clean":"2024-09-17T03:38:28.969036+0000","last_became_active":"2024-09-17T03:38:27.974349+0000","last_became_peered":"2024-09-17T03:38:27.974349+0000","last_unstale":"2024-09-17T03:38:28.969036+0000","last_undegraded":"2024-09-17T03:38:28.969036+0000","last_fullsized":"2024-09-17T03:38:28.969036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:35.927783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"103'3","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.006024+0000","last_change":"2024-09-17T03:38:26.976206+0000","last_active":"2024-09-17T03:38:29.006024+0000","last_peered":"2024-09-17T03:38:29.006024+0000","last_clean":"2024-09-17T03:38:29.006024+0000","last_became_active":"2024-09-17T03:38:26.975880+0000","last_became_peered":"2024-09-17T03:38:26.975880+0000","last_unstale":"2024-09-17T03:38:29.006024+0000","last_undegraded":"2024-09-17T03:38:29.006024+0000","last_fullsized":"2024-09-17T03:38:29.006024+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:35.608702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005888+0000","last_change":"2024-09-17T03:38:27.992658+0000","last_active":"2024-09-17T03:38:29.005888+0000","last_peered":"2024-09-17T03:38:29.005888+0000","last_clean":"2024-09-17T03:38:29.005888+0000","last_became_active":"2024-09-17T03:38:27.992329+0000","last_became_peered":"2024-09-17T03:38:27.992329+0000","last_unstale":"2024-09-17T03:38:29.005888+0000","last_undegraded":"2024-09-17T03:38:29.005888+0000","last_fullsized":"2024-09-17T03:38:29.005888+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:49.376138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"103'6","reported_seq":21,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968653+0000","last_change":"2024-09-17T03:38:26.970950+0000","last_active":"2024-09-17T03:38:28.968653+0000","last_peered":"2024-09-17T03:38:28.968653+0000","last_clean":"2024-09-17T03:38:28.968653+0000","last_became_active":"2024-09-17T03:38:26.970571+0000","last_became_peered":"2024-09-17T03:38:26.970571+0000","last_unstale":"2024-09-17T03:38:28.968653+0000","last_undegraded":"2024-09-17T03:38:28.968653+0000","last_fullsized":"2024-09-17T03:38:28.968653+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:19.026536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261760+0000","last_change":"2024-09-17T03:38:27.993750+0000","last_active":"2024-09-17T03:38:29.261760+0000","last_peered":"2024-09-17T03:38:29.261760+0000","last_clean":"2024-09-17T03:38:29.261760+0000","last_became_active":"2024-09-17T03:38:27.993463+0000","last_became_peered":"2024-09-17T03:38:27.993463+0000","last_unstale":"2024-09-17T03:38:29.261760+0000","last_undegraded":"2024-09-17T03:38:29.261760+0000","last_fullsized":"2024-09-17T03:38:29.261760+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:30.094123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191737+0000","last_change":"2024-09-17T03:38:26.974447+0000","last_active":"2024-09-17T03:38:29.191737+0000","last_peered":"2024-09-17T03:38:29.191737+0000","last_clean":"2024-09-17T03:38:29.191737+0000","last_became_active":"2024-09-17T03:38:26.973897+0000","last_became_peered":"2024-09-17T03:38:26.973897+0000","last_unstale":"2024-09-17T03:38:29.191737+0000","last_undegraded":"2024-09-17T03:38:29.191737+0000","last_fullsized":"2024-09-17T03:38:29.191737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:15.443030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261947+0000","last_change":"2024-09-17T03:38:27.990618+0000","last_active":"2024-09-17T03:38:29.261947+0000","last_peered":"2024-09-17T03:38:29.261947+0000","last_clean":"2024-09-17T03:38:29.261947+0000","last_became_active":"2024-09-17T03:38:27.990303+0000","last_became_peered":"2024-09-17T03:38:27.990303+0000","last_unstale":"2024-09-17T03:38:29.261947+0000","last_undegraded":"2024-09-17T03:38:29.261947+0000","last_fullsized":"2024-09-17T03:38:29.261947+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:47.932118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.192048+0000","last_change":"2024-09-17T03:38:26.974800+0000","last_active":"2024-09-17T03:38:29.192048+0000","last_peered":"2024-09-17T03:38:29.192048+0000","last_clean":"2024-09-17T03:38:29.192048+0000","last_became_active":"2024-09-17T03:38:26.973636+0000","last_became_peered":"2024-09-17T03:38:26.973636+0000","last_unstale":"2024-09-17T03:38:29.192048+0000","last_undegraded":"2024-09-17T03:38:29.192048+0000","last_fullsized":"2024-09-17T03:38:29.192048+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:24.347945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967612+0000","last_change":"2024-09-17T03:38:27.981267+0000","last_active":"2024-09-17T03:38:28.967612+0000","last_peered":"2024-09-17T03:38:28.967612+0000","last_clean":"2024-09-17T03:38:28.967612+0000","last_became_active":"2024-09-17T03:38:27.980948+0000","last_became_peered":"2024-09-17T03:38:27.980948+0000","last_unstale":"2024-09-17T03:38:28.967612+0000","last_undegraded":"2024-09-17T03:38:28.967612+0000","last_fullsized":"2024-09-17T03:38:28.967612+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:00.923679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967685+0000","last_change":"2024-09-17T03:38:26.967641+0000","last_active":"2024-09-17T03:38:28.967685+0000","last_peered":"2024-09-17T03:38:28.967685+0000","last_clean":"2024-09-17T03:38:28.967685+0000","last_became_active":"2024-09-17T03:38:26.967327+0000","last_became_peered":"2024-09-17T03:38:26.967327+0000","last_unstale":"2024-09-17T03:38:28.967685+0000","last_undegraded":"2024-09-17T03:38:28.967685+0000","last_fullsized":"2024-09-17T03:38:28.967685+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:29.998335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191642+0000","last_change":"2024-09-17T03:38:27.996101+0000","last_active":"2024-09-17T03:38:29.191642+0000","last_peered":"2024-09-17T03:38:29.191642+0000","last_clean":"2024-09-17T03:38:29.191642+0000","last_became_active":"2024-09-17T03:38:27.995788+0000","last_became_peered":"2024-09-17T03:38:27.995788+0000","last_unstale":"2024-09-17T03:38:29.191642+0000","last_undegraded":"2024-09-17T03:38:29.191642+0000","last_fullsized":"2024-09-17T03:38:29.191642+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:15.921214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"103'8","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261364+0000","last_change":"2024-09-17T03:38:26.970998+0000","last_active":"2024-09-17T03:38:29.261364+0000","last_peered":"2024-09-17T03:38:29.261364+0000","last_clean":"2024-09-17T03:38:29.261364+0000","last_became_active":"2024-09-17T03:38:26.970693+0000","last_became_peered":"2024-09-17T03:38:26.970693+0000","last_unstale":"2024-09-17T03:38:29.261364+0000","last_undegraded":"2024-09-17T03:38:29.261364+0000","last_fullsized":"2024-09-17T03:38:29.261364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:21.604318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969341+0000","last_change":"2024-09-17T03:38:27.972622+0000","last_active":"2024-09-17T03:38:28.969341+0000","last_peered":"2024-09-17T03:38:28.969341+0000","last_clean":"2024-09-17T03:38:28.969341+0000","last_became_active":"2024-09-17T03:38:27.972170+0000","last_became_peered":"2024-09-17T03:38:27.972170+0000","last_unstale":"2024-09-17T03:38:28.969341+0000","last_undegraded":"2024-09-17T03:38:28.969341+0000","last_fullsized":"2024-09-17T03:38:28.969341+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:42.671301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968039+0000","last_change":"2024-09-17T03:38:26.974319+0000","last_active":"2024-09-17T03:38:28.968039+0000","last_peered":"2024-09-17T03:38:28.968039+0000","last_clean":"2024-09-17T03:38:28.968039+0000","last_became_active":"2024-09-17T03:38:26.974008+0000","last_became_peered":"2024-09-17T03:38:26.974008+0000","last_unstale":"2024-09-17T03:38:28.968039+0000","last_undegraded":"2024-09-17T03:38:28.968039+0000","last_fullsized":"2024-09-17T03:38:28.968039+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:15.506982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261329+0000","last_change":"2024-09-17T03:38:27.983713+0000","last_active":"2024-09-17T03:38:29.261329+0000","last_peered":"2024-09-17T03:38:29.261329+0000","last_clean":"2024-09-17T03:38:29.261329+0000","last_became_active":"2024-09-17T03:38:27.983398+0000","last_became_peered":"2024-09-17T03:38:27.983398+0000","last_unstale":"2024-09-17T03:38:29.261329+0000","last_undegraded":"2024-09-17T03:38:29.261329+0000","last_fullsized":"2024-09-17T03:38:29.261329+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:46.803973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968860+0000","last_change":"2024-09-17T03:38:26.972839+0000","last_active":"2024-09-17T03:38:28.968860+0000","last_peered":"2024-09-17T03:38:28.968860+0000","last_clean":"2024-09-17T03:38:28.968860+0000","last_became_active":"2024-09-17T03:38:26.972478+0000","last_became_peered":"2024-09-17T03:38:26.972478+0000","last_unstale":"2024-09-17T03:38:28.968860+0000","last_undegraded":"2024-09-17T03:38:28.968860+0000","last_fullsized":"2024-09-17T03:38:28.968860+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:36.480429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005983+0000","last_change":"2024-09-17T03:38:27.991905+0000","last_active":"2024-09-17T03:38:29.005983+0000","last_peered":"2024-09-17T03:38:29.005983+0000","last_clean":"2024-09-17T03:38:29.005983+0000","last_became_active":"2024-09-17T03:38:27.991253+0000","last_became_peered":"2024-09-17T03:38:27.991253+0000","last_unstale":"2024-09-17T03:38:29.005983+0000","last_undegraded":"2024-09-17T03:38:29.005983+0000","last_fullsized":"2024-09-17T03:38:29.005983+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:47.703166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966712+0000","last_change":"2024-09-17T03:38:26.966582+0000","last_active":"2024-09-17T03:38:28.966712+0000","last_peered":"2024-09-17T03:38:28.966712+0000","last_clean":"2024-09-17T03:38:28.966712+0000","last_became_active":"2024-09-17T03:38:26.966236+0000","last_became_peered":"2024-09-17T03:38:26.966236+0000","last_unstale":"2024-09-17T03:38:28.966712+0000","last_undegraded":"2024-09-17T03:38:28.966712+0000","last_fullsized":"2024-09-17T03:38:28.966712+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:37.908196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191936+0000","last_change":"2024-09-17T03:38:27.998470+0000","last_active":"2024-09-17T03:38:29.191936+0000","last_peered":"2024-09-17T03:38:29.191936+0000","last_clean":"2024-09-17T03:38:29.191936+0000","last_became_active":"2024-09-17T03:38:27.998141+0000","last_became_peered":"2024-09-17T03:38:27.998141+0000","last_unstale":"2024-09-17T03:38:29.191936+0000","last_undegraded":"2024-09-17T03:38:29.191936+0000","last_fullsized":"2024-09-17T03:38:29.191936+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:21.927496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966717+0000","last_change":"2024-09-17T03:38:26.976542+0000","last_active":"2024-09-17T03:38:28.966717+0000","last_peered":"2024-09-17T03:38:28.966717+0000","last_clean":"2024-09-17T03:38:28.966717+0000","last_became_active":"2024-09-17T03:38:26.976209+0000","last_became_peered":"2024-09-17T03:38:26.976209+0000","last_unstale":"2024-09-17T03:38:28.966717+0000","last_undegraded":"2024-09-17T03:38:28.966717+0000","last_fullsized":"2024-09-17T03:38:28.966717+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:45.010470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191554+0000","last_change":"2024-09-17T03:38:27.989123+0000","last_active":"2024-09-17T03:38:29.191554+0000","last_peered":"2024-09-17T03:38:29.191554+0000","last_clean":"2024-09-17T03:38:29.191554+0000","last_became_active":"2024-09-17T03:38:27.987713+0000","last_became_peered":"2024-09-17T03:38:27.987713+0000","last_unstale":"2024-09-17T03:38:29.191554+0000","last_undegraded":"2024-09-17T03:38:29.191554+0000","last_fullsized":"2024-09-17T03:38:29.191554+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:59.793518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261258+0000","last_change":"2024-09-17T03:38:26.973805+0000","last_active":"2024-09-17T03:38:29.261258+0000","last_peered":"2024-09-17T03:38:29.261258+0000","last_clean":"2024-09-17T03:38:29.261258+0000","last_became_active":"2024-09-17T03:38:26.973309+0000","last_became_peered":"2024-09-17T03:38:26.973309+0000","last_unstale":"2024-09-17T03:38:29.261258+0000","last_undegraded":"2024-09-17T03:38:29.261258+0000","last_fullsized":"2024-09-17T03:38:29.261258+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:06.940817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191418+0000","last_change":"2024-09-17T03:38:27.998634+0000","last_active":"2024-09-17T03:38:29.191418+0000","last_peered":"2024-09-17T03:38:29.191418+0000","last_clean":"2024-09-17T03:38:29.191418+0000","last_became_active":"2024-09-17T03:38:27.998367+0000","last_became_peered":"2024-09-17T03:38:27.998367+0000","last_unstale":"2024-09-17T03:38:29.191418+0000","last_undegraded":"2024-09-17T03:38:29.191418+0000","last_fullsized":"2024-09-17T03:38:29.191418+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:21.126756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261205+0000","last_change":"2024-09-17T03:38:26.971443+0000","last_active":"2024-09-17T03:38:29.261205+0000","last_peered":"2024-09-17T03:38:29.261205+0000","last_clean":"2024-09-17T03:38:29.261205+0000","last_became_active":"2024-09-17T03:38:26.971141+0000","last_became_peered":"2024-09-17T03:38:26.971141+0000","last_unstale":"2024-09-17T03:38:29.261205+0000","last_undegraded":"2024-09-17T03:38:29.261205+0000","last_fullsized":"2024-09-17T03:38:29.261205+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:07.606547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967668+0000","last_change":"2024-09-17T03:38:27.982133+0000","last_active":"2024-09-17T03:38:28.967668+0000","last_peered":"2024-09-17T03:38:28.967668+0000","last_clean":"2024-09-17T03:38:28.967668+0000","last_became_active":"2024-09-17T03:38:27.981801+0000","last_became_peered":"2024-09-17T03:38:27.981801+0000","last_unstale":"2024-09-17T03:38:28.967668+0000","last_undegraded":"2024-09-17T03:38:28.967668+0000","last_fullsized":"2024-09-17T03:38:28.967668+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:17.462936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966389+0000","last_change":"2024-09-17T03:38:26.974657+0000","last_active":"2024-09-17T03:38:28.966389+0000","last_peered":"2024-09-17T03:38:28.966389+0000","last_clean":"2024-09-17T03:38:28.966389+0000","last_became_active":"2024-09-17T03:38:26.973955+0000","last_became_peered":"2024-09-17T03:38:26.973955+0000","last_unstale":"2024-09-17T03:38:28.966389+0000","last_undegraded":"2024-09-17T03:38:28.966389+0000","last_fullsized":"2024-09-17T03:38:28.966389+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:23.286979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967097+0000","last_change":"2024-09-17T03:38:27.990530+0000","last_active":"2024-09-17T03:38:28.967097+0000","last_peered":"2024-09-17T03:38:28.967097+0000","last_clean":"2024-09-17T03:38:28.967097+0000","last_became_active":"2024-09-17T03:38:27.990225+0000","last_became_peered":"2024-09-17T03:38:27.990225+0000","last_unstale":"2024-09-17T03:38:28.967097+0000","last_undegraded":"2024-09-17T03:38:28.967097+0000","last_fullsized":"2024-09-17T03:38:28.967097+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:05.637779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"103'2","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261494+0000","last_change":"2024-09-17T03:38:26.974776+0000","last_active":"2024-09-17T03:38:29.261494+0000","last_peered":"2024-09-17T03:38:29.261494+0000","last_clean":"2024-09-17T03:38:29.261494+0000","last_became_active":"2024-09-17T03:38:26.974459+0000","last_became_peered":"2024-09-17T03:38:26.974459+0000","last_unstale":"2024-09-17T03:38:29.261494+0000","last_undegraded":"2024-09-17T03:38:29.261494+0000","last_fullsized":"2024-09-17T03:38:29.261494+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:40.413816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262162+0000","last_change":"2024-09-17T03:38:27.990635+0000","last_active":"2024-09-17T03:38:29.262162+0000","last_peered":"2024-09-17T03:38:29.262162+0000","last_clean":"2024-09-17T03:38:29.262162+0000","last_became_active":"2024-09-17T03:38:27.990326+0000","last_became_peered":"2024-09-17T03:38:27.990326+0000","last_unstale":"2024-09-17T03:38:29.262162+0000","last_undegraded":"2024-09-17T03:38:29.262162+0000","last_fullsized":"2024-09-17T03:38:29.262162+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:11.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967149+0000","last_change":"2024-09-17T03:38:26.974661+0000","last_active":"2024-09-17T03:38:28.967149+0000","last_peered":"2024-09-17T03:38:28.967149+0000","last_clean":"2024-09-17T03:38:28.967149+0000","last_became_active":"2024-09-17T03:38:26.974345+0000","last_became_peered":"2024-09-17T03:38:26.974345+0000","last_unstale":"2024-09-17T03:38:28.967149+0000","last_undegraded":"2024-09-17T03:38:28.967149+0000","last_fullsized":"2024-09-17T03:38:28.967149+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:59.359475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.262108+0000","last_change":"2024-09-17T03:38:27.983385+0000","last_active":"2024-09-17T03:38:29.262108+0000","last_peered":"2024-09-17T03:38:29.262108+0000","last_clean":"2024-09-17T03:38:29.262108+0000","last_became_active":"2024-09-17T03:38:27.982698+0000","last_became_peered":"2024-09-17T03:38:27.982698+0000","last_unstale":"2024-09-17T03:38:29.262108+0000","last_undegraded":"2024-09-17T03:38:29.262108+0000","last_fullsized":"2024-09-17T03:38:29.262108+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:13.426190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966637+0000","last_change":"2024-09-17T03:38:26.965679+0000","last_active":"2024-09-17T03:38:28.966637+0000","last_peered":"2024-09-17T03:38:28.966637+0000","last_clean":"2024-09-17T03:38:28.966637+0000","last_became_active":"2024-09-17T03:38:26.965356+0000","last_became_peered":"2024-09-17T03:38:26.965356+0000","last_unstale":"2024-09-17T03:38:28.966637+0000","last_undegraded":"2024-09-17T03:38:28.966637+0000","last_fullsized":"2024-09-17T03:38:28.966637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:04.970216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968941+0000","last_change":"2024-09-17T03:38:27.993766+0000","last_active":"2024-09-17T03:38:28.968941+0000","last_peered":"2024-09-17T03:38:28.968941+0000","last_clean":"2024-09-17T03:38:28.968941+0000","last_became_active":"2024-09-17T03:38:27.993432+0000","last_became_peered":"2024-09-17T03:38:27.993432+0000","last_unstale":"2024-09-17T03:38:28.968941+0000","last_undegraded":"2024-09-17T03:38:28.968941+0000","last_fullsized":"2024-09-17T03:38:28.968941+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:45.247320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.969217+0000","last_change":"2024-09-17T03:38:26.970931+0000","last_active":"2024-09-17T03:38:28.969217+0000","last_peered":"2024-09-17T03:38:28.969217+0000","last_clean":"2024-09-17T03:38:28.969217+0000","last_became_active":"2024-09-17T03:38:26.970604+0000","last_became_peered":"2024-09-17T03:38:26.970604+0000","last_unstale":"2024-09-17T03:38:28.969217+0000","last_undegraded":"2024-09-17T03:38:28.969217+0000","last_fullsized":"2024-09-17T03:38:28.969217+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:52.328415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.192172+0000","last_change":"2024-09-17T03:38:27.994165+0000","last_active":"2024-09-17T03:38:29.192172+0000","last_peered":"2024-09-17T03:38:29.192172+0000","last_clean":"2024-09-17T03:38:29.192172+0000","last_became_active":"2024-09-17T03:38:27.993861+0000","last_became_peered":"2024-09-17T03:38:27.993861+0000","last_unstale":"2024-09-17T03:38:29.192172+0000","last_undegraded":"2024-09-17T03:38:29.192172+0000","last_fullsized":"2024-09-17T03:38:29.192172+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:33.720992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.966741+0000","last_change":"2024-09-17T03:38:26.970499+0000","last_active":"2024-09-17T03:38:28.966741+0000","last_peered":"2024-09-17T03:38:28.966741+0000","last_clean":"2024-09-17T03:38:28.966741+0000","last_became_active":"2024-09-17T03:38:26.970128+0000","last_became_peered":"2024-09-17T03:38:26.970128+0000","last_unstale":"2024-09-17T03:38:28.966741+0000","last_undegraded":"2024-09-17T03:38:28.966741+0000","last_fullsized":"2024-09-17T03:38:28.966741+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:43.177282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967999+0000","last_change":"2024-09-17T03:38:27.971482+0000","last_active":"2024-09-17T03:38:28.967999+0000","last_peered":"2024-09-17T03:38:28.967999+0000","last_clean":"2024-09-17T03:38:28.967999+0000","last_became_active":"2024-09-17T03:38:27.971124+0000","last_became_peered":"2024-09-17T03:38:27.971124+0000","last_unstale":"2024-09-17T03:38:28.967999+0000","last_undegraded":"2024-09-17T03:38:28.967999+0000","last_fullsized":"2024-09-17T03:38:28.967999+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:00.365080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.968381+0000","last_change":"2024-09-17T03:38:26.974041+0000","last_active":"2024-09-17T03:38:28.968381+0000","last_peered":"2024-09-17T03:38:28.968381+0000","last_clean":"2024-09-17T03:38:28.968381+0000","last_became_active":"2024-09-17T03:38:26.973115+0000","last_became_peered":"2024-09-17T03:38:26.973115+0000","last_unstale":"2024-09-17T03:38:28.968381+0000","last_undegraded":"2024-09-17T03:38:28.968381+0000","last_fullsized":"2024-09-17T03:38:28.968381+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:33.987282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191435+0000","last_change":"2024-09-17T03:38:27.996142+0000","last_active":"2024-09-17T03:38:29.191435+0000","last_peered":"2024-09-17T03:38:29.191435+0000","last_clean":"2024-09-17T03:38:29.191435+0000","last_became_active":"2024-09-17T03:38:27.995822+0000","last_became_peered":"2024-09-17T03:38:27.995822+0000","last_unstale":"2024-09-17T03:38:29.191435+0000","last_undegraded":"2024-09-17T03:38:29.191435+0000","last_fullsized":"2024-09-17T03:38:29.191435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:04.315528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.261303+0000","last_change":"2024-09-17T03:38:26.969822+0000","last_active":"2024-09-17T03:38:29.261303+0000","last_peered":"2024-09-17T03:38:29.261303+0000","last_clean":"2024-09-17T03:38:29.261303+0000","last_became_active":"2024-09-17T03:38:26.969461+0000","last_became_peered":"2024-09-17T03:38:26.969461+0000","last_unstale":"2024-09-17T03:38:29.261303+0000","last_undegraded":"2024-09-17T03:38:29.261303+0000","last_fullsized":"2024-09-17T03:38:29.261303+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:13.647806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:28.967882+0000","last_change":"2024-09-17T03:38:27.993971+0000","last_active":"2024-09-17T03:38:28.967882+0000","last_peered":"2024-09-17T03:38:28.967882+0000","last_clean":"2024-09-17T03:38:28.967882+0000","last_became_active":"2024-09-17T03:38:27.993620+0000","last_became_peered":"2024-09-17T03:38:27.993620+0000","last_unstale":"2024-09-17T03:38:28.967882+0000","last_undegraded":"2024-09-17T03:38:28.967882+0000","last_fullsized":"2024-09-17T03:38:28.967882+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:44.121364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191565+0000","last_change":"2024-09-17T03:38:26.974988+0000","last_active":"2024-09-17T03:38:29.191565+0000","last_peered":"2024-09-17T03:38:29.191565+0000","last_clean":"2024-09-17T03:38:29.191565+0000","last_became_active":"2024-09-17T03:38:26.974315+0000","last_became_peered":"2024-09-17T03:38:26.974315+0000","last_unstale":"2024-09-17T03:38:29.191565+0000","last_undegraded":"2024-09-17T03:38:29.191565+0000","last_fullsized":"2024-09-17T03:38:29.191565+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:12.754692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.191832+0000","last_change":"2024-09-17T03:38:27.998521+0000","last_active":"2024-09-17T03:38:29.191832+0000","last_peered":"2024-09-17T03:38:29.191832+0000","last_clean":"2024-09-17T03:38:29.191832+0000","last_became_active":"2024-09-17T03:38:27.998207+0000","last_became_peered":"2024-09-17T03:38:27.998207+0000","last_unstale":"2024-09-17T03:38:29.191832+0000","last_undegraded":"2024-09-17T03:38:29.191832+0000","last_fullsized":"2024-09-17T03:38:29.191832+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:26.949525+0000","last_clean_scrub_stamp":"2024-09-17T03:38:26.949525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:22.891457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005652+0000","last_change":"2024-09-17T03:38:26.979932+0000","last_active":"2024-09-17T03:38:29.005652+0000","last_peered":"2024-09-17T03:38:29.005652+0000","last_clean":"2024-09-17T03:38:29.005652+0000","last_became_active":"2024-09-17T03:38:26.979630+0000","last_became_peered":"2024-09-17T03:38:26.979630+0000","last_unstale":"2024-09-17T03:38:29.005652+0000","last_undegraded":"2024-09-17T03:38:29.005652+0000","last_fullsized":"2024-09-17T03:38:29.005652+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:38:25.943920+0000","last_clean_scrub_stamp":"2024-09-17T03:38:25.943920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:59.918075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":261,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T03:38:29.005746+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:38:29.005746+0000","last_peered":"2024-09-17T03:38:29.005746+0000","last_clean":"2024-09-17T03:38:29.005746+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:38:29.005746+0000","last_undegraded":"2024-09-17T03:38:29.005746+0000","last_fullsized":"2024-09-17T03:38:29.005746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37184,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334656,"statfs":{"total":96636764160,"available":96598687744,"internally_reserved":0,"allocated":1880064,"data_stored":1146837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36174283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40756,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331084,"statfs":{"total":96636764160,"available":96595030016,"internally_reserved":0,"allocated":1273856,"data_stored":550709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40776,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331064,"statfs":{"total":96636764160,"available":96595009536,"internally_reserved":0,"allocated":1298432,"data_stored":558093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36596,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335244,"statfs":{"total":96636764160,"available":96599289856,"internally_reserved":0,"allocated":1269760,"data_stored":550091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509513,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40760,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331080,"statfs":{"total":96636764160,"available":96595025920,"internally_reserved":0,"allocated":1277952,"data_stored":556357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37168,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334672,"statfs":{"total":96636764160,"available":96598704128,"internally_reserved":0,"allocated":1863680,"data_stored":1141007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40760,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331080,"statfs":{"total":96636764160,"available":96595025920,"internally_reserved":0,"allocated":1282048,"data_stored":556427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40772,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331068,"statfs":{"total":96636764160,"available":96595013632,"internally_reserved":0,"allocated":1294336,"data_stored":557991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:38:35.776 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:38:35.776 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:38:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.931+0000 7fa8d4994640 1 -- 172.21.15.146:0/3786867634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8bc0099b0 msgr2=0x7fa8bc00bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.931+0000 7fa8d4994640 1 --2- 172.21.15.146:0/3786867634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8bc0099b0 0x7fa8bc00bdd0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8001dc0 tx=0x7fa8bc005830 comp rx=0 tx=0).stop 2024-09-17T03:38:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.931+0000 7fa8d4994640 1 -- 172.21.15.146:0/3786867634 shutdown_connections 2024-09-17T03:38:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.931+0000 7fa8d4994640 1 --2- 172.21.15.146:0/3786867634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8bc0099b0 0x7fa8bc00bdd0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.931+0000 7fa8d4994640 1 -- 172.21.15.146:0/3786867634 >> 172.21.15.146:0/3786867634 conn(0x7fa8d006dd60 msgr2=0x7fa8d006e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.931+0000 7fa8d4994640 1 -- 172.21.15.146:0/3786867634 shutdown_connections 2024-09-17T03:38:35.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.931+0000 7fa8d4994640 1 -- 172.21.15.146:0/3786867634 wait complete. 2024-09-17T03:38:35.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.933+0000 7fa8d4994640 1 Processor -- start 2024-09-17T03:38:35.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.933+0000 7fa8d4994640 1 -- start start 2024-09-17T03:38:35.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8d4994640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8bc0099b0 0x7fa8d014da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:35.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8d4994640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d0142bc0 0x7fa8d00b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:35.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8d4994640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d0142fd0 0x7fa8d00b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:35.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8d4994640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d015ca60 con 0x7fa8d0142fd0 2024-09-17T03:38:35.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8d4994640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d015c8e0 con 0x7fa8bc0099b0 2024-09-17T03:38:35.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8d4994640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d015cbe0 con 0x7fa8d0142bc0 2024-09-17T03:38:35.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8ced9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d0142fd0 0x7fa8d00b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:35.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8ced9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d0142fd0 0x7fa8d00b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52994/0 (socket says 172.21.15.146:52994) 2024-09-17T03:38:35.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8ced9d640 1 -- 172.21.15.146:0/3599379907 learned_addr learned my addr 172.21.15.146:0/3599379907 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:35.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8ce59c640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8bc0099b0 0x7fa8d014da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:35.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8cdd9b640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d0142bc0 0x7fa8d00b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:35.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8ced9d640 1 -- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d0142bc0 msgr2=0x7fa8d00b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:35.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8ced9d640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d0142bc0 0x7fa8d00b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8ced9d640 1 -- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8bc0099b0 msgr2=0x7fa8d014da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:35.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8ced9d640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8bc0099b0 0x7fa8d014da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:35.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8ced9d640 1 -- 172.21.15.146:0/3599379907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d014c000 con 0x7fa8d0142fd0 2024-09-17T03:38:35.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8cdd9b640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d0142bc0 0x7fa8d00b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:38:35.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.934+0000 7fa8ced9d640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d0142fd0 0x7fa8d00b3810 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8001eb0 tx=0x7fa8c8006dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:35.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.935+0000 7fa8c6ffd640 1 -- 172.21.15.146:0/3599379907 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80062b0 con 0x7fa8d0142fd0 2024-09-17T03:38:35.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.935+0000 7fa8c6ffd640 1 -- 172.21.15.146:0/3599379907 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8c8006470 con 0x7fa8d0142fd0 2024-09-17T03:38:35.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.935+0000 7fa8d4994640 1 -- 172.21.15.146:0/3599379907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d014c2e0 con 0x7fa8d0142fd0 2024-09-17T03:38:35.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.935+0000 7fa8c6ffd640 1 -- 172.21.15.146:0/3599379907 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8033480 con 0x7fa8d0142fd0 2024-09-17T03:38:35.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.935+0000 7fa8d4994640 1 -- 172.21.15.146:0/3599379907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d014c8a0 con 0x7fa8d0142fd0 2024-09-17T03:38:35.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.936+0000 7fa8d4994640 1 -- 172.21.15.146:0/3599379907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d00739e0 con 0x7fa8d0142fd0 2024-09-17T03:38:35.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.937+0000 7fa8c6ffd640 1 -- 172.21.15.146:0/3599379907 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa8c8033620 con 0x7fa8d0142fd0 2024-09-17T03:38:35.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.937+0000 7fa8c6ffd640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa8b0078b90 0x7fa8b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:35.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.937+0000 7fa8c6ffd640 1 -- 172.21.15.146:0/3599379907 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fa8c80bac50 con 0x7fa8d0142fd0 2024-09-17T03:38:35.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.937+0000 7fa8ce59c640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa8b0078b90 0x7fa8b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:35.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.938+0000 7fa8ce59c640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa8b0078b90 0x7fa8b007b0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8000fb0 tx=0x7fa8b8001100 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:35.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:35.942+0000 7fa8c6ffd640 1 -- 172.21.15.146:0/3599379907 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa8c8083090 con 0x7fa8d0142fd0 2024-09-17T03:38:36.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.189+0000 7fa8d4994640 1 -- 172.21.15.146:0/3599379907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa8d006e170 con 0x7fa8d0142fd0 2024-09-17T03:38:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.194+0000 7fa8c6ffd640 1 -- 172.21.15.146:0/3599379907 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7fa8c8082990 con 0x7fa8d0142fd0 2024-09-17T03:38:36.194 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:38:36.194 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:38:36.194 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:38:36.194 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:38:36.194 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:38:36.194 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:38:36.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 -- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa8b0078b90 msgr2=0x7fa8b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:36.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa8b0078b90 0x7fa8b007b0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8000fb0 tx=0x7fa8b8001100 comp rx=0 tx=0).stop 2024-09-17T03:38:36.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 -- 172.21.15.146:0/3599379907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d0142fd0 msgr2=0x7fa8d00b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:36.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d0142fd0 0x7fa8d00b3810 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8001eb0 tx=0x7fa8c8006dd0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 -- 172.21.15.146:0/3599379907 shutdown_connections 2024-09-17T03:38:36.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa8b0078b90 0x7fa8b007b0a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8d0142fd0 0x7fa8d00b3810 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8d0142bc0 0x7fa8d00b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 --2- 172.21.15.146:0/3599379907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8bc0099b0 0x7fa8d014da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 -- 172.21.15.146:0/3599379907 >> 172.21.15.146:0/3599379907 conn(0x7fa8d006dd60 msgr2=0x7fa8d006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:36.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 -- 172.21.15.146:0/3599379907 shutdown_connections 2024-09-17T03:38:36.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.197+0000 7fa8d4994640 1 -- 172.21.15.146:0/3599379907 wait complete. 2024-09-17T03:38:36.209 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:38:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.322+0000 7f9edbd57640 1 -- 172.21.15.146:0/3642134102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ed40d0660 msgr2=0x7f9ed406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.322+0000 7f9edbd57640 1 --2- 172.21.15.146:0/3642134102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ed40d0660 0x7f9ed406d190 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4071ce0 tx=0x7f9ecc02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.322+0000 7f9edbd57640 1 -- 172.21.15.146:0/3642134102 shutdown_connections 2024-09-17T03:38:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.322+0000 7f9edbd57640 1 --2- 172.21.15.146:0/3642134102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ed40d0660 0x7f9ed406d190 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.322+0000 7f9edbd57640 1 --2- 172.21.15.146:0/3642134102 >> v2:172.21.15.179:3300/0 conn(0x7f9ed4146230 0x7f9ed406cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.322+0000 7f9edbd57640 1 -- 172.21.15.146:0/3642134102 >> 172.21.15.146:0/3642134102 conn(0x7f9ed40b3150 msgr2=0x7f9ed40b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.322+0000 7f9edbd57640 1 -- 172.21.15.146:0/3642134102 shutdown_connections 2024-09-17T03:38:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.322+0000 7f9edbd57640 1 -- 172.21.15.146:0/3642134102 wait complete. 2024-09-17T03:38:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.324+0000 7f9edbd57640 1 Processor -- start 2024-09-17T03:38:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.324+0000 7f9edbd57640 1 -- start start 2024-09-17T03:38:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9edbd57640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ed40d0660 0x7f9ed415f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9edbd57640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ed4145ce0 0x7f9ed4131e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9edbd57640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed4146230 0x7f9ed41f7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9edbd57640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed4073e10 con 0x7f9ed40d0660 2024-09-17T03:38:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9edbd57640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed4073c90 con 0x7f9ed4145ce0 2024-09-17T03:38:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9edbd57640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed4073f90 con 0x7f9ed4146230 2024-09-17T03:38:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9ed9af3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ed40d0660 0x7f9ed415f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9ed9af3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ed40d0660 0x7f9ed415f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53014/0 (socket says 172.21.15.146:53014) 2024-09-17T03:38:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9ed9af3640 1 -- 172.21.15.146:0/2759834712 learned_addr learned my addr 172.21.15.146:0/2759834712 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9ed92f2640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ed4145ce0 0x7f9ed4131e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9eda2f4640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed4146230 0x7f9ed41f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9ed9af3640 1 -- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed4146230 msgr2=0x7f9ed41f7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9ed9af3640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed4146230 0x7f9ed41f7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9ed9af3640 1 -- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ed4145ce0 msgr2=0x7f9ed4131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9ed9af3640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ed4145ce0 0x7f9ed4131e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9ed9af3640 1 -- 172.21.15.146:0/2759834712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed4132b50 con 0x7f9ed40d0660 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9ed92f2640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ed4145ce0 0x7f9ed4131e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.325+0000 7f9ed9af3640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ed40d0660 0x7f9ed415f630 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400eb60 tx=0x7f9ec400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.326+0000 7f9ed27fc640 1 -- 172.21.15.146:0/2759834712 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4010630 con 0x7f9ed40d0660 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.326+0000 7f9ed27fc640 1 -- 172.21.15.146:0/2759834712 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ec40108c0 con 0x7f9ed40d0660 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.326+0000 7f9ed27fc640 1 -- 172.21.15.146:0/2759834712 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4010d10 con 0x7f9ed40d0660 2024-09-17T03:38:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.326+0000 7f9edbd57640 1 -- 172.21.15.146:0/2759834712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed41f37a0 con 0x7f9ed40d0660 2024-09-17T03:38:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.326+0000 7f9edbd57640 1 -- 172.21.15.146:0/2759834712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed41f3d60 con 0x7f9ed40d0660 2024-09-17T03:38:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.327+0000 7f9edbd57640 1 -- 172.21.15.146:0/2759834712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed4073580 con 0x7f9ed40d0660 2024-09-17T03:38:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.327+0000 7f9ed27fc640 1 -- 172.21.15.146:0/2759834712 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ec4018420 con 0x7f9ed40d0660 2024-09-17T03:38:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.328+0000 7f9ed27fc640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9ec0078b90 0x7f9ec007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.328+0000 7f9ed27fc640 1 -- 172.21.15.146:0/2759834712 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f9ec409ba80 con 0x7f9ed40d0660 2024-09-17T03:38:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.328+0000 7f9ed92f2640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9ec0078b90 0x7f9ec007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.329+0000 7f9ed92f2640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9ec0078b90 0x7f9ec007b0a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8000f60 tx=0x7f9ec8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.332+0000 7f9ed27fc640 1 -- 172.21.15.146:0/2759834712 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9ec400ee60 con 0x7f9ed40d0660 2024-09-17T03:38:36.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.544+0000 7f9edbd57640 1 -- 172.21.15.146:0/2759834712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ed40cdc50 con 0x7f9ed40d0660 2024-09-17T03:38:36.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.544+0000 7f9ed27fc640 1 -- 172.21.15.146:0/2759834712 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5225 (secure 0 0 0) 0x7f9ec4063f50 con 0x7f9ed40d0660 2024-09-17T03:38:36.545 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:38:36.545 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":77,"btime":"2024-09-17T03:38:29:984393+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/351223948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":351223948},{"type":"v1","addr":"172.21.15.146:6835","nonce":351223948}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/985271714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":985271714},{"type":"v1","addr":"172.21.15.179:6835","nonce":985271714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/781824323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":781824323},{"type":"v1","addr":"172.21.15.179:6837","nonce":781824323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:38:27.325806+0000","modified":"2024-09-17T03:38:29.334476+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7770},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7770":{"gid":7770,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/682941374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":682941374},{"type":"v1","addr":"172.21.15.146:6834","nonce":682941374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7770,"qdb_cluster":[7770]},"id":7}]} 2024-09-17T03:38:36.545 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 77 2024-09-17T03:38:36.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 -- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9ec0078b90 msgr2=0x7f9ec007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:36.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9ec0078b90 0x7f9ec007b0a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8000f60 tx=0x7f9ec8009040 comp rx=0 tx=0).stop 2024-09-17T03:38:36.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 -- 172.21.15.146:0/2759834712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ed40d0660 msgr2=0x7f9ed415f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:36.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ed40d0660 0x7f9ed415f630 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400eb60 tx=0x7f9ec400c6a0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 -- 172.21.15.146:0/2759834712 shutdown_connections 2024-09-17T03:38:36.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9ec0078b90 0x7f9ec007b0a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ed4146230 0x7f9ed41f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ed4145ce0 0x7f9ed4131e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 --2- 172.21.15.146:0/2759834712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ed40d0660 0x7f9ed415f630 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:36.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 -- 172.21.15.146:0/2759834712 >> 172.21.15.146:0/2759834712 conn(0x7f9ed40b3150 msgr2=0x7f9ed4070900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:36.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 -- 172.21.15.146:0/2759834712 shutdown_connections 2024-09-17T03:38:36.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:36.547+0000 7f9edbd57640 1 -- 172.21.15.146:0/2759834712 wait complete. 2024-09-17T03:38:36.960 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:38:27.325806+0000', 'modified': '2024-09-17T03:38:29.334476+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7770}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7770': {'gid': 7770, 'name': 'a', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.146:6834/682941374', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 682941374}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 682941374}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7770, 'qdb_cluster': [7770]} 2024-09-17T03:38:36.960 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:38:36.961 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:38:37.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.080+0000 7fc354fba640 1 -- 172.21.15.146:0/1362344887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3500b3b60 msgr2=0x7fc35015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.080+0000 7fc354fba640 1 --2- 172.21.15.146:0/1362344887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3500b3b60 0x7fc35015caa0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fc3500b8440 tx=0x7fc34802a980 comp rx=0 tx=0).stop 2024-09-17T03:38:37.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.080+0000 7fc354fba640 1 -- 172.21.15.146:0/1362344887 shutdown_connections 2024-09-17T03:38:37.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.080+0000 7fc354fba640 1 --2- 172.21.15.146:0/1362344887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3500b3b60 0x7fc35015caa0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.080+0000 7fc354fba640 1 --2- 172.21.15.146:0/1362344887 >> v2:172.21.15.179:3300/0 conn(0x7fc3500b5750 0x7fc3500b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.080+0000 7fc354fba640 1 -- 172.21.15.146:0/1362344887 >> 172.21.15.146:0/1362344887 conn(0x7fc3500b7b20 msgr2=0x7fc35009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:37.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.080+0000 7fc354fba640 1 -- 172.21.15.146:0/1362344887 shutdown_connections 2024-09-17T03:38:37.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.080+0000 7fc354fba640 1 -- 172.21.15.146:0/1362344887 wait complete. 2024-09-17T03:38:37.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.082+0000 7fc354fba640 1 Processor -- start 2024-09-17T03:38:37.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.082+0000 7fc354fba640 1 -- start start 2024-09-17T03:38:37.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.083+0000 7fc354fba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3500b3b60 0x7fc3501f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.083+0000 7fc354fba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3500b5750 0x7fc35009e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.083+0000 7fc354fba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3500b5ce0 0x7fc35014df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.083+0000 7fc354fba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc35015d420 con 0x7fc3500b3b60 2024-09-17T03:38:37.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.083+0000 7fc354fba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc35015d2a0 con 0x7fc3500b5ce0 2024-09-17T03:38:37.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.083+0000 7fc354fba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc35015d5a0 con 0x7fc3500b5750 2024-09-17T03:38:37.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.083+0000 7fc34e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3500b3b60 0x7fc3501f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.083+0000 7fc34e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3500b3b60 0x7fc3501f4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53040/0 (socket says 172.21.15.146:53040) 2024-09-17T03:38:37.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.083+0000 7fc34e59c640 1 -- 172.21.15.146:0/3278747573 learned_addr learned my addr 172.21.15.146:0/3278747573 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:37.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc345d9b640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3500b5750 0x7fc35009e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc34ed9d640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3500b5ce0 0x7fc35014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc34e59c640 1 -- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3500b5750 msgr2=0x7fc35009e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc34e59c640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3500b5750 0x7fc35009e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc34e59c640 1 -- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3500b5ce0 msgr2=0x7fc35014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc34e59c640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3500b5ce0 0x7fc35014df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc34e59c640 1 -- 172.21.15.146:0/3278747573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35009c940 con 0x7fc3500b3b60 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc34e59c640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3500b3b60 0x7fc3501f4010 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fc34000b420 tx=0x7fc34000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc3477fe640 1 -- 172.21.15.146:0/3278747573 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340011830 con 0x7fc3500b3b60 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc3477fe640 1 -- 172.21.15.146:0/3278747573 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc340016070 con 0x7fc3500b3b60 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc354fba640 1 -- 172.21.15.146:0/3278747573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35009cc20 con 0x7fc3500b3b60 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc3477fe640 1 -- 172.21.15.146:0/3278747573 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340011d60 con 0x7fc3500b3b60 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.084+0000 7fc354fba640 1 -- 172.21.15.146:0/3278747573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35009d1e0 con 0x7fc3500b3b60 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.086+0000 7fc3477fe640 1 -- 172.21.15.146:0/3278747573 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc34001b460 con 0x7fc3500b3b60 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.086+0000 7fc3477fe640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc330078bc0 0x7fc33007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.087+0000 7fc3477fe640 1 -- 172.21.15.146:0/3278747573 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fc34009a670 con 0x7fc3500b3b60 2024-09-17T03:38:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.087+0000 7fc345d9b640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc330078bc0 0x7fc33007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.087+0000 7fc345d9b640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc330078bc0 0x7fc33007b0d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc3500c7950 tx=0x7fc33800a2d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:37.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.087+0000 7fc35c005740 1 Processor -- start 2024-09-17T03:38:37.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.088+0000 7fc35c005740 1 -- start start 2024-09-17T03:38:37.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc35c005740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871d3270 0x5624875a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc35c005740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871aa3b0 0x5624875a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc35c005740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x5624875c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc35c005740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5624874ed820 con 0x5624871aa3b0 2024-09-17T03:38:37.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc35c005740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5624874dcc50 con 0x5624871d3270 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc35c005740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5624874e0a60 con 0x5624871b2590 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc345d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871aa3b0 0x5624875a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc345d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871aa3b0 0x5624875a54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53048/0 (socket says 172.21.15.146:53048) 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc345d9b640 1 -- 172.21.15.146:0/1897436355 learned_addr learned my addr 172.21.15.146:0/1897436355 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc34e59c640 1 --2- 172.21.15.146:0/1897436355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871d3270 0x5624875a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc34ed9d640 1 --2- 172.21.15.146:0/1897436355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x5624875c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc345d9b640 1 -- 172.21.15.146:0/1897436355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 msgr2=0x5624875c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc345d9b640 1 --2- 172.21.15.146:0/1897436355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x5624875c23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc345d9b640 1 -- 172.21.15.146:0/1897436355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871d3270 msgr2=0x5624875a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc345d9b640 1 --2- 172.21.15.146:0/1897436355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871d3270 0x5624875a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.089+0000 7fc345d9b640 1 -- 172.21.15.146:0/1897436355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248723e850 con 0x5624871aa3b0 2024-09-17T03:38:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.090+0000 7fc345d9b640 1 --2- 172.21.15.146:0/1897436355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871aa3b0 0x5624875a54e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc33800fe20 tx=0x7fc338012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e13c8dd71a9daa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:37.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.090+0000 7fc32ffff640 1 -- 172.21.15.146:0/1897436355 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338016070 con 0x5624871aa3b0 2024-09-17T03:38:37.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.090+0000 7fc32ffff640 1 -- 172.21.15.146:0/1897436355 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc338025630 con 0x5624871aa3b0 2024-09-17T03:38:37.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.090+0000 7fc32ffff640 1 -- 172.21.15.146:0/1897436355 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338025a60 con 0x5624871aa3b0 2024-09-17T03:38:37.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.091+0000 7fc35c005740 1 -- 172.21.15.146:0/1897436355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871aa3b0 msgr2=0x5624875a54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.091+0000 7fc35c005740 1 --2- 172.21.15.146:0/1897436355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871aa3b0 0x5624875a54e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc33800fe20 tx=0x7fc338012000 comp rx=0 tx=0).stop 2024-09-17T03:38:37.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.091+0000 7fc35c005740 1 -- 172.21.15.146:0/1897436355 shutdown_connections 2024-09-17T03:38:37.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.091+0000 7fc35c005740 1 --2- 172.21.15.146:0/1897436355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x5624875c23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.091+0000 7fc35c005740 1 --2- 172.21.15.146:0/1897436355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871aa3b0 0x5624875a54e0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.091+0000 7fc35c005740 1 --2- 172.21.15.146:0/1897436355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871d3270 0x5624875a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.091+0000 7fc35c005740 1 -- 172.21.15.146:0/1897436355 >> 172.21.15.146:0/1897436355 conn(0x5624871c73c0 msgr2=0x56248757b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:37.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.091+0000 7fc35c005740 1 -- 172.21.15.146:0/1897436355 shutdown_connections 2024-09-17T03:38:37.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.091+0000 7fc35c005740 1 -- 172.21.15.146:0/1897436355 wait complete. 2024-09-17T03:38:37.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.092+0000 7fc35c005740 1 -- start start 2024-09-17T03:38:37.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.092+0000 7fc35c005740 1 Processor -- start 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.093+0000 7fc35c005740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x5624875916c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.093+0000 7fc35c005740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x5624875b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.093+0000 7fc35c005740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x562487594760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.093+0000 7fc35c005740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56248724d620 con 0x5624871d3270 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.093+0000 7fc35c005740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5624874825f0 con 0x5624871aa3b0 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.093+0000 7fc35c005740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5624875a5a20 con 0x5624871b2590 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.093+0000 7fc35c005740 10 client.0 _ll_register_callbacks cb 0x5624874860a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.093+0000 7fc34ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x562487594760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.093+0000 7fc34ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x562487594760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53052/0 (socket says 172.21.15.146:53052) 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.093+0000 7fc34ed9d640 1 -- 172.21.15.146:0/1832090889 learned_addr learned my addr 172.21.15.146:0/1832090889 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.093+0000 7fc34e59c640 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x5624875916c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc345d9b640 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x5624875b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc34ed9d640 1 -- 172.21.15.146:0/1832090889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 msgr2=0x5624875b8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc34ed9d640 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x5624875b8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc34ed9d640 1 -- 172.21.15.146:0/1832090889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 msgr2=0x5624875916c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc34ed9d640 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x5624875916c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc34ed9d640 1 -- 172.21.15.146:0/1832090889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624872b56b0 con 0x5624871d3270 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc34ed9d640 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x562487594760 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc34802af70 tx=0x7fc348003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193cdb0fefb0de2a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc32d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc32d7fa640 1 -- 172.21.15.146:0/1832090889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348034040 con 0x5624871d3270 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc32d7fa640 1 -- 172.21.15.146:0/1832090889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fc348004040 con 0x5624871d3270 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc35c005740 1 -- 172.21.15.146:0/1832090889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc338025630 con 0x5624871d3270 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc32d7fa640 1 -- 172.21.15.146:0/1832090889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fc348051050 con 0x5624871d3270 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc35c005740 10 client.7938 fetch_fsmap learned FSMap version 77 2024-09-17T03:38:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc35c005740 1 -- 172.21.15.146:0/1832090889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5624875b6d40 con 0x5624871d3270 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc32d7fa640 1 -- 172.21.15.146:0/1832090889 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc338025630 con 0x5624871d3270 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc32d7fa640 1 -- 172.21.15.146:0/1832090889 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7fc348054020 con 0x5624871d3270 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc35c005740 10 client.7938 fetch_fsmap finished waiting for FSMap version 77 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc35c005740 10 client.7938 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc35c005740 20 client.7938 populate_metadata read hostname 'smithi146' 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc35c005740 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x562487191e40 0x5624875d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc35c005740 4 client.7938 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.094+0000 7fc35c005740 1 -- 172.21.15.146:0/1832090889 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624874ef770 con 0x562487191e40 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.095+0000 7fc34e59c640 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x562487191e40 0x5624875d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.095+0000 7fc32d7fa640 10 client.7938 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.095+0000 7fc34e59c640 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x562487191e40 0x5624875d2790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f58d75735e01dbe6 server_cookie=86f7b4a0450a6c3c in_seq=0 out_seq=0 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc32d7fa640 1 -- 172.21.15.146:0/1832090889 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624874ef770 con 0x562487191e40 2024-09-17T03:38:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc32d7fa640 10 client.7938 handle_command_reply: tid=0 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 1 client.7938 shutdown 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 1 -- 172.21.15.146:0/1832090889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 msgr2=0x562487594760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x562487594760 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc34802af70 tx=0x7fc348003ba0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 1 -- 172.21.15.146:0/1832090889 shutdown_connections 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x562487191e40 0x5624875d2790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x562487594760 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x5624875b8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 1 --2- 172.21.15.146:0/1832090889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x5624875916c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc32d7fa640 0 client.7938 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 1 -- 172.21.15.146:0/1832090889 >> 172.21.15.146:0/1832090889 conn(0x5624871c73c0 msgr2=0x562487575b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 1 -- 172.21.15.146:0/1832090889 shutdown_connections 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 1 -- 172.21.15.146:0/1832090889 wait complete. 2024-09-17T03:38:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.096+0000 7fc35c005740 20 client.7938 trim_cache size 0 max 16384 2024-09-17T03:38:37.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.114+0000 7fc35c005740 1 Processor -- start 2024-09-17T03:38:37.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.114+0000 7fc35c005740 1 -- start start 2024-09-17T03:38:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.115+0000 7fc35c005740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x56248757b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.115+0000 7fc35c005740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x56248757b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.115+0000 7fc35c005740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x5624875e2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.115+0000 7fc35c005740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc3501fef90 con 0x5624871d3270 2024-09-17T03:38:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.115+0000 7fc35c005740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc3501f6f50 con 0x5624871aa3b0 2024-09-17T03:38:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.115+0000 7fc35c005740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc3501f75a0 con 0x5624871b2590 2024-09-17T03:38:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc34ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x5624875e2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc34ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x5624875e2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53064/0 (socket says 172.21.15.146:53064) 2024-09-17T03:38:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc34ed9d640 1 -- 172.21.15.146:0/1191854924 learned_addr learned my addr 172.21.15.146:0/1191854924 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc345d9b640 1 --2- 172.21.15.146:0/1191854924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x56248757b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc34e59c640 1 --2- 172.21.15.146:0/1191854924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x56248757b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc34ed9d640 1 -- 172.21.15.146:0/1191854924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 msgr2=0x56248757b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc34ed9d640 1 --2- 172.21.15.146:0/1191854924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x56248757b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc34ed9d640 1 -- 172.21.15.146:0/1191854924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 msgr2=0x56248757b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc34ed9d640 1 --2- 172.21.15.146:0/1191854924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x56248757b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc34ed9d640 1 -- 172.21.15.146:0/1191854924 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248756fea0 con 0x5624871d3270 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc345d9b640 1 --2- 172.21.15.146:0/1191854924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x56248757b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc34e59c640 1 --2- 172.21.15.146:0/1191854924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x56248757b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc34ed9d640 1 --2- 172.21.15.146:0/1191854924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x5624875e2e90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fc348030780 tx=0x7fc34802a980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6463106eb60cfaa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc32f7fe640 1 -- 172.21.15.146:0/1191854924 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348034050 con 0x5624871d3270 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc32f7fe640 1 -- 172.21.15.146:0/1191854924 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc348049070 con 0x5624871d3270 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.116+0000 7fc32f7fe640 1 -- 172.21.15.146:0/1191854924 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348004140 con 0x5624871d3270 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.117+0000 7fc35c005740 1 -- 172.21.15.146:0/1191854924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 msgr2=0x5624875e2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.117+0000 7fc35c005740 1 --2- 172.21.15.146:0/1191854924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x5624875e2e90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fc348030780 tx=0x7fc34802a980 comp rx=0 tx=0).stop 2024-09-17T03:38:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.117+0000 7fc35c005740 1 -- 172.21.15.146:0/1191854924 shutdown_connections 2024-09-17T03:38:37.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.117+0000 7fc35c005740 1 --2- 172.21.15.146:0/1191854924 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871d3270 0x5624875e2e90 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.117+0000 7fc35c005740 1 --2- 172.21.15.146:0/1191854924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871b2590 0x56248757b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.117+0000 7fc35c005740 1 --2- 172.21.15.146:0/1191854924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x56248757b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.117+0000 7fc35c005740 1 -- 172.21.15.146:0/1191854924 >> 172.21.15.146:0/1191854924 conn(0x5624871c73c0 msgr2=0x5624875934a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:37.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.117+0000 7fc35c005740 1 -- 172.21.15.146:0/1191854924 shutdown_connections 2024-09-17T03:38:37.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.117+0000 7fc35c005740 1 -- 172.21.15.146:0/1191854924 wait complete. 2024-09-17T03:38:37.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.118+0000 7fc35c005740 1 -- start start 2024-09-17T03:38:37.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.118+0000 7fc35c005740 1 Processor -- start 2024-09-17T03:38:37.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.119+0000 7fc35c005740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x5624875a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.119+0000 7fc35c005740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871b2590 0x56248763ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.119+0000 7fc35c005740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871d3270 0x562487642950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.119+0000 7fc35c005740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562487593320 con 0x5624871b2590 2024-09-17T03:38:37.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.119+0000 7fc35c005740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5624875d0720 con 0x5624871aa3b0 2024-09-17T03:38:37.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.119+0000 7fc35c005740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5624875b7540 con 0x5624871d3270 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.119+0000 7fc35c005740 10 client.0 _ll_register_callbacks cb 0x7fc3480099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc345d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871b2590 0x56248763ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc345d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871b2590 0x56248763ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53076/0 (socket says 172.21.15.146:53076) 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc345d9b640 1 -- 172.21.15.146:0/601901724 learned_addr learned my addr 172.21.15.146:0/601901724 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc34e59c640 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x5624875a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc34ed9d640 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871d3270 0x562487642950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc345d9b640 1 -- 172.21.15.146:0/601901724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871d3270 msgr2=0x562487642950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc345d9b640 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871d3270 0x562487642950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc345d9b640 1 -- 172.21.15.146:0/601901724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 msgr2=0x5624875a55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc345d9b640 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x5624875a55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc345d9b640 1 -- 172.21.15.146:0/601901724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624875cbd90 con 0x5624871b2590 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc345d9b640 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871b2590 0x56248763ed00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc33800fdf0 tx=0x7fc338026670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469e36dedfd106d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc32d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:38:37.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc32d7fa640 1 -- 172.21.15.146:0/601901724 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338033020 con 0x5624871b2590 2024-09-17T03:38:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc32d7fa640 1 -- 172.21.15.146:0/601901724 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fc338026a70 con 0x5624871b2590 2024-09-17T03:38:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc35c005740 1 -- 172.21.15.146:0/601901724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc348049070 con 0x5624871b2590 2024-09-17T03:38:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc32d7fa640 1 -- 172.21.15.146:0/601901724 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fc33803d050 con 0x5624871b2590 2024-09-17T03:38:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc35c005740 10 client.7944 fetch_fsmap learned FSMap version 77 2024-09-17T03:38:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.120+0000 7fc35c005740 1 -- 172.21.15.146:0/601901724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) -- 0x5624875a50c0 con 0x5624871b2590 2024-09-17T03:38:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc32d7fa640 1 -- 172.21.15.146:0/601901724 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc348049070 con 0x5624871b2590 2024-09-17T03:38:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc32d7fa640 1 -- 172.21.15.146:0/601901724 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 77) ==== 3502+0+0 (secure 0 0 0) 0x7fc338040020 con 0x5624871b2590 2024-09-17T03:38:37.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc35c005740 10 client.7944 fetch_fsmap finished waiting for FSMap version 77 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc35c005740 10 client.7944 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc35c005740 20 client.7944 populate_metadata read hostname 'smithi146' 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc35c005740 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x5624875e3280 0x5624875c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc35c005740 4 client.7944 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc35c005740 1 -- 172.21.15.146:0/601901724 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "status"}) -- 0x5624874eb220 con 0x5624875e3280 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc34e59c640 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x5624875e3280 0x5624875c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc32d7fa640 10 client.7944 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc34e59c640 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x5624875e3280 0x5624875c80e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d6b3c3820d21aba server_cookie=251e1fcfa4fd09da in_seq=0 out_seq=0 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc32d7fa640 1 -- 172.21.15.146:0/601901724 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5624874eb220 con 0x5624875e3280 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc32d7fa640 10 client.7944 handle_command_reply: tid=0 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.121+0000 7fc35c005740 1 client.7944 shutdown 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc35c005740 1 -- 172.21.15.146:0/601901724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871b2590 msgr2=0x56248763ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc35c005740 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871b2590 0x56248763ed00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc33800fdf0 tx=0x7fc338026670 comp rx=0 tx=0).stop 2024-09-17T03:38:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc35c005740 1 -- 172.21.15.146:0/601901724 shutdown_connections 2024-09-17T03:38:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc35c005740 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5624871d3270 0x562487642950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc35c005740 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x5624875e3280 0x5624875c80e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc35c005740 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5624871b2590 0x56248763ed00 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc32d7fa640 0 client.7944 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:38:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc35c005740 1 --2- 172.21.15.146:0/601901724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5624871aa3b0 0x5624875a55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc35c005740 1 -- 172.21.15.146:0/601901724 >> 172.21.15.146:0/601901724 conn(0x5624871c73c0 msgr2=0x5624875934a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc35c005740 1 -- 172.21.15.146:0/601901724 shutdown_connections 2024-09-17T03:38:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc35c005740 1 -- 172.21.15.146:0/601901724 wait complete. 2024-09-17T03:38:37.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc35c005740 20 client.7944 trim_cache size 0 max 16384 2024-09-17T03:38:37.128 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 7770, 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 9.1596565630000004, 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 77, 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 104, 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 104, 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 20.175095916 2024-09-17T03:38:37.129 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:38:37.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc354fba640 1 -- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc330078bc0 msgr2=0x7fc33007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc354fba640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc330078bc0 0x7fc33007b0d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc3500c7950 tx=0x7fc33800a2d0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc354fba640 1 -- 172.21.15.146:0/3278747573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3500b3b60 msgr2=0x7fc3501f4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc354fba640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3500b3b60 0x7fc3501f4010 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fc34000b420 tx=0x7fc34000b8e0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc354fba640 1 -- 172.21.15.146:0/3278747573 shutdown_connections 2024-09-17T03:38:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc354fba640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc330078bc0 0x7fc33007b0d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc354fba640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3500b5ce0 0x7fc35014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc354fba640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3500b5750 0x7fc35009e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc354fba640 1 --2- 172.21.15.146:0/3278747573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3500b3b60 0x7fc3501f4010 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.122+0000 7fc354fba640 1 -- 172.21.15.146:0/3278747573 >> 172.21.15.146:0/3278747573 conn(0x7fc3500b7b20 msgr2=0x7fc350070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.123+0000 7fc354fba640 1 -- 172.21.15.146:0/3278747573 shutdown_connections 2024-09-17T03:38:37.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.123+0000 7fc354fba640 1 -- 172.21.15.146:0/3278747573 wait complete. 2024-09-17T03:38:37.134 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:38:37.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.246+0000 7fb141fa1640 1 -- 172.21.15.146:0/638590994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb124003a00 msgr2=0x7fb124003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.246+0000 7fb141fa1640 1 --2- 172.21.15.146:0/638590994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb124003a00 0x7fb124003e70 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fb13c072d50 tx=0x7fb124005830 comp rx=0 tx=0).stop 2024-09-17T03:38:37.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.246+0000 7fb13bfff640 1 -- 172.21.15.146:0/638590994 reap_dead start 2024-09-17T03:38:37.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.246+0000 7fb141fa1640 1 -- 172.21.15.146:0/638590994 shutdown_connections 2024-09-17T03:38:37.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.246+0000 7fb141fa1640 1 -- 172.21.15.146:0/638590994 >> 172.21.15.146:0/638590994 conn(0x7fb13c0b3150 msgr2=0x7fb13c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:37.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.246+0000 7fb141fa1640 1 -- 172.21.15.146:0/638590994 shutdown_connections 2024-09-17T03:38:37.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.246+0000 7fb141fa1640 1 -- 172.21.15.146:0/638590994 wait complete. 2024-09-17T03:38:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.248+0000 7fb141fa1640 1 Processor -- start 2024-09-17T03:38:37.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.248+0000 7fb141fa1640 1 -- start start 2024-09-17T03:38:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.249+0000 7fb141fa1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb124003a00 0x7fb13c154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.249+0000 7fb141fa1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb13c0b0050 0x7fb13c1f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.249+0000 7fb141fa1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13c0af440 0x7fb13c0af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.249+0000 7fb141fa1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c06f700 con 0x7fb13c0af440 2024-09-17T03:38:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.249+0000 7fb141fa1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb13c06f580 con 0x7fb13c0b0050 2024-09-17T03:38:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.249+0000 7fb141fa1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb13c06f880 con 0x7fb124003a00 2024-09-17T03:38:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb13bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13c0af440 0x7fb13c0af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb13bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13c0af440 0x7fb13c0af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32918/0 (socket says 172.21.15.146:32918) 2024-09-17T03:38:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb13bfff640 1 -- 172.21.15.146:0/560505877 learned_addr learned my addr 172.21.15.146:0/560505877 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb13b7fe640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb124003a00 0x7fb13c154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb13affd640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb13c0b0050 0x7fb13c1f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb13bfff640 1 -- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb124003a00 msgr2=0x7fb13c154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb13bfff640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb124003a00 0x7fb13c154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb13bfff640 1 -- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb13c0b0050 msgr2=0x7fb13c1f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb13bfff640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb13c0b0050 0x7fb13c1f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb13bfff640 1 -- 172.21.15.146:0/560505877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13c0afd90 con 0x7fb13c0af440 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb13bfff640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13c0af440 0x7fb13c0af850 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fb13c071430 tx=0x7fb1340039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb123fff640 1 -- 172.21.15.146:0/560505877 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134015070 con 0x7fb13c0af440 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb123fff640 1 -- 172.21.15.146:0/560505877 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb134011840 con 0x7fb13c0af440 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb141fa1640 1 -- 172.21.15.146:0/560505877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb13c1fa0e0 con 0x7fb13c0af440 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb123fff640 1 -- 172.21.15.146:0/560505877 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134011c90 con 0x7fb13c0af440 2024-09-17T03:38:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.250+0000 7fb141fa1640 1 -- 172.21.15.146:0/560505877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb13c151160 con 0x7fb13c0af440 2024-09-17T03:38:37.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.251+0000 7fb141fa1640 1 -- 172.21.15.146:0/560505877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb13c0b5680 con 0x7fb13c0af440 2024-09-17T03:38:37.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.252+0000 7fb123fff640 1 -- 172.21.15.146:0/560505877 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb134018070 con 0x7fb13c0af440 2024-09-17T03:38:37.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.253+0000 7fb123fff640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb128078b90 0x7fb12807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:37.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.253+0000 7fb123fff640 1 -- 172.21.15.146:0/560505877 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fb13409b7a0 con 0x7fb13c0af440 2024-09-17T03:38:37.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.253+0000 7fb13b7fe640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb128078b90 0x7fb12807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:37.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.254+0000 7fb13b7fe640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb128078b90 0x7fb12807b0a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb12c034000 tx=0x7fb12c02d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:37.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.257+0000 7fb123fff640 1 -- 172.21.15.146:0/560505877 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb13c0afd90 con 0x7fb13c0af440 2024-09-17T03:38:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.467+0000 7fb141fa1640 1 -- 172.21.15.146:0/560505877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb13c15bf80 con 0x7fb13c0af440 2024-09-17T03:38:37.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.467+0000 7fb123fff640 1 -- 172.21.15.146:0/560505877 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v77) ==== 53+0+73 (secure 0 0 0) 0x7fb134063d00 con 0x7fb13c0af440 2024-09-17T03:38:37.467 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:38:37.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 -- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb128078b90 msgr2=0x7fb12807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb128078b90 0x7fb12807b0a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb12c034000 tx=0x7fb12c02d040 comp rx=0 tx=0).stop 2024-09-17T03:38:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 -- 172.21.15.146:0/560505877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13c0af440 msgr2=0x7fb13c0af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13c0af440 0x7fb13c0af850 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fb13c071430 tx=0x7fb1340039c0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 -- 172.21.15.146:0/560505877 shutdown_connections 2024-09-17T03:38:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb128078b90 0x7fb12807b0a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb13c0af440 0x7fb13c0af850 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb13c0b0050 0x7fb13c1f5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 --2- 172.21.15.146:0/560505877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb124003a00 0x7fb13c154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 -- 172.21.15.146:0/560505877 >> 172.21.15.146:0/560505877 conn(0x7fb13c0b3150 msgr2=0x7fb13c15dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 -- 172.21.15.146:0/560505877 shutdown_connections 2024-09-17T03:38:37.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37.469+0000 7fb141fa1640 1 -- 172.21.15.146:0/560505877 wait complete. 2024-09-17T03:38:37.481 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:38:37.481 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:38:37.481 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:38:37.481 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:38:37.481 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:37.481 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:38:37.481 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:38:37.481 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:38:37.481 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:37.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:37.482 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:38:37.497 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:38:37.497 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:37.498 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42454sec preferred_lft 42454sec 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:38:37.499 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:37.500 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:38:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:38:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:38:37.500 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:38:37.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:37.500 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:38:37.561 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:38:37.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:37.563 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:38:37.618 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:38:37.619 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:38:37.619 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:38:37.619 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:38:37.619 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:38:37.619 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:38:37.619 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:38:37.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:38:37.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:38:37.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:38:37.619 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:38:37.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:38:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:37.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:37.745 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:38:37.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:38:37.761 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:38:37.761 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:37.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:37.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:38:37.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:37.826 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:37.881 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:38:37.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:38:37.881 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:37.937 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:38:37.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:37.937 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:38.031 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:38.031 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:38.031 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:38:38.042 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:38.042 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:38.042 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:38:38.042 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:38:38.043 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:38.048 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:38:38.048 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:38:38.048 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:38:38.048 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:38:38.048 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:38:38.048 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:38:38.048 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:38:38.049 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:38:38.049 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:38:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:38:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:38:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:38:38.049 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:38:38.050 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:38:38.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:38.050 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:38:38.075 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:38:38.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:38:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:38.176 INFO:teuthology.orchestra.run.smithi146.stdout:client7953 2024-09-17T03:38:38.177 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:38:38.177 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:38.193 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-17T03:38:38.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.351+0000 7fdd79cb6640 1 -- 172.21.15.146:0/4119081037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd5c003a30 msgr2=0x7fdd5c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:38.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.351+0000 7fdd79cb6640 1 --2- 172.21.15.146:0/4119081037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd5c003a30 0x7fdd5c003ea0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fdd64006fd0 tx=0x7fdd5c005830 comp rx=0 tx=0).stop 2024-09-17T03:38:38.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.351+0000 7fdd73fff640 1 -- 172.21.15.146:0/4119081037 reap_dead start 2024-09-17T03:38:38.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.351+0000 7fdd79cb6640 1 -- 172.21.15.146:0/4119081037 shutdown_connections 2024-09-17T03:38:38.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.351+0000 7fdd79cb6640 1 -- 172.21.15.146:0/4119081037 >> 172.21.15.146:0/4119081037 conn(0x7fdd740d4be0 msgr2=0x7fdd740d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:38.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.351+0000 7fdd79cb6640 1 -- 172.21.15.146:0/4119081037 shutdown_connections 2024-09-17T03:38:38.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.351+0000 7fdd79cb6640 1 -- 172.21.15.146:0/4119081037 wait complete. 2024-09-17T03:38:38.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.353+0000 7fdd79cb6640 1 Processor -- start 2024-09-17T03:38:38.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.353+0000 7fdd79cb6640 1 -- start start 2024-09-17T03:38:38.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.354+0000 7fdd79cb6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd5c003a30 0x7fdd74167520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.354+0000 7fdd79cb6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd740cb9c0 0x7fdd740cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.354+0000 7fdd79cb6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd740ce3e0 0x7fdd740c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.354+0000 7fdd79cb6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7406f6b0 con 0x7fdd740cb9c0 2024-09-17T03:38:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.354+0000 7fdd79cb6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdd740d43b0 con 0x7fdd5c003a30 2024-09-17T03:38:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.354+0000 7fdd79cb6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdd74167c00 con 0x7fdd740ce3e0 2024-09-17T03:38:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.354+0000 7fdd72ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd740cb9c0 0x7fdd740cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.354+0000 7fdd72ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd740cb9c0 0x7fdd740cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32930/0 (socket says 172.21.15.146:32930) 2024-09-17T03:38:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.354+0000 7fdd72ffd640 1 -- 172.21.15.146:0/2190758509 learned_addr learned my addr 172.21.15.146:0/2190758509 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:38:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd73fff640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd740ce3e0 0x7fdd740c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd737fe640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd5c003a30 0x7fdd74167520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:38.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd72ffd640 1 -- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd740ce3e0 msgr2=0x7fdd740c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd72ffd640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd740ce3e0 0x7fdd740c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd72ffd640 1 -- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd5c003a30 msgr2=0x7fdd74167520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd72ffd640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd5c003a30 0x7fdd74167520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd72ffd640 1 -- 172.21.15.146:0/2190758509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd740ce7f0 con 0x7fdd740cb9c0 2024-09-17T03:38:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd72ffd640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd740cb9c0 0x7fdd740cdea0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fdd68003f80 tx=0x7fdd680016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd5bfff640 1 -- 172.21.15.146:0/2190758509 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68016030 con 0x7fdd740cb9c0 2024-09-17T03:38:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd5bfff640 1 -- 172.21.15.146:0/2190758509 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd68011640 con 0x7fdd740cb9c0 2024-09-17T03:38:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd5bfff640 1 -- 172.21.15.146:0/2190758509 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68011a70 con 0x7fdd740cb9c0 2024-09-17T03:38:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd79cb6640 1 -- 172.21.15.146:0/2190758509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd740cc3a0 con 0x7fdd740cb9c0 2024-09-17T03:38:38.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.355+0000 7fdd79cb6640 1 -- 172.21.15.146:0/2190758509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd740cc960 con 0x7fdd740cb9c0 2024-09-17T03:38:38.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.356+0000 7fdd79cb6640 1 -- 172.21.15.146:0/2190758509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd741620f0 con 0x7fdd740cb9c0 2024-09-17T03:38:38.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.357+0000 7fdd5bfff640 1 -- 172.21.15.146:0/2190758509 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd68019070 con 0x7fdd740cb9c0 2024-09-17T03:38:38.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.357+0000 7fdd5bfff640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd60078bc0 0x7fdd6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:38:38.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.358+0000 7fdd5bfff640 1 -- 172.21.15.146:0/2190758509 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fdd6809b230 con 0x7fdd740cb9c0 2024-09-17T03:38:38.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.358+0000 7fdd737fe640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd60078bc0 0x7fdd6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:38:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.358+0000 7fdd737fe640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd60078bc0 0x7fdd6007b0d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdd64033000 tx=0x7fdd74069ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:38:38.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.362+0000 7fdd5bfff640 1 -- 172.21.15.146:0/2190758509 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdd740ce7f0 con 0x7fdd740cb9c0 2024-09-17T03:38:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:38.575+0000 7fdd79cb6640 1 -- 172.21.15.146:0/2190758509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fdd740d2bd0 con 0x7fdd740cb9c0 2024-09-17T03:38:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.013+0000 7fdd5bfff640 1 -- 172.21.15.146:0/2190758509 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v78) ==== 167+0+0 (secure 0 0 0) 0x7fdd680630b0 con 0x7fdd740cb9c0 2024-09-17T03:38:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:enabled new snapshots 2024-09-17T03:38:39.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.016+0000 7fdd79cb6640 1 -- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd60078bc0 msgr2=0x7fdd6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:39.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.016+0000 7fdd79cb6640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd60078bc0 0x7fdd6007b0d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdd64033000 tx=0x7fdd74069ad0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.016+0000 7fdd79cb6640 1 -- 172.21.15.146:0/2190758509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd740cb9c0 msgr2=0x7fdd740cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:38:39.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.016+0000 7fdd79cb6640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd740cb9c0 0x7fdd740cdea0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fdd68003f80 tx=0x7fdd680016f0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.017+0000 7fdd79cb6640 1 -- 172.21.15.146:0/2190758509 shutdown_connections 2024-09-17T03:38:39.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.017+0000 7fdd79cb6640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdd60078bc0 0x7fdd6007b0d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.017+0000 7fdd79cb6640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdd740ce3e0 0x7fdd740c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.017+0000 7fdd79cb6640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd740cb9c0 0x7fdd740cdea0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.017+0000 7fdd79cb6640 1 --2- 172.21.15.146:0/2190758509 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdd5c003a30 0x7fdd74167520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:38:39.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.017+0000 7fdd79cb6640 1 -- 172.21.15.146:0/2190758509 >> 172.21.15.146:0/2190758509 conn(0x7fdd740d4be0 msgr2=0x7fdd7415f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:38:39.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.017+0000 7fdd79cb6640 1 -- 172.21.15.146:0/2190758509 shutdown_connections 2024-09-17T03:38:39.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:39.017+0000 7fdd79cb6640 1 -- 172.21.15.146:0/2190758509 wait complete. 2024-09-17T03:38:39.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:39.029 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-17T03:38:39.050 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:38:39.050 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:38:39.106 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> n = 2000 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> if 3 > 0: 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2024-09-17T03:38:39.107 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> try: 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:38:39.108 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-09-17T03:38:39.109 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2024-09-17T03:38:39.109 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(3): 2024-09-17T03:38:39.109 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-17T03:38:39.109 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:38:39.109 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-09-17T03:38:39.109 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2024-09-17T03:38:39.109 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2024-09-17T03:38:39.109 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:38:57.612 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:38:57.615 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:38:58.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:38:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:38:58.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:58.777 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-17T03:38:58.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:38:58.860 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-17T03:39:27.895 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:39:27.898 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:39:28.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:28.871 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-17T03:39:28.997 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-17T03:39:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.112+0000 7fbf68ae5640 1 -- 172.21.15.146:0/598884162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf640b5ce0 msgr2=0x7fbf640b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.112+0000 7fbf68ae5640 1 --2- 172.21.15.146:0/598884162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf640b5ce0 0x7fbf640b1320 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fbf640b6120 tx=0x7fbf5402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.112+0000 7fbf68ae5640 1 -- 172.21.15.146:0/598884162 shutdown_connections 2024-09-17T03:39:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.112+0000 7fbf68ae5640 1 --2- 172.21.15.146:0/598884162 >> v2:172.21.15.179:3300/0 conn(0x7fbf640b3d30 0x7fbf6415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.112+0000 7fbf68ae5640 1 --2- 172.21.15.146:0/598884162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf640b5ce0 0x7fbf640b1320 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.112+0000 7fbf68ae5640 1 -- 172.21.15.146:0/598884162 >> 172.21.15.146:0/598884162 conn(0x7fbf640b7b20 msgr2=0x7fbf6409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.112+0000 7fbf68ae5640 1 -- 172.21.15.146:0/598884162 shutdown_connections 2024-09-17T03:39:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.112+0000 7fbf68ae5640 1 -- 172.21.15.146:0/598884162 wait complete. 2024-09-17T03:39:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.114+0000 7fbf68ae5640 1 Processor -- start 2024-09-17T03:39:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.114+0000 7fbf68ae5640 1 -- start start 2024-09-17T03:39:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf68ae5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf640b5750 0x7fbf641f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf68ae5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf640b5ce0 0x7fbf6414db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf68ae5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf64156bd0 0x7fbf64158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf68ae5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6415d3f0 con 0x7fbf640b5750 2024-09-17T03:39:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf68ae5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6415d270 con 0x7fbf640b5ce0 2024-09-17T03:39:29.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf68ae5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbf6415d570 con 0x7fbf64156bd0 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf6259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf640b5750 0x7fbf641f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf6259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf640b5750 0x7fbf641f7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55414/0 (socket says 172.21.15.146:55414) 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf6259c640 1 -- 172.21.15.146:0/1272744685 learned_addr learned my addr 172.21.15.146:0/1272744685 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf62d9d640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf64156bd0 0x7fbf64158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf640b5ce0 0x7fbf6414db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf6259c640 1 -- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf64156bd0 msgr2=0x7fbf64158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf6259c640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf64156bd0 0x7fbf64158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf6259c640 1 -- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf640b5ce0 msgr2=0x7fbf6414db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf6259c640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf640b5ce0 0x7fbf6414db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf6259c640 1 -- 172.21.15.146:0/1272744685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf641e7cd0 con 0x7fbf640b5750 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf6259c640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf640b5750 0x7fbf641f7770 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fbf540099c0 tx=0x7fbf540038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf5b7fe640 1 -- 172.21.15.146:0/1272744685 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5403e030 con 0x7fbf640b5750 2024-09-17T03:39:29.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf5b7fe640 1 -- 172.21.15.146:0/1272744685 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf54003db0 con 0x7fbf640b5750 2024-09-17T03:39:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf68ae5640 1 -- 172.21.15.146:0/1272744685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf641e6970 con 0x7fbf640b5750 2024-09-17T03:39:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf5b7fe640 1 -- 172.21.15.146:0/1272744685 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54035040 con 0x7fbf640b5750 2024-09-17T03:39:29.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.116+0000 7fbf68ae5640 1 -- 172.21.15.146:0/1272744685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf641e6f10 con 0x7fbf640b5750 2024-09-17T03:39:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.118+0000 7fbf5b7fe640 1 -- 172.21.15.146:0/1272744685 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf54041030 con 0x7fbf640b5750 2024-09-17T03:39:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.119+0000 7fbf5b7fe640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbf44078bc0 0x7fbf4407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.119+0000 7fbf5b7fe640 1 -- 172.21.15.146:0/1272744685 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fbf540bb770 con 0x7fbf640b5750 2024-09-17T03:39:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.119+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbf44078bc0 0x7fbf4407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.120+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbf44078bc0 0x7fbf4407b0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbf641e8140 tx=0x7fbf4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.120+0000 7fbf6fa57740 1 Processor -- start 2024-09-17T03:39:29.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.120+0000 7fbf6fa57740 1 -- start start 2024-09-17T03:39:29.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.121+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 0x55f645e90310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.121+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a784d0 0x55f645e72fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.121+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 0x55f645e73520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.121+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f645dbbbd0 con 0x55f645a806b0 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.121+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f645dab000 con 0x55f645aa1390 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.121+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f645daee10 con 0x55f645a784d0 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.121+0000 7fbf6259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 0x55f645e90310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.121+0000 7fbf62d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 0x55f645e73520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.121+0000 7fbf59d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a784d0 0x55f645e72fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.121+0000 7fbf6259c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 0x55f645e90310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:41182/0 (socket says 172.21.15.146:41182) 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.121+0000 7fbf6259c640 1 -- 172.21.15.146:0/4251252010 learned_addr learned my addr 172.21.15.146:0/4251252010 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.122+0000 7fbf59d9b640 1 -- 172.21.15.146:0/4251252010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 msgr2=0x55f645e90310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.122+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/4251252010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 0x55f645e90310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.122+0000 7fbf59d9b640 1 -- 172.21.15.146:0/4251252010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 msgr2=0x55f645e73520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.122+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/4251252010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 0x55f645e73520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.122+0000 7fbf59d9b640 1 -- 172.21.15.146:0/4251252010 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f645b837d0 con 0x55f645a784d0 2024-09-17T03:39:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.122+0000 7fbf6259c640 1 --2- 172.21.15.146:0/4251252010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 0x55f645e90310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:39:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.122+0000 7fbf62d9d640 1 --2- 172.21.15.146:0/4251252010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 0x55f645e73520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:39:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.122+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/4251252010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a784d0 0x55f645e72fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf640b7fe0 tx=0x7fbf4c012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f477e3fa07b38d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.122+0000 7fbf43fff640 1 -- 172.21.15.146:0/4251252010 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c025070 con 0x55f645a784d0 2024-09-17T03:39:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.122+0000 7fbf43fff640 1 -- 172.21.15.146:0/4251252010 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf4c01b050 con 0x55f645a784d0 2024-09-17T03:39:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.122+0000 7fbf43fff640 1 -- 172.21.15.146:0/4251252010 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c014cc0 con 0x55f645a784d0 2024-09-17T03:39:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.123+0000 7fbf6fa57740 1 -- 172.21.15.146:0/4251252010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a784d0 msgr2=0x55f645e72fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.123+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/4251252010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a784d0 0x55f645e72fe0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf640b7fe0 tx=0x7fbf4c012000 comp rx=0 tx=0).stop 2024-09-17T03:39:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.123+0000 7fbf6fa57740 1 -- 172.21.15.146:0/4251252010 shutdown_connections 2024-09-17T03:39:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.123+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/4251252010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 0x55f645e73520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.123+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/4251252010 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a784d0 0x55f645e72fe0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.123+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/4251252010 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 0x55f645e90310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.123+0000 7fbf6fa57740 1 -- 172.21.15.146:0/4251252010 >> 172.21.15.146:0/4251252010 conn(0x55f645a954e0 msgr2=0x55f645e49200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.123+0000 7fbf6fa57740 1 -- 172.21.15.146:0/4251252010 shutdown_connections 2024-09-17T03:39:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.123+0000 7fbf6fa57740 1 -- 172.21.15.146:0/4251252010 wait complete. 2024-09-17T03:39:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.124+0000 7fbf6fa57740 1 -- start start 2024-09-17T03:39:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.124+0000 7fbf6fa57740 1 Processor -- start 2024-09-17T03:39:29.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645a784d0 0x55f645e883b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a806b0 0x55f645e61340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645aa1390 0x55f645e86550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f645b1b740 con 0x55f645aa1390 2024-09-17T03:39:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f645d50540 con 0x55f645a784d0 2024-09-17T03:39:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f645e88910 con 0x55f645a806b0 2024-09-17T03:39:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf6fa57740 10 client.0 _ll_register_callbacks cb 0x55f645d4f0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf62d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645aa1390 0x55f645e86550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf62d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645aa1390 0x55f645e86550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55442/0 (socket says 172.21.15.146:55442) 2024-09-17T03:39:29.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf62d9d640 1 -- 172.21.15.146:0/3258644839 learned_addr learned my addr 172.21.15.146:0/3258644839 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf6259c640 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645a784d0 0x55f645e883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a806b0 0x55f645e61340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf62d9d640 1 -- 172.21.15.146:0/3258644839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a806b0 msgr2=0x55f645e61340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf62d9d640 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a806b0 0x55f645e61340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf62d9d640 1 -- 172.21.15.146:0/3258644839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645a784d0 msgr2=0x55f645e883b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf62d9d640 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645a784d0 0x55f645e883b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf62d9d640 1 -- 172.21.15.146:0/3258644839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f645aea6a0 con 0x55f645aa1390 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf6259c640 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645a784d0 0x55f645e883b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf62d9d640 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645aa1390 0x55f645e86550 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c005fd0 tx=0x7fbf5c011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698269c73bd51cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf417fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf417fa640 1 -- 172.21.15.146:0/3258644839 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c01f060 con 0x55f645aa1390 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf417fa640 1 -- 172.21.15.146:0/3258644839 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fbf5c003c40 con 0x55f645aa1390 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.126+0000 7fbf6fa57740 1 -- 172.21.15.146:0/3258644839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf4c01b050 con 0x55f645aa1390 2024-09-17T03:39:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf417fa640 1 -- 172.21.15.146:0/3258644839 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fbf5c025050 con 0x55f645aa1390 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf6fa57740 10 client.7971 fetch_fsmap learned FSMap version 78 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf6fa57740 1 -- 172.21.15.146:0/3258644839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x55f645be3f60 con 0x55f645aa1390 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf417fa640 1 -- 172.21.15.146:0/3258644839 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf4c01b050 con 0x55f645aa1390 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf417fa640 1 -- 172.21.15.146:0/3258644839 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7fbf5c028020 con 0x55f645aa1390 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf6fa57740 10 client.7971 fetch_fsmap finished waiting for FSMap version 78 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf6fa57740 10 client.7971 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf6fa57740 20 client.7971 populate_metadata read hostname 'smithi146' 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55f645a5ff60 0x55f645e878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf6fa57740 4 client.7971 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf6fa57740 1 -- 172.21.15.146:0/3258644839 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f645dbdb20 con 0x55f645a5ff60 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf6259c640 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55f645a5ff60 0x55f645e878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf417fa640 10 client.7971 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.127+0000 7fbf6259c640 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55f645a5ff60 0x55f645e878b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a99cf8a3da9e8694 server_cookie=a57a75887f8d89e3 in_seq=0 out_seq=0 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf417fa640 1 -- 172.21.15.146:0/3258644839 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f645dbdb20 con 0x55f645a5ff60 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf417fa640 10 client.7971 handle_command_reply: tid=0 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 1 client.7971 shutdown 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 1 -- 172.21.15.146:0/3258644839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645aa1390 msgr2=0x55f645e86550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645aa1390 0x55f645e86550 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c005fd0 tx=0x7fbf5c011e40 comp rx=0 tx=0).stop 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 1 -- 172.21.15.146:0/3258644839 shutdown_connections 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55f645a5ff60 0x55f645e878b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645aa1390 0x55f645e86550 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a806b0 0x55f645e61340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/3258644839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645a784d0 0x55f645e883b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf417fa640 0 client.7971 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 1 -- 172.21.15.146:0/3258644839 >> 172.21.15.146:0/3258644839 conn(0x55f645a954e0 msgr2=0x55f645e91370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 1 -- 172.21.15.146:0/3258644839 shutdown_connections 2024-09-17T03:39:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 1 -- 172.21.15.146:0/3258644839 wait complete. 2024-09-17T03:39:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.128+0000 7fbf6fa57740 20 client.7971 trim_cache size 0 max 16384 2024-09-17T03:39:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.145+0000 7fbf6fa57740 1 Processor -- start 2024-09-17T03:39:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.145+0000 7fbf6fa57740 1 -- start start 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645a784d0 0x55f645e9f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 0x55f645eb0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645aa1390 0x55f645eb13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbf642001c0 con 0x55f645a806b0 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbf641ff1a0 con 0x55f645a784d0 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbf641e5db0 con 0x55f645aa1390 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf59d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 0x55f645eb0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf59d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 0x55f645eb0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55446/0 (socket says 172.21.15.146:55446) 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf59d9b640 1 -- 172.21.15.146:0/4205084897 learned_addr learned my addr 172.21.15.146:0/4205084897 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf59d9b640 1 -- 172.21.15.146:0/4205084897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645aa1390 msgr2=0x55f645eb13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/4205084897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645aa1390 0x55f645eb13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf59d9b640 1 -- 172.21.15.146:0/4205084897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645a784d0 msgr2=0x55f645e9f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/4205084897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645a784d0 0x55f645e9f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf59d9b640 1 -- 172.21.15.146:0/4205084897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f645e87c20 con 0x55f645a806b0 2024-09-17T03:39:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.146+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/4205084897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 0x55f645eb0e60 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c014820 tx=0x7fbf4c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc862e57c89beab server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf437fe640 1 -- 172.21.15.146:0/4205084897 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c02f030 con 0x55f645a806b0 2024-09-17T03:39:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf437fe640 1 -- 172.21.15.146:0/4205084897 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf4c014d80 con 0x55f645a806b0 2024-09-17T03:39:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf437fe640 1 -- 172.21.15.146:0/4205084897 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c025040 con 0x55f645a806b0 2024-09-17T03:39:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf6fa57740 1 -- 172.21.15.146:0/4205084897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 msgr2=0x55f645eb0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/4205084897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 0x55f645eb0e60 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c014820 tx=0x7fbf4c007df0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf6fa57740 1 -- 172.21.15.146:0/4205084897 shutdown_connections 2024-09-17T03:39:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/4205084897 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645aa1390 0x55f645eb13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/4205084897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a806b0 0x55f645eb0e60 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/4205084897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645a784d0 0x55f645e9f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf6fa57740 1 -- 172.21.15.146:0/4205084897 >> 172.21.15.146:0/4205084897 conn(0x55f645a954e0 msgr2=0x55f645e89f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf6fa57740 1 -- 172.21.15.146:0/4205084897 shutdown_connections 2024-09-17T03:39:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.147+0000 7fbf6fa57740 1 -- 172.21.15.146:0/4205084897 wait complete. 2024-09-17T03:39:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.148+0000 7fbf6fa57740 1 -- start start 2024-09-17T03:39:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.148+0000 7fbf6fa57740 1 Processor -- start 2024-09-17T03:39:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a784d0 0x55f645e90bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a806b0 0x55f645f11a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6fa57740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 0x55f645ef3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f645e905b0 con 0x55f645a784d0 2024-09-17T03:39:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f645e9c260 con 0x55f645aa1390 2024-09-17T03:39:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6fa57740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f645ef3ab0 con 0x55f645a806b0 2024-09-17T03:39:29.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6fa57740 10 client.0 _ll_register_callbacks cb 0x7fbf5c009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a784d0 0x55f645e90bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a784d0 0x55f645e90bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55450/0 (socket says 172.21.15.146:55450) 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6259c640 1 -- 172.21.15.146:0/2503785242 learned_addr learned my addr 172.21.15.146:0/2503785242 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf62d9d640 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 0x55f645ef3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a806b0 0x55f645f11a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6259c640 1 -- 172.21.15.146:0/2503785242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a806b0 msgr2=0x55f645f11a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6259c640 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a806b0 0x55f645f11a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6259c640 1 -- 172.21.15.146:0/2503785242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 msgr2=0x55f645ef3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6259c640 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 0x55f645ef3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6259c640 1 -- 172.21.15.146:0/2503785242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f645b81ad0 con 0x55f645a784d0 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf62d9d640 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 0x55f645ef3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf6259c640 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a784d0 0x55f645e90bc0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fbf54004650 tx=0x7fbf54083130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c774bee26570720e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf417fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf417fa640 1 -- 172.21.15.146:0/2503785242 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54048040 con 0x55f645a784d0 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.150+0000 7fbf417fa640 1 -- 172.21.15.146:0/2503785242 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fbf540839c0 con 0x55f645a784d0 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf6fa57740 1 -- 172.21.15.146:0/2503785242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf4c014d80 con 0x55f645a784d0 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf417fa640 1 -- 172.21.15.146:0/2503785242 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fbf5408ced0 con 0x55f645a784d0 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf6fa57740 10 client.7977 fetch_fsmap learned FSMap version 78 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf6fa57740 1 -- 172.21.15.146:0/2503785242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x55f645e90350 con 0x55f645a784d0 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf417fa640 1 -- 172.21.15.146:0/2503785242 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf4c014d80 con 0x55f645a784d0 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf417fa640 1 -- 172.21.15.146:0/2503785242 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7fbf5408ca40 con 0x55f645a784d0 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf6fa57740 10 client.7977 fetch_fsmap finished waiting for FSMap version 78 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf6fa57740 10 client.7977 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf6fa57740 20 client.7977 populate_metadata read hostname 'smithi146' 2024-09-17T03:39:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55f645e8f890 0x55f645e8fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf6fa57740 4 client.7977 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf6fa57740 1 -- 172.21.15.146:0/2503785242 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55f645db95d0 con 0x55f645e8f890 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55f645e8f890 0x55f645e8fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.151+0000 7fbf417fa640 10 client.7977 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf59d9b640 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55f645e8f890 0x55f645e8fca0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e5a1a38e1772043 server_cookie=c040d6c5c0a87b48 in_seq=0 out_seq=0 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf417fa640 1 -- 172.21.15.146:0/2503785242 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18085 (crc 0 0 0) 0x55f645db95d0 con 0x55f645e8f890 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf417fa640 10 client.7977 handle_command_reply: tid=0 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf6fa57740 1 client.7977 shutdown 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf6fa57740 1 -- 172.21.15.146:0/2503785242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a784d0 msgr2=0x55f645e90bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a784d0 0x55f645e90bc0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fbf54004650 tx=0x7fbf54083130 comp rx=0 tx=0).stop 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf6fa57740 1 -- 172.21.15.146:0/2503785242 shutdown_connections 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f645aa1390 0x55f645ef3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f645a806b0 0x55f645f11a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55f645e8f890 0x55f645e8fca0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf6fa57740 1 --2- 172.21.15.146:0/2503785242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f645a784d0 0x55f645e90bc0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf417fa640 0 client.7977 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf6fa57740 1 -- 172.21.15.146:0/2503785242 >> 172.21.15.146:0/2503785242 conn(0x55f645a954e0 msgr2=0x55f645e89cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf6fa57740 1 -- 172.21.15.146:0/2503785242 shutdown_connections 2024-09-17T03:39:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.152+0000 7fbf6fa57740 1 -- 172.21.15.146:0/2503785242 wait complete. 2024-09-17T03:39:29.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf6fa57740 20 client.7977 trim_cache size 0 max 16384 2024-09-17T03:39:29.158 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:39:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 1880, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 1881, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 467602, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 28810804, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 9, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.364912240, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.178558810, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.042268313, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.129789803, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1880, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.309302278, 2024-09-17T03:39:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000164522 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2, 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000297, 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000148 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 0 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 27429, 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 49809, 2024-09-17T03:39:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 9106994, 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 35007821, 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 8, 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 3.530784268, 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 2.848955920, 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 1.397486997, 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.025691695, 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 49807, 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.263096202, 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000025359 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:39:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 48828, 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.008798673, 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000180 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 112736 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 2310, 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 2304, 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 868577, 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 51520936, 2024-09-17T03:39:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 5, 2024-09-17T03:39:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2024-09-17T03:39:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.419340730, 2024-09-17T03:39:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.263579623, 2024-09-17T03:39:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.061859580, 2024-09-17T03:39:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.088144650, 2024-09-17T03:39:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:39:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2304, 2024-09-17T03:39:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.458031643, 2024-09-17T03:39:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000198798 2024-09-17T03:39:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:39:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 129888, 2024-09-17T03:39:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 20480 2024-09-17T03:39:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-09-17T03:39:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2024-09-17T03:39:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-09-17T03:39:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2024-09-17T03:39:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-17T03:39:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-17T03:39:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1269, 2024-09-17T03:39:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 20.297546396, 2024-09-17T03:39:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.015994914 2024-09-17T03:39:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1481, 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.108601871, 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000748549 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 25293, 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 25293, 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 25293, 2024-09-17T03:39:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 499.213336015, 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.019737213 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_complete": 0, 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_keys": 0, 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 12, 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 19908, 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 0, 2024-09-17T03:39:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 19908, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 19907, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 0, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 35, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 35, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 2, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 45911, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 45418, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2024-09-17T03:39:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 86, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2024-09-17T03:39:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 909, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 4029, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-17T03:39:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 3889, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 3417, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 58, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 13975 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update": 0, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update_receipt": 0, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_try_discover": 0, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_send_discover": 0, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_handle_discover": 0, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 2000, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 326, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2024-09-17T03:39:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 4173, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 1641, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 2248, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_path": 0, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_inode": 0, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 0, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2024-09-17T03:39:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_succeeded": 0, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_write_failed": 0 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "evlrg": 0, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 24515, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 0, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 0, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 24515, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2024-09-17T03:39:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 0, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 33, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 0, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 0, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 33, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "segmjr": 3, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 0, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 4194304, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 96293855, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 0, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2600, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 143.379100958, 2024-09-17T03:39:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.055145808 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 0 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 2014, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 2014, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 0, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 13, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 13, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 0, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 19908, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 19909, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 1, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 35, 2024-09-17T03:39:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 8014, 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 7979, 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 183096, 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 413032448 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 28213, 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 25293, 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 4, 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2000, 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.779984464, 2024-09-17T03:39:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000889992 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 30, 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.004565643, 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000152188 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6000, 2024-09-17T03:39:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 7.807285811, 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001301214 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 7001, 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 5.984914268, 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000854865 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2024-09-17T03:39:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000051932, 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000051932 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.003132618, 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.003132618 2024-09-17T03:39:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.061032584, 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.061032584 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000103172, 2024-09-17T03:39:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000103172 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8, 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.921110485, 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.240138810 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2248, 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 461.650785184, 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.205360669 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "req_snapdiff_latency": { 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.109348227, 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.109348227 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000299708, 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000299708 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.185 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2024-09-17T03:39:29.186 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8000, 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 19.890721919, 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002486340 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2024-09-17T03:39:29.187 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 1, 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 0, 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 1, 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 17984, 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 17984, 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 48, 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: "mdthresh_evicted": 0 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-09-17T03:39:29.188 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-09-17T03:39:29.189 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-09-17T03:39:29.190 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 19844906, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 7088, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 440, 2024-09-17T03:39:29.191 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 5, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 5312, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 75, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-09-17T03:39:29.192 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 21329592, 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 887564, 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 4493, 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 92547963, 2024-09-17T03:39:29.193 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 37, 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 4493, 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: "op_latency": { 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4493, 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 19.685694843, 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.004381414 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: "op_inflight": 0, 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4493, 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 4587 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 4493, 2024-09-17T03:39:29.194 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 57, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 4436, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 0, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 11, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 57, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 2657, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 34, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 1641, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2024-09-17T03:39:29.195 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 33, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 0, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 22, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T03:39:29.196 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2024-09-17T03:39:29.197 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 104, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 1, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 8, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 8, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 103, 2024-09-17T03:39:29.198 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 0, 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 29 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 1, 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 32, 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2024-09-17T03:39:29.199 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 32, 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed_ops": 1641, 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 1641, 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 31615, 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 8025393, 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 31615, 2024-09-17T03:39:29.200 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 31615, 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 8025393, 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:39:29.201 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 4493, 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 92726832, 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 4493, 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 92726832, 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 4493, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 4493, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 4493, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 4493, 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:39:29.203 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 1641, 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 178869, 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 1641, 2024-09-17T03:39:29.204 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 57, 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 178869, 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55f83d6ab380": { 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 84, 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-17T03:39:29.205 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 24515, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 92099551, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 24515, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2600, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 92099467, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.206 INFO:teuthology.orchestra.run.smithi146.stdout: "trackedop": { 2024-09-17T03:39:29.207 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_ops_count": 0 2024-09-17T03:39:29.207 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.207 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:39:29.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 -- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbf44078bc0 msgr2=0x7fbf4407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbf44078bc0 0x7fbf4407b0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbf641e8140 tx=0x7fbf4c009040 comp rx=0 tx=0).stop 2024-09-17T03:39:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 -- 172.21.15.146:0/1272744685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf640b5750 msgr2=0x7fbf641f7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf640b5750 0x7fbf641f7770 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fbf540099c0 tx=0x7fbf540038a0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 -- 172.21.15.146:0/1272744685 shutdown_connections 2024-09-17T03:39:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbf44078bc0 0x7fbf4407b0d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbf64156bd0 0x7fbf64158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbf640b5ce0 0x7fbf6414db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 --2- 172.21.15.146:0/1272744685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf640b5750 0x7fbf641f7770 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 -- 172.21.15.146:0/1272744685 >> 172.21.15.146:0/1272744685 conn(0x7fbf640b7b20 msgr2=0x7fbf6415b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 -- 172.21.15.146:0/1272744685 shutdown_connections 2024-09-17T03:39:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.153+0000 7fbf68ae5640 1 -- 172.21.15.146:0/1272744685 wait complete. 2024-09-17T03:39:29.210 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-17T03:39:29.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:29.210 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start '~mdsdir' recursive 2024-09-17T03:39:29.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.354+0000 7f1cd3fff640 1 -- 172.21.15.146:0/3426735480 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4030050 con 0x7f1cdc15a860 2024-09-17T03:39:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.355+0000 7f1ce245c640 1 -- 172.21.15.146:0/3426735480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cdc15a860 msgr2=0x7f1cdc0adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.355+0000 7f1ce245c640 1 --2- 172.21.15.146:0/3426735480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cdc15a860 0x7f1cdc0adde0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4005fd0 tx=0x7f1cd402c840 comp rx=0 tx=0).stop 2024-09-17T03:39:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.356+0000 7f1ce245c640 1 -- 172.21.15.146:0/3426735480 shutdown_connections 2024-09-17T03:39:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.356+0000 7f1ce245c640 1 --2- 172.21.15.146:0/3426735480 >> v2:172.21.15.146:3300/0 conn(0x7f1cdc0ae320 0x7f1cdc06ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.356+0000 7f1ce245c640 1 --2- 172.21.15.146:0/3426735480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cdc15a860 0x7f1cdc0adde0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.356+0000 7f1ce245c640 1 -- 172.21.15.146:0/3426735480 >> 172.21.15.146:0/3426735480 conn(0x7f1cdc0d0340 msgr2=0x7f1cdc0d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.358+0000 7f1ce245c640 1 -- 172.21.15.146:0/3426735480 shutdown_connections 2024-09-17T03:39:29.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.360+0000 7f1ce245c640 1 -- 172.21.15.146:0/3426735480 wait complete. 2024-09-17T03:39:29.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.363+0000 7f1ce245c640 1 Processor -- start 2024-09-17T03:39:29.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.364+0000 7f1ce245c640 1 -- start start 2024-09-17T03:39:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.366+0000 7f1ce245c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cdc06f320 0x7f1cdc150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.367+0000 7f1ce245c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cdc0ae320 0x7f1cdc09e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.367+0000 7f1ce245c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cdc15a860 0x7f1cdc158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.367+0000 7f1ce145a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cdc06f320 0x7f1cdc150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.367+0000 7f1ce145a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cdc06f320 0x7f1cdc150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:41222/0 (socket says 172.21.15.146:41222) 2024-09-17T03:39:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.367+0000 7f1ce145a640 1 -- 172.21.15.146:0/2428574865 learned_addr learned my addr 172.21.15.146:0/2428574865 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.367+0000 7f1ce0c59640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cdc0ae320 0x7f1cdc09e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.367+0000 7f1ce1c5b640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cdc15a860 0x7f1cdc158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.367+0000 7f1ce245c640 1 -- 172.21.15.146:0/2428574865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc0b51a0 con 0x7f1cdc15a860 2024-09-17T03:39:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.367+0000 7f1ce245c640 1 -- 172.21.15.146:0/2428574865 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc0706b0 con 0x7f1cdc06f320 2024-09-17T03:39:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.367+0000 7f1ce245c640 1 -- 172.21.15.146:0/2428574865 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1cdc0b5320 con 0x7f1cdc0ae320 2024-09-17T03:39:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.369+0000 7f1ce145a640 1 -- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cdc0ae320 msgr2=0x7f1cdc09e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.369+0000 7f1ce145a640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cdc0ae320 0x7f1cdc09e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.369+0000 7f1ce145a640 1 -- 172.21.15.146:0/2428574865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cdc15a860 msgr2=0x7f1cdc158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.369+0000 7f1ce145a640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cdc15a860 0x7f1cdc158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.369+0000 7f1ce145a640 1 -- 172.21.15.146:0/2428574865 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc0cfaf0 con 0x7f1cdc06f320 2024-09-17T03:39:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.369+0000 7f1ce1c5b640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cdc15a860 0x7f1cdc158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:39:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.370+0000 7f1ce145a640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cdc06f320 0x7f1cdc150ca0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009b30 tx=0x7f1cd4033600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.371+0000 7f1cd1ffb640 1 -- 172.21.15.146:0/2428574865 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4041020 con 0x7f1cdc06f320 2024-09-17T03:39:29.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.371+0000 7f1cd1ffb640 1 -- 172.21.15.146:0/2428574865 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cd4033a60 con 0x7f1cdc06f320 2024-09-17T03:39:29.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.371+0000 7f1cd1ffb640 1 -- 172.21.15.146:0/2428574865 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4039040 con 0x7f1cdc06f320 2024-09-17T03:39:29.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.371+0000 7f1ce245c640 1 -- 172.21.15.146:0/2428574865 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cdc1fb0c0 con 0x7f1cdc06f320 2024-09-17T03:39:29.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.371+0000 7f1ce245c640 1 -- 172.21.15.146:0/2428574865 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cdc1fb680 con 0x7f1cdc06f320 2024-09-17T03:39:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.376+0000 7f1cea624740 1 Processor -- start 2024-09-17T03:39:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.376+0000 7f1cea624740 1 -- start start 2024-09-17T03:39:29.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.379+0000 7f1cd1ffb640 1 -- 172.21.15.146:0/2428574865 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1cd4044020 con 0x7f1cdc06f320 2024-09-17T03:39:29.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.380+0000 7f1cea624740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1475b0 0x55ee6c536270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.380+0000 7f1cea624740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 0x55ee6c518f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.380+0000 7f1cea624740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1268d0 0x55ee6c519480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.380+0000 7f1cea624740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ee6c461a80 con 0x55ee6c1268d0 2024-09-17T03:39:29.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.380+0000 7f1cea624740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ee6c450eb0 con 0x55ee6c1475b0 2024-09-17T03:39:29.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.380+0000 7f1cea624740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ee6c454cc0 con 0x55ee6c11e6f0 2024-09-17T03:39:29.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.380+0000 7f1ce145a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 0x55ee6c518f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.380+0000 7f1ce145a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 0x55ee6c518f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:51010/0 (socket says 172.21.15.146:51010) 2024-09-17T03:39:29.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.380+0000 7f1ce145a640 1 -- 172.21.15.146:0/823132624 learned_addr learned my addr 172.21.15.146:0/823132624 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.380+0000 7f1ce1c5b640 1 --2- 172.21.15.146:0/823132624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1475b0 0x55ee6c536270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.380+0000 7f1cd1ffb640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1cc0078c60 0x7f1cc007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.381+0000 7f1ce0c59640 1 --2- 172.21.15.146:0/823132624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1268d0 0x55ee6c519480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.381+0000 7f1ce145a640 1 -- 172.21.15.146:0/823132624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1475b0 msgr2=0x55ee6c536270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.381+0000 7f1ce145a640 1 --2- 172.21.15.146:0/823132624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1475b0 0x55ee6c536270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.381+0000 7f1ce145a640 1 -- 172.21.15.146:0/823132624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1268d0 msgr2=0x55ee6c519480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.381+0000 7f1cd1ffb640 1 -- 172.21.15.146:0/2428574865 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1cd40bb970 con 0x7f1cdc06f320 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.381+0000 7f1ce145a640 1 --2- 172.21.15.146:0/823132624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1268d0 0x55ee6c519480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.381+0000 7f1ce145a640 1 -- 172.21.15.146:0/823132624 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee6c22ba20 con 0x55ee6c11e6f0 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.381+0000 7f1ce1c5b640 1 --2- 172.21.15.146:0/823132624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1475b0 0x55ee6c536270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.381+0000 7f1ce0c59640 1 --2- 172.21.15.146:0/823132624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1268d0 0x55ee6c519480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.381+0000 7f1ce1c5b640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1cc0078c60 0x7f1cc007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.381+0000 7f1ce145a640 1 --2- 172.21.15.146:0/823132624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 0x55ee6c518f40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d350 tx=0x7f1cd404c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e03bd6e9704ef87 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.382+0000 7f1cbeffd640 1 -- 172.21.15.146:0/823132624 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4030070 con 0x55ee6c11e6f0 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.382+0000 7f1cbeffd640 1 -- 172.21.15.146:0/823132624 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cd4033eb0 con 0x55ee6c11e6f0 2024-09-17T03:39:29.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.382+0000 7f1cbeffd640 1 -- 172.21.15.146:0/823132624 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40bee60 con 0x55ee6c11e6f0 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.383+0000 7f1cea624740 1 -- 172.21.15.146:0/823132624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 msgr2=0x55ee6c518f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.383+0000 7f1cea624740 1 --2- 172.21.15.146:0/823132624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 0x55ee6c518f40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d350 tx=0x7f1cd404c000 comp rx=0 tx=0).stop 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.383+0000 7f1ce1c5b640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1cc0078c60 0x7f1cc007b170 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80013f0 tx=0x7f1cd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.383+0000 7f1cea624740 1 -- 172.21.15.146:0/823132624 shutdown_connections 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.383+0000 7f1cea624740 1 --2- 172.21.15.146:0/823132624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1268d0 0x55ee6c519480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.383+0000 7f1cea624740 1 --2- 172.21.15.146:0/823132624 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 0x55ee6c518f40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.383+0000 7f1cea624740 1 --2- 172.21.15.146:0/823132624 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1475b0 0x55ee6c536270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.383+0000 7f1cea624740 1 -- 172.21.15.146:0/823132624 >> 172.21.15.146:0/823132624 conn(0x55ee6c13b700 msgr2=0x55ee6c4ef160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.383+0000 7f1cea624740 1 -- 172.21.15.146:0/823132624 shutdown_connections 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.383+0000 7f1cea624740 1 -- 172.21.15.146:0/823132624 wait complete. 2024-09-17T03:39:29.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.384+0000 7f1cea624740 1 -- start start 2024-09-17T03:39:29.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.384+0000 7f1cea624740 1 Processor -- start 2024-09-17T03:39:29.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.385+0000 7f1cea624740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c11e6f0 0x55ee6c52e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.385+0000 7f1cea624740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 0x55ee6c543920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.385+0000 7f1cea624740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 0x55ee6c5344a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.385+0000 7f1cea624740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ee6c1c1960 con 0x55ee6c1475b0 2024-09-17T03:39:29.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.385+0000 7f1cea624740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ee6c3d7670 con 0x55ee6c11e6f0 2024-09-17T03:39:29.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.385+0000 7f1cea624740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ee6c461a80 con 0x55ee6c1268d0 2024-09-17T03:39:29.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.385+0000 7f1cea624740 10 client.0 _ll_register_callbacks cb 0x55ee6c44a3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:29.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.385+0000 7f1ce1c5b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 0x55ee6c5344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.385+0000 7f1ce0c59640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 0x55ee6c543920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.385+0000 7f1ce0c59640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 0x55ee6c543920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:51012/0 (socket says 172.21.15.146:51012) 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.385+0000 7f1ce0c59640 1 -- 172.21.15.146:0/2122333684 learned_addr learned my addr 172.21.15.146:0/2122333684 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1ce145a640 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c11e6f0 0x55ee6c52e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1ce0c59640 1 -- 172.21.15.146:0/2122333684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c11e6f0 msgr2=0x55ee6c52e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1ce0c59640 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c11e6f0 0x55ee6c52e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1ce0c59640 1 -- 172.21.15.146:0/2122333684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 msgr2=0x55ee6c5344a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1ce0c59640 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 0x55ee6c5344a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1ce0c59640 1 -- 172.21.15.146:0/2122333684 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55ee6c1908c0 con 0x55ee6c1268d0 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1ce145a640 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c11e6f0 0x55ee6c52e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1ce0c59640 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 0x55ee6c543920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009620 tx=0x7f1ccc0039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b5ef109defeaa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1cb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.179:3301/0 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1cb7fff640 1 -- 172.21.15.146:0/2122333684 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc005220 con 0x55ee6c1268d0 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1cea624740 1 -- 172.21.15.146:0/2122333684 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee6c4639d0 con 0x55ee6c1268d0 2024-09-17T03:39:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1cb7fff640 1 -- 172.21.15.146:0/2122333684 <== mon.2 v2:172.21.15.179:3301/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1ccc0053c0 con 0x55ee6c1268d0 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1cb7fff640 1 -- 172.21.15.146:0/2122333684 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f1ccc023050 con 0x55ee6c1268d0 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1cea624740 10 client.6623 fetch_fsmap learned FSMap version 78 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1cea624740 1 -- 172.21.15.146:0/2122333684 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x55ee6c28c1b0 con 0x55ee6c1268d0 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.386+0000 7f1cb7fff640 1 -- 172.21.15.146:0/2122333684 <== mon.2 v2:172.21.15.179:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ee6c4639d0 con 0x55ee6c1268d0 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.387+0000 7f1cb7fff640 1 -- 172.21.15.146:0/2122333684 <== mon.2 v2:172.21.15.179:3301/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7f1ccc026020 con 0x55ee6c1268d0 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.387+0000 7f1cea624740 10 client.6623 fetch_fsmap finished waiting for FSMap version 78 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.387+0000 7f1cea624740 10 client.6623 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.387+0000 7f1cea624740 20 client.6623 populate_metadata read hostname 'smithi146' 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.387+0000 7f1cea624740 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55ee6c106180 0x55ee6c52b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.387+0000 7f1cea624740 4 client.6623 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.387+0000 7f1cea624740 1 -- 172.21.15.146:0/2122333684 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee6c45f480 con 0x55ee6c106180 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.387+0000 7f1ce145a640 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55ee6c106180 0x55ee6c52b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.387+0000 7f1cb7fff640 10 client.6623 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.387+0000 7f1ce145a640 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55ee6c106180 0x55ee6c52b7d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5d4dd719cdc72b9 server_cookie=c7a772dce631a82b in_seq=0 out_seq=0 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cb7fff640 1 -- 172.21.15.146:0/2122333684 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee6c45f480 con 0x55ee6c106180 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cb7fff640 10 client.6623 handle_command_reply: tid=0 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 1 client.6623 shutdown 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 1 -- 172.21.15.146:0/2122333684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 msgr2=0x55ee6c543920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 0x55ee6c543920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009620 tx=0x7f1ccc0039c0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 1 -- 172.21.15.146:0/2122333684 shutdown_connections 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55ee6c106180 0x55ee6c52b7d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 0x55ee6c5344a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 0x55ee6c543920 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cb7fff640 0 client.6623 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 1 --2- 172.21.15.146:0/2122333684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c11e6f0 0x55ee6c52e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 1 -- 172.21.15.146:0/2122333684 >> 172.21.15.146:0/2122333684 conn(0x55ee6c13b700 msgr2=0x55ee6c4e84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 1 -- 172.21.15.146:0/2122333684 shutdown_connections 2024-09-17T03:39:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 1 -- 172.21.15.146:0/2122333684 wait complete. 2024-09-17T03:39:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.388+0000 7f1cea624740 20 client.6623 trim_cache size 0 max 16384 2024-09-17T03:39:29.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.406+0000 7f1cea624740 1 Processor -- start 2024-09-17T03:39:29.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.406+0000 7f1cea624740 1 -- start start 2024-09-17T03:39:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.407+0000 7f1cea624740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c11e6f0 0x55ee6c519130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.407+0000 7f1cea624740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 0x55ee6c519670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.407+0000 7f1cea624740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1475b0 0x55ee6c52b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.407+0000 7f1cea624740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc08f410 con 0x55ee6c11e6f0 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.407+0000 7f1cea624740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc08e430 con 0x55ee6c1475b0 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.407+0000 7f1cea624740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1cdc15ddf0 con 0x55ee6c1268d0 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1ce145a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c11e6f0 0x55ee6c519130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1ce145a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c11e6f0 0x55ee6c519130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55478/0 (socket says 172.21.15.146:55478) 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1ce145a640 1 -- 172.21.15.146:0/3276453016 learned_addr learned my addr 172.21.15.146:0/3276453016 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1ce0c59640 1 --2- 172.21.15.146:0/3276453016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 0x55ee6c519670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1ce1c5b640 1 --2- 172.21.15.146:0/3276453016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1475b0 0x55ee6c52b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1ce145a640 1 -- 172.21.15.146:0/3276453016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 msgr2=0x55ee6c519670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1ce145a640 1 --2- 172.21.15.146:0/3276453016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 0x55ee6c519670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1ce145a640 1 -- 172.21.15.146:0/3276453016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1475b0 msgr2=0x55ee6c52b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1ce145a640 1 --2- 172.21.15.146:0/3276453016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1475b0 0x55ee6c52b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1ce145a640 1 -- 172.21.15.146:0/3276453016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee6c52e680 con 0x55ee6c11e6f0 2024-09-17T03:39:29.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1ce145a640 1 --2- 172.21.15.146:0/3276453016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c11e6f0 0x55ee6c519130 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d350 tx=0x7f1cd404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fc161d3032f866 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1cbe7fc640 1 -- 172.21.15.146:0/3276453016 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4030040 con 0x55ee6c11e6f0 2024-09-17T03:39:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1cbe7fc640 1 -- 172.21.15.146:0/3276453016 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cd4083250 con 0x55ee6c11e6f0 2024-09-17T03:39:29.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.408+0000 7f1cbe7fc640 1 -- 172.21.15.146:0/3276453016 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4004d60 con 0x55ee6c11e6f0 2024-09-17T03:39:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.409+0000 7f1cea624740 1 -- 172.21.15.146:0/3276453016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c11e6f0 msgr2=0x55ee6c519130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.409+0000 7f1cea624740 1 --2- 172.21.15.146:0/3276453016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c11e6f0 0x55ee6c519130 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d350 tx=0x7f1cd404c000 comp rx=0 tx=0).stop 2024-09-17T03:39:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.409+0000 7f1cea624740 1 -- 172.21.15.146:0/3276453016 shutdown_connections 2024-09-17T03:39:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.409+0000 7f1cea624740 1 --2- 172.21.15.146:0/3276453016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1475b0 0x55ee6c52b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.409+0000 7f1cea624740 1 --2- 172.21.15.146:0/3276453016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c1268d0 0x55ee6c519670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.409+0000 7f1cea624740 1 --2- 172.21.15.146:0/3276453016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c11e6f0 0x55ee6c519130 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.409+0000 7f1cea624740 1 -- 172.21.15.146:0/3276453016 >> 172.21.15.146:0/3276453016 conn(0x55ee6c13b700 msgr2=0x55ee6c534270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.409+0000 7f1cea624740 1 -- 172.21.15.146:0/3276453016 shutdown_connections 2024-09-17T03:39:29.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.409+0000 7f1cea624740 1 -- 172.21.15.146:0/3276453016 wait complete. 2024-09-17T03:39:29.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.410+0000 7f1cea624740 1 -- start start 2024-09-17T03:39:29.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.410+0000 7f1cea624740 1 Processor -- start 2024-09-17T03:39:29.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.411+0000 7f1cea624740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 0x55ee6c4ed700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.411+0000 7f1cea624740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1268d0 0x55ee6c5b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.411+0000 7f1cea624740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 0x55ee6c549210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.411+0000 7f1cea624740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ee6c454cc0 con 0x55ee6c1475b0 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.411+0000 7f1cea624740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1cdc1fca40 con 0x55ee6c1268d0 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.411+0000 7f1cea624740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ee6c54c2d0 con 0x55ee6c11e6f0 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.411+0000 7f1cea624740 10 client.0 _ll_register_callbacks cb 0x7f1ccc004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1ce1c5b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 0x55ee6c549210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1ce1c5b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 0x55ee6c549210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55492/0 (socket says 172.21.15.146:55492) 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1ce1c5b640 1 -- 172.21.15.146:0/1073548151 learned_addr learned my addr 172.21.15.146:0/1073548151 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1ce0c59640 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1268d0 0x55ee6c5b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1ce145a640 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 0x55ee6c4ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1ce1c5b640 1 -- 172.21.15.146:0/1073548151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 msgr2=0x55ee6c4ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1ce1c5b640 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 0x55ee6c4ed700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1ce1c5b640 1 -- 172.21.15.146:0/1073548151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1268d0 msgr2=0x55ee6c5b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1ce1c5b640 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1268d0 0x55ee6c5b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1ce1c5b640 1 -- 172.21.15.146:0/1073548151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee6c229d20 con 0x55ee6c1475b0 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1ce1c5b640 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 0x55ee6c549210 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8015810 tx=0x7f1cd8004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a5628d91432e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1cb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1cb7fff640 1 -- 172.21.15.146:0/1073548151 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8028070 con 0x55ee6c1475b0 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1cb7fff640 1 -- 172.21.15.146:0/1073548151 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1cd8016b50 con 0x55ee6c1475b0 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1cea624740 1 -- 172.21.15.146:0/1073548151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd4083250 con 0x55ee6c1475b0 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1cb7fff640 1 -- 172.21.15.146:0/1073548151 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f1cd8033050 con 0x55ee6c1475b0 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1cea624740 10 client.7998 fetch_fsmap learned FSMap version 78 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.412+0000 7f1cea624740 1 -- 172.21.15.146:0/1073548151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x55ee6c549c70 con 0x55ee6c1475b0 2024-09-17T03:39:29.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.413+0000 7f1cb7fff640 1 -- 172.21.15.146:0/1073548151 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cd4083250 con 0x55ee6c1475b0 2024-09-17T03:39:29.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.413+0000 7f1cb7fff640 1 -- 172.21.15.146:0/1073548151 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7f1cd8036020 con 0x55ee6c1475b0 2024-09-17T03:39:29.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.413+0000 7f1cea624740 10 client.7998 fetch_fsmap finished waiting for FSMap version 78 2024-09-17T03:39:29.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.413+0000 7f1cea624740 10 client.7998 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-17T03:39:29.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.413+0000 7f1cea624740 20 client.7998 populate_metadata read hostname 'smithi146' 2024-09-17T03:39:29.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.413+0000 7f1cea624740 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55ee6c531070 0x55ee6c534270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.413+0000 7f1cea624740 4 client.7998 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-17T03:39:29.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.413+0000 7f1cea624740 1 -- 172.21.15.146:0/1073548151 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55ee6c45c8b0 con 0x55ee6c531070 2024-09-17T03:39:29.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.413+0000 7f1ce145a640 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55ee6c531070 0x55ee6c534270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.413+0000 7f1cb7fff640 10 client.7998 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.413+0000 7f1ce145a640 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55ee6c531070 0x55ee6c534270 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e34c8789dd8f326 server_cookie=f48a4eb6f64632df in_seq=0 out_seq=0 2024-09-17T03:39:29.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cb7fff640 1 -- 172.21.15.146:0/1073548151 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ee6c45c8b0 con 0x55ee6c531070 2024-09-17T03:39:29.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cb7fff640 10 client.7998 handle_command_reply: tid=0 2024-09-17T03:39:29.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cea624740 1 client.7998 shutdown 2024-09-17T03:39:29.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cea624740 1 -- 172.21.15.146:0/1073548151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 msgr2=0x55ee6c549210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cea624740 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 0x55ee6c549210 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8015810 tx=0x7f1cd8004620 comp rx=0 tx=0).stop 2024-09-17T03:39:29.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cea624740 1 -- 172.21.15.146:0/1073548151 shutdown_connections 2024-09-17T03:39:29.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cea624740 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55ee6c531070 0x55ee6c534270 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cea624740 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ee6c1475b0 0x55ee6c549210 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cea624740 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee6c1268d0 0x55ee6c5b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cb7fff640 0 client.7998 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cea624740 1 --2- 172.21.15.146:0/1073548151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee6c11e6f0 0x55ee6c4ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.422+0000 7f1cea624740 1 -- 172.21.15.146:0/1073548151 >> 172.21.15.146:0/1073548151 conn(0x55ee6c13b700 msgr2=0x55ee6c509180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1cea624740 1 -- 172.21.15.146:0/1073548151 shutdown_connections 2024-09-17T03:39:29.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1cea624740 1 -- 172.21.15.146:0/1073548151 wait complete. 2024-09-17T03:39:29.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1cea624740 20 client.7998 trim_cache size 0 max 16384 2024-09-17T03:39:29.424 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:39:29.424 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:39:29.424 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "29f8adc9-2fb2-4ea2-be5e-4b93408ae2fe", 2024-09-17T03:39:29.424 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:39:29.425 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:39:29.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1ce245c640 1 -- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1cc0078c60 msgr2=0x7f1cc007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1ce245c640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1cc0078c60 0x7f1cc007b170 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80013f0 tx=0x7f1cd8009040 comp rx=0 tx=0).stop 2024-09-17T03:39:29.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1ce245c640 1 -- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cdc06f320 msgr2=0x7f1cdc150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1ce245c640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cdc06f320 0x7f1cdc150ca0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009b30 tx=0x7f1cd4033600 comp rx=0 tx=0).stop 2024-09-17T03:39:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1ce245c640 1 -- 172.21.15.146:0/2428574865 shutdown_connections 2024-09-17T03:39:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1ce245c640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1cc0078c60 0x7f1cc007b170 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1ce245c640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cdc15a860 0x7f1cdc158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1ce245c640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1cdc0ae320 0x7f1cdc09e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1ce245c640 1 --2- 172.21.15.146:0/2428574865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1cdc06f320 0x7f1cdc150ca0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.423+0000 7f1ce245c640 1 -- 172.21.15.146:0/2428574865 >> 172.21.15.146:0/2428574865 conn(0x7f1cdc0d0340 msgr2=0x7f1cdc074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.424+0000 7f1ce245c640 1 -- 172.21.15.146:0/2428574865 shutdown_connections 2024-09-17T03:39:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.424+0000 7f1ce245c640 1 -- 172.21.15.146:0/2428574865 wait complete. 2024-09-17T03:39:29.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:29.435 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T03:39:29.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.570+0000 7f79d9c07640 1 -- 172.21.15.146:0/2372050586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b3c90 msgr2=0x7f79d415b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.570+0000 7f79d9c07640 1 --2- 172.21.15.146:0/2372050586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b3c90 0x7f79d415b890 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f79d4069480 tx=0x7f79c402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.570+0000 7f79d9c07640 1 -- 172.21.15.146:0/2372050586 shutdown_connections 2024-09-17T03:39:29.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.570+0000 7f79d9c07640 1 --2- 172.21.15.146:0/2372050586 >> v2:172.21.15.179:3300/0 conn(0x7f79d4074a00 0x7f79d406f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.570+0000 7f79d9c07640 1 --2- 172.21.15.146:0/2372050586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b3c90 0x7f79d415b890 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.570+0000 7f79d9c07640 1 -- 172.21.15.146:0/2372050586 >> 172.21.15.146:0/2372050586 conn(0x7f79d40b2db0 msgr2=0x7f79d40b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.570+0000 7f79d9c07640 1 -- 172.21.15.146:0/2372050586 shutdown_connections 2024-09-17T03:39:29.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.570+0000 7f79d9c07640 1 -- 172.21.15.146:0/2372050586 wait complete. 2024-09-17T03:39:29.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.572+0000 7f79d9c07640 1 Processor -- start 2024-09-17T03:39:29.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.572+0000 7f79d9c07640 1 -- start start 2024-09-17T03:39:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.573+0000 7f79d9c07640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b3c90 0x7f79d41f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.573+0000 7f79d9c07640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d40b4f30 0x7f79d4073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d9c07640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d41547d0 0x7f79d4073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d9c07640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f79d40af320 con 0x7f79d40b3c90 2024-09-17T03:39:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d9c07640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79d40af1a0 con 0x7f79d41547d0 2024-09-17T03:39:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d9c07640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f79d40af4a0 con 0x7f79d40b4f30 2024-09-17T03:39:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b3c90 0x7f79d41f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d2ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d40b4f30 0x7f79d4073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b3c90 0x7f79d41f6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55514/0 (socket says 172.21.15.146:55514) 2024-09-17T03:39:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d37fe640 1 -- 172.21.15.146:0/2116965400 learned_addr learned my addr 172.21.15.146:0/2116965400 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d3fff640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d41547d0 0x7f79d4073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d2ffd640 1 -- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d41547d0 msgr2=0x7f79d4073750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d2ffd640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d41547d0 0x7f79d4073750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d2ffd640 1 -- 172.21.15.146:0/2116965400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b3c90 msgr2=0x7f79d41f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d2ffd640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b3c90 0x7f79d41f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d2ffd640 1 -- 172.21.15.146:0/2116965400 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d41f6780 con 0x7f79d40b4f30 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79d2ffd640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d40b4f30 0x7f79d4073210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00c3f0 tx=0x7f79bc00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.574+0000 7f79cbfff640 1 -- 172.21.15.146:0/2116965400 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc017070 con 0x7f79d40b4f30 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.575+0000 7f79cbfff640 1 -- 172.21.15.146:0/2116965400 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79bc0035f0 con 0x7f79d40b4f30 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.575+0000 7f79cbfff640 1 -- 172.21.15.146:0/2116965400 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc003a40 con 0x7f79d40b4f30 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.575+0000 7f79d9c07640 1 -- 172.21.15.146:0/2116965400 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d4152a60 con 0x7f79d40b4f30 2024-09-17T03:39:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.575+0000 7f79d9c07640 1 -- 172.21.15.146:0/2116965400 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d4153020 con 0x7f79d40b4f30 2024-09-17T03:39:29.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.577+0000 7f79cbfff640 1 -- 172.21.15.146:0/2116965400 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79bc01a070 con 0x7f79d40b4f30 2024-09-17T03:39:29.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.577+0000 7f79cbfff640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078b90 0x7f79b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.578+0000 7f79cbfff640 1 -- 172.21.15.146:0/2116965400 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f79bc099da0 con 0x7f79d40b4f30 2024-09-17T03:39:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.578+0000 7f79d37fe640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078b90 0x7f79b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.578+0000 7f79d37fe640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078b90 0x7f79b407b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009230 tx=0x7f79c4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.579+0000 7f79e0c4e740 1 Processor -- start 2024-09-17T03:39:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.579+0000 7f79e0c4e740 1 -- start start 2024-09-17T03:39:29.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.580+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ae8390 0x55c0f5edd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.580+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 0x55c0f5eb2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.580+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 0x55c0f5eb25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.580+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c0f5e02a60 con 0x55c0f5abf4d0 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.580+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c0f5df1e90 con 0x55c0f5ae8390 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.580+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c0f5df5ca0 con 0x55c0f5ac76b0 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d3fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 0x55c0f5eb25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ae8390 0x55c0f5edd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 0x55c0f5eb2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d3fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 0x55c0f5eb25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:51050/0 (socket says 172.21.15.146:51050) 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ae8390 0x55c0f5edd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:41288/0 (socket says 172.21.15.146:41288) 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d3fff640 1 -- 172.21.15.146:0/15228753 learned_addr learned my addr 172.21.15.146:0/15228753 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d3fff640 1 -- 172.21.15.146:0/15228753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ae8390 msgr2=0x55c0f5edd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d3fff640 1 --2- 172.21.15.146:0/15228753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ae8390 0x55c0f5edd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d3fff640 1 -- 172.21.15.146:0/15228753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 msgr2=0x55c0f5eb2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d3fff640 1 --2- 172.21.15.146:0/15228753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 0x55c0f5eb2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d3fff640 1 -- 172.21.15.146:0/15228753 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0f5bca7d0 con 0x55c0f5ac76b0 2024-09-17T03:39:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79d3fff640 1 --2- 172.21.15.146:0/15228753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 0x55c0f5eb25b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009f30 tx=0x7f79cc0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf33c92344e82014 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79c97fa640 1 -- 172.21.15.146:0/15228753 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc004d20 con 0x55c0f5ac76b0 2024-09-17T03:39:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79c97fa640 1 -- 172.21.15.146:0/15228753 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79cc003a30 con 0x55c0f5ac76b0 2024-09-17T03:39:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.581+0000 7f79c97fa640 1 -- 172.21.15.146:0/15228753 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc004050 con 0x55c0f5ac76b0 2024-09-17T03:39:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.583+0000 7f79e0c4e740 1 -- 172.21.15.146:0/15228753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 msgr2=0x55c0f5eb25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.583+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/15228753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 0x55c0f5eb25b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009f30 tx=0x7f79cc0118d0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.583+0000 7f79e0c4e740 1 -- 172.21.15.146:0/15228753 shutdown_connections 2024-09-17T03:39:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.583+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/15228753 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 0x55c0f5eb25b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.583+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/15228753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 0x55c0f5eb2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.583+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/15228753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ae8390 0x55c0f5edd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.583+0000 7f79e0c4e740 1 -- 172.21.15.146:0/15228753 >> 172.21.15.146:0/15228753 conn(0x55c0f5adc4e0 msgr2=0x55c0f5e98510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.583+0000 7f79e0c4e740 1 -- 172.21.15.146:0/15228753 shutdown_connections 2024-09-17T03:39:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.583+0000 7f79e0c4e740 1 -- 172.21.15.146:0/15228753 wait complete. 2024-09-17T03:39:29.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.584+0000 7f79e0c4e740 1 -- start start 2024-09-17T03:39:29.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.584+0000 7f79e0c4e740 1 Processor -- start 2024-09-17T03:39:29.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.587+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5abf4d0 0x55c0f5eebb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.587+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ac76b0 0x55c0f5ed90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.587+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ae8390 0x55c0f5ed9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.587+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c0f5b62740 con 0x55c0f5ae8390 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.587+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c0f5d97970 con 0x55c0f5ac76b0 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.587+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c0f5ed4e10 con 0x55c0f5abf4d0 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.587+0000 7f79e0c4e740 10 client.0 _ll_register_callbacks cb 0x55c0f5da6780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.587+0000 7f79d3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ae8390 0x55c0f5ed9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.587+0000 7f79d3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ae8390 0x55c0f5ed9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55538/0 (socket says 172.21.15.146:55538) 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.587+0000 7f79d3fff640 1 -- 172.21.15.146:0/84110436 learned_addr learned my addr 172.21.15.146:0/84110436 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.587+0000 7f79d37fe640 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5abf4d0 0x55c0f5eebb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79d2ffd640 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ac76b0 0x55c0f5ed90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79d3fff640 1 -- 172.21.15.146:0/84110436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5abf4d0 msgr2=0x55c0f5eebb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79d3fff640 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5abf4d0 0x55c0f5eebb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79d3fff640 1 -- 172.21.15.146:0/84110436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ac76b0 msgr2=0x55c0f5ed90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79d3fff640 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ac76b0 0x55c0f5ed90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79d3fff640 1 -- 172.21.15.146:0/84110436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0f5b53970 con 0x55c0f5ae8390 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79d2ffd640 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ac76b0 0x55c0f5ed90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79d3fff640 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ae8390 0x55c0f5ed9600 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f79cc000f80 tx=0x7f79cc003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9665638d5f5230 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79b27fc640 1 -- 172.21.15.146:0/84110436 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc027070 con 0x55c0f5ae8390 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79b27fc640 1 -- 172.21.15.146:0/84110436 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f79cc004460 con 0x55c0f5ae8390 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79e0c4e740 1 -- 172.21.15.146:0/84110436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79cc003a30 con 0x55c0f5ae8390 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79b27fc640 1 -- 172.21.15.146:0/84110436 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f79cc032050 con 0x55c0f5ae8390 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79e0c4e740 10 client.8010 fetch_fsmap learned FSMap version 78 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.588+0000 7f79e0c4e740 1 -- 172.21.15.146:0/84110436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x55c0f5b316a0 con 0x55c0f5ae8390 2024-09-17T03:39:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.589+0000 7f79b27fc640 1 -- 172.21.15.146:0/84110436 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79cc003a30 con 0x55c0f5ae8390 2024-09-17T03:39:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.589+0000 7f79b27fc640 1 -- 172.21.15.146:0/84110436 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7f79cc035020 con 0x55c0f5ae8390 2024-09-17T03:39:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.589+0000 7f79e0c4e740 10 client.8010 fetch_fsmap finished waiting for FSMap version 78 2024-09-17T03:39:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.589+0000 7f79e0c4e740 10 client.8010 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-17T03:39:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.589+0000 7f79e0c4e740 20 client.8010 populate_metadata read hostname 'smithi146' 2024-09-17T03:39:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.589+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c0f5aa6f60 0x55c0f5eef980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.589+0000 7f79e0c4e740 4 client.8010 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:39:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.589+0000 7f79e0c4e740 1 -- 172.21.15.146:0/84110436 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0f5e049b0 con 0x55c0f5aa6f60 2024-09-17T03:39:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.589+0000 7f79d37fe640 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c0f5aa6f60 0x55c0f5eef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.589+0000 7f79b27fc640 10 client.8010 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.590+0000 7f79d37fe640 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c0f5aa6f60 0x55c0f5eef980 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a2a77a52b81575e server_cookie=27a986cb36fb83a9 in_seq=0 out_seq=0 2024-09-17T03:39:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79b27fc640 1 -- 172.21.15.146:0/84110436 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c0f5e049b0 con 0x55c0f5aa6f60 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79b27fc640 10 client.8010 handle_command_reply: tid=0 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 1 client.8010 shutdown 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 1 -- 172.21.15.146:0/84110436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ae8390 msgr2=0x55c0f5ed9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ae8390 0x55c0f5ed9600 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f79cc000f80 tx=0x7f79cc003e10 comp rx=0 tx=0).stop 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 1 -- 172.21.15.146:0/84110436 shutdown_connections 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c0f5aa6f60 0x55c0f5eef980 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ae8390 0x55c0f5ed9600 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5ac76b0 0x55c0f5ed90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79b27fc640 0 client.8010 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/84110436 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5abf4d0 0x55c0f5eebb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 1 -- 172.21.15.146:0/84110436 >> 172.21.15.146:0/84110436 conn(0x55c0f5adc4e0 msgr2=0x55c0f5eb1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 1 -- 172.21.15.146:0/84110436 shutdown_connections 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 1 -- 172.21.15.146:0/84110436 wait complete. 2024-09-17T03:39:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.591+0000 7f79e0c4e740 20 client.8010 trim_cache size 0 max 16384 2024-09-17T03:39:29.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.626+0000 7f79e0c4e740 1 Processor -- start 2024-09-17T03:39:29.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.626+0000 7f79e0c4e740 1 -- start start 2024-09-17T03:39:29.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.628+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5adc4e0 0x55c0f5ed90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.628+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 0x55c0f5ed95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.628+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 0x55c0f5ed7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.628+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f79d40c7910 con 0x55c0f5abf4d0 2024-09-17T03:39:29.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.628+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79d41f9e20 con 0x55c0f5adc4e0 2024-09-17T03:39:29.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.628+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f79d41f9180 con 0x55c0f5ac76b0 2024-09-17T03:39:29.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 0x55c0f5ed95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5adc4e0 0x55c0f5ed90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 0x55c0f5ed95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55550/0 (socket says 172.21.15.146:55550) 2024-09-17T03:39:29.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d2ffd640 1 -- 172.21.15.146:0/581700784 learned_addr learned my addr 172.21.15.146:0/581700784 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d3fff640 1 --2- 172.21.15.146:0/581700784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 0x55c0f5ed7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d37fe640 1 -- 172.21.15.146:0/581700784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 msgr2=0x55c0f5ed7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d37fe640 1 --2- 172.21.15.146:0/581700784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 0x55c0f5ed7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d37fe640 1 -- 172.21.15.146:0/581700784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 msgr2=0x55c0f5ed95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d37fe640 1 --2- 172.21.15.146:0/581700784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 0x55c0f5ed95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d37fe640 1 -- 172.21.15.146:0/581700784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0f5e95070 con 0x55c0f5adc4e0 2024-09-17T03:39:29.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d2ffd640 1 --2- 172.21.15.146:0/581700784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 0x55c0f5ed95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:39:29.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79d37fe640 1 --2- 172.21.15.146:0/581700784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5adc4e0 0x55c0f5ed90a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79c4000c00 tx=0x7f79c403d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd38f35ed703cc57 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.629+0000 7f79c8ff9640 1 -- 172.21.15.146:0/581700784 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4035040 con 0x55c0f5adc4e0 2024-09-17T03:39:29.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.630+0000 7f79c8ff9640 1 -- 172.21.15.146:0/581700784 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79c4003cb0 con 0x55c0f5adc4e0 2024-09-17T03:39:29.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.630+0000 7f79c8ff9640 1 -- 172.21.15.146:0/581700784 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4003e60 con 0x55c0f5adc4e0 2024-09-17T03:39:29.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.630+0000 7f79e0c4e740 1 -- 172.21.15.146:0/581700784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5adc4e0 msgr2=0x55c0f5ed90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.630+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/581700784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5adc4e0 0x55c0f5ed90a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79c4000c00 tx=0x7f79c403d000 comp rx=0 tx=0).stop 2024-09-17T03:39:29.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.631+0000 7f79e0c4e740 1 -- 172.21.15.146:0/581700784 shutdown_connections 2024-09-17T03:39:29.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.631+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/581700784 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5ac76b0 0x55c0f5ed7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.631+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/581700784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5abf4d0 0x55c0f5ed95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.631+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/581700784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5adc4e0 0x55c0f5ed90a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.631+0000 7f79e0c4e740 1 -- 172.21.15.146:0/581700784 >> 172.21.15.146:0/581700784 conn(0x55c0f5ebf460 msgr2=0x55c0f5e97f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.631+0000 7f79e0c4e740 1 -- 172.21.15.146:0/581700784 shutdown_connections 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.631+0000 7f79e0c4e740 1 -- 172.21.15.146:0/581700784 wait complete. 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.632+0000 7f79e0c4e740 1 -- start start 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.632+0000 7f79e0c4e740 1 Processor -- start 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.634+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5abf4d0 0x55c0f5f45840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.634+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ac76b0 0x55c0f5ea6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.634+0000 7f79e0c4e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5adc4e0 0x55c0f5ea6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.634+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c0f5e84b10 con 0x55c0f5ac76b0 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79d41f97d0 con 0x55c0f5abf4d0 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79e0c4e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c0f5eb0650 con 0x55c0f5adc4e0 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79e0c4e740 10 client.0 _ll_register_callbacks cb 0x7f79bc000ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5abf4d0 0x55c0f5f45840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ac76b0 0x55c0f5ea6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d3fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5adc4e0 0x55c0f5ea6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d37fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5abf4d0 0x55c0f5f45840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:41314/0 (socket says 172.21.15.146:41314) 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d37fe640 1 -- 172.21.15.146:0/1678884459 learned_addr learned my addr 172.21.15.146:0/1678884459 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ac76b0 0x55c0f5ea6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55564/0 (socket says 172.21.15.146:55564) 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d3fff640 1 -- 172.21.15.146:0/1678884459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5abf4d0 msgr2=0x55c0f5f45840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d3fff640 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5abf4d0 0x55c0f5f45840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d3fff640 1 -- 172.21.15.146:0/1678884459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ac76b0 msgr2=0x55c0f5ea6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d3fff640 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ac76b0 0x55c0f5ea6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d3fff640 1 -- 172.21.15.146:0/1678884459 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55c0f5eb0180 con 0x55c0f5adc4e0 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d37fe640 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5abf4d0 0x55c0f5f45840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79d3fff640 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5adc4e0 0x55c0f5ea6a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f79cc011dd0 tx=0x7f79cc0246a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7420ad324a3d2bf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.179:3301/0 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.635+0000 7f79b27fc640 1 -- 172.21.15.146:0/1678884459 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc03b060 con 0x55c0f5adc4e0 2024-09-17T03:39:29.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79b27fc640 1 -- 172.21.15.146:0/1678884459 <== mon.2 v2:172.21.15.179:3301/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f79cc024ca0 con 0x55c0f5adc4e0 2024-09-17T03:39:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79e0c4e740 1 -- 172.21.15.146:0/1678884459 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79c4003cb0 con 0x55c0f5adc4e0 2024-09-17T03:39:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79b27fc640 1 -- 172.21.15.146:0/1678884459 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f79cc041050 con 0x55c0f5adc4e0 2024-09-17T03:39:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79e0c4e740 10 client.6644 fetch_fsmap learned FSMap version 78 2024-09-17T03:39:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79e0c4e740 1 -- 172.21.15.146:0/1678884459 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x55c0f5e937a0 con 0x55c0f5adc4e0 2024-09-17T03:39:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79b27fc640 1 -- 172.21.15.146:0/1678884459 <== mon.2 v2:172.21.15.179:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79c4003cb0 con 0x55c0f5adc4e0 2024-09-17T03:39:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79b27fc640 1 -- 172.21.15.146:0/1678884459 <== mon.2 v2:172.21.15.179:3301/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7f79cc044020 con 0x55c0f5adc4e0 2024-09-17T03:39:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79e0c4e740 10 client.6644 fetch_fsmap finished waiting for FSMap version 78 2024-09-17T03:39:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79e0c4e740 10 client.6644 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-17T03:39:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79e0c4e740 20 client.6644 populate_metadata read hostname 'smithi146' 2024-09-17T03:39:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c0f5a7c3a0 0x55c0f5eeb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79e0c4e740 4 client.6644 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79e0c4e740 1 -- 172.21.15.146:0/1678884459 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c0f5ed7590 con 0x55c0f5a7c3a0 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.636+0000 7f79d37fe640 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c0f5a7c3a0 0x55c0f5eeb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.637+0000 7f79b27fc640 10 client.6644 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.637+0000 7f79d37fe640 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c0f5a7c3a0 0x55c0f5eeb110 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd8ec038d7a38b1b server_cookie=ff1061eb1cdba858 in_seq=0 out_seq=0 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79b27fc640 1 -- 172.21.15.146:0/1678884459 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+583 (crc 0 0 0) 0x55c0f5ed7590 con 0x55c0f5a7c3a0 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79b27fc640 10 client.6644 handle_command_reply: tid=0 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79e0c4e740 1 client.6644 shutdown 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79e0c4e740 1 -- 172.21.15.146:0/1678884459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5adc4e0 msgr2=0x55c0f5ea6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5adc4e0 0x55c0f5ea6a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f79cc011dd0 tx=0x7f79cc0246a0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79e0c4e740 1 -- 172.21.15.146:0/1678884459 shutdown_connections 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c0f5adc4e0 0x55c0f5ea6a90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c0f5a7c3a0 0x55c0f5eeb110 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c0f5ac76b0 0x55c0f5ea6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79e0c4e740 1 --2- 172.21.15.146:0/1678884459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c0f5abf4d0 0x55c0f5f45840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79b27fc640 0 client.6644 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79e0c4e740 1 -- 172.21.15.146:0/1678884459 >> 172.21.15.146:0/1678884459 conn(0x55c0f5ebf460 msgr2=0x55c0f5ed93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79e0c4e740 1 -- 172.21.15.146:0/1678884459 shutdown_connections 2024-09-17T03:39:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.638+0000 7f79e0c4e740 1 -- 172.21.15.146:0/1678884459 wait complete. 2024-09-17T03:39:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79e0c4e740 20 client.6644 trim_cache size 0 max 16384 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "scrub active (1160 inodes in the stack)", 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout: "29f8adc9-2fb2-4ea2-be5e-4b93408ae2fe": { 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "~mds0", 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "29f8adc9-2fb2-4ea2-be5e-4b93408ae2fe", 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout: "29f8adc9-2fb2-4ea2-be5e-4b93408ae2fe": { 2024-09-17T03:39:29.646 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:39:29.414726+0000", 2024-09-17T03:39:29.647 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "~mdsdir", 2024-09-17T03:39:29.647 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:39:29.647 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:39:29.647 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:39:29.647 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:39:29.647 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.647 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:29.647 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:39:29.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 -- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078b90 msgr2=0x7f79b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078b90 0x7f79b407b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009230 tx=0x7f79c4004730 comp rx=0 tx=0).stop 2024-09-17T03:39:29.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 -- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d40b4f30 msgr2=0x7f79d4073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:29.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d40b4f30 0x7f79d4073210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00c3f0 tx=0x7f79bc00c7f0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 -- 172.21.15.146:0/2116965400 shutdown_connections 2024-09-17T03:39:29.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078b90 0x7f79b407b0a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d41547d0 0x7f79d4073750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d40b4f30 0x7f79d4073210 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 --2- 172.21.15.146:0/2116965400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b3c90 0x7f79d41f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 -- 172.21.15.146:0/2116965400 >> 172.21.15.146:0/2116965400 conn(0x7f79d40b2db0 msgr2=0x7f79d40b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 -- 172.21.15.146:0/2116965400 shutdown_connections 2024-09-17T03:39:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:29.639+0000 7f79d9c07640 1 -- 172.21.15.146:0/2116965400 wait complete. 2024-09-17T03:39:29.651 INFO:tasks.cephfs.filesystem:scrub status for tag:29f8adc9-2fb2-4ea2-be5e-4b93408ae2fe - {'path': '~mds0', 'tag': '29f8adc9-2fb2-4ea2-be5e-4b93408ae2fe', 'options': 'recursive'} 2024-09-17T03:39:58.050 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:39:58.054 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:39:59.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:39:59.652 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T03:39:59.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.780+0000 7f99e7f13640 1 -- 172.21.15.146:0/3016781168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e01620f0 msgr2=0x7f99e006ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.780+0000 7f99e7f13640 1 --2- 172.21.15.146:0/3016781168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e01620f0 0x7f99e006ed30 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009830 tx=0x7f99d002a480 comp rx=0 tx=0).stop 2024-09-17T03:39:59.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.780+0000 7f99e7f13640 1 -- 172.21.15.146:0/3016781168 shutdown_connections 2024-09-17T03:39:59.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.780+0000 7f99e7f13640 1 --2- 172.21.15.146:0/3016781168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e01620f0 0x7f99e006ed30 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.780+0000 7f99e7f13640 1 --2- 172.21.15.146:0/3016781168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e00b3870 0x7f99e00cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.780+0000 7f99e7f13640 1 -- 172.21.15.146:0/3016781168 >> 172.21.15.146:0/3016781168 conn(0x7f99e00d4be0 msgr2=0x7f99e00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.781+0000 7f99e7f13640 1 -- 172.21.15.146:0/3016781168 shutdown_connections 2024-09-17T03:39:59.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.781+0000 7f99e7f13640 1 -- 172.21.15.146:0/3016781168 wait complete. 2024-09-17T03:39:59.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.782+0000 7f99e7f13640 1 Processor -- start 2024-09-17T03:39:59.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.782+0000 7f99e7f13640 1 -- start start 2024-09-17T03:39:59.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e7f13640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e006f270 0x7f99e014cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e7f13640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e00b3870 0x7f99e015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e7f13640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e01620f0 0x7f99e015c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e7f13640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f99e00d43b0 con 0x7f99e006f270 2024-09-17T03:39:59.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e7f13640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99e0162fb0 con 0x7f99e01620f0 2024-09-17T03:39:59.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e7f13640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99e00c8400 con 0x7f99e00b3870 2024-09-17T03:39:59.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e5caf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e006f270 0x7f99e014cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e5caf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e006f270 0x7f99e014cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60878/0 (socket says 172.21.15.146:60878) 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e5caf640 1 -- 172.21.15.146:0/2944811687 learned_addr learned my addr 172.21.15.146:0/2944811687 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e5caf640 1 -- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e00b3870 msgr2=0x7f99e015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e5caf640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e00b3870 0x7f99e015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e5caf640 1 -- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e01620f0 msgr2=0x7f99e015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e5caf640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e01620f0 0x7f99e015c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e5caf640 1 -- 172.21.15.146:0/2944811687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e014d450 con 0x7f99e006f270 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e5caf640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e006f270 0x7f99e014cf10 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00d770 tx=0x7f99dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99d67fc640 1 -- 172.21.15.146:0/2944811687 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc017070 con 0x7f99e006f270 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99d67fc640 1 -- 172.21.15.146:0/2944811687 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99dc009d20 con 0x7f99e006f270 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99d67fc640 1 -- 172.21.15.146:0/2944811687 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0106c0 con 0x7f99e006f270 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.784+0000 7f99e7f13640 1 -- 172.21.15.146:0/2944811687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e00cb170 con 0x7f99e006f270 2024-09-17T03:39:59.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.785+0000 7f99e7f13640 1 -- 172.21.15.146:0/2944811687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e015b560 con 0x7f99e006f270 2024-09-17T03:39:59.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.786+0000 7f99d67fc640 1 -- 172.21.15.146:0/2944811687 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99dc01a070 con 0x7f99e006f270 2024-09-17T03:39:59.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.787+0000 7f99d67fc640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99c4078bc0 0x7f99c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.787+0000 7f99d67fc640 1 -- 172.21.15.146:0/2944811687 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7f99dc09adf0 con 0x7f99e006f270 2024-09-17T03:39:59.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.787+0000 7f99e54ae640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99c4078bc0 0x7f99c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.788+0000 7f99e54ae640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99c4078bc0 0x7f99c407b0d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f99d0034000 tx=0x7f99d00046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.788+0000 7f99eee7f740 1 Processor -- start 2024-09-17T03:39:59.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.788+0000 7f99eee7f740 1 -- start start 2024-09-17T03:39:59.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.789+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543ce390 0x564d547baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.789+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543a54d0 0x564d5478f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.789+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d5478fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.789+0000 7f99eee7f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564d546e8a60 con 0x564d543ad6b0 2024-09-17T03:39:59.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.789+0000 7f99eee7f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564d546d7e90 con 0x564d543a54d0 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.789+0000 7f99eee7f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564d546dbca0 con 0x564d543ce390 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.789+0000 7f99e64b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d5478fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.789+0000 7f99e64b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d5478fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60882/0 (socket says 172.21.15.146:60882) 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.789+0000 7f99e64b0640 1 -- 172.21.15.146:0/2264431583 learned_addr learned my addr 172.21.15.146:0/2264431583 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.789+0000 7f99e5caf640 1 --2- 172.21.15.146:0/2264431583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543ce390 0x564d547baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.789+0000 7f99e54ae640 1 --2- 172.21.15.146:0/2264431583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543a54d0 0x564d5478f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.790+0000 7f99e64b0640 1 -- 172.21.15.146:0/2264431583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543ce390 msgr2=0x564d547baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.790+0000 7f99e64b0640 1 --2- 172.21.15.146:0/2264431583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543ce390 0x564d547baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.790+0000 7f99e64b0640 1 -- 172.21.15.146:0/2264431583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543a54d0 msgr2=0x564d5478f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.790+0000 7f99e64b0640 1 --2- 172.21.15.146:0/2264431583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543a54d0 0x564d5478f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.790+0000 7f99e64b0640 1 -- 172.21.15.146:0/2264431583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d544b07d0 con 0x564d543ad6b0 2024-09-17T03:39:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.790+0000 7f99e54ae640 1 --2- 172.21.15.146:0/2264431583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543a54d0 0x564d5478f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.790+0000 7f99e64b0640 1 --2- 172.21.15.146:0/2264431583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d5478fda0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f99d8001be0 tx=0x7f99d80020a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff120f3079020d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.790+0000 7f99c37fe640 1 -- 172.21.15.146:0/2264431583 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8017070 con 0x564d543ad6b0 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.790+0000 7f99c37fe640 1 -- 172.21.15.146:0/2264431583 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99d8003da0 con 0x564d543ad6b0 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.790+0000 7f99c37fe640 1 -- 172.21.15.146:0/2264431583 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d800c9e0 con 0x564d543ad6b0 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.791+0000 7f99eee7f740 1 -- 172.21.15.146:0/2264431583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 msgr2=0x564d5478fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.791+0000 7f99eee7f740 1 --2- 172.21.15.146:0/2264431583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d5478fda0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f99d8001be0 tx=0x7f99d80020a0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.791+0000 7f99eee7f740 1 -- 172.21.15.146:0/2264431583 shutdown_connections 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.791+0000 7f99eee7f740 1 --2- 172.21.15.146:0/2264431583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d5478fda0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.791+0000 7f99eee7f740 1 --2- 172.21.15.146:0/2264431583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543a54d0 0x564d5478f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.791+0000 7f99eee7f740 1 --2- 172.21.15.146:0/2264431583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543ce390 0x564d547baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.791+0000 7f99eee7f740 1 -- 172.21.15.146:0/2264431583 >> 172.21.15.146:0/2264431583 conn(0x564d543c24e0 msgr2=0x564d54775d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.791+0000 7f99eee7f740 1 -- 172.21.15.146:0/2264431583 shutdown_connections 2024-09-17T03:39:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.791+0000 7f99eee7f740 1 -- 172.21.15.146:0/2264431583 wait complete. 2024-09-17T03:39:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.792+0000 7f99eee7f740 1 -- start start 2024-09-17T03:39:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.792+0000 7f99eee7f740 1 Processor -- start 2024-09-17T03:39:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.793+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543a54d0 0x564d547b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.793+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ad6b0 0x564d547a0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.793+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ce390 0x564d547b6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.793+0000 7f99eee7f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564d54448740 con 0x564d543ce390 2024-09-17T03:39:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.793+0000 7f99eee7f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564d5467d970 con 0x564d543ad6b0 2024-09-17T03:39:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.793+0000 7f99eee7f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564d547b32e0 con 0x564d543a54d0 2024-09-17T03:39:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.793+0000 7f99eee7f740 10 client.0 _ll_register_callbacks cb 0x564d5468c780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.793+0000 7f99e64b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ce390 0x564d547b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.793+0000 7f99e64b0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ce390 0x564d547b6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60890/0 (socket says 172.21.15.146:60890) 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.793+0000 7f99e64b0640 1 -- 172.21.15.146:0/1180397849 learned_addr learned my addr 172.21.15.146:0/1180397849 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99e54ae640 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ad6b0 0x564d547a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99e5caf640 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543a54d0 0x564d547b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99e64b0640 1 -- 172.21.15.146:0/1180397849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543a54d0 msgr2=0x564d547b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99e64b0640 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543a54d0 0x564d547b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99e64b0640 1 -- 172.21.15.146:0/1180397849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ad6b0 msgr2=0x564d547a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99e64b0640 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ad6b0 0x564d547a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99e64b0640 1 -- 172.21.15.146:0/1180397849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d54439970 con 0x564d543ce390 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99e64b0640 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ce390 0x564d547b6530 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f99d8005040 tx=0x7f99d800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ea8a031c6d1b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99c0ff9640 1 -- 172.21.15.146:0/1180397849 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8022070 con 0x564d543ce390 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99c0ff9640 1 -- 172.21.15.146:0/1180397849 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7f99d80050d0 con 0x564d543ce390 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99eee7f740 1 -- 172.21.15.146:0/1180397849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99d8003da0 con 0x564d543ce390 2024-09-17T03:39:59.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99c0ff9640 1 -- 172.21.15.146:0/1180397849 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f99d802d050 con 0x564d543ce390 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99eee7f740 10 client.8031 fetch_fsmap learned FSMap version 78 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99eee7f740 1 -- 172.21.15.146:0/1180397849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x564d544176a0 con 0x564d543ce390 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.794+0000 7f99c0ff9640 1 -- 172.21.15.146:0/1180397849 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99d8003da0 con 0x564d543ce390 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.795+0000 7f99c0ff9640 1 -- 172.21.15.146:0/1180397849 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7f99d80052d0 con 0x564d543ce390 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.795+0000 7f99eee7f740 10 client.8031 fetch_fsmap finished waiting for FSMap version 78 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.795+0000 7f99eee7f740 10 client.8031 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.795+0000 7f99eee7f740 20 client.8031 populate_metadata read hostname 'smithi146' 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.795+0000 7f99eee7f740 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x564d5438cf60 0x564d547b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.795+0000 7f99eee7f740 4 client.8031 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.795+0000 7f99eee7f740 1 -- 172.21.15.146:0/1180397849 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d546ea9b0 con 0x564d5438cf60 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.795+0000 7f99e5caf640 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x564d5438cf60 0x564d547b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.795+0000 7f99c0ff9640 10 client.8031 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.795+0000 7f99e5caf640 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x564d5438cf60 0x564d547b6a70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25a45fca7e88f9f2 server_cookie=9ab23c94ec882c4b in_seq=0 out_seq=0 2024-09-17T03:39:59.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99c0ff9640 1 -- 172.21.15.146:0/1180397849 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d546ea9b0 con 0x564d5438cf60 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99c0ff9640 10 client.8031 handle_command_reply: tid=0 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 1 client.8031 shutdown 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 1 -- 172.21.15.146:0/1180397849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ce390 msgr2=0x564d547b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ce390 0x564d547b6530 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f99d8005040 tx=0x7f99d800cb60 comp rx=0 tx=0).stop 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 1 -- 172.21.15.146:0/1180397849 shutdown_connections 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x564d5438cf60 0x564d547b6a70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ce390 0x564d547b6530 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ad6b0 0x564d547a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99c0ff9640 0 client.8031 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 1 --2- 172.21.15.146:0/1180397849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543a54d0 0x564d547b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 1 -- 172.21.15.146:0/1180397849 >> 172.21.15.146:0/1180397849 conn(0x564d543c24e0 msgr2=0x564d547bb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 1 -- 172.21.15.146:0/1180397849 shutdown_connections 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 1 -- 172.21.15.146:0/1180397849 wait complete. 2024-09-17T03:39:59.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.796+0000 7f99eee7f740 20 client.8031 trim_cache size 0 max 16384 2024-09-17T03:39:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.814+0000 7f99eee7f740 1 Processor -- start 2024-09-17T03:39:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.814+0000 7f99eee7f740 1 -- start start 2024-09-17T03:39:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.815+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543a54d0 0x564d547b7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.815+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d547b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.815+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ce390 0x564d547b1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.815+0000 7f99eee7f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f99e0202460 con 0x564d543ad6b0 2024-09-17T03:39:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.815+0000 7f99eee7f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99e01fa250 con 0x564d543ce390 2024-09-17T03:39:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.815+0000 7f99eee7f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99e01f95b0 con 0x564d543a54d0 2024-09-17T03:39:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.815+0000 7f99e54ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d547b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.815+0000 7f99e54ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d547b78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60904/0 (socket says 172.21.15.146:60904) 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.815+0000 7f99e54ae640 1 -- 172.21.15.146:0/1075370767 learned_addr learned my addr 172.21.15.146:0/1075370767 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99e64b0640 1 --2- 172.21.15.146:0/1075370767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ce390 0x564d547b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99e54ae640 1 -- 172.21.15.146:0/1075370767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543a54d0 msgr2=0x564d547b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99e5caf640 1 --2- 172.21.15.146:0/1075370767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543a54d0 0x564d547b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99e54ae640 1 --2- 172.21.15.146:0/1075370767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543a54d0 0x564d547b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99e54ae640 1 -- 172.21.15.146:0/1075370767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ce390 msgr2=0x564d547b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99e54ae640 1 --2- 172.21.15.146:0/1075370767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ce390 0x564d547b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99e54ae640 1 -- 172.21.15.146:0/1075370767 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d547c4260 con 0x564d543ad6b0 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99e64b0640 1 --2- 172.21.15.146:0/1075370767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ce390 0x564d547b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99e5caf640 1 --2- 172.21.15.146:0/1075370767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543a54d0 0x564d547b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99e54ae640 1 --2- 172.21.15.146:0/1075370767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d547b78a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009950 tx=0x7f99d003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c42fcacf2e2dda server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99c2ffd640 1 -- 172.21.15.146:0/1075370767 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d00039f0 con 0x564d543ad6b0 2024-09-17T03:39:59.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99c2ffd640 1 -- 172.21.15.146:0/1075370767 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99d0003c80 con 0x564d543ad6b0 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.816+0000 7f99c2ffd640 1 -- 172.21.15.146:0/1075370767 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0052440 con 0x564d543ad6b0 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.817+0000 7f99eee7f740 1 -- 172.21.15.146:0/1075370767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 msgr2=0x564d547b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.817+0000 7f99eee7f740 1 --2- 172.21.15.146:0/1075370767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d547b78a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009950 tx=0x7f99d003c000 comp rx=0 tx=0).stop 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.817+0000 7f99eee7f740 1 -- 172.21.15.146:0/1075370767 shutdown_connections 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.817+0000 7f99eee7f740 1 --2- 172.21.15.146:0/1075370767 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ce390 0x564d547b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.817+0000 7f99eee7f740 1 --2- 172.21.15.146:0/1075370767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543ad6b0 0x564d547b78a0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.817+0000 7f99eee7f740 1 --2- 172.21.15.146:0/1075370767 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543a54d0 0x564d547b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.817+0000 7f99eee7f740 1 -- 172.21.15.146:0/1075370767 >> 172.21.15.146:0/1075370767 conn(0x564d543c24e0 msgr2=0x564d5479e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.817+0000 7f99eee7f740 1 -- 172.21.15.146:0/1075370767 shutdown_connections 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.817+0000 7f99eee7f740 1 -- 172.21.15.146:0/1075370767 wait complete. 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.818+0000 7f99eee7f740 1 -- start start 2024-09-17T03:39:59.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.818+0000 7f99eee7f740 1 Processor -- start 2024-09-17T03:39:59.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.819+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543a54d0 0x564d54823510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.819+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ad6b0 0x564d547b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.819+0000 7f99eee7f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543ce390 0x564d5483a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.819+0000 7f99eee7f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564d5478eaf0 con 0x564d543a54d0 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.819+0000 7f99eee7f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99e01f9c00 con 0x564d543ad6b0 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.819+0000 7f99eee7f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564d547c7690 con 0x564d543ce390 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.819+0000 7f99eee7f740 10 client.0 _ll_register_callbacks cb 0x7f99d8015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.819+0000 7f99e5caf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543a54d0 0x564d54823510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.819+0000 7f99e5caf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543a54d0 0x564d54823510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60912/0 (socket says 172.21.15.146:60912) 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.819+0000 7f99e5caf640 1 -- 172.21.15.146:0/263173453 learned_addr learned my addr 172.21.15.146:0/263173453 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99e54ae640 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ad6b0 0x564d547b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99e64b0640 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543ce390 0x564d5483a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99e5caf640 1 -- 172.21.15.146:0/263173453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543ce390 msgr2=0x564d5483a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99e5caf640 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543ce390 0x564d5483a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99e5caf640 1 -- 172.21.15.146:0/263173453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ad6b0 msgr2=0x564d547b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99e5caf640 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ad6b0 0x564d547b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99e5caf640 1 -- 172.21.15.146:0/263173453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d5483e080 con 0x564d543a54d0 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99e64b0640 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543ce390 0x564d5483a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99e5caf640 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543a54d0 0x564d54823510 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f99dc05fe10 tx=0x7f99dc05ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480c7ec7387dcb06 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99c0ff9640 1 -- 172.21.15.146:0/263173453 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc021040 con 0x564d543a54d0 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99c0ff9640 1 -- 172.21.15.146:0/263173453 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7f99dc04bbb0 con 0x564d543a54d0 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99eee7f740 1 -- 172.21.15.146:0/263173453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99d0003c80 con 0x564d543a54d0 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99c0ff9640 1 -- 172.21.15.146:0/263173453 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f99dc062ba0 con 0x564d543a54d0 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99eee7f740 10 client.8037 fetch_fsmap learned FSMap version 78 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99eee7f740 1 -- 172.21.15.146:0/263173453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x564d547b28f0 con 0x564d543a54d0 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99c0ff9640 1 -- 172.21.15.146:0/263173453 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99d0003c80 con 0x564d543a54d0 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99c0ff9640 1 -- 172.21.15.146:0/263173453 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7f99dc067190 con 0x564d543a54d0 2024-09-17T03:39:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99eee7f740 10 client.8037 fetch_fsmap finished waiting for FSMap version 78 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99eee7f740 10 client.8037 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99eee7f740 20 client.8037 populate_metadata read hostname 'smithi146' 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99eee7f740 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x564d54770b70 0x564d5478f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99eee7f740 4 client.8037 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.820+0000 7f99eee7f740 1 -- 172.21.15.146:0/263173453 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564d546e6460 con 0x564d54770b70 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99e54ae640 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x564d54770b70 0x564d5478f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99c0ff9640 10 client.8037 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99e54ae640 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x564d54770b70 0x564d5478f6b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=632bb2de072afc24 server_cookie=17b2fc6f70ea60b1 in_seq=0 out_seq=0 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99c0ff9640 1 -- 172.21.15.146:0/263173453 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+380 (crc 0 0 0) 0x564d546e6460 con 0x564d54770b70 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99c0ff9640 10 client.8037 handle_command_reply: tid=0 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99eee7f740 1 client.8037 shutdown 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99eee7f740 1 -- 172.21.15.146:0/263173453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543a54d0 msgr2=0x564d54823510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99eee7f740 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543a54d0 0x564d54823510 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f99dc05fe10 tx=0x7f99dc05ea40 comp rx=0 tx=0).stop 2024-09-17T03:39:59.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99eee7f740 1 -- 172.21.15.146:0/263173453 shutdown_connections 2024-09-17T03:39:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99eee7f740 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564d543ce390 0x564d5483a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99eee7f740 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564d543ad6b0 0x564d547b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99eee7f740 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x564d54770b70 0x564d5478f6b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99eee7f740 1 --2- 172.21.15.146:0/263173453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d543a54d0 0x564d54823510 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99eee7f740 1 -- 172.21.15.146:0/263173453 >> 172.21.15.146:0/263173453 conn(0x564d543c24e0 msgr2=0x564d547b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.821+0000 7f99c0ff9640 0 client.8037 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99eee7f740 1 -- 172.21.15.146:0/263173453 shutdown_connections 2024-09-17T03:39:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99eee7f740 1 -- 172.21.15.146:0/263173453 wait complete. 2024-09-17T03:39:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99eee7f740 20 client.8037 trim_cache size 0 max 16384 2024-09-17T03:39:59.827 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {}, 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "29f8adc9-2fb2-4ea2-be5e-4b93408ae2fe": { 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:39:29.414726+0000", 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "~mdsdir", 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:39:59.828 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:39:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 -- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99c4078bc0 msgr2=0x7f99c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99c4078bc0 0x7f99c407b0d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f99d0034000 tx=0x7f99d00046c0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 -- 172.21.15.146:0/2944811687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e006f270 msgr2=0x7f99e014cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e006f270 0x7f99e014cf10 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00d770 tx=0x7f99dc00dc30 comp rx=0 tx=0).stop 2024-09-17T03:39:59.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 -- 172.21.15.146:0/2944811687 shutdown_connections 2024-09-17T03:39:59.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99c4078bc0 0x7f99c407b0d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99e01620f0 0x7f99e015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99e00b3870 0x7f99e015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 --2- 172.21.15.146:0/2944811687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e006f270 0x7f99e014cf10 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 -- 172.21.15.146:0/2944811687 >> 172.21.15.146:0/2944811687 conn(0x7f99e00d4be0 msgr2=0x7f99e00b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 -- 172.21.15.146:0/2944811687 shutdown_connections 2024-09-17T03:39:59.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.822+0000 7f99e7f13640 1 -- 172.21.15.146:0/2944811687 wait complete. 2024-09-17T03:39:59.832 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:39:59.832 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-17T03:39:59.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.949+0000 7fb1da541640 1 -- 172.21.15.146:0/3415635113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1d41620f0 msgr2=0x7fb1d406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.949+0000 7fb1da541640 1 --2- 172.21.15.146:0/3415635113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1d41620f0 0x7fb1d406ed30 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40b73c0 tx=0x7fb1c802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.949+0000 7fb1da541640 1 -- 172.21.15.146:0/3415635113 shutdown_connections 2024-09-17T03:39:59.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.949+0000 7fb1da541640 1 --2- 172.21.15.146:0/3415635113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1d41620f0 0x7fb1d406ed30 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.949+0000 7fb1da541640 1 --2- 172.21.15.146:0/3415635113 >> v2:172.21.15.179:3300/0 conn(0x7fb1d40b3870 0x7fb1d40cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.949+0000 7fb1da541640 1 -- 172.21.15.146:0/3415635113 >> 172.21.15.146:0/3415635113 conn(0x7fb1d40d4be0 msgr2=0x7fb1d40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.949+0000 7fb1da541640 1 -- 172.21.15.146:0/3415635113 shutdown_connections 2024-09-17T03:39:59.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.949+0000 7fb1da541640 1 -- 172.21.15.146:0/3415635113 wait complete. 2024-09-17T03:39:59.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.951+0000 7fb1da541640 1 Processor -- start 2024-09-17T03:39:59.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.951+0000 7fb1da541640 1 -- start start 2024-09-17T03:39:59.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.952+0000 7fb1da541640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d406f270 0x7fb1d40ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.952+0000 7fb1da541640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1d40b3870 0x7fb1d4157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.952+0000 7fb1da541640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1d41620f0 0x7fb1d415a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.952+0000 7fb1da541640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d4162670 con 0x7fb1d40b3870 2024-09-17T03:39:59.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.952+0000 7fb1da541640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d40d43b0 con 0x7fb1d406f270 2024-09-17T03:39:59.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.952+0000 7fb1da541640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d4162fb0 con 0x7fb1d41620f0 2024-09-17T03:39:59.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.952+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1d40b3870 0x7fb1d4157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.952+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1d40b3870 0x7fb1d4157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60926/0 (socket says 172.21.15.146:60926) 2024-09-17T03:39:59.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.952+0000 7fb1d37fe640 1 -- 172.21.15.146:0/3752459633 learned_addr learned my addr 172.21.15.146:0/3752459633 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:59.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d406f270 0x7fb1d40ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1d8ade640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1d41620f0 0x7fb1d415a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1d37fe640 1 -- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1d41620f0 msgr2=0x7fb1d415a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1d37fe640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1d41620f0 0x7fb1d415a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1d37fe640 1 -- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d406f270 msgr2=0x7fb1d40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1d37fe640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d406f270 0x7fb1d40ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1d37fe640 1 -- 172.21.15.146:0/3752459633 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d4158a50 con 0x7fb1d40b3870 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1d37fe640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1d40b3870 0x7fb1d4157990 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009780 tx=0x7fb1c8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1d0ff9640 1 -- 172.21.15.146:0/3752459633 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8031d60 con 0x7fb1d40b3870 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1d0ff9640 1 -- 172.21.15.146:0/3752459633 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1c8033e10 con 0x7fb1d40b3870 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1da541640 1 -- 172.21.15.146:0/3752459633 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d4158d30 con 0x7fb1d40b3870 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1d0ff9640 1 -- 172.21.15.146:0/3752459633 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8005260 con 0x7fb1d40b3870 2024-09-17T03:39:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.953+0000 7fb1da541640 1 -- 172.21.15.146:0/3752459633 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d41592f0 con 0x7fb1d40b3870 2024-09-17T03:39:59.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.956+0000 7fb1d0ff9640 1 -- 172.21.15.146:0/3752459633 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1c8005400 con 0x7fb1d40b3870 2024-09-17T03:39:59.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.956+0000 7fb1d0ff9640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 0x7fb1c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.956+0000 7fb1d0ff9640 1 -- 172.21.15.146:0/3752459633 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7fb1c80bbde0 con 0x7fb1d40b3870 2024-09-17T03:39:59.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.956+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 0x7fb1c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.957+0000 7fb1e14ae740 1 Processor -- start 2024-09-17T03:39:59.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.957+0000 7fb1e14ae740 1 -- start start 2024-09-17T03:39:59.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.957+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 0x7fb1c007b0a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400bb50 tx=0x7fb1c400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858e9390 0x55c485cd8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485cbafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cbb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c485c03bd0 con 0x55c4858c86b0 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c485bf3000 con 0x55c4858c04d0 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c485bf6e10 con 0x55c4858e9390 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d8ade640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cbb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d8ade640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cbb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60938/0 (socket says 172.21.15.146:60938) 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d8ade640 1 -- 172.21.15.146:0/4155120104 learned_addr learned my addr 172.21.15.146:0/4155120104 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d37fe640 1 --2- 172.21.15.146:0/4155120104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485cbafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/4155120104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858e9390 0x55c485cd8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d8ade640 1 -- 172.21.15.146:0/4155120104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858e9390 msgr2=0x55c485cd8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d8ade640 1 --2- 172.21.15.146:0/4155120104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858e9390 0x55c485cd8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d8ade640 1 -- 172.21.15.146:0/4155120104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 msgr2=0x55c485cbafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d8ade640 1 --2- 172.21.15.146:0/4155120104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485cbafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d8ade640 1 -- 172.21.15.146:0/4155120104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4859cb7d0 con 0x55c4858c86b0 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/4155120104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858e9390 0x55c485cd8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.958+0000 7fb1d8ade640 1 --2- 172.21.15.146:0/4155120104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cbb520 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00f200 tx=0x7fb1cc00f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906348f08b0886ab server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.959+0000 7fb1b9ffb640 1 -- 172.21.15.146:0/4155120104 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc018020 con 0x55c4858c86b0 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.959+0000 7fb1b9ffb640 1 -- 172.21.15.146:0/4155120104 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1cc014680 con 0x55c4858c86b0 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.959+0000 7fb1b9ffb640 1 -- 172.21.15.146:0/4155120104 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc014a90 con 0x55c4858c86b0 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.959+0000 7fb1e14ae740 1 -- 172.21.15.146:0/4155120104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 msgr2=0x55c485cbb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.959+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/4155120104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cbb520 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00f200 tx=0x7fb1cc00f6c0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.959+0000 7fb1e14ae740 1 -- 172.21.15.146:0/4155120104 shutdown_connections 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.959+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/4155120104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cbb520 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.959+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/4155120104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485cbafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.959+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/4155120104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858e9390 0x55c485cd8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.959+0000 7fb1e14ae740 1 -- 172.21.15.146:0/4155120104 >> 172.21.15.146:0/4155120104 conn(0x55c4858dd4e0 msgr2=0x55c485c91200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.960+0000 7fb1e14ae740 1 -- 172.21.15.146:0/4155120104 shutdown_connections 2024-09-17T03:39:59.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.960+0000 7fb1e14ae740 1 -- 172.21.15.146:0/4155120104 wait complete. 2024-09-17T03:39:59.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.960+0000 7fb1e14ae740 1 -- start start 2024-09-17T03:39:59.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.961+0000 7fb1e14ae740 1 Processor -- start 2024-09-17T03:39:59.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485ccd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cd03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858e9390 0x55c485ce4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c485963740 con 0x55c4858c86b0 2024-09-17T03:39:59.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c485b98540 con 0x55c4858c04d0 2024-09-17T03:39:59.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c485cd0ea0 con 0x55c4858e9390 2024-09-17T03:39:59.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1e14ae740 10 client.0 _ll_register_callbacks cb 0x55c485b970e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cd03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cd03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60952/0 (socket says 172.21.15.146:60952) 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1d37fe640 1 -- 172.21.15.146:0/2565114683 learned_addr learned my addr 172.21.15.146:0/2565114683 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485ccd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1d8ade640 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858e9390 0x55c485ce4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1d37fe640 1 -- 172.21.15.146:0/2565114683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858e9390 msgr2=0x55c485ce4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1d37fe640 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858e9390 0x55c485ce4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1d37fe640 1 -- 172.21.15.146:0/2565114683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 msgr2=0x55c485ccd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1d37fe640 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485ccd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1d37fe640 1 -- 172.21.15.146:0/2565114683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4859326a0 con 0x55c4858c86b0 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1d37fe640 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cd03b0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8005820 tx=0x7fb1c8084230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4720fc0670817cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.962+0000 7fb1b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:39:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/2565114683 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8048070 con 0x55c4858c86b0 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/2565114683 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7fb1c806f170 con 0x55c4858c86b0 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1e14ae740 1 -- 172.21.15.146:0/2565114683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1cc014680 con 0x55c4858c86b0 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/2565114683 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fb1c8083440 con 0x55c4858c86b0 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1e14ae740 10 client.8052 fetch_fsmap learned FSMap version 78 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1e14ae740 1 -- 172.21.15.146:0/2565114683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x55c485a2bf60 con 0x55c4858c86b0 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/2565114683 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1cc014680 con 0x55c4858c86b0 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/2565114683 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7fb1c8082f30 con 0x55c4858c86b0 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1e14ae740 10 client.8052 fetch_fsmap finished waiting for FSMap version 78 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1e14ae740 10 client.8052 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1e14ae740 20 client.8052 populate_metadata read hostname 'smithi146' 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c4858a7f60 0x55c485ccf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1e14ae740 4 client.8052 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1e14ae740 1 -- 172.21.15.146:0/2565114683 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c485c05b20 con 0x55c4858a7f60 2024-09-17T03:39:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.963+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c4858a7f60 0x55c485ccf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.964+0000 7fb1b2ffd640 10 client.8052 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.964+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c4858a7f60 0x55c485ccf6c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dff05303b5f6815a server_cookie=9e4b7a24e154ab9c in_seq=0 out_seq=0 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.964+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/2565114683 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c485c05b20 con 0x55c4858a7f60 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.964+0000 7fb1b2ffd640 10 client.8052 handle_command_reply: tid=0 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.964+0000 7fb1e14ae740 1 client.8052 shutdown 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1e14ae740 1 -- 172.21.15.146:0/2565114683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 msgr2=0x55c485cd03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cd03b0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8005820 tx=0x7fb1c8084230 comp rx=0 tx=0).stop 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1e14ae740 1 -- 172.21.15.146:0/2565114683 shutdown_connections 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858e9390 0x55c485ce4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c4858a7f60 0x55c485ccf6c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485cd03b0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/2565114683 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485ccd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1b2ffd640 0 client.8052 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:59.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1e14ae740 1 -- 172.21.15.146:0/2565114683 >> 172.21.15.146:0/2565114683 conn(0x55c4858dd4e0 msgr2=0x55c485cb7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1e14ae740 1 -- 172.21.15.146:0/2565114683 shutdown_connections 2024-09-17T03:39:59.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1e14ae740 1 -- 172.21.15.146:0/2565114683 wait complete. 2024-09-17T03:39:59.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.965+0000 7fb1e14ae740 20 client.8052 trim_cache size 0 max 16384 2024-09-17T03:39:59.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.981+0000 7fb1e14ae740 1 Processor -- start 2024-09-17T03:39:59.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.981+0000 7fb1e14ae740 1 -- start start 2024-09-17T03:39:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.982+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485cd9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.982+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858c86b0 0x55c485cd9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.982+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858e9390 0x55c485cf8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.982+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c485caa550 con 0x55c4858e9390 2024-09-17T03:39:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.982+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d4202400 con 0x55c4858c04d0 2024-09-17T03:39:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.982+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d41fa140 con 0x55c4858c86b0 2024-09-17T03:39:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.982+0000 7fb1d8ade640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858e9390 0x55c485cf8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.982+0000 7fb1d8ade640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858e9390 0x55c485cf8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60964/0 (socket says 172.21.15.146:60964) 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.982+0000 7fb1d8ade640 1 -- 172.21.15.146:0/437586252 learned_addr learned my addr 172.21.15.146:0/437586252 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.982+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/437586252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485cd9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.982+0000 7fb1d37fe640 1 --2- 172.21.15.146:0/437586252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858c86b0 0x55c485cd9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.983+0000 7fb1d8ade640 1 -- 172.21.15.146:0/437586252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858c86b0 msgr2=0x55c485cd9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.983+0000 7fb1d8ade640 1 --2- 172.21.15.146:0/437586252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858c86b0 0x55c485cd9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.983+0000 7fb1d8ade640 1 -- 172.21.15.146:0/437586252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 msgr2=0x55c485cd9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.983+0000 7fb1d8ade640 1 --2- 172.21.15.146:0/437586252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485cd9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.983+0000 7fb1d8ade640 1 -- 172.21.15.146:0/437586252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c485cd0720 con 0x55c4858e9390 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.983+0000 7fb1d8ade640 1 --2- 172.21.15.146:0/437586252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858e9390 0x55c485cf8b30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc016000 tx=0x7fb1cc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327a30b91e41778d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.983+0000 7fb1b97fa640 1 -- 172.21.15.146:0/437586252 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc018040 con 0x55c4858e9390 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.983+0000 7fb1b97fa640 1 -- 172.21.15.146:0/437586252 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1cc014a30 con 0x55c4858e9390 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.983+0000 7fb1b97fa640 1 -- 172.21.15.146:0/437586252 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc026440 con 0x55c4858e9390 2024-09-17T03:39:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.984+0000 7fb1e14ae740 1 -- 172.21.15.146:0/437586252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858e9390 msgr2=0x55c485cf8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.984+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/437586252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858e9390 0x55c485cf8b30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc016000 tx=0x7fb1cc001250 comp rx=0 tx=0).stop 2024-09-17T03:39:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.984+0000 7fb1e14ae740 1 -- 172.21.15.146:0/437586252 shutdown_connections 2024-09-17T03:39:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.984+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/437586252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858e9390 0x55c485cf8b30 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.984+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/437586252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858c86b0 0x55c485cd9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.984+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/437586252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858c04d0 0x55c485cd9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.984+0000 7fb1e14ae740 1 -- 172.21.15.146:0/437586252 >> 172.21.15.146:0/437586252 conn(0x55c4858dd4e0 msgr2=0x55c485cbafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.984+0000 7fb1e14ae740 1 -- 172.21.15.146:0/437586252 shutdown_connections 2024-09-17T03:39:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.984+0000 7fb1e14ae740 1 -- 172.21.15.146:0/437586252 wait complete. 2024-09-17T03:39:59.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.984+0000 7fb1e14ae740 1 -- start start 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.985+0000 7fb1e14ae740 1 Processor -- start 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858c04d0 0x55c485ca8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485d56710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1e14ae740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858e9390 0x55c485ccd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d41f9af0 con 0x55c4858c86b0 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d40c87d0 con 0x55c4858e9390 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1e14ae740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c485963740 con 0x55c4858c04d0 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1e14ae740 10 client.0 _ll_register_callbacks cb 0x7fb1c8084f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485d56710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485d56710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60980/0 (socket says 172.21.15.146:60980) 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1d37fe640 1 -- 172.21.15.146:0/900582411 learned_addr learned my addr 172.21.15.146:0/900582411 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858c04d0 0x55c485ca8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1d8ade640 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858e9390 0x55c485ccd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1d37fe640 1 -- 172.21.15.146:0/900582411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858c04d0 msgr2=0x55c485ca8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1d37fe640 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858c04d0 0x55c485ca8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1d37fe640 1 -- 172.21.15.146:0/900582411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858e9390 msgr2=0x55c485ccd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1d37fe640 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858e9390 0x55c485ccd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.986+0000 7fb1d37fe640 1 -- 172.21.15.146:0/900582411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4859c9ad0 con 0x55c4858c86b0 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1d37fe640 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485d56710 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fb1c807fd80 tx=0x7fb1c8080390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2a29e2aba059bf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/900582411 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8048040 con 0x55c4858c86b0 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/900582411 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7fb1c8088190 con 0x55c4858c86b0 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1e14ae740 1 -- 172.21.15.146:0/900582411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1cc014a30 con 0x55c4858c86b0 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/900582411 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fb1c807fb70 con 0x55c4858c86b0 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1e14ae740 10 client.8058 fetch_fsmap learned FSMap version 78 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1e14ae740 1 -- 172.21.15.146:0/900582411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) -- 0x55c485c8f3d0 con 0x55c4858c86b0 2024-09-17T03:39:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/900582411 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1cc014a30 con 0x55c4858c86b0 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/900582411 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 78) ==== 3502+0+0 (secure 0 0 0) 0x7fb1c807f620 con 0x55c4858c86b0 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1e14ae740 10 client.8058 fetch_fsmap finished waiting for FSMap version 78 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1e14ae740 10 client.8058 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1e14ae740 20 client.8058 populate_metadata read hostname 'smithi146' 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c485c8c420 0x55c485ccde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1e14ae740 4 client.8058 mds_command: new command op to 7770 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1e14ae740 1 -- 172.21.15.146:0/900582411 --> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55c485c015d0 con 0x55c485c8c420 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.987+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c485c8c420 0x55c485ccde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1b2ffd640 10 client.8058 ms_handle_connect on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1d3fff640 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c485c8c420 0x55c485ccde90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39b51937da41b0ae server_cookie=5e9d039b323d0519 in_seq=0 out_seq=0 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1b2ffd640 1 -- 172.21.15.146:0/900582411 <== mds.0 v2:172.21.15.146:6832/682941374 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18097 (crc 0 0 0) 0x55c485c015d0 con 0x55c485c8c420 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1b2ffd640 10 client.8058 handle_command_reply: tid=0 2024-09-17T03:39:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1e14ae740 1 client.8058 shutdown 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1e14ae740 1 -- 172.21.15.146:0/900582411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 msgr2=0x55c485d56710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485d56710 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fb1c807fd80 tx=0x7fb1c8080390 comp rx=0 tx=0).stop 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1e14ae740 1 -- 172.21.15.146:0/900582411 shutdown_connections 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4858e9390 0x55c485ccd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.146:6832/682941374,v1:172.21.15.146:6834/682941374] conn(0x55c485c8c420 0x55c485ccde90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4858c86b0 0x55c485d56710 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1e14ae740 1 --2- 172.21.15.146:0/900582411 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4858c04d0 0x55c485ca8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1b2ffd640 0 client.8058 ms_handle_reset on v2:172.21.15.146:6832/682941374 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1e14ae740 1 -- 172.21.15.146:0/900582411 >> 172.21.15.146:0/900582411 conn(0x55c4858dd4e0 msgr2=0x55c485caaa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.988+0000 7fb1e14ae740 1 -- 172.21.15.146:0/900582411 shutdown_connections 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1e14ae740 1 -- 172.21.15.146:0/900582411 wait complete. 2024-09-17T03:39:59.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1e14ae740 20 client.8058 trim_cache size 0 max 16384 2024-09-17T03:39:59.994 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:39:59.994 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2024-09-17T03:39:59.994 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 3250, 2024-09-17T03:39:59.994 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 3251, 2024-09-17T03:39:59.994 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 815076, 2024-09-17T03:39:59.994 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 29376318, 2024-09-17T03:39:59.994 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 17, 2024-09-17T03:39:59.994 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 6, 2024-09-17T03:39:59.994 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.471644958, 2024-09-17T03:39:59.994 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.227424392, 2024-09-17T03:39:59.994 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.065936182, 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.158419798, 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3250, 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.504921192, 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000155360 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 10, 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000001512, 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000151 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 0 2024-09-17T03:39:59.995 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 28107, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 50462, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 9284330, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 35580717, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 8, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 3.592325887, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 2.876582023, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 1.408340209, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.043322787, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 50460, 2024-09-17T03:39:59.996 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.312280744, 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000026006 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 48899, 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.008815365, 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000180 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 123776 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 4029, 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 4023, 2024-09-17T03:39:59.997 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 1508361, 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 52290219, 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 5, 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.553847110, 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.334009110, 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.085852917, 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.122475870, 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4023, 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.603419336, 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000149992 2024-09-17T03:39:59.998 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_encrypted_bytes": 133920, 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_encrypted_bytes": 27008 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-17T03:39:59.999 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1722, 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 21.130058696, 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.012270649 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3376, 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.354741318, 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000401285 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.000 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 25293, 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 25293, 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 25293, 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 499.213336015, 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.019737213 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_complete": 0, 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch_keys": 0, 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 12, 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2024-09-17T03:40:00.001 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 17908, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 0, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 17908, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 17907, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 0, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 2, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 2, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 2, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 47586, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 47093, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2024-09-17T03:40:00.002 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 86, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 1685, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 1685, 2024-09-17T03:40:00.003 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2024-09-17T03:40:00.004 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2024-09-17T03:40:00.004 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2024-09-17T03:40:00.004 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 11, 2024-09-17T03:40:00.004 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 1, 2024-09-17T03:40:00.004 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 10, 2024-09-17T03:40:00.004 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 1674, 2024-09-17T03:40:00.004 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2024-09-17T03:40:00.004 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 910, 2024-09-17T03:40:00.004 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 4029, 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 3889, 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 3417, 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 59, 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 13975 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update": 0, 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_update_receipt": 0, 2024-09-17T03:40:00.005 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_try_discover": 0, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_send_discover": 0, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_handle_discover": 0, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 0, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 0, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 4173, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 3641, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 2248, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2024-09-17T03:40:00.006 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_path": 0, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_quiesce_inode": 0, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 1, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_succeeded": 0, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_write_failed": 0 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.007 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "evlrg": 0, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 26523, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 0, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 0, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 26523, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 0, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 36, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 0, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 0, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 36, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "segmjr": 4, 2024-09-17T03:40:00.008 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 0, 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 4194304, 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 97510563, 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 0, 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2605, 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 143.404953055, 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.055049886 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 0 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.009 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 14, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 2015, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 2001, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 13, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 13, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 0, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 17908, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 19909, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 2001, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 2, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 8014, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 8012, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 169484, 2024-09-17T03:40:00.010 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 414146560 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 28213, 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 25293, 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 5, 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2000, 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.779984464, 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000889992 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.011 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 30, 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.004565643, 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000152188 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6000, 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 7.807285811, 2024-09-17T03:40:00.012 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001301214 2024-09-17T03:40:00.013 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.013 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2024-09-17T03:40:00.013 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 7001, 2024-09-17T03:40:00.017 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 5.984914268, 2024-09-17T03:40:00.017 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000854865 2024-09-17T03:40:00.017 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.017 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2024-09-17T03:40:00.017 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.018 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000051932, 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000051932 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.019 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.003132618, 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.003132618 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:40:00.020 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.061032584, 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.061032584 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000103172, 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000103172 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8, 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.921110485, 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.240138810 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.021 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2248, 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 461.650785184, 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.205360669 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: "req_snapdiff_latency": { 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.022 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.109348227, 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.109348227 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.023 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000299708, 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000299708 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.024 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.025 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8000, 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 19.890721919, 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002486340 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.026 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 1, 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 0, 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 1, 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 17984, 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 17984, 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 78, 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "mdthresh_evicted": 0 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.027 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2024-09-17T03:40:00.028 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_buffer_items": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_bytes": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_extent_items": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_bytes": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_blob_items": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_shared_blob_items": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2024-09-17T03:40:00.029 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 250473, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 92, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 440, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 5, 2024-09-17T03:40:00.030 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 5416, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 77, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 13058781, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 661678, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2024-09-17T03:40:00.031 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 8205, 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 93977566, 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 37, 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 8205, 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "op_latency": { 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8205, 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 30.903520974, 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.003766425 2024-09-17T03:40:00.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "op_inflight": 0, 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8205, 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 8302 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 8205, 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 1750, 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 6455, 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 0, 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 11, 2024-09-17T03:40:00.033 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 64, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 2668, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 38, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 1641, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 2034, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 1686, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 22, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2024-09-17T03:40:00.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2024-09-17T03:40:00.035 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2024-09-17T03:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2024-09-17T03:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2024-09-17T03:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2024-09-17T03:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2024-09-17T03:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2024-09-17T03:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2024-09-17T03:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2024-09-17T03:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 106, 2024-09-17T03:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2024-09-17T03:40:00.036 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 3, 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 8, 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 8, 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 107, 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 0, 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 31 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 1, 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2024-09-17T03:40:00.037 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 32, 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 32, 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed_ops": 3641, 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 3641, 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:40:00.038 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 35382, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 8850822, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 35382, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 35382, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 8850822, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.039 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 8205, 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 94358435, 2024-09-17T03:40:00.040 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 8205, 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 94358435, 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2024-09-17T03:40:00.041 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 8205, 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 8205, 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 8205, 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 8205, 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2024-09-17T03:40:00.042 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 3641, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 380869, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 3641, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 63, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 380869, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.043 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55f83d6ab380": { 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 26523, 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 93316259, 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 26523, 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 2605, 2024-09-17T03:40:00.044 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 93316259, 2024-09-17T03:40:00.045 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2024-09-17T03:40:00.045 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2024-09-17T03:40:00.045 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2024-09-17T03:40:00.045 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2024-09-17T03:40:00.045 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:00.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:00.045 INFO:teuthology.orchestra.run.smithi146.stdout: "trackedop": { 2024-09-17T03:40:00.045 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_ops_count": 0 2024-09-17T03:40:00.045 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:00.045 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:40:00.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 -- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 msgr2=0x7fb1c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 0x7fb1c007b0a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400bb50 tx=0x7fb1c400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 -- 172.21.15.146:0/3752459633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1d40b3870 msgr2=0x7fb1d4157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1d40b3870 0x7fb1d4157990 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009780 tx=0x7fb1c8033c20 comp rx=0 tx=0).stop 2024-09-17T03:40:00.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 -- 172.21.15.146:0/3752459633 shutdown_connections 2024-09-17T03:40:00.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb1c0078b90 0x7fb1c007b0a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1d41620f0 0x7fb1d415a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1d40b3870 0x7fb1d4157990 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 --2- 172.21.15.146:0/3752459633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d406f270 0x7fb1d40ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 -- 172.21.15.146:0/3752459633 >> 172.21.15.146:0/3752459633 conn(0x7fb1d40d4be0 msgr2=0x7fb1d40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:00.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 -- 172.21.15.146:0/3752459633 shutdown_connections 2024-09-17T03:40:00.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:39:59.989+0000 7fb1da541640 1 -- 172.21.15.146:0/3752459633 wait complete. 2024-09-17T03:40:00.049 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:40:00.049 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:00.092 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:00.140 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:40:00.140 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:00.140 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:40:00.140 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:00.156 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:40:00.156 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:00.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:40:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.366+0000 7f2b8d494640 1 -- 172.21.15.146:0/657993178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8815f1e0 msgr2=0x7f2b881515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.366+0000 7f2b8d494640 1 --2- 172.21.15.146:0/657993178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8815f1e0 0x7f2b881515a0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f2b80005fd0 tx=0x7f2b8002ab40 comp rx=0 tx=0).stop 2024-09-17T03:40:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.366+0000 7f2b8d494640 1 -- 172.21.15.146:0/657993178 shutdown_connections 2024-09-17T03:40:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.366+0000 7f2b8d494640 1 --2- 172.21.15.146:0/657993178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8815f1e0 0x7f2b881515a0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.366+0000 7f2b8d494640 1 -- 172.21.15.146:0/657993178 >> 172.21.15.146:0/657993178 conn(0x7f2b880b2060 msgr2=0x7f2b880b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.366+0000 7f2b8d494640 1 -- 172.21.15.146:0/657993178 shutdown_connections 2024-09-17T03:40:00.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.366+0000 7f2b8d494640 1 -- 172.21.15.146:0/657993178 wait complete. 2024-09-17T03:40:00.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.368+0000 7f2b8d494640 1 Processor -- start 2024-09-17T03:40:00.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.369+0000 7f2b8d494640 1 -- start start 2024-09-17T03:40:00.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b8d494640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b88072df0 0x7f2b8814d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b8d494640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b880b3360 0x7f2b88149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b8d494640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8806e470 0x7f2b8806e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b8d494640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88151e70 con 0x7f2b8806e470 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b8d494640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88151cf0 con 0x7f2b880b3360 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b8d494640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2b88151ff0 con 0x7f2b88072df0 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8806e470 0x7f2b8806e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8806e470 0x7f2b8806e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32768/0 (socket says 172.21.15.146:32768) 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b877fe640 1 -- 172.21.15.146:0/3624104491 learned_addr learned my addr 172.21.15.146:0/3624104491 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b867fc640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b880b3360 0x7f2b88149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b86ffd640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b88072df0 0x7f2b8814d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b877fe640 1 -- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b88072df0 msgr2=0x7f2b8814d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b877fe640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b88072df0 0x7f2b8814d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b877fe640 1 -- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b880b3360 msgr2=0x7f2b88149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b877fe640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b880b3360 0x7f2b88149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b877fe640 1 -- 172.21.15.146:0/3624104491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8806edc0 con 0x7f2b8806e470 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b867fc640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b880b3360 0x7f2b88149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:00.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b86ffd640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b88072df0 0x7f2b8814d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:00.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.370+0000 7f2b877fe640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8806e470 0x7f2b8806e880 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f2b80006010 tx=0x7f2b8002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:00.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.371+0000 7f2b6f7fe640 1 -- 172.21.15.146:0/3624104491 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80044070 con 0x7f2b8806e470 2024-09-17T03:40:00.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.371+0000 7f2b6f7fe640 1 -- 172.21.15.146:0/3624104491 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b80004250 con 0x7f2b8806e470 2024-09-17T03:40:00.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.371+0000 7f2b6f7fe640 1 -- 172.21.15.146:0/3624104491 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b800046a0 con 0x7f2b8806e470 2024-09-17T03:40:00.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.371+0000 7f2b8d494640 1 -- 172.21.15.146:0/3624104491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b881f2760 con 0x7f2b8806e470 2024-09-17T03:40:00.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.371+0000 7f2b8d494640 1 -- 172.21.15.146:0/3624104491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b881f2d20 con 0x7f2b8806e470 2024-09-17T03:40:00.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.372+0000 7f2b8d494640 1 -- 172.21.15.146:0/3624104491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b881515a0 con 0x7f2b8806e470 2024-09-17T03:40:00.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.372+0000 7f2b6f7fe640 1 -- 172.21.15.146:0/3624104491 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b80036400 con 0x7f2b8806e470 2024-09-17T03:40:00.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.373+0000 7f2b6f7fe640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 0x7f2b7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.373+0000 7f2b6f7fe640 1 -- 172.21.15.146:0/3624104491 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7f2b800bb600 con 0x7f2b8806e470 2024-09-17T03:40:00.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.373+0000 7f2b86ffd640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 0x7f2b7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.374+0000 7f2b86ffd640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 0x7f2b7407b0d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2b78007fd0 tx=0x7f2b78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:00.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.377+0000 7f2b6f7fe640 1 -- 172.21.15.146:0/3624104491 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2b8806edc0 con 0x7f2b8806e470 2024-09-17T03:40:00.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.565+0000 7f2b8d494640 1 -- 172.21.15.146:0/3624104491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2b880d08c0 con 0x7f2b8806e470 2024-09-17T03:40:00.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.566+0000 7f2b6f7fe640 1 -- 172.21.15.146:0/3624104491 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v106) ==== 80+0+0 (secure 0 0 0) 0x7f2b80032030 con 0x7f2b8806e470 2024-09-17T03:40:00.565 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:40:00.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 -- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 msgr2=0x7f2b7407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 0x7f2b7407b0d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2b78007fd0 tx=0x7f2b78009040 comp rx=0 tx=0).stop 2024-09-17T03:40:00.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 -- 172.21.15.146:0/3624104491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8806e470 msgr2=0x7f2b8806e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8806e470 0x7f2b8806e880 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f2b80006010 tx=0x7f2b8002c8b0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 -- 172.21.15.146:0/3624104491 shutdown_connections 2024-09-17T03:40:00.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078bc0 0x7f2b7407b0d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b8806e470 0x7f2b8806e880 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b880b3360 0x7f2b88149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 --2- 172.21.15.146:0/3624104491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b88072df0 0x7f2b8814d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 -- 172.21.15.146:0/3624104491 >> 172.21.15.146:0/3624104491 conn(0x7f2b880b2060 msgr2=0x7f2b880d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:00.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 -- 172.21.15.146:0/3624104491 shutdown_connections 2024-09-17T03:40:00.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.568+0000 7f2b8d494640 1 -- 172.21.15.146:0/3624104491 wait complete. 2024-09-17T03:40:00.579 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:40:00.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:00.580 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:00.630 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:40:00.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:00.631 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:40:00.665 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:00.665 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:40:00.665 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:00.682 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:00.682 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:00.682 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:40:00.682 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:00.721 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:40:00.721 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:00.721 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:40:00.721 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:00.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:00.739 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.874+0000 7fa972c15640 1 -- 172.21.15.146:0/3315447782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa95c004db0 msgr2=0x7fa95c005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.874+0000 7fa972c15640 1 --2- 172.21.15.146:0/3315447782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa95c004db0 0x7fa95c005280 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fa964005fd0 tx=0x7fa95c005830 comp rx=0 tx=0).stop 2024-09-17T03:40:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.874+0000 7fa9711b2640 1 -- 172.21.15.146:0/3315447782 reap_dead start 2024-09-17T03:40:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.874+0000 7fa972c15640 1 -- 172.21.15.146:0/3315447782 shutdown_connections 2024-09-17T03:40:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.874+0000 7fa972c15640 1 -- 172.21.15.146:0/3315447782 >> 172.21.15.146:0/3315447782 conn(0x7fa96c0b3150 msgr2=0x7fa96c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.874+0000 7fa972c15640 1 -- 172.21.15.146:0/3315447782 shutdown_connections 2024-09-17T03:40:00.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.874+0000 7fa972c15640 1 -- 172.21.15.146:0/3315447782 wait complete. 2024-09-17T03:40:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.876+0000 7fa972c15640 1 Processor -- start 2024-09-17T03:40:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.876+0000 7fa972c15640 1 -- start start 2024-09-17T03:40:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.877+0000 7fa972c15640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa95c004db0 0x7fa96c144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.877+0000 7fa972c15640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa96c1547f0 0x7fa96c146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.877+0000 7fa972c15640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c147200 0x7fa96c147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.877+0000 7fa972c15640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c0b5290 con 0x7fa96c147200 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.877+0000 7fa972c15640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c0b5110 con 0x7fa95c004db0 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.877+0000 7fa972c15640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa96c0b5410 con 0x7fa96c1547f0 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.877+0000 7fa9711b2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c147200 0x7fa96c147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.877+0000 7fa9711b2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c147200 0x7fa96c147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32786/0 (socket says 172.21.15.146:32786) 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa9711b2640 1 -- 172.21.15.146:0/4258170300 learned_addr learned my addr 172.21.15.146:0/4258170300 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa9709b1640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa95c004db0 0x7fa96c144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa96bfff640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa96c1547f0 0x7fa96c146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa9711b2640 1 -- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa96c1547f0 msgr2=0x7fa96c146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa9711b2640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa96c1547f0 0x7fa96c146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa9711b2640 1 -- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa95c004db0 msgr2=0x7fa96c144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:00.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa9711b2640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa95c004db0 0x7fa96c144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:00.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa9711b2640 1 -- 172.21.15.146:0/4258170300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c1595d0 con 0x7fa96c147200 2024-09-17T03:40:00.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa9711b2640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c147200 0x7fa96c147610 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fa964005fd0 tx=0x7fa96402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:00.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa9697fa640 1 -- 172.21.15.146:0/4258170300 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964031040 con 0x7fa96c147200 2024-09-17T03:40:00.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa9697fa640 1 -- 172.21.15.146:0/4258170300 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa964004b20 con 0x7fa96c147200 2024-09-17T03:40:00.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa972c15640 1 -- 172.21.15.146:0/4258170300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96c159e70 con 0x7fa96c147200 2024-09-17T03:40:00.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa9697fa640 1 -- 172.21.15.146:0/4258170300 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964009b40 con 0x7fa96c147200 2024-09-17T03:40:00.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.878+0000 7fa972c15640 1 -- 172.21.15.146:0/4258170300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa96c1598b0 con 0x7fa96c147200 2024-09-17T03:40:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.879+0000 7fa972c15640 1 -- 172.21.15.146:0/4258170300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa96c0b5680 con 0x7fa96c147200 2024-09-17T03:40:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.880+0000 7fa9697fa640 1 -- 172.21.15.146:0/4258170300 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa964004030 con 0x7fa96c147200 2024-09-17T03:40:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.880+0000 7fa9697fa640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa950078b90 0x7fa95007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:00.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.880+0000 7fa9697fa640 1 -- 172.21.15.146:0/4258170300 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7fa9640baee0 con 0x7fa96c147200 2024-09-17T03:40:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.881+0000 7fa9709b1640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa950078b90 0x7fa95007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:00.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.881+0000 7fa9709b1640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa950078b90 0x7fa95007b0a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa960000c00 tx=0x7fa960006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:00.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:00.885+0000 7fa9697fa640 1 -- 172.21.15.146:0/4258170300 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa964042060 con 0x7fa96c147200 2024-09-17T03:40:01.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.096+0000 7fa972c15640 1 -- 172.21.15.146:0/4258170300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa96c0699f0 con 0x7fa96c147200 2024-09-17T03:40:01.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.097+0000 7fa9697fa640 1 -- 172.21.15.146:0/4258170300 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5225 (secure 0 0 0) 0x7fa964082cb0 con 0x7fa96c147200 2024-09-17T03:40:01.096 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:01.096 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":78,"btime":"2024-09-17T03:38:39:013322+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/351223948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":351223948},{"type":"v1","addr":"172.21.15.146:6835","nonce":351223948}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/985271714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":985271714},{"type":"v1","addr":"172.21.15.179:6835","nonce":985271714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/781824323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":781824323},{"type":"v1","addr":"172.21.15.179:6837","nonce":781824323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T03:38:27.325806+0000","modified":"2024-09-17T03:38:38.576869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7770},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7770":{"gid":7770,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/682941374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":682941374},{"type":"v1","addr":"172.21.15.146:6834","nonce":682941374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7770,"qdb_cluster":[7770]},"id":7}]} 2024-09-17T03:40:01.096 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 78 2024-09-17T03:40:01.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 -- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa950078b90 msgr2=0x7fa95007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa950078b90 0x7fa95007b0a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa960000c00 tx=0x7fa960006b70 comp rx=0 tx=0).stop 2024-09-17T03:40:01.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 -- 172.21.15.146:0/4258170300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c147200 msgr2=0x7fa96c147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c147200 0x7fa96c147610 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fa964005fd0 tx=0x7fa96402bea0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 -- 172.21.15.146:0/4258170300 shutdown_connections 2024-09-17T03:40:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa950078b90 0x7fa95007b0a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa96c147200 0x7fa96c147610 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa96c1547f0 0x7fa96c146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 --2- 172.21.15.146:0/4258170300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa95c004db0 0x7fa96c144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 -- 172.21.15.146:0/4258170300 >> 172.21.15.146:0/4258170300 conn(0x7fa96c0b3150 msgr2=0x7fa96c075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 -- 172.21.15.146:0/4258170300 shutdown_connections 2024-09-17T03:40:01.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.099+0000 7fa972c15640 1 -- 172.21.15.146:0/4258170300 wait complete. 2024-09-17T03:40:01.109 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:01.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.223+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2914924706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb00003a50 msgr2=0x7feb00003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.223+0000 7feb1b4b4640 1 --2- 172.21.15.146:0/2914924706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb00003a50 0x7feb00003ec0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7feb100016c0 tx=0x7feb00005830 comp rx=0 tx=0).stop 2024-09-17T03:40:01.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.223+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2914924706 shutdown_connections 2024-09-17T03:40:01.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.223+0000 7feb1b4b4640 1 --2- 172.21.15.146:0/2914924706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb00003a50 0x7feb00003ec0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.223+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2914924706 >> 172.21.15.146:0/2914924706 conn(0x7feb140b7b20 msgr2=0x7feb1409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:01.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.224+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2914924706 shutdown_connections 2024-09-17T03:40:01.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.224+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2914924706 wait complete. 2024-09-17T03:40:01.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.225+0000 7feb1b4b4640 1 Processor -- start 2024-09-17T03:40:01.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.225+0000 7feb1b4b4640 1 -- start start 2024-09-17T03:40:01.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb1b4b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb00003a50 0x7feb1409fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb1b4b4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb14152830 0x7feb141f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb1b4b4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb141f4ef0 0x7feb141f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb1b4b4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feb140b1320 con 0x7feb00003a50 2024-09-17T03:40:01.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb1b4b4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feb140b3880 con 0x7feb14152830 2024-09-17T03:40:01.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb1b4b4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7feb140b14a0 con 0x7feb141f4ef0 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb19250640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb00003a50 0x7feb1409fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb19250640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb00003a50 0x7feb1409fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32810/0 (socket says 172.21.15.146:32810) 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb19250640 1 -- 172.21.15.146:0/2925206133 learned_addr learned my addr 172.21.15.146:0/2925206133 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb18a4f640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb14152830 0x7feb141f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb19a51640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb141f4ef0 0x7feb141f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb19250640 1 -- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb141f4ef0 msgr2=0x7feb141f6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb19250640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb141f4ef0 0x7feb141f6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb19250640 1 -- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb14152830 msgr2=0x7feb141f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb19250640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb14152830 0x7feb141f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb19250640 1 -- 172.21.15.146:0/2925206133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb14151790 con 0x7feb00003a50 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb18a4f640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb14152830 0x7feb141f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:01.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb19250640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb00003a50 0x7feb1409fc80 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7feb100017e0 tx=0x7feb100063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb09ffb640 1 -- 172.21.15.146:0/2925206133 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10042070 con 0x7feb00003a50 2024-09-17T03:40:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb09ffb640 1 -- 172.21.15.146:0/2925206133 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb10039070 con 0x7feb00003a50 2024-09-17T03:40:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2925206133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb14151a70 con 0x7feb00003a50 2024-09-17T03:40:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.227+0000 7feb09ffb640 1 -- 172.21.15.146:0/2925206133 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10003d90 con 0x7feb00003a50 2024-09-17T03:40:01.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.228+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2925206133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb14152030 con 0x7feb00003a50 2024-09-17T03:40:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.229+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2925206133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb140b20a0 con 0x7feb00003a50 2024-09-17T03:40:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.229+0000 7feb09ffb640 1 -- 172.21.15.146:0/2925206133 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb1003b070 con 0x7feb00003a50 2024-09-17T03:40:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.230+0000 7feb09ffb640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaf8078bc0 0x7feaf807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.230+0000 7feb09ffb640 1 -- 172.21.15.146:0/2925206133 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7feb100ba1e0 con 0x7feb00003a50 2024-09-17T03:40:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.230+0000 7feb18a4f640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaf8078bc0 0x7feaf807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.231+0000 7feb18a4f640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaf8078bc0 0x7feaf807b0d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7feb04005eb0 tx=0x7feb04005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:01.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.234+0000 7feb09ffb640 1 -- 172.21.15.146:0/2925206133 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feb10082040 con 0x7feb00003a50 2024-09-17T03:40:01.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.443+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2925206133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb1415abd0 con 0x7feb00003a50 2024-09-17T03:40:01.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.444+0000 7feb09ffb640 1 -- 172.21.15.146:0/2925206133 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5225 (secure 0 0 0) 0x7feb10086a70 con 0x7feb00003a50 2024-09-17T03:40:01.444 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:01.444 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":78,"btime":"2024-09-17T03:38:39:013322+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/351223948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":351223948},{"type":"v1","addr":"172.21.15.146:6835","nonce":351223948}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/985271714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":985271714},{"type":"v1","addr":"172.21.15.179:6835","nonce":985271714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/781824323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":781824323},{"type":"v1","addr":"172.21.15.179:6837","nonce":781824323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T03:38:27.325806+0000","modified":"2024-09-17T03:38:38.576869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7770},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7770":{"gid":7770,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/682941374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":682941374},{"type":"v1","addr":"172.21.15.146:6834","nonce":682941374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7770,"qdb_cluster":[7770]},"id":7}]} 2024-09-17T03:40:01.444 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 78 2024-09-17T03:40:01.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaf8078bc0 msgr2=0x7feaf807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaf8078bc0 0x7feaf807b0d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7feb04005eb0 tx=0x7feb04005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:01.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2925206133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb00003a50 msgr2=0x7feb1409fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb00003a50 0x7feb1409fc80 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7feb100017e0 tx=0x7feb100063a0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2925206133 shutdown_connections 2024-09-17T03:40:01.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaf8078bc0 0x7feaf807b0d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb141f4ef0 0x7feb141f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb14152830 0x7feb141f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 --2- 172.21.15.146:0/2925206133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb00003a50 0x7feb1409fc80 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2925206133 >> 172.21.15.146:0/2925206133 conn(0x7feb140b7b20 msgr2=0x7feb1415b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:01.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2925206133 shutdown_connections 2024-09-17T03:40:01.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.446+0000 7feb1b4b4640 1 -- 172.21.15.146:0/2925206133 wait complete. 2024-09-17T03:40:01.456 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.571+0000 7f50759e4640 1 -- 172.21.15.146:0/2105103062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5058003a50 msgr2=0x7f5058003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.571+0000 7f50759e4640 1 --2- 172.21.15.146:0/2105103062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5058003a50 0x7f5058003ee0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f5060009b50 tx=0x7f5058005830 comp rx=0 tx=0).stop 2024-09-17T03:40:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.571+0000 7f50759e4640 1 -- 172.21.15.146:0/2105103062 shutdown_connections 2024-09-17T03:40:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.571+0000 7f50759e4640 1 --2- 172.21.15.146:0/2105103062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5058003a50 0x7f5058003ee0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.571+0000 7f50759e4640 1 -- 172.21.15.146:0/2105103062 >> 172.21.15.146:0/2105103062 conn(0x7f50700d4be0 msgr2=0x7f50700d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.571+0000 7f50759e4640 1 -- 172.21.15.146:0/2105103062 shutdown_connections 2024-09-17T03:40:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.571+0000 7f50759e4640 1 -- 172.21.15.146:0/2105103062 wait complete. 2024-09-17T03:40:01.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.573+0000 7f50759e4640 1 Processor -- start 2024-09-17T03:40:01.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.573+0000 7f50759e4640 1 -- start start 2024-09-17T03:40:01.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.574+0000 7f50759e4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5058003a50 0x7f5070160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.574+0000 7f50759e4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f507015f2a0 0x7f5070153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f50759e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f507015c2b0 0x7f507015c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f50759e4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f50700cf810 con 0x7f5058003a50 2024-09-17T03:40:01.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f50759e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f50700cf690 con 0x7f507015c2b0 2024-09-17T03:40:01.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f50759e4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f507006ed30 con 0x7f507015f2a0 2024-09-17T03:40:01.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f506effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5058003a50 0x7f5070160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f506effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5058003a50 0x7f5070160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32818/0 (socket says 172.21.15.146:32818) 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f506effd640 1 -- 172.21.15.146:0/3566230934 learned_addr learned my addr 172.21.15.146:0/3566230934 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f506e7fc640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f507015f2a0 0x7f5070153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f506f7fe640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f507015c2b0 0x7f507015c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f506effd640 1 -- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f507015f2a0 msgr2=0x7f5070153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f506effd640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f507015f2a0 0x7f5070153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f506effd640 1 -- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f507015c2b0 msgr2=0x7f507015c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f506effd640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f507015c2b0 0x7f507015c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f506effd640 1 -- 172.21.15.146:0/3566230934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f507015cc00 con 0x7f5058003a50 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f506effd640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5058003a50 0x7f5070160f30 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f5060009a70 tx=0x7f50600336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f5057fff640 1 -- 172.21.15.146:0/3566230934 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060038040 con 0x7f5058003a50 2024-09-17T03:40:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f5057fff640 1 -- 172.21.15.146:0/3566230934 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5060004230 con 0x7f5058003a50 2024-09-17T03:40:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f50759e4640 1 -- 172.21.15.146:0/3566230934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5070160030 con 0x7f5058003a50 2024-09-17T03:40:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f5057fff640 1 -- 172.21.15.146:0/3566230934 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50600338e0 con 0x7f5058003a50 2024-09-17T03:40:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.575+0000 7f50759e4640 1 -- 172.21.15.146:0/3566230934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50701605f0 con 0x7f5058003a50 2024-09-17T03:40:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.576+0000 7f50759e4640 1 -- 172.21.15.146:0/3566230934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f507006f220 con 0x7f5058003a50 2024-09-17T03:40:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.577+0000 7f5057fff640 1 -- 172.21.15.146:0/3566230934 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f506002b8a0 con 0x7f5058003a50 2024-09-17T03:40:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.577+0000 7f5057fff640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f505c078b90 0x7f505c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.578+0000 7f5057fff640 1 -- 172.21.15.146:0/3566230934 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7f50600bb550 con 0x7f5058003a50 2024-09-17T03:40:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.578+0000 7f506e7fc640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f505c078b90 0x7f505c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.578+0000 7f506e7fc640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f505c078b90 0x7f505c07b0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5064001eb0 tx=0x7f50640016c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:01.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.582+0000 7f5057fff640 1 -- 172.21.15.146:0/3566230934 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f507015cc00 con 0x7f5058003a50 2024-09-17T03:40:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.756+0000 7f50759e4640 1 -- 172.21.15.146:0/3566230934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50700d2bd0 con 0x7f5058003a50 2024-09-17T03:40:01.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.757+0000 7f5057fff640 1 -- 172.21.15.146:0/3566230934 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+16794 (secure 0 0 0) 0x7f5060083970 con 0x7f5058003a50 2024-09-17T03:40:01.757 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:01.757 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":106,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:39:40.318972+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:38:25.075763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:38:26.285571+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:01.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 -- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f505c078b90 msgr2=0x7f505c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f505c078b90 0x7f505c07b0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5064001eb0 tx=0x7f50640016c0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 -- 172.21.15.146:0/3566230934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5058003a50 msgr2=0x7f5070160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5058003a50 0x7f5070160f30 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f5060009a70 tx=0x7f50600336f0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 -- 172.21.15.146:0/3566230934 shutdown_connections 2024-09-17T03:40:01.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f505c078b90 0x7f505c07b0a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f507015c2b0 0x7f507015c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f507015f2a0 0x7f5070153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 --2- 172.21.15.146:0/3566230934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5058003a50 0x7f5070160f30 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 -- 172.21.15.146:0/3566230934 >> 172.21.15.146:0/3566230934 conn(0x7f50700d4be0 msgr2=0x7f50700cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:01.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 -- 172.21.15.146:0/3566230934 shutdown_connections 2024-09-17T03:40:01.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.759+0000 7f50759e4640 1 -- 172.21.15.146:0/3566230934 wait complete. 2024-09-17T03:40:01.770 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:40:01.770 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.883+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/1022211701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9a015c8e0 msgr2=0x7fd9a006f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.883+0000 7fd9a4b6e640 1 --2- 172.21.15.146:0/1022211701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9a015c8e0 0x7fd9a006f580 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fd990005fd0 tx=0x7fd99002a540 comp rx=0 tx=0).stop 2024-09-17T03:40:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.883+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/1022211701 shutdown_connections 2024-09-17T03:40:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.883+0000 7fd9a4b6e640 1 --2- 172.21.15.146:0/1022211701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9a00cdc50 0x7fd9a00b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.883+0000 7fd9a4b6e640 1 --2- 172.21.15.146:0/1022211701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9a015c8e0 0x7fd9a006f580 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.883+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/1022211701 >> 172.21.15.146:0/1022211701 conn(0x7fd9a00b3150 msgr2=0x7fd9a00b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.883+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/1022211701 shutdown_connections 2024-09-17T03:40:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.883+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/1022211701 wait complete. 2024-09-17T03:40:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.885+0000 7fd9a4b6e640 1 Processor -- start 2024-09-17T03:40:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.885+0000 7fd9a4b6e640 1 -- start start 2024-09-17T03:40:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd9a4b6e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9a00cd840 0x7fd9a0157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd9a4b6e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9a00cdc50 0x7fd9a0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd9a4b6e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9a015c8e0 0x7fd9a0156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd9a4b6e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a0073580 con 0x7fd9a015c8e0 2024-09-17T03:40:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd9a4b6e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a00b5460 con 0x7fd9a00cd840 2024-09-17T03:40:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd9a4b6e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd9a0073700 con 0x7fd9a00cdc50 2024-09-17T03:40:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd99ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9a015c8e0 0x7fd9a0156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd99ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9a015c8e0 0x7fd9a0156890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32834/0 (socket says 172.21.15.146:32834) 2024-09-17T03:40:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd99ed9d640 1 -- 172.21.15.146:0/2522063481 learned_addr learned my addr 172.21.15.146:0/2522063481 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd99dd9b640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9a00cdc50 0x7fd9a0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd99e59c640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9a00cd840 0x7fd9a0157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd99ed9d640 1 -- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9a00cdc50 msgr2=0x7fd9a0156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.886+0000 7fd99ed9d640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9a00cdc50 0x7fd9a0156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.887+0000 7fd99ed9d640 1 -- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9a00cd840 msgr2=0x7fd9a0157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.887+0000 7fd99ed9d640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9a00cd840 0x7fd9a0157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.887+0000 7fd99ed9d640 1 -- 172.21.15.146:0/2522063481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a00aac20 con 0x7fd9a015c8e0 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.887+0000 7fd99e59c640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9a00cd840 0x7fd9a0157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.887+0000 7fd99ed9d640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9a015c8e0 0x7fd9a0156890 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fd998007c00 tx=0x7fd99800e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.887+0000 7fd98effd640 1 -- 172.21.15.146:0/2522063481 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd998007e10 con 0x7fd9a015c8e0 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.887+0000 7fd98effd640 1 -- 172.21.15.146:0/2522063481 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd99800c2e0 con 0x7fd9a015c8e0 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.887+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/2522063481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a0158020 con 0x7fd9a015c8e0 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.887+0000 7fd98effd640 1 -- 172.21.15.146:0/2522063481 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99800ed30 con 0x7fd9a015c8e0 2024-09-17T03:40:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.887+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/2522063481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a0143ee0 con 0x7fd9a015c8e0 2024-09-17T03:40:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.888+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/2522063481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a00b2700 con 0x7fd9a015c8e0 2024-09-17T03:40:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.889+0000 7fd98effd640 1 -- 172.21.15.146:0/2522063481 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd99800a440 con 0x7fd9a015c8e0 2024-09-17T03:40:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.889+0000 7fd98effd640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd980078bc0 0x7fd98007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.889+0000 7fd98effd640 1 -- 172.21.15.146:0/2522063481 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7fd99809cf90 con 0x7fd9a015c8e0 2024-09-17T03:40:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.890+0000 7fd99e59c640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd980078bc0 0x7fd98007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.890+0000 7fd99e59c640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd980078bc0 0x7fd98007b0d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd990033000 tx=0x7fd990004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:01.894+0000 7fd98effd640 1 -- 172.21.15.146:0/2522063481 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9a00b2700 con 0x7fd9a015c8e0 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.105+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/2522063481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9a00b4ba0 con 0x7fd9a015c8e0 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.105+0000 7fd98effd640 1 -- 172.21.15.146:0/2522063481 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5225 (secure 0 0 0) 0x7fd998065330 con 0x7fd9a015c8e0 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:02.104 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":78,"btime":"2024-09-17T03:38:39:013322+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/351223948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":351223948},{"type":"v1","addr":"172.21.15.146:6835","nonce":351223948}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/985271714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":985271714},{"type":"v1","addr":"172.21.15.179:6835","nonce":985271714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/781824323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":781824323},{"type":"v1","addr":"172.21.15.179:6837","nonce":781824323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T03:38:27.325806+0000","modified":"2024-09-17T03:38:38.576869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7770},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7770":{"gid":7770,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/682941374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":682941374},{"type":"v1","addr":"172.21.15.146:6834","nonce":682941374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7770,"qdb_cluster":[7770]},"id":7}]} 2024-09-17T03:40:02.105 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 78 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.107+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd980078bc0 msgr2=0x7fd98007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.107+0000 7fd9a4b6e640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd980078bc0 0x7fd98007b0d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd990033000 tx=0x7fd990004730 comp rx=0 tx=0).stop 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.107+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/2522063481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9a015c8e0 msgr2=0x7fd9a0156890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.107+0000 7fd9a4b6e640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9a015c8e0 0x7fd9a0156890 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fd998007c00 tx=0x7fd99800e420 comp rx=0 tx=0).stop 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.108+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/2522063481 shutdown_connections 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.108+0000 7fd9a4b6e640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd980078bc0 0x7fd98007b0d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.108+0000 7fd9a4b6e640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9a015c8e0 0x7fd9a0156890 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.108+0000 7fd9a4b6e640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9a00cdc50 0x7fd9a0156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.108+0000 7fd9a4b6e640 1 --2- 172.21.15.146:0/2522063481 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9a00cd840 0x7fd9a0157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.108+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/2522063481 >> 172.21.15.146:0/2522063481 conn(0x7fd9a00b3150 msgr2=0x7fd9a00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:02.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.108+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/2522063481 shutdown_connections 2024-09-17T03:40:02.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.108+0000 7fd9a4b6e640 1 -- 172.21.15.146:0/2522063481 wait complete. 2024-09-17T03:40:02.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:02.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.233+0000 7f71d7263640 1 -- 172.21.15.146:0/180740101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71b8004d40 msgr2=0x7f71b80051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.233+0000 7f71d7263640 1 --2- 172.21.15.146:0/180740101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71b8004d40 0x7f71b80051f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f71c8005fd0 tx=0x7f71b8005830 comp rx=0 tx=0).stop 2024-09-17T03:40:02.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.233+0000 7f71d5800640 1 -- 172.21.15.146:0/180740101 reap_dead start 2024-09-17T03:40:02.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.233+0000 7f71d7263640 1 -- 172.21.15.146:0/180740101 shutdown_connections 2024-09-17T03:40:02.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.233+0000 7f71d7263640 1 -- 172.21.15.146:0/180740101 >> 172.21.15.146:0/180740101 conn(0x7f71d00b3150 msgr2=0x7f71d00b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:02.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.233+0000 7f71d7263640 1 -- 172.21.15.146:0/180740101 shutdown_connections 2024-09-17T03:40:02.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.233+0000 7f71d7263640 1 -- 172.21.15.146:0/180740101 wait complete. 2024-09-17T03:40:02.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.235+0000 7f71d7263640 1 Processor -- start 2024-09-17T03:40:02.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.235+0000 7f71d7263640 1 -- start start 2024-09-17T03:40:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.236+0000 7f71d7263640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71b8004d40 0x7f71d0144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.236+0000 7f71d7263640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c63c0 0x7f71d0141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.236+0000 7f71d7263640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d01424b0 0x7f71d00af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.236+0000 7f71d7263640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f71d00b5260 con 0x7f71d00c63c0 2024-09-17T03:40:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.236+0000 7f71d7263640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f71d00b50e0 con 0x7f71b8004d40 2024-09-17T03:40:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.236+0000 7f71d7263640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f71d00b53e0 con 0x7f71d01424b0 2024-09-17T03:40:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.236+0000 7f71c7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c63c0 0x7f71d0141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.236+0000 7f71c7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c63c0 0x7f71d0141b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32842/0 (socket says 172.21.15.146:32842) 2024-09-17T03:40:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.236+0000 7f71c7fff640 1 -- 172.21.15.146:0/1060991207 learned_addr learned my addr 172.21.15.146:0/1060991207 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71d5800640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d01424b0 0x7f71d00af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71d4fff640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71b8004d40 0x7f71d0144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71c7fff640 1 -- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d01424b0 msgr2=0x7f71d00af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71c7fff640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d01424b0 0x7f71d00af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71c7fff640 1 -- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71b8004d40 msgr2=0x7f71d0144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71c7fff640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71b8004d40 0x7f71d0144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71c7fff640 1 -- 172.21.15.146:0/1060991207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d00aeaa0 con 0x7f71d00c63c0 2024-09-17T03:40:02.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71d4fff640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71b8004d40 0x7f71d0144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71c7fff640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c63c0 0x7f71d0141b40 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f71c0003ec0 tx=0x7f71c0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71c57fa640 1 -- 172.21.15.146:0/1060991207 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c0015070 con 0x7f71d00c63c0 2024-09-17T03:40:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71c57fa640 1 -- 172.21.15.146:0/1060991207 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71c0011840 con 0x7f71d00c63c0 2024-09-17T03:40:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71c57fa640 1 -- 172.21.15.146:0/1060991207 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c0011cb0 con 0x7f71d00c63c0 2024-09-17T03:40:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71d7263640 1 -- 172.21.15.146:0/1060991207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d00aed80 con 0x7f71d00c63c0 2024-09-17T03:40:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.237+0000 7f71d7263640 1 -- 172.21.15.146:0/1060991207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d00af340 con 0x7f71d00c63c0 2024-09-17T03:40:02.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.238+0000 7f71d7263640 1 -- 172.21.15.146:0/1060991207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d00b5680 con 0x7f71d00c63c0 2024-09-17T03:40:02.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.239+0000 7f71c57fa640 1 -- 172.21.15.146:0/1060991207 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f71c0018070 con 0x7f71d00c63c0 2024-09-17T03:40:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.240+0000 7f71c57fa640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f71bc078bc0 0x7f71bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.240+0000 7f71c57fa640 1 -- 172.21.15.146:0/1060991207 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7f71c009b850 con 0x7f71d00c63c0 2024-09-17T03:40:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.240+0000 7f71d4fff640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f71bc078bc0 0x7f71bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.240+0000 7f71d4fff640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f71bc078bc0 0x7f71bc07b0d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f71cc000fb0 tx=0x7f71cc0067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.244+0000 7f71c57fa640 1 -- 172.21.15.146:0/1060991207 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f71c00636b0 con 0x7f71d00c63c0 2024-09-17T03:40:02.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.455+0000 7f71d7263640 1 -- 172.21.15.146:0/1060991207 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71d00c6860 con 0x7f71d00c63c0 2024-09-17T03:40:02.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.456+0000 7f71c57fa640 1 -- 172.21.15.146:0/1060991207 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5225 (secure 0 0 0) 0x7f71c00680e0 con 0x7f71d00c63c0 2024-09-17T03:40:02.455 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:02.455 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":78,"btime":"2024-09-17T03:38:39:013322+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/351223948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":351223948},{"type":"v1","addr":"172.21.15.146:6835","nonce":351223948}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/985271714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":985271714},{"type":"v1","addr":"172.21.15.179:6835","nonce":985271714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/781824323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":781824323},{"type":"v1","addr":"172.21.15.179:6837","nonce":781824323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T03:38:27.325806+0000","modified":"2024-09-17T03:38:38.576869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7770},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7770":{"gid":7770,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/682941374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":682941374},{"type":"v1","addr":"172.21.15.146:6834","nonce":682941374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7770,"qdb_cluster":[7770]},"id":7}]} 2024-09-17T03:40:02.456 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 78 2024-09-17T03:40:02.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 -- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f71bc078bc0 msgr2=0x7f71bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f71bc078bc0 0x7f71bc07b0d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f71cc000fb0 tx=0x7f71cc0067a0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 -- 172.21.15.146:0/1060991207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c63c0 msgr2=0x7f71d0141b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c63c0 0x7f71d0141b40 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f71c0003ec0 tx=0x7f71c0001630 comp rx=0 tx=0).stop 2024-09-17T03:40:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 -- 172.21.15.146:0/1060991207 shutdown_connections 2024-09-17T03:40:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f71bc078bc0 0x7f71bc07b0d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71d01424b0 0x7f71d00af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d00c63c0 0x7f71d0141b40 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 --2- 172.21.15.146:0/1060991207 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71b8004d40 0x7f71d0144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 -- 172.21.15.146:0/1060991207 >> 172.21.15.146:0/1060991207 conn(0x7f71d00b3150 msgr2=0x7f71d00d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 -- 172.21.15.146:0/1060991207 shutdown_connections 2024-09-17T03:40:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.458+0000 7f71d7263640 1 -- 172.21.15.146:0/1060991207 wait complete. 2024-09-17T03:40:02.469 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:02.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.583+0000 7fde4fcbe640 1 -- 172.21.15.146:0/4056654328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde481631a0 msgr2=0x7fde480cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.583+0000 7fde4fcbe640 1 --2- 172.21.15.146:0/4056654328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde481631a0 0x7fde480cef40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fde38009830 tx=0x7fde3802a480 comp rx=0 tx=0).stop 2024-09-17T03:40:02.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.583+0000 7fde4fcbe640 1 -- 172.21.15.146:0/4056654328 shutdown_connections 2024-09-17T03:40:02.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.583+0000 7fde4fcbe640 1 --2- 172.21.15.146:0/4056654328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde481631a0 0x7fde480cef40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.583+0000 7fde4fcbe640 1 --2- 172.21.15.146:0/4056654328 >> v2:172.21.15.179:3300/0 conn(0x7fde4815f1a0 0x7fde480cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.583+0000 7fde4fcbe640 1 -- 172.21.15.146:0/4056654328 >> 172.21.15.146:0/4056654328 conn(0x7fde480d11f0 msgr2=0x7fde480d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.583+0000 7fde4fcbe640 1 -- 172.21.15.146:0/4056654328 shutdown_connections 2024-09-17T03:40:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.583+0000 7fde4fcbe640 1 -- 172.21.15.146:0/4056654328 wait complete. 2024-09-17T03:40:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.584+0000 7fde4fcbe640 1 Processor -- start 2024-09-17T03:40:02.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.585+0000 7fde4fcbe640 1 -- start start 2024-09-17T03:40:02.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4fcbe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde480b61f0 0x7fde481f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4fcbe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde4815f1a0 0x7fde480c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4fcbe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde481631a0 0x7fde480ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4fcbe640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fde480695f0 con 0x7fde4815f1a0 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4fcbe640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fde48069470 con 0x7fde481631a0 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4fcbe640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fde48069770 con 0x7fde480b61f0 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4d259640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde4815f1a0 0x7fde480c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4d259640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde4815f1a0 0x7fde480c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32858/0 (socket says 172.21.15.146:32858) 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4d259640 1 -- 172.21.15.146:0/2642816774 learned_addr learned my addr 172.21.15.146:0/2642816774 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4da5a640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde480b61f0 0x7fde481f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4e25b640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde481631a0 0x7fde480ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4d259640 1 -- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde480b61f0 msgr2=0x7fde481f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4d259640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde480b61f0 0x7fde481f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4d259640 1 -- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde481631a0 msgr2=0x7fde480ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4d259640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde481631a0 0x7fde480ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.586+0000 7fde4d259640 1 -- 172.21.15.146:0/2642816774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde48075fe0 con 0x7fde4815f1a0 2024-09-17T03:40:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.587+0000 7fde4d259640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde4815f1a0 0x7fde480c9fe0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fde3802aa70 tx=0x7fde38033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.587+0000 7fde3e7fc640 1 -- 172.21.15.146:0/2642816774 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38031d60 con 0x7fde4815f1a0 2024-09-17T03:40:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.587+0000 7fde3e7fc640 1 -- 172.21.15.146:0/2642816774 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde38033e10 con 0x7fde4815f1a0 2024-09-17T03:40:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.587+0000 7fde4fcbe640 1 -- 172.21.15.146:0/2642816774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde480c8910 con 0x7fde4815f1a0 2024-09-17T03:40:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.587+0000 7fde3e7fc640 1 -- 172.21.15.146:0/2642816774 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38005260 con 0x7fde4815f1a0 2024-09-17T03:40:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.587+0000 7fde4fcbe640 1 -- 172.21.15.146:0/2642816774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde480c8ed0 con 0x7fde4815f1a0 2024-09-17T03:40:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.588+0000 7fde4fcbe640 1 -- 172.21.15.146:0/2642816774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde480c8680 con 0x7fde4815f1a0 2024-09-17T03:40:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.588+0000 7fde3e7fc640 1 -- 172.21.15.146:0/2642816774 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde38005400 con 0x7fde4815f1a0 2024-09-17T03:40:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.589+0000 7fde3e7fc640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde2c078b90 0x7fde2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.589+0000 7fde3e7fc640 1 -- 172.21.15.146:0/2642816774 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7fde380bbd90 con 0x7fde4815f1a0 2024-09-17T03:40:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.589+0000 7fde4da5a640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde2c078b90 0x7fde2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.590+0000 7fde4da5a640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde2c078b90 0x7fde2c07b0a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fde440095f0 tx=0x7fde44005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:02.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.594+0000 7fde3e7fc640 1 -- 172.21.15.146:0/2642816774 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde3803f030 con 0x7fde4815f1a0 2024-09-17T03:40:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.768+0000 7fde4fcbe640 1 -- 172.21.15.146:0/2642816774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde48069c20 con 0x7fde4815f1a0 2024-09-17T03:40:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.769+0000 7fde3e7fc640 1 -- 172.21.15.146:0/2642816774 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+16794 (secure 0 0 0) 0x7fde38083b60 con 0x7fde4815f1a0 2024-09-17T03:40:02.768 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:02.768 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":106,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:39:40.318972+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:38:25.075763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:38:26.285571+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 -- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde2c078b90 msgr2=0x7fde2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde2c078b90 0x7fde2c07b0a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fde440095f0 tx=0x7fde44005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 -- 172.21.15.146:0/2642816774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde4815f1a0 msgr2=0x7fde480c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde4815f1a0 0x7fde480c9fe0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fde3802aa70 tx=0x7fde38033c20 comp rx=0 tx=0).stop 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 -- 172.21.15.146:0/2642816774 shutdown_connections 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fde2c078b90 0x7fde2c07b0a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde481631a0 0x7fde480ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde4815f1a0 0x7fde480c9fe0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 --2- 172.21.15.146:0/2642816774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde480b61f0 0x7fde481f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 -- 172.21.15.146:0/2642816774 >> 172.21.15.146:0/2642816774 conn(0x7fde480d11f0 msgr2=0x7fde480b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 -- 172.21.15.146:0/2642816774 shutdown_connections 2024-09-17T03:40:02.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.771+0000 7fde4fcbe640 1 -- 172.21.15.146:0/2642816774 wait complete. 2024-09-17T03:40:02.782 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:40:02.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.896+0000 7f240af39640 1 -- 172.21.15.146:0/1991737039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24040b5ce0 msgr2=0x7f24040b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.896+0000 7f240af39640 1 --2- 172.21.15.146:0/1991737039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24040b5ce0 0x7f24040b1320 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f23f8009830 tx=0x7f23f802a510 comp rx=0 tx=0).stop 2024-09-17T03:40:02.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.896+0000 7f240af39640 1 -- 172.21.15.146:0/1991737039 shutdown_connections 2024-09-17T03:40:02.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.896+0000 7f240af39640 1 --2- 172.21.15.146:0/1991737039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24040b5750 0x7f24040b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.896+0000 7f240af39640 1 --2- 172.21.15.146:0/1991737039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24040b5ce0 0x7f24040b1320 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.896+0000 7f240af39640 1 -- 172.21.15.146:0/1991737039 >> 172.21.15.146:0/1991737039 conn(0x7f24040b7b20 msgr2=0x7f240409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:02.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.896+0000 7f240af39640 1 -- 172.21.15.146:0/1991737039 shutdown_connections 2024-09-17T03:40:02.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.896+0000 7f240af39640 1 -- 172.21.15.146:0/1991737039 wait complete. 2024-09-17T03:40:02.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.898+0000 7f240af39640 1 Processor -- start 2024-09-17T03:40:02.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.898+0000 7f240af39640 1 -- start start 2024-09-17T03:40:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.899+0000 7f240af39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24040b3b60 0x7f24041f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.899+0000 7f240af39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24040b5750 0x7f2404148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.899+0000 7f240af39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24040b5ce0 0x7f240415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.899+0000 7f240af39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f24040b27b0 con 0x7f24040b3b60 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.899+0000 7f240af39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f240415dd00 con 0x7f24040b5ce0 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.899+0000 7f240af39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f24040b2930 con 0x7f24040b5750 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.899+0000 7f2408cd5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24040b3b60 0x7f24041f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.899+0000 7f2408cd5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24040b3b60 0x7f24041f77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32874/0 (socket says 172.21.15.146:32874) 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.899+0000 7f2408cd5640 1 -- 172.21.15.146:0/1079973723 learned_addr learned my addr 172.21.15.146:0/1079973723 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.899+0000 7f24094d6640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24040b5ce0 0x7f240415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.899+0000 7f2403fff640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24040b5750 0x7f2404148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f2408cd5640 1 -- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24040b5750 msgr2=0x7f2404148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f2408cd5640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24040b5750 0x7f2404148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f2408cd5640 1 -- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24040b5ce0 msgr2=0x7f240415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f2408cd5640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24040b5ce0 0x7f240415b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f2408cd5640 1 -- 172.21.15.146:0/1079973723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24041f7ce0 con 0x7f24040b3b60 2024-09-17T03:40:02.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f2403fff640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24040b5750 0x7f2404148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f2408cd5640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24040b3b60 0x7f24041f77a0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f23f802ab00 tx=0x7f23f8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f24017fa640 1 -- 172.21.15.146:0/1079973723 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8031d60 con 0x7f24040b3b60 2024-09-17T03:40:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f24017fa640 1 -- 172.21.15.146:0/1079973723 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23f8033e10 con 0x7f24040b3b60 2024-09-17T03:40:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f240af39640 1 -- 172.21.15.146:0/1079973723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2404148750 con 0x7f24040b3b60 2024-09-17T03:40:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f24017fa640 1 -- 172.21.15.146:0/1079973723 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8005260 con 0x7f24040b3b60 2024-09-17T03:40:02.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.900+0000 7f240af39640 1 -- 172.21.15.146:0/1079973723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240409dc70 con 0x7f24040b3b60 2024-09-17T03:40:02.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.901+0000 7f240af39640 1 -- 172.21.15.146:0/1079973723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24040b2e20 con 0x7f24040b3b60 2024-09-17T03:40:02.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.902+0000 7f24017fa640 1 -- 172.21.15.146:0/1079973723 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23f8005400 con 0x7f24040b3b60 2024-09-17T03:40:02.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.902+0000 7f24017fa640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23e8078b90 0x7f23e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:02.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.902+0000 7f24017fa640 1 -- 172.21.15.146:0/1079973723 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5737+0+0 (secure 0 0 0) 0x7f23f80bc080 con 0x7f24040b3b60 2024-09-17T03:40:02.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.903+0000 7f2403fff640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23e8078b90 0x7f23e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:02.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.903+0000 7f2403fff640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23e8078b90 0x7f23e807b0a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2404076670 tx=0x7f23f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:02.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:02.907+0000 7f24017fa640 1 -- 172.21.15.146:0/1079973723 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2404148750 con 0x7f24040b3b60 2024-09-17T03:40:03.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.118+0000 7f240af39640 1 -- 172.21.15.146:0/1079973723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2404158470 con 0x7f24040b3b60 2024-09-17T03:40:03.118 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:40:03.119+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:40:03.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.121+0000 7f24017fa640 1 -- 172.21.15.146:0/1079973723 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) ==== 161+0+0 (secure 0 0 0) 0x7f24041f7ce0 con 0x7f24040b3b60 2024-09-17T03:40:03.120 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:40:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.124+0000 7f240af39640 1 -- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23e8078b90 msgr2=0x7f23e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.124+0000 7f240af39640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23e8078b90 0x7f23e807b0a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2404076670 tx=0x7f23f0008040 comp rx=0 tx=0).stop 2024-09-17T03:40:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.124+0000 7f240af39640 1 -- 172.21.15.146:0/1079973723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24040b3b60 msgr2=0x7f24041f77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.124+0000 7f240af39640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24040b3b60 0x7f24041f77a0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f23f802ab00 tx=0x7f23f8033c20 comp rx=0 tx=0).stop 2024-09-17T03:40:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.124+0000 7f240af39640 1 -- 172.21.15.146:0/1079973723 shutdown_connections 2024-09-17T03:40:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.124+0000 7f240af39640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23e8078b90 0x7f23e807b0a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.124+0000 7f240af39640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24040b5ce0 0x7f240415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.124+0000 7f240af39640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24040b5750 0x7f2404148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.124+0000 7f240af39640 1 --2- 172.21.15.146:0/1079973723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24040b3b60 0x7f24041f77a0 secure :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f23f802ab00 tx=0x7f23f8033c20 comp rx=0 tx=0).stop 2024-09-17T03:40:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.124+0000 7f240af39640 1 -- 172.21.15.146:0/1079973723 >> 172.21.15.146:0/1079973723 conn(0x7f24040b7b20 msgr2=0x7f2404070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:03.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.125+0000 7f240af39640 1 -- 172.21.15.146:0/1079973723 shutdown_connections 2024-09-17T03:40:03.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.125+0000 7f240af39640 1 -- 172.21.15.146:0/1079973723 wait complete. 2024-09-17T03:40:03.136 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:40:03.189 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:40:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.256+0000 7f0a79427640 1 -- 172.21.15.146:0/3435516831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a741620f0 msgr2=0x7f0a7406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.256+0000 7f0a79427640 1 --2- 172.21.15.146:0/3435516831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a741620f0 0x7f0a7406ed30 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f0a74069ce0 tx=0x7f0a5c02a4b0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.256+0000 7f0a79427640 1 -- 172.21.15.146:0/3435516831 shutdown_connections 2024-09-17T03:40:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.256+0000 7f0a79427640 1 --2- 172.21.15.146:0/3435516831 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a7406f270 0x7f0a741628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.256+0000 7f0a79427640 1 --2- 172.21.15.146:0/3435516831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a741620f0 0x7f0a7406ed30 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.256+0000 7f0a79427640 1 --2- 172.21.15.146:0/3435516831 >> v2:172.21.15.179:3300/0 conn(0x7f0a740b3870 0x7f0a740cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.256+0000 7f0a79427640 1 -- 172.21.15.146:0/3435516831 >> 172.21.15.146:0/3435516831 conn(0x7f0a740d4be0 msgr2=0x7f0a740d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.256+0000 7f0a79427640 1 -- 172.21.15.146:0/3435516831 shutdown_connections 2024-09-17T03:40:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.256+0000 7f0a79427640 1 -- 172.21.15.146:0/3435516831 wait complete. 2024-09-17T03:40:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.258+0000 7f0a79427640 1 Processor -- start 2024-09-17T03:40:03.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.258+0000 7f0a79427640 1 -- start start 2024-09-17T03:40:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a79427640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7406f270 0x7f0a7415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a79427640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a740b3870 0x7f0a740cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a79427640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a741620f0 0x7f0a741f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a79427640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74163170 con 0x7f0a7406f270 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a79427640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74162ff0 con 0x7f0a741620f0 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a79427640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0a741632f0 con 0x7f0a740b3870 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a72ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7406f270 0x7f0a7415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a72ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7406f270 0x7f0a7415cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32902/0 (socket says 172.21.15.146:32902) 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a72ffd640 1 -- 172.21.15.146:0/989093573 learned_addr learned my addr 172.21.15.146:0/989093573 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a6a7fc640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a740b3870 0x7f0a740cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a737fe640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a741620f0 0x7f0a741f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a72ffd640 1 -- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a740b3870 msgr2=0x7f0a740cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a72ffd640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a740b3870 0x7f0a740cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a72ffd640 1 -- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a741620f0 msgr2=0x7f0a741f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a72ffd640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a741620f0 0x7f0a741f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:03.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a72ffd640 1 -- 172.21.15.146:0/989093573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a740cc7f0 con 0x7f0a7406f270 2024-09-17T03:40:03.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a737fe640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a741620f0 0x7f0a741f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:03.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a72ffd640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7406f270 0x7f0a7415cd80 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400d770 tx=0x7f0a6400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:03.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a6bfff640 1 -- 172.21.15.146:0/989093573 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a64017070 con 0x7f0a7406f270 2024-09-17T03:40:03.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.260+0000 7f0a6bfff640 1 -- 172.21.15.146:0/989093573 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a64009cc0 con 0x7f0a7406f270 2024-09-17T03:40:03.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.261+0000 7f0a79427640 1 -- 172.21.15.146:0/989093573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a741f7020 con 0x7f0a7406f270 2024-09-17T03:40:03.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.261+0000 7f0a6bfff640 1 -- 172.21.15.146:0/989093573 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a640106c0 con 0x7f0a7406f270 2024-09-17T03:40:03.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.261+0000 7f0a79427640 1 -- 172.21.15.146:0/989093573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a740cbab0 con 0x7f0a7406f270 2024-09-17T03:40:03.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.261+0000 7f0a79427640 1 -- 172.21.15.146:0/989093573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7415fba0 con 0x7f0a7406f270 2024-09-17T03:40:03.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.262+0000 7f0a6bfff640 1 -- 172.21.15.146:0/989093573 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a6401a070 con 0x7f0a7406f270 2024-09-17T03:40:03.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.263+0000 7f0a6bfff640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078bc0 0x7f0a5407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:03.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.263+0000 7f0a6bfff640 1 -- 172.21.15.146:0/989093573 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5795+0+0 (secure 0 0 0) 0x7f0a6409ac70 con 0x7f0a7406f270 2024-09-17T03:40:03.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.263+0000 7f0a6a7fc640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078bc0 0x7f0a5407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:03.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.264+0000 7f0a6a7fc640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078bc0 0x7f0a5407b0d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c033000 tx=0x7f0a5c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:03.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.267+0000 7f0a6bfff640 1 -- 172.21.15.146:0/989093573 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a7415fba0 con 0x7f0a7406f270 2024-09-17T03:40:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:03.479+0000 7f0a79427640 1 -- 172.21.15.146:0/989093573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0a740cf370 con 0x7f0a7406f270 2024-09-17T03:40:04.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.123+0000 7f0a6bfff640 1 -- 172.21.15.146:0/989093573 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) ==== 104+0+0 (secure 0 0 0) 0x7f0a64062a90 con 0x7f0a7406f270 2024-09-17T03:40:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.125+0000 7f0a79427640 1 -- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078bc0 msgr2=0x7f0a5407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.125+0000 7f0a79427640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078bc0 0x7f0a5407b0d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c033000 tx=0x7f0a5c004730 comp rx=0 tx=0).stop 2024-09-17T03:40:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.125+0000 7f0a79427640 1 -- 172.21.15.146:0/989093573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7406f270 msgr2=0x7f0a7415cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.125+0000 7f0a79427640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7406f270 0x7f0a7415cd80 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400d770 tx=0x7f0a6400dc30 comp rx=0 tx=0).stop 2024-09-17T03:40:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.125+0000 7f0a79427640 1 -- 172.21.15.146:0/989093573 shutdown_connections 2024-09-17T03:40:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.125+0000 7f0a79427640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078bc0 0x7f0a5407b0d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.125+0000 7f0a79427640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a741620f0 0x7f0a741f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.125+0000 7f0a79427640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a740b3870 0x7f0a740cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.125+0000 7f0a79427640 1 --2- 172.21.15.146:0/989093573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a7406f270 0x7f0a7415cd80 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.125+0000 7f0a79427640 1 -- 172.21.15.146:0/989093573 >> 172.21.15.146:0/989093573 conn(0x7f0a740d4be0 msgr2=0x7f0a740b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:04.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.126+0000 7f0a79427640 1 -- 172.21.15.146:0/989093573 shutdown_connections 2024-09-17T03:40:04.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.126+0000 7f0a79427640 1 -- 172.21.15.146:0/989093573 wait complete. 2024-09-17T03:40:04.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:40:04.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.258+0000 7f803ba4d640 1 -- 172.21.15.146:0/2523293310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340b5750 msgr2=0x7f80340b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.258+0000 7f803ba4d640 1 --2- 172.21.15.146:0/2523293310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340b5750 0x7f80340b3620 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8024009830 tx=0x7f802402a510 comp rx=0 tx=0).stop 2024-09-17T03:40:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.258+0000 7f803ba4d640 1 -- 172.21.15.146:0/2523293310 shutdown_connections 2024-09-17T03:40:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.258+0000 7f803ba4d640 1 --2- 172.21.15.146:0/2523293310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340b5750 0x7f80340b3620 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.258+0000 7f803ba4d640 1 --2- 172.21.15.146:0/2523293310 >> v2:172.21.15.179:3300/0 conn(0x7f80340b5ce0 0x7f80340b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.258+0000 7f803ba4d640 1 -- 172.21.15.146:0/2523293310 >> 172.21.15.146:0/2523293310 conn(0x7f80340b7b20 msgr2=0x7f803409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.258+0000 7f803ba4d640 1 -- 172.21.15.146:0/2523293310 shutdown_connections 2024-09-17T03:40:04.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.258+0000 7f803ba4d640 1 -- 172.21.15.146:0/2523293310 wait complete. 2024-09-17T03:40:04.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.260+0000 7f803ba4d640 1 Processor -- start 2024-09-17T03:40:04.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.260+0000 7f803ba4d640 1 -- start start 2024-09-17T03:40:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.261+0000 7f803ba4d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340b3b60 0x7f80341514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.261+0000 7f803ba4d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80340b5750 0x7f80341583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.261+0000 7f803ba4d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80340b5ce0 0x7f8034158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.261+0000 7f803ba4d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f80340b27b0 con 0x7f80340b5750 2024-09-17T03:40:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.261+0000 7f803ba4d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f803415dd00 con 0x7f80340b5ce0 2024-09-17T03:40:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.261+0000 7f803ba4d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f80340b2930 con 0x7f80340b3b60 2024-09-17T03:40:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8038fe8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80340b5750 0x7f80341583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8038fe8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80340b5750 0x7f80341583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32906/0 (socket says 172.21.15.146:32906) 2024-09-17T03:40:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8038fe8640 1 -- 172.21.15.146:0/2589617470 learned_addr learned my addr 172.21.15.146:0/2589617470 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:04.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f80397e9640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340b3b60 0x7f80341514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8039fea640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80340b5ce0 0x7f8034158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8038fe8640 1 -- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340b3b60 msgr2=0x7f80341514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8038fe8640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340b3b60 0x7f80341514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8038fe8640 1 -- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80340b5ce0 msgr2=0x7f8034158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8038fe8640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80340b5ce0 0x7f8034158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8038fe8640 1 -- 172.21.15.146:0/2589617470 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803409e920 con 0x7f80340b5750 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8038fe8640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80340b5750 0x7f80341583f0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f802402ab00 tx=0x7f8024033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8029ffb640 1 -- 172.21.15.146:0/2589617470 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024005c90 con 0x7f80340b5750 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8029ffb640 1 -- 172.21.15.146:0/2589617470 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8024031e50 con 0x7f80340b5750 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f803ba4d640 1 -- 172.21.15.146:0/2589617470 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f803409c940 con 0x7f80340b5750 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.262+0000 7f8029ffb640 1 -- 172.21.15.146:0/2589617470 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024005260 con 0x7f80340b5750 2024-09-17T03:40:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.263+0000 7f803ba4d640 1 -- 172.21.15.146:0/2589617470 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80340a0140 con 0x7f80340b5750 2024-09-17T03:40:04.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.263+0000 7f803ba4d640 1 -- 172.21.15.146:0/2589617470 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80341f4d60 con 0x7f80340b5750 2024-09-17T03:40:04.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.264+0000 7f8029ffb640 1 -- 172.21.15.146:0/2589617470 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8024005400 con 0x7f80340b5750 2024-09-17T03:40:04.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.265+0000 7f8029ffb640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8018078b90 0x7f801807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:04.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.265+0000 7f8029ffb640 1 -- 172.21.15.146:0/2589617470 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5795+0+0 (secure 0 0 0) 0x7f80240bbce0 con 0x7f80340b5750 2024-09-17T03:40:04.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.265+0000 7f80397e9640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8018078b90 0x7f801807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:04.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.266+0000 7f80397e9640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8018078b90 0x7f801807b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f80300095f0 tx=0x7f8030005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:04.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.269+0000 7f8029ffb640 1 -- 172.21.15.146:0/2589617470 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f803409e920 con 0x7f80340b5750 2024-09-17T03:40:04.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:04.445+0000 7f803ba4d640 1 -- 172.21.15.146:0/2589617470 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f80340b2de0 con 0x7f80340b5750 2024-09-17T03:40:05.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.387+0000 7f8029ffb640 1 -- 172.21.15.146:0/2589617470 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v108) ==== 181+0+0 (secure 0 0 0) 0x7f802403f030 con 0x7f80340b5750 2024-09-17T03:40:05.386 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:40:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.390+0000 7f803ba4d640 1 -- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8018078b90 msgr2=0x7f801807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.390+0000 7f803ba4d640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8018078b90 0x7f801807b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f80300095f0 tx=0x7f8030005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.390+0000 7f803ba4d640 1 -- 172.21.15.146:0/2589617470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80340b5750 msgr2=0x7f80341583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.390+0000 7f803ba4d640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80340b5750 0x7f80341583f0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f802402ab00 tx=0x7f8024033c20 comp rx=0 tx=0).stop 2024-09-17T03:40:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.390+0000 7f803ba4d640 1 -- 172.21.15.146:0/2589617470 shutdown_connections 2024-09-17T03:40:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.390+0000 7f803ba4d640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8018078b90 0x7f801807b0a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.390+0000 7f803ba4d640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80340b5ce0 0x7f8034158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.390+0000 7f803ba4d640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80340b5750 0x7f80341583f0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.390+0000 7f803ba4d640 1 --2- 172.21.15.146:0/2589617470 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80340b3b60 0x7f80341514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.390+0000 7f803ba4d640 1 -- 172.21.15.146:0/2589617470 >> 172.21.15.146:0/2589617470 conn(0x7f80340b7b20 msgr2=0x7f8034075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:05.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.391+0000 7f803ba4d640 1 -- 172.21.15.146:0/2589617470 shutdown_connections 2024-09-17T03:40:05.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.391+0000 7f803ba4d640 1 -- 172.21.15.146:0/2589617470 wait complete. 2024-09-17T03:40:05.408 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:40:05.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.538+0000 7f329c225640 1 -- 172.21.15.146:0/3997076272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3280004d90 msgr2=0x7f3280005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:05.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.538+0000 7f329c225640 1 --2- 172.21.15.146:0/3997076272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3280004d90 0x7f3280005220 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f3294068d40 tx=0x7f3280005830 comp rx=0 tx=0).stop 2024-09-17T03:40:05.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.538+0000 7f329a7c2640 1 -- 172.21.15.146:0/3997076272 reap_dead start 2024-09-17T03:40:05.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.538+0000 7f329c225640 1 -- 172.21.15.146:0/3997076272 shutdown_connections 2024-09-17T03:40:05.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.538+0000 7f329c225640 1 -- 172.21.15.146:0/3997076272 >> 172.21.15.146:0/3997076272 conn(0x7f32940d11f0 msgr2=0x7f32940d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:05.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.538+0000 7f329c225640 1 -- 172.21.15.146:0/3997076272 shutdown_connections 2024-09-17T03:40:05.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.538+0000 7f329c225640 1 -- 172.21.15.146:0/3997076272 wait complete. 2024-09-17T03:40:05.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.540+0000 7f329c225640 1 Processor -- start 2024-09-17T03:40:05.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.540+0000 7f329c225640 1 -- start start 2024-09-17T03:40:05.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.541+0000 7f329c225640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3280004d90 0x7f329415ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:05.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.541+0000 7f329c225640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3294160b00 0x7f329414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.541+0000 7f329c225640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32940ca3e0 0x7f32940ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.541+0000 7f329c225640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f32940b6990 con 0x7f32940ca3e0 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.541+0000 7f329c225640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f32940b6810 con 0x7f3280004d90 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.541+0000 7f329c225640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3294069220 con 0x7f3294160b00 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.541+0000 7f329a7c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32940ca3e0 0x7f32940ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.541+0000 7f32997c0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3294160b00 0x7f329414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.541+0000 7f329a7c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32940ca3e0 0x7f32940ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32922/0 (socket says 172.21.15.146:32922) 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.541+0000 7f3299fc1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3280004d90 0x7f329415ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.541+0000 7f329a7c2640 1 -- 172.21.15.146:0/922991952 learned_addr learned my addr 172.21.15.146:0/922991952 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.542+0000 7f329a7c2640 1 -- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3294160b00 msgr2=0x7f329414fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.542+0000 7f329a7c2640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3294160b00 0x7f329414fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.542+0000 7f329a7c2640 1 -- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3280004d90 msgr2=0x7f329415ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:05.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.542+0000 7f329a7c2640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3280004d90 0x7f329415ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:05.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.542+0000 7f329a7c2640 1 -- 172.21.15.146:0/922991952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32940cad30 con 0x7f32940ca3e0 2024-09-17T03:40:05.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.542+0000 7f329a7c2640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32940ca3e0 0x7f32940ca7f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f328c02b810 tx=0x7f328c033b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:05.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.542+0000 7f328a7fc640 1 -- 172.21.15.146:0/922991952 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c038040 con 0x7f32940ca3e0 2024-09-17T03:40:05.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.542+0000 7f328a7fc640 1 -- 172.21.15.146:0/922991952 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f328c02bbe0 con 0x7f32940ca3e0 2024-09-17T03:40:05.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.542+0000 7f329c225640 1 -- 172.21.15.146:0/922991952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329415c110 con 0x7f32940ca3e0 2024-09-17T03:40:05.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.542+0000 7f328a7fc640 1 -- 172.21.15.146:0/922991952 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c004d80 con 0x7f32940ca3e0 2024-09-17T03:40:05.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.542+0000 7f329c225640 1 -- 172.21.15.146:0/922991952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f329415c6d0 con 0x7f32940ca3e0 2024-09-17T03:40:05.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.543+0000 7f329c225640 1 -- 172.21.15.146:0/922991952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32940cef40 con 0x7f32940ca3e0 2024-09-17T03:40:05.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.544+0000 7f328a7fc640 1 -- 172.21.15.146:0/922991952 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f328c043030 con 0x7f32940ca3e0 2024-09-17T03:40:05.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.544+0000 7f328a7fc640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3278078bc0 0x7f327807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:05.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.544+0000 7f328a7fc640 1 -- 172.21.15.146:0/922991952 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5357+0+0 (secure 0 0 0) 0x7f328c0bb300 con 0x7f32940ca3e0 2024-09-17T03:40:05.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.545+0000 7f3299fc1640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3278078bc0 0x7f327807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:05.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.545+0000 7f3299fc1640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3278078bc0 0x7f327807b0d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f32900013f0 tx=0x7f3290000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:05.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.549+0000 7f328a7fc640 1 -- 172.21.15.146:0/922991952 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f328c04a020 con 0x7f32940ca3e0 2024-09-17T03:40:05.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:05.723+0000 7f329c225640 1 -- 172.21.15.146:0/922991952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f32940c9170 con 0x7f32940ca3e0 2024-09-17T03:40:06.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.403+0000 7f328a7fc640 1 -- 172.21.15.146:0/922991952 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v109) ==== 169+0+0 (secure 0 0 0) 0x7f32940cad30 con 0x7f32940ca3e0 2024-09-17T03:40:06.403 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:40:06.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 -- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3278078bc0 msgr2=0x7f327807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3278078bc0 0x7f327807b0d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f32900013f0 tx=0x7f3290000ed0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 -- 172.21.15.146:0/922991952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32940ca3e0 msgr2=0x7f32940ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32940ca3e0 0x7f32940ca7f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f328c02b810 tx=0x7f328c033b80 comp rx=0 tx=0).stop 2024-09-17T03:40:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 -- 172.21.15.146:0/922991952 shutdown_connections 2024-09-17T03:40:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3278078bc0 0x7f327807b0d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32940ca3e0 0x7f32940ca7f0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3294160b00 0x7f329414fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 --2- 172.21.15.146:0/922991952 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3280004d90 0x7f329415ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 -- 172.21.15.146:0/922991952 >> 172.21.15.146:0/922991952 conn(0x7f32940d11f0 msgr2=0x7f329415e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 -- 172.21.15.146:0/922991952 shutdown_connections 2024-09-17T03:40:06.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.407+0000 7f329c225640 1 -- 172.21.15.146:0/922991952 wait complete. 2024-09-17T03:40:06.421 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:40:06.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.542+0000 7f173ccbd640 1 -- 172.21.15.146:0/3247788970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1738153af0 msgr2=0x7f173815ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:06.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.542+0000 7f173ccbd640 1 --2- 172.21.15.146:0/3247788970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1738153af0 0x7f173815ce70 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f1728005fd0 tx=0x7f172802a520 comp rx=0 tx=0).stop 2024-09-17T03:40:06.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.542+0000 7f173ccbd640 1 -- 172.21.15.146:0/3247788970 shutdown_connections 2024-09-17T03:40:06.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.542+0000 7f173ccbd640 1 --2- 172.21.15.146:0/3247788970 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17380cdf10 0x7f17380734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.542+0000 7f173ccbd640 1 --2- 172.21.15.146:0/3247788970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1738153af0 0x7f173815ce70 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.542+0000 7f173ccbd640 1 -- 172.21.15.146:0/3247788970 >> 172.21.15.146:0/3247788970 conn(0x7f17380b3410 msgr2=0x7f17380b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.542+0000 7f173ccbd640 1 -- 172.21.15.146:0/3247788970 shutdown_connections 2024-09-17T03:40:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.542+0000 7f173ccbd640 1 -- 172.21.15.146:0/3247788970 wait complete. 2024-09-17T03:40:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.544+0000 7f173ccbd640 1 Processor -- start 2024-09-17T03:40:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.544+0000 7f173ccbd640 1 -- start start 2024-09-17T03:40:06.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.545+0000 7f173ccbd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1738073a30 0x7f1738155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:06.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.545+0000 7f173ccbd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17380cdf10 0x7f1738147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:06.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173ccbd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1738153af0 0x7f173806dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:06.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173ccbd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1738160bc0 con 0x7f1738073a30 2024-09-17T03:40:06.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173ccbd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f17380d0b80 con 0x7f1738153af0 2024-09-17T03:40:06.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173ccbd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1738160d40 con 0x7f17380cdf10 2024-09-17T03:40:06.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1738073a30 0x7f1738155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:06.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1738073a30 0x7f1738155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32952/0 (socket says 172.21.15.146:32952) 2024-09-17T03:40:06.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173659c640 1 -- 172.21.15.146:0/1689353580 learned_addr learned my addr 172.21.15.146:0/1689353580 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:06.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f1736d9d640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1738153af0 0x7f173806dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:06.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f1735d9b640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17380cdf10 0x7f1738147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:06.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173659c640 1 -- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17380cdf10 msgr2=0x7f1738147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:06.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173659c640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17380cdf10 0x7f1738147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173659c640 1 -- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1738153af0 msgr2=0x7f173806dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:06.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173659c640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1738153af0 0x7f173806dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173659c640 1 -- 172.21.15.146:0/1689353580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1738148430 con 0x7f1738073a30 2024-09-17T03:40:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f1736d9d640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1738153af0 0x7f173806dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f1735d9b640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17380cdf10 0x7f1738147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173659c640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1738073a30 0x7f1738155270 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1728034040 tx=0x7f17280039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f1726ffd640 1 -- 172.21.15.146:0/1689353580 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172803e030 con 0x7f1738073a30 2024-09-17T03:40:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f1726ffd640 1 -- 172.21.15.146:0/1689353580 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17280047a0 con 0x7f1738073a30 2024-09-17T03:40:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173ccbd640 1 -- 172.21.15.146:0/1689353580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17381f60a0 con 0x7f1738073a30 2024-09-17T03:40:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f1726ffd640 1 -- 172.21.15.146:0/1689353580 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728035040 con 0x7f1738073a30 2024-09-17T03:40:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.546+0000 7f173ccbd640 1 -- 172.21.15.146:0/1689353580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17381f6660 con 0x7f1738073a30 2024-09-17T03:40:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.548+0000 7f173ccbd640 1 -- 172.21.15.146:0/1689353580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17381f68a0 con 0x7f1738073a30 2024-09-17T03:40:06.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.548+0000 7f1726ffd640 1 -- 172.21.15.146:0/1689353580 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1728041030 con 0x7f1738073a30 2024-09-17T03:40:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.548+0000 7f1726ffd640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1718078b90 0x7f171807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.549+0000 7f1726ffd640 1 -- 172.21.15.146:0/1689353580 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4943+0+0 (secure 0 0 0) 0x7f17280bb280 con 0x7f1738073a30 2024-09-17T03:40:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.549+0000 7f1735d9b640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1718078b90 0x7f171807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:06.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.549+0000 7f1735d9b640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1718078b90 0x7f171807b0a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1738156c60 tx=0x7f172c005cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:06.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.553+0000 7f1726ffd640 1 -- 172.21.15.146:0/1689353580 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f17381f68a0 con 0x7f1738073a30 2024-09-17T03:40:06.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.727+0000 7f173ccbd640 1 -- 172.21.15.146:0/1689353580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f17380734f0 con 0x7f1738073a30 2024-09-17T03:40:06.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.731+0000 7f1726ffd640 1 -- 172.21.15.146:0/1689353580 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v51) ==== 71+0+0 (secure 0 0 0) 0x7f1738070ac0 con 0x7f1738073a30 2024-09-17T03:40:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 -- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1718078b90 msgr2=0x7f171807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1718078b90 0x7f171807b0a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1738156c60 tx=0x7f172c005cb0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 -- 172.21.15.146:0/1689353580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1738073a30 msgr2=0x7f1738155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1738073a30 0x7f1738155270 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1728034040 tx=0x7f17280039e0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 -- 172.21.15.146:0/1689353580 shutdown_connections 2024-09-17T03:40:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1718078b90 0x7f171807b0a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1738153af0 0x7f173806dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f17380cdf10 0x7f1738147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 --2- 172.21.15.146:0/1689353580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1738073a30 0x7f1738155270 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 -- 172.21.15.146:0/1689353580 >> 172.21.15.146:0/1689353580 conn(0x7f17380b3410 msgr2=0x7f17380d1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 -- 172.21.15.146:0/1689353580 shutdown_connections 2024-09-17T03:40:06.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.733+0000 7f173ccbd640 1 -- 172.21.15.146:0/1689353580 wait complete. 2024-09-17T03:40:06.743 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-17T03:40:06.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.868+0000 7f0b44d5e640 1 -- 172.21.15.146:0/2525437556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b400b5750 msgr2=0x7f0b400b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:06.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.868+0000 7f0b44d5e640 1 --2- 172.21.15.146:0/2525437556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b400b5750 0x7f0b400b3620 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009830 tx=0x7f0b2802a510 comp rx=0 tx=0).stop 2024-09-17T03:40:06.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.868+0000 7f0b44d5e640 1 -- 172.21.15.146:0/2525437556 shutdown_connections 2024-09-17T03:40:06.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.868+0000 7f0b44d5e640 1 --2- 172.21.15.146:0/2525437556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b400b3b60 0x7f0b4015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.868+0000 7f0b44d5e640 1 --2- 172.21.15.146:0/2525437556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b400b5750 0x7f0b400b3620 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.868+0000 7f0b44d5e640 1 -- 172.21.15.146:0/2525437556 >> 172.21.15.146:0/2525437556 conn(0x7f0b400b7b20 msgr2=0x7f0b4009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:06.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.868+0000 7f0b44d5e640 1 -- 172.21.15.146:0/2525437556 shutdown_connections 2024-09-17T03:40:06.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.868+0000 7f0b44d5e640 1 -- 172.21.15.146:0/2525437556 wait complete. 2024-09-17T03:40:06.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.870+0000 7f0b44d5e640 1 Processor -- start 2024-09-17T03:40:06.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.870+0000 7f0b44d5e640 1 -- start start 2024-09-17T03:40:06.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.871+0000 7f0b44d5e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b400b3b60 0x7f0b40146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:06.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.871+0000 7f0b44d5e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b400b5750 0x7f0b4009c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b44d5e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b400b5ce0 0x7f0b400718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b44d5e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4015d4b0 con 0x7f0b400b5750 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b44d5e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4015d330 con 0x7f0b400b3b60 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b44d5e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4015d630 con 0x7f0b400b5ce0 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b35d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b400b5750 0x7f0b4009c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b35d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b400b5750 0x7f0b4009c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32954/0 (socket says 172.21.15.146:32954) 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b35d9b640 1 -- 172.21.15.146:0/3449594815 learned_addr learned my addr 172.21.15.146:0/3449594815 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b3ed9d640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b400b5ce0 0x7f0b400718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b3e59c640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b400b3b60 0x7f0b40146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b35d9b640 1 -- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b400b5ce0 msgr2=0x7f0b400718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b35d9b640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b400b5ce0 0x7f0b400718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b35d9b640 1 -- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b400b3b60 msgr2=0x7f0b40146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b35d9b640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b400b3b60 0x7f0b40146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b35d9b640 1 -- 172.21.15.146:0/3449594815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b401465a0 con 0x7f0b400b5750 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b3ed9d640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b400b5ce0 0x7f0b400718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b35d9b640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b400b5750 0x7f0b4009c6f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009950 tx=0x7f0b28033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b377fe640 1 -- 172.21.15.146:0/3449594815 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28005c90 con 0x7f0b400b5750 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b44d5e640 1 -- 172.21.15.146:0/3449594815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4009f130 con 0x7f0b400b5750 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b377fe640 1 -- 172.21.15.146:0/3449594815 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b28031e50 con 0x7f0b400b5750 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.872+0000 7f0b377fe640 1 -- 172.21.15.146:0/3449594815 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28005260 con 0x7f0b400b5750 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.873+0000 7f0b44d5e640 1 -- 172.21.15.146:0/3449594815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4009f6f0 con 0x7f0b400b5750 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.873+0000 7f0b44d5e640 1 -- 172.21.15.146:0/3449594815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b4009eea0 con 0x7f0b400b5750 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.874+0000 7f0b377fe640 1 -- 172.21.15.146:0/3449594815 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b28005400 con 0x7f0b400b5750 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.875+0000 7f0b377fe640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0b20078b90 0x7f0b2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:06.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.875+0000 7f0b377fe640 1 -- 172.21.15.146:0/3449594815 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4943+0+0 (secure 0 0 0) 0x7f0b280bba80 con 0x7f0b400b5750 2024-09-17T03:40:06.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.875+0000 7f0b3e59c640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0b20078b90 0x7f0b2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:06.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.876+0000 7f0b3e59c640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0b20078b90 0x7f0b2007b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0b30001600 tx=0x7f0b30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:06.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:06.879+0000 7f0b377fe640 1 -- 172.21.15.146:0/3449594815 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b401465a0 con 0x7f0b400b5750 2024-09-17T03:40:07.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.123+0000 7f0b44d5e640 1 -- 172.21.15.146:0/3449594815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f0b4015dae0 con 0x7f0b400b5750 2024-09-17T03:40:07.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.404+0000 7f0b377fe640 1 -- 172.21.15.146:0/3449594815 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v340) ==== 158+0+0 (secure 0 0 0) 0x7f0b2803f030 con 0x7f0b400b5750 2024-09-17T03:40:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 -- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0b20078b90 msgr2=0x7f0b2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0b20078b90 0x7f0b2007b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0b30001600 tx=0x7f0b30009040 comp rx=0 tx=0).stop 2024-09-17T03:40:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 -- 172.21.15.146:0/3449594815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b400b5750 msgr2=0x7f0b4009c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b400b5750 0x7f0b4009c6f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009950 tx=0x7f0b28033c20 comp rx=0 tx=0).stop 2024-09-17T03:40:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 -- 172.21.15.146:0/3449594815 shutdown_connections 2024-09-17T03:40:07.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0b20078b90 0x7f0b2007b0a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b400b5ce0 0x7f0b400718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b400b5750 0x7f0b4009c6f0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 --2- 172.21.15.146:0/3449594815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b400b3b60 0x7f0b40146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 -- 172.21.15.146:0/3449594815 >> 172.21.15.146:0/3449594815 conn(0x7f0b400b7b20 msgr2=0x7f0b40156580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 -- 172.21.15.146:0/3449594815 shutdown_connections 2024-09-17T03:40:07.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.407+0000 7f0b44d5e640 1 -- 172.21.15.146:0/3449594815 wait complete. 2024-09-17T03:40:07.417 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-09-17T03:40:07.417 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-17T03:40:07.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:07.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.532+0000 7f86a48a2640 1 -- 172.21.15.146:0/3090071359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86a006fbf0 msgr2=0x7f86a0070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.532+0000 7f86a48a2640 1 --2- 172.21.15.146:0/3090071359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86a006fbf0 0x7f86a0070000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8698009be0 tx=0x7f869802a840 comp rx=0 tx=0).stop 2024-09-17T03:40:07.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.532+0000 7f86a48a2640 1 -- 172.21.15.146:0/3090071359 shutdown_connections 2024-09-17T03:40:07.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.532+0000 7f86a48a2640 1 --2- 172.21.15.146:0/3090071359 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86a006fbf0 0x7f86a0070000 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.532+0000 7f86a48a2640 1 --2- 172.21.15.146:0/3090071359 >> v2:172.21.15.179:3300/0 conn(0x7f86a015d8a0 0x7f86a0156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.532+0000 7f86a48a2640 1 -- 172.21.15.146:0/3090071359 >> 172.21.15.146:0/3090071359 conn(0x7f86a006dd60 msgr2=0x7f86a006e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:07.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.533+0000 7f86a48a2640 1 -- 172.21.15.146:0/3090071359 shutdown_connections 2024-09-17T03:40:07.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.533+0000 7f86a48a2640 1 -- 172.21.15.146:0/3090071359 wait complete. 2024-09-17T03:40:07.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.534+0000 7f86a48a2640 1 Processor -- start 2024-09-17T03:40:07.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.534+0000 7f86a48a2640 1 -- start start 2024-09-17T03:40:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f86a48a2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86a006cc50 0x7f86a0158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f86a48a2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a006fbf0 0x7f86a01574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f86a48a2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a015d8a0 0x7f86a0157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f86a48a2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f86a0073c80 con 0x7f86a015d8a0 2024-09-17T03:40:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f86a48a2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f86a0070540 con 0x7f86a006fbf0 2024-09-17T03:40:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f86a48a2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f86a00706c0 con 0x7f86a006cc50 2024-09-17T03:40:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f869ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a015d8a0 0x7f86a0157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f869ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a015d8a0 0x7f86a0157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39882/0 (socket says 172.21.15.146:39882) 2024-09-17T03:40:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f869ed9d640 1 -- 172.21.15.146:0/750306799 learned_addr learned my addr 172.21.15.146:0/750306799 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f869e59c640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86a006cc50 0x7f86a0158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f869dd9b640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a006fbf0 0x7f86a01574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f869ed9d640 1 -- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86a006cc50 msgr2=0x7f86a0158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f869ed9d640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86a006cc50 0x7f86a0158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f869ed9d640 1 -- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a006fbf0 msgr2=0x7f86a01574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f869ed9d640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a006fbf0 0x7f86a01574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f869ed9d640 1 -- 172.21.15.146:0/750306799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a00b57a0 con 0x7f86a015d8a0 2024-09-17T03:40:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.536+0000 7f869ed9d640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a015d8a0 0x7f86a0157a20 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f8698009be0 tx=0x7f8698033e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.537+0000 7f868effd640 1 -- 172.21.15.146:0/750306799 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698042020 con 0x7f86a015d8a0 2024-09-17T03:40:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.537+0000 7f868effd640 1 -- 172.21.15.146:0/750306799 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8698004040 con 0x7f86a015d8a0 2024-09-17T03:40:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.537+0000 7f86a48a2640 1 -- 172.21.15.146:0/750306799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a00af420 con 0x7f86a015d8a0 2024-09-17T03:40:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.537+0000 7f868effd640 1 -- 172.21.15.146:0/750306799 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698037040 con 0x7f86a015d8a0 2024-09-17T03:40:07.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.537+0000 7f86a48a2640 1 -- 172.21.15.146:0/750306799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a00af9e0 con 0x7f86a015d8a0 2024-09-17T03:40:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.538+0000 7f86a48a2640 1 -- 172.21.15.146:0/750306799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a0070000 con 0x7f86a015d8a0 2024-09-17T03:40:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.539+0000 7f868effd640 1 -- 172.21.15.146:0/750306799 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8698045020 con 0x7f86a015d8a0 2024-09-17T03:40:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.539+0000 7f868effd640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8680078b90 0x7f868007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.539+0000 7f868effd640 1 -- 172.21.15.146:0/750306799 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4943+0+0 (secure 0 0 0) 0x7f86980bb920 con 0x7f86a015d8a0 2024-09-17T03:40:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.539+0000 7f869e59c640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8680078b90 0x7f868007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.540+0000 7f869e59c640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8680078b90 0x7f868007b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8690009b30 tx=0x7f8690005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:07.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.544+0000 7f868effd640 1 -- 172.21.15.146:0/750306799 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f869804c030 con 0x7f86a015d8a0 2024-09-17T03:40:07.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.718+0000 7f86a48a2640 1 -- 172.21.15.146:0/750306799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86a015a2f0 con 0x7f86a015d8a0 2024-09-17T03:40:07.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.719+0000 7f868effd640 1 -- 172.21.15.146:0/750306799 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+13090 (secure 0 0 0) 0x7f869802f070 con 0x7f86a015d8a0 2024-09-17T03:40:07.718 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:07.718 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":109,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:40:06.399102+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/682941374":"2024-09-18T03:40:03.119762+0000","172.21.15.146:6832/682941374":"2024-09-18T03:40:03.119762+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:07.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 -- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8680078b90 msgr2=0x7f868007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8680078b90 0x7f868007b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8690009b30 tx=0x7f8690005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:07.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 -- 172.21.15.146:0/750306799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a015d8a0 msgr2=0x7f86a0157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a015d8a0 0x7f86a0157a20 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f8698009be0 tx=0x7f8698033e50 comp rx=0 tx=0).stop 2024-09-17T03:40:07.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 -- 172.21.15.146:0/750306799 shutdown_connections 2024-09-17T03:40:07.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8680078b90 0x7f868007b0a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a015d8a0 0x7f86a0157a20 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86a006fbf0 0x7f86a01574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 --2- 172.21.15.146:0/750306799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86a006cc50 0x7f86a0158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 -- 172.21.15.146:0/750306799 >> 172.21.15.146:0/750306799 conn(0x7f86a006dd60 msgr2=0x7f86a015ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:07.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 -- 172.21.15.146:0/750306799 shutdown_connections 2024-09-17T03:40:07.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.721+0000 7f86a48a2640 1 -- 172.21.15.146:0/750306799 wait complete. 2024-09-17T03:40:07.731 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:40:07.732 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:40:07.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.848+0000 7f0b10d0b640 1 -- 172.21.15.146:0/3758388338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0c0b5750 msgr2=0x7f0b0c0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.848+0000 7f0b10d0b640 1 --2- 172.21.15.146:0/3758388338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0c0b5750 0x7f0b0c0b3620 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0b1a60 tx=0x7f0b0002a820 comp rx=0 tx=0).stop 2024-09-17T03:40:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.848+0000 7f0b10d0b640 1 -- 172.21.15.146:0/3758388338 shutdown_connections 2024-09-17T03:40:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.848+0000 7f0b10d0b640 1 --2- 172.21.15.146:0/3758388338 >> v2:172.21.15.179:3300/0 conn(0x7f0b0c0b3b60 0x7f0b0c15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.848+0000 7f0b10d0b640 1 --2- 172.21.15.146:0/3758388338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0c0b5750 0x7f0b0c0b3620 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.848+0000 7f0b10d0b640 1 -- 172.21.15.146:0/3758388338 >> 172.21.15.146:0/3758388338 conn(0x7f0b0c0b7b20 msgr2=0x7f0b0c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.848+0000 7f0b10d0b640 1 -- 172.21.15.146:0/3758388338 shutdown_connections 2024-09-17T03:40:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.848+0000 7f0b10d0b640 1 -- 172.21.15.146:0/3758388338 wait complete. 2024-09-17T03:40:07.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.850+0000 7f0b10d0b640 1 Processor -- start 2024-09-17T03:40:07.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.850+0000 7f0b10d0b640 1 -- start start 2024-09-17T03:40:07.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.851+0000 7f0b10d0b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0c0b3b60 0x7f0b0c1f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.851+0000 7f0b10d0b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0c0b5750 0x7f0b0c1f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.851+0000 7f0b10d0b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b0c0b5ce0 0x7f0b0c147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.851+0000 7f0b10d0b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c15d3d0 con 0x7f0b0c0b3b60 2024-09-17T03:40:07.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.851+0000 7f0b10d0b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c15d250 con 0x7f0b0c0b5750 2024-09-17T03:40:07.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.851+0000 7f0b10d0b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0b0c15d550 con 0x7f0b0c0b5ce0 2024-09-17T03:40:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b0a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0c0b3b60 0x7f0b0c1f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b0a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0c0b3b60 0x7f0b0c1f8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39896/0 (socket says 172.21.15.146:39896) 2024-09-17T03:40:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b0a59c640 1 -- 172.21.15.146:0/2246534528 learned_addr learned my addr 172.21.15.146:0/2246534528 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b0a59c640 1 -- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b0c0b5ce0 msgr2=0x7f0b0c147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b0ad9d640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b0c0b5ce0 0x7f0b0c147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b09d9b640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0c0b5750 0x7f0b0c1f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b0a59c640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b0c0b5ce0 0x7f0b0c147b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b0a59c640 1 -- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0c0b5750 msgr2=0x7f0b0c1f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b0a59c640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0c0b5750 0x7f0b0c1f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b0a59c640 1 -- 172.21.15.146:0/2246534528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0c15ea50 con 0x7f0b0c0b3b60 2024-09-17T03:40:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b09d9b640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0c0b5750 0x7f0b0c1f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b0a59c640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0c0b3b60 0x7f0b0c1f8fb0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400c3c0 tx=0x7f0b0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0afaffd640 1 -- 172.21.15.146:0/2246534528 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04017070 con 0x7f0b0c0b3b60 2024-09-17T03:40:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0afaffd640 1 -- 172.21.15.146:0/2246534528 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b040035f0 con 0x7f0b0c0b3b60 2024-09-17T03:40:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b10d0b640 1 -- 172.21.15.146:0/2246534528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0c15ed30 con 0x7f0b0c0b3b60 2024-09-17T03:40:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0afaffd640 1 -- 172.21.15.146:0/2246534528 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04003a80 con 0x7f0b0c0b3b60 2024-09-17T03:40:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.852+0000 7f0b10d0b640 1 -- 172.21.15.146:0/2246534528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0c15f2f0 con 0x7f0b0c0b3b60 2024-09-17T03:40:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.853+0000 7f0b10d0b640 1 -- 172.21.15.146:0/2246534528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0c15caa0 con 0x7f0b0c0b3b60 2024-09-17T03:40:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.854+0000 7f0afaffd640 1 -- 172.21.15.146:0/2246534528 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b0401a070 con 0x7f0b0c0b3b60 2024-09-17T03:40:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.855+0000 7f0afaffd640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078b90 0x7f0aec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.855+0000 7f0afaffd640 1 -- 172.21.15.146:0/2246534528 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4943+0+0 (secure 0 0 0) 0x7f0b04099d00 con 0x7f0b0c0b3b60 2024-09-17T03:40:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.855+0000 7f0b09d9b640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078b90 0x7f0aec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.855+0000 7f0b09d9b640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078b90 0x7f0aec07b0a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0b00034000 tx=0x7f0b00004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:07.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:07.859+0000 7f0afaffd640 1 -- 172.21.15.146:0/2246534528 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b0c0b3f70 con 0x7f0b0c0b3b60 2024-09-17T03:40:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.034+0000 7f0b10d0b640 1 -- 172.21.15.146:0/2246534528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0b0c15ab60 con 0x7f0b0c0b3b60 2024-09-17T03:40:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.034+0000 7f0afaffd640 1 -- 172.21.15.146:0/2246534528 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) ==== 93+0+10 (secure 0 0 0) 0x7f0b040624d0 con 0x7f0b0c0b3b60 2024-09-17T03:40:08.034 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:40:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.036+0000 7f0b10d0b640 1 -- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078b90 msgr2=0x7f0aec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.036+0000 7f0b10d0b640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078b90 0x7f0aec07b0a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0b00034000 tx=0x7f0b00004ab0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.036+0000 7f0b10d0b640 1 -- 172.21.15.146:0/2246534528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0c0b3b60 msgr2=0x7f0b0c1f8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.036+0000 7f0b10d0b640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0c0b3b60 0x7f0b0c1f8fb0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400c3c0 tx=0x7f0b0400c880 comp rx=0 tx=0).stop 2024-09-17T03:40:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.036+0000 7f0b10d0b640 1 -- 172.21.15.146:0/2246534528 shutdown_connections 2024-09-17T03:40:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.036+0000 7f0b10d0b640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078b90 0x7f0aec07b0a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.036+0000 7f0b10d0b640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b0c0b5ce0 0x7f0b0c147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.036+0000 7f0b10d0b640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0c0b5750 0x7f0b0c1f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.036+0000 7f0b10d0b640 1 --2- 172.21.15.146:0/2246534528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0c0b3b60 0x7f0b0c1f8fb0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.036+0000 7f0b10d0b640 1 -- 172.21.15.146:0/2246534528 >> 172.21.15.146:0/2246534528 conn(0x7f0b0c0b7b20 msgr2=0x7f0b0c0707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.037+0000 7f0b10d0b640 1 -- 172.21.15.146:0/2246534528 shutdown_connections 2024-09-17T03:40:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.037+0000 7f0b10d0b640 1 -- 172.21.15.146:0/2246534528 wait complete. 2024-09-17T03:40:08.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-17T03:40:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.162+0000 7f11fa512640 1 -- 172.21.15.146:0/2351550079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11f40b61f0 msgr2=0x7f11f40b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.162+0000 7f11fa512640 1 --2- 172.21.15.146:0/2351550079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11f40b61f0 0x7f11f40b6600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f11ec005fd0 tx=0x7f11ec02a820 comp rx=0 tx=0).stop 2024-09-17T03:40:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.162+0000 7f11fa512640 1 -- 172.21.15.146:0/2351550079 shutdown_connections 2024-09-17T03:40:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.162+0000 7f11fa512640 1 --2- 172.21.15.146:0/2351550079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11f40b61f0 0x7f11f40b6600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.162+0000 7f11fa512640 1 --2- 172.21.15.146:0/2351550079 >> v2:172.21.15.179:3300/0 conn(0x7f11f415f1a0 0x7f11f40cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.162+0000 7f11fa512640 1 -- 172.21.15.146:0/2351550079 >> 172.21.15.146:0/2351550079 conn(0x7f11f40d11f0 msgr2=0x7f11f40d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.162+0000 7f11fa512640 1 -- 172.21.15.146:0/2351550079 shutdown_connections 2024-09-17T03:40:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.162+0000 7f11fa512640 1 -- 172.21.15.146:0/2351550079 wait complete. 2024-09-17T03:40:08.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.164+0000 7f11fa512640 1 Processor -- start 2024-09-17T03:40:08.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.164+0000 7f11fa512640 1 -- start start 2024-09-17T03:40:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.165+0000 7f11fa512640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11f40b61f0 0x7f11f40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.165+0000 7f11fa512640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f415f1a0 0x7f11f40cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.165+0000 7f11fa512640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11f41631a0 0x7f11f414fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11fa512640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11f40695b0 con 0x7f11f415f1a0 2024-09-17T03:40:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11fa512640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f11f4069430 con 0x7f11f41631a0 2024-09-17T03:40:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11fa512640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f11f4069730 con 0x7f11f40b61f0 2024-09-17T03:40:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f415f1a0 0x7f11f40cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f415f1a0 0x7f11f40cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39910/0 (socket says 172.21.15.146:39910) 2024-09-17T03:40:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f37fe640 1 -- 172.21.15.146:0/3889766310 learned_addr learned my addr 172.21.15.146:0/3889766310 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f3fff640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11f40b61f0 0x7f11f40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f8aaf640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11f41631a0 0x7f11f414fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f37fe640 1 -- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11f40b61f0 msgr2=0x7f11f40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f37fe640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11f40b61f0 0x7f11f40caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f37fe640 1 -- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11f41631a0 msgr2=0x7f11f414fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f37fe640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11f41631a0 0x7f11f414fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f37fe640 1 -- 172.21.15.146:0/3889766310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f40cc8f0 con 0x7f11f415f1a0 2024-09-17T03:40:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f37fe640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f415f1a0 0x7f11f40cc1c0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c3a0 tx=0x7f11e800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f0ff9640 1 -- 172.21.15.146:0/3889766310 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8011790 con 0x7f11f415f1a0 2024-09-17T03:40:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11fa512640 1 -- 172.21.15.146:0/3889766310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f40ccbd0 con 0x7f11f415f1a0 2024-09-17T03:40:08.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f0ff9640 1 -- 172.21.15.146:0/3889766310 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11e8017070 con 0x7f11f415f1a0 2024-09-17T03:40:08.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11f0ff9640 1 -- 172.21.15.146:0/3889766310 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8011cc0 con 0x7f11f415f1a0 2024-09-17T03:40:08.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.166+0000 7f11fa512640 1 -- 172.21.15.146:0/3889766310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f4150000 con 0x7f11f415f1a0 2024-09-17T03:40:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.167+0000 7f11fa512640 1 -- 172.21.15.146:0/3889766310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f4069be0 con 0x7f11f415f1a0 2024-09-17T03:40:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.168+0000 7f11f0ff9640 1 -- 172.21.15.146:0/3889766310 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f11e801c460 con 0x7f11f415f1a0 2024-09-17T03:40:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.169+0000 7f11f0ff9640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11e0078b90 0x7f11e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.169+0000 7f11f0ff9640 1 -- 172.21.15.146:0/3889766310 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4943+0+0 (secure 0 0 0) 0x7f11e809a6a0 con 0x7f11f415f1a0 2024-09-17T03:40:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.169+0000 7f11f3fff640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11e0078b90 0x7f11e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.169+0000 7f11f3fff640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11e0078b90 0x7f11e007b0a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009b30 tx=0x7f11e4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.173+0000 7f11f0ff9640 1 -- 172.21.15.146:0/3889766310 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11f40b6b40 con 0x7f11f415f1a0 2024-09-17T03:40:08.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:08.415+0000 7f11fa512640 1 -- 172.21.15.146:0/3889766310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7f11f40c7ff0 con 0x7f11f415f1a0 2024-09-17T03:40:09.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.411+0000 7f11f0ff9640 1 -- 172.21.15.146:0/3889766310 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v342) ==== 147+0+0 (secure 0 0 0) 0x7f11e80627a0 con 0x7f11f415f1a0 2024-09-17T03:40:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.414+0000 7f11fa512640 1 -- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11e0078b90 msgr2=0x7f11e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.414+0000 7f11fa512640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11e0078b90 0x7f11e007b0a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009b30 tx=0x7f11e4005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.414+0000 7f11fa512640 1 -- 172.21.15.146:0/3889766310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f415f1a0 msgr2=0x7f11f40cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.414+0000 7f11fa512640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f415f1a0 0x7f11f40cc1c0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c3a0 tx=0x7f11e800c860 comp rx=0 tx=0).stop 2024-09-17T03:40:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.414+0000 7f11fa512640 1 -- 172.21.15.146:0/3889766310 shutdown_connections 2024-09-17T03:40:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.414+0000 7f11fa512640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f11e0078b90 0x7f11e007b0a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.414+0000 7f11fa512640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11f41631a0 0x7f11f414fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.414+0000 7f11fa512640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f415f1a0 0x7f11f40cc1c0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.414+0000 7f11fa512640 1 --2- 172.21.15.146:0/3889766310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11f40b61f0 0x7f11f40caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.414+0000 7f11fa512640 1 -- 172.21.15.146:0/3889766310 >> 172.21.15.146:0/3889766310 conn(0x7f11f40d11f0 msgr2=0x7f11f40b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.415+0000 7f11fa512640 1 -- 172.21.15.146:0/3889766310 shutdown_connections 2024-09-17T03:40:09.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.415+0000 7f11fa512640 1 -- 172.21.15.146:0/3889766310 wait complete. 2024-09-17T03:40:09.427 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:40:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.543+0000 7fc57c1a9640 1 -- 172.21.15.146:0/4202942236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740b47c0 msgr2=0x7fc5740cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.543+0000 7fc57c1a9640 1 --2- 172.21.15.146:0/4202942236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740b47c0 0x7fc5740cd090 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fc564009830 tx=0x7fc56402a530 comp rx=0 tx=0).stop 2024-09-17T03:40:09.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.543+0000 7fc57c1a9640 1 -- 172.21.15.146:0/4202942236 shutdown_connections 2024-09-17T03:40:09.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.543+0000 7fc57c1a9640 1 --2- 172.21.15.146:0/4202942236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740b47c0 0x7fc5740cd090 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.543+0000 7fc57c1a9640 1 -- 172.21.15.146:0/4202942236 >> 172.21.15.146:0/4202942236 conn(0x7fc57409ba20 msgr2=0x7fc5740b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:09.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.543+0000 7fc57c1a9640 1 -- 172.21.15.146:0/4202942236 shutdown_connections 2024-09-17T03:40:09.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.543+0000 7fc57c1a9640 1 -- 172.21.15.146:0/4202942236 wait complete. 2024-09-17T03:40:09.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.545+0000 7fc57c1a9640 1 Processor -- start 2024-09-17T03:40:09.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.545+0000 7fc57c1a9640 1 -- start start 2024-09-17T03:40:09.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.546+0000 7fc57c1a9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5740b47c0 0x7fc5740c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.546+0000 7fc57c1a9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5740cd5d0 0x7fc574163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.546+0000 7fc57c1a9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740d0710 0x7fc574163cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.546+0000 7fc57c1a9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740b2f30 con 0x7fc5740d0710 2024-09-17T03:40:09.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.546+0000 7fc57c1a9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740b80a0 con 0x7fc5740b47c0 2024-09-17T03:40:09.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.546+0000 7fc57c1a9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc574168470 con 0x7fc5740cd5d0 2024-09-17T03:40:09.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.546+0000 7fc57a746640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740d0710 0x7fc574163cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.546+0000 7fc57a746640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740d0710 0x7fc574163cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39926/0 (socket says 172.21.15.146:39926) 2024-09-17T03:40:09.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.546+0000 7fc57a746640 1 -- 172.21.15.146:0/2330313540 learned_addr learned my addr 172.21.15.146:0/2330313540 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:09.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.546+0000 7fc579f45640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5740b47c0 0x7fc5740c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc579744640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5740cd5d0 0x7fc574163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc57a746640 1 -- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5740cd5d0 msgr2=0x7fc574163790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc57a746640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5740cd5d0 0x7fc574163790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc57a746640 1 -- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5740b47c0 msgr2=0x7fc5740c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc57a746640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5740b47c0 0x7fc5740c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc57a746640 1 -- 172.21.15.146:0/2330313540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57406fc30 con 0x7fc5740d0710 2024-09-17T03:40:09.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc579744640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5740cd5d0 0x7fc574163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:09.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc57a746640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740d0710 0x7fc574163cd0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00c700 tx=0x7fc56c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:09.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc56a7fc640 1 -- 172.21.15.146:0/2330313540 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c003b70 con 0x7fc5740d0710 2024-09-17T03:40:09.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc56a7fc640 1 -- 172.21.15.146:0/2330313540 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc56c003d10 con 0x7fc5740d0710 2024-09-17T03:40:09.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc57c1a9640 1 -- 172.21.15.146:0/2330313540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5740af860 con 0x7fc5740d0710 2024-09-17T03:40:09.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc56a7fc640 1 -- 172.21.15.146:0/2330313540 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c00aab0 con 0x7fc5740d0710 2024-09-17T03:40:09.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.547+0000 7fc57c1a9640 1 -- 172.21.15.146:0/2330313540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5740afe20 con 0x7fc5740d0710 2024-09-17T03:40:09.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.548+0000 7fc57c1a9640 1 -- 172.21.15.146:0/2330313540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5740c5b60 con 0x7fc5740d0710 2024-09-17T03:40:09.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.549+0000 7fc56a7fc640 1 -- 172.21.15.146:0/2330313540 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc56c00ac50 con 0x7fc5740d0710 2024-09-17T03:40:09.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.549+0000 7fc56a7fc640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc558078bc0 0x7fc55807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.549+0000 7fc56a7fc640 1 -- 172.21.15.146:0/2330313540 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4943+0+0 (secure 0 0 0) 0x7fc56c09a730 con 0x7fc5740d0710 2024-09-17T03:40:09.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.549+0000 7fc579f45640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc558078bc0 0x7fc55807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.550+0000 7fc579f45640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc558078bc0 0x7fc55807b0d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc570000f60 tx=0x7fc570009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:09.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.554+0000 7fc56a7fc640 1 -- 172.21.15.146:0/2330313540 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc56c062f00 con 0x7fc5740d0710 2024-09-17T03:40:09.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.727+0000 7fc57c1a9640 1 -- 172.21.15.146:0/2330313540 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc5740cd090 con 0x7fc5740d0710 2024-09-17T03:40:09.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.728+0000 7fc56a7fc640 1 -- 172.21.15.146:0/2330313540 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v51) ==== 59+0+2294 (secure 0 0 0) 0x7fc56c062800 con 0x7fc5740d0710 2024-09-17T03:40:09.728 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:40:09.728 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:40:09.728 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:40:09.728 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:40:09.728 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:40:09.729 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:40:09.729 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:40:09.729 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:40:09.729 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:40:09.729 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:40:09.729 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:40:09.730 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:40:09.730 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:40:09.730 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:40:09.730 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:40:09.730 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:40:09.730 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:40:09.731 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:40:09.731 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:40:09.731 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:40:09.731 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:40:09.731 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:40:09.731 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:40:09.732 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:40:09.732 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:40:09.732 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:40:09.732 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:40:09.732 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:40:09.733 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:40:09.733 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:40:09.733 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:40:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 -- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc558078bc0 msgr2=0x7fc55807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc558078bc0 0x7fc55807b0d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc570000f60 tx=0x7fc570009040 comp rx=0 tx=0).stop 2024-09-17T03:40:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 -- 172.21.15.146:0/2330313540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740d0710 msgr2=0x7fc574163cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740d0710 0x7fc574163cd0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00c700 tx=0x7fc56c00cbc0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 -- 172.21.15.146:0/2330313540 shutdown_connections 2024-09-17T03:40:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc558078bc0 0x7fc55807b0d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5740d0710 0x7fc574163cd0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5740cd5d0 0x7fc574163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 --2- 172.21.15.146:0/2330313540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5740b47c0 0x7fc5740c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 -- 172.21.15.146:0/2330313540 >> 172.21.15.146:0/2330313540 conn(0x7fc57409ba20 msgr2=0x7fc5740ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 -- 172.21.15.146:0/2330313540 shutdown_connections 2024-09-17T03:40:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.730+0000 7fc57c1a9640 1 -- 172.21.15.146:0/2330313540 wait complete. 2024-09-17T03:40:09.741 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:40:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.858+0000 7f6b40270640 1 -- 172.21.15.146:0/1368372176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b380701e0 msgr2=0x7f6b380cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.858+0000 7f6b40270640 1 --2- 172.21.15.146:0/1368372176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b380701e0 0x7f6b380cfea0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6b3815d000 tx=0x7f6b3002aa90 comp rx=0 tx=0).stop 2024-09-17T03:40:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.859+0000 7f6b40270640 1 -- 172.21.15.146:0/1368372176 shutdown_connections 2024-09-17T03:40:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.859+0000 7f6b40270640 1 --2- 172.21.15.146:0/1368372176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b380701e0 0x7f6b380cfea0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.859+0000 7f6b40270640 1 --2- 172.21.15.146:0/1368372176 >> v2:172.21.15.179:3300/0 conn(0x7f6b3815c9f0 0x7f6b381526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.859+0000 7f6b40270640 1 -- 172.21.15.146:0/1368372176 >> 172.21.15.146:0/1368372176 conn(0x7f6b3806d3c0 msgr2=0x7f6b380b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:09.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.859+0000 7f6b40270640 1 -- 172.21.15.146:0/1368372176 shutdown_connections 2024-09-17T03:40:09.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.859+0000 7f6b40270640 1 -- 172.21.15.146:0/1368372176 wait complete. 2024-09-17T03:40:09.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.860+0000 7f6b40270640 1 Processor -- start 2024-09-17T03:40:09.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.861+0000 7f6b40270640 1 -- start start 2024-09-17T03:40:09.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b40270640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b380b4100 0x7f6b3814b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b40270640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b380cc930 0x7f6b380b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b40270640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b380b1620 0x7f6b380af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b40270640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6b380d0770 con 0x7f6b380b4100 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b40270640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6b380d05f0 con 0x7f6b380b1620 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b40270640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6b380d08f0 con 0x7f6b380cc930 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3e00c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b380b4100 0x7f6b3814b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3e00c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b380b4100 0x7f6b3814b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39940/0 (socket says 172.21.15.146:39940) 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3e00c640 1 -- 172.21.15.146:0/372788975 learned_addr learned my addr 172.21.15.146:0/372788975 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3e80d640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b380b1620 0x7f6b380af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3d80b640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b380cc930 0x7f6b380b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3e00c640 1 -- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b380cc930 msgr2=0x7f6b380b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3e00c640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b380cc930 0x7f6b380b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3e00c640 1 -- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b380b1620 msgr2=0x7f6b380af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3e00c640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b380b1620 0x7f6b380af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:09.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3e00c640 1 -- 172.21.15.146:0/372788975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b380b1a30 con 0x7f6b380b4100 2024-09-17T03:40:09.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3e80d640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b380b1620 0x7f6b380af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:09.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.862+0000 7f6b3e00c640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b380b4100 0x7f6b3814b960 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f6b28009fd0 tx=0x7f6b2800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:09.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.863+0000 7f6b36ffd640 1 -- 172.21.15.146:0/372788975 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2800ccc0 con 0x7f6b380b4100 2024-09-17T03:40:09.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.863+0000 7f6b36ffd640 1 -- 172.21.15.146:0/372788975 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b2800ee70 con 0x7f6b380b4100 2024-09-17T03:40:09.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.863+0000 7f6b36ffd640 1 -- 172.21.15.146:0/372788975 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2800ce60 con 0x7f6b380b4100 2024-09-17T03:40:09.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.863+0000 7f6b40270640 1 -- 172.21.15.146:0/372788975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b380ae9c0 con 0x7f6b380b4100 2024-09-17T03:40:09.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.863+0000 7f6b40270640 1 -- 172.21.15.146:0/372788975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b380aef80 con 0x7f6b380b4100 2024-09-17T03:40:09.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.864+0000 7f6b40270640 1 -- 172.21.15.146:0/372788975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b3815c9f0 con 0x7f6b380b4100 2024-09-17T03:40:09.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.864+0000 7f6b36ffd640 1 -- 172.21.15.146:0/372788975 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b28004280 con 0x7f6b380b4100 2024-09-17T03:40:09.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.865+0000 7f6b36ffd640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b24078b90 0x7f6b2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:09.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.865+0000 7f6b36ffd640 1 -- 172.21.15.146:0/372788975 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4943+0+0 (secure 0 0 0) 0x7f6b2809b2f0 con 0x7f6b380b4100 2024-09-17T03:40:09.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.865+0000 7f6b3d80b640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b24078b90 0x7f6b2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:09.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.866+0000 7f6b3d80b640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b24078b90 0x7f6b2407b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6b380c6900 tx=0x7f6b2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:09.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:09.869+0000 7f6b36ffd640 1 -- 172.21.15.146:0/372788975 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6b380b1a30 con 0x7f6b380b4100 2024-09-17T03:40:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.043+0000 7f6b40270640 1 -- 172.21.15.146:0/372788975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6b3815e850 con 0x7f6b380b4100 2024-09-17T03:40:10.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.047+0000 7f6b36ffd640 1 -- 172.21.15.146:0/372788975 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7f6b28063ac0 con 0x7f6b380b4100 2024-09-17T03:40:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 -- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b24078b90 msgr2=0x7f6b2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b24078b90 0x7f6b2407b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6b380c6900 tx=0x7f6b2c009040 comp rx=0 tx=0).stop 2024-09-17T03:40:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 -- 172.21.15.146:0/372788975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b380b4100 msgr2=0x7f6b3814b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b380b4100 0x7f6b3814b960 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f6b28009fd0 tx=0x7f6b2800ec20 comp rx=0 tx=0).stop 2024-09-17T03:40:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 -- 172.21.15.146:0/372788975 shutdown_connections 2024-09-17T03:40:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b24078b90 0x7f6b2407b0a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b380b1620 0x7f6b380af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b380cc930 0x7f6b380b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 --2- 172.21.15.146:0/372788975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b380b4100 0x7f6b3814b960 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 -- 172.21.15.146:0/372788975 >> 172.21.15.146:0/372788975 conn(0x7f6b3806d3c0 msgr2=0x7f6b38072c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 -- 172.21.15.146:0/372788975 shutdown_connections 2024-09-17T03:40:10.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.049+0000 7f6b40270640 1 -- 172.21.15.146:0/372788975 wait complete. 2024-09-17T03:40:10.060 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:40:10.060 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:10.107 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:10.154 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:40:10.154 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:40:10.154 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:10.170 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:40:10.170 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:40:10.170 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:10.188 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:10.188 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:40:10.189 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:10.225 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:40:10.225 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:40:10.225 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:10.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:10.246 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:40:10.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.380+0000 7feeea79d640 1 -- 172.21.15.146:0/3801616403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feed00053a0 msgr2=0x7feed000ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.380+0000 7feeea79d640 1 --2- 172.21.15.146:0/3801616403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feed00053a0 0x7feed000ba50 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7feedc009ed0 tx=0x7feed0005830 comp rx=0 tx=0).stop 2024-09-17T03:40:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.380+0000 7feeea79d640 1 -- 172.21.15.146:0/3801616403 shutdown_connections 2024-09-17T03:40:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.380+0000 7feeea79d640 1 --2- 172.21.15.146:0/3801616403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feed00053a0 0x7feed000ba50 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.381+0000 7feeea79d640 1 -- 172.21.15.146:0/3801616403 >> 172.21.15.146:0/3801616403 conn(0x7feee406d120 msgr2=0x7feee406d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.381+0000 7feeea79d640 1 -- 172.21.15.146:0/3801616403 shutdown_connections 2024-09-17T03:40:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.381+0000 7feeea79d640 1 -- 172.21.15.146:0/3801616403 wait complete. 2024-09-17T03:40:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.382+0000 7feeea79d640 1 Processor -- start 2024-09-17T03:40:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.382+0000 7feeea79d640 1 -- start start 2024-09-17T03:40:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feeea79d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feed00053a0 0x7feee41f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feeea79d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4150760 0x7feee41575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feeea79d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee41f5b00 0x7feee41f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feeea79d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feee40d0d40 con 0x7feee4150760 2024-09-17T03:40:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feeea79d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feee40d2cb0 con 0x7feee41f5b00 2024-09-17T03:40:10.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feeea79d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7feee40d0ec0 con 0x7feed00053a0 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feee8f9a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4150760 0x7feee41575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feee8f9a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4150760 0x7feee41575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39946/0 (socket says 172.21.15.146:39946) 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feee8f9a640 1 -- 172.21.15.146:0/1635311003 learned_addr learned my addr 172.21.15.146:0/1635311003 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feee979b640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feed00053a0 0x7feee41f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feee9f9c640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee41f5b00 0x7feee41f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feee8f9a640 1 -- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feed00053a0 msgr2=0x7feee41f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feee8f9a640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feed00053a0 0x7feee41f8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feee8f9a640 1 -- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee41f5b00 msgr2=0x7feee41f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feee8f9a640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee41f5b00 0x7feee41f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feee8f9a640 1 -- 172.21.15.146:0/1635311003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee40b4590 con 0x7feee4150760 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feee8f9a640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4150760 0x7feee41575c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7feed40063e0 tx=0x7feed40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feed9ffb640 1 -- 172.21.15.146:0/1635311003 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4015070 con 0x7feee4150760 2024-09-17T03:40:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feed9ffb640 1 -- 172.21.15.146:0/1635311003 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feed4011840 con 0x7feee4150760 2024-09-17T03:40:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feeea79d640 1 -- 172.21.15.146:0/1635311003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee40b4870 con 0x7feee4150760 2024-09-17T03:40:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.384+0000 7feed9ffb640 1 -- 172.21.15.146:0/1635311003 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4011c90 con 0x7feee4150760 2024-09-17T03:40:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.385+0000 7feeea79d640 1 -- 172.21.15.146:0/1635311003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee40b4020 con 0x7feee4150760 2024-09-17T03:40:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.386+0000 7feeea79d640 1 -- 172.21.15.146:0/1635311003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee41f5410 con 0x7feee4150760 2024-09-17T03:40:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.387+0000 7feed9ffb640 1 -- 172.21.15.146:0/1635311003 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feed4018070 con 0x7feee4150760 2024-09-17T03:40:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.387+0000 7feed9ffb640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feec8078b90 0x7feec807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.387+0000 7feed9ffb640 1 -- 172.21.15.146:0/1635311003 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4943+0+0 (secure 0 0 0) 0x7feed409b620 con 0x7feee4150760 2024-09-17T03:40:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.387+0000 7feee979b640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feec8078b90 0x7feec807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.388+0000 7feee979b640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feec8078b90 0x7feec807b0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7feee0000c00 tx=0x7feee0006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:10.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.391+0000 7feed9ffb640 1 -- 172.21.15.146:0/1635311003 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feed4063830 con 0x7feee4150760 2024-09-17T03:40:10.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.604+0000 7feeea79d640 1 -- 172.21.15.146:0/1635311003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feee40b4320 con 0x7feee4150760 2024-09-17T03:40:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.604+0000 7feed9ffb640 1 -- 172.21.15.146:0/1635311003 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+3914 (secure 0 0 0) 0x7feed4068260 con 0x7feee4150760 2024-09-17T03:40:10.604 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:10.604 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":80,"btime":"2024-09-17T03:40:04:121601+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/351223948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":351223948},{"type":"v1","addr":"172.21.15.146:6835","nonce":351223948}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7015,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/985271714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":985271714},{"type":"v1","addr":"172.21.15.179:6835","nonce":985271714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/781824323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":781824323},{"type":"v1","addr":"172.21.15.179:6837","nonce":781824323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":8121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1226077783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1226077783},{"type":"v1","addr":"172.21.15.146:6834","nonce":1226077783}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[]} 2024-09-17T03:40:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 80 2024-09-17T03:40:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 -- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feec8078b90 msgr2=0x7feec807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feec8078b90 0x7feec807b0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7feee0000c00 tx=0x7feee0006b70 comp rx=0 tx=0).stop 2024-09-17T03:40:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 -- 172.21.15.146:0/1635311003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4150760 msgr2=0x7feee41575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4150760 0x7feee41575c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7feed40063e0 tx=0x7feed40039c0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 -- 172.21.15.146:0/1635311003 shutdown_connections 2024-09-17T03:40:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feec8078b90 0x7feec807b0a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feee41f5b00 0x7feee41f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4150760 0x7feee41575c0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 --2- 172.21.15.146:0/1635311003 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feed00053a0 0x7feee41f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 -- 172.21.15.146:0/1635311003 >> 172.21.15.146:0/1635311003 conn(0x7feee406d120 msgr2=0x7feee415b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 -- 172.21.15.146:0/1635311003 shutdown_connections 2024-09-17T03:40:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.606+0000 7feeea79d640 1 -- 172.21.15.146:0/1635311003 wait complete. 2024-09-17T03:40:10.617 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:40:10.617 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:40:10.617 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:40:10.618 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:10.618 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:40:10.618 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:40:10.618 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:40:10.618 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:10.618 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:40:10.618 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:40:10.619 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:40:10.619 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:10.619 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:40:10.619 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:40:10.619 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:40:10.619 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:10.628 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:40:10.628 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:40:10.630 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:40:10.630 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:40:10.631 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:40:10.631 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:40:10.632 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:40:10.632 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:40:10.672 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:40:10.673 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:10.674 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:40:10.674 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:10.675 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:40:10.675 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:10.675 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:40:10.676 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:10.676 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:40:10.758 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:40:10.759 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:40:10.769 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:40:10.770 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:40:10.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.798+0000 7f019e539640 1 -- 172.21.15.146:0/4230341335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01980d0710 msgr2=0x7f01980cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.798+0000 7f019e539640 1 --2- 172.21.15.146:0/4230341335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01980d0710 0x7f01980cf170 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f01980743d0 tx=0x7f018802a4f0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.798+0000 7f019e539640 1 -- 172.21.15.146:0/4230341335 shutdown_connections 2024-09-17T03:40:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.798+0000 7f019e539640 1 --2- 172.21.15.146:0/4230341335 >> v2:172.21.15.179:3300/0 conn(0x7f01980b47c0 0x7f0198161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.798+0000 7f019e539640 1 --2- 172.21.15.146:0/4230341335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01980cf6b0 0x7f0198161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.798+0000 7f019e539640 1 --2- 172.21.15.146:0/4230341335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01980d0710 0x7f01980cf170 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.798+0000 7f019e539640 1 -- 172.21.15.146:0/4230341335 >> 172.21.15.146:0/4230341335 conn(0x7f019809ba20 msgr2=0x7f01980b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.798+0000 7f019e539640 1 -- 172.21.15.146:0/4230341335 shutdown_connections 2024-09-17T03:40:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.799+0000 7f019e539640 1 -- 172.21.15.146:0/4230341335 wait complete. 2024-09-17T03:40:10.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.800+0000 7f019e539640 1 Processor -- start 2024-09-17T03:40:10.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.800+0000 7f019e539640 1 -- start start 2024-09-17T03:40:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f019e539640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01980b47c0 0x7f019815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f019e539640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01980cf6b0 0x7f01980b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f019e539640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01980d0710 0x7f01980b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f019e539640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0198162030 con 0x7f01980b47c0 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f019e539640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0198161eb0 con 0x7f01980d0710 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f019e539640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f01980cd090 con 0x7f01980cf6b0 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f0197fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01980b47c0 0x7f019815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f0197fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01980b47c0 0x7f019815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40006/0 (socket says 172.21.15.146:40006) 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f0197fff640 1 -- 172.21.15.146:0/1871722634 learned_addr learned my addr 172.21.15.146:0/1871722634 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f019cad6640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01980d0710 0x7f01980b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f01977fe640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01980cf6b0 0x7f01980b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f0197fff640 1 -- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01980cf6b0 msgr2=0x7f01980b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f0197fff640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01980cf6b0 0x7f01980b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f0197fff640 1 -- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01980d0710 msgr2=0x7f01980b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f0197fff640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01980d0710 0x7f01980b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f0197fff640 1 -- 172.21.15.146:0/1871722634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019806ec10 con 0x7f01980b47c0 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f019cad6640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01980d0710 0x7f01980b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f0197fff640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01980b47c0 0x7f019815a4c0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f0188006010 tx=0x7f01880038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f0194ff9640 1 -- 172.21.15.146:0/1871722634 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018803e030 con 0x7f01980b47c0 2024-09-17T03:40:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.802+0000 7f0194ff9640 1 -- 172.21.15.146:0/1871722634 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0188003d90 con 0x7f01980b47c0 2024-09-17T03:40:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.803+0000 7f019e539640 1 -- 172.21.15.146:0/1871722634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019806eef0 con 0x7f01980b47c0 2024-09-17T03:40:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.803+0000 7f0194ff9640 1 -- 172.21.15.146:0/1871722634 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0188035040 con 0x7f01980b47c0 2024-09-17T03:40:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.803+0000 7f019e539640 1 -- 172.21.15.146:0/1871722634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019806f4b0 con 0x7f01980b47c0 2024-09-17T03:40:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.803+0000 7f019e539640 1 -- 172.21.15.146:0/1871722634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01980cf170 con 0x7f01980b47c0 2024-09-17T03:40:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.804+0000 7f0194ff9640 1 -- 172.21.15.146:0/1871722634 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0188041030 con 0x7f01980b47c0 2024-09-17T03:40:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.805+0000 7f0194ff9640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0184078b90 0x7f018407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.805+0000 7f0194ff9640 1 -- 172.21.15.146:0/1871722634 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4943+0+0 (secure 0 0 0) 0x7f01880bb040 con 0x7f01980b47c0 2024-09-17T03:40:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.805+0000 7f01977fe640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0184078b90 0x7f018407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.805+0000 7f01977fe640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0184078b90 0x7f018407b0a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f019815df10 tx=0x7f018c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.809+0000 7f0194ff9640 1 -- 172.21.15.146:0/1871722634 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01880831c0 con 0x7f01980b47c0 2024-09-17T03:40:10.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:10.997+0000 7f019e539640 1 -- 172.21.15.146:0/1871722634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f019815c370 con 0x7f01980b47c0 2024-09-17T03:40:11.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.436+0000 7f0194ff9640 1 -- 172.21.15.146:0/1871722634 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v111) ==== 97+0+0 (secure 0 0 0) 0x7f0188087bf0 con 0x7f01980b47c0 2024-09-17T03:40:11.436 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:40:11.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 -- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0184078b90 msgr2=0x7f018407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0184078b90 0x7f018407b0a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f019815df10 tx=0x7f018c005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:11.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 -- 172.21.15.146:0/1871722634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01980b47c0 msgr2=0x7f019815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01980b47c0 0x7f019815a4c0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f0188006010 tx=0x7f01880038a0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 -- 172.21.15.146:0/1871722634 shutdown_connections 2024-09-17T03:40:11.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0184078b90 0x7f018407b0a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01980d0710 0x7f01980b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01980cf6b0 0x7f01980b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 --2- 172.21.15.146:0/1871722634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01980b47c0 0x7f019815a4c0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 -- 172.21.15.146:0/1871722634 >> 172.21.15.146:0/1871722634 conn(0x7f019809ba20 msgr2=0x7f019815fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:11.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 -- 172.21.15.146:0/1871722634 shutdown_connections 2024-09-17T03:40:11.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.439+0000 7f019e539640 1 -- 172.21.15.146:0/1871722634 wait complete. 2024-09-17T03:40:11.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:40:11.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.568+0000 7fe3f1739640 1 -- 172.21.15.146:0/1618990316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec06f440 msgr2=0x7fe3ec169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.568+0000 7fe3f1739640 1 --2- 172.21.15.146:0/1618990316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec06f440 0x7fe3ec169c10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4005fd0 tx=0x7fe3e402aaa0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.568+0000 7fe3f1739640 1 -- 172.21.15.146:0/1618990316 shutdown_connections 2024-09-17T03:40:11.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.568+0000 7fe3f1739640 1 --2- 172.21.15.146:0/1618990316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec06f440 0x7fe3ec169c10 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.568+0000 7fe3f1739640 1 -- 172.21.15.146:0/1618990316 >> 172.21.15.146:0/1618990316 conn(0x7fe3ec0d4be0 msgr2=0x7fe3ec0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:11.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.568+0000 7fe3f1739640 1 -- 172.21.15.146:0/1618990316 shutdown_connections 2024-09-17T03:40:11.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.568+0000 7fe3f1739640 1 -- 172.21.15.146:0/1618990316 wait complete. 2024-09-17T03:40:11.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.569+0000 7fe3f1739640 1 Processor -- start 2024-09-17T03:40:11.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.570+0000 7fe3f1739640 1 -- start start 2024-09-17T03:40:11.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3f1739640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec0b3870 0x7fe3ec15c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3f1739640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0cf370 0x7fe3ec1547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3f1739640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec0b6780 0x7fe3ec0b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3f1739640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec16a2d0 con 0x7fe3ec0cf370 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3f1739640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec16a150 con 0x7fe3ec0b3870 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3f1739640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe3ec16a450 con 0x7fe3ec0b6780 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3e27fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0cf370 0x7fe3ec1547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3e27fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0cf370 0x7fe3ec1547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40022/0 (socket says 172.21.15.146:40022) 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3e27fc640 1 -- 172.21.15.146:0/2281876196 learned_addr learned my addr 172.21.15.146:0/2281876196 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3eaffd640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec0b3870 0x7fe3ec15c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3eb7fe640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec0b6780 0x7fe3ec0b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3e27fc640 1 -- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec0b6780 msgr2=0x7fe3ec0b6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3e27fc640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec0b6780 0x7fe3ec0b6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3e27fc640 1 -- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec0b3870 msgr2=0x7fe3ec15c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3e27fc640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec0b3870 0x7fe3ec15c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.571+0000 7fe3e27fc640 1 -- 172.21.15.146:0/2281876196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ec0b70d0 con 0x7fe3ec0cf370 2024-09-17T03:40:11.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.572+0000 7fe3e27fc640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0cf370 0x7fe3ec1547a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400c3c0 tx=0x7fe3d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:11.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.572+0000 7fe3e3fff640 1 -- 172.21.15.146:0/2281876196 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40052d0 con 0x7fe3ec0cf370 2024-09-17T03:40:11.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.572+0000 7fe3e3fff640 1 -- 172.21.15.146:0/2281876196 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3d4007020 con 0x7fe3ec0cf370 2024-09-17T03:40:11.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.572+0000 7fe3f1739640 1 -- 172.21.15.146:0/2281876196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ec15dc60 con 0x7fe3ec0cf370 2024-09-17T03:40:11.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.572+0000 7fe3e3fff640 1 -- 172.21.15.146:0/2281876196 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4007470 con 0x7fe3ec0cf370 2024-09-17T03:40:11.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.572+0000 7fe3f1739640 1 -- 172.21.15.146:0/2281876196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ec155c00 con 0x7fe3ec0cf370 2024-09-17T03:40:11.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.573+0000 7fe3f1739640 1 -- 172.21.15.146:0/2281876196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3ec1620f0 con 0x7fe3ec0cf370 2024-09-17T03:40:11.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.574+0000 7fe3e3fff640 1 -- 172.21.15.146:0/2281876196 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3d40067d0 con 0x7fe3ec0cf370 2024-09-17T03:40:11.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.574+0000 7fe3e3fff640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3cc078bc0 0x7fe3cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.574+0000 7fe3e3fff640 1 -- 172.21.15.146:0/2281876196 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4857+0+0 (secure 0 0 0) 0x7fe3d4099e90 con 0x7fe3ec0cf370 2024-09-17T03:40:11.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.574+0000 7fe3eaffd640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3cc078bc0 0x7fe3cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.575+0000 7fe3eaffd640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3cc078bc0 0x7fe3cc07b0d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc001770 tx=0x7fe3dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:11.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.579+0000 7fe3e3fff640 1 -- 172.21.15.146:0/2281876196 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe3ec0b70d0 con 0x7fe3ec0cf370 2024-09-17T03:40:11.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.824+0000 7fe3f1739640 1 -- 172.21.15.146:0/2281876196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe3ec0d2bb0 con 0x7fe3ec0cf370 2024-09-17T03:40:11.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.825+0000 7fe3e3fff640 1 -- 172.21.15.146:0/2281876196 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7fe3d4061fd0 con 0x7fe3ec0cf370 2024-09-17T03:40:11.824 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:11.824 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:40:11.824 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:40:11.824 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.824 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:40:11.824 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:40:11.824 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:40:11.825 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.826 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.827 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.828 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:40:11.829 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:40:11.831 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:40:11.833 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:40:11.834 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.835 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:40:11.836 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:40:11.836 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.836 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:40:11.836 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:40:11.836 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:40:11.836 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.836 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.836 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.836 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:40:11.837 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:40:11.838 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:40:11.838 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.838 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:11.838 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:40:11.838 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:40:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 -- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3cc078bc0 msgr2=0x7fe3cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3cc078bc0 0x7fe3cc07b0d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc001770 tx=0x7fe3dc009040 comp rx=0 tx=0).stop 2024-09-17T03:40:11.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 -- 172.21.15.146:0/2281876196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0cf370 msgr2=0x7fe3ec1547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0cf370 0x7fe3ec1547a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400c3c0 tx=0x7fe3d400c880 comp rx=0 tx=0).stop 2024-09-17T03:40:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 -- 172.21.15.146:0/2281876196 shutdown_connections 2024-09-17T03:40:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3cc078bc0 0x7fe3cc07b0d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3ec0b6780 0x7fe3ec0b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3ec0cf370 0x7fe3ec1547a0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 --2- 172.21.15.146:0/2281876196 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3ec0b3870 0x7fe3ec15c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 -- 172.21.15.146:0/2281876196 >> 172.21.15.146:0/2281876196 conn(0x7fe3ec0d4be0 msgr2=0x7fe3ec0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 -- 172.21.15.146:0/2281876196 shutdown_connections 2024-09-17T03:40:11.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.827+0000 7fe3f1739640 1 -- 172.21.15.146:0/2281876196 wait complete. 2024-09-17T03:40:11.841 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:40:11.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.956+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/620972755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd20004d40 msgr2=0x7fbd20005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.956+0000 7fbd3b6f9640 1 --2- 172.21.15.146:0/620972755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd20004d40 0x7fbd20005150 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fbd340755b0 tx=0x7fbd20005830 comp rx=0 tx=0).stop 2024-09-17T03:40:11.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.956+0000 7fbd39c96640 1 -- 172.21.15.146:0/620972755 reap_dead start 2024-09-17T03:40:11.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.956+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/620972755 shutdown_connections 2024-09-17T03:40:11.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.956+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/620972755 >> 172.21.15.146:0/620972755 conn(0x7fbd340b7b20 msgr2=0x7fbd3409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:11.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.956+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/620972755 shutdown_connections 2024-09-17T03:40:11.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.956+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/620972755 wait complete. 2024-09-17T03:40:11.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.958+0000 7fbd3b6f9640 1 Processor -- start 2024-09-17T03:40:11.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.958+0000 7fbd3b6f9640 1 -- start start 2024-09-17T03:40:11.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.959+0000 7fbd3b6f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd20004d40 0x7fbd341f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.959+0000 7fbd3b6f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd3415c4b0 0x7fbd341f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.959+0000 7fbd3b6f9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd341f9240 0x7fbd34142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.959+0000 7fbd3b6f9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3406e030 con 0x7fbd20004d40 2024-09-17T03:40:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.959+0000 7fbd3b6f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3406deb0 con 0x7fbd3415c4b0 2024-09-17T03:40:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.959+0000 7fbd3b6f9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbd3406e1b0 con 0x7fbd341f9240 2024-09-17T03:40:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd39495640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd20004d40 0x7fbd341f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd39495640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd20004d40 0x7fbd341f6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40038/0 (socket says 172.21.15.146:40038) 2024-09-17T03:40:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd39495640 1 -- 172.21.15.146:0/3995408601 learned_addr learned my addr 172.21.15.146:0/3995408601 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd39c96640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd341f9240 0x7fbd34142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd38c94640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd3415c4b0 0x7fbd341f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd39495640 1 -- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd341f9240 msgr2=0x7fbd34142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd39495640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd341f9240 0x7fbd34142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd39495640 1 -- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd3415c4b0 msgr2=0x7fbd341f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd39495640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd3415c4b0 0x7fbd341f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd39495640 1 -- 172.21.15.146:0/3995408601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3415dd60 con 0x7fbd20004d40 2024-09-17T03:40:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd39495640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd20004d40 0x7fbd341f6140 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fbd30011ae0 tx=0x7fbd30009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd29ffb640 1 -- 172.21.15.146:0/3995408601 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3001e070 con 0x7fbd20004d40 2024-09-17T03:40:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd29ffb640 1 -- 172.21.15.146:0/3995408601 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd3000fc70 con 0x7fbd20004d40 2024-09-17T03:40:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/3995408601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3415ccc0 con 0x7fbd20004d40 2024-09-17T03:40:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd29ffb640 1 -- 172.21.15.146:0/3995408601 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd30019670 con 0x7fbd20004d40 2024-09-17T03:40:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.960+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/3995408601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3415d280 con 0x7fbd20004d40 2024-09-17T03:40:11.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.962+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/3995408601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3406e990 con 0x7fbd20004d40 2024-09-17T03:40:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.962+0000 7fbd29ffb640 1 -- 172.21.15.146:0/3995408601 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd30021070 con 0x7fbd20004d40 2024-09-17T03:40:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.963+0000 7fbd29ffb640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd18078b90 0x7fbd1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.963+0000 7fbd29ffb640 1 -- 172.21.15.146:0/3995408601 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4857+0+0 (secure 0 0 0) 0x7fbd3009b220 con 0x7fbd20004d40 2024-09-17T03:40:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.963+0000 7fbd38c94640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd18078b90 0x7fbd1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:11.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.964+0000 7fbd38c94640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd18078b90 0x7fbd1807b0a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbd340a0600 tx=0x7fbd24000fb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:11.967+0000 7fbd29ffb640 1 -- 172.21.15.146:0/3995408601 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd3000fe60 con 0x7fbd20004d40 2024-09-17T03:40:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.145+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/3995408601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbd34071610 con 0x7fbd20004d40 2024-09-17T03:40:12.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.146+0000 7fbd29ffb640 1 -- 172.21.15.146:0/3995408601 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v113) ==== 84+0+65 (secure 0 0 0) 0x7fbd30063360 con 0x7fbd20004d40 2024-09-17T03:40:12.145 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:12.145 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:40:12.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:40:12.146 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:40:12.146 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:40:12.146 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:12.146 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:40:12.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd18078b90 msgr2=0x7fbd1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd18078b90 0x7fbd1807b0a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbd340a0600 tx=0x7fbd24000fb0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/3995408601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd20004d40 msgr2=0x7fbd341f6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd20004d40 0x7fbd341f6140 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fbd30011ae0 tx=0x7fbd30009ed0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/3995408601 shutdown_connections 2024-09-17T03:40:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd18078b90 0x7fbd1807b0a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd341f9240 0x7fbd34142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd3415c4b0 0x7fbd341f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 --2- 172.21.15.146:0/3995408601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd20004d40 0x7fbd341f6140 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/3995408601 >> 172.21.15.146:0/3995408601 conn(0x7fbd340b7b20 msgr2=0x7fbd340b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:12.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/3995408601 shutdown_connections 2024-09-17T03:40:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.148+0000 7fbd3b6f9640 1 -- 172.21.15.146:0/3995408601 wait complete. 2024-09-17T03:40:12.159 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:40:12.159 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:40:12.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.276+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3559507387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e00b3870 msgr2=0x7fe7e00cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.276+0000 7fe7e4d72640 1 --2- 172.21.15.146:0/3559507387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e00b3870 0x7fe7e00cf370 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0069ce0 tx=0x7fe7d002a4b0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.276+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3559507387 shutdown_connections 2024-09-17T03:40:12.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.276+0000 7fe7e4d72640 1 --2- 172.21.15.146:0/3559507387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e006f270 0x7fe7e01628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.276+0000 7fe7e4d72640 1 --2- 172.21.15.146:0/3559507387 >> v2:172.21.15.179:3300/0 conn(0x7fe7e01620f0 0x7fe7e006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.276+0000 7fe7e4d72640 1 --2- 172.21.15.146:0/3559507387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e00b3870 0x7fe7e00cf370 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.276+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3559507387 >> 172.21.15.146:0/3559507387 conn(0x7fe7e00d4be0 msgr2=0x7fe7e00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:12.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.276+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3559507387 shutdown_connections 2024-09-17T03:40:12.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.276+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3559507387 wait complete. 2024-09-17T03:40:12.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.278+0000 7fe7e4d72640 1 Processor -- start 2024-09-17T03:40:12.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.278+0000 7fe7e4d72640 1 -- start start 2024-09-17T03:40:12.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.279+0000 7fe7e4d72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e006f270 0x7fe7e014fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.279+0000 7fe7e4d72640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e00b3870 0x7fe7e00c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.279+0000 7fe7e4d72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e01620f0 0x7fe7e00c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.279+0000 7fe7e4d72640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e0162f60 con 0x7fe7e00b3870 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.279+0000 7fe7e4d72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e0162de0 con 0x7fe7e006f270 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7e4d72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e01630e0 con 0x7fe7e01620f0 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d5d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e00b3870 0x7fe7e00c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d5d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e00b3870 0x7fe7e00c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40058/0 (socket says 172.21.15.146:40058) 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d5d9b640 1 -- 172.21.15.146:0/3598443849 learned_addr learned my addr 172.21.15.146:0/3598443849 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7de59c640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e006f270 0x7fe7e014fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d5d9b640 1 -- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e01620f0 msgr2=0x7fe7e00c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7ded9d640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e01620f0 0x7fe7e00c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d5d9b640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e01620f0 0x7fe7e00c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d5d9b640 1 -- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e006f270 msgr2=0x7fe7e014fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:12.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d5d9b640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e006f270 0x7fe7e014fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:12.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d5d9b640 1 -- 172.21.15.146:0/3598443849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e00c8220 con 0x7fe7e00b3870 2024-09-17T03:40:12.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d5d9b640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e00b3870 0x7fe7e00c8fe0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800b440 tx=0x7fe7c800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:12.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d77fe640 1 -- 172.21.15.146:0/3598443849 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8015020 con 0x7fe7e00b3870 2024-09-17T03:40:12.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d77fe640 1 -- 172.21.15.146:0/3598443849 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7c8011980 con 0x7fe7e00b3870 2024-09-17T03:40:12.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7d77fe640 1 -- 172.21.15.146:0/3598443849 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8011dd0 con 0x7fe7e00b3870 2024-09-17T03:40:12.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3598443849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e00c8500 con 0x7fe7e00b3870 2024-09-17T03:40:12.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.280+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3598443849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e00c8ac0 con 0x7fe7e00b3870 2024-09-17T03:40:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.281+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3598443849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e00cad60 con 0x7fe7e00b3870 2024-09-17T03:40:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.282+0000 7fe7d77fe640 1 -- 172.21.15.146:0/3598443849 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe7c8018020 con 0x7fe7e00b3870 2024-09-17T03:40:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.282+0000 7fe7d77fe640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7c0078b90 0x7fe7c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.283+0000 7fe7d77fe640 1 -- 172.21.15.146:0/3598443849 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4857+0+0 (secure 0 0 0) 0x7fe7c809aaf0 con 0x7fe7e00b3870 2024-09-17T03:40:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.283+0000 7fe7de59c640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7c0078b90 0x7fe7c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.283+0000 7fe7de59c640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7c0078b90 0x7fe7c007b0a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0033000 tx=0x7fe7d0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:12.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.287+0000 7fe7d77fe640 1 -- 172.21.15.146:0/3598443849 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe7c801f020 con 0x7fe7e00b3870 2024-09-17T03:40:12.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:12.464+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3598443849 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe7e0163660 con 0x7fe7e00b3870 2024-09-17T03:40:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.453+0000 7fe7d77fe640 1 -- 172.21.15.146:0/3598443849 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v114) ==== 138+0+0 (secure 0 0 0) 0x7fe7c800d040 con 0x7fe7e00b3870 2024-09-17T03:40:13.452 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:40:13.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7c0078b90 msgr2=0x7fe7c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:13.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7c0078b90 0x7fe7c007b0a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0033000 tx=0x7fe7d0004730 comp rx=0 tx=0).stop 2024-09-17T03:40:13.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3598443849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e00b3870 msgr2=0x7fe7e00c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:13.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e00b3870 0x7fe7e00c8fe0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800b440 tx=0x7fe7c800b900 comp rx=0 tx=0).stop 2024-09-17T03:40:13.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3598443849 shutdown_connections 2024-09-17T03:40:13.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7c0078b90 0x7fe7c007b0a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7e01620f0 0x7fe7e00c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7e00b3870 0x7fe7e00c8fe0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 --2- 172.21.15.146:0/3598443849 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7e006f270 0x7fe7e014fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3598443849 >> 172.21.15.146:0/3598443849 conn(0x7fe7e00d4be0 msgr2=0x7fe7e00b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:13.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3598443849 shutdown_connections 2024-09-17T03:40:13.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.456+0000 7fe7e4d72640 1 -- 172.21.15.146:0/3598443849 wait complete. 2024-09-17T03:40:13.475 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:40:13.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.603+0000 7fcb346de640 1 -- 172.21.15.146:0/436753582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb2c1604c0 msgr2=0x7fcb2c1608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:13.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.603+0000 7fcb346de640 1 --2- 172.21.15.146:0/436753582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb2c1604c0 0x7fcb2c1608d0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005fd0 tx=0x7fcb1c02a530 comp rx=0 tx=0).stop 2024-09-17T03:40:13.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.603+0000 7fcb346de640 1 -- 172.21.15.146:0/436753582 shutdown_connections 2024-09-17T03:40:13.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.603+0000 7fcb346de640 1 --2- 172.21.15.146:0/436753582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c0b0280 0x7fcb2c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.603+0000 7fcb346de640 1 --2- 172.21.15.146:0/436753582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb2c1604c0 0x7fcb2c1608d0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.603+0000 7fcb346de640 1 -- 172.21.15.146:0/436753582 >> 172.21.15.146:0/436753582 conn(0x7fcb2c0b7ab0 msgr2=0x7fcb2c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:13.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.603+0000 7fcb346de640 1 -- 172.21.15.146:0/436753582 shutdown_connections 2024-09-17T03:40:13.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.603+0000 7fcb346de640 1 -- 172.21.15.146:0/436753582 wait complete. 2024-09-17T03:40:13.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.605+0000 7fcb346de640 1 Processor -- start 2024-09-17T03:40:13.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.605+0000 7fcb346de640 1 -- start start 2024-09-17T03:40:13.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.606+0000 7fcb346de640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb2c0b0280 0x7fcb2c157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:13.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.606+0000 7fcb346de640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb2c15a5e0 0x7fcb2c15f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:13.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.606+0000 7fcb346de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c1604c0 0x7fcb2c1f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:13.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.606+0000 7fcb346de640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c0b0d50 con 0x7fcb2c15a5e0 2024-09-17T03:40:13.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.606+0000 7fcb346de640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c0b0bd0 con 0x7fcb2c0b0280 2024-09-17T03:40:13.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.606+0000 7fcb346de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2c0b0ed0 con 0x7fcb2c1604c0 2024-09-17T03:40:13.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.606+0000 7fcb31c79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb2c15a5e0 0x7fcb2c15f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:13.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb31c79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb2c15a5e0 0x7fcb2c15f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40088/0 (socket says 172.21.15.146:40088) 2024-09-17T03:40:13.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb31c79640 1 -- 172.21.15.146:0/2724981213 learned_addr learned my addr 172.21.15.146:0/2724981213 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:13.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb31c79640 1 -- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c1604c0 msgr2=0x7fcb2c1f7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb3247a640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb2c0b0280 0x7fcb2c157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb32c7b640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c1604c0 0x7fcb2c1f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb31c79640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c1604c0 0x7fcb2c1f7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb31c79640 1 -- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb2c0b0280 msgr2=0x7fcb2c157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb31c79640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb2c0b0280 0x7fcb2c157260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb31c79640 1 -- 172.21.15.146:0/2724981213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c15e0d0 con 0x7fcb2c15a5e0 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb31c79640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb2c15a5e0 0x7fcb2c15f170 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c034040 tx=0x7fcb1c004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb22ffd640 1 -- 172.21.15.146:0/2724981213 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c03e030 con 0x7fcb2c15a5e0 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb22ffd640 1 -- 172.21.15.146:0/2724981213 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb1c0035f0 con 0x7fcb2c15a5e0 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb346de640 1 -- 172.21.15.146:0/2724981213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2c15e3b0 con 0x7fcb2c15a5e0 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb22ffd640 1 -- 172.21.15.146:0/2724981213 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c035040 con 0x7fcb2c15a5e0 2024-09-17T03:40:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.607+0000 7fcb346de640 1 -- 172.21.15.146:0/2724981213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2c15e970 con 0x7fcb2c15a5e0 2024-09-17T03:40:13.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.608+0000 7fcb346de640 1 -- 172.21.15.146:0/2724981213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2c146900 con 0x7fcb2c15a5e0 2024-09-17T03:40:13.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.609+0000 7fcb22ffd640 1 -- 172.21.15.146:0/2724981213 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb1c041030 con 0x7fcb2c15a5e0 2024-09-17T03:40:13.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.610+0000 7fcb22ffd640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb10078b90 0x7fcb1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:13.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.610+0000 7fcb22ffd640 1 -- 172.21.15.146:0/2724981213 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5227+0+0 (secure 0 0 0) 0x7fcb1c0bb460 con 0x7fcb2c15a5e0 2024-09-17T03:40:13.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.610+0000 7fcb3247a640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb10078b90 0x7fcb1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:13.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.611+0000 7fcb3247a640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb10078b90 0x7fcb1007b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800a750 tx=0x7fcb28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:13.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.615+0000 7fcb22ffd640 1 -- 172.21.15.146:0/2724981213 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcb2c146900 con 0x7fcb2c15a5e0 2024-09-17T03:40:13.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:13.794+0000 7fcb346de640 1 -- 172.21.15.146:0/2724981213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcb2c0b1410 con 0x7fcb2c15a5e0 2024-09-17T03:40:14.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.458+0000 7fcb22ffd640 1 -- 172.21.15.146:0/2724981213 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v115) ==== 170+0+0 (secure 0 0 0) 0x7fcb2c0b6f00 con 0x7fcb2c15a5e0 2024-09-17T03:40:14.457 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 -- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb10078b90 msgr2=0x7fcb1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb10078b90 0x7fcb1007b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800a750 tx=0x7fcb28008040 comp rx=0 tx=0).stop 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 -- 172.21.15.146:0/2724981213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb2c15a5e0 msgr2=0x7fcb2c15f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb2c15a5e0 0x7fcb2c15f170 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c034040 tx=0x7fcb1c004cc0 comp rx=0 tx=0).stop 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 -- 172.21.15.146:0/2724981213 shutdown_connections 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcb10078b90 0x7fcb1007b0a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb2c1604c0 0x7fcb2c1f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb2c15a5e0 0x7fcb2c15f170 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 --2- 172.21.15.146:0/2724981213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb2c0b0280 0x7fcb2c157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 -- 172.21.15.146:0/2724981213 >> 172.21.15.146:0/2724981213 conn(0x7fcb2c0b7ab0 msgr2=0x7fcb2c15ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 -- 172.21.15.146:0/2724981213 shutdown_connections 2024-09-17T03:40:14.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.460+0000 7fcb346de640 1 -- 172.21.15.146:0/2724981213 wait complete. 2024-09-17T03:40:14.480 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:40:14.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.599+0000 7f36cec77640 1 -- 172.21.15.146:0/1795087770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c80cfca0 msgr2=0x7f36c80cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.599+0000 7f36cec77640 1 --2- 172.21.15.146:0/1795087770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c80cfca0 0x7f36c80cef40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009830 tx=0x7f36b402a480 comp rx=0 tx=0).stop 2024-09-17T03:40:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.599+0000 7f36cec77640 1 -- 172.21.15.146:0/1795087770 shutdown_connections 2024-09-17T03:40:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.599+0000 7f36cec77640 1 --2- 172.21.15.146:0/1795087770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c80b61f0 0x7f36c80b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.599+0000 7f36cec77640 1 --2- 172.21.15.146:0/1795087770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c80cfca0 0x7f36c80cef40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.599+0000 7f36cec77640 1 -- 172.21.15.146:0/1795087770 >> 172.21.15.146:0/1795087770 conn(0x7f36c80d11f0 msgr2=0x7f36c80d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.599+0000 7f36cec77640 1 -- 172.21.15.146:0/1795087770 shutdown_connections 2024-09-17T03:40:14.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.599+0000 7f36cec77640 1 -- 172.21.15.146:0/1795087770 wait complete. 2024-09-17T03:40:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.601+0000 7f36cec77640 1 Processor -- start 2024-09-17T03:40:14.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.601+0000 7f36cec77640 1 -- start start 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.602+0000 7f36cec77640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c80b61f0 0x7f36c81f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.602+0000 7f36cec77640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c80cfca0 0x7f36c80c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.602+0000 7f36cec77640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c815f1a0 0x7f36c8157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.602+0000 7f36cec77640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f36c80695b0 con 0x7f36c80cfca0 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.602+0000 7f36cec77640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f36c8069430 con 0x7f36c815f1a0 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.602+0000 7f36cec77640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f36c8069730 con 0x7f36c80b61f0 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c80cfca0 0x7f36c80c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c80cfca0 0x7f36c80c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40102/0 (socket says 172.21.15.146:40102) 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c7fff640 1 -- 172.21.15.146:0/1994368167 learned_addr learned my addr 172.21.15.146:0/1994368167 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36cd214640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c815f1a0 0x7f36c8157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36cca13640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c80b61f0 0x7f36c81f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c7fff640 1 -- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c80b61f0 msgr2=0x7f36c81f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c7fff640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c80b61f0 0x7f36c81f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c7fff640 1 -- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c815f1a0 msgr2=0x7f36c8157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c7fff640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c815f1a0 0x7f36c8157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c7fff640 1 -- 172.21.15.146:0/1994368167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c81f6770 con 0x7f36c80cfca0 2024-09-17T03:40:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c7fff640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c80cfca0 0x7f36c80c9c80 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f36b4000c00 tx=0x7f36b4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c57fa640 1 -- 172.21.15.146:0/1994368167 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4031d60 con 0x7f36c80cfca0 2024-09-17T03:40:14.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c57fa640 1 -- 172.21.15.146:0/1994368167 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36b4033e10 con 0x7f36c80cfca0 2024-09-17T03:40:14.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36c57fa640 1 -- 172.21.15.146:0/1994368167 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4033310 con 0x7f36c80cfca0 2024-09-17T03:40:14.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36cec77640 1 -- 172.21.15.146:0/1994368167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c81f6a50 con 0x7f36c80cfca0 2024-09-17T03:40:14.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.603+0000 7f36cec77640 1 -- 172.21.15.146:0/1994368167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c80cbbf0 con 0x7f36c80cfca0 2024-09-17T03:40:14.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.604+0000 7f36cec77640 1 -- 172.21.15.146:0/1994368167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c80c8890 con 0x7f36c80cfca0 2024-09-17T03:40:14.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.605+0000 7f36c57fa640 1 -- 172.21.15.146:0/1994368167 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36b40334b0 con 0x7f36c80cfca0 2024-09-17T03:40:14.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.606+0000 7f36c57fa640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f36ac078b90 0x7f36ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:14.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.606+0000 7f36c57fa640 1 -- 172.21.15.146:0/1994368167 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5609+0+0 (secure 0 0 0) 0x7f36b40bbf60 con 0x7f36c80cfca0 2024-09-17T03:40:14.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.606+0000 7f36cca13640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f36ac078b90 0x7f36ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:14.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.607+0000 7f36cca13640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f36ac078b90 0x7f36ac07b0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f36bc001720 tx=0x7f36bc007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:14.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.611+0000 7f36c57fa640 1 -- 172.21.15.146:0/1994368167 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36b403f030 con 0x7f36c80cfca0 2024-09-17T03:40:14.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:14.827+0000 7f36cec77640 1 -- 172.21.15.146:0/1994368167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f36c81f6500 con 0x7f36c80cfca0 2024-09-17T03:40:15.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.460+0000 7f36c57fa640 1 -- 172.21.15.146:0/1994368167 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v83) ==== 174+0+0 (secure 0 0 0) 0x7f36b4083ed0 con 0x7f36c80cfca0 2024-09-17T03:40:15.459 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 16 and data pool 17 2024-09-17T03:40:15.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.465+0000 7f36cec77640 1 -- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f36ac078b90 msgr2=0x7f36ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.465+0000 7f36cec77640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f36ac078b90 0x7f36ac07b0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f36bc001720 tx=0x7f36bc007e90 comp rx=0 tx=0).stop 2024-09-17T03:40:15.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.465+0000 7f36cec77640 1 -- 172.21.15.146:0/1994368167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c80cfca0 msgr2=0x7f36c80c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.465+0000 7f36cec77640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c80cfca0 0x7f36c80c9c80 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f36b4000c00 tx=0x7f36b4033c20 comp rx=0 tx=0).stop 2024-09-17T03:40:15.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.465+0000 7f36cec77640 1 -- 172.21.15.146:0/1994368167 shutdown_connections 2024-09-17T03:40:15.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.465+0000 7f36cec77640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f36ac078b90 0x7f36ac07b0a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.465+0000 7f36cec77640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36c815f1a0 0x7f36c8157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.465+0000 7f36cec77640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c80cfca0 0x7f36c80c9c80 secure :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f36b4000c00 tx=0x7f36b4033c20 comp rx=0 tx=0).stop 2024-09-17T03:40:15.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.465+0000 7f36cec77640 1 --2- 172.21.15.146:0/1994368167 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36c80b61f0 0x7f36c81f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.465+0000 7f36cec77640 1 -- 172.21.15.146:0/1994368167 >> 172.21.15.146:0/1994368167 conn(0x7f36c80d11f0 msgr2=0x7f36c80d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:15.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.467+0000 7f36cec77640 1 -- 172.21.15.146:0/1994368167 shutdown_connections 2024-09-17T03:40:15.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.467+0000 7f36cec77640 1 -- 172.21.15.146:0/1994368167 wait complete. 2024-09-17T03:40:15.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:15.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.620+0000 7ff2292a2640 1 -- 172.21.15.146:0/436341488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2240b3870 msgr2=0x7ff2240cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.620+0000 7ff2292a2640 1 --2- 172.21.15.146:0/436341488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2240b3870 0x7ff2240cf370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff214005fd0 tx=0x7ff21402a540 comp rx=0 tx=0).stop 2024-09-17T03:40:15.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.620+0000 7ff2292a2640 1 -- 172.21.15.146:0/436341488 shutdown_connections 2024-09-17T03:40:15.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.620+0000 7ff2292a2640 1 --2- 172.21.15.146:0/436341488 >> v2:172.21.15.179:3300/0 conn(0x7ff2241620f0 0x7ff22406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.620+0000 7ff2292a2640 1 --2- 172.21.15.146:0/436341488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2240b3870 0x7ff2240cf370 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.620+0000 7ff2292a2640 1 -- 172.21.15.146:0/436341488 >> 172.21.15.146:0/436341488 conn(0x7ff2240d4be0 msgr2=0x7ff2240d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:15.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.620+0000 7ff2292a2640 1 -- 172.21.15.146:0/436341488 shutdown_connections 2024-09-17T03:40:15.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.620+0000 7ff2292a2640 1 -- 172.21.15.146:0/436341488 wait complete. 2024-09-17T03:40:15.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.622+0000 7ff2292a2640 1 Processor -- start 2024-09-17T03:40:15.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.622+0000 7ff2292a2640 1 -- start start 2024-09-17T03:40:15.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.623+0000 7ff2292a2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22406f270 0x7ff2240ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.623+0000 7ff2292a2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2240b3870 0x7ff22414fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.623+0000 7ff2292a2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2241620f0 0x7ff2240cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.623+0000 7ff2292a2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff2240d43b0 con 0x7ff22406f270 2024-09-17T03:40:15.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.623+0000 7ff2292a2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff224162fb0 con 0x7ff2241620f0 2024-09-17T03:40:15.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.623+0000 7ff2292a2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff2240cd4d0 con 0x7ff2240b3870 2024-09-17T03:40:15.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.623+0000 7ff222ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22406f270 0x7ff2240ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:15.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.623+0000 7ff222ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22406f270 0x7ff2240ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40118/0 (socket says 172.21.15.146:40118) 2024-09-17T03:40:15.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.623+0000 7ff222ffd640 1 -- 172.21.15.146:0/3449276908 learned_addr learned my addr 172.21.15.146:0/3449276908 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:15.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.623+0000 7ff21a7fc640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2240b3870 0x7ff22414fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.623+0000 7ff2237fe640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2241620f0 0x7ff2240cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.624+0000 7ff222ffd640 1 -- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2240b3870 msgr2=0x7ff22414fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.624+0000 7ff222ffd640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2240b3870 0x7ff22414fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.624+0000 7ff222ffd640 1 -- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2241620f0 msgr2=0x7ff2240cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.624+0000 7ff222ffd640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2241620f0 0x7ff2240cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.624+0000 7ff222ffd640 1 -- 172.21.15.146:0/3449276908 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2240b43f0 con 0x7ff22406f270 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.624+0000 7ff222ffd640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22406f270 0x7ff2240ca9a0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7ff214034040 tx=0x7ff2140038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.624+0000 7ff21bfff640 1 -- 172.21.15.146:0/3449276908 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21403e030 con 0x7ff22406f270 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.624+0000 7ff21bfff640 1 -- 172.21.15.146:0/3449276908 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff214003db0 con 0x7ff22406f270 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.624+0000 7ff2292a2640 1 -- 172.21.15.146:0/3449276908 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2240b46d0 con 0x7ff22406f270 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.624+0000 7ff21bfff640 1 -- 172.21.15.146:0/3449276908 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214035040 con 0x7ff22406f270 2024-09-17T03:40:15.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.624+0000 7ff2292a2640 1 -- 172.21.15.146:0/3449276908 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2240b4c90 con 0x7ff22406f270 2024-09-17T03:40:15.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.625+0000 7ff2292a2640 1 -- 172.21.15.146:0/3449276908 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff224163460 con 0x7ff22406f270 2024-09-17T03:40:15.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.626+0000 7ff21bfff640 1 -- 172.21.15.146:0/3449276908 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff214041030 con 0x7ff22406f270 2024-09-17T03:40:15.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.626+0000 7ff21bfff640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff204078bc0 0x7ff20407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.626+0000 7ff21bfff640 1 -- 172.21.15.146:0/3449276908 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7ff2140bb3c0 con 0x7ff22406f270 2024-09-17T03:40:15.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.627+0000 7ff21a7fc640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff204078bc0 0x7ff20407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:15.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.627+0000 7ff21a7fc640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff204078bc0 0x7ff20407b0d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff2240cf110 tx=0x7ff20c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:15.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.631+0000 7ff21bfff640 1 -- 172.21.15.146:0/3449276908 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff214083130 con 0x7ff22406f270 2024-09-17T03:40:15.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.807+0000 7ff2292a2640 1 -- 172.21.15.146:0/3449276908 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2240d2bd0 con 0x7ff22406f270 2024-09-17T03:40:15.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.808+0000 7ff21bfff640 1 -- 172.21.15.146:0/3449276908 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16748 (secure 0 0 0) 0x7ff214087b60 con 0x7ff22406f270 2024-09-17T03:40:15.807 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:15.807 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":116,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:40:14.828302+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:40:12.468448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T03:40:13.798897+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:15.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.810+0000 7ff2292a2640 1 -- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff204078bc0 msgr2=0x7ff20407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.810+0000 7ff2292a2640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff204078bc0 0x7ff20407b0d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff2240cf110 tx=0x7ff20c005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:15.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.810+0000 7ff2292a2640 1 -- 172.21.15.146:0/3449276908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22406f270 msgr2=0x7ff2240ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.810+0000 7ff2292a2640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22406f270 0x7ff2240ca9a0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7ff214034040 tx=0x7ff2140038a0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.810+0000 7ff2292a2640 1 -- 172.21.15.146:0/3449276908 shutdown_connections 2024-09-17T03:40:15.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.810+0000 7ff2292a2640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff204078bc0 0x7ff20407b0d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.810+0000 7ff2292a2640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2241620f0 0x7ff2240cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.810+0000 7ff2292a2640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2240b3870 0x7ff22414fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.810+0000 7ff2292a2640 1 --2- 172.21.15.146:0/3449276908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff22406f270 0x7ff2240ca9a0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.810+0000 7ff2292a2640 1 -- 172.21.15.146:0/3449276908 >> 172.21.15.146:0/3449276908 conn(0x7ff2240d4be0 msgr2=0x7ff22415e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:15.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.811+0000 7ff2292a2640 1 -- 172.21.15.146:0/3449276908 shutdown_connections 2024-09-17T03:40:15.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.811+0000 7ff2292a2640 1 -- 172.21.15.146:0/3449276908 wait complete. 2024-09-17T03:40:15.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:15.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.936+0000 7fd29db82640 1 -- 172.21.15.146:0/1593242508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd298073480 msgr2=0x7fd298073890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.936+0000 7fd29db82640 1 --2- 172.21.15.146:0/1593242508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd298073480 0x7fd298073890 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fd2980b57b0 tx=0x7fd29002aa30 comp rx=0 tx=0).stop 2024-09-17T03:40:15.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.936+0000 7fd29db82640 1 -- 172.21.15.146:0/1593242508 shutdown_connections 2024-09-17T03:40:15.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.936+0000 7fd29db82640 1 --2- 172.21.15.146:0/1593242508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd298073480 0x7fd298073890 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.936+0000 7fd29db82640 1 --2- 172.21.15.146:0/1593242508 >> v2:172.21.15.179:3300/0 conn(0x7fd2981604f0 0x7fd298160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.936+0000 7fd29db82640 1 --2- 172.21.15.146:0/1593242508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd298153a60 0x7fd29815d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.936+0000 7fd29db82640 1 -- 172.21.15.146:0/1593242508 >> 172.21.15.146:0/1593242508 conn(0x7fd2980b2060 msgr2=0x7fd2980b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:15.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.936+0000 7fd29db82640 1 -- 172.21.15.146:0/1593242508 shutdown_connections 2024-09-17T03:40:15.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.936+0000 7fd29db82640 1 -- 172.21.15.146:0/1593242508 wait complete. 2024-09-17T03:40:15.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.938+0000 7fd29db82640 1 Processor -- start 2024-09-17T03:40:15.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.938+0000 7fd29db82640 1 -- start start 2024-09-17T03:40:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd29db82640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd298073480 0x7fd298148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd29db82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd298153a60 0x7fd2980ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd29db82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2981604f0 0x7fd2980aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd29db82640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd298073dd0 con 0x7fd2981604f0 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd29db82640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd29806f830 con 0x7fd298153a60 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd29db82640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd298073f50 con 0x7fd298073480 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd297fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2981604f0 0x7fd2980aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd297fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2981604f0 0x7fd2980aedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40144/0 (socket says 172.21.15.146:40144) 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd297fff640 1 -- 172.21.15.146:0/120376335 learned_addr learned my addr 172.21.15.146:0/120376335 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd2977fe640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd298073480 0x7fd298148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd28ffff640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd298153a60 0x7fd2980ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd297fff640 1 -- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd298073480 msgr2=0x7fd298148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd297fff640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd298073480 0x7fd298148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd297fff640 1 -- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd298153a60 msgr2=0x7fd2980ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd297fff640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd298153a60 0x7fd2980ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd297fff640 1 -- 172.21.15.146:0/120376335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2980b42c0 con 0x7fd2981604f0 2024-09-17T03:40:15.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.939+0000 7fd28ffff640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd298153a60 0x7fd2980ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.940+0000 7fd297fff640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2981604f0 0x7fd2980aedd0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fd290009d60 tx=0x7fd290003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.940+0000 7fd294ff9640 1 -- 172.21.15.146:0/120376335 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290033050 con 0x7fd2981604f0 2024-09-17T03:40:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.940+0000 7fd294ff9640 1 -- 172.21.15.146:0/120376335 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd290004450 con 0x7fd2981604f0 2024-09-17T03:40:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.940+0000 7fd29db82640 1 -- 172.21.15.146:0/120376335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2980b3500 con 0x7fd2981604f0 2024-09-17T03:40:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.940+0000 7fd294ff9640 1 -- 172.21.15.146:0/120376335 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd290038450 con 0x7fd2981604f0 2024-09-17T03:40:15.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.940+0000 7fd29db82640 1 -- 172.21.15.146:0/120376335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2980b3ac0 con 0x7fd2981604f0 2024-09-17T03:40:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.941+0000 7fd29db82640 1 -- 172.21.15.146:0/120376335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2980b50d0 con 0x7fd2981604f0 2024-09-17T03:40:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.942+0000 7fd294ff9640 1 -- 172.21.15.146:0/120376335 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd290036070 con 0x7fd2981604f0 2024-09-17T03:40:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.942+0000 7fd294ff9640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd278078b90 0x7fd27807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.942+0000 7fd294ff9640 1 -- 172.21.15.146:0/120376335 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fd2900bc310 con 0x7fd2981604f0 2024-09-17T03:40:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.942+0000 7fd2977fe640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd278078b90 0x7fd27807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.943+0000 7fd2977fe640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd278078b90 0x7fd27807b0a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd28800daa0 tx=0x7fd288005d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:15.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:15.947+0000 7fd294ff9640 1 -- 172.21.15.146:0/120376335 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd290084750 con 0x7fd2981604f0 2024-09-17T03:40:16.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.124+0000 7fd29db82640 1 -- 172.21.15.146:0/120376335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd29815d980 con 0x7fd2981604f0 2024-09-17T03:40:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.125+0000 7fd294ff9640 1 -- 172.21.15.146:0/120376335 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16748 (secure 0 0 0) 0x7fd290084050 con 0x7fd2981604f0 2024-09-17T03:40:16.124 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:16.125 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":116,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:40:14.828302+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:40:12.468448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T03:40:13.798897+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:16.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 -- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd278078b90 msgr2=0x7fd27807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd278078b90 0x7fd27807b0a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd28800daa0 tx=0x7fd288005d70 comp rx=0 tx=0).stop 2024-09-17T03:40:16.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 -- 172.21.15.146:0/120376335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2981604f0 msgr2=0x7fd2980aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2981604f0 0x7fd2980aedd0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fd290009d60 tx=0x7fd290003f10 comp rx=0 tx=0).stop 2024-09-17T03:40:16.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 -- 172.21.15.146:0/120376335 shutdown_connections 2024-09-17T03:40:16.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd278078b90 0x7fd27807b0a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2981604f0 0x7fd2980aedd0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd298153a60 0x7fd2980ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 --2- 172.21.15.146:0/120376335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd298073480 0x7fd298148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 -- 172.21.15.146:0/120376335 >> 172.21.15.146:0/120376335 conn(0x7fd2980b2060 msgr2=0x7fd2980d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:16.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 -- 172.21.15.146:0/120376335 shutdown_connections 2024-09-17T03:40:16.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.127+0000 7fd29db82640 1 -- 172.21.15.146:0/120376335 wait complete. 2024-09-17T03:40:16.138 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:40:16.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.255+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/3791363346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f7c005350 msgr2=0x7f1f7c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.255+0000 7f1f9ac8b640 1 --2- 172.21.15.146:0/3791363346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f7c005350 0x7f1f7c00b9c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c001dc0 tx=0x7f1f7c005830 comp rx=0 tx=0).stop 2024-09-17T03:40:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.255+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/3791363346 shutdown_connections 2024-09-17T03:40:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.255+0000 7f1f9ac8b640 1 --2- 172.21.15.146:0/3791363346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f7c005350 0x7f1f7c00b9c0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.255+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/3791363346 >> 172.21.15.146:0/3791363346 conn(0x7f1f9409ba20 msgr2=0x7f1f940b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.255+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/3791363346 shutdown_connections 2024-09-17T03:40:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.255+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/3791363346 wait complete. 2024-09-17T03:40:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.257+0000 7f1f9ac8b640 1 Processor -- start 2024-09-17T03:40:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.257+0000 7f1f9ac8b640 1 -- start start 2024-09-17T03:40:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.258+0000 7f1f9ac8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c005350 0x7f1f940b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.258+0000 7f1f9ac8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f940c9630 0x7f1f940afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.258+0000 7f1f9ac8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f941df460 0x7f1f940706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.258+0000 7f1f9ac8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1f940cd420 con 0x7f1f940c9630 2024-09-17T03:40:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.258+0000 7f1f9ac8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1f940cd2a0 con 0x7f1f941df460 2024-09-17T03:40:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.258+0000 7f1f9ac8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1f940cd9e0 con 0x7f1f7c005350 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.258+0000 7f1f8bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f940c9630 0x7f1f940afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.258+0000 7f1f8bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f940c9630 0x7f1f940afc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40154/0 (socket says 172.21.15.146:40154) 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.258+0000 7f1f8bfff640 1 -- 172.21.15.146:0/646630306 learned_addr learned my addr 172.21.15.146:0/646630306 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f98a27640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c005350 0x7f1f940b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f99228640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f941df460 0x7f1f940706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f8bfff640 1 -- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c005350 msgr2=0x7f1f940b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f8bfff640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c005350 0x7f1f940b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f8bfff640 1 -- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f941df460 msgr2=0x7f1f940706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f8bfff640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f941df460 0x7f1f940706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f8bfff640 1 -- 172.21.15.146:0/646630306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f940b0660 con 0x7f1f940c9630 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f99228640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f941df460 0x7f1f940706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f8bfff640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f940c9630 0x7f1f940afc30 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f1f84011800 tx=0x7f1f84011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f897fa640 1 -- 172.21.15.146:0/646630306 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84004460 con 0x7f1f940c9630 2024-09-17T03:40:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f897fa640 1 -- 172.21.15.146:0/646630306 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f84016070 con 0x7f1f940c9630 2024-09-17T03:40:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/646630306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f940b0940 con 0x7f1f940c9630 2024-09-17T03:40:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f897fa640 1 -- 172.21.15.146:0/646630306 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8400fb60 con 0x7f1f940c9630 2024-09-17T03:40:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.259+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/646630306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f940af430 con 0x7f1f940c9630 2024-09-17T03:40:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.260+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/646630306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f940cdee0 con 0x7f1f940c9630 2024-09-17T03:40:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.261+0000 7f1f897fa640 1 -- 172.21.15.146:0/646630306 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f8400fd00 con 0x7f1f940c9630 2024-09-17T03:40:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.262+0000 7f1f897fa640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f80078b90 0x7f1f8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.262+0000 7f1f897fa640 1 -- 172.21.15.146:0/646630306 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f1f8409ba40 con 0x7f1f940c9630 2024-09-17T03:40:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.262+0000 7f1f98a27640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f80078b90 0x7f1f8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.262+0000 7f1f98a27640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f80078b90 0x7f1f8007b0a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1f900018a0 tx=0x7f1f90001be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.266+0000 7f1f897fa640 1 -- 172.21.15.146:0/646630306 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1f84063e80 con 0x7f1f940c9630 2024-09-17T03:40:16.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:16.478+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/646630306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1f940cfd50 con 0x7f1f940c9630 2024-09-17T03:40:17.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.479+0000 7f1f897fa640 1 -- 172.21.15.146:0/646630306 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v86) ==== 118+0+0 (secure 0 0 0) 0x7f1f8409be20 con 0x7f1f940c9630 2024-09-17T03:40:17.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f80078b90 msgr2=0x7f1f8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f80078b90 0x7f1f8007b0a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1f900018a0 tx=0x7f1f90001be0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/646630306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f940c9630 msgr2=0x7f1f940afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f940c9630 0x7f1f940afc30 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f1f84011800 tx=0x7f1f84011cc0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/646630306 shutdown_connections 2024-09-17T03:40:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f80078b90 0x7f1f8007b0a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1f941df460 0x7f1f940706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f940c9630 0x7f1f940afc30 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 --2- 172.21.15.146:0/646630306 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1f7c005350 0x7f1f940b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/646630306 >> 172.21.15.146:0/646630306 conn(0x7f1f9409ba20 msgr2=0x7f1f94075e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/646630306 shutdown_connections 2024-09-17T03:40:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.483+0000 7f1f9ac8b640 1 -- 172.21.15.146:0/646630306 wait complete. 2024-09-17T03:40:17.497 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:40:17.497 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:40:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.620+0000 7f89d9513640 1 -- 172.21.15.146:0/496052379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d40b08d0 msgr2=0x7f89d40b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.620+0000 7f89d9513640 1 --2- 172.21.15.146:0/496052379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d40b08d0 0x7f89d40b0ce0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009830 tx=0x7f89c402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.620+0000 7f89d9513640 1 -- 172.21.15.146:0/496052379 shutdown_connections 2024-09-17T03:40:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.620+0000 7f89d9513640 1 --2- 172.21.15.146:0/496052379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d40b08d0 0x7f89d40b0ce0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.620+0000 7f89d9513640 1 -- 172.21.15.146:0/496052379 >> 172.21.15.146:0/496052379 conn(0x7f89d409ba20 msgr2=0x7f89d40b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.620+0000 7f89d9513640 1 -- 172.21.15.146:0/496052379 shutdown_connections 2024-09-17T03:40:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.620+0000 7f89d9513640 1 -- 172.21.15.146:0/496052379 wait complete. 2024-09-17T03:40:17.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.622+0000 7f89d9513640 1 Processor -- start 2024-09-17T03:40:17.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.622+0000 7f89d9513640 1 -- start start 2024-09-17T03:40:17.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.623+0000 7f89d9513640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d40b08d0 0x7f89d40cf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.623+0000 7f89d9513640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89d40b3250 0x7f89d40cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.623+0000 7f89d9513640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89d40b4f20 0x7f89d415db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.623+0000 7f89d9513640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4167fb0 con 0x7f89d40b08d0 2024-09-17T03:40:17.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.623+0000 7f89d9513640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4167e30 con 0x7f89d40b3250 2024-09-17T03:40:17.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.623+0000 7f89d9513640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89d4168130 con 0x7f89d40b4f20 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.623+0000 7f89d2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d40b08d0 0x7f89d40cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d40b08d0 0x7f89d40cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53402/0 (socket says 172.21.15.146:53402) 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d2ffd640 1 -- 172.21.15.146:0/1845675943 learned_addr learned my addr 172.21.15.146:0/1845675943 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d27fc640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89d40b3250 0x7f89d40cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d37fe640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89d40b4f20 0x7f89d415db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d2ffd640 1 -- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89d40b4f20 msgr2=0x7f89d415db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d2ffd640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89d40b4f20 0x7f89d415db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d2ffd640 1 -- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89d40b3250 msgr2=0x7f89d40cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d2ffd640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89d40b3250 0x7f89d40cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d2ffd640 1 -- 172.21.15.146:0/1845675943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d415f3a0 con 0x7f89d40b08d0 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d2ffd640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d40b08d0 0x7f89d40cf110 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c780 tx=0x7f89cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89cb7fe640 1 -- 172.21.15.146:0/1845675943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc003b70 con 0x7f89d40b08d0 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89cb7fe640 1 -- 172.21.15.146:0/1845675943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89cc003d10 con 0x7f89d40b08d0 2024-09-17T03:40:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d9513640 1 -- 172.21.15.146:0/1845675943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d415f680 con 0x7f89d40b08d0 2024-09-17T03:40:17.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89cb7fe640 1 -- 172.21.15.146:0/1845675943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00aab0 con 0x7f89d40b08d0 2024-09-17T03:40:17.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.624+0000 7f89d9513640 1 -- 172.21.15.146:0/1845675943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d4160280 con 0x7f89d40b08d0 2024-09-17T03:40:17.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.626+0000 7f89d9513640 1 -- 172.21.15.146:0/1845675943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d40b0ce0 con 0x7f89d40b08d0 2024-09-17T03:40:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.626+0000 7f89cb7fe640 1 -- 172.21.15.146:0/1845675943 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f89cc00ac50 con 0x7f89d40b08d0 2024-09-17T03:40:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.627+0000 7f89cb7fe640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89b4078b90 0x7f89b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.627+0000 7f89cb7fe640 1 -- 172.21.15.146:0/1845675943 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f89cc09ab50 con 0x7f89d40b08d0 2024-09-17T03:40:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.627+0000 7f89d27fc640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89b4078b90 0x7f89b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:17.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.627+0000 7f89d27fc640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89b4078b90 0x7f89b407b0a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f89d4159930 tx=0x7f89bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.631+0000 7f89cb7fe640 1 -- 172.21.15.146:0/1845675943 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89cc063030 con 0x7f89d40b08d0 2024-09-17T03:40:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:17.843+0000 7f89d9513640 1 -- 172.21.15.146:0/1845675943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f89d40b57a0 con 0x7f89d40b08d0 2024-09-17T03:40:18.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.485+0000 7f89cb7fe640 1 -- 172.21.15.146:0/1845675943 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v87) ==== 122+0+0 (secure 0 0 0) 0x7f89cc062930 con 0x7f89d40b08d0 2024-09-17T03:40:18.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.487+0000 7f89d9513640 1 -- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89b4078b90 msgr2=0x7f89b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.487+0000 7f89d9513640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89b4078b90 0x7f89b407b0a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f89d4159930 tx=0x7f89bc009040 comp rx=0 tx=0).stop 2024-09-17T03:40:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.487+0000 7f89d9513640 1 -- 172.21.15.146:0/1845675943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d40b08d0 msgr2=0x7f89d40cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.487+0000 7f89d9513640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d40b08d0 0x7f89d40cf110 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c780 tx=0x7f89cc00cc40 comp rx=0 tx=0).stop 2024-09-17T03:40:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.487+0000 7f89d9513640 1 -- 172.21.15.146:0/1845675943 shutdown_connections 2024-09-17T03:40:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.487+0000 7f89d9513640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89b4078b90 0x7f89b407b0a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.487+0000 7f89d9513640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89d40b4f20 0x7f89d415db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.487+0000 7f89d9513640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89d40b3250 0x7f89d40cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.487+0000 7f89d9513640 1 --2- 172.21.15.146:0/1845675943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89d40b08d0 0x7f89d40cf110 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.487+0000 7f89d9513640 1 -- 172.21.15.146:0/1845675943 >> 172.21.15.146:0/1845675943 conn(0x7f89d409ba20 msgr2=0x7f89d40d2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.487+0000 7f89d9513640 1 -- 172.21.15.146:0/1845675943 shutdown_connections 2024-09-17T03:40:18.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.488+0000 7f89d9513640 1 -- 172.21.15.146:0/1845675943 wait complete. 2024-09-17T03:40:18.502 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:40:18.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:18.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.620+0000 7f4f30c94640 1 -- 172.21.15.146:0/1045405469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c0d0710 msgr2=0x7f4f2c0cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.620+0000 7f4f30c94640 1 --2- 172.21.15.146:0/1045405469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c0d0710 0x7f4f2c0cf170 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0d0b20 tx=0x7f4f1c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.620+0000 7f4f30c94640 1 -- 172.21.15.146:0/1045405469 shutdown_connections 2024-09-17T03:40:18.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.620+0000 7f4f30c94640 1 --2- 172.21.15.146:0/1045405469 >> v2:172.21.15.179:3300/0 conn(0x7f4f2c0cf6b0 0x7f4f2c161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.620+0000 7f4f30c94640 1 --2- 172.21.15.146:0/1045405469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c0d0710 0x7f4f2c0cf170 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.620+0000 7f4f30c94640 1 -- 172.21.15.146:0/1045405469 >> 172.21.15.146:0/1045405469 conn(0x7f4f2c09ba20 msgr2=0x7f4f2c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:18.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.620+0000 7f4f30c94640 1 -- 172.21.15.146:0/1045405469 shutdown_connections 2024-09-17T03:40:18.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.620+0000 7f4f30c94640 1 -- 172.21.15.146:0/1045405469 wait complete. 2024-09-17T03:40:18.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.622+0000 7f4f30c94640 1 Processor -- start 2024-09-17T03:40:18.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.622+0000 7f4f30c94640 1 -- start start 2024-09-17T03:40:18.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.623+0000 7f4f30c94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c0b47c0 0x7f4f2c1f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f30c94640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f2c0cf6b0 0x7f4f2c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f30c94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f2c0d0710 0x7f4f2c0c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f30c94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c0b1de0 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f30c94640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c162080 con 0x7f4f2c0d0710 2024-09-17T03:40:18.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f30c94640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4f2c0b1f60 con 0x7f4f2c0cf6b0 2024-09-17T03:40:18.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f2a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c0b47c0 0x7f4f2c1f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f2a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c0b47c0 0x7f4f2c1f3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53406/0 (socket says 172.21.15.146:53406) 2024-09-17T03:40:18.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f2a59c640 1 -- 172.21.15.146:0/918579526 learned_addr learned my addr 172.21.15.146:0/918579526 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:18.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f2ad9d640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f2c0d0710 0x7f4f2c0c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f21d9b640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f2c0cf6b0 0x7f4f2c15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f2a59c640 1 -- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f2c0cf6b0 msgr2=0x7f4f2c15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f2a59c640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f2c0cf6b0 0x7f4f2c15a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f2a59c640 1 -- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f2c0d0710 msgr2=0x7f4f2c0c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f2a59c640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f2c0d0710 0x7f4f2c0c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f2a59c640 1 -- 172.21.15.146:0/918579526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2c1f4280 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f2a59c640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c0b47c0 0x7f4f2c1f3d40 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c02aa90 tx=0x7f4f1c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:18.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f237fe640 1 -- 172.21.15.146:0/918579526 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c031d60 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f237fe640 1 -- 172.21.15.146:0/918579526 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f1c033e10 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f30c94640 1 -- 172.21.15.146:0/918579526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2c15f570 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f237fe640 1 -- 172.21.15.146:0/918579526 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c005260 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.624+0000 7f4f30c94640 1 -- 172.21.15.146:0/918579526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2c1f3540 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.625+0000 7f4f30c94640 1 -- 172.21.15.146:0/918579526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2c0cf170 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.626+0000 7f4f237fe640 1 -- 172.21.15.146:0/918579526 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f1c005400 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.627+0000 7f4f237fe640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f0c078bc0 0x7f4f0c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.627+0000 7f4f237fe640 1 -- 172.21.15.146:0/918579526 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f4f1c0bc000 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.627+0000 7f4f21d9b640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f0c078bc0 0x7f4f0c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.628+0000 7f4f21d9b640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f0c078bc0 0x7f4f0c07b0d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0cf550 tx=0x7f4f14005c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:18.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.632+0000 7f4f237fe640 1 -- 172.21.15.146:0/918579526 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f1c03f030 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.843+0000 7f4f30c94640 1 -- 172.21.15.146:0/918579526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f2c0ced70 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.844+0000 7f4f237fe640 1 -- 172.21.15.146:0/918579526 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5237 (secure 0 0 0) 0x7f4f1c0844d0 con 0x7f4f2c0b47c0 2024-09-17T03:40:18.845 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:18.845 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6767,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1732967634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1732967634},{"type":"v1","addr":"172.21.15.146:6835","nonce":1732967634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2315176305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2315176305},{"type":"v1","addr":"172.21.15.179:6837","nonce":2315176305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1700206363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1700206363},{"type":"v1","addr":"172.21.15.179:6836","nonce":1700206363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:14.828261+0000","modified":"2024-09-17T03:40:17.844984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8187":{"gid":8187,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/2931720030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2931720030},{"type":"v1","addr":"172.21.15.146:6833","nonce":2931720030}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8187,"qdb_cluster":[8187]},"id":8}]} 2024-09-17T03:40:18.845 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 87 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 -- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f0c078bc0 msgr2=0x7f4f0c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f0c078bc0 0x7f4f0c07b0d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0cf550 tx=0x7f4f14005c40 comp rx=0 tx=0).stop 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 -- 172.21.15.146:0/918579526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c0b47c0 msgr2=0x7f4f2c1f3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c0b47c0 0x7f4f2c1f3d40 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c02aa90 tx=0x7f4f1c033c20 comp rx=0 tx=0).stop 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 -- 172.21.15.146:0/918579526 shutdown_connections 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f0c078bc0 0x7f4f0c07b0d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f2c0d0710 0x7f4f2c0c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f2c0cf6b0 0x7f4f2c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 --2- 172.21.15.146:0/918579526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c0b47c0 0x7f4f2c1f3d40 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 -- 172.21.15.146:0/918579526 >> 172.21.15.146:0/918579526 conn(0x7f4f2c09ba20 msgr2=0x7f4f2c0b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 -- 172.21.15.146:0/918579526 shutdown_connections 2024-09-17T03:40:18.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.846+0000 7f4f30c94640 1 -- 172.21.15.146:0/918579526 wait complete. 2024-09-17T03:40:18.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.970+0000 7f9b41b90640 1 -- 172.21.15.146:0/3004293293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3c0b5ce0 msgr2=0x7f9b3c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.970+0000 7f9b41b90640 1 --2- 172.21.15.146:0/3004293293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3c0b5ce0 0x7f9b3c0b1320 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0b8440 tx=0x7f9b2c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.970+0000 7f9b41b90640 1 -- 172.21.15.146:0/3004293293 shutdown_connections 2024-09-17T03:40:18.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.970+0000 7f9b41b90640 1 --2- 172.21.15.146:0/3004293293 >> v2:172.21.15.179:3300/0 conn(0x7f9b3c0b5750 0x7f9b3c0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.970+0000 7f9b41b90640 1 --2- 172.21.15.146:0/3004293293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3c0b5ce0 0x7f9b3c0b1320 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.970+0000 7f9b41b90640 1 -- 172.21.15.146:0/3004293293 >> 172.21.15.146:0/3004293293 conn(0x7f9b3c0b7b20 msgr2=0x7f9b3c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:18.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.970+0000 7f9b41b90640 1 -- 172.21.15.146:0/3004293293 shutdown_connections 2024-09-17T03:40:18.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.970+0000 7f9b41b90640 1 -- 172.21.15.146:0/3004293293 wait complete. 2024-09-17T03:40:18.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.972+0000 7f9b41b90640 1 Processor -- start 2024-09-17T03:40:18.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.972+0000 7f9b41b90640 1 -- start start 2024-09-17T03:40:18.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.973+0000 7f9b41b90640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b3c0b3b60 0x7f9b3c1f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.973+0000 7f9b41b90640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3c0b5750 0x7f9b3c152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.973+0000 7f9b41b90640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b3c0b5ce0 0x7f9b3c1f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b41b90640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c0b27b0 con 0x7f9b3c0b5750 2024-09-17T03:40:18.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b41b90640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c15dcc0 con 0x7f9b3c0b5ce0 2024-09-17T03:40:18.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b41b90640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c0b2930 con 0x7f9b3c0b3b60 2024-09-17T03:40:18.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b3affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3c0b5750 0x7f9b3c152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b3affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3c0b5750 0x7f9b3c152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53422/0 (socket says 172.21.15.146:53422) 2024-09-17T03:40:18.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b3affd640 1 -- 172.21.15.146:0/722424479 learned_addr learned my addr 172.21.15.146:0/722424479 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:18.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b3b7fe640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b3c0b3b60 0x7f9b3c1f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b3bfff640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b3c0b5ce0 0x7f9b3c1f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b3affd640 1 -- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b3c0b3b60 msgr2=0x7f9b3c1f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b3affd640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b3c0b3b60 0x7f9b3c1f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b3affd640 1 -- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b3c0b5ce0 msgr2=0x7f9b3c1f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b3affd640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b3c0b5ce0 0x7f9b3c1f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b3affd640 1 -- 172.21.15.146:0/722424479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c1533c0 con 0x7f9b3c0b5750 2024-09-17T03:40:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b3affd640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3c0b5750 0x7f9b3c152650 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000e9b0 tx=0x7f9b3000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b23fff640 1 -- 172.21.15.146:0/722424479 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000ccc0 con 0x7f9b3c0b5750 2024-09-17T03:40:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b23fff640 1 -- 172.21.15.146:0/722424479 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b30011470 con 0x7f9b3c0b5750 2024-09-17T03:40:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b23fff640 1 -- 172.21.15.146:0/722424479 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30011820 con 0x7f9b3c0b5750 2024-09-17T03:40:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b41b90640 1 -- 172.21.15.146:0/722424479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c1536a0 con 0x7f9b3c0b5750 2024-09-17T03:40:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.974+0000 7f9b41b90640 1 -- 172.21.15.146:0/722424479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c153c60 con 0x7f9b3c0b5750 2024-09-17T03:40:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.975+0000 7f9b41b90640 1 -- 172.21.15.146:0/722424479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c0b2e20 con 0x7f9b3c0b5750 2024-09-17T03:40:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.976+0000 7f9b23fff640 1 -- 172.21.15.146:0/722424479 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b300119c0 con 0x7f9b3c0b5750 2024-09-17T03:40:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.977+0000 7f9b23fff640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b28078bc0 0x7f9b2807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.977+0000 7f9b23fff640 1 -- 172.21.15.146:0/722424479 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f9b3009b8d0 con 0x7f9b3c0b5750 2024-09-17T03:40:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.977+0000 7f9b3b7fe640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b28078bc0 0x7f9b2807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:18.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.977+0000 7f9b3b7fe640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b28078bc0 0x7f9b2807b0d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c033000 tx=0x7f9b2c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:18.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:18.981+0000 7f9b23fff640 1 -- 172.21.15.146:0/722424479 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b30016030 con 0x7f9b3c0b5750 2024-09-17T03:40:19.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.160+0000 7f9b41b90640 1 -- 172.21.15.146:0/722424479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b3c15ae60 con 0x7f9b3c0b5750 2024-09-17T03:40:19.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.162+0000 7f9b23fff640 1 -- 172.21.15.146:0/722424479 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16735 (secure 0 0 0) 0x7f9b30063da0 con 0x7f9b3c0b5750 2024-09-17T03:40:19.162 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:19.162 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":117,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:40:16.468982+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:40:12.468448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T03:40:13.798897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 -- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b28078bc0 msgr2=0x7f9b2807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b28078bc0 0x7f9b2807b0d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c033000 tx=0x7f9b2c004730 comp rx=0 tx=0).stop 2024-09-17T03:40:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 -- 172.21.15.146:0/722424479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3c0b5750 msgr2=0x7f9b3c152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3c0b5750 0x7f9b3c152650 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000e9b0 tx=0x7f9b3000ee70 comp rx=0 tx=0).stop 2024-09-17T03:40:19.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 -- 172.21.15.146:0/722424479 shutdown_connections 2024-09-17T03:40:19.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b28078bc0 0x7f9b2807b0d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b3c0b5ce0 0x7f9b3c1f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b3c0b5750 0x7f9b3c152650 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 --2- 172.21.15.146:0/722424479 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b3c0b3b60 0x7f9b3c1f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 -- 172.21.15.146:0/722424479 >> 172.21.15.146:0/722424479 conn(0x7f9b3c0b7b20 msgr2=0x7f9b3c075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:19.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 -- 172.21.15.146:0/722424479 shutdown_connections 2024-09-17T03:40:19.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.164+0000 7f9b41b90640 1 -- 172.21.15.146:0/722424479 wait complete. 2024-09-17T03:40:19.177 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:40:19.177 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:19.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.290+0000 7f254c3df640 1 -- 172.21.15.146:0/3547672888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25440b5ce0 msgr2=0x7f25440b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.290+0000 7f254c3df640 1 --2- 172.21.15.146:0/3547672888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25440b5ce0 0x7f25440b1320 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f2540005fd0 tx=0x7f254002a940 comp rx=0 tx=0).stop 2024-09-17T03:40:19.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.290+0000 7f254c3df640 1 -- 172.21.15.146:0/3547672888 shutdown_connections 2024-09-17T03:40:19.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.290+0000 7f254c3df640 1 --2- 172.21.15.146:0/3547672888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25440b5ce0 0x7f25440b1320 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.290+0000 7f254c3df640 1 -- 172.21.15.146:0/3547672888 >> 172.21.15.146:0/3547672888 conn(0x7f25440b7b20 msgr2=0x7f254409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:19.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.290+0000 7f254c3df640 1 -- 172.21.15.146:0/3547672888 shutdown_connections 2024-09-17T03:40:19.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.290+0000 7f254c3df640 1 -- 172.21.15.146:0/3547672888 wait complete. 2024-09-17T03:40:19.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.292+0000 7f254c3df640 1 Processor -- start 2024-09-17T03:40:19.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.292+0000 7f254c3df640 1 -- start start 2024-09-17T03:40:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254c3df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25440b5750 0x7f254414ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254c3df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25440b5ce0 0x7f254406e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254c3df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f254406f750 0x7f25441f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254c3df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f254415d680 con 0x7f254406f750 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254c3df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f254415d500 con 0x7f25440b5ce0 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254c3df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f254415d800 con 0x7f25440b5750 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254a97c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f254406f750 0x7f25441f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254a97c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f254406f750 0x7f25441f97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53440/0 (socket says 172.21.15.146:53440) 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254a97c640 1 -- 172.21.15.146:0/2198531068 learned_addr learned my addr 172.21.15.146:0/2198531068 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254a17b640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25440b5750 0x7f254414ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254997a640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25440b5ce0 0x7f254406e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254a97c640 1 -- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25440b5750 msgr2=0x7f254414ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254a97c640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25440b5750 0x7f254414ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254a97c640 1 -- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25440b5ce0 msgr2=0x7f254406e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254a97c640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25440b5ce0 0x7f254406e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.293+0000 7f254a97c640 1 -- 172.21.15.146:0/2198531068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2544157230 con 0x7f254406f750 2024-09-17T03:40:19.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.294+0000 7f254a97c640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f254406f750 0x7f25441f97e0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f253c00c3c0 tx=0x7f253c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:19.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.294+0000 7f253affd640 1 -- 172.21.15.146:0/2198531068 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c017070 con 0x7f254406f750 2024-09-17T03:40:19.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.294+0000 7f253affd640 1 -- 172.21.15.146:0/2198531068 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f253c0035f0 con 0x7f254406f750 2024-09-17T03:40:19.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.294+0000 7f254c3df640 1 -- 172.21.15.146:0/2198531068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2544157510 con 0x7f254406f750 2024-09-17T03:40:19.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.294+0000 7f253affd640 1 -- 172.21.15.146:0/2198531068 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c003a40 con 0x7f254406f750 2024-09-17T03:40:19.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.294+0000 7f254c3df640 1 -- 172.21.15.146:0/2198531068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f254406e6c0 con 0x7f254406f750 2024-09-17T03:40:19.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.295+0000 7f254c3df640 1 -- 172.21.15.146:0/2198531068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25440b1320 con 0x7f254406f750 2024-09-17T03:40:19.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.296+0000 7f253affd640 1 -- 172.21.15.146:0/2198531068 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f253c01a070 con 0x7f254406f750 2024-09-17T03:40:19.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.296+0000 7f253affd640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2528078bc0 0x7f252807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.296+0000 7f253affd640 1 -- 172.21.15.146:0/2198531068 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f253c099dc0 con 0x7f254406f750 2024-09-17T03:40:19.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.296+0000 7f254a17b640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2528078bc0 0x7f252807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.297+0000 7f254a17b640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2528078bc0 0x7f252807b0d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2540034000 tx=0x7f2540004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.300+0000 7f253affd640 1 -- 172.21.15.146:0/2198531068 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f253c061c80 con 0x7f254406f750 2024-09-17T03:40:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.472+0000 7f254c3df640 1 -- 172.21.15.146:0/2198531068 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2544150520 con 0x7f2528078bc0 2024-09-17T03:40:19.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.477+0000 7f253affd640 1 -- 172.21.15.146:0/2198531068 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248290 (secure 0 0 0) 0x7f2540003c60 con 0x7f2528078bc0 2024-09-17T03:40:19.481 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:19.482 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 -- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2528078bc0 msgr2=0x7f252807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2528078bc0 0x7f252807b0d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2540034000 tx=0x7f2540004ab0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 -- 172.21.15.146:0/2198531068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f254406f750 msgr2=0x7f25441f97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f254406f750 0x7f25441f97e0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f253c00c3c0 tx=0x7f253c00c880 comp rx=0 tx=0).stop 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 -- 172.21.15.146:0/2198531068 shutdown_connections 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2528078bc0 0x7f252807b0d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f254406f750 0x7f25441f97e0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25440b5ce0 0x7f254406e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 --2- 172.21.15.146:0/2198531068 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25440b5750 0x7f254414ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 -- 172.21.15.146:0/2198531068 >> 172.21.15.146:0/2198531068 conn(0x7f25440b7b20 msgr2=0x7f254415b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 -- 172.21.15.146:0/2198531068 shutdown_connections 2024-09-17T03:40:19.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.481+0000 7f254c3df640 1 -- 172.21.15.146:0/2198531068 wait complete. 2024-09-17T03:40:19.493 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-09-17T03:40:17.907217+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":356212,"kb_used_data":12276,"kb_used_omap":12,"kb_used_meta":343731,"kb_avail":754618508,"statfs":{"total":773094113280,"available":772729352192,"internally_reserved":0,"allocated":12570624,"data_stored":6128445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":351981105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.452847"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.474412+0000","last_change":"2024-09-17T03:40:14.474412+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.474412+0000","last_undegraded":"2024-09-17T03:40:14.474412+0000","last_fullsized":"2024-09-17T03:40:14.474412+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.462557+0000","last_change":"2024-09-17T03:40:14.462557+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.462557+0000","last_undegraded":"2024-09-17T03:40:14.462557+0000","last_fullsized":"2024-09-17T03:40:14.462557+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.469918+0000","last_change":"2024-09-17T03:40:14.469918+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.469918+0000","last_undegraded":"2024-09-17T03:40:14.469918+0000","last_fullsized":"2024-09-17T03:40:14.469918+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.473735+0000","last_change":"2024-09-17T03:40:14.473735+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.473735+0000","last_undegraded":"2024-09-17T03:40:14.473735+0000","last_fullsized":"2024-09-17T03:40:14.473735+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467916+0000","last_change":"2024-09-17T03:40:14.467916+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467916+0000","last_undegraded":"2024-09-17T03:40:14.467916+0000","last_fullsized":"2024-09-17T03:40:14.467916+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.475403+0000","last_change":"2024-09-17T03:40:14.475403+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.475403+0000","last_undegraded":"2024-09-17T03:40:14.475403+0000","last_fullsized":"2024-09-17T03:40:14.475403+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551912+0000","last_change":"2024-09-17T03:40:15.479882+0000","last_active":"2024-09-17T03:40:16.551912+0000","last_peered":"2024-09-17T03:40:16.551912+0000","last_clean":"2024-09-17T03:40:16.551912+0000","last_became_active":"2024-09-17T03:40:15.479041+0000","last_became_peered":"2024-09-17T03:40:15.479041+0000","last_unstale":"2024-09-17T03:40:16.551912+0000","last_undegraded":"2024-09-17T03:40:16.551912+0000","last_fullsized":"2024-09-17T03:40:16.551912+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:31.468455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470750+0000","last_change":"2024-09-17T03:40:14.470750+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470750+0000","last_undegraded":"2024-09-17T03:40:14.470750+0000","last_fullsized":"2024-09-17T03:40:14.470750+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.473283+0000","last_change":"2024-09-17T03:40:14.473283+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.473283+0000","last_undegraded":"2024-09-17T03:40:14.473283+0000","last_fullsized":"2024-09-17T03:40:14.473283+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.472818+0000","last_change":"2024-09-17T03:40:14.472818+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.472818+0000","last_undegraded":"2024-09-17T03:40:14.472818+0000","last_fullsized":"2024-09-17T03:40:14.472818+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.463012+0000","last_change":"2024-09-17T03:40:14.463012+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.463012+0000","last_undegraded":"2024-09-17T03:40:14.463012+0000","last_fullsized":"2024-09-17T03:40:14.463012+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.471829+0000","last_change":"2024-09-17T03:40:14.471829+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.471829+0000","last_undegraded":"2024-09-17T03:40:14.471829+0000","last_fullsized":"2024-09-17T03:40:14.471829+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467384+0000","last_change":"2024-09-17T03:40:14.467384+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467384+0000","last_undegraded":"2024-09-17T03:40:14.467384+0000","last_fullsized":"2024-09-17T03:40:14.467384+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467936+0000","last_change":"2024-09-17T03:40:14.467936+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467936+0000","last_undegraded":"2024-09-17T03:40:14.467936+0000","last_fullsized":"2024-09-17T03:40:14.467936+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.477600+0000","last_change":"2024-09-17T03:40:14.477600+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.477600+0000","last_undegraded":"2024-09-17T03:40:14.477600+0000","last_fullsized":"2024-09-17T03:40:14.477600+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470980+0000","last_change":"2024-09-17T03:40:14.470980+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470980+0000","last_undegraded":"2024-09-17T03:40:14.470980+0000","last_fullsized":"2024-09-17T03:40:14.470980+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.463153+0000","last_change":"2024-09-17T03:40:14.463153+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.463153+0000","last_undegraded":"2024-09-17T03:40:14.463153+0000","last_fullsized":"2024-09-17T03:40:14.463153+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467131+0000","last_change":"2024-09-17T03:40:14.467131+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467131+0000","last_undegraded":"2024-09-17T03:40:14.467131+0000","last_fullsized":"2024-09-17T03:40:14.467131+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.469449+0000","last_change":"2024-09-17T03:40:14.469449+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.469449+0000","last_undegraded":"2024-09-17T03:40:14.469449+0000","last_fullsized":"2024-09-17T03:40:14.469449+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.463127+0000","last_change":"2024-09-17T03:40:14.463127+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.463127+0000","last_undegraded":"2024-09-17T03:40:14.463127+0000","last_fullsized":"2024-09-17T03:40:14.463127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.462458+0000","last_change":"2024-09-17T03:40:14.462458+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.462458+0000","last_undegraded":"2024-09-17T03:40:14.462458+0000","last_fullsized":"2024-09-17T03:40:14.462458+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551935+0000","last_change":"2024-09-17T03:40:15.470210+0000","last_active":"2024-09-17T03:40:16.551935+0000","last_peered":"2024-09-17T03:40:16.551935+0000","last_clean":"2024-09-17T03:40:16.551935+0000","last_became_active":"2024-09-17T03:40:15.469093+0000","last_became_peered":"2024-09-17T03:40:15.469093+0000","last_unstale":"2024-09-17T03:40:16.551935+0000","last_undegraded":"2024-09-17T03:40:16.551935+0000","last_fullsized":"2024-09-17T03:40:16.551935+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:35.551590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.463740+0000","last_change":"2024-09-17T03:40:14.463740+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.463740+0000","last_undegraded":"2024-09-17T03:40:14.463740+0000","last_fullsized":"2024-09-17T03:40:14.463740+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551653+0000","last_change":"2024-09-17T03:40:15.484372+0000","last_active":"2024-09-17T03:40:16.551653+0000","last_peered":"2024-09-17T03:40:16.551653+0000","last_clean":"2024-09-17T03:40:16.551653+0000","last_became_active":"2024-09-17T03:40:15.484026+0000","last_became_peered":"2024-09-17T03:40:15.484026+0000","last_unstale":"2024-09-17T03:40:16.551653+0000","last_undegraded":"2024-09-17T03:40:16.551653+0000","last_fullsized":"2024-09-17T03:40:16.551653+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:31.193826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.462236+0000","last_change":"2024-09-17T03:40:14.462236+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.462236+0000","last_undegraded":"2024-09-17T03:40:14.462236+0000","last_fullsized":"2024-09-17T03:40:14.462236+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.471223+0000","last_change":"2024-09-17T03:40:14.471223+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.471223+0000","last_undegraded":"2024-09-17T03:40:14.471223+0000","last_fullsized":"2024-09-17T03:40:14.471223+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.475986+0000","last_change":"2024-09-17T03:40:14.475986+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.475986+0000","last_undegraded":"2024-09-17T03:40:14.475986+0000","last_fullsized":"2024-09-17T03:40:14.475986+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552236+0000","last_change":"2024-09-17T03:40:15.494642+0000","last_active":"2024-09-17T03:40:16.552236+0000","last_peered":"2024-09-17T03:40:16.552236+0000","last_clean":"2024-09-17T03:40:16.552236+0000","last_became_active":"2024-09-17T03:40:15.494266+0000","last_became_peered":"2024-09-17T03:40:15.494266+0000","last_unstale":"2024-09-17T03:40:16.552236+0000","last_undegraded":"2024-09-17T03:40:16.552236+0000","last_fullsized":"2024-09-17T03:40:16.552236+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:13.272105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.464551+0000","last_change":"2024-09-17T03:40:14.464551+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.464551+0000","last_undegraded":"2024-09-17T03:40:14.464551+0000","last_fullsized":"2024-09-17T03:40:14.464551+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552939+0000","last_change":"2024-09-17T03:40:15.489604+0000","last_active":"2024-09-17T03:40:16.552939+0000","last_peered":"2024-09-17T03:40:16.552939+0000","last_clean":"2024-09-17T03:40:16.552939+0000","last_became_active":"2024-09-17T03:40:15.489302+0000","last_became_peered":"2024-09-17T03:40:15.489302+0000","last_unstale":"2024-09-17T03:40:16.552939+0000","last_undegraded":"2024-09-17T03:40:16.552939+0000","last_fullsized":"2024-09-17T03:40:16.552939+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:51.069041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470799+0000","last_change":"2024-09-17T03:40:14.470799+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470799+0000","last_undegraded":"2024-09-17T03:40:14.470799+0000","last_fullsized":"2024-09-17T03:40:14.470799+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.476563+0000","last_change":"2024-09-17T03:40:14.476563+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.476563+0000","last_undegraded":"2024-09-17T03:40:14.476563+0000","last_fullsized":"2024-09-17T03:40:14.476563+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.474749+0000","last_change":"2024-09-17T03:40:14.474749+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.474749+0000","last_undegraded":"2024-09-17T03:40:14.474749+0000","last_fullsized":"2024-09-17T03:40:14.474749+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"116'4","reported_seq":19,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552862+0000","last_change":"2024-09-17T03:40:14.474590+0000","last_active":"2024-09-17T03:40:16.552862+0000","last_peered":"2024-09-17T03:40:16.552862+0000","last_clean":"2024-09-17T03:40:16.552862+0000","last_became_active":"2024-09-17T03:40:14.474251+0000","last_became_peered":"2024-09-17T03:40:14.474251+0000","last_unstale":"2024-09-17T03:40:16.552862+0000","last_undegraded":"2024-09-17T03:40:16.552862+0000","last_fullsized":"2024-09-17T03:40:16.552862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:24.482162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.465900+0000","last_change":"2024-09-17T03:40:14.465900+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.465900+0000","last_undegraded":"2024-09-17T03:40:14.465900+0000","last_fullsized":"2024-09-17T03:40:14.465900+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.476736+0000","last_change":"2024-09-17T03:40:14.475924+0000","last_active":"2024-09-17T03:40:14.476736+0000","last_peered":"2024-09-17T03:40:14.476736+0000","last_clean":"2024-09-17T03:40:14.476736+0000","last_became_active":"2024-09-17T03:40:14.475532+0000","last_became_peered":"2024-09-17T03:40:14.475532+0000","last_unstale":"2024-09-17T03:40:14.476736+0000","last_undegraded":"2024-09-17T03:40:14.476736+0000","last_fullsized":"2024-09-17T03:40:14.476736+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:25.973617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470779+0000","last_change":"2024-09-17T03:40:14.470779+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470779+0000","last_undegraded":"2024-09-17T03:40:14.470779+0000","last_fullsized":"2024-09-17T03:40:14.470779+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.475195+0000","last_change":"2024-09-17T03:40:14.470654+0000","last_active":"2024-09-17T03:40:14.475195+0000","last_peered":"2024-09-17T03:40:14.475195+0000","last_clean":"2024-09-17T03:40:14.475195+0000","last_became_active":"2024-09-17T03:40:14.470305+0000","last_became_peered":"2024-09-17T03:40:14.470305+0000","last_unstale":"2024-09-17T03:40:14.475195+0000","last_undegraded":"2024-09-17T03:40:14.475195+0000","last_fullsized":"2024-09-17T03:40:14.475195+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:45.336467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468965+0000","last_change":"2024-09-17T03:40:14.468965+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468965+0000","last_undegraded":"2024-09-17T03:40:14.468965+0000","last_fullsized":"2024-09-17T03:40:14.468965+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.481974+0000","last_change":"2024-09-17T03:40:14.480944+0000","last_active":"2024-09-17T03:40:14.481974+0000","last_peered":"2024-09-17T03:40:14.481974+0000","last_clean":"2024-09-17T03:40:14.481974+0000","last_became_active":"2024-09-17T03:40:14.480631+0000","last_became_peered":"2024-09-17T03:40:14.480631+0000","last_unstale":"2024-09-17T03:40:14.481974+0000","last_undegraded":"2024-09-17T03:40:14.481974+0000","last_fullsized":"2024-09-17T03:40:14.481974+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:31.749316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470314+0000","last_change":"2024-09-17T03:40:14.470314+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470314+0000","last_undegraded":"2024-09-17T03:40:14.470314+0000","last_fullsized":"2024-09-17T03:40:14.470314+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552511+0000","last_change":"2024-09-17T03:40:14.481995+0000","last_active":"2024-09-17T03:40:16.552511+0000","last_peered":"2024-09-17T03:40:16.552511+0000","last_clean":"2024-09-17T03:40:16.552511+0000","last_became_active":"2024-09-17T03:40:14.481664+0000","last_became_peered":"2024-09-17T03:40:14.481664+0000","last_unstale":"2024-09-17T03:40:16.552511+0000","last_undegraded":"2024-09-17T03:40:16.552511+0000","last_fullsized":"2024-09-17T03:40:16.552511+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:21.880772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.464099+0000","last_change":"2024-09-17T03:40:14.464099+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.464099+0000","last_undegraded":"2024-09-17T03:40:14.464099+0000","last_fullsized":"2024-09-17T03:40:14.464099+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552304+0000","last_change":"2024-09-17T03:40:14.480486+0000","last_active":"2024-09-17T03:40:16.552304+0000","last_peered":"2024-09-17T03:40:16.552304+0000","last_clean":"2024-09-17T03:40:16.552304+0000","last_became_active":"2024-09-17T03:40:14.480219+0000","last_became_peered":"2024-09-17T03:40:14.480219+0000","last_unstale":"2024-09-17T03:40:16.552304+0000","last_undegraded":"2024-09-17T03:40:16.552304+0000","last_fullsized":"2024-09-17T03:40:16.552304+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:55.122669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470019+0000","last_change":"2024-09-17T03:40:14.470019+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470019+0000","last_undegraded":"2024-09-17T03:40:14.470019+0000","last_fullsized":"2024-09-17T03:40:14.470019+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.479637+0000","last_change":"2024-09-17T03:40:14.479207+0000","last_active":"2024-09-17T03:40:14.479637+0000","last_peered":"2024-09-17T03:40:14.479637+0000","last_clean":"2024-09-17T03:40:14.479637+0000","last_became_active":"2024-09-17T03:40:14.478974+0000","last_became_peered":"2024-09-17T03:40:14.478974+0000","last_unstale":"2024-09-17T03:40:14.479637+0000","last_undegraded":"2024-09-17T03:40:14.479637+0000","last_fullsized":"2024-09-17T03:40:14.479637+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:05.106569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551862+0000","last_change":"2024-09-17T03:40:15.480254+0000","last_active":"2024-09-17T03:40:16.551862+0000","last_peered":"2024-09-17T03:40:16.551862+0000","last_clean":"2024-09-17T03:40:16.551862+0000","last_became_active":"2024-09-17T03:40:15.479489+0000","last_became_peered":"2024-09-17T03:40:15.479489+0000","last_unstale":"2024-09-17T03:40:16.551862+0000","last_undegraded":"2024-09-17T03:40:16.551862+0000","last_fullsized":"2024-09-17T03:40:16.551862+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:21.795552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.486069+0000","last_change":"2024-09-17T03:40:14.485088+0000","last_active":"2024-09-17T03:40:14.486069+0000","last_peered":"2024-09-17T03:40:14.486069+0000","last_clean":"2024-09-17T03:40:14.486069+0000","last_became_active":"2024-09-17T03:40:14.484700+0000","last_became_peered":"2024-09-17T03:40:14.484700+0000","last_unstale":"2024-09-17T03:40:14.486069+0000","last_undegraded":"2024-09-17T03:40:14.486069+0000","last_fullsized":"2024-09-17T03:40:14.486069+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:07.134098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553004+0000","last_change":"2024-09-17T03:40:15.481077+0000","last_active":"2024-09-17T03:40:16.553004+0000","last_peered":"2024-09-17T03:40:16.553004+0000","last_clean":"2024-09-17T03:40:16.553004+0000","last_became_active":"2024-09-17T03:40:15.480776+0000","last_became_peered":"2024-09-17T03:40:15.480776+0000","last_unstale":"2024-09-17T03:40:16.553004+0000","last_undegraded":"2024-09-17T03:40:16.553004+0000","last_fullsized":"2024-09-17T03:40:16.553004+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:41.034237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.475250+0000","last_change":"2024-09-17T03:40:14.471040+0000","last_active":"2024-09-17T03:40:14.475250+0000","last_peered":"2024-09-17T03:40:14.475250+0000","last_clean":"2024-09-17T03:40:14.475250+0000","last_became_active":"2024-09-17T03:40:14.470269+0000","last_became_peered":"2024-09-17T03:40:14.470269+0000","last_unstale":"2024-09-17T03:40:14.475250+0000","last_undegraded":"2024-09-17T03:40:14.475250+0000","last_fullsized":"2024-09-17T03:40:14.475250+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:03.964932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.465185+0000","last_change":"2024-09-17T03:40:14.465185+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.465185+0000","last_undegraded":"2024-09-17T03:40:14.465185+0000","last_fullsized":"2024-09-17T03:40:14.465185+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552017+0000","last_change":"2024-09-17T03:40:14.480083+0000","last_active":"2024-09-17T03:40:16.552017+0000","last_peered":"2024-09-17T03:40:16.552017+0000","last_clean":"2024-09-17T03:40:16.552017+0000","last_became_active":"2024-09-17T03:40:14.479815+0000","last_became_peered":"2024-09-17T03:40:14.479815+0000","last_unstale":"2024-09-17T03:40:16.552017+0000","last_undegraded":"2024-09-17T03:40:16.552017+0000","last_fullsized":"2024-09-17T03:40:16.552017+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:46.688766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552355+0000","last_change":"2024-09-17T03:40:15.474882+0000","last_active":"2024-09-17T03:40:16.552355+0000","last_peered":"2024-09-17T03:40:16.552355+0000","last_clean":"2024-09-17T03:40:16.552355+0000","last_became_active":"2024-09-17T03:40:15.474567+0000","last_became_peered":"2024-09-17T03:40:15.474567+0000","last_unstale":"2024-09-17T03:40:16.552355+0000","last_undegraded":"2024-09-17T03:40:16.552355+0000","last_fullsized":"2024-09-17T03:40:16.552355+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:48.082051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.483566+0000","last_change":"2024-09-17T03:40:14.481321+0000","last_active":"2024-09-17T03:40:14.483566+0000","last_peered":"2024-09-17T03:40:14.483566+0000","last_clean":"2024-09-17T03:40:14.483566+0000","last_became_active":"2024-09-17T03:40:14.481045+0000","last_became_peered":"2024-09-17T03:40:14.481045+0000","last_unstale":"2024-09-17T03:40:14.483566+0000","last_undegraded":"2024-09-17T03:40:14.483566+0000","last_fullsized":"2024-09-17T03:40:14.483566+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:54.104963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553056+0000","last_change":"2024-09-17T03:40:15.485451+0000","last_active":"2024-09-17T03:40:16.553056+0000","last_peered":"2024-09-17T03:40:16.553056+0000","last_clean":"2024-09-17T03:40:16.553056+0000","last_became_active":"2024-09-17T03:40:15.485116+0000","last_became_peered":"2024-09-17T03:40:15.485116+0000","last_unstale":"2024-09-17T03:40:16.553056+0000","last_undegraded":"2024-09-17T03:40:16.553056+0000","last_fullsized":"2024-09-17T03:40:16.553056+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:48.894066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.485499+0000","last_change":"2024-09-17T03:40:14.484915+0000","last_active":"2024-09-17T03:40:14.485499+0000","last_peered":"2024-09-17T03:40:14.485499+0000","last_clean":"2024-09-17T03:40:14.485499+0000","last_became_active":"2024-09-17T03:40:14.484594+0000","last_became_peered":"2024-09-17T03:40:14.484594+0000","last_unstale":"2024-09-17T03:40:14.485499+0000","last_undegraded":"2024-09-17T03:40:14.485499+0000","last_fullsized":"2024-09-17T03:40:14.485499+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:12.316965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552175+0000","last_change":"2024-09-17T03:40:15.488261+0000","last_active":"2024-09-17T03:40:16.552175+0000","last_peered":"2024-09-17T03:40:16.552175+0000","last_clean":"2024-09-17T03:40:16.552175+0000","last_became_active":"2024-09-17T03:40:15.487934+0000","last_became_peered":"2024-09-17T03:40:15.487934+0000","last_unstale":"2024-09-17T03:40:16.552175+0000","last_undegraded":"2024-09-17T03:40:16.552175+0000","last_fullsized":"2024-09-17T03:40:16.552175+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:02.064934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.482507+0000","last_change":"2024-09-17T03:40:14.480581+0000","last_active":"2024-09-17T03:40:14.482507+0000","last_peered":"2024-09-17T03:40:14.482507+0000","last_clean":"2024-09-17T03:40:14.482507+0000","last_became_active":"2024-09-17T03:40:14.480240+0000","last_became_peered":"2024-09-17T03:40:14.480240+0000","last_unstale":"2024-09-17T03:40:14.482507+0000","last_undegraded":"2024-09-17T03:40:14.482507+0000","last_fullsized":"2024-09-17T03:40:14.482507+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.242335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551951+0000","last_change":"2024-09-17T03:40:15.482447+0000","last_active":"2024-09-17T03:40:16.551951+0000","last_peered":"2024-09-17T03:40:16.551951+0000","last_clean":"2024-09-17T03:40:16.551951+0000","last_became_active":"2024-09-17T03:40:15.482134+0000","last_became_peered":"2024-09-17T03:40:15.482134+0000","last_unstale":"2024-09-17T03:40:16.551951+0000","last_undegraded":"2024-09-17T03:40:16.551951+0000","last_fullsized":"2024-09-17T03:40:16.551951+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:20.940998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.471433+0000","last_change":"2024-09-17T03:40:14.470150+0000","last_active":"2024-09-17T03:40:14.471433+0000","last_peered":"2024-09-17T03:40:14.471433+0000","last_clean":"2024-09-17T03:40:14.471433+0000","last_became_active":"2024-09-17T03:40:14.469836+0000","last_became_peered":"2024-09-17T03:40:14.469836+0000","last_unstale":"2024-09-17T03:40:14.471433+0000","last_undegraded":"2024-09-17T03:40:14.471433+0000","last_fullsized":"2024-09-17T03:40:14.471433+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:47.976750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551775+0000","last_change":"2024-09-17T03:40:15.474933+0000","last_active":"2024-09-17T03:40:16.551775+0000","last_peered":"2024-09-17T03:40:16.551775+0000","last_clean":"2024-09-17T03:40:16.551775+0000","last_became_active":"2024-09-17T03:40:15.474590+0000","last_became_peered":"2024-09-17T03:40:15.474590+0000","last_unstale":"2024-09-17T03:40:16.551775+0000","last_undegraded":"2024-09-17T03:40:16.551775+0000","last_fullsized":"2024-09-17T03:40:16.551775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:57.185460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.478166+0000","last_change":"2024-09-17T03:40:14.475793+0000","last_active":"2024-09-17T03:40:14.478166+0000","last_peered":"2024-09-17T03:40:14.478166+0000","last_clean":"2024-09-17T03:40:14.478166+0000","last_became_active":"2024-09-17T03:40:14.475496+0000","last_became_peered":"2024-09-17T03:40:14.475496+0000","last_unstale":"2024-09-17T03:40:14.478166+0000","last_undegraded":"2024-09-17T03:40:14.478166+0000","last_fullsized":"2024-09-17T03:40:14.478166+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:20.095174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467048+0000","last_change":"2024-09-17T03:40:14.467048+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467048+0000","last_undegraded":"2024-09-17T03:40:14.467048+0000","last_fullsized":"2024-09-17T03:40:14.467048+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.482575+0000","last_change":"2024-09-17T03:40:14.475616+0000","last_active":"2024-09-17T03:40:14.482575+0000","last_peered":"2024-09-17T03:40:14.482575+0000","last_clean":"2024-09-17T03:40:14.482575+0000","last_became_active":"2024-09-17T03:40:14.475319+0000","last_became_peered":"2024-09-17T03:40:14.475319+0000","last_unstale":"2024-09-17T03:40:14.482575+0000","last_undegraded":"2024-09-17T03:40:14.482575+0000","last_fullsized":"2024-09-17T03:40:14.482575+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:16.022122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468493+0000","last_change":"2024-09-17T03:40:14.468493+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468493+0000","last_undegraded":"2024-09-17T03:40:14.468493+0000","last_fullsized":"2024-09-17T03:40:14.468493+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.477126+0000","last_change":"2024-09-17T03:40:14.474157+0000","last_active":"2024-09-17T03:40:14.477126+0000","last_peered":"2024-09-17T03:40:14.477126+0000","last_clean":"2024-09-17T03:40:14.477126+0000","last_became_active":"2024-09-17T03:40:14.473846+0000","last_became_peered":"2024-09-17T03:40:14.473846+0000","last_unstale":"2024-09-17T03:40:14.477126+0000","last_undegraded":"2024-09-17T03:40:14.477126+0000","last_fullsized":"2024-09-17T03:40:14.477126+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:28.752232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468819+0000","last_change":"2024-09-17T03:40:14.468819+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468819+0000","last_undegraded":"2024-09-17T03:40:14.468819+0000","last_fullsized":"2024-09-17T03:40:14.468819+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.486862+0000","last_change":"2024-09-17T03:40:14.486426+0000","last_active":"2024-09-17T03:40:14.486862+0000","last_peered":"2024-09-17T03:40:14.486862+0000","last_clean":"2024-09-17T03:40:14.486862+0000","last_became_active":"2024-09-17T03:40:14.486185+0000","last_became_peered":"2024-09-17T03:40:14.486185+0000","last_unstale":"2024-09-17T03:40:14.486862+0000","last_undegraded":"2024-09-17T03:40:14.486862+0000","last_fullsized":"2024-09-17T03:40:14.486862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:37.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468420+0000","last_change":"2024-09-17T03:40:14.468420+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468420+0000","last_undegraded":"2024-09-17T03:40:14.468420+0000","last_fullsized":"2024-09-17T03:40:14.468420+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552753+0000","last_change":"2024-09-17T03:40:14.480432+0000","last_active":"2024-09-17T03:40:16.552753+0000","last_peered":"2024-09-17T03:40:16.552753+0000","last_clean":"2024-09-17T03:40:16.552753+0000","last_became_active":"2024-09-17T03:40:14.480110+0000","last_became_peered":"2024-09-17T03:40:14.480110+0000","last_unstale":"2024-09-17T03:40:16.552753+0000","last_undegraded":"2024-09-17T03:40:16.552753+0000","last_fullsized":"2024-09-17T03:40:16.552753+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:32.719766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467405+0000","last_change":"2024-09-17T03:40:14.467405+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467405+0000","last_undegraded":"2024-09-17T03:40:14.467405+0000","last_fullsized":"2024-09-17T03:40:14.467405+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.481234+0000","last_change":"2024-09-17T03:40:14.478399+0000","last_active":"2024-09-17T03:40:14.481234+0000","last_peered":"2024-09-17T03:40:14.481234+0000","last_clean":"2024-09-17T03:40:14.481234+0000","last_became_active":"2024-09-17T03:40:14.477797+0000","last_became_peered":"2024-09-17T03:40:14.477797+0000","last_unstale":"2024-09-17T03:40:14.481234+0000","last_undegraded":"2024-09-17T03:40:14.481234+0000","last_fullsized":"2024-09-17T03:40:14.481234+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:25.268711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.469468+0000","last_change":"2024-09-17T03:40:14.469468+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.469468+0000","last_undegraded":"2024-09-17T03:40:14.469468+0000","last_fullsized":"2024-09-17T03:40:14.469468+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.482323+0000","last_change":"2024-09-17T03:40:14.481534+0000","last_active":"2024-09-17T03:40:14.482323+0000","last_peered":"2024-09-17T03:40:14.482323+0000","last_clean":"2024-09-17T03:40:14.482323+0000","last_became_active":"2024-09-17T03:40:14.481228+0000","last_became_peered":"2024-09-17T03:40:14.481228+0000","last_unstale":"2024-09-17T03:40:14.482323+0000","last_undegraded":"2024-09-17T03:40:14.482323+0000","last_fullsized":"2024-09-17T03:40:14.482323+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:22.429779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468494+0000","last_change":"2024-09-17T03:40:14.468494+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468494+0000","last_undegraded":"2024-09-17T03:40:14.468494+0000","last_fullsized":"2024-09-17T03:40:14.468494+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.479177+0000","last_change":"2024-09-17T03:40:14.478288+0000","last_active":"2024-09-17T03:40:14.479177+0000","last_peered":"2024-09-17T03:40:14.479177+0000","last_clean":"2024-09-17T03:40:14.479177+0000","last_became_active":"2024-09-17T03:40:14.478005+0000","last_became_peered":"2024-09-17T03:40:14.478005+0000","last_unstale":"2024-09-17T03:40:14.479177+0000","last_undegraded":"2024-09-17T03:40:14.479177+0000","last_fullsized":"2024-09-17T03:40:14.479177+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:41.137552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551999+0000","last_change":"2024-09-17T03:40:15.497363+0000","last_active":"2024-09-17T03:40:16.551999+0000","last_peered":"2024-09-17T03:40:16.551999+0000","last_clean":"2024-09-17T03:40:16.551999+0000","last_became_active":"2024-09-17T03:40:15.495974+0000","last_became_peered":"2024-09-17T03:40:15.495974+0000","last_unstale":"2024-09-17T03:40:16.551999+0000","last_undegraded":"2024-09-17T03:40:16.551999+0000","last_fullsized":"2024-09-17T03:40:16.551999+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:36.847762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.479983+0000","last_change":"2024-09-17T03:40:14.473315+0000","last_active":"2024-09-17T03:40:14.479983+0000","last_peered":"2024-09-17T03:40:14.479983+0000","last_clean":"2024-09-17T03:40:14.479983+0000","last_became_active":"2024-09-17T03:40:14.472752+0000","last_became_peered":"2024-09-17T03:40:14.472752+0000","last_unstale":"2024-09-17T03:40:14.479983+0000","last_undegraded":"2024-09-17T03:40:14.479983+0000","last_fullsized":"2024-09-17T03:40:14.479983+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:24.545328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.466594+0000","last_change":"2024-09-17T03:40:14.466594+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.466594+0000","last_undegraded":"2024-09-17T03:40:14.466594+0000","last_fullsized":"2024-09-17T03:40:14.466594+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551565+0000","last_change":"2024-09-17T03:40:14.485645+0000","last_active":"2024-09-17T03:40:16.551565+0000","last_peered":"2024-09-17T03:40:16.551565+0000","last_clean":"2024-09-17T03:40:16.551565+0000","last_became_active":"2024-09-17T03:40:14.483559+0000","last_became_peered":"2024-09-17T03:40:14.483559+0000","last_unstale":"2024-09-17T03:40:16.551565+0000","last_undegraded":"2024-09-17T03:40:16.551565+0000","last_fullsized":"2024-09-17T03:40:16.551565+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:28.380087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.469453+0000","last_change":"2024-09-17T03:40:14.469453+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.469453+0000","last_undegraded":"2024-09-17T03:40:14.469453+0000","last_fullsized":"2024-09-17T03:40:14.469453+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.475689+0000","last_change":"2024-09-17T03:40:14.473982+0000","last_active":"2024-09-17T03:40:14.475689+0000","last_peered":"2024-09-17T03:40:14.475689+0000","last_clean":"2024-09-17T03:40:14.475689+0000","last_became_active":"2024-09-17T03:40:14.473658+0000","last_became_peered":"2024-09-17T03:40:14.473658+0000","last_unstale":"2024-09-17T03:40:14.475689+0000","last_undegraded":"2024-09-17T03:40:14.475689+0000","last_fullsized":"2024-09-17T03:40:14.475689+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:26.977607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.469350+0000","last_change":"2024-09-17T03:40:14.469350+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.469350+0000","last_undegraded":"2024-09-17T03:40:14.469350+0000","last_fullsized":"2024-09-17T03:40:14.469350+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.479783+0000","last_change":"2024-09-17T03:40:14.472535+0000","last_active":"2024-09-17T03:40:14.479783+0000","last_peered":"2024-09-17T03:40:14.479783+0000","last_clean":"2024-09-17T03:40:14.479783+0000","last_became_active":"2024-09-17T03:40:14.472200+0000","last_became_peered":"2024-09-17T03:40:14.472200+0000","last_unstale":"2024-09-17T03:40:14.479783+0000","last_undegraded":"2024-09-17T03:40:14.479783+0000","last_fullsized":"2024-09-17T03:40:14.479783+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:48.023358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.466029+0000","last_change":"2024-09-17T03:40:14.466029+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.466029+0000","last_undegraded":"2024-09-17T03:40:14.466029+0000","last_fullsized":"2024-09-17T03:40:14.466029+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552423+0000","last_change":"2024-09-17T03:40:14.483507+0000","last_active":"2024-09-17T03:40:16.552423+0000","last_peered":"2024-09-17T03:40:16.552423+0000","last_clean":"2024-09-17T03:40:16.552423+0000","last_became_active":"2024-09-17T03:40:14.483198+0000","last_became_peered":"2024-09-17T03:40:14.483198+0000","last_unstale":"2024-09-17T03:40:16.552423+0000","last_undegraded":"2024-09-17T03:40:16.552423+0000","last_fullsized":"2024-09-17T03:40:16.552423+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:27.505809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.462999+0000","last_change":"2024-09-17T03:40:14.462999+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.462999+0000","last_undegraded":"2024-09-17T03:40:14.462999+0000","last_fullsized":"2024-09-17T03:40:14.462999+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552671+0000","last_change":"2024-09-17T03:40:14.475085+0000","last_active":"2024-09-17T03:40:16.552671+0000","last_peered":"2024-09-17T03:40:16.552671+0000","last_clean":"2024-09-17T03:40:16.552671+0000","last_became_active":"2024-09-17T03:40:14.474642+0000","last_became_peered":"2024-09-17T03:40:14.474642+0000","last_unstale":"2024-09-17T03:40:16.552671+0000","last_undegraded":"2024-09-17T03:40:16.552671+0000","last_fullsized":"2024-09-17T03:40:16.552671+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:07.438425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.463536+0000","last_change":"2024-09-17T03:40:14.463536+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.463536+0000","last_undegraded":"2024-09-17T03:40:14.463536+0000","last_fullsized":"2024-09-17T03:40:14.463536+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.481414+0000","last_change":"2024-09-17T03:40:14.480911+0000","last_active":"2024-09-17T03:40:14.481414+0000","last_peered":"2024-09-17T03:40:14.481414+0000","last_clean":"2024-09-17T03:40:14.481414+0000","last_became_active":"2024-09-17T03:40:14.480499+0000","last_became_peered":"2024-09-17T03:40:14.480499+0000","last_unstale":"2024-09-17T03:40:14.481414+0000","last_undegraded":"2024-09-17T03:40:14.481414+0000","last_fullsized":"2024-09-17T03:40:14.481414+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:58.351626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467991+0000","last_change":"2024-09-17T03:40:14.467991+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467991+0000","last_undegraded":"2024-09-17T03:40:14.467991+0000","last_fullsized":"2024-09-17T03:40:14.467991+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.475489+0000","last_change":"2024-09-17T03:40:14.472140+0000","last_active":"2024-09-17T03:40:14.475489+0000","last_peered":"2024-09-17T03:40:14.475489+0000","last_clean":"2024-09-17T03:40:14.475489+0000","last_became_active":"2024-09-17T03:40:14.471857+0000","last_became_peered":"2024-09-17T03:40:14.471857+0000","last_unstale":"2024-09-17T03:40:14.475489+0000","last_undegraded":"2024-09-17T03:40:14.475489+0000","last_fullsized":"2024-09-17T03:40:14.475489+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:30.623360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468941+0000","last_change":"2024-09-17T03:40:14.468941+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468941+0000","last_undegraded":"2024-09-17T03:40:14.468941+0000","last_fullsized":"2024-09-17T03:40:14.468941+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.479952+0000","last_change":"2024-09-17T03:40:14.473025+0000","last_active":"2024-09-17T03:40:14.479952+0000","last_peered":"2024-09-17T03:40:14.479952+0000","last_clean":"2024-09-17T03:40:14.479952+0000","last_became_active":"2024-09-17T03:40:14.472373+0000","last_became_peered":"2024-09-17T03:40:14.472373+0000","last_unstale":"2024-09-17T03:40:14.479952+0000","last_undegraded":"2024-09-17T03:40:14.479952+0000","last_fullsized":"2024-09-17T03:40:14.479952+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:09.188966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551907+0000","last_change":"2024-09-17T03:40:15.483370+0000","last_active":"2024-09-17T03:40:16.551907+0000","last_peered":"2024-09-17T03:40:16.551907+0000","last_clean":"2024-09-17T03:40:16.551907+0000","last_became_active":"2024-09-17T03:40:15.483063+0000","last_became_peered":"2024-09-17T03:40:15.483063+0000","last_unstale":"2024-09-17T03:40:16.551907+0000","last_undegraded":"2024-09-17T03:40:16.551907+0000","last_fullsized":"2024-09-17T03:40:16.551907+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:53.510707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552003+0000","last_change":"2024-09-17T03:40:14.482698+0000","last_active":"2024-09-17T03:40:16.552003+0000","last_peered":"2024-09-17T03:40:16.552003+0000","last_clean":"2024-09-17T03:40:16.552003+0000","last_became_active":"2024-09-17T03:40:14.482376+0000","last_became_peered":"2024-09-17T03:40:14.482376+0000","last_unstale":"2024-09-17T03:40:16.552003+0000","last_undegraded":"2024-09-17T03:40:16.552003+0000","last_fullsized":"2024-09-17T03:40:16.552003+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:16.596119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":283,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.472050+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:40:14.472050+0000","last_peered":"2024-09-17T03:40:14.472050+0000","last_clean":"2024-09-17T03:40:14.472050+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:40:14.472050+0000","last_undegraded":"2024-09-17T03:40:14.472050+0000","last_fullsized":"2024-09-17T03:40:14.472050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509533,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41476,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330364,"statfs":{"total":96636764160,"available":96594292736,"internally_reserved":0,"allocated":2002944,"data_stored":1202924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40434123},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46464,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325376,"statfs":{"total":96636764160,"available":96589185024,"internally_reserved":0,"allocated":1421312,"data_stored":618831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50624,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321216,"statfs":{"total":96636764160,"available":96584925184,"internally_reserved":0,"allocated":1409024,"data_stored":612556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46452,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325388,"statfs":{"total":96636764160,"available":96589197312,"internally_reserved":0,"allocated":1409024,"data_stored":612556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50612,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321228,"statfs":{"total":96636764160,"available":96584937472,"internally_reserved":0,"allocated":1409024,"data_stored":612556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509534,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45624,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326216,"statfs":{"total":96636764160,"available":96590045184,"internally_reserved":0,"allocated":2002944,"data_stored":1202924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574941,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28452,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343388,"statfs":{"total":96636764160,"available":96607629312,"internally_reserved":0,"allocated":1454080,"data_stored":632510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574941,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46508,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325332,"statfs":{"total":96636764160,"available":96589139968,"internally_reserved":0,"allocated":1462272,"data_stored":633588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:19.497 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.646+0000 7f694d539640 1 -- 172.21.15.146:0/2457856451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6930004800 msgr2=0x7f6930004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.646+0000 7f694d539640 1 --2- 172.21.15.146:0/2457856451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6930004800 0x7f6930004c10 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f693c006fa0 tx=0x7f6930005830 comp rx=0 tx=0).stop 2024-09-17T03:40:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.646+0000 7f69477fe640 1 -- 172.21.15.146:0/2457856451 reap_dead start 2024-09-17T03:40:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.646+0000 7f694d539640 1 -- 172.21.15.146:0/2457856451 shutdown_connections 2024-09-17T03:40:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.646+0000 7f694d539640 1 -- 172.21.15.146:0/2457856451 >> 172.21.15.146:0/2457856451 conn(0x7f69480b2060 msgr2=0x7f69480b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.646+0000 7f694d539640 1 -- 172.21.15.146:0/2457856451 shutdown_connections 2024-09-17T03:40:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.647+0000 7f694d539640 1 -- 172.21.15.146:0/2457856451 wait complete. 2024-09-17T03:40:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.648+0000 7f694d539640 1 Processor -- start 2024-09-17T03:40:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.648+0000 7f694d539640 1 -- start start 2024-09-17T03:40:19.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f694d539640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930004800 0x7f69481f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f694d539640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69481f3690 0x7f6948156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f694d539640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69481573a0 0x7f69480ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f694d539640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f694806e470 con 0x7f69481573a0 2024-09-17T03:40:19.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f694d539640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f69480b4dc0 con 0x7f6930004800 2024-09-17T03:40:19.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f694d539640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f694806e5f0 con 0x7f69481f3690 2024-09-17T03:40:19.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f69477fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69481573a0 0x7f69480ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f69477fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69481573a0 0x7f69480ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53454/0 (socket says 172.21.15.146:53454) 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f69477fe640 1 -- 172.21.15.146:0/2792115154 learned_addr learned my addr 172.21.15.146:0/2792115154 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f6946ffd640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930004800 0x7f69481f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f69467fc640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69481f3690 0x7f6948156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f69477fe640 1 -- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69481f3690 msgr2=0x7f6948156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f69477fe640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69481f3690 0x7f6948156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f69477fe640 1 -- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930004800 msgr2=0x7f69481f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f69477fe640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930004800 0x7f69481f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f69477fe640 1 -- 172.21.15.146:0/2792115154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69481577b0 con 0x7f69481573a0 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f69477fe640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69481573a0 0x7f69480ae860 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f6930004780 tx=0x7f6940010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f692f7fe640 1 -- 172.21.15.146:0/2792115154 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694000ec70 con 0x7f69481573a0 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f692f7fe640 1 -- 172.21.15.146:0/2792115154 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f694000ee30 con 0x7f69481573a0 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f694d539640 1 -- 172.21.15.146:0/2792115154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69481f3da0 con 0x7f69481573a0 2024-09-17T03:40:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f692f7fe640 1 -- 172.21.15.146:0/2792115154 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940004d60 con 0x7f69481573a0 2024-09-17T03:40:19.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.650+0000 7f694d539640 1 -- 172.21.15.146:0/2792115154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69481488e0 con 0x7f69481573a0 2024-09-17T03:40:19.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.651+0000 7f694d539640 1 -- 172.21.15.146:0/2792115154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69481f3b10 con 0x7f69481573a0 2024-09-17T03:40:19.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.652+0000 7f692f7fe640 1 -- 172.21.15.146:0/2792115154 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f694001c020 con 0x7f69481573a0 2024-09-17T03:40:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.653+0000 7f692f7fe640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6934078b90 0x7f693407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.653+0000 7f692f7fe640 1 -- 172.21.15.146:0/2792115154 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f694009b020 con 0x7f69481573a0 2024-09-17T03:40:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.653+0000 7f6946ffd640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6934078b90 0x7f693407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.653+0000 7f6946ffd640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6934078b90 0x7f693407b0a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6938000c00 tx=0x7f6938006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.657+0000 7f692f7fe640 1 -- 172.21.15.146:0/2792115154 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f69481577b0 con 0x7f69481573a0 2024-09-17T03:40:19.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.828+0000 7f694d539640 1 -- 172.21.15.146:0/2792115154 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f694815ead0 con 0x7f6934078b90 2024-09-17T03:40:19.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.832+0000 7f692f7fe640 1 -- 172.21.15.146:0/2792115154 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248290 (secure 0 0 0) 0x7f694815ead0 con 0x7f6934078b90 2024-09-17T03:40:19.835 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:19.837 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:40:19.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 -- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6934078b90 msgr2=0x7f693407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6934078b90 0x7f693407b0a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6938000c00 tx=0x7f6938006b70 comp rx=0 tx=0).stop 2024-09-17T03:40:19.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 -- 172.21.15.146:0/2792115154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69481573a0 msgr2=0x7f69480ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:19.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69481573a0 0x7f69480ae860 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f6930004780 tx=0x7f6940010f00 comp rx=0 tx=0).stop 2024-09-17T03:40:19.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 -- 172.21.15.146:0/2792115154 shutdown_connections 2024-09-17T03:40:19.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6934078b90 0x7f693407b0a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69481573a0 0x7f69480ae860 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69481f3690 0x7f6948156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 --2- 172.21.15.146:0/2792115154 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930004800 0x7f69481f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:19.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 -- 172.21.15.146:0/2792115154 >> 172.21.15.146:0/2792115154 conn(0x7f69480b2060 msgr2=0x7f694815d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:19.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 -- 172.21.15.146:0/2792115154 shutdown_connections 2024-09-17T03:40:19.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:19.836+0000 7f694d539640 1 -- 172.21.15.146:0/2792115154 wait complete. 2024-09-17T03:40:19.847 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-09-17T03:40:17.907217+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":356212,"kb_used_data":12276,"kb_used_omap":12,"kb_used_meta":343731,"kb_avail":754618508,"statfs":{"total":773094113280,"available":772729352192,"internally_reserved":0,"allocated":12570624,"data_stored":6128445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":351981105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.452847"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.474412+0000","last_change":"2024-09-17T03:40:14.474412+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.474412+0000","last_undegraded":"2024-09-17T03:40:14.474412+0000","last_fullsized":"2024-09-17T03:40:14.474412+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.462557+0000","last_change":"2024-09-17T03:40:14.462557+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.462557+0000","last_undegraded":"2024-09-17T03:40:14.462557+0000","last_fullsized":"2024-09-17T03:40:14.462557+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.469918+0000","last_change":"2024-09-17T03:40:14.469918+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.469918+0000","last_undegraded":"2024-09-17T03:40:14.469918+0000","last_fullsized":"2024-09-17T03:40:14.469918+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.473735+0000","last_change":"2024-09-17T03:40:14.473735+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.473735+0000","last_undegraded":"2024-09-17T03:40:14.473735+0000","last_fullsized":"2024-09-17T03:40:14.473735+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467916+0000","last_change":"2024-09-17T03:40:14.467916+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467916+0000","last_undegraded":"2024-09-17T03:40:14.467916+0000","last_fullsized":"2024-09-17T03:40:14.467916+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.475403+0000","last_change":"2024-09-17T03:40:14.475403+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.475403+0000","last_undegraded":"2024-09-17T03:40:14.475403+0000","last_fullsized":"2024-09-17T03:40:14.475403+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551912+0000","last_change":"2024-09-17T03:40:15.479882+0000","last_active":"2024-09-17T03:40:16.551912+0000","last_peered":"2024-09-17T03:40:16.551912+0000","last_clean":"2024-09-17T03:40:16.551912+0000","last_became_active":"2024-09-17T03:40:15.479041+0000","last_became_peered":"2024-09-17T03:40:15.479041+0000","last_unstale":"2024-09-17T03:40:16.551912+0000","last_undegraded":"2024-09-17T03:40:16.551912+0000","last_fullsized":"2024-09-17T03:40:16.551912+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:31.468455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470750+0000","last_change":"2024-09-17T03:40:14.470750+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470750+0000","last_undegraded":"2024-09-17T03:40:14.470750+0000","last_fullsized":"2024-09-17T03:40:14.470750+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.473283+0000","last_change":"2024-09-17T03:40:14.473283+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.473283+0000","last_undegraded":"2024-09-17T03:40:14.473283+0000","last_fullsized":"2024-09-17T03:40:14.473283+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.472818+0000","last_change":"2024-09-17T03:40:14.472818+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.472818+0000","last_undegraded":"2024-09-17T03:40:14.472818+0000","last_fullsized":"2024-09-17T03:40:14.472818+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.463012+0000","last_change":"2024-09-17T03:40:14.463012+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.463012+0000","last_undegraded":"2024-09-17T03:40:14.463012+0000","last_fullsized":"2024-09-17T03:40:14.463012+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.471829+0000","last_change":"2024-09-17T03:40:14.471829+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.471829+0000","last_undegraded":"2024-09-17T03:40:14.471829+0000","last_fullsized":"2024-09-17T03:40:14.471829+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467384+0000","last_change":"2024-09-17T03:40:14.467384+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467384+0000","last_undegraded":"2024-09-17T03:40:14.467384+0000","last_fullsized":"2024-09-17T03:40:14.467384+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467936+0000","last_change":"2024-09-17T03:40:14.467936+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467936+0000","last_undegraded":"2024-09-17T03:40:14.467936+0000","last_fullsized":"2024-09-17T03:40:14.467936+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.477600+0000","last_change":"2024-09-17T03:40:14.477600+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.477600+0000","last_undegraded":"2024-09-17T03:40:14.477600+0000","last_fullsized":"2024-09-17T03:40:14.477600+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470980+0000","last_change":"2024-09-17T03:40:14.470980+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470980+0000","last_undegraded":"2024-09-17T03:40:14.470980+0000","last_fullsized":"2024-09-17T03:40:14.470980+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.463153+0000","last_change":"2024-09-17T03:40:14.463153+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.463153+0000","last_undegraded":"2024-09-17T03:40:14.463153+0000","last_fullsized":"2024-09-17T03:40:14.463153+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467131+0000","last_change":"2024-09-17T03:40:14.467131+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467131+0000","last_undegraded":"2024-09-17T03:40:14.467131+0000","last_fullsized":"2024-09-17T03:40:14.467131+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.469449+0000","last_change":"2024-09-17T03:40:14.469449+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.469449+0000","last_undegraded":"2024-09-17T03:40:14.469449+0000","last_fullsized":"2024-09-17T03:40:14.469449+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.463127+0000","last_change":"2024-09-17T03:40:14.463127+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.463127+0000","last_undegraded":"2024-09-17T03:40:14.463127+0000","last_fullsized":"2024-09-17T03:40:14.463127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.462458+0000","last_change":"2024-09-17T03:40:14.462458+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.462458+0000","last_undegraded":"2024-09-17T03:40:14.462458+0000","last_fullsized":"2024-09-17T03:40:14.462458+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551935+0000","last_change":"2024-09-17T03:40:15.470210+0000","last_active":"2024-09-17T03:40:16.551935+0000","last_peered":"2024-09-17T03:40:16.551935+0000","last_clean":"2024-09-17T03:40:16.551935+0000","last_became_active":"2024-09-17T03:40:15.469093+0000","last_became_peered":"2024-09-17T03:40:15.469093+0000","last_unstale":"2024-09-17T03:40:16.551935+0000","last_undegraded":"2024-09-17T03:40:16.551935+0000","last_fullsized":"2024-09-17T03:40:16.551935+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:35.551590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.463740+0000","last_change":"2024-09-17T03:40:14.463740+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.463740+0000","last_undegraded":"2024-09-17T03:40:14.463740+0000","last_fullsized":"2024-09-17T03:40:14.463740+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551653+0000","last_change":"2024-09-17T03:40:15.484372+0000","last_active":"2024-09-17T03:40:16.551653+0000","last_peered":"2024-09-17T03:40:16.551653+0000","last_clean":"2024-09-17T03:40:16.551653+0000","last_became_active":"2024-09-17T03:40:15.484026+0000","last_became_peered":"2024-09-17T03:40:15.484026+0000","last_unstale":"2024-09-17T03:40:16.551653+0000","last_undegraded":"2024-09-17T03:40:16.551653+0000","last_fullsized":"2024-09-17T03:40:16.551653+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:31.193826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.462236+0000","last_change":"2024-09-17T03:40:14.462236+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.462236+0000","last_undegraded":"2024-09-17T03:40:14.462236+0000","last_fullsized":"2024-09-17T03:40:14.462236+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.471223+0000","last_change":"2024-09-17T03:40:14.471223+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.471223+0000","last_undegraded":"2024-09-17T03:40:14.471223+0000","last_fullsized":"2024-09-17T03:40:14.471223+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.475986+0000","last_change":"2024-09-17T03:40:14.475986+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.475986+0000","last_undegraded":"2024-09-17T03:40:14.475986+0000","last_fullsized":"2024-09-17T03:40:14.475986+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552236+0000","last_change":"2024-09-17T03:40:15.494642+0000","last_active":"2024-09-17T03:40:16.552236+0000","last_peered":"2024-09-17T03:40:16.552236+0000","last_clean":"2024-09-17T03:40:16.552236+0000","last_became_active":"2024-09-17T03:40:15.494266+0000","last_became_peered":"2024-09-17T03:40:15.494266+0000","last_unstale":"2024-09-17T03:40:16.552236+0000","last_undegraded":"2024-09-17T03:40:16.552236+0000","last_fullsized":"2024-09-17T03:40:16.552236+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:13.272105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.464551+0000","last_change":"2024-09-17T03:40:14.464551+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.464551+0000","last_undegraded":"2024-09-17T03:40:14.464551+0000","last_fullsized":"2024-09-17T03:40:14.464551+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552939+0000","last_change":"2024-09-17T03:40:15.489604+0000","last_active":"2024-09-17T03:40:16.552939+0000","last_peered":"2024-09-17T03:40:16.552939+0000","last_clean":"2024-09-17T03:40:16.552939+0000","last_became_active":"2024-09-17T03:40:15.489302+0000","last_became_peered":"2024-09-17T03:40:15.489302+0000","last_unstale":"2024-09-17T03:40:16.552939+0000","last_undegraded":"2024-09-17T03:40:16.552939+0000","last_fullsized":"2024-09-17T03:40:16.552939+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:51.069041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470799+0000","last_change":"2024-09-17T03:40:14.470799+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470799+0000","last_undegraded":"2024-09-17T03:40:14.470799+0000","last_fullsized":"2024-09-17T03:40:14.470799+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.476563+0000","last_change":"2024-09-17T03:40:14.476563+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.476563+0000","last_undegraded":"2024-09-17T03:40:14.476563+0000","last_fullsized":"2024-09-17T03:40:14.476563+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.474749+0000","last_change":"2024-09-17T03:40:14.474749+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.474749+0000","last_undegraded":"2024-09-17T03:40:14.474749+0000","last_fullsized":"2024-09-17T03:40:14.474749+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"116'4","reported_seq":19,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552862+0000","last_change":"2024-09-17T03:40:14.474590+0000","last_active":"2024-09-17T03:40:16.552862+0000","last_peered":"2024-09-17T03:40:16.552862+0000","last_clean":"2024-09-17T03:40:16.552862+0000","last_became_active":"2024-09-17T03:40:14.474251+0000","last_became_peered":"2024-09-17T03:40:14.474251+0000","last_unstale":"2024-09-17T03:40:16.552862+0000","last_undegraded":"2024-09-17T03:40:16.552862+0000","last_fullsized":"2024-09-17T03:40:16.552862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:24.482162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.465900+0000","last_change":"2024-09-17T03:40:14.465900+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.465900+0000","last_undegraded":"2024-09-17T03:40:14.465900+0000","last_fullsized":"2024-09-17T03:40:14.465900+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.476736+0000","last_change":"2024-09-17T03:40:14.475924+0000","last_active":"2024-09-17T03:40:14.476736+0000","last_peered":"2024-09-17T03:40:14.476736+0000","last_clean":"2024-09-17T03:40:14.476736+0000","last_became_active":"2024-09-17T03:40:14.475532+0000","last_became_peered":"2024-09-17T03:40:14.475532+0000","last_unstale":"2024-09-17T03:40:14.476736+0000","last_undegraded":"2024-09-17T03:40:14.476736+0000","last_fullsized":"2024-09-17T03:40:14.476736+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:25.973617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470779+0000","last_change":"2024-09-17T03:40:14.470779+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470779+0000","last_undegraded":"2024-09-17T03:40:14.470779+0000","last_fullsized":"2024-09-17T03:40:14.470779+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.475195+0000","last_change":"2024-09-17T03:40:14.470654+0000","last_active":"2024-09-17T03:40:14.475195+0000","last_peered":"2024-09-17T03:40:14.475195+0000","last_clean":"2024-09-17T03:40:14.475195+0000","last_became_active":"2024-09-17T03:40:14.470305+0000","last_became_peered":"2024-09-17T03:40:14.470305+0000","last_unstale":"2024-09-17T03:40:14.475195+0000","last_undegraded":"2024-09-17T03:40:14.475195+0000","last_fullsized":"2024-09-17T03:40:14.475195+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:45.336467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468965+0000","last_change":"2024-09-17T03:40:14.468965+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468965+0000","last_undegraded":"2024-09-17T03:40:14.468965+0000","last_fullsized":"2024-09-17T03:40:14.468965+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.481974+0000","last_change":"2024-09-17T03:40:14.480944+0000","last_active":"2024-09-17T03:40:14.481974+0000","last_peered":"2024-09-17T03:40:14.481974+0000","last_clean":"2024-09-17T03:40:14.481974+0000","last_became_active":"2024-09-17T03:40:14.480631+0000","last_became_peered":"2024-09-17T03:40:14.480631+0000","last_unstale":"2024-09-17T03:40:14.481974+0000","last_undegraded":"2024-09-17T03:40:14.481974+0000","last_fullsized":"2024-09-17T03:40:14.481974+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:31.749316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470314+0000","last_change":"2024-09-17T03:40:14.470314+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470314+0000","last_undegraded":"2024-09-17T03:40:14.470314+0000","last_fullsized":"2024-09-17T03:40:14.470314+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552511+0000","last_change":"2024-09-17T03:40:14.481995+0000","last_active":"2024-09-17T03:40:16.552511+0000","last_peered":"2024-09-17T03:40:16.552511+0000","last_clean":"2024-09-17T03:40:16.552511+0000","last_became_active":"2024-09-17T03:40:14.481664+0000","last_became_peered":"2024-09-17T03:40:14.481664+0000","last_unstale":"2024-09-17T03:40:16.552511+0000","last_undegraded":"2024-09-17T03:40:16.552511+0000","last_fullsized":"2024-09-17T03:40:16.552511+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:21.880772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.464099+0000","last_change":"2024-09-17T03:40:14.464099+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.464099+0000","last_undegraded":"2024-09-17T03:40:14.464099+0000","last_fullsized":"2024-09-17T03:40:14.464099+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552304+0000","last_change":"2024-09-17T03:40:14.480486+0000","last_active":"2024-09-17T03:40:16.552304+0000","last_peered":"2024-09-17T03:40:16.552304+0000","last_clean":"2024-09-17T03:40:16.552304+0000","last_became_active":"2024-09-17T03:40:14.480219+0000","last_became_peered":"2024-09-17T03:40:14.480219+0000","last_unstale":"2024-09-17T03:40:16.552304+0000","last_undegraded":"2024-09-17T03:40:16.552304+0000","last_fullsized":"2024-09-17T03:40:16.552304+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:55.122669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.470019+0000","last_change":"2024-09-17T03:40:14.470019+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.470019+0000","last_undegraded":"2024-09-17T03:40:14.470019+0000","last_fullsized":"2024-09-17T03:40:14.470019+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.479637+0000","last_change":"2024-09-17T03:40:14.479207+0000","last_active":"2024-09-17T03:40:14.479637+0000","last_peered":"2024-09-17T03:40:14.479637+0000","last_clean":"2024-09-17T03:40:14.479637+0000","last_became_active":"2024-09-17T03:40:14.478974+0000","last_became_peered":"2024-09-17T03:40:14.478974+0000","last_unstale":"2024-09-17T03:40:14.479637+0000","last_undegraded":"2024-09-17T03:40:14.479637+0000","last_fullsized":"2024-09-17T03:40:14.479637+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:05.106569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551862+0000","last_change":"2024-09-17T03:40:15.480254+0000","last_active":"2024-09-17T03:40:16.551862+0000","last_peered":"2024-09-17T03:40:16.551862+0000","last_clean":"2024-09-17T03:40:16.551862+0000","last_became_active":"2024-09-17T03:40:15.479489+0000","last_became_peered":"2024-09-17T03:40:15.479489+0000","last_unstale":"2024-09-17T03:40:16.551862+0000","last_undegraded":"2024-09-17T03:40:16.551862+0000","last_fullsized":"2024-09-17T03:40:16.551862+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:21.795552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.486069+0000","last_change":"2024-09-17T03:40:14.485088+0000","last_active":"2024-09-17T03:40:14.486069+0000","last_peered":"2024-09-17T03:40:14.486069+0000","last_clean":"2024-09-17T03:40:14.486069+0000","last_became_active":"2024-09-17T03:40:14.484700+0000","last_became_peered":"2024-09-17T03:40:14.484700+0000","last_unstale":"2024-09-17T03:40:14.486069+0000","last_undegraded":"2024-09-17T03:40:14.486069+0000","last_fullsized":"2024-09-17T03:40:14.486069+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:07.134098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553004+0000","last_change":"2024-09-17T03:40:15.481077+0000","last_active":"2024-09-17T03:40:16.553004+0000","last_peered":"2024-09-17T03:40:16.553004+0000","last_clean":"2024-09-17T03:40:16.553004+0000","last_became_active":"2024-09-17T03:40:15.480776+0000","last_became_peered":"2024-09-17T03:40:15.480776+0000","last_unstale":"2024-09-17T03:40:16.553004+0000","last_undegraded":"2024-09-17T03:40:16.553004+0000","last_fullsized":"2024-09-17T03:40:16.553004+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:41.034237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.475250+0000","last_change":"2024-09-17T03:40:14.471040+0000","last_active":"2024-09-17T03:40:14.475250+0000","last_peered":"2024-09-17T03:40:14.475250+0000","last_clean":"2024-09-17T03:40:14.475250+0000","last_became_active":"2024-09-17T03:40:14.470269+0000","last_became_peered":"2024-09-17T03:40:14.470269+0000","last_unstale":"2024-09-17T03:40:14.475250+0000","last_undegraded":"2024-09-17T03:40:14.475250+0000","last_fullsized":"2024-09-17T03:40:14.475250+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:03.964932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.465185+0000","last_change":"2024-09-17T03:40:14.465185+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.465185+0000","last_undegraded":"2024-09-17T03:40:14.465185+0000","last_fullsized":"2024-09-17T03:40:14.465185+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552017+0000","last_change":"2024-09-17T03:40:14.480083+0000","last_active":"2024-09-17T03:40:16.552017+0000","last_peered":"2024-09-17T03:40:16.552017+0000","last_clean":"2024-09-17T03:40:16.552017+0000","last_became_active":"2024-09-17T03:40:14.479815+0000","last_became_peered":"2024-09-17T03:40:14.479815+0000","last_unstale":"2024-09-17T03:40:16.552017+0000","last_undegraded":"2024-09-17T03:40:16.552017+0000","last_fullsized":"2024-09-17T03:40:16.552017+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:46.688766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552355+0000","last_change":"2024-09-17T03:40:15.474882+0000","last_active":"2024-09-17T03:40:16.552355+0000","last_peered":"2024-09-17T03:40:16.552355+0000","last_clean":"2024-09-17T03:40:16.552355+0000","last_became_active":"2024-09-17T03:40:15.474567+0000","last_became_peered":"2024-09-17T03:40:15.474567+0000","last_unstale":"2024-09-17T03:40:16.552355+0000","last_undegraded":"2024-09-17T03:40:16.552355+0000","last_fullsized":"2024-09-17T03:40:16.552355+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:48.082051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.483566+0000","last_change":"2024-09-17T03:40:14.481321+0000","last_active":"2024-09-17T03:40:14.483566+0000","last_peered":"2024-09-17T03:40:14.483566+0000","last_clean":"2024-09-17T03:40:14.483566+0000","last_became_active":"2024-09-17T03:40:14.481045+0000","last_became_peered":"2024-09-17T03:40:14.481045+0000","last_unstale":"2024-09-17T03:40:14.483566+0000","last_undegraded":"2024-09-17T03:40:14.483566+0000","last_fullsized":"2024-09-17T03:40:14.483566+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:54.104963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553056+0000","last_change":"2024-09-17T03:40:15.485451+0000","last_active":"2024-09-17T03:40:16.553056+0000","last_peered":"2024-09-17T03:40:16.553056+0000","last_clean":"2024-09-17T03:40:16.553056+0000","last_became_active":"2024-09-17T03:40:15.485116+0000","last_became_peered":"2024-09-17T03:40:15.485116+0000","last_unstale":"2024-09-17T03:40:16.553056+0000","last_undegraded":"2024-09-17T03:40:16.553056+0000","last_fullsized":"2024-09-17T03:40:16.553056+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:48.894066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.485499+0000","last_change":"2024-09-17T03:40:14.484915+0000","last_active":"2024-09-17T03:40:14.485499+0000","last_peered":"2024-09-17T03:40:14.485499+0000","last_clean":"2024-09-17T03:40:14.485499+0000","last_became_active":"2024-09-17T03:40:14.484594+0000","last_became_peered":"2024-09-17T03:40:14.484594+0000","last_unstale":"2024-09-17T03:40:14.485499+0000","last_undegraded":"2024-09-17T03:40:14.485499+0000","last_fullsized":"2024-09-17T03:40:14.485499+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:12.316965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552175+0000","last_change":"2024-09-17T03:40:15.488261+0000","last_active":"2024-09-17T03:40:16.552175+0000","last_peered":"2024-09-17T03:40:16.552175+0000","last_clean":"2024-09-17T03:40:16.552175+0000","last_became_active":"2024-09-17T03:40:15.487934+0000","last_became_peered":"2024-09-17T03:40:15.487934+0000","last_unstale":"2024-09-17T03:40:16.552175+0000","last_undegraded":"2024-09-17T03:40:16.552175+0000","last_fullsized":"2024-09-17T03:40:16.552175+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:02.064934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.482507+0000","last_change":"2024-09-17T03:40:14.480581+0000","last_active":"2024-09-17T03:40:14.482507+0000","last_peered":"2024-09-17T03:40:14.482507+0000","last_clean":"2024-09-17T03:40:14.482507+0000","last_became_active":"2024-09-17T03:40:14.480240+0000","last_became_peered":"2024-09-17T03:40:14.480240+0000","last_unstale":"2024-09-17T03:40:14.482507+0000","last_undegraded":"2024-09-17T03:40:14.482507+0000","last_fullsized":"2024-09-17T03:40:14.482507+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.242335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551951+0000","last_change":"2024-09-17T03:40:15.482447+0000","last_active":"2024-09-17T03:40:16.551951+0000","last_peered":"2024-09-17T03:40:16.551951+0000","last_clean":"2024-09-17T03:40:16.551951+0000","last_became_active":"2024-09-17T03:40:15.482134+0000","last_became_peered":"2024-09-17T03:40:15.482134+0000","last_unstale":"2024-09-17T03:40:16.551951+0000","last_undegraded":"2024-09-17T03:40:16.551951+0000","last_fullsized":"2024-09-17T03:40:16.551951+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:20.940998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.471433+0000","last_change":"2024-09-17T03:40:14.470150+0000","last_active":"2024-09-17T03:40:14.471433+0000","last_peered":"2024-09-17T03:40:14.471433+0000","last_clean":"2024-09-17T03:40:14.471433+0000","last_became_active":"2024-09-17T03:40:14.469836+0000","last_became_peered":"2024-09-17T03:40:14.469836+0000","last_unstale":"2024-09-17T03:40:14.471433+0000","last_undegraded":"2024-09-17T03:40:14.471433+0000","last_fullsized":"2024-09-17T03:40:14.471433+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:47.976750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551775+0000","last_change":"2024-09-17T03:40:15.474933+0000","last_active":"2024-09-17T03:40:16.551775+0000","last_peered":"2024-09-17T03:40:16.551775+0000","last_clean":"2024-09-17T03:40:16.551775+0000","last_became_active":"2024-09-17T03:40:15.474590+0000","last_became_peered":"2024-09-17T03:40:15.474590+0000","last_unstale":"2024-09-17T03:40:16.551775+0000","last_undegraded":"2024-09-17T03:40:16.551775+0000","last_fullsized":"2024-09-17T03:40:16.551775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:57.185460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.478166+0000","last_change":"2024-09-17T03:40:14.475793+0000","last_active":"2024-09-17T03:40:14.478166+0000","last_peered":"2024-09-17T03:40:14.478166+0000","last_clean":"2024-09-17T03:40:14.478166+0000","last_became_active":"2024-09-17T03:40:14.475496+0000","last_became_peered":"2024-09-17T03:40:14.475496+0000","last_unstale":"2024-09-17T03:40:14.478166+0000","last_undegraded":"2024-09-17T03:40:14.478166+0000","last_fullsized":"2024-09-17T03:40:14.478166+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:20.095174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467048+0000","last_change":"2024-09-17T03:40:14.467048+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467048+0000","last_undegraded":"2024-09-17T03:40:14.467048+0000","last_fullsized":"2024-09-17T03:40:14.467048+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.482575+0000","last_change":"2024-09-17T03:40:14.475616+0000","last_active":"2024-09-17T03:40:14.482575+0000","last_peered":"2024-09-17T03:40:14.482575+0000","last_clean":"2024-09-17T03:40:14.482575+0000","last_became_active":"2024-09-17T03:40:14.475319+0000","last_became_peered":"2024-09-17T03:40:14.475319+0000","last_unstale":"2024-09-17T03:40:14.482575+0000","last_undegraded":"2024-09-17T03:40:14.482575+0000","last_fullsized":"2024-09-17T03:40:14.482575+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:16.022122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468493+0000","last_change":"2024-09-17T03:40:14.468493+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468493+0000","last_undegraded":"2024-09-17T03:40:14.468493+0000","last_fullsized":"2024-09-17T03:40:14.468493+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.477126+0000","last_change":"2024-09-17T03:40:14.474157+0000","last_active":"2024-09-17T03:40:14.477126+0000","last_peered":"2024-09-17T03:40:14.477126+0000","last_clean":"2024-09-17T03:40:14.477126+0000","last_became_active":"2024-09-17T03:40:14.473846+0000","last_became_peered":"2024-09-17T03:40:14.473846+0000","last_unstale":"2024-09-17T03:40:14.477126+0000","last_undegraded":"2024-09-17T03:40:14.477126+0000","last_fullsized":"2024-09-17T03:40:14.477126+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:28.752232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468819+0000","last_change":"2024-09-17T03:40:14.468819+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468819+0000","last_undegraded":"2024-09-17T03:40:14.468819+0000","last_fullsized":"2024-09-17T03:40:14.468819+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.486862+0000","last_change":"2024-09-17T03:40:14.486426+0000","last_active":"2024-09-17T03:40:14.486862+0000","last_peered":"2024-09-17T03:40:14.486862+0000","last_clean":"2024-09-17T03:40:14.486862+0000","last_became_active":"2024-09-17T03:40:14.486185+0000","last_became_peered":"2024-09-17T03:40:14.486185+0000","last_unstale":"2024-09-17T03:40:14.486862+0000","last_undegraded":"2024-09-17T03:40:14.486862+0000","last_fullsized":"2024-09-17T03:40:14.486862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:37.669890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468420+0000","last_change":"2024-09-17T03:40:14.468420+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468420+0000","last_undegraded":"2024-09-17T03:40:14.468420+0000","last_fullsized":"2024-09-17T03:40:14.468420+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552753+0000","last_change":"2024-09-17T03:40:14.480432+0000","last_active":"2024-09-17T03:40:16.552753+0000","last_peered":"2024-09-17T03:40:16.552753+0000","last_clean":"2024-09-17T03:40:16.552753+0000","last_became_active":"2024-09-17T03:40:14.480110+0000","last_became_peered":"2024-09-17T03:40:14.480110+0000","last_unstale":"2024-09-17T03:40:16.552753+0000","last_undegraded":"2024-09-17T03:40:16.552753+0000","last_fullsized":"2024-09-17T03:40:16.552753+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:32.719766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467405+0000","last_change":"2024-09-17T03:40:14.467405+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467405+0000","last_undegraded":"2024-09-17T03:40:14.467405+0000","last_fullsized":"2024-09-17T03:40:14.467405+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.481234+0000","last_change":"2024-09-17T03:40:14.478399+0000","last_active":"2024-09-17T03:40:14.481234+0000","last_peered":"2024-09-17T03:40:14.481234+0000","last_clean":"2024-09-17T03:40:14.481234+0000","last_became_active":"2024-09-17T03:40:14.477797+0000","last_became_peered":"2024-09-17T03:40:14.477797+0000","last_unstale":"2024-09-17T03:40:14.481234+0000","last_undegraded":"2024-09-17T03:40:14.481234+0000","last_fullsized":"2024-09-17T03:40:14.481234+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:25.268711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.469468+0000","last_change":"2024-09-17T03:40:14.469468+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.469468+0000","last_undegraded":"2024-09-17T03:40:14.469468+0000","last_fullsized":"2024-09-17T03:40:14.469468+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.482323+0000","last_change":"2024-09-17T03:40:14.481534+0000","last_active":"2024-09-17T03:40:14.482323+0000","last_peered":"2024-09-17T03:40:14.482323+0000","last_clean":"2024-09-17T03:40:14.482323+0000","last_became_active":"2024-09-17T03:40:14.481228+0000","last_became_peered":"2024-09-17T03:40:14.481228+0000","last_unstale":"2024-09-17T03:40:14.482323+0000","last_undegraded":"2024-09-17T03:40:14.482323+0000","last_fullsized":"2024-09-17T03:40:14.482323+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:22.429779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468494+0000","last_change":"2024-09-17T03:40:14.468494+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468494+0000","last_undegraded":"2024-09-17T03:40:14.468494+0000","last_fullsized":"2024-09-17T03:40:14.468494+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.479177+0000","last_change":"2024-09-17T03:40:14.478288+0000","last_active":"2024-09-17T03:40:14.479177+0000","last_peered":"2024-09-17T03:40:14.479177+0000","last_clean":"2024-09-17T03:40:14.479177+0000","last_became_active":"2024-09-17T03:40:14.478005+0000","last_became_peered":"2024-09-17T03:40:14.478005+0000","last_unstale":"2024-09-17T03:40:14.479177+0000","last_undegraded":"2024-09-17T03:40:14.479177+0000","last_fullsized":"2024-09-17T03:40:14.479177+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:41.137552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551999+0000","last_change":"2024-09-17T03:40:15.497363+0000","last_active":"2024-09-17T03:40:16.551999+0000","last_peered":"2024-09-17T03:40:16.551999+0000","last_clean":"2024-09-17T03:40:16.551999+0000","last_became_active":"2024-09-17T03:40:15.495974+0000","last_became_peered":"2024-09-17T03:40:15.495974+0000","last_unstale":"2024-09-17T03:40:16.551999+0000","last_undegraded":"2024-09-17T03:40:16.551999+0000","last_fullsized":"2024-09-17T03:40:16.551999+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:36.847762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.479983+0000","last_change":"2024-09-17T03:40:14.473315+0000","last_active":"2024-09-17T03:40:14.479983+0000","last_peered":"2024-09-17T03:40:14.479983+0000","last_clean":"2024-09-17T03:40:14.479983+0000","last_became_active":"2024-09-17T03:40:14.472752+0000","last_became_peered":"2024-09-17T03:40:14.472752+0000","last_unstale":"2024-09-17T03:40:14.479983+0000","last_undegraded":"2024-09-17T03:40:14.479983+0000","last_fullsized":"2024-09-17T03:40:14.479983+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:24.545328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.466594+0000","last_change":"2024-09-17T03:40:14.466594+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.466594+0000","last_undegraded":"2024-09-17T03:40:14.466594+0000","last_fullsized":"2024-09-17T03:40:14.466594+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551565+0000","last_change":"2024-09-17T03:40:14.485645+0000","last_active":"2024-09-17T03:40:16.551565+0000","last_peered":"2024-09-17T03:40:16.551565+0000","last_clean":"2024-09-17T03:40:16.551565+0000","last_became_active":"2024-09-17T03:40:14.483559+0000","last_became_peered":"2024-09-17T03:40:14.483559+0000","last_unstale":"2024-09-17T03:40:16.551565+0000","last_undegraded":"2024-09-17T03:40:16.551565+0000","last_fullsized":"2024-09-17T03:40:16.551565+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:28.380087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.469453+0000","last_change":"2024-09-17T03:40:14.469453+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.469453+0000","last_undegraded":"2024-09-17T03:40:14.469453+0000","last_fullsized":"2024-09-17T03:40:14.469453+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.475689+0000","last_change":"2024-09-17T03:40:14.473982+0000","last_active":"2024-09-17T03:40:14.475689+0000","last_peered":"2024-09-17T03:40:14.475689+0000","last_clean":"2024-09-17T03:40:14.475689+0000","last_became_active":"2024-09-17T03:40:14.473658+0000","last_became_peered":"2024-09-17T03:40:14.473658+0000","last_unstale":"2024-09-17T03:40:14.475689+0000","last_undegraded":"2024-09-17T03:40:14.475689+0000","last_fullsized":"2024-09-17T03:40:14.475689+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:26.977607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.469350+0000","last_change":"2024-09-17T03:40:14.469350+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.469350+0000","last_undegraded":"2024-09-17T03:40:14.469350+0000","last_fullsized":"2024-09-17T03:40:14.469350+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.479783+0000","last_change":"2024-09-17T03:40:14.472535+0000","last_active":"2024-09-17T03:40:14.479783+0000","last_peered":"2024-09-17T03:40:14.479783+0000","last_clean":"2024-09-17T03:40:14.479783+0000","last_became_active":"2024-09-17T03:40:14.472200+0000","last_became_peered":"2024-09-17T03:40:14.472200+0000","last_unstale":"2024-09-17T03:40:14.479783+0000","last_undegraded":"2024-09-17T03:40:14.479783+0000","last_fullsized":"2024-09-17T03:40:14.479783+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:48.023358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.466029+0000","last_change":"2024-09-17T03:40:14.466029+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.466029+0000","last_undegraded":"2024-09-17T03:40:14.466029+0000","last_fullsized":"2024-09-17T03:40:14.466029+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552423+0000","last_change":"2024-09-17T03:40:14.483507+0000","last_active":"2024-09-17T03:40:16.552423+0000","last_peered":"2024-09-17T03:40:16.552423+0000","last_clean":"2024-09-17T03:40:16.552423+0000","last_became_active":"2024-09-17T03:40:14.483198+0000","last_became_peered":"2024-09-17T03:40:14.483198+0000","last_unstale":"2024-09-17T03:40:16.552423+0000","last_undegraded":"2024-09-17T03:40:16.552423+0000","last_fullsized":"2024-09-17T03:40:16.552423+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:27.505809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.462999+0000","last_change":"2024-09-17T03:40:14.462999+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.462999+0000","last_undegraded":"2024-09-17T03:40:14.462999+0000","last_fullsized":"2024-09-17T03:40:14.462999+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552671+0000","last_change":"2024-09-17T03:40:14.475085+0000","last_active":"2024-09-17T03:40:16.552671+0000","last_peered":"2024-09-17T03:40:16.552671+0000","last_clean":"2024-09-17T03:40:16.552671+0000","last_became_active":"2024-09-17T03:40:14.474642+0000","last_became_peered":"2024-09-17T03:40:14.474642+0000","last_unstale":"2024-09-17T03:40:16.552671+0000","last_undegraded":"2024-09-17T03:40:16.552671+0000","last_fullsized":"2024-09-17T03:40:16.552671+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:07.438425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.463536+0000","last_change":"2024-09-17T03:40:14.463536+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.463536+0000","last_undegraded":"2024-09-17T03:40:14.463536+0000","last_fullsized":"2024-09-17T03:40:14.463536+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.481414+0000","last_change":"2024-09-17T03:40:14.480911+0000","last_active":"2024-09-17T03:40:14.481414+0000","last_peered":"2024-09-17T03:40:14.481414+0000","last_clean":"2024-09-17T03:40:14.481414+0000","last_became_active":"2024-09-17T03:40:14.480499+0000","last_became_peered":"2024-09-17T03:40:14.480499+0000","last_unstale":"2024-09-17T03:40:14.481414+0000","last_undegraded":"2024-09-17T03:40:14.481414+0000","last_fullsized":"2024-09-17T03:40:14.481414+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:58.351626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.467991+0000","last_change":"2024-09-17T03:40:14.467991+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.467991+0000","last_undegraded":"2024-09-17T03:40:14.467991+0000","last_fullsized":"2024-09-17T03:40:14.467991+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.475489+0000","last_change":"2024-09-17T03:40:14.472140+0000","last_active":"2024-09-17T03:40:14.475489+0000","last_peered":"2024-09-17T03:40:14.475489+0000","last_clean":"2024-09-17T03:40:14.475489+0000","last_became_active":"2024-09-17T03:40:14.471857+0000","last_became_peered":"2024-09-17T03:40:14.471857+0000","last_unstale":"2024-09-17T03:40:14.475489+0000","last_undegraded":"2024-09-17T03:40:14.475489+0000","last_fullsized":"2024-09-17T03:40:14.475489+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:30.623360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":115,"state":"creating+peering","last_fresh":"2024-09-17T03:40:14.468941+0000","last_change":"2024-09-17T03:40:14.468941+0000","last_active":"2024-09-17T03:40:14.453556+0000","last_peered":"2024-09-17T03:40:14.453556+0000","last_clean":"2024-09-17T03:40:14.453556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:40:14.468941+0000","last_undegraded":"2024-09-17T03:40:14.468941+0000","last_fullsized":"2024-09-17T03:40:14.468941+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.479952+0000","last_change":"2024-09-17T03:40:14.473025+0000","last_active":"2024-09-17T03:40:14.479952+0000","last_peered":"2024-09-17T03:40:14.479952+0000","last_clean":"2024-09-17T03:40:14.479952+0000","last_became_active":"2024-09-17T03:40:14.472373+0000","last_became_peered":"2024-09-17T03:40:14.472373+0000","last_unstale":"2024-09-17T03:40:14.479952+0000","last_undegraded":"2024-09-17T03:40:14.479952+0000","last_fullsized":"2024-09-17T03:40:14.479952+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:09.188966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551907+0000","last_change":"2024-09-17T03:40:15.483370+0000","last_active":"2024-09-17T03:40:16.551907+0000","last_peered":"2024-09-17T03:40:16.551907+0000","last_clean":"2024-09-17T03:40:16.551907+0000","last_became_active":"2024-09-17T03:40:15.483063+0000","last_became_peered":"2024-09-17T03:40:15.483063+0000","last_unstale":"2024-09-17T03:40:16.551907+0000","last_undegraded":"2024-09-17T03:40:16.551907+0000","last_fullsized":"2024-09-17T03:40:16.551907+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:53.510707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552003+0000","last_change":"2024-09-17T03:40:14.482698+0000","last_active":"2024-09-17T03:40:16.552003+0000","last_peered":"2024-09-17T03:40:16.552003+0000","last_clean":"2024-09-17T03:40:16.552003+0000","last_became_active":"2024-09-17T03:40:14.482376+0000","last_became_peered":"2024-09-17T03:40:14.482376+0000","last_unstale":"2024-09-17T03:40:16.552003+0000","last_undegraded":"2024-09-17T03:40:16.552003+0000","last_fullsized":"2024-09-17T03:40:16.552003+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:16.596119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":283,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T03:40:14.472050+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:40:14.472050+0000","last_peered":"2024-09-17T03:40:14.472050+0000","last_clean":"2024-09-17T03:40:14.472050+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:40:14.472050+0000","last_undegraded":"2024-09-17T03:40:14.472050+0000","last_fullsized":"2024-09-17T03:40:14.472050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509533,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41476,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330364,"statfs":{"total":96636764160,"available":96594292736,"internally_reserved":0,"allocated":2002944,"data_stored":1202924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40434123},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46464,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325376,"statfs":{"total":96636764160,"available":96589185024,"internally_reserved":0,"allocated":1421312,"data_stored":618831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50624,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321216,"statfs":{"total":96636764160,"available":96584925184,"internally_reserved":0,"allocated":1409024,"data_stored":612556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46452,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325388,"statfs":{"total":96636764160,"available":96589197312,"internally_reserved":0,"allocated":1409024,"data_stored":612556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50612,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321228,"statfs":{"total":96636764160,"available":96584937472,"internally_reserved":0,"allocated":1409024,"data_stored":612556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509534,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45624,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326216,"statfs":{"total":96636764160,"available":96590045184,"internally_reserved":0,"allocated":2002944,"data_stored":1202924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574941,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28452,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343388,"statfs":{"total":96636764160,"available":96607629312,"internally_reserved":0,"allocated":1454080,"data_stored":632510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574941,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46508,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325332,"statfs":{"total":96636764160,"available":96589139968,"internally_reserved":0,"allocated":1462272,"data_stored":633588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:19.851 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.002+0000 7f6c5144d640 1 -- 172.21.15.146:0/1552443872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c34004210 msgr2=0x7f6c34004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.002+0000 7f6c5144d640 1 --2- 172.21.15.146:0/1552443872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c34004210 0x7f6c34004800 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f6c40006fd0 tx=0x7f6c34005830 comp rx=0 tx=0).stop 2024-09-17T03:40:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.002+0000 7f6c4b7fe640 1 -- 172.21.15.146:0/1552443872 reap_dead start 2024-09-17T03:40:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.002+0000 7f6c5144d640 1 -- 172.21.15.146:0/1552443872 shutdown_connections 2024-09-17T03:40:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.002+0000 7f6c5144d640 1 -- 172.21.15.146:0/1552443872 >> 172.21.15.146:0/1552443872 conn(0x7f6c4c0b3410 msgr2=0x7f6c4c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.002+0000 7f6c5144d640 1 -- 172.21.15.146:0/1552443872 shutdown_connections 2024-09-17T03:40:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.002+0000 7f6c5144d640 1 -- 172.21.15.146:0/1552443872 wait complete. 2024-09-17T03:40:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.004+0000 7f6c5144d640 1 Processor -- start 2024-09-17T03:40:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.004+0000 7f6c5144d640 1 -- start start 2024-09-17T03:40:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.005+0000 7f6c5144d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c34004210 0x7f6c4c1461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.005+0000 7f6c5144d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c4c146f20 0x7f6c4c156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.005+0000 7f6c5144d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c4c1568c0 0x7f6c4c14e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.005+0000 7f6c5144d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c0d0040 con 0x7f6c4c146f20 2024-09-17T03:40:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.005+0000 7f6c5144d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c0ce290 con 0x7f6c34004210 2024-09-17T03:40:20.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.005+0000 7f6c5144d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4c0d01c0 con 0x7f6c4c1568c0 2024-09-17T03:40:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.005+0000 7f6c4a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c4c146f20 0x7f6c4c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.005+0000 7f6c4a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c4c146f20 0x7f6c4c156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53470/0 (socket says 172.21.15.146:53470) 2024-09-17T03:40:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.005+0000 7f6c4a7fc640 1 -- 172.21.15.146:0/1103356517 learned_addr learned my addr 172.21.15.146:0/1103356517 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c4affd640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c34004210 0x7f6c4c1461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c4b7fe640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c4c1568c0 0x7f6c4c14e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c4a7fc640 1 -- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c4c1568c0 msgr2=0x7f6c4c14e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c4a7fc640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c4c1568c0 0x7f6c4c14e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c4a7fc640 1 -- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c34004210 msgr2=0x7f6c4c1461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c4a7fc640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c34004210 0x7f6c4c1461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c4a7fc640 1 -- 172.21.15.146:0/1103356517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c156cd0 con 0x7f6c4c146f20 2024-09-17T03:40:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c4b7fe640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c4c1568c0 0x7f6c4c14e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c4a7fc640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c4c146f20 0x7f6c4c156380 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f6c40000f60 tx=0x7f6c40006440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c337fe640 1 -- 172.21.15.146:0/1103356517 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40031040 con 0x7f6c4c146f20 2024-09-17T03:40:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c337fe640 1 -- 172.21.15.146:0/1103356517 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c40003820 con 0x7f6c4c146f20 2024-09-17T03:40:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c5144d640 1 -- 172.21.15.146:0/1103356517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4c14f510 con 0x7f6c4c146f20 2024-09-17T03:40:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c337fe640 1 -- 172.21.15.146:0/1103356517 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40003c10 con 0x7f6c4c146f20 2024-09-17T03:40:20.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.006+0000 7f6c5144d640 1 -- 172.21.15.146:0/1103356517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4c154ab0 con 0x7f6c4c146f20 2024-09-17T03:40:20.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.007+0000 7f6c5144d640 1 -- 172.21.15.146:0/1103356517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c4c0d0750 con 0x7f6c4c146f20 2024-09-17T03:40:20.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.008+0000 7f6c337fe640 1 -- 172.21.15.146:0/1103356517 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c40034070 con 0x7f6c4c146f20 2024-09-17T03:40:20.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.008+0000 7f6c337fe640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c38078bc0 0x7f6c3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.008+0000 7f6c337fe640 1 -- 172.21.15.146:0/1103356517 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f6c400bb150 con 0x7f6c4c146f20 2024-09-17T03:40:20.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.009+0000 7f6c4affd640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c38078bc0 0x7f6c3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.009+0000 7f6c4affd640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c38078bc0 0x7f6c3807b0d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c006420 tx=0x7f6c3c006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:20.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.013+0000 7f6c337fe640 1 -- 172.21.15.146:0/1103356517 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6c4c156cd0 con 0x7f6c4c146f20 2024-09-17T03:40:20.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.187+0000 7f6c5144d640 1 -- 172.21.15.146:0/1103356517 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c4c0d0de0 con 0x7f6c38078bc0 2024-09-17T03:40:20.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.192+0000 7f6c337fe640 1 -- 172.21.15.146:0/1103356517 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252471 (secure 0 0 0) 0x7f6c4c0d0de0 con 0x7f6c38078bc0 2024-09-17T03:40:20.195 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:20.196 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:40:20.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 -- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c38078bc0 msgr2=0x7f6c3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c38078bc0 0x7f6c3807b0d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c006420 tx=0x7f6c3c006b10 comp rx=0 tx=0).stop 2024-09-17T03:40:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 -- 172.21.15.146:0/1103356517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c4c146f20 msgr2=0x7f6c4c156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c4c146f20 0x7f6c4c156380 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f6c40000f60 tx=0x7f6c40006440 comp rx=0 tx=0).stop 2024-09-17T03:40:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 -- 172.21.15.146:0/1103356517 shutdown_connections 2024-09-17T03:40:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c38078bc0 0x7f6c3807b0d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c4c1568c0 0x7f6c4c14e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c4c146f20 0x7f6c4c156380 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 --2- 172.21.15.146:0/1103356517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c34004210 0x7f6c4c1461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 -- 172.21.15.146:0/1103356517 >> 172.21.15.146:0/1103356517 conn(0x7f6c4c0b3410 msgr2=0x7f6c4c151e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 -- 172.21.15.146:0/1103356517 shutdown_connections 2024-09-17T03:40:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.196+0000 7f6c5144d640 1 -- 172.21.15.146:0/1103356517 wait complete. 2024-09-17T03:40:20.207 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-17T03:40:19.907727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":356456,"kb_used_data":12520,"kb_used_omap":12,"kb_used_meta":343731,"kb_avail":754618264,"statfs":{"total":773094113280,"available":772729102336,"internally_reserved":0,"allocated":12820480,"data_stored":6240804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":351981105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001678"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552785+0000","last_change":"2024-09-17T03:40:15.497016+0000","last_active":"2024-09-17T03:40:16.552785+0000","last_peered":"2024-09-17T03:40:16.552785+0000","last_clean":"2024-09-17T03:40:16.552785+0000","last_became_active":"2024-09-17T03:40:15.496378+0000","last_became_peered":"2024-09-17T03:40:15.496378+0000","last_unstale":"2024-09-17T03:40:16.552785+0000","last_undegraded":"2024-09-17T03:40:16.552785+0000","last_fullsized":"2024-09-17T03:40:16.552785+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:37.698708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476763+0000","last_change":"2024-09-17T03:40:15.471970+0000","last_active":"2024-09-17T03:40:16.476763+0000","last_peered":"2024-09-17T03:40:16.476763+0000","last_clean":"2024-09-17T03:40:16.476763+0000","last_became_active":"2024-09-17T03:40:15.471657+0000","last_became_peered":"2024-09-17T03:40:15.471657+0000","last_unstale":"2024-09-17T03:40:16.476763+0000","last_undegraded":"2024-09-17T03:40:16.476763+0000","last_fullsized":"2024-09-17T03:40:16.476763+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:43.359671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552234+0000","last_change":"2024-09-17T03:40:15.482150+0000","last_active":"2024-09-17T03:40:16.552234+0000","last_peered":"2024-09-17T03:40:16.552234+0000","last_clean":"2024-09-17T03:40:16.552234+0000","last_became_active":"2024-09-17T03:40:15.481828+0000","last_became_peered":"2024-09-17T03:40:15.481828+0000","last_unstale":"2024-09-17T03:40:16.552234+0000","last_undegraded":"2024-09-17T03:40:16.552234+0000","last_fullsized":"2024-09-17T03:40:16.552234+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:56.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552918+0000","last_change":"2024-09-17T03:40:15.495282+0000","last_active":"2024-09-17T03:40:16.552918+0000","last_peered":"2024-09-17T03:40:16.552918+0000","last_clean":"2024-09-17T03:40:16.552918+0000","last_became_active":"2024-09-17T03:40:15.494916+0000","last_became_peered":"2024-09-17T03:40:15.494916+0000","last_unstale":"2024-09-17T03:40:16.552918+0000","last_undegraded":"2024-09-17T03:40:16.552918+0000","last_fullsized":"2024-09-17T03:40:16.552918+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:17.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552250+0000","last_change":"2024-09-17T03:40:15.475218+0000","last_active":"2024-09-17T03:40:16.552250+0000","last_peered":"2024-09-17T03:40:16.552250+0000","last_clean":"2024-09-17T03:40:16.552250+0000","last_became_active":"2024-09-17T03:40:15.474586+0000","last_became_peered":"2024-09-17T03:40:15.474586+0000","last_unstale":"2024-09-17T03:40:16.552250+0000","last_undegraded":"2024-09-17T03:40:16.552250+0000","last_fullsized":"2024-09-17T03:40:16.552250+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:34.290950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475605+0000","last_change":"2024-09-17T03:40:15.476554+0000","last_active":"2024-09-17T03:40:16.475605+0000","last_peered":"2024-09-17T03:40:16.475605+0000","last_clean":"2024-09-17T03:40:16.475605+0000","last_became_active":"2024-09-17T03:40:15.476209+0000","last_became_peered":"2024-09-17T03:40:15.476209+0000","last_unstale":"2024-09-17T03:40:16.475605+0000","last_undegraded":"2024-09-17T03:40:16.475605+0000","last_fullsized":"2024-09-17T03:40:16.475605+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:40.711541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551912+0000","last_change":"2024-09-17T03:40:15.479882+0000","last_active":"2024-09-17T03:40:16.551912+0000","last_peered":"2024-09-17T03:40:16.551912+0000","last_clean":"2024-09-17T03:40:16.551912+0000","last_became_active":"2024-09-17T03:40:15.479041+0000","last_became_peered":"2024-09-17T03:40:15.479041+0000","last_unstale":"2024-09-17T03:40:16.551912+0000","last_undegraded":"2024-09-17T03:40:16.551912+0000","last_fullsized":"2024-09-17T03:40:16.551912+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:31.468455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551777+0000","last_change":"2024-09-17T03:40:15.483743+0000","last_active":"2024-09-17T03:40:16.551777+0000","last_peered":"2024-09-17T03:40:16.551777+0000","last_clean":"2024-09-17T03:40:16.551777+0000","last_became_active":"2024-09-17T03:40:15.482551+0000","last_became_peered":"2024-09-17T03:40:15.482551+0000","last_unstale":"2024-09-17T03:40:16.551777+0000","last_undegraded":"2024-09-17T03:40:16.551777+0000","last_fullsized":"2024-09-17T03:40:16.551777+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:11.954766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552922+0000","last_change":"2024-09-17T03:40:15.496204+0000","last_active":"2024-09-17T03:40:16.552922+0000","last_peered":"2024-09-17T03:40:16.552922+0000","last_clean":"2024-09-17T03:40:16.552922+0000","last_became_active":"2024-09-17T03:40:15.495775+0000","last_became_peered":"2024-09-17T03:40:15.495775+0000","last_unstale":"2024-09-17T03:40:16.552922+0000","last_undegraded":"2024-09-17T03:40:16.552922+0000","last_fullsized":"2024-09-17T03:40:16.552922+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:02.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553100+0000","last_change":"2024-09-17T03:40:15.496321+0000","last_active":"2024-09-17T03:40:16.553100+0000","last_peered":"2024-09-17T03:40:16.553100+0000","last_clean":"2024-09-17T03:40:16.553100+0000","last_became_active":"2024-09-17T03:40:15.495406+0000","last_became_peered":"2024-09-17T03:40:15.495406+0000","last_unstale":"2024-09-17T03:40:16.553100+0000","last_undegraded":"2024-09-17T03:40:16.553100+0000","last_fullsized":"2024-09-17T03:40:16.553100+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:46.298994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476823+0000","last_change":"2024-09-17T03:40:15.470662+0000","last_active":"2024-09-17T03:40:16.476823+0000","last_peered":"2024-09-17T03:40:16.476823+0000","last_clean":"2024-09-17T03:40:16.476823+0000","last_became_active":"2024-09-17T03:40:15.470333+0000","last_became_peered":"2024-09-17T03:40:15.470333+0000","last_unstale":"2024-09-17T03:40:16.476823+0000","last_undegraded":"2024-09-17T03:40:16.476823+0000","last_fullsized":"2024-09-17T03:40:16.476823+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:59.432670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553004+0000","last_change":"2024-09-17T03:40:15.497895+0000","last_active":"2024-09-17T03:40:16.553004+0000","last_peered":"2024-09-17T03:40:16.553004+0000","last_clean":"2024-09-17T03:40:16.553004+0000","last_became_active":"2024-09-17T03:40:15.495567+0000","last_became_peered":"2024-09-17T03:40:15.495567+0000","last_unstale":"2024-09-17T03:40:16.553004+0000","last_undegraded":"2024-09-17T03:40:16.553004+0000","last_fullsized":"2024-09-17T03:40:16.553004+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:01.849474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552762+0000","last_change":"2024-09-17T03:40:15.482010+0000","last_active":"2024-09-17T03:40:16.552762+0000","last_peered":"2024-09-17T03:40:16.552762+0000","last_clean":"2024-09-17T03:40:16.552762+0000","last_became_active":"2024-09-17T03:40:15.481624+0000","last_became_peered":"2024-09-17T03:40:15.481624+0000","last_unstale":"2024-09-17T03:40:16.552762+0000","last_undegraded":"2024-09-17T03:40:16.552762+0000","last_fullsized":"2024-09-17T03:40:16.552762+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:29.432451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551828+0000","last_change":"2024-09-17T03:40:15.481964+0000","last_active":"2024-09-17T03:40:16.551828+0000","last_peered":"2024-09-17T03:40:16.551828+0000","last_clean":"2024-09-17T03:40:16.551828+0000","last_became_active":"2024-09-17T03:40:15.481637+0000","last_became_peered":"2024-09-17T03:40:15.481637+0000","last_unstale":"2024-09-17T03:40:16.551828+0000","last_undegraded":"2024-09-17T03:40:16.551828+0000","last_fullsized":"2024-09-17T03:40:16.551828+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:03.349218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475614+0000","last_change":"2024-09-17T03:40:15.476228+0000","last_active":"2024-09-17T03:40:16.475614+0000","last_peered":"2024-09-17T03:40:16.475614+0000","last_clean":"2024-09-17T03:40:16.475614+0000","last_became_active":"2024-09-17T03:40:15.475923+0000","last_became_peered":"2024-09-17T03:40:15.475923+0000","last_unstale":"2024-09-17T03:40:16.475614+0000","last_undegraded":"2024-09-17T03:40:16.475614+0000","last_fullsized":"2024-09-17T03:40:16.475614+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:37.778905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552446+0000","last_change":"2024-09-17T03:40:15.487172+0000","last_active":"2024-09-17T03:40:16.552446+0000","last_peered":"2024-09-17T03:40:16.552446+0000","last_clean":"2024-09-17T03:40:16.552446+0000","last_became_active":"2024-09-17T03:40:15.486843+0000","last_became_peered":"2024-09-17T03:40:15.486843+0000","last_unstale":"2024-09-17T03:40:16.552446+0000","last_undegraded":"2024-09-17T03:40:16.552446+0000","last_fullsized":"2024-09-17T03:40:16.552446+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:35.230466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477078+0000","last_change":"2024-09-17T03:40:15.471388+0000","last_active":"2024-09-17T03:40:16.477078+0000","last_peered":"2024-09-17T03:40:16.477078+0000","last_clean":"2024-09-17T03:40:16.477078+0000","last_became_active":"2024-09-17T03:40:15.470136+0000","last_became_peered":"2024-09-17T03:40:15.470136+0000","last_unstale":"2024-09-17T03:40:16.477078+0000","last_undegraded":"2024-09-17T03:40:16.477078+0000","last_fullsized":"2024-09-17T03:40:16.477078+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:32.381586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476433+0000","last_change":"2024-09-17T03:40:15.474023+0000","last_active":"2024-09-17T03:40:16.476433+0000","last_peered":"2024-09-17T03:40:16.476433+0000","last_clean":"2024-09-17T03:40:16.476433+0000","last_became_active":"2024-09-17T03:40:15.473072+0000","last_became_peered":"2024-09-17T03:40:15.473072+0000","last_unstale":"2024-09-17T03:40:16.476433+0000","last_undegraded":"2024-09-17T03:40:16.476433+0000","last_fullsized":"2024-09-17T03:40:16.476433+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:13.319000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552518+0000","last_change":"2024-09-17T03:40:15.484636+0000","last_active":"2024-09-17T03:40:16.552518+0000","last_peered":"2024-09-17T03:40:16.552518+0000","last_clean":"2024-09-17T03:40:16.552518+0000","last_became_active":"2024-09-17T03:40:15.482975+0000","last_became_peered":"2024-09-17T03:40:15.482975+0000","last_unstale":"2024-09-17T03:40:16.552518+0000","last_undegraded":"2024-09-17T03:40:16.552518+0000","last_fullsized":"2024-09-17T03:40:16.552518+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:04.977186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477160+0000","last_change":"2024-09-17T03:40:15.482147+0000","last_active":"2024-09-17T03:40:16.477160+0000","last_peered":"2024-09-17T03:40:16.477160+0000","last_clean":"2024-09-17T03:40:16.477160+0000","last_became_active":"2024-09-17T03:40:15.481833+0000","last_became_peered":"2024-09-17T03:40:15.481833+0000","last_unstale":"2024-09-17T03:40:16.477160+0000","last_undegraded":"2024-09-17T03:40:16.477160+0000","last_fullsized":"2024-09-17T03:40:16.477160+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:49.596916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477556+0000","last_change":"2024-09-17T03:40:15.468981+0000","last_active":"2024-09-17T03:40:16.477556+0000","last_peered":"2024-09-17T03:40:16.477556+0000","last_clean":"2024-09-17T03:40:16.477556+0000","last_became_active":"2024-09-17T03:40:15.467938+0000","last_became_peered":"2024-09-17T03:40:15.467938+0000","last_unstale":"2024-09-17T03:40:16.477556+0000","last_undegraded":"2024-09-17T03:40:16.477556+0000","last_fullsized":"2024-09-17T03:40:16.477556+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:07.644872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551935+0000","last_change":"2024-09-17T03:40:15.470210+0000","last_active":"2024-09-17T03:40:16.551935+0000","last_peered":"2024-09-17T03:40:16.551935+0000","last_clean":"2024-09-17T03:40:16.551935+0000","last_became_active":"2024-09-17T03:40:15.469093+0000","last_became_peered":"2024-09-17T03:40:15.469093+0000","last_unstale":"2024-09-17T03:40:16.551935+0000","last_undegraded":"2024-09-17T03:40:16.551935+0000","last_fullsized":"2024-09-17T03:40:16.551935+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:35.551590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476232+0000","last_change":"2024-09-17T03:40:15.481291+0000","last_active":"2024-09-17T03:40:16.476232+0000","last_peered":"2024-09-17T03:40:16.476232+0000","last_clean":"2024-09-17T03:40:16.476232+0000","last_became_active":"2024-09-17T03:40:15.480790+0000","last_became_peered":"2024-09-17T03:40:15.480790+0000","last_unstale":"2024-09-17T03:40:16.476232+0000","last_undegraded":"2024-09-17T03:40:16.476232+0000","last_fullsized":"2024-09-17T03:40:16.476232+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:23.236029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551653+0000","last_change":"2024-09-17T03:40:15.484372+0000","last_active":"2024-09-17T03:40:16.551653+0000","last_peered":"2024-09-17T03:40:16.551653+0000","last_clean":"2024-09-17T03:40:16.551653+0000","last_became_active":"2024-09-17T03:40:15.484026+0000","last_became_peered":"2024-09-17T03:40:15.484026+0000","last_unstale":"2024-09-17T03:40:16.551653+0000","last_undegraded":"2024-09-17T03:40:16.551653+0000","last_fullsized":"2024-09-17T03:40:16.551653+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:31.193826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477240+0000","last_change":"2024-09-17T03:40:15.469694+0000","last_active":"2024-09-17T03:40:16.477240+0000","last_peered":"2024-09-17T03:40:16.477240+0000","last_clean":"2024-09-17T03:40:16.477240+0000","last_became_active":"2024-09-17T03:40:15.469377+0000","last_became_peered":"2024-09-17T03:40:15.469377+0000","last_unstale":"2024-09-17T03:40:16.477240+0000","last_undegraded":"2024-09-17T03:40:16.477240+0000","last_fullsized":"2024-09-17T03:40:16.477240+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:17.217971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553115+0000","last_change":"2024-09-17T03:40:15.494804+0000","last_active":"2024-09-17T03:40:16.553115+0000","last_peered":"2024-09-17T03:40:16.553115+0000","last_clean":"2024-09-17T03:40:16.553115+0000","last_became_active":"2024-09-17T03:40:15.494455+0000","last_became_peered":"2024-09-17T03:40:15.494455+0000","last_unstale":"2024-09-17T03:40:16.553115+0000","last_undegraded":"2024-09-17T03:40:16.553115+0000","last_fullsized":"2024-09-17T03:40:16.553115+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:49.736642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476020+0000","last_change":"2024-09-17T03:40:15.497449+0000","last_active":"2024-09-17T03:40:16.476020+0000","last_peered":"2024-09-17T03:40:16.476020+0000","last_clean":"2024-09-17T03:40:16.476020+0000","last_became_active":"2024-09-17T03:40:15.496364+0000","last_became_peered":"2024-09-17T03:40:15.496364+0000","last_unstale":"2024-09-17T03:40:16.476020+0000","last_undegraded":"2024-09-17T03:40:16.476020+0000","last_fullsized":"2024-09-17T03:40:16.476020+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:59.627991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552236+0000","last_change":"2024-09-17T03:40:15.494642+0000","last_active":"2024-09-17T03:40:16.552236+0000","last_peered":"2024-09-17T03:40:16.552236+0000","last_clean":"2024-09-17T03:40:16.552236+0000","last_became_active":"2024-09-17T03:40:15.494266+0000","last_became_peered":"2024-09-17T03:40:15.494266+0000","last_unstale":"2024-09-17T03:40:16.552236+0000","last_undegraded":"2024-09-17T03:40:16.552236+0000","last_fullsized":"2024-09-17T03:40:16.552236+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:13.272105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476604+0000","last_change":"2024-09-17T03:40:15.479298+0000","last_active":"2024-09-17T03:40:16.476604+0000","last_peered":"2024-09-17T03:40:16.476604+0000","last_clean":"2024-09-17T03:40:16.476604+0000","last_became_active":"2024-09-17T03:40:15.478964+0000","last_became_peered":"2024-09-17T03:40:15.478964+0000","last_unstale":"2024-09-17T03:40:16.476604+0000","last_undegraded":"2024-09-17T03:40:16.476604+0000","last_fullsized":"2024-09-17T03:40:16.476604+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:25.727689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552939+0000","last_change":"2024-09-17T03:40:15.489604+0000","last_active":"2024-09-17T03:40:16.552939+0000","last_peered":"2024-09-17T03:40:16.552939+0000","last_clean":"2024-09-17T03:40:16.552939+0000","last_became_active":"2024-09-17T03:40:15.489302+0000","last_became_peered":"2024-09-17T03:40:15.489302+0000","last_unstale":"2024-09-17T03:40:16.552939+0000","last_undegraded":"2024-09-17T03:40:16.552939+0000","last_fullsized":"2024-09-17T03:40:16.552939+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:51.069041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551769+0000","last_change":"2024-09-17T03:40:15.485199+0000","last_active":"2024-09-17T03:40:16.551769+0000","last_peered":"2024-09-17T03:40:16.551769+0000","last_clean":"2024-09-17T03:40:16.551769+0000","last_became_active":"2024-09-17T03:40:15.484863+0000","last_became_peered":"2024-09-17T03:40:15.484863+0000","last_unstale":"2024-09-17T03:40:16.551769+0000","last_undegraded":"2024-09-17T03:40:16.551769+0000","last_fullsized":"2024-09-17T03:40:16.551769+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:55.504035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475628+0000","last_change":"2024-09-17T03:40:15.478863+0000","last_active":"2024-09-17T03:40:16.475628+0000","last_peered":"2024-09-17T03:40:16.475628+0000","last_clean":"2024-09-17T03:40:16.475628+0000","last_became_active":"2024-09-17T03:40:15.478565+0000","last_became_peered":"2024-09-17T03:40:15.478565+0000","last_unstale":"2024-09-17T03:40:16.475628+0000","last_undegraded":"2024-09-17T03:40:16.475628+0000","last_fullsized":"2024-09-17T03:40:16.475628+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:20.800752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475958+0000","last_change":"2024-09-17T03:40:15.475782+0000","last_active":"2024-09-17T03:40:16.475958+0000","last_peered":"2024-09-17T03:40:16.475958+0000","last_clean":"2024-09-17T03:40:16.475958+0000","last_became_active":"2024-09-17T03:40:15.475291+0000","last_became_peered":"2024-09-17T03:40:15.475291+0000","last_unstale":"2024-09-17T03:40:16.475958+0000","last_undegraded":"2024-09-17T03:40:16.475958+0000","last_fullsized":"2024-09-17T03:40:16.475958+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:32.617963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"116'4","reported_seq":19,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552862+0000","last_change":"2024-09-17T03:40:14.474590+0000","last_active":"2024-09-17T03:40:16.552862+0000","last_peered":"2024-09-17T03:40:16.552862+0000","last_clean":"2024-09-17T03:40:16.552862+0000","last_became_active":"2024-09-17T03:40:14.474251+0000","last_became_peered":"2024-09-17T03:40:14.474251+0000","last_unstale":"2024-09-17T03:40:16.552862+0000","last_undegraded":"2024-09-17T03:40:16.552862+0000","last_fullsized":"2024-09-17T03:40:16.552862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:24.482162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478410+0000","last_change":"2024-09-17T03:40:15.478596+0000","last_active":"2024-09-17T03:40:16.478410+0000","last_peered":"2024-09-17T03:40:16.478410+0000","last_clean":"2024-09-17T03:40:16.478410+0000","last_became_active":"2024-09-17T03:40:15.478141+0000","last_became_peered":"2024-09-17T03:40:15.478141+0000","last_unstale":"2024-09-17T03:40:16.478410+0000","last_undegraded":"2024-09-17T03:40:16.478410+0000","last_fullsized":"2024-09-17T03:40:16.478410+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:17.884900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551866+0000","last_change":"2024-09-17T03:40:14.475924+0000","last_active":"2024-09-17T03:40:16.551866+0000","last_peered":"2024-09-17T03:40:16.551866+0000","last_clean":"2024-09-17T03:40:16.551866+0000","last_became_active":"2024-09-17T03:40:14.475532+0000","last_became_peered":"2024-09-17T03:40:14.475532+0000","last_unstale":"2024-09-17T03:40:16.551866+0000","last_undegraded":"2024-09-17T03:40:16.551866+0000","last_fullsized":"2024-09-17T03:40:16.551866+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:09.188966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476017+0000","last_change":"2024-09-17T03:40:15.477759+0000","last_active":"2024-09-17T03:40:16.476017+0000","last_peered":"2024-09-17T03:40:16.476017+0000","last_clean":"2024-09-17T03:40:16.476017+0000","last_became_active":"2024-09-17T03:40:15.477354+0000","last_became_peered":"2024-09-17T03:40:15.477354+0000","last_unstale":"2024-09-17T03:40:16.476017+0000","last_undegraded":"2024-09-17T03:40:16.476017+0000","last_fullsized":"2024-09-17T03:40:16.476017+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:57.668885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551608+0000","last_change":"2024-09-17T03:40:14.470654+0000","last_active":"2024-09-17T03:40:16.551608+0000","last_peered":"2024-09-17T03:40:16.551608+0000","last_clean":"2024-09-17T03:40:16.551608+0000","last_became_active":"2024-09-17T03:40:14.470305+0000","last_became_peered":"2024-09-17T03:40:14.470305+0000","last_unstale":"2024-09-17T03:40:16.551608+0000","last_undegraded":"2024-09-17T03:40:16.551608+0000","last_fullsized":"2024-09-17T03:40:16.551608+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:30.603247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552555+0000","last_change":"2024-09-17T03:40:15.483578+0000","last_active":"2024-09-17T03:40:16.552555+0000","last_peered":"2024-09-17T03:40:16.552555+0000","last_clean":"2024-09-17T03:40:16.552555+0000","last_became_active":"2024-09-17T03:40:15.482562+0000","last_became_peered":"2024-09-17T03:40:15.482562+0000","last_unstale":"2024-09-17T03:40:16.552555+0000","last_undegraded":"2024-09-17T03:40:16.552555+0000","last_fullsized":"2024-09-17T03:40:16.552555+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:32.079090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552207+0000","last_change":"2024-09-17T03:40:14.480944+0000","last_active":"2024-09-17T03:40:16.552207+0000","last_peered":"2024-09-17T03:40:16.552207+0000","last_clean":"2024-09-17T03:40:16.552207+0000","last_became_active":"2024-09-17T03:40:14.480631+0000","last_became_peered":"2024-09-17T03:40:14.480631+0000","last_unstale":"2024-09-17T03:40:16.552207+0000","last_undegraded":"2024-09-17T03:40:16.552207+0000","last_fullsized":"2024-09-17T03:40:16.552207+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:17.744845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552252+0000","last_change":"2024-09-17T03:40:15.486260+0000","last_active":"2024-09-17T03:40:16.552252+0000","last_peered":"2024-09-17T03:40:16.552252+0000","last_clean":"2024-09-17T03:40:16.552252+0000","last_became_active":"2024-09-17T03:40:15.485935+0000","last_became_peered":"2024-09-17T03:40:15.485935+0000","last_unstale":"2024-09-17T03:40:16.552252+0000","last_undegraded":"2024-09-17T03:40:16.552252+0000","last_fullsized":"2024-09-17T03:40:16.552252+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:08.384805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552511+0000","last_change":"2024-09-17T03:40:14.481995+0000","last_active":"2024-09-17T03:40:16.552511+0000","last_peered":"2024-09-17T03:40:16.552511+0000","last_clean":"2024-09-17T03:40:16.552511+0000","last_became_active":"2024-09-17T03:40:14.481664+0000","last_became_peered":"2024-09-17T03:40:14.481664+0000","last_unstale":"2024-09-17T03:40:16.552511+0000","last_undegraded":"2024-09-17T03:40:16.552511+0000","last_fullsized":"2024-09-17T03:40:16.552511+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:21.880772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476966+0000","last_change":"2024-09-17T03:40:15.478649+0000","last_active":"2024-09-17T03:40:16.476966+0000","last_peered":"2024-09-17T03:40:16.476966+0000","last_clean":"2024-09-17T03:40:16.476966+0000","last_became_active":"2024-09-17T03:40:15.478320+0000","last_became_peered":"2024-09-17T03:40:15.478320+0000","last_unstale":"2024-09-17T03:40:16.476966+0000","last_undegraded":"2024-09-17T03:40:16.476966+0000","last_fullsized":"2024-09-17T03:40:16.476966+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:23.907814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552304+0000","last_change":"2024-09-17T03:40:14.480486+0000","last_active":"2024-09-17T03:40:16.552304+0000","last_peered":"2024-09-17T03:40:16.552304+0000","last_clean":"2024-09-17T03:40:16.552304+0000","last_became_active":"2024-09-17T03:40:14.480219+0000","last_became_peered":"2024-09-17T03:40:14.480219+0000","last_unstale":"2024-09-17T03:40:16.552304+0000","last_undegraded":"2024-09-17T03:40:16.552304+0000","last_fullsized":"2024-09-17T03:40:16.552304+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:55.122669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552499+0000","last_change":"2024-09-17T03:40:15.492764+0000","last_active":"2024-09-17T03:40:16.552499+0000","last_peered":"2024-09-17T03:40:16.552499+0000","last_clean":"2024-09-17T03:40:16.552499+0000","last_became_active":"2024-09-17T03:40:15.490938+0000","last_became_peered":"2024-09-17T03:40:15.490938+0000","last_unstale":"2024-09-17T03:40:16.552499+0000","last_undegraded":"2024-09-17T03:40:16.552499+0000","last_fullsized":"2024-09-17T03:40:16.552499+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:45.378479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476284+0000","last_change":"2024-09-17T03:40:14.479207+0000","last_active":"2024-09-17T03:40:16.476284+0000","last_peered":"2024-09-17T03:40:16.476284+0000","last_clean":"2024-09-17T03:40:16.476284+0000","last_became_active":"2024-09-17T03:40:14.478974+0000","last_became_peered":"2024-09-17T03:40:14.478974+0000","last_unstale":"2024-09-17T03:40:16.476284+0000","last_undegraded":"2024-09-17T03:40:16.476284+0000","last_fullsized":"2024-09-17T03:40:16.476284+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:37.325086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551862+0000","last_change":"2024-09-17T03:40:15.480254+0000","last_active":"2024-09-17T03:40:16.551862+0000","last_peered":"2024-09-17T03:40:16.551862+0000","last_clean":"2024-09-17T03:40:16.551862+0000","last_became_active":"2024-09-17T03:40:15.479489+0000","last_became_peered":"2024-09-17T03:40:15.479489+0000","last_unstale":"2024-09-17T03:40:16.551862+0000","last_undegraded":"2024-09-17T03:40:16.551862+0000","last_fullsized":"2024-09-17T03:40:16.551862+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:21.795552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552805+0000","last_change":"2024-09-17T03:40:14.485088+0000","last_active":"2024-09-17T03:40:16.552805+0000","last_peered":"2024-09-17T03:40:16.552805+0000","last_clean":"2024-09-17T03:40:16.552805+0000","last_became_active":"2024-09-17T03:40:14.484700+0000","last_became_peered":"2024-09-17T03:40:14.484700+0000","last_unstale":"2024-09-17T03:40:16.552805+0000","last_undegraded":"2024-09-17T03:40:16.552805+0000","last_fullsized":"2024-09-17T03:40:16.552805+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:42.357636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553004+0000","last_change":"2024-09-17T03:40:15.481077+0000","last_active":"2024-09-17T03:40:16.553004+0000","last_peered":"2024-09-17T03:40:16.553004+0000","last_clean":"2024-09-17T03:40:16.553004+0000","last_became_active":"2024-09-17T03:40:15.480776+0000","last_became_peered":"2024-09-17T03:40:15.480776+0000","last_unstale":"2024-09-17T03:40:16.553004+0000","last_undegraded":"2024-09-17T03:40:16.553004+0000","last_fullsized":"2024-09-17T03:40:16.553004+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:41.034237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551653+0000","last_change":"2024-09-17T03:40:14.471040+0000","last_active":"2024-09-17T03:40:16.551653+0000","last_peered":"2024-09-17T03:40:16.551653+0000","last_clean":"2024-09-17T03:40:16.551653+0000","last_became_active":"2024-09-17T03:40:14.470269+0000","last_became_peered":"2024-09-17T03:40:14.470269+0000","last_unstale":"2024-09-17T03:40:16.551653+0000","last_undegraded":"2024-09-17T03:40:16.551653+0000","last_fullsized":"2024-09-17T03:40:16.551653+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:58.742393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478375+0000","last_change":"2024-09-17T03:40:15.496633+0000","last_active":"2024-09-17T03:40:16.478375+0000","last_peered":"2024-09-17T03:40:16.478375+0000","last_clean":"2024-09-17T03:40:16.478375+0000","last_became_active":"2024-09-17T03:40:15.496027+0000","last_became_peered":"2024-09-17T03:40:15.496027+0000","last_unstale":"2024-09-17T03:40:16.478375+0000","last_undegraded":"2024-09-17T03:40:16.478375+0000","last_fullsized":"2024-09-17T03:40:16.478375+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:17.187794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552017+0000","last_change":"2024-09-17T03:40:14.480083+0000","last_active":"2024-09-17T03:40:16.552017+0000","last_peered":"2024-09-17T03:40:16.552017+0000","last_clean":"2024-09-17T03:40:16.552017+0000","last_became_active":"2024-09-17T03:40:14.479815+0000","last_became_peered":"2024-09-17T03:40:14.479815+0000","last_unstale":"2024-09-17T03:40:16.552017+0000","last_undegraded":"2024-09-17T03:40:16.552017+0000","last_fullsized":"2024-09-17T03:40:16.552017+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:46.688766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552355+0000","last_change":"2024-09-17T03:40:15.474882+0000","last_active":"2024-09-17T03:40:16.552355+0000","last_peered":"2024-09-17T03:40:16.552355+0000","last_clean":"2024-09-17T03:40:16.552355+0000","last_became_active":"2024-09-17T03:40:15.474567+0000","last_became_peered":"2024-09-17T03:40:15.474567+0000","last_unstale":"2024-09-17T03:40:16.552355+0000","last_undegraded":"2024-09-17T03:40:16.552355+0000","last_fullsized":"2024-09-17T03:40:16.552355+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:48.082051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"116'3","reported_seq":18,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552848+0000","last_change":"2024-09-17T03:40:14.481321+0000","last_active":"2024-09-17T03:40:16.552848+0000","last_peered":"2024-09-17T03:40:16.552848+0000","last_clean":"2024-09-17T03:40:16.552848+0000","last_became_active":"2024-09-17T03:40:14.481045+0000","last_became_peered":"2024-09-17T03:40:14.481045+0000","last_unstale":"2024-09-17T03:40:16.552848+0000","last_undegraded":"2024-09-17T03:40:16.552848+0000","last_fullsized":"2024-09-17T03:40:16.552848+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:48.594881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553056+0000","last_change":"2024-09-17T03:40:15.485451+0000","last_active":"2024-09-17T03:40:16.553056+0000","last_peered":"2024-09-17T03:40:16.553056+0000","last_clean":"2024-09-17T03:40:16.553056+0000","last_became_active":"2024-09-17T03:40:15.485116+0000","last_became_peered":"2024-09-17T03:40:15.485116+0000","last_unstale":"2024-09-17T03:40:16.553056+0000","last_undegraded":"2024-09-17T03:40:16.553056+0000","last_fullsized":"2024-09-17T03:40:16.553056+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:48.894066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"116'6","reported_seq":21,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553198+0000","last_change":"2024-09-17T03:40:14.484915+0000","last_active":"2024-09-17T03:40:16.553198+0000","last_peered":"2024-09-17T03:40:16.553198+0000","last_clean":"2024-09-17T03:40:16.553198+0000","last_became_active":"2024-09-17T03:40:14.484594+0000","last_became_peered":"2024-09-17T03:40:14.484594+0000","last_unstale":"2024-09-17T03:40:16.553198+0000","last_undegraded":"2024-09-17T03:40:16.553198+0000","last_fullsized":"2024-09-17T03:40:16.553198+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:32.875825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552175+0000","last_change":"2024-09-17T03:40:15.488261+0000","last_active":"2024-09-17T03:40:16.552175+0000","last_peered":"2024-09-17T03:40:16.552175+0000","last_clean":"2024-09-17T03:40:16.552175+0000","last_became_active":"2024-09-17T03:40:15.487934+0000","last_became_peered":"2024-09-17T03:40:15.487934+0000","last_unstale":"2024-09-17T03:40:16.552175+0000","last_undegraded":"2024-09-17T03:40:16.552175+0000","last_fullsized":"2024-09-17T03:40:16.552175+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:02.064934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475762+0000","last_change":"2024-09-17T03:40:14.480581+0000","last_active":"2024-09-17T03:40:16.475762+0000","last_peered":"2024-09-17T03:40:16.475762+0000","last_clean":"2024-09-17T03:40:16.475762+0000","last_became_active":"2024-09-17T03:40:14.480240+0000","last_became_peered":"2024-09-17T03:40:14.480240+0000","last_unstale":"2024-09-17T03:40:16.475762+0000","last_undegraded":"2024-09-17T03:40:16.475762+0000","last_fullsized":"2024-09-17T03:40:16.475762+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:42.775504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551951+0000","last_change":"2024-09-17T03:40:15.482447+0000","last_active":"2024-09-17T03:40:16.551951+0000","last_peered":"2024-09-17T03:40:16.551951+0000","last_clean":"2024-09-17T03:40:16.551951+0000","last_became_active":"2024-09-17T03:40:15.482134+0000","last_became_peered":"2024-09-17T03:40:15.482134+0000","last_unstale":"2024-09-17T03:40:16.551951+0000","last_undegraded":"2024-09-17T03:40:16.551951+0000","last_fullsized":"2024-09-17T03:40:16.551951+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:20.940998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477872+0000","last_change":"2024-09-17T03:40:14.470150+0000","last_active":"2024-09-17T03:40:16.477872+0000","last_peered":"2024-09-17T03:40:16.477872+0000","last_clean":"2024-09-17T03:40:16.477872+0000","last_became_active":"2024-09-17T03:40:14.469836+0000","last_became_peered":"2024-09-17T03:40:14.469836+0000","last_unstale":"2024-09-17T03:40:16.477872+0000","last_undegraded":"2024-09-17T03:40:16.477872+0000","last_fullsized":"2024-09-17T03:40:16.477872+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:58.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551775+0000","last_change":"2024-09-17T03:40:15.474933+0000","last_active":"2024-09-17T03:40:16.551775+0000","last_peered":"2024-09-17T03:40:16.551775+0000","last_clean":"2024-09-17T03:40:16.551775+0000","last_became_active":"2024-09-17T03:40:15.474590+0000","last_became_peered":"2024-09-17T03:40:15.474590+0000","last_unstale":"2024-09-17T03:40:16.551775+0000","last_undegraded":"2024-09-17T03:40:16.551775+0000","last_fullsized":"2024-09-17T03:40:16.551775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:57.185460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"116'8","reported_seq":23,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551827+0000","last_change":"2024-09-17T03:40:14.475793+0000","last_active":"2024-09-17T03:40:16.551827+0000","last_peered":"2024-09-17T03:40:16.551827+0000","last_clean":"2024-09-17T03:40:16.551827+0000","last_became_active":"2024-09-17T03:40:14.475496+0000","last_became_peered":"2024-09-17T03:40:14.475496+0000","last_unstale":"2024-09-17T03:40:16.551827+0000","last_undegraded":"2024-09-17T03:40:16.551827+0000","last_fullsized":"2024-09-17T03:40:16.551827+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:20.163847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552479+0000","last_change":"2024-09-17T03:40:15.500205+0000","last_active":"2024-09-17T03:40:16.552479+0000","last_peered":"2024-09-17T03:40:16.552479+0000","last_clean":"2024-09-17T03:40:16.552479+0000","last_became_active":"2024-09-17T03:40:15.499443+0000","last_became_peered":"2024-09-17T03:40:15.499443+0000","last_unstale":"2024-09-17T03:40:16.552479+0000","last_undegraded":"2024-09-17T03:40:16.552479+0000","last_fullsized":"2024-09-17T03:40:16.552479+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:09.991996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553195+0000","last_change":"2024-09-17T03:40:14.475616+0000","last_active":"2024-09-17T03:40:16.553195+0000","last_peered":"2024-09-17T03:40:16.553195+0000","last_clean":"2024-09-17T03:40:16.553195+0000","last_became_active":"2024-09-17T03:40:14.475319+0000","last_became_peered":"2024-09-17T03:40:14.475319+0000","last_unstale":"2024-09-17T03:40:16.553195+0000","last_undegraded":"2024-09-17T03:40:16.553195+0000","last_fullsized":"2024-09-17T03:40:16.553195+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:11.080444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475980+0000","last_change":"2024-09-17T03:40:15.496594+0000","last_active":"2024-09-17T03:40:16.475980+0000","last_peered":"2024-09-17T03:40:16.475980+0000","last_clean":"2024-09-17T03:40:16.475980+0000","last_became_active":"2024-09-17T03:40:15.496263+0000","last_became_peered":"2024-09-17T03:40:15.496263+0000","last_unstale":"2024-09-17T03:40:16.475980+0000","last_undegraded":"2024-09-17T03:40:16.475980+0000","last_fullsized":"2024-09-17T03:40:16.475980+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:33.863023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552569+0000","last_change":"2024-09-17T03:40:14.474157+0000","last_active":"2024-09-17T03:40:16.552569+0000","last_peered":"2024-09-17T03:40:16.552569+0000","last_clean":"2024-09-17T03:40:16.552569+0000","last_became_active":"2024-09-17T03:40:14.473846+0000","last_became_peered":"2024-09-17T03:40:14.473846+0000","last_unstale":"2024-09-17T03:40:16.552569+0000","last_undegraded":"2024-09-17T03:40:16.552569+0000","last_fullsized":"2024-09-17T03:40:16.552569+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:29.173297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552125+0000","last_change":"2024-09-17T03:40:15.496350+0000","last_active":"2024-09-17T03:40:16.552125+0000","last_peered":"2024-09-17T03:40:16.552125+0000","last_clean":"2024-09-17T03:40:16.552125+0000","last_became_active":"2024-09-17T03:40:15.496024+0000","last_became_peered":"2024-09-17T03:40:15.496024+0000","last_unstale":"2024-09-17T03:40:16.552125+0000","last_undegraded":"2024-09-17T03:40:16.552125+0000","last_fullsized":"2024-09-17T03:40:16.552125+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:07.692190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477089+0000","last_change":"2024-09-17T03:40:14.486426+0000","last_active":"2024-09-17T03:40:16.477089+0000","last_peered":"2024-09-17T03:40:16.477089+0000","last_clean":"2024-09-17T03:40:16.477089+0000","last_became_active":"2024-09-17T03:40:14.486185+0000","last_became_peered":"2024-09-17T03:40:14.486185+0000","last_unstale":"2024-09-17T03:40:16.477089+0000","last_undegraded":"2024-09-17T03:40:16.477089+0000","last_fullsized":"2024-09-17T03:40:16.477089+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:59.582788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552791+0000","last_change":"2024-09-17T03:40:15.483973+0000","last_active":"2024-09-17T03:40:16.552791+0000","last_peered":"2024-09-17T03:40:16.552791+0000","last_clean":"2024-09-17T03:40:16.552791+0000","last_became_active":"2024-09-17T03:40:15.483145+0000","last_became_peered":"2024-09-17T03:40:15.483145+0000","last_unstale":"2024-09-17T03:40:16.552791+0000","last_undegraded":"2024-09-17T03:40:16.552791+0000","last_fullsized":"2024-09-17T03:40:16.552791+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:27.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552753+0000","last_change":"2024-09-17T03:40:14.480432+0000","last_active":"2024-09-17T03:40:16.552753+0000","last_peered":"2024-09-17T03:40:16.552753+0000","last_clean":"2024-09-17T03:40:16.552753+0000","last_became_active":"2024-09-17T03:40:14.480110+0000","last_became_peered":"2024-09-17T03:40:14.480110+0000","last_unstale":"2024-09-17T03:40:16.552753+0000","last_undegraded":"2024-09-17T03:40:16.552753+0000","last_fullsized":"2024-09-17T03:40:16.552753+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:32.719766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552127+0000","last_change":"2024-09-17T03:40:15.482488+0000","last_active":"2024-09-17T03:40:16.552127+0000","last_peered":"2024-09-17T03:40:16.552127+0000","last_clean":"2024-09-17T03:40:16.552127+0000","last_became_active":"2024-09-17T03:40:15.482132+0000","last_became_peered":"2024-09-17T03:40:15.482132+0000","last_unstale":"2024-09-17T03:40:16.552127+0000","last_undegraded":"2024-09-17T03:40:16.552127+0000","last_fullsized":"2024-09-17T03:40:16.552127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:00.988692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475789+0000","last_change":"2024-09-17T03:40:14.478399+0000","last_active":"2024-09-17T03:40:16.475789+0000","last_peered":"2024-09-17T03:40:16.475789+0000","last_clean":"2024-09-17T03:40:16.475789+0000","last_became_active":"2024-09-17T03:40:14.477797+0000","last_became_peered":"2024-09-17T03:40:14.477797+0000","last_unstale":"2024-09-17T03:40:16.475789+0000","last_undegraded":"2024-09-17T03:40:16.475789+0000","last_fullsized":"2024-09-17T03:40:16.475789+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:51.818142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552560+0000","last_change":"2024-09-17T03:40:15.485602+0000","last_active":"2024-09-17T03:40:16.552560+0000","last_peered":"2024-09-17T03:40:16.552560+0000","last_clean":"2024-09-17T03:40:16.552560+0000","last_became_active":"2024-09-17T03:40:15.485151+0000","last_became_peered":"2024-09-17T03:40:15.485151+0000","last_unstale":"2024-09-17T03:40:16.552560+0000","last_undegraded":"2024-09-17T03:40:16.552560+0000","last_fullsized":"2024-09-17T03:40:16.552560+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:03.138811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551456+0000","last_change":"2024-09-17T03:40:14.481534+0000","last_active":"2024-09-17T03:40:16.551456+0000","last_peered":"2024-09-17T03:40:16.551456+0000","last_clean":"2024-09-17T03:40:16.551456+0000","last_became_active":"2024-09-17T03:40:14.481228+0000","last_became_peered":"2024-09-17T03:40:14.481228+0000","last_unstale":"2024-09-17T03:40:16.551456+0000","last_undegraded":"2024-09-17T03:40:16.551456+0000","last_fullsized":"2024-09-17T03:40:16.551456+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:44.335281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551852+0000","last_change":"2024-09-17T03:40:15.484052+0000","last_active":"2024-09-17T03:40:16.551852+0000","last_peered":"2024-09-17T03:40:16.551852+0000","last_clean":"2024-09-17T03:40:16.551852+0000","last_became_active":"2024-09-17T03:40:15.482744+0000","last_became_peered":"2024-09-17T03:40:15.482744+0000","last_unstale":"2024-09-17T03:40:16.551852+0000","last_undegraded":"2024-09-17T03:40:16.551852+0000","last_fullsized":"2024-09-17T03:40:16.551852+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:59.432670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475820+0000","last_change":"2024-09-17T03:40:14.478288+0000","last_active":"2024-09-17T03:40:16.475820+0000","last_peered":"2024-09-17T03:40:16.475820+0000","last_clean":"2024-09-17T03:40:16.475820+0000","last_became_active":"2024-09-17T03:40:14.478005+0000","last_became_peered":"2024-09-17T03:40:14.478005+0000","last_unstale":"2024-09-17T03:40:16.475820+0000","last_undegraded":"2024-09-17T03:40:16.475820+0000","last_fullsized":"2024-09-17T03:40:16.475820+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:39.216489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551999+0000","last_change":"2024-09-17T03:40:15.497363+0000","last_active":"2024-09-17T03:40:16.551999+0000","last_peered":"2024-09-17T03:40:16.551999+0000","last_clean":"2024-09-17T03:40:16.551999+0000","last_became_active":"2024-09-17T03:40:15.495974+0000","last_became_peered":"2024-09-17T03:40:15.495974+0000","last_unstale":"2024-09-17T03:40:16.551999+0000","last_undegraded":"2024-09-17T03:40:16.551999+0000","last_fullsized":"2024-09-17T03:40:16.551999+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:36.847762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552705+0000","last_change":"2024-09-17T03:40:14.473315+0000","last_active":"2024-09-17T03:40:16.552705+0000","last_peered":"2024-09-17T03:40:16.552705+0000","last_clean":"2024-09-17T03:40:16.552705+0000","last_became_active":"2024-09-17T03:40:14.472752+0000","last_became_peered":"2024-09-17T03:40:14.472752+0000","last_unstale":"2024-09-17T03:40:16.552705+0000","last_undegraded":"2024-09-17T03:40:16.552705+0000","last_fullsized":"2024-09-17T03:40:16.552705+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.347183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478161+0000","last_change":"2024-09-17T03:40:15.496606+0000","last_active":"2024-09-17T03:40:16.478161+0000","last_peered":"2024-09-17T03:40:16.478161+0000","last_clean":"2024-09-17T03:40:16.478161+0000","last_became_active":"2024-09-17T03:40:15.496039+0000","last_became_peered":"2024-09-17T03:40:15.496039+0000","last_unstale":"2024-09-17T03:40:16.478161+0000","last_undegraded":"2024-09-17T03:40:16.478161+0000","last_fullsized":"2024-09-17T03:40:16.478161+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:13.783841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551565+0000","last_change":"2024-09-17T03:40:14.485645+0000","last_active":"2024-09-17T03:40:16.551565+0000","last_peered":"2024-09-17T03:40:16.551565+0000","last_clean":"2024-09-17T03:40:16.551565+0000","last_became_active":"2024-09-17T03:40:14.483559+0000","last_became_peered":"2024-09-17T03:40:14.483559+0000","last_unstale":"2024-09-17T03:40:16.551565+0000","last_undegraded":"2024-09-17T03:40:16.551565+0000","last_fullsized":"2024-09-17T03:40:16.551565+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:28.380087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553025+0000","last_change":"2024-09-17T03:40:15.495051+0000","last_active":"2024-09-17T03:40:16.553025+0000","last_peered":"2024-09-17T03:40:16.553025+0000","last_clean":"2024-09-17T03:40:16.553025+0000","last_became_active":"2024-09-17T03:40:15.494741+0000","last_became_peered":"2024-09-17T03:40:15.494741+0000","last_unstale":"2024-09-17T03:40:16.553025+0000","last_undegraded":"2024-09-17T03:40:16.553025+0000","last_fullsized":"2024-09-17T03:40:16.553025+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:19.888917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"117'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478149+0000","last_change":"2024-09-17T03:40:14.473982+0000","last_active":"2024-09-17T03:40:16.478149+0000","last_peered":"2024-09-17T03:40:16.478149+0000","last_clean":"2024-09-17T03:40:16.478149+0000","last_became_active":"2024-09-17T03:40:14.473658+0000","last_became_peered":"2024-09-17T03:40:14.473658+0000","last_unstale":"2024-09-17T03:40:16.478149+0000","last_undegraded":"2024-09-17T03:40:16.478149+0000","last_fullsized":"2024-09-17T03:40:16.478149+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:28.613912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553230+0000","last_change":"2024-09-17T03:40:15.492445+0000","last_active":"2024-09-17T03:40:16.553230+0000","last_peered":"2024-09-17T03:40:16.553230+0000","last_clean":"2024-09-17T03:40:16.553230+0000","last_became_active":"2024-09-17T03:40:15.492138+0000","last_became_peered":"2024-09-17T03:40:15.492138+0000","last_unstale":"2024-09-17T03:40:16.553230+0000","last_undegraded":"2024-09-17T03:40:16.553230+0000","last_fullsized":"2024-09-17T03:40:16.553230+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:23.192448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552984+0000","last_change":"2024-09-17T03:40:14.472535+0000","last_active":"2024-09-17T03:40:16.552984+0000","last_peered":"2024-09-17T03:40:16.552984+0000","last_clean":"2024-09-17T03:40:16.552984+0000","last_became_active":"2024-09-17T03:40:14.472200+0000","last_became_peered":"2024-09-17T03:40:14.472200+0000","last_unstale":"2024-09-17T03:40:16.552984+0000","last_undegraded":"2024-09-17T03:40:16.552984+0000","last_fullsized":"2024-09-17T03:40:16.552984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:16.215936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476897+0000","last_change":"2024-09-17T03:40:15.496223+0000","last_active":"2024-09-17T03:40:16.476897+0000","last_peered":"2024-09-17T03:40:16.476897+0000","last_clean":"2024-09-17T03:40:16.476897+0000","last_became_active":"2024-09-17T03:40:15.495895+0000","last_became_peered":"2024-09-17T03:40:15.495895+0000","last_unstale":"2024-09-17T03:40:16.476897+0000","last_undegraded":"2024-09-17T03:40:16.476897+0000","last_fullsized":"2024-09-17T03:40:16.476897+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:08.136133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552423+0000","last_change":"2024-09-17T03:40:14.483507+0000","last_active":"2024-09-17T03:40:16.552423+0000","last_peered":"2024-09-17T03:40:16.552423+0000","last_clean":"2024-09-17T03:40:16.552423+0000","last_became_active":"2024-09-17T03:40:14.483198+0000","last_became_peered":"2024-09-17T03:40:14.483198+0000","last_unstale":"2024-09-17T03:40:16.552423+0000","last_undegraded":"2024-09-17T03:40:16.552423+0000","last_fullsized":"2024-09-17T03:40:16.552423+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:27.505809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476391+0000","last_change":"2024-09-17T03:40:15.481516+0000","last_active":"2024-09-17T03:40:16.476391+0000","last_peered":"2024-09-17T03:40:16.476391+0000","last_clean":"2024-09-17T03:40:16.476391+0000","last_became_active":"2024-09-17T03:40:15.481100+0000","last_became_peered":"2024-09-17T03:40:15.481100+0000","last_unstale":"2024-09-17T03:40:16.476391+0000","last_undegraded":"2024-09-17T03:40:16.476391+0000","last_fullsized":"2024-09-17T03:40:16.476391+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:49.910297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552671+0000","last_change":"2024-09-17T03:40:14.475085+0000","last_active":"2024-09-17T03:40:16.552671+0000","last_peered":"2024-09-17T03:40:16.552671+0000","last_clean":"2024-09-17T03:40:16.552671+0000","last_became_active":"2024-09-17T03:40:14.474642+0000","last_became_peered":"2024-09-17T03:40:14.474642+0000","last_unstale":"2024-09-17T03:40:16.552671+0000","last_undegraded":"2024-09-17T03:40:16.552671+0000","last_fullsized":"2024-09-17T03:40:16.552671+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:07.438425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477319+0000","last_change":"2024-09-17T03:40:15.472755+0000","last_active":"2024-09-17T03:40:16.477319+0000","last_peered":"2024-09-17T03:40:16.477319+0000","last_clean":"2024-09-17T03:40:16.477319+0000","last_became_active":"2024-09-17T03:40:15.472437+0000","last_became_peered":"2024-09-17T03:40:15.472437+0000","last_unstale":"2024-09-17T03:40:16.477319+0000","last_undegraded":"2024-09-17T03:40:16.477319+0000","last_fullsized":"2024-09-17T03:40:16.477319+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:44.143632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476452+0000","last_change":"2024-09-17T03:40:14.480911+0000","last_active":"2024-09-17T03:40:16.476452+0000","last_peered":"2024-09-17T03:40:16.476452+0000","last_clean":"2024-09-17T03:40:16.476452+0000","last_became_active":"2024-09-17T03:40:14.480499+0000","last_became_peered":"2024-09-17T03:40:14.480499+0000","last_unstale":"2024-09-17T03:40:16.476452+0000","last_undegraded":"2024-09-17T03:40:16.476452+0000","last_fullsized":"2024-09-17T03:40:16.476452+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:04.911626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552172+0000","last_change":"2024-09-17T03:40:15.484106+0000","last_active":"2024-09-17T03:40:16.552172+0000","last_peered":"2024-09-17T03:40:16.552172+0000","last_clean":"2024-09-17T03:40:16.552172+0000","last_became_active":"2024-09-17T03:40:15.483402+0000","last_became_peered":"2024-09-17T03:40:15.483402+0000","last_unstale":"2024-09-17T03:40:16.552172+0000","last_undegraded":"2024-09-17T03:40:16.552172+0000","last_fullsized":"2024-09-17T03:40:16.552172+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:15.968927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551582+0000","last_change":"2024-09-17T03:40:14.472140+0000","last_active":"2024-09-17T03:40:16.551582+0000","last_peered":"2024-09-17T03:40:16.551582+0000","last_clean":"2024-09-17T03:40:16.551582+0000","last_became_active":"2024-09-17T03:40:14.471857+0000","last_became_peered":"2024-09-17T03:40:14.471857+0000","last_unstale":"2024-09-17T03:40:16.551582+0000","last_undegraded":"2024-09-17T03:40:16.551582+0000","last_fullsized":"2024-09-17T03:40:16.551582+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:53.540753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552005+0000","last_change":"2024-09-17T03:40:15.491609+0000","last_active":"2024-09-17T03:40:16.552005+0000","last_peered":"2024-09-17T03:40:16.552005+0000","last_clean":"2024-09-17T03:40:16.552005+0000","last_became_active":"2024-09-17T03:40:15.491296+0000","last_became_peered":"2024-09-17T03:40:15.491296+0000","last_unstale":"2024-09-17T03:40:16.552005+0000","last_undegraded":"2024-09-17T03:40:16.552005+0000","last_fullsized":"2024-09-17T03:40:16.552005+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:46.783619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552876+0000","last_change":"2024-09-17T03:40:14.473025+0000","last_active":"2024-09-17T03:40:16.552876+0000","last_peered":"2024-09-17T03:40:16.552876+0000","last_clean":"2024-09-17T03:40:16.552876+0000","last_became_active":"2024-09-17T03:40:14.472373+0000","last_became_peered":"2024-09-17T03:40:14.472373+0000","last_unstale":"2024-09-17T03:40:16.552876+0000","last_undegraded":"2024-09-17T03:40:16.552876+0000","last_fullsized":"2024-09-17T03:40:16.552876+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:06.642837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551907+0000","last_change":"2024-09-17T03:40:15.483370+0000","last_active":"2024-09-17T03:40:16.551907+0000","last_peered":"2024-09-17T03:40:16.551907+0000","last_clean":"2024-09-17T03:40:16.551907+0000","last_became_active":"2024-09-17T03:40:15.483063+0000","last_became_peered":"2024-09-17T03:40:15.483063+0000","last_unstale":"2024-09-17T03:40:16.551907+0000","last_undegraded":"2024-09-17T03:40:16.551907+0000","last_fullsized":"2024-09-17T03:40:16.551907+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:53.510707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552003+0000","last_change":"2024-09-17T03:40:14.482698+0000","last_active":"2024-09-17T03:40:16.552003+0000","last_peered":"2024-09-17T03:40:16.552003+0000","last_clean":"2024-09-17T03:40:16.552003+0000","last_became_active":"2024-09-17T03:40:14.482376+0000","last_became_peered":"2024-09-17T03:40:14.482376+0000","last_unstale":"2024-09-17T03:40:16.552003+0000","last_undegraded":"2024-09-17T03:40:16.552003+0000","last_fullsized":"2024-09-17T03:40:16.552003+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:16.596119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":287,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552761+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:40:16.552761+0000","last_peered":"2024-09-17T03:40:16.552761+0000","last_clean":"2024-09-17T03:40:16.552761+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:40:16.552761+0000","last_undegraded":"2024-09-17T03:40:16.552761+0000","last_fullsized":"2024-09-17T03:40:16.552761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509534,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2048000,"data_stored":1222890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40434123},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46500,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325340,"statfs":{"total":96636764160,"available":96589148160,"internally_reserved":0,"allocated":1449984,"data_stored":631976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50656,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321184,"statfs":{"total":96636764160,"available":96584892416,"internally_reserved":0,"allocated":1445888,"data_stored":631906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509534,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46488,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325352,"statfs":{"total":96636764160,"available":96589160448,"internally_reserved":0,"allocated":1445888,"data_stored":631906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50656,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321184,"statfs":{"total":96636764160,"available":96584892416,"internally_reserved":0,"allocated":1454080,"data_stored":632030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509535,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45680,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326160,"statfs":{"total":96636764160,"available":96589987840,"internally_reserved":0,"allocated":2060288,"data_stored":1223998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574941,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28452,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343388,"statfs":{"total":96636764160,"available":96607629312,"internally_reserved":0,"allocated":1454080,"data_stored":632510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574941,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46508,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325332,"statfs":{"total":96636764160,"available":96589139968,"internally_reserved":0,"allocated":1462272,"data_stored":633588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:20.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:40:20.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.360+0000 7f880c3c3640 1 -- 172.21.15.146:0/1841197449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88040b5750 msgr2=0x7f88040b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.360+0000 7f880c3c3640 1 --2- 172.21.15.146:0/1841197449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88040b5750 0x7f88040b3620 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f8804074610 tx=0x7f87f402a560 comp rx=0 tx=0).stop 2024-09-17T03:40:20.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.360+0000 7f880c3c3640 1 -- 172.21.15.146:0/1841197449 shutdown_connections 2024-09-17T03:40:20.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.360+0000 7f880c3c3640 1 --2- 172.21.15.146:0/1841197449 >> v2:172.21.15.179:3300/0 conn(0x7f88040b3b60 0x7f88040b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.360+0000 7f880c3c3640 1 --2- 172.21.15.146:0/1841197449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88040b5750 0x7f88040b3620 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.360+0000 7f880c3c3640 1 --2- 172.21.15.146:0/1841197449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b5ce0 0x7f88040b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.360+0000 7f880c3c3640 1 -- 172.21.15.146:0/1841197449 >> 172.21.15.146:0/1841197449 conn(0x7f88040b7b20 msgr2=0x7f880409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.360+0000 7f880c3c3640 1 -- 172.21.15.146:0/1841197449 shutdown_connections 2024-09-17T03:40:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.360+0000 7f880c3c3640 1 -- 172.21.15.146:0/1841197449 wait complete. 2024-09-17T03:40:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.362+0000 7f880c3c3640 1 Processor -- start 2024-09-17T03:40:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.362+0000 7f880c3c3640 1 -- start start 2024-09-17T03:40:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880c3c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88040b3b60 0x7f88041f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880c3c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b5750 0x7f88040a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880c3c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88040b5ce0 0x7f88041f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880c3c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f88040b2970 con 0x7f88040b3b60 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880c3c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f88040b27f0 con 0x7f88040b5ce0 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880c3c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f88040b2af0 con 0x7f88040b5750 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880a15f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88040b3b60 0x7f88041f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880a15f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88040b3b60 0x7f88041f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53502/0 (socket says 172.21.15.146:53502) 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880a15f640 1 -- 172.21.15.146:0/306416559 learned_addr learned my addr 172.21.15.146:0/306416559 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880995e640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b5750 0x7f88040a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880a960640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88040b5ce0 0x7f88041f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880a15f640 1 -- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b5750 msgr2=0x7f88040a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880a15f640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b5750 0x7f88040a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880a15f640 1 -- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88040b5ce0 msgr2=0x7f88041f6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880a15f640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88040b5ce0 0x7f88041f6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880a15f640 1 -- 172.21.15.146:0/306416559 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88041f44d0 con 0x7f88040b3b60 2024-09-17T03:40:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880995e640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b5750 0x7f88040a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.363+0000 7f880a15f640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88040b3b60 0x7f88041f0d30 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f880000b440 tx=0x7f880000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.364+0000 7f87faffd640 1 -- 172.21.15.146:0/306416559 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800015020 con 0x7f88040b3b60 2024-09-17T03:40:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.364+0000 7f87faffd640 1 -- 172.21.15.146:0/306416559 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8800011980 con 0x7f88040b3b60 2024-09-17T03:40:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.364+0000 7f880c3c3640 1 -- 172.21.15.146:0/306416559 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8804158d80 con 0x7f88040b3b60 2024-09-17T03:40:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.364+0000 7f87faffd640 1 -- 172.21.15.146:0/306416559 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800011dd0 con 0x7f88040b3b60 2024-09-17T03:40:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.364+0000 7f880c3c3640 1 -- 172.21.15.146:0/306416559 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88041f6070 con 0x7f88040b3b60 2024-09-17T03:40:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.365+0000 7f880c3c3640 1 -- 172.21.15.146:0/306416559 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88041592a0 con 0x7f88040b3b60 2024-09-17T03:40:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.366+0000 7f87faffd640 1 -- 172.21.15.146:0/306416559 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8800018020 con 0x7f88040b3b60 2024-09-17T03:40:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.366+0000 7f87faffd640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f87e8078b90 0x7f87e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.366+0000 7f87faffd640 1 -- 172.21.15.146:0/306416559 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f880009b220 con 0x7f88040b3b60 2024-09-17T03:40:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.366+0000 7f880995e640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f87e8078b90 0x7f87e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.367+0000 7f880995e640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f87e8078b90 0x7f87e807b0a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f87f4033000 tx=0x7f87f4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.370+0000 7f87faffd640 1 -- 172.21.15.146:0/306416559 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88041592a0 con 0x7f88040b3b60 2024-09-17T03:40:20.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.616+0000 7f880c3c3640 1 -- 172.21.15.146:0/306416559 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8804071c10 con 0x7f88040b3b60 2024-09-17T03:40:20.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.617+0000 7f87faffd640 1 -- 172.21.15.146:0/306416559 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1057 (secure 0 0 0) 0x7f8804071c10 con 0x7f88040b3b60 2024-09-17T03:40:20.617 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:20.617 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":465,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":117,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":365010944,"bytes_avail":772729102336,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8187}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-17T03:40:03.903948+0000","services":{}},"progress_events":{}} 2024-09-17T03:40:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 -- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f87e8078b90 msgr2=0x7f87e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f87e8078b90 0x7f87e807b0a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f87f4033000 tx=0x7f87f4004730 comp rx=0 tx=0).stop 2024-09-17T03:40:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 -- 172.21.15.146:0/306416559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88040b3b60 msgr2=0x7f88041f0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88040b3b60 0x7f88041f0d30 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f880000b440 tx=0x7f880000b900 comp rx=0 tx=0).stop 2024-09-17T03:40:20.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 -- 172.21.15.146:0/306416559 shutdown_connections 2024-09-17T03:40:20.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f87e8078b90 0x7f87e807b0a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f88040b5ce0 0x7f88041f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88040b5750 0x7f88040a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 --2- 172.21.15.146:0/306416559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88040b3b60 0x7f88041f0d30 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 -- 172.21.15.146:0/306416559 >> 172.21.15.146:0/306416559 conn(0x7f88040b7b20 msgr2=0x7f8804070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:20.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 -- 172.21.15.146:0/306416559 shutdown_connections 2024-09-17T03:40:20.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.620+0000 7f880c3c3640 1 -- 172.21.15.146:0/306416559 wait complete. 2024-09-17T03:40:20.631 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:40:20.632 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:20.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.745+0000 7f326e59b640 1 -- 172.21.15.146:0/2066659341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32680b3b60 msgr2=0x7f326815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.745+0000 7f326e59b640 1 --2- 172.21.15.146:0/2066659341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32680b3b60 0x7f326815caa0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f32680b8440 tx=0x7f326002a820 comp rx=0 tx=0).stop 2024-09-17T03:40:20.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.745+0000 7f326e59b640 1 -- 172.21.15.146:0/2066659341 shutdown_connections 2024-09-17T03:40:20.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.745+0000 7f326e59b640 1 --2- 172.21.15.146:0/2066659341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32680b3b60 0x7f326815caa0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.745+0000 7f326e59b640 1 --2- 172.21.15.146:0/2066659341 >> v2:172.21.15.179:3300/0 conn(0x7f32680b5750 0x7f32680b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.745+0000 7f326e59b640 1 -- 172.21.15.146:0/2066659341 >> 172.21.15.146:0/2066659341 conn(0x7f32680b7b20 msgr2=0x7f326809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:20.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.745+0000 7f326e59b640 1 -- 172.21.15.146:0/2066659341 shutdown_connections 2024-09-17T03:40:20.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.745+0000 7f326e59b640 1 -- 172.21.15.146:0/2066659341 wait complete. 2024-09-17T03:40:20.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.747+0000 7f326e59b640 1 Processor -- start 2024-09-17T03:40:20.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.747+0000 7f326e59b640 1 -- start start 2024-09-17T03:40:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.748+0000 7f326e59b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32680b3b60 0x7f3268143b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.748+0000 7f326e59b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32680b5750 0x7f3268144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.748+0000 7f326e59b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32680b5ce0 0x7f3268144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.748+0000 7f326e59b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f326815d420 con 0x7f32680b5750 2024-09-17T03:40:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.748+0000 7f326e59b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f326815d2a0 con 0x7f32680b5ce0 2024-09-17T03:40:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.748+0000 7f326e59b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f326815d5a0 con 0x7f32680b3b60 2024-09-17T03:40:20.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f32677fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32680b5750 0x7f3268144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f32677fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32680b5750 0x7f3268144410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53514/0 (socket says 172.21.15.146:53514) 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f32677fe640 1 -- 172.21.15.146:0/1385568335 learned_addr learned my addr 172.21.15.146:0/1385568335 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f326cb38640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32680b5ce0 0x7f3268144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f32677fe640 1 -- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32680b3b60 msgr2=0x7f3268143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f3267fff640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32680b3b60 0x7f3268143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f32677fe640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32680b3b60 0x7f3268143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f32677fe640 1 -- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32680b5ce0 msgr2=0x7f3268144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f32677fe640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32680b5ce0 0x7f3268144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f32677fe640 1 -- 172.21.15.146:0/1385568335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32681473e0 con 0x7f32680b5750 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f326cb38640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32680b5ce0 0x7f3268144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f3267fff640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32680b3b60 0x7f3268143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f32677fe640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32680b5750 0x7f3268144410 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c970 tx=0x7f325c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f3264ff9640 1 -- 172.21.15.146:0/1385568335 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c004220 con 0x7f32680b5750 2024-09-17T03:40:20.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f3264ff9640 1 -- 172.21.15.146:0/1385568335 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f325c0044b0 con 0x7f32680b5750 2024-09-17T03:40:20.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f326e59b640 1 -- 172.21.15.146:0/1385568335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32680a0670 con 0x7f32680b5750 2024-09-17T03:40:20.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f3264ff9640 1 -- 172.21.15.146:0/1385568335 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c007c10 con 0x7f32680b5750 2024-09-17T03:40:20.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.749+0000 7f326e59b640 1 -- 172.21.15.146:0/1385568335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3268158f50 con 0x7f32680b5750 2024-09-17T03:40:20.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.750+0000 7f326e59b640 1 -- 172.21.15.146:0/1385568335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32680a03e0 con 0x7f32680b5750 2024-09-17T03:40:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.751+0000 7f3264ff9640 1 -- 172.21.15.146:0/1385568335 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f325c003610 con 0x7f32680b5750 2024-09-17T03:40:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.751+0000 7f3264ff9640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3254078b90 0x7f325407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.752+0000 7f3264ff9640 1 -- 172.21.15.146:0/1385568335 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f325c09b2c0 con 0x7f32680b5750 2024-09-17T03:40:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.752+0000 7f3267fff640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3254078b90 0x7f325407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:20.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.752+0000 7f3267fff640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3254078b90 0x7f325407b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3258000f60 tx=0x7f3258009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:20.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.756+0000 7f3264ff9640 1 -- 172.21.15.146:0/1385568335 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f325c014030 con 0x7f32680b5750 2024-09-17T03:40:20.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.927+0000 7f326e59b640 1 -- 172.21.15.146:0/1385568335 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f326815caa0 con 0x7f3254078b90 2024-09-17T03:40:20.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.931+0000 7f3264ff9640 1 -- 172.21.15.146:0/1385568335 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252471 (secure 0 0 0) 0x7f326815caa0 con 0x7f3254078b90 2024-09-17T03:40:20.934 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:20.935 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:40:20.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 -- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3254078b90 msgr2=0x7f325407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3254078b90 0x7f325407b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3258000f60 tx=0x7f3258009040 comp rx=0 tx=0).stop 2024-09-17T03:40:20.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 -- 172.21.15.146:0/1385568335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32680b5750 msgr2=0x7f3268144410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:20.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32680b5750 0x7f3268144410 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c970 tx=0x7f325c00ce30 comp rx=0 tx=0).stop 2024-09-17T03:40:20.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 -- 172.21.15.146:0/1385568335 shutdown_connections 2024-09-17T03:40:20.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3254078b90 0x7f325407b0a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32680b5ce0 0x7f3268144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32680b5750 0x7f3268144410 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 --2- 172.21.15.146:0/1385568335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32680b3b60 0x7f3268143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:20.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 -- 172.21.15.146:0/1385568335 >> 172.21.15.146:0/1385568335 conn(0x7f32680b7b20 msgr2=0x7f326815a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:20.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 -- 172.21.15.146:0/1385568335 shutdown_connections 2024-09-17T03:40:20.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:20.935+0000 7f326e59b640 1 -- 172.21.15.146:0/1385568335 wait complete. 2024-09-17T03:40:20.946 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-17T03:40:19.907727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":356456,"kb_used_data":12520,"kb_used_omap":12,"kb_used_meta":343731,"kb_avail":754618264,"statfs":{"total":773094113280,"available":772729102336,"internally_reserved":0,"allocated":12820480,"data_stored":6240804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":351981105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001678"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552785+0000","last_change":"2024-09-17T03:40:15.497016+0000","last_active":"2024-09-17T03:40:16.552785+0000","last_peered":"2024-09-17T03:40:16.552785+0000","last_clean":"2024-09-17T03:40:16.552785+0000","last_became_active":"2024-09-17T03:40:15.496378+0000","last_became_peered":"2024-09-17T03:40:15.496378+0000","last_unstale":"2024-09-17T03:40:16.552785+0000","last_undegraded":"2024-09-17T03:40:16.552785+0000","last_fullsized":"2024-09-17T03:40:16.552785+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:37.698708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476763+0000","last_change":"2024-09-17T03:40:15.471970+0000","last_active":"2024-09-17T03:40:16.476763+0000","last_peered":"2024-09-17T03:40:16.476763+0000","last_clean":"2024-09-17T03:40:16.476763+0000","last_became_active":"2024-09-17T03:40:15.471657+0000","last_became_peered":"2024-09-17T03:40:15.471657+0000","last_unstale":"2024-09-17T03:40:16.476763+0000","last_undegraded":"2024-09-17T03:40:16.476763+0000","last_fullsized":"2024-09-17T03:40:16.476763+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:43.359671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552234+0000","last_change":"2024-09-17T03:40:15.482150+0000","last_active":"2024-09-17T03:40:16.552234+0000","last_peered":"2024-09-17T03:40:16.552234+0000","last_clean":"2024-09-17T03:40:16.552234+0000","last_became_active":"2024-09-17T03:40:15.481828+0000","last_became_peered":"2024-09-17T03:40:15.481828+0000","last_unstale":"2024-09-17T03:40:16.552234+0000","last_undegraded":"2024-09-17T03:40:16.552234+0000","last_fullsized":"2024-09-17T03:40:16.552234+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:56.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552918+0000","last_change":"2024-09-17T03:40:15.495282+0000","last_active":"2024-09-17T03:40:16.552918+0000","last_peered":"2024-09-17T03:40:16.552918+0000","last_clean":"2024-09-17T03:40:16.552918+0000","last_became_active":"2024-09-17T03:40:15.494916+0000","last_became_peered":"2024-09-17T03:40:15.494916+0000","last_unstale":"2024-09-17T03:40:16.552918+0000","last_undegraded":"2024-09-17T03:40:16.552918+0000","last_fullsized":"2024-09-17T03:40:16.552918+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:17.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552250+0000","last_change":"2024-09-17T03:40:15.475218+0000","last_active":"2024-09-17T03:40:16.552250+0000","last_peered":"2024-09-17T03:40:16.552250+0000","last_clean":"2024-09-17T03:40:16.552250+0000","last_became_active":"2024-09-17T03:40:15.474586+0000","last_became_peered":"2024-09-17T03:40:15.474586+0000","last_unstale":"2024-09-17T03:40:16.552250+0000","last_undegraded":"2024-09-17T03:40:16.552250+0000","last_fullsized":"2024-09-17T03:40:16.552250+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:34.290950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475605+0000","last_change":"2024-09-17T03:40:15.476554+0000","last_active":"2024-09-17T03:40:16.475605+0000","last_peered":"2024-09-17T03:40:16.475605+0000","last_clean":"2024-09-17T03:40:16.475605+0000","last_became_active":"2024-09-17T03:40:15.476209+0000","last_became_peered":"2024-09-17T03:40:15.476209+0000","last_unstale":"2024-09-17T03:40:16.475605+0000","last_undegraded":"2024-09-17T03:40:16.475605+0000","last_fullsized":"2024-09-17T03:40:16.475605+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:40.711541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551912+0000","last_change":"2024-09-17T03:40:15.479882+0000","last_active":"2024-09-17T03:40:16.551912+0000","last_peered":"2024-09-17T03:40:16.551912+0000","last_clean":"2024-09-17T03:40:16.551912+0000","last_became_active":"2024-09-17T03:40:15.479041+0000","last_became_peered":"2024-09-17T03:40:15.479041+0000","last_unstale":"2024-09-17T03:40:16.551912+0000","last_undegraded":"2024-09-17T03:40:16.551912+0000","last_fullsized":"2024-09-17T03:40:16.551912+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:31.468455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551777+0000","last_change":"2024-09-17T03:40:15.483743+0000","last_active":"2024-09-17T03:40:16.551777+0000","last_peered":"2024-09-17T03:40:16.551777+0000","last_clean":"2024-09-17T03:40:16.551777+0000","last_became_active":"2024-09-17T03:40:15.482551+0000","last_became_peered":"2024-09-17T03:40:15.482551+0000","last_unstale":"2024-09-17T03:40:16.551777+0000","last_undegraded":"2024-09-17T03:40:16.551777+0000","last_fullsized":"2024-09-17T03:40:16.551777+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:11.954766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552922+0000","last_change":"2024-09-17T03:40:15.496204+0000","last_active":"2024-09-17T03:40:16.552922+0000","last_peered":"2024-09-17T03:40:16.552922+0000","last_clean":"2024-09-17T03:40:16.552922+0000","last_became_active":"2024-09-17T03:40:15.495775+0000","last_became_peered":"2024-09-17T03:40:15.495775+0000","last_unstale":"2024-09-17T03:40:16.552922+0000","last_undegraded":"2024-09-17T03:40:16.552922+0000","last_fullsized":"2024-09-17T03:40:16.552922+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:02.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553100+0000","last_change":"2024-09-17T03:40:15.496321+0000","last_active":"2024-09-17T03:40:16.553100+0000","last_peered":"2024-09-17T03:40:16.553100+0000","last_clean":"2024-09-17T03:40:16.553100+0000","last_became_active":"2024-09-17T03:40:15.495406+0000","last_became_peered":"2024-09-17T03:40:15.495406+0000","last_unstale":"2024-09-17T03:40:16.553100+0000","last_undegraded":"2024-09-17T03:40:16.553100+0000","last_fullsized":"2024-09-17T03:40:16.553100+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:46.298994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476823+0000","last_change":"2024-09-17T03:40:15.470662+0000","last_active":"2024-09-17T03:40:16.476823+0000","last_peered":"2024-09-17T03:40:16.476823+0000","last_clean":"2024-09-17T03:40:16.476823+0000","last_became_active":"2024-09-17T03:40:15.470333+0000","last_became_peered":"2024-09-17T03:40:15.470333+0000","last_unstale":"2024-09-17T03:40:16.476823+0000","last_undegraded":"2024-09-17T03:40:16.476823+0000","last_fullsized":"2024-09-17T03:40:16.476823+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:59.432670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553004+0000","last_change":"2024-09-17T03:40:15.497895+0000","last_active":"2024-09-17T03:40:16.553004+0000","last_peered":"2024-09-17T03:40:16.553004+0000","last_clean":"2024-09-17T03:40:16.553004+0000","last_became_active":"2024-09-17T03:40:15.495567+0000","last_became_peered":"2024-09-17T03:40:15.495567+0000","last_unstale":"2024-09-17T03:40:16.553004+0000","last_undegraded":"2024-09-17T03:40:16.553004+0000","last_fullsized":"2024-09-17T03:40:16.553004+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:01.849474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552762+0000","last_change":"2024-09-17T03:40:15.482010+0000","last_active":"2024-09-17T03:40:16.552762+0000","last_peered":"2024-09-17T03:40:16.552762+0000","last_clean":"2024-09-17T03:40:16.552762+0000","last_became_active":"2024-09-17T03:40:15.481624+0000","last_became_peered":"2024-09-17T03:40:15.481624+0000","last_unstale":"2024-09-17T03:40:16.552762+0000","last_undegraded":"2024-09-17T03:40:16.552762+0000","last_fullsized":"2024-09-17T03:40:16.552762+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:29.432451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551828+0000","last_change":"2024-09-17T03:40:15.481964+0000","last_active":"2024-09-17T03:40:16.551828+0000","last_peered":"2024-09-17T03:40:16.551828+0000","last_clean":"2024-09-17T03:40:16.551828+0000","last_became_active":"2024-09-17T03:40:15.481637+0000","last_became_peered":"2024-09-17T03:40:15.481637+0000","last_unstale":"2024-09-17T03:40:16.551828+0000","last_undegraded":"2024-09-17T03:40:16.551828+0000","last_fullsized":"2024-09-17T03:40:16.551828+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:03.349218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475614+0000","last_change":"2024-09-17T03:40:15.476228+0000","last_active":"2024-09-17T03:40:16.475614+0000","last_peered":"2024-09-17T03:40:16.475614+0000","last_clean":"2024-09-17T03:40:16.475614+0000","last_became_active":"2024-09-17T03:40:15.475923+0000","last_became_peered":"2024-09-17T03:40:15.475923+0000","last_unstale":"2024-09-17T03:40:16.475614+0000","last_undegraded":"2024-09-17T03:40:16.475614+0000","last_fullsized":"2024-09-17T03:40:16.475614+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:37.778905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552446+0000","last_change":"2024-09-17T03:40:15.487172+0000","last_active":"2024-09-17T03:40:16.552446+0000","last_peered":"2024-09-17T03:40:16.552446+0000","last_clean":"2024-09-17T03:40:16.552446+0000","last_became_active":"2024-09-17T03:40:15.486843+0000","last_became_peered":"2024-09-17T03:40:15.486843+0000","last_unstale":"2024-09-17T03:40:16.552446+0000","last_undegraded":"2024-09-17T03:40:16.552446+0000","last_fullsized":"2024-09-17T03:40:16.552446+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:35.230466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477078+0000","last_change":"2024-09-17T03:40:15.471388+0000","last_active":"2024-09-17T03:40:16.477078+0000","last_peered":"2024-09-17T03:40:16.477078+0000","last_clean":"2024-09-17T03:40:16.477078+0000","last_became_active":"2024-09-17T03:40:15.470136+0000","last_became_peered":"2024-09-17T03:40:15.470136+0000","last_unstale":"2024-09-17T03:40:16.477078+0000","last_undegraded":"2024-09-17T03:40:16.477078+0000","last_fullsized":"2024-09-17T03:40:16.477078+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:32.381586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476433+0000","last_change":"2024-09-17T03:40:15.474023+0000","last_active":"2024-09-17T03:40:16.476433+0000","last_peered":"2024-09-17T03:40:16.476433+0000","last_clean":"2024-09-17T03:40:16.476433+0000","last_became_active":"2024-09-17T03:40:15.473072+0000","last_became_peered":"2024-09-17T03:40:15.473072+0000","last_unstale":"2024-09-17T03:40:16.476433+0000","last_undegraded":"2024-09-17T03:40:16.476433+0000","last_fullsized":"2024-09-17T03:40:16.476433+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:13.319000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552518+0000","last_change":"2024-09-17T03:40:15.484636+0000","last_active":"2024-09-17T03:40:16.552518+0000","last_peered":"2024-09-17T03:40:16.552518+0000","last_clean":"2024-09-17T03:40:16.552518+0000","last_became_active":"2024-09-17T03:40:15.482975+0000","last_became_peered":"2024-09-17T03:40:15.482975+0000","last_unstale":"2024-09-17T03:40:16.552518+0000","last_undegraded":"2024-09-17T03:40:16.552518+0000","last_fullsized":"2024-09-17T03:40:16.552518+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:04.977186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477160+0000","last_change":"2024-09-17T03:40:15.482147+0000","last_active":"2024-09-17T03:40:16.477160+0000","last_peered":"2024-09-17T03:40:16.477160+0000","last_clean":"2024-09-17T03:40:16.477160+0000","last_became_active":"2024-09-17T03:40:15.481833+0000","last_became_peered":"2024-09-17T03:40:15.481833+0000","last_unstale":"2024-09-17T03:40:16.477160+0000","last_undegraded":"2024-09-17T03:40:16.477160+0000","last_fullsized":"2024-09-17T03:40:16.477160+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:49.596916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477556+0000","last_change":"2024-09-17T03:40:15.468981+0000","last_active":"2024-09-17T03:40:16.477556+0000","last_peered":"2024-09-17T03:40:16.477556+0000","last_clean":"2024-09-17T03:40:16.477556+0000","last_became_active":"2024-09-17T03:40:15.467938+0000","last_became_peered":"2024-09-17T03:40:15.467938+0000","last_unstale":"2024-09-17T03:40:16.477556+0000","last_undegraded":"2024-09-17T03:40:16.477556+0000","last_fullsized":"2024-09-17T03:40:16.477556+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:07.644872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551935+0000","last_change":"2024-09-17T03:40:15.470210+0000","last_active":"2024-09-17T03:40:16.551935+0000","last_peered":"2024-09-17T03:40:16.551935+0000","last_clean":"2024-09-17T03:40:16.551935+0000","last_became_active":"2024-09-17T03:40:15.469093+0000","last_became_peered":"2024-09-17T03:40:15.469093+0000","last_unstale":"2024-09-17T03:40:16.551935+0000","last_undegraded":"2024-09-17T03:40:16.551935+0000","last_fullsized":"2024-09-17T03:40:16.551935+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:35.551590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476232+0000","last_change":"2024-09-17T03:40:15.481291+0000","last_active":"2024-09-17T03:40:16.476232+0000","last_peered":"2024-09-17T03:40:16.476232+0000","last_clean":"2024-09-17T03:40:16.476232+0000","last_became_active":"2024-09-17T03:40:15.480790+0000","last_became_peered":"2024-09-17T03:40:15.480790+0000","last_unstale":"2024-09-17T03:40:16.476232+0000","last_undegraded":"2024-09-17T03:40:16.476232+0000","last_fullsized":"2024-09-17T03:40:16.476232+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:23.236029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551653+0000","last_change":"2024-09-17T03:40:15.484372+0000","last_active":"2024-09-17T03:40:16.551653+0000","last_peered":"2024-09-17T03:40:16.551653+0000","last_clean":"2024-09-17T03:40:16.551653+0000","last_became_active":"2024-09-17T03:40:15.484026+0000","last_became_peered":"2024-09-17T03:40:15.484026+0000","last_unstale":"2024-09-17T03:40:16.551653+0000","last_undegraded":"2024-09-17T03:40:16.551653+0000","last_fullsized":"2024-09-17T03:40:16.551653+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:31.193826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477240+0000","last_change":"2024-09-17T03:40:15.469694+0000","last_active":"2024-09-17T03:40:16.477240+0000","last_peered":"2024-09-17T03:40:16.477240+0000","last_clean":"2024-09-17T03:40:16.477240+0000","last_became_active":"2024-09-17T03:40:15.469377+0000","last_became_peered":"2024-09-17T03:40:15.469377+0000","last_unstale":"2024-09-17T03:40:16.477240+0000","last_undegraded":"2024-09-17T03:40:16.477240+0000","last_fullsized":"2024-09-17T03:40:16.477240+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:17.217971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553115+0000","last_change":"2024-09-17T03:40:15.494804+0000","last_active":"2024-09-17T03:40:16.553115+0000","last_peered":"2024-09-17T03:40:16.553115+0000","last_clean":"2024-09-17T03:40:16.553115+0000","last_became_active":"2024-09-17T03:40:15.494455+0000","last_became_peered":"2024-09-17T03:40:15.494455+0000","last_unstale":"2024-09-17T03:40:16.553115+0000","last_undegraded":"2024-09-17T03:40:16.553115+0000","last_fullsized":"2024-09-17T03:40:16.553115+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:49.736642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476020+0000","last_change":"2024-09-17T03:40:15.497449+0000","last_active":"2024-09-17T03:40:16.476020+0000","last_peered":"2024-09-17T03:40:16.476020+0000","last_clean":"2024-09-17T03:40:16.476020+0000","last_became_active":"2024-09-17T03:40:15.496364+0000","last_became_peered":"2024-09-17T03:40:15.496364+0000","last_unstale":"2024-09-17T03:40:16.476020+0000","last_undegraded":"2024-09-17T03:40:16.476020+0000","last_fullsized":"2024-09-17T03:40:16.476020+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:59.627991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552236+0000","last_change":"2024-09-17T03:40:15.494642+0000","last_active":"2024-09-17T03:40:16.552236+0000","last_peered":"2024-09-17T03:40:16.552236+0000","last_clean":"2024-09-17T03:40:16.552236+0000","last_became_active":"2024-09-17T03:40:15.494266+0000","last_became_peered":"2024-09-17T03:40:15.494266+0000","last_unstale":"2024-09-17T03:40:16.552236+0000","last_undegraded":"2024-09-17T03:40:16.552236+0000","last_fullsized":"2024-09-17T03:40:16.552236+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:13.272105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476604+0000","last_change":"2024-09-17T03:40:15.479298+0000","last_active":"2024-09-17T03:40:16.476604+0000","last_peered":"2024-09-17T03:40:16.476604+0000","last_clean":"2024-09-17T03:40:16.476604+0000","last_became_active":"2024-09-17T03:40:15.478964+0000","last_became_peered":"2024-09-17T03:40:15.478964+0000","last_unstale":"2024-09-17T03:40:16.476604+0000","last_undegraded":"2024-09-17T03:40:16.476604+0000","last_fullsized":"2024-09-17T03:40:16.476604+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:25.727689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552939+0000","last_change":"2024-09-17T03:40:15.489604+0000","last_active":"2024-09-17T03:40:16.552939+0000","last_peered":"2024-09-17T03:40:16.552939+0000","last_clean":"2024-09-17T03:40:16.552939+0000","last_became_active":"2024-09-17T03:40:15.489302+0000","last_became_peered":"2024-09-17T03:40:15.489302+0000","last_unstale":"2024-09-17T03:40:16.552939+0000","last_undegraded":"2024-09-17T03:40:16.552939+0000","last_fullsized":"2024-09-17T03:40:16.552939+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:51.069041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551769+0000","last_change":"2024-09-17T03:40:15.485199+0000","last_active":"2024-09-17T03:40:16.551769+0000","last_peered":"2024-09-17T03:40:16.551769+0000","last_clean":"2024-09-17T03:40:16.551769+0000","last_became_active":"2024-09-17T03:40:15.484863+0000","last_became_peered":"2024-09-17T03:40:15.484863+0000","last_unstale":"2024-09-17T03:40:16.551769+0000","last_undegraded":"2024-09-17T03:40:16.551769+0000","last_fullsized":"2024-09-17T03:40:16.551769+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:55.504035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475628+0000","last_change":"2024-09-17T03:40:15.478863+0000","last_active":"2024-09-17T03:40:16.475628+0000","last_peered":"2024-09-17T03:40:16.475628+0000","last_clean":"2024-09-17T03:40:16.475628+0000","last_became_active":"2024-09-17T03:40:15.478565+0000","last_became_peered":"2024-09-17T03:40:15.478565+0000","last_unstale":"2024-09-17T03:40:16.475628+0000","last_undegraded":"2024-09-17T03:40:16.475628+0000","last_fullsized":"2024-09-17T03:40:16.475628+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:20.800752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475958+0000","last_change":"2024-09-17T03:40:15.475782+0000","last_active":"2024-09-17T03:40:16.475958+0000","last_peered":"2024-09-17T03:40:16.475958+0000","last_clean":"2024-09-17T03:40:16.475958+0000","last_became_active":"2024-09-17T03:40:15.475291+0000","last_became_peered":"2024-09-17T03:40:15.475291+0000","last_unstale":"2024-09-17T03:40:16.475958+0000","last_undegraded":"2024-09-17T03:40:16.475958+0000","last_fullsized":"2024-09-17T03:40:16.475958+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:32.617963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"116'4","reported_seq":19,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552862+0000","last_change":"2024-09-17T03:40:14.474590+0000","last_active":"2024-09-17T03:40:16.552862+0000","last_peered":"2024-09-17T03:40:16.552862+0000","last_clean":"2024-09-17T03:40:16.552862+0000","last_became_active":"2024-09-17T03:40:14.474251+0000","last_became_peered":"2024-09-17T03:40:14.474251+0000","last_unstale":"2024-09-17T03:40:16.552862+0000","last_undegraded":"2024-09-17T03:40:16.552862+0000","last_fullsized":"2024-09-17T03:40:16.552862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:24.482162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478410+0000","last_change":"2024-09-17T03:40:15.478596+0000","last_active":"2024-09-17T03:40:16.478410+0000","last_peered":"2024-09-17T03:40:16.478410+0000","last_clean":"2024-09-17T03:40:16.478410+0000","last_became_active":"2024-09-17T03:40:15.478141+0000","last_became_peered":"2024-09-17T03:40:15.478141+0000","last_unstale":"2024-09-17T03:40:16.478410+0000","last_undegraded":"2024-09-17T03:40:16.478410+0000","last_fullsized":"2024-09-17T03:40:16.478410+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:17.884900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551866+0000","last_change":"2024-09-17T03:40:14.475924+0000","last_active":"2024-09-17T03:40:16.551866+0000","last_peered":"2024-09-17T03:40:16.551866+0000","last_clean":"2024-09-17T03:40:16.551866+0000","last_became_active":"2024-09-17T03:40:14.475532+0000","last_became_peered":"2024-09-17T03:40:14.475532+0000","last_unstale":"2024-09-17T03:40:16.551866+0000","last_undegraded":"2024-09-17T03:40:16.551866+0000","last_fullsized":"2024-09-17T03:40:16.551866+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:09.188966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476017+0000","last_change":"2024-09-17T03:40:15.477759+0000","last_active":"2024-09-17T03:40:16.476017+0000","last_peered":"2024-09-17T03:40:16.476017+0000","last_clean":"2024-09-17T03:40:16.476017+0000","last_became_active":"2024-09-17T03:40:15.477354+0000","last_became_peered":"2024-09-17T03:40:15.477354+0000","last_unstale":"2024-09-17T03:40:16.476017+0000","last_undegraded":"2024-09-17T03:40:16.476017+0000","last_fullsized":"2024-09-17T03:40:16.476017+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:57.668885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551608+0000","last_change":"2024-09-17T03:40:14.470654+0000","last_active":"2024-09-17T03:40:16.551608+0000","last_peered":"2024-09-17T03:40:16.551608+0000","last_clean":"2024-09-17T03:40:16.551608+0000","last_became_active":"2024-09-17T03:40:14.470305+0000","last_became_peered":"2024-09-17T03:40:14.470305+0000","last_unstale":"2024-09-17T03:40:16.551608+0000","last_undegraded":"2024-09-17T03:40:16.551608+0000","last_fullsized":"2024-09-17T03:40:16.551608+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:30.603247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552555+0000","last_change":"2024-09-17T03:40:15.483578+0000","last_active":"2024-09-17T03:40:16.552555+0000","last_peered":"2024-09-17T03:40:16.552555+0000","last_clean":"2024-09-17T03:40:16.552555+0000","last_became_active":"2024-09-17T03:40:15.482562+0000","last_became_peered":"2024-09-17T03:40:15.482562+0000","last_unstale":"2024-09-17T03:40:16.552555+0000","last_undegraded":"2024-09-17T03:40:16.552555+0000","last_fullsized":"2024-09-17T03:40:16.552555+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:32.079090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552207+0000","last_change":"2024-09-17T03:40:14.480944+0000","last_active":"2024-09-17T03:40:16.552207+0000","last_peered":"2024-09-17T03:40:16.552207+0000","last_clean":"2024-09-17T03:40:16.552207+0000","last_became_active":"2024-09-17T03:40:14.480631+0000","last_became_peered":"2024-09-17T03:40:14.480631+0000","last_unstale":"2024-09-17T03:40:16.552207+0000","last_undegraded":"2024-09-17T03:40:16.552207+0000","last_fullsized":"2024-09-17T03:40:16.552207+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:17.744845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552252+0000","last_change":"2024-09-17T03:40:15.486260+0000","last_active":"2024-09-17T03:40:16.552252+0000","last_peered":"2024-09-17T03:40:16.552252+0000","last_clean":"2024-09-17T03:40:16.552252+0000","last_became_active":"2024-09-17T03:40:15.485935+0000","last_became_peered":"2024-09-17T03:40:15.485935+0000","last_unstale":"2024-09-17T03:40:16.552252+0000","last_undegraded":"2024-09-17T03:40:16.552252+0000","last_fullsized":"2024-09-17T03:40:16.552252+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:08.384805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552511+0000","last_change":"2024-09-17T03:40:14.481995+0000","last_active":"2024-09-17T03:40:16.552511+0000","last_peered":"2024-09-17T03:40:16.552511+0000","last_clean":"2024-09-17T03:40:16.552511+0000","last_became_active":"2024-09-17T03:40:14.481664+0000","last_became_peered":"2024-09-17T03:40:14.481664+0000","last_unstale":"2024-09-17T03:40:16.552511+0000","last_undegraded":"2024-09-17T03:40:16.552511+0000","last_fullsized":"2024-09-17T03:40:16.552511+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:21.880772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476966+0000","last_change":"2024-09-17T03:40:15.478649+0000","last_active":"2024-09-17T03:40:16.476966+0000","last_peered":"2024-09-17T03:40:16.476966+0000","last_clean":"2024-09-17T03:40:16.476966+0000","last_became_active":"2024-09-17T03:40:15.478320+0000","last_became_peered":"2024-09-17T03:40:15.478320+0000","last_unstale":"2024-09-17T03:40:16.476966+0000","last_undegraded":"2024-09-17T03:40:16.476966+0000","last_fullsized":"2024-09-17T03:40:16.476966+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:23.907814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552304+0000","last_change":"2024-09-17T03:40:14.480486+0000","last_active":"2024-09-17T03:40:16.552304+0000","last_peered":"2024-09-17T03:40:16.552304+0000","last_clean":"2024-09-17T03:40:16.552304+0000","last_became_active":"2024-09-17T03:40:14.480219+0000","last_became_peered":"2024-09-17T03:40:14.480219+0000","last_unstale":"2024-09-17T03:40:16.552304+0000","last_undegraded":"2024-09-17T03:40:16.552304+0000","last_fullsized":"2024-09-17T03:40:16.552304+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:55.122669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552499+0000","last_change":"2024-09-17T03:40:15.492764+0000","last_active":"2024-09-17T03:40:16.552499+0000","last_peered":"2024-09-17T03:40:16.552499+0000","last_clean":"2024-09-17T03:40:16.552499+0000","last_became_active":"2024-09-17T03:40:15.490938+0000","last_became_peered":"2024-09-17T03:40:15.490938+0000","last_unstale":"2024-09-17T03:40:16.552499+0000","last_undegraded":"2024-09-17T03:40:16.552499+0000","last_fullsized":"2024-09-17T03:40:16.552499+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:45.378479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476284+0000","last_change":"2024-09-17T03:40:14.479207+0000","last_active":"2024-09-17T03:40:16.476284+0000","last_peered":"2024-09-17T03:40:16.476284+0000","last_clean":"2024-09-17T03:40:16.476284+0000","last_became_active":"2024-09-17T03:40:14.478974+0000","last_became_peered":"2024-09-17T03:40:14.478974+0000","last_unstale":"2024-09-17T03:40:16.476284+0000","last_undegraded":"2024-09-17T03:40:16.476284+0000","last_fullsized":"2024-09-17T03:40:16.476284+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:37.325086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551862+0000","last_change":"2024-09-17T03:40:15.480254+0000","last_active":"2024-09-17T03:40:16.551862+0000","last_peered":"2024-09-17T03:40:16.551862+0000","last_clean":"2024-09-17T03:40:16.551862+0000","last_became_active":"2024-09-17T03:40:15.479489+0000","last_became_peered":"2024-09-17T03:40:15.479489+0000","last_unstale":"2024-09-17T03:40:16.551862+0000","last_undegraded":"2024-09-17T03:40:16.551862+0000","last_fullsized":"2024-09-17T03:40:16.551862+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:21.795552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552805+0000","last_change":"2024-09-17T03:40:14.485088+0000","last_active":"2024-09-17T03:40:16.552805+0000","last_peered":"2024-09-17T03:40:16.552805+0000","last_clean":"2024-09-17T03:40:16.552805+0000","last_became_active":"2024-09-17T03:40:14.484700+0000","last_became_peered":"2024-09-17T03:40:14.484700+0000","last_unstale":"2024-09-17T03:40:16.552805+0000","last_undegraded":"2024-09-17T03:40:16.552805+0000","last_fullsized":"2024-09-17T03:40:16.552805+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:42.357636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553004+0000","last_change":"2024-09-17T03:40:15.481077+0000","last_active":"2024-09-17T03:40:16.553004+0000","last_peered":"2024-09-17T03:40:16.553004+0000","last_clean":"2024-09-17T03:40:16.553004+0000","last_became_active":"2024-09-17T03:40:15.480776+0000","last_became_peered":"2024-09-17T03:40:15.480776+0000","last_unstale":"2024-09-17T03:40:16.553004+0000","last_undegraded":"2024-09-17T03:40:16.553004+0000","last_fullsized":"2024-09-17T03:40:16.553004+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:41.034237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551653+0000","last_change":"2024-09-17T03:40:14.471040+0000","last_active":"2024-09-17T03:40:16.551653+0000","last_peered":"2024-09-17T03:40:16.551653+0000","last_clean":"2024-09-17T03:40:16.551653+0000","last_became_active":"2024-09-17T03:40:14.470269+0000","last_became_peered":"2024-09-17T03:40:14.470269+0000","last_unstale":"2024-09-17T03:40:16.551653+0000","last_undegraded":"2024-09-17T03:40:16.551653+0000","last_fullsized":"2024-09-17T03:40:16.551653+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:58.742393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478375+0000","last_change":"2024-09-17T03:40:15.496633+0000","last_active":"2024-09-17T03:40:16.478375+0000","last_peered":"2024-09-17T03:40:16.478375+0000","last_clean":"2024-09-17T03:40:16.478375+0000","last_became_active":"2024-09-17T03:40:15.496027+0000","last_became_peered":"2024-09-17T03:40:15.496027+0000","last_unstale":"2024-09-17T03:40:16.478375+0000","last_undegraded":"2024-09-17T03:40:16.478375+0000","last_fullsized":"2024-09-17T03:40:16.478375+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:17.187794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552017+0000","last_change":"2024-09-17T03:40:14.480083+0000","last_active":"2024-09-17T03:40:16.552017+0000","last_peered":"2024-09-17T03:40:16.552017+0000","last_clean":"2024-09-17T03:40:16.552017+0000","last_became_active":"2024-09-17T03:40:14.479815+0000","last_became_peered":"2024-09-17T03:40:14.479815+0000","last_unstale":"2024-09-17T03:40:16.552017+0000","last_undegraded":"2024-09-17T03:40:16.552017+0000","last_fullsized":"2024-09-17T03:40:16.552017+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:46.688766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552355+0000","last_change":"2024-09-17T03:40:15.474882+0000","last_active":"2024-09-17T03:40:16.552355+0000","last_peered":"2024-09-17T03:40:16.552355+0000","last_clean":"2024-09-17T03:40:16.552355+0000","last_became_active":"2024-09-17T03:40:15.474567+0000","last_became_peered":"2024-09-17T03:40:15.474567+0000","last_unstale":"2024-09-17T03:40:16.552355+0000","last_undegraded":"2024-09-17T03:40:16.552355+0000","last_fullsized":"2024-09-17T03:40:16.552355+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:48.082051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"116'3","reported_seq":18,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552848+0000","last_change":"2024-09-17T03:40:14.481321+0000","last_active":"2024-09-17T03:40:16.552848+0000","last_peered":"2024-09-17T03:40:16.552848+0000","last_clean":"2024-09-17T03:40:16.552848+0000","last_became_active":"2024-09-17T03:40:14.481045+0000","last_became_peered":"2024-09-17T03:40:14.481045+0000","last_unstale":"2024-09-17T03:40:16.552848+0000","last_undegraded":"2024-09-17T03:40:16.552848+0000","last_fullsized":"2024-09-17T03:40:16.552848+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:48.594881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553056+0000","last_change":"2024-09-17T03:40:15.485451+0000","last_active":"2024-09-17T03:40:16.553056+0000","last_peered":"2024-09-17T03:40:16.553056+0000","last_clean":"2024-09-17T03:40:16.553056+0000","last_became_active":"2024-09-17T03:40:15.485116+0000","last_became_peered":"2024-09-17T03:40:15.485116+0000","last_unstale":"2024-09-17T03:40:16.553056+0000","last_undegraded":"2024-09-17T03:40:16.553056+0000","last_fullsized":"2024-09-17T03:40:16.553056+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:48.894066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"116'6","reported_seq":21,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553198+0000","last_change":"2024-09-17T03:40:14.484915+0000","last_active":"2024-09-17T03:40:16.553198+0000","last_peered":"2024-09-17T03:40:16.553198+0000","last_clean":"2024-09-17T03:40:16.553198+0000","last_became_active":"2024-09-17T03:40:14.484594+0000","last_became_peered":"2024-09-17T03:40:14.484594+0000","last_unstale":"2024-09-17T03:40:16.553198+0000","last_undegraded":"2024-09-17T03:40:16.553198+0000","last_fullsized":"2024-09-17T03:40:16.553198+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:32.875825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552175+0000","last_change":"2024-09-17T03:40:15.488261+0000","last_active":"2024-09-17T03:40:16.552175+0000","last_peered":"2024-09-17T03:40:16.552175+0000","last_clean":"2024-09-17T03:40:16.552175+0000","last_became_active":"2024-09-17T03:40:15.487934+0000","last_became_peered":"2024-09-17T03:40:15.487934+0000","last_unstale":"2024-09-17T03:40:16.552175+0000","last_undegraded":"2024-09-17T03:40:16.552175+0000","last_fullsized":"2024-09-17T03:40:16.552175+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:02.064934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475762+0000","last_change":"2024-09-17T03:40:14.480581+0000","last_active":"2024-09-17T03:40:16.475762+0000","last_peered":"2024-09-17T03:40:16.475762+0000","last_clean":"2024-09-17T03:40:16.475762+0000","last_became_active":"2024-09-17T03:40:14.480240+0000","last_became_peered":"2024-09-17T03:40:14.480240+0000","last_unstale":"2024-09-17T03:40:16.475762+0000","last_undegraded":"2024-09-17T03:40:16.475762+0000","last_fullsized":"2024-09-17T03:40:16.475762+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:42.775504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551951+0000","last_change":"2024-09-17T03:40:15.482447+0000","last_active":"2024-09-17T03:40:16.551951+0000","last_peered":"2024-09-17T03:40:16.551951+0000","last_clean":"2024-09-17T03:40:16.551951+0000","last_became_active":"2024-09-17T03:40:15.482134+0000","last_became_peered":"2024-09-17T03:40:15.482134+0000","last_unstale":"2024-09-17T03:40:16.551951+0000","last_undegraded":"2024-09-17T03:40:16.551951+0000","last_fullsized":"2024-09-17T03:40:16.551951+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:20.940998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477872+0000","last_change":"2024-09-17T03:40:14.470150+0000","last_active":"2024-09-17T03:40:16.477872+0000","last_peered":"2024-09-17T03:40:16.477872+0000","last_clean":"2024-09-17T03:40:16.477872+0000","last_became_active":"2024-09-17T03:40:14.469836+0000","last_became_peered":"2024-09-17T03:40:14.469836+0000","last_unstale":"2024-09-17T03:40:16.477872+0000","last_undegraded":"2024-09-17T03:40:16.477872+0000","last_fullsized":"2024-09-17T03:40:16.477872+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:58.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551775+0000","last_change":"2024-09-17T03:40:15.474933+0000","last_active":"2024-09-17T03:40:16.551775+0000","last_peered":"2024-09-17T03:40:16.551775+0000","last_clean":"2024-09-17T03:40:16.551775+0000","last_became_active":"2024-09-17T03:40:15.474590+0000","last_became_peered":"2024-09-17T03:40:15.474590+0000","last_unstale":"2024-09-17T03:40:16.551775+0000","last_undegraded":"2024-09-17T03:40:16.551775+0000","last_fullsized":"2024-09-17T03:40:16.551775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:57.185460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"116'8","reported_seq":23,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551827+0000","last_change":"2024-09-17T03:40:14.475793+0000","last_active":"2024-09-17T03:40:16.551827+0000","last_peered":"2024-09-17T03:40:16.551827+0000","last_clean":"2024-09-17T03:40:16.551827+0000","last_became_active":"2024-09-17T03:40:14.475496+0000","last_became_peered":"2024-09-17T03:40:14.475496+0000","last_unstale":"2024-09-17T03:40:16.551827+0000","last_undegraded":"2024-09-17T03:40:16.551827+0000","last_fullsized":"2024-09-17T03:40:16.551827+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:20.163847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552479+0000","last_change":"2024-09-17T03:40:15.500205+0000","last_active":"2024-09-17T03:40:16.552479+0000","last_peered":"2024-09-17T03:40:16.552479+0000","last_clean":"2024-09-17T03:40:16.552479+0000","last_became_active":"2024-09-17T03:40:15.499443+0000","last_became_peered":"2024-09-17T03:40:15.499443+0000","last_unstale":"2024-09-17T03:40:16.552479+0000","last_undegraded":"2024-09-17T03:40:16.552479+0000","last_fullsized":"2024-09-17T03:40:16.552479+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:09.991996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553195+0000","last_change":"2024-09-17T03:40:14.475616+0000","last_active":"2024-09-17T03:40:16.553195+0000","last_peered":"2024-09-17T03:40:16.553195+0000","last_clean":"2024-09-17T03:40:16.553195+0000","last_became_active":"2024-09-17T03:40:14.475319+0000","last_became_peered":"2024-09-17T03:40:14.475319+0000","last_unstale":"2024-09-17T03:40:16.553195+0000","last_undegraded":"2024-09-17T03:40:16.553195+0000","last_fullsized":"2024-09-17T03:40:16.553195+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:11.080444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475980+0000","last_change":"2024-09-17T03:40:15.496594+0000","last_active":"2024-09-17T03:40:16.475980+0000","last_peered":"2024-09-17T03:40:16.475980+0000","last_clean":"2024-09-17T03:40:16.475980+0000","last_became_active":"2024-09-17T03:40:15.496263+0000","last_became_peered":"2024-09-17T03:40:15.496263+0000","last_unstale":"2024-09-17T03:40:16.475980+0000","last_undegraded":"2024-09-17T03:40:16.475980+0000","last_fullsized":"2024-09-17T03:40:16.475980+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:33.863023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552569+0000","last_change":"2024-09-17T03:40:14.474157+0000","last_active":"2024-09-17T03:40:16.552569+0000","last_peered":"2024-09-17T03:40:16.552569+0000","last_clean":"2024-09-17T03:40:16.552569+0000","last_became_active":"2024-09-17T03:40:14.473846+0000","last_became_peered":"2024-09-17T03:40:14.473846+0000","last_unstale":"2024-09-17T03:40:16.552569+0000","last_undegraded":"2024-09-17T03:40:16.552569+0000","last_fullsized":"2024-09-17T03:40:16.552569+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:29.173297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552125+0000","last_change":"2024-09-17T03:40:15.496350+0000","last_active":"2024-09-17T03:40:16.552125+0000","last_peered":"2024-09-17T03:40:16.552125+0000","last_clean":"2024-09-17T03:40:16.552125+0000","last_became_active":"2024-09-17T03:40:15.496024+0000","last_became_peered":"2024-09-17T03:40:15.496024+0000","last_unstale":"2024-09-17T03:40:16.552125+0000","last_undegraded":"2024-09-17T03:40:16.552125+0000","last_fullsized":"2024-09-17T03:40:16.552125+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:07.692190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477089+0000","last_change":"2024-09-17T03:40:14.486426+0000","last_active":"2024-09-17T03:40:16.477089+0000","last_peered":"2024-09-17T03:40:16.477089+0000","last_clean":"2024-09-17T03:40:16.477089+0000","last_became_active":"2024-09-17T03:40:14.486185+0000","last_became_peered":"2024-09-17T03:40:14.486185+0000","last_unstale":"2024-09-17T03:40:16.477089+0000","last_undegraded":"2024-09-17T03:40:16.477089+0000","last_fullsized":"2024-09-17T03:40:16.477089+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:59.582788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552791+0000","last_change":"2024-09-17T03:40:15.483973+0000","last_active":"2024-09-17T03:40:16.552791+0000","last_peered":"2024-09-17T03:40:16.552791+0000","last_clean":"2024-09-17T03:40:16.552791+0000","last_became_active":"2024-09-17T03:40:15.483145+0000","last_became_peered":"2024-09-17T03:40:15.483145+0000","last_unstale":"2024-09-17T03:40:16.552791+0000","last_undegraded":"2024-09-17T03:40:16.552791+0000","last_fullsized":"2024-09-17T03:40:16.552791+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:27.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552753+0000","last_change":"2024-09-17T03:40:14.480432+0000","last_active":"2024-09-17T03:40:16.552753+0000","last_peered":"2024-09-17T03:40:16.552753+0000","last_clean":"2024-09-17T03:40:16.552753+0000","last_became_active":"2024-09-17T03:40:14.480110+0000","last_became_peered":"2024-09-17T03:40:14.480110+0000","last_unstale":"2024-09-17T03:40:16.552753+0000","last_undegraded":"2024-09-17T03:40:16.552753+0000","last_fullsized":"2024-09-17T03:40:16.552753+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:32.719766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552127+0000","last_change":"2024-09-17T03:40:15.482488+0000","last_active":"2024-09-17T03:40:16.552127+0000","last_peered":"2024-09-17T03:40:16.552127+0000","last_clean":"2024-09-17T03:40:16.552127+0000","last_became_active":"2024-09-17T03:40:15.482132+0000","last_became_peered":"2024-09-17T03:40:15.482132+0000","last_unstale":"2024-09-17T03:40:16.552127+0000","last_undegraded":"2024-09-17T03:40:16.552127+0000","last_fullsized":"2024-09-17T03:40:16.552127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:00.988692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475789+0000","last_change":"2024-09-17T03:40:14.478399+0000","last_active":"2024-09-17T03:40:16.475789+0000","last_peered":"2024-09-17T03:40:16.475789+0000","last_clean":"2024-09-17T03:40:16.475789+0000","last_became_active":"2024-09-17T03:40:14.477797+0000","last_became_peered":"2024-09-17T03:40:14.477797+0000","last_unstale":"2024-09-17T03:40:16.475789+0000","last_undegraded":"2024-09-17T03:40:16.475789+0000","last_fullsized":"2024-09-17T03:40:16.475789+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:51.818142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552560+0000","last_change":"2024-09-17T03:40:15.485602+0000","last_active":"2024-09-17T03:40:16.552560+0000","last_peered":"2024-09-17T03:40:16.552560+0000","last_clean":"2024-09-17T03:40:16.552560+0000","last_became_active":"2024-09-17T03:40:15.485151+0000","last_became_peered":"2024-09-17T03:40:15.485151+0000","last_unstale":"2024-09-17T03:40:16.552560+0000","last_undegraded":"2024-09-17T03:40:16.552560+0000","last_fullsized":"2024-09-17T03:40:16.552560+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:03.138811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551456+0000","last_change":"2024-09-17T03:40:14.481534+0000","last_active":"2024-09-17T03:40:16.551456+0000","last_peered":"2024-09-17T03:40:16.551456+0000","last_clean":"2024-09-17T03:40:16.551456+0000","last_became_active":"2024-09-17T03:40:14.481228+0000","last_became_peered":"2024-09-17T03:40:14.481228+0000","last_unstale":"2024-09-17T03:40:16.551456+0000","last_undegraded":"2024-09-17T03:40:16.551456+0000","last_fullsized":"2024-09-17T03:40:16.551456+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:44.335281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551852+0000","last_change":"2024-09-17T03:40:15.484052+0000","last_active":"2024-09-17T03:40:16.551852+0000","last_peered":"2024-09-17T03:40:16.551852+0000","last_clean":"2024-09-17T03:40:16.551852+0000","last_became_active":"2024-09-17T03:40:15.482744+0000","last_became_peered":"2024-09-17T03:40:15.482744+0000","last_unstale":"2024-09-17T03:40:16.551852+0000","last_undegraded":"2024-09-17T03:40:16.551852+0000","last_fullsized":"2024-09-17T03:40:16.551852+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:59.432670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475820+0000","last_change":"2024-09-17T03:40:14.478288+0000","last_active":"2024-09-17T03:40:16.475820+0000","last_peered":"2024-09-17T03:40:16.475820+0000","last_clean":"2024-09-17T03:40:16.475820+0000","last_became_active":"2024-09-17T03:40:14.478005+0000","last_became_peered":"2024-09-17T03:40:14.478005+0000","last_unstale":"2024-09-17T03:40:16.475820+0000","last_undegraded":"2024-09-17T03:40:16.475820+0000","last_fullsized":"2024-09-17T03:40:16.475820+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:39.216489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551999+0000","last_change":"2024-09-17T03:40:15.497363+0000","last_active":"2024-09-17T03:40:16.551999+0000","last_peered":"2024-09-17T03:40:16.551999+0000","last_clean":"2024-09-17T03:40:16.551999+0000","last_became_active":"2024-09-17T03:40:15.495974+0000","last_became_peered":"2024-09-17T03:40:15.495974+0000","last_unstale":"2024-09-17T03:40:16.551999+0000","last_undegraded":"2024-09-17T03:40:16.551999+0000","last_fullsized":"2024-09-17T03:40:16.551999+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:36.847762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552705+0000","last_change":"2024-09-17T03:40:14.473315+0000","last_active":"2024-09-17T03:40:16.552705+0000","last_peered":"2024-09-17T03:40:16.552705+0000","last_clean":"2024-09-17T03:40:16.552705+0000","last_became_active":"2024-09-17T03:40:14.472752+0000","last_became_peered":"2024-09-17T03:40:14.472752+0000","last_unstale":"2024-09-17T03:40:16.552705+0000","last_undegraded":"2024-09-17T03:40:16.552705+0000","last_fullsized":"2024-09-17T03:40:16.552705+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.347183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478161+0000","last_change":"2024-09-17T03:40:15.496606+0000","last_active":"2024-09-17T03:40:16.478161+0000","last_peered":"2024-09-17T03:40:16.478161+0000","last_clean":"2024-09-17T03:40:16.478161+0000","last_became_active":"2024-09-17T03:40:15.496039+0000","last_became_peered":"2024-09-17T03:40:15.496039+0000","last_unstale":"2024-09-17T03:40:16.478161+0000","last_undegraded":"2024-09-17T03:40:16.478161+0000","last_fullsized":"2024-09-17T03:40:16.478161+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:13.783841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551565+0000","last_change":"2024-09-17T03:40:14.485645+0000","last_active":"2024-09-17T03:40:16.551565+0000","last_peered":"2024-09-17T03:40:16.551565+0000","last_clean":"2024-09-17T03:40:16.551565+0000","last_became_active":"2024-09-17T03:40:14.483559+0000","last_became_peered":"2024-09-17T03:40:14.483559+0000","last_unstale":"2024-09-17T03:40:16.551565+0000","last_undegraded":"2024-09-17T03:40:16.551565+0000","last_fullsized":"2024-09-17T03:40:16.551565+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:28.380087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553025+0000","last_change":"2024-09-17T03:40:15.495051+0000","last_active":"2024-09-17T03:40:16.553025+0000","last_peered":"2024-09-17T03:40:16.553025+0000","last_clean":"2024-09-17T03:40:16.553025+0000","last_became_active":"2024-09-17T03:40:15.494741+0000","last_became_peered":"2024-09-17T03:40:15.494741+0000","last_unstale":"2024-09-17T03:40:16.553025+0000","last_undegraded":"2024-09-17T03:40:16.553025+0000","last_fullsized":"2024-09-17T03:40:16.553025+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:19.888917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"117'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478149+0000","last_change":"2024-09-17T03:40:14.473982+0000","last_active":"2024-09-17T03:40:16.478149+0000","last_peered":"2024-09-17T03:40:16.478149+0000","last_clean":"2024-09-17T03:40:16.478149+0000","last_became_active":"2024-09-17T03:40:14.473658+0000","last_became_peered":"2024-09-17T03:40:14.473658+0000","last_unstale":"2024-09-17T03:40:16.478149+0000","last_undegraded":"2024-09-17T03:40:16.478149+0000","last_fullsized":"2024-09-17T03:40:16.478149+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:28.613912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553230+0000","last_change":"2024-09-17T03:40:15.492445+0000","last_active":"2024-09-17T03:40:16.553230+0000","last_peered":"2024-09-17T03:40:16.553230+0000","last_clean":"2024-09-17T03:40:16.553230+0000","last_became_active":"2024-09-17T03:40:15.492138+0000","last_became_peered":"2024-09-17T03:40:15.492138+0000","last_unstale":"2024-09-17T03:40:16.553230+0000","last_undegraded":"2024-09-17T03:40:16.553230+0000","last_fullsized":"2024-09-17T03:40:16.553230+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:23.192448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552984+0000","last_change":"2024-09-17T03:40:14.472535+0000","last_active":"2024-09-17T03:40:16.552984+0000","last_peered":"2024-09-17T03:40:16.552984+0000","last_clean":"2024-09-17T03:40:16.552984+0000","last_became_active":"2024-09-17T03:40:14.472200+0000","last_became_peered":"2024-09-17T03:40:14.472200+0000","last_unstale":"2024-09-17T03:40:16.552984+0000","last_undegraded":"2024-09-17T03:40:16.552984+0000","last_fullsized":"2024-09-17T03:40:16.552984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:16.215936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476897+0000","last_change":"2024-09-17T03:40:15.496223+0000","last_active":"2024-09-17T03:40:16.476897+0000","last_peered":"2024-09-17T03:40:16.476897+0000","last_clean":"2024-09-17T03:40:16.476897+0000","last_became_active":"2024-09-17T03:40:15.495895+0000","last_became_peered":"2024-09-17T03:40:15.495895+0000","last_unstale":"2024-09-17T03:40:16.476897+0000","last_undegraded":"2024-09-17T03:40:16.476897+0000","last_fullsized":"2024-09-17T03:40:16.476897+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:08.136133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552423+0000","last_change":"2024-09-17T03:40:14.483507+0000","last_active":"2024-09-17T03:40:16.552423+0000","last_peered":"2024-09-17T03:40:16.552423+0000","last_clean":"2024-09-17T03:40:16.552423+0000","last_became_active":"2024-09-17T03:40:14.483198+0000","last_became_peered":"2024-09-17T03:40:14.483198+0000","last_unstale":"2024-09-17T03:40:16.552423+0000","last_undegraded":"2024-09-17T03:40:16.552423+0000","last_fullsized":"2024-09-17T03:40:16.552423+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:27.505809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476391+0000","last_change":"2024-09-17T03:40:15.481516+0000","last_active":"2024-09-17T03:40:16.476391+0000","last_peered":"2024-09-17T03:40:16.476391+0000","last_clean":"2024-09-17T03:40:16.476391+0000","last_became_active":"2024-09-17T03:40:15.481100+0000","last_became_peered":"2024-09-17T03:40:15.481100+0000","last_unstale":"2024-09-17T03:40:16.476391+0000","last_undegraded":"2024-09-17T03:40:16.476391+0000","last_fullsized":"2024-09-17T03:40:16.476391+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:49.910297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552671+0000","last_change":"2024-09-17T03:40:14.475085+0000","last_active":"2024-09-17T03:40:16.552671+0000","last_peered":"2024-09-17T03:40:16.552671+0000","last_clean":"2024-09-17T03:40:16.552671+0000","last_became_active":"2024-09-17T03:40:14.474642+0000","last_became_peered":"2024-09-17T03:40:14.474642+0000","last_unstale":"2024-09-17T03:40:16.552671+0000","last_undegraded":"2024-09-17T03:40:16.552671+0000","last_fullsized":"2024-09-17T03:40:16.552671+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:07.438425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477319+0000","last_change":"2024-09-17T03:40:15.472755+0000","last_active":"2024-09-17T03:40:16.477319+0000","last_peered":"2024-09-17T03:40:16.477319+0000","last_clean":"2024-09-17T03:40:16.477319+0000","last_became_active":"2024-09-17T03:40:15.472437+0000","last_became_peered":"2024-09-17T03:40:15.472437+0000","last_unstale":"2024-09-17T03:40:16.477319+0000","last_undegraded":"2024-09-17T03:40:16.477319+0000","last_fullsized":"2024-09-17T03:40:16.477319+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:44.143632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476452+0000","last_change":"2024-09-17T03:40:14.480911+0000","last_active":"2024-09-17T03:40:16.476452+0000","last_peered":"2024-09-17T03:40:16.476452+0000","last_clean":"2024-09-17T03:40:16.476452+0000","last_became_active":"2024-09-17T03:40:14.480499+0000","last_became_peered":"2024-09-17T03:40:14.480499+0000","last_unstale":"2024-09-17T03:40:16.476452+0000","last_undegraded":"2024-09-17T03:40:16.476452+0000","last_fullsized":"2024-09-17T03:40:16.476452+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:04.911626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552172+0000","last_change":"2024-09-17T03:40:15.484106+0000","last_active":"2024-09-17T03:40:16.552172+0000","last_peered":"2024-09-17T03:40:16.552172+0000","last_clean":"2024-09-17T03:40:16.552172+0000","last_became_active":"2024-09-17T03:40:15.483402+0000","last_became_peered":"2024-09-17T03:40:15.483402+0000","last_unstale":"2024-09-17T03:40:16.552172+0000","last_undegraded":"2024-09-17T03:40:16.552172+0000","last_fullsized":"2024-09-17T03:40:16.552172+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:15.968927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551582+0000","last_change":"2024-09-17T03:40:14.472140+0000","last_active":"2024-09-17T03:40:16.551582+0000","last_peered":"2024-09-17T03:40:16.551582+0000","last_clean":"2024-09-17T03:40:16.551582+0000","last_became_active":"2024-09-17T03:40:14.471857+0000","last_became_peered":"2024-09-17T03:40:14.471857+0000","last_unstale":"2024-09-17T03:40:16.551582+0000","last_undegraded":"2024-09-17T03:40:16.551582+0000","last_fullsized":"2024-09-17T03:40:16.551582+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:53.540753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552005+0000","last_change":"2024-09-17T03:40:15.491609+0000","last_active":"2024-09-17T03:40:16.552005+0000","last_peered":"2024-09-17T03:40:16.552005+0000","last_clean":"2024-09-17T03:40:16.552005+0000","last_became_active":"2024-09-17T03:40:15.491296+0000","last_became_peered":"2024-09-17T03:40:15.491296+0000","last_unstale":"2024-09-17T03:40:16.552005+0000","last_undegraded":"2024-09-17T03:40:16.552005+0000","last_fullsized":"2024-09-17T03:40:16.552005+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:46.783619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552876+0000","last_change":"2024-09-17T03:40:14.473025+0000","last_active":"2024-09-17T03:40:16.552876+0000","last_peered":"2024-09-17T03:40:16.552876+0000","last_clean":"2024-09-17T03:40:16.552876+0000","last_became_active":"2024-09-17T03:40:14.472373+0000","last_became_peered":"2024-09-17T03:40:14.472373+0000","last_unstale":"2024-09-17T03:40:16.552876+0000","last_undegraded":"2024-09-17T03:40:16.552876+0000","last_fullsized":"2024-09-17T03:40:16.552876+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:06.642837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551907+0000","last_change":"2024-09-17T03:40:15.483370+0000","last_active":"2024-09-17T03:40:16.551907+0000","last_peered":"2024-09-17T03:40:16.551907+0000","last_clean":"2024-09-17T03:40:16.551907+0000","last_became_active":"2024-09-17T03:40:15.483063+0000","last_became_peered":"2024-09-17T03:40:15.483063+0000","last_unstale":"2024-09-17T03:40:16.551907+0000","last_undegraded":"2024-09-17T03:40:16.551907+0000","last_fullsized":"2024-09-17T03:40:16.551907+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:53.510707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552003+0000","last_change":"2024-09-17T03:40:14.482698+0000","last_active":"2024-09-17T03:40:16.552003+0000","last_peered":"2024-09-17T03:40:16.552003+0000","last_clean":"2024-09-17T03:40:16.552003+0000","last_became_active":"2024-09-17T03:40:14.482376+0000","last_became_peered":"2024-09-17T03:40:14.482376+0000","last_unstale":"2024-09-17T03:40:16.552003+0000","last_undegraded":"2024-09-17T03:40:16.552003+0000","last_fullsized":"2024-09-17T03:40:16.552003+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:16.596119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":287,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552761+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:40:16.552761+0000","last_peered":"2024-09-17T03:40:16.552761+0000","last_clean":"2024-09-17T03:40:16.552761+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:40:16.552761+0000","last_undegraded":"2024-09-17T03:40:16.552761+0000","last_fullsized":"2024-09-17T03:40:16.552761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509534,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2048000,"data_stored":1222890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40434123},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46500,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325340,"statfs":{"total":96636764160,"available":96589148160,"internally_reserved":0,"allocated":1449984,"data_stored":631976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50656,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321184,"statfs":{"total":96636764160,"available":96584892416,"internally_reserved":0,"allocated":1445888,"data_stored":631906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509534,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46488,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325352,"statfs":{"total":96636764160,"available":96589160448,"internally_reserved":0,"allocated":1445888,"data_stored":631906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50656,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321184,"statfs":{"total":96636764160,"available":96584892416,"internally_reserved":0,"allocated":1454080,"data_stored":632030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509535,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45680,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326160,"statfs":{"total":96636764160,"available":96589987840,"internally_reserved":0,"allocated":2060288,"data_stored":1223998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574941,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28452,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343388,"statfs":{"total":96636764160,"available":96607629312,"internally_reserved":0,"allocated":1454080,"data_stored":632510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574941,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46508,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325332,"statfs":{"total":96636764160,"available":96589139968,"internally_reserved":0,"allocated":1462272,"data_stored":633588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:21.428 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-09-17T03:40:21.428+0000 7f364e320640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:40:23.951 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:40:24.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.078+0000 7ffb85ec5640 1 -- 172.21.15.146:0/1393219696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8015b770 msgr2=0x7ffb8006fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.078+0000 7ffb85ec5640 1 --2- 172.21.15.146:0/1393219696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8015b770 0x7ffb8006fe10 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7ffb800cfe20 tx=0x7ffb7002aa30 comp rx=0 tx=0).stop 2024-09-17T03:40:24.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.078+0000 7ffb85ec5640 1 -- 172.21.15.146:0/1393219696 shutdown_connections 2024-09-17T03:40:24.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.078+0000 7ffb85ec5640 1 --2- 172.21.15.146:0/1393219696 >> v2:172.21.15.179:3300/0 conn(0x7ffb80072d90 0x7ffb800b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.078+0000 7ffb85ec5640 1 --2- 172.21.15.146:0/1393219696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8015b770 0x7ffb8006fe10 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.078+0000 7ffb85ec5640 1 -- 172.21.15.146:0/1393219696 >> 172.21.15.146:0/1393219696 conn(0x7ffb800b2060 msgr2=0x7ffb800b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:24.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.078+0000 7ffb85ec5640 1 -- 172.21.15.146:0/1393219696 shutdown_connections 2024-09-17T03:40:24.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.078+0000 7ffb85ec5640 1 -- 172.21.15.146:0/1393219696 wait complete. 2024-09-17T03:40:24.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.079+0000 7ffb85ec5640 1 Processor -- start 2024-09-17T03:40:24.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.080+0000 7ffb85ec5640 1 -- start start 2024-09-17T03:40:24.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb85ec5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb80070350 0x7ffb8015e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb85ec5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8015b770 0x7ffb80142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb85ec5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb801f68f0 0x7ffb801f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb85ec5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffb800b4db0 con 0x7ffb8015b770 2024-09-17T03:40:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb85ec5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffb800b4c30 con 0x7ffb801f68f0 2024-09-17T03:40:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb85ec5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffb800b4f30 con 0x7ffb80070350 2024-09-17T03:40:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb7effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8015b770 0x7ffb80142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb7effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8015b770 0x7ffb80142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53528/0 (socket says 172.21.15.146:53528) 2024-09-17T03:40:24.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb7effd640 1 -- 172.21.15.146:0/4236744080 learned_addr learned my addr 172.21.15.146:0/4236744080 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb7ffff640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb801f68f0 0x7ffb801f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb7f7fe640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb80070350 0x7ffb8015e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb7effd640 1 -- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb80070350 msgr2=0x7ffb8015e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb7effd640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb80070350 0x7ffb8015e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb7effd640 1 -- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb801f68f0 msgr2=0x7ffb801f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb7effd640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb801f68f0 0x7ffb801f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.081+0000 7ffb7effd640 1 -- 172.21.15.146:0/4236744080 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb801e61e0 con 0x7ffb8015b770 2024-09-17T03:40:24.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.082+0000 7ffb7effd640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8015b770 0x7ffb80142690 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7ffb74001eb0 tx=0x7ffb7400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.082+0000 7ffb67fff640 1 -- 172.21.15.146:0/4236744080 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74017070 con 0x7ffb8015b770 2024-09-17T03:40:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.082+0000 7ffb67fff640 1 -- 172.21.15.146:0/4236744080 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb740035f0 con 0x7ffb8015b770 2024-09-17T03:40:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.082+0000 7ffb85ec5640 1 -- 172.21.15.146:0/4236744080 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb801e64a0 con 0x7ffb8015b770 2024-09-17T03:40:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.082+0000 7ffb67fff640 1 -- 172.21.15.146:0/4236744080 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74003a00 con 0x7ffb8015b770 2024-09-17T03:40:24.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.082+0000 7ffb85ec5640 1 -- 172.21.15.146:0/4236744080 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb8015d510 con 0x7ffb8015b770 2024-09-17T03:40:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.083+0000 7ffb85ec5640 1 -- 172.21.15.146:0/4236744080 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb8015bd60 con 0x7ffb8015b770 2024-09-17T03:40:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.084+0000 7ffb67fff640 1 -- 172.21.15.146:0/4236744080 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb7401a070 con 0x7ffb8015b770 2024-09-17T03:40:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.084+0000 7ffb67fff640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb6c078b90 0x7ffb6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.085+0000 7ffb67fff640 1 -- 172.21.15.146:0/4236744080 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7ffb74099fb0 con 0x7ffb8015b770 2024-09-17T03:40:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.085+0000 7ffb7f7fe640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb6c078b90 0x7ffb6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.085+0000 7ffb7f7fe640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb6c078b90 0x7ffb6c07b0a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffb70035000 tx=0x7ffb70004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:24.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.089+0000 7ffb67fff640 1 -- 172.21.15.146:0/4236744080 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffb8015bb80 con 0x7ffb8015b770 2024-09-17T03:40:24.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.260+0000 7ffb85ec5640 1 -- 172.21.15.146:0/4236744080 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb801e6670 con 0x7ffb6c078b90 2024-09-17T03:40:24.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.265+0000 7ffb67fff640 1 -- 172.21.15.146:0/4236744080 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252448 (secure 0 0 0) 0x7ffb70003970 con 0x7ffb6c078b90 2024-09-17T03:40:24.267 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:24.268 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:40:24.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 -- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb6c078b90 msgr2=0x7ffb6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb6c078b90 0x7ffb6c07b0a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffb70035000 tx=0x7ffb70004ab0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 -- 172.21.15.146:0/4236744080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8015b770 msgr2=0x7ffb80142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8015b770 0x7ffb80142690 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7ffb74001eb0 tx=0x7ffb7400c820 comp rx=0 tx=0).stop 2024-09-17T03:40:24.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 -- 172.21.15.146:0/4236744080 shutdown_connections 2024-09-17T03:40:24.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb6c078b90 0x7ffb6c07b0a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb801f68f0 0x7ffb801f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb8015b770 0x7ffb80142690 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 --2- 172.21.15.146:0/4236744080 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb80070350 0x7ffb8015e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 -- 172.21.15.146:0/4236744080 >> 172.21.15.146:0/4236744080 conn(0x7ffb800b2060 msgr2=0x7ffb800b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:24.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 -- 172.21.15.146:0/4236744080 shutdown_connections 2024-09-17T03:40:24.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.268+0000 7ffb85ec5640 1 -- 172.21.15.146:0/4236744080 wait complete. 2024-09-17T03:40:24.279 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-17T03:40:23.908974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":356456,"kb_used_data":12520,"kb_used_omap":12,"kb_used_meta":343731,"kb_avail":754618264,"statfs":{"total":773094113280,"available":772729102336,"internally_reserved":0,"allocated":12820480,"data_stored":6240804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":351981105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.447195"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552785+0000","last_change":"2024-09-17T03:40:15.497016+0000","last_active":"2024-09-17T03:40:16.552785+0000","last_peered":"2024-09-17T03:40:16.552785+0000","last_clean":"2024-09-17T03:40:16.552785+0000","last_became_active":"2024-09-17T03:40:15.496378+0000","last_became_peered":"2024-09-17T03:40:15.496378+0000","last_unstale":"2024-09-17T03:40:16.552785+0000","last_undegraded":"2024-09-17T03:40:16.552785+0000","last_fullsized":"2024-09-17T03:40:16.552785+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:37.698708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476763+0000","last_change":"2024-09-17T03:40:15.471970+0000","last_active":"2024-09-17T03:40:16.476763+0000","last_peered":"2024-09-17T03:40:16.476763+0000","last_clean":"2024-09-17T03:40:16.476763+0000","last_became_active":"2024-09-17T03:40:15.471657+0000","last_became_peered":"2024-09-17T03:40:15.471657+0000","last_unstale":"2024-09-17T03:40:16.476763+0000","last_undegraded":"2024-09-17T03:40:16.476763+0000","last_fullsized":"2024-09-17T03:40:16.476763+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:43.359671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552234+0000","last_change":"2024-09-17T03:40:15.482150+0000","last_active":"2024-09-17T03:40:16.552234+0000","last_peered":"2024-09-17T03:40:16.552234+0000","last_clean":"2024-09-17T03:40:16.552234+0000","last_became_active":"2024-09-17T03:40:15.481828+0000","last_became_peered":"2024-09-17T03:40:15.481828+0000","last_unstale":"2024-09-17T03:40:16.552234+0000","last_undegraded":"2024-09-17T03:40:16.552234+0000","last_fullsized":"2024-09-17T03:40:16.552234+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:56.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552918+0000","last_change":"2024-09-17T03:40:15.495282+0000","last_active":"2024-09-17T03:40:16.552918+0000","last_peered":"2024-09-17T03:40:16.552918+0000","last_clean":"2024-09-17T03:40:16.552918+0000","last_became_active":"2024-09-17T03:40:15.494916+0000","last_became_peered":"2024-09-17T03:40:15.494916+0000","last_unstale":"2024-09-17T03:40:16.552918+0000","last_undegraded":"2024-09-17T03:40:16.552918+0000","last_fullsized":"2024-09-17T03:40:16.552918+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:17.643266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552250+0000","last_change":"2024-09-17T03:40:15.475218+0000","last_active":"2024-09-17T03:40:16.552250+0000","last_peered":"2024-09-17T03:40:16.552250+0000","last_clean":"2024-09-17T03:40:16.552250+0000","last_became_active":"2024-09-17T03:40:15.474586+0000","last_became_peered":"2024-09-17T03:40:15.474586+0000","last_unstale":"2024-09-17T03:40:16.552250+0000","last_undegraded":"2024-09-17T03:40:16.552250+0000","last_fullsized":"2024-09-17T03:40:16.552250+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:34.290950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475605+0000","last_change":"2024-09-17T03:40:15.476554+0000","last_active":"2024-09-17T03:40:16.475605+0000","last_peered":"2024-09-17T03:40:16.475605+0000","last_clean":"2024-09-17T03:40:16.475605+0000","last_became_active":"2024-09-17T03:40:15.476209+0000","last_became_peered":"2024-09-17T03:40:15.476209+0000","last_unstale":"2024-09-17T03:40:16.475605+0000","last_undegraded":"2024-09-17T03:40:16.475605+0000","last_fullsized":"2024-09-17T03:40:16.475605+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:40.711541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551912+0000","last_change":"2024-09-17T03:40:15.479882+0000","last_active":"2024-09-17T03:40:16.551912+0000","last_peered":"2024-09-17T03:40:16.551912+0000","last_clean":"2024-09-17T03:40:16.551912+0000","last_became_active":"2024-09-17T03:40:15.479041+0000","last_became_peered":"2024-09-17T03:40:15.479041+0000","last_unstale":"2024-09-17T03:40:16.551912+0000","last_undegraded":"2024-09-17T03:40:16.551912+0000","last_fullsized":"2024-09-17T03:40:16.551912+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:31.468455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551777+0000","last_change":"2024-09-17T03:40:15.483743+0000","last_active":"2024-09-17T03:40:16.551777+0000","last_peered":"2024-09-17T03:40:16.551777+0000","last_clean":"2024-09-17T03:40:16.551777+0000","last_became_active":"2024-09-17T03:40:15.482551+0000","last_became_peered":"2024-09-17T03:40:15.482551+0000","last_unstale":"2024-09-17T03:40:16.551777+0000","last_undegraded":"2024-09-17T03:40:16.551777+0000","last_fullsized":"2024-09-17T03:40:16.551777+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:11.954766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552922+0000","last_change":"2024-09-17T03:40:15.496204+0000","last_active":"2024-09-17T03:40:16.552922+0000","last_peered":"2024-09-17T03:40:16.552922+0000","last_clean":"2024-09-17T03:40:16.552922+0000","last_became_active":"2024-09-17T03:40:15.495775+0000","last_became_peered":"2024-09-17T03:40:15.495775+0000","last_unstale":"2024-09-17T03:40:16.552922+0000","last_undegraded":"2024-09-17T03:40:16.552922+0000","last_fullsized":"2024-09-17T03:40:16.552922+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:02.933118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553100+0000","last_change":"2024-09-17T03:40:15.496321+0000","last_active":"2024-09-17T03:40:16.553100+0000","last_peered":"2024-09-17T03:40:16.553100+0000","last_clean":"2024-09-17T03:40:16.553100+0000","last_became_active":"2024-09-17T03:40:15.495406+0000","last_became_peered":"2024-09-17T03:40:15.495406+0000","last_unstale":"2024-09-17T03:40:16.553100+0000","last_undegraded":"2024-09-17T03:40:16.553100+0000","last_fullsized":"2024-09-17T03:40:16.553100+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:46.298994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476823+0000","last_change":"2024-09-17T03:40:15.470662+0000","last_active":"2024-09-17T03:40:16.476823+0000","last_peered":"2024-09-17T03:40:16.476823+0000","last_clean":"2024-09-17T03:40:16.476823+0000","last_became_active":"2024-09-17T03:40:15.470333+0000","last_became_peered":"2024-09-17T03:40:15.470333+0000","last_unstale":"2024-09-17T03:40:16.476823+0000","last_undegraded":"2024-09-17T03:40:16.476823+0000","last_fullsized":"2024-09-17T03:40:16.476823+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:59.432670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553004+0000","last_change":"2024-09-17T03:40:15.497895+0000","last_active":"2024-09-17T03:40:16.553004+0000","last_peered":"2024-09-17T03:40:16.553004+0000","last_clean":"2024-09-17T03:40:16.553004+0000","last_became_active":"2024-09-17T03:40:15.495567+0000","last_became_peered":"2024-09-17T03:40:15.495567+0000","last_unstale":"2024-09-17T03:40:16.553004+0000","last_undegraded":"2024-09-17T03:40:16.553004+0000","last_fullsized":"2024-09-17T03:40:16.553004+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:01.849474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552762+0000","last_change":"2024-09-17T03:40:15.482010+0000","last_active":"2024-09-17T03:40:16.552762+0000","last_peered":"2024-09-17T03:40:16.552762+0000","last_clean":"2024-09-17T03:40:16.552762+0000","last_became_active":"2024-09-17T03:40:15.481624+0000","last_became_peered":"2024-09-17T03:40:15.481624+0000","last_unstale":"2024-09-17T03:40:16.552762+0000","last_undegraded":"2024-09-17T03:40:16.552762+0000","last_fullsized":"2024-09-17T03:40:16.552762+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:29.432451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551828+0000","last_change":"2024-09-17T03:40:15.481964+0000","last_active":"2024-09-17T03:40:16.551828+0000","last_peered":"2024-09-17T03:40:16.551828+0000","last_clean":"2024-09-17T03:40:16.551828+0000","last_became_active":"2024-09-17T03:40:15.481637+0000","last_became_peered":"2024-09-17T03:40:15.481637+0000","last_unstale":"2024-09-17T03:40:16.551828+0000","last_undegraded":"2024-09-17T03:40:16.551828+0000","last_fullsized":"2024-09-17T03:40:16.551828+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:03.349218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475614+0000","last_change":"2024-09-17T03:40:15.476228+0000","last_active":"2024-09-17T03:40:16.475614+0000","last_peered":"2024-09-17T03:40:16.475614+0000","last_clean":"2024-09-17T03:40:16.475614+0000","last_became_active":"2024-09-17T03:40:15.475923+0000","last_became_peered":"2024-09-17T03:40:15.475923+0000","last_unstale":"2024-09-17T03:40:16.475614+0000","last_undegraded":"2024-09-17T03:40:16.475614+0000","last_fullsized":"2024-09-17T03:40:16.475614+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:37.778905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552446+0000","last_change":"2024-09-17T03:40:15.487172+0000","last_active":"2024-09-17T03:40:16.552446+0000","last_peered":"2024-09-17T03:40:16.552446+0000","last_clean":"2024-09-17T03:40:16.552446+0000","last_became_active":"2024-09-17T03:40:15.486843+0000","last_became_peered":"2024-09-17T03:40:15.486843+0000","last_unstale":"2024-09-17T03:40:16.552446+0000","last_undegraded":"2024-09-17T03:40:16.552446+0000","last_fullsized":"2024-09-17T03:40:16.552446+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:35.230466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477078+0000","last_change":"2024-09-17T03:40:15.471388+0000","last_active":"2024-09-17T03:40:16.477078+0000","last_peered":"2024-09-17T03:40:16.477078+0000","last_clean":"2024-09-17T03:40:16.477078+0000","last_became_active":"2024-09-17T03:40:15.470136+0000","last_became_peered":"2024-09-17T03:40:15.470136+0000","last_unstale":"2024-09-17T03:40:16.477078+0000","last_undegraded":"2024-09-17T03:40:16.477078+0000","last_fullsized":"2024-09-17T03:40:16.477078+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:32.381586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476433+0000","last_change":"2024-09-17T03:40:15.474023+0000","last_active":"2024-09-17T03:40:16.476433+0000","last_peered":"2024-09-17T03:40:16.476433+0000","last_clean":"2024-09-17T03:40:16.476433+0000","last_became_active":"2024-09-17T03:40:15.473072+0000","last_became_peered":"2024-09-17T03:40:15.473072+0000","last_unstale":"2024-09-17T03:40:16.476433+0000","last_undegraded":"2024-09-17T03:40:16.476433+0000","last_fullsized":"2024-09-17T03:40:16.476433+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:13.319000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552518+0000","last_change":"2024-09-17T03:40:15.484636+0000","last_active":"2024-09-17T03:40:16.552518+0000","last_peered":"2024-09-17T03:40:16.552518+0000","last_clean":"2024-09-17T03:40:16.552518+0000","last_became_active":"2024-09-17T03:40:15.482975+0000","last_became_peered":"2024-09-17T03:40:15.482975+0000","last_unstale":"2024-09-17T03:40:16.552518+0000","last_undegraded":"2024-09-17T03:40:16.552518+0000","last_fullsized":"2024-09-17T03:40:16.552518+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:04.977186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477160+0000","last_change":"2024-09-17T03:40:15.482147+0000","last_active":"2024-09-17T03:40:16.477160+0000","last_peered":"2024-09-17T03:40:16.477160+0000","last_clean":"2024-09-17T03:40:16.477160+0000","last_became_active":"2024-09-17T03:40:15.481833+0000","last_became_peered":"2024-09-17T03:40:15.481833+0000","last_unstale":"2024-09-17T03:40:16.477160+0000","last_undegraded":"2024-09-17T03:40:16.477160+0000","last_fullsized":"2024-09-17T03:40:16.477160+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:49.596916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477556+0000","last_change":"2024-09-17T03:40:15.468981+0000","last_active":"2024-09-17T03:40:16.477556+0000","last_peered":"2024-09-17T03:40:16.477556+0000","last_clean":"2024-09-17T03:40:16.477556+0000","last_became_active":"2024-09-17T03:40:15.467938+0000","last_became_peered":"2024-09-17T03:40:15.467938+0000","last_unstale":"2024-09-17T03:40:16.477556+0000","last_undegraded":"2024-09-17T03:40:16.477556+0000","last_fullsized":"2024-09-17T03:40:16.477556+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:07.644872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551935+0000","last_change":"2024-09-17T03:40:15.470210+0000","last_active":"2024-09-17T03:40:16.551935+0000","last_peered":"2024-09-17T03:40:16.551935+0000","last_clean":"2024-09-17T03:40:16.551935+0000","last_became_active":"2024-09-17T03:40:15.469093+0000","last_became_peered":"2024-09-17T03:40:15.469093+0000","last_unstale":"2024-09-17T03:40:16.551935+0000","last_undegraded":"2024-09-17T03:40:16.551935+0000","last_fullsized":"2024-09-17T03:40:16.551935+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:35.551590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476232+0000","last_change":"2024-09-17T03:40:15.481291+0000","last_active":"2024-09-17T03:40:16.476232+0000","last_peered":"2024-09-17T03:40:16.476232+0000","last_clean":"2024-09-17T03:40:16.476232+0000","last_became_active":"2024-09-17T03:40:15.480790+0000","last_became_peered":"2024-09-17T03:40:15.480790+0000","last_unstale":"2024-09-17T03:40:16.476232+0000","last_undegraded":"2024-09-17T03:40:16.476232+0000","last_fullsized":"2024-09-17T03:40:16.476232+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:23.236029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551653+0000","last_change":"2024-09-17T03:40:15.484372+0000","last_active":"2024-09-17T03:40:16.551653+0000","last_peered":"2024-09-17T03:40:16.551653+0000","last_clean":"2024-09-17T03:40:16.551653+0000","last_became_active":"2024-09-17T03:40:15.484026+0000","last_became_peered":"2024-09-17T03:40:15.484026+0000","last_unstale":"2024-09-17T03:40:16.551653+0000","last_undegraded":"2024-09-17T03:40:16.551653+0000","last_fullsized":"2024-09-17T03:40:16.551653+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:31.193826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477240+0000","last_change":"2024-09-17T03:40:15.469694+0000","last_active":"2024-09-17T03:40:16.477240+0000","last_peered":"2024-09-17T03:40:16.477240+0000","last_clean":"2024-09-17T03:40:16.477240+0000","last_became_active":"2024-09-17T03:40:15.469377+0000","last_became_peered":"2024-09-17T03:40:15.469377+0000","last_unstale":"2024-09-17T03:40:16.477240+0000","last_undegraded":"2024-09-17T03:40:16.477240+0000","last_fullsized":"2024-09-17T03:40:16.477240+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:17.217971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553115+0000","last_change":"2024-09-17T03:40:15.494804+0000","last_active":"2024-09-17T03:40:16.553115+0000","last_peered":"2024-09-17T03:40:16.553115+0000","last_clean":"2024-09-17T03:40:16.553115+0000","last_became_active":"2024-09-17T03:40:15.494455+0000","last_became_peered":"2024-09-17T03:40:15.494455+0000","last_unstale":"2024-09-17T03:40:16.553115+0000","last_undegraded":"2024-09-17T03:40:16.553115+0000","last_fullsized":"2024-09-17T03:40:16.553115+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:49.736642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476020+0000","last_change":"2024-09-17T03:40:15.497449+0000","last_active":"2024-09-17T03:40:16.476020+0000","last_peered":"2024-09-17T03:40:16.476020+0000","last_clean":"2024-09-17T03:40:16.476020+0000","last_became_active":"2024-09-17T03:40:15.496364+0000","last_became_peered":"2024-09-17T03:40:15.496364+0000","last_unstale":"2024-09-17T03:40:16.476020+0000","last_undegraded":"2024-09-17T03:40:16.476020+0000","last_fullsized":"2024-09-17T03:40:16.476020+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:59.627991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552236+0000","last_change":"2024-09-17T03:40:15.494642+0000","last_active":"2024-09-17T03:40:16.552236+0000","last_peered":"2024-09-17T03:40:16.552236+0000","last_clean":"2024-09-17T03:40:16.552236+0000","last_became_active":"2024-09-17T03:40:15.494266+0000","last_became_peered":"2024-09-17T03:40:15.494266+0000","last_unstale":"2024-09-17T03:40:16.552236+0000","last_undegraded":"2024-09-17T03:40:16.552236+0000","last_fullsized":"2024-09-17T03:40:16.552236+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:13.272105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476604+0000","last_change":"2024-09-17T03:40:15.479298+0000","last_active":"2024-09-17T03:40:16.476604+0000","last_peered":"2024-09-17T03:40:16.476604+0000","last_clean":"2024-09-17T03:40:16.476604+0000","last_became_active":"2024-09-17T03:40:15.478964+0000","last_became_peered":"2024-09-17T03:40:15.478964+0000","last_unstale":"2024-09-17T03:40:16.476604+0000","last_undegraded":"2024-09-17T03:40:16.476604+0000","last_fullsized":"2024-09-17T03:40:16.476604+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:25.727689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552939+0000","last_change":"2024-09-17T03:40:15.489604+0000","last_active":"2024-09-17T03:40:16.552939+0000","last_peered":"2024-09-17T03:40:16.552939+0000","last_clean":"2024-09-17T03:40:16.552939+0000","last_became_active":"2024-09-17T03:40:15.489302+0000","last_became_peered":"2024-09-17T03:40:15.489302+0000","last_unstale":"2024-09-17T03:40:16.552939+0000","last_undegraded":"2024-09-17T03:40:16.552939+0000","last_fullsized":"2024-09-17T03:40:16.552939+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:51.069041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551769+0000","last_change":"2024-09-17T03:40:15.485199+0000","last_active":"2024-09-17T03:40:16.551769+0000","last_peered":"2024-09-17T03:40:16.551769+0000","last_clean":"2024-09-17T03:40:16.551769+0000","last_became_active":"2024-09-17T03:40:15.484863+0000","last_became_peered":"2024-09-17T03:40:15.484863+0000","last_unstale":"2024-09-17T03:40:16.551769+0000","last_undegraded":"2024-09-17T03:40:16.551769+0000","last_fullsized":"2024-09-17T03:40:16.551769+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:55.504035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475628+0000","last_change":"2024-09-17T03:40:15.478863+0000","last_active":"2024-09-17T03:40:16.475628+0000","last_peered":"2024-09-17T03:40:16.475628+0000","last_clean":"2024-09-17T03:40:16.475628+0000","last_became_active":"2024-09-17T03:40:15.478565+0000","last_became_peered":"2024-09-17T03:40:15.478565+0000","last_unstale":"2024-09-17T03:40:16.475628+0000","last_undegraded":"2024-09-17T03:40:16.475628+0000","last_fullsized":"2024-09-17T03:40:16.475628+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:20.800752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475958+0000","last_change":"2024-09-17T03:40:15.475782+0000","last_active":"2024-09-17T03:40:16.475958+0000","last_peered":"2024-09-17T03:40:16.475958+0000","last_clean":"2024-09-17T03:40:16.475958+0000","last_became_active":"2024-09-17T03:40:15.475291+0000","last_became_peered":"2024-09-17T03:40:15.475291+0000","last_unstale":"2024-09-17T03:40:16.475958+0000","last_undegraded":"2024-09-17T03:40:16.475958+0000","last_fullsized":"2024-09-17T03:40:16.475958+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:32.617963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"116'4","reported_seq":19,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552862+0000","last_change":"2024-09-17T03:40:14.474590+0000","last_active":"2024-09-17T03:40:16.552862+0000","last_peered":"2024-09-17T03:40:16.552862+0000","last_clean":"2024-09-17T03:40:16.552862+0000","last_became_active":"2024-09-17T03:40:14.474251+0000","last_became_peered":"2024-09-17T03:40:14.474251+0000","last_unstale":"2024-09-17T03:40:16.552862+0000","last_undegraded":"2024-09-17T03:40:16.552862+0000","last_fullsized":"2024-09-17T03:40:16.552862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:24.482162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478410+0000","last_change":"2024-09-17T03:40:15.478596+0000","last_active":"2024-09-17T03:40:16.478410+0000","last_peered":"2024-09-17T03:40:16.478410+0000","last_clean":"2024-09-17T03:40:16.478410+0000","last_became_active":"2024-09-17T03:40:15.478141+0000","last_became_peered":"2024-09-17T03:40:15.478141+0000","last_unstale":"2024-09-17T03:40:16.478410+0000","last_undegraded":"2024-09-17T03:40:16.478410+0000","last_fullsized":"2024-09-17T03:40:16.478410+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:17.884900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551866+0000","last_change":"2024-09-17T03:40:14.475924+0000","last_active":"2024-09-17T03:40:16.551866+0000","last_peered":"2024-09-17T03:40:16.551866+0000","last_clean":"2024-09-17T03:40:16.551866+0000","last_became_active":"2024-09-17T03:40:14.475532+0000","last_became_peered":"2024-09-17T03:40:14.475532+0000","last_unstale":"2024-09-17T03:40:16.551866+0000","last_undegraded":"2024-09-17T03:40:16.551866+0000","last_fullsized":"2024-09-17T03:40:16.551866+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:09.188966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476017+0000","last_change":"2024-09-17T03:40:15.477759+0000","last_active":"2024-09-17T03:40:16.476017+0000","last_peered":"2024-09-17T03:40:16.476017+0000","last_clean":"2024-09-17T03:40:16.476017+0000","last_became_active":"2024-09-17T03:40:15.477354+0000","last_became_peered":"2024-09-17T03:40:15.477354+0000","last_unstale":"2024-09-17T03:40:16.476017+0000","last_undegraded":"2024-09-17T03:40:16.476017+0000","last_fullsized":"2024-09-17T03:40:16.476017+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:57.668885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551608+0000","last_change":"2024-09-17T03:40:14.470654+0000","last_active":"2024-09-17T03:40:16.551608+0000","last_peered":"2024-09-17T03:40:16.551608+0000","last_clean":"2024-09-17T03:40:16.551608+0000","last_became_active":"2024-09-17T03:40:14.470305+0000","last_became_peered":"2024-09-17T03:40:14.470305+0000","last_unstale":"2024-09-17T03:40:16.551608+0000","last_undegraded":"2024-09-17T03:40:16.551608+0000","last_fullsized":"2024-09-17T03:40:16.551608+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:30.603247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552555+0000","last_change":"2024-09-17T03:40:15.483578+0000","last_active":"2024-09-17T03:40:16.552555+0000","last_peered":"2024-09-17T03:40:16.552555+0000","last_clean":"2024-09-17T03:40:16.552555+0000","last_became_active":"2024-09-17T03:40:15.482562+0000","last_became_peered":"2024-09-17T03:40:15.482562+0000","last_unstale":"2024-09-17T03:40:16.552555+0000","last_undegraded":"2024-09-17T03:40:16.552555+0000","last_fullsized":"2024-09-17T03:40:16.552555+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:32.079090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552207+0000","last_change":"2024-09-17T03:40:14.480944+0000","last_active":"2024-09-17T03:40:16.552207+0000","last_peered":"2024-09-17T03:40:16.552207+0000","last_clean":"2024-09-17T03:40:16.552207+0000","last_became_active":"2024-09-17T03:40:14.480631+0000","last_became_peered":"2024-09-17T03:40:14.480631+0000","last_unstale":"2024-09-17T03:40:16.552207+0000","last_undegraded":"2024-09-17T03:40:16.552207+0000","last_fullsized":"2024-09-17T03:40:16.552207+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:17.744845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552252+0000","last_change":"2024-09-17T03:40:15.486260+0000","last_active":"2024-09-17T03:40:16.552252+0000","last_peered":"2024-09-17T03:40:16.552252+0000","last_clean":"2024-09-17T03:40:16.552252+0000","last_became_active":"2024-09-17T03:40:15.485935+0000","last_became_peered":"2024-09-17T03:40:15.485935+0000","last_unstale":"2024-09-17T03:40:16.552252+0000","last_undegraded":"2024-09-17T03:40:16.552252+0000","last_fullsized":"2024-09-17T03:40:16.552252+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:08.384805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552511+0000","last_change":"2024-09-17T03:40:14.481995+0000","last_active":"2024-09-17T03:40:16.552511+0000","last_peered":"2024-09-17T03:40:16.552511+0000","last_clean":"2024-09-17T03:40:16.552511+0000","last_became_active":"2024-09-17T03:40:14.481664+0000","last_became_peered":"2024-09-17T03:40:14.481664+0000","last_unstale":"2024-09-17T03:40:16.552511+0000","last_undegraded":"2024-09-17T03:40:16.552511+0000","last_fullsized":"2024-09-17T03:40:16.552511+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:21.880772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476966+0000","last_change":"2024-09-17T03:40:15.478649+0000","last_active":"2024-09-17T03:40:16.476966+0000","last_peered":"2024-09-17T03:40:16.476966+0000","last_clean":"2024-09-17T03:40:16.476966+0000","last_became_active":"2024-09-17T03:40:15.478320+0000","last_became_peered":"2024-09-17T03:40:15.478320+0000","last_unstale":"2024-09-17T03:40:16.476966+0000","last_undegraded":"2024-09-17T03:40:16.476966+0000","last_fullsized":"2024-09-17T03:40:16.476966+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:23.907814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552304+0000","last_change":"2024-09-17T03:40:14.480486+0000","last_active":"2024-09-17T03:40:16.552304+0000","last_peered":"2024-09-17T03:40:16.552304+0000","last_clean":"2024-09-17T03:40:16.552304+0000","last_became_active":"2024-09-17T03:40:14.480219+0000","last_became_peered":"2024-09-17T03:40:14.480219+0000","last_unstale":"2024-09-17T03:40:16.552304+0000","last_undegraded":"2024-09-17T03:40:16.552304+0000","last_fullsized":"2024-09-17T03:40:16.552304+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:55.122669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552499+0000","last_change":"2024-09-17T03:40:15.492764+0000","last_active":"2024-09-17T03:40:16.552499+0000","last_peered":"2024-09-17T03:40:16.552499+0000","last_clean":"2024-09-17T03:40:16.552499+0000","last_became_active":"2024-09-17T03:40:15.490938+0000","last_became_peered":"2024-09-17T03:40:15.490938+0000","last_unstale":"2024-09-17T03:40:16.552499+0000","last_undegraded":"2024-09-17T03:40:16.552499+0000","last_fullsized":"2024-09-17T03:40:16.552499+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:45.378479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476284+0000","last_change":"2024-09-17T03:40:14.479207+0000","last_active":"2024-09-17T03:40:16.476284+0000","last_peered":"2024-09-17T03:40:16.476284+0000","last_clean":"2024-09-17T03:40:16.476284+0000","last_became_active":"2024-09-17T03:40:14.478974+0000","last_became_peered":"2024-09-17T03:40:14.478974+0000","last_unstale":"2024-09-17T03:40:16.476284+0000","last_undegraded":"2024-09-17T03:40:16.476284+0000","last_fullsized":"2024-09-17T03:40:16.476284+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:37.325086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551862+0000","last_change":"2024-09-17T03:40:15.480254+0000","last_active":"2024-09-17T03:40:16.551862+0000","last_peered":"2024-09-17T03:40:16.551862+0000","last_clean":"2024-09-17T03:40:16.551862+0000","last_became_active":"2024-09-17T03:40:15.479489+0000","last_became_peered":"2024-09-17T03:40:15.479489+0000","last_unstale":"2024-09-17T03:40:16.551862+0000","last_undegraded":"2024-09-17T03:40:16.551862+0000","last_fullsized":"2024-09-17T03:40:16.551862+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:21.795552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552805+0000","last_change":"2024-09-17T03:40:14.485088+0000","last_active":"2024-09-17T03:40:16.552805+0000","last_peered":"2024-09-17T03:40:16.552805+0000","last_clean":"2024-09-17T03:40:16.552805+0000","last_became_active":"2024-09-17T03:40:14.484700+0000","last_became_peered":"2024-09-17T03:40:14.484700+0000","last_unstale":"2024-09-17T03:40:16.552805+0000","last_undegraded":"2024-09-17T03:40:16.552805+0000","last_fullsized":"2024-09-17T03:40:16.552805+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:42.357636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553004+0000","last_change":"2024-09-17T03:40:15.481077+0000","last_active":"2024-09-17T03:40:16.553004+0000","last_peered":"2024-09-17T03:40:16.553004+0000","last_clean":"2024-09-17T03:40:16.553004+0000","last_became_active":"2024-09-17T03:40:15.480776+0000","last_became_peered":"2024-09-17T03:40:15.480776+0000","last_unstale":"2024-09-17T03:40:16.553004+0000","last_undegraded":"2024-09-17T03:40:16.553004+0000","last_fullsized":"2024-09-17T03:40:16.553004+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:41.034237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551653+0000","last_change":"2024-09-17T03:40:14.471040+0000","last_active":"2024-09-17T03:40:16.551653+0000","last_peered":"2024-09-17T03:40:16.551653+0000","last_clean":"2024-09-17T03:40:16.551653+0000","last_became_active":"2024-09-17T03:40:14.470269+0000","last_became_peered":"2024-09-17T03:40:14.470269+0000","last_unstale":"2024-09-17T03:40:16.551653+0000","last_undegraded":"2024-09-17T03:40:16.551653+0000","last_fullsized":"2024-09-17T03:40:16.551653+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:58.742393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478375+0000","last_change":"2024-09-17T03:40:15.496633+0000","last_active":"2024-09-17T03:40:16.478375+0000","last_peered":"2024-09-17T03:40:16.478375+0000","last_clean":"2024-09-17T03:40:16.478375+0000","last_became_active":"2024-09-17T03:40:15.496027+0000","last_became_peered":"2024-09-17T03:40:15.496027+0000","last_unstale":"2024-09-17T03:40:16.478375+0000","last_undegraded":"2024-09-17T03:40:16.478375+0000","last_fullsized":"2024-09-17T03:40:16.478375+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:17.187794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552017+0000","last_change":"2024-09-17T03:40:14.480083+0000","last_active":"2024-09-17T03:40:16.552017+0000","last_peered":"2024-09-17T03:40:16.552017+0000","last_clean":"2024-09-17T03:40:16.552017+0000","last_became_active":"2024-09-17T03:40:14.479815+0000","last_became_peered":"2024-09-17T03:40:14.479815+0000","last_unstale":"2024-09-17T03:40:16.552017+0000","last_undegraded":"2024-09-17T03:40:16.552017+0000","last_fullsized":"2024-09-17T03:40:16.552017+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:46.688766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552355+0000","last_change":"2024-09-17T03:40:15.474882+0000","last_active":"2024-09-17T03:40:16.552355+0000","last_peered":"2024-09-17T03:40:16.552355+0000","last_clean":"2024-09-17T03:40:16.552355+0000","last_became_active":"2024-09-17T03:40:15.474567+0000","last_became_peered":"2024-09-17T03:40:15.474567+0000","last_unstale":"2024-09-17T03:40:16.552355+0000","last_undegraded":"2024-09-17T03:40:16.552355+0000","last_fullsized":"2024-09-17T03:40:16.552355+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:48.082051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"116'3","reported_seq":18,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552848+0000","last_change":"2024-09-17T03:40:14.481321+0000","last_active":"2024-09-17T03:40:16.552848+0000","last_peered":"2024-09-17T03:40:16.552848+0000","last_clean":"2024-09-17T03:40:16.552848+0000","last_became_active":"2024-09-17T03:40:14.481045+0000","last_became_peered":"2024-09-17T03:40:14.481045+0000","last_unstale":"2024-09-17T03:40:16.552848+0000","last_undegraded":"2024-09-17T03:40:16.552848+0000","last_fullsized":"2024-09-17T03:40:16.552848+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:48.594881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553056+0000","last_change":"2024-09-17T03:40:15.485451+0000","last_active":"2024-09-17T03:40:16.553056+0000","last_peered":"2024-09-17T03:40:16.553056+0000","last_clean":"2024-09-17T03:40:16.553056+0000","last_became_active":"2024-09-17T03:40:15.485116+0000","last_became_peered":"2024-09-17T03:40:15.485116+0000","last_unstale":"2024-09-17T03:40:16.553056+0000","last_undegraded":"2024-09-17T03:40:16.553056+0000","last_fullsized":"2024-09-17T03:40:16.553056+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:48.894066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"116'6","reported_seq":21,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553198+0000","last_change":"2024-09-17T03:40:14.484915+0000","last_active":"2024-09-17T03:40:16.553198+0000","last_peered":"2024-09-17T03:40:16.553198+0000","last_clean":"2024-09-17T03:40:16.553198+0000","last_became_active":"2024-09-17T03:40:14.484594+0000","last_became_peered":"2024-09-17T03:40:14.484594+0000","last_unstale":"2024-09-17T03:40:16.553198+0000","last_undegraded":"2024-09-17T03:40:16.553198+0000","last_fullsized":"2024-09-17T03:40:16.553198+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:32.875825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552175+0000","last_change":"2024-09-17T03:40:15.488261+0000","last_active":"2024-09-17T03:40:16.552175+0000","last_peered":"2024-09-17T03:40:16.552175+0000","last_clean":"2024-09-17T03:40:16.552175+0000","last_became_active":"2024-09-17T03:40:15.487934+0000","last_became_peered":"2024-09-17T03:40:15.487934+0000","last_unstale":"2024-09-17T03:40:16.552175+0000","last_undegraded":"2024-09-17T03:40:16.552175+0000","last_fullsized":"2024-09-17T03:40:16.552175+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:02.064934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475762+0000","last_change":"2024-09-17T03:40:14.480581+0000","last_active":"2024-09-17T03:40:16.475762+0000","last_peered":"2024-09-17T03:40:16.475762+0000","last_clean":"2024-09-17T03:40:16.475762+0000","last_became_active":"2024-09-17T03:40:14.480240+0000","last_became_peered":"2024-09-17T03:40:14.480240+0000","last_unstale":"2024-09-17T03:40:16.475762+0000","last_undegraded":"2024-09-17T03:40:16.475762+0000","last_fullsized":"2024-09-17T03:40:16.475762+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:42.775504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551951+0000","last_change":"2024-09-17T03:40:15.482447+0000","last_active":"2024-09-17T03:40:16.551951+0000","last_peered":"2024-09-17T03:40:16.551951+0000","last_clean":"2024-09-17T03:40:16.551951+0000","last_became_active":"2024-09-17T03:40:15.482134+0000","last_became_peered":"2024-09-17T03:40:15.482134+0000","last_unstale":"2024-09-17T03:40:16.551951+0000","last_undegraded":"2024-09-17T03:40:16.551951+0000","last_fullsized":"2024-09-17T03:40:16.551951+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:20.940998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477872+0000","last_change":"2024-09-17T03:40:14.470150+0000","last_active":"2024-09-17T03:40:16.477872+0000","last_peered":"2024-09-17T03:40:16.477872+0000","last_clean":"2024-09-17T03:40:16.477872+0000","last_became_active":"2024-09-17T03:40:14.469836+0000","last_became_peered":"2024-09-17T03:40:14.469836+0000","last_unstale":"2024-09-17T03:40:16.477872+0000","last_undegraded":"2024-09-17T03:40:16.477872+0000","last_fullsized":"2024-09-17T03:40:16.477872+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:58.072121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551775+0000","last_change":"2024-09-17T03:40:15.474933+0000","last_active":"2024-09-17T03:40:16.551775+0000","last_peered":"2024-09-17T03:40:16.551775+0000","last_clean":"2024-09-17T03:40:16.551775+0000","last_became_active":"2024-09-17T03:40:15.474590+0000","last_became_peered":"2024-09-17T03:40:15.474590+0000","last_unstale":"2024-09-17T03:40:16.551775+0000","last_undegraded":"2024-09-17T03:40:16.551775+0000","last_fullsized":"2024-09-17T03:40:16.551775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:57.185460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"116'8","reported_seq":23,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551827+0000","last_change":"2024-09-17T03:40:14.475793+0000","last_active":"2024-09-17T03:40:16.551827+0000","last_peered":"2024-09-17T03:40:16.551827+0000","last_clean":"2024-09-17T03:40:16.551827+0000","last_became_active":"2024-09-17T03:40:14.475496+0000","last_became_peered":"2024-09-17T03:40:14.475496+0000","last_unstale":"2024-09-17T03:40:16.551827+0000","last_undegraded":"2024-09-17T03:40:16.551827+0000","last_fullsized":"2024-09-17T03:40:16.551827+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:20.163847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552479+0000","last_change":"2024-09-17T03:40:15.500205+0000","last_active":"2024-09-17T03:40:16.552479+0000","last_peered":"2024-09-17T03:40:16.552479+0000","last_clean":"2024-09-17T03:40:16.552479+0000","last_became_active":"2024-09-17T03:40:15.499443+0000","last_became_peered":"2024-09-17T03:40:15.499443+0000","last_unstale":"2024-09-17T03:40:16.552479+0000","last_undegraded":"2024-09-17T03:40:16.552479+0000","last_fullsized":"2024-09-17T03:40:16.552479+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:09.991996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553195+0000","last_change":"2024-09-17T03:40:14.475616+0000","last_active":"2024-09-17T03:40:16.553195+0000","last_peered":"2024-09-17T03:40:16.553195+0000","last_clean":"2024-09-17T03:40:16.553195+0000","last_became_active":"2024-09-17T03:40:14.475319+0000","last_became_peered":"2024-09-17T03:40:14.475319+0000","last_unstale":"2024-09-17T03:40:16.553195+0000","last_undegraded":"2024-09-17T03:40:16.553195+0000","last_fullsized":"2024-09-17T03:40:16.553195+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:11.080444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475980+0000","last_change":"2024-09-17T03:40:15.496594+0000","last_active":"2024-09-17T03:40:16.475980+0000","last_peered":"2024-09-17T03:40:16.475980+0000","last_clean":"2024-09-17T03:40:16.475980+0000","last_became_active":"2024-09-17T03:40:15.496263+0000","last_became_peered":"2024-09-17T03:40:15.496263+0000","last_unstale":"2024-09-17T03:40:16.475980+0000","last_undegraded":"2024-09-17T03:40:16.475980+0000","last_fullsized":"2024-09-17T03:40:16.475980+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:33.863023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552569+0000","last_change":"2024-09-17T03:40:14.474157+0000","last_active":"2024-09-17T03:40:16.552569+0000","last_peered":"2024-09-17T03:40:16.552569+0000","last_clean":"2024-09-17T03:40:16.552569+0000","last_became_active":"2024-09-17T03:40:14.473846+0000","last_became_peered":"2024-09-17T03:40:14.473846+0000","last_unstale":"2024-09-17T03:40:16.552569+0000","last_undegraded":"2024-09-17T03:40:16.552569+0000","last_fullsized":"2024-09-17T03:40:16.552569+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:29.173297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552125+0000","last_change":"2024-09-17T03:40:15.496350+0000","last_active":"2024-09-17T03:40:16.552125+0000","last_peered":"2024-09-17T03:40:16.552125+0000","last_clean":"2024-09-17T03:40:16.552125+0000","last_became_active":"2024-09-17T03:40:15.496024+0000","last_became_peered":"2024-09-17T03:40:15.496024+0000","last_unstale":"2024-09-17T03:40:16.552125+0000","last_undegraded":"2024-09-17T03:40:16.552125+0000","last_fullsized":"2024-09-17T03:40:16.552125+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:07.692190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477089+0000","last_change":"2024-09-17T03:40:14.486426+0000","last_active":"2024-09-17T03:40:16.477089+0000","last_peered":"2024-09-17T03:40:16.477089+0000","last_clean":"2024-09-17T03:40:16.477089+0000","last_became_active":"2024-09-17T03:40:14.486185+0000","last_became_peered":"2024-09-17T03:40:14.486185+0000","last_unstale":"2024-09-17T03:40:16.477089+0000","last_undegraded":"2024-09-17T03:40:16.477089+0000","last_fullsized":"2024-09-17T03:40:16.477089+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:59.582788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552791+0000","last_change":"2024-09-17T03:40:15.483973+0000","last_active":"2024-09-17T03:40:16.552791+0000","last_peered":"2024-09-17T03:40:16.552791+0000","last_clean":"2024-09-17T03:40:16.552791+0000","last_became_active":"2024-09-17T03:40:15.483145+0000","last_became_peered":"2024-09-17T03:40:15.483145+0000","last_unstale":"2024-09-17T03:40:16.552791+0000","last_undegraded":"2024-09-17T03:40:16.552791+0000","last_fullsized":"2024-09-17T03:40:16.552791+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:27.565878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552753+0000","last_change":"2024-09-17T03:40:14.480432+0000","last_active":"2024-09-17T03:40:16.552753+0000","last_peered":"2024-09-17T03:40:16.552753+0000","last_clean":"2024-09-17T03:40:16.552753+0000","last_became_active":"2024-09-17T03:40:14.480110+0000","last_became_peered":"2024-09-17T03:40:14.480110+0000","last_unstale":"2024-09-17T03:40:16.552753+0000","last_undegraded":"2024-09-17T03:40:16.552753+0000","last_fullsized":"2024-09-17T03:40:16.552753+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:32.719766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552127+0000","last_change":"2024-09-17T03:40:15.482488+0000","last_active":"2024-09-17T03:40:16.552127+0000","last_peered":"2024-09-17T03:40:16.552127+0000","last_clean":"2024-09-17T03:40:16.552127+0000","last_became_active":"2024-09-17T03:40:15.482132+0000","last_became_peered":"2024-09-17T03:40:15.482132+0000","last_unstale":"2024-09-17T03:40:16.552127+0000","last_undegraded":"2024-09-17T03:40:16.552127+0000","last_fullsized":"2024-09-17T03:40:16.552127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:00.988692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475789+0000","last_change":"2024-09-17T03:40:14.478399+0000","last_active":"2024-09-17T03:40:16.475789+0000","last_peered":"2024-09-17T03:40:16.475789+0000","last_clean":"2024-09-17T03:40:16.475789+0000","last_became_active":"2024-09-17T03:40:14.477797+0000","last_became_peered":"2024-09-17T03:40:14.477797+0000","last_unstale":"2024-09-17T03:40:16.475789+0000","last_undegraded":"2024-09-17T03:40:16.475789+0000","last_fullsized":"2024-09-17T03:40:16.475789+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:51.818142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552560+0000","last_change":"2024-09-17T03:40:15.485602+0000","last_active":"2024-09-17T03:40:16.552560+0000","last_peered":"2024-09-17T03:40:16.552560+0000","last_clean":"2024-09-17T03:40:16.552560+0000","last_became_active":"2024-09-17T03:40:15.485151+0000","last_became_peered":"2024-09-17T03:40:15.485151+0000","last_unstale":"2024-09-17T03:40:16.552560+0000","last_undegraded":"2024-09-17T03:40:16.552560+0000","last_fullsized":"2024-09-17T03:40:16.552560+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:03.138811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551456+0000","last_change":"2024-09-17T03:40:14.481534+0000","last_active":"2024-09-17T03:40:16.551456+0000","last_peered":"2024-09-17T03:40:16.551456+0000","last_clean":"2024-09-17T03:40:16.551456+0000","last_became_active":"2024-09-17T03:40:14.481228+0000","last_became_peered":"2024-09-17T03:40:14.481228+0000","last_unstale":"2024-09-17T03:40:16.551456+0000","last_undegraded":"2024-09-17T03:40:16.551456+0000","last_fullsized":"2024-09-17T03:40:16.551456+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:44.335281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551852+0000","last_change":"2024-09-17T03:40:15.484052+0000","last_active":"2024-09-17T03:40:16.551852+0000","last_peered":"2024-09-17T03:40:16.551852+0000","last_clean":"2024-09-17T03:40:16.551852+0000","last_became_active":"2024-09-17T03:40:15.482744+0000","last_became_peered":"2024-09-17T03:40:15.482744+0000","last_unstale":"2024-09-17T03:40:16.551852+0000","last_undegraded":"2024-09-17T03:40:16.551852+0000","last_fullsized":"2024-09-17T03:40:16.551852+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:59.432670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.475820+0000","last_change":"2024-09-17T03:40:14.478288+0000","last_active":"2024-09-17T03:40:16.475820+0000","last_peered":"2024-09-17T03:40:16.475820+0000","last_clean":"2024-09-17T03:40:16.475820+0000","last_became_active":"2024-09-17T03:40:14.478005+0000","last_became_peered":"2024-09-17T03:40:14.478005+0000","last_unstale":"2024-09-17T03:40:16.475820+0000","last_undegraded":"2024-09-17T03:40:16.475820+0000","last_fullsized":"2024-09-17T03:40:16.475820+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:39.216489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551999+0000","last_change":"2024-09-17T03:40:15.497363+0000","last_active":"2024-09-17T03:40:16.551999+0000","last_peered":"2024-09-17T03:40:16.551999+0000","last_clean":"2024-09-17T03:40:16.551999+0000","last_became_active":"2024-09-17T03:40:15.495974+0000","last_became_peered":"2024-09-17T03:40:15.495974+0000","last_unstale":"2024-09-17T03:40:16.551999+0000","last_undegraded":"2024-09-17T03:40:16.551999+0000","last_fullsized":"2024-09-17T03:40:16.551999+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:36.847762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552705+0000","last_change":"2024-09-17T03:40:14.473315+0000","last_active":"2024-09-17T03:40:16.552705+0000","last_peered":"2024-09-17T03:40:16.552705+0000","last_clean":"2024-09-17T03:40:16.552705+0000","last_became_active":"2024-09-17T03:40:14.472752+0000","last_became_peered":"2024-09-17T03:40:14.472752+0000","last_unstale":"2024-09-17T03:40:16.552705+0000","last_undegraded":"2024-09-17T03:40:16.552705+0000","last_fullsized":"2024-09-17T03:40:16.552705+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:02.347183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478161+0000","last_change":"2024-09-17T03:40:15.496606+0000","last_active":"2024-09-17T03:40:16.478161+0000","last_peered":"2024-09-17T03:40:16.478161+0000","last_clean":"2024-09-17T03:40:16.478161+0000","last_became_active":"2024-09-17T03:40:15.496039+0000","last_became_peered":"2024-09-17T03:40:15.496039+0000","last_unstale":"2024-09-17T03:40:16.478161+0000","last_undegraded":"2024-09-17T03:40:16.478161+0000","last_fullsized":"2024-09-17T03:40:16.478161+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:13.783841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551565+0000","last_change":"2024-09-17T03:40:14.485645+0000","last_active":"2024-09-17T03:40:16.551565+0000","last_peered":"2024-09-17T03:40:16.551565+0000","last_clean":"2024-09-17T03:40:16.551565+0000","last_became_active":"2024-09-17T03:40:14.483559+0000","last_became_peered":"2024-09-17T03:40:14.483559+0000","last_unstale":"2024-09-17T03:40:16.551565+0000","last_undegraded":"2024-09-17T03:40:16.551565+0000","last_fullsized":"2024-09-17T03:40:16.551565+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:28.380087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553025+0000","last_change":"2024-09-17T03:40:15.495051+0000","last_active":"2024-09-17T03:40:16.553025+0000","last_peered":"2024-09-17T03:40:16.553025+0000","last_clean":"2024-09-17T03:40:16.553025+0000","last_became_active":"2024-09-17T03:40:15.494741+0000","last_became_peered":"2024-09-17T03:40:15.494741+0000","last_unstale":"2024-09-17T03:40:16.553025+0000","last_undegraded":"2024-09-17T03:40:16.553025+0000","last_fullsized":"2024-09-17T03:40:16.553025+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:19.888917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"117'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.478149+0000","last_change":"2024-09-17T03:40:14.473982+0000","last_active":"2024-09-17T03:40:16.478149+0000","last_peered":"2024-09-17T03:40:16.478149+0000","last_clean":"2024-09-17T03:40:16.478149+0000","last_became_active":"2024-09-17T03:40:14.473658+0000","last_became_peered":"2024-09-17T03:40:14.473658+0000","last_unstale":"2024-09-17T03:40:16.478149+0000","last_undegraded":"2024-09-17T03:40:16.478149+0000","last_fullsized":"2024-09-17T03:40:16.478149+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:28.613912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.553230+0000","last_change":"2024-09-17T03:40:15.492445+0000","last_active":"2024-09-17T03:40:16.553230+0000","last_peered":"2024-09-17T03:40:16.553230+0000","last_clean":"2024-09-17T03:40:16.553230+0000","last_became_active":"2024-09-17T03:40:15.492138+0000","last_became_peered":"2024-09-17T03:40:15.492138+0000","last_unstale":"2024-09-17T03:40:16.553230+0000","last_undegraded":"2024-09-17T03:40:16.553230+0000","last_fullsized":"2024-09-17T03:40:16.553230+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:23.192448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552984+0000","last_change":"2024-09-17T03:40:14.472535+0000","last_active":"2024-09-17T03:40:16.552984+0000","last_peered":"2024-09-17T03:40:16.552984+0000","last_clean":"2024-09-17T03:40:16.552984+0000","last_became_active":"2024-09-17T03:40:14.472200+0000","last_became_peered":"2024-09-17T03:40:14.472200+0000","last_unstale":"2024-09-17T03:40:16.552984+0000","last_undegraded":"2024-09-17T03:40:16.552984+0000","last_fullsized":"2024-09-17T03:40:16.552984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:16.215936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476897+0000","last_change":"2024-09-17T03:40:15.496223+0000","last_active":"2024-09-17T03:40:16.476897+0000","last_peered":"2024-09-17T03:40:16.476897+0000","last_clean":"2024-09-17T03:40:16.476897+0000","last_became_active":"2024-09-17T03:40:15.495895+0000","last_became_peered":"2024-09-17T03:40:15.495895+0000","last_unstale":"2024-09-17T03:40:16.476897+0000","last_undegraded":"2024-09-17T03:40:16.476897+0000","last_fullsized":"2024-09-17T03:40:16.476897+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:08.136133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552423+0000","last_change":"2024-09-17T03:40:14.483507+0000","last_active":"2024-09-17T03:40:16.552423+0000","last_peered":"2024-09-17T03:40:16.552423+0000","last_clean":"2024-09-17T03:40:16.552423+0000","last_became_active":"2024-09-17T03:40:14.483198+0000","last_became_peered":"2024-09-17T03:40:14.483198+0000","last_unstale":"2024-09-17T03:40:16.552423+0000","last_undegraded":"2024-09-17T03:40:16.552423+0000","last_fullsized":"2024-09-17T03:40:16.552423+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:27.505809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476391+0000","last_change":"2024-09-17T03:40:15.481516+0000","last_active":"2024-09-17T03:40:16.476391+0000","last_peered":"2024-09-17T03:40:16.476391+0000","last_clean":"2024-09-17T03:40:16.476391+0000","last_became_active":"2024-09-17T03:40:15.481100+0000","last_became_peered":"2024-09-17T03:40:15.481100+0000","last_unstale":"2024-09-17T03:40:16.476391+0000","last_undegraded":"2024-09-17T03:40:16.476391+0000","last_fullsized":"2024-09-17T03:40:16.476391+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:49.910297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552671+0000","last_change":"2024-09-17T03:40:14.475085+0000","last_active":"2024-09-17T03:40:16.552671+0000","last_peered":"2024-09-17T03:40:16.552671+0000","last_clean":"2024-09-17T03:40:16.552671+0000","last_became_active":"2024-09-17T03:40:14.474642+0000","last_became_peered":"2024-09-17T03:40:14.474642+0000","last_unstale":"2024-09-17T03:40:16.552671+0000","last_undegraded":"2024-09-17T03:40:16.552671+0000","last_fullsized":"2024-09-17T03:40:16.552671+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:07.438425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.477319+0000","last_change":"2024-09-17T03:40:15.472755+0000","last_active":"2024-09-17T03:40:16.477319+0000","last_peered":"2024-09-17T03:40:16.477319+0000","last_clean":"2024-09-17T03:40:16.477319+0000","last_became_active":"2024-09-17T03:40:15.472437+0000","last_became_peered":"2024-09-17T03:40:15.472437+0000","last_unstale":"2024-09-17T03:40:16.477319+0000","last_undegraded":"2024-09-17T03:40:16.477319+0000","last_fullsized":"2024-09-17T03:40:16.477319+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:44.143632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.476452+0000","last_change":"2024-09-17T03:40:14.480911+0000","last_active":"2024-09-17T03:40:16.476452+0000","last_peered":"2024-09-17T03:40:16.476452+0000","last_clean":"2024-09-17T03:40:16.476452+0000","last_became_active":"2024-09-17T03:40:14.480499+0000","last_became_peered":"2024-09-17T03:40:14.480499+0000","last_unstale":"2024-09-17T03:40:16.476452+0000","last_undegraded":"2024-09-17T03:40:16.476452+0000","last_fullsized":"2024-09-17T03:40:16.476452+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:04.911626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552172+0000","last_change":"2024-09-17T03:40:15.484106+0000","last_active":"2024-09-17T03:40:16.552172+0000","last_peered":"2024-09-17T03:40:16.552172+0000","last_clean":"2024-09-17T03:40:16.552172+0000","last_became_active":"2024-09-17T03:40:15.483402+0000","last_became_peered":"2024-09-17T03:40:15.483402+0000","last_unstale":"2024-09-17T03:40:16.552172+0000","last_undegraded":"2024-09-17T03:40:16.552172+0000","last_fullsized":"2024-09-17T03:40:16.552172+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:15.968927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551582+0000","last_change":"2024-09-17T03:40:14.472140+0000","last_active":"2024-09-17T03:40:16.551582+0000","last_peered":"2024-09-17T03:40:16.551582+0000","last_clean":"2024-09-17T03:40:16.551582+0000","last_became_active":"2024-09-17T03:40:14.471857+0000","last_became_peered":"2024-09-17T03:40:14.471857+0000","last_unstale":"2024-09-17T03:40:16.551582+0000","last_undegraded":"2024-09-17T03:40:16.551582+0000","last_fullsized":"2024-09-17T03:40:16.551582+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:53.540753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552005+0000","last_change":"2024-09-17T03:40:15.491609+0000","last_active":"2024-09-17T03:40:16.552005+0000","last_peered":"2024-09-17T03:40:16.552005+0000","last_clean":"2024-09-17T03:40:16.552005+0000","last_became_active":"2024-09-17T03:40:15.491296+0000","last_became_peered":"2024-09-17T03:40:15.491296+0000","last_unstale":"2024-09-17T03:40:16.552005+0000","last_undegraded":"2024-09-17T03:40:16.552005+0000","last_fullsized":"2024-09-17T03:40:16.552005+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:46.783619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552876+0000","last_change":"2024-09-17T03:40:14.473025+0000","last_active":"2024-09-17T03:40:16.552876+0000","last_peered":"2024-09-17T03:40:16.552876+0000","last_clean":"2024-09-17T03:40:16.552876+0000","last_became_active":"2024-09-17T03:40:14.472373+0000","last_became_peered":"2024-09-17T03:40:14.472373+0000","last_unstale":"2024-09-17T03:40:16.552876+0000","last_undegraded":"2024-09-17T03:40:16.552876+0000","last_fullsized":"2024-09-17T03:40:16.552876+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:06.642837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.551907+0000","last_change":"2024-09-17T03:40:15.483370+0000","last_active":"2024-09-17T03:40:16.551907+0000","last_peered":"2024-09-17T03:40:16.551907+0000","last_clean":"2024-09-17T03:40:16.551907+0000","last_became_active":"2024-09-17T03:40:15.483063+0000","last_became_peered":"2024-09-17T03:40:15.483063+0000","last_unstale":"2024-09-17T03:40:16.551907+0000","last_undegraded":"2024-09-17T03:40:16.551907+0000","last_fullsized":"2024-09-17T03:40:16.551907+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:14.453556+0000","last_clean_scrub_stamp":"2024-09-17T03:40:14.453556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:53.510707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552003+0000","last_change":"2024-09-17T03:40:14.482698+0000","last_active":"2024-09-17T03:40:16.552003+0000","last_peered":"2024-09-17T03:40:16.552003+0000","last_clean":"2024-09-17T03:40:16.552003+0000","last_became_active":"2024-09-17T03:40:14.482376+0000","last_became_peered":"2024-09-17T03:40:14.482376+0000","last_unstale":"2024-09-17T03:40:16.552003+0000","last_undegraded":"2024-09-17T03:40:16.552003+0000","last_fullsized":"2024-09-17T03:40:16.552003+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:40:13.451521+0000","last_clean_scrub_stamp":"2024-09-17T03:40:13.451521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:16.596119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":287,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T03:40:16.552761+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:40:16.552761+0000","last_peered":"2024-09-17T03:40:16.552761+0000","last_clean":"2024-09-17T03:40:16.552761+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:40:16.552761+0000","last_undegraded":"2024-09-17T03:40:16.552761+0000","last_fullsized":"2024-09-17T03:40:16.552761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509534,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2048000,"data_stored":1222890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":40434123},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46500,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325340,"statfs":{"total":96636764160,"available":96589148160,"internally_reserved":0,"allocated":1449984,"data_stored":631976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50656,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321184,"statfs":{"total":96636764160,"available":96584892416,"internally_reserved":0,"allocated":1445888,"data_stored":631906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509534,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46488,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325352,"statfs":{"total":96636764160,"available":96589160448,"internally_reserved":0,"allocated":1445888,"data_stored":631906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50656,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321184,"statfs":{"total":96636764160,"available":96584892416,"internally_reserved":0,"allocated":1454080,"data_stored":632030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509535,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45680,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326160,"statfs":{"total":96636764160,"available":96589987840,"internally_reserved":0,"allocated":2060288,"data_stored":1223998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28452,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343388,"statfs":{"total":96636764160,"available":96607629312,"internally_reserved":0,"allocated":1454080,"data_stored":632510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46508,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325332,"statfs":{"total":96636764160,"available":96589139968,"internally_reserved":0,"allocated":1462272,"data_stored":633588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:40:24.283 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:40:24.284 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:40:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.441+0000 7f1fa5adc640 1 -- 172.21.15.146:0/858551445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa006fa90 msgr2=0x7f1fa0073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.441+0000 7f1fa5adc640 1 --2- 172.21.15.146:0/858551445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa006fa90 0x7f1fa0073ba0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f1f98005fd0 tx=0x7f1f9802a780 comp rx=0 tx=0).stop 2024-09-17T03:40:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.441+0000 7f1fa5adc640 1 -- 172.21.15.146:0/858551445 shutdown_connections 2024-09-17T03:40:24.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.441+0000 7f1fa5adc640 1 --2- 172.21.15.146:0/858551445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa006fa90 0x7f1fa0073ba0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.441+0000 7f1fa5adc640 1 --2- 172.21.15.146:0/858551445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fa006f680 0x7f1fa0073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.441+0000 7f1fa5adc640 1 -- 172.21.15.146:0/858551445 >> 172.21.15.146:0/858551445 conn(0x7f1fa006dd60 msgr2=0x7f1fa006e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:24.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.441+0000 7f1fa5adc640 1 -- 172.21.15.146:0/858551445 shutdown_connections 2024-09-17T03:40:24.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.441+0000 7f1fa5adc640 1 -- 172.21.15.146:0/858551445 wait complete. 2024-09-17T03:40:24.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.443+0000 7f1fa5adc640 1 Processor -- start 2024-09-17T03:40:24.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.443+0000 7f1fa5adc640 1 -- start start 2024-09-17T03:40:24.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1fa5adc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fa006f680 0x7f1fa014c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1fa5adc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa006fa90 0x7f1fa0140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1fa5adc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fa0152850 0x7f1fa00b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1fa5adc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa00b5c70 con 0x7f1fa006fa90 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1fa5adc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa00b5af0 con 0x7f1fa006f680 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1fa5adc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa00b5df0 con 0x7f1fa0152850 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1f9effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa006fa90 0x7f1fa0140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1f9effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa006fa90 0x7f1fa0140e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53540/0 (socket says 172.21.15.146:53540) 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1f9effd640 1 -- 172.21.15.146:0/1474471770 learned_addr learned my addr 172.21.15.146:0/1474471770 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1f9ffff640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fa0152850 0x7f1fa00b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1f9f7fe640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fa006f680 0x7f1fa014c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1f9effd640 1 -- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fa0152850 msgr2=0x7f1fa00b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1f9effd640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fa0152850 0x7f1fa00b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1f9effd640 1 -- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fa006f680 msgr2=0x7f1fa014c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1f9effd640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fa006f680 0x7f1fa014c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.444+0000 7f1f9effd640 1 -- 172.21.15.146:0/1474471770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa014d000 con 0x7f1fa006fa90 2024-09-17T03:40:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.445+0000 7f1f9effd640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa006fa90 0x7f1fa0140e60 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400c970 tx=0x7f1f9400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:24.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.445+0000 7f1f87fff640 1 -- 172.21.15.146:0/1474471770 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94007bb0 con 0x7f1fa006fa90 2024-09-17T03:40:24.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.445+0000 7f1f87fff640 1 -- 172.21.15.146:0/1474471770 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f94007e40 con 0x7f1fa006fa90 2024-09-17T03:40:24.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.445+0000 7f1fa5adc640 1 -- 172.21.15.146:0/1474471770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa014d2a0 con 0x7f1fa006fa90 2024-09-17T03:40:24.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.445+0000 7f1f87fff640 1 -- 172.21.15.146:0/1474471770 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9400f690 con 0x7f1fa006fa90 2024-09-17T03:40:24.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.445+0000 7f1fa5adc640 1 -- 172.21.15.146:0/1474471770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa01492f0 con 0x7f1fa006fa90 2024-09-17T03:40:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.446+0000 7f1fa5adc640 1 -- 172.21.15.146:0/1474471770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa014a570 con 0x7f1fa006fa90 2024-09-17T03:40:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.447+0000 7f1f87fff640 1 -- 172.21.15.146:0/1474471770 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f9400f830 con 0x7f1fa006fa90 2024-09-17T03:40:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.447+0000 7f1f87fff640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f8c078b90 0x7f1f8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.447+0000 7f1f87fff640 1 -- 172.21.15.146:0/1474471770 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f1f9409b5c0 con 0x7f1fa006fa90 2024-09-17T03:40:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.448+0000 7f1f9f7fe640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f8c078b90 0x7f1f8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.448+0000 7f1f9f7fe640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f8c078b90 0x7f1f8c07b0a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1f90007fd0 tx=0x7f1f90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:24.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.452+0000 7f1f87fff640 1 -- 172.21.15.146:0/1474471770 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1f94014030 con 0x7f1fa006fa90 2024-09-17T03:40:24.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.701+0000 7f1fa5adc640 1 -- 172.21.15.146:0/1474471770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1fa00b62a0 con 0x7f1fa006fa90 2024-09-17T03:40:24.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.704+0000 7f1f87fff640 1 -- 172.21.15.146:0/1474471770 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7f1f94063980 con 0x7f1fa006fa90 2024-09-17T03:40:24.704 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:40:24.704 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:40:24.704 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:40:24.704 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:40:24.705 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:40:24.705 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:40:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.706+0000 7f1fa5adc640 1 -- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f8c078b90 msgr2=0x7f1f8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.706+0000 7f1fa5adc640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f8c078b90 0x7f1f8c07b0a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1f90007fd0 tx=0x7f1f90009040 comp rx=0 tx=0).stop 2024-09-17T03:40:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.706+0000 7f1fa5adc640 1 -- 172.21.15.146:0/1474471770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa006fa90 msgr2=0x7f1fa0140e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.706+0000 7f1fa5adc640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa006fa90 0x7f1fa0140e60 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400c970 tx=0x7f1f9400ce30 comp rx=0 tx=0).stop 2024-09-17T03:40:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.706+0000 7f1fa5adc640 1 -- 172.21.15.146:0/1474471770 shutdown_connections 2024-09-17T03:40:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.706+0000 7f1fa5adc640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1f8c078b90 0x7f1f8c07b0a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.706+0000 7f1fa5adc640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fa0152850 0x7f1fa00b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.706+0000 7f1fa5adc640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fa006fa90 0x7f1fa0140e60 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.707+0000 7f1fa5adc640 1 --2- 172.21.15.146:0/1474471770 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fa006f680 0x7f1fa014c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.707+0000 7f1fa5adc640 1 -- 172.21.15.146:0/1474471770 >> 172.21.15.146:0/1474471770 conn(0x7f1fa006dd60 msgr2=0x7f1fa00cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.707+0000 7f1fa5adc640 1 -- 172.21.15.146:0/1474471770 shutdown_connections 2024-09-17T03:40:24.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.707+0000 7f1fa5adc640 1 -- 172.21.15.146:0/1474471770 wait complete. 2024-09-17T03:40:24.718 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.831+0000 7f1c76e2e640 1 -- 172.21.15.146:0/3613365845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7015c8e0 msgr2=0x7f1c7006f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.831+0000 7f1c76e2e640 1 --2- 172.21.15.146:0/3613365845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7015c8e0 0x7f1c7006f580 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f1c60005fd0 tx=0x7f1c6002aa10 comp rx=0 tx=0).stop 2024-09-17T03:40:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.831+0000 7f1c76e2e640 1 -- 172.21.15.146:0/3613365845 shutdown_connections 2024-09-17T03:40:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.831+0000 7f1c76e2e640 1 --2- 172.21.15.146:0/3613365845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c700cdc50 0x7f1c700b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.831+0000 7f1c76e2e640 1 --2- 172.21.15.146:0/3613365845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7015c8e0 0x7f1c7006f580 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.831+0000 7f1c76e2e640 1 -- 172.21.15.146:0/3613365845 >> 172.21.15.146:0/3613365845 conn(0x7f1c700b3150 msgr2=0x7f1c700b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.831+0000 7f1c76e2e640 1 -- 172.21.15.146:0/3613365845 shutdown_connections 2024-09-17T03:40:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.831+0000 7f1c76e2e640 1 -- 172.21.15.146:0/3613365845 wait complete. 2024-09-17T03:40:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.833+0000 7f1c76e2e640 1 Processor -- start 2024-09-17T03:40:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.833+0000 7f1c76e2e640 1 -- start start 2024-09-17T03:40:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c76e2e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c700cd840 0x7f1c701e82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c76e2e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c700cdc50 0x7f1c70140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c76e2e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c7015c8e0 0x7f1c701f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c76e2e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70073580 con 0x7f1c700cdc50 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c76e2e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1c700b5460 con 0x7f1c7015c8e0 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c76e2e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1c70073700 con 0x7f1c700cd840 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c700cdc50 0x7f1c70140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c700cdc50 0x7f1c70140b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53562/0 (socket says 172.21.15.146:53562) 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c6ffff640 1 -- 172.21.15.146:0/495029857 learned_addr learned my addr 172.21.15.146:0/495029857 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c753cb640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c7015c8e0 0x7f1c701f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c74bca640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c700cd840 0x7f1c701e82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c6ffff640 1 -- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c700cd840 msgr2=0x7f1c701e82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c6ffff640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c700cd840 0x7f1c701e82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c6ffff640 1 -- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c7015c8e0 msgr2=0x7f1c701f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c6ffff640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c7015c8e0 0x7f1c701f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.834+0000 7f1c6ffff640 1 -- 172.21.15.146:0/495029857 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c701e8800 con 0x7f1c700cdc50 2024-09-17T03:40:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.835+0000 7f1c74bca640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c700cd840 0x7f1c701e82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.835+0000 7f1c6ffff640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c700cdc50 0x7f1c70140b30 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800c340 tx=0x7f1c5800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.835+0000 7f1c6d7fa640 1 -- 172.21.15.146:0/495029857 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58017070 con 0x7f1c700cdc50 2024-09-17T03:40:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.835+0000 7f1c6d7fa640 1 -- 172.21.15.146:0/495029857 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c580053c0 con 0x7f1c700cdc50 2024-09-17T03:40:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.835+0000 7f1c76e2e640 1 -- 172.21.15.146:0/495029857 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c701f6940 con 0x7f1c700cdc50 2024-09-17T03:40:24.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.835+0000 7f1c6d7fa640 1 -- 172.21.15.146:0/495029857 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58003850 con 0x7f1c700cdc50 2024-09-17T03:40:24.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.835+0000 7f1c76e2e640 1 -- 172.21.15.146:0/495029857 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c700cf700 con 0x7f1c700cdc50 2024-09-17T03:40:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.836+0000 7f1c76e2e640 1 -- 172.21.15.146:0/495029857 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c70050f60 con 0x7f1c700cdc50 2024-09-17T03:40:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.837+0000 7f1c6d7fa640 1 -- 172.21.15.146:0/495029857 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c5801a070 con 0x7f1c700cdc50 2024-09-17T03:40:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.837+0000 7f1c6d7fa640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c50078b90 0x7f1c5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.837+0000 7f1c6d7fa640 1 -- 172.21.15.146:0/495029857 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f1c58099f90 con 0x7f1c700cdc50 2024-09-17T03:40:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.838+0000 7f1c74bca640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c50078b90 0x7f1c5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:24.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.838+0000 7f1c74bca640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c50078b90 0x7f1c5007b0a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1c60035000 tx=0x7f1c60004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:24.842+0000 7f1c6d7fa640 1 -- 172.21.15.146:0/495029857 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c70050f60 con 0x7f1c700cdc50 2024-09-17T03:40:25.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.050+0000 7f1c76e2e640 1 -- 172.21.15.146:0/495029857 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c700b4ba0 con 0x7f1c700cdc50 2024-09-17T03:40:25.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.051+0000 7f1c6d7fa640 1 -- 172.21.15.146:0/495029857 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5237 (secure 0 0 0) 0x7f1c58061d90 con 0x7f1c700cdc50 2024-09-17T03:40:25.051 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:25.051 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6767,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1732967634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1732967634},{"type":"v1","addr":"172.21.15.146:6835","nonce":1732967634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2315176305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2315176305},{"type":"v1","addr":"172.21.15.179:6837","nonce":2315176305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1700206363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1700206363},{"type":"v1","addr":"172.21.15.179:6836","nonce":1700206363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:14.828261+0000","modified":"2024-09-17T03:40:17.844984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8187":{"gid":8187,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/2931720030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2931720030},{"type":"v1","addr":"172.21.15.146:6833","nonce":2931720030}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8187,"qdb_cluster":[8187]},"id":8}]} 2024-09-17T03:40:25.052 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 87 2024-09-17T03:40:25.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 -- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c50078b90 msgr2=0x7f1c5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c50078b90 0x7f1c5007b0a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1c60035000 tx=0x7f1c60004ab0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 -- 172.21.15.146:0/495029857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c700cdc50 msgr2=0x7f1c70140b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c700cdc50 0x7f1c70140b30 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800c340 tx=0x7f1c5800c800 comp rx=0 tx=0).stop 2024-09-17T03:40:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 -- 172.21.15.146:0/495029857 shutdown_connections 2024-09-17T03:40:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c50078b90 0x7f1c5007b0a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c7015c8e0 0x7f1c701f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c700cdc50 0x7f1c70140b30 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 --2- 172.21.15.146:0/495029857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c700cd840 0x7f1c701e82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 -- 172.21.15.146:0/495029857 >> 172.21.15.146:0/495029857 conn(0x7f1c700b3150 msgr2=0x7f1c700d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 -- 172.21.15.146:0/495029857 shutdown_connections 2024-09-17T03:40:25.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.053+0000 7f1c76e2e640 1 -- 172.21.15.146:0/495029857 wait complete. 2024-09-17T03:40:25.469 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 87, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:40:14.828261+0000', 'modified': '2024-09-17T03:40:17.844984+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8187}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8187': {'gid': 8187, 'name': 'a', 'rank': 0, 'incarnation': 83, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6833/2931720030', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 2931720030}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 2931720030}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8187, 'qdb_cluster': [8187]} 2024-09-17T03:40:25.469 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:40:25.469 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:40:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.587+0000 7f7c2eb50640 1 -- 172.21.15.146:0/505444187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c280b5ce0 msgr2=0x7f7c280b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.587+0000 7f7c2eb50640 1 --2- 172.21.15.146:0/505444187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c280b5ce0 0x7f7c280b1320 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f7c24005fd0 tx=0x7f7c2402a670 comp rx=0 tx=0).stop 2024-09-17T03:40:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.587+0000 7f7c2eb50640 1 -- 172.21.15.146:0/505444187 shutdown_connections 2024-09-17T03:40:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.587+0000 7f7c2eb50640 1 --2- 172.21.15.146:0/505444187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c280b5ce0 0x7f7c280b1320 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.587+0000 7f7c2eb50640 1 -- 172.21.15.146:0/505444187 >> 172.21.15.146:0/505444187 conn(0x7f7c280b7b20 msgr2=0x7f7c2809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.587+0000 7f7c2eb50640 1 -- 172.21.15.146:0/505444187 shutdown_connections 2024-09-17T03:40:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.587+0000 7f7c2eb50640 1 -- 172.21.15.146:0/505444187 wait complete. 2024-09-17T03:40:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.589+0000 7f7c2eb50640 1 Processor -- start 2024-09-17T03:40:25.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.589+0000 7f7c2eb50640 1 -- start start 2024-09-17T03:40:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c2eb50640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c280b5750 0x7f7c281f9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c2eb50640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c280b5ce0 0x7f7c281e8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c2eb50640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c281e8640 0x7f7c2815dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c2eb50640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2815d680 con 0x7f7c280b5ce0 2024-09-17T03:40:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c2eb50640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2815d500 con 0x7f7c281e8640 2024-09-17T03:40:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c2eb50640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2815d800 con 0x7f7c280b5750 2024-09-17T03:40:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c280b5ce0 0x7f7c281e8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c280b5ce0 0x7f7c281e8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53584/0 (socket says 172.21.15.146:53584) 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1ffff640 1 -- 172.21.15.146:0/2558226650 learned_addr learned my addr 172.21.15.146:0/2558226650 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c2c8ec640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c280b5750 0x7f7c281f9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c2d0ed640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c281e8640 0x7f7c2815dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1ffff640 1 -- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c280b5750 msgr2=0x7f7c281f9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c280b5750 0x7f7c281f9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1ffff640 1 -- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c281e8640 msgr2=0x7f7c2815dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c281e8640 0x7f7c2815dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1ffff640 1 -- 172.21.15.146:0/2558226650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c281e8a50 con 0x7f7c280b5ce0 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c280b5ce0 0x7f7c281e8100 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800c3a0 tx=0x7f7c1800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1d7fa640 1 -- 172.21.15.146:0/2558226650 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18017070 con 0x7f7c280b5ce0 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1d7fa640 1 -- 172.21.15.146:0/2558226650 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c180053c0 con 0x7f7c280b5ce0 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c2eb50640 1 -- 172.21.15.146:0/2558226650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2806e1f0 con 0x7f7c280b5ce0 2024-09-17T03:40:25.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.591+0000 7f7c1d7fa640 1 -- 172.21.15.146:0/2558226650 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18003850 con 0x7f7c280b5ce0 2024-09-17T03:40:25.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.592+0000 7f7c2eb50640 1 -- 172.21.15.146:0/2558226650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2806e7b0 con 0x7f7c280b5ce0 2024-09-17T03:40:25.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.593+0000 7f7c1d7fa640 1 -- 172.21.15.146:0/2558226650 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c1801a070 con 0x7f7c280b5ce0 2024-09-17T03:40:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.594+0000 7f7c1d7fa640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c14078b90 0x7f7c1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.594+0000 7f7c1d7fa640 1 -- 172.21.15.146:0/2558226650 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f7c1809a000 con 0x7f7c280b5ce0 2024-09-17T03:40:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.594+0000 7f7c2c8ec640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c14078b90 0x7f7c1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.595+0000 7f7c35abb740 1 Processor -- start 2024-09-17T03:40:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.595+0000 7f7c35abb740 1 -- start start 2024-09-17T03:40:25.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.595+0000 7f7c2c8ec640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c14078b90 0x7f7c1407b0a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7c24033000 tx=0x7f7c24004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:25.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f37fcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f34023b0 0x5619f37fd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f340a590 0x5619f381a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c35abb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5619f3745820 con 0x5619f34023b0 2024-09-17T03:40:25.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c35abb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5619f3734c50 con 0x5619f340a590 2024-09-17T03:40:25.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c35abb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5619f3738a60 con 0x5619f342b270 2024-09-17T03:40:25.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f34023b0 0x5619f37fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f34023b0 0x5619f37fd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53586/0 (socket says 172.21.15.146:53586) 2024-09-17T03:40:25.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c1ffff640 1 -- 172.21.15.146:0/3173886484 learned_addr learned my addr 172.21.15.146:0/3173886484 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:25.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c2c8ec640 1 --2- 172.21.15.146:0/3173886484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f37fcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c2d0ed640 1 --2- 172.21.15.146:0/3173886484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f340a590 0x5619f381a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c1ffff640 1 -- 172.21.15.146:0/3173886484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 msgr2=0x5619f37fcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/3173886484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f37fcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c1ffff640 1 -- 172.21.15.146:0/3173886484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f340a590 msgr2=0x5619f381a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/3173886484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f340a590 0x5619f381a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.596+0000 7f7c1ffff640 1 -- 172.21.15.146:0/3173886484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619f3496850 con 0x5619f34023b0 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.597+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/3173886484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f34023b0 0x5619f37fd4e0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f7c180984a0 tx=0x7f7c18061680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15e37af7bbeb0f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.597+0000 7f7c0e7fc640 1 -- 172.21.15.146:0/3173886484 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18088170 con 0x5619f34023b0 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.597+0000 7f7c0e7fc640 1 -- 172.21.15.146:0/3173886484 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c18066940 con 0x5619f34023b0 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.597+0000 7f7c0e7fc640 1 -- 172.21.15.146:0/3173886484 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c180613b0 con 0x5619f34023b0 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.597+0000 7f7c35abb740 1 -- 172.21.15.146:0/3173886484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f34023b0 msgr2=0x5619f37fd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.597+0000 7f7c35abb740 1 --2- 172.21.15.146:0/3173886484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f34023b0 0x5619f37fd4e0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f7c180984a0 tx=0x7f7c18061680 comp rx=0 tx=0).stop 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.598+0000 7f7c35abb740 1 -- 172.21.15.146:0/3173886484 shutdown_connections 2024-09-17T03:40:25.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.598+0000 7f7c35abb740 1 --2- 172.21.15.146:0/3173886484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f340a590 0x5619f381a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.598+0000 7f7c35abb740 1 --2- 172.21.15.146:0/3173886484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f34023b0 0x5619f37fd4e0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.598+0000 7f7c35abb740 1 --2- 172.21.15.146:0/3173886484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f37fcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.598+0000 7f7c35abb740 1 -- 172.21.15.146:0/3173886484 >> 172.21.15.146:0/3173886484 conn(0x5619f341f3c0 msgr2=0x5619f37d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:25.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.598+0000 7f7c35abb740 1 -- 172.21.15.146:0/3173886484 shutdown_connections 2024-09-17T03:40:25.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.598+0000 7f7c35abb740 1 -- 172.21.15.146:0/3173886484 wait complete. 2024-09-17T03:40:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.598+0000 7f7c35abb740 1 -- start start 2024-09-17T03:40:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.599+0000 7f7c35abb740 1 Processor -- start 2024-09-17T03:40:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f382a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f382ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f382b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c35abb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5619f34a5620 con 0x5619f340a590 2024-09-17T03:40:25.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c35abb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5619f36da5f0 con 0x5619f34023b0 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c35abb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5619f37fda20 con 0x5619f342b270 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c35abb740 10 client.0 _ll_register_callbacks cb 0x5619f36de0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f382ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f382ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53598/0 (socket says 172.21.15.146:53598) 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c1ffff640 1 -- 172.21.15.146:0/3463527463 learned_addr learned my addr 172.21.15.146:0/3463527463 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c2c8ec640 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f382a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c2d0ed640 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f382b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c1ffff640 1 -- 172.21.15.146:0/3463527463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 msgr2=0x5619f382b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f382b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c1ffff640 1 -- 172.21.15.146:0/3463527463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 msgr2=0x5619f382a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f382a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.600+0000 7f7c1ffff640 1 -- 172.21.15.146:0/3463527463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619f350d6b0 con 0x5619f340a590 2024-09-17T03:40:25.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f382ad40 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f7c1805e490 tx=0x7f7c18061400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2330892405d68b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c077fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c077fe640 1 -- 172.21.15.146:0/3463527463 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1806b7f0 con 0x5619f340a590 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c077fe640 1 -- 172.21.15.146:0/3463527463 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f7c1805da70 con 0x5619f340a590 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c35abb740 1 -- 172.21.15.146:0/3463527463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c18066940 con 0x5619f340a590 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c077fe640 1 -- 172.21.15.146:0/3463527463 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f7c18067ad0 con 0x5619f340a590 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c35abb740 10 client.8355 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c35abb740 1 -- 172.21.15.146:0/3463527463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5619f3810730 con 0x5619f340a590 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c077fe640 1 -- 172.21.15.146:0/3463527463 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c18066940 con 0x5619f340a590 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c077fe640 1 -- 172.21.15.146:0/3463527463 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f7c18067c70 con 0x5619f340a590 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c35abb740 10 client.8355 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c35abb740 10 client.8355 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:40:25.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c35abb740 20 client.8355 populate_metadata read hostname 'smithi146' 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c35abb740 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5619f33e9e40 0x5619f3834b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c35abb740 4 client.8355 mds_command: new command op to 8187 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c35abb740 1 -- 172.21.15.146:0/3463527463 --> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619f3747770 con 0x5619f33e9e40 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.601+0000 7f7c2c8ec640 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5619f33e9e40 0x5619f3834b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.602+0000 7f7c077fe640 10 client.8355 ms_handle_connect on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.602+0000 7f7c2c8ec640 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5619f33e9e40 0x5619f3834b10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a029fd69c8efe8c server_cookie=5abc8a44354268f9 in_seq=0 out_seq=0 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.602+0000 7f7c077fe640 1 -- 172.21.15.146:0/3463527463 <== mds.0 v2:172.21.15.146:6832/2931720030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619f3747770 con 0x5619f33e9e40 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.602+0000 7f7c077fe640 10 client.8355 handle_command_reply: tid=0 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.602+0000 7f7c35abb740 1 client.8355 shutdown 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c35abb740 1 -- 172.21.15.146:0/3463527463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 msgr2=0x5619f382ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c35abb740 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f382ad40 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f7c1805e490 tx=0x7f7c18061400 comp rx=0 tx=0).stop 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c35abb740 1 -- 172.21.15.146:0/3463527463 shutdown_connections 2024-09-17T03:40:25.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c35abb740 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5619f33e9e40 0x5619f3834b10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c35abb740 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f382b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c35abb740 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f382ad40 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c35abb740 1 --2- 172.21.15.146:0/3463527463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f382a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c077fe640 0 client.8355 ms_handle_reset on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c35abb740 1 -- 172.21.15.146:0/3463527463 >> 172.21.15.146:0/3463527463 conn(0x5619f341f3c0 msgr2=0x5619f37ec760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c35abb740 1 -- 172.21.15.146:0/3463527463 shutdown_connections 2024-09-17T03:40:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c35abb740 1 -- 172.21.15.146:0/3463527463 wait complete. 2024-09-17T03:40:25.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.603+0000 7f7c35abb740 20 client.8355 trim_cache size 0 max 16384 2024-09-17T03:40:25.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.621+0000 7f7c35abb740 1 Processor -- start 2024-09-17T03:40:25.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.621+0000 7f7c35abb740 1 -- start start 2024-09-17T03:40:25.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.622+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f380e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.622+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f340a590 0x5619f37fca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.622+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f342b270 0x5619f37fcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.622+0000 7f7c35abb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7c282012a0 con 0x5619f342b270 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.622+0000 7f7c35abb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7c281f5d30 con 0x5619f34023b0 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.622+0000 7f7c35abb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7c281f6380 con 0x5619f340a590 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c2d0ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f342b270 0x5619f37fcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c2d0ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f342b270 0x5619f37fcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53604/0 (socket says 172.21.15.146:53604) 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c2d0ed640 1 -- 172.21.15.146:0/1168654512 learned_addr learned my addr 172.21.15.146:0/1168654512 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c2c8ec640 1 --2- 172.21.15.146:0/1168654512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f380e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/1168654512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f340a590 0x5619f37fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c2d0ed640 1 -- 172.21.15.146:0/1168654512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f340a590 msgr2=0x5619f37fca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c2d0ed640 1 --2- 172.21.15.146:0/1168654512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f340a590 0x5619f37fca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c2d0ed640 1 -- 172.21.15.146:0/1168654512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 msgr2=0x5619f380e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c2d0ed640 1 --2- 172.21.15.146:0/1168654512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f380e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c2d0ed640 1 -- 172.21.15.146:0/1168654512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619f37fa820 con 0x5619f342b270 2024-09-17T03:40:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/1168654512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f340a590 0x5619f37fca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c2d0ed640 1 --2- 172.21.15.146:0/1168654512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f342b270 0x5619f37fcf50 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f7c20001ef0 tx=0x7f7c20015780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82e3fa227f1fab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c0dffb640 1 -- 172.21.15.146:0/1168654512 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20006b30 con 0x5619f342b270 2024-09-17T03:40:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c0dffb640 1 -- 172.21.15.146:0/1168654512 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c20006de0 con 0x5619f342b270 2024-09-17T03:40:25.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.623+0000 7f7c0dffb640 1 -- 172.21.15.146:0/1168654512 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20003bd0 con 0x5619f342b270 2024-09-17T03:40:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.624+0000 7f7c35abb740 1 -- 172.21.15.146:0/1168654512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f342b270 msgr2=0x5619f37fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.624+0000 7f7c35abb740 1 --2- 172.21.15.146:0/1168654512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f342b270 0x5619f37fcf50 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f7c20001ef0 tx=0x7f7c20015780 comp rx=0 tx=0).stop 2024-09-17T03:40:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.624+0000 7f7c35abb740 1 -- 172.21.15.146:0/1168654512 shutdown_connections 2024-09-17T03:40:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.624+0000 7f7c35abb740 1 --2- 172.21.15.146:0/1168654512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f342b270 0x5619f37fcf50 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.624+0000 7f7c35abb740 1 --2- 172.21.15.146:0/1168654512 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f340a590 0x5619f37fca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.624+0000 7f7c35abb740 1 --2- 172.21.15.146:0/1168654512 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f380e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.624+0000 7f7c35abb740 1 -- 172.21.15.146:0/1168654512 >> 172.21.15.146:0/1168654512 conn(0x5619f341f3c0 msgr2=0x5619f380ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.624+0000 7f7c35abb740 1 -- 172.21.15.146:0/1168654512 shutdown_connections 2024-09-17T03:40:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.624+0000 7f7c35abb740 1 -- 172.21.15.146:0/1168654512 wait complete. 2024-09-17T03:40:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.625+0000 7f7c35abb740 1 -- start start 2024-09-17T03:40:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.625+0000 7f7c35abb740 1 Processor -- start 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f388c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f380e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c35abb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f3825380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c35abb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5619f34a5620 con 0x5619f340a590 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c35abb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5619f36da5f0 con 0x5619f34023b0 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c35abb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5619f3827da0 con 0x5619f342b270 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c35abb740 10 client.0 _ll_register_callbacks cb 0x7f7c18087070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f380e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f380e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53614/0 (socket says 172.21.15.146:53614) 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c1ffff640 1 -- 172.21.15.146:0/1065076331 learned_addr learned my addr 172.21.15.146:0/1065076331 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c2c8ec640 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f388c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c2d0ed640 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f3825380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c1ffff640 1 -- 172.21.15.146:0/1065076331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 msgr2=0x5619f3825380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f3825380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c1ffff640 1 -- 172.21.15.146:0/1065076331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 msgr2=0x5619f388c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f388c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c1ffff640 1 -- 172.21.15.146:0/1065076331 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619f388cbe0 con 0x5619f340a590 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c1ffff640 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f380e0a0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f7c1805f180 tx=0x7f7c18067f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c61c4dcbc005da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c077fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c077fe640 1 -- 172.21.15.146:0/1065076331 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1806b7f0 con 0x5619f340a590 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c077fe640 1 -- 172.21.15.146:0/1065076331 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f7c18060df0 con 0x5619f340a590 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c35abb740 1 -- 172.21.15.146:0/1065076331 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c20006de0 con 0x5619f340a590 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c077fe640 1 -- 172.21.15.146:0/1065076331 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f7c18061470 con 0x5619f340a590 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c35abb740 10 client.8361 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c35abb740 1 -- 172.21.15.146:0/1065076331 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5619f388cbe0 con 0x5619f340a590 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.627+0000 7f7c077fe640 1 -- 172.21.15.146:0/1065076331 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c20006de0 con 0x5619f340a590 2024-09-17T03:40:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c077fe640 1 -- 172.21.15.146:0/1065076331 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f7c18066330 con 0x5619f340a590 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c35abb740 10 client.8361 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c35abb740 10 client.8361 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c35abb740 20 client.8361 populate_metadata read hostname 'smithi146' 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c35abb740 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5619f38258c0 0x5619f37eac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c35abb740 4 client.8361 mds_command: new command op to 8187 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c35abb740 1 -- 172.21.15.146:0/1065076331 --> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] -- command(tid 0: {"prefix": "status"}) -- 0x5619f37f99d0 con 0x5619f38258c0 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c2c8ec640 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5619f38258c0 0x5619f37eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c077fe640 10 client.8361 ms_handle_connect on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c2c8ec640 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5619f38258c0 0x5619f37eac70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=879cd4e7744a5811 server_cookie=e3adaf85b109c8c4 in_seq=0 out_seq=0 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c077fe640 1 -- 172.21.15.146:0/1065076331 <== mds.0 v2:172.21.15.146:6832/2931720030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5619f37f99d0 con 0x5619f38258c0 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c077fe640 10 client.8361 handle_command_reply: tid=0 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.628+0000 7f7c35abb740 1 client.8361 shutdown 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c35abb740 1 -- 172.21.15.146:0/1065076331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 msgr2=0x5619f380e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c35abb740 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f380e0a0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f7c1805f180 tx=0x7f7c18067f00 comp rx=0 tx=0).stop 2024-09-17T03:40:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c35abb740 1 -- 172.21.15.146:0/1065076331 shutdown_connections 2024-09-17T03:40:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c35abb740 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5619f38258c0 0x5619f37eac70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c35abb740 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5619f342b270 0x5619f3825380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c077fe640 0 client.8361 ms_handle_reset on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c35abb740 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5619f340a590 0x5619f380e0a0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c35abb740 1 --2- 172.21.15.146:0/1065076331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5619f34023b0 0x5619f388c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c35abb740 1 -- 172.21.15.146:0/1065076331 >> 172.21.15.146:0/1065076331 conn(0x5619f341f3c0 msgr2=0x5619f37ebe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c35abb740 1 -- 172.21.15.146:0/1065076331 shutdown_connections 2024-09-17T03:40:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c35abb740 1 -- 172.21.15.146:0/1065076331 wait complete. 2024-09-17T03:40:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c35abb740 20 client.8361 trim_cache size 0 max 16384 2024-09-17T03:40:25.634 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 8187, 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.169170923999999, 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 87, 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 117, 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 117, 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 14.868777225000001 2024-09-17T03:40:25.635 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:40:25.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c2eb50640 1 -- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c14078b90 msgr2=0x7f7c1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c2eb50640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c14078b90 0x7f7c1407b0a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7c24033000 tx=0x7f7c24004730 comp rx=0 tx=0).stop 2024-09-17T03:40:25.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c2eb50640 1 -- 172.21.15.146:0/2558226650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c280b5ce0 msgr2=0x7f7c281e8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c2eb50640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c280b5ce0 0x7f7c281e8100 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800c3a0 tx=0x7f7c1800c860 comp rx=0 tx=0).stop 2024-09-17T03:40:25.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c2eb50640 1 -- 172.21.15.146:0/2558226650 shutdown_connections 2024-09-17T03:40:25.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.629+0000 7f7c2eb50640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c14078b90 0x7f7c1407b0a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.630+0000 7f7c2eb50640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c281e8640 0x7f7c2815dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.630+0000 7f7c2eb50640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c280b5ce0 0x7f7c281e8100 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.630+0000 7f7c2eb50640 1 --2- 172.21.15.146:0/2558226650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c280b5750 0x7f7c281f9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.630+0000 7f7c2eb50640 1 -- 172.21.15.146:0/2558226650 >> 172.21.15.146:0/2558226650 conn(0x7f7c280b7b20 msgr2=0x7f7c280b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:25.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.630+0000 7f7c2eb50640 1 -- 172.21.15.146:0/2558226650 shutdown_connections 2024-09-17T03:40:25.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.630+0000 7f7c2eb50640 1 -- 172.21.15.146:0/2558226650 wait complete. 2024-09-17T03:40:25.641 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:40:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.754+0000 7f0480982640 1 -- 172.21.15.146:0/520803683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0468003a30 msgr2=0x7f0468003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.754+0000 7f0480982640 1 --2- 172.21.15.146:0/520803683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0468003a30 0x7f0468003ea0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f046c009b50 tx=0x7f0468005830 comp rx=0 tx=0).stop 2024-09-17T03:40:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.754+0000 7f047ad9d640 1 -- 172.21.15.146:0/520803683 reap_dead start 2024-09-17T03:40:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.754+0000 7f0480982640 1 -- 172.21.15.146:0/520803683 shutdown_connections 2024-09-17T03:40:25.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.754+0000 7f0480982640 1 -- 172.21.15.146:0/520803683 >> 172.21.15.146:0/520803683 conn(0x7f047c0b3410 msgr2=0x7f047c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.754+0000 7f0480982640 1 -- 172.21.15.146:0/520803683 shutdown_connections 2024-09-17T03:40:25.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.754+0000 7f0480982640 1 -- 172.21.15.146:0/520803683 wait complete. 2024-09-17T03:40:25.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.756+0000 7f0480982640 1 Processor -- start 2024-09-17T03:40:25.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.756+0000 7f0480982640 1 -- start start 2024-09-17T03:40:25.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.757+0000 7f0480982640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0468003a30 0x7f047c1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.757+0000 7f0480982640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f047c1435e0 0x7f047c1439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.757+0000 7f0480982640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f047c0d0cc0 0x7f047c0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.757+0000 7f0480982640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f047c070f70 con 0x7f047c1435e0 2024-09-17T03:40:25.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.757+0000 7f0480982640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f047c070df0 con 0x7f0468003a30 2024-09-17T03:40:25.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.757+0000 7f0480982640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f047c15bd10 con 0x7f047c0d0cc0 2024-09-17T03:40:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.757+0000 7f0471d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f047c1435e0 0x7f047c1439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.757+0000 7f0471d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f047c1435e0 0x7f047c1439f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53640/0 (socket says 172.21.15.146:53640) 2024-09-17T03:40:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.757+0000 7f0471d9b640 1 -- 172.21.15.146:0/247176319 learned_addr learned my addr 172.21.15.146:0/247176319 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f047a59c640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0468003a30 0x7f047c1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f047ad9d640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f047c0d0cc0 0x7f047c0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f0471d9b640 1 -- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f047c0d0cc0 msgr2=0x7f047c0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f0471d9b640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f047c0d0cc0 0x7f047c0d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f0471d9b640 1 -- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0468003a30 msgr2=0x7f047c1521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f0471d9b640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0468003a30 0x7f047c1521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f0471d9b640 1 -- 172.21.15.146:0/247176319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c1444b0 con 0x7f047c1435e0 2024-09-17T03:40:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f047ad9d640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f047c0d0cc0 0x7f047c0d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f0471d9b640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f047c1435e0 0x7f047c1439f0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f0464001eb0 tx=0x7f046400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f04737fe640 1 -- 172.21.15.146:0/247176319 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0464015070 con 0x7f047c1435e0 2024-09-17T03:40:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f04737fe640 1 -- 172.21.15.146:0/247176319 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f046400ca00 con 0x7f047c1435e0 2024-09-17T03:40:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f04737fe640 1 -- 172.21.15.146:0/247176319 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046400ce30 con 0x7f047c1435e0 2024-09-17T03:40:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f0480982640 1 -- 172.21.15.146:0/247176319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047c0ce8e0 con 0x7f047c1435e0 2024-09-17T03:40:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.758+0000 7f0480982640 1 -- 172.21.15.146:0/247176319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047c0cebc0 con 0x7f047c1435e0 2024-09-17T03:40:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.759+0000 7f0480982640 1 -- 172.21.15.146:0/247176319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047c0b4530 con 0x7f047c1435e0 2024-09-17T03:40:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.760+0000 7f04737fe640 1 -- 172.21.15.146:0/247176319 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0464018070 con 0x7f047c1435e0 2024-09-17T03:40:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.760+0000 7f04737fe640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f045c078b90 0x7f045c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.761+0000 7f04737fe640 1 -- 172.21.15.146:0/247176319 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f046409b1f0 con 0x7f047c1435e0 2024-09-17T03:40:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.761+0000 7f047a59c640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f045c078b90 0x7f045c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.761+0000 7f047a59c640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f045c078b90 0x7f045c07b0a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f046c035000 tx=0x7f046c02d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.765+0000 7f04737fe640 1 -- 172.21.15.146:0/247176319 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0464062fe0 con 0x7f047c1435e0 2024-09-17T03:40:25.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.976+0000 7f0480982640 1 -- 172.21.15.146:0/247176319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f047c0cde90 con 0x7f047c1435e0 2024-09-17T03:40:25.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.976+0000 7f04737fe640 1 -- 172.21.15.146:0/247176319 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v87) ==== 53+0+73 (secure 0 0 0) 0x7f0464067a10 con 0x7f047c1435e0 2024-09-17T03:40:25.977 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:40:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.978+0000 7f0480982640 1 -- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f045c078b90 msgr2=0x7f045c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.978+0000 7f0480982640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f045c078b90 0x7f045c07b0a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f046c035000 tx=0x7f046c02d040 comp rx=0 tx=0).stop 2024-09-17T03:40:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.978+0000 7f0480982640 1 -- 172.21.15.146:0/247176319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f047c1435e0 msgr2=0x7f047c1439f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.978+0000 7f0480982640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f047c1435e0 0x7f047c1439f0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f0464001eb0 tx=0x7f046400ea70 comp rx=0 tx=0).stop 2024-09-17T03:40:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.979+0000 7f0480982640 1 -- 172.21.15.146:0/247176319 shutdown_connections 2024-09-17T03:40:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.979+0000 7f0480982640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f045c078b90 0x7f045c07b0a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.979+0000 7f0480982640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f047c0d0cc0 0x7f047c0d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.979+0000 7f0480982640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f047c1435e0 0x7f047c1439f0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.979+0000 7f0480982640 1 --2- 172.21.15.146:0/247176319 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0468003a30 0x7f047c1521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.979+0000 7f0480982640 1 -- 172.21.15.146:0/247176319 >> 172.21.15.146:0/247176319 conn(0x7f047c0b3410 msgr2=0x7f047c0b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.979+0000 7f0480982640 1 -- 172.21.15.146:0/247176319 shutdown_connections 2024-09-17T03:40:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:25.979+0000 7f0480982640 1 -- 172.21.15.146:0/247176319 wait complete. 2024-09-17T03:40:25.991 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:40:25.991 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:40:25.991 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:40:25.991 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:40:25.991 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:25.991 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:40:25.991 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:40:25.991 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:40:25.991 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:25.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:25.991 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:40:26.008 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:40:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:40:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:40:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:40:26.008 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:40:26.009 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42346sec preferred_lft 42346sec 2024-09-17T03:40:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:40:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:26.010 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:40:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:40:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:40:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:40:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:26.010 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:40:26.010 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:40:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:26.011 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:40:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:40:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:40:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:40:26.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:26.011 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:40:26.072 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:40:26.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:26.073 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:40:26.130 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:40:26.130 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:40:26.130 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:40:26.130 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:40:26.131 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:40:26.131 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:40:26.131 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:26.131 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:40:26.131 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:40:26.131 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:40:26.131 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:26.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:40:26.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:26.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:26.258 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:40:26.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:40:26.273 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:40:26.273 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:26.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:26.274 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:40:26.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:26.339 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:26.396 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:40:26.396 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:40:26.397 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:26.451 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:40:26.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:26.451 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:26.546 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:26.547 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:40:26.557 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:26.557 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:26.557 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:40:26.557 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:40:26.557 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:26.563 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:40:26.563 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:40:26.563 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:40:26.563 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:40:26.564 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:40:26.564 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:40:26.564 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:40:26.564 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:40:26.564 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:40:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:40:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:40:26.564 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:40:26.565 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:40:26.566 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:40:26.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:26.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:26.592 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:40:26.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:26.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:26.692 INFO:teuthology.orchestra.run.smithi146.stdout:client7489 2024-09-17T03:40:26.692 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:40:26.692 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:26.708 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:26.708 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:26.708 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.0 2024-09-17T03:40:26.708 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:26.709 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:26.709 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:26.709 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:26.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:26.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.817 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099241 s, 106 MB/s 2024-09-17T03:40:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074556 s, 141 MB/s 2024-09-17T03:40:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884294 s, 119 MB/s 2024-09-17T03:40:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599104 s, 175 MB/s 2024-09-17T03:40:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721823 s, 145 MB/s 2024-09-17T03:40:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743987 s, 141 MB/s 2024-09-17T03:40:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.872 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086965 s, 121 MB/s 2024-09-17T03:40:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006789 s, 154 MB/s 2024-09-17T03:40:26.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691637 s, 152 MB/s 2024-09-17T03:40:26.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759562 s, 138 MB/s 2024-09-17T03:40:26.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.908 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708805 s, 148 MB/s 2024-09-17T03:40:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686942 s, 153 MB/s 2024-09-17T03:40:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670486 s, 156 MB/s 2024-09-17T03:40:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815695 s, 129 MB/s 2024-09-17T03:40:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00818331 s, 128 MB/s 2024-09-17T03:40:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702826 s, 149 MB/s 2024-09-17T03:40:26.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716718 s, 146 MB/s 2024-09-17T03:40:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687094 s, 153 MB/s 2024-09-17T03:40:26.978 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.979 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690172 s, 152 MB/s 2024-09-17T03:40:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.987 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685767 s, 153 MB/s 2024-09-17T03:40:26.995 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:26.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:26.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698363 s, 150 MB/s 2024-09-17T03:40:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.004 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668173 s, 157 MB/s 2024-09-17T03:40:27.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.012 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590922 s, 177 MB/s 2024-09-17T03:40:27.020 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.021 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680753 s, 154 MB/s 2024-09-17T03:40:27.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681155 s, 154 MB/s 2024-09-17T03:40:27.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.037 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678551 s, 155 MB/s 2024-09-17T03:40:27.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.046 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665423 s, 158 MB/s 2024-09-17T03:40:27.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.054 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657192 s, 160 MB/s 2024-09-17T03:40:27.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.063 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667493 s, 157 MB/s 2024-09-17T03:40:27.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.071 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068576 s, 153 MB/s 2024-09-17T03:40:27.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.080 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652873 s, 161 MB/s 2024-09-17T03:40:27.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.089 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080902 s, 130 MB/s 2024-09-17T03:40:27.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:27.096 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:27.096 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:27.096 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.1 2024-09-17T03:40:27.096 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:27.096 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:27.096 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:27.096 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657878 s, 159 MB/s 2024-09-17T03:40:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074514 s, 141 MB/s 2024-09-17T03:40:27.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.172 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661056 s, 159 MB/s 2024-09-17T03:40:27.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689731 s, 152 MB/s 2024-09-17T03:40:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648197 s, 162 MB/s 2024-09-17T03:40:27.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642094 s, 163 MB/s 2024-09-17T03:40:27.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.205 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674363 s, 155 MB/s 2024-09-17T03:40:27.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.213 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681946 s, 154 MB/s 2024-09-17T03:40:27.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.222 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659878 s, 159 MB/s 2024-09-17T03:40:27.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062352 s, 168 MB/s 2024-09-17T03:40:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659028 s, 159 MB/s 2024-09-17T03:40:27.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.246 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670682 s, 156 MB/s 2024-09-17T03:40:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.255 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676952 s, 155 MB/s 2024-09-17T03:40:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610188 s, 172 MB/s 2024-09-17T03:40:27.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.271 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656281 s, 160 MB/s 2024-09-17T03:40:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.278 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602712 s, 174 MB/s 2024-09-17T03:40:27.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.287 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661856 s, 158 MB/s 2024-09-17T03:40:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.296 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736766 s, 142 MB/s 2024-09-17T03:40:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853712 s, 123 MB/s 2024-09-17T03:40:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674435 s, 155 MB/s 2024-09-17T03:40:27.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.322 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605824 s, 173 MB/s 2024-09-17T03:40:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592045 s, 177 MB/s 2024-09-17T03:40:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727008 s, 144 MB/s 2024-09-17T03:40:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622437 s, 168 MB/s 2024-09-17T03:40:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619229 s, 169 MB/s 2024-09-17T03:40:27.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.363 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612336 s, 171 MB/s 2024-09-17T03:40:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587697 s, 178 MB/s 2024-09-17T03:40:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646827 s, 162 MB/s 2024-09-17T03:40:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655483 s, 160 MB/s 2024-09-17T03:40:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627481 s, 167 MB/s 2024-09-17T03:40:27.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.405 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757988 s, 138 MB/s 2024-09-17T03:40:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652797 s, 161 MB/s 2024-09-17T03:40:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:27.419 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:27.420 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:27.420 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.2 2024-09-17T03:40:27.420 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:27.420 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:27.420 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:27.420 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:27.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691466 s, 152 MB/s 2024-09-17T03:40:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659125 s, 159 MB/s 2024-09-17T03:40:27.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.494 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594255 s, 176 MB/s 2024-09-17T03:40:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657804 s, 159 MB/s 2024-09-17T03:40:27.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.511 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.511 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695152 s, 151 MB/s 2024-09-17T03:40:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078422 s, 134 MB/s 2024-09-17T03:40:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658917 s, 159 MB/s 2024-09-17T03:40:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669225 s, 157 MB/s 2024-09-17T03:40:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688183 s, 152 MB/s 2024-09-17T03:40:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650804 s, 161 MB/s 2024-09-17T03:40:27.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.563 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676408 s, 155 MB/s 2024-09-17T03:40:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628448 s, 167 MB/s 2024-09-17T03:40:27.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.578 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065894 s, 159 MB/s 2024-09-17T03:40:27.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.587 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656388 s, 160 MB/s 2024-09-17T03:40:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743213 s, 141 MB/s 2024-09-17T03:40:27.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661998 s, 158 MB/s 2024-09-17T03:40:27.613 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.613 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.613 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735979 s, 142 MB/s 2024-09-17T03:40:27.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.621 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609623 s, 172 MB/s 2024-09-17T03:40:27.629 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.629 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.630 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665229 s, 158 MB/s 2024-09-17T03:40:27.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.637 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611081 s, 172 MB/s 2024-09-17T03:40:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725331 s, 145 MB/s 2024-09-17T03:40:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611774 s, 171 MB/s 2024-09-17T03:40:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596176 s, 176 MB/s 2024-09-17T03:40:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661292 s, 159 MB/s 2024-09-17T03:40:27.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.679 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664585 s, 158 MB/s 2024-09-17T03:40:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599014 s, 175 MB/s 2024-09-17T03:40:27.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667534 s, 157 MB/s 2024-09-17T03:40:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732137 s, 143 MB/s 2024-09-17T03:40:27.713 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.713 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.713 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744588 s, 141 MB/s 2024-09-17T03:40:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605315 s, 173 MB/s 2024-09-17T03:40:27.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.729 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725467 s, 145 MB/s 2024-09-17T03:40:27.737 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667917 s, 157 MB/s 2024-09-17T03:40:27.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:27.744 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:27.744 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:27.744 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.3 2024-09-17T03:40:27.744 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:27.744 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:27.745 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:27.745 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:27.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:27.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.804 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679489 s, 154 MB/s 2024-09-17T03:40:27.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653888 s, 160 MB/s 2024-09-17T03:40:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663858 s, 158 MB/s 2024-09-17T03:40:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661894 s, 158 MB/s 2024-09-17T03:40:27.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061182 s, 171 MB/s 2024-09-17T03:40:27.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.845 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678607 s, 155 MB/s 2024-09-17T03:40:27.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.854 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751256 s, 140 MB/s 2024-09-17T03:40:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641426 s, 163 MB/s 2024-09-17T03:40:27.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.870 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581718 s, 180 MB/s 2024-09-17T03:40:27.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.878 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624466 s, 168 MB/s 2024-09-17T03:40:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727853 s, 144 MB/s 2024-09-17T03:40:27.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.896 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723693 s, 145 MB/s 2024-09-17T03:40:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699925 s, 150 MB/s 2024-09-17T03:40:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611942 s, 171 MB/s 2024-09-17T03:40:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703141 s, 149 MB/s 2024-09-17T03:40:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.929 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608081 s, 172 MB/s 2024-09-17T03:40:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.938 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660996 s, 159 MB/s 2024-09-17T03:40:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.948 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829579 s, 126 MB/s 2024-09-17T03:40:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644206 s, 163 MB/s 2024-09-17T03:40:27.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646177 s, 162 MB/s 2024-09-17T03:40:27.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692349 s, 151 MB/s 2024-09-17T03:40:27.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665655 s, 158 MB/s 2024-09-17T03:40:27.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065329 s, 161 MB/s 2024-09-17T03:40:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615729 s, 170 MB/s 2024-09-17T03:40:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809051 s, 130 MB/s 2024-09-17T03:40:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594939 s, 176 MB/s 2024-09-17T03:40:28.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.022 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591357 s, 177 MB/s 2024-09-17T03:40:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648857 s, 162 MB/s 2024-09-17T03:40:28.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.039 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668074 s, 157 MB/s 2024-09-17T03:40:28.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.047 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671956 s, 156 MB/s 2024-09-17T03:40:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.056 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742701 s, 141 MB/s 2024-09-17T03:40:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006579 s, 159 MB/s 2024-09-17T03:40:28.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:28.071 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:28.071 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:28.071 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.4 2024-09-17T03:40:28.071 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:28.071 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:28.071 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:28.071 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:28.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:28.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.130 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660422 s, 159 MB/s 2024-09-17T03:40:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.137 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607529 s, 173 MB/s 2024-09-17T03:40:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076562 s, 137 MB/s 2024-09-17T03:40:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.155 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669533 s, 157 MB/s 2024-09-17T03:40:28.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.163 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649114 s, 162 MB/s 2024-09-17T03:40:28.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.171 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598509 s, 175 MB/s 2024-09-17T03:40:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.179 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637277 s, 165 MB/s 2024-09-17T03:40:28.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.188 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698589 s, 150 MB/s 2024-09-17T03:40:28.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.196 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616371 s, 170 MB/s 2024-09-17T03:40:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.203 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577346 s, 182 MB/s 2024-09-17T03:40:28.205 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:40:28.207 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:40:28.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.213 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764921 s, 137 MB/s 2024-09-17T03:40:28.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.222 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744544 s, 141 MB/s 2024-09-17T03:40:28.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.230 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695282 s, 151 MB/s 2024-09-17T03:40:28.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611176 s, 172 MB/s 2024-09-17T03:40:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.247 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667191 s, 157 MB/s 2024-09-17T03:40:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607839 s, 173 MB/s 2024-09-17T03:40:28.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.264 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747966 s, 140 MB/s 2024-09-17T03:40:28.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.272 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696453 s, 151 MB/s 2024-09-17T03:40:28.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746209 s, 141 MB/s 2024-09-17T03:40:28.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.290 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658117 s, 159 MB/s 2024-09-17T03:40:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.299 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781128 s, 134 MB/s 2024-09-17T03:40:28.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679996 s, 154 MB/s 2024-09-17T03:40:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650436 s, 161 MB/s 2024-09-17T03:40:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573587 s, 183 MB/s 2024-09-17T03:40:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.332 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661669 s, 158 MB/s 2024-09-17T03:40:28.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.340 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637896 s, 164 MB/s 2024-09-17T03:40:28.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566886 s, 185 MB/s 2024-09-17T03:40:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.355 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585032 s, 179 MB/s 2024-09-17T03:40:28.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.363 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680156 s, 154 MB/s 2024-09-17T03:40:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.372 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654467 s, 160 MB/s 2024-09-17T03:40:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.381 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738782 s, 142 MB/s 2024-09-17T03:40:28.389 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.389 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.389 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666658 s, 157 MB/s 2024-09-17T03:40:28.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:28.396 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:28.396 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:28.396 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.5 2024-09-17T03:40:28.396 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:28.396 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:28.396 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:28.396 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:28.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726287 s, 144 MB/s 2024-09-17T03:40:28.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.504 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733154 s, 143 MB/s 2024-09-17T03:40:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740075 s, 142 MB/s 2024-09-17T03:40:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677929 s, 155 MB/s 2024-09-17T03:40:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749705 s, 140 MB/s 2024-09-17T03:40:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725702 s, 144 MB/s 2024-09-17T03:40:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.548 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646048 s, 162 MB/s 2024-09-17T03:40:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638147 s, 164 MB/s 2024-09-17T03:40:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701206 s, 150 MB/s 2024-09-17T03:40:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633569 s, 166 MB/s 2024-09-17T03:40:28.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750386 s, 140 MB/s 2024-09-17T03:40:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610683 s, 172 MB/s 2024-09-17T03:40:28.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603879 s, 174 MB/s 2024-09-17T03:40:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684665 s, 153 MB/s 2024-09-17T03:40:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611227 s, 172 MB/s 2024-09-17T03:40:28.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.622 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665269 s, 158 MB/s 2024-09-17T03:40:28.630 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.630 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.631 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658709 s, 159 MB/s 2024-09-17T03:40:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641558 s, 163 MB/s 2024-09-17T03:40:28.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619587 s, 169 MB/s 2024-09-17T03:40:28.655 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.655 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.655 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720819 s, 145 MB/s 2024-09-17T03:40:28.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.664 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670841 s, 156 MB/s 2024-09-17T03:40:28.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.671 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623305 s, 168 MB/s 2024-09-17T03:40:28.680 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072255 s, 145 MB/s 2024-09-17T03:40:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758879 s, 138 MB/s 2024-09-17T03:40:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.699 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729391 s, 144 MB/s 2024-09-17T03:40:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757195 s, 138 MB/s 2024-09-17T03:40:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.716 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592852 s, 177 MB/s 2024-09-17T03:40:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.724 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659986 s, 159 MB/s 2024-09-17T03:40:28.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.733 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673512 s, 156 MB/s 2024-09-17T03:40:28.741 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.742 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769824 s, 136 MB/s 2024-09-17T03:40:28.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.751 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715101 s, 147 MB/s 2024-09-17T03:40:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.758 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607835 s, 173 MB/s 2024-09-17T03:40:28.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:28.765 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:28.765 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:28.765 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.6 2024-09-17T03:40:28.765 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:28.765 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:28.765 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:28.765 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:28.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:28.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.823 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672816 s, 156 MB/s 2024-09-17T03:40:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.831 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632977 s, 166 MB/s 2024-09-17T03:40:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609524 s, 172 MB/s 2024-09-17T03:40:28.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699343 s, 150 MB/s 2024-09-17T03:40:28.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725912 s, 144 MB/s 2024-09-17T03:40:28.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635565 s, 165 MB/s 2024-09-17T03:40:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773339 s, 136 MB/s 2024-09-17T03:40:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.884 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786074 s, 133 MB/s 2024-09-17T03:40:28.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743029 s, 141 MB/s 2024-09-17T03:40:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006781 s, 155 MB/s 2024-09-17T03:40:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609371 s, 172 MB/s 2024-09-17T03:40:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.917 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674314 s, 156 MB/s 2024-09-17T03:40:28.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661241 s, 159 MB/s 2024-09-17T03:40:28.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594549 s, 176 MB/s 2024-09-17T03:40:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617612 s, 170 MB/s 2024-09-17T03:40:28.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725382 s, 145 MB/s 2024-09-17T03:40:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654795 s, 160 MB/s 2024-09-17T03:40:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684449 s, 153 MB/s 2024-09-17T03:40:28.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.975 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655163 s, 160 MB/s 2024-09-17T03:40:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577499 s, 182 MB/s 2024-09-17T03:40:28.990 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.990 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.990 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589878 s, 178 MB/s 2024-09-17T03:40:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:28.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:28.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065587 s, 160 MB/s 2024-09-17T03:40:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.008 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736684 s, 142 MB/s 2024-09-17T03:40:29.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.016 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597964 s, 175 MB/s 2024-09-17T03:40:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.023 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594405 s, 176 MB/s 2024-09-17T03:40:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605869 s, 173 MB/s 2024-09-17T03:40:29.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.040 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666212 s, 157 MB/s 2024-09-17T03:40:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.049 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773238 s, 136 MB/s 2024-09-17T03:40:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654711 s, 160 MB/s 2024-09-17T03:40:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.066 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664286 s, 158 MB/s 2024-09-17T03:40:29.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.075 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729895 s, 144 MB/s 2024-09-17T03:40:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661709 s, 158 MB/s 2024-09-17T03:40:29.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:29.090 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:29.090 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:29.090 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.7 2024-09-17T03:40:29.090 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:29.090 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:29.090 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:29.090 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:29.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662176 s, 158 MB/s 2024-09-17T03:40:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673333 s, 156 MB/s 2024-09-17T03:40:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.166 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766209 s, 137 MB/s 2024-09-17T03:40:29.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.175 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730919 s, 143 MB/s 2024-09-17T03:40:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714595 s, 147 MB/s 2024-09-17T03:40:29.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731903 s, 143 MB/s 2024-09-17T03:40:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683531 s, 153 MB/s 2024-09-17T03:40:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729966 s, 144 MB/s 2024-09-17T03:40:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636726 s, 165 MB/s 2024-09-17T03:40:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672194 s, 156 MB/s 2024-09-17T03:40:29.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.235 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655308 s, 160 MB/s 2024-09-17T03:40:29.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638581 s, 164 MB/s 2024-09-17T03:40:29.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.251 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062733 s, 167 MB/s 2024-09-17T03:40:29.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.260 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724992 s, 145 MB/s 2024-09-17T03:40:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692551 s, 151 MB/s 2024-09-17T03:40:29.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.277 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673593 s, 156 MB/s 2024-09-17T03:40:29.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671311 s, 156 MB/s 2024-09-17T03:40:29.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.294 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062055 s, 169 MB/s 2024-09-17T03:40:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.301 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607779 s, 173 MB/s 2024-09-17T03:40:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058566 s, 179 MB/s 2024-09-17T03:40:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757739 s, 138 MB/s 2024-09-17T03:40:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.327 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712966 s, 147 MB/s 2024-09-17T03:40:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.336 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730061 s, 144 MB/s 2024-09-17T03:40:29.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.346 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671398 s, 156 MB/s 2024-09-17T03:40:29.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.353 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646518 s, 162 MB/s 2024-09-17T03:40:29.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.361 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678996 s, 154 MB/s 2024-09-17T03:40:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642734 s, 163 MB/s 2024-09-17T03:40:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.378 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687462 s, 153 MB/s 2024-09-17T03:40:29.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775814 s, 135 MB/s 2024-09-17T03:40:29.397 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.397 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.397 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744154 s, 141 MB/s 2024-09-17T03:40:29.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.405 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061567 s, 170 MB/s 2024-09-17T03:40:29.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.413 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658492 s, 159 MB/s 2024-09-17T03:40:29.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:29.419 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:29.420 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:29.420 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.8 2024-09-17T03:40:29.420 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:29.420 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:29.420 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:29.420 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:29.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:29.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.479 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698819 s, 150 MB/s 2024-09-17T03:40:29.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648525 s, 162 MB/s 2024-09-17T03:40:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.496 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659722 s, 159 MB/s 2024-09-17T03:40:29.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729088 s, 144 MB/s 2024-09-17T03:40:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757949 s, 138 MB/s 2024-09-17T03:40:29.523 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.523 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.523 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718889 s, 146 MB/s 2024-09-17T03:40:29.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006118 s, 171 MB/s 2024-09-17T03:40:29.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.539 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651243 s, 161 MB/s 2024-09-17T03:40:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789649 s, 133 MB/s 2024-09-17T03:40:29.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.557 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702921 s, 149 MB/s 2024-09-17T03:40:29.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627297 s, 167 MB/s 2024-09-17T03:40:29.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074271 s, 141 MB/s 2024-09-17T03:40:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616317 s, 170 MB/s 2024-09-17T03:40:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.591 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722885 s, 145 MB/s 2024-09-17T03:40:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658377 s, 159 MB/s 2024-09-17T03:40:29.607 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.607 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.607 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578741 s, 181 MB/s 2024-09-17T03:40:29.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673982 s, 156 MB/s 2024-09-17T03:40:29.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.623 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657982 s, 159 MB/s 2024-09-17T03:40:29.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.632 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715039 s, 147 MB/s 2024-09-17T03:40:29.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681206 s, 154 MB/s 2024-09-17T03:40:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738589 s, 142 MB/s 2024-09-17T03:40:29.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647212 s, 162 MB/s 2024-09-17T03:40:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599541 s, 175 MB/s 2024-09-17T03:40:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.674 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593804 s, 177 MB/s 2024-09-17T03:40:29.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601871 s, 174 MB/s 2024-09-17T03:40:29.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.690 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.690 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651264 s, 161 MB/s 2024-09-17T03:40:29.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.700 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608175 s, 172 MB/s 2024-09-17T03:40:29.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.706 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689852 s, 152 MB/s 2024-09-17T03:40:29.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.714 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644954 s, 163 MB/s 2024-09-17T03:40:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.722 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592628 s, 177 MB/s 2024-09-17T03:40:29.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.730 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066614 s, 157 MB/s 2024-09-17T03:40:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077142 s, 136 MB/s 2024-09-17T03:40:29.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:29.746 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:29.746 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:29.746 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.9 2024-09-17T03:40:29.747 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:29.747 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:29.747 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:29.747 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:29.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:29.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.806 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745122 s, 141 MB/s 2024-09-17T03:40:29.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.814 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657872 s, 159 MB/s 2024-09-17T03:40:29.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.822 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619315 s, 169 MB/s 2024-09-17T03:40:29.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.830 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655111 s, 160 MB/s 2024-09-17T03:40:29.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652598 s, 161 MB/s 2024-09-17T03:40:29.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067075 s, 156 MB/s 2024-09-17T03:40:29.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677978 s, 155 MB/s 2024-09-17T03:40:29.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659155 s, 159 MB/s 2024-09-17T03:40:29.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745259 s, 141 MB/s 2024-09-17T03:40:29.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.882 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752873 s, 139 MB/s 2024-09-17T03:40:29.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668196 s, 157 MB/s 2024-09-17T03:40:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602678 s, 174 MB/s 2024-09-17T03:40:29.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.907 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681808 s, 154 MB/s 2024-09-17T03:40:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736542 s, 142 MB/s 2024-09-17T03:40:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748528 s, 140 MB/s 2024-09-17T03:40:29.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668746 s, 157 MB/s 2024-09-17T03:40:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069856 s, 150 MB/s 2024-09-17T03:40:29.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.951 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713945 s, 147 MB/s 2024-09-17T03:40:29.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662223 s, 158 MB/s 2024-09-17T03:40:29.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.968 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685904 s, 153 MB/s 2024-09-17T03:40:29.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.977 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740831 s, 142 MB/s 2024-09-17T03:40:29.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.984 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573874 s, 183 MB/s 2024-09-17T03:40:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:29.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645073 s, 163 MB/s 2024-09-17T03:40:30.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.000 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596647 s, 176 MB/s 2024-09-17T03:40:30.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.008 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611879 s, 171 MB/s 2024-09-17T03:40:30.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727739 s, 144 MB/s 2024-09-17T03:40:30.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.025 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635754 s, 165 MB/s 2024-09-17T03:40:30.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.034 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673895 s, 156 MB/s 2024-09-17T03:40:30.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655142 s, 160 MB/s 2024-09-17T03:40:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687472 s, 153 MB/s 2024-09-17T03:40:30.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.060 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.060 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074999 s, 140 MB/s 2024-09-17T03:40:30.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.068 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636123 s, 165 MB/s 2024-09-17T03:40:30.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:30.074 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:30.074 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:30.074 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.10 2024-09-17T03:40:30.074 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:30.075 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:30.075 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:30.075 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:30.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.133 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673041 s, 156 MB/s 2024-09-17T03:40:30.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.141 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617687 s, 170 MB/s 2024-09-17T03:40:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729432 s, 144 MB/s 2024-09-17T03:40:30.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589594 s, 178 MB/s 2024-09-17T03:40:30.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.166 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663255 s, 158 MB/s 2024-09-17T03:40:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.174 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619338 s, 169 MB/s 2024-09-17T03:40:30.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.183 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745084 s, 141 MB/s 2024-09-17T03:40:30.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673733 s, 156 MB/s 2024-09-17T03:40:30.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.200 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652766 s, 161 MB/s 2024-09-17T03:40:30.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.208 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654488 s, 160 MB/s 2024-09-17T03:40:30.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.216 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599875 s, 175 MB/s 2024-09-17T03:40:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.224 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663582 s, 158 MB/s 2024-09-17T03:40:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751349 s, 140 MB/s 2024-09-17T03:40:30.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.242 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712881 s, 147 MB/s 2024-09-17T03:40:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614813 s, 171 MB/s 2024-09-17T03:40:30.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.258 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573882 s, 183 MB/s 2024-09-17T03:40:30.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058849 s, 178 MB/s 2024-09-17T03:40:30.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.273 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577916 s, 181 MB/s 2024-09-17T03:40:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067463 s, 155 MB/s 2024-09-17T03:40:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599817 s, 175 MB/s 2024-09-17T03:40:30.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724376 s, 145 MB/s 2024-09-17T03:40:30.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.306 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669782 s, 157 MB/s 2024-09-17T03:40:30.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.314 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006656 s, 158 MB/s 2024-09-17T03:40:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613909 s, 171 MB/s 2024-09-17T03:40:30.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.331 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706793 s, 148 MB/s 2024-09-17T03:40:30.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.340 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715504 s, 147 MB/s 2024-09-17T03:40:30.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586218 s, 179 MB/s 2024-09-17T03:40:30.355 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.355 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.355 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587537 s, 178 MB/s 2024-09-17T03:40:30.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.364 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722039 s, 145 MB/s 2024-09-17T03:40:30.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.372 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594764 s, 176 MB/s 2024-09-17T03:40:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737923 s, 142 MB/s 2024-09-17T03:40:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740808 s, 142 MB/s 2024-09-17T03:40:30.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:30.397 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:30.397 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:30.397 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.11 2024-09-17T03:40:30.397 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:30.397 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:30.397 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:30.397 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:30.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:30.455 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687824 s, 152 MB/s 2024-09-17T03:40:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.465 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730966 s, 143 MB/s 2024-09-17T03:40:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688442 s, 152 MB/s 2024-09-17T03:40:30.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746912 s, 140 MB/s 2024-09-17T03:40:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652148 s, 161 MB/s 2024-09-17T03:40:30.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.499 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674719 s, 155 MB/s 2024-09-17T03:40:30.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602761 s, 174 MB/s 2024-09-17T03:40:30.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.515 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650905 s, 161 MB/s 2024-09-17T03:40:30.523 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.524 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704429 s, 149 MB/s 2024-09-17T03:40:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693926 s, 151 MB/s 2024-09-17T03:40:30.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.541 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677137 s, 155 MB/s 2024-09-17T03:40:30.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.548 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582026 s, 180 MB/s 2024-09-17T03:40:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590789 s, 177 MB/s 2024-09-17T03:40:30.563 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.564 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059083 s, 177 MB/s 2024-09-17T03:40:30.572 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.572 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.572 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666677 s, 157 MB/s 2024-09-17T03:40:30.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.580 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670259 s, 156 MB/s 2024-09-17T03:40:30.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672951 s, 156 MB/s 2024-09-17T03:40:30.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659242 s, 159 MB/s 2024-09-17T03:40:30.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751546 s, 140 MB/s 2024-09-17T03:40:30.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753802 s, 139 MB/s 2024-09-17T03:40:30.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.623 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635209 s, 165 MB/s 2024-09-17T03:40:30.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.631 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683808 s, 153 MB/s 2024-09-17T03:40:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633528 s, 166 MB/s 2024-09-17T03:40:30.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.648 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662737 s, 158 MB/s 2024-09-17T03:40:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665502 s, 158 MB/s 2024-09-17T03:40:30.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.664 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605256 s, 173 MB/s 2024-09-17T03:40:30.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.673 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068207 s, 154 MB/s 2024-09-17T03:40:30.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668822 s, 157 MB/s 2024-09-17T03:40:30.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.689 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668271 s, 157 MB/s 2024-09-17T03:40:30.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.698 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734133 s, 143 MB/s 2024-09-17T03:40:30.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.706 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666813 s, 157 MB/s 2024-09-17T03:40:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071843 s, 146 MB/s 2024-09-17T03:40:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:30.722 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:30.722 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:30.722 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.12 2024-09-17T03:40:30.722 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:30.722 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:30.722 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:30.722 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:30.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:30.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.784 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743271 s, 141 MB/s 2024-09-17T03:40:30.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.792 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666655 s, 157 MB/s 2024-09-17T03:40:30.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.801 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682111 s, 154 MB/s 2024-09-17T03:40:30.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.810 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676001 s, 155 MB/s 2024-09-17T03:40:30.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.819 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742981 s, 141 MB/s 2024-09-17T03:40:30.827 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.828 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671391 s, 156 MB/s 2024-09-17T03:40:30.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662081 s, 158 MB/s 2024-09-17T03:40:30.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.845 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074259 s, 141 MB/s 2024-09-17T03:40:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680038 s, 154 MB/s 2024-09-17T03:40:30.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.863 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643577 s, 163 MB/s 2024-09-17T03:40:30.871 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.871 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.871 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686378 s, 153 MB/s 2024-09-17T03:40:30.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.879 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663348 s, 158 MB/s 2024-09-17T03:40:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725897 s, 144 MB/s 2024-09-17T03:40:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064165 s, 163 MB/s 2024-09-17T03:40:30.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649961 s, 161 MB/s 2024-09-17T03:40:30.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687982 s, 152 MB/s 2024-09-17T03:40:30.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.921 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599589 s, 175 MB/s 2024-09-17T03:40:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.929 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650015 s, 161 MB/s 2024-09-17T03:40:30.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.939 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007627 s, 137 MB/s 2024-09-17T03:40:30.946 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.947 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660538 s, 159 MB/s 2024-09-17T03:40:30.955 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.955 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070422 s, 149 MB/s 2024-09-17T03:40:30.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.963 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609019 s, 172 MB/s 2024-09-17T03:40:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064762 s, 162 MB/s 2024-09-17T03:40:30.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.980 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691128 s, 152 MB/s 2024-09-17T03:40:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723085 s, 145 MB/s 2024-09-17T03:40:30.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:30.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:30.998 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722987 s, 145 MB/s 2024-09-17T03:40:31.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.006 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654898 s, 160 MB/s 2024-09-17T03:40:31.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.014 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645998 s, 162 MB/s 2024-09-17T03:40:31.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.023 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730708 s, 144 MB/s 2024-09-17T03:40:31.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.031 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006524 s, 161 MB/s 2024-09-17T03:40:31.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639645 s, 164 MB/s 2024-09-17T03:40:31.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.048 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644955 s, 163 MB/s 2024-09-17T03:40:31.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:31.054 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:31.054 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:31.054 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.13 2024-09-17T03:40:31.054 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:31.054 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:31.054 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:31.054 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:31.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602445 s, 174 MB/s 2024-09-17T03:40:31.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.121 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655826 s, 160 MB/s 2024-09-17T03:40:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.129 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634238 s, 165 MB/s 2024-09-17T03:40:31.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.138 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730699 s, 144 MB/s 2024-09-17T03:40:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.147 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673459 s, 156 MB/s 2024-09-17T03:40:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.154 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640722 s, 164 MB/s 2024-09-17T03:40:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577721 s, 182 MB/s 2024-09-17T03:40:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602102 s, 174 MB/s 2024-09-17T03:40:31.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.178 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659614 s, 159 MB/s 2024-09-17T03:40:31.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.186 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597356 s, 176 MB/s 2024-09-17T03:40:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604224 s, 174 MB/s 2024-09-17T03:40:31.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669985 s, 157 MB/s 2024-09-17T03:40:31.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578421 s, 181 MB/s 2024-09-17T03:40:31.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692197 s, 151 MB/s 2024-09-17T03:40:31.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690319 s, 152 MB/s 2024-09-17T03:40:31.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.235 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697028 s, 150 MB/s 2024-09-17T03:40:31.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724474 s, 145 MB/s 2024-09-17T03:40:31.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720148 s, 146 MB/s 2024-09-17T03:40:31.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.261 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686361 s, 153 MB/s 2024-09-17T03:40:31.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.270 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646067 s, 162 MB/s 2024-09-17T03:40:31.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.278 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653253 s, 161 MB/s 2024-09-17T03:40:31.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670172 s, 156 MB/s 2024-09-17T03:40:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660106 s, 159 MB/s 2024-09-17T03:40:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658832 s, 159 MB/s 2024-09-17T03:40:31.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671922 s, 156 MB/s 2024-09-17T03:40:31.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.319 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645299 s, 162 MB/s 2024-09-17T03:40:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616593 s, 170 MB/s 2024-09-17T03:40:31.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059424 s, 176 MB/s 2024-09-17T03:40:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640922 s, 164 MB/s 2024-09-17T03:40:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673315 s, 156 MB/s 2024-09-17T03:40:31.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.358 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605432 s, 173 MB/s 2024-09-17T03:40:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629678 s, 167 MB/s 2024-09-17T03:40:31.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:31.373 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:31.373 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:31.374 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.14 2024-09-17T03:40:31.374 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:31.374 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:31.374 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:31.374 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:31.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063692 s, 165 MB/s 2024-09-17T03:40:31.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.440 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669821 s, 157 MB/s 2024-09-17T03:40:31.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.449 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746273 s, 141 MB/s 2024-09-17T03:40:31.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.457 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669062 s, 157 MB/s 2024-09-17T03:40:31.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.466 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666606 s, 157 MB/s 2024-09-17T03:40:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670177 s, 156 MB/s 2024-09-17T03:40:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637882 s, 164 MB/s 2024-09-17T03:40:31.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.490 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618863 s, 169 MB/s 2024-09-17T03:40:31.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.499 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739582 s, 142 MB/s 2024-09-17T03:40:31.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.508 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673526 s, 156 MB/s 2024-09-17T03:40:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.516 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678665 s, 155 MB/s 2024-09-17T03:40:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.524 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630837 s, 166 MB/s 2024-09-17T03:40:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.533 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680388 s, 154 MB/s 2024-09-17T03:40:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720817 s, 145 MB/s 2024-09-17T03:40:31.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.551 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751524 s, 140 MB/s 2024-09-17T03:40:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623183 s, 168 MB/s 2024-09-17T03:40:31.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.567 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656236 s, 160 MB/s 2024-09-17T03:40:31.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.575 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645126 s, 163 MB/s 2024-09-17T03:40:31.584 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.584 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.584 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072131 s, 145 MB/s 2024-09-17T03:40:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742551 s, 141 MB/s 2024-09-17T03:40:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725231 s, 145 MB/s 2024-09-17T03:40:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.611 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670753 s, 156 MB/s 2024-09-17T03:40:31.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.619 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662488 s, 158 MB/s 2024-09-17T03:40:31.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.627 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696775 s, 150 MB/s 2024-09-17T03:40:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649655 s, 161 MB/s 2024-09-17T03:40:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.643 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643368 s, 163 MB/s 2024-09-17T03:40:31.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725601 s, 145 MB/s 2024-09-17T03:40:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710583 s, 148 MB/s 2024-09-17T03:40:31.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749371 s, 140 MB/s 2024-09-17T03:40:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656747 s, 160 MB/s 2024-09-17T03:40:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656635 s, 160 MB/s 2024-09-17T03:40:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750164 s, 140 MB/s 2024-09-17T03:40:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:31.703 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:31.703 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:31.703 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.15 2024-09-17T03:40:31.703 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:31.703 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:31.703 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:31.703 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:31.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:31.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.762 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670543 s, 156 MB/s 2024-09-17T03:40:31.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.771 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.771 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717933 s, 146 MB/s 2024-09-17T03:40:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653947 s, 160 MB/s 2024-09-17T03:40:31.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.787 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694933 s, 151 MB/s 2024-09-17T03:40:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.795 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616799 s, 170 MB/s 2024-09-17T03:40:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588958 s, 178 MB/s 2024-09-17T03:40:31.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620076 s, 169 MB/s 2024-09-17T03:40:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581841 s, 180 MB/s 2024-09-17T03:40:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.827 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664484 s, 158 MB/s 2024-09-17T03:40:31.835 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.835 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732353 s, 143 MB/s 2024-09-17T03:40:31.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.843 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588204 s, 178 MB/s 2024-09-17T03:40:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684552 s, 153 MB/s 2024-09-17T03:40:31.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.861 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698602 s, 150 MB/s 2024-09-17T03:40:31.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.869 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635925 s, 165 MB/s 2024-09-17T03:40:31.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653736 s, 160 MB/s 2024-09-17T03:40:31.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.885 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675638 s, 155 MB/s 2024-09-17T03:40:31.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733746 s, 143 MB/s 2024-09-17T03:40:31.903 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.903 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.903 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722419 s, 145 MB/s 2024-09-17T03:40:31.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646338 s, 162 MB/s 2024-09-17T03:40:31.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.919 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621005 s, 169 MB/s 2024-09-17T03:40:31.927 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.927 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.927 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596324 s, 176 MB/s 2024-09-17T03:40:31.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.935 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634459 s, 165 MB/s 2024-09-17T03:40:31.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076145 s, 138 MB/s 2024-09-17T03:40:31.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.952 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601501 s, 174 MB/s 2024-09-17T03:40:31.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.960 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602199 s, 174 MB/s 2024-09-17T03:40:31.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.968 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643613 s, 163 MB/s 2024-09-17T03:40:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685805 s, 153 MB/s 2024-09-17T03:40:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702556 s, 149 MB/s 2024-09-17T03:40:31.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:31.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:31.994 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690019 s, 152 MB/s 2024-09-17T03:40:32.002 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.002 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.002 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603625 s, 174 MB/s 2024-09-17T03:40:32.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.010 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605561 s, 173 MB/s 2024-09-17T03:40:32.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.018 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653229 s, 161 MB/s 2024-09-17T03:40:32.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:32.025 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:32.025 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:32.025 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.16 2024-09-17T03:40:32.025 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:32.025 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:32.025 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:32.025 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:32.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:32.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073597 s, 142 MB/s 2024-09-17T03:40:32.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.092 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660976 s, 159 MB/s 2024-09-17T03:40:32.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.100 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602924 s, 174 MB/s 2024-09-17T03:40:32.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653921 s, 160 MB/s 2024-09-17T03:40:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666309 s, 157 MB/s 2024-09-17T03:40:32.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.125 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661049 s, 159 MB/s 2024-09-17T03:40:32.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.133 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654201 s, 160 MB/s 2024-09-17T03:40:32.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.142 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670608 s, 156 MB/s 2024-09-17T03:40:32.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.151 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756043 s, 139 MB/s 2024-09-17T03:40:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625436 s, 168 MB/s 2024-09-17T03:40:32.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.168 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751897 s, 139 MB/s 2024-09-17T03:40:32.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.177 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748393 s, 140 MB/s 2024-09-17T03:40:32.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605345 s, 173 MB/s 2024-09-17T03:40:32.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606511 s, 173 MB/s 2024-09-17T03:40:32.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676122 s, 155 MB/s 2024-09-17T03:40:32.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.210 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651781 s, 161 MB/s 2024-09-17T03:40:32.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590185 s, 178 MB/s 2024-09-17T03:40:32.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074826 s, 140 MB/s 2024-09-17T03:40:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.236 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741233 s, 141 MB/s 2024-09-17T03:40:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065314 s, 161 MB/s 2024-09-17T03:40:32.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732864 s, 143 MB/s 2024-09-17T03:40:32.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.261 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065996 s, 159 MB/s 2024-09-17T03:40:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597699 s, 175 MB/s 2024-09-17T03:40:32.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.278 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750901 s, 140 MB/s 2024-09-17T03:40:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647042 s, 162 MB/s 2024-09-17T03:40:32.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.294 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619545 s, 169 MB/s 2024-09-17T03:40:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736139 s, 142 MB/s 2024-09-17T03:40:32.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.312 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669471 s, 157 MB/s 2024-09-17T03:40:32.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654763 s, 160 MB/s 2024-09-17T03:40:32.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.327 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600544 s, 175 MB/s 2024-09-17T03:40:32.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600843 s, 175 MB/s 2024-09-17T03:40:32.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.344 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719784 s, 146 MB/s 2024-09-17T03:40:32.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:32.351 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:32.351 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:32.351 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.17 2024-09-17T03:40:32.351 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:32.351 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:32.351 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:32.351 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:32.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:32.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.409 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629862 s, 166 MB/s 2024-09-17T03:40:32.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.417 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599552 s, 175 MB/s 2024-09-17T03:40:32.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.427 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760219 s, 138 MB/s 2024-09-17T03:40:32.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659215 s, 159 MB/s 2024-09-17T03:40:32.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778284 s, 135 MB/s 2024-09-17T03:40:32.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.453 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065709 s, 160 MB/s 2024-09-17T03:40:32.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.460 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596375 s, 176 MB/s 2024-09-17T03:40:32.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.468 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568167 s, 185 MB/s 2024-09-17T03:40:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648955 s, 162 MB/s 2024-09-17T03:40:32.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.485 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757579 s, 138 MB/s 2024-09-17T03:40:32.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.494 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661834 s, 158 MB/s 2024-09-17T03:40:32.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.501 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592764 s, 177 MB/s 2024-09-17T03:40:32.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.509 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639401 s, 164 MB/s 2024-09-17T03:40:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670332 s, 156 MB/s 2024-09-17T03:40:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773198 s, 136 MB/s 2024-09-17T03:40:32.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.536 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074688 s, 140 MB/s 2024-09-17T03:40:32.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598515 s, 175 MB/s 2024-09-17T03:40:32.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.553 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681833 s, 154 MB/s 2024-09-17T03:40:32.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.560 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588026 s, 178 MB/s 2024-09-17T03:40:32.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.568 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595518 s, 176 MB/s 2024-09-17T03:40:32.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700802 s, 150 MB/s 2024-09-17T03:40:32.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.585 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663967 s, 158 MB/s 2024-09-17T03:40:32.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.594 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752358 s, 139 MB/s 2024-09-17T03:40:32.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765673 s, 137 MB/s 2024-09-17T03:40:32.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.612 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654589 s, 160 MB/s 2024-09-17T03:40:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596688 s, 176 MB/s 2024-09-17T03:40:32.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.627 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591524 s, 177 MB/s 2024-09-17T03:40:32.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.636 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672899 s, 156 MB/s 2024-09-17T03:40:32.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.645 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752785 s, 139 MB/s 2024-09-17T03:40:32.653 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.653 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.653 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611832 s, 171 MB/s 2024-09-17T03:40:32.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593945 s, 177 MB/s 2024-09-17T03:40:32.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757987 s, 138 MB/s 2024-09-17T03:40:32.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:32.677 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:32.677 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:32.677 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.18 2024-09-17T03:40:32.677 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:32.677 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:32.677 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:32.677 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:32.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.736 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647319 s, 162 MB/s 2024-09-17T03:40:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.745 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730769 s, 143 MB/s 2024-09-17T03:40:32.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.753 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066698 s, 157 MB/s 2024-09-17T03:40:32.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.762 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684655 s, 153 MB/s 2024-09-17T03:40:32.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.770 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636411 s, 165 MB/s 2024-09-17T03:40:32.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.778 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641034 s, 164 MB/s 2024-09-17T03:40:32.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649227 s, 162 MB/s 2024-09-17T03:40:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.794 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647042 s, 162 MB/s 2024-09-17T03:40:32.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606286 s, 173 MB/s 2024-09-17T03:40:32.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.811 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725056 s, 145 MB/s 2024-09-17T03:40:32.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.820 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662201 s, 158 MB/s 2024-09-17T03:40:32.827 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.827 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.827 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609094 s, 172 MB/s 2024-09-17T03:40:32.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699066 s, 150 MB/s 2024-09-17T03:40:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738887 s, 142 MB/s 2024-09-17T03:40:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636912 s, 165 MB/s 2024-09-17T03:40:32.861 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064529 s, 162 MB/s 2024-09-17T03:40:32.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.870 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704165 s, 149 MB/s 2024-09-17T03:40:32.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.879 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676519 s, 155 MB/s 2024-09-17T03:40:32.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.886 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609209 s, 172 MB/s 2024-09-17T03:40:32.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571817 s, 183 MB/s 2024-09-17T03:40:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.902 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658175 s, 159 MB/s 2024-09-17T03:40:32.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685647 s, 153 MB/s 2024-09-17T03:40:32.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.918 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591017 s, 177 MB/s 2024-09-17T03:40:32.927 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.927 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.927 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664697 s, 158 MB/s 2024-09-17T03:40:32.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.934 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581173 s, 180 MB/s 2024-09-17T03:40:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655186 s, 160 MB/s 2024-09-17T03:40:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588324 s, 178 MB/s 2024-09-17T03:40:32.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.958 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060232 s, 174 MB/s 2024-09-17T03:40:32.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.968 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789073 s, 133 MB/s 2024-09-17T03:40:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.975 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599078 s, 175 MB/s 2024-09-17T03:40:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731834 s, 143 MB/s 2024-09-17T03:40:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690662 s, 152 MB/s 2024-09-17T03:40:32.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:33.000 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:33.000 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:33.000 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.19 2024-09-17T03:40:33.000 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:33.000 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:33.000 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:33.000 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:33.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735271 s, 143 MB/s 2024-09-17T03:40:33.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.067 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605801 s, 173 MB/s 2024-09-17T03:40:33.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.076 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714201 s, 147 MB/s 2024-09-17T03:40:33.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621261 s, 169 MB/s 2024-09-17T03:40:33.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.092 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649427 s, 161 MB/s 2024-09-17T03:40:33.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.100 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638104 s, 164 MB/s 2024-09-17T03:40:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660079 s, 159 MB/s 2024-09-17T03:40:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639196 s, 164 MB/s 2024-09-17T03:40:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676797 s, 155 MB/s 2024-09-17T03:40:33.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064912 s, 162 MB/s 2024-09-17T03:40:33.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.140 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634135 s, 165 MB/s 2024-09-17T03:40:33.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652786 s, 161 MB/s 2024-09-17T03:40:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576708 s, 182 MB/s 2024-09-17T03:40:33.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.164 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623473 s, 168 MB/s 2024-09-17T03:40:33.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.173 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720768 s, 145 MB/s 2024-09-17T03:40:33.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604491 s, 173 MB/s 2024-09-17T03:40:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718067 s, 146 MB/s 2024-09-17T03:40:33.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.199 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689547 s, 152 MB/s 2024-09-17T03:40:33.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.208 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773004 s, 136 MB/s 2024-09-17T03:40:33.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.216 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064819 s, 162 MB/s 2024-09-17T03:40:33.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.224 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663717 s, 158 MB/s 2024-09-17T03:40:33.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682997 s, 154 MB/s 2024-09-17T03:40:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644941 s, 163 MB/s 2024-09-17T03:40:33.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668435 s, 157 MB/s 2024-09-17T03:40:33.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.258 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687973 s, 152 MB/s 2024-09-17T03:40:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117372 s, 89.3 MB/s 2024-09-17T03:40:33.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.280 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639813 s, 164 MB/s 2024-09-17T03:40:33.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.287 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608253 s, 172 MB/s 2024-09-17T03:40:33.295 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.296 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662961 s, 158 MB/s 2024-09-17T03:40:33.304 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.304 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.304 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678667 s, 155 MB/s 2024-09-17T03:40:33.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568855 s, 184 MB/s 2024-09-17T03:40:33.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682754 s, 154 MB/s 2024-09-17T03:40:33.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:33.326 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:33.327 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:33.327 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.20 2024-09-17T03:40:33.327 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:33.327 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:33.327 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:33.327 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:33.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.386 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672662 s, 156 MB/s 2024-09-17T03:40:33.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.394 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667042 s, 157 MB/s 2024-09-17T03:40:33.403 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.403 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.403 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734754 s, 143 MB/s 2024-09-17T03:40:33.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.411 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620334 s, 169 MB/s 2024-09-17T03:40:33.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.420 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743385 s, 141 MB/s 2024-09-17T03:40:33.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.429 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733517 s, 143 MB/s 2024-09-17T03:40:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608127 s, 172 MB/s 2024-09-17T03:40:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740009 s, 142 MB/s 2024-09-17T03:40:33.455 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752071 s, 139 MB/s 2024-09-17T03:40:33.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.464 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072317 s, 145 MB/s 2024-09-17T03:40:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606986 s, 173 MB/s 2024-09-17T03:40:33.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.481 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678897 s, 154 MB/s 2024-09-17T03:40:33.489 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.490 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724437 s, 145 MB/s 2024-09-17T03:40:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639361 s, 164 MB/s 2024-09-17T03:40:33.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763831 s, 137 MB/s 2024-09-17T03:40:33.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.516 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683603 s, 153 MB/s 2024-09-17T03:40:33.525 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.525 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.525 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778187 s, 135 MB/s 2024-09-17T03:40:33.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.533 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609667 s, 172 MB/s 2024-09-17T03:40:33.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.541 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600331 s, 175 MB/s 2024-09-17T03:40:33.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614358 s, 171 MB/s 2024-09-17T03:40:33.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.557 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600851 s, 175 MB/s 2024-09-17T03:40:33.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619879 s, 169 MB/s 2024-09-17T03:40:33.572 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.572 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.573 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586185 s, 179 MB/s 2024-09-17T03:40:33.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.580 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594171 s, 176 MB/s 2024-09-17T03:40:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695569 s, 151 MB/s 2024-09-17T03:40:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066096 s, 159 MB/s 2024-09-17T03:40:33.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.605 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622576 s, 168 MB/s 2024-09-17T03:40:33.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.614 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724413 s, 145 MB/s 2024-09-17T03:40:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727127 s, 144 MB/s 2024-09-17T03:40:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681706 s, 154 MB/s 2024-09-17T03:40:33.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.640 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679986 s, 154 MB/s 2024-09-17T03:40:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646335 s, 162 MB/s 2024-09-17T03:40:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:33.655 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:33.655 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:33.655 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.21 2024-09-17T03:40:33.655 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:33.655 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:33.655 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:33.655 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:33.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:33.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.714 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643727 s, 163 MB/s 2024-09-17T03:40:33.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.723 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065956 s, 159 MB/s 2024-09-17T03:40:33.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713162 s, 147 MB/s 2024-09-17T03:40:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683621 s, 153 MB/s 2024-09-17T03:40:33.749 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.749 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.749 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729638 s, 144 MB/s 2024-09-17T03:40:33.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.757 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064823 s, 162 MB/s 2024-09-17T03:40:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647434 s, 162 MB/s 2024-09-17T03:40:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654516 s, 160 MB/s 2024-09-17T03:40:33.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647077 s, 162 MB/s 2024-09-17T03:40:33.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.790 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730293 s, 144 MB/s 2024-09-17T03:40:33.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.799 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682919 s, 154 MB/s 2024-09-17T03:40:33.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.808 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753742 s, 139 MB/s 2024-09-17T03:40:33.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.817 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711589 s, 147 MB/s 2024-09-17T03:40:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683589 s, 153 MB/s 2024-09-17T03:40:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667615 s, 157 MB/s 2024-09-17T03:40:33.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.842 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664007 s, 158 MB/s 2024-09-17T03:40:33.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.850 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676387 s, 155 MB/s 2024-09-17T03:40:33.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.859 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686843 s, 153 MB/s 2024-09-17T03:40:33.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.868 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748949 s, 140 MB/s 2024-09-17T03:40:33.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715364 s, 147 MB/s 2024-09-17T03:40:33.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.886 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731788 s, 143 MB/s 2024-09-17T03:40:33.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656738 s, 160 MB/s 2024-09-17T03:40:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.902 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668708 s, 157 MB/s 2024-09-17T03:40:33.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.910 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642428 s, 163 MB/s 2024-09-17T03:40:33.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.919 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727346 s, 144 MB/s 2024-09-17T03:40:33.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.928 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067681 s, 155 MB/s 2024-09-17T03:40:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789337 s, 133 MB/s 2024-09-17T03:40:33.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.946 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.946 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668779 s, 157 MB/s 2024-09-17T03:40:33.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.953 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600986 s, 174 MB/s 2024-09-17T03:40:33.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.962 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725622 s, 145 MB/s 2024-09-17T03:40:33.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.970 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609298 s, 172 MB/s 2024-09-17T03:40:33.978 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:33.978 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:33.979 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674929 s, 155 MB/s 2024-09-17T03:40:33.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:33.985 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:33.985 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:33.985 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.22 2024-09-17T03:40:33.985 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:33.985 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:33.985 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:33.985 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:34.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:34.044 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.044 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.044 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668876 s, 157 MB/s 2024-09-17T03:40:34.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746975 s, 140 MB/s 2024-09-17T03:40:34.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.062 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761773 s, 138 MB/s 2024-09-17T03:40:34.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.071 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656419 s, 160 MB/s 2024-09-17T03:40:34.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.079 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717928 s, 146 MB/s 2024-09-17T03:40:34.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.087 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589608 s, 178 MB/s 2024-09-17T03:40:34.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.096 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739615 s, 142 MB/s 2024-09-17T03:40:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727208 s, 144 MB/s 2024-09-17T03:40:34.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.113 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064264 s, 163 MB/s 2024-09-17T03:40:34.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.122 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642337 s, 163 MB/s 2024-09-17T03:40:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676675 s, 155 MB/s 2024-09-17T03:40:34.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.140 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800156 s, 131 MB/s 2024-09-17T03:40:34.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751365 s, 140 MB/s 2024-09-17T03:40:34.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066165 s, 158 MB/s 2024-09-17T03:40:34.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.166 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072916 s, 144 MB/s 2024-09-17T03:40:34.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.174 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626749 s, 167 MB/s 2024-09-17T03:40:34.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.183 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656609 s, 160 MB/s 2024-09-17T03:40:34.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.192 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750353 s, 140 MB/s 2024-09-17T03:40:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671517 s, 156 MB/s 2024-09-17T03:40:34.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.210 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742137 s, 141 MB/s 2024-09-17T03:40:34.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581493 s, 180 MB/s 2024-09-17T03:40:34.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.226 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675252 s, 155 MB/s 2024-09-17T03:40:34.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.235 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075943 s, 138 MB/s 2024-09-17T03:40:34.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701737 s, 149 MB/s 2024-09-17T03:40:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630839 s, 166 MB/s 2024-09-17T03:40:34.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.261 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752479 s, 139 MB/s 2024-09-17T03:40:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.270 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731698 s, 143 MB/s 2024-09-17T03:40:34.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.278 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648041 s, 162 MB/s 2024-09-17T03:40:34.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592117 s, 177 MB/s 2024-09-17T03:40:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065937 s, 159 MB/s 2024-09-17T03:40:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.303 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667403 s, 157 MB/s 2024-09-17T03:40:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697446 s, 150 MB/s 2024-09-17T03:40:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:34.317 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:34.318 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:34.318 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.23 2024-09-17T03:40:34.318 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:34.318 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:34.318 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:34.318 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:34.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.377 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738953 s, 142 MB/s 2024-09-17T03:40:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667653 s, 157 MB/s 2024-09-17T03:40:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.394 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672994 s, 156 MB/s 2024-09-17T03:40:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062269 s, 168 MB/s 2024-09-17T03:40:34.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.410 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654019 s, 160 MB/s 2024-09-17T03:40:34.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657792 s, 159 MB/s 2024-09-17T03:40:34.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.427 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695597 s, 151 MB/s 2024-09-17T03:40:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638822 s, 164 MB/s 2024-09-17T03:40:34.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.443 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645281 s, 162 MB/s 2024-09-17T03:40:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660887 s, 159 MB/s 2024-09-17T03:40:34.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643114 s, 163 MB/s 2024-09-17T03:40:34.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.468 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726011 s, 144 MB/s 2024-09-17T03:40:34.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066947 s, 157 MB/s 2024-09-17T03:40:34.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.486 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071978 s, 146 MB/s 2024-09-17T03:40:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.494 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072342 s, 145 MB/s 2024-09-17T03:40:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666647 s, 157 MB/s 2024-09-17T03:40:34.511 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.511 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.511 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649004 s, 162 MB/s 2024-09-17T03:40:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729213 s, 144 MB/s 2024-09-17T03:40:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077688 s, 135 MB/s 2024-09-17T03:40:34.538 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.538 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.538 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738337 s, 142 MB/s 2024-09-17T03:40:34.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.547 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658839 s, 159 MB/s 2024-09-17T03:40:34.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.555 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665463 s, 158 MB/s 2024-09-17T03:40:34.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.564 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741974 s, 141 MB/s 2024-09-17T03:40:34.572 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.573 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662718 s, 158 MB/s 2024-09-17T03:40:34.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.580 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620569 s, 169 MB/s 2024-09-17T03:40:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640966 s, 164 MB/s 2024-09-17T03:40:34.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656265 s, 160 MB/s 2024-09-17T03:40:34.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728809 s, 144 MB/s 2024-09-17T03:40:34.613 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.614 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608281 s, 172 MB/s 2024-09-17T03:40:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.621 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598197 s, 175 MB/s 2024-09-17T03:40:34.630 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.630 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.631 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720208 s, 146 MB/s 2024-09-17T03:40:34.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.638 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590163 s, 178 MB/s 2024-09-17T03:40:34.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:34.645 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:34.645 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:34.645 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.24 2024-09-17T03:40:34.645 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:34.645 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:34.645 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:34.645 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:34.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:34.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.704 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678373 s, 155 MB/s 2024-09-17T03:40:34.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.711 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606461 s, 173 MB/s 2024-09-17T03:40:34.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.719 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592158 s, 177 MB/s 2024-09-17T03:40:34.726 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.727 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587933 s, 178 MB/s 2024-09-17T03:40:34.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.736 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727824 s, 144 MB/s 2024-09-17T03:40:34.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.745 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738757 s, 142 MB/s 2024-09-17T03:40:34.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.753 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677153 s, 155 MB/s 2024-09-17T03:40:34.761 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.761 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.761 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060412 s, 174 MB/s 2024-09-17T03:40:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720258 s, 146 MB/s 2024-09-17T03:40:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.778 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671777 s, 156 MB/s 2024-09-17T03:40:34.788 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.788 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.788 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751859 s, 139 MB/s 2024-09-17T03:40:34.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.796 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662644 s, 158 MB/s 2024-09-17T03:40:34.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.805 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644489 s, 163 MB/s 2024-09-17T03:40:34.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592261 s, 177 MB/s 2024-09-17T03:40:34.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649972 s, 161 MB/s 2024-09-17T03:40:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566577 s, 185 MB/s 2024-09-17T03:40:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735005 s, 143 MB/s 2024-09-17T03:40:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680692 s, 154 MB/s 2024-09-17T03:40:34.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583634 s, 180 MB/s 2024-09-17T03:40:34.861 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.861 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669039 s, 157 MB/s 2024-09-17T03:40:34.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.871 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744527 s, 141 MB/s 2024-09-17T03:40:34.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.878 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583841 s, 180 MB/s 2024-09-17T03:40:34.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.887 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.887 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662021 s, 158 MB/s 2024-09-17T03:40:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580952 s, 180 MB/s 2024-09-17T03:40:34.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.903 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.903 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664691 s, 158 MB/s 2024-09-17T03:40:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677262 s, 155 MB/s 2024-09-17T03:40:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.919 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598351 s, 175 MB/s 2024-09-17T03:40:34.927 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.928 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727735 s, 144 MB/s 2024-09-17T03:40:34.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.936 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646995 s, 162 MB/s 2024-09-17T03:40:34.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.944 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616008 s, 170 MB/s 2024-09-17T03:40:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069826 s, 150 MB/s 2024-09-17T03:40:34.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:34.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:34.960 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593737 s, 177 MB/s 2024-09-17T03:40:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:34.966 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:34.966 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:34.967 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.25 2024-09-17T03:40:34.967 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:34.967 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:34.967 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:34.967 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:35.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579873 s, 181 MB/s 2024-09-17T03:40:35.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.033 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675671 s, 155 MB/s 2024-09-17T03:40:35.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724728 s, 145 MB/s 2024-09-17T03:40:35.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075881 s, 138 MB/s 2024-09-17T03:40:35.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586664 s, 179 MB/s 2024-09-17T03:40:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668508 s, 157 MB/s 2024-09-17T03:40:35.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754229 s, 139 MB/s 2024-09-17T03:40:35.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.086 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734408 s, 143 MB/s 2024-09-17T03:40:35.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.094 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607762 s, 173 MB/s 2024-09-17T03:40:35.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064294 s, 163 MB/s 2024-09-17T03:40:35.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.110 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631532 s, 166 MB/s 2024-09-17T03:40:35.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733034 s, 143 MB/s 2024-09-17T03:40:35.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.128 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.128 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728725 s, 144 MB/s 2024-09-17T03:40:35.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.136 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658688 s, 159 MB/s 2024-09-17T03:40:35.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631714 s, 166 MB/s 2024-09-17T03:40:35.152 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.152 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.152 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671235 s, 156 MB/s 2024-09-17T03:40:35.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661988 s, 158 MB/s 2024-09-17T03:40:35.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.170 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766123 s, 137 MB/s 2024-09-17T03:40:35.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.179 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690014 s, 152 MB/s 2024-09-17T03:40:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.187 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651758 s, 161 MB/s 2024-09-17T03:40:35.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.195 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635283 s, 165 MB/s 2024-09-17T03:40:35.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.203 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631587 s, 166 MB/s 2024-09-17T03:40:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597097 s, 176 MB/s 2024-09-17T03:40:35.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.220 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673235 s, 156 MB/s 2024-09-17T03:40:35.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589322 s, 178 MB/s 2024-09-17T03:40:35.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.236 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733711 s, 143 MB/s 2024-09-17T03:40:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691956 s, 152 MB/s 2024-09-17T03:40:35.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066295 s, 158 MB/s 2024-09-17T03:40:35.264 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067693 s, 155 MB/s 2024-09-17T03:40:35.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.269 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597602 s, 175 MB/s 2024-09-17T03:40:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.277 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604115 s, 174 MB/s 2024-09-17T03:40:35.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740382 s, 142 MB/s 2024-09-17T03:40:35.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:35.293 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:35.293 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:35.293 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.26 2024-09-17T03:40:35.293 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:35.293 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:35.293 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:35.293 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:35.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655265 s, 160 MB/s 2024-09-17T03:40:35.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.361 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749854 s, 140 MB/s 2024-09-17T03:40:35.368 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.368 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.368 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570804 s, 184 MB/s 2024-09-17T03:40:35.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602982 s, 174 MB/s 2024-09-17T03:40:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746364 s, 140 MB/s 2024-09-17T03:40:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639718 s, 164 MB/s 2024-09-17T03:40:35.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652747 s, 161 MB/s 2024-09-17T03:40:35.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.409 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613907 s, 171 MB/s 2024-09-17T03:40:35.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.417 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660605 s, 159 MB/s 2024-09-17T03:40:35.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655572 s, 160 MB/s 2024-09-17T03:40:35.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.434 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644179 s, 163 MB/s 2024-09-17T03:40:35.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.442 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678274 s, 155 MB/s 2024-09-17T03:40:35.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064403 s, 163 MB/s 2024-09-17T03:40:35.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644542 s, 163 MB/s 2024-09-17T03:40:35.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.467 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662641 s, 158 MB/s 2024-09-17T03:40:35.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670945 s, 156 MB/s 2024-09-17T03:40:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587791 s, 178 MB/s 2024-09-17T03:40:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659653 s, 159 MB/s 2024-09-17T03:40:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698586 s, 150 MB/s 2024-09-17T03:40:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588832 s, 178 MB/s 2024-09-17T03:40:35.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.515 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574406 s, 183 MB/s 2024-09-17T03:40:35.523 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.524 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649641 s, 161 MB/s 2024-09-17T03:40:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608995 s, 172 MB/s 2024-09-17T03:40:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715181 s, 147 MB/s 2024-09-17T03:40:35.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066583 s, 157 MB/s 2024-09-17T03:40:35.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587816 s, 178 MB/s 2024-09-17T03:40:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645319 s, 162 MB/s 2024-09-17T03:40:35.572 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.573 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652434 s, 161 MB/s 2024-09-17T03:40:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767459 s, 137 MB/s 2024-09-17T03:40:35.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611102 s, 172 MB/s 2024-09-17T03:40:35.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611146 s, 172 MB/s 2024-09-17T03:40:35.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634276 s, 165 MB/s 2024-09-17T03:40:35.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:35.612 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:35.613 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:35.613 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.27 2024-09-17T03:40:35.613 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:35.613 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:35.613 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:35.613 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068084 s, 154 MB/s 2024-09-17T03:40:35.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.679 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611383 s, 172 MB/s 2024-09-17T03:40:35.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.689 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740229 s, 142 MB/s 2024-09-17T03:40:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681305 s, 154 MB/s 2024-09-17T03:40:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.706 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670622 s, 156 MB/s 2024-09-17T03:40:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669408 s, 157 MB/s 2024-09-17T03:40:35.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.723 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744491 s, 141 MB/s 2024-09-17T03:40:35.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639795 s, 164 MB/s 2024-09-17T03:40:35.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.739 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602885 s, 174 MB/s 2024-09-17T03:40:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.747 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678213 s, 155 MB/s 2024-09-17T03:40:35.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.756 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642717 s, 163 MB/s 2024-09-17T03:40:35.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.765 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708691 s, 148 MB/s 2024-09-17T03:40:35.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.774 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705261 s, 149 MB/s 2024-09-17T03:40:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726554 s, 144 MB/s 2024-09-17T03:40:35.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079757 s, 131 MB/s 2024-09-17T03:40:35.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068387 s, 153 MB/s 2024-09-17T03:40:35.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.810 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684111 s, 153 MB/s 2024-09-17T03:40:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.820 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810985 s, 129 MB/s 2024-09-17T03:40:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682408 s, 154 MB/s 2024-09-17T03:40:35.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671893 s, 156 MB/s 2024-09-17T03:40:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727921 s, 144 MB/s 2024-09-17T03:40:35.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771665 s, 136 MB/s 2024-09-17T03:40:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663148 s, 158 MB/s 2024-09-17T03:40:35.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651578 s, 161 MB/s 2024-09-17T03:40:35.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.882 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645961 s, 162 MB/s 2024-09-17T03:40:35.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.891 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680778 s, 154 MB/s 2024-09-17T03:40:35.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815642 s, 129 MB/s 2024-09-17T03:40:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838666 s, 125 MB/s 2024-09-17T03:40:35.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.921 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796421 s, 132 MB/s 2024-09-17T03:40:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772343 s, 136 MB/s 2024-09-17T03:40:35.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.939 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682031 s, 154 MB/s 2024-09-17T03:40:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661418 s, 159 MB/s 2024-09-17T03:40:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:35.954 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:35.954 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:35.954 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.28 2024-09-17T03:40:35.954 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:35.954 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:35.954 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:35.954 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:36.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:36.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.012 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646608 s, 162 MB/s 2024-09-17T03:40:36.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.021 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765707 s, 137 MB/s 2024-09-17T03:40:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645119 s, 163 MB/s 2024-09-17T03:40:36.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.038 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723415 s, 145 MB/s 2024-09-17T03:40:36.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.047 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652148 s, 161 MB/s 2024-09-17T03:40:36.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.055 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065799 s, 159 MB/s 2024-09-17T03:40:36.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.064 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725391 s, 145 MB/s 2024-09-17T03:40:36.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.072 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660596 s, 159 MB/s 2024-09-17T03:40:36.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.081 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726776 s, 144 MB/s 2024-09-17T03:40:36.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.089 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646436 s, 162 MB/s 2024-09-17T03:40:36.097 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.097 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.097 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647358 s, 162 MB/s 2024-09-17T03:40:36.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.106 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731071 s, 143 MB/s 2024-09-17T03:40:36.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648951 s, 162 MB/s 2024-09-17T03:40:36.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.124 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752607 s, 139 MB/s 2024-09-17T03:40:36.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640908 s, 164 MB/s 2024-09-17T03:40:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680618 s, 154 MB/s 2024-09-17T03:40:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069747 s, 150 MB/s 2024-09-17T03:40:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626064 s, 167 MB/s 2024-09-17T03:40:36.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00791226 s, 133 MB/s 2024-09-17T03:40:36.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.175 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661677 s, 158 MB/s 2024-09-17T03:40:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661276 s, 159 MB/s 2024-09-17T03:40:36.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631909 s, 166 MB/s 2024-09-17T03:40:36.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688773 s, 152 MB/s 2024-09-17T03:40:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641625 s, 163 MB/s 2024-09-17T03:40:36.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653867 s, 160 MB/s 2024-09-17T03:40:36.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.226 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743712 s, 141 MB/s 2024-09-17T03:40:36.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.235 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076756 s, 137 MB/s 2024-09-17T03:40:36.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619879 s, 169 MB/s 2024-09-17T03:40:36.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.252 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728171 s, 144 MB/s 2024-09-17T03:40:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665466 s, 158 MB/s 2024-09-17T03:40:36.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.268 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589346 s, 178 MB/s 2024-09-17T03:40:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766875 s, 137 MB/s 2024-09-17T03:40:36.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:36.284 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:36.284 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:36.284 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.29 2024-09-17T03:40:36.284 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:36.284 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:36.284 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:36.284 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:36.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661778 s, 158 MB/s 2024-09-17T03:40:36.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768561 s, 136 MB/s 2024-09-17T03:40:36.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.360 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664475 s, 158 MB/s 2024-09-17T03:40:36.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744391 s, 141 MB/s 2024-09-17T03:40:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582203 s, 180 MB/s 2024-09-17T03:40:36.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681725 s, 154 MB/s 2024-09-17T03:40:36.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.394 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066701 s, 157 MB/s 2024-09-17T03:40:36.403 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.403 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.403 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764416 s, 137 MB/s 2024-09-17T03:40:36.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.411 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674731 s, 155 MB/s 2024-09-17T03:40:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702325 s, 149 MB/s 2024-09-17T03:40:36.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.428 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064121 s, 164 MB/s 2024-09-17T03:40:36.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.436 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668969 s, 157 MB/s 2024-09-17T03:40:36.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574615 s, 182 MB/s 2024-09-17T03:40:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577249 s, 182 MB/s 2024-09-17T03:40:36.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.460 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678911 s, 154 MB/s 2024-09-17T03:40:36.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.468 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624976 s, 168 MB/s 2024-09-17T03:40:36.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.477 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770813 s, 136 MB/s 2024-09-17T03:40:36.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.485 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584257 s, 179 MB/s 2024-09-17T03:40:36.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.494 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730971 s, 143 MB/s 2024-09-17T03:40:36.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.502 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662286 s, 158 MB/s 2024-09-17T03:40:36.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.510 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614192 s, 171 MB/s 2024-09-17T03:40:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732567 s, 143 MB/s 2024-09-17T03:40:36.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632604 s, 166 MB/s 2024-09-17T03:40:36.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.535 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607004 s, 173 MB/s 2024-09-17T03:40:36.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674882 s, 155 MB/s 2024-09-17T03:40:36.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068944 s, 152 MB/s 2024-09-17T03:40:36.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640803 s, 164 MB/s 2024-09-17T03:40:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602626 s, 174 MB/s 2024-09-17T03:40:36.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.576 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586893 s, 179 MB/s 2024-09-17T03:40:36.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.585 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076974 s, 136 MB/s 2024-09-17T03:40:36.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.595 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734377 s, 143 MB/s 2024-09-17T03:40:36.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.603 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602555 s, 174 MB/s 2024-09-17T03:40:36.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:36.609 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:36.609 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:36.609 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.30 2024-09-17T03:40:36.609 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:36.610 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:36.610 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:36.610 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:36.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:36.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.668 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064708 s, 162 MB/s 2024-09-17T03:40:36.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635526 s, 165 MB/s 2024-09-17T03:40:36.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699356 s, 150 MB/s 2024-09-17T03:40:36.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.693 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636229 s, 165 MB/s 2024-09-17T03:40:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742604 s, 141 MB/s 2024-09-17T03:40:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683982 s, 153 MB/s 2024-09-17T03:40:36.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.718 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064408 s, 163 MB/s 2024-09-17T03:40:36.726 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.727 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694017 s, 151 MB/s 2024-09-17T03:40:36.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.735 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653773 s, 160 MB/s 2024-09-17T03:40:36.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.743 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670121 s, 156 MB/s 2024-09-17T03:40:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582763 s, 180 MB/s 2024-09-17T03:40:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058684 s, 179 MB/s 2024-09-17T03:40:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744043 s, 141 MB/s 2024-09-17T03:40:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606125 s, 173 MB/s 2024-09-17T03:40:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696724 s, 151 MB/s 2024-09-17T03:40:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661411 s, 159 MB/s 2024-09-17T03:40:36.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591892 s, 177 MB/s 2024-09-17T03:40:36.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.808 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667169 s, 157 MB/s 2024-09-17T03:40:36.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.817 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727047 s, 144 MB/s 2024-09-17T03:40:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601034 s, 174 MB/s 2024-09-17T03:40:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073069 s, 144 MB/s 2024-09-17T03:40:36.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.842 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654236 s, 160 MB/s 2024-09-17T03:40:36.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.851 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736264 s, 142 MB/s 2024-09-17T03:40:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587857 s, 178 MB/s 2024-09-17T03:40:36.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.867 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589324 s, 178 MB/s 2024-09-17T03:40:36.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590074 s, 178 MB/s 2024-09-17T03:40:36.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706713 s, 148 MB/s 2024-09-17T03:40:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675415 s, 155 MB/s 2024-09-17T03:40:36.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599522 s, 175 MB/s 2024-09-17T03:40:36.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.907 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588931 s, 178 MB/s 2024-09-17T03:40:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670006 s, 157 MB/s 2024-09-17T03:40:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765684 s, 137 MB/s 2024-09-17T03:40:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:36.932 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:40:36.932 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:40:36.932 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.31 2024-09-17T03:40:36.932 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:40:36.932 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:40:36.932 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:40:36.932 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:40:36.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:40:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741013 s, 142 MB/s 2024-09-17T03:40:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693781 s, 151 MB/s 2024-09-17T03:40:37.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.009 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721224 s, 145 MB/s 2024-09-17T03:40:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672141 s, 156 MB/s 2024-09-17T03:40:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684798 s, 153 MB/s 2024-09-17T03:40:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603945 s, 174 MB/s 2024-09-17T03:40:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723154 s, 145 MB/s 2024-09-17T03:40:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.051 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667148 s, 157 MB/s 2024-09-17T03:40:37.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.061 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740267 s, 142 MB/s 2024-09-17T03:40:37.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.068 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652817 s, 161 MB/s 2024-09-17T03:40:37.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674243 s, 156 MB/s 2024-09-17T03:40:37.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593337 s, 177 MB/s 2024-09-17T03:40:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.093 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716233 s, 146 MB/s 2024-09-17T03:40:37.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671757 s, 156 MB/s 2024-09-17T03:40:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.109 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580163 s, 181 MB/s 2024-09-17T03:40:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.118 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744189 s, 141 MB/s 2024-09-17T03:40:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071482 s, 147 MB/s 2024-09-17T03:40:37.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.135 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635512 s, 165 MB/s 2024-09-17T03:40:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.143 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631811 s, 166 MB/s 2024-09-17T03:40:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.151 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667811 s, 157 MB/s 2024-09-17T03:40:37.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.159 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603731 s, 174 MB/s 2024-09-17T03:40:37.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.168 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720948 s, 145 MB/s 2024-09-17T03:40:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671829 s, 156 MB/s 2024-09-17T03:40:37.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605837 s, 173 MB/s 2024-09-17T03:40:37.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725673 s, 144 MB/s 2024-09-17T03:40:37.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595096 s, 176 MB/s 2024-09-17T03:40:37.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601197 s, 174 MB/s 2024-09-17T03:40:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641736 s, 163 MB/s 2024-09-17T03:40:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.226 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731303 s, 143 MB/s 2024-09-17T03:40:37.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.234 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607355 s, 173 MB/s 2024-09-17T03:40:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755525 s, 139 MB/s 2024-09-17T03:40:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:40:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:40:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065991 s, 159 MB/s 2024-09-17T03:40:37.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:40:37.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:37.260 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-09-17T03:40:37.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.376+0000 7f632f093640 1 -- 172.21.15.146:0/2302756638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632815c8e0 msgr2=0x7f632806f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.376+0000 7f632f093640 1 --2- 172.21.15.146:0/2302756638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632815c8e0 0x7f632806f580 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f632815bd20 tx=0x7f631802a560 comp rx=0 tx=0).stop 2024-09-17T03:40:37.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.376+0000 7f632f093640 1 -- 172.21.15.146:0/2302756638 shutdown_connections 2024-09-17T03:40:37.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.376+0000 7f632f093640 1 --2- 172.21.15.146:0/2302756638 >> v2:172.21.15.179:3300/0 conn(0x7f63280cd840 0x7f63280b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.376+0000 7f632f093640 1 --2- 172.21.15.146:0/2302756638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632815c8e0 0x7f632806f580 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.376+0000 7f632f093640 1 -- 172.21.15.146:0/2302756638 >> 172.21.15.146:0/2302756638 conn(0x7f63280b3150 msgr2=0x7f63280b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.376+0000 7f632f093640 1 -- 172.21.15.146:0/2302756638 shutdown_connections 2024-09-17T03:40:37.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.376+0000 7f632f093640 1 -- 172.21.15.146:0/2302756638 wait complete. 2024-09-17T03:40:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.378+0000 7f632f093640 1 Processor -- start 2024-09-17T03:40:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.378+0000 7f632f093640 1 -- start start 2024-09-17T03:40:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.379+0000 7f632f093640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63280cd840 0x7f632814c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.379+0000 7f632f093640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63280cdc50 0x7f63280b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.379+0000 7f632f093640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632815c8e0 0x7f63280b6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.379+0000 7f632f093640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6328073580 con 0x7f632815c8e0 2024-09-17T03:40:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.379+0000 7f632f093640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f63280b5e50 con 0x7f63280cd840 2024-09-17T03:40:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.379+0000 7f632f093640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6328073700 con 0x7f63280cdc50 2024-09-17T03:40:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.379+0000 7f632d630640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632815c8e0 0x7f63280b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.379+0000 7f632d630640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632815c8e0 0x7f63280b6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37600/0 (socket says 172.21.15.146:37600) 2024-09-17T03:40:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.379+0000 7f632d630640 1 -- 172.21.15.146:0/3944258046 learned_addr learned my addr 172.21.15.146:0/3944258046 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f6327fff640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63280cdc50 0x7f63280b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f632ce2f640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63280cd840 0x7f632814c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f632d630640 1 -- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63280cdc50 msgr2=0x7f63280b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f632d630640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63280cdc50 0x7f63280b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f632d630640 1 -- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63280cd840 msgr2=0x7f632814c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f632d630640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63280cd840 0x7f632814c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f632d630640 1 -- 172.21.15.146:0/3944258046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63281f6df0 con 0x7f632815c8e0 2024-09-17T03:40:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f632d630640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632815c8e0 0x7f63280b6510 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f632000c3c0 tx=0x7f632000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f63257fa640 1 -- 172.21.15.146:0/3944258046 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320017070 con 0x7f632815c8e0 2024-09-17T03:40:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f63257fa640 1 -- 172.21.15.146:0/3944258046 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63200053c0 con 0x7f632815c8e0 2024-09-17T03:40:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f632f093640 1 -- 172.21.15.146:0/3944258046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63281f70d0 con 0x7f632815c8e0 2024-09-17T03:40:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f63257fa640 1 -- 172.21.15.146:0/3944258046 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320003850 con 0x7f632815c8e0 2024-09-17T03:40:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.380+0000 7f632f093640 1 -- 172.21.15.146:0/3944258046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63281f7690 con 0x7f632815c8e0 2024-09-17T03:40:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.382+0000 7f63257fa640 1 -- 172.21.15.146:0/3944258046 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f632001a070 con 0x7f632815c8e0 2024-09-17T03:40:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.383+0000 7f63257fa640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6314078b90 0x7f631407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.383+0000 7f63257fa640 1 -- 172.21.15.146:0/3944258046 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f632009a090 con 0x7f632815c8e0 2024-09-17T03:40:37.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.383+0000 7f632ce2f640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6314078b90 0x7f631407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.384+0000 7f6335fff740 1 Processor -- start 2024-09-17T03:40:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.384+0000 7f632ce2f640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6314078b90 0x7f631407b0a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6318033000 tx=0x7f6318004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.384+0000 7f6335fff740 1 -- start start 2024-09-17T03:40:37.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6335fff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26d5730 0x5638e2ac4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6335fff740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26ac870 0x5638e2aa7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6335fff740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26b4a50 0x5638e2aa8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6335fff740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5638e29efc40 con 0x5638e26ac870 2024-09-17T03:40:37.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6335fff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5638e29df070 con 0x5638e26d5730 2024-09-17T03:40:37.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6335fff740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5638e29e2e80 con 0x5638e26b4a50 2024-09-17T03:40:37.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6327fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26ac870 0x5638e2aa7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f632ce2f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26d5730 0x5638e2ac4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6327fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26ac870 0x5638e2aa7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37606/0 (socket says 172.21.15.146:37606) 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6327fff640 1 -- 172.21.15.146:0/1905388317 learned_addr learned my addr 172.21.15.146:0/1905388317 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f632d630640 1 --2- 172.21.15.146:0/1905388317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26b4a50 0x5638e2aa8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6327fff640 1 -- 172.21.15.146:0/1905388317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26b4a50 msgr2=0x5638e2aa8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6327fff640 1 --2- 172.21.15.146:0/1905388317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26b4a50 0x5638e2aa8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6327fff640 1 -- 172.21.15.146:0/1905388317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26d5730 msgr2=0x5638e2ac4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6327fff640 1 --2- 172.21.15.146:0/1905388317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26d5730 0x5638e2ac4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6327fff640 1 -- 172.21.15.146:0/1905388317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638e27b9ba0 con 0x5638e26ac870 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.385+0000 7f6327fff640 1 --2- 172.21.15.146:0/1905388317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26ac870 0x5638e2aa7ac0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f631c009f60 tx=0x7f631c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df20e1dad317cfab server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.386+0000 7f630e7fc640 1 -- 172.21.15.146:0/1905388317 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c003c30 con 0x5638e26ac870 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.386+0000 7f630e7fc640 1 -- 172.21.15.146:0/1905388317 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f631c003dd0 con 0x5638e26ac870 2024-09-17T03:40:37.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.386+0000 7f630e7fc640 1 -- 172.21.15.146:0/1905388317 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c004250 con 0x5638e26ac870 2024-09-17T03:40:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.386+0000 7f6335fff740 1 -- 172.21.15.146:0/1905388317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26ac870 msgr2=0x5638e2aa7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.386+0000 7f6335fff740 1 --2- 172.21.15.146:0/1905388317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26ac870 0x5638e2aa7ac0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f631c009f60 tx=0x7f631c009f90 comp rx=0 tx=0).stop 2024-09-17T03:40:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.386+0000 7f6335fff740 1 -- 172.21.15.146:0/1905388317 shutdown_connections 2024-09-17T03:40:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.386+0000 7f6335fff740 1 --2- 172.21.15.146:0/1905388317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26b4a50 0x5638e2aa8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.386+0000 7f6335fff740 1 --2- 172.21.15.146:0/1905388317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26ac870 0x5638e2aa7ac0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.386+0000 7f6335fff740 1 --2- 172.21.15.146:0/1905388317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26d5730 0x5638e2ac4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.386+0000 7f6335fff740 1 -- 172.21.15.146:0/1905388317 >> 172.21.15.146:0/1905388317 conn(0x5638e26c9880 msgr2=0x5638e2a7dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.387+0000 7f6335fff740 1 -- 172.21.15.146:0/1905388317 shutdown_connections 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.387+0000 7f6335fff740 1 -- 172.21.15.146:0/1905388317 wait complete. 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.387+0000 7f6335fff740 1 -- start start 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.388+0000 7f6335fff740 1 Processor -- start 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6335fff740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2aa4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6335fff740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26b4a50 0x5638e2aa3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6335fff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26d5730 0x5638e2a7d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6335fff740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5638e274fae0 con 0x5638e26b4a50 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6335fff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5638e2965870 con 0x5638e26d5730 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6335fff740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5638e2ad28c0 con 0x5638e26ac870 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6335fff740 10 client.0 _ll_register_callbacks cb 0x5638e29932d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6327fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26b4a50 0x5638e2aa3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6327fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26b4a50 0x5638e2aa3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37610/0 (socket says 172.21.15.146:37610) 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6327fff640 1 -- 172.21.15.146:0/1946954087 learned_addr learned my addr 172.21.15.146:0/1946954087 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f632ce2f640 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2aa4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f632d630640 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26d5730 0x5638e2a7d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6327fff640 1 -- 172.21.15.146:0/1946954087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 msgr2=0x5638e2aa4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6327fff640 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2aa4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6327fff640 1 -- 172.21.15.146:0/1946954087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26d5730 msgr2=0x5638e2a7d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6327fff640 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26d5730 0x5638e2a7d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6327fff640 1 -- 172.21.15.146:0/1946954087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638e271ea40 con 0x5638e26b4a50 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f6327fff640 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26b4a50 0x5638e2aa3c90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f631c000f80 tx=0x7f631c004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e245b54313eb270 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.389+0000 7f63077fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f63077fe640 1 -- 172.21.15.146:0/1946954087 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c027030 con 0x5638e26b4a50 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f63077fe640 1 -- 172.21.15.146:0/1946954087 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f631c01f040 con 0x5638e26b4a50 2024-09-17T03:40:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f6335fff740 1 -- 172.21.15.146:0/1946954087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f631c003dd0 con 0x5638e26b4a50 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f63077fe640 1 -- 172.21.15.146:0/1946954087 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f631c004680 con 0x5638e26b4a50 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f6335fff740 10 client.8379 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f6335fff740 1 -- 172.21.15.146:0/1946954087 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5638e281a330 con 0x5638e26b4a50 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f63077fe640 1 -- 172.21.15.146:0/1946954087 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f631c003dd0 con 0x5638e26b4a50 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f63077fe640 1 -- 172.21.15.146:0/1946954087 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f631c018070 con 0x5638e26b4a50 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f6335fff740 10 client.8379 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f6335fff740 10 client.8379 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f6335fff740 20 client.8379 populate_metadata read hostname 'smithi146' 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f6335fff740 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5638e2694300 0x5638e2a7db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f6335fff740 4 client.8379 mds_command: new command op to 8187 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f6335fff740 1 -- 172.21.15.146:0/1946954087 --> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638e29f1b90 con 0x5638e2694300 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.390+0000 7f632ce2f640 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5638e2694300 0x5638e2a7db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.391+0000 7f63077fe640 10 client.8379 ms_handle_connect on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.391+0000 7f632ce2f640 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5638e2694300 0x5638e2a7db40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=555af15e35ce7ef8 server_cookie=1626f7b35804ccc3 in_seq=0 out_seq=0 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.391+0000 7f63077fe640 1 -- 172.21.15.146:0/1946954087 <== mds.0 v2:172.21.15.146:6832/2931720030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638e29f1b90 con 0x5638e2694300 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.391+0000 7f63077fe640 10 client.8379 handle_command_reply: tid=0 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.391+0000 7f6335fff740 1 client.8379 shutdown 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f6335fff740 1 -- 172.21.15.146:0/1946954087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26b4a50 msgr2=0x5638e2aa3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f6335fff740 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26b4a50 0x5638e2aa3c90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f631c000f80 tx=0x7f631c004280 comp rx=0 tx=0).stop 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f6335fff740 1 -- 172.21.15.146:0/1946954087 shutdown_connections 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f6335fff740 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5638e2694300 0x5638e2a7db40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f6335fff740 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26d5730 0x5638e2a7d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f6335fff740 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26b4a50 0x5638e2aa3c90 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f63077fe640 0 client.8379 ms_handle_reset on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f6335fff740 1 --2- 172.21.15.146:0/1946954087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2aa4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f6335fff740 1 -- 172.21.15.146:0/1946954087 >> 172.21.15.146:0/1946954087 conn(0x5638e26c9880 msgr2=0x5638e2ac3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f6335fff740 1 -- 172.21.15.146:0/1946954087 shutdown_connections 2024-09-17T03:40:37.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f6335fff740 1 -- 172.21.15.146:0/1946954087 wait complete. 2024-09-17T03:40:37.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.392+0000 7f6335fff740 20 client.8379 trim_cache size 0 max 16384 2024-09-17T03:40:37.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.409+0000 7f6335fff740 1 Processor -- start 2024-09-17T03:40:37.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.409+0000 7f6335fff740 1 -- start start 2024-09-17T03:40:37.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f6335fff740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2ad20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f6335fff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 0x5638e2aa1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f6335fff740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f6335fff740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6328200120 con 0x5638e26d5730 2024-09-17T03:40:37.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f6335fff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f63281ff130 con 0x5638e26b4a50 2024-09-17T03:40:37.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f6335fff740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f63281556b0 con 0x5638e26ac870 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f632d630640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f632d630640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a772a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37624/0 (socket says 172.21.15.146:37624) 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f632d630640 1 -- 172.21.15.146:0/4021145785 learned_addr learned my addr 172.21.15.146:0/4021145785 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f6327fff640 1 --2- 172.21.15.146:0/4021145785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 0x5638e2aa1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f632ce2f640 1 --2- 172.21.15.146:0/4021145785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2ad20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f632d630640 1 -- 172.21.15.146:0/4021145785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 msgr2=0x5638e2ad20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f632d630640 1 --2- 172.21.15.146:0/4021145785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2ad20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f632d630640 1 -- 172.21.15.146:0/4021145785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 msgr2=0x5638e2aa1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f632d630640 1 --2- 172.21.15.146:0/4021145785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 0x5638e2aa1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f632d630640 1 -- 172.21.15.146:0/4021145785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638e27b7ea0 con 0x5638e26d5730 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f632ce2f640 1 --2- 172.21.15.146:0/4021145785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2ad20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:37.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f632d630640 1 --2- 172.21.15.146:0/4021145785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a772a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f632000cd80 tx=0x7f632001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de5cd0f7c5cf7c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f630dffb640 1 -- 172.21.15.146:0/4021145785 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320065040 con 0x5638e26d5730 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f630dffb640 1 -- 172.21.15.146:0/4021145785 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6320088030 con 0x5638e26d5730 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.411+0000 7f630dffb640 1 -- 172.21.15.146:0/4021145785 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632006b7f0 con 0x5638e26d5730 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.412+0000 7f6335fff740 1 -- 172.21.15.146:0/4021145785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 msgr2=0x5638e2a772a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.412+0000 7f6335fff740 1 --2- 172.21.15.146:0/4021145785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a772a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f632000cd80 tx=0x7f632001e040 comp rx=0 tx=0).stop 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.412+0000 7f6335fff740 1 -- 172.21.15.146:0/4021145785 shutdown_connections 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.412+0000 7f6335fff740 1 --2- 172.21.15.146:0/4021145785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a772a0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.412+0000 7f6335fff740 1 --2- 172.21.15.146:0/4021145785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 0x5638e2aa1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.412+0000 7f6335fff740 1 --2- 172.21.15.146:0/4021145785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2ad20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.412+0000 7f6335fff740 1 -- 172.21.15.146:0/4021145785 >> 172.21.15.146:0/4021145785 conn(0x5638e26c9880 msgr2=0x5638e2a7e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.412+0000 7f6335fff740 1 -- 172.21.15.146:0/4021145785 shutdown_connections 2024-09-17T03:40:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.412+0000 7f6335fff740 1 -- 172.21.15.146:0/4021145785 wait complete. 2024-09-17T03:40:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.413+0000 7f6335fff740 1 -- start start 2024-09-17T03:40:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.413+0000 7f6335fff740 1 Processor -- start 2024-09-17T03:40:37.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6335fff740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2b459d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6335fff740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 0x5638e2b41cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6335fff740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a7cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6335fff740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5638e274fae0 con 0x5638e26d5730 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6335fff740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6328155d00 con 0x5638e26b4a50 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6335fff740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5638e2aa7d60 con 0x5638e26ac870 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6335fff740 10 client.0 _ll_register_callbacks cb 0x7f6318040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f632d630640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a7cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6327fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 0x5638e2b41cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f632ce2f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2b459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6327fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 0x5638e2b41cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:40894/0 (socket says 172.21.15.146:40894) 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6327fff640 1 -- 172.21.15.146:0/908991673 learned_addr learned my addr 172.21.15.146:0/908991673 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f632d630640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a7cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37638/0 (socket says 172.21.15.146:37638) 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f632d630640 1 -- 172.21.15.146:0/908991673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 msgr2=0x5638e2b459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f632d630640 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2b459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f632d630640 1 -- 172.21.15.146:0/908991673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 msgr2=0x5638e2b41cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f632d630640 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 0x5638e2b41cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f632d630640 1 -- 172.21.15.146:0/908991673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638e2ad2550 con 0x5638e26d5730 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6327fff640 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 0x5638e2b41cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f632d630640 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a7cf60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f6320000f60 tx=0x7f632005e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62feb29973059903 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f63077fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f63077fe640 1 -- 172.21.15.146:0/908991673 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320065040 con 0x5638e26d5730 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f63077fe640 1 -- 172.21.15.146:0/908991673 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f63200610e0 con 0x5638e26d5730 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6335fff740 1 -- 172.21.15.146:0/908991673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6320088030 con 0x5638e26d5730 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f63077fe640 1 -- 172.21.15.146:0/908991673 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f63200842e0 con 0x5638e26d5730 2024-09-17T03:40:37.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6335fff740 10 client.8385 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.415+0000 7f6335fff740 1 -- 172.21.15.146:0/908991673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5638e2a7cb90 con 0x5638e26d5730 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.416+0000 7f63077fe640 1 -- 172.21.15.146:0/908991673 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6320088030 con 0x5638e26d5730 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.416+0000 7f63077fe640 1 -- 172.21.15.146:0/908991673 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f632005d7d0 con 0x5638e26d5730 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.416+0000 7f6335fff740 10 client.8385 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.416+0000 7f6335fff740 10 client.8385 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.416+0000 7f6335fff740 20 client.8385 populate_metadata read hostname 'smithi146' 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.416+0000 7f6335fff740 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5638e2ac2a70 0x5638e2a7d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.416+0000 7f6335fff740 4 client.8385 mds_command: new command op to 8187 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.416+0000 7f6335fff740 1 -- 172.21.15.146:0/908991673 --> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5638e29ed640 con 0x5638e2ac2a70 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.416+0000 7f632ce2f640 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5638e2ac2a70 0x5638e2a7d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.416+0000 7f63077fe640 10 client.8385 ms_handle_connect on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.416+0000 7f632ce2f640 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5638e2ac2a70 0x5638e2a7d4a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a98c3753c2da73bd server_cookie=17ddeafa7564760b in_seq=0 out_seq=0 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f63077fe640 1 -- 172.21.15.146:0/908991673 <== mds.0 v2:172.21.15.146:6832/2931720030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5638e29ed640 con 0x5638e2ac2a70 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f63077fe640 10 client.8385 handle_command_reply: tid=0 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f6335fff740 1 client.8385 shutdown 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f6335fff740 1 -- 172.21.15.146:0/908991673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 msgr2=0x5638e2a7cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f6335fff740 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a7cf60 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f6320000f60 tx=0x7f632005e4d0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f6335fff740 1 -- 172.21.15.146:0/908991673 shutdown_connections 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f6335fff740 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5638e2ac2a70 0x5638e2a7d4a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f6335fff740 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5638e26d5730 0x5638e2a7cf60 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f6335fff740 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5638e26b4a50 0x5638e2b41cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f6335fff740 1 --2- 172.21.15.146:0/908991673 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5638e26ac870 0x5638e2b459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f6335fff740 1 -- 172.21.15.146:0/908991673 >> 172.21.15.146:0/908991673 conn(0x5638e26c9880 msgr2=0x5638e2ac2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f63077fe640 0 client.8385 ms_handle_reset on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f6335fff740 1 -- 172.21.15.146:0/908991673 shutdown_connections 2024-09-17T03:40:37.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.419+0000 7f6335fff740 1 -- 172.21.15.146:0/908991673 wait complete. 2024-09-17T03:40:37.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f6335fff740 20 client.8385 trim_cache size 0 max 16384 2024-09-17T03:40:37.423 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:40:37.423 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:40:37.423 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "1335fba5-4ec7-4826-88ea-6235ee94d22b", 2024-09-17T03:40:37.423 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:40:37.423 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:40:37.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 -- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6314078b90 msgr2=0x7f631407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6314078b90 0x7f631407b0a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6318033000 tx=0x7f6318004730 comp rx=0 tx=0).stop 2024-09-17T03:40:37.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 -- 172.21.15.146:0/3944258046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632815c8e0 msgr2=0x7f63280b6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632815c8e0 0x7f63280b6510 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f632000c3c0 tx=0x7f632000c880 comp rx=0 tx=0).stop 2024-09-17T03:40:37.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 -- 172.21.15.146:0/3944258046 shutdown_connections 2024-09-17T03:40:37.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6314078b90 0x7f631407b0a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f632815c8e0 0x7f63280b6510 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63280cdc50 0x7f63280b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 --2- 172.21.15.146:0/3944258046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63280cd840 0x7f632814c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 -- 172.21.15.146:0/3944258046 >> 172.21.15.146:0/3944258046 conn(0x7f63280b3150 msgr2=0x7f632815b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 -- 172.21.15.146:0/3944258046 shutdown_connections 2024-09-17T03:40:37.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.420+0000 7f632f093640 1 -- 172.21.15.146:0/3944258046 wait complete. 2024-09-17T03:40:37.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:37.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-09-17T03:40:37.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.580+0000 7f34c554a640 1 -- 172.21.15.146:0/819613777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c01556c0 msgr2=0x7f34c0155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.580+0000 7f34c554a640 1 --2- 172.21.15.146:0/819613777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c01556c0 0x7f34c0155ad0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f34c0074370 tx=0x7f34b802a980 comp rx=0 tx=0).stop 2024-09-17T03:40:37.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.581+0000 7f34c554a640 1 -- 172.21.15.146:0/819613777 shutdown_connections 2024-09-17T03:40:37.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.581+0000 7f34c554a640 1 --2- 172.21.15.146:0/819613777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c01556c0 0x7f34c0155ad0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.581+0000 7f34c554a640 1 --2- 172.21.15.146:0/819613777 >> v2:172.21.15.179:3300/0 conn(0x7f34c00735f0 0x7f34c0073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.581+0000 7f34c554a640 1 --2- 172.21.15.146:0/819613777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c00cdf90 0x7f34c015c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.581+0000 7f34c554a640 1 -- 172.21.15.146:0/819613777 >> 172.21.15.146:0/819613777 conn(0x7f34c00b3510 msgr2=0x7f34c00b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.581+0000 7f34c554a640 1 -- 172.21.15.146:0/819613777 shutdown_connections 2024-09-17T03:40:37.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.581+0000 7f34c554a640 1 -- 172.21.15.146:0/819613777 wait complete. 2024-09-17T03:40:37.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.583+0000 7f34c554a640 1 Processor -- start 2024-09-17T03:40:37.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.583+0000 7f34c554a640 1 -- start start 2024-09-17T03:40:37.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.585+0000 7f34c554a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34c00735f0 0x7f34c01f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.585+0000 7f34c554a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c00cdf90 0x7f34c01f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.585+0000 7f34c554a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c01556c0 0x7f34c01f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.585+0000 7f34bf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c01556c0 0x7f34c01f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.585+0000 7f34bf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c01556c0 0x7f34c01f2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37658/0 (socket says 172.21.15.146:37658) 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.585+0000 7f34bf7fe640 1 -- 172.21.15.146:0/2770184748 learned_addr learned my addr 172.21.15.146:0/2770184748 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.585+0000 7f34c554a640 1 -- 172.21.15.146:0/2770184748 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f34c00b6760 con 0x7f34c01556c0 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.585+0000 7f34c554a640 1 -- 172.21.15.146:0/2770184748 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34c00b65e0 con 0x7f34c00735f0 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.585+0000 7f34c554a640 1 -- 172.21.15.146:0/2770184748 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f34c015f350 con 0x7f34c00cdf90 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.585+0000 7f34beffd640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34c00735f0 0x7f34c01f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.585+0000 7f34be7fc640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c00cdf90 0x7f34c01f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34be7fc640 1 -- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34c00735f0 msgr2=0x7f34c01f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34be7fc640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34c00735f0 0x7f34c01f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34be7fc640 1 -- 172.21.15.146:0/2770184748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c01556c0 msgr2=0x7f34c01f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34be7fc640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c01556c0 0x7f34c01f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34be7fc640 1 -- 172.21.15.146:0/2770184748 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c01f2620 con 0x7f34c00cdf90 2024-09-17T03:40:37.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34beffd640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34c00735f0 0x7f34c01f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:40:37.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34be7fc640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c00cdf90 0x7f34c01f20e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f34b4010730 tx=0x7f34b4010bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34a77fe640 1 -- 172.21.15.146:0/2770184748 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b401a020 con 0x7f34c00cdf90 2024-09-17T03:40:37.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34a77fe640 1 -- 172.21.15.146:0/2770184748 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34b400d8a0 con 0x7f34c00cdf90 2024-09-17T03:40:37.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34a77fe640 1 -- 172.21.15.146:0/2770184748 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b400dcf0 con 0x7f34c00cdf90 2024-09-17T03:40:37.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34c554a640 1 -- 172.21.15.146:0/2770184748 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c0151790 con 0x7f34c00cdf90 2024-09-17T03:40:37.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.586+0000 7f34c554a640 1 -- 172.21.15.146:0/2770184748 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c0151d50 con 0x7f34c00cdf90 2024-09-17T03:40:37.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.589+0000 7f34a77fe640 1 -- 172.21.15.146:0/2770184748 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34b401d020 con 0x7f34c00cdf90 2024-09-17T03:40:37.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.589+0000 7f34a77fe640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ac078bc0 0x7f34ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.589+0000 7f34a77fe640 1 -- 172.21.15.146:0/2770184748 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f34b409d120 con 0x7f34c00cdf90 2024-09-17T03:40:37.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.590+0000 7f34beffd640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ac078bc0 0x7f34ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.590+0000 7f34beffd640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ac078bc0 0x7f34ac07b0d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f34c0072ae0 tx=0x7f34b000a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.591+0000 7f34cc4b4740 1 Processor -- start 2024-09-17T03:40:37.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.591+0000 7f34cc4b4740 1 -- start start 2024-09-17T03:40:37.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.593+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e6537390 0x5596e6926310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.594+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e6908fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.594+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e6909520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.594+0000 7f34cc4b4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5596e6851bd0 con 0x5596e650e4d0 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.594+0000 7f34cc4b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5596e6841000 con 0x5596e65166b0 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.594+0000 7f34be7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e6908fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.594+0000 7f34be7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e6908fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37666/0 (socket says 172.21.15.146:37666) 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.594+0000 7f34beffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e6537390 0x5596e6926310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.594+0000 7f34be7fc640 1 -- 172.21.15.146:0/4203876838 learned_addr learned my addr 172.21.15.146:0/4203876838 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.594+0000 7f34bf7fe640 1 --2- 172.21.15.146:0/4203876838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e6909520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.594+0000 7f34cc4b4740 1 -- 172.21.15.146:0/4203876838 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5596e6844e10 con 0x5596e6537390 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.595+0000 7f34beffd640 1 -- 172.21.15.146:0/4203876838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 msgr2=0x5596e6909520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.595+0000 7f34beffd640 1 --2- 172.21.15.146:0/4203876838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e6909520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.595+0000 7f34beffd640 1 -- 172.21.15.146:0/4203876838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 msgr2=0x5596e6908fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.595+0000 7f34beffd640 1 --2- 172.21.15.146:0/4203876838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e6908fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.595+0000 7f34beffd640 1 -- 172.21.15.146:0/4203876838 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596e66197d0 con 0x5596e6537390 2024-09-17T03:40:37.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.595+0000 7f34be7fc640 1 --2- 172.21.15.146:0/4203876838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e6908fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:40:37.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.595+0000 7f34beffd640 1 --2- 172.21.15.146:0/4203876838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e6537390 0x5596e6926310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34b00107b0 tx=0x7f34b0012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c3b9f15abe26a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.595+0000 7f34a4ff9640 1 -- 172.21.15.146:0/4203876838 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0016070 con 0x5596e6537390 2024-09-17T03:40:37.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.595+0000 7f34a4ff9640 1 -- 172.21.15.146:0/4203876838 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34b001bc20 con 0x5596e6537390 2024-09-17T03:40:37.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.595+0000 7f34a4ff9640 1 -- 172.21.15.146:0/4203876838 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0027480 con 0x5596e6537390 2024-09-17T03:40:37.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.596+0000 7f34cc4b4740 1 -- 172.21.15.146:0/4203876838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e6537390 msgr2=0x5596e6926310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.596+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/4203876838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e6537390 0x5596e6926310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34b00107b0 tx=0x7f34b0012000 comp rx=0 tx=0).stop 2024-09-17T03:40:37.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.596+0000 7f34cc4b4740 1 -- 172.21.15.146:0/4203876838 shutdown_connections 2024-09-17T03:40:37.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.596+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/4203876838 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e6909520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.596+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/4203876838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e6908fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.596+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/4203876838 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e6537390 0x5596e6926310 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.596+0000 7f34cc4b4740 1 -- 172.21.15.146:0/4203876838 >> 172.21.15.146:0/4203876838 conn(0x5596e652b4e0 msgr2=0x5596e68df200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.596+0000 7f34cc4b4740 1 -- 172.21.15.146:0/4203876838 shutdown_connections 2024-09-17T03:40:37.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.596+0000 7f34cc4b4740 1 -- 172.21.15.146:0/4203876838 wait complete. 2024-09-17T03:40:37.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.597+0000 7f34cc4b4740 1 -- start start 2024-09-17T03:40:37.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.597+0000 7f34cc4b4740 1 Processor -- start 2024-09-17T03:40:37.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e691e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e68f7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e6537390 0x5596e68f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34cc4b4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5596e65b1740 con 0x5596e650e4d0 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34cc4b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5596e67e6540 con 0x5596e65166b0 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34cc4b4740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5596e68f46b0 con 0x5596e6537390 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34cc4b4740 10 client.0 _ll_register_callbacks cb 0x5596e67e50e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34be7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e68f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34beffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e691e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34be7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e68f7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:40928/0 (socket says 172.21.15.146:40928) 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34be7fc640 1 -- 172.21.15.146:0/2863817541 learned_addr learned my addr 172.21.15.146:0/2863817541 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.599+0000 7f34bf7fe640 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e6537390 0x5596e68f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.600+0000 7f34be7fc640 1 -- 172.21.15.146:0/2863817541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e6537390 msgr2=0x5596e68f7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.600+0000 7f34be7fc640 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e6537390 0x5596e68f7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.600+0000 7f34be7fc640 1 -- 172.21.15.146:0/2863817541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 msgr2=0x5596e691e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.600+0000 7f34be7fc640 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e691e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.600+0000 7f34be7fc640 1 -- 172.21.15.146:0/2863817541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596e65806a0 con 0x5596e65166b0 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.600+0000 7f34beffd640 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e691e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.600+0000 7f34be7fc640 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e68f7990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f34b4010700 tx=0x7f34b40654b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54c5365aebd3a4db server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.600+0000 7f349dffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.600+0000 7f349dffb640 1 -- 172.21.15.146:0/2863817541 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4050320 con 0x5596e65166b0 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.600+0000 7f349dffb640 1 -- 172.21.15.146:0/2863817541 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f34b4060860 con 0x5596e65166b0 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.600+0000 7f34cc4b4740 1 -- 172.21.15.146:0/2863817541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34b001bc20 con 0x5596e65166b0 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f349dffb640 1 -- 172.21.15.146:0/2863817541 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f34b4064f10 con 0x5596e65166b0 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f34cc4b4740 10 client.7522 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f34cc4b4740 1 -- 172.21.15.146:0/2863817541 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5596e6679f60 con 0x5596e65166b0 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f349dffb640 1 -- 172.21.15.146:0/2863817541 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34b001bc20 con 0x5596e65166b0 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f349dffb640 1 -- 172.21.15.146:0/2863817541 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f34b4060a60 con 0x5596e65166b0 2024-09-17T03:40:37.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f34cc4b4740 10 client.7522 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:37.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f34cc4b4740 10 client.7522 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-17T03:40:37.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f34cc4b4740 20 client.7522 populate_metadata read hostname 'smithi146' 2024-09-17T03:40:37.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5596e64f5f60 0x5596e6901310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f34cc4b4740 4 client.7522 mds_command: new command op to 8187 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:40:37.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f34cc4b4740 1 -- 172.21.15.146:0/2863817541 --> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596e6853b20 con 0x5596e64f5f60 2024-09-17T03:40:37.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.601+0000 7f34beffd640 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5596e64f5f60 0x5596e6901310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.602+0000 7f349dffb640 10 client.7522 ms_handle_connect on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.602+0000 7f34beffd640 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5596e64f5f60 0x5596e6901310 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f3d9eae30039c0d server_cookie=760f3355e7ab9a34 in_seq=0 out_seq=0 2024-09-17T03:40:37.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.605+0000 7f349dffb640 1 -- 172.21.15.146:0/2863817541 <== mds.0 v2:172.21.15.146:6832/2931720030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596e6853b20 con 0x5596e64f5f60 2024-09-17T03:40:37.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.605+0000 7f349dffb640 10 client.7522 handle_command_reply: tid=0 2024-09-17T03:40:37.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.605+0000 7f34cc4b4740 1 client.7522 shutdown 2024-09-17T03:40:37.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f34cc4b4740 1 -- 172.21.15.146:0/2863817541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 msgr2=0x5596e68f7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e68f7990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f34b4010700 tx=0x7f34b40654b0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f34cc4b4740 1 -- 172.21.15.146:0/2863817541 shutdown_connections 2024-09-17T03:40:37.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5596e64f5f60 0x5596e6901310 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f349dffb640 0 client.7522 ms_handle_reset on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e6537390 0x5596e68f7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e68f7990 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/2863817541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e691e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f34cc4b4740 1 -- 172.21.15.146:0/2863817541 >> 172.21.15.146:0/2863817541 conn(0x5596e652b4e0 msgr2=0x5596e68e01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f34cc4b4740 1 -- 172.21.15.146:0/2863817541 shutdown_connections 2024-09-17T03:40:37.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f34cc4b4740 1 -- 172.21.15.146:0/2863817541 wait complete. 2024-09-17T03:40:37.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.606+0000 7f34cc4b4740 20 client.7522 trim_cache size 0 max 16384 2024-09-17T03:40:37.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.634+0000 7f34cc4b4740 1 Processor -- start 2024-09-17T03:40:37.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.634+0000 7f34cc4b4740 1 -- start start 2024-09-17T03:40:37.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e64f5f60 0x5596e6924670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e6924bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e691ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34cc4b4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f34c01fdfd0 con 0x5596e650e4d0 2024-09-17T03:40:37.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34cc4b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34c01f5d00 con 0x5596e65166b0 2024-09-17T03:40:37.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34cc4b4740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f34c01f5060 con 0x5596e64f5f60 2024-09-17T03:40:37.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34bf7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e691ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34be7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e6924bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34beffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e64f5f60 0x5596e6924670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34beffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e64f5f60 0x5596e6924670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:45892/0 (socket says 172.21.15.146:45892) 2024-09-17T03:40:37.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34bf7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e691ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:40942/0 (socket says 172.21.15.146:40942) 2024-09-17T03:40:37.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.636+0000 7f34beffd640 1 -- 172.21.15.146:0/1955588915 learned_addr learned my addr 172.21.15.146:0/1955588915 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.637+0000 7f34bf7fe640 1 -- 172.21.15.146:0/1955588915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e64f5f60 msgr2=0x5596e6924670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.637+0000 7f34bf7fe640 1 --2- 172.21.15.146:0/1955588915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e64f5f60 0x5596e6924670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.637+0000 7f34bf7fe640 1 -- 172.21.15.146:0/1955588915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 msgr2=0x5596e6924bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.637+0000 7f34bf7fe640 1 --2- 172.21.15.146:0/1955588915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e6924bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.637+0000 7f34bf7fe640 1 -- 172.21.15.146:0/1955588915 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596e6617ad0 con 0x5596e65166b0 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.637+0000 7f34bf7fe640 1 --2- 172.21.15.146:0/1955588915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e691ca00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f34b8033040 tx=0x7f34b8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c255032e2d36cd1f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.637+0000 7f349ffff640 1 -- 172.21.15.146:0/1955588915 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b804a070 con 0x5596e65166b0 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.637+0000 7f349ffff640 1 -- 172.21.15.146:0/1955588915 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34b8003970 con 0x5596e65166b0 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.637+0000 7f349ffff640 1 -- 172.21.15.146:0/1955588915 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8034040 con 0x5596e65166b0 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.638+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1955588915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 msgr2=0x5596e691ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.638+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/1955588915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e691ca00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f34b8033040 tx=0x7f34b8004a40 comp rx=0 tx=0).stop 2024-09-17T03:40:37.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.638+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1955588915 shutdown_connections 2024-09-17T03:40:37.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.638+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/1955588915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e691ca00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.638+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/1955588915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e650e4d0 0x5596e6924bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.638+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/1955588915 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e64f5f60 0x5596e6924670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.638+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1955588915 >> 172.21.15.146:0/1955588915 conn(0x5596e652b4e0 msgr2=0x5596e68d9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.638+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1955588915 shutdown_connections 2024-09-17T03:40:37.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.638+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1955588915 wait complete. 2024-09-17T03:40:37.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.639+0000 7f34cc4b4740 1 -- start start 2024-09-17T03:40:37.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.640+0000 7f34cc4b4740 1 Processor -- start 2024-09-17T03:40:37.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e64f5f60 0x5596e69abb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e650e4d0 0x5596e6924670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34cc4b4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e6924bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34cc4b4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5596e6927e30 con 0x5596e64f5f60 2024-09-17T03:40:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34beffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e64f5f60 0x5596e69abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34beffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e64f5f60 0x5596e69abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37700/0 (socket says 172.21.15.146:37700) 2024-09-17T03:40:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34beffd640 1 -- 172.21.15.146:0/1430177983 learned_addr learned my addr 172.21.15.146:0/1430177983 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34cc4b4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34c01f56b0 con 0x5596e65166b0 2024-09-17T03:40:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1430177983 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5596e68da6a0 con 0x5596e650e4d0 2024-09-17T03:40:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34cc4b4740 10 client.0 _ll_register_callbacks cb 0x7f34b409b5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34bf7fe640 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e6924bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34be7fc640 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e650e4d0 0x5596e6924670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34beffd640 1 -- 172.21.15.146:0/1430177983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e650e4d0 msgr2=0x5596e6924670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34beffd640 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e650e4d0 0x5596e6924670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34beffd640 1 -- 172.21.15.146:0/1430177983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 msgr2=0x5596e6924bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34beffd640 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e6924bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34beffd640 1 -- 172.21.15.146:0/1430177983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596e6925890 con 0x5596e64f5f60 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.642+0000 7f34be7fc640 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e650e4d0 0x5596e6924670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.643+0000 7f34beffd640 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e64f5f60 0x5596e69abb30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f34b0010750 tx=0x7f34b0005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fe6bc85ab58433 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.643+0000 7f349dffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.643+0000 7f349dffb640 1 -- 172.21.15.146:0/1430177983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0016040 con 0x5596e64f5f60 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.643+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1430177983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34b8003970 con 0x5596e64f5f60 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.643+0000 7f349dffb640 1 -- 172.21.15.146:0/1430177983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f34b001be20 con 0x5596e64f5f60 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.643+0000 7f349dffb640 1 -- 172.21.15.146:0/1430177983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f34b0044050 con 0x5596e64f5f60 2024-09-17T03:40:37.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.643+0000 7f34cc4b4740 10 client.8403 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:37.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.643+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1430177983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5596e68f71c0 con 0x5596e64f5f60 2024-09-17T03:40:37.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.643+0000 7f349dffb640 1 -- 172.21.15.146:0/1430177983 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34b8003970 con 0x5596e64f5f60 2024-09-17T03:40:37.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.643+0000 7f349dffb640 1 -- 172.21.15.146:0/1430177983 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7f34b0047020 con 0x5596e64f5f60 2024-09-17T03:40:37.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.644+0000 7f34cc4b4740 10 client.8403 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:37.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.644+0000 7f34cc4b4740 10 client.8403 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-17T03:40:37.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.644+0000 7f34cc4b4740 20 client.8403 populate_metadata read hostname 'smithi146' 2024-09-17T03:40:37.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.644+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5596e64cb3a0 0x5596e694fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.644+0000 7f34cc4b4740 4 client.8403 mds_command: new command op to 8187 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-17T03:40:37.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.644+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1430177983 --> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x5596e684f5d0 con 0x5596e64cb3a0 2024-09-17T03:40:37.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.644+0000 7f34be7fc640 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5596e64cb3a0 0x5596e694fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.644+0000 7f349dffb640 10 client.8403 ms_handle_connect on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.645+0000 7f34be7fc640 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5596e64cb3a0 0x5596e694fce0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f1b58ac1c495fee server_cookie=46da4bad2fd4b648 in_seq=0 out_seq=0 2024-09-17T03:40:37.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.663+0000 7f349dffb640 1 -- 172.21.15.146:0/1430177983 <== mds.0 v2:172.21.15.146:6832/2931720030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5596e684f5d0 con 0x5596e64cb3a0 2024-09-17T03:40:37.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.663+0000 7f349dffb640 10 client.8403 handle_command_reply: tid=0 2024-09-17T03:40:37.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.663+0000 7f34cc4b4740 1 client.8403 shutdown 2024-09-17T03:40:37.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1430177983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e64f5f60 msgr2=0x5596e69abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e64f5f60 0x5596e69abb30 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f34b0010750 tx=0x7f34b0005be0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1430177983 shutdown_connections 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5596e64cb3a0 0x5596e694fce0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596e65166b0 0x5596e6924bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596e650e4d0 0x5596e6924670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f349dffb640 0 client.8403 ms_handle_reset on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f34cc4b4740 1 --2- 172.21.15.146:0/1430177983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596e64f5f60 0x5596e69abb30 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1430177983 >> 172.21.15.146:0/1430177983 conn(0x5596e652b4e0 msgr2=0x5596e6923d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1430177983 shutdown_connections 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f34cc4b4740 1 -- 172.21.15.146:0/1430177983 wait complete. 2024-09-17T03:40:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.664+0000 7f34cc4b4740 20 client.8403 trim_cache size 0 max 16384 2024-09-17T03:40:37.666 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:40:37.666 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:40:37.666 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:40:37.666 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:40:37.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 -- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ac078bc0 msgr2=0x7f34ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ac078bc0 0x7f34ac07b0d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f34c0072ae0 tx=0x7f34b000a250 comp rx=0 tx=0).stop 2024-09-17T03:40:37.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 -- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c00cdf90 msgr2=0x7f34c01f20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c00cdf90 0x7f34c01f20e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f34b4010730 tx=0x7f34b4010bf0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 -- 172.21.15.146:0/2770184748 shutdown_connections 2024-09-17T03:40:37.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ac078bc0 0x7f34ac07b0d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c01556c0 0x7f34c01f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34c00cdf90 0x7f34c01f20e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 --2- 172.21.15.146:0/2770184748 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34c00735f0 0x7f34c01f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 -- 172.21.15.146:0/2770184748 >> 172.21.15.146:0/2770184748 conn(0x7f34c00b3510 msgr2=0x7f34c00d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 -- 172.21.15.146:0/2770184748 shutdown_connections 2024-09-17T03:40:37.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.665+0000 7f34c554a640 1 -- 172.21.15.146:0/2770184748 wait complete. 2024-09-17T03:40:37.677 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:40:37.678 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-17T03:40:37.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.793+0000 7fe33f990640 1 -- 172.21.15.146:0/4078643653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe33815c8e0 msgr2=0x7fe33806f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.793+0000 7fe33f990640 1 --2- 172.21.15.146:0/4078643653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe33815c8e0 0x7fe33806f580 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe3380b45d0 tx=0x7fe33402a820 comp rx=0 tx=0).stop 2024-09-17T03:40:37.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.793+0000 7fe33f990640 1 -- 172.21.15.146:0/4078643653 shutdown_connections 2024-09-17T03:40:37.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.793+0000 7fe33f990640 1 --2- 172.21.15.146:0/4078643653 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe33815c8e0 0x7fe33806f580 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.793+0000 7fe33f990640 1 -- 172.21.15.146:0/4078643653 >> 172.21.15.146:0/4078643653 conn(0x7fe3380b3150 msgr2=0x7fe3380b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.793+0000 7fe33f990640 1 -- 172.21.15.146:0/4078643653 shutdown_connections 2024-09-17T03:40:37.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.793+0000 7fe33f990640 1 -- 172.21.15.146:0/4078643653 wait complete. 2024-09-17T03:40:37.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.795+0000 7fe33f990640 1 Processor -- start 2024-09-17T03:40:37.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.795+0000 7fe33f990640 1 -- start start 2024-09-17T03:40:37.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.796+0000 7fe33f990640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3380cd840 0x7fe338156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.796+0000 7fe33f990640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3380cdc50 0x7fe338142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.796+0000 7fe33f990640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815c8e0 0x7fe338143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.796+0000 7fe33f990640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe338073700 con 0x7fe3380cdc50 2024-09-17T03:40:37.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.796+0000 7fe33f990640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe338073580 con 0x7fe3380cd840 2024-09-17T03:40:37.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.796+0000 7fe33f990640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe338073880 con 0x7fe33815c8e0 2024-09-17T03:40:37.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.796+0000 7fe33cf2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3380cdc50 0x7fe338142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33cf2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3380cdc50 0x7fe338142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37708/0 (socket says 172.21.15.146:37708) 2024-09-17T03:40:37.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33cf2b640 1 -- 172.21.15.146:0/498503452 learned_addr learned my addr 172.21.15.146:0/498503452 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33d72c640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3380cd840 0x7fe338156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33df2d640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815c8e0 0x7fe338143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33cf2b640 1 -- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815c8e0 msgr2=0x7fe338143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33cf2b640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815c8e0 0x7fe338143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33cf2b640 1 -- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3380cd840 msgr2=0x7fe338156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33cf2b640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3380cd840 0x7fe338156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33cf2b640 1 -- 172.21.15.146:0/498503452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3381f6730 con 0x7fe3380cdc50 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33df2d640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815c8e0 0x7fe338143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33d72c640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3380cd840 0x7fe338156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33cf2b640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3380cdc50 0x7fe338142b70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fe32800c3c0 tx=0x7fe32800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe32dffb640 1 -- 172.21.15.146:0/498503452 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328017070 con 0x7fe3380cdc50 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe32dffb640 1 -- 172.21.15.146:0/498503452 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3280035f0 con 0x7fe3380cdc50 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33f990640 1 -- 172.21.15.146:0/498503452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3381430b0 con 0x7fe3380cdc50 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe32dffb640 1 -- 172.21.15.146:0/498503452 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328003a40 con 0x7fe3380cdc50 2024-09-17T03:40:37.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.797+0000 7fe33f990640 1 -- 172.21.15.146:0/498503452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe338156460 con 0x7fe3380cdc50 2024-09-17T03:40:37.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.799+0000 7fe32dffb640 1 -- 172.21.15.146:0/498503452 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe32801a070 con 0x7fe3380cdc50 2024-09-17T03:40:37.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.799+0000 7fe32dffb640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe31c078bc0 0x7fe31c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.800+0000 7fe32dffb640 1 -- 172.21.15.146:0/498503452 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7fe328099f70 con 0x7fe3380cdc50 2024-09-17T03:40:37.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.800+0000 7fe33d72c640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe31c078bc0 0x7fe31c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.800+0000 7fe33d72c640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe31c078bc0 0x7fe31c07b0d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe334033000 tx=0x7fe334004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.800+0000 7fe3469e0740 1 Processor -- start 2024-09-17T03:40:37.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.800+0000 7fe3469e0740 1 -- start start 2024-09-17T03:40:37.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd74e390 0x5575bdb1f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd7254d0 0x5575bdb1fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb3cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe3469e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5575bda68a60 con 0x5575bd72d6b0 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe3469e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5575bda57e90 con 0x5575bd7254d0 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe3469e0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5575bda5bca0 con 0x5575bd74e390 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe33df2d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb3cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe33d72c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd74e390 0x5575bdb1f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe33df2d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb3cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37718/0 (socket says 172.21.15.146:37718) 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe33df2d640 1 -- 172.21.15.146:0/658794622 learned_addr learned my addr 172.21.15.146:0/658794622 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe33cf2b640 1 --2- 172.21.15.146:0/658794622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd7254d0 0x5575bdb1fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe33df2d640 1 -- 172.21.15.146:0/658794622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd74e390 msgr2=0x5575bdb1f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe33df2d640 1 --2- 172.21.15.146:0/658794622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd74e390 0x5575bdb1f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe33df2d640 1 -- 172.21.15.146:0/658794622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd7254d0 msgr2=0x5575bdb1fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe33df2d640 1 --2- 172.21.15.146:0/658794622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd7254d0 0x5575bdb1fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe33df2d640 1 -- 172.21.15.146:0/658794622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575bd8307d0 con 0x5575bd72d6b0 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe33df2d640 1 --2- 172.21.15.146:0/658794622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb3cb80 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fe3300018f0 tx=0x7fe330001db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c10d9351c0701f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe322ffd640 1 -- 172.21.15.146:0/658794622 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330016020 con 0x5575bd72d6b0 2024-09-17T03:40:37.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe322ffd640 1 -- 172.21.15.146:0/658794622 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe33000dd50 con 0x5575bd72d6b0 2024-09-17T03:40:37.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.802+0000 7fe322ffd640 1 -- 172.21.15.146:0/658794622 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330012630 con 0x5575bd72d6b0 2024-09-17T03:40:37.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.803+0000 7fe3469e0740 1 -- 172.21.15.146:0/658794622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 msgr2=0x5575bdb3cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.803+0000 7fe3469e0740 1 --2- 172.21.15.146:0/658794622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb3cb80 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fe3300018f0 tx=0x7fe330001db0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.803+0000 7fe3469e0740 1 -- 172.21.15.146:0/658794622 shutdown_connections 2024-09-17T03:40:37.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.803+0000 7fe3469e0740 1 --2- 172.21.15.146:0/658794622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb3cb80 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.803+0000 7fe3469e0740 1 --2- 172.21.15.146:0/658794622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd7254d0 0x5575bdb1fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.803+0000 7fe3469e0740 1 --2- 172.21.15.146:0/658794622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd74e390 0x5575bdb1f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.803+0000 7fe3469e0740 1 -- 172.21.15.146:0/658794622 >> 172.21.15.146:0/658794622 conn(0x5575bd7424e0 msgr2=0x5575bdaf5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.803+0000 7fe3469e0740 1 -- 172.21.15.146:0/658794622 shutdown_connections 2024-09-17T03:40:37.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.803+0000 7fe3469e0740 1 -- 172.21.15.146:0/658794622 wait complete. 2024-09-17T03:40:37.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.804+0000 7fe3469e0740 1 -- start start 2024-09-17T03:40:37.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.804+0000 7fe3469e0740 1 Processor -- start 2024-09-17T03:40:37.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd7254d0 0x5575bdb34d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd74e390 0x5575bdb31870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe3469e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5575bd7c8740 con 0x5575bd72d6b0 2024-09-17T03:40:37.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe3469e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5575bd9fd970 con 0x5575bd74e390 2024-09-17T03:40:37.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe3469e0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5575bdb201c0 con 0x5575bd7254d0 2024-09-17T03:40:37.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe3469e0740 10 client.0 _ll_register_callbacks cb 0x5575bda00be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:37.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe33cf2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe33cf2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37726/0 (socket says 172.21.15.146:37726) 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe33cf2b640 1 -- 172.21.15.146:0/2898778996 learned_addr learned my addr 172.21.15.146:0/2898778996 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe33df2d640 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd74e390 0x5575bdb31870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe33d72c640 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd7254d0 0x5575bdb34d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe33cf2b640 1 -- 172.21.15.146:0/2898778996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd7254d0 msgr2=0x5575bdb34d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe33cf2b640 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd7254d0 0x5575bdb34d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe33cf2b640 1 -- 172.21.15.146:0/2898778996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd74e390 msgr2=0x5575bdb31870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe33cf2b640 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd74e390 0x5575bdb31870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe33cf2b640 1 -- 172.21.15.146:0/2898778996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575bd7b9970 con 0x5575bd72d6b0 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe33cf2b640 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fe32800cd80 tx=0x7fe328061540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff99a8338381135a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe317fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe317fff640 1 -- 172.21.15.146:0/2898778996 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328082dd0 con 0x5575bd72d6b0 2024-09-17T03:40:37.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe317fff640 1 -- 172.21.15.146:0/2898778996 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7fe328060f20 con 0x5575bd72d6b0 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe3469e0740 1 -- 172.21.15.146:0/2898778996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe33000dd50 con 0x5575bd72d6b0 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.806+0000 7fe317fff640 1 -- 172.21.15.146:0/2898778996 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fe3280667a0 con 0x5575bd72d6b0 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe3469e0740 10 client.8415 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe3469e0740 1 -- 172.21.15.146:0/2898778996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5575bd7976a0 con 0x5575bd72d6b0 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe317fff640 1 -- 172.21.15.146:0/2898778996 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe33000dd50 con 0x5575bd72d6b0 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe317fff640 1 -- 172.21.15.146:0/2898778996 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7fe32805d610 con 0x5575bd72d6b0 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe3469e0740 10 client.8415 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe3469e0740 10 client.8415 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe3469e0740 20 client.8415 populate_metadata read hostname 'smithi146' 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe3469e0740 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5575bd70cf60 0x5575bdb4d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe3469e0740 4 client.8415 mds_command: new command op to 8187 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe3469e0740 1 -- 172.21.15.146:0/2898778996 --> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575bda6a9b0 con 0x5575bd70cf60 2024-09-17T03:40:37.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe33d72c640 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5575bd70cf60 0x5575bdb4d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe317fff640 10 client.8415 ms_handle_connect on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.807+0000 7fe33d72c640 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5575bd70cf60 0x5575bdb4d680 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9789527513225f3 server_cookie=a9861fdb23150162 in_seq=0 out_seq=0 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe317fff640 1 -- 172.21.15.146:0/2898778996 <== mds.0 v2:172.21.15.146:6832/2931720030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575bda6a9b0 con 0x5575bd70cf60 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe317fff640 10 client.8415 handle_command_reply: tid=0 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 1 client.8415 shutdown 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 1 -- 172.21.15.146:0/2898778996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 msgr2=0x5575bdb31330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fe32800cd80 tx=0x7fe328061540 comp rx=0 tx=0).stop 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 1 -- 172.21.15.146:0/2898778996 shutdown_connections 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5575bd70cf60 0x5575bdb4d680 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd74e390 0x5575bdb31870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe317fff640 0 client.8415 ms_handle_reset on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 1 --2- 172.21.15.146:0/2898778996 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd7254d0 0x5575bdb34d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 1 -- 172.21.15.146:0/2898778996 >> 172.21.15.146:0/2898778996 conn(0x5575bd7424e0 msgr2=0x5575bdaf0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 1 -- 172.21.15.146:0/2898778996 shutdown_connections 2024-09-17T03:40:37.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 1 -- 172.21.15.146:0/2898778996 wait complete. 2024-09-17T03:40:37.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.808+0000 7fe3469e0740 20 client.8415 trim_cache size 0 max 16384 2024-09-17T03:40:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.826+0000 7fe3469e0740 1 Processor -- start 2024-09-17T03:40:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.826+0000 7fe3469e0740 1 -- start start 2024-09-17T03:40:37.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.827+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd70cf60 0x5575bdaf0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.827+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd7254d0 0x5575bdb330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.827+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.827+0000 7fe3469e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3381fdcb0 con 0x5575bd7254d0 2024-09-17T03:40:37.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.827+0000 7fe3469e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe33806cf10 con 0x5575bd70cf60 2024-09-17T03:40:37.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.827+0000 7fe3469e0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe3381f6110 con 0x5575bd72d6b0 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe33cf2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd7254d0 0x5575bdb330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe33cf2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd7254d0 0x5575bdb330f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37734/0 (socket says 172.21.15.146:37734) 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe33cf2b640 1 -- 172.21.15.146:0/3722800967 learned_addr learned my addr 172.21.15.146:0/3722800967 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe33d72c640 1 --2- 172.21.15.146:0/3722800967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd70cf60 0x5575bdaf0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe33df2d640 1 --2- 172.21.15.146:0/3722800967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe33cf2b640 1 -- 172.21.15.146:0/3722800967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd72d6b0 msgr2=0x5575bdb31330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe33cf2b640 1 --2- 172.21.15.146:0/3722800967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe33cf2b640 1 -- 172.21.15.146:0/3722800967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd70cf60 msgr2=0x5575bdaf0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe33cf2b640 1 --2- 172.21.15.146:0/3722800967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd70cf60 0x5575bdaf0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe33cf2b640 1 -- 172.21.15.146:0/3722800967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575bda68700 con 0x5575bd7254d0 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe33cf2b640 1 --2- 172.21.15.146:0/3722800967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd7254d0 0x5575bdb330f0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fe32800c390 tx=0x7fe328061bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9cb0c833c4821e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe3227fc640 1 -- 172.21.15.146:0/3722800967 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32806b6e0 con 0x5575bd7254d0 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe3227fc640 1 -- 172.21.15.146:0/3722800967 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe328082bd0 con 0x5575bd7254d0 2024-09-17T03:40:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.828+0000 7fe3227fc640 1 -- 172.21.15.146:0/3722800967 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328060f20 con 0x5575bd7254d0 2024-09-17T03:40:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.829+0000 7fe3469e0740 1 -- 172.21.15.146:0/3722800967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd7254d0 msgr2=0x5575bdb330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.829+0000 7fe3469e0740 1 --2- 172.21.15.146:0/3722800967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd7254d0 0x5575bdb330f0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fe32800c390 tx=0x7fe328061bc0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.829+0000 7fe3469e0740 1 -- 172.21.15.146:0/3722800967 shutdown_connections 2024-09-17T03:40:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.829+0000 7fe3469e0740 1 --2- 172.21.15.146:0/3722800967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.829+0000 7fe3469e0740 1 --2- 172.21.15.146:0/3722800967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd7254d0 0x5575bdb330f0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.829+0000 7fe3469e0740 1 --2- 172.21.15.146:0/3722800967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd70cf60 0x5575bdaf0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.829+0000 7fe3469e0740 1 -- 172.21.15.146:0/3722800967 >> 172.21.15.146:0/3722800967 conn(0x5575bd7424e0 msgr2=0x5575bdb30800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.829+0000 7fe3469e0740 1 -- 172.21.15.146:0/3722800967 shutdown_connections 2024-09-17T03:40:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.829+0000 7fe3469e0740 1 -- 172.21.15.146:0/3722800967 wait complete. 2024-09-17T03:40:37.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.830+0000 7fe3469e0740 1 -- start start 2024-09-17T03:40:37.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.830+0000 7fe3469e0740 1 Processor -- start 2024-09-17T03:40:37.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd70cf60 0x5575bdb60240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd7254d0 0x5575bdb4ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe3469e0740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe3469e0740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe338146080 con 0x5575bd72d6b0 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe3469e0740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5575bdbbc160 con 0x5575bd7254d0 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe3469e0740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5575bdb4c470 con 0x5575bd70cf60 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe3469e0740 10 client.0 _ll_register_callbacks cb 0x7fe328061610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe33df2d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe33df2d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37742/0 (socket says 172.21.15.146:37742) 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe33df2d640 1 -- 172.21.15.146:0/1870888400 learned_addr learned my addr 172.21.15.146:0/1870888400 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe33cf2b640 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd7254d0 0x5575bdb4ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.831+0000 7fe33d72c640 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd70cf60 0x5575bdb60240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe33df2d640 1 -- 172.21.15.146:0/1870888400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd70cf60 msgr2=0x5575bdb60240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe33df2d640 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd70cf60 0x5575bdb60240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe33df2d640 1 -- 172.21.15.146:0/1870888400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd7254d0 msgr2=0x5575bdb4ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe33df2d640 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd7254d0 0x5575bdb4ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe33df2d640 1 -- 172.21.15.146:0/1870888400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575bdba0ff0 con 0x5575bd72d6b0 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe33df2d640 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x5575bdaf75d0 tx=0x7fe330007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc38165c9babe2bc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe317fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe317fff640 1 -- 172.21.15.146:0/1870888400 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33002a060 con 0x5575bd72d6b0 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe317fff640 1 -- 172.21.15.146:0/1870888400 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7fe3300046a0 con 0x5575bd72d6b0 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe3469e0740 1 -- 172.21.15.146:0/1870888400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe328082bd0 con 0x5575bd72d6b0 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe317fff640 1 -- 172.21.15.146:0/1870888400 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fe330030050 con 0x5575bd72d6b0 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe3469e0740 10 client.8421 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe3469e0740 1 -- 172.21.15.146:0/1870888400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5575bdb4c090 con 0x5575bd72d6b0 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe317fff640 1 -- 172.21.15.146:0/1870888400 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe328082bd0 con 0x5575bd72d6b0 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe317fff640 1 -- 172.21.15.146:0/1870888400 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7fe330033020 con 0x5575bd72d6b0 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe3469e0740 10 client.8421 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:37.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe3469e0740 10 client.8421 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe3469e0740 20 client.8421 populate_metadata read hostname 'smithi146' 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe3469e0740 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5575bd6e23a0 0x5575bdb482d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe3469e0740 4 client.8421 mds_command: new command op to 8187 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.832+0000 7fe3469e0740 1 -- 172.21.15.146:0/1870888400 --> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5575bda66460 con 0x5575bd6e23a0 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe33d72c640 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5575bd6e23a0 0x5575bdb482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe317fff640 10 client.8421 ms_handle_connect on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe33d72c640 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5575bd6e23a0 0x5575bdb482d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6ea99d0ec8a38d3 server_cookie=b89bb2970967af33 in_seq=0 out_seq=0 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe317fff640 1 -- 172.21.15.146:0/1870888400 <== mds.0 v2:172.21.15.146:6832/2931720030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+610 (crc 0 0 0) 0x5575bda66460 con 0x5575bd6e23a0 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe317fff640 10 client.8421 handle_command_reply: tid=0 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe3469e0740 1 client.8421 shutdown 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe3469e0740 1 -- 172.21.15.146:0/1870888400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 msgr2=0x5575bdb31330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe3469e0740 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x5575bdaf75d0 tx=0x7fe330007d90 comp rx=0 tx=0).stop 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe3469e0740 1 -- 172.21.15.146:0/1870888400 shutdown_connections 2024-09-17T03:40:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe3469e0740 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x5575bd6e23a0 0x5575bdb482d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe3469e0740 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5575bd72d6b0 0x5575bdb31330 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe3469e0740 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5575bd7254d0 0x5575bdb4ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe317fff640 0 client.8421 ms_handle_reset on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe3469e0740 1 --2- 172.21.15.146:0/1870888400 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5575bd70cf60 0x5575bdb60240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.833+0000 7fe3469e0740 1 -- 172.21.15.146:0/1870888400 >> 172.21.15.146:0/1870888400 conn(0x5575bd7424e0 msgr2=0x5575bdb30800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe3469e0740 1 -- 172.21.15.146:0/1870888400 shutdown_connections 2024-09-17T03:40:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe3469e0740 1 -- 172.21.15.146:0/1870888400 wait complete. 2024-09-17T03:40:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe3469e0740 20 client.8421 trim_cache size 0 max 16384 2024-09-17T03:40:37.839 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:40:37.839 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:40:37.839 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: "1335fba5-4ec7-4826-88ea-6235ee94d22b": { 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "1335fba5-4ec7-4826-88ea-6235ee94d22b", 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: "1335fba5-4ec7-4826-88ea-6235ee94d22b": { 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:40:37.417671+0000", 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:40:37.840 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:40:37.841 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:40:37.841 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:37.841 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:37.841 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 -- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe31c078bc0 msgr2=0x7fe31c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe31c078bc0 0x7fe31c07b0d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe334033000 tx=0x7fe334004ab0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 -- 172.21.15.146:0/498503452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3380cdc50 msgr2=0x7fe338142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3380cdc50 0x7fe338142b70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fe32800c3c0 tx=0x7fe32800c880 comp rx=0 tx=0).stop 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 -- 172.21.15.146:0/498503452 shutdown_connections 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe31c078bc0 0x7fe31c07b0d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe33815c8e0 0x7fe338143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3380cdc50 0x7fe338142b70 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 --2- 172.21.15.146:0/498503452 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3380cd840 0x7fe338156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 -- 172.21.15.146:0/498503452 >> 172.21.15.146:0/498503452 conn(0x7fe3380b3150 msgr2=0x7fe3380b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 -- 172.21.15.146:0/498503452 shutdown_connections 2024-09-17T03:40:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:37.834+0000 7fe33f990640 1 -- 172.21.15.146:0/498503452 wait complete. 2024-09-17T03:40:42.846 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:40:42.846 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-17T03:40:42.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.962+0000 7ff084dda640 1 -- 172.21.15.146:0/1476552677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0800cd990 msgr2=0x7ff080074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.962+0000 7ff084dda640 1 --2- 172.21.15.146:0/1476552677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0800cd990 0x7ff080074740 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7ff080074140 tx=0x7ff07002a480 comp rx=0 tx=0).stop 2024-09-17T03:40:42.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.962+0000 7ff084dda640 1 -- 172.21.15.146:0/1476552677 shutdown_connections 2024-09-17T03:40:42.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.962+0000 7ff084dda640 1 --2- 172.21.15.146:0/1476552677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0800cd990 0x7ff080074740 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.962+0000 7ff084dda640 1 -- 172.21.15.146:0/1476552677 >> 172.21.15.146:0/1476552677 conn(0x7ff0800b2950 msgr2=0x7ff0800b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:42.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.962+0000 7ff084dda640 1 -- 172.21.15.146:0/1476552677 shutdown_connections 2024-09-17T03:40:42.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.962+0000 7ff084dda640 1 -- 172.21.15.146:0/1476552677 wait complete. 2024-09-17T03:40:42.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.964+0000 7ff084dda640 1 Processor -- start 2024-09-17T03:40:42.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.964+0000 7ff084dda640 1 -- start start 2024-09-17T03:40:42.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.965+0000 7ff084dda640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0800cd990 0x7ff0800ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.965+0000 7ff084dda640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff08015b8c0 0x7ff080149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.965+0000 7ff084dda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff080149dd0 0x7ff0800ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.965+0000 7ff084dda640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff08015fd50 con 0x7ff0800cd990 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.965+0000 7ff084dda640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff08015fbd0 con 0x7ff080149dd0 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.965+0000 7ff084dda640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff08015fed0 con 0x7ff08015b8c0 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.965+0000 7ff07e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0800cd990 0x7ff0800ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.965+0000 7ff07e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0800cd990 0x7ff0800ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37760/0 (socket says 172.21.15.146:37760) 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.965+0000 7ff07e59c640 1 -- 172.21.15.146:0/1950868630 learned_addr learned my addr 172.21.15.146:0/1950868630 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.965+0000 7ff07dd9b640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff08015b8c0 0x7ff080149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.965+0000 7ff07ed9d640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff080149dd0 0x7ff0800ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.966+0000 7ff07e59c640 1 -- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff08015b8c0 msgr2=0x7ff080149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.966+0000 7ff07e59c640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff08015b8c0 0x7ff080149890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.966+0000 7ff07e59c640 1 -- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff080149dd0 msgr2=0x7ff0800ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.966+0000 7ff07e59c640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff080149dd0 0x7ff0800ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.966+0000 7ff07e59c640 1 -- 172.21.15.146:0/1950868630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0801f5560 con 0x7ff0800cd990 2024-09-17T03:40:42.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.966+0000 7ff07e59c640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0800cd990 0x7ff0800ac9d0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7ff070009780 tx=0x7ff070033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.966+0000 7ff06effd640 1 -- 172.21.15.146:0/1950868630 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070031d60 con 0x7ff0800cd990 2024-09-17T03:40:42.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.966+0000 7ff06effd640 1 -- 172.21.15.146:0/1950868630 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff070005020 con 0x7ff0800cd990 2024-09-17T03:40:42.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.966+0000 7ff084dda640 1 -- 172.21.15.146:0/1950868630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0801f5840 con 0x7ff0800cd990 2024-09-17T03:40:42.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.966+0000 7ff06effd640 1 -- 172.21.15.146:0/1950868630 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070005470 con 0x7ff0800cd990 2024-09-17T03:40:42.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.966+0000 7ff084dda640 1 -- 172.21.15.146:0/1950868630 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0801f5e00 con 0x7ff0800cd990 2024-09-17T03:40:42.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.968+0000 7ff06effd640 1 -- 172.21.15.146:0/1950868630 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0700047a0 con 0x7ff0800cd990 2024-09-17T03:40:42.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.969+0000 7ff06effd640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff060078b90 0x7ff06007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.969+0000 7ff06effd640 1 -- 172.21.15.146:0/1950868630 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7ff0700bbfe0 con 0x7ff0800cd990 2024-09-17T03:40:42.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.969+0000 7ff07dd9b640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff060078b90 0x7ff06007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.969+0000 7ff08be24740 1 Processor -- start 2024-09-17T03:40:42.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.970+0000 7ff07dd9b640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff060078b90 0x7ff06007b0a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff08015b310 tx=0x7ff074007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.970+0000 7ff08be24740 1 -- start start 2024-09-17T03:40:42.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff08be24740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe97390 0x565410283a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff08be24740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe6e4d0 0x565410258860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff08be24740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe766b0 0x565410258da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff08be24740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5654101b1a60 con 0x56540fe6e4d0 2024-09-17T03:40:42.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff08be24740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5654101a0e90 con 0x56540fe766b0 2024-09-17T03:40:42.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff08be24740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5654101a4ca0 con 0x56540fe97390 2024-09-17T03:40:42.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff07dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe6e4d0 0x565410258860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff07dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe6e4d0 0x565410258860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37772/0 (socket says 172.21.15.146:37772) 2024-09-17T03:40:42.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff07dd9b640 1 -- 172.21.15.146:0/2193756331 learned_addr learned my addr 172.21.15.146:0/2193756331 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:42.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff07e59c640 1 --2- 172.21.15.146:0/2193756331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe97390 0x565410283a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff07ed9d640 1 --2- 172.21.15.146:0/2193756331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe766b0 0x565410258da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff07dd9b640 1 -- 172.21.15.146:0/2193756331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe97390 msgr2=0x565410283a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff07dd9b640 1 --2- 172.21.15.146:0/2193756331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe97390 0x565410283a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff07dd9b640 1 -- 172.21.15.146:0/2193756331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe766b0 msgr2=0x565410258da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff07dd9b640 1 --2- 172.21.15.146:0/2193756331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe766b0 0x565410258da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff07dd9b640 1 -- 172.21.15.146:0/2193756331 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56540ff797d0 con 0x56540fe6e4d0 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.971+0000 7ff07dd9b640 1 --2- 172.21.15.146:0/2193756331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe6e4d0 0x565410258860 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7ff07400fb20 tx=0x7ff074012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a61cff4ade3e0a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.972+0000 7ff05ffff640 1 -- 172.21.15.146:0/2193756331 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07401b050 con 0x56540fe6e4d0 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.972+0000 7ff05ffff640 1 -- 172.21.15.146:0/2193756331 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff074025070 con 0x56540fe6e4d0 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.972+0000 7ff05ffff640 1 -- 172.21.15.146:0/2193756331 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074020440 con 0x56540fe6e4d0 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.972+0000 7ff08be24740 1 -- 172.21.15.146:0/2193756331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe6e4d0 msgr2=0x565410258860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.972+0000 7ff08be24740 1 --2- 172.21.15.146:0/2193756331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe6e4d0 0x565410258860 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7ff07400fb20 tx=0x7ff074012000 comp rx=0 tx=0).stop 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.973+0000 7ff08be24740 1 -- 172.21.15.146:0/2193756331 shutdown_connections 2024-09-17T03:40:42.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.973+0000 7ff08be24740 1 --2- 172.21.15.146:0/2193756331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe766b0 0x565410258da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.973+0000 7ff08be24740 1 --2- 172.21.15.146:0/2193756331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe6e4d0 0x565410258860 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.973+0000 7ff08be24740 1 --2- 172.21.15.146:0/2193756331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe97390 0x565410283a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.973+0000 7ff08be24740 1 -- 172.21.15.146:0/2193756331 >> 172.21.15.146:0/2193756331 conn(0x56540fe8b4e0 msgr2=0x56541023ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.973+0000 7ff08be24740 1 -- 172.21.15.146:0/2193756331 shutdown_connections 2024-09-17T03:40:42.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.973+0000 7ff08be24740 1 -- 172.21.15.146:0/2193756331 wait complete. 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.974+0000 7ff08be24740 1 -- start start 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.974+0000 7ff08be24740 1 Processor -- start 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff08be24740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x56541027efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff08be24740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe766b0 0x5654102577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff08be24740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x565410268530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff08be24740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56540ff11740 con 0x56540fe97390 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff08be24740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x565410146970 con 0x56540fe6e4d0 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff08be24740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56541027b9e0 con 0x56540fe766b0 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff08be24740 10 client.0 _ll_register_callbacks cb 0x565410155780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff07ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x565410268530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff07ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x565410268530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37776/0 (socket says 172.21.15.146:37776) 2024-09-17T03:40:42.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff07ed9d640 1 -- 172.21.15.146:0/347648995 learned_addr learned my addr 172.21.15.146:0/347648995 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff07e59c640 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x56541027efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff07dd9b640 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe766b0 0x5654102577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff07ed9d640 1 -- 172.21.15.146:0/347648995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe766b0 msgr2=0x5654102577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff07ed9d640 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe766b0 0x5654102577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff07ed9d640 1 -- 172.21.15.146:0/347648995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 msgr2=0x56541027efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff07ed9d640 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x56541027efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.975+0000 7ff07ed9d640 1 -- 172.21.15.146:0/347648995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56540ff02970 con 0x56540fe97390 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff07ed9d640 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x565410268530 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7ff0780125f0 tx=0x7ff078012ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927568626a5cf5bf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff05d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff05d7fa640 1 -- 172.21.15.146:0/347648995 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078019020 con 0x56540fe97390 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff05d7fa640 1 -- 172.21.15.146:0/347648995 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7ff078003c40 con 0x56540fe97390 2024-09-17T03:40:42.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff08be24740 1 -- 172.21.15.146:0/347648995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff074025070 con 0x56540fe97390 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff05d7fa640 1 -- 172.21.15.146:0/347648995 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7ff078023050 con 0x56540fe97390 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff08be24740 10 client.8436 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff08be24740 1 -- 172.21.15.146:0/347648995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x56540fee06a0 con 0x56540fe97390 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff05d7fa640 1 -- 172.21.15.146:0/347648995 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff074025070 con 0x56540fe97390 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff05d7fa640 1 -- 172.21.15.146:0/347648995 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7ff078026020 con 0x56540fe97390 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff08be24740 10 client.8436 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff08be24740 10 client.8436 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff08be24740 20 client.8436 populate_metadata read hostname 'smithi146' 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff08be24740 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x56540fe55f60 0x565410268a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff08be24740 4 client.8436 mds_command: new command op to 8187 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff08be24740 1 -- 172.21.15.146:0/347648995 --> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654101b39b0 con 0x56540fe55f60 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.976+0000 7ff07e59c640 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x56540fe55f60 0x565410268a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.977+0000 7ff05d7fa640 10 client.8436 ms_handle_connect on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.977+0000 7ff07e59c640 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x56540fe55f60 0x565410268a70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5d05409a93d372c server_cookie=f04537345f459b45 in_seq=0 out_seq=0 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.977+0000 7ff05d7fa640 1 -- 172.21.15.146:0/347648995 <== mds.0 v2:172.21.15.146:6832/2931720030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5654101b39b0 con 0x56540fe55f60 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff05d7fa640 10 client.8436 handle_command_reply: tid=0 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 1 client.8436 shutdown 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 1 -- 172.21.15.146:0/347648995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 msgr2=0x565410268530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x565410268530 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7ff0780125f0 tx=0x7ff078012ab0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 1 -- 172.21.15.146:0/347648995 shutdown_connections 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x56540fe55f60 0x565410268a70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x565410268530 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe766b0 0x5654102577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 1 --2- 172.21.15.146:0/347648995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x56541027efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff05d7fa640 0 client.8436 ms_handle_reset on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 1 -- 172.21.15.146:0/347648995 >> 172.21.15.146:0/347648995 conn(0x56540fe8b4e0 msgr2=0x565410265d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 1 -- 172.21.15.146:0/347648995 shutdown_connections 2024-09-17T03:40:42.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 1 -- 172.21.15.146:0/347648995 wait complete. 2024-09-17T03:40:42.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.978+0000 7ff08be24740 20 client.8436 trim_cache size 0 max 16384 2024-09-17T03:40:42.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.995+0000 7ff08be24740 1 Processor -- start 2024-09-17T03:40:42.996 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.995+0000 7ff08be24740 1 -- start start 2024-09-17T03:40:43.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff08be24740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x565410268320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff08be24740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe766b0 0x565410268860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff08be24740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe97390 0x565410266dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff08be24740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff080200250 con 0x56540fe766b0 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff08be24740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff0801ff270 con 0x56540fe6e4d0 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff08be24740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff0800b12d0 con 0x56540fe97390 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe766b0 0x565410268860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe766b0 0x565410268860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37790/0 (socket says 172.21.15.146:37790) 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07dd9b640 1 -- 172.21.15.146:0/117865312 learned_addr learned my addr 172.21.15.146:0/117865312 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07ed9d640 1 --2- 172.21.15.146:0/117865312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe97390 0x565410266dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07e59c640 1 --2- 172.21.15.146:0/117865312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x565410268320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07dd9b640 1 -- 172.21.15.146:0/117865312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe97390 msgr2=0x565410266dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07dd9b640 1 --2- 172.21.15.146:0/117865312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe97390 0x565410266dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07dd9b640 1 -- 172.21.15.146:0/117865312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 msgr2=0x565410268320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:43.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07dd9b640 1 --2- 172.21.15.146:0/117865312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x565410268320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07dd9b640 1 -- 172.21.15.146:0/117865312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654102852f0 con 0x56540fe766b0 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07e59c640 1 --2- 172.21.15.146:0/117865312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x565410268320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07ed9d640 1 --2- 172.21.15.146:0/117865312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe97390 0x565410266dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff07dd9b640 1 --2- 172.21.15.146:0/117865312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe766b0 0x565410268860 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff074021000 tx=0x7ff074004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb88ca669520b8dd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff05f7fe640 1 -- 172.21.15.146:0/117865312 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074014cd0 con 0x56540fe766b0 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff05f7fe640 1 -- 172.21.15.146:0/117865312 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff07402f020 con 0x56540fe766b0 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.997+0000 7ff05f7fe640 1 -- 172.21.15.146:0/117865312 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074005290 con 0x56540fe766b0 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.998+0000 7ff08be24740 1 -- 172.21.15.146:0/117865312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe766b0 msgr2=0x565410268860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.998+0000 7ff08be24740 1 --2- 172.21.15.146:0/117865312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe766b0 0x565410268860 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff074021000 tx=0x7ff074004620 comp rx=0 tx=0).stop 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.998+0000 7ff08be24740 1 -- 172.21.15.146:0/117865312 shutdown_connections 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.998+0000 7ff08be24740 1 --2- 172.21.15.146:0/117865312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe97390 0x565410266dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.998+0000 7ff08be24740 1 --2- 172.21.15.146:0/117865312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe766b0 0x565410268860 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.998+0000 7ff08be24740 1 --2- 172.21.15.146:0/117865312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x565410268320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.998+0000 7ff08be24740 1 -- 172.21.15.146:0/117865312 >> 172.21.15.146:0/117865312 conn(0x56540fe8b4e0 msgr2=0x565410237e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.998+0000 7ff08be24740 1 -- 172.21.15.146:0/117865312 shutdown_connections 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.998+0000 7ff08be24740 1 -- 172.21.15.146:0/117865312 wait complete. 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.999+0000 7ff08be24740 1 -- start start 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:42.999+0000 7ff08be24740 1 Processor -- start 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.000+0000 7ff08be24740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x5654102a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.000+0000 7ff08be24740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe766b0 0x5654102fc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.000+0000 7ff08be24740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x5654102682f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff08be24740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff0801fec50 con 0x56540fe97390 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff08be24740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5654102a22e0 con 0x56540fe6e4d0 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff08be24740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x565410306e10 con 0x56540fe766b0 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff08be24740 10 client.0 _ll_register_callbacks cb 0x7ff0780019d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:40:43.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x5654102682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x5654102682f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37806/0 (socket says 172.21.15.146:37806) 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07ed9d640 1 -- 172.21.15.146:0/486424224 learned_addr learned my addr 172.21.15.146:0/486424224 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07dd9b640 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe766b0 0x5654102fc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07e59c640 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x5654102a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07ed9d640 1 -- 172.21.15.146:0/486424224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe766b0 msgr2=0x5654102fc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07ed9d640 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe766b0 0x5654102fc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07ed9d640 1 -- 172.21.15.146:0/486424224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 msgr2=0x5654102a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07ed9d640 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x5654102a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07ed9d640 1 -- 172.21.15.146:0/486424224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56541023f390 con 0x56540fe97390 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07e59c640 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x5654102a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff07ed9d640 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x5654102682f0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7ff078012300 tx=0x7ff078005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e115f2554b5d4496 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff05d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:40:43.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff05d7fa640 1 -- 172.21.15.146:0/486424224 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07802b030 con 0x56540fe97390 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff05d7fa640 1 -- 172.21.15.146:0/486424224 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7ff078003c40 con 0x56540fe97390 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff08be24740 1 -- 172.21.15.146:0/486424224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565410268140 con 0x56540fe97390 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.001+0000 7ff05d7fa640 1 -- 172.21.15.146:0/486424224 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7ff078034050 con 0x56540fe97390 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff08be24740 10 client.8442 fetch_fsmap learned FSMap version 87 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff08be24740 1 -- 172.21.15.146:0/486424224 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x5654102fcfa0 con 0x56540fe97390 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff05d7fa640 1 -- 172.21.15.146:0/486424224 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x565410268140 con 0x56540fe97390 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff05d7fa640 1 -- 172.21.15.146:0/486424224 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 87) ==== 3502+0+0 (secure 0 0 0) 0x7ff078037020 con 0x56540fe97390 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff08be24740 10 client.8442 fetch_fsmap finished waiting for FSMap version 87 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff08be24740 10 client.8442 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff08be24740 20 client.8442 populate_metadata read hostname 'smithi146' 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff08be24740 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x565410268830 0x5654103061b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff08be24740 4 client.8442 mds_command: new command op to 8187 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:40:43.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff08be24740 1 -- 172.21.15.146:0/486424224 --> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56541027af60 con 0x565410268830 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff07e59c640 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x565410268830 0x5654103061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff05d7fa640 10 client.8442 ms_handle_connect on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.002+0000 7ff07e59c640 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x565410268830 0x5654103061b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76dd08d7776c96f6 server_cookie=1bc978ff21281683 in_seq=0 out_seq=0 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff05d7fa640 1 -- 172.21.15.146:0/486424224 <== mds.0 v2:172.21.15.146:6832/2931720030 1 ==== command_reply(tid 0: 0 ) ==== 8+0+397 (crc 0 0 0) 0x56541027af60 con 0x565410268830 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff05d7fa640 10 client.8442 handle_command_reply: tid=0 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 1 client.8442 shutdown 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 1 -- 172.21.15.146:0/486424224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 msgr2=0x5654102682f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x5654102682f0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7ff078012300 tx=0x7ff078005670 comp rx=0 tx=0).stop 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 1 -- 172.21.15.146:0/486424224 shutdown_connections 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.146:6832/2931720030,v1:172.21.15.146:6833/2931720030] conn(0x565410268830 0x5654103061b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540fe97390 0x5654102682f0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56540fe766b0 0x5654102fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 1 --2- 172.21.15.146:0/486424224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540fe6e4d0 0x5654102a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff05d7fa640 0 client.8442 ms_handle_reset on v2:172.21.15.146:6832/2931720030 2024-09-17T03:40:43.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 1 -- 172.21.15.146:0/486424224 >> 172.21.15.146:0/486424224 conn(0x56540fe8b4e0 msgr2=0x56541029cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:43.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 1 -- 172.21.15.146:0/486424224 shutdown_connections 2024-09-17T03:40:43.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 1 -- 172.21.15.146:0/486424224 wait complete. 2024-09-17T03:40:43.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff08be24740 20 client.8442 trim_cache size 0 max 16384 2024-09-17T03:40:43.012 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:40:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2024-09-17T03:40:43.012 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {}, 2024-09-17T03:40:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:40:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "1335fba5-4ec7-4826-88ea-6235ee94d22b": { 2024-09-17T03:40:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:40:37.417671+0000", 2024-09-17T03:40:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:40:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:40:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:40:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:40:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:40:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:43.013 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:40:43.013 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:40:43.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff084dda640 1 -- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff060078b90 msgr2=0x7ff06007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff084dda640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff060078b90 0x7ff06007b0a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff08015b310 tx=0x7ff074007e90 comp rx=0 tx=0).stop 2024-09-17T03:40:43.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff084dda640 1 -- 172.21.15.146:0/1950868630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0800cd990 msgr2=0x7ff0800ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.003+0000 7ff084dda640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0800cd990 0x7ff0800ac9d0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7ff070009780 tx=0x7ff070033d60 comp rx=0 tx=0).stop 2024-09-17T03:40:43.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.004+0000 7ff084dda640 1 -- 172.21.15.146:0/1950868630 shutdown_connections 2024-09-17T03:40:43.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.004+0000 7ff084dda640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff060078b90 0x7ff06007b0a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.004+0000 7ff084dda640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff080149dd0 0x7ff0800ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.004+0000 7ff084dda640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff08015b8c0 0x7ff080149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.004+0000 7ff084dda640 1 --2- 172.21.15.146:0/1950868630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0800cd990 0x7ff0800ac9d0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.004+0000 7ff084dda640 1 -- 172.21.15.146:0/1950868630 >> 172.21.15.146:0/1950868630 conn(0x7ff0800b2950 msgr2=0x7ff08015f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:43.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.004+0000 7ff084dda640 1 -- 172.21.15.146:0/1950868630 shutdown_connections 2024-09-17T03:40:43.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.004+0000 7ff084dda640 1 -- 172.21.15.146:0/1950868630 wait complete. 2024-09-17T03:40:43.016 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:40:43.016 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.128+0000 7f517ed4a640 1 -- 172.21.15.146:0/1702860654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51780b3360 msgr2=0x7f5178072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.128+0000 7f517ed4a640 1 --2- 172.21.15.146:0/1702860654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51780b3360 0x7f5178072df0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f5174005fd0 tx=0x7f517402a530 comp rx=0 tx=0).stop 2024-09-17T03:40:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.128+0000 7f517ed4a640 1 -- 172.21.15.146:0/1702860654 shutdown_connections 2024-09-17T03:40:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.128+0000 7f517ed4a640 1 --2- 172.21.15.146:0/1702860654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f517815ead0 0x7f517815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.128+0000 7f517ed4a640 1 --2- 172.21.15.146:0/1702860654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51780b3360 0x7f5178072df0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.128+0000 7f517ed4a640 1 -- 172.21.15.146:0/1702860654 >> 172.21.15.146:0/1702860654 conn(0x7f51780b2060 msgr2=0x7f51780b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.128+0000 7f517ed4a640 1 -- 172.21.15.146:0/1702860654 shutdown_connections 2024-09-17T03:40:43.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.128+0000 7f517ed4a640 1 -- 172.21.15.146:0/1702860654 wait complete. 2024-09-17T03:40:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.130+0000 7f517ed4a640 1 Processor -- start 2024-09-17T03:40:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.130+0000 7f517ed4a640 1 -- start start 2024-09-17T03:40:43.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f517ed4a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51780b3360 0x7f51781f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f517ed4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51780cfc40 0x7f517814e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f517ed4a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f517815ead0 0x7f5178140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f517ed4a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f51781515a0 con 0x7f51780cfc40 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f517ed4a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f51780b4ec0 con 0x7f51780b3360 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f517ed4a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5178151720 con 0x7f517815ead0 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51780cfc40 0x7f517814e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51780cfc40 0x7f517814e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37832/0 (socket says 172.21.15.146:37832) 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516ffff640 1 -- 172.21.15.146:0/3929203044 learned_addr learned my addr 172.21.15.146:0/3929203044 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f517cae6640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51780b3360 0x7f51781f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f517d2e7640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f517815ead0 0x7f5178140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516ffff640 1 -- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f517815ead0 msgr2=0x7f5178140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516ffff640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f517815ead0 0x7f5178140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516ffff640 1 -- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51780b3360 msgr2=0x7f51781f7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516ffff640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51780b3360 0x7f51781f7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516ffff640 1 -- 172.21.15.146:0/3929203044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f517814eb80 con 0x7f51780cfc40 2024-09-17T03:40:43.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516ffff640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51780cfc40 0x7f517814e640 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f516800b3e0 tx=0x7f516800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:43.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516d7fa640 1 -- 172.21.15.146:0/3929203044 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168015020 con 0x7f51780cfc40 2024-09-17T03:40:43.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516d7fa640 1 -- 172.21.15.146:0/3929203044 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5168011940 con 0x7f51780cfc40 2024-09-17T03:40:43.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f517ed4a640 1 -- 172.21.15.146:0/3929203044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5178149460 con 0x7f51780cfc40 2024-09-17T03:40:43.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.132+0000 7f516d7fa640 1 -- 172.21.15.146:0/3929203044 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168011d90 con 0x7f51780cfc40 2024-09-17T03:40:43.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.133+0000 7f517ed4a640 1 -- 172.21.15.146:0/3929203044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51781f73d0 con 0x7f51780cfc40 2024-09-17T03:40:43.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.133+0000 7f517ed4a640 1 -- 172.21.15.146:0/3929203044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51781491d0 con 0x7f51780cfc40 2024-09-17T03:40:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.134+0000 7f516d7fa640 1 -- 172.21.15.146:0/3929203044 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5168018020 con 0x7f51780cfc40 2024-09-17T03:40:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.135+0000 7f516d7fa640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5164078b90 0x7f516407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.135+0000 7f516d7fa640 1 -- 172.21.15.146:0/3929203044 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7f516809a9a0 con 0x7f51780cfc40 2024-09-17T03:40:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.135+0000 7f517cae6640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5164078b90 0x7f516407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.135+0000 7f517cae6640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5164078b90 0x7f516407b0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5174033000 tx=0x7f5174004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:43.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.139+0000 7f516d7fa640 1 -- 172.21.15.146:0/3929203044 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f517814eb80 con 0x7f51780cfc40 2024-09-17T03:40:43.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.351+0000 7f517ed4a640 1 -- 172.21.15.146:0/3929203044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51781f7200 con 0x7f51780cfc40 2024-09-17T03:40:43.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.351+0000 7f516d7fa640 1 -- 172.21.15.146:0/3929203044 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5237 (secure 0 0 0) 0x7f5168062750 con 0x7f51780cfc40 2024-09-17T03:40:43.352 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:43.352 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6767,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1732967634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1732967634},{"type":"v1","addr":"172.21.15.146:6835","nonce":1732967634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2315176305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2315176305},{"type":"v1","addr":"172.21.15.179:6837","nonce":2315176305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1700206363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1700206363},{"type":"v1","addr":"172.21.15.179:6836","nonce":1700206363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:14.828261+0000","modified":"2024-09-17T03:40:17.844984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8187":{"gid":8187,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/2931720030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2931720030},{"type":"v1","addr":"172.21.15.146:6833","nonce":2931720030}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8187,"qdb_cluster":[8187]},"id":8}]} 2024-09-17T03:40:43.352 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 87 2024-09-17T03:40:43.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 -- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5164078b90 msgr2=0x7f516407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5164078b90 0x7f516407b0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5174033000 tx=0x7f5174004730 comp rx=0 tx=0).stop 2024-09-17T03:40:43.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 -- 172.21.15.146:0/3929203044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51780cfc40 msgr2=0x7f517814e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51780cfc40 0x7f517814e640 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f516800b3e0 tx=0x7f516800b8a0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 -- 172.21.15.146:0/3929203044 shutdown_connections 2024-09-17T03:40:43.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5164078b90 0x7f516407b0a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f517815ead0 0x7f5178140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51780cfc40 0x7f517814e640 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 --2- 172.21.15.146:0/3929203044 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51780b3360 0x7f51781f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 -- 172.21.15.146:0/3929203044 >> 172.21.15.146:0/3929203044 conn(0x7f51780b2060 msgr2=0x7f517815c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:43.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 -- 172.21.15.146:0/3929203044 shutdown_connections 2024-09-17T03:40:43.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.354+0000 7f517ed4a640 1 -- 172.21.15.146:0/3929203044 wait complete. 2024-09-17T03:40:43.365 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T03:40:43.366 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:40:43.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.476+0000 7f1c20cde640 1 -- 172.21.15.146:0/1500654454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c1c0b4530 msgr2=0x7f1c1c0b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.476+0000 7f1c20cde640 1 --2- 172.21.15.146:0/1500654454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c1c0b4530 0x7f1c1c0b4940 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f1c04005fd0 tx=0x7f1c0402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.476+0000 7f1c20cde640 1 -- 172.21.15.146:0/1500654454 shutdown_connections 2024-09-17T03:40:43.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.476+0000 7f1c20cde640 1 --2- 172.21.15.146:0/1500654454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c1c0b4530 0x7f1c1c0b4940 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.476+0000 7f1c20cde640 1 -- 172.21.15.146:0/1500654454 >> 172.21.15.146:0/1500654454 conn(0x7f1c1c0b3410 msgr2=0x7f1c1c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:43.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.476+0000 7f1c20cde640 1 -- 172.21.15.146:0/1500654454 shutdown_connections 2024-09-17T03:40:43.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.476+0000 7f1c20cde640 1 -- 172.21.15.146:0/1500654454 wait complete. 2024-09-17T03:40:43.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.478+0000 7f1c20cde640 1 Processor -- start 2024-09-17T03:40:43.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.478+0000 7f1c20cde640 1 -- start start 2024-09-17T03:40:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.479+0000 7f1c20cde640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c1c06dd60 0x7f1c1c1e57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c20cde640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c1c0b4530 0x7f1c1c155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c20cde640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c1c0b55f0 0x7f1c1c146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c20cde640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c15c0a0 con 0x7f1c1c06dd60 2024-09-17T03:40:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c20cde640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c15bf20 con 0x7f1c1c0b4530 2024-09-17T03:40:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c20cde640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1c15c220 con 0x7f1c1c0b55f0 2024-09-17T03:40:43.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c1a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c1c06dd60 0x7f1c1c1e57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c1a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c1c06dd60 0x7f1c1c1e57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37858/0 (socket says 172.21.15.146:37858) 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c1a59c640 1 -- 172.21.15.146:0/1508205043 learned_addr learned my addr 172.21.15.146:0/1508205043 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c19d9b640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c1c0b4530 0x7f1c1c155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c1ad9d640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c1c0b55f0 0x7f1c1c146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c1a59c640 1 -- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c1c0b55f0 msgr2=0x7f1c1c146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c1a59c640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c1c0b55f0 0x7f1c1c146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c1a59c640 1 -- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c1c0b4530 msgr2=0x7f1c1c155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c1a59c640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c1c0b4530 0x7f1c1c155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c1a59c640 1 -- 172.21.15.146:0/1508205043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1c154b50 con 0x7f1c1c06dd60 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c1a59c640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c1c06dd60 0x7f1c1c1e57a0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c710 tx=0x7f1c1400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c12ffd640 1 -- 172.21.15.146:0/1508205043 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14003b90 con 0x7f1c1c06dd60 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c12ffd640 1 -- 172.21.15.146:0/1508205043 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c14003d30 con 0x7f1c1c06dd60 2024-09-17T03:40:43.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c12ffd640 1 -- 172.21.15.146:0/1508205043 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400aab0 con 0x7f1c1c06dd60 2024-09-17T03:40:43.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c20cde640 1 -- 172.21.15.146:0/1508205043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c1c154e30 con 0x7f1c1c06dd60 2024-09-17T03:40:43.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.480+0000 7f1c20cde640 1 -- 172.21.15.146:0/1508205043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c1c1553f0 con 0x7f1c1c06dd60 2024-09-17T03:40:43.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.482+0000 7f1c20cde640 1 -- 172.21.15.146:0/1508205043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c1c15c730 con 0x7f1c1c06dd60 2024-09-17T03:40:43.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.482+0000 7f1c12ffd640 1 -- 172.21.15.146:0/1508205043 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c1400ac50 con 0x7f1c1c06dd60 2024-09-17T03:40:43.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.482+0000 7f1c12ffd640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1bfc078b90 0x7f1bfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:43.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.483+0000 7f1c12ffd640 1 -- 172.21.15.146:0/1508205043 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7f1c1409ab60 con 0x7f1c1c06dd60 2024-09-17T03:40:43.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.483+0000 7f1c19d9b640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1bfc078b90 0x7f1bfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:43.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.483+0000 7f1c19d9b640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1bfc078b90 0x7f1bfc07b0a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1c04033000 tx=0x7f1c04004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:43.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.487+0000 7f1c12ffd640 1 -- 172.21.15.146:0/1508205043 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c1400ce20 con 0x7f1c1c06dd60 2024-09-17T03:40:43.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.730+0000 7f1c20cde640 1 -- 172.21.15.146:0/1508205043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1c1c159260 con 0x7f1c1c06dd60 2024-09-17T03:40:43.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.731+0000 7f1c12ffd640 1 -- 172.21.15.146:0/1508205043 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1679 (secure 0 0 0) 0x7f1c14062f60 con 0x7f1c1c06dd60 2024-09-17T03:40:43.731 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:43.731 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":488,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076770153,"bytes_used":2505207808,"bytes_avail":770588905472,"bytes_total":773094113280,"write_bytes_sec":85071863,"read_op_per_sec":0,"write_op_per_sec":93},"fsmap":{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8187}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-17T03:40:41.913691+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:40:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 -- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1bfc078b90 msgr2=0x7f1bfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1bfc078b90 0x7f1bfc07b0a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1c04033000 tx=0x7f1c04004730 comp rx=0 tx=0).stop 2024-09-17T03:40:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 -- 172.21.15.146:0/1508205043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c1c06dd60 msgr2=0x7f1c1c1e57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c1c06dd60 0x7f1c1c1e57a0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c710 tx=0x7f1c1400cbd0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 -- 172.21.15.146:0/1508205043 shutdown_connections 2024-09-17T03:40:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1bfc078b90 0x7f1bfc07b0a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c1c0b55f0 0x7f1c1c146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c1c0b4530 0x7f1c1c155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 --2- 172.21.15.146:0/1508205043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c1c06dd60 0x7f1c1c1e57a0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 -- 172.21.15.146:0/1508205043 >> 172.21.15.146:0/1508205043 conn(0x7f1c1c0b3410 msgr2=0x7f1c1c1588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 -- 172.21.15.146:0/1508205043 shutdown_connections 2024-09-17T03:40:43.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:43.733+0000 7f1c20cde640 1 -- 172.21.15.146:0/1508205043 wait complete. 2024-09-17T03:40:43.744 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/scrub_control_test_path]'} 2024-09-17T03:40:44.745 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.873+0000 7f8bd1c69640 1 -- 172.21.15.146:0/295455399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb4005350 msgr2=0x7f8bb400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.873+0000 7f8bd1c69640 1 --2- 172.21.15.146:0/295455399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb4005350 0x7f8bb400b9c0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4001d90 tx=0x7f8bb4005830 comp rx=0 tx=0).stop 2024-09-17T03:40:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.873+0000 7f8bd1c69640 1 -- 172.21.15.146:0/295455399 shutdown_connections 2024-09-17T03:40:44.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.873+0000 7f8bd1c69640 1 --2- 172.21.15.146:0/295455399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb4005350 0x7f8bb400b9c0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.873+0000 7f8bd1c69640 1 -- 172.21.15.146:0/295455399 >> 172.21.15.146:0/295455399 conn(0x7f8bcc0b3150 msgr2=0x7f8bcc0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.873+0000 7f8bd1c69640 1 -- 172.21.15.146:0/295455399 shutdown_connections 2024-09-17T03:40:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.873+0000 7f8bd1c69640 1 -- 172.21.15.146:0/295455399 wait complete. 2024-09-17T03:40:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.874+0000 7f8bd1c69640 1 Processor -- start 2024-09-17T03:40:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.875+0000 7f8bd1c69640 1 -- start start 2024-09-17T03:40:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bd1c69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb4005350 0x7f8bcc13fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bd1c69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bcc13c550 0x7f8bcc1f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bd1c69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bcc1f9150 0x7f8bcc1f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bd1c69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc0b5a10 con 0x7f8bb4005350 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bd1c69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc0b5890 con 0x7f8bcc1f9150 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bd1c69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8bcc0b5b90 con 0x7f8bcc13c550 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bcb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb4005350 0x7f8bcc13fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bcb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb4005350 0x7f8bcc13fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37888/0 (socket says 172.21.15.146:37888) 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bcb7fe640 1 -- 172.21.15.146:0/3053775799 learned_addr learned my addr 172.21.15.146:0/3053775799 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bcbfff640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bcc1f9150 0x7f8bcc1f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bcaffd640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bcc13c550 0x7f8bcc1f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bcb7fe640 1 -- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bcc13c550 msgr2=0x7f8bcc1f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bcb7fe640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bcc13c550 0x7f8bcc1f8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bcb7fe640 1 -- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bcc1f9150 msgr2=0x7f8bcc1f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bcb7fe640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bcc1f9150 0x7f8bcc1f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.876+0000 7f8bcb7fe640 1 -- 172.21.15.146:0/3053775799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc152a60 con 0x7f8bb4005350 2024-09-17T03:40:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.877+0000 7f8bcaffd640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bcc13c550 0x7f8bcc1f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.877+0000 7f8bcb7fe640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb4005350 0x7f8bcc13fa70 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc011ae0 tx=0x7f8bbc009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.877+0000 7f8bb3fff640 1 -- 172.21.15.146:0/3053775799 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc01e070 con 0x7f8bb4005350 2024-09-17T03:40:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.877+0000 7f8bb3fff640 1 -- 172.21.15.146:0/3053775799 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bbc004460 con 0x7f8bb4005350 2024-09-17T03:40:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.877+0000 7f8bd1c69640 1 -- 172.21.15.146:0/3053775799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc1f9b20 con 0x7f8bb4005350 2024-09-17T03:40:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.877+0000 7f8bb3fff640 1 -- 172.21.15.146:0/3053775799 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00fc60 con 0x7f8bb4005350 2024-09-17T03:40:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.877+0000 7f8bd1c69640 1 -- 172.21.15.146:0/3053775799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc13ef90 con 0x7f8bb4005350 2024-09-17T03:40:44.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.878+0000 7f8bd1c69640 1 -- 172.21.15.146:0/3053775799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc0b4ba0 con 0x7f8bb4005350 2024-09-17T03:40:44.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.879+0000 7f8bb3fff640 1 -- 172.21.15.146:0/3053775799 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8bbc021070 con 0x7f8bb4005350 2024-09-17T03:40:44.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.880+0000 7f8bb3fff640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8bb8078b90 0x7f8bb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:44.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.880+0000 7f8bb3fff640 1 -- 172.21.15.146:0/3053775799 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7f8bbc09b770 con 0x7f8bb4005350 2024-09-17T03:40:44.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.880+0000 7f8bcaffd640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8bb8078b90 0x7f8bb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:44.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.881+0000 7f8bcaffd640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8bb8078b90 0x7f8bb807b0a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc15d480 tx=0x7f8bc0006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:44.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:44.884+0000 7f8bb3fff640 1 -- 172.21.15.146:0/3053775799 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8bbc063520 con 0x7f8bb4005350 2024-09-17T03:40:45.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.092+0000 7f8bd1c69640 1 -- 172.21.15.146:0/3053775799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bcc15d1d0 con 0x7f8bb4005350 2024-09-17T03:40:45.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.092+0000 7f8bb3fff640 1 -- 172.21.15.146:0/3053775799 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5237 (secure 0 0 0) 0x7f8bbc067f50 con 0x7f8bb4005350 2024-09-17T03:40:45.094 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:45.094 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6767,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1732967634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1732967634},{"type":"v1","addr":"172.21.15.146:6835","nonce":1732967634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2315176305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2315176305},{"type":"v1","addr":"172.21.15.179:6837","nonce":2315176305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1700206363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1700206363},{"type":"v1","addr":"172.21.15.179:6836","nonce":1700206363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:14.828261+0000","modified":"2024-09-17T03:40:17.844984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8187":{"gid":8187,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/2931720030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2931720030},{"type":"v1","addr":"172.21.15.146:6833","nonce":2931720030}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8187,"qdb_cluster":[8187]},"id":8}]} 2024-09-17T03:40:45.095 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 87 2024-09-17T03:40:45.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 -- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8bb8078b90 msgr2=0x7f8bb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:45.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8bb8078b90 0x7f8bb807b0a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc15d480 tx=0x7f8bc0006720 comp rx=0 tx=0).stop 2024-09-17T03:40:45.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 -- 172.21.15.146:0/3053775799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb4005350 msgr2=0x7f8bcc13fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:45.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb4005350 0x7f8bcc13fa70 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc011ae0 tx=0x7f8bbc009e40 comp rx=0 tx=0).stop 2024-09-17T03:40:45.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 -- 172.21.15.146:0/3053775799 shutdown_connections 2024-09-17T03:40:45.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8bb8078b90 0x7f8bb807b0a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8bcc1f9150 0x7f8bcc1f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8bcc13c550 0x7f8bcc1f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 --2- 172.21.15.146:0/3053775799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb4005350 0x7f8bcc13fa70 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 -- 172.21.15.146:0/3053775799 >> 172.21.15.146:0/3053775799 conn(0x7f8bcc0b3150 msgr2=0x7f8bcc0d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:45.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 -- 172.21.15.146:0/3053775799 shutdown_connections 2024-09-17T03:40:45.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.095+0000 7f8bd1c69640 1 -- 172.21.15.146:0/3053775799 wait complete. 2024-09-17T03:40:45.106 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T03:40:45.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:40:45.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.218+0000 7fac5b49b640 1 -- 172.21.15.146:0/3720702776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac540b5750 msgr2=0x7fac540b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:45.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.218+0000 7fac5b49b640 1 --2- 172.21.15.146:0/3720702776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac540b5750 0x7fac540b3620 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fac44009830 tx=0x7fac4402a530 comp rx=0 tx=0).stop 2024-09-17T03:40:45.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.218+0000 7fac5b49b640 1 -- 172.21.15.146:0/3720702776 shutdown_connections 2024-09-17T03:40:45.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.218+0000 7fac5b49b640 1 --2- 172.21.15.146:0/3720702776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac540b5750 0x7fac540b3620 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.218+0000 7fac5b49b640 1 -- 172.21.15.146:0/3720702776 >> 172.21.15.146:0/3720702776 conn(0x7fac540b7b20 msgr2=0x7fac5409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:45.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.218+0000 7fac5b49b640 1 -- 172.21.15.146:0/3720702776 shutdown_connections 2024-09-17T03:40:45.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.218+0000 7fac5b49b640 1 -- 172.21.15.146:0/3720702776 wait complete. 2024-09-17T03:40:45.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.220+0000 7fac5b49b640 1 Processor -- start 2024-09-17T03:40:45.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.220+0000 7fac5b49b640 1 -- start start 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.221+0000 7fac5b49b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac540b3b60 0x7fac54152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.221+0000 7fac5b49b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac540b5750 0x7fac54153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.221+0000 7fac5b49b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac540b5ce0 0x7fac5414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.221+0000 7fac5b49b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fac5415d650 con 0x7fac540b5ce0 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.221+0000 7fac5b49b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fac5415d4d0 con 0x7fac540b5750 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.221+0000 7fac5b49b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fac5415d7d0 con 0x7fac540b3b60 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.221+0000 7fac59a38640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac540b5ce0 0x7fac5414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.221+0000 7fac59a38640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac540b5ce0 0x7fac5414f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37912/0 (socket says 172.21.15.146:37912) 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.221+0000 7fac59a38640 1 -- 172.21.15.146:0/214242330 learned_addr learned my addr 172.21.15.146:0/214242330 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.221+0000 7fac58a36640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac540b5750 0x7fac54153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.221+0000 7fac59237640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac540b3b60 0x7fac54152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:45.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.222+0000 7fac59a38640 1 -- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac540b3b60 msgr2=0x7fac54152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.222+0000 7fac59a38640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac540b3b60 0x7fac54152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.222+0000 7fac59a38640 1 -- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac540b5750 msgr2=0x7fac54153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.222+0000 7fac59a38640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac540b5750 0x7fac54153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.222+0000 7fac59a38640 1 -- 172.21.15.146:0/214242330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac541f3f90 con 0x7fac540b5ce0 2024-09-17T03:40:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.222+0000 7fac59a38640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac540b5ce0 0x7fac5414f1f0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c730 tx=0x7fac4c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.222+0000 7fac49ffb640 1 -- 172.21.15.146:0/214242330 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c003b70 con 0x7fac540b5ce0 2024-09-17T03:40:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.222+0000 7fac49ffb640 1 -- 172.21.15.146:0/214242330 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac4c003d30 con 0x7fac540b5ce0 2024-09-17T03:40:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.222+0000 7fac49ffb640 1 -- 172.21.15.146:0/214242330 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0052d0 con 0x7fac540b5ce0 2024-09-17T03:40:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.222+0000 7fac5b49b640 1 -- 172.21.15.146:0/214242330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac541f4270 con 0x7fac540b5ce0 2024-09-17T03:40:45.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.222+0000 7fac5b49b640 1 -- 172.21.15.146:0/214242330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac54153bb0 con 0x7fac540b5ce0 2024-09-17T03:40:45.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.223+0000 7fac5b49b640 1 -- 172.21.15.146:0/214242330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac541f3d00 con 0x7fac540b5ce0 2024-09-17T03:40:45.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.224+0000 7fac49ffb640 1 -- 172.21.15.146:0/214242330 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac4c005680 con 0x7fac540b5ce0 2024-09-17T03:40:45.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.224+0000 7fac49ffb640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac38078bc0 0x7fac3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:45.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.224+0000 7fac49ffb640 1 -- 172.21.15.146:0/214242330 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7fac4c09aab0 con 0x7fac540b5ce0 2024-09-17T03:40:45.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.225+0000 7fac59237640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac38078bc0 0x7fac3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:45.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.225+0000 7fac59237640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac38078bc0 0x7fac3807b0d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fac50000f60 tx=0x7fac50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.229+0000 7fac49ffb640 1 -- 172.21.15.146:0/214242330 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fac540b3f70 con 0x7fac540b5ce0 2024-09-17T03:40:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.472+0000 7fac5b49b640 1 -- 172.21.15.146:0/214242330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fac5415dd10 con 0x7fac540b5ce0 2024-09-17T03:40:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.473+0000 7fac49ffb640 1 -- 172.21.15.146:0/214242330 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1756 (secure 0 0 0) 0x7fac4c062980 con 0x7fac540b5ce0 2024-09-17T03:40:45.473 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:45.473 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":490,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"peering","count":1}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076770153,"bytes_used":2532974592,"bytes_avail":770561138688,"bytes_total":773094113280,"inactive_pgs_ratio":0.010309278033673763,"write_bytes_sec":41495394,"read_op_per_sec":0,"write_op_per_sec":53},"fsmap":{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8187}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-17T03:40:41.913691+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:40:45.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 -- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac38078bc0 msgr2=0x7fac3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac38078bc0 0x7fac3807b0d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fac50000f60 tx=0x7fac50009040 comp rx=0 tx=0).stop 2024-09-17T03:40:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 -- 172.21.15.146:0/214242330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac540b5ce0 msgr2=0x7fac5414f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac540b5ce0 0x7fac5414f1f0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c730 tx=0x7fac4c00cbf0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 -- 172.21.15.146:0/214242330 shutdown_connections 2024-09-17T03:40:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac38078bc0 0x7fac3807b0d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac540b5ce0 0x7fac5414f1f0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac540b5750 0x7fac54153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 --2- 172.21.15.146:0/214242330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac540b3b60 0x7fac54152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 -- 172.21.15.146:0/214242330 >> 172.21.15.146:0/214242330 conn(0x7fac540b7b20 msgr2=0x7fac540b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 -- 172.21.15.146:0/214242330 shutdown_connections 2024-09-17T03:40:45.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:45.475+0000 7fac5b49b640 1 -- 172.21.15.146:0/214242330 wait complete. 2024-09-17T03:40:45.486 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/scrub_control_test_path]'} 2024-09-17T03:40:46.487 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:46.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.611+0000 7f94e9640640 1 -- 172.21.15.146:0/2424651901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e41620f0 msgr2=0x7f94e406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.611+0000 7f94e9640640 1 --2- 172.21.15.146:0/2424651901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e41620f0 0x7f94e406ed30 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009830 tx=0x7f94cc02a480 comp rx=0 tx=0).stop 2024-09-17T03:40:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.611+0000 7f94e9640640 1 -- 172.21.15.146:0/2424651901 shutdown_connections 2024-09-17T03:40:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.611+0000 7f94e9640640 1 --2- 172.21.15.146:0/2424651901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e41620f0 0x7f94e406ed30 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.611+0000 7f94e9640640 1 --2- 172.21.15.146:0/2424651901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94e40b3870 0x7f94e40cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.611+0000 7f94e9640640 1 -- 172.21.15.146:0/2424651901 >> 172.21.15.146:0/2424651901 conn(0x7f94e40d4be0 msgr2=0x7f94e40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.611+0000 7f94e9640640 1 -- 172.21.15.146:0/2424651901 shutdown_connections 2024-09-17T03:40:46.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.611+0000 7f94e9640640 1 -- 172.21.15.146:0/2424651901 wait complete. 2024-09-17T03:40:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.613+0000 7f94e9640640 1 Processor -- start 2024-09-17T03:40:46.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.613+0000 7f94e9640640 1 -- start start 2024-09-17T03:40:46.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.614+0000 7f94e9640640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e406f270 0x7f94e415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.614+0000 7f94e9640640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94e40b3870 0x7f94e40ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.614+0000 7f94e9640640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94e41620f0 0x7f94e41f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.614+0000 7f94e9640640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f94e40d43b0 con 0x7f94e406f270 2024-09-17T03:40:46.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.614+0000 7f94e9640640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f94e4162fb0 con 0x7f94e40b3870 2024-09-17T03:40:46.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.614+0000 7f94e9640640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f94e40caa60 con 0x7f94e41620f0 2024-09-17T03:40:46.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.614+0000 7f94e2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e406f270 0x7f94e415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.614+0000 7f94e2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e406f270 0x7f94e415bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37926/0 (socket says 172.21.15.146:37926) 2024-09-17T03:40:46.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.614+0000 7f94e2ffd640 1 -- 172.21.15.146:0/2764735518 learned_addr learned my addr 172.21.15.146:0/2764735518 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:46.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94da7fc640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94e40b3870 0x7f94e40ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94e2ffd640 1 -- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94e41620f0 msgr2=0x7f94e41f96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94e37fe640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94e41620f0 0x7f94e41f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94e2ffd640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94e41620f0 0x7f94e41f96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94e2ffd640 1 -- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94e40b3870 msgr2=0x7f94e40ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94e2ffd640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94e40b3870 0x7f94e40ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94e2ffd640 1 -- 172.21.15.146:0/2764735518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e415cd60 con 0x7f94e406f270 2024-09-17T03:40:46.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94da7fc640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94e40b3870 0x7f94e40ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:46.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94e37fe640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94e41620f0 0x7f94e41f96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:46.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94e2ffd640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e406f270 0x7f94e415bf50 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c970 tx=0x7f94d400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:46.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94dbfff640 1 -- 172.21.15.146:0/2764735518 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4007bb0 con 0x7f94e406f270 2024-09-17T03:40:46.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94dbfff640 1 -- 172.21.15.146:0/2764735518 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94d4007e40 con 0x7f94e406f270 2024-09-17T03:40:46.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94e9640640 1 -- 172.21.15.146:0/2764735518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e40cead0 con 0x7f94e406f270 2024-09-17T03:40:46.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94dbfff640 1 -- 172.21.15.146:0/2764735518 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4005280 con 0x7f94e406f270 2024-09-17T03:40:46.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.615+0000 7f94e9640640 1 -- 172.21.15.146:0/2764735518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e415ca80 con 0x7f94e406f270 2024-09-17T03:40:46.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.616+0000 7f94e9640640 1 -- 172.21.15.146:0/2764735518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e4051080 con 0x7f94e406f270 2024-09-17T03:40:46.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.617+0000 7f94dbfff640 1 -- 172.21.15.146:0/2764735518 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f94d4005420 con 0x7f94e406f270 2024-09-17T03:40:46.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.617+0000 7f94dbfff640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94c4078bc0 0x7f94c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.617+0000 7f94dbfff640 1 -- 172.21.15.146:0/2764735518 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7f94d409b290 con 0x7f94e406f270 2024-09-17T03:40:46.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.617+0000 7f94da7fc640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94c4078bc0 0x7f94c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.618+0000 7f94da7fc640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94c4078bc0 0x7f94c407b0d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f94cc034000 tx=0x7f94cc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:46.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.622+0000 7f94dbfff640 1 -- 172.21.15.146:0/2764735518 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f94e4051080 con 0x7f94e406f270 2024-09-17T03:40:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.832+0000 7f94e9640640 1 -- 172.21.15.146:0/2764735518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94e4163460 con 0x7f94e406f270 2024-09-17T03:40:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.832+0000 7f94dbfff640 1 -- 172.21.15.146:0/2764735518 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5237 (secure 0 0 0) 0x7f94d4014030 con 0x7f94e406f270 2024-09-17T03:40:46.833 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:46.833 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6767,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1732967634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1732967634},{"type":"v1","addr":"172.21.15.146:6835","nonce":1732967634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2315176305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2315176305},{"type":"v1","addr":"172.21.15.179:6837","nonce":2315176305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1700206363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1700206363},{"type":"v1","addr":"172.21.15.179:6836","nonce":1700206363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:14.828261+0000","modified":"2024-09-17T03:40:17.844984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8187":{"gid":8187,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/2931720030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2931720030},{"type":"v1","addr":"172.21.15.146:6833","nonce":2931720030}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8187,"qdb_cluster":[8187]},"id":8}]} 2024-09-17T03:40:46.833 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 87 2024-09-17T03:40:46.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 -- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94c4078bc0 msgr2=0x7f94c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94c4078bc0 0x7f94c407b0d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f94cc034000 tx=0x7f94cc004730 comp rx=0 tx=0).stop 2024-09-17T03:40:46.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 -- 172.21.15.146:0/2764735518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e406f270 msgr2=0x7f94e415bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e406f270 0x7f94e415bf50 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c970 tx=0x7f94d400ce30 comp rx=0 tx=0).stop 2024-09-17T03:40:46.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 -- 172.21.15.146:0/2764735518 shutdown_connections 2024-09-17T03:40:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f94c4078bc0 0x7f94c407b0d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94e41620f0 0x7f94e41f96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94e40b3870 0x7f94e40ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 --2- 172.21.15.146:0/2764735518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94e406f270 0x7f94e415bf50 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 -- 172.21.15.146:0/2764735518 >> 172.21.15.146:0/2764735518 conn(0x7f94e40d4be0 msgr2=0x7f94e4160ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 -- 172.21.15.146:0/2764735518 shutdown_connections 2024-09-17T03:40:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.835+0000 7f94e9640640 1 -- 172.21.15.146:0/2764735518 wait complete. 2024-09-17T03:40:46.846 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T03:40:46.846 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:40:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.958+0000 7ffa717ad640 1 -- 172.21.15.146:0/3540298885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6c0b5ce0 msgr2=0x7ffa6c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.958+0000 7ffa717ad640 1 --2- 172.21.15.146:0/3540298885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6c0b5ce0 0x7ffa6c0b1320 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c005fd0 tx=0x7ffa5c02a530 comp rx=0 tx=0).stop 2024-09-17T03:40:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.959+0000 7ffa717ad640 1 -- 172.21.15.146:0/3540298885 shutdown_connections 2024-09-17T03:40:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.959+0000 7ffa717ad640 1 --2- 172.21.15.146:0/3540298885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa6c0b3d30 0x7ffa6c15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.959+0000 7ffa717ad640 1 --2- 172.21.15.146:0/3540298885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6c0b5ce0 0x7ffa6c0b1320 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.959+0000 7ffa717ad640 1 -- 172.21.15.146:0/3540298885 >> 172.21.15.146:0/3540298885 conn(0x7ffa6c0b7b20 msgr2=0x7ffa6c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:46.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.959+0000 7ffa717ad640 1 -- 172.21.15.146:0/3540298885 shutdown_connections 2024-09-17T03:40:46.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.959+0000 7ffa717ad640 1 -- 172.21.15.146:0/3540298885 wait complete. 2024-09-17T03:40:46.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.960+0000 7ffa717ad640 1 Processor -- start 2024-09-17T03:40:46.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.961+0000 7ffa717ad640 1 -- start start 2024-09-17T03:40:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa717ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa6c0b5750 0x7ffa6c148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa717ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6c0b5ce0 0x7ffa6c1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa717ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa6c071550 0x7ffa6c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa717ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c15d4b0 con 0x7ffa6c0b5ce0 2024-09-17T03:40:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa717ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c15d330 con 0x7ffa6c0b5750 2024-09-17T03:40:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa717ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c15d630 con 0x7ffa6c071550 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6c0b5ce0 0x7ffa6c1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6c0b5ce0 0x7ffa6c1569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37930/0 (socket says 172.21.15.146:37930) 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6a7fc640 1 -- 172.21.15.146:0/2434194099 learned_addr learned my addr 172.21.15.146:0/2434194099 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6affd640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa6c0b5750 0x7ffa6c148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6b7fe640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa6c071550 0x7ffa6c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6a7fc640 1 -- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa6c071550 msgr2=0x7ffa6c071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6a7fc640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa6c071550 0x7ffa6c071960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6a7fc640 1 -- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa6c0b5750 msgr2=0x7ffa6c148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6a7fc640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa6c0b5750 0x7ffa6c148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6a7fc640 1 -- 172.21.15.146:0/2434194099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c071ea0 con 0x7ffa6c0b5ce0 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6b7fe640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa6c071550 0x7ffa6c071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:46.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.962+0000 7ffa6a7fc640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6c0b5ce0 0x7ffa6c1569d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000b3e0 tx=0x7ffa6000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.963+0000 7ffa537fe640 1 -- 172.21.15.146:0/2434194099 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60015020 con 0x7ffa6c0b5ce0 2024-09-17T03:40:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.963+0000 7ffa537fe640 1 -- 172.21.15.146:0/2434194099 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa60011920 con 0x7ffa6c0b5ce0 2024-09-17T03:40:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.963+0000 7ffa717ad640 1 -- 172.21.15.146:0/2434194099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c155f70 con 0x7ffa6c0b5ce0 2024-09-17T03:40:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.963+0000 7ffa537fe640 1 -- 172.21.15.146:0/2434194099 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60011d70 con 0x7ffa6c0b5ce0 2024-09-17T03:40:46.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.963+0000 7ffa717ad640 1 -- 172.21.15.146:0/2434194099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c1551b0 con 0x7ffa6c0b5ce0 2024-09-17T03:40:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.964+0000 7ffa717ad640 1 -- 172.21.15.146:0/2434194099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6c154c20 con 0x7ffa6c0b5ce0 2024-09-17T03:40:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.965+0000 7ffa537fe640 1 -- 172.21.15.146:0/2434194099 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa60018020 con 0x7ffa6c0b5ce0 2024-09-17T03:40:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.965+0000 7ffa537fe640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa58078bc0 0x7ffa5807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.965+0000 7ffa537fe640 1 -- 172.21.15.146:0/2434194099 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7ffa6009abf0 con 0x7ffa6c0b5ce0 2024-09-17T03:40:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.965+0000 7ffa6affd640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa58078bc0 0x7ffa5807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:46.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.966+0000 7ffa6affd640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa58078bc0 0x7ffa5807b0d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c033000 tx=0x7ffa5c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:46.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:46.970+0000 7ffa537fe640 1 -- 172.21.15.146:0/2434194099 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffa6001f020 con 0x7ffa6c0b5ce0 2024-09-17T03:40:47.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.212+0000 7ffa717ad640 1 -- 172.21.15.146:0/2434194099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ffa6c15dbd0 con 0x7ffa6c0b5ce0 2024-09-17T03:40:47.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.212+0000 7ffa537fe640 1 -- 172.21.15.146:0/2434194099 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1931 (secure 0 0 0) 0x7ffa6c071ea0 con 0x7ffa6c0b5ce0 2024-09-17T03:40:47.212 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:47.213 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":491,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"peering","count":1}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076770153,"bytes_used":2510102528,"bytes_avail":770584010752,"bytes_total":773094113280,"inactive_pgs_ratio":0.010309278033673763,"recovering_objects_per_sec":1,"recovering_bytes_per_sec":1310359,"recovering_keys_per_sec":0,"num_objects_recovered":10,"num_bytes_recovered":10485760,"num_keys_recovered":0,"write_bytes_sec":27999199,"read_op_per_sec":0,"write_op_per_sec":40},"fsmap":{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8187}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-17T03:40:41.913691+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:40:47.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 -- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa58078bc0 msgr2=0x7ffa5807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:47.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa58078bc0 0x7ffa5807b0d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c033000 tx=0x7ffa5c004730 comp rx=0 tx=0).stop 2024-09-17T03:40:47.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 -- 172.21.15.146:0/2434194099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6c0b5ce0 msgr2=0x7ffa6c1569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:47.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6c0b5ce0 0x7ffa6c1569d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000b3e0 tx=0x7ffa6000b8a0 comp rx=0 tx=0).stop 2024-09-17T03:40:47.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 -- 172.21.15.146:0/2434194099 shutdown_connections 2024-09-17T03:40:47.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa58078bc0 0x7ffa5807b0d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:47.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa6c071550 0x7ffa6c071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:47.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa6c0b5ce0 0x7ffa6c1569d0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 --2- 172.21.15.146:0/2434194099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa6c0b5750 0x7ffa6c148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 -- 172.21.15.146:0/2434194099 >> 172.21.15.146:0/2434194099 conn(0x7ffa6c0b7b20 msgr2=0x7ffa6c159870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 -- 172.21.15.146:0/2434194099 shutdown_connections 2024-09-17T03:40:47.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:47.214+0000 7ffa717ad640 1 -- 172.21.15.146:0/2434194099 wait complete. 2024-09-17T03:40:47.226 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/scrub_control_test_path]'} 2024-09-17T03:40:48.226 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.349+0000 7fd4eb17b640 1 -- 172.21.15.146:0/2626591561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4e415c8e0 msgr2=0x7fd4e406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.349+0000 7fd4eb17b640 1 --2- 172.21.15.146:0/2626591561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4e415c8e0 0x7fd4e406f580 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4071500 tx=0x7fd4d402a560 comp rx=0 tx=0).stop 2024-09-17T03:40:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.349+0000 7fd4eb17b640 1 -- 172.21.15.146:0/2626591561 shutdown_connections 2024-09-17T03:40:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.349+0000 7fd4eb17b640 1 --2- 172.21.15.146:0/2626591561 >> v2:172.21.15.179:3300/0 conn(0x7fd4e40cdc50 0x7fd4e40b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.349+0000 7fd4eb17b640 1 --2- 172.21.15.146:0/2626591561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4e415c8e0 0x7fd4e406f580 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.349+0000 7fd4eb17b640 1 -- 172.21.15.146:0/2626591561 >> 172.21.15.146:0/2626591561 conn(0x7fd4e40b3150 msgr2=0x7fd4e40b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.349+0000 7fd4eb17b640 1 -- 172.21.15.146:0/2626591561 shutdown_connections 2024-09-17T03:40:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.349+0000 7fd4eb17b640 1 -- 172.21.15.146:0/2626591561 wait complete. 2024-09-17T03:40:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.351+0000 7fd4eb17b640 1 Processor -- start 2024-09-17T03:40:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.351+0000 7fd4eb17b640 1 -- start start 2024-09-17T03:40:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.352+0000 7fd4eb17b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4e40cd840 0x7fd4e41f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.352+0000 7fd4eb17b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4e40cdc50 0x7fd4e4140590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.352+0000 7fd4eb17b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4e415c8e0 0x7fd4e41542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.352+0000 7fd4eb17b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e4073580 con 0x7fd4e415c8e0 2024-09-17T03:40:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.352+0000 7fd4eb17b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e40b5370 con 0x7fd4e40cdc50 2024-09-17T03:40:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.352+0000 7fd4eb17b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e4073700 con 0x7fd4e40cd840 2024-09-17T03:40:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.352+0000 7fd4e9718640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4e415c8e0 0x7fd4e41542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.352+0000 7fd4e9718640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4e415c8e0 0x7fd4e41542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50662/0 (socket says 172.21.15.146:50662) 2024-09-17T03:40:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.352+0000 7fd4e9718640 1 -- 172.21.15.146:0/982139423 learned_addr learned my addr 172.21.15.146:0/982139423 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.352+0000 7fd4e8f17640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4e40cd840 0x7fd4e41f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.352+0000 7fd4e3fff640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4e40cdc50 0x7fd4e4140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4e9718640 1 -- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4e40cd840 msgr2=0x7fd4e41f7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4e9718640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4e40cd840 0x7fd4e41f7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4e9718640 1 -- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4e40cdc50 msgr2=0x7fd4e4140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4e9718640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4e40cdc50 0x7fd4e4140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4e9718640 1 -- 172.21.15.146:0/982139423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e4143650 con 0x7fd4e415c8e0 2024-09-17T03:40:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4e8f17640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4e40cd840 0x7fd4e41f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4e9718640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4e415c8e0 0x7fd4e41542a0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00e990 tx=0x7fd4dc00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4e17fa640 1 -- 172.21.15.146:0/982139423 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc004d20 con 0x7fd4e415c8e0 2024-09-17T03:40:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4e17fa640 1 -- 172.21.15.146:0/982139423 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4dc00caa0 con 0x7fd4e415c8e0 2024-09-17T03:40:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4eb17b640 1 -- 172.21.15.146:0/982139423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e4143930 con 0x7fd4e415c8e0 2024-09-17T03:40:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4e17fa640 1 -- 172.21.15.146:0/982139423 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc005020 con 0x7fd4e415c8e0 2024-09-17T03:40:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.353+0000 7fd4eb17b640 1 -- 172.21.15.146:0/982139423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e4143ef0 con 0x7fd4e415c8e0 2024-09-17T03:40:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.354+0000 7fd4eb17b640 1 -- 172.21.15.146:0/982139423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e41433c0 con 0x7fd4e415c8e0 2024-09-17T03:40:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.355+0000 7fd4e17fa640 1 -- 172.21.15.146:0/982139423 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd4dc0051c0 con 0x7fd4e415c8e0 2024-09-17T03:40:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.355+0000 7fd4e17fa640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd4d0078bc0 0x7fd4d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.356+0000 7fd4e17fa640 1 -- 172.21.15.146:0/982139423 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7fd4dc09b640 con 0x7fd4e415c8e0 2024-09-17T03:40:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.356+0000 7fd4e8f17640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd4d0078bc0 0x7fd4d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.356+0000 7fd4e8f17640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd4d0078bc0 0x7fd4d007b0d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4033000 tx=0x7fd4d4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:48.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.360+0000 7fd4e17fa640 1 -- 172.21.15.146:0/982139423 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd4dc016030 con 0x7fd4e415c8e0 2024-09-17T03:40:48.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.570+0000 7fd4eb17b640 1 -- 172.21.15.146:0/982139423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4e4073bb0 con 0x7fd4e415c8e0 2024-09-17T03:40:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.571+0000 7fd4e17fa640 1 -- 172.21.15.146:0/982139423 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5237 (secure 0 0 0) 0x7fd4dc0633f0 con 0x7fd4e415c8e0 2024-09-17T03:40:48.571 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:48.571 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6767,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1732967634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1732967634},{"type":"v1","addr":"172.21.15.146:6835","nonce":1732967634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2315176305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2315176305},{"type":"v1","addr":"172.21.15.179:6837","nonce":2315176305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1700206363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1700206363},{"type":"v1","addr":"172.21.15.179:6836","nonce":1700206363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:14.828261+0000","modified":"2024-09-17T03:40:17.844984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8187":{"gid":8187,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/2931720030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2931720030},{"type":"v1","addr":"172.21.15.146:6833","nonce":2931720030}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8187,"qdb_cluster":[8187]},"id":8}]} 2024-09-17T03:40:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 87 2024-09-17T03:40:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.573+0000 7fd4eb17b640 1 -- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd4d0078bc0 msgr2=0x7fd4d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.573+0000 7fd4eb17b640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd4d0078bc0 0x7fd4d007b0d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4033000 tx=0x7fd4d4004730 comp rx=0 tx=0).stop 2024-09-17T03:40:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.573+0000 7fd4eb17b640 1 -- 172.21.15.146:0/982139423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4e415c8e0 msgr2=0x7fd4e41542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.573+0000 7fd4eb17b640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4e415c8e0 0x7fd4e41542a0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00e990 tx=0x7fd4dc00ee50 comp rx=0 tx=0).stop 2024-09-17T03:40:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.574+0000 7fd4eb17b640 1 -- 172.21.15.146:0/982139423 shutdown_connections 2024-09-17T03:40:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.574+0000 7fd4eb17b640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd4d0078bc0 0x7fd4d007b0d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.574+0000 7fd4eb17b640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4e415c8e0 0x7fd4e41542a0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.574+0000 7fd4eb17b640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4e40cdc50 0x7fd4e4140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.574+0000 7fd4eb17b640 1 --2- 172.21.15.146:0/982139423 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4e40cd840 0x7fd4e41f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.574+0000 7fd4eb17b640 1 -- 172.21.15.146:0/982139423 >> 172.21.15.146:0/982139423 conn(0x7fd4e40b3150 msgr2=0x7fd4e40b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.574+0000 7fd4eb17b640 1 -- 172.21.15.146:0/982139423 shutdown_connections 2024-09-17T03:40:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.574+0000 7fd4eb17b640 1 -- 172.21.15.146:0/982139423 wait complete. 2024-09-17T03:40:48.585 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T03:40:48.585 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:40:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.696+0000 7f2862f2b640 1 -- 172.21.15.146:0/3510865930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c0d0710 msgr2=0x7f285c0cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.696+0000 7f2862f2b640 1 --2- 172.21.15.146:0/3510865930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c0d0710 0x7f285c0cf170 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f2858005fd0 tx=0x7f285802a560 comp rx=0 tx=0).stop 2024-09-17T03:40:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.696+0000 7f2862f2b640 1 -- 172.21.15.146:0/3510865930 shutdown_connections 2024-09-17T03:40:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.696+0000 7f2862f2b640 1 --2- 172.21.15.146:0/3510865930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f285c0b47c0 0x7f285c161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.696+0000 7f2862f2b640 1 --2- 172.21.15.146:0/3510865930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c0d0710 0x7f285c0cf170 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.696+0000 7f2862f2b640 1 -- 172.21.15.146:0/3510865930 >> 172.21.15.146:0/3510865930 conn(0x7f285c09ba20 msgr2=0x7f285c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.696+0000 7f2862f2b640 1 -- 172.21.15.146:0/3510865930 shutdown_connections 2024-09-17T03:40:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.696+0000 7f2862f2b640 1 -- 172.21.15.146:0/3510865930 wait complete. 2024-09-17T03:40:48.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.698+0000 7f2862f2b640 1 Processor -- start 2024-09-17T03:40:48.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.698+0000 7f2862f2b640 1 -- start start 2024-09-17T03:40:48.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2862f2b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f285c0b47c0 0x7f285c09fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2862f2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c0cf6b0 0x7f285c0b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2862f2b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f285c0d0710 0x7f285c0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2862f2b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f285c0b1de0 con 0x7f285c0cf6b0 2024-09-17T03:40:48.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2862f2b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f285c162080 con 0x7f285c0d0710 2024-09-17T03:40:48.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2862f2b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f285c0b1f60 con 0x7f285c0b47c0 2024-09-17T03:40:48.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2853fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c0cf6b0 0x7f285c0b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:48.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2853fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c0cf6b0 0x7f285c0b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50676/0 (socket says 172.21.15.146:50676) 2024-09-17T03:40:48.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2853fff640 1 -- 172.21.15.146:0/3624056995 learned_addr learned my addr 172.21.15.146:0/3624056995 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2853fff640 1 -- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f285c0b47c0 msgr2=0x7f285c09fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2853fff640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f285c0b47c0 0x7f285c09fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2853fff640 1 -- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f285c0d0710 msgr2=0x7f285c0c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2853fff640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f285c0d0710 0x7f285c0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2853fff640 1 -- 172.21.15.146:0/3624056995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285c14af10 con 0x7f285c0cf6b0 2024-09-17T03:40:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2853fff640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c0cf6b0 0x7f285c0b03e0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f284c00c3f0 tx=0x7f284c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f28517fa640 1 -- 172.21.15.146:0/3624056995 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c017070 con 0x7f285c0cf6b0 2024-09-17T03:40:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f28517fa640 1 -- 172.21.15.146:0/3624056995 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f284c0035f0 con 0x7f285c0cf6b0 2024-09-17T03:40:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f2862f2b640 1 -- 172.21.15.146:0/3624056995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285c14b1f0 con 0x7f285c0cf6b0 2024-09-17T03:40:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.700+0000 7f28517fa640 1 -- 172.21.15.146:0/3624056995 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c003a40 con 0x7f285c0cf6b0 2024-09-17T03:40:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.701+0000 7f2862f2b640 1 -- 172.21.15.146:0/3624056995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f285c14b7b0 con 0x7f285c0cf6b0 2024-09-17T03:40:48.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.701+0000 7f2862f2b640 1 -- 172.21.15.146:0/3624056995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f285c0cf170 con 0x7f285c0cf6b0 2024-09-17T03:40:48.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.702+0000 7f28517fa640 1 -- 172.21.15.146:0/3624056995 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f284c01a070 con 0x7f285c0cf6b0 2024-09-17T03:40:48.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.703+0000 7f28517fa640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 0x7f284807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:48.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.703+0000 7f28517fa640 1 -- 172.21.15.146:0/3624056995 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7f284c09a090 con 0x7f285c0cf6b0 2024-09-17T03:40:48.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.703+0000 7f2860cc7640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 0x7f284807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:48.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.704+0000 7f2860cc7640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 0x7f284807b0d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2858033000 tx=0x7f28580046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:48.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.707+0000 7f28517fa640 1 -- 172.21.15.146:0/3624056995 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f284c062490 con 0x7f285c0cf6b0 2024-09-17T03:40:48.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.951+0000 7f2862f2b640 1 -- 172.21.15.146:0/3624056995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f285c0b0e30 con 0x7f285c0cf6b0 2024-09-17T03:40:48.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.952+0000 7f28517fa640 1 -- 172.21.15.146:0/3624056995 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1723 (secure 0 0 0) 0x7f284c061d90 con 0x7f285c0cf6b0 2024-09-17T03:40:48.952 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:48.952 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":493,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076770153,"bytes_used":2533212160,"bytes_avail":770560901120,"bytes_total":773094113280,"recovering_objects_per_sec":3,"recovering_bytes_per_sec":4193037,"recovering_keys_per_sec":0,"num_objects_recovered":32,"num_bytes_recovered":33554432,"num_keys_recovered":0},"fsmap":{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8187}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-17T03:40:47.915551+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:40:48.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 -- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 msgr2=0x7f284807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 0x7f284807b0d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2858033000 tx=0x7f28580046c0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 -- 172.21.15.146:0/3624056995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c0cf6b0 msgr2=0x7f285c0b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c0cf6b0 0x7f285c0b03e0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f284c00c3f0 tx=0x7f284c00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 -- 172.21.15.146:0/3624056995 shutdown_connections 2024-09-17T03:40:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 0x7f284807b0d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f285c0d0710 0x7f285c0c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f285c0cf6b0 0x7f285c0b03e0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 --2- 172.21.15.146:0/3624056995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f285c0b47c0 0x7f285c09fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 -- 172.21.15.146:0/3624056995 >> 172.21.15.146:0/3624056995 conn(0x7f285c09ba20 msgr2=0x7f285c0b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 -- 172.21.15.146:0/3624056995 shutdown_connections 2024-09-17T03:40:48.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:48.954+0000 7f2862f2b640 1 -- 172.21.15.146:0/3624056995 wait complete. 2024-09-17T03:40:48.966 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:40:48.966 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:40:48.966 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:49.014 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:49.060 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:40:49.060 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:49.061 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:40:49.061 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:49.077 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:40:49.077 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:49.133 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:40:49.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.287+0000 7f4b4c41d640 1 -- 172.21.15.146:0/2402066130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b30004800 msgr2=0x7f4b30004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.287+0000 7f4b4c41d640 1 --2- 172.21.15.146:0/2402066130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b30004800 0x7f4b30004c10 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400baf0 tx=0x7f4b30005830 comp rx=0 tx=0).stop 2024-09-17T03:40:49.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.287+0000 7f4b4a9ba640 1 -- 172.21.15.146:0/2402066130 reap_dead start 2024-09-17T03:40:49.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.287+0000 7f4b4c41d640 1 -- 172.21.15.146:0/2402066130 shutdown_connections 2024-09-17T03:40:49.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.287+0000 7f4b4c41d640 1 -- 172.21.15.146:0/2402066130 >> 172.21.15.146:0/2402066130 conn(0x7f4b440d4be0 msgr2=0x7f4b440d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:49.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.287+0000 7f4b4c41d640 1 -- 172.21.15.146:0/2402066130 shutdown_connections 2024-09-17T03:40:49.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.287+0000 7f4b4c41d640 1 -- 172.21.15.146:0/2402066130 wait complete. 2024-09-17T03:40:49.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.289+0000 7f4b4c41d640 1 Processor -- start 2024-09-17T03:40:49.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.289+0000 7f4b4c41d640 1 -- start start 2024-09-17T03:40:49.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b4c41d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b30004800 0x7f4b441fa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b4c41d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b440ca9e0 0x7f4b44160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b4c41d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b44156df0 0x7f4b44157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b4c41d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4b44162690 con 0x7f4b440ca9e0 2024-09-17T03:40:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b4c41d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4b440d43b0 con 0x7f4b30004800 2024-09-17T03:40:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b4c41d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4b4406ed30 con 0x7f4b44156df0 2024-09-17T03:40:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b499b8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b440ca9e0 0x7f4b44160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b499b8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b440ca9e0 0x7f4b44160ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50690/0 (socket says 172.21.15.146:50690) 2024-09-17T03:40:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b499b8640 1 -- 172.21.15.146:0/1151852994 learned_addr learned my addr 172.21.15.146:0/1151852994 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b4a9ba640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b44156df0 0x7f4b44157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b4a1b9640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b30004800 0x7f4b441fa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b499b8640 1 -- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b44156df0 msgr2=0x7f4b44157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b499b8640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b44156df0 0x7f4b44157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b499b8640 1 -- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b30004800 msgr2=0x7f4b441fa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b499b8640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b30004800 0x7f4b441fa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b499b8640 1 -- 172.21.15.146:0/1151852994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b44157740 con 0x7f4b440ca9e0 2024-09-17T03:40:49.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.290+0000 7f4b4a9ba640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b44156df0 0x7f4b44157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:49.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.291+0000 7f4b499b8640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b440ca9e0 0x7f4b44160ab0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400baf0 tx=0x7f4b34005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:49.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.291+0000 7f4b3affd640 1 -- 172.21.15.146:0/1151852994 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34040070 con 0x7f4b440ca9e0 2024-09-17T03:40:49.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.291+0000 7f4b3affd640 1 -- 172.21.15.146:0/1151852994 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b34004230 con 0x7f4b440ca9e0 2024-09-17T03:40:49.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.291+0000 7f4b4c41d640 1 -- 172.21.15.146:0/1151852994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b440c8430 con 0x7f4b440ca9e0 2024-09-17T03:40:49.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.291+0000 7f4b3affd640 1 -- 172.21.15.146:0/1151852994 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34035040 con 0x7f4b440ca9e0 2024-09-17T03:40:49.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.291+0000 7f4b4c41d640 1 -- 172.21.15.146:0/1151852994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b440c89f0 con 0x7f4b440ca9e0 2024-09-17T03:40:49.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.292+0000 7f4b4c41d640 1 -- 172.21.15.146:0/1151852994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b440caef0 con 0x7f4b440ca9e0 2024-09-17T03:40:49.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.293+0000 7f4b3affd640 1 -- 172.21.15.146:0/1151852994 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4b34038020 con 0x7f4b440ca9e0 2024-09-17T03:40:49.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.293+0000 7f4b3affd640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078b90 0x7f4b2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:49.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.293+0000 7f4b3affd640 1 -- 172.21.15.146:0/1151852994 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7f4b340bb970 con 0x7f4b440ca9e0 2024-09-17T03:40:49.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.293+0000 7f4b4a1b9640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078b90 0x7f4b2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:49.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.294+0000 7f4b4a1b9640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078b90 0x7f4b2807b0a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4b40003700 tx=0x7f4b4000b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:49.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.298+0000 7f4b3affd640 1 -- 172.21.15.146:0/1151852994 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4b44157740 con 0x7f4b440ca9e0 2024-09-17T03:40:49.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.482+0000 7f4b4c41d640 1 -- 172.21.15.146:0/1151852994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4b4408d860 con 0x7f4b440ca9e0 2024-09-17T03:40:49.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.483+0000 7f4b3affd640 1 -- 172.21.15.146:0/1151852994 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v119) ==== 80+0+0 (secure 0 0 0) 0x7f4b4408d860 con 0x7f4b440ca9e0 2024-09-17T03:40:49.483 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:40:49.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 -- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078b90 msgr2=0x7f4b2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078b90 0x7f4b2807b0a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4b40003700 tx=0x7f4b4000b260 comp rx=0 tx=0).stop 2024-09-17T03:40:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 -- 172.21.15.146:0/1151852994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b440ca9e0 msgr2=0x7f4b44160ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b440ca9e0 0x7f4b44160ab0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400baf0 tx=0x7f4b34005870 comp rx=0 tx=0).stop 2024-09-17T03:40:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 -- 172.21.15.146:0/1151852994 shutdown_connections 2024-09-17T03:40:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078b90 0x7f4b2807b0a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b44156df0 0x7f4b44157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b440ca9e0 0x7f4b44160ab0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 --2- 172.21.15.146:0/1151852994 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b30004800 0x7f4b441fa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 -- 172.21.15.146:0/1151852994 >> 172.21.15.146:0/1151852994 conn(0x7f4b440d4be0 msgr2=0x7f4b440cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 -- 172.21.15.146:0/1151852994 shutdown_connections 2024-09-17T03:40:49.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:49.485+0000 7f4b4c41d640 1 -- 172.21.15.146:0/1151852994 wait complete. 2024-09-17T03:40:49.496 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:40:49.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:49.497 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:40:50.117 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:40:50.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:40:50.118 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:40:50.133 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:50.133 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:40:50.133 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:50.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:50.150 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:50.151 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:40:50.151 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:50.190 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:40:50.190 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:40:50.190 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:40:50.190 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:50.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:50.206 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.343+0000 7fbe5abb0640 1 -- 172.21.15.146:0/4248013563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe540b5ce0 msgr2=0x7fbe540b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.343+0000 7fbe5abb0640 1 --2- 172.21.15.146:0/4248013563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe540b5ce0 0x7fbe540b1320 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fbe540b8440 tx=0x7fbe5002a530 comp rx=0 tx=0).stop 2024-09-17T03:40:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.343+0000 7fbe5abb0640 1 -- 172.21.15.146:0/4248013563 shutdown_connections 2024-09-17T03:40:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.343+0000 7fbe5abb0640 1 --2- 172.21.15.146:0/4248013563 >> v2:172.21.15.179:3300/0 conn(0x7fbe540b5750 0x7fbe540b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.343+0000 7fbe5abb0640 1 --2- 172.21.15.146:0/4248013563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe540b5ce0 0x7fbe540b1320 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.343+0000 7fbe5abb0640 1 -- 172.21.15.146:0/4248013563 >> 172.21.15.146:0/4248013563 conn(0x7fbe540b7b20 msgr2=0x7fbe5409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.344+0000 7fbe5abb0640 1 -- 172.21.15.146:0/4248013563 shutdown_connections 2024-09-17T03:40:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.344+0000 7fbe5abb0640 1 -- 172.21.15.146:0/4248013563 wait complete. 2024-09-17T03:40:50.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.345+0000 7fbe5abb0640 1 Processor -- start 2024-09-17T03:40:50.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.345+0000 7fbe5abb0640 1 -- start start 2024-09-17T03:40:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5abb0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe540b3b60 0x7fbe5409fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5abb0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe540b5750 0x7fbe541f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5abb0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe540b5ce0 0x7fbe541f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5abb0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbe540b27b0 con 0x7fbe540b5ce0 2024-09-17T03:40:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5abb0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5415dcc0 con 0x7fbe540b5750 2024-09-17T03:40:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5abb0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbe540b2930 con 0x7fbe540b3b60 2024-09-17T03:40:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5914d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe540b5ce0 0x7fbe541f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5914d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe540b5ce0 0x7fbe541f73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50712/0 (socket says 172.21.15.146:50712) 2024-09-17T03:40:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5914d640 1 -- 172.21.15.146:0/489145244 learned_addr learned my addr 172.21.15.146:0/489145244 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe4bfff640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe540b5750 0x7fbe541f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5894c640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe540b3b60 0x7fbe5409fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5914d640 1 -- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe540b3b60 msgr2=0x7fbe5409fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5914d640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe540b3b60 0x7fbe5409fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5914d640 1 -- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe540b5750 msgr2=0x7fbe541f6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5914d640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe540b5750 0x7fbe541f6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5914d640 1 -- 172.21.15.146:0/489145244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe54153450 con 0x7fbe540b5ce0 2024-09-17T03:40:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.347+0000 7fbe5914d640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe540b5ce0 0x7fbe541f73a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00caa0 tx=0x7fbe4c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:50.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.348+0000 7fbe497fa640 1 -- 172.21.15.146:0/489145244 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c016020 con 0x7fbe540b5ce0 2024-09-17T03:40:50.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.348+0000 7fbe497fa640 1 -- 172.21.15.146:0/489145244 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe4c00acf0 con 0x7fbe540b5ce0 2024-09-17T03:40:50.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.348+0000 7fbe5abb0640 1 -- 172.21.15.146:0/489145244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe54152bb0 con 0x7fbe540b5ce0 2024-09-17T03:40:50.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.348+0000 7fbe497fa640 1 -- 172.21.15.146:0/489145244 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c012680 con 0x7fbe540b5ce0 2024-09-17T03:40:50.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.348+0000 7fbe5abb0640 1 -- 172.21.15.146:0/489145244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe54153170 con 0x7fbe540b5ce0 2024-09-17T03:40:50.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.349+0000 7fbe5abb0640 1 -- 172.21.15.146:0/489145244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe540b2de0 con 0x7fbe540b5ce0 2024-09-17T03:40:50.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.349+0000 7fbe497fa640 1 -- 172.21.15.146:0/489145244 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe4c019020 con 0x7fbe540b5ce0 2024-09-17T03:40:50.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.350+0000 7fbe497fa640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbe40078b90 0x7fbe4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:50.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.350+0000 7fbe497fa640 1 -- 172.21.15.146:0/489145244 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7fbe4c09b1a0 con 0x7fbe540b5ce0 2024-09-17T03:40:50.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.350+0000 7fbe5894c640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbe40078b90 0x7fbe4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:50.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.351+0000 7fbe5894c640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbe40078b90 0x7fbe4007b0a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbe50034000 tx=0x7fbe50004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:50.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.355+0000 7fbe497fa640 1 -- 172.21.15.146:0/489145244 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbe4c020020 con 0x7fbe540b5ce0 2024-09-17T03:40:50.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.566+0000 7fbe5abb0640 1 -- 172.21.15.146:0/489145244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe5415a9b0 con 0x7fbe540b5ce0 2024-09-17T03:40:50.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.569+0000 7fbe497fa640 1 -- 172.21.15.146:0/489145244 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5237 (secure 0 0 0) 0x7fbe540b3f70 con 0x7fbe540b5ce0 2024-09-17T03:40:50.569 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:50.569 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6767,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1732967634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1732967634},{"type":"v1","addr":"172.21.15.146:6835","nonce":1732967634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2315176305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2315176305},{"type":"v1","addr":"172.21.15.179:6837","nonce":2315176305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1700206363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1700206363},{"type":"v1","addr":"172.21.15.179:6836","nonce":1700206363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:14.828261+0000","modified":"2024-09-17T03:40:17.844984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8187":{"gid":8187,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/2931720030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2931720030},{"type":"v1","addr":"172.21.15.146:6833","nonce":2931720030}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8187,"qdb_cluster":[8187]},"id":8}]} 2024-09-17T03:40:50.569 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 87 2024-09-17T03:40:50.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 -- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbe40078b90 msgr2=0x7fbe4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbe40078b90 0x7fbe4007b0a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbe50034000 tx=0x7fbe50004730 comp rx=0 tx=0).stop 2024-09-17T03:40:50.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 -- 172.21.15.146:0/489145244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe540b5ce0 msgr2=0x7fbe541f73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe540b5ce0 0x7fbe541f73a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00caa0 tx=0x7fbe4c00cf60 comp rx=0 tx=0).stop 2024-09-17T03:40:50.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 -- 172.21.15.146:0/489145244 shutdown_connections 2024-09-17T03:40:50.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbe40078b90 0x7fbe4007b0a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe540b5ce0 0x7fbe541f73a0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbe540b5750 0x7fbe541f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 --2- 172.21.15.146:0/489145244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbe540b3b60 0x7fbe5409fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 -- 172.21.15.146:0/489145244 >> 172.21.15.146:0/489145244 conn(0x7fbe540b7b20 msgr2=0x7fbe540b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:50.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 -- 172.21.15.146:0/489145244 shutdown_connections 2024-09-17T03:40:50.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.571+0000 7fbe5abb0640 1 -- 172.21.15.146:0/489145244 wait complete. 2024-09-17T03:40:50.583 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.696+0000 7f4375a71640 1 -- 172.21.15.146:0/365681574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4358005350 msgr2=0x7f435800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.696+0000 7f4375a71640 1 --2- 172.21.15.146:0/365681574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4358005350 0x7f435800b9c0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f4368005fd0 tx=0x7f4358005830 comp rx=0 tx=0).stop 2024-09-17T03:40:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.696+0000 7f4375a71640 1 -- 172.21.15.146:0/365681574 shutdown_connections 2024-09-17T03:40:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.696+0000 7f4375a71640 1 --2- 172.21.15.146:0/365681574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4358005350 0x7f435800b9c0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.696+0000 7f4375a71640 1 -- 172.21.15.146:0/365681574 >> 172.21.15.146:0/365681574 conn(0x7f43700b7b20 msgr2=0x7f437009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.696+0000 7f4375a71640 1 -- 172.21.15.146:0/365681574 shutdown_connections 2024-09-17T03:40:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.696+0000 7f4375a71640 1 -- 172.21.15.146:0/365681574 wait complete. 2024-09-17T03:40:50.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.698+0000 7f4375a71640 1 Processor -- start 2024-09-17T03:40:50.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.698+0000 7f4375a71640 1 -- start start 2024-09-17T03:40:50.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.699+0000 7f4375a71640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4358005350 0x7f437015dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:50.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.699+0000 7f4375a71640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f437015f5f0 0x7f43701541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:50.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.699+0000 7f4375a71640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43701f9360 0x7f437015b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:50.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f4375a71640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f43700b3620 con 0x7f4358005350 2024-09-17T03:40:50.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f4375a71640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f43700b1740 con 0x7f43701f9360 2024-09-17T03:40:50.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f4375a71640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f43700b37a0 con 0x7f437015f5f0 2024-09-17T03:40:50.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f436f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4358005350 0x7f437015dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f436f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4358005350 0x7f437015dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50730/0 (socket says 172.21.15.146:50730) 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f436f7fe640 1 -- 172.21.15.146:0/20239933 learned_addr learned my addr 172.21.15.146:0/20239933 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f436ffff640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43701f9360 0x7f437015b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f436effd640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f437015f5f0 0x7f43701541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f436f7fe640 1 -- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f437015f5f0 msgr2=0x7f43701541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f436f7fe640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f437015f5f0 0x7f43701541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f436f7fe640 1 -- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43701f9360 msgr2=0x7f437015b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f436f7fe640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43701f9360 0x7f437015b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f436f7fe640 1 -- 172.21.15.146:0/20239933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437015e2d0 con 0x7f4358005350 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f436f7fe640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4358005350 0x7f437015dd90 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f436000e590 tx=0x7f436000ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f4357fff640 1 -- 172.21.15.146:0/20239933 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4360015070 con 0x7f4358005350 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f4357fff640 1 -- 172.21.15.146:0/20239933 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4360010980 con 0x7f4358005350 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f4375a71640 1 -- 172.21.15.146:0/20239933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437006f660 con 0x7f4358005350 2024-09-17T03:40:50.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f4357fff640 1 -- 172.21.15.146:0/20239933 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4360010d50 con 0x7f4358005350 2024-09-17T03:40:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.700+0000 7f4375a71640 1 -- 172.21.15.146:0/20239933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f437006fc20 con 0x7f4358005350 2024-09-17T03:40:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.701+0000 7f4375a71640 1 -- 172.21.15.146:0/20239933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43700b3d00 con 0x7f4358005350 2024-09-17T03:40:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.702+0000 7f4357fff640 1 -- 172.21.15.146:0/20239933 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4360018070 con 0x7f4358005350 2024-09-17T03:40:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.702+0000 7f4357fff640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f435c078b90 0x7f435c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:50.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.703+0000 7f4357fff640 1 -- 172.21.15.146:0/20239933 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7f436009b0b0 con 0x7f4358005350 2024-09-17T03:40:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.703+0000 7f436effd640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f435c078b90 0x7f435c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:50.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.703+0000 7f436effd640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f435c078b90 0x7f435c07b0a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4364000c00 tx=0x7f4364006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:50.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.707+0000 7f4357fff640 1 -- 172.21.15.146:0/20239933 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f43600634b0 con 0x7f4358005350 2024-09-17T03:40:50.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.916+0000 7f4375a71640 1 -- 172.21.15.146:0/20239933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f437006d020 con 0x7f4358005350 2024-09-17T03:40:50.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.917+0000 7f4357fff640 1 -- 172.21.15.146:0/20239933 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5237 (secure 0 0 0) 0x7f4360062db0 con 0x7f4358005350 2024-09-17T03:40:50.917 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:50.917 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6767,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1732967634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1732967634},{"type":"v1","addr":"172.21.15.146:6835","nonce":1732967634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2315176305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2315176305},{"type":"v1","addr":"172.21.15.179:6837","nonce":2315176305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1700206363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1700206363},{"type":"v1","addr":"172.21.15.179:6836","nonce":1700206363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:14.828261+0000","modified":"2024-09-17T03:40:17.844984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8187":{"gid":8187,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/2931720030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2931720030},{"type":"v1","addr":"172.21.15.146:6833","nonce":2931720030}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8187,"qdb_cluster":[8187]},"id":8}]} 2024-09-17T03:40:50.917 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 87 2024-09-17T03:40:50.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 -- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f435c078b90 msgr2=0x7f435c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f435c078b90 0x7f435c07b0a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4364000c00 tx=0x7f4364006b70 comp rx=0 tx=0).stop 2024-09-17T03:40:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 -- 172.21.15.146:0/20239933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4358005350 msgr2=0x7f437015dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4358005350 0x7f437015dd90 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f436000e590 tx=0x7f436000ea50 comp rx=0 tx=0).stop 2024-09-17T03:40:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 -- 172.21.15.146:0/20239933 shutdown_connections 2024-09-17T03:40:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f435c078b90 0x7f435c07b0a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43701f9360 0x7f437015b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f437015f5f0 0x7f43701541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 --2- 172.21.15.146:0/20239933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4358005350 0x7f437015dd90 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 -- 172.21.15.146:0/20239933 >> 172.21.15.146:0/20239933 conn(0x7f43700b7b20 msgr2=0x7f4370154d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 -- 172.21.15.146:0/20239933 shutdown_connections 2024-09-17T03:40:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:50.919+0000 7f4375a71640 1 -- 172.21.15.146:0/20239933 wait complete. 2024-09-17T03:40:50.931 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:51.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.044+0000 7f5b506bd640 1 -- 172.21.15.146:0/3789169195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b480cd840 msgr2=0x7f5b480b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.044+0000 7f5b506bd640 1 --2- 172.21.15.146:0/3789169195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b480cd840 0x7f5b480b5680 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c005fd0 tx=0x7f5b3c02a540 comp rx=0 tx=0).stop 2024-09-17T03:40:51.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.044+0000 7f5b506bd640 1 -- 172.21.15.146:0/3789169195 shutdown_connections 2024-09-17T03:40:51.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.044+0000 7f5b506bd640 1 --2- 172.21.15.146:0/3789169195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b480cdc50 0x7f5b480b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.044+0000 7f5b506bd640 1 --2- 172.21.15.146:0/3789169195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b480cd840 0x7f5b480b5680 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.044+0000 7f5b506bd640 1 -- 172.21.15.146:0/3789169195 >> 172.21.15.146:0/3789169195 conn(0x7f5b480b3150 msgr2=0x7f5b480b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:51.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.044+0000 7f5b506bd640 1 -- 172.21.15.146:0/3789169195 shutdown_connections 2024-09-17T03:40:51.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.044+0000 7f5b506bd640 1 -- 172.21.15.146:0/3789169195 wait complete. 2024-09-17T03:40:51.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.046+0000 7f5b506bd640 1 Processor -- start 2024-09-17T03:40:51.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.046+0000 7f5b506bd640 1 -- start start 2024-09-17T03:40:51.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b506bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b480cd840 0x7f5b48155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b506bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b480cdc50 0x7f5b48157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b506bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b4815c8e0 0x7f5b48150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b506bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48073580 con 0x7f5b480cd840 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b506bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5b480b5430 con 0x7f5b480cdc50 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b506bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5b48073700 con 0x7f5b4815c8e0 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b4e459640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b480cd840 0x7f5b48155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b4e459640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b480cd840 0x7f5b48155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50762/0 (socket says 172.21.15.146:50762) 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b4e459640 1 -- 172.21.15.146:0/2898640214 learned_addr learned my addr 172.21.15.146:0/2898640214 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b4ec5a640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b4815c8e0 0x7f5b48150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b4dc58640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b480cdc50 0x7f5b48157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b4e459640 1 -- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b4815c8e0 msgr2=0x7f5b48150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b4e459640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b4815c8e0 0x7f5b48150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b4e459640 1 -- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b480cdc50 msgr2=0x7f5b48157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b4e459640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b480cdc50 0x7f5b48157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.047+0000 7f5b4e459640 1 -- 172.21.15.146:0/2898640214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b481f7140 con 0x7f5b480cd840 2024-09-17T03:40:51.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.048+0000 7f5b4e459640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b480cd840 0x7f5b48155d20 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f5b3800c7a0 tx=0x7f5b3800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:51.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.048+0000 7f5b46ffd640 1 -- 172.21.15.146:0/2898640214 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38017070 con 0x7f5b480cd840 2024-09-17T03:40:51.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.048+0000 7f5b46ffd640 1 -- 172.21.15.146:0/2898640214 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b38005070 con 0x7f5b480cd840 2024-09-17T03:40:51.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.048+0000 7f5b506bd640 1 -- 172.21.15.146:0/2898640214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b481f7420 con 0x7f5b480cd840 2024-09-17T03:40:51.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.048+0000 7f5b46ffd640 1 -- 172.21.15.146:0/2898640214 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b380054a0 con 0x7f5b480cd840 2024-09-17T03:40:51.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.048+0000 7f5b506bd640 1 -- 172.21.15.146:0/2898640214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b4814e210 con 0x7f5b480cd840 2024-09-17T03:40:51.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.049+0000 7f5b506bd640 1 -- 172.21.15.146:0/2898640214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b480b5680 con 0x7f5b480cd840 2024-09-17T03:40:51.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.050+0000 7f5b46ffd640 1 -- 172.21.15.146:0/2898640214 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b3801a070 con 0x7f5b480cd840 2024-09-17T03:40:51.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.050+0000 7f5b46ffd640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b34078b90 0x7f5b3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.050+0000 7f5b46ffd640 1 -- 172.21.15.146:0/2898640214 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7f5b3809a3d0 con 0x7f5b480cd840 2024-09-17T03:40:51.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.050+0000 7f5b4dc58640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b34078b90 0x7f5b3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.051+0000 7f5b4dc58640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b34078b90 0x7f5b3407b0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c033000 tx=0x7f5b3c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:51.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.055+0000 7f5b46ffd640 1 -- 172.21.15.146:0/2898640214 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5b38062180 con 0x7f5b480cd840 2024-09-17T03:40:51.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.231+0000 7f5b506bd640 1 -- 172.21.15.146:0/2898640214 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b48152900 con 0x7f5b480cd840 2024-09-17T03:40:51.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.232+0000 7f5b46ffd640 1 -- 172.21.15.146:0/2898640214 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16829 (secure 0 0 0) 0x7f5b38066bb0 con 0x7f5b480cd840 2024-09-17T03:40:51.232 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:51.233 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":119,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:40:42.537104+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:40:12.468448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T03:40:13.798897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.18","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:51.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.234+0000 7f5b506bd640 1 -- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b34078b90 msgr2=0x7f5b3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.234+0000 7f5b506bd640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b34078b90 0x7f5b3407b0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c033000 tx=0x7f5b3c004730 comp rx=0 tx=0).stop 2024-09-17T03:40:51.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.234+0000 7f5b506bd640 1 -- 172.21.15.146:0/2898640214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b480cd840 msgr2=0x7f5b48155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.234+0000 7f5b506bd640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b480cd840 0x7f5b48155d20 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f5b3800c7a0 tx=0x7f5b3800cc60 comp rx=0 tx=0).stop 2024-09-17T03:40:51.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.234+0000 7f5b506bd640 1 -- 172.21.15.146:0/2898640214 shutdown_connections 2024-09-17T03:40:51.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.234+0000 7f5b506bd640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b34078b90 0x7f5b3407b0a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.234+0000 7f5b506bd640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b4815c8e0 0x7f5b48150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.234+0000 7f5b506bd640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b480cdc50 0x7f5b48157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.234+0000 7f5b506bd640 1 --2- 172.21.15.146:0/2898640214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b480cd840 0x7f5b48155d20 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.234+0000 7f5b506bd640 1 -- 172.21.15.146:0/2898640214 >> 172.21.15.146:0/2898640214 conn(0x7f5b480b3150 msgr2=0x7f5b480b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:51.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.235+0000 7f5b506bd640 1 -- 172.21.15.146:0/2898640214 shutdown_connections 2024-09-17T03:40:51.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.235+0000 7f5b506bd640 1 -- 172.21.15.146:0/2898640214 wait complete. 2024-09-17T03:40:51.246 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:40:51.247 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:51.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.359+0000 7f921db32640 1 -- 172.21.15.146:0/2944568563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92180d0710 msgr2=0x7f92180cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.359+0000 7f921db32640 1 --2- 172.21.15.146:0/2944568563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92180d0710 0x7f92180cf170 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f9208005fd0 tx=0x7f920802a540 comp rx=0 tx=0).stop 2024-09-17T03:40:51.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.359+0000 7f921db32640 1 -- 172.21.15.146:0/2944568563 shutdown_connections 2024-09-17T03:40:51.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.359+0000 7f921db32640 1 --2- 172.21.15.146:0/2944568563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92180d0710 0x7f92180cf170 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.359+0000 7f921db32640 1 -- 172.21.15.146:0/2944568563 >> 172.21.15.146:0/2944568563 conn(0x7f921809ba20 msgr2=0x7f92180b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:51.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.359+0000 7f921db32640 1 -- 172.21.15.146:0/2944568563 shutdown_connections 2024-09-17T03:40:51.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.359+0000 7f921db32640 1 -- 172.21.15.146:0/2944568563 wait complete. 2024-09-17T03:40:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.361+0000 7f921db32640 1 Processor -- start 2024-09-17T03:40:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.361+0000 7f921db32640 1 -- start start 2024-09-17T03:40:51.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.362+0000 7f921db32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180b47c0 0x7f9218156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.362+0000 7f921db32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92180cf6b0 0x7f92180cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.362+0000 7f921db32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180d0710 0x7f921815ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.362+0000 7f921db32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f92180b2ed0 con 0x7f92180cf6b0 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.362+0000 7f921db32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92180b80a0 con 0x7f92180d0710 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.362+0000 7f921db32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9218168470 con 0x7f92180b47c0 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f9216ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92180cf6b0 0x7f92180cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f9216ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92180cf6b0 0x7f92180cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50772/0 (socket says 172.21.15.146:50772) 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f9216ffd640 1 -- 172.21.15.146:0/413404529 learned_addr learned my addr 172.21.15.146:0/413404529 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f92177fe640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180b47c0 0x7f9218156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f9217fff640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180d0710 0x7f921815ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f9216ffd640 1 -- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180b47c0 msgr2=0x7f9218156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f9216ffd640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180b47c0 0x7f9218156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f9216ffd640 1 -- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180d0710 msgr2=0x7f921815ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f9216ffd640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180d0710 0x7f921815ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f9216ffd640 1 -- 172.21.15.146:0/413404529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9218155c00 con 0x7f92180cf6b0 2024-09-17T03:40:51.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f9216ffd640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92180cf6b0 0x7f92180cbdc0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f920c00b3e0 tx=0x7f920c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:51.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f91fffff640 1 -- 172.21.15.146:0/413404529 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c015020 con 0x7f92180cf6b0 2024-09-17T03:40:51.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f91fffff640 1 -- 172.21.15.146:0/413404529 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f920c011940 con 0x7f92180cf6b0 2024-09-17T03:40:51.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f921db32640 1 -- 172.21.15.146:0/413404529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9218155ec0 con 0x7f92180cf6b0 2024-09-17T03:40:51.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f91fffff640 1 -- 172.21.15.146:0/413404529 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c011d90 con 0x7f92180cf6b0 2024-09-17T03:40:51.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.363+0000 7f921db32640 1 -- 172.21.15.146:0/413404529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9218156480 con 0x7f92180cf6b0 2024-09-17T03:40:51.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.364+0000 7f921db32640 1 -- 172.21.15.146:0/413404529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92180ccc70 con 0x7f92180cf6b0 2024-09-17T03:40:51.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.365+0000 7f91fffff640 1 -- 172.21.15.146:0/413404529 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f920c018020 con 0x7f92180cf6b0 2024-09-17T03:40:51.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.365+0000 7f91fffff640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9204078b90 0x7f920407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.365+0000 7f91fffff640 1 -- 172.21.15.146:0/413404529 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7f920c09acc0 con 0x7f92180cf6b0 2024-09-17T03:40:51.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.366+0000 7f92177fe640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9204078b90 0x7f920407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.366+0000 7f92177fe640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9204078b90 0x7f920407b0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9208033000 tx=0x7f9208004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:51.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.370+0000 7f91fffff640 1 -- 172.21.15.146:0/413404529 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f92180ccc70 con 0x7f92180cf6b0 2024-09-17T03:40:51.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.581+0000 7f921db32640 1 -- 172.21.15.146:0/413404529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92180cf170 con 0x7f92180cf6b0 2024-09-17T03:40:51.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.581+0000 7f91fffff640 1 -- 172.21.15.146:0/413404529 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5237 (secure 0 0 0) 0x7f920c01f020 con 0x7f92180cf6b0 2024-09-17T03:40:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:51.582 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6767,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1732967634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1732967634},{"type":"v1","addr":"172.21.15.146:6835","nonce":1732967634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2315176305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2315176305},{"type":"v1","addr":"172.21.15.179:6837","nonce":2315176305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1700206363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1700206363},{"type":"v1","addr":"172.21.15.179:6836","nonce":1700206363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:14.828261+0000","modified":"2024-09-17T03:40:17.844984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8187":{"gid":8187,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/2931720030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2931720030},{"type":"v1","addr":"172.21.15.146:6833","nonce":2931720030}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8187,"qdb_cluster":[8187]},"id":8}]} 2024-09-17T03:40:51.582 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 87 2024-09-17T03:40:51.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 -- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9204078b90 msgr2=0x7f920407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9204078b90 0x7f920407b0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9208033000 tx=0x7f9208004730 comp rx=0 tx=0).stop 2024-09-17T03:40:51.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 -- 172.21.15.146:0/413404529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92180cf6b0 msgr2=0x7f92180cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92180cf6b0 0x7f92180cbdc0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f920c00b3e0 tx=0x7f920c00b8a0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 -- 172.21.15.146:0/413404529 shutdown_connections 2024-09-17T03:40:51.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9204078b90 0x7f920407b0a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92180d0710 0x7f921815ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92180cf6b0 0x7f92180cbdc0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 --2- 172.21.15.146:0/413404529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92180b47c0 0x7f9218156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 -- 172.21.15.146:0/413404529 >> 172.21.15.146:0/413404529 conn(0x7f921809ba20 msgr2=0x7f92180b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:51.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 -- 172.21.15.146:0/413404529 shutdown_connections 2024-09-17T03:40:51.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.584+0000 7f921db32640 1 -- 172.21.15.146:0/413404529 wait complete. 2024-09-17T03:40:51.596 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:51.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.708+0000 7f4ca0d21640 1 -- 172.21.15.146:0/728725082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0b5ce0 msgr2=0x7f4c9c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.708+0000 7f4ca0d21640 1 --2- 172.21.15.146:0/728725082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0b5ce0 0x7f4c9c0b1320 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0b8440 tx=0x7f4c8c02a530 comp rx=0 tx=0).stop 2024-09-17T03:40:51.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.708+0000 7f4ca0d21640 1 -- 172.21.15.146:0/728725082 shutdown_connections 2024-09-17T03:40:51.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.708+0000 7f4ca0d21640 1 --2- 172.21.15.146:0/728725082 >> v2:172.21.15.179:3300/0 conn(0x7f4c9c0b5750 0x7f4c9c0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.708+0000 7f4ca0d21640 1 --2- 172.21.15.146:0/728725082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0b5ce0 0x7f4c9c0b1320 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.708+0000 7f4ca0d21640 1 -- 172.21.15.146:0/728725082 >> 172.21.15.146:0/728725082 conn(0x7f4c9c0b7b20 msgr2=0x7f4c9c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:51.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.708+0000 7f4ca0d21640 1 -- 172.21.15.146:0/728725082 shutdown_connections 2024-09-17T03:40:51.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.708+0000 7f4ca0d21640 1 -- 172.21.15.146:0/728725082 wait complete. 2024-09-17T03:40:51.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.710+0000 7f4ca0d21640 1 Processor -- start 2024-09-17T03:40:51.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.710+0000 7f4ca0d21640 1 -- start start 2024-09-17T03:40:51.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.711+0000 7f4ca0d21640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c9c0b3b60 0x7f4c9c1567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.711+0000 7f4ca0d21640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c9c0b5750 0x7f4c9c142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.711+0000 7f4ca0d21640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0b5ce0 0x7f4c9c1e9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.711+0000 7f4ca0d21640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c0b27b0 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.711+0000 7f4ca0d21640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c15dcc0 con 0x7f4c9c0b5750 2024-09-17T03:40:51.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.711+0000 7f4ca0d21640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9c0b2930 con 0x7f4c9c0b3b60 2024-09-17T03:40:51.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.711+0000 7f4c9ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0b5ce0 0x7f4c9c1e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.711+0000 7f4c9ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0b5ce0 0x7f4c9c1e9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50798/0 (socket says 172.21.15.146:50798) 2024-09-17T03:40:51.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.711+0000 7f4c9ad9d640 1 -- 172.21.15.146:0/1809426948 learned_addr learned my addr 172.21.15.146:0/1809426948 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:51.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.711+0000 7f4c91d9b640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c9c0b5750 0x7f4c9c142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c9a59c640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c9c0b3b60 0x7f4c9c1567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c9ad9d640 1 -- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c9c0b3b60 msgr2=0x7f4c9c1567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c9ad9d640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c9c0b3b60 0x7f4c9c1567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c9ad9d640 1 -- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c9c0b5750 msgr2=0x7f4c9c142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c9ad9d640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c9c0b5750 0x7f4c9c142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c9ad9d640 1 -- 172.21.15.146:0/1809426948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9c156d20 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c91d9b640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c9c0b5750 0x7f4c9c142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c9a59c640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c9c0b3b60 0x7f4c9c1567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c9ad9d640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0b5ce0 0x7f4c9c1e9370 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400caa0 tx=0x7f4c9400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c937fe640 1 -- 172.21.15.146:0/1809426948 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94016020 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c937fe640 1 -- 172.21.15.146:0/1809426948 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c9400acf0 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4c937fe640 1 -- 172.21.15.146:0/1809426948 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94012680 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4ca0d21640 1 -- 172.21.15.146:0/1809426948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c9c1f5ef0 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.712+0000 7f4ca0d21640 1 -- 172.21.15.146:0/1809426948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c9c1f64b0 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.713+0000 7f4ca0d21640 1 -- 172.21.15.146:0/1809426948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c9c156fc0 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.714+0000 7f4c937fe640 1 -- 172.21.15.146:0/1809426948 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c94019020 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.714+0000 7f4c937fe640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4c7c078b90 0x7f4c7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:51.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.714+0000 7f4c937fe640 1 -- 172.21.15.146:0/1809426948 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7f4c9409b300 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.715+0000 7f4c9a59c640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4c7c078b90 0x7f4c7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:51.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.715+0000 7f4c9a59c640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4c7c078b90 0x7f4c7c07b0a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c034000 tx=0x7f4c8c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:51.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.720+0000 7f4c937fe640 1 -- 172.21.15.146:0/1809426948 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c94020020 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.928+0000 7f4ca0d21640 1 -- 172.21.15.146:0/1809426948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c9c0b2de0 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.928+0000 7f4c937fe640 1 -- 172.21.15.146:0/1809426948 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5237 (secure 0 0 0) 0x7f4c9c0b3f70 con 0x7f4c9c0b5ce0 2024-09-17T03:40:51.928 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:51.929 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"btime":"2024-09-17T03:40:18:481624+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6767,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1732967634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1732967634},{"type":"v1","addr":"172.21.15.146:6835","nonce":1732967634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2315176305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2315176305},{"type":"v1","addr":"172.21.15.179:6837","nonce":2315176305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1700206363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1700206363},{"type":"v1","addr":"172.21.15.179:6836","nonce":1700206363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:40:14.828261+0000","modified":"2024-09-17T03:40:17.844984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8187":{"gid":8187,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/2931720030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2931720030},{"type":"v1","addr":"172.21.15.146:6833","nonce":2931720030}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8187,"qdb_cluster":[8187]},"id":8}]} 2024-09-17T03:40:51.929 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 87 2024-09-17T03:40:51.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 -- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4c7c078b90 msgr2=0x7f4c7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4c7c078b90 0x7f4c7c07b0a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c034000 tx=0x7f4c8c004730 comp rx=0 tx=0).stop 2024-09-17T03:40:51.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 -- 172.21.15.146:0/1809426948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0b5ce0 msgr2=0x7f4c9c1e9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:51.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0b5ce0 0x7f4c9c1e9370 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400caa0 tx=0x7f4c9400cf60 comp rx=0 tx=0).stop 2024-09-17T03:40:51.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 -- 172.21.15.146:0/1809426948 shutdown_connections 2024-09-17T03:40:51.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4c7c078b90 0x7f4c7c07b0a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0b5ce0 0x7f4c9c1e9370 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c9c0b5750 0x7f4c9c142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 --2- 172.21.15.146:0/1809426948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c9c0b3b60 0x7f4c9c1567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:51.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 -- 172.21.15.146:0/1809426948 >> 172.21.15.146:0/1809426948 conn(0x7f4c9c0b7b20 msgr2=0x7f4c9c0b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:51.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 -- 172.21.15.146:0/1809426948 shutdown_connections 2024-09-17T03:40:51.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:51.931+0000 7f4ca0d21640 1 -- 172.21.15.146:0/1809426948 wait complete. 2024-09-17T03:40:51.943 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.055+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/840035248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc15ec30 msgr2=0x7fc8dc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.055+0000 7fc8e1a5c640 1 --2- 172.21.15.146:0/840035248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc15ec30 0x7fc8dc068d00 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc074f00 tx=0x7fc8d002a560 comp rx=0 tx=0).stop 2024-09-17T03:40:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.055+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/840035248 shutdown_connections 2024-09-17T03:40:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.055+0000 7fc8e1a5c640 1 --2- 172.21.15.146:0/840035248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8dc069240 0x7fc8dc0d2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.055+0000 7fc8e1a5c640 1 --2- 172.21.15.146:0/840035248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc15ec30 0x7fc8dc068d00 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.055+0000 7fc8e1a5c640 1 --2- 172.21.15.146:0/840035248 >> v2:172.21.15.179:3300/0 conn(0x7fc8dc0b36b0 0x7fc8dc0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.055+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/840035248 >> 172.21.15.146:0/840035248 conn(0x7fc8dc0d4960 msgr2=0x7fc8dc0d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.055+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/840035248 shutdown_connections 2024-09-17T03:40:52.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.055+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/840035248 wait complete. 2024-09-17T03:40:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.057+0000 7fc8e1a5c640 1 Processor -- start 2024-09-17T03:40:52.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.057+0000 7fc8e1a5c640 1 -- start start 2024-09-17T03:40:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8e1a5c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc069240 0x7fc8dc0b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8e1a5c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8dc0b36b0 0x7fc8dc149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8e1a5c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8dc15ec30 0x7fc8dc14a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8e1a5c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc0d35a0 con 0x7fc8dc069240 2024-09-17T03:40:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8e1a5c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc0d3420 con 0x7fc8dc15ec30 2024-09-17T03:40:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8e1a5c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc8dc0d3720 con 0x7fc8dc0b36b0 2024-09-17T03:40:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8daffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc069240 0x7fc8dc0b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8daffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc069240 0x7fc8dc0b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50822/0 (socket says 172.21.15.146:50822) 2024-09-17T03:40:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8daffd640 1 -- 172.21.15.146:0/1522595966 learned_addr learned my addr 172.21.15.146:0/1522595966 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8db7fe640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8dc15ec30 0x7fc8dc14a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8da7fc640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8dc0b36b0 0x7fc8dc149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8daffd640 1 -- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8dc0b36b0 msgr2=0x7fc8dc149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8daffd640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8dc0b36b0 0x7fc8dc149f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8daffd640 1 -- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8dc15ec30 msgr2=0x7fc8dc14a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8daffd640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8dc15ec30 0x7fc8dc14a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8daffd640 1 -- 172.21.15.146:0/1522595966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc1eab50 con 0x7fc8dc069240 2024-09-17T03:40:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8da7fc640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8dc0b36b0 0x7fc8dc149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8daffd640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc069240 0x7fc8dc0b2c70 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00e790 tx=0x7fc8cc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:52.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8c3fff640 1 -- 172.21.15.146:0/1522595966 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc00eea0 con 0x7fc8dc069240 2024-09-17T03:40:52.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8c3fff640 1 -- 172.21.15.146:0/1522595966 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8cc00cdb0 con 0x7fc8dc069240 2024-09-17T03:40:52.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/1522595966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8dc1eae30 con 0x7fc8dc069240 2024-09-17T03:40:52.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8c3fff640 1 -- 172.21.15.146:0/1522595966 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc010690 con 0x7fc8dc069240 2024-09-17T03:40:52.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.059+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/1522595966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8dc14af80 con 0x7fc8dc069240 2024-09-17T03:40:52.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.060+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/1522595966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8dc0b3c00 con 0x7fc8dc069240 2024-09-17T03:40:52.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.061+0000 7fc8c3fff640 1 -- 172.21.15.146:0/1522595966 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc8cc010830 con 0x7fc8dc069240 2024-09-17T03:40:52.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.061+0000 7fc8c3fff640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc8c8078b90 0x7fc8c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.062+0000 7fc8c3fff640 1 -- 172.21.15.146:0/1522595966 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7fc8cc09b700 con 0x7fc8dc069240 2024-09-17T03:40:52.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.062+0000 7fc8da7fc640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc8c8078b90 0x7fc8c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.062+0000 7fc8da7fc640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc8c8078b90 0x7fc8c807b0a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0033000 tx=0x7fc8d0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:52.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.066+0000 7fc8c3fff640 1 -- 172.21.15.146:0/1522595966 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc8cc063b10 con 0x7fc8dc069240 2024-09-17T03:40:52.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.241+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/1522595966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8dc162010 con 0x7fc8dc069240 2024-09-17T03:40:52.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.243+0000 7fc8c3fff640 1 -- 172.21.15.146:0/1522595966 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16829 (secure 0 0 0) 0x7fc8cc063410 con 0x7fc8dc069240 2024-09-17T03:40:52.243 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:52.243 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":119,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:40:42.537104+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:40:12.468448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T03:40:13.798897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.18","mappings":[{"from":0,"to":5}]},{"pgid":"17.3f","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc8c8078b90 msgr2=0x7fc8c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc8c8078b90 0x7fc8c807b0a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0033000 tx=0x7fc8d0004730 comp rx=0 tx=0).stop 2024-09-17T03:40:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/1522595966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc069240 msgr2=0x7fc8dc0b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc069240 0x7fc8dc0b2c70 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00e790 tx=0x7fc8cc00ec50 comp rx=0 tx=0).stop 2024-09-17T03:40:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/1522595966 shutdown_connections 2024-09-17T03:40:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc8c8078b90 0x7fc8c807b0a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8dc15ec30 0x7fc8dc14a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8dc0b36b0 0x7fc8dc149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 --2- 172.21.15.146:0/1522595966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8dc069240 0x7fc8dc0b2c70 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/1522595966 >> 172.21.15.146:0/1522595966 conn(0x7fc8dc0d4960 msgr2=0x7fc8dc0b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:52.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/1522595966 shutdown_connections 2024-09-17T03:40:52.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.245+0000 7fc8e1a5c640 1 -- 172.21.15.146:0/1522595966 wait complete. 2024-09-17T03:40:52.257 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:40:52.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.371+0000 7f20d8e0e640 1 -- 172.21.15.146:0/3991090406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d40b3d30 msgr2=0x7f20d415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.371+0000 7f20d8e0e640 1 --2- 172.21.15.146:0/3991090406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d40b3d30 0x7f20d415caa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f20cc005fd0 tx=0x7f20cc02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.371+0000 7f20d8e0e640 1 -- 172.21.15.146:0/3991090406 shutdown_connections 2024-09-17T03:40:52.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.371+0000 7f20d8e0e640 1 --2- 172.21.15.146:0/3991090406 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d40b3d30 0x7f20d415caa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.371+0000 7f20d8e0e640 1 --2- 172.21.15.146:0/3991090406 >> v2:172.21.15.179:3300/0 conn(0x7f20d40b5ce0 0x7f20d40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.371+0000 7f20d8e0e640 1 -- 172.21.15.146:0/3991090406 >> 172.21.15.146:0/3991090406 conn(0x7f20d40b7b20 msgr2=0x7f20d409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:52.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.371+0000 7f20d8e0e640 1 -- 172.21.15.146:0/3991090406 shutdown_connections 2024-09-17T03:40:52.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.371+0000 7f20d8e0e640 1 -- 172.21.15.146:0/3991090406 wait complete. 2024-09-17T03:40:52.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.373+0000 7f20d8e0e640 1 Processor -- start 2024-09-17T03:40:52.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.373+0000 7f20d8e0e640 1 -- start start 2024-09-17T03:40:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.374+0000 7f20d8e0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d40b5750 0x7f20d41f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.374+0000 7f20d8e0e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d40b5ce0 0x7f20d415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.374+0000 7f20d8e0e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d4153c30 0x7f20d415f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.374+0000 7f20d8e0e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f20d415d4b0 con 0x7f20d4153c30 2024-09-17T03:40:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.374+0000 7f20d8e0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f20d415d330 con 0x7f20d40b5750 2024-09-17T03:40:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.374+0000 7f20d8e0e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f20d415d630 con 0x7f20d40b5ce0 2024-09-17T03:40:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d4153c30 0x7f20d415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d4153c30 0x7f20d415f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50826/0 (socket says 172.21.15.146:50826) 2024-09-17T03:40:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d2d9d640 1 -- 172.21.15.146:0/97604903 learned_addr learned my addr 172.21.15.146:0/97604903 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d259c640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d40b5750 0x7f20d41f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d1d9b640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d40b5ce0 0x7f20d415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d2d9d640 1 -- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d40b5ce0 msgr2=0x7f20d415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d2d9d640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d40b5ce0 0x7f20d415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d2d9d640 1 -- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d40b5750 msgr2=0x7f20d41f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d2d9d640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d40b5750 0x7f20d41f6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d2d9d640 1 -- 172.21.15.146:0/97604903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d4154dd0 con 0x7f20d4153c30 2024-09-17T03:40:52.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d259c640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d40b5750 0x7f20d41f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:52.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d2d9d640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d4153c30 0x7f20d415f360 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f20cc02aea0 tx=0x7f20cc033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:52.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20c2ffd640 1 -- 172.21.15.146:0/97604903 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc031990 con 0x7f20d4153c30 2024-09-17T03:40:52.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20c2ffd640 1 -- 172.21.15.146:0/97604903 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20cc031c20 con 0x7f20d4153c30 2024-09-17T03:40:52.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20d8e0e640 1 -- 172.21.15.146:0/97604903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d41550b0 con 0x7f20d4153c30 2024-09-17T03:40:52.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.375+0000 7f20c2ffd640 1 -- 172.21.15.146:0/97604903 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0330d0 con 0x7f20d4153c30 2024-09-17T03:40:52.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.376+0000 7f20d8e0e640 1 -- 172.21.15.146:0/97604903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d4155670 con 0x7f20d4153c30 2024-09-17T03:40:52.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.377+0000 7f20d8e0e640 1 -- 172.21.15.146:0/97604903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d415db50 con 0x7f20d4153c30 2024-09-17T03:40:52.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.377+0000 7f20c2ffd640 1 -- 172.21.15.146:0/97604903 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20cc033270 con 0x7f20d4153c30 2024-09-17T03:40:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.378+0000 7f20c2ffd640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078bc0 0x7f20b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.378+0000 7f20c2ffd640 1 -- 172.21.15.146:0/97604903 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5767+0+0 (secure 0 0 0) 0x7f20cc0bbc70 con 0x7f20d4153c30 2024-09-17T03:40:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.378+0000 7f20d259c640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078bc0 0x7f20b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.379+0000 7f20d259c640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078bc0 0x7f20b407b0d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009b80 tx=0x7f20c4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:52.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.383+0000 7f20c2ffd640 1 -- 172.21.15.146:0/97604903 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f20cc04a070 con 0x7f20d4153c30 2024-09-17T03:40:52.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.597+0000 7f20d8e0e640 1 -- 172.21.15.146:0/97604903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f20d4154b60 con 0x7f20d4153c30 2024-09-17T03:40:52.597 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:40:52.597+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:40:52.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.599+0000 7f20c2ffd640 1 -- 172.21.15.146:0/97604903 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v88) ==== 161+0+0 (secure 0 0 0) 0x7f20cc03f030 con 0x7f20d4153c30 2024-09-17T03:40:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:40:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 -- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078bc0 msgr2=0x7f20b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078bc0 0x7f20b407b0d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009b80 tx=0x7f20c4005f90 comp rx=0 tx=0).stop 2024-09-17T03:40:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 -- 172.21.15.146:0/97604903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d4153c30 msgr2=0x7f20d415f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d4153c30 0x7f20d415f360 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f20cc02aea0 tx=0x7f20cc033f70 comp rx=0 tx=0).stop 2024-09-17T03:40:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 -- 172.21.15.146:0/97604903 shutdown_connections 2024-09-17T03:40:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078bc0 0x7f20b407b0d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20d4153c30 0x7f20d415f360 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20d40b5ce0 0x7f20d415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 --2- 172.21.15.146:0/97604903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20d40b5750 0x7f20d41f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 -- 172.21.15.146:0/97604903 >> 172.21.15.146:0/97604903 conn(0x7f20d40b7b20 msgr2=0x7f20d4157150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 -- 172.21.15.146:0/97604903 shutdown_connections 2024-09-17T03:40:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.602+0000 7f20d8e0e640 1 -- 172.21.15.146:0/97604903 wait complete. 2024-09-17T03:40:52.618 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:40:52.672 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:40:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.738+0000 7fc3152ec640 1 -- 172.21.15.146:0/3587444221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3100b47c0 msgr2=0x7fc310161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.738+0000 7fc3152ec640 1 --2- 172.21.15.146:0/3587444221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3100b47c0 0x7fc310161760 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fc3100740d0 tx=0x7fc30802a9c0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.738+0000 7fc3152ec640 1 -- 172.21.15.146:0/3587444221 shutdown_connections 2024-09-17T03:40:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.738+0000 7fc3152ec640 1 --2- 172.21.15.146:0/3587444221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3100b47c0 0x7fc310161760 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.738+0000 7fc3152ec640 1 --2- 172.21.15.146:0/3587444221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100cf6b0 0x7fc310161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.738+0000 7fc3152ec640 1 --2- 172.21.15.146:0/3587444221 >> v2:172.21.15.179:3300/0 conn(0x7fc3100d0710 0x7fc3100cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.738+0000 7fc3152ec640 1 -- 172.21.15.146:0/3587444221 >> 172.21.15.146:0/3587444221 conn(0x7fc31009ba20 msgr2=0x7fc3100b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.738+0000 7fc3152ec640 1 -- 172.21.15.146:0/3587444221 shutdown_connections 2024-09-17T03:40:52.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.738+0000 7fc3152ec640 1 -- 172.21.15.146:0/3587444221 wait complete. 2024-09-17T03:40:52.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.740+0000 7fc3152ec640 1 Processor -- start 2024-09-17T03:40:52.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.740+0000 7fc3152ec640 1 -- start start 2024-09-17T03:40:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.741+0000 7fc3152ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3100b47c0 0x7fc31014c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.741+0000 7fc3152ec640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3100cf6b0 0x7fc31014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.741+0000 7fc3152ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100d0710 0x7fc31014cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.741+0000 7fc3152ec640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc310162030 con 0x7fc3100cf6b0 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.741+0000 7fc3152ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc310161eb0 con 0x7fc3100b47c0 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.741+0000 7fc3152ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc3100cd090 con 0x7fc3100d0710 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc3067fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3100cf6b0 0x7fc31014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc3067fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3100cf6b0 0x7fc31014c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50876/0 (socket says 172.21.15.146:50876) 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc3067fc640 1 -- 172.21.15.146:0/1952839527 learned_addr learned my addr 172.21.15.146:0/1952839527 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc30effd640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3100b47c0 0x7fc31014c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc30f7fe640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100d0710 0x7fc31014cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc3067fc640 1 -- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100d0710 msgr2=0x7fc31014cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc3067fc640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100d0710 0x7fc31014cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc3067fc640 1 -- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3100b47c0 msgr2=0x7fc31014c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc3067fc640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3100b47c0 0x7fc31014c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc3067fc640 1 -- 172.21.15.146:0/1952839527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3101e8b90 con 0x7fc3100cf6b0 2024-09-17T03:40:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc3067fc640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3100cf6b0 0x7fc31014c9e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c770 tx=0x7fc2f800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc307fff640 1 -- 172.21.15.146:0/1952839527 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8007bb0 con 0x7fc3100cf6b0 2024-09-17T03:40:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc307fff640 1 -- 172.21.15.146:0/1952839527 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2f8007e40 con 0x7fc3100cf6b0 2024-09-17T03:40:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc3152ec640 1 -- 172.21.15.146:0/1952839527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3101e8e70 con 0x7fc3100cf6b0 2024-09-17T03:40:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc307fff640 1 -- 172.21.15.146:0/1952839527 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8005280 con 0x7fc3100cf6b0 2024-09-17T03:40:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.742+0000 7fc3152ec640 1 -- 172.21.15.146:0/1952839527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3101e9430 con 0x7fc3100cf6b0 2024-09-17T03:40:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.743+0000 7fc3152ec640 1 -- 172.21.15.146:0/1952839527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3100cf170 con 0x7fc3100cf6b0 2024-09-17T03:40:52.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.744+0000 7fc307fff640 1 -- 172.21.15.146:0/1952839527 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc2f8005420 con 0x7fc3100cf6b0 2024-09-17T03:40:52.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.745+0000 7fc307fff640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f0078b90 0x7fc2f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:52.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.745+0000 7fc307fff640 1 -- 172.21.15.146:0/1952839527 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5853+0+0 (secure 0 0 0) 0x7fc2f809b5e0 con 0x7fc3100cf6b0 2024-09-17T03:40:52.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.745+0000 7fc30effd640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f0078b90 0x7fc2f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:52.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.745+0000 7fc30effd640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f0078b90 0x7fc2f007b0a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc30000a490 tx=0x7fc30000a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.748+0000 7fc307fff640 1 -- 172.21.15.146:0/1952839527 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc2f8014030 con 0x7fc3100cf6b0 2024-09-17T03:40:52.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:52.959+0000 7fc3152ec640 1 -- 172.21.15.146:0/1952839527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc3101e8920 con 0x7fc3100cf6b0 2024-09-17T03:40:53.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.601+0000 7fc307fff640 1 -- 172.21.15.146:0/1952839527 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v89) ==== 104+0+0 (secure 0 0 0) 0x7fc2f8063420 con 0x7fc3100cf6b0 2024-09-17T03:40:53.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 -- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f0078b90 msgr2=0x7fc2f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f0078b90 0x7fc2f007b0a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc30000a490 tx=0x7fc30000a420 comp rx=0 tx=0).stop 2024-09-17T03:40:53.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 -- 172.21.15.146:0/1952839527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3100cf6b0 msgr2=0x7fc31014c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3100cf6b0 0x7fc31014c9e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c770 tx=0x7fc2f800cc30 comp rx=0 tx=0).stop 2024-09-17T03:40:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 -- 172.21.15.146:0/1952839527 shutdown_connections 2024-09-17T03:40:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2f0078b90 0x7fc2f007b0a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc3100d0710 0x7fc31014cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3100cf6b0 0x7fc31014c9e0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 --2- 172.21.15.146:0/1952839527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc3100b47c0 0x7fc31014c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 -- 172.21.15.146:0/1952839527 >> 172.21.15.146:0/1952839527 conn(0x7fc31009ba20 msgr2=0x7fc3101605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 -- 172.21.15.146:0/1952839527 shutdown_connections 2024-09-17T03:40:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.604+0000 7fc3152ec640 1 -- 172.21.15.146:0/1952839527 wait complete. 2024-09-17T03:40:53.617 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:40:53.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.735+0000 7f7721162640 1 -- 172.21.15.146:0/1491744090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c06f270 msgr2=0x7f771c0d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.735+0000 7f7721162640 1 --2- 172.21.15.146:0/1491744090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c06f270 0x7f771c0d3190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7714005fd0 tx=0x7f771402a820 comp rx=0 tx=0).stop 2024-09-17T03:40:53.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.735+0000 7f7721162640 1 -- 172.21.15.146:0/1491744090 shutdown_connections 2024-09-17T03:40:53.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.735+0000 7f7721162640 1 --2- 172.21.15.146:0/1491744090 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c06f270 0x7f771c0d3190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.735+0000 7f7721162640 1 --2- 172.21.15.146:0/1491744090 >> v2:172.21.15.179:3300/0 conn(0x7f771c0cf370 0x7f771c06ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.735+0000 7f7721162640 1 -- 172.21.15.146:0/1491744090 >> 172.21.15.146:0/1491744090 conn(0x7f771c0d4be0 msgr2=0x7f771c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:53.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.736+0000 7f7721162640 1 -- 172.21.15.146:0/1491744090 shutdown_connections 2024-09-17T03:40:53.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.736+0000 7f7721162640 1 -- 172.21.15.146:0/1491744090 wait complete. 2024-09-17T03:40:53.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.738+0000 7f7721162640 1 Processor -- start 2024-09-17T03:40:53.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.738+0000 7f7721162640 1 -- start start 2024-09-17T03:40:53.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f7721162640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c06f270 0x7f771c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f7721162640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c0b3870 0x7f771c14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f7721162640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c0cf370 0x7f771c0cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f7721162640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f771c0d3a60 con 0x7f771c0cf370 2024-09-17T03:40:53.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f7721162640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f771c0d38e0 con 0x7f771c06f270 2024-09-17T03:40:53.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f7721162640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f771c0d3be0 con 0x7f771c0b3870 2024-09-17T03:40:53.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f771b59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c0cf370 0x7f771c0cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f771b59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c0cf370 0x7f771c0cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50890/0 (socket says 172.21.15.146:50890) 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f771b59e640 1 -- 172.21.15.146:0/2343751075 learned_addr learned my addr 172.21.15.146:0/2343751075 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f771a59c640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c0b3870 0x7f771c14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f771ad9d640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c06f270 0x7f771c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f771b59e640 1 -- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c0b3870 msgr2=0x7f771c14cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f771b59e640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c0b3870 0x7f771c14cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f771b59e640 1 -- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c06f270 msgr2=0x7f771c0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f771b59e640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c06f270 0x7f771c0cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.739+0000 7f771b59e640 1 -- 172.21.15.146:0/2343751075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c14d130 con 0x7f771c0cf370 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.740+0000 7f771b59e640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c0cf370 0x7f771c0cb8a0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7714009cd0 tx=0x7f7714032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.740+0000 7f77037fe640 1 -- 172.21.15.146:0/2343751075 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714037040 con 0x7f771c0cf370 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.740+0000 7f77037fe640 1 -- 172.21.15.146:0/2343751075 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7714042070 con 0x7f771c0cf370 2024-09-17T03:40:53.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.740+0000 7f7721162640 1 -- 172.21.15.146:0/2343751075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c0cbde0 con 0x7f771c0cf370 2024-09-17T03:40:53.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.740+0000 7f77037fe640 1 -- 172.21.15.146:0/2343751075 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714003e60 con 0x7f771c0cf370 2024-09-17T03:40:53.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.740+0000 7f7721162640 1 -- 172.21.15.146:0/2343751075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c0cc540 con 0x7f771c0cf370 2024-09-17T03:40:53.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.741+0000 7f7721162640 1 -- 172.21.15.146:0/2343751075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771c0cbfb0 con 0x7f771c0cf370 2024-09-17T03:40:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.741+0000 7f77037fe640 1 -- 172.21.15.146:0/2343751075 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7714004280 con 0x7f771c0cf370 2024-09-17T03:40:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.742+0000 7f77037fe640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7708078b90 0x7f770807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.742+0000 7f77037fe640 1 -- 172.21.15.146:0/2343751075 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5853+0+0 (secure 0 0 0) 0x7f77140bba20 con 0x7f771c0cf370 2024-09-17T03:40:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.742+0000 7f771ad9d640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7708078b90 0x7f770807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.743+0000 7f771ad9d640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7708078b90 0x7f770807b0a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f770c007d60 tx=0x7f770c007cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.746+0000 7f77037fe640 1 -- 172.21.15.146:0/2343751075 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7714083790 con 0x7f771c0cf370 2024-09-17T03:40:53.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:53.920+0000 7f7721162640 1 -- 172.21.15.146:0/2343751075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f771c0ccf40 con 0x7f771c0cf370 2024-09-17T03:40:54.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.607+0000 7f77037fe640 1 -- 172.21.15.146:0/2343751075 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v121) ==== 181+0+0 (secure 0 0 0) 0x7f77140881c0 con 0x7f771c0cf370 2024-09-17T03:40:54.606 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:40:54.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.610+0000 7f7721162640 1 -- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7708078b90 msgr2=0x7f770807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.610+0000 7f7721162640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7708078b90 0x7f770807b0a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f770c007d60 tx=0x7f770c007cf0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.610+0000 7f7721162640 1 -- 172.21.15.146:0/2343751075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c0cf370 msgr2=0x7f771c0cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.610+0000 7f7721162640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c0cf370 0x7f771c0cb8a0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7714009cd0 tx=0x7f7714032c60 comp rx=0 tx=0).stop 2024-09-17T03:40:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.611+0000 7f7721162640 1 -- 172.21.15.146:0/2343751075 shutdown_connections 2024-09-17T03:40:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.611+0000 7f7721162640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7708078b90 0x7f770807b0a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.611+0000 7f7721162640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c0cf370 0x7f771c0cb8a0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.611+0000 7f7721162640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f771c0b3870 0x7f771c14cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.611+0000 7f7721162640 1 --2- 172.21.15.146:0/2343751075 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f771c06f270 0x7f771c0cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.611+0000 7f7721162640 1 -- 172.21.15.146:0/2343751075 >> 172.21.15.146:0/2343751075 conn(0x7f771c0d4be0 msgr2=0x7f771c15f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.611+0000 7f7721162640 1 -- 172.21.15.146:0/2343751075 shutdown_connections 2024-09-17T03:40:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.611+0000 7f7721162640 1 -- 172.21.15.146:0/2343751075 wait complete. 2024-09-17T03:40:54.623 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:40:54.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.744+0000 7fee0f957640 1 -- 172.21.15.146:0/1600903537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0806f270 msgr2=0x7fee080d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.744+0000 7fee0f957640 1 --2- 172.21.15.146:0/1600903537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0806f270 0x7fee080d3190 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fedf8005fd0 tx=0x7fedf802aa30 comp rx=0 tx=0).stop 2024-09-17T03:40:54.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.744+0000 7fee0f957640 1 -- 172.21.15.146:0/1600903537 shutdown_connections 2024-09-17T03:40:54.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.744+0000 7fee0f957640 1 --2- 172.21.15.146:0/1600903537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee0806f270 0x7fee080d3190 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.744+0000 7fee0f957640 1 --2- 172.21.15.146:0/1600903537 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee080cf370 0x7fee0806ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.744+0000 7fee0f957640 1 -- 172.21.15.146:0/1600903537 >> 172.21.15.146:0/1600903537 conn(0x7fee080d4be0 msgr2=0x7fee080d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:54.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.745+0000 7fee0f957640 1 -- 172.21.15.146:0/1600903537 shutdown_connections 2024-09-17T03:40:54.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.745+0000 7fee0f957640 1 -- 172.21.15.146:0/1600903537 wait complete. 2024-09-17T03:40:54.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.746+0000 7fee0f957640 1 Processor -- start 2024-09-17T03:40:54.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.746+0000 7fee0f957640 1 -- start start 2024-09-17T03:40:54.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0f957640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee0806f270 0x7fee0814fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:54.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0f957640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee080b3870 0x7fee081f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:54.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0f957640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee080cf370 0x7fee081f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:54.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0f957640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fee080d3ae0 con 0x7fee080cf370 2024-09-17T03:40:54.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0f957640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fee080d3960 con 0x7fee080b3870 2024-09-17T03:40:54.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0f957640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fee080d3c60 con 0x7fee0806f270 2024-09-17T03:40:54.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0def4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee080cf370 0x7fee081f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0def4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee080cf370 0x7fee081f9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50912/0 (socket says 172.21.15.146:50912) 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0def4640 1 -- 172.21.15.146:0/3363807124 learned_addr learned my addr 172.21.15.146:0/3363807124 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0d6f3640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee0806f270 0x7fee0814fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0cef2640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee080b3870 0x7fee081f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0def4640 1 -- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee0806f270 msgr2=0x7fee0814fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0def4640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee0806f270 0x7fee0814fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0def4640 1 -- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee080b3870 msgr2=0x7fee081f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0def4640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee080b3870 0x7fee081f9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0def4640 1 -- 172.21.15.146:0/3363807124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee080cb3d0 con 0x7fee080cf370 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0cef2640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee080b3870 0x7fee081f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0def4640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee080cf370 0x7fee081f9a90 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fedf802b020 tx=0x7fedf8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:54.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee05ffb640 1 -- 172.21.15.146:0/3363807124 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8033050 con 0x7fee080cf370 2024-09-17T03:40:54.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee05ffb640 1 -- 172.21.15.146:0/3363807124 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedf80044d0 con 0x7fee080cf370 2024-09-17T03:40:54.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee0f957640 1 -- 172.21.15.146:0/3363807124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee08158910 con 0x7fee080cf370 2024-09-17T03:40:54.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.748+0000 7fee05ffb640 1 -- 172.21.15.146:0/3363807124 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8038450 con 0x7fee080cf370 2024-09-17T03:40:54.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.749+0000 7fee0f957640 1 -- 172.21.15.146:0/3363807124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee08159f80 con 0x7fee080cf370 2024-09-17T03:40:54.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.750+0000 7fee0f957640 1 -- 172.21.15.146:0/3363807124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee080d4160 con 0x7fee080cf370 2024-09-17T03:40:54.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.750+0000 7fee05ffb640 1 -- 172.21.15.146:0/3363807124 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fedf8036070 con 0x7fee080cf370 2024-09-17T03:40:54.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.751+0000 7fee05ffb640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedf4078bc0 0x7fedf407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:54.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.752+0000 7fee05ffb640 1 -- 172.21.15.146:0/3363807124 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5415+0+0 (secure 0 0 0) 0x7fedf80bc260 con 0x7fee080cf370 2024-09-17T03:40:54.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.752+0000 7fee0d6f3640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedf4078bc0 0x7fedf407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:54.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.752+0000 7fee0d6f3640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedf4078bc0 0x7fedf407b0d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fee00007fd0 tx=0x7fee00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:54.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.756+0000 7fee05ffb640 1 -- 172.21.15.146:0/3363807124 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fee08158910 con 0x7fee080cf370 2024-09-17T03:40:54.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:54.939+0000 7fee0f957640 1 -- 172.21.15.146:0/3363807124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fee08159d70 con 0x7fee080cf370 2024-09-17T03:40:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.608+0000 7fee05ffb640 1 -- 172.21.15.146:0/3363807124 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v122) ==== 169+0+0 (secure 0 0 0) 0x7fedf80847c0 con 0x7fee080cf370 2024-09-17T03:40:55.608 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:40:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.612+0000 7fee0f957640 1 -- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedf4078bc0 msgr2=0x7fedf407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.612+0000 7fee0f957640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedf4078bc0 0x7fedf407b0d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fee00007fd0 tx=0x7fee00009040 comp rx=0 tx=0).stop 2024-09-17T03:40:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.612+0000 7fee0f957640 1 -- 172.21.15.146:0/3363807124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee080cf370 msgr2=0x7fee081f9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.612+0000 7fee0f957640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee080cf370 0x7fee081f9a90 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fedf802b020 tx=0x7fedf8003f10 comp rx=0 tx=0).stop 2024-09-17T03:40:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.613+0000 7fee0f957640 1 -- 172.21.15.146:0/3363807124 shutdown_connections 2024-09-17T03:40:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.613+0000 7fee0f957640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedf4078bc0 0x7fedf407b0d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.613+0000 7fee0f957640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee080cf370 0x7fee081f9a90 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.613+0000 7fee0f957640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee080b3870 0x7fee081f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.613+0000 7fee0f957640 1 --2- 172.21.15.146:0/3363807124 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee0806f270 0x7fee0814fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.613+0000 7fee0f957640 1 -- 172.21.15.146:0/3363807124 >> 172.21.15.146:0/3363807124 conn(0x7fee080d4be0 msgr2=0x7fee0815c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:55.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.613+0000 7fee0f957640 1 -- 172.21.15.146:0/3363807124 shutdown_connections 2024-09-17T03:40:55.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.613+0000 7fee0f957640 1 -- 172.21.15.146:0/3363807124 wait complete. 2024-09-17T03:40:55.631 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:40:55.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.748+0000 7f72d73e4640 1 -- 172.21.15.146:0/3384747273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72d00b61f0 msgr2=0x7f72d00b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:55.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.748+0000 7f72d73e4640 1 --2- 172.21.15.146:0/3384747273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72d00b61f0 0x7f72d00b6600 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f72d006e100 tx=0x7f72c802a980 comp rx=0 tx=0).stop 2024-09-17T03:40:55.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.748+0000 7f72d73e4640 1 -- 172.21.15.146:0/3384747273 shutdown_connections 2024-09-17T03:40:55.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.748+0000 7f72d73e4640 1 --2- 172.21.15.146:0/3384747273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72d00b61f0 0x7f72d00b6600 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.748+0000 7f72d73e4640 1 --2- 172.21.15.146:0/3384747273 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d01631a0 0x7f72d00cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.748+0000 7f72d73e4640 1 --2- 172.21.15.146:0/3384747273 >> v2:172.21.15.179:3300/0 conn(0x7f72d015f1a0 0x7f72d00cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.748+0000 7f72d73e4640 1 -- 172.21.15.146:0/3384747273 >> 172.21.15.146:0/3384747273 conn(0x7f72d00d11f0 msgr2=0x7f72d00d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:55.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.748+0000 7f72d73e4640 1 -- 172.21.15.146:0/3384747273 shutdown_connections 2024-09-17T03:40:55.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.748+0000 7f72d73e4640 1 -- 172.21.15.146:0/3384747273 wait complete. 2024-09-17T03:40:55.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.750+0000 7f72d73e4640 1 Processor -- start 2024-09-17T03:40:55.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.750+0000 7f72d73e4640 1 -- start start 2024-09-17T03:40:55.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d73e4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d00b61f0 0x7f72d01f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:55.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d73e4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72d015f1a0 0x7f72d01f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:55.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d73e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72d01631a0 0x7f72d0158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:55.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d73e4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f72d00693a0 con 0x7f72d015f1a0 2024-09-17T03:40:55.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d73e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f72d0069220 con 0x7f72d01631a0 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d73e4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f72d0069520 con 0x7f72d00b61f0 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d497f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72d015f1a0 0x7f72d01f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d497f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72d015f1a0 0x7f72d01f6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50924/0 (socket says 172.21.15.146:50924) 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d497f640 1 -- 172.21.15.146:0/3739850942 learned_addr learned my addr 172.21.15.146:0/3739850942 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d5180640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d00b61f0 0x7f72d01f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d5981640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72d01631a0 0x7f72d0158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d497f640 1 -- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d00b61f0 msgr2=0x7f72d01f94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d497f640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d00b61f0 0x7f72d01f94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d497f640 1 -- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72d01631a0 msgr2=0x7f72d0158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d497f640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72d01631a0 0x7f72d0158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.751+0000 7f72d497f640 1 -- 172.21.15.146:0/3739850942 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d01f6da0 con 0x7f72d015f1a0 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.752+0000 7f72d497f640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72d015f1a0 0x7f72d01f6860 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f72c000d6d0 tx=0x7f72c000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.752+0000 7f72c5ffb640 1 -- 172.21.15.146:0/3739850942 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0017070 con 0x7f72d015f1a0 2024-09-17T03:40:55.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.752+0000 7f72c5ffb640 1 -- 172.21.15.146:0/3739850942 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72c0005330 con 0x7f72d015f1a0 2024-09-17T03:40:55.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.752+0000 7f72d73e4640 1 -- 172.21.15.146:0/3739850942 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d01f9db0 con 0x7f72d015f1a0 2024-09-17T03:40:55.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.752+0000 7f72c5ffb640 1 -- 172.21.15.146:0/3739850942 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0009820 con 0x7f72d015f1a0 2024-09-17T03:40:55.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.752+0000 7f72d73e4640 1 -- 172.21.15.146:0/3739850942 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d01f6060 con 0x7f72d015f1a0 2024-09-17T03:40:55.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.753+0000 7f72d73e4640 1 -- 172.21.15.146:0/3739850942 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d0069a40 con 0x7f72d015f1a0 2024-09-17T03:40:55.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.754+0000 7f72c5ffb640 1 -- 172.21.15.146:0/3739850942 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72c0009bd0 con 0x7f72d015f1a0 2024-09-17T03:40:55.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.754+0000 7f72c5ffb640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72b4078b90 0x7f72b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:55.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.755+0000 7f72c5ffb640 1 -- 172.21.15.146:0/3739850942 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4943+0+0 (secure 0 0 0) 0x7f72c009afd0 con 0x7f72d015f1a0 2024-09-17T03:40:55.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.755+0000 7f72d5180640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72b4078b90 0x7f72b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:55.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.755+0000 7f72d5180640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72b4078b90 0x7f72b407b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00bb50 tx=0x7f72cc00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:55.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.758+0000 7f72c5ffb640 1 -- 172.21.15.146:0/3739850942 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72c00631a0 con 0x7f72d015f1a0 2024-09-17T03:40:55.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.942+0000 7f72d73e4640 1 -- 172.21.15.146:0/3739850942 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f72d01f9b40 con 0x7f72d015f1a0 2024-09-17T03:40:55.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.946+0000 7f72c5ffb640 1 -- 172.21.15.146:0/3739850942 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v53) ==== 71+0+0 (secure 0 0 0) 0x7f72c0067bd0 con 0x7f72d015f1a0 2024-09-17T03:40:55.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.948+0000 7f72d73e4640 1 -- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72b4078b90 msgr2=0x7f72b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:55.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.948+0000 7f72d73e4640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72b4078b90 0x7f72b407b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00bb50 tx=0x7f72cc00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.948+0000 7f72d73e4640 1 -- 172.21.15.146:0/3739850942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72d015f1a0 msgr2=0x7f72d01f6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:55.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.948+0000 7f72d73e4640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72d015f1a0 0x7f72d01f6860 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f72c000d6d0 tx=0x7f72c000db90 comp rx=0 tx=0).stop 2024-09-17T03:40:55.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.949+0000 7f72d73e4640 1 -- 172.21.15.146:0/3739850942 shutdown_connections 2024-09-17T03:40:55.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.949+0000 7f72d73e4640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72b4078b90 0x7f72b407b0a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.949+0000 7f72d73e4640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72d01631a0 0x7f72d0158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.949+0000 7f72d73e4640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72d015f1a0 0x7f72d01f6860 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.949+0000 7f72d73e4640 1 --2- 172.21.15.146:0/3739850942 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d00b61f0 0x7f72d01f94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:55.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.949+0000 7f72d73e4640 1 -- 172.21.15.146:0/3739850942 >> 172.21.15.146:0/3739850942 conn(0x7f72d00d11f0 msgr2=0x7f72d0160d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:55.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.949+0000 7f72d73e4640 1 -- 172.21.15.146:0/3739850942 shutdown_connections 2024-09-17T03:40:55.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:55.949+0000 7f72d73e4640 1 -- 172.21.15.146:0/3739850942 wait complete. 2024-09-17T03:40:55.960 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-17T03:40:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.073+0000 7fbd302d3640 1 -- 172.21.15.146:0/2118556211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd280b7580 msgr2=0x7fbd280ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.073+0000 7fbd302d3640 1 --2- 172.21.15.146:0/2118556211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd280b7580 0x7fbd280ccbd0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fbd18005fd0 tx=0x7fbd1802aa10 comp rx=0 tx=0).stop 2024-09-17T03:40:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.073+0000 7fbd302d3640 1 -- 172.21.15.146:0/2118556211 shutdown_connections 2024-09-17T03:40:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.073+0000 7fbd302d3640 1 --2- 172.21.15.146:0/2118556211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280cefe0 0x7fbd280cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.073+0000 7fbd302d3640 1 --2- 172.21.15.146:0/2118556211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd280b7580 0x7fbd280ccbd0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.073+0000 7fbd302d3640 1 -- 172.21.15.146:0/2118556211 >> 172.21.15.146:0/2118556211 conn(0x7fbd2809ba20 msgr2=0x7fbd280b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.073+0000 7fbd302d3640 1 -- 172.21.15.146:0/2118556211 shutdown_connections 2024-09-17T03:40:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.073+0000 7fbd302d3640 1 -- 172.21.15.146:0/2118556211 wait complete. 2024-09-17T03:40:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.075+0000 7fbd302d3640 1 Processor -- start 2024-09-17T03:40:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.075+0000 7fbd302d3640 1 -- start start 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.076+0000 7fbd302d3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280b7580 0x7fbd281f6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.076+0000 7fbd302d3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd280cefe0 0x7fbd281e6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.076+0000 7fbd302d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd280d1190 0x7fbd280c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.076+0000 7fbd302d3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2806eef0 con 0x7fbd280d1190 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.076+0000 7fbd302d3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2806ed70 con 0x7fbd280cefe0 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.076+0000 7fbd302d3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbd280d15a0 con 0x7fbd280b7580 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.076+0000 7fbd2e870640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd280d1190 0x7fbd280c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.076+0000 7fbd2e870640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd280d1190 0x7fbd280c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50952/0 (socket says 172.21.15.146:50952) 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.076+0000 7fbd2e870640 1 -- 172.21.15.146:0/191738621 learned_addr learned my addr 172.21.15.146:0/191738621 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd2e870640 1 -- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280b7580 msgr2=0x7fbd281f6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd2d86e640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd280cefe0 0x7fbd281e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd2e870640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280b7580 0x7fbd281f6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd2e870640 1 -- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd280cefe0 msgr2=0x7fbd281e6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd2e870640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd280cefe0 0x7fbd281e6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd2e870640 1 -- 172.21.15.146:0/191738621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd280c6390 con 0x7fbd280d1190 2024-09-17T03:40:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd2d86e640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd280cefe0 0x7fbd281e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:40:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd2e870640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd280d1190 0x7fbd280c7ee0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c340 tx=0x7fbd2000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd26ffd640 1 -- 172.21.15.146:0/191738621 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20017070 con 0x7fbd280d1190 2024-09-17T03:40:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd26ffd640 1 -- 172.21.15.146:0/191738621 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd200035f0 con 0x7fbd280d1190 2024-09-17T03:40:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd302d3640 1 -- 172.21.15.146:0/191738621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd280c6670 con 0x7fbd280d1190 2024-09-17T03:40:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd26ffd640 1 -- 172.21.15.146:0/191738621 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20003a80 con 0x7fbd280d1190 2024-09-17T03:40:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.077+0000 7fbd302d3640 1 -- 172.21.15.146:0/191738621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd280c6c30 con 0x7fbd280d1190 2024-09-17T03:40:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.078+0000 7fbd302d3640 1 -- 172.21.15.146:0/191738621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd280c6100 con 0x7fbd280d1190 2024-09-17T03:40:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.079+0000 7fbd26ffd640 1 -- 172.21.15.146:0/191738621 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd2001a070 con 0x7fbd280d1190 2024-09-17T03:40:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.080+0000 7fbd26ffd640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd14078b90 0x7fbd1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.080+0000 7fbd26ffd640 1 -- 172.21.15.146:0/191738621 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4943+0+0 (secure 0 0 0) 0x7fbd2009a0d0 con 0x7fbd280d1190 2024-09-17T03:40:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.080+0000 7fbd2e06f640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd14078b90 0x7fbd1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.080+0000 7fbd2e06f640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd14078b90 0x7fbd1407b0a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbd18035000 tx=0x7fbd18004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:56.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.083+0000 7fbd26ffd640 1 -- 172.21.15.146:0/191738621 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd20021020 con 0x7fbd280d1190 2024-09-17T03:40:56.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.329+0000 7fbd302d3640 1 -- 172.21.15.146:0/191738621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7fbd280cfd50 con 0x7fbd280d1190 2024-09-17T03:40:56.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.620+0000 7fbd26ffd640 1 -- 172.21.15.146:0/191738621 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v379) ==== 144+0+0 (secure 0 0 0) 0x7fbd200628f0 con 0x7fbd280d1190 2024-09-17T03:40:56.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 -- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd14078b90 msgr2=0x7fbd1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd14078b90 0x7fbd1407b0a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbd18035000 tx=0x7fbd18004a40 comp rx=0 tx=0).stop 2024-09-17T03:40:56.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 -- 172.21.15.146:0/191738621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd280d1190 msgr2=0x7fbd280c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd280d1190 0x7fbd280c7ee0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c340 tx=0x7fbd2000c800 comp rx=0 tx=0).stop 2024-09-17T03:40:56.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 -- 172.21.15.146:0/191738621 shutdown_connections 2024-09-17T03:40:56.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd14078b90 0x7fbd1407b0a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd280d1190 0x7fbd280c7ee0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd280cefe0 0x7fbd281e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 --2- 172.21.15.146:0/191738621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd280b7580 0x7fbd281f6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 -- 172.21.15.146:0/191738621 >> 172.21.15.146:0/191738621 conn(0x7fbd2809ba20 msgr2=0x7fbd280d2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:56.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 -- 172.21.15.146:0/191738621 shutdown_connections 2024-09-17T03:40:56.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.622+0000 7fbd302d3640 1 -- 172.21.15.146:0/191738621 wait complete. 2024-09-17T03:40:56.633 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-17T03:40:56.634 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-17T03:40:56.634 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:40:56.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.761+0000 7f657ec77640 1 -- 172.21.15.146:0/4264343291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65780b55f0 msgr2=0x7f6578070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.761+0000 7f657ec77640 1 --2- 172.21.15.146:0/4264343291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65780b55f0 0x7f6578070be0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f65780b0c50 tx=0x7f656802a580 comp rx=0 tx=0).stop 2024-09-17T03:40:56.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.761+0000 7f657ec77640 1 -- 172.21.15.146:0/4264343291 shutdown_connections 2024-09-17T03:40:56.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.761+0000 7f657ec77640 1 --2- 172.21.15.146:0/4264343291 >> v2:172.21.15.179:3300/0 conn(0x7f65780b4a70 0x7f657806dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.761+0000 7f657ec77640 1 --2- 172.21.15.146:0/4264343291 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6578071120 0x7f65780b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.761+0000 7f657ec77640 1 --2- 172.21.15.146:0/4264343291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65780b55f0 0x7f6578070be0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.761+0000 7f657ec77640 1 -- 172.21.15.146:0/4264343291 >> 172.21.15.146:0/4264343291 conn(0x7f65780b3410 msgr2=0x7f65780b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.761+0000 7f657ec77640 1 -- 172.21.15.146:0/4264343291 shutdown_connections 2024-09-17T03:40:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.761+0000 7f657ec77640 1 -- 172.21.15.146:0/4264343291 wait complete. 2024-09-17T03:40:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.762+0000 7f657ec77640 1 Processor -- start 2024-09-17T03:40:56.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.762+0000 7f657ec77640 1 -- start start 2024-09-17T03:40:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ec77640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6578071120 0x7f657813b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ec77640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65780b4a70 0x7f65781e5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ec77640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65780b55f0 0x7f65780b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ec77640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f657806e630 con 0x7f6578071120 2024-09-17T03:40:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ec77640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f657806e4b0 con 0x7f65780b55f0 2024-09-17T03:40:56.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ec77640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f657815bd10 con 0x7f65780b4a70 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ca13640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6578071120 0x7f657813b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ca13640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6578071120 0x7f657813b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50966/0 (socket says 172.21.15.146:50966) 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ca13640 1 -- 172.21.15.146:0/1986178222 learned_addr learned my addr 172.21.15.146:0/1986178222 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ca13640 1 -- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65780b4a70 msgr2=0x7f65781e5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ca13640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65780b4a70 0x7f65781e5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ca13640 1 -- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65780b55f0 msgr2=0x7f65780b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657d214640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65780b55f0 0x7f65780b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ca13640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65780b55f0 0x7f65780b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ca13640 1 -- 172.21.15.146:0/1986178222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657813dd80 con 0x7f6578071120 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.764+0000 7f657ca13640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6578071120 0x7f657813b560 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f6568034040 tx=0x7f65680039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.765+0000 7f65757fa640 1 -- 172.21.15.146:0/1986178222 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656803e030 con 0x7f6578071120 2024-09-17T03:40:56.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.765+0000 7f65757fa640 1 -- 172.21.15.146:0/1986178222 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65680047a0 con 0x7f6578071120 2024-09-17T03:40:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.765+0000 7f657ec77640 1 -- 172.21.15.146:0/1986178222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65781f3e10 con 0x7f6578071120 2024-09-17T03:40:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.765+0000 7f65757fa640 1 -- 172.21.15.146:0/1986178222 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568035040 con 0x7f6578071120 2024-09-17T03:40:56.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.765+0000 7f657ec77640 1 -- 172.21.15.146:0/1986178222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65781f43d0 con 0x7f6578071120 2024-09-17T03:40:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.766+0000 7f657ec77640 1 -- 172.21.15.146:0/1986178222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f657806dd60 con 0x7f6578071120 2024-09-17T03:40:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.766+0000 7f65757fa640 1 -- 172.21.15.146:0/1986178222 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6568041030 con 0x7f6578071120 2024-09-17T03:40:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.767+0000 7f65757fa640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6564078bc0 0x7f656407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.767+0000 7f65757fa640 1 -- 172.21.15.146:0/1986178222 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4943+0+0 (secure 0 0 0) 0x7f65680bb1d0 con 0x7f6578071120 2024-09-17T03:40:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.767+0000 7f6577fff640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6564078bc0 0x7f656407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.768+0000 7f6577fff640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6564078bc0 0x7f656407b0d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6578155e60 tx=0x7f656c006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:56.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.771+0000 7f65757fa640 1 -- 172.21.15.146:0/1986178222 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f65680839a0 con 0x7f6578071120 2024-09-17T03:40:56.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.947+0000 7f657ec77640 1 -- 172.21.15.146:0/1986178222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f657815e950 con 0x7f6578071120 2024-09-17T03:40:56.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.948+0000 7f65757fa640 1 -- 172.21.15.146:0/1986178222 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+13092 (secure 0 0 0) 0x7f65680b9e20 con 0x7f6578071120 2024-09-17T03:40:56.947 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:56.947 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":122,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:40:55.607740+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6833/2931720030":"2024-09-18T03:40:52.598747+0000","172.21.15.146:6832/2931720030":"2024-09-18T03:40:52.598747+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:40:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.950+0000 7f657ec77640 1 -- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6564078bc0 msgr2=0x7f656407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.950+0000 7f657ec77640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6564078bc0 0x7f656407b0d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6578155e60 tx=0x7f656c006bf0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.950+0000 7f657ec77640 1 -- 172.21.15.146:0/1986178222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6578071120 msgr2=0x7f657813b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.950+0000 7f657ec77640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6578071120 0x7f657813b560 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f6568034040 tx=0x7f65680039e0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.950+0000 7f657ec77640 1 -- 172.21.15.146:0/1986178222 shutdown_connections 2024-09-17T03:40:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.950+0000 7f657ec77640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6564078bc0 0x7f656407b0d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.950+0000 7f657ec77640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65780b55f0 0x7f65780b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.950+0000 7f657ec77640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65780b4a70 0x7f65781e5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.950+0000 7f657ec77640 1 --2- 172.21.15.146:0/1986178222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6578071120 0x7f657813b560 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:56.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.950+0000 7f657ec77640 1 -- 172.21.15.146:0/1986178222 >> 172.21.15.146:0/1986178222 conn(0x7f65780b3410 msgr2=0x7f6578075f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:56.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.950+0000 7f657ec77640 1 -- 172.21.15.146:0/1986178222 shutdown_connections 2024-09-17T03:40:56.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:56.951+0000 7f657ec77640 1 -- 172.21.15.146:0/1986178222 wait complete. 2024-09-17T03:40:56.962 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:40:56.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:40:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.079+0000 7f351f3df640 1 -- 172.21.15.146:0/2626034168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180b5ce0 msgr2=0x7f35180b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.079+0000 7f351f3df640 1 --2- 172.21.15.146:0/2626034168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180b5ce0 0x7f35180b1320 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f35180b8440 tx=0x7f351002a560 comp rx=0 tx=0).stop 2024-09-17T03:40:57.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.079+0000 7f351f3df640 1 -- 172.21.15.146:0/2626034168 shutdown_connections 2024-09-17T03:40:57.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.079+0000 7f351f3df640 1 --2- 172.21.15.146:0/2626034168 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35180b3b60 0x7f35180b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.079+0000 7f351f3df640 1 --2- 172.21.15.146:0/2626034168 >> v2:172.21.15.179:3300/0 conn(0x7f35180b5750 0x7f35180b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.079+0000 7f351f3df640 1 --2- 172.21.15.146:0/2626034168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180b5ce0 0x7f35180b1320 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.079+0000 7f351f3df640 1 -- 172.21.15.146:0/2626034168 >> 172.21.15.146:0/2626034168 conn(0x7f35180b7b20 msgr2=0x7f351809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.079+0000 7f351f3df640 1 -- 172.21.15.146:0/2626034168 shutdown_connections 2024-09-17T03:40:57.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.079+0000 7f351f3df640 1 -- 172.21.15.146:0/2626034168 wait complete. 2024-09-17T03:40:57.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.081+0000 7f351f3df640 1 Processor -- start 2024-09-17T03:40:57.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.081+0000 7f351f3df640 1 -- start start 2024-09-17T03:40:57.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351f3df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35180b3b60 0x7f3518147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351f3df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180b5750 0x7f35181f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351f3df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35180b5ce0 0x7f35181f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351f3df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f35180b2970 con 0x7f35180b5750 2024-09-17T03:40:57.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351f3df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f35180b27f0 con 0x7f35180b5ce0 2024-09-17T03:40:57.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351f3df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f35180b2af0 con 0x7f35180b3b60 2024-09-17T03:40:57.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351c97a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180b5750 0x7f35181f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351c97a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180b5750 0x7f35181f6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50980/0 (socket says 172.21.15.146:50980) 2024-09-17T03:40:57.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351c97a640 1 -- 172.21.15.146:0/3667154529 learned_addr learned my addr 172.21.15.146:0/3667154529 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:57.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351d17b640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35180b3b60 0x7f3518147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351d97c640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35180b5ce0 0x7f35181f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351c97a640 1 -- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35180b3b60 msgr2=0x7f3518147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351c97a640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35180b3b60 0x7f3518147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351c97a640 1 -- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35180b5ce0 msgr2=0x7f35181f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351c97a640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35180b5ce0 0x7f35181f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.082+0000 7f351c97a640 1 -- 172.21.15.146:0/3667154529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3518153c50 con 0x7f35180b5750 2024-09-17T03:40:57.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.083+0000 7f351c97a640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180b5750 0x7f35181f6f70 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c970 tx=0x7f350c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.083+0000 7f3515ffb640 1 -- 172.21.15.146:0/3667154529 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c004220 con 0x7f35180b5750 2024-09-17T03:40:57.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.083+0000 7f3515ffb640 1 -- 172.21.15.146:0/3667154529 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f350c0044b0 con 0x7f35180b5750 2024-09-17T03:40:57.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.083+0000 7f351f3df640 1 -- 172.21.15.146:0/3667154529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3518153690 con 0x7f35180b5750 2024-09-17T03:40:57.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.083+0000 7f3515ffb640 1 -- 172.21.15.146:0/3667154529 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c007c10 con 0x7f35180b5750 2024-09-17T03:40:57.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.083+0000 7f351f3df640 1 -- 172.21.15.146:0/3667154529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f351815cb40 con 0x7f35180b5750 2024-09-17T03:40:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.084+0000 7f351f3df640 1 -- 172.21.15.146:0/3667154529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35180b3620 con 0x7f35180b5750 2024-09-17T03:40:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.085+0000 7f3515ffb640 1 -- 172.21.15.146:0/3667154529 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f350c003610 con 0x7f35180b5750 2024-09-17T03:40:57.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.085+0000 7f3515ffb640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3504078bc0 0x7f350407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.085+0000 7f3515ffb640 1 -- 172.21.15.146:0/3667154529 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4943+0+0 (secure 0 0 0) 0x7f350c09acf0 con 0x7f35180b5750 2024-09-17T03:40:57.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.086+0000 7f351d17b640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3504078bc0 0x7f350407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.086+0000 7f351d17b640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3504078bc0 0x7f350407b0d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3510033000 tx=0x7f3510004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.090+0000 7f3515ffb640 1 -- 172.21.15.146:0/3667154529 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f350c09f070 con 0x7f35180b5750 2024-09-17T03:40:57.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.265+0000 7f351f3df640 1 -- 172.21.15.146:0/3667154529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f351815bc20 con 0x7f35180b5750 2024-09-17T03:40:57.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.266+0000 7f3515ffb640 1 -- 172.21.15.146:0/3667154529 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v122) ==== 93+0+10 (secure 0 0 0) 0x7f350c014030 con 0x7f35180b5750 2024-09-17T03:40:57.265 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:40:57.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 -- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3504078bc0 msgr2=0x7f350407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3504078bc0 0x7f350407b0d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3510033000 tx=0x7f3510004730 comp rx=0 tx=0).stop 2024-09-17T03:40:57.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 -- 172.21.15.146:0/3667154529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180b5750 msgr2=0x7f35181f6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180b5750 0x7f35181f6f70 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c970 tx=0x7f350c00ce30 comp rx=0 tx=0).stop 2024-09-17T03:40:57.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 -- 172.21.15.146:0/3667154529 shutdown_connections 2024-09-17T03:40:57.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3504078bc0 0x7f350407b0d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35180b5ce0 0x7f35181f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35180b5750 0x7f35181f6f70 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 --2- 172.21.15.146:0/3667154529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35180b3b60 0x7f3518147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 -- 172.21.15.146:0/3667154529 >> 172.21.15.146:0/3667154529 conn(0x7f35180b7b20 msgr2=0x7f35180b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 -- 172.21.15.146:0/3667154529 shutdown_connections 2024-09-17T03:40:57.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.268+0000 7f351f3df640 1 -- 172.21.15.146:0/3667154529 wait complete. 2024-09-17T03:40:57.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-17T03:40:57.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.393+0000 7f620552b640 1 -- 172.21.15.146:0/3793323219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62000b3870 msgr2=0x7f62000cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.393+0000 7f620552b640 1 --2- 172.21.15.146:0/3793323219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62000b3870 0x7f62000cf370 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f6200069ce0 tx=0x7f61f002a970 comp rx=0 tx=0).stop 2024-09-17T03:40:57.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.393+0000 7f620552b640 1 -- 172.21.15.146:0/3793323219 shutdown_connections 2024-09-17T03:40:57.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.393+0000 7f620552b640 1 --2- 172.21.15.146:0/3793323219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f620006f270 0x7f62001628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.393+0000 7f620552b640 1 --2- 172.21.15.146:0/3793323219 >> v2:172.21.15.179:3300/0 conn(0x7f62001620f0 0x7f620006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.393+0000 7f620552b640 1 --2- 172.21.15.146:0/3793323219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62000b3870 0x7f62000cf370 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.393+0000 7f620552b640 1 -- 172.21.15.146:0/3793323219 >> 172.21.15.146:0/3793323219 conn(0x7f62000d4be0 msgr2=0x7f62000d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:57.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.393+0000 7f620552b640 1 -- 172.21.15.146:0/3793323219 shutdown_connections 2024-09-17T03:40:57.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.393+0000 7f620552b640 1 -- 172.21.15.146:0/3793323219 wait complete. 2024-09-17T03:40:57.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.395+0000 7f620552b640 1 Processor -- start 2024-09-17T03:40:57.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.395+0000 7f620552b640 1 -- start start 2024-09-17T03:40:57.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f620552b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620006f270 0x7f620015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f620552b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b3870 0x7f620014fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f620552b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62001620f0 0x7f620014ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f620552b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6200163170 con 0x7f620006f270 2024-09-17T03:40:57.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f620552b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6200162ff0 con 0x7f62000b3870 2024-09-17T03:40:57.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f620552b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f62001632f0 con 0x7f62001620f0 2024-09-17T03:40:57.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61feffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620006f270 0x7f620015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61feffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620006f270 0x7f620015cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34668/0 (socket says 172.21.15.146:34668) 2024-09-17T03:40:57.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61feffd640 1 -- 172.21.15.146:0/3754479507 learned_addr learned my addr 172.21.15.146:0/3754479507 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:57.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61ff7fe640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62001620f0 0x7f620014ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61fe7fc640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b3870 0x7f620014fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61feffd640 1 -- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62001620f0 msgr2=0x7f620014ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61feffd640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62001620f0 0x7f620014ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61feffd640 1 -- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b3870 msgr2=0x7f620014fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:57.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61feffd640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b3870 0x7f620014fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:57.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61feffd640 1 -- 172.21.15.146:0/3754479507 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62000ceba0 con 0x7f620006f270 2024-09-17T03:40:57.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61fe7fc640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b3870 0x7f620014fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:57.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.396+0000 7f61ff7fe640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62001620f0 0x7f620014ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:40:57.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.397+0000 7f61feffd640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620006f270 0x7f620015cfb0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f61f0000f80 tx=0x7f61f0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.397+0000 7f61f77fe640 1 -- 172.21.15.146:0/3754479507 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0034040 con 0x7f620006f270 2024-09-17T03:40:57.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.397+0000 7f61f77fe640 1 -- 172.21.15.146:0/3754479507 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61f0004640 con 0x7f620006f270 2024-09-17T03:40:57.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.397+0000 7f620552b640 1 -- 172.21.15.146:0/3754479507 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62000cee80 con 0x7f620006f270 2024-09-17T03:40:57.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.397+0000 7f61f77fe640 1 -- 172.21.15.146:0/3754479507 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0045480 con 0x7f620006f270 2024-09-17T03:40:57.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.397+0000 7f620552b640 1 -- 172.21.15.146:0/3754479507 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620014dd20 con 0x7f620006f270 2024-09-17T03:40:57.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.398+0000 7f620552b640 1 -- 172.21.15.146:0/3754479507 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62000cf370 con 0x7f620006f270 2024-09-17T03:40:57.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.398+0000 7f61f77fe640 1 -- 172.21.15.146:0/3754479507 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61f0037020 con 0x7f620006f270 2024-09-17T03:40:57.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.399+0000 7f61f77fe640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f61e0078b90 0x7f61e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:57.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.399+0000 7f61f77fe640 1 -- 172.21.15.146:0/3754479507 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4943+0+0 (secure 0 0 0) 0x7f61f00bc3f0 con 0x7f620006f270 2024-09-17T03:40:57.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.399+0000 7f61fe7fc640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f61e0078b90 0x7f61e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:57.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.400+0000 7f61fe7fc640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f61e0078b90 0x7f61e007b0a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f61e8005d70 tx=0x7f61e8005d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:57.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.403+0000 7f61f77fe640 1 -- 172.21.15.146:0/3754479507 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f61f0084b30 con 0x7f620006f270 2024-09-17T03:40:57.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:57.646+0000 7f620552b640 1 -- 172.21.15.146:0/3754479507 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f62000d2bd0 con 0x7f620006f270 2024-09-17T03:40:58.336 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:40:58.339 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:40:58.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.629+0000 7f61f77fe640 1 -- 172.21.15.146:0/3754479507 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v381) ==== 158+0+0 (secure 0 0 0) 0x7f61f0084430 con 0x7f620006f270 2024-09-17T03:40:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 -- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f61e0078b90 msgr2=0x7f61e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f61e0078b90 0x7f61e007b0a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f61e8005d70 tx=0x7f61e8005d00 comp rx=0 tx=0).stop 2024-09-17T03:40:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 -- 172.21.15.146:0/3754479507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620006f270 msgr2=0x7f620015cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620006f270 0x7f620015cfb0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f61f0000f80 tx=0x7f61f0003f90 comp rx=0 tx=0).stop 2024-09-17T03:40:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 -- 172.21.15.146:0/3754479507 shutdown_connections 2024-09-17T03:40:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f61e0078b90 0x7f61e007b0a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62001620f0 0x7f620014ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62000b3870 0x7f620014fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 --2- 172.21.15.146:0/3754479507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f620006f270 0x7f620015cfb0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 -- 172.21.15.146:0/3754479507 >> 172.21.15.146:0/3754479507 conn(0x7f62000d4be0 msgr2=0x7f62000b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 -- 172.21.15.146:0/3754479507 shutdown_connections 2024-09-17T03:40:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.632+0000 7f620552b640 1 -- 172.21.15.146:0/3754479507 wait complete. 2024-09-17T03:40:58.646 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:40:58.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.768+0000 7f85fe1da640 1 -- 172.21.15.146:0/3266959284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85e4004800 msgr2=0x7f85e4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.768+0000 7f85fe1da640 1 --2- 172.21.15.146:0/3266959284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85e4004800 0x7f85e4004c10 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f85e0006f60 tx=0x7f85e4005830 comp rx=0 tx=0).stop 2024-09-17T03:40:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.768+0000 7f85f7fff640 1 -- 172.21.15.146:0/3266959284 reap_dead start 2024-09-17T03:40:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.768+0000 7f85fe1da640 1 -- 172.21.15.146:0/3266959284 shutdown_connections 2024-09-17T03:40:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.768+0000 7f85fe1da640 1 -- 172.21.15.146:0/3266959284 >> 172.21.15.146:0/3266959284 conn(0x7f85f80b3410 msgr2=0x7f85f80b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.768+0000 7f85fe1da640 1 -- 172.21.15.146:0/3266959284 shutdown_connections 2024-09-17T03:40:58.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.768+0000 7f85fe1da640 1 -- 172.21.15.146:0/3266959284 wait complete. 2024-09-17T03:40:58.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.770+0000 7f85fe1da640 1 Processor -- start 2024-09-17T03:40:58.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.770+0000 7f85fe1da640 1 -- start start 2024-09-17T03:40:58.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.771+0000 7f85fe1da640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85e4004800 0x7f85f8153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:58.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.771+0000 7f85fe1da640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85f81f2e70 0x7f85f81f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:58.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.771+0000 7f85fe1da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85f81f57b0 0x7f85f81f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:58.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.771+0000 7f85fe1da640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f85f80b5c10 con 0x7f85e4004800 2024-09-17T03:40:58.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.771+0000 7f85fe1da640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f85f806e680 con 0x7f85f81f57b0 2024-09-17T03:40:58.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.771+0000 7f85fe1da640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f85f80b4940 con 0x7f85f81f2e70 2024-09-17T03:40:58.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.771+0000 7f85f77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85e4004800 0x7f85f8153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:58.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.771+0000 7f85f77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85e4004800 0x7f85f8153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34684/0 (socket says 172.21.15.146:34684) 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.771+0000 7f85f77fe640 1 -- 172.21.15.146:0/633915496 learned_addr learned my addr 172.21.15.146:0/633915496 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85f7fff640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85f81f57b0 0x7f85f81f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.771+0000 7f85eeffd640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85f81f2e70 0x7f85f81f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85f77fe640 1 -- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85f81f2e70 msgr2=0x7f85f81f1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85f77fe640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85f81f2e70 0x7f85f81f1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85f77fe640 1 -- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85f81f57b0 msgr2=0x7f85f81f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85f77fe640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85f81f57b0 0x7f85f81f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85f77fe640 1 -- 172.21.15.146:0/633915496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f81f6100 con 0x7f85e4004800 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85f77fe640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85e4004800 0x7f85f8153090 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f85e8003f50 tx=0x7f85e800f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85f4ff9640 1 -- 172.21.15.146:0/633915496 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8015070 con 0x7f85e4004800 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85f4ff9640 1 -- 172.21.15.146:0/633915496 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85e8011840 con 0x7f85e4004800 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85f4ff9640 1 -- 172.21.15.146:0/633915496 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8011c70 con 0x7f85e4004800 2024-09-17T03:40:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85fe1da640 1 -- 172.21.15.146:0/633915496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f80cf930 con 0x7f85e4004800 2024-09-17T03:40:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.772+0000 7f85fe1da640 1 -- 172.21.15.146:0/633915496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f80cfef0 con 0x7f85e4004800 2024-09-17T03:40:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.773+0000 7f85fe1da640 1 -- 172.21.15.146:0/633915496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f806dd60 con 0x7f85e4004800 2024-09-17T03:40:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.774+0000 7f85f4ff9640 1 -- 172.21.15.146:0/633915496 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f85e80103c0 con 0x7f85e4004800 2024-09-17T03:40:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.774+0000 7f85f4ff9640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85d8078bc0 0x7f85d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.774+0000 7f85f4ff9640 1 -- 172.21.15.146:0/633915496 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4943+0+0 (secure 0 0 0) 0x7f85e809b480 con 0x7f85e4004800 2024-09-17T03:40:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.775+0000 7f85eeffd640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85d8078bc0 0x7f85d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.775+0000 7f85eeffd640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85d8078bc0 0x7f85d807b0d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f85e0033000 tx=0x7f85e0038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:58.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.779+0000 7f85f4ff9640 1 -- 172.21.15.146:0/633915496 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f85f81f6100 con 0x7f85e4004800 2024-09-17T03:40:58.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.961+0000 7f85fe1da640 1 -- 172.21.15.146:0/633915496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f85f8075610 con 0x7f85e4004800 2024-09-17T03:40:58.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.962+0000 7f85f4ff9640 1 -- 172.21.15.146:0/633915496 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v53) ==== 59+0+2294 (secure 0 0 0) 0x7f85e8063580 con 0x7f85e4004800 2024-09-17T03:40:58.962 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:40:58.962 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:40:58.962 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:40:58.962 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:40:58.962 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:40:58.962 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:40:58.962 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:40:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:40:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:40:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:40:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:40:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:40:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:40:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:40:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:40:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:40:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:40:58.963 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:40:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:40:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:40:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:40:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:40:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:40:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:40:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:40:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:40:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:40:58.964 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:40:58.965 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:40:58.965 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:40:58.965 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:40:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 -- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85d8078bc0 msgr2=0x7f85d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85d8078bc0 0x7f85d807b0d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f85e0033000 tx=0x7f85e0038040 comp rx=0 tx=0).stop 2024-09-17T03:40:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 -- 172.21.15.146:0/633915496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85e4004800 msgr2=0x7f85f8153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85e4004800 0x7f85f8153090 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f85e8003f50 tx=0x7f85e800f7e0 comp rx=0 tx=0).stop 2024-09-17T03:40:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 -- 172.21.15.146:0/633915496 shutdown_connections 2024-09-17T03:40:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85d8078bc0 0x7f85d807b0d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:58.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85f81f57b0 0x7f85f81f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:58.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85f81f2e70 0x7f85f81f1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:58.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 --2- 172.21.15.146:0/633915496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85e4004800 0x7f85f8153090 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:58.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 -- 172.21.15.146:0/633915496 >> 172.21.15.146:0/633915496 conn(0x7f85f80b3410 msgr2=0x7f85f815f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:58.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 -- 172.21.15.146:0/633915496 shutdown_connections 2024-09-17T03:40:58.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:58.964+0000 7f85fe1da640 1 -- 172.21.15.146:0/633915496 wait complete. 2024-09-17T03:40:58.978 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:40:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.100+0000 7f585464d640 1 -- 172.21.15.146:0/1892614735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5834003a00 msgr2=0x7f5834003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.100+0000 7f585464d640 1 --2- 172.21.15.146:0/1892614735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5834003a00 0x7f5834003e30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5844006fc0 tx=0x7f5834005830 comp rx=0 tx=0).stop 2024-09-17T03:40:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.100+0000 7f585464d640 1 -- 172.21.15.146:0/1892614735 shutdown_connections 2024-09-17T03:40:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.100+0000 7f585464d640 1 --2- 172.21.15.146:0/1892614735 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5834003a00 0x7f5834003e30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.100+0000 7f585464d640 1 -- 172.21.15.146:0/1892614735 >> 172.21.15.146:0/1892614735 conn(0x7f584c0b3510 msgr2=0x7f584c0b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.100+0000 7f585464d640 1 -- 172.21.15.146:0/1892614735 shutdown_connections 2024-09-17T03:40:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.100+0000 7f585464d640 1 -- 172.21.15.146:0/1892614735 wait complete. 2024-09-17T03:40:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.102+0000 7f585464d640 1 Processor -- start 2024-09-17T03:40:59.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.102+0000 7f585464d640 1 -- start start 2024-09-17T03:40:59.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.103+0000 7f585464d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834003a00 0x7f584c1e7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.103+0000 7f585464d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c154630 0x7f584c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.103+0000 7f585464d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c147ef0 0x7f584c148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.103+0000 7f585464d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f584c15c930 con 0x7f5834003a00 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.103+0000 7f585464d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f584c15c7b0 con 0x7f584c154630 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.103+0000 7f585464d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f584c15cab0 con 0x7f584c147ef0 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.103+0000 7f58523e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834003a00 0x7f584c1e7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.103+0000 7f58523e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834003a00 0x7f584c1e7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34710/0 (socket says 172.21.15.146:34710) 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.103+0000 7f58523e9640 1 -- 172.21.15.146:0/160393862 learned_addr learned my addr 172.21.15.146:0/160393862 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.103+0000 7f5852bea640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c147ef0 0x7f584c148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.103+0000 7f5851be8640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c154630 0x7f584c154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.104+0000 7f58523e9640 1 -- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c147ef0 msgr2=0x7f584c148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.104+0000 7f58523e9640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c147ef0 0x7f584c148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.104+0000 7f58523e9640 1 -- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c154630 msgr2=0x7f584c154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.104+0000 7f58523e9640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c154630 0x7f584c154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.104+0000 7f58523e9640 1 -- 172.21.15.146:0/160393862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c1507a0 con 0x7f5834003a00 2024-09-17T03:40:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.104+0000 7f58523e9640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834003a00 0x7f584c1e7c00 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f5844000f60 tx=0x7f5844001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.104+0000 7f584affd640 1 -- 172.21.15.146:0/160393862 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844032030 con 0x7f5834003a00 2024-09-17T03:40:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.104+0000 7f584affd640 1 -- 172.21.15.146:0/160393862 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58440037f0 con 0x7f5834003a00 2024-09-17T03:40:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.104+0000 7f584affd640 1 -- 172.21.15.146:0/160393862 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844003bc0 con 0x7f5834003a00 2024-09-17T03:40:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.104+0000 7f585464d640 1 -- 172.21.15.146:0/160393862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f584c148840 con 0x7f5834003a00 2024-09-17T03:40:59.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.104+0000 7f585464d640 1 -- 172.21.15.146:0/160393862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f584c14f9e0 con 0x7f5834003a00 2024-09-17T03:40:59.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.105+0000 7f585464d640 1 -- 172.21.15.146:0/160393862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f584c0737b0 con 0x7f5834003a00 2024-09-17T03:40:59.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.106+0000 7f584affd640 1 -- 172.21.15.146:0/160393862 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5844035020 con 0x7f5834003a00 2024-09-17T03:40:59.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.107+0000 7f584affd640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5838078b90 0x7f583807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:59.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.107+0000 7f584affd640 1 -- 172.21.15.146:0/160393862 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4943+0+0 (secure 0 0 0) 0x7f58440bb680 con 0x7f5834003a00 2024-09-17T03:40:59.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.107+0000 7f5851be8640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5838078b90 0x7f583807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:59.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.107+0000 7f5851be8640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5838078b90 0x7f583807b0a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f584c14f530 tx=0x7f5840006e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:59.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.111+0000 7f584affd640 1 -- 172.21.15.146:0/160393862 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5844047060 con 0x7f5834003a00 2024-09-17T03:40:59.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.294+0000 7f585464d640 1 -- 172.21.15.146:0/160393862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f584c070d60 con 0x7f5834003a00 2024-09-17T03:40:59.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.298+0000 7f584affd640 1 -- 172.21.15.146:0/160393862 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v54)=0 v54) ==== 122+0+0 (secure 0 0 0) 0x7f5844083dc0 con 0x7f5834003a00 2024-09-17T03:40:59.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 -- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5838078b90 msgr2=0x7f583807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5838078b90 0x7f583807b0a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f584c14f530 tx=0x7f5840006e90 comp rx=0 tx=0).stop 2024-09-17T03:40:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 -- 172.21.15.146:0/160393862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834003a00 msgr2=0x7f584c1e7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834003a00 0x7f584c1e7c00 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f5844000f60 tx=0x7f5844001da0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 -- 172.21.15.146:0/160393862 shutdown_connections 2024-09-17T03:40:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5838078b90 0x7f583807b0a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f584c147ef0 0x7f584c148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f584c154630 0x7f584c154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 --2- 172.21.15.146:0/160393862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834003a00 0x7f584c1e7c00 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 -- 172.21.15.146:0/160393862 >> 172.21.15.146:0/160393862 conn(0x7f584c0b3510 msgr2=0x7f584c15b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 -- 172.21.15.146:0/160393862 shutdown_connections 2024-09-17T03:40:59.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.300+0000 7f585464d640 1 -- 172.21.15.146:0/160393862 wait complete. 2024-09-17T03:40:59.311 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:40:59.311 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:59.349 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:40:59.395 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:40:59.395 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:40:59.395 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:59.412 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:40:59.412 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:40:59.412 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:59.430 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:59.431 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:40:59.431 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:59.469 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:40:59.469 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:40:59.469 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:40:59.488 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:40:59.488 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:40:59.488 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:40:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.626+0000 7f6b1164d640 1 -- 172.21.15.146:0/3512904464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b0c0b5ce0 msgr2=0x7f6b0c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.626+0000 7f6b1164d640 1 --2- 172.21.15.146:0/3512904464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b0c0b5ce0 0x7f6b0c0b1320 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009830 tx=0x7f6af402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.626+0000 7f6b1164d640 1 -- 172.21.15.146:0/3512904464 shutdown_connections 2024-09-17T03:40:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.626+0000 7f6b1164d640 1 --2- 172.21.15.146:0/3512904464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b0c0b5ce0 0x7f6b0c0b1320 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.626+0000 7f6b1164d640 1 -- 172.21.15.146:0/3512904464 >> 172.21.15.146:0/3512904464 conn(0x7f6b0c0b7b20 msgr2=0x7f6b0c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.626+0000 7f6b1164d640 1 -- 172.21.15.146:0/3512904464 shutdown_connections 2024-09-17T03:40:59.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.626+0000 7f6b1164d640 1 -- 172.21.15.146:0/3512904464 wait complete. 2024-09-17T03:40:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.628+0000 7f6b1164d640 1 Processor -- start 2024-09-17T03:40:59.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.628+0000 7f6b1164d640 1 -- start start 2024-09-17T03:40:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b1164d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b0c0b5750 0x7f6b0c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b1164d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b0c0b5ce0 0x7f6b0c147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b1164d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c09e650 0x7f6b0c09d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b1164d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c15d680 con 0x7f6b0c0b5750 2024-09-17T03:40:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b1164d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c15d500 con 0x7f6b0c0b5ce0 2024-09-17T03:40:59.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b1164d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c15d800 con 0x7f6b0c09e650 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b0affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b0c0b5750 0x7f6b0c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b0affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b0c0b5750 0x7f6b0c154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34726/0 (socket says 172.21.15.146:34726) 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b0affd640 1 -- 172.21.15.146:0/3741989622 learned_addr learned my addr 172.21.15.146:0/3741989622 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b0a7fc640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b0c0b5ce0 0x7f6b0c147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b0b7fe640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c09e650 0x7f6b0c09d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b0affd640 1 -- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c09e650 msgr2=0x7f6b0c09d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b0affd640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c09e650 0x7f6b0c09d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b0affd640 1 -- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b0c0b5ce0 msgr2=0x7f6b0c147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b0affd640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b0c0b5ce0 0x7f6b0c147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.629+0000 7f6b0affd640 1 -- 172.21.15.146:0/3741989622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c154b90 con 0x7f6b0c0b5750 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.630+0000 7f6b0affd640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b0c0b5750 0x7f6b0c154650 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009950 tx=0x7f6af4033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.630+0000 7f6b037fe640 1 -- 172.21.15.146:0/3741989622 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4031d60 con 0x7f6b0c0b5750 2024-09-17T03:40:59.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.630+0000 7f6b037fe640 1 -- 172.21.15.146:0/3741989622 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6af40330d0 con 0x7f6b0c0b5750 2024-09-17T03:40:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.630+0000 7f6b1164d640 1 -- 172.21.15.146:0/3741989622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c09c890 con 0x7f6b0c0b5750 2024-09-17T03:40:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.630+0000 7f6b037fe640 1 -- 172.21.15.146:0/3741989622 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4033520 con 0x7f6b0c0b5750 2024-09-17T03:40:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.630+0000 7f6b1164d640 1 -- 172.21.15.146:0/3741989622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c09ce50 con 0x7f6b0c0b5750 2024-09-17T03:40:59.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.631+0000 7f6b1164d640 1 -- 172.21.15.146:0/3741989622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0c15dd60 con 0x7f6b0c0b5750 2024-09-17T03:40:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.634+0000 7f6b037fe640 1 -- 172.21.15.146:0/3741989622 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6af40035f0 con 0x7f6b0c0b5750 2024-09-17T03:40:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.634+0000 7f6b037fe640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6aec078b90 0x7f6aec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:40:59.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.635+0000 7f6b037fe640 1 -- 172.21.15.146:0/3741989622 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4943+0+0 (secure 0 0 0) 0x7f6af40bc4a0 con 0x7f6b0c0b5750 2024-09-17T03:40:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.635+0000 7f6b0a7fc640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6aec078b90 0x7f6aec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:40:59.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.635+0000 7f6b0a7fc640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6aec078b90 0x7f6aec07b0a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c157650 tx=0x7f6afc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:40:59.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.638+0000 7f6b037fe640 1 -- 172.21.15.146:0/3741989622 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6af4051020 con 0x7f6b0c0b5750 2024-09-17T03:40:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.861+0000 7f6b1164d640 1 -- 172.21.15.146:0/3741989622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b0c15bf00 con 0x7f6b0c0b5750 2024-09-17T03:40:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.861+0000 7f6b037fe640 1 -- 172.21.15.146:0/3741989622 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+3923 (secure 0 0 0) 0x7f6af403f030 con 0x7f6b0c0b5750 2024-09-17T03:40:59.860 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:40:59.861 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":89,"btime":"2024-09-17T03:40:53:600485+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6767,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1732967634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1732967634},{"type":"v1","addr":"172.21.15.146:6835","nonce":1732967634}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":6776,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2315176305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2315176305},{"type":"v1","addr":"172.21.15.179:6837","nonce":2315176305}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":7381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1700206363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1700206363},{"type":"v1","addr":"172.21.15.179:6836","nonce":1700206363}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":8568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1403948502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1403948502},{"type":"v1","addr":"172.21.15.146:6833","nonce":1403948502}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[]} 2024-09-17T03:40:59.861 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 89 2024-09-17T03:40:59.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 -- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6aec078b90 msgr2=0x7f6aec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6aec078b90 0x7f6aec07b0a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c157650 tx=0x7f6afc009040 comp rx=0 tx=0).stop 2024-09-17T03:40:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 -- 172.21.15.146:0/3741989622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b0c0b5750 msgr2=0x7f6b0c154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:40:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b0c0b5750 0x7f6b0c154650 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009950 tx=0x7f6af4033d60 comp rx=0 tx=0).stop 2024-09-17T03:40:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 -- 172.21.15.146:0/3741989622 shutdown_connections 2024-09-17T03:40:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6aec078b90 0x7f6aec07b0a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b0c09e650 0x7f6b0c09d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b0c0b5ce0 0x7f6b0c147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 --2- 172.21.15.146:0/3741989622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b0c0b5750 0x7f6b0c154650 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:40:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 -- 172.21.15.146:0/3741989622 >> 172.21.15.146:0/3741989622 conn(0x7f6b0c0b7b20 msgr2=0x7f6b0c15caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:40:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 -- 172.21.15.146:0/3741989622 shutdown_connections 2024-09-17T03:40:59.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:40:59.863+0000 7f6b1164d640 1 -- 172.21.15.146:0/3741989622 wait complete. 2024-09-17T03:40:59.874 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:40:59.874 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:40:59.874 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:40:59.875 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:59.875 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:40:59.875 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:40:59.875 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:40:59.875 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:59.875 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:40:59.875 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:40:59.876 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:40:59.876 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:59.876 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:40:59.876 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:40:59.876 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:40:59.876 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:40:59.884 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:40:59.884 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:40:59.887 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:40:59.887 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:40:59.888 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:40:59.888 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:40:59.889 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:40:59.890 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:40:59.930 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:40:59.930 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:59.931 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:40:59.931 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:59.932 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:40:59.932 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:59.933 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:40:59.933 DEBUG:teuthology.parallel:result is None 2024-09-17T03:40:59.933 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:41:00.022 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:41:00.022 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:41:00.024 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:41:00.025 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:41:00.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.057+0000 7f49bf215640 1 -- 172.21.15.146:0/292780667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b80d0710 msgr2=0x7f49b80cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:00.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.057+0000 7f49bf215640 1 --2- 172.21.15.146:0/292780667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b80d0710 0x7f49b80cf170 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f49ac009830 tx=0x7f49ac02a480 comp rx=0 tx=0).stop 2024-09-17T03:41:00.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.057+0000 7f49bf215640 1 -- 172.21.15.146:0/292780667 shutdown_connections 2024-09-17T03:41:00.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.057+0000 7f49bf215640 1 --2- 172.21.15.146:0/292780667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80b47c0 0x7f49b8161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:00.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.057+0000 7f49bf215640 1 --2- 172.21.15.146:0/292780667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b80d0710 0x7f49b80cf170 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:00.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.057+0000 7f49bf215640 1 -- 172.21.15.146:0/292780667 >> 172.21.15.146:0/292780667 conn(0x7f49b809ba20 msgr2=0x7f49b80b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:00.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.057+0000 7f49bf215640 1 -- 172.21.15.146:0/292780667 shutdown_connections 2024-09-17T03:41:00.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.057+0000 7f49bf215640 1 -- 172.21.15.146:0/292780667 wait complete. 2024-09-17T03:41:00.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.059+0000 7f49bf215640 1 Processor -- start 2024-09-17T03:41:00.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.059+0000 7f49bf215640 1 -- start start 2024-09-17T03:41:00.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.060+0000 7f49bf215640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b80b47c0 0x7f49b8156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:00.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.060+0000 7f49bf215640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80cf6b0 0x7f49b81f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:00.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.060+0000 7f49bf215640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b80d0710 0x7f49b81f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:00.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.060+0000 7f49bf215640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f49b80b1de0 con 0x7f49b80d0710 2024-09-17T03:41:00.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.060+0000 7f49bf215640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49b8162080 con 0x7f49b80b47c0 2024-09-17T03:41:00.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.060+0000 7f49bf215640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f49b80b1f60 con 0x7f49b80cf6b0 2024-09-17T03:41:00.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.060+0000 7f49bd7b2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b80d0710 0x7f49b81f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:00.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.060+0000 7f49bd7b2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b80d0710 0x7f49b81f6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34764/0 (socket says 172.21.15.146:34764) 2024-09-17T03:41:00.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.060+0000 7f49bd7b2640 1 -- 172.21.15.146:0/999452662 learned_addr learned my addr 172.21.15.146:0/999452662 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:00.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49bcfb1640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b80b47c0 0x7f49b8156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:00.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49b7fff640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80cf6b0 0x7f49b81f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:00.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49bd7b2640 1 -- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80cf6b0 msgr2=0x7f49b81f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:00.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49bd7b2640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80cf6b0 0x7f49b81f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:00.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49bd7b2640 1 -- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b80b47c0 msgr2=0x7f49b8156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:00.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49bd7b2640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b80b47c0 0x7f49b8156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:00.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49bd7b2640 1 -- 172.21.15.146:0/999452662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b815a900 con 0x7f49b80d0710 2024-09-17T03:41:00.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49bd7b2640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b80d0710 0x7f49b81f6880 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f49b000ea40 tx=0x7f49b000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:00.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49b57fa640 1 -- 172.21.15.146:0/999452662 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b000ce40 con 0x7f49b80d0710 2024-09-17T03:41:00.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49b57fa640 1 -- 172.21.15.146:0/999452662 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49b0004c10 con 0x7f49b80d0710 2024-09-17T03:41:00.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49bf215640 1 -- 172.21.15.146:0/999452662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b81f5860 con 0x7f49b80d0710 2024-09-17T03:41:00.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49b57fa640 1 -- 172.21.15.146:0/999452662 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0005020 con 0x7f49b80d0710 2024-09-17T03:41:00.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.061+0000 7f49bf215640 1 -- 172.21.15.146:0/999452662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b81f5e20 con 0x7f49b80d0710 2024-09-17T03:41:00.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.062+0000 7f49bf215640 1 -- 172.21.15.146:0/999452662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b80cf170 con 0x7f49b80d0710 2024-09-17T03:41:00.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.063+0000 7f49b57fa640 1 -- 172.21.15.146:0/999452662 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49b00051c0 con 0x7f49b80d0710 2024-09-17T03:41:00.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.063+0000 7f49b57fa640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f499c078bc0 0x7f499c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:00.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.064+0000 7f49b57fa640 1 -- 172.21.15.146:0/999452662 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4943+0+0 (secure 0 0 0) 0x7f49b009b720 con 0x7f49b80d0710 2024-09-17T03:41:00.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.064+0000 7f49bcfb1640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f499c078bc0 0x7f499c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:00.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.064+0000 7f49bcfb1640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f499c078bc0 0x7f499c07b0d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f49ac034000 tx=0x7f49ac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:00.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.068+0000 7f49b57fa640 1 -- 172.21.15.146:0/999452662 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f49b0063810 con 0x7f49b80d0710 2024-09-17T03:41:00.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.255+0000 7f49bf215640 1 -- 172.21.15.146:0/999452662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f49b80ced70 con 0x7f49b80d0710 2024-09-17T03:41:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.639+0000 7f49b57fa640 1 -- 172.21.15.146:0/999452662 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v124) ==== 97+0+0 (secure 0 0 0) 0x7f49b0068240 con 0x7f49b80d0710 2024-09-17T03:41:00.638 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:41:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 -- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f499c078bc0 msgr2=0x7f499c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f499c078bc0 0x7f499c07b0d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f49ac034000 tx=0x7f49ac004730 comp rx=0 tx=0).stop 2024-09-17T03:41:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 -- 172.21.15.146:0/999452662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b80d0710 msgr2=0x7f49b81f6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b80d0710 0x7f49b81f6880 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f49b000ea40 tx=0x7f49b000ef00 comp rx=0 tx=0).stop 2024-09-17T03:41:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 -- 172.21.15.146:0/999452662 shutdown_connections 2024-09-17T03:41:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f499c078bc0 0x7f499c07b0d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b80d0710 0x7f49b81f6880 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49b80cf6b0 0x7f49b81f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 --2- 172.21.15.146:0/999452662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49b80b47c0 0x7f49b8156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 -- 172.21.15.146:0/999452662 >> 172.21.15.146:0/999452662 conn(0x7f49b809ba20 msgr2=0x7f49b80b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 -- 172.21.15.146:0/999452662 shutdown_connections 2024-09-17T03:41:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.642+0000 7f49bf215640 1 -- 172.21.15.146:0/999452662 wait complete. 2024-09-17T03:41:00.654 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:41:00.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.769+0000 7f8a4b12b640 1 -- 172.21.15.146:0/2803073864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a2c004800 msgr2=0x7f8a2c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:00.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.769+0000 7f8a4b12b640 1 --2- 172.21.15.146:0/2803073864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a2c004800 0x7f8a2c004c10 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f8a44073530 tx=0x7f8a2c005830 comp rx=0 tx=0).stop 2024-09-17T03:41:00.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.769+0000 7f8a4b12b640 1 -- 172.21.15.146:0/2803073864 shutdown_connections 2024-09-17T03:41:00.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.769+0000 7f8a4b12b640 1 --2- 172.21.15.146:0/2803073864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a2c004800 0x7f8a2c004c10 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:00.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.769+0000 7f8a4b12b640 1 -- 172.21.15.146:0/2803073864 >> 172.21.15.146:0/2803073864 conn(0x7f8a440b3150 msgr2=0x7f8a440b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:00.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.769+0000 7f8a4b12b640 1 -- 172.21.15.146:0/2803073864 shutdown_connections 2024-09-17T03:41:00.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.769+0000 7f8a4b12b640 1 -- 172.21.15.146:0/2803073864 wait complete. 2024-09-17T03:41:00.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.771+0000 7f8a4b12b640 1 Processor -- start 2024-09-17T03:41:00.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.771+0000 7f8a4b12b640 1 -- start start 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.772+0000 7f8a4b12b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a2c004800 0x7f8a4414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.772+0000 7f8a4b12b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a4414f960 0x7f8a441e6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.772+0000 7f8a4b12b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a4414feb0 0x7f8a441f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.772+0000 7f8a4b12b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8a440b5a10 con 0x7f8a4414f960 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.772+0000 7f8a4b12b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a440b5890 con 0x7f8a4414feb0 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.772+0000 7f8a4b12b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8a440b5b90 con 0x7f8a2c004800 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a3bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a4414f960 0x7f8a441e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a3bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a4414f960 0x7f8a441e6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34780/0 (socket says 172.21.15.146:34780) 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a3bfff640 1 -- 172.21.15.146:0/3983495195 learned_addr learned my addr 172.21.15.146:0/3983495195 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a48ec7640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a2c004800 0x7f8a4414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a496c8640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a4414feb0 0x7f8a441f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:00.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a3bfff640 1 -- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a2c004800 msgr2=0x7f8a4414f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:00.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a3bfff640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a2c004800 0x7f8a4414f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:00.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a3bfff640 1 -- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a4414feb0 msgr2=0x7f8a441f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:00.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a3bfff640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a4414feb0 0x7f8a441f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:00.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a3bfff640 1 -- 172.21.15.146:0/3983495195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4414f730 con 0x7f8a4414f960 2024-09-17T03:41:00.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a3bfff640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a4414f960 0x7f8a441e6610 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f8a34001780 tx=0x7f8a3402af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:00.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a397fa640 1 -- 172.21.15.146:0/3983495195 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34042070 con 0x7f8a4414f960 2024-09-17T03:41:00.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a397fa640 1 -- 172.21.15.146:0/3983495195 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a34039070 con 0x7f8a4414f960 2024-09-17T03:41:00.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a397fa640 1 -- 172.21.15.146:0/3983495195 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34003830 con 0x7f8a4414f960 2024-09-17T03:41:00.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a4b12b640 1 -- 172.21.15.146:0/3983495195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a441e5570 con 0x7f8a4414f960 2024-09-17T03:41:00.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.773+0000 7f8a4b12b640 1 -- 172.21.15.146:0/3983495195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a441e5b30 con 0x7f8a4414f960 2024-09-17T03:41:00.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.775+0000 7f8a4b12b640 1 -- 172.21.15.146:0/3983495195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a440b4ba0 con 0x7f8a4414f960 2024-09-17T03:41:00.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.775+0000 7f8a397fa640 1 -- 172.21.15.146:0/3983495195 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a3403b070 con 0x7f8a4414f960 2024-09-17T03:41:00.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.776+0000 7f8a397fa640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a30078b90 0x7f8a3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:00.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.776+0000 7f8a397fa640 1 -- 172.21.15.146:0/3983495195 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4857+0+0 (secure 0 0 0) 0x7f8a340b9be0 con 0x7f8a4414f960 2024-09-17T03:41:00.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.776+0000 7f8a48ec7640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a30078b90 0x7f8a3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:00.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.776+0000 7f8a48ec7640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a30078b90 0x7f8a3007b0a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006b70 tx=0x7f8a40006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:00.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:00.780+0000 7f8a397fa640 1 -- 172.21.15.146:0/3983495195 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8a34081d20 con 0x7f8a4414f960 2024-09-17T03:41:01.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.022+0000 7f8a4b12b640 1 -- 172.21.15.146:0/3983495195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8a441e5240 con 0x7f8a4414f960 2024-09-17T03:41:01.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.023+0000 7f8a397fa640 1 -- 172.21.15.146:0/3983495195 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f8a34086750 con 0x7f8a4414f960 2024-09-17T03:41:01.022 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:01.022 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:41:01.022 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:41:01.022 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.023 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.024 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:41:01.025 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.026 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:41:01.027 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:41:01.029 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.030 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:01.031 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:41:01.032 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.033 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:41:01.034 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:41:01.035 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:41:01.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 -- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a30078b90 msgr2=0x7f8a3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:01.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a30078b90 0x7f8a3007b0a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006b70 tx=0x7f8a40006720 comp rx=0 tx=0).stop 2024-09-17T03:41:01.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 -- 172.21.15.146:0/3983495195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a4414f960 msgr2=0x7f8a441e6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:01.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a4414f960 0x7f8a441e6610 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f8a34001780 tx=0x7f8a3402af40 comp rx=0 tx=0).stop 2024-09-17T03:41:01.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 -- 172.21.15.146:0/3983495195 shutdown_connections 2024-09-17T03:41:01.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8a30078b90 0x7f8a3007b0a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a4414feb0 0x7f8a441f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a4414f960 0x7f8a441e6610 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 --2- 172.21.15.146:0/3983495195 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a2c004800 0x7f8a4414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 -- 172.21.15.146:0/3983495195 >> 172.21.15.146:0/3983495195 conn(0x7f8a440b3150 msgr2=0x7f8a440b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:01.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 -- 172.21.15.146:0/3983495195 shutdown_connections 2024-09-17T03:41:01.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.025+0000 7f8a4b12b640 1 -- 172.21.15.146:0/3983495195 wait complete. 2024-09-17T03:41:01.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:41:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.152+0000 7ff647b69640 1 -- 172.21.15.146:0/1029196692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6400b5750 msgr2=0x7ff6400b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.152+0000 7ff647b69640 1 --2- 172.21.15.146:0/1029196692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6400b5750 0x7ff6400b3620 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff640074610 tx=0x7ff63002a560 comp rx=0 tx=0).stop 2024-09-17T03:41:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.152+0000 7ff647b69640 1 -- 172.21.15.146:0/1029196692 shutdown_connections 2024-09-17T03:41:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.152+0000 7ff647b69640 1 --2- 172.21.15.146:0/1029196692 >> v2:172.21.15.179:3300/0 conn(0x7ff6400b3b60 0x7ff6400b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.152+0000 7ff647b69640 1 --2- 172.21.15.146:0/1029196692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6400b5750 0x7ff6400b3620 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.152+0000 7ff647b69640 1 --2- 172.21.15.146:0/1029196692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6400b5ce0 0x7ff6400b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.152+0000 7ff647b69640 1 -- 172.21.15.146:0/1029196692 >> 172.21.15.146:0/1029196692 conn(0x7ff6400b7b20 msgr2=0x7ff64009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.152+0000 7ff647b69640 1 -- 172.21.15.146:0/1029196692 shutdown_connections 2024-09-17T03:41:01.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.152+0000 7ff647b69640 1 -- 172.21.15.146:0/1029196692 wait complete. 2024-09-17T03:41:01.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.154+0000 7ff647b69640 1 Processor -- start 2024-09-17T03:41:01.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.154+0000 7ff647b69640 1 -- start start 2024-09-17T03:41:01.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.155+0000 7ff647b69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6400b3b60 0x7ff640143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:01.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.155+0000 7ff647b69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6400b5750 0x7ff6401f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:01.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.155+0000 7ff647b69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6400b5ce0 0x7ff64015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:01.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.155+0000 7ff647b69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff6400b2970 con 0x7ff6400b5750 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.155+0000 7ff647b69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6400b27f0 con 0x7ff6400b5ce0 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.155+0000 7ff647b69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff6400b2af0 con 0x7ff6400b3b60 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff645104640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6400b5750 0x7ff6401f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff645104640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6400b5750 0x7ff6401f76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34794/0 (socket says 172.21.15.146:34794) 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff645104640 1 -- 172.21.15.146:0/607084538 learned_addr learned my addr 172.21.15.146:0/607084538 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff645905640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6400b3b60 0x7ff640143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff645104640 1 -- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6400b3b60 msgr2=0x7ff640143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff645104640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6400b3b60 0x7ff640143930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff646106640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6400b5ce0 0x7ff64015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff645104640 1 -- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6400b5ce0 msgr2=0x7ff64015b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff645104640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6400b5ce0 0x7ff64015b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff645104640 1 -- 172.21.15.146:0/607084538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6401e55e0 con 0x7ff6400b5750 2024-09-17T03:41:01.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff645104640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6400b5750 0x7ff6401f76a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7ff630034040 tx=0x7ff6300038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff6367fc640 1 -- 172.21.15.146:0/607084538 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63003e030 con 0x7ff6400b5750 2024-09-17T03:41:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff6367fc640 1 -- 172.21.15.146:0/607084538 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff630003ca0 con 0x7ff6400b5750 2024-09-17T03:41:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff647b69640 1 -- 172.21.15.146:0/607084538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6401e5300 con 0x7ff6400b5750 2024-09-17T03:41:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff6367fc640 1 -- 172.21.15.146:0/607084538 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff630035040 con 0x7ff6400b5750 2024-09-17T03:41:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.156+0000 7ff647b69640 1 -- 172.21.15.146:0/607084538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff640146590 con 0x7ff6400b5750 2024-09-17T03:41:01.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.157+0000 7ff647b69640 1 -- 172.21.15.146:0/607084538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6400b3620 con 0x7ff6400b5750 2024-09-17T03:41:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.158+0000 7ff6367fc640 1 -- 172.21.15.146:0/607084538 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff630041030 con 0x7ff6400b5750 2024-09-17T03:41:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.158+0000 7ff6367fc640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff624078b90 0x7ff62407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.159+0000 7ff6367fc640 1 -- 172.21.15.146:0/607084538 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4857+0+0 (secure 0 0 0) 0x7ff6300bb0a0 con 0x7ff6400b5750 2024-09-17T03:41:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.159+0000 7ff645905640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff624078b90 0x7ff62407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.159+0000 7ff645905640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff624078b90 0x7ff62407b0a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009a00 tx=0x7ff63c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:01.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.163+0000 7ff6367fc640 1 -- 172.21.15.146:0/607084538 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff6300838c0 con 0x7ff6400b5750 2024-09-17T03:41:01.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.337+0000 7ff647b69640 1 -- 172.21.15.146:0/607084538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff64015aef0 con 0x7ff6400b5750 2024-09-17T03:41:01.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.338+0000 7ff6367fc640 1 -- 172.21.15.146:0/607084538 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v126) ==== 84+0+65 (secure 0 0 0) 0x7ff6300831c0 con 0x7ff6400b5750 2024-09-17T03:41:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:01.337 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:41:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:41:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:41:01.337 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:01.338 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:41:01.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 -- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff624078b90 msgr2=0x7ff62407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:01.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff624078b90 0x7ff62407b0a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009a00 tx=0x7ff63c005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 -- 172.21.15.146:0/607084538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6400b5750 msgr2=0x7ff6401f76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6400b5750 0x7ff6401f76a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7ff630034040 tx=0x7ff6300038a0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 -- 172.21.15.146:0/607084538 shutdown_connections 2024-09-17T03:41:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff624078b90 0x7ff62407b0a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6400b5ce0 0x7ff64015b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6400b5750 0x7ff6401f76a0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 --2- 172.21.15.146:0/607084538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6400b3b60 0x7ff640143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 -- 172.21.15.146:0/607084538 >> 172.21.15.146:0/607084538 conn(0x7ff6400b7b20 msgr2=0x7ff6400715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 -- 172.21.15.146:0/607084538 shutdown_connections 2024-09-17T03:41:01.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.340+0000 7ff647b69640 1 -- 172.21.15.146:0/607084538 wait complete. 2024-09-17T03:41:01.350 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:41:01.351 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:41:01.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.469+0000 7f19d7027640 1 -- 172.21.15.146:0/2063103790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00b3870 msgr2=0x7f19d00cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:01.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.469+0000 7f19d7027640 1 --2- 172.21.15.146:0/2063103790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00b3870 0x7f19d00cf370 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f19cc005fd0 tx=0x7f19cc02a540 comp rx=0 tx=0).stop 2024-09-17T03:41:01.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.469+0000 7f19d7027640 1 -- 172.21.15.146:0/2063103790 shutdown_connections 2024-09-17T03:41:01.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.469+0000 7f19d7027640 1 --2- 172.21.15.146:0/2063103790 >> v2:172.21.15.179:3300/0 conn(0x7f19d006f440 0x7f19d00d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.469+0000 7f19d7027640 1 --2- 172.21.15.146:0/2063103790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d00b3870 0x7f19d00cf370 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.469+0000 7f19d7027640 1 -- 172.21.15.146:0/2063103790 >> 172.21.15.146:0/2063103790 conn(0x7f19d00d4be0 msgr2=0x7f19d00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:01.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.469+0000 7f19d7027640 1 -- 172.21.15.146:0/2063103790 shutdown_connections 2024-09-17T03:41:01.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.469+0000 7f19d7027640 1 -- 172.21.15.146:0/2063103790 wait complete. 2024-09-17T03:41:01.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.470+0000 7f19d7027640 1 Processor -- start 2024-09-17T03:41:01.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.470+0000 7f19d7027640 1 -- start start 2024-09-17T03:41:01.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d7027640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d00b3870 0x7f19d0156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:01.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d7027640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d01620f0 0x7f19d0155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:01.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d7027640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d0155640 0x7f19d01f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:01.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d7027640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f19d00d3ae0 con 0x7f19d0155640 2024-09-17T03:41:01.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d7027640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f19d00d3960 con 0x7f19d00b3870 2024-09-17T03:41:01.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d7027640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f19d00d3c60 con 0x7f19d01620f0 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d55c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d0155640 0x7f19d01f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d4dc3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d00b3870 0x7f19d0156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d55c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d0155640 0x7f19d01f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34810/0 (socket says 172.21.15.146:34810) 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d55c4640 1 -- 172.21.15.146:0/3025140777 learned_addr learned my addr 172.21.15.146:0/3025140777 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19c7fff640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d01620f0 0x7f19d0155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d55c4640 1 -- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d01620f0 msgr2=0x7f19d0155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d55c4640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d01620f0 0x7f19d0155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d55c4640 1 -- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d00b3870 msgr2=0x7f19d0156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d55c4640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d00b3870 0x7f19d0156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.472+0000 7f19d55c4640 1 -- 172.21.15.146:0/3025140777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d01f5a40 con 0x7f19d0155640 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.473+0000 7f19d55c4640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d0155640 0x7f19d01f2a00 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f19c800ebf0 tx=0x7f19c800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.473+0000 7f19c57fa640 1 -- 172.21.15.146:0/3025140777 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8003b70 con 0x7f19d0155640 2024-09-17T03:41:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.473+0000 7f19c57fa640 1 -- 172.21.15.146:0/3025140777 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19c8003d10 con 0x7f19d0155640 2024-09-17T03:41:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.473+0000 7f19d7027640 1 -- 172.21.15.146:0/3025140777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d01572d0 con 0x7f19d0155640 2024-09-17T03:41:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.473+0000 7f19c57fa640 1 -- 172.21.15.146:0/3025140777 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8004280 con 0x7f19d0155640 2024-09-17T03:41:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.473+0000 7f19d7027640 1 -- 172.21.15.146:0/3025140777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d01f5cc0 con 0x7f19d0155640 2024-09-17T03:41:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.474+0000 7f19d7027640 1 -- 172.21.15.146:0/3025140777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d00d3190 con 0x7f19d0155640 2024-09-17T03:41:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.474+0000 7f19c57fa640 1 -- 172.21.15.146:0/3025140777 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19c8004420 con 0x7f19d0155640 2024-09-17T03:41:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.475+0000 7f19c57fa640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f19bc078b90 0x7f19bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.475+0000 7f19c57fa640 1 -- 172.21.15.146:0/3025140777 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4857+0+0 (secure 0 0 0) 0x7f19c809b680 con 0x7f19d0155640 2024-09-17T03:41:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.475+0000 7f19d4dc3640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f19bc078b90 0x7f19bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:01.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.476+0000 7f19d4dc3640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f19bc078b90 0x7f19bc07b0a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f19cc033000 tx=0x7f19cc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:01.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.480+0000 7f19c57fa640 1 -- 172.21.15.146:0/3025140777 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f19d01f5a40 con 0x7f19d0155640 2024-09-17T03:41:01.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:01.657+0000 7f19d7027640 1 -- 172.21.15.146:0/3025140777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f19d00b9850 con 0x7f19d0155640 2024-09-17T03:41:02.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.647+0000 7f19c57fa640 1 -- 172.21.15.146:0/3025140777 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v127) ==== 138+0+0 (secure 0 0 0) 0x7f19c8063720 con 0x7f19d0155640 2024-09-17T03:41:02.647 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:41:02.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 -- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f19bc078b90 msgr2=0x7f19bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:02.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f19bc078b90 0x7f19bc07b0a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f19cc033000 tx=0x7f19cc004730 comp rx=0 tx=0).stop 2024-09-17T03:41:02.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 -- 172.21.15.146:0/3025140777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d0155640 msgr2=0x7f19d01f2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:02.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d0155640 0x7f19d01f2a00 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f19c800ebf0 tx=0x7f19c800c6a0 comp rx=0 tx=0).stop 2024-09-17T03:41:02.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 -- 172.21.15.146:0/3025140777 shutdown_connections 2024-09-17T03:41:02.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f19bc078b90 0x7f19bc07b0a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:02.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19d0155640 0x7f19d01f2a00 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:02.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f19d01620f0 0x7f19d0155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:02.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 --2- 172.21.15.146:0/3025140777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f19d00b3870 0x7f19d0156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:02.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 -- 172.21.15.146:0/3025140777 >> 172.21.15.146:0/3025140777 conn(0x7f19d00d4be0 msgr2=0x7f19d00cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:02.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 -- 172.21.15.146:0/3025140777 shutdown_connections 2024-09-17T03:41:02.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.651+0000 7f19d7027640 1 -- 172.21.15.146:0/3025140777 wait complete. 2024-09-17T03:41:02.668 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:41:02.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.796+0000 7f41bd320640 1 -- 172.21.15.146:0/2486387341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41b806cc50 msgr2=0x7f41b806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:02.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.796+0000 7f41bd320640 1 --2- 172.21.15.146:0/2486387341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41b806cc50 0x7f41b806d060 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f41b0005fd0 tx=0x7f41b002aa90 comp rx=0 tx=0).stop 2024-09-17T03:41:02.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.796+0000 7f41bd320640 1 -- 172.21.15.146:0/2486387341 shutdown_connections 2024-09-17T03:41:02.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.796+0000 7f41bd320640 1 --2- 172.21.15.146:0/2486387341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41b806cc50 0x7f41b806d060 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:02.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.796+0000 7f41bd320640 1 --2- 172.21.15.146:0/2486387341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b80cdce0 0x7f41b806f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:02.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.796+0000 7f41bd320640 1 -- 172.21.15.146:0/2486387341 >> 172.21.15.146:0/2486387341 conn(0x7f41b806dd60 msgr2=0x7f41b806e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:02.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.796+0000 7f41bd320640 1 -- 172.21.15.146:0/2486387341 shutdown_connections 2024-09-17T03:41:02.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.796+0000 7f41bd320640 1 -- 172.21.15.146:0/2486387341 wait complete. 2024-09-17T03:41:02.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.798+0000 7f41bd320640 1 Processor -- start 2024-09-17T03:41:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.798+0000 7f41bd320640 1 -- start start 2024-09-17T03:41:02.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41bd320640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b806cc50 0x7f41b81450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:02.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41bd320640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41b80cdce0 0x7f41b8159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:02.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41bd320640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41b8160420 0x7f41b8150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:02.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41bd320640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f41b815d3a0 con 0x7f41b80cdce0 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41bd320640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f41b806ffa0 con 0x7f41b8160420 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41bd320640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f41b815d520 con 0x7f41b806cc50 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41ae7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41b80cdce0 0x7f41b8159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41ae7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41b80cdce0 0x7f41b8159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34838/0 (socket says 172.21.15.146:34838) 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41ae7fc640 1 -- 172.21.15.146:0/1579741973 learned_addr learned my addr 172.21.15.146:0/1579741973 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41b6ffd640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b806cc50 0x7f41b81450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41b77fe640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41b8160420 0x7f41b8150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41ae7fc640 1 -- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b806cc50 msgr2=0x7f41b81450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41ae7fc640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b806cc50 0x7f41b81450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41ae7fc640 1 -- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41b8160420 msgr2=0x7f41b8150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41ae7fc640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41b8160420 0x7f41b8150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41ae7fc640 1 -- 172.21.15.146:0/1579741973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b814f600 con 0x7f41b80cdce0 2024-09-17T03:41:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41b77fe640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41b8160420 0x7f41b8150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.799+0000 7f41b6ffd640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b806cc50 0x7f41b81450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.800+0000 7f41ae7fc640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41b80cdce0 0x7f41b8159b60 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f41a000e7c0 tx=0x7f41a000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.800+0000 7f41affff640 1 -- 172.21.15.146:0/1579741973 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a000ccc0 con 0x7f41b80cdce0 2024-09-17T03:41:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.800+0000 7f41affff640 1 -- 172.21.15.146:0/1579741973 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41a0010430 con 0x7f41b80cdce0 2024-09-17T03:41:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.800+0000 7f41bd320640 1 -- 172.21.15.146:0/1579741973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b814f8e0 con 0x7f41b80cdce0 2024-09-17T03:41:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.800+0000 7f41affff640 1 -- 172.21.15.146:0/1579741973 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0010860 con 0x7f41b80cdce0 2024-09-17T03:41:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.800+0000 7f41bd320640 1 -- 172.21.15.146:0/1579741973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b8157930 con 0x7f41b80cdce0 2024-09-17T03:41:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.801+0000 7f41bd320640 1 -- 172.21.15.146:0/1579741973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b806d060 con 0x7f41b80cdce0 2024-09-17T03:41:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.802+0000 7f41affff640 1 -- 172.21.15.146:0/1579741973 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f41a0010a00 con 0x7f41b80cdce0 2024-09-17T03:41:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.802+0000 7f41affff640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4198078bc0 0x7f419807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.802+0000 7f41affff640 1 -- 172.21.15.146:0/1579741973 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5227+0+0 (secure 0 0 0) 0x7f41a009b490 con 0x7f41b80cdce0 2024-09-17T03:41:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.802+0000 7f41b6ffd640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4198078bc0 0x7f419807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.803+0000 7f41b6ffd640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4198078bc0 0x7f419807b0d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f41a8000f60 tx=0x7f41a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:02.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.807+0000 7f41affff640 1 -- 172.21.15.146:0/1579741973 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f41a0063b40 con 0x7f41b80cdce0 2024-09-17T03:41:02.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:02.982+0000 7f41bd320640 1 -- 172.21.15.146:0/1579741973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f41b814f390 con 0x7f41b80cdce0 2024-09-17T03:41:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.655+0000 7f41affff640 1 -- 172.21.15.146:0/1579741973 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v128) ==== 170+0+0 (secure 0 0 0) 0x7f41a0063440 con 0x7f41b80cdce0 2024-09-17T03:41:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:41:03.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.657+0000 7f41bd320640 1 -- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4198078bc0 msgr2=0x7f419807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:03.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.658+0000 7f41bd320640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4198078bc0 0x7f419807b0d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f41a8000f60 tx=0x7f41a8009040 comp rx=0 tx=0).stop 2024-09-17T03:41:03.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.658+0000 7f41bd320640 1 -- 172.21.15.146:0/1579741973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41b80cdce0 msgr2=0x7f41b8159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:03.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.658+0000 7f41bd320640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41b80cdce0 0x7f41b8159b60 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f41a000e7c0 tx=0x7f41a000ec80 comp rx=0 tx=0).stop 2024-09-17T03:41:03.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.658+0000 7f41bd320640 1 -- 172.21.15.146:0/1579741973 shutdown_connections 2024-09-17T03:41:03.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.658+0000 7f41bd320640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4198078bc0 0x7f419807b0d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:03.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.658+0000 7f41bd320640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41b8160420 0x7f41b8150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:03.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.658+0000 7f41bd320640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41b80cdce0 0x7f41b8159b60 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:03.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.658+0000 7f41bd320640 1 --2- 172.21.15.146:0/1579741973 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f41b806cc50 0x7f41b81450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:03.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.658+0000 7f41bd320640 1 -- 172.21.15.146:0/1579741973 >> 172.21.15.146:0/1579741973 conn(0x7f41b806dd60 msgr2=0x7f41b80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:03.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.658+0000 7f41bd320640 1 -- 172.21.15.146:0/1579741973 shutdown_connections 2024-09-17T03:41:03.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.658+0000 7f41bd320640 1 -- 172.21.15.146:0/1579741973 wait complete. 2024-09-17T03:41:03.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:41:03.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.799+0000 7fb770c8b640 1 -- 172.21.15.146:0/99557623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c0b61f0 msgr2=0x7fb76c0b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:03.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.799+0000 7fb770c8b640 1 --2- 172.21.15.146:0/99557623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c0b61f0 0x7fb76c0b6600 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fb76c06e100 tx=0x7fb76402a980 comp rx=0 tx=0).stop 2024-09-17T03:41:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.799+0000 7fb770c8b640 1 -- 172.21.15.146:0/99557623 shutdown_connections 2024-09-17T03:41:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.799+0000 7fb770c8b640 1 --2- 172.21.15.146:0/99557623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c0b61f0 0x7fb76c0b6600 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.799+0000 7fb770c8b640 1 --2- 172.21.15.146:0/99557623 >> v2:172.21.15.179:3300/0 conn(0x7fb76c15f1a0 0x7fb76c0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.799+0000 7fb770c8b640 1 -- 172.21.15.146:0/99557623 >> 172.21.15.146:0/99557623 conn(0x7fb76c0d11f0 msgr2=0x7fb76c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.799+0000 7fb770c8b640 1 -- 172.21.15.146:0/99557623 shutdown_connections 2024-09-17T03:41:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.799+0000 7fb770c8b640 1 -- 172.21.15.146:0/99557623 wait complete. 2024-09-17T03:41:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.801+0000 7fb770c8b640 1 Processor -- start 2024-09-17T03:41:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.801+0000 7fb770c8b640 1 -- start start 2024-09-17T03:41:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.802+0000 7fb770c8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c0b61f0 0x7fb76c155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.802+0000 7fb770c8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c15f1a0 0x7fb76c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.802+0000 7fb770c8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb76c1631a0 0x7fb76c0cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.802+0000 7fb770c8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c0695b0 con 0x7fb76c15f1a0 2024-09-17T03:41:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.802+0000 7fb770c8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c069430 con 0x7fb76c0b61f0 2024-09-17T03:41:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.802+0000 7fb770c8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb76c069730 con 0x7fb76c1631a0 2024-09-17T03:41:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.802+0000 7fb769d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c15f1a0 0x7fb76c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.802+0000 7fb769d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c15f1a0 0x7fb76c0cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34854/0 (socket says 172.21.15.146:34854) 2024-09-17T03:41:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.802+0000 7fb769d9b640 1 -- 172.21.15.146:0/2106718963 learned_addr learned my addr 172.21.15.146:0/2106718963 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:03.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb76a59c640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c0b61f0 0x7fb76c155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb76ad9d640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb76c1631a0 0x7fb76c0cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb769d9b640 1 -- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb76c1631a0 msgr2=0x7fb76c0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb769d9b640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb76c1631a0 0x7fb76c0cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb769d9b640 1 -- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c0b61f0 msgr2=0x7fb76c155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb769d9b640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c0b61f0 0x7fb76c155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb769d9b640 1 -- 172.21.15.146:0/2106718963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c0ce430 con 0x7fb76c15f1a0 2024-09-17T03:41:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb76a59c640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c0b61f0 0x7fb76c155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb76ad9d640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb76c1631a0 0x7fb76c0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb769d9b640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c15f1a0 0x7fb76c0cbe70 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fb76000b3f0 tx=0x7fb76000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb75affd640 1 -- 172.21.15.146:0/2106718963 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760015020 con 0x7fb76c15f1a0 2024-09-17T03:41:03.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb75affd640 1 -- 172.21.15.146:0/2106718963 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb760011920 con 0x7fb76c15f1a0 2024-09-17T03:41:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb770c8b640 1 -- 172.21.15.146:0/2106718963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76c0cde70 con 0x7fb76c15f1a0 2024-09-17T03:41:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb75affd640 1 -- 172.21.15.146:0/2106718963 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760011d70 con 0x7fb76c15f1a0 2024-09-17T03:41:03.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.803+0000 7fb770c8b640 1 -- 172.21.15.146:0/2106718963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb76c0b9bd0 con 0x7fb76c15f1a0 2024-09-17T03:41:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.804+0000 7fb770c8b640 1 -- 172.21.15.146:0/2106718963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb76c069be0 con 0x7fb76c15f1a0 2024-09-17T03:41:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.805+0000 7fb75affd640 1 -- 172.21.15.146:0/2106718963 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb760018020 con 0x7fb76c15f1a0 2024-09-17T03:41:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.806+0000 7fb75affd640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb74c078bc0 0x7fb74c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.806+0000 7fb75affd640 1 -- 172.21.15.146:0/2106718963 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5609+0+0 (secure 0 0 0) 0x7fb76009b030 con 0x7fb76c15f1a0 2024-09-17T03:41:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.806+0000 7fb76a59c640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb74c078bc0 0x7fb74c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.807+0000 7fb76a59c640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb74c078bc0 0x7fb74c07b0d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb75c005fd0 tx=0x7fb75c00f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:03.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:03.810+0000 7fb75affd640 1 -- 172.21.15.146:0/2106718963 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb76001f020 con 0x7fb76c15f1a0 2024-09-17T03:41:04.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.021+0000 7fb770c8b640 1 -- 172.21.15.146:0/2106718963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb76c0cb7b0 con 0x7fb76c15f1a0 2024-09-17T03:41:04.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.664+0000 7fb75affd640 1 -- 172.21.15.146:0/2106718963 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v92) ==== 174+0+0 (secure 0 0 0) 0x7fb7600636d0 con 0x7fb76c15f1a0 2024-09-17T03:41:04.664 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 18 and data pool 19 2024-09-17T03:41:04.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.676+0000 7fb770c8b640 1 -- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb74c078bc0 msgr2=0x7fb74c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.676+0000 7fb770c8b640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb74c078bc0 0x7fb74c07b0d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb75c005fd0 tx=0x7fb75c00f360 comp rx=0 tx=0).stop 2024-09-17T03:41:04.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.676+0000 7fb770c8b640 1 -- 172.21.15.146:0/2106718963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c15f1a0 msgr2=0x7fb76c0cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.676+0000 7fb770c8b640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c15f1a0 0x7fb76c0cbe70 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fb76000b3f0 tx=0x7fb76000b8b0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.678+0000 7fb770c8b640 1 -- 172.21.15.146:0/2106718963 shutdown_connections 2024-09-17T03:41:04.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.678+0000 7fb770c8b640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb74c078bc0 0x7fb74c07b0d0 secure :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb75c005fd0 tx=0x7fb75c00f360 comp rx=0 tx=0).stop 2024-09-17T03:41:04.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.678+0000 7fb770c8b640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb76c1631a0 0x7fb76c0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.678+0000 7fb770c8b640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c15f1a0 0x7fb76c0cbe70 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.678+0000 7fb770c8b640 1 --2- 172.21.15.146:0/2106718963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb76c0b61f0 0x7fb76c155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.678+0000 7fb770c8b640 1 -- 172.21.15.146:0/2106718963 >> 172.21.15.146:0/2106718963 conn(0x7fb76c0d11f0 msgr2=0x7fb76c15d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:04.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.679+0000 7fb770c8b640 1 -- 172.21.15.146:0/2106718963 shutdown_connections 2024-09-17T03:41:04.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.682+0000 7fb770c8b640 1 -- 172.21.15.146:0/2106718963 wait complete. 2024-09-17T03:41:04.698 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:41:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.813+0000 7f3e4b520640 1 -- 172.21.15.146:0/1396030665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e44153a60 msgr2=0x7f3e4415d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.813+0000 7f3e4b520640 1 --2- 172.21.15.146:0/1396030665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e44153a60 0x7f3e4415d980 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f3e44070850 tx=0x7f3e4002a540 comp rx=0 tx=0).stop 2024-09-17T03:41:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.813+0000 7f3e4b520640 1 -- 172.21.15.146:0/1396030665 shutdown_connections 2024-09-17T03:41:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.813+0000 7f3e4b520640 1 --2- 172.21.15.146:0/1396030665 >> v2:172.21.15.179:3300/0 conn(0x7f3e44073480 0x7f3e44073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.813+0000 7f3e4b520640 1 --2- 172.21.15.146:0/1396030665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e44153a60 0x7f3e4415d980 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.813+0000 7f3e4b520640 1 -- 172.21.15.146:0/1396030665 >> 172.21.15.146:0/1396030665 conn(0x7f3e440b2060 msgr2=0x7f3e440b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:04.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.813+0000 7f3e4b520640 1 -- 172.21.15.146:0/1396030665 shutdown_connections 2024-09-17T03:41:04.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.813+0000 7f3e4b520640 1 -- 172.21.15.146:0/1396030665 wait complete. 2024-09-17T03:41:04.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.815+0000 7f3e4b520640 1 Processor -- start 2024-09-17T03:41:04.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.815+0000 7f3e4b520640 1 -- start start 2024-09-17T03:41:04.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.816+0000 7f3e4b520640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e44073480 0x7f3e441f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.816+0000 7f3e4b520640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e44153a60 0x7f3e44159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.816+0000 7f3e4b520640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e441604f0 0x7f3e441f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.816+0000 7f3e4b520640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44073f50 con 0x7f3e441604f0 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.816+0000 7f3e4b520640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44073dd0 con 0x7f3e44153a60 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.816+0000 7f3e4b520640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3e440740d0 con 0x7f3e44073480 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.816+0000 7f3e49abd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e441604f0 0x7f3e441f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.816+0000 7f3e49abd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e441604f0 0x7f3e441f6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34876/0 (socket says 172.21.15.146:34876) 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.816+0000 7f3e49abd640 1 -- 172.21.15.146:0/1285488668 learned_addr learned my addr 172.21.15.146:0/1285488668 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.816+0000 7f3e492bc640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e44073480 0x7f3e441f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.816+0000 7f3e48abb640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e44153a60 0x7f3e44159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.817+0000 7f3e49abd640 1 -- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e44073480 msgr2=0x7f3e441f7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.817+0000 7f3e49abd640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e44073480 0x7f3e441f7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.817+0000 7f3e49abd640 1 -- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e44153a60 msgr2=0x7f3e44159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:04.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.817+0000 7f3e49abd640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e44153a60 0x7f3e44159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:04.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.817+0000 7f3e49abd640 1 -- 172.21.15.146:0/1285488668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e441566b0 con 0x7f3e441604f0 2024-09-17T03:41:04.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.817+0000 7f3e49abd640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e441604f0 0x7f3e441f6f20 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00cad0 tx=0x7f3e3c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:04.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.817+0000 7f3e39ffb640 1 -- 172.21.15.146:0/1285488668 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00ae20 con 0x7f3e441604f0 2024-09-17T03:41:04.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.817+0000 7f3e39ffb640 1 -- 172.21.15.146:0/1285488668 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e3c00f450 con 0x7f3e441604f0 2024-09-17T03:41:04.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.817+0000 7f3e4b520640 1 -- 172.21.15.146:0/1285488668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e44156990 con 0x7f3e441604f0 2024-09-17T03:41:04.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.817+0000 7f3e39ffb640 1 -- 172.21.15.146:0/1285488668 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00f8c0 con 0x7f3e441604f0 2024-09-17T03:41:04.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.817+0000 7f3e4b520640 1 -- 172.21.15.146:0/1285488668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e44156f50 con 0x7f3e441604f0 2024-09-17T03:41:04.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.818+0000 7f3e4b520640 1 -- 172.21.15.146:0/1285488668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e44154570 con 0x7f3e441604f0 2024-09-17T03:41:04.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.819+0000 7f3e39ffb640 1 -- 172.21.15.146:0/1285488668 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e3c00fa60 con 0x7f3e441604f0 2024-09-17T03:41:04.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.819+0000 7f3e39ffb640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3e28078bc0 0x7f3e2807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:04.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.820+0000 7f3e39ffb640 1 -- 172.21.15.146:0/1285488668 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f3e3c09b6e0 con 0x7f3e441604f0 2024-09-17T03:41:04.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.820+0000 7f3e492bc640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3e28078bc0 0x7f3e2807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:04.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.820+0000 7f3e492bc640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3e28078bc0 0x7f3e2807b0d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3e40033000 tx=0x7f3e40004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:04.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:04.824+0000 7f3e39ffb640 1 -- 172.21.15.146:0/1285488668 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3e3c014030 con 0x7f3e441604f0 2024-09-17T03:41:05.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.001+0000 7f3e4b520640 1 -- 172.21.15.146:0/1285488668 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e44157330 con 0x7f3e441604f0 2024-09-17T03:41:05.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.002+0000 7f3e39ffb640 1 -- 172.21.15.146:0/1285488668 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16800 (secure 0 0 0) 0x7f3e44157330 con 0x7f3e441604f0 2024-09-17T03:41:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:05.002 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":129,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:41:04.022760+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:41:01.662178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T03:41:02.986445+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:41:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.004+0000 7f3e4b520640 1 -- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3e28078bc0 msgr2=0x7f3e2807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.004+0000 7f3e4b520640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3e28078bc0 0x7f3e2807b0d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3e40033000 tx=0x7f3e40004730 comp rx=0 tx=0).stop 2024-09-17T03:41:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.004+0000 7f3e4b520640 1 -- 172.21.15.146:0/1285488668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e441604f0 msgr2=0x7f3e441f6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.004+0000 7f3e4b520640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e441604f0 0x7f3e441f6f20 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00cad0 tx=0x7f3e3c00cf90 comp rx=0 tx=0).stop 2024-09-17T03:41:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.004+0000 7f3e4b520640 1 -- 172.21.15.146:0/1285488668 shutdown_connections 2024-09-17T03:41:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.004+0000 7f3e4b520640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3e28078bc0 0x7f3e2807b0d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.004+0000 7f3e4b520640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e441604f0 0x7f3e441f6f20 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.004+0000 7f3e4b520640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3e44153a60 0x7f3e44159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.004+0000 7f3e4b520640 1 --2- 172.21.15.146:0/1285488668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3e44073480 0x7f3e441f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.004+0000 7f3e4b520640 1 -- 172.21.15.146:0/1285488668 >> 172.21.15.146:0/1285488668 conn(0x7f3e440b2060 msgr2=0x7f3e440b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:05.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.005+0000 7f3e4b520640 1 -- 172.21.15.146:0/1285488668 shutdown_connections 2024-09-17T03:41:05.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.005+0000 7f3e4b520640 1 -- 172.21.15.146:0/1285488668 wait complete. 2024-09-17T03:41:05.016 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:41:05.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.130+0000 7f68840b6640 1 -- 172.21.15.146:0/2993657064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0b61f0 msgr2=0x7f687c0b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.130+0000 7f68840b6640 1 --2- 172.21.15.146:0/2993657064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0b61f0 0x7f687c0b6600 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f687c15cd70 tx=0x7f687402aa30 comp rx=0 tx=0).stop 2024-09-17T03:41:05.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.130+0000 7f68840b6640 1 -- 172.21.15.146:0/2993657064 shutdown_connections 2024-09-17T03:41:05.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.130+0000 7f68840b6640 1 --2- 172.21.15.146:0/2993657064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0b61f0 0x7f687c0b6600 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.130+0000 7f68840b6640 1 --2- 172.21.15.146:0/2993657064 >> v2:172.21.15.179:3300/0 conn(0x7f687c0cfca0 0x7f687c0cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.130+0000 7f68840b6640 1 -- 172.21.15.146:0/2993657064 >> 172.21.15.146:0/2993657064 conn(0x7f687c0d11f0 msgr2=0x7f687c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:05.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.130+0000 7f68840b6640 1 -- 172.21.15.146:0/2993657064 shutdown_connections 2024-09-17T03:41:05.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.130+0000 7f68840b6640 1 -- 172.21.15.146:0/2993657064 wait complete. 2024-09-17T03:41:05.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.132+0000 7f68840b6640 1 Processor -- start 2024-09-17T03:41:05.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.132+0000 7f68840b6640 1 -- start start 2024-09-17T03:41:05.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.133+0000 7f68840b6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f687c0b61f0 0x7f687c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.133+0000 7f68840b6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0cfca0 0x7f687c0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.133+0000 7f68840b6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f687c15f1a0 0x7f687c0cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.133+0000 7f68840b6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f687c0695b0 con 0x7f687c0cfca0 2024-09-17T03:41:05.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.133+0000 7f68840b6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f687c069430 con 0x7f687c15f1a0 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.133+0000 7f68840b6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f687c069730 con 0x7f687c0b61f0 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.133+0000 7f6881651640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0cfca0 0x7f687c0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f6881651640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0cfca0 0x7f687c0cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34904/0 (socket says 172.21.15.146:34904) 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f6881651640 1 -- 172.21.15.146:0/1780487258 learned_addr learned my addr 172.21.15.146:0/1780487258 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f6882653640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f687c15f1a0 0x7f687c0cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f6881e52640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f687c0b61f0 0x7f687c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f6881651640 1 -- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f687c0b61f0 msgr2=0x7f687c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f6881651640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f687c0b61f0 0x7f687c15c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f6881651640 1 -- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f687c15f1a0 msgr2=0x7f687c0cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f6881651640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f687c15f1a0 0x7f687c0cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f6881651640 1 -- 172.21.15.146:0/1780487258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687c0cc930 con 0x7f687c0cfca0 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f6881e52640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f687c0b61f0 0x7f687c15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:05.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f6881651640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0cfca0 0x7f687c0cd6f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f686c00e790 tx=0x7f686c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:05.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f68727fc640 1 -- 172.21.15.146:0/1780487258 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c00eea0 con 0x7f687c0cfca0 2024-09-17T03:41:05.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f68727fc640 1 -- 172.21.15.146:0/1780487258 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f686c00cdb0 con 0x7f687c0cfca0 2024-09-17T03:41:05.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f68840b6640 1 -- 172.21.15.146:0/1780487258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687c0ccc10 con 0x7f687c0cfca0 2024-09-17T03:41:05.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f68727fc640 1 -- 172.21.15.146:0/1780487258 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c010690 con 0x7f687c0cfca0 2024-09-17T03:41:05.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.134+0000 7f68840b6640 1 -- 172.21.15.146:0/1780487258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f687c0cd1d0 con 0x7f687c0cfca0 2024-09-17T03:41:05.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.135+0000 7f68840b6640 1 -- 172.21.15.146:0/1780487258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f687c069c50 con 0x7f687c0cfca0 2024-09-17T03:41:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.136+0000 7f68727fc640 1 -- 172.21.15.146:0/1780487258 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f686c010830 con 0x7f687c0cfca0 2024-09-17T03:41:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.136+0000 7f68727fc640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6860078bc0 0x7f686007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.137+0000 7f68727fc640 1 -- 172.21.15.146:0/1780487258 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f686c09b570 con 0x7f687c0cfca0 2024-09-17T03:41:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.137+0000 7f6881e52640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6860078bc0 0x7f686007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.137+0000 7f6881e52640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6860078bc0 0x7f686007b0d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6878007fd0 tx=0x7f6878009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:05.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.141+0000 7f68727fc640 1 -- 172.21.15.146:0/1780487258 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f686c063480 con 0x7f687c0cfca0 2024-09-17T03:41:05.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.317+0000 7f68840b6640 1 -- 172.21.15.146:0/1780487258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f687c0c7ff0 con 0x7f687c0cfca0 2024-09-17T03:41:05.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.318+0000 7f68727fc640 1 -- 172.21.15.146:0/1780487258 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16800 (secure 0 0 0) 0x7f686c067eb0 con 0x7f687c0cfca0 2024-09-17T03:41:05.317 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:05.317 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":129,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:41:04.022760+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:41:01.662178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T03:41:02.986445+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:41:05.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 -- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6860078bc0 msgr2=0x7f686007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6860078bc0 0x7f686007b0d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6878007fd0 tx=0x7f6878009040 comp rx=0 tx=0).stop 2024-09-17T03:41:05.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 -- 172.21.15.146:0/1780487258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0cfca0 msgr2=0x7f687c0cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0cfca0 0x7f687c0cd6f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f686c00e790 tx=0x7f686c00ec50 comp rx=0 tx=0).stop 2024-09-17T03:41:05.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 -- 172.21.15.146:0/1780487258 shutdown_connections 2024-09-17T03:41:05.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6860078bc0 0x7f686007b0d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f687c15f1a0 0x7f687c0cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f687c0cfca0 0x7f687c0cd6f0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 --2- 172.21.15.146:0/1780487258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f687c0b61f0 0x7f687c15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 -- 172.21.15.146:0/1780487258 >> 172.21.15.146:0/1780487258 conn(0x7f687c0d11f0 msgr2=0x7f687c15deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:05.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 -- 172.21.15.146:0/1780487258 shutdown_connections 2024-09-17T03:41:05.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.320+0000 7f68840b6640 1 -- 172.21.15.146:0/1780487258 wait complete. 2024-09-17T03:41:05.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:41:05.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.449+0000 7f8547a4d640 1 -- 172.21.15.146:0/3002338284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85400d1190 msgr2=0x7f85400d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.449+0000 7f8547a4d640 1 --2- 172.21.15.146:0/3002338284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85400d1190 0x7f85400d15a0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f8538005fd0 tx=0x7f853802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.449+0000 7f8547a4d640 1 -- 172.21.15.146:0/3002338284 shutdown_connections 2024-09-17T03:41:05.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.449+0000 7f8547a4d640 1 --2- 172.21.15.146:0/3002338284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85400d1190 0x7f85400d15a0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.449+0000 7f8547a4d640 1 --2- 172.21.15.146:0/3002338284 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85400cefe0 0x7f85400cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.449+0000 7f8547a4d640 1 -- 172.21.15.146:0/3002338284 >> 172.21.15.146:0/3002338284 conn(0x7f854009ba20 msgr2=0x7f85400b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:05.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.449+0000 7f8547a4d640 1 -- 172.21.15.146:0/3002338284 shutdown_connections 2024-09-17T03:41:05.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.449+0000 7f8547a4d640 1 -- 172.21.15.146:0/3002338284 wait complete. 2024-09-17T03:41:05.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.451+0000 7f8547a4d640 1 Processor -- start 2024-09-17T03:41:05.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.451+0000 7f8547a4d640 1 -- start start 2024-09-17T03:41:05.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.452+0000 7f8547a4d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85400b7580 0x7f85400b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.452+0000 7f8547a4d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85400cefe0 0x7f85400ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8547a4d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85400d1190 0x7f85401e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8547a4d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f854006dee0 con 0x7f85400d1190 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8547a4d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f854006dd60 con 0x7f85400cefe0 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8547a4d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f854006e060 con 0x7f85400b7580 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8545fea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85400d1190 0x7f85401e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8545fea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85400d1190 0x7f85401e7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34932/0 (socket says 172.21.15.146:34932) 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8545fea640 1 -- 172.21.15.146:0/1037305755 learned_addr learned my addr 172.21.15.146:0/1037305755 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f85457e9640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85400b7580 0x7f85400b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8544fe8640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85400cefe0 0x7f85400ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8545fea640 1 -- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85400b7580 msgr2=0x7f85400b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8545fea640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85400b7580 0x7f85400b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8545fea640 1 -- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85400cefe0 msgr2=0x7f85400ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8545fea640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85400cefe0 0x7f85400ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8545fea640 1 -- 172.21.15.146:0/1037305755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85400b1a80 con 0x7f85400d1190 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8545fea640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85400d1190 0x7f85401e7a50 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f8538006010 tx=0x7f85380039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:05.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8535ffb640 1 -- 172.21.15.146:0/1037305755 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853803e030 con 0x7f85400d1190 2024-09-17T03:41:05.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8535ffb640 1 -- 172.21.15.146:0/1037305755 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85380047a0 con 0x7f85400d1190 2024-09-17T03:41:05.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8547a4d640 1 -- 172.21.15.146:0/1037305755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85400b1d20 con 0x7f85400d1190 2024-09-17T03:41:05.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.453+0000 7f8535ffb640 1 -- 172.21.15.146:0/1037305755 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538035040 con 0x7f85400d1190 2024-09-17T03:41:05.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.454+0000 7f8547a4d640 1 -- 172.21.15.146:0/1037305755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85401e8a10 con 0x7f85400d1190 2024-09-17T03:41:05.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.454+0000 7f8547a4d640 1 -- 172.21.15.146:0/1037305755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85401e8780 con 0x7f85400d1190 2024-09-17T03:41:05.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.455+0000 7f8535ffb640 1 -- 172.21.15.146:0/1037305755 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8538041030 con 0x7f85400d1190 2024-09-17T03:41:05.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.456+0000 7f8535ffb640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8524078b90 0x7f852407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:05.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.456+0000 7f8535ffb640 1 -- 172.21.15.146:0/1037305755 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f85380bb480 con 0x7f85400d1190 2024-09-17T03:41:05.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.456+0000 7f85457e9640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8524078b90 0x7f852407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:05.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.456+0000 7f85457e9640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8524078b90 0x7f852407b0a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f853c009f20 tx=0x7f853c0094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:05.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.460+0000 7f8535ffb640 1 -- 172.21.15.146:0/1037305755 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f85380839e0 con 0x7f85400d1190 2024-09-17T03:41:05.643 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-09-17T03:41:05.644+0000 7f8015c43640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:41:05.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:05.677+0000 7f8547a4d640 1 -- 172.21.15.146:0/1037305755 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f85400cfd50 con 0x7f85400d1190 2024-09-17T03:41:06.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.677+0000 7f8535ffb640 1 -- 172.21.15.146:0/1037305755 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v94) ==== 118+0+0 (secure 0 0 0) 0x7f85380832e0 con 0x7f85400d1190 2024-09-17T03:41:06.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 -- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8524078b90 msgr2=0x7f852407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8524078b90 0x7f852407b0a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f853c009f20 tx=0x7f853c0094d0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 -- 172.21.15.146:0/1037305755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85400d1190 msgr2=0x7f85401e7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85400d1190 0x7f85401e7a50 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f8538006010 tx=0x7f85380039e0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 -- 172.21.15.146:0/1037305755 shutdown_connections 2024-09-17T03:41:06.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8524078b90 0x7f852407b0a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85400d1190 0x7f85401e7a50 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85400cefe0 0x7f85400ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 --2- 172.21.15.146:0/1037305755 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85400b7580 0x7f85400b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 -- 172.21.15.146:0/1037305755 >> 172.21.15.146:0/1037305755 conn(0x7f854009ba20 msgr2=0x7f85401e7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:06.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 -- 172.21.15.146:0/1037305755 shutdown_connections 2024-09-17T03:41:06.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.682+0000 7f8547a4d640 1 -- 172.21.15.146:0/1037305755 wait complete. 2024-09-17T03:41:06.696 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:41:06.696 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:41:06.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.825+0000 7ff405b6e640 1 -- 172.21.15.146:0/1303376543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e8003c30 msgr2=0x7ff3e8004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.825+0000 7ff405b6e640 1 --2- 172.21.15.146:0/1303376543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e8003c30 0x7ff3e8004080 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000c760 tx=0x7ff3e8005830 comp rx=0 tx=0).stop 2024-09-17T03:41:06.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.825+0000 7ff405b6e640 1 -- 172.21.15.146:0/1303376543 shutdown_connections 2024-09-17T03:41:06.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.825+0000 7ff405b6e640 1 --2- 172.21.15.146:0/1303376543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e8003c30 0x7ff3e8004080 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.825+0000 7ff405b6e640 1 -- 172.21.15.146:0/1303376543 >> 172.21.15.146:0/1303376543 conn(0x7ff4000b2060 msgr2=0x7ff4000b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:06.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.825+0000 7ff405b6e640 1 -- 172.21.15.146:0/1303376543 shutdown_connections 2024-09-17T03:41:06.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.825+0000 7ff405b6e640 1 -- 172.21.15.146:0/1303376543 wait complete. 2024-09-17T03:41:06.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.827+0000 7ff405b6e640 1 Processor -- start 2024-09-17T03:41:06.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.827+0000 7ff405b6e640 1 -- start start 2024-09-17T03:41:06.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.828+0000 7ff405b6e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e8003c30 0x7ff4001f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.828+0000 7ff405b6e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4001f1420 0x7ff40015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.828+0000 7ff405b6e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4000ad840 0x7ff4000adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.828+0000 7ff405b6e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000cfc40 con 0x7ff4000ad840 2024-09-17T03:41:06.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.828+0000 7ff405b6e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff40015ed30 con 0x7ff3e8003c30 2024-09-17T03:41:06.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.828+0000 7ff405b6e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff4000cfdc0 con 0x7ff4001f1420 2024-09-17T03:41:06.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.828+0000 7ff3fffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4000ad840 0x7ff4000adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.828+0000 7ff3fffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4000ad840 0x7ff4000adc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34948/0 (socket says 172.21.15.146:34948) 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.828+0000 7ff3fffff640 1 -- 172.21.15.146:0/3109873324 learned_addr learned my addr 172.21.15.146:0/3109873324 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.828+0000 7ff3ff7fe640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e8003c30 0x7ff4001f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.828+0000 7ff3feffd640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4001f1420 0x7ff40015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.829+0000 7ff3fffff640 1 -- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4001f1420 msgr2=0x7ff40015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.829+0000 7ff3fffff640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4001f1420 0x7ff40015a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.829+0000 7ff3fffff640 1 -- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e8003c30 msgr2=0x7ff4001f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.829+0000 7ff3fffff640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e8003c30 0x7ff4001f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.829+0000 7ff3fffff640 1 -- 172.21.15.146:0/3109873324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4001f1e50 con 0x7ff4000ad840 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.829+0000 7ff3fffff640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4000ad840 0x7ff4000adc50 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7ff400071960 tx=0x7ff3f8001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.829+0000 7ff3e7fff640 1 -- 172.21.15.146:0/3109873324 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8011660 con 0x7ff4000ad840 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.829+0000 7ff3e7fff640 1 -- 172.21.15.146:0/3109873324 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3f8017070 con 0x7ff4000ad840 2024-09-17T03:41:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.829+0000 7ff3e7fff640 1 -- 172.21.15.146:0/3109873324 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8011b90 con 0x7ff4000ad840 2024-09-17T03:41:06.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.829+0000 7ff405b6e640 1 -- 172.21.15.146:0/3109873324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4001f2130 con 0x7ff4000ad840 2024-09-17T03:41:06.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.829+0000 7ff405b6e640 1 -- 172.21.15.146:0/3109873324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4001f4ec0 con 0x7ff4000ad840 2024-09-17T03:41:06.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.830+0000 7ff405b6e640 1 -- 172.21.15.146:0/3109873324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4001f1bc0 con 0x7ff4000ad840 2024-09-17T03:41:06.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.831+0000 7ff3e7fff640 1 -- 172.21.15.146:0/3109873324 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff3f801c460 con 0x7ff4000ad840 2024-09-17T03:41:06.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.831+0000 7ff3e7fff640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3ec078b90 0x7ff3ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:06.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.831+0000 7ff3e7fff640 1 -- 172.21.15.146:0/3109873324 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7ff3f809b3c0 con 0x7ff4000ad840 2024-09-17T03:41:06.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.832+0000 7ff3ff7fe640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3ec078b90 0x7ff3ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:06.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.832+0000 7ff3ff7fe640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3ec078b90 0x7ff3ec07b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0033000 tx=0x7ff3f0038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:06.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:06.836+0000 7ff3e7fff640 1 -- 172.21.15.146:0/3109873324 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff3f8063890 con 0x7ff4000ad840 2024-09-17T03:41:07.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.048+0000 7ff405b6e640 1 -- 172.21.15.146:0/3109873324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff40006e470 con 0x7ff4000ad840 2024-09-17T03:41:07.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.679+0000 7ff3e7fff640 1 -- 172.21.15.146:0/3109873324 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v95) ==== 122+0+0 (secure 0 0 0) 0x7ff3f8063190 con 0x7ff4000ad840 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.681+0000 7ff405b6e640 1 -- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3ec078b90 msgr2=0x7ff3ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.681+0000 7ff405b6e640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3ec078b90 0x7ff3ec07b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0033000 tx=0x7ff3f0038040 comp rx=0 tx=0).stop 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.681+0000 7ff405b6e640 1 -- 172.21.15.146:0/3109873324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4000ad840 msgr2=0x7ff4000adc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.681+0000 7ff405b6e640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4000ad840 0x7ff4000adc50 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7ff400071960 tx=0x7ff3f8001800 comp rx=0 tx=0).stop 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.681+0000 7ff405b6e640 1 -- 172.21.15.146:0/3109873324 shutdown_connections 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.681+0000 7ff405b6e640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3ec078b90 0x7ff3ec07b0a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.681+0000 7ff405b6e640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4000ad840 0x7ff4000adc50 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.681+0000 7ff405b6e640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4001f1420 0x7ff40015a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.681+0000 7ff405b6e640 1 --2- 172.21.15.146:0/3109873324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e8003c30 0x7ff4001f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.681+0000 7ff405b6e640 1 -- 172.21.15.146:0/3109873324 >> 172.21.15.146:0/3109873324 conn(0x7ff4000b2060 msgr2=0x7ff4000affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.682+0000 7ff405b6e640 1 -- 172.21.15.146:0/3109873324 shutdown_connections 2024-09-17T03:41:07.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.682+0000 7ff405b6e640 1 -- 172.21.15.146:0/3109873324 wait complete. 2024-09-17T03:41:07.694 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:41:07.694 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:07.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.809+0000 7f09cbde4640 1 -- 172.21.15.146:0/2221565196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09c40b3d30 msgr2=0x7f09c415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.809+0000 7f09cbde4640 1 --2- 172.21.15.146:0/2221565196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09c40b3d30 0x7f09c415caa0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f09bc005fd0 tx=0x7f09bc02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.809+0000 7f09cbde4640 1 -- 172.21.15.146:0/2221565196 shutdown_connections 2024-09-17T03:41:07.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.809+0000 7f09cbde4640 1 --2- 172.21.15.146:0/2221565196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09c40b3d30 0x7f09c415caa0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.809+0000 7f09cbde4640 1 --2- 172.21.15.146:0/2221565196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c40b5ce0 0x7f09c40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.809+0000 7f09cbde4640 1 -- 172.21.15.146:0/2221565196 >> 172.21.15.146:0/2221565196 conn(0x7f09c40b7b20 msgr2=0x7f09c409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:07.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.809+0000 7f09cbde4640 1 -- 172.21.15.146:0/2221565196 shutdown_connections 2024-09-17T03:41:07.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.809+0000 7f09cbde4640 1 -- 172.21.15.146:0/2221565196 wait complete. 2024-09-17T03:41:07.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.811+0000 7f09cbde4640 1 Processor -- start 2024-09-17T03:41:07.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.811+0000 7f09cbde4640 1 -- start start 2024-09-17T03:41:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09cbde4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09c40b5750 0x7f09c4151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09cbde4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09c40b5ce0 0x7f09c41f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09cbde4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c4156010 0x7f09c41f9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09cbde4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f09c415d460 con 0x7f09c40b5750 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09cbde4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f09c415d2e0 con 0x7f09c40b5ce0 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09cbde4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f09c415d5e0 con 0x7f09c4156010 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09c9b80640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09c40b5750 0x7f09c4151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09c9b80640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09c40b5750 0x7f09c4151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33324/0 (socket says 172.21.15.146:33324) 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09c9b80640 1 -- 172.21.15.146:0/2983270536 learned_addr learned my addr 172.21.15.146:0/2983270536 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09ca381640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c4156010 0x7f09c41f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09c937f640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09c40b5ce0 0x7f09c41f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09c9b80640 1 -- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c4156010 msgr2=0x7f09c41f9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09c9b80640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c4156010 0x7f09c41f9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09c9b80640 1 -- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09c40b5ce0 msgr2=0x7f09c41f8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09c9b80640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09c40b5ce0 0x7f09c41f8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09c9b80640 1 -- 172.21.15.146:0/2983270536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c41f9b50 con 0x7f09c40b5750 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09ca381640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c4156010 0x7f09c41f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:07.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.812+0000 7f09c937f640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09c40b5ce0 0x7f09c41f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:07.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.813+0000 7f09c9b80640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09c40b5750 0x7f09c4151210 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f09c000d780 tx=0x7f09c000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:07.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.813+0000 7f09ba7fc640 1 -- 172.21.15.146:0/2983270536 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0017070 con 0x7f09c40b5750 2024-09-17T03:41:07.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.813+0000 7f09ba7fc640 1 -- 172.21.15.146:0/2983270536 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09c000de90 con 0x7f09c40b5750 2024-09-17T03:41:07.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.813+0000 7f09ba7fc640 1 -- 172.21.15.146:0/2983270536 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c00099d0 con 0x7f09c40b5750 2024-09-17T03:41:07.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.813+0000 7f09cbde4640 1 -- 172.21.15.146:0/2983270536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c4156770 con 0x7f09c40b5750 2024-09-17T03:41:07.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.813+0000 7f09cbde4640 1 -- 172.21.15.146:0/2983270536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c41f9850 con 0x7f09c40b5750 2024-09-17T03:41:07.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.814+0000 7f09cbde4640 1 -- 172.21.15.146:0/2983270536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c4156560 con 0x7f09c40b5750 2024-09-17T03:41:07.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.815+0000 7f09ba7fc640 1 -- 172.21.15.146:0/2983270536 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09c0009b70 con 0x7f09c40b5750 2024-09-17T03:41:07.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.815+0000 7f09ba7fc640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09a8078b90 0x7f09a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:07.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.815+0000 7f09ba7fc640 1 -- 172.21.15.146:0/2983270536 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f09c009b140 con 0x7f09c40b5750 2024-09-17T03:41:07.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.815+0000 7f09c937f640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09a8078b90 0x7f09a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:07.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.816+0000 7f09c937f640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09a8078b90 0x7f09a807b0a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f09c41580a0 tx=0x7f09b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:07.819+0000 7f09ba7fc640 1 -- 172.21.15.146:0/2983270536 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f09c0020020 con 0x7f09c40b5750 2024-09-17T03:41:08.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.032+0000 7f09cbde4640 1 -- 172.21.15.146:0/2983270536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09c415daa0 con 0x7f09c40b5750 2024-09-17T03:41:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.033+0000 7f09ba7fc640 1 -- 172.21.15.146:0/2983270536 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7f09c0063590 con 0x7f09c40b5750 2024-09-17T03:41:08.032 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:08.032 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 -- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09a8078b90 msgr2=0x7f09a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09a8078b90 0x7f09a807b0a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f09c41580a0 tx=0x7f09b4009040 comp rx=0 tx=0).stop 2024-09-17T03:41:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 -- 172.21.15.146:0/2983270536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09c40b5750 msgr2=0x7f09c4151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09c40b5750 0x7f09c4151210 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f09c000d780 tx=0x7f09c000dc40 comp rx=0 tx=0).stop 2024-09-17T03:41:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 -- 172.21.15.146:0/2983270536 shutdown_connections 2024-09-17T03:41:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09a8078b90 0x7f09a807b0a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09c4156010 0x7f09c41f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09c40b5ce0 0x7f09c41f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 --2- 172.21.15.146:0/2983270536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09c40b5750 0x7f09c4151210 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 -- 172.21.15.146:0/2983270536 >> 172.21.15.146:0/2983270536 conn(0x7f09c40b7b20 msgr2=0x7f09c40d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 -- 172.21.15.146:0/2983270536 shutdown_connections 2024-09-17T03:41:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.035+0000 7f09cbde4640 1 -- 172.21.15.146:0/2983270536 wait complete. 2024-09-17T03:41:08.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:41:08.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.159+0000 7f3a7f17b640 1 -- 172.21.15.146:0/239372067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a780d0710 msgr2=0x7f3a780cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.159+0000 7f3a7f17b640 1 --2- 172.21.15.146:0/239372067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a780d0710 0x7f3a780cf170 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f3a780d0b20 tx=0x7f3a6c02a560 comp rx=0 tx=0).stop 2024-09-17T03:41:08.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.159+0000 7f3a7f17b640 1 -- 172.21.15.146:0/239372067 shutdown_connections 2024-09-17T03:41:08.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.159+0000 7f3a7f17b640 1 --2- 172.21.15.146:0/239372067 >> v2:172.21.15.179:3300/0 conn(0x7f3a780cf6b0 0x7f3a78161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.159+0000 7f3a7f17b640 1 --2- 172.21.15.146:0/239372067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a780d0710 0x7f3a780cf170 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.159+0000 7f3a7f17b640 1 -- 172.21.15.146:0/239372067 >> 172.21.15.146:0/239372067 conn(0x7f3a7809ba20 msgr2=0x7f3a780b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:08.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.159+0000 7f3a7f17b640 1 -- 172.21.15.146:0/239372067 shutdown_connections 2024-09-17T03:41:08.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.159+0000 7f3a7f17b640 1 -- 172.21.15.146:0/239372067 wait complete. 2024-09-17T03:41:08.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.161+0000 7f3a7f17b640 1 Processor -- start 2024-09-17T03:41:08.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.161+0000 7f3a7f17b640 1 -- start start 2024-09-17T03:41:08.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7f17b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a780b47c0 0x7f3a780c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7f17b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a780cf6b0 0x7f3a78156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7f17b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a780d0710 0x7f3a780b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7f17b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3a780b1de0 con 0x7f3a780d0710 2024-09-17T03:41:08.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7f17b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a78162080 con 0x7f3a780b47c0 2024-09-17T03:41:08.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7f17b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3a780b1f60 con 0x7f3a780cf6b0 2024-09-17T03:41:08.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7d718640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a780d0710 0x7f3a780b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7d718640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a780d0710 0x7f3a780b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33350/0 (socket says 172.21.15.146:33350) 2024-09-17T03:41:08.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7d718640 1 -- 172.21.15.146:0/2264351338 learned_addr learned my addr 172.21.15.146:0/2264351338 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7cf17640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a780b47c0 0x7f3a780c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a77fff640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a780cf6b0 0x7f3a78156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7d718640 1 -- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a780cf6b0 msgr2=0x7f3a78156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7d718640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a780cf6b0 0x7f3a78156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7d718640 1 -- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a780b47c0 msgr2=0x7f3a780c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7d718640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a780b47c0 0x7f3a780c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7d718640 1 -- 172.21.15.146:0/2264351338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a780c90f0 con 0x7f3a780d0710 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7d718640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a780d0710 0x7f3a780b0980 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c6b0 tx=0x7f3a7000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a757fa640 1 -- 172.21.15.146:0/2264351338 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70003b70 con 0x7f3a780d0710 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a757fa640 1 -- 172.21.15.146:0/2264351338 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a70003d30 con 0x7f3a780d0710 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7f17b640 1 -- 172.21.15.146:0/2264351338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a7815bcd0 con 0x7f3a780d0710 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a757fa640 1 -- 172.21.15.146:0/2264351338 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70005330 con 0x7f3a780d0710 2024-09-17T03:41:08.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.163+0000 7f3a7f17b640 1 -- 172.21.15.146:0/2264351338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a7815b1f0 con 0x7f3a780d0710 2024-09-17T03:41:08.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.165+0000 7f3a7f17b640 1 -- 172.21.15.146:0/2264351338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a780b3150 con 0x7f3a780d0710 2024-09-17T03:41:08.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.165+0000 7f3a757fa640 1 -- 172.21.15.146:0/2264351338 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a700054d0 con 0x7f3a780d0710 2024-09-17T03:41:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.166+0000 7f3a757fa640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078bc0 0x7f3a5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.166+0000 7f3a757fa640 1 -- 172.21.15.146:0/2264351338 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f3a7009a8a0 con 0x7f3a780d0710 2024-09-17T03:41:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.166+0000 7f3a7cf17640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078bc0 0x7f3a5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.166+0000 7f3a7cf17640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078bc0 0x7f3a5c07b0d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c033000 tx=0x7f3a6c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.170+0000 7f3a757fa640 1 -- 172.21.15.146:0/2264351338 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a780b3150 con 0x7f3a780d0710 2024-09-17T03:41:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.344+0000 7f3a7f17b640 1 -- 172.21.15.146:0/2264351338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a780cf170 con 0x7f3a780d0710 2024-09-17T03:41:08.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.345+0000 7f3a757fa640 1 -- 172.21.15.146:0/2264351338 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16787 (secure 0 0 0) 0x7f3a780c90f0 con 0x7f3a780d0710 2024-09-17T03:41:08.345 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:08.345 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":130,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:41:05.664992+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:41:01.662178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T03:41:02.986445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:41:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 -- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078bc0 msgr2=0x7f3a5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078bc0 0x7f3a5c07b0d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c033000 tx=0x7f3a6c004730 comp rx=0 tx=0).stop 2024-09-17T03:41:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 -- 172.21.15.146:0/2264351338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a780d0710 msgr2=0x7f3a780b0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a780d0710 0x7f3a780b0980 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c6b0 tx=0x7f3a7000cb70 comp rx=0 tx=0).stop 2024-09-17T03:41:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 -- 172.21.15.146:0/2264351338 shutdown_connections 2024-09-17T03:41:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078bc0 0x7f3a5c07b0d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a780d0710 0x7f3a780b0980 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a780cf6b0 0x7f3a78156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 --2- 172.21.15.146:0/2264351338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a780b47c0 0x7f3a780c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 -- 172.21.15.146:0/2264351338 >> 172.21.15.146:0/2264351338 conn(0x7f3a7809ba20 msgr2=0x7f3a780d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:08.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 -- 172.21.15.146:0/2264351338 shutdown_connections 2024-09-17T03:41:08.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.348+0000 7f3a7f17b640 1 -- 172.21.15.146:0/2264351338 wait complete. 2024-09-17T03:41:08.359 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:41:08.359 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:41:08.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.475+0000 7f9f1ef52640 1 -- 172.21.15.146:0/3362490220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f180b3360 msgr2=0x7f9f18072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.475+0000 7f9f1ef52640 1 --2- 172.21.15.146:0/3362490220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f180b3360 0x7f9f18072df0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f9f180b3120 tx=0x7f9f0802a560 comp rx=0 tx=0).stop 2024-09-17T03:41:08.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.475+0000 7f9f1ef52640 1 -- 172.21.15.146:0/3362490220 shutdown_connections 2024-09-17T03:41:08.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.475+0000 7f9f1ef52640 1 --2- 172.21.15.146:0/3362490220 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f1815f010 0x7f9f181515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.475+0000 7f9f1ef52640 1 --2- 172.21.15.146:0/3362490220 >> v2:172.21.15.179:3300/0 conn(0x7f9f180cfc40 0x7f9f1815ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.475+0000 7f9f1ef52640 1 --2- 172.21.15.146:0/3362490220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f180b3360 0x7f9f18072df0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.475+0000 7f9f1ef52640 1 -- 172.21.15.146:0/3362490220 >> 172.21.15.146:0/3362490220 conn(0x7f9f180b2060 msgr2=0x7f9f180b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:08.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.475+0000 7f9f1ef52640 1 -- 172.21.15.146:0/3362490220 shutdown_connections 2024-09-17T03:41:08.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.475+0000 7f9f1ef52640 1 -- 172.21.15.146:0/3362490220 wait complete. 2024-09-17T03:41:08.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.476+0000 7f9f1ef52640 1 Processor -- start 2024-09-17T03:41:08.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.476+0000 7f9f1ef52640 1 -- start start 2024-09-17T03:41:08.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1ef52640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f180b3360 0x7f9f18151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1ef52640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f180cfc40 0x7f9f18141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1ef52640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1815f010 0x7f9f1814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1ef52640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1806e800 con 0x7f9f1815f010 2024-09-17T03:41:08.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1ef52640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1806e680 con 0x7f9f180b3360 2024-09-17T03:41:08.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1ef52640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9f1806e980 con 0x7f9f180cfc40 2024-09-17T03:41:08.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1d4ef640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1815f010 0x7f9f1814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1d4ef640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1815f010 0x7f9f1814ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33370/0 (socket says 172.21.15.146:33370) 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1d4ef640 1 -- 172.21.15.146:0/1560508361 learned_addr learned my addr 172.21.15.146:0/1560508361 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f17fff640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f180cfc40 0x7f9f18141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1ccee640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f180b3360 0x7f9f18151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1d4ef640 1 -- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f180cfc40 msgr2=0x7f9f18141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1d4ef640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f180cfc40 0x7f9f18141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1d4ef640 1 -- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f180b3360 msgr2=0x7f9f18151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1d4ef640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f180b3360 0x7f9f18151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1d4ef640 1 -- 172.21.15.146:0/1560508361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1814af20 con 0x7f9f1815f010 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.478+0000 7f9f1d4ef640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1815f010 0x7f9f1814ccd0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000d690 tx=0x7f9f1000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.479+0000 7f9f157fa640 1 -- 172.21.15.146:0/1560508361 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10017070 con 0x7f9f1815f010 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.479+0000 7f9f157fa640 1 -- 172.21.15.146:0/1560508361 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f10005310 con 0x7f9f1815f010 2024-09-17T03:41:08.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.479+0000 7f9f1ef52640 1 -- 172.21.15.146:0/1560508361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1814b200 con 0x7f9f1815f010 2024-09-17T03:41:08.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.479+0000 7f9f157fa640 1 -- 172.21.15.146:0/1560508361 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10009820 con 0x7f9f1815f010 2024-09-17T03:41:08.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.479+0000 7f9f1ef52640 1 -- 172.21.15.146:0/1560508361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f1814b7c0 con 0x7f9f1815f010 2024-09-17T03:41:08.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.480+0000 7f9f1ef52640 1 -- 172.21.15.146:0/1560508361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f1815ead0 con 0x7f9f1815f010 2024-09-17T03:41:08.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.480+0000 7f9f157fa640 1 -- 172.21.15.146:0/1560508361 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f100099c0 con 0x7f9f1815f010 2024-09-17T03:41:08.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.481+0000 7f9f157fa640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f04078bc0 0x7f9f0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.481+0000 7f9f157fa640 1 -- 172.21.15.146:0/1560508361 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f9f1009ac40 con 0x7f9f1815f010 2024-09-17T03:41:08.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.481+0000 7f9f1ccee640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f04078bc0 0x7f9f0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.482+0000 7f9f1ccee640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f04078bc0 0x7f9f0407b0d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9f08033000 tx=0x7f9f08004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:08.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.485+0000 7f9f157fa640 1 -- 172.21.15.146:0/1560508361 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9f10062ac0 con 0x7f9f1815f010 2024-09-17T03:41:08.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.657+0000 7f9f1ef52640 1 -- 172.21.15.146:0/1560508361 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f1814fcd0 con 0x7f9f04078bc0 2024-09-17T03:41:08.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.662+0000 7f9f157fa640 1 -- 172.21.15.146:0/1560508361 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248127 (secure 0 0 0) 0x7f9f1814fcd0 con 0x7f9f04078bc0 2024-09-17T03:41:08.664 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:08.666 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:41:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.665+0000 7f9f1ef52640 1 -- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f04078bc0 msgr2=0x7f9f0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.665+0000 7f9f1ef52640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f04078bc0 0x7f9f0407b0d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9f08033000 tx=0x7f9f08004730 comp rx=0 tx=0).stop 2024-09-17T03:41:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.665+0000 7f9f1ef52640 1 -- 172.21.15.146:0/1560508361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1815f010 msgr2=0x7f9f1814ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.665+0000 7f9f1ef52640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1815f010 0x7f9f1814ccd0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000d690 tx=0x7f9f1000db50 comp rx=0 tx=0).stop 2024-09-17T03:41:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.666+0000 7f9f1ef52640 1 -- 172.21.15.146:0/1560508361 shutdown_connections 2024-09-17T03:41:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.666+0000 7f9f1ef52640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f04078bc0 0x7f9f0407b0d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.666+0000 7f9f1ef52640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f1815f010 0x7f9f1814ccd0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.666+0000 7f9f1ef52640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f180cfc40 0x7f9f18141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.666+0000 7f9f1ef52640 1 --2- 172.21.15.146:0/1560508361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f180b3360 0x7f9f18151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.666+0000 7f9f1ef52640 1 -- 172.21.15.146:0/1560508361 >> 172.21.15.146:0/1560508361 conn(0x7f9f180b2060 msgr2=0x7f9f180b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.666+0000 7f9f1ef52640 1 -- 172.21.15.146:0/1560508361 shutdown_connections 2024-09-17T03:41:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.666+0000 7f9f1ef52640 1 -- 172.21.15.146:0/1560508361 wait complete. 2024-09-17T03:41:08.676 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2024-09-17T03:41:07.920492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":107,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":372868,"kb_used_data":13640,"kb_used_omap":12,"kb_used_meta":359027,"kb_avail":754601852,"statfs":{"total":773094113280,"available":772712296448,"internally_reserved":0,"allocated":13967360,"data_stored":6760670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":367644209},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.267526"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668389+0000","last_change":"2024-09-17T03:41:03.668389+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668389+0000","last_undegraded":"2024-09-17T03:41:03.668389+0000","last_fullsized":"2024-09-17T03:41:03.668389+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.664358+0000","last_change":"2024-09-17T03:41:03.664358+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.664358+0000","last_undegraded":"2024-09-17T03:41:03.664358+0000","last_fullsized":"2024-09-17T03:41:03.664358+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660671+0000","last_change":"2024-09-17T03:41:03.660671+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660671+0000","last_undegraded":"2024-09-17T03:41:03.660671+0000","last_fullsized":"2024-09-17T03:41:03.660671+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665901+0000","last_change":"2024-09-17T03:41:03.665901+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665901+0000","last_undegraded":"2024-09-17T03:41:03.665901+0000","last_fullsized":"2024-09-17T03:41:03.665901+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666474+0000","last_change":"2024-09-17T03:41:03.666474+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666474+0000","last_undegraded":"2024-09-17T03:41:03.666474+0000","last_fullsized":"2024-09-17T03:41:03.666474+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661120+0000","last_change":"2024-09-17T03:41:03.661120+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661120+0000","last_undegraded":"2024-09-17T03:41:03.661120+0000","last_fullsized":"2024-09-17T03:41:03.661120+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662424+0000","last_change":"2024-09-17T03:41:03.662424+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662424+0000","last_undegraded":"2024-09-17T03:41:03.662424+0000","last_fullsized":"2024-09-17T03:41:03.662424+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659572+0000","last_change":"2024-09-17T03:41:03.659572+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659572+0000","last_undegraded":"2024-09-17T03:41:03.659572+0000","last_fullsized":"2024-09-17T03:41:03.659572+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661229+0000","last_change":"2024-09-17T03:41:03.661229+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661229+0000","last_undegraded":"2024-09-17T03:41:03.661229+0000","last_fullsized":"2024-09-17T03:41:03.661229+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663835+0000","last_change":"2024-09-17T03:41:03.663835+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663835+0000","last_undegraded":"2024-09-17T03:41:03.663835+0000","last_fullsized":"2024-09-17T03:41:03.663835+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662386+0000","last_change":"2024-09-17T03:41:03.662386+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662386+0000","last_undegraded":"2024-09-17T03:41:03.662386+0000","last_fullsized":"2024-09-17T03:41:03.662386+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659424+0000","last_change":"2024-09-17T03:41:03.659424+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659424+0000","last_undegraded":"2024-09-17T03:41:03.659424+0000","last_fullsized":"2024-09-17T03:41:03.659424+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668363+0000","last_change":"2024-09-17T03:41:03.668363+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668363+0000","last_undegraded":"2024-09-17T03:41:03.668363+0000","last_fullsized":"2024-09-17T03:41:03.668363+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663736+0000","last_change":"2024-09-17T03:41:03.663736+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663736+0000","last_undegraded":"2024-09-17T03:41:03.663736+0000","last_fullsized":"2024-09-17T03:41:03.663736+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665838+0000","last_change":"2024-09-17T03:41:03.665838+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665838+0000","last_undegraded":"2024-09-17T03:41:03.665838+0000","last_fullsized":"2024-09-17T03:41:03.665838+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775951+0000","last_change":"2024-09-17T03:41:04.684317+0000","last_active":"2024-09-17T03:41:05.775951+0000","last_peered":"2024-09-17T03:41:05.775951+0000","last_clean":"2024-09-17T03:41:05.775951+0000","last_became_active":"2024-09-17T03:41:04.682665+0000","last_became_peered":"2024-09-17T03:41:04.682665+0000","last_unstale":"2024-09-17T03:41:05.775951+0000","last_undegraded":"2024-09-17T03:41:05.775951+0000","last_fullsized":"2024-09-17T03:41:05.775951+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:26.514663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662489+0000","last_change":"2024-09-17T03:41:03.662489+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662489+0000","last_undegraded":"2024-09-17T03:41:03.662489+0000","last_fullsized":"2024-09-17T03:41:03.662489+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776176+0000","last_change":"2024-09-17T03:41:04.672835+0000","last_active":"2024-09-17T03:41:05.776176+0000","last_peered":"2024-09-17T03:41:05.776176+0000","last_clean":"2024-09-17T03:41:05.776176+0000","last_became_active":"2024-09-17T03:41:04.672536+0000","last_became_peered":"2024-09-17T03:41:04.672536+0000","last_unstale":"2024-09-17T03:41:05.776176+0000","last_undegraded":"2024-09-17T03:41:05.776176+0000","last_fullsized":"2024-09-17T03:41:05.776176+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:20.558673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661907+0000","last_change":"2024-09-17T03:41:03.661907+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661907+0000","last_undegraded":"2024-09-17T03:41:03.661907+0000","last_fullsized":"2024-09-17T03:41:03.661907+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776267+0000","last_change":"2024-09-17T03:41:04.681101+0000","last_active":"2024-09-17T03:41:05.776267+0000","last_peered":"2024-09-17T03:41:05.776267+0000","last_clean":"2024-09-17T03:41:05.776267+0000","last_became_active":"2024-09-17T03:41:04.678923+0000","last_became_peered":"2024-09-17T03:41:04.678923+0000","last_unstale":"2024-09-17T03:41:05.776267+0000","last_undegraded":"2024-09-17T03:41:05.776267+0000","last_fullsized":"2024-09-17T03:41:05.776267+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:04.887694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668038+0000","last_change":"2024-09-17T03:41:03.668038+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668038+0000","last_undegraded":"2024-09-17T03:41:03.668038+0000","last_fullsized":"2024-09-17T03:41:03.668038+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661114+0000","last_change":"2024-09-17T03:41:03.661114+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661114+0000","last_undegraded":"2024-09-17T03:41:03.661114+0000","last_fullsized":"2024-09-17T03:41:03.661114+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.658915+0000","last_change":"2024-09-17T03:41:03.658915+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.658915+0000","last_undegraded":"2024-09-17T03:41:03.658915+0000","last_fullsized":"2024-09-17T03:41:03.658915+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661399+0000","last_change":"2024-09-17T03:41:03.661399+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661399+0000","last_undegraded":"2024-09-17T03:41:03.661399+0000","last_fullsized":"2024-09-17T03:41:03.661399+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663743+0000","last_change":"2024-09-17T03:41:03.663743+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663743+0000","last_undegraded":"2024-09-17T03:41:03.663743+0000","last_fullsized":"2024-09-17T03:41:03.663743+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776200+0000","last_change":"2024-09-17T03:41:04.674681+0000","last_active":"2024-09-17T03:41:05.776200+0000","last_peered":"2024-09-17T03:41:05.776200+0000","last_clean":"2024-09-17T03:41:05.776200+0000","last_became_active":"2024-09-17T03:41:04.674347+0000","last_became_peered":"2024-09-17T03:41:04.674347+0000","last_unstale":"2024-09-17T03:41:05.776200+0000","last_undegraded":"2024-09-17T03:41:05.776200+0000","last_fullsized":"2024-09-17T03:41:05.776200+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:54.420791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665301+0000","last_change":"2024-09-17T03:41:03.665301+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665301+0000","last_undegraded":"2024-09-17T03:41:03.665301+0000","last_fullsized":"2024-09-17T03:41:03.665301+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992621+0000","last_change":"2024-09-17T03:41:04.680689+0000","last_active":"2024-09-17T03:41:05.992621+0000","last_peered":"2024-09-17T03:41:05.992621+0000","last_clean":"2024-09-17T03:41:05.992621+0000","last_became_active":"2024-09-17T03:41:04.680384+0000","last_became_peered":"2024-09-17T03:41:04.680384+0000","last_unstale":"2024-09-17T03:41:05.992621+0000","last_undegraded":"2024-09-17T03:41:05.992621+0000","last_fullsized":"2024-09-17T03:41:05.992621+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:16.107400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.667902+0000","last_change":"2024-09-17T03:41:03.667902+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.667902+0000","last_undegraded":"2024-09-17T03:41:03.667902+0000","last_fullsized":"2024-09-17T03:41:03.667902+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666662+0000","last_change":"2024-09-17T03:41:03.666662+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666662+0000","last_undegraded":"2024-09-17T03:41:03.666662+0000","last_fullsized":"2024-09-17T03:41:03.666662+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.669042+0000","last_change":"2024-09-17T03:41:03.669042+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.669042+0000","last_undegraded":"2024-09-17T03:41:03.669042+0000","last_fullsized":"2024-09-17T03:41:03.669042+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659148+0000","last_change":"2024-09-17T03:41:03.659148+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659148+0000","last_undegraded":"2024-09-17T03:41:03.659148+0000","last_fullsized":"2024-09-17T03:41:03.659148+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776437+0000","last_change":"2024-09-17T03:41:04.676577+0000","last_active":"2024-09-17T03:41:05.776437+0000","last_peered":"2024-09-17T03:41:05.776437+0000","last_clean":"2024-09-17T03:41:05.776437+0000","last_became_active":"2024-09-17T03:41:04.676246+0000","last_became_peered":"2024-09-17T03:41:04.676246+0000","last_unstale":"2024-09-17T03:41:05.776437+0000","last_undegraded":"2024-09-17T03:41:05.776437+0000","last_fullsized":"2024-09-17T03:41:05.776437+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:18.595167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.677378+0000","last_change":"2024-09-17T03:41:03.676165+0000","last_active":"2024-09-17T03:41:03.677378+0000","last_peered":"2024-09-17T03:41:03.677378+0000","last_clean":"2024-09-17T03:41:03.677378+0000","last_became_active":"2024-09-17T03:41:03.675800+0000","last_became_peered":"2024-09-17T03:41:03.675800+0000","last_unstale":"2024-09-17T03:41:03.677378+0000","last_undegraded":"2024-09-17T03:41:03.677378+0000","last_fullsized":"2024-09-17T03:41:03.677378+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:49.812724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659794+0000","last_change":"2024-09-17T03:41:03.659794+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659794+0000","last_undegraded":"2024-09-17T03:41:03.659794+0000","last_fullsized":"2024-09-17T03:41:03.659794+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992676+0000","last_change":"2024-09-17T03:41:03.674308+0000","last_active":"2024-09-17T03:41:05.992676+0000","last_peered":"2024-09-17T03:41:05.992676+0000","last_clean":"2024-09-17T03:41:05.992676+0000","last_became_active":"2024-09-17T03:41:03.673437+0000","last_became_peered":"2024-09-17T03:41:03.673437+0000","last_unstale":"2024-09-17T03:41:05.992676+0000","last_undegraded":"2024-09-17T03:41:05.992676+0000","last_fullsized":"2024-09-17T03:41:05.992676+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:26.761000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668568+0000","last_change":"2024-09-17T03:41:03.668568+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668568+0000","last_undegraded":"2024-09-17T03:41:03.668568+0000","last_fullsized":"2024-09-17T03:41:03.668568+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676256+0000","last_change":"2024-09-17T03:41:03.673481+0000","last_active":"2024-09-17T03:41:03.676256+0000","last_peered":"2024-09-17T03:41:03.676256+0000","last_clean":"2024-09-17T03:41:03.676256+0000","last_became_active":"2024-09-17T03:41:03.673184+0000","last_became_peered":"2024-09-17T03:41:03.673184+0000","last_unstale":"2024-09-17T03:41:03.676256+0000","last_undegraded":"2024-09-17T03:41:03.676256+0000","last_fullsized":"2024-09-17T03:41:03.676256+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:41.960307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668682+0000","last_change":"2024-09-17T03:41:03.668682+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668682+0000","last_undegraded":"2024-09-17T03:41:03.668682+0000","last_fullsized":"2024-09-17T03:41:03.668682+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.675302+0000","last_change":"2024-09-17T03:41:03.670618+0000","last_active":"2024-09-17T03:41:03.675302+0000","last_peered":"2024-09-17T03:41:03.675302+0000","last_clean":"2024-09-17T03:41:03.675302+0000","last_became_active":"2024-09-17T03:41:03.670320+0000","last_became_peered":"2024-09-17T03:41:03.670320+0000","last_unstale":"2024-09-17T03:41:03.675302+0000","last_undegraded":"2024-09-17T03:41:03.675302+0000","last_fullsized":"2024-09-17T03:41:03.675302+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:42.426871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775936+0000","last_change":"2024-09-17T03:41:04.681945+0000","last_active":"2024-09-17T03:41:05.775936+0000","last_peered":"2024-09-17T03:41:05.775936+0000","last_clean":"2024-09-17T03:41:05.775936+0000","last_became_active":"2024-09-17T03:41:04.680316+0000","last_became_peered":"2024-09-17T03:41:04.680316+0000","last_unstale":"2024-09-17T03:41:05.775936+0000","last_undegraded":"2024-09-17T03:41:05.775936+0000","last_fullsized":"2024-09-17T03:41:05.775936+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:13.616492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676783+0000","last_change":"2024-09-17T03:41:03.675301+0000","last_active":"2024-09-17T03:41:03.676783+0000","last_peered":"2024-09-17T03:41:03.676783+0000","last_clean":"2024-09-17T03:41:03.676783+0000","last_became_active":"2024-09-17T03:41:03.675002+0000","last_became_peered":"2024-09-17T03:41:03.675002+0000","last_unstale":"2024-09-17T03:41:03.676783+0000","last_undegraded":"2024-09-17T03:41:03.676783+0000","last_fullsized":"2024-09-17T03:41:03.676783+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:06.938494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659787+0000","last_change":"2024-09-17T03:41:03.659787+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659787+0000","last_undegraded":"2024-09-17T03:41:03.659787+0000","last_fullsized":"2024-09-17T03:41:03.659787+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775855+0000","last_change":"2024-09-17T03:41:03.676747+0000","last_active":"2024-09-17T03:41:05.775855+0000","last_peered":"2024-09-17T03:41:05.775855+0000","last_clean":"2024-09-17T03:41:05.775855+0000","last_became_active":"2024-09-17T03:41:03.676034+0000","last_became_peered":"2024-09-17T03:41:03.676034+0000","last_unstale":"2024-09-17T03:41:05.775855+0000","last_undegraded":"2024-09-17T03:41:05.775855+0000","last_fullsized":"2024-09-17T03:41:05.775855+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:54.137997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659028+0000","last_change":"2024-09-17T03:41:03.659028+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659028+0000","last_undegraded":"2024-09-17T03:41:03.659028+0000","last_fullsized":"2024-09-17T03:41:03.659028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674444+0000","last_change":"2024-09-17T03:41:03.672674+0000","last_active":"2024-09-17T03:41:03.674444+0000","last_peered":"2024-09-17T03:41:03.674444+0000","last_clean":"2024-09-17T03:41:03.674444+0000","last_became_active":"2024-09-17T03:41:03.672235+0000","last_became_peered":"2024-09-17T03:41:03.672235+0000","last_unstale":"2024-09-17T03:41:03.674444+0000","last_undegraded":"2024-09-17T03:41:03.674444+0000","last_fullsized":"2024-09-17T03:41:03.674444+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:19.598620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663216+0000","last_change":"2024-09-17T03:41:03.663216+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663216+0000","last_undegraded":"2024-09-17T03:41:03.663216+0000","last_fullsized":"2024-09-17T03:41:03.663216+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.669948+0000","last_change":"2024-09-17T03:41:03.666881+0000","last_active":"2024-09-17T03:41:03.669948+0000","last_peered":"2024-09-17T03:41:03.669948+0000","last_clean":"2024-09-17T03:41:03.669948+0000","last_became_active":"2024-09-17T03:41:03.666536+0000","last_became_peered":"2024-09-17T03:41:03.666536+0000","last_unstale":"2024-09-17T03:41:03.669948+0000","last_undegraded":"2024-09-17T03:41:03.669948+0000","last_fullsized":"2024-09-17T03:41:03.669948+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:17.836632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665544+0000","last_change":"2024-09-17T03:41:03.665544+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665544+0000","last_undegraded":"2024-09-17T03:41:03.665544+0000","last_fullsized":"2024-09-17T03:41:03.665544+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992979+0000","last_change":"2024-09-17T03:41:03.675807+0000","last_active":"2024-09-17T03:41:05.992979+0000","last_peered":"2024-09-17T03:41:05.992979+0000","last_clean":"2024-09-17T03:41:05.992979+0000","last_became_active":"2024-09-17T03:41:03.675416+0000","last_became_peered":"2024-09-17T03:41:03.675416+0000","last_unstale":"2024-09-17T03:41:05.992979+0000","last_undegraded":"2024-09-17T03:41:05.992979+0000","last_fullsized":"2024-09-17T03:41:05.992979+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:38.733293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992833+0000","last_change":"2024-09-17T03:41:04.677308+0000","last_active":"2024-09-17T03:41:05.992833+0000","last_peered":"2024-09-17T03:41:05.992833+0000","last_clean":"2024-09-17T03:41:05.992833+0000","last_became_active":"2024-09-17T03:41:04.677003+0000","last_became_peered":"2024-09-17T03:41:04.677003+0000","last_unstale":"2024-09-17T03:41:05.992833+0000","last_undegraded":"2024-09-17T03:41:05.992833+0000","last_fullsized":"2024-09-17T03:41:05.992833+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:55.994505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776317+0000","last_change":"2024-09-17T03:41:03.671819+0000","last_active":"2024-09-17T03:41:05.776317+0000","last_peered":"2024-09-17T03:41:05.776317+0000","last_clean":"2024-09-17T03:41:05.776317+0000","last_became_active":"2024-09-17T03:41:03.671499+0000","last_became_peered":"2024-09-17T03:41:03.671499+0000","last_unstale":"2024-09-17T03:41:05.776317+0000","last_undegraded":"2024-09-17T03:41:05.776317+0000","last_fullsized":"2024-09-17T03:41:05.776317+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:31.784168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668052+0000","last_change":"2024-09-17T03:41:03.668052+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668052+0000","last_undegraded":"2024-09-17T03:41:03.668052+0000","last_fullsized":"2024-09-17T03:41:03.668052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"129'3","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992455+0000","last_change":"2024-09-17T03:41:03.673293+0000","last_active":"2024-09-17T03:41:05.992455+0000","last_peered":"2024-09-17T03:41:05.992455+0000","last_clean":"2024-09-17T03:41:05.992455+0000","last_became_active":"2024-09-17T03:41:03.672799+0000","last_became_peered":"2024-09-17T03:41:03.672799+0000","last_unstale":"2024-09-17T03:41:05.992455+0000","last_undegraded":"2024-09-17T03:41:05.992455+0000","last_fullsized":"2024-09-17T03:41:05.992455+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:27.089366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666707+0000","last_change":"2024-09-17T03:41:03.666707+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666707+0000","last_undegraded":"2024-09-17T03:41:03.666707+0000","last_fullsized":"2024-09-17T03:41:03.666707+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674435+0000","last_change":"2024-09-17T03:41:03.673721+0000","last_active":"2024-09-17T03:41:03.674435+0000","last_peered":"2024-09-17T03:41:03.674435+0000","last_clean":"2024-09-17T03:41:03.674435+0000","last_became_active":"2024-09-17T03:41:03.673378+0000","last_became_peered":"2024-09-17T03:41:03.673378+0000","last_unstale":"2024-09-17T03:41:03.674435+0000","last_undegraded":"2024-09-17T03:41:03.674435+0000","last_fullsized":"2024-09-17T03:41:03.674435+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:55.881455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666691+0000","last_change":"2024-09-17T03:41:03.666691+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666691+0000","last_undegraded":"2024-09-17T03:41:03.666691+0000","last_fullsized":"2024-09-17T03:41:03.666691+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674516+0000","last_change":"2024-09-17T03:41:03.672669+0000","last_active":"2024-09-17T03:41:03.674516+0000","last_peered":"2024-09-17T03:41:03.674516+0000","last_clean":"2024-09-17T03:41:03.674516+0000","last_became_active":"2024-09-17T03:41:03.672086+0000","last_became_peered":"2024-09-17T03:41:03.672086+0000","last_unstale":"2024-09-17T03:41:03.674516+0000","last_undegraded":"2024-09-17T03:41:03.674516+0000","last_fullsized":"2024-09-17T03:41:03.674516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:08.990017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662623+0000","last_change":"2024-09-17T03:41:03.662623+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662623+0000","last_undegraded":"2024-09-17T03:41:03.662623+0000","last_fullsized":"2024-09-17T03:41:03.662623+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676848+0000","last_change":"2024-09-17T03:41:03.674227+0000","last_active":"2024-09-17T03:41:03.676848+0000","last_peered":"2024-09-17T03:41:03.676848+0000","last_clean":"2024-09-17T03:41:03.676848+0000","last_became_active":"2024-09-17T03:41:03.673934+0000","last_became_peered":"2024-09-17T03:41:03.673934+0000","last_unstale":"2024-09-17T03:41:03.676848+0000","last_undegraded":"2024-09-17T03:41:03.676848+0000","last_fullsized":"2024-09-17T03:41:03.676848+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:27.858015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660821+0000","last_change":"2024-09-17T03:41:03.660821+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660821+0000","last_undegraded":"2024-09-17T03:41:03.660821+0000","last_fullsized":"2024-09-17T03:41:03.660821+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.671946+0000","last_change":"2024-09-17T03:41:03.671146+0000","last_active":"2024-09-17T03:41:03.671946+0000","last_peered":"2024-09-17T03:41:03.671946+0000","last_clean":"2024-09-17T03:41:03.671946+0000","last_became_active":"2024-09-17T03:41:03.670717+0000","last_became_peered":"2024-09-17T03:41:03.670717+0000","last_unstale":"2024-09-17T03:41:03.671946+0000","last_undegraded":"2024-09-17T03:41:03.671946+0000","last_fullsized":"2024-09-17T03:41:03.671946+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:22.067124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659964+0000","last_change":"2024-09-17T03:41:03.659964+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659964+0000","last_undegraded":"2024-09-17T03:41:03.659964+0000","last_fullsized":"2024-09-17T03:41:03.659964+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993043+0000","last_change":"2024-09-17T03:41:03.673614+0000","last_active":"2024-09-17T03:41:05.993043+0000","last_peered":"2024-09-17T03:41:05.993043+0000","last_clean":"2024-09-17T03:41:05.993043+0000","last_became_active":"2024-09-17T03:41:03.672276+0000","last_became_peered":"2024-09-17T03:41:03.672276+0000","last_unstale":"2024-09-17T03:41:05.993043+0000","last_undegraded":"2024-09-17T03:41:05.993043+0000","last_fullsized":"2024-09-17T03:41:05.993043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:58.982726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992933+0000","last_change":"2024-09-17T03:41:04.671325+0000","last_active":"2024-09-17T03:41:05.992933+0000","last_peered":"2024-09-17T03:41:05.992933+0000","last_clean":"2024-09-17T03:41:05.992933+0000","last_became_active":"2024-09-17T03:41:04.670508+0000","last_became_peered":"2024-09-17T03:41:04.670508+0000","last_unstale":"2024-09-17T03:41:05.992933+0000","last_undegraded":"2024-09-17T03:41:05.992933+0000","last_fullsized":"2024-09-17T03:41:05.992933+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:54.939814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.672772+0000","last_change":"2024-09-17T03:41:03.670284+0000","last_active":"2024-09-17T03:41:03.672772+0000","last_peered":"2024-09-17T03:41:03.672772+0000","last_clean":"2024-09-17T03:41:03.672772+0000","last_became_active":"2024-09-17T03:41:03.668681+0000","last_became_peered":"2024-09-17T03:41:03.668681+0000","last_unstale":"2024-09-17T03:41:03.672772+0000","last_undegraded":"2024-09-17T03:41:03.672772+0000","last_fullsized":"2024-09-17T03:41:03.672772+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:08.382715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776233+0000","last_change":"2024-09-17T03:41:04.679337+0000","last_active":"2024-09-17T03:41:05.776233+0000","last_peered":"2024-09-17T03:41:05.776233+0000","last_clean":"2024-09-17T03:41:05.776233+0000","last_became_active":"2024-09-17T03:41:04.677967+0000","last_became_peered":"2024-09-17T03:41:04.677967+0000","last_unstale":"2024-09-17T03:41:05.776233+0000","last_undegraded":"2024-09-17T03:41:05.776233+0000","last_fullsized":"2024-09-17T03:41:05.776233+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:05.761345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674540+0000","last_change":"2024-09-17T03:41:03.672925+0000","last_active":"2024-09-17T03:41:03.674540+0000","last_peered":"2024-09-17T03:41:03.674540+0000","last_clean":"2024-09-17T03:41:03.674540+0000","last_became_active":"2024-09-17T03:41:03.672614+0000","last_became_peered":"2024-09-17T03:41:03.672614+0000","last_unstale":"2024-09-17T03:41:03.674540+0000","last_undegraded":"2024-09-17T03:41:03.674540+0000","last_fullsized":"2024-09-17T03:41:03.674540+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:20.355934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661416+0000","last_change":"2024-09-17T03:41:03.661416+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661416+0000","last_undegraded":"2024-09-17T03:41:03.661416+0000","last_fullsized":"2024-09-17T03:41:03.661416+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992493+0000","last_change":"2024-09-17T03:41:03.669334+0000","last_active":"2024-09-17T03:41:05.992493+0000","last_peered":"2024-09-17T03:41:05.992493+0000","last_clean":"2024-09-17T03:41:05.992493+0000","last_became_active":"2024-09-17T03:41:03.669018+0000","last_became_peered":"2024-09-17T03:41:03.669018+0000","last_unstale":"2024-09-17T03:41:05.992493+0000","last_undegraded":"2024-09-17T03:41:05.992493+0000","last_fullsized":"2024-09-17T03:41:05.992493+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:10.640755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666052+0000","last_change":"2024-09-17T03:41:03.666052+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666052+0000","last_undegraded":"2024-09-17T03:41:03.666052+0000","last_fullsized":"2024-09-17T03:41:03.666052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992516+0000","last_change":"2024-09-17T03:41:03.676603+0000","last_active":"2024-09-17T03:41:05.992516+0000","last_peered":"2024-09-17T03:41:05.992516+0000","last_clean":"2024-09-17T03:41:05.992516+0000","last_became_active":"2024-09-17T03:41:03.676265+0000","last_became_peered":"2024-09-17T03:41:03.676265+0000","last_unstale":"2024-09-17T03:41:05.992516+0000","last_undegraded":"2024-09-17T03:41:05.992516+0000","last_fullsized":"2024-09-17T03:41:05.992516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:49.453780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659305+0000","last_change":"2024-09-17T03:41:03.659305+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659305+0000","last_undegraded":"2024-09-17T03:41:03.659305+0000","last_fullsized":"2024-09-17T03:41:03.659305+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776059+0000","last_change":"2024-09-17T03:41:03.675991+0000","last_active":"2024-09-17T03:41:05.776059+0000","last_peered":"2024-09-17T03:41:05.776059+0000","last_clean":"2024-09-17T03:41:05.776059+0000","last_became_active":"2024-09-17T03:41:03.671518+0000","last_became_peered":"2024-09-17T03:41:03.671518+0000","last_unstale":"2024-09-17T03:41:05.776059+0000","last_undegraded":"2024-09-17T03:41:05.776059+0000","last_fullsized":"2024-09-17T03:41:05.776059+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:48.342701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661138+0000","last_change":"2024-09-17T03:41:03.661138+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661138+0000","last_undegraded":"2024-09-17T03:41:03.661138+0000","last_fullsized":"2024-09-17T03:41:03.661138+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775781+0000","last_change":"2024-09-17T03:41:03.668667+0000","last_active":"2024-09-17T03:41:05.775781+0000","last_peered":"2024-09-17T03:41:05.775781+0000","last_clean":"2024-09-17T03:41:05.775781+0000","last_became_active":"2024-09-17T03:41:03.668333+0000","last_became_peered":"2024-09-17T03:41:03.668333+0000","last_unstale":"2024-09-17T03:41:05.775781+0000","last_undegraded":"2024-09-17T03:41:05.775781+0000","last_fullsized":"2024-09-17T03:41:05.775781+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:10.629109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.669492+0000","last_change":"2024-09-17T03:41:03.669492+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.669492+0000","last_undegraded":"2024-09-17T03:41:03.669492+0000","last_fullsized":"2024-09-17T03:41:03.669492+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.672738+0000","last_change":"2024-09-17T03:41:03.669613+0000","last_active":"2024-09-17T03:41:03.672738+0000","last_peered":"2024-09-17T03:41:03.672738+0000","last_clean":"2024-09-17T03:41:03.672738+0000","last_became_active":"2024-09-17T03:41:03.669217+0000","last_became_peered":"2024-09-17T03:41:03.669217+0000","last_unstale":"2024-09-17T03:41:03.672738+0000","last_undegraded":"2024-09-17T03:41:03.672738+0000","last_fullsized":"2024-09-17T03:41:03.672738+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:54.056149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660865+0000","last_change":"2024-09-17T03:41:03.660865+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660865+0000","last_undegraded":"2024-09-17T03:41:03.660865+0000","last_fullsized":"2024-09-17T03:41:03.660865+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.677237+0000","last_change":"2024-09-17T03:41:03.675319+0000","last_active":"2024-09-17T03:41:03.677237+0000","last_peered":"2024-09-17T03:41:03.677237+0000","last_clean":"2024-09-17T03:41:03.677237+0000","last_became_active":"2024-09-17T03:41:03.673645+0000","last_became_peered":"2024-09-17T03:41:03.673645+0000","last_unstale":"2024-09-17T03:41:03.677237+0000","last_undegraded":"2024-09-17T03:41:03.677237+0000","last_fullsized":"2024-09-17T03:41:03.677237+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:30.261494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668855+0000","last_change":"2024-09-17T03:41:03.668855+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668855+0000","last_undegraded":"2024-09-17T03:41:03.668855+0000","last_fullsized":"2024-09-17T03:41:03.668855+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676207+0000","last_change":"2024-09-17T03:41:03.675332+0000","last_active":"2024-09-17T03:41:03.676207+0000","last_peered":"2024-09-17T03:41:03.676207+0000","last_clean":"2024-09-17T03:41:03.676207+0000","last_became_active":"2024-09-17T03:41:03.674332+0000","last_became_peered":"2024-09-17T03:41:03.674332+0000","last_unstale":"2024-09-17T03:41:03.676207+0000","last_undegraded":"2024-09-17T03:41:03.676207+0000","last_fullsized":"2024-09-17T03:41:03.676207+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:54.397168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660772+0000","last_change":"2024-09-17T03:41:03.660772+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660772+0000","last_undegraded":"2024-09-17T03:41:03.660772+0000","last_fullsized":"2024-09-17T03:41:03.660772+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.669869+0000","last_change":"2024-09-17T03:41:03.666881+0000","last_active":"2024-09-17T03:41:03.669869+0000","last_peered":"2024-09-17T03:41:03.669869+0000","last_clean":"2024-09-17T03:41:03.669869+0000","last_became_active":"2024-09-17T03:41:03.666310+0000","last_became_peered":"2024-09-17T03:41:03.666310+0000","last_unstale":"2024-09-17T03:41:03.669869+0000","last_undegraded":"2024-09-17T03:41:03.669869+0000","last_fullsized":"2024-09-17T03:41:03.669869+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:34.354857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660107+0000","last_change":"2024-09-17T03:41:03.660107+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660107+0000","last_undegraded":"2024-09-17T03:41:03.660107+0000","last_fullsized":"2024-09-17T03:41:03.660107+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.673804+0000","last_change":"2024-09-17T03:41:03.671833+0000","last_active":"2024-09-17T03:41:03.673804+0000","last_peered":"2024-09-17T03:41:03.673804+0000","last_clean":"2024-09-17T03:41:03.673804+0000","last_became_active":"2024-09-17T03:41:03.671461+0000","last_became_peered":"2024-09-17T03:41:03.671461+0000","last_unstale":"2024-09-17T03:41:03.673804+0000","last_undegraded":"2024-09-17T03:41:03.673804+0000","last_fullsized":"2024-09-17T03:41:03.673804+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:42.632227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668196+0000","last_change":"2024-09-17T03:41:03.668196+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668196+0000","last_undegraded":"2024-09-17T03:41:03.668196+0000","last_fullsized":"2024-09-17T03:41:03.668196+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676755+0000","last_change":"2024-09-17T03:41:03.674559+0000","last_active":"2024-09-17T03:41:03.676755+0000","last_peered":"2024-09-17T03:41:03.676755+0000","last_clean":"2024-09-17T03:41:03.676755+0000","last_became_active":"2024-09-17T03:41:03.674262+0000","last_became_peered":"2024-09-17T03:41:03.674262+0000","last_unstale":"2024-09-17T03:41:03.676755+0000","last_undegraded":"2024-09-17T03:41:03.676755+0000","last_fullsized":"2024-09-17T03:41:03.676755+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:50.186518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992647+0000","last_change":"2024-09-17T03:41:04.683290+0000","last_active":"2024-09-17T03:41:05.992647+0000","last_peered":"2024-09-17T03:41:05.992647+0000","last_clean":"2024-09-17T03:41:05.992647+0000","last_became_active":"2024-09-17T03:41:04.682914+0000","last_became_peered":"2024-09-17T03:41:04.682914+0000","last_unstale":"2024-09-17T03:41:05.992647+0000","last_undegraded":"2024-09-17T03:41:05.992647+0000","last_fullsized":"2024-09-17T03:41:05.992647+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:41.050865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.678605+0000","last_change":"2024-09-17T03:41:03.678154+0000","last_active":"2024-09-17T03:41:03.678605+0000","last_peered":"2024-09-17T03:41:03.678605+0000","last_clean":"2024-09-17T03:41:03.678605+0000","last_became_active":"2024-09-17T03:41:03.677792+0000","last_became_peered":"2024-09-17T03:41:03.677792+0000","last_unstale":"2024-09-17T03:41:03.678605+0000","last_undegraded":"2024-09-17T03:41:03.678605+0000","last_fullsized":"2024-09-17T03:41:03.678605+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:15.308921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776116+0000","last_change":"2024-09-17T03:41:04.679711+0000","last_active":"2024-09-17T03:41:05.776116+0000","last_peered":"2024-09-17T03:41:05.776116+0000","last_clean":"2024-09-17T03:41:05.776116+0000","last_became_active":"2024-09-17T03:41:04.677950+0000","last_became_peered":"2024-09-17T03:41:04.677950+0000","last_unstale":"2024-09-17T03:41:05.776116+0000","last_undegraded":"2024-09-17T03:41:05.776116+0000","last_fullsized":"2024-09-17T03:41:05.776116+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:28.312827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775980+0000","last_change":"2024-09-17T03:41:03.666191+0000","last_active":"2024-09-17T03:41:05.775980+0000","last_peered":"2024-09-17T03:41:05.775980+0000","last_clean":"2024-09-17T03:41:05.775980+0000","last_became_active":"2024-09-17T03:41:03.665893+0000","last_became_peered":"2024-09-17T03:41:03.665893+0000","last_unstale":"2024-09-17T03:41:05.775980+0000","last_undegraded":"2024-09-17T03:41:05.775980+0000","last_fullsized":"2024-09-17T03:41:05.775980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:18.129464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661116+0000","last_change":"2024-09-17T03:41:03.661116+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661116+0000","last_undegraded":"2024-09-17T03:41:03.661116+0000","last_fullsized":"2024-09-17T03:41:03.661116+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.671432+0000","last_change":"2024-09-17T03:41:03.668313+0000","last_active":"2024-09-17T03:41:03.671432+0000","last_peered":"2024-09-17T03:41:03.671432+0000","last_clean":"2024-09-17T03:41:03.671432+0000","last_became_active":"2024-09-17T03:41:03.668025+0000","last_became_peered":"2024-09-17T03:41:03.668025+0000","last_unstale":"2024-09-17T03:41:03.671432+0000","last_undegraded":"2024-09-17T03:41:03.671432+0000","last_fullsized":"2024-09-17T03:41:03.671432+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:33.753544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666007+0000","last_change":"2024-09-17T03:41:03.666007+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666007+0000","last_undegraded":"2024-09-17T03:41:03.666007+0000","last_fullsized":"2024-09-17T03:41:03.666007+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.677397+0000","last_change":"2024-09-17T03:41:03.676588+0000","last_active":"2024-09-17T03:41:03.677397+0000","last_peered":"2024-09-17T03:41:03.677397+0000","last_clean":"2024-09-17T03:41:03.677397+0000","last_became_active":"2024-09-17T03:41:03.676281+0000","last_became_peered":"2024-09-17T03:41:03.676281+0000","last_unstale":"2024-09-17T03:41:03.677397+0000","last_undegraded":"2024-09-17T03:41:03.677397+0000","last_fullsized":"2024-09-17T03:41:03.677397+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:21.048654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":307,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.670871+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:41:03.670871+0000","last_peered":"2024-09-17T03:41:03.670871+0000","last_clean":"2024-09-17T03:41:03.670871+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:41:03.670871+0000","last_undegraded":"2024-09-17T03:41:03.670871+0000","last_fullsized":"2024-09-17T03:41:03.670871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29164,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342676,"statfs":{"total":96636764160,"available":96606900224,"internally_reserved":0,"allocated":2183168,"data_stored":1284557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50792,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509543,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50792,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509543,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46632,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325208,"statfs":{"total":96636764160,"available":96589012992,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50796,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321044,"statfs":{"total":96636764160,"available":96584749056,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47212,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324628,"statfs":{"total":96636764160,"available":96588419072,"internally_reserved":0,"allocated":2183168,"data_stored":1284557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46660,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325180,"statfs":{"total":96636764160,"available":96588984320,"internally_reserved":0,"allocated":1622016,"data_stored":707376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50820,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321020,"statfs":{"total":96636764160,"available":96584724480,"internally_reserved":0,"allocated":1622016,"data_stored":707424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:41:08.681 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:41:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.831+0000 7f5e89b39640 1 -- 172.21.15.146:0/1374828420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415f1a0 msgr2=0x7f5e840cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.831+0000 7f5e89b39640 1 --2- 172.21.15.146:0/1374828420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415f1a0 0x7f5e840cfca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e74005fd0 tx=0x7f5e7402a540 comp rx=0 tx=0).stop 2024-09-17T03:41:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.831+0000 7f5e89b39640 1 -- 172.21.15.146:0/1374828420 shutdown_connections 2024-09-17T03:41:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.831+0000 7f5e89b39640 1 --2- 172.21.15.146:0/1374828420 >> v2:172.21.15.179:3300/0 conn(0x7f5e841631a0 0x7f5e840cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.831+0000 7f5e89b39640 1 --2- 172.21.15.146:0/1374828420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415f1a0 0x7f5e840cfca0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.831+0000 7f5e89b39640 1 -- 172.21.15.146:0/1374828420 >> 172.21.15.146:0/1374828420 conn(0x7f5e840d11f0 msgr2=0x7f5e840d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.832+0000 7f5e89b39640 1 -- 172.21.15.146:0/1374828420 shutdown_connections 2024-09-17T03:41:08.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.832+0000 7f5e89b39640 1 -- 172.21.15.146:0/1374828420 wait complete. 2024-09-17T03:41:08.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.833+0000 7f5e89b39640 1 Processor -- start 2024-09-17T03:41:08.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.833+0000 7f5e89b39640 1 -- start start 2024-09-17T03:41:08.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e89b39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e840b61f0 0x7f5e8414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e89b39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415f1a0 0x7f5e841f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e89b39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e841631a0 0x7f5e840cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e89b39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840695b0 con 0x7f5e840b61f0 2024-09-17T03:41:08.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e89b39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84069430 con 0x7f5e841631a0 2024-09-17T03:41:08.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e89b39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5e84069730 con 0x7f5e8415f1a0 2024-09-17T03:41:08.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e837fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e840b61f0 0x7f5e8414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e837fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e840b61f0 0x7f5e8414eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33376/0 (socket says 172.21.15.146:33376) 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e837fe640 1 -- 172.21.15.146:0/4177564193 learned_addr learned my addr 172.21.15.146:0/4177564193 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e82ffd640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415f1a0 0x7f5e841f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e83fff640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e841631a0 0x7f5e840cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e837fe640 1 -- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415f1a0 msgr2=0x7f5e841f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e837fe640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415f1a0 0x7f5e841f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e837fe640 1 -- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e841631a0 msgr2=0x7f5e840cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e837fe640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e841631a0 0x7f5e840cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e837fe640 1 -- 172.21.15.146:0/4177564193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8415c0f0 con 0x7f5e840b61f0 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.835+0000 7f5e837fe640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e840b61f0 0x7f5e8414eed0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f5e74000c00 tx=0x7f5e740038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.836+0000 7f5e6bfff640 1 -- 172.21.15.146:0/4177564193 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7403e030 con 0x7f5e840b61f0 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.836+0000 7f5e6bfff640 1 -- 172.21.15.146:0/4177564193 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e74003db0 con 0x7f5e840b61f0 2024-09-17T03:41:08.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.836+0000 7f5e89b39640 1 -- 172.21.15.146:0/4177564193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e841f6120 con 0x7f5e840b61f0 2024-09-17T03:41:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.836+0000 7f5e6bfff640 1 -- 172.21.15.146:0/4177564193 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74035040 con 0x7f5e840b61f0 2024-09-17T03:41:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.836+0000 7f5e89b39640 1 -- 172.21.15.146:0/4177564193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e8415bb30 con 0x7f5e840b61f0 2024-09-17T03:41:08.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.837+0000 7f5e89b39640 1 -- 172.21.15.146:0/4177564193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e84069be0 con 0x7f5e840b61f0 2024-09-17T03:41:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.837+0000 7f5e6bfff640 1 -- 172.21.15.146:0/4177564193 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e74041030 con 0x7f5e840b61f0 2024-09-17T03:41:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.838+0000 7f5e6bfff640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e70078b90 0x7f5e7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.838+0000 7f5e6bfff640 1 -- 172.21.15.146:0/4177564193 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f5e740bb360 con 0x7f5e840b61f0 2024-09-17T03:41:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.838+0000 7f5e82ffd640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e70078b90 0x7f5e7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.839+0000 7f5e82ffd640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e70078b90 0x7f5e7007b0a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5e780095f0 tx=0x7f5e78005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:08.843+0000 7f5e6bfff640 1 -- 172.21.15.146:0/4177564193 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e740831e0 con 0x7f5e840b61f0 2024-09-17T03:41:09.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.013+0000 7f5e89b39640 1 -- 172.21.15.146:0/4177564193 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e840c7ff0 con 0x7f5e70078b90 2024-09-17T03:41:09.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.018+0000 7f5e6bfff640 1 -- 172.21.15.146:0/4177564193 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248127 (secure 0 0 0) 0x7f5e840c7ff0 con 0x7f5e70078b90 2024-09-17T03:41:09.020 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:09.021 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:41:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 -- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e70078b90 msgr2=0x7f5e7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e70078b90 0x7f5e7007b0a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5e780095f0 tx=0x7f5e78005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 -- 172.21.15.146:0/4177564193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e840b61f0 msgr2=0x7f5e8414eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e840b61f0 0x7f5e8414eed0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f5e74000c00 tx=0x7f5e740038a0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 -- 172.21.15.146:0/4177564193 shutdown_connections 2024-09-17T03:41:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e70078b90 0x7f5e7007b0a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e841631a0 0x7f5e840cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e8415f1a0 0x7f5e841f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 --2- 172.21.15.146:0/4177564193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e840b61f0 0x7f5e8414eed0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 -- 172.21.15.146:0/4177564193 >> 172.21.15.146:0/4177564193 conn(0x7f5e840d11f0 msgr2=0x7f5e8415d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:09.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 -- 172.21.15.146:0/4177564193 shutdown_connections 2024-09-17T03:41:09.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.021+0000 7f5e89b39640 1 -- 172.21.15.146:0/4177564193 wait complete. 2024-09-17T03:41:09.032 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2024-09-17T03:41:07.920492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":107,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":372868,"kb_used_data":13640,"kb_used_omap":12,"kb_used_meta":359027,"kb_avail":754601852,"statfs":{"total":773094113280,"available":772712296448,"internally_reserved":0,"allocated":13967360,"data_stored":6760670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":367644209},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.267526"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668389+0000","last_change":"2024-09-17T03:41:03.668389+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668389+0000","last_undegraded":"2024-09-17T03:41:03.668389+0000","last_fullsized":"2024-09-17T03:41:03.668389+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.664358+0000","last_change":"2024-09-17T03:41:03.664358+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.664358+0000","last_undegraded":"2024-09-17T03:41:03.664358+0000","last_fullsized":"2024-09-17T03:41:03.664358+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660671+0000","last_change":"2024-09-17T03:41:03.660671+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660671+0000","last_undegraded":"2024-09-17T03:41:03.660671+0000","last_fullsized":"2024-09-17T03:41:03.660671+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665901+0000","last_change":"2024-09-17T03:41:03.665901+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665901+0000","last_undegraded":"2024-09-17T03:41:03.665901+0000","last_fullsized":"2024-09-17T03:41:03.665901+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666474+0000","last_change":"2024-09-17T03:41:03.666474+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666474+0000","last_undegraded":"2024-09-17T03:41:03.666474+0000","last_fullsized":"2024-09-17T03:41:03.666474+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661120+0000","last_change":"2024-09-17T03:41:03.661120+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661120+0000","last_undegraded":"2024-09-17T03:41:03.661120+0000","last_fullsized":"2024-09-17T03:41:03.661120+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662424+0000","last_change":"2024-09-17T03:41:03.662424+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662424+0000","last_undegraded":"2024-09-17T03:41:03.662424+0000","last_fullsized":"2024-09-17T03:41:03.662424+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659572+0000","last_change":"2024-09-17T03:41:03.659572+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659572+0000","last_undegraded":"2024-09-17T03:41:03.659572+0000","last_fullsized":"2024-09-17T03:41:03.659572+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661229+0000","last_change":"2024-09-17T03:41:03.661229+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661229+0000","last_undegraded":"2024-09-17T03:41:03.661229+0000","last_fullsized":"2024-09-17T03:41:03.661229+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663835+0000","last_change":"2024-09-17T03:41:03.663835+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663835+0000","last_undegraded":"2024-09-17T03:41:03.663835+0000","last_fullsized":"2024-09-17T03:41:03.663835+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662386+0000","last_change":"2024-09-17T03:41:03.662386+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662386+0000","last_undegraded":"2024-09-17T03:41:03.662386+0000","last_fullsized":"2024-09-17T03:41:03.662386+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659424+0000","last_change":"2024-09-17T03:41:03.659424+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659424+0000","last_undegraded":"2024-09-17T03:41:03.659424+0000","last_fullsized":"2024-09-17T03:41:03.659424+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668363+0000","last_change":"2024-09-17T03:41:03.668363+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668363+0000","last_undegraded":"2024-09-17T03:41:03.668363+0000","last_fullsized":"2024-09-17T03:41:03.668363+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663736+0000","last_change":"2024-09-17T03:41:03.663736+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663736+0000","last_undegraded":"2024-09-17T03:41:03.663736+0000","last_fullsized":"2024-09-17T03:41:03.663736+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665838+0000","last_change":"2024-09-17T03:41:03.665838+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665838+0000","last_undegraded":"2024-09-17T03:41:03.665838+0000","last_fullsized":"2024-09-17T03:41:03.665838+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775951+0000","last_change":"2024-09-17T03:41:04.684317+0000","last_active":"2024-09-17T03:41:05.775951+0000","last_peered":"2024-09-17T03:41:05.775951+0000","last_clean":"2024-09-17T03:41:05.775951+0000","last_became_active":"2024-09-17T03:41:04.682665+0000","last_became_peered":"2024-09-17T03:41:04.682665+0000","last_unstale":"2024-09-17T03:41:05.775951+0000","last_undegraded":"2024-09-17T03:41:05.775951+0000","last_fullsized":"2024-09-17T03:41:05.775951+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:26.514663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662489+0000","last_change":"2024-09-17T03:41:03.662489+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662489+0000","last_undegraded":"2024-09-17T03:41:03.662489+0000","last_fullsized":"2024-09-17T03:41:03.662489+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776176+0000","last_change":"2024-09-17T03:41:04.672835+0000","last_active":"2024-09-17T03:41:05.776176+0000","last_peered":"2024-09-17T03:41:05.776176+0000","last_clean":"2024-09-17T03:41:05.776176+0000","last_became_active":"2024-09-17T03:41:04.672536+0000","last_became_peered":"2024-09-17T03:41:04.672536+0000","last_unstale":"2024-09-17T03:41:05.776176+0000","last_undegraded":"2024-09-17T03:41:05.776176+0000","last_fullsized":"2024-09-17T03:41:05.776176+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:20.558673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661907+0000","last_change":"2024-09-17T03:41:03.661907+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661907+0000","last_undegraded":"2024-09-17T03:41:03.661907+0000","last_fullsized":"2024-09-17T03:41:03.661907+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776267+0000","last_change":"2024-09-17T03:41:04.681101+0000","last_active":"2024-09-17T03:41:05.776267+0000","last_peered":"2024-09-17T03:41:05.776267+0000","last_clean":"2024-09-17T03:41:05.776267+0000","last_became_active":"2024-09-17T03:41:04.678923+0000","last_became_peered":"2024-09-17T03:41:04.678923+0000","last_unstale":"2024-09-17T03:41:05.776267+0000","last_undegraded":"2024-09-17T03:41:05.776267+0000","last_fullsized":"2024-09-17T03:41:05.776267+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:04.887694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668038+0000","last_change":"2024-09-17T03:41:03.668038+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668038+0000","last_undegraded":"2024-09-17T03:41:03.668038+0000","last_fullsized":"2024-09-17T03:41:03.668038+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661114+0000","last_change":"2024-09-17T03:41:03.661114+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661114+0000","last_undegraded":"2024-09-17T03:41:03.661114+0000","last_fullsized":"2024-09-17T03:41:03.661114+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.658915+0000","last_change":"2024-09-17T03:41:03.658915+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.658915+0000","last_undegraded":"2024-09-17T03:41:03.658915+0000","last_fullsized":"2024-09-17T03:41:03.658915+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661399+0000","last_change":"2024-09-17T03:41:03.661399+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661399+0000","last_undegraded":"2024-09-17T03:41:03.661399+0000","last_fullsized":"2024-09-17T03:41:03.661399+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663743+0000","last_change":"2024-09-17T03:41:03.663743+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663743+0000","last_undegraded":"2024-09-17T03:41:03.663743+0000","last_fullsized":"2024-09-17T03:41:03.663743+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776200+0000","last_change":"2024-09-17T03:41:04.674681+0000","last_active":"2024-09-17T03:41:05.776200+0000","last_peered":"2024-09-17T03:41:05.776200+0000","last_clean":"2024-09-17T03:41:05.776200+0000","last_became_active":"2024-09-17T03:41:04.674347+0000","last_became_peered":"2024-09-17T03:41:04.674347+0000","last_unstale":"2024-09-17T03:41:05.776200+0000","last_undegraded":"2024-09-17T03:41:05.776200+0000","last_fullsized":"2024-09-17T03:41:05.776200+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:54.420791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665301+0000","last_change":"2024-09-17T03:41:03.665301+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665301+0000","last_undegraded":"2024-09-17T03:41:03.665301+0000","last_fullsized":"2024-09-17T03:41:03.665301+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992621+0000","last_change":"2024-09-17T03:41:04.680689+0000","last_active":"2024-09-17T03:41:05.992621+0000","last_peered":"2024-09-17T03:41:05.992621+0000","last_clean":"2024-09-17T03:41:05.992621+0000","last_became_active":"2024-09-17T03:41:04.680384+0000","last_became_peered":"2024-09-17T03:41:04.680384+0000","last_unstale":"2024-09-17T03:41:05.992621+0000","last_undegraded":"2024-09-17T03:41:05.992621+0000","last_fullsized":"2024-09-17T03:41:05.992621+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:16.107400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.667902+0000","last_change":"2024-09-17T03:41:03.667902+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.667902+0000","last_undegraded":"2024-09-17T03:41:03.667902+0000","last_fullsized":"2024-09-17T03:41:03.667902+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666662+0000","last_change":"2024-09-17T03:41:03.666662+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666662+0000","last_undegraded":"2024-09-17T03:41:03.666662+0000","last_fullsized":"2024-09-17T03:41:03.666662+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.669042+0000","last_change":"2024-09-17T03:41:03.669042+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.669042+0000","last_undegraded":"2024-09-17T03:41:03.669042+0000","last_fullsized":"2024-09-17T03:41:03.669042+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659148+0000","last_change":"2024-09-17T03:41:03.659148+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659148+0000","last_undegraded":"2024-09-17T03:41:03.659148+0000","last_fullsized":"2024-09-17T03:41:03.659148+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776437+0000","last_change":"2024-09-17T03:41:04.676577+0000","last_active":"2024-09-17T03:41:05.776437+0000","last_peered":"2024-09-17T03:41:05.776437+0000","last_clean":"2024-09-17T03:41:05.776437+0000","last_became_active":"2024-09-17T03:41:04.676246+0000","last_became_peered":"2024-09-17T03:41:04.676246+0000","last_unstale":"2024-09-17T03:41:05.776437+0000","last_undegraded":"2024-09-17T03:41:05.776437+0000","last_fullsized":"2024-09-17T03:41:05.776437+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:18.595167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.677378+0000","last_change":"2024-09-17T03:41:03.676165+0000","last_active":"2024-09-17T03:41:03.677378+0000","last_peered":"2024-09-17T03:41:03.677378+0000","last_clean":"2024-09-17T03:41:03.677378+0000","last_became_active":"2024-09-17T03:41:03.675800+0000","last_became_peered":"2024-09-17T03:41:03.675800+0000","last_unstale":"2024-09-17T03:41:03.677378+0000","last_undegraded":"2024-09-17T03:41:03.677378+0000","last_fullsized":"2024-09-17T03:41:03.677378+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:49.812724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659794+0000","last_change":"2024-09-17T03:41:03.659794+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659794+0000","last_undegraded":"2024-09-17T03:41:03.659794+0000","last_fullsized":"2024-09-17T03:41:03.659794+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992676+0000","last_change":"2024-09-17T03:41:03.674308+0000","last_active":"2024-09-17T03:41:05.992676+0000","last_peered":"2024-09-17T03:41:05.992676+0000","last_clean":"2024-09-17T03:41:05.992676+0000","last_became_active":"2024-09-17T03:41:03.673437+0000","last_became_peered":"2024-09-17T03:41:03.673437+0000","last_unstale":"2024-09-17T03:41:05.992676+0000","last_undegraded":"2024-09-17T03:41:05.992676+0000","last_fullsized":"2024-09-17T03:41:05.992676+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:26.761000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668568+0000","last_change":"2024-09-17T03:41:03.668568+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668568+0000","last_undegraded":"2024-09-17T03:41:03.668568+0000","last_fullsized":"2024-09-17T03:41:03.668568+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676256+0000","last_change":"2024-09-17T03:41:03.673481+0000","last_active":"2024-09-17T03:41:03.676256+0000","last_peered":"2024-09-17T03:41:03.676256+0000","last_clean":"2024-09-17T03:41:03.676256+0000","last_became_active":"2024-09-17T03:41:03.673184+0000","last_became_peered":"2024-09-17T03:41:03.673184+0000","last_unstale":"2024-09-17T03:41:03.676256+0000","last_undegraded":"2024-09-17T03:41:03.676256+0000","last_fullsized":"2024-09-17T03:41:03.676256+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:41.960307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668682+0000","last_change":"2024-09-17T03:41:03.668682+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668682+0000","last_undegraded":"2024-09-17T03:41:03.668682+0000","last_fullsized":"2024-09-17T03:41:03.668682+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.675302+0000","last_change":"2024-09-17T03:41:03.670618+0000","last_active":"2024-09-17T03:41:03.675302+0000","last_peered":"2024-09-17T03:41:03.675302+0000","last_clean":"2024-09-17T03:41:03.675302+0000","last_became_active":"2024-09-17T03:41:03.670320+0000","last_became_peered":"2024-09-17T03:41:03.670320+0000","last_unstale":"2024-09-17T03:41:03.675302+0000","last_undegraded":"2024-09-17T03:41:03.675302+0000","last_fullsized":"2024-09-17T03:41:03.675302+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:42.426871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775936+0000","last_change":"2024-09-17T03:41:04.681945+0000","last_active":"2024-09-17T03:41:05.775936+0000","last_peered":"2024-09-17T03:41:05.775936+0000","last_clean":"2024-09-17T03:41:05.775936+0000","last_became_active":"2024-09-17T03:41:04.680316+0000","last_became_peered":"2024-09-17T03:41:04.680316+0000","last_unstale":"2024-09-17T03:41:05.775936+0000","last_undegraded":"2024-09-17T03:41:05.775936+0000","last_fullsized":"2024-09-17T03:41:05.775936+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:13.616492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676783+0000","last_change":"2024-09-17T03:41:03.675301+0000","last_active":"2024-09-17T03:41:03.676783+0000","last_peered":"2024-09-17T03:41:03.676783+0000","last_clean":"2024-09-17T03:41:03.676783+0000","last_became_active":"2024-09-17T03:41:03.675002+0000","last_became_peered":"2024-09-17T03:41:03.675002+0000","last_unstale":"2024-09-17T03:41:03.676783+0000","last_undegraded":"2024-09-17T03:41:03.676783+0000","last_fullsized":"2024-09-17T03:41:03.676783+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:06.938494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659787+0000","last_change":"2024-09-17T03:41:03.659787+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659787+0000","last_undegraded":"2024-09-17T03:41:03.659787+0000","last_fullsized":"2024-09-17T03:41:03.659787+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775855+0000","last_change":"2024-09-17T03:41:03.676747+0000","last_active":"2024-09-17T03:41:05.775855+0000","last_peered":"2024-09-17T03:41:05.775855+0000","last_clean":"2024-09-17T03:41:05.775855+0000","last_became_active":"2024-09-17T03:41:03.676034+0000","last_became_peered":"2024-09-17T03:41:03.676034+0000","last_unstale":"2024-09-17T03:41:05.775855+0000","last_undegraded":"2024-09-17T03:41:05.775855+0000","last_fullsized":"2024-09-17T03:41:05.775855+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:54.137997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659028+0000","last_change":"2024-09-17T03:41:03.659028+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659028+0000","last_undegraded":"2024-09-17T03:41:03.659028+0000","last_fullsized":"2024-09-17T03:41:03.659028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674444+0000","last_change":"2024-09-17T03:41:03.672674+0000","last_active":"2024-09-17T03:41:03.674444+0000","last_peered":"2024-09-17T03:41:03.674444+0000","last_clean":"2024-09-17T03:41:03.674444+0000","last_became_active":"2024-09-17T03:41:03.672235+0000","last_became_peered":"2024-09-17T03:41:03.672235+0000","last_unstale":"2024-09-17T03:41:03.674444+0000","last_undegraded":"2024-09-17T03:41:03.674444+0000","last_fullsized":"2024-09-17T03:41:03.674444+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:19.598620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663216+0000","last_change":"2024-09-17T03:41:03.663216+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663216+0000","last_undegraded":"2024-09-17T03:41:03.663216+0000","last_fullsized":"2024-09-17T03:41:03.663216+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.669948+0000","last_change":"2024-09-17T03:41:03.666881+0000","last_active":"2024-09-17T03:41:03.669948+0000","last_peered":"2024-09-17T03:41:03.669948+0000","last_clean":"2024-09-17T03:41:03.669948+0000","last_became_active":"2024-09-17T03:41:03.666536+0000","last_became_peered":"2024-09-17T03:41:03.666536+0000","last_unstale":"2024-09-17T03:41:03.669948+0000","last_undegraded":"2024-09-17T03:41:03.669948+0000","last_fullsized":"2024-09-17T03:41:03.669948+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:17.836632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665544+0000","last_change":"2024-09-17T03:41:03.665544+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665544+0000","last_undegraded":"2024-09-17T03:41:03.665544+0000","last_fullsized":"2024-09-17T03:41:03.665544+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992979+0000","last_change":"2024-09-17T03:41:03.675807+0000","last_active":"2024-09-17T03:41:05.992979+0000","last_peered":"2024-09-17T03:41:05.992979+0000","last_clean":"2024-09-17T03:41:05.992979+0000","last_became_active":"2024-09-17T03:41:03.675416+0000","last_became_peered":"2024-09-17T03:41:03.675416+0000","last_unstale":"2024-09-17T03:41:05.992979+0000","last_undegraded":"2024-09-17T03:41:05.992979+0000","last_fullsized":"2024-09-17T03:41:05.992979+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:38.733293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992833+0000","last_change":"2024-09-17T03:41:04.677308+0000","last_active":"2024-09-17T03:41:05.992833+0000","last_peered":"2024-09-17T03:41:05.992833+0000","last_clean":"2024-09-17T03:41:05.992833+0000","last_became_active":"2024-09-17T03:41:04.677003+0000","last_became_peered":"2024-09-17T03:41:04.677003+0000","last_unstale":"2024-09-17T03:41:05.992833+0000","last_undegraded":"2024-09-17T03:41:05.992833+0000","last_fullsized":"2024-09-17T03:41:05.992833+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:55.994505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776317+0000","last_change":"2024-09-17T03:41:03.671819+0000","last_active":"2024-09-17T03:41:05.776317+0000","last_peered":"2024-09-17T03:41:05.776317+0000","last_clean":"2024-09-17T03:41:05.776317+0000","last_became_active":"2024-09-17T03:41:03.671499+0000","last_became_peered":"2024-09-17T03:41:03.671499+0000","last_unstale":"2024-09-17T03:41:05.776317+0000","last_undegraded":"2024-09-17T03:41:05.776317+0000","last_fullsized":"2024-09-17T03:41:05.776317+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:31.784168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668052+0000","last_change":"2024-09-17T03:41:03.668052+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668052+0000","last_undegraded":"2024-09-17T03:41:03.668052+0000","last_fullsized":"2024-09-17T03:41:03.668052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"129'3","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992455+0000","last_change":"2024-09-17T03:41:03.673293+0000","last_active":"2024-09-17T03:41:05.992455+0000","last_peered":"2024-09-17T03:41:05.992455+0000","last_clean":"2024-09-17T03:41:05.992455+0000","last_became_active":"2024-09-17T03:41:03.672799+0000","last_became_peered":"2024-09-17T03:41:03.672799+0000","last_unstale":"2024-09-17T03:41:05.992455+0000","last_undegraded":"2024-09-17T03:41:05.992455+0000","last_fullsized":"2024-09-17T03:41:05.992455+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:27.089366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666707+0000","last_change":"2024-09-17T03:41:03.666707+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666707+0000","last_undegraded":"2024-09-17T03:41:03.666707+0000","last_fullsized":"2024-09-17T03:41:03.666707+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674435+0000","last_change":"2024-09-17T03:41:03.673721+0000","last_active":"2024-09-17T03:41:03.674435+0000","last_peered":"2024-09-17T03:41:03.674435+0000","last_clean":"2024-09-17T03:41:03.674435+0000","last_became_active":"2024-09-17T03:41:03.673378+0000","last_became_peered":"2024-09-17T03:41:03.673378+0000","last_unstale":"2024-09-17T03:41:03.674435+0000","last_undegraded":"2024-09-17T03:41:03.674435+0000","last_fullsized":"2024-09-17T03:41:03.674435+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:55.881455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666691+0000","last_change":"2024-09-17T03:41:03.666691+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666691+0000","last_undegraded":"2024-09-17T03:41:03.666691+0000","last_fullsized":"2024-09-17T03:41:03.666691+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674516+0000","last_change":"2024-09-17T03:41:03.672669+0000","last_active":"2024-09-17T03:41:03.674516+0000","last_peered":"2024-09-17T03:41:03.674516+0000","last_clean":"2024-09-17T03:41:03.674516+0000","last_became_active":"2024-09-17T03:41:03.672086+0000","last_became_peered":"2024-09-17T03:41:03.672086+0000","last_unstale":"2024-09-17T03:41:03.674516+0000","last_undegraded":"2024-09-17T03:41:03.674516+0000","last_fullsized":"2024-09-17T03:41:03.674516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:08.990017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662623+0000","last_change":"2024-09-17T03:41:03.662623+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662623+0000","last_undegraded":"2024-09-17T03:41:03.662623+0000","last_fullsized":"2024-09-17T03:41:03.662623+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676848+0000","last_change":"2024-09-17T03:41:03.674227+0000","last_active":"2024-09-17T03:41:03.676848+0000","last_peered":"2024-09-17T03:41:03.676848+0000","last_clean":"2024-09-17T03:41:03.676848+0000","last_became_active":"2024-09-17T03:41:03.673934+0000","last_became_peered":"2024-09-17T03:41:03.673934+0000","last_unstale":"2024-09-17T03:41:03.676848+0000","last_undegraded":"2024-09-17T03:41:03.676848+0000","last_fullsized":"2024-09-17T03:41:03.676848+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:27.858015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660821+0000","last_change":"2024-09-17T03:41:03.660821+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660821+0000","last_undegraded":"2024-09-17T03:41:03.660821+0000","last_fullsized":"2024-09-17T03:41:03.660821+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.671946+0000","last_change":"2024-09-17T03:41:03.671146+0000","last_active":"2024-09-17T03:41:03.671946+0000","last_peered":"2024-09-17T03:41:03.671946+0000","last_clean":"2024-09-17T03:41:03.671946+0000","last_became_active":"2024-09-17T03:41:03.670717+0000","last_became_peered":"2024-09-17T03:41:03.670717+0000","last_unstale":"2024-09-17T03:41:03.671946+0000","last_undegraded":"2024-09-17T03:41:03.671946+0000","last_fullsized":"2024-09-17T03:41:03.671946+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:22.067124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659964+0000","last_change":"2024-09-17T03:41:03.659964+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659964+0000","last_undegraded":"2024-09-17T03:41:03.659964+0000","last_fullsized":"2024-09-17T03:41:03.659964+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993043+0000","last_change":"2024-09-17T03:41:03.673614+0000","last_active":"2024-09-17T03:41:05.993043+0000","last_peered":"2024-09-17T03:41:05.993043+0000","last_clean":"2024-09-17T03:41:05.993043+0000","last_became_active":"2024-09-17T03:41:03.672276+0000","last_became_peered":"2024-09-17T03:41:03.672276+0000","last_unstale":"2024-09-17T03:41:05.993043+0000","last_undegraded":"2024-09-17T03:41:05.993043+0000","last_fullsized":"2024-09-17T03:41:05.993043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:58.982726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992933+0000","last_change":"2024-09-17T03:41:04.671325+0000","last_active":"2024-09-17T03:41:05.992933+0000","last_peered":"2024-09-17T03:41:05.992933+0000","last_clean":"2024-09-17T03:41:05.992933+0000","last_became_active":"2024-09-17T03:41:04.670508+0000","last_became_peered":"2024-09-17T03:41:04.670508+0000","last_unstale":"2024-09-17T03:41:05.992933+0000","last_undegraded":"2024-09-17T03:41:05.992933+0000","last_fullsized":"2024-09-17T03:41:05.992933+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:54.939814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.672772+0000","last_change":"2024-09-17T03:41:03.670284+0000","last_active":"2024-09-17T03:41:03.672772+0000","last_peered":"2024-09-17T03:41:03.672772+0000","last_clean":"2024-09-17T03:41:03.672772+0000","last_became_active":"2024-09-17T03:41:03.668681+0000","last_became_peered":"2024-09-17T03:41:03.668681+0000","last_unstale":"2024-09-17T03:41:03.672772+0000","last_undegraded":"2024-09-17T03:41:03.672772+0000","last_fullsized":"2024-09-17T03:41:03.672772+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:08.382715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776233+0000","last_change":"2024-09-17T03:41:04.679337+0000","last_active":"2024-09-17T03:41:05.776233+0000","last_peered":"2024-09-17T03:41:05.776233+0000","last_clean":"2024-09-17T03:41:05.776233+0000","last_became_active":"2024-09-17T03:41:04.677967+0000","last_became_peered":"2024-09-17T03:41:04.677967+0000","last_unstale":"2024-09-17T03:41:05.776233+0000","last_undegraded":"2024-09-17T03:41:05.776233+0000","last_fullsized":"2024-09-17T03:41:05.776233+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:05.761345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674540+0000","last_change":"2024-09-17T03:41:03.672925+0000","last_active":"2024-09-17T03:41:03.674540+0000","last_peered":"2024-09-17T03:41:03.674540+0000","last_clean":"2024-09-17T03:41:03.674540+0000","last_became_active":"2024-09-17T03:41:03.672614+0000","last_became_peered":"2024-09-17T03:41:03.672614+0000","last_unstale":"2024-09-17T03:41:03.674540+0000","last_undegraded":"2024-09-17T03:41:03.674540+0000","last_fullsized":"2024-09-17T03:41:03.674540+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:20.355934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661416+0000","last_change":"2024-09-17T03:41:03.661416+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661416+0000","last_undegraded":"2024-09-17T03:41:03.661416+0000","last_fullsized":"2024-09-17T03:41:03.661416+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992493+0000","last_change":"2024-09-17T03:41:03.669334+0000","last_active":"2024-09-17T03:41:05.992493+0000","last_peered":"2024-09-17T03:41:05.992493+0000","last_clean":"2024-09-17T03:41:05.992493+0000","last_became_active":"2024-09-17T03:41:03.669018+0000","last_became_peered":"2024-09-17T03:41:03.669018+0000","last_unstale":"2024-09-17T03:41:05.992493+0000","last_undegraded":"2024-09-17T03:41:05.992493+0000","last_fullsized":"2024-09-17T03:41:05.992493+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:10.640755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666052+0000","last_change":"2024-09-17T03:41:03.666052+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666052+0000","last_undegraded":"2024-09-17T03:41:03.666052+0000","last_fullsized":"2024-09-17T03:41:03.666052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992516+0000","last_change":"2024-09-17T03:41:03.676603+0000","last_active":"2024-09-17T03:41:05.992516+0000","last_peered":"2024-09-17T03:41:05.992516+0000","last_clean":"2024-09-17T03:41:05.992516+0000","last_became_active":"2024-09-17T03:41:03.676265+0000","last_became_peered":"2024-09-17T03:41:03.676265+0000","last_unstale":"2024-09-17T03:41:05.992516+0000","last_undegraded":"2024-09-17T03:41:05.992516+0000","last_fullsized":"2024-09-17T03:41:05.992516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:49.453780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659305+0000","last_change":"2024-09-17T03:41:03.659305+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659305+0000","last_undegraded":"2024-09-17T03:41:03.659305+0000","last_fullsized":"2024-09-17T03:41:03.659305+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776059+0000","last_change":"2024-09-17T03:41:03.675991+0000","last_active":"2024-09-17T03:41:05.776059+0000","last_peered":"2024-09-17T03:41:05.776059+0000","last_clean":"2024-09-17T03:41:05.776059+0000","last_became_active":"2024-09-17T03:41:03.671518+0000","last_became_peered":"2024-09-17T03:41:03.671518+0000","last_unstale":"2024-09-17T03:41:05.776059+0000","last_undegraded":"2024-09-17T03:41:05.776059+0000","last_fullsized":"2024-09-17T03:41:05.776059+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:48.342701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661138+0000","last_change":"2024-09-17T03:41:03.661138+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661138+0000","last_undegraded":"2024-09-17T03:41:03.661138+0000","last_fullsized":"2024-09-17T03:41:03.661138+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775781+0000","last_change":"2024-09-17T03:41:03.668667+0000","last_active":"2024-09-17T03:41:05.775781+0000","last_peered":"2024-09-17T03:41:05.775781+0000","last_clean":"2024-09-17T03:41:05.775781+0000","last_became_active":"2024-09-17T03:41:03.668333+0000","last_became_peered":"2024-09-17T03:41:03.668333+0000","last_unstale":"2024-09-17T03:41:05.775781+0000","last_undegraded":"2024-09-17T03:41:05.775781+0000","last_fullsized":"2024-09-17T03:41:05.775781+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:10.629109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.669492+0000","last_change":"2024-09-17T03:41:03.669492+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.669492+0000","last_undegraded":"2024-09-17T03:41:03.669492+0000","last_fullsized":"2024-09-17T03:41:03.669492+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.672738+0000","last_change":"2024-09-17T03:41:03.669613+0000","last_active":"2024-09-17T03:41:03.672738+0000","last_peered":"2024-09-17T03:41:03.672738+0000","last_clean":"2024-09-17T03:41:03.672738+0000","last_became_active":"2024-09-17T03:41:03.669217+0000","last_became_peered":"2024-09-17T03:41:03.669217+0000","last_unstale":"2024-09-17T03:41:03.672738+0000","last_undegraded":"2024-09-17T03:41:03.672738+0000","last_fullsized":"2024-09-17T03:41:03.672738+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:54.056149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660865+0000","last_change":"2024-09-17T03:41:03.660865+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660865+0000","last_undegraded":"2024-09-17T03:41:03.660865+0000","last_fullsized":"2024-09-17T03:41:03.660865+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.677237+0000","last_change":"2024-09-17T03:41:03.675319+0000","last_active":"2024-09-17T03:41:03.677237+0000","last_peered":"2024-09-17T03:41:03.677237+0000","last_clean":"2024-09-17T03:41:03.677237+0000","last_became_active":"2024-09-17T03:41:03.673645+0000","last_became_peered":"2024-09-17T03:41:03.673645+0000","last_unstale":"2024-09-17T03:41:03.677237+0000","last_undegraded":"2024-09-17T03:41:03.677237+0000","last_fullsized":"2024-09-17T03:41:03.677237+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:30.261494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668855+0000","last_change":"2024-09-17T03:41:03.668855+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668855+0000","last_undegraded":"2024-09-17T03:41:03.668855+0000","last_fullsized":"2024-09-17T03:41:03.668855+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676207+0000","last_change":"2024-09-17T03:41:03.675332+0000","last_active":"2024-09-17T03:41:03.676207+0000","last_peered":"2024-09-17T03:41:03.676207+0000","last_clean":"2024-09-17T03:41:03.676207+0000","last_became_active":"2024-09-17T03:41:03.674332+0000","last_became_peered":"2024-09-17T03:41:03.674332+0000","last_unstale":"2024-09-17T03:41:03.676207+0000","last_undegraded":"2024-09-17T03:41:03.676207+0000","last_fullsized":"2024-09-17T03:41:03.676207+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:54.397168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660772+0000","last_change":"2024-09-17T03:41:03.660772+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660772+0000","last_undegraded":"2024-09-17T03:41:03.660772+0000","last_fullsized":"2024-09-17T03:41:03.660772+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.669869+0000","last_change":"2024-09-17T03:41:03.666881+0000","last_active":"2024-09-17T03:41:03.669869+0000","last_peered":"2024-09-17T03:41:03.669869+0000","last_clean":"2024-09-17T03:41:03.669869+0000","last_became_active":"2024-09-17T03:41:03.666310+0000","last_became_peered":"2024-09-17T03:41:03.666310+0000","last_unstale":"2024-09-17T03:41:03.669869+0000","last_undegraded":"2024-09-17T03:41:03.669869+0000","last_fullsized":"2024-09-17T03:41:03.669869+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:34.354857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660107+0000","last_change":"2024-09-17T03:41:03.660107+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660107+0000","last_undegraded":"2024-09-17T03:41:03.660107+0000","last_fullsized":"2024-09-17T03:41:03.660107+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.673804+0000","last_change":"2024-09-17T03:41:03.671833+0000","last_active":"2024-09-17T03:41:03.673804+0000","last_peered":"2024-09-17T03:41:03.673804+0000","last_clean":"2024-09-17T03:41:03.673804+0000","last_became_active":"2024-09-17T03:41:03.671461+0000","last_became_peered":"2024-09-17T03:41:03.671461+0000","last_unstale":"2024-09-17T03:41:03.673804+0000","last_undegraded":"2024-09-17T03:41:03.673804+0000","last_fullsized":"2024-09-17T03:41:03.673804+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:42.632227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668196+0000","last_change":"2024-09-17T03:41:03.668196+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668196+0000","last_undegraded":"2024-09-17T03:41:03.668196+0000","last_fullsized":"2024-09-17T03:41:03.668196+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676755+0000","last_change":"2024-09-17T03:41:03.674559+0000","last_active":"2024-09-17T03:41:03.676755+0000","last_peered":"2024-09-17T03:41:03.676755+0000","last_clean":"2024-09-17T03:41:03.676755+0000","last_became_active":"2024-09-17T03:41:03.674262+0000","last_became_peered":"2024-09-17T03:41:03.674262+0000","last_unstale":"2024-09-17T03:41:03.676755+0000","last_undegraded":"2024-09-17T03:41:03.676755+0000","last_fullsized":"2024-09-17T03:41:03.676755+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:50.186518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992647+0000","last_change":"2024-09-17T03:41:04.683290+0000","last_active":"2024-09-17T03:41:05.992647+0000","last_peered":"2024-09-17T03:41:05.992647+0000","last_clean":"2024-09-17T03:41:05.992647+0000","last_became_active":"2024-09-17T03:41:04.682914+0000","last_became_peered":"2024-09-17T03:41:04.682914+0000","last_unstale":"2024-09-17T03:41:05.992647+0000","last_undegraded":"2024-09-17T03:41:05.992647+0000","last_fullsized":"2024-09-17T03:41:05.992647+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:41.050865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.678605+0000","last_change":"2024-09-17T03:41:03.678154+0000","last_active":"2024-09-17T03:41:03.678605+0000","last_peered":"2024-09-17T03:41:03.678605+0000","last_clean":"2024-09-17T03:41:03.678605+0000","last_became_active":"2024-09-17T03:41:03.677792+0000","last_became_peered":"2024-09-17T03:41:03.677792+0000","last_unstale":"2024-09-17T03:41:03.678605+0000","last_undegraded":"2024-09-17T03:41:03.678605+0000","last_fullsized":"2024-09-17T03:41:03.678605+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:15.308921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776116+0000","last_change":"2024-09-17T03:41:04.679711+0000","last_active":"2024-09-17T03:41:05.776116+0000","last_peered":"2024-09-17T03:41:05.776116+0000","last_clean":"2024-09-17T03:41:05.776116+0000","last_became_active":"2024-09-17T03:41:04.677950+0000","last_became_peered":"2024-09-17T03:41:04.677950+0000","last_unstale":"2024-09-17T03:41:05.776116+0000","last_undegraded":"2024-09-17T03:41:05.776116+0000","last_fullsized":"2024-09-17T03:41:05.776116+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:28.312827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775980+0000","last_change":"2024-09-17T03:41:03.666191+0000","last_active":"2024-09-17T03:41:05.775980+0000","last_peered":"2024-09-17T03:41:05.775980+0000","last_clean":"2024-09-17T03:41:05.775980+0000","last_became_active":"2024-09-17T03:41:03.665893+0000","last_became_peered":"2024-09-17T03:41:03.665893+0000","last_unstale":"2024-09-17T03:41:05.775980+0000","last_undegraded":"2024-09-17T03:41:05.775980+0000","last_fullsized":"2024-09-17T03:41:05.775980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:18.129464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661116+0000","last_change":"2024-09-17T03:41:03.661116+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661116+0000","last_undegraded":"2024-09-17T03:41:03.661116+0000","last_fullsized":"2024-09-17T03:41:03.661116+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.671432+0000","last_change":"2024-09-17T03:41:03.668313+0000","last_active":"2024-09-17T03:41:03.671432+0000","last_peered":"2024-09-17T03:41:03.671432+0000","last_clean":"2024-09-17T03:41:03.671432+0000","last_became_active":"2024-09-17T03:41:03.668025+0000","last_became_peered":"2024-09-17T03:41:03.668025+0000","last_unstale":"2024-09-17T03:41:03.671432+0000","last_undegraded":"2024-09-17T03:41:03.671432+0000","last_fullsized":"2024-09-17T03:41:03.671432+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:33.753544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666007+0000","last_change":"2024-09-17T03:41:03.666007+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666007+0000","last_undegraded":"2024-09-17T03:41:03.666007+0000","last_fullsized":"2024-09-17T03:41:03.666007+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.677397+0000","last_change":"2024-09-17T03:41:03.676588+0000","last_active":"2024-09-17T03:41:03.677397+0000","last_peered":"2024-09-17T03:41:03.677397+0000","last_clean":"2024-09-17T03:41:03.677397+0000","last_became_active":"2024-09-17T03:41:03.676281+0000","last_became_peered":"2024-09-17T03:41:03.676281+0000","last_unstale":"2024-09-17T03:41:03.677397+0000","last_undegraded":"2024-09-17T03:41:03.677397+0000","last_fullsized":"2024-09-17T03:41:03.677397+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:21.048654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":307,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.670871+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:41:03.670871+0000","last_peered":"2024-09-17T03:41:03.670871+0000","last_clean":"2024-09-17T03:41:03.670871+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:41:03.670871+0000","last_undegraded":"2024-09-17T03:41:03.670871+0000","last_fullsized":"2024-09-17T03:41:03.670871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29164,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342676,"statfs":{"total":96636764160,"available":96606900224,"internally_reserved":0,"allocated":2183168,"data_stored":1284557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50792,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509543,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50792,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509543,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46632,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325208,"statfs":{"total":96636764160,"available":96589012992,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50796,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321044,"statfs":{"total":96636764160,"available":96584749056,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47212,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324628,"statfs":{"total":96636764160,"available":96588419072,"internally_reserved":0,"allocated":2183168,"data_stored":1284557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46660,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325180,"statfs":{"total":96636764160,"available":96588984320,"internally_reserved":0,"allocated":1622016,"data_stored":707376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50820,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321020,"statfs":{"total":96636764160,"available":96584724480,"internally_reserved":0,"allocated":1622016,"data_stored":707424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:41:09.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:41:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.186+0000 7f872c04a640 1 -- 172.21.15.146:0/2933495360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f870c003a50 msgr2=0x7f870c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.186+0000 7f872c04a640 1 --2- 172.21.15.146:0/2933495360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f870c003a50 0x7f870c003ec0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f871400c290 tx=0x7f870c005830 comp rx=0 tx=0).stop 2024-09-17T03:41:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.186+0000 7f872a5e7640 1 -- 172.21.15.146:0/2933495360 reap_dead start 2024-09-17T03:41:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.186+0000 7f872c04a640 1 -- 172.21.15.146:0/2933495360 shutdown_connections 2024-09-17T03:41:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.186+0000 7f872c04a640 1 -- 172.21.15.146:0/2933495360 >> 172.21.15.146:0/2933495360 conn(0x7f87240b2060 msgr2=0x7f87240b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.187+0000 7f872c04a640 1 -- 172.21.15.146:0/2933495360 shutdown_connections 2024-09-17T03:41:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.187+0000 7f872c04a640 1 -- 172.21.15.146:0/2933495360 wait complete. 2024-09-17T03:41:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.188+0000 7f872c04a640 1 Processor -- start 2024-09-17T03:41:09.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.188+0000 7f872c04a640 1 -- start start 2024-09-17T03:41:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872c04a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f870c003a50 0x7f87241f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872c04a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f872415a780 0x7f872415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872c04a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87240b09c0 0x7f87240b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872c04a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8724073a10 con 0x7f87240b09c0 2024-09-17T03:41:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872c04a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8724073890 con 0x7f872415a780 2024-09-17T03:41:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872c04a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8724073b90 con 0x7f870c003a50 2024-09-17T03:41:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872a5e7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87240b09c0 0x7f87240b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872a5e7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87240b09c0 0x7f87240b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33402/0 (socket says 172.21.15.146:33402) 2024-09-17T03:41:09.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872a5e7640 1 -- 172.21.15.146:0/3254318138 learned_addr learned my addr 172.21.15.146:0/3254318138 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f8729de6640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f870c003a50 0x7f87241f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f87295e5640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f872415a780 0x7f872415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872a5e7640 1 -- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f870c003a50 msgr2=0x7f87241f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872a5e7640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f870c003a50 0x7f87241f71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872a5e7640 1 -- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f872415a780 msgr2=0x7f872415b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872a5e7640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f872415a780 0x7f872415b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872a5e7640 1 -- 172.21.15.146:0/3254318138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87240cf700 con 0x7f87240b09c0 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f87295e5640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f872415a780 0x7f872415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872a5e7640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87240b09c0 0x7f87240b0dd0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f8724160450 tx=0x7f871c010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f87227fc640 1 -- 172.21.15.146:0/3254318138 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c00ee70 con 0x7f87240b09c0 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872c04a640 1 -- 172.21.15.146:0/3254318138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87241f7720 con 0x7f87240b09c0 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f87227fc640 1 -- 172.21.15.146:0/3254318138 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f871c015070 con 0x7f87240b09c0 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f87227fc640 1 -- 172.21.15.146:0/3254318138 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c004d80 con 0x7f87240b09c0 2024-09-17T03:41:09.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.190+0000 7f872c04a640 1 -- 172.21.15.146:0/3254318138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87240cf140 con 0x7f87240b09c0 2024-09-17T03:41:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.192+0000 7f872c04a640 1 -- 172.21.15.146:0/3254318138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87240ce0f0 con 0x7f87240b09c0 2024-09-17T03:41:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.192+0000 7f87227fc640 1 -- 172.21.15.146:0/3254318138 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f871c003970 con 0x7f87240b09c0 2024-09-17T03:41:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.193+0000 7f87227fc640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8710078b90 0x7f871007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.193+0000 7f87227fc640 1 -- 172.21.15.146:0/3254318138 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f871c09b420 con 0x7f87240b09c0 2024-09-17T03:41:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.193+0000 7f8729de6640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8710078b90 0x7f871007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.193+0000 7f8729de6640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8710078b90 0x7f871007b0a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8714033000 tx=0x7f872415cf00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.197+0000 7f87227fc640 1 -- 172.21.15.146:0/3254318138 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f87240ce0f0 con 0x7f87240b09c0 2024-09-17T03:41:09.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.368+0000 7f872c04a640 1 -- 172.21.15.146:0/3254318138 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87240ceed0 con 0x7f8710078b90 2024-09-17T03:41:09.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.372+0000 7f87227fc640 1 -- 172.21.15.146:0/3254318138 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248127 (secure 0 0 0) 0x7f87240ceed0 con 0x7f8710078b90 2024-09-17T03:41:09.374 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:41:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.375+0000 7f872c04a640 1 -- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8710078b90 msgr2=0x7f871007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.375+0000 7f872c04a640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8710078b90 0x7f871007b0a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8714033000 tx=0x7f872415cf00 comp rx=0 tx=0).stop 2024-09-17T03:41:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.375+0000 7f872c04a640 1 -- 172.21.15.146:0/3254318138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87240b09c0 msgr2=0x7f87240b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.375+0000 7f872c04a640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87240b09c0 0x7f87240b0dd0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f8724160450 tx=0x7f871c010f40 comp rx=0 tx=0).stop 2024-09-17T03:41:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.376+0000 7f872c04a640 1 -- 172.21.15.146:0/3254318138 shutdown_connections 2024-09-17T03:41:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.376+0000 7f872c04a640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8710078b90 0x7f871007b0a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.376+0000 7f872c04a640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87240b09c0 0x7f87240b0dd0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.376+0000 7f872c04a640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f872415a780 0x7f872415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.376+0000 7f872c04a640 1 --2- 172.21.15.146:0/3254318138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f870c003a50 0x7f87241f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.376+0000 7f872c04a640 1 -- 172.21.15.146:0/3254318138 >> 172.21.15.146:0/3254318138 conn(0x7f87240b2060 msgr2=0x7f8724148c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:09.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.376+0000 7f872c04a640 1 -- 172.21.15.146:0/3254318138 shutdown_connections 2024-09-17T03:41:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.376+0000 7f872c04a640 1 -- 172.21.15.146:0/3254318138 wait complete. 2024-09-17T03:41:09.386 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2024-09-17T03:41:07.920492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":107,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":372868,"kb_used_data":13640,"kb_used_omap":12,"kb_used_meta":359027,"kb_avail":754601852,"statfs":{"total":773094113280,"available":772712296448,"internally_reserved":0,"allocated":13967360,"data_stored":6760670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":367644209},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.267526"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668389+0000","last_change":"2024-09-17T03:41:03.668389+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668389+0000","last_undegraded":"2024-09-17T03:41:03.668389+0000","last_fullsized":"2024-09-17T03:41:03.668389+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.664358+0000","last_change":"2024-09-17T03:41:03.664358+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.664358+0000","last_undegraded":"2024-09-17T03:41:03.664358+0000","last_fullsized":"2024-09-17T03:41:03.664358+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660671+0000","last_change":"2024-09-17T03:41:03.660671+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660671+0000","last_undegraded":"2024-09-17T03:41:03.660671+0000","last_fullsized":"2024-09-17T03:41:03.660671+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665901+0000","last_change":"2024-09-17T03:41:03.665901+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665901+0000","last_undegraded":"2024-09-17T03:41:03.665901+0000","last_fullsized":"2024-09-17T03:41:03.665901+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666474+0000","last_change":"2024-09-17T03:41:03.666474+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666474+0000","last_undegraded":"2024-09-17T03:41:03.666474+0000","last_fullsized":"2024-09-17T03:41:03.666474+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661120+0000","last_change":"2024-09-17T03:41:03.661120+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661120+0000","last_undegraded":"2024-09-17T03:41:03.661120+0000","last_fullsized":"2024-09-17T03:41:03.661120+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662424+0000","last_change":"2024-09-17T03:41:03.662424+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662424+0000","last_undegraded":"2024-09-17T03:41:03.662424+0000","last_fullsized":"2024-09-17T03:41:03.662424+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659572+0000","last_change":"2024-09-17T03:41:03.659572+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659572+0000","last_undegraded":"2024-09-17T03:41:03.659572+0000","last_fullsized":"2024-09-17T03:41:03.659572+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661229+0000","last_change":"2024-09-17T03:41:03.661229+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661229+0000","last_undegraded":"2024-09-17T03:41:03.661229+0000","last_fullsized":"2024-09-17T03:41:03.661229+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663835+0000","last_change":"2024-09-17T03:41:03.663835+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663835+0000","last_undegraded":"2024-09-17T03:41:03.663835+0000","last_fullsized":"2024-09-17T03:41:03.663835+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662386+0000","last_change":"2024-09-17T03:41:03.662386+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662386+0000","last_undegraded":"2024-09-17T03:41:03.662386+0000","last_fullsized":"2024-09-17T03:41:03.662386+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659424+0000","last_change":"2024-09-17T03:41:03.659424+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659424+0000","last_undegraded":"2024-09-17T03:41:03.659424+0000","last_fullsized":"2024-09-17T03:41:03.659424+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668363+0000","last_change":"2024-09-17T03:41:03.668363+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668363+0000","last_undegraded":"2024-09-17T03:41:03.668363+0000","last_fullsized":"2024-09-17T03:41:03.668363+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663736+0000","last_change":"2024-09-17T03:41:03.663736+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663736+0000","last_undegraded":"2024-09-17T03:41:03.663736+0000","last_fullsized":"2024-09-17T03:41:03.663736+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665838+0000","last_change":"2024-09-17T03:41:03.665838+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665838+0000","last_undegraded":"2024-09-17T03:41:03.665838+0000","last_fullsized":"2024-09-17T03:41:03.665838+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775951+0000","last_change":"2024-09-17T03:41:04.684317+0000","last_active":"2024-09-17T03:41:05.775951+0000","last_peered":"2024-09-17T03:41:05.775951+0000","last_clean":"2024-09-17T03:41:05.775951+0000","last_became_active":"2024-09-17T03:41:04.682665+0000","last_became_peered":"2024-09-17T03:41:04.682665+0000","last_unstale":"2024-09-17T03:41:05.775951+0000","last_undegraded":"2024-09-17T03:41:05.775951+0000","last_fullsized":"2024-09-17T03:41:05.775951+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:26.514663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662489+0000","last_change":"2024-09-17T03:41:03.662489+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662489+0000","last_undegraded":"2024-09-17T03:41:03.662489+0000","last_fullsized":"2024-09-17T03:41:03.662489+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776176+0000","last_change":"2024-09-17T03:41:04.672835+0000","last_active":"2024-09-17T03:41:05.776176+0000","last_peered":"2024-09-17T03:41:05.776176+0000","last_clean":"2024-09-17T03:41:05.776176+0000","last_became_active":"2024-09-17T03:41:04.672536+0000","last_became_peered":"2024-09-17T03:41:04.672536+0000","last_unstale":"2024-09-17T03:41:05.776176+0000","last_undegraded":"2024-09-17T03:41:05.776176+0000","last_fullsized":"2024-09-17T03:41:05.776176+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:20.558673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661907+0000","last_change":"2024-09-17T03:41:03.661907+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661907+0000","last_undegraded":"2024-09-17T03:41:03.661907+0000","last_fullsized":"2024-09-17T03:41:03.661907+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776267+0000","last_change":"2024-09-17T03:41:04.681101+0000","last_active":"2024-09-17T03:41:05.776267+0000","last_peered":"2024-09-17T03:41:05.776267+0000","last_clean":"2024-09-17T03:41:05.776267+0000","last_became_active":"2024-09-17T03:41:04.678923+0000","last_became_peered":"2024-09-17T03:41:04.678923+0000","last_unstale":"2024-09-17T03:41:05.776267+0000","last_undegraded":"2024-09-17T03:41:05.776267+0000","last_fullsized":"2024-09-17T03:41:05.776267+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:04.887694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668038+0000","last_change":"2024-09-17T03:41:03.668038+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668038+0000","last_undegraded":"2024-09-17T03:41:03.668038+0000","last_fullsized":"2024-09-17T03:41:03.668038+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661114+0000","last_change":"2024-09-17T03:41:03.661114+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661114+0000","last_undegraded":"2024-09-17T03:41:03.661114+0000","last_fullsized":"2024-09-17T03:41:03.661114+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.658915+0000","last_change":"2024-09-17T03:41:03.658915+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.658915+0000","last_undegraded":"2024-09-17T03:41:03.658915+0000","last_fullsized":"2024-09-17T03:41:03.658915+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661399+0000","last_change":"2024-09-17T03:41:03.661399+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661399+0000","last_undegraded":"2024-09-17T03:41:03.661399+0000","last_fullsized":"2024-09-17T03:41:03.661399+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663743+0000","last_change":"2024-09-17T03:41:03.663743+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663743+0000","last_undegraded":"2024-09-17T03:41:03.663743+0000","last_fullsized":"2024-09-17T03:41:03.663743+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776200+0000","last_change":"2024-09-17T03:41:04.674681+0000","last_active":"2024-09-17T03:41:05.776200+0000","last_peered":"2024-09-17T03:41:05.776200+0000","last_clean":"2024-09-17T03:41:05.776200+0000","last_became_active":"2024-09-17T03:41:04.674347+0000","last_became_peered":"2024-09-17T03:41:04.674347+0000","last_unstale":"2024-09-17T03:41:05.776200+0000","last_undegraded":"2024-09-17T03:41:05.776200+0000","last_fullsized":"2024-09-17T03:41:05.776200+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:54.420791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665301+0000","last_change":"2024-09-17T03:41:03.665301+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665301+0000","last_undegraded":"2024-09-17T03:41:03.665301+0000","last_fullsized":"2024-09-17T03:41:03.665301+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992621+0000","last_change":"2024-09-17T03:41:04.680689+0000","last_active":"2024-09-17T03:41:05.992621+0000","last_peered":"2024-09-17T03:41:05.992621+0000","last_clean":"2024-09-17T03:41:05.992621+0000","last_became_active":"2024-09-17T03:41:04.680384+0000","last_became_peered":"2024-09-17T03:41:04.680384+0000","last_unstale":"2024-09-17T03:41:05.992621+0000","last_undegraded":"2024-09-17T03:41:05.992621+0000","last_fullsized":"2024-09-17T03:41:05.992621+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:16.107400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.667902+0000","last_change":"2024-09-17T03:41:03.667902+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.667902+0000","last_undegraded":"2024-09-17T03:41:03.667902+0000","last_fullsized":"2024-09-17T03:41:03.667902+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666662+0000","last_change":"2024-09-17T03:41:03.666662+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666662+0000","last_undegraded":"2024-09-17T03:41:03.666662+0000","last_fullsized":"2024-09-17T03:41:03.666662+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.669042+0000","last_change":"2024-09-17T03:41:03.669042+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.669042+0000","last_undegraded":"2024-09-17T03:41:03.669042+0000","last_fullsized":"2024-09-17T03:41:03.669042+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659148+0000","last_change":"2024-09-17T03:41:03.659148+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659148+0000","last_undegraded":"2024-09-17T03:41:03.659148+0000","last_fullsized":"2024-09-17T03:41:03.659148+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776437+0000","last_change":"2024-09-17T03:41:04.676577+0000","last_active":"2024-09-17T03:41:05.776437+0000","last_peered":"2024-09-17T03:41:05.776437+0000","last_clean":"2024-09-17T03:41:05.776437+0000","last_became_active":"2024-09-17T03:41:04.676246+0000","last_became_peered":"2024-09-17T03:41:04.676246+0000","last_unstale":"2024-09-17T03:41:05.776437+0000","last_undegraded":"2024-09-17T03:41:05.776437+0000","last_fullsized":"2024-09-17T03:41:05.776437+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:18.595167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.677378+0000","last_change":"2024-09-17T03:41:03.676165+0000","last_active":"2024-09-17T03:41:03.677378+0000","last_peered":"2024-09-17T03:41:03.677378+0000","last_clean":"2024-09-17T03:41:03.677378+0000","last_became_active":"2024-09-17T03:41:03.675800+0000","last_became_peered":"2024-09-17T03:41:03.675800+0000","last_unstale":"2024-09-17T03:41:03.677378+0000","last_undegraded":"2024-09-17T03:41:03.677378+0000","last_fullsized":"2024-09-17T03:41:03.677378+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:49.812724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659794+0000","last_change":"2024-09-17T03:41:03.659794+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659794+0000","last_undegraded":"2024-09-17T03:41:03.659794+0000","last_fullsized":"2024-09-17T03:41:03.659794+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992676+0000","last_change":"2024-09-17T03:41:03.674308+0000","last_active":"2024-09-17T03:41:05.992676+0000","last_peered":"2024-09-17T03:41:05.992676+0000","last_clean":"2024-09-17T03:41:05.992676+0000","last_became_active":"2024-09-17T03:41:03.673437+0000","last_became_peered":"2024-09-17T03:41:03.673437+0000","last_unstale":"2024-09-17T03:41:05.992676+0000","last_undegraded":"2024-09-17T03:41:05.992676+0000","last_fullsized":"2024-09-17T03:41:05.992676+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:26.761000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668568+0000","last_change":"2024-09-17T03:41:03.668568+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668568+0000","last_undegraded":"2024-09-17T03:41:03.668568+0000","last_fullsized":"2024-09-17T03:41:03.668568+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676256+0000","last_change":"2024-09-17T03:41:03.673481+0000","last_active":"2024-09-17T03:41:03.676256+0000","last_peered":"2024-09-17T03:41:03.676256+0000","last_clean":"2024-09-17T03:41:03.676256+0000","last_became_active":"2024-09-17T03:41:03.673184+0000","last_became_peered":"2024-09-17T03:41:03.673184+0000","last_unstale":"2024-09-17T03:41:03.676256+0000","last_undegraded":"2024-09-17T03:41:03.676256+0000","last_fullsized":"2024-09-17T03:41:03.676256+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:41.960307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668682+0000","last_change":"2024-09-17T03:41:03.668682+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668682+0000","last_undegraded":"2024-09-17T03:41:03.668682+0000","last_fullsized":"2024-09-17T03:41:03.668682+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.675302+0000","last_change":"2024-09-17T03:41:03.670618+0000","last_active":"2024-09-17T03:41:03.675302+0000","last_peered":"2024-09-17T03:41:03.675302+0000","last_clean":"2024-09-17T03:41:03.675302+0000","last_became_active":"2024-09-17T03:41:03.670320+0000","last_became_peered":"2024-09-17T03:41:03.670320+0000","last_unstale":"2024-09-17T03:41:03.675302+0000","last_undegraded":"2024-09-17T03:41:03.675302+0000","last_fullsized":"2024-09-17T03:41:03.675302+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:42.426871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775936+0000","last_change":"2024-09-17T03:41:04.681945+0000","last_active":"2024-09-17T03:41:05.775936+0000","last_peered":"2024-09-17T03:41:05.775936+0000","last_clean":"2024-09-17T03:41:05.775936+0000","last_became_active":"2024-09-17T03:41:04.680316+0000","last_became_peered":"2024-09-17T03:41:04.680316+0000","last_unstale":"2024-09-17T03:41:05.775936+0000","last_undegraded":"2024-09-17T03:41:05.775936+0000","last_fullsized":"2024-09-17T03:41:05.775936+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:13.616492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676783+0000","last_change":"2024-09-17T03:41:03.675301+0000","last_active":"2024-09-17T03:41:03.676783+0000","last_peered":"2024-09-17T03:41:03.676783+0000","last_clean":"2024-09-17T03:41:03.676783+0000","last_became_active":"2024-09-17T03:41:03.675002+0000","last_became_peered":"2024-09-17T03:41:03.675002+0000","last_unstale":"2024-09-17T03:41:03.676783+0000","last_undegraded":"2024-09-17T03:41:03.676783+0000","last_fullsized":"2024-09-17T03:41:03.676783+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:06.938494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659787+0000","last_change":"2024-09-17T03:41:03.659787+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659787+0000","last_undegraded":"2024-09-17T03:41:03.659787+0000","last_fullsized":"2024-09-17T03:41:03.659787+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775855+0000","last_change":"2024-09-17T03:41:03.676747+0000","last_active":"2024-09-17T03:41:05.775855+0000","last_peered":"2024-09-17T03:41:05.775855+0000","last_clean":"2024-09-17T03:41:05.775855+0000","last_became_active":"2024-09-17T03:41:03.676034+0000","last_became_peered":"2024-09-17T03:41:03.676034+0000","last_unstale":"2024-09-17T03:41:05.775855+0000","last_undegraded":"2024-09-17T03:41:05.775855+0000","last_fullsized":"2024-09-17T03:41:05.775855+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:54.137997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659028+0000","last_change":"2024-09-17T03:41:03.659028+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659028+0000","last_undegraded":"2024-09-17T03:41:03.659028+0000","last_fullsized":"2024-09-17T03:41:03.659028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674444+0000","last_change":"2024-09-17T03:41:03.672674+0000","last_active":"2024-09-17T03:41:03.674444+0000","last_peered":"2024-09-17T03:41:03.674444+0000","last_clean":"2024-09-17T03:41:03.674444+0000","last_became_active":"2024-09-17T03:41:03.672235+0000","last_became_peered":"2024-09-17T03:41:03.672235+0000","last_unstale":"2024-09-17T03:41:03.674444+0000","last_undegraded":"2024-09-17T03:41:03.674444+0000","last_fullsized":"2024-09-17T03:41:03.674444+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:19.598620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.663216+0000","last_change":"2024-09-17T03:41:03.663216+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.663216+0000","last_undegraded":"2024-09-17T03:41:03.663216+0000","last_fullsized":"2024-09-17T03:41:03.663216+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.669948+0000","last_change":"2024-09-17T03:41:03.666881+0000","last_active":"2024-09-17T03:41:03.669948+0000","last_peered":"2024-09-17T03:41:03.669948+0000","last_clean":"2024-09-17T03:41:03.669948+0000","last_became_active":"2024-09-17T03:41:03.666536+0000","last_became_peered":"2024-09-17T03:41:03.666536+0000","last_unstale":"2024-09-17T03:41:03.669948+0000","last_undegraded":"2024-09-17T03:41:03.669948+0000","last_fullsized":"2024-09-17T03:41:03.669948+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:17.836632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.665544+0000","last_change":"2024-09-17T03:41:03.665544+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.665544+0000","last_undegraded":"2024-09-17T03:41:03.665544+0000","last_fullsized":"2024-09-17T03:41:03.665544+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992979+0000","last_change":"2024-09-17T03:41:03.675807+0000","last_active":"2024-09-17T03:41:05.992979+0000","last_peered":"2024-09-17T03:41:05.992979+0000","last_clean":"2024-09-17T03:41:05.992979+0000","last_became_active":"2024-09-17T03:41:03.675416+0000","last_became_peered":"2024-09-17T03:41:03.675416+0000","last_unstale":"2024-09-17T03:41:05.992979+0000","last_undegraded":"2024-09-17T03:41:05.992979+0000","last_fullsized":"2024-09-17T03:41:05.992979+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:38.733293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992833+0000","last_change":"2024-09-17T03:41:04.677308+0000","last_active":"2024-09-17T03:41:05.992833+0000","last_peered":"2024-09-17T03:41:05.992833+0000","last_clean":"2024-09-17T03:41:05.992833+0000","last_became_active":"2024-09-17T03:41:04.677003+0000","last_became_peered":"2024-09-17T03:41:04.677003+0000","last_unstale":"2024-09-17T03:41:05.992833+0000","last_undegraded":"2024-09-17T03:41:05.992833+0000","last_fullsized":"2024-09-17T03:41:05.992833+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:55.994505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776317+0000","last_change":"2024-09-17T03:41:03.671819+0000","last_active":"2024-09-17T03:41:05.776317+0000","last_peered":"2024-09-17T03:41:05.776317+0000","last_clean":"2024-09-17T03:41:05.776317+0000","last_became_active":"2024-09-17T03:41:03.671499+0000","last_became_peered":"2024-09-17T03:41:03.671499+0000","last_unstale":"2024-09-17T03:41:05.776317+0000","last_undegraded":"2024-09-17T03:41:05.776317+0000","last_fullsized":"2024-09-17T03:41:05.776317+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:31.784168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668052+0000","last_change":"2024-09-17T03:41:03.668052+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668052+0000","last_undegraded":"2024-09-17T03:41:03.668052+0000","last_fullsized":"2024-09-17T03:41:03.668052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"129'3","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992455+0000","last_change":"2024-09-17T03:41:03.673293+0000","last_active":"2024-09-17T03:41:05.992455+0000","last_peered":"2024-09-17T03:41:05.992455+0000","last_clean":"2024-09-17T03:41:05.992455+0000","last_became_active":"2024-09-17T03:41:03.672799+0000","last_became_peered":"2024-09-17T03:41:03.672799+0000","last_unstale":"2024-09-17T03:41:05.992455+0000","last_undegraded":"2024-09-17T03:41:05.992455+0000","last_fullsized":"2024-09-17T03:41:05.992455+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:27.089366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666707+0000","last_change":"2024-09-17T03:41:03.666707+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666707+0000","last_undegraded":"2024-09-17T03:41:03.666707+0000","last_fullsized":"2024-09-17T03:41:03.666707+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674435+0000","last_change":"2024-09-17T03:41:03.673721+0000","last_active":"2024-09-17T03:41:03.674435+0000","last_peered":"2024-09-17T03:41:03.674435+0000","last_clean":"2024-09-17T03:41:03.674435+0000","last_became_active":"2024-09-17T03:41:03.673378+0000","last_became_peered":"2024-09-17T03:41:03.673378+0000","last_unstale":"2024-09-17T03:41:03.674435+0000","last_undegraded":"2024-09-17T03:41:03.674435+0000","last_fullsized":"2024-09-17T03:41:03.674435+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:55.881455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666691+0000","last_change":"2024-09-17T03:41:03.666691+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666691+0000","last_undegraded":"2024-09-17T03:41:03.666691+0000","last_fullsized":"2024-09-17T03:41:03.666691+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674516+0000","last_change":"2024-09-17T03:41:03.672669+0000","last_active":"2024-09-17T03:41:03.674516+0000","last_peered":"2024-09-17T03:41:03.674516+0000","last_clean":"2024-09-17T03:41:03.674516+0000","last_became_active":"2024-09-17T03:41:03.672086+0000","last_became_peered":"2024-09-17T03:41:03.672086+0000","last_unstale":"2024-09-17T03:41:03.674516+0000","last_undegraded":"2024-09-17T03:41:03.674516+0000","last_fullsized":"2024-09-17T03:41:03.674516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:08.990017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.662623+0000","last_change":"2024-09-17T03:41:03.662623+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.662623+0000","last_undegraded":"2024-09-17T03:41:03.662623+0000","last_fullsized":"2024-09-17T03:41:03.662623+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676848+0000","last_change":"2024-09-17T03:41:03.674227+0000","last_active":"2024-09-17T03:41:03.676848+0000","last_peered":"2024-09-17T03:41:03.676848+0000","last_clean":"2024-09-17T03:41:03.676848+0000","last_became_active":"2024-09-17T03:41:03.673934+0000","last_became_peered":"2024-09-17T03:41:03.673934+0000","last_unstale":"2024-09-17T03:41:03.676848+0000","last_undegraded":"2024-09-17T03:41:03.676848+0000","last_fullsized":"2024-09-17T03:41:03.676848+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:27.858015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660821+0000","last_change":"2024-09-17T03:41:03.660821+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660821+0000","last_undegraded":"2024-09-17T03:41:03.660821+0000","last_fullsized":"2024-09-17T03:41:03.660821+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.671946+0000","last_change":"2024-09-17T03:41:03.671146+0000","last_active":"2024-09-17T03:41:03.671946+0000","last_peered":"2024-09-17T03:41:03.671946+0000","last_clean":"2024-09-17T03:41:03.671946+0000","last_became_active":"2024-09-17T03:41:03.670717+0000","last_became_peered":"2024-09-17T03:41:03.670717+0000","last_unstale":"2024-09-17T03:41:03.671946+0000","last_undegraded":"2024-09-17T03:41:03.671946+0000","last_fullsized":"2024-09-17T03:41:03.671946+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:22.067124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659964+0000","last_change":"2024-09-17T03:41:03.659964+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659964+0000","last_undegraded":"2024-09-17T03:41:03.659964+0000","last_fullsized":"2024-09-17T03:41:03.659964+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993043+0000","last_change":"2024-09-17T03:41:03.673614+0000","last_active":"2024-09-17T03:41:05.993043+0000","last_peered":"2024-09-17T03:41:05.993043+0000","last_clean":"2024-09-17T03:41:05.993043+0000","last_became_active":"2024-09-17T03:41:03.672276+0000","last_became_peered":"2024-09-17T03:41:03.672276+0000","last_unstale":"2024-09-17T03:41:05.993043+0000","last_undegraded":"2024-09-17T03:41:05.993043+0000","last_fullsized":"2024-09-17T03:41:05.993043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:58.982726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992933+0000","last_change":"2024-09-17T03:41:04.671325+0000","last_active":"2024-09-17T03:41:05.992933+0000","last_peered":"2024-09-17T03:41:05.992933+0000","last_clean":"2024-09-17T03:41:05.992933+0000","last_became_active":"2024-09-17T03:41:04.670508+0000","last_became_peered":"2024-09-17T03:41:04.670508+0000","last_unstale":"2024-09-17T03:41:05.992933+0000","last_undegraded":"2024-09-17T03:41:05.992933+0000","last_fullsized":"2024-09-17T03:41:05.992933+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:54.939814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.672772+0000","last_change":"2024-09-17T03:41:03.670284+0000","last_active":"2024-09-17T03:41:03.672772+0000","last_peered":"2024-09-17T03:41:03.672772+0000","last_clean":"2024-09-17T03:41:03.672772+0000","last_became_active":"2024-09-17T03:41:03.668681+0000","last_became_peered":"2024-09-17T03:41:03.668681+0000","last_unstale":"2024-09-17T03:41:03.672772+0000","last_undegraded":"2024-09-17T03:41:03.672772+0000","last_fullsized":"2024-09-17T03:41:03.672772+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:08.382715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776233+0000","last_change":"2024-09-17T03:41:04.679337+0000","last_active":"2024-09-17T03:41:05.776233+0000","last_peered":"2024-09-17T03:41:05.776233+0000","last_clean":"2024-09-17T03:41:05.776233+0000","last_became_active":"2024-09-17T03:41:04.677967+0000","last_became_peered":"2024-09-17T03:41:04.677967+0000","last_unstale":"2024-09-17T03:41:05.776233+0000","last_undegraded":"2024-09-17T03:41:05.776233+0000","last_fullsized":"2024-09-17T03:41:05.776233+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:05.761345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.674540+0000","last_change":"2024-09-17T03:41:03.672925+0000","last_active":"2024-09-17T03:41:03.674540+0000","last_peered":"2024-09-17T03:41:03.674540+0000","last_clean":"2024-09-17T03:41:03.674540+0000","last_became_active":"2024-09-17T03:41:03.672614+0000","last_became_peered":"2024-09-17T03:41:03.672614+0000","last_unstale":"2024-09-17T03:41:03.674540+0000","last_undegraded":"2024-09-17T03:41:03.674540+0000","last_fullsized":"2024-09-17T03:41:03.674540+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:20.355934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661416+0000","last_change":"2024-09-17T03:41:03.661416+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661416+0000","last_undegraded":"2024-09-17T03:41:03.661416+0000","last_fullsized":"2024-09-17T03:41:03.661416+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992493+0000","last_change":"2024-09-17T03:41:03.669334+0000","last_active":"2024-09-17T03:41:05.992493+0000","last_peered":"2024-09-17T03:41:05.992493+0000","last_clean":"2024-09-17T03:41:05.992493+0000","last_became_active":"2024-09-17T03:41:03.669018+0000","last_became_peered":"2024-09-17T03:41:03.669018+0000","last_unstale":"2024-09-17T03:41:05.992493+0000","last_undegraded":"2024-09-17T03:41:05.992493+0000","last_fullsized":"2024-09-17T03:41:05.992493+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:10.640755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666052+0000","last_change":"2024-09-17T03:41:03.666052+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666052+0000","last_undegraded":"2024-09-17T03:41:03.666052+0000","last_fullsized":"2024-09-17T03:41:03.666052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992516+0000","last_change":"2024-09-17T03:41:03.676603+0000","last_active":"2024-09-17T03:41:05.992516+0000","last_peered":"2024-09-17T03:41:05.992516+0000","last_clean":"2024-09-17T03:41:05.992516+0000","last_became_active":"2024-09-17T03:41:03.676265+0000","last_became_peered":"2024-09-17T03:41:03.676265+0000","last_unstale":"2024-09-17T03:41:05.992516+0000","last_undegraded":"2024-09-17T03:41:05.992516+0000","last_fullsized":"2024-09-17T03:41:05.992516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:49.453780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.659305+0000","last_change":"2024-09-17T03:41:03.659305+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.659305+0000","last_undegraded":"2024-09-17T03:41:03.659305+0000","last_fullsized":"2024-09-17T03:41:03.659305+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776059+0000","last_change":"2024-09-17T03:41:03.675991+0000","last_active":"2024-09-17T03:41:05.776059+0000","last_peered":"2024-09-17T03:41:05.776059+0000","last_clean":"2024-09-17T03:41:05.776059+0000","last_became_active":"2024-09-17T03:41:03.671518+0000","last_became_peered":"2024-09-17T03:41:03.671518+0000","last_unstale":"2024-09-17T03:41:05.776059+0000","last_undegraded":"2024-09-17T03:41:05.776059+0000","last_fullsized":"2024-09-17T03:41:05.776059+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:48.342701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661138+0000","last_change":"2024-09-17T03:41:03.661138+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661138+0000","last_undegraded":"2024-09-17T03:41:03.661138+0000","last_fullsized":"2024-09-17T03:41:03.661138+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775781+0000","last_change":"2024-09-17T03:41:03.668667+0000","last_active":"2024-09-17T03:41:05.775781+0000","last_peered":"2024-09-17T03:41:05.775781+0000","last_clean":"2024-09-17T03:41:05.775781+0000","last_became_active":"2024-09-17T03:41:03.668333+0000","last_became_peered":"2024-09-17T03:41:03.668333+0000","last_unstale":"2024-09-17T03:41:05.775781+0000","last_undegraded":"2024-09-17T03:41:05.775781+0000","last_fullsized":"2024-09-17T03:41:05.775781+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:10.629109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.669492+0000","last_change":"2024-09-17T03:41:03.669492+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.669492+0000","last_undegraded":"2024-09-17T03:41:03.669492+0000","last_fullsized":"2024-09-17T03:41:03.669492+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.672738+0000","last_change":"2024-09-17T03:41:03.669613+0000","last_active":"2024-09-17T03:41:03.672738+0000","last_peered":"2024-09-17T03:41:03.672738+0000","last_clean":"2024-09-17T03:41:03.672738+0000","last_became_active":"2024-09-17T03:41:03.669217+0000","last_became_peered":"2024-09-17T03:41:03.669217+0000","last_unstale":"2024-09-17T03:41:03.672738+0000","last_undegraded":"2024-09-17T03:41:03.672738+0000","last_fullsized":"2024-09-17T03:41:03.672738+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:54.056149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660865+0000","last_change":"2024-09-17T03:41:03.660865+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660865+0000","last_undegraded":"2024-09-17T03:41:03.660865+0000","last_fullsized":"2024-09-17T03:41:03.660865+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.677237+0000","last_change":"2024-09-17T03:41:03.675319+0000","last_active":"2024-09-17T03:41:03.677237+0000","last_peered":"2024-09-17T03:41:03.677237+0000","last_clean":"2024-09-17T03:41:03.677237+0000","last_became_active":"2024-09-17T03:41:03.673645+0000","last_became_peered":"2024-09-17T03:41:03.673645+0000","last_unstale":"2024-09-17T03:41:03.677237+0000","last_undegraded":"2024-09-17T03:41:03.677237+0000","last_fullsized":"2024-09-17T03:41:03.677237+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:30.261494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668855+0000","last_change":"2024-09-17T03:41:03.668855+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668855+0000","last_undegraded":"2024-09-17T03:41:03.668855+0000","last_fullsized":"2024-09-17T03:41:03.668855+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676207+0000","last_change":"2024-09-17T03:41:03.675332+0000","last_active":"2024-09-17T03:41:03.676207+0000","last_peered":"2024-09-17T03:41:03.676207+0000","last_clean":"2024-09-17T03:41:03.676207+0000","last_became_active":"2024-09-17T03:41:03.674332+0000","last_became_peered":"2024-09-17T03:41:03.674332+0000","last_unstale":"2024-09-17T03:41:03.676207+0000","last_undegraded":"2024-09-17T03:41:03.676207+0000","last_fullsized":"2024-09-17T03:41:03.676207+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:54.397168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660772+0000","last_change":"2024-09-17T03:41:03.660772+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660772+0000","last_undegraded":"2024-09-17T03:41:03.660772+0000","last_fullsized":"2024-09-17T03:41:03.660772+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.669869+0000","last_change":"2024-09-17T03:41:03.666881+0000","last_active":"2024-09-17T03:41:03.669869+0000","last_peered":"2024-09-17T03:41:03.669869+0000","last_clean":"2024-09-17T03:41:03.669869+0000","last_became_active":"2024-09-17T03:41:03.666310+0000","last_became_peered":"2024-09-17T03:41:03.666310+0000","last_unstale":"2024-09-17T03:41:03.669869+0000","last_undegraded":"2024-09-17T03:41:03.669869+0000","last_fullsized":"2024-09-17T03:41:03.669869+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:34.354857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.660107+0000","last_change":"2024-09-17T03:41:03.660107+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.660107+0000","last_undegraded":"2024-09-17T03:41:03.660107+0000","last_fullsized":"2024-09-17T03:41:03.660107+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.673804+0000","last_change":"2024-09-17T03:41:03.671833+0000","last_active":"2024-09-17T03:41:03.673804+0000","last_peered":"2024-09-17T03:41:03.673804+0000","last_clean":"2024-09-17T03:41:03.673804+0000","last_became_active":"2024-09-17T03:41:03.671461+0000","last_became_peered":"2024-09-17T03:41:03.671461+0000","last_unstale":"2024-09-17T03:41:03.673804+0000","last_undegraded":"2024-09-17T03:41:03.673804+0000","last_fullsized":"2024-09-17T03:41:03.673804+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:42.632227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.668196+0000","last_change":"2024-09-17T03:41:03.668196+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.668196+0000","last_undegraded":"2024-09-17T03:41:03.668196+0000","last_fullsized":"2024-09-17T03:41:03.668196+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.676755+0000","last_change":"2024-09-17T03:41:03.674559+0000","last_active":"2024-09-17T03:41:03.676755+0000","last_peered":"2024-09-17T03:41:03.676755+0000","last_clean":"2024-09-17T03:41:03.676755+0000","last_became_active":"2024-09-17T03:41:03.674262+0000","last_became_peered":"2024-09-17T03:41:03.674262+0000","last_unstale":"2024-09-17T03:41:03.676755+0000","last_undegraded":"2024-09-17T03:41:03.676755+0000","last_fullsized":"2024-09-17T03:41:03.676755+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:50.186518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992647+0000","last_change":"2024-09-17T03:41:04.683290+0000","last_active":"2024-09-17T03:41:05.992647+0000","last_peered":"2024-09-17T03:41:05.992647+0000","last_clean":"2024-09-17T03:41:05.992647+0000","last_became_active":"2024-09-17T03:41:04.682914+0000","last_became_peered":"2024-09-17T03:41:04.682914+0000","last_unstale":"2024-09-17T03:41:05.992647+0000","last_undegraded":"2024-09-17T03:41:05.992647+0000","last_fullsized":"2024-09-17T03:41:05.992647+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:41.050865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.678605+0000","last_change":"2024-09-17T03:41:03.678154+0000","last_active":"2024-09-17T03:41:03.678605+0000","last_peered":"2024-09-17T03:41:03.678605+0000","last_clean":"2024-09-17T03:41:03.678605+0000","last_became_active":"2024-09-17T03:41:03.677792+0000","last_became_peered":"2024-09-17T03:41:03.677792+0000","last_unstale":"2024-09-17T03:41:03.678605+0000","last_undegraded":"2024-09-17T03:41:03.678605+0000","last_fullsized":"2024-09-17T03:41:03.678605+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:15.308921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776116+0000","last_change":"2024-09-17T03:41:04.679711+0000","last_active":"2024-09-17T03:41:05.776116+0000","last_peered":"2024-09-17T03:41:05.776116+0000","last_clean":"2024-09-17T03:41:05.776116+0000","last_became_active":"2024-09-17T03:41:04.677950+0000","last_became_peered":"2024-09-17T03:41:04.677950+0000","last_unstale":"2024-09-17T03:41:05.776116+0000","last_undegraded":"2024-09-17T03:41:05.776116+0000","last_fullsized":"2024-09-17T03:41:05.776116+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:28.312827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775980+0000","last_change":"2024-09-17T03:41:03.666191+0000","last_active":"2024-09-17T03:41:05.775980+0000","last_peered":"2024-09-17T03:41:05.775980+0000","last_clean":"2024-09-17T03:41:05.775980+0000","last_became_active":"2024-09-17T03:41:03.665893+0000","last_became_peered":"2024-09-17T03:41:03.665893+0000","last_unstale":"2024-09-17T03:41:05.775980+0000","last_undegraded":"2024-09-17T03:41:05.775980+0000","last_fullsized":"2024-09-17T03:41:05.775980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:18.129464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.661116+0000","last_change":"2024-09-17T03:41:03.661116+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.661116+0000","last_undegraded":"2024-09-17T03:41:03.661116+0000","last_fullsized":"2024-09-17T03:41:03.661116+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.671432+0000","last_change":"2024-09-17T03:41:03.668313+0000","last_active":"2024-09-17T03:41:03.671432+0000","last_peered":"2024-09-17T03:41:03.671432+0000","last_clean":"2024-09-17T03:41:03.671432+0000","last_became_active":"2024-09-17T03:41:03.668025+0000","last_became_peered":"2024-09-17T03:41:03.668025+0000","last_unstale":"2024-09-17T03:41:03.671432+0000","last_undegraded":"2024-09-17T03:41:03.671432+0000","last_fullsized":"2024-09-17T03:41:03.671432+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:33.753544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-17T03:41:03.666007+0000","last_change":"2024-09-17T03:41:03.666007+0000","last_active":"2024-09-17T03:41:03.648345+0000","last_peered":"2024-09-17T03:41:03.648345+0000","last_clean":"2024-09-17T03:41:03.648345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:03.666007+0000","last_undegraded":"2024-09-17T03:41:03.666007+0000","last_fullsized":"2024-09-17T03:41:03.666007+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.677397+0000","last_change":"2024-09-17T03:41:03.676588+0000","last_active":"2024-09-17T03:41:03.677397+0000","last_peered":"2024-09-17T03:41:03.677397+0000","last_clean":"2024-09-17T03:41:03.677397+0000","last_became_active":"2024-09-17T03:41:03.676281+0000","last_became_peered":"2024-09-17T03:41:03.676281+0000","last_unstale":"2024-09-17T03:41:03.677397+0000","last_undegraded":"2024-09-17T03:41:03.677397+0000","last_fullsized":"2024-09-17T03:41:03.677397+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:21.048654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":307,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-17T03:41:03.670871+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:41:03.670871+0000","last_peered":"2024-09-17T03:41:03.670871+0000","last_clean":"2024-09-17T03:41:03.670871+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:41:03.670871+0000","last_undegraded":"2024-09-17T03:41:03.670871+0000","last_fullsized":"2024-09-17T03:41:03.670871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29164,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342676,"statfs":{"total":96636764160,"available":96606900224,"internally_reserved":0,"allocated":2183168,"data_stored":1284557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50792,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509543,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50792,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509543,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46632,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325208,"statfs":{"total":96636764160,"available":96589012992,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50796,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321044,"statfs":{"total":96636764160,"available":96584749056,"internally_reserved":0,"allocated":1589248,"data_stored":694189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47212,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324628,"statfs":{"total":96636764160,"available":96588419072,"internally_reserved":0,"allocated":2183168,"data_stored":1284557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46660,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325180,"statfs":{"total":96636764160,"available":96588984320,"internally_reserved":0,"allocated":1622016,"data_stored":707376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50820,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321020,"statfs":{"total":96636764160,"available":96584724480,"internally_reserved":0,"allocated":1622016,"data_stored":707424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:41:09.390 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3f is not active+clean 2024-09-17T03:41:09.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.668389+0000', 'last_change': '2024-09-17T03:41:03.668389+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.668389+0000', 'last_undegraded': '2024-09-17T03:41:03.668389+0000', 'last_fullsized': '2024-09-17T03:41:03.668389+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:41:09.390 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3e is not active+clean 2024-09-17T03:41:09.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.664358+0000', 'last_change': '2024-09-17T03:41:03.664358+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.664358+0000', 'last_undegraded': '2024-09-17T03:41:03.664358+0000', 'last_fullsized': '2024-09-17T03:41:03.664358+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:41:09.390 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3d is not active+clean 2024-09-17T03:41:09.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.660671+0000', 'last_change': '2024-09-17T03:41:03.660671+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.660671+0000', 'last_undegraded': '2024-09-17T03:41:03.660671+0000', 'last_fullsized': '2024-09-17T03:41:03.660671+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:41:09.390 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3c is not active+clean 2024-09-17T03:41:09.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.665901+0000', 'last_change': '2024-09-17T03:41:03.665901+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.665901+0000', 'last_undegraded': '2024-09-17T03:41:03.665901+0000', 'last_fullsized': '2024-09-17T03:41:03.665901+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:41:09.391 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3b is not active+clean 2024-09-17T03:41:09.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.666474+0000', 'last_change': '2024-09-17T03:41:03.666474+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.666474+0000', 'last_undegraded': '2024-09-17T03:41:03.666474+0000', 'last_fullsized': '2024-09-17T03:41:03.666474+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:41:09.391 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3a is not active+clean 2024-09-17T03:41:09.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.661120+0000', 'last_change': '2024-09-17T03:41:03.661120+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.661120+0000', 'last_undegraded': '2024-09-17T03:41:03.661120+0000', 'last_fullsized': '2024-09-17T03:41:03.661120+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:41:09.391 INFO:tasks.ceph.ceph_manager.ceph:PG 19.39 is not active+clean 2024-09-17T03:41:09.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.662424+0000', 'last_change': '2024-09-17T03:41:03.662424+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.662424+0000', 'last_undegraded': '2024-09-17T03:41:03.662424+0000', 'last_fullsized': '2024-09-17T03:41:03.662424+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:41:09.391 INFO:tasks.ceph.ceph_manager.ceph:PG 19.38 is not active+clean 2024-09-17T03:41:09.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.659572+0000', 'last_change': '2024-09-17T03:41:03.659572+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.659572+0000', 'last_undegraded': '2024-09-17T03:41:03.659572+0000', 'last_fullsized': '2024-09-17T03:41:03.659572+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:41:09.391 INFO:tasks.ceph.ceph_manager.ceph:PG 19.37 is not active+clean 2024-09-17T03:41:09.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.661229+0000', 'last_change': '2024-09-17T03:41:03.661229+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.661229+0000', 'last_undegraded': '2024-09-17T03:41:03.661229+0000', 'last_fullsized': '2024-09-17T03:41:03.661229+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:41:09.392 INFO:tasks.ceph.ceph_manager.ceph:PG 19.36 is not active+clean 2024-09-17T03:41:09.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.663835+0000', 'last_change': '2024-09-17T03:41:03.663835+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.663835+0000', 'last_undegraded': '2024-09-17T03:41:03.663835+0000', 'last_fullsized': '2024-09-17T03:41:03.663835+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:41:09.392 INFO:tasks.ceph.ceph_manager.ceph:PG 19.35 is not active+clean 2024-09-17T03:41:09.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.662386+0000', 'last_change': '2024-09-17T03:41:03.662386+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.662386+0000', 'last_undegraded': '2024-09-17T03:41:03.662386+0000', 'last_fullsized': '2024-09-17T03:41:03.662386+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:41:09.392 INFO:tasks.ceph.ceph_manager.ceph:PG 19.34 is not active+clean 2024-09-17T03:41:09.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.659424+0000', 'last_change': '2024-09-17T03:41:03.659424+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.659424+0000', 'last_undegraded': '2024-09-17T03:41:03.659424+0000', 'last_fullsized': '2024-09-17T03:41:03.659424+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:41:09.392 INFO:tasks.ceph.ceph_manager.ceph:PG 19.33 is not active+clean 2024-09-17T03:41:09.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.668363+0000', 'last_change': '2024-09-17T03:41:03.668363+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.668363+0000', 'last_undegraded': '2024-09-17T03:41:03.668363+0000', 'last_fullsized': '2024-09-17T03:41:03.668363+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:41:09.392 INFO:tasks.ceph.ceph_manager.ceph:PG 19.32 is not active+clean 2024-09-17T03:41:09.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.663736+0000', 'last_change': '2024-09-17T03:41:03.663736+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.663736+0000', 'last_undegraded': '2024-09-17T03:41:03.663736+0000', 'last_fullsized': '2024-09-17T03:41:03.663736+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:PG 19.31 is not active+clean 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.665838+0000', 'last_change': '2024-09-17T03:41:03.665838+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.665838+0000', 'last_undegraded': '2024-09-17T03:41:03.665838+0000', 'last_fullsized': '2024-09-17T03:41:03.665838+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2f is not active+clean 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.662489+0000', 'last_change': '2024-09-17T03:41:03.662489+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.662489+0000', 'last_undegraded': '2024-09-17T03:41:03.662489+0000', 'last_fullsized': '2024-09-17T03:41:03.662489+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2d is not active+clean 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.661907+0000', 'last_change': '2024-09-17T03:41:03.661907+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.661907+0000', 'last_undegraded': '2024-09-17T03:41:03.661907+0000', 'last_fullsized': '2024-09-17T03:41:03.661907+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2b is not active+clean 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.668038+0000', 'last_change': '2024-09-17T03:41:03.668038+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.668038+0000', 'last_undegraded': '2024-09-17T03:41:03.668038+0000', 'last_fullsized': '2024-09-17T03:41:03.668038+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2a is not active+clean 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.661114+0000', 'last_change': '2024-09-17T03:41:03.661114+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.661114+0000', 'last_undegraded': '2024-09-17T03:41:03.661114+0000', 'last_fullsized': '2024-09-17T03:41:03.661114+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:PG 19.29 is not active+clean 2024-09-17T03:41:09.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.658915+0000', 'last_change': '2024-09-17T03:41:03.658915+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.658915+0000', 'last_undegraded': '2024-09-17T03:41:03.658915+0000', 'last_fullsized': '2024-09-17T03:41:03.658915+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:41:09.394 INFO:tasks.ceph.ceph_manager.ceph:PG 19.28 is not active+clean 2024-09-17T03:41:09.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.661399+0000', 'last_change': '2024-09-17T03:41:03.661399+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.661399+0000', 'last_undegraded': '2024-09-17T03:41:03.661399+0000', 'last_fullsized': '2024-09-17T03:41:03.661399+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:41:09.394 INFO:tasks.ceph.ceph_manager.ceph:PG 19.27 is not active+clean 2024-09-17T03:41:09.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.663743+0000', 'last_change': '2024-09-17T03:41:03.663743+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.663743+0000', 'last_undegraded': '2024-09-17T03:41:03.663743+0000', 'last_fullsized': '2024-09-17T03:41:03.663743+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:41:09.394 INFO:tasks.ceph.ceph_manager.ceph:PG 19.25 is not active+clean 2024-09-17T03:41:09.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.665301+0000', 'last_change': '2024-09-17T03:41:03.665301+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.665301+0000', 'last_undegraded': '2024-09-17T03:41:03.665301+0000', 'last_fullsized': '2024-09-17T03:41:03.665301+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:41:09.394 INFO:tasks.ceph.ceph_manager.ceph:PG 19.23 is not active+clean 2024-09-17T03:41:09.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.667902+0000', 'last_change': '2024-09-17T03:41:03.667902+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.667902+0000', 'last_undegraded': '2024-09-17T03:41:03.667902+0000', 'last_fullsized': '2024-09-17T03:41:03.667902+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:41:09.394 INFO:tasks.ceph.ceph_manager.ceph:PG 19.22 is not active+clean 2024-09-17T03:41:09.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.666662+0000', 'last_change': '2024-09-17T03:41:03.666662+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.666662+0000', 'last_undegraded': '2024-09-17T03:41:03.666662+0000', 'last_fullsized': '2024-09-17T03:41:03.666662+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:41:09.394 INFO:tasks.ceph.ceph_manager.ceph:PG 19.21 is not active+clean 2024-09-17T03:41:09.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.669042+0000', 'last_change': '2024-09-17T03:41:03.669042+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.669042+0000', 'last_undegraded': '2024-09-17T03:41:03.669042+0000', 'last_fullsized': '2024-09-17T03:41:03.669042+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:41:09.395 INFO:tasks.ceph.ceph_manager.ceph:PG 19.20 is not active+clean 2024-09-17T03:41:09.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.659148+0000', 'last_change': '2024-09-17T03:41:03.659148+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.659148+0000', 'last_undegraded': '2024-09-17T03:41:03.659148+0000', 'last_fullsized': '2024-09-17T03:41:03.659148+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:41:09.395 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1f is not active+clean 2024-09-17T03:41:09.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.659794+0000', 'last_change': '2024-09-17T03:41:03.659794+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.659794+0000', 'last_undegraded': '2024-09-17T03:41:03.659794+0000', 'last_fullsized': '2024-09-17T03:41:03.659794+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:41:09.395 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1c is not active+clean 2024-09-17T03:41:09.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.668568+0000', 'last_change': '2024-09-17T03:41:03.668568+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.668568+0000', 'last_undegraded': '2024-09-17T03:41:03.668568+0000', 'last_fullsized': '2024-09-17T03:41:03.668568+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:41:09.395 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1d is not active+clean 2024-09-17T03:41:09.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.668682+0000', 'last_change': '2024-09-17T03:41:03.668682+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.668682+0000', 'last_undegraded': '2024-09-17T03:41:03.668682+0000', 'last_fullsized': '2024-09-17T03:41:03.668682+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:41:09.395 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1b is not active+clean 2024-09-17T03:41:09.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.659787+0000', 'last_change': '2024-09-17T03:41:03.659787+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.659787+0000', 'last_undegraded': '2024-09-17T03:41:03.659787+0000', 'last_fullsized': '2024-09-17T03:41:03.659787+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:PG 19.18 is not active+clean 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.659028+0000', 'last_change': '2024-09-17T03:41:03.659028+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.659028+0000', 'last_undegraded': '2024-09-17T03:41:03.659028+0000', 'last_fullsized': '2024-09-17T03:41:03.659028+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:PG 19.19 is not active+clean 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.663216+0000', 'last_change': '2024-09-17T03:41:03.663216+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.663216+0000', 'last_undegraded': '2024-09-17T03:41:03.663216+0000', 'last_fullsized': '2024-09-17T03:41:03.663216+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:PG 19.16 is not active+clean 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.665544+0000', 'last_change': '2024-09-17T03:41:03.665544+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.665544+0000', 'last_undegraded': '2024-09-17T03:41:03.665544+0000', 'last_fullsized': '2024-09-17T03:41:03.665544+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:PG 19.14 is not active+clean 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.668052+0000', 'last_change': '2024-09-17T03:41:03.668052+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.668052+0000', 'last_undegraded': '2024-09-17T03:41:03.668052+0000', 'last_fullsized': '2024-09-17T03:41:03.668052+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:PG 19.15 is not active+clean 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.666707+0000', 'last_change': '2024-09-17T03:41:03.666707+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.666707+0000', 'last_undegraded': '2024-09-17T03:41:03.666707+0000', 'last_fullsized': '2024-09-17T03:41:03.666707+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:PG 19.13 is not active+clean 2024-09-17T03:41:09.396 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.666691+0000', 'last_change': '2024-09-17T03:41:03.666691+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.666691+0000', 'last_undegraded': '2024-09-17T03:41:03.666691+0000', 'last_fullsized': '2024-09-17T03:41:03.666691+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:41:09.397 INFO:tasks.ceph.ceph_manager.ceph:PG 19.10 is not active+clean 2024-09-17T03:41:09.397 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.662623+0000', 'last_change': '2024-09-17T03:41:03.662623+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.662623+0000', 'last_undegraded': '2024-09-17T03:41:03.662623+0000', 'last_fullsized': '2024-09-17T03:41:03.662623+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:41:09.397 INFO:tasks.ceph.ceph_manager.ceph:PG 19.11 is not active+clean 2024-09-17T03:41:09.397 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.660821+0000', 'last_change': '2024-09-17T03:41:03.660821+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.660821+0000', 'last_undegraded': '2024-09-17T03:41:03.660821+0000', 'last_fullsized': '2024-09-17T03:41:03.660821+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:41:09.397 INFO:tasks.ceph.ceph_manager.ceph:PG 19.e is not active+clean 2024-09-17T03:41:09.397 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.659964+0000', 'last_change': '2024-09-17T03:41:03.659964+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.659964+0000', 'last_undegraded': '2024-09-17T03:41:03.659964+0000', 'last_fullsized': '2024-09-17T03:41:03.659964+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:41:09.397 INFO:tasks.ceph.ceph_manager.ceph:PG 19.d is not active+clean 2024-09-17T03:41:09.397 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.661416+0000', 'last_change': '2024-09-17T03:41:03.661416+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.661416+0000', 'last_undegraded': '2024-09-17T03:41:03.661416+0000', 'last_fullsized': '2024-09-17T03:41:03.661416+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:41:09.397 INFO:tasks.ceph.ceph_manager.ceph:PG 19.a is not active+clean 2024-09-17T03:41:09.397 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.666052+0000', 'last_change': '2024-09-17T03:41:03.666052+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.666052+0000', 'last_undegraded': '2024-09-17T03:41:03.666052+0000', 'last_fullsized': '2024-09-17T03:41:03.666052+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:41:09.397 INFO:tasks.ceph.ceph_manager.ceph:PG 19.b is not active+clean 2024-09-17T03:41:09.398 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.659305+0000', 'last_change': '2024-09-17T03:41:03.659305+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.659305+0000', 'last_undegraded': '2024-09-17T03:41:03.659305+0000', 'last_fullsized': '2024-09-17T03:41:03.659305+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:41:09.398 INFO:tasks.ceph.ceph_manager.ceph:PG 19.8 is not active+clean 2024-09-17T03:41:09.398 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.661138+0000', 'last_change': '2024-09-17T03:41:03.661138+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.661138+0000', 'last_undegraded': '2024-09-17T03:41:03.661138+0000', 'last_fullsized': '2024-09-17T03:41:03.661138+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:41:09.398 INFO:tasks.ceph.ceph_manager.ceph:PG 19.9 is not active+clean 2024-09-17T03:41:09.398 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.669492+0000', 'last_change': '2024-09-17T03:41:03.669492+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.669492+0000', 'last_undegraded': '2024-09-17T03:41:03.669492+0000', 'last_fullsized': '2024-09-17T03:41:03.669492+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:41:09.398 INFO:tasks.ceph.ceph_manager.ceph:PG 19.6 is not active+clean 2024-09-17T03:41:09.398 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.660865+0000', 'last_change': '2024-09-17T03:41:03.660865+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.660865+0000', 'last_undegraded': '2024-09-17T03:41:03.660865+0000', 'last_fullsized': '2024-09-17T03:41:03.660865+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:41:09.398 INFO:tasks.ceph.ceph_manager.ceph:PG 19.7 is not active+clean 2024-09-17T03:41:09.398 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.668855+0000', 'last_change': '2024-09-17T03:41:03.668855+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.668855+0000', 'last_undegraded': '2024-09-17T03:41:03.668855+0000', 'last_fullsized': '2024-09-17T03:41:03.668855+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:41:09.398 INFO:tasks.ceph.ceph_manager.ceph:PG 19.4 is not active+clean 2024-09-17T03:41:09.398 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.660772+0000', 'last_change': '2024-09-17T03:41:03.660772+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.660772+0000', 'last_undegraded': '2024-09-17T03:41:03.660772+0000', 'last_fullsized': '2024-09-17T03:41:03.660772+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:41:09.399 INFO:tasks.ceph.ceph_manager.ceph:PG 19.5 is not active+clean 2024-09-17T03:41:09.399 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.660107+0000', 'last_change': '2024-09-17T03:41:03.660107+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.660107+0000', 'last_undegraded': '2024-09-17T03:41:03.660107+0000', 'last_fullsized': '2024-09-17T03:41:03.660107+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:41:09.399 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2 is not active+clean 2024-09-17T03:41:09.399 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.668196+0000', 'last_change': '2024-09-17T03:41:03.668196+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.668196+0000', 'last_undegraded': '2024-09-17T03:41:03.668196+0000', 'last_fullsized': '2024-09-17T03:41:03.668196+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:41:09.399 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1 is not active+clean 2024-09-17T03:41:09.399 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.661116+0000', 'last_change': '2024-09-17T03:41:03.661116+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.661116+0000', 'last_undegraded': '2024-09-17T03:41:03.661116+0000', 'last_fullsized': '2024-09-17T03:41:03.661116+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:41:09.399 INFO:tasks.ceph.ceph_manager.ceph:PG 19.12 is not active+clean 2024-09-17T03:41:09.399 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 128, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:03.666007+0000', 'last_change': '2024-09-17T03:41:03.666007+0000', 'last_active': '2024-09-17T03:41:03.648345+0000', 'last_peered': '2024-09-17T03:41:03.648345+0000', 'last_clean': '2024-09-17T03:41:03.648345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:03.666007+0000', 'last_undegraded': '2024-09-17T03:41:03.666007+0000', 'last_fullsized': '2024-09-17T03:41:03.666007+0000', 'mapping_epoch': 128, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 128, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:03.648345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:41:09.400 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:41:09.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.542+0000 7f4308e0a640 1 -- 172.21.15.146:0/630303946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040b4370 msgr2=0x7f43040b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.542+0000 7f4308e0a640 1 --2- 172.21.15.146:0/630303946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040b4370 0x7f43040b4780 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f42fc005fd0 tx=0x7f42fc02aa10 comp rx=0 tx=0).stop 2024-09-17T03:41:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.542+0000 7f4308e0a640 1 -- 172.21.15.146:0/630303946 shutdown_connections 2024-09-17T03:41:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.542+0000 7f4308e0a640 1 --2- 172.21.15.146:0/630303946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040b4370 0x7f43040b4780 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.542+0000 7f4308e0a640 1 --2- 172.21.15.146:0/630303946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4304072680 0x7f4304072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.542+0000 7f4308e0a640 1 -- 172.21.15.146:0/630303946 >> 172.21.15.146:0/630303946 conn(0x7f43040b2060 msgr2=0x7f43040b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.542+0000 7f4308e0a640 1 -- 172.21.15.146:0/630303946 shutdown_connections 2024-09-17T03:41:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.542+0000 7f4308e0a640 1 -- 172.21.15.146:0/630303946 wait complete. 2024-09-17T03:41:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.544+0000 7f4308e0a640 1 Processor -- start 2024-09-17T03:41:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.544+0000 7f4308e0a640 1 -- start start 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.545+0000 7f4308e0a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4304072680 0x7f430406eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.545+0000 7f4308e0a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040b4370 0x7f4304148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.545+0000 7f4308e0a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f430415b770 0x7f4304148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.545+0000 7f4308e0a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f43040b4e40 con 0x7f43040b4370 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.545+0000 7f4308e0a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f43040b4cc0 con 0x7f430415b770 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4308e0a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f43040b4fc0 con 0x7f4304072680 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4301d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040b4370 0x7f4304148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4301d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040b4370 0x7f4304148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33418/0 (socket says 172.21.15.146:33418) 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4301d9b640 1 -- 172.21.15.146:0/3049650586 learned_addr learned my addr 172.21.15.146:0/3049650586 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f430259c640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4304072680 0x7f430406eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4302d9d640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f430415b770 0x7f4304148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4301d9b640 1 -- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4304072680 msgr2=0x7f430406eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4301d9b640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4304072680 0x7f430406eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4301d9b640 1 -- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f430415b770 msgr2=0x7f4304148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4301d9b640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f430415b770 0x7f4304148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4301d9b640 1 -- 172.21.15.146:0/3049650586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430414b4b0 con 0x7f43040b4370 2024-09-17T03:41:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4301d9b640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040b4370 0x7f4304148510 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f42f800e7c0 tx=0x7f42f800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f42f2ffd640 1 -- 172.21.15.146:0/3049650586 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f800ccc0 con 0x7f43040b4370 2024-09-17T03:41:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f42f2ffd640 1 -- 172.21.15.146:0/3049650586 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42f8010430 con 0x7f43040b4370 2024-09-17T03:41:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4308e0a640 1 -- 172.21.15.146:0/3049650586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430414b790 con 0x7f43040b4370 2024-09-17T03:41:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f42f2ffd640 1 -- 172.21.15.146:0/3049650586 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8010840 con 0x7f43040b4370 2024-09-17T03:41:09.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.546+0000 7f4308e0a640 1 -- 172.21.15.146:0/3049650586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430415be80 con 0x7f43040b4370 2024-09-17T03:41:09.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.547+0000 7f4308e0a640 1 -- 172.21.15.146:0/3049650586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43040b5580 con 0x7f43040b4370 2024-09-17T03:41:09.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.548+0000 7f42f2ffd640 1 -- 172.21.15.146:0/3049650586 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42f80109e0 con 0x7f43040b4370 2024-09-17T03:41:09.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.549+0000 7f42f2ffd640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f42e4078b90 0x7f42e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.549+0000 7f42f2ffd640 1 -- 172.21.15.146:0/3049650586 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f42f809b6d0 con 0x7f43040b4370 2024-09-17T03:41:09.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.549+0000 7f430259c640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f42e4078b90 0x7f42e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.549+0000 7f430259c640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f42e4078b90 0x7f42e407b0a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f42f4001720 tx=0x7f42f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:09.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.553+0000 7f42f2ffd640 1 -- 172.21.15.146:0/3049650586 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42f8063550 con 0x7f43040b4370 2024-09-17T03:41:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.797+0000 7f4308e0a640 1 -- 172.21.15.146:0/3049650586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f430415c2a0 con 0x7f43040b4370 2024-09-17T03:41:09.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.798+0000 7f42f2ffd640 1 -- 172.21.15.146:0/3049650586 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1689 (secure 0 0 0) 0x7f42f8067f80 con 0x7f43040b4370 2024-09-17T03:41:09.797 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:09.797 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":514,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":52},{"state_name":"active+clean","count":45}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590480,"bytes_used":381816832,"bytes_avail":772712296448,"bytes_total":773094113280,"inactive_pgs_ratio":0.53608244657516479,"write_bytes_sec":388,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8658}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-17T03:40:47.915551+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:41:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 -- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f42e4078b90 msgr2=0x7f42e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f42e4078b90 0x7f42e407b0a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f42f4001720 tx=0x7f42f4009040 comp rx=0 tx=0).stop 2024-09-17T03:41:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 -- 172.21.15.146:0/3049650586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040b4370 msgr2=0x7f4304148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040b4370 0x7f4304148510 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f42f800e7c0 tx=0x7f42f800ec80 comp rx=0 tx=0).stop 2024-09-17T03:41:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 -- 172.21.15.146:0/3049650586 shutdown_connections 2024-09-17T03:41:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f42e4078b90 0x7f42e407b0a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f430415b770 0x7f4304148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43040b4370 0x7f4304148510 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 --2- 172.21.15.146:0/3049650586 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4304072680 0x7f430406eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 -- 172.21.15.146:0/3049650586 >> 172.21.15.146:0/3049650586 conn(0x7f43040b2060 msgr2=0x7f4304159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 -- 172.21.15.146:0/3049650586 shutdown_connections 2024-09-17T03:41:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.800+0000 7f4308e0a640 1 -- 172.21.15.146:0/3049650586 wait complete. 2024-09-17T03:41:09.812 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:41:09.813 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:41:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.926+0000 7ffa363eb640 1 -- 172.21.15.146:0/1582572219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa30070350 msgr2=0x7ffa30072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.926+0000 7ffa363eb640 1 --2- 172.21.15.146:0/1582572219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa30070350 0x7ffa30072680 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7ffa180098e0 tx=0x7ffa1802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.926+0000 7ffa363eb640 1 -- 172.21.15.146:0/1582572219 shutdown_connections 2024-09-17T03:41:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.926+0000 7ffa363eb640 1 --2- 172.21.15.146:0/1582572219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa30070350 0x7ffa30072680 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.926+0000 7ffa363eb640 1 --2- 172.21.15.146:0/1582572219 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa3015b770 0x7ffa3006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.926+0000 7ffa363eb640 1 -- 172.21.15.146:0/1582572219 >> 172.21.15.146:0/1582572219 conn(0x7ffa300b2060 msgr2=0x7ffa300b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.926+0000 7ffa363eb640 1 -- 172.21.15.146:0/1582572219 shutdown_connections 2024-09-17T03:41:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.926+0000 7ffa363eb640 1 -- 172.21.15.146:0/1582572219 wait complete. 2024-09-17T03:41:09.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.928+0000 7ffa363eb640 1 Processor -- start 2024-09-17T03:41:09.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.928+0000 7ffa363eb640 1 -- start start 2024-09-17T03:41:09.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa363eb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa30070350 0x7ffa300cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa363eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa30072bc0 0x7ffa3014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa363eb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa3015b770 0x7ffa301f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa363eb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3015f9f0 con 0x7ffa30072bc0 2024-09-17T03:41:09.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa363eb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffa300b5590 con 0x7ffa3015b770 2024-09-17T03:41:09.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa363eb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3015fb70 con 0x7ffa30070350 2024-09-17T03:41:09.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa27fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa30072bc0 0x7ffa3014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa27fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa30072bc0 0x7ffa3014fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33428/0 (socket says 172.21.15.146:33428) 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa27fff640 1 -- 172.21.15.146:0/2362927482 learned_addr learned my addr 172.21.15.146:0/2362927482 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa2ffff640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa30070350 0x7ffa300cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa34988640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa3015b770 0x7ffa301f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa27fff640 1 -- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa30070350 msgr2=0x7ffa300cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa27fff640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa30070350 0x7ffa300cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa27fff640 1 -- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa3015b770 msgr2=0x7ffa301f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa27fff640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa3015b770 0x7ffa301f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa27fff640 1 -- 172.21.15.146:0/2362927482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa300cfa90 con 0x7ffa30072bc0 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa2ffff640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa30070350 0x7ffa300cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa27fff640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa30072bc0 0x7ffa3014fe60 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7ffa1802aa90 tx=0x7ffa180052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa2d7fa640 1 -- 172.21.15.146:0/2362927482 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1803f070 con 0x7ffa30072bc0 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa2d7fa640 1 -- 172.21.15.146:0/2362927482 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa18004340 con 0x7ffa30072bc0 2024-09-17T03:41:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa363eb640 1 -- 172.21.15.146:0/2362927482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa30152650 con 0x7ffa30072bc0 2024-09-17T03:41:09.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.930+0000 7ffa2d7fa640 1 -- 172.21.15.146:0/2362927482 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18005cf0 con 0x7ffa30072bc0 2024-09-17T03:41:09.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.931+0000 7ffa363eb640 1 -- 172.21.15.146:0/2362927482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa30152320 con 0x7ffa30072bc0 2024-09-17T03:41:09.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.932+0000 7ffa363eb640 1 -- 172.21.15.146:0/2362927482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa301600a0 con 0x7ffa30072bc0 2024-09-17T03:41:09.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.932+0000 7ffa2d7fa640 1 -- 172.21.15.146:0/2362927482 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa18042070 con 0x7ffa30072bc0 2024-09-17T03:41:09.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.933+0000 7ffa2d7fa640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa10078b90 0x7ffa1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:09.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.933+0000 7ffa2d7fa640 1 -- 172.21.15.146:0/2362927482 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7ffa180bbc20 con 0x7ffa30072bc0 2024-09-17T03:41:09.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.933+0000 7ffa2ffff640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa10078b90 0x7ffa1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:09.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.934+0000 7ffa2ffff640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa10078b90 0x7ffa1007b0a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ffa20005fd0 tx=0x7ffa2000f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:09.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:09.937+0000 7ffa2d7fa640 1 -- 172.21.15.146:0/2362927482 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffa3015bb80 con 0x7ffa30072bc0 2024-09-17T03:41:10.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.133+0000 7ffa363eb640 1 -- 172.21.15.146:0/2362927482 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa301503a0 con 0x7ffa10078b90 2024-09-17T03:41:10.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.138+0000 7ffa2d7fa640 1 -- 172.21.15.146:0/2362927482 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252472 (secure 0 0 0) 0x7ffa2000fb80 con 0x7ffa10078b90 2024-09-17T03:41:10.139 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:10.141 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:41:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 -- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa10078b90 msgr2=0x7ffa1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa10078b90 0x7ffa1007b0a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ffa20005fd0 tx=0x7ffa2000f360 comp rx=0 tx=0).stop 2024-09-17T03:41:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 -- 172.21.15.146:0/2362927482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa30072bc0 msgr2=0x7ffa3014fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa30072bc0 0x7ffa3014fe60 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7ffa1802aa90 tx=0x7ffa180052f0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 -- 172.21.15.146:0/2362927482 shutdown_connections 2024-09-17T03:41:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa10078b90 0x7ffa1007b0a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa3015b770 0x7ffa301f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa30072bc0 0x7ffa3014fe60 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 --2- 172.21.15.146:0/2362927482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa30070350 0x7ffa300cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 -- 172.21.15.146:0/2362927482 >> 172.21.15.146:0/2362927482 conn(0x7ffa300b2060 msgr2=0x7ffa300b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 -- 172.21.15.146:0/2362927482 shutdown_connections 2024-09-17T03:41:10.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:10.141+0000 7ffa363eb640 1 -- 172.21.15.146:0/2362927482 wait complete. 2024-09-17T03:41:10.151 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-09-17T03:41:09.921371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":391088,"kb_used_data":13832,"kb_used_omap":12,"kb_used_meta":377075,"kb_avail":754583632,"statfs":{"total":773094113280,"available":772693639168,"internally_reserved":0,"allocated":14163968,"data_stored":6843668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":386125361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.264605"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993207+0000","last_change":"2024-09-17T03:41:04.672249+0000","last_active":"2024-09-17T03:41:05.993207+0000","last_peered":"2024-09-17T03:41:05.993207+0000","last_clean":"2024-09-17T03:41:05.993207+0000","last_became_active":"2024-09-17T03:41:04.671932+0000","last_became_peered":"2024-09-17T03:41:04.671932+0000","last_unstale":"2024-09-17T03:41:05.993207+0000","last_undegraded":"2024-09-17T03:41:05.993207+0000","last_fullsized":"2024-09-17T03:41:05.993207+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:39.105086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992166+0000","last_change":"2024-09-17T03:41:04.665581+0000","last_active":"2024-09-17T03:41:05.992166+0000","last_peered":"2024-09-17T03:41:05.992166+0000","last_clean":"2024-09-17T03:41:05.992166+0000","last_became_active":"2024-09-17T03:41:04.664464+0000","last_became_peered":"2024-09-17T03:41:04.664464+0000","last_unstale":"2024-09-17T03:41:05.992166+0000","last_undegraded":"2024-09-17T03:41:05.992166+0000","last_fullsized":"2024-09-17T03:41:05.992166+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:01.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670513+0000","last_change":"2024-09-17T03:41:04.667588+0000","last_active":"2024-09-17T03:41:05.670513+0000","last_peered":"2024-09-17T03:41:05.670513+0000","last_clean":"2024-09-17T03:41:05.670513+0000","last_became_active":"2024-09-17T03:41:04.667263+0000","last_became_peered":"2024-09-17T03:41:04.667263+0000","last_unstale":"2024-09-17T03:41:05.670513+0000","last_undegraded":"2024-09-17T03:41:05.670513+0000","last_fullsized":"2024-09-17T03:41:05.670513+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:52.333599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992229+0000","last_change":"2024-09-17T03:41:04.680843+0000","last_active":"2024-09-17T03:41:05.992229+0000","last_peered":"2024-09-17T03:41:05.992229+0000","last_clean":"2024-09-17T03:41:05.992229+0000","last_became_active":"2024-09-17T03:41:04.680479+0000","last_became_peered":"2024-09-17T03:41:04.680479+0000","last_unstale":"2024-09-17T03:41:05.992229+0000","last_undegraded":"2024-09-17T03:41:05.992229+0000","last_fullsized":"2024-09-17T03:41:05.992229+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:49.779612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679336+0000","last_change":"2024-09-17T03:41:04.679361+0000","last_active":"2024-09-17T03:41:05.679336+0000","last_peered":"2024-09-17T03:41:05.679336+0000","last_clean":"2024-09-17T03:41:05.679336+0000","last_became_active":"2024-09-17T03:41:04.678823+0000","last_became_peered":"2024-09-17T03:41:04.678823+0000","last_unstale":"2024-09-17T03:41:05.679336+0000","last_undegraded":"2024-09-17T03:41:05.679336+0000","last_fullsized":"2024-09-17T03:41:05.679336+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:11.633326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670496+0000","last_change":"2024-09-17T03:41:04.671657+0000","last_active":"2024-09-17T03:41:05.670496+0000","last_peered":"2024-09-17T03:41:05.670496+0000","last_clean":"2024-09-17T03:41:05.670496+0000","last_became_active":"2024-09-17T03:41:04.671355+0000","last_became_peered":"2024-09-17T03:41:04.671355+0000","last_unstale":"2024-09-17T03:41:05.670496+0000","last_undegraded":"2024-09-17T03:41:05.670496+0000","last_fullsized":"2024-09-17T03:41:05.670496+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:04.156584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669722+0000","last_change":"2024-09-17T03:41:04.664789+0000","last_active":"2024-09-17T03:41:05.669722+0000","last_peered":"2024-09-17T03:41:05.669722+0000","last_clean":"2024-09-17T03:41:05.669722+0000","last_became_active":"2024-09-17T03:41:04.664451+0000","last_became_peered":"2024-09-17T03:41:04.664451+0000","last_unstale":"2024-09-17T03:41:05.669722+0000","last_undegraded":"2024-09-17T03:41:05.669722+0000","last_fullsized":"2024-09-17T03:41:05.669722+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:06.838055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670206+0000","last_change":"2024-09-17T03:41:04.677687+0000","last_active":"2024-09-17T03:41:05.670206+0000","last_peered":"2024-09-17T03:41:05.670206+0000","last_clean":"2024-09-17T03:41:05.670206+0000","last_became_active":"2024-09-17T03:41:04.677149+0000","last_became_peered":"2024-09-17T03:41:04.677149+0000","last_unstale":"2024-09-17T03:41:05.670206+0000","last_undegraded":"2024-09-17T03:41:05.670206+0000","last_fullsized":"2024-09-17T03:41:05.670206+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:24.425255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670969+0000","last_change":"2024-09-17T03:41:04.675327+0000","last_active":"2024-09-17T03:41:05.670969+0000","last_peered":"2024-09-17T03:41:05.670969+0000","last_clean":"2024-09-17T03:41:05.670969+0000","last_became_active":"2024-09-17T03:41:04.674979+0000","last_became_peered":"2024-09-17T03:41:04.674979+0000","last_unstale":"2024-09-17T03:41:05.670969+0000","last_undegraded":"2024-09-17T03:41:05.670969+0000","last_fullsized":"2024-09-17T03:41:05.670969+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:06.838055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992482+0000","last_change":"2024-09-17T03:41:04.672762+0000","last_active":"2024-09-17T03:41:05.992482+0000","last_peered":"2024-09-17T03:41:05.992482+0000","last_clean":"2024-09-17T03:41:05.992482+0000","last_became_active":"2024-09-17T03:41:04.672460+0000","last_became_peered":"2024-09-17T03:41:04.672460+0000","last_unstale":"2024-09-17T03:41:05.992482+0000","last_undegraded":"2024-09-17T03:41:05.992482+0000","last_fullsized":"2024-09-17T03:41:05.992482+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:21.361458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668703+0000","last_change":"2024-09-17T03:41:04.673942+0000","last_active":"2024-09-17T03:41:05.668703+0000","last_peered":"2024-09-17T03:41:05.668703+0000","last_clean":"2024-09-17T03:41:05.668703+0000","last_became_active":"2024-09-17T03:41:04.673639+0000","last_became_peered":"2024-09-17T03:41:04.673639+0000","last_unstale":"2024-09-17T03:41:05.668703+0000","last_undegraded":"2024-09-17T03:41:05.668703+0000","last_fullsized":"2024-09-17T03:41:05.668703+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:24.886857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670397+0000","last_change":"2024-09-17T03:41:04.668452+0000","last_active":"2024-09-17T03:41:05.670397+0000","last_peered":"2024-09-17T03:41:05.670397+0000","last_clean":"2024-09-17T03:41:05.670397+0000","last_became_active":"2024-09-17T03:41:04.668145+0000","last_became_peered":"2024-09-17T03:41:04.668145+0000","last_unstale":"2024-09-17T03:41:05.670397+0000","last_undegraded":"2024-09-17T03:41:05.670397+0000","last_fullsized":"2024-09-17T03:41:05.670397+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:34.573268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993206+0000","last_change":"2024-09-17T03:41:04.682835+0000","last_active":"2024-09-17T03:41:05.993206+0000","last_peered":"2024-09-17T03:41:05.993206+0000","last_clean":"2024-09-17T03:41:05.993206+0000","last_became_active":"2024-09-17T03:41:04.682107+0000","last_became_peered":"2024-09-17T03:41:04.682107+0000","last_unstale":"2024-09-17T03:41:05.993206+0000","last_undegraded":"2024-09-17T03:41:05.993206+0000","last_fullsized":"2024-09-17T03:41:05.993206+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.922478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992181+0000","last_change":"2024-09-17T03:41:04.675335+0000","last_active":"2024-09-17T03:41:05.992181+0000","last_peered":"2024-09-17T03:41:05.992181+0000","last_clean":"2024-09-17T03:41:05.992181+0000","last_became_active":"2024-09-17T03:41:04.675056+0000","last_became_peered":"2024-09-17T03:41:04.675056+0000","last_unstale":"2024-09-17T03:41:05.992181+0000","last_undegraded":"2024-09-17T03:41:05.992181+0000","last_fullsized":"2024-09-17T03:41:05.992181+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:05.163716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992623+0000","last_change":"2024-09-17T03:41:04.671396+0000","last_active":"2024-09-17T03:41:05.992623+0000","last_peered":"2024-09-17T03:41:05.992623+0000","last_clean":"2024-09-17T03:41:05.992623+0000","last_became_active":"2024-09-17T03:41:04.671094+0000","last_became_peered":"2024-09-17T03:41:04.671094+0000","last_unstale":"2024-09-17T03:41:05.992623+0000","last_undegraded":"2024-09-17T03:41:05.992623+0000","last_fullsized":"2024-09-17T03:41:05.992623+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:16.170440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775951+0000","last_change":"2024-09-17T03:41:04.684317+0000","last_active":"2024-09-17T03:41:05.775951+0000","last_peered":"2024-09-17T03:41:05.775951+0000","last_clean":"2024-09-17T03:41:05.775951+0000","last_became_active":"2024-09-17T03:41:04.682665+0000","last_became_peered":"2024-09-17T03:41:04.682665+0000","last_unstale":"2024-09-17T03:41:05.775951+0000","last_undegraded":"2024-09-17T03:41:05.775951+0000","last_fullsized":"2024-09-17T03:41:05.775951+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:26.514663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.671294+0000","last_change":"2024-09-17T03:41:04.665988+0000","last_active":"2024-09-17T03:41:05.671294+0000","last_peered":"2024-09-17T03:41:05.671294+0000","last_clean":"2024-09-17T03:41:05.671294+0000","last_became_active":"2024-09-17T03:41:04.665691+0000","last_became_peered":"2024-09-17T03:41:04.665691+0000","last_unstale":"2024-09-17T03:41:05.671294+0000","last_undegraded":"2024-09-17T03:41:05.671294+0000","last_fullsized":"2024-09-17T03:41:05.671294+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:38.931430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776176+0000","last_change":"2024-09-17T03:41:04.672835+0000","last_active":"2024-09-17T03:41:05.776176+0000","last_peered":"2024-09-17T03:41:05.776176+0000","last_clean":"2024-09-17T03:41:05.776176+0000","last_became_active":"2024-09-17T03:41:04.672536+0000","last_became_peered":"2024-09-17T03:41:04.672536+0000","last_unstale":"2024-09-17T03:41:05.776176+0000","last_undegraded":"2024-09-17T03:41:05.776176+0000","last_fullsized":"2024-09-17T03:41:05.776176+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:20.558673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668702+0000","last_change":"2024-09-17T03:41:04.672148+0000","last_active":"2024-09-17T03:41:05.668702+0000","last_peered":"2024-09-17T03:41:05.668702+0000","last_clean":"2024-09-17T03:41:05.668702+0000","last_became_active":"2024-09-17T03:41:04.671834+0000","last_became_peered":"2024-09-17T03:41:04.671834+0000","last_unstale":"2024-09-17T03:41:05.668702+0000","last_undegraded":"2024-09-17T03:41:05.668702+0000","last_fullsized":"2024-09-17T03:41:05.668702+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:03.245032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776267+0000","last_change":"2024-09-17T03:41:04.681101+0000","last_active":"2024-09-17T03:41:05.776267+0000","last_peered":"2024-09-17T03:41:05.776267+0000","last_clean":"2024-09-17T03:41:05.776267+0000","last_became_active":"2024-09-17T03:41:04.678923+0000","last_became_peered":"2024-09-17T03:41:04.678923+0000","last_unstale":"2024-09-17T03:41:05.776267+0000","last_undegraded":"2024-09-17T03:41:05.776267+0000","last_fullsized":"2024-09-17T03:41:05.776267+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:04.887694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679087+0000","last_change":"2024-09-17T03:41:04.678898+0000","last_active":"2024-09-17T03:41:05.679087+0000","last_peered":"2024-09-17T03:41:05.679087+0000","last_clean":"2024-09-17T03:41:05.679087+0000","last_became_active":"2024-09-17T03:41:04.678497+0000","last_became_peered":"2024-09-17T03:41:04.678497+0000","last_unstale":"2024-09-17T03:41:05.679087+0000","last_undegraded":"2024-09-17T03:41:05.679087+0000","last_fullsized":"2024-09-17T03:41:05.679087+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:43.279673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668571+0000","last_change":"2024-09-17T03:41:04.673356+0000","last_active":"2024-09-17T03:41:05.668571+0000","last_peered":"2024-09-17T03:41:05.668571+0000","last_clean":"2024-09-17T03:41:05.668571+0000","last_became_active":"2024-09-17T03:41:04.673065+0000","last_became_peered":"2024-09-17T03:41:04.673065+0000","last_unstale":"2024-09-17T03:41:05.668571+0000","last_undegraded":"2024-09-17T03:41:05.668571+0000","last_fullsized":"2024-09-17T03:41:05.668571+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:12.855509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670017+0000","last_change":"2024-09-17T03:41:04.675423+0000","last_active":"2024-09-17T03:41:05.670017+0000","last_peered":"2024-09-17T03:41:05.670017+0000","last_clean":"2024-09-17T03:41:05.670017+0000","last_became_active":"2024-09-17T03:41:04.674791+0000","last_became_peered":"2024-09-17T03:41:04.674791+0000","last_unstale":"2024-09-17T03:41:05.670017+0000","last_undegraded":"2024-09-17T03:41:05.670017+0000","last_fullsized":"2024-09-17T03:41:05.670017+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:57.579594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668486+0000","last_change":"2024-09-17T03:41:04.666902+0000","last_active":"2024-09-17T03:41:05.668486+0000","last_peered":"2024-09-17T03:41:05.668486+0000","last_clean":"2024-09-17T03:41:05.668486+0000","last_became_active":"2024-09-17T03:41:04.666600+0000","last_became_peered":"2024-09-17T03:41:04.666600+0000","last_unstale":"2024-09-17T03:41:05.668486+0000","last_undegraded":"2024-09-17T03:41:05.668486+0000","last_fullsized":"2024-09-17T03:41:05.668486+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:40.244825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992456+0000","last_change":"2024-09-17T03:41:04.680361+0000","last_active":"2024-09-17T03:41:05.992456+0000","last_peered":"2024-09-17T03:41:05.992456+0000","last_clean":"2024-09-17T03:41:05.992456+0000","last_became_active":"2024-09-17T03:41:04.680058+0000","last_became_peered":"2024-09-17T03:41:04.680058+0000","last_unstale":"2024-09-17T03:41:05.992456+0000","last_undegraded":"2024-09-17T03:41:05.992456+0000","last_fullsized":"2024-09-17T03:41:05.992456+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:20.604144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776200+0000","last_change":"2024-09-17T03:41:04.674681+0000","last_active":"2024-09-17T03:41:05.776200+0000","last_peered":"2024-09-17T03:41:05.776200+0000","last_clean":"2024-09-17T03:41:05.776200+0000","last_became_active":"2024-09-17T03:41:04.674347+0000","last_became_peered":"2024-09-17T03:41:04.674347+0000","last_unstale":"2024-09-17T03:41:05.776200+0000","last_undegraded":"2024-09-17T03:41:05.776200+0000","last_fullsized":"2024-09-17T03:41:05.776200+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:54.420791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992935+0000","last_change":"2024-09-17T03:41:04.681902+0000","last_active":"2024-09-17T03:41:05.992935+0000","last_peered":"2024-09-17T03:41:05.992935+0000","last_clean":"2024-09-17T03:41:05.992935+0000","last_became_active":"2024-09-17T03:41:04.681609+0000","last_became_peered":"2024-09-17T03:41:04.681609+0000","last_unstale":"2024-09-17T03:41:05.992935+0000","last_undegraded":"2024-09-17T03:41:05.992935+0000","last_fullsized":"2024-09-17T03:41:05.992935+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:11.925081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992621+0000","last_change":"2024-09-17T03:41:04.680689+0000","last_active":"2024-09-17T03:41:05.992621+0000","last_peered":"2024-09-17T03:41:05.992621+0000","last_clean":"2024-09-17T03:41:05.992621+0000","last_became_active":"2024-09-17T03:41:04.680384+0000","last_became_peered":"2024-09-17T03:41:04.680384+0000","last_unstale":"2024-09-17T03:41:05.992621+0000","last_undegraded":"2024-09-17T03:41:05.992621+0000","last_fullsized":"2024-09-17T03:41:05.992621+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:16.107400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993188+0000","last_change":"2024-09-17T03:41:04.683048+0000","last_active":"2024-09-17T03:41:05.993188+0000","last_peered":"2024-09-17T03:41:05.993188+0000","last_clean":"2024-09-17T03:41:05.993188+0000","last_became_active":"2024-09-17T03:41:04.682477+0000","last_became_peered":"2024-09-17T03:41:04.682477+0000","last_unstale":"2024-09-17T03:41:05.993188+0000","last_undegraded":"2024-09-17T03:41:05.993188+0000","last_fullsized":"2024-09-17T03:41:05.993188+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:44.301787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992457+0000","last_change":"2024-09-17T03:41:04.678463+0000","last_active":"2024-09-17T03:41:05.992457+0000","last_peered":"2024-09-17T03:41:05.992457+0000","last_clean":"2024-09-17T03:41:05.992457+0000","last_became_active":"2024-09-17T03:41:04.677339+0000","last_became_peered":"2024-09-17T03:41:04.677339+0000","last_unstale":"2024-09-17T03:41:05.992457+0000","last_undegraded":"2024-09-17T03:41:05.992457+0000","last_fullsized":"2024-09-17T03:41:05.992457+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:18.810735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678760+0000","last_change":"2024-09-17T03:41:04.686768+0000","last_active":"2024-09-17T03:41:05.678760+0000","last_peered":"2024-09-17T03:41:05.678760+0000","last_clean":"2024-09-17T03:41:05.678760+0000","last_became_active":"2024-09-17T03:41:04.686436+0000","last_became_peered":"2024-09-17T03:41:04.686436+0000","last_unstale":"2024-09-17T03:41:05.678760+0000","last_undegraded":"2024-09-17T03:41:05.678760+0000","last_fullsized":"2024-09-17T03:41:05.678760+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:01.708962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669551+0000","last_change":"2024-09-17T03:41:04.674939+0000","last_active":"2024-09-17T03:41:05.669551+0000","last_peered":"2024-09-17T03:41:05.669551+0000","last_clean":"2024-09-17T03:41:05.669551+0000","last_became_active":"2024-09-17T03:41:04.674633+0000","last_became_peered":"2024-09-17T03:41:04.674633+0000","last_unstale":"2024-09-17T03:41:05.669551+0000","last_undegraded":"2024-09-17T03:41:05.669551+0000","last_fullsized":"2024-09-17T03:41:05.669551+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:26.893496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776437+0000","last_change":"2024-09-17T03:41:04.676577+0000","last_active":"2024-09-17T03:41:05.776437+0000","last_peered":"2024-09-17T03:41:05.776437+0000","last_clean":"2024-09-17T03:41:05.776437+0000","last_became_active":"2024-09-17T03:41:04.676246+0000","last_became_peered":"2024-09-17T03:41:04.676246+0000","last_unstale":"2024-09-17T03:41:05.776437+0000","last_undegraded":"2024-09-17T03:41:05.776437+0000","last_fullsized":"2024-09-17T03:41:05.776437+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:18.595167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"129'4","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679091+0000","last_change":"2024-09-17T03:41:03.676165+0000","last_active":"2024-09-17T03:41:05.679091+0000","last_peered":"2024-09-17T03:41:05.679091+0000","last_clean":"2024-09-17T03:41:05.679091+0000","last_became_active":"2024-09-17T03:41:03.675800+0000","last_became_peered":"2024-09-17T03:41:03.675800+0000","last_unstale":"2024-09-17T03:41:05.679091+0000","last_undegraded":"2024-09-17T03:41:05.679091+0000","last_fullsized":"2024-09-17T03:41:05.679091+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:08.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.671221+0000","last_change":"2024-09-17T03:41:04.675703+0000","last_active":"2024-09-17T03:41:05.671221+0000","last_peered":"2024-09-17T03:41:05.671221+0000","last_clean":"2024-09-17T03:41:05.671221+0000","last_became_active":"2024-09-17T03:41:04.675223+0000","last_became_peered":"2024-09-17T03:41:04.675223+0000","last_unstale":"2024-09-17T03:41:05.671221+0000","last_undegraded":"2024-09-17T03:41:05.671221+0000","last_fullsized":"2024-09-17T03:41:05.671221+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:52.127906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992676+0000","last_change":"2024-09-17T03:41:03.674308+0000","last_active":"2024-09-17T03:41:05.992676+0000","last_peered":"2024-09-17T03:41:05.992676+0000","last_clean":"2024-09-17T03:41:05.992676+0000","last_became_active":"2024-09-17T03:41:03.673437+0000","last_became_peered":"2024-09-17T03:41:03.673437+0000","last_unstale":"2024-09-17T03:41:05.992676+0000","last_undegraded":"2024-09-17T03:41:05.992676+0000","last_fullsized":"2024-09-17T03:41:05.992676+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:26.761000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679117+0000","last_change":"2024-09-17T03:41:04.682660+0000","last_active":"2024-09-17T03:41:05.679117+0000","last_peered":"2024-09-17T03:41:05.679117+0000","last_clean":"2024-09-17T03:41:05.679117+0000","last_became_active":"2024-09-17T03:41:04.681977+0000","last_became_peered":"2024-09-17T03:41:04.681977+0000","last_unstale":"2024-09-17T03:41:05.679117+0000","last_undegraded":"2024-09-17T03:41:05.679117+0000","last_fullsized":"2024-09-17T03:41:05.679117+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:00.017736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668867+0000","last_change":"2024-09-17T03:41:03.673481+0000","last_active":"2024-09-17T03:41:05.668867+0000","last_peered":"2024-09-17T03:41:05.668867+0000","last_clean":"2024-09-17T03:41:05.668867+0000","last_became_active":"2024-09-17T03:41:03.673184+0000","last_became_peered":"2024-09-17T03:41:03.673184+0000","last_unstale":"2024-09-17T03:41:05.668867+0000","last_undegraded":"2024-09-17T03:41:05.668867+0000","last_fullsized":"2024-09-17T03:41:05.668867+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:20.289969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679069+0000","last_change":"2024-09-17T03:41:04.681372+0000","last_active":"2024-09-17T03:41:05.679069+0000","last_peered":"2024-09-17T03:41:05.679069+0000","last_clean":"2024-09-17T03:41:05.679069+0000","last_became_active":"2024-09-17T03:41:04.681023+0000","last_became_peered":"2024-09-17T03:41:04.681023+0000","last_unstale":"2024-09-17T03:41:05.679069+0000","last_undegraded":"2024-09-17T03:41:05.679069+0000","last_fullsized":"2024-09-17T03:41:05.679069+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:13:14.823600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992880+0000","last_change":"2024-09-17T03:41:03.670618+0000","last_active":"2024-09-17T03:41:05.992880+0000","last_peered":"2024-09-17T03:41:05.992880+0000","last_clean":"2024-09-17T03:41:05.992880+0000","last_became_active":"2024-09-17T03:41:03.670320+0000","last_became_peered":"2024-09-17T03:41:03.670320+0000","last_unstale":"2024-09-17T03:41:05.992880+0000","last_undegraded":"2024-09-17T03:41:05.992880+0000","last_fullsized":"2024-09-17T03:41:05.992880+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:13.736628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775936+0000","last_change":"2024-09-17T03:41:04.681945+0000","last_active":"2024-09-17T03:41:05.775936+0000","last_peered":"2024-09-17T03:41:05.775936+0000","last_clean":"2024-09-17T03:41:05.775936+0000","last_became_active":"2024-09-17T03:41:04.680316+0000","last_became_peered":"2024-09-17T03:41:04.680316+0000","last_unstale":"2024-09-17T03:41:05.775936+0000","last_undegraded":"2024-09-17T03:41:05.775936+0000","last_fullsized":"2024-09-17T03:41:05.775936+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:13.616492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992071+0000","last_change":"2024-09-17T03:41:03.675301+0000","last_active":"2024-09-17T03:41:05.992071+0000","last_peered":"2024-09-17T03:41:05.992071+0000","last_clean":"2024-09-17T03:41:05.992071+0000","last_became_active":"2024-09-17T03:41:03.675002+0000","last_became_peered":"2024-09-17T03:41:03.675002+0000","last_unstale":"2024-09-17T03:41:05.992071+0000","last_undegraded":"2024-09-17T03:41:05.992071+0000","last_fullsized":"2024-09-17T03:41:05.992071+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:58.380265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670682+0000","last_change":"2024-09-17T03:41:04.671407+0000","last_active":"2024-09-17T03:41:05.670682+0000","last_peered":"2024-09-17T03:41:05.670682+0000","last_clean":"2024-09-17T03:41:05.670682+0000","last_became_active":"2024-09-17T03:41:04.671116+0000","last_became_peered":"2024-09-17T03:41:04.671116+0000","last_unstale":"2024-09-17T03:41:05.670682+0000","last_undegraded":"2024-09-17T03:41:05.670682+0000","last_fullsized":"2024-09-17T03:41:05.670682+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:45.577154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775855+0000","last_change":"2024-09-17T03:41:03.676747+0000","last_active":"2024-09-17T03:41:05.775855+0000","last_peered":"2024-09-17T03:41:05.775855+0000","last_clean":"2024-09-17T03:41:05.775855+0000","last_became_active":"2024-09-17T03:41:03.676034+0000","last_became_peered":"2024-09-17T03:41:03.676034+0000","last_unstale":"2024-09-17T03:41:05.775855+0000","last_undegraded":"2024-09-17T03:41:05.775855+0000","last_fullsized":"2024-09-17T03:41:05.775855+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:54.137997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669801+0000","last_change":"2024-09-17T03:41:04.675580+0000","last_active":"2024-09-17T03:41:05.669801+0000","last_peered":"2024-09-17T03:41:05.669801+0000","last_clean":"2024-09-17T03:41:05.669801+0000","last_became_active":"2024-09-17T03:41:04.675124+0000","last_became_peered":"2024-09-17T03:41:04.675124+0000","last_unstale":"2024-09-17T03:41:05.669801+0000","last_undegraded":"2024-09-17T03:41:05.669801+0000","last_fullsized":"2024-09-17T03:41:05.669801+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:44.698823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669927+0000","last_change":"2024-09-17T03:41:03.672674+0000","last_active":"2024-09-17T03:41:05.669927+0000","last_peered":"2024-09-17T03:41:05.669927+0000","last_clean":"2024-09-17T03:41:05.669927+0000","last_became_active":"2024-09-17T03:41:03.672235+0000","last_became_peered":"2024-09-17T03:41:03.672235+0000","last_unstale":"2024-09-17T03:41:05.669927+0000","last_undegraded":"2024-09-17T03:41:05.669927+0000","last_fullsized":"2024-09-17T03:41:05.669927+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:52.033242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992013+0000","last_change":"2024-09-17T03:41:04.673894+0000","last_active":"2024-09-17T03:41:05.992013+0000","last_peered":"2024-09-17T03:41:05.992013+0000","last_clean":"2024-09-17T03:41:05.992013+0000","last_became_active":"2024-09-17T03:41:04.673600+0000","last_became_peered":"2024-09-17T03:41:04.673600+0000","last_unstale":"2024-09-17T03:41:05.992013+0000","last_undegraded":"2024-09-17T03:41:05.992013+0000","last_fullsized":"2024-09-17T03:41:05.992013+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:45.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992626+0000","last_change":"2024-09-17T03:41:03.666881+0000","last_active":"2024-09-17T03:41:05.992626+0000","last_peered":"2024-09-17T03:41:05.992626+0000","last_clean":"2024-09-17T03:41:05.992626+0000","last_became_active":"2024-09-17T03:41:03.666536+0000","last_became_peered":"2024-09-17T03:41:03.666536+0000","last_unstale":"2024-09-17T03:41:05.992626+0000","last_undegraded":"2024-09-17T03:41:05.992626+0000","last_fullsized":"2024-09-17T03:41:05.992626+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:43.296263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992710+0000","last_change":"2024-09-17T03:41:04.673282+0000","last_active":"2024-09-17T03:41:05.992710+0000","last_peered":"2024-09-17T03:41:05.992710+0000","last_clean":"2024-09-17T03:41:05.992710+0000","last_became_active":"2024-09-17T03:41:04.673006+0000","last_became_peered":"2024-09-17T03:41:04.673006+0000","last_unstale":"2024-09-17T03:41:05.992710+0000","last_undegraded":"2024-09-17T03:41:05.992710+0000","last_fullsized":"2024-09-17T03:41:05.992710+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:23.394637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992979+0000","last_change":"2024-09-17T03:41:03.675807+0000","last_active":"2024-09-17T03:41:05.992979+0000","last_peered":"2024-09-17T03:41:05.992979+0000","last_clean":"2024-09-17T03:41:05.992979+0000","last_became_active":"2024-09-17T03:41:03.675416+0000","last_became_peered":"2024-09-17T03:41:03.675416+0000","last_unstale":"2024-09-17T03:41:05.992979+0000","last_undegraded":"2024-09-17T03:41:05.992979+0000","last_fullsized":"2024-09-17T03:41:05.992979+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:38.733293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992833+0000","last_change":"2024-09-17T03:41:04.677308+0000","last_active":"2024-09-17T03:41:05.992833+0000","last_peered":"2024-09-17T03:41:05.992833+0000","last_clean":"2024-09-17T03:41:05.992833+0000","last_became_active":"2024-09-17T03:41:04.677003+0000","last_became_peered":"2024-09-17T03:41:04.677003+0000","last_unstale":"2024-09-17T03:41:05.992833+0000","last_undegraded":"2024-09-17T03:41:05.992833+0000","last_fullsized":"2024-09-17T03:41:05.992833+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:55.994505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776317+0000","last_change":"2024-09-17T03:41:03.671819+0000","last_active":"2024-09-17T03:41:05.776317+0000","last_peered":"2024-09-17T03:41:05.776317+0000","last_clean":"2024-09-17T03:41:05.776317+0000","last_became_active":"2024-09-17T03:41:03.671499+0000","last_became_peered":"2024-09-17T03:41:03.671499+0000","last_unstale":"2024-09-17T03:41:05.776317+0000","last_undegraded":"2024-09-17T03:41:05.776317+0000","last_fullsized":"2024-09-17T03:41:05.776317+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:31.784168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679268+0000","last_change":"2024-09-17T03:41:04.687167+0000","last_active":"2024-09-17T03:41:05.679268+0000","last_peered":"2024-09-17T03:41:05.679268+0000","last_clean":"2024-09-17T03:41:05.679268+0000","last_became_active":"2024-09-17T03:41:04.686468+0000","last_became_peered":"2024-09-17T03:41:04.686468+0000","last_unstale":"2024-09-17T03:41:05.679268+0000","last_undegraded":"2024-09-17T03:41:05.679268+0000","last_fullsized":"2024-09-17T03:41:05.679268+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:07.904857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"129'3","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992455+0000","last_change":"2024-09-17T03:41:03.673293+0000","last_active":"2024-09-17T03:41:05.992455+0000","last_peered":"2024-09-17T03:41:05.992455+0000","last_clean":"2024-09-17T03:41:05.992455+0000","last_became_active":"2024-09-17T03:41:03.672799+0000","last_became_peered":"2024-09-17T03:41:03.672799+0000","last_unstale":"2024-09-17T03:41:05.992455+0000","last_undegraded":"2024-09-17T03:41:05.992455+0000","last_fullsized":"2024-09-17T03:41:05.992455+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:27.089366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679394+0000","last_change":"2024-09-17T03:41:04.685114+0000","last_active":"2024-09-17T03:41:05.679394+0000","last_peered":"2024-09-17T03:41:05.679394+0000","last_clean":"2024-09-17T03:41:05.679394+0000","last_became_active":"2024-09-17T03:41:04.682645+0000","last_became_peered":"2024-09-17T03:41:04.682645+0000","last_unstale":"2024-09-17T03:41:05.679394+0000","last_undegraded":"2024-09-17T03:41:05.679394+0000","last_fullsized":"2024-09-17T03:41:05.679394+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:28.946466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"129'6","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.671453+0000","last_change":"2024-09-17T03:41:03.673721+0000","last_active":"2024-09-17T03:41:05.671453+0000","last_peered":"2024-09-17T03:41:05.671453+0000","last_clean":"2024-09-17T03:41:05.671453+0000","last_became_active":"2024-09-17T03:41:03.673378+0000","last_became_peered":"2024-09-17T03:41:03.673378+0000","last_unstale":"2024-09-17T03:41:05.671453+0000","last_undegraded":"2024-09-17T03:41:05.671453+0000","last_fullsized":"2024-09-17T03:41:05.671453+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:00.271744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993378+0000","last_change":"2024-09-17T03:41:04.682669+0000","last_active":"2024-09-17T03:41:05.993378+0000","last_peered":"2024-09-17T03:41:05.993378+0000","last_clean":"2024-09-17T03:41:05.993378+0000","last_became_active":"2024-09-17T03:41:04.681735+0000","last_became_peered":"2024-09-17T03:41:04.681735+0000","last_unstale":"2024-09-17T03:41:05.993378+0000","last_undegraded":"2024-09-17T03:41:05.993378+0000","last_fullsized":"2024-09-17T03:41:05.993378+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:32.554460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992818+0000","last_change":"2024-09-17T03:41:03.672669+0000","last_active":"2024-09-17T03:41:05.992818+0000","last_peered":"2024-09-17T03:41:05.992818+0000","last_clean":"2024-09-17T03:41:05.992818+0000","last_became_active":"2024-09-17T03:41:03.672086+0000","last_became_peered":"2024-09-17T03:41:03.672086+0000","last_unstale":"2024-09-17T03:41:05.992818+0000","last_undegraded":"2024-09-17T03:41:05.992818+0000","last_fullsized":"2024-09-17T03:41:05.992818+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:22.052287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992701+0000","last_change":"2024-09-17T03:41:04.669109+0000","last_active":"2024-09-17T03:41:05.992701+0000","last_peered":"2024-09-17T03:41:05.992701+0000","last_clean":"2024-09-17T03:41:05.992701+0000","last_became_active":"2024-09-17T03:41:04.668623+0000","last_became_peered":"2024-09-17T03:41:04.668623+0000","last_unstale":"2024-09-17T03:41:05.992701+0000","last_undegraded":"2024-09-17T03:41:05.992701+0000","last_fullsized":"2024-09-17T03:41:05.992701+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:20.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992407+0000","last_change":"2024-09-17T03:41:03.674227+0000","last_active":"2024-09-17T03:41:05.992407+0000","last_peered":"2024-09-17T03:41:05.992407+0000","last_clean":"2024-09-17T03:41:05.992407+0000","last_became_active":"2024-09-17T03:41:03.673934+0000","last_became_peered":"2024-09-17T03:41:03.673934+0000","last_unstale":"2024-09-17T03:41:05.992407+0000","last_undegraded":"2024-09-17T03:41:05.992407+0000","last_fullsized":"2024-09-17T03:41:05.992407+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:05.213422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669939+0000","last_change":"2024-09-17T03:41:04.670930+0000","last_active":"2024-09-17T03:41:05.669939+0000","last_peered":"2024-09-17T03:41:05.669939+0000","last_clean":"2024-09-17T03:41:05.669939+0000","last_became_active":"2024-09-17T03:41:04.670596+0000","last_became_peered":"2024-09-17T03:41:04.670596+0000","last_unstale":"2024-09-17T03:41:05.669939+0000","last_undegraded":"2024-09-17T03:41:05.669939+0000","last_fullsized":"2024-09-17T03:41:05.669939+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:35.978408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"129'8","reported_seq":23,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669989+0000","last_change":"2024-09-17T03:41:03.671146+0000","last_active":"2024-09-17T03:41:05.669989+0000","last_peered":"2024-09-17T03:41:05.669989+0000","last_clean":"2024-09-17T03:41:05.669989+0000","last_became_active":"2024-09-17T03:41:03.670717+0000","last_became_peered":"2024-09-17T03:41:03.670717+0000","last_unstale":"2024-09-17T03:41:05.669989+0000","last_undegraded":"2024-09-17T03:41:05.669989+0000","last_fullsized":"2024-09-17T03:41:05.669989+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:44.383978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670792+0000","last_change":"2024-09-17T03:41:04.684949+0000","last_active":"2024-09-17T03:41:05.670792+0000","last_peered":"2024-09-17T03:41:05.670792+0000","last_clean":"2024-09-17T03:41:05.670792+0000","last_became_active":"2024-09-17T03:41:04.683009+0000","last_became_peered":"2024-09-17T03:41:04.683009+0000","last_unstale":"2024-09-17T03:41:05.670792+0000","last_undegraded":"2024-09-17T03:41:05.670792+0000","last_fullsized":"2024-09-17T03:41:05.670792+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:26.893496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993043+0000","last_change":"2024-09-17T03:41:03.673614+0000","last_active":"2024-09-17T03:41:05.993043+0000","last_peered":"2024-09-17T03:41:05.993043+0000","last_clean":"2024-09-17T03:41:05.993043+0000","last_became_active":"2024-09-17T03:41:03.672276+0000","last_became_peered":"2024-09-17T03:41:03.672276+0000","last_unstale":"2024-09-17T03:41:05.993043+0000","last_undegraded":"2024-09-17T03:41:05.993043+0000","last_fullsized":"2024-09-17T03:41:05.993043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:58.982726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992933+0000","last_change":"2024-09-17T03:41:04.671325+0000","last_active":"2024-09-17T03:41:05.992933+0000","last_peered":"2024-09-17T03:41:05.992933+0000","last_clean":"2024-09-17T03:41:05.992933+0000","last_became_active":"2024-09-17T03:41:04.670508+0000","last_became_peered":"2024-09-17T03:41:04.670508+0000","last_unstale":"2024-09-17T03:41:05.992933+0000","last_undegraded":"2024-09-17T03:41:05.992933+0000","last_fullsized":"2024-09-17T03:41:05.992933+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:54.939814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668928+0000","last_change":"2024-09-17T03:41:03.670284+0000","last_active":"2024-09-17T03:41:05.668928+0000","last_peered":"2024-09-17T03:41:05.668928+0000","last_clean":"2024-09-17T03:41:05.668928+0000","last_became_active":"2024-09-17T03:41:03.668681+0000","last_became_peered":"2024-09-17T03:41:03.668681+0000","last_unstale":"2024-09-17T03:41:05.668928+0000","last_undegraded":"2024-09-17T03:41:05.668928+0000","last_fullsized":"2024-09-17T03:41:05.668928+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:17.557215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776233+0000","last_change":"2024-09-17T03:41:04.679337+0000","last_active":"2024-09-17T03:41:05.776233+0000","last_peered":"2024-09-17T03:41:05.776233+0000","last_clean":"2024-09-17T03:41:05.776233+0000","last_became_active":"2024-09-17T03:41:04.677967+0000","last_became_peered":"2024-09-17T03:41:04.677967+0000","last_unstale":"2024-09-17T03:41:05.776233+0000","last_undegraded":"2024-09-17T03:41:05.776233+0000","last_fullsized":"2024-09-17T03:41:05.776233+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:05.761345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670866+0000","last_change":"2024-09-17T03:41:03.672925+0000","last_active":"2024-09-17T03:41:05.670866+0000","last_peered":"2024-09-17T03:41:05.670866+0000","last_clean":"2024-09-17T03:41:05.670866+0000","last_became_active":"2024-09-17T03:41:03.672614+0000","last_became_peered":"2024-09-17T03:41:03.672614+0000","last_unstale":"2024-09-17T03:41:05.670866+0000","last_undegraded":"2024-09-17T03:41:05.670866+0000","last_fullsized":"2024-09-17T03:41:05.670866+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:19.186487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992349+0000","last_change":"2024-09-17T03:41:04.674664+0000","last_active":"2024-09-17T03:41:05.992349+0000","last_peered":"2024-09-17T03:41:05.992349+0000","last_clean":"2024-09-17T03:41:05.992349+0000","last_became_active":"2024-09-17T03:41:04.674370+0000","last_became_peered":"2024-09-17T03:41:04.674370+0000","last_unstale":"2024-09-17T03:41:05.992349+0000","last_undegraded":"2024-09-17T03:41:05.992349+0000","last_fullsized":"2024-09-17T03:41:05.992349+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:47.854552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992493+0000","last_change":"2024-09-17T03:41:03.669334+0000","last_active":"2024-09-17T03:41:05.992493+0000","last_peered":"2024-09-17T03:41:05.992493+0000","last_clean":"2024-09-17T03:41:05.992493+0000","last_became_active":"2024-09-17T03:41:03.669018+0000","last_became_peered":"2024-09-17T03:41:03.669018+0000","last_unstale":"2024-09-17T03:41:05.992493+0000","last_undegraded":"2024-09-17T03:41:05.992493+0000","last_fullsized":"2024-09-17T03:41:05.992493+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:10.640755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992670+0000","last_change":"2024-09-17T03:41:04.672340+0000","last_active":"2024-09-17T03:41:05.992670+0000","last_peered":"2024-09-17T03:41:05.992670+0000","last_clean":"2024-09-17T03:41:05.992670+0000","last_became_active":"2024-09-17T03:41:04.671945+0000","last_became_peered":"2024-09-17T03:41:04.671945+0000","last_unstale":"2024-09-17T03:41:05.992670+0000","last_undegraded":"2024-09-17T03:41:05.992670+0000","last_fullsized":"2024-09-17T03:41:05.992670+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:56.992165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992516+0000","last_change":"2024-09-17T03:41:03.676603+0000","last_active":"2024-09-17T03:41:05.992516+0000","last_peered":"2024-09-17T03:41:05.992516+0000","last_clean":"2024-09-17T03:41:05.992516+0000","last_became_active":"2024-09-17T03:41:03.676265+0000","last_became_peered":"2024-09-17T03:41:03.676265+0000","last_unstale":"2024-09-17T03:41:05.992516+0000","last_undegraded":"2024-09-17T03:41:05.992516+0000","last_fullsized":"2024-09-17T03:41:05.992516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:49.453780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670960+0000","last_change":"2024-09-17T03:41:04.670121+0000","last_active":"2024-09-17T03:41:05.670960+0000","last_peered":"2024-09-17T03:41:05.670960+0000","last_clean":"2024-09-17T03:41:05.670960+0000","last_became_active":"2024-09-17T03:41:04.666510+0000","last_became_peered":"2024-09-17T03:41:04.666510+0000","last_unstale":"2024-09-17T03:41:05.670960+0000","last_undegraded":"2024-09-17T03:41:05.670960+0000","last_fullsized":"2024-09-17T03:41:05.670960+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:35.493783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776059+0000","last_change":"2024-09-17T03:41:03.675991+0000","last_active":"2024-09-17T03:41:05.776059+0000","last_peered":"2024-09-17T03:41:05.776059+0000","last_clean":"2024-09-17T03:41:05.776059+0000","last_became_active":"2024-09-17T03:41:03.671518+0000","last_became_peered":"2024-09-17T03:41:03.671518+0000","last_unstale":"2024-09-17T03:41:05.776059+0000","last_undegraded":"2024-09-17T03:41:05.776059+0000","last_fullsized":"2024-09-17T03:41:05.776059+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:48.342701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.991980+0000","last_change":"2024-09-17T03:41:04.668568+0000","last_active":"2024-09-17T03:41:05.991980+0000","last_peered":"2024-09-17T03:41:05.991980+0000","last_clean":"2024-09-17T03:41:05.991980+0000","last_became_active":"2024-09-17T03:41:04.668163+0000","last_became_peered":"2024-09-17T03:41:04.668163+0000","last_unstale":"2024-09-17T03:41:05.991980+0000","last_undegraded":"2024-09-17T03:41:05.991980+0000","last_fullsized":"2024-09-17T03:41:05.991980+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:56.886979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775781+0000","last_change":"2024-09-17T03:41:03.668667+0000","last_active":"2024-09-17T03:41:05.775781+0000","last_peered":"2024-09-17T03:41:05.775781+0000","last_clean":"2024-09-17T03:41:05.775781+0000","last_became_active":"2024-09-17T03:41:03.668333+0000","last_became_peered":"2024-09-17T03:41:03.668333+0000","last_unstale":"2024-09-17T03:41:05.775781+0000","last_undegraded":"2024-09-17T03:41:05.775781+0000","last_fullsized":"2024-09-17T03:41:05.775781+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:10.629109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678688+0000","last_change":"2024-09-17T03:41:04.687350+0000","last_active":"2024-09-17T03:41:05.678688+0000","last_peered":"2024-09-17T03:41:05.678688+0000","last_clean":"2024-09-17T03:41:05.678688+0000","last_became_active":"2024-09-17T03:41:04.686528+0000","last_became_peered":"2024-09-17T03:41:04.686528+0000","last_unstale":"2024-09-17T03:41:05.678688+0000","last_undegraded":"2024-09-17T03:41:05.678688+0000","last_fullsized":"2024-09-17T03:41:05.678688+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:51.871963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668394+0000","last_change":"2024-09-17T03:41:03.669613+0000","last_active":"2024-09-17T03:41:05.668394+0000","last_peered":"2024-09-17T03:41:05.668394+0000","last_clean":"2024-09-17T03:41:05.668394+0000","last_became_active":"2024-09-17T03:41:03.669217+0000","last_became_peered":"2024-09-17T03:41:03.669217+0000","last_unstale":"2024-09-17T03:41:05.668394+0000","last_undegraded":"2024-09-17T03:41:05.668394+0000","last_fullsized":"2024-09-17T03:41:05.668394+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:07.751104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.671742+0000","last_change":"2024-09-17T03:41:04.673388+0000","last_active":"2024-09-17T03:41:05.671742+0000","last_peered":"2024-09-17T03:41:05.671742+0000","last_clean":"2024-09-17T03:41:05.671742+0000","last_became_active":"2024-09-17T03:41:04.673087+0000","last_became_peered":"2024-09-17T03:41:04.673087+0000","last_unstale":"2024-09-17T03:41:05.671742+0000","last_undegraded":"2024-09-17T03:41:05.671742+0000","last_fullsized":"2024-09-17T03:41:05.671742+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:12.387236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993347+0000","last_change":"2024-09-17T03:41:03.675319+0000","last_active":"2024-09-17T03:41:05.993347+0000","last_peered":"2024-09-17T03:41:05.993347+0000","last_clean":"2024-09-17T03:41:05.993347+0000","last_became_active":"2024-09-17T03:41:03.673645+0000","last_became_peered":"2024-09-17T03:41:03.673645+0000","last_unstale":"2024-09-17T03:41:05.993347+0000","last_undegraded":"2024-09-17T03:41:05.993347+0000","last_fullsized":"2024-09-17T03:41:05.993347+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:45.858150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993171+0000","last_change":"2024-09-17T03:41:04.680675+0000","last_active":"2024-09-17T03:41:05.993171+0000","last_peered":"2024-09-17T03:41:05.993171+0000","last_clean":"2024-09-17T03:41:05.993171+0000","last_became_active":"2024-09-17T03:41:04.678376+0000","last_became_peered":"2024-09-17T03:41:04.678376+0000","last_unstale":"2024-09-17T03:41:05.993171+0000","last_undegraded":"2024-09-17T03:41:05.993171+0000","last_fullsized":"2024-09-17T03:41:05.993171+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:10.858760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"130'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678963+0000","last_change":"2024-09-17T03:41:03.675332+0000","last_active":"2024-09-17T03:41:05.678963+0000","last_peered":"2024-09-17T03:41:05.678963+0000","last_clean":"2024-09-17T03:41:05.678963+0000","last_became_active":"2024-09-17T03:41:03.674332+0000","last_became_peered":"2024-09-17T03:41:03.674332+0000","last_unstale":"2024-09-17T03:41:05.678963+0000","last_undegraded":"2024-09-17T03:41:05.678963+0000","last_fullsized":"2024-09-17T03:41:05.678963+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:33.496868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992909+0000","last_change":"2024-09-17T03:41:04.679786+0000","last_active":"2024-09-17T03:41:05.992909+0000","last_peered":"2024-09-17T03:41:05.992909+0000","last_clean":"2024-09-17T03:41:05.992909+0000","last_became_active":"2024-09-17T03:41:04.679448+0000","last_became_peered":"2024-09-17T03:41:04.679448+0000","last_unstale":"2024-09-17T03:41:05.992909+0000","last_undegraded":"2024-09-17T03:41:05.992909+0000","last_fullsized":"2024-09-17T03:41:05.992909+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:53.038766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992326+0000","last_change":"2024-09-17T03:41:03.666881+0000","last_active":"2024-09-17T03:41:05.992326+0000","last_peered":"2024-09-17T03:41:05.992326+0000","last_clean":"2024-09-17T03:41:05.992326+0000","last_became_active":"2024-09-17T03:41:03.666310+0000","last_became_peered":"2024-09-17T03:41:03.666310+0000","last_unstale":"2024-09-17T03:41:05.992326+0000","last_undegraded":"2024-09-17T03:41:05.992326+0000","last_fullsized":"2024-09-17T03:41:05.992326+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:01.508264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670668+0000","last_change":"2024-09-17T03:41:04.673742+0000","last_active":"2024-09-17T03:41:05.670668+0000","last_peered":"2024-09-17T03:41:05.670668+0000","last_clean":"2024-09-17T03:41:05.670668+0000","last_became_active":"2024-09-17T03:41:04.671298+0000","last_became_peered":"2024-09-17T03:41:04.671298+0000","last_unstale":"2024-09-17T03:41:05.670668+0000","last_undegraded":"2024-09-17T03:41:05.670668+0000","last_fullsized":"2024-09-17T03:41:05.670668+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:52.127906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668827+0000","last_change":"2024-09-17T03:41:03.671833+0000","last_active":"2024-09-17T03:41:05.668827+0000","last_peered":"2024-09-17T03:41:05.668827+0000","last_clean":"2024-09-17T03:41:05.668827+0000","last_became_active":"2024-09-17T03:41:03.671461+0000","last_became_peered":"2024-09-17T03:41:03.671461+0000","last_unstale":"2024-09-17T03:41:05.668827+0000","last_undegraded":"2024-09-17T03:41:05.668827+0000","last_fullsized":"2024-09-17T03:41:05.668827+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:51.176006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678723+0000","last_change":"2024-09-17T03:41:04.680596+0000","last_active":"2024-09-17T03:41:05.678723+0000","last_peered":"2024-09-17T03:41:05.678723+0000","last_clean":"2024-09-17T03:41:05.678723+0000","last_became_active":"2024-09-17T03:41:04.680286+0000","last_became_peered":"2024-09-17T03:41:04.680286+0000","last_unstale":"2024-09-17T03:41:05.678723+0000","last_undegraded":"2024-09-17T03:41:05.678723+0000","last_fullsized":"2024-09-17T03:41:05.678723+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:20.908677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992200+0000","last_change":"2024-09-17T03:41:03.674559+0000","last_active":"2024-09-17T03:41:05.992200+0000","last_peered":"2024-09-17T03:41:05.992200+0000","last_clean":"2024-09-17T03:41:05.992200+0000","last_became_active":"2024-09-17T03:41:03.674262+0000","last_became_peered":"2024-09-17T03:41:03.674262+0000","last_unstale":"2024-09-17T03:41:05.992200+0000","last_undegraded":"2024-09-17T03:41:05.992200+0000","last_fullsized":"2024-09-17T03:41:05.992200+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:37.214658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992647+0000","last_change":"2024-09-17T03:41:04.683290+0000","last_active":"2024-09-17T03:41:05.992647+0000","last_peered":"2024-09-17T03:41:05.992647+0000","last_clean":"2024-09-17T03:41:05.992647+0000","last_became_active":"2024-09-17T03:41:04.682914+0000","last_became_peered":"2024-09-17T03:41:04.682914+0000","last_unstale":"2024-09-17T03:41:05.992647+0000","last_undegraded":"2024-09-17T03:41:05.992647+0000","last_fullsized":"2024-09-17T03:41:05.992647+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:41.050865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678968+0000","last_change":"2024-09-17T03:41:03.678154+0000","last_active":"2024-09-17T03:41:05.678968+0000","last_peered":"2024-09-17T03:41:05.678968+0000","last_clean":"2024-09-17T03:41:05.678968+0000","last_became_active":"2024-09-17T03:41:03.677792+0000","last_became_peered":"2024-09-17T03:41:03.677792+0000","last_unstale":"2024-09-17T03:41:05.678968+0000","last_undegraded":"2024-09-17T03:41:05.678968+0000","last_fullsized":"2024-09-17T03:41:05.678968+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:50.038738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776116+0000","last_change":"2024-09-17T03:41:04.679711+0000","last_active":"2024-09-17T03:41:05.776116+0000","last_peered":"2024-09-17T03:41:05.776116+0000","last_clean":"2024-09-17T03:41:05.776116+0000","last_became_active":"2024-09-17T03:41:04.677950+0000","last_became_peered":"2024-09-17T03:41:04.677950+0000","last_unstale":"2024-09-17T03:41:05.776116+0000","last_undegraded":"2024-09-17T03:41:05.776116+0000","last_fullsized":"2024-09-17T03:41:05.776116+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:28.312827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775980+0000","last_change":"2024-09-17T03:41:03.666191+0000","last_active":"2024-09-17T03:41:05.775980+0000","last_peered":"2024-09-17T03:41:05.775980+0000","last_clean":"2024-09-17T03:41:05.775980+0000","last_became_active":"2024-09-17T03:41:03.665893+0000","last_became_peered":"2024-09-17T03:41:03.665893+0000","last_unstale":"2024-09-17T03:41:05.775980+0000","last_undegraded":"2024-09-17T03:41:05.775980+0000","last_fullsized":"2024-09-17T03:41:05.775980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:18.129464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992294+0000","last_change":"2024-09-17T03:41:04.681335+0000","last_active":"2024-09-17T03:41:05.992294+0000","last_peered":"2024-09-17T03:41:05.992294+0000","last_clean":"2024-09-17T03:41:05.992294+0000","last_became_active":"2024-09-17T03:41:04.681048+0000","last_became_peered":"2024-09-17T03:41:04.681048+0000","last_unstale":"2024-09-17T03:41:05.992294+0000","last_undegraded":"2024-09-17T03:41:05.992294+0000","last_fullsized":"2024-09-17T03:41:05.992294+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:07.353107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668526+0000","last_change":"2024-09-17T03:41:03.668313+0000","last_active":"2024-09-17T03:41:05.668526+0000","last_peered":"2024-09-17T03:41:05.668526+0000","last_clean":"2024-09-17T03:41:05.668526+0000","last_became_active":"2024-09-17T03:41:03.668025+0000","last_became_peered":"2024-09-17T03:41:03.668025+0000","last_unstale":"2024-09-17T03:41:05.668526+0000","last_undegraded":"2024-09-17T03:41:05.668526+0000","last_fullsized":"2024-09-17T03:41:05.668526+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:45.663494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678776+0000","last_change":"2024-09-17T03:41:04.685474+0000","last_active":"2024-09-17T03:41:05.678776+0000","last_peered":"2024-09-17T03:41:05.678776+0000","last_clean":"2024-09-17T03:41:05.678776+0000","last_became_active":"2024-09-17T03:41:04.685139+0000","last_became_peered":"2024-09-17T03:41:04.685139+0000","last_unstale":"2024-09-17T03:41:05.678776+0000","last_undegraded":"2024-09-17T03:41:05.678776+0000","last_fullsized":"2024-09-17T03:41:05.678776+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:42.457611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679326+0000","last_change":"2024-09-17T03:41:03.676588+0000","last_active":"2024-09-17T03:41:05.679326+0000","last_peered":"2024-09-17T03:41:05.679326+0000","last_clean":"2024-09-17T03:41:05.679326+0000","last_became_active":"2024-09-17T03:41:03.676281+0000","last_became_peered":"2024-09-17T03:41:03.676281+0000","last_unstale":"2024-09-17T03:41:05.679326+0000","last_undegraded":"2024-09-17T03:41:05.679326+0000","last_fullsized":"2024-09-17T03:41:05.679326+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:29.592714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":311,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678585+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:41:05.678585+0000","last_peered":"2024-09-17T03:41:05.678585+0000","last_clean":"2024-09-17T03:41:05.678585+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:41:05.678585+0000","last_undegraded":"2024-09-17T03:41:05.678585+0000","last_fullsized":"2024-09-17T03:41:05.678585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47256,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324584,"statfs":{"total":96636764160,"available":96588374016,"internally_reserved":0,"allocated":2232320,"data_stored":1299882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509544,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50824,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321016,"statfs":{"total":96636764160,"available":96584720384,"internally_reserved":0,"allocated":1626112,"data_stored":708876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50816,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":1617920,"data_stored":707334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509544,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46664,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325176,"statfs":{"total":96636764160,"available":96588980224,"internally_reserved":0,"allocated":1622016,"data_stored":707880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509545,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50816,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":1613824,"data_stored":707264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509545,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47232,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324608,"statfs":{"total":96636764160,"available":96588398592,"internally_reserved":0,"allocated":2207744,"data_stored":1297632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46660,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325180,"statfs":{"total":96636764160,"available":96588984320,"internally_reserved":0,"allocated":1622016,"data_stored":707376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50820,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321020,"statfs":{"total":96636764160,"available":96584724480,"internally_reserved":0,"allocated":1622016,"data_stored":707424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:41:13.157 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:41:13.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.285+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1667117473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ac0cd5d0 msgr2=0x7f54ac0cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.285+0000 7f54b2ef9640 1 --2- 172.21.15.146:0/1667117473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ac0cd5d0 0x7f54ac0cd9e0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0d0b20 tx=0x7f54a402a980 comp rx=0 tx=0).stop 2024-09-17T03:41:13.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.285+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1667117473 shutdown_connections 2024-09-17T03:41:13.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.285+0000 7f54b2ef9640 1 --2- 172.21.15.146:0/1667117473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ac0cd5d0 0x7f54ac0cd9e0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.285+0000 7f54b2ef9640 1 --2- 172.21.15.146:0/1667117473 >> v2:172.21.15.179:3300/0 conn(0x7f54ac0b47c0 0x7f54ac0cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.285+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1667117473 >> 172.21.15.146:0/1667117473 conn(0x7f54ac09ba20 msgr2=0x7f54ac0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:13.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.285+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1667117473 shutdown_connections 2024-09-17T03:41:13.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.285+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1667117473 wait complete. 2024-09-17T03:41:13.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.287+0000 7f54b2ef9640 1 Processor -- start 2024-09-17T03:41:13.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.287+0000 7f54b2ef9640 1 -- start start 2024-09-17T03:41:13.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54b2ef9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54ac0b47c0 0x7f54ac1f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54b2ef9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ac0cd5d0 0x7f54ac1dd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54b2ef9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54ac0d0710 0x7f54ac1e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54b2ef9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac0b80a0 con 0x7f54ac0cd5d0 2024-09-17T03:41:13.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54b2ef9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac0b1de0 con 0x7f54ac0b47c0 2024-09-17T03:41:13.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54b2ef9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac1f47c0 con 0x7f54ac0d0710 2024-09-17T03:41:13.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ac0cd5d0 0x7f54ac1dd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ac0cd5d0 0x7f54ac1dd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33440/0 (socket says 172.21.15.146:33440) 2024-09-17T03:41:13.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54a3fff640 1 -- 172.21.15.146:0/1599145381 learned_addr learned my addr 172.21.15.146:0/1599145381 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:13.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54b1496640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54ac0d0710 0x7f54ac1e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54b0c95640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54ac0b47c0 0x7f54ac1f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54a3fff640 1 -- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54ac0d0710 msgr2=0x7f54ac1e1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54a3fff640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54ac0d0710 0x7f54ac1e1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54a3fff640 1 -- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54ac0b47c0 msgr2=0x7f54ac1f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54a3fff640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54ac0b47c0 0x7f54ac1f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54a3fff640 1 -- 172.21.15.146:0/1599145381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac0b0830 con 0x7f54ac0cd5d0 2024-09-17T03:41:13.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.289+0000 7f54a3fff640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ac0cd5d0 0x7f54ac1dd910 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c9a0 tx=0x7f549c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:13.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.290+0000 7f54a17fa640 1 -- 172.21.15.146:0/1599145381 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c007bb0 con 0x7f54ac0cd5d0 2024-09-17T03:41:13.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.290+0000 7f54a17fa640 1 -- 172.21.15.146:0/1599145381 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f549c005020 con 0x7f54ac0cd5d0 2024-09-17T03:41:13.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.290+0000 7f54a17fa640 1 -- 172.21.15.146:0/1599145381 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c007e60 con 0x7f54ac0cd5d0 2024-09-17T03:41:13.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.290+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1599145381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac0b0b10 con 0x7f54ac0cd5d0 2024-09-17T03:41:13.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.290+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1599145381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac0b10d0 con 0x7f54ac0cd5d0 2024-09-17T03:41:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.291+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1599145381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ac0cd090 con 0x7f54ac0cd5d0 2024-09-17T03:41:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.291+0000 7f54a17fa640 1 -- 172.21.15.146:0/1599145381 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f549c005470 con 0x7f54ac0cd5d0 2024-09-17T03:41:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.292+0000 7f54a17fa640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5498078b90 0x7f549807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.292+0000 7f54a17fa640 1 -- 172.21.15.146:0/1599145381 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f549c09b150 con 0x7f54ac0cd5d0 2024-09-17T03:41:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.292+0000 7f54b0c95640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5498078b90 0x7f549807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.293+0000 7f54b0c95640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5498078b90 0x7f549807b0a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f54a8006fd0 tx=0x7f54a8009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:13.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.297+0000 7f54a17fa640 1 -- 172.21.15.146:0/1599145381 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f549c014030 con 0x7f54ac0cd5d0 2024-09-17T03:41:13.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.467+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1599145381 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54ac1dde50 con 0x7f5498078b90 2024-09-17T03:41:13.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.472+0000 7f54a17fa640 1 -- 172.21.15.146:0/1599145381 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252472 (secure 0 0 0) 0x7f54ac1dde50 con 0x7f5498078b90 2024-09-17T03:41:13.474 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:13.475 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:41:13.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5498078b90 msgr2=0x7f549807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5498078b90 0x7f549807b0a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f54a8006fd0 tx=0x7f54a8009060 comp rx=0 tx=0).stop 2024-09-17T03:41:13.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1599145381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ac0cd5d0 msgr2=0x7f54ac1dd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ac0cd5d0 0x7f54ac1dd910 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c9a0 tx=0x7f549c00ce60 comp rx=0 tx=0).stop 2024-09-17T03:41:13.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1599145381 shutdown_connections 2024-09-17T03:41:13.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5498078b90 0x7f549807b0a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f54ac0d0710 0x7f54ac1e1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ac0cd5d0 0x7f54ac1dd910 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 --2- 172.21.15.146:0/1599145381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54ac0b47c0 0x7f54ac1f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1599145381 >> 172.21.15.146:0/1599145381 conn(0x7f54ac09ba20 msgr2=0x7f54ac0cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:13.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1599145381 shutdown_connections 2024-09-17T03:41:13.477 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.475+0000 7f54b2ef9640 1 -- 172.21.15.146:0/1599145381 wait complete. 2024-09-17T03:41:13.487 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2024-09-17T03:41:11.922141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":391088,"kb_used_data":13832,"kb_used_omap":12,"kb_used_meta":377075,"kb_avail":754583632,"statfs":{"total":773094113280,"available":772693639168,"internally_reserved":0,"allocated":14163968,"data_stored":6843668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":386125361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002649"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993207+0000","last_change":"2024-09-17T03:41:04.672249+0000","last_active":"2024-09-17T03:41:05.993207+0000","last_peered":"2024-09-17T03:41:05.993207+0000","last_clean":"2024-09-17T03:41:05.993207+0000","last_became_active":"2024-09-17T03:41:04.671932+0000","last_became_peered":"2024-09-17T03:41:04.671932+0000","last_unstale":"2024-09-17T03:41:05.993207+0000","last_undegraded":"2024-09-17T03:41:05.993207+0000","last_fullsized":"2024-09-17T03:41:05.993207+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:39.105086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992166+0000","last_change":"2024-09-17T03:41:04.665581+0000","last_active":"2024-09-17T03:41:05.992166+0000","last_peered":"2024-09-17T03:41:05.992166+0000","last_clean":"2024-09-17T03:41:05.992166+0000","last_became_active":"2024-09-17T03:41:04.664464+0000","last_became_peered":"2024-09-17T03:41:04.664464+0000","last_unstale":"2024-09-17T03:41:05.992166+0000","last_undegraded":"2024-09-17T03:41:05.992166+0000","last_fullsized":"2024-09-17T03:41:05.992166+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:01.277268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670513+0000","last_change":"2024-09-17T03:41:04.667588+0000","last_active":"2024-09-17T03:41:05.670513+0000","last_peered":"2024-09-17T03:41:05.670513+0000","last_clean":"2024-09-17T03:41:05.670513+0000","last_became_active":"2024-09-17T03:41:04.667263+0000","last_became_peered":"2024-09-17T03:41:04.667263+0000","last_unstale":"2024-09-17T03:41:05.670513+0000","last_undegraded":"2024-09-17T03:41:05.670513+0000","last_fullsized":"2024-09-17T03:41:05.670513+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:52.333599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992229+0000","last_change":"2024-09-17T03:41:04.680843+0000","last_active":"2024-09-17T03:41:05.992229+0000","last_peered":"2024-09-17T03:41:05.992229+0000","last_clean":"2024-09-17T03:41:05.992229+0000","last_became_active":"2024-09-17T03:41:04.680479+0000","last_became_peered":"2024-09-17T03:41:04.680479+0000","last_unstale":"2024-09-17T03:41:05.992229+0000","last_undegraded":"2024-09-17T03:41:05.992229+0000","last_fullsized":"2024-09-17T03:41:05.992229+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:49.779612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679336+0000","last_change":"2024-09-17T03:41:04.679361+0000","last_active":"2024-09-17T03:41:05.679336+0000","last_peered":"2024-09-17T03:41:05.679336+0000","last_clean":"2024-09-17T03:41:05.679336+0000","last_became_active":"2024-09-17T03:41:04.678823+0000","last_became_peered":"2024-09-17T03:41:04.678823+0000","last_unstale":"2024-09-17T03:41:05.679336+0000","last_undegraded":"2024-09-17T03:41:05.679336+0000","last_fullsized":"2024-09-17T03:41:05.679336+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:11.633326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670496+0000","last_change":"2024-09-17T03:41:04.671657+0000","last_active":"2024-09-17T03:41:05.670496+0000","last_peered":"2024-09-17T03:41:05.670496+0000","last_clean":"2024-09-17T03:41:05.670496+0000","last_became_active":"2024-09-17T03:41:04.671355+0000","last_became_peered":"2024-09-17T03:41:04.671355+0000","last_unstale":"2024-09-17T03:41:05.670496+0000","last_undegraded":"2024-09-17T03:41:05.670496+0000","last_fullsized":"2024-09-17T03:41:05.670496+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:04.156584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669722+0000","last_change":"2024-09-17T03:41:04.664789+0000","last_active":"2024-09-17T03:41:05.669722+0000","last_peered":"2024-09-17T03:41:05.669722+0000","last_clean":"2024-09-17T03:41:05.669722+0000","last_became_active":"2024-09-17T03:41:04.664451+0000","last_became_peered":"2024-09-17T03:41:04.664451+0000","last_unstale":"2024-09-17T03:41:05.669722+0000","last_undegraded":"2024-09-17T03:41:05.669722+0000","last_fullsized":"2024-09-17T03:41:05.669722+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:06.838055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670206+0000","last_change":"2024-09-17T03:41:04.677687+0000","last_active":"2024-09-17T03:41:05.670206+0000","last_peered":"2024-09-17T03:41:05.670206+0000","last_clean":"2024-09-17T03:41:05.670206+0000","last_became_active":"2024-09-17T03:41:04.677149+0000","last_became_peered":"2024-09-17T03:41:04.677149+0000","last_unstale":"2024-09-17T03:41:05.670206+0000","last_undegraded":"2024-09-17T03:41:05.670206+0000","last_fullsized":"2024-09-17T03:41:05.670206+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:24.425255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670969+0000","last_change":"2024-09-17T03:41:04.675327+0000","last_active":"2024-09-17T03:41:05.670969+0000","last_peered":"2024-09-17T03:41:05.670969+0000","last_clean":"2024-09-17T03:41:05.670969+0000","last_became_active":"2024-09-17T03:41:04.674979+0000","last_became_peered":"2024-09-17T03:41:04.674979+0000","last_unstale":"2024-09-17T03:41:05.670969+0000","last_undegraded":"2024-09-17T03:41:05.670969+0000","last_fullsized":"2024-09-17T03:41:05.670969+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:06.838055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992482+0000","last_change":"2024-09-17T03:41:04.672762+0000","last_active":"2024-09-17T03:41:05.992482+0000","last_peered":"2024-09-17T03:41:05.992482+0000","last_clean":"2024-09-17T03:41:05.992482+0000","last_became_active":"2024-09-17T03:41:04.672460+0000","last_became_peered":"2024-09-17T03:41:04.672460+0000","last_unstale":"2024-09-17T03:41:05.992482+0000","last_undegraded":"2024-09-17T03:41:05.992482+0000","last_fullsized":"2024-09-17T03:41:05.992482+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:21.361458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668703+0000","last_change":"2024-09-17T03:41:04.673942+0000","last_active":"2024-09-17T03:41:05.668703+0000","last_peered":"2024-09-17T03:41:05.668703+0000","last_clean":"2024-09-17T03:41:05.668703+0000","last_became_active":"2024-09-17T03:41:04.673639+0000","last_became_peered":"2024-09-17T03:41:04.673639+0000","last_unstale":"2024-09-17T03:41:05.668703+0000","last_undegraded":"2024-09-17T03:41:05.668703+0000","last_fullsized":"2024-09-17T03:41:05.668703+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:24.886857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670397+0000","last_change":"2024-09-17T03:41:04.668452+0000","last_active":"2024-09-17T03:41:05.670397+0000","last_peered":"2024-09-17T03:41:05.670397+0000","last_clean":"2024-09-17T03:41:05.670397+0000","last_became_active":"2024-09-17T03:41:04.668145+0000","last_became_peered":"2024-09-17T03:41:04.668145+0000","last_unstale":"2024-09-17T03:41:05.670397+0000","last_undegraded":"2024-09-17T03:41:05.670397+0000","last_fullsized":"2024-09-17T03:41:05.670397+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:34.573268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993206+0000","last_change":"2024-09-17T03:41:04.682835+0000","last_active":"2024-09-17T03:41:05.993206+0000","last_peered":"2024-09-17T03:41:05.993206+0000","last_clean":"2024-09-17T03:41:05.993206+0000","last_became_active":"2024-09-17T03:41:04.682107+0000","last_became_peered":"2024-09-17T03:41:04.682107+0000","last_unstale":"2024-09-17T03:41:05.993206+0000","last_undegraded":"2024-09-17T03:41:05.993206+0000","last_fullsized":"2024-09-17T03:41:05.993206+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.922478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992181+0000","last_change":"2024-09-17T03:41:04.675335+0000","last_active":"2024-09-17T03:41:05.992181+0000","last_peered":"2024-09-17T03:41:05.992181+0000","last_clean":"2024-09-17T03:41:05.992181+0000","last_became_active":"2024-09-17T03:41:04.675056+0000","last_became_peered":"2024-09-17T03:41:04.675056+0000","last_unstale":"2024-09-17T03:41:05.992181+0000","last_undegraded":"2024-09-17T03:41:05.992181+0000","last_fullsized":"2024-09-17T03:41:05.992181+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:05.163716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992623+0000","last_change":"2024-09-17T03:41:04.671396+0000","last_active":"2024-09-17T03:41:05.992623+0000","last_peered":"2024-09-17T03:41:05.992623+0000","last_clean":"2024-09-17T03:41:05.992623+0000","last_became_active":"2024-09-17T03:41:04.671094+0000","last_became_peered":"2024-09-17T03:41:04.671094+0000","last_unstale":"2024-09-17T03:41:05.992623+0000","last_undegraded":"2024-09-17T03:41:05.992623+0000","last_fullsized":"2024-09-17T03:41:05.992623+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:16.170440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775951+0000","last_change":"2024-09-17T03:41:04.684317+0000","last_active":"2024-09-17T03:41:05.775951+0000","last_peered":"2024-09-17T03:41:05.775951+0000","last_clean":"2024-09-17T03:41:05.775951+0000","last_became_active":"2024-09-17T03:41:04.682665+0000","last_became_peered":"2024-09-17T03:41:04.682665+0000","last_unstale":"2024-09-17T03:41:05.775951+0000","last_undegraded":"2024-09-17T03:41:05.775951+0000","last_fullsized":"2024-09-17T03:41:05.775951+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:26.514663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.671294+0000","last_change":"2024-09-17T03:41:04.665988+0000","last_active":"2024-09-17T03:41:05.671294+0000","last_peered":"2024-09-17T03:41:05.671294+0000","last_clean":"2024-09-17T03:41:05.671294+0000","last_became_active":"2024-09-17T03:41:04.665691+0000","last_became_peered":"2024-09-17T03:41:04.665691+0000","last_unstale":"2024-09-17T03:41:05.671294+0000","last_undegraded":"2024-09-17T03:41:05.671294+0000","last_fullsized":"2024-09-17T03:41:05.671294+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:38.931430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776176+0000","last_change":"2024-09-17T03:41:04.672835+0000","last_active":"2024-09-17T03:41:05.776176+0000","last_peered":"2024-09-17T03:41:05.776176+0000","last_clean":"2024-09-17T03:41:05.776176+0000","last_became_active":"2024-09-17T03:41:04.672536+0000","last_became_peered":"2024-09-17T03:41:04.672536+0000","last_unstale":"2024-09-17T03:41:05.776176+0000","last_undegraded":"2024-09-17T03:41:05.776176+0000","last_fullsized":"2024-09-17T03:41:05.776176+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:20.558673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668702+0000","last_change":"2024-09-17T03:41:04.672148+0000","last_active":"2024-09-17T03:41:05.668702+0000","last_peered":"2024-09-17T03:41:05.668702+0000","last_clean":"2024-09-17T03:41:05.668702+0000","last_became_active":"2024-09-17T03:41:04.671834+0000","last_became_peered":"2024-09-17T03:41:04.671834+0000","last_unstale":"2024-09-17T03:41:05.668702+0000","last_undegraded":"2024-09-17T03:41:05.668702+0000","last_fullsized":"2024-09-17T03:41:05.668702+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:03.245032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776267+0000","last_change":"2024-09-17T03:41:04.681101+0000","last_active":"2024-09-17T03:41:05.776267+0000","last_peered":"2024-09-17T03:41:05.776267+0000","last_clean":"2024-09-17T03:41:05.776267+0000","last_became_active":"2024-09-17T03:41:04.678923+0000","last_became_peered":"2024-09-17T03:41:04.678923+0000","last_unstale":"2024-09-17T03:41:05.776267+0000","last_undegraded":"2024-09-17T03:41:05.776267+0000","last_fullsized":"2024-09-17T03:41:05.776267+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:04.887694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679087+0000","last_change":"2024-09-17T03:41:04.678898+0000","last_active":"2024-09-17T03:41:05.679087+0000","last_peered":"2024-09-17T03:41:05.679087+0000","last_clean":"2024-09-17T03:41:05.679087+0000","last_became_active":"2024-09-17T03:41:04.678497+0000","last_became_peered":"2024-09-17T03:41:04.678497+0000","last_unstale":"2024-09-17T03:41:05.679087+0000","last_undegraded":"2024-09-17T03:41:05.679087+0000","last_fullsized":"2024-09-17T03:41:05.679087+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:43.279673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668571+0000","last_change":"2024-09-17T03:41:04.673356+0000","last_active":"2024-09-17T03:41:05.668571+0000","last_peered":"2024-09-17T03:41:05.668571+0000","last_clean":"2024-09-17T03:41:05.668571+0000","last_became_active":"2024-09-17T03:41:04.673065+0000","last_became_peered":"2024-09-17T03:41:04.673065+0000","last_unstale":"2024-09-17T03:41:05.668571+0000","last_undegraded":"2024-09-17T03:41:05.668571+0000","last_fullsized":"2024-09-17T03:41:05.668571+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:12.855509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670017+0000","last_change":"2024-09-17T03:41:04.675423+0000","last_active":"2024-09-17T03:41:05.670017+0000","last_peered":"2024-09-17T03:41:05.670017+0000","last_clean":"2024-09-17T03:41:05.670017+0000","last_became_active":"2024-09-17T03:41:04.674791+0000","last_became_peered":"2024-09-17T03:41:04.674791+0000","last_unstale":"2024-09-17T03:41:05.670017+0000","last_undegraded":"2024-09-17T03:41:05.670017+0000","last_fullsized":"2024-09-17T03:41:05.670017+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:57.579594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668486+0000","last_change":"2024-09-17T03:41:04.666902+0000","last_active":"2024-09-17T03:41:05.668486+0000","last_peered":"2024-09-17T03:41:05.668486+0000","last_clean":"2024-09-17T03:41:05.668486+0000","last_became_active":"2024-09-17T03:41:04.666600+0000","last_became_peered":"2024-09-17T03:41:04.666600+0000","last_unstale":"2024-09-17T03:41:05.668486+0000","last_undegraded":"2024-09-17T03:41:05.668486+0000","last_fullsized":"2024-09-17T03:41:05.668486+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:40.244825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992456+0000","last_change":"2024-09-17T03:41:04.680361+0000","last_active":"2024-09-17T03:41:05.992456+0000","last_peered":"2024-09-17T03:41:05.992456+0000","last_clean":"2024-09-17T03:41:05.992456+0000","last_became_active":"2024-09-17T03:41:04.680058+0000","last_became_peered":"2024-09-17T03:41:04.680058+0000","last_unstale":"2024-09-17T03:41:05.992456+0000","last_undegraded":"2024-09-17T03:41:05.992456+0000","last_fullsized":"2024-09-17T03:41:05.992456+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:20.604144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776200+0000","last_change":"2024-09-17T03:41:04.674681+0000","last_active":"2024-09-17T03:41:05.776200+0000","last_peered":"2024-09-17T03:41:05.776200+0000","last_clean":"2024-09-17T03:41:05.776200+0000","last_became_active":"2024-09-17T03:41:04.674347+0000","last_became_peered":"2024-09-17T03:41:04.674347+0000","last_unstale":"2024-09-17T03:41:05.776200+0000","last_undegraded":"2024-09-17T03:41:05.776200+0000","last_fullsized":"2024-09-17T03:41:05.776200+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:54.420791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992935+0000","last_change":"2024-09-17T03:41:04.681902+0000","last_active":"2024-09-17T03:41:05.992935+0000","last_peered":"2024-09-17T03:41:05.992935+0000","last_clean":"2024-09-17T03:41:05.992935+0000","last_became_active":"2024-09-17T03:41:04.681609+0000","last_became_peered":"2024-09-17T03:41:04.681609+0000","last_unstale":"2024-09-17T03:41:05.992935+0000","last_undegraded":"2024-09-17T03:41:05.992935+0000","last_fullsized":"2024-09-17T03:41:05.992935+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:11.925081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992621+0000","last_change":"2024-09-17T03:41:04.680689+0000","last_active":"2024-09-17T03:41:05.992621+0000","last_peered":"2024-09-17T03:41:05.992621+0000","last_clean":"2024-09-17T03:41:05.992621+0000","last_became_active":"2024-09-17T03:41:04.680384+0000","last_became_peered":"2024-09-17T03:41:04.680384+0000","last_unstale":"2024-09-17T03:41:05.992621+0000","last_undegraded":"2024-09-17T03:41:05.992621+0000","last_fullsized":"2024-09-17T03:41:05.992621+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:16.107400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993188+0000","last_change":"2024-09-17T03:41:04.683048+0000","last_active":"2024-09-17T03:41:05.993188+0000","last_peered":"2024-09-17T03:41:05.993188+0000","last_clean":"2024-09-17T03:41:05.993188+0000","last_became_active":"2024-09-17T03:41:04.682477+0000","last_became_peered":"2024-09-17T03:41:04.682477+0000","last_unstale":"2024-09-17T03:41:05.993188+0000","last_undegraded":"2024-09-17T03:41:05.993188+0000","last_fullsized":"2024-09-17T03:41:05.993188+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:44.301787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992457+0000","last_change":"2024-09-17T03:41:04.678463+0000","last_active":"2024-09-17T03:41:05.992457+0000","last_peered":"2024-09-17T03:41:05.992457+0000","last_clean":"2024-09-17T03:41:05.992457+0000","last_became_active":"2024-09-17T03:41:04.677339+0000","last_became_peered":"2024-09-17T03:41:04.677339+0000","last_unstale":"2024-09-17T03:41:05.992457+0000","last_undegraded":"2024-09-17T03:41:05.992457+0000","last_fullsized":"2024-09-17T03:41:05.992457+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:18.810735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678760+0000","last_change":"2024-09-17T03:41:04.686768+0000","last_active":"2024-09-17T03:41:05.678760+0000","last_peered":"2024-09-17T03:41:05.678760+0000","last_clean":"2024-09-17T03:41:05.678760+0000","last_became_active":"2024-09-17T03:41:04.686436+0000","last_became_peered":"2024-09-17T03:41:04.686436+0000","last_unstale":"2024-09-17T03:41:05.678760+0000","last_undegraded":"2024-09-17T03:41:05.678760+0000","last_fullsized":"2024-09-17T03:41:05.678760+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:01.708962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669551+0000","last_change":"2024-09-17T03:41:04.674939+0000","last_active":"2024-09-17T03:41:05.669551+0000","last_peered":"2024-09-17T03:41:05.669551+0000","last_clean":"2024-09-17T03:41:05.669551+0000","last_became_active":"2024-09-17T03:41:04.674633+0000","last_became_peered":"2024-09-17T03:41:04.674633+0000","last_unstale":"2024-09-17T03:41:05.669551+0000","last_undegraded":"2024-09-17T03:41:05.669551+0000","last_fullsized":"2024-09-17T03:41:05.669551+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:26.893496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776437+0000","last_change":"2024-09-17T03:41:04.676577+0000","last_active":"2024-09-17T03:41:05.776437+0000","last_peered":"2024-09-17T03:41:05.776437+0000","last_clean":"2024-09-17T03:41:05.776437+0000","last_became_active":"2024-09-17T03:41:04.676246+0000","last_became_peered":"2024-09-17T03:41:04.676246+0000","last_unstale":"2024-09-17T03:41:05.776437+0000","last_undegraded":"2024-09-17T03:41:05.776437+0000","last_fullsized":"2024-09-17T03:41:05.776437+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:18.595167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"129'4","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679091+0000","last_change":"2024-09-17T03:41:03.676165+0000","last_active":"2024-09-17T03:41:05.679091+0000","last_peered":"2024-09-17T03:41:05.679091+0000","last_clean":"2024-09-17T03:41:05.679091+0000","last_became_active":"2024-09-17T03:41:03.675800+0000","last_became_peered":"2024-09-17T03:41:03.675800+0000","last_unstale":"2024-09-17T03:41:05.679091+0000","last_undegraded":"2024-09-17T03:41:05.679091+0000","last_fullsized":"2024-09-17T03:41:05.679091+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:08.078181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.671221+0000","last_change":"2024-09-17T03:41:04.675703+0000","last_active":"2024-09-17T03:41:05.671221+0000","last_peered":"2024-09-17T03:41:05.671221+0000","last_clean":"2024-09-17T03:41:05.671221+0000","last_became_active":"2024-09-17T03:41:04.675223+0000","last_became_peered":"2024-09-17T03:41:04.675223+0000","last_unstale":"2024-09-17T03:41:05.671221+0000","last_undegraded":"2024-09-17T03:41:05.671221+0000","last_fullsized":"2024-09-17T03:41:05.671221+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:52.127906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992676+0000","last_change":"2024-09-17T03:41:03.674308+0000","last_active":"2024-09-17T03:41:05.992676+0000","last_peered":"2024-09-17T03:41:05.992676+0000","last_clean":"2024-09-17T03:41:05.992676+0000","last_became_active":"2024-09-17T03:41:03.673437+0000","last_became_peered":"2024-09-17T03:41:03.673437+0000","last_unstale":"2024-09-17T03:41:05.992676+0000","last_undegraded":"2024-09-17T03:41:05.992676+0000","last_fullsized":"2024-09-17T03:41:05.992676+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:26.761000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679117+0000","last_change":"2024-09-17T03:41:04.682660+0000","last_active":"2024-09-17T03:41:05.679117+0000","last_peered":"2024-09-17T03:41:05.679117+0000","last_clean":"2024-09-17T03:41:05.679117+0000","last_became_active":"2024-09-17T03:41:04.681977+0000","last_became_peered":"2024-09-17T03:41:04.681977+0000","last_unstale":"2024-09-17T03:41:05.679117+0000","last_undegraded":"2024-09-17T03:41:05.679117+0000","last_fullsized":"2024-09-17T03:41:05.679117+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:00.017736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668867+0000","last_change":"2024-09-17T03:41:03.673481+0000","last_active":"2024-09-17T03:41:05.668867+0000","last_peered":"2024-09-17T03:41:05.668867+0000","last_clean":"2024-09-17T03:41:05.668867+0000","last_became_active":"2024-09-17T03:41:03.673184+0000","last_became_peered":"2024-09-17T03:41:03.673184+0000","last_unstale":"2024-09-17T03:41:05.668867+0000","last_undegraded":"2024-09-17T03:41:05.668867+0000","last_fullsized":"2024-09-17T03:41:05.668867+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:20.289969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679069+0000","last_change":"2024-09-17T03:41:04.681372+0000","last_active":"2024-09-17T03:41:05.679069+0000","last_peered":"2024-09-17T03:41:05.679069+0000","last_clean":"2024-09-17T03:41:05.679069+0000","last_became_active":"2024-09-17T03:41:04.681023+0000","last_became_peered":"2024-09-17T03:41:04.681023+0000","last_unstale":"2024-09-17T03:41:05.679069+0000","last_undegraded":"2024-09-17T03:41:05.679069+0000","last_fullsized":"2024-09-17T03:41:05.679069+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:13:14.823600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992880+0000","last_change":"2024-09-17T03:41:03.670618+0000","last_active":"2024-09-17T03:41:05.992880+0000","last_peered":"2024-09-17T03:41:05.992880+0000","last_clean":"2024-09-17T03:41:05.992880+0000","last_became_active":"2024-09-17T03:41:03.670320+0000","last_became_peered":"2024-09-17T03:41:03.670320+0000","last_unstale":"2024-09-17T03:41:05.992880+0000","last_undegraded":"2024-09-17T03:41:05.992880+0000","last_fullsized":"2024-09-17T03:41:05.992880+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:13.736628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775936+0000","last_change":"2024-09-17T03:41:04.681945+0000","last_active":"2024-09-17T03:41:05.775936+0000","last_peered":"2024-09-17T03:41:05.775936+0000","last_clean":"2024-09-17T03:41:05.775936+0000","last_became_active":"2024-09-17T03:41:04.680316+0000","last_became_peered":"2024-09-17T03:41:04.680316+0000","last_unstale":"2024-09-17T03:41:05.775936+0000","last_undegraded":"2024-09-17T03:41:05.775936+0000","last_fullsized":"2024-09-17T03:41:05.775936+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:13.616492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992071+0000","last_change":"2024-09-17T03:41:03.675301+0000","last_active":"2024-09-17T03:41:05.992071+0000","last_peered":"2024-09-17T03:41:05.992071+0000","last_clean":"2024-09-17T03:41:05.992071+0000","last_became_active":"2024-09-17T03:41:03.675002+0000","last_became_peered":"2024-09-17T03:41:03.675002+0000","last_unstale":"2024-09-17T03:41:05.992071+0000","last_undegraded":"2024-09-17T03:41:05.992071+0000","last_fullsized":"2024-09-17T03:41:05.992071+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:58.380265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670682+0000","last_change":"2024-09-17T03:41:04.671407+0000","last_active":"2024-09-17T03:41:05.670682+0000","last_peered":"2024-09-17T03:41:05.670682+0000","last_clean":"2024-09-17T03:41:05.670682+0000","last_became_active":"2024-09-17T03:41:04.671116+0000","last_became_peered":"2024-09-17T03:41:04.671116+0000","last_unstale":"2024-09-17T03:41:05.670682+0000","last_undegraded":"2024-09-17T03:41:05.670682+0000","last_fullsized":"2024-09-17T03:41:05.670682+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:45.577154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775855+0000","last_change":"2024-09-17T03:41:03.676747+0000","last_active":"2024-09-17T03:41:05.775855+0000","last_peered":"2024-09-17T03:41:05.775855+0000","last_clean":"2024-09-17T03:41:05.775855+0000","last_became_active":"2024-09-17T03:41:03.676034+0000","last_became_peered":"2024-09-17T03:41:03.676034+0000","last_unstale":"2024-09-17T03:41:05.775855+0000","last_undegraded":"2024-09-17T03:41:05.775855+0000","last_fullsized":"2024-09-17T03:41:05.775855+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:54.137997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669801+0000","last_change":"2024-09-17T03:41:04.675580+0000","last_active":"2024-09-17T03:41:05.669801+0000","last_peered":"2024-09-17T03:41:05.669801+0000","last_clean":"2024-09-17T03:41:05.669801+0000","last_became_active":"2024-09-17T03:41:04.675124+0000","last_became_peered":"2024-09-17T03:41:04.675124+0000","last_unstale":"2024-09-17T03:41:05.669801+0000","last_undegraded":"2024-09-17T03:41:05.669801+0000","last_fullsized":"2024-09-17T03:41:05.669801+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:44.698823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669927+0000","last_change":"2024-09-17T03:41:03.672674+0000","last_active":"2024-09-17T03:41:05.669927+0000","last_peered":"2024-09-17T03:41:05.669927+0000","last_clean":"2024-09-17T03:41:05.669927+0000","last_became_active":"2024-09-17T03:41:03.672235+0000","last_became_peered":"2024-09-17T03:41:03.672235+0000","last_unstale":"2024-09-17T03:41:05.669927+0000","last_undegraded":"2024-09-17T03:41:05.669927+0000","last_fullsized":"2024-09-17T03:41:05.669927+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:52.033242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992013+0000","last_change":"2024-09-17T03:41:04.673894+0000","last_active":"2024-09-17T03:41:05.992013+0000","last_peered":"2024-09-17T03:41:05.992013+0000","last_clean":"2024-09-17T03:41:05.992013+0000","last_became_active":"2024-09-17T03:41:04.673600+0000","last_became_peered":"2024-09-17T03:41:04.673600+0000","last_unstale":"2024-09-17T03:41:05.992013+0000","last_undegraded":"2024-09-17T03:41:05.992013+0000","last_fullsized":"2024-09-17T03:41:05.992013+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:45.817138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992626+0000","last_change":"2024-09-17T03:41:03.666881+0000","last_active":"2024-09-17T03:41:05.992626+0000","last_peered":"2024-09-17T03:41:05.992626+0000","last_clean":"2024-09-17T03:41:05.992626+0000","last_became_active":"2024-09-17T03:41:03.666536+0000","last_became_peered":"2024-09-17T03:41:03.666536+0000","last_unstale":"2024-09-17T03:41:05.992626+0000","last_undegraded":"2024-09-17T03:41:05.992626+0000","last_fullsized":"2024-09-17T03:41:05.992626+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:43.296263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992710+0000","last_change":"2024-09-17T03:41:04.673282+0000","last_active":"2024-09-17T03:41:05.992710+0000","last_peered":"2024-09-17T03:41:05.992710+0000","last_clean":"2024-09-17T03:41:05.992710+0000","last_became_active":"2024-09-17T03:41:04.673006+0000","last_became_peered":"2024-09-17T03:41:04.673006+0000","last_unstale":"2024-09-17T03:41:05.992710+0000","last_undegraded":"2024-09-17T03:41:05.992710+0000","last_fullsized":"2024-09-17T03:41:05.992710+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:23.394637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992979+0000","last_change":"2024-09-17T03:41:03.675807+0000","last_active":"2024-09-17T03:41:05.992979+0000","last_peered":"2024-09-17T03:41:05.992979+0000","last_clean":"2024-09-17T03:41:05.992979+0000","last_became_active":"2024-09-17T03:41:03.675416+0000","last_became_peered":"2024-09-17T03:41:03.675416+0000","last_unstale":"2024-09-17T03:41:05.992979+0000","last_undegraded":"2024-09-17T03:41:05.992979+0000","last_fullsized":"2024-09-17T03:41:05.992979+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:38.733293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992833+0000","last_change":"2024-09-17T03:41:04.677308+0000","last_active":"2024-09-17T03:41:05.992833+0000","last_peered":"2024-09-17T03:41:05.992833+0000","last_clean":"2024-09-17T03:41:05.992833+0000","last_became_active":"2024-09-17T03:41:04.677003+0000","last_became_peered":"2024-09-17T03:41:04.677003+0000","last_unstale":"2024-09-17T03:41:05.992833+0000","last_undegraded":"2024-09-17T03:41:05.992833+0000","last_fullsized":"2024-09-17T03:41:05.992833+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:55.994505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776317+0000","last_change":"2024-09-17T03:41:03.671819+0000","last_active":"2024-09-17T03:41:05.776317+0000","last_peered":"2024-09-17T03:41:05.776317+0000","last_clean":"2024-09-17T03:41:05.776317+0000","last_became_active":"2024-09-17T03:41:03.671499+0000","last_became_peered":"2024-09-17T03:41:03.671499+0000","last_unstale":"2024-09-17T03:41:05.776317+0000","last_undegraded":"2024-09-17T03:41:05.776317+0000","last_fullsized":"2024-09-17T03:41:05.776317+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:31.784168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679268+0000","last_change":"2024-09-17T03:41:04.687167+0000","last_active":"2024-09-17T03:41:05.679268+0000","last_peered":"2024-09-17T03:41:05.679268+0000","last_clean":"2024-09-17T03:41:05.679268+0000","last_became_active":"2024-09-17T03:41:04.686468+0000","last_became_peered":"2024-09-17T03:41:04.686468+0000","last_unstale":"2024-09-17T03:41:05.679268+0000","last_undegraded":"2024-09-17T03:41:05.679268+0000","last_fullsized":"2024-09-17T03:41:05.679268+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:07.904857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"129'3","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992455+0000","last_change":"2024-09-17T03:41:03.673293+0000","last_active":"2024-09-17T03:41:05.992455+0000","last_peered":"2024-09-17T03:41:05.992455+0000","last_clean":"2024-09-17T03:41:05.992455+0000","last_became_active":"2024-09-17T03:41:03.672799+0000","last_became_peered":"2024-09-17T03:41:03.672799+0000","last_unstale":"2024-09-17T03:41:05.992455+0000","last_undegraded":"2024-09-17T03:41:05.992455+0000","last_fullsized":"2024-09-17T03:41:05.992455+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:27.089366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679394+0000","last_change":"2024-09-17T03:41:04.685114+0000","last_active":"2024-09-17T03:41:05.679394+0000","last_peered":"2024-09-17T03:41:05.679394+0000","last_clean":"2024-09-17T03:41:05.679394+0000","last_became_active":"2024-09-17T03:41:04.682645+0000","last_became_peered":"2024-09-17T03:41:04.682645+0000","last_unstale":"2024-09-17T03:41:05.679394+0000","last_undegraded":"2024-09-17T03:41:05.679394+0000","last_fullsized":"2024-09-17T03:41:05.679394+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:28.946466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"129'6","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.671453+0000","last_change":"2024-09-17T03:41:03.673721+0000","last_active":"2024-09-17T03:41:05.671453+0000","last_peered":"2024-09-17T03:41:05.671453+0000","last_clean":"2024-09-17T03:41:05.671453+0000","last_became_active":"2024-09-17T03:41:03.673378+0000","last_became_peered":"2024-09-17T03:41:03.673378+0000","last_unstale":"2024-09-17T03:41:05.671453+0000","last_undegraded":"2024-09-17T03:41:05.671453+0000","last_fullsized":"2024-09-17T03:41:05.671453+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:00.271744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993378+0000","last_change":"2024-09-17T03:41:04.682669+0000","last_active":"2024-09-17T03:41:05.993378+0000","last_peered":"2024-09-17T03:41:05.993378+0000","last_clean":"2024-09-17T03:41:05.993378+0000","last_became_active":"2024-09-17T03:41:04.681735+0000","last_became_peered":"2024-09-17T03:41:04.681735+0000","last_unstale":"2024-09-17T03:41:05.993378+0000","last_undegraded":"2024-09-17T03:41:05.993378+0000","last_fullsized":"2024-09-17T03:41:05.993378+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:32.554460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992818+0000","last_change":"2024-09-17T03:41:03.672669+0000","last_active":"2024-09-17T03:41:05.992818+0000","last_peered":"2024-09-17T03:41:05.992818+0000","last_clean":"2024-09-17T03:41:05.992818+0000","last_became_active":"2024-09-17T03:41:03.672086+0000","last_became_peered":"2024-09-17T03:41:03.672086+0000","last_unstale":"2024-09-17T03:41:05.992818+0000","last_undegraded":"2024-09-17T03:41:05.992818+0000","last_fullsized":"2024-09-17T03:41:05.992818+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:22.052287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992701+0000","last_change":"2024-09-17T03:41:04.669109+0000","last_active":"2024-09-17T03:41:05.992701+0000","last_peered":"2024-09-17T03:41:05.992701+0000","last_clean":"2024-09-17T03:41:05.992701+0000","last_became_active":"2024-09-17T03:41:04.668623+0000","last_became_peered":"2024-09-17T03:41:04.668623+0000","last_unstale":"2024-09-17T03:41:05.992701+0000","last_undegraded":"2024-09-17T03:41:05.992701+0000","last_fullsized":"2024-09-17T03:41:05.992701+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:20.192011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992407+0000","last_change":"2024-09-17T03:41:03.674227+0000","last_active":"2024-09-17T03:41:05.992407+0000","last_peered":"2024-09-17T03:41:05.992407+0000","last_clean":"2024-09-17T03:41:05.992407+0000","last_became_active":"2024-09-17T03:41:03.673934+0000","last_became_peered":"2024-09-17T03:41:03.673934+0000","last_unstale":"2024-09-17T03:41:05.992407+0000","last_undegraded":"2024-09-17T03:41:05.992407+0000","last_fullsized":"2024-09-17T03:41:05.992407+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:05.213422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669939+0000","last_change":"2024-09-17T03:41:04.670930+0000","last_active":"2024-09-17T03:41:05.669939+0000","last_peered":"2024-09-17T03:41:05.669939+0000","last_clean":"2024-09-17T03:41:05.669939+0000","last_became_active":"2024-09-17T03:41:04.670596+0000","last_became_peered":"2024-09-17T03:41:04.670596+0000","last_unstale":"2024-09-17T03:41:05.669939+0000","last_undegraded":"2024-09-17T03:41:05.669939+0000","last_fullsized":"2024-09-17T03:41:05.669939+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:35.978408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"129'8","reported_seq":23,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.669989+0000","last_change":"2024-09-17T03:41:03.671146+0000","last_active":"2024-09-17T03:41:05.669989+0000","last_peered":"2024-09-17T03:41:05.669989+0000","last_clean":"2024-09-17T03:41:05.669989+0000","last_became_active":"2024-09-17T03:41:03.670717+0000","last_became_peered":"2024-09-17T03:41:03.670717+0000","last_unstale":"2024-09-17T03:41:05.669989+0000","last_undegraded":"2024-09-17T03:41:05.669989+0000","last_fullsized":"2024-09-17T03:41:05.669989+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:44.383978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670792+0000","last_change":"2024-09-17T03:41:04.684949+0000","last_active":"2024-09-17T03:41:05.670792+0000","last_peered":"2024-09-17T03:41:05.670792+0000","last_clean":"2024-09-17T03:41:05.670792+0000","last_became_active":"2024-09-17T03:41:04.683009+0000","last_became_peered":"2024-09-17T03:41:04.683009+0000","last_unstale":"2024-09-17T03:41:05.670792+0000","last_undegraded":"2024-09-17T03:41:05.670792+0000","last_fullsized":"2024-09-17T03:41:05.670792+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:26.893496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993043+0000","last_change":"2024-09-17T03:41:03.673614+0000","last_active":"2024-09-17T03:41:05.993043+0000","last_peered":"2024-09-17T03:41:05.993043+0000","last_clean":"2024-09-17T03:41:05.993043+0000","last_became_active":"2024-09-17T03:41:03.672276+0000","last_became_peered":"2024-09-17T03:41:03.672276+0000","last_unstale":"2024-09-17T03:41:05.993043+0000","last_undegraded":"2024-09-17T03:41:05.993043+0000","last_fullsized":"2024-09-17T03:41:05.993043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:58.982726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992933+0000","last_change":"2024-09-17T03:41:04.671325+0000","last_active":"2024-09-17T03:41:05.992933+0000","last_peered":"2024-09-17T03:41:05.992933+0000","last_clean":"2024-09-17T03:41:05.992933+0000","last_became_active":"2024-09-17T03:41:04.670508+0000","last_became_peered":"2024-09-17T03:41:04.670508+0000","last_unstale":"2024-09-17T03:41:05.992933+0000","last_undegraded":"2024-09-17T03:41:05.992933+0000","last_fullsized":"2024-09-17T03:41:05.992933+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:54.939814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668928+0000","last_change":"2024-09-17T03:41:03.670284+0000","last_active":"2024-09-17T03:41:05.668928+0000","last_peered":"2024-09-17T03:41:05.668928+0000","last_clean":"2024-09-17T03:41:05.668928+0000","last_became_active":"2024-09-17T03:41:03.668681+0000","last_became_peered":"2024-09-17T03:41:03.668681+0000","last_unstale":"2024-09-17T03:41:05.668928+0000","last_undegraded":"2024-09-17T03:41:05.668928+0000","last_fullsized":"2024-09-17T03:41:05.668928+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:17.557215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776233+0000","last_change":"2024-09-17T03:41:04.679337+0000","last_active":"2024-09-17T03:41:05.776233+0000","last_peered":"2024-09-17T03:41:05.776233+0000","last_clean":"2024-09-17T03:41:05.776233+0000","last_became_active":"2024-09-17T03:41:04.677967+0000","last_became_peered":"2024-09-17T03:41:04.677967+0000","last_unstale":"2024-09-17T03:41:05.776233+0000","last_undegraded":"2024-09-17T03:41:05.776233+0000","last_fullsized":"2024-09-17T03:41:05.776233+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:05.761345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670866+0000","last_change":"2024-09-17T03:41:03.672925+0000","last_active":"2024-09-17T03:41:05.670866+0000","last_peered":"2024-09-17T03:41:05.670866+0000","last_clean":"2024-09-17T03:41:05.670866+0000","last_became_active":"2024-09-17T03:41:03.672614+0000","last_became_peered":"2024-09-17T03:41:03.672614+0000","last_unstale":"2024-09-17T03:41:05.670866+0000","last_undegraded":"2024-09-17T03:41:05.670866+0000","last_fullsized":"2024-09-17T03:41:05.670866+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:19.186487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992349+0000","last_change":"2024-09-17T03:41:04.674664+0000","last_active":"2024-09-17T03:41:05.992349+0000","last_peered":"2024-09-17T03:41:05.992349+0000","last_clean":"2024-09-17T03:41:05.992349+0000","last_became_active":"2024-09-17T03:41:04.674370+0000","last_became_peered":"2024-09-17T03:41:04.674370+0000","last_unstale":"2024-09-17T03:41:05.992349+0000","last_undegraded":"2024-09-17T03:41:05.992349+0000","last_fullsized":"2024-09-17T03:41:05.992349+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:47.854552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992493+0000","last_change":"2024-09-17T03:41:03.669334+0000","last_active":"2024-09-17T03:41:05.992493+0000","last_peered":"2024-09-17T03:41:05.992493+0000","last_clean":"2024-09-17T03:41:05.992493+0000","last_became_active":"2024-09-17T03:41:03.669018+0000","last_became_peered":"2024-09-17T03:41:03.669018+0000","last_unstale":"2024-09-17T03:41:05.992493+0000","last_undegraded":"2024-09-17T03:41:05.992493+0000","last_fullsized":"2024-09-17T03:41:05.992493+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:10.640755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992670+0000","last_change":"2024-09-17T03:41:04.672340+0000","last_active":"2024-09-17T03:41:05.992670+0000","last_peered":"2024-09-17T03:41:05.992670+0000","last_clean":"2024-09-17T03:41:05.992670+0000","last_became_active":"2024-09-17T03:41:04.671945+0000","last_became_peered":"2024-09-17T03:41:04.671945+0000","last_unstale":"2024-09-17T03:41:05.992670+0000","last_undegraded":"2024-09-17T03:41:05.992670+0000","last_fullsized":"2024-09-17T03:41:05.992670+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:56.992165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992516+0000","last_change":"2024-09-17T03:41:03.676603+0000","last_active":"2024-09-17T03:41:05.992516+0000","last_peered":"2024-09-17T03:41:05.992516+0000","last_clean":"2024-09-17T03:41:05.992516+0000","last_became_active":"2024-09-17T03:41:03.676265+0000","last_became_peered":"2024-09-17T03:41:03.676265+0000","last_unstale":"2024-09-17T03:41:05.992516+0000","last_undegraded":"2024-09-17T03:41:05.992516+0000","last_fullsized":"2024-09-17T03:41:05.992516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:49.453780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670960+0000","last_change":"2024-09-17T03:41:04.670121+0000","last_active":"2024-09-17T03:41:05.670960+0000","last_peered":"2024-09-17T03:41:05.670960+0000","last_clean":"2024-09-17T03:41:05.670960+0000","last_became_active":"2024-09-17T03:41:04.666510+0000","last_became_peered":"2024-09-17T03:41:04.666510+0000","last_unstale":"2024-09-17T03:41:05.670960+0000","last_undegraded":"2024-09-17T03:41:05.670960+0000","last_fullsized":"2024-09-17T03:41:05.670960+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:35.493783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776059+0000","last_change":"2024-09-17T03:41:03.675991+0000","last_active":"2024-09-17T03:41:05.776059+0000","last_peered":"2024-09-17T03:41:05.776059+0000","last_clean":"2024-09-17T03:41:05.776059+0000","last_became_active":"2024-09-17T03:41:03.671518+0000","last_became_peered":"2024-09-17T03:41:03.671518+0000","last_unstale":"2024-09-17T03:41:05.776059+0000","last_undegraded":"2024-09-17T03:41:05.776059+0000","last_fullsized":"2024-09-17T03:41:05.776059+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:48.342701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.991980+0000","last_change":"2024-09-17T03:41:04.668568+0000","last_active":"2024-09-17T03:41:05.991980+0000","last_peered":"2024-09-17T03:41:05.991980+0000","last_clean":"2024-09-17T03:41:05.991980+0000","last_became_active":"2024-09-17T03:41:04.668163+0000","last_became_peered":"2024-09-17T03:41:04.668163+0000","last_unstale":"2024-09-17T03:41:05.991980+0000","last_undegraded":"2024-09-17T03:41:05.991980+0000","last_fullsized":"2024-09-17T03:41:05.991980+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:56.886979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775781+0000","last_change":"2024-09-17T03:41:03.668667+0000","last_active":"2024-09-17T03:41:05.775781+0000","last_peered":"2024-09-17T03:41:05.775781+0000","last_clean":"2024-09-17T03:41:05.775781+0000","last_became_active":"2024-09-17T03:41:03.668333+0000","last_became_peered":"2024-09-17T03:41:03.668333+0000","last_unstale":"2024-09-17T03:41:05.775781+0000","last_undegraded":"2024-09-17T03:41:05.775781+0000","last_fullsized":"2024-09-17T03:41:05.775781+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:10.629109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678688+0000","last_change":"2024-09-17T03:41:04.687350+0000","last_active":"2024-09-17T03:41:05.678688+0000","last_peered":"2024-09-17T03:41:05.678688+0000","last_clean":"2024-09-17T03:41:05.678688+0000","last_became_active":"2024-09-17T03:41:04.686528+0000","last_became_peered":"2024-09-17T03:41:04.686528+0000","last_unstale":"2024-09-17T03:41:05.678688+0000","last_undegraded":"2024-09-17T03:41:05.678688+0000","last_fullsized":"2024-09-17T03:41:05.678688+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:51.871963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668394+0000","last_change":"2024-09-17T03:41:03.669613+0000","last_active":"2024-09-17T03:41:05.668394+0000","last_peered":"2024-09-17T03:41:05.668394+0000","last_clean":"2024-09-17T03:41:05.668394+0000","last_became_active":"2024-09-17T03:41:03.669217+0000","last_became_peered":"2024-09-17T03:41:03.669217+0000","last_unstale":"2024-09-17T03:41:05.668394+0000","last_undegraded":"2024-09-17T03:41:05.668394+0000","last_fullsized":"2024-09-17T03:41:05.668394+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:07.751104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.671742+0000","last_change":"2024-09-17T03:41:04.673388+0000","last_active":"2024-09-17T03:41:05.671742+0000","last_peered":"2024-09-17T03:41:05.671742+0000","last_clean":"2024-09-17T03:41:05.671742+0000","last_became_active":"2024-09-17T03:41:04.673087+0000","last_became_peered":"2024-09-17T03:41:04.673087+0000","last_unstale":"2024-09-17T03:41:05.671742+0000","last_undegraded":"2024-09-17T03:41:05.671742+0000","last_fullsized":"2024-09-17T03:41:05.671742+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:12.387236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993347+0000","last_change":"2024-09-17T03:41:03.675319+0000","last_active":"2024-09-17T03:41:05.993347+0000","last_peered":"2024-09-17T03:41:05.993347+0000","last_clean":"2024-09-17T03:41:05.993347+0000","last_became_active":"2024-09-17T03:41:03.673645+0000","last_became_peered":"2024-09-17T03:41:03.673645+0000","last_unstale":"2024-09-17T03:41:05.993347+0000","last_undegraded":"2024-09-17T03:41:05.993347+0000","last_fullsized":"2024-09-17T03:41:05.993347+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:45.858150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.993171+0000","last_change":"2024-09-17T03:41:04.680675+0000","last_active":"2024-09-17T03:41:05.993171+0000","last_peered":"2024-09-17T03:41:05.993171+0000","last_clean":"2024-09-17T03:41:05.993171+0000","last_became_active":"2024-09-17T03:41:04.678376+0000","last_became_peered":"2024-09-17T03:41:04.678376+0000","last_unstale":"2024-09-17T03:41:05.993171+0000","last_undegraded":"2024-09-17T03:41:05.993171+0000","last_fullsized":"2024-09-17T03:41:05.993171+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:10.858760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"130'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678963+0000","last_change":"2024-09-17T03:41:03.675332+0000","last_active":"2024-09-17T03:41:05.678963+0000","last_peered":"2024-09-17T03:41:05.678963+0000","last_clean":"2024-09-17T03:41:05.678963+0000","last_became_active":"2024-09-17T03:41:03.674332+0000","last_became_peered":"2024-09-17T03:41:03.674332+0000","last_unstale":"2024-09-17T03:41:05.678963+0000","last_undegraded":"2024-09-17T03:41:05.678963+0000","last_fullsized":"2024-09-17T03:41:05.678963+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:33.496868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992909+0000","last_change":"2024-09-17T03:41:04.679786+0000","last_active":"2024-09-17T03:41:05.992909+0000","last_peered":"2024-09-17T03:41:05.992909+0000","last_clean":"2024-09-17T03:41:05.992909+0000","last_became_active":"2024-09-17T03:41:04.679448+0000","last_became_peered":"2024-09-17T03:41:04.679448+0000","last_unstale":"2024-09-17T03:41:05.992909+0000","last_undegraded":"2024-09-17T03:41:05.992909+0000","last_fullsized":"2024-09-17T03:41:05.992909+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:53.038766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992326+0000","last_change":"2024-09-17T03:41:03.666881+0000","last_active":"2024-09-17T03:41:05.992326+0000","last_peered":"2024-09-17T03:41:05.992326+0000","last_clean":"2024-09-17T03:41:05.992326+0000","last_became_active":"2024-09-17T03:41:03.666310+0000","last_became_peered":"2024-09-17T03:41:03.666310+0000","last_unstale":"2024-09-17T03:41:05.992326+0000","last_undegraded":"2024-09-17T03:41:05.992326+0000","last_fullsized":"2024-09-17T03:41:05.992326+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:01.508264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.670668+0000","last_change":"2024-09-17T03:41:04.673742+0000","last_active":"2024-09-17T03:41:05.670668+0000","last_peered":"2024-09-17T03:41:05.670668+0000","last_clean":"2024-09-17T03:41:05.670668+0000","last_became_active":"2024-09-17T03:41:04.671298+0000","last_became_peered":"2024-09-17T03:41:04.671298+0000","last_unstale":"2024-09-17T03:41:05.670668+0000","last_undegraded":"2024-09-17T03:41:05.670668+0000","last_fullsized":"2024-09-17T03:41:05.670668+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:52.127906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668827+0000","last_change":"2024-09-17T03:41:03.671833+0000","last_active":"2024-09-17T03:41:05.668827+0000","last_peered":"2024-09-17T03:41:05.668827+0000","last_clean":"2024-09-17T03:41:05.668827+0000","last_became_active":"2024-09-17T03:41:03.671461+0000","last_became_peered":"2024-09-17T03:41:03.671461+0000","last_unstale":"2024-09-17T03:41:05.668827+0000","last_undegraded":"2024-09-17T03:41:05.668827+0000","last_fullsized":"2024-09-17T03:41:05.668827+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:51.176006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678723+0000","last_change":"2024-09-17T03:41:04.680596+0000","last_active":"2024-09-17T03:41:05.678723+0000","last_peered":"2024-09-17T03:41:05.678723+0000","last_clean":"2024-09-17T03:41:05.678723+0000","last_became_active":"2024-09-17T03:41:04.680286+0000","last_became_peered":"2024-09-17T03:41:04.680286+0000","last_unstale":"2024-09-17T03:41:05.678723+0000","last_undegraded":"2024-09-17T03:41:05.678723+0000","last_fullsized":"2024-09-17T03:41:05.678723+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:20.908677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992200+0000","last_change":"2024-09-17T03:41:03.674559+0000","last_active":"2024-09-17T03:41:05.992200+0000","last_peered":"2024-09-17T03:41:05.992200+0000","last_clean":"2024-09-17T03:41:05.992200+0000","last_became_active":"2024-09-17T03:41:03.674262+0000","last_became_peered":"2024-09-17T03:41:03.674262+0000","last_unstale":"2024-09-17T03:41:05.992200+0000","last_undegraded":"2024-09-17T03:41:05.992200+0000","last_fullsized":"2024-09-17T03:41:05.992200+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:37.214658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992647+0000","last_change":"2024-09-17T03:41:04.683290+0000","last_active":"2024-09-17T03:41:05.992647+0000","last_peered":"2024-09-17T03:41:05.992647+0000","last_clean":"2024-09-17T03:41:05.992647+0000","last_became_active":"2024-09-17T03:41:04.682914+0000","last_became_peered":"2024-09-17T03:41:04.682914+0000","last_unstale":"2024-09-17T03:41:05.992647+0000","last_undegraded":"2024-09-17T03:41:05.992647+0000","last_fullsized":"2024-09-17T03:41:05.992647+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:41.050865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678968+0000","last_change":"2024-09-17T03:41:03.678154+0000","last_active":"2024-09-17T03:41:05.678968+0000","last_peered":"2024-09-17T03:41:05.678968+0000","last_clean":"2024-09-17T03:41:05.678968+0000","last_became_active":"2024-09-17T03:41:03.677792+0000","last_became_peered":"2024-09-17T03:41:03.677792+0000","last_unstale":"2024-09-17T03:41:05.678968+0000","last_undegraded":"2024-09-17T03:41:05.678968+0000","last_fullsized":"2024-09-17T03:41:05.678968+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:50.038738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.776116+0000","last_change":"2024-09-17T03:41:04.679711+0000","last_active":"2024-09-17T03:41:05.776116+0000","last_peered":"2024-09-17T03:41:05.776116+0000","last_clean":"2024-09-17T03:41:05.776116+0000","last_became_active":"2024-09-17T03:41:04.677950+0000","last_became_peered":"2024-09-17T03:41:04.677950+0000","last_unstale":"2024-09-17T03:41:05.776116+0000","last_undegraded":"2024-09-17T03:41:05.776116+0000","last_fullsized":"2024-09-17T03:41:05.776116+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:28.312827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.775980+0000","last_change":"2024-09-17T03:41:03.666191+0000","last_active":"2024-09-17T03:41:05.775980+0000","last_peered":"2024-09-17T03:41:05.775980+0000","last_clean":"2024-09-17T03:41:05.775980+0000","last_became_active":"2024-09-17T03:41:03.665893+0000","last_became_peered":"2024-09-17T03:41:03.665893+0000","last_unstale":"2024-09-17T03:41:05.775980+0000","last_undegraded":"2024-09-17T03:41:05.775980+0000","last_fullsized":"2024-09-17T03:41:05.775980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:18.129464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.992294+0000","last_change":"2024-09-17T03:41:04.681335+0000","last_active":"2024-09-17T03:41:05.992294+0000","last_peered":"2024-09-17T03:41:05.992294+0000","last_clean":"2024-09-17T03:41:05.992294+0000","last_became_active":"2024-09-17T03:41:04.681048+0000","last_became_peered":"2024-09-17T03:41:04.681048+0000","last_unstale":"2024-09-17T03:41:05.992294+0000","last_undegraded":"2024-09-17T03:41:05.992294+0000","last_fullsized":"2024-09-17T03:41:05.992294+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:07.353107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.668526+0000","last_change":"2024-09-17T03:41:03.668313+0000","last_active":"2024-09-17T03:41:05.668526+0000","last_peered":"2024-09-17T03:41:05.668526+0000","last_clean":"2024-09-17T03:41:05.668526+0000","last_became_active":"2024-09-17T03:41:03.668025+0000","last_became_peered":"2024-09-17T03:41:03.668025+0000","last_unstale":"2024-09-17T03:41:05.668526+0000","last_undegraded":"2024-09-17T03:41:05.668526+0000","last_fullsized":"2024-09-17T03:41:05.668526+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:45.663494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678776+0000","last_change":"2024-09-17T03:41:04.685474+0000","last_active":"2024-09-17T03:41:05.678776+0000","last_peered":"2024-09-17T03:41:05.678776+0000","last_clean":"2024-09-17T03:41:05.678776+0000","last_became_active":"2024-09-17T03:41:04.685139+0000","last_became_peered":"2024-09-17T03:41:04.685139+0000","last_unstale":"2024-09-17T03:41:05.678776+0000","last_undegraded":"2024-09-17T03:41:05.678776+0000","last_fullsized":"2024-09-17T03:41:05.678776+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:03.648345+0000","last_clean_scrub_stamp":"2024-09-17T03:41:03.648345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:42.457611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.679326+0000","last_change":"2024-09-17T03:41:03.676588+0000","last_active":"2024-09-17T03:41:05.679326+0000","last_peered":"2024-09-17T03:41:05.679326+0000","last_clean":"2024-09-17T03:41:05.679326+0000","last_became_active":"2024-09-17T03:41:03.676281+0000","last_became_peered":"2024-09-17T03:41:03.676281+0000","last_unstale":"2024-09-17T03:41:05.679326+0000","last_undegraded":"2024-09-17T03:41:05.679326+0000","last_fullsized":"2024-09-17T03:41:05.679326+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:02.642821+0000","last_clean_scrub_stamp":"2024-09-17T03:41:02.642821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:29.592714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":311,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T03:41:05.678585+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:41:05.678585+0000","last_peered":"2024-09-17T03:41:05.678585+0000","last_clean":"2024-09-17T03:41:05.678585+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:41:05.678585+0000","last_undegraded":"2024-09-17T03:41:05.678585+0000","last_fullsized":"2024-09-17T03:41:05.678585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47256,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324584,"statfs":{"total":96636764160,"available":96588374016,"internally_reserved":0,"allocated":2232320,"data_stored":1299882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":46135755},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509544,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50824,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321016,"statfs":{"total":96636764160,"available":96584720384,"internally_reserved":0,"allocated":1626112,"data_stored":708876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50816,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":1617920,"data_stored":707334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509544,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46664,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325176,"statfs":{"total":96636764160,"available":96588980224,"internally_reserved":0,"allocated":1622016,"data_stored":707880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509545,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50816,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":1613824,"data_stored":707264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509545,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47232,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324608,"statfs":{"total":96636764160,"available":96588398592,"internally_reserved":0,"allocated":2207744,"data_stored":1297632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46660,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325180,"statfs":{"total":96636764160,"available":96588984320,"internally_reserved":0,"allocated":1622016,"data_stored":707376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50820,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321020,"statfs":{"total":96636764160,"available":96584724480,"internally_reserved":0,"allocated":1622016,"data_stored":707424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:41:13.491 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:41:13.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:41:13.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.649+0000 7f1e3d977640 1 -- 172.21.15.146:0/1758269176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e3815f820 msgr2=0x7f1e380d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.649+0000 7f1e3d977640 1 --2- 172.21.15.146:0/1758269176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e3815f820 0x7f1e380d02d0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f1e38073430 tx=0x7f1e2002a560 comp rx=0 tx=0).stop 2024-09-17T03:41:13.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.649+0000 7f1e3d977640 1 -- 172.21.15.146:0/1758269176 shutdown_connections 2024-09-17T03:41:13.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.649+0000 7f1e3d977640 1 --2- 172.21.15.146:0/1758269176 >> v2:172.21.15.179:3300/0 conn(0x7f1e380d0810 0x7f1e3815bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.649+0000 7f1e3d977640 1 --2- 172.21.15.146:0/1758269176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e3815f820 0x7f1e380d02d0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.649+0000 7f1e3d977640 1 --2- 172.21.15.146:0/1758269176 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e38145150 0x7f1e3815f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.649+0000 7f1e3d977640 1 -- 172.21.15.146:0/1758269176 >> 172.21.15.146:0/1758269176 conn(0x7f1e3806e820 msgr2=0x7f1e380b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:13.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.649+0000 7f1e3d977640 1 -- 172.21.15.146:0/1758269176 shutdown_connections 2024-09-17T03:41:13.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.649+0000 7f1e3d977640 1 -- 172.21.15.146:0/1758269176 wait complete. 2024-09-17T03:41:13.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.650+0000 7f1e3d977640 1 Processor -- start 2024-09-17T03:41:13.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.651+0000 7f1e3d977640 1 -- start start 2024-09-17T03:41:13.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e3d977640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e380d0810 0x7f1e380b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e3d977640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e38145150 0x7f1e3815af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e3d977640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e3815f820 0x7f1e380afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e3d977640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3815c560 con 0x7f1e38145150 2024-09-17T03:41:13.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e3d977640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3815c3e0 con 0x7f1e380d0810 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e3d977640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3815c6e0 con 0x7f1e3815f820 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e367fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e38145150 0x7f1e3815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e367fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e38145150 0x7f1e3815af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33452/0 (socket says 172.21.15.146:33452) 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e367fc640 1 -- 172.21.15.146:0/704133529 learned_addr learned my addr 172.21.15.146:0/704133529 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e377fe640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e3815f820 0x7f1e380afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e36ffd640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e380d0810 0x7f1e380b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e367fc640 1 -- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e3815f820 msgr2=0x7f1e380afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e367fc640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e3815f820 0x7f1e380afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e367fc640 1 -- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e380d0810 msgr2=0x7f1e380b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e367fc640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e380d0810 0x7f1e380b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e367fc640 1 -- 172.21.15.146:0/704133529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e380b27c0 con 0x7f1e38145150 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.652+0000 7f1e377fe640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e3815f820 0x7f1e380afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.653+0000 7f1e367fc640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e38145150 0x7f1e3815af70 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f1e20000c00 tx=0x7f1e200039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.653+0000 7f1e2ffff640 1 -- 172.21.15.146:0/704133529 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2003e030 con 0x7f1e38145150 2024-09-17T03:41:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.653+0000 7f1e2ffff640 1 -- 172.21.15.146:0/704133529 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e200047a0 con 0x7f1e38145150 2024-09-17T03:41:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.653+0000 7f1e3d977640 1 -- 172.21.15.146:0/704133529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e380b2cd0 con 0x7f1e38145150 2024-09-17T03:41:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.653+0000 7f1e2ffff640 1 -- 172.21.15.146:0/704133529 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20035040 con 0x7f1e38145150 2024-09-17T03:41:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.653+0000 7f1e3d977640 1 -- 172.21.15.146:0/704133529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e38132ef0 con 0x7f1e38145150 2024-09-17T03:41:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.654+0000 7f1e3d977640 1 -- 172.21.15.146:0/704133529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e38076920 con 0x7f1e38145150 2024-09-17T03:41:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.654+0000 7f1e2ffff640 1 -- 172.21.15.146:0/704133529 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1e20041030 con 0x7f1e38145150 2024-09-17T03:41:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.655+0000 7f1e2ffff640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e18078bc0 0x7f1e1807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.655+0000 7f1e2ffff640 1 -- 172.21.15.146:0/704133529 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f1e200bb670 con 0x7f1e38145150 2024-09-17T03:41:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.655+0000 7f1e36ffd640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e18078bc0 0x7f1e1807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.656+0000 7f1e36ffd640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e18078bc0 0x7f1e1807b0d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1e28008c80 tx=0x7f1e28008230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.660+0000 7f1e2ffff640 1 -- 172.21.15.146:0/704133529 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1e38076920 con 0x7f1e38145150 2024-09-17T03:41:13.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.906+0000 7f1e3d977640 1 -- 172.21.15.146:0/704133529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1e3815f2e0 con 0x7f1e38145150 2024-09-17T03:41:13.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.909+0000 7f1e2ffff640 1 -- 172.21.15.146:0/704133529 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f1e20083a30 con 0x7f1e38145150 2024-09-17T03:41:13.908 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:41:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:41:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:41:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:41:13.908 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:41:13.908 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 -- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e18078bc0 msgr2=0x7f1e1807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e18078bc0 0x7f1e1807b0d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1e28008c80 tx=0x7f1e28008230 comp rx=0 tx=0).stop 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 -- 172.21.15.146:0/704133529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e38145150 msgr2=0x7f1e3815af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e38145150 0x7f1e3815af70 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f1e20000c00 tx=0x7f1e200039e0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 -- 172.21.15.146:0/704133529 shutdown_connections 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e18078bc0 0x7f1e1807b0d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e3815f820 0x7f1e380afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e38145150 0x7f1e3815af70 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 --2- 172.21.15.146:0/704133529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e380d0810 0x7f1e380b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 -- 172.21.15.146:0/704133529 >> 172.21.15.146:0/704133529 conn(0x7f1e3806e820 msgr2=0x7f1e38142dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 -- 172.21.15.146:0/704133529 shutdown_connections 2024-09-17T03:41:13.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:13.911+0000 7f1e3d977640 1 -- 172.21.15.146:0/704133529 wait complete. 2024-09-17T03:41:13.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:14.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.037+0000 7fe820277640 1 -- 172.21.15.146:0/894438236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8180cdc50 msgr2=0x7fe8180b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.037+0000 7fe820277640 1 --2- 172.21.15.146:0/894438236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8180cdc50 0x7fe8180b4ba0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fe810005fd0 tx=0x7fe81002aa10 comp rx=0 tx=0).stop 2024-09-17T03:41:14.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.037+0000 7fe820277640 1 -- 172.21.15.146:0/894438236 shutdown_connections 2024-09-17T03:41:14.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.037+0000 7fe820277640 1 --2- 172.21.15.146:0/894438236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8180cdc50 0x7fe8180b4ba0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.037+0000 7fe820277640 1 --2- 172.21.15.146:0/894438236 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe81815c8e0 0x7fe81806f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.037+0000 7fe820277640 1 -- 172.21.15.146:0/894438236 >> 172.21.15.146:0/894438236 conn(0x7fe8180b3150 msgr2=0x7fe8180b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.037+0000 7fe820277640 1 -- 172.21.15.146:0/894438236 shutdown_connections 2024-09-17T03:41:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.037+0000 7fe820277640 1 -- 172.21.15.146:0/894438236 wait complete. 2024-09-17T03:41:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.038+0000 7fe820277640 1 Processor -- start 2024-09-17T03:41:14.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.039+0000 7fe820277640 1 -- start start 2024-09-17T03:41:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe820277640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8180cd840 0x7fe818151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe820277640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8180cdc50 0x7fe8180aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe820277640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81815c8e0 0x7fe81806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe820277640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe818073580 con 0x7fe8180cdc50 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe820277640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe8180b5370 con 0x7fe81815c8e0 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe820277640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe818073700 con 0x7fe8180cd840 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81d812640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8180cdc50 0x7fe8180aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81d812640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8180cdc50 0x7fe8180aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33470/0 (socket says 172.21.15.146:33470) 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81d812640 1 -- 172.21.15.146:0/2115543113 learned_addr learned my addr 172.21.15.146:0/2115543113 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81e013640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8180cd840 0x7fe818151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81e814640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81815c8e0 0x7fe81806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81d812640 1 -- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8180cd840 msgr2=0x7fe818151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81d812640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8180cd840 0x7fe818151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81d812640 1 -- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81815c8e0 msgr2=0x7fe81806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81d812640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81815c8e0 0x7fe81806cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81d812640 1 -- 172.21.15.146:0/2115543113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe818158700 con 0x7fe8180cdc50 2024-09-17T03:41:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81e013640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8180cd840 0x7fe818151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe81d812640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8180cdc50 0x7fe8180aacc0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fe80800c3c0 tx=0x7fe80800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.040+0000 7fe80effd640 1 -- 172.21.15.146:0/2115543113 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808017070 con 0x7fe8180cdc50 2024-09-17T03:41:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.041+0000 7fe80effd640 1 -- 172.21.15.146:0/2115543113 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8080035f0 con 0x7fe8180cdc50 2024-09-17T03:41:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.041+0000 7fe820277640 1 -- 172.21.15.146:0/2115543113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8181589e0 con 0x7fe8180cdc50 2024-09-17T03:41:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.041+0000 7fe80effd640 1 -- 172.21.15.146:0/2115543113 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808003a20 con 0x7fe8180cdc50 2024-09-17T03:41:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.041+0000 7fe820277640 1 -- 172.21.15.146:0/2115543113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe818158fa0 con 0x7fe8180cdc50 2024-09-17T03:41:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.042+0000 7fe820277640 1 -- 172.21.15.146:0/2115543113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe818073b80 con 0x7fe8180cdc50 2024-09-17T03:41:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.042+0000 7fe80effd640 1 -- 172.21.15.146:0/2115543113 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe80801a070 con 0x7fe8180cdc50 2024-09-17T03:41:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.043+0000 7fe80effd640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7fc078b90 0x7fe7fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.043+0000 7fe80effd640 1 -- 172.21.15.146:0/2115543113 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fe80809a030 con 0x7fe8180cdc50 2024-09-17T03:41:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.043+0000 7fe81e013640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7fc078b90 0x7fe7fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.044+0000 7fe81e013640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7fc078b90 0x7fe7fc07b0a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe814009b80 tx=0x7fe814005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.048+0000 7fe80effd640 1 -- 172.21.15.146:0/2115543113 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe808062470 con 0x7fe8180cdc50 2024-09-17T03:41:14.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.257+0000 7fe820277640 1 -- 172.21.15.146:0/2115543113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe81815de60 con 0x7fe8180cdc50 2024-09-17T03:41:14.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.257+0000 7fe80effd640 1 -- 172.21.15.146:0/2115543113 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7fe808061d70 con 0x7fe8180cdc50 2024-09-17T03:41:14.256 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:14.257 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:14.257 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 -- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7fc078b90 msgr2=0x7fe7fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7fc078b90 0x7fe7fc07b0a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe814009b80 tx=0x7fe814005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 -- 172.21.15.146:0/2115543113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8180cdc50 msgr2=0x7fe8180aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8180cdc50 0x7fe8180aacc0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fe80800c3c0 tx=0x7fe80800c880 comp rx=0 tx=0).stop 2024-09-17T03:41:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 -- 172.21.15.146:0/2115543113 shutdown_connections 2024-09-17T03:41:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7fc078b90 0x7fe7fc07b0a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe81815c8e0 0x7fe81806cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8180cdc50 0x7fe8180aacc0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 --2- 172.21.15.146:0/2115543113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8180cd840 0x7fe818151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 -- 172.21.15.146:0/2115543113 >> 172.21.15.146:0/2115543113 conn(0x7fe8180b3150 msgr2=0x7fe8180b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:14.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 -- 172.21.15.146:0/2115543113 shutdown_connections 2024-09-17T03:41:14.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.260+0000 7fe820277640 1 -- 172.21.15.146:0/2115543113 wait complete. 2024-09-17T03:41:14.673 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:41:04.022718+0000', 'modified': '2024-09-17T03:41:07.049751+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8658}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8658': {'gid': 8658, 'name': 'c', 'rank': 0, 'incarnation': 92, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6834/141241275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 141241275}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 141241275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8658, 'qdb_cluster': [8658]} 2024-09-17T03:41:14.673 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:41:14.673 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:41:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.791+0000 7f8d6b038640 1 -- 172.21.15.146:0/3000179843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d640cd840 msgr2=0x7f8d640b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.791+0000 7f8d6b038640 1 --2- 172.21.15.146:0/3000179843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d640cd840 0x7f8d640b5680 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f8d640b45d0 tx=0x7f8d5802aa00 comp rx=0 tx=0).stop 2024-09-17T03:41:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.791+0000 7f8d6b038640 1 -- 172.21.15.146:0/3000179843 shutdown_connections 2024-09-17T03:41:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.791+0000 7f8d6b038640 1 --2- 172.21.15.146:0/3000179843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d640cd840 0x7f8d640b5680 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.791+0000 7f8d6b038640 1 -- 172.21.15.146:0/3000179843 >> 172.21.15.146:0/3000179843 conn(0x7f8d640b3150 msgr2=0x7f8d640b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.791+0000 7f8d6b038640 1 -- 172.21.15.146:0/3000179843 shutdown_connections 2024-09-17T03:41:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.791+0000 7f8d6b038640 1 -- 172.21.15.146:0/3000179843 wait complete. 2024-09-17T03:41:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.793+0000 7f8d6b038640 1 Processor -- start 2024-09-17T03:41:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.793+0000 7f8d6b038640 1 -- start start 2024-09-17T03:41:14.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d6b038640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d640cd840 0x7f8d64143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d6b038640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d640cdc50 0x7f8d641e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d6b038640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d6415c8e0 0x7f8d6415a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d6b038640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8d64073700 con 0x7f8d640cdc50 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d6b038640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d64073580 con 0x7f8d6415c8e0 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d6b038640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8d64073880 con 0x7f8d640cd840 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d63fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d640cdc50 0x7f8d641e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d63fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d640cdc50 0x7f8d641e3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33484/0 (socket says 172.21.15.146:33484) 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d63fff640 1 -- 172.21.15.146:0/766664511 learned_addr learned my addr 172.21.15.146:0/766664511 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d63fff640 1 -- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d640cd840 msgr2=0x7f8d64143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d695d5640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d6415c8e0 0x7f8d6415a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d63fff640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d640cd840 0x7f8d64143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d63fff640 1 -- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d6415c8e0 msgr2=0x7f8d6415a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d63fff640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d6415c8e0 0x7f8d6415a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d63fff640 1 -- 172.21.15.146:0/766664511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d640cefb0 con 0x7f8d640cdc50 2024-09-17T03:41:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d63fff640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d640cdc50 0x7f8d641e3eb0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f8d5802aff0 tx=0x7f8d58003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d617fa640 1 -- 172.21.15.146:0/766664511 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58033050 con 0x7f8d640cdc50 2024-09-17T03:41:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d617fa640 1 -- 172.21.15.146:0/766664511 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d58004630 con 0x7f8d640cdc50 2024-09-17T03:41:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d6b038640 1 -- 172.21.15.146:0/766664511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d640cf250 con 0x7f8d640cdc50 2024-09-17T03:41:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.795+0000 7f8d617fa640 1 -- 172.21.15.146:0/766664511 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d580386b0 con 0x7f8d640cdc50 2024-09-17T03:41:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.796+0000 7f8d6b038640 1 -- 172.21.15.146:0/766664511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d64153f10 con 0x7f8d640cdc50 2024-09-17T03:41:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.797+0000 7f8d617fa640 1 -- 172.21.15.146:0/766664511 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d58036070 con 0x7f8d640cdc50 2024-09-17T03:41:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.798+0000 7f8d617fa640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d50078b90 0x7f8d5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.798+0000 7f8d617fa640 1 -- 172.21.15.146:0/766664511 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f8d580bc1a0 con 0x7f8d640cdc50 2024-09-17T03:41:14.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.798+0000 7f8d68dd4640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d50078b90 0x7f8d5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.798+0000 7f8d72084740 1 Processor -- start 2024-09-17T03:41:14.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.799+0000 7f8d68dd4640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d50078b90 0x7f8d5007b0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8d54006fd0 tx=0x7f8d54006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:14.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.799+0000 7f8d72084740 1 -- start start 2024-09-17T03:41:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d72084740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429da270 0x55c442dabfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d72084740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b13b0 0x55c442dac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d72084740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429b9590 0x55c442dc93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d72084740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c442cf4820 con 0x55c4429b9590 2024-09-17T03:41:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d72084740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c442ce3c50 con 0x55c4429da270 2024-09-17T03:41:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d72084740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c442ce7a60 con 0x55c4429b13b0 2024-09-17T03:41:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d695d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429b9590 0x55c442dc93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d695d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429b9590 0x55c442dc93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33496/0 (socket says 172.21.15.146:33496) 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d695d5640 1 -- 172.21.15.146:0/2736131764 learned_addr learned my addr 172.21.15.146:0/2736131764 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d63fff640 1 --2- 172.21.15.146:0/2736131764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b13b0 0x55c442dac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d68dd4640 1 --2- 172.21.15.146:0/2736131764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429da270 0x55c442dabfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d695d5640 1 -- 172.21.15.146:0/2736131764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b13b0 msgr2=0x55c442dac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d695d5640 1 --2- 172.21.15.146:0/2736131764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b13b0 0x55c442dac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d695d5640 1 -- 172.21.15.146:0/2736131764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429da270 msgr2=0x55c442dabfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d695d5640 1 --2- 172.21.15.146:0/2736131764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429da270 0x55c442dabfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d695d5640 1 -- 172.21.15.146:0/2736131764 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c442a45850 con 0x55c4429b9590 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.800+0000 7f8d695d5640 1 --2- 172.21.15.146:0/2736131764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429b9590 0x55c442dc93e0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c001580 tx=0x7f8d5c001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ad46a2af3e9baa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.801+0000 7f8d4a7fc640 1 -- 172.21.15.146:0/2736131764 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c018070 con 0x55c4429b9590 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.801+0000 7f8d4a7fc640 1 -- 172.21.15.146:0/2736131764 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d5c0035f0 con 0x55c4429b9590 2024-09-17T03:41:14.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.801+0000 7f8d4a7fc640 1 -- 172.21.15.146:0/2736131764 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c003a00 con 0x55c4429b9590 2024-09-17T03:41:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.801+0000 7f8d72084740 1 -- 172.21.15.146:0/2736131764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429b9590 msgr2=0x55c442dc93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.801+0000 7f8d72084740 1 --2- 172.21.15.146:0/2736131764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429b9590 0x55c442dc93e0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c001580 tx=0x7f8d5c001980 comp rx=0 tx=0).stop 2024-09-17T03:41:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.801+0000 7f8d72084740 1 -- 172.21.15.146:0/2736131764 shutdown_connections 2024-09-17T03:41:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.801+0000 7f8d72084740 1 --2- 172.21.15.146:0/2736131764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429b9590 0x55c442dc93e0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.802+0000 7f8d72084740 1 --2- 172.21.15.146:0/2736131764 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b13b0 0x55c442dac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.802+0000 7f8d72084740 1 --2- 172.21.15.146:0/2736131764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429da270 0x55c442dabfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.802+0000 7f8d72084740 1 -- 172.21.15.146:0/2736131764 >> 172.21.15.146:0/2736131764 conn(0x55c4429ce3c0 msgr2=0x55c442d82260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.802+0000 7f8d72084740 1 -- 172.21.15.146:0/2736131764 shutdown_connections 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.802+0000 7f8d72084740 1 -- 172.21.15.146:0/2736131764 wait complete. 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.802+0000 7f8d72084740 1 -- start start 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.803+0000 7f8d72084740 1 Processor -- start 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d72084740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b13b0 0x55c442dd6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d72084740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b9590 0x55c442dc72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d72084740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442d966d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d72084740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c442a54620 con 0x55c4429da270 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d72084740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c442c895f0 con 0x55c4429b13b0 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d72084740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c442daca20 con 0x55c4429b9590 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d72084740 10 client.0 _ll_register_callbacks cb 0x55c442c8d0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d695d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442d966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d695d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442d966d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33512/0 (socket says 172.21.15.146:33512) 2024-09-17T03:41:14.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d695d5640 1 -- 172.21.15.146:0/1704299017 learned_addr learned my addr 172.21.15.146:0/1704299017 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d63fff640 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b9590 0x55c442dc72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d68dd4640 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b13b0 0x55c442dd6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d695d5640 1 -- 172.21.15.146:0/1704299017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b9590 msgr2=0x55c442dc72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d695d5640 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b9590 0x55c442dc72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d695d5640 1 -- 172.21.15.146:0/1704299017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b13b0 msgr2=0x55c442dd6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d695d5640 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b13b0 0x55c442dd6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d695d5640 1 -- 172.21.15.146:0/1704299017 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c442abc6b0 con 0x55c4429da270 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.804+0000 7f8d63fff640 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b9590 0x55c442dc72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d695d5640 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442d966d0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c012000 tx=0x7f8d5c004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913b0a8eb17a5934 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d437fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d437fe640 1 -- 172.21.15.146:0/1704299017 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c021020 con 0x55c4429da270 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d437fe640 1 -- 172.21.15.146:0/1704299017 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f8d5c0010e0 con 0x55c4429da270 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d72084740 1 -- 172.21.15.146:0/1704299017 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d5c0035f0 con 0x55c4429da270 2024-09-17T03:41:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d437fe640 1 -- 172.21.15.146:0/1704299017 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f8d5c02b050 con 0x55c4429da270 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d72084740 10 client.8808 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d72084740 1 -- 172.21.15.146:0/1704299017 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x55c442d961b0 con 0x55c4429da270 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d437fe640 1 -- 172.21.15.146:0/1704299017 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d5c0035f0 con 0x55c4429da270 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d437fe640 1 -- 172.21.15.146:0/1704299017 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f8d5c02e020 con 0x55c4429da270 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d72084740 10 client.8808 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d72084740 10 client.8808 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d72084740 20 client.8808 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d72084740 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x55c442998e40 0x55c442dbdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d72084740 4 client.8808 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d72084740 1 -- 172.21.15.146:0/1704299017 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c442cf6770 con 0x55c442998e40 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.805+0000 7f8d68dd4640 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x55c442998e40 0x55c442dbdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.806+0000 7f8d437fe640 10 client.8808 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.806+0000 7f8d68dd4640 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x55c442998e40 0x55c442dbdd40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a4905aaf704cff server_cookie=931aae69acf8c96e in_seq=0 out_seq=0 2024-09-17T03:41:14.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d437fe640 1 -- 172.21.15.146:0/1704299017 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c442cf6770 con 0x55c442998e40 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d437fe640 10 client.8808 handle_command_reply: tid=0 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 1 client.8808 shutdown 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 1 -- 172.21.15.146:0/1704299017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 msgr2=0x55c442d966d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442d966d0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c012000 tx=0x7f8d5c004d50 comp rx=0 tx=0).stop 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 1 -- 172.21.15.146:0/1704299017 shutdown_connections 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x55c442998e40 0x55c442dbdd40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442d966d0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b9590 0x55c442dc72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d437fe640 0 client.8808 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 1 --2- 172.21.15.146:0/1704299017 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b13b0 0x55c442dd6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 1 -- 172.21.15.146:0/1704299017 >> 172.21.15.146:0/1704299017 conn(0x55c4429ce3c0 msgr2=0x55c442d82110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 1 -- 172.21.15.146:0/1704299017 shutdown_connections 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 1 -- 172.21.15.146:0/1704299017 wait complete. 2024-09-17T03:41:14.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.807+0000 7f8d72084740 20 client.8808 trim_cache size 0 max 16384 2024-09-17T03:41:14.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.825+0000 7f8d72084740 1 Processor -- start 2024-09-17T03:41:14.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.825+0000 7f8d72084740 1 -- start start 2024-09-17T03:41:14.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.826+0000 7f8d72084740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b13b0 0x55c442dc6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.826+0000 7f8d72084740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b9590 0x55c442d822e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.826+0000 7f8d72084740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442de8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.826+0000 7f8d72084740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8d64201450 con 0x55c4429da270 2024-09-17T03:41:14.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d72084740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d641554d0 con 0x55c4429b13b0 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d72084740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8d641f9aa0 con 0x55c4429b9590 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d695d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442de8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d695d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442de8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33520/0 (socket says 172.21.15.146:33520) 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d695d5640 1 -- 172.21.15.146:0/694349072 learned_addr learned my addr 172.21.15.146:0/694349072 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d63fff640 1 --2- 172.21.15.146:0/694349072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b9590 0x55c442d822e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d68dd4640 1 --2- 172.21.15.146:0/694349072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b13b0 0x55c442dc6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d695d5640 1 -- 172.21.15.146:0/694349072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b9590 msgr2=0x55c442d822e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d695d5640 1 --2- 172.21.15.146:0/694349072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b9590 0x55c442d822e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d695d5640 1 -- 172.21.15.146:0/694349072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b13b0 msgr2=0x55c442dc6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d695d5640 1 --2- 172.21.15.146:0/694349072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b13b0 0x55c442dc6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d695d5640 1 -- 172.21.15.146:0/694349072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c442dc8230 con 0x55c4429da270 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d68dd4640 1 --2- 172.21.15.146:0/694349072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b13b0 0x55c442dc6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:14.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d695d5640 1 --2- 172.21.15.146:0/694349072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442de8c10 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0078e0 tx=0x7f8d5c001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5459475d9154d6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d49ffb640 1 -- 172.21.15.146:0/694349072 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c021070 con 0x55c4429da270 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d49ffb640 1 -- 172.21.15.146:0/694349072 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d5c004dc0 con 0x55c4429da270 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.827+0000 7f8d49ffb640 1 -- 172.21.15.146:0/694349072 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c018040 con 0x55c4429da270 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.828+0000 7f8d72084740 1 -- 172.21.15.146:0/694349072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 msgr2=0x55c442de8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.828+0000 7f8d72084740 1 --2- 172.21.15.146:0/694349072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442de8c10 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0078e0 tx=0x7f8d5c001980 comp rx=0 tx=0).stop 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.828+0000 7f8d72084740 1 -- 172.21.15.146:0/694349072 shutdown_connections 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.828+0000 7f8d72084740 1 --2- 172.21.15.146:0/694349072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442de8c10 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.828+0000 7f8d72084740 1 --2- 172.21.15.146:0/694349072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b9590 0x55c442d822e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.828+0000 7f8d72084740 1 --2- 172.21.15.146:0/694349072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b13b0 0x55c442dc6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.828+0000 7f8d72084740 1 -- 172.21.15.146:0/694349072 >> 172.21.15.146:0/694349072 conn(0x55c4429ce3c0 msgr2=0x55c442dea190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.828+0000 7f8d72084740 1 -- 172.21.15.146:0/694349072 shutdown_connections 2024-09-17T03:41:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.828+0000 7f8d72084740 1 -- 172.21.15.146:0/694349072 wait complete. 2024-09-17T03:41:14.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.829+0000 7f8d72084740 1 -- start start 2024-09-17T03:41:14.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.829+0000 7f8d72084740 1 Processor -- start 2024-09-17T03:41:14.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.830+0000 7f8d72084740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b13b0 0x55c442e2f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.830+0000 7f8d72084740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b9590 0x55c442d96680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.830+0000 7f8d72084740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442dddb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.830+0000 7f8d72084740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c442dd98a0 con 0x55c4429da270 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.830+0000 7f8d72084740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c442dd6700 con 0x55c4429b9590 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.830+0000 7f8d72084740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c442d96f10 con 0x55c4429b13b0 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.830+0000 7f8d72084740 10 client.0 _ll_register_callbacks cb 0x7f8d5c016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d695d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442dddb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d695d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442dddb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33530/0 (socket says 172.21.15.146:33530) 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d695d5640 1 -- 172.21.15.146:0/3668608823 learned_addr learned my addr 172.21.15.146:0/3668608823 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d68dd4640 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b13b0 0x55c442e2f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d63fff640 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b9590 0x55c442d96680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d695d5640 1 -- 172.21.15.146:0/3668608823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b13b0 msgr2=0x55c442e2f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d695d5640 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b13b0 0x55c442e2f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d695d5640 1 -- 172.21.15.146:0/3668608823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b9590 msgr2=0x55c442d96680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d695d5640 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b9590 0x55c442d96680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d695d5640 1 -- 172.21.15.146:0/3668608823 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c442de8d90 con 0x55c4429da270 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d695d5640 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442dddb90 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c000f60 tx=0x7f8d5c004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3c218f38908ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d437fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d437fe640 1 -- 172.21.15.146:0/3668608823 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c033020 con 0x55c4429da270 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d437fe640 1 -- 172.21.15.146:0/3668608823 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f8d5c013a70 con 0x55c4429da270 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d72084740 1 -- 172.21.15.146:0/3668608823 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d5c004dc0 con 0x55c4429da270 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d437fe640 1 -- 172.21.15.146:0/3668608823 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f8d5c03d050 con 0x55c4429da270 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d72084740 10 client.8814 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.831+0000 7f8d72084740 1 -- 172.21.15.146:0/3668608823 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x55c442dde0d0 con 0x55c4429da270 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.832+0000 7f8d437fe640 1 -- 172.21.15.146:0/3668608823 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d5c004dc0 con 0x55c4429da270 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.832+0000 7f8d437fe640 1 -- 172.21.15.146:0/3668608823 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f8d5c040020 con 0x55c4429da270 2024-09-17T03:41:14.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.832+0000 7f8d72084740 10 client.8814 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.832+0000 7f8d72084740 10 client.8814 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.832+0000 7f8d72084740 20 client.8814 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.832+0000 7f8d72084740 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x55c442d82740 0x55c442da8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.832+0000 7f8d72084740 4 client.8814 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.832+0000 7f8d72084740 1 -- 172.21.15.146:0/3668608823 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "status"}) -- 0x55c442cf2220 con 0x55c442d82740 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.832+0000 7f8d68dd4640 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x55c442d82740 0x55c442da8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.832+0000 7f8d437fe640 10 client.8814 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.832+0000 7f8d68dd4640 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x55c442d82740 0x55c442da8a70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc5b31359cb2da server_cookie=eb78ce196266638b in_seq=0 out_seq=0 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d437fe640 1 -- 172.21.15.146:0/3668608823 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55c442cf2220 con 0x55c442d82740 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d437fe640 10 client.8814 handle_command_reply: tid=0 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 1 client.8814 shutdown 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 1 -- 172.21.15.146:0/3668608823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 msgr2=0x55c442dddb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442dddb90 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c000f60 tx=0x7f8d5c004620 comp rx=0 tx=0).stop 2024-09-17T03:41:14.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 1 -- 172.21.15.146:0/3668608823 shutdown_connections 2024-09-17T03:41:14.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x55c442d82740 0x55c442da8a70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4429da270 0x55c442dddb90 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c4429b9590 0x55c442d96680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d437fe640 0 client.8814 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:14.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 1 --2- 172.21.15.146:0/3668608823 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c4429b13b0 0x55c442e2f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 1 -- 172.21.15.146:0/3668608823 >> 172.21.15.146:0/3668608823 conn(0x55c4429ce3c0 msgr2=0x55c442dc6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:14.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 1 -- 172.21.15.146:0/3668608823 shutdown_connections 2024-09-17T03:41:14.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 1 -- 172.21.15.146:0/3668608823 wait complete. 2024-09-17T03:41:14.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d72084740 20 client.8814 trim_cache size 0 max 16384 2024-09-17T03:41:14.837 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 8658, 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.16602395, 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 95, 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 130, 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 130, 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 14.808470442000001 2024-09-17T03:41:14.838 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:41:14.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d6b038640 1 -- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d50078b90 msgr2=0x7f8d5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d6b038640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d50078b90 0x7f8d5007b0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8d54006fd0 tx=0x7f8d54006bc0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d6b038640 1 -- 172.21.15.146:0/766664511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d640cdc50 msgr2=0x7f8d641e3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.833+0000 7f8d6b038640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d640cdc50 0x7f8d641e3eb0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f8d5802aff0 tx=0x7f8d58003f90 comp rx=0 tx=0).stop 2024-09-17T03:41:14.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.834+0000 7f8d6b038640 1 -- 172.21.15.146:0/766664511 shutdown_connections 2024-09-17T03:41:14.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.834+0000 7f8d6b038640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d50078b90 0x7f8d5007b0a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.834+0000 7f8d6b038640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d6415c8e0 0x7f8d6415a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.834+0000 7f8d6b038640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d640cdc50 0x7f8d641e3eb0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.834+0000 7f8d6b038640 1 --2- 172.21.15.146:0/766664511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d640cd840 0x7f8d64143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.834+0000 7f8d6b038640 1 -- 172.21.15.146:0/766664511 >> 172.21.15.146:0/766664511 conn(0x7f8d640b3150 msgr2=0x7f8d6415b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:14.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.834+0000 7f8d6b038640 1 -- 172.21.15.146:0/766664511 shutdown_connections 2024-09-17T03:41:14.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.834+0000 7f8d6b038640 1 -- 172.21.15.146:0/766664511 wait complete. 2024-09-17T03:41:14.844 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:41:14.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.959+0000 7fdb3d271640 1 -- 172.21.15.146:0/1375587046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb38153af0 msgr2=0x7fdb3815ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.959+0000 7fdb3d271640 1 --2- 172.21.15.146:0/1375587046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb38153af0 0x7fdb3815ce70 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fdb38072fa0 tx=0x7fdb2802a560 comp rx=0 tx=0).stop 2024-09-17T03:41:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.959+0000 7fdb3d271640 1 -- 172.21.15.146:0/1375587046 shutdown_connections 2024-09-17T03:41:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.959+0000 7fdb3d271640 1 --2- 172.21.15.146:0/1375587046 >> v2:172.21.15.179:3300/0 conn(0x7fdb380cdf10 0x7fdb380734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.959+0000 7fdb3d271640 1 --2- 172.21.15.146:0/1375587046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb38153af0 0x7fdb3815ce70 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.959+0000 7fdb3d271640 1 -- 172.21.15.146:0/1375587046 >> 172.21.15.146:0/1375587046 conn(0x7fdb380b3410 msgr2=0x7fdb380b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.959+0000 7fdb3d271640 1 -- 172.21.15.146:0/1375587046 shutdown_connections 2024-09-17T03:41:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.959+0000 7fdb3d271640 1 -- 172.21.15.146:0/1375587046 wait complete. 2024-09-17T03:41:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.961+0000 7fdb3d271640 1 Processor -- start 2024-09-17T03:41:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.961+0000 7fdb3d271640 1 -- start start 2024-09-17T03:41:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.962+0000 7fdb3d271640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb38073a30 0x7fdb381f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.962+0000 7fdb3d271640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb380cdf10 0x7fdb381f0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.962+0000 7fdb3d271640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb38153af0 0x7fdb381596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.962+0000 7fdb3d271640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdb38160bc0 con 0x7fdb380cdf10 2024-09-17T03:41:14.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.962+0000 7fdb3d271640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdb380d0b50 con 0x7fdb38073a30 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.962+0000 7fdb3d271640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdb38160d40 con 0x7fdb38153af0 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.962+0000 7fdb2ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb380cdf10 0x7fdb381f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.962+0000 7fdb2ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb380cdf10 0x7fdb381f0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33542/0 (socket says 172.21.15.146:33542) 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.962+0000 7fdb2ffff640 1 -- 172.21.15.146:0/2125394995 learned_addr learned my addr 172.21.15.146:0/2125394995 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.962+0000 7fdb377fe640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb38153af0 0x7fdb381596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.962+0000 7fdb36ffd640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb38073a30 0x7fdb381f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.963+0000 7fdb2ffff640 1 -- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb38153af0 msgr2=0x7fdb381596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.963+0000 7fdb2ffff640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb38153af0 0x7fdb381596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.963+0000 7fdb2ffff640 1 -- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb38073a30 msgr2=0x7fdb381f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.963+0000 7fdb2ffff640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb38073a30 0x7fdb381f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.963+0000 7fdb2ffff640 1 -- 172.21.15.146:0/2125394995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb38157580 con 0x7fdb380cdf10 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.963+0000 7fdb2ffff640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb380cdf10 0x7fdb381f0930 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c970 tx=0x7fdb2000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.963+0000 7fdb2f7fe640 1 -- 172.21.15.146:0/2125394995 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20007bb0 con 0x7fdb380cdf10 2024-09-17T03:41:14.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.963+0000 7fdb2f7fe640 1 -- 172.21.15.146:0/2125394995 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb20005020 con 0x7fdb380cdf10 2024-09-17T03:41:14.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.963+0000 7fdb3d271640 1 -- 172.21.15.146:0/2125394995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb38157a80 con 0x7fdb380cdf10 2024-09-17T03:41:14.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.963+0000 7fdb2f7fe640 1 -- 172.21.15.146:0/2125394995 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb20007e60 con 0x7fdb380cdf10 2024-09-17T03:41:14.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.963+0000 7fdb3d271640 1 -- 172.21.15.146:0/2125394995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb38158040 con 0x7fdb380cdf10 2024-09-17T03:41:14.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.964+0000 7fdb3d271640 1 -- 172.21.15.146:0/2125394995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb381577f0 con 0x7fdb380cdf10 2024-09-17T03:41:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.965+0000 7fdb2f7fe640 1 -- 172.21.15.146:0/2125394995 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdb20005470 con 0x7fdb380cdf10 2024-09-17T03:41:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.965+0000 7fdb2f7fe640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb18078bc0 0x7fdb1807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.965+0000 7fdb2f7fe640 1 -- 172.21.15.146:0/2125394995 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fdb2009b020 con 0x7fdb380cdf10 2024-09-17T03:41:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.966+0000 7fdb36ffd640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb18078bc0 0x7fdb1807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.966+0000 7fdb36ffd640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb18078bc0 0x7fdb1807b0d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdb28033000 tx=0x7fdb28004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:14.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:14.970+0000 7fdb2f7fe640 1 -- 172.21.15.146:0/2125394995 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdb20014030 con 0x7fdb380cdf10 2024-09-17T03:41:15.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.180+0000 7fdb3d271640 1 -- 172.21.15.146:0/2125394995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdb38161230 con 0x7fdb380cdf10 2024-09-17T03:41:15.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.180+0000 7fdb2f7fe640 1 -- 172.21.15.146:0/2125394995 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v95) ==== 53+0+73 (secure 0 0 0) 0x7fdb20062f30 con 0x7fdb380cdf10 2024-09-17T03:41:15.180 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:41:15.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.182+0000 7fdb3d271640 1 -- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb18078bc0 msgr2=0x7fdb1807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:15.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.182+0000 7fdb3d271640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb18078bc0 0x7fdb1807b0d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdb28033000 tx=0x7fdb28004730 comp rx=0 tx=0).stop 2024-09-17T03:41:15.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.182+0000 7fdb3d271640 1 -- 172.21.15.146:0/2125394995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb380cdf10 msgr2=0x7fdb381f0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:15.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.182+0000 7fdb3d271640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb380cdf10 0x7fdb381f0930 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c970 tx=0x7fdb2000ce30 comp rx=0 tx=0).stop 2024-09-17T03:41:15.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.183+0000 7fdb3d271640 1 -- 172.21.15.146:0/2125394995 shutdown_connections 2024-09-17T03:41:15.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.183+0000 7fdb3d271640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb18078bc0 0x7fdb1807b0d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:15.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.183+0000 7fdb3d271640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdb38153af0 0x7fdb381596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:15.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.183+0000 7fdb3d271640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb380cdf10 0x7fdb381f0930 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.183+0000 7fdb3d271640 1 --2- 172.21.15.146:0/2125394995 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdb38073a30 0x7fdb381f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.183+0000 7fdb3d271640 1 -- 172.21.15.146:0/2125394995 >> 172.21.15.146:0/2125394995 conn(0x7fdb380b3410 msgr2=0x7fdb380d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.183+0000 7fdb3d271640 1 -- 172.21.15.146:0/2125394995 shutdown_connections 2024-09-17T03:41:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15.183+0000 7fdb3d271640 1 -- 172.21.15.146:0/2125394995 wait complete. 2024-09-17T03:41:15.193 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:41:15.193 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:41:15.193 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:41:15.193 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:41:15.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:41:15.193 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:41:15.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:41:15.193 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:41:15.193 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:41:15.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.194 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:41:15.210 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:41:15.210 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:41:15.210 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:41:15.210 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:41:15.211 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42297sec preferred_lft 42297sec 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:41:15.212 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:41:15.213 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:41:15.213 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:41:15.213 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:41:15.213 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:41:15.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.213 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:41:15.273 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:41:15.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.276 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:41:15.333 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:41:15.333 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:41:15.334 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:41:15.334 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:41:15.334 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:41:15.334 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:41:15.334 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:15.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:41:15.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:41:15.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:41:15.334 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:15.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:41:15.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:15.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.461 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:41:15.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:41:15.476 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:41:15.476 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:41:15.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.477 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:41:15.541 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:41:15.542 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:41:15.597 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:41:15.597 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:41:15.597 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:41:15.653 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:41:15.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.653 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:41:15.747 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:41:15.748 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:41:15.748 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:41:15.759 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:41:15.759 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:41:15.759 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:41:15.759 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:41:15.759 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:41:15.764 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:41:15.764 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:41:15.765 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:41:15.765 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:41:15.765 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:41:15.765 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:41:15.765 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:41:15.765 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:41:15.765 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:41:15.765 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:41:15.765 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:41:15.766 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:41:15.766 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:41:15.767 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:41:15.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:15.767 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:41:15.792 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:41:15.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:15.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:15.894 INFO:teuthology.orchestra.run.smithi146.stdout:client8823 2024-09-17T03:41:15.894 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:41:15.894 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:15.910 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-17T03:41:15.910 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-09-17T03:41:15.910 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:15.910 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:15.910 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.0 2024-09-17T03:41:15.910 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:15.911 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:15.911 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:15.911 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:15.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.020 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100553 s, 104 MB/s 2024-09-17T03:41:16.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833098 s, 126 MB/s 2024-09-17T03:41:16.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.038 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635599 s, 165 MB/s 2024-09-17T03:41:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695774 s, 151 MB/s 2024-09-17T03:41:16.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.055 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737953 s, 142 MB/s 2024-09-17T03:41:16.063 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.063 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.063 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641157 s, 164 MB/s 2024-09-17T03:41:16.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.072 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654796 s, 160 MB/s 2024-09-17T03:41:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755414 s, 139 MB/s 2024-09-17T03:41:16.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.091 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796541 s, 132 MB/s 2024-09-17T03:41:16.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.098 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601894 s, 174 MB/s 2024-09-17T03:41:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.106 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582175 s, 180 MB/s 2024-09-17T03:41:16.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.116 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778477 s, 135 MB/s 2024-09-17T03:41:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.124 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705689 s, 149 MB/s 2024-09-17T03:41:16.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.134 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724394 s, 145 MB/s 2024-09-17T03:41:16.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.143 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837189 s, 125 MB/s 2024-09-17T03:41:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.153 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838968 s, 125 MB/s 2024-09-17T03:41:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720389 s, 146 MB/s 2024-09-17T03:41:16.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.171 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689947 s, 152 MB/s 2024-09-17T03:41:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697866 s, 150 MB/s 2024-09-17T03:41:16.187 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.188 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605229 s, 173 MB/s 2024-09-17T03:41:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.196 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640262 s, 164 MB/s 2024-09-17T03:41:16.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.205 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778379 s, 135 MB/s 2024-09-17T03:41:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.214 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687583 s, 153 MB/s 2024-09-17T03:41:16.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.223 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.223 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710299 s, 148 MB/s 2024-09-17T03:41:16.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782123 s, 134 MB/s 2024-09-17T03:41:16.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712926 s, 147 MB/s 2024-09-17T03:41:16.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.249 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700315 s, 150 MB/s 2024-09-17T03:41:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777932 s, 135 MB/s 2024-09-17T03:41:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633313 s, 166 MB/s 2024-09-17T03:41:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638931 s, 164 MB/s 2024-09-17T03:41:16.284 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.285 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075407 s, 139 MB/s 2024-09-17T03:41:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00814205 s, 129 MB/s 2024-09-17T03:41:16.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:16.301 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:16.301 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:16.301 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.1 2024-09-17T03:41:16.301 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:16.301 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:16.301 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:16.302 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:16.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757097 s, 138 MB/s 2024-09-17T03:41:16.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707026 s, 148 MB/s 2024-09-17T03:41:16.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007511 s, 140 MB/s 2024-09-17T03:41:16.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671577 s, 156 MB/s 2024-09-17T03:41:16.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645767 s, 162 MB/s 2024-09-17T03:41:16.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.405 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700218 s, 150 MB/s 2024-09-17T03:41:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585764 s, 179 MB/s 2024-09-17T03:41:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.421 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662497 s, 158 MB/s 2024-09-17T03:41:16.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.429 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068162 s, 154 MB/s 2024-09-17T03:41:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677896 s, 155 MB/s 2024-09-17T03:41:16.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.447 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738318 s, 142 MB/s 2024-09-17T03:41:16.455 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695615 s, 151 MB/s 2024-09-17T03:41:16.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.463 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609446 s, 172 MB/s 2024-09-17T03:41:16.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.472 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677328 s, 155 MB/s 2024-09-17T03:41:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.481 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720383 s, 146 MB/s 2024-09-17T03:41:16.489 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.489 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.489 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649426 s, 161 MB/s 2024-09-17T03:41:16.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.497 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631776 s, 166 MB/s 2024-09-17T03:41:16.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682496 s, 154 MB/s 2024-09-17T03:41:16.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.514 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067987 s, 154 MB/s 2024-09-17T03:41:16.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.523 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674112 s, 156 MB/s 2024-09-17T03:41:16.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675753 s, 155 MB/s 2024-09-17T03:41:16.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.539 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654768 s, 160 MB/s 2024-09-17T03:41:16.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075334 s, 139 MB/s 2024-09-17T03:41:16.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.558 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782428 s, 134 MB/s 2024-09-17T03:41:16.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.567 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764892 s, 137 MB/s 2024-09-17T03:41:16.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.576 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725652 s, 145 MB/s 2024-09-17T03:41:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737342 s, 142 MB/s 2024-09-17T03:41:16.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.594 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685597 s, 153 MB/s 2024-09-17T03:41:16.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.603 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691988 s, 152 MB/s 2024-09-17T03:41:16.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.612 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725842 s, 144 MB/s 2024-09-17T03:41:16.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.620 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658566 s, 159 MB/s 2024-09-17T03:41:16.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.629 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673206 s, 156 MB/s 2024-09-17T03:41:16.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:16.635 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:16.635 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:16.635 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.2 2024-09-17T03:41:16.635 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:16.635 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:16.635 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:16.635 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:16.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744485 s, 141 MB/s 2024-09-17T03:41:16.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.703 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059151 s, 177 MB/s 2024-09-17T03:41:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689181 s, 152 MB/s 2024-09-17T03:41:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.720 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659474 s, 159 MB/s 2024-09-17T03:41:16.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.727 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592839 s, 177 MB/s 2024-09-17T03:41:16.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.736 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649876 s, 161 MB/s 2024-09-17T03:41:16.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642693 s, 163 MB/s 2024-09-17T03:41:16.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.752 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067588 s, 155 MB/s 2024-09-17T03:41:16.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621364 s, 169 MB/s 2024-09-17T03:41:16.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573242 s, 183 MB/s 2024-09-17T03:41:16.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.776 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632572 s, 166 MB/s 2024-09-17T03:41:16.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.784 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636206 s, 165 MB/s 2024-09-17T03:41:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.792 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597176 s, 176 MB/s 2024-09-17T03:41:16.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630361 s, 166 MB/s 2024-09-17T03:41:16.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.809 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781535 s, 134 MB/s 2024-09-17T03:41:16.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667667 s, 157 MB/s 2024-09-17T03:41:16.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.826 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648884 s, 162 MB/s 2024-09-17T03:41:16.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.834 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674765 s, 155 MB/s 2024-09-17T03:41:16.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666731 s, 157 MB/s 2024-09-17T03:41:16.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667263 s, 157 MB/s 2024-09-17T03:41:16.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.859 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663024 s, 158 MB/s 2024-09-17T03:41:16.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.868 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746466 s, 140 MB/s 2024-09-17T03:41:16.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680578 s, 154 MB/s 2024-09-17T03:41:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656667 s, 160 MB/s 2024-09-17T03:41:16.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.893 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583462 s, 180 MB/s 2024-09-17T03:41:16.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683851 s, 153 MB/s 2024-09-17T03:41:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621285 s, 169 MB/s 2024-09-17T03:41:16.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.919 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761105 s, 138 MB/s 2024-09-17T03:41:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733097 s, 143 MB/s 2024-09-17T03:41:16.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.936 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635496 s, 165 MB/s 2024-09-17T03:41:16.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.945 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070336 s, 149 MB/s 2024-09-17T03:41:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668587 s, 157 MB/s 2024-09-17T03:41:16.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:16.959 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:16.959 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:16.960 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.3 2024-09-17T03:41:16.960 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:16.960 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:16.960 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:16.960 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:17.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:17.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.019 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689505 s, 152 MB/s 2024-09-17T03:41:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638814 s, 164 MB/s 2024-09-17T03:41:17.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.035 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672829 s, 156 MB/s 2024-09-17T03:41:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065689 s, 160 MB/s 2024-09-17T03:41:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737219 s, 142 MB/s 2024-09-17T03:41:17.060 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.060 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.060 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620221 s, 169 MB/s 2024-09-17T03:41:17.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.068 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582346 s, 180 MB/s 2024-09-17T03:41:17.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674981 s, 155 MB/s 2024-09-17T03:41:17.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.085 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065355 s, 160 MB/s 2024-09-17T03:41:17.094 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.094 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.094 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736048 s, 142 MB/s 2024-09-17T03:41:17.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620136 s, 169 MB/s 2024-09-17T03:41:17.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.111 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646331 s, 162 MB/s 2024-09-17T03:41:17.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.118 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603425 s, 174 MB/s 2024-09-17T03:41:17.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654386 s, 160 MB/s 2024-09-17T03:41:17.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.135 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596287 s, 176 MB/s 2024-09-17T03:41:17.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072727 s, 144 MB/s 2024-09-17T03:41:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645609 s, 162 MB/s 2024-09-17T03:41:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.161 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740392 s, 142 MB/s 2024-09-17T03:41:17.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641556 s, 163 MB/s 2024-09-17T03:41:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626849 s, 167 MB/s 2024-09-17T03:41:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735168 s, 143 MB/s 2024-09-17T03:41:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630698 s, 166 MB/s 2024-09-17T03:41:17.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.203 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669379 s, 157 MB/s 2024-09-17T03:41:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652905 s, 161 MB/s 2024-09-17T03:41:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636265 s, 165 MB/s 2024-09-17T03:41:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688751 s, 152 MB/s 2024-09-17T03:41:17.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.237 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721135 s, 145 MB/s 2024-09-17T03:41:17.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654085 s, 160 MB/s 2024-09-17T03:41:17.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655011 s, 160 MB/s 2024-09-17T03:41:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.261 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060019 s, 175 MB/s 2024-09-17T03:41:17.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.270 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738715 s, 142 MB/s 2024-09-17T03:41:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066488 s, 158 MB/s 2024-09-17T03:41:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:17.285 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:17.285 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:17.285 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.4 2024-09-17T03:41:17.285 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:17.285 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:17.285 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:17.286 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:17.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777422 s, 135 MB/s 2024-09-17T03:41:17.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.353 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670727 s, 156 MB/s 2024-09-17T03:41:17.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715144 s, 147 MB/s 2024-09-17T03:41:17.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598193 s, 175 MB/s 2024-09-17T03:41:17.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762074 s, 138 MB/s 2024-09-17T03:41:17.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643456 s, 163 MB/s 2024-09-17T03:41:17.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679979 s, 154 MB/s 2024-09-17T03:41:17.403 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.403 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.403 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616069 s, 170 MB/s 2024-09-17T03:41:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772925 s, 136 MB/s 2024-09-17T03:41:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742591 s, 141 MB/s 2024-09-17T03:41:17.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.432 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728908 s, 144 MB/s 2024-09-17T03:41:17.439 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.439 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.439 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634939 s, 165 MB/s 2024-09-17T03:41:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.448 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732201 s, 143 MB/s 2024-09-17T03:41:17.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.457 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645414 s, 162 MB/s 2024-09-17T03:41:17.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.465 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633833 s, 165 MB/s 2024-09-17T03:41:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724717 s, 145 MB/s 2024-09-17T03:41:17.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.481 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060357 s, 174 MB/s 2024-09-17T03:41:17.489 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.489 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.489 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632039 s, 166 MB/s 2024-09-17T03:41:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721771 s, 145 MB/s 2024-09-17T03:41:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588522 s, 178 MB/s 2024-09-17T03:41:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652197 s, 161 MB/s 2024-09-17T03:41:17.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643072 s, 163 MB/s 2024-09-17T03:41:17.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650332 s, 161 MB/s 2024-09-17T03:41:17.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.539 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640136 s, 164 MB/s 2024-09-17T03:41:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626585 s, 167 MB/s 2024-09-17T03:41:17.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740558 s, 142 MB/s 2024-09-17T03:41:17.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.564 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634155 s, 165 MB/s 2024-09-17T03:41:17.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.573 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736037 s, 142 MB/s 2024-09-17T03:41:17.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729332 s, 144 MB/s 2024-09-17T03:41:17.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615041 s, 170 MB/s 2024-09-17T03:41:17.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671761 s, 156 MB/s 2024-09-17T03:41:17.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.607 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.607 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607371 s, 173 MB/s 2024-09-17T03:41:17.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:17.613 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:17.614 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:17.614 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.5 2024-09-17T03:41:17.614 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:17.614 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:17.614 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:17.615 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744037 s, 141 MB/s 2024-09-17T03:41:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.683 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643104 s, 163 MB/s 2024-09-17T03:41:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.692 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675905 s, 155 MB/s 2024-09-17T03:41:17.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.700 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666691 s, 157 MB/s 2024-09-17T03:41:17.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.708 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061782 s, 170 MB/s 2024-09-17T03:41:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.716 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659272 s, 159 MB/s 2024-09-17T03:41:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.725 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725485 s, 145 MB/s 2024-09-17T03:41:17.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.734 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651383 s, 161 MB/s 2024-09-17T03:41:17.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.742 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742057 s, 141 MB/s 2024-09-17T03:41:17.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.751 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.751 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656901 s, 160 MB/s 2024-09-17T03:41:17.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743935 s, 141 MB/s 2024-09-17T03:41:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072687 s, 144 MB/s 2024-09-17T03:41:17.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.777 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664275 s, 158 MB/s 2024-09-17T03:41:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675845 s, 155 MB/s 2024-09-17T03:41:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730511 s, 144 MB/s 2024-09-17T03:41:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597965 s, 175 MB/s 2024-09-17T03:41:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677273 s, 155 MB/s 2024-09-17T03:41:17.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582545 s, 180 MB/s 2024-09-17T03:41:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741434 s, 141 MB/s 2024-09-17T03:41:17.835 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.835 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615416 s, 170 MB/s 2024-09-17T03:41:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673288 s, 156 MB/s 2024-09-17T03:41:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745109 s, 141 MB/s 2024-09-17T03:41:17.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713367 s, 147 MB/s 2024-09-17T03:41:17.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.870 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643109 s, 163 MB/s 2024-09-17T03:41:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696322 s, 151 MB/s 2024-09-17T03:41:17.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781127 s, 134 MB/s 2024-09-17T03:41:17.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067732 s, 155 MB/s 2024-09-17T03:41:17.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595455 s, 176 MB/s 2024-09-17T03:41:17.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749521 s, 140 MB/s 2024-09-17T03:41:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732897 s, 143 MB/s 2024-09-17T03:41:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628331 s, 167 MB/s 2024-09-17T03:41:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:17.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:17.940 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666192 s, 157 MB/s 2024-09-17T03:41:17.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:17.946 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:17.946 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:17.946 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.6 2024-09-17T03:41:17.946 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:17.946 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:17.946 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:17.947 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:17.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594119 s, 176 MB/s 2024-09-17T03:41:18.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.014 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692793 s, 151 MB/s 2024-09-17T03:41:18.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.022 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676357 s, 155 MB/s 2024-09-17T03:41:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.031 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750217 s, 140 MB/s 2024-09-17T03:41:18.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745727 s, 141 MB/s 2024-09-17T03:41:18.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.049 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676009 s, 155 MB/s 2024-09-17T03:41:18.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.057 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634541 s, 165 MB/s 2024-09-17T03:41:18.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624586 s, 168 MB/s 2024-09-17T03:41:18.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.073 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606886 s, 173 MB/s 2024-09-17T03:41:18.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.081 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648082 s, 162 MB/s 2024-09-17T03:41:18.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.090 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646747 s, 162 MB/s 2024-09-17T03:41:18.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.097 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582162 s, 180 MB/s 2024-09-17T03:41:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.106 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075912 s, 138 MB/s 2024-09-17T03:41:18.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.114 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694581 s, 151 MB/s 2024-09-17T03:41:18.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.123 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663423 s, 158 MB/s 2024-09-17T03:41:18.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638736 s, 164 MB/s 2024-09-17T03:41:18.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.139 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621952 s, 169 MB/s 2024-09-17T03:41:18.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.148 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729045 s, 144 MB/s 2024-09-17T03:41:18.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599503 s, 175 MB/s 2024-09-17T03:41:18.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.165 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730649 s, 144 MB/s 2024-09-17T03:41:18.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.174 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681887 s, 154 MB/s 2024-09-17T03:41:18.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.182 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659 s, 159 MB/s 2024-09-17T03:41:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624575 s, 168 MB/s 2024-09-17T03:41:18.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.199 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735925 s, 142 MB/s 2024-09-17T03:41:18.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.207 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658898 s, 159 MB/s 2024-09-17T03:41:18.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.215 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065767 s, 159 MB/s 2024-09-17T03:41:18.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.224 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730514 s, 144 MB/s 2024-09-17T03:41:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770253 s, 136 MB/s 2024-09-17T03:41:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.242 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652759 s, 161 MB/s 2024-09-17T03:41:18.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728964 s, 144 MB/s 2024-09-17T03:41:18.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.258 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585816 s, 179 MB/s 2024-09-17T03:41:18.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.266 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669735 s, 157 MB/s 2024-09-17T03:41:18.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:18.273 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:18.273 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:18.273 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.7 2024-09-17T03:41:18.273 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:18.273 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:18.273 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:18.273 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:18.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:18.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.332 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734236 s, 143 MB/s 2024-09-17T03:41:18.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.340 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601899 s, 174 MB/s 2024-09-17T03:41:18.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.349 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768835 s, 136 MB/s 2024-09-17T03:41:18.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.357 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618789 s, 169 MB/s 2024-09-17T03:41:18.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.366 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691869 s, 152 MB/s 2024-09-17T03:41:18.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.375 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763681 s, 137 MB/s 2024-09-17T03:41:18.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.383 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593751 s, 177 MB/s 2024-09-17T03:41:18.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.392 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072577 s, 144 MB/s 2024-09-17T03:41:18.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.400 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654145 s, 160 MB/s 2024-09-17T03:41:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646466 s, 162 MB/s 2024-09-17T03:41:18.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.417 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678053 s, 155 MB/s 2024-09-17T03:41:18.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072839 s, 144 MB/s 2024-09-17T03:41:18.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727687 s, 144 MB/s 2024-09-17T03:41:18.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745862 s, 141 MB/s 2024-09-17T03:41:18.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062061 s, 169 MB/s 2024-09-17T03:41:18.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.460 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670754 s, 156 MB/s 2024-09-17T03:41:18.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.469 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727597 s, 144 MB/s 2024-09-17T03:41:18.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.477 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633989 s, 165 MB/s 2024-09-17T03:41:18.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075066 s, 140 MB/s 2024-09-17T03:41:18.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.497 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751496 s, 140 MB/s 2024-09-17T03:41:18.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.505 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731721 s, 143 MB/s 2024-09-17T03:41:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611309 s, 172 MB/s 2024-09-17T03:41:18.521 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.521 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.521 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629577 s, 167 MB/s 2024-09-17T03:41:18.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.530 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723005 s, 145 MB/s 2024-09-17T03:41:18.538 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.538 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.539 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704016 s, 149 MB/s 2024-09-17T03:41:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661256 s, 159 MB/s 2024-09-17T03:41:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.555 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663308 s, 158 MB/s 2024-09-17T03:41:18.563 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.563 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.563 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615875 s, 170 MB/s 2024-09-17T03:41:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.571 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585701 s, 179 MB/s 2024-09-17T03:41:18.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.580 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731413 s, 143 MB/s 2024-09-17T03:41:18.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.588 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664534 s, 158 MB/s 2024-09-17T03:41:18.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719226 s, 146 MB/s 2024-09-17T03:41:18.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:18.604 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:18.604 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:18.604 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.8 2024-09-17T03:41:18.604 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:18.604 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:18.604 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:18.604 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:18.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:18.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.663 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732662 s, 143 MB/s 2024-09-17T03:41:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007388 s, 142 MB/s 2024-09-17T03:41:18.680 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.680 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.680 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618953 s, 169 MB/s 2024-09-17T03:41:18.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.688 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656787 s, 160 MB/s 2024-09-17T03:41:18.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653463 s, 160 MB/s 2024-09-17T03:41:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.705 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623591 s, 168 MB/s 2024-09-17T03:41:18.713 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.713 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.713 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663585 s, 158 MB/s 2024-09-17T03:41:18.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.722 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726193 s, 144 MB/s 2024-09-17T03:41:18.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719098 s, 146 MB/s 2024-09-17T03:41:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.739 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589573 s, 178 MB/s 2024-09-17T03:41:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.747 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670366 s, 156 MB/s 2024-09-17T03:41:18.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.756 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639364 s, 164 MB/s 2024-09-17T03:41:18.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.764 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663674 s, 158 MB/s 2024-09-17T03:41:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669698 s, 157 MB/s 2024-09-17T03:41:18.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667742 s, 157 MB/s 2024-09-17T03:41:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722729 s, 145 MB/s 2024-09-17T03:41:18.797 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.797 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.797 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619005 s, 169 MB/s 2024-09-17T03:41:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605675 s, 173 MB/s 2024-09-17T03:41:18.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.813 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670011 s, 157 MB/s 2024-09-17T03:41:18.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072057 s, 146 MB/s 2024-09-17T03:41:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733753 s, 143 MB/s 2024-09-17T03:41:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652828 s, 161 MB/s 2024-09-17T03:41:18.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696209 s, 151 MB/s 2024-09-17T03:41:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078909 s, 133 MB/s 2024-09-17T03:41:18.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140934 s, 74.4 MB/s 2024-09-17T03:41:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744067 s, 141 MB/s 2024-09-17T03:41:18.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.891 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667223 s, 157 MB/s 2024-09-17T03:41:18.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.900 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678986 s, 154 MB/s 2024-09-17T03:41:18.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742328 s, 141 MB/s 2024-09-17T03:41:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.918 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734068 s, 143 MB/s 2024-09-17T03:41:18.927 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.927 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.927 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724448 s, 145 MB/s 2024-09-17T03:41:18.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:18.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:18.936 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653158 s, 161 MB/s 2024-09-17T03:41:18.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:18.942 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:18.942 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:18.942 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.9 2024-09-17T03:41:18.942 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:18.942 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:18.942 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:18.942 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:18.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:19.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.001 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060891 s, 172 MB/s 2024-09-17T03:41:19.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.009 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669337 s, 157 MB/s 2024-09-17T03:41:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.018 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727495 s, 144 MB/s 2024-09-17T03:41:19.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664646 s, 158 MB/s 2024-09-17T03:41:19.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.036 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734338 s, 143 MB/s 2024-09-17T03:41:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665051 s, 158 MB/s 2024-09-17T03:41:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691869 s, 152 MB/s 2024-09-17T03:41:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768637 s, 136 MB/s 2024-09-17T03:41:19.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.071 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745221 s, 141 MB/s 2024-09-17T03:41:19.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065663 s, 160 MB/s 2024-09-17T03:41:19.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.089 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751058 s, 140 MB/s 2024-09-17T03:41:19.097 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.097 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.097 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654765 s, 160 MB/s 2024-09-17T03:41:19.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.106 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665532 s, 158 MB/s 2024-09-17T03:41:19.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729486 s, 144 MB/s 2024-09-17T03:41:19.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.123 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713821 s, 147 MB/s 2024-09-17T03:41:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635375 s, 165 MB/s 2024-09-17T03:41:19.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.139 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058458 s, 179 MB/s 2024-09-17T03:41:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057804 s, 181 MB/s 2024-09-17T03:41:19.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.154 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582996 s, 180 MB/s 2024-09-17T03:41:19.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.163 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066797 s, 157 MB/s 2024-09-17T03:41:19.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.171 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667118 s, 157 MB/s 2024-09-17T03:41:19.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.180 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744281 s, 141 MB/s 2024-09-17T03:41:19.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.188 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669821 s, 157 MB/s 2024-09-17T03:41:19.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737254 s, 142 MB/s 2024-09-17T03:41:19.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.206 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072482 s, 145 MB/s 2024-09-17T03:41:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.215 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658478 s, 159 MB/s 2024-09-17T03:41:19.223 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.223 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.223 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676399 s, 155 MB/s 2024-09-17T03:41:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595171 s, 176 MB/s 2024-09-17T03:41:19.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059949 s, 175 MB/s 2024-09-17T03:41:19.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.246 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632206 s, 166 MB/s 2024-09-17T03:41:19.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.255 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067632 s, 155 MB/s 2024-09-17T03:41:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612804 s, 171 MB/s 2024-09-17T03:41:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:19.269 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:19.270 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:19.270 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.10 2024-09-17T03:41:19.270 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:19.270 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:19.270 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:19.270 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:19.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:19.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.328 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666314 s, 157 MB/s 2024-09-17T03:41:19.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.337 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702278 s, 149 MB/s 2024-09-17T03:41:19.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.346 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068102 s, 154 MB/s 2024-09-17T03:41:19.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.357 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830677 s, 126 MB/s 2024-09-17T03:41:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.365 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715771 s, 146 MB/s 2024-09-17T03:41:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642279 s, 163 MB/s 2024-09-17T03:41:19.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.383 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768241 s, 136 MB/s 2024-09-17T03:41:19.390 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.391 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606073 s, 173 MB/s 2024-09-17T03:41:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.399 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688754 s, 152 MB/s 2024-09-17T03:41:19.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.407 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621837 s, 169 MB/s 2024-09-17T03:41:19.415 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.415 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.416 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664179 s, 158 MB/s 2024-09-17T03:41:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644097 s, 163 MB/s 2024-09-17T03:41:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762017 s, 138 MB/s 2024-09-17T03:41:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.441 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651978 s, 161 MB/s 2024-09-17T03:41:19.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.449 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063996 s, 164 MB/s 2024-09-17T03:41:19.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.458 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672024 s, 156 MB/s 2024-09-17T03:41:19.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.466 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645584 s, 162 MB/s 2024-09-17T03:41:19.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640147 s, 164 MB/s 2024-09-17T03:41:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.481 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596582 s, 176 MB/s 2024-09-17T03:41:19.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759993 s, 138 MB/s 2024-09-17T03:41:19.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.500 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732107 s, 143 MB/s 2024-09-17T03:41:19.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.508 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641958 s, 163 MB/s 2024-09-17T03:41:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.516 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664098 s, 158 MB/s 2024-09-17T03:41:19.525 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.525 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.525 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725991 s, 144 MB/s 2024-09-17T03:41:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601842 s, 174 MB/s 2024-09-17T03:41:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663887 s, 158 MB/s 2024-09-17T03:41:19.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.550 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640556 s, 164 MB/s 2024-09-17T03:41:19.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.558 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638552 s, 164 MB/s 2024-09-17T03:41:19.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.567 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664513 s, 158 MB/s 2024-09-17T03:41:19.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656613 s, 160 MB/s 2024-09-17T03:41:19.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608921 s, 172 MB/s 2024-09-17T03:41:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612279 s, 171 MB/s 2024-09-17T03:41:19.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:19.597 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:19.597 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:19.597 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.11 2024-09-17T03:41:19.597 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:19.597 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:19.597 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:19.597 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604436 s, 173 MB/s 2024-09-17T03:41:19.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.664 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733916 s, 143 MB/s 2024-09-17T03:41:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671585 s, 156 MB/s 2024-09-17T03:41:19.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617605 s, 170 MB/s 2024-09-17T03:41:19.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.689 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611138 s, 172 MB/s 2024-09-17T03:41:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660301 s, 159 MB/s 2024-09-17T03:41:19.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.705 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654348 s, 160 MB/s 2024-09-17T03:41:19.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.714 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676864 s, 155 MB/s 2024-09-17T03:41:19.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.723 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072786 s, 144 MB/s 2024-09-17T03:41:19.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595131 s, 176 MB/s 2024-09-17T03:41:19.738 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.738 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.738 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588833 s, 178 MB/s 2024-09-17T03:41:19.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.747 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.747 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657347 s, 160 MB/s 2024-09-17T03:41:19.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.755 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067607 s, 155 MB/s 2024-09-17T03:41:19.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.764 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735188 s, 143 MB/s 2024-09-17T03:41:19.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.772 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647201 s, 162 MB/s 2024-09-17T03:41:19.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723496 s, 145 MB/s 2024-09-17T03:41:19.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.790 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736645 s, 142 MB/s 2024-09-17T03:41:19.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.799 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730841 s, 143 MB/s 2024-09-17T03:41:19.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.807 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657837 s, 159 MB/s 2024-09-17T03:41:19.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640076 s, 164 MB/s 2024-09-17T03:41:19.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709574 s, 148 MB/s 2024-09-17T03:41:19.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.833 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640077 s, 164 MB/s 2024-09-17T03:41:19.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635035 s, 165 MB/s 2024-09-17T03:41:19.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.849 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656592 s, 160 MB/s 2024-09-17T03:41:19.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.858 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747944 s, 140 MB/s 2024-09-17T03:41:19.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645583 s, 162 MB/s 2024-09-17T03:41:19.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.875 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642125 s, 163 MB/s 2024-09-17T03:41:19.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646624 s, 162 MB/s 2024-09-17T03:41:19.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580192 s, 181 MB/s 2024-09-17T03:41:19.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728355 s, 144 MB/s 2024-09-17T03:41:19.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.908 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655049 s, 160 MB/s 2024-09-17T03:41:19.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.916 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598827 s, 175 MB/s 2024-09-17T03:41:19.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:19.922 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:19.922 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:19.922 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.12 2024-09-17T03:41:19.922 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:19.922 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:19.923 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:19.923 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:19.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:19.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.980 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615353 s, 170 MB/s 2024-09-17T03:41:19.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743067 s, 141 MB/s 2024-09-17T03:41:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655211 s, 160 MB/s 2024-09-17T03:41:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598725 s, 175 MB/s 2024-09-17T03:41:20.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.014 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070154 s, 149 MB/s 2024-09-17T03:41:20.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.022 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620379 s, 169 MB/s 2024-09-17T03:41:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833037 s, 126 MB/s 2024-09-17T03:41:20.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.043 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909152 s, 115 MB/s 2024-09-17T03:41:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640558 s, 164 MB/s 2024-09-17T03:41:20.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.061 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680597 s, 154 MB/s 2024-09-17T03:41:20.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.069 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661594 s, 158 MB/s 2024-09-17T03:41:20.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641143 s, 164 MB/s 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.087 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786217 s, 133 MB/s 2024-09-17T03:41:20.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.096 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073936 s, 142 MB/s 2024-09-17T03:41:20.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.105 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667872 s, 157 MB/s 2024-09-17T03:41:20.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.114 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692032 s, 152 MB/s 2024-09-17T03:41:20.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.123 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777526 s, 135 MB/s 2024-09-17T03:41:20.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684041 s, 153 MB/s 2024-09-17T03:41:20.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.140 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633469 s, 166 MB/s 2024-09-17T03:41:20.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655989 s, 160 MB/s 2024-09-17T03:41:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676277 s, 155 MB/s 2024-09-17T03:41:20.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677996 s, 155 MB/s 2024-09-17T03:41:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067726 s, 155 MB/s 2024-09-17T03:41:20.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063846 s, 164 MB/s 2024-09-17T03:41:20.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664121 s, 158 MB/s 2024-09-17T03:41:20.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720134 s, 146 MB/s 2024-09-17T03:41:20.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.210 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663782 s, 158 MB/s 2024-09-17T03:41:20.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663012 s, 158 MB/s 2024-09-17T03:41:20.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727644 s, 144 MB/s 2024-09-17T03:41:20.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.237 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656993 s, 160 MB/s 2024-09-17T03:41:20.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669143 s, 157 MB/s 2024-09-17T03:41:20.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649469 s, 161 MB/s 2024-09-17T03:41:20.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:20.261 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:20.261 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:20.261 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.13 2024-09-17T03:41:20.261 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:20.261 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:20.261 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:20.261 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:20.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:20.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681866 s, 154 MB/s 2024-09-17T03:41:20.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.328 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648112 s, 162 MB/s 2024-09-17T03:41:20.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.338 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766962 s, 137 MB/s 2024-09-17T03:41:20.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706767 s, 148 MB/s 2024-09-17T03:41:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692874 s, 151 MB/s 2024-09-17T03:41:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.365 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601278 s, 174 MB/s 2024-09-17T03:41:20.373 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.373 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.373 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066556 s, 158 MB/s 2024-09-17T03:41:20.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.383 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724611 s, 145 MB/s 2024-09-17T03:41:20.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.392 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656874 s, 160 MB/s 2024-09-17T03:41:20.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701288 s, 150 MB/s 2024-09-17T03:41:20.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.409 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640298 s, 164 MB/s 2024-09-17T03:41:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659339 s, 159 MB/s 2024-09-17T03:41:20.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.427 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665337 s, 158 MB/s 2024-09-17T03:41:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589235 s, 178 MB/s 2024-09-17T03:41:20.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719088 s, 146 MB/s 2024-09-17T03:41:20.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.453 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661599 s, 158 MB/s 2024-09-17T03:41:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.463 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755326 s, 139 MB/s 2024-09-17T03:41:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585725 s, 179 MB/s 2024-09-17T03:41:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643057 s, 163 MB/s 2024-09-17T03:41:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603863 s, 174 MB/s 2024-09-17T03:41:20.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.496 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647603 s, 162 MB/s 2024-09-17T03:41:20.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.504 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582416 s, 180 MB/s 2024-09-17T03:41:20.512 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.513 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631909 s, 166 MB/s 2024-09-17T03:41:20.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.521 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573213 s, 183 MB/s 2024-09-17T03:41:20.528 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.528 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.528 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589181 s, 178 MB/s 2024-09-17T03:41:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647645 s, 162 MB/s 2024-09-17T03:41:20.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.546 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640427 s, 164 MB/s 2024-09-17T03:41:20.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.555 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706527 s, 148 MB/s 2024-09-17T03:41:20.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.562 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638539 s, 164 MB/s 2024-09-17T03:41:20.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.571 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006688 s, 157 MB/s 2024-09-17T03:41:20.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.580 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781445 s, 134 MB/s 2024-09-17T03:41:20.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.588 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061447 s, 171 MB/s 2024-09-17T03:41:20.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:20.595 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:20.595 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:20.595 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.14 2024-09-17T03:41:20.595 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:20.595 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:20.595 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:20.595 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:20.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:20.653 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670979 s, 156 MB/s 2024-09-17T03:41:20.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.662 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706653 s, 148 MB/s 2024-09-17T03:41:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.671 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067648 s, 155 MB/s 2024-09-17T03:41:20.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.679 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650042 s, 161 MB/s 2024-09-17T03:41:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.688 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712872 s, 147 MB/s 2024-09-17T03:41:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598765 s, 175 MB/s 2024-09-17T03:41:20.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.704 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646813 s, 162 MB/s 2024-09-17T03:41:20.713 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.713 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.713 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732551 s, 143 MB/s 2024-09-17T03:41:20.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.722 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680504 s, 154 MB/s 2024-09-17T03:41:20.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727496 s, 144 MB/s 2024-09-17T03:41:20.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.740 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734523 s, 143 MB/s 2024-09-17T03:41:20.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.748 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639795 s, 164 MB/s 2024-09-17T03:41:20.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.757 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741121 s, 141 MB/s 2024-09-17T03:41:20.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663799 s, 158 MB/s 2024-09-17T03:41:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.774 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067431 s, 156 MB/s 2024-09-17T03:41:20.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.783 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072095 s, 145 MB/s 2024-09-17T03:41:20.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.790 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596069 s, 176 MB/s 2024-09-17T03:41:20.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.798 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623417 s, 168 MB/s 2024-09-17T03:41:20.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.806 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603122 s, 174 MB/s 2024-09-17T03:41:20.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.815 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669597 s, 157 MB/s 2024-09-17T03:41:20.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.823 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680597 s, 154 MB/s 2024-09-17T03:41:20.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.831 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654088 s, 160 MB/s 2024-09-17T03:41:20.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654556 s, 160 MB/s 2024-09-17T03:41:20.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686934 s, 153 MB/s 2024-09-17T03:41:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595939 s, 176 MB/s 2024-09-17T03:41:20.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.863 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637285 s, 165 MB/s 2024-09-17T03:41:20.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.872 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662378 s, 158 MB/s 2024-09-17T03:41:20.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.880 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640948 s, 164 MB/s 2024-09-17T03:41:20.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730473 s, 144 MB/s 2024-09-17T03:41:20.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639779 s, 164 MB/s 2024-09-17T03:41:20.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614336 s, 171 MB/s 2024-09-17T03:41:20.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732417 s, 143 MB/s 2024-09-17T03:41:20.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:20.921 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:20.921 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:20.921 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.15 2024-09-17T03:41:20.921 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:20.921 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:20.921 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:20.921 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:20.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:20.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.979 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649605 s, 161 MB/s 2024-09-17T03:41:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643268 s, 163 MB/s 2024-09-17T03:41:20.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:20.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:20.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725396 s, 145 MB/s 2024-09-17T03:41:21.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.004 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597205 s, 176 MB/s 2024-09-17T03:41:21.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.013 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765852 s, 137 MB/s 2024-09-17T03:41:21.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.022 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658693 s, 159 MB/s 2024-09-17T03:41:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072996 s, 144 MB/s 2024-09-17T03:41:21.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.040 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708196 s, 148 MB/s 2024-09-17T03:41:21.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.049 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644791 s, 163 MB/s 2024-09-17T03:41:21.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.058 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693852 s, 151 MB/s 2024-09-17T03:41:21.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.067 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693065 s, 151 MB/s 2024-09-17T03:41:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639026 s, 164 MB/s 2024-09-17T03:41:21.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.083 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602938 s, 174 MB/s 2024-09-17T03:41:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658689 s, 159 MB/s 2024-09-17T03:41:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650659 s, 161 MB/s 2024-09-17T03:41:21.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.111 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692067 s, 152 MB/s 2024-09-17T03:41:21.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.120 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744576 s, 141 MB/s 2024-09-17T03:41:21.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.129 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711983 s, 147 MB/s 2024-09-17T03:41:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.138 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664984 s, 158 MB/s 2024-09-17T03:41:21.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.146 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650978 s, 161 MB/s 2024-09-17T03:41:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.154 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657325 s, 160 MB/s 2024-09-17T03:41:21.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720626 s, 146 MB/s 2024-09-17T03:41:21.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.171 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637781 s, 164 MB/s 2024-09-17T03:41:21.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.179 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682706 s, 154 MB/s 2024-09-17T03:41:21.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.188 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749426 s, 140 MB/s 2024-09-17T03:41:21.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.196 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616931 s, 170 MB/s 2024-09-17T03:41:21.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.204 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619284 s, 169 MB/s 2024-09-17T03:41:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.213 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654099 s, 160 MB/s 2024-09-17T03:41:21.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.220 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589767 s, 178 MB/s 2024-09-17T03:41:21.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647591 s, 162 MB/s 2024-09-17T03:41:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757367 s, 138 MB/s 2024-09-17T03:41:21.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.247 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676379 s, 155 MB/s 2024-09-17T03:41:21.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:21.253 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:21.253 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:21.253 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.16 2024-09-17T03:41:21.253 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:21.253 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:21.253 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:21.253 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:21.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:21.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672722 s, 156 MB/s 2024-09-17T03:41:21.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676864 s, 155 MB/s 2024-09-17T03:41:21.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.328 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663448 s, 158 MB/s 2024-09-17T03:41:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.336 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657248 s, 160 MB/s 2024-09-17T03:41:21.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.344 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594635 s, 176 MB/s 2024-09-17T03:41:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735141 s, 143 MB/s 2024-09-17T03:41:21.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.363 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675869 s, 155 MB/s 2024-09-17T03:41:21.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.371 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689355 s, 152 MB/s 2024-09-17T03:41:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645429 s, 162 MB/s 2024-09-17T03:41:21.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742507 s, 141 MB/s 2024-09-17T03:41:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762669 s, 137 MB/s 2024-09-17T03:41:21.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.407 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761996 s, 138 MB/s 2024-09-17T03:41:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.416 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743219 s, 141 MB/s 2024-09-17T03:41:21.424 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.424 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.424 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668017 s, 157 MB/s 2024-09-17T03:41:21.432 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.433 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658097 s, 159 MB/s 2024-09-17T03:41:21.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.440 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596723 s, 176 MB/s 2024-09-17T03:41:21.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.449 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734652 s, 143 MB/s 2024-09-17T03:41:21.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.458 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667369 s, 157 MB/s 2024-09-17T03:41:21.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.467 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758388 s, 138 MB/s 2024-09-17T03:41:21.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674511 s, 155 MB/s 2024-09-17T03:41:21.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.484 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638875 s, 164 MB/s 2024-09-17T03:41:21.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616006 s, 170 MB/s 2024-09-17T03:41:21.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.500 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636043 s, 165 MB/s 2024-09-17T03:41:21.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601891 s, 174 MB/s 2024-09-17T03:41:21.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.515 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006021 s, 174 MB/s 2024-09-17T03:41:21.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.524 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677169 s, 155 MB/s 2024-09-17T03:41:21.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.532 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652012 s, 161 MB/s 2024-09-17T03:41:21.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061639 s, 170 MB/s 2024-09-17T03:41:21.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.548 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671414 s, 156 MB/s 2024-09-17T03:41:21.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643806 s, 163 MB/s 2024-09-17T03:41:21.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072434 s, 145 MB/s 2024-09-17T03:41:21.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665572 s, 158 MB/s 2024-09-17T03:41:21.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:21.580 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:21.580 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:21.580 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.17 2024-09-17T03:41:21.580 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:21.581 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:21.581 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:21.581 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:21.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:21.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.640 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741052 s, 141 MB/s 2024-09-17T03:41:21.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.649 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743799 s, 141 MB/s 2024-09-17T03:41:21.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726999 s, 144 MB/s 2024-09-17T03:41:21.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.665 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057349 s, 183 MB/s 2024-09-17T03:41:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789681 s, 133 MB/s 2024-09-17T03:41:21.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.683 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650995 s, 161 MB/s 2024-09-17T03:41:21.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.693 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732774 s, 143 MB/s 2024-09-17T03:41:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.702 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722587 s, 145 MB/s 2024-09-17T03:41:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075859 s, 138 MB/s 2024-09-17T03:41:21.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.720 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595118 s, 176 MB/s 2024-09-17T03:41:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777645 s, 135 MB/s 2024-09-17T03:41:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071843 s, 146 MB/s 2024-09-17T03:41:21.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.748 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672747 s, 156 MB/s 2024-09-17T03:41:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.756 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650479 s, 161 MB/s 2024-09-17T03:41:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741837 s, 141 MB/s 2024-09-17T03:41:21.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.775 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693558 s, 151 MB/s 2024-09-17T03:41:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.785 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746553 s, 140 MB/s 2024-09-17T03:41:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617017 s, 170 MB/s 2024-09-17T03:41:21.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667296 s, 157 MB/s 2024-09-17T03:41:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642618 s, 163 MB/s 2024-09-17T03:41:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.819 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063596 s, 165 MB/s 2024-09-17T03:41:21.827 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.827 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.827 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059919 s, 175 MB/s 2024-09-17T03:41:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756294 s, 139 MB/s 2024-09-17T03:41:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756275 s, 139 MB/s 2024-09-17T03:41:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646887 s, 162 MB/s 2024-09-17T03:41:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652281 s, 161 MB/s 2024-09-17T03:41:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738018 s, 142 MB/s 2024-09-17T03:41:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672207 s, 156 MB/s 2024-09-17T03:41:21.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.891 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679504 s, 154 MB/s 2024-09-17T03:41:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689975 s, 152 MB/s 2024-09-17T03:41:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643432 s, 163 MB/s 2024-09-17T03:41:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694536 s, 151 MB/s 2024-09-17T03:41:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:21.925 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:21.925 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:21.925 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.18 2024-09-17T03:41:21.925 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:21.925 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:21.925 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:21.925 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:21.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642778 s, 163 MB/s 2024-09-17T03:41:21.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:21.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:21.994 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066655 s, 157 MB/s 2024-09-17T03:41:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074376 s, 141 MB/s 2024-09-17T03:41:22.011 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.011 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.012 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616128 s, 170 MB/s 2024-09-17T03:41:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.019 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588219 s, 178 MB/s 2024-09-17T03:41:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725777 s, 144 MB/s 2024-09-17T03:41:22.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.038 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690956 s, 152 MB/s 2024-09-17T03:41:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669039 s, 157 MB/s 2024-09-17T03:41:22.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.057 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749223 s, 140 MB/s 2024-09-17T03:41:22.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.066 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071611 s, 146 MB/s 2024-09-17T03:41:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.075 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665955 s, 157 MB/s 2024-09-17T03:41:22.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743156 s, 141 MB/s 2024-09-17T03:41:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588933 s, 178 MB/s 2024-09-17T03:41:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762242 s, 138 MB/s 2024-09-17T03:41:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668667 s, 157 MB/s 2024-09-17T03:41:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592235 s, 177 MB/s 2024-09-17T03:41:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.128 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647006 s, 162 MB/s 2024-09-17T03:41:22.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.136 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584149 s, 180 MB/s 2024-09-17T03:41:22.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.146 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077837 s, 135 MB/s 2024-09-17T03:41:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074414 s, 141 MB/s 2024-09-17T03:41:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650331 s, 161 MB/s 2024-09-17T03:41:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694865 s, 151 MB/s 2024-09-17T03:41:22.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.183 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740001 s, 142 MB/s 2024-09-17T03:41:22.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.191 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617489 s, 170 MB/s 2024-09-17T03:41:22.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.200 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647945 s, 162 MB/s 2024-09-17T03:41:22.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713041 s, 147 MB/s 2024-09-17T03:41:22.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682107 s, 154 MB/s 2024-09-17T03:41:22.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737956 s, 142 MB/s 2024-09-17T03:41:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615441 s, 170 MB/s 2024-09-17T03:41:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682621 s, 154 MB/s 2024-09-17T03:41:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654229 s, 160 MB/s 2024-09-17T03:41:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.261 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590546 s, 178 MB/s 2024-09-17T03:41:22.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:22.268 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:22.268 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:22.268 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.19 2024-09-17T03:41:22.269 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:22.269 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:22.269 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:22.269 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:22.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.329 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065552 s, 160 MB/s 2024-09-17T03:41:22.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.338 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746775 s, 140 MB/s 2024-09-17T03:41:22.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649843 s, 161 MB/s 2024-09-17T03:41:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698792 s, 150 MB/s 2024-09-17T03:41:22.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.365 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667023 s, 157 MB/s 2024-09-17T03:41:22.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.374 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692676 s, 151 MB/s 2024-09-17T03:41:22.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.383 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743608 s, 141 MB/s 2024-09-17T03:41:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720394 s, 146 MB/s 2024-09-17T03:41:22.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651927 s, 161 MB/s 2024-09-17T03:41:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736277 s, 142 MB/s 2024-09-17T03:41:22.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.420 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672784 s, 156 MB/s 2024-09-17T03:41:22.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.428 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602752 s, 174 MB/s 2024-09-17T03:41:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072329 s, 145 MB/s 2024-09-17T03:41:22.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.447 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768345 s, 136 MB/s 2024-09-17T03:41:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731316 s, 143 MB/s 2024-09-17T03:41:22.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.465 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643641 s, 163 MB/s 2024-09-17T03:41:22.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669928 s, 157 MB/s 2024-09-17T03:41:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735274 s, 143 MB/s 2024-09-17T03:41:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779713 s, 134 MB/s 2024-09-17T03:41:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.501 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621541 s, 169 MB/s 2024-09-17T03:41:22.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.510 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666565 s, 157 MB/s 2024-09-17T03:41:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.519 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653887 s, 160 MB/s 2024-09-17T03:41:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.528 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.528 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663397 s, 158 MB/s 2024-09-17T03:41:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.536 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671787 s, 156 MB/s 2024-09-17T03:41:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.545 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664425 s, 158 MB/s 2024-09-17T03:41:22.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666344 s, 157 MB/s 2024-09-17T03:41:22.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.562 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634021 s, 165 MB/s 2024-09-17T03:41:22.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.572 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737478 s, 142 MB/s 2024-09-17T03:41:22.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614186 s, 171 MB/s 2024-09-17T03:41:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.588 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676079 s, 155 MB/s 2024-09-17T03:41:22.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725608 s, 145 MB/s 2024-09-17T03:41:22.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582357 s, 180 MB/s 2024-09-17T03:41:22.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:22.611 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:22.611 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:22.611 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.20 2024-09-17T03:41:22.611 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:22.611 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:22.611 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:22.611 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:22.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696914 s, 150 MB/s 2024-09-17T03:41:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702377 s, 149 MB/s 2024-09-17T03:41:22.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.687 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667382 s, 157 MB/s 2024-09-17T03:41:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638968 s, 164 MB/s 2024-09-17T03:41:22.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.703 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598429 s, 175 MB/s 2024-09-17T03:41:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.710 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599105 s, 175 MB/s 2024-09-17T03:41:22.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.720 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725034 s, 145 MB/s 2024-09-17T03:41:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.729 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604856 s, 173 MB/s 2024-09-17T03:41:22.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.735 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652201 s, 161 MB/s 2024-09-17T03:41:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680721 s, 154 MB/s 2024-09-17T03:41:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684698 s, 153 MB/s 2024-09-17T03:41:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642583 s, 163 MB/s 2024-09-17T03:41:22.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.769 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068096 s, 154 MB/s 2024-09-17T03:41:22.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.777 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640183 s, 164 MB/s 2024-09-17T03:41:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624299 s, 168 MB/s 2024-09-17T03:41:22.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.794 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073064 s, 144 MB/s 2024-09-17T03:41:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650306 s, 161 MB/s 2024-09-17T03:41:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672687 s, 156 MB/s 2024-09-17T03:41:22.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.820 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668746 s, 157 MB/s 2024-09-17T03:41:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751134 s, 140 MB/s 2024-09-17T03:41:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641761 s, 163 MB/s 2024-09-17T03:41:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646033 s, 162 MB/s 2024-09-17T03:41:22.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674518 s, 155 MB/s 2024-09-17T03:41:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724471 s, 145 MB/s 2024-09-17T03:41:22.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.870 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665301 s, 158 MB/s 2024-09-17T03:41:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673547 s, 156 MB/s 2024-09-17T03:41:22.887 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.887 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.888 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667779 s, 157 MB/s 2024-09-17T03:41:22.895 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655836 s, 160 MB/s 2024-09-17T03:41:22.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711815 s, 147 MB/s 2024-09-17T03:41:22.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727574 s, 144 MB/s 2024-09-17T03:41:22.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723462 s, 145 MB/s 2024-09-17T03:41:22.930 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.930 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659687 s, 159 MB/s 2024-09-17T03:41:22.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:22.937 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:22.937 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:22.937 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.21 2024-09-17T03:41:22.937 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:22.937 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:22.937 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:22.937 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:22.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:22.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:22.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:22.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652497 s, 161 MB/s 2024-09-17T03:41:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.004 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646114 s, 162 MB/s 2024-09-17T03:41:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.013 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677536 s, 155 MB/s 2024-09-17T03:41:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.022 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672134 s, 156 MB/s 2024-09-17T03:41:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760235 s, 138 MB/s 2024-09-17T03:41:23.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.040 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660289 s, 159 MB/s 2024-09-17T03:41:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765789 s, 137 MB/s 2024-09-17T03:41:23.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.057 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665433 s, 158 MB/s 2024-09-17T03:41:23.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602605 s, 174 MB/s 2024-09-17T03:41:23.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.074 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666905 s, 157 MB/s 2024-09-17T03:41:23.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.081 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641491 s, 163 MB/s 2024-09-17T03:41:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651492 s, 161 MB/s 2024-09-17T03:41:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637001 s, 165 MB/s 2024-09-17T03:41:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656122 s, 160 MB/s 2024-09-17T03:41:23.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.114 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641855 s, 163 MB/s 2024-09-17T03:41:23.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.122 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638935 s, 164 MB/s 2024-09-17T03:41:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.130 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645399 s, 162 MB/s 2024-09-17T03:41:23.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.138 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609945 s, 172 MB/s 2024-09-17T03:41:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.147 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064683 s, 162 MB/s 2024-09-17T03:41:23.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.155 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006557 s, 160 MB/s 2024-09-17T03:41:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.164 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727338 s, 144 MB/s 2024-09-17T03:41:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.172 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598711 s, 175 MB/s 2024-09-17T03:41:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660876 s, 159 MB/s 2024-09-17T03:41:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732142 s, 143 MB/s 2024-09-17T03:41:23.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.199 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658208 s, 159 MB/s 2024-09-17T03:41:23.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074706 s, 140 MB/s 2024-09-17T03:41:23.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740368 s, 142 MB/s 2024-09-17T03:41:23.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066986 s, 157 MB/s 2024-09-17T03:41:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647439 s, 162 MB/s 2024-09-17T03:41:23.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636808 s, 165 MB/s 2024-09-17T03:41:23.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689194 s, 152 MB/s 2024-09-17T03:41:23.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726531 s, 144 MB/s 2024-09-17T03:41:23.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:23.269 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:23.269 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:23.270 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.22 2024-09-17T03:41:23.270 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:23.270 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:23.270 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:23.270 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:23.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.329 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600898 s, 175 MB/s 2024-09-17T03:41:23.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.337 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620419 s, 169 MB/s 2024-09-17T03:41:23.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742218 s, 141 MB/s 2024-09-17T03:41:23.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.357 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828126 s, 127 MB/s 2024-09-17T03:41:23.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.366 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721356 s, 145 MB/s 2024-09-17T03:41:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722485 s, 145 MB/s 2024-09-17T03:41:23.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.384 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600176 s, 175 MB/s 2024-09-17T03:41:23.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657315 s, 160 MB/s 2024-09-17T03:41:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060563 s, 173 MB/s 2024-09-17T03:41:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.411 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750925 s, 140 MB/s 2024-09-17T03:41:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594269 s, 176 MB/s 2024-09-17T03:41:23.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.428 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755035 s, 139 MB/s 2024-09-17T03:41:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.438 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774368 s, 135 MB/s 2024-09-17T03:41:23.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621169 s, 169 MB/s 2024-09-17T03:41:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729735 s, 144 MB/s 2024-09-17T03:41:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655661 s, 160 MB/s 2024-09-17T03:41:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631634 s, 166 MB/s 2024-09-17T03:41:23.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645153 s, 163 MB/s 2024-09-17T03:41:23.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719487 s, 146 MB/s 2024-09-17T03:41:23.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.501 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723141 s, 145 MB/s 2024-09-17T03:41:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.510 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765353 s, 137 MB/s 2024-09-17T03:41:23.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059486 s, 176 MB/s 2024-09-17T03:41:23.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658976 s, 159 MB/s 2024-09-17T03:41:23.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.536 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661158 s, 159 MB/s 2024-09-17T03:41:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.545 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589909 s, 178 MB/s 2024-09-17T03:41:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.553 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608627 s, 172 MB/s 2024-09-17T03:41:23.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.562 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724208 s, 145 MB/s 2024-09-17T03:41:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664138 s, 158 MB/s 2024-09-17T03:41:23.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645983 s, 162 MB/s 2024-09-17T03:41:23.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071719 s, 146 MB/s 2024-09-17T03:41:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662161 s, 158 MB/s 2024-09-17T03:41:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059313 s, 177 MB/s 2024-09-17T03:41:23.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:23.612 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:23.612 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:23.612 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.23 2024-09-17T03:41:23.612 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:23.612 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:23.612 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:23.612 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736277 s, 142 MB/s 2024-09-17T03:41:23.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.682 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715036 s, 147 MB/s 2024-09-17T03:41:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.691 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681453 s, 154 MB/s 2024-09-17T03:41:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.701 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755527 s, 139 MB/s 2024-09-17T03:41:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675335 s, 155 MB/s 2024-09-17T03:41:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.718 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610987 s, 172 MB/s 2024-09-17T03:41:23.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.728 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605201 s, 173 MB/s 2024-09-17T03:41:23.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.736 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739088 s, 142 MB/s 2024-09-17T03:41:23.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627979 s, 167 MB/s 2024-09-17T03:41:23.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.753 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685981 s, 153 MB/s 2024-09-17T03:41:23.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.763 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728992 s, 144 MB/s 2024-09-17T03:41:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776176 s, 135 MB/s 2024-09-17T03:41:23.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.782 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770298 s, 136 MB/s 2024-09-17T03:41:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.791 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657711 s, 159 MB/s 2024-09-17T03:41:23.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.799 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642829 s, 163 MB/s 2024-09-17T03:41:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.808 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613024 s, 171 MB/s 2024-09-17T03:41:23.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.817 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735687 s, 143 MB/s 2024-09-17T03:41:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.826 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723439 s, 145 MB/s 2024-09-17T03:41:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.834 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611313 s, 172 MB/s 2024-09-17T03:41:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.844 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678933 s, 154 MB/s 2024-09-17T03:41:23.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.852 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633488 s, 166 MB/s 2024-09-17T03:41:23.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.860 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061772 s, 170 MB/s 2024-09-17T03:41:23.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.871 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.871 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789984 s, 133 MB/s 2024-09-17T03:41:23.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.878 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580597 s, 181 MB/s 2024-09-17T03:41:23.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.888 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740125 s, 142 MB/s 2024-09-17T03:41:23.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.898 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711361 s, 147 MB/s 2024-09-17T03:41:23.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676218 s, 155 MB/s 2024-09-17T03:41:23.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685175 s, 153 MB/s 2024-09-17T03:41:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.924 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665336 s, 158 MB/s 2024-09-17T03:41:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736067 s, 142 MB/s 2024-09-17T03:41:23.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.943 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071618 s, 146 MB/s 2024-09-17T03:41:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:23.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726895 s, 144 MB/s 2024-09-17T03:41:23.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:23.961 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:23.961 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:23.962 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.24 2024-09-17T03:41:23.962 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:23.962 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:23.962 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:23.962 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:24.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:24.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.025 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076834 s, 136 MB/s 2024-09-17T03:41:24.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.034 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684698 s, 153 MB/s 2024-09-17T03:41:24.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674291 s, 156 MB/s 2024-09-17T03:41:24.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727664 s, 144 MB/s 2024-09-17T03:41:24.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.062 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075736 s, 138 MB/s 2024-09-17T03:41:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646541 s, 162 MB/s 2024-09-17T03:41:24.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.078 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595575 s, 176 MB/s 2024-09-17T03:41:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066833 s, 157 MB/s 2024-09-17T03:41:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641005 s, 164 MB/s 2024-09-17T03:41:24.104 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.105 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644039 s, 163 MB/s 2024-09-17T03:41:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734163 s, 143 MB/s 2024-09-17T03:41:24.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.123 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765493 s, 137 MB/s 2024-09-17T03:41:24.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651121 s, 161 MB/s 2024-09-17T03:41:24.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.140 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648576 s, 162 MB/s 2024-09-17T03:41:24.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.148 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066035 s, 159 MB/s 2024-09-17T03:41:24.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665129 s, 158 MB/s 2024-09-17T03:41:24.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.165 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735891 s, 142 MB/s 2024-09-17T03:41:24.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718033 s, 146 MB/s 2024-09-17T03:41:24.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745955 s, 141 MB/s 2024-09-17T03:41:24.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073277 s, 143 MB/s 2024-09-17T03:41:24.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689308 s, 152 MB/s 2024-09-17T03:41:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.210 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664314 s, 158 MB/s 2024-09-17T03:41:24.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065105 s, 161 MB/s 2024-09-17T03:41:24.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736147 s, 142 MB/s 2024-09-17T03:41:24.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.236 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739566 s, 142 MB/s 2024-09-17T03:41:24.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624559 s, 168 MB/s 2024-09-17T03:41:24.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688737 s, 152 MB/s 2024-09-17T03:41:24.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.261 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666213 s, 157 MB/s 2024-09-17T03:41:24.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.270 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719493 s, 146 MB/s 2024-09-17T03:41:24.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.278 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658362 s, 159 MB/s 2024-09-17T03:41:24.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.287 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748798 s, 140 MB/s 2024-09-17T03:41:24.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.296 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742268 s, 141 MB/s 2024-09-17T03:41:24.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:24.303 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:24.303 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:24.303 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.25 2024-09-17T03:41:24.304 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:24.304 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:24.304 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:24.304 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:24.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:24.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.364 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669878 s, 157 MB/s 2024-09-17T03:41:24.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.372 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650933 s, 161 MB/s 2024-09-17T03:41:24.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.380 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657197 s, 160 MB/s 2024-09-17T03:41:24.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061116 s, 172 MB/s 2024-09-17T03:41:24.397 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.397 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.398 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744886 s, 141 MB/s 2024-09-17T03:41:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590157 s, 178 MB/s 2024-09-17T03:41:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.414 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735909 s, 142 MB/s 2024-09-17T03:41:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.423 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668511 s, 157 MB/s 2024-09-17T03:41:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.431 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636767 s, 165 MB/s 2024-09-17T03:41:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.440 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729948 s, 144 MB/s 2024-09-17T03:41:24.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.448 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597174 s, 176 MB/s 2024-09-17T03:41:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727815 s, 144 MB/s 2024-09-17T03:41:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.466 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721366 s, 145 MB/s 2024-09-17T03:41:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645064 s, 163 MB/s 2024-09-17T03:41:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642871 s, 163 MB/s 2024-09-17T03:41:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068076 s, 154 MB/s 2024-09-17T03:41:24.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.499 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675791 s, 155 MB/s 2024-09-17T03:41:24.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650255 s, 161 MB/s 2024-09-17T03:41:24.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.516 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721681 s, 145 MB/s 2024-09-17T03:41:24.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.524 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606354 s, 173 MB/s 2024-09-17T03:41:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006814 s, 154 MB/s 2024-09-17T03:41:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733112 s, 143 MB/s 2024-09-17T03:41:24.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.550 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659633 s, 159 MB/s 2024-09-17T03:41:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648877 s, 162 MB/s 2024-09-17T03:41:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726821 s, 144 MB/s 2024-09-17T03:41:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640195 s, 164 MB/s 2024-09-17T03:41:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665214 s, 158 MB/s 2024-09-17T03:41:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627446 s, 167 MB/s 2024-09-17T03:41:24.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686432 s, 153 MB/s 2024-09-17T03:41:24.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742196 s, 141 MB/s 2024-09-17T03:41:24.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.619 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074528 s, 141 MB/s 2024-09-17T03:41:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.628 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068196 s, 154 MB/s 2024-09-17T03:41:24.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:24.634 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:24.634 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:24.634 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.26 2024-09-17T03:41:24.634 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:24.634 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:24.634 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:24.635 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:24.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661032 s, 159 MB/s 2024-09-17T03:41:24.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.703 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638523 s, 164 MB/s 2024-09-17T03:41:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727507 s, 144 MB/s 2024-09-17T03:41:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651241 s, 161 MB/s 2024-09-17T03:41:24.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.729 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665886 s, 157 MB/s 2024-09-17T03:41:24.737 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.737 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.737 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646714 s, 162 MB/s 2024-09-17T03:41:24.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.745 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612158 s, 171 MB/s 2024-09-17T03:41:24.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.753 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677948 s, 155 MB/s 2024-09-17T03:41:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.762 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729959 s, 144 MB/s 2024-09-17T03:41:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642078 s, 163 MB/s 2024-09-17T03:41:24.779 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.779 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.779 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655554 s, 160 MB/s 2024-09-17T03:41:24.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.790 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730958 s, 143 MB/s 2024-09-17T03:41:24.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.798 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664828 s, 158 MB/s 2024-09-17T03:41:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.806 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650698 s, 161 MB/s 2024-09-17T03:41:24.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.814 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642447 s, 163 MB/s 2024-09-17T03:41:24.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.823 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662625 s, 158 MB/s 2024-09-17T03:41:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745286 s, 141 MB/s 2024-09-17T03:41:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.842 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646389 s, 162 MB/s 2024-09-17T03:41:24.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.850 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632224 s, 166 MB/s 2024-09-17T03:41:24.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.859 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694511 s, 151 MB/s 2024-09-17T03:41:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730265 s, 144 MB/s 2024-09-17T03:41:24.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.878 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711817 s, 147 MB/s 2024-09-17T03:41:24.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.886 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649215 s, 162 MB/s 2024-09-17T03:41:24.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596013 s, 176 MB/s 2024-09-17T03:41:24.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.904 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727014 s, 144 MB/s 2024-09-17T03:41:24.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715218 s, 147 MB/s 2024-09-17T03:41:24.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.923 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729337 s, 144 MB/s 2024-09-17T03:41:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673744 s, 156 MB/s 2024-09-17T03:41:24.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739212 s, 142 MB/s 2024-09-17T03:41:24.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675082 s, 155 MB/s 2024-09-17T03:41:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660149 s, 159 MB/s 2024-09-17T03:41:24.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:24.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:24.967 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682598 s, 154 MB/s 2024-09-17T03:41:24.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:24.976 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:24.976 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:24.977 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.27 2024-09-17T03:41:24.977 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:24.977 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:24.977 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:24.977 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:25.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:25.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.189 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073235 s, 143 MB/s 2024-09-17T03:41:25.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672184 s, 156 MB/s 2024-09-17T03:41:25.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.206 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736889 s, 142 MB/s 2024-09-17T03:41:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773935 s, 135 MB/s 2024-09-17T03:41:25.223 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.224 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651714 s, 161 MB/s 2024-09-17T03:41:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694433 s, 151 MB/s 2024-09-17T03:41:25.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661564 s, 158 MB/s 2024-09-17T03:41:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658968 s, 159 MB/s 2024-09-17T03:41:25.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.258 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754398 s, 139 MB/s 2024-09-17T03:41:25.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694297 s, 151 MB/s 2024-09-17T03:41:25.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680704 s, 154 MB/s 2024-09-17T03:41:25.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642034 s, 163 MB/s 2024-09-17T03:41:25.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.292 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665544 s, 158 MB/s 2024-09-17T03:41:25.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624994 s, 168 MB/s 2024-09-17T03:41:25.307 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.307 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.307 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596858 s, 176 MB/s 2024-09-17T03:41:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070988 s, 148 MB/s 2024-09-17T03:41:25.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.324 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582496 s, 180 MB/s 2024-09-17T03:41:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679608 s, 154 MB/s 2024-09-17T03:41:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751806 s, 139 MB/s 2024-09-17T03:41:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101373 s, 103 MB/s 2024-09-17T03:41:25.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660434 s, 159 MB/s 2024-09-17T03:41:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739979 s, 142 MB/s 2024-09-17T03:41:25.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060486 s, 173 MB/s 2024-09-17T03:41:25.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712639 s, 147 MB/s 2024-09-17T03:41:25.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600453 s, 175 MB/s 2024-09-17T03:41:25.403 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.403 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.403 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601931 s, 174 MB/s 2024-09-17T03:41:25.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707082 s, 148 MB/s 2024-09-17T03:41:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644114 s, 163 MB/s 2024-09-17T03:41:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.428 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626933 s, 167 MB/s 2024-09-17T03:41:25.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.437 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699319 s, 150 MB/s 2024-09-17T03:41:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728686 s, 144 MB/s 2024-09-17T03:41:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.454 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650099 s, 161 MB/s 2024-09-17T03:41:25.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:25.461 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:25.461 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:25.461 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.28 2024-09-17T03:41:25.461 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:25.461 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:25.461 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:25.462 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:25.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:25.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.520 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672453 s, 156 MB/s 2024-09-17T03:41:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603862 s, 174 MB/s 2024-09-17T03:41:25.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.536 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653794 s, 160 MB/s 2024-09-17T03:41:25.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656605 s, 160 MB/s 2024-09-17T03:41:25.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.553 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753492 s, 139 MB/s 2024-09-17T03:41:25.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.563 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740309 s, 142 MB/s 2024-09-17T03:41:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658373 s, 159 MB/s 2024-09-17T03:41:25.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646786 s, 162 MB/s 2024-09-17T03:41:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.588 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625851 s, 168 MB/s 2024-09-17T03:41:25.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797907 s, 131 MB/s 2024-09-17T03:41:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759557 s, 138 MB/s 2024-09-17T03:41:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669669 s, 157 MB/s 2024-09-17T03:41:25.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.622 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602843 s, 174 MB/s 2024-09-17T03:41:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752188 s, 139 MB/s 2024-09-17T03:41:25.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616282 s, 170 MB/s 2024-09-17T03:41:25.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.649 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730566 s, 144 MB/s 2024-09-17T03:41:25.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.656 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593988 s, 177 MB/s 2024-09-17T03:41:25.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.665 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691384 s, 152 MB/s 2024-09-17T03:41:25.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.673 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598386 s, 175 MB/s 2024-09-17T03:41:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005967 s, 176 MB/s 2024-09-17T03:41:25.690 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.690 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.690 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757531 s, 138 MB/s 2024-09-17T03:41:25.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.699 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647156 s, 162 MB/s 2024-09-17T03:41:25.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.708 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707065 s, 148 MB/s 2024-09-17T03:41:25.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696224 s, 151 MB/s 2024-09-17T03:41:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.725 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668063 s, 157 MB/s 2024-09-17T03:41:25.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.735 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725368 s, 145 MB/s 2024-09-17T03:41:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715304 s, 147 MB/s 2024-09-17T03:41:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716466 s, 146 MB/s 2024-09-17T03:41:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666904 s, 157 MB/s 2024-09-17T03:41:25.771 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.772 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761558 s, 138 MB/s 2024-09-17T03:41:25.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722113 s, 145 MB/s 2024-09-17T03:41:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.792 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732228 s, 143 MB/s 2024-09-17T03:41:25.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:25.797 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:25.797 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:25.797 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.29 2024-09-17T03:41:25.797 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:25.797 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:25.798 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:25.798 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:25.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:25.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609896 s, 172 MB/s 2024-09-17T03:41:25.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657538 s, 159 MB/s 2024-09-17T03:41:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620321 s, 169 MB/s 2024-09-17T03:41:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007317 s, 143 MB/s 2024-09-17T03:41:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736234 s, 142 MB/s 2024-09-17T03:41:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614622 s, 171 MB/s 2024-09-17T03:41:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594532 s, 176 MB/s 2024-09-17T03:41:25.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.917 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058891 s, 178 MB/s 2024-09-17T03:41:25.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.926 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672431 s, 156 MB/s 2024-09-17T03:41:25.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.935 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756884 s, 139 MB/s 2024-09-17T03:41:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639948 s, 164 MB/s 2024-09-17T03:41:25.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.953 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662255 s, 158 MB/s 2024-09-17T03:41:25.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.962 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741153 s, 141 MB/s 2024-09-17T03:41:25.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729854 s, 144 MB/s 2024-09-17T03:41:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576294 s, 182 MB/s 2024-09-17T03:41:25.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:25.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:25.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737214 s, 142 MB/s 2024-09-17T03:41:26.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.000 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713522 s, 147 MB/s 2024-09-17T03:41:26.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.008 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718361 s, 146 MB/s 2024-09-17T03:41:26.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.016 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659053 s, 159 MB/s 2024-09-17T03:41:26.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.026 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070004 s, 150 MB/s 2024-09-17T03:41:26.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.034 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690216 s, 152 MB/s 2024-09-17T03:41:26.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.043 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726275 s, 144 MB/s 2024-09-17T03:41:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714919 s, 147 MB/s 2024-09-17T03:41:26.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.061 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750731 s, 140 MB/s 2024-09-17T03:41:26.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.069 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652058 s, 161 MB/s 2024-09-17T03:41:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783806 s, 134 MB/s 2024-09-17T03:41:26.088 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.088 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.088 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742155 s, 141 MB/s 2024-09-17T03:41:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740322 s, 142 MB/s 2024-09-17T03:41:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.106 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683848 s, 153 MB/s 2024-09-17T03:41:26.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071772 s, 146 MB/s 2024-09-17T03:41:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601706 s, 174 MB/s 2024-09-17T03:41:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722686 s, 145 MB/s 2024-09-17T03:41:26.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:26.138 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:26.138 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:26.138 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.30 2024-09-17T03:41:26.138 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:26.138 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:26.138 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:26.138 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:26.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:26.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.196 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653572 s, 160 MB/s 2024-09-17T03:41:26.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.205 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678937 s, 154 MB/s 2024-09-17T03:41:26.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.213 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618353 s, 170 MB/s 2024-09-17T03:41:26.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.222 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764968 s, 137 MB/s 2024-09-17T03:41:26.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.230 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581187 s, 180 MB/s 2024-09-17T03:41:26.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641776 s, 163 MB/s 2024-09-17T03:41:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651822 s, 161 MB/s 2024-09-17T03:41:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642399 s, 163 MB/s 2024-09-17T03:41:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719236 s, 146 MB/s 2024-09-17T03:41:26.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.273 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733702 s, 143 MB/s 2024-09-17T03:41:26.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.282 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731277 s, 143 MB/s 2024-09-17T03:41:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.292 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749122 s, 140 MB/s 2024-09-17T03:41:26.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657112 s, 160 MB/s 2024-09-17T03:41:26.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740106 s, 142 MB/s 2024-09-17T03:41:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.319 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692759 s, 151 MB/s 2024-09-17T03:41:26.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.327 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626182 s, 167 MB/s 2024-09-17T03:41:26.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680063 s, 154 MB/s 2024-09-17T03:41:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059247 s, 177 MB/s 2024-09-17T03:41:26.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662607 s, 158 MB/s 2024-09-17T03:41:26.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.361 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737811 s, 142 MB/s 2024-09-17T03:41:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684545 s, 153 MB/s 2024-09-17T03:41:26.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075488 s, 139 MB/s 2024-09-17T03:41:26.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.387 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685104 s, 153 MB/s 2024-09-17T03:41:26.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673237 s, 156 MB/s 2024-09-17T03:41:26.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.404 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669638 s, 157 MB/s 2024-09-17T03:41:26.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.414 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731566 s, 143 MB/s 2024-09-17T03:41:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648785 s, 162 MB/s 2024-09-17T03:41:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607482 s, 173 MB/s 2024-09-17T03:41:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643102 s, 163 MB/s 2024-09-17T03:41:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749709 s, 140 MB/s 2024-09-17T03:41:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.455 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645532 s, 162 MB/s 2024-09-17T03:41:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750325 s, 140 MB/s 2024-09-17T03:41:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:26.471 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:41:26.471 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:41:26.471 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.31 2024-09-17T03:41:26.471 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:41:26.471 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:41:26.471 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:41:26.471 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:41:26.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:41:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775561 s, 135 MB/s 2024-09-17T03:41:26.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607918 s, 172 MB/s 2024-09-17T03:41:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.548 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617015 s, 170 MB/s 2024-09-17T03:41:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613909 s, 171 MB/s 2024-09-17T03:41:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652083 s, 161 MB/s 2024-09-17T03:41:26.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739572 s, 142 MB/s 2024-09-17T03:41:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678794 s, 154 MB/s 2024-09-17T03:41:26.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006174 s, 170 MB/s 2024-09-17T03:41:26.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653252 s, 161 MB/s 2024-09-17T03:41:26.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640591 s, 164 MB/s 2024-09-17T03:41:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684685 s, 153 MB/s 2024-09-17T03:41:26.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.623 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661872 s, 158 MB/s 2024-09-17T03:41:26.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.631 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065697 s, 160 MB/s 2024-09-17T03:41:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625995 s, 168 MB/s 2024-09-17T03:41:26.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.648 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725312 s, 145 MB/s 2024-09-17T03:41:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657084 s, 160 MB/s 2024-09-17T03:41:26.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.666 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762193 s, 138 MB/s 2024-09-17T03:41:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.675 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690551 s, 152 MB/s 2024-09-17T03:41:26.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.682 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606455 s, 173 MB/s 2024-09-17T03:41:26.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.691 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678861 s, 154 MB/s 2024-09-17T03:41:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659445 s, 159 MB/s 2024-09-17T03:41:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.707 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612601 s, 171 MB/s 2024-09-17T03:41:26.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.715 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605794 s, 173 MB/s 2024-09-17T03:41:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718629 s, 146 MB/s 2024-09-17T03:41:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.732 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589034 s, 178 MB/s 2024-09-17T03:41:26.741 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.742 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803335 s, 131 MB/s 2024-09-17T03:41:26.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.751 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719403 s, 146 MB/s 2024-09-17T03:41:26.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.759 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633289 s, 166 MB/s 2024-09-17T03:41:26.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731042 s, 143 MB/s 2024-09-17T03:41:26.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.776 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650386 s, 161 MB/s 2024-09-17T03:41:26.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.784 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654438 s, 160 MB/s 2024-09-17T03:41:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:41:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:41:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652712 s, 161 MB/s 2024-09-17T03:41:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:41:26.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:26.799 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-09-17T03:41:26.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.916+0000 7f14aea27640 1 -- 172.21.15.146:0/1954584501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a80cdc50 msgr2=0x7f14a80b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.916+0000 7f14aea27640 1 --2- 172.21.15.146:0/1954584501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a80cdc50 0x7f14a80b4ba0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f14a0005fd0 tx=0x7f14a002aa10 comp rx=0 tx=0).stop 2024-09-17T03:41:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.916+0000 7f14aea27640 1 -- 172.21.15.146:0/1954584501 shutdown_connections 2024-09-17T03:41:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.916+0000 7f14aea27640 1 --2- 172.21.15.146:0/1954584501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a80cdc50 0x7f14a80b4ba0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.916+0000 7f14aea27640 1 --2- 172.21.15.146:0/1954584501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a80cd840 0x7f14a80b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.916+0000 7f14aea27640 1 -- 172.21.15.146:0/1954584501 >> 172.21.15.146:0/1954584501 conn(0x7f14a80b3150 msgr2=0x7f14a80b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.916+0000 7f14aea27640 1 -- 172.21.15.146:0/1954584501 shutdown_connections 2024-09-17T03:41:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.916+0000 7f14aea27640 1 -- 172.21.15.146:0/1954584501 wait complete. 2024-09-17T03:41:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.918+0000 7f14aea27640 1 Processor -- start 2024-09-17T03:41:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.918+0000 7f14aea27640 1 -- start start 2024-09-17T03:41:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.919+0000 7f14aea27640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a80cd840 0x7f14a81f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.919+0000 7f14aea27640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a80cdc50 0x7f14a8140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.919+0000 7f14aea27640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a815c8e0 0x7f14a806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.919+0000 7f14aea27640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f14a8073580 con 0x7f14a80cdc50 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.919+0000 7f14aea27640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14a80b5400 con 0x7f14a80cd840 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.919+0000 7f14aea27640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f14a8073700 con 0x7f14a815c8e0 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.919+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a80cdc50 0x7f14a8140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.919+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a80cdc50 0x7f14a8140630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59754/0 (socket says 172.21.15.146:59754) 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.919+0000 7f14a77fe640 1 -- 172.21.15.146:0/170660585 learned_addr learned my addr 172.21.15.146:0/170660585 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14acfc4640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a815c8e0 0x7f14a806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14a7fff640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a80cd840 0x7f14a81f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14a77fe640 1 -- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a815c8e0 msgr2=0x7f14a806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14a77fe640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a815c8e0 0x7f14a806cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14a77fe640 1 -- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a80cd840 msgr2=0x7f14a81f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14a77fe640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a80cd840 0x7f14a81f7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14a77fe640 1 -- 172.21.15.146:0/170660585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a81564d0 con 0x7f14a80cdc50 2024-09-17T03:41:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14a77fe640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a80cdc50 0x7f14a8140630 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f149c00d750 tx=0x7f149c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14a4ff9640 1 -- 172.21.15.146:0/170660585 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c017070 con 0x7f14a80cdc50 2024-09-17T03:41:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14a4ff9640 1 -- 172.21.15.146:0/170660585 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f149c009d20 con 0x7f14a80cdc50 2024-09-17T03:41:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14aea27640 1 -- 172.21.15.146:0/170660585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a81e68d0 con 0x7f14a80cdc50 2024-09-17T03:41:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14a4ff9640 1 -- 172.21.15.146:0/170660585 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c0106c0 con 0x7f14a80cdc50 2024-09-17T03:41:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.920+0000 7f14aea27640 1 -- 172.21.15.146:0/170660585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a81e6e90 con 0x7f14a80cdc50 2024-09-17T03:41:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.922+0000 7f14a4ff9640 1 -- 172.21.15.146:0/170660585 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f149c01a070 con 0x7f14a80cdc50 2024-09-17T03:41:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.922+0000 7f14a4ff9640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1494078b90 0x7f149407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.922+0000 7f14a4ff9640 1 -- 172.21.15.146:0/170660585 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f149c09ae90 con 0x7f14a80cdc50 2024-09-17T03:41:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.923+0000 7f14a7fff640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1494078b90 0x7f149407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.923+0000 7f14a7fff640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1494078b90 0x7f149407b0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1498001720 tx=0x7f1498009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:26.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.923+0000 7f14b5a69740 1 Processor -- start 2024-09-17T03:41:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.924+0000 7f14b5a69740 1 -- start start 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c4f730 0x558d7a03edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c26870 0x558d7a021ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a022000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14b5a69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558d79f69c40 con 0x558d79c4f730 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14b5a69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558d79f59070 con 0x558d79c2ea50 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14b5a69740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x558d79f5ce80 con 0x558d79c26870 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c4f730 0x558d7a03edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c4f730 0x558d7a03edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59756/0 (socket says 172.21.15.146:59756) 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14a7fff640 1 -- 172.21.15.146:0/3520390317 learned_addr learned my addr 172.21.15.146:0/3520390317 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14a77fe640 1 --2- 172.21.15.146:0/3520390317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c26870 0x558d7a021ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14acfc4640 1 --2- 172.21.15.146:0/3520390317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a022000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14a7fff640 1 -- 172.21.15.146:0/3520390317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c26870 msgr2=0x558d7a021ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:26.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14a7fff640 1 --2- 172.21.15.146:0/3520390317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c26870 0x558d7a021ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14a7fff640 1 -- 172.21.15.146:0/3520390317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 msgr2=0x558d7a022000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14a7fff640 1 --2- 172.21.15.146:0/3520390317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a022000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14a7fff640 1 -- 172.21.15.146:0/3520390317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d79d33ba0 con 0x558d79c4f730 2024-09-17T03:41:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f14a7fff640 1 --2- 172.21.15.146:0/3520390317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c4f730 0x558d7a03edf0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f149800f9a0 tx=0x7f1498012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b2aa5968d36e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.925+0000 7f148dffb640 1 -- 172.21.15.146:0/3520390317 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498025070 con 0x558d79c4f730 2024-09-17T03:41:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.926+0000 7f148dffb640 1 -- 172.21.15.146:0/3520390317 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f149801b050 con 0x558d79c4f730 2024-09-17T03:41:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.926+0000 7f148dffb640 1 -- 172.21.15.146:0/3520390317 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498014e40 con 0x558d79c4f730 2024-09-17T03:41:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.926+0000 7f14b5a69740 1 -- 172.21.15.146:0/3520390317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c4f730 msgr2=0x558d7a03edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.926+0000 7f14b5a69740 1 --2- 172.21.15.146:0/3520390317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c4f730 0x558d7a03edf0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f149800f9a0 tx=0x7f1498012000 comp rx=0 tx=0).stop 2024-09-17T03:41:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.926+0000 7f14b5a69740 1 -- 172.21.15.146:0/3520390317 shutdown_connections 2024-09-17T03:41:26.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.926+0000 7f14b5a69740 1 --2- 172.21.15.146:0/3520390317 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a022000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.926+0000 7f14b5a69740 1 --2- 172.21.15.146:0/3520390317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c26870 0x558d7a021ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.926+0000 7f14b5a69740 1 --2- 172.21.15.146:0/3520390317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c4f730 0x558d7a03edf0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.926+0000 7f14b5a69740 1 -- 172.21.15.146:0/3520390317 >> 172.21.15.146:0/3520390317 conn(0x558d79c43880 msgr2=0x558d79ff7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.926+0000 7f14b5a69740 1 -- 172.21.15.146:0/3520390317 shutdown_connections 2024-09-17T03:41:26.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.926+0000 7f14b5a69740 1 -- 172.21.15.146:0/3520390317 wait complete. 2024-09-17T03:41:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.927+0000 7f14b5a69740 1 -- start start 2024-09-17T03:41:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.927+0000 7f14b5a69740 1 Processor -- start 2024-09-17T03:41:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c26870 0x558d7a01b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c2ea50 0x558d7a020de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a010180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14b5a69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558d79cc9ae0 con 0x558d79c2ea50 2024-09-17T03:41:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14b5a69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558d79edf870 con 0x558d79c26870 2024-09-17T03:41:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14b5a69740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x558d7a01d3d0 con 0x558d79c4f730 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14b5a69740 10 client.0 _ll_register_callbacks cb 0x558d79f0d2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c2ea50 0x558d7a020de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14a77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c2ea50 0x558d7a020de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59758/0 (socket says 172.21.15.146:59758) 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14a77fe640 1 -- 172.21.15.146:0/153051166 learned_addr learned my addr 172.21.15.146:0/153051166 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14acfc4640 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a010180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14a7fff640 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c26870 0x558d7a01b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14a77fe640 1 -- 172.21.15.146:0/153051166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 msgr2=0x558d7a010180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14a77fe640 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a010180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14a77fe640 1 -- 172.21.15.146:0/153051166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c26870 msgr2=0x558d7a01b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14a77fe640 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c26870 0x558d7a01b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14a77fe640 1 -- 172.21.15.146:0/153051166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d79c98a40 con 0x558d79c2ea50 2024-09-17T03:41:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f14a77fe640 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c2ea50 0x558d7a020de0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f149c05fef0 tx=0x7f149c062b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7d9c251738c175 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.929+0000 7f1486ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f1486ffd640 1 -- 172.21.15.146:0/153051166 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c021040 con 0x558d79c2ea50 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f1486ffd640 1 -- 172.21.15.146:0/153051166 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f149c0673f0 con 0x558d79c2ea50 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f14b5a69740 1 -- 172.21.15.146:0/153051166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f149801b050 con 0x558d79c2ea50 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f1486ffd640 1 -- 172.21.15.146:0/153051166 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f149c00de60 con 0x558d79c2ea50 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f14b5a69740 10 client.8835 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f14b5a69740 1 -- 172.21.15.146:0/153051166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x558d79d94330 con 0x558d79c2ea50 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f1486ffd640 1 -- 172.21.15.146:0/153051166 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f149801b050 con 0x558d79c2ea50 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f1486ffd640 1 -- 172.21.15.146:0/153051166 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f149c061ee0 con 0x558d79c2ea50 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f14b5a69740 10 client.8835 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f14b5a69740 10 client.8835 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f14b5a69740 20 client.8835 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f14b5a69740 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x558d79c0e300 0x558d7a033690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f14b5a69740 4 client.8835 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f14b5a69740 1 -- 172.21.15.146:0/153051166 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d79f6bb90 con 0x558d79c0e300 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f14a7fff640 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x558d79c0e300 0x558d7a033690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f1486ffd640 10 client.8835 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.930+0000 7f14a7fff640 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x558d79c0e300 0x558d7a033690 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b6556724688f8f2 server_cookie=800aa8a877650771 in_seq=0 out_seq=0 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f1486ffd640 1 -- 172.21.15.146:0/153051166 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d79f6bb90 con 0x558d79c0e300 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f1486ffd640 10 client.8835 handle_command_reply: tid=0 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f14b5a69740 1 client.8835 shutdown 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f14b5a69740 1 -- 172.21.15.146:0/153051166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c2ea50 msgr2=0x558d7a020de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f14b5a69740 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c2ea50 0x558d7a020de0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f149c05fef0 tx=0x7f149c062b70 comp rx=0 tx=0).stop 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f14b5a69740 1 -- 172.21.15.146:0/153051166 shutdown_connections 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f14b5a69740 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x558d79c0e300 0x558d7a033690 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f14b5a69740 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a010180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f14b5a69740 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c2ea50 0x558d7a020de0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f1486ffd640 0 client.8835 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f14b5a69740 1 --2- 172.21.15.146:0/153051166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c26870 0x558d7a01b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f14b5a69740 1 -- 172.21.15.146:0/153051166 >> 172.21.15.146:0/153051166 conn(0x558d79c43880 msgr2=0x558d79ff7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f14b5a69740 1 -- 172.21.15.146:0/153051166 shutdown_connections 2024-09-17T03:41:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.931+0000 7f14b5a69740 1 -- 172.21.15.146:0/153051166 wait complete. 2024-09-17T03:41:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.932+0000 7f14b5a69740 20 client.8835 trim_cache size 0 max 16384 2024-09-17T03:41:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.949+0000 7f14b5a69740 1 Processor -- start 2024-09-17T03:41:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.949+0000 7f14b5a69740 1 -- start start 2024-09-17T03:41:26.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d79ff8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a019370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a0198b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14b5a69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f14a8200170 con 0x558d79c26870 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14b5a69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14a81ff1b0 con 0x558d79c2ea50 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14b5a69740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f14a8156e80 con 0x558d79c4f730 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d79ff8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d79ff8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59774/0 (socket says 172.21.15.146:59774) 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14a7fff640 1 -- 172.21.15.146:0/179061303 learned_addr learned my addr 172.21.15.146:0/179061303 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14acfc4640 1 --2- 172.21.15.146:0/179061303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a0198b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14a77fe640 1 --2- 172.21.15.146:0/179061303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a019370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14a7fff640 1 -- 172.21.15.146:0/179061303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 msgr2=0x558d7a0198b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14a7fff640 1 --2- 172.21.15.146:0/179061303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a0198b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14a7fff640 1 -- 172.21.15.146:0/179061303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 msgr2=0x558d7a019370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14a7fff640 1 --2- 172.21.15.146:0/179061303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a019370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14a7fff640 1 -- 172.21.15.146:0/179061303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7a021150 con 0x558d79c26870 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f14a7fff640 1 --2- 172.21.15.146:0/179061303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d79ff8d00 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f149800f970 tx=0x7f1498000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88cfe457ee5309 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f148d7fa640 1 -- 172.21.15.146:0/179061303 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498039070 con 0x558d79c26870 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f148d7fa640 1 -- 172.21.15.146:0/179061303 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f149801b040 con 0x558d79c26870 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.951+0000 7f148d7fa640 1 -- 172.21.15.146:0/179061303 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498025040 con 0x558d79c26870 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.952+0000 7f14b5a69740 1 -- 172.21.15.146:0/179061303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 msgr2=0x558d79ff8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.952+0000 7f14b5a69740 1 --2- 172.21.15.146:0/179061303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d79ff8d00 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f149800f970 tx=0x7f1498000ed0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.952+0000 7f14b5a69740 1 -- 172.21.15.146:0/179061303 shutdown_connections 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.952+0000 7f14b5a69740 1 --2- 172.21.15.146:0/179061303 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a0198b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.952+0000 7f14b5a69740 1 --2- 172.21.15.146:0/179061303 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a019370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.952+0000 7f14b5a69740 1 --2- 172.21.15.146:0/179061303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d79ff8d00 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.952+0000 7f14b5a69740 1 -- 172.21.15.146:0/179061303 >> 172.21.15.146:0/179061303 conn(0x558d79c43880 msgr2=0x558d7a00ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:26.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.952+0000 7f14b5a69740 1 -- 172.21.15.146:0/179061303 shutdown_connections 2024-09-17T03:41:26.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.952+0000 7f14b5a69740 1 -- 172.21.15.146:0/179061303 wait complete. 2024-09-17T03:41:26.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.953+0000 7f14b5a69740 1 -- start start 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.953+0000 7f14b5a69740 1 Processor -- start 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d7a0b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a034840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14b5a69740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a034d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14b5a69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f14a81574d0 con 0x558d79c26870 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14b5a69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558d79f6bb90 con 0x558d79c2ea50 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14b5a69740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x558d7a01a910 con 0x558d79c4f730 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14b5a69740 10 client.0 _ll_register_callbacks cb 0x7f149c00d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d7a0b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14a7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d7a0b97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59778/0 (socket says 172.21.15.146:59778) 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14a7fff640 1 -- 172.21.15.146:0/2077696794 learned_addr learned my addr 172.21.15.146:0/2077696794 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:26.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14a77fe640 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a034840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14acfc4640 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a034d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14a7fff640 1 -- 172.21.15.146:0/2077696794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 msgr2=0x558d7a034d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14a7fff640 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a034d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14a7fff640 1 -- 172.21.15.146:0/2077696794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 msgr2=0x558d7a034840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14a7fff640 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a034840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14a7fff640 1 -- 172.21.15.146:0/2077696794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7a00fd60 con 0x558d79c26870 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14a7fff640 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d7a0b97a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f1498037040 tx=0x7f1498014950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebae18d23710cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f1486ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f1486ffd640 1 -- 172.21.15.146:0/2077696794 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498025030 con 0x558d79c26870 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f1486ffd640 1 -- 172.21.15.146:0/2077696794 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f149802d720 con 0x558d79c26870 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.955+0000 7f14b5a69740 1 -- 172.21.15.146:0/2077696794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f149801b040 con 0x558d79c26870 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f1486ffd640 1 -- 172.21.15.146:0/2077696794 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f1498039030 con 0x558d79c26870 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f14b5a69740 10 client.8841 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f14b5a69740 1 -- 172.21.15.146:0/2077696794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x558d79d31ea0 con 0x558d79c26870 2024-09-17T03:41:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f1486ffd640 1 -- 172.21.15.146:0/2077696794 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f149801b040 con 0x558d79c26870 2024-09-17T03:41:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f1486ffd640 1 -- 172.21.15.146:0/2077696794 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f149802d960 con 0x558d79c26870 2024-09-17T03:41:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f14b5a69740 10 client.8841 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f14b5a69740 10 client.8841 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-17T03:41:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f14b5a69740 20 client.8841 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f14b5a69740 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x558d79ff8320 0x558d7a0bc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f14b5a69740 4 client.8841 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-17T03:41:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f14b5a69740 1 -- 172.21.15.146:0/2077696794 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x558d79f67640 con 0x558d79ff8320 2024-09-17T03:41:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f14a77fe640 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x558d79ff8320 0x558d7a0bc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f1486ffd640 10 client.8841 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:26.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.956+0000 7f14a77fe640 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x558d79ff8320 0x558d7a0bc350 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=771fe79f42c1550b server_cookie=7f0724d4dfeb6f1d in_seq=0 out_seq=0 2024-09-17T03:41:26.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f1486ffd640 1 -- 172.21.15.146:0/2077696794 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558d79f67640 con 0x558d79ff8320 2024-09-17T03:41:26.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f1486ffd640 10 client.8841 handle_command_reply: tid=0 2024-09-17T03:41:26.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f14b5a69740 1 client.8841 shutdown 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f14b5a69740 1 -- 172.21.15.146:0/2077696794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 msgr2=0x558d7a0b97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f14b5a69740 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d7a0b97a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f1498037040 tx=0x7f1498014950 comp rx=0 tx=0).stop 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f14b5a69740 1 -- 172.21.15.146:0/2077696794 shutdown_connections 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f14b5a69740 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x558d79ff8320 0x558d7a0bc350 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f14b5a69740 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558d79c4f730 0x558d7a034d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f14b5a69740 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558d79c2ea50 0x558d7a034840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f1486ffd640 0 client.8841 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f14b5a69740 1 --2- 172.21.15.146:0/2077696794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d79c26870 0x558d7a0b97a0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f14b5a69740 1 -- 172.21.15.146:0/2077696794 >> 172.21.15.146:0/2077696794 conn(0x558d79c43880 msgr2=0x558d7a01b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f14b5a69740 1 -- 172.21.15.146:0/2077696794 shutdown_connections 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.959+0000 7f14b5a69740 1 -- 172.21.15.146:0/2077696794 wait complete. 2024-09-17T03:41:26.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14b5a69740 20 client.8841 trim_cache size 0 max 16384 2024-09-17T03:41:26.963 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:41:26.963 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:41:26.963 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "d827d267-7e6c-4ed3-ab08-484ceb637a01", 2024-09-17T03:41:26.963 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:41:26.963 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:41:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 -- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1494078b90 msgr2=0x7f149407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1494078b90 0x7f149407b0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1498001720 tx=0x7f1498009040 comp rx=0 tx=0).stop 2024-09-17T03:41:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 -- 172.21.15.146:0/170660585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a80cdc50 msgr2=0x7f14a8140630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a80cdc50 0x7f14a8140630 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f149c00d750 tx=0x7f149c00dc10 comp rx=0 tx=0).stop 2024-09-17T03:41:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 -- 172.21.15.146:0/170660585 shutdown_connections 2024-09-17T03:41:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1494078b90 0x7f149407b0a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14a815c8e0 0x7f14a806cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a80cdc50 0x7f14a8140630 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 --2- 172.21.15.146:0/170660585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14a80cd840 0x7f14a81f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 -- 172.21.15.146:0/170660585 >> 172.21.15.146:0/170660585 conn(0x7f14a80b3150 msgr2=0x7f14a80b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 -- 172.21.15.146:0/170660585 shutdown_connections 2024-09-17T03:41:26.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:26.960+0000 7f14aea27640 1 -- 172.21.15.146:0/170660585 wait complete. 2024-09-17T03:41:26.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:26.972 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-09-17T03:41:27.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.093+0000 7ffa7e025640 1 -- 172.21.15.146:0/1482808029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa780cf370 msgr2=0x7ffa7806ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.093+0000 7ffa7e025640 1 --2- 172.21.15.146:0/1482808029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa780cf370 0x7ffa7806ed30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009860 tx=0x7ffa6c02a510 comp rx=0 tx=0).stop 2024-09-17T03:41:27.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.094+0000 7ffa7e025640 1 -- 172.21.15.146:0/1482808029 shutdown_connections 2024-09-17T03:41:27.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.094+0000 7ffa7e025640 1 --2- 172.21.15.146:0/1482808029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa780cf370 0x7ffa7806ed30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.094+0000 7ffa7e025640 1 -- 172.21.15.146:0/1482808029 >> 172.21.15.146:0/1482808029 conn(0x7ffa780d4be0 msgr2=0x7ffa780d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.094+0000 7ffa7e025640 1 -- 172.21.15.146:0/1482808029 shutdown_connections 2024-09-17T03:41:27.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.094+0000 7ffa7e025640 1 -- 172.21.15.146:0/1482808029 wait complete. 2024-09-17T03:41:27.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.096+0000 7ffa7e025640 1 Processor -- start 2024-09-17T03:41:27.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.096+0000 7ffa7e025640 1 -- start start 2024-09-17T03:41:27.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.098+0000 7ffa7e025640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa7806f270 0x7ffa780b8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.098+0000 7ffa7e025640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa780b3870 0x7ffa780b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.098+0000 7ffa7e025640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa780cf370 0x7ffa78150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.098+0000 7ffa7e025640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffa780d3d40 con 0x7ffa7806f270 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.098+0000 7ffa7e025640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffa780d3bc0 con 0x7ffa780cf370 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.098+0000 7ffa7e025640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffa780d3ec0 con 0x7ffa780b3870 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.098+0000 7ffa777fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa7806f270 0x7ffa780b8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.098+0000 7ffa777fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa7806f270 0x7ffa780b8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59782/0 (socket says 172.21.15.146:59782) 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.098+0000 7ffa777fe640 1 -- 172.21.15.146:0/513487412 learned_addr learned my addr 172.21.15.146:0/513487412 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.098+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa780b3870 0x7ffa780b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.098+0000 7ffa77fff640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa780cf370 0x7ffa78150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa76ffd640 1 -- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa780cf370 msgr2=0x7ffa78150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa780cf370 0x7ffa78150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa76ffd640 1 -- 172.21.15.146:0/513487412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa7806f270 msgr2=0x7ffa780b8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa7806f270 0x7ffa780b8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa76ffd640 1 -- 172.21.15.146:0/513487412 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa780cbbd0 con 0x7ffa780b3870 2024-09-17T03:41:27.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa777fe640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa7806f270 0x7ffa780b8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:41:27.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa780b3870 0x7ffa780b93d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa7808d860 tx=0x7ffa6c033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa5ffff640 1 -- 172.21.15.146:0/513487412 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c005c90 con 0x7ffa780b3870 2024-09-17T03:41:27.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa5ffff640 1 -- 172.21.15.146:0/513487412 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa6c033e10 con 0x7ffa780b3870 2024-09-17T03:41:27.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa5ffff640 1 -- 172.21.15.146:0/513487412 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c005280 con 0x7ffa780b3870 2024-09-17T03:41:27.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa7e025640 1 -- 172.21.15.146:0/513487412 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa780cbeb0 con 0x7ffa780b3870 2024-09-17T03:41:27.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.099+0000 7ffa7e025640 1 -- 172.21.15.146:0/513487412 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa780cc470 con 0x7ffa780b3870 2024-09-17T03:41:27.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.101+0000 7ffa5ffff640 1 -- 172.21.15.146:0/513487412 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa6c005420 con 0x7ffa780b3870 2024-09-17T03:41:27.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.102+0000 7ffa5ffff640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa64078b90 0x7ffa6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.102+0000 7ffa5ffff640 1 -- 172.21.15.146:0/513487412 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7ffa6c0bbc30 con 0x7ffa780b3870 2024-09-17T03:41:27.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.102+0000 7ffa777fe640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa64078b90 0x7ffa6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.103+0000 7ffa777fe640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa64078b90 0x7ffa6407b0a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ffa68001120 tx=0x7ffa68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.104+0000 7ffa85074740 1 Processor -- start 2024-09-17T03:41:27.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.104+0000 7ffa85074740 1 -- start start 2024-09-17T03:41:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.106+0000 7ffa85074740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7efb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.106+0000 7ffa85074740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7d2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.106+0000 7ffa85074740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7d2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.106+0000 7ffa85074740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561c7d71bbd0 con 0x561c7d3d84d0 2024-09-17T03:41:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.106+0000 7ffa85074740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561c7d70b000 con 0x561c7d3e06b0 2024-09-17T03:41:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.106+0000 7ffa85074740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561c7d70ee10 con 0x561c7d401390 2024-09-17T03:41:27.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa76ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa77fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7d2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa777fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa76ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7d2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59794/0 (socket says 172.21.15.146:59794) 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa76ffd640 1 -- 172.21.15.146:0/2249805023 learned_addr learned my addr 172.21.15.146:0/2249805023 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa77fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7d2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:52296/0 (socket says 172.21.15.146:52296) 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa76ffd640 1 -- 172.21.15.146:0/2249805023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 msgr2=0x561c7d7efb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/2249805023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7efb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa76ffd640 1 -- 172.21.15.146:0/2249805023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 msgr2=0x561c7d7d2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/2249805023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7d2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa76ffd640 1 -- 172.21.15.146:0/2249805023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c7d4e37d0 con 0x561c7d3d84d0 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/2249805023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7d2830 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c083a40 tx=0x7ffa6c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c14ac19320c30ec server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa5d7fa640 1 -- 172.21.15.146:0/2249805023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0a7030 con 0x561c7d3d84d0 2024-09-17T03:41:27.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa5d7fa640 1 -- 172.21.15.146:0/2249805023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa6c0317a0 con 0x561c7d3d84d0 2024-09-17T03:41:27.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.107+0000 7ffa5d7fa640 1 -- 172.21.15.146:0/2249805023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c048070 con 0x561c7d3d84d0 2024-09-17T03:41:27.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.108+0000 7ffa85074740 1 -- 172.21.15.146:0/2249805023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 msgr2=0x561c7d7d2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.108+0000 7ffa85074740 1 --2- 172.21.15.146:0/2249805023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7d2830 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c083a40 tx=0x7ffa6c005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:27.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.108+0000 7ffa85074740 1 -- 172.21.15.146:0/2249805023 shutdown_connections 2024-09-17T03:41:27.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.108+0000 7ffa85074740 1 --2- 172.21.15.146:0/2249805023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7d2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.108+0000 7ffa85074740 1 --2- 172.21.15.146:0/2249805023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7d2830 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.108+0000 7ffa85074740 1 --2- 172.21.15.146:0/2249805023 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7efb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.108+0000 7ffa85074740 1 -- 172.21.15.146:0/2249805023 >> 172.21.15.146:0/2249805023 conn(0x561c7d3f54e0 msgr2=0x561c7d7a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.108+0000 7ffa85074740 1 -- 172.21.15.146:0/2249805023 shutdown_connections 2024-09-17T03:41:27.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.108+0000 7ffa85074740 1 -- 172.21.15.146:0/2249805023 wait complete. 2024-09-17T03:41:27.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.109+0000 7ffa85074740 1 -- start start 2024-09-17T03:41:27.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.109+0000 7ffa85074740 1 Processor -- start 2024-09-17T03:41:27.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa85074740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7eded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa85074740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa85074740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa85074740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561c7d47b740 con 0x561c7d3d84d0 2024-09-17T03:41:27.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa85074740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561c7d6b0540 con 0x561c7d3e06b0 2024-09-17T03:41:27.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa85074740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561c7d71bbd0 con 0x561c7d401390 2024-09-17T03:41:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa777fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7eded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa777fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7eded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59810/0 (socket says 172.21.15.146:59810) 2024-09-17T03:41:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa777fe640 1 -- 172.21.15.146:0/1506340881 learned_addr learned my addr 172.21.15.146:0/1506340881 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa76ffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa77fff640 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.111+0000 7ffa85074740 10 client.0 _ll_register_callbacks cb 0x561c7d6af0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa777fe640 1 -- 172.21.15.146:0/1506340881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 msgr2=0x561c7d7e95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa777fe640 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7e95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa777fe640 1 -- 172.21.15.146:0/1506340881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 msgr2=0x561c7d7e66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa777fe640 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7e66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa777fe640 1 -- 172.21.15.146:0/1506340881 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c7d44a6a0 con 0x561c7d3d84d0 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa777fe640 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7eded0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7ffa680149d0 tx=0x7ffa68000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c2a6f53bb44ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa567fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa567fc640 1 -- 172.21.15.146:0/1506340881 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa68025020 con 0x561c7d3d84d0 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa567fc640 1 -- 172.21.15.146:0/1506340881 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7ffa68013b40 con 0x561c7d3d84d0 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa85074740 1 -- 172.21.15.146:0/1506340881 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa6c0317a0 con 0x561c7d3d84d0 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa567fc640 1 -- 172.21.15.146:0/1506340881 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7ffa6802f050 con 0x561c7d3d84d0 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa85074740 10 client.8853 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa85074740 1 -- 172.21.15.146:0/1506340881 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x561c7d543f60 con 0x561c7d3d84d0 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa567fc640 1 -- 172.21.15.146:0/1506340881 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa6c0317a0 con 0x561c7d3d84d0 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.112+0000 7ffa567fc640 1 -- 172.21.15.146:0/1506340881 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7ffa68032020 con 0x561c7d3d84d0 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.113+0000 7ffa85074740 10 client.8853 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.113+0000 7ffa85074740 10 client.8853 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-17T03:41:27.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.113+0000 7ffa85074740 20 client.8853 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.113+0000 7ffa85074740 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561c7d3bff60 0x561c7d7fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.113+0000 7ffa85074740 4 client.8853 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:41:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.113+0000 7ffa85074740 1 -- 172.21.15.146:0/1506340881 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c7d71db20 con 0x561c7d3bff60 2024-09-17T03:41:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.113+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561c7d3bff60 0x561c7d7fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.113+0000 7ffa567fc640 10 client.8853 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.113+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561c7d3bff60 0x561c7d7fffa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6abe291e2a34ed5 server_cookie=3fd7280b8db07c41 in_seq=0 out_seq=0 2024-09-17T03:41:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.115+0000 7ffa567fc640 1 -- 172.21.15.146:0/1506340881 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561c7d71db20 con 0x561c7d3bff60 2024-09-17T03:41:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.115+0000 7ffa567fc640 10 client.8853 handle_command_reply: tid=0 2024-09-17T03:41:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.115+0000 7ffa85074740 1 client.8853 shutdown 2024-09-17T03:41:27.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa85074740 1 -- 172.21.15.146:0/1506340881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 msgr2=0x561c7d7eded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa85074740 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7eded0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7ffa680149d0 tx=0x7ffa68000fe0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa85074740 1 -- 172.21.15.146:0/1506340881 shutdown_connections 2024-09-17T03:41:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa85074740 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561c7d3bff60 0x561c7d7fffa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa85074740 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7e95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa85074740 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7e66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa85074740 1 --2- 172.21.15.146:0/1506340881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7eded0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa85074740 1 -- 172.21.15.146:0/1506340881 >> 172.21.15.146:0/1506340881 conn(0x561c7d3f54e0 msgr2=0x561c7d7f03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa567fc640 0 client.8853 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa85074740 1 -- 172.21.15.146:0/1506340881 shutdown_connections 2024-09-17T03:41:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa85074740 1 -- 172.21.15.146:0/1506340881 wait complete. 2024-09-17T03:41:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.116+0000 7ffa85074740 20 client.8853 trim_cache size 0 max 16384 2024-09-17T03:41:27.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.141+0000 7ffa85074740 1 Processor -- start 2024-09-17T03:41:27.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.141+0000 7ffa85074740 1 -- start start 2024-09-17T03:41:27.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa85074740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7edef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa85074740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7ef790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa85074740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7a9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa85074740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffa78202320 con 0x561c7d3d84d0 2024-09-17T03:41:27.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa85074740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7814f690 con 0x561c7d3e06b0 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa85074740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffa781fa3b0 con 0x561c7d401390 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa777fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa777fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7edef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59042/0 (socket says 172.21.15.146:59042) 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa777fe640 1 -- 172.21.15.146:0/952861629 learned_addr learned my addr 172.21.15.146:0/952861629 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/952861629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7ef790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa77fff640 1 --2- 172.21.15.146:0/952861629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa777fe640 1 -- 172.21.15.146:0/952861629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 msgr2=0x561c7d7a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa777fe640 1 --2- 172.21.15.146:0/952861629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7a9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa777fe640 1 -- 172.21.15.146:0/952861629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 msgr2=0x561c7d7ef790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa777fe640 1 --2- 172.21.15.146:0/952861629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7ef790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa777fe640 1 -- 172.21.15.146:0/952861629 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c7d4e1ad0 con 0x561c7d3d84d0 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.143+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/952861629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7ef790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.144+0000 7ffa777fe640 1 --2- 172.21.15.146:0/952861629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7edef0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ffa68013f30 tx=0x7ffa68013f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41078a3ba82356c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.144+0000 7ffa5cff9640 1 -- 172.21.15.146:0/952861629 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa68037020 con 0x561c7d3d84d0 2024-09-17T03:41:27.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.144+0000 7ffa5cff9640 1 -- 172.21.15.146:0/952861629 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa6801b070 con 0x561c7d3d84d0 2024-09-17T03:41:27.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.144+0000 7ffa5cff9640 1 -- 172.21.15.146:0/952861629 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa68025070 con 0x561c7d3d84d0 2024-09-17T03:41:27.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.145+0000 7ffa85074740 1 -- 172.21.15.146:0/952861629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 msgr2=0x561c7d7edef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.145+0000 7ffa85074740 1 --2- 172.21.15.146:0/952861629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7edef0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ffa68013f30 tx=0x7ffa68013f60 comp rx=0 tx=0).stop 2024-09-17T03:41:27.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.145+0000 7ffa85074740 1 -- 172.21.15.146:0/952861629 shutdown_connections 2024-09-17T03:41:27.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.145+0000 7ffa85074740 1 --2- 172.21.15.146:0/952861629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.145+0000 7ffa85074740 1 --2- 172.21.15.146:0/952861629 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3e06b0 0x561c7d7ef790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.145+0000 7ffa85074740 1 --2- 172.21.15.146:0/952861629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3d84d0 0x561c7d7edef0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.145+0000 7ffa85074740 1 -- 172.21.15.146:0/952861629 >> 172.21.15.146:0/952861629 conn(0x561c7d3f54e0 msgr2=0x561c7d7e3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.145+0000 7ffa85074740 1 -- 172.21.15.146:0/952861629 shutdown_connections 2024-09-17T03:41:27.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.145+0000 7ffa85074740 1 -- 172.21.15.146:0/952861629 wait complete. 2024-09-17T03:41:27.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.146+0000 7ffa85074740 1 -- start start 2024-09-17T03:41:27.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.146+0000 7ffa85074740 1 Processor -- start 2024-09-17T03:41:27.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa85074740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3d84d0 0x561c7d810cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa85074740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3e06b0 0x561c7d7cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa85074740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa85074740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561c7d79ee40 con 0x561c7d3e06b0 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa85074740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7814f040 con 0x561c7d3d84d0 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa85074740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561c7d6b04c0 con 0x561c7d401390 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa85074740 10 client.0 _ll_register_callbacks cb 0x7ffa68001dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa777fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3d84d0 0x561c7d810cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa777fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3d84d0 0x561c7d810cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:35154/0 (socket says 172.21.15.146:35154) 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa76ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3e06b0 0x561c7d7cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa777fe640 1 -- 172.21.15.146:0/4077195200 learned_addr learned my addr 172.21.15.146:0/4077195200 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa77fff640 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa76ffd640 1 -- 172.21.15.146:0/4077195200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 msgr2=0x561c7d7cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa76ffd640 1 -- 172.21.15.146:0/4077195200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3d84d0 msgr2=0x561c7d810cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3d84d0 0x561c7d810cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.148+0000 7ffa76ffd640 1 -- 172.21.15.146:0/4077195200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c7d8705d0 con 0x561c7d3e06b0 2024-09-17T03:41:27.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa76ffd640 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3e06b0 0x561c7d7cf140 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0a7000 tx=0x7ffa6c0ba030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8665ec5301a4686 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa567fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:27.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa567fc640 1 -- 172.21.15.146:0/4077195200 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0a1030 con 0x561c7d3e06b0 2024-09-17T03:41:27.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa567fc640 1 -- 172.21.15.146:0/4077195200 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7ffa6c07fd20 con 0x561c7d3e06b0 2024-09-17T03:41:27.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa85074740 1 -- 172.21.15.146:0/4077195200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa6801b070 con 0x561c7d3e06b0 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa567fc640 1 -- 172.21.15.146:0/4077195200 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7ffa6c048040 con 0x561c7d3e06b0 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa85074740 10 client.8859 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa85074740 1 -- 172.21.15.146:0/4077195200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x561c7d805d40 con 0x561c7d3e06b0 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa567fc640 1 -- 172.21.15.146:0/4077195200 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa6801b070 con 0x561c7d3e06b0 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa567fc640 1 -- 172.21.15.146:0/4077195200 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7ffa6c083d10 con 0x561c7d3e06b0 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa85074740 10 client.8859 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa85074740 10 client.8859 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa85074740 20 client.8859 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa85074740 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561c7d7f6aa0 0x561c7d86c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa85074740 4 client.8859 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa85074740 1 -- 172.21.15.146:0/4077195200 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x561c7d7195d0 con 0x561c7d7f6aa0 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.149+0000 7ffa777fe640 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561c7d7f6aa0 0x561c7d86c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.150+0000 7ffa777fe640 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561c7d7f6aa0 0x561c7d86c9b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b20323a51028807b server_cookie=ddd1a8d8e8054dbf in_seq=0 out_seq=0 2024-09-17T03:41:27.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.150+0000 7ffa567fc640 10 client.8859 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa567fc640 1 -- 172.21.15.146:0/4077195200 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561c7d7195d0 con 0x561c7d7f6aa0 2024-09-17T03:41:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa567fc640 10 client.8859 handle_command_reply: tid=0 2024-09-17T03:41:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 1 client.8859 shutdown 2024-09-17T03:41:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 1 -- 172.21.15.146:0/4077195200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3e06b0 msgr2=0x561c7d7cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3e06b0 0x561c7d7cf140 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0a7000 tx=0x7ffa6c0ba030 comp rx=0 tx=0).stop 2024-09-17T03:41:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 1 -- 172.21.15.146:0/4077195200 shutdown_connections 2024-09-17T03:41:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561c7d7f6aa0 0x561c7d86c9b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561c7d401390 0x561c7d7cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561c7d3e06b0 0x561c7d7cf140 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 1 --2- 172.21.15.146:0/4077195200 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561c7d3d84d0 0x561c7d810cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 1 -- 172.21.15.146:0/4077195200 >> 172.21.15.146:0/4077195200 conn(0x561c7d3f54e0 msgr2=0x561c7d7a9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa567fc640 0 client.8859 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 1 -- 172.21.15.146:0/4077195200 shutdown_connections 2024-09-17T03:41:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 1 -- 172.21.15.146:0/4077195200 wait complete. 2024-09-17T03:41:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.164+0000 7ffa85074740 20 client.8859 trim_cache size 0 max 16384 2024-09-17T03:41:27.167 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:41:27.167 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:41:27.167 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:41:27.168 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:41:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 -- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa64078b90 msgr2=0x7ffa6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa64078b90 0x7ffa6407b0a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ffa68001120 tx=0x7ffa68009040 comp rx=0 tx=0).stop 2024-09-17T03:41:27.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 -- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa780b3870 msgr2=0x7ffa780b93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa780b3870 0x7ffa780b93d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa7808d860 tx=0x7ffa6c033c20 comp rx=0 tx=0).stop 2024-09-17T03:41:27.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 -- 172.21.15.146:0/513487412 shutdown_connections 2024-09-17T03:41:27.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffa64078b90 0x7ffa6407b0a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa780cf370 0x7ffa78150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffa780b3870 0x7ffa780b93d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 --2- 172.21.15.146:0/513487412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa7806f270 0x7ffa780b8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 -- 172.21.15.146:0/513487412 >> 172.21.15.146:0/513487412 conn(0x7ffa780d4be0 msgr2=0x7ffa7815c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 -- 172.21.15.146:0/513487412 shutdown_connections 2024-09-17T03:41:27.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.165+0000 7ffa7e025640 1 -- 172.21.15.146:0/513487412 wait complete. 2024-09-17T03:41:27.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:27.177 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-17T03:41:27.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.293+0000 7fb831be4640 1 -- 172.21.15.146:0/1707338916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb82c0b5ce0 msgr2=0x7fb82c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.293+0000 7fb831be4640 1 --2- 172.21.15.146:0/1707338916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb82c0b5ce0 0x7fb82c0b1320 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb82c0b8440 tx=0x7fb81c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.293+0000 7fb831be4640 1 -- 172.21.15.146:0/1707338916 shutdown_connections 2024-09-17T03:41:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.293+0000 7fb831be4640 1 --2- 172.21.15.146:0/1707338916 >> v2:172.21.15.179:3300/0 conn(0x7fb82c0b5750 0x7fb82c0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.293+0000 7fb831be4640 1 --2- 172.21.15.146:0/1707338916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb82c0b5ce0 0x7fb82c0b1320 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.293+0000 7fb831be4640 1 -- 172.21.15.146:0/1707338916 >> 172.21.15.146:0/1707338916 conn(0x7fb82c0b7b20 msgr2=0x7fb82c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.293+0000 7fb831be4640 1 -- 172.21.15.146:0/1707338916 shutdown_connections 2024-09-17T03:41:27.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.293+0000 7fb831be4640 1 -- 172.21.15.146:0/1707338916 wait complete. 2024-09-17T03:41:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.295+0000 7fb831be4640 1 Processor -- start 2024-09-17T03:41:27.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.295+0000 7fb831be4640 1 -- start start 2024-09-17T03:41:27.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.296+0000 7fb831be4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb82c0b3b60 0x7fb82c1f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.296+0000 7fb831be4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb82c0b5750 0x7fb82c152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.296+0000 7fb831be4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb82c0b5ce0 0x7fb82c1f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.296+0000 7fb831be4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c0b27b0 con 0x7fb82c0b5ce0 2024-09-17T03:41:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.296+0000 7fb831be4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c15dcc0 con 0x7fb82c0b5750 2024-09-17T03:41:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.296+0000 7fb831be4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c0b2930 con 0x7fb82c0b3b60 2024-09-17T03:41:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.296+0000 7fb82bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb82c0b5ce0 0x7fb82c1f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.296+0000 7fb82bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb82c0b5ce0 0x7fb82c1f66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59062/0 (socket says 172.21.15.146:59062) 2024-09-17T03:41:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb82bfff640 1 -- 172.21.15.146:0/3302986990 learned_addr learned my addr 172.21.15.146:0/3302986990 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb82b7fe640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb82c0b3b60 0x7fb82c1f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb82affd640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb82c0b5750 0x7fb82c152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb82bfff640 1 -- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb82c0b3b60 msgr2=0x7fb82c1f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb82c0b3b60 0x7fb82c1f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb82bfff640 1 -- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb82c0b5750 msgr2=0x7fb82c152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb82c0b5750 0x7fb82c152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb82bfff640 1 -- 172.21.15.146:0/3302986990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c1533c0 con 0x7fb82c0b5ce0 2024-09-17T03:41:27.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb82affd640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb82c0b5750 0x7fb82c152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:27.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb82c0b5ce0 0x7fb82c1f66c0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fb82400c730 tx=0x7fb82400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb813fff640 1 -- 172.21.15.146:0/3302986990 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824003b70 con 0x7fb82c0b5ce0 2024-09-17T03:41:27.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb813fff640 1 -- 172.21.15.146:0/3302986990 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb824003d30 con 0x7fb82c0b5ce0 2024-09-17T03:41:27.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb813fff640 1 -- 172.21.15.146:0/3302986990 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8240052d0 con 0x7fb82c0b5ce0 2024-09-17T03:41:27.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb831be4640 1 -- 172.21.15.146:0/3302986990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82c1536a0 con 0x7fb82c0b5ce0 2024-09-17T03:41:27.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.297+0000 7fb831be4640 1 -- 172.21.15.146:0/3302986990 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c153c60 con 0x7fb82c0b5ce0 2024-09-17T03:41:27.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.300+0000 7fb813fff640 1 -- 172.21.15.146:0/3302986990 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb824005680 con 0x7fb82c0b5ce0 2024-09-17T03:41:27.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.300+0000 7fb813fff640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078bc0 0x7fb81807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.300+0000 7fb813fff640 1 -- 172.21.15.146:0/3302986990 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fb82409ac60 con 0x7fb82c0b5ce0 2024-09-17T03:41:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.300+0000 7fb82b7fe640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078bc0 0x7fb81807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.301+0000 7fb82b7fe640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078bc0 0x7fb81807b0d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb81c033000 tx=0x7fb81c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.301+0000 7fb838c32740 1 Processor -- start 2024-09-17T03:41:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.301+0000 7fb838c32740 1 -- start start 2024-09-17T03:41:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.302+0000 7fb838c32740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d390a390 0x5596d3cf6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.302+0000 7fb838c32740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 0x5596d3ccb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.302+0000 7fb838c32740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d38e96b0 0x5596d3ccbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.302+0000 7fb838c32740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5596d3c24a60 con 0x5596d38e96b0 2024-09-17T03:41:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.302+0000 7fb838c32740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5596d3c13e90 con 0x5596d390a390 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.302+0000 7fb838c32740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5596d3c17ca0 con 0x5596d38e14d0 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.302+0000 7fb82bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d38e96b0 0x5596d3ccbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.302+0000 7fb82b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d390a390 0x5596d3cf6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.302+0000 7fb82b7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d390a390 0x5596d3cf6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:35178/0 (socket says 172.21.15.146:35178) 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.302+0000 7fb82b7fe640 1 -- 172.21.15.146:0/3595333118 learned_addr learned my addr 172.21.15.146:0/3595333118 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.302+0000 7fb82affd640 1 --2- 172.21.15.146:0/3595333118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 0x5596d3ccb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.303+0000 7fb82bfff640 1 -- 172.21.15.146:0/3595333118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 msgr2=0x5596d3ccb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.303+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3595333118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 0x5596d3ccb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.303+0000 7fb82bfff640 1 -- 172.21.15.146:0/3595333118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d390a390 msgr2=0x5596d3cf6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.303+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3595333118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d390a390 0x5596d3cf6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.303+0000 7fb82bfff640 1 -- 172.21.15.146:0/3595333118 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d39ec7d0 con 0x5596d38e96b0 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.303+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3595333118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d38e96b0 0x5596d3ccbda0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fb8240991e0 tx=0x7fb824062440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba84f041f1620597 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.303+0000 7fb8117fa640 1 -- 172.21.15.146:0/3595333118 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824063130 con 0x5596d38e96b0 2024-09-17T03:41:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.303+0000 7fb8117fa640 1 -- 172.21.15.146:0/3595333118 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb824067510 con 0x5596d38e96b0 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.303+0000 7fb8117fa640 1 -- 172.21.15.146:0/3595333118 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82406c3c0 con 0x5596d38e96b0 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.304+0000 7fb838c32740 1 -- 172.21.15.146:0/3595333118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d38e96b0 msgr2=0x5596d3ccbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.304+0000 7fb838c32740 1 --2- 172.21.15.146:0/3595333118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d38e96b0 0x5596d3ccbda0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fb8240991e0 tx=0x7fb824062440 comp rx=0 tx=0).stop 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.304+0000 7fb838c32740 1 -- 172.21.15.146:0/3595333118 shutdown_connections 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.304+0000 7fb838c32740 1 --2- 172.21.15.146:0/3595333118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d38e96b0 0x5596d3ccbda0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.304+0000 7fb838c32740 1 --2- 172.21.15.146:0/3595333118 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 0x5596d3ccb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.304+0000 7fb838c32740 1 --2- 172.21.15.146:0/3595333118 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d390a390 0x5596d3cf6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.304+0000 7fb838c32740 1 -- 172.21.15.146:0/3595333118 >> 172.21.15.146:0/3595333118 conn(0x5596d38fe4e0 msgr2=0x5596d3cb1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.304+0000 7fb838c32740 1 -- 172.21.15.146:0/3595333118 shutdown_connections 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.304+0000 7fb838c32740 1 -- 172.21.15.146:0/3595333118 wait complete. 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.305+0000 7fb838c32740 1 -- start start 2024-09-17T03:41:27.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.305+0000 7fb838c32740 1 Processor -- start 2024-09-17T03:41:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb838c32740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e14d0 0x5596d3cec530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb838c32740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e96b0 0x5596d3cc29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb838c32740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cb0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb838c32740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5596d3984740 con 0x5596d390a390 2024-09-17T03:41:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb838c32740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5596d3bb9970 con 0x5596d38e14d0 2024-09-17T03:41:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb838c32740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5596d3c24a60 con 0x5596d38e96b0 2024-09-17T03:41:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb838c32740 10 client.0 _ll_register_callbacks cb 0x5596d3bc8780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb82bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cb0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb82bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cb0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59084/0 (socket says 172.21.15.146:59084) 2024-09-17T03:41:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb82bfff640 1 -- 172.21.15.146:0/3775378164 learned_addr learned my addr 172.21.15.146:0/3775378164 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb82b7fe640 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e14d0 0x5596d3cec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb82affd640 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e96b0 0x5596d3cc29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb82bfff640 1 -- 172.21.15.146:0/3775378164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e96b0 msgr2=0x5596d3cc29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e96b0 0x5596d3cc29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb82bfff640 1 -- 172.21.15.146:0/3775378164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e14d0 msgr2=0x5596d3cec530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.306+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e14d0 0x5596d3cec530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb82bfff640 1 -- 172.21.15.146:0/3775378164 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596d3975970 con 0x5596d390a390 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cb0a50 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fb824099100 tx=0x7fb824062b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ebf505b6984164 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb80a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3775378164 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824080070 con 0x5596d390a390 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3775378164 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fb82406c130 con 0x5596d390a390 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb838c32740 1 -- 172.21.15.146:0/3775378164 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb824067510 con 0x5596d390a390 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3775378164 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fb824072050 con 0x5596d390a390 2024-09-17T03:41:27.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb838c32740 10 client.8874 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb838c32740 1 -- 172.21.15.146:0/3775378164 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x5596d39536a0 con 0x5596d390a390 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3775378164 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb824067510 con 0x5596d390a390 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3775378164 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7fb824078b50 con 0x5596d390a390 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb838c32740 10 client.8874 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb838c32740 10 client.8874 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb838c32740 20 client.8874 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb838c32740 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x5596d38c8f60 0x5596d3cb0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb838c32740 4 client.8874 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb838c32740 1 -- 172.21.15.146:0/3775378164 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596d3c269b0 con 0x5596d38c8f60 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.307+0000 7fb82b7fe640 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x5596d38c8f60 0x5596d3cb0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.308+0000 7fb80a7fc640 10 client.8874 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.308+0000 7fb82b7fe640 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x5596d38c8f60 0x5596d3cb0f90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8cd51547c36ce1 server_cookie=44d9fcb5f3557bd5 in_seq=0 out_seq=0 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.308+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3775378164 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596d3c269b0 con 0x5596d38c8f60 2024-09-17T03:41:27.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.308+0000 7fb80a7fc640 10 client.8874 handle_command_reply: tid=0 2024-09-17T03:41:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.308+0000 7fb838c32740 1 client.8874 shutdown 2024-09-17T03:41:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb838c32740 1 -- 172.21.15.146:0/3775378164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 msgr2=0x5596d3cb0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb838c32740 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cb0a50 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fb824099100 tx=0x7fb824062b20 comp rx=0 tx=0).stop 2024-09-17T03:41:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb838c32740 1 -- 172.21.15.146:0/3775378164 shutdown_connections 2024-09-17T03:41:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb838c32740 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x5596d38c8f60 0x5596d3cb0f90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb838c32740 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cb0a50 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb838c32740 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e96b0 0x5596d3cc29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb838c32740 1 --2- 172.21.15.146:0/3775378164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e14d0 0x5596d3cec530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb80a7fc640 0 client.8874 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb838c32740 1 -- 172.21.15.146:0/3775378164 >> 172.21.15.146:0/3775378164 conn(0x5596d38fe4e0 msgr2=0x5596d3caca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb838c32740 1 -- 172.21.15.146:0/3775378164 shutdown_connections 2024-09-17T03:41:27.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb838c32740 1 -- 172.21.15.146:0/3775378164 wait complete. 2024-09-17T03:41:27.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.309+0000 7fb838c32740 20 client.8874 trim_cache size 0 max 16384 2024-09-17T03:41:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.326+0000 7fb838c32740 1 Processor -- start 2024-09-17T03:41:27.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.326+0000 7fb838c32740 1 -- start start 2024-09-17T03:41:27.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb838c32740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 0x5596d3ccb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb838c32740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e96b0 0x5596d3caf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb838c32740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cafeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb838c32740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c200200 con 0x5596d390a390 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb838c32740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c1f4ae0 con 0x5596d38e96b0 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb838c32740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c1f3e40 con 0x5596d38e14d0 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb82bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cafeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb82bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cafeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59086/0 (socket says 172.21.15.146:59086) 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb82bfff640 1 -- 172.21.15.146:0/3089882119 learned_addr learned my addr 172.21.15.146:0/3089882119 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb82bfff640 1 -- 172.21.15.146:0/3089882119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 msgr2=0x5596d3ccb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3089882119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 0x5596d3ccb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb82bfff640 1 -- 172.21.15.146:0/3089882119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e96b0 msgr2=0x5596d3caf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb82affd640 1 --2- 172.21.15.146:0/3089882119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e96b0 0x5596d3caf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3089882119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e96b0 0x5596d3caf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb82bfff640 1 -- 172.21.15.146:0/3089882119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596d3cb0810 con 0x5596d390a390 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3089882119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cafeb0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fb8240990d0 tx=0x7fb824062800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2d4f2be09e1be0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb810ff9640 1 -- 172.21.15.146:0/3089882119 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824080070 con 0x5596d390a390 2024-09-17T03:41:27.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb810ff9640 1 -- 172.21.15.146:0/3089882119 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb824067510 con 0x5596d390a390 2024-09-17T03:41:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.328+0000 7fb810ff9640 1 -- 172.21.15.146:0/3089882119 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82406c170 con 0x5596d390a390 2024-09-17T03:41:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.329+0000 7fb838c32740 1 -- 172.21.15.146:0/3089882119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 msgr2=0x5596d3cafeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.329+0000 7fb838c32740 1 --2- 172.21.15.146:0/3089882119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cafeb0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fb8240990d0 tx=0x7fb824062800 comp rx=0 tx=0).stop 2024-09-17T03:41:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.329+0000 7fb838c32740 1 -- 172.21.15.146:0/3089882119 shutdown_connections 2024-09-17T03:41:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.329+0000 7fb838c32740 1 --2- 172.21.15.146:0/3089882119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3cafeb0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.329+0000 7fb838c32740 1 --2- 172.21.15.146:0/3089882119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e96b0 0x5596d3caf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.329+0000 7fb838c32740 1 --2- 172.21.15.146:0/3089882119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 0x5596d3ccb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.329+0000 7fb838c32740 1 -- 172.21.15.146:0/3089882119 >> 172.21.15.146:0/3089882119 conn(0x5596d38fe4e0 msgr2=0x5596d3cb0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.329+0000 7fb838c32740 1 -- 172.21.15.146:0/3089882119 shutdown_connections 2024-09-17T03:41:27.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.329+0000 7fb838c32740 1 -- 172.21.15.146:0/3089882119 wait complete. 2024-09-17T03:41:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.330+0000 7fb838c32740 1 -- start start 2024-09-17T03:41:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.330+0000 7fb838c32740 1 Processor -- start 2024-09-17T03:41:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.331+0000 7fb838c32740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 0x5596d3ceb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.331+0000 7fb838c32740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e96b0 0x5596d3cab420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.331+0000 7fb838c32740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3d6fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.331+0000 7fb838c32740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c1f4490 con 0x5596d390a390 2024-09-17T03:41:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.331+0000 7fb838c32740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5596d3cb0810 con 0x5596d38e96b0 2024-09-17T03:41:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.331+0000 7fb838c32740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5596d3d08f30 con 0x5596d38e14d0 2024-09-17T03:41:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.331+0000 7fb838c32740 10 client.0 _ll_register_callbacks cb 0x7fb81c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3d6fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3d6fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59100/0 (socket says 172.21.15.146:59100) 2024-09-17T03:41:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82bfff640 1 -- 172.21.15.146:0/3875888081 learned_addr learned my addr 172.21.15.146:0/3875888081 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82b7fe640 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 0x5596d3ceb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82affd640 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e96b0 0x5596d3cab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82bfff640 1 -- 172.21.15.146:0/3875888081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 msgr2=0x5596d3ceb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 0x5596d3ceb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82bfff640 1 -- 172.21.15.146:0/3875888081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e96b0 msgr2=0x5596d3cab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e96b0 0x5596d3cab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82bfff640 1 -- 172.21.15.146:0/3875888081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596d3cae860 con 0x5596d390a390 2024-09-17T03:41:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82affd640 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e96b0 0x5596d3cab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb82bfff640 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3d6fde0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fb824062970 tx=0x7fb82406c1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112a0e407b737367 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb80a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3875888081 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824080070 con 0x5596d390a390 2024-09-17T03:41:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3875888081 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fb824061ea0 con 0x5596d390a390 2024-09-17T03:41:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb838c32740 1 -- 172.21.15.146:0/3875888081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb824067510 con 0x5596d390a390 2024-09-17T03:41:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3875888081 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fb824018b40 con 0x5596d390a390 2024-09-17T03:41:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb838c32740 10 client.8880 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb838c32740 1 -- 172.21.15.146:0/3875888081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x5596d3cae860 con 0x5596d390a390 2024-09-17T03:41:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.332+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3875888081 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb824067510 con 0x5596d390a390 2024-09-17T03:41:27.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3875888081 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7fb82408f080 con 0x5596d390a390 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 10 client.8880 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 10 client.8880 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 20 client.8880 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x5596d3cc6450 0x5596d3d08320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 4 client.8880 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 -- 172.21.15.146:0/3875888081 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5596d3c22460 con 0x5596d3cc6450 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb82b7fe640 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x5596d3cc6450 0x5596d3d08320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb80a7fc640 10 client.8880 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb82b7fe640 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x5596d3cc6450 0x5596d3d08320 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d35c24073f394f2 server_cookie=2e4069d8d4c95678 in_seq=0 out_seq=0 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb80a7fc640 1 -- 172.21.15.146:0/3875888081 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x5596d3c22460 con 0x5596d3cc6450 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb80a7fc640 10 client.8880 handle_command_reply: tid=0 2024-09-17T03:41:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 client.8880 shutdown 2024-09-17T03:41:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 -- 172.21.15.146:0/3875888081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 msgr2=0x5596d3d6fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3d6fde0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fb824062970 tx=0x7fb82406c1c0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 -- 172.21.15.146:0/3875888081 shutdown_connections 2024-09-17T03:41:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x5596d3cc6450 0x5596d3d08320 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5596d390a390 0x5596d3d6fde0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb80a7fc640 0 client.8880 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596d38e96b0 0x5596d3cab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 --2- 172.21.15.146:0/3875888081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596d38e14d0 0x5596d3ceb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 -- 172.21.15.146:0/3875888081 >> 172.21.15.146:0/3875888081 conn(0x5596d38fe4e0 msgr2=0x5596d3cb0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 -- 172.21.15.146:0/3875888081 shutdown_connections 2024-09-17T03:41:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.333+0000 7fb838c32740 1 -- 172.21.15.146:0/3875888081 wait complete. 2024-09-17T03:41:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb838c32740 20 client.8880 trim_cache size 0 max 16384 2024-09-17T03:41:27.341 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:41:27.341 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "PAUSED (786 inodes in the stack)", 2024-09-17T03:41:27.341 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:41:27.342 INFO:teuthology.orchestra.run.smithi146.stdout: "d827d267-7e6c-4ed3-ab08-484ceb637a01": { 2024-09-17T03:41:27.342 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:41:27.342 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "d827d267-7e6c-4ed3-ab08-484ceb637a01", 2024-09-17T03:41:27.342 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2024-09-17T03:41:27.342 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:27.342 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:27.342 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:41:27.342 INFO:teuthology.orchestra.run.smithi146.stdout: "d827d267-7e6c-4ed3-ab08-484ceb637a01": { 2024-09-17T03:41:27.342 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:41:26.957903+0000", 2024-09-17T03:41:27.343 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:41:27.343 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:41:27.343 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:41:27.343 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:41:27.343 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:41:27.343 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:27.343 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:27.343 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:41:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 -- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078bc0 msgr2=0x7fb81807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078bc0 0x7fb81807b0d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb81c033000 tx=0x7fb81c004730 comp rx=0 tx=0).stop 2024-09-17T03:41:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 -- 172.21.15.146:0/3302986990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb82c0b5ce0 msgr2=0x7fb82c1f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb82c0b5ce0 0x7fb82c1f66c0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fb82400c730 tx=0x7fb82400cbf0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 -- 172.21.15.146:0/3302986990 shutdown_connections 2024-09-17T03:41:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078bc0 0x7fb81807b0d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb82c0b5ce0 0x7fb82c1f66c0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb82c0b5750 0x7fb82c152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 --2- 172.21.15.146:0/3302986990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb82c0b3b60 0x7fb82c1f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 -- 172.21.15.146:0/3302986990 >> 172.21.15.146:0/3302986990 conn(0x7fb82c0b7b20 msgr2=0x7fb82c075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 -- 172.21.15.146:0/3302986990 shutdown_connections 2024-09-17T03:41:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.334+0000 7fb831be4640 1 -- 172.21.15.146:0/3302986990 wait complete. 2024-09-17T03:41:27.346 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.457+0000 7f9a03bad640 1 -- 172.21.15.146:0/2017046624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc0ae890 msgr2=0x7f99fc06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.457+0000 7f9a03bad640 1 --2- 172.21.15.146:0/2017046624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc0ae890 0x7f99fc06cc50 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f99fc074620 tx=0x7f99ec02a530 comp rx=0 tx=0).stop 2024-09-17T03:41:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.457+0000 7f9a03bad640 1 -- 172.21.15.146:0/2017046624 shutdown_connections 2024-09-17T03:41:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.457+0000 7f9a03bad640 1 --2- 172.21.15.146:0/2017046624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc0ae890 0x7f99fc06cc50 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.457+0000 7f9a03bad640 1 --2- 172.21.15.146:0/2017046624 >> v2:172.21.15.179:3300/0 conn(0x7f99fc0b0c60 0x7f99fc155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.458+0000 7f9a03bad640 1 -- 172.21.15.146:0/2017046624 >> 172.21.15.146:0/2017046624 conn(0x7f99fc0b3150 msgr2=0x7f99fc0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.458+0000 7f9a03bad640 1 -- 172.21.15.146:0/2017046624 shutdown_connections 2024-09-17T03:41:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.458+0000 7f9a03bad640 1 -- 172.21.15.146:0/2017046624 wait complete. 2024-09-17T03:41:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.459+0000 7f9a03bad640 1 Processor -- start 2024-09-17T03:41:27.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.459+0000 7f9a03bad640 1 -- start start 2024-09-17T03:41:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a03bad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99fc0ae890 0x7f99fc1538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a03bad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc0aeca0 0x7f99fc146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a03bad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99fc0b0c60 0x7f99fc147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a03bad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc06d550 con 0x7f99fc0aeca0 2024-09-17T03:41:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a03bad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc06d3d0 con 0x7f99fc0b0c60 2024-09-17T03:41:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a03bad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99fc0b62c0 con 0x7f99fc0ae890 2024-09-17T03:41:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a01148640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc0aeca0 0x7f99fc146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a01148640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc0aeca0 0x7f99fc146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59112/0 (socket says 172.21.15.146:59112) 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a01148640 1 -- 172.21.15.146:0/1929010471 learned_addr learned my addr 172.21.15.146:0/1929010471 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a01949640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99fc0ae890 0x7f99fc1538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a0214a640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99fc0b0c60 0x7f99fc147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a01148640 1 -- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99fc0ae890 msgr2=0x7f99fc1538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a01148640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99fc0ae890 0x7f99fc1538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a01148640 1 -- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99fc0b0c60 msgr2=0x7f99fc147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a01148640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99fc0b0c60 0x7f99fc147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a01148640 1 -- 172.21.15.146:0/1929010471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99fc154510 con 0x7f99fc0aeca0 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a0214a640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99fc0b0c60 0x7f99fc147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a01148640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc0aeca0 0x7f99fc146d00 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f99ec02ab20 tx=0x7f99ec033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f99f27fc640 1 -- 172.21.15.146:0/1929010471 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec005c90 con 0x7f99fc0aeca0 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f99f27fc640 1 -- 172.21.15.146:0/1929010471 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99ec031e50 con 0x7f99fc0aeca0 2024-09-17T03:41:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f9a03bad640 1 -- 172.21.15.146:0/1929010471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99fc1f6930 con 0x7f99fc0aeca0 2024-09-17T03:41:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.461+0000 7f99f27fc640 1 -- 172.21.15.146:0/1929010471 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec005260 con 0x7f99fc0aeca0 2024-09-17T03:41:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.462+0000 7f9a03bad640 1 -- 172.21.15.146:0/1929010471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99fc1f6370 con 0x7f99fc0aeca0 2024-09-17T03:41:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.463+0000 7f9a03bad640 1 -- 172.21.15.146:0/1929010471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99fc0b6810 con 0x7f99fc0aeca0 2024-09-17T03:41:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.463+0000 7f99f27fc640 1 -- 172.21.15.146:0/1929010471 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99ec005400 con 0x7f99fc0aeca0 2024-09-17T03:41:27.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.464+0000 7f99f27fc640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99e0078b90 0x7f99e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.464+0000 7f99f27fc640 1 -- 172.21.15.146:0/1929010471 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f99ec0bbce0 con 0x7f99fc0aeca0 2024-09-17T03:41:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.464+0000 7f9a01949640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99e0078b90 0x7f99e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.465+0000 7f9a01949640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99e0078b90 0x7f99e007b0a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009b30 tx=0x7f99f8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.468+0000 7f99f27fc640 1 -- 172.21.15.146:0/1929010471 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99fc154510 con 0x7f99fc0aeca0 2024-09-17T03:41:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.681+0000 7f9a03bad640 1 -- 172.21.15.146:0/1929010471 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99fc071320 con 0x7f99fc0aeca0 2024-09-17T03:41:27.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.682+0000 7f99f27fc640 1 -- 172.21.15.146:0/1929010471 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7f99ec03f030 con 0x7f99fc0aeca0 2024-09-17T03:41:27.682 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:27.682 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:27.683 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 -- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99e0078b90 msgr2=0x7f99e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99e0078b90 0x7f99e007b0a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009b30 tx=0x7f99f8005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 -- 172.21.15.146:0/1929010471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc0aeca0 msgr2=0x7f99fc146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc0aeca0 0x7f99fc146d00 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f99ec02ab20 tx=0x7f99ec033c20 comp rx=0 tx=0).stop 2024-09-17T03:41:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 -- 172.21.15.146:0/1929010471 shutdown_connections 2024-09-17T03:41:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f99e0078b90 0x7f99e007b0a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f99fc0b0c60 0x7f99fc147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc0aeca0 0x7f99fc146d00 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 --2- 172.21.15.146:0/1929010471 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f99fc0ae890 0x7f99fc1538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 -- 172.21.15.146:0/1929010471 >> 172.21.15.146:0/1929010471 conn(0x7f99fc0b3150 msgr2=0x7f99fc0b4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 -- 172.21.15.146:0/1929010471 shutdown_connections 2024-09-17T03:41:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.684+0000 7f9a03bad640 1 -- 172.21.15.146:0/1929010471 wait complete. 2024-09-17T03:41:27.695 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:41:27.696 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:41:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.808+0000 7fe886c30640 1 -- 172.21.15.146:0/2423573927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8800b4270 msgr2=0x7fe880165bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.808+0000 7fe886c30640 1 --2- 172.21.15.146:0/2423573927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8800b4270 0x7fe880165bc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe878005fd0 tx=0x7fe87802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.808+0000 7fe886c30640 1 -- 172.21.15.146:0/2423573927 shutdown_connections 2024-09-17T03:41:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.808+0000 7fe886c30640 1 --2- 172.21.15.146:0/2423573927 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8800b4270 0x7fe880165bc0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.808+0000 7fe886c30640 1 -- 172.21.15.146:0/2423573927 >> 172.21.15.146:0/2423573927 conn(0x7fe88006d3c0 msgr2=0x7fe8800b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.808+0000 7fe886c30640 1 -- 172.21.15.146:0/2423573927 shutdown_connections 2024-09-17T03:41:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.808+0000 7fe886c30640 1 -- 172.21.15.146:0/2423573927 wait complete. 2024-09-17T03:41:27.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.810+0000 7fe886c30640 1 Processor -- start 2024-09-17T03:41:27.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.810+0000 7fe886c30640 1 -- start start 2024-09-17T03:41:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.811+0000 7fe886c30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe880144380 0x7fe88015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.811+0000 7fe886c30640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe880144900 0x7fe8801555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.811+0000 7fe886c30640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe880155b30 0x7fe8800af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.811+0000 7fe886c30640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe880166490 con 0x7fe880144380 2024-09-17T03:41:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.811+0000 7fe886c30640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe880166310 con 0x7fe880144900 2024-09-17T03:41:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.811+0000 7fe886c30640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe880166610 con 0x7fe880155b30 2024-09-17T03:41:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.811+0000 7fe8849cc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe880144380 0x7fe88015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8849cc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe880144380 0x7fe88015ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59114/0 (socket says 172.21.15.146:59114) 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8849cc640 1 -- 172.21.15.146:0/1519346774 learned_addr learned my addr 172.21.15.146:0/1519346774 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8851cd640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe880155b30 0x7fe8800af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe877fff640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe880144900 0x7fe8801555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8849cc640 1 -- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe880155b30 msgr2=0x7fe8800af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8849cc640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe880155b30 0x7fe8800af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8849cc640 1 -- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe880144900 msgr2=0x7fe8801555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8849cc640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe880144900 0x7fe8801555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8849cc640 1 -- 172.21.15.146:0/1519346774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe880155f40 con 0x7fe880144380 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8849cc640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe880144380 0x7fe88015ac20 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00c3c0 tx=0x7fe87c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8757fa640 1 -- 172.21.15.146:0/1519346774 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c015020 con 0x7fe880144380 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8757fa640 1 -- 172.21.15.146:0/1519346774 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe87c0035f0 con 0x7fe880144380 2024-09-17T03:41:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe886c30640 1 -- 172.21.15.146:0/1519346774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88013f920 con 0x7fe880144380 2024-09-17T03:41:27.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe8757fa640 1 -- 172.21.15.146:0/1519346774 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c003a80 con 0x7fe880144380 2024-09-17T03:41:27.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.812+0000 7fe886c30640 1 -- 172.21.15.146:0/1519346774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88013fee0 con 0x7fe880144380 2024-09-17T03:41:27.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.813+0000 7fe886c30640 1 -- 172.21.15.146:0/1519346774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8800b4820 con 0x7fe880144380 2024-09-17T03:41:27.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.814+0000 7fe8757fa640 1 -- 172.21.15.146:0/1519346774 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe87c018020 con 0x7fe880144380 2024-09-17T03:41:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.814+0000 7fe8757fa640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe86c078bc0 0x7fe86c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.815+0000 7fe8757fa640 1 -- 172.21.15.146:0/1519346774 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fe87c09c650 con 0x7fe880144380 2024-09-17T03:41:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.815+0000 7fe877fff640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe86c078bc0 0x7fe86c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.815+0000 7fe877fff640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe86c078bc0 0x7fe86c07b0d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe870000f60 tx=0x7fe870009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:27.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:27.819+0000 7fe8757fa640 1 -- 172.21.15.146:0/1519346774 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe87c01f030 con 0x7fe880144380 2024-09-17T03:41:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.060+0000 7fe886c30640 1 -- 172.21.15.146:0/1519346774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe8800d0200 con 0x7fe880144380 2024-09-17T03:41:28.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.060+0000 7fe8757fa640 1 -- 172.21.15.146:0/1519346774 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1615 (secure 0 0 0) 0x7fe880155f40 con 0x7fe880144380 2024-09-17T03:41:28.061 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:28.061 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":532,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":810,"data_bytes":825625393,"bytes_used":1972051968,"bytes_avail":771122061312,"bytes_total":773094113280,"write_bytes_sec":68742490,"read_op_per_sec":0,"write_op_per_sec":67},"fsmap":{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8658}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-17T03:40:47.915551+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:41:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 -- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe86c078bc0 msgr2=0x7fe86c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe86c078bc0 0x7fe86c07b0d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe870000f60 tx=0x7fe870009040 comp rx=0 tx=0).stop 2024-09-17T03:41:28.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 -- 172.21.15.146:0/1519346774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe880144380 msgr2=0x7fe88015ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe880144380 0x7fe88015ac20 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00c3c0 tx=0x7fe87c00c880 comp rx=0 tx=0).stop 2024-09-17T03:41:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 -- 172.21.15.146:0/1519346774 shutdown_connections 2024-09-17T03:41:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe86c078bc0 0x7fe86c07b0d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe880155b30 0x7fe8800af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe880144900 0x7fe8801555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 --2- 172.21.15.146:0/1519346774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe880144380 0x7fe88015ac20 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 -- 172.21.15.146:0/1519346774 >> 172.21.15.146:0/1519346774 conn(0x7fe88006d3c0 msgr2=0x7fe880142a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 -- 172.21.15.146:0/1519346774 shutdown_connections 2024-09-17T03:41:28.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:28.063+0000 7fe886c30640 1 -- 172.21.15.146:0/1519346774 wait complete. 2024-09-17T03:41:28.074 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:41:28.667 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:41:28.670 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:41:29.075 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.201+0000 7ff69464d640 1 -- 172.21.15.146:0/1641133844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff678003c30 msgr2=0x7ff6780040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.201+0000 7ff69464d640 1 --2- 172.21.15.146:0/1641133844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff678003c30 0x7ff6780040a0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7ff688001830 tx=0x7ff678005830 comp rx=0 tx=0).stop 2024-09-17T03:41:29.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.201+0000 7ff69464d640 1 -- 172.21.15.146:0/1641133844 shutdown_connections 2024-09-17T03:41:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.201+0000 7ff69464d640 1 --2- 172.21.15.146:0/1641133844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff678003c30 0x7ff6780040a0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.201+0000 7ff69464d640 1 -- 172.21.15.146:0/1641133844 >> 172.21.15.146:0/1641133844 conn(0x7ff68c0d11f0 msgr2=0x7ff68c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.201+0000 7ff69464d640 1 -- 172.21.15.146:0/1641133844 shutdown_connections 2024-09-17T03:41:29.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.201+0000 7ff69464d640 1 -- 172.21.15.146:0/1641133844 wait complete. 2024-09-17T03:41:29.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.203+0000 7ff69464d640 1 Processor -- start 2024-09-17T03:41:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.203+0000 7ff69464d640 1 -- start start 2024-09-17T03:41:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.204+0000 7ff69464d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff678003c30 0x7ff68c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.204+0000 7ff69464d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff68c158a30 0x7ff68c14fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.204+0000 7ff69464d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff68c0cd9a0 0x7ff68c0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.204+0000 7ff69464d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c1631a0 con 0x7ff678003c30 2024-09-17T03:41:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.204+0000 7ff69464d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff68c0b68c0 con 0x7ff68c0cd9a0 2024-09-17T03:41:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.204+0000 7ff69464d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff68c163320 con 0x7ff68c158a30 2024-09-17T03:41:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.204+0000 7ff6923e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff678003c30 0x7ff68c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.204+0000 7ff6923e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff678003c30 0x7ff68c0cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59140/0 (socket says 172.21.15.146:59140) 2024-09-17T03:41:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.204+0000 7ff6923e9640 1 -- 172.21.15.146:0/917322261 learned_addr learned my addr 172.21.15.146:0/917322261 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff692bea640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff68c0cd9a0 0x7ff68c0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff691be8640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff68c158a30 0x7ff68c14fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff6923e9640 1 -- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff68c158a30 msgr2=0x7ff68c14fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff6923e9640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff68c158a30 0x7ff68c14fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff6923e9640 1 -- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff68c0cd9a0 msgr2=0x7ff68c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff6923e9640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff68c0cd9a0 0x7ff68c0cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff6923e9640 1 -- 172.21.15.146:0/917322261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68c0ce2f0 con 0x7ff678003c30 2024-09-17T03:41:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff6923e9640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff678003c30 0x7ff68c0cb7b0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ff688001950 tx=0x7ff688006170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff682ffd640 1 -- 172.21.15.146:0/917322261 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688043070 con 0x7ff678003c30 2024-09-17T03:41:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff682ffd640 1 -- 172.21.15.146:0/917322261 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff688003af0 con 0x7ff678003c30 2024-09-17T03:41:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff682ffd640 1 -- 172.21.15.146:0/917322261 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688033480 con 0x7ff678003c30 2024-09-17T03:41:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff69464d640 1 -- 172.21.15.146:0/917322261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68c150000 con 0x7ff678003c30 2024-09-17T03:41:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.205+0000 7ff69464d640 1 -- 172.21.15.146:0/917322261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff68c0cc2e0 con 0x7ff678003c30 2024-09-17T03:41:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.206+0000 7ff69464d640 1 -- 172.21.15.146:0/917322261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff68c0cef40 con 0x7ff678003c30 2024-09-17T03:41:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.207+0000 7ff682ffd640 1 -- 172.21.15.146:0/917322261 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff688046070 con 0x7ff678003c30 2024-09-17T03:41:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.207+0000 7ff682ffd640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff670078bc0 0x7ff67007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.207+0000 7ff682ffd640 1 -- 172.21.15.146:0/917322261 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7ff6880bab70 con 0x7ff678003c30 2024-09-17T03:41:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.208+0000 7ff691be8640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff670078bc0 0x7ff67007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.208+0000 7ff691be8640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff670078bc0 0x7ff67007b0d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0010e0 tx=0x7ff67c0012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.212+0000 7ff682ffd640 1 -- 172.21.15.146:0/917322261 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff68c0ce2f0 con 0x7ff678003c30 2024-09-17T03:41:29.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.423+0000 7ff69464d640 1 -- 172.21.15.146:0/917322261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff68c0c7ff0 con 0x7ff678003c30 2024-09-17T03:41:29.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.424+0000 7ff682ffd640 1 -- 172.21.15.146:0/917322261 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7ff688006260 con 0x7ff678003c30 2024-09-17T03:41:29.424 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:29.424 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:29.424 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 -- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff670078bc0 msgr2=0x7ff67007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff670078bc0 0x7ff67007b0d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0010e0 tx=0x7ff67c0012e0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 -- 172.21.15.146:0/917322261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff678003c30 msgr2=0x7ff68c0cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff678003c30 0x7ff68c0cb7b0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7ff688001950 tx=0x7ff688006170 comp rx=0 tx=0).stop 2024-09-17T03:41:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 -- 172.21.15.146:0/917322261 shutdown_connections 2024-09-17T03:41:29.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff670078bc0 0x7ff67007b0d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff68c0cd9a0 0x7ff68c0cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff68c158a30 0x7ff68c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 --2- 172.21.15.146:0/917322261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff678003c30 0x7ff68c0cb7b0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 -- 172.21.15.146:0/917322261 >> 172.21.15.146:0/917322261 conn(0x7ff68c0d11f0 msgr2=0x7ff68c0b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:29.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 -- 172.21.15.146:0/917322261 shutdown_connections 2024-09-17T03:41:29.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.426+0000 7ff69464d640 1 -- 172.21.15.146:0/917322261 wait complete. 2024-09-17T03:41:29.437 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:41:29.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:41:29.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.550+0000 7f927bd20640 1 -- 172.21.15.146:0/92643611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92740cefe0 msgr2=0x7f92740cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:29.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.550+0000 7f927bd20640 1 --2- 172.21.15.146:0/92643611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92740cefe0 0x7f92740cf3f0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f9264009830 tx=0x7f926402a480 comp rx=0 tx=0).stop 2024-09-17T03:41:29.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.550+0000 7f927bd20640 1 -- 172.21.15.146:0/92643611 shutdown_connections 2024-09-17T03:41:29.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.550+0000 7f927bd20640 1 --2- 172.21.15.146:0/92643611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92740cefe0 0x7f92740cf3f0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.550+0000 7f927bd20640 1 -- 172.21.15.146:0/92643611 >> 172.21.15.146:0/92643611 conn(0x7f927409ba20 msgr2=0x7f92740b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:29.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.550+0000 7f927bd20640 1 -- 172.21.15.146:0/92643611 shutdown_connections 2024-09-17T03:41:29.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.550+0000 7f927bd20640 1 -- 172.21.15.146:0/92643611 wait complete. 2024-09-17T03:41:29.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.552+0000 7f927bd20640 1 Processor -- start 2024-09-17T03:41:29.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.552+0000 7f927bd20640 1 -- start start 2024-09-17T03:41:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927bd20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92740b7580 0x7f92740afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927bd20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92740cefe0 0x7f92741e4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927bd20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92740d1190 0x7f92740c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927bd20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f92740d1930 con 0x7f92740d1190 2024-09-17T03:41:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927bd20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92740d17b0 con 0x7f92740b7580 2024-09-17T03:41:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927bd20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f92740d1ab0 con 0x7f92740cefe0 2024-09-17T03:41:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927a2bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92740d1190 0x7f92740c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927a2bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92740d1190 0x7f92740c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59166/0 (socket says 172.21.15.146:59166) 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927a2bd640 1 -- 172.21.15.146:0/2062640477 learned_addr learned my addr 172.21.15.146:0/2062640477 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f9279abc640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92740b7580 0x7f92740afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f92792bb640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92740cefe0 0x7f92741e4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927a2bd640 1 -- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92740cefe0 msgr2=0x7f92741e4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927a2bd640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92740cefe0 0x7f92741e4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927a2bd640 1 -- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92740b7580 msgr2=0x7f92740afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927a2bd640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92740b7580 0x7f92740afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927a2bd640 1 -- 172.21.15.146:0/2062640477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92741f5a10 con 0x7f92740d1190 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927a2bd640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92740d1190 0x7f92740c7520 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f926c00b970 tx=0x7f926c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f926a7fc640 1 -- 172.21.15.146:0/2062640477 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c019070 con 0x7f92740d1190 2024-09-17T03:41:29.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f926a7fc640 1 -- 172.21.15.146:0/2062640477 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f926c00cc30 con 0x7f92740d1190 2024-09-17T03:41:29.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927bd20640 1 -- 172.21.15.146:0/2062640477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92741e5200 con 0x7f92740d1190 2024-09-17T03:41:29.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f926a7fc640 1 -- 172.21.15.146:0/2062640477 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0146a0 con 0x7f92740d1190 2024-09-17T03:41:29.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.554+0000 7f927bd20640 1 -- 172.21.15.146:0/2062640477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92741f5f60 con 0x7f92740d1190 2024-09-17T03:41:29.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.555+0000 7f927bd20640 1 -- 172.21.15.146:0/2062640477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92740cf3f0 con 0x7f92740d1190 2024-09-17T03:41:29.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.556+0000 7f926a7fc640 1 -- 172.21.15.146:0/2062640477 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f926c01c070 con 0x7f92740d1190 2024-09-17T03:41:29.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.557+0000 7f926a7fc640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9258078bc0 0x7f925807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:29.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.557+0000 7f926a7fc640 1 -- 172.21.15.146:0/2062640477 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f926c09ab00 con 0x7f92740d1190 2024-09-17T03:41:29.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.557+0000 7f9279abc640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9258078bc0 0x7f925807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:29.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.557+0000 7f9279abc640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9258078bc0 0x7f925807b0d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9270007fd0 tx=0x7f9270009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:29.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.561+0000 7f926a7fc640 1 -- 172.21.15.146:0/2062640477 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f926c062f40 con 0x7f92740d1190 2024-09-17T03:41:29.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.805+0000 7f927bd20640 1 -- 172.21.15.146:0/2062640477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f92740cfd50 con 0x7f92740d1190 2024-09-17T03:41:29.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.806+0000 7f926a7fc640 1 -- 172.21.15.146:0/2062640477 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1615 (secure 0 0 0) 0x7f926c062840 con 0x7f92740d1190 2024-09-17T03:41:29.806 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:29.806 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":534,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":877,"data_bytes":895879985,"bytes_used":2175475712,"bytes_avail":770918637568,"bytes_total":773094113280,"write_bytes_sec":74595326,"read_op_per_sec":0,"write_op_per_sec":72},"fsmap":{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8658}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-17T03:40:47.915551+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:41:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 -- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9258078bc0 msgr2=0x7f925807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9258078bc0 0x7f925807b0d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9270007fd0 tx=0x7f9270009040 comp rx=0 tx=0).stop 2024-09-17T03:41:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 -- 172.21.15.146:0/2062640477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92740d1190 msgr2=0x7f92740c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92740d1190 0x7f92740c7520 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f926c00b970 tx=0x7f926c00be30 comp rx=0 tx=0).stop 2024-09-17T03:41:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 -- 172.21.15.146:0/2062640477 shutdown_connections 2024-09-17T03:41:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9258078bc0 0x7f925807b0d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92740d1190 0x7f92740c7520 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92740cefe0 0x7f92741e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 --2- 172.21.15.146:0/2062640477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92740b7580 0x7f92740afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:29.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 -- 172.21.15.146:0/2062640477 >> 172.21.15.146:0/2062640477 conn(0x7f927409ba20 msgr2=0x7f9274075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:29.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 -- 172.21.15.146:0/2062640477 shutdown_connections 2024-09-17T03:41:29.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:29.808+0000 7f927bd20640 1 -- 172.21.15.146:0/2062640477 wait complete. 2024-09-17T03:41:29.820 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:41:30.821 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:30.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.948+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/358524902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec0cf6b0 msgr2=0x7f3cec161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:30.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.948+0000 7f3cf0c8b640 1 --2- 172.21.15.146:0/358524902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec0cf6b0 0x7f3cec161220 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0743d0 tx=0x7f3ce002a4f0 comp rx=0 tx=0).stop 2024-09-17T03:41:30.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.948+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/358524902 shutdown_connections 2024-09-17T03:41:30.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.948+0000 7f3cf0c8b640 1 --2- 172.21.15.146:0/358524902 >> v2:172.21.15.179:3300/0 conn(0x7f3cec0b47c0 0x7f3cec161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:30.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.948+0000 7f3cf0c8b640 1 --2- 172.21.15.146:0/358524902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec0cf6b0 0x7f3cec161220 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:30.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.948+0000 7f3cf0c8b640 1 --2- 172.21.15.146:0/358524902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cec0d0710 0x7f3cec0cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:30.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.948+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/358524902 >> 172.21.15.146:0/358524902 conn(0x7f3cec09ba20 msgr2=0x7f3cec0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:30.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.948+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/358524902 shutdown_connections 2024-09-17T03:41:30.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.948+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/358524902 wait complete. 2024-09-17T03:41:30.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.950+0000 7f3cf0c8b640 1 Processor -- start 2024-09-17T03:41:30.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.950+0000 7f3cf0c8b640 1 -- start start 2024-09-17T03:41:30.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cf0c8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cec0b47c0 0x7f3cec0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:30.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cf0c8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cec0cf6b0 0x7f3cec0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:30.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cf0c8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec0d0710 0x7f3cec160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:30.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cf0c8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3cec162030 con 0x7f3cec0d0710 2024-09-17T03:41:30.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cf0c8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3cec161eb0 con 0x7f3cec0b47c0 2024-09-17T03:41:30.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cf0c8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3cec0cd090 con 0x7f3cec0cf6b0 2024-09-17T03:41:30.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cead9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec0d0710 0x7f3cec160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:30.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cead9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec0d0710 0x7f3cec160b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59196/0 (socket says 172.21.15.146:59196) 2024-09-17T03:41:30.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cead9d640 1 -- 172.21.15.146:0/3247377974 learned_addr learned my addr 172.21.15.146:0/3247377974 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:30.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cea59c640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cec0b47c0 0x7f3cec0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3ce9d9b640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cec0cf6b0 0x7f3cec0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cead9d640 1 -- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cec0cf6b0 msgr2=0x7f3cec0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cead9d640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cec0cf6b0 0x7f3cec0cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cead9d640 1 -- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cec0b47c0 msgr2=0x7f3cec0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cead9d640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cec0b47c0 0x7f3cec0cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cead9d640 1 -- 172.21.15.146:0/3247377974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cec1610b0 con 0x7f3cec0d0710 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cead9d640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec0d0710 0x7f3cec160b70 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400eab0 tx=0x7f3ce4009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.952+0000 7f3cdaffd640 1 -- 172.21.15.146:0/3247377974 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400ce40 con 0x7f3cec0d0710 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.953+0000 7f3cdaffd640 1 -- 172.21.15.146:0/3247377974 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ce4004c10 con 0x7f3cec0d0710 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.953+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/3247377974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cec0c9cc0 con 0x7f3cec0d0710 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.953+0000 7f3cdaffd640 1 -- 172.21.15.146:0/3247377974 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4005020 con 0x7f3cec0d0710 2024-09-17T03:41:30.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.953+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/3247377974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cec0ca280 con 0x7f3cec0d0710 2024-09-17T03:41:30.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.953+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/3247377974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cec0cf170 con 0x7f3cec0d0710 2024-09-17T03:41:30.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.954+0000 7f3cdaffd640 1 -- 172.21.15.146:0/3247377974 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ce40051c0 con 0x7f3cec0d0710 2024-09-17T03:41:30.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.955+0000 7f3cdaffd640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ccc078b90 0x7f3ccc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:30.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.955+0000 7f3cdaffd640 1 -- 172.21.15.146:0/3247377974 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f3ce409ba20 con 0x7f3cec0d0710 2024-09-17T03:41:30.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.955+0000 7f3cea59c640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ccc078b90 0x7f3ccc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:30.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.955+0000 7f3cea59c640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ccc078b90 0x7f3ccc07b0a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009b30 tx=0x7f3cdc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:30.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:30.959+0000 7f3cdaffd640 1 -- 172.21.15.146:0/3247377974 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3cec1610b0 con 0x7f3cec0d0710 2024-09-17T03:41:31.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.168+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/3247377974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cec0ced70 con 0x7f3cec0d0710 2024-09-17T03:41:31.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.168+0000 7f3cdaffd640 1 -- 172.21.15.146:0/3247377974 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7f3ce4063810 con 0x7f3cec0d0710 2024-09-17T03:41:31.169 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:31.169 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:31.169 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:31.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ccc078b90 msgr2=0x7f3ccc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ccc078b90 0x7f3ccc07b0a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009b30 tx=0x7f3cdc005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/3247377974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec0d0710 msgr2=0x7f3cec160b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec0d0710 0x7f3cec160b70 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400eab0 tx=0x7f3ce4009f70 comp rx=0 tx=0).stop 2024-09-17T03:41:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/3247377974 shutdown_connections 2024-09-17T03:41:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ccc078b90 0x7f3ccc07b0a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3cec0d0710 0x7f3cec160b70 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3cec0cf6b0 0x7f3cec0cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 --2- 172.21.15.146:0/3247377974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cec0b47c0 0x7f3cec0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/3247377974 >> 172.21.15.146:0/3247377974 conn(0x7f3cec09ba20 msgr2=0x7f3cec0b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:31.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/3247377974 shutdown_connections 2024-09-17T03:41:31.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.171+0000 7f3cf0c8b640 1 -- 172.21.15.146:0/3247377974 wait complete. 2024-09-17T03:41:31.182 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:41:31.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:41:31.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.295+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/1448720266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fd41620f0 msgr2=0x7f0fd406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:31.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.295+0000 7f0fdaf6e640 1 --2- 172.21.15.146:0/1448720266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fd41620f0 0x7f0fd406ed30 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009830 tx=0x7f0fc402a480 comp rx=0 tx=0).stop 2024-09-17T03:41:31.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.295+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/1448720266 shutdown_connections 2024-09-17T03:41:31.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.295+0000 7f0fdaf6e640 1 --2- 172.21.15.146:0/1448720266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fd41620f0 0x7f0fd406ed30 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.295+0000 7f0fdaf6e640 1 --2- 172.21.15.146:0/1448720266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fd40b3870 0x7f0fd40cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.295+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/1448720266 >> 172.21.15.146:0/1448720266 conn(0x7f0fd40d4be0 msgr2=0x7f0fd40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:31.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.295+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/1448720266 shutdown_connections 2024-09-17T03:41:31.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.295+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/1448720266 wait complete. 2024-09-17T03:41:31.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.297+0000 7f0fdaf6e640 1 Processor -- start 2024-09-17T03:41:31.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.297+0000 7f0fdaf6e640 1 -- start start 2024-09-17T03:41:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fdaf6e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fd406f270 0x7f0fd41f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fdaf6e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fd40b3870 0x7f0fd4161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fdaf6e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fd41620f0 0x7f0fd40c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fdaf6e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4162fb0 con 0x7f0fd40b3870 2024-09-17T03:41:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fdaf6e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd40d43b0 con 0x7f0fd41620f0 2024-09-17T03:41:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fdaf6e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0fd4163130 con 0x7f0fd406f270 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fcbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fd40b3870 0x7f0fd4161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fcbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fd40b3870 0x7f0fd4161250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59222/0 (socket says 172.21.15.146:59222) 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fcbfff640 1 -- 172.21.15.146:0/3925111148 learned_addr learned my addr 172.21.15.146:0/3925111148 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fd8d0a640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fd406f270 0x7f0fd41f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fd950b640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fd41620f0 0x7f0fd40c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fcbfff640 1 -- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fd406f270 msgr2=0x7f0fd41f9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fcbfff640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fd406f270 0x7f0fd41f9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fcbfff640 1 -- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fd41620f0 msgr2=0x7f0fd40c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fcbfff640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fd41620f0 0x7f0fd40c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fcbfff640 1 -- 172.21.15.146:0/3925111148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd40abb40 con 0x7f0fd40b3870 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fcbfff640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fd40b3870 0x7f0fd4161250 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009950 tx=0x7f0fc4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fc97fa640 1 -- 172.21.15.146:0/3925111148 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4031d60 con 0x7f0fd40b3870 2024-09-17T03:41:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fc97fa640 1 -- 172.21.15.146:0/3925111148 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fc4033e10 con 0x7f0fd40b3870 2024-09-17T03:41:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/3925111148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd40abe20 con 0x7f0fd40b3870 2024-09-17T03:41:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fc97fa640 1 -- 172.21.15.146:0/3925111148 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4033310 con 0x7f0fd40b3870 2024-09-17T03:41:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.299+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/3925111148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd4161790 con 0x7f0fd40b3870 2024-09-17T03:41:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.300+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/3925111148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd40c9b50 con 0x7f0fd40b3870 2024-09-17T03:41:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.301+0000 7f0fc97fa640 1 -- 172.21.15.146:0/3925111148 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0fc40334b0 con 0x7f0fd40b3870 2024-09-17T03:41:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.302+0000 7f0fc97fa640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fc0078b90 0x7f0fc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.302+0000 7f0fc97fa640 1 -- 172.21.15.146:0/3925111148 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f0fc40bbfc0 con 0x7f0fd40b3870 2024-09-17T03:41:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.302+0000 7f0fd8d0a640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fc0078b90 0x7f0fc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.302+0000 7f0fd8d0a640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fc0078b90 0x7f0fc007b0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009b30 tx=0x7f0fd0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.306+0000 7f0fc97fa640 1 -- 172.21.15.146:0/3925111148 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0fc403f030 con 0x7f0fd40b3870 2024-09-17T03:41:31.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.550+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/3925111148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0fd41635e0 con 0x7f0fd40b3870 2024-09-17T03:41:31.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.551+0000 7f0fc97fa640 1 -- 172.21.15.146:0/3925111148 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1617 (secure 0 0 0) 0x7f0fc4083ed0 con 0x7f0fd40b3870 2024-09-17T03:41:31.551 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:31.551 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":536,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076736355,"bytes_used":2560253952,"bytes_avail":770533859328,"bytes_total":773094113280,"write_bytes_sec":86355007,"read_op_per_sec":0,"write_op_per_sec":91},"fsmap":{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8658}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-17T03:40:47.915551+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:41:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fc0078b90 msgr2=0x7f0fc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:31.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fc0078b90 0x7f0fc007b0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009b30 tx=0x7f0fd0005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:31.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/3925111148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fd40b3870 msgr2=0x7f0fd4161250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:31.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fd40b3870 0x7f0fd4161250 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009950 tx=0x7f0fc4033c20 comp rx=0 tx=0).stop 2024-09-17T03:41:31.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/3925111148 shutdown_connections 2024-09-17T03:41:31.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fc0078b90 0x7f0fc007b0a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fd41620f0 0x7f0fd40c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fd40b3870 0x7f0fd4161250 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 --2- 172.21.15.146:0/3925111148 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fd406f270 0x7f0fd41f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:31.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/3925111148 >> 172.21.15.146:0/3925111148 conn(0x7f0fd40d4be0 msgr2=0x7f0fd4075f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:31.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/3925111148 shutdown_connections 2024-09-17T03:41:31.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:31.553+0000 7f0fdaf6e640 1 -- 172.21.15.146:0/3925111148 wait complete. 2024-09-17T03:41:31.564 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:41:32.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:32.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.693+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/711082913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f940b5750 msgr2=0x7f4f940b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:32.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.693+0000 7f4f9b4d3640 1 --2- 172.21.15.146:0/711082913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f940b5750 0x7f4f940b3620 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f4f940b5390 tx=0x7f4f8402a530 comp rx=0 tx=0).stop 2024-09-17T03:41:32.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.693+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/711082913 shutdown_connections 2024-09-17T03:41:32.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.693+0000 7f4f9b4d3640 1 --2- 172.21.15.146:0/711082913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f940b5750 0x7f4f940b3620 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:32.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.693+0000 7f4f9b4d3640 1 --2- 172.21.15.146:0/711082913 >> v2:172.21.15.179:3300/0 conn(0x7f4f940b5ce0 0x7f4f940b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:32.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.693+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/711082913 >> 172.21.15.146:0/711082913 conn(0x7f4f940b7b20 msgr2=0x7f4f9409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:32.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.693+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/711082913 shutdown_connections 2024-09-17T03:41:32.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.693+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/711082913 wait complete. 2024-09-17T03:41:32.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.695+0000 7f4f9b4d3640 1 Processor -- start 2024-09-17T03:41:32.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.695+0000 7f4f9b4d3640 1 -- start start 2024-09-17T03:41:32.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.696+0000 7f4f9b4d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f940b3b60 0x7f4f9406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.696+0000 7f4f9b4d3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f940b5750 0x7f4f9406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.696+0000 7f4f9b4d3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f940b5ce0 0x7f4f94154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.696+0000 7f4f9b4d3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4f940b27b0 con 0x7f4f940b3b60 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.696+0000 7f4f9b4d3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9415dcc0 con 0x7f4f940b5ce0 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.696+0000 7f4f9b4d3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4f940b2930 con 0x7f4f940b5750 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.696+0000 7f4f9926f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f940b3b60 0x7f4f9406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.696+0000 7f4f9926f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f940b3b60 0x7f4f9406fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59234/0 (socket says 172.21.15.146:59234) 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.696+0000 7f4f9926f640 1 -- 172.21.15.146:0/1636121821 learned_addr learned my addr 172.21.15.146:0/1636121821 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f98a6e640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f940b5750 0x7f4f9406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f99a70640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f940b5ce0 0x7f4f94154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f9926f640 1 -- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f940b5750 msgr2=0x7f4f9406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:32.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f9926f640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f940b5750 0x7f4f9406ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:32.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f9926f640 1 -- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f940b5ce0 msgr2=0x7f4f94154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:32.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f9926f640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f940b5ce0 0x7f4f94154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:32.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f9926f640 1 -- 172.21.15.146:0/1636121821 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9406de90 con 0x7f4f940b3b60 2024-09-17T03:41:32.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f99a70640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f940b5ce0 0x7f4f94154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:32.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f9926f640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f940b3b60 0x7f4f9406fa00 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d770 tx=0x7f4f9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:32.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f89ffb640 1 -- 172.21.15.146:0/1636121821 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90017070 con 0x7f4f940b3b60 2024-09-17T03:41:32.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f89ffb640 1 -- 172.21.15.146:0/1636121821 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f90009d20 con 0x7f4f940b3b60 2024-09-17T03:41:32.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/1636121821 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9406e170 con 0x7f4f940b3b60 2024-09-17T03:41:32.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f89ffb640 1 -- 172.21.15.146:0/1636121821 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f900106c0 con 0x7f4f940b3b60 2024-09-17T03:41:32.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.697+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/1636121821 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9406e730 con 0x7f4f940b3b60 2024-09-17T03:41:32.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.698+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/1636121821 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f940b2e00 con 0x7f4f940b3b60 2024-09-17T03:41:32.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.699+0000 7f4f89ffb640 1 -- 172.21.15.146:0/1636121821 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f9001a070 con 0x7f4f940b3b60 2024-09-17T03:41:32.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.700+0000 7f4f89ffb640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f78078bc0 0x7f4f7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:32.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.700+0000 7f4f89ffb640 1 -- 172.21.15.146:0/1636121821 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f4f9009adc0 con 0x7f4f940b3b60 2024-09-17T03:41:32.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.700+0000 7f4f98a6e640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f78078bc0 0x7f4f7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:32.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.701+0000 7f4f98a6e640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f78078bc0 0x7f4f7807b0d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4f84034000 tx=0x7f4f84004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:32.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.704+0000 7f4f89ffb640 1 -- 172.21.15.146:0/1636121821 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f90063290 con 0x7f4f940b3b60 2024-09-17T03:41:32.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.912+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/1636121821 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f94072500 con 0x7f4f940b3b60 2024-09-17T03:41:32.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.913+0000 7f4f89ffb640 1 -- 172.21.15.146:0/1636121821 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7f4f90062b90 con 0x7f4f940b3b60 2024-09-17T03:41:32.913 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:32.913 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:32.913 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:32.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f78078bc0 msgr2=0x7f4f7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:32.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f78078bc0 0x7f4f7807b0d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4f84034000 tx=0x7f4f84004730 comp rx=0 tx=0).stop 2024-09-17T03:41:32.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/1636121821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f940b3b60 msgr2=0x7f4f9406fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:32.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f940b3b60 0x7f4f9406fa00 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000d770 tx=0x7f4f9000dc30 comp rx=0 tx=0).stop 2024-09-17T03:41:32.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/1636121821 shutdown_connections 2024-09-17T03:41:32.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f78078bc0 0x7f4f7807b0d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:32.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f940b5ce0 0x7f4f94154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:32.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f940b5750 0x7f4f9406ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:32.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 --2- 172.21.15.146:0/1636121821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f940b3b60 0x7f4f9406fa00 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:32.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/1636121821 >> 172.21.15.146:0/1636121821 conn(0x7f4f940b7b20 msgr2=0x7f4f94071df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:32.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/1636121821 shutdown_connections 2024-09-17T03:41:32.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:32.915+0000 7f4f9b4d3640 1 -- 172.21.15.146:0/1636121821 wait complete. 2024-09-17T03:41:32.926 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:41:32.927 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:41:33.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.038+0000 7fd9d678e640 1 -- 172.21.15.146:0/2233460430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d00b5ce0 msgr2=0x7fd9d00b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.038+0000 7fd9d678e640 1 --2- 172.21.15.146:0/2233460430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d00b5ce0 0x7fd9d00b1320 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00b8440 tx=0x7fd9c002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.038+0000 7fd9d678e640 1 -- 172.21.15.146:0/2233460430 shutdown_connections 2024-09-17T03:41:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.038+0000 7fd9d678e640 1 --2- 172.21.15.146:0/2233460430 >> v2:172.21.15.179:3300/0 conn(0x7fd9d00b5750 0x7fd9d00b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.038+0000 7fd9d678e640 1 --2- 172.21.15.146:0/2233460430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d00b5ce0 0x7fd9d00b1320 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.038+0000 7fd9d678e640 1 -- 172.21.15.146:0/2233460430 >> 172.21.15.146:0/2233460430 conn(0x7fd9d00b7b20 msgr2=0x7fd9d009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.038+0000 7fd9d678e640 1 -- 172.21.15.146:0/2233460430 shutdown_connections 2024-09-17T03:41:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.038+0000 7fd9d678e640 1 -- 172.21.15.146:0/2233460430 wait complete. 2024-09-17T03:41:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.040+0000 7fd9d678e640 1 Processor -- start 2024-09-17T03:41:33.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.040+0000 7fd9d678e640 1 -- start start 2024-09-17T03:41:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.041+0000 7fd9d678e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d00b3b60 0x7fd9d0145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.041+0000 7fd9d678e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d00b5750 0x7fd9d01575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.041+0000 7fd9d678e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d00b5ce0 0x7fd9d01f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.041+0000 7fd9d678e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d00b27b0 con 0x7fd9d00b3b60 2024-09-17T03:41:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.041+0000 7fd9d678e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d015dcc0 con 0x7fd9d00b5750 2024-09-17T03:41:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.041+0000 7fd9d678e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d00b2930 con 0x7fd9d00b5ce0 2024-09-17T03:41:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.041+0000 7fd9cffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d00b3b60 0x7fd9d0145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.041+0000 7fd9cffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d00b3b60 0x7fd9d0145150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59248/0 (socket says 172.21.15.146:59248) 2024-09-17T03:41:33.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9cffff640 1 -- 172.21.15.146:0/2666171706 learned_addr learned my addr 172.21.15.146:0/2666171706 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9cf7fe640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d00b5750 0x7fd9d01575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9d4d2b640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d00b5ce0 0x7fd9d01f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9cffff640 1 -- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d00b5ce0 msgr2=0x7fd9d01f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9cffff640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d00b5ce0 0x7fd9d01f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9cffff640 1 -- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d00b5750 msgr2=0x7fd9d01575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9cffff640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d00b5750 0x7fd9d01575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9cffff640 1 -- 172.21.15.146:0/2666171706 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d0157b20 con 0x7fd9d00b3b60 2024-09-17T03:41:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9cffff640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d00b3b60 0x7fd9d0145150 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0000c00 tx=0x7fd9c0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9ccff9640 1 -- 172.21.15.146:0/2666171706 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c003e030 con 0x7fd9d00b3b60 2024-09-17T03:41:33.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9ccff9640 1 -- 172.21.15.146:0/2666171706 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9c0003e00 con 0x7fd9d00b3b60 2024-09-17T03:41:33.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9d678e640 1 -- 172.21.15.146:0/2666171706 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d0155d00 con 0x7fd9d00b3b60 2024-09-17T03:41:33.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9ccff9640 1 -- 172.21.15.146:0/2666171706 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0035040 con 0x7fd9d00b3b60 2024-09-17T03:41:33.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.042+0000 7fd9d678e640 1 -- 172.21.15.146:0/2666171706 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d01562c0 con 0x7fd9d00b3b60 2024-09-17T03:41:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.043+0000 7fd9d678e640 1 -- 172.21.15.146:0/2666171706 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d01512c0 con 0x7fd9d00b3b60 2024-09-17T03:41:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.044+0000 7fd9ccff9640 1 -- 172.21.15.146:0/2666171706 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9c0041030 con 0x7fd9d00b3b60 2024-09-17T03:41:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.045+0000 7fd9ccff9640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078bf0 0x7fd9bc07b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.045+0000 7fd9ccff9640 1 -- 172.21.15.146:0/2666171706 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fd9c00bb480 con 0x7fd9d00b3b60 2024-09-17T03:41:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.045+0000 7fd9cf7fe640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078bf0 0x7fd9bc07b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.045+0000 7fd9cf7fe640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078bf0 0x7fd9bc07b100 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0159180 tx=0x7fd9c400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.049+0000 7fd9ccff9640 1 -- 172.21.15.146:0/2666171706 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9c0083300 con 0x7fd9d00b3b60 2024-09-17T03:41:33.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.294+0000 7fd9d678e640 1 -- 172.21.15.146:0/2666171706 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd9d00b2e00 con 0x7fd9d00b3b60 2024-09-17T03:41:33.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.294+0000 7fd9ccff9640 1 -- 172.21.15.146:0/2666171706 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7fd9c0087d30 con 0x7fd9d00b3b60 2024-09-17T03:41:33.295 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:33.295 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":537,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076736355,"bytes_used":2560253952,"bytes_avail":770533859328,"bytes_total":773094113280,"write_bytes_sec":63288675,"read_op_per_sec":0,"write_op_per_sec":68},"fsmap":{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8658}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-17T03:41:31.927393+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:41:33.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 -- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078bf0 msgr2=0x7fd9bc07b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078bf0 0x7fd9bc07b100 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0159180 tx=0x7fd9c400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 -- 172.21.15.146:0/2666171706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d00b3b60 msgr2=0x7fd9d0145150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d00b3b60 0x7fd9d0145150 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0000c00 tx=0x7fd9c0003910 comp rx=0 tx=0).stop 2024-09-17T03:41:33.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 -- 172.21.15.146:0/2666171706 shutdown_connections 2024-09-17T03:41:33.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078bf0 0x7fd9bc07b100 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d00b5ce0 0x7fd9d01f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d00b5750 0x7fd9d01575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 --2- 172.21.15.146:0/2666171706 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d00b3b60 0x7fd9d0145150 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 -- 172.21.15.146:0/2666171706 >> 172.21.15.146:0/2666171706 conn(0x7fd9d00b7b20 msgr2=0x7fd9d00b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 -- 172.21.15.146:0/2666171706 shutdown_connections 2024-09-17T03:41:33.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.297+0000 7fd9d678e640 1 -- 172.21.15.146:0/2666171706 wait complete. 2024-09-17T03:41:33.308 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-17T03:41:33.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:33.308 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub resume 2024-09-17T03:41:33.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.424+0000 7fe9ba206640 1 -- 172.21.15.146:0/2996608172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9b40b47c0 msgr2=0x7fe9b40cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.424+0000 7fe9ba206640 1 --2- 172.21.15.146:0/2996608172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9b40b47c0 0x7fe9b40cd090 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40d3620 tx=0x7fe9a802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.424+0000 7fe9ba206640 1 -- 172.21.15.146:0/2996608172 shutdown_connections 2024-09-17T03:41:33.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.424+0000 7fe9ba206640 1 --2- 172.21.15.146:0/2996608172 >> v2:172.21.15.179:3300/0 conn(0x7fe9b40cd5d0 0x7fe9b40cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.424+0000 7fe9ba206640 1 --2- 172.21.15.146:0/2996608172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9b40b47c0 0x7fe9b40cd090 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.424+0000 7fe9ba206640 1 -- 172.21.15.146:0/2996608172 >> 172.21.15.146:0/2996608172 conn(0x7fe9b409ba20 msgr2=0x7fe9b40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.424+0000 7fe9ba206640 1 -- 172.21.15.146:0/2996608172 shutdown_connections 2024-09-17T03:41:33.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.424+0000 7fe9ba206640 1 -- 172.21.15.146:0/2996608172 wait complete. 2024-09-17T03:41:33.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.426+0000 7fe9ba206640 1 Processor -- start 2024-09-17T03:41:33.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.426+0000 7fe9ba206640 1 -- start start 2024-09-17T03:41:33.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9ba206640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9b40b47c0 0x7fe9b41f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9ba206640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9b40cd5d0 0x7fe9b40c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9ba206640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b40d0710 0x7fe9b40b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9ba206640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b40b80a0 con 0x7fe9b40cd5d0 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9ba206640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b40b1de0 con 0x7fe9b40d0710 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9ba206640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b40af910 con 0x7fe9b40b47c0 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9b40cd5d0 0x7fe9b40c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9b40cd5d0 0x7fe9b40c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59256/0 (socket says 172.21.15.146:59256) 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/63379944 learned_addr learned my addr 172.21.15.146:0/63379944 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9b40b47c0 0x7fe9b41f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b3fff640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b40d0710 0x7fe9b40b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9b40b47c0 msgr2=0x7fe9b41f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9b40b47c0 0x7fe9b41f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b40d0710 msgr2=0x7fe9b40b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b40d0710 0x7fe9b40b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/63379944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b40719f0 con 0x7fe9b40cd5d0 2024-09-17T03:41:33.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b3fff640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b40d0710 0x7fe9b40b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:33.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9b40cd5d0 0x7fe9b40c5160 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009780 tx=0x7fe9a8033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.428+0000 7fe99bfff640 1 -- 172.21.15.146:0/63379944 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8031d60 con 0x7fe9b40cd5d0 2024-09-17T03:41:33.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.429+0000 7fe99bfff640 1 -- 172.21.15.146:0/63379944 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9a8005020 con 0x7fe9b40cd5d0 2024-09-17T03:41:33.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.429+0000 7fe9ba206640 1 -- 172.21.15.146:0/63379944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b4071cd0 con 0x7fe9b40cd5d0 2024-09-17T03:41:33.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.429+0000 7fe99bfff640 1 -- 172.21.15.146:0/63379944 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8005470 con 0x7fe9b40cd5d0 2024-09-17T03:41:33.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.429+0000 7fe9ba206640 1 -- 172.21.15.146:0/63379944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b40c7920 con 0x7fe9b40cd5d0 2024-09-17T03:41:33.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.431+0000 7fe99bfff640 1 -- 172.21.15.146:0/63379944 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9a80047a0 con 0x7fe9b40cd5d0 2024-09-17T03:41:33.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.431+0000 7fe99bfff640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078bc0 0x7fe9a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.431+0000 7fe99bfff640 1 -- 172.21.15.146:0/63379944 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fe9a80bbeb0 con 0x7fe9b40cd5d0 2024-09-17T03:41:33.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.431+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078bc0 0x7fe9a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.432+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078bc0 0x7fe9a007b0d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4000f60 tx=0x7fe9a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.432+0000 7fe9c124a740 1 Processor -- start 2024-09-17T03:41:33.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.432+0000 7fe9c124a740 1 -- start start 2024-09-17T03:41:33.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.433+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b6301c390 0x564b63408a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.433+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.433+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ffb6b0 0x564b633ddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.433+0000 7fe9c124a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564b63336a60 con 0x564b62ff34d0 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.433+0000 7fe9c124a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564b63325e90 con 0x564b6301c390 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.433+0000 7fe9c124a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564b63329ca0 con 0x564b62ffb6b0 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59258/0 (socket says 172.21.15.146:59258) 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/730500754 learned_addr learned my addr 172.21.15.146:0/730500754 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/730500754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b6301c390 0x564b63408a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b3fff640 1 --2- 172.21.15.146:0/730500754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ffb6b0 0x564b633ddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/730500754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ffb6b0 msgr2=0x564b633ddda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/730500754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ffb6b0 0x564b633ddda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/730500754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b6301c390 msgr2=0x564b63408a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/730500754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b6301c390 0x564b63408a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/730500754 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b630fe7d0 con 0x564b62ff34d0 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/730500754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b6301c390 0x564b63408a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/730500754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dd860 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80ba320 tx=0x7fe9a8083b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4d6991df6a321 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9997fa640 1 -- 172.21.15.146:0/730500754 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8048070 con 0x564b62ff34d0 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9997fa640 1 -- 172.21.15.146:0/730500754 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9a8083d30 con 0x564b62ff34d0 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.434+0000 7fe9997fa640 1 -- 172.21.15.146:0/730500754 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8088760 con 0x564b62ff34d0 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.435+0000 7fe9c124a740 1 -- 172.21.15.146:0/730500754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 msgr2=0x564b633dd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.435+0000 7fe9c124a740 1 --2- 172.21.15.146:0/730500754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dd860 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80ba320 tx=0x7fe9a8083b00 comp rx=0 tx=0).stop 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.435+0000 7fe9c124a740 1 -- 172.21.15.146:0/730500754 shutdown_connections 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.435+0000 7fe9c124a740 1 --2- 172.21.15.146:0/730500754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ffb6b0 0x564b633ddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.435+0000 7fe9c124a740 1 --2- 172.21.15.146:0/730500754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dd860 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.435+0000 7fe9c124a740 1 --2- 172.21.15.146:0/730500754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b6301c390 0x564b63408a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.435+0000 7fe9c124a740 1 -- 172.21.15.146:0/730500754 >> 172.21.15.146:0/730500754 conn(0x564b630104e0 msgr2=0x564b633c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.435+0000 7fe9c124a740 1 -- 172.21.15.146:0/730500754 shutdown_connections 2024-09-17T03:41:33.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.435+0000 7fe9c124a740 1 -- 172.21.15.146:0/730500754 wait complete. 2024-09-17T03:41:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.436+0000 7fe9c124a740 1 -- start start 2024-09-17T03:41:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.436+0000 7fe9c124a740 1 Processor -- start 2024-09-17T03:41:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.437+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.437+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ffb6b0 0x564b633dca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.437+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b6301c390 0x564b634052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.437+0000 7fe9c124a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x564b63096740 con 0x564b62ff34d0 2024-09-17T03:41:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.437+0000 7fe9c124a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564b632cb970 con 0x564b62ffb6b0 2024-09-17T03:41:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.437+0000 7fe9c124a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564b6340a930 con 0x564b6301c390 2024-09-17T03:41:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.437+0000 7fe9c124a740 10 client.0 _ll_register_callbacks cb 0x564b632da780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.437+0000 7fe9b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59274/0 (socket says 172.21.15.146:59274) 2024-09-17T03:41:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b37fe640 1 -- 172.21.15.146:0/2744969793 learned_addr learned my addr 172.21.15.146:0/2744969793 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b3fff640 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b6301c390 0x564b634052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ffb6b0 0x564b633dca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b37fe640 1 -- 172.21.15.146:0/2744969793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b6301c390 msgr2=0x564b634052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b6301c390 0x564b634052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b37fe640 1 -- 172.21.15.146:0/2744969793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ffb6b0 msgr2=0x564b633dca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ffb6b0 0x564b633dca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b37fe640 1 -- 172.21.15.146:0/2744969793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b63087970 con 0x564b62ff34d0 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b3fff640 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b6301c390 0x564b634052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ffb6b0 0x564b633dca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dc540 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4014700 tx=0x7fe9a4001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863a95a3c78440fd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9927fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9927fc640 1 -- 172.21.15.146:0/2744969793 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4013680 con 0x564b62ff34d0 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9927fc640 1 -- 172.21.15.146:0/2744969793 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fe9a4013820 con 0x564b62ff34d0 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9c124a740 1 -- 172.21.15.146:0/2744969793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9a8083d30 con 0x564b62ff34d0 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9927fc640 1 -- 172.21.15.146:0/2744969793 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fe9a402e050 con 0x564b62ff34d0 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9c124a740 10 client.8955 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.438+0000 7fe9c124a740 1 -- 172.21.15.146:0/2744969793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x564b630656a0 con 0x564b62ff34d0 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.439+0000 7fe9927fc640 1 -- 172.21.15.146:0/2744969793 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9a8083d30 con 0x564b62ff34d0 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.439+0000 7fe9927fc640 1 -- 172.21.15.146:0/2744969793 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7fe9a4031020 con 0x564b62ff34d0 2024-09-17T03:41:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.439+0000 7fe9c124a740 10 client.8955 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.439+0000 7fe9c124a740 10 client.8955 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.439+0000 7fe9c124a740 20 client.8955 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.439+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x564b62fdaf60 0x564b633ec770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.439+0000 7fe9c124a740 4 client.8955 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.439+0000 7fe9c124a740 1 -- 172.21.15.146:0/2744969793 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b633389b0 con 0x564b62fdaf60 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.439+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x564b62fdaf60 0x564b633ec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.439+0000 7fe9927fc640 10 client.8955 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.439+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x564b62fdaf60 0x564b633ec770 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9631af7ed7612c0 server_cookie=980dfb9b1bce385 in_seq=0 out_seq=0 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9927fc640 1 -- 172.21.15.146:0/2744969793 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b633389b0 con 0x564b62fdaf60 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9927fc640 10 client.8955 handle_command_reply: tid=0 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 1 client.8955 shutdown 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 1 -- 172.21.15.146:0/2744969793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 msgr2=0x564b633dc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dc540 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4014700 tx=0x7fe9a4001080 comp rx=0 tx=0).stop 2024-09-17T03:41:33.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 1 -- 172.21.15.146:0/2744969793 shutdown_connections 2024-09-17T03:41:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x564b62fdaf60 0x564b633ec770 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b6301c390 0x564b634052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ffb6b0 0x564b633dca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9927fc640 0 client.8955 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2744969793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b62ff34d0 0x564b633dc540 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 1 -- 172.21.15.146:0/2744969793 >> 172.21.15.146:0/2744969793 conn(0x564b630104e0 msgr2=0x564b633bea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 1 -- 172.21.15.146:0/2744969793 shutdown_connections 2024-09-17T03:41:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 1 -- 172.21.15.146:0/2744969793 wait complete. 2024-09-17T03:41:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.440+0000 7fe9c124a740 20 client.8955 trim_cache size 0 max 16384 2024-09-17T03:41:33.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.458+0000 7fe9c124a740 1 Processor -- start 2024-09-17T03:41:33.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.458+0000 7fe9c124a740 1 -- start start 2024-09-17T03:41:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ff34d0 0x564b633edb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ffb6b0 0x564b63408a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633dd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9c124a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b4201ec0 con 0x564b6301c390 2024-09-17T03:41:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9c124a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b41f9c20 con 0x564b62ffb6b0 2024-09-17T03:41:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9c124a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b41f8f80 con 0x564b62ff34d0 2024-09-17T03:41:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633dd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633dd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59276/0 (socket says 172.21.15.146:59276) 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9b3fff640 1 -- 172.21.15.146:0/2790323091 learned_addr learned my addr 172.21.15.146:0/2790323091 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/2790323091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ffb6b0 0x564b63408a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/2790323091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ff34d0 0x564b633edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9b3fff640 1 -- 172.21.15.146:0/2790323091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ff34d0 msgr2=0x564b633edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.459+0000 7fe9b3fff640 1 --2- 172.21.15.146:0/2790323091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ff34d0 0x564b633edb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.460+0000 7fe9b3fff640 1 -- 172.21.15.146:0/2790323091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ffb6b0 msgr2=0x564b63408a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.460+0000 7fe9b3fff640 1 --2- 172.21.15.146:0/2790323091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ffb6b0 0x564b63408a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.460+0000 7fe9b3fff640 1 -- 172.21.15.146:0/2790323091 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b633c0860 con 0x564b6301c390 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.460+0000 7fe9b3fff640 1 --2- 172.21.15.146:0/2790323091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633dd620 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac012480 tx=0x7fe9ac012940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81918ab0ee0cb8f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.460+0000 7fe998ff9640 1 -- 172.21.15.146:0/2790323091 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac004b20 con 0x564b6301c390 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.460+0000 7fe998ff9640 1 -- 172.21.15.146:0/2790323091 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9ac004cc0 con 0x564b6301c390 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.460+0000 7fe998ff9640 1 -- 172.21.15.146:0/2790323091 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac010a20 con 0x564b6301c390 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.461+0000 7fe9c124a740 1 -- 172.21.15.146:0/2790323091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 msgr2=0x564b633dd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.461+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2790323091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633dd620 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac012480 tx=0x7fe9ac012940 comp rx=0 tx=0).stop 2024-09-17T03:41:33.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.461+0000 7fe9c124a740 1 -- 172.21.15.146:0/2790323091 shutdown_connections 2024-09-17T03:41:33.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.461+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2790323091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633dd620 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.461+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2790323091 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ffb6b0 0x564b63408a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.461+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2790323091 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ff34d0 0x564b633edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.461+0000 7fe9c124a740 1 -- 172.21.15.146:0/2790323091 >> 172.21.15.146:0/2790323091 conn(0x564b630104e0 msgr2=0x564b633c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.461+0000 7fe9c124a740 1 -- 172.21.15.146:0/2790323091 shutdown_connections 2024-09-17T03:41:33.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.461+0000 7fe9c124a740 1 -- 172.21.15.146:0/2790323091 wait complete. 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.462+0000 7fe9c124a740 1 -- start start 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.462+0000 7fe9c124a740 1 Processor -- start 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ff34d0 0x564b6340f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ffb6b0 0x564b6346de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9c124a740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9c124a740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b41f95d0 con 0x564b6301c390 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9c124a740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564b63401d80 con 0x564b62ff34d0 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9c124a740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564b6346e390 con 0x564b62ffb6b0 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9c124a740 10 client.0 _ll_register_callbacks cb 0x7fe9a4017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9b3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59290/0 (socket says 172.21.15.146:59290) 2024-09-17T03:41:33.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9b3fff640 1 -- 172.21.15.146:0/2535909175 learned_addr learned my addr 172.21.15.146:0/2535909175 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ffb6b0 0x564b6346de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ff34d0 0x564b6340f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9b3fff640 1 -- 172.21.15.146:0/2535909175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ffb6b0 msgr2=0x564b6346de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9b3fff640 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ffb6b0 0x564b6346de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9b3fff640 1 -- 172.21.15.146:0/2535909175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ff34d0 msgr2=0x564b6340f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9b3fff640 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ff34d0 0x564b6340f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.463+0000 7fe9b3fff640 1 -- 172.21.15.146:0/2535909175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b634882c0 con 0x564b6301c390 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9b3fff640 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633ff5f0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac014040 tx=0x7fe9ac00ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41944877d647c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9927fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9927fc640 1 -- 172.21.15.146:0/2535909175 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac010a50 con 0x564b6301c390 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9927fc640 1 -- 172.21.15.146:0/2535909175 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fe9ac018040 con 0x564b6301c390 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9c124a740 1 -- 172.21.15.146:0/2535909175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9ac004cc0 con 0x564b6301c390 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9927fc640 1 -- 172.21.15.146:0/2535909175 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fe9ac033050 con 0x564b6301c390 2024-09-17T03:41:33.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9c124a740 10 client.8961 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9c124a740 1 -- 172.21.15.146:0/2535909175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x564b633edd20 con 0x564b6301c390 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9927fc640 1 -- 172.21.15.146:0/2535909175 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9ac004cc0 con 0x564b6301c390 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9927fc640 1 -- 172.21.15.146:0/2535909175 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7fe9ac036020 con 0x564b6301c390 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9c124a740 10 client.8961 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9c124a740 10 client.8961 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9c124a740 20 client.8961 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x564b633ffd10 0x564b6348b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9c124a740 4 client.8961 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9c124a740 1 -- 172.21.15.146:0/2535909175 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x564b63334460 con 0x564b633ffd10 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.464+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x564b633ffd10 0x564b6348b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.465+0000 7fe9b37fe640 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x564b633ffd10 0x564b6348b6c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90e5e684876ccff9 server_cookie=19b2e789fa32e7e7 in_seq=0 out_seq=0 2024-09-17T03:41:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.465+0000 7fe9927fc640 10 client.8961 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:33.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.466+0000 7fe9927fc640 1 -- 172.21.15.146:0/2535909175 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564b63334460 con 0x564b633ffd10 2024-09-17T03:41:33.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.466+0000 7fe9927fc640 10 client.8961 handle_command_reply: tid=0 2024-09-17T03:41:33.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.466+0000 7fe9c124a740 1 client.8961 shutdown 2024-09-17T03:41:33.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.466+0000 7fe9c124a740 1 -- 172.21.15.146:0/2535909175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 msgr2=0x564b633ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.466+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633ff5f0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac014040 tx=0x7fe9ac00ad60 comp rx=0 tx=0).stop 2024-09-17T03:41:33.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9c124a740 1 -- 172.21.15.146:0/2535909175 shutdown_connections 2024-09-17T03:41:33.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x564b633ffd10 0x564b6348b6c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b6301c390 0x564b633ff5f0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564b62ffb6b0 0x564b6346de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9927fc640 0 client.8961 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:33.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9c124a740 1 --2- 172.21.15.146:0/2535909175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564b62ff34d0 0x564b6340f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9c124a740 1 -- 172.21.15.146:0/2535909175 >> 172.21.15.146:0/2535909175 conn(0x564b630104e0 msgr2=0x564b633ed530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9c124a740 1 -- 172.21.15.146:0/2535909175 shutdown_connections 2024-09-17T03:41:33.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9c124a740 1 -- 172.21.15.146:0/2535909175 wait complete. 2024-09-17T03:41:33.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9c124a740 20 client.8961 trim_cache size 0 max 16384 2024-09-17T03:41:33.471 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:41:33.472 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:41:33.472 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:41:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9ba206640 1 -- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078bc0 msgr2=0x7fe9a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9ba206640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078bc0 0x7fe9a007b0d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4000f60 tx=0x7fe9a4009040 comp rx=0 tx=0).stop 2024-09-17T03:41:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9ba206640 1 -- 172.21.15.146:0/63379944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9b40cd5d0 msgr2=0x7fe9b40c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9ba206640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9b40cd5d0 0x7fe9b40c5160 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009780 tx=0x7fe9a8033d60 comp rx=0 tx=0).stop 2024-09-17T03:41:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9ba206640 1 -- 172.21.15.146:0/63379944 shutdown_connections 2024-09-17T03:41:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9ba206640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078bc0 0x7fe9a007b0d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9ba206640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9b40d0710 0x7fe9b40b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9ba206640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9b40cd5d0 0x7fe9b40c5160 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9ba206640 1 --2- 172.21.15.146:0/63379944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9b40b47c0 0x7fe9b41f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.467+0000 7fe9ba206640 1 -- 172.21.15.146:0/63379944 >> 172.21.15.146:0/63379944 conn(0x7fe9b409ba20 msgr2=0x7fe9b40ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.468+0000 7fe9ba206640 1 -- 172.21.15.146:0/63379944 shutdown_connections 2024-09-17T03:41:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.468+0000 7fe9ba206640 1 -- 172.21.15.146:0/63379944 wait complete. 2024-09-17T03:41:33.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:33.483 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-17T03:41:33.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.605+0000 7ff844139640 1 -- 172.21.15.146:0/1836821453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c0b5e30 msgr2=0x7ff83c0b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.605+0000 7ff844139640 1 --2- 172.21.15.146:0/1836821453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c0b5e30 0x7ff83c0b6240 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0b3d60 tx=0x7ff83402aa30 comp rx=0 tx=0).stop 2024-09-17T03:41:33.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.605+0000 7ff844139640 1 -- 172.21.15.146:0/1836821453 shutdown_connections 2024-09-17T03:41:33.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.605+0000 7ff844139640 1 --2- 172.21.15.146:0/1836821453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c0b5e30 0x7ff83c0b6240 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.605+0000 7ff844139640 1 --2- 172.21.15.146:0/1836821453 >> v2:172.21.15.179:3300/0 conn(0x7ff83c06f580 0x7ff83c06f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.605+0000 7ff844139640 1 --2- 172.21.15.146:0/1836821453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff83c0b4450 0x7ff83c15c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.605+0000 7ff844139640 1 -- 172.21.15.146:0/1836821453 >> 172.21.15.146:0/1836821453 conn(0x7ff83c0b3150 msgr2=0x7ff83c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.605+0000 7ff844139640 1 -- 172.21.15.146:0/1836821453 shutdown_connections 2024-09-17T03:41:33.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.605+0000 7ff844139640 1 -- 172.21.15.146:0/1836821453 wait complete. 2024-09-17T03:41:33.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.608+0000 7ff844139640 1 Processor -- start 2024-09-17T03:41:33.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.608+0000 7ff844139640 1 -- start start 2024-09-17T03:41:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff844139640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c06f580 0x7ff83c0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff844139640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff83c0b4450 0x7ff83c14aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff844139640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff83c0b5e30 0x7ff83c1f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff844139640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c073580 con 0x7ff83c06f580 2024-09-17T03:41:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff844139640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c0d1270 con 0x7ff83c0b4450 2024-09-17T03:41:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff844139640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff83c073700 con 0x7ff83c0b5e30 2024-09-17T03:41:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff841ed5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c06f580 0x7ff83c0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff841ed5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c06f580 0x7ff83c0caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59302/0 (socket says 172.21.15.146:59302) 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff841ed5640 1 -- 172.21.15.146:0/3311415740 learned_addr learned my addr 172.21.15.146:0/3311415740 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff8426d6640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff83c0b5e30 0x7ff83c1f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff8416d4640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff83c0b4450 0x7ff83c14aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff841ed5640 1 -- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff83c0b5e30 msgr2=0x7ff83c1f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff841ed5640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff83c0b5e30 0x7ff83c1f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff841ed5640 1 -- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff83c0b4450 msgr2=0x7ff83c14aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff841ed5640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff83c0b4450 0x7ff83c14aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff841ed5640 1 -- 172.21.15.146:0/3311415740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83c1f3980 con 0x7ff83c06f580 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff8426d6640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff83c0b5e30 0x7ff83c1f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.610+0000 7ff841ed5640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c06f580 0x7ff83c0caa30 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7ff83800e7c0 tx=0x7ff83800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.611+0000 7ff8327fc640 1 -- 172.21.15.146:0/3311415740 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83800ccc0 con 0x7ff83c06f580 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.611+0000 7ff8327fc640 1 -- 172.21.15.146:0/3311415740 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff83800ce80 con 0x7ff83c06f580 2024-09-17T03:41:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.611+0000 7ff8327fc640 1 -- 172.21.15.146:0/3311415740 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838005280 con 0x7ff83c06f580 2024-09-17T03:41:33.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.611+0000 7ff844139640 1 -- 172.21.15.146:0/3311415740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83c0caf70 con 0x7ff83c06f580 2024-09-17T03:41:33.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.611+0000 7ff844139640 1 -- 172.21.15.146:0/3311415740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff83c1f79c0 con 0x7ff83c06f580 2024-09-17T03:41:33.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.614+0000 7ff8327fc640 1 -- 172.21.15.146:0/3311415740 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff838005420 con 0x7ff83c06f580 2024-09-17T03:41:33.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.614+0000 7ff8327fc640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff820078b90 0x7ff82007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.614+0000 7ff8327fc640 1 -- 172.21.15.146:0/3311415740 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7ff83809b660 con 0x7ff83c06f580 2024-09-17T03:41:33.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.614+0000 7ff84b0ad740 1 Processor -- start 2024-09-17T03:41:33.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.614+0000 7ff8416d4640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff820078b90 0x7ff82007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.614+0000 7ff84b0ad740 1 -- start start 2024-09-17T03:41:33.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.615+0000 7ff8416d4640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff820078b90 0x7ff82007b0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0cdac0 tx=0x7ff82c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.616+0000 7ff84b0ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 0x561378052a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.616+0000 7ff84b0ad740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378027860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff841ed5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 0x561378052a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff841ed5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 0x561378052a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:35412/0 (socket says 172.21.15.146:35412) 2024-09-17T03:41:33.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff8416d4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378027860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff8416d4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378027860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59308/0 (socket says 172.21.15.146:59308) 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff841ed5640 1 -- 172.21.15.146:0/754678944 learned_addr learned my addr 172.21.15.146:0/754678944 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/754678944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c456b0 0x561378027da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff84b0ad740 1 -- 172.21.15.146:0/754678944 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561377f80a60 con 0x561377c3d4d0 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff84b0ad740 1 -- 172.21.15.146:0/754678944 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561377f6fe90 con 0x561377c66390 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff84b0ad740 1 -- 172.21.15.146:0/754678944 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561377f73ca0 con 0x561377c456b0 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff8426d6640 1 --2- 172.21.15.146:0/754678944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c456b0 0x561378027da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff841ed5640 1 -- 172.21.15.146:0/754678944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c456b0 msgr2=0x561378027da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff841ed5640 1 --2- 172.21.15.146:0/754678944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c456b0 0x561378027da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff841ed5640 1 -- 172.21.15.146:0/754678944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 msgr2=0x561378027860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff841ed5640 1 --2- 172.21.15.146:0/754678944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378027860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff841ed5640 1 -- 172.21.15.146:0/754678944 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561377d487d0 con 0x561377c66390 2024-09-17T03:41:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.617+0000 7ff8416d4640 1 --2- 172.21.15.146:0/754678944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378027860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:41:33.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.618+0000 7ff841ed5640 1 --2- 172.21.15.146:0/754678944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 0x561378052a10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff838099bb0 tx=0x7ff838062e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a985d9e7ff357024 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.618+0000 7ff81f7fe640 1 -- 172.21.15.146:0/754678944 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838067e80 con 0x561377c66390 2024-09-17T03:41:33.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.618+0000 7ff81f7fe640 1 -- 172.21.15.146:0/754678944 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff838089030 con 0x561377c66390 2024-09-17T03:41:33.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.618+0000 7ff81f7fe640 1 -- 172.21.15.146:0/754678944 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83806cb70 con 0x561377c66390 2024-09-17T03:41:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.619+0000 7ff84b0ad740 1 -- 172.21.15.146:0/754678944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 msgr2=0x561378052a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.619+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/754678944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 0x561378052a10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff838099bb0 tx=0x7ff838062e60 comp rx=0 tx=0).stop 2024-09-17T03:41:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.619+0000 7ff84b0ad740 1 -- 172.21.15.146:0/754678944 shutdown_connections 2024-09-17T03:41:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.619+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/754678944 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c456b0 0x561378027da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.619+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/754678944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378027860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.619+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/754678944 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 0x561378052a10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.619+0000 7ff84b0ad740 1 -- 172.21.15.146:0/754678944 >> 172.21.15.146:0/754678944 conn(0x561377c5a4e0 msgr2=0x56137800dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.619+0000 7ff84b0ad740 1 -- 172.21.15.146:0/754678944 shutdown_connections 2024-09-17T03:41:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.619+0000 7ff84b0ad740 1 -- 172.21.15.146:0/754678944 wait complete. 2024-09-17T03:41:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.620+0000 7ff84b0ad740 1 -- start start 2024-09-17T03:41:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.620+0000 7ff84b0ad740 1 Processor -- start 2024-09-17T03:41:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.622+0000 7ff84b0ad740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378066080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.622+0000 7ff84b0ad740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c456b0 0x561378062a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.622+0000 7ff84b0ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 0x561378048710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.622+0000 7ff84b0ad740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561377ce0740 con 0x561377c3d4d0 2024-09-17T03:41:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.622+0000 7ff84b0ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561377f15970 con 0x561377c66390 2024-09-17T03:41:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.622+0000 7ff84b0ad740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561378035dd0 con 0x561377c456b0 2024-09-17T03:41:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.622+0000 7ff841ed5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.622+0000 7ff84b0ad740 10 client.0 _ll_register_callbacks cb 0x561377f24780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.622+0000 7ff841ed5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378066080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59318/0 (socket says 172.21.15.146:59318) 2024-09-17T03:41:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.622+0000 7ff841ed5640 1 -- 172.21.15.146:0/715344034 learned_addr learned my addr 172.21.15.146:0/715344034 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.622+0000 7ff8426d6640 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 0x561378048710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff841ed5640 1 -- 172.21.15.146:0/715344034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c456b0 msgr2=0x561378062a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff8416d4640 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c456b0 0x561378062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff841ed5640 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c456b0 0x561378062a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff841ed5640 1 -- 172.21.15.146:0/715344034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 msgr2=0x561378048710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff841ed5640 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 0x561378048710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff841ed5640 1 -- 172.21.15.146:0/715344034 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561377cd1970 con 0x561377c3d4d0 2024-09-17T03:41:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff8416d4640 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c456b0 0x561378062a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff841ed5640 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378066080 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ff838099fd0 tx=0x7ff83806cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccb94113f9e8338 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff81cff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff81cff9640 1 -- 172.21.15.146:0/715344034 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83806cdc0 con 0x561377c3d4d0 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff81cff9640 1 -- 172.21.15.146:0/715344034 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7ff8380626b0 con 0x561377c3d4d0 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff84b0ad740 1 -- 172.21.15.146:0/715344034 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff838089030 con 0x561377c3d4d0 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff81cff9640 1 -- 172.21.15.146:0/715344034 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7ff838074050 con 0x561377c3d4d0 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff84b0ad740 10 client.8973 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff84b0ad740 1 -- 172.21.15.146:0/715344034 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x561377caf6a0 con 0x561377c3d4d0 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.623+0000 7ff81cff9640 1 -- 172.21.15.146:0/715344034 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff838089030 con 0x561377c3d4d0 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.624+0000 7ff81cff9640 1 -- 172.21.15.146:0/715344034 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7ff838077020 con 0x561377c3d4d0 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.624+0000 7ff84b0ad740 10 client.8973 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.624+0000 7ff84b0ad740 10 client.8973 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.624+0000 7ff84b0ad740 20 client.8973 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.624+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561377c24f60 0x561378035580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.624+0000 7ff84b0ad740 4 client.8973 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:41:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.624+0000 7ff84b0ad740 1 -- 172.21.15.146:0/715344034 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561377f829b0 con 0x561377c24f60 2024-09-17T03:41:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.624+0000 7ff8416d4640 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561377c24f60 0x561378035580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.624+0000 7ff81cff9640 10 client.8973 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.624+0000 7ff8416d4640 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561377c24f60 0x561378035580 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4c7e9eeae8204c7 server_cookie=c3a3e08369454808 in_seq=0 out_seq=0 2024-09-17T03:41:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff81cff9640 1 -- 172.21.15.146:0/715344034 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561377f829b0 con 0x561377c24f60 2024-09-17T03:41:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff81cff9640 10 client.8973 handle_command_reply: tid=0 2024-09-17T03:41:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 1 client.8973 shutdown 2024-09-17T03:41:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 1 -- 172.21.15.146:0/715344034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 msgr2=0x561378066080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378066080 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ff838099fd0 tx=0x7ff83806cb60 comp rx=0 tx=0).stop 2024-09-17T03:41:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 1 -- 172.21.15.146:0/715344034 shutdown_connections 2024-09-17T03:41:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561377c24f60 0x561378035580 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c66390 0x561378048710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff81cff9640 0 client.8973 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c456b0 0x561378062a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/715344034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378066080 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 1 -- 172.21.15.146:0/715344034 >> 172.21.15.146:0/715344034 conn(0x561377c5a4e0 msgr2=0x561378027e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 1 -- 172.21.15.146:0/715344034 shutdown_connections 2024-09-17T03:41:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 1 -- 172.21.15.146:0/715344034 wait complete. 2024-09-17T03:41:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.627+0000 7ff84b0ad740 20 client.8973 trim_cache size 0 max 16384 2024-09-17T03:41:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.649+0000 7ff84b0ad740 1 Processor -- start 2024-09-17T03:41:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.649+0000 7ff84b0ad740 1 -- start start 2024-09-17T03:41:33.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.650+0000 7ff84b0ad740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c24f60 0x561378062880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.650+0000 7ff84b0ad740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378006dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.650+0000 7ff84b0ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c456b0 0x561378007310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.650+0000 7ff84b0ad740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c1582c0 con 0x561377c3d4d0 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff84b0ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c157300 con 0x561377c456b0 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff84b0ad740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff83c06d560 con 0x561377c24f60 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff8416d4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378006dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff8416d4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378006dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59334/0 (socket says 172.21.15.146:59334) 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff8426d6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c456b0 0x561378007310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff841ed5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c24f60 0x561378062880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff8416d4640 1 -- 172.21.15.146:0/3296944637 learned_addr learned my addr 172.21.15.146:0/3296944637 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff8416d4640 1 -- 172.21.15.146:0/3296944637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c24f60 msgr2=0x561378062880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff8416d4640 1 --2- 172.21.15.146:0/3296944637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c24f60 0x561378062880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff8416d4640 1 -- 172.21.15.146:0/3296944637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c456b0 msgr2=0x561378007310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff8416d4640 1 --2- 172.21.15.146:0/3296944637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c456b0 0x561378007310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff8416d4640 1 -- 172.21.15.146:0/3296944637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56137804fb40 con 0x561377c3d4d0 2024-09-17T03:41:33.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff8416d4640 1 --2- 172.21.15.146:0/3296944637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378006dd0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009860 tx=0x7ff82c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58352e7cb62ac836 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff81effd640 1 -- 172.21.15.146:0/3296944637 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c02d070 con 0x561377c3d4d0 2024-09-17T03:41:33.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff81effd640 1 -- 172.21.15.146:0/3296944637 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff82c003c70 con 0x561377c3d4d0 2024-09-17T03:41:33.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.651+0000 7ff81effd640 1 -- 172.21.15.146:0/3296944637 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c01f430 con 0x561377c3d4d0 2024-09-17T03:41:33.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.652+0000 7ff84b0ad740 1 -- 172.21.15.146:0/3296944637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 msgr2=0x561378006dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.652+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/3296944637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378006dd0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009860 tx=0x7ff82c014000 comp rx=0 tx=0).stop 2024-09-17T03:41:33.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.652+0000 7ff84b0ad740 1 -- 172.21.15.146:0/3296944637 shutdown_connections 2024-09-17T03:41:33.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.652+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/3296944637 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c456b0 0x561378007310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.652+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/3296944637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c3d4d0 0x561378006dd0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.652+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/3296944637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c24f60 0x561378062880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.652+0000 7ff84b0ad740 1 -- 172.21.15.146:0/3296944637 >> 172.21.15.146:0/3296944637 conn(0x561377c5a4e0 msgr2=0x561378047b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.653+0000 7ff84b0ad740 1 -- 172.21.15.146:0/3296944637 shutdown_connections 2024-09-17T03:41:33.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.653+0000 7ff84b0ad740 1 -- 172.21.15.146:0/3296944637 wait complete. 2024-09-17T03:41:33.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.654+0000 7ff84b0ad740 1 -- start start 2024-09-17T03:41:33.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.654+0000 7ff84b0ad740 1 Processor -- start 2024-09-17T03:41:33.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff84b0ad740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c24f60 0x561378006dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff84b0ad740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c3d4d0 0x561378007310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff84b0ad740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c456b0 0x561378046650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff84b0ad740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561378007990 con 0x561377c24f60 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff84b0ad740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c0cbe80 con 0x561377c456b0 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff84b0ad740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561378026040 con 0x561377c3d4d0 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff841ed5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c24f60 0x561378006dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff84b0ad740 10 client.0 _ll_register_callbacks cb 0x7ff83807c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff8416d4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c3d4d0 0x561378007310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff8426d6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c456b0 0x561378046650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff841ed5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c24f60 0x561378006dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59350/0 (socket says 172.21.15.146:59350) 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff8416d4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c3d4d0 0x561378007310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:35290/0 (socket says 172.21.15.146:35290) 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff841ed5640 1 -- 172.21.15.146:0/881186869 learned_addr learned my addr 172.21.15.146:0/881186869 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff841ed5640 1 -- 172.21.15.146:0/881186869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c3d4d0 msgr2=0x561378007310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff841ed5640 1 --2- 172.21.15.146:0/881186869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c3d4d0 0x561378007310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff841ed5640 1 -- 172.21.15.146:0/881186869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c456b0 msgr2=0x561378046650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff841ed5640 1 --2- 172.21.15.146:0/881186869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c456b0 0x561378046650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.656+0000 7ff841ed5640 1 -- 172.21.15.146:0/881186869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613780d5c30 con 0x561377c24f60 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff841ed5640 1 --2- 172.21.15.146:0/881186869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c24f60 0x561378006dd0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7ff838099fd0 tx=0x7ff83805efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7752eebe6e264135 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff81cff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff81cff9640 1 -- 172.21.15.146:0/881186869 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83806cdc0 con 0x561377c24f60 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff81cff9640 1 -- 172.21.15.146:0/881186869 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7ff838062330 con 0x561377c24f60 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff84b0ad740 1 -- 172.21.15.146:0/881186869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff82c003c70 con 0x561377c24f60 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff81cff9640 1 -- 172.21.15.146:0/881186869 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7ff838056050 con 0x561377c24f60 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff84b0ad740 10 client.8979 fetch_fsmap learned FSMap version 95 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff84b0ad740 1 -- 172.21.15.146:0/881186869 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x56137804aba0 con 0x561377c24f60 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff81cff9640 1 -- 172.21.15.146:0/881186869 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff82c003c70 con 0x561377c24f60 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff81cff9640 1 -- 172.21.15.146:0/881186869 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7ff838059020 con 0x561377c24f60 2024-09-17T03:41:33.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff84b0ad740 10 client.8979 fetch_fsmap finished waiting for FSMap version 95 2024-09-17T03:41:33.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff84b0ad740 10 client.8979 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-09-17T03:41:33.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff84b0ad740 20 client.8979 populate_metadata read hostname 'smithi146' 2024-09-17T03:41:33.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/881186869 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561377bfa3a0 0x561378046b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff84b0ad740 4 client.8979 mds_command: new command op to 8658 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:41:33.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.657+0000 7ff84b0ad740 1 -- 172.21.15.146:0/881186869 --> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561377f7e460 con 0x561377bfa3a0 2024-09-17T03:41:33.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.658+0000 7ff8416d4640 1 --2- 172.21.15.146:0/881186869 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561377bfa3a0 0x561378046b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.658+0000 7ff81cff9640 10 client.8979 ms_handle_connect on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:33.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.658+0000 7ff8416d4640 1 --2- 172.21.15.146:0/881186869 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561377bfa3a0 0x561378046b90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=816ed4a220daad23 server_cookie=45d05827cb570020 in_seq=0 out_seq=0 2024-09-17T03:41:33.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff81cff9640 1 -- 172.21.15.146:0/881186869 <== mds.0 v2:172.21.15.146:6832/141241275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+618 (crc 0 0 0) 0x561377f7e460 con 0x561377bfa3a0 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff81cff9640 10 client.8979 handle_command_reply: tid=0 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff84b0ad740 1 client.8979 shutdown 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff84b0ad740 1 -- 172.21.15.146:0/881186869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c24f60 msgr2=0x561378006dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/881186869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c24f60 0x561378006dd0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7ff838099fd0 tx=0x7ff83805efd0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff84b0ad740 1 -- 172.21.15.146:0/881186869 shutdown_connections 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/881186869 >> [v2:172.21.15.146:6832/141241275,v1:172.21.15.146:6834/141241275] conn(0x561377bfa3a0 0x561378046b90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/881186869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561377c456b0 0x561378046650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/881186869 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561377c3d4d0 0x561378007310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff84b0ad740 1 --2- 172.21.15.146:0/881186869 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561377c24f60 0x561378006dd0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff84b0ad740 1 -- 172.21.15.146:0/881186869 >> 172.21.15.146:0/881186869 conn(0x561377c5a4e0 msgr2=0x561378065140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff81cff9640 0 client.8979 ms_handle_reset on v2:172.21.15.146:6832/141241275 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff84b0ad740 1 -- 172.21.15.146:0/881186869 shutdown_connections 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.661+0000 7ff84b0ad740 1 -- 172.21.15.146:0/881186869 wait complete. 2024-09-17T03:41:33.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff84b0ad740 20 client.8979 trim_cache size 0 max 16384 2024-09-17T03:41:33.664 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:41:33.664 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "scrub active (653 inodes in the stack)", 2024-09-17T03:41:33.664 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:41:33.664 INFO:teuthology.orchestra.run.smithi146.stdout: "d827d267-7e6c-4ed3-ab08-484ceb637a01": { 2024-09-17T03:41:33.664 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:41:33.664 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "d827d267-7e6c-4ed3-ab08-484ceb637a01", 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: "d827d267-7e6c-4ed3-ab08-484ceb637a01": { 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:41:26.957903+0000", 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:33.665 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:41:33.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 -- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff820078b90 msgr2=0x7ff82007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff820078b90 0x7ff82007b0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0cdac0 tx=0x7ff82c005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:33.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 -- 172.21.15.146:0/3311415740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c06f580 msgr2=0x7ff83c0caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c06f580 0x7ff83c0caa30 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7ff83800e7c0 tx=0x7ff83800ec80 comp rx=0 tx=0).stop 2024-09-17T03:41:33.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 -- 172.21.15.146:0/3311415740 shutdown_connections 2024-09-17T03:41:33.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff820078b90 0x7ff82007b0a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff83c0b5e30 0x7ff83c1f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff83c0b4450 0x7ff83c14aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 --2- 172.21.15.146:0/3311415740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff83c06f580 0x7ff83c0caa30 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 -- 172.21.15.146:0/3311415740 >> 172.21.15.146:0/3311415740 conn(0x7ff83c0b3150 msgr2=0x7ff83c0ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 -- 172.21.15.146:0/3311415740 shutdown_connections 2024-09-17T03:41:33.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.662+0000 7ff844139640 1 -- 172.21.15.146:0/3311415740 wait complete. 2024-09-17T03:41:33.675 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:33.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.814+0000 7fe7f764d640 1 -- 172.21.15.146:0/3260771018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f00b3b60 msgr2=0x7fe7f015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.814+0000 7fe7f764d640 1 --2- 172.21.15.146:0/3260771018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f00b3b60 0x7fe7f015caa0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00b8440 tx=0x7fe7e802aa30 comp rx=0 tx=0).stop 2024-09-17T03:41:33.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.814+0000 7fe7f764d640 1 -- 172.21.15.146:0/3260771018 shutdown_connections 2024-09-17T03:41:33.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.814+0000 7fe7f764d640 1 --2- 172.21.15.146:0/3260771018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f00b3b60 0x7fe7f015caa0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.814+0000 7fe7f764d640 1 --2- 172.21.15.146:0/3260771018 >> v2:172.21.15.179:3300/0 conn(0x7fe7f00b5750 0x7fe7f00b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.814+0000 7fe7f764d640 1 -- 172.21.15.146:0/3260771018 >> 172.21.15.146:0/3260771018 conn(0x7fe7f00b7b20 msgr2=0x7fe7f009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:33.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.814+0000 7fe7f764d640 1 -- 172.21.15.146:0/3260771018 shutdown_connections 2024-09-17T03:41:33.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.814+0000 7fe7f764d640 1 -- 172.21.15.146:0/3260771018 wait complete. 2024-09-17T03:41:33.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.816+0000 7fe7f764d640 1 Processor -- start 2024-09-17T03:41:33.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.816+0000 7fe7f764d640 1 -- start start 2024-09-17T03:41:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f764d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7f00b3b60 0x7fe7f0152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f764d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7f00b5750 0x7fe7f014d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f764d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f00b5ce0 0x7fe7f015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f764d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f015d480 con 0x7fe7f00b5ce0 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f764d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f015d300 con 0x7fe7f00b5750 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f764d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f015d600 con 0x7fe7f00b3b60 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f4be8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7f00b5750 0x7fe7f014d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f53e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7f00b3b60 0x7fe7f0152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f5bea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f00b5ce0 0x7fe7f015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f4be8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7f00b5750 0x7fe7f014d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:35454/0 (socket says 172.21.15.146:35454) 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f5bea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f00b5ce0 0x7fe7f015ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59362/0 (socket says 172.21.15.146:59362) 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f4be8640 1 -- 172.21.15.146:0/271623528 learned_addr learned my addr 172.21.15.146:0/271623528 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.817+0000 7fe7f53e9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7f00b3b60 0x7fe7f0152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:35306/0 (socket says 172.21.15.146:35306) 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7f53e9640 1 -- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7f00b5750 msgr2=0x7fe7f014d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7f53e9640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7f00b5750 0x7fe7f014d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7f53e9640 1 -- 172.21.15.146:0/271623528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f00b5ce0 msgr2=0x7fe7f015ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7f53e9640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f00b5ce0 0x7fe7f015ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7f53e9640 1 -- 172.21.15.146:0/271623528 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f01529a0 con 0x7fe7f00b3b60 2024-09-17T03:41:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7f4be8640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7f00b5750 0x7fe7f014d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:41:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7f5bea640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f00b5ce0 0x7fe7f015ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:41:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7f53e9640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7f00b3b60 0x7fe7f0152460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c3f0 tx=0x7fe7ec00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7e5ffb640 1 -- 172.21.15.146:0/271623528 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec017070 con 0x7fe7f00b3b60 2024-09-17T03:41:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7e5ffb640 1 -- 172.21.15.146:0/271623528 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7ec0053c0 con 0x7fe7f00b3b60 2024-09-17T03:41:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7e5ffb640 1 -- 172.21.15.146:0/271623528 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec003850 con 0x7fe7f00b3b60 2024-09-17T03:41:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.818+0000 7fe7f764d640 1 -- 172.21.15.146:0/271623528 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f00d28d0 con 0x7fe7f00b3b60 2024-09-17T03:41:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.819+0000 7fe7f764d640 1 -- 172.21.15.146:0/271623528 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f00d2e90 con 0x7fe7f00b3b60 2024-09-17T03:41:33.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.820+0000 7fe7f764d640 1 -- 172.21.15.146:0/271623528 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f015ec30 con 0x7fe7f00b3b60 2024-09-17T03:41:33.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.820+0000 7fe7e5ffb640 1 -- 172.21.15.146:0/271623528 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe7ec01a070 con 0x7fe7f00b3b60 2024-09-17T03:41:33.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.821+0000 7fe7e5ffb640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7d4078b90 0x7fe7d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:33.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.821+0000 7fe7e5ffb640 1 -- 172.21.15.146:0/271623528 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fe7ec099f30 con 0x7fe7f00b3b60 2024-09-17T03:41:33.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.821+0000 7fe7f4be8640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7d4078b90 0x7fe7d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:33.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.821+0000 7fe7f4be8640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7d4078b90 0x7fe7d407b0a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0071250 tx=0x7fe7e0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:33.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:33.826+0000 7fe7e5ffb640 1 -- 172.21.15.146:0/271623528 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe7f00b3f70 con 0x7fe7f00b3b60 2024-09-17T03:41:34.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.070+0000 7fe7f764d640 1 -- 172.21.15.146:0/271623528 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7f0071b20 con 0x7fe7f00b3b60 2024-09-17T03:41:34.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.070+0000 7fe7e5ffb640 1 -- 172.21.15.146:0/271623528 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7fe7ec061db0 con 0x7fe7f00b3b60 2024-09-17T03:41:34.071 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:34.071 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:34.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 -- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7d4078b90 msgr2=0x7fe7d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:34.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7d4078b90 0x7fe7d407b0a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0071250 tx=0x7fe7e0005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:34.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 -- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7f00b3b60 msgr2=0x7fe7f0152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:34.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7f00b3b60 0x7fe7f0152460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00c3f0 tx=0x7fe7ec00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 -- 172.21.15.146:0/271623528 shutdown_connections 2024-09-17T03:41:34.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe7d4078b90 0x7fe7d407b0a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7f00b5ce0 0x7fe7f015ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7f00b5750 0x7fe7f014d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 --2- 172.21.15.146:0/271623528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7f00b3b60 0x7fe7f0152460 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 -- 172.21.15.146:0/271623528 >> 172.21.15.146:0/271623528 conn(0x7fe7f00b7b20 msgr2=0x7fe7f009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 -- 172.21.15.146:0/271623528 shutdown_connections 2024-09-17T03:41:34.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.074+0000 7fe7f764d640 1 -- 172.21.15.146:0/271623528 wait complete. 2024-09-17T03:41:34.086 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:41:34.086 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:41:34.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.244+0000 7fe2d78f9640 1 -- 172.21.15.146:0/1048320465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d00b08d0 msgr2=0x7fe2d00b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.244+0000 7fe2d78f9640 1 --2- 172.21.15.146:0/1048320465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d00b08d0 0x7fe2d00b0ce0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8005fd0 tx=0x7fe2c802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.244+0000 7fe2d78f9640 1 -- 172.21.15.146:0/1048320465 shutdown_connections 2024-09-17T03:41:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.244+0000 7fe2d78f9640 1 --2- 172.21.15.146:0/1048320465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d00b08d0 0x7fe2d00b0ce0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.244+0000 7fe2d78f9640 1 --2- 172.21.15.146:0/1048320465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2d00b4f20 0x7fe2d00b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.244+0000 7fe2d78f9640 1 -- 172.21.15.146:0/1048320465 >> 172.21.15.146:0/1048320465 conn(0x7fe2d009ba20 msgr2=0x7fe2d00b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.244+0000 7fe2d78f9640 1 -- 172.21.15.146:0/1048320465 shutdown_connections 2024-09-17T03:41:34.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.244+0000 7fe2d78f9640 1 -- 172.21.15.146:0/1048320465 wait complete. 2024-09-17T03:41:34.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.247+0000 7fe2d78f9640 1 Processor -- start 2024-09-17T03:41:34.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.247+0000 7fe2d78f9640 1 -- start start 2024-09-17T03:41:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d78f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d00b08d0 0x7fe2d014a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d78f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d00b3250 0x7fe2d015e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d78f9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2d00b4f20 0x7fe2d015f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d78f9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d0160b70 con 0x7fe2d00b3250 2024-09-17T03:41:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d78f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00b1430 con 0x7fe2d00b08d0 2024-09-17T03:41:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d78f9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d0160cf0 con 0x7fe2d00b4f20 2024-09-17T03:41:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d5695640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d00b08d0 0x7fe2d014a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:34.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d4e94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d00b3250 0x7fe2d015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d5e96640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2d00b4f20 0x7fe2d015f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d4e94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d00b3250 0x7fe2d015e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59372/0 (socket says 172.21.15.146:59372) 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d5695640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d00b08d0 0x7fe2d014a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:35466/0 (socket says 172.21.15.146:35466) 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d4e94640 1 -- 172.21.15.146:0/3024330233 learned_addr learned my addr 172.21.15.146:0/3024330233 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d4e94640 1 -- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2d00b4f20 msgr2=0x7fe2d015f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d4e94640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2d00b4f20 0x7fe2d015f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d4e94640 1 -- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d00b08d0 msgr2=0x7fe2d014a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.249+0000 7fe2d4e94640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d00b08d0 0x7fe2d014a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.250+0000 7fe2d4e94640 1 -- 172.21.15.146:0/3024330233 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d015e980 con 0x7fe2d00b3250 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.250+0000 7fe2d5e96640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2d00b4f20 0x7fe2d015f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.250+0000 7fe2d5695640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d00b08d0 0x7fe2d014a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.250+0000 7fe2d4e94640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d00b3250 0x7fe2d015e010 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c430 tx=0x7fe2c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:34.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.250+0000 7fe2c5ffb640 1 -- 172.21.15.146:0/3024330233 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0017070 con 0x7fe2d00b3250 2024-09-17T03:41:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.250+0000 7fe2c5ffb640 1 -- 172.21.15.146:0/3024330233 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2c00053e0 con 0x7fe2d00b3250 2024-09-17T03:41:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.250+0000 7fe2c5ffb640 1 -- 172.21.15.146:0/3024330233 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0003850 con 0x7fe2d00b3250 2024-09-17T03:41:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.250+0000 7fe2d78f9640 1 -- 172.21.15.146:0/3024330233 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d015ec60 con 0x7fe2d00b3250 2024-09-17T03:41:34.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.251+0000 7fe2d78f9640 1 -- 172.21.15.146:0/3024330233 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d0153d80 con 0x7fe2d00b3250 2024-09-17T03:41:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.252+0000 7fe2d78f9640 1 -- 172.21.15.146:0/3024330233 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d0153b70 con 0x7fe2d00b3250 2024-09-17T03:41:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.252+0000 7fe2c5ffb640 1 -- 172.21.15.146:0/3024330233 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe2c001a070 con 0x7fe2d00b3250 2024-09-17T03:41:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.253+0000 7fe2c5ffb640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe2b4078b90 0x7fe2b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.253+0000 7fe2c5ffb640 1 -- 172.21.15.146:0/3024330233 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fe2c009a120 con 0x7fe2d00b3250 2024-09-17T03:41:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.253+0000 7fe2d5695640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe2b4078b90 0x7fe2b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:34.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.254+0000 7fe2d5695640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe2b4078b90 0x7fe2b407b0a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0099a0 tx=0x7fe2cc012040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:34.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.261+0000 7fe2c5ffb640 1 -- 172.21.15.146:0/3024330233 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe2c0061df0 con 0x7fe2d00b3250 2024-09-17T03:41:34.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.639+0000 7fe2d78f9640 1 -- 172.21.15.146:0/3024330233 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe2d00b0ce0 con 0x7fe2d00b3250 2024-09-17T03:41:34.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.639+0000 7fe2c5ffb640 1 -- 172.21.15.146:0/3024330233 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7fe2c0066820 con 0x7fe2d00b3250 2024-09-17T03:41:34.640 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:34.640 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":539,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076736355,"bytes_used":2565496832,"bytes_avail":770528616448,"bytes_total":773094113280,"write_bytes_sec":63288590,"read_op_per_sec":0,"write_op_per_sec":68},"fsmap":{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8658}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-17T03:41:31.927393+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:41:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 -- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe2b4078b90 msgr2=0x7fe2b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe2b4078b90 0x7fe2b407b0a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0099a0 tx=0x7fe2cc012040 comp rx=0 tx=0).stop 2024-09-17T03:41:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 -- 172.21.15.146:0/3024330233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d00b3250 msgr2=0x7fe2d015e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d00b3250 0x7fe2d015e010 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c430 tx=0x7fe2c000c8f0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 -- 172.21.15.146:0/3024330233 shutdown_connections 2024-09-17T03:41:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe2b4078b90 0x7fe2b407b0a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2d00b4f20 0x7fe2d015f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2d00b3250 0x7fe2d015e010 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 --2- 172.21.15.146:0/3024330233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2d00b08d0 0x7fe2d014a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:34.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 -- 172.21.15.146:0/3024330233 >> 172.21.15.146:0/3024330233 conn(0x7fe2d009ba20 msgr2=0x7fe2d00b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:34.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 -- 172.21.15.146:0/3024330233 shutdown_connections 2024-09-17T03:41:34.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:34.643+0000 7fe2d78f9640 1 -- 172.21.15.146:0/3024330233 wait complete. 2024-09-17T03:41:34.656 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-17T03:41:35.657 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:35.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.778+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3647961982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e40b3d30 msgr2=0x7ff3e415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:35.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.778+0000 7ff3eb48b640 1 --2- 172.21.15.146:0/3647961982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e40b3d30 0x7ff3e415caa0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40b5390 tx=0x7ff3dc02aac0 comp rx=0 tx=0).stop 2024-09-17T03:41:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.778+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3647961982 shutdown_connections 2024-09-17T03:41:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.778+0000 7ff3eb48b640 1 --2- 172.21.15.146:0/3647961982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e40b3d30 0x7ff3e415caa0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.778+0000 7ff3eb48b640 1 --2- 172.21.15.146:0/3647961982 >> v2:172.21.15.179:3300/0 conn(0x7ff3e40b5ce0 0x7ff3e40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.778+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3647961982 >> 172.21.15.146:0/3647961982 conn(0x7ff3e40b7b20 msgr2=0x7ff3e409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.778+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3647961982 shutdown_connections 2024-09-17T03:41:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.778+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3647961982 wait complete. 2024-09-17T03:41:35.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.780+0000 7ff3eb48b640 1 Processor -- start 2024-09-17T03:41:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.780+0000 7ff3eb48b640 1 -- start start 2024-09-17T03:41:35.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3eb48b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e40b5750 0x7ff3e409fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:35.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3eb48b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e40b5ce0 0x7ff3e41f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:35.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3eb48b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3e41f7520 0x7ff3e415b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:35.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3eb48b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e415d420 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3eb48b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e415d2a0 con 0x7ff3e40b5750 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3eb48b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e415d5a0 con 0x7ff3e41f7520 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3e8a26640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e40b5ce0 0x7ff3e41f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3e8a26640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e40b5ce0 0x7ff3e41f6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59384/0 (socket says 172.21.15.146:59384) 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3e8a26640 1 -- 172.21.15.146:0/3740746258 learned_addr learned my addr 172.21.15.146:0/3740746258 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3e9227640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e40b5750 0x7ff3e409fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3e9a28640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3e41f7520 0x7ff3e415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3e8a26640 1 -- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3e41f7520 msgr2=0x7ff3e415b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3e8a26640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3e41f7520 0x7ff3e415b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3e8a26640 1 -- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e40b5750 msgr2=0x7ff3e409fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3e8a26640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e40b5750 0x7ff3e409fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.781+0000 7ff3e8a26640 1 -- 172.21.15.146:0/3740746258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e41f34e0 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.782+0000 7ff3e8a26640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e40b5ce0 0x7ff3e41f6fe0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400c340 tx=0x7ff3d400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.782+0000 7ff3d9ffb640 1 -- 172.21.15.146:0/3740746258 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4017070 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.782+0000 7ff3d9ffb640 1 -- 172.21.15.146:0/3740746258 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3d40053c0 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.782+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3740746258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e41f37c0 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.782+0000 7ff3d9ffb640 1 -- 172.21.15.146:0/3740746258 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4003850 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.782+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3740746258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e41f3d80 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.783+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3740746258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e4146980 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.783+0000 7ff3d9ffb640 1 -- 172.21.15.146:0/3740746258 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff3d401a070 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.784+0000 7ff3d9ffb640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3c8078bc0 0x7ff3c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:35.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.784+0000 7ff3d9ffb640 1 -- 172.21.15.146:0/3740746258 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7ff3d4099fc0 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.784+0000 7ff3e9227640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3c8078bc0 0x7ff3c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:35.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.785+0000 7ff3e9227640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3c8078bc0 0x7ff3c807b0d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0004630 tx=0x7ff3e000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:35.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.789+0000 7ff3d9ffb640 1 -- 172.21.15.146:0/3740746258 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff3e4146980 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.998+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3740746258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3e415da60 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:35.999+0000 7ff3d9ffb640 1 -- 172.21.15.146:0/3740746258 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7ff3d4061db0 con 0x7ff3e40b5ce0 2024-09-17T03:41:35.999 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:35.999 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:35.999 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:36.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3c8078bc0 msgr2=0x7ff3c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:36.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3c8078bc0 0x7ff3c807b0d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0004630 tx=0x7ff3e000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:41:36.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3740746258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e40b5ce0 msgr2=0x7ff3e41f6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:36.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e40b5ce0 0x7ff3e41f6fe0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400c340 tx=0x7ff3d400c800 comp rx=0 tx=0).stop 2024-09-17T03:41:36.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3740746258 shutdown_connections 2024-09-17T03:41:36.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff3c8078bc0 0x7ff3c807b0d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:36.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3e41f7520 0x7ff3e415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:36.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3e40b5ce0 0x7ff3e41f6fe0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:36.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 --2- 172.21.15.146:0/3740746258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3e40b5750 0x7ff3e409fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:36.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3740746258 >> 172.21.15.146:0/3740746258 conn(0x7ff3e40b7b20 msgr2=0x7ff3e4155900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:36.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3740746258 shutdown_connections 2024-09-17T03:41:36.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.001+0000 7ff3eb48b640 1 -- 172.21.15.146:0/3740746258 wait complete. 2024-09-17T03:41:36.012 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:41:36.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:41:36.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.123+0000 7f3493f69640 1 -- 172.21.15.146:0/3711076312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3478003a30 msgr2=0x7f3478003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:36.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.123+0000 7f3493f69640 1 --2- 172.21.15.146:0/3711076312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3478003a30 0x7f3478003ea0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f34880016c0 tx=0x7f3478005830 comp rx=0 tx=0).stop 2024-09-17T03:41:36.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.123+0000 7f3492506640 1 -- 172.21.15.146:0/3711076312 reap_dead start 2024-09-17T03:41:36.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.123+0000 7f3493f69640 1 -- 172.21.15.146:0/3711076312 shutdown_connections 2024-09-17T03:41:36.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.123+0000 7f3493f69640 1 -- 172.21.15.146:0/3711076312 >> 172.21.15.146:0/3711076312 conn(0x7f348c0d4be0 msgr2=0x7f348c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:36.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.123+0000 7f3493f69640 1 -- 172.21.15.146:0/3711076312 shutdown_connections 2024-09-17T03:41:36.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.123+0000 7f3493f69640 1 -- 172.21.15.146:0/3711076312 wait complete. 2024-09-17T03:41:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.125+0000 7f3493f69640 1 Processor -- start 2024-09-17T03:41:36.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.125+0000 7f3493f69640 1 -- start start 2024-09-17T03:41:36.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3493f69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3478003a30 0x7f348c14db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:36.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3493f69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cc570 0x7f348c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3493f69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f348c0c98d0 0x7f348c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3493f69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f348c0d38a0 con 0x7f348c0cc570 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3493f69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f348c06f020 con 0x7f348c0c98d0 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3493f69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f348c0d3a20 con 0x7f3478003a30 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3491504640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cc570 0x7f348c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3491504640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cc570 0x7f348c0cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59398/0 (socket says 172.21.15.146:59398) 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3491504640 1 -- 172.21.15.146:0/2330096692 learned_addr learned my addr 172.21.15.146:0/2330096692 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3491d05640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3478003a30 0x7f348c14db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3492506640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f348c0c98d0 0x7f348c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3491504640 1 -- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3478003a30 msgr2=0x7f348c14db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.126+0000 7f3491504640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3478003a30 0x7f348c14db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.127+0000 7f3491504640 1 -- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f348c0c98d0 msgr2=0x7f348c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:36.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.127+0000 7f3491504640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f348c0c98d0 0x7f348c0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:36.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.127+0000 7f3491504640 1 -- 172.21.15.146:0/2330096692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c0ca220 con 0x7f348c0cc570 2024-09-17T03:41:36.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.127+0000 7f3491504640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cc570 0x7f348c0cc980 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f347c011ae0 tx=0x7f347c009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:36.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.127+0000 7f34827fc640 1 -- 172.21.15.146:0/2330096692 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c004460 con 0x7f348c0cc570 2024-09-17T03:41:36.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.127+0000 7f34827fc640 1 -- 172.21.15.146:0/2330096692 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f347c00fa00 con 0x7f348c0cc570 2024-09-17T03:41:36.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.127+0000 7f34827fc640 1 -- 172.21.15.146:0/2330096692 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c00fe10 con 0x7f348c0cc570 2024-09-17T03:41:36.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.127+0000 7f3493f69640 1 -- 172.21.15.146:0/2330096692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348c1f6730 con 0x7f348c0cc570 2024-09-17T03:41:36.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.127+0000 7f3493f69640 1 -- 172.21.15.146:0/2330096692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348c1f6cf0 con 0x7f348c0cc570 2024-09-17T03:41:36.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.128+0000 7f3493f69640 1 -- 172.21.15.146:0/2330096692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f348c1f64a0 con 0x7f348c0cc570 2024-09-17T03:41:36.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.129+0000 7f34827fc640 1 -- 172.21.15.146:0/2330096692 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f347c005020 con 0x7f348c0cc570 2024-09-17T03:41:36.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.129+0000 7f34827fc640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 0x7f347007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:36.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.129+0000 7f34827fc640 1 -- 172.21.15.146:0/2330096692 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f347c09b8f0 con 0x7f348c0cc570 2024-09-17T03:41:36.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.129+0000 7f3491d05640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 0x7f347007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:36.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.130+0000 7f3491d05640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 0x7f347007b0a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3488032000 tx=0x7f348802c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:36.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.133+0000 7f34827fc640 1 -- 172.21.15.146:0/2330096692 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f348c0ca220 con 0x7f348c0cc570 2024-09-17T03:41:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.378+0000 7f3493f69640 1 -- 172.21.15.146:0/2330096692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f348c0d3fb0 con 0x7f348c0cc570 2024-09-17T03:41:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.378+0000 7f34827fc640 1 -- 172.21.15.146:0/2330096692 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7f347c0636e0 con 0x7f348c0cc570 2024-09-17T03:41:36.378 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:36.379 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":540,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076736355,"bytes_used":2565496832,"bytes_avail":770528616448,"bytes_total":773094113280,"write_bytes_sec":63288590,"read_op_per_sec":0,"write_op_per_sec":68},"fsmap":{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8658}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-17T03:41:31.927393+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:41:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.380+0000 7f3493f69640 1 -- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 msgr2=0x7f347007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.380+0000 7f3493f69640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 0x7f347007b0a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3488032000 tx=0x7f348802c040 comp rx=0 tx=0).stop 2024-09-17T03:41:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.381+0000 7f3493f69640 1 -- 172.21.15.146:0/2330096692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cc570 msgr2=0x7f348c0cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.381+0000 7f3493f69640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cc570 0x7f348c0cc980 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f347c011ae0 tx=0x7f347c009e00 comp rx=0 tx=0).stop 2024-09-17T03:41:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.381+0000 7f3493f69640 1 -- 172.21.15.146:0/2330096692 shutdown_connections 2024-09-17T03:41:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.381+0000 7f3493f69640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 0x7f347007b0a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.381+0000 7f3493f69640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f348c0c98d0 0x7f348c0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:36.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.381+0000 7f3493f69640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cc570 0x7f348c0cc980 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:36.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.381+0000 7f3493f69640 1 --2- 172.21.15.146:0/2330096692 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3478003a30 0x7f348c14db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:36.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.381+0000 7f3493f69640 1 -- 172.21.15.146:0/2330096692 >> 172.21.15.146:0/2330096692 conn(0x7f348c0d4be0 msgr2=0x7f348c0b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:36.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.381+0000 7f3493f69640 1 -- 172.21.15.146:0/2330096692 shutdown_connections 2024-09-17T03:41:36.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:36.381+0000 7f3493f69640 1 -- 172.21.15.146:0/2330096692 wait complete. 2024-09-17T03:41:36.392 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-17T03:41:37.394 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:37.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.511+0000 7f28eb215640 1 -- 172.21.15.146:0/1854472105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28cc006390 msgr2=0x7f28cc00cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:37.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.511+0000 7f28eb215640 1 --2- 172.21.15.146:0/1854472105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28cc006390 0x7f28cc00cad0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f28dc001800 tx=0x7f28cc006940 comp rx=0 tx=0).stop 2024-09-17T03:41:37.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.512+0000 7f28eb215640 1 -- 172.21.15.146:0/1854472105 shutdown_connections 2024-09-17T03:41:37.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.512+0000 7f28eb215640 1 --2- 172.21.15.146:0/1854472105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28cc006390 0x7f28cc00cad0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.512+0000 7f28eb215640 1 -- 172.21.15.146:0/1854472105 >> 172.21.15.146:0/1854472105 conn(0x7f28e40b2060 msgr2=0x7f28e40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:37.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.512+0000 7f28eb215640 1 -- 172.21.15.146:0/1854472105 shutdown_connections 2024-09-17T03:41:37.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.512+0000 7f28eb215640 1 -- 172.21.15.146:0/1854472105 wait complete. 2024-09-17T03:41:37.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.513+0000 7f28eb215640 1 Processor -- start 2024-09-17T03:41:37.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.513+0000 7f28eb215640 1 -- start start 2024-09-17T03:41:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28eb215640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28cc006390 0x7f28e414b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28eb215640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28e41f3bd0 0x7f28e41540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28eb215640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e414bdb0 0x7f28e4154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28eb215640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f28e406e470 con 0x7f28e414bdb0 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28eb215640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4073220 con 0x7f28cc006390 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28eb215640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f28e406e5f0 con 0x7f28e41f3bd0 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28e97b2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e414bdb0 0x7f28e4154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28e3fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28e41f3bd0 0x7f28e41540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28e97b2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e414bdb0 0x7f28e4154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54690/0 (socket says 172.21.15.146:54690) 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28e97b2640 1 -- 172.21.15.146:0/1956589183 learned_addr learned my addr 172.21.15.146:0/1956589183 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28e8fb1640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28cc006390 0x7f28e414b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28e97b2640 1 -- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28e41f3bd0 msgr2=0x7f28e41540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28e97b2640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28e41f3bd0 0x7f28e41540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28e97b2640 1 -- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28cc006390 msgr2=0x7f28e414b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28e97b2640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28cc006390 0x7f28e414b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28e97b2640 1 -- 172.21.15.146:0/1956589183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e41f7130 con 0x7f28e414bdb0 2024-09-17T03:41:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.515+0000 7f28e3fff640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28e41f3bd0 0x7f28e41540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:41:37.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.516+0000 7f28e97b2640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e414bdb0 0x7f28e4154610 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0018f0 tx=0x7f28dc032ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:37.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.516+0000 7f28e17fa640 1 -- 172.21.15.146:0/1956589183 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc0068c0 con 0x7f28e414bdb0 2024-09-17T03:41:37.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.516+0000 7f28e17fa640 1 -- 172.21.15.146:0/1956589183 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28dc0038e0 con 0x7f28e414bdb0 2024-09-17T03:41:37.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.516+0000 7f28eb215640 1 -- 172.21.15.146:0/1956589183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e41f30f0 con 0x7f28e414bdb0 2024-09-17T03:41:37.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.516+0000 7f28e17fa640 1 -- 172.21.15.146:0/1956589183 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc001450 con 0x7f28e414bdb0 2024-09-17T03:41:37.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.516+0000 7f28eb215640 1 -- 172.21.15.146:0/1956589183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e41f4c70 con 0x7f28e414bdb0 2024-09-17T03:41:37.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.517+0000 7f28eb215640 1 -- 172.21.15.146:0/1956589183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e41f4ed0 con 0x7f28e414bdb0 2024-09-17T03:41:37.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.518+0000 7f28e17fa640 1 -- 172.21.15.146:0/1956589183 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28dc03d030 con 0x7f28e414bdb0 2024-09-17T03:41:37.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.518+0000 7f28e17fa640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28d0078b90 0x7f28d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:37.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.518+0000 7f28e17fa640 1 -- 172.21.15.146:0/1956589183 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f28dc0bab30 con 0x7f28e414bdb0 2024-09-17T03:41:37.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.519+0000 7f28e8fb1640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28d0078b90 0x7f28d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:37.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.519+0000 7f28e8fb1640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28d0078b90 0x7f28d007b0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009bd0 tx=0x7f28d4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:37.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.523+0000 7f28e17fa640 1 -- 172.21.15.146:0/1956589183 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f28dc0829b0 con 0x7f28e414bdb0 2024-09-17T03:41:37.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.735+0000 7f28eb215640 1 -- 172.21.15.146:0/1956589183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28e41f2ee0 con 0x7f28e414bdb0 2024-09-17T03:41:37.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.736+0000 7f28e17fa640 1 -- 172.21.15.146:0/1956589183 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7f28dc0873e0 con 0x7f28e414bdb0 2024-09-17T03:41:37.736 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:37.736 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:37.737 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 -- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28d0078b90 msgr2=0x7f28d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28d0078b90 0x7f28d007b0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009bd0 tx=0x7f28d4005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 -- 172.21.15.146:0/1956589183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e414bdb0 msgr2=0x7f28e4154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e414bdb0 0x7f28e4154610 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0018f0 tx=0x7f28dc032ab0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 -- 172.21.15.146:0/1956589183 shutdown_connections 2024-09-17T03:41:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28d0078b90 0x7f28d007b0a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28e414bdb0 0x7f28e4154610 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28e41f3bd0 0x7f28e41540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 --2- 172.21.15.146:0/1956589183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28cc006390 0x7f28e414b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 -- 172.21.15.146:0/1956589183 >> 172.21.15.146:0/1956589183 conn(0x7f28e40b2060 msgr2=0x7f28e40d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 -- 172.21.15.146:0/1956589183 shutdown_connections 2024-09-17T03:41:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.738+0000 7f28eb215640 1 -- 172.21.15.146:0/1956589183 wait complete. 2024-09-17T03:41:37.750 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:41:37.750 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:41:37.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.862+0000 7fa4dc52b640 1 -- 172.21.15.146:0/1839812948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d40cf6b0 msgr2=0x7fa4d4161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:37.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.862+0000 7fa4dc52b640 1 --2- 172.21.15.146:0/1839812948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d40cf6b0 0x7fa4d4161220 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40743d0 tx=0x7fa4c402a4f0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.862+0000 7fa4dc52b640 1 -- 172.21.15.146:0/1839812948 shutdown_connections 2024-09-17T03:41:37.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.862+0000 7fa4dc52b640 1 --2- 172.21.15.146:0/1839812948 >> v2:172.21.15.179:3300/0 conn(0x7fa4d40b47c0 0x7fa4d4161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.862+0000 7fa4dc52b640 1 --2- 172.21.15.146:0/1839812948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d40cf6b0 0x7fa4d4161220 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.862+0000 7fa4dc52b640 1 --2- 172.21.15.146:0/1839812948 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d40d0710 0x7fa4d40cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.862+0000 7fa4dc52b640 1 -- 172.21.15.146:0/1839812948 >> 172.21.15.146:0/1839812948 conn(0x7fa4d409ba20 msgr2=0x7fa4d40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:37.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.863+0000 7fa4dc52b640 1 -- 172.21.15.146:0/1839812948 shutdown_connections 2024-09-17T03:41:37.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.863+0000 7fa4dc52b640 1 -- 172.21.15.146:0/1839812948 wait complete. 2024-09-17T03:41:37.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.864+0000 7fa4dc52b640 1 Processor -- start 2024-09-17T03:41:37.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.864+0000 7fa4dc52b640 1 -- start start 2024-09-17T03:41:37.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.865+0000 7fa4dc52b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4d40b47c0 0x7fa4d40a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:37.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.865+0000 7fa4dc52b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d40cf6b0 0x7fa4d40b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:37.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.865+0000 7fa4dc52b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d40d0710 0x7fa4d40717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:37.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.865+0000 7fa4dc52b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4162030 con 0x7fa4d40cf6b0 2024-09-17T03:41:37.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.865+0000 7fa4dc52b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4161eb0 con 0x7fa4d40b47c0 2024-09-17T03:41:37.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.865+0000 7fa4dc52b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d40cd090 con 0x7fa4d40d0710 2024-09-17T03:41:37.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4d9ac6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d40cf6b0 0x7fa4d40b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4d9ac6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d40cf6b0 0x7fa4d40b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54720/0 (socket says 172.21.15.146:54720) 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4d9ac6640 1 -- 172.21.15.146:0/2582043333 learned_addr learned my addr 172.21.15.146:0/2582043333 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4daac8640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d40d0710 0x7fa4d40717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4da2c7640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4d40b47c0 0x7fa4d40a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4d9ac6640 1 -- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d40d0710 msgr2=0x7fa4d40717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4d9ac6640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d40d0710 0x7fa4d40717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4d9ac6640 1 -- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4d40b47c0 msgr2=0x7fa4d40a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4d9ac6640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4d40b47c0 0x7fa4d40a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4d9ac6640 1 -- 172.21.15.146:0/2582043333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d40b2cb0 con 0x7fa4d40cf6b0 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4d9ac6640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d40cf6b0 0x7fa4d40b2770 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4034040 tx=0x7fa4c4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4caffd640 1 -- 172.21.15.146:0/2582043333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c403e030 con 0x7fa4d40cf6b0 2024-09-17T03:41:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4caffd640 1 -- 172.21.15.146:0/2582043333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4c4003e00 con 0x7fa4d40cf6b0 2024-09-17T03:41:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4dc52b640 1 -- 172.21.15.146:0/2582043333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d4151660 con 0x7fa4d40cf6b0 2024-09-17T03:41:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4caffd640 1 -- 172.21.15.146:0/2582043333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4035040 con 0x7fa4d40cf6b0 2024-09-17T03:41:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.866+0000 7fa4dc52b640 1 -- 172.21.15.146:0/2582043333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d4151c20 con 0x7fa4d40cf6b0 2024-09-17T03:41:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.867+0000 7fa4dc52b640 1 -- 172.21.15.146:0/2582043333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d40b2e80 con 0x7fa4d40cf6b0 2024-09-17T03:41:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.868+0000 7fa4caffd640 1 -- 172.21.15.146:0/2582043333 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa4c4041030 con 0x7fa4d40cf6b0 2024-09-17T03:41:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.868+0000 7fa4caffd640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4b8078b90 0x7fa4b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.868+0000 7fa4caffd640 1 -- 172.21.15.146:0/2582043333 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fa4c40bb580 con 0x7fa4d40cf6b0 2024-09-17T03:41:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.869+0000 7fa4da2c7640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4b8078b90 0x7fa4b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.869+0000 7fa4da2c7640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4b8078b90 0x7fa4b807b0a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0005fd0 tx=0x7fa4d0005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:37.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:37.873+0000 7fa4caffd640 1 -- 172.21.15.146:0/2582043333 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa4c4083a50 con 0x7fa4d40cf6b0 2024-09-17T03:41:38.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.113+0000 7fa4dc52b640 1 -- 172.21.15.146:0/2582043333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa4d40cf170 con 0x7fa4d40cf6b0 2024-09-17T03:41:38.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.114+0000 7fa4caffd640 1 -- 172.21.15.146:0/2582043333 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7fa4c4083350 con 0x7fa4d40cf6b0 2024-09-17T03:41:38.114 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:38.114 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":542,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078133528,"bytes_used":2576474112,"bytes_avail":770517639168,"bytes_total":773094113280,"write_bytes_sec":55599367,"read_op_per_sec":0,"write_op_per_sec":117},"fsmap":{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8658}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-17T03:41:35.928693+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:41:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 -- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4b8078b90 msgr2=0x7fa4b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4b8078b90 0x7fa4b807b0a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0005fd0 tx=0x7fa4d0005850 comp rx=0 tx=0).stop 2024-09-17T03:41:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 -- 172.21.15.146:0/2582043333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d40cf6b0 msgr2=0x7fa4d40b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d40cf6b0 0x7fa4d40b2770 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4034040 tx=0x7fa4c4003910 comp rx=0 tx=0).stop 2024-09-17T03:41:38.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 -- 172.21.15.146:0/2582043333 shutdown_connections 2024-09-17T03:41:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4b8078b90 0x7fa4b807b0a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4d40d0710 0x7fa4d40717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4d40cf6b0 0x7fa4d40b2770 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 --2- 172.21.15.146:0/2582043333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4d40b47c0 0x7fa4d40a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 -- 172.21.15.146:0/2582043333 >> 172.21.15.146:0/2582043333 conn(0x7fa4d409ba20 msgr2=0x7fa4d40c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 -- 172.21.15.146:0/2582043333 shutdown_connections 2024-09-17T03:41:38.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:38.116+0000 7fa4dc52b640 1 -- 172.21.15.146:0/2582043333 wait complete. 2024-09-17T03:41:38.127 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'active paths [/scrub_control_test_path]'} 2024-09-17T03:41:39.128 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.249+0000 7fae15e64640 1 -- 172.21.15.146:0/218152731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae100b3870 msgr2=0x7fae100cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.249+0000 7fae15e64640 1 --2- 172.21.15.146:0/218152731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae100b3870 0x7fae100cf370 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fae100b3790 tx=0x7fae0002a560 comp rx=0 tx=0).stop 2024-09-17T03:41:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.250+0000 7fae15e64640 1 -- 172.21.15.146:0/218152731 shutdown_connections 2024-09-17T03:41:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.250+0000 7fae15e64640 1 --2- 172.21.15.146:0/218152731 >> v2:172.21.15.179:3300/0 conn(0x7fae1006f440 0x7fae100d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.250+0000 7fae15e64640 1 --2- 172.21.15.146:0/218152731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae100b3870 0x7fae100cf370 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.250+0000 7fae15e64640 1 -- 172.21.15.146:0/218152731 >> 172.21.15.146:0/218152731 conn(0x7fae100d4be0 msgr2=0x7fae100d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.250+0000 7fae15e64640 1 -- 172.21.15.146:0/218152731 shutdown_connections 2024-09-17T03:41:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.250+0000 7fae15e64640 1 -- 172.21.15.146:0/218152731 wait complete. 2024-09-17T03:41:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.251+0000 7fae15e64640 1 Processor -- start 2024-09-17T03:41:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.252+0000 7fae15e64640 1 -- start start 2024-09-17T03:41:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae15e64640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae100b3870 0x7fae100cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae15e64640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae101620f0 0x7fae10150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae15e64640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae10160c40 0x7fae100cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae15e64640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fae100d3a60 con 0x7fae100b3870 2024-09-17T03:41:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae15e64640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fae100d38e0 con 0x7fae10160c40 2024-09-17T03:41:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae15e64640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fae100d3be0 con 0x7fae101620f0 2024-09-17T03:41:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae0f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae100b3870 0x7fae100cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae0f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae100b3870 0x7fae100cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54746/0 (socket says 172.21.15.146:54746) 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae0f7fe640 1 -- 172.21.15.146:0/2231081311 learned_addr learned my addr 172.21.15.146:0/2231081311 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae0ffff640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae10160c40 0x7fae100cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae0effd640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae101620f0 0x7fae10150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae0f7fe640 1 -- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae101620f0 msgr2=0x7fae10150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae0f7fe640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae101620f0 0x7fae10150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae0f7fe640 1 -- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae10160c40 msgr2=0x7fae100cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae0f7fe640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae10160c40 0x7fae100cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae0f7fe640 1 -- 172.21.15.146:0/2231081311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae10161390 con 0x7fae100b3870 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.253+0000 7fae0f7fe640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae100b3870 0x7fae100cadb0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fae000099c0 tx=0x7fae000039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.254+0000 7fadf7fff640 1 -- 172.21.15.146:0/2231081311 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0003e030 con 0x7fae100b3870 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.254+0000 7fadf7fff640 1 -- 172.21.15.146:0/2231081311 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae000047a0 con 0x7fae100b3870 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.254+0000 7fae15e64640 1 -- 172.21.15.146:0/2231081311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae100c8190 con 0x7fae100b3870 2024-09-17T03:41:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.254+0000 7fadf7fff640 1 -- 172.21.15.146:0/2231081311 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00035040 con 0x7fae100b3870 2024-09-17T03:41:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.254+0000 7fae15e64640 1 -- 172.21.15.146:0/2231081311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae100c8750 con 0x7fae100b3870 2024-09-17T03:41:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.255+0000 7fae15e64640 1 -- 172.21.15.146:0/2231081311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae100d3190 con 0x7fae100b3870 2024-09-17T03:41:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.256+0000 7fadf7fff640 1 -- 172.21.15.146:0/2231081311 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae00041030 con 0x7fae100b3870 2024-09-17T03:41:39.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.256+0000 7fadf7fff640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fadfc078bc0 0x7fadfc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:39.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.256+0000 7fadf7fff640 1 -- 172.21.15.146:0/2231081311 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fae000bb380 con 0x7fae100b3870 2024-09-17T03:41:39.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.256+0000 7fae0effd640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fadfc078bc0 0x7fadfc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:39.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.257+0000 7fae0effd640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fadfc078bc0 0x7fadfc07b0d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fae100ce270 tx=0x7fae04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.261+0000 7fadf7fff640 1 -- 172.21.15.146:0/2231081311 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fae00083200 con 0x7fae100b3870 2024-09-17T03:41:39.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.471+0000 7fae15e64640 1 -- 172.21.15.146:0/2231081311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae100d2bd0 con 0x7fae100b3870 2024-09-17T03:41:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.472+0000 7fadf7fff640 1 -- 172.21.15.146:0/2231081311 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7fae00087c30 con 0x7fae100b3870 2024-09-17T03:41:39.472 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:39.472 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:39.472 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 -- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fadfc078bc0 msgr2=0x7fadfc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fadfc078bc0 0x7fadfc07b0d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fae100ce270 tx=0x7fae04009040 comp rx=0 tx=0).stop 2024-09-17T03:41:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 -- 172.21.15.146:0/2231081311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae100b3870 msgr2=0x7fae100cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae100b3870 0x7fae100cadb0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fae000099c0 tx=0x7fae000039e0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 -- 172.21.15.146:0/2231081311 shutdown_connections 2024-09-17T03:41:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fadfc078bc0 0x7fadfc07b0d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae10160c40 0x7fae100cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae101620f0 0x7fae10150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 --2- 172.21.15.146:0/2231081311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae100b3870 0x7fae100cadb0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 -- 172.21.15.146:0/2231081311 >> 172.21.15.146:0/2231081311 conn(0x7fae100d4be0 msgr2=0x7fae1015de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 -- 172.21.15.146:0/2231081311 shutdown_connections 2024-09-17T03:41:39.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.474+0000 7fae15e64640 1 -- 172.21.15.146:0/2231081311 wait complete. 2024-09-17T03:41:39.485 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:41:39.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:41:39.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.597+0000 7f857c24d640 1 -- 172.21.15.146:0/1906541838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85740b5ce0 msgr2=0x7f85740b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:39.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.597+0000 7f857c24d640 1 --2- 172.21.15.146:0/1906541838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85740b5ce0 0x7f85740b1320 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f85740b8440 tx=0x7f857002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.597+0000 7f857c24d640 1 -- 172.21.15.146:0/1906541838 shutdown_connections 2024-09-17T03:41:39.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.597+0000 7f857c24d640 1 --2- 172.21.15.146:0/1906541838 >> v2:172.21.15.179:3300/0 conn(0x7f85740b5750 0x7f85740b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.597+0000 7f857c24d640 1 --2- 172.21.15.146:0/1906541838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85740b5ce0 0x7f85740b1320 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.597+0000 7f857c24d640 1 -- 172.21.15.146:0/1906541838 >> 172.21.15.146:0/1906541838 conn(0x7f85740b7b20 msgr2=0x7f857409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:39.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.597+0000 7f857c24d640 1 -- 172.21.15.146:0/1906541838 shutdown_connections 2024-09-17T03:41:39.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.597+0000 7f857c24d640 1 -- 172.21.15.146:0/1906541838 wait complete. 2024-09-17T03:41:39.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.599+0000 7f857c24d640 1 Processor -- start 2024-09-17T03:41:39.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.599+0000 7f857c24d640 1 -- start start 2024-09-17T03:41:39.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f857c24d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85740b3b60 0x7f85740c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:39.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f857c24d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85740b5750 0x7f857409fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:39.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f857c24d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85740b5ce0 0x7f857409cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:39.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f857c24d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f85740b27b0 con 0x7f85740b5750 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f857c24d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f857415dcc0 con 0x7f85740b3b60 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f857c24d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f85740b2930 con 0x7f85740b5ce0 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f85797e8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85740b5750 0x7f857409fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f85797e8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85740b5750 0x7f857409fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54768/0 (socket says 172.21.15.146:54768) 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f85797e8640 1 -- 172.21.15.146:0/4244383312 learned_addr learned my addr 172.21.15.146:0/4244383312 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f8579fe9640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85740b3b60 0x7f85740c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f857a7ea640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85740b5ce0 0x7f857409cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f85797e8640 1 -- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85740b5ce0 msgr2=0x7f857409cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f85797e8640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85740b5ce0 0x7f857409cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f85797e8640 1 -- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85740b3b60 msgr2=0x7f85740c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f85797e8640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85740b3b60 0x7f85740c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.600+0000 7f85797e8640 1 -- 172.21.15.146:0/4244383312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85740a06b0 con 0x7f85740b5750 2024-09-17T03:41:39.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.601+0000 7f85797e8640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85740b5750 0x7f857409fbb0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f856400d720 tx=0x7f856400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:39.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.601+0000 7f856a7fc640 1 -- 172.21.15.146:0/4244383312 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8564017070 con 0x7f85740b5750 2024-09-17T03:41:39.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.601+0000 7f856a7fc640 1 -- 172.21.15.146:0/4244383312 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8564009b10 con 0x7f85740b5750 2024-09-17T03:41:39.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.601+0000 7f857c24d640 1 -- 172.21.15.146:0/4244383312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85740c7610 con 0x7f85740b5750 2024-09-17T03:41:39.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.601+0000 7f856a7fc640 1 -- 172.21.15.146:0/4244383312 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8564010460 con 0x7f85740b5750 2024-09-17T03:41:39.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.601+0000 7f857c24d640 1 -- 172.21.15.146:0/4244383312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85740c7bd0 con 0x7f85740b5750 2024-09-17T03:41:39.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.602+0000 7f857c24d640 1 -- 172.21.15.146:0/4244383312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85740a0420 con 0x7f85740b5750 2024-09-17T03:41:39.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.603+0000 7f856a7fc640 1 -- 172.21.15.146:0/4244383312 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f856401a070 con 0x7f85740b5750 2024-09-17T03:41:39.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.603+0000 7f856a7fc640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8558078b90 0x7f855807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:39.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.603+0000 7f856a7fc640 1 -- 172.21.15.146:0/4244383312 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f856409adb0 con 0x7f85740b5750 2024-09-17T03:41:39.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.604+0000 7f8579fe9640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8558078b90 0x7f855807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:39.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.604+0000 7f8579fe9640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8558078b90 0x7f855807b0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8570033000 tx=0x7f8570004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:39.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.608+0000 7f856a7fc640 1 -- 172.21.15.146:0/4244383312 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8564062c30 con 0x7f85740b5750 2024-09-17T03:41:39.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.847+0000 7f857c24d640 1 -- 172.21.15.146:0/4244383312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f85740c8010 con 0x7f85740b5750 2024-09-17T03:41:39.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.847+0000 7f856a7fc640 1 -- 172.21.15.146:0/4244383312 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7f8564067660 con 0x7f85740b5750 2024-09-17T03:41:39.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:39.848 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":544,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078133528,"bytes_used":2576474112,"bytes_avail":770517639168,"bytes_total":773094113280,"write_bytes_sec":21104859,"read_op_per_sec":0,"write_op_per_sec":84},"fsmap":{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8658}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-17T03:41:35.928693+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:41:39.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.849+0000 7f857c24d640 1 -- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8558078b90 msgr2=0x7f855807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:39.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.849+0000 7f857c24d640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8558078b90 0x7f855807b0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8570033000 tx=0x7f8570004730 comp rx=0 tx=0).stop 2024-09-17T03:41:39.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.849+0000 7f857c24d640 1 -- 172.21.15.146:0/4244383312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85740b5750 msgr2=0x7f857409fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:39.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.849+0000 7f857c24d640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85740b5750 0x7f857409fbb0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f856400d720 tx=0x7f856400dbe0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.849+0000 7f857c24d640 1 -- 172.21.15.146:0/4244383312 shutdown_connections 2024-09-17T03:41:39.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.849+0000 7f857c24d640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8558078b90 0x7f855807b0a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.849+0000 7f857c24d640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85740b5ce0 0x7f857409cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.849+0000 7f857c24d640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85740b5750 0x7f857409fbb0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.849+0000 7f857c24d640 1 --2- 172.21.15.146:0/4244383312 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85740b3b60 0x7f85740c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.849+0000 7f857c24d640 1 -- 172.21.15.146:0/4244383312 >> 172.21.15.146:0/4244383312 conn(0x7f85740b7b20 msgr2=0x7f85740b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.850+0000 7f857c24d640 1 -- 172.21.15.146:0/4244383312 shutdown_connections 2024-09-17T03:41:39.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:39.850+0000 7f857c24d640 1 -- 172.21.15.146:0/4244383312 wait complete. 2024-09-17T03:41:39.861 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'active paths [/scrub_control_test_path]'} 2024-09-17T03:41:40.862 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:40.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.982+0000 7f7d47870640 1 -- 172.21.15.146:0/3741727081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d400cdc50 msgr2=0x7f7d400b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:40.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.982+0000 7f7d47870640 1 --2- 172.21.15.146:0/3741727081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d400cdc50 0x7f7d400b4ba0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f7d38005fd0 tx=0x7f7d3802a970 comp rx=0 tx=0).stop 2024-09-17T03:41:40.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.982+0000 7f7d47870640 1 -- 172.21.15.146:0/3741727081 shutdown_connections 2024-09-17T03:41:40.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.982+0000 7f7d47870640 1 --2- 172.21.15.146:0/3741727081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d400cdc50 0x7f7d400b4ba0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:40.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.982+0000 7f7d47870640 1 --2- 172.21.15.146:0/3741727081 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d4015c8e0 0x7f7d4006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:40.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.982+0000 7f7d47870640 1 -- 172.21.15.146:0/3741727081 >> 172.21.15.146:0/3741727081 conn(0x7f7d400b3150 msgr2=0x7f7d400b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:40.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.982+0000 7f7d47870640 1 -- 172.21.15.146:0/3741727081 shutdown_connections 2024-09-17T03:41:40.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.982+0000 7f7d47870640 1 -- 172.21.15.146:0/3741727081 wait complete. 2024-09-17T03:41:40.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.984+0000 7f7d47870640 1 Processor -- start 2024-09-17T03:41:40.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.984+0000 7f7d47870640 1 -- start start 2024-09-17T03:41:40.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.985+0000 7f7d47870640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d400cd840 0x7f7d4014bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:40.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.985+0000 7f7d47870640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d400cdc50 0x7f7d4014c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:40.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.985+0000 7f7d47870640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d4015c8e0 0x7f7d4014cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:40.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.985+0000 7f7d47870640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7d40073580 con 0x7f7d400cdc50 2024-09-17T03:41:40.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.985+0000 7f7d47870640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d400b5370 con 0x7f7d400cd840 2024-09-17T03:41:40.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.985+0000 7f7d47870640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7d40073700 con 0x7f7d4015c8e0 2024-09-17T03:41:40.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d44e0b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d400cdc50 0x7f7d4014c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:40.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d44e0b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d400cdc50 0x7f7d4014c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54786/0 (socket says 172.21.15.146:54786) 2024-09-17T03:41:40.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d44e0b640 1 -- 172.21.15.146:0/581552229 learned_addr learned my addr 172.21.15.146:0/581552229 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:40.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d45e0d640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d4015c8e0 0x7f7d4014cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:40.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d4560c640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d400cd840 0x7f7d4014bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:40.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d44e0b640 1 -- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d4015c8e0 msgr2=0x7f7d4014cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:40.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d44e0b640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d4015c8e0 0x7f7d4014cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:40.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d44e0b640 1 -- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d400cd840 msgr2=0x7f7d4014bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:40.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d44e0b640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d400cd840 0x7f7d4014bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:40.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d44e0b640 1 -- 172.21.15.146:0/581552229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4014dd10 con 0x7f7d400cdc50 2024-09-17T03:41:40.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d44e0b640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d400cdc50 0x7f7d4014c9d0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000b3f0 tx=0x7f7d3000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:40.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d35ffb640 1 -- 172.21.15.146:0/581552229 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30015020 con 0x7f7d400cdc50 2024-09-17T03:41:40.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d35ffb640 1 -- 172.21.15.146:0/581552229 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d30011920 con 0x7f7d400cdc50 2024-09-17T03:41:40.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d35ffb640 1 -- 172.21.15.146:0/581552229 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30011d70 con 0x7f7d400cdc50 2024-09-17T03:41:40.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.986+0000 7f7d47870640 1 -- 172.21.15.146:0/581552229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4015b370 con 0x7f7d400cdc50 2024-09-17T03:41:40.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.987+0000 7f7d47870640 1 -- 172.21.15.146:0/581552229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d4015adb0 con 0x7f7d400cdc50 2024-09-17T03:41:40.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.987+0000 7f7d47870640 1 -- 172.21.15.146:0/581552229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4015ab20 con 0x7f7d400cdc50 2024-09-17T03:41:40.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.988+0000 7f7d35ffb640 1 -- 172.21.15.146:0/581552229 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d30018020 con 0x7f7d400cdc50 2024-09-17T03:41:40.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.989+0000 7f7d35ffb640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d24078b90 0x7f7d2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:40.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.989+0000 7f7d35ffb640 1 -- 172.21.15.146:0/581552229 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f7d3009a880 con 0x7f7d400cdc50 2024-09-17T03:41:40.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.989+0000 7f7d4560c640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d24078b90 0x7f7d2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:40.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.990+0000 7f7d4560c640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d24078b90 0x7f7d2407b0a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c004630 tx=0x7f7d3c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:40.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:40.993+0000 7f7d35ffb640 1 -- 172.21.15.146:0/581552229 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d3001f030 con 0x7f7d400cdc50 2024-09-17T03:41:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.204+0000 7f7d47870640 1 -- 172.21.15.146:0/581552229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d40073b80 con 0x7f7d400cdc50 2024-09-17T03:41:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.205+0000 7f7d35ffb640 1 -- 172.21.15.146:0/581552229 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7f7d4014dd10 con 0x7f7d400cdc50 2024-09-17T03:41:41.205 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:41.205 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:41.206 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.207+0000 7f7d47870640 1 -- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d24078b90 msgr2=0x7f7d2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.208+0000 7f7d47870640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d24078b90 0x7f7d2407b0a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c004630 tx=0x7f7d3c00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.208+0000 7f7d47870640 1 -- 172.21.15.146:0/581552229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d400cdc50 msgr2=0x7f7d4014c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.208+0000 7f7d47870640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d400cdc50 0x7f7d4014c9d0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000b3f0 tx=0x7f7d3000b8b0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.208+0000 7f7d47870640 1 -- 172.21.15.146:0/581552229 shutdown_connections 2024-09-17T03:41:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.208+0000 7f7d47870640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d24078b90 0x7f7d2407b0a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.208+0000 7f7d47870640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d4015c8e0 0x7f7d4014cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.208+0000 7f7d47870640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d400cdc50 0x7f7d4014c9d0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.208+0000 7f7d47870640 1 --2- 172.21.15.146:0/581552229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d400cd840 0x7f7d4014bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.208+0000 7f7d47870640 1 -- 172.21.15.146:0/581552229 >> 172.21.15.146:0/581552229 conn(0x7f7d400b3150 msgr2=0x7f7d4015e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:41.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.208+0000 7f7d47870640 1 -- 172.21.15.146:0/581552229 shutdown_connections 2024-09-17T03:41:41.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.208+0000 7f7d47870640 1 -- 172.21.15.146:0/581552229 wait complete. 2024-09-17T03:41:41.219 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:41:41.219 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:41:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.331+0000 7fa64692b640 1 -- 172.21.15.146:0/102918584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa64015c8e0 msgr2=0x7fa64006f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.331+0000 7fa64692b640 1 --2- 172.21.15.146:0/102918584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa64015c8e0 0x7fa64006f580 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fa64015bd20 tx=0x7fa63002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.331+0000 7fa64692b640 1 -- 172.21.15.146:0/102918584 shutdown_connections 2024-09-17T03:41:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.331+0000 7fa64692b640 1 --2- 172.21.15.146:0/102918584 >> v2:172.21.15.179:3300/0 conn(0x7fa6400cd840 0x7fa6400b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.331+0000 7fa64692b640 1 --2- 172.21.15.146:0/102918584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa64015c8e0 0x7fa64006f580 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.331+0000 7fa64692b640 1 -- 172.21.15.146:0/102918584 >> 172.21.15.146:0/102918584 conn(0x7fa6400b3150 msgr2=0x7fa6400b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.331+0000 7fa64692b640 1 -- 172.21.15.146:0/102918584 shutdown_connections 2024-09-17T03:41:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.331+0000 7fa64692b640 1 -- 172.21.15.146:0/102918584 wait complete. 2024-09-17T03:41:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.333+0000 7fa64692b640 1 Processor -- start 2024-09-17T03:41:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.333+0000 7fa64692b640 1 -- start start 2024-09-17T03:41:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa64692b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6400cd840 0x7fa6400aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa64692b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400cdc50 0x7fa64014bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa64692b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa64015c8e0 0x7fa6401f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa64692b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa640073580 con 0x7fa6400cdc50 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa64692b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa6400b5e50 con 0x7fa64015c8e0 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa64692b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa640073700 con 0x7fa6400cd840 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa63f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400cdc50 0x7fa64014bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa63f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400cdc50 0x7fa64014bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54808/0 (socket says 172.21.15.146:54808) 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa63f7fe640 1 -- 172.21.15.146:0/2148143792 learned_addr learned my addr 172.21.15.146:0/2148143792 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa63ffff640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6400cd840 0x7fa6400aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa644ec8640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa64015c8e0 0x7fa6401f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa63f7fe640 1 -- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6400cd840 msgr2=0x7fa6400aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa63f7fe640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6400cd840 0x7fa6400aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa63f7fe640 1 -- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa64015c8e0 msgr2=0x7fa6401f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa63f7fe640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa64015c8e0 0x7fa6401f6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.334+0000 7fa63f7fe640 1 -- 172.21.15.146:0/2148143792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6400aa480 con 0x7fa6400cdc50 2024-09-17T03:41:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.335+0000 7fa63f7fe640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400cdc50 0x7fa64014bfa0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fa63400e720 tx=0x7fa63400ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.335+0000 7fa63cff9640 1 -- 172.21.15.146:0/2148143792 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63400cab0 con 0x7fa6400cdc50 2024-09-17T03:41:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.335+0000 7fa63cff9640 1 -- 172.21.15.146:0/2148143792 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa63400cc50 con 0x7fa6400cdc50 2024-09-17T03:41:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.335+0000 7fa64692b640 1 -- 172.21.15.146:0/2148143792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6400aa980 con 0x7fa6400cdc50 2024-09-17T03:41:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.335+0000 7fa63cff9640 1 -- 172.21.15.146:0/2148143792 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa634005280 con 0x7fa6400cdc50 2024-09-17T03:41:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.335+0000 7fa64692b640 1 -- 172.21.15.146:0/2148143792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa64014cd10 con 0x7fa6400cdc50 2024-09-17T03:41:41.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.336+0000 7fa64692b640 1 -- 172.21.15.146:0/2148143792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6400aa6f0 con 0x7fa6400cdc50 2024-09-17T03:41:41.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.337+0000 7fa63cff9640 1 -- 172.21.15.146:0/2148143792 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa634005420 con 0x7fa6400cdc50 2024-09-17T03:41:41.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.337+0000 7fa63cff9640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa62c078b90 0x7fa62c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:41.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.337+0000 7fa63cff9640 1 -- 172.21.15.146:0/2148143792 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fa63409b610 con 0x7fa6400cdc50 2024-09-17T03:41:41.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.337+0000 7fa63ffff640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa62c078b90 0x7fa62c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:41.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.338+0000 7fa63ffff640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa62c078b90 0x7fa62c07b0a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa630034000 tx=0x7fa630004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.342+0000 7fa63cff9640 1 -- 172.21.15.146:0/2148143792 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa63400ce20 con 0x7fa6400cdc50 2024-09-17T03:41:41.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.584+0000 7fa64692b640 1 -- 172.21.15.146:0/2148143792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa640073ba0 con 0x7fa6400cdc50 2024-09-17T03:41:41.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.585+0000 7fa63cff9640 1 -- 172.21.15.146:0/2148143792 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7fa63406c030 con 0x7fa6400cdc50 2024-09-17T03:41:41.585 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:41.585 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":546,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078357618,"bytes_used":2577260544,"bytes_avail":770516852736,"bytes_total":773094113280,"write_bytes_sec":15280222,"read_op_per_sec":0,"write_op_per_sec":87},"fsmap":{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8658}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-17T03:41:35.928693+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:41:41.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 -- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa62c078b90 msgr2=0x7fa62c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:41.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa62c078b90 0x7fa62c07b0a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa630034000 tx=0x7fa630004730 comp rx=0 tx=0).stop 2024-09-17T03:41:41.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 -- 172.21.15.146:0/2148143792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400cdc50 msgr2=0x7fa64014bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:41.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400cdc50 0x7fa64014bfa0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fa63400e720 tx=0x7fa63400ebe0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 -- 172.21.15.146:0/2148143792 shutdown_connections 2024-09-17T03:41:41.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa62c078b90 0x7fa62c07b0a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa64015c8e0 0x7fa6401f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6400cdc50 0x7fa64014bfa0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 --2- 172.21.15.146:0/2148143792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa6400cd840 0x7fa6400aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:41.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 -- 172.21.15.146:0/2148143792 >> 172.21.15.146:0/2148143792 conn(0x7fa6400b3150 msgr2=0x7fa64015dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:41.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 -- 172.21.15.146:0/2148143792 shutdown_connections 2024-09-17T03:41:41.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:41.587+0000 7fa64692b640 1 -- 172.21.15.146:0/2148143792 wait complete. 2024-09-17T03:41:41.598 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'active paths [/scrub_control_test_path]'} 2024-09-17T03:41:42.600 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:42.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.726+0000 7f5abb95f640 1 -- 172.21.15.146:0/3840262437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab406f270 msgr2=0x7f5ab40d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:42.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.726+0000 7f5abb95f640 1 --2- 172.21.15.146:0/3840262437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab406f270 0x7f5ab40d3190 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40b3d00 tx=0x7f5aac02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:41:42.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.726+0000 7f5abb95f640 1 -- 172.21.15.146:0/3840262437 shutdown_connections 2024-09-17T03:41:42.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.726+0000 7f5abb95f640 1 --2- 172.21.15.146:0/3840262437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab406f270 0x7f5ab40d3190 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:42.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.726+0000 7f5abb95f640 1 --2- 172.21.15.146:0/3840262437 >> v2:172.21.15.179:3300/0 conn(0x7f5ab40cf370 0x7f5ab406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:42.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.726+0000 7f5abb95f640 1 -- 172.21.15.146:0/3840262437 >> 172.21.15.146:0/3840262437 conn(0x7f5ab40d4be0 msgr2=0x7f5ab40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:42.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.726+0000 7f5abb95f640 1 -- 172.21.15.146:0/3840262437 shutdown_connections 2024-09-17T03:41:42.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.726+0000 7f5abb95f640 1 -- 172.21.15.146:0/3840262437 wait complete. 2024-09-17T03:41:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.728+0000 7f5abb95f640 1 Processor -- start 2024-09-17T03:41:42.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.728+0000 7f5abb95f640 1 -- start start 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5abb95f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab406f270 0x7f5ab40c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5abb95f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab40b3870 0x7f5ab414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5abb95f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ab40cf370 0x7f5ab40cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5abb95f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab40d3a60 con 0x7f5ab40b3870 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5abb95f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab40d38e0 con 0x7f5ab40cf370 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5abb95f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab40d3be0 con 0x7f5ab406f270 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5ab8efa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab40b3870 0x7f5ab414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5ab8efa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab40b3870 0x7f5ab414cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54836/0 (socket says 172.21.15.146:54836) 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5ab8efa640 1 -- 172.21.15.146:0/3722944742 learned_addr learned my addr 172.21.15.146:0/3722944742 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5ab9efc640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ab40cf370 0x7f5ab40cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5ab96fb640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab406f270 0x7f5ab40c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:42.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5ab8efa640 1 -- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab406f270 msgr2=0x7f5ab40c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5ab8efa640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab406f270 0x7f5ab40c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5ab8efa640 1 -- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ab40cf370 msgr2=0x7f5ab40cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5ab8efa640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ab40cf370 0x7f5ab40cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5ab8efa640 1 -- 172.21.15.146:0/3722944742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab40c7ea0 con 0x7f5ab40b3870 2024-09-17T03:41:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5ab8efa640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab40b3870 0x7f5ab414cb10 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400d770 tx=0x7f5aa400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5aa9ffb640 1 -- 172.21.15.146:0/3722944742 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4017070 con 0x7f5ab40b3870 2024-09-17T03:41:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5aa9ffb640 1 -- 172.21.15.146:0/3722944742 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5aa4009d20 con 0x7f5ab40b3870 2024-09-17T03:41:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5abb95f640 1 -- 172.21.15.146:0/3722944742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab40c8180 con 0x7f5ab40b3870 2024-09-17T03:41:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.730+0000 7f5aa9ffb640 1 -- 172.21.15.146:0/3722944742 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40106c0 con 0x7f5ab40b3870 2024-09-17T03:41:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.731+0000 7f5abb95f640 1 -- 172.21.15.146:0/3722944742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab40c8740 con 0x7f5ab40b3870 2024-09-17T03:41:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.732+0000 7f5abb95f640 1 -- 172.21.15.146:0/3722944742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab40d3190 con 0x7f5ab40b3870 2024-09-17T03:41:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.732+0000 7f5aa9ffb640 1 -- 172.21.15.146:0/3722944742 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5aa401a070 con 0x7f5ab40b3870 2024-09-17T03:41:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.733+0000 7f5aa9ffb640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a98078b90 0x7f5a9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.733+0000 7f5aa9ffb640 1 -- 172.21.15.146:0/3722944742 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5767+0+0 (secure 0 0 0) 0x7f5aa409aef0 con 0x7f5ab40b3870 2024-09-17T03:41:42.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.733+0000 7f5ab96fb640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a98078b90 0x7f5a9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:42.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.734+0000 7f5ab96fb640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a98078b90 0x7f5a9807b0a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0007fd0 tx=0x7f5ab0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:42.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.738+0000 7f5aa9ffb640 1 -- 172.21.15.146:0/3722944742 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5aa40632f0 con 0x7f5ab40b3870 2024-09-17T03:41:42.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.948+0000 7f5abb95f640 1 -- 172.21.15.146:0/3722944742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ab415b260 con 0x7f5ab40b3870 2024-09-17T03:41:42.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.949+0000 7f5aa9ffb640 1 -- 172.21.15.146:0/3722944742 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7f5aa4062bf0 con 0x7f5ab40b3870 2024-09-17T03:41:42.949 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:42.949 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:42.949 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:42.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 -- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a98078b90 msgr2=0x7f5a9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:42.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a98078b90 0x7f5a9807b0a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0007fd0 tx=0x7f5ab0009040 comp rx=0 tx=0).stop 2024-09-17T03:41:42.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 -- 172.21.15.146:0/3722944742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab40b3870 msgr2=0x7f5ab414cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:42.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab40b3870 0x7f5ab414cb10 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400d770 tx=0x7f5aa400dc30 comp rx=0 tx=0).stop 2024-09-17T03:41:42.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 -- 172.21.15.146:0/3722944742 shutdown_connections 2024-09-17T03:41:42.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a98078b90 0x7f5a9807b0a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:42.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ab40cf370 0x7f5ab40cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:42.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ab40b3870 0x7f5ab414cb10 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:42.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 --2- 172.21.15.146:0/3722944742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5ab406f270 0x7f5ab40c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:42.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 -- 172.21.15.146:0/3722944742 >> 172.21.15.146:0/3722944742 conn(0x7f5ab40d4be0 msgr2=0x7f5ab40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:42.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 -- 172.21.15.146:0/3722944742 shutdown_connections 2024-09-17T03:41:42.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:42.951+0000 7f5abb95f640 1 -- 172.21.15.146:0/3722944742 wait complete. 2024-09-17T03:41:42.962 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:41:42.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:41:43.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.074+0000 7f4237a30640 1 -- 172.21.15.146:0/2958985780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42300b5ce0 msgr2=0x7f42300b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.074+0000 7f4237a30640 1 --2- 172.21.15.146:0/2958985780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42300b5ce0 0x7f42300b1320 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f422c009830 tx=0x7f422c02a510 comp rx=0 tx=0).stop 2024-09-17T03:41:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.074+0000 7f4237a30640 1 -- 172.21.15.146:0/2958985780 shutdown_connections 2024-09-17T03:41:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.074+0000 7f4237a30640 1 --2- 172.21.15.146:0/2958985780 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42300b3d30 0x7f423015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.074+0000 7f4237a30640 1 --2- 172.21.15.146:0/2958985780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42300b5ce0 0x7f42300b1320 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.074+0000 7f4237a30640 1 -- 172.21.15.146:0/2958985780 >> 172.21.15.146:0/2958985780 conn(0x7f42300b7b20 msgr2=0x7f423009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.074+0000 7f4237a30640 1 -- 172.21.15.146:0/2958985780 shutdown_connections 2024-09-17T03:41:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.074+0000 7f4237a30640 1 -- 172.21.15.146:0/2958985780 wait complete. 2024-09-17T03:41:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.076+0000 7f4237a30640 1 Processor -- start 2024-09-17T03:41:43.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.076+0000 7f4237a30640 1 -- start start 2024-09-17T03:41:43.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.077+0000 7f4237a30640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42300b5750 0x7f423006dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.077+0000 7f4237a30640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42300b5ce0 0x7f42301f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.077+0000 7f4237a30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42301540b0 0x7f4230151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.077+0000 7f4237a30640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f423015d4b0 con 0x7f42301540b0 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.077+0000 7f4237a30640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f423015d330 con 0x7f42300b5750 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.077+0000 7f4237a30640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f423015d630 con 0x7f42300b5ce0 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.077+0000 7f4235fcd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42301540b0 0x7f4230151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4235fcd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42301540b0 0x7f4230151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54846/0 (socket says 172.21.15.146:54846) 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4235fcd640 1 -- 172.21.15.146:0/2959628581 learned_addr learned my addr 172.21.15.146:0/2959628581 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f42357cc640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42300b5750 0x7f423006dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4234fcb640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42300b5ce0 0x7f42301f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4235fcd640 1 -- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42300b5ce0 msgr2=0x7f42301f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4235fcd640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42300b5ce0 0x7f42301f53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4235fcd640 1 -- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42300b5750 msgr2=0x7f423006dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:43.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4235fcd640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42300b5750 0x7f423006dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4235fcd640 1 -- 172.21.15.146:0/2959628581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423006f6c0 con 0x7f42301540b0 2024-09-17T03:41:43.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4234fcb640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42300b5ce0 0x7f42301f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:43.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4235fcd640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42301540b0 0x7f4230151000 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f422800d9e0 tx=0x7f422800dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:43.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4225ffb640 1 -- 172.21.15.146:0/2959628581 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4228017070 con 0x7f42301540b0 2024-09-17T03:41:43.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4225ffb640 1 -- 172.21.15.146:0/2959628581 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f422800be30 con 0x7f42301540b0 2024-09-17T03:41:43.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4225ffb640 1 -- 172.21.15.146:0/2959628581 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4228003bb0 con 0x7f42301540b0 2024-09-17T03:41:43.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4237a30640 1 -- 172.21.15.146:0/2959628581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423006e620 con 0x7f42301540b0 2024-09-17T03:41:43.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.078+0000 7f4237a30640 1 -- 172.21.15.146:0/2959628581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f423006ebe0 con 0x7f42301540b0 2024-09-17T03:41:43.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.079+0000 7f4237a30640 1 -- 172.21.15.146:0/2959628581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f423006e390 con 0x7f42301540b0 2024-09-17T03:41:43.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.080+0000 7f4225ffb640 1 -- 172.21.15.146:0/2959628581 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4228010460 con 0x7f42301540b0 2024-09-17T03:41:43.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.080+0000 7f4225ffb640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4214078b90 0x7f421407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:43.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.081+0000 7f4225ffb640 1 -- 172.21.15.146:0/2959628581 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5767+0+0 (secure 0 0 0) 0x7f422809b1c0 con 0x7f42301540b0 2024-09-17T03:41:43.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.081+0000 7f42357cc640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4214078b90 0x7f421407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:43.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.081+0000 7f42357cc640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4214078b90 0x7f421407b0a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f422c034000 tx=0x7f422c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:43.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.085+0000 7f4225ffb640 1 -- 172.21.15.146:0/2959628581 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f423006f6c0 con 0x7f42301540b0 2024-09-17T03:41:43.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.329+0000 7f4237a30640 1 -- 172.21.15.146:0/2959628581 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f42300b2760 con 0x7f42301540b0 2024-09-17T03:41:43.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.329+0000 7f4225ffb640 1 -- 172.21.15.146:0/2959628581 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1615 (secure 0 0 0) 0x7f42300b2760 con 0x7f42301540b0 2024-09-17T03:41:43.330 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:43.330 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":547,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1078357618,"bytes_used":2577260544,"bytes_avail":770516852736,"bytes_total":773094113280,"write_bytes_sec":201922,"read_op_per_sec":0,"write_op_per_sec":66},"fsmap":{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8658}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-17T03:41:41.930323+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:41:43.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 -- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4214078b90 msgr2=0x7f421407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:43.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4214078b90 0x7f421407b0a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f422c034000 tx=0x7f422c004730 comp rx=0 tx=0).stop 2024-09-17T03:41:43.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 -- 172.21.15.146:0/2959628581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42301540b0 msgr2=0x7f4230151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:43.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42301540b0 0x7f4230151000 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f422800d9e0 tx=0x7f422800dea0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 -- 172.21.15.146:0/2959628581 shutdown_connections 2024-09-17T03:41:43.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4214078b90 0x7f421407b0a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42301540b0 0x7f4230151000 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42300b5ce0 0x7f42301f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 --2- 172.21.15.146:0/2959628581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42300b5750 0x7f423006dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 -- 172.21.15.146:0/2959628581 >> 172.21.15.146:0/2959628581 conn(0x7f42300b7b20 msgr2=0x7f42300b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:43.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 -- 172.21.15.146:0/2959628581 shutdown_connections 2024-09-17T03:41:43.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.332+0000 7f4237a30640 1 -- 172.21.15.146:0/2959628581 wait complete. 2024-09-17T03:41:43.343 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:41:43.343 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:41:43.345 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:41:43.381 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:41:43.426 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:41:43.426 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:41:43.426 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:41:43.426 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:43.443 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:41:43.443 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:43.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:41:43.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.657+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/1296085802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d80b3870 msgr2=0x7fe3d80cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:43.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.657+0000 7fe3dd2ec640 1 --2- 172.21.15.146:0/1296085802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d80b3870 0x7fe3d80cf370 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8005fd0 tx=0x7fe3c802a820 comp rx=0 tx=0).stop 2024-09-17T03:41:43.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.657+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/1296085802 shutdown_connections 2024-09-17T03:41:43.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.657+0000 7fe3dd2ec640 1 --2- 172.21.15.146:0/1296085802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3d806f440 0x7fe3d80d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.657+0000 7fe3dd2ec640 1 --2- 172.21.15.146:0/1296085802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d80b3870 0x7fe3d80cf370 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.657+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/1296085802 >> 172.21.15.146:0/1296085802 conn(0x7fe3d80d4be0 msgr2=0x7fe3d80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:43.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.657+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/1296085802 shutdown_connections 2024-09-17T03:41:43.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.657+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/1296085802 wait complete. 2024-09-17T03:41:43.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.659+0000 7fe3dd2ec640 1 Processor -- start 2024-09-17T03:41:43.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.659+0000 7fe3dd2ec640 1 -- start start 2024-09-17T03:41:43.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3dd2ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3d80b3870 0x7fe3d81f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:43.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3dd2ec640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81620f0 0x7fe3d80b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:43.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3dd2ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d814dc70 0x7fe3d80c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:43.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3dd2ec640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80d3a60 con 0x7fe3d81620f0 2024-09-17T03:41:43.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3dd2ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80d38e0 con 0x7fe3d814dc70 2024-09-17T03:41:43.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3dd2ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d80d3be0 con 0x7fe3d80b3870 2024-09-17T03:41:43.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3d67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81620f0 0x7fe3d80b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:43.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3d67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81620f0 0x7fe3d80b6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54854/0 (socket says 172.21.15.146:54854) 2024-09-17T03:41:43.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3d67fc640 1 -- 172.21.15.146:0/932316144 learned_addr learned my addr 172.21.15.146:0/932316144 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:43.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3d6ffd640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3d80b3870 0x7fe3d81f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:43.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3d77fe640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d814dc70 0x7fe3d80c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:43.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3d67fc640 1 -- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3d80b3870 msgr2=0x7fe3d81f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:43.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3d67fc640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3d80b3870 0x7fe3d81f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3d67fc640 1 -- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d814dc70 msgr2=0x7fe3d80c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:43.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3d67fc640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d814dc70 0x7fe3d80c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3d67fc640 1 -- 172.21.15.146:0/932316144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d80b5360 con 0x7fe3d81620f0 2024-09-17T03:41:43.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.660+0000 7fe3d67fc640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81620f0 0x7fe3d80b6900 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c3a0 tx=0x7fe3cc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:43.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.661+0000 7fe3bf7fe640 1 -- 172.21.15.146:0/932316144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc011790 con 0x7fe3d81620f0 2024-09-17T03:41:43.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.661+0000 7fe3bf7fe640 1 -- 172.21.15.146:0/932316144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3cc017070 con 0x7fe3d81620f0 2024-09-17T03:41:43.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.661+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/932316144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d80b5860 con 0x7fe3d81620f0 2024-09-17T03:41:43.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.661+0000 7fe3bf7fe640 1 -- 172.21.15.146:0/932316144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc011d20 con 0x7fe3d81620f0 2024-09-17T03:41:43.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.661+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/932316144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d80b5e20 con 0x7fe3d81620f0 2024-09-17T03:41:43.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.662+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/932316144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d80b55d0 con 0x7fe3d81620f0 2024-09-17T03:41:43.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.662+0000 7fe3bf7fe640 1 -- 172.21.15.146:0/932316144 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3cc01c460 con 0x7fe3d81620f0 2024-09-17T03:41:43.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.663+0000 7fe3bf7fe640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3c4078b90 0x7fe3c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:43.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.663+0000 7fe3bf7fe640 1 -- 172.21.15.146:0/932316144 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5767+0+0 (secure 0 0 0) 0x7fe3cc09a9d0 con 0x7fe3d81620f0 2024-09-17T03:41:43.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.663+0000 7fe3d6ffd640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3c4078b90 0x7fe3c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:43.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.664+0000 7fe3d6ffd640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3c4078b90 0x7fe3c407b0a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8034000 tx=0x7fe3c8004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:43.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.668+0000 7fe3bf7fe640 1 -- 172.21.15.146:0/932316144 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe3cc062810 con 0x7fe3d81620f0 2024-09-17T03:41:43.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.855+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/932316144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe3d80d3190 con 0x7fe3d81620f0 2024-09-17T03:41:43.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.855+0000 7fe3bf7fe640 1 -- 172.21.15.146:0/932316144 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v132) ==== 80+0+0 (secure 0 0 0) 0x7fe3cc067240 con 0x7fe3d81620f0 2024-09-17T03:41:43.856 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:41:43.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.857+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3c4078b90 msgr2=0x7fe3c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:43.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.857+0000 7fe3dd2ec640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3c4078b90 0x7fe3c407b0a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8034000 tx=0x7fe3c8004ab0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.858+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/932316144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81620f0 msgr2=0x7fe3d80b6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:43.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.858+0000 7fe3dd2ec640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81620f0 0x7fe3d80b6900 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00c3a0 tx=0x7fe3cc00c860 comp rx=0 tx=0).stop 2024-09-17T03:41:43.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.858+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/932316144 shutdown_connections 2024-09-17T03:41:43.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.858+0000 7fe3dd2ec640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe3c4078b90 0x7fe3c407b0a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.858+0000 7fe3dd2ec640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe3d814dc70 0x7fe3d80c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.858+0000 7fe3dd2ec640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3d81620f0 0x7fe3d80b6900 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.858+0000 7fe3dd2ec640 1 --2- 172.21.15.146:0/932316144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe3d80b3870 0x7fe3d81f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:43.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.858+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/932316144 >> 172.21.15.146:0/932316144 conn(0x7fe3d80d4be0 msgr2=0x7fe3d8075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:43.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.858+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/932316144 shutdown_connections 2024-09-17T03:41:43.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:43.858+0000 7fe3dd2ec640 1 -- 172.21.15.146:0/932316144 wait complete. 2024-09-17T03:41:43.869 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:41:43.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:43.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:41:44.099 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:41:44.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:41:44.099 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:41:44.114 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:41:44.114 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:41:44.114 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:44.130 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:41:44.130 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:41:44.131 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:41:44.131 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:44.170 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:41:44.170 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:41:44.170 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:41:44.170 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:44.185 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:41:44.186 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:44.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.324+0000 7f69eebad640 1 -- 172.21.15.146:0/1929668057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e80b5ce0 msgr2=0x7f69e80b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:44.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.324+0000 7f69eebad640 1 --2- 172.21.15.146:0/1929668057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e80b5ce0 0x7f69e80b1320 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009830 tx=0x7f69e402a410 comp rx=0 tx=0).stop 2024-09-17T03:41:44.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.325+0000 7f69eebad640 1 -- 172.21.15.146:0/1929668057 shutdown_connections 2024-09-17T03:41:44.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.325+0000 7f69eebad640 1 --2- 172.21.15.146:0/1929668057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e80b3d30 0x7f69e815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:44.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.325+0000 7f69eebad640 1 --2- 172.21.15.146:0/1929668057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e80b5ce0 0x7f69e80b1320 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:44.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.325+0000 7f69eebad640 1 -- 172.21.15.146:0/1929668057 >> 172.21.15.146:0/1929668057 conn(0x7f69e80b7b20 msgr2=0x7f69e809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:44.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.325+0000 7f69eebad640 1 -- 172.21.15.146:0/1929668057 shutdown_connections 2024-09-17T03:41:44.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.325+0000 7f69eebad640 1 -- 172.21.15.146:0/1929668057 wait complete. 2024-09-17T03:41:44.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.326+0000 7f69eebad640 1 Processor -- start 2024-09-17T03:41:44.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.326+0000 7f69eebad640 1 -- start start 2024-09-17T03:41:44.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69eebad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e80b5750 0x7f69e81584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:44.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69eebad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80b5ce0 0x7f69e806f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69eebad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e81589e0 0x7f69e815f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69eebad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69e815d460 con 0x7f69e80b5ce0 2024-09-17T03:41:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69eebad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f69e815d2e0 con 0x7f69e81589e0 2024-09-17T03:41:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69eebad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f69e815d5e0 con 0x7f69e80b5750 2024-09-17T03:41:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69dffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80b5ce0 0x7f69e806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69dffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80b5ce0 0x7f69e806f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54858/0 (socket says 172.21.15.146:54858) 2024-09-17T03:41:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69dffff640 1 -- 172.21.15.146:0/870411222 learned_addr learned my addr 172.21.15.146:0/870411222 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69ec949640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e80b5750 0x7f69e81584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:44.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69ed14a640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e81589e0 0x7f69e815f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:44.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69dffff640 1 -- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e80b5750 msgr2=0x7f69e81584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:44.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69dffff640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e80b5750 0x7f69e81584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69dffff640 1 -- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e81589e0 msgr2=0x7f69e815f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69dffff640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e81589e0 0x7f69e815f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69dffff640 1 -- 172.21.15.146:0/870411222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e806fda0 con 0x7f69e80b5ce0 2024-09-17T03:41:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69ed14a640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e81589e0 0x7f69e815f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:41:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69ec949640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e80b5750 0x7f69e81584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:41:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.328+0000 7f69dffff640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80b5ce0 0x7f69e806f280 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f69d800c520 tx=0x7f69d800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.329+0000 7f69dd7fa640 1 -- 172.21.15.146:0/870411222 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8017070 con 0x7f69e80b5ce0 2024-09-17T03:41:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.329+0000 7f69dd7fa640 1 -- 172.21.15.146:0/870411222 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69d80035f0 con 0x7f69e80b5ce0 2024-09-17T03:41:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.329+0000 7f69eebad640 1 -- 172.21.15.146:0/870411222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e81f8b50 con 0x7f69e80b5ce0 2024-09-17T03:41:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.329+0000 7f69dd7fa640 1 -- 172.21.15.146:0/870411222 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8003a40 con 0x7f69e80b5ce0 2024-09-17T03:41:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.329+0000 7f69eebad640 1 -- 172.21.15.146:0/870411222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e81f90d0 con 0x7f69e80b5ce0 2024-09-17T03:41:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.330+0000 7f69eebad640 1 -- 172.21.15.146:0/870411222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e815b3d0 con 0x7f69e80b5ce0 2024-09-17T03:41:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.330+0000 7f69dd7fa640 1 -- 172.21.15.146:0/870411222 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f69d801a070 con 0x7f69e80b5ce0 2024-09-17T03:41:44.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.331+0000 7f69dd7fa640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f69d4078b90 0x7f69d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:44.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.331+0000 7f69dd7fa640 1 -- 172.21.15.146:0/870411222 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5767+0+0 (secure 0 0 0) 0x7f69d809a1c0 con 0x7f69e80b5ce0 2024-09-17T03:41:44.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.331+0000 7f69ec949640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f69d4078b90 0x7f69d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:44.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.332+0000 7f69ec949640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f69d4078b90 0x7f69d407b0a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f69e4034000 tx=0x7f69e4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:44.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.336+0000 7f69dd7fa640 1 -- 172.21.15.146:0/870411222 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f69e81f8b50 con 0x7f69e80b5ce0 2024-09-17T03:41:44.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.547+0000 7f69eebad640 1 -- 172.21.15.146:0/870411222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69e806a3f0 con 0x7f69e80b5ce0 2024-09-17T03:41:44.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.547+0000 7f69dd7fa640 1 -- 172.21.15.146:0/870411222 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7f69d8061f70 con 0x7f69e80b5ce0 2024-09-17T03:41:44.684 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:44.684 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:44.685 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.549+0000 7f69eebad640 1 -- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f69d4078b90 msgr2=0x7f69d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.549+0000 7f69eebad640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f69d4078b90 0x7f69d407b0a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f69e4034000 tx=0x7f69e4004730 comp rx=0 tx=0).stop 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.549+0000 7f69eebad640 1 -- 172.21.15.146:0/870411222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80b5ce0 msgr2=0x7f69e806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.549+0000 7f69eebad640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80b5ce0 0x7f69e806f280 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f69d800c520 tx=0x7f69d800c9e0 comp rx=0 tx=0).stop 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.549+0000 7f69eebad640 1 -- 172.21.15.146:0/870411222 shutdown_connections 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.549+0000 7f69eebad640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f69d4078b90 0x7f69d407b0a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.549+0000 7f69eebad640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69e81589e0 0x7f69e815f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.549+0000 7f69eebad640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80b5ce0 0x7f69e806f280 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.549+0000 7f69eebad640 1 --2- 172.21.15.146:0/870411222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69e80b5750 0x7f69e81584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.549+0000 7f69eebad640 1 -- 172.21.15.146:0/870411222 >> 172.21.15.146:0/870411222 conn(0x7f69e80b7b20 msgr2=0x7f69e815bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.550+0000 7f69eebad640 1 -- 172.21.15.146:0/870411222 shutdown_connections 2024-09-17T03:41:44.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.550+0000 7f69eebad640 1 -- 172.21.15.146:0/870411222 wait complete. 2024-09-17T03:41:44.687 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.800+0000 7fbcd5da1640 1 -- 172.21.15.146:0/408758884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb8003a00 msgr2=0x7fbcb8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.800+0000 7fbcd5da1640 1 --2- 172.21.15.146:0/408758884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb8003a00 0x7fbcb8003e70 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000c4a0 tx=0x7fbcb8005830 comp rx=0 tx=0).stop 2024-09-17T03:41:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.800+0000 7fbccffff640 1 -- 172.21.15.146:0/408758884 reap_dead start 2024-09-17T03:41:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.800+0000 7fbcd5da1640 1 -- 172.21.15.146:0/408758884 shutdown_connections 2024-09-17T03:41:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.800+0000 7fbcd5da1640 1 -- 172.21.15.146:0/408758884 >> 172.21.15.146:0/408758884 conn(0x7fbcd00b7b20 msgr2=0x7fbcd009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.800+0000 7fbcd5da1640 1 -- 172.21.15.146:0/408758884 shutdown_connections 2024-09-17T03:41:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.800+0000 7fbcd5da1640 1 -- 172.21.15.146:0/408758884 wait complete. 2024-09-17T03:41:44.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.802+0000 7fbcd5da1640 1 Processor -- start 2024-09-17T03:41:44.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.802+0000 7fbcd5da1640 1 -- start start 2024-09-17T03:41:44.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.803+0000 7fbcd5da1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcb8003a00 0x7fbcd01f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:44.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.803+0000 7fbcd5da1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd0150e60 0x7fbcd0144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:44.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.803+0000 7fbcd5da1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd01452f0 0x7fbcd0145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:44.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.803+0000 7fbcd5da1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd00b39b0 con 0x7fbcd01452f0 2024-09-17T03:41:44.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.803+0000 7fbcd5da1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd00b3830 con 0x7fbcb8003a00 2024-09-17T03:41:44.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbcd5da1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd015cfe0 con 0x7fbcd0150e60 2024-09-17T03:41:44.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbccffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd01452f0 0x7fbcd0145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:44.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbccffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd01452f0 0x7fbcd0145700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54876/0 (socket says 172.21.15.146:54876) 2024-09-17T03:41:44.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbccffff640 1 -- 172.21.15.146:0/2004125523 learned_addr learned my addr 172.21.15.146:0/2004125523 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbcceffd640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd0150e60 0x7fbcd0144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbccf7fe640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcb8003a00 0x7fbcd01f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbccffff640 1 -- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd0150e60 msgr2=0x7fbcd0144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbccffff640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd0150e60 0x7fbcd0144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbccffff640 1 -- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcb8003a00 msgr2=0x7fbcd01f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbccffff640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcb8003a00 0x7fbcd01f3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbccffff640 1 -- 172.21.15.146:0/2004125523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd01f4190 con 0x7fbcd01452f0 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbcceffd640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd0150e60 0x7fbcd0144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbccffff640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd01452f0 0x7fbcd0145700 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00b8440 tx=0x7fbcc800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbcb7fff640 1 -- 172.21.15.146:0/2004125523 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8004b20 con 0x7fbcd01452f0 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbcb7fff640 1 -- 172.21.15.146:0/2004125523 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcc8004cc0 con 0x7fbcd01452f0 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbcd5da1640 1 -- 172.21.15.146:0/2004125523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd01f4400 con 0x7fbcd01452f0 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbcb7fff640 1 -- 172.21.15.146:0/2004125523 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8003bd0 con 0x7fbcd01452f0 2024-09-17T03:41:44.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.804+0000 7fbcd5da1640 1 -- 172.21.15.146:0/2004125523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd0153d50 con 0x7fbcd01452f0 2024-09-17T03:41:44.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.805+0000 7fbcd5da1640 1 -- 172.21.15.146:0/2004125523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd009c7d0 con 0x7fbcd01452f0 2024-09-17T03:41:44.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.806+0000 7fbcb7fff640 1 -- 172.21.15.146:0/2004125523 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcc8004030 con 0x7fbcd01452f0 2024-09-17T03:41:44.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.807+0000 7fbcb7fff640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcbc078b90 0x7fbcbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:44.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.807+0000 7fbcb7fff640 1 -- 172.21.15.146:0/2004125523 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5767+0+0 (secure 0 0 0) 0x7fbcc809b4c0 con 0x7fbcd01452f0 2024-09-17T03:41:44.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.807+0000 7fbccf7fe640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcbc078b90 0x7fbcbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:44.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.807+0000 7fbccf7fe640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcbc078b90 0x7fbcbc07b0a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0033000 tx=0x7fbcd00b7110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:44.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:44.811+0000 7fbcb7fff640 1 -- 172.21.15.146:0/2004125523 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbcc8063950 con 0x7fbcd01452f0 2024-09-17T03:41:45.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.019+0000 7fbcd5da1640 1 -- 172.21.15.146:0/2004125523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcd00b1ae0 con 0x7fbcd01452f0 2024-09-17T03:41:45.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.019+0000 7fbcb7fff640 1 -- 172.21.15.146:0/2004125523 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7fbcd00b1ae0 con 0x7fbcd01452f0 2024-09-17T03:41:45.020 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:45.020 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:45.021 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:45.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 -- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcbc078b90 msgr2=0x7fbcbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcbc078b90 0x7fbcbc07b0a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0033000 tx=0x7fbcd00b7110 comp rx=0 tx=0).stop 2024-09-17T03:41:45.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 -- 172.21.15.146:0/2004125523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd01452f0 msgr2=0x7fbcd0145700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd01452f0 0x7fbcd0145700 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00b8440 tx=0x7fbcc800f3c0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 -- 172.21.15.146:0/2004125523 shutdown_connections 2024-09-17T03:41:45.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcbc078b90 0x7fbcbc07b0a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd01452f0 0x7fbcd0145700 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcd0150e60 0x7fbcd0144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 --2- 172.21.15.146:0/2004125523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcb8003a00 0x7fbcd01f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 -- 172.21.15.146:0/2004125523 >> 172.21.15.146:0/2004125523 conn(0x7fbcd00b7b20 msgr2=0x7fbcd0070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:45.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 -- 172.21.15.146:0/2004125523 shutdown_connections 2024-09-17T03:41:45.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.022+0000 7fbcd5da1640 1 -- 172.21.15.146:0/2004125523 wait complete. 2024-09-17T03:41:45.034 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:41:45.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.146+0000 7f6028e3f640 1 -- 172.21.15.146:0/2012379440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602415b8c0 msgr2=0x7f602406f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.146+0000 7f6028e3f640 1 --2- 172.21.15.146:0/2012379440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602415b8c0 0x7f602406f980 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f60240722c0 tx=0x7f601802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.146+0000 7f6028e3f640 1 -- 172.21.15.146:0/2012379440 shutdown_connections 2024-09-17T03:41:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.146+0000 7f6028e3f640 1 --2- 172.21.15.146:0/2012379440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602415b8c0 0x7f602406f980 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.146+0000 7f6028e3f640 1 --2- 172.21.15.146:0/2012379440 >> v2:172.21.15.179:3300/0 conn(0x7f60240cd990 0x7f6024074740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.146+0000 7f6028e3f640 1 -- 172.21.15.146:0/2012379440 >> 172.21.15.146:0/2012379440 conn(0x7f60240b2950 msgr2=0x7f60240b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.146+0000 7f6028e3f640 1 -- 172.21.15.146:0/2012379440 shutdown_connections 2024-09-17T03:41:45.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.146+0000 7f6028e3f640 1 -- 172.21.15.146:0/2012379440 wait complete. 2024-09-17T03:41:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.148+0000 7f6028e3f640 1 Processor -- start 2024-09-17T03:41:45.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.148+0000 7f6028e3f640 1 -- start start 2024-09-17T03:41:45.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.149+0000 7f6028e3f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602406fec0 0x7f6024151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.149+0000 7f6028e3f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60240cd990 0x7f6024155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.149+0000 7f6028e3f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602415b8c0 0x7f6024156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.149+0000 7f6028e3f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6024073cb0 con 0x7f602406fec0 2024-09-17T03:41:45.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.149+0000 7f6028e3f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6024073b30 con 0x7f60240cd990 2024-09-17T03:41:45.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.149+0000 7f6028e3f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6024072f20 con 0x7f602415b8c0 2024-09-17T03:41:45.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.149+0000 7f602259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602406fec0 0x7f6024151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.149+0000 7f602259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602406fec0 0x7f6024151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54884/0 (socket says 172.21.15.146:54884) 2024-09-17T03:41:45.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.149+0000 7f602259c640 1 -- 172.21.15.146:0/2176278269 learned_addr learned my addr 172.21.15.146:0/2176278269 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.149+0000 7f6021d9b640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60240cd990 0x7f6024155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.149+0000 7f6022d9d640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602415b8c0 0x7f6024156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.150+0000 7f602259c640 1 -- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602415b8c0 msgr2=0x7f6024156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.150+0000 7f602259c640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602415b8c0 0x7f6024156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.150+0000 7f602259c640 1 -- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60240cd990 msgr2=0x7f6024155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.150+0000 7f602259c640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60240cd990 0x7f6024155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.150+0000 7f602259c640 1 -- 172.21.15.146:0/2176278269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60241f3fd0 con 0x7f602406fec0 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.150+0000 7f602259c640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602406fec0 0x7f6024151200 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f601400ea20 tx=0x7f601400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.150+0000 7f6012ffd640 1 -- 172.21.15.146:0/2176278269 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601400cde0 con 0x7f602406fec0 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.150+0000 7f6012ffd640 1 -- 172.21.15.146:0/2176278269 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6014004c10 con 0x7f602406fec0 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.150+0000 7f6028e3f640 1 -- 172.21.15.146:0/2176278269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60241f42b0 con 0x7f602406fec0 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.150+0000 7f6012ffd640 1 -- 172.21.15.146:0/2176278269 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014005020 con 0x7f602406fec0 2024-09-17T03:41:45.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.150+0000 7f6028e3f640 1 -- 172.21.15.146:0/2176278269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60241f6110 con 0x7f602406fec0 2024-09-17T03:41:45.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.151+0000 7f6028e3f640 1 -- 172.21.15.146:0/2176278269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6024151740 con 0x7f602406fec0 2024-09-17T03:41:45.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.152+0000 7f6012ffd640 1 -- 172.21.15.146:0/2176278269 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f60140051c0 con 0x7f602406fec0 2024-09-17T03:41:45.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.152+0000 7f6012ffd640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6004078b90 0x7f600407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.152+0000 7f6012ffd640 1 -- 172.21.15.146:0/2176278269 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5767+0+0 (secure 0 0 0) 0x7f601409b690 con 0x7f602406fec0 2024-09-17T03:41:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.153+0000 7f6021d9b640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6004078b90 0x7f600407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.153+0000 7f6021d9b640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6004078b90 0x7f600407b0a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6018033000 tx=0x7f6018004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:45.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.157+0000 7f6012ffd640 1 -- 172.21.15.146:0/2176278269 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6014016030 con 0x7f602406fec0 2024-09-17T03:41:45.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.333+0000 7f6028e3f640 1 -- 172.21.15.146:0/2176278269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60240b5900 con 0x7f602406fec0 2024-09-17T03:41:45.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.334+0000 7f6012ffd640 1 -- 172.21.15.146:0/2176278269 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+16829 (secure 0 0 0) 0x7f60240b5900 con 0x7f602406fec0 2024-09-17T03:41:45.334 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:45.335 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":132,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:41:43.416587+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:41:01.662178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T03:41:02.986445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.21","mappings":[{"from":2,"to":0}]},{"pgid":"19.22","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:41:45.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.336+0000 7f6028e3f640 1 -- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6004078b90 msgr2=0x7f600407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.336+0000 7f6028e3f640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6004078b90 0x7f600407b0a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6018033000 tx=0x7f6018004730 comp rx=0 tx=0).stop 2024-09-17T03:41:45.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.336+0000 7f6028e3f640 1 -- 172.21.15.146:0/2176278269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602406fec0 msgr2=0x7f6024151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.336+0000 7f6028e3f640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602406fec0 0x7f6024151200 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f601400ea20 tx=0x7f601400eee0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.336+0000 7f6028e3f640 1 -- 172.21.15.146:0/2176278269 shutdown_connections 2024-09-17T03:41:45.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.336+0000 7f6028e3f640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6004078b90 0x7f600407b0a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.336+0000 7f6028e3f640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f602415b8c0 0x7f6024156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.336+0000 7f6028e3f640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f60240cd990 0x7f6024155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.336+0000 7f6028e3f640 1 --2- 172.21.15.146:0/2176278269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f602406fec0 0x7f6024151200 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.336+0000 7f6028e3f640 1 -- 172.21.15.146:0/2176278269 >> 172.21.15.146:0/2176278269 conn(0x7f60240b2950 msgr2=0x7f6024157570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:45.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.337+0000 7f6028e3f640 1 -- 172.21.15.146:0/2176278269 shutdown_connections 2024-09-17T03:41:45.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.337+0000 7f6028e3f640 1 -- 172.21.15.146:0/2176278269 wait complete. 2024-09-17T03:41:45.349 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:41:45.349 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.463+0000 7f85a03c3640 1 -- 172.21.15.146:0/1564943885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85980b5ce0 msgr2=0x7f85980b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.463+0000 7f85a03c3640 1 --2- 172.21.15.146:0/1564943885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85980b5ce0 0x7f85980b1320 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f85980b6120 tx=0x7f859402aac0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.463+0000 7f85a03c3640 1 -- 172.21.15.146:0/1564943885 shutdown_connections 2024-09-17T03:41:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.463+0000 7f85a03c3640 1 --2- 172.21.15.146:0/1564943885 >> v2:172.21.15.179:3300/0 conn(0x7f85980b3d30 0x7f859815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.463+0000 7f85a03c3640 1 --2- 172.21.15.146:0/1564943885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85980b5ce0 0x7f85980b1320 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.463+0000 7f85a03c3640 1 -- 172.21.15.146:0/1564943885 >> 172.21.15.146:0/1564943885 conn(0x7f85980b7b20 msgr2=0x7f859809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.463+0000 7f85a03c3640 1 -- 172.21.15.146:0/1564943885 shutdown_connections 2024-09-17T03:41:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.463+0000 7f85a03c3640 1 -- 172.21.15.146:0/1564943885 wait complete. 2024-09-17T03:41:45.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.465+0000 7f85a03c3640 1 Processor -- start 2024-09-17T03:41:45.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.465+0000 7f85a03c3640 1 -- start start 2024-09-17T03:41:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f85a03c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85980b5750 0x7f8598143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f85a03c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85980b5ce0 0x7f859806eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f85a03c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85981e5650 0x7f859806f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f85a03c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f859815d3a0 con 0x7f85981e5650 2024-09-17T03:41:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f85a03c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f859815d220 con 0x7f85980b5ce0 2024-09-17T03:41:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f85a03c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f859815d520 con 0x7f85980b5750 2024-09-17T03:41:45.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f859e960640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85981e5650 0x7f859806f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f859e960640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85981e5650 0x7f859806f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54906/0 (socket says 172.21.15.146:54906) 2024-09-17T03:41:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f859e960640 1 -- 172.21.15.146:0/1475249777 learned_addr learned my addr 172.21.15.146:0/1475249777 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f859e15f640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85980b5750 0x7f8598143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f859d95e640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85980b5ce0 0x7f859806eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f859e960640 1 -- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85980b5750 msgr2=0x7f8598143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f859e960640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85980b5750 0x7f8598143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f859e960640 1 -- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85980b5ce0 msgr2=0x7f859806eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f859e960640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85980b5ce0 0x7f859806eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.466+0000 7f859e960640 1 -- 172.21.15.146:0/1475249777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859806dee0 con 0x7f85981e5650 2024-09-17T03:41:45.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.467+0000 7f859e960640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85981e5650 0x7f859806f1e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f859000d650 tx=0x7f859000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:45.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.467+0000 7f858effd640 1 -- 172.21.15.146:0/1475249777 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590017070 con 0x7f85981e5650 2024-09-17T03:41:45.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.467+0000 7f858effd640 1 -- 172.21.15.146:0/1475249777 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8590005310 con 0x7f85981e5650 2024-09-17T03:41:45.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.467+0000 7f858effd640 1 -- 172.21.15.146:0/1475249777 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590009820 con 0x7f85981e5650 2024-09-17T03:41:45.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.467+0000 7f85a03c3640 1 -- 172.21.15.146:0/1475249777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859806e1c0 con 0x7f85981e5650 2024-09-17T03:41:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.467+0000 7f85a03c3640 1 -- 172.21.15.146:0/1475249777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859806e780 con 0x7f85981e5650 2024-09-17T03:41:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.468+0000 7f85a03c3640 1 -- 172.21.15.146:0/1475249777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859815ec00 con 0x7f85981e5650 2024-09-17T03:41:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.469+0000 7f858effd640 1 -- 172.21.15.146:0/1475249777 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f85900099c0 con 0x7f85981e5650 2024-09-17T03:41:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.469+0000 7f858effd640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f857c078b90 0x7f857c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.469+0000 7f858effd640 1 -- 172.21.15.146:0/1475249777 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5767+0+0 (secure 0 0 0) 0x7f859009ade0 con 0x7f85981e5650 2024-09-17T03:41:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.469+0000 7f859e15f640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f857c078b90 0x7f857c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.470+0000 7f859e15f640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f857c078b90 0x7f857c07b0a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8594035000 tx=0x7f8594038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.474+0000 7f858effd640 1 -- 172.21.15.146:0/1475249777 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8590062b10 con 0x7f85981e5650 2024-09-17T03:41:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.684+0000 7f85a03c3640 1 -- 172.21.15.146:0/1475249777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8598071160 con 0x7f85981e5650 2024-09-17T03:41:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.684+0000 7f858effd640 1 -- 172.21.15.146:0/1475249777 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7f8590067540 con 0x7f85981e5650 2024-09-17T03:41:45.685 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:45.685 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:45.686 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.686+0000 7f85a03c3640 1 -- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f857c078b90 msgr2=0x7f857c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.686+0000 7f85a03c3640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f857c078b90 0x7f857c07b0a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8594035000 tx=0x7f8594038040 comp rx=0 tx=0).stop 2024-09-17T03:41:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.686+0000 7f85a03c3640 1 -- 172.21.15.146:0/1475249777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85981e5650 msgr2=0x7f859806f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.686+0000 7f85a03c3640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85981e5650 0x7f859806f1e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f859000d650 tx=0x7f859000db10 comp rx=0 tx=0).stop 2024-09-17T03:41:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.686+0000 7f85a03c3640 1 -- 172.21.15.146:0/1475249777 shutdown_connections 2024-09-17T03:41:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.686+0000 7f85a03c3640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f857c078b90 0x7f857c07b0a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.686+0000 7f85a03c3640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85981e5650 0x7f859806f1e0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.686+0000 7f85a03c3640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85980b5ce0 0x7f859806eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.686+0000 7f85a03c3640 1 --2- 172.21.15.146:0/1475249777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85980b5750 0x7f8598143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.686+0000 7f85a03c3640 1 -- 172.21.15.146:0/1475249777 >> 172.21.15.146:0/1475249777 conn(0x7f85980b7b20 msgr2=0x7f859815b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.686+0000 7f85a03c3640 1 -- 172.21.15.146:0/1475249777 shutdown_connections 2024-09-17T03:41:45.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.687+0000 7f85a03c3640 1 -- 172.21.15.146:0/1475249777 wait complete. 2024-09-17T03:41:45.699 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:45.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.812+0000 7efbfcc94640 1 -- 172.21.15.146:0/3080887411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbe0003a00 msgr2=0x7efbe0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.812+0000 7efbfcc94640 1 --2- 172.21.15.146:0/3080887411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbe0003a00 0x7efbe0003e70 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009ed0 tx=0x7efbe0005830 comp rx=0 tx=0).stop 2024-09-17T03:41:45.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.812+0000 7efbf6d9d640 1 -- 172.21.15.146:0/3080887411 reap_dead start 2024-09-17T03:41:45.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.812+0000 7efbfcc94640 1 -- 172.21.15.146:0/3080887411 shutdown_connections 2024-09-17T03:41:45.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.812+0000 7efbfcc94640 1 -- 172.21.15.146:0/3080887411 >> 172.21.15.146:0/3080887411 conn(0x7efbf80d4be0 msgr2=0x7efbf80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:45.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.812+0000 7efbfcc94640 1 -- 172.21.15.146:0/3080887411 shutdown_connections 2024-09-17T03:41:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.812+0000 7efbfcc94640 1 -- 172.21.15.146:0/3080887411 wait complete. 2024-09-17T03:41:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.814+0000 7efbfcc94640 1 Processor -- start 2024-09-17T03:41:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.814+0000 7efbfcc94640 1 -- start start 2024-09-17T03:41:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbfcc94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbe0003a00 0x7efbf8149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbfcc94640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efbf8149ed0 0x7efbf81f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbfcc94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbf81f9d40 0x7efbf81fa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbfcc94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efbf80d3190 con 0x7efbf81f9d40 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbfcc94640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efbf806f650 con 0x7efbe0003a00 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbfcc94640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efbf80d3310 con 0x7efbf8149ed0 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbf6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbf81f9d40 0x7efbf81fa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbf6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbf81f9d40 0x7efbf81fa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54910/0 (socket says 172.21.15.146:54910) 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbf6d9d640 1 -- 172.21.15.146:0/2698962281 learned_addr learned my addr 172.21.15.146:0/2698962281 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbf659c640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbe0003a00 0x7efbf8149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbf5d9b640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efbf8149ed0 0x7efbf81f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbf6d9d640 1 -- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efbf8149ed0 msgr2=0x7efbf81f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbf6d9d640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efbf8149ed0 0x7efbf81f9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbf6d9d640 1 -- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbe0003a00 msgr2=0x7efbf8149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbf6d9d640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbe0003a00 0x7efbf8149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.815+0000 7efbf6d9d640 1 -- 172.21.15.146:0/2698962281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf81611a0 con 0x7efbf81f9d40 2024-09-17T03:41:45.817 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.816+0000 7efbf6d9d640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbf81f9d40 0x7efbf81fa150 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7efbf80b7850 tx=0x7efbf0011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.816+0000 7efbe6ffd640 1 -- 172.21.15.146:0/2698962281 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf001f070 con 0x7efbf81f9d40 2024-09-17T03:41:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.816+0000 7efbe6ffd640 1 -- 172.21.15.146:0/2698962281 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efbf000fb40 con 0x7efbf81f9d40 2024-09-17T03:41:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.816+0000 7efbfcc94640 1 -- 172.21.15.146:0/2698962281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbf815e770 con 0x7efbf81f9d40 2024-09-17T03:41:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.816+0000 7efbe6ffd640 1 -- 172.21.15.146:0/2698962281 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0012450 con 0x7efbf81f9d40 2024-09-17T03:41:45.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.816+0000 7efbfcc94640 1 -- 172.21.15.146:0/2698962281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbf80c8500 con 0x7efbf81f9d40 2024-09-17T03:41:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.817+0000 7efbfcc94640 1 -- 172.21.15.146:0/2698962281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbf80cf370 con 0x7efbf81f9d40 2024-09-17T03:41:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.818+0000 7efbe6ffd640 1 -- 172.21.15.146:0/2698962281 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efbf0022070 con 0x7efbf81f9d40 2024-09-17T03:41:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.818+0000 7efbe6ffd640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efbd8078bc0 0x7efbd807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.818+0000 7efbe6ffd640 1 -- 172.21.15.146:0/2698962281 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5767+0+0 (secure 0 0 0) 0x7efbf009b750 con 0x7efbf81f9d40 2024-09-17T03:41:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.819+0000 7efbf659c640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efbd8078bc0 0x7efbd807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:45.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.819+0000 7efbf659c640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efbd8078bc0 0x7efbd807b0d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7efbe8035000 tx=0x7efbe8004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:45.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:45.823+0000 7efbe6ffd640 1 -- 172.21.15.146:0/2698962281 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efbf0063be0 con 0x7efbf81f9d40 2024-09-17T03:41:46.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.033+0000 7efbfcc94640 1 -- 172.21.15.146:0/2698962281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efbf80b4450 con 0x7efbf81f9d40 2024-09-17T03:41:46.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.033+0000 7efbe6ffd640 1 -- 172.21.15.146:0/2698962281 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5234 (secure 0 0 0) 0x7efbf00634e0 con 0x7efbf81f9d40 2024-09-17T03:41:46.034 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:46.034 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"btime":"2024-09-17T03:41:07:678057+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:04.022718+0000","modified":"2024-09-17T03:41:07.049751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8658},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8658":{"gid":8658,"name":"c","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/141241275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":141241275},{"type":"v1","addr":"172.21.15.146:6834","nonce":141241275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8658,"qdb_cluster":[8658]},"id":9}]} 2024-09-17T03:41:46.034 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2024-09-17T03:41:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 -- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efbd8078bc0 msgr2=0x7efbd807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efbd8078bc0 0x7efbd807b0d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7efbe8035000 tx=0x7efbe8004a40 comp rx=0 tx=0).stop 2024-09-17T03:41:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 -- 172.21.15.146:0/2698962281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbf81f9d40 msgr2=0x7efbf81fa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbf81f9d40 0x7efbf81fa150 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7efbf80b7850 tx=0x7efbf0011b10 comp rx=0 tx=0).stop 2024-09-17T03:41:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 -- 172.21.15.146:0/2698962281 shutdown_connections 2024-09-17T03:41:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efbd8078bc0 0x7efbd807b0d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbf81f9d40 0x7efbf81fa150 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efbf8149ed0 0x7efbf81f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 --2- 172.21.15.146:0/2698962281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbe0003a00 0x7efbf8149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 -- 172.21.15.146:0/2698962281 >> 172.21.15.146:0/2698962281 conn(0x7efbf80d4be0 msgr2=0x7efbf80b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 -- 172.21.15.146:0/2698962281 shutdown_connections 2024-09-17T03:41:46.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.036+0000 7efbfcc94640 1 -- 172.21.15.146:0/2698962281 wait complete. 2024-09-17T03:41:46.048 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:41:46.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.160+0000 7f2727fda640 1 -- 172.21.15.146:0/1943442285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272006d360 msgr2=0x7f27200cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.160+0000 7f2727fda640 1 --2- 172.21.15.146:0/1943442285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272006d360 0x7f27200cf650 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f2710009830 tx=0x7f271002a510 comp rx=0 tx=0).stop 2024-09-17T03:41:46.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.160+0000 7f2727fda640 1 -- 172.21.15.146:0/1943442285 shutdown_connections 2024-09-17T03:41:46.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.160+0000 7f2727fda640 1 --2- 172.21.15.146:0/1943442285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f272006d360 0x7f27200cf650 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.160+0000 7f2727fda640 1 -- 172.21.15.146:0/1943442285 >> 172.21.15.146:0/1943442285 conn(0x7f27200b3150 msgr2=0x7f27200b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:46.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.160+0000 7f2727fda640 1 -- 172.21.15.146:0/1943442285 shutdown_connections 2024-09-17T03:41:46.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.160+0000 7f2727fda640 1 -- 172.21.15.146:0/1943442285 wait complete. 2024-09-17T03:41:46.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.162+0000 7f2727fda640 1 Processor -- start 2024-09-17T03:41:46.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.162+0000 7f2727fda640 1 -- start start 2024-09-17T03:41:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.163+0000 7f2727fda640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720145ce0 0x7f2720142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.163+0000 7f2727fda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2720146230 0x7f27201f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.163+0000 7f2727fda640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f272015f1b0 0x7f272015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.163+0000 7f2727fda640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f27200d0630 con 0x7f2720145ce0 2024-09-17T03:41:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.163+0000 7f2727fda640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f27200d04b0 con 0x7f2720146230 2024-09-17T03:41:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.163+0000 7f2727fda640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f27200d07b0 con 0x7f272015f1b0 2024-09-17T03:41:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.163+0000 7f2725d76640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720145ce0 0x7f2720142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.163+0000 7f2725d76640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720145ce0 0x7f2720142770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54926/0 (socket says 172.21.15.146:54926) 2024-09-17T03:41:46.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.163+0000 7f2725d76640 1 -- 172.21.15.146:0/888340857 learned_addr learned my addr 172.21.15.146:0/888340857 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:46.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.163+0000 7f2725575640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2720146230 0x7f27201f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.163+0000 7f2726577640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f272015f1b0 0x7f272015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.164+0000 7f2725d76640 1 -- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f272015f1b0 msgr2=0x7f272015f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.164+0000 7f2725d76640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f272015f1b0 0x7f272015f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.164+0000 7f2725d76640 1 -- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2720146230 msgr2=0x7f27201f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.164+0000 7f2725d76640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2720146230 0x7f27201f7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.164+0000 7f2725d76640 1 -- 172.21.15.146:0/888340857 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272015fb00 con 0x7f2720145ce0 2024-09-17T03:41:46.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.164+0000 7f2725d76640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720145ce0 0x7f2720142770 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c3a0 tx=0x7f271c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:46.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.164+0000 7f27167fc640 1 -- 172.21.15.146:0/888340857 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c011790 con 0x7f2720145ce0 2024-09-17T03:41:46.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.164+0000 7f27167fc640 1 -- 172.21.15.146:0/888340857 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f271c017070 con 0x7f2720145ce0 2024-09-17T03:41:46.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.164+0000 7f27167fc640 1 -- 172.21.15.146:0/888340857 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c011cc0 con 0x7f2720145ce0 2024-09-17T03:41:46.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.164+0000 7f2727fda640 1 -- 172.21.15.146:0/888340857 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27201f78a0 con 0x7f2720145ce0 2024-09-17T03:41:46.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.164+0000 7f2727fda640 1 -- 172.21.15.146:0/888340857 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27201f3a10 con 0x7f2720145ce0 2024-09-17T03:41:46.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.165+0000 7f2727fda640 1 -- 172.21.15.146:0/888340857 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f272006cc50 con 0x7f2720145ce0 2024-09-17T03:41:46.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.166+0000 7f27167fc640 1 -- 172.21.15.146:0/888340857 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f271c01c460 con 0x7f2720145ce0 2024-09-17T03:41:46.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.166+0000 7f27167fc640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2704078b90 0x7f270407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.167+0000 7f27167fc640 1 -- 172.21.15.146:0/888340857 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5767+0+0 (secure 0 0 0) 0x7f271c09a960 con 0x7f2720145ce0 2024-09-17T03:41:46.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.167+0000 7f2725575640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2704078b90 0x7f270407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.167+0000 7f2725575640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2704078b90 0x7f270407b0a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2710034000 tx=0x7f2710004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:46.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.171+0000 7f27167fc640 1 -- 172.21.15.146:0/888340857 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f272015fb00 con 0x7f2720145ce0 2024-09-17T03:41:46.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.348+0000 7f2727fda640 1 -- 172.21.15.146:0/888340857 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27200cdc50 con 0x7f2720145ce0 2024-09-17T03:41:46.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.349+0000 7f27167fc640 1 -- 172.21.15.146:0/888340857 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+16829 (secure 0 0 0) 0x7f271c062830 con 0x7f2720145ce0 2024-09-17T03:41:46.349 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:46.349 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":132,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:41:43.416587+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:41:01.662178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T03:41:02.986445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.21","mappings":[{"from":2,"to":0}]},{"pgid":"19.22","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:41:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 -- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2704078b90 msgr2=0x7f270407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2704078b90 0x7f270407b0a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2710034000 tx=0x7f2710004730 comp rx=0 tx=0).stop 2024-09-17T03:41:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 -- 172.21.15.146:0/888340857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720145ce0 msgr2=0x7f2720142770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720145ce0 0x7f2720142770 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c3a0 tx=0x7f271c00c860 comp rx=0 tx=0).stop 2024-09-17T03:41:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 -- 172.21.15.146:0/888340857 shutdown_connections 2024-09-17T03:41:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2704078b90 0x7f270407b0a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f272015f1b0 0x7f272015f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2720146230 0x7f27201f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 --2- 172.21.15.146:0/888340857 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720145ce0 0x7f2720142770 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 -- 172.21.15.146:0/888340857 >> 172.21.15.146:0/888340857 conn(0x7f27200b3150 msgr2=0x7f27201455a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:46.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 -- 172.21.15.146:0/888340857 shutdown_connections 2024-09-17T03:41:46.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.351+0000 7f2727fda640 1 -- 172.21.15.146:0/888340857 wait complete. 2024-09-17T03:41:46.363 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:41:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.478+0000 7fb6df464640 1 -- 172.21.15.146:0/2869054494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6d80cdc50 msgr2=0x7fb6d80b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.478+0000 7fb6df464640 1 --2- 172.21.15.146:0/2869054494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6d80cdc50 0x7fb6d80b4ba0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009830 tx=0x7fb6d002a480 comp rx=0 tx=0).stop 2024-09-17T03:41:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.478+0000 7fb6df464640 1 -- 172.21.15.146:0/2869054494 shutdown_connections 2024-09-17T03:41:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.478+0000 7fb6df464640 1 --2- 172.21.15.146:0/2869054494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6d80cdc50 0x7fb6d80b4ba0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.478+0000 7fb6df464640 1 --2- 172.21.15.146:0/2869054494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6d80cd840 0x7fb6d80b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.478+0000 7fb6df464640 1 -- 172.21.15.146:0/2869054494 >> 172.21.15.146:0/2869054494 conn(0x7fb6d80b3150 msgr2=0x7fb6d80b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.478+0000 7fb6df464640 1 -- 172.21.15.146:0/2869054494 shutdown_connections 2024-09-17T03:41:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.478+0000 7fb6df464640 1 -- 172.21.15.146:0/2869054494 wait complete. 2024-09-17T03:41:46.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.480+0000 7fb6df464640 1 Processor -- start 2024-09-17T03:41:46.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.480+0000 7fb6df464640 1 -- start start 2024-09-17T03:41:46.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.481+0000 7fb6df464640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6d80cd840 0x7fb6d8151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.481+0000 7fb6df464640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6d80cdc50 0x7fb6d8154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6df464640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d815c8e0 0x7fb6d815b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6df464640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d8073580 con 0x7fb6d80cdc50 2024-09-17T03:41:46.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6df464640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d80b5400 con 0x7fb6d815c8e0 2024-09-17T03:41:46.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6df464640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d8073700 con 0x7fb6d80cd840 2024-09-17T03:41:46.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6dc9ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6d80cdc50 0x7fb6d8154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6dc9ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6d80cdc50 0x7fb6d8154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54942/0 (socket says 172.21.15.146:54942) 2024-09-17T03:41:46.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6dc9ff640 1 -- 172.21.15.146:0/2195414373 learned_addr learned my addr 172.21.15.146:0/2195414373 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:46.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6dd200640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6d80cd840 0x7fb6d8151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6dda01640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d815c8e0 0x7fb6d815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6dc9ff640 1 -- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6d80cd840 msgr2=0x7fb6d8151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6dc9ff640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6d80cd840 0x7fb6d8151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6dc9ff640 1 -- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d815c8e0 msgr2=0x7fb6d815b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6dc9ff640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d815c8e0 0x7fb6d815b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6dc9ff640 1 -- 172.21.15.146:0/2195414373 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d8152950 con 0x7fb6d80cdc50 2024-09-17T03:41:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6dc9ff640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6d80cdc50 0x7fb6d8154560 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00d6d0 tx=0x7fb6cc00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6d5ffb640 1 -- 172.21.15.146:0/2195414373 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc017070 con 0x7fb6d80cdc50 2024-09-17T03:41:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6d5ffb640 1 -- 172.21.15.146:0/2195414373 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6cc004310 con 0x7fb6d80cdc50 2024-09-17T03:41:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6df464640 1 -- 172.21.15.146:0/2195414373 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d814bbb0 con 0x7fb6d80cdc50 2024-09-17T03:41:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6d5ffb640 1 -- 172.21.15.146:0/2195414373 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc009a80 con 0x7fb6d80cdc50 2024-09-17T03:41:46.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.482+0000 7fb6df464640 1 -- 172.21.15.146:0/2195414373 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d814c170 con 0x7fb6d80cdc50 2024-09-17T03:41:46.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.484+0000 7fb6df464640 1 -- 172.21.15.146:0/2195414373 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d81526c0 con 0x7fb6d80cdc50 2024-09-17T03:41:46.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.484+0000 7fb6d5ffb640 1 -- 172.21.15.146:0/2195414373 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6cc009c20 con 0x7fb6d80cdc50 2024-09-17T03:41:46.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.485+0000 7fb6d5ffb640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb6c4078b90 0x7fb6c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.485+0000 7fb6d5ffb640 1 -- 172.21.15.146:0/2195414373 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5767+0+0 (secure 0 0 0) 0x7fb6cc09ad90 con 0x7fb6d80cdc50 2024-09-17T03:41:46.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.485+0000 7fb6dd200640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb6c4078b90 0x7fb6c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.485+0000 7fb6dd200640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb6c4078b90 0x7fb6c407b0a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80020f0 tx=0x7fb6c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:46.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.489+0000 7fb6d5ffb640 1 -- 172.21.15.146:0/2195414373 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6cc063220 con 0x7fb6d80cdc50 2024-09-17T03:41:46.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.697+0000 7fb6df464640 1 -- 172.21.15.146:0/2195414373 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb6d8051010 con 0x7fb6d80cdc50 2024-09-17T03:41:46.698 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:41:46.698+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:41:46.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.700+0000 7fb6d5ffb640 1 -- 172.21.15.146:0/2195414373 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v96) ==== 161+0+0 (secure 0 0 0) 0x7fb6d8051010 con 0x7fb6d80cdc50 2024-09-17T03:41:46.701 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:41:46.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 -- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb6c4078b90 msgr2=0x7fb6c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb6c4078b90 0x7fb6c407b0a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80020f0 tx=0x7fb6c8009040 comp rx=0 tx=0).stop 2024-09-17T03:41:46.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 -- 172.21.15.146:0/2195414373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6d80cdc50 msgr2=0x7fb6d8154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6d80cdc50 0x7fb6d8154560 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00d6d0 tx=0x7fb6cc00db90 comp rx=0 tx=0).stop 2024-09-17T03:41:46.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 -- 172.21.15.146:0/2195414373 shutdown_connections 2024-09-17T03:41:46.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb6c4078b90 0x7fb6c407b0a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6d815c8e0 0x7fb6d815b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6d80cdc50 0x7fb6d8154560 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 --2- 172.21.15.146:0/2195414373 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6d80cd840 0x7fb6d8151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 -- 172.21.15.146:0/2195414373 >> 172.21.15.146:0/2195414373 conn(0x7fb6d80b3150 msgr2=0x7fb6d80b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:46.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 -- 172.21.15.146:0/2195414373 shutdown_connections 2024-09-17T03:41:46.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.703+0000 7fb6df464640 1 -- 172.21.15.146:0/2195414373 wait complete. 2024-09-17T03:41:46.717 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:41:46.767 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:41:46.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.835+0000 7f23c87eb640 1 -- 172.21.15.146:0/1754524134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c00b5750 msgr2=0x7f23c00b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.835+0000 7f23c87eb640 1 --2- 172.21.15.146:0/1754524134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c00b5750 0x7f23c00b3620 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009830 tx=0x7f23b002a510 comp rx=0 tx=0).stop 2024-09-17T03:41:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.835+0000 7f23c87eb640 1 -- 172.21.15.146:0/1754524134 shutdown_connections 2024-09-17T03:41:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.835+0000 7f23c87eb640 1 --2- 172.21.15.146:0/1754524134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c00b5750 0x7f23c00b3620 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.835+0000 7f23c87eb640 1 --2- 172.21.15.146:0/1754524134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c00b5ce0 0x7f23c00b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.835+0000 7f23c87eb640 1 -- 172.21.15.146:0/1754524134 >> 172.21.15.146:0/1754524134 conn(0x7f23c00b7b20 msgr2=0x7f23c009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.835+0000 7f23c87eb640 1 -- 172.21.15.146:0/1754524134 shutdown_connections 2024-09-17T03:41:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.835+0000 7f23c87eb640 1 -- 172.21.15.146:0/1754524134 wait complete. 2024-09-17T03:41:46.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.837+0000 7f23c87eb640 1 Processor -- start 2024-09-17T03:41:46.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.837+0000 7f23c87eb640 1 -- start start 2024-09-17T03:41:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.838+0000 7f23c87eb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c00b3b60 0x7f23c014b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.838+0000 7f23c87eb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c00b5750 0x7f23c0145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.838+0000 7f23c87eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c00b5ce0 0x7f23c0145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.838+0000 7f23c87eb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f23c00b27b0 con 0x7f23c00b5ce0 2024-09-17T03:41:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.838+0000 7f23c87eb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f23c015dd00 con 0x7f23c00b5750 2024-09-17T03:41:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.838+0000 7f23c87eb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f23c00b2930 con 0x7f23c00b3b60 2024-09-17T03:41:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.838+0000 7f23c6d88640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c00b5ce0 0x7f23c0145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.838+0000 7f23c6d88640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c00b5ce0 0x7f23c0145e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54976/0 (socket says 172.21.15.146:54976) 2024-09-17T03:41:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.838+0000 7f23c6d88640 1 -- 172.21.15.146:0/2654186327 learned_addr learned my addr 172.21.15.146:0/2654186327 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23c6587640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c00b3b60 0x7f23c014b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23c5d86640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c00b5750 0x7f23c0145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23c6d88640 1 -- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c00b3b60 msgr2=0x7f23c014b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23c6d88640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c00b3b60 0x7f23c014b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23c6d88640 1 -- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c00b5750 msgr2=0x7f23c0145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23c6d88640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c00b5750 0x7f23c0145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23c6d88640 1 -- 172.21.15.146:0/2654186327 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c014b760 con 0x7f23c00b5ce0 2024-09-17T03:41:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23c6d88640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c00b5ce0 0x7f23c0145e40 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f23b800c760 tx=0x7f23b800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23b6ffd640 1 -- 172.21.15.146:0/2654186327 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8017070 con 0x7f23c00b5ce0 2024-09-17T03:41:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23b6ffd640 1 -- 172.21.15.146:0/2654186327 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23b800ce10 con 0x7f23c00b5ce0 2024-09-17T03:41:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23b6ffd640 1 -- 172.21.15.146:0/2654186327 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b80052b0 con 0x7f23c00b5ce0 2024-09-17T03:41:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23c87eb640 1 -- 172.21.15.146:0/2654186327 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c0146380 con 0x7f23c00b5ce0 2024-09-17T03:41:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.839+0000 7f23c87eb640 1 -- 172.21.15.146:0/2654186327 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c009f010 con 0x7f23c00b5ce0 2024-09-17T03:41:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.840+0000 7f23c87eb640 1 -- 172.21.15.146:0/2654186327 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c009eaa0 con 0x7f23c00b5ce0 2024-09-17T03:41:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.841+0000 7f23b6ffd640 1 -- 172.21.15.146:0/2654186327 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23b801a070 con 0x7f23c00b5ce0 2024-09-17T03:41:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.841+0000 7f23b6ffd640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23a4078b90 0x7f23a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.842+0000 7f23b6ffd640 1 -- 172.21.15.146:0/2654186327 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5853+0+0 (secure 0 0 0) 0x7f23b809a390 con 0x7f23c00b5ce0 2024-09-17T03:41:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.842+0000 7f23c6587640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23a4078b90 0x7f23a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.842+0000 7f23c6587640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23a4078b90 0x7f23a407b0a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00bb50 tx=0x7f23bc00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:46.846+0000 7f23b6ffd640 1 -- 172.21.15.146:0/2654186327 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f23c00b3f70 con 0x7f23c00b5ce0 2024-09-17T03:41:47.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.057+0000 7f23c87eb640 1 -- 172.21.15.146:0/2654186327 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f23c01f3920 con 0x7f23c00b5ce0 2024-09-17T03:41:47.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.703+0000 7f23b6ffd640 1 -- 172.21.15.146:0/2654186327 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v97) ==== 104+0+0 (secure 0 0 0) 0x7f23b8062180 con 0x7f23c00b5ce0 2024-09-17T03:41:47.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 -- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23a4078b90 msgr2=0x7f23a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:47.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23a4078b90 0x7f23a407b0a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00bb50 tx=0x7f23bc00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 -- 172.21.15.146:0/2654186327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c00b5ce0 msgr2=0x7f23c0145e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:47.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c00b5ce0 0x7f23c0145e40 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f23b800c760 tx=0x7f23b800cc20 comp rx=0 tx=0).stop 2024-09-17T03:41:47.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 -- 172.21.15.146:0/2654186327 shutdown_connections 2024-09-17T03:41:47.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f23a4078b90 0x7f23a407b0a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c00b5ce0 0x7f23c0145e40 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f23c00b5750 0x7f23c0145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 --2- 172.21.15.146:0/2654186327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f23c00b3b60 0x7f23c014b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 -- 172.21.15.146:0/2654186327 >> 172.21.15.146:0/2654186327 conn(0x7f23c00b7b20 msgr2=0x7f23c00b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:47.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 -- 172.21.15.146:0/2654186327 shutdown_connections 2024-09-17T03:41:47.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.707+0000 7f23c87eb640 1 -- 172.21.15.146:0/2654186327 wait complete. 2024-09-17T03:41:47.721 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:41:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.842+0000 7f752140e640 1 -- 172.21.15.146:0/2130745720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c0b4a70 msgr2=0x7f751c06dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.842+0000 7f752140e640 1 --2- 172.21.15.146:0/2130745720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c0b4a70 0x7f751c06dd60 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f751c074730 tx=0x7f751402a560 comp rx=0 tx=0).stop 2024-09-17T03:41:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.842+0000 7f752140e640 1 -- 172.21.15.146:0/2130745720 shutdown_connections 2024-09-17T03:41:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.842+0000 7f752140e640 1 --2- 172.21.15.146:0/2130745720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c0b4a70 0x7f751c06dd60 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.842+0000 7f752140e640 1 --2- 172.21.15.146:0/2130745720 >> v2:172.21.15.179:3300/0 conn(0x7f751c071120 0x7f751c0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.842+0000 7f752140e640 1 --2- 172.21.15.146:0/2130745720 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c0b55f0 0x7f751c070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.842+0000 7f752140e640 1 -- 172.21.15.146:0/2130745720 >> 172.21.15.146:0/2130745720 conn(0x7f751c0b3410 msgr2=0x7f751c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.842+0000 7f752140e640 1 -- 172.21.15.146:0/2130745720 shutdown_connections 2024-09-17T03:41:47.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.842+0000 7f752140e640 1 -- 172.21.15.146:0/2130745720 wait complete. 2024-09-17T03:41:47.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.844+0000 7f752140e640 1 Processor -- start 2024-09-17T03:41:47.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.844+0000 7f752140e640 1 -- start start 2024-09-17T03:41:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.845+0000 7f752140e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c071120 0x7f751c1e6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.845+0000 7f752140e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c0b4a70 0x7f751c140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.845+0000 7f752140e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f751c0b55f0 0x7f751c140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.845+0000 7f752140e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f751c06e630 con 0x7f751c0b4a70 2024-09-17T03:41:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.845+0000 7f752140e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f751c06e4b0 con 0x7f751c0b55f0 2024-09-17T03:41:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.845+0000 7f752140e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f751c15bd10 con 0x7f751c071120 2024-09-17T03:41:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.845+0000 7f751a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c0b4a70 0x7f751c140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.845+0000 7f751a7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c0b4a70 0x7f751c140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35794/0 (socket says 172.21.15.146:35794) 2024-09-17T03:41:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.845+0000 7f751a7fc640 1 -- 172.21.15.146:0/1642991240 learned_addr learned my addr 172.21.15.146:0/1642991240 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f751b7fe640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f751c0b55f0 0x7f751c140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:47.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f751affd640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c071120 0x7f751c1e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:47.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f751a7fc640 1 -- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c071120 msgr2=0x7f751c1e6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:47.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f751a7fc640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c071120 0x7f751c1e6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f751a7fc640 1 -- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f751c0b55f0 msgr2=0x7f751c140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:47.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f751a7fc640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f751c0b55f0 0x7f751c140fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:47.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f751a7fc640 1 -- 172.21.15.146:0/1642991240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c13ec30 con 0x7f751c0b4a70 2024-09-17T03:41:47.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f751b7fe640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f751c0b55f0 0x7f751c140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:47.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f751a7fc640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c0b4a70 0x7f751c140a70 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f750400e7c0 tx=0x7f750400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:47.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f75137fe640 1 -- 172.21.15.146:0/1642991240 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750400ccc0 con 0x7f751c0b4a70 2024-09-17T03:41:47.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f75137fe640 1 -- 172.21.15.146:0/1642991240 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f750400ee70 con 0x7f751c0b4a70 2024-09-17T03:41:47.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f752140e640 1 -- 172.21.15.146:0/1642991240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751c13ef10 con 0x7f751c0b4a70 2024-09-17T03:41:47.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f75137fe640 1 -- 172.21.15.146:0/1642991240 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504010690 con 0x7f751c0b4a70 2024-09-17T03:41:47.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.846+0000 7f752140e640 1 -- 172.21.15.146:0/1642991240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751c1e7450 con 0x7f751c0b4a70 2024-09-17T03:41:47.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.847+0000 7f752140e640 1 -- 172.21.15.146:0/1642991240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751c141880 con 0x7f751c0b4a70 2024-09-17T03:41:47.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.848+0000 7f75137fe640 1 -- 172.21.15.146:0/1642991240 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7504010830 con 0x7f751c0b4a70 2024-09-17T03:41:47.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.848+0000 7f75137fe640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74fc078bc0 0x7f74fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:47.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.848+0000 7f75137fe640 1 -- 172.21.15.146:0/1642991240 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5853+0+0 (secure 0 0 0) 0x7f750409b6f0 con 0x7f751c0b4a70 2024-09-17T03:41:47.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.848+0000 7f751affd640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74fc078bc0 0x7f74fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:47.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.849+0000 7f751affd640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74fc078bc0 0x7f74fc07b0d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f750c005fd0 tx=0x7f750c009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:47.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:47.853+0000 7f75137fe640 1 -- 172.21.15.146:0/1642991240 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7504063b40 con 0x7f751c0b4a70 2024-09-17T03:41:48.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.032+0000 7f752140e640 1 -- 172.21.15.146:0/1642991240 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f751c06dd60 con 0x7f751c0b4a70 2024-09-17T03:41:48.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.710+0000 7f75137fe640 1 -- 172.21.15.146:0/1642991240 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v134) ==== 181+0+0 (secure 0 0 0) 0x7f7504063440 con 0x7f751c0b4a70 2024-09-17T03:41:48.710 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:41:48.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 -- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74fc078bc0 msgr2=0x7f74fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:48.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74fc078bc0 0x7f74fc07b0d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f750c005fd0 tx=0x7f750c009500 comp rx=0 tx=0).stop 2024-09-17T03:41:48.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 -- 172.21.15.146:0/1642991240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c0b4a70 msgr2=0x7f751c140a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:48.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c0b4a70 0x7f751c140a70 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f750400e7c0 tx=0x7f750400ec80 comp rx=0 tx=0).stop 2024-09-17T03:41:48.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 -- 172.21.15.146:0/1642991240 shutdown_connections 2024-09-17T03:41:48.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74fc078bc0 0x7f74fc07b0d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:48.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f751c0b55f0 0x7f751c140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:48.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c0b4a70 0x7f751c140a70 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:48.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 --2- 172.21.15.146:0/1642991240 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f751c071120 0x7f751c1e6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:48.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 -- 172.21.15.146:0/1642991240 >> 172.21.15.146:0/1642991240 conn(0x7f751c0b3410 msgr2=0x7f751c15f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:48.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 -- 172.21.15.146:0/1642991240 shutdown_connections 2024-09-17T03:41:48.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.712+0000 7f752140e640 1 -- 172.21.15.146:0/1642991240 wait complete. 2024-09-17T03:41:48.728 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:41:48.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.848+0000 7ff97aa9b640 1 -- 172.21.15.146:0/4051856422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9740d0710 msgr2=0x7ff9740cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:48.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.848+0000 7ff97aa9b640 1 --2- 172.21.15.146:0/4051856422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9740d0710 0x7ff9740cf170 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7ff9740743d0 tx=0x7ff96402a4f0 comp rx=0 tx=0).stop 2024-09-17T03:41:48.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.848+0000 7ff97aa9b640 1 -- 172.21.15.146:0/4051856422 shutdown_connections 2024-09-17T03:41:48.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.848+0000 7ff97aa9b640 1 --2- 172.21.15.146:0/4051856422 >> v2:172.21.15.179:3300/0 conn(0x7ff9740b47c0 0x7ff974161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:48.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.848+0000 7ff97aa9b640 1 --2- 172.21.15.146:0/4051856422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9740cf6b0 0x7ff974161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:48.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.848+0000 7ff97aa9b640 1 --2- 172.21.15.146:0/4051856422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9740d0710 0x7ff9740cf170 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:48.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.848+0000 7ff97aa9b640 1 -- 172.21.15.146:0/4051856422 >> 172.21.15.146:0/4051856422 conn(0x7ff97409ba20 msgr2=0x7ff9740b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:48.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.848+0000 7ff97aa9b640 1 -- 172.21.15.146:0/4051856422 shutdown_connections 2024-09-17T03:41:48.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.848+0000 7ff97aa9b640 1 -- 172.21.15.146:0/4051856422 wait complete. 2024-09-17T03:41:48.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.850+0000 7ff97aa9b640 1 Processor -- start 2024-09-17T03:41:48.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.850+0000 7ff97aa9b640 1 -- start start 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.851+0000 7ff97aa9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9740b47c0 0x7ff9741f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.851+0000 7ff97aa9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9740cf6b0 0x7ff9740c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.851+0000 7ff97aa9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9740d0710 0x7ff9740af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.851+0000 7ff97aa9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff974162030 con 0x7ff9740d0710 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.851+0000 7ff97aa9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff974161eb0 con 0x7ff9740b47c0 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.851+0000 7ff97aa9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff9740cd090 con 0x7ff9740cf6b0 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.851+0000 7ff979038640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9740d0710 0x7ff9740af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff979038640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9740d0710 0x7ff9740af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35820/0 (socket says 172.21.15.146:35820) 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff979038640 1 -- 172.21.15.146:0/2075561324 learned_addr learned my addr 172.21.15.146:0/2075561324 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff973fff640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9740cf6b0 0x7ff9740c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff978837640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9740b47c0 0x7ff9741f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:48.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff979038640 1 -- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9740cf6b0 msgr2=0x7ff9740c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff979038640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9740cf6b0 0x7ff9740c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff979038640 1 -- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9740b47c0 msgr2=0x7ff9741f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff979038640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9740b47c0 0x7ff9741f7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff979038640 1 -- 172.21.15.146:0/2075561324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9741f8250 con 0x7ff9740d0710 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff973fff640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9740cf6b0 0x7ff9740c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff978837640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9740b47c0 0x7ff9741f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff979038640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9740d0710 0x7ff9740af540 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00d690 tx=0x7ff96c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff9717fa640 1 -- 172.21.15.146:0/2075561324 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c017070 con 0x7ff9740d0710 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff9717fa640 1 -- 172.21.15.146:0/2075561324 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff96c005310 con 0x7ff9740d0710 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff97aa9b640 1 -- 172.21.15.146:0/2075561324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9741f3dc0 con 0x7ff9740d0710 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff9717fa640 1 -- 172.21.15.146:0/2075561324 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0047a0 con 0x7ff9740d0710 2024-09-17T03:41:48.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.852+0000 7ff97aa9b640 1 -- 172.21.15.146:0/2075561324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9741f4360 con 0x7ff9740d0710 2024-09-17T03:41:48.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.853+0000 7ff97aa9b640 1 -- 172.21.15.146:0/2075561324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9741f4d00 con 0x7ff9740d0710 2024-09-17T03:41:48.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.854+0000 7ff9717fa640 1 -- 172.21.15.146:0/2075561324 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff96c004940 con 0x7ff9740d0710 2024-09-17T03:41:48.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.854+0000 7ff9717fa640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff960078b90 0x7ff96007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:48.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.855+0000 7ff9717fa640 1 -- 172.21.15.146:0/2075561324 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5415+0+0 (secure 0 0 0) 0x7ff96c09aca0 con 0x7ff9740d0710 2024-09-17T03:41:48.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.855+0000 7ff978837640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff960078b90 0x7ff96007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:48.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.855+0000 7ff978837640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff960078b90 0x7ff96007b0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff964033000 tx=0x7ff964004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:48.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:48.859+0000 7ff9717fa640 1 -- 172.21.15.146:0/2075561324 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff9741f4d00 con 0x7ff9740d0710 2024-09-17T03:41:49.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.034+0000 7ff97aa9b640 1 -- 172.21.15.146:0/2075561324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff9740cc9b0 con 0x7ff9740d0710 2024-09-17T03:41:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.715+0000 7ff9717fa640 1 -- 172.21.15.146:0/2075561324 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v135) ==== 169+0+0 (secure 0 0 0) 0x7ff9740cc9b0 con 0x7ff9740d0710 2024-09-17T03:41:49.715 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:41:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 -- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff960078b90 msgr2=0x7ff96007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff960078b90 0x7ff96007b0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff964033000 tx=0x7ff964004730 comp rx=0 tx=0).stop 2024-09-17T03:41:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 -- 172.21.15.146:0/2075561324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9740d0710 msgr2=0x7ff9740af540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9740d0710 0x7ff9740af540 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00d690 tx=0x7ff96c00da90 comp rx=0 tx=0).stop 2024-09-17T03:41:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 -- 172.21.15.146:0/2075561324 shutdown_connections 2024-09-17T03:41:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff960078b90 0x7ff96007b0a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9740d0710 0x7ff9740af540 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff9740cf6b0 0x7ff9740c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 --2- 172.21.15.146:0/2075561324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9740b47c0 0x7ff9741f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 -- 172.21.15.146:0/2075561324 >> 172.21.15.146:0/2075561324 conn(0x7ff97409ba20 msgr2=0x7ff9740cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 -- 172.21.15.146:0/2075561324 shutdown_connections 2024-09-17T03:41:49.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.717+0000 7ff97aa9b640 1 -- 172.21.15.146:0/2075561324 wait complete. 2024-09-17T03:41:49.741 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:41:49.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.885+0000 7f091e240640 1 -- 172.21.15.146:0/2851211452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09180b55f0 msgr2=0x7f0918070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:49.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.885+0000 7f091e240640 1 --2- 172.21.15.146:0/2851211452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09180b55f0 0x7f0918070be0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f09181603a0 tx=0x7f090802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:41:49.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.885+0000 7f091e240640 1 -- 172.21.15.146:0/2851211452 shutdown_connections 2024-09-17T03:41:49.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.885+0000 7f091e240640 1 --2- 172.21.15.146:0/2851211452 >> v2:172.21.15.179:3300/0 conn(0x7f091806dd60 0x7f091806e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:49.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.885+0000 7f091e240640 1 --2- 172.21.15.146:0/2851211452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09180b55f0 0x7f0918070be0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:49.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.885+0000 7f091e240640 1 -- 172.21.15.146:0/2851211452 >> 172.21.15.146:0/2851211452 conn(0x7f09180b3410 msgr2=0x7f09180b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:49.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.885+0000 7f091e240640 1 -- 172.21.15.146:0/2851211452 shutdown_connections 2024-09-17T03:41:49.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.885+0000 7f091e240640 1 -- 172.21.15.146:0/2851211452 wait complete. 2024-09-17T03:41:49.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.887+0000 7f091e240640 1 Processor -- start 2024-09-17T03:41:49.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.887+0000 7f091e240640 1 -- start start 2024-09-17T03:41:49.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.888+0000 7f091e240640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091806dd60 0x7f09181f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:49.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.888+0000 7f091e240640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0918071120 0x7f0918158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:49.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.888+0000 7f091e240640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09180b55f0 0x7f09181f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:49.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.888+0000 7f091e240640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f091815bd10 con 0x7f091806dd60 2024-09-17T03:41:49.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.888+0000 7f091e240640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f09180b4e50 con 0x7f0918071120 2024-09-17T03:41:49.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.888+0000 7f091e240640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f091815be90 con 0x7f09180b55f0 2024-09-17T03:41:49.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.888+0000 7f09177fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091806dd60 0x7f09181f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:49.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.888+0000 7f09177fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091806dd60 0x7f09181f4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35836/0 (socket says 172.21.15.146:35836) 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.888+0000 7f09177fe640 1 -- 172.21.15.146:0/378763330 learned_addr learned my addr 172.21.15.146:0/378763330 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.888+0000 7f0917fff640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09180b55f0 0x7f09181f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.888+0000 7f0916ffd640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0918071120 0x7f0918158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f09177fe640 1 -- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09180b55f0 msgr2=0x7f09181f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f09177fe640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09180b55f0 0x7f09181f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f09177fe640 1 -- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0918071120 msgr2=0x7f0918158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f09177fe640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0918071120 0x7f0918158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f09177fe640 1 -- 172.21.15.146:0/378763330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09181f4e20 con 0x7f091806dd60 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f0917fff640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09180b55f0 0x7f09181f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f0916ffd640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0918071120 0x7f0918158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f09177fe640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091806dd60 0x7f09181f4420 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0908034040 tx=0x7f09080039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f08fffff640 1 -- 172.21.15.146:0/378763330 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090803e030 con 0x7f091806dd60 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f08fffff640 1 -- 172.21.15.146:0/378763330 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09080047a0 con 0x7f091806dd60 2024-09-17T03:41:49.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f08fffff640 1 -- 172.21.15.146:0/378763330 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908035040 con 0x7f091806dd60 2024-09-17T03:41:49.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f091e240640 1 -- 172.21.15.146:0/378763330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09181f5100 con 0x7f091806dd60 2024-09-17T03:41:49.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.889+0000 7f091e240640 1 -- 172.21.15.146:0/378763330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09181f56c0 con 0x7f091806dd60 2024-09-17T03:41:49.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.890+0000 7f091e240640 1 -- 172.21.15.146:0/378763330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f091806e170 con 0x7f091806dd60 2024-09-17T03:41:49.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.891+0000 7f08fffff640 1 -- 172.21.15.146:0/378763330 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0908041030 con 0x7f091806dd60 2024-09-17T03:41:49.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.891+0000 7f08fffff640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0904078b90 0x7f090407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:49.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.891+0000 7f08fffff640 1 -- 172.21.15.146:0/378763330 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7f09080bb100 con 0x7f091806dd60 2024-09-17T03:41:49.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.891+0000 7f0916ffd640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0904078b90 0x7f090407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:49.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.892+0000 7f0916ffd640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0904078b90 0x7f090407b0a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f090c007fd0 tx=0x7f090c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:49.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:49.896+0000 7f08fffff640 1 -- 172.21.15.146:0/378763330 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0908083960 con 0x7f091806dd60 2024-09-17T03:41:50.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.072+0000 7f091e240640 1 -- 172.21.15.146:0/378763330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f09180b45d0 con 0x7f091806dd60 2024-09-17T03:41:50.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.076+0000 7f08fffff640 1 -- 172.21.15.146:0/378763330 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v55) ==== 71+0+0 (secure 0 0 0) 0x7f0908083260 con 0x7f091806dd60 2024-09-17T03:41:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 -- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0904078b90 msgr2=0x7f090407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0904078b90 0x7f090407b0a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f090c007fd0 tx=0x7f090c009040 comp rx=0 tx=0).stop 2024-09-17T03:41:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 -- 172.21.15.146:0/378763330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091806dd60 msgr2=0x7f09181f4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091806dd60 0x7f09181f4420 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0908034040 tx=0x7f09080039e0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 -- 172.21.15.146:0/378763330 shutdown_connections 2024-09-17T03:41:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0904078b90 0x7f090407b0a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09180b55f0 0x7f09181f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0918071120 0x7f0918158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 --2- 172.21.15.146:0/378763330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f091806dd60 0x7f09181f4420 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 -- 172.21.15.146:0/378763330 >> 172.21.15.146:0/378763330 conn(0x7f09180b3410 msgr2=0x7f091815c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 -- 172.21.15.146:0/378763330 shutdown_connections 2024-09-17T03:41:50.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.078+0000 7f091e240640 1 -- 172.21.15.146:0/378763330 wait complete. 2024-09-17T03:41:50.090 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-17T03:41:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.203+0000 7fc9e2d39640 1 -- 172.21.15.146:0/288930014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9dc0b5750 msgr2=0x7fc9dc0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.203+0000 7fc9e2d39640 1 --2- 172.21.15.146:0/288930014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9dc0b5750 0x7fc9dc0b3620 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc074610 tx=0x7fc9c802a560 comp rx=0 tx=0).stop 2024-09-17T03:41:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.203+0000 7fc9e2d39640 1 -- 172.21.15.146:0/288930014 shutdown_connections 2024-09-17T03:41:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.203+0000 7fc9e2d39640 1 --2- 172.21.15.146:0/288930014 >> v2:172.21.15.179:3300/0 conn(0x7fc9dc0b3b60 0x7fc9dc0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.203+0000 7fc9e2d39640 1 --2- 172.21.15.146:0/288930014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9dc0b5750 0x7fc9dc0b3620 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.203+0000 7fc9e2d39640 1 --2- 172.21.15.146:0/288930014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9dc0b5ce0 0x7fc9dc0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.203+0000 7fc9e2d39640 1 -- 172.21.15.146:0/288930014 >> 172.21.15.146:0/288930014 conn(0x7fc9dc0b7b20 msgr2=0x7fc9dc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.203+0000 7fc9e2d39640 1 -- 172.21.15.146:0/288930014 shutdown_connections 2024-09-17T03:41:50.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.203+0000 7fc9e2d39640 1 -- 172.21.15.146:0/288930014 wait complete. 2024-09-17T03:41:50.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.205+0000 7fc9e2d39640 1 Processor -- start 2024-09-17T03:41:50.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.205+0000 7fc9e2d39640 1 -- start start 2024-09-17T03:41:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e2d39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9dc0b3b60 0x7fc9dc14f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e2d39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9dc0b5750 0x7fc9dc06dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e2d39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9dc0b5ce0 0x7fc9dc155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e2d39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc0b2970 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e2d39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc0b27f0 con 0x7fc9dc0b5750 2024-09-17T03:41:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e2d39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc0b2af0 con 0x7fc9dc0b3b60 2024-09-17T03:41:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e12d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9dc0b5ce0 0x7fc9dc155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e12d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9dc0b5ce0 0x7fc9dc155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35848/0 (socket says 172.21.15.146:35848) 2024-09-17T03:41:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e12d6640 1 -- 172.21.15.146:0/1689325589 learned_addr learned my addr 172.21.15.146:0/1689325589 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9dbfff640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9dc0b5750 0x7fc9dc06dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e0ad5640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9dc0b3b60 0x7fc9dc14f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e12d6640 1 -- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9dc0b3b60 msgr2=0x7fc9dc14f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e12d6640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9dc0b3b60 0x7fc9dc14f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e12d6640 1 -- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9dc0b5750 msgr2=0x7fc9dc06dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e12d6640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9dc0b5750 0x7fc9dc06dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e12d6640 1 -- 172.21.15.146:0/1689325589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc06ea20 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e12d6640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9dc0b5ce0 0x7fc9dc155f70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400cab0 tx=0x7fc9d400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9d97fa640 1 -- 172.21.15.146:0/1689325589 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4007df0 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9d97fa640 1 -- 172.21.15.146:0/1689325589 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9d400f560 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e2d39640 1 -- 172.21.15.146:0/1689325589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc09c820 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9d97fa640 1 -- 172.21.15.146:0/1689325589 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400f9b0 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.207+0000 7fc9e2d39640 1 -- 172.21.15.146:0/1689325589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc09cde0 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.208+0000 7fc9e2d39640 1 -- 172.21.15.146:0/1689325589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9dc06e790 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.209+0000 7fc9d97fa640 1 -- 172.21.15.146:0/1689325589 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9d400fb50 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.210+0000 7fc9d97fa640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9c0078bc0 0x7fc9c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:50.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.210+0000 7fc9d97fa640 1 -- 172.21.15.146:0/1689325589 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7fc9d409b340 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.210+0000 7fc9e0ad5640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9c0078bc0 0x7fc9c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:50.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.211+0000 7fc9e0ad5640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9c0078bc0 0x7fc9c007b0d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0004630 tx=0x7fc9d000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.214+0000 7fc9d97fa640 1 -- 172.21.15.146:0/1689325589 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc9d4014070 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.455+0000 7fc9e2d39640 1 -- 172.21.15.146:0/1689325589 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7fc9dc0b3620 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.722+0000 7fc9d97fa640 1 -- 172.21.15.146:0/1689325589 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v426) ==== 155+0+0 (secure 0 0 0) 0x7fc9d4063550 con 0x7fc9dc0b5ce0 2024-09-17T03:41:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.724+0000 7fc9e2d39640 1 -- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9c0078bc0 msgr2=0x7fc9c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.724+0000 7fc9e2d39640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9c0078bc0 0x7fc9c007b0d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0004630 tx=0x7fc9d000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.724+0000 7fc9e2d39640 1 -- 172.21.15.146:0/1689325589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9dc0b5ce0 msgr2=0x7fc9dc155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.724+0000 7fc9e2d39640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9dc0b5ce0 0x7fc9dc155f70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400cab0 tx=0x7fc9d400cf70 comp rx=0 tx=0).stop 2024-09-17T03:41:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.724+0000 7fc9e2d39640 1 -- 172.21.15.146:0/1689325589 shutdown_connections 2024-09-17T03:41:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.724+0000 7fc9e2d39640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9c0078bc0 0x7fc9c007b0d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.724+0000 7fc9e2d39640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9dc0b5ce0 0x7fc9dc155f70 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.724+0000 7fc9e2d39640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9dc0b5750 0x7fc9dc06dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.724+0000 7fc9e2d39640 1 --2- 172.21.15.146:0/1689325589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9dc0b3b60 0x7fc9dc14f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.725+0000 7fc9e2d39640 1 -- 172.21.15.146:0/1689325589 >> 172.21.15.146:0/1689325589 conn(0x7fc9dc0b7b20 msgr2=0x7fc9dc159200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:50.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.725+0000 7fc9e2d39640 1 -- 172.21.15.146:0/1689325589 shutdown_connections 2024-09-17T03:41:50.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.725+0000 7fc9e2d39640 1 -- 172.21.15.146:0/1689325589 wait complete. 2024-09-17T03:41:50.736 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-17T03:41:50.737 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-17T03:41:50.737 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:41:50.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.851+0000 7f6265a94640 1 -- 172.21.15.146:0/2946907867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6260072bc0 msgr2=0x7f626015f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:50.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.851+0000 7f6265a94640 1 --2- 172.21.15.146:0/2946907867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6260072bc0 0x7f626015f2e0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f626006e1d0 tx=0x7f625802a4e0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.851+0000 7f6265a94640 1 -- 172.21.15.146:0/2946907867 shutdown_connections 2024-09-17T03:41:50.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.851+0000 7f6265a94640 1 --2- 172.21.15.146:0/2946907867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6260072bc0 0x7f626015f2e0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.851+0000 7f6265a94640 1 --2- 172.21.15.146:0/2946907867 >> v2:172.21.15.179:3300/0 conn(0x7f6260070350 0x7f6260072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.851+0000 7f6265a94640 1 --2- 172.21.15.146:0/2946907867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f626015b770 0x7f626006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.851+0000 7f6265a94640 1 -- 172.21.15.146:0/2946907867 >> 172.21.15.146:0/2946907867 conn(0x7f62600b2060 msgr2=0x7f62600b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:50.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.851+0000 7f6265a94640 1 -- 172.21.15.146:0/2946907867 shutdown_connections 2024-09-17T03:41:50.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.851+0000 7f6265a94640 1 -- 172.21.15.146:0/2946907867 wait complete. 2024-09-17T03:41:50.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.852+0000 7f6265a94640 1 Processor -- start 2024-09-17T03:41:50.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.853+0000 7f6265a94640 1 -- start start 2024-09-17T03:41:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f6265a94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6260070350 0x7f62601f9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f6265a94640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6260072bc0 0x7f62600cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f6265a94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f626015b770 0x7f6260143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f6265a94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f626015fbb0 con 0x7f626015b770 2024-09-17T03:41:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f6265a94640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f626015fa30 con 0x7f6260070350 2024-09-17T03:41:50.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f6265a94640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f626015fd30 con 0x7f6260072bc0 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f625ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f626015b770 0x7f6260143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f625ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f626015b770 0x7f6260143d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35866/0 (socket says 172.21.15.146:35866) 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f625ffff640 1 -- 172.21.15.146:0/2794288194 learned_addr learned my addr 172.21.15.146:0/2794288194 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f625f7fe640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6260070350 0x7f62601f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f625effd640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6260072bc0 0x7f62600cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f625ffff640 1 -- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6260072bc0 msgr2=0x7f62600cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f625ffff640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6260072bc0 0x7f62600cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f625ffff640 1 -- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6260070350 msgr2=0x7f62601f9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f625ffff640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6260070350 0x7f62601f9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.854+0000 7f625ffff640 1 -- 172.21.15.146:0/2794288194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6260153cc0 con 0x7f626015b770 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.855+0000 7f625ffff640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f626015b770 0x7f6260143d20 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f6258006010 tx=0x7f6258003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:50.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.855+0000 7f6247fff640 1 -- 172.21.15.146:0/2794288194 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625803e030 con 0x7f626015b770 2024-09-17T03:41:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.855+0000 7f6247fff640 1 -- 172.21.15.146:0/2794288194 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6258003d80 con 0x7f626015b770 2024-09-17T03:41:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.855+0000 7f6265a94640 1 -- 172.21.15.146:0/2794288194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6260153fa0 con 0x7f626015b770 2024-09-17T03:41:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.855+0000 7f6247fff640 1 -- 172.21.15.146:0/2794288194 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6258035040 con 0x7f626015b770 2024-09-17T03:41:50.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.855+0000 7f6265a94640 1 -- 172.21.15.146:0/2794288194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62601f60a0 con 0x7f626015b770 2024-09-17T03:41:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.856+0000 7f6265a94640 1 -- 172.21.15.146:0/2794288194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f626015f2e0 con 0x7f626015b770 2024-09-17T03:41:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.857+0000 7f6247fff640 1 -- 172.21.15.146:0/2794288194 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6258041030 con 0x7f626015b770 2024-09-17T03:41:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.857+0000 7f6247fff640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f624c078b90 0x7f624c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.857+0000 7f6247fff640 1 -- 172.21.15.146:0/2794288194 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7f62580bb420 con 0x7f626015b770 2024-09-17T03:41:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.857+0000 7f625f7fe640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f624c078b90 0x7f624c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:50.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.858+0000 7f625f7fe640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f624c078b90 0x7f624c07b0a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6250005fd0 tx=0x7f62500095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:50.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:50.862+0000 7f6247fff640 1 -- 172.21.15.146:0/2794288194 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f62580835a0 con 0x7f626015b770 2024-09-17T03:41:51.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.038+0000 7f6265a94640 1 -- 172.21.15.146:0/2794288194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62600b0120 con 0x7f626015b770 2024-09-17T03:41:51.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.039+0000 7f6247fff640 1 -- 172.21.15.146:0/2794288194 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) ==== 74+0+13090 (secure 0 0 0) 0x7f6258087fd0 con 0x7f626015b770 2024-09-17T03:41:51.039 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:51.039 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":135,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:41:49.711358+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/141241275":"2024-09-18T03:41:46.699348+0000","172.21.15.146:6832/141241275":"2024-09-18T03:41:46.699348+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:41:51.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 -- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f624c078b90 msgr2=0x7f624c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:51.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f624c078b90 0x7f624c07b0a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6250005fd0 tx=0x7f62500095e0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 -- 172.21.15.146:0/2794288194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f626015b770 msgr2=0x7f6260143d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:51.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f626015b770 0x7f6260143d20 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f6258006010 tx=0x7f6258003890 comp rx=0 tx=0).stop 2024-09-17T03:41:51.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 -- 172.21.15.146:0/2794288194 shutdown_connections 2024-09-17T03:41:51.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f624c078b90 0x7f624c07b0a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f626015b770 0x7f6260143d20 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6260072bc0 0x7f62600cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 --2- 172.21.15.146:0/2794288194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6260070350 0x7f62601f9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 -- 172.21.15.146:0/2794288194 >> 172.21.15.146:0/2794288194 conn(0x7f62600b2060 msgr2=0x7f62600b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:51.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 -- 172.21.15.146:0/2794288194 shutdown_connections 2024-09-17T03:41:51.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.041+0000 7f6265a94640 1 -- 172.21.15.146:0/2794288194 wait complete. 2024-09-17T03:41:51.053 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:41:51.053 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:41:51.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.170+0000 7f08c3332640 1 -- 172.21.15.146:0/1314827967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a8005150 msgr2=0x7f08a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:51.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.170+0000 7f08c3332640 1 --2- 172.21.15.146:0/1314827967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a8005150 0x7f08a800b9c0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009ed0 tx=0x7f08a8005830 comp rx=0 tx=0).stop 2024-09-17T03:41:51.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.170+0000 7f08c18cf640 1 -- 172.21.15.146:0/1314827967 reap_dead start 2024-09-17T03:41:51.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.170+0000 7f08c3332640 1 -- 172.21.15.146:0/1314827967 shutdown_connections 2024-09-17T03:41:51.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.170+0000 7f08c3332640 1 -- 172.21.15.146:0/1314827967 >> 172.21.15.146:0/1314827967 conn(0x7f08bc0b7b20 msgr2=0x7f08bc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:51.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.170+0000 7f08c3332640 1 -- 172.21.15.146:0/1314827967 shutdown_connections 2024-09-17T03:41:51.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.170+0000 7f08c3332640 1 -- 172.21.15.146:0/1314827967 wait complete. 2024-09-17T03:41:51.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.172+0000 7f08c3332640 1 Processor -- start 2024-09-17T03:41:51.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.172+0000 7f08c3332640 1 -- start start 2024-09-17T03:41:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c3332640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a8005150 0x7f08bc14dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c3332640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08bc14e520 0x7f08bc0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c3332640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08bc0cbec0 0x7f08bc1f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c3332640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc15caa0 con 0x7f08a8005150 2024-09-17T03:41:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c3332640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc15cc20 con 0x7f08bc14e520 2024-09-17T03:41:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c3332640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f08bc15cda0 con 0x7f08bc0cbec0 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c10ce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a8005150 0x7f08bc14dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c10ce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a8005150 0x7f08bc14dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35882/0 (socket says 172.21.15.146:35882) 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c10ce640 1 -- 172.21.15.146:0/2844163795 learned_addr learned my addr 172.21.15.146:0/2844163795 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c08cd640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08bc14e520 0x7f08bc0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c18cf640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08bc0cbec0 0x7f08bc1f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c10ce640 1 -- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08bc0cbec0 msgr2=0x7f08bc1f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c10ce640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08bc0cbec0 0x7f08bc1f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c10ce640 1 -- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08bc14e520 msgr2=0x7f08bc0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c10ce640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08bc14e520 0x7f08bc0cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.173+0000 7f08c10ce640 1 -- 172.21.15.146:0/2844163795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc0cc2d0 con 0x7f08a8005150 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.174+0000 7f08c10ce640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a8005150 0x7f08bc14dfe0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f08b8011ae0 tx=0x7f08b8009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.174+0000 7f08b1ffb640 1 -- 172.21.15.146:0/2844163795 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b800fcb0 con 0x7f08a8005150 2024-09-17T03:41:51.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.174+0000 7f08b1ffb640 1 -- 172.21.15.146:0/2844163795 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08b800fe50 con 0x7f08a8005150 2024-09-17T03:41:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.174+0000 7f08c3332640 1 -- 172.21.15.146:0/2844163795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08bc14ef40 con 0x7f08a8005150 2024-09-17T03:41:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.174+0000 7f08b1ffb640 1 -- 172.21.15.146:0/2844163795 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8004280 con 0x7f08a8005150 2024-09-17T03:41:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.174+0000 7f08c3332640 1 -- 172.21.15.146:0/2844163795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08bc14ec60 con 0x7f08a8005150 2024-09-17T03:41:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.175+0000 7f08c3332640 1 -- 172.21.15.146:0/2844163795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08bc0b1320 con 0x7f08a8005150 2024-09-17T03:41:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.176+0000 7f08b1ffb640 1 -- 172.21.15.146:0/2844163795 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f08b80035f0 con 0x7f08a8005150 2024-09-17T03:41:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.176+0000 7f08b1ffb640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f08a0078b90 0x7f08a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.176+0000 7f08b1ffb640 1 -- 172.21.15.146:0/2844163795 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7f08b809b430 con 0x7f08a8005150 2024-09-17T03:41:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.176+0000 7f08c08cd640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f08a0078b90 0x7f08a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.177+0000 7f08c08cd640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f08a0078b90 0x7f08a007b0a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f08bc14e930 tx=0x7f08ac000f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:51.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.180+0000 7f08b1ffb640 1 -- 172.21.15.146:0/2844163795 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f08bc0cc2d0 con 0x7f08a8005150 2024-09-17T03:41:51.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.354+0000 7f08c3332640 1 -- 172.21.15.146:0/2844163795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f08bc159b80 con 0x7f08a8005150 2024-09-17T03:41:51.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.355+0000 7f08b1ffb640 1 -- 172.21.15.146:0/2844163795 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) ==== 93+0+10 (secure 0 0 0) 0x7f08b8063640 con 0x7f08a8005150 2024-09-17T03:41:51.355 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 -- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f08a0078b90 msgr2=0x7f08a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f08a0078b90 0x7f08a007b0a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f08bc14e930 tx=0x7f08ac000f80 comp rx=0 tx=0).stop 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 -- 172.21.15.146:0/2844163795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a8005150 msgr2=0x7f08bc14dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a8005150 0x7f08bc14dfe0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f08b8011ae0 tx=0x7f08b8009f10 comp rx=0 tx=0).stop 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 -- 172.21.15.146:0/2844163795 shutdown_connections 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f08a0078b90 0x7f08a007b0a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08bc0cbec0 0x7f08bc1f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08bc14e520 0x7f08bc0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 --2- 172.21.15.146:0/2844163795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a8005150 0x7f08bc14dfe0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 -- 172.21.15.146:0/2844163795 >> 172.21.15.146:0/2844163795 conn(0x7f08bc0b7b20 msgr2=0x7f08bc0b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 -- 172.21.15.146:0/2844163795 shutdown_connections 2024-09-17T03:41:51.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.357+0000 7f08c3332640 1 -- 172.21.15.146:0/2844163795 wait complete. 2024-09-17T03:41:51.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-17T03:41:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.483+0000 7fcccc7a8640 1 -- 172.21.15.146:0/3588000873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc415c9f0 msgr2=0x7fccc41526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.483+0000 7fcccc7a8640 1 --2- 172.21.15.146:0/3588000873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc415c9f0 0x7fccc41526a0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009830 tx=0x7fccc002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.483+0000 7fcccc7a8640 1 -- 172.21.15.146:0/3588000873 shutdown_connections 2024-09-17T03:41:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.483+0000 7fcccc7a8640 1 --2- 172.21.15.146:0/3588000873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc415c9f0 0x7fccc41526a0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.483+0000 7fcccc7a8640 1 -- 172.21.15.146:0/3588000873 >> 172.21.15.146:0/3588000873 conn(0x7fccc406d3c0 msgr2=0x7fccc40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.483+0000 7fcccc7a8640 1 -- 172.21.15.146:0/3588000873 shutdown_connections 2024-09-17T03:41:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.483+0000 7fcccc7a8640 1 -- 172.21.15.146:0/3588000873 wait complete. 2024-09-17T03:41:51.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.485+0000 7fcccc7a8640 1 Processor -- start 2024-09-17T03:41:51.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.485+0000 7fcccc7a8640 1 -- start start 2024-09-17T03:41:51.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fcccc7a8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccc40b4100 0x7fccc41f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:51.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fcccc7a8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc40aec80 0x7fccc40af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:51.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fcccc7a8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc41f85a0 0x7fccc41f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:51.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fcccc7a8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fccc40d05b0 con 0x7fccc40aec80 2024-09-17T03:41:51.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fcccc7a8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fccc40b4720 con 0x7fccc41f85a0 2024-09-17T03:41:51.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fcccc7a8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fccc40d0730 con 0x7fccc40b4100 2024-09-17T03:41:51.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fccc9d43640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc40aec80 0x7fccc40af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:51.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fccc9d43640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc40aec80 0x7fccc40af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35892/0 (socket says 172.21.15.146:35892) 2024-09-17T03:41:51.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fccc9d43640 1 -- 172.21.15.146:0/2936827674 learned_addr learned my addr 172.21.15.146:0/2936827674 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:51.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fccca544640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccc40b4100 0x7fccc41f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:51.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fcccad45640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc41f85a0 0x7fccc41f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fccc9d43640 1 -- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccc40b4100 msgr2=0x7fccc41f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fccc9d43640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccc40b4100 0x7fccc41f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fccc9d43640 1 -- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc41f85a0 msgr2=0x7fccc41f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fccc9d43640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc41f85a0 0x7fccc41f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fccc9d43640 1 -- 172.21.15.146:0/2936827674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc41f8ef0 con 0x7fccc40aec80 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.486+0000 7fcccad45640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc41f85a0 0x7fccc41f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.487+0000 7fccc9d43640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc40aec80 0x7fccc40af090 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c340 tx=0x7fccb400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.487+0000 7fccbaffd640 1 -- 172.21.15.146:0/2936827674 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4011790 con 0x7fccc40aec80 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.487+0000 7fccbaffd640 1 -- 172.21.15.146:0/2936827674 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccb4017070 con 0x7fccc40aec80 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.487+0000 7fcccc7a8640 1 -- 172.21.15.146:0/2936827674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc4153060 con 0x7fccc40aec80 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.487+0000 7fccbaffd640 1 -- 172.21.15.146:0/2936827674 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4011d00 con 0x7fccc40aec80 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.487+0000 7fcccc7a8640 1 -- 172.21.15.146:0/2936827674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc40afd00 con 0x7fccc40aec80 2024-09-17T03:41:51.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.488+0000 7fcccc7a8640 1 -- 172.21.15.146:0/2936827674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc40af770 con 0x7fccc40aec80 2024-09-17T03:41:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.489+0000 7fccbaffd640 1 -- 172.21.15.146:0/2936827674 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fccb401c460 con 0x7fccc40aec80 2024-09-17T03:41:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.489+0000 7fccbaffd640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcca8078bc0 0x7fcca807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.489+0000 7fccbaffd640 1 -- 172.21.15.146:0/2936827674 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7fccb409a710 con 0x7fccc40aec80 2024-09-17T03:41:51.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.489+0000 7fccca544640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcca8078bc0 0x7fcca807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:51.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.490+0000 7fccca544640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcca8078bc0 0x7fcca807b0d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fccc0034000 tx=0x7fccc0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:51.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.494+0000 7fccbaffd640 1 -- 172.21.15.146:0/2936827674 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fccc41f8ef0 con 0x7fccc40aec80 2024-09-17T03:41:51.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:51.740+0000 7fcccc7a8640 1 -- 172.21.15.146:0/2936827674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7fccc415c9f0 con 0x7fccc40aec80 2024-09-17T03:41:52.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.730+0000 7fccbaffd640 1 -- 172.21.15.146:0/2936827674 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v428) ==== 169+0+0 (secure 0 0 0) 0x7fccb4062ee0 con 0x7fccc40aec80 2024-09-17T03:41:52.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 -- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcca8078bc0 msgr2=0x7fcca807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:52.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcca8078bc0 0x7fcca807b0d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fccc0034000 tx=0x7fccc0004730 comp rx=0 tx=0).stop 2024-09-17T03:41:52.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 -- 172.21.15.146:0/2936827674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc40aec80 msgr2=0x7fccc40af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc40aec80 0x7fccc40af090 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fccb400c340 tx=0x7fccb400c800 comp rx=0 tx=0).stop 2024-09-17T03:41:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 -- 172.21.15.146:0/2936827674 shutdown_connections 2024-09-17T03:41:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcca8078bc0 0x7fcca807b0d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fccc41f85a0 0x7fccc41f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccc40aec80 0x7fccc40af090 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 --2- 172.21.15.146:0/2936827674 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fccc40b4100 0x7fccc41f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 -- 172.21.15.146:0/2936827674 >> 172.21.15.146:0/2936827674 conn(0x7fccc406d3c0 msgr2=0x7fccc41526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 -- 172.21.15.146:0/2936827674 shutdown_connections 2024-09-17T03:41:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.733+0000 7fcccc7a8640 1 -- 172.21.15.146:0/2936827674 wait complete. 2024-09-17T03:41:52.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:41:52.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.866+0000 7f8afec38640 1 -- 172.21.15.146:0/1125918449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af80b3870 msgr2=0x7f8af80cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:52.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.866+0000 7f8afec38640 1 --2- 172.21.15.146:0/1125918449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af80b3870 0x7f8af80cf370 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f8af8069ce0 tx=0x7f8af402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:41:52.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.866+0000 7f8afec38640 1 -- 172.21.15.146:0/1125918449 shutdown_connections 2024-09-17T03:41:52.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.866+0000 7f8afec38640 1 --2- 172.21.15.146:0/1125918449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af806f270 0x7f8af81628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:52.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.866+0000 7f8afec38640 1 --2- 172.21.15.146:0/1125918449 >> v2:172.21.15.179:3300/0 conn(0x7f8af81620f0 0x7f8af806ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:52.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.866+0000 7f8afec38640 1 --2- 172.21.15.146:0/1125918449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af80b3870 0x7f8af80cf370 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:52.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.866+0000 7f8afec38640 1 -- 172.21.15.146:0/1125918449 >> 172.21.15.146:0/1125918449 conn(0x7f8af80d4be0 msgr2=0x7f8af80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:52.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.867+0000 7f8afec38640 1 -- 172.21.15.146:0/1125918449 shutdown_connections 2024-09-17T03:41:52.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.867+0000 7f8afec38640 1 -- 172.21.15.146:0/1125918449 wait complete. 2024-09-17T03:41:52.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.868+0000 7f8afec38640 1 Processor -- start 2024-09-17T03:41:52.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.868+0000 7f8afec38640 1 -- start start 2024-09-17T03:41:52.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afec38640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8af806f270 0x7f8af8150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:52.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afec38640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b3870 0x7f8af814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:52.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afec38640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af81620f0 0x7f8af80b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:52.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afec38640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8af8163170 con 0x7f8af81620f0 2024-09-17T03:41:52.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afec38640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8af8162ff0 con 0x7f8af806f270 2024-09-17T03:41:52.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afec38640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8af81632f0 con 0x7f8af80b3870 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afd1d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af81620f0 0x7f8af80b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afd1d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af81620f0 0x7f8af80b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35924/0 (socket says 172.21.15.146:35924) 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afd1d5640 1 -- 172.21.15.146:0/2480689617 learned_addr learned my addr 172.21.15.146:0/2480689617 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afc9d4640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8af806f270 0x7f8af8150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8aeffff640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b3870 0x7f8af814d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afd1d5640 1 -- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b3870 msgr2=0x7f8af814d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afd1d5640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b3870 0x7f8af814d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afd1d5640 1 -- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8af806f270 msgr2=0x7f8af8150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afd1d5640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8af806f270 0x7f8af8150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afd1d5640 1 -- 172.21.15.146:0/2480689617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af8150640 con 0x7f8af81620f0 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.870+0000 7f8afd1d5640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af81620f0 0x7f8af80b2f60 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f8af000e990 tx=0x7f8af000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.871+0000 7f8aed7fa640 1 -- 172.21.15.146:0/2480689617 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0004d20 con 0x7f8af81620f0 2024-09-17T03:41:52.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.871+0000 7f8aed7fa640 1 -- 172.21.15.146:0/2480689617 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8af000caa0 con 0x7f8af81620f0 2024-09-17T03:41:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.871+0000 7f8afec38640 1 -- 172.21.15.146:0/2480689617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af80ccc40 con 0x7f8af81620f0 2024-09-17T03:41:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.871+0000 7f8aed7fa640 1 -- 172.21.15.146:0/2480689617 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0005020 con 0x7f8af81620f0 2024-09-17T03:41:52.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.871+0000 7f8afec38640 1 -- 172.21.15.146:0/2480689617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af80cd200 con 0x7f8af81620f0 2024-09-17T03:41:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.872+0000 7f8afec38640 1 -- 172.21.15.146:0/2480689617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af80cf370 con 0x7f8af81620f0 2024-09-17T03:41:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.872+0000 7f8aed7fa640 1 -- 172.21.15.146:0/2480689617 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8af00051c0 con 0x7f8af81620f0 2024-09-17T03:41:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.873+0000 7f8aed7fa640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8ae4078bc0 0x7f8ae407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.873+0000 7f8aed7fa640 1 -- 172.21.15.146:0/2480689617 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7f8af009b220 con 0x7f8af81620f0 2024-09-17T03:41:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.873+0000 7f8afc9d4640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8ae4078bc0 0x7f8ae407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.874+0000 7f8afc9d4640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8ae4078bc0 0x7f8ae407b0d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8af4033000 tx=0x7f8af4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:52.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:52.877+0000 7f8aed7fa640 1 -- 172.21.15.146:0/2480689617 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8af0016030 con 0x7f8af81620f0 2024-09-17T03:41:53.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.054+0000 7f8afec38640 1 -- 172.21.15.146:0/2480689617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f8af80d2bd0 con 0x7f8af81620f0 2024-09-17T03:41:53.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.054+0000 7f8aed7fa640 1 -- 172.21.15.146:0/2480689617 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v55) ==== 59+0+2294 (secure 0 0 0) 0x7f8af0063310 con 0x7f8af81620f0 2024-09-17T03:41:53.055 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:41:53.055 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:41:53.055 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:41:53.055 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:41:53.055 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:41:53.055 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:41:53.055 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:41:53.055 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:41:53.055 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:41:53.055 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:41:53.055 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:41:53.056 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:41:53.057 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:41:53.057 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:41:53.057 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:41:53.057 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:41:53.057 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:41:53.057 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:41:53.057 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:41:53.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 -- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8ae4078bc0 msgr2=0x7f8ae407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8ae4078bc0 0x7f8ae407b0d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8af4033000 tx=0x7f8af4004730 comp rx=0 tx=0).stop 2024-09-17T03:41:53.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 -- 172.21.15.146:0/2480689617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af81620f0 msgr2=0x7f8af80b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af81620f0 0x7f8af80b2f60 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f8af000e990 tx=0x7f8af000ee50 comp rx=0 tx=0).stop 2024-09-17T03:41:53.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 -- 172.21.15.146:0/2480689617 shutdown_connections 2024-09-17T03:41:53.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8ae4078bc0 0x7f8ae407b0d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8af81620f0 0x7f8af80b2f60 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8af80b3870 0x7f8af814d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 --2- 172.21.15.146:0/2480689617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8af806f270 0x7f8af8150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 -- 172.21.15.146:0/2480689617 >> 172.21.15.146:0/2480689617 conn(0x7f8af80d4be0 msgr2=0x7f8af8160180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:53.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 -- 172.21.15.146:0/2480689617 shutdown_connections 2024-09-17T03:41:53.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.057+0000 7f8afec38640 1 -- 172.21.15.146:0/2480689617 wait complete. 2024-09-17T03:41:53.069 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:41:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.184+0000 7f5b8d713640 1 -- 172.21.15.146:0/589409198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b8806dd60 msgr2=0x7f5b8806e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.184+0000 7f5b8d713640 1 --2- 172.21.15.146:0/589409198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b8806dd60 0x7f5b8806e170 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f5b880b0700 tx=0x7f5b8002aac0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.184+0000 7f5b8d713640 1 -- 172.21.15.146:0/589409198 shutdown_connections 2024-09-17T03:41:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.184+0000 7f5b8d713640 1 --2- 172.21.15.146:0/589409198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b8806dd60 0x7f5b8806e170 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.184+0000 7f5b8d713640 1 --2- 172.21.15.146:0/589409198 >> v2:172.21.15.179:3300/0 conn(0x7f5b880b4530 0x7f5b880b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.184+0000 7f5b8d713640 1 -- 172.21.15.146:0/589409198 >> 172.21.15.146:0/589409198 conn(0x7f5b880b3410 msgr2=0x7f5b880b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:53.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.185+0000 7f5b8d713640 1 -- 172.21.15.146:0/589409198 shutdown_connections 2024-09-17T03:41:53.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.185+0000 7f5b8d713640 1 -- 172.21.15.146:0/589409198 wait complete. 2024-09-17T03:41:53.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.186+0000 7f5b8d713640 1 Processor -- start 2024-09-17T03:41:53.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.186+0000 7f5b8d713640 1 -- start start 2024-09-17T03:41:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b8d713640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b8806dd60 0x7f5b881f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b8d713640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b880b4530 0x7f5b881435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b8d713640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b880b55f0 0x7f5b881f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b8d713640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8815be90 con 0x7f5b8806dd60 2024-09-17T03:41:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b8d713640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8815bd10 con 0x7f5b880b4530 2024-09-17T03:41:53.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b8d713640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8815c010 con 0x7f5b880b55f0 2024-09-17T03:41:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b86ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b8806dd60 0x7f5b881f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b86ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b8806dd60 0x7f5b881f7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35934/0 (socket says 172.21.15.146:35934) 2024-09-17T03:41:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b86ffd640 1 -- 172.21.15.146:0/424789824 learned_addr learned my addr 172.21.15.146:0/424789824 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b877fe640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b880b55f0 0x7f5b881f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b867fc640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b880b4530 0x7f5b881435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b86ffd640 1 -- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b880b55f0 msgr2=0x7f5b881f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b86ffd640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b880b55f0 0x7f5b881f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b86ffd640 1 -- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b880b4530 msgr2=0x7f5b881435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b86ffd640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b880b4530 0x7f5b881435e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b86ffd640 1 -- 172.21.15.146:0/424789824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b88145f90 con 0x7f5b8806dd60 2024-09-17T03:41:53.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b867fc640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b880b4530 0x7f5b881435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:53.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b86ffd640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b8806dd60 0x7f5b881f7660 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800c370 tx=0x7f5b7800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:53.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b6f7fe640 1 -- 172.21.15.146:0/424789824 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780052d0 con 0x7f5b8806dd60 2024-09-17T03:41:53.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b6f7fe640 1 -- 172.21.15.146:0/424789824 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b78007020 con 0x7f5b8806dd60 2024-09-17T03:41:53.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.188+0000 7f5b8d713640 1 -- 172.21.15.146:0/424789824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b881f7ba0 con 0x7f5b8806dd60 2024-09-17T03:41:53.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.189+0000 7f5b6f7fe640 1 -- 172.21.15.146:0/424789824 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78007470 con 0x7f5b8806dd60 2024-09-17T03:41:53.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.189+0000 7f5b8d713640 1 -- 172.21.15.146:0/424789824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b88143b20 con 0x7f5b8806dd60 2024-09-17T03:41:53.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.189+0000 7f5b8d713640 1 -- 172.21.15.146:0/424789824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8815c530 con 0x7f5b8806dd60 2024-09-17T03:41:53.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.190+0000 7f5b6f7fe640 1 -- 172.21.15.146:0/424789824 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b780067d0 con 0x7f5b8806dd60 2024-09-17T03:41:53.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.191+0000 7f5b6f7fe640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b74078bc0 0x7f5b7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:53.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.191+0000 7f5b6f7fe640 1 -- 172.21.15.146:0/424789824 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7f5b78099d80 con 0x7f5b8806dd60 2024-09-17T03:41:53.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.191+0000 7f5b867fc640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b74078bc0 0x7f5b7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:53.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.192+0000 7f5b867fc640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b74078bc0 0x7f5b7407b0d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5b8806dcb0 tx=0x7f5b7c00a520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:53.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.195+0000 7f5b6f7fe640 1 -- 172.21.15.146:0/424789824 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5b881f7ba0 con 0x7f5b8806dd60 2024-09-17T03:41:53.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.369+0000 7f5b8d713640 1 -- 172.21.15.146:0/424789824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5b880b1310 con 0x7f5b8806dd60 2024-09-17T03:41:53.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.373+0000 7f5b6f7fe640 1 -- 172.21.15.146:0/424789824 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v56)=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7f5b8806e6b0 con 0x7f5b8806dd60 2024-09-17T03:41:53.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 -- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b74078bc0 msgr2=0x7f5b7407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b74078bc0 0x7f5b7407b0d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5b8806dcb0 tx=0x7f5b7c00a520 comp rx=0 tx=0).stop 2024-09-17T03:41:53.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 -- 172.21.15.146:0/424789824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b8806dd60 msgr2=0x7f5b881f7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b8806dd60 0x7f5b881f7660 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800c370 tx=0x7f5b7800c830 comp rx=0 tx=0).stop 2024-09-17T03:41:53.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 -- 172.21.15.146:0/424789824 shutdown_connections 2024-09-17T03:41:53.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5b74078bc0 0x7f5b7407b0d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5b880b55f0 0x7f5b881f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5b880b4530 0x7f5b881435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 --2- 172.21.15.146:0/424789824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5b8806dd60 0x7f5b881f7660 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 -- 172.21.15.146:0/424789824 >> 172.21.15.146:0/424789824 conn(0x7f5b880b3410 msgr2=0x7f5b880b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:53.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 -- 172.21.15.146:0/424789824 shutdown_connections 2024-09-17T03:41:53.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.375+0000 7f5b8d713640 1 -- 172.21.15.146:0/424789824 wait complete. 2024-09-17T03:41:53.387 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:41:53.387 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:41:53.448 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:41:53.500 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:41:53.501 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:41:53.501 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:53.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:41:53.518 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:41:53.518 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:53.536 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:41:53.537 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:41:53.537 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:53.574 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:41:53.574 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:41:53.574 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:41:53.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:41:53.594 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:41:53.594 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:41:53.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.727+0000 7feabef69640 1 -- 172.21.15.146:0/502461810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feab80cd990 msgr2=0x7feab8074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.727+0000 7feabef69640 1 --2- 172.21.15.146:0/502461810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feab80cd990 0x7feab8074740 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7feab80727a0 tx=0x7feaa802a440 comp rx=0 tx=0).stop 2024-09-17T03:41:53.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.727+0000 7feabef69640 1 -- 172.21.15.146:0/502461810 shutdown_connections 2024-09-17T03:41:53.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.727+0000 7feabef69640 1 --2- 172.21.15.146:0/502461810 >> v2:172.21.15.179:3300/0 conn(0x7feab8070090 0x7feab815f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.727+0000 7feabef69640 1 --2- 172.21.15.146:0/502461810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feab80cd990 0x7feab8074740 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.727+0000 7feabef69640 1 -- 172.21.15.146:0/502461810 >> 172.21.15.146:0/502461810 conn(0x7feab80b2950 msgr2=0x7feab80b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.727+0000 7feabef69640 1 -- 172.21.15.146:0/502461810 shutdown_connections 2024-09-17T03:41:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.727+0000 7feabef69640 1 -- 172.21.15.146:0/502461810 wait complete. 2024-09-17T03:41:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.728+0000 7feabef69640 1 Processor -- start 2024-09-17T03:41:53.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.729+0000 7feabef69640 1 -- start start 2024-09-17T03:41:53.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feabef69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab80cd990 0x7feab81569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:53.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feabef69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feab815b8c0 0x7feab8150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:53.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feabef69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab815d2f0 0x7feab81f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:53.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feabef69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feab815fb80 con 0x7feab815b8c0 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feabef69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feab815fa00 con 0x7feab815d2f0 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feabef69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7feab815fd00 con 0x7feab80cd990 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feab7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feab815b8c0 0x7feab8150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feab7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feab815b8c0 0x7feab8150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35950/0 (socket says 172.21.15.146:35950) 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feab7fff640 1 -- 172.21.15.146:0/2748126983 learned_addr learned my addr 172.21.15.146:0/2748126983 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feabcd05640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab80cd990 0x7feab81569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feabd506640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab815d2f0 0x7feab81f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feab7fff640 1 -- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab80cd990 msgr2=0x7feab81569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feab7fff640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab80cd990 0x7feab81569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feab7fff640 1 -- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab815d2f0 msgr2=0x7feab81f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feab7fff640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab815d2f0 0x7feab81f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.730+0000 7feab7fff640 1 -- 172.21.15.146:0/2748126983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab815dac0 con 0x7feab815b8c0 2024-09-17T03:41:53.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.731+0000 7feab7fff640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feab815b8c0 0x7feab8150330 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7feaac00ba50 tx=0x7feaac00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:53.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.731+0000 7feab57fa640 1 -- 172.21.15.146:0/2748126983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac019070 con 0x7feab815b8c0 2024-09-17T03:41:53.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.731+0000 7feab57fa640 1 -- 172.21.15.146:0/2748126983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feaac00cd10 con 0x7feab815b8c0 2024-09-17T03:41:53.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.731+0000 7feab57fa640 1 -- 172.21.15.146:0/2748126983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac0146a0 con 0x7feab815b8c0 2024-09-17T03:41:53.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.731+0000 7feabef69640 1 -- 172.21.15.146:0/2748126983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab815dda0 con 0x7feab815b8c0 2024-09-17T03:41:53.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.731+0000 7feabef69640 1 -- 172.21.15.146:0/2748126983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab815e360 con 0x7feab815b8c0 2024-09-17T03:41:53.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.732+0000 7feabef69640 1 -- 172.21.15.146:0/2748126983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab80b5000 con 0x7feab815b8c0 2024-09-17T03:41:53.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.733+0000 7feab57fa640 1 -- 172.21.15.146:0/2748126983 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feaac01c070 con 0x7feab815b8c0 2024-09-17T03:41:53.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.733+0000 7feab57fa640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaa4078b90 0x7feaa407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:53.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.733+0000 7feab57fa640 1 -- 172.21.15.146:0/2748126983 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7feaac09a690 con 0x7feab815b8c0 2024-09-17T03:41:53.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.733+0000 7feabcd05640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaa4078b90 0x7feaa407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:53.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.734+0000 7feabcd05640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaa4078b90 0x7feaa407b0a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7feaa8033000 tx=0x7feaa8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.742+0000 7feab57fa640 1 -- 172.21.15.146:0/2748126983 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feab80b5000 con 0x7feab815b8c0 2024-09-17T03:41:53.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.951+0000 7feabef69640 1 -- 172.21.15.146:0/2748126983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feab8160220 con 0x7feab815b8c0 2024-09-17T03:41:53.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.952+0000 7feab57fa640 1 -- 172.21.15.146:0/2748126983 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) ==== 94+0+3923 (secure 0 0 0) 0x7feaac062810 con 0x7feab815b8c0 2024-09-17T03:41:53.952 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:53.952 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":97,"btime":"2024-09-17T03:41:47:702220+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1882271854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1882271854},{"type":"v1","addr":"172.21.15.146:6835","nonce":1882271854}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4135268274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4135268274},{"type":"v1","addr":"172.21.15.179:6837","nonce":4135268274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3071692463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3071692463},{"type":"v1","addr":"172.21.15.179:6836","nonce":3071692463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91},{"gid":9123,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/4072297548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4072297548},{"type":"v1","addr":"172.21.15.146:6834","nonce":4072297548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[]} 2024-09-17T03:41:53.953 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 97 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 -- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaa4078b90 msgr2=0x7feaa407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaa4078b90 0x7feaa407b0a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7feaa8033000 tx=0x7feaa8004730 comp rx=0 tx=0).stop 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 -- 172.21.15.146:0/2748126983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feab815b8c0 msgr2=0x7feab8150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feab815b8c0 0x7feab8150330 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7feaac00ba50 tx=0x7feaac00bf10 comp rx=0 tx=0).stop 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 -- 172.21.15.146:0/2748126983 shutdown_connections 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feaa4078b90 0x7feaa407b0a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feab815d2f0 0x7feab81f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feab815b8c0 0x7feab8150330 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 --2- 172.21.15.146:0/2748126983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feab80cd990 0x7feab81569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 -- 172.21.15.146:0/2748126983 >> 172.21.15.146:0/2748126983 conn(0x7feab80b2950 msgr2=0x7feab80b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 -- 172.21.15.146:0/2748126983 shutdown_connections 2024-09-17T03:41:53.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:53.954+0000 7feabef69640 1 -- 172.21.15.146:0/2748126983 wait complete. 2024-09-17T03:41:53.966 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:41:53.967 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:41:53.967 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:41:53.967 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:53.967 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:41:53.967 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:41:53.967 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:41:53.967 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:53.968 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:41:53.968 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:41:53.968 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:41:53.968 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:53.968 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:41:53.968 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:41:53.968 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:41:53.969 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:41:53.977 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:41:53.978 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:41:53.979 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:41:53.979 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:41:53.980 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:41:53.980 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:41:53.981 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:41:53.982 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:41:54.022 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:41:54.022 DEBUG:teuthology.parallel:result is None 2024-09-17T03:41:54.023 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:41:54.023 DEBUG:teuthology.parallel:result is None 2024-09-17T03:41:54.024 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:41:54.024 DEBUG:teuthology.parallel:result is None 2024-09-17T03:41:54.025 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:41:54.025 DEBUG:teuthology.parallel:result is None 2024-09-17T03:41:54.025 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:41:54.112 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:41:54.112 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:41:54.113 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:41:54.113 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:41:54.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.146+0000 7f599a7ad640 1 -- 172.21.15.146:0/358092521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5994155dc0 msgr2=0x7f599406f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.146+0000 7f599a7ad640 1 --2- 172.21.15.146:0/358092521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5994155dc0 0x7f599406f8f0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f59940732f0 tx=0x7f597c02a560 comp rx=0 tx=0).stop 2024-09-17T03:41:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.146+0000 7f599a7ad640 1 -- 172.21.15.146:0/358092521 shutdown_connections 2024-09-17T03:41:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.146+0000 7f599a7ad640 1 --2- 172.21.15.146:0/358092521 >> v2:172.21.15.179:3300/0 conn(0x7f59940734f0 0x7f5994073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.146+0000 7f599a7ad640 1 --2- 172.21.15.146:0/358092521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f599406e0d0 0x7f599406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.146+0000 7f599a7ad640 1 --2- 172.21.15.146:0/358092521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5994155dc0 0x7f599406f8f0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.146+0000 7f599a7ad640 1 -- 172.21.15.146:0/358092521 >> 172.21.15.146:0/358092521 conn(0x7f59940b3720 msgr2=0x7f59940b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.146+0000 7f599a7ad640 1 -- 172.21.15.146:0/358092521 shutdown_connections 2024-09-17T03:41:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.146+0000 7f599a7ad640 1 -- 172.21.15.146:0/358092521 wait complete. 2024-09-17T03:41:54.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.148+0000 7f599a7ad640 1 Processor -- start 2024-09-17T03:41:54.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.148+0000 7f599a7ad640 1 -- start start 2024-09-17T03:41:54.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.149+0000 7f599a7ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f599406e0d0 0x7f59940aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:54.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.149+0000 7f599a7ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59940734f0 0x7f59941f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:54.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.149+0000 7f599a7ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5994155dc0 0x7f599414b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.149+0000 7f599a7ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f59940b5330 con 0x7f59940734f0 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.149+0000 7f599a7ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f59940b51b0 con 0x7f599406e0d0 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.149+0000 7f599a7ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f59940b54b0 con 0x7f5994155dc0 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.149+0000 7f59937fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59940734f0 0x7f59941f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.149+0000 7f59937fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59940734f0 0x7f59941f4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35986/0 (socket says 172.21.15.146:35986) 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.149+0000 7f59937fe640 1 -- 172.21.15.146:0/2469141233 learned_addr learned my addr 172.21.15.146:0/2469141233 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f5993fff640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f599406e0d0 0x7f59940aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f5998d4a640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5994155dc0 0x7f599414b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f59937fe640 1 -- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5994155dc0 msgr2=0x7f599414b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f59937fe640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5994155dc0 0x7f599414b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f59937fe640 1 -- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f599406e0d0 msgr2=0x7f59940aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f59937fe640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f599406e0d0 0x7f59940aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f59937fe640 1 -- 172.21.15.146:0/2469141233 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59941f4780 con 0x7f59940734f0 2024-09-17T03:41:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f59937fe640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59940734f0 0x7f59941f4240 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f598400c9a0 tx=0x7f598400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f5990ff9640 1 -- 172.21.15.146:0/2469141233 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5984004230 con 0x7f59940734f0 2024-09-17T03:41:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f5990ff9640 1 -- 172.21.15.146:0/2469141233 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59840044c0 con 0x7f59940734f0 2024-09-17T03:41:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f5990ff9640 1 -- 172.21.15.146:0/2469141233 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5984007bf0 con 0x7f59940734f0 2024-09-17T03:41:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f599a7ad640 1 -- 172.21.15.146:0/2469141233 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5994158c20 con 0x7f59940734f0 2024-09-17T03:41:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.150+0000 7f599a7ad640 1 -- 172.21.15.146:0/2469141233 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59941591e0 con 0x7f59940734f0 2024-09-17T03:41:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.151+0000 7f599a7ad640 1 -- 172.21.15.146:0/2469141233 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5994158990 con 0x7f59940734f0 2024-09-17T03:41:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.152+0000 7f5990ff9640 1 -- 172.21.15.146:0/2469141233 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59840035f0 con 0x7f59940734f0 2024-09-17T03:41:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.152+0000 7f5990ff9640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5974078b90 0x7f597407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.152+0000 7f5990ff9640 1 -- 172.21.15.146:0/2469141233 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7f598409aec0 con 0x7f59940734f0 2024-09-17T03:41:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.153+0000 7f5993fff640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5974078b90 0x7f597407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.153+0000 7f5993fff640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5974078b90 0x7f597407b0a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f597c033000 tx=0x7f597c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:54.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.157+0000 7f5990ff9640 1 -- 172.21.15.146:0/2469141233 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f59941f4780 con 0x7f59940734f0 2024-09-17T03:41:54.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.342+0000 7f599a7ad640 1 -- 172.21.15.146:0/2469141233 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f59940ce020 con 0x7f59940734f0 2024-09-17T03:41:54.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.750+0000 7f5990ff9640 1 -- 172.21.15.146:0/2469141233 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v137) ==== 97+0+0 (secure 0 0 0) 0x7f59940ce020 con 0x7f59940734f0 2024-09-17T03:41:54.750 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:41:54.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.752+0000 7f599a7ad640 1 -- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5974078b90 msgr2=0x7f597407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:54.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.752+0000 7f599a7ad640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5974078b90 0x7f597407b0a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f597c033000 tx=0x7f597c004730 comp rx=0 tx=0).stop 2024-09-17T03:41:54.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.752+0000 7f599a7ad640 1 -- 172.21.15.146:0/2469141233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59940734f0 msgr2=0x7f59941f4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:54.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.752+0000 7f599a7ad640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59940734f0 0x7f59941f4240 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f598400c9a0 tx=0x7f598400ce60 comp rx=0 tx=0).stop 2024-09-17T03:41:54.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.752+0000 7f599a7ad640 1 -- 172.21.15.146:0/2469141233 shutdown_connections 2024-09-17T03:41:54.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.752+0000 7f599a7ad640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5974078b90 0x7f597407b0a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.752+0000 7f599a7ad640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5994155dc0 0x7f599414b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.752+0000 7f599a7ad640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59940734f0 0x7f59941f4240 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.752+0000 7f599a7ad640 1 --2- 172.21.15.146:0/2469141233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f599406e0d0 0x7f59940aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.753+0000 7f599a7ad640 1 -- 172.21.15.146:0/2469141233 >> 172.21.15.146:0/2469141233 conn(0x7f59940b3720 msgr2=0x7f599415b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:54.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.753+0000 7f599a7ad640 1 -- 172.21.15.146:0/2469141233 shutdown_connections 2024-09-17T03:41:54.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.753+0000 7f599a7ad640 1 -- 172.21.15.146:0/2469141233 wait complete. 2024-09-17T03:41:54.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:41:54.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.879+0000 7fbfc2038640 1 -- 172.21.15.146:0/3115232259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0b3360 msgr2=0x7fbfbc072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:54.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.879+0000 7fbfc2038640 1 --2- 172.21.15.146:0/3115232259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0b3360 0x7fbfbc072df0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009830 tx=0x7fbfac02a510 comp rx=0 tx=0).stop 2024-09-17T03:41:54.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.879+0000 7fbfc2038640 1 -- 172.21.15.146:0/3115232259 shutdown_connections 2024-09-17T03:41:54.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.879+0000 7fbfc2038640 1 --2- 172.21.15.146:0/3115232259 >> v2:172.21.15.179:3300/0 conn(0x7fbfbc0cfc40 0x7fbfbc15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.879+0000 7fbfc2038640 1 --2- 172.21.15.146:0/3115232259 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0b3360 0x7fbfbc072df0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.879+0000 7fbfc2038640 1 -- 172.21.15.146:0/3115232259 >> 172.21.15.146:0/3115232259 conn(0x7fbfbc0b2060 msgr2=0x7fbfbc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:54.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.879+0000 7fbfc2038640 1 -- 172.21.15.146:0/3115232259 shutdown_connections 2024-09-17T03:41:54.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.879+0000 7fbfc2038640 1 -- 172.21.15.146:0/3115232259 wait complete. 2024-09-17T03:41:54.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.881+0000 7fbfc2038640 1 Processor -- start 2024-09-17T03:41:54.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.881+0000 7fbfc2038640 1 -- start start 2024-09-17T03:41:54.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.882+0000 7fbfc2038640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc0b3360 0x7fbfbc1469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:54.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.882+0000 7fbfc2038640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0cfc40 0x7fbfbc1472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:54.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.882+0000 7fbfc2038640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfbc15f010 0x7fbfbc1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:54.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.882+0000 7fbfc2038640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc06e800 con 0x7fbfbc15f010 2024-09-17T03:41:54.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.882+0000 7fbfc2038640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc06e680 con 0x7fbfbc0b3360 2024-09-17T03:41:54.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.882+0000 7fbfc2038640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbfbc06e980 con 0x7fbfbc0cfc40 2024-09-17T03:41:54.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfbc15f010 0x7fbfbc1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:54.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfbc15f010 0x7fbfbc1477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35998/0 (socket says 172.21.15.146:35998) 2024-09-17T03:41:54.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfbbfff640 1 -- 172.21.15.146:0/2711940183 learned_addr learned my addr 172.21.15.146:0/2711940183 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:54.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfbaffd640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0cfc40 0x7fbfbc1472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:54.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfbb7fe640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc0b3360 0x7fbfbc1469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:54.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfbbfff640 1 -- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0cfc40 msgr2=0x7fbfbc1472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:54.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfbbfff640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0cfc40 0x7fbfbc1472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfbbfff640 1 -- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc0b3360 msgr2=0x7fbfbc1469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:54.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfbbfff640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc0b3360 0x7fbfbc1469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:54.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfbbfff640 1 -- 172.21.15.146:0/2711940183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc0adc00 con 0x7fbfbc15f010 2024-09-17T03:41:54.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfbbfff640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfbc15f010 0x7fbfbc1477f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400cb10 tx=0x7fbfb400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:54.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfa3fff640 1 -- 172.21.15.146:0/2711940183 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4016020 con 0x7fbfbc15f010 2024-09-17T03:41:54.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfa3fff640 1 -- 172.21.15.146:0/2711940183 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfb400ad00 con 0x7fbfbc15f010 2024-09-17T03:41:54.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfc2038640 1 -- 172.21.15.146:0/2711940183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfbc15d900 con 0x7fbfbc15f010 2024-09-17T03:41:54.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfa3fff640 1 -- 172.21.15.146:0/2711940183 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4012680 con 0x7fbfbc15f010 2024-09-17T03:41:54.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.883+0000 7fbfc2038640 1 -- 172.21.15.146:0/2711940183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfbc15dec0 con 0x7fbfbc15f010 2024-09-17T03:41:54.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.884+0000 7fbfc2038640 1 -- 172.21.15.146:0/2711940183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfbc072df0 con 0x7fbfbc15f010 2024-09-17T03:41:54.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.885+0000 7fbfa3fff640 1 -- 172.21.15.146:0/2711940183 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbfb4019020 con 0x7fbfbc15f010 2024-09-17T03:41:54.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.886+0000 7fbfa3fff640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfa8078b90 0x7fbfa807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:54.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.886+0000 7fbfa3fff640 1 -- 172.21.15.146:0/2711940183 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4857+0+0 (secure 0 0 0) 0x7fbfb409aab0 con 0x7fbfbc15f010 2024-09-17T03:41:54.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.886+0000 7fbfbb7fe640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfa8078b90 0x7fbfa807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:54.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.886+0000 7fbfbb7fe640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfa8078b90 0x7fbfa807b0a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbfac034000 tx=0x7fbfac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:54.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:54.890+0000 7fbfa3fff640 1 -- 172.21.15.146:0/2711940183 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbfb4020030 con 0x7fbfbc15f010 2024-09-17T03:41:55.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.133+0000 7fbfc2038640 1 -- 172.21.15.146:0/2711940183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbfbc0699f0 con 0x7fbfbc15f010 2024-09-17T03:41:55.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.134+0000 7fbfa3fff640 1 -- 172.21.15.146:0/2711940183 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7fbfbc15f420 con 0x7fbfbc15f010 2024-09-17T03:41:55.134 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:55.134 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:41:55.134 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:41:55.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.134 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:41:55.134 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.135 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:41:55.136 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.138 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.139 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.140 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.141 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.142 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:41:55.144 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:41:55.145 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:41:55.146 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.146 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.146 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.146 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:41:55.146 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:41:55.146 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.146 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:41:55.146 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:41:55.146 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:41:55.146 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.147 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.147 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.147 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:41:55.147 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:41:55.147 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.147 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:41:55.147 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:41:55.147 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.147 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.147 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:41:55.148 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.148 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:41:55.148 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:41:55.148 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:41:55.148 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:41:55.148 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:41:55.148 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:41:55.148 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.148 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.148 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:41:55.148 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:41:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 -- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfa8078b90 msgr2=0x7fbfa807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfa8078b90 0x7fbfa807b0a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbfac034000 tx=0x7fbfac004730 comp rx=0 tx=0).stop 2024-09-17T03:41:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 -- 172.21.15.146:0/2711940183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfbc15f010 msgr2=0x7fbfbc1477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfbc15f010 0x7fbfbc1477f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400cb10 tx=0x7fbfb400a060 comp rx=0 tx=0).stop 2024-09-17T03:41:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 -- 172.21.15.146:0/2711940183 shutdown_connections 2024-09-17T03:41:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbfa8078b90 0x7fbfa807b0a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbfbc15f010 0x7fbfbc1477f0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbfbc0cfc40 0x7fbfbc1472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 --2- 172.21.15.146:0/2711940183 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbfbc0b3360 0x7fbfbc1469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 -- 172.21.15.146:0/2711940183 >> 172.21.15.146:0/2711940183 conn(0x7fbfbc0b2060 msgr2=0x7fbfbc0b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:55.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 -- 172.21.15.146:0/2711940183 shutdown_connections 2024-09-17T03:41:55.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.136+0000 7fbfc2038640 1 -- 172.21.15.146:0/2711940183 wait complete. 2024-09-17T03:41:55.151 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:41:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.265+0000 7f3aa3c69640 1 -- 172.21.15.146:0/3489355972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c0701e0 msgr2=0x7f3a9c0cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.265+0000 7f3aa3c69640 1 --2- 172.21.15.146:0/3489355972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c0701e0 0x7f3a9c0cfea0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f3a94005fd0 tx=0x7f3a9402a670 comp rx=0 tx=0).stop 2024-09-17T03:41:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.265+0000 7f3aa3c69640 1 -- 172.21.15.146:0/3489355972 shutdown_connections 2024-09-17T03:41:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.265+0000 7f3aa3c69640 1 --2- 172.21.15.146:0/3489355972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c0701e0 0x7f3a9c0cfea0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.265+0000 7f3aa3c69640 1 -- 172.21.15.146:0/3489355972 >> 172.21.15.146:0/3489355972 conn(0x7f3a9c06d3c0 msgr2=0x7f3a9c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.265+0000 7f3aa3c69640 1 -- 172.21.15.146:0/3489355972 shutdown_connections 2024-09-17T03:41:55.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.265+0000 7f3aa3c69640 1 -- 172.21.15.146:0/3489355972 wait complete. 2024-09-17T03:41:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.267+0000 7f3aa3c69640 1 Processor -- start 2024-09-17T03:41:55.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.267+0000 7f3aa3c69640 1 -- start start 2024-09-17T03:41:55.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.268+0000 7f3aa3c69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a9c0b4100 0x7f3a9c1403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.268+0000 7f3aa3c69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c143680 0x7f3a9c0d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.268+0000 7f3aa3c69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a9c0d10d0 0x7f3a9c1f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.268+0000 7f3aa3c69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c0d0560 con 0x7f3a9c143680 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.268+0000 7f3aa3c69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c0d03e0 con 0x7f3a9c0b4100 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.268+0000 7f3aa3c69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9c0d06e0 con 0x7f3a9c0d10d0 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa1204640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c143680 0x7f3a9c0d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa1204640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c143680 0x7f3a9c0d0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36010/0 (socket says 172.21.15.146:36010) 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa1204640 1 -- 172.21.15.146:0/2596636057 learned_addr learned my addr 172.21.15.146:0/2596636057 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa1a05640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a9c0b4100 0x7f3a9c1403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa2206640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a9c0d10d0 0x7f3a9c1f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa1204640 1 -- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a9c0d10d0 msgr2=0x7f3a9c1f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:55.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa1204640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a9c0d10d0 0x7f3a9c1f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa1204640 1 -- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a9c0b4100 msgr2=0x7f3a9c1403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:55.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa1204640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a9c0b4100 0x7f3a9c1403f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa1204640 1 -- 172.21.15.146:0/2596636057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c140930 con 0x7f3a9c143680 2024-09-17T03:41:55.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa1204640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c143680 0x7f3a9c0d0b90 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c3a0 tx=0x7f3a8c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:55.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3a927fc640 1 -- 172.21.15.146:0/2596636057 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c017070 con 0x7f3a9c143680 2024-09-17T03:41:55.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3a927fc640 1 -- 172.21.15.146:0/2596636057 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a8c0035f0 con 0x7f3a9c143680 2024-09-17T03:41:55.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa3c69640 1 -- 172.21.15.146:0/2596636057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9c0d14e0 con 0x7f3a9c143680 2024-09-17T03:41:55.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3a927fc640 1 -- 172.21.15.146:0/2596636057 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c003a40 con 0x7f3a9c143680 2024-09-17T03:41:55.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.269+0000 7f3aa3c69640 1 -- 172.21.15.146:0/2596636057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9c1f19c0 con 0x7f3a9c143680 2024-09-17T03:41:55.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.270+0000 7f3aa3c69640 1 -- 172.21.15.146:0/2596636057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a9c15c9f0 con 0x7f3a9c143680 2024-09-17T03:41:55.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.271+0000 7f3a927fc640 1 -- 172.21.15.146:0/2596636057 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a8c01a070 con 0x7f3a9c143680 2024-09-17T03:41:55.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.272+0000 7f3a927fc640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a80078bc0 0x7f3a8007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:55.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.272+0000 7f3a927fc640 1 -- 172.21.15.146:0/2596636057 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4857+0+0 (secure 0 0 0) 0x7f3a8c099bf0 con 0x7f3a9c143680 2024-09-17T03:41:55.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.272+0000 7f3aa1a05640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a80078bc0 0x7f3a8007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:55.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.272+0000 7f3aa1a05640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a80078bc0 0x7f3a8007b0d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3a980012e0 tx=0x7f3a98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:55.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.276+0000 7f3a927fc640 1 -- 172.21.15.146:0/2596636057 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a9c0d14e0 con 0x7f3a9c143680 2024-09-17T03:41:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.453+0000 7f3aa3c69640 1 -- 172.21.15.146:0/2596636057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3a9c1f1ef0 con 0x7f3a9c143680 2024-09-17T03:41:55.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.454+0000 7f3a927fc640 1 -- 172.21.15.146:0/2596636057 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v139) ==== 84+0+65 (secure 0 0 0) 0x7f3a9c140930 con 0x7f3a9c143680 2024-09-17T03:41:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:55.454 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:41:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:41:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:41:55.454 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:41:55.455 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:41:55.455 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:41:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 -- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a80078bc0 msgr2=0x7f3a8007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a80078bc0 0x7f3a8007b0d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3a980012e0 tx=0x7f3a98009040 comp rx=0 tx=0).stop 2024-09-17T03:41:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 -- 172.21.15.146:0/2596636057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c143680 msgr2=0x7f3a9c0d0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:55.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c143680 0x7f3a9c0d0b90 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00c3a0 tx=0x7f3a8c00c860 comp rx=0 tx=0).stop 2024-09-17T03:41:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 -- 172.21.15.146:0/2596636057 shutdown_connections 2024-09-17T03:41:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a80078bc0 0x7f3a8007b0d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a9c0d10d0 0x7f3a9c1f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a9c143680 0x7f3a9c0d0b90 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 --2- 172.21.15.146:0/2596636057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a9c0b4100 0x7f3a9c1403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 -- 172.21.15.146:0/2596636057 >> 172.21.15.146:0/2596636057 conn(0x7f3a9c06d3c0 msgr2=0x7f3a9c1526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 -- 172.21.15.146:0/2596636057 shutdown_connections 2024-09-17T03:41:55.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.456+0000 7f3aa3c69640 1 -- 172.21.15.146:0/2596636057 wait complete. 2024-09-17T03:41:55.467 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:41:55.468 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:41:55.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.584+0000 7f7909a69640 1 -- 172.21.15.146:0/4218518750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78ec004800 msgr2=0x7f78ec004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:55.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.585+0000 7f7909a69640 1 --2- 172.21.15.146:0/4218518750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78ec004800 0x7f78ec004c10 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009b40 tx=0x7f78ec005830 comp rx=0 tx=0).stop 2024-09-17T03:41:55.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.585+0000 7f7903fff640 1 -- 172.21.15.146:0/4218518750 reap_dead start 2024-09-17T03:41:55.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.585+0000 7f7909a69640 1 -- 172.21.15.146:0/4218518750 shutdown_connections 2024-09-17T03:41:55.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.585+0000 7f7909a69640 1 -- 172.21.15.146:0/4218518750 >> 172.21.15.146:0/4218518750 conn(0x7f79040b2060 msgr2=0x7f79040b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:55.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.585+0000 7f7909a69640 1 -- 172.21.15.146:0/4218518750 shutdown_connections 2024-09-17T03:41:55.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.585+0000 7f7909a69640 1 -- 172.21.15.146:0/4218518750 wait complete. 2024-09-17T03:41:55.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.586+0000 7f7909a69640 1 Processor -- start 2024-09-17T03:41:55.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.587+0000 7f7909a69640 1 -- start start 2024-09-17T03:41:55.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f7909a69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78ec004800 0x7f7904148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:55.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f7909a69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79040c52d0 0x7f79041f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:55.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f7909a69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79041f6f90 0x7f79040aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:55.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f7909a69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7904072c10 con 0x7f78ec004800 2024-09-17T03:41:55.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f7909a69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7904072a90 con 0x7f79041f6f90 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f7909a69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7904072d90 con 0x7f79040c52d0 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f79037fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78ec004800 0x7f7904148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f79037fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78ec004800 0x7f7904148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36040/0 (socket says 172.21.15.146:36040) 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f79037fe640 1 -- 172.21.15.146:0/857243868 learned_addr learned my addr 172.21.15.146:0/857243868 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f7902ffd640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79040c52d0 0x7f79041f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f7903fff640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79041f6f90 0x7f79040aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f79037fe640 1 -- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79040c52d0 msgr2=0x7f79041f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f79037fe640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79040c52d0 0x7f79041f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f79037fe640 1 -- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79041f6f90 msgr2=0x7f79040aa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f79037fe640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79041f6f90 0x7f79040aa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f79037fe640 1 -- 172.21.15.146:0/857243868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79041f73a0 con 0x7f78ec004800 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f7902ffd640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79040c52d0 0x7f79041f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:55.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f7903fff640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79041f6f90 0x7f79040aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.588+0000 7f79037fe640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78ec004800 0x7f7904148e70 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f78f4003f80 tx=0x7f78f40016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.589+0000 7f78ebfff640 1 -- 172.21.15.146:0/857243868 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4016030 con 0x7f78ec004800 2024-09-17T03:41:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.589+0000 7f78ebfff640 1 -- 172.21.15.146:0/857243868 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78f4011700 con 0x7f78ec004800 2024-09-17T03:41:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.589+0000 7f78ebfff640 1 -- 172.21.15.146:0/857243868 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4011b30 con 0x7f78ec004800 2024-09-17T03:41:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.589+0000 7f7909a69640 1 -- 172.21.15.146:0/857243868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79040ad1c0 con 0x7f78ec004800 2024-09-17T03:41:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.589+0000 7f7909a69640 1 -- 172.21.15.146:0/857243868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79040ad780 con 0x7f78ec004800 2024-09-17T03:41:55.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.590+0000 7f7909a69640 1 -- 172.21.15.146:0/857243868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79040b51c0 con 0x7f78ec004800 2024-09-17T03:41:55.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.590+0000 7f78ebfff640 1 -- 172.21.15.146:0/857243868 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78f4019070 con 0x7f78ec004800 2024-09-17T03:41:55.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.591+0000 7f78ebfff640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78f0078b90 0x7f78f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:55.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.591+0000 7f78ebfff640 1 -- 172.21.15.146:0/857243868 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4857+0+0 (secure 0 0 0) 0x7f78f409b160 con 0x7f78ec004800 2024-09-17T03:41:55.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.591+0000 7f7902ffd640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78f0078b90 0x7f78f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:55.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.591+0000 7f7902ffd640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78f0078b90 0x7f78f007b0a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f78f8035000 tx=0x7f78f802d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.595+0000 7f78ebfff640 1 -- 172.21.15.146:0/857243868 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f79041f73a0 con 0x7f78ec004800 2024-09-17T03:41:55.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:55.772+0000 7f7909a69640 1 -- 172.21.15.146:0/857243868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f79040d0dd0 con 0x7f78ec004800 2024-09-17T03:41:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.755+0000 7f78ebfff640 1 -- 172.21.15.146:0/857243868 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v140) ==== 138+0+0 (secure 0 0 0) 0x7f7904072fd0 con 0x7f78ec004800 2024-09-17T03:41:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:41:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.758+0000 7f7909a69640 1 -- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78f0078b90 msgr2=0x7f78f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.758+0000 7f7909a69640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78f0078b90 0x7f78f007b0a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f78f8035000 tx=0x7f78f802d040 comp rx=0 tx=0).stop 2024-09-17T03:41:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.758+0000 7f7909a69640 1 -- 172.21.15.146:0/857243868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78ec004800 msgr2=0x7f7904148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.758+0000 7f7909a69640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78ec004800 0x7f7904148e70 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f78f4003f80 tx=0x7f78f40016f0 comp rx=0 tx=0).stop 2024-09-17T03:41:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.759+0000 7f7909a69640 1 -- 172.21.15.146:0/857243868 shutdown_connections 2024-09-17T03:41:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.759+0000 7f7909a69640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f78f0078b90 0x7f78f007b0a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.759+0000 7f7909a69640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79041f6f90 0x7f79040aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.759+0000 7f7909a69640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79040c52d0 0x7f79041f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.759+0000 7f7909a69640 1 --2- 172.21.15.146:0/857243868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78ec004800 0x7f7904148e70 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.759+0000 7f7909a69640 1 -- 172.21.15.146:0/857243868 >> 172.21.15.146:0/857243868 conn(0x7f79040b2060 msgr2=0x7f790415e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:56.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.759+0000 7f7909a69640 1 -- 172.21.15.146:0/857243868 shutdown_connections 2024-09-17T03:41:56.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.759+0000 7f7909a69640 1 -- 172.21.15.146:0/857243868 wait complete. 2024-09-17T03:41:56.776 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:41:56.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.903+0000 7facfc6ce640 1 -- 172.21.15.146:0/4073110054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf415c8e0 msgr2=0x7facf40b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:56.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.903+0000 7facfc6ce640 1 --2- 172.21.15.146:0/4073110054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf415c8e0 0x7facf40b1120 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7facf40744e0 tx=0x7face402a980 comp rx=0 tx=0).stop 2024-09-17T03:41:56.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.903+0000 7facfc6ce640 1 -- 172.21.15.146:0/4073110054 shutdown_connections 2024-09-17T03:41:56.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.903+0000 7facfc6ce640 1 --2- 172.21.15.146:0/4073110054 >> v2:172.21.15.179:3300/0 conn(0x7facf40b5eb0 0x7facf40b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:56.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.903+0000 7facfc6ce640 1 --2- 172.21.15.146:0/4073110054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf415c8e0 0x7facf40b1120 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:56.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.903+0000 7facfc6ce640 1 -- 172.21.15.146:0/4073110054 >> 172.21.15.146:0/4073110054 conn(0x7facf409ba20 msgr2=0x7facf40b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:56.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.903+0000 7facfc6ce640 1 -- 172.21.15.146:0/4073110054 shutdown_connections 2024-09-17T03:41:56.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.903+0000 7facfc6ce640 1 -- 172.21.15.146:0/4073110054 wait complete. 2024-09-17T03:41:56.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.905+0000 7facfc6ce640 1 Processor -- start 2024-09-17T03:41:56.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.905+0000 7facfc6ce640 1 -- start start 2024-09-17T03:41:56.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.906+0000 7facfc6ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facf40b6590 0x7facf41471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:56.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.906+0000 7facfc6ce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf415c8e0 0x7facf4158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:56.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.906+0000 7facfc6ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf415afb0 0x7facf415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:56.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.906+0000 7facfc6ce640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7facf40b20a0 con 0x7facf415c8e0 2024-09-17T03:41:56.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.906+0000 7facfc6ce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7facf40b1f20 con 0x7facf40b6590 2024-09-17T03:41:56.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.906+0000 7facfc6ce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7facf40b2220 con 0x7facf415afb0 2024-09-17T03:41:56.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.906+0000 7facf9c69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf415c8e0 0x7facf4158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:56.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.906+0000 7facf9c69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf415c8e0 0x7facf4158010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36068/0 (socket says 172.21.15.146:36068) 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.906+0000 7facf9c69640 1 -- 172.21.15.146:0/809259131 learned_addr learned my addr 172.21.15.146:0/809259131 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.906+0000 7facfac6b640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf415afb0 0x7facf415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.906+0000 7facfa46a640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facf40b6590 0x7facf41471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facf9c69640 1 -- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf415afb0 msgr2=0x7facf415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facf9c69640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf415afb0 0x7facf415b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facf9c69640 1 -- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facf40b6590 msgr2=0x7facf41471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facf9c69640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facf40b6590 0x7facf41471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facf9c69640 1 -- 172.21.15.146:0/809259131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf415b900 con 0x7facf415c8e0 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facfa46a640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facf40b6590 0x7facf41471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facf9c69640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf415c8e0 0x7facf4158010 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7face800b3f0 tx=0x7face800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facf2ffd640 1 -- 172.21.15.146:0/809259131 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8015020 con 0x7facf415c8e0 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facf2ffd640 1 -- 172.21.15.146:0/809259131 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7face8011920 con 0x7facf415c8e0 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facfc6ce640 1 -- 172.21.15.146:0/809259131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf409cd90 con 0x7facf415c8e0 2024-09-17T03:41:56.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facf2ffd640 1 -- 172.21.15.146:0/809259131 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8011d70 con 0x7facf415c8e0 2024-09-17T03:41:56.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.907+0000 7facfc6ce640 1 -- 172.21.15.146:0/809259131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf409cab0 con 0x7facf415c8e0 2024-09-17T03:41:56.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.908+0000 7facfc6ce640 1 -- 172.21.15.146:0/809259131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf40b26f0 con 0x7facf415c8e0 2024-09-17T03:41:56.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.909+0000 7facf2ffd640 1 -- 172.21.15.146:0/809259131 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7face8018020 con 0x7facf415c8e0 2024-09-17T03:41:56.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.909+0000 7facf2ffd640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7face0078bc0 0x7face007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.909+0000 7facf2ffd640 1 -- 172.21.15.146:0/809259131 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5227+0+0 (secure 0 0 0) 0x7face809ae80 con 0x7facf415c8e0 2024-09-17T03:41:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.910+0000 7facfa46a640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7face0078bc0 0x7face007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:56.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.910+0000 7facfa46a640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7face0078bc0 0x7face007b0d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7face4035000 tx=0x7face4004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:56.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:56.913+0000 7facf2ffd640 1 -- 172.21.15.146:0/809259131 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7face801f030 con 0x7facf415c8e0 2024-09-17T03:41:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.090+0000 7facfc6ce640 1 -- 172.21.15.146:0/809259131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7facf4072110 con 0x7facf415c8e0 2024-09-17T03:41:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.762+0000 7facf2ffd640 1 -- 172.21.15.146:0/809259131 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v141) ==== 170+0+0 (secure 0 0 0) 0x7facf415b900 con 0x7facf415c8e0 2024-09-17T03:41:57.763 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:41:57.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 -- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7face0078bc0 msgr2=0x7face007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:57.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7face0078bc0 0x7face007b0d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7face4035000 tx=0x7face4004ab0 comp rx=0 tx=0).stop 2024-09-17T03:41:57.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 -- 172.21.15.146:0/809259131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf415c8e0 msgr2=0x7facf4158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:57.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf415c8e0 0x7facf4158010 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7face800b3f0 tx=0x7face800b8b0 comp rx=0 tx=0).stop 2024-09-17T03:41:57.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 -- 172.21.15.146:0/809259131 shutdown_connections 2024-09-17T03:41:57.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7face0078bc0 0x7face007b0d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:57.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facf415afb0 0x7facf415b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:57.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf415c8e0 0x7facf4158010 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:57.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 --2- 172.21.15.146:0/809259131 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facf40b6590 0x7facf41471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:57.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 -- 172.21.15.146:0/809259131 >> 172.21.15.146:0/809259131 conn(0x7facf409ba20 msgr2=0x7facf4160d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:57.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 -- 172.21.15.146:0/809259131 shutdown_connections 2024-09-17T03:41:57.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.767+0000 7facfc6ce640 1 -- 172.21.15.146:0/809259131 wait complete. 2024-09-17T03:41:57.793 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:41:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.912+0000 7f65c397b640 1 -- 172.21.15.146:0/565188676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a4004d40 msgr2=0x7f65a4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.912+0000 7f65c397b640 1 --2- 172.21.15.146:0/565188676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a4004d40 0x7f65a4005190 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0d2530 tx=0x7f65a4005830 comp rx=0 tx=0).stop 2024-09-17T03:41:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.912+0000 7f65c1f18640 1 -- 172.21.15.146:0/565188676 reap_dead start 2024-09-17T03:41:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.912+0000 7f65c397b640 1 -- 172.21.15.146:0/565188676 shutdown_connections 2024-09-17T03:41:57.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.912+0000 7f65c397b640 1 -- 172.21.15.146:0/565188676 >> 172.21.15.146:0/565188676 conn(0x7f65bc0b3410 msgr2=0x7f65bc0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.912+0000 7f65c397b640 1 -- 172.21.15.146:0/565188676 shutdown_connections 2024-09-17T03:41:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.912+0000 7f65c397b640 1 -- 172.21.15.146:0/565188676 wait complete. 2024-09-17T03:41:57.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.914+0000 7f65c397b640 1 Processor -- start 2024-09-17T03:41:57.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.914+0000 7f65c397b640 1 -- start start 2024-09-17T03:41:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c397b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a4004d40 0x7f65bc154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c397b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65bc155520 0x7f65bc142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:57.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c397b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65bc1f3c40 0x7f65bc0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c397b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc0b4cd0 con 0x7f65a4004d40 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c397b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc0b4b50 con 0x7f65bc155520 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c397b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f65bc1f2f60 con 0x7f65bc1f3c40 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c1717640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a4004d40 0x7f65bc154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c1717640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a4004d40 0x7f65bc154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59292/0 (socket says 172.21.15.146:59292) 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c1717640 1 -- 172.21.15.146:0/206872071 learned_addr learned my addr 172.21.15.146:0/206872071 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c1f18640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65bc1f3c40 0x7f65bc0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c0f16640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65bc155520 0x7f65bc142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c1717640 1 -- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65bc1f3c40 msgr2=0x7f65bc0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c1717640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65bc1f3c40 0x7f65bc0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c1717640 1 -- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65bc155520 msgr2=0x7f65bc142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c1717640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65bc155520 0x7f65bc142950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c1717640 1 -- 172.21.15.146:0/206872071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc1f3180 con 0x7f65a4004d40 2024-09-17T03:41:57.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.915+0000 7f65c0f16640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65bc155520 0x7f65bc142950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:41:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.916+0000 7f65c1717640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a4004d40 0x7f65bc154fe0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0019f0 tx=0x7f65ac001eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.916+0000 7f65b9ffb640 1 -- 172.21.15.146:0/206872071 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac015070 con 0x7f65a4004d40 2024-09-17T03:41:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.916+0000 7f65b9ffb640 1 -- 172.21.15.146:0/206872071 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65ac00ed60 con 0x7f65a4004d40 2024-09-17T03:41:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.916+0000 7f65c397b640 1 -- 172.21.15.146:0/206872071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65bc143680 con 0x7f65a4004d40 2024-09-17T03:41:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.916+0000 7f65b9ffb640 1 -- 172.21.15.146:0/206872071 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac003bb0 con 0x7f65a4004d40 2024-09-17T03:41:57.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.916+0000 7f65c397b640 1 -- 172.21.15.146:0/206872071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65bc1f3720 con 0x7f65a4004d40 2024-09-17T03:41:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.917+0000 7f65c397b640 1 -- 172.21.15.146:0/206872071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65bc070be0 con 0x7f65a4004d40 2024-09-17T03:41:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.918+0000 7f65b9ffb640 1 -- 172.21.15.146:0/206872071 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f65ac004020 con 0x7f65a4004d40 2024-09-17T03:41:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.918+0000 7f65b9ffb640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65a8078b90 0x7f65a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.918+0000 7f65b9ffb640 1 -- 172.21.15.146:0/206872071 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5609+0+0 (secure 0 0 0) 0x7f65ac09b6a0 con 0x7f65a4004d40 2024-09-17T03:41:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.919+0000 7f65c0f16640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65a8078b90 0x7f65a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:57.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.919+0000 7f65c0f16640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65a8078b90 0x7f65a807b0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0d21e0 tx=0x7f65b0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:57.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:57.923+0000 7f65b9ffb640 1 -- 172.21.15.146:0/206872071 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f65ac063bd0 con 0x7f65a4004d40 2024-09-17T03:41:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.134+0000 7f65c397b640 1 -- 172.21.15.146:0/206872071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f65bc0699c0 con 0x7f65a4004d40 2024-09-17T03:41:58.732 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:41:58.734 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:41:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.777+0000 7f65b9ffb640 1 -- 172.21.15.146:0/206872071 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v100) ==== 174+0+0 (secure 0 0 0) 0x7f65ac0634d0 con 0x7f65a4004d40 2024-09-17T03:41:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 20 and data pool 21 2024-09-17T03:41:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.787+0000 7f65c397b640 1 -- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65a8078b90 msgr2=0x7f65a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.787+0000 7f65c397b640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65a8078b90 0x7f65a807b0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0d21e0 tx=0x7f65b0005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.787+0000 7f65c397b640 1 -- 172.21.15.146:0/206872071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a4004d40 msgr2=0x7f65bc154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.787+0000 7f65c397b640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a4004d40 0x7f65bc154fe0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0019f0 tx=0x7f65ac001eb0 comp rx=0 tx=0).stop 2024-09-17T03:41:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.787+0000 7f65c397b640 1 -- 172.21.15.146:0/206872071 shutdown_connections 2024-09-17T03:41:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.787+0000 7f65c397b640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f65a8078b90 0x7f65a807b0a0 secure :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0d21e0 tx=0x7f65b0005f90 comp rx=0 tx=0).stop 2024-09-17T03:41:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.787+0000 7f65c397b640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65bc1f3c40 0x7f65bc0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.787+0000 7f65c397b640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65bc155520 0x7f65bc142950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.787+0000 7f65c397b640 1 --2- 172.21.15.146:0/206872071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65a4004d40 0x7f65bc154fe0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.787+0000 7f65c397b640 1 -- 172.21.15.146:0/206872071 >> 172.21.15.146:0/206872071 conn(0x7f65bc0b3410 msgr2=0x7f65bc0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.789+0000 7f65c397b640 1 -- 172.21.15.146:0/206872071 shutdown_connections 2024-09-17T03:41:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.789+0000 7f65c397b640 1 -- 172.21.15.146:0/206872071 wait complete. 2024-09-17T03:41:58.807 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:41:58.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.961+0000 7fea5d4c5640 1 -- 172.21.15.146:0/2849748146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea580b55f0 msgr2=0x7fea58070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:58.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.961+0000 7fea5d4c5640 1 --2- 172.21.15.146:0/2849748146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea580b55f0 0x7fea58070be0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fea580b0700 tx=0x7fea5002a560 comp rx=0 tx=0).stop 2024-09-17T03:41:58.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.961+0000 7fea5d4c5640 1 -- 172.21.15.146:0/2849748146 shutdown_connections 2024-09-17T03:41:58.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.961+0000 7fea5d4c5640 1 --2- 172.21.15.146:0/2849748146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea580b4a70 0x7fea5806dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:58.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.961+0000 7fea5d4c5640 1 --2- 172.21.15.146:0/2849748146 >> v2:172.21.15.179:3300/0 conn(0x7fea58071120 0x7fea580b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:58.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.961+0000 7fea5d4c5640 1 --2- 172.21.15.146:0/2849748146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea580b55f0 0x7fea58070be0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:58.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.961+0000 7fea5d4c5640 1 -- 172.21.15.146:0/2849748146 >> 172.21.15.146:0/2849748146 conn(0x7fea580b3410 msgr2=0x7fea580b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:58.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.961+0000 7fea5d4c5640 1 -- 172.21.15.146:0/2849748146 shutdown_connections 2024-09-17T03:41:58.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.961+0000 7fea5d4c5640 1 -- 172.21.15.146:0/2849748146 wait complete. 2024-09-17T03:41:58.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.963+0000 7fea5d4c5640 1 Processor -- start 2024-09-17T03:41:58.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.963+0000 7fea5d4c5640 1 -- start start 2024-09-17T03:41:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.964+0000 7fea5d4c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea58071120 0x7fea58140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.964+0000 7fea5d4c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea580b4a70 0x7fea58159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea5d4c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea580b55f0 0x7fea5806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea5d4c5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea5806e630 con 0x7fea58071120 2024-09-17T03:41:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea5d4c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fea5806e4b0 con 0x7fea580b55f0 2024-09-17T03:41:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea5d4c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fea5815bd10 con 0x7fea580b4a70 2024-09-17T03:41:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea56ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea58071120 0x7fea58140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea56ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea58071120 0x7fea58140ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59298/0 (socket says 172.21.15.146:59298) 2024-09-17T03:41:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea56ffd640 1 -- 172.21.15.146:0/1549130386 learned_addr learned my addr 172.21.15.146:0/1549130386 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea567fc640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea580b4a70 0x7fea58159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea577fe640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea580b55f0 0x7fea5806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea56ffd640 1 -- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea580b4a70 msgr2=0x7fea58159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea56ffd640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea580b4a70 0x7fea58159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea56ffd640 1 -- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea580b55f0 msgr2=0x7fea5806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea56ffd640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea580b55f0 0x7fea5806cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea56ffd640 1 -- 172.21.15.146:0/1549130386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea58143340 con 0x7fea58071120 2024-09-17T03:41:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea577fe640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea580b55f0 0x7fea5806cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea56ffd640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea58071120 0x7fea58140ae0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fea50000c00 tx=0x7fea50003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea3f7fe640 1 -- 172.21.15.146:0/1549130386 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5003e030 con 0x7fea58071120 2024-09-17T03:41:58.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea3f7fe640 1 -- 172.21.15.146:0/1549130386 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea50003e00 con 0x7fea58071120 2024-09-17T03:41:58.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea5d4c5640 1 -- 172.21.15.146:0/1549130386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea58141020 con 0x7fea58071120 2024-09-17T03:41:58.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea3f7fe640 1 -- 172.21.15.146:0/1549130386 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50035040 con 0x7fea58071120 2024-09-17T03:41:58.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.965+0000 7fea5d4c5640 1 -- 172.21.15.146:0/1549130386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea581438d0 con 0x7fea58071120 2024-09-17T03:41:58.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.966+0000 7fea5d4c5640 1 -- 172.21.15.146:0/1549130386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5806dd60 con 0x7fea58071120 2024-09-17T03:41:58.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.967+0000 7fea3f7fe640 1 -- 172.21.15.146:0/1549130386 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea50041030 con 0x7fea58071120 2024-09-17T03:41:58.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.967+0000 7fea3f7fe640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea44078b90 0x7fea4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:58.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.968+0000 7fea3f7fe640 1 -- 172.21.15.146:0/1549130386 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fea500bb290 con 0x7fea58071120 2024-09-17T03:41:58.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.968+0000 7fea567fc640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea44078b90 0x7fea4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:58.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.968+0000 7fea567fc640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea44078b90 0x7fea4407b0a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fea5815bca0 tx=0x7fea4c0095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:58.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:58.972+0000 7fea3f7fe640 1 -- 172.21.15.146:0/1549130386 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea500831a0 con 0x7fea58071120 2024-09-17T03:41:59.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.148+0000 7fea5d4c5640 1 -- 172.21.15.146:0/1549130386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea580b29e0 con 0x7fea58071120 2024-09-17T03:41:59.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.149+0000 7fea3f7fe640 1 -- 172.21.15.146:0/1549130386 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16800 (secure 0 0 0) 0x7fea50087bd0 con 0x7fea58071120 2024-09-17T03:41:59.149 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:59.150 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":142,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:41:58.134820+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:41:55.777474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T03:41:57.096388+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:41:59.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 -- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea44078b90 msgr2=0x7fea4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:59.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea44078b90 0x7fea4407b0a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fea5815bca0 tx=0x7fea4c0095e0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 -- 172.21.15.146:0/1549130386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea58071120 msgr2=0x7fea58140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:59.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea58071120 0x7fea58140ae0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fea50000c00 tx=0x7fea50003910 comp rx=0 tx=0).stop 2024-09-17T03:41:59.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 -- 172.21.15.146:0/1549130386 shutdown_connections 2024-09-17T03:41:59.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea44078b90 0x7fea4407b0a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea580b55f0 0x7fea5806cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea580b4a70 0x7fea58159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 --2- 172.21.15.146:0/1549130386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea58071120 0x7fea58140ae0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 -- 172.21.15.146:0/1549130386 >> 172.21.15.146:0/1549130386 conn(0x7fea580b3410 msgr2=0x7fea580b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 -- 172.21.15.146:0/1549130386 shutdown_connections 2024-09-17T03:41:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.152+0000 7fea5d4c5640 1 -- 172.21.15.146:0/1549130386 wait complete. 2024-09-17T03:41:59.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:41:59.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.277+0000 7f78827ba640 1 -- 172.21.15.146:0/2233657201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7864003a50 msgr2=0x7f7864003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.277+0000 7f78827ba640 1 --2- 172.21.15.146:0/2233657201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7864003a50 0x7f7864003ec0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f786c00c310 tx=0x7f7864005830 comp rx=0 tx=0).stop 2024-09-17T03:41:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.277+0000 7f78827ba640 1 -- 172.21.15.146:0/2233657201 shutdown_connections 2024-09-17T03:41:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.277+0000 7f78827ba640 1 --2- 172.21.15.146:0/2233657201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7864003a50 0x7f7864003ec0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.277+0000 7f78827ba640 1 -- 172.21.15.146:0/2233657201 >> 172.21.15.146:0/2233657201 conn(0x7f787c0b2060 msgr2=0x7f787c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.277+0000 7f78827ba640 1 -- 172.21.15.146:0/2233657201 shutdown_connections 2024-09-17T03:41:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.277+0000 7f78827ba640 1 -- 172.21.15.146:0/2233657201 wait complete. 2024-09-17T03:41:59.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.279+0000 7f78827ba640 1 Processor -- start 2024-09-17T03:41:59.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.279+0000 7f78827ba640 1 -- start start 2024-09-17T03:41:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.280+0000 7f78827ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7864003a50 0x7f787c147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.280+0000 7f78827ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f787c0ae730 0x7f787c0c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.280+0000 7f78827ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f787c150f20 0x7f787c0c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.280+0000 7f78827ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f787c15db00 con 0x7f787c0ae730 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.280+0000 7f78827ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f787c15d980 con 0x7f787c150f20 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.280+0000 7f78827ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f787c15dc80 con 0x7f7864003a50 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.280+0000 7f787b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f787c0ae730 0x7f787c0c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.280+0000 7f787b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f787c0ae730 0x7f787c0c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59324/0 (socket says 172.21.15.146:59324) 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.280+0000 7f787b7fe640 1 -- 172.21.15.146:0/1649364362 learned_addr learned my addr 172.21.15.146:0/1649364362 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f787b7fe640 1 -- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7864003a50 msgr2=0x7f787c147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f787bfff640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7864003a50 0x7f787c147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f7880d57640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f787c150f20 0x7f787c0c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:59.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f787b7fe640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7864003a50 0x7f787c147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f787b7fe640 1 -- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f787c150f20 msgr2=0x7f787c0c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f787b7fe640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f787c150f20 0x7f787c0c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f787b7fe640 1 -- 172.21.15.146:0/1649364362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c0aec40 con 0x7f787c0ae730 2024-09-17T03:41:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f787b7fe640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f787c0ae730 0x7f787c0c5b50 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f7870003f80 tx=0x7f78700016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f7878ff9640 1 -- 172.21.15.146:0/1649364362 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870011640 con 0x7f787c0ae730 2024-09-17T03:41:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f7878ff9640 1 -- 172.21.15.146:0/1649364362 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7870016020 con 0x7f787c0ae730 2024-09-17T03:41:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f78827ba640 1 -- 172.21.15.146:0/1649364362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c0aef20 con 0x7f787c0ae730 2024-09-17T03:41:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f7878ff9640 1 -- 172.21.15.146:0/1649364362 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870011a80 con 0x7f787c0ae730 2024-09-17T03:41:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.281+0000 7f78827ba640 1 -- 172.21.15.146:0/1649364362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c0af4e0 con 0x7f787c0ae730 2024-09-17T03:41:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.282+0000 7f78827ba640 1 -- 172.21.15.146:0/1649364362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c0ab4d0 con 0x7f787c0ae730 2024-09-17T03:41:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.283+0000 7f7878ff9640 1 -- 172.21.15.146:0/1649364362 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7870011c20 con 0x7f787c0ae730 2024-09-17T03:41:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.283+0000 7f7878ff9640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7868078b90 0x7f786807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.283+0000 7f7878ff9640 1 -- 172.21.15.146:0/1649364362 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f787009ba50 con 0x7f787c0ae730 2024-09-17T03:41:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.284+0000 7f787bfff640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7868078b90 0x7f786807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.284+0000 7f787bfff640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7868078b90 0x7f786807b0a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f786c033000 tx=0x7f787c070640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.288+0000 7f7878ff9640 1 -- 172.21.15.146:0/1649364362 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7870020020 con 0x7f787c0ae730 2024-09-17T03:41:59.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.463+0000 7f78827ba640 1 -- 172.21.15.146:0/1649364362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f787c160700 con 0x7f787c0ae730 2024-09-17T03:41:59.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.464+0000 7f7878ff9640 1 -- 172.21.15.146:0/1649364362 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16800 (secure 0 0 0) 0x7f7870063f30 con 0x7f787c0ae730 2024-09-17T03:41:59.464 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:41:59.464 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":142,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:41:58.134820+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:41:55.777474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T03:41:57.096388+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:41:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 -- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7868078b90 msgr2=0x7f786807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7868078b90 0x7f786807b0a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f786c033000 tx=0x7f787c070640 comp rx=0 tx=0).stop 2024-09-17T03:41:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 -- 172.21.15.146:0/1649364362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f787c0ae730 msgr2=0x7f787c0c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f787c0ae730 0x7f787c0c5b50 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f7870003f80 tx=0x7f78700016e0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 -- 172.21.15.146:0/1649364362 shutdown_connections 2024-09-17T03:41:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7868078b90 0x7f786807b0a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f787c150f20 0x7f787c0c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f787c0ae730 0x7f787c0c5b50 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 --2- 172.21.15.146:0/1649364362 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7864003a50 0x7f787c147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 -- 172.21.15.146:0/1649364362 >> 172.21.15.146:0/1649364362 conn(0x7f787c0b2060 msgr2=0x7f787c075f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 -- 172.21.15.146:0/1649364362 shutdown_connections 2024-09-17T03:41:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.466+0000 7f78827ba640 1 -- 172.21.15.146:0/1649364362 wait complete. 2024-09-17T03:41:59.478 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:41:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.595+0000 7fc036664640 1 -- 172.21.15.146:0/1936349206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03015b770 msgr2=0x7fc03006fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.595+0000 7fc036664640 1 --2- 172.21.15.146:0/1936349206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03015b770 0x7fc03006fe10 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fc030073180 tx=0x7fc02002a4b0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.595+0000 7fc036664640 1 -- 172.21.15.146:0/1936349206 shutdown_connections 2024-09-17T03:41:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.595+0000 7fc036664640 1 --2- 172.21.15.146:0/1936349206 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc030072bc0 0x7fc03015f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.595+0000 7fc036664640 1 --2- 172.21.15.146:0/1936349206 >> v2:172.21.15.179:3300/0 conn(0x7fc030070350 0x7fc030072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.595+0000 7fc036664640 1 --2- 172.21.15.146:0/1936349206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03015b770 0x7fc03006fe10 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.595+0000 7fc036664640 1 -- 172.21.15.146:0/1936349206 >> 172.21.15.146:0/1936349206 conn(0x7fc0300b2060 msgr2=0x7fc0300b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:41:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.595+0000 7fc036664640 1 -- 172.21.15.146:0/1936349206 shutdown_connections 2024-09-17T03:41:59.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.595+0000 7fc036664640 1 -- 172.21.15.146:0/1936349206 wait complete. 2024-09-17T03:41:59.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.597+0000 7fc036664640 1 Processor -- start 2024-09-17T03:41:59.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.597+0000 7fc036664640 1 -- start start 2024-09-17T03:41:59.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc036664640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc030070350 0x7fc0301f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:59.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc036664640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc030072bc0 0x7fc03014d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:59.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc036664640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc03015b770 0x7fc0301f9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:59.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc036664640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc03015fbb0 con 0x7fc030072bc0 2024-09-17T03:41:59.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc036664640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc03015fa30 con 0x7fc03015b770 2024-09-17T03:41:59.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc036664640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc03015fd30 con 0x7fc030070350 2024-09-17T03:41:59.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc030072bc0 0x7fc03014d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:59.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc030072bc0 0x7fc03014d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59352/0 (socket says 172.21.15.146:59352) 2024-09-17T03:41:59.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02f7fe640 1 -- 172.21.15.146:0/2417365544 learned_addr learned my addr 172.21.15.146:0/2417365544 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:41:59.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02ffff640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc030070350 0x7fc0301f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:59.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc034c01640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc03015b770 0x7fc0301f9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:59.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02f7fe640 1 -- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc030070350 msgr2=0x7fc0301f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02f7fe640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc030070350 0x7fc0301f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02f7fe640 1 -- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc03015b770 msgr2=0x7fc0301f9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02f7fe640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc03015b770 0x7fc0301f9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02f7fe640 1 -- 172.21.15.146:0/2417365544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03015e720 con 0x7fc030072bc0 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc034c01640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc03015b770 0x7fc0301f9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02f7fe640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc030072bc0 0x7fc03014d740 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fc02400c9a0 tx=0x7fc02400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02cff9640 1 -- 172.21.15.146:0/2417365544 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024004220 con 0x7fc030072bc0 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02cff9640 1 -- 172.21.15.146:0/2417365544 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0240044b0 con 0x7fc030072bc0 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc02cff9640 1 -- 172.21.15.146:0/2417365544 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024007c10 con 0x7fc030072bc0 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc036664640 1 -- 172.21.15.146:0/2417365544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03015ea00 con 0x7fc030072bc0 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.599+0000 7fc036664640 1 -- 172.21.15.146:0/2417365544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03015a930 con 0x7fc030072bc0 2024-09-17T03:41:59.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.600+0000 7fc036664640 1 -- 172.21.15.146:0/2417365544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc03015ac50 con 0x7fc030072bc0 2024-09-17T03:41:59.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.601+0000 7fc02cff9640 1 -- 172.21.15.146:0/2417365544 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc024005030 con 0x7fc030072bc0 2024-09-17T03:41:59.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.602+0000 7fc02cff9640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc01c078b90 0x7fc01c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:41:59.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.602+0000 7fc02cff9640 1 -- 172.21.15.146:0/2417365544 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fc02409b090 con 0x7fc030072bc0 2024-09-17T03:41:59.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.602+0000 7fc02ffff640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc01c078b90 0x7fc01c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:41:59.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.602+0000 7fc02ffff640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc01c078b90 0x7fc01c07b0a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc020033000 tx=0x7fc020004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:41:59.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.606+0000 7fc02cff9640 1 -- 172.21.15.146:0/2417365544 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc024014070 con 0x7fc030072bc0 2024-09-17T03:41:59.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:41:59.821+0000 7fc036664640 1 -- 172.21.15.146:0/2417365544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc03015f2e0 con 0x7fc030072bc0 2024-09-17T03:42:00.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.787+0000 7fc02cff9640 1 -- 172.21.15.146:0/2417365544 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v103) ==== 118+0+0 (secure 0 0 0) 0x7fc024062fa0 con 0x7fc030072bc0 2024-09-17T03:42:00.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 -- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc01c078b90 msgr2=0x7fc01c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:00.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc01c078b90 0x7fc01c07b0a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc020033000 tx=0x7fc020004730 comp rx=0 tx=0).stop 2024-09-17T03:42:00.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 -- 172.21.15.146:0/2417365544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc030072bc0 msgr2=0x7fc03014d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:00.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc030072bc0 0x7fc03014d740 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fc02400c9a0 tx=0x7fc02400ce60 comp rx=0 tx=0).stop 2024-09-17T03:42:00.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 -- 172.21.15.146:0/2417365544 shutdown_connections 2024-09-17T03:42:00.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc01c078b90 0x7fc01c07b0a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:00.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc03015b770 0x7fc0301f9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:00.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc030072bc0 0x7fc03014d740 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:00.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 --2- 172.21.15.146:0/2417365544 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc030070350 0x7fc0301f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:00.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 -- 172.21.15.146:0/2417365544 >> 172.21.15.146:0/2417365544 conn(0x7fc0300b2060 msgr2=0x7fc0300d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:00.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 -- 172.21.15.146:0/2417365544 shutdown_connections 2024-09-17T03:42:00.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.791+0000 7fc036664640 1 -- 172.21.15.146:0/2417365544 wait complete. 2024-09-17T03:42:00.804 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:42:00.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:42:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.927+0000 7f08401c3640 1 -- 172.21.15.146:0/2281005826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0838152920 msgr2=0x7f0838073580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.927+0000 7f08401c3640 1 --2- 172.21.15.146:0/2281005826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0838152920 0x7f0838073580 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f0834005fd0 tx=0x7f083402a530 comp rx=0 tx=0).stop 2024-09-17T03:42:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.927+0000 7f08401c3640 1 -- 172.21.15.146:0/2281005826 shutdown_connections 2024-09-17T03:42:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.927+0000 7f08401c3640 1 --2- 172.21.15.146:0/2281005826 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08380701f0 0x7f08380b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.927+0000 7f08401c3640 1 --2- 172.21.15.146:0/2281005826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0838152920 0x7f0838073580 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.927+0000 7f08401c3640 1 -- 172.21.15.146:0/2281005826 >> 172.21.15.146:0/2281005826 conn(0x7f083806dd60 msgr2=0x7f083806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:00.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.928+0000 7f08401c3640 1 -- 172.21.15.146:0/2281005826 shutdown_connections 2024-09-17T03:42:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.928+0000 7f08401c3640 1 -- 172.21.15.146:0/2281005826 wait complete. 2024-09-17T03:42:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.929+0000 7f08401c3640 1 Processor -- start 2024-09-17T03:42:00.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.929+0000 7f08401c3640 1 -- start start 2024-09-17T03:42:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.930+0000 7f08401c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08380701f0 0x7f08381f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.930+0000 7f08401c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0838073ac0 0x7f08381f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.930+0000 7f08401c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0838152920 0x7f08381f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.930+0000 7f08401c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f08380b5590 con 0x7f0838073ac0 2024-09-17T03:42:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f08401c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f08380b5410 con 0x7f0838152920 2024-09-17T03:42:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f08401c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f08380b5710 con 0x7f08380701f0 2024-09-17T03:42:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083d75e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0838073ac0 0x7f08381f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083d75e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0838073ac0 0x7f08381f3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59366/0 (socket says 172.21.15.146:59366) 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083d75e640 1 -- 172.21.15.146:0/1705618802 learned_addr learned my addr 172.21.15.146:0/1705618802 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083df5f640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08380701f0 0x7f08381f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083e760640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0838152920 0x7f08381f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083d75e640 1 -- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08380701f0 msgr2=0x7f08381f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083d75e640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08380701f0 0x7f08381f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083d75e640 1 -- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0838152920 msgr2=0x7f08381f43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083d75e640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0838152920 0x7f08381f43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083d75e640 1 -- 172.21.15.146:0/1705618802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0838151670 con 0x7f0838073ac0 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083e760640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0838152920 0x7f08381f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f083d75e640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0838073ac0 0x7f08381f3e70 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f0828009fd0 tx=0x7f082800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f082e7fc640 1 -- 172.21.15.146:0/1705618802 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828015020 con 0x7f0838073ac0 2024-09-17T03:42:00.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f082e7fc640 1 -- 172.21.15.146:0/1705618802 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0828011920 con 0x7f0838073ac0 2024-09-17T03:42:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f08401c3640 1 -- 172.21.15.146:0/1705618802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0838155390 con 0x7f0838073ac0 2024-09-17T03:42:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f082e7fc640 1 -- 172.21.15.146:0/1705618802 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828011d50 con 0x7f0838073ac0 2024-09-17T03:42:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.931+0000 7f08401c3640 1 -- 172.21.15.146:0/1705618802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0838155950 con 0x7f0838073ac0 2024-09-17T03:42:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.932+0000 7f08401c3640 1 -- 172.21.15.146:0/1705618802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0838155100 con 0x7f0838073ac0 2024-09-17T03:42:00.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.933+0000 7f082e7fc640 1 -- 172.21.15.146:0/1705618802 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0828018020 con 0x7f0838073ac0 2024-09-17T03:42:00.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.934+0000 7f082e7fc640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f081c078bc0 0x7f081c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:00.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.934+0000 7f082e7fc640 1 -- 172.21.15.146:0/1705618802 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f082809ac10 con 0x7f0838073ac0 2024-09-17T03:42:00.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.934+0000 7f083df5f640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f081c078bc0 0x7f081c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:00.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.934+0000 7f083df5f640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f081c078bc0 0x7f081c07b0d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0834033000 tx=0x7f0834004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:00.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:00.938+0000 7f082e7fc640 1 -- 172.21.15.146:0/1705618802 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f082801f020 con 0x7f0838073ac0 2024-09-17T03:42:01.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.148+0000 7f08401c3640 1 -- 172.21.15.146:0/1705618802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f08380b5c20 con 0x7f0838073ac0 2024-09-17T03:42:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.793+0000 7f082e7fc640 1 -- 172.21.15.146:0/1705618802 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v104) ==== 122+0+0 (secure 0 0 0) 0x7f08280630e0 con 0x7f0838073ac0 2024-09-17T03:42:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 -- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f081c078bc0 msgr2=0x7f081c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f081c078bc0 0x7f081c07b0d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0834033000 tx=0x7f0834004730 comp rx=0 tx=0).stop 2024-09-17T03:42:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 -- 172.21.15.146:0/1705618802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0838073ac0 msgr2=0x7f08381f3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0838073ac0 0x7f08381f3e70 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f0828009fd0 tx=0x7f082800b870 comp rx=0 tx=0).stop 2024-09-17T03:42:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 -- 172.21.15.146:0/1705618802 shutdown_connections 2024-09-17T03:42:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f081c078bc0 0x7f081c07b0d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0838152920 0x7f08381f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:01.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0838073ac0 0x7f08381f3e70 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 --2- 172.21.15.146:0/1705618802 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08380701f0 0x7f08381f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 -- 172.21.15.146:0/1705618802 >> 172.21.15.146:0/1705618802 conn(0x7f083806dd60 msgr2=0x7f083815e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 -- 172.21.15.146:0/1705618802 shutdown_connections 2024-09-17T03:42:01.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.796+0000 7f08401c3640 1 -- 172.21.15.146:0/1705618802 wait complete. 2024-09-17T03:42:01.809 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:42:01.809 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:01.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.927+0000 7f66dc93a640 1 -- 172.21.15.146:0/1609761959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80b5750 msgr2=0x7f66d80b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:01.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.927+0000 7f66dc93a640 1 --2- 172.21.15.146:0/1609761959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80b5750 0x7f66d80b3620 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009830 tx=0x7f66cc02a510 comp rx=0 tx=0).stop 2024-09-17T03:42:01.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.927+0000 7f66dc93a640 1 -- 172.21.15.146:0/1609761959 shutdown_connections 2024-09-17T03:42:01.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.927+0000 7f66dc93a640 1 --2- 172.21.15.146:0/1609761959 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d80b3b60 0x7f66d815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:01.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.927+0000 7f66dc93a640 1 --2- 172.21.15.146:0/1609761959 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80b5750 0x7f66d80b3620 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:01.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.927+0000 7f66dc93a640 1 -- 172.21.15.146:0/1609761959 >> 172.21.15.146:0/1609761959 conn(0x7f66d80b7b20 msgr2=0x7f66d809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:01.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.927+0000 7f66dc93a640 1 -- 172.21.15.146:0/1609761959 shutdown_connections 2024-09-17T03:42:01.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.927+0000 7f66dc93a640 1 -- 172.21.15.146:0/1609761959 wait complete. 2024-09-17T03:42:01.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.929+0000 7f66dc93a640 1 Processor -- start 2024-09-17T03:42:01.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.929+0000 7f66dc93a640 1 -- start start 2024-09-17T03:42:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66dc93a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80b3b60 0x7f66d81461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66dc93a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d80b5750 0x7f66d8144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66dc93a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d80b5ce0 0x7f66d81f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66dc93a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66d815d4b0 con 0x7f66d80b3b60 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66dc93a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f66d815d330 con 0x7f66d80b5750 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66dc93a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f66d815d630 con 0x7f66d80b5ce0 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80b3b60 0x7f66d81461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80b3b60 0x7f66d81461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59386/0 (socket says 172.21.15.146:59386) 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d659c640 1 -- 172.21.15.146:0/125114454 learned_addr learned my addr 172.21.15.146:0/125114454 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d5d9b640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d80b5750 0x7f66d8144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d6d9d640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d80b5ce0 0x7f66d81f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d659c640 1 -- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d80b5ce0 msgr2=0x7f66d81f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d659c640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d80b5ce0 0x7f66d81f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d659c640 1 -- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d80b5750 msgr2=0x7f66d8144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d659c640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d80b5750 0x7f66d8144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d659c640 1 -- 172.21.15.146:0/125114454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d8146990 con 0x7f66d80b3b60 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d6d9d640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d80b5ce0 0x7f66d81f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:01.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.930+0000 7f66d5d9b640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d80b5750 0x7f66d8144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.931+0000 7f66d659c640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80b3b60 0x7f66d81461e0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f66c800c3c0 tx=0x7f66c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.931+0000 7f66c6ffd640 1 -- 172.21.15.146:0/125114454 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8017070 con 0x7f66d80b3b60 2024-09-17T03:42:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.931+0000 7f66c6ffd640 1 -- 172.21.15.146:0/125114454 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66c80035f0 con 0x7f66d80b3b60 2024-09-17T03:42:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.931+0000 7f66c6ffd640 1 -- 172.21.15.146:0/125114454 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8003a80 con 0x7f66d80b3b60 2024-09-17T03:42:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.931+0000 7f66dc93a640 1 -- 172.21.15.146:0/125114454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d8146c70 con 0x7f66d80b3b60 2024-09-17T03:42:01.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.931+0000 7f66dc93a640 1 -- 172.21.15.146:0/125114454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d81447c0 con 0x7f66d80b3b60 2024-09-17T03:42:01.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.932+0000 7f66dc93a640 1 -- 172.21.15.146:0/125114454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d815ad30 con 0x7f66d80b3b60 2024-09-17T03:42:01.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.933+0000 7f66c6ffd640 1 -- 172.21.15.146:0/125114454 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66c801a070 con 0x7f66d80b3b60 2024-09-17T03:42:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.933+0000 7f66c6ffd640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b8078b90 0x7f66b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.933+0000 7f66c6ffd640 1 -- 172.21.15.146:0/125114454 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f66c809a050 con 0x7f66d80b3b60 2024-09-17T03:42:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.933+0000 7f66d5d9b640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b8078b90 0x7f66b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:01.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.934+0000 7f66d5d9b640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b8078b90 0x7f66b807b0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f66cc034000 tx=0x7f66cc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:01.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:01.938+0000 7f66c6ffd640 1 -- 172.21.15.146:0/125114454 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f66d815ad30 con 0x7f66d80b3b60 2024-09-17T03:42:02.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.148+0000 7f66dc93a640 1 -- 172.21.15.146:0/125114454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66d815ecc0 con 0x7f66d80b3b60 2024-09-17T03:42:02.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.148+0000 7f66c6ffd640 1 -- 172.21.15.146:0/125114454 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7f66d80b3f70 con 0x7f66d80b3b60 2024-09-17T03:42:02.148 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:02.148 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:02.148 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:02.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 -- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b8078b90 msgr2=0x7f66b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b8078b90 0x7f66b807b0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f66cc034000 tx=0x7f66cc004730 comp rx=0 tx=0).stop 2024-09-17T03:42:02.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 -- 172.21.15.146:0/125114454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80b3b60 msgr2=0x7f66d81461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80b3b60 0x7f66d81461e0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f66c800c3c0 tx=0x7f66c800c880 comp rx=0 tx=0).stop 2024-09-17T03:42:02.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 -- 172.21.15.146:0/125114454 shutdown_connections 2024-09-17T03:42:02.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b8078b90 0x7f66b807b0a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d80b5ce0 0x7f66d81f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d80b5750 0x7f66d8144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 --2- 172.21.15.146:0/125114454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d80b3b60 0x7f66d81461e0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 -- 172.21.15.146:0/125114454 >> 172.21.15.146:0/125114454 conn(0x7f66d80b7b20 msgr2=0x7f66d815b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 -- 172.21.15.146:0/125114454 shutdown_connections 2024-09-17T03:42:02.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.151+0000 7f66dc93a640 1 -- 172.21.15.146:0/125114454 wait complete. 2024-09-17T03:42:02.162 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:42:02.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.276+0000 7f1e1012b640 1 -- 172.21.15.146:0/3331696927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df4004800 msgr2=0x7f1df4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.276+0000 7f1e1012b640 1 --2- 172.21.15.146:0/3331696927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df4004800 0x7f1df4004c10 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f1e08073530 tx=0x7f1df4005830 comp rx=0 tx=0).stop 2024-09-17T03:42:02.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.276+0000 7f1e1012b640 1 -- 172.21.15.146:0/3331696927 shutdown_connections 2024-09-17T03:42:02.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.276+0000 7f1e1012b640 1 --2- 172.21.15.146:0/3331696927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df4004800 0x7f1df4004c10 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.276+0000 7f1e1012b640 1 -- 172.21.15.146:0/3331696927 >> 172.21.15.146:0/3331696927 conn(0x7f1e080b3150 msgr2=0x7f1e080b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:02.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.276+0000 7f1e1012b640 1 -- 172.21.15.146:0/3331696927 shutdown_connections 2024-09-17T03:42:02.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.276+0000 7f1e1012b640 1 -- 172.21.15.146:0/3331696927 wait complete. 2024-09-17T03:42:02.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.278+0000 7f1e1012b640 1 Processor -- start 2024-09-17T03:42:02.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.278+0000 7f1e1012b640 1 -- start start 2024-09-17T03:42:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.279+0000 7f1e1012b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1df4004800 0x7f1e081e4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.279+0000 7f1e1012b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e0814c650 0x7f1e081e6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.279+0000 7f1e1012b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e081e66b0 0x7f1e081e6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.279+0000 7f1e1012b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e080b5a10 con 0x7f1e0814c650 2024-09-17T03:42:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.279+0000 7f1e1012b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1e080b5890 con 0x7f1df4004800 2024-09-17T03:42:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.279+0000 7f1e1012b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1e080b5b90 con 0x7f1e081e66b0 2024-09-17T03:42:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.279+0000 7f1e0d6c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e0814c650 0x7f1e081e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.279+0000 7f1e0d6c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e0814c650 0x7f1e081e6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59400/0 (socket says 172.21.15.146:59400) 2024-09-17T03:42:02.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.279+0000 7f1e0d6c6640 1 -- 172.21.15.146:0/4208242907 learned_addr learned my addr 172.21.15.146:0/4208242907 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:02.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1e0dec7640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1df4004800 0x7f1e081e4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1e0e6c8640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e081e66b0 0x7f1e081e6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1e0d6c6640 1 -- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e081e66b0 msgr2=0x7f1e081e6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1e0d6c6640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e081e66b0 0x7f1e081e6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1e0d6c6640 1 -- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1df4004800 msgr2=0x7f1e081e4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1e0d6c6640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1df4004800 0x7f1e081e4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1e0d6c6640 1 -- 172.21.15.146:0/4208242907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e081e50d0 con 0x7f1e0814c650 2024-09-17T03:42:02.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1e0d6c6640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e0814c650 0x7f1e081e6170 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009a70 tx=0x7f1df80336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:02.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1dfe7fc640 1 -- 172.21.15.146:0/4208242907 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8038040 con 0x7f1e0814c650 2024-09-17T03:42:02.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1dfe7fc640 1 -- 172.21.15.146:0/4208242907 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1df8041070 con 0x7f1e0814c650 2024-09-17T03:42:02.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1e1012b640 1 -- 172.21.15.146:0/4208242907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e081e53b0 con 0x7f1e0814c650 2024-09-17T03:42:02.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1dfe7fc640 1 -- 172.21.15.146:0/4208242907 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8033c90 con 0x7f1e0814c650 2024-09-17T03:42:02.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.280+0000 7f1e1012b640 1 -- 172.21.15.146:0/4208242907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e081e5970 con 0x7f1e0814c650 2024-09-17T03:42:02.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.281+0000 7f1e1012b640 1 -- 172.21.15.146:0/4208242907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e081e4e20 con 0x7f1e0814c650 2024-09-17T03:42:02.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.282+0000 7f1dfe7fc640 1 -- 172.21.15.146:0/4208242907 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1df8046460 con 0x7f1e0814c650 2024-09-17T03:42:02.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.282+0000 7f1dfe7fc640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1dec078b90 0x7f1dec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.283+0000 7f1dfe7fc640 1 -- 172.21.15.146:0/4208242907 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f1df80bb5b0 con 0x7f1e0814c650 2024-09-17T03:42:02.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.283+0000 7f1e0dec7640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1dec078b90 0x7f1dec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.283+0000 7f1e0dec7640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1dec078b90 0x7f1dec07b0a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1e0806a390 tx=0x7f1e04006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:02.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.287+0000 7f1dfe7fc640 1 -- 172.21.15.146:0/4208242907 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1df80833a0 con 0x7f1e0814c650 2024-09-17T03:42:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.461+0000 7f1e1012b640 1 -- 172.21.15.146:0/4208242907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e080b4ba0 con 0x7f1e0814c650 2024-09-17T03:42:02.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.462+0000 7f1dfe7fc640 1 -- 172.21.15.146:0/4208242907 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+16787 (secure 0 0 0) 0x7f1df8087dd0 con 0x7f1e0814c650 2024-09-17T03:42:02.461 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:02.461 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":143,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:41:59.765590+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:41:55.777474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T03:41:57.096388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:42:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 -- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1dec078b90 msgr2=0x7f1dec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1dec078b90 0x7f1dec07b0a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1e0806a390 tx=0x7f1e04006040 comp rx=0 tx=0).stop 2024-09-17T03:42:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 -- 172.21.15.146:0/4208242907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e0814c650 msgr2=0x7f1e081e6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e0814c650 0x7f1e081e6170 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009a70 tx=0x7f1df80336f0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 -- 172.21.15.146:0/4208242907 shutdown_connections 2024-09-17T03:42:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1dec078b90 0x7f1dec07b0a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e081e66b0 0x7f1e081e6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e0814c650 0x7f1e081e6170 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 --2- 172.21.15.146:0/4208242907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1df4004800 0x7f1e081e4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 -- 172.21.15.146:0/4208242907 >> 172.21.15.146:0/4208242907 conn(0x7f1e080b3150 msgr2=0x7f1e080b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:02.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 -- 172.21.15.146:0/4208242907 shutdown_connections 2024-09-17T03:42:02.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.464+0000 7f1e1012b640 1 -- 172.21.15.146:0/4208242907 wait complete. 2024-09-17T03:42:02.475 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:42:02.476 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:42:02.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.591+0000 7f0c07425640 1 -- 172.21.15.146:0/1932506214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c000b5750 msgr2=0x7f0c000b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.591+0000 7f0c07425640 1 --2- 172.21.15.146:0/1932506214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c000b5750 0x7f0c000b3620 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f0c000b5390 tx=0x7f0bf002a560 comp rx=0 tx=0).stop 2024-09-17T03:42:02.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.591+0000 7f0c07425640 1 -- 172.21.15.146:0/1932506214 shutdown_connections 2024-09-17T03:42:02.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.591+0000 7f0c07425640 1 --2- 172.21.15.146:0/1932506214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c000b5750 0x7f0c000b3620 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.591+0000 7f0c07425640 1 --2- 172.21.15.146:0/1932506214 >> v2:172.21.15.179:3300/0 conn(0x7f0c000b5ce0 0x7f0c000b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.591+0000 7f0c07425640 1 -- 172.21.15.146:0/1932506214 >> 172.21.15.146:0/1932506214 conn(0x7f0c000b7b20 msgr2=0x7f0c0009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:02.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.591+0000 7f0c07425640 1 -- 172.21.15.146:0/1932506214 shutdown_connections 2024-09-17T03:42:02.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.591+0000 7f0c07425640 1 -- 172.21.15.146:0/1932506214 wait complete. 2024-09-17T03:42:02.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.593+0000 7f0c07425640 1 Processor -- start 2024-09-17T03:42:02.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.593+0000 7f0c07425640 1 -- start start 2024-09-17T03:42:02.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c07425640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c000b3b60 0x7f0c00147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c07425640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c000b5750 0x7f0c0009c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c07425640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c000b5ce0 0x7f0c001e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c07425640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0c000b27b0 con 0x7f0c000b5ce0 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c07425640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0015dcc0 con 0x7f0c000b3b60 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c07425640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0c000b2930 con 0x7f0c000b5750 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c059c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c000b5ce0 0x7f0c001e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c059c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c000b5ce0 0x7f0c001e4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59408/0 (socket says 172.21.15.146:59408) 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c059c2640 1 -- 172.21.15.146:0/2591063300 learned_addr learned my addr 172.21.15.146:0/2591063300 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c049c0640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c000b5750 0x7f0c0009c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c051c1640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c000b3b60 0x7f0c00147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c059c2640 1 -- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c000b5750 msgr2=0x7f0c0009c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c059c2640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c000b5750 0x7f0c0009c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c059c2640 1 -- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c000b3b60 msgr2=0x7f0c00147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c059c2640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c000b3b60 0x7f0c00147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.594+0000 7f0c059c2640 1 -- 172.21.15.146:0/2591063300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0009d4d0 con 0x7f0c000b5ce0 2024-09-17T03:42:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.595+0000 7f0c059c2640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c000b5ce0 0x7f0c001e4f60 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800ba10 tx=0x7f0bf800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.595+0000 7f0bf5ffb640 1 -- 172.21.15.146:0/2591063300 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8019070 con 0x7f0c000b5ce0 2024-09-17T03:42:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.595+0000 7f0bf5ffb640 1 -- 172.21.15.146:0/2591063300 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bf800cc90 con 0x7f0c000b5ce0 2024-09-17T03:42:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.595+0000 7f0c07425640 1 -- 172.21.15.146:0/2591063300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c0009d7b0 con 0x7f0c000b5ce0 2024-09-17T03:42:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.595+0000 7f0bf5ffb640 1 -- 172.21.15.146:0/2591063300 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80146a0 con 0x7f0c000b5ce0 2024-09-17T03:42:02.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.595+0000 7f0c07425640 1 -- 172.21.15.146:0/2591063300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c0009dd70 con 0x7f0c000b5ce0 2024-09-17T03:42:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.596+0000 7f0c07425640 1 -- 172.21.15.146:0/2591063300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c000b7440 con 0x7f0c000b5ce0 2024-09-17T03:42:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.597+0000 7f0bf5ffb640 1 -- 172.21.15.146:0/2591063300 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0bf801c070 con 0x7f0c000b5ce0 2024-09-17T03:42:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.597+0000 7f0bf5ffb640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0be4078b90 0x7f0be407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.597+0000 7f0bf5ffb640 1 -- 172.21.15.146:0/2591063300 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f0bf809a980 con 0x7f0c000b5ce0 2024-09-17T03:42:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.597+0000 7f0c051c1640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0be4078b90 0x7f0be407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.598+0000 7f0c051c1640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0be4078b90 0x7f0be407b0a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0098e0 tx=0x7f0bfc009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:02.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.602+0000 7f0bf5ffb640 1 -- 172.21.15.146:0/2591063300 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0bf8062800 con 0x7f0c000b5ce0 2024-09-17T03:42:02.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.771+0000 7f0c07425640 1 -- 172.21.15.146:0/2591063300 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0c0009e0e0 con 0x7f0be4078b90 2024-09-17T03:42:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.776+0000 7f0bf5ffb640 1 -- 172.21.15.146:0/2591063300 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249504 (secure 0 0 0) 0x7f0c0009e0e0 con 0x7f0be4078b90 2024-09-17T03:42:02.778 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:42:02.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 -- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0be4078b90 msgr2=0x7f0be407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0be4078b90 0x7f0be407b0a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0098e0 tx=0x7f0bfc009060 comp rx=0 tx=0).stop 2024-09-17T03:42:02.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 -- 172.21.15.146:0/2591063300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c000b5ce0 msgr2=0x7f0c001e4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c000b5ce0 0x7f0c001e4f60 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800ba10 tx=0x7f0bf800bed0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 -- 172.21.15.146:0/2591063300 shutdown_connections 2024-09-17T03:42:02.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0be4078b90 0x7f0be407b0a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c000b5ce0 0x7f0c001e4f60 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c000b5750 0x7f0c0009c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 --2- 172.21.15.146:0/2591063300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c000b3b60 0x7f0c00147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 -- 172.21.15.146:0/2591063300 >> 172.21.15.146:0/2591063300 conn(0x7f0c000b7b20 msgr2=0x7f0c0015a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:02.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 -- 172.21.15.146:0/2591063300 shutdown_connections 2024-09-17T03:42:02.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.780+0000 7f0c07425640 1 -- 172.21.15.146:0/2591063300 wait complete. 2024-09-17T03:42:02.791 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2024-09-17T03:42:01.934889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":141,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":162,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":417216,"kb_used_data":14968,"kb_used_omap":12,"kb_used_meta":402035,"kb_avail":754557504,"statfs":{"total":773094113280,"available":772666884096,"internally_reserved":0,"allocated":15327232,"data_stored":7358286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":411684401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.176865"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789673+0000","last_change":"2024-09-17T03:41:58.783510+0000","last_active":"2024-09-17T03:41:58.789673+0000","last_peered":"2024-09-17T03:41:58.789673+0000","last_clean":"2024-09-17T03:41:58.789673+0000","last_became_active":"2024-09-17T03:41:58.782625+0000","last_became_peered":"2024-09-17T03:41:58.782625+0000","last_unstale":"2024-09-17T03:41:58.789673+0000","last_undegraded":"2024-09-17T03:41:58.789673+0000","last_fullsized":"2024-09-17T03:41:58.789673+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:08.308387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.773941+0000","last_change":"2024-09-17T03:41:58.773210+0000","last_active":"2024-09-17T03:41:58.773941+0000","last_peered":"2024-09-17T03:41:58.773941+0000","last_clean":"2024-09-17T03:41:58.773941+0000","last_became_active":"2024-09-17T03:41:58.771709+0000","last_became_peered":"2024-09-17T03:41:58.771709+0000","last_unstale":"2024-09-17T03:41:58.773941+0000","last_undegraded":"2024-09-17T03:41:58.773941+0000","last_fullsized":"2024-09-17T03:41:58.773941+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:23.055342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790017+0000","last_change":"2024-09-17T03:41:58.784113+0000","last_active":"2024-09-17T03:41:58.790017+0000","last_peered":"2024-09-17T03:41:58.790017+0000","last_clean":"2024-09-17T03:41:58.790017+0000","last_became_active":"2024-09-17T03:41:58.783674+0000","last_became_peered":"2024-09-17T03:41:58.783674+0000","last_unstale":"2024-09-17T03:41:58.790017+0000","last_undegraded":"2024-09-17T03:41:58.790017+0000","last_fullsized":"2024-09-17T03:41:58.790017+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:15.404369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789718+0000","last_change":"2024-09-17T03:41:58.781216+0000","last_active":"2024-09-17T03:41:58.789718+0000","last_peered":"2024-09-17T03:41:58.789718+0000","last_clean":"2024-09-17T03:41:58.789718+0000","last_became_active":"2024-09-17T03:41:58.780931+0000","last_became_peered":"2024-09-17T03:41:58.780931+0000","last_unstale":"2024-09-17T03:41:58.789718+0000","last_undegraded":"2024-09-17T03:41:58.789718+0000","last_fullsized":"2024-09-17T03:41:58.789718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:17.947058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.797923+0000","last_change":"2024-09-17T03:41:58.795953+0000","last_active":"2024-09-17T03:41:58.797923+0000","last_peered":"2024-09-17T03:41:58.797923+0000","last_clean":"2024-09-17T03:41:58.797923+0000","last_became_active":"2024-09-17T03:41:58.795588+0000","last_became_peered":"2024-09-17T03:41:58.795588+0000","last_unstale":"2024-09-17T03:41:58.797923+0000","last_undegraded":"2024-09-17T03:41:58.797923+0000","last_fullsized":"2024-09-17T03:41:58.797923+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:03.090120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794142+0000","last_change":"2024-09-17T03:41:58.793259+0000","last_active":"2024-09-17T03:41:58.794142+0000","last_peered":"2024-09-17T03:41:58.794142+0000","last_clean":"2024-09-17T03:41:58.794142+0000","last_became_active":"2024-09-17T03:41:58.792967+0000","last_became_peered":"2024-09-17T03:41:58.792967+0000","last_unstale":"2024-09-17T03:41:58.794142+0000","last_undegraded":"2024-09-17T03:41:58.794142+0000","last_fullsized":"2024-09-17T03:41:58.794142+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:49.170549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789159+0000","last_change":"2024-09-17T03:41:58.786406+0000","last_active":"2024-09-17T03:41:58.789159+0000","last_peered":"2024-09-17T03:41:58.789159+0000","last_clean":"2024-09-17T03:41:58.789159+0000","last_became_active":"2024-09-17T03:41:58.785804+0000","last_became_peered":"2024-09-17T03:41:58.785804+0000","last_unstale":"2024-09-17T03:41:58.789159+0000","last_undegraded":"2024-09-17T03:41:58.789159+0000","last_fullsized":"2024-09-17T03:41:58.789159+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:31.346639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793904+0000","last_change":"2024-09-17T03:41:58.792926+0000","last_active":"2024-09-17T03:41:58.793904+0000","last_peered":"2024-09-17T03:41:58.793904+0000","last_clean":"2024-09-17T03:41:58.793904+0000","last_became_active":"2024-09-17T03:41:58.792624+0000","last_became_peered":"2024-09-17T03:41:58.792624+0000","last_unstale":"2024-09-17T03:41:58.793904+0000","last_undegraded":"2024-09-17T03:41:58.793904+0000","last_fullsized":"2024-09-17T03:41:58.793904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:28.867944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789347+0000","last_change":"2024-09-17T03:41:58.787698+0000","last_active":"2024-09-17T03:41:58.789347+0000","last_peered":"2024-09-17T03:41:58.789347+0000","last_clean":"2024-09-17T03:41:58.789347+0000","last_became_active":"2024-09-17T03:41:58.787391+0000","last_became_peered":"2024-09-17T03:41:58.787391+0000","last_unstale":"2024-09-17T03:41:58.789347+0000","last_undegraded":"2024-09-17T03:41:58.789347+0000","last_fullsized":"2024-09-17T03:41:58.789347+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:16.851435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.796383+0000","last_change":"2024-09-17T03:41:58.792904+0000","last_active":"2024-09-17T03:41:58.796383+0000","last_peered":"2024-09-17T03:41:58.796383+0000","last_clean":"2024-09-17T03:41:58.796383+0000","last_became_active":"2024-09-17T03:41:58.792587+0000","last_became_peered":"2024-09-17T03:41:58.792587+0000","last_unstale":"2024-09-17T03:41:58.796383+0000","last_undegraded":"2024-09-17T03:41:58.796383+0000","last_fullsized":"2024-09-17T03:41:58.796383+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:35.853662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.780484+0000","last_change":"2024-09-17T03:41:58.778325+0000","last_active":"2024-09-17T03:41:58.780484+0000","last_peered":"2024-09-17T03:41:58.780484+0000","last_clean":"2024-09-17T03:41:58.780484+0000","last_became_active":"2024-09-17T03:41:58.778010+0000","last_became_peered":"2024-09-17T03:41:58.778010+0000","last_unstale":"2024-09-17T03:41:58.780484+0000","last_undegraded":"2024-09-17T03:41:58.780484+0000","last_fullsized":"2024-09-17T03:41:58.780484+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:31.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791571+0000","last_change":"2024-09-17T03:41:58.784054+0000","last_active":"2024-09-17T03:41:58.791571+0000","last_peered":"2024-09-17T03:41:58.791571+0000","last_clean":"2024-09-17T03:41:58.791571+0000","last_became_active":"2024-09-17T03:41:58.783751+0000","last_became_peered":"2024-09-17T03:41:58.783751+0000","last_unstale":"2024-09-17T03:41:58.791571+0000","last_undegraded":"2024-09-17T03:41:58.791571+0000","last_fullsized":"2024-09-17T03:41:58.791571+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:49.444227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795743+0000","last_change":"2024-09-17T03:41:58.791309+0000","last_active":"2024-09-17T03:41:58.795743+0000","last_peered":"2024-09-17T03:41:58.795743+0000","last_clean":"2024-09-17T03:41:58.795743+0000","last_became_active":"2024-09-17T03:41:58.791005+0000","last_became_peered":"2024-09-17T03:41:58.791005+0000","last_unstale":"2024-09-17T03:41:58.795743+0000","last_undegraded":"2024-09-17T03:41:58.795743+0000","last_fullsized":"2024-09-17T03:41:58.795743+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:44.620003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.773928+0000","last_change":"2024-09-17T03:41:58.772834+0000","last_active":"2024-09-17T03:41:58.773928+0000","last_peered":"2024-09-17T03:41:58.773928+0000","last_clean":"2024-09-17T03:41:58.773928+0000","last_became_active":"2024-09-17T03:41:58.772503+0000","last_became_peered":"2024-09-17T03:41:58.772503+0000","last_unstale":"2024-09-17T03:41:58.773928+0000","last_undegraded":"2024-09-17T03:41:58.773928+0000","last_fullsized":"2024-09-17T03:41:58.773928+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:05.742202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790728+0000","last_change":"2024-09-17T03:41:58.785329+0000","last_active":"2024-09-17T03:41:58.790728+0000","last_peered":"2024-09-17T03:41:58.790728+0000","last_clean":"2024-09-17T03:41:58.790728+0000","last_became_active":"2024-09-17T03:41:58.785017+0000","last_became_peered":"2024-09-17T03:41:58.785017+0000","last_unstale":"2024-09-17T03:41:58.790728+0000","last_undegraded":"2024-09-17T03:41:58.790728+0000","last_fullsized":"2024-09-17T03:41:58.790728+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:10.635488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790132+0000","last_change":"2024-09-17T03:41:58.782096+0000","last_active":"2024-09-17T03:41:58.790132+0000","last_peered":"2024-09-17T03:41:58.790132+0000","last_clean":"2024-09-17T03:41:58.790132+0000","last_became_active":"2024-09-17T03:41:58.781798+0000","last_became_peered":"2024-09-17T03:41:58.781798+0000","last_unstale":"2024-09-17T03:41:58.790132+0000","last_undegraded":"2024-09-17T03:41:58.790132+0000","last_fullsized":"2024-09-17T03:41:58.790132+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:24.167278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789200+0000","last_change":"2024-09-17T03:41:58.787064+0000","last_active":"2024-09-17T03:41:58.789200+0000","last_peered":"2024-09-17T03:41:58.789200+0000","last_clean":"2024-09-17T03:41:58.789200+0000","last_became_active":"2024-09-17T03:41:58.786212+0000","last_became_peered":"2024-09-17T03:41:58.786212+0000","last_unstale":"2024-09-17T03:41:58.789200+0000","last_undegraded":"2024-09-17T03:41:58.789200+0000","last_fullsized":"2024-09-17T03:41:58.789200+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:01.139228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789870+0000","last_change":"2024-09-17T03:41:58.785048+0000","last_active":"2024-09-17T03:41:58.789870+0000","last_peered":"2024-09-17T03:41:58.789870+0000","last_clean":"2024-09-17T03:41:58.789870+0000","last_became_active":"2024-09-17T03:41:58.784435+0000","last_became_peered":"2024-09-17T03:41:58.784435+0000","last_unstale":"2024-09-17T03:41:58.789870+0000","last_undegraded":"2024-09-17T03:41:58.789870+0000","last_fullsized":"2024-09-17T03:41:58.789870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:46.290406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794684+0000","last_change":"2024-09-17T03:41:58.791265+0000","last_active":"2024-09-17T03:41:58.794684+0000","last_peered":"2024-09-17T03:41:58.794684+0000","last_clean":"2024-09-17T03:41:58.794684+0000","last_became_active":"2024-09-17T03:41:58.790981+0000","last_became_peered":"2024-09-17T03:41:58.790981+0000","last_unstale":"2024-09-17T03:41:58.794684+0000","last_undegraded":"2024-09-17T03:41:58.794684+0000","last_fullsized":"2024-09-17T03:41:58.794684+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:03.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789286+0000","last_change":"2024-09-17T03:41:58.786007+0000","last_active":"2024-09-17T03:41:58.789286+0000","last_peered":"2024-09-17T03:41:58.789286+0000","last_clean":"2024-09-17T03:41:58.789286+0000","last_became_active":"2024-09-17T03:41:58.785642+0000","last_became_peered":"2024-09-17T03:41:58.785642+0000","last_unstale":"2024-09-17T03:41:58.789286+0000","last_undegraded":"2024-09-17T03:41:58.789286+0000","last_fullsized":"2024-09-17T03:41:58.789286+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:45.260732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791077+0000","last_change":"2024-09-17T03:41:58.784174+0000","last_active":"2024-09-17T03:41:58.791077+0000","last_peered":"2024-09-17T03:41:58.791077+0000","last_clean":"2024-09-17T03:41:58.791077+0000","last_became_active":"2024-09-17T03:41:58.783889+0000","last_became_peered":"2024-09-17T03:41:58.783889+0000","last_unstale":"2024-09-17T03:41:58.791077+0000","last_undegraded":"2024-09-17T03:41:58.791077+0000","last_fullsized":"2024-09-17T03:41:58.791077+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:49.912037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793352+0000","last_change":"2024-09-17T03:41:58.790506+0000","last_active":"2024-09-17T03:41:58.793352+0000","last_peered":"2024-09-17T03:41:58.793352+0000","last_clean":"2024-09-17T03:41:58.793352+0000","last_became_active":"2024-09-17T03:41:58.790198+0000","last_became_peered":"2024-09-17T03:41:58.790198+0000","last_unstale":"2024-09-17T03:41:58.793352+0000","last_undegraded":"2024-09-17T03:41:58.793352+0000","last_fullsized":"2024-09-17T03:41:58.793352+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:44.163526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791013+0000","last_change":"2024-09-17T03:41:58.783272+0000","last_active":"2024-09-17T03:41:58.791013+0000","last_peered":"2024-09-17T03:41:58.791013+0000","last_clean":"2024-09-17T03:41:58.791013+0000","last_became_active":"2024-09-17T03:41:58.782949+0000","last_became_peered":"2024-09-17T03:41:58.782949+0000","last_unstale":"2024-09-17T03:41:58.791013+0000","last_undegraded":"2024-09-17T03:41:58.791013+0000","last_fullsized":"2024-09-17T03:41:58.791013+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:33.398364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789500+0000","last_change":"2024-09-17T03:41:58.786551+0000","last_active":"2024-09-17T03:41:58.789500+0000","last_peered":"2024-09-17T03:41:58.789500+0000","last_clean":"2024-09-17T03:41:58.789500+0000","last_became_active":"2024-09-17T03:41:58.786235+0000","last_became_peered":"2024-09-17T03:41:58.786235+0000","last_unstale":"2024-09-17T03:41:58.789500+0000","last_undegraded":"2024-09-17T03:41:58.789500+0000","last_fullsized":"2024-09-17T03:41:58.789500+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:55.612023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.782762+0000","last_change":"2024-09-17T03:41:58.781120+0000","last_active":"2024-09-17T03:41:58.782762+0000","last_peered":"2024-09-17T03:41:58.782762+0000","last_clean":"2024-09-17T03:41:58.782762+0000","last_became_active":"2024-09-17T03:41:58.780819+0000","last_became_peered":"2024-09-17T03:41:58.780819+0000","last_unstale":"2024-09-17T03:41:58.782762+0000","last_undegraded":"2024-09-17T03:41:58.782762+0000","last_fullsized":"2024-09-17T03:41:58.782762+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:50.827807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789904+0000","last_change":"2024-09-17T03:41:58.786598+0000","last_active":"2024-09-17T03:41:58.789904+0000","last_peered":"2024-09-17T03:41:58.789904+0000","last_clean":"2024-09-17T03:41:58.789904+0000","last_became_active":"2024-09-17T03:41:58.786273+0000","last_became_peered":"2024-09-17T03:41:58.786273+0000","last_unstale":"2024-09-17T03:41:58.789904+0000","last_undegraded":"2024-09-17T03:41:58.789904+0000","last_fullsized":"2024-09-17T03:41:58.789904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:39.675219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791599+0000","last_change":"2024-09-17T03:41:58.788709+0000","last_active":"2024-09-17T03:41:58.791599+0000","last_peered":"2024-09-17T03:41:58.791599+0000","last_clean":"2024-09-17T03:41:58.791599+0000","last_became_active":"2024-09-17T03:41:58.788401+0000","last_became_peered":"2024-09-17T03:41:58.788401+0000","last_unstale":"2024-09-17T03:41:58.791599+0000","last_undegraded":"2024-09-17T03:41:58.791599+0000","last_fullsized":"2024-09-17T03:41:58.791599+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:54.187280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794133+0000","last_change":"2024-09-17T03:41:58.792053+0000","last_active":"2024-09-17T03:41:58.794133+0000","last_peered":"2024-09-17T03:41:58.794133+0000","last_clean":"2024-09-17T03:41:58.794133+0000","last_became_active":"2024-09-17T03:41:58.791734+0000","last_became_peered":"2024-09-17T03:41:58.791734+0000","last_unstale":"2024-09-17T03:41:58.794133+0000","last_undegraded":"2024-09-17T03:41:58.794133+0000","last_fullsized":"2024-09-17T03:41:58.794133+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:34.904922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"142'4","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800933+0000","last_change":"2024-09-17T03:41:57.783265+0000","last_active":"2024-09-17T03:41:58.800933+0000","last_peered":"2024-09-17T03:41:58.800933+0000","last_clean":"2024-09-17T03:41:58.800933+0000","last_became_active":"2024-09-17T03:41:57.782950+0000","last_became_peered":"2024-09-17T03:41:57.782950+0000","last_unstale":"2024-09-17T03:41:58.800933+0000","last_undegraded":"2024-09-17T03:41:58.800933+0000","last_fullsized":"2024-09-17T03:41:58.800933+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.767175+0000","last_change":"2024-09-17T03:41:56.767175+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.767175+0000","last_undegraded":"2024-09-17T03:41:56.767175+0000","last_fullsized":"2024-09-17T03:41:56.767175+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791207+0000","last_change":"2024-09-17T03:41:58.788338+0000","last_active":"2024-09-17T03:41:58.791207+0000","last_peered":"2024-09-17T03:41:58.791207+0000","last_clean":"2024-09-17T03:41:58.791207+0000","last_became_active":"2024-09-17T03:41:58.788052+0000","last_became_peered":"2024-09-17T03:41:58.788052+0000","last_unstale":"2024-09-17T03:41:58.791207+0000","last_undegraded":"2024-09-17T03:41:58.791207+0000","last_fullsized":"2024-09-17T03:41:58.791207+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:33.314758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799041+0000","last_change":"2024-09-17T03:41:57.786673+0000","last_active":"2024-09-17T03:41:58.799041+0000","last_peered":"2024-09-17T03:41:58.799041+0000","last_clean":"2024-09-17T03:41:58.799041+0000","last_became_active":"2024-09-17T03:41:57.786359+0000","last_became_peered":"2024-09-17T03:41:57.786359+0000","last_unstale":"2024-09-17T03:41:58.799041+0000","last_undegraded":"2024-09-17T03:41:58.799041+0000","last_fullsized":"2024-09-17T03:41:58.799041+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:36.067718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789415+0000","last_change":"2024-09-17T03:41:58.787967+0000","last_active":"2024-09-17T03:41:58.789415+0000","last_peered":"2024-09-17T03:41:58.789415+0000","last_clean":"2024-09-17T03:41:58.789415+0000","last_became_active":"2024-09-17T03:41:58.787652+0000","last_became_peered":"2024-09-17T03:41:58.787652+0000","last_unstale":"2024-09-17T03:41:58.789415+0000","last_undegraded":"2024-09-17T03:41:58.789415+0000","last_fullsized":"2024-09-17T03:41:58.789415+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:18.330621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799781+0000","last_change":"2024-09-17T03:41:57.786812+0000","last_active":"2024-09-17T03:41:58.799781+0000","last_peered":"2024-09-17T03:41:58.799781+0000","last_clean":"2024-09-17T03:41:58.799781+0000","last_became_active":"2024-09-17T03:41:57.786434+0000","last_became_peered":"2024-09-17T03:41:57.786434+0000","last_unstale":"2024-09-17T03:41:58.799781+0000","last_undegraded":"2024-09-17T03:41:58.799781+0000","last_fullsized":"2024-09-17T03:41:58.799781+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.381560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"142'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798526+0000","last_change":"2024-09-17T03:41:57.782388+0000","last_active":"2024-09-17T03:41:58.798526+0000","last_peered":"2024-09-17T03:41:58.798526+0000","last_clean":"2024-09-17T03:41:58.798526+0000","last_became_active":"2024-09-17T03:41:57.782057+0000","last_became_peered":"2024-09-17T03:41:57.782057+0000","last_unstale":"2024-09-17T03:41:58.798526+0000","last_undegraded":"2024-09-17T03:41:58.798526+0000","last_fullsized":"2024-09-17T03:41:58.798526+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:47.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790997+0000","last_change":"2024-09-17T03:41:58.782536+0000","last_active":"2024-09-17T03:41:58.790997+0000","last_peered":"2024-09-17T03:41:58.790997+0000","last_clean":"2024-09-17T03:41:58.790997+0000","last_became_active":"2024-09-17T03:41:58.782153+0000","last_became_peered":"2024-09-17T03:41:58.782153+0000","last_unstale":"2024-09-17T03:41:58.790997+0000","last_undegraded":"2024-09-17T03:41:58.790997+0000","last_fullsized":"2024-09-17T03:41:58.790997+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:02.865504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.760063+0000","last_change":"2024-09-17T03:41:56.760063+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.760063+0000","last_undegraded":"2024-09-17T03:41:56.760063+0000","last_fullsized":"2024-09-17T03:41:56.760063+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.777449+0000","last_change":"2024-09-17T03:41:57.787289+0000","last_active":"2024-09-17T03:41:58.777449+0000","last_peered":"2024-09-17T03:41:58.777449+0000","last_clean":"2024-09-17T03:41:58.777449+0000","last_became_active":"2024-09-17T03:41:57.786949+0000","last_became_peered":"2024-09-17T03:41:57.786949+0000","last_unstale":"2024-09-17T03:41:58.777449+0000","last_undegraded":"2024-09-17T03:41:58.777449+0000","last_fullsized":"2024-09-17T03:41:58.777449+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:11.729127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776783+0000","last_change":"2024-09-17T03:41:57.788010+0000","last_active":"2024-09-17T03:41:58.776783+0000","last_peered":"2024-09-17T03:41:58.776783+0000","last_clean":"2024-09-17T03:41:58.776783+0000","last_became_active":"2024-09-17T03:41:57.787639+0000","last_became_peered":"2024-09-17T03:41:57.787639+0000","last_unstale":"2024-09-17T03:41:58.776783+0000","last_undegraded":"2024-09-17T03:41:58.776783+0000","last_fullsized":"2024-09-17T03:41:58.776783+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:53.119624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.764747+0000","last_change":"2024-09-17T03:41:56.764747+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.764747+0000","last_undegraded":"2024-09-17T03:41:56.764747+0000","last_fullsized":"2024-09-17T03:41:56.764747+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799815+0000","last_change":"2024-09-17T03:41:58.795904+0000","last_active":"2024-09-17T03:41:58.799815+0000","last_peered":"2024-09-17T03:41:58.799815+0000","last_clean":"2024-09-17T03:41:58.799815+0000","last_became_active":"2024-09-17T03:41:58.795526+0000","last_became_peered":"2024-09-17T03:41:58.795526+0000","last_unstale":"2024-09-17T03:41:58.799815+0000","last_undegraded":"2024-09-17T03:41:58.799815+0000","last_fullsized":"2024-09-17T03:41:58.799815+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:46.917885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.772721+0000","last_change":"2024-09-17T03:41:57.784269+0000","last_active":"2024-09-17T03:41:58.772721+0000","last_peered":"2024-09-17T03:41:58.772721+0000","last_clean":"2024-09-17T03:41:58.772721+0000","last_became_active":"2024-09-17T03:41:57.783959+0000","last_became_peered":"2024-09-17T03:41:57.783959+0000","last_unstale":"2024-09-17T03:41:58.772721+0000","last_undegraded":"2024-09-17T03:41:58.772721+0000","last_fullsized":"2024-09-17T03:41:58.772721+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:53.953478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791040+0000","last_change":"2024-09-17T03:41:58.788640+0000","last_active":"2024-09-17T03:41:58.791040+0000","last_peered":"2024-09-17T03:41:58.791040+0000","last_clean":"2024-09-17T03:41:58.791040+0000","last_became_active":"2024-09-17T03:41:58.788345+0000","last_became_peered":"2024-09-17T03:41:58.788345+0000","last_unstale":"2024-09-17T03:41:58.791040+0000","last_undegraded":"2024-09-17T03:41:58.791040+0000","last_fullsized":"2024-09-17T03:41:58.791040+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:45.234838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"142'6","reported_seq":19,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.801083+0000","last_change":"2024-09-17T03:41:57.782746+0000","last_active":"2024-09-17T03:41:58.801083+0000","last_peered":"2024-09-17T03:41:58.801083+0000","last_clean":"2024-09-17T03:41:58.801083+0000","last_became_active":"2024-09-17T03:41:57.782411+0000","last_became_peered":"2024-09-17T03:41:57.782411+0000","last_unstale":"2024-09-17T03:41:58.801083+0000","last_undegraded":"2024-09-17T03:41:58.801083+0000","last_fullsized":"2024-09-17T03:41:58.801083+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:17.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795355+0000","last_change":"2024-09-17T03:41:58.791701+0000","last_active":"2024-09-17T03:41:58.795355+0000","last_peered":"2024-09-17T03:41:58.795355+0000","last_clean":"2024-09-17T03:41:58.795355+0000","last_became_active":"2024-09-17T03:41:58.791387+0000","last_became_peered":"2024-09-17T03:41:58.791387+0000","last_unstale":"2024-09-17T03:41:58.795355+0000","last_undegraded":"2024-09-17T03:41:58.795355+0000","last_fullsized":"2024-09-17T03:41:58.795355+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.988090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798954+0000","last_change":"2024-09-17T03:41:57.776058+0000","last_active":"2024-09-17T03:41:58.798954+0000","last_peered":"2024-09-17T03:41:58.798954+0000","last_clean":"2024-09-17T03:41:58.798954+0000","last_became_active":"2024-09-17T03:41:57.775726+0000","last_became_peered":"2024-09-17T03:41:57.775726+0000","last_unstale":"2024-09-17T03:41:58.798954+0000","last_undegraded":"2024-09-17T03:41:58.798954+0000","last_fullsized":"2024-09-17T03:41:58.798954+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:35.559498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769712+0000","last_change":"2024-09-17T03:41:57.787376+0000","last_active":"2024-09-17T03:41:58.769712+0000","last_peered":"2024-09-17T03:41:58.769712+0000","last_clean":"2024-09-17T03:41:58.769712+0000","last_became_active":"2024-09-17T03:41:57.787036+0000","last_became_peered":"2024-09-17T03:41:57.787036+0000","last_unstale":"2024-09-17T03:41:58.769712+0000","last_undegraded":"2024-09-17T03:41:58.769712+0000","last_fullsized":"2024-09-17T03:41:58.769712+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:07.925487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.774207+0000","last_change":"2024-09-17T03:41:57.777414+0000","last_active":"2024-09-17T03:41:58.774207+0000","last_peered":"2024-09-17T03:41:58.774207+0000","last_clean":"2024-09-17T03:41:58.774207+0000","last_became_active":"2024-09-17T03:41:57.777105+0000","last_became_peered":"2024-09-17T03:41:57.777105+0000","last_unstale":"2024-09-17T03:41:58.774207+0000","last_undegraded":"2024-09-17T03:41:58.774207+0000","last_fullsized":"2024-09-17T03:41:58.774207+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:02.185593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.779969+0000","last_change":"2024-09-17T03:41:58.778450+0000","last_active":"2024-09-17T03:41:58.779969+0000","last_peered":"2024-09-17T03:41:58.779969+0000","last_clean":"2024-09-17T03:41:58.779969+0000","last_became_active":"2024-09-17T03:41:58.778161+0000","last_became_peered":"2024-09-17T03:41:58.778161+0000","last_unstale":"2024-09-17T03:41:58.779969+0000","last_undegraded":"2024-09-17T03:41:58.779969+0000","last_fullsized":"2024-09-17T03:41:58.779969+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:09.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"142'8","reported_seq":21,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800571+0000","last_change":"2024-09-17T03:41:57.781387+0000","last_active":"2024-09-17T03:41:58.800571+0000","last_peered":"2024-09-17T03:41:58.800571+0000","last_clean":"2024-09-17T03:41:58.800571+0000","last_became_active":"2024-09-17T03:41:57.781040+0000","last_became_peered":"2024-09-17T03:41:57.781040+0000","last_unstale":"2024-09-17T03:41:58.800571+0000","last_undegraded":"2024-09-17T03:41:58.800571+0000","last_fullsized":"2024-09-17T03:41:58.800571+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:01.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789125+0000","last_change":"2024-09-17T03:41:58.785556+0000","last_active":"2024-09-17T03:41:58.789125+0000","last_peered":"2024-09-17T03:41:58.789125+0000","last_clean":"2024-09-17T03:41:58.789125+0000","last_became_active":"2024-09-17T03:41:58.785245+0000","last_became_peered":"2024-09-17T03:41:58.785245+0000","last_unstale":"2024-09-17T03:41:58.789125+0000","last_undegraded":"2024-09-17T03:41:58.789125+0000","last_fullsized":"2024-09-17T03:41:58.789125+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:09.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.760811+0000","last_change":"2024-09-17T03:41:56.760811+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.760811+0000","last_undegraded":"2024-09-17T03:41:56.760811+0000","last_fullsized":"2024-09-17T03:41:56.760811+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.784457+0000","last_change":"2024-09-17T03:41:58.779968+0000","last_active":"2024-09-17T03:41:58.784457+0000","last_peered":"2024-09-17T03:41:58.784457+0000","last_clean":"2024-09-17T03:41:58.784457+0000","last_became_active":"2024-09-17T03:41:58.779689+0000","last_became_peered":"2024-09-17T03:41:58.779689+0000","last_unstale":"2024-09-17T03:41:58.784457+0000","last_undegraded":"2024-09-17T03:41:58.784457+0000","last_fullsized":"2024-09-17T03:41:58.784457+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:10.869543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.766679+0000","last_change":"2024-09-17T03:41:56.766679+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.766679+0000","last_undegraded":"2024-09-17T03:41:56.766679+0000","last_fullsized":"2024-09-17T03:41:56.766679+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793187+0000","last_change":"2024-09-17T03:41:58.790968+0000","last_active":"2024-09-17T03:41:58.793187+0000","last_peered":"2024-09-17T03:41:58.793187+0000","last_clean":"2024-09-17T03:41:58.793187+0000","last_became_active":"2024-09-17T03:41:58.790345+0000","last_became_peered":"2024-09-17T03:41:58.790345+0000","last_unstale":"2024-09-17T03:41:58.793187+0000","last_undegraded":"2024-09-17T03:41:58.793187+0000","last_fullsized":"2024-09-17T03:41:58.793187+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:50.226386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"142'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798308+0000","last_change":"2024-09-17T03:41:57.782205+0000","last_active":"2024-09-17T03:41:58.798308+0000","last_peered":"2024-09-17T03:41:58.798308+0000","last_clean":"2024-09-17T03:41:58.798308+0000","last_became_active":"2024-09-17T03:41:57.781549+0000","last_became_peered":"2024-09-17T03:41:57.781549+0000","last_unstale":"2024-09-17T03:41:58.798308+0000","last_undegraded":"2024-09-17T03:41:58.798308+0000","last_fullsized":"2024-09-17T03:41:58.798308+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:14.375766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.786243+0000","last_change":"2024-09-17T03:41:58.782158+0000","last_active":"2024-09-17T03:41:58.786243+0000","last_peered":"2024-09-17T03:41:58.786243+0000","last_clean":"2024-09-17T03:41:58.786243+0000","last_became_active":"2024-09-17T03:41:58.781872+0000","last_became_peered":"2024-09-17T03:41:58.781872+0000","last_unstale":"2024-09-17T03:41:58.786243+0000","last_undegraded":"2024-09-17T03:41:58.786243+0000","last_fullsized":"2024-09-17T03:41:58.786243+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:52.198315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.765252+0000","last_change":"2024-09-17T03:41:56.765252+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.765252+0000","last_undegraded":"2024-09-17T03:41:56.765252+0000","last_fullsized":"2024-09-17T03:41:56.765252+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794769+0000","last_change":"2024-09-17T03:41:58.788349+0000","last_active":"2024-09-17T03:41:58.794769+0000","last_peered":"2024-09-17T03:41:58.794769+0000","last_clean":"2024-09-17T03:41:58.794769+0000","last_became_active":"2024-09-17T03:41:58.788032+0000","last_became_peered":"2024-09-17T03:41:58.788032+0000","last_unstale":"2024-09-17T03:41:58.794769+0000","last_undegraded":"2024-09-17T03:41:58.794769+0000","last_fullsized":"2024-09-17T03:41:58.794769+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:38.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798397+0000","last_change":"2024-09-17T03:41:57.776487+0000","last_active":"2024-09-17T03:41:58.798397+0000","last_peered":"2024-09-17T03:41:58.798397+0000","last_clean":"2024-09-17T03:41:58.798397+0000","last_became_active":"2024-09-17T03:41:57.776096+0000","last_became_peered":"2024-09-17T03:41:57.776096+0000","last_unstale":"2024-09-17T03:41:58.798397+0000","last_undegraded":"2024-09-17T03:41:58.798397+0000","last_fullsized":"2024-09-17T03:41:58.798397+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:15.191990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798487+0000","last_change":"2024-09-17T03:41:58.797168+0000","last_active":"2024-09-17T03:41:58.798487+0000","last_peered":"2024-09-17T03:41:58.798487+0000","last_clean":"2024-09-17T03:41:58.798487+0000","last_became_active":"2024-09-17T03:41:58.796622+0000","last_became_peered":"2024-09-17T03:41:58.796622+0000","last_unstale":"2024-09-17T03:41:58.798487+0000","last_undegraded":"2024-09-17T03:41:58.798487+0000","last_fullsized":"2024-09-17T03:41:58.798487+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:12.189579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769800+0000","last_change":"2024-09-17T03:41:57.778245+0000","last_active":"2024-09-17T03:41:58.769800+0000","last_peered":"2024-09-17T03:41:58.769800+0000","last_clean":"2024-09-17T03:41:58.769800+0000","last_became_active":"2024-09-17T03:41:57.777803+0000","last_became_peered":"2024-09-17T03:41:57.777803+0000","last_unstale":"2024-09-17T03:41:58.769800+0000","last_undegraded":"2024-09-17T03:41:58.769800+0000","last_fullsized":"2024-09-17T03:41:58.769800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:05.305842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794707+0000","last_change":"2024-09-17T03:41:58.791751+0000","last_active":"2024-09-17T03:41:58.794707+0000","last_peered":"2024-09-17T03:41:58.794707+0000","last_clean":"2024-09-17T03:41:58.794707+0000","last_became_active":"2024-09-17T03:41:58.791471+0000","last_became_peered":"2024-09-17T03:41:58.791471+0000","last_unstale":"2024-09-17T03:41:58.794707+0000","last_undegraded":"2024-09-17T03:41:58.794707+0000","last_fullsized":"2024-09-17T03:41:58.794707+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:47.947416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.771095+0000","last_change":"2024-09-17T03:41:57.783936+0000","last_active":"2024-09-17T03:41:58.771095+0000","last_peered":"2024-09-17T03:41:58.771095+0000","last_clean":"2024-09-17T03:41:58.771095+0000","last_became_active":"2024-09-17T03:41:57.783328+0000","last_became_peered":"2024-09-17T03:41:57.783328+0000","last_unstale":"2024-09-17T03:41:58.771095+0000","last_undegraded":"2024-09-17T03:41:58.771095+0000","last_fullsized":"2024-09-17T03:41:58.771095+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:27.468632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798358+0000","last_change":"2024-09-17T03:41:58.796724+0000","last_active":"2024-09-17T03:41:58.798358+0000","last_peered":"2024-09-17T03:41:58.798358+0000","last_clean":"2024-09-17T03:41:58.798358+0000","last_became_active":"2024-09-17T03:41:58.796412+0000","last_became_peered":"2024-09-17T03:41:58.796412+0000","last_unstale":"2024-09-17T03:41:58.798358+0000","last_undegraded":"2024-09-17T03:41:58.798358+0000","last_fullsized":"2024-09-17T03:41:58.798358+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:27.063583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.771463+0000","last_change":"2024-09-17T03:41:57.781280+0000","last_active":"2024-09-17T03:41:58.771463+0000","last_peered":"2024-09-17T03:41:58.771463+0000","last_clean":"2024-09-17T03:41:58.771463+0000","last_became_active":"2024-09-17T03:41:57.780910+0000","last_became_peered":"2024-09-17T03:41:57.780910+0000","last_unstale":"2024-09-17T03:41:58.771463+0000","last_undegraded":"2024-09-17T03:41:58.771463+0000","last_fullsized":"2024-09-17T03:41:58.771463+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:01.006744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800372+0000","last_change":"2024-09-17T03:41:57.783360+0000","last_active":"2024-09-17T03:41:58.800372+0000","last_peered":"2024-09-17T03:41:58.800372+0000","last_clean":"2024-09-17T03:41:58.800372+0000","last_became_active":"2024-09-17T03:41:57.783016+0000","last_became_peered":"2024-09-17T03:41:57.783016+0000","last_unstale":"2024-09-17T03:41:58.800372+0000","last_undegraded":"2024-09-17T03:41:58.800372+0000","last_fullsized":"2024-09-17T03:41:58.800372+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:57.921906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.781646+0000","last_change":"2024-09-17T03:41:58.779367+0000","last_active":"2024-09-17T03:41:58.781646+0000","last_peered":"2024-09-17T03:41:58.781646+0000","last_clean":"2024-09-17T03:41:58.781646+0000","last_became_active":"2024-09-17T03:41:58.779044+0000","last_became_peered":"2024-09-17T03:41:58.779044+0000","last_unstale":"2024-09-17T03:41:58.781646+0000","last_undegraded":"2024-09-17T03:41:58.781646+0000","last_fullsized":"2024-09-17T03:41:58.781646+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:59.168673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776049+0000","last_change":"2024-09-17T03:41:57.780031+0000","last_active":"2024-09-17T03:41:58.776049+0000","last_peered":"2024-09-17T03:41:58.776049+0000","last_clean":"2024-09-17T03:41:58.776049+0000","last_became_active":"2024-09-17T03:41:57.779710+0000","last_became_peered":"2024-09-17T03:41:57.779710+0000","last_unstale":"2024-09-17T03:41:58.776049+0000","last_undegraded":"2024-09-17T03:41:58.776049+0000","last_fullsized":"2024-09-17T03:41:58.776049+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:56.392154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.777493+0000","last_change":"2024-09-17T03:41:57.782553+0000","last_active":"2024-09-17T03:41:58.777493+0000","last_peered":"2024-09-17T03:41:58.777493+0000","last_clean":"2024-09-17T03:41:58.777493+0000","last_became_active":"2024-09-17T03:41:57.782195+0000","last_became_peered":"2024-09-17T03:41:57.782195+0000","last_unstale":"2024-09-17T03:41:58.777493+0000","last_undegraded":"2024-09-17T03:41:58.777493+0000","last_fullsized":"2024-09-17T03:41:58.777493+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.986071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790757+0000","last_change":"2024-09-17T03:41:58.786028+0000","last_active":"2024-09-17T03:41:58.790757+0000","last_peered":"2024-09-17T03:41:58.790757+0000","last_clean":"2024-09-17T03:41:58.790757+0000","last_became_active":"2024-09-17T03:41:58.785761+0000","last_became_peered":"2024-09-17T03:41:58.785761+0000","last_unstale":"2024-09-17T03:41:58.790757+0000","last_undegraded":"2024-09-17T03:41:58.790757+0000","last_fullsized":"2024-09-17T03:41:58.790757+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:47.216999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776326+0000","last_change":"2024-09-17T03:41:57.782886+0000","last_active":"2024-09-17T03:41:58.776326+0000","last_peered":"2024-09-17T03:41:58.776326+0000","last_clean":"2024-09-17T03:41:58.776326+0000","last_became_active":"2024-09-17T03:41:57.782391+0000","last_became_peered":"2024-09-17T03:41:57.782391+0000","last_unstale":"2024-09-17T03:41:58.776326+0000","last_undegraded":"2024-09-17T03:41:58.776326+0000","last_fullsized":"2024-09-17T03:41:58.776326+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:13.802117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795960+0000","last_change":"2024-09-17T03:41:58.794134+0000","last_active":"2024-09-17T03:41:58.795960+0000","last_peered":"2024-09-17T03:41:58.795960+0000","last_clean":"2024-09-17T03:41:58.795960+0000","last_became_active":"2024-09-17T03:41:58.793808+0000","last_became_peered":"2024-09-17T03:41:58.793808+0000","last_unstale":"2024-09-17T03:41:58.795960+0000","last_undegraded":"2024-09-17T03:41:58.795960+0000","last_fullsized":"2024-09-17T03:41:58.795960+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:31.999015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.778574+0000","last_change":"2024-09-17T03:41:57.785169+0000","last_active":"2024-09-17T03:41:58.778574+0000","last_peered":"2024-09-17T03:41:58.778574+0000","last_clean":"2024-09-17T03:41:58.778574+0000","last_became_active":"2024-09-17T03:41:57.784823+0000","last_became_peered":"2024-09-17T03:41:57.784823+0000","last_unstale":"2024-09-17T03:41:58.778574+0000","last_undegraded":"2024-09-17T03:41:58.778574+0000","last_fullsized":"2024-09-17T03:41:58.778574+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:57.518613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.770051+0000","last_change":"2024-09-17T03:41:57.783095+0000","last_active":"2024-09-17T03:41:58.770051+0000","last_peered":"2024-09-17T03:41:58.770051+0000","last_clean":"2024-09-17T03:41:58.770051+0000","last_became_active":"2024-09-17T03:41:57.782778+0000","last_became_peered":"2024-09-17T03:41:57.782778+0000","last_unstale":"2024-09-17T03:41:58.770051+0000","last_undegraded":"2024-09-17T03:41:58.770051+0000","last_fullsized":"2024-09-17T03:41:58.770051+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:42.526729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789255+0000","last_change":"2024-09-17T03:41:58.784537+0000","last_active":"2024-09-17T03:41:58.789255+0000","last_peered":"2024-09-17T03:41:58.789255+0000","last_clean":"2024-09-17T03:41:58.789255+0000","last_became_active":"2024-09-17T03:41:58.784218+0000","last_became_peered":"2024-09-17T03:41:58.784218+0000","last_unstale":"2024-09-17T03:41:58.789255+0000","last_undegraded":"2024-09-17T03:41:58.789255+0000","last_fullsized":"2024-09-17T03:41:58.789255+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:16.246738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.770135+0000","last_change":"2024-09-17T03:41:57.776527+0000","last_active":"2024-09-17T03:41:58.770135+0000","last_peered":"2024-09-17T03:41:58.770135+0000","last_clean":"2024-09-17T03:41:58.770135+0000","last_became_active":"2024-09-17T03:41:57.776202+0000","last_became_peered":"2024-09-17T03:41:57.776202+0000","last_unstale":"2024-09-17T03:41:58.770135+0000","last_undegraded":"2024-09-17T03:41:58.770135+0000","last_fullsized":"2024-09-17T03:41:58.770135+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:53.119624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.764686+0000","last_change":"2024-09-17T03:41:56.764686+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.764686+0000","last_undegraded":"2024-09-17T03:41:56.764686+0000","last_fullsized":"2024-09-17T03:41:56.764686+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798396+0000","last_change":"2024-09-17T03:41:58.797467+0000","last_active":"2024-09-17T03:41:58.798396+0000","last_peered":"2024-09-17T03:41:58.798396+0000","last_clean":"2024-09-17T03:41:58.798396+0000","last_became_active":"2024-09-17T03:41:58.797143+0000","last_became_peered":"2024-09-17T03:41:58.797143+0000","last_unstale":"2024-09-17T03:41:58.798396+0000","last_undegraded":"2024-09-17T03:41:58.798396+0000","last_fullsized":"2024-09-17T03:41:58.798396+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:16.835504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"142'3","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798176+0000","last_change":"2024-09-17T03:41:57.777388+0000","last_active":"2024-09-17T03:41:58.798176+0000","last_peered":"2024-09-17T03:41:58.798176+0000","last_clean":"2024-09-17T03:41:58.798176+0000","last_became_active":"2024-09-17T03:41:57.777035+0000","last_became_peered":"2024-09-17T03:41:57.777035+0000","last_unstale":"2024-09-17T03:41:58.798176+0000","last_undegraded":"2024-09-17T03:41:58.798176+0000","last_fullsized":"2024-09-17T03:41:58.798176+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.381560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":333,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769029+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:41:58.769029+0000","last_peered":"2024-09-17T03:41:58.769029+0000","last_clean":"2024-09-17T03:41:58.769029+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:41:58.769029+0000","last_undegraded":"2024-09-17T03:41:58.769029+0000","last_fullsized":"2024-09-17T03:41:58.769029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51560,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320280,"statfs":{"total":96636764160,"available":96583966720,"internally_reserved":0,"allocated":2371584,"data_stored":1367342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509554,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1781760,"data_stored":776468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509554,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55132,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316708,"statfs":{"total":96636764160,"available":96580308992,"internally_reserved":0,"allocated":1769472,"data_stored":776322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":778004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55128,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316712,"statfs":{"total":96636764160,"available":96580313088,"internally_reserved":0,"allocated":1773568,"data_stored":776904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509555,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51568,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320272,"statfs":{"total":96636764160,"available":96583958528,"internally_reserved":0,"allocated":2379776,"data_stored":1368336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46772,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325068,"statfs":{"total":96636764160,"available":96588869632,"internally_reserved":0,"allocated":1732608,"data_stored":757455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50932,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320908,"statfs":{"total":96636764160,"available":96584609792,"internally_reserved":0,"allocated":1732608,"data_stored":757455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:42:02.795 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:42:02.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.946+0000 7f14e408b640 1 -- 172.21.15.146:0/517243414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c8004d90 msgr2=0x7f14c8005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.946+0000 7f14e408b640 1 --2- 172.21.15.146:0/517243414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c8004d90 0x7f14c8005260 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0755b0 tx=0x7f14c8005830 comp rx=0 tx=0).stop 2024-09-17T03:42:02.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.946+0000 7f14e2628640 1 -- 172.21.15.146:0/517243414 reap_dead start 2024-09-17T03:42:02.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.946+0000 7f14e408b640 1 -- 172.21.15.146:0/517243414 shutdown_connections 2024-09-17T03:42:02.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.946+0000 7f14e408b640 1 -- 172.21.15.146:0/517243414 >> 172.21.15.146:0/517243414 conn(0x7f14dc0b7b20 msgr2=0x7f14dc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:02.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.946+0000 7f14e408b640 1 -- 172.21.15.146:0/517243414 shutdown_connections 2024-09-17T03:42:02.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.946+0000 7f14e408b640 1 -- 172.21.15.146:0/517243414 wait complete. 2024-09-17T03:42:02.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.948+0000 7f14e408b640 1 Processor -- start 2024-09-17T03:42:02.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.948+0000 7f14e408b640 1 -- start start 2024-09-17T03:42:02.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.949+0000 7f14e408b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c8004d90 0x7f14dc143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.949+0000 7f14e408b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14dc155040 0x7f14dc145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.949+0000 7f14e408b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14dc146530 0x7f14dc146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.949+0000 7f14e408b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc06e030 con 0x7f14c8004d90 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.949+0000 7f14e408b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc06deb0 con 0x7f14dc155040 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.949+0000 7f14e408b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f14dc06e1b0 con 0x7f14dc146530 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.949+0000 7f14e1e27640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c8004d90 0x7f14dc143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.949+0000 7f14e1e27640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c8004d90 0x7f14dc143750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59422/0 (socket says 172.21.15.146:59422) 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.949+0000 7f14e1e27640 1 -- 172.21.15.146:0/2099204613 learned_addr learned my addr 172.21.15.146:0/2099204613 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.949+0000 7f14e2628640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14dc146530 0x7f14dc146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.949+0000 7f14e1626640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14dc155040 0x7f14dc145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14e1e27640 1 -- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14dc146530 msgr2=0x7f14dc146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14e1e27640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14dc146530 0x7f14dc146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14e1e27640 1 -- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14dc155040 msgr2=0x7f14dc145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:02.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14e1e27640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14dc155040 0x7f14dc145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:02.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14e1e27640 1 -- 172.21.15.146:0/2099204613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc09d780 con 0x7f14c8004d90 2024-09-17T03:42:02.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14e1626640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14dc155040 0x7f14dc145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:02.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14e1e27640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c8004d90 0x7f14dc143750 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f14d8011a50 tx=0x7f14d8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:02.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14d27fc640 1 -- 172.21.15.146:0/2099204613 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d801f070 con 0x7f14c8004d90 2024-09-17T03:42:02.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14d27fc640 1 -- 172.21.15.146:0/2099204613 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14d800fe80 con 0x7f14c8004d90 2024-09-17T03:42:02.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14d27fc640 1 -- 172.21.15.146:0/2099204613 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8012690 con 0x7f14c8004d90 2024-09-17T03:42:02.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14e408b640 1 -- 172.21.15.146:0/2099204613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14dc143c90 con 0x7f14c8004d90 2024-09-17T03:42:02.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.950+0000 7f14e408b640 1 -- 172.21.15.146:0/2099204613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14dc09d9f0 con 0x7f14c8004d90 2024-09-17T03:42:02.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.951+0000 7f14e408b640 1 -- 172.21.15.146:0/2099204613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14dc06f150 con 0x7f14c8004d90 2024-09-17T03:42:02.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.952+0000 7f14d27fc640 1 -- 172.21.15.146:0/2099204613 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14d8022070 con 0x7f14c8004d90 2024-09-17T03:42:02.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.952+0000 7f14d27fc640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14c0078bc0 0x7f14c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:02.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.952+0000 7f14d27fc640 1 -- 172.21.15.146:0/2099204613 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f14d809b880 con 0x7f14c8004d90 2024-09-17T03:42:02.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.953+0000 7f14e1626640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14c0078bc0 0x7f14c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:02.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.953+0000 7f14e1626640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14c0078bc0 0x7f14c007b0d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0018a0 tx=0x7f14cc001110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:02.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:02.957+0000 7f14d27fc640 1 -- 172.21.15.146:0/2099204613 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14d8063670 con 0x7f14c8004d90 2024-09-17T03:42:03.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.128+0000 7f14e408b640 1 -- 172.21.15.146:0/2099204613 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14dc0b0550 con 0x7f14c0078bc0 2024-09-17T03:42:03.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.132+0000 7f14d27fc640 1 -- 172.21.15.146:0/2099204613 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249504 (secure 0 0 0) 0x7f14dc0b0550 con 0x7f14c0078bc0 2024-09-17T03:42:03.134 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:03.135 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:42:03.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.135+0000 7f14e408b640 1 -- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14c0078bc0 msgr2=0x7f14c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.135+0000 7f14e408b640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14c0078bc0 0x7f14c007b0d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0018a0 tx=0x7f14cc001110 comp rx=0 tx=0).stop 2024-09-17T03:42:03.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.135+0000 7f14e408b640 1 -- 172.21.15.146:0/2099204613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c8004d90 msgr2=0x7f14dc143750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.135+0000 7f14e408b640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c8004d90 0x7f14dc143750 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f14d8011a50 tx=0x7f14d8011f10 comp rx=0 tx=0).stop 2024-09-17T03:42:03.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.136+0000 7f14e408b640 1 -- 172.21.15.146:0/2099204613 shutdown_connections 2024-09-17T03:42:03.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.136+0000 7f14e408b640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f14c0078bc0 0x7f14c007b0d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.136+0000 7f14e408b640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14dc146530 0x7f14dc146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.136+0000 7f14e408b640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f14dc155040 0x7f14dc145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.136+0000 7f14e408b640 1 --2- 172.21.15.146:0/2099204613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c8004d90 0x7f14dc143750 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.136+0000 7f14e408b640 1 -- 172.21.15.146:0/2099204613 >> 172.21.15.146:0/2099204613 conn(0x7f14dc0b7b20 msgr2=0x7f14dc071200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:03.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.136+0000 7f14e408b640 1 -- 172.21.15.146:0/2099204613 shutdown_connections 2024-09-17T03:42:03.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.136+0000 7f14e408b640 1 -- 172.21.15.146:0/2099204613 wait complete. 2024-09-17T03:42:03.146 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2024-09-17T03:42:01.934889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":141,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":162,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":417216,"kb_used_data":14968,"kb_used_omap":12,"kb_used_meta":402035,"kb_avail":754557504,"statfs":{"total":773094113280,"available":772666884096,"internally_reserved":0,"allocated":15327232,"data_stored":7358286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":411684401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.176865"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789673+0000","last_change":"2024-09-17T03:41:58.783510+0000","last_active":"2024-09-17T03:41:58.789673+0000","last_peered":"2024-09-17T03:41:58.789673+0000","last_clean":"2024-09-17T03:41:58.789673+0000","last_became_active":"2024-09-17T03:41:58.782625+0000","last_became_peered":"2024-09-17T03:41:58.782625+0000","last_unstale":"2024-09-17T03:41:58.789673+0000","last_undegraded":"2024-09-17T03:41:58.789673+0000","last_fullsized":"2024-09-17T03:41:58.789673+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:08.308387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.773941+0000","last_change":"2024-09-17T03:41:58.773210+0000","last_active":"2024-09-17T03:41:58.773941+0000","last_peered":"2024-09-17T03:41:58.773941+0000","last_clean":"2024-09-17T03:41:58.773941+0000","last_became_active":"2024-09-17T03:41:58.771709+0000","last_became_peered":"2024-09-17T03:41:58.771709+0000","last_unstale":"2024-09-17T03:41:58.773941+0000","last_undegraded":"2024-09-17T03:41:58.773941+0000","last_fullsized":"2024-09-17T03:41:58.773941+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:23.055342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790017+0000","last_change":"2024-09-17T03:41:58.784113+0000","last_active":"2024-09-17T03:41:58.790017+0000","last_peered":"2024-09-17T03:41:58.790017+0000","last_clean":"2024-09-17T03:41:58.790017+0000","last_became_active":"2024-09-17T03:41:58.783674+0000","last_became_peered":"2024-09-17T03:41:58.783674+0000","last_unstale":"2024-09-17T03:41:58.790017+0000","last_undegraded":"2024-09-17T03:41:58.790017+0000","last_fullsized":"2024-09-17T03:41:58.790017+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:15.404369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789718+0000","last_change":"2024-09-17T03:41:58.781216+0000","last_active":"2024-09-17T03:41:58.789718+0000","last_peered":"2024-09-17T03:41:58.789718+0000","last_clean":"2024-09-17T03:41:58.789718+0000","last_became_active":"2024-09-17T03:41:58.780931+0000","last_became_peered":"2024-09-17T03:41:58.780931+0000","last_unstale":"2024-09-17T03:41:58.789718+0000","last_undegraded":"2024-09-17T03:41:58.789718+0000","last_fullsized":"2024-09-17T03:41:58.789718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:17.947058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.797923+0000","last_change":"2024-09-17T03:41:58.795953+0000","last_active":"2024-09-17T03:41:58.797923+0000","last_peered":"2024-09-17T03:41:58.797923+0000","last_clean":"2024-09-17T03:41:58.797923+0000","last_became_active":"2024-09-17T03:41:58.795588+0000","last_became_peered":"2024-09-17T03:41:58.795588+0000","last_unstale":"2024-09-17T03:41:58.797923+0000","last_undegraded":"2024-09-17T03:41:58.797923+0000","last_fullsized":"2024-09-17T03:41:58.797923+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:03.090120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794142+0000","last_change":"2024-09-17T03:41:58.793259+0000","last_active":"2024-09-17T03:41:58.794142+0000","last_peered":"2024-09-17T03:41:58.794142+0000","last_clean":"2024-09-17T03:41:58.794142+0000","last_became_active":"2024-09-17T03:41:58.792967+0000","last_became_peered":"2024-09-17T03:41:58.792967+0000","last_unstale":"2024-09-17T03:41:58.794142+0000","last_undegraded":"2024-09-17T03:41:58.794142+0000","last_fullsized":"2024-09-17T03:41:58.794142+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:49.170549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789159+0000","last_change":"2024-09-17T03:41:58.786406+0000","last_active":"2024-09-17T03:41:58.789159+0000","last_peered":"2024-09-17T03:41:58.789159+0000","last_clean":"2024-09-17T03:41:58.789159+0000","last_became_active":"2024-09-17T03:41:58.785804+0000","last_became_peered":"2024-09-17T03:41:58.785804+0000","last_unstale":"2024-09-17T03:41:58.789159+0000","last_undegraded":"2024-09-17T03:41:58.789159+0000","last_fullsized":"2024-09-17T03:41:58.789159+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:31.346639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793904+0000","last_change":"2024-09-17T03:41:58.792926+0000","last_active":"2024-09-17T03:41:58.793904+0000","last_peered":"2024-09-17T03:41:58.793904+0000","last_clean":"2024-09-17T03:41:58.793904+0000","last_became_active":"2024-09-17T03:41:58.792624+0000","last_became_peered":"2024-09-17T03:41:58.792624+0000","last_unstale":"2024-09-17T03:41:58.793904+0000","last_undegraded":"2024-09-17T03:41:58.793904+0000","last_fullsized":"2024-09-17T03:41:58.793904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:28.867944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789347+0000","last_change":"2024-09-17T03:41:58.787698+0000","last_active":"2024-09-17T03:41:58.789347+0000","last_peered":"2024-09-17T03:41:58.789347+0000","last_clean":"2024-09-17T03:41:58.789347+0000","last_became_active":"2024-09-17T03:41:58.787391+0000","last_became_peered":"2024-09-17T03:41:58.787391+0000","last_unstale":"2024-09-17T03:41:58.789347+0000","last_undegraded":"2024-09-17T03:41:58.789347+0000","last_fullsized":"2024-09-17T03:41:58.789347+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:16.851435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.796383+0000","last_change":"2024-09-17T03:41:58.792904+0000","last_active":"2024-09-17T03:41:58.796383+0000","last_peered":"2024-09-17T03:41:58.796383+0000","last_clean":"2024-09-17T03:41:58.796383+0000","last_became_active":"2024-09-17T03:41:58.792587+0000","last_became_peered":"2024-09-17T03:41:58.792587+0000","last_unstale":"2024-09-17T03:41:58.796383+0000","last_undegraded":"2024-09-17T03:41:58.796383+0000","last_fullsized":"2024-09-17T03:41:58.796383+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:35.853662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.780484+0000","last_change":"2024-09-17T03:41:58.778325+0000","last_active":"2024-09-17T03:41:58.780484+0000","last_peered":"2024-09-17T03:41:58.780484+0000","last_clean":"2024-09-17T03:41:58.780484+0000","last_became_active":"2024-09-17T03:41:58.778010+0000","last_became_peered":"2024-09-17T03:41:58.778010+0000","last_unstale":"2024-09-17T03:41:58.780484+0000","last_undegraded":"2024-09-17T03:41:58.780484+0000","last_fullsized":"2024-09-17T03:41:58.780484+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:31.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791571+0000","last_change":"2024-09-17T03:41:58.784054+0000","last_active":"2024-09-17T03:41:58.791571+0000","last_peered":"2024-09-17T03:41:58.791571+0000","last_clean":"2024-09-17T03:41:58.791571+0000","last_became_active":"2024-09-17T03:41:58.783751+0000","last_became_peered":"2024-09-17T03:41:58.783751+0000","last_unstale":"2024-09-17T03:41:58.791571+0000","last_undegraded":"2024-09-17T03:41:58.791571+0000","last_fullsized":"2024-09-17T03:41:58.791571+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:49.444227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795743+0000","last_change":"2024-09-17T03:41:58.791309+0000","last_active":"2024-09-17T03:41:58.795743+0000","last_peered":"2024-09-17T03:41:58.795743+0000","last_clean":"2024-09-17T03:41:58.795743+0000","last_became_active":"2024-09-17T03:41:58.791005+0000","last_became_peered":"2024-09-17T03:41:58.791005+0000","last_unstale":"2024-09-17T03:41:58.795743+0000","last_undegraded":"2024-09-17T03:41:58.795743+0000","last_fullsized":"2024-09-17T03:41:58.795743+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:44.620003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.773928+0000","last_change":"2024-09-17T03:41:58.772834+0000","last_active":"2024-09-17T03:41:58.773928+0000","last_peered":"2024-09-17T03:41:58.773928+0000","last_clean":"2024-09-17T03:41:58.773928+0000","last_became_active":"2024-09-17T03:41:58.772503+0000","last_became_peered":"2024-09-17T03:41:58.772503+0000","last_unstale":"2024-09-17T03:41:58.773928+0000","last_undegraded":"2024-09-17T03:41:58.773928+0000","last_fullsized":"2024-09-17T03:41:58.773928+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:05.742202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790728+0000","last_change":"2024-09-17T03:41:58.785329+0000","last_active":"2024-09-17T03:41:58.790728+0000","last_peered":"2024-09-17T03:41:58.790728+0000","last_clean":"2024-09-17T03:41:58.790728+0000","last_became_active":"2024-09-17T03:41:58.785017+0000","last_became_peered":"2024-09-17T03:41:58.785017+0000","last_unstale":"2024-09-17T03:41:58.790728+0000","last_undegraded":"2024-09-17T03:41:58.790728+0000","last_fullsized":"2024-09-17T03:41:58.790728+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:10.635488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790132+0000","last_change":"2024-09-17T03:41:58.782096+0000","last_active":"2024-09-17T03:41:58.790132+0000","last_peered":"2024-09-17T03:41:58.790132+0000","last_clean":"2024-09-17T03:41:58.790132+0000","last_became_active":"2024-09-17T03:41:58.781798+0000","last_became_peered":"2024-09-17T03:41:58.781798+0000","last_unstale":"2024-09-17T03:41:58.790132+0000","last_undegraded":"2024-09-17T03:41:58.790132+0000","last_fullsized":"2024-09-17T03:41:58.790132+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:24.167278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789200+0000","last_change":"2024-09-17T03:41:58.787064+0000","last_active":"2024-09-17T03:41:58.789200+0000","last_peered":"2024-09-17T03:41:58.789200+0000","last_clean":"2024-09-17T03:41:58.789200+0000","last_became_active":"2024-09-17T03:41:58.786212+0000","last_became_peered":"2024-09-17T03:41:58.786212+0000","last_unstale":"2024-09-17T03:41:58.789200+0000","last_undegraded":"2024-09-17T03:41:58.789200+0000","last_fullsized":"2024-09-17T03:41:58.789200+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:01.139228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789870+0000","last_change":"2024-09-17T03:41:58.785048+0000","last_active":"2024-09-17T03:41:58.789870+0000","last_peered":"2024-09-17T03:41:58.789870+0000","last_clean":"2024-09-17T03:41:58.789870+0000","last_became_active":"2024-09-17T03:41:58.784435+0000","last_became_peered":"2024-09-17T03:41:58.784435+0000","last_unstale":"2024-09-17T03:41:58.789870+0000","last_undegraded":"2024-09-17T03:41:58.789870+0000","last_fullsized":"2024-09-17T03:41:58.789870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:46.290406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794684+0000","last_change":"2024-09-17T03:41:58.791265+0000","last_active":"2024-09-17T03:41:58.794684+0000","last_peered":"2024-09-17T03:41:58.794684+0000","last_clean":"2024-09-17T03:41:58.794684+0000","last_became_active":"2024-09-17T03:41:58.790981+0000","last_became_peered":"2024-09-17T03:41:58.790981+0000","last_unstale":"2024-09-17T03:41:58.794684+0000","last_undegraded":"2024-09-17T03:41:58.794684+0000","last_fullsized":"2024-09-17T03:41:58.794684+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:03.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789286+0000","last_change":"2024-09-17T03:41:58.786007+0000","last_active":"2024-09-17T03:41:58.789286+0000","last_peered":"2024-09-17T03:41:58.789286+0000","last_clean":"2024-09-17T03:41:58.789286+0000","last_became_active":"2024-09-17T03:41:58.785642+0000","last_became_peered":"2024-09-17T03:41:58.785642+0000","last_unstale":"2024-09-17T03:41:58.789286+0000","last_undegraded":"2024-09-17T03:41:58.789286+0000","last_fullsized":"2024-09-17T03:41:58.789286+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:45.260732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791077+0000","last_change":"2024-09-17T03:41:58.784174+0000","last_active":"2024-09-17T03:41:58.791077+0000","last_peered":"2024-09-17T03:41:58.791077+0000","last_clean":"2024-09-17T03:41:58.791077+0000","last_became_active":"2024-09-17T03:41:58.783889+0000","last_became_peered":"2024-09-17T03:41:58.783889+0000","last_unstale":"2024-09-17T03:41:58.791077+0000","last_undegraded":"2024-09-17T03:41:58.791077+0000","last_fullsized":"2024-09-17T03:41:58.791077+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:49.912037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793352+0000","last_change":"2024-09-17T03:41:58.790506+0000","last_active":"2024-09-17T03:41:58.793352+0000","last_peered":"2024-09-17T03:41:58.793352+0000","last_clean":"2024-09-17T03:41:58.793352+0000","last_became_active":"2024-09-17T03:41:58.790198+0000","last_became_peered":"2024-09-17T03:41:58.790198+0000","last_unstale":"2024-09-17T03:41:58.793352+0000","last_undegraded":"2024-09-17T03:41:58.793352+0000","last_fullsized":"2024-09-17T03:41:58.793352+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:44.163526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791013+0000","last_change":"2024-09-17T03:41:58.783272+0000","last_active":"2024-09-17T03:41:58.791013+0000","last_peered":"2024-09-17T03:41:58.791013+0000","last_clean":"2024-09-17T03:41:58.791013+0000","last_became_active":"2024-09-17T03:41:58.782949+0000","last_became_peered":"2024-09-17T03:41:58.782949+0000","last_unstale":"2024-09-17T03:41:58.791013+0000","last_undegraded":"2024-09-17T03:41:58.791013+0000","last_fullsized":"2024-09-17T03:41:58.791013+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:33.398364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789500+0000","last_change":"2024-09-17T03:41:58.786551+0000","last_active":"2024-09-17T03:41:58.789500+0000","last_peered":"2024-09-17T03:41:58.789500+0000","last_clean":"2024-09-17T03:41:58.789500+0000","last_became_active":"2024-09-17T03:41:58.786235+0000","last_became_peered":"2024-09-17T03:41:58.786235+0000","last_unstale":"2024-09-17T03:41:58.789500+0000","last_undegraded":"2024-09-17T03:41:58.789500+0000","last_fullsized":"2024-09-17T03:41:58.789500+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:55.612023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.782762+0000","last_change":"2024-09-17T03:41:58.781120+0000","last_active":"2024-09-17T03:41:58.782762+0000","last_peered":"2024-09-17T03:41:58.782762+0000","last_clean":"2024-09-17T03:41:58.782762+0000","last_became_active":"2024-09-17T03:41:58.780819+0000","last_became_peered":"2024-09-17T03:41:58.780819+0000","last_unstale":"2024-09-17T03:41:58.782762+0000","last_undegraded":"2024-09-17T03:41:58.782762+0000","last_fullsized":"2024-09-17T03:41:58.782762+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:50.827807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789904+0000","last_change":"2024-09-17T03:41:58.786598+0000","last_active":"2024-09-17T03:41:58.789904+0000","last_peered":"2024-09-17T03:41:58.789904+0000","last_clean":"2024-09-17T03:41:58.789904+0000","last_became_active":"2024-09-17T03:41:58.786273+0000","last_became_peered":"2024-09-17T03:41:58.786273+0000","last_unstale":"2024-09-17T03:41:58.789904+0000","last_undegraded":"2024-09-17T03:41:58.789904+0000","last_fullsized":"2024-09-17T03:41:58.789904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:39.675219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791599+0000","last_change":"2024-09-17T03:41:58.788709+0000","last_active":"2024-09-17T03:41:58.791599+0000","last_peered":"2024-09-17T03:41:58.791599+0000","last_clean":"2024-09-17T03:41:58.791599+0000","last_became_active":"2024-09-17T03:41:58.788401+0000","last_became_peered":"2024-09-17T03:41:58.788401+0000","last_unstale":"2024-09-17T03:41:58.791599+0000","last_undegraded":"2024-09-17T03:41:58.791599+0000","last_fullsized":"2024-09-17T03:41:58.791599+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:54.187280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794133+0000","last_change":"2024-09-17T03:41:58.792053+0000","last_active":"2024-09-17T03:41:58.794133+0000","last_peered":"2024-09-17T03:41:58.794133+0000","last_clean":"2024-09-17T03:41:58.794133+0000","last_became_active":"2024-09-17T03:41:58.791734+0000","last_became_peered":"2024-09-17T03:41:58.791734+0000","last_unstale":"2024-09-17T03:41:58.794133+0000","last_undegraded":"2024-09-17T03:41:58.794133+0000","last_fullsized":"2024-09-17T03:41:58.794133+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:34.904922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"142'4","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800933+0000","last_change":"2024-09-17T03:41:57.783265+0000","last_active":"2024-09-17T03:41:58.800933+0000","last_peered":"2024-09-17T03:41:58.800933+0000","last_clean":"2024-09-17T03:41:58.800933+0000","last_became_active":"2024-09-17T03:41:57.782950+0000","last_became_peered":"2024-09-17T03:41:57.782950+0000","last_unstale":"2024-09-17T03:41:58.800933+0000","last_undegraded":"2024-09-17T03:41:58.800933+0000","last_fullsized":"2024-09-17T03:41:58.800933+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.767175+0000","last_change":"2024-09-17T03:41:56.767175+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.767175+0000","last_undegraded":"2024-09-17T03:41:56.767175+0000","last_fullsized":"2024-09-17T03:41:56.767175+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791207+0000","last_change":"2024-09-17T03:41:58.788338+0000","last_active":"2024-09-17T03:41:58.791207+0000","last_peered":"2024-09-17T03:41:58.791207+0000","last_clean":"2024-09-17T03:41:58.791207+0000","last_became_active":"2024-09-17T03:41:58.788052+0000","last_became_peered":"2024-09-17T03:41:58.788052+0000","last_unstale":"2024-09-17T03:41:58.791207+0000","last_undegraded":"2024-09-17T03:41:58.791207+0000","last_fullsized":"2024-09-17T03:41:58.791207+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:33.314758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799041+0000","last_change":"2024-09-17T03:41:57.786673+0000","last_active":"2024-09-17T03:41:58.799041+0000","last_peered":"2024-09-17T03:41:58.799041+0000","last_clean":"2024-09-17T03:41:58.799041+0000","last_became_active":"2024-09-17T03:41:57.786359+0000","last_became_peered":"2024-09-17T03:41:57.786359+0000","last_unstale":"2024-09-17T03:41:58.799041+0000","last_undegraded":"2024-09-17T03:41:58.799041+0000","last_fullsized":"2024-09-17T03:41:58.799041+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:36.067718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789415+0000","last_change":"2024-09-17T03:41:58.787967+0000","last_active":"2024-09-17T03:41:58.789415+0000","last_peered":"2024-09-17T03:41:58.789415+0000","last_clean":"2024-09-17T03:41:58.789415+0000","last_became_active":"2024-09-17T03:41:58.787652+0000","last_became_peered":"2024-09-17T03:41:58.787652+0000","last_unstale":"2024-09-17T03:41:58.789415+0000","last_undegraded":"2024-09-17T03:41:58.789415+0000","last_fullsized":"2024-09-17T03:41:58.789415+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:18.330621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799781+0000","last_change":"2024-09-17T03:41:57.786812+0000","last_active":"2024-09-17T03:41:58.799781+0000","last_peered":"2024-09-17T03:41:58.799781+0000","last_clean":"2024-09-17T03:41:58.799781+0000","last_became_active":"2024-09-17T03:41:57.786434+0000","last_became_peered":"2024-09-17T03:41:57.786434+0000","last_unstale":"2024-09-17T03:41:58.799781+0000","last_undegraded":"2024-09-17T03:41:58.799781+0000","last_fullsized":"2024-09-17T03:41:58.799781+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.381560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"142'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798526+0000","last_change":"2024-09-17T03:41:57.782388+0000","last_active":"2024-09-17T03:41:58.798526+0000","last_peered":"2024-09-17T03:41:58.798526+0000","last_clean":"2024-09-17T03:41:58.798526+0000","last_became_active":"2024-09-17T03:41:57.782057+0000","last_became_peered":"2024-09-17T03:41:57.782057+0000","last_unstale":"2024-09-17T03:41:58.798526+0000","last_undegraded":"2024-09-17T03:41:58.798526+0000","last_fullsized":"2024-09-17T03:41:58.798526+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:47.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790997+0000","last_change":"2024-09-17T03:41:58.782536+0000","last_active":"2024-09-17T03:41:58.790997+0000","last_peered":"2024-09-17T03:41:58.790997+0000","last_clean":"2024-09-17T03:41:58.790997+0000","last_became_active":"2024-09-17T03:41:58.782153+0000","last_became_peered":"2024-09-17T03:41:58.782153+0000","last_unstale":"2024-09-17T03:41:58.790997+0000","last_undegraded":"2024-09-17T03:41:58.790997+0000","last_fullsized":"2024-09-17T03:41:58.790997+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:02.865504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.760063+0000","last_change":"2024-09-17T03:41:56.760063+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.760063+0000","last_undegraded":"2024-09-17T03:41:56.760063+0000","last_fullsized":"2024-09-17T03:41:56.760063+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.777449+0000","last_change":"2024-09-17T03:41:57.787289+0000","last_active":"2024-09-17T03:41:58.777449+0000","last_peered":"2024-09-17T03:41:58.777449+0000","last_clean":"2024-09-17T03:41:58.777449+0000","last_became_active":"2024-09-17T03:41:57.786949+0000","last_became_peered":"2024-09-17T03:41:57.786949+0000","last_unstale":"2024-09-17T03:41:58.777449+0000","last_undegraded":"2024-09-17T03:41:58.777449+0000","last_fullsized":"2024-09-17T03:41:58.777449+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:11.729127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776783+0000","last_change":"2024-09-17T03:41:57.788010+0000","last_active":"2024-09-17T03:41:58.776783+0000","last_peered":"2024-09-17T03:41:58.776783+0000","last_clean":"2024-09-17T03:41:58.776783+0000","last_became_active":"2024-09-17T03:41:57.787639+0000","last_became_peered":"2024-09-17T03:41:57.787639+0000","last_unstale":"2024-09-17T03:41:58.776783+0000","last_undegraded":"2024-09-17T03:41:58.776783+0000","last_fullsized":"2024-09-17T03:41:58.776783+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:53.119624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.764747+0000","last_change":"2024-09-17T03:41:56.764747+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.764747+0000","last_undegraded":"2024-09-17T03:41:56.764747+0000","last_fullsized":"2024-09-17T03:41:56.764747+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799815+0000","last_change":"2024-09-17T03:41:58.795904+0000","last_active":"2024-09-17T03:41:58.799815+0000","last_peered":"2024-09-17T03:41:58.799815+0000","last_clean":"2024-09-17T03:41:58.799815+0000","last_became_active":"2024-09-17T03:41:58.795526+0000","last_became_peered":"2024-09-17T03:41:58.795526+0000","last_unstale":"2024-09-17T03:41:58.799815+0000","last_undegraded":"2024-09-17T03:41:58.799815+0000","last_fullsized":"2024-09-17T03:41:58.799815+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:46.917885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.772721+0000","last_change":"2024-09-17T03:41:57.784269+0000","last_active":"2024-09-17T03:41:58.772721+0000","last_peered":"2024-09-17T03:41:58.772721+0000","last_clean":"2024-09-17T03:41:58.772721+0000","last_became_active":"2024-09-17T03:41:57.783959+0000","last_became_peered":"2024-09-17T03:41:57.783959+0000","last_unstale":"2024-09-17T03:41:58.772721+0000","last_undegraded":"2024-09-17T03:41:58.772721+0000","last_fullsized":"2024-09-17T03:41:58.772721+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:53.953478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791040+0000","last_change":"2024-09-17T03:41:58.788640+0000","last_active":"2024-09-17T03:41:58.791040+0000","last_peered":"2024-09-17T03:41:58.791040+0000","last_clean":"2024-09-17T03:41:58.791040+0000","last_became_active":"2024-09-17T03:41:58.788345+0000","last_became_peered":"2024-09-17T03:41:58.788345+0000","last_unstale":"2024-09-17T03:41:58.791040+0000","last_undegraded":"2024-09-17T03:41:58.791040+0000","last_fullsized":"2024-09-17T03:41:58.791040+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:45.234838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"142'6","reported_seq":19,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.801083+0000","last_change":"2024-09-17T03:41:57.782746+0000","last_active":"2024-09-17T03:41:58.801083+0000","last_peered":"2024-09-17T03:41:58.801083+0000","last_clean":"2024-09-17T03:41:58.801083+0000","last_became_active":"2024-09-17T03:41:57.782411+0000","last_became_peered":"2024-09-17T03:41:57.782411+0000","last_unstale":"2024-09-17T03:41:58.801083+0000","last_undegraded":"2024-09-17T03:41:58.801083+0000","last_fullsized":"2024-09-17T03:41:58.801083+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:17.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795355+0000","last_change":"2024-09-17T03:41:58.791701+0000","last_active":"2024-09-17T03:41:58.795355+0000","last_peered":"2024-09-17T03:41:58.795355+0000","last_clean":"2024-09-17T03:41:58.795355+0000","last_became_active":"2024-09-17T03:41:58.791387+0000","last_became_peered":"2024-09-17T03:41:58.791387+0000","last_unstale":"2024-09-17T03:41:58.795355+0000","last_undegraded":"2024-09-17T03:41:58.795355+0000","last_fullsized":"2024-09-17T03:41:58.795355+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.988090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798954+0000","last_change":"2024-09-17T03:41:57.776058+0000","last_active":"2024-09-17T03:41:58.798954+0000","last_peered":"2024-09-17T03:41:58.798954+0000","last_clean":"2024-09-17T03:41:58.798954+0000","last_became_active":"2024-09-17T03:41:57.775726+0000","last_became_peered":"2024-09-17T03:41:57.775726+0000","last_unstale":"2024-09-17T03:41:58.798954+0000","last_undegraded":"2024-09-17T03:41:58.798954+0000","last_fullsized":"2024-09-17T03:41:58.798954+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:35.559498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769712+0000","last_change":"2024-09-17T03:41:57.787376+0000","last_active":"2024-09-17T03:41:58.769712+0000","last_peered":"2024-09-17T03:41:58.769712+0000","last_clean":"2024-09-17T03:41:58.769712+0000","last_became_active":"2024-09-17T03:41:57.787036+0000","last_became_peered":"2024-09-17T03:41:57.787036+0000","last_unstale":"2024-09-17T03:41:58.769712+0000","last_undegraded":"2024-09-17T03:41:58.769712+0000","last_fullsized":"2024-09-17T03:41:58.769712+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:07.925487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.774207+0000","last_change":"2024-09-17T03:41:57.777414+0000","last_active":"2024-09-17T03:41:58.774207+0000","last_peered":"2024-09-17T03:41:58.774207+0000","last_clean":"2024-09-17T03:41:58.774207+0000","last_became_active":"2024-09-17T03:41:57.777105+0000","last_became_peered":"2024-09-17T03:41:57.777105+0000","last_unstale":"2024-09-17T03:41:58.774207+0000","last_undegraded":"2024-09-17T03:41:58.774207+0000","last_fullsized":"2024-09-17T03:41:58.774207+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:02.185593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.779969+0000","last_change":"2024-09-17T03:41:58.778450+0000","last_active":"2024-09-17T03:41:58.779969+0000","last_peered":"2024-09-17T03:41:58.779969+0000","last_clean":"2024-09-17T03:41:58.779969+0000","last_became_active":"2024-09-17T03:41:58.778161+0000","last_became_peered":"2024-09-17T03:41:58.778161+0000","last_unstale":"2024-09-17T03:41:58.779969+0000","last_undegraded":"2024-09-17T03:41:58.779969+0000","last_fullsized":"2024-09-17T03:41:58.779969+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:09.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"142'8","reported_seq":21,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800571+0000","last_change":"2024-09-17T03:41:57.781387+0000","last_active":"2024-09-17T03:41:58.800571+0000","last_peered":"2024-09-17T03:41:58.800571+0000","last_clean":"2024-09-17T03:41:58.800571+0000","last_became_active":"2024-09-17T03:41:57.781040+0000","last_became_peered":"2024-09-17T03:41:57.781040+0000","last_unstale":"2024-09-17T03:41:58.800571+0000","last_undegraded":"2024-09-17T03:41:58.800571+0000","last_fullsized":"2024-09-17T03:41:58.800571+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:01.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789125+0000","last_change":"2024-09-17T03:41:58.785556+0000","last_active":"2024-09-17T03:41:58.789125+0000","last_peered":"2024-09-17T03:41:58.789125+0000","last_clean":"2024-09-17T03:41:58.789125+0000","last_became_active":"2024-09-17T03:41:58.785245+0000","last_became_peered":"2024-09-17T03:41:58.785245+0000","last_unstale":"2024-09-17T03:41:58.789125+0000","last_undegraded":"2024-09-17T03:41:58.789125+0000","last_fullsized":"2024-09-17T03:41:58.789125+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:09.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.760811+0000","last_change":"2024-09-17T03:41:56.760811+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.760811+0000","last_undegraded":"2024-09-17T03:41:56.760811+0000","last_fullsized":"2024-09-17T03:41:56.760811+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.784457+0000","last_change":"2024-09-17T03:41:58.779968+0000","last_active":"2024-09-17T03:41:58.784457+0000","last_peered":"2024-09-17T03:41:58.784457+0000","last_clean":"2024-09-17T03:41:58.784457+0000","last_became_active":"2024-09-17T03:41:58.779689+0000","last_became_peered":"2024-09-17T03:41:58.779689+0000","last_unstale":"2024-09-17T03:41:58.784457+0000","last_undegraded":"2024-09-17T03:41:58.784457+0000","last_fullsized":"2024-09-17T03:41:58.784457+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:10.869543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.766679+0000","last_change":"2024-09-17T03:41:56.766679+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.766679+0000","last_undegraded":"2024-09-17T03:41:56.766679+0000","last_fullsized":"2024-09-17T03:41:56.766679+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793187+0000","last_change":"2024-09-17T03:41:58.790968+0000","last_active":"2024-09-17T03:41:58.793187+0000","last_peered":"2024-09-17T03:41:58.793187+0000","last_clean":"2024-09-17T03:41:58.793187+0000","last_became_active":"2024-09-17T03:41:58.790345+0000","last_became_peered":"2024-09-17T03:41:58.790345+0000","last_unstale":"2024-09-17T03:41:58.793187+0000","last_undegraded":"2024-09-17T03:41:58.793187+0000","last_fullsized":"2024-09-17T03:41:58.793187+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:50.226386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"142'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798308+0000","last_change":"2024-09-17T03:41:57.782205+0000","last_active":"2024-09-17T03:41:58.798308+0000","last_peered":"2024-09-17T03:41:58.798308+0000","last_clean":"2024-09-17T03:41:58.798308+0000","last_became_active":"2024-09-17T03:41:57.781549+0000","last_became_peered":"2024-09-17T03:41:57.781549+0000","last_unstale":"2024-09-17T03:41:58.798308+0000","last_undegraded":"2024-09-17T03:41:58.798308+0000","last_fullsized":"2024-09-17T03:41:58.798308+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:14.375766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.786243+0000","last_change":"2024-09-17T03:41:58.782158+0000","last_active":"2024-09-17T03:41:58.786243+0000","last_peered":"2024-09-17T03:41:58.786243+0000","last_clean":"2024-09-17T03:41:58.786243+0000","last_became_active":"2024-09-17T03:41:58.781872+0000","last_became_peered":"2024-09-17T03:41:58.781872+0000","last_unstale":"2024-09-17T03:41:58.786243+0000","last_undegraded":"2024-09-17T03:41:58.786243+0000","last_fullsized":"2024-09-17T03:41:58.786243+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:52.198315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.765252+0000","last_change":"2024-09-17T03:41:56.765252+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.765252+0000","last_undegraded":"2024-09-17T03:41:56.765252+0000","last_fullsized":"2024-09-17T03:41:56.765252+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794769+0000","last_change":"2024-09-17T03:41:58.788349+0000","last_active":"2024-09-17T03:41:58.794769+0000","last_peered":"2024-09-17T03:41:58.794769+0000","last_clean":"2024-09-17T03:41:58.794769+0000","last_became_active":"2024-09-17T03:41:58.788032+0000","last_became_peered":"2024-09-17T03:41:58.788032+0000","last_unstale":"2024-09-17T03:41:58.794769+0000","last_undegraded":"2024-09-17T03:41:58.794769+0000","last_fullsized":"2024-09-17T03:41:58.794769+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:38.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798397+0000","last_change":"2024-09-17T03:41:57.776487+0000","last_active":"2024-09-17T03:41:58.798397+0000","last_peered":"2024-09-17T03:41:58.798397+0000","last_clean":"2024-09-17T03:41:58.798397+0000","last_became_active":"2024-09-17T03:41:57.776096+0000","last_became_peered":"2024-09-17T03:41:57.776096+0000","last_unstale":"2024-09-17T03:41:58.798397+0000","last_undegraded":"2024-09-17T03:41:58.798397+0000","last_fullsized":"2024-09-17T03:41:58.798397+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:15.191990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798487+0000","last_change":"2024-09-17T03:41:58.797168+0000","last_active":"2024-09-17T03:41:58.798487+0000","last_peered":"2024-09-17T03:41:58.798487+0000","last_clean":"2024-09-17T03:41:58.798487+0000","last_became_active":"2024-09-17T03:41:58.796622+0000","last_became_peered":"2024-09-17T03:41:58.796622+0000","last_unstale":"2024-09-17T03:41:58.798487+0000","last_undegraded":"2024-09-17T03:41:58.798487+0000","last_fullsized":"2024-09-17T03:41:58.798487+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:12.189579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769800+0000","last_change":"2024-09-17T03:41:57.778245+0000","last_active":"2024-09-17T03:41:58.769800+0000","last_peered":"2024-09-17T03:41:58.769800+0000","last_clean":"2024-09-17T03:41:58.769800+0000","last_became_active":"2024-09-17T03:41:57.777803+0000","last_became_peered":"2024-09-17T03:41:57.777803+0000","last_unstale":"2024-09-17T03:41:58.769800+0000","last_undegraded":"2024-09-17T03:41:58.769800+0000","last_fullsized":"2024-09-17T03:41:58.769800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:05.305842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794707+0000","last_change":"2024-09-17T03:41:58.791751+0000","last_active":"2024-09-17T03:41:58.794707+0000","last_peered":"2024-09-17T03:41:58.794707+0000","last_clean":"2024-09-17T03:41:58.794707+0000","last_became_active":"2024-09-17T03:41:58.791471+0000","last_became_peered":"2024-09-17T03:41:58.791471+0000","last_unstale":"2024-09-17T03:41:58.794707+0000","last_undegraded":"2024-09-17T03:41:58.794707+0000","last_fullsized":"2024-09-17T03:41:58.794707+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:47.947416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.771095+0000","last_change":"2024-09-17T03:41:57.783936+0000","last_active":"2024-09-17T03:41:58.771095+0000","last_peered":"2024-09-17T03:41:58.771095+0000","last_clean":"2024-09-17T03:41:58.771095+0000","last_became_active":"2024-09-17T03:41:57.783328+0000","last_became_peered":"2024-09-17T03:41:57.783328+0000","last_unstale":"2024-09-17T03:41:58.771095+0000","last_undegraded":"2024-09-17T03:41:58.771095+0000","last_fullsized":"2024-09-17T03:41:58.771095+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:27.468632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798358+0000","last_change":"2024-09-17T03:41:58.796724+0000","last_active":"2024-09-17T03:41:58.798358+0000","last_peered":"2024-09-17T03:41:58.798358+0000","last_clean":"2024-09-17T03:41:58.798358+0000","last_became_active":"2024-09-17T03:41:58.796412+0000","last_became_peered":"2024-09-17T03:41:58.796412+0000","last_unstale":"2024-09-17T03:41:58.798358+0000","last_undegraded":"2024-09-17T03:41:58.798358+0000","last_fullsized":"2024-09-17T03:41:58.798358+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:27.063583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.771463+0000","last_change":"2024-09-17T03:41:57.781280+0000","last_active":"2024-09-17T03:41:58.771463+0000","last_peered":"2024-09-17T03:41:58.771463+0000","last_clean":"2024-09-17T03:41:58.771463+0000","last_became_active":"2024-09-17T03:41:57.780910+0000","last_became_peered":"2024-09-17T03:41:57.780910+0000","last_unstale":"2024-09-17T03:41:58.771463+0000","last_undegraded":"2024-09-17T03:41:58.771463+0000","last_fullsized":"2024-09-17T03:41:58.771463+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:01.006744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800372+0000","last_change":"2024-09-17T03:41:57.783360+0000","last_active":"2024-09-17T03:41:58.800372+0000","last_peered":"2024-09-17T03:41:58.800372+0000","last_clean":"2024-09-17T03:41:58.800372+0000","last_became_active":"2024-09-17T03:41:57.783016+0000","last_became_peered":"2024-09-17T03:41:57.783016+0000","last_unstale":"2024-09-17T03:41:58.800372+0000","last_undegraded":"2024-09-17T03:41:58.800372+0000","last_fullsized":"2024-09-17T03:41:58.800372+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:57.921906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.781646+0000","last_change":"2024-09-17T03:41:58.779367+0000","last_active":"2024-09-17T03:41:58.781646+0000","last_peered":"2024-09-17T03:41:58.781646+0000","last_clean":"2024-09-17T03:41:58.781646+0000","last_became_active":"2024-09-17T03:41:58.779044+0000","last_became_peered":"2024-09-17T03:41:58.779044+0000","last_unstale":"2024-09-17T03:41:58.781646+0000","last_undegraded":"2024-09-17T03:41:58.781646+0000","last_fullsized":"2024-09-17T03:41:58.781646+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:59.168673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776049+0000","last_change":"2024-09-17T03:41:57.780031+0000","last_active":"2024-09-17T03:41:58.776049+0000","last_peered":"2024-09-17T03:41:58.776049+0000","last_clean":"2024-09-17T03:41:58.776049+0000","last_became_active":"2024-09-17T03:41:57.779710+0000","last_became_peered":"2024-09-17T03:41:57.779710+0000","last_unstale":"2024-09-17T03:41:58.776049+0000","last_undegraded":"2024-09-17T03:41:58.776049+0000","last_fullsized":"2024-09-17T03:41:58.776049+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:56.392154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.777493+0000","last_change":"2024-09-17T03:41:57.782553+0000","last_active":"2024-09-17T03:41:58.777493+0000","last_peered":"2024-09-17T03:41:58.777493+0000","last_clean":"2024-09-17T03:41:58.777493+0000","last_became_active":"2024-09-17T03:41:57.782195+0000","last_became_peered":"2024-09-17T03:41:57.782195+0000","last_unstale":"2024-09-17T03:41:58.777493+0000","last_undegraded":"2024-09-17T03:41:58.777493+0000","last_fullsized":"2024-09-17T03:41:58.777493+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.986071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790757+0000","last_change":"2024-09-17T03:41:58.786028+0000","last_active":"2024-09-17T03:41:58.790757+0000","last_peered":"2024-09-17T03:41:58.790757+0000","last_clean":"2024-09-17T03:41:58.790757+0000","last_became_active":"2024-09-17T03:41:58.785761+0000","last_became_peered":"2024-09-17T03:41:58.785761+0000","last_unstale":"2024-09-17T03:41:58.790757+0000","last_undegraded":"2024-09-17T03:41:58.790757+0000","last_fullsized":"2024-09-17T03:41:58.790757+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:47.216999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776326+0000","last_change":"2024-09-17T03:41:57.782886+0000","last_active":"2024-09-17T03:41:58.776326+0000","last_peered":"2024-09-17T03:41:58.776326+0000","last_clean":"2024-09-17T03:41:58.776326+0000","last_became_active":"2024-09-17T03:41:57.782391+0000","last_became_peered":"2024-09-17T03:41:57.782391+0000","last_unstale":"2024-09-17T03:41:58.776326+0000","last_undegraded":"2024-09-17T03:41:58.776326+0000","last_fullsized":"2024-09-17T03:41:58.776326+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:13.802117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795960+0000","last_change":"2024-09-17T03:41:58.794134+0000","last_active":"2024-09-17T03:41:58.795960+0000","last_peered":"2024-09-17T03:41:58.795960+0000","last_clean":"2024-09-17T03:41:58.795960+0000","last_became_active":"2024-09-17T03:41:58.793808+0000","last_became_peered":"2024-09-17T03:41:58.793808+0000","last_unstale":"2024-09-17T03:41:58.795960+0000","last_undegraded":"2024-09-17T03:41:58.795960+0000","last_fullsized":"2024-09-17T03:41:58.795960+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:31.999015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.778574+0000","last_change":"2024-09-17T03:41:57.785169+0000","last_active":"2024-09-17T03:41:58.778574+0000","last_peered":"2024-09-17T03:41:58.778574+0000","last_clean":"2024-09-17T03:41:58.778574+0000","last_became_active":"2024-09-17T03:41:57.784823+0000","last_became_peered":"2024-09-17T03:41:57.784823+0000","last_unstale":"2024-09-17T03:41:58.778574+0000","last_undegraded":"2024-09-17T03:41:58.778574+0000","last_fullsized":"2024-09-17T03:41:58.778574+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:57.518613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.770051+0000","last_change":"2024-09-17T03:41:57.783095+0000","last_active":"2024-09-17T03:41:58.770051+0000","last_peered":"2024-09-17T03:41:58.770051+0000","last_clean":"2024-09-17T03:41:58.770051+0000","last_became_active":"2024-09-17T03:41:57.782778+0000","last_became_peered":"2024-09-17T03:41:57.782778+0000","last_unstale":"2024-09-17T03:41:58.770051+0000","last_undegraded":"2024-09-17T03:41:58.770051+0000","last_fullsized":"2024-09-17T03:41:58.770051+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:42.526729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789255+0000","last_change":"2024-09-17T03:41:58.784537+0000","last_active":"2024-09-17T03:41:58.789255+0000","last_peered":"2024-09-17T03:41:58.789255+0000","last_clean":"2024-09-17T03:41:58.789255+0000","last_became_active":"2024-09-17T03:41:58.784218+0000","last_became_peered":"2024-09-17T03:41:58.784218+0000","last_unstale":"2024-09-17T03:41:58.789255+0000","last_undegraded":"2024-09-17T03:41:58.789255+0000","last_fullsized":"2024-09-17T03:41:58.789255+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:16.246738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.770135+0000","last_change":"2024-09-17T03:41:57.776527+0000","last_active":"2024-09-17T03:41:58.770135+0000","last_peered":"2024-09-17T03:41:58.770135+0000","last_clean":"2024-09-17T03:41:58.770135+0000","last_became_active":"2024-09-17T03:41:57.776202+0000","last_became_peered":"2024-09-17T03:41:57.776202+0000","last_unstale":"2024-09-17T03:41:58.770135+0000","last_undegraded":"2024-09-17T03:41:58.770135+0000","last_fullsized":"2024-09-17T03:41:58.770135+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:53.119624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.764686+0000","last_change":"2024-09-17T03:41:56.764686+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.764686+0000","last_undegraded":"2024-09-17T03:41:56.764686+0000","last_fullsized":"2024-09-17T03:41:56.764686+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798396+0000","last_change":"2024-09-17T03:41:58.797467+0000","last_active":"2024-09-17T03:41:58.798396+0000","last_peered":"2024-09-17T03:41:58.798396+0000","last_clean":"2024-09-17T03:41:58.798396+0000","last_became_active":"2024-09-17T03:41:58.797143+0000","last_became_peered":"2024-09-17T03:41:58.797143+0000","last_unstale":"2024-09-17T03:41:58.798396+0000","last_undegraded":"2024-09-17T03:41:58.798396+0000","last_fullsized":"2024-09-17T03:41:58.798396+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:16.835504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"142'3","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798176+0000","last_change":"2024-09-17T03:41:57.777388+0000","last_active":"2024-09-17T03:41:58.798176+0000","last_peered":"2024-09-17T03:41:58.798176+0000","last_clean":"2024-09-17T03:41:58.798176+0000","last_became_active":"2024-09-17T03:41:57.777035+0000","last_became_peered":"2024-09-17T03:41:57.777035+0000","last_unstale":"2024-09-17T03:41:58.798176+0000","last_undegraded":"2024-09-17T03:41:58.798176+0000","last_fullsized":"2024-09-17T03:41:58.798176+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.381560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":333,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769029+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:41:58.769029+0000","last_peered":"2024-09-17T03:41:58.769029+0000","last_clean":"2024-09-17T03:41:58.769029+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:41:58.769029+0000","last_undegraded":"2024-09-17T03:41:58.769029+0000","last_fullsized":"2024-09-17T03:41:58.769029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51560,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320280,"statfs":{"total":96636764160,"available":96583966720,"internally_reserved":0,"allocated":2371584,"data_stored":1367342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509554,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1781760,"data_stored":776468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509554,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55132,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316708,"statfs":{"total":96636764160,"available":96580308992,"internally_reserved":0,"allocated":1769472,"data_stored":776322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":778004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55128,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316712,"statfs":{"total":96636764160,"available":96580313088,"internally_reserved":0,"allocated":1773568,"data_stored":776904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509555,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51568,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320272,"statfs":{"total":96636764160,"available":96583958528,"internally_reserved":0,"allocated":2379776,"data_stored":1368336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46772,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325068,"statfs":{"total":96636764160,"available":96588869632,"internally_reserved":0,"allocated":1732608,"data_stored":757455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50932,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320908,"statfs":{"total":96636764160,"available":96584609792,"internally_reserved":0,"allocated":1732608,"data_stored":757455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:42:03.150 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:42:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.301+0000 7f4463220640 1 -- 172.21.15.146:0/3632766672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f444c003a30 msgr2=0x7f444c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.301+0000 7f4463220640 1 --2- 172.21.15.146:0/3632766672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f444c003a30 0x7f444c003ea0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f4450009b50 tx=0x7f444c005830 comp rx=0 tx=0).stop 2024-09-17T03:42:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.301+0000 7f44617bd640 1 -- 172.21.15.146:0/3632766672 reap_dead start 2024-09-17T03:42:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.301+0000 7f4463220640 1 -- 172.21.15.146:0/3632766672 shutdown_connections 2024-09-17T03:42:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.301+0000 7f4463220640 1 -- 172.21.15.146:0/3632766672 >> 172.21.15.146:0/3632766672 conn(0x7f445c0b2060 msgr2=0x7f445c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.301+0000 7f4463220640 1 -- 172.21.15.146:0/3632766672 shutdown_connections 2024-09-17T03:42:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.301+0000 7f4463220640 1 -- 172.21.15.146:0/3632766672 wait complete. 2024-09-17T03:42:03.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.303+0000 7f4463220640 1 Processor -- start 2024-09-17T03:42:03.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.303+0000 7f4463220640 1 -- start start 2024-09-17T03:42:03.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4463220640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f444c003a30 0x7f445c14e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:03.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4463220640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f445c1f34d0 0x7f445c14db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:03.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4463220640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f445c159f80 0x7f445c15a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:03.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4463220640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0b4c00 con 0x7f444c003a30 2024-09-17T03:42:03.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4463220640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f445c0b4a80 con 0x7f445c1f34d0 2024-09-17T03:42:03.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4463220640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f445c0b4d80 con 0x7f445c159f80 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4460fbc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f444c003a30 0x7f445c14e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4460fbc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f444c003a30 0x7f445c14e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59446/0 (socket says 172.21.15.146:59446) 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4460fbc640 1 -- 172.21.15.146:0/2983118127 learned_addr learned my addr 172.21.15.146:0/2983118127 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f445bfff640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f445c1f34d0 0x7f445c14db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f44617bd640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f445c159f80 0x7f445c15a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4460fbc640 1 -- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f445c159f80 msgr2=0x7f445c15a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4460fbc640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f445c159f80 0x7f445c15a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4460fbc640 1 -- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f445c1f34d0 msgr2=0x7f445c14db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4460fbc640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f445c1f34d0 0x7f445c14db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4460fbc640 1 -- 172.21.15.146:0/2983118127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c15a8d0 con 0x7f444c003a30 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.305+0000 7f4460fbc640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f444c003a30 0x7f445c14e7e0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f4450009c70 tx=0x7f4450033b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.306+0000 7f44597fa640 1 -- 172.21.15.146:0/2983118127 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450043030 con 0x7f444c003a30 2024-09-17T03:42:03.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.306+0000 7f44597fa640 1 -- 172.21.15.146:0/2983118127 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f445002ddb0 con 0x7f444c003a30 2024-09-17T03:42:03.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.306+0000 7f4463220640 1 -- 172.21.15.146:0/2983118127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c14e060 con 0x7f444c003a30 2024-09-17T03:42:03.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.306+0000 7f44597fa640 1 -- 172.21.15.146:0/2983118127 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450038040 con 0x7f444c003a30 2024-09-17T03:42:03.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.306+0000 7f4463220640 1 -- 172.21.15.146:0/2983118127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c1f61f0 con 0x7f444c003a30 2024-09-17T03:42:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.307+0000 7f4463220640 1 -- 172.21.15.146:0/2983118127 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445c1e74a0 con 0x7f444c003a30 2024-09-17T03:42:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.307+0000 7f44597fa640 1 -- 172.21.15.146:0/2983118127 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4450046070 con 0x7f444c003a30 2024-09-17T03:42:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.308+0000 7f44597fa640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4440078b90 0x7f444007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.308+0000 7f44597fa640 1 -- 172.21.15.146:0/2983118127 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f44500bde60 con 0x7f444c003a30 2024-09-17T03:42:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.308+0000 7f445bfff640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4440078b90 0x7f444007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:03.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.309+0000 7f445bfff640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4440078b90 0x7f444007b0a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f445c151b10 tx=0x7f4448006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:03.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.312+0000 7f44597fa640 1 -- 172.21.15.146:0/2983118127 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f445004d070 con 0x7f444c003a30 2024-09-17T03:42:03.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.482+0000 7f4463220640 1 -- 172.21.15.146:0/2983118127 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f445c0b5310 con 0x7f4440078b90 2024-09-17T03:42:03.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.487+0000 7f44597fa640 1 -- 172.21.15.146:0/2983118127 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249504 (secure 0 0 0) 0x7f445c0b5310 con 0x7f4440078b90 2024-09-17T03:42:03.489 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:03.490 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:42:03.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.490+0000 7f4463220640 1 -- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4440078b90 msgr2=0x7f444007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.490+0000 7f4463220640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4440078b90 0x7f444007b0a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f445c151b10 tx=0x7f4448006bc0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.490+0000 7f4463220640 1 -- 172.21.15.146:0/2983118127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f444c003a30 msgr2=0x7f445c14e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.490+0000 7f4463220640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f444c003a30 0x7f445c14e7e0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f4450009c70 tx=0x7f4450033b30 comp rx=0 tx=0).stop 2024-09-17T03:42:03.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.490+0000 7f4463220640 1 -- 172.21.15.146:0/2983118127 shutdown_connections 2024-09-17T03:42:03.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.490+0000 7f4463220640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4440078b90 0x7f444007b0a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.490+0000 7f4463220640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f445c159f80 0x7f445c15a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.490+0000 7f4463220640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f445c1f34d0 0x7f445c14db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.490+0000 7f4463220640 1 --2- 172.21.15.146:0/2983118127 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f444c003a30 0x7f445c14e7e0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.490+0000 7f4463220640 1 -- 172.21.15.146:0/2983118127 >> 172.21.15.146:0/2983118127 conn(0x7f445c0b2060 msgr2=0x7f445c072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:03.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.490+0000 7f4463220640 1 -- 172.21.15.146:0/2983118127 shutdown_connections 2024-09-17T03:42:03.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.491+0000 7f4463220640 1 -- 172.21.15.146:0/2983118127 wait complete. 2024-09-17T03:42:03.501 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2024-09-17T03:42:01.934889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":141,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":162,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":417216,"kb_used_data":14968,"kb_used_omap":12,"kb_used_meta":402035,"kb_avail":754557504,"statfs":{"total":773094113280,"available":772666884096,"internally_reserved":0,"allocated":15327232,"data_stored":7358286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":411684401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.176865"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789673+0000","last_change":"2024-09-17T03:41:58.783510+0000","last_active":"2024-09-17T03:41:58.789673+0000","last_peered":"2024-09-17T03:41:58.789673+0000","last_clean":"2024-09-17T03:41:58.789673+0000","last_became_active":"2024-09-17T03:41:58.782625+0000","last_became_peered":"2024-09-17T03:41:58.782625+0000","last_unstale":"2024-09-17T03:41:58.789673+0000","last_undegraded":"2024-09-17T03:41:58.789673+0000","last_fullsized":"2024-09-17T03:41:58.789673+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:08.308387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.773941+0000","last_change":"2024-09-17T03:41:58.773210+0000","last_active":"2024-09-17T03:41:58.773941+0000","last_peered":"2024-09-17T03:41:58.773941+0000","last_clean":"2024-09-17T03:41:58.773941+0000","last_became_active":"2024-09-17T03:41:58.771709+0000","last_became_peered":"2024-09-17T03:41:58.771709+0000","last_unstale":"2024-09-17T03:41:58.773941+0000","last_undegraded":"2024-09-17T03:41:58.773941+0000","last_fullsized":"2024-09-17T03:41:58.773941+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:23.055342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790017+0000","last_change":"2024-09-17T03:41:58.784113+0000","last_active":"2024-09-17T03:41:58.790017+0000","last_peered":"2024-09-17T03:41:58.790017+0000","last_clean":"2024-09-17T03:41:58.790017+0000","last_became_active":"2024-09-17T03:41:58.783674+0000","last_became_peered":"2024-09-17T03:41:58.783674+0000","last_unstale":"2024-09-17T03:41:58.790017+0000","last_undegraded":"2024-09-17T03:41:58.790017+0000","last_fullsized":"2024-09-17T03:41:58.790017+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:15.404369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789718+0000","last_change":"2024-09-17T03:41:58.781216+0000","last_active":"2024-09-17T03:41:58.789718+0000","last_peered":"2024-09-17T03:41:58.789718+0000","last_clean":"2024-09-17T03:41:58.789718+0000","last_became_active":"2024-09-17T03:41:58.780931+0000","last_became_peered":"2024-09-17T03:41:58.780931+0000","last_unstale":"2024-09-17T03:41:58.789718+0000","last_undegraded":"2024-09-17T03:41:58.789718+0000","last_fullsized":"2024-09-17T03:41:58.789718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:17.947058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.797923+0000","last_change":"2024-09-17T03:41:58.795953+0000","last_active":"2024-09-17T03:41:58.797923+0000","last_peered":"2024-09-17T03:41:58.797923+0000","last_clean":"2024-09-17T03:41:58.797923+0000","last_became_active":"2024-09-17T03:41:58.795588+0000","last_became_peered":"2024-09-17T03:41:58.795588+0000","last_unstale":"2024-09-17T03:41:58.797923+0000","last_undegraded":"2024-09-17T03:41:58.797923+0000","last_fullsized":"2024-09-17T03:41:58.797923+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:03.090120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794142+0000","last_change":"2024-09-17T03:41:58.793259+0000","last_active":"2024-09-17T03:41:58.794142+0000","last_peered":"2024-09-17T03:41:58.794142+0000","last_clean":"2024-09-17T03:41:58.794142+0000","last_became_active":"2024-09-17T03:41:58.792967+0000","last_became_peered":"2024-09-17T03:41:58.792967+0000","last_unstale":"2024-09-17T03:41:58.794142+0000","last_undegraded":"2024-09-17T03:41:58.794142+0000","last_fullsized":"2024-09-17T03:41:58.794142+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:49.170549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789159+0000","last_change":"2024-09-17T03:41:58.786406+0000","last_active":"2024-09-17T03:41:58.789159+0000","last_peered":"2024-09-17T03:41:58.789159+0000","last_clean":"2024-09-17T03:41:58.789159+0000","last_became_active":"2024-09-17T03:41:58.785804+0000","last_became_peered":"2024-09-17T03:41:58.785804+0000","last_unstale":"2024-09-17T03:41:58.789159+0000","last_undegraded":"2024-09-17T03:41:58.789159+0000","last_fullsized":"2024-09-17T03:41:58.789159+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:31.346639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793904+0000","last_change":"2024-09-17T03:41:58.792926+0000","last_active":"2024-09-17T03:41:58.793904+0000","last_peered":"2024-09-17T03:41:58.793904+0000","last_clean":"2024-09-17T03:41:58.793904+0000","last_became_active":"2024-09-17T03:41:58.792624+0000","last_became_peered":"2024-09-17T03:41:58.792624+0000","last_unstale":"2024-09-17T03:41:58.793904+0000","last_undegraded":"2024-09-17T03:41:58.793904+0000","last_fullsized":"2024-09-17T03:41:58.793904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:28.867944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789347+0000","last_change":"2024-09-17T03:41:58.787698+0000","last_active":"2024-09-17T03:41:58.789347+0000","last_peered":"2024-09-17T03:41:58.789347+0000","last_clean":"2024-09-17T03:41:58.789347+0000","last_became_active":"2024-09-17T03:41:58.787391+0000","last_became_peered":"2024-09-17T03:41:58.787391+0000","last_unstale":"2024-09-17T03:41:58.789347+0000","last_undegraded":"2024-09-17T03:41:58.789347+0000","last_fullsized":"2024-09-17T03:41:58.789347+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:16.851435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.796383+0000","last_change":"2024-09-17T03:41:58.792904+0000","last_active":"2024-09-17T03:41:58.796383+0000","last_peered":"2024-09-17T03:41:58.796383+0000","last_clean":"2024-09-17T03:41:58.796383+0000","last_became_active":"2024-09-17T03:41:58.792587+0000","last_became_peered":"2024-09-17T03:41:58.792587+0000","last_unstale":"2024-09-17T03:41:58.796383+0000","last_undegraded":"2024-09-17T03:41:58.796383+0000","last_fullsized":"2024-09-17T03:41:58.796383+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:35.853662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.780484+0000","last_change":"2024-09-17T03:41:58.778325+0000","last_active":"2024-09-17T03:41:58.780484+0000","last_peered":"2024-09-17T03:41:58.780484+0000","last_clean":"2024-09-17T03:41:58.780484+0000","last_became_active":"2024-09-17T03:41:58.778010+0000","last_became_peered":"2024-09-17T03:41:58.778010+0000","last_unstale":"2024-09-17T03:41:58.780484+0000","last_undegraded":"2024-09-17T03:41:58.780484+0000","last_fullsized":"2024-09-17T03:41:58.780484+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:31.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791571+0000","last_change":"2024-09-17T03:41:58.784054+0000","last_active":"2024-09-17T03:41:58.791571+0000","last_peered":"2024-09-17T03:41:58.791571+0000","last_clean":"2024-09-17T03:41:58.791571+0000","last_became_active":"2024-09-17T03:41:58.783751+0000","last_became_peered":"2024-09-17T03:41:58.783751+0000","last_unstale":"2024-09-17T03:41:58.791571+0000","last_undegraded":"2024-09-17T03:41:58.791571+0000","last_fullsized":"2024-09-17T03:41:58.791571+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:49.444227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795743+0000","last_change":"2024-09-17T03:41:58.791309+0000","last_active":"2024-09-17T03:41:58.795743+0000","last_peered":"2024-09-17T03:41:58.795743+0000","last_clean":"2024-09-17T03:41:58.795743+0000","last_became_active":"2024-09-17T03:41:58.791005+0000","last_became_peered":"2024-09-17T03:41:58.791005+0000","last_unstale":"2024-09-17T03:41:58.795743+0000","last_undegraded":"2024-09-17T03:41:58.795743+0000","last_fullsized":"2024-09-17T03:41:58.795743+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:44.620003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.773928+0000","last_change":"2024-09-17T03:41:58.772834+0000","last_active":"2024-09-17T03:41:58.773928+0000","last_peered":"2024-09-17T03:41:58.773928+0000","last_clean":"2024-09-17T03:41:58.773928+0000","last_became_active":"2024-09-17T03:41:58.772503+0000","last_became_peered":"2024-09-17T03:41:58.772503+0000","last_unstale":"2024-09-17T03:41:58.773928+0000","last_undegraded":"2024-09-17T03:41:58.773928+0000","last_fullsized":"2024-09-17T03:41:58.773928+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:05.742202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790728+0000","last_change":"2024-09-17T03:41:58.785329+0000","last_active":"2024-09-17T03:41:58.790728+0000","last_peered":"2024-09-17T03:41:58.790728+0000","last_clean":"2024-09-17T03:41:58.790728+0000","last_became_active":"2024-09-17T03:41:58.785017+0000","last_became_peered":"2024-09-17T03:41:58.785017+0000","last_unstale":"2024-09-17T03:41:58.790728+0000","last_undegraded":"2024-09-17T03:41:58.790728+0000","last_fullsized":"2024-09-17T03:41:58.790728+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:10.635488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790132+0000","last_change":"2024-09-17T03:41:58.782096+0000","last_active":"2024-09-17T03:41:58.790132+0000","last_peered":"2024-09-17T03:41:58.790132+0000","last_clean":"2024-09-17T03:41:58.790132+0000","last_became_active":"2024-09-17T03:41:58.781798+0000","last_became_peered":"2024-09-17T03:41:58.781798+0000","last_unstale":"2024-09-17T03:41:58.790132+0000","last_undegraded":"2024-09-17T03:41:58.790132+0000","last_fullsized":"2024-09-17T03:41:58.790132+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:24.167278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789200+0000","last_change":"2024-09-17T03:41:58.787064+0000","last_active":"2024-09-17T03:41:58.789200+0000","last_peered":"2024-09-17T03:41:58.789200+0000","last_clean":"2024-09-17T03:41:58.789200+0000","last_became_active":"2024-09-17T03:41:58.786212+0000","last_became_peered":"2024-09-17T03:41:58.786212+0000","last_unstale":"2024-09-17T03:41:58.789200+0000","last_undegraded":"2024-09-17T03:41:58.789200+0000","last_fullsized":"2024-09-17T03:41:58.789200+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:01.139228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789870+0000","last_change":"2024-09-17T03:41:58.785048+0000","last_active":"2024-09-17T03:41:58.789870+0000","last_peered":"2024-09-17T03:41:58.789870+0000","last_clean":"2024-09-17T03:41:58.789870+0000","last_became_active":"2024-09-17T03:41:58.784435+0000","last_became_peered":"2024-09-17T03:41:58.784435+0000","last_unstale":"2024-09-17T03:41:58.789870+0000","last_undegraded":"2024-09-17T03:41:58.789870+0000","last_fullsized":"2024-09-17T03:41:58.789870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:46.290406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794684+0000","last_change":"2024-09-17T03:41:58.791265+0000","last_active":"2024-09-17T03:41:58.794684+0000","last_peered":"2024-09-17T03:41:58.794684+0000","last_clean":"2024-09-17T03:41:58.794684+0000","last_became_active":"2024-09-17T03:41:58.790981+0000","last_became_peered":"2024-09-17T03:41:58.790981+0000","last_unstale":"2024-09-17T03:41:58.794684+0000","last_undegraded":"2024-09-17T03:41:58.794684+0000","last_fullsized":"2024-09-17T03:41:58.794684+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:03.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789286+0000","last_change":"2024-09-17T03:41:58.786007+0000","last_active":"2024-09-17T03:41:58.789286+0000","last_peered":"2024-09-17T03:41:58.789286+0000","last_clean":"2024-09-17T03:41:58.789286+0000","last_became_active":"2024-09-17T03:41:58.785642+0000","last_became_peered":"2024-09-17T03:41:58.785642+0000","last_unstale":"2024-09-17T03:41:58.789286+0000","last_undegraded":"2024-09-17T03:41:58.789286+0000","last_fullsized":"2024-09-17T03:41:58.789286+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:45.260732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791077+0000","last_change":"2024-09-17T03:41:58.784174+0000","last_active":"2024-09-17T03:41:58.791077+0000","last_peered":"2024-09-17T03:41:58.791077+0000","last_clean":"2024-09-17T03:41:58.791077+0000","last_became_active":"2024-09-17T03:41:58.783889+0000","last_became_peered":"2024-09-17T03:41:58.783889+0000","last_unstale":"2024-09-17T03:41:58.791077+0000","last_undegraded":"2024-09-17T03:41:58.791077+0000","last_fullsized":"2024-09-17T03:41:58.791077+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:49.912037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793352+0000","last_change":"2024-09-17T03:41:58.790506+0000","last_active":"2024-09-17T03:41:58.793352+0000","last_peered":"2024-09-17T03:41:58.793352+0000","last_clean":"2024-09-17T03:41:58.793352+0000","last_became_active":"2024-09-17T03:41:58.790198+0000","last_became_peered":"2024-09-17T03:41:58.790198+0000","last_unstale":"2024-09-17T03:41:58.793352+0000","last_undegraded":"2024-09-17T03:41:58.793352+0000","last_fullsized":"2024-09-17T03:41:58.793352+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:44.163526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791013+0000","last_change":"2024-09-17T03:41:58.783272+0000","last_active":"2024-09-17T03:41:58.791013+0000","last_peered":"2024-09-17T03:41:58.791013+0000","last_clean":"2024-09-17T03:41:58.791013+0000","last_became_active":"2024-09-17T03:41:58.782949+0000","last_became_peered":"2024-09-17T03:41:58.782949+0000","last_unstale":"2024-09-17T03:41:58.791013+0000","last_undegraded":"2024-09-17T03:41:58.791013+0000","last_fullsized":"2024-09-17T03:41:58.791013+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:33.398364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789500+0000","last_change":"2024-09-17T03:41:58.786551+0000","last_active":"2024-09-17T03:41:58.789500+0000","last_peered":"2024-09-17T03:41:58.789500+0000","last_clean":"2024-09-17T03:41:58.789500+0000","last_became_active":"2024-09-17T03:41:58.786235+0000","last_became_peered":"2024-09-17T03:41:58.786235+0000","last_unstale":"2024-09-17T03:41:58.789500+0000","last_undegraded":"2024-09-17T03:41:58.789500+0000","last_fullsized":"2024-09-17T03:41:58.789500+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:55.612023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.782762+0000","last_change":"2024-09-17T03:41:58.781120+0000","last_active":"2024-09-17T03:41:58.782762+0000","last_peered":"2024-09-17T03:41:58.782762+0000","last_clean":"2024-09-17T03:41:58.782762+0000","last_became_active":"2024-09-17T03:41:58.780819+0000","last_became_peered":"2024-09-17T03:41:58.780819+0000","last_unstale":"2024-09-17T03:41:58.782762+0000","last_undegraded":"2024-09-17T03:41:58.782762+0000","last_fullsized":"2024-09-17T03:41:58.782762+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:50.827807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789904+0000","last_change":"2024-09-17T03:41:58.786598+0000","last_active":"2024-09-17T03:41:58.789904+0000","last_peered":"2024-09-17T03:41:58.789904+0000","last_clean":"2024-09-17T03:41:58.789904+0000","last_became_active":"2024-09-17T03:41:58.786273+0000","last_became_peered":"2024-09-17T03:41:58.786273+0000","last_unstale":"2024-09-17T03:41:58.789904+0000","last_undegraded":"2024-09-17T03:41:58.789904+0000","last_fullsized":"2024-09-17T03:41:58.789904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:39.675219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791599+0000","last_change":"2024-09-17T03:41:58.788709+0000","last_active":"2024-09-17T03:41:58.791599+0000","last_peered":"2024-09-17T03:41:58.791599+0000","last_clean":"2024-09-17T03:41:58.791599+0000","last_became_active":"2024-09-17T03:41:58.788401+0000","last_became_peered":"2024-09-17T03:41:58.788401+0000","last_unstale":"2024-09-17T03:41:58.791599+0000","last_undegraded":"2024-09-17T03:41:58.791599+0000","last_fullsized":"2024-09-17T03:41:58.791599+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:54.187280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794133+0000","last_change":"2024-09-17T03:41:58.792053+0000","last_active":"2024-09-17T03:41:58.794133+0000","last_peered":"2024-09-17T03:41:58.794133+0000","last_clean":"2024-09-17T03:41:58.794133+0000","last_became_active":"2024-09-17T03:41:58.791734+0000","last_became_peered":"2024-09-17T03:41:58.791734+0000","last_unstale":"2024-09-17T03:41:58.794133+0000","last_undegraded":"2024-09-17T03:41:58.794133+0000","last_fullsized":"2024-09-17T03:41:58.794133+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:34.904922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"142'4","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800933+0000","last_change":"2024-09-17T03:41:57.783265+0000","last_active":"2024-09-17T03:41:58.800933+0000","last_peered":"2024-09-17T03:41:58.800933+0000","last_clean":"2024-09-17T03:41:58.800933+0000","last_became_active":"2024-09-17T03:41:57.782950+0000","last_became_peered":"2024-09-17T03:41:57.782950+0000","last_unstale":"2024-09-17T03:41:58.800933+0000","last_undegraded":"2024-09-17T03:41:58.800933+0000","last_fullsized":"2024-09-17T03:41:58.800933+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.767175+0000","last_change":"2024-09-17T03:41:56.767175+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.767175+0000","last_undegraded":"2024-09-17T03:41:56.767175+0000","last_fullsized":"2024-09-17T03:41:56.767175+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791207+0000","last_change":"2024-09-17T03:41:58.788338+0000","last_active":"2024-09-17T03:41:58.791207+0000","last_peered":"2024-09-17T03:41:58.791207+0000","last_clean":"2024-09-17T03:41:58.791207+0000","last_became_active":"2024-09-17T03:41:58.788052+0000","last_became_peered":"2024-09-17T03:41:58.788052+0000","last_unstale":"2024-09-17T03:41:58.791207+0000","last_undegraded":"2024-09-17T03:41:58.791207+0000","last_fullsized":"2024-09-17T03:41:58.791207+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:33.314758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799041+0000","last_change":"2024-09-17T03:41:57.786673+0000","last_active":"2024-09-17T03:41:58.799041+0000","last_peered":"2024-09-17T03:41:58.799041+0000","last_clean":"2024-09-17T03:41:58.799041+0000","last_became_active":"2024-09-17T03:41:57.786359+0000","last_became_peered":"2024-09-17T03:41:57.786359+0000","last_unstale":"2024-09-17T03:41:58.799041+0000","last_undegraded":"2024-09-17T03:41:58.799041+0000","last_fullsized":"2024-09-17T03:41:58.799041+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:36.067718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789415+0000","last_change":"2024-09-17T03:41:58.787967+0000","last_active":"2024-09-17T03:41:58.789415+0000","last_peered":"2024-09-17T03:41:58.789415+0000","last_clean":"2024-09-17T03:41:58.789415+0000","last_became_active":"2024-09-17T03:41:58.787652+0000","last_became_peered":"2024-09-17T03:41:58.787652+0000","last_unstale":"2024-09-17T03:41:58.789415+0000","last_undegraded":"2024-09-17T03:41:58.789415+0000","last_fullsized":"2024-09-17T03:41:58.789415+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:18.330621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799781+0000","last_change":"2024-09-17T03:41:57.786812+0000","last_active":"2024-09-17T03:41:58.799781+0000","last_peered":"2024-09-17T03:41:58.799781+0000","last_clean":"2024-09-17T03:41:58.799781+0000","last_became_active":"2024-09-17T03:41:57.786434+0000","last_became_peered":"2024-09-17T03:41:57.786434+0000","last_unstale":"2024-09-17T03:41:58.799781+0000","last_undegraded":"2024-09-17T03:41:58.799781+0000","last_fullsized":"2024-09-17T03:41:58.799781+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.381560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"142'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798526+0000","last_change":"2024-09-17T03:41:57.782388+0000","last_active":"2024-09-17T03:41:58.798526+0000","last_peered":"2024-09-17T03:41:58.798526+0000","last_clean":"2024-09-17T03:41:58.798526+0000","last_became_active":"2024-09-17T03:41:57.782057+0000","last_became_peered":"2024-09-17T03:41:57.782057+0000","last_unstale":"2024-09-17T03:41:58.798526+0000","last_undegraded":"2024-09-17T03:41:58.798526+0000","last_fullsized":"2024-09-17T03:41:58.798526+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:47.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790997+0000","last_change":"2024-09-17T03:41:58.782536+0000","last_active":"2024-09-17T03:41:58.790997+0000","last_peered":"2024-09-17T03:41:58.790997+0000","last_clean":"2024-09-17T03:41:58.790997+0000","last_became_active":"2024-09-17T03:41:58.782153+0000","last_became_peered":"2024-09-17T03:41:58.782153+0000","last_unstale":"2024-09-17T03:41:58.790997+0000","last_undegraded":"2024-09-17T03:41:58.790997+0000","last_fullsized":"2024-09-17T03:41:58.790997+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:02.865504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.760063+0000","last_change":"2024-09-17T03:41:56.760063+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.760063+0000","last_undegraded":"2024-09-17T03:41:56.760063+0000","last_fullsized":"2024-09-17T03:41:56.760063+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.777449+0000","last_change":"2024-09-17T03:41:57.787289+0000","last_active":"2024-09-17T03:41:58.777449+0000","last_peered":"2024-09-17T03:41:58.777449+0000","last_clean":"2024-09-17T03:41:58.777449+0000","last_became_active":"2024-09-17T03:41:57.786949+0000","last_became_peered":"2024-09-17T03:41:57.786949+0000","last_unstale":"2024-09-17T03:41:58.777449+0000","last_undegraded":"2024-09-17T03:41:58.777449+0000","last_fullsized":"2024-09-17T03:41:58.777449+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:11.729127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776783+0000","last_change":"2024-09-17T03:41:57.788010+0000","last_active":"2024-09-17T03:41:58.776783+0000","last_peered":"2024-09-17T03:41:58.776783+0000","last_clean":"2024-09-17T03:41:58.776783+0000","last_became_active":"2024-09-17T03:41:57.787639+0000","last_became_peered":"2024-09-17T03:41:57.787639+0000","last_unstale":"2024-09-17T03:41:58.776783+0000","last_undegraded":"2024-09-17T03:41:58.776783+0000","last_fullsized":"2024-09-17T03:41:58.776783+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:53.119624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.764747+0000","last_change":"2024-09-17T03:41:56.764747+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.764747+0000","last_undegraded":"2024-09-17T03:41:56.764747+0000","last_fullsized":"2024-09-17T03:41:56.764747+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799815+0000","last_change":"2024-09-17T03:41:58.795904+0000","last_active":"2024-09-17T03:41:58.799815+0000","last_peered":"2024-09-17T03:41:58.799815+0000","last_clean":"2024-09-17T03:41:58.799815+0000","last_became_active":"2024-09-17T03:41:58.795526+0000","last_became_peered":"2024-09-17T03:41:58.795526+0000","last_unstale":"2024-09-17T03:41:58.799815+0000","last_undegraded":"2024-09-17T03:41:58.799815+0000","last_fullsized":"2024-09-17T03:41:58.799815+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:46.917885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.772721+0000","last_change":"2024-09-17T03:41:57.784269+0000","last_active":"2024-09-17T03:41:58.772721+0000","last_peered":"2024-09-17T03:41:58.772721+0000","last_clean":"2024-09-17T03:41:58.772721+0000","last_became_active":"2024-09-17T03:41:57.783959+0000","last_became_peered":"2024-09-17T03:41:57.783959+0000","last_unstale":"2024-09-17T03:41:58.772721+0000","last_undegraded":"2024-09-17T03:41:58.772721+0000","last_fullsized":"2024-09-17T03:41:58.772721+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:53.953478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791040+0000","last_change":"2024-09-17T03:41:58.788640+0000","last_active":"2024-09-17T03:41:58.791040+0000","last_peered":"2024-09-17T03:41:58.791040+0000","last_clean":"2024-09-17T03:41:58.791040+0000","last_became_active":"2024-09-17T03:41:58.788345+0000","last_became_peered":"2024-09-17T03:41:58.788345+0000","last_unstale":"2024-09-17T03:41:58.791040+0000","last_undegraded":"2024-09-17T03:41:58.791040+0000","last_fullsized":"2024-09-17T03:41:58.791040+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:45.234838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"142'6","reported_seq":19,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.801083+0000","last_change":"2024-09-17T03:41:57.782746+0000","last_active":"2024-09-17T03:41:58.801083+0000","last_peered":"2024-09-17T03:41:58.801083+0000","last_clean":"2024-09-17T03:41:58.801083+0000","last_became_active":"2024-09-17T03:41:57.782411+0000","last_became_peered":"2024-09-17T03:41:57.782411+0000","last_unstale":"2024-09-17T03:41:58.801083+0000","last_undegraded":"2024-09-17T03:41:58.801083+0000","last_fullsized":"2024-09-17T03:41:58.801083+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:17.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795355+0000","last_change":"2024-09-17T03:41:58.791701+0000","last_active":"2024-09-17T03:41:58.795355+0000","last_peered":"2024-09-17T03:41:58.795355+0000","last_clean":"2024-09-17T03:41:58.795355+0000","last_became_active":"2024-09-17T03:41:58.791387+0000","last_became_peered":"2024-09-17T03:41:58.791387+0000","last_unstale":"2024-09-17T03:41:58.795355+0000","last_undegraded":"2024-09-17T03:41:58.795355+0000","last_fullsized":"2024-09-17T03:41:58.795355+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.988090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798954+0000","last_change":"2024-09-17T03:41:57.776058+0000","last_active":"2024-09-17T03:41:58.798954+0000","last_peered":"2024-09-17T03:41:58.798954+0000","last_clean":"2024-09-17T03:41:58.798954+0000","last_became_active":"2024-09-17T03:41:57.775726+0000","last_became_peered":"2024-09-17T03:41:57.775726+0000","last_unstale":"2024-09-17T03:41:58.798954+0000","last_undegraded":"2024-09-17T03:41:58.798954+0000","last_fullsized":"2024-09-17T03:41:58.798954+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:35.559498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769712+0000","last_change":"2024-09-17T03:41:57.787376+0000","last_active":"2024-09-17T03:41:58.769712+0000","last_peered":"2024-09-17T03:41:58.769712+0000","last_clean":"2024-09-17T03:41:58.769712+0000","last_became_active":"2024-09-17T03:41:57.787036+0000","last_became_peered":"2024-09-17T03:41:57.787036+0000","last_unstale":"2024-09-17T03:41:58.769712+0000","last_undegraded":"2024-09-17T03:41:58.769712+0000","last_fullsized":"2024-09-17T03:41:58.769712+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:07.925487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.774207+0000","last_change":"2024-09-17T03:41:57.777414+0000","last_active":"2024-09-17T03:41:58.774207+0000","last_peered":"2024-09-17T03:41:58.774207+0000","last_clean":"2024-09-17T03:41:58.774207+0000","last_became_active":"2024-09-17T03:41:57.777105+0000","last_became_peered":"2024-09-17T03:41:57.777105+0000","last_unstale":"2024-09-17T03:41:58.774207+0000","last_undegraded":"2024-09-17T03:41:58.774207+0000","last_fullsized":"2024-09-17T03:41:58.774207+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:02.185593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.779969+0000","last_change":"2024-09-17T03:41:58.778450+0000","last_active":"2024-09-17T03:41:58.779969+0000","last_peered":"2024-09-17T03:41:58.779969+0000","last_clean":"2024-09-17T03:41:58.779969+0000","last_became_active":"2024-09-17T03:41:58.778161+0000","last_became_peered":"2024-09-17T03:41:58.778161+0000","last_unstale":"2024-09-17T03:41:58.779969+0000","last_undegraded":"2024-09-17T03:41:58.779969+0000","last_fullsized":"2024-09-17T03:41:58.779969+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:09.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"142'8","reported_seq":21,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800571+0000","last_change":"2024-09-17T03:41:57.781387+0000","last_active":"2024-09-17T03:41:58.800571+0000","last_peered":"2024-09-17T03:41:58.800571+0000","last_clean":"2024-09-17T03:41:58.800571+0000","last_became_active":"2024-09-17T03:41:57.781040+0000","last_became_peered":"2024-09-17T03:41:57.781040+0000","last_unstale":"2024-09-17T03:41:58.800571+0000","last_undegraded":"2024-09-17T03:41:58.800571+0000","last_fullsized":"2024-09-17T03:41:58.800571+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:01.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789125+0000","last_change":"2024-09-17T03:41:58.785556+0000","last_active":"2024-09-17T03:41:58.789125+0000","last_peered":"2024-09-17T03:41:58.789125+0000","last_clean":"2024-09-17T03:41:58.789125+0000","last_became_active":"2024-09-17T03:41:58.785245+0000","last_became_peered":"2024-09-17T03:41:58.785245+0000","last_unstale":"2024-09-17T03:41:58.789125+0000","last_undegraded":"2024-09-17T03:41:58.789125+0000","last_fullsized":"2024-09-17T03:41:58.789125+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:09.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.760811+0000","last_change":"2024-09-17T03:41:56.760811+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.760811+0000","last_undegraded":"2024-09-17T03:41:56.760811+0000","last_fullsized":"2024-09-17T03:41:56.760811+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.784457+0000","last_change":"2024-09-17T03:41:58.779968+0000","last_active":"2024-09-17T03:41:58.784457+0000","last_peered":"2024-09-17T03:41:58.784457+0000","last_clean":"2024-09-17T03:41:58.784457+0000","last_became_active":"2024-09-17T03:41:58.779689+0000","last_became_peered":"2024-09-17T03:41:58.779689+0000","last_unstale":"2024-09-17T03:41:58.784457+0000","last_undegraded":"2024-09-17T03:41:58.784457+0000","last_fullsized":"2024-09-17T03:41:58.784457+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:10.869543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.766679+0000","last_change":"2024-09-17T03:41:56.766679+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.766679+0000","last_undegraded":"2024-09-17T03:41:56.766679+0000","last_fullsized":"2024-09-17T03:41:56.766679+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793187+0000","last_change":"2024-09-17T03:41:58.790968+0000","last_active":"2024-09-17T03:41:58.793187+0000","last_peered":"2024-09-17T03:41:58.793187+0000","last_clean":"2024-09-17T03:41:58.793187+0000","last_became_active":"2024-09-17T03:41:58.790345+0000","last_became_peered":"2024-09-17T03:41:58.790345+0000","last_unstale":"2024-09-17T03:41:58.793187+0000","last_undegraded":"2024-09-17T03:41:58.793187+0000","last_fullsized":"2024-09-17T03:41:58.793187+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:50.226386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"142'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798308+0000","last_change":"2024-09-17T03:41:57.782205+0000","last_active":"2024-09-17T03:41:58.798308+0000","last_peered":"2024-09-17T03:41:58.798308+0000","last_clean":"2024-09-17T03:41:58.798308+0000","last_became_active":"2024-09-17T03:41:57.781549+0000","last_became_peered":"2024-09-17T03:41:57.781549+0000","last_unstale":"2024-09-17T03:41:58.798308+0000","last_undegraded":"2024-09-17T03:41:58.798308+0000","last_fullsized":"2024-09-17T03:41:58.798308+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:14.375766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.786243+0000","last_change":"2024-09-17T03:41:58.782158+0000","last_active":"2024-09-17T03:41:58.786243+0000","last_peered":"2024-09-17T03:41:58.786243+0000","last_clean":"2024-09-17T03:41:58.786243+0000","last_became_active":"2024-09-17T03:41:58.781872+0000","last_became_peered":"2024-09-17T03:41:58.781872+0000","last_unstale":"2024-09-17T03:41:58.786243+0000","last_undegraded":"2024-09-17T03:41:58.786243+0000","last_fullsized":"2024-09-17T03:41:58.786243+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:52.198315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.765252+0000","last_change":"2024-09-17T03:41:56.765252+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.765252+0000","last_undegraded":"2024-09-17T03:41:56.765252+0000","last_fullsized":"2024-09-17T03:41:56.765252+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794769+0000","last_change":"2024-09-17T03:41:58.788349+0000","last_active":"2024-09-17T03:41:58.794769+0000","last_peered":"2024-09-17T03:41:58.794769+0000","last_clean":"2024-09-17T03:41:58.794769+0000","last_became_active":"2024-09-17T03:41:58.788032+0000","last_became_peered":"2024-09-17T03:41:58.788032+0000","last_unstale":"2024-09-17T03:41:58.794769+0000","last_undegraded":"2024-09-17T03:41:58.794769+0000","last_fullsized":"2024-09-17T03:41:58.794769+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:38.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798397+0000","last_change":"2024-09-17T03:41:57.776487+0000","last_active":"2024-09-17T03:41:58.798397+0000","last_peered":"2024-09-17T03:41:58.798397+0000","last_clean":"2024-09-17T03:41:58.798397+0000","last_became_active":"2024-09-17T03:41:57.776096+0000","last_became_peered":"2024-09-17T03:41:57.776096+0000","last_unstale":"2024-09-17T03:41:58.798397+0000","last_undegraded":"2024-09-17T03:41:58.798397+0000","last_fullsized":"2024-09-17T03:41:58.798397+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:15.191990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798487+0000","last_change":"2024-09-17T03:41:58.797168+0000","last_active":"2024-09-17T03:41:58.798487+0000","last_peered":"2024-09-17T03:41:58.798487+0000","last_clean":"2024-09-17T03:41:58.798487+0000","last_became_active":"2024-09-17T03:41:58.796622+0000","last_became_peered":"2024-09-17T03:41:58.796622+0000","last_unstale":"2024-09-17T03:41:58.798487+0000","last_undegraded":"2024-09-17T03:41:58.798487+0000","last_fullsized":"2024-09-17T03:41:58.798487+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:12.189579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769800+0000","last_change":"2024-09-17T03:41:57.778245+0000","last_active":"2024-09-17T03:41:58.769800+0000","last_peered":"2024-09-17T03:41:58.769800+0000","last_clean":"2024-09-17T03:41:58.769800+0000","last_became_active":"2024-09-17T03:41:57.777803+0000","last_became_peered":"2024-09-17T03:41:57.777803+0000","last_unstale":"2024-09-17T03:41:58.769800+0000","last_undegraded":"2024-09-17T03:41:58.769800+0000","last_fullsized":"2024-09-17T03:41:58.769800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:05.305842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794707+0000","last_change":"2024-09-17T03:41:58.791751+0000","last_active":"2024-09-17T03:41:58.794707+0000","last_peered":"2024-09-17T03:41:58.794707+0000","last_clean":"2024-09-17T03:41:58.794707+0000","last_became_active":"2024-09-17T03:41:58.791471+0000","last_became_peered":"2024-09-17T03:41:58.791471+0000","last_unstale":"2024-09-17T03:41:58.794707+0000","last_undegraded":"2024-09-17T03:41:58.794707+0000","last_fullsized":"2024-09-17T03:41:58.794707+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:47.947416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.771095+0000","last_change":"2024-09-17T03:41:57.783936+0000","last_active":"2024-09-17T03:41:58.771095+0000","last_peered":"2024-09-17T03:41:58.771095+0000","last_clean":"2024-09-17T03:41:58.771095+0000","last_became_active":"2024-09-17T03:41:57.783328+0000","last_became_peered":"2024-09-17T03:41:57.783328+0000","last_unstale":"2024-09-17T03:41:58.771095+0000","last_undegraded":"2024-09-17T03:41:58.771095+0000","last_fullsized":"2024-09-17T03:41:58.771095+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:27.468632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798358+0000","last_change":"2024-09-17T03:41:58.796724+0000","last_active":"2024-09-17T03:41:58.798358+0000","last_peered":"2024-09-17T03:41:58.798358+0000","last_clean":"2024-09-17T03:41:58.798358+0000","last_became_active":"2024-09-17T03:41:58.796412+0000","last_became_peered":"2024-09-17T03:41:58.796412+0000","last_unstale":"2024-09-17T03:41:58.798358+0000","last_undegraded":"2024-09-17T03:41:58.798358+0000","last_fullsized":"2024-09-17T03:41:58.798358+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:27.063583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.771463+0000","last_change":"2024-09-17T03:41:57.781280+0000","last_active":"2024-09-17T03:41:58.771463+0000","last_peered":"2024-09-17T03:41:58.771463+0000","last_clean":"2024-09-17T03:41:58.771463+0000","last_became_active":"2024-09-17T03:41:57.780910+0000","last_became_peered":"2024-09-17T03:41:57.780910+0000","last_unstale":"2024-09-17T03:41:58.771463+0000","last_undegraded":"2024-09-17T03:41:58.771463+0000","last_fullsized":"2024-09-17T03:41:58.771463+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:01.006744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800372+0000","last_change":"2024-09-17T03:41:57.783360+0000","last_active":"2024-09-17T03:41:58.800372+0000","last_peered":"2024-09-17T03:41:58.800372+0000","last_clean":"2024-09-17T03:41:58.800372+0000","last_became_active":"2024-09-17T03:41:57.783016+0000","last_became_peered":"2024-09-17T03:41:57.783016+0000","last_unstale":"2024-09-17T03:41:58.800372+0000","last_undegraded":"2024-09-17T03:41:58.800372+0000","last_fullsized":"2024-09-17T03:41:58.800372+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:57.921906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.781646+0000","last_change":"2024-09-17T03:41:58.779367+0000","last_active":"2024-09-17T03:41:58.781646+0000","last_peered":"2024-09-17T03:41:58.781646+0000","last_clean":"2024-09-17T03:41:58.781646+0000","last_became_active":"2024-09-17T03:41:58.779044+0000","last_became_peered":"2024-09-17T03:41:58.779044+0000","last_unstale":"2024-09-17T03:41:58.781646+0000","last_undegraded":"2024-09-17T03:41:58.781646+0000","last_fullsized":"2024-09-17T03:41:58.781646+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:59.168673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776049+0000","last_change":"2024-09-17T03:41:57.780031+0000","last_active":"2024-09-17T03:41:58.776049+0000","last_peered":"2024-09-17T03:41:58.776049+0000","last_clean":"2024-09-17T03:41:58.776049+0000","last_became_active":"2024-09-17T03:41:57.779710+0000","last_became_peered":"2024-09-17T03:41:57.779710+0000","last_unstale":"2024-09-17T03:41:58.776049+0000","last_undegraded":"2024-09-17T03:41:58.776049+0000","last_fullsized":"2024-09-17T03:41:58.776049+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:56.392154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.777493+0000","last_change":"2024-09-17T03:41:57.782553+0000","last_active":"2024-09-17T03:41:58.777493+0000","last_peered":"2024-09-17T03:41:58.777493+0000","last_clean":"2024-09-17T03:41:58.777493+0000","last_became_active":"2024-09-17T03:41:57.782195+0000","last_became_peered":"2024-09-17T03:41:57.782195+0000","last_unstale":"2024-09-17T03:41:58.777493+0000","last_undegraded":"2024-09-17T03:41:58.777493+0000","last_fullsized":"2024-09-17T03:41:58.777493+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.986071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790757+0000","last_change":"2024-09-17T03:41:58.786028+0000","last_active":"2024-09-17T03:41:58.790757+0000","last_peered":"2024-09-17T03:41:58.790757+0000","last_clean":"2024-09-17T03:41:58.790757+0000","last_became_active":"2024-09-17T03:41:58.785761+0000","last_became_peered":"2024-09-17T03:41:58.785761+0000","last_unstale":"2024-09-17T03:41:58.790757+0000","last_undegraded":"2024-09-17T03:41:58.790757+0000","last_fullsized":"2024-09-17T03:41:58.790757+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:47.216999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776326+0000","last_change":"2024-09-17T03:41:57.782886+0000","last_active":"2024-09-17T03:41:58.776326+0000","last_peered":"2024-09-17T03:41:58.776326+0000","last_clean":"2024-09-17T03:41:58.776326+0000","last_became_active":"2024-09-17T03:41:57.782391+0000","last_became_peered":"2024-09-17T03:41:57.782391+0000","last_unstale":"2024-09-17T03:41:58.776326+0000","last_undegraded":"2024-09-17T03:41:58.776326+0000","last_fullsized":"2024-09-17T03:41:58.776326+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:13.802117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795960+0000","last_change":"2024-09-17T03:41:58.794134+0000","last_active":"2024-09-17T03:41:58.795960+0000","last_peered":"2024-09-17T03:41:58.795960+0000","last_clean":"2024-09-17T03:41:58.795960+0000","last_became_active":"2024-09-17T03:41:58.793808+0000","last_became_peered":"2024-09-17T03:41:58.793808+0000","last_unstale":"2024-09-17T03:41:58.795960+0000","last_undegraded":"2024-09-17T03:41:58.795960+0000","last_fullsized":"2024-09-17T03:41:58.795960+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:31.999015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.778574+0000","last_change":"2024-09-17T03:41:57.785169+0000","last_active":"2024-09-17T03:41:58.778574+0000","last_peered":"2024-09-17T03:41:58.778574+0000","last_clean":"2024-09-17T03:41:58.778574+0000","last_became_active":"2024-09-17T03:41:57.784823+0000","last_became_peered":"2024-09-17T03:41:57.784823+0000","last_unstale":"2024-09-17T03:41:58.778574+0000","last_undegraded":"2024-09-17T03:41:58.778574+0000","last_fullsized":"2024-09-17T03:41:58.778574+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:57.518613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.770051+0000","last_change":"2024-09-17T03:41:57.783095+0000","last_active":"2024-09-17T03:41:58.770051+0000","last_peered":"2024-09-17T03:41:58.770051+0000","last_clean":"2024-09-17T03:41:58.770051+0000","last_became_active":"2024-09-17T03:41:57.782778+0000","last_became_peered":"2024-09-17T03:41:57.782778+0000","last_unstale":"2024-09-17T03:41:58.770051+0000","last_undegraded":"2024-09-17T03:41:58.770051+0000","last_fullsized":"2024-09-17T03:41:58.770051+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:42.526729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789255+0000","last_change":"2024-09-17T03:41:58.784537+0000","last_active":"2024-09-17T03:41:58.789255+0000","last_peered":"2024-09-17T03:41:58.789255+0000","last_clean":"2024-09-17T03:41:58.789255+0000","last_became_active":"2024-09-17T03:41:58.784218+0000","last_became_peered":"2024-09-17T03:41:58.784218+0000","last_unstale":"2024-09-17T03:41:58.789255+0000","last_undegraded":"2024-09-17T03:41:58.789255+0000","last_fullsized":"2024-09-17T03:41:58.789255+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:16.246738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.770135+0000","last_change":"2024-09-17T03:41:57.776527+0000","last_active":"2024-09-17T03:41:58.770135+0000","last_peered":"2024-09-17T03:41:58.770135+0000","last_clean":"2024-09-17T03:41:58.770135+0000","last_became_active":"2024-09-17T03:41:57.776202+0000","last_became_peered":"2024-09-17T03:41:57.776202+0000","last_unstale":"2024-09-17T03:41:58.770135+0000","last_undegraded":"2024-09-17T03:41:58.770135+0000","last_fullsized":"2024-09-17T03:41:58.770135+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:53.119624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:41:57.757220+0000","last_change":"2024-09-17T03:41:57.757220+0000","last_active":"2024-09-17T03:41:57.757220+0000","last_peered":"2024-09-17T03:41:57.757220+0000","last_clean":"2024-09-17T03:41:57.757220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:57.757220+0000","last_undegraded":"2024-09-17T03:41:57.757220+0000","last_fullsized":"2024-09-17T03:41:57.757220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":140,"state":"creating+peering","last_fresh":"2024-09-17T03:41:56.764686+0000","last_change":"2024-09-17T03:41:56.764686+0000","last_active":"2024-09-17T03:41:56.750232+0000","last_peered":"2024-09-17T03:41:56.750232+0000","last_clean":"2024-09-17T03:41:56.750232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:41:56.764686+0000","last_undegraded":"2024-09-17T03:41:56.764686+0000","last_fullsized":"2024-09-17T03:41:56.764686+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798396+0000","last_change":"2024-09-17T03:41:58.797467+0000","last_active":"2024-09-17T03:41:58.798396+0000","last_peered":"2024-09-17T03:41:58.798396+0000","last_clean":"2024-09-17T03:41:58.798396+0000","last_became_active":"2024-09-17T03:41:58.797143+0000","last_became_peered":"2024-09-17T03:41:58.797143+0000","last_unstale":"2024-09-17T03:41:58.798396+0000","last_undegraded":"2024-09-17T03:41:58.798396+0000","last_fullsized":"2024-09-17T03:41:58.798396+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:16.835504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"142'3","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798176+0000","last_change":"2024-09-17T03:41:57.777388+0000","last_active":"2024-09-17T03:41:58.798176+0000","last_peered":"2024-09-17T03:41:58.798176+0000","last_clean":"2024-09-17T03:41:58.798176+0000","last_became_active":"2024-09-17T03:41:57.777035+0000","last_became_peered":"2024-09-17T03:41:57.777035+0000","last_unstale":"2024-09-17T03:41:58.798176+0000","last_undegraded":"2024-09-17T03:41:58.798176+0000","last_fullsized":"2024-09-17T03:41:58.798176+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.381560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":333,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769029+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:41:58.769029+0000","last_peered":"2024-09-17T03:41:58.769029+0000","last_clean":"2024-09-17T03:41:58.769029+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:41:58.769029+0000","last_undegraded":"2024-09-17T03:41:58.769029+0000","last_fullsized":"2024-09-17T03:41:58.769029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51560,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320280,"statfs":{"total":96636764160,"available":96583966720,"internally_reserved":0,"allocated":2371584,"data_stored":1367342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509554,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1781760,"data_stored":776468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509554,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55132,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316708,"statfs":{"total":96636764160,"available":96580308992,"internally_reserved":0,"allocated":1769472,"data_stored":776322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":778004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55128,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316712,"statfs":{"total":96636764160,"available":96580313088,"internally_reserved":0,"allocated":1773568,"data_stored":776904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509555,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51568,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320272,"statfs":{"total":96636764160,"available":96583958528,"internally_reserved":0,"allocated":2379776,"data_stored":1368336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46772,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325068,"statfs":{"total":96636764160,"available":96588869632,"internally_reserved":0,"allocated":1732608,"data_stored":757455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50932,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320908,"statfs":{"total":96636764160,"available":96584609792,"internally_reserved":0,"allocated":1732608,"data_stored":757455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:42:03.505 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3e is not active+clean 2024-09-17T03:42:03.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.505 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3b is not active+clean 2024-09-17T03:42:03.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.505 INFO:tasks.ceph.ceph_manager.ceph:PG 21.37 is not active+clean 2024-09-17T03:42:03.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.505 INFO:tasks.ceph.ceph_manager.ceph:PG 21.33 is not active+clean 2024-09-17T03:42:03.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.506 INFO:tasks.ceph.ceph_manager.ceph:PG 21.21 is not active+clean 2024-09-17T03:42:03.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.506 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1f is not active+clean 2024-09-17T03:42:03.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.506 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1e is not active+clean 2024-09-17T03:42:03.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:56.767175+0000', 'last_change': '2024-09-17T03:41:56.767175+0000', 'last_active': '2024-09-17T03:41:56.750232+0000', 'last_peered': '2024-09-17T03:41:56.750232+0000', 'last_clean': '2024-09-17T03:41:56.750232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:56.767175+0000', 'last_undegraded': '2024-09-17T03:41:56.767175+0000', 'last_fullsized': '2024-09-17T03:41:56.767175+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:42:03.506 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1a is not active+clean 2024-09-17T03:42:03.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.506 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1a is not active+clean 2024-09-17T03:42:03.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:56.760063+0000', 'last_change': '2024-09-17T03:41:56.760063+0000', 'last_active': '2024-09-17T03:41:56.750232+0000', 'last_peered': '2024-09-17T03:41:56.750232+0000', 'last_clean': '2024-09-17T03:41:56.750232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:56.760063+0000', 'last_undegraded': '2024-09-17T03:41:56.760063+0000', 'last_fullsized': '2024-09-17T03:41:56.760063+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:PG 21.18 is not active+clean 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:PG 21.19 is not active+clean 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:PG 21.16 is not active+clean 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:PG 20.17 is not active+clean 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:56.764747+0000', 'last_change': '2024-09-17T03:41:56.764747+0000', 'last_active': '2024-09-17T03:41:56.750232+0000', 'last_peered': '2024-09-17T03:41:56.750232+0000', 'last_clean': '2024-09-17T03:41:56.750232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:56.764747+0000', 'last_undegraded': '2024-09-17T03:41:56.764747+0000', 'last_fullsized': '2024-09-17T03:41:56.764747+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:PG 21.13 is not active+clean 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:PG 21.10 is not active+clean 2024-09-17T03:42:03.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.508 INFO:tasks.ceph.ceph_manager.ceph:PG 20.f is not active+clean 2024-09-17T03:42:03.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:56.760811+0000', 'last_change': '2024-09-17T03:41:56.760811+0000', 'last_active': '2024-09-17T03:41:56.750232+0000', 'last_peered': '2024-09-17T03:41:56.750232+0000', 'last_clean': '2024-09-17T03:41:56.750232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:56.760811+0000', 'last_undegraded': '2024-09-17T03:41:56.760811+0000', 'last_fullsized': '2024-09-17T03:41:56.760811+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:42:03.508 INFO:tasks.ceph.ceph_manager.ceph:PG 20.e is not active+clean 2024-09-17T03:42:03.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:56.766679+0000', 'last_change': '2024-09-17T03:41:56.766679+0000', 'last_active': '2024-09-17T03:41:56.750232+0000', 'last_peered': '2024-09-17T03:41:56.750232+0000', 'last_clean': '2024-09-17T03:41:56.750232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:56.766679+0000', 'last_undegraded': '2024-09-17T03:41:56.766679+0000', 'last_fullsized': '2024-09-17T03:41:56.766679+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:42:03.508 INFO:tasks.ceph.ceph_manager.ceph:PG 20.c is not active+clean 2024-09-17T03:42:03.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:56.765252+0000', 'last_change': '2024-09-17T03:41:56.765252+0000', 'last_active': '2024-09-17T03:41:56.750232+0000', 'last_peered': '2024-09-17T03:41:56.750232+0000', 'last_clean': '2024-09-17T03:41:56.750232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:56.765252+0000', 'last_undegraded': '2024-09-17T03:41:56.765252+0000', 'last_fullsized': '2024-09-17T03:41:56.765252+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:42:03.508 INFO:tasks.ceph.ceph_manager.ceph:PG 21.6 is not active+clean 2024-09-17T03:42:03.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.508 INFO:tasks.ceph.ceph_manager.ceph:PG 21.4 is not active+clean 2024-09-17T03:42:03.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.508 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3 is not active+clean 2024-09-17T03:42:03.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.509 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1 is not active+clean 2024-09-17T03:42:03.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:41:57.757220+0000', 'last_change': '2024-09-17T03:41:57.757220+0000', 'last_active': '2024-09-17T03:41:57.757220+0000', 'last_peered': '2024-09-17T03:41:57.757220+0000', 'last_clean': '2024-09-17T03:41:57.757220+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:57.757220+0000', 'last_undegraded': '2024-09-17T03:41:57.757220+0000', 'last_fullsized': '2024-09-17T03:41:57.757220+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:57.757220+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:42:03.509 INFO:tasks.ceph.ceph_manager.ceph:PG 20.0 is not active+clean 2024-09-17T03:42:03.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 140, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:41:56.764686+0000', 'last_change': '2024-09-17T03:41:56.764686+0000', 'last_active': '2024-09-17T03:41:56.750232+0000', 'last_peered': '2024-09-17T03:41:56.750232+0000', 'last_clean': '2024-09-17T03:41:56.750232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:41:56.764686+0000', 'last_undegraded': '2024-09-17T03:41:56.764686+0000', 'last_fullsized': '2024-09-17T03:41:56.764686+0000', 'mapping_epoch': 140, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 140, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:41:56.750232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:42:03.509 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:42:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.655+0000 7f49de0f9640 1 -- 172.21.15.146:0/3545198868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d80701e0 msgr2=0x7f49d80cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.655+0000 7f49de0f9640 1 --2- 172.21.15.146:0/3545198868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d80701e0 0x7f49d80cfea0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f49d815d000 tx=0x7f49d002aa90 comp rx=0 tx=0).stop 2024-09-17T03:42:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.655+0000 7f49de0f9640 1 -- 172.21.15.146:0/3545198868 shutdown_connections 2024-09-17T03:42:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.655+0000 7f49de0f9640 1 --2- 172.21.15.146:0/3545198868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d80701e0 0x7f49d80cfea0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.655+0000 7f49de0f9640 1 --2- 172.21.15.146:0/3545198868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d815c9f0 0x7f49d81526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.655+0000 7f49de0f9640 1 -- 172.21.15.146:0/3545198868 >> 172.21.15.146:0/3545198868 conn(0x7f49d806d3c0 msgr2=0x7f49d80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.655+0000 7f49de0f9640 1 -- 172.21.15.146:0/3545198868 shutdown_connections 2024-09-17T03:42:03.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.655+0000 7f49de0f9640 1 -- 172.21.15.146:0/3545198868 wait complete. 2024-09-17T03:42:03.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.656+0000 7f49de0f9640 1 Processor -- start 2024-09-17T03:42:03.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.657+0000 7f49de0f9640 1 -- start start 2024-09-17T03:42:03.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49de0f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d80b4100 0x7f49d81f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:03.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49de0f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d8149ca0 0x7f49d814b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:03.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49de0f9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d814a0b0 0x7f49d814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:03.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49de0f9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f49d80d0770 con 0x7f49d8149ca0 2024-09-17T03:42:03.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49de0f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49d80d05f0 con 0x7f49d80b4100 2024-09-17T03:42:03.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49de0f9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f49d80d08f0 con 0x7f49d814a0b0 2024-09-17T03:42:03.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49d6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d8149ca0 0x7f49d814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:03.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49d6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d8149ca0 0x7f49d814b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59464/0 (socket says 172.21.15.146:59464) 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49d6ffd640 1 -- 172.21.15.146:0/540605203 learned_addr learned my addr 172.21.15.146:0/540605203 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49d77fe640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d80b4100 0x7f49d81f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49d7fff640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d814a0b0 0x7f49d814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49d6ffd640 1 -- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d814a0b0 msgr2=0x7f49d814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49d6ffd640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d814a0b0 0x7f49d814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49d6ffd640 1 -- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d80b4100 msgr2=0x7f49d81f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49d6ffd640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d80b4100 0x7f49d81f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49d6ffd640 1 -- 172.21.15.146:0/540605203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d814a740 con 0x7f49d8149ca0 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.658+0000 7f49d77fe640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d80b4100 0x7f49d81f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.659+0000 7f49d6ffd640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d8149ca0 0x7f49d814b3d0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c3a0 tx=0x7f49cc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.659+0000 7f49bffff640 1 -- 172.21.15.146:0/540605203 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc017070 con 0x7f49d8149ca0 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.659+0000 7f49bffff640 1 -- 172.21.15.146:0/540605203 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49cc0053c0 con 0x7f49d8149ca0 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.659+0000 7f49bffff640 1 -- 172.21.15.146:0/540605203 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc003850 con 0x7f49d8149ca0 2024-09-17T03:42:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.659+0000 7f49de0f9640 1 -- 172.21.15.146:0/540605203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d81532c0 con 0x7f49d8149ca0 2024-09-17T03:42:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.659+0000 7f49de0f9640 1 -- 172.21.15.146:0/540605203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d8153880 con 0x7f49d8149ca0 2024-09-17T03:42:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.660+0000 7f49de0f9640 1 -- 172.21.15.146:0/540605203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d815c9f0 con 0x7f49d8149ca0 2024-09-17T03:42:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.661+0000 7f49bffff640 1 -- 172.21.15.146:0/540605203 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49cc01a070 con 0x7f49d8149ca0 2024-09-17T03:42:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.661+0000 7f49bffff640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c4078b90 0x7f49c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.661+0000 7f49bffff640 1 -- 172.21.15.146:0/540605203 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f49cc09a050 con 0x7f49d8149ca0 2024-09-17T03:42:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.661+0000 7f49d77fe640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c4078b90 0x7f49c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:03.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.662+0000 7f49d77fe640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c4078b90 0x7f49c407b0a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f49c8005fd0 tx=0x7f49c800f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:03.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.666+0000 7f49bffff640 1 -- 172.21.15.146:0/540605203 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f49cc061e40 con 0x7f49d8149ca0 2024-09-17T03:42:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.911+0000 7f49de0f9640 1 -- 172.21.15.146:0/540605203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f49d814a4d0 con 0x7f49d8149ca0 2024-09-17T03:42:03.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.911+0000 7f49bffff640 1 -- 172.21.15.146:0/540605203 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1770 (secure 0 0 0) 0x7f49cc066870 con 0x7f49d8149ca0 2024-09-17T03:42:03.911 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:03.911 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":568,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":74},{"state_name":"unknown","count":16},{"state_name":"creating+peering","count":7}],"num_pgs":97,"num_pools":3,"num_objects":21,"data_bytes":592756,"bytes_used":427229184,"bytes_avail":772666884096,"bytes_total":773094113280,"unknown_pgs_ratio":0.16494844853878021,"inactive_pgs_ratio":0.072164945304393768,"write_bytes_sec":2571,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9216}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-17T03:41:41.930323+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:42:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.913+0000 7f49de0f9640 1 -- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c4078b90 msgr2=0x7f49c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.913+0000 7f49de0f9640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c4078b90 0x7f49c407b0a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f49c8005fd0 tx=0x7f49c800f360 comp rx=0 tx=0).stop 2024-09-17T03:42:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.913+0000 7f49de0f9640 1 -- 172.21.15.146:0/540605203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d8149ca0 msgr2=0x7f49d814b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.913+0000 7f49de0f9640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d8149ca0 0x7f49d814b3d0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c3a0 tx=0x7f49cc00c860 comp rx=0 tx=0).stop 2024-09-17T03:42:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.913+0000 7f49de0f9640 1 -- 172.21.15.146:0/540605203 shutdown_connections 2024-09-17T03:42:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.913+0000 7f49de0f9640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f49c4078b90 0x7f49c407b0a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.913+0000 7f49de0f9640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49d814a0b0 0x7f49d814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.913+0000 7f49de0f9640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49d8149ca0 0x7f49d814b3d0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.913+0000 7f49de0f9640 1 --2- 172.21.15.146:0/540605203 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f49d80b4100 0x7f49d81f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:03.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.913+0000 7f49de0f9640 1 -- 172.21.15.146:0/540605203 >> 172.21.15.146:0/540605203 conn(0x7f49d806d3c0 msgr2=0x7f49d81518d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:03.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.914+0000 7f49de0f9640 1 -- 172.21.15.146:0/540605203 shutdown_connections 2024-09-17T03:42:03.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:03.914+0000 7f49de0f9640 1 -- 172.21.15.146:0/540605203 wait complete. 2024-09-17T03:42:03.924 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:42:03.924 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:42:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.038+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/2848929986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b64071120 msgr2=0x7f8b640b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.038+0000 7f8b6c5f9640 1 --2- 172.21.15.146:0/2848929986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b64071120 0x7f8b640b4530 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f8b64074730 tx=0x7f8b5402a520 comp rx=0 tx=0).stop 2024-09-17T03:42:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.038+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/2848929986 shutdown_connections 2024-09-17T03:42:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.038+0000 7f8b6c5f9640 1 --2- 172.21.15.146:0/2848929986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b64071120 0x7f8b640b4530 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.038+0000 7f8b6c5f9640 1 --2- 172.21.15.146:0/2848929986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b640b55f0 0x7f8b64070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.038+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/2848929986 >> 172.21.15.146:0/2848929986 conn(0x7f8b640b3410 msgr2=0x7f8b640b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.038+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/2848929986 shutdown_connections 2024-09-17T03:42:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.038+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/2848929986 wait complete. 2024-09-17T03:42:04.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.040+0000 7f8b6c5f9640 1 Processor -- start 2024-09-17T03:42:04.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.040+0000 7f8b6c5f9640 1 -- start start 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.041+0000 7f8b6c5f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b64071120 0x7f8b6414a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b6c5f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b640b4a70 0x7f8b6415b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b6c5f9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b640b55f0 0x7f8b641536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b6c5f9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6415bd10 con 0x7f8b640b4a70 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b6c5f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6406e710 con 0x7f8b64071120 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b6c5f9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6415be90 con 0x7f8b640b55f0 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b69b94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b640b4a70 0x7f8b6415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b69b94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b640b4a70 0x7f8b6415b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59484/0 (socket says 172.21.15.146:59484) 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b69b94640 1 -- 172.21.15.146:0/3159830757 learned_addr learned my addr 172.21.15.146:0/3159830757 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b69b94640 1 -- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b640b55f0 msgr2=0x7f8b641536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b6ab96640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b640b55f0 0x7f8b641536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b6a395640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b64071120 0x7f8b6414a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b69b94640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b640b55f0 0x7f8b641536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b69b94640 1 -- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b64071120 msgr2=0x7f8b6414a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b69b94640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b64071120 0x7f8b6414a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b69b94640 1 -- 172.21.15.146:0/3159830757 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6415a5e0 con 0x7f8b640b4a70 2024-09-17T03:42:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b69b94640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b640b4a70 0x7f8b6415b420 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f8b54000c00 tx=0x7f8b540039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b5affd640 1 -- 172.21.15.146:0/3159830757 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5403e030 con 0x7f8b640b4a70 2024-09-17T03:42:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b5affd640 1 -- 172.21.15.146:0/3159830757 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b540047a0 con 0x7f8b640b4a70 2024-09-17T03:42:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/3159830757 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b640cfb70 con 0x7f8b640b4a70 2024-09-17T03:42:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b5affd640 1 -- 172.21.15.146:0/3159830757 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54035040 con 0x7f8b640b4a70 2024-09-17T03:42:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.042+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/3159830757 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b640d0130 con 0x7f8b640b4a70 2024-09-17T03:42:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.043+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/3159830757 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b640b4530 con 0x7f8b640b4a70 2024-09-17T03:42:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.044+0000 7f8b5affd640 1 -- 172.21.15.146:0/3159830757 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b54041030 con 0x7f8b640b4a70 2024-09-17T03:42:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.044+0000 7f8b5affd640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b48078b90 0x7f8b4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.045+0000 7f8b5affd640 1 -- 172.21.15.146:0/3159830757 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f8b540bb440 con 0x7f8b640b4a70 2024-09-17T03:42:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.045+0000 7f8b6a395640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b48078b90 0x7f8b4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.045+0000 7f8b6a395640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b48078b90 0x7f8b4807b0a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005fd0 tx=0x7f8b60005bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:04.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.049+0000 7f8b5affd640 1 -- 172.21.15.146:0/3159830757 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b54083900 con 0x7f8b640b4a70 2024-09-17T03:42:04.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.220+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/3159830757 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b6415a8c0 con 0x7f8b48078b90 2024-09-17T03:42:04.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.225+0000 7f8b5affd640 1 -- 172.21.15.146:0/3159830757 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252471 (secure 0 0 0) 0x7f8b6415a8c0 con 0x7f8b48078b90 2024-09-17T03:42:04.227 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:42:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.228+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b48078b90 msgr2=0x7f8b4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.228+0000 7f8b6c5f9640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b48078b90 0x7f8b4807b0a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005fd0 tx=0x7f8b60005bc0 comp rx=0 tx=0).stop 2024-09-17T03:42:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.228+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/3159830757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b640b4a70 msgr2=0x7f8b6415b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:04.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.228+0000 7f8b6c5f9640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b640b4a70 0x7f8b6415b420 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f8b54000c00 tx=0x7f8b540039e0 comp rx=0 tx=0).stop 2024-09-17T03:42:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.228+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/3159830757 shutdown_connections 2024-09-17T03:42:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.228+0000 7f8b6c5f9640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b48078b90 0x7f8b4807b0a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.228+0000 7f8b6c5f9640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b640b55f0 0x7f8b641536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.228+0000 7f8b6c5f9640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b640b4a70 0x7f8b6415b420 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.228+0000 7f8b6c5f9640 1 --2- 172.21.15.146:0/3159830757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b64071120 0x7f8b6414a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.228+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/3159830757 >> 172.21.15.146:0/3159830757 conn(0x7f8b640b3410 msgr2=0x7f8b64158380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.229+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/3159830757 shutdown_connections 2024-09-17T03:42:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:04.229+0000 7f8b6c5f9640 1 -- 172.21.15.146:0/3159830757 wait complete. 2024-09-17T03:42:04.239 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2024-09-17T03:42:03.935322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":421472,"kb_used_data":15072,"kb_used_omap":12,"kb_used_meta":406195,"kb_avail":754553248,"statfs":{"total":773094113280,"available":772662525952,"internally_reserved":0,"allocated":15433728,"data_stored":7408732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":415944241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.167565"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789673+0000","last_change":"2024-09-17T03:41:58.783510+0000","last_active":"2024-09-17T03:41:58.789673+0000","last_peered":"2024-09-17T03:41:58.789673+0000","last_clean":"2024-09-17T03:41:58.789673+0000","last_became_active":"2024-09-17T03:41:58.782625+0000","last_became_peered":"2024-09-17T03:41:58.782625+0000","last_unstale":"2024-09-17T03:41:58.789673+0000","last_undegraded":"2024-09-17T03:41:58.789673+0000","last_fullsized":"2024-09-17T03:41:58.789673+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:08.308387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398169+0000","last_change":"2024-09-17T03:41:58.788134+0000","last_active":"2024-09-17T03:42:00.398169+0000","last_peered":"2024-09-17T03:42:00.398169+0000","last_clean":"2024-09-17T03:42:00.398169+0000","last_became_active":"2024-09-17T03:41:58.787479+0000","last_became_peered":"2024-09-17T03:41:58.787479+0000","last_unstale":"2024-09-17T03:42:00.398169+0000","last_undegraded":"2024-09-17T03:42:00.398169+0000","last_fullsized":"2024-09-17T03:42:00.398169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:35.963326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.773941+0000","last_change":"2024-09-17T03:41:58.773210+0000","last_active":"2024-09-17T03:41:58.773941+0000","last_peered":"2024-09-17T03:41:58.773941+0000","last_clean":"2024-09-17T03:41:58.773941+0000","last_became_active":"2024-09-17T03:41:58.771709+0000","last_became_peered":"2024-09-17T03:41:58.771709+0000","last_unstale":"2024-09-17T03:41:58.773941+0000","last_undegraded":"2024-09-17T03:41:58.773941+0000","last_fullsized":"2024-09-17T03:41:58.773941+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:23.055342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790017+0000","last_change":"2024-09-17T03:41:58.784113+0000","last_active":"2024-09-17T03:41:58.790017+0000","last_peered":"2024-09-17T03:41:58.790017+0000","last_clean":"2024-09-17T03:41:58.790017+0000","last_became_active":"2024-09-17T03:41:58.783674+0000","last_became_peered":"2024-09-17T03:41:58.783674+0000","last_unstale":"2024-09-17T03:41:58.790017+0000","last_undegraded":"2024-09-17T03:41:58.790017+0000","last_fullsized":"2024-09-17T03:41:58.790017+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:15.404369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398509+0000","last_change":"2024-09-17T03:41:58.790442+0000","last_active":"2024-09-17T03:42:00.398509+0000","last_peered":"2024-09-17T03:42:00.398509+0000","last_clean":"2024-09-17T03:42:00.398509+0000","last_became_active":"2024-09-17T03:41:58.789337+0000","last_became_peered":"2024-09-17T03:41:58.789337+0000","last_unstale":"2024-09-17T03:42:00.398509+0000","last_undegraded":"2024-09-17T03:42:00.398509+0000","last_fullsized":"2024-09-17T03:42:00.398509+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:15.170911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789718+0000","last_change":"2024-09-17T03:41:58.781216+0000","last_active":"2024-09-17T03:41:58.789718+0000","last_peered":"2024-09-17T03:41:58.789718+0000","last_clean":"2024-09-17T03:41:58.789718+0000","last_became_active":"2024-09-17T03:41:58.780931+0000","last_became_peered":"2024-09-17T03:41:58.780931+0000","last_unstale":"2024-09-17T03:41:58.789718+0000","last_undegraded":"2024-09-17T03:41:58.789718+0000","last_fullsized":"2024-09-17T03:41:58.789718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:17.947058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.797923+0000","last_change":"2024-09-17T03:41:58.795953+0000","last_active":"2024-09-17T03:41:58.797923+0000","last_peered":"2024-09-17T03:41:58.797923+0000","last_clean":"2024-09-17T03:41:58.797923+0000","last_became_active":"2024-09-17T03:41:58.795588+0000","last_became_peered":"2024-09-17T03:41:58.795588+0000","last_unstale":"2024-09-17T03:41:58.797923+0000","last_undegraded":"2024-09-17T03:41:58.797923+0000","last_fullsized":"2024-09-17T03:41:58.797923+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:03.090120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794142+0000","last_change":"2024-09-17T03:41:58.793259+0000","last_active":"2024-09-17T03:41:58.794142+0000","last_peered":"2024-09-17T03:41:58.794142+0000","last_clean":"2024-09-17T03:41:58.794142+0000","last_became_active":"2024-09-17T03:41:58.792967+0000","last_became_peered":"2024-09-17T03:41:58.792967+0000","last_unstale":"2024-09-17T03:41:58.794142+0000","last_undegraded":"2024-09-17T03:41:58.794142+0000","last_fullsized":"2024-09-17T03:41:58.794142+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:49.170549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398191+0000","last_change":"2024-09-17T03:41:58.783235+0000","last_active":"2024-09-17T03:42:00.398191+0000","last_peered":"2024-09-17T03:42:00.398191+0000","last_clean":"2024-09-17T03:42:00.398191+0000","last_became_active":"2024-09-17T03:41:58.782954+0000","last_became_peered":"2024-09-17T03:41:58.782954+0000","last_unstale":"2024-09-17T03:42:00.398191+0000","last_undegraded":"2024-09-17T03:42:00.398191+0000","last_fullsized":"2024-09-17T03:42:00.398191+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:15.944827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789159+0000","last_change":"2024-09-17T03:41:58.786406+0000","last_active":"2024-09-17T03:41:58.789159+0000","last_peered":"2024-09-17T03:41:58.789159+0000","last_clean":"2024-09-17T03:41:58.789159+0000","last_became_active":"2024-09-17T03:41:58.785804+0000","last_became_peered":"2024-09-17T03:41:58.785804+0000","last_unstale":"2024-09-17T03:41:58.789159+0000","last_undegraded":"2024-09-17T03:41:58.789159+0000","last_fullsized":"2024-09-17T03:41:58.789159+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:31.346639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793904+0000","last_change":"2024-09-17T03:41:58.792926+0000","last_active":"2024-09-17T03:41:58.793904+0000","last_peered":"2024-09-17T03:41:58.793904+0000","last_clean":"2024-09-17T03:41:58.793904+0000","last_became_active":"2024-09-17T03:41:58.792624+0000","last_became_peered":"2024-09-17T03:41:58.792624+0000","last_unstale":"2024-09-17T03:41:58.793904+0000","last_undegraded":"2024-09-17T03:41:58.793904+0000","last_fullsized":"2024-09-17T03:41:58.793904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:28.867944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789347+0000","last_change":"2024-09-17T03:41:58.787698+0000","last_active":"2024-09-17T03:41:58.789347+0000","last_peered":"2024-09-17T03:41:58.789347+0000","last_clean":"2024-09-17T03:41:58.789347+0000","last_became_active":"2024-09-17T03:41:58.787391+0000","last_became_peered":"2024-09-17T03:41:58.787391+0000","last_unstale":"2024-09-17T03:41:58.789347+0000","last_undegraded":"2024-09-17T03:41:58.789347+0000","last_fullsized":"2024-09-17T03:41:58.789347+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:16.851435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398624+0000","last_change":"2024-09-17T03:41:58.789654+0000","last_active":"2024-09-17T03:42:00.398624+0000","last_peered":"2024-09-17T03:42:00.398624+0000","last_clean":"2024-09-17T03:42:00.398624+0000","last_became_active":"2024-09-17T03:41:58.788573+0000","last_became_peered":"2024-09-17T03:41:58.788573+0000","last_unstale":"2024-09-17T03:42:00.398624+0000","last_undegraded":"2024-09-17T03:42:00.398624+0000","last_fullsized":"2024-09-17T03:42:00.398624+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:51.987496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.796383+0000","last_change":"2024-09-17T03:41:58.792904+0000","last_active":"2024-09-17T03:41:58.796383+0000","last_peered":"2024-09-17T03:41:58.796383+0000","last_clean":"2024-09-17T03:41:58.796383+0000","last_became_active":"2024-09-17T03:41:58.792587+0000","last_became_peered":"2024-09-17T03:41:58.792587+0000","last_unstale":"2024-09-17T03:41:58.796383+0000","last_undegraded":"2024-09-17T03:41:58.796383+0000","last_fullsized":"2024-09-17T03:41:58.796383+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:35.853662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.780484+0000","last_change":"2024-09-17T03:41:58.778325+0000","last_active":"2024-09-17T03:41:58.780484+0000","last_peered":"2024-09-17T03:41:58.780484+0000","last_clean":"2024-09-17T03:41:58.780484+0000","last_became_active":"2024-09-17T03:41:58.778010+0000","last_became_peered":"2024-09-17T03:41:58.778010+0000","last_unstale":"2024-09-17T03:41:58.780484+0000","last_undegraded":"2024-09-17T03:41:58.780484+0000","last_fullsized":"2024-09-17T03:41:58.780484+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:31.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791571+0000","last_change":"2024-09-17T03:41:58.784054+0000","last_active":"2024-09-17T03:41:58.791571+0000","last_peered":"2024-09-17T03:41:58.791571+0000","last_clean":"2024-09-17T03:41:58.791571+0000","last_became_active":"2024-09-17T03:41:58.783751+0000","last_became_peered":"2024-09-17T03:41:58.783751+0000","last_unstale":"2024-09-17T03:41:58.791571+0000","last_undegraded":"2024-09-17T03:41:58.791571+0000","last_fullsized":"2024-09-17T03:41:58.791571+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:49.444227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795743+0000","last_change":"2024-09-17T03:41:58.791309+0000","last_active":"2024-09-17T03:41:58.795743+0000","last_peered":"2024-09-17T03:41:58.795743+0000","last_clean":"2024-09-17T03:41:58.795743+0000","last_became_active":"2024-09-17T03:41:58.791005+0000","last_became_peered":"2024-09-17T03:41:58.791005+0000","last_unstale":"2024-09-17T03:41:58.795743+0000","last_undegraded":"2024-09-17T03:41:58.795743+0000","last_fullsized":"2024-09-17T03:41:58.795743+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:44.620003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.773928+0000","last_change":"2024-09-17T03:41:58.772834+0000","last_active":"2024-09-17T03:41:58.773928+0000","last_peered":"2024-09-17T03:41:58.773928+0000","last_clean":"2024-09-17T03:41:58.773928+0000","last_became_active":"2024-09-17T03:41:58.772503+0000","last_became_peered":"2024-09-17T03:41:58.772503+0000","last_unstale":"2024-09-17T03:41:58.773928+0000","last_undegraded":"2024-09-17T03:41:58.773928+0000","last_fullsized":"2024-09-17T03:41:58.773928+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:05.742202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790728+0000","last_change":"2024-09-17T03:41:58.785329+0000","last_active":"2024-09-17T03:41:58.790728+0000","last_peered":"2024-09-17T03:41:58.790728+0000","last_clean":"2024-09-17T03:41:58.790728+0000","last_became_active":"2024-09-17T03:41:58.785017+0000","last_became_peered":"2024-09-17T03:41:58.785017+0000","last_unstale":"2024-09-17T03:41:58.790728+0000","last_undegraded":"2024-09-17T03:41:58.790728+0000","last_fullsized":"2024-09-17T03:41:58.790728+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:10.635488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790132+0000","last_change":"2024-09-17T03:41:58.782096+0000","last_active":"2024-09-17T03:41:58.790132+0000","last_peered":"2024-09-17T03:41:58.790132+0000","last_clean":"2024-09-17T03:41:58.790132+0000","last_became_active":"2024-09-17T03:41:58.781798+0000","last_became_peered":"2024-09-17T03:41:58.781798+0000","last_unstale":"2024-09-17T03:41:58.790132+0000","last_undegraded":"2024-09-17T03:41:58.790132+0000","last_fullsized":"2024-09-17T03:41:58.790132+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:24.167278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789200+0000","last_change":"2024-09-17T03:41:58.787064+0000","last_active":"2024-09-17T03:41:58.789200+0000","last_peered":"2024-09-17T03:41:58.789200+0000","last_clean":"2024-09-17T03:41:58.789200+0000","last_became_active":"2024-09-17T03:41:58.786212+0000","last_became_peered":"2024-09-17T03:41:58.786212+0000","last_unstale":"2024-09-17T03:41:58.789200+0000","last_undegraded":"2024-09-17T03:41:58.789200+0000","last_fullsized":"2024-09-17T03:41:58.789200+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:01.139228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789870+0000","last_change":"2024-09-17T03:41:58.785048+0000","last_active":"2024-09-17T03:41:58.789870+0000","last_peered":"2024-09-17T03:41:58.789870+0000","last_clean":"2024-09-17T03:41:58.789870+0000","last_became_active":"2024-09-17T03:41:58.784435+0000","last_became_peered":"2024-09-17T03:41:58.784435+0000","last_unstale":"2024-09-17T03:41:58.789870+0000","last_undegraded":"2024-09-17T03:41:58.789870+0000","last_fullsized":"2024-09-17T03:41:58.789870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:46.290406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794684+0000","last_change":"2024-09-17T03:41:58.791265+0000","last_active":"2024-09-17T03:41:58.794684+0000","last_peered":"2024-09-17T03:41:58.794684+0000","last_clean":"2024-09-17T03:41:58.794684+0000","last_became_active":"2024-09-17T03:41:58.790981+0000","last_became_peered":"2024-09-17T03:41:58.790981+0000","last_unstale":"2024-09-17T03:41:58.794684+0000","last_undegraded":"2024-09-17T03:41:58.794684+0000","last_fullsized":"2024-09-17T03:41:58.794684+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:03.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789286+0000","last_change":"2024-09-17T03:41:58.786007+0000","last_active":"2024-09-17T03:41:58.789286+0000","last_peered":"2024-09-17T03:41:58.789286+0000","last_clean":"2024-09-17T03:41:58.789286+0000","last_became_active":"2024-09-17T03:41:58.785642+0000","last_became_peered":"2024-09-17T03:41:58.785642+0000","last_unstale":"2024-09-17T03:41:58.789286+0000","last_undegraded":"2024-09-17T03:41:58.789286+0000","last_fullsized":"2024-09-17T03:41:58.789286+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:45.260732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791077+0000","last_change":"2024-09-17T03:41:58.784174+0000","last_active":"2024-09-17T03:41:58.791077+0000","last_peered":"2024-09-17T03:41:58.791077+0000","last_clean":"2024-09-17T03:41:58.791077+0000","last_became_active":"2024-09-17T03:41:58.783889+0000","last_became_peered":"2024-09-17T03:41:58.783889+0000","last_unstale":"2024-09-17T03:41:58.791077+0000","last_undegraded":"2024-09-17T03:41:58.791077+0000","last_fullsized":"2024-09-17T03:41:58.791077+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:49.912037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793352+0000","last_change":"2024-09-17T03:41:58.790506+0000","last_active":"2024-09-17T03:41:58.793352+0000","last_peered":"2024-09-17T03:41:58.793352+0000","last_clean":"2024-09-17T03:41:58.793352+0000","last_became_active":"2024-09-17T03:41:58.790198+0000","last_became_peered":"2024-09-17T03:41:58.790198+0000","last_unstale":"2024-09-17T03:41:58.793352+0000","last_undegraded":"2024-09-17T03:41:58.793352+0000","last_fullsized":"2024-09-17T03:41:58.793352+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:44.163526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791013+0000","last_change":"2024-09-17T03:41:58.783272+0000","last_active":"2024-09-17T03:41:58.791013+0000","last_peered":"2024-09-17T03:41:58.791013+0000","last_clean":"2024-09-17T03:41:58.791013+0000","last_became_active":"2024-09-17T03:41:58.782949+0000","last_became_peered":"2024-09-17T03:41:58.782949+0000","last_unstale":"2024-09-17T03:41:58.791013+0000","last_undegraded":"2024-09-17T03:41:58.791013+0000","last_fullsized":"2024-09-17T03:41:58.791013+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:33.398364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789500+0000","last_change":"2024-09-17T03:41:58.786551+0000","last_active":"2024-09-17T03:41:58.789500+0000","last_peered":"2024-09-17T03:41:58.789500+0000","last_clean":"2024-09-17T03:41:58.789500+0000","last_became_active":"2024-09-17T03:41:58.786235+0000","last_became_peered":"2024-09-17T03:41:58.786235+0000","last_unstale":"2024-09-17T03:41:58.789500+0000","last_undegraded":"2024-09-17T03:41:58.789500+0000","last_fullsized":"2024-09-17T03:41:58.789500+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:55.612023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.782762+0000","last_change":"2024-09-17T03:41:58.781120+0000","last_active":"2024-09-17T03:41:58.782762+0000","last_peered":"2024-09-17T03:41:58.782762+0000","last_clean":"2024-09-17T03:41:58.782762+0000","last_became_active":"2024-09-17T03:41:58.780819+0000","last_became_peered":"2024-09-17T03:41:58.780819+0000","last_unstale":"2024-09-17T03:41:58.782762+0000","last_undegraded":"2024-09-17T03:41:58.782762+0000","last_fullsized":"2024-09-17T03:41:58.782762+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:50.827807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789904+0000","last_change":"2024-09-17T03:41:58.786598+0000","last_active":"2024-09-17T03:41:58.789904+0000","last_peered":"2024-09-17T03:41:58.789904+0000","last_clean":"2024-09-17T03:41:58.789904+0000","last_became_active":"2024-09-17T03:41:58.786273+0000","last_became_peered":"2024-09-17T03:41:58.786273+0000","last_unstale":"2024-09-17T03:41:58.789904+0000","last_undegraded":"2024-09-17T03:41:58.789904+0000","last_fullsized":"2024-09-17T03:41:58.789904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:39.675219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.397853+0000","last_change":"2024-09-17T03:41:58.774158+0000","last_active":"2024-09-17T03:42:00.397853+0000","last_peered":"2024-09-17T03:42:00.397853+0000","last_clean":"2024-09-17T03:42:00.397853+0000","last_became_active":"2024-09-17T03:41:58.773739+0000","last_became_peered":"2024-09-17T03:41:58.773739+0000","last_unstale":"2024-09-17T03:42:00.397853+0000","last_undegraded":"2024-09-17T03:42:00.397853+0000","last_fullsized":"2024-09-17T03:42:00.397853+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:32.110986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791599+0000","last_change":"2024-09-17T03:41:58.788709+0000","last_active":"2024-09-17T03:41:58.791599+0000","last_peered":"2024-09-17T03:41:58.791599+0000","last_clean":"2024-09-17T03:41:58.791599+0000","last_became_active":"2024-09-17T03:41:58.788401+0000","last_became_peered":"2024-09-17T03:41:58.788401+0000","last_unstale":"2024-09-17T03:41:58.791599+0000","last_undegraded":"2024-09-17T03:41:58.791599+0000","last_fullsized":"2024-09-17T03:41:58.791599+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:54.187280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794133+0000","last_change":"2024-09-17T03:41:58.792053+0000","last_active":"2024-09-17T03:41:58.794133+0000","last_peered":"2024-09-17T03:41:58.794133+0000","last_clean":"2024-09-17T03:41:58.794133+0000","last_became_active":"2024-09-17T03:41:58.791734+0000","last_became_peered":"2024-09-17T03:41:58.791734+0000","last_unstale":"2024-09-17T03:41:58.794133+0000","last_undegraded":"2024-09-17T03:41:58.794133+0000","last_fullsized":"2024-09-17T03:41:58.794133+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:34.904922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"142'4","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800933+0000","last_change":"2024-09-17T03:41:57.783265+0000","last_active":"2024-09-17T03:41:58.800933+0000","last_peered":"2024-09-17T03:41:58.800933+0000","last_clean":"2024-09-17T03:41:58.800933+0000","last_became_active":"2024-09-17T03:41:57.782950+0000","last_became_peered":"2024-09-17T03:41:57.782950+0000","last_unstale":"2024-09-17T03:41:58.800933+0000","last_undegraded":"2024-09-17T03:41:58.800933+0000","last_fullsized":"2024-09-17T03:41:58.800933+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398250+0000","last_change":"2024-09-17T03:41:58.790857+0000","last_active":"2024-09-17T03:42:00.398250+0000","last_peered":"2024-09-17T03:42:00.398250+0000","last_clean":"2024-09-17T03:42:00.398250+0000","last_became_active":"2024-09-17T03:41:58.790567+0000","last_became_peered":"2024-09-17T03:41:58.790567+0000","last_unstale":"2024-09-17T03:42:00.398250+0000","last_undegraded":"2024-09-17T03:42:00.398250+0000","last_fullsized":"2024-09-17T03:42:00.398250+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:23.456442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"142'1","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398020+0000","last_change":"2024-09-17T03:41:57.779775+0000","last_active":"2024-09-17T03:42:00.398020+0000","last_peered":"2024-09-17T03:42:00.398020+0000","last_clean":"2024-09-17T03:42:00.398020+0000","last_became_active":"2024-09-17T03:41:57.779410+0000","last_became_peered":"2024-09-17T03:41:57.779410+0000","last_unstale":"2024-09-17T03:42:00.398020+0000","last_undegraded":"2024-09-17T03:42:00.398020+0000","last_fullsized":"2024-09-17T03:42:00.398020+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:52.354071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791207+0000","last_change":"2024-09-17T03:41:58.788338+0000","last_active":"2024-09-17T03:41:58.791207+0000","last_peered":"2024-09-17T03:41:58.791207+0000","last_clean":"2024-09-17T03:41:58.791207+0000","last_became_active":"2024-09-17T03:41:58.788052+0000","last_became_peered":"2024-09-17T03:41:58.788052+0000","last_unstale":"2024-09-17T03:41:58.791207+0000","last_undegraded":"2024-09-17T03:41:58.791207+0000","last_fullsized":"2024-09-17T03:41:58.791207+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:33.314758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799041+0000","last_change":"2024-09-17T03:41:57.786673+0000","last_active":"2024-09-17T03:41:58.799041+0000","last_peered":"2024-09-17T03:41:58.799041+0000","last_clean":"2024-09-17T03:41:58.799041+0000","last_became_active":"2024-09-17T03:41:57.786359+0000","last_became_peered":"2024-09-17T03:41:57.786359+0000","last_unstale":"2024-09-17T03:41:58.799041+0000","last_undegraded":"2024-09-17T03:41:58.799041+0000","last_fullsized":"2024-09-17T03:41:58.799041+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:36.067718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789415+0000","last_change":"2024-09-17T03:41:58.787967+0000","last_active":"2024-09-17T03:41:58.789415+0000","last_peered":"2024-09-17T03:41:58.789415+0000","last_clean":"2024-09-17T03:41:58.789415+0000","last_became_active":"2024-09-17T03:41:58.787652+0000","last_became_peered":"2024-09-17T03:41:58.787652+0000","last_unstale":"2024-09-17T03:41:58.789415+0000","last_undegraded":"2024-09-17T03:41:58.789415+0000","last_fullsized":"2024-09-17T03:41:58.789415+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:18.330621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799781+0000","last_change":"2024-09-17T03:41:57.786812+0000","last_active":"2024-09-17T03:41:58.799781+0000","last_peered":"2024-09-17T03:41:58.799781+0000","last_clean":"2024-09-17T03:41:58.799781+0000","last_became_active":"2024-09-17T03:41:57.786434+0000","last_became_peered":"2024-09-17T03:41:57.786434+0000","last_unstale":"2024-09-17T03:41:58.799781+0000","last_undegraded":"2024-09-17T03:41:58.799781+0000","last_fullsized":"2024-09-17T03:41:58.799781+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.381560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398019+0000","last_change":"2024-09-17T03:41:58.775442+0000","last_active":"2024-09-17T03:42:00.398019+0000","last_peered":"2024-09-17T03:42:00.398019+0000","last_clean":"2024-09-17T03:42:00.398019+0000","last_became_active":"2024-09-17T03:41:58.775106+0000","last_became_peered":"2024-09-17T03:41:58.775106+0000","last_unstale":"2024-09-17T03:42:00.398019+0000","last_undegraded":"2024-09-17T03:42:00.398019+0000","last_fullsized":"2024-09-17T03:42:00.398019+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:16.844984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"142'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798526+0000","last_change":"2024-09-17T03:41:57.782388+0000","last_active":"2024-09-17T03:41:58.798526+0000","last_peered":"2024-09-17T03:41:58.798526+0000","last_clean":"2024-09-17T03:41:58.798526+0000","last_became_active":"2024-09-17T03:41:57.782057+0000","last_became_peered":"2024-09-17T03:41:57.782057+0000","last_unstale":"2024-09-17T03:41:58.798526+0000","last_undegraded":"2024-09-17T03:41:58.798526+0000","last_fullsized":"2024-09-17T03:41:58.798526+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:47.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790997+0000","last_change":"2024-09-17T03:41:58.782536+0000","last_active":"2024-09-17T03:41:58.790997+0000","last_peered":"2024-09-17T03:41:58.790997+0000","last_clean":"2024-09-17T03:41:58.790997+0000","last_became_active":"2024-09-17T03:41:58.782153+0000","last_became_peered":"2024-09-17T03:41:58.782153+0000","last_unstale":"2024-09-17T03:41:58.790997+0000","last_undegraded":"2024-09-17T03:41:58.790997+0000","last_fullsized":"2024-09-17T03:41:58.790997+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:02.865504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"142'1","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398244+0000","last_change":"2024-09-17T03:41:57.787011+0000","last_active":"2024-09-17T03:42:00.398244+0000","last_peered":"2024-09-17T03:42:00.398244+0000","last_clean":"2024-09-17T03:42:00.398244+0000","last_became_active":"2024-09-17T03:41:57.786612+0000","last_became_peered":"2024-09-17T03:41:57.786612+0000","last_unstale":"2024-09-17T03:42:00.398244+0000","last_undegraded":"2024-09-17T03:42:00.398244+0000","last_fullsized":"2024-09-17T03:42:00.398244+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:38.032586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.397855+0000","last_change":"2024-09-17T03:41:58.786921+0000","last_active":"2024-09-17T03:42:00.397855+0000","last_peered":"2024-09-17T03:42:00.397855+0000","last_clean":"2024-09-17T03:42:00.397855+0000","last_became_active":"2024-09-17T03:41:58.786596+0000","last_became_peered":"2024-09-17T03:41:58.786596+0000","last_unstale":"2024-09-17T03:42:00.397855+0000","last_undegraded":"2024-09-17T03:42:00.397855+0000","last_fullsized":"2024-09-17T03:42:00.397855+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:14.503000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.777449+0000","last_change":"2024-09-17T03:41:57.787289+0000","last_active":"2024-09-17T03:41:58.777449+0000","last_peered":"2024-09-17T03:41:58.777449+0000","last_clean":"2024-09-17T03:41:58.777449+0000","last_became_active":"2024-09-17T03:41:57.786949+0000","last_became_peered":"2024-09-17T03:41:57.786949+0000","last_unstale":"2024-09-17T03:41:58.777449+0000","last_undegraded":"2024-09-17T03:41:58.777449+0000","last_fullsized":"2024-09-17T03:41:58.777449+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:11.729127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398370+0000","last_change":"2024-09-17T03:41:58.783127+0000","last_active":"2024-09-17T03:42:00.398370+0000","last_peered":"2024-09-17T03:42:00.398370+0000","last_clean":"2024-09-17T03:42:00.398370+0000","last_became_active":"2024-09-17T03:41:58.782264+0000","last_became_peered":"2024-09-17T03:41:58.782264+0000","last_unstale":"2024-09-17T03:42:00.398370+0000","last_undegraded":"2024-09-17T03:42:00.398370+0000","last_fullsized":"2024-09-17T03:42:00.398370+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:33.147102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776783+0000","last_change":"2024-09-17T03:41:57.788010+0000","last_active":"2024-09-17T03:41:58.776783+0000","last_peered":"2024-09-17T03:41:58.776783+0000","last_clean":"2024-09-17T03:41:58.776783+0000","last_became_active":"2024-09-17T03:41:57.787639+0000","last_became_peered":"2024-09-17T03:41:57.787639+0000","last_unstale":"2024-09-17T03:41:58.776783+0000","last_undegraded":"2024-09-17T03:41:58.776783+0000","last_fullsized":"2024-09-17T03:41:58.776783+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:53.119624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398863+0000","last_change":"2024-09-17T03:41:58.787208+0000","last_active":"2024-09-17T03:42:00.398863+0000","last_peered":"2024-09-17T03:42:00.398863+0000","last_clean":"2024-09-17T03:42:00.398863+0000","last_became_active":"2024-09-17T03:41:58.786658+0000","last_became_peered":"2024-09-17T03:41:58.786658+0000","last_unstale":"2024-09-17T03:42:00.398863+0000","last_undegraded":"2024-09-17T03:42:00.398863+0000","last_fullsized":"2024-09-17T03:42:00.398863+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:58.293415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398246+0000","last_change":"2024-09-17T03:41:57.776917+0000","last_active":"2024-09-17T03:42:00.398246+0000","last_peered":"2024-09-17T03:42:00.398246+0000","last_clean":"2024-09-17T03:42:00.398246+0000","last_became_active":"2024-09-17T03:41:57.776588+0000","last_became_peered":"2024-09-17T03:41:57.776588+0000","last_unstale":"2024-09-17T03:42:00.398246+0000","last_undegraded":"2024-09-17T03:42:00.398246+0000","last_fullsized":"2024-09-17T03:42:00.398246+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:10.846013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.799815+0000","last_change":"2024-09-17T03:41:58.795904+0000","last_active":"2024-09-17T03:41:58.799815+0000","last_peered":"2024-09-17T03:41:58.799815+0000","last_clean":"2024-09-17T03:41:58.799815+0000","last_became_active":"2024-09-17T03:41:58.795526+0000","last_became_peered":"2024-09-17T03:41:58.795526+0000","last_unstale":"2024-09-17T03:41:58.799815+0000","last_undegraded":"2024-09-17T03:41:58.799815+0000","last_fullsized":"2024-09-17T03:41:58.799815+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:46.917885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.772721+0000","last_change":"2024-09-17T03:41:57.784269+0000","last_active":"2024-09-17T03:41:58.772721+0000","last_peered":"2024-09-17T03:41:58.772721+0000","last_clean":"2024-09-17T03:41:58.772721+0000","last_became_active":"2024-09-17T03:41:57.783959+0000","last_became_peered":"2024-09-17T03:41:57.783959+0000","last_unstale":"2024-09-17T03:41:58.772721+0000","last_undegraded":"2024-09-17T03:41:58.772721+0000","last_fullsized":"2024-09-17T03:41:58.772721+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:53.953478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.791040+0000","last_change":"2024-09-17T03:41:58.788640+0000","last_active":"2024-09-17T03:41:58.791040+0000","last_peered":"2024-09-17T03:41:58.791040+0000","last_clean":"2024-09-17T03:41:58.791040+0000","last_became_active":"2024-09-17T03:41:58.788345+0000","last_became_peered":"2024-09-17T03:41:58.788345+0000","last_unstale":"2024-09-17T03:41:58.791040+0000","last_undegraded":"2024-09-17T03:41:58.791040+0000","last_fullsized":"2024-09-17T03:41:58.791040+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:45.234838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"142'6","reported_seq":19,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.801083+0000","last_change":"2024-09-17T03:41:57.782746+0000","last_active":"2024-09-17T03:41:58.801083+0000","last_peered":"2024-09-17T03:41:58.801083+0000","last_clean":"2024-09-17T03:41:58.801083+0000","last_became_active":"2024-09-17T03:41:57.782411+0000","last_became_peered":"2024-09-17T03:41:57.782411+0000","last_unstale":"2024-09-17T03:41:58.801083+0000","last_undegraded":"2024-09-17T03:41:58.801083+0000","last_fullsized":"2024-09-17T03:41:58.801083+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:17.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795355+0000","last_change":"2024-09-17T03:41:58.791701+0000","last_active":"2024-09-17T03:41:58.795355+0000","last_peered":"2024-09-17T03:41:58.795355+0000","last_clean":"2024-09-17T03:41:58.795355+0000","last_became_active":"2024-09-17T03:41:58.791387+0000","last_became_peered":"2024-09-17T03:41:58.791387+0000","last_unstale":"2024-09-17T03:41:58.795355+0000","last_undegraded":"2024-09-17T03:41:58.795355+0000","last_fullsized":"2024-09-17T03:41:58.795355+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:27.988090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798954+0000","last_change":"2024-09-17T03:41:57.776058+0000","last_active":"2024-09-17T03:41:58.798954+0000","last_peered":"2024-09-17T03:41:58.798954+0000","last_clean":"2024-09-17T03:41:58.798954+0000","last_became_active":"2024-09-17T03:41:57.775726+0000","last_became_peered":"2024-09-17T03:41:57.775726+0000","last_unstale":"2024-09-17T03:41:58.798954+0000","last_undegraded":"2024-09-17T03:41:58.798954+0000","last_fullsized":"2024-09-17T03:41:58.798954+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:35.559498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398033+0000","last_change":"2024-09-17T03:41:58.787984+0000","last_active":"2024-09-17T03:42:00.398033+0000","last_peered":"2024-09-17T03:42:00.398033+0000","last_clean":"2024-09-17T03:42:00.398033+0000","last_became_active":"2024-09-17T03:41:58.787654+0000","last_became_peered":"2024-09-17T03:41:58.787654+0000","last_unstale":"2024-09-17T03:42:00.398033+0000","last_undegraded":"2024-09-17T03:42:00.398033+0000","last_fullsized":"2024-09-17T03:42:00.398033+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:17.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769712+0000","last_change":"2024-09-17T03:41:57.787376+0000","last_active":"2024-09-17T03:41:58.769712+0000","last_peered":"2024-09-17T03:41:58.769712+0000","last_clean":"2024-09-17T03:41:58.769712+0000","last_became_active":"2024-09-17T03:41:57.787036+0000","last_became_peered":"2024-09-17T03:41:57.787036+0000","last_unstale":"2024-09-17T03:41:58.769712+0000","last_undegraded":"2024-09-17T03:41:58.769712+0000","last_fullsized":"2024-09-17T03:41:58.769712+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:07.925487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398464+0000","last_change":"2024-09-17T03:41:58.790303+0000","last_active":"2024-09-17T03:42:00.398464+0000","last_peered":"2024-09-17T03:42:00.398464+0000","last_clean":"2024-09-17T03:42:00.398464+0000","last_became_active":"2024-09-17T03:41:58.789996+0000","last_became_peered":"2024-09-17T03:41:58.789996+0000","last_unstale":"2024-09-17T03:42:00.398464+0000","last_undegraded":"2024-09-17T03:42:00.398464+0000","last_fullsized":"2024-09-17T03:42:00.398464+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:28.497518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.774207+0000","last_change":"2024-09-17T03:41:57.777414+0000","last_active":"2024-09-17T03:41:58.774207+0000","last_peered":"2024-09-17T03:41:58.774207+0000","last_clean":"2024-09-17T03:41:58.774207+0000","last_became_active":"2024-09-17T03:41:57.777105+0000","last_became_peered":"2024-09-17T03:41:57.777105+0000","last_unstale":"2024-09-17T03:41:58.774207+0000","last_undegraded":"2024-09-17T03:41:58.774207+0000","last_fullsized":"2024-09-17T03:41:58.774207+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:02.185593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.779969+0000","last_change":"2024-09-17T03:41:58.778450+0000","last_active":"2024-09-17T03:41:58.779969+0000","last_peered":"2024-09-17T03:41:58.779969+0000","last_clean":"2024-09-17T03:41:58.779969+0000","last_became_active":"2024-09-17T03:41:58.778161+0000","last_became_peered":"2024-09-17T03:41:58.778161+0000","last_unstale":"2024-09-17T03:41:58.779969+0000","last_undegraded":"2024-09-17T03:41:58.779969+0000","last_fullsized":"2024-09-17T03:41:58.779969+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:09.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"142'8","reported_seq":21,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800571+0000","last_change":"2024-09-17T03:41:57.781387+0000","last_active":"2024-09-17T03:41:58.800571+0000","last_peered":"2024-09-17T03:41:58.800571+0000","last_clean":"2024-09-17T03:41:58.800571+0000","last_became_active":"2024-09-17T03:41:57.781040+0000","last_became_peered":"2024-09-17T03:41:57.781040+0000","last_unstale":"2024-09-17T03:41:58.800571+0000","last_undegraded":"2024-09-17T03:41:58.800571+0000","last_fullsized":"2024-09-17T03:41:58.800571+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:01.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789125+0000","last_change":"2024-09-17T03:41:58.785556+0000","last_active":"2024-09-17T03:41:58.789125+0000","last_peered":"2024-09-17T03:41:58.789125+0000","last_clean":"2024-09-17T03:41:58.789125+0000","last_became_active":"2024-09-17T03:41:58.785245+0000","last_became_peered":"2024-09-17T03:41:58.785245+0000","last_unstale":"2024-09-17T03:41:58.789125+0000","last_undegraded":"2024-09-17T03:41:58.789125+0000","last_fullsized":"2024-09-17T03:41:58.789125+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:09.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"142'1","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398683+0000","last_change":"2024-09-17T03:41:57.789338+0000","last_active":"2024-09-17T03:42:00.398683+0000","last_peered":"2024-09-17T03:42:00.398683+0000","last_clean":"2024-09-17T03:42:00.398683+0000","last_became_active":"2024-09-17T03:41:57.788925+0000","last_became_peered":"2024-09-17T03:41:57.788925+0000","last_unstale":"2024-09-17T03:42:00.398683+0000","last_undegraded":"2024-09-17T03:42:00.398683+0000","last_fullsized":"2024-09-17T03:42:00.398683+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:32.798364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.784457+0000","last_change":"2024-09-17T03:41:58.779968+0000","last_active":"2024-09-17T03:41:58.784457+0000","last_peered":"2024-09-17T03:41:58.784457+0000","last_clean":"2024-09-17T03:41:58.784457+0000","last_became_active":"2024-09-17T03:41:58.779689+0000","last_became_peered":"2024-09-17T03:41:58.779689+0000","last_unstale":"2024-09-17T03:41:58.784457+0000","last_undegraded":"2024-09-17T03:41:58.784457+0000","last_fullsized":"2024-09-17T03:41:58.784457+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:10.869543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"142'2","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398138+0000","last_change":"2024-09-17T03:41:57.780967+0000","last_active":"2024-09-17T03:42:00.398138+0000","last_peered":"2024-09-17T03:42:00.398138+0000","last_clean":"2024-09-17T03:42:00.398138+0000","last_became_active":"2024-09-17T03:41:57.780670+0000","last_became_peered":"2024-09-17T03:41:57.780670+0000","last_unstale":"2024-09-17T03:42:00.398138+0000","last_undegraded":"2024-09-17T03:42:00.398138+0000","last_fullsized":"2024-09-17T03:42:00.398138+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:59.401059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.793187+0000","last_change":"2024-09-17T03:41:58.790968+0000","last_active":"2024-09-17T03:41:58.793187+0000","last_peered":"2024-09-17T03:41:58.793187+0000","last_clean":"2024-09-17T03:41:58.793187+0000","last_became_active":"2024-09-17T03:41:58.790345+0000","last_became_peered":"2024-09-17T03:41:58.790345+0000","last_unstale":"2024-09-17T03:41:58.793187+0000","last_undegraded":"2024-09-17T03:41:58.793187+0000","last_fullsized":"2024-09-17T03:41:58.793187+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:50.226386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"142'1","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798308+0000","last_change":"2024-09-17T03:41:57.782205+0000","last_active":"2024-09-17T03:41:58.798308+0000","last_peered":"2024-09-17T03:41:58.798308+0000","last_clean":"2024-09-17T03:41:58.798308+0000","last_became_active":"2024-09-17T03:41:57.781549+0000","last_became_peered":"2024-09-17T03:41:57.781549+0000","last_unstale":"2024-09-17T03:41:58.798308+0000","last_undegraded":"2024-09-17T03:41:58.798308+0000","last_fullsized":"2024-09-17T03:41:58.798308+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:14.375766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.786243+0000","last_change":"2024-09-17T03:41:58.782158+0000","last_active":"2024-09-17T03:41:58.786243+0000","last_peered":"2024-09-17T03:41:58.786243+0000","last_clean":"2024-09-17T03:41:58.786243+0000","last_became_active":"2024-09-17T03:41:58.781872+0000","last_became_peered":"2024-09-17T03:41:58.781872+0000","last_unstale":"2024-09-17T03:41:58.786243+0000","last_undegraded":"2024-09-17T03:41:58.786243+0000","last_fullsized":"2024-09-17T03:41:58.786243+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:52.198315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.397914+0000","last_change":"2024-09-17T03:41:57.779963+0000","last_active":"2024-09-17T03:42:00.397914+0000","last_peered":"2024-09-17T03:42:00.397914+0000","last_clean":"2024-09-17T03:42:00.397914+0000","last_became_active":"2024-09-17T03:41:57.779639+0000","last_became_peered":"2024-09-17T03:41:57.779639+0000","last_unstale":"2024-09-17T03:42:00.397914+0000","last_undegraded":"2024-09-17T03:42:00.397914+0000","last_fullsized":"2024-09-17T03:42:00.397914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:59.092236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794769+0000","last_change":"2024-09-17T03:41:58.788349+0000","last_active":"2024-09-17T03:41:58.794769+0000","last_peered":"2024-09-17T03:41:58.794769+0000","last_clean":"2024-09-17T03:41:58.794769+0000","last_became_active":"2024-09-17T03:41:58.788032+0000","last_became_peered":"2024-09-17T03:41:58.788032+0000","last_unstale":"2024-09-17T03:41:58.794769+0000","last_undegraded":"2024-09-17T03:41:58.794769+0000","last_fullsized":"2024-09-17T03:41:58.794769+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:38.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798397+0000","last_change":"2024-09-17T03:41:57.776487+0000","last_active":"2024-09-17T03:41:58.798397+0000","last_peered":"2024-09-17T03:41:58.798397+0000","last_clean":"2024-09-17T03:41:58.798397+0000","last_became_active":"2024-09-17T03:41:57.776096+0000","last_became_peered":"2024-09-17T03:41:57.776096+0000","last_unstale":"2024-09-17T03:41:58.798397+0000","last_undegraded":"2024-09-17T03:41:58.798397+0000","last_fullsized":"2024-09-17T03:41:58.798397+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:15.191990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798487+0000","last_change":"2024-09-17T03:41:58.797168+0000","last_active":"2024-09-17T03:41:58.798487+0000","last_peered":"2024-09-17T03:41:58.798487+0000","last_clean":"2024-09-17T03:41:58.798487+0000","last_became_active":"2024-09-17T03:41:58.796622+0000","last_became_peered":"2024-09-17T03:41:58.796622+0000","last_unstale":"2024-09-17T03:41:58.798487+0000","last_undegraded":"2024-09-17T03:41:58.798487+0000","last_fullsized":"2024-09-17T03:41:58.798487+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:12.189579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769800+0000","last_change":"2024-09-17T03:41:57.778245+0000","last_active":"2024-09-17T03:41:58.769800+0000","last_peered":"2024-09-17T03:41:58.769800+0000","last_clean":"2024-09-17T03:41:58.769800+0000","last_became_active":"2024-09-17T03:41:57.777803+0000","last_became_peered":"2024-09-17T03:41:57.777803+0000","last_unstale":"2024-09-17T03:41:58.769800+0000","last_undegraded":"2024-09-17T03:41:58.769800+0000","last_fullsized":"2024-09-17T03:41:58.769800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:05.305842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.794707+0000","last_change":"2024-09-17T03:41:58.791751+0000","last_active":"2024-09-17T03:41:58.794707+0000","last_peered":"2024-09-17T03:41:58.794707+0000","last_clean":"2024-09-17T03:41:58.794707+0000","last_became_active":"2024-09-17T03:41:58.791471+0000","last_became_peered":"2024-09-17T03:41:58.791471+0000","last_unstale":"2024-09-17T03:41:58.794707+0000","last_undegraded":"2024-09-17T03:41:58.794707+0000","last_fullsized":"2024-09-17T03:41:58.794707+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:47.947416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.771095+0000","last_change":"2024-09-17T03:41:57.783936+0000","last_active":"2024-09-17T03:41:58.771095+0000","last_peered":"2024-09-17T03:41:58.771095+0000","last_clean":"2024-09-17T03:41:58.771095+0000","last_became_active":"2024-09-17T03:41:57.783328+0000","last_became_peered":"2024-09-17T03:41:57.783328+0000","last_unstale":"2024-09-17T03:41:58.771095+0000","last_undegraded":"2024-09-17T03:41:58.771095+0000","last_fullsized":"2024-09-17T03:41:58.771095+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:27.468632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798358+0000","last_change":"2024-09-17T03:41:58.796724+0000","last_active":"2024-09-17T03:41:58.798358+0000","last_peered":"2024-09-17T03:41:58.798358+0000","last_clean":"2024-09-17T03:41:58.798358+0000","last_became_active":"2024-09-17T03:41:58.796412+0000","last_became_peered":"2024-09-17T03:41:58.796412+0000","last_unstale":"2024-09-17T03:41:58.798358+0000","last_undegraded":"2024-09-17T03:41:58.798358+0000","last_fullsized":"2024-09-17T03:41:58.798358+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:27.063583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.771463+0000","last_change":"2024-09-17T03:41:57.781280+0000","last_active":"2024-09-17T03:41:58.771463+0000","last_peered":"2024-09-17T03:41:58.771463+0000","last_clean":"2024-09-17T03:41:58.771463+0000","last_became_active":"2024-09-17T03:41:57.780910+0000","last_became_peered":"2024-09-17T03:41:57.780910+0000","last_unstale":"2024-09-17T03:41:58.771463+0000","last_undegraded":"2024-09-17T03:41:58.771463+0000","last_fullsized":"2024-09-17T03:41:58.771463+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:01.006744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398912+0000","last_change":"2024-09-17T03:41:58.783037+0000","last_active":"2024-09-17T03:42:00.398912+0000","last_peered":"2024-09-17T03:42:00.398912+0000","last_clean":"2024-09-17T03:42:00.398912+0000","last_became_active":"2024-09-17T03:41:58.782732+0000","last_became_peered":"2024-09-17T03:41:58.782732+0000","last_unstale":"2024-09-17T03:42:00.398912+0000","last_undegraded":"2024-09-17T03:42:00.398912+0000","last_fullsized":"2024-09-17T03:42:00.398912+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:14.751177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"142'2","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.800372+0000","last_change":"2024-09-17T03:41:57.783360+0000","last_active":"2024-09-17T03:41:58.800372+0000","last_peered":"2024-09-17T03:41:58.800372+0000","last_clean":"2024-09-17T03:41:58.800372+0000","last_became_active":"2024-09-17T03:41:57.783016+0000","last_became_peered":"2024-09-17T03:41:57.783016+0000","last_unstale":"2024-09-17T03:41:58.800372+0000","last_undegraded":"2024-09-17T03:41:58.800372+0000","last_fullsized":"2024-09-17T03:41:58.800372+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:57.921906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.781646+0000","last_change":"2024-09-17T03:41:58.779367+0000","last_active":"2024-09-17T03:41:58.781646+0000","last_peered":"2024-09-17T03:41:58.781646+0000","last_clean":"2024-09-17T03:41:58.781646+0000","last_became_active":"2024-09-17T03:41:58.779044+0000","last_became_peered":"2024-09-17T03:41:58.779044+0000","last_unstale":"2024-09-17T03:41:58.781646+0000","last_undegraded":"2024-09-17T03:41:58.781646+0000","last_fullsized":"2024-09-17T03:41:58.781646+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:59.168673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776049+0000","last_change":"2024-09-17T03:41:57.780031+0000","last_active":"2024-09-17T03:41:58.776049+0000","last_peered":"2024-09-17T03:41:58.776049+0000","last_clean":"2024-09-17T03:41:58.776049+0000","last_became_active":"2024-09-17T03:41:57.779710+0000","last_became_peered":"2024-09-17T03:41:57.779710+0000","last_unstale":"2024-09-17T03:41:58.776049+0000","last_undegraded":"2024-09-17T03:41:58.776049+0000","last_fullsized":"2024-09-17T03:41:58.776049+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:56.392154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398035+0000","last_change":"2024-09-17T03:41:58.784307+0000","last_active":"2024-09-17T03:42:00.398035+0000","last_peered":"2024-09-17T03:42:00.398035+0000","last_clean":"2024-09-17T03:42:00.398035+0000","last_became_active":"2024-09-17T03:41:58.784018+0000","last_became_peered":"2024-09-17T03:41:58.784018+0000","last_unstale":"2024-09-17T03:42:00.398035+0000","last_undegraded":"2024-09-17T03:42:00.398035+0000","last_fullsized":"2024-09-17T03:42:00.398035+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:33.312518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.777493+0000","last_change":"2024-09-17T03:41:57.782553+0000","last_active":"2024-09-17T03:41:58.777493+0000","last_peered":"2024-09-17T03:41:58.777493+0000","last_clean":"2024-09-17T03:41:58.777493+0000","last_became_active":"2024-09-17T03:41:57.782195+0000","last_became_peered":"2024-09-17T03:41:57.782195+0000","last_unstale":"2024-09-17T03:41:58.777493+0000","last_undegraded":"2024-09-17T03:41:58.777493+0000","last_fullsized":"2024-09-17T03:41:58.777493+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.986071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.790757+0000","last_change":"2024-09-17T03:41:58.786028+0000","last_active":"2024-09-17T03:41:58.790757+0000","last_peered":"2024-09-17T03:41:58.790757+0000","last_clean":"2024-09-17T03:41:58.790757+0000","last_became_active":"2024-09-17T03:41:58.785761+0000","last_became_peered":"2024-09-17T03:41:58.785761+0000","last_unstale":"2024-09-17T03:41:58.790757+0000","last_undegraded":"2024-09-17T03:41:58.790757+0000","last_fullsized":"2024-09-17T03:41:58.790757+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:47.216999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.776326+0000","last_change":"2024-09-17T03:41:57.782886+0000","last_active":"2024-09-17T03:41:58.776326+0000","last_peered":"2024-09-17T03:41:58.776326+0000","last_clean":"2024-09-17T03:41:58.776326+0000","last_became_active":"2024-09-17T03:41:57.782391+0000","last_became_peered":"2024-09-17T03:41:57.782391+0000","last_unstale":"2024-09-17T03:41:58.776326+0000","last_undegraded":"2024-09-17T03:41:58.776326+0000","last_fullsized":"2024-09-17T03:41:58.776326+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:13.802117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.795960+0000","last_change":"2024-09-17T03:41:58.794134+0000","last_active":"2024-09-17T03:41:58.795960+0000","last_peered":"2024-09-17T03:41:58.795960+0000","last_clean":"2024-09-17T03:41:58.795960+0000","last_became_active":"2024-09-17T03:41:58.793808+0000","last_became_peered":"2024-09-17T03:41:58.793808+0000","last_unstale":"2024-09-17T03:41:58.795960+0000","last_undegraded":"2024-09-17T03:41:58.795960+0000","last_fullsized":"2024-09-17T03:41:58.795960+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:31.999015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.778574+0000","last_change":"2024-09-17T03:41:57.785169+0000","last_active":"2024-09-17T03:41:58.778574+0000","last_peered":"2024-09-17T03:41:58.778574+0000","last_clean":"2024-09-17T03:41:58.778574+0000","last_became_active":"2024-09-17T03:41:57.784823+0000","last_became_peered":"2024-09-17T03:41:57.784823+0000","last_unstale":"2024-09-17T03:41:58.778574+0000","last_undegraded":"2024-09-17T03:41:58.778574+0000","last_fullsized":"2024-09-17T03:41:58.778574+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:57.518613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398791+0000","last_change":"2024-09-17T03:41:58.790737+0000","last_active":"2024-09-17T03:42:00.398791+0000","last_peered":"2024-09-17T03:42:00.398791+0000","last_clean":"2024-09-17T03:42:00.398791+0000","last_became_active":"2024-09-17T03:41:58.790111+0000","last_became_peered":"2024-09-17T03:41:58.790111+0000","last_unstale":"2024-09-17T03:42:00.398791+0000","last_undegraded":"2024-09-17T03:42:00.398791+0000","last_fullsized":"2024-09-17T03:42:00.398791+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:50.954109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.770051+0000","last_change":"2024-09-17T03:41:57.783095+0000","last_active":"2024-09-17T03:41:58.770051+0000","last_peered":"2024-09-17T03:41:58.770051+0000","last_clean":"2024-09-17T03:41:58.770051+0000","last_became_active":"2024-09-17T03:41:57.782778+0000","last_became_peered":"2024-09-17T03:41:57.782778+0000","last_unstale":"2024-09-17T03:41:58.770051+0000","last_undegraded":"2024-09-17T03:41:58.770051+0000","last_fullsized":"2024-09-17T03:41:58.770051+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:42.526729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.789255+0000","last_change":"2024-09-17T03:41:58.784537+0000","last_active":"2024-09-17T03:41:58.789255+0000","last_peered":"2024-09-17T03:41:58.789255+0000","last_clean":"2024-09-17T03:41:58.789255+0000","last_became_active":"2024-09-17T03:41:58.784218+0000","last_became_peered":"2024-09-17T03:41:58.784218+0000","last_unstale":"2024-09-17T03:41:58.789255+0000","last_undegraded":"2024-09-17T03:41:58.789255+0000","last_fullsized":"2024-09-17T03:41:58.789255+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:16.246738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.770135+0000","last_change":"2024-09-17T03:41:57.776527+0000","last_active":"2024-09-17T03:41:58.770135+0000","last_peered":"2024-09-17T03:41:58.770135+0000","last_clean":"2024-09-17T03:41:58.770135+0000","last_became_active":"2024-09-17T03:41:57.776202+0000","last_became_peered":"2024-09-17T03:41:57.776202+0000","last_unstale":"2024-09-17T03:41:58.770135+0000","last_undegraded":"2024-09-17T03:41:58.770135+0000","last_fullsized":"2024-09-17T03:41:58.770135+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:53.119624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398420+0000","last_change":"2024-09-17T03:41:58.786519+0000","last_active":"2024-09-17T03:42:00.398420+0000","last_peered":"2024-09-17T03:42:00.398420+0000","last_clean":"2024-09-17T03:42:00.398420+0000","last_became_active":"2024-09-17T03:41:58.786196+0000","last_became_peered":"2024-09-17T03:41:58.786196+0000","last_unstale":"2024-09-17T03:42:00.398420+0000","last_undegraded":"2024-09-17T03:42:00.398420+0000","last_fullsized":"2024-09-17T03:42:00.398420+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:21.542100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.397692+0000","last_change":"2024-09-17T03:41:57.780073+0000","last_active":"2024-09-17T03:42:00.397692+0000","last_peered":"2024-09-17T03:42:00.397692+0000","last_clean":"2024-09-17T03:42:00.397692+0000","last_became_active":"2024-09-17T03:41:57.779735+0000","last_became_peered":"2024-09-17T03:41:57.779735+0000","last_unstale":"2024-09-17T03:42:00.397692+0000","last_undegraded":"2024-09-17T03:42:00.397692+0000","last_fullsized":"2024-09-17T03:42:00.397692+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:31.224227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798396+0000","last_change":"2024-09-17T03:41:58.797467+0000","last_active":"2024-09-17T03:41:58.798396+0000","last_peered":"2024-09-17T03:41:58.798396+0000","last_clean":"2024-09-17T03:41:58.798396+0000","last_became_active":"2024-09-17T03:41:58.797143+0000","last_became_peered":"2024-09-17T03:41:58.797143+0000","last_unstale":"2024-09-17T03:41:58.798396+0000","last_undegraded":"2024-09-17T03:41:58.798396+0000","last_fullsized":"2024-09-17T03:41:58.798396+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:16.835504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"142'3","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.798176+0000","last_change":"2024-09-17T03:41:57.777388+0000","last_active":"2024-09-17T03:41:58.798176+0000","last_peered":"2024-09-17T03:41:58.798176+0000","last_clean":"2024-09-17T03:41:58.798176+0000","last_became_active":"2024-09-17T03:41:57.777035+0000","last_became_peered":"2024-09-17T03:41:57.777035+0000","last_unstale":"2024-09-17T03:41:58.798176+0000","last_undegraded":"2024-09-17T03:41:58.798176+0000","last_fullsized":"2024-09-17T03:41:58.798176+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.381560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":333,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-17T03:41:58.769029+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:41:58.769029+0000","last_peered":"2024-09-17T03:41:58.769029+0000","last_clean":"2024-09-17T03:41:58.769029+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:41:58.769029+0000","last_undegraded":"2024-09-17T03:41:58.769029+0000","last_fullsized":"2024-09-17T03:41:58.769029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51560,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320280,"statfs":{"total":96636764160,"available":96583966720,"internally_reserved":0,"allocated":2371584,"data_stored":1367342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509554,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1781760,"data_stored":776468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509554,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55132,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316708,"statfs":{"total":96636764160,"available":96580308992,"internally_reserved":0,"allocated":1769472,"data_stored":776322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":778004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55128,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316712,"statfs":{"total":96636764160,"available":96580313088,"internally_reserved":0,"allocated":1773568,"data_stored":776904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509555,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51568,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320272,"statfs":{"total":96636764160,"available":96583958528,"internally_reserved":0,"allocated":2379776,"data_stored":1368336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":782644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574962,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":782712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:42:04.751 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-09-17T03:42:04.752+0000 7f0ed8390640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:42:07.244 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:42:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.372+0000 7f317c9ad640 1 -- 172.21.15.146:0/1187111663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780b5ce0 msgr2=0x7f31780b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.372+0000 7f317c9ad640 1 --2- 172.21.15.146:0/1187111663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780b5ce0 0x7f31780b1320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3168009830 tx=0x7f316802a5c0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.373+0000 7f317c9ad640 1 -- 172.21.15.146:0/1187111663 shutdown_connections 2024-09-17T03:42:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.373+0000 7f317c9ad640 1 --2- 172.21.15.146:0/1187111663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780b5ce0 0x7f31780b1320 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.373+0000 7f317c9ad640 1 -- 172.21.15.146:0/1187111663 >> 172.21.15.146:0/1187111663 conn(0x7f31780b7b20 msgr2=0x7f317809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.373+0000 7f317c9ad640 1 -- 172.21.15.146:0/1187111663 shutdown_connections 2024-09-17T03:42:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.373+0000 7f317c9ad640 1 -- 172.21.15.146:0/1187111663 wait complete. 2024-09-17T03:42:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.375+0000 7f317c9ad640 1 Processor -- start 2024-09-17T03:42:07.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.375+0000 7f317c9ad640 1 -- start start 2024-09-17T03:42:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f317c9ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780b5750 0x7f3178144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f317c9ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31780b5ce0 0x7f31781e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f317c9ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f317815b680 0x7f317815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f317c9ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f317815d680 con 0x7f31780b5ce0 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f317c9ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f317815d500 con 0x7f31780b5750 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f317c9ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f317815d800 con 0x7f317815b680 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f3175d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31780b5ce0 0x7f31781e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f3175d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31780b5ce0 0x7f31781e7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52010/0 (socket says 172.21.15.146:52010) 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f3175d9b640 1 -- 172.21.15.146:0/2343733727 learned_addr learned my addr 172.21.15.146:0/2343733727 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f3176d9d640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f317815b680 0x7f317815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f317659c640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780b5750 0x7f3178144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f3175d9b640 1 -- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f317815b680 msgr2=0x7f317815ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f3175d9b640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f317815b680 0x7f317815ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f3175d9b640 1 -- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780b5750 msgr2=0x7f3178144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f3175d9b640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780b5750 0x7f3178144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.376+0000 7f3175d9b640 1 -- 172.21.15.146:0/2343733727 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31781503d0 con 0x7f31780b5ce0 2024-09-17T03:42:07.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.377+0000 7f3175d9b640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31780b5ce0 0x7f31781e7320 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f316000cbd0 tx=0x7f316000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:07.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.377+0000 7f316effd640 1 -- 172.21.15.146:0/2343733727 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160016020 con 0x7f31780b5ce0 2024-09-17T03:42:07.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.377+0000 7f316effd640 1 -- 172.21.15.146:0/2343733727 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f316000ad60 con 0x7f31780b5ce0 2024-09-17T03:42:07.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.377+0000 7f317c9ad640 1 -- 172.21.15.146:0/2343733727 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317815bfd0 con 0x7f31780b5ce0 2024-09-17T03:42:07.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.377+0000 7f316effd640 1 -- 172.21.15.146:0/2343733727 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160012680 con 0x7f31780b5ce0 2024-09-17T03:42:07.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.377+0000 7f317c9ad640 1 -- 172.21.15.146:0/2343733727 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31781f7310 con 0x7f31780b5ce0 2024-09-17T03:42:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.378+0000 7f317c9ad640 1 -- 172.21.15.146:0/2343733727 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31780b2fd0 con 0x7f31780b5ce0 2024-09-17T03:42:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.379+0000 7f316effd640 1 -- 172.21.15.146:0/2343733727 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3160019020 con 0x7f31780b5ce0 2024-09-17T03:42:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.379+0000 7f316effd640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3158078b90 0x7f315807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.379+0000 7f316effd640 1 -- 172.21.15.146:0/2343733727 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f316009b410 con 0x7f31780b5ce0 2024-09-17T03:42:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.379+0000 7f317659c640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3158078b90 0x7f315807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.380+0000 7f317659c640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3158078b90 0x7f315807b0a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3168034000 tx=0x7f3168004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:07.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.384+0000 7f316effd640 1 -- 172.21.15.146:0/2343733727 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f31780b2fd0 con 0x7f31780b5ce0 2024-09-17T03:42:07.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.557+0000 7f317c9ad640 1 -- 172.21.15.146:0/2343733727 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31781e7c90 con 0x7f3158078b90 2024-09-17T03:42:07.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.562+0000 7f316effd640 1 -- 172.21.15.146:0/2343733727 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252413 (secure 0 0 0) 0x7f31781e7c90 con 0x7f3158078b90 2024-09-17T03:42:07.563 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:07.565 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:42:07.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.565+0000 7f317c9ad640 1 -- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3158078b90 msgr2=0x7f315807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:07.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.565+0000 7f317c9ad640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3158078b90 0x7f315807b0a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3168034000 tx=0x7f3168004730 comp rx=0 tx=0).stop 2024-09-17T03:42:07.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.565+0000 7f317c9ad640 1 -- 172.21.15.146:0/2343733727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31780b5ce0 msgr2=0x7f31781e7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:07.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.565+0000 7f317c9ad640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31780b5ce0 0x7f31781e7320 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f316000cbd0 tx=0x7f316000a060 comp rx=0 tx=0).stop 2024-09-17T03:42:07.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.565+0000 7f317c9ad640 1 -- 172.21.15.146:0/2343733727 shutdown_connections 2024-09-17T03:42:07.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.566+0000 7f317c9ad640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3158078b90 0x7f315807b0a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.566+0000 7f317c9ad640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f317815b680 0x7f317815ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.566+0000 7f317c9ad640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31780b5ce0 0x7f31781e7320 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.566+0000 7f317c9ad640 1 --2- 172.21.15.146:0/2343733727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31780b5750 0x7f3178144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.566+0000 7f317c9ad640 1 -- 172.21.15.146:0/2343733727 >> 172.21.15.146:0/2343733727 conn(0x7f31780b7b20 msgr2=0x7f3178150940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:07.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.566+0000 7f317c9ad640 1 -- 172.21.15.146:0/2343733727 shutdown_connections 2024-09-17T03:42:07.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.566+0000 7f317c9ad640 1 -- 172.21.15.146:0/2343733727 wait complete. 2024-09-17T03:42:07.576 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":416,"stamp":"2024-09-17T03:42:05.935924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":421520,"kb_used_data":15144,"kb_used_omap":12,"kb_used_meta":406195,"kb_avail":754553200,"statfs":{"total":773094113280,"available":772662476800,"internally_reserved":0,"allocated":15507456,"data_stored":7446532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":415944241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001954"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.785939+0000","last_change":"2024-09-17T03:41:58.783510+0000","last_active":"2024-09-17T03:41:59.785939+0000","last_peered":"2024-09-17T03:41:59.785939+0000","last_clean":"2024-09-17T03:41:59.785939+0000","last_became_active":"2024-09-17T03:41:58.782625+0000","last_became_peered":"2024-09-17T03:41:58.782625+0000","last_unstale":"2024-09-17T03:41:59.785939+0000","last_undegraded":"2024-09-17T03:41:59.785939+0000","last_fullsized":"2024-09-17T03:41:59.785939+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:15.404369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398169+0000","last_change":"2024-09-17T03:41:58.788134+0000","last_active":"2024-09-17T03:42:00.398169+0000","last_peered":"2024-09-17T03:42:00.398169+0000","last_clean":"2024-09-17T03:42:00.398169+0000","last_became_active":"2024-09-17T03:41:58.787479+0000","last_became_peered":"2024-09-17T03:41:58.787479+0000","last_unstale":"2024-09-17T03:42:00.398169+0000","last_undegraded":"2024-09-17T03:42:00.398169+0000","last_fullsized":"2024-09-17T03:42:00.398169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:35.963326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.772033+0000","last_change":"2024-09-17T03:41:58.773210+0000","last_active":"2024-09-17T03:41:59.772033+0000","last_peered":"2024-09-17T03:41:59.772033+0000","last_clean":"2024-09-17T03:41:59.772033+0000","last_became_active":"2024-09-17T03:41:58.771709+0000","last_became_peered":"2024-09-17T03:41:58.771709+0000","last_unstale":"2024-09-17T03:41:59.772033+0000","last_undegraded":"2024-09-17T03:41:59.772033+0000","last_fullsized":"2024-09-17T03:41:59.772033+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:18.995733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.771492+0000","last_change":"2024-09-17T03:41:58.784113+0000","last_active":"2024-09-17T03:41:59.771492+0000","last_peered":"2024-09-17T03:41:59.771492+0000","last_clean":"2024-09-17T03:41:59.771492+0000","last_became_active":"2024-09-17T03:41:58.783674+0000","last_became_peered":"2024-09-17T03:41:58.783674+0000","last_unstale":"2024-09-17T03:41:59.771492+0000","last_undegraded":"2024-09-17T03:41:59.771492+0000","last_fullsized":"2024-09-17T03:41:59.771492+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:57.353908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398509+0000","last_change":"2024-09-17T03:41:58.790442+0000","last_active":"2024-09-17T03:42:00.398509+0000","last_peered":"2024-09-17T03:42:00.398509+0000","last_clean":"2024-09-17T03:42:00.398509+0000","last_became_active":"2024-09-17T03:41:58.789337+0000","last_became_peered":"2024-09-17T03:41:58.789337+0000","last_unstale":"2024-09-17T03:42:00.398509+0000","last_undegraded":"2024-09-17T03:42:00.398509+0000","last_fullsized":"2024-09-17T03:42:00.398509+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:15.170911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.785709+0000","last_change":"2024-09-17T03:41:58.781216+0000","last_active":"2024-09-17T03:41:59.785709+0000","last_peered":"2024-09-17T03:41:59.785709+0000","last_clean":"2024-09-17T03:41:59.785709+0000","last_became_active":"2024-09-17T03:41:58.780931+0000","last_became_peered":"2024-09-17T03:41:58.780931+0000","last_unstale":"2024-09-17T03:41:59.785709+0000","last_undegraded":"2024-09-17T03:41:59.785709+0000","last_fullsized":"2024-09-17T03:41:59.785709+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:37.074706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.769591+0000","last_change":"2024-09-17T03:41:58.795953+0000","last_active":"2024-09-17T03:41:59.769591+0000","last_peered":"2024-09-17T03:41:59.769591+0000","last_clean":"2024-09-17T03:41:59.769591+0000","last_became_active":"2024-09-17T03:41:58.795588+0000","last_became_peered":"2024-09-17T03:41:58.795588+0000","last_unstale":"2024-09-17T03:41:59.769591+0000","last_undegraded":"2024-09-17T03:41:59.769591+0000","last_fullsized":"2024-09-17T03:41:59.769591+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:34.904922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.785546+0000","last_change":"2024-09-17T03:41:58.793259+0000","last_active":"2024-09-17T03:41:59.785546+0000","last_peered":"2024-09-17T03:41:59.785546+0000","last_clean":"2024-09-17T03:41:59.785546+0000","last_became_active":"2024-09-17T03:41:58.792967+0000","last_became_peered":"2024-09-17T03:41:58.792967+0000","last_unstale":"2024-09-17T03:41:59.785546+0000","last_undegraded":"2024-09-17T03:41:59.785546+0000","last_fullsized":"2024-09-17T03:41:59.785546+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:03.497115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398191+0000","last_change":"2024-09-17T03:41:58.783235+0000","last_active":"2024-09-17T03:42:00.398191+0000","last_peered":"2024-09-17T03:42:00.398191+0000","last_clean":"2024-09-17T03:42:00.398191+0000","last_became_active":"2024-09-17T03:41:58.782954+0000","last_became_peered":"2024-09-17T03:41:58.782954+0000","last_unstale":"2024-09-17T03:42:00.398191+0000","last_undegraded":"2024-09-17T03:42:00.398191+0000","last_fullsized":"2024-09-17T03:42:00.398191+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:15.944827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788339+0000","last_change":"2024-09-17T03:41:58.786406+0000","last_active":"2024-09-17T03:41:59.788339+0000","last_peered":"2024-09-17T03:41:59.788339+0000","last_clean":"2024-09-17T03:41:59.788339+0000","last_became_active":"2024-09-17T03:41:58.785804+0000","last_became_peered":"2024-09-17T03:41:58.785804+0000","last_unstale":"2024-09-17T03:41:59.788339+0000","last_undegraded":"2024-09-17T03:41:59.788339+0000","last_fullsized":"2024-09-17T03:41:59.788339+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:08.907904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.785758+0000","last_change":"2024-09-17T03:41:58.792926+0000","last_active":"2024-09-17T03:41:59.785758+0000","last_peered":"2024-09-17T03:41:59.785758+0000","last_clean":"2024-09-17T03:41:59.785758+0000","last_became_active":"2024-09-17T03:41:58.792624+0000","last_became_peered":"2024-09-17T03:41:58.792624+0000","last_unstale":"2024-09-17T03:41:59.785758+0000","last_undegraded":"2024-09-17T03:41:59.785758+0000","last_fullsized":"2024-09-17T03:41:59.785758+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:37.388549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788447+0000","last_change":"2024-09-17T03:41:58.787698+0000","last_active":"2024-09-17T03:41:59.788447+0000","last_peered":"2024-09-17T03:41:59.788447+0000","last_clean":"2024-09-17T03:41:59.788447+0000","last_became_active":"2024-09-17T03:41:58.787391+0000","last_became_peered":"2024-09-17T03:41:58.787391+0000","last_unstale":"2024-09-17T03:41:59.788447+0000","last_undegraded":"2024-09-17T03:41:59.788447+0000","last_fullsized":"2024-09-17T03:41:59.788447+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:20.048806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398624+0000","last_change":"2024-09-17T03:41:58.789654+0000","last_active":"2024-09-17T03:42:00.398624+0000","last_peered":"2024-09-17T03:42:00.398624+0000","last_clean":"2024-09-17T03:42:00.398624+0000","last_became_active":"2024-09-17T03:41:58.788573+0000","last_became_peered":"2024-09-17T03:41:58.788573+0000","last_unstale":"2024-09-17T03:42:00.398624+0000","last_undegraded":"2024-09-17T03:42:00.398624+0000","last_fullsized":"2024-09-17T03:42:00.398624+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:51.987496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.771897+0000","last_change":"2024-09-17T03:41:58.792904+0000","last_active":"2024-09-17T03:41:59.771897+0000","last_peered":"2024-09-17T03:41:59.771897+0000","last_clean":"2024-09-17T03:41:59.771897+0000","last_became_active":"2024-09-17T03:41:58.792587+0000","last_became_peered":"2024-09-17T03:41:58.792587+0000","last_unstale":"2024-09-17T03:41:59.771897+0000","last_undegraded":"2024-09-17T03:41:59.771897+0000","last_fullsized":"2024-09-17T03:41:59.771897+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:08.529163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788471+0000","last_change":"2024-09-17T03:41:58.778325+0000","last_active":"2024-09-17T03:41:59.788471+0000","last_peered":"2024-09-17T03:41:59.788471+0000","last_clean":"2024-09-17T03:41:59.788471+0000","last_became_active":"2024-09-17T03:41:58.778010+0000","last_became_peered":"2024-09-17T03:41:58.778010+0000","last_unstale":"2024-09-17T03:41:59.788471+0000","last_undegraded":"2024-09-17T03:41:59.788471+0000","last_fullsized":"2024-09-17T03:41:59.788471+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:26.891203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.313915+0000","last_change":"2024-09-17T03:41:58.784054+0000","last_active":"2024-09-17T03:42:00.313915+0000","last_peered":"2024-09-17T03:42:00.313915+0000","last_clean":"2024-09-17T03:42:00.313915+0000","last_became_active":"2024-09-17T03:41:58.783751+0000","last_became_peered":"2024-09-17T03:41:58.783751+0000","last_unstale":"2024-09-17T03:42:00.313915+0000","last_undegraded":"2024-09-17T03:42:00.313915+0000","last_fullsized":"2024-09-17T03:42:00.313915+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:18.534131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788686+0000","last_change":"2024-09-17T03:41:58.791309+0000","last_active":"2024-09-17T03:41:59.788686+0000","last_peered":"2024-09-17T03:41:59.788686+0000","last_clean":"2024-09-17T03:41:59.788686+0000","last_became_active":"2024-09-17T03:41:58.791005+0000","last_became_peered":"2024-09-17T03:41:58.791005+0000","last_unstale":"2024-09-17T03:41:59.788686+0000","last_undegraded":"2024-09-17T03:41:59.788686+0000","last_fullsized":"2024-09-17T03:41:59.788686+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:08.070604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.772268+0000","last_change":"2024-09-17T03:41:58.772834+0000","last_active":"2024-09-17T03:41:59.772268+0000","last_peered":"2024-09-17T03:41:59.772268+0000","last_clean":"2024-09-17T03:41:59.772268+0000","last_became_active":"2024-09-17T03:41:58.772503+0000","last_became_peered":"2024-09-17T03:41:58.772503+0000","last_unstale":"2024-09-17T03:41:59.772268+0000","last_undegraded":"2024-09-17T03:41:59.772268+0000","last_fullsized":"2024-09-17T03:41:59.772268+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:57.353908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.786394+0000","last_change":"2024-09-17T03:41:58.785329+0000","last_active":"2024-09-17T03:41:59.786394+0000","last_peered":"2024-09-17T03:41:59.786394+0000","last_clean":"2024-09-17T03:41:59.786394+0000","last_became_active":"2024-09-17T03:41:58.785017+0000","last_became_peered":"2024-09-17T03:41:58.785017+0000","last_unstale":"2024-09-17T03:41:59.786394+0000","last_undegraded":"2024-09-17T03:41:59.786394+0000","last_fullsized":"2024-09-17T03:41:59.786394+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:38.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.314154+0000","last_change":"2024-09-17T03:41:58.782096+0000","last_active":"2024-09-17T03:42:00.314154+0000","last_peered":"2024-09-17T03:42:00.314154+0000","last_clean":"2024-09-17T03:42:00.314154+0000","last_became_active":"2024-09-17T03:41:58.781798+0000","last_became_peered":"2024-09-17T03:41:58.781798+0000","last_unstale":"2024-09-17T03:42:00.314154+0000","last_undegraded":"2024-09-17T03:42:00.314154+0000","last_fullsized":"2024-09-17T03:42:00.314154+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:46.442475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788504+0000","last_change":"2024-09-17T03:41:58.787064+0000","last_active":"2024-09-17T03:41:59.788504+0000","last_peered":"2024-09-17T03:41:59.788504+0000","last_clean":"2024-09-17T03:41:59.788504+0000","last_became_active":"2024-09-17T03:41:58.786212+0000","last_became_peered":"2024-09-17T03:41:58.786212+0000","last_unstale":"2024-09-17T03:41:59.788504+0000","last_undegraded":"2024-09-17T03:41:59.788504+0000","last_fullsized":"2024-09-17T03:41:59.788504+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:38.431507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.771994+0000","last_change":"2024-09-17T03:41:58.785048+0000","last_active":"2024-09-17T03:41:59.771994+0000","last_peered":"2024-09-17T03:41:59.771994+0000","last_clean":"2024-09-17T03:41:59.771994+0000","last_became_active":"2024-09-17T03:41:58.784435+0000","last_became_peered":"2024-09-17T03:41:58.784435+0000","last_unstale":"2024-09-17T03:41:59.771994+0000","last_undegraded":"2024-09-17T03:41:59.771994+0000","last_fullsized":"2024-09-17T03:41:59.771994+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:24.645717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.770718+0000","last_change":"2024-09-17T03:41:58.791265+0000","last_active":"2024-09-17T03:41:59.770718+0000","last_peered":"2024-09-17T03:41:59.770718+0000","last_clean":"2024-09-17T03:41:59.770718+0000","last_became_active":"2024-09-17T03:41:58.790981+0000","last_became_peered":"2024-09-17T03:41:58.790981+0000","last_unstale":"2024-09-17T03:41:59.770718+0000","last_undegraded":"2024-09-17T03:41:59.770718+0000","last_fullsized":"2024-09-17T03:41:59.770718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:05.025002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788043+0000","last_change":"2024-09-17T03:41:58.786007+0000","last_active":"2024-09-17T03:41:59.788043+0000","last_peered":"2024-09-17T03:41:59.788043+0000","last_clean":"2024-09-17T03:41:59.788043+0000","last_became_active":"2024-09-17T03:41:58.785642+0000","last_became_peered":"2024-09-17T03:41:58.785642+0000","last_unstale":"2024-09-17T03:41:59.788043+0000","last_undegraded":"2024-09-17T03:41:59.788043+0000","last_fullsized":"2024-09-17T03:41:59.788043+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:17.636266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.314396+0000","last_change":"2024-09-17T03:41:58.784174+0000","last_active":"2024-09-17T03:42:00.314396+0000","last_peered":"2024-09-17T03:42:00.314396+0000","last_clean":"2024-09-17T03:42:00.314396+0000","last_became_active":"2024-09-17T03:41:58.783889+0000","last_became_peered":"2024-09-17T03:41:58.783889+0000","last_unstale":"2024-09-17T03:42:00.314396+0000","last_undegraded":"2024-09-17T03:42:00.314396+0000","last_fullsized":"2024-09-17T03:42:00.314396+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:39.686030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.785904+0000","last_change":"2024-09-17T03:41:58.790506+0000","last_active":"2024-09-17T03:41:59.785904+0000","last_peered":"2024-09-17T03:41:59.785904+0000","last_clean":"2024-09-17T03:41:59.785904+0000","last_became_active":"2024-09-17T03:41:58.790198+0000","last_became_peered":"2024-09-17T03:41:58.790198+0000","last_unstale":"2024-09-17T03:41:59.785904+0000","last_undegraded":"2024-09-17T03:41:59.785904+0000","last_fullsized":"2024-09-17T03:41:59.785904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:12.671615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.314324+0000","last_change":"2024-09-17T03:41:58.783272+0000","last_active":"2024-09-17T03:42:00.314324+0000","last_peered":"2024-09-17T03:42:00.314324+0000","last_clean":"2024-09-17T03:42:00.314324+0000","last_became_active":"2024-09-17T03:41:58.782949+0000","last_became_peered":"2024-09-17T03:41:58.782949+0000","last_unstale":"2024-09-17T03:42:00.314324+0000","last_undegraded":"2024-09-17T03:42:00.314324+0000","last_fullsized":"2024-09-17T03:42:00.314324+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:46.236782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.769662+0000","last_change":"2024-09-17T03:41:58.786551+0000","last_active":"2024-09-17T03:41:59.769662+0000","last_peered":"2024-09-17T03:41:59.769662+0000","last_clean":"2024-09-17T03:41:59.769662+0000","last_became_active":"2024-09-17T03:41:58.786235+0000","last_became_peered":"2024-09-17T03:41:58.786235+0000","last_unstale":"2024-09-17T03:41:59.769662+0000","last_undegraded":"2024-09-17T03:41:59.769662+0000","last_fullsized":"2024-09-17T03:41:59.769662+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:06.389681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.785658+0000","last_change":"2024-09-17T03:41:58.781120+0000","last_active":"2024-09-17T03:41:59.785658+0000","last_peered":"2024-09-17T03:41:59.785658+0000","last_clean":"2024-09-17T03:41:59.785658+0000","last_became_active":"2024-09-17T03:41:58.780819+0000","last_became_peered":"2024-09-17T03:41:58.780819+0000","last_unstale":"2024-09-17T03:41:59.785658+0000","last_undegraded":"2024-09-17T03:41:59.785658+0000","last_fullsized":"2024-09-17T03:41:59.785658+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:37.746627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.772132+0000","last_change":"2024-09-17T03:41:58.786598+0000","last_active":"2024-09-17T03:41:59.772132+0000","last_peered":"2024-09-17T03:41:59.772132+0000","last_clean":"2024-09-17T03:41:59.772132+0000","last_became_active":"2024-09-17T03:41:58.786273+0000","last_became_peered":"2024-09-17T03:41:58.786273+0000","last_unstale":"2024-09-17T03:41:59.772132+0000","last_undegraded":"2024-09-17T03:41:59.772132+0000","last_fullsized":"2024-09-17T03:41:59.772132+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:33.491857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.397853+0000","last_change":"2024-09-17T03:41:58.774158+0000","last_active":"2024-09-17T03:42:00.397853+0000","last_peered":"2024-09-17T03:42:00.397853+0000","last_clean":"2024-09-17T03:42:00.397853+0000","last_became_active":"2024-09-17T03:41:58.773739+0000","last_became_peered":"2024-09-17T03:41:58.773739+0000","last_unstale":"2024-09-17T03:42:00.397853+0000","last_undegraded":"2024-09-17T03:42:00.397853+0000","last_fullsized":"2024-09-17T03:42:00.397853+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:32.110986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.313961+0000","last_change":"2024-09-17T03:41:58.788709+0000","last_active":"2024-09-17T03:42:00.313961+0000","last_peered":"2024-09-17T03:42:00.313961+0000","last_clean":"2024-09-17T03:42:00.313961+0000","last_became_active":"2024-09-17T03:41:58.788401+0000","last_became_peered":"2024-09-17T03:41:58.788401+0000","last_unstale":"2024-09-17T03:42:00.313961+0000","last_undegraded":"2024-09-17T03:42:00.313961+0000","last_fullsized":"2024-09-17T03:42:00.313961+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:28.682144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788361+0000","last_change":"2024-09-17T03:41:58.792053+0000","last_active":"2024-09-17T03:41:59.788361+0000","last_peered":"2024-09-17T03:41:59.788361+0000","last_clean":"2024-09-17T03:41:59.788361+0000","last_became_active":"2024-09-17T03:41:58.791734+0000","last_became_peered":"2024-09-17T03:41:58.791734+0000","last_unstale":"2024-09-17T03:41:59.788361+0000","last_undegraded":"2024-09-17T03:41:59.788361+0000","last_fullsized":"2024-09-17T03:41:59.788361+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:24.951147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"142'4","reported_seq":19,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788436+0000","last_change":"2024-09-17T03:41:57.783265+0000","last_active":"2024-09-17T03:41:59.788436+0000","last_peered":"2024-09-17T03:41:59.788436+0000","last_clean":"2024-09-17T03:41:59.788436+0000","last_became_active":"2024-09-17T03:41:57.782950+0000","last_became_peered":"2024-09-17T03:41:57.782950+0000","last_unstale":"2024-09-17T03:41:59.788436+0000","last_undegraded":"2024-09-17T03:41:59.788436+0000","last_fullsized":"2024-09-17T03:41:59.788436+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:13.633153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398250+0000","last_change":"2024-09-17T03:41:58.790857+0000","last_active":"2024-09-17T03:42:00.398250+0000","last_peered":"2024-09-17T03:42:00.398250+0000","last_clean":"2024-09-17T03:42:00.398250+0000","last_became_active":"2024-09-17T03:41:58.790567+0000","last_became_peered":"2024-09-17T03:41:58.790567+0000","last_unstale":"2024-09-17T03:42:00.398250+0000","last_undegraded":"2024-09-17T03:42:00.398250+0000","last_fullsized":"2024-09-17T03:42:00.398250+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:23.456442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"142'1","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398020+0000","last_change":"2024-09-17T03:41:57.779775+0000","last_active":"2024-09-17T03:42:00.398020+0000","last_peered":"2024-09-17T03:42:00.398020+0000","last_clean":"2024-09-17T03:42:00.398020+0000","last_became_active":"2024-09-17T03:41:57.779410+0000","last_became_peered":"2024-09-17T03:41:57.779410+0000","last_unstale":"2024-09-17T03:42:00.398020+0000","last_undegraded":"2024-09-17T03:42:00.398020+0000","last_fullsized":"2024-09-17T03:42:00.398020+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:52.354071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.785904+0000","last_change":"2024-09-17T03:41:58.788338+0000","last_active":"2024-09-17T03:41:59.785904+0000","last_peered":"2024-09-17T03:41:59.785904+0000","last_clean":"2024-09-17T03:41:59.785904+0000","last_became_active":"2024-09-17T03:41:58.788052+0000","last_became_peered":"2024-09-17T03:41:58.788052+0000","last_unstale":"2024-09-17T03:41:59.785904+0000","last_undegraded":"2024-09-17T03:41:59.785904+0000","last_fullsized":"2024-09-17T03:41:59.785904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:02.013733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"142'2","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.771104+0000","last_change":"2024-09-17T03:41:57.786673+0000","last_active":"2024-09-17T03:41:59.771104+0000","last_peered":"2024-09-17T03:41:59.771104+0000","last_clean":"2024-09-17T03:41:59.771104+0000","last_became_active":"2024-09-17T03:41:57.786359+0000","last_became_peered":"2024-09-17T03:41:57.786359+0000","last_unstale":"2024-09-17T03:41:59.771104+0000","last_undegraded":"2024-09-17T03:41:59.771104+0000","last_fullsized":"2024-09-17T03:41:59.771104+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:36.067718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788382+0000","last_change":"2024-09-17T03:41:58.787967+0000","last_active":"2024-09-17T03:41:59.788382+0000","last_peered":"2024-09-17T03:41:59.788382+0000","last_clean":"2024-09-17T03:41:59.788382+0000","last_became_active":"2024-09-17T03:41:58.787652+0000","last_became_peered":"2024-09-17T03:41:58.787652+0000","last_unstale":"2024-09-17T03:41:59.788382+0000","last_undegraded":"2024-09-17T03:41:59.788382+0000","last_fullsized":"2024-09-17T03:41:59.788382+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:14.935061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"142'2","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.771446+0000","last_change":"2024-09-17T03:41:57.786812+0000","last_active":"2024-09-17T03:41:59.771446+0000","last_peered":"2024-09-17T03:41:59.771446+0000","last_clean":"2024-09-17T03:41:59.771446+0000","last_became_active":"2024-09-17T03:41:57.786434+0000","last_became_peered":"2024-09-17T03:41:57.786434+0000","last_unstale":"2024-09-17T03:41:59.771446+0000","last_undegraded":"2024-09-17T03:41:59.771446+0000","last_fullsized":"2024-09-17T03:41:59.771446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.381560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398019+0000","last_change":"2024-09-17T03:41:58.775442+0000","last_active":"2024-09-17T03:42:00.398019+0000","last_peered":"2024-09-17T03:42:00.398019+0000","last_clean":"2024-09-17T03:42:00.398019+0000","last_became_active":"2024-09-17T03:41:58.775106+0000","last_became_peered":"2024-09-17T03:41:58.775106+0000","last_unstale":"2024-09-17T03:42:00.398019+0000","last_undegraded":"2024-09-17T03:42:00.398019+0000","last_fullsized":"2024-09-17T03:42:00.398019+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:16.844984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"142'1","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.314194+0000","last_change":"2024-09-17T03:41:57.782388+0000","last_active":"2024-09-17T03:42:00.314194+0000","last_peered":"2024-09-17T03:42:00.314194+0000","last_clean":"2024-09-17T03:42:00.314194+0000","last_became_active":"2024-09-17T03:41:57.782057+0000","last_became_peered":"2024-09-17T03:41:57.782057+0000","last_unstale":"2024-09-17T03:42:00.314194+0000","last_undegraded":"2024-09-17T03:42:00.314194+0000","last_fullsized":"2024-09-17T03:42:00.314194+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:47.273862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.771200+0000","last_change":"2024-09-17T03:41:58.782536+0000","last_active":"2024-09-17T03:41:59.771200+0000","last_peered":"2024-09-17T03:41:59.771200+0000","last_clean":"2024-09-17T03:41:59.771200+0000","last_became_active":"2024-09-17T03:41:58.782153+0000","last_became_peered":"2024-09-17T03:41:58.782153+0000","last_unstale":"2024-09-17T03:41:59.771200+0000","last_undegraded":"2024-09-17T03:41:59.771200+0000","last_fullsized":"2024-09-17T03:41:59.771200+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:51.614014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"142'1","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398244+0000","last_change":"2024-09-17T03:41:57.787011+0000","last_active":"2024-09-17T03:42:00.398244+0000","last_peered":"2024-09-17T03:42:00.398244+0000","last_clean":"2024-09-17T03:42:00.398244+0000","last_became_active":"2024-09-17T03:41:57.786612+0000","last_became_peered":"2024-09-17T03:41:57.786612+0000","last_unstale":"2024-09-17T03:42:00.398244+0000","last_undegraded":"2024-09-17T03:42:00.398244+0000","last_fullsized":"2024-09-17T03:42:00.398244+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:38.032586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.397855+0000","last_change":"2024-09-17T03:41:58.786921+0000","last_active":"2024-09-17T03:42:00.397855+0000","last_peered":"2024-09-17T03:42:00.397855+0000","last_clean":"2024-09-17T03:42:00.397855+0000","last_became_active":"2024-09-17T03:41:58.786596+0000","last_became_peered":"2024-09-17T03:41:58.786596+0000","last_unstale":"2024-09-17T03:42:00.397855+0000","last_undegraded":"2024-09-17T03:42:00.397855+0000","last_fullsized":"2024-09-17T03:42:00.397855+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:14.503000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.314051+0000","last_change":"2024-09-17T03:41:57.787289+0000","last_active":"2024-09-17T03:42:00.314051+0000","last_peered":"2024-09-17T03:42:00.314051+0000","last_clean":"2024-09-17T03:42:00.314051+0000","last_became_active":"2024-09-17T03:41:57.786949+0000","last_became_peered":"2024-09-17T03:41:57.786949+0000","last_unstale":"2024-09-17T03:42:00.314051+0000","last_undegraded":"2024-09-17T03:42:00.314051+0000","last_fullsized":"2024-09-17T03:42:00.314051+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:11.729127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398370+0000","last_change":"2024-09-17T03:41:58.783127+0000","last_active":"2024-09-17T03:42:00.398370+0000","last_peered":"2024-09-17T03:42:00.398370+0000","last_clean":"2024-09-17T03:42:00.398370+0000","last_became_active":"2024-09-17T03:41:58.782264+0000","last_became_peered":"2024-09-17T03:41:58.782264+0000","last_unstale":"2024-09-17T03:42:00.398370+0000","last_undegraded":"2024-09-17T03:42:00.398370+0000","last_fullsized":"2024-09-17T03:42:00.398370+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:33.147102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.770385+0000","last_change":"2024-09-17T03:41:57.788010+0000","last_active":"2024-09-17T03:41:59.770385+0000","last_peered":"2024-09-17T03:41:59.770385+0000","last_clean":"2024-09-17T03:41:59.770385+0000","last_became_active":"2024-09-17T03:41:57.787639+0000","last_became_peered":"2024-09-17T03:41:57.787639+0000","last_unstale":"2024-09-17T03:41:59.770385+0000","last_undegraded":"2024-09-17T03:41:59.770385+0000","last_fullsized":"2024-09-17T03:41:59.770385+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:53.119624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398863+0000","last_change":"2024-09-17T03:41:58.787208+0000","last_active":"2024-09-17T03:42:00.398863+0000","last_peered":"2024-09-17T03:42:00.398863+0000","last_clean":"2024-09-17T03:42:00.398863+0000","last_became_active":"2024-09-17T03:41:58.786658+0000","last_became_peered":"2024-09-17T03:41:58.786658+0000","last_unstale":"2024-09-17T03:42:00.398863+0000","last_undegraded":"2024-09-17T03:42:00.398863+0000","last_fullsized":"2024-09-17T03:42:00.398863+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:58.293415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398246+0000","last_change":"2024-09-17T03:41:57.776917+0000","last_active":"2024-09-17T03:42:00.398246+0000","last_peered":"2024-09-17T03:42:00.398246+0000","last_clean":"2024-09-17T03:42:00.398246+0000","last_became_active":"2024-09-17T03:41:57.776588+0000","last_became_peered":"2024-09-17T03:41:57.776588+0000","last_unstale":"2024-09-17T03:42:00.398246+0000","last_undegraded":"2024-09-17T03:42:00.398246+0000","last_fullsized":"2024-09-17T03:42:00.398246+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:10.846013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788415+0000","last_change":"2024-09-17T03:41:58.795904+0000","last_active":"2024-09-17T03:41:59.788415+0000","last_peered":"2024-09-17T03:41:59.788415+0000","last_clean":"2024-09-17T03:41:59.788415+0000","last_became_active":"2024-09-17T03:41:58.795526+0000","last_became_peered":"2024-09-17T03:41:58.795526+0000","last_unstale":"2024-09-17T03:41:59.788415+0000","last_undegraded":"2024-09-17T03:41:59.788415+0000","last_fullsized":"2024-09-17T03:41:59.788415+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:03.704506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788728+0000","last_change":"2024-09-17T03:41:57.784269+0000","last_active":"2024-09-17T03:41:59.788728+0000","last_peered":"2024-09-17T03:41:59.788728+0000","last_clean":"2024-09-17T03:41:59.788728+0000","last_became_active":"2024-09-17T03:41:57.783959+0000","last_became_peered":"2024-09-17T03:41:57.783959+0000","last_unstale":"2024-09-17T03:41:59.788728+0000","last_undegraded":"2024-09-17T03:41:59.788728+0000","last_fullsized":"2024-09-17T03:41:59.788728+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:53.953478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.314290+0000","last_change":"2024-09-17T03:41:58.788640+0000","last_active":"2024-09-17T03:42:00.314290+0000","last_peered":"2024-09-17T03:42:00.314290+0000","last_clean":"2024-09-17T03:42:00.314290+0000","last_became_active":"2024-09-17T03:41:58.788345+0000","last_became_peered":"2024-09-17T03:41:58.788345+0000","last_unstale":"2024-09-17T03:42:00.314290+0000","last_undegraded":"2024-09-17T03:42:00.314290+0000","last_fullsized":"2024-09-17T03:42:00.314290+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:00.946931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"142'6","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.769821+0000","last_change":"2024-09-17T03:41:57.782746+0000","last_active":"2024-09-17T03:41:59.769821+0000","last_peered":"2024-09-17T03:41:59.769821+0000","last_clean":"2024-09-17T03:41:59.769821+0000","last_became_active":"2024-09-17T03:41:57.782411+0000","last_became_peered":"2024-09-17T03:41:57.782411+0000","last_unstale":"2024-09-17T03:41:59.769821+0000","last_undegraded":"2024-09-17T03:41:59.769821+0000","last_fullsized":"2024-09-17T03:41:59.769821+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:17.365247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.770929+0000","last_change":"2024-09-17T03:41:58.791701+0000","last_active":"2024-09-17T03:41:59.770929+0000","last_peered":"2024-09-17T03:41:59.770929+0000","last_clean":"2024-09-17T03:41:59.770929+0000","last_became_active":"2024-09-17T03:41:58.791387+0000","last_became_peered":"2024-09-17T03:41:58.791387+0000","last_unstale":"2024-09-17T03:41:59.770929+0000","last_undegraded":"2024-09-17T03:41:59.770929+0000","last_fullsized":"2024-09-17T03:41:59.770929+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:34.353701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"142'2","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.771502+0000","last_change":"2024-09-17T03:41:57.776058+0000","last_active":"2024-09-17T03:41:59.771502+0000","last_peered":"2024-09-17T03:41:59.771502+0000","last_clean":"2024-09-17T03:41:59.771502+0000","last_became_active":"2024-09-17T03:41:57.775726+0000","last_became_peered":"2024-09-17T03:41:57.775726+0000","last_unstale":"2024-09-17T03:41:59.771502+0000","last_undegraded":"2024-09-17T03:41:59.771502+0000","last_fullsized":"2024-09-17T03:41:59.771502+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:35.559498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398033+0000","last_change":"2024-09-17T03:41:58.787984+0000","last_active":"2024-09-17T03:42:00.398033+0000","last_peered":"2024-09-17T03:42:00.398033+0000","last_clean":"2024-09-17T03:42:00.398033+0000","last_became_active":"2024-09-17T03:41:58.787654+0000","last_became_peered":"2024-09-17T03:41:58.787654+0000","last_unstale":"2024-09-17T03:42:00.398033+0000","last_undegraded":"2024-09-17T03:42:00.398033+0000","last_fullsized":"2024-09-17T03:42:00.398033+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:17.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.771135+0000","last_change":"2024-09-17T03:41:57.787376+0000","last_active":"2024-09-17T03:41:59.771135+0000","last_peered":"2024-09-17T03:41:59.771135+0000","last_clean":"2024-09-17T03:41:59.771135+0000","last_became_active":"2024-09-17T03:41:57.787036+0000","last_became_peered":"2024-09-17T03:41:57.787036+0000","last_unstale":"2024-09-17T03:41:59.771135+0000","last_undegraded":"2024-09-17T03:41:59.771135+0000","last_fullsized":"2024-09-17T03:41:59.771135+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:07.925487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398464+0000","last_change":"2024-09-17T03:41:58.790303+0000","last_active":"2024-09-17T03:42:00.398464+0000","last_peered":"2024-09-17T03:42:00.398464+0000","last_clean":"2024-09-17T03:42:00.398464+0000","last_became_active":"2024-09-17T03:41:58.789996+0000","last_became_peered":"2024-09-17T03:41:58.789996+0000","last_unstale":"2024-09-17T03:42:00.398464+0000","last_undegraded":"2024-09-17T03:42:00.398464+0000","last_fullsized":"2024-09-17T03:42:00.398464+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:28.497518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.785457+0000","last_change":"2024-09-17T03:41:57.777414+0000","last_active":"2024-09-17T03:41:59.785457+0000","last_peered":"2024-09-17T03:41:59.785457+0000","last_clean":"2024-09-17T03:41:59.785457+0000","last_became_active":"2024-09-17T03:41:57.777105+0000","last_became_peered":"2024-09-17T03:41:57.777105+0000","last_unstale":"2024-09-17T03:41:59.785457+0000","last_undegraded":"2024-09-17T03:41:59.785457+0000","last_fullsized":"2024-09-17T03:41:59.785457+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:02.185593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.770440+0000","last_change":"2024-09-17T03:41:58.778450+0000","last_active":"2024-09-17T03:41:59.770440+0000","last_peered":"2024-09-17T03:41:59.770440+0000","last_clean":"2024-09-17T03:41:59.770440+0000","last_became_active":"2024-09-17T03:41:58.778161+0000","last_became_peered":"2024-09-17T03:41:58.778161+0000","last_unstale":"2024-09-17T03:41:59.770440+0000","last_undegraded":"2024-09-17T03:41:59.770440+0000","last_fullsized":"2024-09-17T03:41:59.770440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:39.358786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"142'8","reported_seq":23,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.314184+0000","last_change":"2024-09-17T03:41:57.781387+0000","last_active":"2024-09-17T03:42:00.314184+0000","last_peered":"2024-09-17T03:42:00.314184+0000","last_clean":"2024-09-17T03:42:00.314184+0000","last_became_active":"2024-09-17T03:41:57.781040+0000","last_became_peered":"2024-09-17T03:41:57.781040+0000","last_unstale":"2024-09-17T03:42:00.314184+0000","last_undegraded":"2024-09-17T03:42:00.314184+0000","last_fullsized":"2024-09-17T03:42:00.314184+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:01.589570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788612+0000","last_change":"2024-09-17T03:41:58.785556+0000","last_active":"2024-09-17T03:41:59.788612+0000","last_peered":"2024-09-17T03:41:59.788612+0000","last_clean":"2024-09-17T03:41:59.788612+0000","last_became_active":"2024-09-17T03:41:58.785245+0000","last_became_peered":"2024-09-17T03:41:58.785245+0000","last_unstale":"2024-09-17T03:41:59.788612+0000","last_undegraded":"2024-09-17T03:41:59.788612+0000","last_fullsized":"2024-09-17T03:41:59.788612+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:25.717779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"142'1","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398683+0000","last_change":"2024-09-17T03:41:57.789338+0000","last_active":"2024-09-17T03:42:00.398683+0000","last_peered":"2024-09-17T03:42:00.398683+0000","last_clean":"2024-09-17T03:42:00.398683+0000","last_became_active":"2024-09-17T03:41:57.788925+0000","last_became_peered":"2024-09-17T03:41:57.788925+0000","last_unstale":"2024-09-17T03:42:00.398683+0000","last_undegraded":"2024-09-17T03:42:00.398683+0000","last_fullsized":"2024-09-17T03:42:00.398683+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:32.798364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.314444+0000","last_change":"2024-09-17T03:41:58.779968+0000","last_active":"2024-09-17T03:42:00.314444+0000","last_peered":"2024-09-17T03:42:00.314444+0000","last_clean":"2024-09-17T03:42:00.314444+0000","last_became_active":"2024-09-17T03:41:58.779689+0000","last_became_peered":"2024-09-17T03:41:58.779689+0000","last_unstale":"2024-09-17T03:42:00.314444+0000","last_undegraded":"2024-09-17T03:42:00.314444+0000","last_fullsized":"2024-09-17T03:42:00.314444+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:03.192581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"142'2","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398138+0000","last_change":"2024-09-17T03:41:57.780967+0000","last_active":"2024-09-17T03:42:00.398138+0000","last_peered":"2024-09-17T03:42:00.398138+0000","last_clean":"2024-09-17T03:42:00.398138+0000","last_became_active":"2024-09-17T03:41:57.780670+0000","last_became_peered":"2024-09-17T03:41:57.780670+0000","last_unstale":"2024-09-17T03:42:00.398138+0000","last_undegraded":"2024-09-17T03:42:00.398138+0000","last_fullsized":"2024-09-17T03:42:00.398138+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:59.401059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.771751+0000","last_change":"2024-09-17T03:41:58.790968+0000","last_active":"2024-09-17T03:41:59.771751+0000","last_peered":"2024-09-17T03:41:59.771751+0000","last_clean":"2024-09-17T03:41:59.771751+0000","last_became_active":"2024-09-17T03:41:58.790345+0000","last_became_peered":"2024-09-17T03:41:58.790345+0000","last_unstale":"2024-09-17T03:41:59.771751+0000","last_undegraded":"2024-09-17T03:41:59.771751+0000","last_fullsized":"2024-09-17T03:41:59.771751+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:06.964385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"142'1","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.314499+0000","last_change":"2024-09-17T03:41:57.782205+0000","last_active":"2024-09-17T03:42:00.314499+0000","last_peered":"2024-09-17T03:42:00.314499+0000","last_clean":"2024-09-17T03:42:00.314499+0000","last_became_active":"2024-09-17T03:41:57.781549+0000","last_became_peered":"2024-09-17T03:41:57.781549+0000","last_unstale":"2024-09-17T03:42:00.314499+0000","last_undegraded":"2024-09-17T03:42:00.314499+0000","last_fullsized":"2024-09-17T03:42:00.314499+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:14.375766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.786139+0000","last_change":"2024-09-17T03:41:58.782158+0000","last_active":"2024-09-17T03:41:59.786139+0000","last_peered":"2024-09-17T03:41:59.786139+0000","last_clean":"2024-09-17T03:41:59.786139+0000","last_became_active":"2024-09-17T03:41:58.781872+0000","last_became_peered":"2024-09-17T03:41:58.781872+0000","last_unstale":"2024-09-17T03:41:59.786139+0000","last_undegraded":"2024-09-17T03:41:59.786139+0000","last_fullsized":"2024-09-17T03:41:59.786139+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:46.290406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.397914+0000","last_change":"2024-09-17T03:41:57.779963+0000","last_active":"2024-09-17T03:42:00.397914+0000","last_peered":"2024-09-17T03:42:00.397914+0000","last_clean":"2024-09-17T03:42:00.397914+0000","last_became_active":"2024-09-17T03:41:57.779639+0000","last_became_peered":"2024-09-17T03:41:57.779639+0000","last_unstale":"2024-09-17T03:42:00.397914+0000","last_undegraded":"2024-09-17T03:42:00.397914+0000","last_fullsized":"2024-09-17T03:42:00.397914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:59.092236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.772224+0000","last_change":"2024-09-17T03:41:58.788349+0000","last_active":"2024-09-17T03:41:59.772224+0000","last_peered":"2024-09-17T03:41:59.772224+0000","last_clean":"2024-09-17T03:41:59.772224+0000","last_became_active":"2024-09-17T03:41:58.788032+0000","last_became_peered":"2024-09-17T03:41:58.788032+0000","last_unstale":"2024-09-17T03:41:59.772224+0000","last_undegraded":"2024-09-17T03:41:59.772224+0000","last_fullsized":"2024-09-17T03:41:59.772224+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:55.806348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"142'2","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.769736+0000","last_change":"2024-09-17T03:41:57.776487+0000","last_active":"2024-09-17T03:41:59.769736+0000","last_peered":"2024-09-17T03:41:59.769736+0000","last_clean":"2024-09-17T03:41:59.769736+0000","last_became_active":"2024-09-17T03:41:57.776096+0000","last_became_peered":"2024-09-17T03:41:57.776096+0000","last_unstale":"2024-09-17T03:41:59.769736+0000","last_undegraded":"2024-09-17T03:41:59.769736+0000","last_fullsized":"2024-09-17T03:41:59.769736+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:15.191990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.769619+0000","last_change":"2024-09-17T03:41:58.797168+0000","last_active":"2024-09-17T03:41:59.769619+0000","last_peered":"2024-09-17T03:41:59.769619+0000","last_clean":"2024-09-17T03:41:59.769619+0000","last_became_active":"2024-09-17T03:41:58.796622+0000","last_became_peered":"2024-09-17T03:41:58.796622+0000","last_unstale":"2024-09-17T03:41:59.769619+0000","last_undegraded":"2024-09-17T03:41:59.769619+0000","last_fullsized":"2024-09-17T03:41:59.769619+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:17.636266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788101+0000","last_change":"2024-09-17T03:41:57.778245+0000","last_active":"2024-09-17T03:41:59.788101+0000","last_peered":"2024-09-17T03:41:59.788101+0000","last_clean":"2024-09-17T03:41:59.788101+0000","last_became_active":"2024-09-17T03:41:57.777803+0000","last_became_peered":"2024-09-17T03:41:57.777803+0000","last_unstale":"2024-09-17T03:41:59.788101+0000","last_undegraded":"2024-09-17T03:41:59.788101+0000","last_fullsized":"2024-09-17T03:41:59.788101+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:05.305842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.770361+0000","last_change":"2024-09-17T03:41:58.791751+0000","last_active":"2024-09-17T03:41:59.770361+0000","last_peered":"2024-09-17T03:41:59.770361+0000","last_clean":"2024-09-17T03:41:59.770361+0000","last_became_active":"2024-09-17T03:41:58.791471+0000","last_became_peered":"2024-09-17T03:41:58.791471+0000","last_unstale":"2024-09-17T03:41:59.770361+0000","last_undegraded":"2024-09-17T03:41:59.770361+0000","last_fullsized":"2024-09-17T03:41:59.770361+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:27.582404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.787961+0000","last_change":"2024-09-17T03:41:57.783936+0000","last_active":"2024-09-17T03:41:59.787961+0000","last_peered":"2024-09-17T03:41:59.787961+0000","last_clean":"2024-09-17T03:41:59.787961+0000","last_became_active":"2024-09-17T03:41:57.783328+0000","last_became_peered":"2024-09-17T03:41:57.783328+0000","last_unstale":"2024-09-17T03:41:59.787961+0000","last_undegraded":"2024-09-17T03:41:59.787961+0000","last_fullsized":"2024-09-17T03:41:59.787961+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:27.468632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.769560+0000","last_change":"2024-09-17T03:41:58.796724+0000","last_active":"2024-09-17T03:41:59.769560+0000","last_peered":"2024-09-17T03:41:59.769560+0000","last_clean":"2024-09-17T03:41:59.769560+0000","last_became_active":"2024-09-17T03:41:58.796412+0000","last_became_peered":"2024-09-17T03:41:58.796412+0000","last_unstale":"2024-09-17T03:41:59.769560+0000","last_undegraded":"2024-09-17T03:41:59.769560+0000","last_fullsized":"2024-09-17T03:41:59.769560+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:55.172472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.770239+0000","last_change":"2024-09-17T03:41:57.781280+0000","last_active":"2024-09-17T03:41:59.770239+0000","last_peered":"2024-09-17T03:41:59.770239+0000","last_clean":"2024-09-17T03:41:59.770239+0000","last_became_active":"2024-09-17T03:41:57.780910+0000","last_became_peered":"2024-09-17T03:41:57.780910+0000","last_unstale":"2024-09-17T03:41:59.770239+0000","last_undegraded":"2024-09-17T03:41:59.770239+0000","last_fullsized":"2024-09-17T03:41:59.770239+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:01.006744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398912+0000","last_change":"2024-09-17T03:41:58.783037+0000","last_active":"2024-09-17T03:42:00.398912+0000","last_peered":"2024-09-17T03:42:00.398912+0000","last_clean":"2024-09-17T03:42:00.398912+0000","last_became_active":"2024-09-17T03:41:58.782732+0000","last_became_peered":"2024-09-17T03:41:58.782732+0000","last_unstale":"2024-09-17T03:42:00.398912+0000","last_undegraded":"2024-09-17T03:42:00.398912+0000","last_fullsized":"2024-09-17T03:42:00.398912+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:14.751177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"142'2","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788645+0000","last_change":"2024-09-17T03:41:57.783360+0000","last_active":"2024-09-17T03:41:59.788645+0000","last_peered":"2024-09-17T03:41:59.788645+0000","last_clean":"2024-09-17T03:41:59.788645+0000","last_became_active":"2024-09-17T03:41:57.783016+0000","last_became_peered":"2024-09-17T03:41:57.783016+0000","last_unstale":"2024-09-17T03:41:59.788645+0000","last_undegraded":"2024-09-17T03:41:59.788645+0000","last_fullsized":"2024-09-17T03:41:59.788645+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:57.921906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.772547+0000","last_change":"2024-09-17T03:41:58.779367+0000","last_active":"2024-09-17T03:41:59.772547+0000","last_peered":"2024-09-17T03:41:59.772547+0000","last_clean":"2024-09-17T03:41:59.772547+0000","last_became_active":"2024-09-17T03:41:58.779044+0000","last_became_peered":"2024-09-17T03:41:58.779044+0000","last_unstale":"2024-09-17T03:41:59.772547+0000","last_undegraded":"2024-09-17T03:41:59.772547+0000","last_fullsized":"2024-09-17T03:41:59.772547+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:45.014388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"143'1","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.785995+0000","last_change":"2024-09-17T03:41:57.780031+0000","last_active":"2024-09-17T03:41:59.785995+0000","last_peered":"2024-09-17T03:41:59.785995+0000","last_clean":"2024-09-17T03:41:59.785995+0000","last_became_active":"2024-09-17T03:41:57.779710+0000","last_became_peered":"2024-09-17T03:41:57.779710+0000","last_unstale":"2024-09-17T03:41:59.785995+0000","last_undegraded":"2024-09-17T03:41:59.785995+0000","last_fullsized":"2024-09-17T03:41:59.785995+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:56.392154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398035+0000","last_change":"2024-09-17T03:41:58.784307+0000","last_active":"2024-09-17T03:42:00.398035+0000","last_peered":"2024-09-17T03:42:00.398035+0000","last_clean":"2024-09-17T03:42:00.398035+0000","last_became_active":"2024-09-17T03:41:58.784018+0000","last_became_peered":"2024-09-17T03:41:58.784018+0000","last_unstale":"2024-09-17T03:42:00.398035+0000","last_undegraded":"2024-09-17T03:42:00.398035+0000","last_fullsized":"2024-09-17T03:42:00.398035+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:33.312518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.786334+0000","last_change":"2024-09-17T03:41:57.782553+0000","last_active":"2024-09-17T03:41:59.786334+0000","last_peered":"2024-09-17T03:41:59.786334+0000","last_clean":"2024-09-17T03:41:59.786334+0000","last_became_active":"2024-09-17T03:41:57.782195+0000","last_became_peered":"2024-09-17T03:41:57.782195+0000","last_unstale":"2024-09-17T03:41:59.786334+0000","last_undegraded":"2024-09-17T03:41:59.786334+0000","last_fullsized":"2024-09-17T03:41:59.786334+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.986071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.786147+0000","last_change":"2024-09-17T03:41:58.786028+0000","last_active":"2024-09-17T03:41:59.786147+0000","last_peered":"2024-09-17T03:41:59.786147+0000","last_clean":"2024-09-17T03:41:59.786147+0000","last_became_active":"2024-09-17T03:41:58.785761+0000","last_became_peered":"2024-09-17T03:41:58.785761+0000","last_unstale":"2024-09-17T03:41:59.786147+0000","last_undegraded":"2024-09-17T03:41:59.786147+0000","last_fullsized":"2024-09-17T03:41:59.786147+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:09.845463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.785702+0000","last_change":"2024-09-17T03:41:57.782886+0000","last_active":"2024-09-17T03:41:59.785702+0000","last_peered":"2024-09-17T03:41:59.785702+0000","last_clean":"2024-09-17T03:41:59.785702+0000","last_became_active":"2024-09-17T03:41:57.782391+0000","last_became_peered":"2024-09-17T03:41:57.782391+0000","last_unstale":"2024-09-17T03:41:59.785702+0000","last_undegraded":"2024-09-17T03:41:59.785702+0000","last_fullsized":"2024-09-17T03:41:59.785702+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:13.802117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.314269+0000","last_change":"2024-09-17T03:41:58.794134+0000","last_active":"2024-09-17T03:42:00.314269+0000","last_peered":"2024-09-17T03:42:00.314269+0000","last_clean":"2024-09-17T03:42:00.314269+0000","last_became_active":"2024-09-17T03:41:58.793808+0000","last_became_peered":"2024-09-17T03:41:58.793808+0000","last_unstale":"2024-09-17T03:42:00.314269+0000","last_undegraded":"2024-09-17T03:42:00.314269+0000","last_fullsized":"2024-09-17T03:42:00.314269+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:21.002372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.769864+0000","last_change":"2024-09-17T03:41:57.785169+0000","last_active":"2024-09-17T03:41:59.769864+0000","last_peered":"2024-09-17T03:41:59.769864+0000","last_clean":"2024-09-17T03:41:59.769864+0000","last_became_active":"2024-09-17T03:41:57.784823+0000","last_became_peered":"2024-09-17T03:41:57.784823+0000","last_unstale":"2024-09-17T03:41:59.769864+0000","last_undegraded":"2024-09-17T03:41:59.769864+0000","last_fullsized":"2024-09-17T03:41:59.769864+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:57.518613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398791+0000","last_change":"2024-09-17T03:41:58.790737+0000","last_active":"2024-09-17T03:42:00.398791+0000","last_peered":"2024-09-17T03:42:00.398791+0000","last_clean":"2024-09-17T03:42:00.398791+0000","last_became_active":"2024-09-17T03:41:58.790111+0000","last_became_peered":"2024-09-17T03:41:58.790111+0000","last_unstale":"2024-09-17T03:42:00.398791+0000","last_undegraded":"2024-09-17T03:42:00.398791+0000","last_fullsized":"2024-09-17T03:42:00.398791+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:50.954109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788137+0000","last_change":"2024-09-17T03:41:57.783095+0000","last_active":"2024-09-17T03:41:59.788137+0000","last_peered":"2024-09-17T03:41:59.788137+0000","last_clean":"2024-09-17T03:41:59.788137+0000","last_became_active":"2024-09-17T03:41:57.782778+0000","last_became_peered":"2024-09-17T03:41:57.782778+0000","last_unstale":"2024-09-17T03:41:59.788137+0000","last_undegraded":"2024-09-17T03:41:59.788137+0000","last_fullsized":"2024-09-17T03:41:59.788137+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:42.526729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788068+0000","last_change":"2024-09-17T03:41:58.784537+0000","last_active":"2024-09-17T03:41:59.788068+0000","last_peered":"2024-09-17T03:41:59.788068+0000","last_clean":"2024-09-17T03:41:59.788068+0000","last_became_active":"2024-09-17T03:41:58.784218+0000","last_became_peered":"2024-09-17T03:41:58.784218+0000","last_unstale":"2024-09-17T03:41:59.788068+0000","last_undegraded":"2024-09-17T03:41:59.788068+0000","last_fullsized":"2024-09-17T03:41:59.788068+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:31.962074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.770645+0000","last_change":"2024-09-17T03:41:57.776527+0000","last_active":"2024-09-17T03:41:59.770645+0000","last_peered":"2024-09-17T03:41:59.770645+0000","last_clean":"2024-09-17T03:41:59.770645+0000","last_became_active":"2024-09-17T03:41:57.776202+0000","last_became_peered":"2024-09-17T03:41:57.776202+0000","last_unstale":"2024-09-17T03:41:59.770645+0000","last_undegraded":"2024-09-17T03:41:59.770645+0000","last_fullsized":"2024-09-17T03:41:59.770645+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:53.119624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.398420+0000","last_change":"2024-09-17T03:41:58.786519+0000","last_active":"2024-09-17T03:42:00.398420+0000","last_peered":"2024-09-17T03:42:00.398420+0000","last_clean":"2024-09-17T03:42:00.398420+0000","last_became_active":"2024-09-17T03:41:58.786196+0000","last_became_peered":"2024-09-17T03:41:58.786196+0000","last_unstale":"2024-09-17T03:42:00.398420+0000","last_undegraded":"2024-09-17T03:42:00.398420+0000","last_fullsized":"2024-09-17T03:42:00.398420+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:21.542100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:42:00.397692+0000","last_change":"2024-09-17T03:41:57.780073+0000","last_active":"2024-09-17T03:42:00.397692+0000","last_peered":"2024-09-17T03:42:00.397692+0000","last_clean":"2024-09-17T03:42:00.397692+0000","last_became_active":"2024-09-17T03:41:57.779735+0000","last_became_peered":"2024-09-17T03:41:57.779735+0000","last_unstale":"2024-09-17T03:42:00.397692+0000","last_undegraded":"2024-09-17T03:42:00.397692+0000","last_fullsized":"2024-09-17T03:42:00.397692+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:31.224227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.769691+0000","last_change":"2024-09-17T03:41:58.797467+0000","last_active":"2024-09-17T03:41:59.769691+0000","last_peered":"2024-09-17T03:41:59.769691+0000","last_clean":"2024-09-17T03:41:59.769691+0000","last_became_active":"2024-09-17T03:41:58.797143+0000","last_became_peered":"2024-09-17T03:41:58.797143+0000","last_unstale":"2024-09-17T03:41:59.769691+0000","last_undegraded":"2024-09-17T03:41:59.769691+0000","last_fullsized":"2024-09-17T03:41:59.769691+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:57.757220+0000","last_clean_scrub_stamp":"2024-09-17T03:41:57.757220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:53.175594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"142'3","reported_seq":18,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.772222+0000","last_change":"2024-09-17T03:41:57.777388+0000","last_active":"2024-09-17T03:41:59.772222+0000","last_peered":"2024-09-17T03:41:59.772222+0000","last_clean":"2024-09-17T03:41:59.772222+0000","last_became_active":"2024-09-17T03:41:57.777035+0000","last_became_peered":"2024-09-17T03:41:57.777035+0000","last_unstale":"2024-09-17T03:41:59.772222+0000","last_undegraded":"2024-09-17T03:41:59.772222+0000","last_fullsized":"2024-09-17T03:41:59.772222+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:41:56.750232+0000","last_clean_scrub_stamp":"2024-09-17T03:41:56.750232+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.381560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":335,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T03:41:59.788380+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:41:59.788380+0000","last_peered":"2024-09-17T03:41:59.788380+0000","last_clean":"2024-09-17T03:41:59.788380+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:41:59.788380+0000","last_undegraded":"2024-09-17T03:41:59.788380+0000","last_fullsized":"2024-09-17T03:41:59.788380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509555,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":2383872,"data_stored":1373642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":50395595},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509555,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55148,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316692,"statfs":{"total":96636764160,"available":96580292608,"internally_reserved":0,"allocated":1794048,"data_stored":782768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509555,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55136,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316704,"statfs":{"total":96636764160,"available":96580304896,"internally_reserved":0,"allocated":1781760,"data_stored":782622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509555,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50996,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320844,"statfs":{"total":96636764160,"available":96584544256,"internally_reserved":0,"allocated":1798144,"data_stored":784304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509556,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1785856,"data_stored":783204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509556,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51572,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320268,"statfs":{"total":96636764160,"available":96583954432,"internally_reserved":0,"allocated":2392064,"data_stored":1374636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":782644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574962,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":782712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:42:07.580 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:42:07.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:42:07.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.738+0000 7f6257f2b640 1 -- 172.21.15.146:0/624958741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62500b4940 msgr2=0x7f62500b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:07.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.738+0000 7f6257f2b640 1 --2- 172.21.15.146:0/624958741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62500b4940 0x7f62500b4030 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f62500afb40 tx=0x7f624c02a560 comp rx=0 tx=0).stop 2024-09-17T03:42:07.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.738+0000 7f6257f2b640 1 -- 172.21.15.146:0/624958741 shutdown_connections 2024-09-17T03:42:07.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.738+0000 7f6257f2b640 1 --2- 172.21.15.146:0/624958741 >> v2:172.21.15.179:3300/0 conn(0x7f6250152690 0x7f625015f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.738+0000 7f6257f2b640 1 --2- 172.21.15.146:0/624958741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62500b4940 0x7f62500b4030 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.738+0000 7f6257f2b640 1 -- 172.21.15.146:0/624958741 >> 172.21.15.146:0/624958741 conn(0x7f62500b2950 msgr2=0x7f625006cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:07.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.738+0000 7f6257f2b640 1 -- 172.21.15.146:0/624958741 shutdown_connections 2024-09-17T03:42:07.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.738+0000 7f6257f2b640 1 -- 172.21.15.146:0/624958741 wait complete. 2024-09-17T03:42:07.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.740+0000 7f6257f2b640 1 Processor -- start 2024-09-17T03:42:07.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.740+0000 7f6257f2b640 1 -- start start 2024-09-17T03:42:07.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.741+0000 7f6257f2b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62500b4940 0x7f6250149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:07.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.741+0000 7f6257f2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6250152690 0x7f625013eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:07.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.741+0000 7f6257f2b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f625015f8d0 0x7f625014acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:07.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.741+0000 7f6257f2b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62500cd0a0 con 0x7f6250152690 2024-09-17T03:42:07.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.741+0000 7f6257f2b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f62500ccf20 con 0x7f62500b4940 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.741+0000 7f6257f2b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f62500cd220 con 0x7f625015f8d0 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.741+0000 7f62554c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6250152690 0x7f625013eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.741+0000 7f62554c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6250152690 0x7f625013eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52020/0 (socket says 172.21.15.146:52020) 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.741+0000 7f62554c6640 1 -- 172.21.15.146:0/62358922 learned_addr learned my addr 172.21.15.146:0/62358922 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.741+0000 7f6255cc7640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62500b4940 0x7f6250149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.741+0000 7f62564c8640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f625015f8d0 0x7f625014acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.742+0000 7f62554c6640 1 -- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f625015f8d0 msgr2=0x7f625014acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.742+0000 7f62554c6640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f625015f8d0 0x7f625014acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.742+0000 7f62554c6640 1 -- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62500b4940 msgr2=0x7f6250149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.742+0000 7f62554c6640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62500b4940 0x7f6250149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.742+0000 7f62554c6640 1 -- 172.21.15.146:0/62358922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625013f0b0 con 0x7f6250152690 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.742+0000 7f62554c6640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6250152690 0x7f625013eb70 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f624000af40 tx=0x7f624000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.742+0000 7f62467fc640 1 -- 172.21.15.146:0/62358922 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624001c070 con 0x7f6250152690 2024-09-17T03:42:07.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.742+0000 7f62467fc640 1 -- 172.21.15.146:0/62358922 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6240007ca0 con 0x7f6250152690 2024-09-17T03:42:07.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.742+0000 7f6257f2b640 1 -- 172.21.15.146:0/62358922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6250149dc0 con 0x7f6250152690 2024-09-17T03:42:07.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.742+0000 7f62467fc640 1 -- 172.21.15.146:0/62358922 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624000f7b0 con 0x7f6250152690 2024-09-17T03:42:07.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.742+0000 7f6257f2b640 1 -- 172.21.15.146:0/62358922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625014a380 con 0x7f6250152690 2024-09-17T03:42:07.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.743+0000 7f6257f2b640 1 -- 172.21.15.146:0/62358922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6250149b30 con 0x7f6250152690 2024-09-17T03:42:07.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.744+0000 7f62467fc640 1 -- 172.21.15.146:0/62358922 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f624001f070 con 0x7f6250152690 2024-09-17T03:42:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.744+0000 7f62467fc640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6234078bc0 0x7f623407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.745+0000 7f62467fc640 1 -- 172.21.15.146:0/62358922 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f624009ce40 con 0x7f6250152690 2024-09-17T03:42:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.745+0000 7f6255cc7640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6234078bc0 0x7f623407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.745+0000 7f6255cc7640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6234078bc0 0x7f623407b0d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f624c033000 tx=0x7f624c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:07.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.749+0000 7f62467fc640 1 -- 172.21.15.146:0/62358922 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6240064bb0 con 0x7f6250152690 2024-09-17T03:42:07.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.989+0000 7f6257f2b640 1 -- 172.21.15.146:0/62358922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f62500b0050 con 0x7f6250152690 2024-09-17T03:42:07.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.992+0000 7f62467fc640 1 -- 172.21.15.146:0/62358922 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f62500b0050 con 0x7f6250152690 2024-09-17T03:42:07.991 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:42:07.992 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:42:07.992 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:42:07.992 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:42:07.992 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:42:07.992 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:42:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 -- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6234078bc0 msgr2=0x7f623407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6234078bc0 0x7f623407b0d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f624c033000 tx=0x7f624c004730 comp rx=0 tx=0).stop 2024-09-17T03:42:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 -- 172.21.15.146:0/62358922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6250152690 msgr2=0x7f625013eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6250152690 0x7f625013eb70 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f624000af40 tx=0x7f624000ce00 comp rx=0 tx=0).stop 2024-09-17T03:42:07.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 -- 172.21.15.146:0/62358922 shutdown_connections 2024-09-17T03:42:07.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6234078bc0 0x7f623407b0d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f625015f8d0 0x7f625014acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6250152690 0x7f625013eb70 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 --2- 172.21.15.146:0/62358922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62500b4940 0x7f6250149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:07.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 -- 172.21.15.146:0/62358922 >> 172.21.15.146:0/62358922 conn(0x7f62500b2950 msgr2=0x7f62500b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:07.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 -- 172.21.15.146:0/62358922 shutdown_connections 2024-09-17T03:42:07.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:07.995+0000 7f6257f2b640 1 -- 172.21.15.146:0/62358922 wait complete. 2024-09-17T03:42:08.006 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:08.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.120+0000 7fb6231e6640 1 -- 172.21.15.146:0/1045196026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb61c072680 msgr2=0x7fb61c072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.120+0000 7fb6231e6640 1 --2- 172.21.15.146:0/1045196026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb61c072680 0x7fb61c072a90 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0cfe20 tx=0x7fb60802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.120+0000 7fb6231e6640 1 -- 172.21.15.146:0/1045196026 shutdown_connections 2024-09-17T03:42:08.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.120+0000 7fb6231e6640 1 --2- 172.21.15.146:0/1045196026 >> v2:172.21.15.179:3300/0 conn(0x7fb61c0b4370 0x7fb61c0b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.120+0000 7fb6231e6640 1 --2- 172.21.15.146:0/1045196026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb61c072680 0x7fb61c072a90 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.120+0000 7fb6231e6640 1 -- 172.21.15.146:0/1045196026 >> 172.21.15.146:0/1045196026 conn(0x7fb61c0b2060 msgr2=0x7fb61c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.120+0000 7fb6231e6640 1 -- 172.21.15.146:0/1045196026 shutdown_connections 2024-09-17T03:42:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.120+0000 7fb6231e6640 1 -- 172.21.15.146:0/1045196026 wait complete. 2024-09-17T03:42:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.122+0000 7fb6231e6640 1 Processor -- start 2024-09-17T03:42:08.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.122+0000 7fb6231e6640 1 -- start start 2024-09-17T03:42:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb6231e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c072680 0x7fb61c1f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb6231e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb61c0b4370 0x7fb61c143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb6231e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb61c15b770 0x7fb61c1f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb6231e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c0b4e40 con 0x7fb61c15b770 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb6231e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c0b4cc0 con 0x7fb61c0b4370 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb6231e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb61c0b4fc0 con 0x7fb61c072680 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb621783640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb61c15b770 0x7fb61c1f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb621783640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb61c15b770 0x7fb61c1f5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52036/0 (socket says 172.21.15.146:52036) 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb621783640 1 -- 172.21.15.146:0/391379811 learned_addr learned my addr 172.21.15.146:0/391379811 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb61bfff640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb61c0b4370 0x7fb61c143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb620f82640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c072680 0x7fb61c1f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb621783640 1 -- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c072680 msgr2=0x7fb61c1f2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb621783640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c072680 0x7fb61c1f2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb621783640 1 -- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb61c0b4370 msgr2=0x7fb61c143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb621783640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb61c0b4370 0x7fb61c143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.123+0000 7fb621783640 1 -- 172.21.15.146:0/391379811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c1442f0 con 0x7fb61c15b770 2024-09-17T03:42:08.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.124+0000 7fb621783640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb61c15b770 0x7fb61c1f5910 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e990 tx=0x7fb61400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:08.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.124+0000 7fb6197fa640 1 -- 172.21.15.146:0/391379811 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614004d20 con 0x7fb61c15b770 2024-09-17T03:42:08.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.124+0000 7fb6197fa640 1 -- 172.21.15.146:0/391379811 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb61400caa0 con 0x7fb61c15b770 2024-09-17T03:42:08.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.124+0000 7fb6197fa640 1 -- 172.21.15.146:0/391379811 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614005020 con 0x7fb61c15b770 2024-09-17T03:42:08.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.124+0000 7fb6231e6640 1 -- 172.21.15.146:0/391379811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61c1f2320 con 0x7fb61c15b770 2024-09-17T03:42:08.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.124+0000 7fb6231e6640 1 -- 172.21.15.146:0/391379811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb61c1f6670 con 0x7fb61c15b770 2024-09-17T03:42:08.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.125+0000 7fb6231e6640 1 -- 172.21.15.146:0/391379811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb61c1f6100 con 0x7fb61c15b770 2024-09-17T03:42:08.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.126+0000 7fb6197fa640 1 -- 172.21.15.146:0/391379811 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6140051c0 con 0x7fb61c15b770 2024-09-17T03:42:08.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.126+0000 7fb6197fa640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb600078b90 0x7fb60007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.126+0000 7fb6197fa640 1 -- 172.21.15.146:0/391379811 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fb61409b530 con 0x7fb61c15b770 2024-09-17T03:42:08.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.126+0000 7fb620f82640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb600078b90 0x7fb60007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.127+0000 7fb620f82640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb600078b90 0x7fb60007b0a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb610000f60 tx=0x7fb610009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.131+0000 7fb6197fa640 1 -- 172.21.15.146:0/391379811 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb61c1442f0 con 0x7fb61c15b770 2024-09-17T03:42:08.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.340+0000 7fb6231e6640 1 -- 172.21.15.146:0/391379811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb61c0b5550 con 0x7fb61c15b770 2024-09-17T03:42:08.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.341+0000 7fb6197fa640 1 -- 172.21.15.146:0/391379811 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7fb614016030 con 0x7fb61c15b770 2024-09-17T03:42:08.340 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:08.340 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 -- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb600078b90 msgr2=0x7fb60007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb600078b90 0x7fb60007b0a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb610000f60 tx=0x7fb610009040 comp rx=0 tx=0).stop 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 -- 172.21.15.146:0/391379811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb61c15b770 msgr2=0x7fb61c1f5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb61c15b770 0x7fb61c1f5910 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e990 tx=0x7fb61400ee50 comp rx=0 tx=0).stop 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 -- 172.21.15.146:0/391379811 shutdown_connections 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb600078b90 0x7fb60007b0a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb61c15b770 0x7fb61c1f5910 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb61c0b4370 0x7fb61c143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 --2- 172.21.15.146:0/391379811 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb61c072680 0x7fb61c1f2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 -- 172.21.15.146:0/391379811 >> 172.21.15.146:0/391379811 conn(0x7fb61c0b2060 msgr2=0x7fb61c075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 -- 172.21.15.146:0/391379811 shutdown_connections 2024-09-17T03:42:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.343+0000 7fb6231e6640 1 -- 172.21.15.146:0/391379811 wait complete. 2024-09-17T03:42:08.757 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 104, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:41:58.134780+0000', 'modified': '2024-09-17T03:42:01.148959+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9216}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9216': {'gid': 9216, 'name': 'a', 'rank': 0, 'incarnation': 100, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6834/955598829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 955598829}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 955598829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9216, 'qdb_cluster': [9216]} 2024-09-17T03:42:08.757 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:42:08.757 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:42:08.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.875+0000 7f345ef82640 1 -- 172.21.15.146:0/1612414600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34580cdc50 msgr2=0x7f34580b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.875+0000 7f345ef82640 1 --2- 172.21.15.146:0/1612414600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34580cdc50 0x7f34580b4ba0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f3458070300 tx=0x7f345002a4b0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.875+0000 7f345ef82640 1 -- 172.21.15.146:0/1612414600 shutdown_connections 2024-09-17T03:42:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.875+0000 7f345ef82640 1 --2- 172.21.15.146:0/1612414600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34580cdc50 0x7f34580b4ba0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.875+0000 7f345ef82640 1 --2- 172.21.15.146:0/1612414600 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34580cd840 0x7f34580b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.875+0000 7f345ef82640 1 --2- 172.21.15.146:0/1612414600 >> v2:172.21.15.179:3300/0 conn(0x7f345815c8e0 0x7f345806f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.875+0000 7f345ef82640 1 -- 172.21.15.146:0/1612414600 >> 172.21.15.146:0/1612414600 conn(0x7f34580b3150 msgr2=0x7f34580b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.875+0000 7f345ef82640 1 -- 172.21.15.146:0/1612414600 shutdown_connections 2024-09-17T03:42:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.875+0000 7f345ef82640 1 -- 172.21.15.146:0/1612414600 wait complete. 2024-09-17T03:42:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.877+0000 7f345ef82640 1 Processor -- start 2024-09-17T03:42:08.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.877+0000 7f345ef82640 1 -- start start 2024-09-17T03:42:08.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.878+0000 7f345ef82640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34580cd840 0x7f34581f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.878+0000 7f345ef82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34580cdc50 0x7f34581f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.878+0000 7f345ef82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f345815c8e0 0x7f3458154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.878+0000 7f345ef82640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f34580b5470 con 0x7f34580cdc50 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.878+0000 7f345ef82640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34580b52f0 con 0x7f345815c8e0 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.878+0000 7f345ef82640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f34580b5f20 con 0x7f34580cd840 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.878+0000 7f3457fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34580cdc50 0x7f34581f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f3457fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34580cdc50 0x7f34581f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52054/0 (socket says 172.21.15.146:52054) 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f3457fff640 1 -- 172.21.15.146:0/1694197966 learned_addr learned my addr 172.21.15.146:0/1694197966 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f345d51f640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f345815c8e0 0x7f3458154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f345cd1e640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34580cd840 0x7f34581f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f3457fff640 1 -- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34580cd840 msgr2=0x7f34581f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f3457fff640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34580cd840 0x7f34581f2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f3457fff640 1 -- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f345815c8e0 msgr2=0x7f3458154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f3457fff640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f345815c8e0 0x7f3458154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f3457fff640 1 -- 172.21.15.146:0/1694197966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34581f53f0 con 0x7f34580cdc50 2024-09-17T03:42:08.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f3457fff640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34580cdc50 0x7f34581f4eb0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f344c00eb60 tx=0x7f344c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:08.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f34557fa640 1 -- 172.21.15.146:0/1694197966 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c003b70 con 0x7f34580cdc50 2024-09-17T03:42:08.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f34557fa640 1 -- 172.21.15.146:0/1694197966 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f344c003e00 con 0x7f34580cdc50 2024-09-17T03:42:08.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f345ef82640 1 -- 172.21.15.146:0/1694197966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34581566a0 con 0x7f34580cdc50 2024-09-17T03:42:08.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f34557fa640 1 -- 172.21.15.146:0/1694197966 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c004280 con 0x7f34580cdc50 2024-09-17T03:42:08.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.879+0000 7f345ef82640 1 -- 172.21.15.146:0/1694197966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3458156c60 con 0x7f34580cdc50 2024-09-17T03:42:08.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.881+0000 7f34557fa640 1 -- 172.21.15.146:0/1694197966 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f344c004420 con 0x7f34580cdc50 2024-09-17T03:42:08.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.881+0000 7f34557fa640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3444078b90 0x7f344407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.882+0000 7f34557fa640 1 -- 172.21.15.146:0/1694197966 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f344c09ba80 con 0x7f34580cdc50 2024-09-17T03:42:08.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.882+0000 7f345cd1e640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3444078b90 0x7f344407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.882+0000 7f345cd1e640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3444078b90 0x7f344407b0a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3448009ab0 tx=0x7f3448005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:08.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.883+0000 7f3465fcc740 1 Processor -- start 2024-09-17T03:42:08.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.883+0000 7f3465fcc740 1 -- start start 2024-09-17T03:42:08.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413cdf4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca0b3b0 0x56413ce02e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413ce033b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f3465fcc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56413cd4e820 con 0x56413ca34270 2024-09-17T03:42:08.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f3465fcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56413cd3dc50 con 0x56413ca13590 2024-09-17T03:42:08.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f3465fcc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56413cd41a60 con 0x56413ca0b3b0 2024-09-17T03:42:08.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f345cd1e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413cdf4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f345cd1e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413cdf4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52056/0 (socket says 172.21.15.146:52056) 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f345cd1e640 1 -- 172.21.15.146:0/545303971 learned_addr learned my addr 172.21.15.146:0/545303971 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f3457fff640 1 --2- 172.21.15.146:0/545303971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca0b3b0 0x56413ce02e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f345d51f640 1 --2- 172.21.15.146:0/545303971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413ce033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f345cd1e640 1 -- 172.21.15.146:0/545303971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca0b3b0 msgr2=0x56413ce02e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f345cd1e640 1 --2- 172.21.15.146:0/545303971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca0b3b0 0x56413ce02e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f345cd1e640 1 -- 172.21.15.146:0/545303971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 msgr2=0x56413ce033b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.884+0000 7f345cd1e640 1 --2- 172.21.15.146:0/545303971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413ce033b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.885+0000 7f345cd1e640 1 -- 172.21.15.146:0/545303971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56413ca9f850 con 0x56413ca34270 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.885+0000 7f345cd1e640 1 --2- 172.21.15.146:0/545303971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413cdf4970 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f3448011e80 tx=0x7f3448014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7affaa34623396f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.885+0000 7f343e7fc640 1 -- 172.21.15.146:0/545303971 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448003d70 con 0x56413ca34270 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.885+0000 7f343e7fc640 1 -- 172.21.15.146:0/545303971 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34480044d0 con 0x56413ca34270 2024-09-17T03:42:08.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.885+0000 7f343e7fc640 1 -- 172.21.15.146:0/545303971 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344801e660 con 0x56413ca34270 2024-09-17T03:42:08.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.886+0000 7f3465fcc740 1 -- 172.21.15.146:0/545303971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 msgr2=0x56413cdf4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.886+0000 7f3465fcc740 1 --2- 172.21.15.146:0/545303971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413cdf4970 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f3448011e80 tx=0x7f3448014000 comp rx=0 tx=0).stop 2024-09-17T03:42:08.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.886+0000 7f3465fcc740 1 -- 172.21.15.146:0/545303971 shutdown_connections 2024-09-17T03:42:08.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.886+0000 7f3465fcc740 1 --2- 172.21.15.146:0/545303971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413ce033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.886+0000 7f3465fcc740 1 --2- 172.21.15.146:0/545303971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca0b3b0 0x56413ce02e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.886+0000 7f3465fcc740 1 --2- 172.21.15.146:0/545303971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413cdf4970 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.886+0000 7f3465fcc740 1 -- 172.21.15.146:0/545303971 >> 172.21.15.146:0/545303971 conn(0x56413ca283c0 msgr2=0x56413cddc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:08.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.886+0000 7f3465fcc740 1 -- 172.21.15.146:0/545303971 shutdown_connections 2024-09-17T03:42:08.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.886+0000 7f3465fcc740 1 -- 172.21.15.146:0/545303971 wait complete. 2024-09-17T03:42:08.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.887+0000 7f3465fcc740 1 -- start start 2024-09-17T03:42:08.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.887+0000 7f3465fcc740 1 Processor -- start 2024-09-17T03:42:08.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca0b3b0 0x56413ce16ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca13590 0x56413ce1a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce18070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f3465fcc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56413caae620 con 0x56413ca34270 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f3465fcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56413cce35f0 con 0x56413ca0b3b0 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f3465fcc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56413ce193b0 con 0x56413ca13590 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f3465fcc740 10 client.0 _ll_register_callbacks cb 0x56413cce70a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f345d51f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce18070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f345d51f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce18070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52066/0 (socket says 172.21.15.146:52066) 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f345d51f640 1 -- 172.21.15.146:0/360893484 learned_addr learned my addr 172.21.15.146:0/360893484 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f345cd1e640 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca0b3b0 0x56413ce16ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.888+0000 7f3457fff640 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca13590 0x56413ce1a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f345d51f640 1 -- 172.21.15.146:0/360893484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca13590 msgr2=0x56413ce1a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f345d51f640 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca13590 0x56413ce1a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f345d51f640 1 -- 172.21.15.146:0/360893484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca0b3b0 msgr2=0x56413ce16ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:08.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f345d51f640 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca0b3b0 0x56413ce16ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f345d51f640 1 -- 172.21.15.146:0/360893484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56413cb166b0 con 0x56413ca34270 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f345d51f640 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce18070 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f3450034040 tx=0x7f3450005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5e7a5635ebbb69 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f34377fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f34377fe640 1 -- 172.21.15.146:0/360893484 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450035040 con 0x56413ca34270 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f34377fe640 1 -- 172.21.15.146:0/360893484 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f3450004240 con 0x56413ca34270 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f3465fcc740 1 -- 172.21.15.146:0/360893484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34480044d0 con 0x56413ca34270 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f34377fe640 1 -- 172.21.15.146:0/360893484 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f3450004440 con 0x56413ca34270 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f3465fcc740 10 client.9366 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f3465fcc740 1 -- 172.21.15.146:0/360893484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x56413ce190f0 con 0x56413ca34270 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f34377fe640 1 -- 172.21.15.146:0/360893484 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34480044d0 con 0x56413ca34270 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f34377fe640 1 -- 172.21.15.146:0/360893484 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f34500036e0 con 0x56413ca34270 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f3465fcc740 10 client.9366 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:08.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f3465fcc740 10 client.9366 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f3465fcc740 20 client.9366 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f3465fcc740 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56413c9f2e40 0x56413ce42200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.889+0000 7f3465fcc740 4 client.9366 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.890+0000 7f3465fcc740 1 -- 172.21.15.146:0/360893484 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56413cd50770 con 0x56413c9f2e40 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.890+0000 7f345cd1e640 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56413c9f2e40 0x56413ce42200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.890+0000 7f34377fe640 10 client.9366 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.890+0000 7f345cd1e640 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56413c9f2e40 0x56413ce42200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d46279ffc8f05fd server_cookie=226af86730092960 in_seq=0 out_seq=0 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f34377fe640 1 -- 172.21.15.146:0/360893484 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56413cd50770 con 0x56413c9f2e40 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f34377fe640 10 client.9366 handle_command_reply: tid=0 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 1 client.9366 shutdown 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 1 -- 172.21.15.146:0/360893484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 msgr2=0x56413ce18070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce18070 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f3450034040 tx=0x7f3450005680 comp rx=0 tx=0).stop 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 1 -- 172.21.15.146:0/360893484 shutdown_connections 2024-09-17T03:42:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56413c9f2e40 0x56413ce42200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce18070 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca13590 0x56413ce1a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f34377fe640 0 client.9366 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:08.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 1 --2- 172.21.15.146:0/360893484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca0b3b0 0x56413ce16ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 1 -- 172.21.15.146:0/360893484 >> 172.21.15.146:0/360893484 conn(0x56413ca283c0 msgr2=0x56413cdd52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:08.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 1 -- 172.21.15.146:0/360893484 shutdown_connections 2024-09-17T03:42:08.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 1 -- 172.21.15.146:0/360893484 wait complete. 2024-09-17T03:42:08.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.891+0000 7f3465fcc740 20 client.9366 trim_cache size 0 max 16384 2024-09-17T03:42:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.909+0000 7f3465fcc740 1 Processor -- start 2024-09-17T03:42:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.909+0000 7f3465fcc740 1 -- start start 2024-09-17T03:42:08.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca0b3b0 0x56413cdd7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413cdd7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce02c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f3465fcc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f345806d340 con 0x56413ca34270 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f3465fcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34581f3f60 con 0x56413ca13590 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f3465fcc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f345806ccf0 con 0x56413ca0b3b0 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f345d51f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce02c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f345d51f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce02c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52082/0 (socket says 172.21.15.146:52082) 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f345d51f640 1 -- 172.21.15.146:0/3173726270 learned_addr learned my addr 172.21.15.146:0/3173726270 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f345cd1e640 1 --2- 172.21.15.146:0/3173726270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca0b3b0 0x56413cdd7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f3457fff640 1 --2- 172.21.15.146:0/3173726270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413cdd7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f345d51f640 1 -- 172.21.15.146:0/3173726270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca0b3b0 msgr2=0x56413cdd7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f345d51f640 1 --2- 172.21.15.146:0/3173726270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca0b3b0 0x56413cdd7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f345d51f640 1 -- 172.21.15.146:0/3173726270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 msgr2=0x56413cdd7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:08.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f345d51f640 1 --2- 172.21.15.146:0/3173726270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413cdd7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f345d51f640 1 -- 172.21.15.146:0/3173726270 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56413ce029a0 con 0x56413ca34270 2024-09-17T03:42:08.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f3457fff640 1 --2- 172.21.15.146:0/3173726270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413cdd7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:08.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f345d51f640 1 --2- 172.21.15.146:0/3173726270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce02c30 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f34500096a0 tx=0x7f345002a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0d09bc31c1bc72 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:08.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f343dffb640 1 -- 172.21.15.146:0/3173726270 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450035030 con 0x56413ca34270 2024-09-17T03:42:08.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f343dffb640 1 -- 172.21.15.146:0/3173726270 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34500035f0 con 0x56413ca34270 2024-09-17T03:42:08.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.911+0000 7f343dffb640 1 -- 172.21.15.146:0/3173726270 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345002ab30 con 0x56413ca34270 2024-09-17T03:42:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.912+0000 7f3465fcc740 1 -- 172.21.15.146:0/3173726270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 msgr2=0x56413ce02c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.912+0000 7f3465fcc740 1 --2- 172.21.15.146:0/3173726270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce02c30 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f34500096a0 tx=0x7f345002a4b0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.912+0000 7f3465fcc740 1 -- 172.21.15.146:0/3173726270 shutdown_connections 2024-09-17T03:42:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.912+0000 7f3465fcc740 1 --2- 172.21.15.146:0/3173726270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca34270 0x56413ce02c30 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.912+0000 7f3465fcc740 1 --2- 172.21.15.146:0/3173726270 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413cdd7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.912+0000 7f3465fcc740 1 --2- 172.21.15.146:0/3173726270 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca0b3b0 0x56413cdd7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.912+0000 7f3465fcc740 1 -- 172.21.15.146:0/3173726270 >> 172.21.15.146:0/3173726270 conn(0x56413ca283c0 msgr2=0x56413ce1ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.912+0000 7f3465fcc740 1 -- 172.21.15.146:0/3173726270 shutdown_connections 2024-09-17T03:42:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.912+0000 7f3465fcc740 1 -- 172.21.15.146:0/3173726270 wait complete. 2024-09-17T03:42:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.913+0000 7f3465fcc740 1 -- start start 2024-09-17T03:42:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.913+0000 7f3465fcc740 1 Processor -- start 2024-09-17T03:42:08.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca0b3b0 0x56413ce1dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413ce9b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f3465fcc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca34270 0x56413ce1fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f3465fcc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56413cddb830 con 0x56413ca0b3b0 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f3465fcc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56413cddb3e0 con 0x56413ca13590 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f3465fcc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56413ce18680 con 0x56413ca34270 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f3465fcc740 10 client.0 _ll_register_callbacks cb 0x7f3450009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f345cd1e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca0b3b0 0x56413ce1dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f345cd1e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca0b3b0 0x56413ce1dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52086/0 (socket says 172.21.15.146:52086) 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f345cd1e640 1 -- 172.21.15.146:0/3249043463 learned_addr learned my addr 172.21.15.146:0/3249043463 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f3457fff640 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413ce9b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f345d51f640 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca34270 0x56413ce1fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f345cd1e640 1 -- 172.21.15.146:0/3249043463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca34270 msgr2=0x56413ce1fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:08.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f345cd1e640 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca34270 0x56413ce1fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f345cd1e640 1 -- 172.21.15.146:0/3249043463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 msgr2=0x56413ce9b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f345cd1e640 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413ce9b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f345cd1e640 1 -- 172.21.15.146:0/3249043463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56413ce032f0 con 0x56413ca0b3b0 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f345cd1e640 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca0b3b0 0x56413ce1dd40 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f3448005bc0 tx=0x7f3448005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac120636f69a7ba server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f34377fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f34377fe640 1 -- 172.21.15.146:0/3249043463 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34480044d0 con 0x56413ca0b3b0 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f34377fe640 1 -- 172.21.15.146:0/3249043463 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f344801e630 con 0x56413ca0b3b0 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.915+0000 7f3465fcc740 1 -- 172.21.15.146:0/3249043463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34500035f0 con 0x56413ca0b3b0 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f34377fe640 1 -- 172.21.15.146:0/3249043463 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f3448044050 con 0x56413ca0b3b0 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f3465fcc740 10 client.9372 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f3465fcc740 1 -- 172.21.15.146:0/3249043463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x56413cea8f50 con 0x56413ca0b3b0 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f34377fe640 1 -- 172.21.15.146:0/3249043463 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34500035f0 con 0x56413ca0b3b0 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f34377fe640 1 -- 172.21.15.146:0/3249043463 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f3448047020 con 0x56413ca0b3b0 2024-09-17T03:42:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f3465fcc740 10 client.9372 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f3465fcc740 10 client.9372 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f3465fcc740 20 client.9372 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f3465fcc740 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56413cea8ad0 0x56413cdf3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f3465fcc740 4 client.9372 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f3465fcc740 1 -- 172.21.15.146:0/3249043463 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "status"}) -- 0x56413cd4c220 con 0x56413cea8ad0 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f3457fff640 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56413cea8ad0 0x56413cdf3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f34377fe640 10 client.9372 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.916+0000 7f3457fff640 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56413cea8ad0 0x56413cdf3650 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a48b2454c3ebd8 server_cookie=77ec0ddbf55558d9 in_seq=0 out_seq=0 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f34377fe640 1 -- 172.21.15.146:0/3249043463 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x56413cd4c220 con 0x56413cea8ad0 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f34377fe640 10 client.9372 handle_command_reply: tid=0 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 1 client.9372 shutdown 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 1 -- 172.21.15.146:0/3249043463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca0b3b0 msgr2=0x56413ce1dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca0b3b0 0x56413ce1dd40 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f3448005bc0 tx=0x7f3448005850 comp rx=0 tx=0).stop 2024-09-17T03:42:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 1 -- 172.21.15.146:0/3249043463 shutdown_connections 2024-09-17T03:42:08.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56413cea8ad0 0x56413cdf3650 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56413ca34270 0x56413ce1fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f34377fe640 0 client.9372 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:08.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56413ca13590 0x56413ce9b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 1 --2- 172.21.15.146:0/3249043463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56413ca0b3b0 0x56413ce1dd40 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 1 -- 172.21.15.146:0/3249043463 >> 172.21.15.146:0/3249043463 conn(0x56413ca283c0 msgr2=0x56413ce16d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:08.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 1 -- 172.21.15.146:0/3249043463 shutdown_connections 2024-09-17T03:42:08.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 1 -- 172.21.15.146:0/3249043463 wait complete. 2024-09-17T03:42:08.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.917+0000 7f3465fcc740 20 client.9372 trim_cache size 0 max 16384 2024-09-17T03:42:08.921 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 9216, 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.139486460000001, 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 104, 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 143, 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 143, 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 14.802505701999999 2024-09-17T03:42:08.922 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:42:08.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 -- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3444078b90 msgr2=0x7f344407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3444078b90 0x7f344407b0a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3448009ab0 tx=0x7f3448005f90 comp rx=0 tx=0).stop 2024-09-17T03:42:08.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 -- 172.21.15.146:0/1694197966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34580cdc50 msgr2=0x7f34581f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:08.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34580cdc50 0x7f34581f4eb0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f344c00eb60 tx=0x7f344c00c6a0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 -- 172.21.15.146:0/1694197966 shutdown_connections 2024-09-17T03:42:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3444078b90 0x7f344407b0a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f345815c8e0 0x7f3458154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34580cdc50 0x7f34581f4eb0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 --2- 172.21.15.146:0/1694197966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34580cd840 0x7f34581f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 -- 172.21.15.146:0/1694197966 >> 172.21.15.146:0/1694197966 conn(0x7f34580b3150 msgr2=0x7f345815b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 -- 172.21.15.146:0/1694197966 shutdown_connections 2024-09-17T03:42:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:08.918+0000 7f345ef82640 1 -- 172.21.15.146:0/1694197966 wait complete. 2024-09-17T03:42:08.928 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:42:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.043+0000 7f286d1c2640 1 -- 172.21.15.146:0/964999435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28680b4f20 msgr2=0x7f28680b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.043+0000 7f286d1c2640 1 --2- 172.21.15.146:0/964999435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28680b4f20 0x7f28680b5600 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f286809c0e0 tx=0x7f285802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:42:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.043+0000 7f286d1c2640 1 -- 172.21.15.146:0/964999435 shutdown_connections 2024-09-17T03:42:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.043+0000 7f286d1c2640 1 --2- 172.21.15.146:0/964999435 >> v2:172.21.15.179:3300/0 conn(0x7f28680b3250 0x7f28680b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.043+0000 7f286d1c2640 1 --2- 172.21.15.146:0/964999435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28680b4f20 0x7f28680b5600 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.043+0000 7f286d1c2640 1 -- 172.21.15.146:0/964999435 >> 172.21.15.146:0/964999435 conn(0x7f286809ba20 msgr2=0x7f28680b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.043+0000 7f286d1c2640 1 -- 172.21.15.146:0/964999435 shutdown_connections 2024-09-17T03:42:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.043+0000 7f286d1c2640 1 -- 172.21.15.146:0/964999435 wait complete. 2024-09-17T03:42:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.045+0000 7f286d1c2640 1 Processor -- start 2024-09-17T03:42:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.045+0000 7f286d1c2640 1 -- start start 2024-09-17T03:42:09.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.046+0000 7f286d1c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28680b2480 0x7f286815e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:09.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.046+0000 7f286d1c2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28680b3250 0x7f2868150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:09.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f286d1c2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28680b4f20 0x7f286815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:09.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f286d1c2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f28680b12a0 con 0x7f28680b2480 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f286d1c2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2868160b70 con 0x7f28680b4f20 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f286d1c2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f28681f91b0 con 0x7f28680b3250 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f2866d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28680b2480 0x7f286815e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f2866d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28680b2480 0x7f286815e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52108/0 (socket says 172.21.15.146:52108) 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f2866d9d640 1 -- 172.21.15.146:0/955945489 learned_addr learned my addr 172.21.15.146:0/955945489 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f285e59c640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28680b3250 0x7f2868150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f286759e640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28680b4f20 0x7f286815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f2866d9d640 1 -- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28680b3250 msgr2=0x7f2868150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f2866d9d640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28680b3250 0x7f2868150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f2866d9d640 1 -- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28680b4f20 msgr2=0x7f286815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f2866d9d640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28680b4f20 0x7f286815bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f2866d9d640 1 -- 172.21.15.146:0/955945489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28681f9400 con 0x7f28680b2480 2024-09-17T03:42:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f286759e640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28680b4f20 0x7f286815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f2866d9d640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28680b2480 0x7f286815e970 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f2858034040 tx=0x7f28580039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f285ffff640 1 -- 172.21.15.146:0/955945489 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285803e030 con 0x7f28680b2480 2024-09-17T03:42:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f285ffff640 1 -- 172.21.15.146:0/955945489 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28580047a0 con 0x7f28680b2480 2024-09-17T03:42:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f286d1c2640 1 -- 172.21.15.146:0/955945489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28681f96e0 con 0x7f28680b2480 2024-09-17T03:42:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f285ffff640 1 -- 172.21.15.146:0/955945489 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2858035040 con 0x7f28680b2480 2024-09-17T03:42:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.047+0000 7f286d1c2640 1 -- 172.21.15.146:0/955945489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286806faf0 con 0x7f28680b2480 2024-09-17T03:42:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.048+0000 7f286d1c2640 1 -- 172.21.15.146:0/955945489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286806e340 con 0x7f28680b2480 2024-09-17T03:42:09.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.049+0000 7f285ffff640 1 -- 172.21.15.146:0/955945489 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2858041030 con 0x7f28680b2480 2024-09-17T03:42:09.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.049+0000 7f285ffff640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 0x7f284807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:09.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.050+0000 7f285ffff640 1 -- 172.21.15.146:0/955945489 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f28580bb500 con 0x7f28680b2480 2024-09-17T03:42:09.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.050+0000 7f285e59c640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 0x7f284807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:09.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.050+0000 7f285e59c640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 0x7f284807b0d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2850005fd0 tx=0x7f2850005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.054+0000 7f285ffff640 1 -- 172.21.15.146:0/955945489 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2858083950 con 0x7f28680b2480 2024-09-17T03:42:09.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.263+0000 7f286d1c2640 1 -- 172.21.15.146:0/955945489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f28680b1f40 con 0x7f28680b2480 2024-09-17T03:42:09.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.263+0000 7f285ffff640 1 -- 172.21.15.146:0/955945489 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) ==== 53+0+73 (secure 0 0 0) 0x7f2858083250 con 0x7f28680b2480 2024-09-17T03:42:09.262 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:42:09.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.265+0000 7f286d1c2640 1 -- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 msgr2=0x7f284807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.265+0000 7f286d1c2640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 0x7f284807b0d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2850005fd0 tx=0x7f2850005850 comp rx=0 tx=0).stop 2024-09-17T03:42:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.265+0000 7f286d1c2640 1 -- 172.21.15.146:0/955945489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28680b2480 msgr2=0x7f286815e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.265+0000 7f286d1c2640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28680b2480 0x7f286815e970 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f2858034040 tx=0x7f28580039e0 comp rx=0 tx=0).stop 2024-09-17T03:42:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.265+0000 7f286d1c2640 1 -- 172.21.15.146:0/955945489 shutdown_connections 2024-09-17T03:42:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.265+0000 7f286d1c2640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2848078bc0 0x7f284807b0d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.265+0000 7f286d1c2640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f28680b4f20 0x7f286815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.265+0000 7f286d1c2640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28680b3250 0x7f2868150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.265+0000 7f286d1c2640 1 --2- 172.21.15.146:0/955945489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28680b2480 0x7f286815e970 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.265+0000 7f286d1c2640 1 -- 172.21.15.146:0/955945489 >> 172.21.15.146:0/955945489 conn(0x7f286809ba20 msgr2=0x7f28680cef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.265+0000 7f286d1c2640 1 -- 172.21.15.146:0/955945489 shutdown_connections 2024-09-17T03:42:09.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09.266+0000 7f286d1c2640 1 -- 172.21.15.146:0/955945489 wait complete. 2024-09-17T03:42:09.276 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:42:09.276 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:42:09.276 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:42:09.277 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:42:09.277 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:42:09.277 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:42:09.277 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:42:09.277 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:42:09.277 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:42:09.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:09.277 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:42:09.293 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:42:09.293 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:42:09.293 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:42:09.293 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:09.293 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:42:09.293 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:42:09.294 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42242sec preferred_lft 42242sec 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:09.295 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:42:09.296 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:42:09.296 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:42:09.296 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:09.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:09.296 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:42:09.356 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:42:09.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:09.358 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:42:09.414 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:42:09.414 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:42:09.414 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:42:09.414 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:42:09.415 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:42:09.415 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:42:09.415 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:09.415 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:42:09.415 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:42:09.415 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:42:09.415 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:09.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:42:09.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:09.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:09.540 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:42:09.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:42:09.556 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:42:09.556 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:42:09.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:09.556 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:42:09.620 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:42:09.621 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:42:09.677 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:42:09.677 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:42:09.677 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:42:09.731 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:42:09.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:09.732 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:42:09.826 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:42:09.826 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:42:09.826 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:42:09.837 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:42:09.837 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:42:09.837 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:42:09.837 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:42:09.837 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:42:09.843 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:42:09.843 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:42:09.843 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:42:09.843 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:42:09.843 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:42:09.843 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:42:09.843 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:42:09.843 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:42:09.844 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:42:09.844 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:42:09.844 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:42:09.844 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:42:09.844 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:42:09.845 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:42:09.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:09.845 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:42:09.870 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:42:09.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:09.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:09.971 INFO:teuthology.orchestra.run.smithi146.stdout:client7472 2024-09-17T03:42:09.972 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:42:09.972 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:42:09.988 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:09.988 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:09.988 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.0 2024-09-17T03:42:09.988 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:09.988 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:09.988 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:09.989 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:10.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100878 s, 104 MB/s 2024-09-17T03:42:10.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.107 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863707 s, 121 MB/s 2024-09-17T03:42:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853858 s, 123 MB/s 2024-09-17T03:42:10.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722238 s, 145 MB/s 2024-09-17T03:42:10.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.136 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730764 s, 143 MB/s 2024-09-17T03:42:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679714 s, 154 MB/s 2024-09-17T03:42:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.153 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701289 s, 150 MB/s 2024-09-17T03:42:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071929 s, 146 MB/s 2024-09-17T03:42:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658941 s, 159 MB/s 2024-09-17T03:42:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.178 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625977 s, 168 MB/s 2024-09-17T03:42:10.187 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.187 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.187 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751886 s, 139 MB/s 2024-09-17T03:42:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.195 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672972 s, 156 MB/s 2024-09-17T03:42:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.204 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712125 s, 147 MB/s 2024-09-17T03:42:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.212 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659928 s, 159 MB/s 2024-09-17T03:42:10.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.221 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684813 s, 153 MB/s 2024-09-17T03:42:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.230 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077873 s, 135 MB/s 2024-09-17T03:42:10.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.239 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745163 s, 141 MB/s 2024-09-17T03:42:10.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.248 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666046 s, 157 MB/s 2024-09-17T03:42:10.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.256 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650543 s, 161 MB/s 2024-09-17T03:42:10.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.264 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.264 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607843 s, 173 MB/s 2024-09-17T03:42:10.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.274 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835169 s, 126 MB/s 2024-09-17T03:42:10.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704816 s, 149 MB/s 2024-09-17T03:42:10.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068502 s, 153 MB/s 2024-09-17T03:42:10.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.299 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637996 s, 164 MB/s 2024-09-17T03:42:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719282 s, 146 MB/s 2024-09-17T03:42:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646872 s, 162 MB/s 2024-09-17T03:42:10.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678321 s, 155 MB/s 2024-09-17T03:42:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664272 s, 158 MB/s 2024-09-17T03:42:10.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.341 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619904 s, 169 MB/s 2024-09-17T03:42:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.350 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743535 s, 141 MB/s 2024-09-17T03:42:10.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.358 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596584 s, 176 MB/s 2024-09-17T03:42:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.367 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742808 s, 141 MB/s 2024-09-17T03:42:10.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:10.374 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:10.374 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:10.374 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.1 2024-09-17T03:42:10.374 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:10.374 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:10.374 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:10.374 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:10.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671318 s, 156 MB/s 2024-09-17T03:42:10.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.442 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644856 s, 163 MB/s 2024-09-17T03:42:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761401 s, 138 MB/s 2024-09-17T03:42:10.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627923 s, 167 MB/s 2024-09-17T03:42:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605007 s, 173 MB/s 2024-09-17T03:42:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.477 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073253 s, 143 MB/s 2024-09-17T03:42:10.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.484 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606803 s, 173 MB/s 2024-09-17T03:42:10.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.493 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736187 s, 142 MB/s 2024-09-17T03:42:10.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.502 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678992 s, 154 MB/s 2024-09-17T03:42:10.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.510 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679701 s, 154 MB/s 2024-09-17T03:42:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646536 s, 162 MB/s 2024-09-17T03:42:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636837 s, 165 MB/s 2024-09-17T03:42:10.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.534 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611287 s, 172 MB/s 2024-09-17T03:42:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770618 s, 136 MB/s 2024-09-17T03:42:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659358 s, 159 MB/s 2024-09-17T03:42:10.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.561 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676724 s, 155 MB/s 2024-09-17T03:42:10.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061322 s, 171 MB/s 2024-09-17T03:42:10.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006629 s, 158 MB/s 2024-09-17T03:42:10.584 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.585 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595818 s, 176 MB/s 2024-09-17T03:42:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654659 s, 160 MB/s 2024-09-17T03:42:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688383 s, 152 MB/s 2024-09-17T03:42:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699153 s, 150 MB/s 2024-09-17T03:42:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678472 s, 155 MB/s 2024-09-17T03:42:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.627 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687502 s, 153 MB/s 2024-09-17T03:42:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755049 s, 139 MB/s 2024-09-17T03:42:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.644 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670237 s, 156 MB/s 2024-09-17T03:42:10.653 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.653 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.653 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674985 s, 155 MB/s 2024-09-17T03:42:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638724 s, 164 MB/s 2024-09-17T03:42:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653286 s, 161 MB/s 2024-09-17T03:42:10.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.677 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650899 s, 161 MB/s 2024-09-17T03:42:10.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755693 s, 139 MB/s 2024-09-17T03:42:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715256 s, 147 MB/s 2024-09-17T03:42:10.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:10.702 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:10.702 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:10.702 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.2 2024-09-17T03:42:10.702 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:10.702 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:10.702 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:10.703 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:10.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586223 s, 179 MB/s 2024-09-17T03:42:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591894 s, 177 MB/s 2024-09-17T03:42:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645812 s, 162 MB/s 2024-09-17T03:42:10.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738625 s, 142 MB/s 2024-09-17T03:42:10.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617313 s, 170 MB/s 2024-09-17T03:42:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712246 s, 147 MB/s 2024-09-17T03:42:10.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.813 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706787 s, 148 MB/s 2024-09-17T03:42:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074709 s, 140 MB/s 2024-09-17T03:42:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593088 s, 177 MB/s 2024-09-17T03:42:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.838 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592078 s, 177 MB/s 2024-09-17T03:42:10.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725729 s, 144 MB/s 2024-09-17T03:42:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.857 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667011 s, 157 MB/s 2024-09-17T03:42:10.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585636 s, 179 MB/s 2024-09-17T03:42:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740026 s, 142 MB/s 2024-09-17T03:42:10.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643173 s, 163 MB/s 2024-09-17T03:42:10.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.892 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760013 s, 138 MB/s 2024-09-17T03:42:10.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664541 s, 158 MB/s 2024-09-17T03:42:10.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.910 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675221 s, 155 MB/s 2024-09-17T03:42:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.919 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746489 s, 140 MB/s 2024-09-17T03:42:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639516 s, 164 MB/s 2024-09-17T03:42:10.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738279 s, 142 MB/s 2024-09-17T03:42:10.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.946 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.946 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641039 s, 164 MB/s 2024-09-17T03:42:10.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765885 s, 137 MB/s 2024-09-17T03:42:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618286 s, 170 MB/s 2024-09-17T03:42:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582859 s, 180 MB/s 2024-09-17T03:42:10.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728503 s, 144 MB/s 2024-09-17T03:42:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.990 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673136 s, 156 MB/s 2024-09-17T03:42:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745193 s, 141 MB/s 2024-09-17T03:42:11.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.009 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689697 s, 152 MB/s 2024-09-17T03:42:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674463 s, 155 MB/s 2024-09-17T03:42:11.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.027 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.027 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744944 s, 141 MB/s 2024-09-17T03:42:11.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.036 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658446 s, 159 MB/s 2024-09-17T03:42:11.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:11.042 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:11.042 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:11.042 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.3 2024-09-17T03:42:11.042 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:11.042 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:11.042 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:11.043 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:11.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690887 s, 152 MB/s 2024-09-17T03:42:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.112 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627189 s, 167 MB/s 2024-09-17T03:42:11.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.121 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739803 s, 142 MB/s 2024-09-17T03:42:11.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758978 s, 138 MB/s 2024-09-17T03:42:11.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.139 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647556 s, 162 MB/s 2024-09-17T03:42:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.148 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595782 s, 176 MB/s 2024-09-17T03:42:11.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686147 s, 153 MB/s 2024-09-17T03:42:11.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.165 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646661 s, 162 MB/s 2024-09-17T03:42:11.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.175 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764216 s, 137 MB/s 2024-09-17T03:42:11.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722874 s, 145 MB/s 2024-09-17T03:42:11.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067688 s, 155 MB/s 2024-09-17T03:42:11.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666538 s, 157 MB/s 2024-09-17T03:42:11.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598301 s, 175 MB/s 2024-09-17T03:42:11.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067899 s, 154 MB/s 2024-09-17T03:42:11.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075298 s, 139 MB/s 2024-09-17T03:42:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.235 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654138 s, 160 MB/s 2024-09-17T03:42:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786482 s, 133 MB/s 2024-09-17T03:42:11.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647209 s, 162 MB/s 2024-09-17T03:42:11.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732469 s, 143 MB/s 2024-09-17T03:42:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.272 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708669 s, 148 MB/s 2024-09-17T03:42:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064055 s, 164 MB/s 2024-09-17T03:42:11.289 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.289 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.289 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603997 s, 174 MB/s 2024-09-17T03:42:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690603 s, 152 MB/s 2024-09-17T03:42:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.306 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658897 s, 159 MB/s 2024-09-17T03:42:11.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.315 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605306 s, 173 MB/s 2024-09-17T03:42:11.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644413 s, 163 MB/s 2024-09-17T03:42:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773201 s, 136 MB/s 2024-09-17T03:42:11.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644446 s, 163 MB/s 2024-09-17T03:42:11.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702199 s, 149 MB/s 2024-09-17T03:42:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.360 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007457 s, 141 MB/s 2024-09-17T03:42:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064098 s, 164 MB/s 2024-09-17T03:42:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.378 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732376 s, 143 MB/s 2024-09-17T03:42:11.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:11.385 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:11.385 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:11.386 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.4 2024-09-17T03:42:11.386 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:11.386 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:11.386 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:11.386 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:11.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:11.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729068 s, 144 MB/s 2024-09-17T03:42:11.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.454 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665932 s, 157 MB/s 2024-09-17T03:42:11.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.463 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624053 s, 168 MB/s 2024-09-17T03:42:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590483 s, 178 MB/s 2024-09-17T03:42:11.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.479 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633368 s, 166 MB/s 2024-09-17T03:42:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683705 s, 153 MB/s 2024-09-17T03:42:11.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.497 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638429 s, 164 MB/s 2024-09-17T03:42:11.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746351 s, 140 MB/s 2024-09-17T03:42:11.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.515 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689051 s, 152 MB/s 2024-09-17T03:42:11.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.524 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639124 s, 164 MB/s 2024-09-17T03:42:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.533 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665447 s, 158 MB/s 2024-09-17T03:42:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064953 s, 161 MB/s 2024-09-17T03:42:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.551 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762263 s, 138 MB/s 2024-09-17T03:42:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.561 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744692 s, 141 MB/s 2024-09-17T03:42:11.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.570 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071534 s, 147 MB/s 2024-09-17T03:42:11.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649867 s, 161 MB/s 2024-09-17T03:42:11.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.588 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722129 s, 145 MB/s 2024-09-17T03:42:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595696 s, 176 MB/s 2024-09-17T03:42:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686763 s, 153 MB/s 2024-09-17T03:42:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727755 s, 144 MB/s 2024-09-17T03:42:11.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.624 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749396 s, 140 MB/s 2024-09-17T03:42:11.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.633 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708511 s, 148 MB/s 2024-09-17T03:42:11.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.642 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657946 s, 159 MB/s 2024-09-17T03:42:11.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653389 s, 160 MB/s 2024-09-17T03:42:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.660 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719324 s, 146 MB/s 2024-09-17T03:42:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650317 s, 161 MB/s 2024-09-17T03:42:11.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.677 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656412 s, 160 MB/s 2024-09-17T03:42:11.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.686 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636166 s, 165 MB/s 2024-09-17T03:42:11.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632869 s, 166 MB/s 2024-09-17T03:42:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.702 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586084 s, 179 MB/s 2024-09-17T03:42:11.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.711 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669522 s, 157 MB/s 2024-09-17T03:42:11.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.720 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683453 s, 153 MB/s 2024-09-17T03:42:11.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:11.726 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:11.726 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:11.727 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.5 2024-09-17T03:42:11.727 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:11.727 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:11.727 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:11.727 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:11.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:11.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.787 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715614 s, 147 MB/s 2024-09-17T03:42:11.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.795 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662538 s, 158 MB/s 2024-09-17T03:42:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651519 s, 161 MB/s 2024-09-17T03:42:11.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736127 s, 142 MB/s 2024-09-17T03:42:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661787 s, 158 MB/s 2024-09-17T03:42:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.828 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060095 s, 174 MB/s 2024-09-17T03:42:11.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.838 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079285 s, 132 MB/s 2024-09-17T03:42:11.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.846 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641778 s, 163 MB/s 2024-09-17T03:42:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126991 s, 82.6 MB/s 2024-09-17T03:42:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.868 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650992 s, 161 MB/s 2024-09-17T03:42:11.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732021 s, 143 MB/s 2024-09-17T03:42:11.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.886 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670074 s, 156 MB/s 2024-09-17T03:42:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656459 s, 160 MB/s 2024-09-17T03:42:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754798 s, 139 MB/s 2024-09-17T03:42:11.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.912 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688904 s, 152 MB/s 2024-09-17T03:42:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.920 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615345 s, 170 MB/s 2024-09-17T03:42:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.928 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649828 s, 161 MB/s 2024-09-17T03:42:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760719 s, 138 MB/s 2024-09-17T03:42:11.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.946 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.946 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641492 s, 163 MB/s 2024-09-17T03:42:11.954 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.954 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.955 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728191 s, 144 MB/s 2024-09-17T03:42:11.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.964 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738238 s, 142 MB/s 2024-09-17T03:42:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643799 s, 163 MB/s 2024-09-17T03:42:11.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.980 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603718 s, 174 MB/s 2024-09-17T03:42:11.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729302 s, 144 MB/s 2024-09-17T03:42:11.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:11.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:11.997 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636111 s, 165 MB/s 2024-09-17T03:42:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735311 s, 143 MB/s 2024-09-17T03:42:12.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.015 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703831 s, 149 MB/s 2024-09-17T03:42:12.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.023 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673348 s, 156 MB/s 2024-09-17T03:42:12.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670425 s, 156 MB/s 2024-09-17T03:42:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.040 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065792 s, 159 MB/s 2024-09-17T03:42:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724932 s, 145 MB/s 2024-09-17T03:42:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.057 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070711 s, 148 MB/s 2024-09-17T03:42:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:12.064 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:12.065 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:12.065 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.6 2024-09-17T03:42:12.065 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:12.065 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:12.065 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:12.065 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:12.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:12.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.124 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671118 s, 156 MB/s 2024-09-17T03:42:12.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657374 s, 160 MB/s 2024-09-17T03:42:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666197 s, 157 MB/s 2024-09-17T03:42:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654466 s, 160 MB/s 2024-09-17T03:42:12.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.158 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637672 s, 164 MB/s 2024-09-17T03:42:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073019 s, 144 MB/s 2024-09-17T03:42:12.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.175 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633185 s, 166 MB/s 2024-09-17T03:42:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589282 s, 178 MB/s 2024-09-17T03:42:12.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.191 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645262 s, 163 MB/s 2024-09-17T03:42:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666214 s, 157 MB/s 2024-09-17T03:42:12.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.208 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628372 s, 167 MB/s 2024-09-17T03:42:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733855 s, 143 MB/s 2024-09-17T03:42:12.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.224 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580041 s, 181 MB/s 2024-09-17T03:42:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644797 s, 163 MB/s 2024-09-17T03:42:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632623 s, 166 MB/s 2024-09-17T03:42:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666565 s, 157 MB/s 2024-09-17T03:42:12.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677404 s, 155 MB/s 2024-09-17T03:42:12.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.266 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717948 s, 146 MB/s 2024-09-17T03:42:12.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683454 s, 153 MB/s 2024-09-17T03:42:12.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648446 s, 162 MB/s 2024-09-17T03:42:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670633 s, 156 MB/s 2024-09-17T03:42:12.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649664 s, 161 MB/s 2024-09-17T03:42:12.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671764 s, 156 MB/s 2024-09-17T03:42:12.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670465 s, 156 MB/s 2024-09-17T03:42:12.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676488 s, 155 MB/s 2024-09-17T03:42:12.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702988 s, 149 MB/s 2024-09-17T03:42:12.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642716 s, 163 MB/s 2024-09-17T03:42:12.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.350 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670267 s, 156 MB/s 2024-09-17T03:42:12.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.359 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733964 s, 143 MB/s 2024-09-17T03:42:12.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.367 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587858 s, 178 MB/s 2024-09-17T03:42:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727191 s, 144 MB/s 2024-09-17T03:42:12.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626399 s, 167 MB/s 2024-09-17T03:42:12.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:12.391 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:12.391 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:12.392 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.7 2024-09-17T03:42:12.392 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:12.392 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:12.392 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:12.392 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:12.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:12.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654082 s, 160 MB/s 2024-09-17T03:42:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601904 s, 174 MB/s 2024-09-17T03:42:12.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.468 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665206 s, 158 MB/s 2024-09-17T03:42:12.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.478 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739731 s, 142 MB/s 2024-09-17T03:42:12.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725971 s, 144 MB/s 2024-09-17T03:42:12.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.496 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716012 s, 146 MB/s 2024-09-17T03:42:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657697 s, 159 MB/s 2024-09-17T03:42:12.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.513 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646079 s, 162 MB/s 2024-09-17T03:42:12.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650582 s, 161 MB/s 2024-09-17T03:42:12.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.530 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602823 s, 174 MB/s 2024-09-17T03:42:12.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759521 s, 138 MB/s 2024-09-17T03:42:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717161 s, 146 MB/s 2024-09-17T03:42:12.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.559 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742508 s, 141 MB/s 2024-09-17T03:42:12.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.568 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071913 s, 146 MB/s 2024-09-17T03:42:12.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.576 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681278 s, 154 MB/s 2024-09-17T03:42:12.584 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.584 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.584 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659417 s, 159 MB/s 2024-09-17T03:42:12.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.593 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743564 s, 141 MB/s 2024-09-17T03:42:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624721 s, 168 MB/s 2024-09-17T03:42:12.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656639 s, 160 MB/s 2024-09-17T03:42:12.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.618 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647302 s, 162 MB/s 2024-09-17T03:42:12.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.626 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676788 s, 155 MB/s 2024-09-17T03:42:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681567 s, 154 MB/s 2024-09-17T03:42:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.643 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604128 s, 174 MB/s 2024-09-17T03:42:12.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.651 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651172 s, 161 MB/s 2024-09-17T03:42:12.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075928 s, 138 MB/s 2024-09-17T03:42:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638546 s, 164 MB/s 2024-09-17T03:42:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671132 s, 156 MB/s 2024-09-17T03:42:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.685 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657626 s, 159 MB/s 2024-09-17T03:42:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726162 s, 144 MB/s 2024-09-17T03:42:12.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.703 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712878 s, 147 MB/s 2024-09-17T03:42:12.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.712 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645064 s, 163 MB/s 2024-09-17T03:42:12.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.719 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601368 s, 174 MB/s 2024-09-17T03:42:12.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:12.726 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:12.726 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:12.726 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.8 2024-09-17T03:42:12.726 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:12.726 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:12.726 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:12.726 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:12.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:12.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634524 s, 165 MB/s 2024-09-17T03:42:12.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.794 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658861 s, 159 MB/s 2024-09-17T03:42:12.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754637 s, 139 MB/s 2024-09-17T03:42:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733027 s, 143 MB/s 2024-09-17T03:42:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.821 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675574 s, 155 MB/s 2024-09-17T03:42:12.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602754 s, 174 MB/s 2024-09-17T03:42:12.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682457 s, 154 MB/s 2024-09-17T03:42:12.844 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.845 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630763 s, 166 MB/s 2024-09-17T03:42:12.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062598 s, 168 MB/s 2024-09-17T03:42:12.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.861 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.861 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609413 s, 172 MB/s 2024-09-17T03:42:12.869 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.869 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.870 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724718 s, 145 MB/s 2024-09-17T03:42:12.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.878 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661277 s, 159 MB/s 2024-09-17T03:42:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650422 s, 161 MB/s 2024-09-17T03:42:12.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669404 s, 157 MB/s 2024-09-17T03:42:12.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.902 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604266 s, 174 MB/s 2024-09-17T03:42:12.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731122 s, 143 MB/s 2024-09-17T03:42:12.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.919 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658943 s, 159 MB/s 2024-09-17T03:42:12.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.928 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066058 s, 159 MB/s 2024-09-17T03:42:12.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.936 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581363 s, 180 MB/s 2024-09-17T03:42:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.944 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688965 s, 152 MB/s 2024-09-17T03:42:12.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.953 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706756 s, 148 MB/s 2024-09-17T03:42:12.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.961 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644515 s, 163 MB/s 2024-09-17T03:42:12.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.969 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654133 s, 160 MB/s 2024-09-17T03:42:12.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.977 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669763 s, 157 MB/s 2024-09-17T03:42:12.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.986 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664725 s, 158 MB/s 2024-09-17T03:42:12.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:12.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:12.994 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649078 s, 162 MB/s 2024-09-17T03:42:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.002 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.003 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065184 s, 161 MB/s 2024-09-17T03:42:13.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.010 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626575 s, 167 MB/s 2024-09-17T03:42:13.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.019 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731199 s, 143 MB/s 2024-09-17T03:42:13.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.028 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655386 s, 160 MB/s 2024-09-17T03:42:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.037 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662148 s, 158 MB/s 2024-09-17T03:42:13.045 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.045 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.045 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695906 s, 151 MB/s 2024-09-17T03:42:13.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:13.052 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:13.052 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:13.052 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.9 2024-09-17T03:42:13.052 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:13.052 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:13.052 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:13.052 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:13.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067008 s, 156 MB/s 2024-09-17T03:42:13.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.120 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750302 s, 140 MB/s 2024-09-17T03:42:13.128 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.129 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651186 s, 161 MB/s 2024-09-17T03:42:13.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.137 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679906 s, 154 MB/s 2024-09-17T03:42:13.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.145 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649263 s, 162 MB/s 2024-09-17T03:42:13.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.154 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734625 s, 143 MB/s 2024-09-17T03:42:13.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634032 s, 165 MB/s 2024-09-17T03:42:13.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.170 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592932 s, 177 MB/s 2024-09-17T03:42:13.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.178 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639003 s, 164 MB/s 2024-09-17T03:42:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.186 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614399 s, 171 MB/s 2024-09-17T03:42:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653461 s, 160 MB/s 2024-09-17T03:42:13.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.203 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760388 s, 138 MB/s 2024-09-17T03:42:13.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.212 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725138 s, 145 MB/s 2024-09-17T03:42:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664907 s, 158 MB/s 2024-09-17T03:42:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621605 s, 169 MB/s 2024-09-17T03:42:13.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.236 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608714 s, 172 MB/s 2024-09-17T03:42:13.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633327 s, 166 MB/s 2024-09-17T03:42:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662123 s, 158 MB/s 2024-09-17T03:42:13.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.262 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074891 s, 140 MB/s 2024-09-17T03:42:13.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.270 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615856 s, 170 MB/s 2024-09-17T03:42:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625401 s, 168 MB/s 2024-09-17T03:42:13.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.287 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678937 s, 154 MB/s 2024-09-17T03:42:13.295 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.295 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.295 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631442 s, 166 MB/s 2024-09-17T03:42:13.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.303 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654289 s, 160 MB/s 2024-09-17T03:42:13.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633498 s, 166 MB/s 2024-09-17T03:42:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667285 s, 157 MB/s 2024-09-17T03:42:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722189 s, 145 MB/s 2024-09-17T03:42:13.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.337 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637589 s, 164 MB/s 2024-09-17T03:42:13.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.344 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590736 s, 178 MB/s 2024-09-17T03:42:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708458 s, 148 MB/s 2024-09-17T03:42:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671461 s, 156 MB/s 2024-09-17T03:42:13.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069108 s, 152 MB/s 2024-09-17T03:42:13.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:13.377 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:13.377 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:13.377 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.10 2024-09-17T03:42:13.377 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:13.377 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:13.377 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:13.377 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:13.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658182 s, 159 MB/s 2024-09-17T03:42:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686274 s, 153 MB/s 2024-09-17T03:42:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.453 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744599 s, 141 MB/s 2024-09-17T03:42:13.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.462 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719778 s, 146 MB/s 2024-09-17T03:42:13.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.471 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664884 s, 158 MB/s 2024-09-17T03:42:13.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.479 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665457 s, 158 MB/s 2024-09-17T03:42:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074355 s, 141 MB/s 2024-09-17T03:42:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738257 s, 142 MB/s 2024-09-17T03:42:13.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736724 s, 142 MB/s 2024-09-17T03:42:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618905 s, 169 MB/s 2024-09-17T03:42:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662786 s, 158 MB/s 2024-09-17T03:42:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741134 s, 141 MB/s 2024-09-17T03:42:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.541 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649227 s, 162 MB/s 2024-09-17T03:42:13.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710491 s, 148 MB/s 2024-09-17T03:42:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665527 s, 158 MB/s 2024-09-17T03:42:13.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693206 s, 151 MB/s 2024-09-17T03:42:13.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067321 s, 156 MB/s 2024-09-17T03:42:13.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.583 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722719 s, 145 MB/s 2024-09-17T03:42:13.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681334 s, 154 MB/s 2024-09-17T03:42:13.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.600 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667747 s, 157 MB/s 2024-09-17T03:42:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.608 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633271 s, 166 MB/s 2024-09-17T03:42:13.617 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.617 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.617 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723012 s, 145 MB/s 2024-09-17T03:42:13.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663359 s, 158 MB/s 2024-09-17T03:42:13.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.633 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633353 s, 166 MB/s 2024-09-17T03:42:13.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.642 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064462 s, 163 MB/s 2024-09-17T03:42:13.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.651 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763059 s, 137 MB/s 2024-09-17T03:42:13.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.660 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736222 s, 142 MB/s 2024-09-17T03:42:13.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724194 s, 145 MB/s 2024-09-17T03:42:13.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.677 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597933 s, 175 MB/s 2024-09-17T03:42:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615319 s, 170 MB/s 2024-09-17T03:42:13.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727594 s, 144 MB/s 2024-09-17T03:42:13.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.702 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678728 s, 154 MB/s 2024-09-17T03:42:13.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:13.709 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:13.709 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:13.709 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.11 2024-09-17T03:42:13.709 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:13.709 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:13.710 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:13.710 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:13.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:13.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655682 s, 160 MB/s 2024-09-17T03:42:13.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.777 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687242 s, 153 MB/s 2024-09-17T03:42:13.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681229 s, 154 MB/s 2024-09-17T03:42:13.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.795 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686866 s, 153 MB/s 2024-09-17T03:42:13.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.804 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705398 s, 149 MB/s 2024-09-17T03:42:13.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.813 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074725 s, 140 MB/s 2024-09-17T03:42:13.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.823 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740257 s, 142 MB/s 2024-09-17T03:42:13.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712518 s, 147 MB/s 2024-09-17T03:42:13.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734661 s, 143 MB/s 2024-09-17T03:42:13.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.851 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075673 s, 139 MB/s 2024-09-17T03:42:13.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.858 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604741 s, 173 MB/s 2024-09-17T03:42:13.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584483 s, 179 MB/s 2024-09-17T03:42:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643419 s, 163 MB/s 2024-09-17T03:42:13.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.882 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638124 s, 164 MB/s 2024-09-17T03:42:13.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.892 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723938 s, 145 MB/s 2024-09-17T03:42:13.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.900 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725393 s, 145 MB/s 2024-09-17T03:42:13.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635128 s, 165 MB/s 2024-09-17T03:42:13.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.917 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007573 s, 138 MB/s 2024-09-17T03:42:13.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.926 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677511 s, 155 MB/s 2024-09-17T03:42:13.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.934 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061832 s, 170 MB/s 2024-09-17T03:42:13.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.943 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744016 s, 141 MB/s 2024-09-17T03:42:13.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.952 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744942 s, 141 MB/s 2024-09-17T03:42:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.962 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074882 s, 140 MB/s 2024-09-17T03:42:13.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.971 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745029 s, 141 MB/s 2024-09-17T03:42:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.979 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637529 s, 164 MB/s 2024-09-17T03:42:13.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.987 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648031 s, 162 MB/s 2024-09-17T03:42:13.995 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:13.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:13.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713317 s, 147 MB/s 2024-09-17T03:42:14.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.004 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717642 s, 146 MB/s 2024-09-17T03:42:14.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.014 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743742 s, 141 MB/s 2024-09-17T03:42:14.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.022 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673301 s, 156 MB/s 2024-09-17T03:42:14.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666158 s, 157 MB/s 2024-09-17T03:42:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660824 s, 159 MB/s 2024-09-17T03:42:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:14.045 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:14.045 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:14.045 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.12 2024-09-17T03:42:14.045 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:14.045 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:14.045 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:14.045 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:14.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.105 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758448 s, 138 MB/s 2024-09-17T03:42:14.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.113 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064825 s, 162 MB/s 2024-09-17T03:42:14.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.122 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769699 s, 136 MB/s 2024-09-17T03:42:14.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633988 s, 165 MB/s 2024-09-17T03:42:14.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.139 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690139 s, 152 MB/s 2024-09-17T03:42:14.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827265 s, 127 MB/s 2024-09-17T03:42:14.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.158 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675938 s, 155 MB/s 2024-09-17T03:42:14.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675233 s, 155 MB/s 2024-09-17T03:42:14.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.175 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607197 s, 173 MB/s 2024-09-17T03:42:14.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652182 s, 161 MB/s 2024-09-17T03:42:14.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673158 s, 156 MB/s 2024-09-17T03:42:14.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671091 s, 156 MB/s 2024-09-17T03:42:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741022 s, 142 MB/s 2024-09-17T03:42:14.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.220 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066026 s, 159 MB/s 2024-09-17T03:42:14.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755159 s, 139 MB/s 2024-09-17T03:42:14.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.239 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00791737 s, 132 MB/s 2024-09-17T03:42:14.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.248 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701871 s, 149 MB/s 2024-09-17T03:42:14.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.256 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577583 s, 182 MB/s 2024-09-17T03:42:14.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723127 s, 145 MB/s 2024-09-17T03:42:14.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745363 s, 141 MB/s 2024-09-17T03:42:14.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.284 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.284 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066245 s, 158 MB/s 2024-09-17T03:42:14.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.292 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652364 s, 161 MB/s 2024-09-17T03:42:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634564 s, 165 MB/s 2024-09-17T03:42:14.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.309 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641751 s, 163 MB/s 2024-09-17T03:42:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656977 s, 160 MB/s 2024-09-17T03:42:14.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.326 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659748 s, 159 MB/s 2024-09-17T03:42:14.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.336 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728787 s, 144 MB/s 2024-09-17T03:42:14.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.345 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645714 s, 162 MB/s 2024-09-17T03:42:14.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.353 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633148 s, 166 MB/s 2024-09-17T03:42:14.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764538 s, 137 MB/s 2024-09-17T03:42:14.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.372 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073234 s, 143 MB/s 2024-09-17T03:42:14.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.381 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674139 s, 156 MB/s 2024-09-17T03:42:14.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:14.387 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:14.387 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:14.387 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.13 2024-09-17T03:42:14.387 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:14.387 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:14.387 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:14.388 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:14.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621003 s, 169 MB/s 2024-09-17T03:42:14.455 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.455 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.455 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671612 s, 156 MB/s 2024-09-17T03:42:14.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.464 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662295 s, 158 MB/s 2024-09-17T03:42:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735925 s, 142 MB/s 2024-09-17T03:42:14.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603881 s, 174 MB/s 2024-09-17T03:42:14.489 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.490 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585384 s, 179 MB/s 2024-09-17T03:42:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649315 s, 161 MB/s 2024-09-17T03:42:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645715 s, 162 MB/s 2024-09-17T03:42:14.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.516 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646058 s, 162 MB/s 2024-09-17T03:42:14.525 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.525 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.525 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804767 s, 130 MB/s 2024-09-17T03:42:14.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.534 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713303 s, 147 MB/s 2024-09-17T03:42:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672545 s, 156 MB/s 2024-09-17T03:42:14.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.551 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647451 s, 162 MB/s 2024-09-17T03:42:14.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.559 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691205 s, 152 MB/s 2024-09-17T03:42:14.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721778 s, 145 MB/s 2024-09-17T03:42:14.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666375 s, 157 MB/s 2024-09-17T03:42:14.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.585 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676209 s, 155 MB/s 2024-09-17T03:42:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760888 s, 138 MB/s 2024-09-17T03:42:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.603 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668826 s, 157 MB/s 2024-09-17T03:42:14.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.611 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059977 s, 175 MB/s 2024-09-17T03:42:14.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.620 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726733 s, 144 MB/s 2024-09-17T03:42:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611195 s, 172 MB/s 2024-09-17T03:42:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775024 s, 135 MB/s 2024-09-17T03:42:14.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681598 s, 154 MB/s 2024-09-17T03:42:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067637 s, 155 MB/s 2024-09-17T03:42:14.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.663 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729064 s, 144 MB/s 2024-09-17T03:42:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066269 s, 158 MB/s 2024-09-17T03:42:14.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.679 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577744 s, 181 MB/s 2024-09-17T03:42:14.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.688 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742351 s, 141 MB/s 2024-09-17T03:42:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688435 s, 152 MB/s 2024-09-17T03:42:14.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.705 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662273 s, 158 MB/s 2024-09-17T03:42:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740402 s, 142 MB/s 2024-09-17T03:42:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:14.721 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:14.721 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:14.721 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.14 2024-09-17T03:42:14.721 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:14.721 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:14.721 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:14.721 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:14.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746883 s, 140 MB/s 2024-09-17T03:42:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901287 s, 116 MB/s 2024-09-17T03:42:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668661 s, 157 MB/s 2024-09-17T03:42:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.808 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644452 s, 163 MB/s 2024-09-17T03:42:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.817 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669522 s, 157 MB/s 2024-09-17T03:42:14.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638819 s, 164 MB/s 2024-09-17T03:42:14.833 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.833 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706737 s, 148 MB/s 2024-09-17T03:42:14.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.842 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664599 s, 158 MB/s 2024-09-17T03:42:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.850 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651905 s, 161 MB/s 2024-09-17T03:42:14.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.857 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602739 s, 174 MB/s 2024-09-17T03:42:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066223 s, 158 MB/s 2024-09-17T03:42:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.875 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735979 s, 142 MB/s 2024-09-17T03:42:14.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588606 s, 178 MB/s 2024-09-17T03:42:14.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.891 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654827 s, 160 MB/s 2024-09-17T03:42:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068386 s, 153 MB/s 2024-09-17T03:42:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752449 s, 139 MB/s 2024-09-17T03:42:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.917 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651358 s, 161 MB/s 2024-09-17T03:42:14.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.924 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594432 s, 176 MB/s 2024-09-17T03:42:14.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.934 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752501 s, 139 MB/s 2024-09-17T03:42:14.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.942 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679692 s, 154 MB/s 2024-09-17T03:42:14.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635 s, 165 MB/s 2024-09-17T03:42:14.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.958 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674063 s, 156 MB/s 2024-09-17T03:42:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.966 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625199 s, 168 MB/s 2024-09-17T03:42:14.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.976 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744346 s, 141 MB/s 2024-09-17T03:42:14.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603784 s, 174 MB/s 2024-09-17T03:42:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:14.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671478 s, 156 MB/s 2024-09-17T03:42:15.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.000 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681805 s, 154 MB/s 2024-09-17T03:42:15.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.008 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582829 s, 180 MB/s 2024-09-17T03:42:15.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769293 s, 136 MB/s 2024-09-17T03:42:15.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.026 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657499 s, 159 MB/s 2024-09-17T03:42:15.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.033 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606086 s, 173 MB/s 2024-09-17T03:42:15.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662412 s, 158 MB/s 2024-09-17T03:42:15.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:15.049 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:15.049 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:15.049 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.15 2024-09-17T03:42:15.049 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:15.049 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:15.049 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:15.049 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:15.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682726 s, 154 MB/s 2024-09-17T03:42:15.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.116 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723059 s, 145 MB/s 2024-09-17T03:42:15.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.126 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744726 s, 141 MB/s 2024-09-17T03:42:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592 s, 177 MB/s 2024-09-17T03:42:15.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.142 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659893 s, 159 MB/s 2024-09-17T03:42:15.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706064 s, 149 MB/s 2024-09-17T03:42:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.158 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632826 s, 166 MB/s 2024-09-17T03:42:15.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629362 s, 167 MB/s 2024-09-17T03:42:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743366 s, 141 MB/s 2024-09-17T03:42:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718225 s, 146 MB/s 2024-09-17T03:42:15.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650446 s, 161 MB/s 2024-09-17T03:42:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734435 s, 143 MB/s 2024-09-17T03:42:15.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.210 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583754 s, 180 MB/s 2024-09-17T03:42:15.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641765 s, 163 MB/s 2024-09-17T03:42:15.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.226 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064706 s, 162 MB/s 2024-09-17T03:42:15.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.234 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627504 s, 167 MB/s 2024-09-17T03:42:15.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.242 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656196 s, 160 MB/s 2024-09-17T03:42:15.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674142 s, 156 MB/s 2024-09-17T03:42:15.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.259 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633786 s, 165 MB/s 2024-09-17T03:42:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059922 s, 175 MB/s 2024-09-17T03:42:15.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665977 s, 157 MB/s 2024-09-17T03:42:15.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064293 s, 163 MB/s 2024-09-17T03:42:15.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657944 s, 159 MB/s 2024-09-17T03:42:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659138 s, 159 MB/s 2024-09-17T03:42:15.307 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.307 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666349 s, 157 MB/s 2024-09-17T03:42:15.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.317 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757682 s, 138 MB/s 2024-09-17T03:42:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606036 s, 173 MB/s 2024-09-17T03:42:15.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620244 s, 169 MB/s 2024-09-17T03:42:15.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741724 s, 141 MB/s 2024-09-17T03:42:15.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.350 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680359 s, 154 MB/s 2024-09-17T03:42:15.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.359 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655114 s, 160 MB/s 2024-09-17T03:42:15.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.368 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.368 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074389 s, 141 MB/s 2024-09-17T03:42:15.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:15.374 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:15.374 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:15.375 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.16 2024-09-17T03:42:15.375 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:15.375 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:15.375 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:15.375 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:15.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.433 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677376 s, 155 MB/s 2024-09-17T03:42:15.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.441 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654425 s, 160 MB/s 2024-09-17T03:42:15.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.449 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066386 s, 158 MB/s 2024-09-17T03:42:15.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.458 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731715 s, 143 MB/s 2024-09-17T03:42:15.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.467 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671056 s, 156 MB/s 2024-09-17T03:42:15.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724024 s, 145 MB/s 2024-09-17T03:42:15.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.485 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712492 s, 147 MB/s 2024-09-17T03:42:15.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.494 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754182 s, 139 MB/s 2024-09-17T03:42:15.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.501 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595188 s, 176 MB/s 2024-09-17T03:42:15.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.510 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666831 s, 157 MB/s 2024-09-17T03:42:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657599 s, 159 MB/s 2024-09-17T03:42:15.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734389 s, 143 MB/s 2024-09-17T03:42:15.537 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.537 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.537 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667019 s, 157 MB/s 2024-09-17T03:42:15.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588338 s, 178 MB/s 2024-09-17T03:42:15.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693882 s, 151 MB/s 2024-09-17T03:42:15.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.561 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758618 s, 138 MB/s 2024-09-17T03:42:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671875 s, 156 MB/s 2024-09-17T03:42:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746457 s, 140 MB/s 2024-09-17T03:42:15.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.587 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689381 s, 152 MB/s 2024-09-17T03:42:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.595 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666279 s, 157 MB/s 2024-09-17T03:42:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602152 s, 174 MB/s 2024-09-17T03:42:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634658 s, 165 MB/s 2024-09-17T03:42:15.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.721 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692664 s, 151 MB/s 2024-09-17T03:42:15.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.724 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748332 s, 140 MB/s 2024-09-17T03:42:15.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.724 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622089 s, 169 MB/s 2024-09-17T03:42:15.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645365 s, 162 MB/s 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643304 s, 163 MB/s 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607868 s, 173 MB/s 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061256 s, 171 MB/s 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.725 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675392 s, 155 MB/s 2024-09-17T03:42:15.726 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.726 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.726 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063644 s, 165 MB/s 2024-09-17T03:42:15.726 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.726 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.726 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666456 s, 157 MB/s 2024-09-17T03:42:15.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:15.727 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:15.727 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:15.727 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.17 2024-09-17T03:42:15.727 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:15.727 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:15.728 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:15.728 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:15.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:15.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.787 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661242 s, 159 MB/s 2024-09-17T03:42:15.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.795 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638866 s, 164 MB/s 2024-09-17T03:42:15.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663035 s, 158 MB/s 2024-09-17T03:42:15.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.811 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607044 s, 173 MB/s 2024-09-17T03:42:15.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.819 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648693 s, 162 MB/s 2024-09-17T03:42:15.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.828 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718343 s, 146 MB/s 2024-09-17T03:42:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065723 s, 160 MB/s 2024-09-17T03:42:15.844 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.844 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.845 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662034 s, 158 MB/s 2024-09-17T03:42:15.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634826 s, 165 MB/s 2024-09-17T03:42:15.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750834 s, 140 MB/s 2024-09-17T03:42:15.871 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.871 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.871 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720153 s, 146 MB/s 2024-09-17T03:42:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691471 s, 152 MB/s 2024-09-17T03:42:15.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.888 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714695 s, 147 MB/s 2024-09-17T03:42:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073059 s, 144 MB/s 2024-09-17T03:42:15.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714875 s, 147 MB/s 2024-09-17T03:42:15.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676845 s, 155 MB/s 2024-09-17T03:42:15.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.923 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669552 s, 157 MB/s 2024-09-17T03:42:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059285 s, 177 MB/s 2024-09-17T03:42:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.939 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659215 s, 159 MB/s 2024-09-17T03:42:15.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.948 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737307 s, 142 MB/s 2024-09-17T03:42:15.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662595 s, 158 MB/s 2024-09-17T03:42:15.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.964 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599752 s, 175 MB/s 2024-09-17T03:42:15.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.974 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724299 s, 145 MB/s 2024-09-17T03:42:15.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067812 s, 155 MB/s 2024-09-17T03:42:15.990 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.991 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689538 s, 152 MB/s 2024-09-17T03:42:15.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:15.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:15.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667144 s, 157 MB/s 2024-09-17T03:42:16.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633996 s, 165 MB/s 2024-09-17T03:42:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.015 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633845 s, 165 MB/s 2024-09-17T03:42:16.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.024 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.024 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685827 s, 153 MB/s 2024-09-17T03:42:16.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063052 s, 166 MB/s 2024-09-17T03:42:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728196 s, 144 MB/s 2024-09-17T03:42:16.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.050 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717722 s, 146 MB/s 2024-09-17T03:42:16.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:16.056 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:16.056 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:16.056 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.18 2024-09-17T03:42:16.056 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:16.057 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:16.057 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:16.057 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:16.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:16.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.116 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755613 s, 139 MB/s 2024-09-17T03:42:16.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.125 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740186 s, 142 MB/s 2024-09-17T03:42:16.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.134 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674519 s, 155 MB/s 2024-09-17T03:42:16.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.142 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620593 s, 169 MB/s 2024-09-17T03:42:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064925 s, 162 MB/s 2024-09-17T03:42:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666042 s, 157 MB/s 2024-09-17T03:42:16.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.166 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633535 s, 166 MB/s 2024-09-17T03:42:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672114 s, 156 MB/s 2024-09-17T03:42:16.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.183 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668929 s, 157 MB/s 2024-09-17T03:42:16.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.192 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683108 s, 154 MB/s 2024-09-17T03:42:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.200 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634775 s, 165 MB/s 2024-09-17T03:42:16.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.208 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641714 s, 163 MB/s 2024-09-17T03:42:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.216 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634011 s, 165 MB/s 2024-09-17T03:42:16.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.225 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682405 s, 154 MB/s 2024-09-17T03:42:16.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066407 s, 158 MB/s 2024-09-17T03:42:16.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635344 s, 165 MB/s 2024-09-17T03:42:16.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.249 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665314 s, 158 MB/s 2024-09-17T03:42:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659464 s, 159 MB/s 2024-09-17T03:42:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678312 s, 155 MB/s 2024-09-17T03:42:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742223 s, 141 MB/s 2024-09-17T03:42:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657672 s, 159 MB/s 2024-09-17T03:42:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631862 s, 166 MB/s 2024-09-17T03:42:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757024 s, 139 MB/s 2024-09-17T03:42:16.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631474 s, 166 MB/s 2024-09-17T03:42:16.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.317 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661244 s, 159 MB/s 2024-09-17T03:42:16.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616941 s, 170 MB/s 2024-09-17T03:42:16.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738087 s, 142 MB/s 2024-09-17T03:42:16.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683986 s, 153 MB/s 2024-09-17T03:42:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719515 s, 146 MB/s 2024-09-17T03:42:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651642 s, 161 MB/s 2024-09-17T03:42:16.368 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.368 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.368 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675542 s, 155 MB/s 2024-09-17T03:42:16.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600871 s, 175 MB/s 2024-09-17T03:42:16.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:16.382 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:16.382 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:16.383 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.19 2024-09-17T03:42:16.383 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:16.383 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:16.383 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:16.383 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:16.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:16.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.441 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677146 s, 155 MB/s 2024-09-17T03:42:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654257 s, 160 MB/s 2024-09-17T03:42:16.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.457 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597948 s, 175 MB/s 2024-09-17T03:42:16.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.465 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625478 s, 168 MB/s 2024-09-17T03:42:16.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656138 s, 160 MB/s 2024-09-17T03:42:16.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726039 s, 144 MB/s 2024-09-17T03:42:16.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670765 s, 156 MB/s 2024-09-17T03:42:16.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.499 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640077 s, 164 MB/s 2024-09-17T03:42:16.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630298 s, 166 MB/s 2024-09-17T03:42:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727562 s, 144 MB/s 2024-09-17T03:42:16.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.525 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642915 s, 163 MB/s 2024-09-17T03:42:16.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.532 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621707 s, 169 MB/s 2024-09-17T03:42:16.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.541 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637973 s, 164 MB/s 2024-09-17T03:42:16.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649083 s, 162 MB/s 2024-09-17T03:42:16.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.558 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752468 s, 139 MB/s 2024-09-17T03:42:16.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633243 s, 166 MB/s 2024-09-17T03:42:16.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575385 s, 182 MB/s 2024-09-17T03:42:16.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653216 s, 161 MB/s 2024-09-17T03:42:16.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.591 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662998 s, 158 MB/s 2024-09-17T03:42:16.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733265 s, 143 MB/s 2024-09-17T03:42:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655608 s, 160 MB/s 2024-09-17T03:42:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671998 s, 156 MB/s 2024-09-17T03:42:16.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.625 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743206 s, 141 MB/s 2024-09-17T03:42:16.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.634 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746014 s, 141 MB/s 2024-09-17T03:42:16.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.642 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663294 s, 158 MB/s 2024-09-17T03:42:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.651 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667311 s, 157 MB/s 2024-09-17T03:42:16.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.660 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761232 s, 138 MB/s 2024-09-17T03:42:16.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674784 s, 155 MB/s 2024-09-17T03:42:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.678 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722222 s, 145 MB/s 2024-09-17T03:42:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721376 s, 145 MB/s 2024-09-17T03:42:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653308 s, 161 MB/s 2024-09-17T03:42:16.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.704 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702425 s, 149 MB/s 2024-09-17T03:42:16.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:16.710 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:16.710 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:16.710 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.20 2024-09-17T03:42:16.710 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:16.710 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:16.710 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:16.710 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:16.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.769 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703525 s, 149 MB/s 2024-09-17T03:42:16.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.777 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617921 s, 170 MB/s 2024-09-17T03:42:16.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.785 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684531 s, 153 MB/s 2024-09-17T03:42:16.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.795 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737391 s, 142 MB/s 2024-09-17T03:42:16.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699815 s, 150 MB/s 2024-09-17T03:42:16.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.813 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749033 s, 140 MB/s 2024-09-17T03:42:16.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.821 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668535 s, 157 MB/s 2024-09-17T03:42:16.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.830 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744931 s, 141 MB/s 2024-09-17T03:42:16.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073445 s, 143 MB/s 2024-09-17T03:42:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677881 s, 155 MB/s 2024-09-17T03:42:16.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642733 s, 163 MB/s 2024-09-17T03:42:16.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657137 s, 160 MB/s 2024-09-17T03:42:16.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682245 s, 154 MB/s 2024-09-17T03:42:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068413 s, 153 MB/s 2024-09-17T03:42:16.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727887 s, 144 MB/s 2024-09-17T03:42:16.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664852 s, 158 MB/s 2024-09-17T03:42:16.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.907 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006694 s, 157 MB/s 2024-09-17T03:42:16.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634337 s, 165 MB/s 2024-09-17T03:42:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646216 s, 162 MB/s 2024-09-17T03:42:16.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640913 s, 164 MB/s 2024-09-17T03:42:16.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.939 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606324 s, 173 MB/s 2024-09-17T03:42:16.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.949 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763158 s, 137 MB/s 2024-09-17T03:42:16.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619168 s, 169 MB/s 2024-09-17T03:42:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065718 s, 160 MB/s 2024-09-17T03:42:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.974 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669835 s, 157 MB/s 2024-09-17T03:42:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723191 s, 145 MB/s 2024-09-17T03:42:16.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:16.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:16.991 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691127 s, 152 MB/s 2024-09-17T03:42:16.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.000 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684313 s, 153 MB/s 2024-09-17T03:42:17.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.008 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682921 s, 154 MB/s 2024-09-17T03:42:17.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699045 s, 150 MB/s 2024-09-17T03:42:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747739 s, 140 MB/s 2024-09-17T03:42:17.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.034 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672416 s, 156 MB/s 2024-09-17T03:42:17.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:17.042 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:17.042 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:17.042 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.21 2024-09-17T03:42:17.042 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:17.042 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:17.042 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:17.042 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:17.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:17.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133211 s, 78.7 MB/s 2024-09-17T03:42:17.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.117 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.117 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723472 s, 145 MB/s 2024-09-17T03:42:17.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.125 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067095 s, 156 MB/s 2024-09-17T03:42:17.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.133 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652994 s, 161 MB/s 2024-09-17T03:42:17.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.143 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768551 s, 136 MB/s 2024-09-17T03:42:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.152 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726834 s, 144 MB/s 2024-09-17T03:42:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624085 s, 168 MB/s 2024-09-17T03:42:17.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.168 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627289 s, 167 MB/s 2024-09-17T03:42:17.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.176 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670301 s, 156 MB/s 2024-09-17T03:42:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065906 s, 159 MB/s 2024-09-17T03:42:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646309 s, 162 MB/s 2024-09-17T03:42:17.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678546 s, 155 MB/s 2024-09-17T03:42:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654496 s, 160 MB/s 2024-09-17T03:42:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597784 s, 175 MB/s 2024-09-17T03:42:17.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.226 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712241 s, 147 MB/s 2024-09-17T03:42:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669387 s, 157 MB/s 2024-09-17T03:42:17.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740367 s, 142 MB/s 2024-09-17T03:42:17.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.251 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060427 s, 174 MB/s 2024-09-17T03:42:17.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.260 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662708 s, 158 MB/s 2024-09-17T03:42:17.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594158 s, 176 MB/s 2024-09-17T03:42:17.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.276 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723404 s, 145 MB/s 2024-09-17T03:42:17.284 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.285 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668316 s, 157 MB/s 2024-09-17T03:42:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604585 s, 173 MB/s 2024-09-17T03:42:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.301 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721929 s, 145 MB/s 2024-09-17T03:42:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006661 s, 157 MB/s 2024-09-17T03:42:17.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.319 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726932 s, 144 MB/s 2024-09-17T03:42:17.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.328 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069495 s, 151 MB/s 2024-09-17T03:42:17.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.337 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745962 s, 141 MB/s 2024-09-17T03:42:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.345 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668131 s, 157 MB/s 2024-09-17T03:42:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752958 s, 139 MB/s 2024-09-17T03:42:17.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.363 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715773 s, 146 MB/s 2024-09-17T03:42:17.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.372 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733078 s, 143 MB/s 2024-09-17T03:42:17.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:17.382 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:17.382 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:17.382 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.22 2024-09-17T03:42:17.382 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:17.382 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:17.382 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:17.382 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:17.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:17.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.442 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713451 s, 147 MB/s 2024-09-17T03:42:17.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745769 s, 141 MB/s 2024-09-17T03:42:17.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657287 s, 160 MB/s 2024-09-17T03:42:17.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.467 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584668 s, 179 MB/s 2024-09-17T03:42:17.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.475 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638294 s, 164 MB/s 2024-09-17T03:42:17.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.484 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678392 s, 155 MB/s 2024-09-17T03:42:17.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.493 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743128 s, 141 MB/s 2024-09-17T03:42:17.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.501 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067156 s, 156 MB/s 2024-09-17T03:42:17.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.509 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067677 s, 155 MB/s 2024-09-17T03:42:17.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.517 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663173 s, 158 MB/s 2024-09-17T03:42:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778638 s, 135 MB/s 2024-09-17T03:42:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.535 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656697 s, 160 MB/s 2024-09-17T03:42:17.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698406 s, 150 MB/s 2024-09-17T03:42:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605556 s, 173 MB/s 2024-09-17T03:42:17.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.561 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689489 s, 152 MB/s 2024-09-17T03:42:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724241 s, 145 MB/s 2024-09-17T03:42:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.578 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663956 s, 158 MB/s 2024-09-17T03:42:17.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666782 s, 157 MB/s 2024-09-17T03:42:17.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.593 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583557 s, 180 MB/s 2024-09-17T03:42:17.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.602 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703916 s, 149 MB/s 2024-09-17T03:42:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679319 s, 154 MB/s 2024-09-17T03:42:17.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.619 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586574 s, 179 MB/s 2024-09-17T03:42:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.626 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583105 s, 180 MB/s 2024-09-17T03:42:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686363 s, 153 MB/s 2024-09-17T03:42:17.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.643 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607015 s, 173 MB/s 2024-09-17T03:42:17.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733214 s, 143 MB/s 2024-09-17T03:42:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651996 s, 161 MB/s 2024-09-17T03:42:17.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683588 s, 153 MB/s 2024-09-17T03:42:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.677 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725619 s, 145 MB/s 2024-09-17T03:42:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657639 s, 159 MB/s 2024-09-17T03:42:17.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742016 s, 141 MB/s 2024-09-17T03:42:17.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.703 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617048 s, 170 MB/s 2024-09-17T03:42:17.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:17.709 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:17.709 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:17.710 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.23 2024-09-17T03:42:17.710 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:17.710 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:17.710 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:17.710 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:17.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685863 s, 153 MB/s 2024-09-17T03:42:17.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.778 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723586 s, 145 MB/s 2024-09-17T03:42:17.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598134 s, 175 MB/s 2024-09-17T03:42:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653539 s, 160 MB/s 2024-09-17T03:42:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606311 s, 173 MB/s 2024-09-17T03:42:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670672 s, 156 MB/s 2024-09-17T03:42:17.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.819 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734866 s, 143 MB/s 2024-09-17T03:42:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753207 s, 139 MB/s 2024-09-17T03:42:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715557 s, 147 MB/s 2024-09-17T03:42:17.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.846 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650901 s, 161 MB/s 2024-09-17T03:42:17.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750137 s, 140 MB/s 2024-09-17T03:42:17.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.863 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648548 s, 162 MB/s 2024-09-17T03:42:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.872 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689105 s, 152 MB/s 2024-09-17T03:42:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604705 s, 173 MB/s 2024-09-17T03:42:17.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.888 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674642 s, 155 MB/s 2024-09-17T03:42:17.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.896 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067253 s, 156 MB/s 2024-09-17T03:42:17.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755065 s, 139 MB/s 2024-09-17T03:42:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642383 s, 163 MB/s 2024-09-17T03:42:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075829 s, 138 MB/s 2024-09-17T03:42:17.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771617 s, 136 MB/s 2024-09-17T03:42:17.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.940 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608231 s, 172 MB/s 2024-09-17T03:42:17.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.948 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602541 s, 174 MB/s 2024-09-17T03:42:17.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683803 s, 153 MB/s 2024-09-17T03:42:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066579 s, 157 MB/s 2024-09-17T03:42:17.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.973 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065642 s, 160 MB/s 2024-09-17T03:42:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666228 s, 157 MB/s 2024-09-17T03:42:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642082 s, 163 MB/s 2024-09-17T03:42:17.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:17.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:17.998 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658045 s, 159 MB/s 2024-09-17T03:42:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655993 s, 160 MB/s 2024-09-17T03:42:18.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.015 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660608 s, 159 MB/s 2024-09-17T03:42:18.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.024 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.024 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730548 s, 144 MB/s 2024-09-17T03:42:18.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698641 s, 150 MB/s 2024-09-17T03:42:18.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:18.039 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:18.040 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:18.040 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.24 2024-09-17T03:42:18.040 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:18.040 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:18.040 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:18.040 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:18.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.099 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698015 s, 150 MB/s 2024-09-17T03:42:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.107 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675077 s, 155 MB/s 2024-09-17T03:42:18.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594562 s, 176 MB/s 2024-09-17T03:42:18.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.123 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647264 s, 162 MB/s 2024-09-17T03:42:18.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640382 s, 164 MB/s 2024-09-17T03:42:18.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.140 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737365 s, 142 MB/s 2024-09-17T03:42:18.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.148 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657487 s, 159 MB/s 2024-09-17T03:42:18.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675102 s, 155 MB/s 2024-09-17T03:42:18.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.165 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630379 s, 166 MB/s 2024-09-17T03:42:18.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.173 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680354 s, 154 MB/s 2024-09-17T03:42:18.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065699 s, 160 MB/s 2024-09-17T03:42:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.190 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645826 s, 162 MB/s 2024-09-17T03:42:18.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.198 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637357 s, 165 MB/s 2024-09-17T03:42:18.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.206 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665362 s, 158 MB/s 2024-09-17T03:42:18.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.214 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615782 s, 170 MB/s 2024-09-17T03:42:18.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.221 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574262 s, 183 MB/s 2024-09-17T03:42:18.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.230 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674309 s, 156 MB/s 2024-09-17T03:42:18.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.239 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745316 s, 141 MB/s 2024-09-17T03:42:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.248 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686239 s, 153 MB/s 2024-09-17T03:42:18.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073684 s, 142 MB/s 2024-09-17T03:42:18.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.266 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737051 s, 142 MB/s 2024-09-17T03:42:18.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.274 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592329 s, 177 MB/s 2024-09-17T03:42:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.282 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650929 s, 161 MB/s 2024-09-17T03:42:18.289 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.290 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636969 s, 165 MB/s 2024-09-17T03:42:18.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629199 s, 167 MB/s 2024-09-17T03:42:18.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.306 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645807 s, 162 MB/s 2024-09-17T03:42:18.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.314 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621294 s, 169 MB/s 2024-09-17T03:42:18.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.322 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673801 s, 156 MB/s 2024-09-17T03:42:18.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.332 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758411 s, 138 MB/s 2024-09-17T03:42:18.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.341 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748221 s, 140 MB/s 2024-09-17T03:42:18.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.348 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597171 s, 176 MB/s 2024-09-17T03:42:18.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.357 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653783 s, 160 MB/s 2024-09-17T03:42:18.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:18.364 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:18.364 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:18.365 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.25 2024-09-17T03:42:18.365 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:18.365 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:18.365 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:18.365 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:18.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:18.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742015 s, 141 MB/s 2024-09-17T03:42:18.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.434 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647612 s, 162 MB/s 2024-09-17T03:42:18.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.443 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736693 s, 142 MB/s 2024-09-17T03:42:18.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661278 s, 159 MB/s 2024-09-17T03:42:18.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.460 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065724 s, 160 MB/s 2024-09-17T03:42:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.468 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711507 s, 147 MB/s 2024-09-17T03:42:18.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.478 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750119 s, 140 MB/s 2024-09-17T03:42:18.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732186 s, 143 MB/s 2024-09-17T03:42:18.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702977 s, 149 MB/s 2024-09-17T03:42:18.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.505 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737109 s, 142 MB/s 2024-09-17T03:42:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.514 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741109 s, 141 MB/s 2024-09-17T03:42:18.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675292 s, 155 MB/s 2024-09-17T03:42:18.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717142 s, 146 MB/s 2024-09-17T03:42:18.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720464 s, 146 MB/s 2024-09-17T03:42:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657268 s, 160 MB/s 2024-09-17T03:42:18.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.558 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754186 s, 139 MB/s 2024-09-17T03:42:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006434 s, 163 MB/s 2024-09-17T03:42:18.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598773 s, 175 MB/s 2024-09-17T03:42:18.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668208 s, 157 MB/s 2024-09-17T03:42:18.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600769 s, 175 MB/s 2024-09-17T03:42:18.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682448 s, 154 MB/s 2024-09-17T03:42:18.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649555 s, 161 MB/s 2024-09-17T03:42:18.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668302 s, 157 MB/s 2024-09-17T03:42:18.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.623 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644585 s, 163 MB/s 2024-09-17T03:42:18.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.631 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621623 s, 169 MB/s 2024-09-17T03:42:18.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059162 s, 177 MB/s 2024-09-17T03:42:18.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.647 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632396 s, 166 MB/s 2024-09-17T03:42:18.655 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.655 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.655 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688027 s, 152 MB/s 2024-09-17T03:42:18.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.664 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726772 s, 144 MB/s 2024-09-17T03:42:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641147 s, 164 MB/s 2024-09-17T03:42:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656093 s, 160 MB/s 2024-09-17T03:42:18.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.689 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686547 s, 153 MB/s 2024-09-17T03:42:18.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:18.697 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:18.697 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:18.697 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.26 2024-09-17T03:42:18.697 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:18.697 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:18.697 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:18.697 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:18.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:18.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.755 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657394 s, 160 MB/s 2024-09-17T03:42:18.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.764 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738035 s, 142 MB/s 2024-09-17T03:42:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.773 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643459 s, 163 MB/s 2024-09-17T03:42:18.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062626 s, 167 MB/s 2024-09-17T03:42:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730609 s, 144 MB/s 2024-09-17T03:42:18.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.798 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641663 s, 163 MB/s 2024-09-17T03:42:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679517 s, 154 MB/s 2024-09-17T03:42:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651967 s, 161 MB/s 2024-09-17T03:42:18.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.823 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651124 s, 161 MB/s 2024-09-17T03:42:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649558 s, 161 MB/s 2024-09-17T03:42:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640197 s, 164 MB/s 2024-09-17T03:42:18.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676532 s, 155 MB/s 2024-09-17T03:42:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739894 s, 142 MB/s 2024-09-17T03:42:18.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743551 s, 141 MB/s 2024-09-17T03:42:18.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625817 s, 168 MB/s 2024-09-17T03:42:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.884 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072763 s, 144 MB/s 2024-09-17T03:42:18.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.891 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658854 s, 159 MB/s 2024-09-17T03:42:18.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.900 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064647 s, 162 MB/s 2024-09-17T03:42:18.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.908 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064545 s, 162 MB/s 2024-09-17T03:42:18.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.917 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664146 s, 158 MB/s 2024-09-17T03:42:18.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686208 s, 153 MB/s 2024-09-17T03:42:18.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661908 s, 158 MB/s 2024-09-17T03:42:18.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.943 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076567 s, 137 MB/s 2024-09-17T03:42:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665608 s, 158 MB/s 2024-09-17T03:42:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641982 s, 163 MB/s 2024-09-17T03:42:18.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.968 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666739 s, 157 MB/s 2024-09-17T03:42:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779894 s, 134 MB/s 2024-09-17T03:42:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730451 s, 144 MB/s 2024-09-17T03:42:18.995 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:18.995 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:18.995 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714624 s, 147 MB/s 2024-09-17T03:42:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.003 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652141 s, 161 MB/s 2024-09-17T03:42:19.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.012 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683495 s, 153 MB/s 2024-09-17T03:42:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707782 s, 148 MB/s 2024-09-17T03:42:19.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:19.027 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:19.027 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:19.027 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.27 2024-09-17T03:42:19.027 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:19.028 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:19.028 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:19.028 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:19.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.086 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639092 s, 164 MB/s 2024-09-17T03:42:19.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.095 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659149 s, 159 MB/s 2024-09-17T03:42:19.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685143 s, 153 MB/s 2024-09-17T03:42:19.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.112 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726537 s, 144 MB/s 2024-09-17T03:42:19.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.121 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735678 s, 143 MB/s 2024-09-17T03:42:19.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.129 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699624 s, 150 MB/s 2024-09-17T03:42:19.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.138 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621727 s, 169 MB/s 2024-09-17T03:42:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760204 s, 138 MB/s 2024-09-17T03:42:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689346 s, 152 MB/s 2024-09-17T03:42:19.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854305 s, 123 MB/s 2024-09-17T03:42:19.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.175 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650249 s, 161 MB/s 2024-09-17T03:42:19.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800662 s, 131 MB/s 2024-09-17T03:42:19.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065337 s, 160 MB/s 2024-09-17T03:42:19.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637032 s, 165 MB/s 2024-09-17T03:42:19.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800759 s, 131 MB/s 2024-09-17T03:42:19.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.220 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652979 s, 161 MB/s 2024-09-17T03:42:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659102 s, 159 MB/s 2024-09-17T03:42:19.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.237 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671791 s, 156 MB/s 2024-09-17T03:42:19.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00812988 s, 129 MB/s 2024-09-17T03:42:19.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00791516 s, 132 MB/s 2024-09-17T03:42:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657396 s, 160 MB/s 2024-09-17T03:42:19.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.274 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696069 s, 151 MB/s 2024-09-17T03:42:19.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703094 s, 149 MB/s 2024-09-17T03:42:19.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.292 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690556 s, 152 MB/s 2024-09-17T03:42:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653209 s, 161 MB/s 2024-09-17T03:42:19.307 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587588 s, 178 MB/s 2024-09-17T03:42:19.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670645 s, 156 MB/s 2024-09-17T03:42:19.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696109 s, 151 MB/s 2024-09-17T03:42:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669626 s, 157 MB/s 2024-09-17T03:42:19.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.341 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642354 s, 163 MB/s 2024-09-17T03:42:19.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.350 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723653 s, 145 MB/s 2024-09-17T03:42:19.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.359 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721508 s, 145 MB/s 2024-09-17T03:42:19.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:19.365 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:19.366 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:19.366 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.28 2024-09-17T03:42:19.366 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:19.366 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:19.366 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:19.366 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:19.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756208 s, 139 MB/s 2024-09-17T03:42:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077823 s, 135 MB/s 2024-09-17T03:42:19.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682686 s, 154 MB/s 2024-09-17T03:42:19.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666028 s, 157 MB/s 2024-09-17T03:42:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782321 s, 134 MB/s 2024-09-17T03:42:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742404 s, 141 MB/s 2024-09-17T03:42:19.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.478 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588069 s, 178 MB/s 2024-09-17T03:42:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678907 s, 154 MB/s 2024-09-17T03:42:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587496 s, 178 MB/s 2024-09-17T03:42:19.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.505 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744741 s, 141 MB/s 2024-09-17T03:42:19.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.514 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687503 s, 153 MB/s 2024-09-17T03:42:19.521 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.521 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580871 s, 181 MB/s 2024-09-17T03:42:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.530 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601432 s, 174 MB/s 2024-09-17T03:42:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682965 s, 154 MB/s 2024-09-17T03:42:19.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.547 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591616 s, 177 MB/s 2024-09-17T03:42:19.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688163 s, 152 MB/s 2024-09-17T03:42:19.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649911 s, 161 MB/s 2024-09-17T03:42:19.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657762 s, 159 MB/s 2024-09-17T03:42:19.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.583 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738007 s, 142 MB/s 2024-09-17T03:42:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.591 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605687 s, 173 MB/s 2024-09-17T03:42:19.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.600 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653835 s, 160 MB/s 2024-09-17T03:42:19.608 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.608 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.608 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645932 s, 162 MB/s 2024-09-17T03:42:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073508 s, 143 MB/s 2024-09-17T03:42:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766761 s, 137 MB/s 2024-09-17T03:42:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.636 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602156 s, 174 MB/s 2024-09-17T03:42:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742277 s, 141 MB/s 2024-09-17T03:42:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661524 s, 159 MB/s 2024-09-17T03:42:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.663 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066122 s, 159 MB/s 2024-09-17T03:42:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635008 s, 165 MB/s 2024-09-17T03:42:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602896 s, 174 MB/s 2024-09-17T03:42:19.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.688 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666533 s, 157 MB/s 2024-09-17T03:42:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675867 s, 155 MB/s 2024-09-17T03:42:19.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:19.704 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:19.704 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:19.704 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.29 2024-09-17T03:42:19.704 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:19.704 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:19.704 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:19.704 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:19.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:19.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.763 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609699 s, 172 MB/s 2024-09-17T03:42:19.771 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.771 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.772 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677875 s, 155 MB/s 2024-09-17T03:42:19.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700847 s, 150 MB/s 2024-09-17T03:42:19.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.789 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685851 s, 153 MB/s 2024-09-17T03:42:19.797 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.798 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684269 s, 153 MB/s 2024-09-17T03:42:19.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.806 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592931 s, 177 MB/s 2024-09-17T03:42:19.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.814 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576822 s, 182 MB/s 2024-09-17T03:42:19.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.823 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731033 s, 143 MB/s 2024-09-17T03:42:19.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.832 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068702 s, 153 MB/s 2024-09-17T03:42:19.844 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731855 s, 143 MB/s 2024-09-17T03:42:19.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.850 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649943 s, 161 MB/s 2024-09-17T03:42:19.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.859 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650497 s, 161 MB/s 2024-09-17T03:42:19.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.867 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628338 s, 167 MB/s 2024-09-17T03:42:19.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.876 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642029 s, 163 MB/s 2024-09-17T03:42:19.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.886 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740822 s, 142 MB/s 2024-09-17T03:42:19.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661088 s, 159 MB/s 2024-09-17T03:42:19.903 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.903 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.903 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647442 s, 162 MB/s 2024-09-17T03:42:19.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654593 s, 160 MB/s 2024-09-17T03:42:19.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.920 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677324 s, 155 MB/s 2024-09-17T03:42:19.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.929 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749175 s, 140 MB/s 2024-09-17T03:42:19.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068752 s, 153 MB/s 2024-09-17T03:42:19.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.945 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646834 s, 162 MB/s 2024-09-17T03:42:19.955 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.955 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.955 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766748 s, 137 MB/s 2024-09-17T03:42:19.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.963 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671883 s, 156 MB/s 2024-09-17T03:42:19.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.971 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636891 s, 165 MB/s 2024-09-17T03:42:19.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.980 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067362 s, 156 MB/s 2024-09-17T03:42:19.988 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657668 s, 159 MB/s 2024-09-17T03:42:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738233 s, 142 MB/s 2024-09-17T03:42:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605115 s, 173 MB/s 2024-09-17T03:42:20.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.013 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623786 s, 168 MB/s 2024-09-17T03:42:20.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.022 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734324 s, 143 MB/s 2024-09-17T03:42:20.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682382 s, 154 MB/s 2024-09-17T03:42:20.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:20.037 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:20.037 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:20.037 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.30 2024-09-17T03:42:20.037 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:20.037 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:20.037 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:20.037 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:20.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:20.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.097 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750949 s, 140 MB/s 2024-09-17T03:42:20.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.105 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673127 s, 156 MB/s 2024-09-17T03:42:20.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.113 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609505 s, 172 MB/s 2024-09-17T03:42:20.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.121 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665617 s, 158 MB/s 2024-09-17T03:42:20.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.130 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733569 s, 143 MB/s 2024-09-17T03:42:20.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.139 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661902 s, 158 MB/s 2024-09-17T03:42:20.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.148 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729801 s, 144 MB/s 2024-09-17T03:42:20.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073348 s, 143 MB/s 2024-09-17T03:42:20.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.166 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731605 s, 143 MB/s 2024-09-17T03:42:20.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.174 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665343 s, 158 MB/s 2024-09-17T03:42:20.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.182 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676085 s, 155 MB/s 2024-09-17T03:42:20.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.191 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064196 s, 163 MB/s 2024-09-17T03:42:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.198 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603146 s, 174 MB/s 2024-09-17T03:42:20.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.207 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630154 s, 166 MB/s 2024-09-17T03:42:20.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.214 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600108 s, 175 MB/s 2024-09-17T03:42:20.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.222 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612947 s, 171 MB/s 2024-09-17T03:42:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686932 s, 153 MB/s 2024-09-17T03:42:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.239 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616126 s, 170 MB/s 2024-09-17T03:42:20.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.246 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580207 s, 181 MB/s 2024-09-17T03:42:20.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.255 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670051 s, 156 MB/s 2024-09-17T03:42:20.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613939 s, 171 MB/s 2024-09-17T03:42:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.272 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738781 s, 142 MB/s 2024-09-17T03:42:20.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.280 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646249 s, 162 MB/s 2024-09-17T03:42:20.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.290 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078329 s, 134 MB/s 2024-09-17T03:42:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665974 s, 157 MB/s 2024-09-17T03:42:20.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.306 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648543 s, 162 MB/s 2024-09-17T03:42:20.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.315 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652543 s, 161 MB/s 2024-09-17T03:42:20.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630125 s, 166 MB/s 2024-09-17T03:42:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664321 s, 158 MB/s 2024-09-17T03:42:20.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.339 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657915 s, 159 MB/s 2024-09-17T03:42:20.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.348 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637274 s, 165 MB/s 2024-09-17T03:42:20.355 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648009 s, 162 MB/s 2024-09-17T03:42:20.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:20.362 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:20.362 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:20.362 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.31 2024-09-17T03:42:20.362 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:20.363 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:20.363 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:20.363 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:20.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.421 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667043 s, 157 MB/s 2024-09-17T03:42:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.429 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663015 s, 158 MB/s 2024-09-17T03:42:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.439 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792802 s, 132 MB/s 2024-09-17T03:42:20.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060239 s, 174 MB/s 2024-09-17T03:42:20.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.455 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.455 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637145 s, 165 MB/s 2024-09-17T03:42:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.463 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622991 s, 168 MB/s 2024-09-17T03:42:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619683 s, 169 MB/s 2024-09-17T03:42:20.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729798 s, 144 MB/s 2024-09-17T03:42:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686243 s, 153 MB/s 2024-09-17T03:42:20.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.496 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598273 s, 175 MB/s 2024-09-17T03:42:20.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.504 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658914 s, 159 MB/s 2024-09-17T03:42:20.512 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.512 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.512 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642883 s, 163 MB/s 2024-09-17T03:42:20.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.521 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.521 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654729 s, 160 MB/s 2024-09-17T03:42:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.529 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732931 s, 143 MB/s 2024-09-17T03:42:20.537 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.538 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.538 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658196 s, 159 MB/s 2024-09-17T03:42:20.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.545 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058036 s, 181 MB/s 2024-09-17T03:42:20.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.555 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766856 s, 137 MB/s 2024-09-17T03:42:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666671 s, 157 MB/s 2024-09-17T03:42:20.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.571 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650435 s, 161 MB/s 2024-09-17T03:42:20.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629707 s, 167 MB/s 2024-09-17T03:42:20.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781372 s, 134 MB/s 2024-09-17T03:42:20.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786171 s, 133 MB/s 2024-09-17T03:42:20.608 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.608 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.608 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744851 s, 141 MB/s 2024-09-17T03:42:20.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672554 s, 156 MB/s 2024-09-17T03:42:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676152 s, 155 MB/s 2024-09-17T03:42:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678395 s, 155 MB/s 2024-09-17T03:42:20.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.642 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657944 s, 159 MB/s 2024-09-17T03:42:20.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693966 s, 151 MB/s 2024-09-17T03:42:20.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.659 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684473 s, 153 MB/s 2024-09-17T03:42:20.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.667 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643187 s, 163 MB/s 2024-09-17T03:42:20.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648236 s, 162 MB/s 2024-09-17T03:42:20.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:20.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:20.684 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687662 s, 152 MB/s 2024-09-17T03:42:20.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:20.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:20.690 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub start /scrub_control_test_path recursive 2024-09-17T03:42:20.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.808+0000 7f3656863640 1 -- 172.21.15.146:0/2606422288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365015f1a0 msgr2=0x7f36500cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:20.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.808+0000 7f3656863640 1 --2- 172.21.15.146:0/2606422288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365015f1a0 0x7f36500cfca0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f365015cd70 tx=0x7f364002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.808+0000 7f3656863640 1 -- 172.21.15.146:0/2606422288 shutdown_connections 2024-09-17T03:42:20.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.808+0000 7f3656863640 1 --2- 172.21.15.146:0/2606422288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36500b61f0 0x7f36500b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.808+0000 7f3656863640 1 --2- 172.21.15.146:0/2606422288 >> v2:172.21.15.179:3300/0 conn(0x7f36501631a0 0x7f36500cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.808+0000 7f3656863640 1 --2- 172.21.15.146:0/2606422288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f365015f1a0 0x7f36500cfca0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.808+0000 7f3656863640 1 -- 172.21.15.146:0/2606422288 >> 172.21.15.146:0/2606422288 conn(0x7f36500d11f0 msgr2=0x7f36500d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:20.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.809+0000 7f3656863640 1 -- 172.21.15.146:0/2606422288 shutdown_connections 2024-09-17T03:42:20.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.809+0000 7f3656863640 1 -- 172.21.15.146:0/2606422288 wait complete. 2024-09-17T03:42:20.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.810+0000 7f3656863640 1 Processor -- start 2024-09-17T03:42:20.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.810+0000 7f3656863640 1 -- start start 2024-09-17T03:42:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f3656863640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36500b61f0 0x7f36500cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f3656863640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f365015f1a0 0x7f36500ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f3656863640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36501631a0 0x7f36500cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f3656863640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f36500693a0 con 0x7f36500b61f0 2024-09-17T03:42:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f3656863640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3650069220 con 0x7f365015f1a0 2024-09-17T03:42:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f3656863640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3650069520 con 0x7f36501631a0 2024-09-17T03:42:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f364ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36500b61f0 0x7f36500cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f364ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36500b61f0 0x7f36500cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38652/0 (socket says 172.21.15.146:38652) 2024-09-17T03:42:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f364ffff640 1 -- 172.21.15.146:0/1807603186 learned_addr learned my addr 172.21.15.146:0/1807603186 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f364f7fe640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f365015f1a0 0x7f36500ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f3654e00640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36501631a0 0x7f36500cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f364ffff640 1 -- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36501631a0 msgr2=0x7f36500cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f364ffff640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36501631a0 0x7f36500cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f364ffff640 1 -- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f365015f1a0 msgr2=0x7f36500ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f364ffff640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f365015f1a0 0x7f36500ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f364ffff640 1 -- 172.21.15.146:0/1807603186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36500c8900 con 0x7f36500b61f0 2024-09-17T03:42:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f364ffff640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36500b61f0 0x7f36500cc800 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f36400099c0 tx=0x7f36400038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:20.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.812+0000 7f364cff9640 1 -- 172.21.15.146:0/1807603186 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364003e030 con 0x7f36500b61f0 2024-09-17T03:42:20.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.813+0000 7f364cff9640 1 -- 172.21.15.146:0/1807603186 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3640003ca0 con 0x7f36500b61f0 2024-09-17T03:42:20.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.813+0000 7f364cff9640 1 -- 172.21.15.146:0/1807603186 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640035040 con 0x7f36500b61f0 2024-09-17T03:42:20.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.813+0000 7f3656863640 1 -- 172.21.15.146:0/1807603186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36500c8be0 con 0x7f36500b61f0 2024-09-17T03:42:20.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.813+0000 7f3656863640 1 -- 172.21.15.146:0/1807603186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3650158190 con 0x7f36500b61f0 2024-09-17T03:42:20.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.814+0000 7f364cff9640 1 -- 172.21.15.146:0/1807603186 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3640041030 con 0x7f36500b61f0 2024-09-17T03:42:20.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.815+0000 7f364cff9640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f363c078bc0 0x7f363c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.815+0000 7f364cff9640 1 -- 172.21.15.146:0/1807603186 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f36400bb420 con 0x7f36500b61f0 2024-09-17T03:42:20.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.815+0000 7f364f7fe640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f363c078bc0 0x7f363c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.815+0000 7f364f7fe640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f363c078bc0 0x7f363c07b0d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f36500d1ca0 tx=0x7f3644005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:20.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.816+0000 7f365d7d1740 1 Processor -- start 2024-09-17T03:42:20.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.816+0000 7f365d7d1740 1 -- start start 2024-09-17T03:42:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76ec730 0x55cda7adbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76c3870 0x55cda7abeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7abf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f365d7d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cda7a06c40 con 0x55cda76cba50 2024-09-17T03:42:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f365d7d1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cda79f6070 con 0x55cda76ec730 2024-09-17T03:42:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f365d7d1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55cda79f9e80 con 0x55cda76c3870 2024-09-17T03:42:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f3654e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7abf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f364f7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76c3870 0x55cda7abeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f3654e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7abf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38654/0 (socket says 172.21.15.146:38654) 2024-09-17T03:42:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f3654e00640 1 -- 172.21.15.146:0/3207664651 learned_addr learned my addr 172.21.15.146:0/3207664651 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f364ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76ec730 0x55cda7adbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f3654e00640 1 -- 172.21.15.146:0/3207664651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76c3870 msgr2=0x55cda7abeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f3654e00640 1 --2- 172.21.15.146:0/3207664651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76c3870 0x55cda7abeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f3654e00640 1 -- 172.21.15.146:0/3207664651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76ec730 msgr2=0x55cda7adbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f3654e00640 1 --2- 172.21.15.146:0/3207664651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76ec730 0x55cda7adbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f3654e00640 1 -- 172.21.15.146:0/3207664651 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda77d0ba0 con 0x55cda76cba50 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.817+0000 7f364f7fe640 1 --2- 172.21.15.146:0/3207664651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76c3870 0x55cda7abeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.818+0000 7f3654e00640 1 --2- 172.21.15.146:0/3207664651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7abf000 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f3648009e10 tx=0x7f364800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfec5138a81a7fc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.818+0000 7f3635ffb640 1 -- 172.21.15.146:0/3207664651 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648011440 con 0x55cda76cba50 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.818+0000 7f3635ffb640 1 -- 172.21.15.146:0/3207664651 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36480116d0 con 0x55cda76cba50 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.818+0000 7f3635ffb640 1 -- 172.21.15.146:0/3207664651 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648011b00 con 0x55cda76cba50 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.818+0000 7f365d7d1740 1 -- 172.21.15.146:0/3207664651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 msgr2=0x55cda7abf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.818+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3207664651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7abf000 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f3648009e10 tx=0x7f364800f730 comp rx=0 tx=0).stop 2024-09-17T03:42:20.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.818+0000 7f365d7d1740 1 -- 172.21.15.146:0/3207664651 shutdown_connections 2024-09-17T03:42:20.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.819+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3207664651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7abf000 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.819+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3207664651 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76c3870 0x55cda7abeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.819+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3207664651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76ec730 0x55cda7adbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.819+0000 7f365d7d1740 1 -- 172.21.15.146:0/3207664651 >> 172.21.15.146:0/3207664651 conn(0x55cda76e0880 msgr2=0x55cda7a94ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:20.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.819+0000 7f365d7d1740 1 -- 172.21.15.146:0/3207664651 shutdown_connections 2024-09-17T03:42:20.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.819+0000 7f365d7d1740 1 -- 172.21.15.146:0/3207664651 wait complete. 2024-09-17T03:42:20.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.819+0000 7f365d7d1740 1 -- start start 2024-09-17T03:42:20.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.820+0000 7f365d7d1740 1 Processor -- start 2024-09-17T03:42:20.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7aad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76cba50 0x55cda7ad7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76ec730 0x55cda7ad8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f365d7d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cda7766ae0 con 0x55cda76c3870 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f365d7d1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cda797c870 con 0x55cda76cba50 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f365d7d1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55cda7ad43d0 con 0x55cda76ec730 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f365d7d1740 10 client.0 _ll_register_callbacks cb 0x55cda79aa2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f364ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7aad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f364ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7aad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38670/0 (socket says 172.21.15.146:38670) 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f364ffff640 1 -- 172.21.15.146:0/3867221348 learned_addr learned my addr 172.21.15.146:0/3867221348 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f364f7fe640 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76cba50 0x55cda7ad7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f3654e00640 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76ec730 0x55cda7ad8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f364ffff640 1 -- 172.21.15.146:0/3867221348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76ec730 msgr2=0x55cda7ad8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f364ffff640 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76ec730 0x55cda7ad8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f364ffff640 1 -- 172.21.15.146:0/3867221348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76cba50 msgr2=0x55cda7ad7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f364ffff640 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76cba50 0x55cda7ad7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.821+0000 7f364ffff640 1 -- 172.21.15.146:0/3867221348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cda7735a40 con 0x55cda76c3870 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f364ffff640 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7aad630 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f3640083100 tx=0x7f3640082b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5c5280c4e9a626 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f362effd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f362effd640 1 -- 172.21.15.146:0/3867221348 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400a9070 con 0x55cda76c3870 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f362effd640 1 -- 172.21.15.146:0/3867221348 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f364008c900 con 0x55cda76c3870 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f365d7d1740 1 -- 172.21.15.146:0/3867221348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36480116d0 con 0x55cda76c3870 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f362effd640 1 -- 172.21.15.146:0/3867221348 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f3640048040 con 0x55cda76c3870 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f365d7d1740 10 client.9390 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f365d7d1740 1 -- 172.21.15.146:0/3867221348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55cda7831330 con 0x55cda76c3870 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f362effd640 1 -- 172.21.15.146:0/3867221348 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36480116d0 con 0x55cda76c3870 2024-09-17T03:42:20.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f362effd640 1 -- 172.21.15.146:0/3867221348 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f36400823d0 con 0x55cda76c3870 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f365d7d1740 10 client.9390 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f365d7d1740 10 client.9390 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f365d7d1740 20 client.9390 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55cda76ab300 0x55cda7aec1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f365d7d1740 4 client.9390 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f365d7d1740 1 -- 172.21.15.146:0/3867221348 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cda7a08b90 con 0x55cda76ab300 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.822+0000 7f364f7fe640 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55cda76ab300 0x55cda7aec1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.823+0000 7f362effd640 10 client.9390 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.823+0000 7f364f7fe640 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55cda76ab300 0x55cda7aec1d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aba6e458051bd3f server_cookie=ba93ef5f2243dcae in_seq=0 out_seq=0 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.823+0000 7f362effd640 1 -- 172.21.15.146:0/3867221348 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cda7a08b90 con 0x55cda76ab300 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.823+0000 7f362effd640 10 client.9390 handle_command_reply: tid=0 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.823+0000 7f365d7d1740 1 client.9390 shutdown 2024-09-17T03:42:20.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f365d7d1740 1 -- 172.21.15.146:0/3867221348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 msgr2=0x55cda7aad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7aad630 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f3640083100 tx=0x7f3640082b80 comp rx=0 tx=0).stop 2024-09-17T03:42:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f365d7d1740 1 -- 172.21.15.146:0/3867221348 shutdown_connections 2024-09-17T03:42:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55cda76ab300 0x55cda7aec1d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76ec730 0x55cda7ad8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76cba50 0x55cda7ad7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f362effd640 0 client.9390 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3867221348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7aad630 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f365d7d1740 1 -- 172.21.15.146:0/3867221348 >> 172.21.15.146:0/3867221348 conn(0x55cda76e0880 msgr2=0x55cda7a8dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f365d7d1740 1 -- 172.21.15.146:0/3867221348 shutdown_connections 2024-09-17T03:42:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f365d7d1740 1 -- 172.21.15.146:0/3867221348 wait complete. 2024-09-17T03:42:20.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.824+0000 7f365d7d1740 20 client.9390 trim_cache size 0 max 16384 2024-09-17T03:42:20.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.842+0000 7f365d7d1740 1 Processor -- start 2024-09-17T03:42:20.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.842+0000 7f365d7d1740 1 -- start start 2024-09-17T03:42:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.843+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76c3870 0x55cda7ada2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.843+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7ae5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.843+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76ec730 0x55cda7ae5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.843+0000 7f365d7d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f36502023c0 con 0x55cda76cba50 2024-09-17T03:42:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.843+0000 7f365d7d1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f36502015e0 con 0x55cda76ec730 2024-09-17T03:42:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.843+0000 7f365d7d1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3650148c00 con 0x55cda76c3870 2024-09-17T03:42:20.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.843+0000 7f364f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7ae5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.843+0000 7f364f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7ae5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38678/0 (socket says 172.21.15.146:38678) 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.843+0000 7f364f7fe640 1 -- 172.21.15.146:0/3409746308 learned_addr learned my addr 172.21.15.146:0/3409746308 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f364f7fe640 1 -- 172.21.15.146:0/3409746308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76c3870 msgr2=0x55cda7ada2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f364ffff640 1 --2- 172.21.15.146:0/3409746308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76c3870 0x55cda7ada2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f364f7fe640 1 --2- 172.21.15.146:0/3409746308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76c3870 0x55cda7ada2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f364f7fe640 1 -- 172.21.15.146:0/3409746308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76ec730 msgr2=0x55cda7ae5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f3654e00640 1 --2- 172.21.15.146:0/3409746308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76ec730 0x55cda7ae5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f364f7fe640 1 --2- 172.21.15.146:0/3409746308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76ec730 0x55cda7ae5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f364f7fe640 1 -- 172.21.15.146:0/3409746308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda7abe700 con 0x55cda76cba50 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f3654e00640 1 --2- 172.21.15.146:0/3409746308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76ec730 0x55cda7ae5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f364f7fe640 1 --2- 172.21.15.146:0/3409746308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7ae5990 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f3644009fd0 tx=0x7f3644016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38b1ddb7681af7d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f36357fa640 1 -- 172.21.15.146:0/3409746308 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364402d070 con 0x55cda76cba50 2024-09-17T03:42:20.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f36357fa640 1 -- 172.21.15.146:0/3409746308 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3644004310 con 0x55cda76cba50 2024-09-17T03:42:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.844+0000 7f36357fa640 1 -- 172.21.15.146:0/3409746308 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644005260 con 0x55cda76cba50 2024-09-17T03:42:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.845+0000 7f365d7d1740 1 -- 172.21.15.146:0/3409746308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 msgr2=0x55cda7ae5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.845+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3409746308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7ae5990 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f3644009fd0 tx=0x7f3644016000 comp rx=0 tx=0).stop 2024-09-17T03:42:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.845+0000 7f365d7d1740 1 -- 172.21.15.146:0/3409746308 shutdown_connections 2024-09-17T03:42:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.845+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3409746308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76ec730 0x55cda7ae5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.845+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3409746308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76cba50 0x55cda7ae5990 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.845+0000 7f365d7d1740 1 --2- 172.21.15.146:0/3409746308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76c3870 0x55cda7ada2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.845+0000 7f365d7d1740 1 -- 172.21.15.146:0/3409746308 >> 172.21.15.146:0/3409746308 conn(0x55cda76e0880 msgr2=0x55cda7a95fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.845+0000 7f365d7d1740 1 -- 172.21.15.146:0/3409746308 shutdown_connections 2024-09-17T03:42:20.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.845+0000 7f365d7d1740 1 -- 172.21.15.146:0/3409746308 wait complete. 2024-09-17T03:42:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.846+0000 7f365d7d1740 1 -- start start 2024-09-17T03:42:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.846+0000 7f365d7d1740 1 Processor -- start 2024-09-17T03:42:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7b4fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76cba50 0x55cda7a8dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f365d7d1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76ec730 0x55cda7a8e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f365d7d1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cda7abd710 con 0x55cda76c3870 2024-09-17T03:42:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f365d7d1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3650147550 con 0x55cda76cba50 2024-09-17T03:42:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f365d7d1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55cda7ad4890 con 0x55cda76ec730 2024-09-17T03:42:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f365d7d1740 10 client.0 _ll_register_callbacks cb 0x7f364007f010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f364ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7b4fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f364ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7b4fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38690/0 (socket says 172.21.15.146:38690) 2024-09-17T03:42:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f364ffff640 1 -- 172.21.15.146:0/2321838903 learned_addr learned my addr 172.21.15.146:0/2321838903 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f3654e00640 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76ec730 0x55cda7a8e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.847+0000 7f364f7fe640 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76cba50 0x55cda7a8dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f364ffff640 1 -- 172.21.15.146:0/2321838903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76ec730 msgr2=0x55cda7a8e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f364ffff640 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76ec730 0x55cda7a8e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f364ffff640 1 -- 172.21.15.146:0/2321838903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76cba50 msgr2=0x55cda7a8dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f364ffff640 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76cba50 0x55cda7a8dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f364ffff640 1 -- 172.21.15.146:0/2321838903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cda77ceea0 con 0x55cda76c3870 2024-09-17T03:42:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f364ffff640 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7b4fdc0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f3640034040 tx=0x7f36400825e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8324681309ca208e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f362effd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f362effd640 1 -- 172.21.15.146:0/2321838903 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400a9050 con 0x55cda76c3870 2024-09-17T03:42:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f362effd640 1 -- 172.21.15.146:0/2321838903 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f364007eac0 con 0x55cda76c3870 2024-09-17T03:42:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f365d7d1740 1 -- 172.21.15.146:0/2321838903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3644004310 con 0x55cda76c3870 2024-09-17T03:42:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f362effd640 1 -- 172.21.15.146:0/2321838903 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f3640082f40 con 0x55cda76c3870 2024-09-17T03:42:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f365d7d1740 10 client.9396 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f365d7d1740 1 -- 172.21.15.146:0/2321838903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55cda7ada3f0 con 0x55cda76c3870 2024-09-17T03:42:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f362effd640 1 -- 172.21.15.146:0/2321838903 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3644004310 con 0x55cda76c3870 2024-09-17T03:42:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f362effd640 1 -- 172.21.15.146:0/2321838903 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f364007ecc0 con 0x55cda76c3870 2024-09-17T03:42:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f365d7d1740 10 client.9396 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:20.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f365d7d1740 10 client.9396 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:20.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f365d7d1740 20 client.9396 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:20.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f365d7d1740 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55cda7ad8980 0x55cda7b59380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:20.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f365d7d1740 4 client.9396 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-17T03:42:20.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f365d7d1740 1 -- 172.21.15.146:0/2321838903 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55cda7a04640 con 0x55cda7ad8980 2024-09-17T03:42:20.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.848+0000 7f364f7fe640 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55cda7ad8980 0x55cda7b59380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:20.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.849+0000 7f362effd640 10 client.9396 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:20.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.849+0000 7f364f7fe640 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55cda7ad8980 0x55cda7b59380 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52d22ef67ecb124e server_cookie=4957f4543574ee1c in_seq=0 out_seq=0 2024-09-17T03:42:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.851+0000 7f362effd640 1 -- 172.21.15.146:0/2321838903 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cda7a04640 con 0x55cda7ad8980 2024-09-17T03:42:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.851+0000 7f362effd640 10 client.9396 handle_command_reply: tid=0 2024-09-17T03:42:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.851+0000 7f365d7d1740 1 client.9396 shutdown 2024-09-17T03:42:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f365d7d1740 1 -- 172.21.15.146:0/2321838903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 msgr2=0x55cda7b4fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f365d7d1740 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7b4fdc0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f3640034040 tx=0x7f36400825e0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f365d7d1740 1 -- 172.21.15.146:0/2321838903 shutdown_connections 2024-09-17T03:42:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f365d7d1740 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55cda7ad8980 0x55cda7b59380 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f365d7d1740 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cda76ec730 0x55cda7a8e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f365d7d1740 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cda76cba50 0x55cda7a8dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f362effd640 0 client.9396 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f365d7d1740 1 --2- 172.21.15.146:0/2321838903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cda76c3870 0x55cda7b4fdc0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f365d7d1740 1 -- 172.21.15.146:0/2321838903 >> 172.21.15.146:0/2321838903 conn(0x55cda76e0880 msgr2=0x55cda7ad9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f365d7d1740 1 -- 172.21.15.146:0/2321838903 shutdown_connections 2024-09-17T03:42:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f365d7d1740 1 -- 172.21.15.146:0/2321838903 wait complete. 2024-09-17T03:42:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.852+0000 7f365d7d1740 20 client.9396 trim_cache size 0 max 16384 2024-09-17T03:42:20.856 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:42:20.856 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:42:20.856 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "e831064f-2a65-4323-88f5-8eb02fad2c07", 2024-09-17T03:42:20.856 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:42:20.857 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 -- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f363c078bc0 msgr2=0x7f363c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f363c078bc0 0x7f363c07b0d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f36500d1ca0 tx=0x7f3644005f90 comp rx=0 tx=0).stop 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 -- 172.21.15.146:0/1807603186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36500b61f0 msgr2=0x7f36500cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36500b61f0 0x7f36500cc800 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f36400099c0 tx=0x7f36400038a0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 -- 172.21.15.146:0/1807603186 shutdown_connections 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f363c078bc0 0x7f363c07b0d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36501631a0 0x7f36500cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f365015f1a0 0x7f36500ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 --2- 172.21.15.146:0/1807603186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36500b61f0 0x7f36500cc800 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 -- 172.21.15.146:0/1807603186 >> 172.21.15.146:0/1807603186 conn(0x7f36500d11f0 msgr2=0x7f3650159010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 -- 172.21.15.146:0/1807603186 shutdown_connections 2024-09-17T03:42:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:20.853+0000 7f3656863640 1 -- 172.21.15.146:0/1807603186 wait complete. 2024-09-17T03:42:20.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:20.864 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub pause 2024-09-17T03:42:21.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.012+0000 7f2215b39640 1 -- 172.21.15.146:0/753931085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22100b3360 msgr2=0x7f2210072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.012+0000 7f2215b39640 1 --2- 172.21.15.146:0/753931085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22100b3360 0x7f2210072df0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f2210075760 tx=0x7f220002a560 comp rx=0 tx=0).stop 2024-09-17T03:42:21.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.012+0000 7f2215b39640 1 -- 172.21.15.146:0/753931085 shutdown_connections 2024-09-17T03:42:21.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.012+0000 7f2215b39640 1 --2- 172.21.15.146:0/753931085 >> v2:172.21.15.179:3300/0 conn(0x7f221015f010 0x7f22101515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.012+0000 7f2215b39640 1 --2- 172.21.15.146:0/753931085 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f22100cfc40 0x7f221015ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.012+0000 7f2215b39640 1 --2- 172.21.15.146:0/753931085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22100b3360 0x7f2210072df0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.012+0000 7f2215b39640 1 -- 172.21.15.146:0/753931085 >> 172.21.15.146:0/753931085 conn(0x7f22100b2060 msgr2=0x7f22100b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.012+0000 7f2215b39640 1 -- 172.21.15.146:0/753931085 shutdown_connections 2024-09-17T03:42:21.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.012+0000 7f2215b39640 1 -- 172.21.15.146:0/753931085 wait complete. 2024-09-17T03:42:21.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.015+0000 7f2215b39640 1 Processor -- start 2024-09-17T03:42:21.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.015+0000 7f2215b39640 1 -- start start 2024-09-17T03:42:21.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.017+0000 7f2215b39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22100b3360 0x7f221013d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.017+0000 7f2215b39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22100cfc40 0x7f22100acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.017+0000 7f2215b39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f221015f010 0x7f22100ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.017+0000 7f2215b39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f221006e800 con 0x7f22100b3360 2024-09-17T03:42:21.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.017+0000 7f2215b39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f221006e680 con 0x7f22100cfc40 2024-09-17T03:42:21.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.017+0000 7f2215b39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f221006e980 con 0x7f221015f010 2024-09-17T03:42:21.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.017+0000 7f220ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f221015f010 0x7f22100ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.017+0000 7f220effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22100cfc40 0x7f22100acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.017+0000 7f220effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22100cfc40 0x7f22100acbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:42788/0 (socket says 172.21.15.146:42788) 2024-09-17T03:42:21.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.017+0000 7f220effd640 1 -- 172.21.15.146:0/4071345556 learned_addr learned my addr 172.21.15.146:0/4071345556 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.018+0000 7f220f7fe640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22100b3360 0x7f221013d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.018+0000 7f220effd640 1 -- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f221015f010 msgr2=0x7f22100ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.018+0000 7f220effd640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f221015f010 0x7f22100ad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.018+0000 7f220effd640 1 -- 172.21.15.146:0/4071345556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22100b3360 msgr2=0x7f221013d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.018+0000 7f220effd640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22100b3360 0x7f221013d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.018+0000 7f220effd640 1 -- 172.21.15.146:0/4071345556 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221013d9a0 con 0x7f22100cfc40 2024-09-17T03:42:21.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.018+0000 7f220f7fe640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22100b3360 0x7f221013d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:21.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.018+0000 7f220ffff640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f221015f010 0x7f22100ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:42:21.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.018+0000 7f220effd640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22100cfc40 0x7f22100acbe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f220400ea60 tx=0x7f220400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.019+0000 7f21f7fff640 1 -- 172.21.15.146:0/4071345556 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220400cbc0 con 0x7f22100cfc40 2024-09-17T03:42:21.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.020+0000 7f21f7fff640 1 -- 172.21.15.146:0/4071345556 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f220400cd60 con 0x7f22100cfc40 2024-09-17T03:42:21.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.020+0000 7f21f7fff640 1 -- 172.21.15.146:0/4071345556 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204004280 con 0x7f22100cfc40 2024-09-17T03:42:21.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.020+0000 7f2215b39640 1 -- 172.21.15.146:0/4071345556 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f221015aa90 con 0x7f22100cfc40 2024-09-17T03:42:21.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.020+0000 7f2215b39640 1 -- 172.21.15.146:0/4071345556 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22101f9220 con 0x7f22100cfc40 2024-09-17T03:42:21.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.022+0000 7f21f7fff640 1 -- 172.21.15.146:0/4071345556 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2204005030 con 0x7f22100cfc40 2024-09-17T03:42:21.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.022+0000 7f21f7fff640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21fc078be0 0x7f21fc07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.023+0000 7f21f7fff640 1 -- 172.21.15.146:0/4071345556 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f220409aeb0 con 0x7f22100cfc40 2024-09-17T03:42:21.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.023+0000 7f220f7fe640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21fc078be0 0x7f21fc07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.023+0000 7f220f7fe640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21fc078be0 0x7f21fc07b0f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2200033000 tx=0x7f2200004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.024+0000 7f221caab740 1 Processor -- start 2024-09-17T03:42:21.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.024+0000 7f221caab740 1 -- start start 2024-09-17T03:42:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f221caab740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a339390 0x55b01a728310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f221caab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a70afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f221caab740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 0x55b01a70b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f221caab740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b01a653bd0 con 0x55b01a339390 2024-09-17T03:42:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f221caab740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b01a643000 con 0x55b01a3104d0 2024-09-17T03:42:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f221caab740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55b01a646e10 con 0x55b01a3186b0 2024-09-17T03:42:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f220effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a70afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f220f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a339390 0x55b01a728310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f220effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a70afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:42798/0 (socket says 172.21.15.146:42798) 2024-09-17T03:42:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f220effd640 1 -- 172.21.15.146:0/2128571791 learned_addr learned my addr 172.21.15.146:0/2128571791 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f220ffff640 1 --2- 172.21.15.146:0/2128571791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 0x55b01a70b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f220effd640 1 -- 172.21.15.146:0/2128571791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 msgr2=0x55b01a70b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f220effd640 1 --2- 172.21.15.146:0/2128571791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 0x55b01a70b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f220effd640 1 -- 172.21.15.146:0/2128571791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a339390 msgr2=0x55b01a728310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f220effd640 1 --2- 172.21.15.146:0/2128571791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a339390 0x55b01a728310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f220effd640 1 -- 172.21.15.146:0/2128571791 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01a41b7d0 con 0x55b01a3104d0 2024-09-17T03:42:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.026+0000 7f220ffff640 1 --2- 172.21.15.146:0/2128571791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 0x55b01a70b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:42:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.027+0000 7f220effd640 1 --2- 172.21.15.146:0/2128571791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a70afe0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f220405fff0 tx=0x7f2204062c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbaa7306f825a94e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.027+0000 7f21f5ffb640 1 -- 172.21.15.146:0/2128571791 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204062d80 con 0x55b01a3104d0 2024-09-17T03:42:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.027+0000 7f21f5ffb640 1 -- 172.21.15.146:0/2128571791 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2204089030 con 0x55b01a3104d0 2024-09-17T03:42:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.027+0000 7f21f5ffb640 1 -- 172.21.15.146:0/2128571791 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2204067860 con 0x55b01a3104d0 2024-09-17T03:42:21.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.028+0000 7f221caab740 1 -- 172.21.15.146:0/2128571791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 msgr2=0x55b01a70afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.028+0000 7f221caab740 1 --2- 172.21.15.146:0/2128571791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a70afe0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f220405fff0 tx=0x7f2204062c80 comp rx=0 tx=0).stop 2024-09-17T03:42:21.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.028+0000 7f221caab740 1 -- 172.21.15.146:0/2128571791 shutdown_connections 2024-09-17T03:42:21.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.028+0000 7f221caab740 1 --2- 172.21.15.146:0/2128571791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 0x55b01a70b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.028+0000 7f221caab740 1 --2- 172.21.15.146:0/2128571791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a70afe0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.028+0000 7f221caab740 1 --2- 172.21.15.146:0/2128571791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a339390 0x55b01a728310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.028+0000 7f221caab740 1 -- 172.21.15.146:0/2128571791 >> 172.21.15.146:0/2128571791 conn(0x55b01a32d4e0 msgr2=0x55b01a6e1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.028+0000 7f221caab740 1 -- 172.21.15.146:0/2128571791 shutdown_connections 2024-09-17T03:42:21.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.028+0000 7f221caab740 1 -- 172.21.15.146:0/2128571791 wait complete. 2024-09-17T03:42:21.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.029+0000 7f221caab740 1 -- start start 2024-09-17T03:42:21.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.030+0000 7f221caab740 1 Processor -- start 2024-09-17T03:42:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.031+0000 7f221caab740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3104d0 0x55b01a6f8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.031+0000 7f221caab740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3186b0 0x55b01a6e0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.031+0000 7f221caab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a339390 0x55b01a6e0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.031+0000 7f221caab740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b01a3b3740 con 0x55b01a3186b0 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.031+0000 7f221caab740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b01a5e8540 con 0x55b01a339390 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.031+0000 7f221caab740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55b01a721b80 con 0x55b01a3104d0 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f221caab740 10 client.0 _ll_register_callbacks cb 0x55b01a5e70e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3186b0 0x55b01a6e0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3186b0 0x55b01a6e0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38718/0 (socket says 172.21.15.146:38718) 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220effd640 1 -- 172.21.15.146:0/3049817612 learned_addr learned my addr 172.21.15.146:0/3049817612 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220ffff640 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a339390 0x55b01a6e0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220f7fe640 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3104d0 0x55b01a6f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220ffff640 1 -- 172.21.15.146:0/3049817612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3104d0 msgr2=0x55b01a6f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220ffff640 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3104d0 0x55b01a6f8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220ffff640 1 -- 172.21.15.146:0/3049817612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3186b0 msgr2=0x55b01a6e0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220ffff640 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3186b0 0x55b01a6e0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220ffff640 1 -- 172.21.15.146:0/3049817612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01a3826a0 con 0x55b01a339390 2024-09-17T03:42:21.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220effd640 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3186b0 0x55b01a6e0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:42:21.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f220ffff640 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a339390 0x55b01a6e0ff0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x55b01a70bf00 tx=0x7f220800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ef25eac1882152c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.032+0000 7f21eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.033+0000 7f21eeffd640 1 -- 172.21.15.146:0/3049817612 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220800fe30 con 0x55b01a339390 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.033+0000 7f21eeffd640 1 -- 172.21.15.146:0/3049817612 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f2208004b20 con 0x55b01a339390 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.033+0000 7f221caab740 1 -- 172.21.15.146:0/3049817612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2204089030 con 0x55b01a339390 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.033+0000 7f21eeffd640 1 -- 172.21.15.146:0/3049817612 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f2208024050 con 0x55b01a339390 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.033+0000 7f221caab740 10 client.8272 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.033+0000 7f221caab740 1 -- 172.21.15.146:0/3049817612 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55b01a47bf60 con 0x55b01a339390 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.033+0000 7f21eeffd640 1 -- 172.21.15.146:0/3049817612 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2204089030 con 0x55b01a339390 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.033+0000 7f21eeffd640 1 -- 172.21.15.146:0/3049817612 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f2208027020 con 0x55b01a339390 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.034+0000 7f221caab740 10 client.8272 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.034+0000 7f221caab740 10 client.8272 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.034+0000 7f221caab740 20 client.8272 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:21.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.034+0000 7f221caab740 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55b01a2f7f60 0x55b01a71ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.034+0000 7f221caab740 4 client.8272 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:42:21.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.034+0000 7f221caab740 1 -- 172.21.15.146:0/3049817612 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b01a655b20 con 0x55b01a2f7f60 2024-09-17T03:42:21.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.034+0000 7f220f7fe640 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55b01a2f7f60 0x55b01a71ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.034+0000 7f21eeffd640 10 client.8272 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:21.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.034+0000 7f220f7fe640 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55b01a2f7f60 0x55b01a71ca80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd814feb73496c26 server_cookie=a49d1aeb7a33009e in_seq=0 out_seq=0 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f21eeffd640 1 -- 172.21.15.146:0/3049817612 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b01a655b20 con 0x55b01a2f7f60 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f21eeffd640 10 client.8272 handle_command_reply: tid=0 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 1 client.8272 shutdown 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 1 -- 172.21.15.146:0/3049817612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a339390 msgr2=0x55b01a6e0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a339390 0x55b01a6e0ff0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x55b01a70bf00 tx=0x7f220800f790 comp rx=0 tx=0).stop 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 1 -- 172.21.15.146:0/3049817612 shutdown_connections 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55b01a2f7f60 0x55b01a71ca80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a339390 0x55b01a6e0ff0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3186b0 0x55b01a6e0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 1 --2- 172.21.15.146:0/3049817612 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3104d0 0x55b01a6f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f21eeffd640 0 client.8272 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 1 -- 172.21.15.146:0/3049817612 >> 172.21.15.146:0/3049817612 conn(0x55b01a32d4e0 msgr2=0x55b01a7292b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 1 -- 172.21.15.146:0/3049817612 shutdown_connections 2024-09-17T03:42:21.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 1 -- 172.21.15.146:0/3049817612 wait complete. 2024-09-17T03:42:21.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.038+0000 7f221caab740 20 client.8272 trim_cache size 0 max 16384 2024-09-17T03:42:21.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.063+0000 7f221caab740 1 Processor -- start 2024-09-17T03:42:21.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.063+0000 7f221caab740 1 -- start start 2024-09-17T03:42:21.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.065+0000 7f221caab740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3104d0 0x55b01a739100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.066+0000 7f221caab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3186b0 0x55b01a721e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.066+0000 7f220f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3104d0 0x55b01a739100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.066+0000 7f220f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3104d0 0x55b01a739100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38724/0 (socket says 172.21.15.146:38724) 2024-09-17T03:42:21.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.066+0000 7f220f7fe640 1 -- 172.21.15.146:0/2329012308 learned_addr learned my addr 172.21.15.146:0/2329012308 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.066+0000 7f220effd640 1 --2- 172.21.15.146:0/2329012308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3186b0 0x55b01a721e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.066+0000 7f221caab740 1 --2- 172.21.15.146:0/2329012308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a339390 0x55b01a71f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.066+0000 7f221caab740 1 -- 172.21.15.146:0/2329012308 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2210202440 con 0x55b01a3104d0 2024-09-17T03:42:21.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.067+0000 7f221caab740 1 -- 172.21.15.146:0/2329012308 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f22102014d0 con 0x55b01a3186b0 2024-09-17T03:42:21.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.067+0000 7f221caab740 1 -- 172.21.15.146:0/2329012308 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2210140900 con 0x55b01a339390 2024-09-17T03:42:21.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.067+0000 7f220ffff640 1 --2- 172.21.15.146:0/2329012308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a339390 0x55b01a71f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.067+0000 7f220ffff640 1 -- 172.21.15.146:0/2329012308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3186b0 msgr2=0x55b01a721e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.067+0000 7f220ffff640 1 --2- 172.21.15.146:0/2329012308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3186b0 0x55b01a721e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.068+0000 7f220ffff640 1 -- 172.21.15.146:0/2329012308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3104d0 msgr2=0x55b01a739100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.068+0000 7f220ffff640 1 --2- 172.21.15.146:0/2329012308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3104d0 0x55b01a739100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.068+0000 7f220ffff640 1 -- 172.21.15.146:0/2329012308 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01a419ad0 con 0x55b01a339390 2024-09-17T03:42:21.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.068+0000 7f220ffff640 1 --2- 172.21.15.146:0/2329012308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a339390 0x55b01a71f3e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55b01a71fdd0 tx=0x7f2208009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ed1786bf936a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.068+0000 7f21f57fa640 1 -- 172.21.15.146:0/2329012308 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220802d070 con 0x55b01a339390 2024-09-17T03:42:21.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.068+0000 7f21f57fa640 1 -- 172.21.15.146:0/2329012308 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2208004b20 con 0x55b01a339390 2024-09-17T03:42:21.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.068+0000 7f21f57fa640 1 -- 172.21.15.146:0/2329012308 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208021070 con 0x55b01a339390 2024-09-17T03:42:21.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.070+0000 7f221caab740 1 -- 172.21.15.146:0/2329012308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a339390 msgr2=0x55b01a71f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.070+0000 7f221caab740 1 --2- 172.21.15.146:0/2329012308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a339390 0x55b01a71f3e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55b01a71fdd0 tx=0x7f2208009570 comp rx=0 tx=0).stop 2024-09-17T03:42:21.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.070+0000 7f221caab740 1 -- 172.21.15.146:0/2329012308 shutdown_connections 2024-09-17T03:42:21.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.070+0000 7f221caab740 1 --2- 172.21.15.146:0/2329012308 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a339390 0x55b01a71f3e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.070+0000 7f221caab740 1 --2- 172.21.15.146:0/2329012308 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3186b0 0x55b01a721e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.070+0000 7f221caab740 1 --2- 172.21.15.146:0/2329012308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a3104d0 0x55b01a739100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.070+0000 7f221caab740 1 -- 172.21.15.146:0/2329012308 >> 172.21.15.146:0/2329012308 conn(0x55b01a32d4e0 msgr2=0x55b01a6dac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.070+0000 7f221caab740 1 -- 172.21.15.146:0/2329012308 shutdown_connections 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.070+0000 7f221caab740 1 -- 172.21.15.146:0/2329012308 wait complete. 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.071+0000 7f221caab740 1 -- start start 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.072+0000 7f221caab740 1 Processor -- start 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f221caab740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a7a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f221caab740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 0x55b01a7a8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f221caab740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a339390 0x55b01a720600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f220f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a7a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f220f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a7a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:42834/0 (socket says 172.21.15.146:42834) 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f220f7fe640 1 -- 172.21.15.146:0/248511103 learned_addr learned my addr 172.21.15.146:0/248511103 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f221caab740 1 -- 172.21.15.146:0/248511103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55b01a722bb0 con 0x55b01a339390 2024-09-17T03:42:21.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f221caab740 1 -- 172.21.15.146:0/248511103 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f22101f6650 con 0x55b01a3104d0 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f221caab740 1 -- 172.21.15.146:0/248511103 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55b01a721210 con 0x55b01a3186b0 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f220effd640 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 0x55b01a7a8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f221caab740 10 client.0 _ll_register_callbacks cb 0x7f2208012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f220ffff640 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a339390 0x55b01a720600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f220f7fe640 1 -- 172.21.15.146:0/248511103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 msgr2=0x55b01a7a8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f220f7fe640 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 0x55b01a7a8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.074+0000 7f220f7fe640 1 -- 172.21.15.146:0/248511103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a339390 msgr2=0x55b01a720600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.075+0000 7f220f7fe640 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a339390 0x55b01a720600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.075+0000 7f220f7fe640 1 -- 172.21.15.146:0/248511103 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01a7a9680 con 0x55b01a3104d0 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.075+0000 7f220effd640 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 0x55b01a7a8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.075+0000 7f220ffff640 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a339390 0x55b01a720600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.075+0000 7f220f7fe640 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a7a9140 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2200005fd0 tx=0x7f2200009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aff9ef1fc3a14e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.075+0000 7f21eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2024-09-17T03:42:21.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.075+0000 7f21eeffd640 1 -- 172.21.15.146:0/248511103 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200035050 con 0x55b01a3104d0 2024-09-17T03:42:21.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.075+0000 7f21eeffd640 1 -- 172.21.15.146:0/248511103 <== mon.1 v2:172.21.15.179:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f22000047a0 con 0x55b01a3104d0 2024-09-17T03:42:21.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.075+0000 7f221caab740 1 -- 172.21.15.146:0/248511103 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2208004b20 con 0x55b01a3104d0 2024-09-17T03:42:21.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f21eeffd640 1 -- 172.21.15.146:0/248511103 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f22000044c0 con 0x55b01a3104d0 2024-09-17T03:42:21.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f221caab740 10 client.8278 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:21.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f221caab740 1 -- 172.21.15.146:0/248511103 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55b01a7a8590 con 0x55b01a3104d0 2024-09-17T03:42:21.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f21eeffd640 1 -- 172.21.15.146:0/248511103 <== mon.1 v2:172.21.15.179:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2208004b20 con 0x55b01a3104d0 2024-09-17T03:42:21.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f21eeffd640 1 -- 172.21.15.146:0/248511103 <== mon.1 v2:172.21.15.179:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f22000049a0 con 0x55b01a3104d0 2024-09-17T03:42:21.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f221caab740 10 client.8278 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:21.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f221caab740 10 client.8278 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:21.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f221caab740 20 client.8278 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:21.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f221caab740 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55b01a6db840 0x55b01a71f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f221caab740 4 client.8278 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-17T03:42:21.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f221caab740 1 -- 172.21.15.146:0/248511103 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55b01a6515d0 con 0x55b01a6db840 2024-09-17T03:42:21.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.076+0000 7f220effd640 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55b01a6db840 0x55b01a71f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.077+0000 7f21eeffd640 10 client.8278 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:21.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.077+0000 7f220effd640 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55b01a6db840 0x55b01a71f3e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0de9e3e2b56ce3f server_cookie=a4db4a19de512e29 in_seq=0 out_seq=0 2024-09-17T03:42:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.092+0000 7f21eeffd640 1 -- 172.21.15.146:0/248511103 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b01a6515d0 con 0x55b01a6db840 2024-09-17T03:42:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.092+0000 7f21eeffd640 10 client.8278 handle_command_reply: tid=0 2024-09-17T03:42:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.092+0000 7f221caab740 1 client.8278 shutdown 2024-09-17T03:42:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.092+0000 7f221caab740 1 -- 172.21.15.146:0/248511103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 msgr2=0x55b01a7a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.092+0000 7f221caab740 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a7a9140 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2200005fd0 tx=0x7f2200009260 comp rx=0 tx=0).stop 2024-09-17T03:42:21.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.092+0000 7f221caab740 1 -- 172.21.15.146:0/248511103 shutdown_connections 2024-09-17T03:42:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.092+0000 7f221caab740 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55b01a6db840 0x55b01a71f3e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.092+0000 7f221caab740 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b01a339390 0x55b01a720600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.092+0000 7f221caab740 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b01a3186b0 0x55b01a7a8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.092+0000 7f21eeffd640 0 client.8278 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.092+0000 7f221caab740 1 --2- 172.21.15.146:0/248511103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b01a3104d0 0x55b01a7a9140 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f221caab740 1 -- 172.21.15.146:0/248511103 >> 172.21.15.146:0/248511103 conn(0x55b01a32d4e0 msgr2=0x55b01a7298a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f221caab740 1 -- 172.21.15.146:0/248511103 shutdown_connections 2024-09-17T03:42:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f221caab740 1 -- 172.21.15.146:0/248511103 wait complete. 2024-09-17T03:42:21.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f221caab740 20 client.8278 trim_cache size 0 max 16384 2024-09-17T03:42:21.093 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:42:21.094 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:42:21.094 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:42:21.094 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:42:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f2215b39640 1 -- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21fc078be0 msgr2=0x7f21fc07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f2215b39640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21fc078be0 0x7f21fc07b0f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2200033000 tx=0x7f2200004730 comp rx=0 tx=0).stop 2024-09-17T03:42:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f2215b39640 1 -- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22100cfc40 msgr2=0x7f22100acbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f2215b39640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22100cfc40 0x7f22100acbe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f220400ea60 tx=0x7f220400ee60 comp rx=0 tx=0).stop 2024-09-17T03:42:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f2215b39640 1 -- 172.21.15.146:0/4071345556 shutdown_connections 2024-09-17T03:42:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f2215b39640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f21fc078be0 0x7f21fc07b0f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f2215b39640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f221015f010 0x7f22100ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f2215b39640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22100cfc40 0x7f22100acbe0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f2215b39640 1 --2- 172.21.15.146:0/4071345556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22100b3360 0x7f221013d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.093+0000 7f2215b39640 1 -- 172.21.15.146:0/4071345556 >> 172.21.15.146:0/4071345556 conn(0x7f22100b2060 msgr2=0x7f221015b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.095 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.094+0000 7f2215b39640 1 -- 172.21.15.146:0/4071345556 shutdown_connections 2024-09-17T03:42:21.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.094+0000 7f2215b39640 1 -- 172.21.15.146:0/4071345556 wait complete. 2024-09-17T03:42:21.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:21.104 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-17T03:42:21.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.219+0000 7f1e47430640 1 -- 172.21.15.146:0/2192892749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e40072df0 msgr2=0x7f1e4015ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.219+0000 7f1e47430640 1 --2- 172.21.15.146:0/2192892749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e40072df0 0x7f1e4015ead0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f1e400aff70 tx=0x7f1e3002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.219+0000 7f1e47430640 1 -- 172.21.15.146:0/2192892749 shutdown_connections 2024-09-17T03:42:21.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.219+0000 7f1e47430640 1 --2- 172.21.15.146:0/2192892749 >> v2:172.21.15.179:3300/0 conn(0x7f1e4015f010 0x7f1e401515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.219+0000 7f1e47430640 1 --2- 172.21.15.146:0/2192892749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e40072df0 0x7f1e4015ead0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.219+0000 7f1e47430640 1 -- 172.21.15.146:0/2192892749 >> 172.21.15.146:0/2192892749 conn(0x7f1e400b2060 msgr2=0x7f1e400b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.219+0000 7f1e47430640 1 -- 172.21.15.146:0/2192892749 shutdown_connections 2024-09-17T03:42:21.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.219+0000 7f1e47430640 1 -- 172.21.15.146:0/2192892749 wait complete. 2024-09-17T03:42:21.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.221+0000 7f1e47430640 1 Processor -- start 2024-09-17T03:42:21.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.221+0000 7f1e47430640 1 -- start start 2024-09-17T03:42:21.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e47430640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e40072df0 0x7f1e4014c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e47430640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e400b3360 0x7f1e401f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e47430640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e4015f010 0x7f1e400ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e47430640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40152010 con 0x7f1e400b3360 2024-09-17T03:42:21.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e47430640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40151e90 con 0x7f1e4015f010 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e47430640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1e40152190 con 0x7f1e40072df0 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e449cb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e400b3360 0x7f1e401f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e449cb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e400b3360 0x7f1e401f3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38744/0 (socket says 172.21.15.146:38744) 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e451cc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e40072df0 0x7f1e4014c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e449cb640 1 -- 172.21.15.146:0/1365985336 learned_addr learned my addr 172.21.15.146:0/1365985336 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e459cd640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e4015f010 0x7f1e400ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e449cb640 1 -- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e40072df0 msgr2=0x7f1e4014c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e449cb640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e40072df0 0x7f1e4014c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e449cb640 1 -- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e4015f010 msgr2=0x7f1e400ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e449cb640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e4015f010 0x7f1e400ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e449cb640 1 -- 172.21.15.146:0/1365985336 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e400ae6c0 con 0x7f1e400b3360 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e459cd640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e4015f010 0x7f1e400ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.222+0000 7f1e451cc640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e40072df0 0x7f1e4014c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:42:21.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.223+0000 7f1e449cb640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e400b3360 0x7f1e401f3040 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f1e3002abe0 tx=0x7f1e300052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.223+0000 7f1e35ffb640 1 -- 172.21.15.146:0/1365985336 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30005cf0 con 0x7f1e400b3360 2024-09-17T03:42:21.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.223+0000 7f1e35ffb640 1 -- 172.21.15.146:0/1365985336 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e30031b50 con 0x7f1e400b3360 2024-09-17T03:42:21.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.223+0000 7f1e35ffb640 1 -- 172.21.15.146:0/1365985336 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e300047a0 con 0x7f1e400b3360 2024-09-17T03:42:21.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.223+0000 7f1e47430640 1 -- 172.21.15.146:0/1365985336 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e400ae9a0 con 0x7f1e400b3360 2024-09-17T03:42:21.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.223+0000 7f1e47430640 1 -- 172.21.15.146:0/1365985336 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e400aef60 con 0x7f1e400b3360 2024-09-17T03:42:21.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.225+0000 7f1e35ffb640 1 -- 172.21.15.146:0/1365985336 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1e30004940 con 0x7f1e400b3360 2024-09-17T03:42:21.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.226+0000 7f1e35ffb640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e24078b90 0x7f1e2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.226+0000 7f1e35ffb640 1 -- 172.21.15.146:0/1365985336 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f1e300bbe30 con 0x7f1e400b3360 2024-09-17T03:42:21.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.226+0000 7f1e451cc640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e24078b90 0x7f1e2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.226+0000 7f1e4e479740 1 Processor -- start 2024-09-17T03:42:21.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.226+0000 7f1e4e479740 1 -- start start 2024-09-17T03:42:21.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.227+0000 7f1e451cc640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e24078b90 0x7f1e2407b0a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c000f60 tx=0x7f1e3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80254b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80216a6b0 0x55e802559b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e4e479740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e8024a5a60 con 0x55e8021624d0 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e4e479740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e802494e90 con 0x55e80218b390 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e4e479740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55e802498ca0 con 0x55e80216a6b0 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e449cb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e451cc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80254b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e449cb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38760/0 (socket says 172.21.15.146:38760) 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e449cb640 1 -- 172.21.15.146:0/3156971338 learned_addr learned my addr 172.21.15.146:0/3156971338 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e459cd640 1 --2- 172.21.15.146:0/3156971338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80216a6b0 0x55e802559b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e449cb640 1 -- 172.21.15.146:0/3156971338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80216a6b0 msgr2=0x55e802559b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e449cb640 1 --2- 172.21.15.146:0/3156971338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80216a6b0 0x55e802559b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e449cb640 1 -- 172.21.15.146:0/3156971338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 msgr2=0x55e80254b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e449cb640 1 --2- 172.21.15.146:0/3156971338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80254b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e449cb640 1 -- 172.21.15.146:0/3156971338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e80226d7d0 con 0x55e8021624d0 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e451cc640 1 --2- 172.21.15.146:0/3156971338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80254b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e449cb640 1 --2- 172.21.15.146:0/3156971338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559610 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f1e300ba2d0 tx=0x7f1e300834e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa93b384e391af9b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e22ffd640 1 -- 172.21.15.146:0/3156971338 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e300886e0 con 0x55e8021624d0 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e22ffd640 1 -- 172.21.15.146:0/3156971338 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e3008d590 con 0x55e8021624d0 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.228+0000 7f1e22ffd640 1 -- 172.21.15.146:0/3156971338 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30004c30 con 0x55e8021624d0 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.229+0000 7f1e4e479740 1 -- 172.21.15.146:0/3156971338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 msgr2=0x55e802559610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.229+0000 7f1e4e479740 1 --2- 172.21.15.146:0/3156971338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559610 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f1e300ba2d0 tx=0x7f1e300834e0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.229+0000 7f1e4e479740 1 -- 172.21.15.146:0/3156971338 shutdown_connections 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.229+0000 7f1e4e479740 1 --2- 172.21.15.146:0/3156971338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80216a6b0 0x55e802559b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.229+0000 7f1e4e479740 1 --2- 172.21.15.146:0/3156971338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559610 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.229+0000 7f1e4e479740 1 --2- 172.21.15.146:0/3156971338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80254b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.229+0000 7f1e4e479740 1 -- 172.21.15.146:0/3156971338 >> 172.21.15.146:0/3156971338 conn(0x55e80217f4e0 msgr2=0x55e802532a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.229+0000 7f1e4e479740 1 -- 172.21.15.146:0/3156971338 shutdown_connections 2024-09-17T03:42:21.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.229+0000 7f1e4e479740 1 -- 172.21.15.146:0/3156971338 wait complete. 2024-09-17T03:42:21.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.230+0000 7f1e4e479740 1 -- start start 2024-09-17T03:42:21.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.230+0000 7f1e4e479740 1 Processor -- start 2024-09-17T03:42:21.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e8021624d0 0x55e802570180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025706c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80258b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e4e479740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55e802205740 con 0x55e80216a6b0 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e4e479740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e80243a970 con 0x55e80218b390 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e4e479740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55e8024a5a60 con 0x55e8021624d0 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e4e479740 10 client.0 _ll_register_callbacks cb 0x55e80243dbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e449cb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e449cb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025706c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38762/0 (socket says 172.21.15.146:38762) 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e449cb640 1 -- 172.21.15.146:0/4123791356 learned_addr learned my addr 172.21.15.146:0/4123791356 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e451cc640 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e8021624d0 0x55e802570180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e459cd640 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80258b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e449cb640 1 -- 172.21.15.146:0/4123791356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e8021624d0 msgr2=0x55e802570180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e449cb640 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e8021624d0 0x55e802570180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e449cb640 1 -- 172.21.15.146:0/4123791356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 msgr2=0x55e80258b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e449cb640 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80258b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e449cb640 1 -- 172.21.15.146:0/4123791356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8021f6970 con 0x55e80216a6b0 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e451cc640 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e8021624d0 0x55e802570180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e459cd640 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80258b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e449cb640 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025706c0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f1e30080f20 tx=0x7f1e30080370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d65ec5b078212a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.232+0000 7f1e1bfff640 1 -- 172.21.15.146:0/4123791356 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30084110 con 0x55e80216a6b0 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e1bfff640 1 -- 172.21.15.146:0/4123791356 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f1e3008d100 con 0x55e80216a6b0 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e4e479740 1 -- 172.21.15.146:0/4123791356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e3008d590 con 0x55e80216a6b0 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e1bfff640 1 -- 172.21.15.146:0/4123791356 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f1e30004e40 con 0x55e80216a6b0 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e4e479740 10 client.9423 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e4e479740 1 -- 172.21.15.146:0/4123791356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55e8021d46a0 con 0x55e80216a6b0 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e1bfff640 1 -- 172.21.15.146:0/4123791356 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e3008d590 con 0x55e80216a6b0 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e1bfff640 1 -- 172.21.15.146:0/4123791356 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f1e3004b030 con 0x55e80216a6b0 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e4e479740 10 client.9423 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e4e479740 10 client.9423 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:21.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e4e479740 20 client.9423 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e4e479740 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55e802149f60 0x55e80258b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e4e479740 4 client.9423 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e4e479740 1 -- 172.21.15.146:0/4123791356 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8024a79b0 con 0x55e802149f60 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e451cc640 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55e802149f60 0x55e80258b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.233+0000 7f1e1bfff640 10 client.9423 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e451cc640 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55e802149f60 0x55e80258b8e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87ce2f07c3acc583 server_cookie=1b552cb9fc827974 in_seq=0 out_seq=0 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e1bfff640 1 -- 172.21.15.146:0/4123791356 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8024a79b0 con 0x55e802149f60 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e1bfff640 10 client.9423 handle_command_reply: tid=0 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e4e479740 1 client.9423 shutdown 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e4e479740 1 -- 172.21.15.146:0/4123791356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 msgr2=0x55e8025706c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e4e479740 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025706c0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f1e30080f20 tx=0x7f1e30080370 comp rx=0 tx=0).stop 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e4e479740 1 -- 172.21.15.146:0/4123791356 shutdown_connections 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e4e479740 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55e802149f60 0x55e80258b8e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e4e479740 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80258b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e4e479740 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025706c0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e1bfff640 0 client.9423 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:21.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e4e479740 1 --2- 172.21.15.146:0/4123791356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e8021624d0 0x55e802570180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.234+0000 7f1e4e479740 1 -- 172.21.15.146:0/4123791356 >> 172.21.15.146:0/4123791356 conn(0x55e80217f4e0 msgr2=0x55e80254c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.235+0000 7f1e4e479740 1 -- 172.21.15.146:0/4123791356 shutdown_connections 2024-09-17T03:42:21.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.235+0000 7f1e4e479740 1 -- 172.21.15.146:0/4123791356 wait complete. 2024-09-17T03:42:21.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.235+0000 7f1e4e479740 20 client.9423 trim_cache size 0 max 16384 2024-09-17T03:42:21.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.252+0000 7f1e4e479740 1 Processor -- start 2024-09-17T03:42:21.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.252+0000 7f1e4e479740 1 -- start start 2024-09-17T03:42:21.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.253+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.253+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80216a6b0 0x55e80255c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.253+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80255c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.253+0000 7f1e4e479740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e400cfc40 con 0x55e8021624d0 2024-09-17T03:42:21.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.253+0000 7f1e4e479740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1e400aa580 con 0x55e80218b390 2024-09-17T03:42:21.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.253+0000 7f1e4e479740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1e401f60d0 con 0x55e80216a6b0 2024-09-17T03:42:21.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.253+0000 7f1e451cc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.253+0000 7f1e451cc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38776/0 (socket says 172.21.15.146:38776) 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.253+0000 7f1e451cc640 1 -- 172.21.15.146:0/4136559709 learned_addr learned my addr 172.21.15.146:0/4136559709 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.254+0000 7f1e459cd640 1 --2- 172.21.15.146:0/4136559709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80255c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.254+0000 7f1e449cb640 1 --2- 172.21.15.146:0/4136559709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80216a6b0 0x55e80255c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.254+0000 7f1e451cc640 1 -- 172.21.15.146:0/4136559709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80216a6b0 msgr2=0x55e80255c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.254+0000 7f1e451cc640 1 --2- 172.21.15.146:0/4136559709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80216a6b0 0x55e80255c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.254+0000 7f1e451cc640 1 -- 172.21.15.146:0/4136559709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 msgr2=0x55e80255c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.254+0000 7f1e451cc640 1 --2- 172.21.15.146:0/4136559709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80255c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.254+0000 7f1e451cc640 1 -- 172.21.15.146:0/4136559709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e802531370 con 0x55e8021624d0 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.254+0000 7f1e451cc640 1 --2- 172.21.15.146:0/4136559709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559aa0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x55e802532690 tx=0x7f1e3c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59227ea96acabb86 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.254+0000 7f1e227fc640 1 -- 172.21.15.146:0/4136559709 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c016d90 con 0x55e8021624d0 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.254+0000 7f1e227fc640 1 -- 172.21.15.146:0/4136559709 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e3c01b040 con 0x55e8021624d0 2024-09-17T03:42:21.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.254+0000 7f1e227fc640 1 -- 172.21.15.146:0/4136559709 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0162d0 con 0x55e8021624d0 2024-09-17T03:42:21.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.255+0000 7f1e4e479740 1 -- 172.21.15.146:0/4136559709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 msgr2=0x55e802559aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.255+0000 7f1e4e479740 1 --2- 172.21.15.146:0/4136559709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559aa0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x55e802532690 tx=0x7f1e3c012000 comp rx=0 tx=0).stop 2024-09-17T03:42:21.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.255+0000 7f1e4e479740 1 -- 172.21.15.146:0/4136559709 shutdown_connections 2024-09-17T03:42:21.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.255+0000 7f1e4e479740 1 --2- 172.21.15.146:0/4136559709 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e80218b390 0x55e80255c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.255+0000 7f1e4e479740 1 --2- 172.21.15.146:0/4136559709 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80216a6b0 0x55e80255c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.255+0000 7f1e4e479740 1 --2- 172.21.15.146:0/4136559709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e8021624d0 0x55e802559aa0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.255+0000 7f1e4e479740 1 -- 172.21.15.146:0/4136559709 >> 172.21.15.146:0/4136559709 conn(0x55e80217f4e0 msgr2=0x55e80259f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.255+0000 7f1e4e479740 1 -- 172.21.15.146:0/4136559709 shutdown_connections 2024-09-17T03:42:21.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.255+0000 7f1e4e479740 1 -- 172.21.15.146:0/4136559709 wait complete. 2024-09-17T03:42:21.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.256+0000 7f1e4e479740 1 -- start start 2024-09-17T03:42:21.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.256+0000 7f1e4e479740 1 Processor -- start 2024-09-17T03:42:21.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e8021624d0 0x55e8025fe1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025f1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e4e479740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80218b390 0x55e80255c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e4e479740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1e401f6720 con 0x55e80216a6b0 2024-09-17T03:42:21.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e4e479740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55e80252ca00 con 0x55e8021624d0 2024-09-17T03:42:21.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e4e479740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55e8025f1b60 con 0x55e80218b390 2024-09-17T03:42:21.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e4e479740 10 client.0 _ll_register_callbacks cb 0x7f1e3006e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:21.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e449cb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e449cb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025f1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38778/0 (socket says 172.21.15.146:38778) 2024-09-17T03:42:21.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e449cb640 1 -- 172.21.15.146:0/2928862873 learned_addr learned my addr 172.21.15.146:0/2928862873 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e451cc640 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e8021624d0 0x55e8025fe1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.257+0000 7f1e459cd640 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80218b390 0x55e80255c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e449cb640 1 -- 172.21.15.146:0/2928862873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80218b390 msgr2=0x55e80255c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e449cb640 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80218b390 0x55e80255c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e449cb640 1 -- 172.21.15.146:0/2928862873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e8021624d0 msgr2=0x55e8025fe1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:21.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e449cb640 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e8021624d0 0x55e8025fe1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e449cb640 1 -- 172.21.15.146:0/2928862873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e80254a7c0 con 0x55e80216a6b0 2024-09-17T03:42:21.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e449cb640 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025f1620 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f1e3002abb0 tx=0x7f1e300841c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2147087cf80911c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e1bfff640 1 -- 172.21.15.146:0/2928862873 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3008d590 con 0x55e80216a6b0 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e1bfff640 1 -- 172.21.15.146:0/2928862873 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f1e3006cca0 con 0x55e80216a6b0 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e4e479740 1 -- 172.21.15.146:0/2928862873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e3c01b040 con 0x55e80216a6b0 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e1bfff640 1 -- 172.21.15.146:0/2928862873 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f1e3006cea0 con 0x55e80216a6b0 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e4e479740 10 client.9429 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e4e479740 1 -- 172.21.15.146:0/2928862873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55e80254a7c0 con 0x55e80216a6b0 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e1bfff640 1 -- 172.21.15.146:0/2928862873 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e3c01b040 con 0x55e80216a6b0 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e1bfff640 1 -- 172.21.15.146:0/2928862873 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f1e3004b040 con 0x55e80216a6b0 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e4e479740 10 client.9429 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e4e479740 10 client.9429 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e4e479740 20 client.9429 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:21.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e4e479740 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55e802578940 0x55e80255c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e4e479740 4 client.9429 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e4e479740 1 -- 172.21.15.146:0/2928862873 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e8024a3460 con 0x55e802578940 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.258+0000 7f1e451cc640 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55e802578940 0x55e80255c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e1bfff640 10 client.9429 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e451cc640 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55e802578940 0x55e80255c950 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d05a52a2f268b253 server_cookie=6338d24e420c6291 in_seq=0 out_seq=0 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e1bfff640 1 -- 172.21.15.146:0/2928862873 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x55e8024a3460 con 0x55e802578940 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e1bfff640 10 client.9429 handle_command_reply: tid=0 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e4e479740 1 client.9429 shutdown 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e4e479740 1 -- 172.21.15.146:0/2928862873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 msgr2=0x55e8025f1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e4e479740 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025f1620 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f1e3002abb0 tx=0x7f1e300841c0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e4e479740 1 -- 172.21.15.146:0/2928862873 shutdown_connections 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e4e479740 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55e802578940 0x55e80255c950 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e4e479740 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55e80218b390 0x55e80255c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e4e479740 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e80216a6b0 0x55e8025f1620 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e1bfff640 0 client.9429 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e4e479740 1 --2- 172.21.15.146:0/2928862873 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55e8021624d0 0x55e8025fe1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.259+0000 7f1e4e479740 1 -- 172.21.15.146:0/2928862873 >> 172.21.15.146:0/2928862873 conn(0x55e80217f4e0 msgr2=0x55e80252e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e4e479740 1 -- 172.21.15.146:0/2928862873 shutdown_connections 2024-09-17T03:42:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e4e479740 1 -- 172.21.15.146:0/2928862873 wait complete. 2024-09-17T03:42:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e4e479740 20 client.9429 trim_cache size 0 max 16384 2024-09-17T03:42:21.265 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "PAUSED (793 inodes in the stack)", 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "e831064f-2a65-4323-88f5-8eb02fad2c07": { 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "e831064f-2a65-4323-88f5-8eb02fad2c07", 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "e831064f-2a65-4323-88f5-8eb02fad2c07": { 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:42:20.849070+0000", 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:42:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:42:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:42:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:42:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:42:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:21.267 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:42:21.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 -- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e24078b90 msgr2=0x7f1e2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e24078b90 0x7f1e2407b0a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c000f60 tx=0x7f1e3c009040 comp rx=0 tx=0).stop 2024-09-17T03:42:21.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 -- 172.21.15.146:0/1365985336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e400b3360 msgr2=0x7f1e401f3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e400b3360 0x7f1e401f3040 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f1e3002abe0 tx=0x7f1e300052f0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 -- 172.21.15.146:0/1365985336 shutdown_connections 2024-09-17T03:42:21.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1e24078b90 0x7f1e2407b0a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1e4015f010 0x7f1e400ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1e400b3360 0x7f1e401f3040 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 --2- 172.21.15.146:0/1365985336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1e40072df0 0x7f1e4014c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 -- 172.21.15.146:0/1365985336 >> 172.21.15.146:0/1365985336 conn(0x7f1e400b2060 msgr2=0x7f1e40151210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 -- 172.21.15.146:0/1365985336 shutdown_connections 2024-09-17T03:42:21.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.260+0000 7f1e47430640 1 -- 172.21.15.146:0/1365985336 wait complete. 2024-09-17T03:42:21.270 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.384+0000 7f4816238640 1 -- 172.21.15.146:0/916633048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f481015b770 msgr2=0x7f481006fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.384+0000 7f4816238640 1 --2- 172.21.15.146:0/916633048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f481015b770 0x7f481006fe10 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f4810074da0 tx=0x7f480002a4e0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.384+0000 7f4816238640 1 -- 172.21.15.146:0/916633048 shutdown_connections 2024-09-17T03:42:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.384+0000 7f4816238640 1 --2- 172.21.15.146:0/916633048 >> v2:172.21.15.179:3300/0 conn(0x7f4810072bc0 0x7f481015f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.384+0000 7f4816238640 1 --2- 172.21.15.146:0/916633048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4810070350 0x7f4810072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.384+0000 7f4816238640 1 --2- 172.21.15.146:0/916633048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f481015b770 0x7f481006fe10 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.384+0000 7f4816238640 1 -- 172.21.15.146:0/916633048 >> 172.21.15.146:0/916633048 conn(0x7f48100b2060 msgr2=0x7f48100b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.384+0000 7f4816238640 1 -- 172.21.15.146:0/916633048 shutdown_connections 2024-09-17T03:42:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.384+0000 7f4816238640 1 -- 172.21.15.146:0/916633048 wait complete. 2024-09-17T03:42:21.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.386+0000 7f4816238640 1 Processor -- start 2024-09-17T03:42:21.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.386+0000 7f4816238640 1 -- start start 2024-09-17T03:42:21.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f4816238640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4810070350 0x7f4810148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f4816238640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4810072bc0 0x7f481015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f4816238640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f481015b770 0x7f481015df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f4816238640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f481015fbb0 con 0x7f4810072bc0 2024-09-17T03:42:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f4816238640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f481015fa30 con 0x7f4810070350 2024-09-17T03:42:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f4816238640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f481015fd30 con 0x7f481015b770 2024-09-17T03:42:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f480effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4810072bc0 0x7f481015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f480effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4810072bc0 0x7f481015ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38802/0 (socket says 172.21.15.146:38802) 2024-09-17T03:42:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f480effd640 1 -- 172.21.15.146:0/27062889 learned_addr learned my addr 172.21.15.146:0/27062889 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f480f7fe640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4810070350 0x7f4810148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f480ffff640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f481015b770 0x7f481015df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f480effd640 1 -- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f481015b770 msgr2=0x7f481015df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f480effd640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f481015b770 0x7f481015df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f480effd640 1 -- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4810070350 msgr2=0x7f4810148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f480effd640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4810070350 0x7f4810148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.387+0000 7f480effd640 1 -- 172.21.15.146:0/27062889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4810149340 con 0x7f4810072bc0 2024-09-17T03:42:21.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.388+0000 7f480ffff640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f481015b770 0x7f481015df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:21.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.388+0000 7f480effd640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4810072bc0 0x7f481015ab60 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f480400d730 tx=0x7f480400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.388+0000 7f47f7fff640 1 -- 172.21.15.146:0/27062889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804017070 con 0x7f4810072bc0 2024-09-17T03:42:21.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.388+0000 7f47f7fff640 1 -- 172.21.15.146:0/27062889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4804009a30 con 0x7f4810072bc0 2024-09-17T03:42:21.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.388+0000 7f4816238640 1 -- 172.21.15.146:0/27062889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48101f70d0 con 0x7f4810072bc0 2024-09-17T03:42:21.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.388+0000 7f47f7fff640 1 -- 172.21.15.146:0/27062889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804010460 con 0x7f4810072bc0 2024-09-17T03:42:21.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.388+0000 7f4816238640 1 -- 172.21.15.146:0/27062889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48101f7690 con 0x7f4810072bc0 2024-09-17T03:42:21.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.389+0000 7f4816238640 1 -- 172.21.15.146:0/27062889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48101f6e40 con 0x7f4810072bc0 2024-09-17T03:42:21.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.390+0000 7f47f7fff640 1 -- 172.21.15.146:0/27062889 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f480401a070 con 0x7f4810072bc0 2024-09-17T03:42:21.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.390+0000 7f47f7fff640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 0x7f47fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.390+0000 7f47f7fff640 1 -- 172.21.15.146:0/27062889 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f480409ae80 con 0x7f4810072bc0 2024-09-17T03:42:21.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.391+0000 7f480f7fe640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 0x7f47fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.391+0000 7f480f7fe640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 0x7f47fc07b0a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4800033000 tx=0x7f4800004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.395+0000 7f47f7fff640 1 -- 172.21.15.146:0/27062889 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4804062bf0 con 0x7f4810072bc0 2024-09-17T03:42:21.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.603+0000 7f4816238640 1 -- 172.21.15.146:0/27062889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f481015f2e0 con 0x7f4810072bc0 2024-09-17T03:42:21.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.604+0000 7f47f7fff640 1 -- 172.21.15.146:0/27062889 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7f4804067620 con 0x7f4810072bc0 2024-09-17T03:42:21.603 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:21.603 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:21.603 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:21.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 -- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 msgr2=0x7f47fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 0x7f47fc07b0a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4800033000 tx=0x7f4800004730 comp rx=0 tx=0).stop 2024-09-17T03:42:21.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 -- 172.21.15.146:0/27062889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4810072bc0 msgr2=0x7f481015ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4810072bc0 0x7f481015ab60 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f480400d730 tx=0x7f480400dbf0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 -- 172.21.15.146:0/27062889 shutdown_connections 2024-09-17T03:42:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f47fc078b90 0x7f47fc07b0a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f481015b770 0x7f481015df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4810072bc0 0x7f481015ab60 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 --2- 172.21.15.146:0/27062889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4810070350 0x7f4810148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 -- 172.21.15.146:0/27062889 >> 172.21.15.146:0/27062889 conn(0x7f48100b2060 msgr2=0x7f48100b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 -- 172.21.15.146:0/27062889 shutdown_connections 2024-09-17T03:42:21.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.606+0000 7f4816238640 1 -- 172.21.15.146:0/27062889 wait complete. 2024-09-17T03:42:21.616 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T03:42:21.617 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:42:21.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.730+0000 7fd13dad5640 1 -- 172.21.15.146:0/3058540020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd124004800 msgr2=0x7fd124004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.730+0000 7fd13dad5640 1 --2- 172.21.15.146:0/3058540020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd124004800 0x7fd124004c10 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fd120009ce0 tx=0x7fd124005830 comp rx=0 tx=0).stop 2024-09-17T03:42:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.730+0000 7fd13dad5640 1 -- 172.21.15.146:0/3058540020 shutdown_connections 2024-09-17T03:42:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.730+0000 7fd13dad5640 1 --2- 172.21.15.146:0/3058540020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd124004800 0x7fd124004c10 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.730+0000 7fd13dad5640 1 -- 172.21.15.146:0/3058540020 >> 172.21.15.146:0/3058540020 conn(0x7fd1380b2060 msgr2=0x7fd1380b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.730+0000 7fd13dad5640 1 -- 172.21.15.146:0/3058540020 shutdown_connections 2024-09-17T03:42:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.730+0000 7fd13dad5640 1 -- 172.21.15.146:0/3058540020 wait complete. 2024-09-17T03:42:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.732+0000 7fd13dad5640 1 Processor -- start 2024-09-17T03:42:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.732+0000 7fd13dad5640 1 -- start start 2024-09-17T03:42:21.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd13dad5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd124004800 0x7fd1381f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd13dad5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13814dd40 0x7fd1381f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd13dad5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1381f64f0 0x7fd13813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd13dad5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd138072e20 con 0x7fd13814dd40 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd13dad5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd138072ca0 con 0x7fd124004800 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd13dad5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd13806fe10 con 0x7fd1381f64f0 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd12ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13814dd40 0x7fd1381f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd12ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13814dd40 0x7fd1381f5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38814/0 (socket says 172.21.15.146:38814) 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd12ffff640 1 -- 172.21.15.146:0/1460350863 learned_addr learned my addr 172.21.15.146:0/1460350863 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd1377fe640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd124004800 0x7fd1381f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd137fff640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1381f64f0 0x7fd13813fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd12ffff640 1 -- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1381f64f0 msgr2=0x7fd13813fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd12ffff640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1381f64f0 0x7fd13813fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd12ffff640 1 -- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd124004800 msgr2=0x7fd1381f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd12ffff640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd124004800 0x7fd1381f5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.733+0000 7fd12ffff640 1 -- 172.21.15.146:0/1460350863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd138150e30 con 0x7fd13814dd40 2024-09-17T03:42:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.734+0000 7fd12ffff640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13814dd40 0x7fd1381f5fb0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fd120009ce0 tx=0x7fd12002b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.734+0000 7fd134ff9640 1 -- 172.21.15.146:0/1460350863 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120004bb0 con 0x7fd13814dd40 2024-09-17T03:42:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.734+0000 7fd134ff9640 1 -- 172.21.15.146:0/1460350863 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd120004e40 con 0x7fd13814dd40 2024-09-17T03:42:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.734+0000 7fd13dad5640 1 -- 172.21.15.146:0/1460350863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd138151110 con 0x7fd13814dd40 2024-09-17T03:42:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.734+0000 7fd134ff9640 1 -- 172.21.15.146:0/1460350863 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12003c720 con 0x7fd13814dd40 2024-09-17T03:42:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.734+0000 7fd13dad5640 1 -- 172.21.15.146:0/1460350863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1381516d0 con 0x7fd13814dd40 2024-09-17T03:42:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.735+0000 7fd13dad5640 1 -- 172.21.15.146:0/1460350863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd138070370 con 0x7fd13814dd40 2024-09-17T03:42:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.736+0000 7fd134ff9640 1 -- 172.21.15.146:0/1460350863 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd12002ba40 con 0x7fd13814dd40 2024-09-17T03:42:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.736+0000 7fd134ff9640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd118078bc0 0x7fd11807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.736+0000 7fd134ff9640 1 -- 172.21.15.146:0/1460350863 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fd1200bdff0 con 0x7fd13814dd40 2024-09-17T03:42:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.736+0000 7fd1377fe640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd118078bc0 0x7fd11807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.737+0000 7fd1377fe640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd118078bc0 0x7fd11807b0d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd13806c6a0 tx=0x7fd128001ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.740+0000 7fd134ff9640 1 -- 172.21.15.146:0/1460350863 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd120085fd0 con 0x7fd13814dd40 2024-09-17T03:42:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.986+0000 7fd13dad5640 1 -- 172.21.15.146:0/1460350863 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd1380b0580 con 0x7fd13814dd40 2024-09-17T03:42:21.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.986+0000 7fd134ff9640 1 -- 172.21.15.146:0/1460350863 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7fd12008aa00 con 0x7fd13814dd40 2024-09-17T03:42:21.986 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:21.986 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":586,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":891,"data_bytes":911642481,"bytes_used":2205523968,"bytes_avail":770888589312,"bytes_total":773094113280,"write_bytes_sec":75907959,"read_op_per_sec":0,"write_op_per_sec":74},"fsmap":{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9216}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-17T03:41:41.930323+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:42:21.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.988+0000 7fd13dad5640 1 -- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd118078bc0 msgr2=0x7fd11807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.988+0000 7fd13dad5640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd118078bc0 0x7fd11807b0d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd13806c6a0 tx=0x7fd128001ab0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.988+0000 7fd13dad5640 1 -- 172.21.15.146:0/1460350863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13814dd40 msgr2=0x7fd1381f5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.988+0000 7fd13dad5640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13814dd40 0x7fd1381f5fb0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fd120009ce0 tx=0x7fd12002b500 comp rx=0 tx=0).stop 2024-09-17T03:42:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.988+0000 7fd13dad5640 1 -- 172.21.15.146:0/1460350863 shutdown_connections 2024-09-17T03:42:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.989+0000 7fd13dad5640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd118078bc0 0x7fd11807b0d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.989+0000 7fd13dad5640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1381f64f0 0x7fd13813fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.989+0000 7fd13dad5640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd13814dd40 0x7fd1381f5fb0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.989+0000 7fd13dad5640 1 --2- 172.21.15.146:0/1460350863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd124004800 0x7fd1381f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.989+0000 7fd13dad5640 1 -- 172.21.15.146:0/1460350863 >> 172.21.15.146:0/1460350863 conn(0x7fd1380b2060 msgr2=0x7fd1380ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.989+0000 7fd13dad5640 1 -- 172.21.15.146:0/1460350863 shutdown_connections 2024-09-17T03:42:21.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:21.989+0000 7fd13dad5640 1 -- 172.21.15.146:0/1460350863 wait complete. 2024-09-17T03:42:21.999 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:42:23.000 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:23.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.122+0000 7f16477ad640 1 -- 172.21.15.146:0/3366728384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16401620f0 msgr2=0x7f164006ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:23.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.122+0000 7f16477ad640 1 --2- 172.21.15.146:0/3366728384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16401620f0 0x7f164006ed30 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f16400b73c0 tx=0x7f163402a560 comp rx=0 tx=0).stop 2024-09-17T03:42:23.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.122+0000 7f16477ad640 1 -- 172.21.15.146:0/3366728384 shutdown_connections 2024-09-17T03:42:23.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.122+0000 7f16477ad640 1 --2- 172.21.15.146:0/3366728384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16401620f0 0x7f164006ed30 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.122+0000 7f16477ad640 1 --2- 172.21.15.146:0/3366728384 >> v2:172.21.15.179:3300/0 conn(0x7f16400b3870 0x7f16400cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.122+0000 7f16477ad640 1 -- 172.21.15.146:0/3366728384 >> 172.21.15.146:0/3366728384 conn(0x7f16400d4be0 msgr2=0x7f16400d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:23.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.122+0000 7f16477ad640 1 -- 172.21.15.146:0/3366728384 shutdown_connections 2024-09-17T03:42:23.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.123+0000 7f16477ad640 1 -- 172.21.15.146:0/3366728384 wait complete. 2024-09-17T03:42:23.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.124+0000 7f16477ad640 1 Processor -- start 2024-09-17T03:42:23.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.124+0000 7f16477ad640 1 -- start start 2024-09-17T03:42:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f16477ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f164006f270 0x7f1640151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f16477ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400b3870 0x7f16400c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f16477ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16401620f0 0x7f16400ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f16477ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1640162670 con 0x7f164006f270 2024-09-17T03:42:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f16477ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f16400d43b0 con 0x7f16401620f0 2024-09-17T03:42:23.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f16477ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1640162fb0 con 0x7f16400b3870 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1645549640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f164006f270 0x7f1640151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1645549640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f164006f270 0x7f1640151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38828/0 (socket says 172.21.15.146:38828) 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1645549640 1 -- 172.21.15.146:0/2246796819 learned_addr learned my addr 172.21.15.146:0/2246796819 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1644d48640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400b3870 0x7f16400c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1645d4a640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16401620f0 0x7f16400ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1645549640 1 -- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400b3870 msgr2=0x7f16400c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1645549640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400b3870 0x7f16400c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1645549640 1 -- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16401620f0 msgr2=0x7f16400ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1645549640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16401620f0 0x7f16400ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1645549640 1 -- 172.21.15.146:0/2246796819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1640152180 con 0x7f164006f270 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1644d48640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400b3870 0x7f16400c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1645d4a640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16401620f0 0x7f16400ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1645549640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f164006f270 0x7f1640151c40 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f163c00c970 tx=0x7f163c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:23.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1631ffb640 1 -- 172.21.15.146:0/2246796819 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c007bb0 con 0x7f164006f270 2024-09-17T03:42:23.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1631ffb640 1 -- 172.21.15.146:0/2246796819 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f163c007e40 con 0x7f164006f270 2024-09-17T03:42:23.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f16477ad640 1 -- 172.21.15.146:0/2246796819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16400c7fd0 con 0x7f164006f270 2024-09-17T03:42:23.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.126+0000 7f1631ffb640 1 -- 172.21.15.146:0/2246796819 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c005280 con 0x7f164006f270 2024-09-17T03:42:23.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.127+0000 7f16477ad640 1 -- 172.21.15.146:0/2246796819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16400c8590 con 0x7f164006f270 2024-09-17T03:42:23.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.128+0000 7f16477ad640 1 -- 172.21.15.146:0/2246796819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1640163460 con 0x7f164006f270 2024-09-17T03:42:23.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.128+0000 7f1631ffb640 1 -- 172.21.15.146:0/2246796819 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f163c005420 con 0x7f164006f270 2024-09-17T03:42:23.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.129+0000 7f1631ffb640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1624078b90 0x7f162407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:23.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.129+0000 7f1631ffb640 1 -- 172.21.15.146:0/2246796819 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f163c09b170 con 0x7f164006f270 2024-09-17T03:42:23.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.129+0000 7f1644d48640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1624078b90 0x7f162407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:23.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.130+0000 7f1644d48640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1624078b90 0x7f162407b0a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1634033000 tx=0x7f1634004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:23.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.133+0000 7f1631ffb640 1 -- 172.21.15.146:0/2246796819 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f163c014030 con 0x7f164006f270 2024-09-17T03:42:23.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.342+0000 7f16477ad640 1 -- 172.21.15.146:0/2246796819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16400d2bd0 con 0x7f164006f270 2024-09-17T03:42:23.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.343+0000 7f1631ffb640 1 -- 172.21.15.146:0/2246796819 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7f163c063700 con 0x7f164006f270 2024-09-17T03:42:23.342 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:23.342 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:23.342 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 -- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1624078b90 msgr2=0x7f162407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1624078b90 0x7f162407b0a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1634033000 tx=0x7f1634004730 comp rx=0 tx=0).stop 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 -- 172.21.15.146:0/2246796819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f164006f270 msgr2=0x7f1640151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f164006f270 0x7f1640151c40 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f163c00c970 tx=0x7f163c00ce30 comp rx=0 tx=0).stop 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 -- 172.21.15.146:0/2246796819 shutdown_connections 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1624078b90 0x7f162407b0a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16401620f0 0x7f16400ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16400b3870 0x7f16400c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 --2- 172.21.15.146:0/2246796819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f164006f270 0x7f1640151c40 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 -- 172.21.15.146:0/2246796819 >> 172.21.15.146:0/2246796819 conn(0x7f16400d4be0 msgr2=0x7f1640160b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 -- 172.21.15.146:0/2246796819 shutdown_connections 2024-09-17T03:42:23.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.345+0000 7f16477ad640 1 -- 172.21.15.146:0/2246796819 wait complete. 2024-09-17T03:42:23.355 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T03:42:23.356 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:42:23.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.468+0000 7fa40198e640 1 -- 172.21.15.146:0/1742862372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3fc0b36b0 msgr2=0x7fa3fc0b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.468+0000 7fa40198e640 1 --2- 172.21.15.146:0/1742862372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3fc0b36b0 0x7fa3fc0b3c00 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009830 tx=0x7fa3ec02a510 comp rx=0 tx=0).stop 2024-09-17T03:42:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.468+0000 7fa40198e640 1 -- 172.21.15.146:0/1742862372 shutdown_connections 2024-09-17T03:42:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.468+0000 7fa40198e640 1 --2- 172.21.15.146:0/1742862372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3fc069410 0x7fa3fc168720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.468+0000 7fa40198e640 1 --2- 172.21.15.146:0/1742862372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3fc0b36b0 0x7fa3fc0b3c00 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.468+0000 7fa40198e640 1 -- 172.21.15.146:0/1742862372 >> 172.21.15.146:0/1742862372 conn(0x7fa3fc0d4960 msgr2=0x7fa3fc0d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.468+0000 7fa40198e640 1 -- 172.21.15.146:0/1742862372 shutdown_connections 2024-09-17T03:42:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.468+0000 7fa40198e640 1 -- 172.21.15.146:0/1742862372 wait complete. 2024-09-17T03:42:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.470+0000 7fa40198e640 1 Processor -- start 2024-09-17T03:42:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.470+0000 7fa40198e640 1 -- start start 2024-09-17T03:42:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.471+0000 7fa40198e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3fc0b36b0 0x7fa3fc0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.471+0000 7fa40198e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3fc15ec30 0x7fa3fc1f8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.471+0000 7fa40198e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3fc1f8ec0 0x7fa3fc0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.471+0000 7fa40198e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc168de0 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.471+0000 7fa40198e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc168c60 con 0x7fa3fc0b36b0 2024-09-17T03:42:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.471+0000 7fa40198e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa3fc168f60 con 0x7fa3fc15ec30 2024-09-17T03:42:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.471+0000 7fa3fb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3fc1f8ec0 0x7fa3fc0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.471+0000 7fa3fb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3fc1f8ec0 0x7fa3fc0b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38840/0 (socket says 172.21.15.146:38840) 2024-09-17T03:42:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.471+0000 7fa3fb7fe640 1 -- 172.21.15.146:0/2917065208 learned_addr learned my addr 172.21.15.146:0/2917065208 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3faffd640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3fc0b36b0 0x7fa3fc0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3f27fc640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3fc15ec30 0x7fa3fc1f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3fb7fe640 1 -- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3fc15ec30 msgr2=0x7fa3fc1f8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3fb7fe640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3fc15ec30 0x7fa3fc1f8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3fb7fe640 1 -- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3fc0b36b0 msgr2=0x7fa3fc0cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3fb7fe640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3fc0b36b0 0x7fa3fc0cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3fb7fe640 1 -- 172.21.15.146:0/2917065208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3fc1f9830 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3faffd640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3fc0b36b0 0x7fa3fc0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3f27fc640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3fc15ec30 0x7fa3fc1f8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3fb7fe640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3fc1f8ec0 0x7fa3fc0b4e30 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400e9c0 tx=0x7fa3f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3f8ff9640 1 -- 172.21.15.146:0/2917065208 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4004d20 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3f8ff9640 1 -- 172.21.15.146:0/2917065208 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3f400cb20 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa40198e640 1 -- 172.21.15.146:0/2917065208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3fc1f92d0 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa3f8ff9640 1 -- 172.21.15.146:0/2917065208 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4005020 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.472+0000 7fa40198e640 1 -- 172.21.15.146:0/2917065208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3fc0b6a50 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.473+0000 7fa40198e640 1 -- 172.21.15.146:0/2917065208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3fc0b3c00 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.474+0000 7fa3f8ff9640 1 -- 172.21.15.146:0/2917065208 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3f40051c0 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.474+0000 7fa3f8ff9640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3dc078b90 0x7fa3dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:23.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.475+0000 7fa3f8ff9640 1 -- 172.21.15.146:0/2917065208 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fa3f409b670 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.475+0000 7fa3faffd640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3dc078b90 0x7fa3dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:23.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.475+0000 7fa3faffd640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3dc078b90 0x7fa3dc07b0a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec034000 tx=0x7fa3ec004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:23.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.479+0000 7fa3f8ff9640 1 -- 172.21.15.146:0/2917065208 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa3fc1f92d0 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.722 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.723+0000 7fa40198e640 1 -- 172.21.15.146:0/2917065208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa3fc161e30 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.723+0000 7fa3f8ff9640 1 -- 172.21.15.146:0/2917065208 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7fa3f4016030 con 0x7fa3fc1f8ec0 2024-09-17T03:42:23.723 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:23.724 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":588,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":891,"data_bytes":911642481,"bytes_used":2205523968,"bytes_avail":770888589312,"bytes_total":773094113280,"write_bytes_sec":75907427,"read_op_per_sec":0,"write_op_per_sec":74},"fsmap":{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9216}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-17T03:41:41.930323+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:42:23.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.725+0000 7fa40198e640 1 -- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3dc078b90 msgr2=0x7fa3dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:23.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.725+0000 7fa40198e640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3dc078b90 0x7fa3dc07b0a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec034000 tx=0x7fa3ec004730 comp rx=0 tx=0).stop 2024-09-17T03:42:23.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.725+0000 7fa40198e640 1 -- 172.21.15.146:0/2917065208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3fc1f8ec0 msgr2=0x7fa3fc0b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:23.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.725+0000 7fa40198e640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3fc1f8ec0 0x7fa3fc0b4e30 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400e9c0 tx=0x7fa3f400ee80 comp rx=0 tx=0).stop 2024-09-17T03:42:23.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.725+0000 7fa40198e640 1 -- 172.21.15.146:0/2917065208 shutdown_connections 2024-09-17T03:42:23.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.725+0000 7fa40198e640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3dc078b90 0x7fa3dc07b0a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.726+0000 7fa40198e640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3fc1f8ec0 0x7fa3fc0b4e30 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.726+0000 7fa40198e640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3fc15ec30 0x7fa3fc1f8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.726+0000 7fa40198e640 1 --2- 172.21.15.146:0/2917065208 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3fc0b36b0 0x7fa3fc0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:23.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.726+0000 7fa40198e640 1 -- 172.21.15.146:0/2917065208 >> 172.21.15.146:0/2917065208 conn(0x7fa3fc0d4960 msgr2=0x7fa3fc15f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:23.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.726+0000 7fa40198e640 1 -- 172.21.15.146:0/2917065208 shutdown_connections 2024-09-17T03:42:23.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:23.726+0000 7fa40198e640 1 -- 172.21.15.146:0/2917065208 wait complete. 2024-09-17T03:42:23.737 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:42:24.739 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.864+0000 7f7e13ed5640 1 -- 172.21.15.146:0/3600010777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df8004d40 msgr2=0x7f7df8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.864+0000 7f7e13ed5640 1 --2- 172.21.15.146:0/3600010777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7df8004d40 0x7f7df8005190 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c730 tx=0x7f7df8005830 comp rx=0 tx=0).stop 2024-09-17T03:42:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.864+0000 7f7e12472640 1 -- 172.21.15.146:0/3600010777 reap_dead start 2024-09-17T03:42:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.864+0000 7f7e13ed5640 1 -- 172.21.15.146:0/3600010777 shutdown_connections 2024-09-17T03:42:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.864+0000 7f7e13ed5640 1 -- 172.21.15.146:0/3600010777 >> 172.21.15.146:0/3600010777 conn(0x7f7e0c0b7b20 msgr2=0x7f7e0c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.864+0000 7f7e13ed5640 1 -- 172.21.15.146:0/3600010777 shutdown_connections 2024-09-17T03:42:24.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.864+0000 7f7e13ed5640 1 -- 172.21.15.146:0/3600010777 wait complete. 2024-09-17T03:42:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.866+0000 7f7e13ed5640 1 Processor -- start 2024-09-17T03:42:24.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.866+0000 7f7e13ed5640 1 -- start start 2024-09-17T03:42:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.867+0000 7f7e13ed5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7df8004d40 0x7f7e0c1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.867+0000 7f7e13ed5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0c1f78a0 0x7f7e0c134a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.867+0000 7f7e13ed5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e0c1f6d00 0x7f7e0c1f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.867+0000 7f7e13ed5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c0b1320 con 0x7f7e0c1f6d00 2024-09-17T03:42:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.867+0000 7f7e13ed5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c15dd70 con 0x7f7e0c1f78a0 2024-09-17T03:42:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.867+0000 7f7e13ed5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0c0b14a0 con 0x7f7df8004d40 2024-09-17T03:42:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e12472640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e0c1f6d00 0x7f7e0c1f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e12472640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e0c1f6d00 0x7f7e0c1f7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38860/0 (socket says 172.21.15.146:38860) 2024-09-17T03:42:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e12472640 1 -- 172.21.15.146:0/2229636983 learned_addr learned my addr 172.21.15.146:0/2229636983 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:24.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e11c71640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7df8004d40 0x7f7e0c1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e11470640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0c1f78a0 0x7f7e0c134a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e12472640 1 -- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7df8004d40 msgr2=0x7f7e0c1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e12472640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7df8004d40 0x7f7e0c1559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e12472640 1 -- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0c1f78a0 msgr2=0x7f7e0c134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e12472640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0c1f78a0 0x7f7e0c134a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e12472640 1 -- 172.21.15.146:0/2229636983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0c1f7650 con 0x7f7e0c1f6d00 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e11470640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0c1f78a0 0x7f7e0c134a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e12472640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e0c1f6d00 0x7f7e0c1f7110 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c850 tx=0x7f7e0400c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e027fc640 1 -- 172.21.15.146:0/2229636983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04004d50 con 0x7f7e0c1f6d00 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e027fc640 1 -- 172.21.15.146:0/2229636983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e0402b990 con 0x7f7e0c1f6d00 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e027fc640 1 -- 172.21.15.146:0/2229636983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0402bde0 con 0x7f7e0c1f6d00 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e13ed5640 1 -- 172.21.15.146:0/2229636983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0c1561f0 con 0x7f7e0c1f6d00 2024-09-17T03:42:24.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.868+0000 7f7e13ed5640 1 -- 172.21.15.146:0/2229636983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e0c1567b0 con 0x7f7e0c1f6d00 2024-09-17T03:42:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.869+0000 7f7e13ed5640 1 -- 172.21.15.146:0/2229636983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e0c0b3620 con 0x7f7e0c1f6d00 2024-09-17T03:42:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.870+0000 7f7e027fc640 1 -- 172.21.15.146:0/2229636983 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e0403d030 con 0x7f7e0c1f6d00 2024-09-17T03:42:24.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.871+0000 7f7e027fc640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7df0078b90 0x7f7df007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.871+0000 7f7e027fc640 1 -- 172.21.15.146:0/2229636983 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f7e040ba870 con 0x7f7e0c1f6d00 2024-09-17T03:42:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.871+0000 7f7e11c71640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7df0078b90 0x7f7df007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:24.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.872+0000 7f7e11c71640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7df0078b90 0x7f7df007b0a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7e08003700 tx=0x7f7e0800b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:24.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:24.875+0000 7f7e027fc640 1 -- 172.21.15.146:0/2229636983 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e0c1f7650 con 0x7f7e0c1f6d00 2024-09-17T03:42:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.086+0000 7f7e13ed5640 1 -- 172.21.15.146:0/2229636983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e0c155f80 con 0x7f7e0c1f6d00 2024-09-17T03:42:25.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.086+0000 7f7e027fc640 1 -- 172.21.15.146:0/2229636983 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7f7e0c0b3f70 con 0x7f7e0c1f6d00 2024-09-17T03:42:25.086 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:25.086 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 -- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7df0078b90 msgr2=0x7f7df007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7df0078b90 0x7f7df007b0a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7e08003700 tx=0x7f7e0800b260 comp rx=0 tx=0).stop 2024-09-17T03:42:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 -- 172.21.15.146:0/2229636983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e0c1f6d00 msgr2=0x7f7e0c1f7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e0c1f6d00 0x7f7e0c1f7110 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c850 tx=0x7f7e0400c380 comp rx=0 tx=0).stop 2024-09-17T03:42:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 -- 172.21.15.146:0/2229636983 shutdown_connections 2024-09-17T03:42:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7df0078b90 0x7f7df007b0a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e0c1f6d00 0x7f7e0c1f7110 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0c1f78a0 0x7f7e0c134a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 --2- 172.21.15.146:0/2229636983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7df8004d40 0x7f7e0c1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 -- 172.21.15.146:0/2229636983 >> 172.21.15.146:0/2229636983 conn(0x7f7e0c0b7b20 msgr2=0x7f7e0c15e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:25.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 -- 172.21.15.146:0/2229636983 shutdown_connections 2024-09-17T03:42:25.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.089+0000 7f7e13ed5640 1 -- 172.21.15.146:0/2229636983 wait complete. 2024-09-17T03:42:25.099 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T03:42:25.099 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:42:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.212+0000 7f06f769b640 1 -- 172.21.15.146:0/762939250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f00b47c0 msgr2=0x7f06f0161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.212+0000 7f06f769b640 1 --2- 172.21.15.146:0/762939250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f00b47c0 0x7f06f0161930 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f06e8005fd0 tx=0x7f06e802a820 comp rx=0 tx=0).stop 2024-09-17T03:42:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.212+0000 7f06f769b640 1 -- 172.21.15.146:0/762939250 shutdown_connections 2024-09-17T03:42:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.212+0000 7f06f769b640 1 --2- 172.21.15.146:0/762939250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f00b47c0 0x7f06f0161930 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.212+0000 7f06f769b640 1 --2- 172.21.15.146:0/762939250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f00d0710 0x7f06f00cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.212+0000 7f06f769b640 1 -- 172.21.15.146:0/762939250 >> 172.21.15.146:0/762939250 conn(0x7f06f009ba20 msgr2=0x7f06f00b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.212+0000 7f06f769b640 1 -- 172.21.15.146:0/762939250 shutdown_connections 2024-09-17T03:42:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.212+0000 7f06f769b640 1 -- 172.21.15.146:0/762939250 wait complete. 2024-09-17T03:42:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.214+0000 7f06f769b640 1 Processor -- start 2024-09-17T03:42:25.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.214+0000 7f06f769b640 1 -- start start 2024-09-17T03:42:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f769b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f00b47c0 0x7f06f01f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f769b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f00cf6b0 0x7f06f015d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f769b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f00d0710 0x7f06f00b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f769b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f06f00b1de0 con 0x7f06f00cf6b0 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f769b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f06f0162080 con 0x7f06f00b47c0 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f769b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f06f00b1f60 con 0x7f06f00d0710 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f4c36640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f00cf6b0 0x7f06f015d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f4c36640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f00cf6b0 0x7f06f015d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38868/0 (socket says 172.21.15.146:38868) 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f4c36640 1 -- 172.21.15.146:0/2123040606 learned_addr learned my addr 172.21.15.146:0/2123040606 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f5c38640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f00d0710 0x7f06f00b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f5437640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f00b47c0 0x7f06f01f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f4c36640 1 -- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f00d0710 msgr2=0x7f06f00b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f4c36640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f00d0710 0x7f06f00b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f4c36640 1 -- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f00b47c0 msgr2=0x7f06f01f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f4c36640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f00b47c0 0x7f06f01f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f4c36640 1 -- 172.21.15.146:0/2123040606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f01f7b20 con 0x7f06f00cf6b0 2024-09-17T03:42:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.215+0000 7f06f5c38640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f00d0710 0x7f06f00b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.216+0000 7f06f4c36640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f00cf6b0 0x7f06f015d840 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c3f0 tx=0x7f06e000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.216+0000 7f06e5ffb640 1 -- 172.21.15.146:0/2123040606 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0017070 con 0x7f06f00cf6b0 2024-09-17T03:42:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.216+0000 7f06e5ffb640 1 -- 172.21.15.146:0/2123040606 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06e00035f0 con 0x7f06f00cf6b0 2024-09-17T03:42:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.216+0000 7f06f769b640 1 -- 172.21.15.146:0/2123040606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f01579e0 con 0x7f06f00cf6b0 2024-09-17T03:42:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.216+0000 7f06e5ffb640 1 -- 172.21.15.146:0/2123040606 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0003a40 con 0x7f06f00cf6b0 2024-09-17T03:42:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.216+0000 7f06f769b640 1 -- 172.21.15.146:0/2123040606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f009dcf0 con 0x7f06f00cf6b0 2024-09-17T03:42:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.217+0000 7f06f769b640 1 -- 172.21.15.146:0/2123040606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f0157740 con 0x7f06f00cf6b0 2024-09-17T03:42:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.218+0000 7f06e5ffb640 1 -- 172.21.15.146:0/2123040606 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06e001a070 con 0x7f06f00cf6b0 2024-09-17T03:42:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.218+0000 7f06e5ffb640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d4078b90 0x7f06d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.219+0000 7f06e5ffb640 1 -- 172.21.15.146:0/2123040606 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f06e0099f90 con 0x7f06f00cf6b0 2024-09-17T03:42:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.219+0000 7f06f5437640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d4078b90 0x7f06d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.219+0000 7f06f5437640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d4078b90 0x7f06d407b0a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f06ec005fd0 tx=0x7f06ec005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:25.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.223+0000 7f06e5ffb640 1 -- 172.21.15.146:0/2123040606 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06f0157740 con 0x7f06f00cf6b0 2024-09-17T03:42:25.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.466+0000 7f06f769b640 1 -- 172.21.15.146:0/2123040606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f06f00cf170 con 0x7f06f00cf6b0 2024-09-17T03:42:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.467+0000 7f06e5ffb640 1 -- 172.21.15.146:0/2123040606 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7f06f01f7b20 con 0x7f06f00cf6b0 2024-09-17T03:42:25.467 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:25.467 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":590,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":969,"data_bytes":993431409,"bytes_used":2369101824,"bytes_avail":770725011456,"bytes_total":773094113280,"write_bytes_sec":82721252,"read_op_per_sec":0,"write_op_per_sec":80},"fsmap":{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9216}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-17T03:41:41.930323+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:42:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 -- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d4078b90 msgr2=0x7f06d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d4078b90 0x7f06d407b0a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f06ec005fd0 tx=0x7f06ec005850 comp rx=0 tx=0).stop 2024-09-17T03:42:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 -- 172.21.15.146:0/2123040606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f00cf6b0 msgr2=0x7f06f015d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f00cf6b0 0x7f06f015d840 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f06e000c3f0 tx=0x7f06e000c8b0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 -- 172.21.15.146:0/2123040606 shutdown_connections 2024-09-17T03:42:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f06d4078b90 0x7f06d407b0a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f06f00d0710 0x7f06f00b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06f00cf6b0 0x7f06f015d840 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 --2- 172.21.15.146:0/2123040606 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f06f00b47c0 0x7f06f01f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 -- 172.21.15.146:0/2123040606 >> 172.21.15.146:0/2123040606 conn(0x7f06f009ba20 msgr2=0x7f06f00b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 -- 172.21.15.146:0/2123040606 shutdown_connections 2024-09-17T03:42:25.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:25.469+0000 7f06f769b640 1 -- 172.21.15.146:0/2123040606 wait complete. 2024-09-17T03:42:25.480 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:42:26.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:26.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.596+0000 7f03c7f6e640 1 -- 172.21.15.146:0/355975119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03c00b3b60 msgr2=0x7f03c015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:26.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.596+0000 7f03c7f6e640 1 --2- 172.21.15.146:0/355975119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03c00b3b60 0x7f03c015caa0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f03c00b8440 tx=0x7f03b802a820 comp rx=0 tx=0).stop 2024-09-17T03:42:26.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.596+0000 7f03c7f6e640 1 -- 172.21.15.146:0/355975119 shutdown_connections 2024-09-17T03:42:26.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.596+0000 7f03c7f6e640 1 --2- 172.21.15.146:0/355975119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03c00b3b60 0x7f03c015caa0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.596+0000 7f03c7f6e640 1 --2- 172.21.15.146:0/355975119 >> v2:172.21.15.179:3300/0 conn(0x7f03c00b5750 0x7f03c00b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.596+0000 7f03c7f6e640 1 -- 172.21.15.146:0/355975119 >> 172.21.15.146:0/355975119 conn(0x7f03c00b7b20 msgr2=0x7f03c009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:26.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.596+0000 7f03c7f6e640 1 -- 172.21.15.146:0/355975119 shutdown_connections 2024-09-17T03:42:26.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.596+0000 7f03c7f6e640 1 -- 172.21.15.146:0/355975119 wait complete. 2024-09-17T03:42:26.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.598+0000 7f03c7f6e640 1 Processor -- start 2024-09-17T03:42:26.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.598+0000 7f03c7f6e640 1 -- start start 2024-09-17T03:42:26.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.599+0000 7f03c7f6e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00b3b60 0x7f03c0144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:26.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.599+0000 7f03c7f6e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c00b5750 0x7f03c01f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:26.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.599+0000 7f03c7f6e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03c00b5ce0 0x7f03c0143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:26.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.599+0000 7f03c7f6e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f03c015d480 con 0x7f03c00b5ce0 2024-09-17T03:42:26.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.599+0000 7f03c7f6e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f03c015d300 con 0x7f03c00b5750 2024-09-17T03:42:26.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.599+0000 7f03c7f6e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f03c015d600 con 0x7f03c00b3b60 2024-09-17T03:42:26.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.599+0000 7f03c650b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03c00b5ce0 0x7f03c0143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.599+0000 7f03c650b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03c00b5ce0 0x7f03c0143750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38892/0 (socket says 172.21.15.146:38892) 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.599+0000 7f03c650b640 1 -- 172.21.15.146:0/3026718896 learned_addr learned my addr 172.21.15.146:0/3026718896 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c5509640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c00b5750 0x7f03c01f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c650b640 1 -- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00b3b60 msgr2=0x7f03c0144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c5d0a640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00b3b60 0x7f03c0144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c650b640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00b3b60 0x7f03c0144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c650b640 1 -- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c00b5750 msgr2=0x7f03c01f6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c650b640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c00b5750 0x7f03c01f6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c650b640 1 -- 172.21.15.146:0/3026718896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c01f73b0 con 0x7f03c00b5ce0 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c5509640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c00b5750 0x7f03c01f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c5d0a640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00b3b60 0x7f03c0144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c650b640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03c00b5ce0 0x7f03c0143750 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009ca0 tx=0x7f03b8032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:26.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03b67fc640 1 -- 172.21.15.146:0/3026718896 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b803f020 con 0x7f03c00b5ce0 2024-09-17T03:42:26.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03b67fc640 1 -- 172.21.15.146:0/3026718896 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03b8004040 con 0x7f03c00b5ce0 2024-09-17T03:42:26.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c7f6e640 1 -- 172.21.15.146:0/3026718896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c009c870 con 0x7f03c00b5ce0 2024-09-17T03:42:26.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03b67fc640 1 -- 172.21.15.146:0/3026718896 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b8037040 con 0x7f03c00b5ce0 2024-09-17T03:42:26.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.600+0000 7f03c7f6e640 1 -- 172.21.15.146:0/3026718896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c01f7ba0 con 0x7f03c00b5ce0 2024-09-17T03:42:26.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.601+0000 7f03c7f6e640 1 -- 172.21.15.146:0/3026718896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c00b22a0 con 0x7f03c00b5ce0 2024-09-17T03:42:26.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.602+0000 7f03b67fc640 1 -- 172.21.15.146:0/3026718896 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f03b8042020 con 0x7f03c00b5ce0 2024-09-17T03:42:26.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.602+0000 7f03b67fc640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f03a4078b90 0x7f03a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:26.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.602+0000 7f03b67fc640 1 -- 172.21.15.146:0/3026718896 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f03b80bb4b0 con 0x7f03c00b5ce0 2024-09-17T03:42:26.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.603+0000 7f03c5d0a640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f03a4078b90 0x7f03a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:26.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.603+0000 7f03c5d0a640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f03a4078b90 0x7f03a407b0a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f03bc000f60 tx=0x7f03bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:26.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.607+0000 7f03b67fc640 1 -- 172.21.15.146:0/3026718896 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f03c00b22a0 con 0x7f03c00b5ce0 2024-09-17T03:42:26.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.816+0000 7f03c7f6e640 1 -- 172.21.15.146:0/3026718896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03c00b78f0 con 0x7f03c00b5ce0 2024-09-17T03:42:26.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.816+0000 7f03b67fc640 1 -- 172.21.15.146:0/3026718896 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7f03b8049070 con 0x7f03c00b5ce0 2024-09-17T03:42:26.817 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:26.817 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:26.817 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 -- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f03a4078b90 msgr2=0x7f03a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f03a4078b90 0x7f03a407b0a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f03bc000f60 tx=0x7f03bc009040 comp rx=0 tx=0).stop 2024-09-17T03:42:26.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 -- 172.21.15.146:0/3026718896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03c00b5ce0 msgr2=0x7f03c0143750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03c00b5ce0 0x7f03c0143750 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009ca0 tx=0x7f03b8032c90 comp rx=0 tx=0).stop 2024-09-17T03:42:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 -- 172.21.15.146:0/3026718896 shutdown_connections 2024-09-17T03:42:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f03a4078b90 0x7f03a407b0a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03c00b5ce0 0x7f03c0143750 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03c00b5750 0x7f03c01f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 --2- 172.21.15.146:0/3026718896 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f03c00b3b60 0x7f03c0144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 -- 172.21.15.146:0/3026718896 >> 172.21.15.146:0/3026718896 conn(0x7f03c00b7b20 msgr2=0x7f03c0071310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 -- 172.21.15.146:0/3026718896 shutdown_connections 2024-09-17T03:42:26.820 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.819+0000 7f03c7f6e640 1 -- 172.21.15.146:0/3026718896 wait complete. 2024-09-17T03:42:26.830 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T03:42:26.830 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:42:26.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.942+0000 7f5d0d989640 1 -- 172.21.15.146:0/2764453682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080b4530 msgr2=0x7f5d080b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.942+0000 7f5d0d989640 1 --2- 172.21.15.146:0/2764453682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080b4530 0x7f5d080b4940 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0005fd0 tx=0x7f5cf002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.942+0000 7f5d0d989640 1 -- 172.21.15.146:0/2764453682 shutdown_connections 2024-09-17T03:42:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.942+0000 7f5d0d989640 1 --2- 172.21.15.146:0/2764453682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d0806dd60 0x7f5d0806e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.942+0000 7f5d0d989640 1 --2- 172.21.15.146:0/2764453682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080b4530 0x7f5d080b4940 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.942+0000 7f5d0d989640 1 -- 172.21.15.146:0/2764453682 >> 172.21.15.146:0/2764453682 conn(0x7f5d080b3410 msgr2=0x7f5d080b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.942+0000 7f5d0d989640 1 -- 172.21.15.146:0/2764453682 shutdown_connections 2024-09-17T03:42:26.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.942+0000 7f5d0d989640 1 -- 172.21.15.146:0/2764453682 wait complete. 2024-09-17T03:42:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.944+0000 7f5d0d989640 1 Processor -- start 2024-09-17T03:42:26.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.944+0000 7f5d0d989640 1 -- start start 2024-09-17T03:42:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.945+0000 7f5d0d989640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d0806dd60 0x7f5d08144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.945+0000 7f5d0d989640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d080b4530 0x7f5d08158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.945+0000 7f5d0d989640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080b55f0 0x7f5d08158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.945+0000 7f5d0d989640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0815bd10 con 0x7f5d080b55f0 2024-09-17T03:42:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.945+0000 7f5d0d989640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080b5c50 con 0x7f5d0806dd60 2024-09-17T03:42:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.945+0000 7f5d0d989640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5d0815be90 con 0x7f5d080b4530 2024-09-17T03:42:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.945+0000 7f5d077fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080b55f0 0x7f5d08158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:26.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.945+0000 7f5d077fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080b55f0 0x7f5d08158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38906/0 (socket says 172.21.15.146:38906) 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.945+0000 7f5d077fe640 1 -- 172.21.15.146:0/3799322459 learned_addr learned my addr 172.21.15.146:0/3799322459 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d067fc640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d080b4530 0x7f5d08158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d06ffd640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d0806dd60 0x7f5d08144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d077fe640 1 -- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d080b4530 msgr2=0x7f5d08158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d077fe640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d080b4530 0x7f5d08158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d077fe640 1 -- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d0806dd60 msgr2=0x7f5d08144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d077fe640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d0806dd60 0x7f5d08144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d077fe640 1 -- 172.21.15.146:0/3799322459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d08159300 con 0x7f5d080b55f0 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d06ffd640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d0806dd60 0x7f5d08144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d067fc640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d080b4530 0x7f5d08158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d077fe640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080b55f0 0x7f5d08158b70 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f5d00007810 tx=0x7f5d00007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:26.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5cfffff640 1 -- 172.21.15.146:0/3799322459 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0001a070 con 0x7f5d080b55f0 2024-09-17T03:42:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5cfffff640 1 -- 172.21.15.146:0/3799322459 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d00004030 con 0x7f5d080b55f0 2024-09-17T03:42:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d0d989640 1 -- 172.21.15.146:0/3799322459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d08155e00 con 0x7f5d080b55f0 2024-09-17T03:42:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5cfffff640 1 -- 172.21.15.146:0/3799322459 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d00004460 con 0x7f5d080b55f0 2024-09-17T03:42:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.946+0000 7f5d0d989640 1 -- 172.21.15.146:0/3799322459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d08153ec0 con 0x7f5d080b55f0 2024-09-17T03:42:26.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.947+0000 7f5d0d989640 1 -- 172.21.15.146:0/3799322459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d0806e170 con 0x7f5d080b55f0 2024-09-17T03:42:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.948+0000 7f5cfffff640 1 -- 172.21.15.146:0/3799322459 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d0001d070 con 0x7f5d080b55f0 2024-09-17T03:42:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.948+0000 7f5cfffff640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ce8078b90 0x7f5ce807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.948+0000 7f5cfffff640 1 -- 172.21.15.146:0/3799322459 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f5d0009c2c0 con 0x7f5d080b55f0 2024-09-17T03:42:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.949+0000 7f5d06ffd640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ce8078b90 0x7f5ce807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:26.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.949+0000 7f5d06ffd640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ce8078b90 0x7f5ce807b0a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8007fd0 tx=0x7f5cf8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:26.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:26.953+0000 7f5cfffff640 1 -- 172.21.15.146:0/3799322459 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5d00064700 con 0x7f5d080b55f0 2024-09-17T03:42:27.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.200+0000 7f5d0d989640 1 -- 172.21.15.146:0/3799322459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5d080d1f10 con 0x7f5d080b55f0 2024-09-17T03:42:27.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.201+0000 7f5cfffff640 1 -- 172.21.15.146:0/3799322459 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f5d00064000 con 0x7f5d080b55f0 2024-09-17T03:42:27.201 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:27.201 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":591,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076760460,"bytes_used":2588188672,"bytes_avail":770505924608,"bytes_total":773094113280,"write_bytes_sec":83909209,"read_op_per_sec":0,"write_op_per_sec":90},"fsmap":{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9216}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-17T03:42:25.941707+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:42:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.203+0000 7f5d0d989640 1 -- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ce8078b90 msgr2=0x7f5ce807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.203+0000 7f5d0d989640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ce8078b90 0x7f5ce807b0a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8007fd0 tx=0x7f5cf8009040 comp rx=0 tx=0).stop 2024-09-17T03:42:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.203+0000 7f5d0d989640 1 -- 172.21.15.146:0/3799322459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080b55f0 msgr2=0x7f5d08158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.203+0000 7f5d0d989640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080b55f0 0x7f5d08158b70 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f5d00007810 tx=0x7f5d00007cd0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.203+0000 7f5d0d989640 1 -- 172.21.15.146:0/3799322459 shutdown_connections 2024-09-17T03:42:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.203+0000 7f5d0d989640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5ce8078b90 0x7f5ce807b0a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.203+0000 7f5d0d989640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d080b55f0 0x7f5d08158b70 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.203+0000 7f5d0d989640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5d080b4530 0x7f5d08158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.203+0000 7f5d0d989640 1 --2- 172.21.15.146:0/3799322459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5d0806dd60 0x7f5d08144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.203+0000 7f5d0d989640 1 -- 172.21.15.146:0/3799322459 >> 172.21.15.146:0/3799322459 conn(0x7f5d080b3410 msgr2=0x7f5d0815e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.204+0000 7f5d0d989640 1 -- 172.21.15.146:0/3799322459 shutdown_connections 2024-09-17T03:42:27.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.204+0000 7f5d0d989640 1 -- 172.21.15.146:0/3799322459 wait complete. 2024-09-17T03:42:27.217 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-17T03:42:27.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:27.218 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub abort 2024-09-17T03:42:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.334+0000 7f659e169640 1 -- 172.21.15.146:0/774812506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65980b5750 msgr2=0x7f65980b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.334 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.334+0000 7f659e169640 1 --2- 172.21.15.146:0/774812506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65980b5750 0x7f65980b3620 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f658c005fd0 tx=0x7f658c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.334+0000 7f659e169640 1 -- 172.21.15.146:0/774812506 shutdown_connections 2024-09-17T03:42:27.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.334+0000 7f659e169640 1 --2- 172.21.15.146:0/774812506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65980b5750 0x7f65980b3620 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.334+0000 7f659e169640 1 -- 172.21.15.146:0/774812506 >> 172.21.15.146:0/774812506 conn(0x7f65980b7b20 msgr2=0x7f659809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.334+0000 7f659e169640 1 -- 172.21.15.146:0/774812506 shutdown_connections 2024-09-17T03:42:27.335 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.334+0000 7f659e169640 1 -- 172.21.15.146:0/774812506 wait complete. 2024-09-17T03:42:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.336+0000 7f659e169640 1 Processor -- start 2024-09-17T03:42:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.336+0000 7f659e169640 1 -- start start 2024-09-17T03:42:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.337+0000 7f659e169640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65980b3b60 0x7f65980a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.337+0000 7f659e169640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65980b5750 0x7f659814f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.337+0000 7f659e169640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65980b5ce0 0x7f65981f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.337+0000 7f659e169640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f659815d650 con 0x7f65980b3b60 2024-09-17T03:42:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.337+0000 7f659e169640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f659815d4d0 con 0x7f65980b5ce0 2024-09-17T03:42:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.337+0000 7f659e169640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f659815d7d0 con 0x7f65980b5750 2024-09-17T03:42:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.337+0000 7f65977fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65980b3b60 0x7f65980a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.337+0000 7f65977fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65980b3b60 0x7f65980a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49146/0 (socket says 172.21.15.146:49146) 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.337+0000 7f65977fe640 1 -- 172.21.15.146:0/576567835 learned_addr learned my addr 172.21.15.146:0/576567835 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.337+0000 7f6597fff640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65980b5ce0 0x7f65981f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.337+0000 7f6596ffd640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65980b5750 0x7f659814f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.338+0000 7f65977fe640 1 -- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65980b5750 msgr2=0x7f659814f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.338+0000 7f65977fe640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65980b5750 0x7f659814f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.338+0000 7f65977fe640 1 -- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65980b5ce0 msgr2=0x7f65981f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.338+0000 7f65977fe640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65980b5ce0 0x7f65981f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.338+0000 7f65977fe640 1 -- 172.21.15.146:0/576567835 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65980a06a0 con 0x7f65980b3b60 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.338+0000 7f65977fe640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65980b3b60 0x7f65980a0160 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f658800c370 tx=0x7f658800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.338+0000 7f657ffff640 1 -- 172.21.15.146:0/576567835 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588017070 con 0x7f65980b3b60 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.338+0000 7f657ffff640 1 -- 172.21.15.146:0/576567835 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65880035f0 con 0x7f65980b3b60 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.338+0000 7f659e169640 1 -- 172.21.15.146:0/576567835 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65981f9470 con 0x7f65980b3b60 2024-09-17T03:42:27.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.338+0000 7f657ffff640 1 -- 172.21.15.146:0/576567835 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588003a40 con 0x7f65980b3b60 2024-09-17T03:42:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.338+0000 7f659e169640 1 -- 172.21.15.146:0/576567835 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65981f9a30 con 0x7f65980b3b60 2024-09-17T03:42:27.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.340+0000 7f657ffff640 1 -- 172.21.15.146:0/576567835 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f658801a070 con 0x7f65980b3b60 2024-09-17T03:42:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.340+0000 7f657ffff640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6584078b90 0x7f658407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.340+0000 7f657ffff640 1 -- 172.21.15.146:0/576567835 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f658809a030 con 0x7f65980b3b60 2024-09-17T03:42:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.341+0000 7f6596ffd640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6584078b90 0x7f658407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.341+0000 7f6596ffd640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6584078b90 0x7f658407b0a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f658c033000 tx=0x7f658c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.342+0000 7f65a50da740 1 Processor -- start 2024-09-17T03:42:27.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.342+0000 7f65a50da740 1 -- start start 2024-09-17T03:42:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65a50da740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b45310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65a50da740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b772d4d0 0x55d4b7b27fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65a50da740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b77356b0 0x55d4b7b28520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65a50da740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d4b7a70bd0 con 0x55d4b7756390 2024-09-17T03:42:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65a50da740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d4b7a60000 con 0x55d4b77356b0 2024-09-17T03:42:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65a50da740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d4b7a63e10 con 0x55d4b772d4d0 2024-09-17T03:42:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65977fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b45310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65977fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b45310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49152/0 (socket says 172.21.15.146:49152) 2024-09-17T03:42:27.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65977fe640 1 -- 172.21.15.146:0/670329613 learned_addr learned my addr 172.21.15.146:0/670329613 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f6597fff640 1 --2- 172.21.15.146:0/670329613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b77356b0 0x55d4b7b28520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f6596ffd640 1 --2- 172.21.15.146:0/670329613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b772d4d0 0x55d4b7b27fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65977fe640 1 -- 172.21.15.146:0/670329613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b772d4d0 msgr2=0x55d4b7b27fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65977fe640 1 --2- 172.21.15.146:0/670329613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b772d4d0 0x55d4b7b27fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65977fe640 1 -- 172.21.15.146:0/670329613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b77356b0 msgr2=0x55d4b7b28520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65977fe640 1 --2- 172.21.15.146:0/670329613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b77356b0 0x55d4b7b28520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f65977fe640 1 -- 172.21.15.146:0/670329613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4b78387d0 con 0x55d4b7756390 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.343+0000 7f6596ffd640 1 --2- 172.21.15.146:0/670329613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b772d4d0 0x55d4b7b27fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.344+0000 7f65977fe640 1 --2- 172.21.15.146:0/670329613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b45310 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f6588098500 tx=0x7f6588061830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c843d7f09b274ac server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.344+0000 7f657d7fa640 1 -- 172.21.15.146:0/670329613 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588066850 con 0x55d4b7756390 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.344+0000 7f657d7fa640 1 -- 172.21.15.146:0/670329613 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f658806b790 con 0x55d4b7756390 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.344+0000 7f657d7fa640 1 -- 172.21.15.146:0/670329613 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588069e30 con 0x55d4b7756390 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.345+0000 7f65a50da740 1 -- 172.21.15.146:0/670329613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 msgr2=0x55d4b7b45310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.345+0000 7f65a50da740 1 --2- 172.21.15.146:0/670329613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b45310 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f6588098500 tx=0x7f6588061830 comp rx=0 tx=0).stop 2024-09-17T03:42:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.345+0000 7f65a50da740 1 -- 172.21.15.146:0/670329613 shutdown_connections 2024-09-17T03:42:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.345+0000 7f65a50da740 1 --2- 172.21.15.146:0/670329613 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b77356b0 0x55d4b7b28520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.345+0000 7f65a50da740 1 --2- 172.21.15.146:0/670329613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b772d4d0 0x55d4b7b27fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.345+0000 7f65a50da740 1 --2- 172.21.15.146:0/670329613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b45310 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.345+0000 7f65a50da740 1 -- 172.21.15.146:0/670329613 >> 172.21.15.146:0/670329613 conn(0x55d4b774a4e0 msgr2=0x55d4b7afe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.345+0000 7f65a50da740 1 -- 172.21.15.146:0/670329613 shutdown_connections 2024-09-17T03:42:27.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.345+0000 7f65a50da740 1 -- 172.21.15.146:0/670329613 wait complete. 2024-09-17T03:42:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.346+0000 7f65a50da740 1 -- start start 2024-09-17T03:42:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.346+0000 7f65a50da740 1 Processor -- start 2024-09-17T03:42:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65a50da740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b3b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65a50da740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7b3de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65a50da740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b7756390 0x55d4b7afdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65a50da740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d4b77d0740 con 0x55d4b772d4d0 2024-09-17T03:42:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65a50da740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d4b7a05540 con 0x55d4b7756390 2024-09-17T03:42:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65a50da740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d4b7b3d3b0 con 0x55d4b77356b0 2024-09-17T03:42:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65a50da740 10 client.0 _ll_register_callbacks cb 0x55d4b7a040e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65977fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b3b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65977fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b3b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49168/0 (socket says 172.21.15.146:49168) 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65977fe640 1 -- 172.21.15.146:0/1399480119 learned_addr learned my addr 172.21.15.146:0/1399480119 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f6597fff640 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b7756390 0x55d4b7afdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f6596ffd640 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7b3de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65977fe640 1 -- 172.21.15.146:0/1399480119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 msgr2=0x55d4b7b3de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65977fe640 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7b3de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65977fe640 1 -- 172.21.15.146:0/1399480119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b7756390 msgr2=0x55d4b7afdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65977fe640 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b7756390 0x55d4b7afdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f65977fe640 1 -- 172.21.15.146:0/1399480119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4b779f6a0 con 0x55d4b772d4d0 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.347+0000 7f6596ffd640 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7b3de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65977fe640 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b3b850 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f6588003fd0 tx=0x7f6588069e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6e5bbcc4d89c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65767fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:27.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65767fc640 1 -- 172.21.15.146:0/1399480119 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588066850 con 0x55d4b772d4d0 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65767fc640 1 -- 172.21.15.146:0/1399480119 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f6588061080 con 0x55d4b772d4d0 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65a50da740 1 -- 172.21.15.146:0/1399480119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f658806b790 con 0x55d4b772d4d0 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65767fc640 1 -- 172.21.15.146:0/1399480119 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f65880612a0 con 0x55d4b772d4d0 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65a50da740 10 client.9504 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65a50da740 1 -- 172.21.15.146:0/1399480119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55d4b7898f60 con 0x55d4b772d4d0 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65767fc640 1 -- 172.21.15.146:0/1399480119 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f658806b790 con 0x55d4b772d4d0 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65767fc640 1 -- 172.21.15.146:0/1399480119 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f658805d770 con 0x55d4b772d4d0 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65a50da740 10 client.9504 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65a50da740 10 client.9504 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65a50da740 20 client.9504 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65a50da740 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55d4b7714f60 0x55d4b7afe230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65a50da740 4 client.9504 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f65a50da740 1 -- 172.21.15.146:0/1399480119 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4b7a72b20 con 0x55d4b7714f60 2024-09-17T03:42:27.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.348+0000 7f6596ffd640 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55d4b7714f60 0x55d4b7afe230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.349+0000 7f65767fc640 10 client.9504 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.349+0000 7f6596ffd640 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55d4b7714f60 0x55d4b7afe230 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fcf7b067def9e50 server_cookie=dafcdb2bb1424fd6 in_seq=0 out_seq=0 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.349+0000 7f65767fc640 1 -- 172.21.15.146:0/1399480119 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4b7a72b20 con 0x55d4b7714f60 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.349+0000 7f65767fc640 10 client.9504 handle_command_reply: tid=0 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.349+0000 7f65a50da740 1 client.9504 shutdown 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.349+0000 7f65a50da740 1 -- 172.21.15.146:0/1399480119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 msgr2=0x55d4b7b3b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.349+0000 7f65a50da740 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b3b850 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f6588003fd0 tx=0x7f6588069e00 comp rx=0 tx=0).stop 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.349+0000 7f65a50da740 1 -- 172.21.15.146:0/1399480119 shutdown_connections 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.349+0000 7f65a50da740 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55d4b7714f60 0x55d4b7afe230 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.349+0000 7f65a50da740 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b7756390 0x55d4b7afdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.350+0000 7f65a50da740 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7b3de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.350+0000 7f65a50da740 1 --2- 172.21.15.146:0/1399480119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b3b850 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.350+0000 7f65a50da740 1 -- 172.21.15.146:0/1399480119 >> 172.21.15.146:0/1399480119 conn(0x55d4b774a4e0 msgr2=0x55d4b7b46060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.350+0000 7f65767fc640 0 client.9504 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.350+0000 7f65a50da740 1 -- 172.21.15.146:0/1399480119 shutdown_connections 2024-09-17T03:42:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.350+0000 7f65a50da740 1 -- 172.21.15.146:0/1399480119 wait complete. 2024-09-17T03:42:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.350+0000 7f65a50da740 20 client.9504 trim_cache size 0 max 16384 2024-09-17T03:42:27.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.367+0000 7f65a50da740 1 Processor -- start 2024-09-17T03:42:27.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.367+0000 7f65a50da740 1 -- start start 2024-09-17T03:42:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.368+0000 7f65a50da740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b772d4d0 0x55d4b7af75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.368+0000 7f65a50da740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7af7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.368+0000 7f65a50da740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b66e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.368+0000 7f65a50da740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f65982025b0 con 0x55d4b7756390 2024-09-17T03:42:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.368+0000 7f65a50da740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6598201640 con 0x55d4b772d4d0 2024-09-17T03:42:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.368+0000 7f65a50da740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f659806f810 con 0x55d4b77356b0 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.368+0000 7f6597fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b66e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.368+0000 7f6597fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b66e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49174/0 (socket says 172.21.15.146:49174) 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.368+0000 7f6597fff640 1 -- 172.21.15.146:0/954581889 learned_addr learned my addr 172.21.15.146:0/954581889 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f6596ffd640 1 --2- 172.21.15.146:0/954581889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7af7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f65977fe640 1 --2- 172.21.15.146:0/954581889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b772d4d0 0x55d4b7af75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f6597fff640 1 -- 172.21.15.146:0/954581889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 msgr2=0x55d4b7af7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f6597fff640 1 --2- 172.21.15.146:0/954581889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7af7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f6597fff640 1 -- 172.21.15.146:0/954581889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b772d4d0 msgr2=0x55d4b7af75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f6597fff640 1 --2- 172.21.15.146:0/954581889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b772d4d0 0x55d4b7af75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f6597fff640 1 -- 172.21.15.146:0/954581889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4b7836ad0 con 0x55d4b7756390 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f6596ffd640 1 --2- 172.21.15.146:0/954581889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7af7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f6597fff640 1 --2- 172.21.15.146:0/954581889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b66e10 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f6590001f50 tx=0x7f6590001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86471c59344b41a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f657cff9640 1 -- 172.21.15.146:0/954581889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590003970 con 0x55d4b7756390 2024-09-17T03:42:27.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f657cff9640 1 -- 172.21.15.146:0/954581889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6590003b10 con 0x55d4b7756390 2024-09-17T03:42:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.369+0000 7f657cff9640 1 -- 172.21.15.146:0/954581889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590005110 con 0x55d4b7756390 2024-09-17T03:42:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.370+0000 7f65a50da740 1 -- 172.21.15.146:0/954581889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 msgr2=0x55d4b7b66e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.370+0000 7f65a50da740 1 --2- 172.21.15.146:0/954581889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b66e10 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f6590001f50 tx=0x7f6590001630 comp rx=0 tx=0).stop 2024-09-17T03:42:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.370+0000 7f65a50da740 1 -- 172.21.15.146:0/954581889 shutdown_connections 2024-09-17T03:42:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.370+0000 7f65a50da740 1 --2- 172.21.15.146:0/954581889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b7756390 0x55d4b7b66e10 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.370+0000 7f65a50da740 1 --2- 172.21.15.146:0/954581889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7af7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.370+0000 7f65a50da740 1 --2- 172.21.15.146:0/954581889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b772d4d0 0x55d4b7af75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.370+0000 7f65a50da740 1 -- 172.21.15.146:0/954581889 >> 172.21.15.146:0/954581889 conn(0x55d4b774a4e0 msgr2=0x55d4b7afe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.370+0000 7f65a50da740 1 -- 172.21.15.146:0/954581889 shutdown_connections 2024-09-17T03:42:27.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.370+0000 7f65a50da740 1 -- 172.21.15.146:0/954581889 wait complete. 2024-09-17T03:42:27.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.371+0000 7f65a50da740 1 -- start start 2024-09-17T03:42:27.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.371+0000 7f65a50da740 1 Processor -- start 2024-09-17T03:42:27.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.372+0000 7f65a50da740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b44890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.372+0000 7f65a50da740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7b44dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.372+0000 7f65a50da740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b7756390 0x55d4b7bc5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.372+0000 7f65a50da740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d4b7b3c0a0 con 0x55d4b772d4d0 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.372+0000 7f65a50da740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f65982011e0 con 0x55d4b7756390 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.372+0000 7f65a50da740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d4b7b17510 con 0x55d4b77356b0 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.372+0000 7f65a50da740 10 client.0 _ll_register_callbacks cb 0x7f65900018a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.372+0000 7f65977fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b44890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.372+0000 7f65977fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b44890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49186/0 (socket says 172.21.15.146:49186) 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.372+0000 7f65977fe640 1 -- 172.21.15.146:0/2241507188 learned_addr learned my addr 172.21.15.146:0/2241507188 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.372+0000 7f6596ffd640 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7b44dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f6597fff640 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b7756390 0x55d4b7bc5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65977fe640 1 -- 172.21.15.146:0/2241507188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 msgr2=0x55d4b7b44dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65977fe640 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7b44dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65977fe640 1 -- 172.21.15.146:0/2241507188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b7756390 msgr2=0x55d4b7bc5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65977fe640 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b7756390 0x55d4b7bc5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65977fe640 1 -- 172.21.15.146:0/2241507188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4b7b564b0 con 0x55d4b772d4d0 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f6597fff640 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b7756390 0x55d4b7bc5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65977fe640 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b44890 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f6588001250 tx=0x7f6588061c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6771d04a247dc5be server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65767fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65767fc640 1 -- 172.21.15.146:0/2241507188 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658806b790 con 0x55d4b772d4d0 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65767fc640 1 -- 172.21.15.146:0/2241507188 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f6588060af0 con 0x55d4b772d4d0 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65a50da740 1 -- 172.21.15.146:0/2241507188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6590003b10 con 0x55d4b772d4d0 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65767fc640 1 -- 172.21.15.146:0/2241507188 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f6588066850 con 0x55d4b772d4d0 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65a50da740 10 client.9510 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65a50da740 1 -- 172.21.15.146:0/2241507188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55d4b7b561d0 con 0x55d4b772d4d0 2024-09-17T03:42:27.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65767fc640 1 -- 172.21.15.146:0/2241507188 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6590003b10 con 0x55d4b772d4d0 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65767fc640 1 -- 172.21.15.146:0/2241507188 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f65880679e0 con 0x55d4b772d4d0 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65a50da740 10 client.9510 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65a50da740 10 client.9510 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65a50da740 20 client.9510 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65a50da740 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55d4b7bbc8f0 0x55d4b7bc61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65a50da740 4 client.9510 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.373+0000 7f65a50da740 1 -- 172.21.15.146:0/2241507188 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55d4b7a6e5d0 con 0x55d4b7bbc8f0 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.374+0000 7f6596ffd640 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55d4b7bbc8f0 0x55d4b7bc61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.374+0000 7f65767fc640 10 client.9510 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.374+0000 7f6596ffd640 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55d4b7bbc8f0 0x55d4b7bc61c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c23dc827c35ea55 server_cookie=79199a241b48bede in_seq=0 out_seq=0 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65767fc640 1 -- 172.21.15.146:0/2241507188 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d4b7a6e5d0 con 0x55d4b7bbc8f0 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65767fc640 10 client.9510 handle_command_reply: tid=0 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 1 client.9510 shutdown 2024-09-17T03:42:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 1 -- 172.21.15.146:0/2241507188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 msgr2=0x55d4b7b44890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b44890 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f6588001250 tx=0x7f6588061c80 comp rx=0 tx=0).stop 2024-09-17T03:42:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 1 -- 172.21.15.146:0/2241507188 shutdown_connections 2024-09-17T03:42:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55d4b7bbc8f0 0x55d4b7bc61c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d4b7756390 0x55d4b7bc5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d4b77356b0 0x55d4b7b44dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65767fc640 0 client.9510 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 1 --2- 172.21.15.146:0/2241507188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d4b772d4d0 0x55d4b7b44890 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 1 -- 172.21.15.146:0/2241507188 >> 172.21.15.146:0/2241507188 conn(0x55d4b774a4e0 msgr2=0x55d4b7afe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 1 -- 172.21.15.146:0/2241507188 shutdown_connections 2024-09-17T03:42:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 1 -- 172.21.15.146:0/2241507188 wait complete. 2024-09-17T03:42:27.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.375+0000 7f65a50da740 20 client.9510 trim_cache size 0 max 16384 2024-09-17T03:42:27.381 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:42:27.381 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:42:27.381 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:42:27.381 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:42:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 -- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6584078b90 msgr2=0x7f658407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6584078b90 0x7f658407b0a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f658c033000 tx=0x7f658c004730 comp rx=0 tx=0).stop 2024-09-17T03:42:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 -- 172.21.15.146:0/576567835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65980b3b60 msgr2=0x7f65980a0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65980b3b60 0x7f65980a0160 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f658800c370 tx=0x7f658800c830 comp rx=0 tx=0).stop 2024-09-17T03:42:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 -- 172.21.15.146:0/576567835 shutdown_connections 2024-09-17T03:42:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6584078b90 0x7f658407b0a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65980b5ce0 0x7f65981f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65980b5750 0x7f659814f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 --2- 172.21.15.146:0/576567835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65980b3b60 0x7f65980a0160 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 -- 172.21.15.146:0/576567835 >> 172.21.15.146:0/576567835 conn(0x7f65980b7b20 msgr2=0x7f6598155c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 -- 172.21.15.146:0/576567835 shutdown_connections 2024-09-17T03:42:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.376+0000 7f659e169640 1 -- 172.21.15.146:0/576567835 wait complete. 2024-09-17T03:42:27.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:27.387 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-17T03:42:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.501+0000 7f6343d19640 1 -- 172.21.15.146:0/3671856215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f633c0b5ce0 msgr2=0x7f633c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.501+0000 7f6343d19640 1 --2- 172.21.15.146:0/3671856215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f633c0b5ce0 0x7f633c0b1320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6338009830 tx=0x7f633802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.501+0000 7f6343d19640 1 -- 172.21.15.146:0/3671856215 shutdown_connections 2024-09-17T03:42:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.501+0000 7f6343d19640 1 --2- 172.21.15.146:0/3671856215 >> v2:172.21.15.179:3300/0 conn(0x7f633c0b3d30 0x7f633c15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.501+0000 7f6343d19640 1 --2- 172.21.15.146:0/3671856215 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f633c0b5ce0 0x7f633c0b1320 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.501+0000 7f6343d19640 1 -- 172.21.15.146:0/3671856215 >> 172.21.15.146:0/3671856215 conn(0x7f633c0b7b20 msgr2=0x7f633c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.501+0000 7f6343d19640 1 -- 172.21.15.146:0/3671856215 shutdown_connections 2024-09-17T03:42:27.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.501+0000 7f6343d19640 1 -- 172.21.15.146:0/3671856215 wait complete. 2024-09-17T03:42:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.503+0000 7f6343d19640 1 Processor -- start 2024-09-17T03:42:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.503+0000 7f6343d19640 1 -- start start 2024-09-17T03:42:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.504+0000 7f6343d19640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f633c0b5750 0x7f633c1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.504+0000 7f6343d19640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f633c0b5ce0 0x7f633c159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.504+0000 7f6343d19640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f633c1e6cc0 0x7f633c159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.504+0000 7f6343d19640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f633c15d460 con 0x7f633c0b5750 2024-09-17T03:42:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.504+0000 7f6343d19640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f633c15d2e0 con 0x7f633c1e6cc0 2024-09-17T03:42:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.504+0000 7f6343d19640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f633c15d5e0 con 0x7f633c0b5ce0 2024-09-17T03:42:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f6341ab5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f633c0b5750 0x7f633c1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f6341ab5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f633c0b5750 0x7f633c1507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49200/0 (socket says 172.21.15.146:49200) 2024-09-17T03:42:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f6341ab5640 1 -- 172.21.15.146:0/214046026 learned_addr learned my addr 172.21.15.146:0/214046026 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f63412b4640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f633c0b5ce0 0x7f633c159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f63422b6640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f633c1e6cc0 0x7f633c159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f6341ab5640 1 -- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f633c0b5ce0 msgr2=0x7f633c159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f6341ab5640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f633c0b5ce0 0x7f633c159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f6341ab5640 1 -- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f633c1e6cc0 msgr2=0x7f633c159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f6341ab5640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f633c1e6cc0 0x7f633c159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f6341ab5640 1 -- 172.21.15.146:0/214046026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c151030 con 0x7f633c0b5750 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f63412b4640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f633c0b5ce0 0x7f633c159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f63422b6640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f633c1e6cc0 0x7f633c159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f6341ab5640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f633c0b5750 0x7f633c1507e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f6338009950 tx=0x7f6338003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f63327fc640 1 -- 172.21.15.146:0/214046026 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338005c90 con 0x7f633c0b5750 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f63327fc640 1 -- 172.21.15.146:0/214046026 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6338005020 con 0x7f633c0b5750 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f6343d19640 1 -- 172.21.15.146:0/214046026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633c1e7430 con 0x7f633c0b5750 2024-09-17T03:42:27.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f63327fc640 1 -- 172.21.15.146:0/214046026 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338005450 con 0x7f633c0b5750 2024-09-17T03:42:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.505+0000 7f6343d19640 1 -- 172.21.15.146:0/214046026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633c1515b0 con 0x7f633c0b5750 2024-09-17T03:42:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.507+0000 7f63327fc640 1 -- 172.21.15.146:0/214046026 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f63380317c0 con 0x7f633c0b5750 2024-09-17T03:42:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.508+0000 7f63327fc640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6320078b90 0x7f632007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.508+0000 7f63327fc640 1 -- 172.21.15.146:0/214046026 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f63380bbdd0 con 0x7f633c0b5750 2024-09-17T03:42:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.508+0000 7f63412b4640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6320078b90 0x7f632007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.509+0000 7f634ac87740 1 Processor -- start 2024-09-17T03:42:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.509+0000 7f63412b4640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6320078b90 0x7f632007b0a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f633c159f20 tx=0x7f632c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.509+0000 7f634ac87740 1 -- start start 2024-09-17T03:42:27.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f634ac87740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875da2390 0x560876162110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f634ac87740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875d794d0 0x560876170610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f634ac87740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d816b0 0x560876170b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f634ac87740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5608760bca60 con 0x560875da2390 2024-09-17T03:42:27.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f634ac87740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5608760abe90 con 0x560875d816b0 2024-09-17T03:42:27.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f634ac87740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5608760afca0 con 0x560875d794d0 2024-09-17T03:42:27.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f6341ab5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875da2390 0x560876162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f6341ab5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875da2390 0x560876162110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49204/0 (socket says 172.21.15.146:49204) 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f6341ab5640 1 -- 172.21.15.146:0/2846282886 learned_addr learned my addr 172.21.15.146:0/2846282886 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f63422b6640 1 --2- 172.21.15.146:0/2846282886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d816b0 0x560876170b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f63412b4640 1 --2- 172.21.15.146:0/2846282886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875d794d0 0x560876170610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f6341ab5640 1 -- 172.21.15.146:0/2846282886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875d794d0 msgr2=0x560876170610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f6341ab5640 1 --2- 172.21.15.146:0/2846282886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875d794d0 0x560876170610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f6341ab5640 1 -- 172.21.15.146:0/2846282886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d816b0 msgr2=0x560876170b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f6341ab5640 1 --2- 172.21.15.146:0/2846282886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d816b0 0x560876170b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f6341ab5640 1 -- 172.21.15.146:0/2846282886 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560875e847d0 con 0x560875da2390 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.510+0000 7f6341ab5640 1 --2- 172.21.15.146:0/2846282886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875da2390 0x560876162110 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f63380ba2a0 tx=0x7f6338083380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc03a40435ff8b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.511+0000 7f631f7fe640 1 -- 172.21.15.146:0/2846282886 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338048030 con 0x560875da2390 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.511+0000 7f631f7fe640 1 -- 172.21.15.146:0/2846282886 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63380836a0 con 0x560875da2390 2024-09-17T03:42:27.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.511+0000 7f631f7fe640 1 -- 172.21.15.146:0/2846282886 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338084290 con 0x560875da2390 2024-09-17T03:42:27.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.511+0000 7f634ac87740 1 -- 172.21.15.146:0/2846282886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875da2390 msgr2=0x560876162110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.511+0000 7f634ac87740 1 --2- 172.21.15.146:0/2846282886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875da2390 0x560876162110 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f63380ba2a0 tx=0x7f6338083380 comp rx=0 tx=0).stop 2024-09-17T03:42:27.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.511+0000 7f634ac87740 1 -- 172.21.15.146:0/2846282886 shutdown_connections 2024-09-17T03:42:27.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.511+0000 7f634ac87740 1 --2- 172.21.15.146:0/2846282886 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d816b0 0x560876170b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.511+0000 7f634ac87740 1 --2- 172.21.15.146:0/2846282886 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875d794d0 0x560876170610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.512+0000 7f634ac87740 1 --2- 172.21.15.146:0/2846282886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875da2390 0x560876162110 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.512+0000 7f634ac87740 1 -- 172.21.15.146:0/2846282886 >> 172.21.15.146:0/2846282886 conn(0x560875d964e0 msgr2=0x560876149a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.512+0000 7f634ac87740 1 -- 172.21.15.146:0/2846282886 shutdown_connections 2024-09-17T03:42:27.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.512+0000 7f634ac87740 1 -- 172.21.15.146:0/2846282886 wait complete. 2024-09-17T03:42:27.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.512+0000 7f634ac87740 1 -- start start 2024-09-17T03:42:27.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.513+0000 7f634ac87740 1 Processor -- start 2024-09-17T03:42:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f634ac87740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d794d0 0x56087619bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f634ac87740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d816b0 0x56087618e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f634ac87740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x56087618eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f634ac87740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560875e1c740 con 0x560875d794d0 2024-09-17T03:42:27.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f634ac87740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560876051970 con 0x560875d816b0 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f634ac87740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5608760bca60 con 0x560875da2390 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f634ac87740 10 client.0 _ll_register_callbacks cb 0x560876054be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f6341ab5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d794d0 0x56087619bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f6341ab5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d794d0 0x56087619bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49218/0 (socket says 172.21.15.146:49218) 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f6341ab5640 1 -- 172.21.15.146:0/3437277567 learned_addr learned my addr 172.21.15.146:0/3437277567 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f63412b4640 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d816b0 0x56087618e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f63422b6640 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x56087618eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f6341ab5640 1 -- 172.21.15.146:0/3437277567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 msgr2=0x56087618eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f6341ab5640 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x56087618eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f6341ab5640 1 -- 172.21.15.146:0/3437277567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d816b0 msgr2=0x56087618e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f6341ab5640 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d816b0 0x56087618e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.514+0000 7f6341ab5640 1 -- 172.21.15.146:0/3437277567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560875e0d970 con 0x560875d794d0 2024-09-17T03:42:27.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f6341ab5640 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d794d0 0x56087619bc10 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f63380095f0 tx=0x7f633802aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839ecea2cfa73506 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f631cff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f631cff9640 1 -- 172.21.15.146:0/3437277567 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338083b90 con 0x560875d794d0 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f631cff9640 1 -- 172.21.15.146:0/3437277567 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f633808d0a0 con 0x560875d794d0 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f634ac87740 1 -- 172.21.15.146:0/3437277567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63380836a0 con 0x560875d794d0 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f631cff9640 1 -- 172.21.15.146:0/3437277567 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f63380885f0 con 0x560875d794d0 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f634ac87740 10 client.9522 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f634ac87740 1 -- 172.21.15.146:0/3437277567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x560875deb6a0 con 0x560875d794d0 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f631cff9640 1 -- 172.21.15.146:0/3437277567 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63380836a0 con 0x560875d794d0 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f631cff9640 1 -- 172.21.15.146:0/3437277567 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f6338082df0 con 0x560875d794d0 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f634ac87740 10 client.9522 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f634ac87740 10 client.9522 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f634ac87740 20 client.9522 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:27.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f634ac87740 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x560875d60f60 0x5608761a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f634ac87740 4 client.9522 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f634ac87740 1 -- 172.21.15.146:0/3437277567 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608760be9b0 con 0x560875d60f60 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.515+0000 7f63412b4640 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x560875d60f60 0x5608761a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.516+0000 7f631cff9640 10 client.9522 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.516+0000 7f63412b4640 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x560875d60f60 0x5608761a52d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b726bc8443ad14dc server_cookie=974c025da130ee43 in_seq=0 out_seq=0 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.516+0000 7f631cff9640 1 -- 172.21.15.146:0/3437277567 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5608760be9b0 con 0x560875d60f60 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.516+0000 7f631cff9640 10 client.9522 handle_command_reply: tid=0 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.516+0000 7f634ac87740 1 client.9522 shutdown 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.516+0000 7f634ac87740 1 -- 172.21.15.146:0/3437277567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d794d0 msgr2=0x56087619bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.516+0000 7f634ac87740 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d794d0 0x56087619bc10 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f63380095f0 tx=0x7f633802aa40 comp rx=0 tx=0).stop 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.517+0000 7f634ac87740 1 -- 172.21.15.146:0/3437277567 shutdown_connections 2024-09-17T03:42:27.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.517+0000 7f634ac87740 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x560875d60f60 0x5608761a52d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.517+0000 7f634ac87740 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x56087618eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.517+0000 7f631cff9640 0 client.9522 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.517+0000 7f634ac87740 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d816b0 0x56087618e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.517+0000 7f634ac87740 1 --2- 172.21.15.146:0/3437277567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d794d0 0x56087619bc10 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.517+0000 7f634ac87740 1 -- 172.21.15.146:0/3437277567 >> 172.21.15.146:0/3437277567 conn(0x560875d964e0 msgr2=0x560876161680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.517+0000 7f634ac87740 1 -- 172.21.15.146:0/3437277567 shutdown_connections 2024-09-17T03:42:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.517+0000 7f634ac87740 1 -- 172.21.15.146:0/3437277567 wait complete. 2024-09-17T03:42:27.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.517+0000 7f634ac87740 20 client.9522 trim_cache size 0 max 16384 2024-09-17T03:42:27.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.535+0000 7f634ac87740 1 Processor -- start 2024-09-17T03:42:27.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.535+0000 7f634ac87740 1 -- start start 2024-09-17T03:42:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f634ac87740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d794d0 0x560876144e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f634ac87740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x5608761453b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f634ac87740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x5608761aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f634ac87740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f633c1fde10 con 0x560875d816b0 2024-09-17T03:42:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f634ac87740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f633c06f090 con 0x560875d794d0 2024-09-17T03:42:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f634ac87740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f633c1e5c80 con 0x560875da2390 2024-09-17T03:42:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f63412b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x5608761453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f63412b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x5608761453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49230/0 (socket says 172.21.15.146:49230) 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f63412b4640 1 -- 172.21.15.146:0/3144718420 learned_addr learned my addr 172.21.15.146:0/3144718420 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f6341ab5640 1 --2- 172.21.15.146:0/3144718420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d794d0 0x560876144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f63422b6640 1 --2- 172.21.15.146:0/3144718420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x5608761aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f63412b4640 1 -- 172.21.15.146:0/3144718420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 msgr2=0x5608761aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f63412b4640 1 --2- 172.21.15.146:0/3144718420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x5608761aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f63412b4640 1 -- 172.21.15.146:0/3144718420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d794d0 msgr2=0x560876144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f63412b4640 1 --2- 172.21.15.146:0/3144718420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d794d0 0x560876144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.536+0000 7f63412b4640 1 -- 172.21.15.146:0/3144718420 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608761a1d80 con 0x560875d816b0 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.537+0000 7f63412b4640 1 --2- 172.21.15.146:0/3144718420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x5608761453b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f632c00e680 tx=0x7f632c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41ccfb88ea2dee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.537+0000 7f631effd640 1 -- 172.21.15.146:0/3144718420 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c030070 con 0x560875d816b0 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.537+0000 7f631effd640 1 -- 172.21.15.146:0/3144718420 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f632c00edb0 con 0x560875d816b0 2024-09-17T03:42:27.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.537+0000 7f631effd640 1 -- 172.21.15.146:0/3144718420 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c023890 con 0x560875d816b0 2024-09-17T03:42:27.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.537+0000 7f634ac87740 1 -- 172.21.15.146:0/3144718420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 msgr2=0x5608761453b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.537+0000 7f634ac87740 1 --2- 172.21.15.146:0/3144718420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x5608761453b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f632c00e680 tx=0x7f632c014000 comp rx=0 tx=0).stop 2024-09-17T03:42:27.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.538+0000 7f634ac87740 1 -- 172.21.15.146:0/3144718420 shutdown_connections 2024-09-17T03:42:27.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.538+0000 7f634ac87740 1 --2- 172.21.15.146:0/3144718420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x5608761aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.538+0000 7f634ac87740 1 --2- 172.21.15.146:0/3144718420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x5608761453b0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.538+0000 7f634ac87740 1 --2- 172.21.15.146:0/3144718420 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d794d0 0x560876144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.538+0000 7f634ac87740 1 -- 172.21.15.146:0/3144718420 >> 172.21.15.146:0/3144718420 conn(0x560875d964e0 msgr2=0x56087618a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.538+0000 7f634ac87740 1 -- 172.21.15.146:0/3144718420 shutdown_connections 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.538+0000 7f634ac87740 1 -- 172.21.15.146:0/3144718420 wait complete. 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.538+0000 7f634ac87740 1 -- start start 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.538+0000 7f634ac87740 1 Processor -- start 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f634ac87740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d794d0 0x560876142f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f634ac87740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x560876190970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f634ac87740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x56087618a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f634ac87740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f633c1520e0 con 0x560875d816b0 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f634ac87740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5608762125b0 con 0x560875d794d0 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f634ac87740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5608762120e0 con 0x560875da2390 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f634ac87740 10 client.0 _ll_register_callbacks cb 0x7f633806e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:27.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f63412b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x560876190970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f63412b4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x560876190970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49232/0 (socket says 172.21.15.146:49232) 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f63412b4640 1 -- 172.21.15.146:0/2959836583 learned_addr learned my addr 172.21.15.146:0/2959836583 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f63422b6640 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x56087618a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f6341ab5640 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d794d0 0x560876142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f63412b4640 1 -- 172.21.15.146:0/2959836583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 msgr2=0x56087618a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f63412b4640 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x56087618a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f63412b4640 1 -- 172.21.15.146:0/2959836583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d794d0 msgr2=0x560876142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f63412b4640 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d794d0 0x560876142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f63412b4640 1 -- 172.21.15.146:0/2959836583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56087616a310 con 0x560875d816b0 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f63412b4640 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x560876190970 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f632c001eb0 tx=0x7f632c023bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464c5461e13f9763 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.540+0000 7f631cff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f631cff9640 1 -- 172.21.15.146:0/2959836583 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c030070 con 0x560875d816b0 2024-09-17T03:42:27.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f631cff9640 1 -- 172.21.15.146:0/2959836583 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f632c010040 con 0x560875d816b0 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f634ac87740 1 -- 172.21.15.146:0/2959836583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f632c00edb0 con 0x560875d816b0 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f631cff9640 1 -- 172.21.15.146:0/2959836583 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7f632c035460 con 0x560875d816b0 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f634ac87740 10 client.9528 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f634ac87740 1 -- 172.21.15.146:0/2959836583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x560876190eb0 con 0x560875d816b0 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f631cff9640 1 -- 172.21.15.146:0/2959836583 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f632c00edb0 con 0x560875d816b0 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f631cff9640 1 -- 172.21.15.146:0/2959836583 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7f632c014070 con 0x560875d816b0 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f634ac87740 10 client.9528 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f634ac87740 10 client.9528 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f634ac87740 20 client.9528 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f634ac87740 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56087618aa00 0x560876215880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f634ac87740 4 client.9528 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f634ac87740 1 -- 172.21.15.146:0/2959836583 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5608760ba460 con 0x56087618aa00 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.541+0000 7f6341ab5640 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56087618aa00 0x560876215880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f631cff9640 10 client.9528 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f6341ab5640 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56087618aa00 0x560876215880 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cc0974cfd18d476 server_cookie=16b04cfbc65b8dc5 in_seq=0 out_seq=0 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f631cff9640 1 -- 172.21.15.146:0/2959836583 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+610 (crc 0 0 0) 0x5608760ba460 con 0x56087618aa00 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f631cff9640 10 client.9528 handle_command_reply: tid=0 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 1 client.9528 shutdown 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 1 -- 172.21.15.146:0/2959836583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 msgr2=0x560876190970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x560876190970 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f632c001eb0 tx=0x7f632c023bb0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 1 -- 172.21.15.146:0/2959836583 shutdown_connections 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x56087618aa00 0x560876215880 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560875da2390 0x56087618a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560875d816b0 0x560876190970 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f631cff9640 0 client.9528 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 1 --2- 172.21.15.146:0/2959836583 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560875d794d0 0x560876142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 1 -- 172.21.15.146:0/2959836583 >> 172.21.15.146:0/2959836583 conn(0x560875d964e0 msgr2=0x5608761856c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 1 -- 172.21.15.146:0/2959836583 shutdown_connections 2024-09-17T03:42:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 1 -- 172.21.15.146:0/2959836583 wait complete. 2024-09-17T03:42:27.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.542+0000 7f634ac87740 20 client.9528 trim_cache size 0 max 16384 2024-09-17T03:42:27.548 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:42:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:42:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:42:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "e831064f-2a65-4323-88f5-8eb02fad2c07": { 2024-09-17T03:42:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:42:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "e831064f-2a65-4323-88f5-8eb02fad2c07", 2024-09-17T03:42:27.548 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: "e831064f-2a65-4323-88f5-8eb02fad2c07": { 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:42:20.849070+0000", 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:27.549 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:42:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 -- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6320078b90 msgr2=0x7f632007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6320078b90 0x7f632007b0a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f633c159f20 tx=0x7f632c009040 comp rx=0 tx=0).stop 2024-09-17T03:42:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 -- 172.21.15.146:0/214046026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f633c0b5750 msgr2=0x7f633c1507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f633c0b5750 0x7f633c1507e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f6338009950 tx=0x7f6338003c10 comp rx=0 tx=0).stop 2024-09-17T03:42:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 -- 172.21.15.146:0/214046026 shutdown_connections 2024-09-17T03:42:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6320078b90 0x7f632007b0a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f633c1e6cc0 0x7f633c159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f633c0b5ce0 0x7f633c159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 --2- 172.21.15.146:0/214046026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f633c0b5750 0x7f633c1507e0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 -- 172.21.15.146:0/214046026 >> 172.21.15.146:0/214046026 conn(0x7f633c0b7b20 msgr2=0x7f633c0b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 -- 172.21.15.146:0/214046026 shutdown_connections 2024-09-17T03:42:27.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.543+0000 7f6343d19640 1 -- 172.21.15.146:0/214046026 wait complete. 2024-09-17T03:42:27.554 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:27.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.666+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/156661044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f980b3d30 msgr2=0x7f0f981677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.666+0000 7f0f9fc0e640 1 --2- 172.21.15.146:0/156661044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f980b3d30 0x7f0f981677c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009be0 tx=0x7f0f9002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.666+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/156661044 shutdown_connections 2024-09-17T03:42:27.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.666+0000 7f0f9fc0e640 1 --2- 172.21.15.146:0/156661044 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f980b3d30 0x7f0f981677c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.666+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/156661044 >> 172.21.15.146:0/156661044 conn(0x7f0f980b7b20 msgr2=0x7f0f9809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.666+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/156661044 shutdown_connections 2024-09-17T03:42:27.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.666+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/156661044 wait complete. 2024-09-17T03:42:27.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.668+0000 7f0f9fc0e640 1 Processor -- start 2024-09-17T03:42:27.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.668+0000 7f0f9fc0e640 1 -- start start 2024-09-17T03:42:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.669+0000 7f0f9fc0e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f980b5750 0x7f0f9809fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.669+0000 7f0f9fc0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f980b5ce0 0x7f0f9814f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.669+0000 7f0f9fc0e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f98152450 0x7f0f980718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.669+0000 7f0f9fc0e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0f98168090 con 0x7f0f980b5750 2024-09-17T03:42:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.669+0000 7f0f9fc0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0f98167f10 con 0x7f0f980b5ce0 2024-09-17T03:42:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.669+0000 7f0f9fc0e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0f98168210 con 0x7f0f98152450 2024-09-17T03:42:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9d9aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f980b5750 0x7f0f9809fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9d9aa640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f980b5750 0x7f0f9809fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49244/0 (socket says 172.21.15.146:49244) 2024-09-17T03:42:27.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9d9aa640 1 -- 172.21.15.146:0/1871370855 learned_addr learned my addr 172.21.15.146:0/1871370855 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9d1a9640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f980b5ce0 0x7f0f9814f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9e1ab640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f98152450 0x7f0f980718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9d9aa640 1 -- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f98152450 msgr2=0x7f0f980718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9d9aa640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f98152450 0x7f0f980718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9d9aa640 1 -- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f980b5ce0 msgr2=0x7f0f9814f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9d9aa640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f980b5ce0 0x7f0f9814f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9d9aa640 1 -- 172.21.15.146:0/1871370855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f98155000 con 0x7f0f980b5750 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9d9aa640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f980b5750 0x7f0f9809fd80 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c690 tx=0x7f0f9400cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f8e7fc640 1 -- 172.21.15.146:0/1871370855 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94016020 con 0x7f0f980b5750 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/1871370855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f981552e0 con 0x7f0f980b5750 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f8e7fc640 1 -- 172.21.15.146:0/1871370855 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f9400a930 con 0x7f0f980b5750 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f8e7fc640 1 -- 172.21.15.146:0/1871370855 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9400ad80 con 0x7f0f980b5750 2024-09-17T03:42:27.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.670+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/1871370855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f981558a0 con 0x7f0f980b5750 2024-09-17T03:42:27.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.671+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/1871370855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f980b1320 con 0x7f0f980b5750 2024-09-17T03:42:27.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.672+0000 7f0f8e7fc640 1 -- 172.21.15.146:0/1871370855 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f94019020 con 0x7f0f980b5750 2024-09-17T03:42:27.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.673+0000 7f0f8e7fc640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f7c078bc0 0x7f0f7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:27.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.673+0000 7f0f8e7fc640 1 -- 172.21.15.146:0/1871370855 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f0f9409ae00 con 0x7f0f980b5750 2024-09-17T03:42:27.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.673+0000 7f0f9d1a9640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f7c078bc0 0x7f0f7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:27.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.673+0000 7f0f9d1a9640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f7c078bc0 0x7f0f7c07b0d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0f9815c370 tx=0x7f0f88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:27.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.677+0000 7f0f8e7fc640 1 -- 172.21.15.146:0/1871370855 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f94020020 con 0x7f0f980b5750 2024-09-17T03:42:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.887+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/1871370855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f98152e60 con 0x7f0f980b5750 2024-09-17T03:42:27.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.888+0000 7f0f8e7fc640 1 -- 172.21.15.146:0/1871370855 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7f0f940632e0 con 0x7f0f980b5750 2024-09-17T03:42:27.888 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:27.888 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:27.888 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f7c078bc0 msgr2=0x7f0f7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f7c078bc0 0x7f0f7c07b0d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0f9815c370 tx=0x7f0f88009040 comp rx=0 tx=0).stop 2024-09-17T03:42:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/1871370855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f980b5750 msgr2=0x7f0f9809fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f980b5750 0x7f0f9809fd80 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c690 tx=0x7f0f9400cb50 comp rx=0 tx=0).stop 2024-09-17T03:42:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/1871370855 shutdown_connections 2024-09-17T03:42:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0f7c078bc0 0x7f0f7c07b0d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0f98152450 0x7f0f980718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f980b5ce0 0x7f0f9814f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 --2- 172.21.15.146:0/1871370855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f980b5750 0x7f0f9809fd80 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/1871370855 >> 172.21.15.146:0/1871370855 conn(0x7f0f980b7b20 msgr2=0x7f0f980b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/1871370855 shutdown_connections 2024-09-17T03:42:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:27.890+0000 7f0f9fc0e640 1 -- 172.21.15.146:0/1871370855 wait complete. 2024-09-17T03:42:27.902 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T03:42:27.902 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:42:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.014+0000 7f36a5158640 1 -- 172.21.15.146:0/3447903049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a01604f0 msgr2=0x7f36a0160900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.014+0000 7f36a5158640 1 --2- 172.21.15.146:0/3447903049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a01604f0 0x7f36a0160900 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f36880098e0 tx=0x7f368802a520 comp rx=0 tx=0).stop 2024-09-17T03:42:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.014+0000 7f36a5158640 1 -- 172.21.15.146:0/3447903049 shutdown_connections 2024-09-17T03:42:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.014+0000 7f36a5158640 1 --2- 172.21.15.146:0/3447903049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a01604f0 0x7f36a0160900 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.014+0000 7f36a5158640 1 --2- 172.21.15.146:0/3447903049 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a0153a60 0x7f36a015d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.014+0000 7f36a5158640 1 -- 172.21.15.146:0/3447903049 >> 172.21.15.146:0/3447903049 conn(0x7f36a00b2060 msgr2=0x7f36a00b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.014+0000 7f36a5158640 1 -- 172.21.15.146:0/3447903049 shutdown_connections 2024-09-17T03:42:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.014+0000 7f36a5158640 1 -- 172.21.15.146:0/3447903049 wait complete. 2024-09-17T03:42:28.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.016+0000 7f36a5158640 1 Processor -- start 2024-09-17T03:42:28.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.016+0000 7f36a5158640 1 -- start start 2024-09-17T03:42:28.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.017+0000 7f36a5158640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a0073480 0x7f36a00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.017+0000 7f36a5158640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36a0153a60 0x7f36a00b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.017+0000 7f36a5158640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a01604f0 0x7f36a00ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.017+0000 7f36a5158640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f36a0074120 con 0x7f36a01604f0 2024-09-17T03:42:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.017+0000 7f36a5158640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f36a0073fa0 con 0x7f36a0153a60 2024-09-17T03:42:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.017+0000 7f36a5158640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f36a00ce830 con 0x7f36a0073480 2024-09-17T03:42:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.017+0000 7f369f59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a01604f0 0x7f36a00ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.017+0000 7f369f59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a01604f0 0x7f36a00ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49262/0 (socket says 172.21.15.146:49262) 2024-09-17T03:42:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.017+0000 7f369f59e640 1 -- 172.21.15.146:0/316103761 learned_addr learned my addr 172.21.15.146:0/316103761 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.017+0000 7f369ed9d640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a0073480 0x7f36a00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.017+0000 7f369659c640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36a0153a60 0x7f36a00b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.018+0000 7f369f59e640 1 -- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a0073480 msgr2=0x7f36a00b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.018+0000 7f369f59e640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a0073480 0x7f36a00b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.018+0000 7f369f59e640 1 -- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36a0153a60 msgr2=0x7f36a00b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.018+0000 7f369f59e640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36a0153a60 0x7f36a00b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.018+0000 7f369f59e640 1 -- 172.21.15.146:0/316103761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a01f91b0 con 0x7f36a01604f0 2024-09-17T03:42:28.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.018+0000 7f369f59e640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a01604f0 0x7f36a00ae890 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f369800b9a0 tx=0x7f369800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.018+0000 7f3697fff640 1 -- 172.21.15.146:0/316103761 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698019070 con 0x7f36a01604f0 2024-09-17T03:42:28.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.018+0000 7f3697fff640 1 -- 172.21.15.146:0/316103761 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f369800cc30 con 0x7f36a01604f0 2024-09-17T03:42:28.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.018+0000 7f36a5158640 1 -- 172.21.15.146:0/316103761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a01f9490 con 0x7f36a01604f0 2024-09-17T03:42:28.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.018+0000 7f3697fff640 1 -- 172.21.15.146:0/316103761 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36980146a0 con 0x7f36a01604f0 2024-09-17T03:42:28.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.018+0000 7f36a5158640 1 -- 172.21.15.146:0/316103761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a01f9a50 con 0x7f36a01604f0 2024-09-17T03:42:28.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.019+0000 7f36a5158640 1 -- 172.21.15.146:0/316103761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a01f5830 con 0x7f36a01604f0 2024-09-17T03:42:28.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.020+0000 7f3697fff640 1 -- 172.21.15.146:0/316103761 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f369801c070 con 0x7f36a01604f0 2024-09-17T03:42:28.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.020+0000 7f3697fff640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3680078b90 0x7f368007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.020+0000 7f3697fff640 1 -- 172.21.15.146:0/316103761 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f369809aa70 con 0x7f36a01604f0 2024-09-17T03:42:28.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.020+0000 7f369ed9d640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3680078b90 0x7f368007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.021+0000 7f369ed9d640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3680078b90 0x7f368007b0a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f369000b810 tx=0x7f3690008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.024+0000 7f3697fff640 1 -- 172.21.15.146:0/316103761 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f369800ce20 con 0x7f36a01604f0 2024-09-17T03:42:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.268+0000 7f36a5158640 1 -- 172.21.15.146:0/316103761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f36a015d980 con 0x7f36a01604f0 2024-09-17T03:42:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.268+0000 7f3697fff640 1 -- 172.21.15.146:0/316103761 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f3698062f40 con 0x7f36a01604f0 2024-09-17T03:42:28.268 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:28.269 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":592,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076760460,"bytes_used":2588188672,"bytes_avail":770505924608,"bytes_total":773094113280,"write_bytes_sec":56143106,"read_op_per_sec":0,"write_op_per_sec":63},"fsmap":{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9216}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-17T03:42:25.941707+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:42:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.270+0000 7f36a5158640 1 -- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3680078b90 msgr2=0x7f368007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.270+0000 7f36a5158640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3680078b90 0x7f368007b0a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f369000b810 tx=0x7f3690008040 comp rx=0 tx=0).stop 2024-09-17T03:42:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.270+0000 7f36a5158640 1 -- 172.21.15.146:0/316103761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a01604f0 msgr2=0x7f36a00ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.270+0000 7f36a5158640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a01604f0 0x7f36a00ae890 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f369800b9a0 tx=0x7f369800be60 comp rx=0 tx=0).stop 2024-09-17T03:42:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.270+0000 7f36a5158640 1 -- 172.21.15.146:0/316103761 shutdown_connections 2024-09-17T03:42:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.270+0000 7f36a5158640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3680078b90 0x7f368007b0a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.270+0000 7f36a5158640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a01604f0 0x7f36a00ae890 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.270+0000 7f36a5158640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36a0153a60 0x7f36a00b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.270+0000 7f36a5158640 1 --2- 172.21.15.146:0/316103761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f36a0073480 0x7f36a00b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.270+0000 7f36a5158640 1 -- 172.21.15.146:0/316103761 >> 172.21.15.146:0/316103761 conn(0x7f36a00b2060 msgr2=0x7f36a00b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.271+0000 7f36a5158640 1 -- 172.21.15.146:0/316103761 shutdown_connections 2024-09-17T03:42:28.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.271+0000 7f36a5158640 1 -- 172.21.15.146:0/316103761 wait complete. 2024-09-17T03:42:28.282 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-17T03:42:28.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:28.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub resume 2024-09-17T03:42:28.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.398+0000 7fd446d6e640 1 -- 172.21.15.146:0/619869965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4400b3d30 msgr2=0x7fd4401677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.398+0000 7fd446d6e640 1 --2- 172.21.15.146:0/619869965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4400b3d30 0x7fd4401677c0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fd438005fd0 tx=0x7fd43802aa10 comp rx=0 tx=0).stop 2024-09-17T03:42:28.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.398+0000 7fd446d6e640 1 -- 172.21.15.146:0/619869965 shutdown_connections 2024-09-17T03:42:28.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.398+0000 7fd446d6e640 1 --2- 172.21.15.146:0/619869965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4400b3d30 0x7fd4401677c0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.398+0000 7fd446d6e640 1 -- 172.21.15.146:0/619869965 >> 172.21.15.146:0/619869965 conn(0x7fd4400b7b20 msgr2=0x7fd44009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.398+0000 7fd446d6e640 1 -- 172.21.15.146:0/619869965 shutdown_connections 2024-09-17T03:42:28.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.398+0000 7fd446d6e640 1 -- 172.21.15.146:0/619869965 wait complete. 2024-09-17T03:42:28.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.399+0000 7fd446d6e640 1 Processor -- start 2024-09-17T03:42:28.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.400+0000 7fd446d6e640 1 -- start start 2024-09-17T03:42:28.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd446d6e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4400b5750 0x7fd440151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd446d6e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4400b5ce0 0x7fd4401f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd446d6e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44009c6f0 0x7fd4401f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd446d6e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd440167f10 con 0x7fd44009c6f0 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd446d6e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd44015ddb0 con 0x7fd4400b5ce0 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd446d6e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd440168090 con 0x7fd4400b5750 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd44530b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44009c6f0 0x7fd4401f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd44530b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44009c6f0 0x7fd4401f7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49276/0 (socket says 172.21.15.146:49276) 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd44530b640 1 -- 172.21.15.146:0/95293439 learned_addr learned my addr 172.21.15.146:0/95293439 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd444b0a640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4400b5750 0x7fd440151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd437fff640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4400b5ce0 0x7fd4401f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd44530b640 1 -- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4400b5750 msgr2=0x7fd440151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd44530b640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4400b5750 0x7fd440151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd44530b640 1 -- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4400b5ce0 msgr2=0x7fd4401f6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd44530b640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4400b5ce0 0x7fd4401f6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd44530b640 1 -- 172.21.15.146:0/95293439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd440152430 con 0x7fd44009c6f0 2024-09-17T03:42:28.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.401+0000 7fd444b0a640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4400b5750 0x7fd440151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:28.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.402+0000 7fd44530b640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44009c6f0 0x7fd4401f7460 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fd438006010 tx=0x7fd438003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.402+0000 7fd4357fa640 1 -- 172.21.15.146:0/95293439 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438046070 con 0x7fd44009c6f0 2024-09-17T03:42:28.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.402+0000 7fd4357fa640 1 -- 172.21.15.146:0/95293439 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4380045c0 con 0x7fd44009c6f0 2024-09-17T03:42:28.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.402+0000 7fd446d6e640 1 -- 172.21.15.146:0/95293439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4401570d0 con 0x7fd44009c6f0 2024-09-17T03:42:28.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.402+0000 7fd4357fa640 1 -- 172.21.15.146:0/95293439 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438033070 con 0x7fd44009c6f0 2024-09-17T03:42:28.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.402+0000 7fd446d6e640 1 -- 172.21.15.146:0/95293439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44014d550 con 0x7fd44009c6f0 2024-09-17T03:42:28.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.404+0000 7fd4357fa640 1 -- 172.21.15.146:0/95293439 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd438049070 con 0x7fd44009c6f0 2024-09-17T03:42:28.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.405+0000 7fd4357fa640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd42c078bc0 0x7fd42c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.405+0000 7fd4357fa640 1 -- 172.21.15.146:0/95293439 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fd4380bbf00 con 0x7fd44009c6f0 2024-09-17T03:42:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.405+0000 7fd444b0a640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd42c078bc0 0x7fd42c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.405+0000 7fd44ddbd740 1 Processor -- start 2024-09-17T03:42:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.405+0000 7fd44ddbd740 1 -- start start 2024-09-17T03:42:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.406+0000 7fd444b0a640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd42c078bc0 0x7fd42c07b0d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007fd0 tx=0x7fd43c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb996390 0x5604fbd82a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb96d4d0 0x5604fbd57860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb9756b0 0x5604fbd57da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5604fbcb0a60 con 0x5604fb996390 2024-09-17T03:42:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5604fbc9fe90 con 0x5604fb96d4d0 2024-09-17T03:42:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5604fbca3ca0 con 0x5604fb9756b0 2024-09-17T03:42:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd444b0a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb996390 0x5604fbd82a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd444b0a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb996390 0x5604fbd82a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49282/0 (socket says 172.21.15.146:49282) 2024-09-17T03:42:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd444b0a640 1 -- 172.21.15.146:0/4220626334 learned_addr learned my addr 172.21.15.146:0/4220626334 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd44530b640 1 --2- 172.21.15.146:0/4220626334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb9756b0 0x5604fbd57da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd437fff640 1 --2- 172.21.15.146:0/4220626334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb96d4d0 0x5604fbd57860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd444b0a640 1 -- 172.21.15.146:0/4220626334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb9756b0 msgr2=0x5604fbd57da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd444b0a640 1 --2- 172.21.15.146:0/4220626334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb9756b0 0x5604fbd57da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd444b0a640 1 -- 172.21.15.146:0/4220626334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb96d4d0 msgr2=0x5604fbd57860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd444b0a640 1 --2- 172.21.15.146:0/4220626334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb96d4d0 0x5604fbd57860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd444b0a640 1 -- 172.21.15.146:0/4220626334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604fba787d0 con 0x5604fb996390 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd437fff640 1 --2- 172.21.15.146:0/4220626334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb96d4d0 0x5604fbd57860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd444b0a640 1 --2- 172.21.15.146:0/4220626334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb996390 0x5604fbd82a10 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0050d0 tx=0x7fd43c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e367138afacf8293 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd4267fc640 1 -- 172.21.15.146:0/4220626334 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c0035f0 con 0x5604fb996390 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd4267fc640 1 -- 172.21.15.146:0/4220626334 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd43c003880 con 0x5604fb996390 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.407+0000 7fd4267fc640 1 -- 172.21.15.146:0/4220626334 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c003c70 con 0x5604fb996390 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.408+0000 7fd44ddbd740 1 -- 172.21.15.146:0/4220626334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb996390 msgr2=0x5604fbd82a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.408+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/4220626334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb996390 0x5604fbd82a10 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0050d0 tx=0x7fd43c011000 comp rx=0 tx=0).stop 2024-09-17T03:42:28.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.408+0000 7fd44ddbd740 1 -- 172.21.15.146:0/4220626334 shutdown_connections 2024-09-17T03:42:28.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.408+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/4220626334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb9756b0 0x5604fbd57da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.408+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/4220626334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb96d4d0 0x5604fbd57860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.408+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/4220626334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb996390 0x5604fbd82a10 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.408+0000 7fd44ddbd740 1 -- 172.21.15.146:0/4220626334 >> 172.21.15.146:0/4220626334 conn(0x5604fb98a4e0 msgr2=0x5604fbd3dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.408+0000 7fd44ddbd740 1 -- 172.21.15.146:0/4220626334 shutdown_connections 2024-09-17T03:42:28.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.408+0000 7fd44ddbd740 1 -- 172.21.15.146:0/4220626334 wait complete. 2024-09-17T03:42:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.409+0000 7fd44ddbd740 1 -- start start 2024-09-17T03:42:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.409+0000 7fd44ddbd740 1 Processor -- start 2024-09-17T03:42:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd7f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb9756b0 0x5604fbd91490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb996390 0x5604fbd66170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5604fba10740 con 0x5604fb96d4d0 2024-09-17T03:42:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5604fbc45970 con 0x5604fb996390 2024-09-17T03:42:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5604fbd7fd80 con 0x5604fb9756b0 2024-09-17T03:42:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd44ddbd740 10 client.0 _ll_register_callbacks cb 0x5604fbc54780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd444b0a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd7f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd444b0a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd7f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49296/0 (socket says 172.21.15.146:49296) 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd444b0a640 1 -- 172.21.15.146:0/3506480227 learned_addr learned my addr 172.21.15.146:0/3506480227 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd44530b640 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb996390 0x5604fbd66170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd437fff640 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb9756b0 0x5604fbd91490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd444b0a640 1 -- 172.21.15.146:0/3506480227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb9756b0 msgr2=0x5604fbd91490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd444b0a640 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb9756b0 0x5604fbd91490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd444b0a640 1 -- 172.21.15.146:0/3506480227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb996390 msgr2=0x5604fbd66170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd444b0a640 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb996390 0x5604fbd66170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd444b0a640 1 -- 172.21.15.146:0/3506480227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604fba01970 con 0x5604fb96d4d0 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd444b0a640 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd7f840 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00e530 tx=0x7fd43c003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245e0faea5377c8b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd41f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.411+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3506480227 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c003e50 con 0x5604fb96d4d0 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3506480227 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fd43c02cad0 con 0x5604fb96d4d0 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3506480227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd43c003880 con 0x5604fb96d4d0 2024-09-17T03:42:28.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3506480227 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fd43c033050 con 0x5604fb96d4d0 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd44ddbd740 10 client.9555 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3506480227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x5604fb9df6a0 con 0x5604fb96d4d0 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3506480227 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd43c003880 con 0x5604fb96d4d0 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3506480227 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7fd43c036020 con 0x5604fb96d4d0 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd44ddbd740 10 client.9555 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd44ddbd740 10 client.9555 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd44ddbd740 20 client.9555 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x5604fb954f60 0x5604fbd7bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd44ddbd740 4 client.9555 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3506480227 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604fbcb29b0 con 0x5604fb954f60 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd437fff640 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x5604fb954f60 0x5604fbd7bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.412+0000 7fd41f7fe640 10 client.9555 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd437fff640 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x5604fb954f60 0x5604fbd7bcd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fd67caff5ce7d2f server_cookie=e6fa909c7c71a1cd in_seq=0 out_seq=0 2024-09-17T03:42:28.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3506480227 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604fbcb29b0 con 0x5604fb954f60 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd41f7fe640 10 client.9555 handle_command_reply: tid=0 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd44ddbd740 1 client.9555 shutdown 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3506480227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 msgr2=0x5604fbd7f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd7f840 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00e530 tx=0x7fd43c003c60 comp rx=0 tx=0).stop 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3506480227 shutdown_connections 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x5604fb954f60 0x5604fbd7bcd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb996390 0x5604fbd66170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd41f7fe640 0 client.9555 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb9756b0 0x5604fbd91490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3506480227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd7f840 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.413+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3506480227 >> 172.21.15.146:0/3506480227 conn(0x5604fb98a4e0 msgr2=0x5604fbd38a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.414+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3506480227 shutdown_connections 2024-09-17T03:42:28.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.414+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3506480227 wait complete. 2024-09-17T03:42:28.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.414+0000 7fd44ddbd740 20 client.9555 trim_cache size 0 max 16384 2024-09-17T03:42:28.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.431+0000 7fd44ddbd740 1 Processor -- start 2024-09-17T03:42:28.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.431+0000 7fd44ddbd740 1 -- start start 2024-09-17T03:42:28.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.432+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb954f60 0x5604fbd78450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.432+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd4b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.432+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb9756b0 0x5604fbd4bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.432+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd4402002e0 con 0x5604fb96d4d0 2024-09-17T03:42:28.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.432+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd4401ff300 con 0x5604fb9756b0 2024-09-17T03:42:28.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.432+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd44014e940 con 0x5604fb954f60 2024-09-17T03:42:28.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.432+0000 7fd437fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd4b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.432+0000 7fd437fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd4b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49304/0 (socket says 172.21.15.146:49304) 2024-09-17T03:42:28.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.432+0000 7fd437fff640 1 -- 172.21.15.146:0/2265402462 learned_addr learned my addr 172.21.15.146:0/2265402462 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.433+0000 7fd444b0a640 1 --2- 172.21.15.146:0/2265402462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb954f60 0x5604fbd78450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.433+0000 7fd44530b640 1 --2- 172.21.15.146:0/2265402462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb9756b0 0x5604fbd4bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.433+0000 7fd437fff640 1 -- 172.21.15.146:0/2265402462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb954f60 msgr2=0x5604fbd78450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.433+0000 7fd437fff640 1 --2- 172.21.15.146:0/2265402462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb954f60 0x5604fbd78450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.433+0000 7fd437fff640 1 -- 172.21.15.146:0/2265402462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb9756b0 msgr2=0x5604fbd4bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.433+0000 7fd437fff640 1 --2- 172.21.15.146:0/2265402462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb9756b0 0x5604fbd4bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.433+0000 7fd437fff640 1 -- 172.21.15.146:0/2265402462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604fbd65ad0 con 0x5604fb96d4d0 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.433+0000 7fd437fff640 1 --2- 172.21.15.146:0/2265402462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd4b9d0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fd440072e10 tx=0x7fd430008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46db56a138bcbcd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.433+0000 7fd425ffb640 1 -- 172.21.15.146:0/2265402462 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd430016aa0 con 0x5604fb96d4d0 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.433+0000 7fd425ffb640 1 -- 172.21.15.146:0/2265402462 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd430016c40 con 0x5604fb96d4d0 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.433+0000 7fd425ffb640 1 -- 172.21.15.146:0/2265402462 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd430024690 con 0x5604fb96d4d0 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.434+0000 7fd44ddbd740 1 -- 172.21.15.146:0/2265402462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 msgr2=0x5604fbd4b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.434+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/2265402462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd4b9d0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fd440072e10 tx=0x7fd430008040 comp rx=0 tx=0).stop 2024-09-17T03:42:28.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.434+0000 7fd44ddbd740 1 -- 172.21.15.146:0/2265402462 shutdown_connections 2024-09-17T03:42:28.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.434+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/2265402462 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb9756b0 0x5604fbd4bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.434+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/2265402462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbd4b9d0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.434+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/2265402462 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb954f60 0x5604fbd78450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.434+0000 7fd44ddbd740 1 -- 172.21.15.146:0/2265402462 >> 172.21.15.146:0/2265402462 conn(0x5604fb98a4e0 msgr2=0x5604fbd38900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.434+0000 7fd44ddbd740 1 -- 172.21.15.146:0/2265402462 shutdown_connections 2024-09-17T03:42:28.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.434+0000 7fd44ddbd740 1 -- 172.21.15.146:0/2265402462 wait complete. 2024-09-17T03:42:28.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.435+0000 7fd44ddbd740 1 -- start start 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.435+0000 7fd44ddbd740 1 Processor -- start 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.436+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb954f60 0x5604fbda5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.436+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbda5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.436+0000 7fd44ddbd740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb9756b0 0x5604fbd371b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.436+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5604fbd7b030 con 0x5604fb96d4d0 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.436+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd44014ef90 con 0x5604fb9756b0 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.436+0000 7fd44ddbd740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5604fbd7a110 con 0x5604fb954f60 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.436+0000 7fd44ddbd740 10 client.0 _ll_register_callbacks cb 0x7fd438009540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.436+0000 7fd437fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbda5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.436+0000 7fd437fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbda5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49312/0 (socket says 172.21.15.146:49312) 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.436+0000 7fd437fff640 1 -- 172.21.15.146:0/3532349252 learned_addr learned my addr 172.21.15.146:0/3532349252 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd437fff640 1 -- 172.21.15.146:0/3532349252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb954f60 msgr2=0x5604fbda5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd437fff640 1 --2- 172.21.15.146:0/3532349252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb954f60 0x5604fbda5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd437fff640 1 -- 172.21.15.146:0/3532349252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb9756b0 msgr2=0x5604fbd371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd437fff640 1 --2- 172.21.15.146:0/3532349252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb9756b0 0x5604fbd371b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd437fff640 1 -- 172.21.15.146:0/3532349252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604fbe02320 con 0x5604fb96d4d0 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd437fff640 1 --2- 172.21.15.146:0/3532349252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbda5c50 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fd430004730 tx=0x7fd430016b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7843adb966afbd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd41f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3532349252 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd430004400 con 0x5604fb96d4d0 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3532349252 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fd4300035f0 con 0x5604fb96d4d0 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3532349252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd430016c40 con 0x5604fb96d4d0 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3532349252 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fd430032050 con 0x5604fb96d4d0 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd44ddbd740 10 client.9561 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3532349252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x5604fbe03000 con 0x5604fb96d4d0 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3532349252 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd430016c40 con 0x5604fb96d4d0 2024-09-17T03:42:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3532349252 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7fd430035020 con 0x5604fb96d4d0 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd44ddbd740 10 client.9561 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd44ddbd740 10 client.9561 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd44ddbd740 20 client.9561 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3532349252 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x5604fb92a3a0 0x5604fbd376f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd44ddbd740 4 client.9561 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3532349252 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x5604fbcae460 con 0x5604fb92a3a0 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.437+0000 7fd444b0a640 1 --2- 172.21.15.146:0/3532349252 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x5604fb92a3a0 0x5604fbd376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd41f7fe640 10 client.9561 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd444b0a640 1 --2- 172.21.15.146:0/3532349252 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x5604fb92a3a0 0x5604fbd376f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8347118750af44f server_cookie=b5e6cfea311fe110 in_seq=0 out_seq=0 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd41f7fe640 1 -- 172.21.15.146:0/3532349252 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5604fbcae460 con 0x5604fb92a3a0 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd41f7fe640 10 client.9561 handle_command_reply: tid=0 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd44ddbd740 1 client.9561 shutdown 2024-09-17T03:42:28.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3532349252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 msgr2=0x5604fbda5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3532349252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbda5c50 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fd430004730 tx=0x7fd430016b50 comp rx=0 tx=0).stop 2024-09-17T03:42:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3532349252 shutdown_connections 2024-09-17T03:42:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3532349252 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x5604fb92a3a0 0x5604fbd376f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3532349252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5604fb9756b0 0x5604fbd371b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3532349252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604fb96d4d0 0x5604fbda5c50 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd41f7fe640 0 client.9561 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd44ddbd740 1 --2- 172.21.15.146:0/3532349252 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5604fb954f60 0x5604fbda5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3532349252 >> 172.21.15.146:0/3532349252 conn(0x5604fb98a4e0 msgr2=0x5604fbd3de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3532349252 shutdown_connections 2024-09-17T03:42:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.438+0000 7fd44ddbd740 1 -- 172.21.15.146:0/3532349252 wait complete. 2024-09-17T03:42:28.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd44ddbd740 20 client.9561 trim_cache size 0 max 16384 2024-09-17T03:42:28.449 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:42:28.449 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:42:28.449 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:42:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 -- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd42c078bc0 msgr2=0x7fd42c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd42c078bc0 0x7fd42c07b0d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007fd0 tx=0x7fd43c009040 comp rx=0 tx=0).stop 2024-09-17T03:42:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 -- 172.21.15.146:0/95293439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44009c6f0 msgr2=0x7fd4401f7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44009c6f0 0x7fd4401f7460 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fd438006010 tx=0x7fd438003f10 comp rx=0 tx=0).stop 2024-09-17T03:42:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 -- 172.21.15.146:0/95293439 shutdown_connections 2024-09-17T03:42:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd42c078bc0 0x7fd42c07b0d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd44009c6f0 0x7fd4401f7460 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4400b5ce0 0x7fd4401f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 --2- 172.21.15.146:0/95293439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4400b5750 0x7fd440151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 -- 172.21.15.146:0/95293439 >> 172.21.15.146:0/95293439 conn(0x7fd4400b7b20 msgr2=0x7fd4400b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 -- 172.21.15.146:0/95293439 shutdown_connections 2024-09-17T03:42:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.439+0000 7fd446d6e640 1 -- 172.21.15.146:0/95293439 wait complete. 2024-09-17T03:42:28.451 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:42:28.451 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-17T03:42:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.567+0000 7fbd92da8640 1 -- 172.21.15.146:0/102781498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b61f0 msgr2=0x7fbd8c0b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.567+0000 7fbd92da8640 1 --2- 172.21.15.146:0/102781498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b61f0 0x7fbd8c0b6600 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c068f10 tx=0x7fbd8402aa90 comp rx=0 tx=0).stop 2024-09-17T03:42:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.567+0000 7fbd92da8640 1 -- 172.21.15.146:0/102781498 shutdown_connections 2024-09-17T03:42:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.567+0000 7fbd92da8640 1 --2- 172.21.15.146:0/102781498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b61f0 0x7fbd8c0b6600 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.567+0000 7fbd92da8640 1 -- 172.21.15.146:0/102781498 >> 172.21.15.146:0/102781498 conn(0x7fbd8c0d11f0 msgr2=0x7fbd8c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.567+0000 7fbd92da8640 1 -- 172.21.15.146:0/102781498 shutdown_connections 2024-09-17T03:42:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.567+0000 7fbd92da8640 1 -- 172.21.15.146:0/102781498 wait complete. 2024-09-17T03:42:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.569+0000 7fbd92da8640 1 Processor -- start 2024-09-17T03:42:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.569+0000 7fbd92da8640 1 -- start start 2024-09-17T03:42:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.570+0000 7fbd92da8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b61f0 0x7fbd8c0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.570+0000 7fbd92da8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd8c0cfca0 0x7fbd8c157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.570+0000 7fbd92da8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd8c15f1a0 0x7fbd8c1f9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.570+0000 7fbd92da8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c0695b0 con 0x7fbd8c0b61f0 2024-09-17T03:42:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.570+0000 7fbd92da8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c069430 con 0x7fbd8c15f1a0 2024-09-17T03:42:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.570+0000 7fbd92da8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c069730 con 0x7fbd8c0cfca0 2024-09-17T03:42:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.570+0000 7fbd90b44640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b61f0 0x7fbd8c0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.570+0000 7fbd90b44640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b61f0 0x7fbd8c0ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49324/0 (socket says 172.21.15.146:49324) 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.570+0000 7fbd90b44640 1 -- 172.21.15.146:0/812492351 learned_addr learned my addr 172.21.15.146:0/812492351 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.570+0000 7fbd91345640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd8c15f1a0 0x7fbd8c1f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.570+0000 7fbd83fff640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd8c0cfca0 0x7fbd8c157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.571+0000 7fbd90b44640 1 -- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd8c0cfca0 msgr2=0x7fbd8c157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.571+0000 7fbd90b44640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd8c0cfca0 0x7fbd8c157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.571+0000 7fbd90b44640 1 -- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd8c15f1a0 msgr2=0x7fbd8c1f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.571+0000 7fbd90b44640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd8c15f1a0 0x7fbd8c1f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.571+0000 7fbd90b44640 1 -- 172.21.15.146:0/812492351 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c0cace0 con 0x7fbd8c0b61f0 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.571+0000 7fbd90b44640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b61f0 0x7fbd8c0ca140 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800c400 tx=0x7fbd8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.571+0000 7fbd817fa640 1 -- 172.21.15.146:0/812492351 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88017070 con 0x7fbd8c0b61f0 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.571+0000 7fbd817fa640 1 -- 172.21.15.146:0/812492351 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd880053c0 con 0x7fbd8c0b61f0 2024-09-17T03:42:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.571+0000 7fbd92da8640 1 -- 172.21.15.146:0/812492351 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c0cafc0 con 0x7fbd8c0b61f0 2024-09-17T03:42:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.571+0000 7fbd817fa640 1 -- 172.21.15.146:0/812492351 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88003850 con 0x7fbd8c0b61f0 2024-09-17T03:42:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.571+0000 7fbd92da8640 1 -- 172.21.15.146:0/812492351 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c0c84f0 con 0x7fbd8c0b61f0 2024-09-17T03:42:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.573+0000 7fbd817fa640 1 -- 172.21.15.146:0/812492351 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd8801a070 con 0x7fbd8c0b61f0 2024-09-17T03:42:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.574+0000 7fbd817fa640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd78078b90 0x7fbd7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.574+0000 7fbd817fa640 1 -- 172.21.15.146:0/812492351 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fbd88099f70 con 0x7fbd8c0b61f0 2024-09-17T03:42:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.574+0000 7fbd83fff640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd78078b90 0x7fbd7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.574+0000 7fbd99def740 1 Processor -- start 2024-09-17T03:42:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.574+0000 7fbd83fff640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd78078b90 0x7fbd7807b0a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c161730 tx=0x7fbd7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.575+0000 7fbd99def740 1 -- start start 2024-09-17T03:42:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd99def740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff13589a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd99def740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 0x55ff1355e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd99def740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1317c6b0 0x55ff1355eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd99def740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ff134b7a60 con 0x55ff1319d390 2024-09-17T03:42:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd99def740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ff134a6e90 con 0x55ff131744d0 2024-09-17T03:42:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd99def740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ff134aaca0 con 0x55ff1317c6b0 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd90b44640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff13589a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd90b44640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff13589a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49326/0 (socket says 172.21.15.146:49326) 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd90b44640 1 -- 172.21.15.146:0/2279448693 learned_addr learned my addr 172.21.15.146:0/2279448693 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd91345640 1 --2- 172.21.15.146:0/2279448693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1317c6b0 0x55ff1355eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd83fff640 1 --2- 172.21.15.146:0/2279448693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 0x55ff1355e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd90b44640 1 -- 172.21.15.146:0/2279448693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1317c6b0 msgr2=0x55ff1355eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd90b44640 1 --2- 172.21.15.146:0/2279448693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1317c6b0 0x55ff1355eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd90b44640 1 -- 172.21.15.146:0/2279448693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 msgr2=0x55ff1355e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd90b44640 1 --2- 172.21.15.146:0/2279448693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 0x55ff1355e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd90b44640 1 -- 172.21.15.146:0/2279448693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff1327f7d0 con 0x55ff1319d390 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd83fff640 1 --2- 172.21.15.146:0/2279448693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 0x55ff1355e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd90b44640 1 --2- 172.21.15.146:0/2279448693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff13589a10 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fbd88001eb0 tx=0x7fbd880011e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be04a6cdceb671a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.576+0000 7fbd727fc640 1 -- 172.21.15.146:0/2279448693 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88088170 con 0x55ff1319d390 2024-09-17T03:42:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.577+0000 7fbd727fc640 1 -- 172.21.15.146:0/2279448693 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd88066940 con 0x55ff1319d390 2024-09-17T03:42:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.577+0000 7fbd727fc640 1 -- 172.21.15.146:0/2279448693 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88061370 con 0x55ff1319d390 2024-09-17T03:42:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.577+0000 7fbd99def740 1 -- 172.21.15.146:0/2279448693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 msgr2=0x55ff13589a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.577+0000 7fbd99def740 1 --2- 172.21.15.146:0/2279448693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff13589a10 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fbd88001eb0 tx=0x7fbd880011e0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.577+0000 7fbd99def740 1 -- 172.21.15.146:0/2279448693 shutdown_connections 2024-09-17T03:42:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.577+0000 7fbd99def740 1 --2- 172.21.15.146:0/2279448693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1317c6b0 0x55ff1355eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.577+0000 7fbd99def740 1 --2- 172.21.15.146:0/2279448693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 0x55ff1355e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.577+0000 7fbd99def740 1 --2- 172.21.15.146:0/2279448693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff13589a10 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.577+0000 7fbd99def740 1 -- 172.21.15.146:0/2279448693 >> 172.21.15.146:0/2279448693 conn(0x55ff131914e0 msgr2=0x55ff13544d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.577+0000 7fbd99def740 1 -- 172.21.15.146:0/2279448693 shutdown_connections 2024-09-17T03:42:28.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.577+0000 7fbd99def740 1 -- 172.21.15.146:0/2279448693 wait complete. 2024-09-17T03:42:28.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.578+0000 7fbd99def740 1 -- start start 2024-09-17T03:42:28.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.578+0000 7fbd99def740 1 Processor -- start 2024-09-17T03:42:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd99def740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff131744d0 0x55ff13583760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd99def740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1317c6b0 0x55ff1359c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd99def740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff1319d390 0x55ff135852f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd99def740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ff13217740 con 0x55ff131744d0 2024-09-17T03:42:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd99def740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ff1344c970 con 0x55ff1319d390 2024-09-17T03:42:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd99def740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ff13583ca0 con 0x55ff1317c6b0 2024-09-17T03:42:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd99def740 10 client.0 _ll_register_callbacks cb 0x55ff1345b780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd90b44640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff131744d0 0x55ff13583760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd90b44640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff131744d0 0x55ff13583760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49336/0 (socket says 172.21.15.146:49336) 2024-09-17T03:42:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd90b44640 1 -- 172.21.15.146:0/2656711655 learned_addr learned my addr 172.21.15.146:0/2656711655 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:28.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd91345640 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff1319d390 0x55ff135852f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd83fff640 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1317c6b0 0x55ff1359c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd90b44640 1 -- 172.21.15.146:0/2656711655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1317c6b0 msgr2=0x55ff1359c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd90b44640 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1317c6b0 0x55ff1359c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd90b44640 1 -- 172.21.15.146:0/2656711655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff1319d390 msgr2=0x55ff135852f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd90b44640 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff1319d390 0x55ff135852f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd90b44640 1 -- 172.21.15.146:0/2656711655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff13208970 con 0x55ff131744d0 2024-09-17T03:42:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd90b44640 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff131744d0 0x55ff13583760 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fbd88061e50 tx=0x7fbd880613a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43859876e1e0450 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.580+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/2656711655 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8807c060 con 0x55ff131744d0 2024-09-17T03:42:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/2656711655 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fbd8805da70 con 0x55ff131744d0 2024-09-17T03:42:28.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd99def740 1 -- 172.21.15.146:0/2656711655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd88066940 con 0x55ff131744d0 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/2656711655 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fbd88088170 con 0x55ff131744d0 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd99def740 10 client.9576 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd99def740 1 -- 172.21.15.146:0/2656711655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55ff131e66a0 con 0x55ff131744d0 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/2656711655 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd88066940 con 0x55ff131744d0 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/2656711655 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7fbd88067ad0 con 0x55ff131744d0 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd99def740 10 client.9576 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd99def740 10 client.9576 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd99def740 20 client.9576 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd99def740 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ff1315bf60 0x55ff13599170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd99def740 4 client.9576 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd99def740 1 -- 172.21.15.146:0/2656711655 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff134b99b0 con 0x55ff1315bf60 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd83fff640 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ff1315bf60 0x55ff13599170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.581+0000 7fbd6b7fe640 10 client.9576 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd83fff640 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ff1315bf60 0x55ff13599170 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8f706a6bfd2e0ba server_cookie=a14a20b90e2ed31c in_seq=0 out_seq=0 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/2656711655 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff134b99b0 con 0x55ff1315bf60 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd6b7fe640 10 client.9576 handle_command_reply: tid=0 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd99def740 1 client.9576 shutdown 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd99def740 1 -- 172.21.15.146:0/2656711655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff131744d0 msgr2=0x55ff13583760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd99def740 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff131744d0 0x55ff13583760 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fbd88061e50 tx=0x7fbd880613a0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd99def740 1 -- 172.21.15.146:0/2656711655 shutdown_connections 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd99def740 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ff1315bf60 0x55ff13599170 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd99def740 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff1319d390 0x55ff135852f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd6b7fe640 0 client.9576 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd99def740 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1317c6b0 0x55ff1359c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd99def740 1 --2- 172.21.15.146:0/2656711655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff131744d0 0x55ff13583760 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd99def740 1 -- 172.21.15.146:0/2656711655 >> 172.21.15.146:0/2656711655 conn(0x55ff131914e0 msgr2=0x55ff13589a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.582+0000 7fbd99def740 1 -- 172.21.15.146:0/2656711655 shutdown_connections 2024-09-17T03:42:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.583+0000 7fbd99def740 1 -- 172.21.15.146:0/2656711655 wait complete. 2024-09-17T03:42:28.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.583+0000 7fbd99def740 20 client.9576 trim_cache size 0 max 16384 2024-09-17T03:42:28.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.600+0000 7fbd99def740 1 Processor -- start 2024-09-17T03:42:28.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.600+0000 7fbd99def740 1 -- start start 2024-09-17T03:42:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.601+0000 7fbd99def740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff131744d0 0x55ff135adf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.601+0000 7fbd99def740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff1317c6b0 0x55ff1356b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.601+0000 7fbd99def740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff135895a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.601+0000 7fbd99def740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c2023d0 con 0x55ff1319d390 2024-09-17T03:42:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.601+0000 7fbd99def740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c0c9ae0 con 0x55ff1317c6b0 2024-09-17T03:42:28.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.601+0000 7fbd99def740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c06a7d0 con 0x55ff131744d0 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd91345640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff135895a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd91345640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff135895a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49350/0 (socket says 172.21.15.146:49350) 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd91345640 1 -- 172.21.15.146:0/2122381922 learned_addr learned my addr 172.21.15.146:0/2122381922 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd90b44640 1 --2- 172.21.15.146:0/2122381922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff131744d0 0x55ff135adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd91345640 1 -- 172.21.15.146:0/2122381922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff131744d0 msgr2=0x55ff135adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd91345640 1 --2- 172.21.15.146:0/2122381922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff131744d0 0x55ff135adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd83fff640 1 --2- 172.21.15.146:0/2122381922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff1317c6b0 0x55ff1356b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd91345640 1 -- 172.21.15.146:0/2122381922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff1317c6b0 msgr2=0x55ff1356b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd91345640 1 --2- 172.21.15.146:0/2122381922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff1317c6b0 0x55ff1356b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd91345640 1 -- 172.21.15.146:0/2122381922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff13541080 con 0x55ff1319d390 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd91345640 1 --2- 172.21.15.146:0/2122381922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff135895a0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fbd8402b080 tx=0x7fbd84004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5bf9b99962d915 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd71ffb640 1 -- 172.21.15.146:0/2122381922 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8402ed60 con 0x55ff1319d390 2024-09-17T03:42:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd71ffb640 1 -- 172.21.15.146:0/2122381922 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd84003970 con 0x55ff1319d390 2024-09-17T03:42:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.602+0000 7fbd71ffb640 1 -- 172.21.15.146:0/2122381922 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84003d40 con 0x55ff1319d390 2024-09-17T03:42:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.603+0000 7fbd99def740 1 -- 172.21.15.146:0/2122381922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 msgr2=0x55ff135895a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.603+0000 7fbd99def740 1 --2- 172.21.15.146:0/2122381922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff135895a0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fbd8402b080 tx=0x7fbd84004ab0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.603+0000 7fbd99def740 1 -- 172.21.15.146:0/2122381922 shutdown_connections 2024-09-17T03:42:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.603+0000 7fbd99def740 1 --2- 172.21.15.146:0/2122381922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1319d390 0x55ff135895a0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.603+0000 7fbd99def740 1 --2- 172.21.15.146:0/2122381922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff1317c6b0 0x55ff1356b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.603+0000 7fbd99def740 1 --2- 172.21.15.146:0/2122381922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff131744d0 0x55ff135adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.603+0000 7fbd99def740 1 -- 172.21.15.146:0/2122381922 >> 172.21.15.146:0/2122381922 conn(0x55ff131914e0 msgr2=0x55ff1357f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.603+0000 7fbd99def740 1 -- 172.21.15.146:0/2122381922 shutdown_connections 2024-09-17T03:42:28.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.603+0000 7fbd99def740 1 -- 172.21.15.146:0/2122381922 wait complete. 2024-09-17T03:42:28.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.604+0000 7fbd99def740 1 -- start start 2024-09-17T03:42:28.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.604+0000 7fbd99def740 1 Processor -- start 2024-09-17T03:42:28.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.605+0000 7fbd99def740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 0x55ff135fed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.605+0000 7fbd99def740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1317c6b0 0x55ff1354fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.605+0000 7fbd99def740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1319d390 0x55ff13550210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.605+0000 7fbd99def740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c0c9490 con 0x55ff1317c6b0 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.605+0000 7fbd99def740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ff1353b0a0 con 0x55ff131744d0 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.605+0000 7fbd99def740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ff1354cb10 con 0x55ff1319d390 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd99def740 10 client.0 _ll_register_callbacks cb 0x7fbd88087070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd83fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1317c6b0 0x55ff1354fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd83fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1317c6b0 0x55ff1354fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49356/0 (socket says 172.21.15.146:49356) 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd83fff640 1 -- 172.21.15.146:0/3564058464 learned_addr learned my addr 172.21.15.146:0/3564058464 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd90b44640 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 0x55ff135fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd91345640 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1319d390 0x55ff13550210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd83fff640 1 -- 172.21.15.146:0/3564058464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1319d390 msgr2=0x55ff13550210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd83fff640 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1319d390 0x55ff13550210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd83fff640 1 -- 172.21.15.146:0/3564058464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 msgr2=0x55ff135fed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd83fff640 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 0x55ff135fed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd83fff640 1 -- 172.21.15.146:0/3564058464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff135423e0 con 0x55ff1317c6b0 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd90b44640 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 0x55ff135fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd83fff640 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1317c6b0 0x55ff1354fcd0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c162300 tx=0x7fbd7c007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32577f44d36bcfe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/3564058464 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c02e020 con 0x55ff1317c6b0 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/3564058464 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fbd7c0148a0 con 0x55ff1317c6b0 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd99def740 1 -- 172.21.15.146:0/3564058464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd84003970 con 0x55ff1317c6b0 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/3564058464 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7fbd7c035050 con 0x55ff1317c6b0 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd99def740 10 client.9582 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.606+0000 7fbd99def740 1 -- 172.21.15.146:0/3564058464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55ff1354c850 con 0x55ff1317c6b0 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.607+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/3564058464 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd84003970 con 0x55ff1317c6b0 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.607+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/3564058464 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7fbd7c038020 con 0x55ff1317c6b0 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.607+0000 7fbd99def740 10 client.9582 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.607+0000 7fbd99def740 10 client.9582 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.607+0000 7fbd99def740 20 client.9582 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.607+0000 7fbd99def740 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ff13583de0 0x55ff135841f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.607+0000 7fbd99def740 4 client.9582 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:42:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.607+0000 7fbd99def740 1 -- 172.21.15.146:0/3564058464 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ff134b5460 con 0x55ff13583de0 2024-09-17T03:42:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.607+0000 7fbd90b44640 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ff13583de0 0x55ff135841f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.607+0000 7fbd6b7fe640 10 client.9582 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.607+0000 7fbd90b44640 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ff13583de0 0x55ff135841f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6bb0fd96b32a02e server_cookie=86cec687475ecdd8 in_seq=0 out_seq=0 2024-09-17T03:42:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd6b7fe640 1 -- 172.21.15.146:0/3564058464 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+610 (crc 0 0 0) 0x55ff134b5460 con 0x55ff13583de0 2024-09-17T03:42:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd6b7fe640 10 client.9582 handle_command_reply: tid=0 2024-09-17T03:42:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 1 client.9582 shutdown 2024-09-17T03:42:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 1 -- 172.21.15.146:0/3564058464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1317c6b0 msgr2=0x55ff1354fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1317c6b0 0x55ff1354fcd0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c162300 tx=0x7fbd7c007e30 comp rx=0 tx=0).stop 2024-09-17T03:42:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 1 -- 172.21.15.146:0/3564058464 shutdown_connections 2024-09-17T03:42:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ff13583de0 0x55ff135841f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ff1319d390 0x55ff13550210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ff1317c6b0 0x55ff1354fcd0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd6b7fe640 0 client.9582 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 1 --2- 172.21.15.146:0/3564058464 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ff131744d0 0x55ff135fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 1 -- 172.21.15.146:0/3564058464 >> 172.21.15.146:0/3564058464 conn(0x55ff131914e0 msgr2=0x55ff13585110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 1 -- 172.21.15.146:0/3564058464 shutdown_connections 2024-09-17T03:42:28.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 1 -- 172.21.15.146:0/3564058464 wait complete. 2024-09-17T03:42:28.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd99def740 20 client.9582 trim_cache size 0 max 16384 2024-09-17T03:42:28.615 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:42:28.615 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:42:28.615 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:42:28.615 INFO:teuthology.orchestra.run.smithi146.stdout: "e831064f-2a65-4323-88f5-8eb02fad2c07": { 2024-09-17T03:42:28.615 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:42:28.615 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "e831064f-2a65-4323-88f5-8eb02fad2c07", 2024-09-17T03:42:28.615 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2024-09-17T03:42:28.615 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout: "e831064f-2a65-4323-88f5-8eb02fad2c07": { 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:42:20.849070+0000", 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:28.616 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:42:28.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd92da8640 1 -- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd78078b90 msgr2=0x7fbd7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd92da8640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd78078b90 0x7fbd7807b0a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c161730 tx=0x7fbd7c009040 comp rx=0 tx=0).stop 2024-09-17T03:42:28.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd92da8640 1 -- 172.21.15.146:0/812492351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b61f0 msgr2=0x7fbd8c0ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:28.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.608+0000 7fbd92da8640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b61f0 0x7fbd8c0ca140 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800c400 tx=0x7fbd8800c8c0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.609+0000 7fbd92da8640 1 -- 172.21.15.146:0/812492351 shutdown_connections 2024-09-17T03:42:28.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.609+0000 7fbd92da8640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd78078b90 0x7fbd7807b0a0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.609+0000 7fbd92da8640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd8c15f1a0 0x7fbd8c1f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.609+0000 7fbd92da8640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd8c0cfca0 0x7fbd8c157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.609+0000 7fbd92da8640 1 --2- 172.21.15.146:0/812492351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd8c0b61f0 0x7fbd8c0ca140 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:28.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.609+0000 7fbd92da8640 1 -- 172.21.15.146:0/812492351 >> 172.21.15.146:0/812492351 conn(0x7fbd8c0d11f0 msgr2=0x7fbd8c15d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:28.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.609+0000 7fbd92da8640 1 -- 172.21.15.146:0/812492351 shutdown_connections 2024-09-17T03:42:28.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:28.609+0000 7fbd92da8640 1 -- 172.21.15.146:0/812492351 wait complete. 2024-09-17T03:42:28.791 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:42:28.793 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:42:33.620 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:42:33.620 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-17T03:42:33.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.747+0000 7ff60239b640 1 -- 172.21.15.146:0/960671782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc0b5ce0 msgr2=0x7ff5fc0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.747+0000 7ff60239b640 1 --2- 172.21.15.146:0/960671782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc0b5ce0 0x7ff5fc0b1320 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0b6120 tx=0x7ff5ec02a560 comp rx=0 tx=0).stop 2024-09-17T03:42:33.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.747+0000 7ff60239b640 1 -- 172.21.15.146:0/960671782 shutdown_connections 2024-09-17T03:42:33.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.747+0000 7ff60239b640 1 --2- 172.21.15.146:0/960671782 >> v2:172.21.15.179:3300/0 conn(0x7ff5fc0b3d30 0x7ff5fc15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.747+0000 7ff60239b640 1 --2- 172.21.15.146:0/960671782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc0b5ce0 0x7ff5fc0b1320 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.747+0000 7ff60239b640 1 -- 172.21.15.146:0/960671782 >> 172.21.15.146:0/960671782 conn(0x7ff5fc0b7b20 msgr2=0x7ff5fc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:33.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.747+0000 7ff60239b640 1 -- 172.21.15.146:0/960671782 shutdown_connections 2024-09-17T03:42:33.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.747+0000 7ff60239b640 1 -- 172.21.15.146:0/960671782 wait complete. 2024-09-17T03:42:33.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.749+0000 7ff60239b640 1 Processor -- start 2024-09-17T03:42:33.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.749+0000 7ff60239b640 1 -- start start 2024-09-17T03:42:33.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.750+0000 7ff60239b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5fc0b5750 0x7ff5fc1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.750+0000 7ff60239b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc0b5ce0 0x7ff5fc156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.750+0000 7ff60239b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc158b10 0x7ff5fc1504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.750+0000 7ff60239b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc15d3f0 con 0x7ff5fc158b10 2024-09-17T03:42:33.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.750+0000 7ff60239b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc15d270 con 0x7ff5fc0b5750 2024-09-17T03:42:33.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.750+0000 7ff60239b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc15d570 con 0x7ff5fc0b5ce0 2024-09-17T03:42:33.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.750+0000 7ff600938640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc158b10 0x7ff5fc1504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff600938640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc158b10 0x7ff5fc1504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49366/0 (socket says 172.21.15.146:49366) 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff600938640 1 -- 172.21.15.146:0/1730299524 learned_addr learned my addr 172.21.15.146:0/1730299524 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5fc0b5750 0x7ff5fc1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff5fb7fe640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc0b5ce0 0x7ff5fc156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff600938640 1 -- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc0b5ce0 msgr2=0x7ff5fc156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff600938640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc0b5ce0 0x7ff5fc156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff600938640 1 -- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5fc0b5750 msgr2=0x7ff5fc1585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff600938640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5fc0b5750 0x7ff5fc1585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff600938640 1 -- 172.21.15.146:0/1730299524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc1f43b0 con 0x7ff5fc158b10 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff5fb7fe640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc0b5ce0 0x7ff5fc156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff600938640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc158b10 0x7ff5fc1504c0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400e990 tx=0x7ff5f400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff5f8ff9640 1 -- 172.21.15.146:0/1730299524 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4004d20 con 0x7ff5fc158b10 2024-09-17T03:42:33.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff5f8ff9640 1 -- 172.21.15.146:0/1730299524 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5f400caa0 con 0x7ff5fc158b10 2024-09-17T03:42:33.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff5f8ff9640 1 -- 172.21.15.146:0/1730299524 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4005020 con 0x7ff5fc158b10 2024-09-17T03:42:33.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff60239b640 1 -- 172.21.15.146:0/1730299524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc1f37a0 con 0x7ff5fc158b10 2024-09-17T03:42:33.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.751+0000 7ff60239b640 1 -- 172.21.15.146:0/1730299524 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5fc1f3d60 con 0x7ff5fc158b10 2024-09-17T03:42:33.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.753+0000 7ff5f8ff9640 1 -- 172.21.15.146:0/1730299524 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff5f40051c0 con 0x7ff5fc158b10 2024-09-17T03:42:33.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.754+0000 7ff5f8ff9640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5e8078b90 0x7ff5e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.754+0000 7ff5f8ff9640 1 -- 172.21.15.146:0/1730299524 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7ff5f409b520 con 0x7ff5fc158b10 2024-09-17T03:42:33.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.754+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5e8078b90 0x7ff5e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.755+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5e8078b90 0x7ff5e807b0a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec033000 tx=0x7ff5ec004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:33.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.755+0000 7ff6093e3740 1 Processor -- start 2024-09-17T03:42:33.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.755+0000 7ff6093e3740 1 -- start start 2024-09-17T03:42:33.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fb88a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f7724d0 0x55ac8fb3e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb69810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff6093e3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ac8fab5a60 con 0x55ac8f79b390 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff6093e3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ac8faa4e90 con 0x55ac8f77a6b0 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff6093e3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ac8faa8ca0 con 0x55ac8f7724d0 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff5fbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fb88a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff5fbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fb88a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49374/0 (socket says 172.21.15.146:49374) 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff5fbfff640 1 -- 172.21.15.146:0/1336001440 learned_addr learned my addr 172.21.15.146:0/1336001440 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff5fb7fe640 1 --2- 172.21.15.146:0/1336001440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f7724d0 0x55ac8fb3e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff600938640 1 --2- 172.21.15.146:0/1336001440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb69810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff5fbfff640 1 -- 172.21.15.146:0/1336001440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f7724d0 msgr2=0x55ac8fb3e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/1336001440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f7724d0 0x55ac8fb3e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff5fbfff640 1 -- 172.21.15.146:0/1336001440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f77a6b0 msgr2=0x55ac8fb69810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/1336001440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb69810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.756+0000 7ff5fbfff640 1 -- 172.21.15.146:0/1336001440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac8f87d7d0 con 0x55ac8f79b390 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.757+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/1336001440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fb88a50 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec000c00 tx=0x7ff5ec03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724799252c11f129 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:33.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.757+0000 7ff5e1ffb640 1 -- 172.21.15.146:0/1336001440 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec035040 con 0x55ac8f79b390 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.757+0000 7ff5e1ffb640 1 -- 172.21.15.146:0/1336001440 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5ec04e070 con 0x55ac8f79b390 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.757+0000 7ff5e1ffb640 1 -- 172.21.15.146:0/1336001440 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec003da0 con 0x55ac8f79b390 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.758+0000 7ff6093e3740 1 -- 172.21.15.146:0/1336001440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 msgr2=0x55ac8fb88a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.758+0000 7ff6093e3740 1 --2- 172.21.15.146:0/1336001440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fb88a50 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec000c00 tx=0x7ff5ec03d000 comp rx=0 tx=0).stop 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.758+0000 7ff6093e3740 1 -- 172.21.15.146:0/1336001440 shutdown_connections 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.758+0000 7ff6093e3740 1 --2- 172.21.15.146:0/1336001440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb69810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.758+0000 7ff6093e3740 1 --2- 172.21.15.146:0/1336001440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f7724d0 0x55ac8fb3e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.758+0000 7ff6093e3740 1 --2- 172.21.15.146:0/1336001440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fb88a50 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.758+0000 7ff6093e3740 1 -- 172.21.15.146:0/1336001440 >> 172.21.15.146:0/1336001440 conn(0x55ac8f78f4e0 msgr2=0x55ac8fb42d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.758+0000 7ff6093e3740 1 -- 172.21.15.146:0/1336001440 shutdown_connections 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.758+0000 7ff6093e3740 1 -- 172.21.15.146:0/1336001440 wait complete. 2024-09-17T03:42:33.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.758+0000 7ff6093e3740 1 -- start start 2024-09-17T03:42:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.759+0000 7ff6093e3740 1 Processor -- start 2024-09-17T03:42:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f79b390 0x55ac8fb9edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff6093e3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ac8f815740 con 0x55ac8f77a6b0 2024-09-17T03:42:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff6093e3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ac8fa4a970 con 0x55ac8f7724d0 2024-09-17T03:42:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff6093e3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ac8fb6b350 con 0x55ac8f79b390 2024-09-17T03:42:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff6093e3740 10 client.0 _ll_register_callbacks cb 0x55ac8fa59780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff5fb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff5fb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49378/0 (socket says 172.21.15.146:49378) 2024-09-17T03:42:33.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff5fb7fe640 1 -- 172.21.15.146:0/2079140274 learned_addr learned my addr 172.21.15.146:0/2079140274 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:33.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff600938640 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f79b390 0x55ac8fb9edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff5fb7fe640 1 -- 172.21.15.146:0/2079140274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f79b390 msgr2=0x55ac8fb9edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:33.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff5fb7fe640 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f79b390 0x55ac8fb9edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff5fb7fe640 1 -- 172.21.15.146:0/2079140274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 msgr2=0x55ac8fb6a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:33.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff5fb7fe640 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff5fb7fe640 1 -- 172.21.15.146:0/2079140274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac8f806970 con 0x55ac8f77a6b0 2024-09-17T03:42:33.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.760+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:33.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff5fb7fe640 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb584e0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000bfb0 tx=0x7ff5f000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1442b399fd5ae24 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:33.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff5daffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff5daffd640 1 -- 172.21.15.146:0/2079140274 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0018030 con 0x55ac8f77a6b0 2024-09-17T03:42:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff5daffd640 1 -- 172.21.15.146:0/2079140274 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7ff5f0004020 con 0x55ac8f77a6b0 2024-09-17T03:42:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff6093e3740 1 -- 172.21.15.146:0/2079140274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5ec04e070 con 0x55ac8f77a6b0 2024-09-17T03:42:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff5daffd640 1 -- 172.21.15.146:0/2079140274 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7ff5f0021050 con 0x55ac8f77a6b0 2024-09-17T03:42:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff6093e3740 10 client.9594 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff6093e3740 1 -- 172.21.15.146:0/2079140274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55ac8f7e46a0 con 0x55ac8f77a6b0 2024-09-17T03:42:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff5daffd640 1 -- 172.21.15.146:0/2079140274 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5ec04e070 con 0x55ac8f77a6b0 2024-09-17T03:42:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff5daffd640 1 -- 172.21.15.146:0/2079140274 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7ff5f0024020 con 0x55ac8f77a6b0 2024-09-17T03:42:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff6093e3740 10 client.9594 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff6093e3740 10 client.9594 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff6093e3740 20 client.9594 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff6093e3740 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ac8f759f60 0x55ac8fb89b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff6093e3740 4 client.9594 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:42:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff6093e3740 1 -- 172.21.15.146:0/2079140274 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac8fab79b0 con 0x55ac8f759f60 2024-09-17T03:42:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.761+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ac8f759f60 0x55ac8fb89b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.762+0000 7ff5daffd640 10 client.9594 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.762+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ac8f759f60 0x55ac8fb89b20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b2d8c03a9d2efe0 server_cookie=f5895ff1c5d25ff3 in_seq=0 out_seq=0 2024-09-17T03:42:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.762+0000 7ff5daffd640 1 -- 172.21.15.146:0/2079140274 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac8fab79b0 con 0x55ac8f759f60 2024-09-17T03:42:33.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.762+0000 7ff5daffd640 10 client.9594 handle_command_reply: tid=0 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.762+0000 7ff6093e3740 1 client.9594 shutdown 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff6093e3740 1 -- 172.21.15.146:0/2079140274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f77a6b0 msgr2=0x55ac8fb584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff6093e3740 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb584e0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000bfb0 tx=0x7ff5f000f670 comp rx=0 tx=0).stop 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff6093e3740 1 -- 172.21.15.146:0/2079140274 shutdown_connections 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff6093e3740 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ac8f759f60 0x55ac8fb89b20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff6093e3740 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f79b390 0x55ac8fb9edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff6093e3740 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb584e0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff5daffd640 0 client.9594 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff6093e3740 1 --2- 172.21.15.146:0/2079140274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff6093e3740 1 -- 172.21.15.146:0/2079140274 >> 172.21.15.146:0/2079140274 conn(0x55ac8f78f4e0 msgr2=0x55ac8fb89330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff6093e3740 1 -- 172.21.15.146:0/2079140274 shutdown_connections 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff6093e3740 1 -- 172.21.15.146:0/2079140274 wait complete. 2024-09-17T03:42:33.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.763+0000 7ff6093e3740 20 client.9594 trim_cache size 0 max 16384 2024-09-17T03:42:33.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.781+0000 7ff6093e3740 1 Processor -- start 2024-09-17T03:42:33.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.781+0000 7ff6093e3740 1 -- start start 2024-09-17T03:42:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.782+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.782+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb6ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.782+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f79b390 0x55ac8fbaeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.782+0000 7ff6093e3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc1fdf80 con 0x55ac8f7724d0 2024-09-17T03:42:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.782+0000 7ff6093e3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc06f2d0 con 0x55ac8f77a6b0 2024-09-17T03:42:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.782+0000 7ff6093e3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc156770 con 0x55ac8f79b390 2024-09-17T03:42:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.782+0000 7ff5fbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.782+0000 7ff5fbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49388/0 (socket says 172.21.15.146:49388) 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.782+0000 7ff5fbfff640 1 -- 172.21.15.146:0/2246193076 learned_addr learned my addr 172.21.15.146:0/2246193076 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.782+0000 7ff600938640 1 --2- 172.21.15.146:0/2246193076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f79b390 0x55ac8fbaeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.782+0000 7ff5fb7fe640 1 --2- 172.21.15.146:0/2246193076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb6ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.783+0000 7ff5fbfff640 1 -- 172.21.15.146:0/2246193076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f79b390 msgr2=0x55ac8fbaeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.783+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/2246193076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f79b390 0x55ac8fbaeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.783+0000 7ff5fbfff640 1 -- 172.21.15.146:0/2246193076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f77a6b0 msgr2=0x55ac8fb6ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.783+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/2246193076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb6ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.783+0000 7ff5fbfff640 1 -- 172.21.15.146:0/2246193076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac8fb400d0 con 0x55ac8f7724d0 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.783+0000 7ff5fb7fe640 1 --2- 172.21.15.146:0/2246193076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb6ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.783+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/2246193076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6b4e0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec02a5a0 tx=0x7ff5ec009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822af89c1da60228 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:33.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.783+0000 7ff5e17fa640 1 -- 172.21.15.146:0/2246193076 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec060020 con 0x55ac8f7724d0 2024-09-17T03:42:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.783+0000 7ff5e17fa640 1 -- 172.21.15.146:0/2246193076 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5ec04e070 con 0x55ac8f7724d0 2024-09-17T03:42:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.783+0000 7ff5e17fa640 1 -- 172.21.15.146:0/2246193076 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec035040 con 0x55ac8f7724d0 2024-09-17T03:42:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.784+0000 7ff6093e3740 1 -- 172.21.15.146:0/2246193076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f7724d0 msgr2=0x55ac8fb6b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.784+0000 7ff6093e3740 1 --2- 172.21.15.146:0/2246193076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6b4e0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec02a5a0 tx=0x7ff5ec009260 comp rx=0 tx=0).stop 2024-09-17T03:42:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.784+0000 7ff6093e3740 1 -- 172.21.15.146:0/2246193076 shutdown_connections 2024-09-17T03:42:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.784+0000 7ff6093e3740 1 --2- 172.21.15.146:0/2246193076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f79b390 0x55ac8fbaeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.784+0000 7ff6093e3740 1 --2- 172.21.15.146:0/2246193076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f77a6b0 0x55ac8fb6ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.784+0000 7ff6093e3740 1 --2- 172.21.15.146:0/2246193076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6b4e0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.784+0000 7ff6093e3740 1 -- 172.21.15.146:0/2246193076 >> 172.21.15.146:0/2246193076 conn(0x55ac8f78f4e0 msgr2=0x55ac8fb7ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.784+0000 7ff6093e3740 1 -- 172.21.15.146:0/2246193076 shutdown_connections 2024-09-17T03:42:33.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.784+0000 7ff6093e3740 1 -- 172.21.15.146:0/2246193076 wait complete. 2024-09-17T03:42:33.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.785+0000 7ff6093e3740 1 -- start start 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.785+0000 7ff6093e3740 1 Processor -- start 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f77a6b0 0x55ac8fb6a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff6093e3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fc0b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff6093e3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc152060 con 0x55ac8f79b390 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff6093e3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ac8fc0c270 con 0x55ac8f7724d0 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff6093e3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ac8fb89390 con 0x55ac8f77a6b0 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff6093e3740 10 client.0 _ll_register_callbacks cb 0x7ff5f000b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff600938640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fc0b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff600938640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fc0b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49402/0 (socket says 172.21.15.146:49402) 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff600938640 1 -- 172.21.15.146:0/4154141878 learned_addr learned my addr 172.21.15.146:0/4154141878 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff5fb7fe640 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f77a6b0 0x55ac8fb6a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.786+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff600938640 1 -- 172.21.15.146:0/4154141878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f77a6b0 msgr2=0x55ac8fb6a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:33.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff600938640 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f77a6b0 0x55ac8fb6a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff600938640 1 -- 172.21.15.146:0/4154141878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 msgr2=0x55ac8fb6a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:33.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff600938640 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff600938640 1 -- 172.21.15.146:0/4154141878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac8fb7fb60 con 0x55ac8f79b390 2024-09-17T03:42:33.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff5fb7fe640 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f77a6b0 0x55ac8fb6a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:33.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:33.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff600938640 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fc0b290 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400c640 tx=0x7ff5f4062cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f36b121627ce4d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:33.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff5daffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff5daffd640 1 -- 172.21.15.146:0/4154141878 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f401f040 con 0x55ac8f79b390 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff5daffd640 1 -- 172.21.15.146:0/4154141878 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7ff5f4062600 con 0x55ac8f79b390 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff6093e3740 1 -- 172.21.15.146:0/4154141878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5ec04e070 con 0x55ac8f79b390 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff5daffd640 1 -- 172.21.15.146:0/4154141878 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) ==== 24+0+0 (secure 0 0 0) 0x7ff5f40633a0 con 0x55ac8f79b390 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff6093e3740 10 client.9600 fetch_fsmap learned FSMap version 104 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff6093e3740 1 -- 172.21.15.146:0/4154141878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) -- 0x55ac8fb80460 con 0x55ac8f79b390 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff5daffd640 1 -- 172.21.15.146:0/4154141878 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5ec04e070 con 0x55ac8f79b390 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff5daffd640 1 -- 172.21.15.146:0/4154141878 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 104) ==== 3502+0+0 (secure 0 0 0) 0x7ff5f404ace0 con 0x55ac8f79b390 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff6093e3740 10 client.9600 fetch_fsmap finished waiting for FSMap version 104 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff6093e3740 10 client.9600 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff6093e3740 20 client.9600 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff6093e3740 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ac8fc08a80 0x55ac8fc0b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff6093e3740 4 client.9600 mds_command: new command op to 9216 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff6093e3740 1 -- 172.21.15.146:0/4154141878 --> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ac8fb81490 con 0x55ac8fc08a80 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.787+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ac8fc08a80 0x55ac8fc0b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff5daffd640 10 client.9600 ms_handle_connect on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff5fbfff640 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ac8fc08a80 0x55ac8fc0b7d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1d76cdc84fd0070 server_cookie=516080bbe7c6c46a in_seq=0 out_seq=0 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff5daffd640 1 -- 172.21.15.146:0/4154141878 <== mds.0 v2:172.21.15.146:6832/955598829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+397 (crc 0 0 0) 0x55ac8fb81490 con 0x55ac8fc08a80 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff5daffd640 10 client.9600 handle_command_reply: tid=0 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff6093e3740 1 client.9600 shutdown 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff6093e3740 1 -- 172.21.15.146:0/4154141878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 msgr2=0x55ac8fc0b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff6093e3740 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fc0b290 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400c640 tx=0x7ff5f4062cf0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff6093e3740 1 -- 172.21.15.146:0/4154141878 shutdown_connections 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff6093e3740 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.146:6832/955598829,v1:172.21.15.146:6834/955598829] conn(0x55ac8fc08a80 0x55ac8fc0b7d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff6093e3740 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac8f79b390 0x55ac8fc0b290 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff6093e3740 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ac8f77a6b0 0x55ac8fb6a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff5daffd640 0 client.9600 ms_handle_reset on v2:172.21.15.146:6832/955598829 2024-09-17T03:42:33.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff6093e3740 1 --2- 172.21.15.146:0/4154141878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ac8f7724d0 0x55ac8fb6a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff6093e3740 1 -- 172.21.15.146:0/4154141878 >> 172.21.15.146:0/4154141878 conn(0x55ac8f78f4e0 msgr2=0x55ac8fb7ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:33.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff6093e3740 1 -- 172.21.15.146:0/4154141878 shutdown_connections 2024-09-17T03:42:33.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.788+0000 7ff6093e3740 1 -- 172.21.15.146:0/4154141878 wait complete. 2024-09-17T03:42:33.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff6093e3740 20 client.9600 trim_cache size 0 max 16384 2024-09-17T03:42:33.795 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:42:33.795 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2024-09-17T03:42:33.795 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {}, 2024-09-17T03:42:33.796 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:42:33.796 INFO:teuthology.orchestra.run.smithi146.stdout: "e831064f-2a65-4323-88f5-8eb02fad2c07": { 2024-09-17T03:42:33.796 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:42:20.849070+0000", 2024-09-17T03:42:33.796 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:42:33.796 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:42:33.796 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:42:33.796 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:42:33.796 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:42:33.796 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:33.796 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:33.796 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:42:33.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 -- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5e8078b90 msgr2=0x7ff5e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5e8078b90 0x7ff5e807b0a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec033000 tx=0x7ff5ec004730 comp rx=0 tx=0).stop 2024-09-17T03:42:33.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 -- 172.21.15.146:0/1730299524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc158b10 msgr2=0x7ff5fc1504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc158b10 0x7ff5fc1504c0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7ff5f400e990 tx=0x7ff5f400ee50 comp rx=0 tx=0).stop 2024-09-17T03:42:33.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 -- 172.21.15.146:0/1730299524 shutdown_connections 2024-09-17T03:42:33.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5e8078b90 0x7ff5e807b0a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc158b10 0x7ff5fc1504c0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc0b5ce0 0x7ff5fc156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 --2- 172.21.15.146:0/1730299524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5fc0b5750 0x7ff5fc1585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 -- 172.21.15.146:0/1730299524 >> 172.21.15.146:0/1730299524 conn(0x7ff5fc0b7b20 msgr2=0x7ff5fc0b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:33.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 -- 172.21.15.146:0/1730299524 shutdown_connections 2024-09-17T03:42:33.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.789+0000 7ff60239b640 1 -- 172.21.15.146:0/1730299524 wait complete. 2024-09-17T03:42:33.800 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:42:33.800 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:33.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.912+0000 7ff995f33640 1 -- 172.21.15.146:0/3326789793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff978004800 msgr2=0x7ff978004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.912+0000 7ff995f33640 1 --2- 172.21.15.146:0/3326789793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff978004800 0x7ff978004c10 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7ff9900749d0 tx=0x7ff978005830 comp rx=0 tx=0).stop 2024-09-17T03:42:33.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.912+0000 7ff98ffff640 1 -- 172.21.15.146:0/3326789793 reap_dead start 2024-09-17T03:42:33.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.912+0000 7ff995f33640 1 -- 172.21.15.146:0/3326789793 shutdown_connections 2024-09-17T03:42:33.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.912+0000 7ff995f33640 1 -- 172.21.15.146:0/3326789793 >> 172.21.15.146:0/3326789793 conn(0x7ff9900b3150 msgr2=0x7ff9900b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:33.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.912+0000 7ff995f33640 1 -- 172.21.15.146:0/3326789793 shutdown_connections 2024-09-17T03:42:33.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.912+0000 7ff995f33640 1 -- 172.21.15.146:0/3326789793 wait complete. 2024-09-17T03:42:33.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.914+0000 7ff995f33640 1 Processor -- start 2024-09-17T03:42:33.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.914+0000 7ff995f33640 1 -- start start 2024-09-17T03:42:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.915+0000 7ff995f33640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff978004800 0x7ff9901419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.915+0000 7ff995f33640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff990142160 0x7ff9901e4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.915+0000 7ff995f33640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99015de90 0x7ff99015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.915+0000 7ff995f33640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff99006f910 con 0x7ff99015de90 2024-09-17T03:42:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.915+0000 7ff995f33640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff99006f790 con 0x7ff990142160 2024-09-17T03:42:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.915+0000 7ff995f33640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff99006fa90 con 0x7ff978004800 2024-09-17T03:42:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff98ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99015de90 0x7ff99015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff98ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99015de90 0x7ff99015e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49410/0 (socket says 172.21.15.146:49410) 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff98ffff640 1 -- 172.21.15.146:0/2417370031 learned_addr learned my addr 172.21.15.146:0/2417370031 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff98f7fe640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff978004800 0x7ff9901419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff98effd640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff990142160 0x7ff9901e4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff98ffff640 1 -- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff978004800 msgr2=0x7ff9901419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff98ffff640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff978004800 0x7ff9901419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff98ffff640 1 -- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff990142160 msgr2=0x7ff9901e4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff98ffff640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff990142160 0x7ff9901e4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff98ffff640 1 -- 172.21.15.146:0/2417370031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99015e7e0 con 0x7ff99015de90 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff98ffff640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99015de90 0x7ff99015e2a0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7ff990073030 tx=0x7ff9880019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff977fff640 1 -- 172.21.15.146:0/2417370031 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988011870 con 0x7ff99015de90 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff977fff640 1 -- 172.21.15.146:0/2417370031 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff988017070 con 0x7ff99015de90 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff995f33640 1 -- 172.21.15.146:0/2417370031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9901f5ad0 con 0x7ff99015de90 2024-09-17T03:42:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff977fff640 1 -- 172.21.15.146:0/2417370031 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988011da0 con 0x7ff99015de90 2024-09-17T03:42:33.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.916+0000 7ff995f33640 1 -- 172.21.15.146:0/2417370031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9901f62b0 con 0x7ff99015de90 2024-09-17T03:42:33.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.917+0000 7ff995f33640 1 -- 172.21.15.146:0/2417370031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9901f5d40 con 0x7ff99015de90 2024-09-17T03:42:33.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.918+0000 7ff977fff640 1 -- 172.21.15.146:0/2417370031 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff98801c460 con 0x7ff99015de90 2024-09-17T03:42:33.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.919+0000 7ff977fff640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff97c078bc0 0x7ff97c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:33.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.919+0000 7ff977fff640 1 -- 172.21.15.146:0/2417370031 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7ff98809b6e0 con 0x7ff99015de90 2024-09-17T03:42:33.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.919+0000 7ff98f7fe640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff97c078bc0 0x7ff97c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:33.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.919+0000 7ff98f7fe640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff97c078bc0 0x7ff97c07b0d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff980009b90 tx=0x7ff980005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:33.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:33.923+0000 7ff977fff640 1 -- 172.21.15.146:0/2417370031 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff99015e7e0 con 0x7ff99015de90 2024-09-17T03:42:34.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.135+0000 7ff995f33640 1 -- 172.21.15.146:0/2417370031 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9900b5680 con 0x7ff99015de90 2024-09-17T03:42:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.136+0000 7ff977fff640 1 -- 172.21.15.146:0/2417370031 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7ff988063aa0 con 0x7ff99015de90 2024-09-17T03:42:34.136 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:34.136 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:34.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 -- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff97c078bc0 msgr2=0x7ff97c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:34.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff97c078bc0 0x7ff97c07b0d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff980009b90 tx=0x7ff980005f90 comp rx=0 tx=0).stop 2024-09-17T03:42:34.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 -- 172.21.15.146:0/2417370031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99015de90 msgr2=0x7ff99015e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:34.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99015de90 0x7ff99015e2a0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7ff990073030 tx=0x7ff9880019b0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 -- 172.21.15.146:0/2417370031 shutdown_connections 2024-09-17T03:42:34.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff97c078bc0 0x7ff97c07b0d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99015de90 0x7ff99015e2a0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff990142160 0x7ff9901e4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 --2- 172.21.15.146:0/2417370031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff978004800 0x7ff9901419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 -- 172.21.15.146:0/2417370031 >> 172.21.15.146:0/2417370031 conn(0x7ff9900b3150 msgr2=0x7ff9900d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:34.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 -- 172.21.15.146:0/2417370031 shutdown_connections 2024-09-17T03:42:34.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.138+0000 7ff995f33640 1 -- 172.21.15.146:0/2417370031 wait complete. 2024-09-17T03:42:34.149 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T03:42:34.150 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:42:34.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.261+0000 7f3a81133640 1 -- 172.21.15.146:0/1666680585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a68003a00 msgr2=0x7f3a68003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:34.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.262+0000 7f3a81133640 1 --2- 172.21.15.146:0/1666680585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a68003a00 0x7f3a68003e70 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00c2e0 tx=0x7f3a68005830 comp rx=0 tx=0).stop 2024-09-17T03:42:34.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.262+0000 7f3a7b59e640 1 -- 172.21.15.146:0/1666680585 reap_dead start 2024-09-17T03:42:34.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.262+0000 7f3a81133640 1 -- 172.21.15.146:0/1666680585 shutdown_connections 2024-09-17T03:42:34.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.262+0000 7f3a81133640 1 -- 172.21.15.146:0/1666680585 >> 172.21.15.146:0/1666680585 conn(0x7f3a7c09ba20 msgr2=0x7f3a7c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:34.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.262+0000 7f3a81133640 1 -- 172.21.15.146:0/1666680585 shutdown_connections 2024-09-17T03:42:34.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.262+0000 7f3a81133640 1 -- 172.21.15.146:0/1666680585 wait complete. 2024-09-17T03:42:34.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.264+0000 7f3a81133640 1 Processor -- start 2024-09-17T03:42:34.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.264+0000 7f3a81133640 1 -- start start 2024-09-17T03:42:34.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.265+0000 7f3a81133640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a68003a00 0x7f3a7c1f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:34.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.265+0000 7f3a81133640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a7c1e1cd0 0x7f3a7c0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.265+0000 7f3a81133640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a7c1e20e0 0x7f3a7c0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.265+0000 7f3a81133640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7c0cdb60 con 0x7f3a68003a00 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.265+0000 7f3a81133640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7c0cd9e0 con 0x7f3a7c1e20e0 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.265+0000 7f3a81133640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7c0cdce0 con 0x7f3a7c1e1cd0 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.265+0000 7f3a7ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a68003a00 0x7f3a7c1f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.265+0000 7f3a7ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a68003a00 0x7f3a7c1f4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49420/0 (socket says 172.21.15.146:49420) 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.265+0000 7f3a7ad9d640 1 -- 172.21.15.146:0/1832691777 learned_addr learned my addr 172.21.15.146:0/1832691777 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.265+0000 7f3a7259c640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a7c1e1cd0 0x7f3a7c0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.265+0000 7f3a7b59e640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a7c1e20e0 0x7f3a7c0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.266+0000 7f3a7ad9d640 1 -- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a7c1e1cd0 msgr2=0x7f3a7c0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.266+0000 7f3a7ad9d640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a7c1e1cd0 0x7f3a7c0b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.266+0000 7f3a7ad9d640 1 -- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a7c1e20e0 msgr2=0x7f3a7c0b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.266+0000 7f3a7ad9d640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a7c1e20e0 0x7f3a7c0b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.266+0000 7f3a7ad9d640 1 -- 172.21.15.146:0/1832691777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7c1f6e00 con 0x7f3a68003a00 2024-09-17T03:42:34.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.266+0000 7f3a7ad9d640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a68003a00 0x7f3a7c1f4000 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00c400 tx=0x7f3a6c006ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:34.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.266+0000 7f3a73fff640 1 -- 172.21.15.146:0/1832691777 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c031040 con 0x7f3a68003a00 2024-09-17T03:42:34.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.266+0000 7f3a73fff640 1 -- 172.21.15.146:0/1832691777 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a6c0065e0 con 0x7f3a68003a00 2024-09-17T03:42:34.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.266+0000 7f3a81133640 1 -- 172.21.15.146:0/1832691777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a7c1f70e0 con 0x7f3a68003a00 2024-09-17T03:42:34.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.266+0000 7f3a73fff640 1 -- 172.21.15.146:0/1832691777 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c003a40 con 0x7f3a68003a00 2024-09-17T03:42:34.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.266+0000 7f3a81133640 1 -- 172.21.15.146:0/1832691777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a7c0c7bd0 con 0x7f3a68003a00 2024-09-17T03:42:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.267+0000 7f3a81133640 1 -- 172.21.15.146:0/1832691777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a7c0cd090 con 0x7f3a68003a00 2024-09-17T03:42:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.268+0000 7f3a73fff640 1 -- 172.21.15.146:0/1832691777 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a6c034070 con 0x7f3a68003a00 2024-09-17T03:42:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.268+0000 7f3a73fff640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078b90 0x7f3a5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.268+0000 7f3a73fff640 1 -- 172.21.15.146:0/1832691777 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f3a6c0bacf0 con 0x7f3a68003a00 2024-09-17T03:42:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.269+0000 7f3a7259c640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078b90 0x7f3a5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:34.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.269+0000 7f3a7259c640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078b90 0x7f3a5c07b0a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c1dfff0 tx=0x7f3a64005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:34.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.273+0000 7f3a73fff640 1 -- 172.21.15.146:0/1832691777 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a6c0bf070 con 0x7f3a68003a00 2024-09-17T03:42:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.514+0000 7f3a81133640 1 -- 172.21.15.146:0/1832691777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3a7c0ced70 con 0x7f3a68003a00 2024-09-17T03:42:34.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.515+0000 7f3a73fff640 1 -- 172.21.15.146:0/1832691777 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1682 (secure 0 0 0) 0x7f3a6c082ae0 con 0x7f3a68003a00 2024-09-17T03:42:34.516 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:34.516 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":599,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076764807,"bytes_used":2588196864,"bytes_avail":770505916416,"bytes_total":773094113280,"write_bytes_sec":13768342,"read_op_per_sec":0,"write_op_per_sec":21},"fsmap":{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9216}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-17T03:42:29.943119+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:42:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 -- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078b90 msgr2=0x7f3a5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078b90 0x7f3a5c07b0a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c1dfff0 tx=0x7f3a64005f90 comp rx=0 tx=0).stop 2024-09-17T03:42:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 -- 172.21.15.146:0/1832691777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a68003a00 msgr2=0x7f3a7c1f4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a68003a00 0x7f3a7c1f4000 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00c400 tx=0x7f3a6c006ce0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 -- 172.21.15.146:0/1832691777 shutdown_connections 2024-09-17T03:42:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3a5c078b90 0x7f3a5c07b0a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3a7c1e20e0 0x7f3a7c0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3a7c1e1cd0 0x7f3a7c0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 --2- 172.21.15.146:0/1832691777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a68003a00 0x7f3a7c1f4000 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 -- 172.21.15.146:0/1832691777 >> 172.21.15.146:0/1832691777 conn(0x7f3a7c09ba20 msgr2=0x7f3a7c0b5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 -- 172.21.15.146:0/1832691777 shutdown_connections 2024-09-17T03:42:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:34.517+0000 7f3a81133640 1 -- 172.21.15.146:0/1832691777 wait complete. 2024-09-17T03:42:34.528 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/scrub_control_test_path]'} 2024-09-17T03:42:35.530 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.657+0000 7f58404ec640 1 -- 172.21.15.146:0/1336223493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003a30 msgr2=0x7f5824003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.657+0000 7f58404ec640 1 --2- 172.21.15.146:0/1336223493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003a30 0x7f5824003ea0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f5834001dc0 tx=0x7f5824005830 comp rx=0 tx=0).stop 2024-09-17T03:42:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.657+0000 7f583ea89640 1 -- 172.21.15.146:0/1336223493 reap_dead start 2024-09-17T03:42:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.657+0000 7f58404ec640 1 -- 172.21.15.146:0/1336223493 shutdown_connections 2024-09-17T03:42:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.657+0000 7f58404ec640 1 -- 172.21.15.146:0/1336223493 >> 172.21.15.146:0/1336223493 conn(0x7f58380b7b20 msgr2=0x7f583809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.657+0000 7f58404ec640 1 -- 172.21.15.146:0/1336223493 shutdown_connections 2024-09-17T03:42:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.657+0000 7f58404ec640 1 -- 172.21.15.146:0/1336223493 wait complete. 2024-09-17T03:42:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.659+0000 7f58404ec640 1 Processor -- start 2024-09-17T03:42:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.659+0000 7f58404ec640 1 -- start start 2024-09-17T03:42:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f58404ec640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003a30 0x7f583815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f58404ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583814e650 0x7f58381f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f58404ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58381f46d0 0x7f58381f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f58404ec640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f58381657b0 con 0x7f5824003a30 2024-09-17T03:42:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f58404ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f583815dcc0 con 0x7f58381f46d0 2024-09-17T03:42:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f58404ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5838165930 con 0x7f583814e650 2024-09-17T03:42:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f583e288640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003a30 0x7f583815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f583e288640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003a30 0x7f583815aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49428/0 (socket says 172.21.15.146:49428) 2024-09-17T03:42:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f583e288640 1 -- 172.21.15.146:0/3047721239 learned_addr learned my addr 172.21.15.146:0/3047721239 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f583e288640 1 -- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583814e650 msgr2=0x7f58381f35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f583e288640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583814e650 0x7f58381f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f583ea89640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58381f46d0 0x7f58381f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f583e288640 1 -- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58381f46d0 msgr2=0x7f58381f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f583e288640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58381f46d0 0x7f58381f4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f583e288640 1 -- 172.21.15.146:0/3047721239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58381f4060 con 0x7f5824003a30 2024-09-17T03:42:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f583e288640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003a30 0x7f583815aa50 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f5834001ee0 tx=0x7f5834003a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f582effd640 1 -- 172.21.15.146:0/3047721239 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5834006440 con 0x7f5824003a30 2024-09-17T03:42:35.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f582effd640 1 -- 172.21.15.146:0/3047721239 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58340065e0 con 0x7f5824003a30 2024-09-17T03:42:35.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f58404ec640 1 -- 172.21.15.146:0/3047721239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58381f4340 con 0x7f5824003a30 2024-09-17T03:42:35.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f582effd640 1 -- 172.21.15.146:0/3047721239 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5834003e40 con 0x7f5824003a30 2024-09-17T03:42:35.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.661+0000 7f58404ec640 1 -- 172.21.15.146:0/3047721239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f583815a530 con 0x7f5824003a30 2024-09-17T03:42:35.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.663+0000 7f58404ec640 1 -- 172.21.15.146:0/3047721239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58380b3620 con 0x7f5824003a30 2024-09-17T03:42:35.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.663+0000 7f582effd640 1 -- 172.21.15.146:0/3047721239 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5834033480 con 0x7f5824003a30 2024-09-17T03:42:35.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.664+0000 7f582effd640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f581c078b90 0x7f581c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:35.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.664+0000 7f582effd640 1 -- 172.21.15.146:0/3047721239 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f58340bb0f0 con 0x7f5824003a30 2024-09-17T03:42:35.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.664+0000 7f583da87640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f581c078b90 0x7f581c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:35.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.665+0000 7f583da87640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f581c078b90 0x7f581c07b0a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f583814b810 tx=0x7f5828001e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.668+0000 7f582effd640 1 -- 172.21.15.146:0/3047721239 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f58340835c0 con 0x7f5824003a30 2024-09-17T03:42:35.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.876+0000 7f58404ec640 1 -- 172.21.15.146:0/3047721239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5838070720 con 0x7f5824003a30 2024-09-17T03:42:35.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.877+0000 7f582effd640 1 -- 172.21.15.146:0/3047721239 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7f5834082ec0 con 0x7f5824003a30 2024-09-17T03:42:35.877 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:35.877 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:35.877 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:35.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 -- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f581c078b90 msgr2=0x7f581c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:35.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f581c078b90 0x7f581c07b0a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f583814b810 tx=0x7f5828001e10 comp rx=0 tx=0).stop 2024-09-17T03:42:35.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 -- 172.21.15.146:0/3047721239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003a30 msgr2=0x7f583815aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:35.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003a30 0x7f583815aa50 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f5834001ee0 tx=0x7f5834003a60 comp rx=0 tx=0).stop 2024-09-17T03:42:35.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 -- 172.21.15.146:0/3047721239 shutdown_connections 2024-09-17T03:42:35.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f581c078b90 0x7f581c07b0a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:35.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58381f46d0 0x7f58381f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:35.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f583814e650 0x7f58381f35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:35.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 --2- 172.21.15.146:0/3047721239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003a30 0x7f583815aa50 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:35.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 -- 172.21.15.146:0/3047721239 >> 172.21.15.146:0/3047721239 conn(0x7f58380b7b20 msgr2=0x7f5838071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:35.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 -- 172.21.15.146:0/3047721239 shutdown_connections 2024-09-17T03:42:35.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:35.879+0000 7f58404ec640 1 -- 172.21.15.146:0/3047721239 wait complete. 2024-09-17T03:42:35.890 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T03:42:35.890 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:42:36.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.002+0000 7ff6f22e5640 1 -- 172.21.15.146:0/155409614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ec0b5ce0 msgr2=0x7ff6ec0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:36.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.002+0000 7ff6f22e5640 1 --2- 172.21.15.146:0/155409614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ec0b5ce0 0x7ff6ec0b1320 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc005fd0 tx=0x7ff6dc02a670 comp rx=0 tx=0).stop 2024-09-17T03:42:36.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.002+0000 7ff6f22e5640 1 -- 172.21.15.146:0/155409614 shutdown_connections 2024-09-17T03:42:36.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.002+0000 7ff6f22e5640 1 --2- 172.21.15.146:0/155409614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ec0b5ce0 0x7ff6ec0b1320 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.002+0000 7ff6f22e5640 1 -- 172.21.15.146:0/155409614 >> 172.21.15.146:0/155409614 conn(0x7ff6ec0b7b20 msgr2=0x7ff6ec09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:36.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.003+0000 7ff6f22e5640 1 -- 172.21.15.146:0/155409614 shutdown_connections 2024-09-17T03:42:36.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.003+0000 7ff6f22e5640 1 -- 172.21.15.146:0/155409614 wait complete. 2024-09-17T03:42:36.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.004+0000 7ff6f22e5640 1 Processor -- start 2024-09-17T03:42:36.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.004+0000 7ff6f22e5640 1 -- start start 2024-09-17T03:42:36.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6f22e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ec0b5750 0x7ff6ec159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:36.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6f22e5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ec0b5ce0 0x7ff6ec158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:36.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6f22e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6ec1f3530 0x7ff6ec1e6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:36.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6f22e5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec15d680 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6f22e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec15d500 con 0x7ff6ec0b5750 2024-09-17T03:42:36.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6f22e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff6ec15d800 con 0x7ff6ec1f3530 2024-09-17T03:42:36.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6eb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ec0b5ce0 0x7ff6ec158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6eb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ec0b5ce0 0x7ff6ec158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49458/0 (socket says 172.21.15.146:49458) 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6eb7fe640 1 -- 172.21.15.146:0/1938367114 learned_addr learned my addr 172.21.15.146:0/1938367114 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6ebfff640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ec0b5750 0x7ff6ec159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6f0882640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6ec1f3530 0x7ff6ec1e6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6eb7fe640 1 -- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6ec1f3530 msgr2=0x7ff6ec1e6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6eb7fe640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6ec1f3530 0x7ff6ec1e6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6eb7fe640 1 -- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ec0b5750 msgr2=0x7ff6ec159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6eb7fe640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ec0b5750 0x7ff6ec159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6eb7fe640 1 -- 172.21.15.146:0/1938367114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec1e51d0 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6ebfff640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ec0b5750 0x7ff6ec159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6eb7fe640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ec0b5ce0 0x7ff6ec158300 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000c3f0 tx=0x7ff6e000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6e8ff9640 1 -- 172.21.15.146:0/1938367114 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0017070 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6e8ff9640 1 -- 172.21.15.146:0/1938367114 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6e00035f0 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6f22e5640 1 -- 172.21.15.146:0/1938367114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec1f3d10 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.006+0000 7ff6e8ff9640 1 -- 172.21.15.146:0/1938367114 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0003a40 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.007+0000 7ff6f22e5640 1 -- 172.21.15.146:0/1938367114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec1f42d0 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.007+0000 7ff6f22e5640 1 -- 172.21.15.146:0/1938367114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ec1f3a80 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.008+0000 7ff6e8ff9640 1 -- 172.21.15.146:0/1938367114 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff6e001a070 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.009+0000 7ff6e8ff9640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6d8078b90 0x7ff6d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:36.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.009+0000 7ff6e8ff9640 1 -- 172.21.15.146:0/1938367114 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7ff6e0099e90 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.009+0000 7ff6ebfff640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6d8078b90 0x7ff6d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:36.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.009+0000 7ff6ebfff640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6d8078b90 0x7ff6d807b0a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc033000 tx=0x7ff6dc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:36.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.013+0000 7ff6e8ff9640 1 -- 172.21.15.146:0/1938367114 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff6ec1e51d0 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.257+0000 7ff6f22e5640 1 -- 172.21.15.146:0/1938367114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff6ec0710a0 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.258+0000 7ff6e8ff9640 1 -- 172.21.15.146:0/1938367114 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1619 (secure 0 0 0) 0x7ff6e0062360 con 0x7ff6ec0b5ce0 2024-09-17T03:42:36.258 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:36.258 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":600,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076764807,"bytes_used":2588196864,"bytes_avail":770505916416,"bytes_total":773094113280,"write_bytes_sec":6954655,"read_op_per_sec":0,"write_op_per_sec":15},"fsmap":{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9216}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-09-17T03:42:35.944795+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:42:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 -- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6d8078b90 msgr2=0x7ff6d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6d8078b90 0x7ff6d807b0a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc033000 tx=0x7ff6dc004730 comp rx=0 tx=0).stop 2024-09-17T03:42:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 -- 172.21.15.146:0/1938367114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ec0b5ce0 msgr2=0x7ff6ec158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ec0b5ce0 0x7ff6ec158300 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000c3f0 tx=0x7ff6e000c8b0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 -- 172.21.15.146:0/1938367114 shutdown_connections 2024-09-17T03:42:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6d8078b90 0x7ff6d807b0a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6ec1f3530 0x7ff6ec1e6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ec0b5ce0 0x7ff6ec158300 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 --2- 172.21.15.146:0/1938367114 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6ec0b5750 0x7ff6ec159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 -- 172.21.15.146:0/1938367114 >> 172.21.15.146:0/1938367114 conn(0x7ff6ec0b7b20 msgr2=0x7ff6ec15b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 -- 172.21.15.146:0/1938367114 shutdown_connections 2024-09-17T03:42:36.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.260+0000 7ff6f22e5640 1 -- 172.21.15.146:0/1938367114 wait complete. 2024-09-17T03:42:36.271 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:42:36.271 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:42:36.272 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:42:36.312 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:42:36.356 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:42:36.356 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:42:36.356 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:42:36.356 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:42:36.372 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:42:36.372 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:42:36.433 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:42:36.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.587+0000 7f6c80c4d640 1 -- 172.21.15.146:0/3548630785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c7c0b3d30 msgr2=0x7f6c7c15caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:36.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.587+0000 7f6c80c4d640 1 --2- 172.21.15.146:0/3548630785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c7c0b3d30 0x7f6c7c15caa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c74005fd0 tx=0x7f6c7402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.587+0000 7f6c80c4d640 1 -- 172.21.15.146:0/3548630785 shutdown_connections 2024-09-17T03:42:36.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.587+0000 7f6c80c4d640 1 --2- 172.21.15.146:0/3548630785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c7c0b3d30 0x7f6c7c15caa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.587+0000 7f6c80c4d640 1 --2- 172.21.15.146:0/3548630785 >> v2:172.21.15.179:3300/0 conn(0x7f6c7c0b5ce0 0x7f6c7c0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.587+0000 7f6c80c4d640 1 -- 172.21.15.146:0/3548630785 >> 172.21.15.146:0/3548630785 conn(0x7f6c7c0b7b20 msgr2=0x7f6c7c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:36.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.587+0000 7f6c80c4d640 1 -- 172.21.15.146:0/3548630785 shutdown_connections 2024-09-17T03:42:36.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.587+0000 7f6c80c4d640 1 -- 172.21.15.146:0/3548630785 wait complete. 2024-09-17T03:42:36.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.589+0000 7f6c80c4d640 1 Processor -- start 2024-09-17T03:42:36.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.589+0000 7f6c80c4d640 1 -- start start 2024-09-17T03:42:36.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.590+0000 7f6c80c4d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c7c0b5750 0x7f6c7c1f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:36.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.590+0000 7f6c80c4d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7c0b5ce0 0x7f6c7c15eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:36.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.590+0000 7f6c80c4d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7c1f6be0 0x7f6c7c1f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:36.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.590+0000 7f6c80c4d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c15d4b0 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.590+0000 7f6c80c4d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c15d330 con 0x7f6c7c1f6be0 2024-09-17T03:42:36.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.590+0000 7f6c80c4d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7c15d630 con 0x7f6c7c0b5750 2024-09-17T03:42:36.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.590+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7c0b5ce0 0x7f6c7c15eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:36.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7c0b5ce0 0x7f6c7c15eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49466/0 (socket says 172.21.15.146:49466) 2024-09-17T03:42:36.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c73fff640 1 -- 172.21.15.146:0/2924661053 learned_addr learned my addr 172.21.15.146:0/2924661053 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:36.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c7a59c640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c7c0b5750 0x7f6c7c1f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c7ad9d640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7c1f6be0 0x7f6c7c1f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c73fff640 1 -- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c7c0b5750 msgr2=0x7f6c7c1f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c73fff640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c7c0b5750 0x7f6c7c1f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c73fff640 1 -- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7c1f6be0 msgr2=0x7f6c7c1f6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c73fff640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7c1f6be0 0x7f6c7c1f6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c73fff640 1 -- 172.21.15.146:0/2924661053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c1f7530 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c73fff640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7c0b5ce0 0x7f6c7c15eca0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400c340 tx=0x7f6c6400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c72ffd640 1 -- 172.21.15.146:0/2924661053 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64011790 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c72ffd640 1 -- 172.21.15.146:0/2924661053 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c64017070 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c72ffd640 1 -- 172.21.15.146:0/2924661053 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64011cc0 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c80c4d640 1 -- 172.21.15.146:0/2924661053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7c1e7810 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.591+0000 7f6c80c4d640 1 -- 172.21.15.146:0/2924661053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7c1e7dd0 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.592+0000 7f6c80c4d640 1 -- 172.21.15.146:0/2924661053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c7c15db50 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.593+0000 7f6c72ffd640 1 -- 172.21.15.146:0/2924661053 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c6401c460 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.594+0000 7f6c72ffd640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c5c078bc0 0x7f6c5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:36.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.594+0000 7f6c72ffd640 1 -- 172.21.15.146:0/2924661053 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f6c6409a7d0 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.594+0000 7f6c7a59c640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c5c078bc0 0x7f6c5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:36.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.595+0000 7f6c7a59c640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c5c078bc0 0x7f6c5c07b0d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0095f0 tx=0x7f6c6c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:36.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.598+0000 7f6c72ffd640 1 -- 172.21.15.146:0/2924661053 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6c7c1f7530 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.784+0000 7f6c80c4d640 1 -- 172.21.15.146:0/2924661053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6c7c15f1e0 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.785+0000 7f6c72ffd640 1 -- 172.21.15.146:0/2924661053 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v143) ==== 80+0+0 (secure 0 0 0) 0x7f6c640626e0 con 0x7f6c7c0b5ce0 2024-09-17T03:42:36.785 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:42:36.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 -- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c5c078bc0 msgr2=0x7f6c5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c5c078bc0 0x7f6c5c07b0d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0095f0 tx=0x7f6c6c005f90 comp rx=0 tx=0).stop 2024-09-17T03:42:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 -- 172.21.15.146:0/2924661053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7c0b5ce0 msgr2=0x7f6c7c15eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7c0b5ce0 0x7f6c7c15eca0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400c340 tx=0x7f6c6400c800 comp rx=0 tx=0).stop 2024-09-17T03:42:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 -- 172.21.15.146:0/2924661053 shutdown_connections 2024-09-17T03:42:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c5c078bc0 0x7f6c5c07b0d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c7c1f6be0 0x7f6c7c1f6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c7c0b5ce0 0x7f6c7c15eca0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 --2- 172.21.15.146:0/2924661053 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c7c0b5750 0x7f6c7c1f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 -- 172.21.15.146:0/2924661053 >> 172.21.15.146:0/2924661053 conn(0x7f6c7c0b7b20 msgr2=0x7f6c7c1572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 -- 172.21.15.146:0/2924661053 shutdown_connections 2024-09-17T03:42:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:36.787+0000 7f6c80c4d640 1 -- 172.21.15.146:0/2924661053 wait complete. 2024-09-17T03:42:36.798 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:42:36.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:36.798 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:42:37.431 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:42:37.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:37.432 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:42:37.447 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:42:37.447 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:42:37.447 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:42:37.465 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:42:37.465 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:42:37.465 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:42:37.466 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:42:37.502 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:42:37.503 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:42:37.503 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:42:37.503 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:42:37.522 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:42:37.522 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:37.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.655+0000 7f58d7369640 1 -- 172.21.15.146:0/631095067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d00cf370 msgr2=0x7f58d006ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:37.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.655+0000 7f58d7369640 1 --2- 172.21.15.146:0/631095067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d00cf370 0x7f58d006ed30 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f58c0005fd0 tx=0x7f58c002a540 comp rx=0 tx=0).stop 2024-09-17T03:42:37.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.655+0000 7f58d7369640 1 -- 172.21.15.146:0/631095067 shutdown_connections 2024-09-17T03:42:37.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.655+0000 7f58d7369640 1 --2- 172.21.15.146:0/631095067 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d006f270 0x7f58d00d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:37.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.655+0000 7f58d7369640 1 --2- 172.21.15.146:0/631095067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d00cf370 0x7f58d006ed30 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:37.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.655+0000 7f58d7369640 1 -- 172.21.15.146:0/631095067 >> 172.21.15.146:0/631095067 conn(0x7f58d00d4be0 msgr2=0x7f58d00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:37.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.655+0000 7f58d7369640 1 -- 172.21.15.146:0/631095067 shutdown_connections 2024-09-17T03:42:37.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.655+0000 7f58d7369640 1 -- 172.21.15.146:0/631095067 wait complete. 2024-09-17T03:42:37.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.657+0000 7f58d7369640 1 Processor -- start 2024-09-17T03:42:37.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.657+0000 7f58d7369640 1 -- start start 2024-09-17T03:42:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.658+0000 7f58d7369640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d006f270 0x7f58d0156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.658+0000 7f58d7369640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d00b3870 0x7f58d014dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.658+0000 7f58d7369640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d00cf370 0x7f58d0156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.658+0000 7f58d7369640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f58d00d3ae0 con 0x7f58d00b3870 2024-09-17T03:42:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.658+0000 7f58d7369640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f58d00d3960 con 0x7f58d00cf370 2024-09-17T03:42:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.658+0000 7f58d7369640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f58d00d3c60 con 0x7f58d006f270 2024-09-17T03:42:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d4904640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d00b3870 0x7f58d014dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d4904640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d00b3870 0x7f58d014dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47236/0 (socket says 172.21.15.146:47236) 2024-09-17T03:42:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d4904640 1 -- 172.21.15.146:0/219368150 learned_addr learned my addr 172.21.15.146:0/219368150 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d5105640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d006f270 0x7f58d0156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d5906640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d00cf370 0x7f58d0156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d4904640 1 -- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d006f270 msgr2=0x7f58d0156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d4904640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d006f270 0x7f58d0156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d4904640 1 -- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d00cf370 msgr2=0x7f58d0156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d4904640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d00cf370 0x7f58d0156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d4904640 1 -- 172.21.15.146:0/219368150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d00b63a0 con 0x7f58d00b3870 2024-09-17T03:42:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d4904640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d00b3870 0x7f58d014dc90 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f58c0006010 tx=0x7f58c00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58c5ffb640 1 -- 172.21.15.146:0/219368150 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c003e030 con 0x7f58d00b3870 2024-09-17T03:42:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58c5ffb640 1 -- 172.21.15.146:0/219368150 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58c0003d90 con 0x7f58d00b3870 2024-09-17T03:42:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58d7369640 1 -- 172.21.15.146:0/219368150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d00b6680 con 0x7f58d00b3870 2024-09-17T03:42:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.659+0000 7f58c5ffb640 1 -- 172.21.15.146:0/219368150 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c0035040 con 0x7f58d00b3870 2024-09-17T03:42:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.660+0000 7f58d7369640 1 -- 172.21.15.146:0/219368150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d00b6c40 con 0x7f58d00b3870 2024-09-17T03:42:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.660+0000 7f58d7369640 1 -- 172.21.15.146:0/219368150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d00b6110 con 0x7f58d00b3870 2024-09-17T03:42:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.661+0000 7f58c5ffb640 1 -- 172.21.15.146:0/219368150 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f58c0041030 con 0x7f58d00b3870 2024-09-17T03:42:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.662+0000 7f58c5ffb640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f58b4078bc0 0x7f58b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.662+0000 7f58c5ffb640 1 -- 172.21.15.146:0/219368150 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f58c00bb330 con 0x7f58d00b3870 2024-09-17T03:42:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.662+0000 7f58d5105640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f58b4078bc0 0x7f58b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:37.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.662+0000 7f58d5105640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f58b4078bc0 0x7f58b407b0d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f58cc001720 tx=0x7f58cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:37.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.666+0000 7f58c5ffb640 1 -- 172.21.15.146:0/219368150 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f58c00831b0 con 0x7f58d00b3870 2024-09-17T03:42:37.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.879+0000 7f58d7369640 1 -- 172.21.15.146:0/219368150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58d00767e0 con 0x7f58d00b3870 2024-09-17T03:42:37.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.880+0000 7f58c5ffb640 1 -- 172.21.15.146:0/219368150 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7f58d00767e0 con 0x7f58d00b3870 2024-09-17T03:42:37.880 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:37.880 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:37.881 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:37.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 -- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f58b4078bc0 msgr2=0x7f58b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:37.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f58b4078bc0 0x7f58b407b0d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f58cc001720 tx=0x7f58cc009040 comp rx=0 tx=0).stop 2024-09-17T03:42:37.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 -- 172.21.15.146:0/219368150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d00b3870 msgr2=0x7f58d014dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:37.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d00b3870 0x7f58d014dc90 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f58c0006010 tx=0x7f58c00038a0 comp rx=0 tx=0).stop 2024-09-17T03:42:37.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 -- 172.21.15.146:0/219368150 shutdown_connections 2024-09-17T03:42:37.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f58b4078bc0 0x7f58b407b0d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:37.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58d00cf370 0x7f58d0156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:37.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58d00b3870 0x7f58d014dc90 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:37.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 --2- 172.21.15.146:0/219368150 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f58d006f270 0x7f58d0156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:37.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 -- 172.21.15.146:0/219368150 >> 172.21.15.146:0/219368150 conn(0x7f58d00d4be0 msgr2=0x7f58d01620f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:37.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 -- 172.21.15.146:0/219368150 shutdown_connections 2024-09-17T03:42:37.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:37.882+0000 7f58d7369640 1 -- 172.21.15.146:0/219368150 wait complete. 2024-09-17T03:42:37.894 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:38.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.007+0000 7f5a5007f640 1 -- 172.21.15.146:0/427185974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4815c8e0 msgr2=0x7f5a4806f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.007+0000 7f5a5007f640 1 --2- 172.21.15.146:0/427185974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4815c8e0 0x7f5a4806f580 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f5a4815bd20 tx=0x7f5a4402a560 comp rx=0 tx=0).stop 2024-09-17T03:42:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.007+0000 7f5a5007f640 1 -- 172.21.15.146:0/427185974 shutdown_connections 2024-09-17T03:42:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.007+0000 7f5a5007f640 1 --2- 172.21.15.146:0/427185974 >> v2:172.21.15.179:3300/0 conn(0x7f5a480cd840 0x7f5a480b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.007+0000 7f5a5007f640 1 --2- 172.21.15.146:0/427185974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4815c8e0 0x7f5a4806f580 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.007+0000 7f5a5007f640 1 -- 172.21.15.146:0/427185974 >> 172.21.15.146:0/427185974 conn(0x7f5a480b3150 msgr2=0x7f5a480b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.007+0000 7f5a5007f640 1 -- 172.21.15.146:0/427185974 shutdown_connections 2024-09-17T03:42:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.007+0000 7f5a5007f640 1 -- 172.21.15.146:0/427185974 wait complete. 2024-09-17T03:42:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.009+0000 7f5a5007f640 1 Processor -- start 2024-09-17T03:42:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.009+0000 7f5a5007f640 1 -- start start 2024-09-17T03:42:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a5007f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480cd840 0x7f5a481532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a5007f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a480cdc50 0x7f5a4814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a5007f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4815c8e0 0x7f5a4814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a5007f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48073580 con 0x7f5a4815c8e0 2024-09-17T03:42:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a5007f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5a480b5e50 con 0x7f5a480cdc50 2024-09-17T03:42:38.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a5007f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5a48073700 con 0x7f5a480cd840 2024-09-17T03:42:38.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a4e61c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4815c8e0 0x7f5a4814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:38.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a4e61c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4815c8e0 0x7f5a4814b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47260/0 (socket says 172.21.15.146:47260) 2024-09-17T03:42:38.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a4e61c640 1 -- 172.21.15.146:0/4220698433 learned_addr learned my addr 172.21.15.146:0/4220698433 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:38.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a4d61a640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a480cdc50 0x7f5a4814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a4de1b640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480cd840 0x7f5a481532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a4e61c640 1 -- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480cd840 msgr2=0x7f5a481532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a4e61c640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480cd840 0x7f5a481532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a4e61c640 1 -- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a480cdc50 msgr2=0x7f5a4814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.010+0000 7f5a4e61c640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a480cdc50 0x7f5a4814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.011+0000 7f5a4e61c640 1 -- 172.21.15.146:0/4220698433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4814c470 con 0x7f5a4815c8e0 2024-09-17T03:42:38.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.011+0000 7f5a4e61c640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4815c8e0 0x7f5a4814b060 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000c760 tx=0x7f5a4000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:38.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.011+0000 7f5a3e7fc640 1 -- 172.21.15.146:0/4220698433 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40003b70 con 0x7f5a4815c8e0 2024-09-17T03:42:38.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.011+0000 7f5a3e7fc640 1 -- 172.21.15.146:0/4220698433 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a40003d10 con 0x7f5a4815c8e0 2024-09-17T03:42:38.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.011+0000 7f5a3e7fc640 1 -- 172.21.15.146:0/4220698433 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40005330 con 0x7f5a4815c8e0 2024-09-17T03:42:38.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.011+0000 7f5a5007f640 1 -- 172.21.15.146:0/4220698433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a48146e60 con 0x7f5a4815c8e0 2024-09-17T03:42:38.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.011+0000 7f5a5007f640 1 -- 172.21.15.146:0/4220698433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4814beb0 con 0x7f5a4815c8e0 2024-09-17T03:42:38.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.012+0000 7f5a5007f640 1 -- 172.21.15.146:0/4220698433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a48073b80 con 0x7f5a4815c8e0 2024-09-17T03:42:38.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.013+0000 7f5a3e7fc640 1 -- 172.21.15.146:0/4220698433 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a400054d0 con 0x7f5a4815c8e0 2024-09-17T03:42:38.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.013+0000 7f5a3e7fc640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a2c078b90 0x7f5a2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.013+0000 7f5a3e7fc640 1 -- 172.21.15.146:0/4220698433 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f5a4009aa00 con 0x7f5a4815c8e0 2024-09-17T03:42:38.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.013+0000 7f5a4de1b640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a2c078b90 0x7f5a2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:38.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.014+0000 7f5a4de1b640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a2c078b90 0x7f5a2c07b0a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5a44033000 tx=0x7f5a44004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:38.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.017+0000 7f5a3e7fc640 1 -- 172.21.15.146:0/4220698433 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5a40062800 con 0x7f5a4815c8e0 2024-09-17T03:42:38.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.230+0000 7f5a5007f640 1 -- 172.21.15.146:0/4220698433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a48149780 con 0x7f5a4815c8e0 2024-09-17T03:42:38.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.230+0000 7f5a3e7fc640 1 -- 172.21.15.146:0/4220698433 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7f5a40067230 con 0x7f5a4815c8e0 2024-09-17T03:42:38.231 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:38.231 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:38.232 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:38.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 -- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a2c078b90 msgr2=0x7f5a2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a2c078b90 0x7f5a2c07b0a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5a44033000 tx=0x7f5a44004730 comp rx=0 tx=0).stop 2024-09-17T03:42:38.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 -- 172.21.15.146:0/4220698433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4815c8e0 msgr2=0x7f5a4814b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4815c8e0 0x7f5a4814b060 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000c760 tx=0x7f5a4000cb60 comp rx=0 tx=0).stop 2024-09-17T03:42:38.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 -- 172.21.15.146:0/4220698433 shutdown_connections 2024-09-17T03:42:38.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a2c078b90 0x7f5a2c07b0a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4815c8e0 0x7f5a4814b060 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a480cdc50 0x7f5a4814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 --2- 172.21.15.146:0/4220698433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a480cd840 0x7f5a481532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 -- 172.21.15.146:0/4220698433 >> 172.21.15.146:0/4220698433 conn(0x7f5a480b3150 msgr2=0x7f5a48070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:38.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 -- 172.21.15.146:0/4220698433 shutdown_connections 2024-09-17T03:42:38.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.232+0000 7f5a5007f640 1 -- 172.21.15.146:0/4220698433 wait complete. 2024-09-17T03:42:38.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:42:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.358+0000 7f1819e71640 1 -- 172.21.15.146:0/547543755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18140cf370 msgr2=0x7f181406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.358+0000 7f1819e71640 1 --2- 172.21.15.146:0/547543755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18140cf370 0x7f181406ed30 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f18140cf110 tx=0x7f17fc02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.358+0000 7f1819e71640 1 -- 172.21.15.146:0/547543755 shutdown_connections 2024-09-17T03:42:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.358+0000 7f1819e71640 1 --2- 172.21.15.146:0/547543755 >> v2:172.21.15.179:3300/0 conn(0x7f181406f270 0x7f18140d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.358+0000 7f1819e71640 1 --2- 172.21.15.146:0/547543755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18140cf370 0x7f181406ed30 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.358+0000 7f1819e71640 1 -- 172.21.15.146:0/547543755 >> 172.21.15.146:0/547543755 conn(0x7f18140d4be0 msgr2=0x7f18140d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.358+0000 7f1819e71640 1 -- 172.21.15.146:0/547543755 shutdown_connections 2024-09-17T03:42:38.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.358+0000 7f1819e71640 1 -- 172.21.15.146:0/547543755 wait complete. 2024-09-17T03:42:38.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.360+0000 7f1819e71640 1 Processor -- start 2024-09-17T03:42:38.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.360+0000 7f1819e71640 1 -- start start 2024-09-17T03:42:38.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1819e71640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f181406f270 0x7f181414a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1819e71640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18140b3870 0x7f18140cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1819e71640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18140cf370 0x7f18140b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1819e71640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f18140d3a60 con 0x7f18140cf370 2024-09-17T03:42:38.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1819e71640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f18140d38e0 con 0x7f18140b3870 2024-09-17T03:42:38.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1819e71640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f18140d3be0 con 0x7f181406f270 2024-09-17T03:42:38.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1813fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18140cf370 0x7f18140b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:38.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1813fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18140cf370 0x7f18140b6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47280/0 (socket says 172.21.15.146:47280) 2024-09-17T03:42:38.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1813fff640 1 -- 172.21.15.146:0/1691490271 learned_addr learned my addr 172.21.15.146:0/1691490271 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:38.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1812ffd640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18140b3870 0x7f18140cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:38.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1813fff640 1 -- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f181406f270 msgr2=0x7f181414a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1813fff640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f181406f270 0x7f181414a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1813fff640 1 -- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18140b3870 msgr2=0x7f18140cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1813fff640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18140b3870 0x7f18140cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1813fff640 1 -- 172.21.15.146:0/1691490271 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18140cbde0 con 0x7f18140cf370 2024-09-17T03:42:38.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1812ffd640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18140b3870 0x7f18140cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:38.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1813fff640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18140cf370 0x7f18140b6b90 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f180c00c920 tx=0x7f180c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:38.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f180bfff640 1 -- 172.21.15.146:0/1691490271 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c007bb0 con 0x7f18140cf370 2024-09-17T03:42:38.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f180bfff640 1 -- 172.21.15.146:0/1691490271 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f180c007e40 con 0x7f18140cf370 2024-09-17T03:42:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1819e71640 1 -- 172.21.15.146:0/1691490271 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18140b70d0 con 0x7f18140cf370 2024-09-17T03:42:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f180bfff640 1 -- 172.21.15.146:0/1691490271 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c005280 con 0x7f18140cf370 2024-09-17T03:42:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.362+0000 7f1819e71640 1 -- 172.21.15.146:0/1691490271 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181414b6f0 con 0x7f18140cf370 2024-09-17T03:42:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.363+0000 7f1819e71640 1 -- 172.21.15.146:0/1691490271 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18140d3190 con 0x7f18140cf370 2024-09-17T03:42:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.364+0000 7f180bfff640 1 -- 172.21.15.146:0/1691490271 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f180c005420 con 0x7f18140cf370 2024-09-17T03:42:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.365+0000 7f180bfff640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f17f4078bc0 0x7f17f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.365+0000 7f180bfff640 1 -- 172.21.15.146:0/1691490271 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f180c09b080 con 0x7f18140cf370 2024-09-17T03:42:38.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.365+0000 7f18137fe640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f17f4078bc0 0x7f17f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:38.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.365+0000 7f18137fe640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f17f4078bc0 0x7f17f407b0d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f180400ab90 tx=0x7f1804009230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:38.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.369+0000 7f180bfff640 1 -- 172.21.15.146:0/1691490271 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f180c014030 con 0x7f18140cf370 2024-09-17T03:42:38.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.545+0000 7f1819e71640 1 -- 172.21.15.146:0/1691490271 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18140d2bd0 con 0x7f18140cf370 2024-09-17T03:42:38.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.546+0000 7f180bfff640 1 -- 172.21.15.146:0/1691490271 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+16787 (secure 0 0 0) 0x7f180c063550 con 0x7f18140cf370 2024-09-17T03:42:38.547 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:38.547 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":143,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:41:59.765590+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:41:55.777474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T03:41:57.096388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:42:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 -- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f17f4078bc0 msgr2=0x7f17f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f17f4078bc0 0x7f17f407b0d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f180400ab90 tx=0x7f1804009230 comp rx=0 tx=0).stop 2024-09-17T03:42:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 -- 172.21.15.146:0/1691490271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18140cf370 msgr2=0x7f18140b6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18140cf370 0x7f18140b6b90 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f180c00c920 tx=0x7f180c00cde0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 -- 172.21.15.146:0/1691490271 shutdown_connections 2024-09-17T03:42:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f17f4078bc0 0x7f17f407b0d0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18140cf370 0x7f18140b6b90 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f18140b3870 0x7f18140cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 --2- 172.21.15.146:0/1691490271 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f181406f270 0x7f181414a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 -- 172.21.15.146:0/1691490271 >> 172.21.15.146:0/1691490271 conn(0x7f18140d4be0 msgr2=0x7f18140b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 -- 172.21.15.146:0/1691490271 shutdown_connections 2024-09-17T03:42:38.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.549+0000 7f1819e71640 1 -- 172.21.15.146:0/1691490271 wait complete. 2024-09-17T03:42:38.561 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:42:38.561 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:38.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.673+0000 7f51e7ede640 1 -- 172.21.15.146:0/1892614311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e006e870 msgr2=0x7f51e0151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.673+0000 7f51e7ede640 1 --2- 172.21.15.146:0/1892614311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e006e870 0x7f51e0151ee0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009830 tx=0x7f51d802a480 comp rx=0 tx=0).stop 2024-09-17T03:42:38.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.673+0000 7f51e7ede640 1 -- 172.21.15.146:0/1892614311 shutdown_connections 2024-09-17T03:42:38.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.673+0000 7f51e7ede640 1 --2- 172.21.15.146:0/1892614311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51e00b3830 0x7f51e00b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.673+0000 7f51e7ede640 1 --2- 172.21.15.146:0/1892614311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e006e870 0x7f51e0151ee0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.673+0000 7f51e7ede640 1 -- 172.21.15.146:0/1892614311 >> 172.21.15.146:0/1892614311 conn(0x7f51e00b2950 msgr2=0x7f51e00b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:38.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.673+0000 7f51e7ede640 1 -- 172.21.15.146:0/1892614311 shutdown_connections 2024-09-17T03:42:38.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.673+0000 7f51e7ede640 1 -- 172.21.15.146:0/1892614311 wait complete. 2024-09-17T03:42:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.675+0000 7f51e7ede640 1 Processor -- start 2024-09-17T03:42:38.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.675+0000 7f51e7ede640 1 -- start start 2024-09-17T03:42:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.676+0000 7f51e7ede640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51e006e870 0x7f51e0143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.676+0000 7f51e7ede640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e00af890 0x7f51e01f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.676+0000 7f51e7ede640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e00b3830 0x7f51e01f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.676+0000 7f51e7ede640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f51e00d1150 con 0x7f51e00b3830 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.676+0000 7f51e7ede640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f51e00d0fd0 con 0x7f51e00af890 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.676+0000 7f51e7ede640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f51e00d12d0 con 0x7f51e006e870 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.676+0000 7f51e647b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e00b3830 0x7f51e01f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.676+0000 7f51e647b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e00b3830 0x7f51e01f4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47306/0 (socket says 172.21.15.146:47306) 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.676+0000 7f51e647b640 1 -- 172.21.15.146:0/3121663667 learned_addr learned my addr 172.21.15.146:0/3121663667 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.676+0000 7f51e5c7a640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51e006e870 0x7f51e0143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.676+0000 7f51e5479640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e00af890 0x7f51e01f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.677+0000 7f51e647b640 1 -- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51e006e870 msgr2=0x7f51e0143c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.677+0000 7f51e647b640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51e006e870 0x7f51e0143c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.677+0000 7f51e647b640 1 -- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e00af890 msgr2=0x7f51e01f0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.677+0000 7f51e647b640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e00af890 0x7f51e01f0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.677+0000 7f51e647b640 1 -- 172.21.15.146:0/3121663667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e0157570 con 0x7f51e00b3830 2024-09-17T03:42:38.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.677+0000 7f51e647b640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e00b3830 0x7f51e01f4a30 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00fa70 tx=0x7f51dc00ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:38.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.677+0000 7f51d67fc640 1 -- 172.21.15.146:0/3121663667 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00dc90 con 0x7f51e00b3830 2024-09-17T03:42:38.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.677+0000 7f51d67fc640 1 -- 172.21.15.146:0/3121663667 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51dc004b20 con 0x7f51e00b3830 2024-09-17T03:42:38.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.677+0000 7f51e7ede640 1 -- 172.21.15.146:0/3121663667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e0157810 con 0x7f51e00b3830 2024-09-17T03:42:38.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.677+0000 7f51d67fc640 1 -- 172.21.15.146:0/3121663667 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc005020 con 0x7f51e00b3830 2024-09-17T03:42:38.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.677+0000 7f51e7ede640 1 -- 172.21.15.146:0/3121663667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e0152ee0 con 0x7f51e00b3830 2024-09-17T03:42:38.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.678+0000 7f51e7ede640 1 -- 172.21.15.146:0/3121663667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e0153140 con 0x7f51e00b3830 2024-09-17T03:42:38.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.679+0000 7f51d67fc640 1 -- 172.21.15.146:0/3121663667 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f51dc0051c0 con 0x7f51e00b3830 2024-09-17T03:42:38.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.679+0000 7f51d67fc640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f51c4078b90 0x7f51c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:38.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.679+0000 7f51d67fc640 1 -- 172.21.15.146:0/3121663667 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7f51dc09bec0 con 0x7f51e00b3830 2024-09-17T03:42:38.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.680+0000 7f51e5c7a640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f51c4078b90 0x7f51c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:38.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.680+0000 7f51e5c7a640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f51c4078b90 0x7f51c407b0a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f51d8034000 tx=0x7f51d8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:38.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.684+0000 7f51d67fc640 1 -- 172.21.15.146:0/3121663667 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f51dc063dd0 con 0x7f51e00b3830 2024-09-17T03:42:38.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.899+0000 7f51e7ede640 1 -- 172.21.15.146:0/3121663667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51e0151ee0 con 0x7f51e00b3830 2024-09-17T03:42:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.900+0000 7f51d67fc640 1 -- 172.21.15.146:0/3121663667 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7f51dc068800 con 0x7f51e00b3830 2024-09-17T03:42:38.900 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:38.900 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:38.901 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 -- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f51c4078b90 msgr2=0x7f51c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f51c4078b90 0x7f51c407b0a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f51d8034000 tx=0x7f51d8004730 comp rx=0 tx=0).stop 2024-09-17T03:42:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 -- 172.21.15.146:0/3121663667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e00b3830 msgr2=0x7f51e01f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e00b3830 0x7f51e01f4a30 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00fa70 tx=0x7f51dc00ff30 comp rx=0 tx=0).stop 2024-09-17T03:42:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 -- 172.21.15.146:0/3121663667 shutdown_connections 2024-09-17T03:42:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f51c4078b90 0x7f51c407b0a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51e00b3830 0x7f51e01f4a30 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51e00af890 0x7f51e01f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 --2- 172.21.15.146:0/3121663667 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51e006e870 0x7f51e0143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:38.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 -- 172.21.15.146:0/3121663667 >> 172.21.15.146:0/3121663667 conn(0x7f51e00b2950 msgr2=0x7f51e00b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:38.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 -- 172.21.15.146:0/3121663667 shutdown_connections 2024-09-17T03:42:38.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:38.903+0000 7f51e7ede640 1 -- 172.21.15.146:0/3121663667 wait complete. 2024-09-17T03:42:38.915 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:39.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.027+0000 7fe27b64a640 1 -- 172.21.15.146:0/390049976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740cf370 msgr2=0x7fe27406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.027+0000 7fe27b64a640 1 --2- 172.21.15.146:0/390049976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740cf370 0x7fe27406ed30 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fe264005fd0 tx=0x7fe26402a540 comp rx=0 tx=0).stop 2024-09-17T03:42:39.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.027+0000 7fe27b64a640 1 -- 172.21.15.146:0/390049976 shutdown_connections 2024-09-17T03:42:39.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.027+0000 7fe27b64a640 1 --2- 172.21.15.146:0/390049976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740cf370 0x7fe27406ed30 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.027+0000 7fe27b64a640 1 -- 172.21.15.146:0/390049976 >> 172.21.15.146:0/390049976 conn(0x7fe2740d4be0 msgr2=0x7fe2740d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:39.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.027+0000 7fe27b64a640 1 -- 172.21.15.146:0/390049976 shutdown_connections 2024-09-17T03:42:39.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.027+0000 7fe27b64a640 1 -- 172.21.15.146:0/390049976 wait complete. 2024-09-17T03:42:39.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.029+0000 7fe27b64a640 1 Processor -- start 2024-09-17T03:42:39.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.029+0000 7fe27b64a640 1 -- start start 2024-09-17T03:42:39.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.030+0000 7fe27b64a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe27406f270 0x7fe27414d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.030+0000 7fe27b64a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740b3870 0x7fe2741500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.030+0000 7fe27b64a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2740cf370 0x7fe274150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.030+0000 7fe27b64a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe2740d3cb0 con 0x7fe2740b3870 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.030+0000 7fe27b64a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe2740d3b30 con 0x7fe27406f270 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.030+0000 7fe27b64a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe2740d3e30 con 0x7fe2740cf370 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.030+0000 7fe278be5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740b3870 0x7fe2741500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe278be5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740b3870 0x7fe2741500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47320/0 (socket says 172.21.15.146:47320) 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe278be5640 1 -- 172.21.15.146:0/2692972521 learned_addr learned my addr 172.21.15.146:0/2692972521 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe279be7640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2740cf370 0x7fe274150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe2793e6640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe27406f270 0x7fe27414d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe278be5640 1 -- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2740cf370 msgr2=0x7fe274150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe278be5640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2740cf370 0x7fe274150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe278be5640 1 -- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe27406f270 msgr2=0x7fe27414d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe278be5640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe27406f270 0x7fe27414d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe278be5640 1 -- 172.21.15.146:0/2692972521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe27415d400 con 0x7fe2740b3870 2024-09-17T03:42:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe278be5640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740b3870 0x7fe2741500d0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fe264034040 tx=0x7fe2640039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe269ffb640 1 -- 172.21.15.146:0/2692972521 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26403e030 con 0x7fe2740b3870 2024-09-17T03:42:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe269ffb640 1 -- 172.21.15.146:0/2692972521 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2640047a0 con 0x7fe2740b3870 2024-09-17T03:42:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe27b64a640 1 -- 172.21.15.146:0/2692972521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2740ab360 con 0x7fe2740b3870 2024-09-17T03:42:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe269ffb640 1 -- 172.21.15.146:0/2692972521 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264035040 con 0x7fe2740b3870 2024-09-17T03:42:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.031+0000 7fe27b64a640 1 -- 172.21.15.146:0/2692972521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2741f6870 con 0x7fe2740b3870 2024-09-17T03:42:39.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.033+0000 7fe27b64a640 1 -- 172.21.15.146:0/2692972521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2741f6b50 con 0x7fe2740b3870 2024-09-17T03:42:39.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.033+0000 7fe269ffb640 1 -- 172.21.15.146:0/2692972521 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe264041030 con 0x7fe2740b3870 2024-09-17T03:42:39.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.034+0000 7fe269ffb640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe258078b90 0x7fe25807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.034+0000 7fe269ffb640 1 -- 172.21.15.146:0/2692972521 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fe2640bb520 con 0x7fe2740b3870 2024-09-17T03:42:39.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.034+0000 7fe2793e6640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe258078b90 0x7fe25807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.035+0000 7fe2793e6640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe258078b90 0x7fe25807b0a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe270000f60 tx=0x7fe270009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:39.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.038+0000 7fe269ffb640 1 -- 172.21.15.146:0/2692972521 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe2640833a0 con 0x7fe2740b3870 2024-09-17T03:42:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.250+0000 7fe27b64a640 1 -- 172.21.15.146:0/2692972521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2740d42d0 con 0x7fe2740b3870 2024-09-17T03:42:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.250+0000 7fe269ffb640 1 -- 172.21.15.146:0/2692972521 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+5236 (secure 0 0 0) 0x7fe264087dd0 con 0x7fe2740b3870 2024-09-17T03:42:39.251 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:39.251 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":104,"btime":"2024-09-17T03:42:01:788502+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:41:58.134780+0000","modified":"2024-09-17T03:42:01.148959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9216},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9216":{"gid":9216,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/955598829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":955598829},{"type":"v1","addr":"172.21.15.146:6834","nonce":955598829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9216,"qdb_cluster":[9216]},"id":10}]} 2024-09-17T03:42:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 104 2024-09-17T03:42:39.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 -- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe258078b90 msgr2=0x7fe25807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe258078b90 0x7fe25807b0a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe270000f60 tx=0x7fe270009040 comp rx=0 tx=0).stop 2024-09-17T03:42:39.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 -- 172.21.15.146:0/2692972521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740b3870 msgr2=0x7fe2741500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740b3870 0x7fe2741500d0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fe264034040 tx=0x7fe2640039e0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 -- 172.21.15.146:0/2692972521 shutdown_connections 2024-09-17T03:42:39.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe258078b90 0x7fe25807b0a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe2740cf370 0x7fe274150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe2740b3870 0x7fe2741500d0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 --2- 172.21.15.146:0/2692972521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe27406f270 0x7fe27414d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 -- 172.21.15.146:0/2692972521 >> 172.21.15.146:0/2692972521 conn(0x7fe2740d4be0 msgr2=0x7fe274075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 -- 172.21.15.146:0/2692972521 shutdown_connections 2024-09-17T03:42:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.253+0000 7fe27b64a640 1 -- 172.21.15.146:0/2692972521 wait complete. 2024-09-17T03:42:39.265 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:42:39.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.378+0000 7fdabef0b640 1 -- 172.21.15.146:0/3036987121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdab80b55f0 msgr2=0x7fdab8070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.378+0000 7fdabef0b640 1 --2- 172.21.15.146:0/3036987121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdab80b55f0 0x7fdab8070be0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8005fd0 tx=0x7fdaa802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.378+0000 7fdabef0b640 1 -- 172.21.15.146:0/3036987121 shutdown_connections 2024-09-17T03:42:39.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.378+0000 7fdabef0b640 1 --2- 172.21.15.146:0/3036987121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdab806dd60 0x7fdab806e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.378+0000 7fdabef0b640 1 --2- 172.21.15.146:0/3036987121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdab80b55f0 0x7fdab8070be0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.378+0000 7fdabef0b640 1 -- 172.21.15.146:0/3036987121 >> 172.21.15.146:0/3036987121 conn(0x7fdab80b3410 msgr2=0x7fdab80b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:39.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.378+0000 7fdabef0b640 1 -- 172.21.15.146:0/3036987121 shutdown_connections 2024-09-17T03:42:39.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.378+0000 7fdabef0b640 1 -- 172.21.15.146:0/3036987121 wait complete. 2024-09-17T03:42:39.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.380+0000 7fdabef0b640 1 Processor -- start 2024-09-17T03:42:39.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.380+0000 7fdabef0b640 1 -- start start 2024-09-17T03:42:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.381+0000 7fdabef0b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdab806dd60 0x7fdab8142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.381+0000 7fdabef0b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdab8071120 0x7fdab81f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.381+0000 7fdabef0b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdab80b55f0 0x7fdab80afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.381+0000 7fdabef0b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdab815be90 con 0x7fdab806dd60 2024-09-17T03:42:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.381+0000 7fdabef0b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdab815bd10 con 0x7fdab8071120 2024-09-17T03:42:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.381+0000 7fdabef0b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdab815c010 con 0x7fdab80b55f0 2024-09-17T03:42:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabcca7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdab806dd60 0x7fdab8142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabcca7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdab806dd60 0x7fdab8142900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47332/0 (socket says 172.21.15.146:47332) 2024-09-17T03:42:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabcca7640 1 -- 172.21.15.146:0/1618585963 learned_addr learned my addr 172.21.15.146:0/1618585963 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabd4a8640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdab80b55f0 0x7fdab80afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdab7fff640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdab8071120 0x7fdab81f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabcca7640 1 -- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdab80b55f0 msgr2=0x7fdab80afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabcca7640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdab80b55f0 0x7fdab80afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabcca7640 1 -- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdab8071120 msgr2=0x7fdab81f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabcca7640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdab8071120 0x7fdab81f6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabcca7640 1 -- 172.21.15.146:0/1618585963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab81f6cc0 con 0x7fdab806dd60 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabd4a8640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdab80b55f0 0x7fdab80afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabcca7640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdab806dd60 0x7fdab8142900 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8034040 tx=0x7fdaa80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdab57fa640 1 -- 172.21.15.146:0/1618585963 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa803e030 con 0x7fdab806dd60 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdab57fa640 1 -- 172.21.15.146:0/1618585963 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdaa8003ca0 con 0x7fdab806dd60 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabef0b640 1 -- 172.21.15.146:0/1618585963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab8144f70 con 0x7fdab806dd60 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdab57fa640 1 -- 172.21.15.146:0/1618585963 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8035040 con 0x7fdab806dd60 2024-09-17T03:42:39.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.382+0000 7fdabef0b640 1 -- 172.21.15.146:0/1618585963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab8145530 con 0x7fdab806dd60 2024-09-17T03:42:39.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.383+0000 7fdabef0b640 1 -- 172.21.15.146:0/1618585963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab815c530 con 0x7fdab806dd60 2024-09-17T03:42:39.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.384+0000 7fdab57fa640 1 -- 172.21.15.146:0/1618585963 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdaa8041030 con 0x7fdab806dd60 2024-09-17T03:42:39.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.385+0000 7fdab57fa640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa4078b90 0x7fdaa407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.385+0000 7fdab57fa640 1 -- 172.21.15.146:0/1618585963 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fdaa80bb6f0 con 0x7fdab806dd60 2024-09-17T03:42:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.385+0000 7fdab7fff640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa4078b90 0x7fdaa407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.386+0000 7fdab7fff640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa4078b90 0x7fdaa407b0a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdab815bca0 tx=0x7fdaac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:39.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.388+0000 7fdab57fa640 1 -- 172.21.15.146:0/1618585963 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdab81f6cc0 con 0x7fdab806dd60 2024-09-17T03:42:39.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.569+0000 7fdabef0b640 1 -- 172.21.15.146:0/1618585963 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdab815ea30 con 0x7fdab806dd60 2024-09-17T03:42:39.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.571+0000 7fdab57fa640 1 -- 172.21.15.146:0/1618585963 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+16787 (secure 0 0 0) 0x7fdaa8083c10 con 0x7fdab806dd60 2024-09-17T03:42:39.571 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:39.571 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":143,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:41:59.765590+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:41:55.777474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T03:41:57.096388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:42:39.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 -- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa4078b90 msgr2=0x7fdaa407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa4078b90 0x7fdaa407b0a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdab815bca0 tx=0x7fdaac009040 comp rx=0 tx=0).stop 2024-09-17T03:42:39.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 -- 172.21.15.146:0/1618585963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdab806dd60 msgr2=0x7fdab8142900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdab806dd60 0x7fdab8142900 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8034040 tx=0x7fdaa80038a0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 -- 172.21.15.146:0/1618585963 shutdown_connections 2024-09-17T03:42:39.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdaa4078b90 0x7fdaa407b0a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdab80b55f0 0x7fdab80afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdab8071120 0x7fdab81f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 --2- 172.21.15.146:0/1618585963 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdab806dd60 0x7fdab8142900 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 -- 172.21.15.146:0/1618585963 >> 172.21.15.146:0/1618585963 conn(0x7fdab80b3410 msgr2=0x7fdab80d1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:39.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 -- 172.21.15.146:0/1618585963 shutdown_connections 2024-09-17T03:42:39.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.573+0000 7fdabef0b640 1 -- 172.21.15.146:0/1618585963 wait complete. 2024-09-17T03:42:39.585 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:42:39.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.699+0000 7fb9e5412640 1 -- 172.21.15.146:0/1179389414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e00b36b0 msgr2=0x7fb9e00b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.699+0000 7fb9e5412640 1 --2- 172.21.15.146:0/1179389414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e00b36b0 0x7fb9e00b3c00 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00b7680 tx=0x7fb9d002a560 comp rx=0 tx=0).stop 2024-09-17T03:42:39.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.699+0000 7fb9e5412640 1 -- 172.21.15.146:0/1179389414 shutdown_connections 2024-09-17T03:42:39.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.699+0000 7fb9e5412640 1 --2- 172.21.15.146:0/1179389414 >> v2:172.21.15.179:3300/0 conn(0x7fb9e015ec30 0x7fb9e0068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.699+0000 7fb9e5412640 1 --2- 172.21.15.146:0/1179389414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e00b36b0 0x7fb9e00b3c00 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.699+0000 7fb9e5412640 1 -- 172.21.15.146:0/1179389414 >> 172.21.15.146:0/1179389414 conn(0x7fb9e00d4960 msgr2=0x7fb9e00d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:39.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.699+0000 7fb9e5412640 1 -- 172.21.15.146:0/1179389414 shutdown_connections 2024-09-17T03:42:39.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.699+0000 7fb9e5412640 1 -- 172.21.15.146:0/1179389414 wait complete. 2024-09-17T03:42:39.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.701+0000 7fb9e5412640 1 Processor -- start 2024-09-17T03:42:39.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.701+0000 7fb9e5412640 1 -- start start 2024-09-17T03:42:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.702+0000 7fb9e5412640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9e0069240 0x7fb9e0157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.702+0000 7fb9e5412640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e00b36b0 0x7fb9e01e76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.702+0000 7fb9e5412640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e015ec30 0x7fb9e00ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.702+0000 7fb9e5412640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00d3770 con 0x7fb9e00b36b0 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.702+0000 7fb9e5412640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e00d35f0 con 0x7fb9e0069240 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.702+0000 7fb9e5412640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e00d38f0 con 0x7fb9e015ec30 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.702+0000 7fb9d7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e00b36b0 0x7fb9e01e76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9d7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e00b36b0 0x7fb9e01e76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47336/0 (socket says 172.21.15.146:47336) 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9d7fff640 1 -- 172.21.15.146:0/1867546648 learned_addr learned my addr 172.21.15.146:0/1867546648 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9deffd640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9e0069240 0x7fb9e0157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9df7fe640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e015ec30 0x7fb9e00ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9d7fff640 1 -- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e015ec30 msgr2=0x7fb9e00ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9d7fff640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e015ec30 0x7fb9e00ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9d7fff640 1 -- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9e0069240 msgr2=0x7fb9e0157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9d7fff640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9e0069240 0x7fb9e0157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9d7fff640 1 -- 172.21.15.146:0/1867546648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e01e7bf0 con 0x7fb9e00b36b0 2024-09-17T03:42:39.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9df7fe640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e015ec30 0x7fb9e00ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:39.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9deffd640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9e0069240 0x7fb9e0157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:39.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9d7fff640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e00b36b0 0x7fb9e01e76b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800b410 tx=0x7fb9c800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:39.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9d77fe640 1 -- 172.21.15.146:0/1867546648 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8015020 con 0x7fb9e00b36b0 2024-09-17T03:42:39.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9d77fe640 1 -- 172.21.15.146:0/1867546648 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9c8011920 con 0x7fb9e00b36b0 2024-09-17T03:42:39.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9e5412640 1 -- 172.21.15.146:0/1867546648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e01f6290 con 0x7fb9e00b36b0 2024-09-17T03:42:39.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9d77fe640 1 -- 172.21.15.146:0/1867546648 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8011d70 con 0x7fb9e00b36b0 2024-09-17T03:42:39.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.703+0000 7fb9e5412640 1 -- 172.21.15.146:0/1867546648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e01f6850 con 0x7fb9e00b36b0 2024-09-17T03:42:39.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.704+0000 7fb9e5412640 1 -- 172.21.15.146:0/1867546648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e01f6000 con 0x7fb9e00b36b0 2024-09-17T03:42:39.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.705+0000 7fb9d77fe640 1 -- 172.21.15.146:0/1867546648 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb9c8018020 con 0x7fb9e00b36b0 2024-09-17T03:42:39.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.705+0000 7fb9d77fe640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c0078bc0 0x7fb9c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:39.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.706+0000 7fb9d77fe640 1 -- 172.21.15.146:0/1867546648 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5709+0+0 (secure 0 0 0) 0x7fb9c809ab00 con 0x7fb9e00b36b0 2024-09-17T03:42:39.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.706+0000 7fb9deffd640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c0078bc0 0x7fb9c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:39.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.706+0000 7fb9deffd640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c0078bc0 0x7fb9c007b0d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0033000 tx=0x7fb9d0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:39.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.710+0000 7fb9d77fe640 1 -- 172.21.15.146:0/1867546648 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9c801f020 con 0x7fb9e00b36b0 2024-09-17T03:42:39.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.918+0000 7fb9e5412640 1 -- 172.21.15.146:0/1867546648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb9e00d3eb0 con 0x7fb9e00b36b0 2024-09-17T03:42:39.921 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:42:39.919+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:42:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.920+0000 7fb9d77fe640 1 -- 172.21.15.146:0/1867546648 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) ==== 161+0+0 (secure 0 0 0) 0x7fb9c8063060 con 0x7fb9e00b36b0 2024-09-17T03:42:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:42:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 -- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c0078bc0 msgr2=0x7fb9c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c0078bc0 0x7fb9c007b0d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0033000 tx=0x7fb9d0004730 comp rx=0 tx=0).stop 2024-09-17T03:42:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 -- 172.21.15.146:0/1867546648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e00b36b0 msgr2=0x7fb9e01e76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e00b36b0 0x7fb9e01e76b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800b410 tx=0x7fb9c800b8d0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 -- 172.21.15.146:0/1867546648 shutdown_connections 2024-09-17T03:42:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb9c0078bc0 0x7fb9c007b0d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb9e015ec30 0x7fb9e00ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e00b36b0 0x7fb9e01e76b0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 --2- 172.21.15.146:0/1867546648 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9e0069240 0x7fb9e0157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 -- 172.21.15.146:0/1867546648 >> 172.21.15.146:0/1867546648 conn(0x7fb9e00d4960 msgr2=0x7fb9e00b94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 -- 172.21.15.146:0/1867546648 shutdown_connections 2024-09-17T03:42:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:39.924+0000 7fb9e5412640 1 -- 172.21.15.146:0/1867546648 wait complete. 2024-09-17T03:42:39.936 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:42:39.987 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:42:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.054+0000 7f1ede92b640 1 -- 172.21.15.146:0/1819314030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ec0004800 msgr2=0x7f1ec0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.054+0000 7f1ede92b640 1 --2- 172.21.15.146:0/1819314030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ec0004800 0x7f1ec0004c10 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f1ed815ccb0 tx=0x7f1ec0005830 comp rx=0 tx=0).stop 2024-09-17T03:42:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.054+0000 7f1ede92b640 1 -- 172.21.15.146:0/1819314030 shutdown_connections 2024-09-17T03:42:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.054+0000 7f1ede92b640 1 --2- 172.21.15.146:0/1819314030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ec0004800 0x7f1ec0004c10 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.054+0000 7f1ede92b640 1 -- 172.21.15.146:0/1819314030 >> 172.21.15.146:0/1819314030 conn(0x7f1ed80b3150 msgr2=0x7f1ed80b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.054+0000 7f1ede92b640 1 -- 172.21.15.146:0/1819314030 shutdown_connections 2024-09-17T03:42:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.054+0000 7f1ede92b640 1 -- 172.21.15.146:0/1819314030 wait complete. 2024-09-17T03:42:40.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.056+0000 7f1ede92b640 1 Processor -- start 2024-09-17T03:42:40.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.056+0000 7f1ede92b640 1 -- start start 2024-09-17T03:42:40.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.057+0000 7f1ede92b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ec0004800 0x7f1ed81f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:40.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.057+0000 7f1ede92b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed81561e0 0x7f1ed8141630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:40.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.057+0000 7f1ede92b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed8157ab0 0x7f1ed81610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:40.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.057+0000 7f1ede92b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8155d10 con 0x7f1ec0004800 2024-09-17T03:42:40.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.057+0000 7f1ede92b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed8155b90 con 0x7f1ed81561e0 2024-09-17T03:42:40.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.057+0000 7f1ede92b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed8155e90 con 0x7f1ed8157ab0 2024-09-17T03:42:40.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ec0004800 0x7f1ed81f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:40.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ec0004800 0x7f1ed81f2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47382/0 (socket says 172.21.15.146:47382) 2024-09-17T03:42:40.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed7fff640 1 -- 172.21.15.146:0/2793626484 learned_addr learned my addr 172.21.15.146:0/2793626484 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:40.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1edcec8640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed8157ab0 0x7f1ed81610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:40.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed77fe640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed81561e0 0x7f1ed8141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:40.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed7fff640 1 -- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed8157ab0 msgr2=0x7f1ed81610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:40.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed7fff640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed8157ab0 0x7f1ed81610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:40.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed7fff640 1 -- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed81561e0 msgr2=0x7f1ed8141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:40.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed7fff640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed81561e0 0x7f1ed8141630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:40.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed7fff640 1 -- 172.21.15.146:0/2793626484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed8160040 con 0x7f1ec0004800 2024-09-17T03:42:40.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1edcec8640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed8157ab0 0x7f1ed81610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:40.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed7fff640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ec0004800 0x7f1ed81f2b30 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8011ae0 tx=0x7f1ec8009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:40.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed4ff9640 1 -- 172.21.15.146:0/2793626484 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec801e070 con 0x7f1ec0004800 2024-09-17T03:42:40.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed4ff9640 1 -- 172.21.15.146:0/2793626484 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ec800fc10 con 0x7f1ec0004800 2024-09-17T03:42:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ede92b640 1 -- 172.21.15.146:0/2793626484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed8160320 con 0x7f1ec0004800 2024-09-17T03:42:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ed4ff9640 1 -- 172.21.15.146:0/2793626484 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8019410 con 0x7f1ec0004800 2024-09-17T03:42:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.058+0000 7f1ede92b640 1 -- 172.21.15.146:0/2793626484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed81608e0 con 0x7f1ec0004800 2024-09-17T03:42:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.059+0000 7f1ede92b640 1 -- 172.21.15.146:0/2793626484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed806cdc0 con 0x7f1ec0004800 2024-09-17T03:42:40.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.060+0000 7f1ed4ff9640 1 -- 172.21.15.146:0/2793626484 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ec8021070 con 0x7f1ec0004800 2024-09-17T03:42:40.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.060+0000 7f1ed4ff9640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ec4078b90 0x7f1ec407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:40.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.060+0000 7f1ed4ff9640 1 -- 172.21.15.146:0/2793626484 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5795+0+0 (secure 0 0 0) 0x7f1ec809b600 con 0x7f1ec0004800 2024-09-17T03:42:40.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.061+0000 7f1ed77fe640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ec4078b90 0x7f1ec407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:40.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.061+0000 7f1ed77fe640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ec4078b90 0x7f1ec407b0a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc032000 tx=0x7f1ecc001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:40.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.065+0000 7f1ed4ff9640 1 -- 172.21.15.146:0/2793626484 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ec8063390 con 0x7f1ec0004800 2024-09-17T03:42:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.276+0000 7f1ede92b640 1 -- 172.21.15.146:0/2793626484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1ed8071320 con 0x7f1ec0004800 2024-09-17T03:42:40.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.929+0000 7f1ed4ff9640 1 -- 172.21.15.146:0/2793626484 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v106) ==== 104+0+0 (secure 0 0 0) 0x7f1ec8067dc0 con 0x7f1ec0004800 2024-09-17T03:42:40.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 -- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ec4078b90 msgr2=0x7f1ec407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:40.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ec4078b90 0x7f1ec407b0a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc032000 tx=0x7f1ecc001190 comp rx=0 tx=0).stop 2024-09-17T03:42:40.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 -- 172.21.15.146:0/2793626484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ec0004800 msgr2=0x7f1ed81f2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:40.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ec0004800 0x7f1ed81f2b30 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8011ae0 tx=0x7f1ec8009eb0 comp rx=0 tx=0).stop 2024-09-17T03:42:40.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 -- 172.21.15.146:0/2793626484 shutdown_connections 2024-09-17T03:42:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1ec4078b90 0x7f1ec407b0a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ed8157ab0 0x7f1ed81610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ed81561e0 0x7f1ed8141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 --2- 172.21.15.146:0/2793626484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ec0004800 0x7f1ed81f2b30 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 -- 172.21.15.146:0/2793626484 >> 172.21.15.146:0/2793626484 conn(0x7f1ed80b3150 msgr2=0x7f1ed80d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 -- 172.21.15.146:0/2793626484 shutdown_connections 2024-09-17T03:42:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:40.932+0000 7f1ede92b640 1 -- 172.21.15.146:0/2793626484 wait complete. 2024-09-17T03:42:40.947 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:42:41.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.073+0000 7fb3067cf640 1 -- 172.21.15.146:0/2616057891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e8003a30 msgr2=0x7fb2e8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:41.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.073+0000 7fb3067cf640 1 --2- 172.21.15.146:0/2616057891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e8003a30 0x7fb2e8003ea0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009b30 tx=0x7fb2e8005830 comp rx=0 tx=0).stop 2024-09-17T03:42:41.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.073+0000 7fb304d6c640 1 -- 172.21.15.146:0/2616057891 reap_dead start 2024-09-17T03:42:41.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.073+0000 7fb3067cf640 1 -- 172.21.15.146:0/2616057891 shutdown_connections 2024-09-17T03:42:41.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.073+0000 7fb3067cf640 1 -- 172.21.15.146:0/2616057891 >> 172.21.15.146:0/2616057891 conn(0x7fb3000b7b20 msgr2=0x7fb30009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:41.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.073+0000 7fb3067cf640 1 -- 172.21.15.146:0/2616057891 shutdown_connections 2024-09-17T03:42:41.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.073+0000 7fb3067cf640 1 -- 172.21.15.146:0/2616057891 wait complete. 2024-09-17T03:42:41.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.075+0000 7fb3067cf640 1 Processor -- start 2024-09-17T03:42:41.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.075+0000 7fb3067cf640 1 -- start start 2024-09-17T03:42:41.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb3067cf640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e8003a30 0x7fb300154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:41.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb3067cf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3001484e0 0x7fb300145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb3067cf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3001478c0 0x7fb300147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb3067cf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb30015d1b0 con 0x7fb3001484e0 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb3067cf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb3000b1840 con 0x7fb3001478c0 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb3067cf640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb30015d330 con 0x7fb2e8003a30 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb2ff7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3001484e0 0x7fb300145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb2ff7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3001484e0 0x7fb300145050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47392/0 (socket says 172.21.15.146:47392) 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb2ff7fe640 1 -- 172.21.15.146:0/2836131971 learned_addr learned my addr 172.21.15.146:0/2836131971 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb304d6c640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3001478c0 0x7fb300147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb2fffff640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e8003a30 0x7fb300154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb2ff7fe640 1 -- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e8003a30 msgr2=0x7fb300154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb2ff7fe640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e8003a30 0x7fb300154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb2ff7fe640 1 -- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3001478c0 msgr2=0x7fb300147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:41.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb2ff7fe640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3001478c0 0x7fb300147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:41.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.076+0000 7fb2ff7fe640 1 -- 172.21.15.146:0/2836131971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb300145590 con 0x7fb3001484e0 2024-09-17T03:42:41.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.077+0000 7fb304d6c640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3001478c0 0x7fb300147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:41.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.077+0000 7fb2ff7fe640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3001484e0 0x7fb300145050 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4000fb0 tx=0x7fb2f400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:41.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.077+0000 7fb2fcff9640 1 -- 172.21.15.146:0/2836131971 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4015070 con 0x7fb3001484e0 2024-09-17T03:42:41.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.077+0000 7fb2fcff9640 1 -- 172.21.15.146:0/2836131971 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2f400ca00 con 0x7fb3001484e0 2024-09-17T03:42:41.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.077+0000 7fb3067cf640 1 -- 172.21.15.146:0/2836131971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb300148210 con 0x7fb3001484e0 2024-09-17T03:42:41.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.077+0000 7fb2fcff9640 1 -- 172.21.15.146:0/2836131971 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f400ce50 con 0x7fb3001484e0 2024-09-17T03:42:41.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.077+0000 7fb3067cf640 1 -- 172.21.15.146:0/2836131971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30009f130 con 0x7fb3001484e0 2024-09-17T03:42:41.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.078+0000 7fb3067cf640 1 -- 172.21.15.146:0/2836131971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb300154c50 con 0x7fb3001484e0 2024-09-17T03:42:41.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.079+0000 7fb2fcff9640 1 -- 172.21.15.146:0/2836131971 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb2f4018070 con 0x7fb3001484e0 2024-09-17T03:42:41.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.079+0000 7fb2fcff9640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb2ec078d60 0x7fb2ec07b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:41.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.079+0000 7fb2fcff9640 1 -- 172.21.15.146:0/2836131971 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5795+0+0 (secure 0 0 0) 0x7fb2f409b260 con 0x7fb3001484e0 2024-09-17T03:42:41.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.079+0000 7fb2fffff640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb2ec078d60 0x7fb2ec07b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:41.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.080+0000 7fb2fffff640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb2ec078d60 0x7fb2ec07b270 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0034000 tx=0x7fb2f00046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:41.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.084+0000 7fb2fcff9640 1 -- 172.21.15.146:0/2836131971 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb300145590 con 0x7fb3001484e0 2024-09-17T03:42:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:41.261+0000 7fb3067cf640 1 -- 172.21.15.146:0/2836131971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb30015d8c0 con 0x7fb3001484e0 2024-09-17T03:42:42.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.093+0000 7fb2fcff9640 1 -- 172.21.15.146:0/2836131971 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v145) ==== 181+0+0 (secure 0 0 0) 0x7fb2f40635c0 con 0x7fb3001484e0 2024-09-17T03:42:42.093 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:42:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 -- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb2ec078d60 msgr2=0x7fb2ec07b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb2ec078d60 0x7fb2ec07b270 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0034000 tx=0x7fb2f00046c0 comp rx=0 tx=0).stop 2024-09-17T03:42:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 -- 172.21.15.146:0/2836131971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3001484e0 msgr2=0x7fb300145050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:42.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3001484e0 0x7fb300145050 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4000fb0 tx=0x7fb2f400ea00 comp rx=0 tx=0).stop 2024-09-17T03:42:42.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 -- 172.21.15.146:0/2836131971 shutdown_connections 2024-09-17T03:42:42.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb2ec078d60 0x7fb2ec07b270 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:42.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3001478c0 0x7fb300147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:42.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3001484e0 0x7fb300145050 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:42.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 --2- 172.21.15.146:0/2836131971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2e8003a30 0x7fb300154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:42.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 -- 172.21.15.146:0/2836131971 >> 172.21.15.146:0/2836131971 conn(0x7fb3000b7b20 msgr2=0x7fb30015b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:42.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 -- 172.21.15.146:0/2836131971 shutdown_connections 2024-09-17T03:42:42.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.096+0000 7fb3067cf640 1 -- 172.21.15.146:0/2836131971 wait complete. 2024-09-17T03:42:42.113 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:42:42.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.237+0000 7febaf4f9640 1 -- 172.21.15.146:0/690102533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba806d360 msgr2=0x7feba80cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:42.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.237+0000 7febaf4f9640 1 --2- 172.21.15.146:0/690102533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba806d360 0x7feba80cf650 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7feba8071ce0 tx=0x7feb9802a530 comp rx=0 tx=0).stop 2024-09-17T03:42:42.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.237+0000 7febaf4f9640 1 -- 172.21.15.146:0/690102533 shutdown_connections 2024-09-17T03:42:42.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.237+0000 7febaf4f9640 1 --2- 172.21.15.146:0/690102533 >> v2:172.21.15.179:3300/0 conn(0x7feba8145ce0 0x7feba80cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:42.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.237+0000 7febaf4f9640 1 --2- 172.21.15.146:0/690102533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba806d360 0x7feba80cf650 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:42.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.237+0000 7febaf4f9640 1 -- 172.21.15.146:0/690102533 >> 172.21.15.146:0/690102533 conn(0x7feba80b3150 msgr2=0x7feba80b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:42.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.237+0000 7febaf4f9640 1 -- 172.21.15.146:0/690102533 shutdown_connections 2024-09-17T03:42:42.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.237+0000 7febaf4f9640 1 -- 172.21.15.146:0/690102533 wait complete. 2024-09-17T03:42:42.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.239+0000 7febaf4f9640 1 Processor -- start 2024-09-17T03:42:42.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.239+0000 7febaf4f9640 1 -- start start 2024-09-17T03:42:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.240+0000 7febaf4f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba8145ce0 0x7feba80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febaf4f9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba8146230 0x7feba81413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febaf4f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba81f9860 0x7feba806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febaf4f9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feba80d0460 con 0x7feba81f9860 2024-09-17T03:42:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febaf4f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feba80d02e0 con 0x7feba8145ce0 2024-09-17T03:42:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febaf4f9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7feba80d05e0 con 0x7feba8146230 2024-09-17T03:42:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febada96640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba81f9860 0x7feba806fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febada96640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba81f9860 0x7feba806fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47414/0 (socket says 172.21.15.146:47414) 2024-09-17T03:42:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febada96640 1 -- 172.21.15.146:0/465142901 learned_addr learned my addr 172.21.15.146:0/465142901 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febaca94640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba8146230 0x7feba81413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:42.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febada96640 1 -- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba8146230 msgr2=0x7feba81413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febada96640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba8146230 0x7feba81413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febada96640 1 -- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba8145ce0 msgr2=0x7feba80b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febada96640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba8145ce0 0x7feba80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febada96640 1 -- 172.21.15.146:0/465142901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba81418f0 con 0x7feba81f9860 2024-09-17T03:42:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febada96640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba81f9860 0x7feba806fad0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7feba000e960 tx=0x7feba000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7feb9dffb640 1 -- 172.21.15.146:0/465142901 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0004d20 con 0x7feba81f9860 2024-09-17T03:42:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7feb9dffb640 1 -- 172.21.15.146:0/465142901 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feba000cb20 con 0x7feba81f9860 2024-09-17T03:42:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7feb9dffb640 1 -- 172.21.15.146:0/465142901 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0005020 con 0x7feba81f9860 2024-09-17T03:42:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.241+0000 7febaf4f9640 1 -- 172.21.15.146:0/465142901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba813f9c0 con 0x7feba81f9860 2024-09-17T03:42:42.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.242+0000 7febaf4f9640 1 -- 172.21.15.146:0/465142901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba81f9060 con 0x7feba81f9860 2024-09-17T03:42:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.242+0000 7febaf4f9640 1 -- 172.21.15.146:0/465142901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba8151030 con 0x7feba81f9860 2024-09-17T03:42:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.243+0000 7feb9dffb640 1 -- 172.21.15.146:0/465142901 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feba00051c0 con 0x7feba81f9860 2024-09-17T03:42:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.244+0000 7feb9dffb640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb8c078b90 0x7feb8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.244+0000 7feb9dffb640 1 -- 172.21.15.146:0/465142901 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5357+0+0 (secure 0 0 0) 0x7feba009b5a0 con 0x7feba81f9860 2024-09-17T03:42:42.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.244+0000 7febad295640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb8c078b90 0x7feb8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:42.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.245+0000 7febad295640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb8c078b90 0x7feb8c07b0a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7feba4001500 tx=0x7feba4007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:42.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.248+0000 7feb9dffb640 1 -- 172.21.15.146:0/465142901 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feba0016030 con 0x7feba81f9860 2024-09-17T03:42:42.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:42.423+0000 7febaf4f9640 1 -- 172.21.15.146:0/465142901 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7feba80cf650 con 0x7feba81f9860 2024-09-17T03:42:43.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.101+0000 7feb9dffb640 1 -- 172.21.15.146:0/465142901 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v146) ==== 169+0+0 (secure 0 0 0) 0x7feba0063ac0 con 0x7feba81f9860 2024-09-17T03:42:43.102 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:42:43.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.105+0000 7febaf4f9640 1 -- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb8c078b90 msgr2=0x7feb8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:43.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.106+0000 7febaf4f9640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb8c078b90 0x7feb8c07b0a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7feba4001500 tx=0x7feba4007a30 comp rx=0 tx=0).stop 2024-09-17T03:42:43.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.106+0000 7febaf4f9640 1 -- 172.21.15.146:0/465142901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba81f9860 msgr2=0x7feba806fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:43.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.106+0000 7febaf4f9640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba81f9860 0x7feba806fad0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7feba000e960 tx=0x7feba000ee20 comp rx=0 tx=0).stop 2024-09-17T03:42:43.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.106+0000 7febaf4f9640 1 -- 172.21.15.146:0/465142901 shutdown_connections 2024-09-17T03:42:43.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.106+0000 7febaf4f9640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7feb8c078b90 0x7feb8c07b0a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.106+0000 7febaf4f9640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feba81f9860 0x7feba806fad0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.106+0000 7febaf4f9640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feba8146230 0x7feba81413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.106+0000 7febaf4f9640 1 --2- 172.21.15.146:0/465142901 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feba8145ce0 0x7feba80b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.106+0000 7febaf4f9640 1 -- 172.21.15.146:0/465142901 >> 172.21.15.146:0/465142901 conn(0x7feba80b3150 msgr2=0x7feba8075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:43.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.106+0000 7febaf4f9640 1 -- 172.21.15.146:0/465142901 shutdown_connections 2024-09-17T03:42:43.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.106+0000 7febaf4f9640 1 -- 172.21.15.146:0/465142901 wait complete. 2024-09-17T03:42:43.127 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:42:43.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.245+0000 7fb410f0b640 1 -- 172.21.15.146:0/3852930242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40c0b3360 msgr2=0x7fb40c072df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:43.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.245+0000 7fb410f0b640 1 --2- 172.21.15.146:0/3852930242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40c0b3360 0x7fb40c072df0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009830 tx=0x7fb3fc02a510 comp rx=0 tx=0).stop 2024-09-17T03:42:43.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.245+0000 7fb410f0b640 1 -- 172.21.15.146:0/3852930242 shutdown_connections 2024-09-17T03:42:43.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.245+0000 7fb410f0b640 1 --2- 172.21.15.146:0/3852930242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40c0b3360 0x7fb40c072df0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.245+0000 7fb410f0b640 1 -- 172.21.15.146:0/3852930242 >> 172.21.15.146:0/3852930242 conn(0x7fb40c0b2060 msgr2=0x7fb40c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:43.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.245+0000 7fb410f0b640 1 -- 172.21.15.146:0/3852930242 shutdown_connections 2024-09-17T03:42:43.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.245+0000 7fb410f0b640 1 -- 172.21.15.146:0/3852930242 wait complete. 2024-09-17T03:42:43.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.247+0000 7fb410f0b640 1 Processor -- start 2024-09-17T03:42:43.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.247+0000 7fb410f0b640 1 -- start start 2024-09-17T03:42:43.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.248+0000 7fb410f0b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40c0b3360 0x7fb40c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:43.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.248+0000 7fb410f0b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb40c0cfc40 0x7fb40c13b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:43.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.248+0000 7fb410f0b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb40c1e8ab0 0x7fb40c1e8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:43.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.248+0000 7fb410f0b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c151e30 con 0x7fb40c0b3360 2024-09-17T03:42:43.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.248+0000 7fb410f0b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c151cb0 con 0x7fb40c1e8ab0 2024-09-17T03:42:43.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.248+0000 7fb410f0b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb40c151fb0 con 0x7fb40c0cfc40 2024-09-17T03:42:43.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.248+0000 7fb40a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40c0b3360 0x7fb40c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:43.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.248+0000 7fb40a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40c0b3360 0x7fb40c0aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47424/0 (socket says 172.21.15.146:47424) 2024-09-17T03:42:43.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.248+0000 7fb40a59c640 1 -- 172.21.15.146:0/1682259870 learned_addr learned my addr 172.21.15.146:0/1682259870 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:43.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb409d9b640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb40c0cfc40 0x7fb40c13b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb40ad9d640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb40c1e8ab0 0x7fb40c1e8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb40a59c640 1 -- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb40c0cfc40 msgr2=0x7fb40c13b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb40a59c640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb40c0cfc40 0x7fb40c13b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb40a59c640 1 -- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb40c1e8ab0 msgr2=0x7fb40c1e8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:43.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb40a59c640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb40c1e8ab0 0x7fb40c1e8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb40a59c640 1 -- 172.21.15.146:0/1682259870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40c1e7750 con 0x7fb40c0b3360 2024-09-17T03:42:43.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb409d9b640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb40c0cfc40 0x7fb40c13b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:43.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb40ad9d640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb40c1e8ab0 0x7fb40c1e8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:43.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb40a59c640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40c0b3360 0x7fb40c0aedb0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009950 tx=0x7fb3fc033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:43.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb3faffd640 1 -- 172.21.15.146:0/1682259870 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc031d60 con 0x7fb40c0b3360 2024-09-17T03:42:43.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb3faffd640 1 -- 172.21.15.146:0/1682259870 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3fc0330d0 con 0x7fb40c0b3360 2024-09-17T03:42:43.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb410f0b640 1 -- 172.21.15.146:0/1682259870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40c1e7a10 con 0x7fb40c0b3360 2024-09-17T03:42:43.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb3faffd640 1 -- 172.21.15.146:0/1682259870 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc033520 con 0x7fb40c0b3360 2024-09-17T03:42:43.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.249+0000 7fb410f0b640 1 -- 172.21.15.146:0/1682259870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb40c1e7fd0 con 0x7fb40c0b3360 2024-09-17T03:42:43.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.250+0000 7fb410f0b640 1 -- 172.21.15.146:0/1682259870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb40c072df0 con 0x7fb40c0b3360 2024-09-17T03:42:43.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.251+0000 7fb3faffd640 1 -- 172.21.15.146:0/1682259870 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3fc0035f0 con 0x7fb40c0b3360 2024-09-17T03:42:43.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.251+0000 7fb3faffd640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3ec078b90 0x7fb3ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:43.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.251+0000 7fb3faffd640 1 -- 172.21.15.146:0/1682259870 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7fb3fc0bc020 con 0x7fb40c0b3360 2024-09-17T03:42:43.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.252+0000 7fb409d9b640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3ec078b90 0x7fb3ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:43.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.252+0000 7fb409d9b640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3ec078b90 0x7fb3ec07b0a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb40c1f6fd0 tx=0x7fb400008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:43.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.256+0000 7fb3faffd640 1 -- 172.21.15.146:0/1682259870 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb3fc03f030 con 0x7fb40c0b3360 2024-09-17T03:42:43.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.432+0000 7fb410f0b640 1 -- 172.21.15.146:0/1682259870 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fb40c15f680 con 0x7fb40c0b3360 2024-09-17T03:42:43.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.436+0000 7fb3faffd640 1 -- 172.21.15.146:0/1682259870 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v57) ==== 71+0+0 (secure 0 0 0) 0x7fb3fc0841a0 con 0x7fb40c0b3360 2024-09-17T03:42:43.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 -- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3ec078b90 msgr2=0x7fb3ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3ec078b90 0x7fb3ec07b0a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb40c1f6fd0 tx=0x7fb400008040 comp rx=0 tx=0).stop 2024-09-17T03:42:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 -- 172.21.15.146:0/1682259870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40c0b3360 msgr2=0x7fb40c0aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40c0b3360 0x7fb40c0aedb0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009950 tx=0x7fb3fc033d60 comp rx=0 tx=0).stop 2024-09-17T03:42:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 -- 172.21.15.146:0/1682259870 shutdown_connections 2024-09-17T03:42:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb3ec078b90 0x7fb3ec07b0a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb40c1e8ab0 0x7fb40c1e8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb40c0cfc40 0x7fb40c13b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 --2- 172.21.15.146:0/1682259870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb40c0b3360 0x7fb40c0aedb0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 -- 172.21.15.146:0/1682259870 >> 172.21.15.146:0/1682259870 conn(0x7fb40c0b2060 msgr2=0x7fb40c15e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 -- 172.21.15.146:0/1682259870 shutdown_connections 2024-09-17T03:42:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.438+0000 7fb410f0b640 1 -- 172.21.15.146:0/1682259870 wait complete. 2024-09-17T03:42:43.450 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-17T03:42:43.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.563+0000 7f25fb28b640 1 -- 172.21.15.146:0/1678816718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00039e0 msgr2=0x7f25e0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:43.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.563+0000 7f25fb28b640 1 --2- 172.21.15.146:0/1678816718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00039e0 0x7f25e0003e10 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009ed0 tx=0x7f25e0005830 comp rx=0 tx=0).stop 2024-09-17T03:42:43.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.563+0000 7f25f9828640 1 -- 172.21.15.146:0/1678816718 reap_dead start 2024-09-17T03:42:43.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.563+0000 7f25fb28b640 1 -- 172.21.15.146:0/1678816718 shutdown_connections 2024-09-17T03:42:43.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.563+0000 7f25fb28b640 1 -- 172.21.15.146:0/1678816718 >> 172.21.15.146:0/1678816718 conn(0x7f25f409ba20 msgr2=0x7f25f40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:43.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.563+0000 7f25fb28b640 1 -- 172.21.15.146:0/1678816718 shutdown_connections 2024-09-17T03:42:43.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.563+0000 7f25fb28b640 1 -- 172.21.15.146:0/1678816718 wait complete. 2024-09-17T03:42:43.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.565+0000 7f25fb28b640 1 Processor -- start 2024-09-17T03:42:43.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.565+0000 7f25fb28b640 1 -- start start 2024-09-17T03:42:43.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.566+0000 7f25fb28b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00039e0 0x7f25f40c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:43.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.566+0000 7f25fb28b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25f4149280 0x7f25f414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:43.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.566+0000 7f25fb28b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25f4149690 0x7f25f414c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:43.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.566+0000 7f25fb28b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f25f40b2f30 con 0x7f25e00039e0 2024-09-17T03:42:43.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.566+0000 7f25fb28b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f25f40b80a0 con 0x7f25f4149280 2024-09-17T03:42:43.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.566+0000 7f25fb28b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f25f40cf170 con 0x7f25f4149690 2024-09-17T03:42:43.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25f9027640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00039e0 0x7f25f40c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:43.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25f9027640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00039e0 0x7f25f40c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47438/0 (socket says 172.21.15.146:47438) 2024-09-17T03:42:43.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25f9027640 1 -- 172.21.15.146:0/3959921785 learned_addr learned my addr 172.21.15.146:0/3959921785 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:43.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25f9828640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25f4149690 0x7f25f414c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:43.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25f8826640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25f4149280 0x7f25f414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25f9027640 1 -- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25f4149690 msgr2=0x7f25f414c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25f9027640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25f4149690 0x7f25f414c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25f9027640 1 -- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25f4149280 msgr2=0x7f25f414bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25f9027640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25f4149280 0x7f25f414bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25f9027640 1 -- 172.21.15.146:0/3959921785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f40cc420 con 0x7f25e00039e0 2024-09-17T03:42:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25f9027640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00039e0 0x7f25f40c9630 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f25f0036040 tx=0x7f25f0033bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25e9ffb640 1 -- 172.21.15.146:0/3959921785 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0043070 con 0x7f25e00039e0 2024-09-17T03:42:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25e9ffb640 1 -- 172.21.15.146:0/3959921785 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25f0033db0 con 0x7f25e00039e0 2024-09-17T03:42:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25fb28b640 1 -- 172.21.15.146:0/3959921785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f4149c60 con 0x7f25e00039e0 2024-09-17T03:42:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25e9ffb640 1 -- 172.21.15.146:0/3959921785 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0038040 con 0x7f25e00039e0 2024-09-17T03:42:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.567+0000 7f25fb28b640 1 -- 172.21.15.146:0/3959921785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f414a220 con 0x7f25e00039e0 2024-09-17T03:42:43.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.569+0000 7f25fb28b640 1 -- 172.21.15.146:0/3959921785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f4161220 con 0x7f25e00039e0 2024-09-17T03:42:43.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.569+0000 7f25e9ffb640 1 -- 172.21.15.146:0/3959921785 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f25f0046070 con 0x7f25e00039e0 2024-09-17T03:42:43.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.569+0000 7f25e9ffb640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25d8078b90 0x7f25d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:43.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.570+0000 7f25e9ffb640 1 -- 172.21.15.146:0/3959921785 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7f25f00bb270 con 0x7f25e00039e0 2024-09-17T03:42:43.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.570+0000 7f25f8826640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25d8078b90 0x7f25d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:43.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.570+0000 7f25f8826640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25d8078b90 0x7f25d807b0a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f25e4001bc0 tx=0x7f25e4001b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:43.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.574+0000 7f25e9ffb640 1 -- 172.21.15.146:0/3959921785 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f25f0083360 con 0x7f25e00039e0 2024-09-17T03:42:43.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:43.814+0000 7f25fb28b640 1 -- 172.21.15.146:0/3959921785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7f25f40ced70 con 0x7f25e00039e0 2024-09-17T03:42:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.103+0000 7f25e9ffb640 1 -- 172.21.15.146:0/3959921785 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v471) ==== 166+0+0 (secure 0 0 0) 0x7f25f0087d90 con 0x7f25e00039e0 2024-09-17T03:42:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.105+0000 7f25fb28b640 1 -- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25d8078b90 msgr2=0x7f25d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.105+0000 7f25fb28b640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25d8078b90 0x7f25d807b0a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f25e4001bc0 tx=0x7f25e4001b50 comp rx=0 tx=0).stop 2024-09-17T03:42:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.105+0000 7f25fb28b640 1 -- 172.21.15.146:0/3959921785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00039e0 msgr2=0x7f25f40c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.105+0000 7f25fb28b640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00039e0 0x7f25f40c9630 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f25f0036040 tx=0x7f25f0033bc0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.106+0000 7f25fb28b640 1 -- 172.21.15.146:0/3959921785 shutdown_connections 2024-09-17T03:42:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.106+0000 7f25fb28b640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f25d8078b90 0x7f25d807b0a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.106+0000 7f25fb28b640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25f4149690 0x7f25f414c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.106+0000 7f25fb28b640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25f4149280 0x7f25f414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.106+0000 7f25fb28b640 1 --2- 172.21.15.146:0/3959921785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25e00039e0 0x7f25f40c9630 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.106+0000 7f25fb28b640 1 -- 172.21.15.146:0/3959921785 >> 172.21.15.146:0/3959921785 conn(0x7f25f409ba20 msgr2=0x7f25f415f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.106+0000 7f25fb28b640 1 -- 172.21.15.146:0/3959921785 shutdown_connections 2024-09-17T03:42:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.106+0000 7f25fb28b640 1 -- 172.21.15.146:0/3959921785 wait complete. 2024-09-17T03:42:44.118 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-17T03:42:44.118 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-17T03:42:44.119 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:42:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.232+0000 7fb05c92b640 1 -- 172.21.15.146:0/3099891973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb044005350 msgr2=0x7fb04400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.232+0000 7fb05c92b640 1 --2- 172.21.15.146:0/3099891973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb044005350 0x7fb04400b9c0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fb05000c290 tx=0x7fb044005830 comp rx=0 tx=0).stop 2024-09-17T03:42:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.232+0000 7fb05c92b640 1 -- 172.21.15.146:0/3099891973 shutdown_connections 2024-09-17T03:42:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.232+0000 7fb05c92b640 1 --2- 172.21.15.146:0/3099891973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb044005350 0x7fb04400b9c0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.232+0000 7fb05c92b640 1 -- 172.21.15.146:0/3099891973 >> 172.21.15.146:0/3099891973 conn(0x7fb05809ba20 msgr2=0x7fb0580b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.232+0000 7fb05c92b640 1 -- 172.21.15.146:0/3099891973 shutdown_connections 2024-09-17T03:42:44.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.232+0000 7fb05c92b640 1 -- 172.21.15.146:0/3099891973 wait complete. 2024-09-17T03:42:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.234+0000 7fb05c92b640 1 Processor -- start 2024-09-17T03:42:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.234+0000 7fb05c92b640 1 -- start start 2024-09-17T03:42:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05c92b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb044005350 0x7fb05815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05c92b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0581f7830 0x7fb0580c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05c92b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0581f6bb0 0x7fb0581f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05c92b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb0580cf2f0 con 0x7fb044005350 2024-09-17T03:42:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05c92b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb0580cf170 con 0x7fb0581f7830 2024-09-17T03:42:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05c92b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb0580cf470 con 0x7fb0581f6bb0 2024-09-17T03:42:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb044005350 0x7fb05815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb044005350 0x7fb05815ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47446/0 (socket says 172.21.15.146:47446) 2024-09-17T03:42:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05659c640 1 -- 172.21.15.146:0/2160456496 learned_addr learned my addr 172.21.15.146:0/2160456496 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb056d9d640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0581f6bb0 0x7fb0581f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb055d9b640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0581f7830 0x7fb0580c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05659c640 1 -- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0581f6bb0 msgr2=0x7fb0581f6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05659c640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0581f6bb0 0x7fb0581f6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05659c640 1 -- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0581f7830 msgr2=0x7fb0580c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05659c640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0581f7830 0x7fb0580c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb05659c640 1 -- 172.21.15.146:0/2160456496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0581f7500 con 0x7fb044005350 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.235+0000 7fb056d9d640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0581f6bb0 0x7fb0581f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.236+0000 7fb05659c640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb044005350 0x7fb05815ab30 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fb048010b60 tx=0x7fb04800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.236+0000 7fb04effd640 1 -- 172.21.15.146:0/2160456496 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb048017070 con 0x7fb044005350 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.236+0000 7fb04effd640 1 -- 172.21.15.146:0/2160456496 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb048011640 con 0x7fb044005350 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.236+0000 7fb05c92b640 1 -- 172.21.15.146:0/2160456496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0580ca7a0 con 0x7fb044005350 2024-09-17T03:42:44.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.236+0000 7fb04effd640 1 -- 172.21.15.146:0/2160456496 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb048011a90 con 0x7fb044005350 2024-09-17T03:42:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.236+0000 7fb05c92b640 1 -- 172.21.15.146:0/2160456496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0580ca1e0 con 0x7fb044005350 2024-09-17T03:42:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.237+0000 7fb05c92b640 1 -- 172.21.15.146:0/2160456496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0581615a0 con 0x7fb044005350 2024-09-17T03:42:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.237+0000 7fb04effd640 1 -- 172.21.15.146:0/2160456496 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb048011c30 con 0x7fb044005350 2024-09-17T03:42:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.238+0000 7fb04effd640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb038078bc0 0x7fb03807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.238+0000 7fb04effd640 1 -- 172.21.15.146:0/2160456496 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7fb04809b580 con 0x7fb044005350 2024-09-17T03:42:44.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.238+0000 7fb055d9b640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb038078bc0 0x7fb03807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.239+0000 7fb055d9b640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb038078bc0 0x7fb03807b0d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb0580cebf0 tx=0x7fb040006ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:44.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.243+0000 7fb04effd640 1 -- 172.21.15.146:0/2160456496 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb0581f7500 con 0x7fb044005350 2024-09-17T03:42:44.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.418+0000 7fb05c92b640 1 -- 172.21.15.146:0/2160456496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0580ced70 con 0x7fb044005350 2024-09-17T03:42:44.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.419+0000 7fb04effd640 1 -- 172.21.15.146:0/2160456496 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+13090 (secure 0 0 0) 0x7fb048010e60 con 0x7fb044005350 2024-09-17T03:42:44.419 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:44.419 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":146,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:42:43.094958+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/955598829":"2024-09-18T03:42:39.920502+0000","172.21.15.146:6832/955598829":"2024-09-18T03:42:39.920502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:42:44.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 -- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb038078bc0 msgr2=0x7fb03807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb038078bc0 0x7fb03807b0d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb0580cebf0 tx=0x7fb040006ac0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 -- 172.21.15.146:0/2160456496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb044005350 msgr2=0x7fb05815ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb044005350 0x7fb05815ab30 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fb048010b60 tx=0x7fb04800e720 comp rx=0 tx=0).stop 2024-09-17T03:42:44.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 -- 172.21.15.146:0/2160456496 shutdown_connections 2024-09-17T03:42:44.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb038078bc0 0x7fb03807b0d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0581f6bb0 0x7fb0581f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0581f7830 0x7fb0580c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 --2- 172.21.15.146:0/2160456496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb044005350 0x7fb05815ab30 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 -- 172.21.15.146:0/2160456496 >> 172.21.15.146:0/2160456496 conn(0x7fb05809ba20 msgr2=0x7fb058070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:44.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 -- 172.21.15.146:0/2160456496 shutdown_connections 2024-09-17T03:42:44.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.421+0000 7fb05c92b640 1 -- 172.21.15.146:0/2160456496 wait complete. 2024-09-17T03:42:44.433 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:42:44.433 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:42:44.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.549+0000 7f2ee729b640 1 -- 172.21.15.146:0/2352950996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee00b5750 msgr2=0x7f2ee00b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.549+0000 7f2ee729b640 1 --2- 172.21.15.146:0/2352950996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee00b5750 0x7f2ee00b3620 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00b5390 tx=0x7f2ed002a530 comp rx=0 tx=0).stop 2024-09-17T03:42:44.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.549+0000 7f2ee729b640 1 -- 172.21.15.146:0/2352950996 shutdown_connections 2024-09-17T03:42:44.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.549+0000 7f2ee729b640 1 --2- 172.21.15.146:0/2352950996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee00b5750 0x7f2ee00b3620 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.549+0000 7f2ee729b640 1 --2- 172.21.15.146:0/2352950996 >> v2:172.21.15.179:3300/0 conn(0x7f2ee00b5ce0 0x7f2ee00b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.549+0000 7f2ee729b640 1 -- 172.21.15.146:0/2352950996 >> 172.21.15.146:0/2352950996 conn(0x7f2ee00b7b20 msgr2=0x7f2ee009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:44.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.549+0000 7f2ee729b640 1 -- 172.21.15.146:0/2352950996 shutdown_connections 2024-09-17T03:42:44.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.549+0000 7f2ee729b640 1 -- 172.21.15.146:0/2352950996 wait complete. 2024-09-17T03:42:44.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.551+0000 7f2ee729b640 1 Processor -- start 2024-09-17T03:42:44.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.551+0000 7f2ee729b640 1 -- start start 2024-09-17T03:42:44.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.552+0000 7f2ee729b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee00b3b60 0x7f2ee0152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.552+0000 7f2ee729b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee00b5750 0x7f2ee014dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.552+0000 7f2ee729b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee00b5ce0 0x7f2ee0154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.552+0000 7f2ee729b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee00b27b0 con 0x7f2ee00b5750 2024-09-17T03:42:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.552+0000 7f2ee729b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee015dcc0 con 0x7f2ee00b5ce0 2024-09-17T03:42:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.552+0000 7f2ee729b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee00b2930 con 0x7f2ee00b3b60 2024-09-17T03:42:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.552+0000 7f2ee4836640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee00b5750 0x7f2ee014dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.552+0000 7f2ee4836640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee00b5750 0x7f2ee014dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47460/0 (socket says 172.21.15.146:47460) 2024-09-17T03:42:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.552+0000 7f2ee4836640 1 -- 172.21.15.146:0/327420577 learned_addr learned my addr 172.21.15.146:0/327420577 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.552+0000 7f2ee5037640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee00b3b60 0x7f2ee0152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.552+0000 7f2ee5838640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee00b5ce0 0x7f2ee0154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ee4836640 1 -- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee00b3b60 msgr2=0x7f2ee0152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ee4836640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee00b3b60 0x7f2ee0152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ee4836640 1 -- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee00b5ce0 msgr2=0x7f2ee0154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ee4836640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee00b5ce0 0x7f2ee0154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ee4836640 1 -- 172.21.15.146:0/327420577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee014e670 con 0x7f2ee00b5750 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ee5037640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee00b3b60 0x7f2ee0152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ee4836640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee00b5750 0x7f2ee014dd90 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00098f0 tx=0x7f2ed0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ed5ffb640 1 -- 172.21.15.146:0/327420577 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0031d60 con 0x7f2ee00b5750 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ed5ffb640 1 -- 172.21.15.146:0/327420577 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ed0033e10 con 0x7f2ee00b5750 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ee729b640 1 -- 172.21.15.146:0/327420577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee01f4820 con 0x7f2ee00b5750 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ed5ffb640 1 -- 172.21.15.146:0/327420577 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0005260 con 0x7f2ee00b5750 2024-09-17T03:42:44.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.553+0000 7f2ee729b640 1 -- 172.21.15.146:0/327420577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee00a0090 con 0x7f2ee00b5750 2024-09-17T03:42:44.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.554+0000 7f2ee729b640 1 -- 172.21.15.146:0/327420577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee00b2e60 con 0x7f2ee00b5750 2024-09-17T03:42:44.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.555+0000 7f2ed5ffb640 1 -- 172.21.15.146:0/327420577 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ed0005400 con 0x7f2ee00b5750 2024-09-17T03:42:44.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.556+0000 7f2ed5ffb640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ec4078b90 0x7f2ec407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.556+0000 7f2ed5ffb640 1 -- 172.21.15.146:0/327420577 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7f2ed00bbd00 con 0x7f2ee00b5750 2024-09-17T03:42:44.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.556+0000 7f2ee5037640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ec4078b90 0x7f2ec407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.556+0000 7f2ee5037640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ec4078b90 0x7f2ec407b0a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009890 tx=0x7f2edc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:44.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.560+0000 7f2ed5ffb640 1 -- 172.21.15.146:0/327420577 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2ed003f030 con 0x7f2ee00b5750 2024-09-17T03:42:44.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.736+0000 7f2ee729b640 1 -- 172.21.15.146:0/327420577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2ee0157970 con 0x7f2ee00b5750 2024-09-17T03:42:44.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.737+0000 7f2ed5ffb640 1 -- 172.21.15.146:0/327420577 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v146) ==== 93+0+10 (secure 0 0 0) 0x7f2ed00844d0 con 0x7f2ee00b5750 2024-09-17T03:42:44.737 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 -- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ec4078b90 msgr2=0x7f2ec407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ec4078b90 0x7f2ec407b0a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009890 tx=0x7f2edc008040 comp rx=0 tx=0).stop 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 -- 172.21.15.146:0/327420577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee00b5750 msgr2=0x7f2ee014dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee00b5750 0x7f2ee014dd90 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00098f0 tx=0x7f2ed0033c20 comp rx=0 tx=0).stop 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 -- 172.21.15.146:0/327420577 shutdown_connections 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2ec4078b90 0x7f2ec407b0a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ee00b5ce0 0x7f2ee0154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee00b5750 0x7f2ee014dd90 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 --2- 172.21.15.146:0/327420577 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ee00b3b60 0x7f2ee0152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 -- 172.21.15.146:0/327420577 >> 172.21.15.146:0/327420577 conn(0x7f2ee00b7b20 msgr2=0x7f2ee014e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 -- 172.21.15.146:0/327420577 shutdown_connections 2024-09-17T03:42:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.739+0000 7f2ee729b640 1 -- 172.21.15.146:0/327420577 wait complete. 2024-09-17T03:42:44.751 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-17T03:42:44.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.864+0000 7fc038fc3640 1 -- 172.21.15.146:0/3007915124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0340b4100 msgr2=0x7fc03406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.864+0000 7fc038fc3640 1 --2- 172.21.15.146:0/3007915124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0340b4100 0x7fc03406fad0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fc028005fd0 tx=0x7fc02802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.864+0000 7fc038fc3640 1 -- 172.21.15.146:0/3007915124 shutdown_connections 2024-09-17T03:42:44.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.864+0000 7fc038fc3640 1 --2- 172.21.15.146:0/3007915124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0340b4100 0x7fc03406fad0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.864+0000 7fc038fc3640 1 -- 172.21.15.146:0/3007915124 >> 172.21.15.146:0/3007915124 conn(0x7fc03406d3c0 msgr2=0x7fc0340b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:44.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.864+0000 7fc038fc3640 1 -- 172.21.15.146:0/3007915124 shutdown_connections 2024-09-17T03:42:44.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.864+0000 7fc038fc3640 1 -- 172.21.15.146:0/3007915124 wait complete. 2024-09-17T03:42:44.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.866+0000 7fc038fc3640 1 Processor -- start 2024-09-17T03:42:44.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.866+0000 7fc038fc3640 1 -- start start 2024-09-17T03:42:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.867+0000 7fc038fc3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0340b4100 0x7fc034140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.867+0000 7fc038fc3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0340b4510 0x7fc03414ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.867+0000 7fc038fc3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0341f23f0 0x7fc03414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.867+0000 7fc038fc3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc034070460 con 0x7fc0340b4100 2024-09-17T03:42:44.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.867+0000 7fc038fc3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc0340702e0 con 0x7fc0340b4510 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.867+0000 7fc038fc3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc0340d05b0 con 0x7fc0341f23f0 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.867+0000 7fc03259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0340b4100 0x7fc034140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.867+0000 7fc03259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0340b4100 0x7fc034140680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47482/0 (socket says 172.21.15.146:47482) 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.867+0000 7fc03259c640 1 -- 172.21.15.146:0/1775665790 learned_addr learned my addr 172.21.15.146:0/1775665790 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc032d9d640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0341f23f0 0x7fc03414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc031d9b640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0340b4510 0x7fc03414ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc03259c640 1 -- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0341f23f0 msgr2=0x7fc03414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc03259c640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0341f23f0 0x7fc03414ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc03259c640 1 -- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0340b4510 msgr2=0x7fc03414ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc03259c640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0340b4510 0x7fc03414ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc03259c640 1 -- 172.21.15.146:0/1775665790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0340aa910 con 0x7fc0340b4100 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc031d9b640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0340b4510 0x7fc03414ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:44.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc03259c640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0340b4100 0x7fc034140680 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fc02400b3c0 tx=0x7fc02400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:44.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc022ffd640 1 -- 172.21.15.146:0/1775665790 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024011830 con 0x7fc0340b4100 2024-09-17T03:42:44.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc022ffd640 1 -- 172.21.15.146:0/1775665790 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc024016070 con 0x7fc0340b4100 2024-09-17T03:42:44.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc038fc3640 1 -- 172.21.15.146:0/1775665790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03414df60 con 0x7fc0340b4100 2024-09-17T03:42:44.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc022ffd640 1 -- 172.21.15.146:0/1775665790 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024011da0 con 0x7fc0340b4100 2024-09-17T03:42:44.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.868+0000 7fc038fc3640 1 -- 172.21.15.146:0/1775665790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03414e520 con 0x7fc0340b4100 2024-09-17T03:42:44.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.869+0000 7fc038fc3640 1 -- 172.21.15.146:0/1775665790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc03415c9f0 con 0x7fc0340b4100 2024-09-17T03:42:44.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.870+0000 7fc022ffd640 1 -- 172.21.15.146:0/1775665790 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc02401b460 con 0x7fc0340b4100 2024-09-17T03:42:44.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.870+0000 7fc022ffd640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc014078b90 0x7fc01407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:44.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.871+0000 7fc022ffd640 1 -- 172.21.15.146:0/1775665790 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7fc02409a750 con 0x7fc0340b4100 2024-09-17T03:42:44.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.871+0000 7fc031d9b640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc014078b90 0x7fc01407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:44.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.871+0000 7fc031d9b640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc014078b90 0x7fc01407b0a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc028033000 tx=0x7fc028004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:44.875+0000 7fc022ffd640 1 -- 172.21.15.146:0/1775665790 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc024062e90 con 0x7fc0340b4100 2024-09-17T03:42:45.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:45.117+0000 7fc038fc3640 1 -- 172.21.15.146:0/1775665790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7fc03406b220 con 0x7fc0340b4100 2024-09-17T03:42:46.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.112+0000 7fc022ffd640 1 -- 172.21.15.146:0/1775665790 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v473) ==== 169+0+0 (secure 0 0 0) 0x7fc024062790 con 0x7fc0340b4100 2024-09-17T03:42:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 -- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc014078b90 msgr2=0x7fc01407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc014078b90 0x7fc01407b0a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc028033000 tx=0x7fc028004730 comp rx=0 tx=0).stop 2024-09-17T03:42:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 -- 172.21.15.146:0/1775665790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0340b4100 msgr2=0x7fc034140680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0340b4100 0x7fc034140680 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fc02400b3c0 tx=0x7fc02400b880 comp rx=0 tx=0).stop 2024-09-17T03:42:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 -- 172.21.15.146:0/1775665790 shutdown_connections 2024-09-17T03:42:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc014078b90 0x7fc01407b0a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0341f23f0 0x7fc03414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0340b4510 0x7fc03414ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 --2- 172.21.15.146:0/1775665790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0340b4100 0x7fc034140680 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 -- 172.21.15.146:0/1775665790 >> 172.21.15.146:0/1775665790 conn(0x7fc03406d3c0 msgr2=0x7fc0340b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 -- 172.21.15.146:0/1775665790 shutdown_connections 2024-09-17T03:42:46.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.115+0000 7fc038fc3640 1 -- 172.21.15.146:0/1775665790 wait complete. 2024-09-17T03:42:46.130 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:42:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.251+0000 7fac06d32640 1 -- 172.21.15.146:0/3469651538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabec005350 msgr2=0x7fabec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.251+0000 7fac06d32640 1 --2- 172.21.15.146:0/3469651538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabec005350 0x7fabec00b9c0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009b20 tx=0x7fabec005830 comp rx=0 tx=0).stop 2024-09-17T03:42:46.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.251+0000 7fac06d32640 1 -- 172.21.15.146:0/3469651538 shutdown_connections 2024-09-17T03:42:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.251+0000 7fac06d32640 1 --2- 172.21.15.146:0/3469651538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabec005350 0x7fabec00b9c0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.251+0000 7fac06d32640 1 -- 172.21.15.146:0/3469651538 >> 172.21.15.146:0/3469651538 conn(0x7fac000b2060 msgr2=0x7fac000b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.251+0000 7fac06d32640 1 -- 172.21.15.146:0/3469651538 shutdown_connections 2024-09-17T03:42:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.251+0000 7fac06d32640 1 -- 172.21.15.146:0/3469651538 wait complete. 2024-09-17T03:42:46.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.253+0000 7fac06d32640 1 Processor -- start 2024-09-17T03:42:46.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.253+0000 7fac06d32640 1 -- start start 2024-09-17T03:42:46.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac06d32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabec005350 0x7fac0006ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac06d32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac0015ded0 0x7fac0006f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac06d32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac0014b7c0 0x7fac0014cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac06d32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fac00072f80 con 0x7fabec005350 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac06d32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fac00072e00 con 0x7fac0015ded0 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac06d32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fac0006fe10 con 0x7fac0014b7c0 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac04ace640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabec005350 0x7fac0006ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac04ace640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabec005350 0x7fac0006ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47488/0 (socket says 172.21.15.146:47488) 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac04ace640 1 -- 172.21.15.146:0/2165021307 learned_addr learned my addr 172.21.15.146:0/2165021307 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac052cf640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac0014b7c0 0x7fac0014cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fabfffff640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac0015ded0 0x7fac0006f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac04ace640 1 -- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac0014b7c0 msgr2=0x7fac0014cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac04ace640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac0014b7c0 0x7fac0014cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac04ace640 1 -- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac0015ded0 msgr2=0x7fac0006f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac04ace640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac0015ded0 0x7fac0006f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac04ace640 1 -- 172.21.15.146:0/2165021307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac001f3690 con 0x7fabec005350 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fac052cf640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac0014b7c0 0x7fac0014cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.254+0000 7fabfffff640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac0015ded0 0x7fac0006f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.255+0000 7fac04ace640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabec005350 0x7fac0006ed00 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fabf0006c60 tx=0x7fabf00067a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.255+0000 7fabfd7fa640 1 -- 172.21.15.146:0/2165021307 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf000fad0 con 0x7fabec005350 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.255+0000 7fabfd7fa640 1 -- 172.21.15.146:0/2165021307 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabf000fc90 con 0x7fabec005350 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.255+0000 7fac06d32640 1 -- 172.21.15.146:0/2165021307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac001f3940 con 0x7fabec005350 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.255+0000 7fabfd7fa640 1 -- 172.21.15.146:0/2165021307 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf0011690 con 0x7fabec005350 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.255+0000 7fac06d32640 1 -- 172.21.15.146:0/2165021307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac001f3f00 con 0x7fabec005350 2024-09-17T03:42:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.256+0000 7fac06d32640 1 -- 172.21.15.146:0/2165021307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac00070370 con 0x7fabec005350 2024-09-17T03:42:46.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.257+0000 7fabfd7fa640 1 -- 172.21.15.146:0/2165021307 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fabf0011830 con 0x7fabec005350 2024-09-17T03:42:46.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.257+0000 7fabfd7fa640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fabe0078bc0 0x7fabe007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:46.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.257+0000 7fabfd7fa640 1 -- 172.21.15.146:0/2165021307 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7fabf009b5c0 con 0x7fabec005350 2024-09-17T03:42:46.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.257+0000 7fabfffff640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fabe0078bc0 0x7fabe007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:46.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.258+0000 7fabfffff640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fabe0078bc0 0x7fabe007b0d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fabe8000f70 tx=0x7fabe8006160 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:46.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.262+0000 7fabfd7fa640 1 -- 172.21.15.146:0/2165021307 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fabf0015030 con 0x7fabec005350 2024-09-17T03:42:46.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.438+0000 7fac06d32640 1 -- 172.21.15.146:0/2165021307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fac00157a00 con 0x7fabec005350 2024-09-17T03:42:46.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.438+0000 7fabfd7fa640 1 -- 172.21.15.146:0/2165021307 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v57) ==== 59+0+2294 (secure 0 0 0) 0x7fac0015bb80 con 0x7fabec005350 2024-09-17T03:42:46.438 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:42:46.439 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:42:46.440 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:42:46.441 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:42:46.441 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:42:46.441 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:42:46.441 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:42:46.441 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:42:46.441 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:42:46.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.440+0000 7fac06d32640 1 -- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fabe0078bc0 msgr2=0x7fabe007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.440+0000 7fac06d32640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fabe0078bc0 0x7fabe007b0d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fabe8000f70 tx=0x7fabe8006160 comp rx=0 tx=0).stop 2024-09-17T03:42:46.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.440+0000 7fac06d32640 1 -- 172.21.15.146:0/2165021307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabec005350 msgr2=0x7fac0006ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.440+0000 7fac06d32640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabec005350 0x7fac0006ed00 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fabf0006c60 tx=0x7fabf00067a0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.441+0000 7fac06d32640 1 -- 172.21.15.146:0/2165021307 shutdown_connections 2024-09-17T03:42:46.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.441+0000 7fac06d32640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fabe0078bc0 0x7fabe007b0d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.441+0000 7fac06d32640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac0014b7c0 0x7fac0014cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.441+0000 7fac06d32640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac0015ded0 0x7fac0006f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.441+0000 7fac06d32640 1 --2- 172.21.15.146:0/2165021307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabec005350 0x7fac0006ed00 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.441+0000 7fac06d32640 1 -- 172.21.15.146:0/2165021307 >> 172.21.15.146:0/2165021307 conn(0x7fac000b2060 msgr2=0x7fac00155870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:46.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.441+0000 7fac06d32640 1 -- 172.21.15.146:0/2165021307 shutdown_connections 2024-09-17T03:42:46.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.441+0000 7fac06d32640 1 -- 172.21.15.146:0/2165021307 wait complete. 2024-09-17T03:42:46.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:42:46.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.569+0000 7f6effd20640 1 -- 172.21.15.146:0/1894794589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef80d0710 msgr2=0x7f6ef80cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.569+0000 7f6effd20640 1 --2- 172.21.15.146:0/1894794589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef80d0710 0x7f6ef80cf170 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80743d0 tx=0x7f6ef002a4f0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.569+0000 7f6effd20640 1 -- 172.21.15.146:0/1894794589 shutdown_connections 2024-09-17T03:42:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.569+0000 7f6effd20640 1 --2- 172.21.15.146:0/1894794589 >> v2:172.21.15.179:3300/0 conn(0x7f6ef80b47c0 0x7f6ef8161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.569+0000 7f6effd20640 1 --2- 172.21.15.146:0/1894794589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ef80cf6b0 0x7f6ef8161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.569+0000 7f6effd20640 1 --2- 172.21.15.146:0/1894794589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef80d0710 0x7f6ef80cf170 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.569+0000 7f6effd20640 1 -- 172.21.15.146:0/1894794589 >> 172.21.15.146:0/1894794589 conn(0x7f6ef809ba20 msgr2=0x7f6ef80b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.569+0000 7f6effd20640 1 -- 172.21.15.146:0/1894794589 shutdown_connections 2024-09-17T03:42:46.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.569+0000 7f6effd20640 1 -- 172.21.15.146:0/1894794589 wait complete. 2024-09-17T03:42:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.571+0000 7f6effd20640 1 Processor -- start 2024-09-17T03:42:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.571+0000 7f6effd20640 1 -- start start 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.572+0000 7f6effd20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef80b47c0 0x7f6ef8159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.572+0000 7f6effd20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ef80cf6b0 0x7f6ef8156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.572+0000 7f6effd20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ef80d0710 0x7f6ef8156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.572+0000 7f6effd20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef8162030 con 0x7f6ef80b47c0 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.572+0000 7f6effd20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef8161eb0 con 0x7f6ef80cf6b0 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.572+0000 7f6effd20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef80cd090 con 0x7f6ef80d0710 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.572+0000 7f6efdabc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef80b47c0 0x7f6ef8159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.572+0000 7f6efdabc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef80b47c0 0x7f6ef8159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47504/0 (socket says 172.21.15.146:47504) 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.572+0000 7f6efdabc640 1 -- 172.21.15.146:0/1343279611 learned_addr learned my addr 172.21.15.146:0/1343279611 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.572+0000 7f6efe2bd640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ef80d0710 0x7f6ef8156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.572+0000 7f6efd2bb640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ef80cf6b0 0x7f6ef8156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6efdabc640 1 -- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ef80d0710 msgr2=0x7f6ef8156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6efdabc640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ef80d0710 0x7f6ef8156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6efdabc640 1 -- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ef80cf6b0 msgr2=0x7f6ef8156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6efdabc640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ef80cf6b0 0x7f6ef8156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6efdabc640 1 -- 172.21.15.146:0/1343279611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef815c160 con 0x7f6ef80b47c0 2024-09-17T03:42:46.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6efe2bd640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ef80d0710 0x7f6ef8156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:46.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6efd2bb640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ef80cf6b0 0x7f6ef8156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:46.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6efdabc640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef80b47c0 0x7f6ef8159c60 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0000c00 tx=0x7f6ef0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:46.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6eee7fc640 1 -- 172.21.15.146:0/1343279611 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef003e030 con 0x7f6ef80b47c0 2024-09-17T03:42:46.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6eee7fc640 1 -- 172.21.15.146:0/1343279611 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ef0003e60 con 0x7f6ef80b47c0 2024-09-17T03:42:46.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6effd20640 1 -- 172.21.15.146:0/1343279611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef815a4e0 con 0x7f6ef80b47c0 2024-09-17T03:42:46.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6eee7fc640 1 -- 172.21.15.146:0/1343279611 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0035040 con 0x7f6ef80b47c0 2024-09-17T03:42:46.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.573+0000 7f6effd20640 1 -- 172.21.15.146:0/1343279611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef80b2a90 con 0x7f6ef80b47c0 2024-09-17T03:42:46.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.574+0000 7f6effd20640 1 -- 172.21.15.146:0/1343279611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef80cf170 con 0x7f6ef80b47c0 2024-09-17T03:42:46.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.575+0000 7f6eee7fc640 1 -- 172.21.15.146:0/1343279611 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ef0041030 con 0x7f6ef80b47c0 2024-09-17T03:42:46.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.575+0000 7f6eee7fc640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6edc078b90 0x7f6edc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:46.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.575+0000 7f6eee7fc640 1 -- 172.21.15.146:0/1343279611 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7f6ef00bb410 con 0x7f6ef80b47c0 2024-09-17T03:42:46.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.576+0000 7f6efd2bb640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6edc078b90 0x7f6edc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:46.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.576+0000 7f6efd2bb640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6edc078b90 0x7f6edc07b0a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8005fd0 tx=0x7f6ee8005e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:46.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.580+0000 7f6eee7fc640 1 -- 172.21.15.146:0/1343279611 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ef0083ad0 con 0x7f6ef80b47c0 2024-09-17T03:42:46.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.754+0000 7f6effd20640 1 -- 172.21.15.146:0/1343279611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6ef80ced70 con 0x7f6ef80b47c0 2024-09-17T03:42:46.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.758+0000 7f6eee7fc640 1 -- 172.21.15.146:0/1343279611 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) ==== 122+0+0 (secure 0 0 0) 0x7f6ef00833d0 con 0x7f6ef80b47c0 2024-09-17T03:42:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 -- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6edc078b90 msgr2=0x7f6edc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6edc078b90 0x7f6edc07b0a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8005fd0 tx=0x7f6ee8005e20 comp rx=0 tx=0).stop 2024-09-17T03:42:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 -- 172.21.15.146:0/1343279611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef80b47c0 msgr2=0x7f6ef8159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef80b47c0 0x7f6ef8159c60 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0000c00 tx=0x7f6ef0003970 comp rx=0 tx=0).stop 2024-09-17T03:42:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 -- 172.21.15.146:0/1343279611 shutdown_connections 2024-09-17T03:42:46.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6edc078b90 0x7f6edc07b0a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ef80d0710 0x7f6ef8156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ef80cf6b0 0x7f6ef8156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 --2- 172.21.15.146:0/1343279611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ef80b47c0 0x7f6ef8159c60 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:46.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 -- 172.21.15.146:0/1343279611 >> 172.21.15.146:0/1343279611 conn(0x7f6ef809ba20 msgr2=0x7f6ef80d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:46.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 -- 172.21.15.146:0/1343279611 shutdown_connections 2024-09-17T03:42:46.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:46.761+0000 7f6effd20640 1 -- 172.21.15.146:0/1343279611 wait complete. 2024-09-17T03:42:46.772 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:42:46.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:42:46.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:42:46.854 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:42:46.921 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:42:46.921 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:42:46.937 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:42:46.937 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:42:46.937 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:42:46.956 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:42:46.957 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:42:46.957 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:42:46.993 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:42:46.993 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:42:46.993 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:42:47.015 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:42:47.015 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:42:47.015 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:47.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.146+0000 7f0484ed3640 1 -- 172.21.15.146:0/1448015354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04800b4f20 msgr2=0x7f04800b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:47.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.146+0000 7f0484ed3640 1 --2- 172.21.15.146:0/1448015354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04800b4f20 0x7f04800b5600 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f0470005fd0 tx=0x7f047002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.146+0000 7f0484ed3640 1 -- 172.21.15.146:0/1448015354 shutdown_connections 2024-09-17T03:42:47.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.146+0000 7f0484ed3640 1 --2- 172.21.15.146:0/1448015354 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04800b08d0 0x7f04800b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.146+0000 7f0484ed3640 1 --2- 172.21.15.146:0/1448015354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04800b4f20 0x7f04800b5600 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.146+0000 7f0484ed3640 1 -- 172.21.15.146:0/1448015354 >> 172.21.15.146:0/1448015354 conn(0x7f048009ba20 msgr2=0x7f04800b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:47.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.146+0000 7f0484ed3640 1 -- 172.21.15.146:0/1448015354 shutdown_connections 2024-09-17T03:42:47.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.146+0000 7f0484ed3640 1 -- 172.21.15.146:0/1448015354 wait complete. 2024-09-17T03:42:47.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.148+0000 7f0484ed3640 1 Processor -- start 2024-09-17T03:42:47.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.148+0000 7f0484ed3640 1 -- start start 2024-09-17T03:42:47.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.149+0000 7f0484ed3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04800b08d0 0x7f04800a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:47.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.149+0000 7f0484ed3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04800b3250 0x7f048009d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:47.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.149+0000 7f0484ed3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04800b4f20 0x7f048015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:47.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0484ed3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f04800b1430 con 0x7f04800b3250 2024-09-17T03:42:47.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0484ed3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0480160b70 con 0x7f04800b4f20 2024-09-17T03:42:47.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0484ed3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f048009cd50 con 0x7f04800b08d0 2024-09-17T03:42:47.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0475d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04800b3250 0x7f048009d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:47.151 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0475d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04800b3250 0x7f048009d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50638/0 (socket says 172.21.15.146:50638) 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0475d9b640 1 -- 172.21.15.146:0/1751165076 learned_addr learned my addr 172.21.15.146:0/1751165076 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f047e59c640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04800b08d0 0x7f04800a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f047ed9d640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04800b4f20 0x7f048015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0475d9b640 1 -- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04800b08d0 msgr2=0x7f04800a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0475d9b640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04800b08d0 0x7f04800a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0475d9b640 1 -- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04800b4f20 msgr2=0x7f048015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0475d9b640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04800b4f20 0x7f048015bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0475d9b640 1 -- 172.21.15.146:0/1751165076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04801f7100 con 0x7f04800b3250 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0475d9b640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04800b3250 0x7f048009d510 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f046800c370 tx=0x7f046800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f04777fe640 1 -- 172.21.15.146:0/1751165076 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468017070 con 0x7f04800b3250 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f04777fe640 1 -- 172.21.15.146:0/1751165076 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04680053c0 con 0x7f04800b3250 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0484ed3640 1 -- 172.21.15.146:0/1751165076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04801f73e0 con 0x7f04800b3250 2024-09-17T03:42:47.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f04777fe640 1 -- 172.21.15.146:0/1751165076 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468003850 con 0x7f04800b3250 2024-09-17T03:42:47.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.150+0000 7f0484ed3640 1 -- 172.21.15.146:0/1751165076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048009ca90 con 0x7f04800b3250 2024-09-17T03:42:47.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.151+0000 7f0484ed3640 1 -- 172.21.15.146:0/1751165076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04800b0ce0 con 0x7f04800b3250 2024-09-17T03:42:47.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.152+0000 7f04777fe640 1 -- 172.21.15.146:0/1751165076 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f046801a070 con 0x7f04800b3250 2024-09-17T03:42:47.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.153+0000 7f04777fe640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0460078b90 0x7f046007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:47.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.153+0000 7f04777fe640 1 -- 172.21.15.146:0/1751165076 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7f0468099d00 con 0x7f04800b3250 2024-09-17T03:42:47.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.153+0000 7f047e59c640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0460078b90 0x7f046007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:47.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.154+0000 7f047e59c640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0460078b90 0x7f046007b0a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0470033000 tx=0x7f0470004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:47.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.157+0000 7f04777fe640 1 -- 172.21.15.146:0/1751165076 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0468061e00 con 0x7f04800b3250 2024-09-17T03:42:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.368+0000 7f0484ed3640 1 -- 172.21.15.146:0/1751165076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0480071380 con 0x7f04800b3250 2024-09-17T03:42:47.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.369+0000 7f04777fe640 1 -- 172.21.15.146:0/1751165076 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+3922 (secure 0 0 0) 0x7f0468066830 con 0x7f04800b3250 2024-09-17T03:42:47.369 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:47.369 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":106,"btime":"2024-09-17T03:42:40:922485+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7376,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3407118078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3407118078},{"type":"v1","addr":"172.21.15.179:6836","nonce":3407118078}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":7379,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/716072936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":716072936},{"type":"v1","addr":"172.21.15.179:6837","nonce":716072936}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":8122,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2003795849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2003795849},{"type":"v1","addr":"172.21.15.146:6835","nonce":2003795849}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":99},{"gid":9690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1473110160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1473110160},{"type":"v1","addr":"172.21.15.146:6834","nonce":1473110160}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[]} 2024-09-17T03:42:47.369 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 106 2024-09-17T03:42:47.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 -- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0460078b90 msgr2=0x7f046007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:47.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0460078b90 0x7f046007b0a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0470033000 tx=0x7f0470004730 comp rx=0 tx=0).stop 2024-09-17T03:42:47.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 -- 172.21.15.146:0/1751165076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04800b3250 msgr2=0x7f048009d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:47.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04800b3250 0x7f048009d510 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f046800c370 tx=0x7f046800c830 comp rx=0 tx=0).stop 2024-09-17T03:42:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 -- 172.21.15.146:0/1751165076 shutdown_connections 2024-09-17T03:42:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0460078b90 0x7f046007b0a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04800b4f20 0x7f048015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04800b3250 0x7f048009d510 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 --2- 172.21.15.146:0/1751165076 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04800b08d0 0x7f04800a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 -- 172.21.15.146:0/1751165076 >> 172.21.15.146:0/1751165076 conn(0x7f048009ba20 msgr2=0x7f04800cef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 -- 172.21.15.146:0/1751165076 shutdown_connections 2024-09-17T03:42:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.371+0000 7f0484ed3640 1 -- 172.21.15.146:0/1751165076 wait complete. 2024-09-17T03:42:47.383 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:42:47.383 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:42:47.383 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:42:47.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:42:47.384 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:42:47.384 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:42:47.384 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:42:47.384 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:42:47.384 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:42:47.384 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:42:47.384 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:42:47.385 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:42:47.385 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:42:47.385 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:42:47.385 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:42:47.385 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:42:47.393 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:42:47.393 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:42:47.396 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:42:47.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:42:47.397 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:42:47.397 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:42:47.398 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:42:47.398 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:42:47.439 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:42:47.439 DEBUG:teuthology.parallel:result is None 2024-09-17T03:42:47.440 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:42:47.440 DEBUG:teuthology.parallel:result is None 2024-09-17T03:42:47.441 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:42:47.441 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:42:47.441 DEBUG:teuthology.parallel:result is None 2024-09-17T03:42:47.441 DEBUG:teuthology.parallel:result is None 2024-09-17T03:42:47.442 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:42:47.526 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:42:47.527 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:42:47.534 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:42:47.534 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:42:47.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.563+0000 7fb657e4d640 1 -- 172.21.15.146:0/4083363326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb63c005350 msgr2=0x7fb63c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:47.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.563+0000 7fb657e4d640 1 --2- 172.21.15.146:0/4083363326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb63c005350 0x7fb63c00b9c0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fb648009ed0 tx=0x7fb63c005830 comp rx=0 tx=0).stop 2024-09-17T03:42:47.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.563+0000 7fb657e4d640 1 -- 172.21.15.146:0/4083363326 shutdown_connections 2024-09-17T03:42:47.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.563+0000 7fb657e4d640 1 --2- 172.21.15.146:0/4083363326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb63c005350 0x7fb63c00b9c0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.563+0000 7fb657e4d640 1 -- 172.21.15.146:0/4083363326 >> 172.21.15.146:0/4083363326 conn(0x7fb65009ba20 msgr2=0x7fb6500b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:47.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.563+0000 7fb657e4d640 1 -- 172.21.15.146:0/4083363326 shutdown_connections 2024-09-17T03:42:47.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.563+0000 7fb657e4d640 1 -- 172.21.15.146:0/4083363326 wait complete. 2024-09-17T03:42:47.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.565+0000 7fb657e4d640 1 Processor -- start 2024-09-17T03:42:47.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.565+0000 7fb657e4d640 1 -- start start 2024-09-17T03:42:47.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.566+0000 7fb657e4d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb63c005350 0x7fb6501e5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.566+0000 7fb657e4d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6501e6250 0x7fb6500ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.566+0000 7fb657e4d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6500ca740 0x7fb6500cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.566+0000 7fb657e4d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb6500cdf40 con 0x7fb6500ca740 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.566+0000 7fb657e4d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb6500cddc0 con 0x7fb63c005350 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.566+0000 7fb657e4d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb6500cd090 con 0x7fb6501e6250 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.566+0000 7fb6563ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6500ca740 0x7fb6500cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.566+0000 7fb6563ea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6500ca740 0x7fb6500cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50682/0 (socket says 172.21.15.146:50682) 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.566+0000 7fb6563ea640 1 -- 172.21.15.146:0/1056405936 learned_addr learned my addr 172.21.15.146:0/1056405936 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.566+0000 7fb655be9640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb63c005350 0x7fb6501e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.566+0000 7fb6553e8640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6501e6250 0x7fb6500ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb6563ea640 1 -- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6501e6250 msgr2=0x7fb6500ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb6563ea640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6501e6250 0x7fb6500ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb6563ea640 1 -- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb63c005350 msgr2=0x7fb6501e5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb6563ea640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb63c005350 0x7fb6501e5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb6563ea640 1 -- 172.21.15.146:0/1056405936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6500cc750 con 0x7fb6500ca740 2024-09-17T03:42:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb655be9640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb63c005350 0x7fb6501e5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb6563ea640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6500ca740 0x7fb6500cab50 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fb648009e20 tx=0x7fb6480042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb6427fc640 1 -- 172.21.15.146:0/1056405936 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6480046d0 con 0x7fb6500ca740 2024-09-17T03:42:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb6427fc640 1 -- 172.21.15.146:0/1056405936 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb64803c480 con 0x7fb6500ca740 2024-09-17T03:42:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb657e4d640 1 -- 172.21.15.146:0/1056405936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6500cc020 con 0x7fb6500ca740 2024-09-17T03:42:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb6427fc640 1 -- 172.21.15.146:0/1056405936 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64803c890 con 0x7fb6500ca740 2024-09-17T03:42:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.567+0000 7fb657e4d640 1 -- 172.21.15.146:0/1056405936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6500c9720 con 0x7fb6500ca740 2024-09-17T03:42:47.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.568+0000 7fb657e4d640 1 -- 172.21.15.146:0/1056405936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6500cd590 con 0x7fb6500ca740 2024-09-17T03:42:47.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.569+0000 7fb6427fc640 1 -- 172.21.15.146:0/1056405936 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb648044020 con 0x7fb6500ca740 2024-09-17T03:42:47.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.569+0000 7fb6427fc640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb634078b90 0x7fb63407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:47.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.569+0000 7fb6427fc640 1 -- 172.21.15.146:0/1056405936 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 4943+0+0 (secure 0 0 0) 0x7fb6480bbad0 con 0x7fb6500ca740 2024-09-17T03:42:47.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.570+0000 7fb655be9640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb634078b90 0x7fb63407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:47.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.570+0000 7fb655be9640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb634078b90 0x7fb63407b0a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb64c000c00 tx=0x7fb64c006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:47.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.574+0000 7fb6427fc640 1 -- 172.21.15.146:0/1056405936 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb64804b020 con 0x7fb6500ca740 2024-09-17T03:42:47.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:47.759+0000 7fb657e4d640 1 -- 172.21.15.146:0/1056405936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb6500cfd50 con 0x7fb6500ca740 2024-09-17T03:42:48.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.128+0000 7fb6427fc640 1 -- 172.21.15.146:0/1056405936 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v148) ==== 97+0+0 (secure 0 0 0) 0x7fb6500cc020 con 0x7fb6500ca740 2024-09-17T03:42:48.128 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:42:48.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 -- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb634078b90 msgr2=0x7fb63407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb634078b90 0x7fb63407b0a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb64c000c00 tx=0x7fb64c006b10 comp rx=0 tx=0).stop 2024-09-17T03:42:48.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 -- 172.21.15.146:0/1056405936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6500ca740 msgr2=0x7fb6500cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6500ca740 0x7fb6500cab50 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fb648009e20 tx=0x7fb6480042d0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 -- 172.21.15.146:0/1056405936 shutdown_connections 2024-09-17T03:42:48.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb634078b90 0x7fb63407b0a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6500ca740 0x7fb6500cab50 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6501e6250 0x7fb6500ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 --2- 172.21.15.146:0/1056405936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb63c005350 0x7fb6501e5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 -- 172.21.15.146:0/1056405936 >> 172.21.15.146:0/1056405936 conn(0x7fb65009ba20 msgr2=0x7fb650071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:48.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 -- 172.21.15.146:0/1056405936 shutdown_connections 2024-09-17T03:42:48.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.131+0000 7fb657e4d640 1 -- 172.21.15.146:0/1056405936 wait complete. 2024-09-17T03:42:48.144 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:42:48.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.256+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1411761110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ec8073480 msgr2=0x7f9ec8073890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.256+0000 7f9ecfde4640 1 --2- 172.21.15.146:0/1411761110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ec8073480 0x7f9ec8073890 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0005fd0 tx=0x7f9ec002a9f0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.256+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1411761110 shutdown_connections 2024-09-17T03:42:48.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.256+0000 7f9ecfde4640 1 --2- 172.21.15.146:0/1411761110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ec8073480 0x7f9ec8073890 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.256+0000 7f9ecfde4640 1 --2- 172.21.15.146:0/1411761110 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec8160c00 0x7f9ec815d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.256+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1411761110 >> 172.21.15.146:0/1411761110 conn(0x7f9ec80b2060 msgr2=0x7f9ec80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:48.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.256+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1411761110 shutdown_connections 2024-09-17T03:42:48.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.256+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1411761110 wait complete. 2024-09-17T03:42:48.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.258+0000 7f9ecfde4640 1 Processor -- start 2024-09-17T03:42:48.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.258+0000 7f9ecfde4640 1 -- start start 2024-09-17T03:42:48.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ecfde4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ec8073480 0x7f9ec8151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ecfde4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec8153a60 0x7f9ec814b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ecfde4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ec8159860 0x7f9ec8159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ecfde4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec8073f50 con 0x7f9ec8159860 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ecfde4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec8073dd0 con 0x7f9ec8073480 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ecfde4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec80740d0 con 0x7f9ec8153a60 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ece381640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ec8159860 0x7f9ec8159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ece381640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ec8159860 0x7f9ec8159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50706/0 (socket says 172.21.15.146:50706) 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ece381640 1 -- 172.21.15.146:0/1349398039 learned_addr learned my addr 172.21.15.146:0/1349398039 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ecdb80640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ec8073480 0x7f9ec8151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ecd37f640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec8153a60 0x7f9ec814b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ece381640 1 -- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec8153a60 msgr2=0x7f9ec814b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ece381640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec8153a60 0x7f9ec814b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ece381640 1 -- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ec8073480 msgr2=0x7f9ec8151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.259+0000 7f9ece381640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ec8073480 0x7f9ec8151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.260+0000 7f9ece381640 1 -- 172.21.15.146:0/1349398039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec81f4520 con 0x7f9ec8159860 2024-09-17T03:42:48.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.260+0000 7f9ece381640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ec8159860 0x7f9ec8159c70 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009d90 tx=0x7f9ec0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:48.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.260+0000 7f9ebe7fc640 1 -- 172.21.15.146:0/1349398039 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0033050 con 0x7f9ec8159860 2024-09-17T03:42:48.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.260+0000 7f9ebe7fc640 1 -- 172.21.15.146:0/1349398039 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ec0004450 con 0x7f9ec8159860 2024-09-17T03:42:48.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.260+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1349398039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec8158070 con 0x7f9ec8159860 2024-09-17T03:42:48.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.260+0000 7f9ebe7fc640 1 -- 172.21.15.146:0/1349398039 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0038450 con 0x7f9ec8159860 2024-09-17T03:42:48.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.260+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1349398039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec8158350 con 0x7f9ec8159860 2024-09-17T03:42:48.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.261+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1349398039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec8073890 con 0x7f9ec8159860 2024-09-17T03:42:48.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.262+0000 7f9ebe7fc640 1 -- 172.21.15.146:0/1349398039 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ec0036070 con 0x7f9ec8159860 2024-09-17T03:42:48.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.262+0000 7f9ebe7fc640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9eac078b90 0x7f9eac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.263+0000 7f9ebe7fc640 1 -- 172.21.15.146:0/1349398039 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4857+0+0 (secure 0 0 0) 0x7f9ec00bbd60 con 0x7f9ec8159860 2024-09-17T03:42:48.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.263+0000 7f9ecdb80640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9eac078b90 0x7f9eac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:48.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.263+0000 7f9ecdb80640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9eac078b90 0x7f9eac07b0a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4006fd0 tx=0x7f9ec4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:48.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.266+0000 7f9ebe7fc640 1 -- 172.21.15.146:0/1349398039 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9ec0084010 con 0x7f9ec8159860 2024-09-17T03:42:48.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.510+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1349398039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9ec80afb20 con 0x7f9ec8159860 2024-09-17T03:42:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.511+0000 7f9ebe7fc640 1 -- 172.21.15.146:0/1349398039 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7f9ec0088a40 con 0x7f9ec8159860 2024-09-17T03:42:48.511 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:48.511 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:42:48.511 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:42:48.511 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.512 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:42:48.512 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:42:48.512 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.512 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:42:48.512 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:42:48.512 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:42:48.512 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.512 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.512 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.512 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.512 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:42:48.513 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.514 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:42:48.515 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.517 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:42:48.519 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:42:48.521 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:42:48.522 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.523 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:42:48.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:42:48.525 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.525 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.525 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:42:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:42:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9eac078b90 msgr2=0x7f9eac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9eac078b90 0x7f9eac07b0a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4006fd0 tx=0x7f9ec4009060 comp rx=0 tx=0).stop 2024-09-17T03:42:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1349398039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ec8159860 msgr2=0x7f9ec8159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ec8159860 0x7f9ec8159c70 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009d90 tx=0x7f9ec0003f10 comp rx=0 tx=0).stop 2024-09-17T03:42:48.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1349398039 shutdown_connections 2024-09-17T03:42:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9eac078b90 0x7f9eac07b0a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ec8159860 0x7f9ec8159c70 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec8153a60 0x7f9ec814b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 --2- 172.21.15.146:0/1349398039 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ec8073480 0x7f9ec8151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1349398039 >> 172.21.15.146:0/1349398039 conn(0x7f9ec80b2060 msgr2=0x7f9ec8152b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1349398039 shutdown_connections 2024-09-17T03:42:48.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.513+0000 7f9ecfde4640 1 -- 172.21.15.146:0/1349398039 wait complete. 2024-09-17T03:42:48.527 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:42:48.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.640+0000 7f4b412c4640 1 -- 172.21.15.146:0/4103116040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3c0b5ce0 msgr2=0x7f4b3c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.640+0000 7f4b412c4640 1 --2- 172.21.15.146:0/4103116040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3c0b5ce0 0x7f4b3c0b1320 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0b6120 tx=0x7f4b2c02aac0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.640+0000 7f4b412c4640 1 -- 172.21.15.146:0/4103116040 shutdown_connections 2024-09-17T03:42:48.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.640+0000 7f4b412c4640 1 --2- 172.21.15.146:0/4103116040 >> v2:172.21.15.179:3300/0 conn(0x7f4b3c0b3d30 0x7f4b3c15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.640+0000 7f4b412c4640 1 --2- 172.21.15.146:0/4103116040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3c0b5ce0 0x7f4b3c0b1320 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.640+0000 7f4b412c4640 1 -- 172.21.15.146:0/4103116040 >> 172.21.15.146:0/4103116040 conn(0x7f4b3c0b7b20 msgr2=0x7f4b3c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:48.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.640+0000 7f4b412c4640 1 -- 172.21.15.146:0/4103116040 shutdown_connections 2024-09-17T03:42:48.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.640+0000 7f4b412c4640 1 -- 172.21.15.146:0/4103116040 wait complete. 2024-09-17T03:42:48.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.642+0000 7f4b412c4640 1 Processor -- start 2024-09-17T03:42:48.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.642+0000 7f4b412c4640 1 -- start start 2024-09-17T03:42:48.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.643+0000 7f4b412c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3c0b5750 0x7f4b3c09c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.643+0000 7f4b412c4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b3c0b5ce0 0x7f4b3c1e6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.643+0000 7f4b412c4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b3c1f32b0 0x7f4b3c1e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.643+0000 7f4b412c4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c15d480 con 0x7f4b3c0b5750 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.643+0000 7f4b412c4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c15d300 con 0x7f4b3c1f32b0 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.643+0000 7f4b412c4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4b3c15d600 con 0x7f4b3c0b5ce0 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.643+0000 7f4b3affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3c0b5750 0x7f4b3c09c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.643+0000 7f4b3affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3c0b5750 0x7f4b3c09c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50720/0 (socket says 172.21.15.146:50720) 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.643+0000 7f4b3affd640 1 -- 172.21.15.146:0/322598703 learned_addr learned my addr 172.21.15.146:0/322598703 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.644+0000 7f4b3affd640 1 -- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b3c0b5ce0 msgr2=0x7f4b3c1e6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.644+0000 7f4b3affd640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b3c0b5ce0 0x7f4b3c1e6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.644+0000 7f4b3affd640 1 -- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b3c1f32b0 msgr2=0x7f4b3c1e7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.644+0000 7f4b3affd640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b3c1f32b0 0x7f4b3c1e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.644+0000 7f4b3affd640 1 -- 172.21.15.146:0/322598703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c09cc30 con 0x7f4b3c0b5750 2024-09-17T03:42:48.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.644+0000 7f4b3affd640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3c0b5750 0x7f4b3c09c6f0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009d60 tx=0x7f4b2c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:48.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.644+0000 7f4b237fe640 1 -- 172.21.15.146:0/322598703 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c004250 con 0x7f4b3c0b5750 2024-09-17T03:42:48.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.644+0000 7f4b237fe640 1 -- 172.21.15.146:0/322598703 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b2c0043f0 con 0x7f4b3c0b5750 2024-09-17T03:42:48.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.644+0000 7f4b237fe640 1 -- 172.21.15.146:0/322598703 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c004820 con 0x7f4b3c0b5750 2024-09-17T03:42:48.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.644+0000 7f4b412c4640 1 -- 172.21.15.146:0/322598703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c1f3e10 con 0x7f4b3c0b5750 2024-09-17T03:42:48.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.644+0000 7f4b412c4640 1 -- 172.21.15.146:0/322598703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c1e7230 con 0x7f4b3c0b5750 2024-09-17T03:42:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.645+0000 7f4b412c4640 1 -- 172.21.15.146:0/322598703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b3c1e7020 con 0x7f4b3c0b5750 2024-09-17T03:42:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.646+0000 7f4b237fe640 1 -- 172.21.15.146:0/322598703 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4b2c049430 con 0x7f4b3c0b5750 2024-09-17T03:42:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.646+0000 7f4b237fe640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078bc0 0x7f4b2807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.647+0000 7f4b237fe640 1 -- 172.21.15.146:0/322598703 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4857+0+0 (secure 0 0 0) 0x7f4b2c0bb7d0 con 0x7f4b3c0b5750 2024-09-17T03:42:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.647+0000 7f4b3a7fc640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078bc0 0x7f4b2807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.647+0000 7f4b3a7fc640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078bc0 0x7f4b2807b0d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4b30000f60 tx=0x7f4b300079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:48.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.651+0000 7f4b237fe640 1 -- 172.21.15.146:0/322598703 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4b2c032030 con 0x7f4b3c0b5750 2024-09-17T03:42:48.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.827+0000 7f4b412c4640 1 -- 172.21.15.146:0/322598703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4b3c15db20 con 0x7f4b3c0b5750 2024-09-17T03:42:48.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.828+0000 7f4b237fe640 1 -- 172.21.15.146:0/322598703 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v150) ==== 84+0+65 (secure 0 0 0) 0x7f4b2c083f60 con 0x7f4b3c0b5750 2024-09-17T03:42:48.828 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:48.828 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:42:48.828 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:42:48.828 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:42:48.828 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:42:48.828 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:42:48.828 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:42:48.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 -- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078bc0 msgr2=0x7f4b2807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078bc0 0x7f4b2807b0d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4b30000f60 tx=0x7f4b300079b0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 -- 172.21.15.146:0/322598703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3c0b5750 msgr2=0x7f4b3c09c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3c0b5750 0x7f4b3c09c6f0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009d60 tx=0x7f4b2c003ce0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 -- 172.21.15.146:0/322598703 shutdown_connections 2024-09-17T03:42:48.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4b28078bc0 0x7f4b2807b0d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4b3c1f32b0 0x7f4b3c1e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4b3c0b5ce0 0x7f4b3c1e6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 --2- 172.21.15.146:0/322598703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b3c0b5750 0x7f4b3c09c6f0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 -- 172.21.15.146:0/322598703 >> 172.21.15.146:0/322598703 conn(0x7f4b3c0b7b20 msgr2=0x7f4b3c153e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:48.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 -- 172.21.15.146:0/322598703 shutdown_connections 2024-09-17T03:42:48.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.830+0000 7f4b412c4640 1 -- 172.21.15.146:0/322598703 wait complete. 2024-09-17T03:42:48.842 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:42:48.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:42:48.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.960+0000 7f1d9b263640 1 -- 172.21.15.146:0/980034486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d940b5750 msgr2=0x7f1d940b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.960+0000 7f1d9b263640 1 --2- 172.21.15.146:0/980034486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d940b5750 0x7f1d940b3620 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009860 tx=0x7f1d8002a530 comp rx=0 tx=0).stop 2024-09-17T03:42:48.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.960+0000 7f1d9b263640 1 -- 172.21.15.146:0/980034486 shutdown_connections 2024-09-17T03:42:48.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.960+0000 7f1d9b263640 1 --2- 172.21.15.146:0/980034486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d940b5750 0x7f1d940b3620 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.960+0000 7f1d9b263640 1 -- 172.21.15.146:0/980034486 >> 172.21.15.146:0/980034486 conn(0x7f1d940b7b20 msgr2=0x7f1d9409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:48.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.960+0000 7f1d9b263640 1 -- 172.21.15.146:0/980034486 shutdown_connections 2024-09-17T03:42:48.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.960+0000 7f1d9b263640 1 -- 172.21.15.146:0/980034486 wait complete. 2024-09-17T03:42:48.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.962+0000 7f1d9b263640 1 Processor -- start 2024-09-17T03:42:48.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.962+0000 7f1d9b263640 1 -- start start 2024-09-17T03:42:48.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.963+0000 7f1d9b263640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d940b3b60 0x7f1d940c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.963+0000 7f1d9b263640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d940b5750 0x7f1d94146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.963+0000 7f1d9b263640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d940b5ce0 0x7f1d9415ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.963+0000 7f1d9b263640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9415d640 con 0x7f1d940b5ce0 2024-09-17T03:42:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.963+0000 7f1d9b263640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9415d4c0 con 0x7f1d940b5750 2024-09-17T03:42:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.963+0000 7f1d9b263640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1d9415d7c0 con 0x7f1d940b3b60 2024-09-17T03:42:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.963+0000 7f1d99800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d940b5ce0 0x7f1d9415ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.963+0000 7f1d99800640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d940b5ce0 0x7f1d9415ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50734/0 (socket says 172.21.15.146:50734) 2024-09-17T03:42:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.963+0000 7f1d99800640 1 -- 172.21.15.146:0/2099807953 learned_addr learned my addr 172.21.15.146:0/2099807953 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.963+0000 7f1d98fff640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d940b3b60 0x7f1d940c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.963+0000 7f1d93fff640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d940b5750 0x7f1d94146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.964+0000 7f1d99800640 1 -- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d940b3b60 msgr2=0x7f1d940c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.964+0000 7f1d99800640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d940b3b60 0x7f1d940c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.964+0000 7f1d99800640 1 -- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d940b5750 msgr2=0x7f1d94146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.964+0000 7f1d99800640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d940b5750 0x7f1d94146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.964+0000 7f1d99800640 1 -- 172.21.15.146:0/2099807953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d94149470 con 0x7f1d940b5ce0 2024-09-17T03:42:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.964+0000 7f1d99800640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d940b5ce0 0x7f1d9415ef60 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c700 tx=0x7f1d8c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.964+0000 7f1d917fa640 1 -- 172.21.15.146:0/2099807953 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c003b70 con 0x7f1d940b5ce0 2024-09-17T03:42:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.964+0000 7f1d917fa640 1 -- 172.21.15.146:0/2099807953 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d8c003d10 con 0x7f1d940b5ce0 2024-09-17T03:42:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.964+0000 7f1d9b263640 1 -- 172.21.15.146:0/2099807953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d94149750 con 0x7f1d940b5ce0 2024-09-17T03:42:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.964+0000 7f1d917fa640 1 -- 172.21.15.146:0/2099807953 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00aab0 con 0x7f1d940b5ce0 2024-09-17T03:42:48.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.964+0000 7f1d9b263640 1 -- 172.21.15.146:0/2099807953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d94149d10 con 0x7f1d940b5ce0 2024-09-17T03:42:48.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.965+0000 7f1d9b263640 1 -- 172.21.15.146:0/2099807953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d9415dd00 con 0x7f1d940b5ce0 2024-09-17T03:42:48.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.966+0000 7f1d917fa640 1 -- 172.21.15.146:0/2099807953 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1d8c00ac50 con 0x7f1d940b5ce0 2024-09-17T03:42:48.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.966+0000 7f1d917fa640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d78078b90 0x7f1d7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:48.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.966+0000 7f1d917fa640 1 -- 172.21.15.146:0/2099807953 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4857+0+0 (secure 0 0 0) 0x7f1d8c09a8e0 con 0x7f1d940b5ce0 2024-09-17T03:42:48.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.967+0000 7f1d98fff640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d78078b90 0x7f1d7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:48.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.967+0000 7f1d98fff640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d78078b90 0x7f1d7807b0a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1d88007a40 tx=0x7f1d88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:48.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:48.971+0000 7f1d917fa640 1 -- 172.21.15.146:0/2099807953 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1d8c062ff0 con 0x7f1d940b5ce0 2024-09-17T03:42:49.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:49.146+0000 7f1d9b263640 1 -- 172.21.15.146:0/2099807953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1d94156e30 con 0x7f1d940b5ce0 2024-09-17T03:42:50.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.135+0000 7f1d917fa640 1 -- 172.21.15.146:0/2099807953 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v151) ==== 138+0+0 (secure 0 0 0) 0x7f1d8c0628f0 con 0x7f1d940b5ce0 2024-09-17T03:42:50.136 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:42:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 -- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d78078b90 msgr2=0x7f1d7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d78078b90 0x7f1d7807b0a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1d88007a40 tx=0x7f1d88009040 comp rx=0 tx=0).stop 2024-09-17T03:42:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 -- 172.21.15.146:0/2099807953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d940b5ce0 msgr2=0x7f1d9415ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:50.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d940b5ce0 0x7f1d9415ef60 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00c700 tx=0x7f1d8c00cbc0 comp rx=0 tx=0).stop 2024-09-17T03:42:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 -- 172.21.15.146:0/2099807953 shutdown_connections 2024-09-17T03:42:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d78078b90 0x7f1d7807b0a0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d940b5ce0 0x7f1d9415ef60 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d940b5750 0x7f1d94146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 --2- 172.21.15.146:0/2099807953 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d940b3b60 0x7f1d940c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 -- 172.21.15.146:0/2099807953 >> 172.21.15.146:0/2099807953 conn(0x7f1d940b7b20 msgr2=0x7f1d9409bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 -- 172.21.15.146:0/2099807953 shutdown_connections 2024-09-17T03:42:50.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.139+0000 7f1d9b263640 1 -- 172.21.15.146:0/2099807953 wait complete. 2024-09-17T03:42:50.157 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:42:50.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.283+0000 7fea40d8a640 1 -- 172.21.15.146:0/3865352443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea3c0cf270 msgr2=0x7fea3c0b6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:50.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.283+0000 7fea40d8a640 1 --2- 172.21.15.146:0/3865352443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea3c0cf270 0x7fea3c0b6690 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fea24009830 tx=0x7fea2402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:42:50.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.283+0000 7fea40d8a640 1 -- 172.21.15.146:0/3865352443 shutdown_connections 2024-09-17T03:42:50.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.283+0000 7fea40d8a640 1 --2- 172.21.15.146:0/3865352443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea3c0cf270 0x7fea3c0b6690 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:50.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.283+0000 7fea40d8a640 1 -- 172.21.15.146:0/3865352443 >> 172.21.15.146:0/3865352443 conn(0x7fea3c0d1460 msgr2=0x7fea3c0d1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:50.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.283+0000 7fea40d8a640 1 -- 172.21.15.146:0/3865352443 shutdown_connections 2024-09-17T03:42:50.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.283+0000 7fea40d8a640 1 -- 172.21.15.146:0/3865352443 wait complete. 2024-09-17T03:42:50.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.285+0000 7fea40d8a640 1 Processor -- start 2024-09-17T03:42:50.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.285+0000 7fea40d8a640 1 -- start start 2024-09-17T03:42:50.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea40d8a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c0b6bd0 0x7fea3c0b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:50.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea40d8a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea3c0b9c30 0x7fea3c15d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:50.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea40d8a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea3c0cf270 0x7fea3c15dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:50.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea40d8a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c0b8a50 con 0x7fea3c0b9c30 2024-09-17T03:42:50.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea40d8a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c0b88d0 con 0x7fea3c0b6bd0 2024-09-17T03:42:50.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea40d8a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fea3c0b8bd0 con 0x7fea3c0cf270 2024-09-17T03:42:50.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea31d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea3c0b9c30 0x7fea3c15d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:50.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea31d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea3c0b9c30 0x7fea3c15d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50738/0 (socket says 172.21.15.146:50738) 2024-09-17T03:42:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea31d9b640 1 -- 172.21.15.146:0/97777576 learned_addr learned my addr 172.21.15.146:0/97777576 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea3a59c640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c0b6bd0 0x7fea3c0b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea3ad9d640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea3c0cf270 0x7fea3c15dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea31d9b640 1 -- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea3c0cf270 msgr2=0x7fea3c15dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea31d9b640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea3c0cf270 0x7fea3c15dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:50.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea31d9b640 1 -- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c0b6bd0 msgr2=0x7fea3c0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:50.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea31d9b640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c0b6bd0 0x7fea3c0b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:50.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea31d9b640 1 -- 172.21.15.146:0/97777576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3c0b3370 con 0x7fea3c0b9c30 2024-09-17T03:42:50.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea31d9b640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea3c0b9c30 0x7fea3c15d680 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fea24009950 tx=0x7fea24033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:50.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea337fe640 1 -- 172.21.15.146:0/97777576 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24031b60 con 0x7fea3c0b9c30 2024-09-17T03:42:50.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea337fe640 1 -- 172.21.15.146:0/97777576 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea24031df0 con 0x7fea3c0b9c30 2024-09-17T03:42:50.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea40d8a640 1 -- 172.21.15.146:0/97777576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea3c0ab720 con 0x7fea3c0b9c30 2024-09-17T03:42:50.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.287+0000 7fea337fe640 1 -- 172.21.15.146:0/97777576 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24005280 con 0x7fea3c0b9c30 2024-09-17T03:42:50.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.288+0000 7fea40d8a640 1 -- 172.21.15.146:0/97777576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea3c0abce0 con 0x7fea3c0b9c30 2024-09-17T03:42:50.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.289+0000 7fea40d8a640 1 -- 172.21.15.146:0/97777576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea3c0b6690 con 0x7fea3c0b9c30 2024-09-17T03:42:50.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.289+0000 7fea337fe640 1 -- 172.21.15.146:0/97777576 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea24005420 con 0x7fea3c0b9c30 2024-09-17T03:42:50.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.290+0000 7fea337fe640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea1c078bc0 0x7fea1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:50.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.290+0000 7fea337fe640 1 -- 172.21.15.146:0/97777576 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5227+0+0 (secure 0 0 0) 0x7fea240bbbe0 con 0x7fea3c0b9c30 2024-09-17T03:42:50.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.290+0000 7fea3a59c640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea1c078bc0 0x7fea1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:50.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.291+0000 7fea3a59c640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea1c078bc0 0x7fea1c07b0d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fea2c000f60 tx=0x7fea2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:50.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.295+0000 7fea337fe640 1 -- 172.21.15.146:0/97777576 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea2403f030 con 0x7fea3c0b9c30 2024-09-17T03:42:50.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:50.471+0000 7fea40d8a640 1 -- 172.21.15.146:0/97777576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fea3c0ab4b0 con 0x7fea3c0b9c30 2024-09-17T03:42:51.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.138+0000 7fea337fe640 1 -- 172.21.15.146:0/97777576 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v152) ==== 170+0+0 (secure 0 0 0) 0x7fea24031770 con 0x7fea3c0b9c30 2024-09-17T03:42:51.138 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:42:51.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 -- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea1c078bc0 msgr2=0x7fea1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:51.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea1c078bc0 0x7fea1c07b0d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fea2c000f60 tx=0x7fea2c009040 comp rx=0 tx=0).stop 2024-09-17T03:42:51.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 -- 172.21.15.146:0/97777576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea3c0b9c30 msgr2=0x7fea3c15d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:51.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea3c0b9c30 0x7fea3c15d680 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fea24009950 tx=0x7fea24033c10 comp rx=0 tx=0).stop 2024-09-17T03:42:51.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 -- 172.21.15.146:0/97777576 shutdown_connections 2024-09-17T03:42:51.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea1c078bc0 0x7fea1c07b0d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:51.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea3c0cf270 0x7fea3c15dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:51.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea3c0b9c30 0x7fea3c15d680 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:51.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 --2- 172.21.15.146:0/97777576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea3c0b6bd0 0x7fea3c0b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:51.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 -- 172.21.15.146:0/97777576 >> 172.21.15.146:0/97777576 conn(0x7fea3c0d1460 msgr2=0x7fea3c0b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:51.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 -- 172.21.15.146:0/97777576 shutdown_connections 2024-09-17T03:42:51.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.140+0000 7fea40d8a640 1 -- 172.21.15.146:0/97777576 wait complete. 2024-09-17T03:42:51.166 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:42:51.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.284+0000 7f79d935e640 1 -- 172.21.15.146:0/2447065930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d409be30 msgr2=0x7f79d40b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:51.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.284+0000 7f79d935e640 1 --2- 172.21.15.146:0/2447065930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d409be30 0x7f79d40b6130 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009830 tx=0x7f79bc02a510 comp rx=0 tx=0).stop 2024-09-17T03:42:51.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.285+0000 7f79d935e640 1 -- 172.21.15.146:0/2447065930 shutdown_connections 2024-09-17T03:42:51.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.285+0000 7f79d935e640 1 --2- 172.21.15.146:0/2447065930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d409be30 0x7f79d40b6130 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:51.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.285+0000 7f79d935e640 1 -- 172.21.15.146:0/2447065930 >> 172.21.15.146:0/2447065930 conn(0x7f79d409ba20 msgr2=0x7f79d40b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:51.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.285+0000 7f79d935e640 1 -- 172.21.15.146:0/2447065930 shutdown_connections 2024-09-17T03:42:51.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.285+0000 7f79d935e640 1 -- 172.21.15.146:0/2447065930 wait complete. 2024-09-17T03:42:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.286+0000 7f79d935e640 1 Processor -- start 2024-09-17T03:42:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.286+0000 7f79d935e640 1 -- start start 2024-09-17T03:42:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79d935e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d409be30 0x7f79d41e8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79d935e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b5be0 0x7f79d409c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79d935e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d40b6670 0x7f79d409cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79d935e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f79d40b1100 con 0x7f79d40b5be0 2024-09-17T03:42:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79d935e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79d40b0f80 con 0x7f79d409be30 2024-09-17T03:42:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79d935e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f79d40b1280 con 0x7f79d40b6670 2024-09-17T03:42:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b5be0 0x7f79d409c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79cbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b5be0 0x7f79d409c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50752/0 (socket says 172.21.15.146:50752) 2024-09-17T03:42:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79cbfff640 1 -- 172.21.15.146:0/2059282164 learned_addr learned my addr 172.21.15.146:0/2059282164 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79d2ffd640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d409be30 0x7f79d41e8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79d37fe640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d40b6670 0x7f79d409cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79cbfff640 1 -- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d40b6670 msgr2=0x7f79d409cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79cbfff640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d40b6670 0x7f79d409cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79cbfff640 1 -- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d409be30 msgr2=0x7f79d41e8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79cbfff640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d409be30 0x7f79d41e8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79cbfff640 1 -- 172.21.15.146:0/2059282164 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d41e8d90 con 0x7f79d40b5be0 2024-09-17T03:42:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79cbfff640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b5be0 0x7f79d409c7a0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f79bc02ab00 tx=0x7f79bc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79cb7fe640 1 -- 172.21.15.146:0/2059282164 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc031d60 con 0x7f79d40b5be0 2024-09-17T03:42:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.288+0000 7f79cb7fe640 1 -- 172.21.15.146:0/2059282164 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79bc033e10 con 0x7f79d40b5be0 2024-09-17T03:42:51.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.289+0000 7f79d935e640 1 -- 172.21.15.146:0/2059282164 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d41e9070 con 0x7f79d40b5be0 2024-09-17T03:42:51.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.289+0000 7f79cb7fe640 1 -- 172.21.15.146:0/2059282164 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79bc005260 con 0x7f79d40b5be0 2024-09-17T03:42:51.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.289+0000 7f79d935e640 1 -- 172.21.15.146:0/2059282164 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d41e9630 con 0x7f79d40b5be0 2024-09-17T03:42:51.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.289+0000 7f79d935e640 1 -- 172.21.15.146:0/2059282164 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d41e8b00 con 0x7f79d40b5be0 2024-09-17T03:42:51.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.290+0000 7f79cb7fe640 1 -- 172.21.15.146:0/2059282164 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79bc005400 con 0x7f79d40b5be0 2024-09-17T03:42:51.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.291+0000 7f79cb7fe640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078bc0 0x7f79b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:51.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.291+0000 7f79cb7fe640 1 -- 172.21.15.146:0/2059282164 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5609+0+0 (secure 0 0 0) 0x7f79bc0bc040 con 0x7f79d40b5be0 2024-09-17T03:42:51.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.291+0000 7f79d2ffd640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078bc0 0x7f79b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:51.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.292+0000 7f79d2ffd640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078bc0 0x7f79b407b0d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f79c4006fd0 tx=0x7f79c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:51.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.296+0000 7f79cb7fe640 1 -- 172.21.15.146:0/2059282164 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f79bc03f030 con 0x7f79d40b5be0 2024-09-17T03:42:51.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:51.506+0000 7f79d935e640 1 -- 172.21.15.146:0/2059282164 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f79d406ad70 con 0x7f79d40b5be0 2024-09-17T03:42:52.163 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 22 and data pool 23 2024-09-17T03:42:52.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.163+0000 7f79cb7fe640 1 -- 172.21.15.146:0/2059282164 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v109) ==== 174+0+0 (secure 0 0 0) 0x7f79bc084460 con 0x7f79d40b5be0 2024-09-17T03:42:52.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.169+0000 7f79d935e640 1 -- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078bc0 msgr2=0x7f79b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.169+0000 7f79d935e640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078bc0 0x7f79b407b0d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f79c4006fd0 tx=0x7f79c4008040 comp rx=0 tx=0).stop 2024-09-17T03:42:52.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.169+0000 7f79d935e640 1 -- 172.21.15.146:0/2059282164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b5be0 msgr2=0x7f79d409c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.169+0000 7f79d935e640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b5be0 0x7f79d409c7a0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f79bc02ab00 tx=0x7f79bc033c20 comp rx=0 tx=0).stop 2024-09-17T03:42:52.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.169+0000 7f79d935e640 1 -- 172.21.15.146:0/2059282164 shutdown_connections 2024-09-17T03:42:52.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.169+0000 7f79d935e640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79b4078bc0 0x7f79b407b0d0 secure :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f79c4006fd0 tx=0x7f79c4008040 comp rx=0 tx=0).stop 2024-09-17T03:42:52.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.170+0000 7f79d935e640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79d40b6670 0x7f79d409cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.170+0000 7f79d935e640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d40b5be0 0x7f79d409c7a0 secure :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f79bc02ab00 tx=0x7f79bc033c20 comp rx=0 tx=0).stop 2024-09-17T03:42:52.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.170+0000 7f79d935e640 1 --2- 172.21.15.146:0/2059282164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79d409be30 0x7f79d41e8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.170+0000 7f79d935e640 1 -- 172.21.15.146:0/2059282164 >> 172.21.15.146:0/2059282164 conn(0x7f79d409ba20 msgr2=0x7f79d40b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:52.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.174+0000 7f79d935e640 1 -- 172.21.15.146:0/2059282164 shutdown_connections 2024-09-17T03:42:52.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.175+0000 7f79d935e640 1 -- 172.21.15.146:0/2059282164 wait complete. 2024-09-17T03:42:52.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:42:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.308+0000 7f024e339640 1 -- 172.21.15.146:0/3879654890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02480d0710 msgr2=0x7f02480cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.308+0000 7f024e339640 1 --2- 172.21.15.146:0/3879654890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02480d0710 0x7f02480cf170 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f0238009830 tx=0x7f023802a480 comp rx=0 tx=0).stop 2024-09-17T03:42:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.308+0000 7f024e339640 1 -- 172.21.15.146:0/3879654890 shutdown_connections 2024-09-17T03:42:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.308+0000 7f024e339640 1 --2- 172.21.15.146:0/3879654890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02480cf6b0 0x7f0248161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.308+0000 7f024e339640 1 --2- 172.21.15.146:0/3879654890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02480d0710 0x7f02480cf170 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.308+0000 7f024e339640 1 -- 172.21.15.146:0/3879654890 >> 172.21.15.146:0/3879654890 conn(0x7f024809ba20 msgr2=0x7f02480b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.308+0000 7f024e339640 1 -- 172.21.15.146:0/3879654890 shutdown_connections 2024-09-17T03:42:52.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.308+0000 7f024e339640 1 -- 172.21.15.146:0/3879654890 wait complete. 2024-09-17T03:42:52.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.310+0000 7f024e339640 1 Processor -- start 2024-09-17T03:42:52.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.310+0000 7f024e339640 1 -- start start 2024-09-17T03:42:52.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024e339640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02480b47c0 0x7f024815d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024e339640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02480cf6b0 0x7f0248156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024e339640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02480d0710 0x7f024815f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024e339640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f02480b1de0 con 0x7f02480d0710 2024-09-17T03:42:52.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024e339640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0248162080 con 0x7f02480cf6b0 2024-09-17T03:42:52.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024e339640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f02480b1f60 con 0x7f02480b47c0 2024-09-17T03:42:52.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024c8d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02480d0710 0x7f024815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024c8d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02480d0710 0x7f024815f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50778/0 (socket says 172.21.15.146:50778) 2024-09-17T03:42:52.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024c8d6640 1 -- 172.21.15.146:0/276043145 learned_addr learned my addr 172.21.15.146:0/276043145 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f0247fff640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02480b47c0 0x7f024815d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f02477fe640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02480cf6b0 0x7f0248156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024c8d6640 1 -- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02480b47c0 msgr2=0x7f024815d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024c8d6640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02480b47c0 0x7f024815d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024c8d6640 1 -- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02480cf6b0 msgr2=0x7f0248156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024c8d6640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02480cf6b0 0x7f0248156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024c8d6640 1 -- 172.21.15.146:0/276043145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024815ddf0 con 0x7f02480d0710 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024c8d6640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02480d0710 0x7f024815f380 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f024000c6f0 tx=0x7f024000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f0244ff9640 1 -- 172.21.15.146:0/276043145 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240017070 con 0x7f02480d0710 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f0244ff9640 1 -- 172.21.15.146:0/276043145 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0240003c90 con 0x7f02480d0710 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024e339640 1 -- 172.21.15.146:0/276043145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02481f3b80 con 0x7f02480d0710 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f0244ff9640 1 -- 172.21.15.146:0/276043145 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240003e60 con 0x7f02480d0710 2024-09-17T03:42:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.312+0000 7f024e339640 1 -- 172.21.15.146:0/276043145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02481f4140 con 0x7f02480d0710 2024-09-17T03:42:52.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.313+0000 7f024e339640 1 -- 172.21.15.146:0/276043145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02480cf170 con 0x7f02480d0710 2024-09-17T03:42:52.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.314+0000 7f0244ff9640 1 -- 172.21.15.146:0/276043145 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f024001a070 con 0x7f02480d0710 2024-09-17T03:42:52.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.315+0000 7f0244ff9640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0234078b90 0x7f023407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.315+0000 7f0244ff9640 1 -- 172.21.15.146:0/276043145 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f024009a290 con 0x7f02480d0710 2024-09-17T03:42:52.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.315+0000 7f0247fff640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0234078b90 0x7f023407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.315+0000 7f0247fff640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0234078b90 0x7f023407b0a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0238034000 tx=0x7f0238004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:52.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.319+0000 7f0244ff9640 1 -- 172.21.15.146:0/276043145 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0240062110 con 0x7f02480d0710 2024-09-17T03:42:52.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.495+0000 7f024e339640 1 -- 172.21.15.146:0/276043145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02480ced70 con 0x7f02480d0710 2024-09-17T03:42:52.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.496+0000 7f0244ff9640 1 -- 172.21.15.146:0/276043145 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) ==== 74+0+16792 (secure 0 0 0) 0x7f0240066b40 con 0x7f02480d0710 2024-09-17T03:42:52.496 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:52.496 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":153,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:42:51.507928+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:42:49.151769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T03:42:50.476593+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 -- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0234078b90 msgr2=0x7f023407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0234078b90 0x7f023407b0a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0238034000 tx=0x7f0238004730 comp rx=0 tx=0).stop 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 -- 172.21.15.146:0/276043145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02480d0710 msgr2=0x7f024815f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02480d0710 0x7f024815f380 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f024000c6f0 tx=0x7f024000cbb0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 -- 172.21.15.146:0/276043145 shutdown_connections 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0234078b90 0x7f023407b0a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f02480d0710 0x7f024815f380 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02480cf6b0 0x7f0248156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 --2- 172.21.15.146:0/276043145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02480b47c0 0x7f024815d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 -- 172.21.15.146:0/276043145 >> 172.21.15.146:0/276043145 conn(0x7f024809ba20 msgr2=0x7f02480b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 -- 172.21.15.146:0/276043145 shutdown_connections 2024-09-17T03:42:52.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.498+0000 7f024e339640 1 -- 172.21.15.146:0/276043145 wait complete. 2024-09-17T03:42:52.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:42:52.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.623+0000 7f876d055640 1 -- 172.21.15.146:0/1874345298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8768070090 msgr2=0x7f8768074740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.623+0000 7f876d055640 1 --2- 172.21.15.146:0/1874345298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8768070090 0x7f8768074740 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f87680727a0 tx=0x7f875002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.624+0000 7f876d055640 1 -- 172.21.15.146:0/1874345298 shutdown_connections 2024-09-17T03:42:52.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.624+0000 7f876d055640 1 --2- 172.21.15.146:0/1874345298 >> v2:172.21.15.179:3300/0 conn(0x7f876815b8c0 0x7f876815f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.624+0000 7f876d055640 1 --2- 172.21.15.146:0/1874345298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8768070090 0x7f8768074740 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.624+0000 7f876d055640 1 -- 172.21.15.146:0/1874345298 >> 172.21.15.146:0/1874345298 conn(0x7f87680b2950 msgr2=0x7f87680b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:52.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.624+0000 7f876d055640 1 -- 172.21.15.146:0/1874345298 shutdown_connections 2024-09-17T03:42:52.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.624+0000 7f876d055640 1 -- 172.21.15.146:0/1874345298 wait complete. 2024-09-17T03:42:52.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.625+0000 7f876d055640 1 Processor -- start 2024-09-17T03:42:52.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.626+0000 7f876d055640 1 -- start start 2024-09-17T03:42:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f876d055640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87680cd990 0x7f87681f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f876d055640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876815b8c0 0x7f876815e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f876d055640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87680aeb30 0x7f8768167650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f876d055640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f876815fb80 con 0x7f87680cd990 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f876d055640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f876815fa00 con 0x7f876815b8c0 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f876d055640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f876815fd00 con 0x7f87680aeb30 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f8766d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87680cd990 0x7f87681f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f8766d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87680cd990 0x7f87681f59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50802/0 (socket says 172.21.15.146:50802) 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f8766d9d640 1 -- 172.21.15.146:0/2767730463 learned_addr learned my addr 172.21.15.146:0/2767730463 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f875e59c640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876815b8c0 0x7f876815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f876759e640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87680aeb30 0x7f8768167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f8766d9d640 1 -- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87680aeb30 msgr2=0x7f8768167650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f8766d9d640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87680aeb30 0x7f8768167650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f8766d9d640 1 -- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876815b8c0 msgr2=0x7f876815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f8766d9d640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876815b8c0 0x7f876815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.627+0000 7f8766d9d640 1 -- 172.21.15.146:0/2767730463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876815d6b0 con 0x7f87680cd990 2024-09-17T03:42:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.628+0000 7f8766d9d640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87680cd990 0x7f87681f59f0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f875800c3a0 tx=0x7f875800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.628+0000 7f875ffff640 1 -- 172.21.15.146:0/2767730463 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8758017070 con 0x7f87680cd990 2024-09-17T03:42:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.628+0000 7f875ffff640 1 -- 172.21.15.146:0/2767730463 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87580053c0 con 0x7f87680cd990 2024-09-17T03:42:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.628+0000 7f876d055640 1 -- 172.21.15.146:0/2767730463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876815d990 con 0x7f87680cd990 2024-09-17T03:42:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.628+0000 7f875ffff640 1 -- 172.21.15.146:0/2767730463 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8758003850 con 0x7f87680cd990 2024-09-17T03:42:52.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.628+0000 7f876d055640 1 -- 172.21.15.146:0/2767730463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876815df50 con 0x7f87680cd990 2024-09-17T03:42:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.629+0000 7f876d055640 1 -- 172.21.15.146:0/2767730463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87680b5be0 con 0x7f87680cd990 2024-09-17T03:42:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.630+0000 7f875ffff640 1 -- 172.21.15.146:0/2767730463 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f875801a070 con 0x7f87680cd990 2024-09-17T03:42:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.630+0000 7f875ffff640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8748078b90 0x7f874807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.630+0000 7f875ffff640 1 -- 172.21.15.146:0/2767730463 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f875809a030 con 0x7f87680cd990 2024-09-17T03:42:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.631+0000 7f875e59c640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8748078b90 0x7f874807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.631+0000 7f875e59c640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8748078b90 0x7f874807b0a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8750033000 tx=0x7f8750004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:52.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.635+0000 7f875ffff640 1 -- 172.21.15.146:0/2767730463 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f87680b5be0 con 0x7f87680cd990 2024-09-17T03:42:52.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.810+0000 7f876d055640 1 -- 172.21.15.146:0/2767730463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8768160220 con 0x7f87680cd990 2024-09-17T03:42:52.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.812+0000 7f875ffff640 1 -- 172.21.15.146:0/2767730463 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) ==== 74+0+16792 (secure 0 0 0) 0x7f8758061e20 con 0x7f87680cd990 2024-09-17T03:42:52.812 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:52.812 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":153,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:42:51.507928+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:42:49.151769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T03:42:50.476593+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:42:52.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 -- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8748078b90 msgr2=0x7f874807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8748078b90 0x7f874807b0a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8750033000 tx=0x7f8750004730 comp rx=0 tx=0).stop 2024-09-17T03:42:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 -- 172.21.15.146:0/2767730463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87680cd990 msgr2=0x7f87681f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87680cd990 0x7f87681f59f0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f875800c3a0 tx=0x7f875800c860 comp rx=0 tx=0).stop 2024-09-17T03:42:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 -- 172.21.15.146:0/2767730463 shutdown_connections 2024-09-17T03:42:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8748078b90 0x7f874807b0a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87680aeb30 0x7f8768167650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876815b8c0 0x7f876815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 --2- 172.21.15.146:0/2767730463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87680cd990 0x7f87681f59f0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 -- 172.21.15.146:0/2767730463 >> 172.21.15.146:0/2767730463 conn(0x7f87680b2950 msgr2=0x7f87680b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 -- 172.21.15.146:0/2767730463 shutdown_connections 2024-09-17T03:42:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.814+0000 7f876d055640 1 -- 172.21.15.146:0/2767730463 wait complete. 2024-09-17T03:42:52.826 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:42:52.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.942+0000 7f29bd8c4640 1 -- 172.21.15.146:0/3995737488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29b806f440 msgr2=0x7f29b8169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.942+0000 7f29bd8c4640 1 --2- 172.21.15.146:0/3995737488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29b806f440 0x7f29b8169c10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009be0 tx=0x7f29b002a800 comp rx=0 tx=0).stop 2024-09-17T03:42:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.942+0000 7f29bd8c4640 1 -- 172.21.15.146:0/3995737488 shutdown_connections 2024-09-17T03:42:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.942+0000 7f29bd8c4640 1 --2- 172.21.15.146:0/3995737488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29b806f440 0x7f29b8169c10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.942+0000 7f29bd8c4640 1 -- 172.21.15.146:0/3995737488 >> 172.21.15.146:0/3995737488 conn(0x7f29b80d4be0 msgr2=0x7f29b80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.942+0000 7f29bd8c4640 1 -- 172.21.15.146:0/3995737488 shutdown_connections 2024-09-17T03:42:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.942+0000 7f29bd8c4640 1 -- 172.21.15.146:0/3995737488 wait complete. 2024-09-17T03:42:52.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.944+0000 7f29bd8c4640 1 Processor -- start 2024-09-17T03:42:52.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.944+0000 7f29bd8c4640 1 -- start start 2024-09-17T03:42:52.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.945+0000 7f29bd8c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b80b3870 0x7f29b815df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.945+0000 7f29bd8c4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29b80cf370 0x7f29b80b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.945+0000 7f29bd8c4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29b81f9120 0x7f29b81f9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.945+0000 7f29bd8c4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f29b816a2d0 con 0x7f29b80b3870 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.945+0000 7f29bd8c4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f29b816a150 con 0x7f29b81f9120 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.945+0000 7f29bd8c4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f29b816a450 con 0x7f29b80cf370 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.945+0000 7f29b6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b80b3870 0x7f29b815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.945+0000 7f29b6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b80b3870 0x7f29b815df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50804/0 (socket says 172.21.15.146:50804) 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.945+0000 7f29b6ffd640 1 -- 172.21.15.146:0/379310038 learned_addr learned my addr 172.21.15.146:0/379310038 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29ae7fc640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29b80cf370 0x7f29b80b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29b77fe640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29b81f9120 0x7f29b81f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29b6ffd640 1 -- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29b80cf370 msgr2=0x7f29b80b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29b6ffd640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29b80cf370 0x7f29b80b6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29b6ffd640 1 -- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29b81f9120 msgr2=0x7f29b81f9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29b6ffd640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29b81f9120 0x7f29b81f9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29b6ffd640 1 -- 172.21.15.146:0/379310038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b80cc140 con 0x7f29b80b3870 2024-09-17T03:42:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29b77fe640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29b81f9120 0x7f29b81f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29b6ffd640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b80b3870 0x7f29b815df10 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f29a800c730 tx=0x7f29a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29b4ff9640 1 -- 172.21.15.146:0/379310038 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8005270 con 0x7f29b80b3870 2024-09-17T03:42:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29b4ff9640 1 -- 172.21.15.146:0/379310038 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29a8005430 con 0x7f29b80b3870 2024-09-17T03:42:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29bd8c4640 1 -- 172.21.15.146:0/379310038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b81f9a70 con 0x7f29b80b3870 2024-09-17T03:42:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29b4ff9640 1 -- 172.21.15.146:0/379310038 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a800a880 con 0x7f29b80b3870 2024-09-17T03:42:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.946+0000 7f29bd8c4640 1 -- 172.21.15.146:0/379310038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b80cdfb0 con 0x7f29b80b3870 2024-09-17T03:42:52.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.947+0000 7f29bd8c4640 1 -- 172.21.15.146:0/379310038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b81620f0 con 0x7f29b80b3870 2024-09-17T03:42:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.948+0000 7f29b4ff9640 1 -- 172.21.15.146:0/379310038 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29a800ac30 con 0x7f29b80b3870 2024-09-17T03:42:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.948+0000 7f29b4ff9640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2998078bc0 0x7f299807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.948+0000 7f29b4ff9640 1 -- 172.21.15.146:0/379310038 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f29a809ad40 con 0x7f29b80b3870 2024-09-17T03:42:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.948+0000 7f29ae7fc640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2998078bc0 0x7f299807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.949+0000 7f29ae7fc640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2998078bc0 0x7f299807b0d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f29a0000f60 tx=0x7f29a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:52.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:52.953+0000 7f29b4ff9640 1 -- 172.21.15.146:0/379310038 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29b81f9a70 con 0x7f29b80b3870 2024-09-17T03:42:53.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:53.170+0000 7f29bd8c4640 1 -- 172.21.15.146:0/379310038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f29b80d2bd0 con 0x7f29b80b3870 2024-09-17T03:42:54.136 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-09-17T03:42:54.136+0000 7ff4cfc35640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:42:54.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.176+0000 7f29b4ff9640 1 -- 172.21.15.146:0/379310038 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v112) ==== 118+0+0 (secure 0 0 0) 0x7f29b80cc140 con 0x7f29b80b3870 2024-09-17T03:42:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.179+0000 7f29bd8c4640 1 -- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2998078bc0 msgr2=0x7f299807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.179+0000 7f29bd8c4640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2998078bc0 0x7f299807b0d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f29a0000f60 tx=0x7f29a0009040 comp rx=0 tx=0).stop 2024-09-17T03:42:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.179+0000 7f29bd8c4640 1 -- 172.21.15.146:0/379310038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b80b3870 msgr2=0x7f29b815df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.179+0000 7f29bd8c4640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b80b3870 0x7f29b815df10 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f29a800c730 tx=0x7f29a800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:42:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.180+0000 7f29bd8c4640 1 -- 172.21.15.146:0/379310038 shutdown_connections 2024-09-17T03:42:54.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.180+0000 7f29bd8c4640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2998078bc0 0x7f299807b0d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.180+0000 7f29bd8c4640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29b81f9120 0x7f29b81f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.180+0000 7f29bd8c4640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29b80cf370 0x7f29b80b6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.180+0000 7f29bd8c4640 1 --2- 172.21.15.146:0/379310038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29b80b3870 0x7f29b815df10 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.180+0000 7f29bd8c4640 1 -- 172.21.15.146:0/379310038 >> 172.21.15.146:0/379310038 conn(0x7f29b80d4be0 msgr2=0x7f29b80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.180+0000 7f29bd8c4640 1 -- 172.21.15.146:0/379310038 shutdown_connections 2024-09-17T03:42:54.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.180+0000 7f29bd8c4640 1 -- 172.21.15.146:0/379310038 wait complete. 2024-09-17T03:42:54.194 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:42:54.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:42:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.316+0000 7fb3568ec640 1 -- 172.21.15.146:0/8624311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3500b55f0 msgr2=0x7fb350070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.316+0000 7fb3568ec640 1 --2- 172.21.15.146:0/8624311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3500b55f0 0x7fb350070be0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fb340009830 tx=0x7fb34002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:42:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.316+0000 7fb3568ec640 1 -- 172.21.15.146:0/8624311 shutdown_connections 2024-09-17T03:42:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.316+0000 7fb3568ec640 1 --2- 172.21.15.146:0/8624311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3500b55f0 0x7fb350070be0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.316+0000 7fb3568ec640 1 -- 172.21.15.146:0/8624311 >> 172.21.15.146:0/8624311 conn(0x7fb3500b3410 msgr2=0x7fb3500b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.316+0000 7fb3568ec640 1 -- 172.21.15.146:0/8624311 shutdown_connections 2024-09-17T03:42:54.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.316+0000 7fb3568ec640 1 -- 172.21.15.146:0/8624311 wait complete. 2024-09-17T03:42:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.318+0000 7fb3568ec640 1 Processor -- start 2024-09-17T03:42:54.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.318+0000 7fb3568ec640 1 -- start start 2024-09-17T03:42:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb3568ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb35006dd60 0x7fb35013b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb3568ec640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb350071120 0x7fb3501e50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb3568ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3500b55f0 0x7fb3501554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb3568ec640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb35015c0a0 con 0x7fb350071120 2024-09-17T03:42:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb3568ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb35015bf20 con 0x7fb3500b55f0 2024-09-17T03:42:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb3568ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb35015c220 con 0x7fb35006dd60 2024-09-17T03:42:54.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb350071120 0x7fb3501e50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb350071120 0x7fb3501e50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50834/0 (socket says 172.21.15.146:50834) 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34f7fe640 1 -- 172.21.15.146:0/1103459907 learned_addr learned my addr 172.21.15.146:0/1103459907 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34ffff640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb35006dd60 0x7fb35013b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34f7fe640 1 -- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb35006dd60 msgr2=0x7fb35013b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34f7fe640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb35006dd60 0x7fb35013b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb354e89640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3500b55f0 0x7fb3501554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34f7fe640 1 -- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3500b55f0 msgr2=0x7fb3501554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34f7fe640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3500b55f0 0x7fb3501554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34f7fe640 1 -- 172.21.15.146:0/1103459907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3501f3cf0 con 0x7fb350071120 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb354e89640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3500b55f0 0x7fb3501554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34f7fe640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb350071120 0x7fb3501e50e0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c3a0 tx=0x7fb33800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34cff9640 1 -- 172.21.15.146:0/1103459907 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338017070 con 0x7fb350071120 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34cff9640 1 -- 172.21.15.146:0/1103459907 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3380053c0 con 0x7fb350071120 2024-09-17T03:42:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb3568ec640 1 -- 172.21.15.146:0/1103459907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3501f3fd0 con 0x7fb350071120 2024-09-17T03:42:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.320+0000 7fb34cff9640 1 -- 172.21.15.146:0/1103459907 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338003850 con 0x7fb350071120 2024-09-17T03:42:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.321+0000 7fb3568ec640 1 -- 172.21.15.146:0/1103459907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3501f4590 con 0x7fb350071120 2024-09-17T03:42:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.321+0000 7fb3568ec640 1 -- 172.21.15.146:0/1103459907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb35015c6d0 con 0x7fb350071120 2024-09-17T03:42:54.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.322+0000 7fb34cff9640 1 -- 172.21.15.146:0/1103459907 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb33801a070 con 0x7fb350071120 2024-09-17T03:42:54.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.323+0000 7fb34cff9640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb330078bc0 0x7fb33007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:54.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.323+0000 7fb34cff9640 1 -- 172.21.15.146:0/1103459907 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fb33809a100 con 0x7fb350071120 2024-09-17T03:42:54.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.323+0000 7fb34ffff640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb330078bc0 0x7fb33007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:54.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.324+0000 7fb34ffff640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb330078bc0 0x7fb33007b0d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb340034000 tx=0x7fb340004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:54.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.327+0000 7fb34cff9640 1 -- 172.21.15.146:0/1103459907 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb338062540 con 0x7fb350071120 2024-09-17T03:42:54.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:54.539+0000 7fb3568ec640 1 -- 172.21.15.146:0/1103459907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb3500b2300 con 0x7fb350071120 2024-09-17T03:42:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.186+0000 7fb34cff9640 1 -- 172.21.15.146:0/1103459907 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v113) ==== 122+0+0 (secure 0 0 0) 0x7fb338061e40 con 0x7fb350071120 2024-09-17T03:42:55.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.188+0000 7fb3568ec640 1 -- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb330078bc0 msgr2=0x7fb33007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.188+0000 7fb3568ec640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb330078bc0 0x7fb33007b0d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb340034000 tx=0x7fb340004730 comp rx=0 tx=0).stop 2024-09-17T03:42:55.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.188+0000 7fb3568ec640 1 -- 172.21.15.146:0/1103459907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb350071120 msgr2=0x7fb3501e50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.188+0000 7fb3568ec640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb350071120 0x7fb3501e50e0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c3a0 tx=0x7fb33800c860 comp rx=0 tx=0).stop 2024-09-17T03:42:55.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.188+0000 7fb3568ec640 1 -- 172.21.15.146:0/1103459907 shutdown_connections 2024-09-17T03:42:55.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.188+0000 7fb3568ec640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb330078bc0 0x7fb33007b0d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.188+0000 7fb3568ec640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3500b55f0 0x7fb3501554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.188+0000 7fb3568ec640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb350071120 0x7fb3501e50e0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.188+0000 7fb3568ec640 1 --2- 172.21.15.146:0/1103459907 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb35006dd60 0x7fb35013b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.188+0000 7fb3568ec640 1 -- 172.21.15.146:0/1103459907 >> 172.21.15.146:0/1103459907 conn(0x7fb3500b3410 msgr2=0x7fb35015b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:55.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.189+0000 7fb3568ec640 1 -- 172.21.15.146:0/1103459907 shutdown_connections 2024-09-17T03:42:55.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.189+0000 7fb3568ec640 1 -- 172.21.15.146:0/1103459907 wait complete. 2024-09-17T03:42:55.202 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:42:55.203 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.319+0000 7faf1a1da640 1 -- 172.21.15.146:0/3373586863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1409ec60 msgr2=0x7faf1415b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.319+0000 7faf1a1da640 1 --2- 172.21.15.146:0/3373586863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1409ec60 0x7faf1415b910 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7faf140b6160 tx=0x7faf0402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.319+0000 7faf1a1da640 1 -- 172.21.15.146:0/3373586863 shutdown_connections 2024-09-17T03:42:55.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.319+0000 7faf1a1da640 1 --2- 172.21.15.146:0/3373586863 >> v2:172.21.15.179:3300/0 conn(0x7faf140b4f50 0x7faf140b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.319+0000 7faf1a1da640 1 --2- 172.21.15.146:0/3373586863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf1409ec60 0x7faf1415b910 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.319+0000 7faf1a1da640 1 -- 172.21.15.146:0/3373586863 >> 172.21.15.146:0/3373586863 conn(0x7faf140d0c50 msgr2=0x7faf140d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.319+0000 7faf1a1da640 1 -- 172.21.15.146:0/3373586863 shutdown_connections 2024-09-17T03:42:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.319+0000 7faf1a1da640 1 -- 172.21.15.146:0/3373586863 wait complete. 2024-09-17T03:42:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.320+0000 7faf1a1da640 1 Processor -- start 2024-09-17T03:42:55.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.321+0000 7faf1a1da640 1 -- start start 2024-09-17T03:42:55.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf1a1da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf1409ec60 0x7faf141f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf1a1da640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf140b4f50 0x7faf1409dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf1a1da640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf140cfc60 0x7faf141e8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf1a1da640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf140ae130 con 0x7faf140cfc60 2024-09-17T03:42:55.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf1a1da640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faf140adfb0 con 0x7faf1409ec60 2024-09-17T03:42:55.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf1a1da640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7faf140ae2b0 con 0x7faf140b4f50 2024-09-17T03:42:55.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf13fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf140cfc60 0x7faf141e8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf13fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf140cfc60 0x7faf141e8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50860/0 (socket says 172.21.15.146:50860) 2024-09-17T03:42:55.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf13fff640 1 -- 172.21.15.146:0/3323499663 learned_addr learned my addr 172.21.15.146:0/3323499663 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf12ffd640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf140b4f50 0x7faf1409dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf137fe640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf1409ec60 0x7faf141f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf13fff640 1 -- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf140b4f50 msgr2=0x7faf1409dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf13fff640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf140b4f50 0x7faf1409dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf13fff640 1 -- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf1409ec60 msgr2=0x7faf141f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf13fff640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf1409ec60 0x7faf141f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.322+0000 7faf13fff640 1 -- 172.21.15.146:0/3323499663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf14157360 con 0x7faf140cfc60 2024-09-17T03:42:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.323+0000 7faf13fff640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf140cfc60 0x7faf141e8510 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00e9c0 tx=0x7faf0c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.323+0000 7faefbfff640 1 -- 172.21.15.146:0/3323499663 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c004d20 con 0x7faf140cfc60 2024-09-17T03:42:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.323+0000 7faefbfff640 1 -- 172.21.15.146:0/3323499663 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf0c00cb20 con 0x7faf140cfc60 2024-09-17T03:42:55.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.323+0000 7faf1a1da640 1 -- 172.21.15.146:0/3323499663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1415c250 con 0x7faf140cfc60 2024-09-17T03:42:55.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.323+0000 7faefbfff640 1 -- 172.21.15.146:0/3323499663 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c005020 con 0x7faf140cfc60 2024-09-17T03:42:55.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.323+0000 7faf1a1da640 1 -- 172.21.15.146:0/3323499663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf1415f1a0 con 0x7faf140cfc60 2024-09-17T03:42:55.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.324+0000 7faf1a1da640 1 -- 172.21.15.146:0/3323499663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf140ae800 con 0x7faf140cfc60 2024-09-17T03:42:55.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.325+0000 7faefbfff640 1 -- 172.21.15.146:0/3323499663 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf0c0051c0 con 0x7faf140cfc60 2024-09-17T03:42:55.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.325+0000 7faefbfff640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf00078b90 0x7faf0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.325+0000 7faefbfff640 1 -- 172.21.15.146:0/3323499663 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7faf0c09b660 con 0x7faf140cfc60 2024-09-17T03:42:55.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.325+0000 7faf137fe640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf00078b90 0x7faf0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.326+0000 7faf137fe640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf00078b90 0x7faf0007b0a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7faf04033000 tx=0x7faf04004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:55.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.330+0000 7faefbfff640 1 -- 172.21.15.146:0/3323499663 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf0c016030 con 0x7faf140cfc60 2024-09-17T03:42:55.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.541+0000 7faf1a1da640 1 -- 172.21.15.146:0/3323499663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf14069960 con 0x7faf140cfc60 2024-09-17T03:42:55.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.542+0000 7faefbfff640 1 -- 172.21.15.146:0/3323499663 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7faf0c063aa0 con 0x7faf140cfc60 2024-09-17T03:42:55.542 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:55.542 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:42:55.542 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:42:55.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 -- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf00078b90 msgr2=0x7faf0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf00078b90 0x7faf0007b0a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7faf04033000 tx=0x7faf04004730 comp rx=0 tx=0).stop 2024-09-17T03:42:55.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 -- 172.21.15.146:0/3323499663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf140cfc60 msgr2=0x7faf141e8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf140cfc60 0x7faf141e8510 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00e9c0 tx=0x7faf0c00ee80 comp rx=0 tx=0).stop 2024-09-17T03:42:55.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 -- 172.21.15.146:0/3323499663 shutdown_connections 2024-09-17T03:42:55.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf00078b90 0x7faf0007b0a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf140cfc60 0x7faf141e8510 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf140b4f50 0x7faf1409dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 --2- 172.21.15.146:0/3323499663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf1409ec60 0x7faf141f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 -- 172.21.15.146:0/3323499663 >> 172.21.15.146:0/3323499663 conn(0x7faf140d0c50 msgr2=0x7faf14070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:55.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 -- 172.21.15.146:0/3323499663 shutdown_connections 2024-09-17T03:42:55.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.544+0000 7faf1a1da640 1 -- 172.21.15.146:0/3323499663 wait complete. 2024-09-17T03:42:55.556 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:42:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.669+0000 7fc7156bd640 1 -- 172.21.15.146:0/2667659045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7100b3870 msgr2=0x7fc7100cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.669+0000 7fc7156bd640 1 --2- 172.21.15.146:0/2667659045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7100b3870 0x7fc7100cf370 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fc7100b3790 tx=0x7fc70002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.669+0000 7fc7156bd640 1 -- 172.21.15.146:0/2667659045 shutdown_connections 2024-09-17T03:42:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.669+0000 7fc7156bd640 1 --2- 172.21.15.146:0/2667659045 >> v2:172.21.15.179:3300/0 conn(0x7fc71006f440 0x7fc7100d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.669+0000 7fc7156bd640 1 --2- 172.21.15.146:0/2667659045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7100b3870 0x7fc7100cf370 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.669+0000 7fc7156bd640 1 -- 172.21.15.146:0/2667659045 >> 172.21.15.146:0/2667659045 conn(0x7fc7100d4be0 msgr2=0x7fc7100d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.669+0000 7fc7156bd640 1 -- 172.21.15.146:0/2667659045 shutdown_connections 2024-09-17T03:42:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.669+0000 7fc7156bd640 1 -- 172.21.15.146:0/2667659045 wait complete. 2024-09-17T03:42:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.670+0000 7fc7156bd640 1 Processor -- start 2024-09-17T03:42:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.671+0000 7fc7156bd640 1 -- start start 2024-09-17T03:42:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc7156bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7100b3870 0x7fc710157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc7156bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7101620f0 0x7fc7100b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc7156bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7101586e0 0x7fc7100b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc7156bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc7100d3a60 con 0x7fc7101586e0 2024-09-17T03:42:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc7156bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc7100d38e0 con 0x7fc7100b3870 2024-09-17T03:42:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc7156bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc7100d3be0 con 0x7fc7101620f0 2024-09-17T03:42:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc70f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7101586e0 0x7fc7100b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc70f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7101586e0 0x7fc7100b6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50876/0 (socket says 172.21.15.146:50876) 2024-09-17T03:42:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc70f7fe640 1 -- 172.21.15.146:0/1963835979 learned_addr learned my addr 172.21.15.146:0/1963835979 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc70effd640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7100b3870 0x7fc710157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc7067fc640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7101620f0 0x7fc7100b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc70f7fe640 1 -- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7101620f0 msgr2=0x7fc7100b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc70f7fe640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7101620f0 0x7fc7100b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc70f7fe640 1 -- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7100b3870 msgr2=0x7fc710157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc70f7fe640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7100b3870 0x7fc710157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.672+0000 7fc70f7fe640 1 -- 172.21.15.146:0/1963835979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc710158f60 con 0x7fc7101586e0 2024-09-17T03:42:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.673+0000 7fc70f7fe640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7101586e0 0x7fc7100b6cc0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fc70800e9c0 tx=0x7fc70800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.673+0000 7fc707fff640 1 -- 172.21.15.146:0/1963835979 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708004d20 con 0x7fc7101586e0 2024-09-17T03:42:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.673+0000 7fc707fff640 1 -- 172.21.15.146:0/1963835979 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc70800cb20 con 0x7fc7101586e0 2024-09-17T03:42:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.673+0000 7fc7156bd640 1 -- 172.21.15.146:0/1963835979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7100b4950 con 0x7fc7101586e0 2024-09-17T03:42:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.673+0000 7fc707fff640 1 -- 172.21.15.146:0/1963835979 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708005020 con 0x7fc7101586e0 2024-09-17T03:42:55.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.673+0000 7fc7156bd640 1 -- 172.21.15.146:0/1963835979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7100b4f10 con 0x7fc7101586e0 2024-09-17T03:42:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.674+0000 7fc7156bd640 1 -- 172.21.15.146:0/1963835979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7100d3190 con 0x7fc7101586e0 2024-09-17T03:42:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.674+0000 7fc707fff640 1 -- 172.21.15.146:0/1963835979 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7080051c0 con 0x7fc7101586e0 2024-09-17T03:42:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.675+0000 7fc707fff640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6f0078b90 0x7fc6f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.675+0000 7fc707fff640 1 -- 172.21.15.146:0/1963835979 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fc70809b590 con 0x7fc7101586e0 2024-09-17T03:42:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.675+0000 7fc70effd640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6f0078b90 0x7fc6f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.676+0000 7fc70effd640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6f0078b90 0x7fc6f007b0a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc700033000 tx=0x7fc700004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:55.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.679+0000 7fc707fff640 1 -- 172.21.15.146:0/1963835979 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc708016030 con 0x7fc7101586e0 2024-09-17T03:42:55.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.854+0000 7fc7156bd640 1 -- 172.21.15.146:0/1963835979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7100d2bd0 con 0x7fc7101586e0 2024-09-17T03:42:55.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.855+0000 7fc707fff640 1 -- 172.21.15.146:0/1963835979 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16779 (secure 0 0 0) 0x7fc708063a60 con 0x7fc7101586e0 2024-09-17T03:42:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:55.856 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":154,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:42:53.150133+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:42:49.151769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T03:42:50.476593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:42:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 -- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6f0078b90 msgr2=0x7fc6f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6f0078b90 0x7fc6f007b0a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc700033000 tx=0x7fc700004730 comp rx=0 tx=0).stop 2024-09-17T03:42:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 -- 172.21.15.146:0/1963835979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7101586e0 msgr2=0x7fc7100b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7101586e0 0x7fc7100b6cc0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fc70800e9c0 tx=0x7fc70800ee80 comp rx=0 tx=0).stop 2024-09-17T03:42:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 -- 172.21.15.146:0/1963835979 shutdown_connections 2024-09-17T03:42:55.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6f0078b90 0x7fc6f007b0a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7101586e0 0x7fc7100b6cc0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7101620f0 0x7fc7100b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 --2- 172.21.15.146:0/1963835979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7100b3870 0x7fc710157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 -- 172.21.15.146:0/1963835979 >> 172.21.15.146:0/1963835979 conn(0x7fc7100d4be0 msgr2=0x7fc710075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:55.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 -- 172.21.15.146:0/1963835979 shutdown_connections 2024-09-17T03:42:55.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.858+0000 7fc7156bd640 1 -- 172.21.15.146:0/1963835979 wait complete. 2024-09-17T03:42:55.870 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:42:55.870 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:42:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.983+0000 7f46bff0b640 1 -- 172.21.15.146:0/4103018804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8073350 msgr2=0x7f46b806fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.983+0000 7f46bff0b640 1 --2- 172.21.15.146:0/4103018804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8073350 0x7f46b806fd00 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f46b0005fd0 tx=0x7f46b002aa90 comp rx=0 tx=0).stop 2024-09-17T03:42:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.983+0000 7f46bff0b640 1 -- 172.21.15.146:0/4103018804 shutdown_connections 2024-09-17T03:42:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.983+0000 7f46bff0b640 1 --2- 172.21.15.146:0/4103018804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8073350 0x7f46b806fd00 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.983+0000 7f46bff0b640 1 --2- 172.21.15.146:0/4103018804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46b8162f10 0x7f46b815f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.983+0000 7f46bff0b640 1 -- 172.21.15.146:0/4103018804 >> 172.21.15.146:0/4103018804 conn(0x7f46b806d3c0 msgr2=0x7f46b80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.983+0000 7f46bff0b640 1 -- 172.21.15.146:0/4103018804 shutdown_connections 2024-09-17T03:42:55.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.983+0000 7f46bff0b640 1 -- 172.21.15.146:0/4103018804 wait complete. 2024-09-17T03:42:55.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.985+0000 7f46bff0b640 1 Processor -- start 2024-09-17T03:42:55.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.985+0000 7f46bff0b640 1 -- start start 2024-09-17T03:42:55.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.986+0000 7f46bff0b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46b8162f10 0x7f46b80af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.986+0000 7f46bff0b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8163320 0x7f46b80af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.986+0000 7f46bff0b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46b80b0a20 0x7f46b80b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.986+0000 7f46bff0b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f46b815f730 con 0x7f46b8163320 2024-09-17T03:42:55.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.986+0000 7f46bff0b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f46b815f5b0 con 0x7f46b8162f10 2024-09-17T03:42:55.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.986+0000 7f46bff0b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f46b8070240 con 0x7f46b80b0a20 2024-09-17T03:42:55.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bd4a6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8163320 0x7f46b80af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bd4a6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8163320 0x7f46b80af980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50906/0 (socket says 172.21.15.146:50906) 2024-09-17T03:42:55.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bd4a6640 1 -- 172.21.15.146:0/2842961932 learned_addr learned my addr 172.21.15.146:0/2842961932 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:55.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46be4a8640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46b80b0a20 0x7f46b80b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bdca7640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46b8162f10 0x7f46b80af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bd4a6640 1 -- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46b80b0a20 msgr2=0x7f46b80b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bd4a6640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46b80b0a20 0x7f46b80b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bd4a6640 1 -- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46b8162f10 msgr2=0x7f46b80af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bd4a6640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46b8162f10 0x7f46b80af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bd4a6640 1 -- 172.21.15.146:0/2842961932 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b80b1c50 con 0x7f46b8163320 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bd4a6640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8163320 0x7f46b80af980 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c3d0 tx=0x7f46a800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46ae7fc640 1 -- 172.21.15.146:0/2842961932 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8017070 con 0x7f46b8163320 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46ae7fc640 1 -- 172.21.15.146:0/2842961932 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46a80053c0 con 0x7f46b8163320 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bff0b640 1 -- 172.21.15.146:0/2842961932 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b81f5790 con 0x7f46b8163320 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46ae7fc640 1 -- 172.21.15.146:0/2842961932 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8003850 con 0x7f46b8163320 2024-09-17T03:42:55.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.987+0000 7f46bff0b640 1 -- 172.21.15.146:0/2842961932 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b81f5d50 con 0x7f46b8163320 2024-09-17T03:42:55.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.988+0000 7f46bff0b640 1 -- 172.21.15.146:0/2842961932 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b80b0680 con 0x7f46b8163320 2024-09-17T03:42:55.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.989+0000 7f46ae7fc640 1 -- 172.21.15.146:0/2842961932 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46a801a070 con 0x7f46b8163320 2024-09-17T03:42:55.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.990+0000 7f46ae7fc640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f469c078b90 0x7f469c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:55.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.990+0000 7f46ae7fc640 1 -- 172.21.15.146:0/2842961932 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f46a809a280 con 0x7f46b8163320 2024-09-17T03:42:55.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.990+0000 7f46bdca7640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f469c078b90 0x7f469c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:55.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.991+0000 7f46bdca7640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f469c078b90 0x7f469c07b0a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f46b400bb50 tx=0x7f46b400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:55.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:55.993+0000 7f46ae7fc640 1 -- 172.21.15.146:0/2842961932 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46a8021020 con 0x7f46b8163320 2024-09-17T03:42:56.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.165+0000 7f46bff0b640 1 -- 172.21.15.146:0/2842961932 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46b81f5520 con 0x7f469c078b90 2024-09-17T03:42:56.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.171+0000 7f46ae7fc640 1 -- 172.21.15.146:0/2842961932 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252470 (secure 0 0 0) 0x7f46b81f5520 con 0x7f469c078b90 2024-09-17T03:42:56.173 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:56.175 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 -- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f469c078b90 msgr2=0x7f469c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f469c078b90 0x7f469c07b0a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f46b400bb50 tx=0x7f46b400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 -- 172.21.15.146:0/2842961932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8163320 msgr2=0x7f46b80af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8163320 0x7f46b80af980 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c3d0 tx=0x7f46a800c890 comp rx=0 tx=0).stop 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 -- 172.21.15.146:0/2842961932 shutdown_connections 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f469c078b90 0x7f469c07b0a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f46b80b0a20 0x7f46b80b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b8163320 0x7f46b80af980 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 --2- 172.21.15.146:0/2842961932 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46b8162f10 0x7f46b80af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 -- 172.21.15.146:0/2842961932 >> 172.21.15.146:0/2842961932 conn(0x7f46b806d3c0 msgr2=0x7f46b8142ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 -- 172.21.15.146:0/2842961932 shutdown_connections 2024-09-17T03:42:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.173+0000 7f46bff0b640 1 -- 172.21.15.146:0/2842961932 wait complete. 2024-09-17T03:42:56.186 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2024-09-17T03:42:55.949510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":430908,"kb_used_data":16192,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754543812,"statfs":{"total":773094113280,"available":772652863488,"internally_reserved":0,"allocated":16580608,"data_stored":7919044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":424463921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.811303"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844560+0000","last_change":"2024-09-17T03:42:52.174513+0000","last_active":"2024-09-17T03:42:53.844560+0000","last_peered":"2024-09-17T03:42:53.844560+0000","last_clean":"2024-09-17T03:42:53.844560+0000","last_became_active":"2024-09-17T03:42:52.174148+0000","last_became_peered":"2024-09-17T03:42:52.174148+0000","last_unstale":"2024-09-17T03:42:53.844560+0000","last_undegraded":"2024-09-17T03:42:53.844560+0000","last_fullsized":"2024-09-17T03:42:53.844560+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:55.832724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157483+0000","last_change":"2024-09-17T03:42:52.165354+0000","last_active":"2024-09-17T03:42:53.157483+0000","last_peered":"2024-09-17T03:42:53.157483+0000","last_clean":"2024-09-17T03:42:53.157483+0000","last_became_active":"2024-09-17T03:42:52.165041+0000","last_became_peered":"2024-09-17T03:42:52.165041+0000","last_unstale":"2024-09-17T03:42:53.157483+0000","last_undegraded":"2024-09-17T03:42:53.157483+0000","last_fullsized":"2024-09-17T03:42:53.157483+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:38.642645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178938+0000","last_change":"2024-09-17T03:42:52.177491+0000","last_active":"2024-09-17T03:42:52.178938+0000","last_peered":"2024-09-17T03:42:52.178938+0000","last_clean":"2024-09-17T03:42:52.178938+0000","last_became_active":"2024-09-17T03:42:52.177178+0000","last_became_peered":"2024-09-17T03:42:52.177178+0000","last_unstale":"2024-09-17T03:42:52.178938+0000","last_undegraded":"2024-09-17T03:42:52.178938+0000","last_fullsized":"2024-09-17T03:42:52.178938+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.262647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974477+0000","last_change":"2024-09-17T03:42:52.167801+0000","last_active":"2024-09-17T03:42:53.974477+0000","last_peered":"2024-09-17T03:42:53.974477+0000","last_clean":"2024-09-17T03:42:53.974477+0000","last_became_active":"2024-09-17T03:42:52.167336+0000","last_became_peered":"2024-09-17T03:42:52.167336+0000","last_unstale":"2024-09-17T03:42:53.974477+0000","last_undegraded":"2024-09-17T03:42:53.974477+0000","last_fullsized":"2024-09-17T03:42:53.974477+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:15.573921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158145+0000","last_change":"2024-09-17T03:42:52.174586+0000","last_active":"2024-09-17T03:42:53.158145+0000","last_peered":"2024-09-17T03:42:53.158145+0000","last_clean":"2024-09-17T03:42:53.158145+0000","last_became_active":"2024-09-17T03:42:52.174272+0000","last_became_peered":"2024-09-17T03:42:52.174272+0000","last_unstale":"2024-09-17T03:42:53.158145+0000","last_undegraded":"2024-09-17T03:42:53.158145+0000","last_fullsized":"2024-09-17T03:42:53.158145+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:47.018142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973838+0000","last_change":"2024-09-17T03:42:52.165467+0000","last_active":"2024-09-17T03:42:53.973838+0000","last_peered":"2024-09-17T03:42:53.973838+0000","last_clean":"2024-09-17T03:42:53.973838+0000","last_became_active":"2024-09-17T03:42:52.164398+0000","last_became_peered":"2024-09-17T03:42:52.164398+0000","last_unstale":"2024-09-17T03:42:53.973838+0000","last_undegraded":"2024-09-17T03:42:53.973838+0000","last_fullsized":"2024-09-17T03:42:53.973838+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:29.233559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153848+0000","last_change":"2024-09-17T03:42:52.173162+0000","last_active":"2024-09-17T03:42:53.153848+0000","last_peered":"2024-09-17T03:42:53.153848+0000","last_clean":"2024-09-17T03:42:53.153848+0000","last_became_active":"2024-09-17T03:42:52.172848+0000","last_became_peered":"2024-09-17T03:42:52.172848+0000","last_unstale":"2024-09-17T03:42:53.153848+0000","last_undegraded":"2024-09-17T03:42:53.153848+0000","last_fullsized":"2024-09-17T03:42:53.153848+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:43.243714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157258+0000","last_change":"2024-09-17T03:42:52.175169+0000","last_active":"2024-09-17T03:42:53.157258+0000","last_peered":"2024-09-17T03:42:53.157258+0000","last_clean":"2024-09-17T03:42:53.157258+0000","last_became_active":"2024-09-17T03:42:52.174579+0000","last_became_peered":"2024-09-17T03:42:52.174579+0000","last_unstale":"2024-09-17T03:42:53.157258+0000","last_undegraded":"2024-09-17T03:42:53.157258+0000","last_fullsized":"2024-09-17T03:42:53.157258+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:11.016163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157872+0000","last_change":"2024-09-17T03:42:52.170889+0000","last_active":"2024-09-17T03:42:53.157872+0000","last_peered":"2024-09-17T03:42:53.157872+0000","last_clean":"2024-09-17T03:42:53.157872+0000","last_became_active":"2024-09-17T03:42:52.168114+0000","last_became_peered":"2024-09-17T03:42:52.168114+0000","last_unstale":"2024-09-17T03:42:53.157872+0000","last_undegraded":"2024-09-17T03:42:53.157872+0000","last_fullsized":"2024-09-17T03:42:53.157872+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:15.573921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157695+0000","last_change":"2024-09-17T03:42:52.170631+0000","last_active":"2024-09-17T03:42:53.157695+0000","last_peered":"2024-09-17T03:42:53.157695+0000","last_clean":"2024-09-17T03:42:53.157695+0000","last_became_active":"2024-09-17T03:42:52.170296+0000","last_became_peered":"2024-09-17T03:42:52.170296+0000","last_unstale":"2024-09-17T03:42:53.157695+0000","last_undegraded":"2024-09-17T03:42:53.157695+0000","last_fullsized":"2024-09-17T03:42:53.157695+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:19.502739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157453+0000","last_change":"2024-09-17T03:42:52.173518+0000","last_active":"2024-09-17T03:42:53.157453+0000","last_peered":"2024-09-17T03:42:53.157453+0000","last_clean":"2024-09-17T03:42:53.157453+0000","last_became_active":"2024-09-17T03:42:52.172891+0000","last_became_peered":"2024-09-17T03:42:52.172891+0000","last_unstale":"2024-09-17T03:42:53.157453+0000","last_undegraded":"2024-09-17T03:42:53.157453+0000","last_fullsized":"2024-09-17T03:42:53.157453+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:42.224892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158052+0000","last_change":"2024-09-17T03:42:52.169522+0000","last_active":"2024-09-17T03:42:53.158052+0000","last_peered":"2024-09-17T03:42:53.158052+0000","last_clean":"2024-09-17T03:42:53.158052+0000","last_became_active":"2024-09-17T03:42:52.169182+0000","last_became_peered":"2024-09-17T03:42:52.169182+0000","last_unstale":"2024-09-17T03:42:53.158052+0000","last_undegraded":"2024-09-17T03:42:53.158052+0000","last_fullsized":"2024-09-17T03:42:53.158052+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:49.791293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.180570+0000","last_change":"2024-09-17T03:42:52.178273+0000","last_active":"2024-09-17T03:42:52.180570+0000","last_peered":"2024-09-17T03:42:52.180570+0000","last_clean":"2024-09-17T03:42:52.180570+0000","last_became_active":"2024-09-17T03:42:52.177849+0000","last_became_peered":"2024-09-17T03:42:52.177849+0000","last_unstale":"2024-09-17T03:42:52.180570+0000","last_undegraded":"2024-09-17T03:42:52.180570+0000","last_fullsized":"2024-09-17T03:42:52.180570+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:10.488576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.173268+0000","last_change":"2024-09-17T03:42:52.171346+0000","last_active":"2024-09-17T03:42:52.173268+0000","last_peered":"2024-09-17T03:42:52.173268+0000","last_clean":"2024-09-17T03:42:52.173268+0000","last_became_active":"2024-09-17T03:42:52.170932+0000","last_became_peered":"2024-09-17T03:42:52.170932+0000","last_unstale":"2024-09-17T03:42:52.173268+0000","last_undegraded":"2024-09-17T03:42:52.173268+0000","last_fullsized":"2024-09-17T03:42:52.173268+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:15.801600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844306+0000","last_change":"2024-09-17T03:42:52.166646+0000","last_active":"2024-09-17T03:42:53.844306+0000","last_peered":"2024-09-17T03:42:53.844306+0000","last_clean":"2024-09-17T03:42:53.844306+0000","last_became_active":"2024-09-17T03:42:52.166269+0000","last_became_peered":"2024-09-17T03:42:52.166269+0000","last_unstale":"2024-09-17T03:42:53.844306+0000","last_undegraded":"2024-09-17T03:42:53.844306+0000","last_fullsized":"2024-09-17T03:42:53.844306+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:29.220120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153444+0000","last_change":"2024-09-17T03:42:52.168408+0000","last_active":"2024-09-17T03:42:53.153444+0000","last_peered":"2024-09-17T03:42:53.153444+0000","last_clean":"2024-09-17T03:42:53.153444+0000","last_became_active":"2024-09-17T03:42:52.168088+0000","last_became_peered":"2024-09-17T03:42:52.168088+0000","last_unstale":"2024-09-17T03:42:53.153444+0000","last_undegraded":"2024-09-17T03:42:53.153444+0000","last_fullsized":"2024-09-17T03:42:53.153444+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:45.063849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974805+0000","last_change":"2024-09-17T03:42:52.174479+0000","last_active":"2024-09-17T03:42:53.974805+0000","last_peered":"2024-09-17T03:42:53.974805+0000","last_clean":"2024-09-17T03:42:53.974805+0000","last_became_active":"2024-09-17T03:42:52.174149+0000","last_became_peered":"2024-09-17T03:42:52.174149+0000","last_unstale":"2024-09-17T03:42:53.974805+0000","last_undegraded":"2024-09-17T03:42:53.974805+0000","last_fullsized":"2024-09-17T03:42:53.974805+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:51.184896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178541+0000","last_change":"2024-09-17T03:42:52.176954+0000","last_active":"2024-09-17T03:42:52.178541+0000","last_peered":"2024-09-17T03:42:52.178541+0000","last_clean":"2024-09-17T03:42:52.178541+0000","last_became_active":"2024-09-17T03:42:52.176627+0000","last_became_peered":"2024-09-17T03:42:52.176627+0000","last_unstale":"2024-09-17T03:42:52.178541+0000","last_undegraded":"2024-09-17T03:42:52.178541+0000","last_fullsized":"2024-09-17T03:42:52.178541+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:19.802075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974938+0000","last_change":"2024-09-17T03:42:52.171146+0000","last_active":"2024-09-17T03:42:53.974938+0000","last_peered":"2024-09-17T03:42:53.974938+0000","last_clean":"2024-09-17T03:42:53.974938+0000","last_became_active":"2024-09-17T03:42:52.170824+0000","last_became_peered":"2024-09-17T03:42:52.170824+0000","last_unstale":"2024-09-17T03:42:53.974938+0000","last_undegraded":"2024-09-17T03:42:53.974938+0000","last_fullsized":"2024-09-17T03:42:53.974938+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:01.909060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.173295+0000","last_change":"2024-09-17T03:42:52.167032+0000","last_active":"2024-09-17T03:42:52.173295+0000","last_peered":"2024-09-17T03:42:52.173295+0000","last_clean":"2024-09-17T03:42:52.173295+0000","last_became_active":"2024-09-17T03:42:52.166269+0000","last_became_peered":"2024-09-17T03:42:52.166269+0000","last_unstale":"2024-09-17T03:42:52.173295+0000","last_undegraded":"2024-09-17T03:42:52.173295+0000","last_fullsized":"2024-09-17T03:42:52.173295+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:51.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973728+0000","last_change":"2024-09-17T03:42:52.173539+0000","last_active":"2024-09-17T03:42:53.973728+0000","last_peered":"2024-09-17T03:42:53.973728+0000","last_clean":"2024-09-17T03:42:53.973728+0000","last_became_active":"2024-09-17T03:42:52.173241+0000","last_became_peered":"2024-09-17T03:42:52.173241+0000","last_unstale":"2024-09-17T03:42:53.973728+0000","last_undegraded":"2024-09-17T03:42:53.973728+0000","last_fullsized":"2024-09-17T03:42:53.973728+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:41.327313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157763+0000","last_change":"2024-09-17T03:42:52.167171+0000","last_active":"2024-09-17T03:42:53.157763+0000","last_peered":"2024-09-17T03:42:53.157763+0000","last_clean":"2024-09-17T03:42:53.157763+0000","last_became_active":"2024-09-17T03:42:52.166787+0000","last_became_peered":"2024-09-17T03:42:52.166787+0000","last_unstale":"2024-09-17T03:42:53.157763+0000","last_undegraded":"2024-09-17T03:42:53.157763+0000","last_fullsized":"2024-09-17T03:42:53.157763+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:41.672806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973633+0000","last_change":"2024-09-17T03:42:52.163659+0000","last_active":"2024-09-17T03:42:53.973633+0000","last_peered":"2024-09-17T03:42:53.973633+0000","last_clean":"2024-09-17T03:42:53.973633+0000","last_became_active":"2024-09-17T03:42:52.162774+0000","last_became_peered":"2024-09-17T03:42:52.162774+0000","last_unstale":"2024-09-17T03:42:53.973633+0000","last_undegraded":"2024-09-17T03:42:53.973633+0000","last_fullsized":"2024-09-17T03:42:53.973633+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:57.181165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157977+0000","last_change":"2024-09-17T03:42:52.174471+0000","last_active":"2024-09-17T03:42:53.157977+0000","last_peered":"2024-09-17T03:42:53.157977+0000","last_clean":"2024-09-17T03:42:53.157977+0000","last_became_active":"2024-09-17T03:42:52.174135+0000","last_became_peered":"2024-09-17T03:42:52.174135+0000","last_unstale":"2024-09-17T03:42:53.157977+0000","last_undegraded":"2024-09-17T03:42:53.157977+0000","last_fullsized":"2024-09-17T03:42:53.157977+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:31.811404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.176795+0000","last_change":"2024-09-17T03:42:52.175569+0000","last_active":"2024-09-17T03:42:52.176795+0000","last_peered":"2024-09-17T03:42:52.176795+0000","last_clean":"2024-09-17T03:42:52.176795+0000","last_became_active":"2024-09-17T03:42:52.175232+0000","last_became_peered":"2024-09-17T03:42:52.175232+0000","last_unstale":"2024-09-17T03:42:52.176795+0000","last_undegraded":"2024-09-17T03:42:52.176795+0000","last_fullsized":"2024-09-17T03:42:52.176795+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:52.376467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153710+0000","last_change":"2024-09-17T03:42:52.171546+0000","last_active":"2024-09-17T03:42:53.153710+0000","last_peered":"2024-09-17T03:42:53.153710+0000","last_clean":"2024-09-17T03:42:53.153710+0000","last_became_active":"2024-09-17T03:42:52.171183+0000","last_became_peered":"2024-09-17T03:42:52.171183+0000","last_unstale":"2024-09-17T03:42:53.153710+0000","last_undegraded":"2024-09-17T03:42:53.153710+0000","last_fullsized":"2024-09-17T03:42:53.153710+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:39.712036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178909+0000","last_change":"2024-09-17T03:42:52.177604+0000","last_active":"2024-09-17T03:42:52.178909+0000","last_peered":"2024-09-17T03:42:52.178909+0000","last_clean":"2024-09-17T03:42:52.178909+0000","last_became_active":"2024-09-17T03:42:52.177207+0000","last_became_peered":"2024-09-17T03:42:52.177207+0000","last_unstale":"2024-09-17T03:42:52.178909+0000","last_undegraded":"2024-09-17T03:42:52.178909+0000","last_fullsized":"2024-09-17T03:42:52.178909+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:01.223813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974733+0000","last_change":"2024-09-17T03:42:52.172770+0000","last_active":"2024-09-17T03:42:53.974733+0000","last_peered":"2024-09-17T03:42:53.974733+0000","last_clean":"2024-09-17T03:42:53.974733+0000","last_became_active":"2024-09-17T03:42:52.172465+0000","last_became_peered":"2024-09-17T03:42:52.172465+0000","last_unstale":"2024-09-17T03:42:53.974733+0000","last_undegraded":"2024-09-17T03:42:53.974733+0000","last_fullsized":"2024-09-17T03:42:53.974733+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:31.811404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178135+0000","last_change":"2024-09-17T03:42:52.176259+0000","last_active":"2024-09-17T03:42:52.178135+0000","last_peered":"2024-09-17T03:42:52.178135+0000","last_clean":"2024-09-17T03:42:52.178135+0000","last_became_active":"2024-09-17T03:42:52.175927+0000","last_became_peered":"2024-09-17T03:42:52.175927+0000","last_unstale":"2024-09-17T03:42:52.178135+0000","last_undegraded":"2024-09-17T03:42:52.178135+0000","last_fullsized":"2024-09-17T03:42:52.178135+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:06.083940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158584+0000","last_change":"2024-09-17T03:42:52.172451+0000","last_active":"2024-09-17T03:42:53.158584+0000","last_peered":"2024-09-17T03:42:53.158584+0000","last_clean":"2024-09-17T03:42:53.158584+0000","last_became_active":"2024-09-17T03:42:52.172131+0000","last_became_peered":"2024-09-17T03:42:52.172131+0000","last_unstale":"2024-09-17T03:42:53.158584+0000","last_undegraded":"2024-09-17T03:42:53.158584+0000","last_fullsized":"2024-09-17T03:42:53.158584+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:37.144283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158208+0000","last_change":"2024-09-17T03:42:52.175390+0000","last_active":"2024-09-17T03:42:53.158208+0000","last_peered":"2024-09-17T03:42:53.158208+0000","last_clean":"2024-09-17T03:42:53.158208+0000","last_became_active":"2024-09-17T03:42:52.175058+0000","last_became_peered":"2024-09-17T03:42:52.175058+0000","last_unstale":"2024-09-17T03:42:53.158208+0000","last_undegraded":"2024-09-17T03:42:53.158208+0000","last_fullsized":"2024-09-17T03:42:53.158208+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:20.271100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178451+0000","last_change":"2024-09-17T03:42:52.176852+0000","last_active":"2024-09-17T03:42:52.178451+0000","last_peered":"2024-09-17T03:42:52.178451+0000","last_clean":"2024-09-17T03:42:52.178451+0000","last_became_active":"2024-09-17T03:42:52.176533+0000","last_became_peered":"2024-09-17T03:42:52.176533+0000","last_unstale":"2024-09-17T03:42:52.178451+0000","last_undegraded":"2024-09-17T03:42:52.178451+0000","last_fullsized":"2024-09-17T03:42:52.178451+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:37.031035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153847+0000","last_change":"2024-09-17T03:42:52.170249+0000","last_active":"2024-09-17T03:42:53.153847+0000","last_peered":"2024-09-17T03:42:53.153847+0000","last_clean":"2024-09-17T03:42:53.153847+0000","last_became_active":"2024-09-17T03:42:52.169950+0000","last_became_peered":"2024-09-17T03:42:52.169950+0000","last_unstale":"2024-09-17T03:42:53.153847+0000","last_undegraded":"2024-09-17T03:42:53.153847+0000","last_fullsized":"2024-09-17T03:42:53.153847+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:24.182060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"153'4","reported_seq":19,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844468+0000","last_change":"2024-09-17T03:42:51.158675+0000","last_active":"2024-09-17T03:42:53.844468+0000","last_peered":"2024-09-17T03:42:53.844468+0000","last_clean":"2024-09-17T03:42:53.844468+0000","last_became_active":"2024-09-17T03:42:51.158297+0000","last_became_peered":"2024-09-17T03:42:51.158297+0000","last_unstale":"2024-09-17T03:42:53.844468+0000","last_undegraded":"2024-09-17T03:42:53.844468+0000","last_fullsized":"2024-09-17T03:42:53.844468+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:23.176650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158289+0000","last_change":"2024-09-17T03:42:52.171095+0000","last_active":"2024-09-17T03:42:53.158289+0000","last_peered":"2024-09-17T03:42:53.158289+0000","last_clean":"2024-09-17T03:42:53.158289+0000","last_became_active":"2024-09-17T03:42:52.170766+0000","last_became_peered":"2024-09-17T03:42:52.170766+0000","last_unstale":"2024-09-17T03:42:53.158289+0000","last_undegraded":"2024-09-17T03:42:53.158289+0000","last_fullsized":"2024-09-17T03:42:53.158289+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:13.428703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"153'1","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157433+0000","last_change":"2024-09-17T03:42:51.152434+0000","last_active":"2024-09-17T03:42:53.157433+0000","last_peered":"2024-09-17T03:42:53.157433+0000","last_clean":"2024-09-17T03:42:53.157433+0000","last_became_active":"2024-09-17T03:42:51.151982+0000","last_became_peered":"2024-09-17T03:42:51.151982+0000","last_unstale":"2024-09-17T03:42:53.157433+0000","last_undegraded":"2024-09-17T03:42:53.157433+0000","last_fullsized":"2024-09-17T03:42:53.157433+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:36.994491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974078+0000","last_change":"2024-09-17T03:42:52.171114+0000","last_active":"2024-09-17T03:42:53.974078+0000","last_peered":"2024-09-17T03:42:53.974078+0000","last_clean":"2024-09-17T03:42:53.974078+0000","last_became_active":"2024-09-17T03:42:52.170771+0000","last_became_peered":"2024-09-17T03:42:52.170771+0000","last_unstale":"2024-09-17T03:42:53.974078+0000","last_undegraded":"2024-09-17T03:42:53.974078+0000","last_fullsized":"2024-09-17T03:42:53.974078+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:44.993911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"153'2","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974997+0000","last_change":"2024-09-17T03:42:51.159069+0000","last_active":"2024-09-17T03:42:53.974997+0000","last_peered":"2024-09-17T03:42:53.974997+0000","last_clean":"2024-09-17T03:42:53.974997+0000","last_became_active":"2024-09-17T03:42:51.158291+0000","last_became_peered":"2024-09-17T03:42:51.158291+0000","last_unstale":"2024-09-17T03:42:53.974997+0000","last_undegraded":"2024-09-17T03:42:53.974997+0000","last_fullsized":"2024-09-17T03:42:53.974997+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:23.721127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.181553+0000","last_change":"2024-09-17T03:42:52.180751+0000","last_active":"2024-09-17T03:42:52.181553+0000","last_peered":"2024-09-17T03:42:52.181553+0000","last_clean":"2024-09-17T03:42:52.181553+0000","last_became_active":"2024-09-17T03:42:52.180346+0000","last_became_peered":"2024-09-17T03:42:52.180346+0000","last_unstale":"2024-09-17T03:42:52.181553+0000","last_undegraded":"2024-09-17T03:42:52.181553+0000","last_fullsized":"2024-09-17T03:42:52.181553+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:26.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"153'2","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.975127+0000","last_change":"2024-09-17T03:42:51.157431+0000","last_active":"2024-09-17T03:42:53.975127+0000","last_peered":"2024-09-17T03:42:53.975127+0000","last_clean":"2024-09-17T03:42:53.975127+0000","last_became_active":"2024-09-17T03:42:51.157119+0000","last_became_peered":"2024-09-17T03:42:51.157119+0000","last_unstale":"2024-09-17T03:42:53.975127+0000","last_undegraded":"2024-09-17T03:42:53.975127+0000","last_fullsized":"2024-09-17T03:42:53.975127+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:08.621226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.154041+0000","last_change":"2024-09-17T03:42:52.163213+0000","last_active":"2024-09-17T03:42:53.154041+0000","last_peered":"2024-09-17T03:42:53.154041+0000","last_clean":"2024-09-17T03:42:53.154041+0000","last_became_active":"2024-09-17T03:42:52.162909+0000","last_became_peered":"2024-09-17T03:42:52.162909+0000","last_unstale":"2024-09-17T03:42:53.154041+0000","last_undegraded":"2024-09-17T03:42:53.154041+0000","last_fullsized":"2024-09-17T03:42:53.154041+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:51.442806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"153'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.182005+0000","last_change":"2024-09-17T03:42:51.162303+0000","last_active":"2024-09-17T03:42:52.182005+0000","last_peered":"2024-09-17T03:42:52.182005+0000","last_clean":"2024-09-17T03:42:52.182005+0000","last_became_active":"2024-09-17T03:42:51.161960+0000","last_became_peered":"2024-09-17T03:42:51.161960+0000","last_unstale":"2024-09-17T03:42:52.182005+0000","last_undegraded":"2024-09-17T03:42:52.182005+0000","last_fullsized":"2024-09-17T03:42:52.182005+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:40.904155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974028+0000","last_change":"2024-09-17T03:42:52.173091+0000","last_active":"2024-09-17T03:42:53.974028+0000","last_peered":"2024-09-17T03:42:53.974028+0000","last_clean":"2024-09-17T03:42:53.974028+0000","last_became_active":"2024-09-17T03:42:52.172779+0000","last_became_peered":"2024-09-17T03:42:52.172779+0000","last_unstale":"2024-09-17T03:42:53.974028+0000","last_undegraded":"2024-09-17T03:42:53.974028+0000","last_fullsized":"2024-09-17T03:42:53.974028+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:19.502739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"153'1","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973316+0000","last_change":"2024-09-17T03:42:51.158532+0000","last_active":"2024-09-17T03:42:53.973316+0000","last_peered":"2024-09-17T03:42:53.973316+0000","last_clean":"2024-09-17T03:42:53.973316+0000","last_became_active":"2024-09-17T03:42:51.158213+0000","last_became_peered":"2024-09-17T03:42:51.158213+0000","last_unstale":"2024-09-17T03:42:53.973316+0000","last_undegraded":"2024-09-17T03:42:53.973316+0000","last_fullsized":"2024-09-17T03:42:53.973316+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:01.672012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973582+0000","last_change":"2024-09-17T03:42:52.172403+0000","last_active":"2024-09-17T03:42:53.973582+0000","last_peered":"2024-09-17T03:42:53.973582+0000","last_clean":"2024-09-17T03:42:53.973582+0000","last_became_active":"2024-09-17T03:42:52.172102+0000","last_became_peered":"2024-09-17T03:42:52.172102+0000","last_unstale":"2024-09-17T03:42:53.973582+0000","last_undegraded":"2024-09-17T03:42:53.973582+0000","last_fullsized":"2024-09-17T03:42:53.973582+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:38.642645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158272+0000","last_change":"2024-09-17T03:42:51.158184+0000","last_active":"2024-09-17T03:42:53.158272+0000","last_peered":"2024-09-17T03:42:53.158272+0000","last_clean":"2024-09-17T03:42:53.158272+0000","last_became_active":"2024-09-17T03:42:51.157837+0000","last_became_peered":"2024-09-17T03:42:51.157837+0000","last_unstale":"2024-09-17T03:42:53.158272+0000","last_undegraded":"2024-09-17T03:42:53.158272+0000","last_fullsized":"2024-09-17T03:42:53.158272+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:08.573467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.975049+0000","last_change":"2024-09-17T03:42:52.165007+0000","last_active":"2024-09-17T03:42:53.975049+0000","last_peered":"2024-09-17T03:42:53.975049+0000","last_clean":"2024-09-17T03:42:53.975049+0000","last_became_active":"2024-09-17T03:42:52.164687+0000","last_became_peered":"2024-09-17T03:42:52.164687+0000","last_unstale":"2024-09-17T03:42:53.975049+0000","last_undegraded":"2024-09-17T03:42:53.975049+0000","last_fullsized":"2024-09-17T03:42:53.975049+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:18.025614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153564+0000","last_change":"2024-09-17T03:42:51.155129+0000","last_active":"2024-09-17T03:42:53.153564+0000","last_peered":"2024-09-17T03:42:53.153564+0000","last_clean":"2024-09-17T03:42:53.153564+0000","last_became_active":"2024-09-17T03:42:51.154458+0000","last_became_peered":"2024-09-17T03:42:51.154458+0000","last_unstale":"2024-09-17T03:42:53.153564+0000","last_undegraded":"2024-09-17T03:42:53.153564+0000","last_fullsized":"2024-09-17T03:42:53.153564+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:58.599165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.169356+0000","last_change":"2024-09-17T03:42:52.166186+0000","last_active":"2024-09-17T03:42:52.169356+0000","last_peered":"2024-09-17T03:42:52.169356+0000","last_clean":"2024-09-17T03:42:52.169356+0000","last_became_active":"2024-09-17T03:42:52.165857+0000","last_became_peered":"2024-09-17T03:42:52.165857+0000","last_unstale":"2024-09-17T03:42:52.169356+0000","last_undegraded":"2024-09-17T03:42:52.169356+0000","last_fullsized":"2024-09-17T03:42:52.169356+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:25.117261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974816+0000","last_change":"2024-09-17T03:42:51.159392+0000","last_active":"2024-09-17T03:42:53.974816+0000","last_peered":"2024-09-17T03:42:53.974816+0000","last_clean":"2024-09-17T03:42:53.974816+0000","last_became_active":"2024-09-17T03:42:51.159086+0000","last_became_peered":"2024-09-17T03:42:51.159086+0000","last_unstale":"2024-09-17T03:42:53.974816+0000","last_undegraded":"2024-09-17T03:42:53.974816+0000","last_fullsized":"2024-09-17T03:42:53.974816+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:28.940975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178929+0000","last_change":"2024-09-17T03:42:52.177825+0000","last_active":"2024-09-17T03:42:52.178929+0000","last_peered":"2024-09-17T03:42:52.178929+0000","last_clean":"2024-09-17T03:42:52.178929+0000","last_became_active":"2024-09-17T03:42:52.177142+0000","last_became_peered":"2024-09-17T03:42:52.177142+0000","last_unstale":"2024-09-17T03:42:52.178929+0000","last_undegraded":"2024-09-17T03:42:52.178929+0000","last_fullsized":"2024-09-17T03:42:52.178929+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:53.353327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"153'3","reported_seq":18,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974474+0000","last_change":"2024-09-17T03:42:51.156236+0000","last_active":"2024-09-17T03:42:53.974474+0000","last_peered":"2024-09-17T03:42:53.974474+0000","last_clean":"2024-09-17T03:42:53.974474+0000","last_became_active":"2024-09-17T03:42:51.154912+0000","last_became_peered":"2024-09-17T03:42:51.154912+0000","last_unstale":"2024-09-17T03:42:53.974474+0000","last_undegraded":"2024-09-17T03:42:53.974474+0000","last_fullsized":"2024-09-17T03:42:53.974474+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:01.306963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158243+0000","last_change":"2024-09-17T03:42:52.179738+0000","last_active":"2024-09-17T03:42:53.158243+0000","last_peered":"2024-09-17T03:42:53.158243+0000","last_clean":"2024-09-17T03:42:53.158243+0000","last_became_active":"2024-09-17T03:42:52.179416+0000","last_became_peered":"2024-09-17T03:42:52.179416+0000","last_unstale":"2024-09-17T03:42:53.158243+0000","last_undegraded":"2024-09-17T03:42:53.158243+0000","last_fullsized":"2024-09-17T03:42:53.158243+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:02.287801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"153'6","reported_seq":21,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158483+0000","last_change":"2024-09-17T03:42:51.157622+0000","last_active":"2024-09-17T03:42:53.158483+0000","last_peered":"2024-09-17T03:42:53.158483+0000","last_clean":"2024-09-17T03:42:53.158483+0000","last_became_active":"2024-09-17T03:42:51.157112+0000","last_became_peered":"2024-09-17T03:42:51.157112+0000","last_unstale":"2024-09-17T03:42:53.158483+0000","last_undegraded":"2024-09-17T03:42:53.158483+0000","last_fullsized":"2024-09-17T03:42:53.158483+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:09.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178636+0000","last_change":"2024-09-17T03:42:52.177529+0000","last_active":"2024-09-17T03:42:52.178636+0000","last_peered":"2024-09-17T03:42:52.178636+0000","last_clean":"2024-09-17T03:42:52.178636+0000","last_became_active":"2024-09-17T03:42:52.177197+0000","last_became_peered":"2024-09-17T03:42:52.177197+0000","last_unstale":"2024-09-17T03:42:52.178636+0000","last_undegraded":"2024-09-17T03:42:52.178636+0000","last_fullsized":"2024-09-17T03:42:52.178636+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:07.811581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"153'2","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973842+0000","last_change":"2024-09-17T03:42:51.161604+0000","last_active":"2024-09-17T03:42:53.973842+0000","last_peered":"2024-09-17T03:42:53.973842+0000","last_clean":"2024-09-17T03:42:53.973842+0000","last_became_active":"2024-09-17T03:42:51.161004+0000","last_became_peered":"2024-09-17T03:42:51.161004+0000","last_unstale":"2024-09-17T03:42:53.973842+0000","last_undegraded":"2024-09-17T03:42:53.973842+0000","last_fullsized":"2024-09-17T03:42:53.973842+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:51.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153976+0000","last_change":"2024-09-17T03:42:52.178155+0000","last_active":"2024-09-17T03:42:53.153976+0000","last_peered":"2024-09-17T03:42:53.153976+0000","last_clean":"2024-09-17T03:42:53.153976+0000","last_became_active":"2024-09-17T03:42:52.175687+0000","last_became_peered":"2024-09-17T03:42:52.175687+0000","last_unstale":"2024-09-17T03:42:53.153976+0000","last_undegraded":"2024-09-17T03:42:53.153976+0000","last_fullsized":"2024-09-17T03:42:53.153976+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:45.799805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.152499+0000","last_change":"2024-09-17T03:42:51.159004+0000","last_active":"2024-09-17T03:42:52.152499+0000","last_peered":"2024-09-17T03:42:52.152499+0000","last_clean":"2024-09-17T03:42:52.152499+0000","last_became_active":"2024-09-17T03:42:51.158672+0000","last_became_peered":"2024-09-17T03:42:51.158672+0000","last_unstale":"2024-09-17T03:42:52.152499+0000","last_undegraded":"2024-09-17T03:42:52.152499+0000","last_fullsized":"2024-09-17T03:42:52.152499+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:09.514940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973566+0000","last_change":"2024-09-17T03:42:52.167219+0000","last_active":"2024-09-17T03:42:53.973566+0000","last_peered":"2024-09-17T03:42:53.973566+0000","last_clean":"2024-09-17T03:42:53.973566+0000","last_became_active":"2024-09-17T03:42:52.166906+0000","last_became_peered":"2024-09-17T03:42:52.166906+0000","last_unstale":"2024-09-17T03:42:53.973566+0000","last_undegraded":"2024-09-17T03:42:53.973566+0000","last_fullsized":"2024-09-17T03:42:53.973566+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:42.224892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973436+0000","last_change":"2024-09-17T03:42:51.156644+0000","last_active":"2024-09-17T03:42:53.973436+0000","last_peered":"2024-09-17T03:42:53.973436+0000","last_clean":"2024-09-17T03:42:53.973436+0000","last_became_active":"2024-09-17T03:42:51.156338+0000","last_became_peered":"2024-09-17T03:42:51.156338+0000","last_unstale":"2024-09-17T03:42:53.973436+0000","last_undegraded":"2024-09-17T03:42:53.973436+0000","last_fullsized":"2024-09-17T03:42:53.973436+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:07.014630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.173300+0000","last_change":"2024-09-17T03:42:52.168259+0000","last_active":"2024-09-17T03:42:52.173300+0000","last_peered":"2024-09-17T03:42:52.173300+0000","last_clean":"2024-09-17T03:42:52.173300+0000","last_became_active":"2024-09-17T03:42:52.166120+0000","last_became_peered":"2024-09-17T03:42:52.166120+0000","last_unstale":"2024-09-17T03:42:52.173300+0000","last_undegraded":"2024-09-17T03:42:52.173300+0000","last_fullsized":"2024-09-17T03:42:52.173300+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:53.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"153'8","reported_seq":23,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157074+0000","last_change":"2024-09-17T03:42:51.157386+0000","last_active":"2024-09-17T03:42:53.157074+0000","last_peered":"2024-09-17T03:42:53.157074+0000","last_clean":"2024-09-17T03:42:53.157074+0000","last_became_active":"2024-09-17T03:42:51.157062+0000","last_became_peered":"2024-09-17T03:42:51.157062+0000","last_unstale":"2024-09-17T03:42:53.157074+0000","last_undegraded":"2024-09-17T03:42:53.157074+0000","last_fullsized":"2024-09-17T03:42:53.157074+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:23.721127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974460+0000","last_change":"2024-09-17T03:42:52.168276+0000","last_active":"2024-09-17T03:42:53.974460+0000","last_peered":"2024-09-17T03:42:53.974460+0000","last_clean":"2024-09-17T03:42:53.974460+0000","last_became_active":"2024-09-17T03:42:52.166776+0000","last_became_peered":"2024-09-17T03:42:52.166776+0000","last_unstale":"2024-09-17T03:42:53.974460+0000","last_undegraded":"2024-09-17T03:42:53.974460+0000","last_fullsized":"2024-09-17T03:42:53.974460+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:41.672806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"153'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.181597+0000","last_change":"2024-09-17T03:42:51.161444+0000","last_active":"2024-09-17T03:42:52.181597+0000","last_peered":"2024-09-17T03:42:52.181597+0000","last_clean":"2024-09-17T03:42:52.181597+0000","last_became_active":"2024-09-17T03:42:51.161141+0000","last_became_peered":"2024-09-17T03:42:51.161141+0000","last_unstale":"2024-09-17T03:42:52.181597+0000","last_undegraded":"2024-09-17T03:42:52.181597+0000","last_fullsized":"2024-09-17T03:42:52.181597+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:12.998027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.176370+0000","last_change":"2024-09-17T03:42:52.171001+0000","last_active":"2024-09-17T03:42:52.176370+0000","last_peered":"2024-09-17T03:42:52.176370+0000","last_clean":"2024-09-17T03:42:52.176370+0000","last_became_active":"2024-09-17T03:42:52.170720+0000","last_became_peered":"2024-09-17T03:42:52.170720+0000","last_unstale":"2024-09-17T03:42:52.176370+0000","last_undegraded":"2024-09-17T03:42:52.176370+0000","last_fullsized":"2024-09-17T03:42:52.176370+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:41.647874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"153'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.183111+0000","last_change":"2024-09-17T03:42:51.162662+0000","last_active":"2024-09-17T03:42:52.183111+0000","last_peered":"2024-09-17T03:42:52.183111+0000","last_clean":"2024-09-17T03:42:52.183111+0000","last_became_active":"2024-09-17T03:42:51.160834+0000","last_became_peered":"2024-09-17T03:42:51.160834+0000","last_unstale":"2024-09-17T03:42:52.183111+0000","last_undegraded":"2024-09-17T03:42:52.183111+0000","last_fullsized":"2024-09-17T03:42:52.183111+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:17.745132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974987+0000","last_change":"2024-09-17T03:42:52.163553+0000","last_active":"2024-09-17T03:42:53.974987+0000","last_peered":"2024-09-17T03:42:53.974987+0000","last_clean":"2024-09-17T03:42:53.974987+0000","last_became_active":"2024-09-17T03:42:52.163243+0000","last_became_peered":"2024-09-17T03:42:52.163243+0000","last_unstale":"2024-09-17T03:42:53.974987+0000","last_undegraded":"2024-09-17T03:42:53.974987+0000","last_fullsized":"2024-09-17T03:42:53.974987+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:49.791293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"153'1","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844344+0000","last_change":"2024-09-17T03:42:51.158791+0000","last_active":"2024-09-17T03:42:53.844344+0000","last_peered":"2024-09-17T03:42:53.844344+0000","last_clean":"2024-09-17T03:42:53.844344+0000","last_became_active":"2024-09-17T03:42:51.156922+0000","last_became_peered":"2024-09-17T03:42:51.156922+0000","last_unstale":"2024-09-17T03:42:53.844344+0000","last_undegraded":"2024-09-17T03:42:53.844344+0000","last_fullsized":"2024-09-17T03:42:53.844344+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:11.351542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153582+0000","last_change":"2024-09-17T03:42:52.173990+0000","last_active":"2024-09-17T03:42:53.153582+0000","last_peered":"2024-09-17T03:42:53.153582+0000","last_clean":"2024-09-17T03:42:53.153582+0000","last_became_active":"2024-09-17T03:42:52.173697+0000","last_became_peered":"2024-09-17T03:42:52.173697+0000","last_unstale":"2024-09-17T03:42:53.153582+0000","last_undegraded":"2024-09-17T03:42:53.153582+0000","last_fullsized":"2024-09-17T03:42:53.153582+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:02.043568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844430+0000","last_change":"2024-09-17T03:42:51.161230+0000","last_active":"2024-09-17T03:42:53.844430+0000","last_peered":"2024-09-17T03:42:53.844430+0000","last_clean":"2024-09-17T03:42:53.844430+0000","last_became_active":"2024-09-17T03:42:51.160918+0000","last_became_peered":"2024-09-17T03:42:51.160918+0000","last_unstale":"2024-09-17T03:42:53.844430+0000","last_undegraded":"2024-09-17T03:42:53.844430+0000","last_fullsized":"2024-09-17T03:42:53.844430+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:27.922214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.173303+0000","last_change":"2024-09-17T03:42:52.167614+0000","last_active":"2024-09-17T03:42:52.173303+0000","last_peered":"2024-09-17T03:42:52.173303+0000","last_clean":"2024-09-17T03:42:52.173303+0000","last_became_active":"2024-09-17T03:42:52.167268+0000","last_became_peered":"2024-09-17T03:42:52.167268+0000","last_unstale":"2024-09-17T03:42:52.173303+0000","last_undegraded":"2024-09-17T03:42:52.173303+0000","last_fullsized":"2024-09-17T03:42:52.173303+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:33.228847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"153'2","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973989+0000","last_change":"2024-09-17T03:42:51.155839+0000","last_active":"2024-09-17T03:42:53.973989+0000","last_peered":"2024-09-17T03:42:53.973989+0000","last_clean":"2024-09-17T03:42:53.973989+0000","last_became_active":"2024-09-17T03:42:51.155532+0000","last_became_peered":"2024-09-17T03:42:51.155532+0000","last_unstale":"2024-09-17T03:42:53.973989+0000","last_undegraded":"2024-09-17T03:42:53.973989+0000","last_fullsized":"2024-09-17T03:42:53.973989+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:23.489556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.154090+0000","last_change":"2024-09-17T03:42:52.167698+0000","last_active":"2024-09-17T03:42:53.154090+0000","last_peered":"2024-09-17T03:42:53.154090+0000","last_clean":"2024-09-17T03:42:53.154090+0000","last_became_active":"2024-09-17T03:42:52.167361+0000","last_became_peered":"2024-09-17T03:42:52.167361+0000","last_unstale":"2024-09-17T03:42:53.154090+0000","last_undegraded":"2024-09-17T03:42:53.154090+0000","last_fullsized":"2024-09-17T03:42:53.154090+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:39.959900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844081+0000","last_change":"2024-09-17T03:42:51.155665+0000","last_active":"2024-09-17T03:42:53.844081+0000","last_peered":"2024-09-17T03:42:53.844081+0000","last_clean":"2024-09-17T03:42:53.844081+0000","last_became_active":"2024-09-17T03:42:51.155276+0000","last_became_peered":"2024-09-17T03:42:51.155276+0000","last_unstale":"2024-09-17T03:42:53.844081+0000","last_undegraded":"2024-09-17T03:42:53.844081+0000","last_fullsized":"2024-09-17T03:42:53.844081+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:51.651854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844167+0000","last_change":"2024-09-17T03:42:52.170275+0000","last_active":"2024-09-17T03:42:53.844167+0000","last_peered":"2024-09-17T03:42:53.844167+0000","last_clean":"2024-09-17T03:42:53.844167+0000","last_became_active":"2024-09-17T03:42:52.168668+0000","last_became_peered":"2024-09-17T03:42:52.168668+0000","last_unstale":"2024-09-17T03:42:53.844167+0000","last_undegraded":"2024-09-17T03:42:53.844167+0000","last_fullsized":"2024-09-17T03:42:53.844167+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:55.754600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973770+0000","last_change":"2024-09-17T03:42:51.157660+0000","last_active":"2024-09-17T03:42:53.973770+0000","last_peered":"2024-09-17T03:42:53.973770+0000","last_clean":"2024-09-17T03:42:53.973770+0000","last_became_active":"2024-09-17T03:42:51.157357+0000","last_became_peered":"2024-09-17T03:42:51.157357+0000","last_unstale":"2024-09-17T03:42:53.973770+0000","last_undegraded":"2024-09-17T03:42:53.973770+0000","last_fullsized":"2024-09-17T03:42:53.973770+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:47.334954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973882+0000","last_change":"2024-09-17T03:42:52.161781+0000","last_active":"2024-09-17T03:42:53.973882+0000","last_peered":"2024-09-17T03:42:53.973882+0000","last_clean":"2024-09-17T03:42:53.973882+0000","last_became_active":"2024-09-17T03:42:52.161479+0000","last_became_peered":"2024-09-17T03:42:52.161479+0000","last_unstale":"2024-09-17T03:42:53.973882+0000","last_undegraded":"2024-09-17T03:42:53.973882+0000","last_fullsized":"2024-09-17T03:42:53.973882+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:20.962301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844292+0000","last_change":"2024-09-17T03:42:51.157277+0000","last_active":"2024-09-17T03:42:53.844292+0000","last_peered":"2024-09-17T03:42:53.844292+0000","last_clean":"2024-09-17T03:42:53.844292+0000","last_became_active":"2024-09-17T03:42:51.156823+0000","last_became_peered":"2024-09-17T03:42:51.156823+0000","last_unstale":"2024-09-17T03:42:53.844292+0000","last_undegraded":"2024-09-17T03:42:53.844292+0000","last_fullsized":"2024-09-17T03:42:53.844292+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:21.757528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.170328+0000","last_change":"2024-09-17T03:42:52.169112+0000","last_active":"2024-09-17T03:42:52.170328+0000","last_peered":"2024-09-17T03:42:52.170328+0000","last_clean":"2024-09-17T03:42:52.170328+0000","last_became_active":"2024-09-17T03:42:52.168817+0000","last_became_peered":"2024-09-17T03:42:52.168817+0000","last_unstale":"2024-09-17T03:42:52.170328+0000","last_undegraded":"2024-09-17T03:42:52.170328+0000","last_fullsized":"2024-09-17T03:42:52.170328+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:18.459211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"153'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.186641+0000","last_change":"2024-09-17T03:42:51.161807+0000","last_active":"2024-09-17T03:42:52.186641+0000","last_peered":"2024-09-17T03:42:52.186641+0000","last_clean":"2024-09-17T03:42:52.186641+0000","last_became_active":"2024-09-17T03:42:51.161516+0000","last_became_peered":"2024-09-17T03:42:51.161516+0000","last_unstale":"2024-09-17T03:42:52.186641+0000","last_undegraded":"2024-09-17T03:42:52.186641+0000","last_fullsized":"2024-09-17T03:42:52.186641+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:22.875211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153630+0000","last_change":"2024-09-17T03:42:52.179896+0000","last_active":"2024-09-17T03:42:53.153630+0000","last_peered":"2024-09-17T03:42:53.153630+0000","last_clean":"2024-09-17T03:42:53.153630+0000","last_became_active":"2024-09-17T03:42:52.174712+0000","last_became_peered":"2024-09-17T03:42:52.174712+0000","last_unstale":"2024-09-17T03:42:53.153630+0000","last_undegraded":"2024-09-17T03:42:53.153630+0000","last_fullsized":"2024-09-17T03:42:53.153630+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:20.460167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.161654+0000","last_change":"2024-09-17T03:42:51.162460+0000","last_active":"2024-09-17T03:42:52.161654+0000","last_peered":"2024-09-17T03:42:52.161654+0000","last_clean":"2024-09-17T03:42:52.161654+0000","last_became_active":"2024-09-17T03:42:51.162061+0000","last_became_peered":"2024-09-17T03:42:51.162061+0000","last_unstale":"2024-09-17T03:42:52.161654+0000","last_undegraded":"2024-09-17T03:42:52.161654+0000","last_fullsized":"2024-09-17T03:42:52.161654+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:33.192917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974302+0000","last_change":"2024-09-17T03:42:52.169530+0000","last_active":"2024-09-17T03:42:53.974302+0000","last_peered":"2024-09-17T03:42:53.974302+0000","last_clean":"2024-09-17T03:42:53.974302+0000","last_became_active":"2024-09-17T03:42:52.169190+0000","last_became_peered":"2024-09-17T03:42:52.169190+0000","last_unstale":"2024-09-17T03:42:53.974302+0000","last_undegraded":"2024-09-17T03:42:53.974302+0000","last_fullsized":"2024-09-17T03:42:53.974302+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:58.404899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157407+0000","last_change":"2024-09-17T03:42:51.162161+0000","last_active":"2024-09-17T03:42:53.157407+0000","last_peered":"2024-09-17T03:42:53.157407+0000","last_clean":"2024-09-17T03:42:53.157407+0000","last_became_active":"2024-09-17T03:42:51.161855+0000","last_became_peered":"2024-09-17T03:42:51.161855+0000","last_unstale":"2024-09-17T03:42:53.157407+0000","last_undegraded":"2024-09-17T03:42:53.157407+0000","last_fullsized":"2024-09-17T03:42:53.157407+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:10.746724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.161840+0000","last_change":"2024-09-17T03:42:52.159619+0000","last_active":"2024-09-17T03:42:52.161840+0000","last_peered":"2024-09-17T03:42:52.161840+0000","last_clean":"2024-09-17T03:42:52.161840+0000","last_became_active":"2024-09-17T03:42:52.158713+0000","last_became_peered":"2024-09-17T03:42:52.158713+0000","last_unstale":"2024-09-17T03:42:52.161840+0000","last_undegraded":"2024-09-17T03:42:52.161840+0000","last_fullsized":"2024-09-17T03:42:52.161840+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:18.429107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.152314+0000","last_change":"2024-09-17T03:42:51.161352+0000","last_active":"2024-09-17T03:42:52.152314+0000","last_peered":"2024-09-17T03:42:52.152314+0000","last_clean":"2024-09-17T03:42:52.152314+0000","last_became_active":"2024-09-17T03:42:51.160687+0000","last_became_peered":"2024-09-17T03:42:51.160687+0000","last_unstale":"2024-09-17T03:42:52.152314+0000","last_undegraded":"2024-09-17T03:42:52.152314+0000","last_fullsized":"2024-09-17T03:42:52.152314+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:34.613914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178107+0000","last_change":"2024-09-17T03:42:52.176266+0000","last_active":"2024-09-17T03:42:52.178107+0000","last_peered":"2024-09-17T03:42:52.178107+0000","last_clean":"2024-09-17T03:42:52.178107+0000","last_became_active":"2024-09-17T03:42:52.171507+0000","last_became_peered":"2024-09-17T03:42:52.171507+0000","last_unstale":"2024-09-17T03:42:52.178107+0000","last_undegraded":"2024-09-17T03:42:52.178107+0000","last_fullsized":"2024-09-17T03:42:52.178107+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:55.562188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157828+0000","last_change":"2024-09-17T03:42:51.161021+0000","last_active":"2024-09-17T03:42:53.157828+0000","last_peered":"2024-09-17T03:42:53.157828+0000","last_clean":"2024-09-17T03:42:53.157828+0000","last_became_active":"2024-09-17T03:42:51.160643+0000","last_became_peered":"2024-09-17T03:42:51.160643+0000","last_unstale":"2024-09-17T03:42:53.157828+0000","last_undegraded":"2024-09-17T03:42:53.157828+0000","last_fullsized":"2024-09-17T03:42:53.157828+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:27.279410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157707+0000","last_change":"2024-09-17T03:42:52.178753+0000","last_active":"2024-09-17T03:42:53.157707+0000","last_peered":"2024-09-17T03:42:53.157707+0000","last_clean":"2024-09-17T03:42:53.157707+0000","last_became_active":"2024-09-17T03:42:52.178292+0000","last_became_peered":"2024-09-17T03:42:52.178292+0000","last_unstale":"2024-09-17T03:42:53.157707+0000","last_undegraded":"2024-09-17T03:42:53.157707+0000","last_fullsized":"2024-09-17T03:42:53.157707+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:57.084403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973454+0000","last_change":"2024-09-17T03:42:51.161243+0000","last_active":"2024-09-17T03:42:53.973454+0000","last_peered":"2024-09-17T03:42:53.973454+0000","last_clean":"2024-09-17T03:42:53.973454+0000","last_became_active":"2024-09-17T03:42:51.160849+0000","last_became_peered":"2024-09-17T03:42:51.160849+0000","last_unstale":"2024-09-17T03:42:53.973454+0000","last_undegraded":"2024-09-17T03:42:53.973454+0000","last_fullsized":"2024-09-17T03:42:53.973454+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:37.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153538+0000","last_change":"2024-09-17T03:42:52.164782+0000","last_active":"2024-09-17T03:42:53.153538+0000","last_peered":"2024-09-17T03:42:53.153538+0000","last_clean":"2024-09-17T03:42:53.153538+0000","last_became_active":"2024-09-17T03:42:52.164470+0000","last_became_peered":"2024-09-17T03:42:52.164470+0000","last_unstale":"2024-09-17T03:42:53.153538+0000","last_undegraded":"2024-09-17T03:42:53.153538+0000","last_fullsized":"2024-09-17T03:42:53.153538+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:24.696705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158479+0000","last_change":"2024-09-17T03:42:51.161611+0000","last_active":"2024-09-17T03:42:53.158479+0000","last_peered":"2024-09-17T03:42:53.158479+0000","last_clean":"2024-09-17T03:42:53.158479+0000","last_became_active":"2024-09-17T03:42:51.161288+0000","last_became_peered":"2024-09-17T03:42:51.161288+0000","last_unstale":"2024-09-17T03:42:53.158479+0000","last_undegraded":"2024-09-17T03:42:53.158479+0000","last_fullsized":"2024-09-17T03:42:53.158479+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:50.900090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.173273+0000","last_change":"2024-09-17T03:42:52.170800+0000","last_active":"2024-09-17T03:42:52.173273+0000","last_peered":"2024-09-17T03:42:52.173273+0000","last_clean":"2024-09-17T03:42:52.173273+0000","last_became_active":"2024-09-17T03:42:52.169064+0000","last_became_peered":"2024-09-17T03:42:52.169064+0000","last_unstale":"2024-09-17T03:42:52.173273+0000","last_undegraded":"2024-09-17T03:42:52.173273+0000","last_fullsized":"2024-09-17T03:42:52.173273+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:08.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157093+0000","last_change":"2024-09-17T03:42:51.153719+0000","last_active":"2024-09-17T03:42:53.157093+0000","last_peered":"2024-09-17T03:42:53.157093+0000","last_clean":"2024-09-17T03:42:53.157093+0000","last_became_active":"2024-09-17T03:42:51.153421+0000","last_became_peered":"2024-09-17T03:42:51.153421+0000","last_unstale":"2024-09-17T03:42:53.157093+0000","last_undegraded":"2024-09-17T03:42:53.157093+0000","last_fullsized":"2024-09-17T03:42:53.157093+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:53.513715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.171214+0000","last_change":"2024-09-17T03:42:52.169981+0000","last_active":"2024-09-17T03:42:52.171214+0000","last_peered":"2024-09-17T03:42:52.171214+0000","last_clean":"2024-09-17T03:42:52.171214+0000","last_became_active":"2024-09-17T03:42:52.169688+0000","last_became_peered":"2024-09-17T03:42:52.169688+0000","last_unstale":"2024-09-17T03:42:52.171214+0000","last_undegraded":"2024-09-17T03:42:52.171214+0000","last_fullsized":"2024-09-17T03:42:52.171214+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:42.134117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158313+0000","last_change":"2024-09-17T03:42:51.158365+0000","last_active":"2024-09-17T03:42:53.158313+0000","last_peered":"2024-09-17T03:42:53.158313+0000","last_clean":"2024-09-17T03:42:53.158313+0000","last_became_active":"2024-09-17T03:42:51.158056+0000","last_became_peered":"2024-09-17T03:42:51.158056+0000","last_unstale":"2024-09-17T03:42:53.158313+0000","last_undegraded":"2024-09-17T03:42:53.158313+0000","last_fullsized":"2024-09-17T03:42:53.158313+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:10.705109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":356,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844258+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:42:53.844258+0000","last_peered":"2024-09-17T03:42:53.844258+0000","last_clean":"2024-09-17T03:42:53.844258+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:42:53.844258+0000","last_undegraded":"2024-09-17T03:42:53.844258+0000","last_fullsized":"2024-09-17T03:42:53.844258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509565,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55888,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315952,"statfs":{"total":96636764160,"available":96579534848,"internally_reserved":0,"allocated":2543616,"data_stored":1438544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509565,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55288,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316552,"statfs":{"total":96636764160,"available":96580149248,"internally_reserved":0,"allocated":1929216,"data_stored":845844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509565,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55300,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316540,"statfs":{"total":96636764160,"available":96580136960,"internally_reserved":0,"allocated":1941504,"data_stored":847504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509565,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51108,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320732,"statfs":{"total":96636764160,"available":96584429568,"internally_reserved":0,"allocated":1916928,"data_stored":839612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509566,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":1929216,"data_stored":845856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509566,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51700,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320140,"statfs":{"total":96636764160,"available":96583823360,"internally_reserved":0,"allocated":2519040,"data_stored":1436190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574972,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51088,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320752,"statfs":{"total":96636764160,"available":96584450048,"internally_reserved":0,"allocated":1900544,"data_stored":832747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55256,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316584,"statfs":{"total":96636764160,"available":96580182016,"internally_reserved":0,"allocated":1900544,"data_stored":832747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:42:56.190 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:42:56.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.339+0000 7f08ae50b640 1 -- 172.21.15.146:0/3329203627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a80b61f0 msgr2=0x7f08a80b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.339+0000 7f08ae50b640 1 --2- 172.21.15.146:0/3329203627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a80b61f0 0x7f08a80b6600 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f08a0005fd0 tx=0x7f08a002a820 comp rx=0 tx=0).stop 2024-09-17T03:42:56.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.339+0000 7f08ae50b640 1 -- 172.21.15.146:0/3329203627 shutdown_connections 2024-09-17T03:42:56.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.339+0000 7f08ae50b640 1 --2- 172.21.15.146:0/3329203627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a80b61f0 0x7f08a80b6600 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.339+0000 7f08ae50b640 1 --2- 172.21.15.146:0/3329203627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a80cfca0 0x7f08a80cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.339+0000 7f08ae50b640 1 -- 172.21.15.146:0/3329203627 >> 172.21.15.146:0/3329203627 conn(0x7f08a80d11f0 msgr2=0x7f08a80d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:56.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.339+0000 7f08ae50b640 1 -- 172.21.15.146:0/3329203627 shutdown_connections 2024-09-17T03:42:56.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.339+0000 7f08ae50b640 1 -- 172.21.15.146:0/3329203627 wait complete. 2024-09-17T03:42:56.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.340+0000 7f08ae50b640 1 Processor -- start 2024-09-17T03:42:56.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.341+0000 7f08ae50b640 1 -- start start 2024-09-17T03:42:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08ae50b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a80b61f0 0x7f08a8157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08ae50b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a80cfca0 0x7f08a80ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08ae50b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a815f1a0 0x7f08a80b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08ae50b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f08a80695b0 con 0x7f08a80b61f0 2024-09-17T03:42:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08ae50b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8069430 con 0x7f08a80cfca0 2024-09-17T03:42:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08ae50b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f08a8069730 con 0x7f08a815f1a0 2024-09-17T03:42:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08a7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a80b61f0 0x7f08a8157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08a7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a80b61f0 0x7f08a8157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50920/0 (socket says 172.21.15.146:50920) 2024-09-17T03:42:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08a7fff640 1 -- 172.21.15.146:0/3647664805 learned_addr learned my addr 172.21.15.146:0/3647664805 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08a77fe640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a80cfca0 0x7f08a80ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08acaa8640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a815f1a0 0x7f08a80b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08a7fff640 1 -- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a815f1a0 msgr2=0x7f08a80b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08a7fff640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a815f1a0 0x7f08a80b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08a7fff640 1 -- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a80cfca0 msgr2=0x7f08a80ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08a7fff640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a80cfca0 0x7f08a80ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08a7fff640 1 -- 172.21.15.146:0/3647664805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a8159860 con 0x7f08a80b61f0 2024-09-17T03:42:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.342+0000 7f08acaa8640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a815f1a0 0x7f08a80b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.343+0000 7f08a7fff640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a80b61f0 0x7f08a8157e60 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f089800c3a0 tx=0x7f089800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.343+0000 7f08a4ff9640 1 -- 172.21.15.146:0/3647664805 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898011790 con 0x7f08a80b61f0 2024-09-17T03:42:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.343+0000 7f08a4ff9640 1 -- 172.21.15.146:0/3647664805 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0898017070 con 0x7f08a80b61f0 2024-09-17T03:42:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.343+0000 7f08ae50b640 1 -- 172.21.15.146:0/3647664805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a8159d60 con 0x7f08a80b61f0 2024-09-17T03:42:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.343+0000 7f08a4ff9640 1 -- 172.21.15.146:0/3647664805 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898011cc0 con 0x7f08a80b61f0 2024-09-17T03:42:56.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.343+0000 7f08ae50b640 1 -- 172.21.15.146:0/3647664805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a815a320 con 0x7f08a80b61f0 2024-09-17T03:42:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.344+0000 7f08ae50b640 1 -- 172.21.15.146:0/3647664805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a8069c50 con 0x7f08a80b61f0 2024-09-17T03:42:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.345+0000 7f08a4ff9640 1 -- 172.21.15.146:0/3647664805 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f089801c460 con 0x7f08a80b61f0 2024-09-17T03:42:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.345+0000 7f08a4ff9640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0894078bc0 0x7f089407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.345+0000 7f08a4ff9640 1 -- 172.21.15.146:0/3647664805 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f089809aae0 con 0x7f08a80b61f0 2024-09-17T03:42:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.345+0000 7f08a77fe640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0894078bc0 0x7f089407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:56.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.346+0000 7f08a77fe640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0894078bc0 0x7f089407b0d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f08a80d40c0 tx=0x7f089c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:56.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.350+0000 7f08a4ff9640 1 -- 172.21.15.146:0/3647664805 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f08a80b6b40 con 0x7f08a80b61f0 2024-09-17T03:42:56.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.521+0000 7f08ae50b640 1 -- 172.21.15.146:0/3647664805 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08a80c7ff0 con 0x7f0894078bc0 2024-09-17T03:42:56.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.525+0000 7f08a4ff9640 1 -- 172.21.15.146:0/3647664805 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252470 (secure 0 0 0) 0x7f08a80c7ff0 con 0x7f0894078bc0 2024-09-17T03:42:56.528 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:56.529 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 -- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0894078bc0 msgr2=0x7f089407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0894078bc0 0x7f089407b0d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f08a80d40c0 tx=0x7f089c005f90 comp rx=0 tx=0).stop 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 -- 172.21.15.146:0/3647664805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a80b61f0 msgr2=0x7f08a8157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a80b61f0 0x7f08a8157e60 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f089800c3a0 tx=0x7f089800c860 comp rx=0 tx=0).stop 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 -- 172.21.15.146:0/3647664805 shutdown_connections 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0894078bc0 0x7f089407b0d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08a815f1a0 0x7f08a80b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08a80cfca0 0x7f08a80ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 --2- 172.21.15.146:0/3647664805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a80b61f0 0x7f08a8157e60 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 -- 172.21.15.146:0/3647664805 >> 172.21.15.146:0/3647664805 conn(0x7f08a80d11f0 msgr2=0x7f08a80b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 -- 172.21.15.146:0/3647664805 shutdown_connections 2024-09-17T03:42:56.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.528+0000 7f08ae50b640 1 -- 172.21.15.146:0/3647664805 wait complete. 2024-09-17T03:42:56.540 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2024-09-17T03:42:55.949510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":430908,"kb_used_data":16192,"kb_used_omap":12,"kb_used_meta":414515,"kb_avail":754543812,"statfs":{"total":773094113280,"available":772652863488,"internally_reserved":0,"allocated":16580608,"data_stored":7919044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":424463921},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.811303"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844560+0000","last_change":"2024-09-17T03:42:52.174513+0000","last_active":"2024-09-17T03:42:53.844560+0000","last_peered":"2024-09-17T03:42:53.844560+0000","last_clean":"2024-09-17T03:42:53.844560+0000","last_became_active":"2024-09-17T03:42:52.174148+0000","last_became_peered":"2024-09-17T03:42:52.174148+0000","last_unstale":"2024-09-17T03:42:53.844560+0000","last_undegraded":"2024-09-17T03:42:53.844560+0000","last_fullsized":"2024-09-17T03:42:53.844560+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:55.832724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157483+0000","last_change":"2024-09-17T03:42:52.165354+0000","last_active":"2024-09-17T03:42:53.157483+0000","last_peered":"2024-09-17T03:42:53.157483+0000","last_clean":"2024-09-17T03:42:53.157483+0000","last_became_active":"2024-09-17T03:42:52.165041+0000","last_became_peered":"2024-09-17T03:42:52.165041+0000","last_unstale":"2024-09-17T03:42:53.157483+0000","last_undegraded":"2024-09-17T03:42:53.157483+0000","last_fullsized":"2024-09-17T03:42:53.157483+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:38.642645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178938+0000","last_change":"2024-09-17T03:42:52.177491+0000","last_active":"2024-09-17T03:42:52.178938+0000","last_peered":"2024-09-17T03:42:52.178938+0000","last_clean":"2024-09-17T03:42:52.178938+0000","last_became_active":"2024-09-17T03:42:52.177178+0000","last_became_peered":"2024-09-17T03:42:52.177178+0000","last_unstale":"2024-09-17T03:42:52.178938+0000","last_undegraded":"2024-09-17T03:42:52.178938+0000","last_fullsized":"2024-09-17T03:42:52.178938+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.262647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974477+0000","last_change":"2024-09-17T03:42:52.167801+0000","last_active":"2024-09-17T03:42:53.974477+0000","last_peered":"2024-09-17T03:42:53.974477+0000","last_clean":"2024-09-17T03:42:53.974477+0000","last_became_active":"2024-09-17T03:42:52.167336+0000","last_became_peered":"2024-09-17T03:42:52.167336+0000","last_unstale":"2024-09-17T03:42:53.974477+0000","last_undegraded":"2024-09-17T03:42:53.974477+0000","last_fullsized":"2024-09-17T03:42:53.974477+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:15.573921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158145+0000","last_change":"2024-09-17T03:42:52.174586+0000","last_active":"2024-09-17T03:42:53.158145+0000","last_peered":"2024-09-17T03:42:53.158145+0000","last_clean":"2024-09-17T03:42:53.158145+0000","last_became_active":"2024-09-17T03:42:52.174272+0000","last_became_peered":"2024-09-17T03:42:52.174272+0000","last_unstale":"2024-09-17T03:42:53.158145+0000","last_undegraded":"2024-09-17T03:42:53.158145+0000","last_fullsized":"2024-09-17T03:42:53.158145+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:47.018142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973838+0000","last_change":"2024-09-17T03:42:52.165467+0000","last_active":"2024-09-17T03:42:53.973838+0000","last_peered":"2024-09-17T03:42:53.973838+0000","last_clean":"2024-09-17T03:42:53.973838+0000","last_became_active":"2024-09-17T03:42:52.164398+0000","last_became_peered":"2024-09-17T03:42:52.164398+0000","last_unstale":"2024-09-17T03:42:53.973838+0000","last_undegraded":"2024-09-17T03:42:53.973838+0000","last_fullsized":"2024-09-17T03:42:53.973838+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:29.233559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153848+0000","last_change":"2024-09-17T03:42:52.173162+0000","last_active":"2024-09-17T03:42:53.153848+0000","last_peered":"2024-09-17T03:42:53.153848+0000","last_clean":"2024-09-17T03:42:53.153848+0000","last_became_active":"2024-09-17T03:42:52.172848+0000","last_became_peered":"2024-09-17T03:42:52.172848+0000","last_unstale":"2024-09-17T03:42:53.153848+0000","last_undegraded":"2024-09-17T03:42:53.153848+0000","last_fullsized":"2024-09-17T03:42:53.153848+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:43.243714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157258+0000","last_change":"2024-09-17T03:42:52.175169+0000","last_active":"2024-09-17T03:42:53.157258+0000","last_peered":"2024-09-17T03:42:53.157258+0000","last_clean":"2024-09-17T03:42:53.157258+0000","last_became_active":"2024-09-17T03:42:52.174579+0000","last_became_peered":"2024-09-17T03:42:52.174579+0000","last_unstale":"2024-09-17T03:42:53.157258+0000","last_undegraded":"2024-09-17T03:42:53.157258+0000","last_fullsized":"2024-09-17T03:42:53.157258+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:11.016163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157872+0000","last_change":"2024-09-17T03:42:52.170889+0000","last_active":"2024-09-17T03:42:53.157872+0000","last_peered":"2024-09-17T03:42:53.157872+0000","last_clean":"2024-09-17T03:42:53.157872+0000","last_became_active":"2024-09-17T03:42:52.168114+0000","last_became_peered":"2024-09-17T03:42:52.168114+0000","last_unstale":"2024-09-17T03:42:53.157872+0000","last_undegraded":"2024-09-17T03:42:53.157872+0000","last_fullsized":"2024-09-17T03:42:53.157872+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:15.573921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157695+0000","last_change":"2024-09-17T03:42:52.170631+0000","last_active":"2024-09-17T03:42:53.157695+0000","last_peered":"2024-09-17T03:42:53.157695+0000","last_clean":"2024-09-17T03:42:53.157695+0000","last_became_active":"2024-09-17T03:42:52.170296+0000","last_became_peered":"2024-09-17T03:42:52.170296+0000","last_unstale":"2024-09-17T03:42:53.157695+0000","last_undegraded":"2024-09-17T03:42:53.157695+0000","last_fullsized":"2024-09-17T03:42:53.157695+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:19.502739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157453+0000","last_change":"2024-09-17T03:42:52.173518+0000","last_active":"2024-09-17T03:42:53.157453+0000","last_peered":"2024-09-17T03:42:53.157453+0000","last_clean":"2024-09-17T03:42:53.157453+0000","last_became_active":"2024-09-17T03:42:52.172891+0000","last_became_peered":"2024-09-17T03:42:52.172891+0000","last_unstale":"2024-09-17T03:42:53.157453+0000","last_undegraded":"2024-09-17T03:42:53.157453+0000","last_fullsized":"2024-09-17T03:42:53.157453+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:42.224892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158052+0000","last_change":"2024-09-17T03:42:52.169522+0000","last_active":"2024-09-17T03:42:53.158052+0000","last_peered":"2024-09-17T03:42:53.158052+0000","last_clean":"2024-09-17T03:42:53.158052+0000","last_became_active":"2024-09-17T03:42:52.169182+0000","last_became_peered":"2024-09-17T03:42:52.169182+0000","last_unstale":"2024-09-17T03:42:53.158052+0000","last_undegraded":"2024-09-17T03:42:53.158052+0000","last_fullsized":"2024-09-17T03:42:53.158052+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:49.791293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.180570+0000","last_change":"2024-09-17T03:42:52.178273+0000","last_active":"2024-09-17T03:42:52.180570+0000","last_peered":"2024-09-17T03:42:52.180570+0000","last_clean":"2024-09-17T03:42:52.180570+0000","last_became_active":"2024-09-17T03:42:52.177849+0000","last_became_peered":"2024-09-17T03:42:52.177849+0000","last_unstale":"2024-09-17T03:42:52.180570+0000","last_undegraded":"2024-09-17T03:42:52.180570+0000","last_fullsized":"2024-09-17T03:42:52.180570+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:10.488576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.173268+0000","last_change":"2024-09-17T03:42:52.171346+0000","last_active":"2024-09-17T03:42:52.173268+0000","last_peered":"2024-09-17T03:42:52.173268+0000","last_clean":"2024-09-17T03:42:52.173268+0000","last_became_active":"2024-09-17T03:42:52.170932+0000","last_became_peered":"2024-09-17T03:42:52.170932+0000","last_unstale":"2024-09-17T03:42:52.173268+0000","last_undegraded":"2024-09-17T03:42:52.173268+0000","last_fullsized":"2024-09-17T03:42:52.173268+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:15.801600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844306+0000","last_change":"2024-09-17T03:42:52.166646+0000","last_active":"2024-09-17T03:42:53.844306+0000","last_peered":"2024-09-17T03:42:53.844306+0000","last_clean":"2024-09-17T03:42:53.844306+0000","last_became_active":"2024-09-17T03:42:52.166269+0000","last_became_peered":"2024-09-17T03:42:52.166269+0000","last_unstale":"2024-09-17T03:42:53.844306+0000","last_undegraded":"2024-09-17T03:42:53.844306+0000","last_fullsized":"2024-09-17T03:42:53.844306+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:29.220120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153444+0000","last_change":"2024-09-17T03:42:52.168408+0000","last_active":"2024-09-17T03:42:53.153444+0000","last_peered":"2024-09-17T03:42:53.153444+0000","last_clean":"2024-09-17T03:42:53.153444+0000","last_became_active":"2024-09-17T03:42:52.168088+0000","last_became_peered":"2024-09-17T03:42:52.168088+0000","last_unstale":"2024-09-17T03:42:53.153444+0000","last_undegraded":"2024-09-17T03:42:53.153444+0000","last_fullsized":"2024-09-17T03:42:53.153444+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:45.063849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974805+0000","last_change":"2024-09-17T03:42:52.174479+0000","last_active":"2024-09-17T03:42:53.974805+0000","last_peered":"2024-09-17T03:42:53.974805+0000","last_clean":"2024-09-17T03:42:53.974805+0000","last_became_active":"2024-09-17T03:42:52.174149+0000","last_became_peered":"2024-09-17T03:42:52.174149+0000","last_unstale":"2024-09-17T03:42:53.974805+0000","last_undegraded":"2024-09-17T03:42:53.974805+0000","last_fullsized":"2024-09-17T03:42:53.974805+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:51.184896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178541+0000","last_change":"2024-09-17T03:42:52.176954+0000","last_active":"2024-09-17T03:42:52.178541+0000","last_peered":"2024-09-17T03:42:52.178541+0000","last_clean":"2024-09-17T03:42:52.178541+0000","last_became_active":"2024-09-17T03:42:52.176627+0000","last_became_peered":"2024-09-17T03:42:52.176627+0000","last_unstale":"2024-09-17T03:42:52.178541+0000","last_undegraded":"2024-09-17T03:42:52.178541+0000","last_fullsized":"2024-09-17T03:42:52.178541+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:19.802075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974938+0000","last_change":"2024-09-17T03:42:52.171146+0000","last_active":"2024-09-17T03:42:53.974938+0000","last_peered":"2024-09-17T03:42:53.974938+0000","last_clean":"2024-09-17T03:42:53.974938+0000","last_became_active":"2024-09-17T03:42:52.170824+0000","last_became_peered":"2024-09-17T03:42:52.170824+0000","last_unstale":"2024-09-17T03:42:53.974938+0000","last_undegraded":"2024-09-17T03:42:53.974938+0000","last_fullsized":"2024-09-17T03:42:53.974938+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:01.909060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.173295+0000","last_change":"2024-09-17T03:42:52.167032+0000","last_active":"2024-09-17T03:42:52.173295+0000","last_peered":"2024-09-17T03:42:52.173295+0000","last_clean":"2024-09-17T03:42:52.173295+0000","last_became_active":"2024-09-17T03:42:52.166269+0000","last_became_peered":"2024-09-17T03:42:52.166269+0000","last_unstale":"2024-09-17T03:42:52.173295+0000","last_undegraded":"2024-09-17T03:42:52.173295+0000","last_fullsized":"2024-09-17T03:42:52.173295+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:51.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973728+0000","last_change":"2024-09-17T03:42:52.173539+0000","last_active":"2024-09-17T03:42:53.973728+0000","last_peered":"2024-09-17T03:42:53.973728+0000","last_clean":"2024-09-17T03:42:53.973728+0000","last_became_active":"2024-09-17T03:42:52.173241+0000","last_became_peered":"2024-09-17T03:42:52.173241+0000","last_unstale":"2024-09-17T03:42:53.973728+0000","last_undegraded":"2024-09-17T03:42:53.973728+0000","last_fullsized":"2024-09-17T03:42:53.973728+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:41.327313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157763+0000","last_change":"2024-09-17T03:42:52.167171+0000","last_active":"2024-09-17T03:42:53.157763+0000","last_peered":"2024-09-17T03:42:53.157763+0000","last_clean":"2024-09-17T03:42:53.157763+0000","last_became_active":"2024-09-17T03:42:52.166787+0000","last_became_peered":"2024-09-17T03:42:52.166787+0000","last_unstale":"2024-09-17T03:42:53.157763+0000","last_undegraded":"2024-09-17T03:42:53.157763+0000","last_fullsized":"2024-09-17T03:42:53.157763+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:41.672806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973633+0000","last_change":"2024-09-17T03:42:52.163659+0000","last_active":"2024-09-17T03:42:53.973633+0000","last_peered":"2024-09-17T03:42:53.973633+0000","last_clean":"2024-09-17T03:42:53.973633+0000","last_became_active":"2024-09-17T03:42:52.162774+0000","last_became_peered":"2024-09-17T03:42:52.162774+0000","last_unstale":"2024-09-17T03:42:53.973633+0000","last_undegraded":"2024-09-17T03:42:53.973633+0000","last_fullsized":"2024-09-17T03:42:53.973633+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:57.181165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157977+0000","last_change":"2024-09-17T03:42:52.174471+0000","last_active":"2024-09-17T03:42:53.157977+0000","last_peered":"2024-09-17T03:42:53.157977+0000","last_clean":"2024-09-17T03:42:53.157977+0000","last_became_active":"2024-09-17T03:42:52.174135+0000","last_became_peered":"2024-09-17T03:42:52.174135+0000","last_unstale":"2024-09-17T03:42:53.157977+0000","last_undegraded":"2024-09-17T03:42:53.157977+0000","last_fullsized":"2024-09-17T03:42:53.157977+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:31.811404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.176795+0000","last_change":"2024-09-17T03:42:52.175569+0000","last_active":"2024-09-17T03:42:52.176795+0000","last_peered":"2024-09-17T03:42:52.176795+0000","last_clean":"2024-09-17T03:42:52.176795+0000","last_became_active":"2024-09-17T03:42:52.175232+0000","last_became_peered":"2024-09-17T03:42:52.175232+0000","last_unstale":"2024-09-17T03:42:52.176795+0000","last_undegraded":"2024-09-17T03:42:52.176795+0000","last_fullsized":"2024-09-17T03:42:52.176795+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:52.376467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153710+0000","last_change":"2024-09-17T03:42:52.171546+0000","last_active":"2024-09-17T03:42:53.153710+0000","last_peered":"2024-09-17T03:42:53.153710+0000","last_clean":"2024-09-17T03:42:53.153710+0000","last_became_active":"2024-09-17T03:42:52.171183+0000","last_became_peered":"2024-09-17T03:42:52.171183+0000","last_unstale":"2024-09-17T03:42:53.153710+0000","last_undegraded":"2024-09-17T03:42:53.153710+0000","last_fullsized":"2024-09-17T03:42:53.153710+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:39.712036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178909+0000","last_change":"2024-09-17T03:42:52.177604+0000","last_active":"2024-09-17T03:42:52.178909+0000","last_peered":"2024-09-17T03:42:52.178909+0000","last_clean":"2024-09-17T03:42:52.178909+0000","last_became_active":"2024-09-17T03:42:52.177207+0000","last_became_peered":"2024-09-17T03:42:52.177207+0000","last_unstale":"2024-09-17T03:42:52.178909+0000","last_undegraded":"2024-09-17T03:42:52.178909+0000","last_fullsized":"2024-09-17T03:42:52.178909+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:01.223813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974733+0000","last_change":"2024-09-17T03:42:52.172770+0000","last_active":"2024-09-17T03:42:53.974733+0000","last_peered":"2024-09-17T03:42:53.974733+0000","last_clean":"2024-09-17T03:42:53.974733+0000","last_became_active":"2024-09-17T03:42:52.172465+0000","last_became_peered":"2024-09-17T03:42:52.172465+0000","last_unstale":"2024-09-17T03:42:53.974733+0000","last_undegraded":"2024-09-17T03:42:53.974733+0000","last_fullsized":"2024-09-17T03:42:53.974733+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:31.811404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178135+0000","last_change":"2024-09-17T03:42:52.176259+0000","last_active":"2024-09-17T03:42:52.178135+0000","last_peered":"2024-09-17T03:42:52.178135+0000","last_clean":"2024-09-17T03:42:52.178135+0000","last_became_active":"2024-09-17T03:42:52.175927+0000","last_became_peered":"2024-09-17T03:42:52.175927+0000","last_unstale":"2024-09-17T03:42:52.178135+0000","last_undegraded":"2024-09-17T03:42:52.178135+0000","last_fullsized":"2024-09-17T03:42:52.178135+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:06.083940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158584+0000","last_change":"2024-09-17T03:42:52.172451+0000","last_active":"2024-09-17T03:42:53.158584+0000","last_peered":"2024-09-17T03:42:53.158584+0000","last_clean":"2024-09-17T03:42:53.158584+0000","last_became_active":"2024-09-17T03:42:52.172131+0000","last_became_peered":"2024-09-17T03:42:52.172131+0000","last_unstale":"2024-09-17T03:42:53.158584+0000","last_undegraded":"2024-09-17T03:42:53.158584+0000","last_fullsized":"2024-09-17T03:42:53.158584+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:37.144283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158208+0000","last_change":"2024-09-17T03:42:52.175390+0000","last_active":"2024-09-17T03:42:53.158208+0000","last_peered":"2024-09-17T03:42:53.158208+0000","last_clean":"2024-09-17T03:42:53.158208+0000","last_became_active":"2024-09-17T03:42:52.175058+0000","last_became_peered":"2024-09-17T03:42:52.175058+0000","last_unstale":"2024-09-17T03:42:53.158208+0000","last_undegraded":"2024-09-17T03:42:53.158208+0000","last_fullsized":"2024-09-17T03:42:53.158208+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:20.271100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178451+0000","last_change":"2024-09-17T03:42:52.176852+0000","last_active":"2024-09-17T03:42:52.178451+0000","last_peered":"2024-09-17T03:42:52.178451+0000","last_clean":"2024-09-17T03:42:52.178451+0000","last_became_active":"2024-09-17T03:42:52.176533+0000","last_became_peered":"2024-09-17T03:42:52.176533+0000","last_unstale":"2024-09-17T03:42:52.178451+0000","last_undegraded":"2024-09-17T03:42:52.178451+0000","last_fullsized":"2024-09-17T03:42:52.178451+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:37.031035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153847+0000","last_change":"2024-09-17T03:42:52.170249+0000","last_active":"2024-09-17T03:42:53.153847+0000","last_peered":"2024-09-17T03:42:53.153847+0000","last_clean":"2024-09-17T03:42:53.153847+0000","last_became_active":"2024-09-17T03:42:52.169950+0000","last_became_peered":"2024-09-17T03:42:52.169950+0000","last_unstale":"2024-09-17T03:42:53.153847+0000","last_undegraded":"2024-09-17T03:42:53.153847+0000","last_fullsized":"2024-09-17T03:42:53.153847+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:24.182060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"153'4","reported_seq":19,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844468+0000","last_change":"2024-09-17T03:42:51.158675+0000","last_active":"2024-09-17T03:42:53.844468+0000","last_peered":"2024-09-17T03:42:53.844468+0000","last_clean":"2024-09-17T03:42:53.844468+0000","last_became_active":"2024-09-17T03:42:51.158297+0000","last_became_peered":"2024-09-17T03:42:51.158297+0000","last_unstale":"2024-09-17T03:42:53.844468+0000","last_undegraded":"2024-09-17T03:42:53.844468+0000","last_fullsized":"2024-09-17T03:42:53.844468+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:23.176650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158289+0000","last_change":"2024-09-17T03:42:52.171095+0000","last_active":"2024-09-17T03:42:53.158289+0000","last_peered":"2024-09-17T03:42:53.158289+0000","last_clean":"2024-09-17T03:42:53.158289+0000","last_became_active":"2024-09-17T03:42:52.170766+0000","last_became_peered":"2024-09-17T03:42:52.170766+0000","last_unstale":"2024-09-17T03:42:53.158289+0000","last_undegraded":"2024-09-17T03:42:53.158289+0000","last_fullsized":"2024-09-17T03:42:53.158289+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:13.428703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"153'1","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157433+0000","last_change":"2024-09-17T03:42:51.152434+0000","last_active":"2024-09-17T03:42:53.157433+0000","last_peered":"2024-09-17T03:42:53.157433+0000","last_clean":"2024-09-17T03:42:53.157433+0000","last_became_active":"2024-09-17T03:42:51.151982+0000","last_became_peered":"2024-09-17T03:42:51.151982+0000","last_unstale":"2024-09-17T03:42:53.157433+0000","last_undegraded":"2024-09-17T03:42:53.157433+0000","last_fullsized":"2024-09-17T03:42:53.157433+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:36.994491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974078+0000","last_change":"2024-09-17T03:42:52.171114+0000","last_active":"2024-09-17T03:42:53.974078+0000","last_peered":"2024-09-17T03:42:53.974078+0000","last_clean":"2024-09-17T03:42:53.974078+0000","last_became_active":"2024-09-17T03:42:52.170771+0000","last_became_peered":"2024-09-17T03:42:52.170771+0000","last_unstale":"2024-09-17T03:42:53.974078+0000","last_undegraded":"2024-09-17T03:42:53.974078+0000","last_fullsized":"2024-09-17T03:42:53.974078+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:44.993911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"153'2","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974997+0000","last_change":"2024-09-17T03:42:51.159069+0000","last_active":"2024-09-17T03:42:53.974997+0000","last_peered":"2024-09-17T03:42:53.974997+0000","last_clean":"2024-09-17T03:42:53.974997+0000","last_became_active":"2024-09-17T03:42:51.158291+0000","last_became_peered":"2024-09-17T03:42:51.158291+0000","last_unstale":"2024-09-17T03:42:53.974997+0000","last_undegraded":"2024-09-17T03:42:53.974997+0000","last_fullsized":"2024-09-17T03:42:53.974997+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:23.721127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.181553+0000","last_change":"2024-09-17T03:42:52.180751+0000","last_active":"2024-09-17T03:42:52.181553+0000","last_peered":"2024-09-17T03:42:52.181553+0000","last_clean":"2024-09-17T03:42:52.181553+0000","last_became_active":"2024-09-17T03:42:52.180346+0000","last_became_peered":"2024-09-17T03:42:52.180346+0000","last_unstale":"2024-09-17T03:42:52.181553+0000","last_undegraded":"2024-09-17T03:42:52.181553+0000","last_fullsized":"2024-09-17T03:42:52.181553+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:26.791826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"153'2","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.975127+0000","last_change":"2024-09-17T03:42:51.157431+0000","last_active":"2024-09-17T03:42:53.975127+0000","last_peered":"2024-09-17T03:42:53.975127+0000","last_clean":"2024-09-17T03:42:53.975127+0000","last_became_active":"2024-09-17T03:42:51.157119+0000","last_became_peered":"2024-09-17T03:42:51.157119+0000","last_unstale":"2024-09-17T03:42:53.975127+0000","last_undegraded":"2024-09-17T03:42:53.975127+0000","last_fullsized":"2024-09-17T03:42:53.975127+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:08.621226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.154041+0000","last_change":"2024-09-17T03:42:52.163213+0000","last_active":"2024-09-17T03:42:53.154041+0000","last_peered":"2024-09-17T03:42:53.154041+0000","last_clean":"2024-09-17T03:42:53.154041+0000","last_became_active":"2024-09-17T03:42:52.162909+0000","last_became_peered":"2024-09-17T03:42:52.162909+0000","last_unstale":"2024-09-17T03:42:53.154041+0000","last_undegraded":"2024-09-17T03:42:53.154041+0000","last_fullsized":"2024-09-17T03:42:53.154041+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:51.442806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"153'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.182005+0000","last_change":"2024-09-17T03:42:51.162303+0000","last_active":"2024-09-17T03:42:52.182005+0000","last_peered":"2024-09-17T03:42:52.182005+0000","last_clean":"2024-09-17T03:42:52.182005+0000","last_became_active":"2024-09-17T03:42:51.161960+0000","last_became_peered":"2024-09-17T03:42:51.161960+0000","last_unstale":"2024-09-17T03:42:52.182005+0000","last_undegraded":"2024-09-17T03:42:52.182005+0000","last_fullsized":"2024-09-17T03:42:52.182005+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:40.904155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974028+0000","last_change":"2024-09-17T03:42:52.173091+0000","last_active":"2024-09-17T03:42:53.974028+0000","last_peered":"2024-09-17T03:42:53.974028+0000","last_clean":"2024-09-17T03:42:53.974028+0000","last_became_active":"2024-09-17T03:42:52.172779+0000","last_became_peered":"2024-09-17T03:42:52.172779+0000","last_unstale":"2024-09-17T03:42:53.974028+0000","last_undegraded":"2024-09-17T03:42:53.974028+0000","last_fullsized":"2024-09-17T03:42:53.974028+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:19.502739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"153'1","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973316+0000","last_change":"2024-09-17T03:42:51.158532+0000","last_active":"2024-09-17T03:42:53.973316+0000","last_peered":"2024-09-17T03:42:53.973316+0000","last_clean":"2024-09-17T03:42:53.973316+0000","last_became_active":"2024-09-17T03:42:51.158213+0000","last_became_peered":"2024-09-17T03:42:51.158213+0000","last_unstale":"2024-09-17T03:42:53.973316+0000","last_undegraded":"2024-09-17T03:42:53.973316+0000","last_fullsized":"2024-09-17T03:42:53.973316+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:01.672012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973582+0000","last_change":"2024-09-17T03:42:52.172403+0000","last_active":"2024-09-17T03:42:53.973582+0000","last_peered":"2024-09-17T03:42:53.973582+0000","last_clean":"2024-09-17T03:42:53.973582+0000","last_became_active":"2024-09-17T03:42:52.172102+0000","last_became_peered":"2024-09-17T03:42:52.172102+0000","last_unstale":"2024-09-17T03:42:53.973582+0000","last_undegraded":"2024-09-17T03:42:53.973582+0000","last_fullsized":"2024-09-17T03:42:53.973582+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:38.642645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158272+0000","last_change":"2024-09-17T03:42:51.158184+0000","last_active":"2024-09-17T03:42:53.158272+0000","last_peered":"2024-09-17T03:42:53.158272+0000","last_clean":"2024-09-17T03:42:53.158272+0000","last_became_active":"2024-09-17T03:42:51.157837+0000","last_became_peered":"2024-09-17T03:42:51.157837+0000","last_unstale":"2024-09-17T03:42:53.158272+0000","last_undegraded":"2024-09-17T03:42:53.158272+0000","last_fullsized":"2024-09-17T03:42:53.158272+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:08.573467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.975049+0000","last_change":"2024-09-17T03:42:52.165007+0000","last_active":"2024-09-17T03:42:53.975049+0000","last_peered":"2024-09-17T03:42:53.975049+0000","last_clean":"2024-09-17T03:42:53.975049+0000","last_became_active":"2024-09-17T03:42:52.164687+0000","last_became_peered":"2024-09-17T03:42:52.164687+0000","last_unstale":"2024-09-17T03:42:53.975049+0000","last_undegraded":"2024-09-17T03:42:53.975049+0000","last_fullsized":"2024-09-17T03:42:53.975049+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:18.025614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153564+0000","last_change":"2024-09-17T03:42:51.155129+0000","last_active":"2024-09-17T03:42:53.153564+0000","last_peered":"2024-09-17T03:42:53.153564+0000","last_clean":"2024-09-17T03:42:53.153564+0000","last_became_active":"2024-09-17T03:42:51.154458+0000","last_became_peered":"2024-09-17T03:42:51.154458+0000","last_unstale":"2024-09-17T03:42:53.153564+0000","last_undegraded":"2024-09-17T03:42:53.153564+0000","last_fullsized":"2024-09-17T03:42:53.153564+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:58.599165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.169356+0000","last_change":"2024-09-17T03:42:52.166186+0000","last_active":"2024-09-17T03:42:52.169356+0000","last_peered":"2024-09-17T03:42:52.169356+0000","last_clean":"2024-09-17T03:42:52.169356+0000","last_became_active":"2024-09-17T03:42:52.165857+0000","last_became_peered":"2024-09-17T03:42:52.165857+0000","last_unstale":"2024-09-17T03:42:52.169356+0000","last_undegraded":"2024-09-17T03:42:52.169356+0000","last_fullsized":"2024-09-17T03:42:52.169356+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:25.117261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974816+0000","last_change":"2024-09-17T03:42:51.159392+0000","last_active":"2024-09-17T03:42:53.974816+0000","last_peered":"2024-09-17T03:42:53.974816+0000","last_clean":"2024-09-17T03:42:53.974816+0000","last_became_active":"2024-09-17T03:42:51.159086+0000","last_became_peered":"2024-09-17T03:42:51.159086+0000","last_unstale":"2024-09-17T03:42:53.974816+0000","last_undegraded":"2024-09-17T03:42:53.974816+0000","last_fullsized":"2024-09-17T03:42:53.974816+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:28.940975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178929+0000","last_change":"2024-09-17T03:42:52.177825+0000","last_active":"2024-09-17T03:42:52.178929+0000","last_peered":"2024-09-17T03:42:52.178929+0000","last_clean":"2024-09-17T03:42:52.178929+0000","last_became_active":"2024-09-17T03:42:52.177142+0000","last_became_peered":"2024-09-17T03:42:52.177142+0000","last_unstale":"2024-09-17T03:42:52.178929+0000","last_undegraded":"2024-09-17T03:42:52.178929+0000","last_fullsized":"2024-09-17T03:42:52.178929+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:53.353327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"153'3","reported_seq":18,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974474+0000","last_change":"2024-09-17T03:42:51.156236+0000","last_active":"2024-09-17T03:42:53.974474+0000","last_peered":"2024-09-17T03:42:53.974474+0000","last_clean":"2024-09-17T03:42:53.974474+0000","last_became_active":"2024-09-17T03:42:51.154912+0000","last_became_peered":"2024-09-17T03:42:51.154912+0000","last_unstale":"2024-09-17T03:42:53.974474+0000","last_undegraded":"2024-09-17T03:42:53.974474+0000","last_fullsized":"2024-09-17T03:42:53.974474+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:01.306963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158243+0000","last_change":"2024-09-17T03:42:52.179738+0000","last_active":"2024-09-17T03:42:53.158243+0000","last_peered":"2024-09-17T03:42:53.158243+0000","last_clean":"2024-09-17T03:42:53.158243+0000","last_became_active":"2024-09-17T03:42:52.179416+0000","last_became_peered":"2024-09-17T03:42:52.179416+0000","last_unstale":"2024-09-17T03:42:53.158243+0000","last_undegraded":"2024-09-17T03:42:53.158243+0000","last_fullsized":"2024-09-17T03:42:53.158243+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:02.287801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"153'6","reported_seq":21,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158483+0000","last_change":"2024-09-17T03:42:51.157622+0000","last_active":"2024-09-17T03:42:53.158483+0000","last_peered":"2024-09-17T03:42:53.158483+0000","last_clean":"2024-09-17T03:42:53.158483+0000","last_became_active":"2024-09-17T03:42:51.157112+0000","last_became_peered":"2024-09-17T03:42:51.157112+0000","last_unstale":"2024-09-17T03:42:53.158483+0000","last_undegraded":"2024-09-17T03:42:53.158483+0000","last_fullsized":"2024-09-17T03:42:53.158483+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:09.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178636+0000","last_change":"2024-09-17T03:42:52.177529+0000","last_active":"2024-09-17T03:42:52.178636+0000","last_peered":"2024-09-17T03:42:52.178636+0000","last_clean":"2024-09-17T03:42:52.178636+0000","last_became_active":"2024-09-17T03:42:52.177197+0000","last_became_peered":"2024-09-17T03:42:52.177197+0000","last_unstale":"2024-09-17T03:42:52.178636+0000","last_undegraded":"2024-09-17T03:42:52.178636+0000","last_fullsized":"2024-09-17T03:42:52.178636+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:07.811581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"153'2","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973842+0000","last_change":"2024-09-17T03:42:51.161604+0000","last_active":"2024-09-17T03:42:53.973842+0000","last_peered":"2024-09-17T03:42:53.973842+0000","last_clean":"2024-09-17T03:42:53.973842+0000","last_became_active":"2024-09-17T03:42:51.161004+0000","last_became_peered":"2024-09-17T03:42:51.161004+0000","last_unstale":"2024-09-17T03:42:53.973842+0000","last_undegraded":"2024-09-17T03:42:53.973842+0000","last_fullsized":"2024-09-17T03:42:53.973842+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:51.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153976+0000","last_change":"2024-09-17T03:42:52.178155+0000","last_active":"2024-09-17T03:42:53.153976+0000","last_peered":"2024-09-17T03:42:53.153976+0000","last_clean":"2024-09-17T03:42:53.153976+0000","last_became_active":"2024-09-17T03:42:52.175687+0000","last_became_peered":"2024-09-17T03:42:52.175687+0000","last_unstale":"2024-09-17T03:42:53.153976+0000","last_undegraded":"2024-09-17T03:42:53.153976+0000","last_fullsized":"2024-09-17T03:42:53.153976+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:45.799805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.152499+0000","last_change":"2024-09-17T03:42:51.159004+0000","last_active":"2024-09-17T03:42:52.152499+0000","last_peered":"2024-09-17T03:42:52.152499+0000","last_clean":"2024-09-17T03:42:52.152499+0000","last_became_active":"2024-09-17T03:42:51.158672+0000","last_became_peered":"2024-09-17T03:42:51.158672+0000","last_unstale":"2024-09-17T03:42:52.152499+0000","last_undegraded":"2024-09-17T03:42:52.152499+0000","last_fullsized":"2024-09-17T03:42:52.152499+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:09.514940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973566+0000","last_change":"2024-09-17T03:42:52.167219+0000","last_active":"2024-09-17T03:42:53.973566+0000","last_peered":"2024-09-17T03:42:53.973566+0000","last_clean":"2024-09-17T03:42:53.973566+0000","last_became_active":"2024-09-17T03:42:52.166906+0000","last_became_peered":"2024-09-17T03:42:52.166906+0000","last_unstale":"2024-09-17T03:42:53.973566+0000","last_undegraded":"2024-09-17T03:42:53.973566+0000","last_fullsized":"2024-09-17T03:42:53.973566+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:42.224892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973436+0000","last_change":"2024-09-17T03:42:51.156644+0000","last_active":"2024-09-17T03:42:53.973436+0000","last_peered":"2024-09-17T03:42:53.973436+0000","last_clean":"2024-09-17T03:42:53.973436+0000","last_became_active":"2024-09-17T03:42:51.156338+0000","last_became_peered":"2024-09-17T03:42:51.156338+0000","last_unstale":"2024-09-17T03:42:53.973436+0000","last_undegraded":"2024-09-17T03:42:53.973436+0000","last_fullsized":"2024-09-17T03:42:53.973436+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:07.014630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.173300+0000","last_change":"2024-09-17T03:42:52.168259+0000","last_active":"2024-09-17T03:42:52.173300+0000","last_peered":"2024-09-17T03:42:52.173300+0000","last_clean":"2024-09-17T03:42:52.173300+0000","last_became_active":"2024-09-17T03:42:52.166120+0000","last_became_peered":"2024-09-17T03:42:52.166120+0000","last_unstale":"2024-09-17T03:42:52.173300+0000","last_undegraded":"2024-09-17T03:42:52.173300+0000","last_fullsized":"2024-09-17T03:42:52.173300+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:53.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"153'8","reported_seq":23,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157074+0000","last_change":"2024-09-17T03:42:51.157386+0000","last_active":"2024-09-17T03:42:53.157074+0000","last_peered":"2024-09-17T03:42:53.157074+0000","last_clean":"2024-09-17T03:42:53.157074+0000","last_became_active":"2024-09-17T03:42:51.157062+0000","last_became_peered":"2024-09-17T03:42:51.157062+0000","last_unstale":"2024-09-17T03:42:53.157074+0000","last_undegraded":"2024-09-17T03:42:53.157074+0000","last_fullsized":"2024-09-17T03:42:53.157074+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:23.721127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974460+0000","last_change":"2024-09-17T03:42:52.168276+0000","last_active":"2024-09-17T03:42:53.974460+0000","last_peered":"2024-09-17T03:42:53.974460+0000","last_clean":"2024-09-17T03:42:53.974460+0000","last_became_active":"2024-09-17T03:42:52.166776+0000","last_became_peered":"2024-09-17T03:42:52.166776+0000","last_unstale":"2024-09-17T03:42:53.974460+0000","last_undegraded":"2024-09-17T03:42:53.974460+0000","last_fullsized":"2024-09-17T03:42:53.974460+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:41.672806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"153'1","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.181597+0000","last_change":"2024-09-17T03:42:51.161444+0000","last_active":"2024-09-17T03:42:52.181597+0000","last_peered":"2024-09-17T03:42:52.181597+0000","last_clean":"2024-09-17T03:42:52.181597+0000","last_became_active":"2024-09-17T03:42:51.161141+0000","last_became_peered":"2024-09-17T03:42:51.161141+0000","last_unstale":"2024-09-17T03:42:52.181597+0000","last_undegraded":"2024-09-17T03:42:52.181597+0000","last_fullsized":"2024-09-17T03:42:52.181597+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:12.998027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.176370+0000","last_change":"2024-09-17T03:42:52.171001+0000","last_active":"2024-09-17T03:42:52.176370+0000","last_peered":"2024-09-17T03:42:52.176370+0000","last_clean":"2024-09-17T03:42:52.176370+0000","last_became_active":"2024-09-17T03:42:52.170720+0000","last_became_peered":"2024-09-17T03:42:52.170720+0000","last_unstale":"2024-09-17T03:42:52.176370+0000","last_undegraded":"2024-09-17T03:42:52.176370+0000","last_fullsized":"2024-09-17T03:42:52.176370+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:41.647874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"153'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.183111+0000","last_change":"2024-09-17T03:42:51.162662+0000","last_active":"2024-09-17T03:42:52.183111+0000","last_peered":"2024-09-17T03:42:52.183111+0000","last_clean":"2024-09-17T03:42:52.183111+0000","last_became_active":"2024-09-17T03:42:51.160834+0000","last_became_peered":"2024-09-17T03:42:51.160834+0000","last_unstale":"2024-09-17T03:42:52.183111+0000","last_undegraded":"2024-09-17T03:42:52.183111+0000","last_fullsized":"2024-09-17T03:42:52.183111+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:17.745132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974987+0000","last_change":"2024-09-17T03:42:52.163553+0000","last_active":"2024-09-17T03:42:53.974987+0000","last_peered":"2024-09-17T03:42:53.974987+0000","last_clean":"2024-09-17T03:42:53.974987+0000","last_became_active":"2024-09-17T03:42:52.163243+0000","last_became_peered":"2024-09-17T03:42:52.163243+0000","last_unstale":"2024-09-17T03:42:53.974987+0000","last_undegraded":"2024-09-17T03:42:53.974987+0000","last_fullsized":"2024-09-17T03:42:53.974987+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:49.791293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"153'1","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844344+0000","last_change":"2024-09-17T03:42:51.158791+0000","last_active":"2024-09-17T03:42:53.844344+0000","last_peered":"2024-09-17T03:42:53.844344+0000","last_clean":"2024-09-17T03:42:53.844344+0000","last_became_active":"2024-09-17T03:42:51.156922+0000","last_became_peered":"2024-09-17T03:42:51.156922+0000","last_unstale":"2024-09-17T03:42:53.844344+0000","last_undegraded":"2024-09-17T03:42:53.844344+0000","last_fullsized":"2024-09-17T03:42:53.844344+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:11.351542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153582+0000","last_change":"2024-09-17T03:42:52.173990+0000","last_active":"2024-09-17T03:42:53.153582+0000","last_peered":"2024-09-17T03:42:53.153582+0000","last_clean":"2024-09-17T03:42:53.153582+0000","last_became_active":"2024-09-17T03:42:52.173697+0000","last_became_peered":"2024-09-17T03:42:52.173697+0000","last_unstale":"2024-09-17T03:42:53.153582+0000","last_undegraded":"2024-09-17T03:42:53.153582+0000","last_fullsized":"2024-09-17T03:42:53.153582+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:02.043568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844430+0000","last_change":"2024-09-17T03:42:51.161230+0000","last_active":"2024-09-17T03:42:53.844430+0000","last_peered":"2024-09-17T03:42:53.844430+0000","last_clean":"2024-09-17T03:42:53.844430+0000","last_became_active":"2024-09-17T03:42:51.160918+0000","last_became_peered":"2024-09-17T03:42:51.160918+0000","last_unstale":"2024-09-17T03:42:53.844430+0000","last_undegraded":"2024-09-17T03:42:53.844430+0000","last_fullsized":"2024-09-17T03:42:53.844430+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:27.922214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.173303+0000","last_change":"2024-09-17T03:42:52.167614+0000","last_active":"2024-09-17T03:42:52.173303+0000","last_peered":"2024-09-17T03:42:52.173303+0000","last_clean":"2024-09-17T03:42:52.173303+0000","last_became_active":"2024-09-17T03:42:52.167268+0000","last_became_peered":"2024-09-17T03:42:52.167268+0000","last_unstale":"2024-09-17T03:42:52.173303+0000","last_undegraded":"2024-09-17T03:42:52.173303+0000","last_fullsized":"2024-09-17T03:42:52.173303+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:33.228847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"153'2","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973989+0000","last_change":"2024-09-17T03:42:51.155839+0000","last_active":"2024-09-17T03:42:53.973989+0000","last_peered":"2024-09-17T03:42:53.973989+0000","last_clean":"2024-09-17T03:42:53.973989+0000","last_became_active":"2024-09-17T03:42:51.155532+0000","last_became_peered":"2024-09-17T03:42:51.155532+0000","last_unstale":"2024-09-17T03:42:53.973989+0000","last_undegraded":"2024-09-17T03:42:53.973989+0000","last_fullsized":"2024-09-17T03:42:53.973989+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:23.489556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.154090+0000","last_change":"2024-09-17T03:42:52.167698+0000","last_active":"2024-09-17T03:42:53.154090+0000","last_peered":"2024-09-17T03:42:53.154090+0000","last_clean":"2024-09-17T03:42:53.154090+0000","last_became_active":"2024-09-17T03:42:52.167361+0000","last_became_peered":"2024-09-17T03:42:52.167361+0000","last_unstale":"2024-09-17T03:42:53.154090+0000","last_undegraded":"2024-09-17T03:42:53.154090+0000","last_fullsized":"2024-09-17T03:42:53.154090+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:39.959900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844081+0000","last_change":"2024-09-17T03:42:51.155665+0000","last_active":"2024-09-17T03:42:53.844081+0000","last_peered":"2024-09-17T03:42:53.844081+0000","last_clean":"2024-09-17T03:42:53.844081+0000","last_became_active":"2024-09-17T03:42:51.155276+0000","last_became_peered":"2024-09-17T03:42:51.155276+0000","last_unstale":"2024-09-17T03:42:53.844081+0000","last_undegraded":"2024-09-17T03:42:53.844081+0000","last_fullsized":"2024-09-17T03:42:53.844081+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:51.651854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844167+0000","last_change":"2024-09-17T03:42:52.170275+0000","last_active":"2024-09-17T03:42:53.844167+0000","last_peered":"2024-09-17T03:42:53.844167+0000","last_clean":"2024-09-17T03:42:53.844167+0000","last_became_active":"2024-09-17T03:42:52.168668+0000","last_became_peered":"2024-09-17T03:42:52.168668+0000","last_unstale":"2024-09-17T03:42:53.844167+0000","last_undegraded":"2024-09-17T03:42:53.844167+0000","last_fullsized":"2024-09-17T03:42:53.844167+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:55.754600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973770+0000","last_change":"2024-09-17T03:42:51.157660+0000","last_active":"2024-09-17T03:42:53.973770+0000","last_peered":"2024-09-17T03:42:53.973770+0000","last_clean":"2024-09-17T03:42:53.973770+0000","last_became_active":"2024-09-17T03:42:51.157357+0000","last_became_peered":"2024-09-17T03:42:51.157357+0000","last_unstale":"2024-09-17T03:42:53.973770+0000","last_undegraded":"2024-09-17T03:42:53.973770+0000","last_fullsized":"2024-09-17T03:42:53.973770+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:47.334954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973882+0000","last_change":"2024-09-17T03:42:52.161781+0000","last_active":"2024-09-17T03:42:53.973882+0000","last_peered":"2024-09-17T03:42:53.973882+0000","last_clean":"2024-09-17T03:42:53.973882+0000","last_became_active":"2024-09-17T03:42:52.161479+0000","last_became_peered":"2024-09-17T03:42:52.161479+0000","last_unstale":"2024-09-17T03:42:53.973882+0000","last_undegraded":"2024-09-17T03:42:53.973882+0000","last_fullsized":"2024-09-17T03:42:53.973882+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:20.962301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844292+0000","last_change":"2024-09-17T03:42:51.157277+0000","last_active":"2024-09-17T03:42:53.844292+0000","last_peered":"2024-09-17T03:42:53.844292+0000","last_clean":"2024-09-17T03:42:53.844292+0000","last_became_active":"2024-09-17T03:42:51.156823+0000","last_became_peered":"2024-09-17T03:42:51.156823+0000","last_unstale":"2024-09-17T03:42:53.844292+0000","last_undegraded":"2024-09-17T03:42:53.844292+0000","last_fullsized":"2024-09-17T03:42:53.844292+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:21.757528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.170328+0000","last_change":"2024-09-17T03:42:52.169112+0000","last_active":"2024-09-17T03:42:52.170328+0000","last_peered":"2024-09-17T03:42:52.170328+0000","last_clean":"2024-09-17T03:42:52.170328+0000","last_became_active":"2024-09-17T03:42:52.168817+0000","last_became_peered":"2024-09-17T03:42:52.168817+0000","last_unstale":"2024-09-17T03:42:52.170328+0000","last_undegraded":"2024-09-17T03:42:52.170328+0000","last_fullsized":"2024-09-17T03:42:52.170328+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:18.459211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"153'2","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.186641+0000","last_change":"2024-09-17T03:42:51.161807+0000","last_active":"2024-09-17T03:42:52.186641+0000","last_peered":"2024-09-17T03:42:52.186641+0000","last_clean":"2024-09-17T03:42:52.186641+0000","last_became_active":"2024-09-17T03:42:51.161516+0000","last_became_peered":"2024-09-17T03:42:51.161516+0000","last_unstale":"2024-09-17T03:42:52.186641+0000","last_undegraded":"2024-09-17T03:42:52.186641+0000","last_fullsized":"2024-09-17T03:42:52.186641+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:22.875211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153630+0000","last_change":"2024-09-17T03:42:52.179896+0000","last_active":"2024-09-17T03:42:53.153630+0000","last_peered":"2024-09-17T03:42:53.153630+0000","last_clean":"2024-09-17T03:42:53.153630+0000","last_became_active":"2024-09-17T03:42:52.174712+0000","last_became_peered":"2024-09-17T03:42:52.174712+0000","last_unstale":"2024-09-17T03:42:53.153630+0000","last_undegraded":"2024-09-17T03:42:53.153630+0000","last_fullsized":"2024-09-17T03:42:53.153630+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:20.460167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.161654+0000","last_change":"2024-09-17T03:42:51.162460+0000","last_active":"2024-09-17T03:42:52.161654+0000","last_peered":"2024-09-17T03:42:52.161654+0000","last_clean":"2024-09-17T03:42:52.161654+0000","last_became_active":"2024-09-17T03:42:51.162061+0000","last_became_peered":"2024-09-17T03:42:51.162061+0000","last_unstale":"2024-09-17T03:42:52.161654+0000","last_undegraded":"2024-09-17T03:42:52.161654+0000","last_fullsized":"2024-09-17T03:42:52.161654+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:33.192917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.974302+0000","last_change":"2024-09-17T03:42:52.169530+0000","last_active":"2024-09-17T03:42:53.974302+0000","last_peered":"2024-09-17T03:42:53.974302+0000","last_clean":"2024-09-17T03:42:53.974302+0000","last_became_active":"2024-09-17T03:42:52.169190+0000","last_became_peered":"2024-09-17T03:42:52.169190+0000","last_unstale":"2024-09-17T03:42:53.974302+0000","last_undegraded":"2024-09-17T03:42:53.974302+0000","last_fullsized":"2024-09-17T03:42:53.974302+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:58.404899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157407+0000","last_change":"2024-09-17T03:42:51.162161+0000","last_active":"2024-09-17T03:42:53.157407+0000","last_peered":"2024-09-17T03:42:53.157407+0000","last_clean":"2024-09-17T03:42:53.157407+0000","last_became_active":"2024-09-17T03:42:51.161855+0000","last_became_peered":"2024-09-17T03:42:51.161855+0000","last_unstale":"2024-09-17T03:42:53.157407+0000","last_undegraded":"2024-09-17T03:42:53.157407+0000","last_fullsized":"2024-09-17T03:42:53.157407+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:10.746724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.161840+0000","last_change":"2024-09-17T03:42:52.159619+0000","last_active":"2024-09-17T03:42:52.161840+0000","last_peered":"2024-09-17T03:42:52.161840+0000","last_clean":"2024-09-17T03:42:52.161840+0000","last_became_active":"2024-09-17T03:42:52.158713+0000","last_became_peered":"2024-09-17T03:42:52.158713+0000","last_unstale":"2024-09-17T03:42:52.161840+0000","last_undegraded":"2024-09-17T03:42:52.161840+0000","last_fullsized":"2024-09-17T03:42:52.161840+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:18.429107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.152314+0000","last_change":"2024-09-17T03:42:51.161352+0000","last_active":"2024-09-17T03:42:52.152314+0000","last_peered":"2024-09-17T03:42:52.152314+0000","last_clean":"2024-09-17T03:42:52.152314+0000","last_became_active":"2024-09-17T03:42:51.160687+0000","last_became_peered":"2024-09-17T03:42:51.160687+0000","last_unstale":"2024-09-17T03:42:52.152314+0000","last_undegraded":"2024-09-17T03:42:52.152314+0000","last_fullsized":"2024-09-17T03:42:52.152314+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:34.613914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.178107+0000","last_change":"2024-09-17T03:42:52.176266+0000","last_active":"2024-09-17T03:42:52.178107+0000","last_peered":"2024-09-17T03:42:52.178107+0000","last_clean":"2024-09-17T03:42:52.178107+0000","last_became_active":"2024-09-17T03:42:52.171507+0000","last_became_peered":"2024-09-17T03:42:52.171507+0000","last_unstale":"2024-09-17T03:42:52.178107+0000","last_undegraded":"2024-09-17T03:42:52.178107+0000","last_fullsized":"2024-09-17T03:42:52.178107+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:55.562188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157828+0000","last_change":"2024-09-17T03:42:51.161021+0000","last_active":"2024-09-17T03:42:53.157828+0000","last_peered":"2024-09-17T03:42:53.157828+0000","last_clean":"2024-09-17T03:42:53.157828+0000","last_became_active":"2024-09-17T03:42:51.160643+0000","last_became_peered":"2024-09-17T03:42:51.160643+0000","last_unstale":"2024-09-17T03:42:53.157828+0000","last_undegraded":"2024-09-17T03:42:53.157828+0000","last_fullsized":"2024-09-17T03:42:53.157828+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:27.279410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157707+0000","last_change":"2024-09-17T03:42:52.178753+0000","last_active":"2024-09-17T03:42:53.157707+0000","last_peered":"2024-09-17T03:42:53.157707+0000","last_clean":"2024-09-17T03:42:53.157707+0000","last_became_active":"2024-09-17T03:42:52.178292+0000","last_became_peered":"2024-09-17T03:42:52.178292+0000","last_unstale":"2024-09-17T03:42:53.157707+0000","last_undegraded":"2024-09-17T03:42:53.157707+0000","last_fullsized":"2024-09-17T03:42:53.157707+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:57.084403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.973454+0000","last_change":"2024-09-17T03:42:51.161243+0000","last_active":"2024-09-17T03:42:53.973454+0000","last_peered":"2024-09-17T03:42:53.973454+0000","last_clean":"2024-09-17T03:42:53.973454+0000","last_became_active":"2024-09-17T03:42:51.160849+0000","last_became_peered":"2024-09-17T03:42:51.160849+0000","last_unstale":"2024-09-17T03:42:53.973454+0000","last_undegraded":"2024-09-17T03:42:53.973454+0000","last_fullsized":"2024-09-17T03:42:53.973454+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:37.635220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.153538+0000","last_change":"2024-09-17T03:42:52.164782+0000","last_active":"2024-09-17T03:42:53.153538+0000","last_peered":"2024-09-17T03:42:53.153538+0000","last_clean":"2024-09-17T03:42:53.153538+0000","last_became_active":"2024-09-17T03:42:52.164470+0000","last_became_peered":"2024-09-17T03:42:52.164470+0000","last_unstale":"2024-09-17T03:42:53.153538+0000","last_undegraded":"2024-09-17T03:42:53.153538+0000","last_fullsized":"2024-09-17T03:42:53.153538+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:24.696705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158479+0000","last_change":"2024-09-17T03:42:51.161611+0000","last_active":"2024-09-17T03:42:53.158479+0000","last_peered":"2024-09-17T03:42:53.158479+0000","last_clean":"2024-09-17T03:42:53.158479+0000","last_became_active":"2024-09-17T03:42:51.161288+0000","last_became_peered":"2024-09-17T03:42:51.161288+0000","last_unstale":"2024-09-17T03:42:53.158479+0000","last_undegraded":"2024-09-17T03:42:53.158479+0000","last_fullsized":"2024-09-17T03:42:53.158479+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:50.900090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.173273+0000","last_change":"2024-09-17T03:42:52.170800+0000","last_active":"2024-09-17T03:42:52.173273+0000","last_peered":"2024-09-17T03:42:52.173273+0000","last_clean":"2024-09-17T03:42:52.173273+0000","last_became_active":"2024-09-17T03:42:52.169064+0000","last_became_peered":"2024-09-17T03:42:52.169064+0000","last_unstale":"2024-09-17T03:42:52.173273+0000","last_undegraded":"2024-09-17T03:42:52.173273+0000","last_fullsized":"2024-09-17T03:42:52.173273+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:08.047446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.157093+0000","last_change":"2024-09-17T03:42:51.153719+0000","last_active":"2024-09-17T03:42:53.157093+0000","last_peered":"2024-09-17T03:42:53.157093+0000","last_clean":"2024-09-17T03:42:53.157093+0000","last_became_active":"2024-09-17T03:42:51.153421+0000","last_became_peered":"2024-09-17T03:42:51.153421+0000","last_unstale":"2024-09-17T03:42:53.157093+0000","last_undegraded":"2024-09-17T03:42:53.157093+0000","last_fullsized":"2024-09-17T03:42:53.157093+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:53.513715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:42:52.171214+0000","last_change":"2024-09-17T03:42:52.169981+0000","last_active":"2024-09-17T03:42:52.171214+0000","last_peered":"2024-09-17T03:42:52.171214+0000","last_clean":"2024-09-17T03:42:52.171214+0000","last_became_active":"2024-09-17T03:42:52.169688+0000","last_became_peered":"2024-09-17T03:42:52.169688+0000","last_unstale":"2024-09-17T03:42:52.171214+0000","last_undegraded":"2024-09-17T03:42:52.171214+0000","last_fullsized":"2024-09-17T03:42:52.171214+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:51.137118+0000","last_clean_scrub_stamp":"2024-09-17T03:42:51.137118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:42.134117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.158313+0000","last_change":"2024-09-17T03:42:51.158365+0000","last_active":"2024-09-17T03:42:53.158313+0000","last_peered":"2024-09-17T03:42:53.158313+0000","last_clean":"2024-09-17T03:42:53.158313+0000","last_became_active":"2024-09-17T03:42:51.158056+0000","last_became_peered":"2024-09-17T03:42:51.158056+0000","last_unstale":"2024-09-17T03:42:53.158313+0000","last_undegraded":"2024-09-17T03:42:53.158313+0000","last_fullsized":"2024-09-17T03:42:53.158313+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:42:50.131708+0000","last_clean_scrub_stamp":"2024-09-17T03:42:50.131708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:10.705109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":356,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T03:42:53.844258+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:42:53.844258+0000","last_peered":"2024-09-17T03:42:53.844258+0000","last_clean":"2024-09-17T03:42:53.844258+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:42:53.844258+0000","last_undegraded":"2024-09-17T03:42:53.844258+0000","last_fullsized":"2024-09-17T03:42:53.844258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509565,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55888,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315952,"statfs":{"total":96636764160,"available":96579534848,"internally_reserved":0,"allocated":2543616,"data_stored":1438544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":54655435},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509565,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55288,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316552,"statfs":{"total":96636764160,"available":96580149248,"internally_reserved":0,"allocated":1929216,"data_stored":845844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509565,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55300,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316540,"statfs":{"total":96636764160,"available":96580136960,"internally_reserved":0,"allocated":1941504,"data_stored":847504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509565,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51108,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320732,"statfs":{"total":96636764160,"available":96584429568,"internally_reserved":0,"allocated":1916928,"data_stored":839612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509566,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":1929216,"data_stored":845856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509566,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51700,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320140,"statfs":{"total":96636764160,"available":96583823360,"internally_reserved":0,"allocated":2519040,"data_stored":1436190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574972,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51088,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320752,"statfs":{"total":96636764160,"available":96584450048,"internally_reserved":0,"allocated":1900544,"data_stored":832747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55256,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316584,"statfs":{"total":96636764160,"available":96580182016,"internally_reserved":0,"allocated":1900544,"data_stored":832747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:42:56.544 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:42:56.544 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:42:56.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.702+0000 7fbbb26be640 1 -- 172.21.15.146:0/1663851078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb94004d40 msgr2=0x7fbb94005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.702+0000 7fbbb26be640 1 --2- 172.21.15.146:0/1663851078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb94004d40 0x7fbb94005210 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fbba4005fd0 tx=0x7fbb94005830 comp rx=0 tx=0).stop 2024-09-17T03:42:56.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.702+0000 7fbbb0c5b640 1 -- 172.21.15.146:0/1663851078 reap_dead start 2024-09-17T03:42:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.702+0000 7fbbb26be640 1 -- 172.21.15.146:0/1663851078 shutdown_connections 2024-09-17T03:42:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.702+0000 7fbbb26be640 1 -- 172.21.15.146:0/1663851078 >> 172.21.15.146:0/1663851078 conn(0x7fbbac09ba20 msgr2=0x7fbbac0b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.702+0000 7fbbb26be640 1 -- 172.21.15.146:0/1663851078 shutdown_connections 2024-09-17T03:42:56.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.702+0000 7fbbb26be640 1 -- 172.21.15.146:0/1663851078 wait complete. 2024-09-17T03:42:56.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.704+0000 7fbbb26be640 1 Processor -- start 2024-09-17T03:42:56.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.704+0000 7fbbb26be640 1 -- start start 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.705+0000 7fbbb26be640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb94004d40 0x7fbbac15ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.705+0000 7fbbb26be640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbac06f670 0x7fbbac15deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.705+0000 7fbbb26be640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbac06fa80 0x7fbbac15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.705+0000 7fbbb26be640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac0b1c60 con 0x7fbbac06fa80 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.705+0000 7fbbb26be640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac0b13f0 con 0x7fbb94004d40 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.705+0000 7fbbb26be640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac0b1de0 con 0x7fbbac06f670 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.705+0000 7fbbb0c5b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbac06fa80 0x7fbbac15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.705+0000 7fbbb0c5b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbac06fa80 0x7fbbac15e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50940/0 (socket says 172.21.15.146:50940) 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.705+0000 7fbbb0c5b640 1 -- 172.21.15.146:0/688676840 learned_addr learned my addr 172.21.15.146:0/688676840 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbbab7fe640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbac06f670 0x7fbbac15deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbbabfff640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb94004d40 0x7fbbac15ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbbb0c5b640 1 -- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbac06f670 msgr2=0x7fbbac15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbbb0c5b640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbac06f670 0x7fbbac15deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbbb0c5b640 1 -- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb94004d40 msgr2=0x7fbbac15ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbbb0c5b640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb94004d40 0x7fbbac15ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbbb0c5b640 1 -- 172.21.15.146:0/688676840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac15a7d0 con 0x7fbbac06fa80 2024-09-17T03:42:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbbb0c5b640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbac06fa80 0x7fbbac15e3f0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fbba4005fd0 tx=0x7fbba4033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbba8ff9640 1 -- 172.21.15.146:0/688676840 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4038040 con 0x7fbbac06fa80 2024-09-17T03:42:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbba8ff9640 1 -- 172.21.15.146:0/688676840 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbba4004b20 con 0x7fbbac06fa80 2024-09-17T03:42:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbbb26be640 1 -- 172.21.15.146:0/688676840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbac06e140 con 0x7fbbac06fa80 2024-09-17T03:42:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbba8ff9640 1 -- 172.21.15.146:0/688676840 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4033760 con 0x7fbbac06fa80 2024-09-17T03:42:56.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.706+0000 7fbbb26be640 1 -- 172.21.15.146:0/688676840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbac06e700 con 0x7fbbac06fa80 2024-09-17T03:42:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.707+0000 7fbbb26be640 1 -- 172.21.15.146:0/688676840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbac0b69a0 con 0x7fbbac06fa80 2024-09-17T03:42:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.708+0000 7fbba8ff9640 1 -- 172.21.15.146:0/688676840 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbba4044020 con 0x7fbbac06fa80 2024-09-17T03:42:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.709+0000 7fbba8ff9640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb98078bc0 0x7fbb9807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.709+0000 7fbba8ff9640 1 -- 172.21.15.146:0/688676840 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fbba40bac40 con 0x7fbbac06fa80 2024-09-17T03:42:56.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.709+0000 7fbbabfff640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb98078bc0 0x7fbb9807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:56.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.709+0000 7fbbabfff640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb98078bc0 0x7fbb9807b0d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0045b0 tx=0x7fbb9c00b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:56.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.713+0000 7fbba8ff9640 1 -- 172.21.15.146:0/688676840 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbba4083080 con 0x7fbbac06fa80 2024-09-17T03:42:56.954 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.954+0000 7fbbb26be640 1 -- 172.21.15.146:0/688676840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fbbac0b2c60 con 0x7fbbac06fa80 2024-09-17T03:42:56.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.957+0000 7fbba8ff9640 1 -- 172.21.15.146:0/688676840 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7fbba4082980 con 0x7fbbac06fa80 2024-09-17T03:42:56.957 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:42:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:42:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:42:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:42:56.958 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:42:56.958 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:42:56.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.959+0000 7fbbb26be640 1 -- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb98078bc0 msgr2=0x7fbb9807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.959+0000 7fbbb26be640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb98078bc0 0x7fbb9807b0d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0045b0 tx=0x7fbb9c00b260 comp rx=0 tx=0).stop 2024-09-17T03:42:56.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.959+0000 7fbbb26be640 1 -- 172.21.15.146:0/688676840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbac06fa80 msgr2=0x7fbbac15e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:56.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.959+0000 7fbbb26be640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbac06fa80 0x7fbbac15e3f0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fbba4005fd0 tx=0x7fbba4033670 comp rx=0 tx=0).stop 2024-09-17T03:42:56.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.960+0000 7fbbb26be640 1 -- 172.21.15.146:0/688676840 shutdown_connections 2024-09-17T03:42:56.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.960+0000 7fbbb26be640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb98078bc0 0x7fbb9807b0d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.960+0000 7fbbb26be640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbac06fa80 0x7fbbac15e3f0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.960+0000 7fbbb26be640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbbac06f670 0x7fbbac15deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.960+0000 7fbbb26be640 1 --2- 172.21.15.146:0/688676840 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb94004d40 0x7fbbac15ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:56.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.960+0000 7fbbb26be640 1 -- 172.21.15.146:0/688676840 >> 172.21.15.146:0/688676840 conn(0x7fbbac09ba20 msgr2=0x7fbbac071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:56.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.960+0000 7fbbb26be640 1 -- 172.21.15.146:0/688676840 shutdown_connections 2024-09-17T03:42:56.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:56.960+0000 7fbbb26be640 1 -- 172.21.15.146:0/688676840 wait complete. 2024-09-17T03:42:56.971 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:57.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.085+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/2009847998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140d2aa0 msgr2=0x7f9b140d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.085+0000 7f9b1ad9d640 1 --2- 172.21.15.146:0/2009847998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140d2aa0 0x7f9b140d1280 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c005fd0 tx=0x7f9b0c02a780 comp rx=0 tx=0).stop 2024-09-17T03:42:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.085+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/2009847998 shutdown_connections 2024-09-17T03:42:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.085+0000 7f9b1ad9d640 1 --2- 172.21.15.146:0/2009847998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140d2aa0 0x7f9b140d1280 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.085+0000 7f9b1ad9d640 1 --2- 172.21.15.146:0/2009847998 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b140d2690 0x7f9b140d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.085+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/2009847998 >> 172.21.15.146:0/2009847998 conn(0x7f9b1406d120 msgr2=0x7f9b1406d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.085+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/2009847998 shutdown_connections 2024-09-17T03:42:57.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.085+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/2009847998 wait complete. 2024-09-17T03:42:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.087+0000 7f9b1ad9d640 1 Processor -- start 2024-09-17T03:42:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.087+0000 7f9b1ad9d640 1 -- start start 2024-09-17T03:42:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.088+0000 7f9b1ad9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b140d2690 0x7f9b141459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.088+0000 7f9b1ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140d2aa0 0x7f9b1415db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.088+0000 7f9b1ad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b1415c3d0 0x7f9b1415e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.088+0000 7f9b1ad9d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9b141629e0 con 0x7f9b140d2aa0 2024-09-17T03:42:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.088+0000 7f9b1ad9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14162860 con 0x7f9b1415c3d0 2024-09-17T03:42:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.088+0000 7f9b1ad9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9b14162b60 con 0x7f9b140d2690 2024-09-17T03:42:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.088+0000 7f9b1959a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140d2aa0 0x7f9b1415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.088+0000 7f9b1959a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140d2aa0 0x7f9b1415db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50956/0 (socket says 172.21.15.146:50956) 2024-09-17T03:42:57.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.088+0000 7f9b1959a640 1 -- 172.21.15.146:0/3548500695 learned_addr learned my addr 172.21.15.146:0/3548500695 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.088+0000 7f9b19d9b640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b140d2690 0x7f9b141459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.088+0000 7f9b1a59c640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b1415c3d0 0x7f9b1415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b1959a640 1 -- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b140d2690 msgr2=0x7f9b141459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b1959a640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b140d2690 0x7f9b141459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b1959a640 1 -- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b1415c3d0 msgr2=0x7f9b1415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b1959a640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b1415c3d0 0x7f9b1415e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b1959a640 1 -- 172.21.15.146:0/3548500695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b14156690 con 0x7f9b140d2aa0 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b19d9b640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b140d2690 0x7f9b141459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b1959a640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140d2aa0 0x7f9b1415db00 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c9a0 tx=0x7f9b0800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b127fc640 1 -- 172.21.15.146:0/3548500695 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08007bb0 con 0x7f9b140d2aa0 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b127fc640 1 -- 172.21.15.146:0/3548500695 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b08007e40 con 0x7f9b140d2aa0 2024-09-17T03:42:57.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/3548500695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b14156970 con 0x7f9b140d2aa0 2024-09-17T03:42:57.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b127fc640 1 -- 172.21.15.146:0/3548500695 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08005280 con 0x7f9b140d2aa0 2024-09-17T03:42:57.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.089+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/3548500695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b14154110 con 0x7f9b140d2aa0 2024-09-17T03:42:57.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.090+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/3548500695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b14163010 con 0x7f9b140d2aa0 2024-09-17T03:42:57.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.091+0000 7f9b127fc640 1 -- 172.21.15.146:0/3548500695 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b08005420 con 0x7f9b140d2aa0 2024-09-17T03:42:57.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.091+0000 7f9b127fc640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b00078b90 0x7f9b0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.091+0000 7f9b127fc640 1 -- 172.21.15.146:0/3548500695 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f9b0809b2d0 con 0x7f9b140d2aa0 2024-09-17T03:42:57.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.092+0000 7f9b19d9b640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b00078b90 0x7f9b0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.092+0000 7f9b19d9b640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b00078b90 0x7f9b0007b0a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9b040016a0 tx=0x7f9b04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:57.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.096+0000 7f9b127fc640 1 -- 172.21.15.146:0/3548500695 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b08014030 con 0x7f9b140d2aa0 2024-09-17T03:42:57.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.307+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/3548500695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b1415b410 con 0x7f9b140d2aa0 2024-09-17T03:42:57.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.308+0000 7f9b127fc640 1 -- 172.21.15.146:0/3548500695 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7f9b08063750 con 0x7f9b140d2aa0 2024-09-17T03:42:57.308 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:57.308 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:42:57.308 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b00078b90 msgr2=0x7f9b0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b00078b90 0x7f9b0007b0a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9b040016a0 tx=0x7f9b04009040 comp rx=0 tx=0).stop 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/3548500695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140d2aa0 msgr2=0x7f9b1415db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140d2aa0 0x7f9b1415db00 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c9a0 tx=0x7f9b0800ce60 comp rx=0 tx=0).stop 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/3548500695 shutdown_connections 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9b00078b90 0x7f9b0007b0a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b1415c3d0 0x7f9b1415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b140d2aa0 0x7f9b1415db00 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 --2- 172.21.15.146:0/3548500695 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9b140d2690 0x7f9b141459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/3548500695 >> 172.21.15.146:0/3548500695 conn(0x7f9b1406d120 msgr2=0x7f9b140b8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/3548500695 shutdown_connections 2024-09-17T03:42:57.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.310+0000 7f9b1ad9d640 1 -- 172.21.15.146:0/3548500695 wait complete. 2024-09-17T03:42:57.724 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 113, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:42:51.507886+0000', 'modified': '2024-09-17T03:42:54.541307+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9783}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9783': {'gid': 9783, 'name': 'c', 'rank': 0, 'incarnation': 109, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/2786424389', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 2786424389}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2786424389}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9783, 'qdb_cluster': [9783]} 2024-09-17T03:42:57.724 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:42:57.724 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:42:57.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.839+0000 7f017a863640 1 -- 172.21.15.146:0/320346095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01740b3d30 msgr2=0x7f01741677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.839+0000 7f017a863640 1 --2- 172.21.15.146:0/320346095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01740b3d30 0x7f01741677c0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f016c005fd0 tx=0x7f016c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.839+0000 7f017a863640 1 -- 172.21.15.146:0/320346095 shutdown_connections 2024-09-17T03:42:57.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.839+0000 7f017a863640 1 --2- 172.21.15.146:0/320346095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01740b3d30 0x7f01741677c0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.839+0000 7f017a863640 1 -- 172.21.15.146:0/320346095 >> 172.21.15.146:0/320346095 conn(0x7f01740b7b20 msgr2=0x7f017409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:57.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.839+0000 7f017a863640 1 -- 172.21.15.146:0/320346095 shutdown_connections 2024-09-17T03:42:57.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.839+0000 7f017a863640 1 -- 172.21.15.146:0/320346095 wait complete. 2024-09-17T03:42:57.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.841+0000 7f017a863640 1 Processor -- start 2024-09-17T03:42:57.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.841+0000 7f017a863640 1 -- start start 2024-09-17T03:42:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.842+0000 7f017a863640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01740b5750 0x7f017414c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.842+0000 7f017a863640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01740b5ce0 0x7f01740b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.842+0000 7f017a863640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01741549b0 0x7f01740b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.842+0000 7f017a863640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0174167f10 con 0x7f01740b5ce0 2024-09-17T03:42:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.842+0000 7f017a863640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f017415ddb0 con 0x7f01740b5750 2024-09-17T03:42:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.842+0000 7f017a863640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0174168090 con 0x7f01741549b0 2024-09-17T03:42:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f016b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01740b5ce0 0x7f01740b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f016b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01740b5ce0 0x7f01740b3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46680/0 (socket says 172.21.15.146:46680) 2024-09-17T03:42:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f016b7fe640 1 -- 172.21.15.146:0/1267412620 learned_addr learned my addr 172.21.15.146:0/1267412620 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f0173fff640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01740b5750 0x7f017414c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f0178e00640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01741549b0 0x7f01740b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f016b7fe640 1 -- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01741549b0 msgr2=0x7f01740b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f016b7fe640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01741549b0 0x7f01740b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f016b7fe640 1 -- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01740b5750 msgr2=0x7f017414c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f016b7fe640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01740b5750 0x7f017414c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f016b7fe640 1 -- 172.21.15.146:0/1267412620 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01741f49e0 con 0x7f01740b5ce0 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f016b7fe640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01740b5ce0 0x7f01740b3410 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c390 tx=0x7f015c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f01717fa640 1 -- 172.21.15.146:0/1267412620 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c011790 con 0x7f01740b5ce0 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f01717fa640 1 -- 172.21.15.146:0/1267412620 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f015c017070 con 0x7f01740b5ce0 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f01717fa640 1 -- 172.21.15.146:0/1267412620 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c011d00 con 0x7f01740b5ce0 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f017a863640 1 -- 172.21.15.146:0/1267412620 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01741f3c20 con 0x7f01740b5ce0 2024-09-17T03:42:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.843+0000 7f017a863640 1 -- 172.21.15.146:0/1267412620 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01741f41e0 con 0x7f01740b5ce0 2024-09-17T03:42:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.845+0000 7f01717fa640 1 -- 172.21.15.146:0/1267412620 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f015c01c460 con 0x7f01740b5ce0 2024-09-17T03:42:57.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.846+0000 7f01717fa640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0154078b90 0x7f015407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.846+0000 7f01717fa640 1 -- 172.21.15.146:0/1267412620 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f015c09a860 con 0x7f01740b5ce0 2024-09-17T03:42:57.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.846+0000 7f0173fff640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0154078b90 0x7f015407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.847+0000 7f01817d2740 1 Processor -- start 2024-09-17T03:42:57.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.847+0000 7f0173fff640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0154078b90 0x7f015407b0a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0164000c00 tx=0x7f0164009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:57.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.847+0000 7f01817d2740 1 -- start start 2024-09-17T03:42:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f01817d2740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64181270 0x559e64552fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f01817d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e641583b0 0x559e645534e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f01817d2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f01817d2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559e6449b820 con 0x559e64160590 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f01817d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559e6448ac50 con 0x559e641583b0 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f01817d2740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x559e6448ea60 con 0x559e64181270 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f0178e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f0178e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46696/0 (socket says 172.21.15.146:46696) 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f0178e00640 1 -- 172.21.15.146:0/3250336997 learned_addr learned my addr 172.21.15.146:0/3250336997 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f0173fff640 1 --2- 172.21.15.146:0/3250336997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64181270 0x559e64552fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f016b7fe640 1 --2- 172.21.15.146:0/3250336997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e641583b0 0x559e645534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f0178e00640 1 -- 172.21.15.146:0/3250336997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64181270 msgr2=0x559e64552fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f0178e00640 1 --2- 172.21.15.146:0/3250336997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64181270 0x559e64552fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f0178e00640 1 -- 172.21.15.146:0/3250336997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e641583b0 msgr2=0x559e645534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f0178e00640 1 --2- 172.21.15.146:0/3250336997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e641583b0 0x559e645534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f0178e00640 1 -- 172.21.15.146:0/3250336997 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e641ec850 con 0x559e64160590 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.848+0000 7f0178e00640 1 --2- 172.21.15.146:0/3250336997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645703e0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f016c005fd0 tx=0x7f016c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51b55c2b6cd0edd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.849+0000 7f0169ffb640 1 -- 172.21.15.146:0/3250336997 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c004040 con 0x559e64160590 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.849+0000 7f0169ffb640 1 -- 172.21.15.146:0/3250336997 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f016c0042d0 con 0x559e64160590 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.849+0000 7f0169ffb640 1 -- 172.21.15.146:0/3250336997 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0046e0 con 0x559e64160590 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.849+0000 7f01817d2740 1 -- 172.21.15.146:0/3250336997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 msgr2=0x559e645703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.849+0000 7f01817d2740 1 --2- 172.21.15.146:0/3250336997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645703e0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f016c005fd0 tx=0x7f016c004a40 comp rx=0 tx=0).stop 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.849+0000 7f01817d2740 1 -- 172.21.15.146:0/3250336997 shutdown_connections 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.849+0000 7f01817d2740 1 --2- 172.21.15.146:0/3250336997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645703e0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.849+0000 7f01817d2740 1 --2- 172.21.15.146:0/3250336997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e641583b0 0x559e645534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.849+0000 7f01817d2740 1 --2- 172.21.15.146:0/3250336997 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64181270 0x559e64552fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.849+0000 7f01817d2740 1 -- 172.21.15.146:0/3250336997 >> 172.21.15.146:0/3250336997 conn(0x559e641753c0 msgr2=0x559e64529260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.850+0000 7f01817d2740 1 -- 172.21.15.146:0/3250336997 shutdown_connections 2024-09-17T03:42:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.850+0000 7f01817d2740 1 -- 172.21.15.146:0/3250336997 wait complete. 2024-09-17T03:42:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.850+0000 7f01817d2740 1 -- start start 2024-09-17T03:42:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.851+0000 7f01817d2740 1 Processor -- start 2024-09-17T03:42:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f01817d2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e641583b0 0x559e645655a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f01817d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e64160590 0x559e645411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f01817d2740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64181270 0x559e64551f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f01817d2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559e641fb620 con 0x559e641583b0 2024-09-17T03:42:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f01817d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559e644305f0 con 0x559e64160590 2024-09-17T03:42:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f01817d2740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x559e64553a20 con 0x559e64181270 2024-09-17T03:42:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f01817d2740 10 client.0 _ll_register_callbacks cb 0x559e644340a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f0173fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e641583b0 0x559e645655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f0173fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e641583b0 0x559e645655a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46708/0 (socket says 172.21.15.146:46708) 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f0173fff640 1 -- 172.21.15.146:0/3910321824 learned_addr learned my addr 172.21.15.146:0/3910321824 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f0178e00640 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64181270 0x559e64551f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f016b7fe640 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e64160590 0x559e645411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f0173fff640 1 -- 172.21.15.146:0/3910321824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64181270 msgr2=0x559e64551f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f0173fff640 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64181270 0x559e64551f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f0173fff640 1 -- 172.21.15.146:0/3910321824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e64160590 msgr2=0x559e645411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f0173fff640 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e64160590 0x559e645411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f0173fff640 1 -- 172.21.15.146:0/3910321824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e642636b0 con 0x559e641583b0 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.852+0000 7f0178e00640 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64181270 0x559e64551f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f0173fff640 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e641583b0 0x559e645655a0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f0164014700 tx=0x7f0164001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea37bef33ad74da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f0152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f0152ffd640 1 -- 172.21.15.146:0/3910321824 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164025020 con 0x559e641583b0 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f0152ffd640 1 -- 172.21.15.146:0/3910321824 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f0164021610 con 0x559e641583b0 2024-09-17T03:42:57.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f01817d2740 1 -- 172.21.15.146:0/3910321824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f016c0042d0 con 0x559e641583b0 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f0152ffd640 1 -- 172.21.15.146:0/3910321824 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f016402f050 con 0x559e641583b0 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f01817d2740 10 client.9921 fetch_fsmap learned FSMap version 113 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f01817d2740 1 -- 172.21.15.146:0/3910321824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x559e64565ae0 con 0x559e641583b0 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f0152ffd640 1 -- 172.21.15.146:0/3910321824 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f016c0042d0 con 0x559e641583b0 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f0152ffd640 1 -- 172.21.15.146:0/3910321824 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7f0164032020 con 0x559e641583b0 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f01817d2740 10 client.9921 fetch_fsmap finished waiting for FSMap version 113 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f01817d2740 10 client.9921 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f01817d2740 20 client.9921 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f01817d2740 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x559e6413fe40 0x559e64566580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f01817d2740 4 client.9921 mds_command: new command op to 9783 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f01817d2740 1 -- 172.21.15.146:0/3910321824 --> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e6449d770 con 0x559e6413fe40 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.853+0000 7f016b7fe640 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x559e6413fe40 0x559e64566580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.854+0000 7f0152ffd640 10 client.9921 ms_handle_connect on v2:172.21.15.146:6833/2786424389 2024-09-17T03:42:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.854+0000 7f016b7fe640 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x559e6413fe40 0x559e64566580 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df11b23c895631f0 server_cookie=c83d7dce592a256e in_seq=0 out_seq=0 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.854+0000 7f0152ffd640 1 -- 172.21.15.146:0/3910321824 <== mds.0 v2:172.21.15.146:6833/2786424389 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e6449d770 con 0x559e6413fe40 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f0152ffd640 10 client.9921 handle_command_reply: tid=0 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 1 client.9921 shutdown 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 1 -- 172.21.15.146:0/3910321824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e641583b0 msgr2=0x559e645655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e641583b0 0x559e645655a0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f0164014700 tx=0x7f0164001080 comp rx=0 tx=0).stop 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 1 -- 172.21.15.146:0/3910321824 shutdown_connections 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x559e6413fe40 0x559e64566580 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64181270 0x559e64551f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e64160590 0x559e645411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f0152ffd640 0 client.9921 ms_handle_reset on v2:172.21.15.146:6833/2786424389 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 1 --2- 172.21.15.146:0/3910321824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e641583b0 0x559e645655a0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 1 -- 172.21.15.146:0/3910321824 >> 172.21.15.146:0/3910321824 conn(0x559e641753c0 msgr2=0x559e64523980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 1 -- 172.21.15.146:0/3910321824 shutdown_connections 2024-09-17T03:42:57.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 1 -- 172.21.15.146:0/3910321824 wait complete. 2024-09-17T03:42:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.855+0000 7f01817d2740 20 client.9921 trim_cache size 0 max 16384 2024-09-17T03:42:57.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.873+0000 7f01817d2740 1 Processor -- start 2024-09-17T03:42:57.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.873+0000 7f01817d2740 1 -- start start 2024-09-17T03:42:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.874+0000 7f01817d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e641583b0 0x559e6456a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.874+0000 7f01817d2740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64160590 0x559e64590ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.874+0000 7f01817d2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64181270 0x559e64591010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.874+0000 7f01817d2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f017415ec00 con 0x559e64181270 2024-09-17T03:42:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.874+0000 7f01817d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f017415df60 con 0x559e641583b0 2024-09-17T03:42:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.874+0000 7f01817d2740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f017415e5b0 con 0x559e64160590 2024-09-17T03:42:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.874+0000 7f0178e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64181270 0x559e64591010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f0178e00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64181270 0x559e64591010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46720/0 (socket says 172.21.15.146:46720) 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f0178e00640 1 -- 172.21.15.146:0/3098763182 learned_addr learned my addr 172.21.15.146:0/3098763182 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f016b7fe640 1 --2- 172.21.15.146:0/3098763182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64160590 0x559e64590ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f0173fff640 1 --2- 172.21.15.146:0/3098763182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e641583b0 0x559e6456a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f0178e00640 1 -- 172.21.15.146:0/3098763182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64160590 msgr2=0x559e64590ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f0178e00640 1 --2- 172.21.15.146:0/3098763182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64160590 0x559e64590ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f0178e00640 1 -- 172.21.15.146:0/3098763182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e641583b0 msgr2=0x559e6456a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f0178e00640 1 --2- 172.21.15.146:0/3098763182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e641583b0 0x559e6456a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f0178e00640 1 -- 172.21.15.146:0/3098763182 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e64570ab0 con 0x559e64181270 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f0178e00640 1 --2- 172.21.15.146:0/3098763182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64181270 0x559e64591010 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f016c009cd0 tx=0x7f016c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ed21ba5cd1e85 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f01697fa640 1 -- 172.21.15.146:0/3098763182 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c053070 con 0x559e64181270 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f01697fa640 1 -- 172.21.15.146:0/3098763182 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f016c003d70 con 0x559e64181270 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.875+0000 7f01697fa640 1 -- 172.21.15.146:0/3098763182 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0042d0 con 0x559e64181270 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.876+0000 7f01817d2740 1 -- 172.21.15.146:0/3098763182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64181270 msgr2=0x559e64591010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.876+0000 7f01817d2740 1 --2- 172.21.15.146:0/3098763182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64181270 0x559e64591010 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f016c009cd0 tx=0x7f016c009500 comp rx=0 tx=0).stop 2024-09-17T03:42:57.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.876+0000 7f01817d2740 1 -- 172.21.15.146:0/3098763182 shutdown_connections 2024-09-17T03:42:57.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.876+0000 7f01817d2740 1 --2- 172.21.15.146:0/3098763182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64181270 0x559e64591010 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.876+0000 7f01817d2740 1 --2- 172.21.15.146:0/3098763182 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e64160590 0x559e64590ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.876+0000 7f01817d2740 1 --2- 172.21.15.146:0/3098763182 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e641583b0 0x559e6456a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.876+0000 7f01817d2740 1 -- 172.21.15.146:0/3098763182 >> 172.21.15.146:0/3098763182 conn(0x559e641753c0 msgr2=0x559e64563d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:57.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.876+0000 7f01817d2740 1 -- 172.21.15.146:0/3098763182 shutdown_connections 2024-09-17T03:42:57.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.876+0000 7f01817d2740 1 -- 172.21.15.146:0/3098763182 wait complete. 2024-09-17T03:42:57.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.877+0000 7f01817d2740 1 -- start start 2024-09-17T03:42:57.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.877+0000 7f01817d2740 1 Processor -- start 2024-09-17T03:42:57.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f01817d2740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e641583b0 0x559e6454e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f01817d2740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645ed520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f01817d2740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e64181270 0x559e6456df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f01817d2740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559e645684b0 con 0x559e64160590 2024-09-17T03:42:57.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f01817d2740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559e645416f0 con 0x559e64181270 2024-09-17T03:42:57.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f01817d2740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x559e64580540 con 0x559e641583b0 2024-09-17T03:42:57.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f01817d2740 10 client.0 _ll_register_callbacks cb 0x7f0164001d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:42:57.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f016b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f016b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645ed520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46724/0 (socket says 172.21.15.146:46724) 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f016b7fe640 1 -- 172.21.15.146:0/2592306013 learned_addr learned my addr 172.21.15.146:0/2592306013 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f0173fff640 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e641583b0 0x559e6454e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.878+0000 7f0178e00640 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e64181270 0x559e6456df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f016b7fe640 1 -- 172.21.15.146:0/2592306013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e641583b0 msgr2=0x559e6454e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f016b7fe640 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e641583b0 0x559e6454e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f016b7fe640 1 -- 172.21.15.146:0/2592306013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e64181270 msgr2=0x559e6456df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f016b7fe640 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e64181270 0x559e6456df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f016b7fe640 1 -- 172.21.15.146:0/2592306013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e64553ab0 con 0x559e64160590 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f016b7fe640 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645ed520 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f015c05f950 tx=0x7f015c05ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0348a87b21ecb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f0152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f0152ffd640 1 -- 172.21.15.146:0/2592306013 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c06b240 con 0x559e64160590 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f0152ffd640 1 -- 172.21.15.146:0/2592306013 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f015c079e00 con 0x559e64160590 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f01817d2740 1 -- 172.21.15.146:0/2592306013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f016c003d70 con 0x559e64160590 2024-09-17T03:42:57.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f0152ffd640 1 -- 172.21.15.146:0/2592306013 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f015c081050 con 0x559e64160590 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f01817d2740 10 client.9927 fetch_fsmap learned FSMap version 113 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f01817d2740 1 -- 172.21.15.146:0/2592306013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x559e64566a90 con 0x559e64160590 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f0152ffd640 1 -- 172.21.15.146:0/2592306013 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f016c003d70 con 0x559e64160590 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f0152ffd640 1 -- 172.21.15.146:0/2592306013 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7f015c061940 con 0x559e64160590 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f01817d2740 10 client.9927 fetch_fsmap finished waiting for FSMap version 113 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f01817d2740 10 client.9927 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f01817d2740 20 client.9927 populate_metadata read hostname 'smithi146' 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f01817d2740 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x559e6458ff30 0x559e645edde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f01817d2740 4 client.9927 mds_command: new command op to 9783 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f01817d2740 1 -- 172.21.15.146:0/2592306013 --> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] -- command(tid 0: {"prefix": "status"}) -- 0x559e64499220 con 0x559e6458ff30 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.879+0000 7f0173fff640 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x559e6458ff30 0x559e645edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f0152ffd640 10 client.9927 ms_handle_connect on v2:172.21.15.146:6833/2786424389 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f0173fff640 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x559e6458ff30 0x559e645edde0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f488bda0a8a52f0 server_cookie=f5cbe082e0d5bd21 in_seq=0 out_seq=0 2024-09-17T03:42:57.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f0152ffd640 1 -- 172.21.15.146:0/2592306013 <== mds.0 v2:172.21.15.146:6833/2786424389 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x559e64499220 con 0x559e6458ff30 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f0152ffd640 10 client.9927 handle_command_reply: tid=0 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f01817d2740 1 client.9927 shutdown 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f01817d2740 1 -- 172.21.15.146:0/2592306013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 msgr2=0x559e645ed520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f01817d2740 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645ed520 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f015c05f950 tx=0x7f015c05ee60 comp rx=0 tx=0).stop 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f01817d2740 1 -- 172.21.15.146:0/2592306013 shutdown_connections 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f01817d2740 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x559e6458ff30 0x559e645edde0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f01817d2740 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559e64181270 0x559e6456df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f01817d2740 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559e64160590 0x559e645ed520 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f0152ffd640 0 client.9927 ms_handle_reset on v2:172.21.15.146:6833/2786424389 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f01817d2740 1 --2- 172.21.15.146:0/2592306013 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559e641583b0 0x559e6454e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f01817d2740 1 -- 172.21.15.146:0/2592306013 >> 172.21.15.146:0/2592306013 conn(0x559e641753c0 msgr2=0x559e64563d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f01817d2740 1 -- 172.21.15.146:0/2592306013 shutdown_connections 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.880+0000 7f01817d2740 1 -- 172.21.15.146:0/2592306013 wait complete. 2024-09-17T03:42:57.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f01817d2740 20 client.9927 trim_cache size 0 max 16384 2024-09-17T03:42:57.887 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:42:57.887 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:42:57.887 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:42:57.887 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 9783, 2024-09-17T03:42:57.887 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:42:57.887 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:42:57.887 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:42:57.887 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 5.7192560669999999, 2024-09-17T03:42:57.888 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 113, 2024-09-17T03:42:57.888 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 154, 2024-09-17T03:42:57.888 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 154, 2024-09-17T03:42:57.888 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 10.352404585 2024-09-17T03:42:57.888 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 -- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0154078b90 msgr2=0x7f015407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0154078b90 0x7f015407b0a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0164000c00 tx=0x7f0164009040 comp rx=0 tx=0).stop 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 -- 172.21.15.146:0/1267412620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01740b5ce0 msgr2=0x7f01740b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01740b5ce0 0x7f01740b3410 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c390 tx=0x7f015c00c850 comp rx=0 tx=0).stop 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 -- 172.21.15.146:0/1267412620 shutdown_connections 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0154078b90 0x7f015407b0a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01741549b0 0x7f01740b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01740b5ce0 0x7f01740b3410 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 --2- 172.21.15.146:0/1267412620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01740b5750 0x7f017414c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 -- 172.21.15.146:0/1267412620 >> 172.21.15.146:0/1267412620 conn(0x7f01740b7b20 msgr2=0x7f0174152b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 -- 172.21.15.146:0/1267412620 shutdown_connections 2024-09-17T03:42:57.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:57.881+0000 7f017a863640 1 -- 172.21.15.146:0/1267412620 wait complete. 2024-09-17T03:42:57.893 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:42:58.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.006+0000 7f6a661ba640 1 -- 172.21.15.146:0/739670508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a60072d90 msgr2=0x7f6a600b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:58.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.006+0000 7f6a661ba640 1 --2- 172.21.15.146:0/739670508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a60072d90 0x7f6a600b4370 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f6a60071f20 tx=0x7f6a5802aa30 comp rx=0 tx=0).stop 2024-09-17T03:42:58.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.007+0000 7f6a661ba640 1 -- 172.21.15.146:0/739670508 shutdown_connections 2024-09-17T03:42:58.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.007+0000 7f6a661ba640 1 --2- 172.21.15.146:0/739670508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a60072d90 0x7f6a600b4370 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:58.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.007+0000 7f6a661ba640 1 --2- 172.21.15.146:0/739670508 >> v2:172.21.15.179:3300/0 conn(0x7f6a6015b770 0x7f6a6006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:58.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.007+0000 7f6a661ba640 1 -- 172.21.15.146:0/739670508 >> 172.21.15.146:0/739670508 conn(0x7f6a600b2060 msgr2=0x7f6a600b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:58.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.007+0000 7f6a661ba640 1 -- 172.21.15.146:0/739670508 shutdown_connections 2024-09-17T03:42:58.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.007+0000 7f6a661ba640 1 -- 172.21.15.146:0/739670508 wait complete. 2024-09-17T03:42:58.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.008+0000 7f6a661ba640 1 Processor -- start 2024-09-17T03:42:58.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.009+0000 7f6a661ba640 1 -- start start 2024-09-17T03:42:58.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a661ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a60070350 0x7f6a600cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:58.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a661ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a6015b770 0x7f6a6014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:58.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a661ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a601530d0 0x7f6a6015df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:58.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a661ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600b4db0 con 0x7f6a6015b770 2024-09-17T03:42:58.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a661ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600b4c30 con 0x7f6a60070350 2024-09-17T03:42:58.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a661ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6a600b4f30 con 0x7f6a601530d0 2024-09-17T03:42:58.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a5effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a6015b770 0x7f6a6014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a5effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a6015b770 0x7f6a6014bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46740/0 (socket says 172.21.15.146:46740) 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a5effd640 1 -- 172.21.15.146:0/4207888296 learned_addr learned my addr 172.21.15.146:0/4207888296 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a5f7fe640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a60070350 0x7f6a600cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a5ffff640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a601530d0 0x7f6a6015df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a5effd640 1 -- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a601530d0 msgr2=0x7f6a6015df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a5effd640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a601530d0 0x7f6a6015df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a5effd640 1 -- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a60070350 msgr2=0x7f6a600cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a5effd640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a60070350 0x7f6a600cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.010+0000 7f6a5effd640 1 -- 172.21.15.146:0/4207888296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6014c3e0 con 0x7f6a6015b770 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.011+0000 7f6a5effd640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a6015b770 0x7f6a6014bea0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c3f0 tx=0x7f6a5400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.011+0000 7f6a47fff640 1 -- 172.21.15.146:0/4207888296 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54017070 con 0x7f6a6015b770 2024-09-17T03:42:58.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.011+0000 7f6a47fff640 1 -- 172.21.15.146:0/4207888296 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a540053c0 con 0x7f6a6015b770 2024-09-17T03:42:58.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.011+0000 7f6a661ba640 1 -- 172.21.15.146:0/4207888296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6006ee80 con 0x7f6a6015b770 2024-09-17T03:42:58.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.011+0000 7f6a47fff640 1 -- 172.21.15.146:0/4207888296 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a540038a0 con 0x7f6a6015b770 2024-09-17T03:42:58.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.011+0000 7f6a661ba640 1 -- 172.21.15.146:0/4207888296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6006f440 con 0x7f6a6015b770 2024-09-17T03:42:58.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.012+0000 7f6a661ba640 1 -- 172.21.15.146:0/4207888296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a600b54c0 con 0x7f6a6015b770 2024-09-17T03:42:58.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.012+0000 7f6a47fff640 1 -- 172.21.15.146:0/4207888296 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a5401a070 con 0x7f6a6015b770 2024-09-17T03:42:58.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.013+0000 7f6a47fff640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a4c078b90 0x7f6a4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:58.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.013+0000 7f6a47fff640 1 -- 172.21.15.146:0/4207888296 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f6a54099f30 con 0x7f6a6015b770 2024-09-17T03:42:58.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.013+0000 7f6a5f7fe640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a4c078b90 0x7f6a4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:58.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.014+0000 7f6a5f7fe640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a4c078b90 0x7f6a4c07b0a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009b30 tx=0x7f6a50005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:58.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.017+0000 7f6a47fff640 1 -- 172.21.15.146:0/4207888296 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6a6015bb80 con 0x7f6a6015b770 2024-09-17T03:42:58.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.229+0000 7f6a661ba640 1 -- 172.21.15.146:0/4207888296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6a600b0430 con 0x7f6a6015b770 2024-09-17T03:42:58.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.229+0000 7f6a47fff640 1 -- 172.21.15.146:0/4207888296 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v113) ==== 53+0+73 (secure 0 0 0) 0x7f6a54061db0 con 0x7f6a6015b770 2024-09-17T03:42:58.230 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:42:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.231+0000 7f6a661ba640 1 -- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a4c078b90 msgr2=0x7f6a4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.231+0000 7f6a661ba640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a4c078b90 0x7f6a4c07b0a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009b30 tx=0x7f6a50005f90 comp rx=0 tx=0).stop 2024-09-17T03:42:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.231+0000 7f6a661ba640 1 -- 172.21.15.146:0/4207888296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a6015b770 msgr2=0x7f6a6014bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.231+0000 7f6a661ba640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a6015b770 0x7f6a6014bea0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400c3f0 tx=0x7f6a5400c8b0 comp rx=0 tx=0).stop 2024-09-17T03:42:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.232+0000 7f6a661ba640 1 -- 172.21.15.146:0/4207888296 shutdown_connections 2024-09-17T03:42:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.232+0000 7f6a661ba640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a4c078b90 0x7f6a4c07b0a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.232+0000 7f6a661ba640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a601530d0 0x7f6a6015df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:58.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.232+0000 7f6a661ba640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a6015b770 0x7f6a6014bea0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.232+0000 7f6a661ba640 1 --2- 172.21.15.146:0/4207888296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a60070350 0x7f6a600cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.232+0000 7f6a661ba640 1 -- 172.21.15.146:0/4207888296 >> 172.21.15.146:0/4207888296 conn(0x7f6a600b2060 msgr2=0x7f6a600b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.232+0000 7f6a661ba640 1 -- 172.21.15.146:0/4207888296 shutdown_connections 2024-09-17T03:42:58.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58.232+0000 7f6a661ba640 1 -- 172.21.15.146:0/4207888296 wait complete. 2024-09-17T03:42:58.243 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:42:58.243 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:42:58.243 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:42:58.244 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:42:58.244 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:42:58.244 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:42:58.244 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:42:58.244 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:42:58.244 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:42:58.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:58.244 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:42:58.261 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:42:58.262 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42193sec preferred_lft 42193sec 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:42:58.263 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:42:58.264 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:42:58.264 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:58.264 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:42:58.264 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:42:58.264 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:42:58.264 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:42:58.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:58.265 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:42:58.325 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:42:58.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:58.327 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:42:58.383 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:42:58.383 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:42:58.384 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:42:58.384 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:42:58.384 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:42:58.384 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:42:58.384 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:58.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:42:58.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:42:58.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:42:58.384 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:58.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:42:58.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:58.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:58.510 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:42:58.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:42:58.526 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:42:58.527 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:42:58.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:58.527 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:42:58.592 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:42:58.592 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:42:58.649 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:42:58.649 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:42:58.649 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:42:58.704 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:42:58.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:58.705 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:42:58.799 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:42:58.799 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:42:58.799 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:42:58.810 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:42:58.810 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:42:58.810 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:42:58.810 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:42:58.810 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:42:58.816 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:42:58.817 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:42:58.817 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:42:58.817 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:42:58.817 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:42:58.817 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:42:58.817 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:42:58.817 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:42:58.817 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:42:58.818 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:42:58.818 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:42:58.818 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:42:58.818 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:42:58.820 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:42:58.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:42:58.820 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:42:58.845 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:42:58.910 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:42:58.931 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:42:58.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:58.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:42:58.948 INFO:teuthology.orchestra.run.smithi146.stdout:client8653 2024-09-17T03:42:58.949 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:42:58.949 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:42:59.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:59.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.195+0000 7f13fe240640 1 -- 172.21.15.146:0/1058557083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80b4510 msgr2=0x7f13f8070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.195+0000 7f13fe240640 1 --2- 172.21.15.146:0/1058557083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80b4510 0x7f13f8070010 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f13f80726f0 tx=0x7f13f002aa30 comp rx=0 tx=0).stop 2024-09-17T03:42:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.195+0000 7f13fe240640 1 -- 172.21.15.146:0/1058557083 shutdown_connections 2024-09-17T03:42:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.195+0000 7f13fe240640 1 --2- 172.21.15.146:0/1058557083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80b4510 0x7f13f8070010 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.195+0000 7f13fe240640 1 --2- 172.21.15.146:0/1058557083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13f80b4100 0x7f13f806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.195+0000 7f13fe240640 1 --2- 172.21.15.146:0/1058557083 >> v2:172.21.15.179:3300/0 conn(0x7f13f815c9f0 0x7f13f81526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.195+0000 7f13fe240640 1 -- 172.21.15.146:0/1058557083 >> 172.21.15.146:0/1058557083 conn(0x7f13f806d3c0 msgr2=0x7f13f80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.195+0000 7f13fe240640 1 -- 172.21.15.146:0/1058557083 shutdown_connections 2024-09-17T03:42:59.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.195+0000 7f13fe240640 1 -- 172.21.15.146:0/1058557083 wait complete. 2024-09-17T03:42:59.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.197+0000 7f13fe240640 1 Processor -- start 2024-09-17T03:42:59.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.197+0000 7f13fe240640 1 -- start start 2024-09-17T03:42:59.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.198+0000 7f13fe240640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f80b4100 0x7f13f8158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:59.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.198+0000 7f13fe240640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80b4510 0x7f13f8155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:59.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.198+0000 7f13fe240640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13f81f3000 0x7f13f81e6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:59.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.198+0000 7f13fe240640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f13f80d04e0 con 0x7f13f80b4510 2024-09-17T03:42:59.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.198+0000 7f13fe240640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f13f80d0360 con 0x7f13f80b4100 2024-09-17T03:42:59.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.198+0000 7f13fe240640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f13f80d0660 con 0x7f13f81f3000 2024-09-17T03:42:59.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.198+0000 7f13f6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80b4510 0x7f13f8155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:59.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.198+0000 7f13f6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80b4510 0x7f13f8155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46762/0 (socket says 172.21.15.146:46762) 2024-09-17T03:42:59.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.198+0000 7f13f6ffd640 1 -- 172.21.15.146:0/2541708007 learned_addr learned my addr 172.21.15.146:0/2541708007 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:59.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13f7fff640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13f81f3000 0x7f13f81e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13f77fe640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f80b4100 0x7f13f8158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13f6ffd640 1 -- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13f81f3000 msgr2=0x7f13f81e6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13f6ffd640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13f81f3000 0x7f13f81e6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13f6ffd640 1 -- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f80b4100 msgr2=0x7f13f8158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13f6ffd640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f80b4100 0x7f13f8158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13f6ffd640 1 -- 172.21.15.146:0/2541708007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f806ee50 con 0x7f13f80b4510 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13f7fff640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13f81f3000 0x7f13f81e6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13f77fe640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f80b4100 0x7f13f8158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13f6ffd640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80b4510 0x7f13f8155990 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00e7c0 tx=0x7f13ec00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13dffff640 1 -- 172.21.15.146:0/2541708007 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec00cc60 con 0x7f13f80b4510 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13dffff640 1 -- 172.21.15.146:0/2541708007 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13ec00ce20 con 0x7f13f80b4510 2024-09-17T03:42:59.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13dffff640 1 -- 172.21.15.146:0/2541708007 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec005280 con 0x7f13f80b4510 2024-09-17T03:42:59.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13fe240640 1 -- 172.21.15.146:0/2541708007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f806f130 con 0x7f13f80b4510 2024-09-17T03:42:59.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.199+0000 7f13fe240640 1 -- 172.21.15.146:0/2541708007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f806f6f0 con 0x7f13f80b4510 2024-09-17T03:42:59.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.200+0000 7f13fe240640 1 -- 172.21.15.146:0/2541708007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f806ebc0 con 0x7f13f80b4510 2024-09-17T03:42:59.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.201+0000 7f13dffff640 1 -- 172.21.15.146:0/2541708007 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f13ec005420 con 0x7f13f80b4510 2024-09-17T03:42:59.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.202+0000 7f13dffff640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f13e4078b90 0x7f13e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:59.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.202+0000 7f13dffff640 1 -- 172.21.15.146:0/2541708007 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f13ec09bae0 con 0x7f13f80b4510 2024-09-17T03:42:59.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.202+0000 7f13f77fe640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f13e4078b90 0x7f13e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:59.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.203+0000 7f13f77fe640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f13e4078b90 0x7f13e407b0a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f13e8005e00 tx=0x7f13e8005c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.208+0000 7f13dffff640 1 -- 172.21.15.146:0/2541708007 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f13ec064010 con 0x7f13f80b4510 2024-09-17T03:42:59.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.417+0000 7f13fe240640 1 -- 172.21.15.146:0/2541708007 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13f815c9f0 con 0x7f13f80b4510 2024-09-17T03:42:59.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.418+0000 7f13dffff640 1 -- 172.21.15.146:0/2541708007 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7f13ec063910 con 0x7f13f80b4510 2024-09-17T03:42:59.418 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:59.419 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:42:59.419 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:42:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 -- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f13e4078b90 msgr2=0x7f13e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f13e4078b90 0x7f13e407b0a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f13e8005e00 tx=0x7f13e8005c90 comp rx=0 tx=0).stop 2024-09-17T03:42:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 -- 172.21.15.146:0/2541708007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80b4510 msgr2=0x7f13f8155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80b4510 0x7f13f8155990 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00e7c0 tx=0x7f13ec00ec80 comp rx=0 tx=0).stop 2024-09-17T03:42:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 -- 172.21.15.146:0/2541708007 shutdown_connections 2024-09-17T03:42:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f13e4078b90 0x7f13e407b0a0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f13f81f3000 0x7f13f81e6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80b4510 0x7f13f8155990 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 --2- 172.21.15.146:0/2541708007 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f13f80b4100 0x7f13f8158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 -- 172.21.15.146:0/2541708007 >> 172.21.15.146:0/2541708007 conn(0x7f13f806d3c0 msgr2=0x7f13f8151900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:59.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 -- 172.21.15.146:0/2541708007 shutdown_connections 2024-09-17T03:42:59.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.420+0000 7f13fe240640 1 -- 172.21.15.146:0/2541708007 wait complete. 2024-09-17T03:42:59.432 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:42:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.545+0000 7f6cc8520640 1 -- 172.21.15.146:0/1944597500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cac003a30 msgr2=0x7f6cac003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.545+0000 7f6cc8520640 1 --2- 172.21.15.146:0/1944597500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cac003a30 0x7f6cac003ea0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0016c0 tx=0x7f6cac005830 comp rx=0 tx=0).stop 2024-09-17T03:42:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.545+0000 7f6cc6abd640 1 -- 172.21.15.146:0/1944597500 reap_dead start 2024-09-17T03:42:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.545+0000 7f6cc8520640 1 -- 172.21.15.146:0/1944597500 shutdown_connections 2024-09-17T03:42:59.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.545+0000 7f6cc8520640 1 -- 172.21.15.146:0/1944597500 >> 172.21.15.146:0/1944597500 conn(0x7f6cc00b3410 msgr2=0x7f6cc00b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.545+0000 7f6cc8520640 1 -- 172.21.15.146:0/1944597500 shutdown_connections 2024-09-17T03:42:59.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.545+0000 7f6cc8520640 1 -- 172.21.15.146:0/1944597500 wait complete. 2024-09-17T03:42:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.547+0000 7f6cc8520640 1 Processor -- start 2024-09-17T03:42:59.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.547+0000 7f6cc8520640 1 -- start start 2024-09-17T03:42:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.548+0000 7f6cc8520640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac003a30 0x7f6cc01e7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.548+0000 7f6cc8520640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cc01e7a60 0x7f6cc01f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.548+0000 7f6cc8520640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cc01f6db0 0x7f6cc01f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.548+0000 7f6cc8520640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc015d200 con 0x7f6cc01f6db0 2024-09-17T03:42:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.548+0000 7f6cc8520640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc015d080 con 0x7f6cac003a30 2024-09-17T03:42:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.548+0000 7f6cc8520640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc00d0040 con 0x7f6cc01e7a60 2024-09-17T03:42:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.548+0000 7f6cc6abd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cc01f6db0 0x7f6cc01f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.548+0000 7f6cc6abd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cc01f6db0 0x7f6cc01f71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46782/0 (socket says 172.21.15.146:46782) 2024-09-17T03:42:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.548+0000 7f6cc6abd640 1 -- 172.21.15.146:0/2629035543 learned_addr learned my addr 172.21.15.146:0/2629035543 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:42:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.548+0000 7f6cc62bc640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac003a30 0x7f6cc01e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.548+0000 7f6cc5abb640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cc01e7a60 0x7f6cc01f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.549+0000 7f6cc6abd640 1 -- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cc01e7a60 msgr2=0x7f6cc01f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.549+0000 7f6cc6abd640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cc01e7a60 0x7f6cc01f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.549+0000 7f6cc6abd640 1 -- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac003a30 msgr2=0x7f6cc01e7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.549+0000 7f6cc6abd640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac003a30 0x7f6cc01e7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.549+0000 7f6cc6abd640 1 -- 172.21.15.146:0/2629035543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc01558e0 con 0x7f6cc01f6db0 2024-09-17T03:42:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.549+0000 7f6cc6abd640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cc01f6db0 0x7f6cc01f71c0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8000f80 tx=0x7f6cb8004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.549+0000 7f6cb6ffd640 1 -- 172.21.15.146:0/2629035543 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011870 con 0x7f6cc01f6db0 2024-09-17T03:42:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.549+0000 7f6cb6ffd640 1 -- 172.21.15.146:0/2629035543 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cb8018070 con 0x7f6cc01f6db0 2024-09-17T03:42:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.549+0000 7f6cc8520640 1 -- 172.21.15.146:0/2629035543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc0155bc0 con 0x7f6cc01f6db0 2024-09-17T03:42:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.549+0000 7f6cb6ffd640 1 -- 172.21.15.146:0/2629035543 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011dc0 con 0x7f6cc01f6db0 2024-09-17T03:42:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.549+0000 7f6cc8520640 1 -- 172.21.15.146:0/2629035543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc0150960 con 0x7f6cc01f6db0 2024-09-17T03:42:59.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.550+0000 7f6cc8520640 1 -- 172.21.15.146:0/2629035543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc0155650 con 0x7f6cc01f6db0 2024-09-17T03:42:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.551+0000 7f6cb6ffd640 1 -- 172.21.15.146:0/2629035543 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6cb801d460 con 0x7f6cc01f6db0 2024-09-17T03:42:59.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.551+0000 7f6cb6ffd640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ca4078bc0 0x7f6ca407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:42:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.551+0000 7f6cb6ffd640 1 -- 172.21.15.146:0/2629035543 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f6cb809b370 con 0x7f6cc01f6db0 2024-09-17T03:42:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.552+0000 7f6cc62bc640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ca4078bc0 0x7f6ca407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:42:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.552+0000 7f6cc62bc640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ca4078bc0 0x7f6ca407b0d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc032000 tx=0x7f6cbc02c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:42:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.556+0000 7f6cb6ffd640 1 -- 172.21.15.146:0/2629035543 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6cc0070ac0 con 0x7f6cc01f6db0 2024-09-17T03:42:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.763+0000 7f6cc8520640 1 -- 172.21.15.146:0/2629035543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cc00cf930 con 0x7f6cc01f6db0 2024-09-17T03:42:59.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.763+0000 7f6cb6ffd640 1 -- 172.21.15.146:0/2629035543 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7f6cb8063160 con 0x7f6cc01f6db0 2024-09-17T03:42:59.763 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:42:59.764 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:42:59.764 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:42:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.765+0000 7f6cc8520640 1 -- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ca4078bc0 msgr2=0x7f6ca407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.765+0000 7f6cc8520640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ca4078bc0 0x7f6ca407b0d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc032000 tx=0x7f6cbc02c040 comp rx=0 tx=0).stop 2024-09-17T03:42:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.765+0000 7f6cc8520640 1 -- 172.21.15.146:0/2629035543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cc01f6db0 msgr2=0x7f6cc01f71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:42:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.765+0000 7f6cc8520640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cc01f6db0 0x7f6cc01f71c0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8000f80 tx=0x7f6cb8004f90 comp rx=0 tx=0).stop 2024-09-17T03:42:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.765+0000 7f6cc8520640 1 -- 172.21.15.146:0/2629035543 shutdown_connections 2024-09-17T03:42:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.765+0000 7f6cc8520640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ca4078bc0 0x7f6ca407b0d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.765+0000 7f6cc8520640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cc01f6db0 0x7f6cc01f71c0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.765+0000 7f6cc8520640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cc01e7a60 0x7f6cc01f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.765+0000 7f6cc8520640 1 --2- 172.21.15.146:0/2629035543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac003a30 0x7f6cc01e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:42:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.765+0000 7f6cc8520640 1 -- 172.21.15.146:0/2629035543 >> 172.21.15.146:0/2629035543 conn(0x7f6cc00b3410 msgr2=0x7f6cc00734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:42:59.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.766+0000 7f6cc8520640 1 -- 172.21.15.146:0/2629035543 shutdown_connections 2024-09-17T03:42:59.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59.766+0000 7f6cc8520640 1 -- 172.21.15.146:0/2629035543 wait complete. 2024-09-17T03:42:59.778 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:42:59.778 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:42:59.778 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.0 2024-09-17T03:42:59.778 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:42:59.778 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:42:59.778 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:42:59.778 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:42:59.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:42:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:42:59.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.846 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924135 s, 113 MB/s 2024-09-17T03:42:59.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.857 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866759 s, 121 MB/s 2024-09-17T03:42:59.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693365 s, 151 MB/s 2024-09-17T03:42:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743186 s, 141 MB/s 2024-09-17T03:42:59.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.885 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850606 s, 123 MB/s 2024-09-17T03:42:59.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076503 s, 137 MB/s 2024-09-17T03:42:59.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.902 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676552 s, 155 MB/s 2024-09-17T03:42:59.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714769 s, 147 MB/s 2024-09-17T03:42:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771957 s, 136 MB/s 2024-09-17T03:42:59.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.928 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597747 s, 175 MB/s 2024-09-17T03:42:59.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.936 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634307 s, 165 MB/s 2024-09-17T03:42:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.946 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733309 s, 143 MB/s 2024-09-17T03:42:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.954 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739164 s, 142 MB/s 2024-09-17T03:42:59.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.963 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736101 s, 142 MB/s 2024-09-17T03:42:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713617 s, 147 MB/s 2024-09-17T03:42:59.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00801602 s, 131 MB/s 2024-09-17T03:42:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:42:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:42:59.991 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725052 s, 145 MB/s 2024-09-17T03:43:00.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.000 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701212 s, 150 MB/s 2024-09-17T03:43:00.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.009 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708523 s, 148 MB/s 2024-09-17T03:43:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705457 s, 149 MB/s 2024-09-17T03:43:00.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.027 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764542 s, 137 MB/s 2024-09-17T03:43:00.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.035 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651568 s, 161 MB/s 2024-09-17T03:43:00.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.043 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590751 s, 177 MB/s 2024-09-17T03:43:00.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750648 s, 140 MB/s 2024-09-17T03:43:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626376 s, 167 MB/s 2024-09-17T03:43:00.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.068 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680027 s, 154 MB/s 2024-09-17T03:43:00.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723175 s, 145 MB/s 2024-09-17T03:43:00.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.085 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616684 s, 170 MB/s 2024-09-17T03:43:00.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.093 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661257 s, 159 MB/s 2024-09-17T03:43:00.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074016 s, 142 MB/s 2024-09-17T03:43:00.112 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.112 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.112 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770023 s, 136 MB/s 2024-09-17T03:43:00.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608031 s, 172 MB/s 2024-09-17T03:43:00.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:00.126 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:00.126 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:00.126 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.1 2024-09-17T03:43:00.126 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:00.126 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:00.126 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:00.126 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:00.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661145 s, 159 MB/s 2024-09-17T03:43:00.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682862 s, 154 MB/s 2024-09-17T03:43:00.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.206 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772216 s, 136 MB/s 2024-09-17T03:43:00.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.215 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709019 s, 148 MB/s 2024-09-17T03:43:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144692 s, 72.5 MB/s 2024-09-17T03:43:00.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.239 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613852 s, 171 MB/s 2024-09-17T03:43:00.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.247 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065236 s, 161 MB/s 2024-09-17T03:43:00.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.262 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138297 s, 75.8 MB/s 2024-09-17T03:43:00.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.271 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686381 s, 153 MB/s 2024-09-17T03:43:00.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.279 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611515 s, 171 MB/s 2024-09-17T03:43:00.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.287 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602628 s, 174 MB/s 2024-09-17T03:43:00.295 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.295 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.296 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687173 s, 153 MB/s 2024-09-17T03:43:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.304 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668263 s, 157 MB/s 2024-09-17T03:43:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765666 s, 137 MB/s 2024-09-17T03:43:00.321 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.322 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698954 s, 150 MB/s 2024-09-17T03:43:00.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.329 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612359 s, 171 MB/s 2024-09-17T03:43:00.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.338 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635819 s, 165 MB/s 2024-09-17T03:43:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597427 s, 176 MB/s 2024-09-17T03:43:00.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.354 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678064 s, 155 MB/s 2024-09-17T03:43:00.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683494 s, 153 MB/s 2024-09-17T03:43:00.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582065 s, 180 MB/s 2024-09-17T03:43:00.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073036 s, 144 MB/s 2024-09-17T03:43:00.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.387 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646933 s, 162 MB/s 2024-09-17T03:43:00.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691784 s, 152 MB/s 2024-09-17T03:43:00.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.404 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063082 s, 166 MB/s 2024-09-17T03:43:00.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.413 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662444 s, 158 MB/s 2024-09-17T03:43:00.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.421 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666561 s, 157 MB/s 2024-09-17T03:43:00.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.429 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065718 s, 160 MB/s 2024-09-17T03:43:00.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.438 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677539 s, 155 MB/s 2024-09-17T03:43:00.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644856 s, 163 MB/s 2024-09-17T03:43:00.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.455 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.455 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708983 s, 148 MB/s 2024-09-17T03:43:00.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.463 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688681 s, 152 MB/s 2024-09-17T03:43:00.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:00.470 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:00.471 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:00.471 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.2 2024-09-17T03:43:00.471 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:00.471 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:00.471 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:00.471 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:00.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:00.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766634 s, 137 MB/s 2024-09-17T03:43:00.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.539 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664933 s, 158 MB/s 2024-09-17T03:43:00.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.547 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619245 s, 169 MB/s 2024-09-17T03:43:00.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761722 s, 138 MB/s 2024-09-17T03:43:00.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.564 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652521 s, 161 MB/s 2024-09-17T03:43:00.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.573 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669491 s, 157 MB/s 2024-09-17T03:43:00.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.581 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067553 s, 155 MB/s 2024-09-17T03:43:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076183 s, 138 MB/s 2024-09-17T03:43:00.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584642 s, 179 MB/s 2024-09-17T03:43:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632287 s, 166 MB/s 2024-09-17T03:43:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607849 s, 173 MB/s 2024-09-17T03:43:00.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.623 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077046 s, 136 MB/s 2024-09-17T03:43:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.632 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645707 s, 162 MB/s 2024-09-17T03:43:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.641 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742946 s, 141 MB/s 2024-09-17T03:43:00.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725809 s, 144 MB/s 2024-09-17T03:43:00.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703581 s, 149 MB/s 2024-09-17T03:43:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.668 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724176 s, 145 MB/s 2024-09-17T03:43:00.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680032 s, 154 MB/s 2024-09-17T03:43:00.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.684 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644494 s, 163 MB/s 2024-09-17T03:43:00.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.692 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645315 s, 162 MB/s 2024-09-17T03:43:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667371 s, 157 MB/s 2024-09-17T03:43:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699306 s, 150 MB/s 2024-09-17T03:43:00.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.717 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620531 s, 169 MB/s 2024-09-17T03:43:00.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.725 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698393 s, 150 MB/s 2024-09-17T03:43:00.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.734 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685421 s, 153 MB/s 2024-09-17T03:43:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.743 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755395 s, 139 MB/s 2024-09-17T03:43:00.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.752 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668469 s, 157 MB/s 2024-09-17T03:43:00.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616322 s, 170 MB/s 2024-09-17T03:43:00.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006459 s, 162 MB/s 2024-09-17T03:43:00.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.777 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736031 s, 142 MB/s 2024-09-17T03:43:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644547 s, 163 MB/s 2024-09-17T03:43:00.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653205 s, 161 MB/s 2024-09-17T03:43:00.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:00.800 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:00.800 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:00.800 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.3 2024-09-17T03:43:00.800 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:00.800 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:00.800 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:00.800 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:00.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:00.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.859 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678534 s, 155 MB/s 2024-09-17T03:43:00.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.867 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651947 s, 161 MB/s 2024-09-17T03:43:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.876 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641602 s, 163 MB/s 2024-09-17T03:43:00.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.885 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734681 s, 143 MB/s 2024-09-17T03:43:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.893 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065583 s, 160 MB/s 2024-09-17T03:43:00.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599615 s, 175 MB/s 2024-09-17T03:43:00.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.908 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057698 s, 182 MB/s 2024-09-17T03:43:00.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.916 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626863 s, 167 MB/s 2024-09-17T03:43:00.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722039 s, 145 MB/s 2024-09-17T03:43:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589512 s, 178 MB/s 2024-09-17T03:43:00.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.940 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581889 s, 180 MB/s 2024-09-17T03:43:00.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747688 s, 140 MB/s 2024-09-17T03:43:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692701 s, 151 MB/s 2024-09-17T03:43:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075292 s, 139 MB/s 2024-09-17T03:43:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.975 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061217 s, 171 MB/s 2024-09-17T03:43:00.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.984 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671747 s, 156 MB/s 2024-09-17T03:43:00.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:00.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:00.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730688 s, 144 MB/s 2024-09-17T03:43:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.001 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606729 s, 173 MB/s 2024-09-17T03:43:01.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.009 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668886 s, 157 MB/s 2024-09-17T03:43:01.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.018 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651312 s, 161 MB/s 2024-09-17T03:43:01.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.026 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645928 s, 162 MB/s 2024-09-17T03:43:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.034 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591705 s, 177 MB/s 2024-09-17T03:43:01.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659111 s, 159 MB/s 2024-09-17T03:43:01.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.050 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581334 s, 180 MB/s 2024-09-17T03:43:01.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.058 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688607 s, 152 MB/s 2024-09-17T03:43:01.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.066 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060984 s, 172 MB/s 2024-09-17T03:43:01.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.075 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745026 s, 141 MB/s 2024-09-17T03:43:01.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657264 s, 160 MB/s 2024-09-17T03:43:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.093 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759332 s, 138 MB/s 2024-09-17T03:43:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588088 s, 178 MB/s 2024-09-17T03:43:01.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.111 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763004 s, 137 MB/s 2024-09-17T03:43:01.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.118 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639944 s, 164 MB/s 2024-09-17T03:43:01.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:01.124 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:01.125 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:01.125 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.4 2024-09-17T03:43:01.125 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:01.125 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:01.125 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:01.125 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:01.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:01.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702223 s, 149 MB/s 2024-09-17T03:43:01.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.192 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696282 s, 151 MB/s 2024-09-17T03:43:01.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652083 s, 161 MB/s 2024-09-17T03:43:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069488 s, 151 MB/s 2024-09-17T03:43:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601182 s, 174 MB/s 2024-09-17T03:43:01.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.226 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665462 s, 158 MB/s 2024-09-17T03:43:01.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592993 s, 177 MB/s 2024-09-17T03:43:01.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584324 s, 179 MB/s 2024-09-17T03:43:01.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.249 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593192 s, 177 MB/s 2024-09-17T03:43:01.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.256 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597881 s, 175 MB/s 2024-09-17T03:43:01.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685396 s, 153 MB/s 2024-09-17T03:43:01.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.274 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724992 s, 145 MB/s 2024-09-17T03:43:01.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.282 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666843 s, 157 MB/s 2024-09-17T03:43:01.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723548 s, 145 MB/s 2024-09-17T03:43:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074484 s, 141 MB/s 2024-09-17T03:43:01.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597151 s, 176 MB/s 2024-09-17T03:43:01.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572017 s, 183 MB/s 2024-09-17T03:43:01.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.324 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677441 s, 155 MB/s 2024-09-17T03:43:01.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749576 s, 140 MB/s 2024-09-17T03:43:01.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733371 s, 143 MB/s 2024-09-17T03:43:01.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694435 s, 151 MB/s 2024-09-17T03:43:01.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.361 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755244 s, 139 MB/s 2024-09-17T03:43:01.368 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.368 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.368 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664785 s, 158 MB/s 2024-09-17T03:43:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.378 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745728 s, 141 MB/s 2024-09-17T03:43:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.386 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612772 s, 171 MB/s 2024-09-17T03:43:01.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585037 s, 179 MB/s 2024-09-17T03:43:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607725 s, 173 MB/s 2024-09-17T03:43:01.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.409 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589171 s, 178 MB/s 2024-09-17T03:43:01.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724 s, 145 MB/s 2024-09-17T03:43:01.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649597 s, 161 MB/s 2024-09-17T03:43:01.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.434 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625936 s, 168 MB/s 2024-09-17T03:43:01.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.443 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679078 s, 154 MB/s 2024-09-17T03:43:01.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:01.449 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:01.449 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:01.449 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.5 2024-09-17T03:43:01.449 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:01.449 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:01.449 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:01.450 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:01.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:01.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.509 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744184 s, 141 MB/s 2024-09-17T03:43:01.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718085 s, 146 MB/s 2024-09-17T03:43:01.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.526 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676918 s, 155 MB/s 2024-09-17T03:43:01.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.536 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735138 s, 143 MB/s 2024-09-17T03:43:01.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644179 s, 163 MB/s 2024-09-17T03:43:01.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667938 s, 157 MB/s 2024-09-17T03:43:01.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.561 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671744 s, 156 MB/s 2024-09-17T03:43:01.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621132 s, 169 MB/s 2024-09-17T03:43:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667525 s, 157 MB/s 2024-09-17T03:43:01.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.585 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606969 s, 173 MB/s 2024-09-17T03:43:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617687 s, 170 MB/s 2024-09-17T03:43:01.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661386 s, 159 MB/s 2024-09-17T03:43:01.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.612 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653509 s, 160 MB/s 2024-09-17T03:43:01.617 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.617 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.617 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629768 s, 167 MB/s 2024-09-17T03:43:01.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.626 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655543 s, 160 MB/s 2024-09-17T03:43:01.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643488 s, 163 MB/s 2024-09-17T03:43:01.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.642 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673032 s, 156 MB/s 2024-09-17T03:43:01.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594344 s, 176 MB/s 2024-09-17T03:43:01.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.657 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576806 s, 182 MB/s 2024-09-17T03:43:01.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.665 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584238 s, 179 MB/s 2024-09-17T03:43:01.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.673 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592828 s, 177 MB/s 2024-09-17T03:43:01.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657684 s, 159 MB/s 2024-09-17T03:43:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.690 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731431 s, 143 MB/s 2024-09-17T03:43:01.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.699 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662436 s, 158 MB/s 2024-09-17T03:43:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662279 s, 158 MB/s 2024-09-17T03:43:01.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.714 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599011 s, 175 MB/s 2024-09-17T03:43:01.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.723 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695109 s, 151 MB/s 2024-09-17T03:43:01.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643804 s, 163 MB/s 2024-09-17T03:43:01.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.739 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594468 s, 176 MB/s 2024-09-17T03:43:01.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.747 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.747 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598281 s, 175 MB/s 2024-09-17T03:43:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.756 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707027 s, 148 MB/s 2024-09-17T03:43:01.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.764 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650117 s, 161 MB/s 2024-09-17T03:43:01.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:01.770 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:01.770 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:01.770 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.6 2024-09-17T03:43:01.771 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:01.771 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:01.771 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:01.771 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:01.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.830 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654175 s, 160 MB/s 2024-09-17T03:43:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745693 s, 141 MB/s 2024-09-17T03:43:01.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666352 s, 157 MB/s 2024-09-17T03:43:01.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.855 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642049 s, 163 MB/s 2024-09-17T03:43:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065728 s, 160 MB/s 2024-09-17T03:43:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604957 s, 173 MB/s 2024-09-17T03:43:01.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.880 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668172 s, 157 MB/s 2024-09-17T03:43:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674982 s, 155 MB/s 2024-09-17T03:43:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625078 s, 168 MB/s 2024-09-17T03:43:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007166 s, 146 MB/s 2024-09-17T03:43:01.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641831 s, 163 MB/s 2024-09-17T03:43:01.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.921 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584479 s, 179 MB/s 2024-09-17T03:43:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.930 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730801 s, 143 MB/s 2024-09-17T03:43:01.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.939 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712271 s, 147 MB/s 2024-09-17T03:43:01.946 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.946 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.946 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058597 s, 179 MB/s 2024-09-17T03:43:01.955 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.955 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.955 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742323 s, 141 MB/s 2024-09-17T03:43:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.964 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068638 s, 153 MB/s 2024-09-17T03:43:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644475 s, 163 MB/s 2024-09-17T03:43:01.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.980 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656825 s, 160 MB/s 2024-09-17T03:43:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067573 s, 155 MB/s 2024-09-17T03:43:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673596 s, 156 MB/s 2024-09-17T03:43:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664399 s, 158 MB/s 2024-09-17T03:43:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.013 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585202 s, 179 MB/s 2024-09-17T03:43:02.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.021 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598379 s, 175 MB/s 2024-09-17T03:43:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671612 s, 156 MB/s 2024-09-17T03:43:02.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.039 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778635 s, 135 MB/s 2024-09-17T03:43:02.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.047 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661906 s, 158 MB/s 2024-09-17T03:43:02.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.055 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596276 s, 176 MB/s 2024-09-17T03:43:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.064 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075652 s, 139 MB/s 2024-09-17T03:43:02.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.073 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714362 s, 147 MB/s 2024-09-17T03:43:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.081 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593328 s, 177 MB/s 2024-09-17T03:43:02.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.089 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643676 s, 163 MB/s 2024-09-17T03:43:02.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:02.096 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:02.096 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:02.096 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.7 2024-09-17T03:43:02.096 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:02.096 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:02.096 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:02.096 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:02.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:02.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.154 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006039 s, 174 MB/s 2024-09-17T03:43:02.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.163 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680433 s, 154 MB/s 2024-09-17T03:43:02.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.171 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606964 s, 173 MB/s 2024-09-17T03:43:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.178 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584582 s, 179 MB/s 2024-09-17T03:43:02.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.186 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654244 s, 160 MB/s 2024-09-17T03:43:02.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058292 s, 180 MB/s 2024-09-17T03:43:02.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684958 s, 153 MB/s 2024-09-17T03:43:02.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740857 s, 142 MB/s 2024-09-17T03:43:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.220 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064323 s, 163 MB/s 2024-09-17T03:43:02.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652983 s, 161 MB/s 2024-09-17T03:43:02.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.237 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733187 s, 143 MB/s 2024-09-17T03:43:02.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635746 s, 165 MB/s 2024-09-17T03:43:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619348 s, 169 MB/s 2024-09-17T03:43:02.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.260 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587784 s, 178 MB/s 2024-09-17T03:43:02.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.269 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685422 s, 153 MB/s 2024-09-17T03:43:02.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.278 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679467 s, 154 MB/s 2024-09-17T03:43:02.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622922 s, 168 MB/s 2024-09-17T03:43:02.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.293 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569199 s, 184 MB/s 2024-09-17T03:43:02.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.302 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705613 s, 149 MB/s 2024-09-17T03:43:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064872 s, 162 MB/s 2024-09-17T03:43:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607256 s, 173 MB/s 2024-09-17T03:43:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610506 s, 172 MB/s 2024-09-17T03:43:02.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645714 s, 162 MB/s 2024-09-17T03:43:02.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.343 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715798 s, 146 MB/s 2024-09-17T03:43:02.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754795 s, 139 MB/s 2024-09-17T03:43:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677167 s, 155 MB/s 2024-09-17T03:43:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688209 s, 152 MB/s 2024-09-17T03:43:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065112 s, 161 MB/s 2024-09-17T03:43:02.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584006 s, 180 MB/s 2024-09-17T03:43:02.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591748 s, 177 MB/s 2024-09-17T03:43:02.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.400 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570298 s, 184 MB/s 2024-09-17T03:43:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747735 s, 140 MB/s 2024-09-17T03:43:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:02.416 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:02.416 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:02.416 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.8 2024-09-17T03:43:02.416 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:02.416 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:02.416 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:02.416 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:02.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729573 s, 144 MB/s 2024-09-17T03:43:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657705 s, 159 MB/s 2024-09-17T03:43:02.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.494 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752921 s, 139 MB/s 2024-09-17T03:43:02.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.502 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065166 s, 161 MB/s 2024-09-17T03:43:02.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.510 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061854 s, 170 MB/s 2024-09-17T03:43:02.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.517 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060252 s, 174 MB/s 2024-09-17T03:43:02.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722218 s, 145 MB/s 2024-09-17T03:43:02.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.534 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601294 s, 174 MB/s 2024-09-17T03:43:02.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659609 s, 159 MB/s 2024-09-17T03:43:02.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674408 s, 155 MB/s 2024-09-17T03:43:02.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.561 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687802 s, 152 MB/s 2024-09-17T03:43:02.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.571 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00823403 s, 127 MB/s 2024-09-17T03:43:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.580 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686063 s, 153 MB/s 2024-09-17T03:43:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663444 s, 158 MB/s 2024-09-17T03:43:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00802886 s, 131 MB/s 2024-09-17T03:43:02.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624355 s, 168 MB/s 2024-09-17T03:43:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673197 s, 156 MB/s 2024-09-17T03:43:02.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.624 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678344 s, 155 MB/s 2024-09-17T03:43:02.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.633 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658606 s, 159 MB/s 2024-09-17T03:43:02.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.641 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659356 s, 159 MB/s 2024-09-17T03:43:02.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.648 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580726 s, 181 MB/s 2024-09-17T03:43:02.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.657 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067681 s, 155 MB/s 2024-09-17T03:43:02.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.666 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663699 s, 158 MB/s 2024-09-17T03:43:02.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.674 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066339 s, 158 MB/s 2024-09-17T03:43:02.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.682 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650608 s, 161 MB/s 2024-09-17T03:43:02.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.691 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725519 s, 145 MB/s 2024-09-17T03:43:02.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.698 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574994 s, 182 MB/s 2024-09-17T03:43:02.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.707 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681346 s, 154 MB/s 2024-09-17T03:43:02.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.715 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653559 s, 160 MB/s 2024-09-17T03:43:02.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.723 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629389 s, 167 MB/s 2024-09-17T03:43:02.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649102 s, 162 MB/s 2024-09-17T03:43:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592535 s, 177 MB/s 2024-09-17T03:43:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:02.745 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:02.746 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:02.746 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.9 2024-09-17T03:43:02.746 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:02.746 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:02.746 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:02.746 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:02.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:02.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.804 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625627 s, 168 MB/s 2024-09-17T03:43:02.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.813 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672729 s, 156 MB/s 2024-09-17T03:43:02.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.821 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614062 s, 171 MB/s 2024-09-17T03:43:02.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.830 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754288 s, 139 MB/s 2024-09-17T03:43:02.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634826 s, 165 MB/s 2024-09-17T03:43:02.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.846 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629596 s, 167 MB/s 2024-09-17T03:43:02.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075486 s, 139 MB/s 2024-09-17T03:43:02.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738869 s, 142 MB/s 2024-09-17T03:43:02.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.872 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596841 s, 176 MB/s 2024-09-17T03:43:02.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.880 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640908 s, 164 MB/s 2024-09-17T03:43:02.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752586 s, 139 MB/s 2024-09-17T03:43:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780436 s, 134 MB/s 2024-09-17T03:43:02.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.907 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065337 s, 160 MB/s 2024-09-17T03:43:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.916 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659318 s, 159 MB/s 2024-09-17T03:43:02.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.924 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629657 s, 167 MB/s 2024-09-17T03:43:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668501 s, 157 MB/s 2024-09-17T03:43:02.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677009 s, 155 MB/s 2024-09-17T03:43:02.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.949 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629143 s, 167 MB/s 2024-09-17T03:43:02.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.958 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072827 s, 144 MB/s 2024-09-17T03:43:02.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.966 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689165 s, 152 MB/s 2024-09-17T03:43:02.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.975 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698282 s, 150 MB/s 2024-09-17T03:43:02.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660199 s, 159 MB/s 2024-09-17T03:43:02.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.991 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640192 s, 164 MB/s 2024-09-17T03:43:02.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:02.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:02.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642878 s, 163 MB/s 2024-09-17T03:43:03.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643612 s, 163 MB/s 2024-09-17T03:43:03.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.015 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578473 s, 181 MB/s 2024-09-17T03:43:03.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.023 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665388 s, 158 MB/s 2024-09-17T03:43:03.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665088 s, 158 MB/s 2024-09-17T03:43:03.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583107 s, 180 MB/s 2024-09-17T03:43:03.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.048 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667993 s, 157 MB/s 2024-09-17T03:43:03.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.057 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739991 s, 142 MB/s 2024-09-17T03:43:03.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657649 s, 159 MB/s 2024-09-17T03:43:03.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:03.072 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:03.072 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:03.072 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.10 2024-09-17T03:43:03.072 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:03.072 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:03.072 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:03.072 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:03.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:03.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679361 s, 154 MB/s 2024-09-17T03:43:03.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.140 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656932 s, 160 MB/s 2024-09-17T03:43:03.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.148 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066226 s, 158 MB/s 2024-09-17T03:43:03.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624513 s, 168 MB/s 2024-09-17T03:43:03.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.164 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.165 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643899 s, 163 MB/s 2024-09-17T03:43:03.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.172 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598735 s, 175 MB/s 2024-09-17T03:43:03.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639207 s, 164 MB/s 2024-09-17T03:43:03.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.189 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071371 s, 147 MB/s 2024-09-17T03:43:03.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.199 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753576 s, 139 MB/s 2024-09-17T03:43:03.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.207 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656838 s, 160 MB/s 2024-09-17T03:43:03.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.216 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615113 s, 170 MB/s 2024-09-17T03:43:03.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.224 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721542 s, 145 MB/s 2024-09-17T03:43:03.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743547 s, 141 MB/s 2024-09-17T03:43:03.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636629 s, 165 MB/s 2024-09-17T03:43:03.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073147 s, 143 MB/s 2024-09-17T03:43:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.258 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669447 s, 157 MB/s 2024-09-17T03:43:03.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.266 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588291 s, 178 MB/s 2024-09-17T03:43:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768632 s, 136 MB/s 2024-09-17T03:43:03.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.284 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.284 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660731 s, 159 MB/s 2024-09-17T03:43:03.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.292 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006674 s, 157 MB/s 2024-09-17T03:43:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.302 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767868 s, 137 MB/s 2024-09-17T03:43:03.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651258 s, 161 MB/s 2024-09-17T03:43:03.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662228 s, 158 MB/s 2024-09-17T03:43:03.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.326 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067155 s, 156 MB/s 2024-09-17T03:43:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651759 s, 161 MB/s 2024-09-17T03:43:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673519 s, 156 MB/s 2024-09-17T03:43:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072441 s, 145 MB/s 2024-09-17T03:43:03.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.361 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742739 s, 141 MB/s 2024-09-17T03:43:03.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646134 s, 162 MB/s 2024-09-17T03:43:03.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.377 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639168 s, 164 MB/s 2024-09-17T03:43:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.386 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660922 s, 159 MB/s 2024-09-17T03:43:03.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610807 s, 172 MB/s 2024-09-17T03:43:03.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:03.400 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:03.400 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:03.400 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.11 2024-09-17T03:43:03.400 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:03.400 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:03.400 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:03.400 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:03.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:03.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673406 s, 156 MB/s 2024-09-17T03:43:03.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.468 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755165 s, 139 MB/s 2024-09-17T03:43:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675969 s, 155 MB/s 2024-09-17T03:43:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617916 s, 170 MB/s 2024-09-17T03:43:03.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.493 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658538 s, 159 MB/s 2024-09-17T03:43:03.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.502 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615587 s, 170 MB/s 2024-09-17T03:43:03.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.509 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729129 s, 144 MB/s 2024-09-17T03:43:03.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665716 s, 158 MB/s 2024-09-17T03:43:03.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.526 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698681 s, 150 MB/s 2024-09-17T03:43:03.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.535 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580804 s, 181 MB/s 2024-09-17T03:43:03.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640622 s, 164 MB/s 2024-09-17T03:43:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.550 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635382 s, 165 MB/s 2024-09-17T03:43:03.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.558 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643564 s, 163 MB/s 2024-09-17T03:43:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.567 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685067 s, 153 MB/s 2024-09-17T03:43:03.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.575 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653882 s, 160 MB/s 2024-09-17T03:43:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.583 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068325 s, 153 MB/s 2024-09-17T03:43:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743388 s, 141 MB/s 2024-09-17T03:43:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644616 s, 163 MB/s 2024-09-17T03:43:03.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718546 s, 146 MB/s 2024-09-17T03:43:03.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.618 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656743 s, 160 MB/s 2024-09-17T03:43:03.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.627 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684447 s, 153 MB/s 2024-09-17T03:43:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645946 s, 162 MB/s 2024-09-17T03:43:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.644 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754215 s, 139 MB/s 2024-09-17T03:43:03.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612096 s, 171 MB/s 2024-09-17T03:43:03.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635693 s, 165 MB/s 2024-09-17T03:43:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736149 s, 142 MB/s 2024-09-17T03:43:03.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.677 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664122 s, 158 MB/s 2024-09-17T03:43:03.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.686 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641225 s, 164 MB/s 2024-09-17T03:43:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639811 s, 164 MB/s 2024-09-17T03:43:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.702 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627149 s, 167 MB/s 2024-09-17T03:43:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675801 s, 155 MB/s 2024-09-17T03:43:03.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.718 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591945 s, 177 MB/s 2024-09-17T03:43:03.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:03.724 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:03.724 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:03.725 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.12 2024-09-17T03:43:03.725 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:03.725 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:03.725 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:03.725 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:03.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:03.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.784 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679718 s, 154 MB/s 2024-09-17T03:43:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.791 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645955 s, 162 MB/s 2024-09-17T03:43:03.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648045 s, 162 MB/s 2024-09-17T03:43:03.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.808 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643775 s, 163 MB/s 2024-09-17T03:43:03.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.815 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597414 s, 176 MB/s 2024-09-17T03:43:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674474 s, 155 MB/s 2024-09-17T03:43:03.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.832 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676405 s, 155 MB/s 2024-09-17T03:43:03.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.842 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763788 s, 137 MB/s 2024-09-17T03:43:03.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.850 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603822 s, 174 MB/s 2024-09-17T03:43:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659902 s, 159 MB/s 2024-09-17T03:43:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587724 s, 178 MB/s 2024-09-17T03:43:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573105 s, 183 MB/s 2024-09-17T03:43:03.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594662 s, 176 MB/s 2024-09-17T03:43:03.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661588 s, 158 MB/s 2024-09-17T03:43:03.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579616 s, 181 MB/s 2024-09-17T03:43:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735208 s, 143 MB/s 2024-09-17T03:43:03.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615279 s, 170 MB/s 2024-09-17T03:43:03.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658686 s, 159 MB/s 2024-09-17T03:43:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698944 s, 150 MB/s 2024-09-17T03:43:03.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.940 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768998 s, 136 MB/s 2024-09-17T03:43:03.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.948 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662959 s, 158 MB/s 2024-09-17T03:43:03.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074123 s, 141 MB/s 2024-09-17T03:43:03.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.965 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640119 s, 164 MB/s 2024-09-17T03:43:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676881 s, 155 MB/s 2024-09-17T03:43:03.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613017 s, 171 MB/s 2024-09-17T03:43:03.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588862 s, 178 MB/s 2024-09-17T03:43:03.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:03.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:03.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740021 s, 142 MB/s 2024-09-17T03:43:04.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.006 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622897 s, 168 MB/s 2024-09-17T03:43:04.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.016 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743852 s, 141 MB/s 2024-09-17T03:43:04.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.026 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748537 s, 140 MB/s 2024-09-17T03:43:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.033 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624844 s, 168 MB/s 2024-09-17T03:43:04.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649274 s, 161 MB/s 2024-09-17T03:43:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:04.048 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:04.048 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:04.048 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.13 2024-09-17T03:43:04.048 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:04.048 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:04.048 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:04.048 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:04.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:04.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658642 s, 159 MB/s 2024-09-17T03:43:04.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.116 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752176 s, 139 MB/s 2024-09-17T03:43:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.125 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672409 s, 156 MB/s 2024-09-17T03:43:04.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590931 s, 177 MB/s 2024-09-17T03:43:04.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.141 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709087 s, 148 MB/s 2024-09-17T03:43:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707003 s, 148 MB/s 2024-09-17T03:43:04.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.159 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735505 s, 143 MB/s 2024-09-17T03:43:04.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598424 s, 175 MB/s 2024-09-17T03:43:04.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.176 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730698 s, 144 MB/s 2024-09-17T03:43:04.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727391 s, 144 MB/s 2024-09-17T03:43:04.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593097 s, 177 MB/s 2024-09-17T03:43:04.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696599 s, 151 MB/s 2024-09-17T03:43:04.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.210 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735191 s, 143 MB/s 2024-09-17T03:43:04.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.219 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674278 s, 156 MB/s 2024-09-17T03:43:04.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646871 s, 162 MB/s 2024-09-17T03:43:04.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.236 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668206 s, 157 MB/s 2024-09-17T03:43:04.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071478 s, 147 MB/s 2024-09-17T03:43:04.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698635 s, 150 MB/s 2024-09-17T03:43:04.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.261 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060158 s, 174 MB/s 2024-09-17T03:43:04.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.270 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697022 s, 150 MB/s 2024-09-17T03:43:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.277 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592722 s, 177 MB/s 2024-09-17T03:43:04.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662803 s, 158 MB/s 2024-09-17T03:43:04.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.293 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585015 s, 179 MB/s 2024-09-17T03:43:04.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.302 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650598 s, 161 MB/s 2024-09-17T03:43:04.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656644 s, 160 MB/s 2024-09-17T03:43:04.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649787 s, 161 MB/s 2024-09-17T03:43:04.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575457 s, 182 MB/s 2024-09-17T03:43:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627881 s, 167 MB/s 2024-09-17T03:43:04.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.341 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643147 s, 163 MB/s 2024-09-17T03:43:04.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.350 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671458 s, 156 MB/s 2024-09-17T03:43:04.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.358 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644219 s, 163 MB/s 2024-09-17T03:43:04.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.367 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072931 s, 144 MB/s 2024-09-17T03:43:04.368 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:04.373 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:04.374 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:04.374 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.14 2024-09-17T03:43:04.374 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:04.374 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:04.374 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:04.374 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:04.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.434 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766743 s, 137 MB/s 2024-09-17T03:43:04.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.443 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731391 s, 143 MB/s 2024-09-17T03:43:04.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614259 s, 171 MB/s 2024-09-17T03:43:04.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680236 s, 154 MB/s 2024-09-17T03:43:04.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.469 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748956 s, 140 MB/s 2024-09-17T03:43:04.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.477 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716846 s, 146 MB/s 2024-09-17T03:43:04.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.486 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717262 s, 146 MB/s 2024-09-17T03:43:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686196 s, 153 MB/s 2024-09-17T03:43:04.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.504 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729377 s, 144 MB/s 2024-09-17T03:43:04.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.513 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755257 s, 139 MB/s 2024-09-17T03:43:04.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733357 s, 143 MB/s 2024-09-17T03:43:04.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727801 s, 144 MB/s 2024-09-17T03:43:04.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007349 s, 143 MB/s 2024-09-17T03:43:04.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.548 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607634 s, 173 MB/s 2024-09-17T03:43:04.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.557 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681676 s, 154 MB/s 2024-09-17T03:43:04.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619334 s, 169 MB/s 2024-09-17T03:43:04.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694627 s, 151 MB/s 2024-09-17T03:43:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006452 s, 163 MB/s 2024-09-17T03:43:04.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677609 s, 155 MB/s 2024-09-17T03:43:04.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592353 s, 177 MB/s 2024-09-17T03:43:04.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688662 s, 152 MB/s 2024-09-17T03:43:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006613 s, 159 MB/s 2024-09-17T03:43:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.623 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645383 s, 162 MB/s 2024-09-17T03:43:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.631 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648821 s, 162 MB/s 2024-09-17T03:43:04.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.640 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663487 s, 158 MB/s 2024-09-17T03:43:04.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.648 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729034 s, 144 MB/s 2024-09-17T03:43:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.657 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728506 s, 144 MB/s 2024-09-17T03:43:04.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.666 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679157 s, 154 MB/s 2024-09-17T03:43:04.674 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.674 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.674 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664791 s, 158 MB/s 2024-09-17T03:43:04.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.683 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740745 s, 142 MB/s 2024-09-17T03:43:04.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.691 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647063 s, 162 MB/s 2024-09-17T03:43:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603462 s, 174 MB/s 2024-09-17T03:43:04.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:04.706 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:04.706 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:04.706 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.15 2024-09-17T03:43:04.706 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:04.706 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:04.706 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:04.706 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:04.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684523 s, 153 MB/s 2024-09-17T03:43:04.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.774 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612608 s, 171 MB/s 2024-09-17T03:43:04.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.782 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651683 s, 161 MB/s 2024-09-17T03:43:04.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.790 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679042 s, 154 MB/s 2024-09-17T03:43:04.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634624 s, 165 MB/s 2024-09-17T03:43:04.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.808 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734186 s, 143 MB/s 2024-09-17T03:43:04.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.815 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594372 s, 176 MB/s 2024-09-17T03:43:04.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.823 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589222 s, 178 MB/s 2024-09-17T03:43:04.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.831 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635512 s, 165 MB/s 2024-09-17T03:43:04.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576134 s, 182 MB/s 2024-09-17T03:43:04.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.846 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600569 s, 175 MB/s 2024-09-17T03:43:04.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754087 s, 139 MB/s 2024-09-17T03:43:04.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636959 s, 165 MB/s 2024-09-17T03:43:04.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.872 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617678 s, 170 MB/s 2024-09-17T03:43:04.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.880 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674249 s, 156 MB/s 2024-09-17T03:43:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679642 s, 154 MB/s 2024-09-17T03:43:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676137 s, 155 MB/s 2024-09-17T03:43:04.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064466 s, 163 MB/s 2024-09-17T03:43:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655131 s, 160 MB/s 2024-09-17T03:43:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682022 s, 154 MB/s 2024-09-17T03:43:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687487 s, 153 MB/s 2024-09-17T03:43:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.939 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063424 s, 165 MB/s 2024-09-17T03:43:04.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.948 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725566 s, 145 MB/s 2024-09-17T03:43:04.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649551 s, 161 MB/s 2024-09-17T03:43:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.965 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677583 s, 155 MB/s 2024-09-17T03:43:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.974 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779632 s, 134 MB/s 2024-09-17T03:43:04.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645582 s, 162 MB/s 2024-09-17T03:43:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.990 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.991 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006553 s, 160 MB/s 2024-09-17T03:43:04.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:04.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:04.998 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598121 s, 175 MB/s 2024-09-17T03:43:05.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749663 s, 140 MB/s 2024-09-17T03:43:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.015 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571607 s, 183 MB/s 2024-09-17T03:43:05.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.024 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694041 s, 151 MB/s 2024-09-17T03:43:05.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:05.030 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:05.030 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:05.030 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.16 2024-09-17T03:43:05.030 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:05.030 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:05.030 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:05.031 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:05.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:05.088 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.088 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.089 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629378 s, 167 MB/s 2024-09-17T03:43:05.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.096 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613104 s, 171 MB/s 2024-09-17T03:43:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.105 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710305 s, 148 MB/s 2024-09-17T03:43:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.114 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071527 s, 147 MB/s 2024-09-17T03:43:05.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.123 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699398 s, 150 MB/s 2024-09-17T03:43:05.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660334 s, 159 MB/s 2024-09-17T03:43:05.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.140 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724773 s, 145 MB/s 2024-09-17T03:43:05.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688045 s, 152 MB/s 2024-09-17T03:43:05.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677214 s, 155 MB/s 2024-09-17T03:43:05.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.165 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600936 s, 174 MB/s 2024-09-17T03:43:05.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.174 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072654 s, 144 MB/s 2024-09-17T03:43:05.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.182 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584229 s, 179 MB/s 2024-09-17T03:43:05.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.190 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683187 s, 153 MB/s 2024-09-17T03:43:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.199 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690439 s, 152 MB/s 2024-09-17T03:43:05.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.206 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596039 s, 176 MB/s 2024-09-17T03:43:05.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.216 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789175 s, 133 MB/s 2024-09-17T03:43:05.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.224 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060064 s, 175 MB/s 2024-09-17T03:43:05.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696893 s, 150 MB/s 2024-09-17T03:43:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.242 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748115 s, 140 MB/s 2024-09-17T03:43:05.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684858 s, 153 MB/s 2024-09-17T03:43:05.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.259 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667807 s, 157 MB/s 2024-09-17T03:43:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671052 s, 156 MB/s 2024-09-17T03:43:05.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.277 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074847 s, 140 MB/s 2024-09-17T03:43:05.284 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.284 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.284 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581592 s, 180 MB/s 2024-09-17T03:43:05.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.293 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652367 s, 161 MB/s 2024-09-17T03:43:05.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.301 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654783 s, 160 MB/s 2024-09-17T03:43:05.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.309 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648629 s, 162 MB/s 2024-09-17T03:43:05.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.317 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602858 s, 174 MB/s 2024-09-17T03:43:05.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066151 s, 159 MB/s 2024-09-17T03:43:05.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579289 s, 181 MB/s 2024-09-17T03:43:05.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.341 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068665 s, 153 MB/s 2024-09-17T03:43:05.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.349 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595786 s, 176 MB/s 2024-09-17T03:43:05.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:05.355 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:05.355 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:05.355 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.17 2024-09-17T03:43:05.355 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:05.355 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:05.356 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:05.356 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:05.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:05.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.414 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656563 s, 160 MB/s 2024-09-17T03:43:05.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.422 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662785 s, 158 MB/s 2024-09-17T03:43:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.430 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582365 s, 180 MB/s 2024-09-17T03:43:05.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.438 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642647 s, 163 MB/s 2024-09-17T03:43:05.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692305 s, 151 MB/s 2024-09-17T03:43:05.455 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.455 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748785 s, 140 MB/s 2024-09-17T03:43:05.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.464 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066134 s, 159 MB/s 2024-09-17T03:43:05.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.472 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614153 s, 171 MB/s 2024-09-17T03:43:05.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.481 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740791 s, 142 MB/s 2024-09-17T03:43:05.489 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.490 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690085 s, 152 MB/s 2024-09-17T03:43:05.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.498 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649797 s, 161 MB/s 2024-09-17T03:43:05.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.505 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610066 s, 172 MB/s 2024-09-17T03:43:05.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.515 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769644 s, 136 MB/s 2024-09-17T03:43:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.523 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682895 s, 154 MB/s 2024-09-17T03:43:05.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.532 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731257 s, 143 MB/s 2024-09-17T03:43:05.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620658 s, 169 MB/s 2024-09-17T03:43:05.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689704 s, 152 MB/s 2024-09-17T03:43:05.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.557 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663572 s, 158 MB/s 2024-09-17T03:43:05.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061306 s, 171 MB/s 2024-09-17T03:43:05.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.575 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724541 s, 145 MB/s 2024-09-17T03:43:05.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.583 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653044 s, 161 MB/s 2024-09-17T03:43:05.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.591 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684081 s, 153 MB/s 2024-09-17T03:43:05.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595399 s, 176 MB/s 2024-09-17T03:43:05.607 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.607 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.607 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664058 s, 158 MB/s 2024-09-17T03:43:05.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655792 s, 160 MB/s 2024-09-17T03:43:05.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.625 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765329 s, 137 MB/s 2024-09-17T03:43:05.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.633 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641953 s, 163 MB/s 2024-09-17T03:43:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.641 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677206 s, 155 MB/s 2024-09-17T03:43:05.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645373 s, 162 MB/s 2024-09-17T03:43:05.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676521 s, 155 MB/s 2024-09-17T03:43:05.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.667 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778241 s, 135 MB/s 2024-09-17T03:43:05.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590001 s, 178 MB/s 2024-09-17T03:43:05.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:05.681 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:05.682 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:05.682 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.18 2024-09-17T03:43:05.682 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:05.682 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:05.682 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:05.682 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:05.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729672 s, 144 MB/s 2024-09-17T03:43:05.749 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.749 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.749 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695666 s, 151 MB/s 2024-09-17T03:43:05.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.757 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657418 s, 159 MB/s 2024-09-17T03:43:05.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663365 s, 158 MB/s 2024-09-17T03:43:05.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658841 s, 159 MB/s 2024-09-17T03:43:05.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.783 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655814 s, 160 MB/s 2024-09-17T03:43:05.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.791 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067907 s, 154 MB/s 2024-09-17T03:43:05.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673785 s, 156 MB/s 2024-09-17T03:43:05.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.807 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601641 s, 174 MB/s 2024-09-17T03:43:05.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.816 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699669 s, 150 MB/s 2024-09-17T03:43:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659244 s, 159 MB/s 2024-09-17T03:43:05.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.832 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588296 s, 178 MB/s 2024-09-17T03:43:05.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.840 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651988 s, 161 MB/s 2024-09-17T03:43:05.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.849 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747852 s, 140 MB/s 2024-09-17T03:43:05.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.858 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716476 s, 146 MB/s 2024-09-17T03:43:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633006 s, 166 MB/s 2024-09-17T03:43:05.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.875 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650447 s, 161 MB/s 2024-09-17T03:43:05.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651768 s, 161 MB/s 2024-09-17T03:43:05.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060164 s, 174 MB/s 2024-09-17T03:43:05.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668546 s, 157 MB/s 2024-09-17T03:43:05.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.907 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669968 s, 157 MB/s 2024-09-17T03:43:05.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.917 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664196 s, 158 MB/s 2024-09-17T03:43:05.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.923 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614313 s, 171 MB/s 2024-09-17T03:43:05.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707013 s, 148 MB/s 2024-09-17T03:43:05.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663827 s, 158 MB/s 2024-09-17T03:43:05.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727784 s, 144 MB/s 2024-09-17T03:43:05.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750375 s, 140 MB/s 2024-09-17T03:43:05.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.967 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665604 s, 158 MB/s 2024-09-17T03:43:05.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.976 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676895 s, 155 MB/s 2024-09-17T03:43:05.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593004 s, 177 MB/s 2024-09-17T03:43:05.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:05.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:05.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732885 s, 143 MB/s 2024-09-17T03:43:06.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.000 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587959 s, 178 MB/s 2024-09-17T03:43:06.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:06.006 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:06.006 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:06.007 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.19 2024-09-17T03:43:06.007 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:06.007 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:06.007 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:06.007 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:06.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.066 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670361 s, 156 MB/s 2024-09-17T03:43:06.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.074 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654418 s, 160 MB/s 2024-09-17T03:43:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650559 s, 161 MB/s 2024-09-17T03:43:06.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.091 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067603 s, 155 MB/s 2024-09-17T03:43:06.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.100 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729976 s, 144 MB/s 2024-09-17T03:43:06.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700775 s, 150 MB/s 2024-09-17T03:43:06.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.121 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780134 s, 134 MB/s 2024-09-17T03:43:06.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748965 s, 140 MB/s 2024-09-17T03:43:06.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.136 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727505 s, 144 MB/s 2024-09-17T03:43:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629637 s, 167 MB/s 2024-09-17T03:43:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653643 s, 160 MB/s 2024-09-17T03:43:06.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.161 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654364 s, 160 MB/s 2024-09-17T03:43:06.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687668 s, 152 MB/s 2024-09-17T03:43:06.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.178 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661555 s, 159 MB/s 2024-09-17T03:43:06.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625451 s, 168 MB/s 2024-09-17T03:43:06.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681464 s, 154 MB/s 2024-09-17T03:43:06.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068443 s, 153 MB/s 2024-09-17T03:43:06.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736539 s, 142 MB/s 2024-09-17T03:43:06.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.220 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597528 s, 175 MB/s 2024-09-17T03:43:06.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609033 s, 172 MB/s 2024-09-17T03:43:06.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.236 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669288 s, 157 MB/s 2024-09-17T03:43:06.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679593 s, 154 MB/s 2024-09-17T03:43:06.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.255 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761568 s, 138 MB/s 2024-09-17T03:43:06.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.262 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634258 s, 165 MB/s 2024-09-17T03:43:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602932 s, 174 MB/s 2024-09-17T03:43:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.278 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598352 s, 175 MB/s 2024-09-17T03:43:06.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.285 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586709 s, 179 MB/s 2024-09-17T03:43:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658844 s, 159 MB/s 2024-09-17T03:43:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.301 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577204 s, 182 MB/s 2024-09-17T03:43:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733387 s, 143 MB/s 2024-09-17T03:43:06.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.319 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065825 s, 159 MB/s 2024-09-17T03:43:06.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.327 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669886 s, 157 MB/s 2024-09-17T03:43:06.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:06.333 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:06.334 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:06.334 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.20 2024-09-17T03:43:06.334 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:06.334 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:06.334 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:06.334 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:06.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:06.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.394 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643435 s, 163 MB/s 2024-09-17T03:43:06.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714525 s, 147 MB/s 2024-09-17T03:43:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.410 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756371 s, 139 MB/s 2024-09-17T03:43:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.420 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075684 s, 139 MB/s 2024-09-17T03:43:06.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.427 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586331 s, 179 MB/s 2024-09-17T03:43:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614825 s, 171 MB/s 2024-09-17T03:43:06.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659242 s, 159 MB/s 2024-09-17T03:43:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628813 s, 167 MB/s 2024-09-17T03:43:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677807 s, 155 MB/s 2024-09-17T03:43:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676085 s, 155 MB/s 2024-09-17T03:43:06.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.477 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598902 s, 175 MB/s 2024-09-17T03:43:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746919 s, 140 MB/s 2024-09-17T03:43:06.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006083 s, 172 MB/s 2024-09-17T03:43:06.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.504 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665344 s, 158 MB/s 2024-09-17T03:43:06.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.513 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702074 s, 149 MB/s 2024-09-17T03:43:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737298 s, 142 MB/s 2024-09-17T03:43:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658406 s, 159 MB/s 2024-09-17T03:43:06.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671553 s, 156 MB/s 2024-09-17T03:43:06.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.548 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644039 s, 163 MB/s 2024-09-17T03:43:06.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.557 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662079 s, 158 MB/s 2024-09-17T03:43:06.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693887 s, 151 MB/s 2024-09-17T03:43:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.575 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073461 s, 143 MB/s 2024-09-17T03:43:06.584 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.584 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.584 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653828 s, 160 MB/s 2024-09-17T03:43:06.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651704 s, 161 MB/s 2024-09-17T03:43:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675664 s, 155 MB/s 2024-09-17T03:43:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655465 s, 160 MB/s 2024-09-17T03:43:06.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.619 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642795 s, 163 MB/s 2024-09-17T03:43:06.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.629 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.629 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735403 s, 143 MB/s 2024-09-17T03:43:06.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.637 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657405 s, 160 MB/s 2024-09-17T03:43:06.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676209 s, 155 MB/s 2024-09-17T03:43:06.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.655 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687184 s, 153 MB/s 2024-09-17T03:43:06.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.664 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697679 s, 150 MB/s 2024-09-17T03:43:06.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:06.670 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:06.670 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:06.670 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.21 2024-09-17T03:43:06.670 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:06.671 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:06.671 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:06.671 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:06.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:06.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.733 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723179 s, 145 MB/s 2024-09-17T03:43:06.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.739 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639065 s, 164 MB/s 2024-09-17T03:43:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665502 s, 158 MB/s 2024-09-17T03:43:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.758 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749231 s, 140 MB/s 2024-09-17T03:43:06.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594384 s, 176 MB/s 2024-09-17T03:43:06.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.775 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716338 s, 146 MB/s 2024-09-17T03:43:06.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.785 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713519 s, 147 MB/s 2024-09-17T03:43:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654193 s, 160 MB/s 2024-09-17T03:43:06.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657158 s, 160 MB/s 2024-09-17T03:43:06.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.810 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676538 s, 155 MB/s 2024-09-17T03:43:06.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.819 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605545 s, 173 MB/s 2024-09-17T03:43:06.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.828 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736966 s, 142 MB/s 2024-09-17T03:43:06.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.838 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075396 s, 139 MB/s 2024-09-17T03:43:06.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.846 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642362 s, 163 MB/s 2024-09-17T03:43:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668538 s, 157 MB/s 2024-09-17T03:43:06.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660452 s, 159 MB/s 2024-09-17T03:43:06.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.872 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614561 s, 171 MB/s 2024-09-17T03:43:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648881 s, 162 MB/s 2024-09-17T03:43:06.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.891 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742524 s, 141 MB/s 2024-09-17T03:43:06.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663473 s, 158 MB/s 2024-09-17T03:43:06.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.907 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588683 s, 178 MB/s 2024-09-17T03:43:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.916 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650737 s, 161 MB/s 2024-09-17T03:43:06.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670007 s, 157 MB/s 2024-09-17T03:43:06.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643201 s, 163 MB/s 2024-09-17T03:43:06.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570771 s, 184 MB/s 2024-09-17T03:43:06.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625951 s, 168 MB/s 2024-09-17T03:43:06.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.958 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691538 s, 152 MB/s 2024-09-17T03:43:06.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.967 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645531 s, 162 MB/s 2024-09-17T03:43:06.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.976 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683098 s, 154 MB/s 2024-09-17T03:43:06.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.984 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607378 s, 173 MB/s 2024-09-17T03:43:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:06.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:06.994 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737787 s, 142 MB/s 2024-09-17T03:43:07.002 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.002 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.002 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006358 s, 165 MB/s 2024-09-17T03:43:07.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:07.009 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:07.009 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:07.009 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.22 2024-09-17T03:43:07.009 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:07.009 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:07.009 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:07.009 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:07.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:07.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.069 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657005 s, 160 MB/s 2024-09-17T03:43:07.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065743 s, 159 MB/s 2024-09-17T03:43:07.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.087 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720377 s, 146 MB/s 2024-09-17T03:43:07.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.097 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727199 s, 144 MB/s 2024-09-17T03:43:07.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.106 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733333 s, 143 MB/s 2024-09-17T03:43:07.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671915 s, 156 MB/s 2024-09-17T03:43:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585856 s, 179 MB/s 2024-09-17T03:43:07.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661981 s, 158 MB/s 2024-09-17T03:43:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692566 s, 151 MB/s 2024-09-17T03:43:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601895 s, 174 MB/s 2024-09-17T03:43:07.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.158 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635994 s, 165 MB/s 2024-09-17T03:43:07.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689138 s, 152 MB/s 2024-09-17T03:43:07.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.176 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764323 s, 137 MB/s 2024-09-17T03:43:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623662 s, 168 MB/s 2024-09-17T03:43:07.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725672 s, 144 MB/s 2024-09-17T03:43:07.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746928 s, 140 MB/s 2024-09-17T03:43:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722121 s, 145 MB/s 2024-09-17T03:43:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.222 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836232 s, 125 MB/s 2024-09-17T03:43:07.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.231 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718418 s, 146 MB/s 2024-09-17T03:43:07.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.240 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768975 s, 136 MB/s 2024-09-17T03:43:07.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.248 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604617 s, 173 MB/s 2024-09-17T03:43:07.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.256 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662573 s, 158 MB/s 2024-09-17T03:43:07.264 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694423 s, 151 MB/s 2024-09-17T03:43:07.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.273 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669609 s, 157 MB/s 2024-09-17T03:43:07.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653433 s, 160 MB/s 2024-09-17T03:43:07.289 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.290 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662931 s, 158 MB/s 2024-09-17T03:43:07.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647518 s, 162 MB/s 2024-09-17T03:43:07.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.306 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006593 s, 159 MB/s 2024-09-17T03:43:07.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.315 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073832 s, 142 MB/s 2024-09-17T03:43:07.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595151 s, 176 MB/s 2024-09-17T03:43:07.330 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.330 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.331 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579995 s, 181 MB/s 2024-09-17T03:43:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618837 s, 169 MB/s 2024-09-17T03:43:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:07.345 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:07.345 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:07.345 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.23 2024-09-17T03:43:07.345 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:07.345 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:07.346 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:07.346 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:07.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:07.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.404 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607617 s, 173 MB/s 2024-09-17T03:43:07.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697247 s, 150 MB/s 2024-09-17T03:43:07.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.421 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671169 s, 156 MB/s 2024-09-17T03:43:07.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.429 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608842 s, 172 MB/s 2024-09-17T03:43:07.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.437 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650198 s, 161 MB/s 2024-09-17T03:43:07.445 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.445 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.445 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068013 s, 154 MB/s 2024-09-17T03:43:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750205 s, 140 MB/s 2024-09-17T03:43:07.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.462 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612162 s, 171 MB/s 2024-09-17T03:43:07.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.471 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715907 s, 146 MB/s 2024-09-17T03:43:07.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.480 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663606 s, 158 MB/s 2024-09-17T03:43:07.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.488 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638258 s, 164 MB/s 2024-09-17T03:43:07.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.497 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721642 s, 145 MB/s 2024-09-17T03:43:07.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.505 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641571 s, 163 MB/s 2024-09-17T03:43:07.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.513 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656277 s, 160 MB/s 2024-09-17T03:43:07.521 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658921 s, 159 MB/s 2024-09-17T03:43:07.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.530 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648015 s, 162 MB/s 2024-09-17T03:43:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659147 s, 159 MB/s 2024-09-17T03:43:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007367 s, 142 MB/s 2024-09-17T03:43:07.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.557 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645298 s, 162 MB/s 2024-09-17T03:43:07.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665212 s, 158 MB/s 2024-09-17T03:43:07.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665619 s, 158 MB/s 2024-09-17T03:43:07.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.583 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061795 s, 170 MB/s 2024-09-17T03:43:07.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076449 s, 137 MB/s 2024-09-17T03:43:07.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665885 s, 157 MB/s 2024-09-17T03:43:07.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709735 s, 148 MB/s 2024-09-17T03:43:07.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.618 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655458 s, 160 MB/s 2024-09-17T03:43:07.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.626 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624037 s, 168 MB/s 2024-09-17T03:43:07.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652739 s, 161 MB/s 2024-09-17T03:43:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652271 s, 161 MB/s 2024-09-17T03:43:07.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640035 s, 164 MB/s 2024-09-17T03:43:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066354 s, 158 MB/s 2024-09-17T03:43:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670382 s, 156 MB/s 2024-09-17T03:43:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:07.676 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:07.676 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:07.676 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.24 2024-09-17T03:43:07.676 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:07.676 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:07.676 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:07.676 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:07.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:07.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.736 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646557 s, 162 MB/s 2024-09-17T03:43:07.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.743 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617885 s, 170 MB/s 2024-09-17T03:43:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.754 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669046 s, 157 MB/s 2024-09-17T03:43:07.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061581 s, 170 MB/s 2024-09-17T03:43:07.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.769 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728871 s, 144 MB/s 2024-09-17T03:43:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.776 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584898 s, 179 MB/s 2024-09-17T03:43:07.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.785 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685338 s, 153 MB/s 2024-09-17T03:43:07.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.794 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793173 s, 132 MB/s 2024-09-17T03:43:07.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674801 s, 155 MB/s 2024-09-17T03:43:07.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.811 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662423 s, 158 MB/s 2024-09-17T03:43:07.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.819 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659711 s, 159 MB/s 2024-09-17T03:43:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739503 s, 142 MB/s 2024-09-17T03:43:07.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060956 s, 172 MB/s 2024-09-17T03:43:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734335 s, 143 MB/s 2024-09-17T03:43:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689211 s, 152 MB/s 2024-09-17T03:43:07.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650497 s, 161 MB/s 2024-09-17T03:43:07.871 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.871 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.871 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742941 s, 141 MB/s 2024-09-17T03:43:07.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.879 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654774 s, 160 MB/s 2024-09-17T03:43:07.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.888 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669919 s, 157 MB/s 2024-09-17T03:43:07.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.896 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664794 s, 158 MB/s 2024-09-17T03:43:07.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663762 s, 158 MB/s 2024-09-17T03:43:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629115 s, 167 MB/s 2024-09-17T03:43:07.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.921 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698115 s, 150 MB/s 2024-09-17T03:43:07.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.929 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065568 s, 160 MB/s 2024-09-17T03:43:07.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582166 s, 180 MB/s 2024-09-17T03:43:07.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.945 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066402 s, 158 MB/s 2024-09-17T03:43:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600492 s, 175 MB/s 2024-09-17T03:43:07.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.961 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576893 s, 182 MB/s 2024-09-17T03:43:07.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.969 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660316 s, 159 MB/s 2024-09-17T03:43:07.978 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.978 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.978 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742106 s, 141 MB/s 2024-09-17T03:43:07.988 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.988 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.988 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775934 s, 135 MB/s 2024-09-17T03:43:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675929 s, 155 MB/s 2024-09-17T03:43:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:08.003 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:08.003 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:08.003 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.25 2024-09-17T03:43:08.003 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:08.003 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:08.003 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:08.003 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:08.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:08.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.062 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762534 s, 138 MB/s 2024-09-17T03:43:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.071 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654584 s, 160 MB/s 2024-09-17T03:43:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641812 s, 163 MB/s 2024-09-17T03:43:08.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.086 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574999 s, 182 MB/s 2024-09-17T03:43:08.094 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.094 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.094 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621286 s, 169 MB/s 2024-09-17T03:43:08.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.103 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644589 s, 163 MB/s 2024-09-17T03:43:08.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.110 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611075 s, 172 MB/s 2024-09-17T03:43:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.118 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648387 s, 162 MB/s 2024-09-17T03:43:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746363 s, 140 MB/s 2024-09-17T03:43:08.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.136 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647895 s, 162 MB/s 2024-09-17T03:43:08.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733356 s, 143 MB/s 2024-09-17T03:43:08.152 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.153 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652766 s, 161 MB/s 2024-09-17T03:43:08.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.161 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061084 s, 172 MB/s 2024-09-17T03:43:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.171 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079095 s, 133 MB/s 2024-09-17T03:43:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640927 s, 164 MB/s 2024-09-17T03:43:08.187 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.187 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.187 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640055 s, 164 MB/s 2024-09-17T03:43:08.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601354 s, 174 MB/s 2024-09-17T03:43:08.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.203 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648211 s, 162 MB/s 2024-09-17T03:43:08.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637617 s, 164 MB/s 2024-09-17T03:43:08.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.220 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694831 s, 151 MB/s 2024-09-17T03:43:08.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674451 s, 155 MB/s 2024-09-17T03:43:08.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.236 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592291 s, 177 MB/s 2024-09-17T03:43:08.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612298 s, 171 MB/s 2024-09-17T03:43:08.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.252 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617727 s, 170 MB/s 2024-09-17T03:43:08.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.260 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066154 s, 159 MB/s 2024-09-17T03:43:08.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.269 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656125 s, 160 MB/s 2024-09-17T03:43:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063586 s, 165 MB/s 2024-09-17T03:43:08.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630134 s, 166 MB/s 2024-09-17T03:43:08.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.293 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063522 s, 165 MB/s 2024-09-17T03:43:08.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.301 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614393 s, 171 MB/s 2024-09-17T03:43:08.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.309 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698109 s, 150 MB/s 2024-09-17T03:43:08.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657994 s, 159 MB/s 2024-09-17T03:43:08.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:08.324 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:08.324 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:08.324 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.26 2024-09-17T03:43:08.324 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:08.325 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:08.325 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:08.325 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776446 s, 135 MB/s 2024-09-17T03:43:08.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068078 s, 154 MB/s 2024-09-17T03:43:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608031 s, 172 MB/s 2024-09-17T03:43:08.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.409 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651462 s, 161 MB/s 2024-09-17T03:43:08.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.417 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661984 s, 158 MB/s 2024-09-17T03:43:08.424 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.424 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.425 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590266 s, 178 MB/s 2024-09-17T03:43:08.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.433 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673598 s, 156 MB/s 2024-09-17T03:43:08.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.441 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664792 s, 158 MB/s 2024-09-17T03:43:08.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.449 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058464 s, 179 MB/s 2024-09-17T03:43:08.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.458 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691251 s, 152 MB/s 2024-09-17T03:43:08.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.466 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657016 s, 160 MB/s 2024-09-17T03:43:08.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.475 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724525 s, 145 MB/s 2024-09-17T03:43:08.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006819 s, 154 MB/s 2024-09-17T03:43:08.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.493 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757349 s, 138 MB/s 2024-09-17T03:43:08.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.501 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006558 s, 160 MB/s 2024-09-17T03:43:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.509 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650587 s, 161 MB/s 2024-09-17T03:43:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640925 s, 164 MB/s 2024-09-17T03:43:08.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771823 s, 136 MB/s 2024-09-17T03:43:08.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.536 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669593 s, 157 MB/s 2024-09-17T03:43:08.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066181 s, 158 MB/s 2024-09-17T03:43:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643462 s, 163 MB/s 2024-09-17T03:43:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.560 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657098 s, 160 MB/s 2024-09-17T03:43:08.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.570 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751188 s, 140 MB/s 2024-09-17T03:43:08.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.578 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675952 s, 155 MB/s 2024-09-17T03:43:08.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.586 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594716 s, 176 MB/s 2024-09-17T03:43:08.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.593 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595579 s, 176 MB/s 2024-09-17T03:43:08.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.602 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637541 s, 164 MB/s 2024-09-17T03:43:08.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658312 s, 159 MB/s 2024-09-17T03:43:08.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.619 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727001 s, 144 MB/s 2024-09-17T03:43:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652824 s, 161 MB/s 2024-09-17T03:43:08.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612508 s, 171 MB/s 2024-09-17T03:43:08.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.644 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679504 s, 154 MB/s 2024-09-17T03:43:08.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:08.650 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:08.650 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:08.650 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.27 2024-09-17T03:43:08.650 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:08.650 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:08.650 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:08.650 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:08.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.710 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733257 s, 143 MB/s 2024-09-17T03:43:08.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.718 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664563 s, 158 MB/s 2024-09-17T03:43:08.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.725 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621618 s, 169 MB/s 2024-09-17T03:43:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655477 s, 160 MB/s 2024-09-17T03:43:08.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.742 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683987 s, 153 MB/s 2024-09-17T03:43:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.751 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.751 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685191 s, 153 MB/s 2024-09-17T03:43:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.759 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065647 s, 160 MB/s 2024-09-17T03:43:08.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745313 s, 141 MB/s 2024-09-17T03:43:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.776 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587453 s, 178 MB/s 2024-09-17T03:43:08.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.784 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662166 s, 158 MB/s 2024-09-17T03:43:08.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068289 s, 154 MB/s 2024-09-17T03:43:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643334 s, 163 MB/s 2024-09-17T03:43:08.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.809 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658944 s, 159 MB/s 2024-09-17T03:43:08.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.817 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604606 s, 173 MB/s 2024-09-17T03:43:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067507 s, 155 MB/s 2024-09-17T03:43:08.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.833 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.833 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058299 s, 180 MB/s 2024-09-17T03:43:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.842 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669988 s, 157 MB/s 2024-09-17T03:43:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.849 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650034 s, 161 MB/s 2024-09-17T03:43:08.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.857 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578363 s, 181 MB/s 2024-09-17T03:43:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661111 s, 159 MB/s 2024-09-17T03:43:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601079 s, 174 MB/s 2024-09-17T03:43:08.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728617 s, 144 MB/s 2024-09-17T03:43:08.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590773 s, 177 MB/s 2024-09-17T03:43:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583587 s, 180 MB/s 2024-09-17T03:43:08.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664318 s, 158 MB/s 2024-09-17T03:43:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648064 s, 162 MB/s 2024-09-17T03:43:08.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066152 s, 159 MB/s 2024-09-17T03:43:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690132 s, 152 MB/s 2024-09-17T03:43:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763998 s, 137 MB/s 2024-09-17T03:43:08.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.948 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642412 s, 163 MB/s 2024-09-17T03:43:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642994 s, 163 MB/s 2024-09-17T03:43:08.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:08.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:08.964 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668259 s, 157 MB/s 2024-09-17T03:43:08.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:08.971 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:08.971 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:08.971 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.28 2024-09-17T03:43:08.971 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:08.971 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:08.971 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:08.971 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726794 s, 144 MB/s 2024-09-17T03:43:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.037 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582365 s, 180 MB/s 2024-09-17T03:43:09.045 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.045 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.045 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622943 s, 168 MB/s 2024-09-17T03:43:09.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.054 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717599 s, 146 MB/s 2024-09-17T03:43:09.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.062 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654579 s, 160 MB/s 2024-09-17T03:43:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.070 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641368 s, 163 MB/s 2024-09-17T03:43:09.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658007 s, 159 MB/s 2024-09-17T03:43:09.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.087 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645862 s, 162 MB/s 2024-09-17T03:43:09.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.095 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654104 s, 160 MB/s 2024-09-17T03:43:09.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.103 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670207 s, 156 MB/s 2024-09-17T03:43:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.111 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658719 s, 159 MB/s 2024-09-17T03:43:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665836 s, 157 MB/s 2024-09-17T03:43:09.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612917 s, 171 MB/s 2024-09-17T03:43:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725872 s, 144 MB/s 2024-09-17T03:43:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059209 s, 177 MB/s 2024-09-17T03:43:09.152 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.153 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666762 s, 157 MB/s 2024-09-17T03:43:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669548 s, 157 MB/s 2024-09-17T03:43:09.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584806 s, 179 MB/s 2024-09-17T03:43:09.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.176 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593904 s, 177 MB/s 2024-09-17T03:43:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.186 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679169 s, 154 MB/s 2024-09-17T03:43:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740196 s, 142 MB/s 2024-09-17T03:43:09.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634974 s, 165 MB/s 2024-09-17T03:43:09.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687798 s, 152 MB/s 2024-09-17T03:43:09.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.221 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804463 s, 130 MB/s 2024-09-17T03:43:09.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649638 s, 161 MB/s 2024-09-17T03:43:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596132 s, 176 MB/s 2024-09-17T03:43:09.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720591 s, 146 MB/s 2024-09-17T03:43:09.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630127 s, 166 MB/s 2024-09-17T03:43:09.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.261 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596787 s, 176 MB/s 2024-09-17T03:43:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727075 s, 144 MB/s 2024-09-17T03:43:09.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.278 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670684 s, 156 MB/s 2024-09-17T03:43:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642337 s, 163 MB/s 2024-09-17T03:43:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:09.293 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:09.293 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:09.293 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.29 2024-09-17T03:43:09.293 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:09.293 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:09.293 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:09.293 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:09.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678119 s, 155 MB/s 2024-09-17T03:43:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.361 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071327 s, 147 MB/s 2024-09-17T03:43:09.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641946 s, 163 MB/s 2024-09-17T03:43:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.377 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059873 s, 175 MB/s 2024-09-17T03:43:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060653 s, 173 MB/s 2024-09-17T03:43:09.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.394 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064478 s, 163 MB/s 2024-09-17T03:43:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063325 s, 166 MB/s 2024-09-17T03:43:09.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.409 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591988 s, 177 MB/s 2024-09-17T03:43:09.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.417 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605548 s, 173 MB/s 2024-09-17T03:43:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.425 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656904 s, 160 MB/s 2024-09-17T03:43:09.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.433 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666439 s, 157 MB/s 2024-09-17T03:43:09.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.442 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073943 s, 142 MB/s 2024-09-17T03:43:09.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.450 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580697 s, 181 MB/s 2024-09-17T03:43:09.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.458 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604492 s, 173 MB/s 2024-09-17T03:43:09.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.465 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587997 s, 178 MB/s 2024-09-17T03:43:09.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655597 s, 160 MB/s 2024-09-17T03:43:09.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654358 s, 160 MB/s 2024-09-17T03:43:09.489 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.490 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603734 s, 174 MB/s 2024-09-17T03:43:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.499 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725491 s, 145 MB/s 2024-09-17T03:43:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673745 s, 156 MB/s 2024-09-17T03:43:09.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.517 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770022 s, 136 MB/s 2024-09-17T03:43:09.525 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.525 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.525 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636594 s, 165 MB/s 2024-09-17T03:43:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.533 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616295 s, 170 MB/s 2024-09-17T03:43:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645896 s, 162 MB/s 2024-09-17T03:43:09.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643384 s, 163 MB/s 2024-09-17T03:43:09.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.558 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675733 s, 155 MB/s 2024-09-17T03:43:09.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640805 s, 164 MB/s 2024-09-17T03:43:09.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.573 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583144 s, 180 MB/s 2024-09-17T03:43:09.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.581 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067316 s, 156 MB/s 2024-09-17T03:43:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594377 s, 176 MB/s 2024-09-17T03:43:09.596 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581663 s, 180 MB/s 2024-09-17T03:43:09.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.605 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638937 s, 164 MB/s 2024-09-17T03:43:09.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:09.611 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:09.611 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:09.612 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.30 2024-09-17T03:43:09.612 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:09.612 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:09.612 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:09.612 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:09.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:09.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061349 s, 171 MB/s 2024-09-17T03:43:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.678 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649219 s, 162 MB/s 2024-09-17T03:43:09.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.687 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641089 s, 164 MB/s 2024-09-17T03:43:09.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657398 s, 160 MB/s 2024-09-17T03:43:09.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579626 s, 181 MB/s 2024-09-17T03:43:09.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.711 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688097 s, 152 MB/s 2024-09-17T03:43:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.720 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759201 s, 138 MB/s 2024-09-17T03:43:09.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.729 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631639 s, 166 MB/s 2024-09-17T03:43:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.737 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637849 s, 164 MB/s 2024-09-17T03:43:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.745 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673314 s, 156 MB/s 2024-09-17T03:43:09.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.756 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656951 s, 160 MB/s 2024-09-17T03:43:09.761 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.761 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.761 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609016 s, 172 MB/s 2024-09-17T03:43:09.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.770 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680042 s, 154 MB/s 2024-09-17T03:43:09.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.777 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588467 s, 178 MB/s 2024-09-17T03:43:09.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672249 s, 156 MB/s 2024-09-17T03:43:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693404 s, 151 MB/s 2024-09-17T03:43:09.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631869 s, 166 MB/s 2024-09-17T03:43:09.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.811 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700793 s, 150 MB/s 2024-09-17T03:43:09.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.819 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064686 s, 162 MB/s 2024-09-17T03:43:09.827 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.827 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.827 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603233 s, 174 MB/s 2024-09-17T03:43:09.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663682 s, 158 MB/s 2024-09-17T03:43:09.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.844 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.844 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066219 s, 158 MB/s 2024-09-17T03:43:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584655 s, 179 MB/s 2024-09-17T03:43:09.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.860 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748853 s, 140 MB/s 2024-09-17T03:43:09.869 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.869 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.869 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006816 s, 154 MB/s 2024-09-17T03:43:09.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616777 s, 170 MB/s 2024-09-17T03:43:09.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.884 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058312 s, 180 MB/s 2024-09-17T03:43:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.892 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060223 s, 174 MB/s 2024-09-17T03:43:09.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734907 s, 143 MB/s 2024-09-17T03:43:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619404 s, 169 MB/s 2024-09-17T03:43:09.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.918 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661381 s, 159 MB/s 2024-09-17T03:43:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644949 s, 163 MB/s 2024-09-17T03:43:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:09.932 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:43:09.932 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:43:09.932 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.31 2024-09-17T03:43:09.932 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:43:09.932 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:43:09.932 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:43:09.932 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:43:09.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:43:09.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:09.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:09.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746377 s, 140 MB/s 2024-09-17T03:43:10.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.000 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671141 s, 156 MB/s 2024-09-17T03:43:10.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.008 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651805 s, 161 MB/s 2024-09-17T03:43:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679893 s, 154 MB/s 2024-09-17T03:43:10.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.025 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006494 s, 161 MB/s 2024-09-17T03:43:10.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.033 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065103 s, 161 MB/s 2024-09-17T03:43:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676588 s, 155 MB/s 2024-09-17T03:43:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.049 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589715 s, 178 MB/s 2024-09-17T03:43:10.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.058 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652487 s, 161 MB/s 2024-09-17T03:43:10.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.066 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693154 s, 151 MB/s 2024-09-17T03:43:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.074 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664645 s, 158 MB/s 2024-09-17T03:43:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.083 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664958 s, 158 MB/s 2024-09-17T03:43:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760301 s, 138 MB/s 2024-09-17T03:43:10.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.101 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745356 s, 141 MB/s 2024-09-17T03:43:10.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.110 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649225 s, 162 MB/s 2024-09-17T03:43:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650904 s, 161 MB/s 2024-09-17T03:43:10.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.125 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615741 s, 170 MB/s 2024-09-17T03:43:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640431 s, 164 MB/s 2024-09-17T03:43:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679366 s, 154 MB/s 2024-09-17T03:43:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664953 s, 158 MB/s 2024-09-17T03:43:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073129 s, 143 MB/s 2024-09-17T03:43:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664069 s, 158 MB/s 2024-09-17T03:43:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592727 s, 177 MB/s 2024-09-17T03:43:10.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663456 s, 158 MB/s 2024-09-17T03:43:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.191 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606448 s, 173 MB/s 2024-09-17T03:43:10.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.199 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577293 s, 182 MB/s 2024-09-17T03:43:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619101 s, 169 MB/s 2024-09-17T03:43:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.216 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669186 s, 157 MB/s 2024-09-17T03:43:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.224 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644859 s, 163 MB/s 2024-09-17T03:43:10.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.232 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588299 s, 178 MB/s 2024-09-17T03:43:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759593 s, 138 MB/s 2024-09-17T03:43:10.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:43:10.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:43:10.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711332 s, 147 MB/s 2024-09-17T03:43:10.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:43:10.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:43:10.256 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub start /scrub_control_test_path recursive 2024-09-17T03:43:10.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.375+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/417418402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a8003a30 msgr2=0x7fe6a8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.375+0000 7fe6c2e9b640 1 --2- 172.21.15.146:0/417418402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a8003a30 0x7fe6a8003ea0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009b50 tx=0x7fe6a8005830 comp rx=0 tx=0).stop 2024-09-17T03:43:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.375+0000 7fe6c1438640 1 -- 172.21.15.146:0/417418402 reap_dead start 2024-09-17T03:43:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.375+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/417418402 shutdown_connections 2024-09-17T03:43:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.375+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/417418402 >> 172.21.15.146:0/417418402 conn(0x7fe6bc09ba20 msgr2=0x7fe6bc0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.375+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/417418402 shutdown_connections 2024-09-17T03:43:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.375+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/417418402 wait complete. 2024-09-17T03:43:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.377+0000 7fe6c2e9b640 1 Processor -- start 2024-09-17T03:43:10.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.377+0000 7fe6c2e9b640 1 -- start start 2024-09-17T03:43:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6c2e9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6a8003a30 0x7fe6bc0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6c2e9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc154880 0x7fe6bc0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6c2e9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6bc0c8d30 0x7fe6bc1f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6c2e9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc0cf170 con 0x7fe6bc154880 2024-09-17T03:43:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6c2e9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc0b80a0 con 0x7fe6a8003a30 2024-09-17T03:43:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6c2e9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe6bc0cf2f0 con 0x7fe6bc0c8d30 2024-09-17T03:43:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6bbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc154880 0x7fe6bc0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6bbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc154880 0x7fe6bc0c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51250/0 (socket says 172.21.15.146:51250) 2024-09-17T03:43:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6bbfff640 1 -- 172.21.15.146:0/1287875956 learned_addr learned my addr 172.21.15.146:0/1287875956 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6c0c37640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6a8003a30 0x7fe6bc0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6c1438640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6bc0c8d30 0x7fe6bc1f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6bbfff640 1 -- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6bc0c8d30 msgr2=0x7fe6bc1f6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6bbfff640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6bc0c8d30 0x7fe6bc1f6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6bbfff640 1 -- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6a8003a30 msgr2=0x7fe6bc0c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.378+0000 7fe6bbfff640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6a8003a30 0x7fe6bc0c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.379+0000 7fe6bbfff640 1 -- 172.21.15.146:0/1287875956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc0c9140 con 0x7fe6bc154880 2024-09-17T03:43:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.379+0000 7fe6bbfff640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc154880 0x7fe6bc0c87f0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4004e90 tx=0x7fe6a4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.379+0000 7fe6b97fa640 1 -- 172.21.15.146:0/1287875956 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4015020 con 0x7fe6bc154880 2024-09-17T03:43:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.379+0000 7fe6b97fa640 1 -- 172.21.15.146:0/1287875956 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6a4011960 con 0x7fe6bc154880 2024-09-17T03:43:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.379+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/1287875956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc0c9b70 con 0x7fe6bc154880 2024-09-17T03:43:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.379+0000 7fe6b97fa640 1 -- 172.21.15.146:0/1287875956 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4011d70 con 0x7fe6bc154880 2024-09-17T03:43:10.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.379+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/1287875956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc0ca080 con 0x7fe6bc154880 2024-09-17T03:43:10.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.381+0000 7fe6b97fa640 1 -- 172.21.15.146:0/1287875956 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe6a4018020 con 0x7fe6bc154880 2024-09-17T03:43:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.381+0000 7fe6b97fa640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe69c078bc0 0x7fe69c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.381+0000 7fe6b97fa640 1 -- 172.21.15.146:0/1287875956 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fe6a409b8e0 con 0x7fe6bc154880 2024-09-17T03:43:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.381+0000 7fe6c0c37640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe69c078bc0 0x7fe69c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.382+0000 7fe6c0c37640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe69c078bc0 0x7fe69c07b0d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac035000 tx=0x7fe6ac02d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.382+0000 7fe6c9e0d740 1 Processor -- start 2024-09-17T03:43:10.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.382+0000 7fe6c9e0d740 1 -- start start 2024-09-17T03:43:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.383+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba865c730 0x558ba8a4bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.383+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba8633870 0x558ba8a2eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.383+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a2f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.383+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558ba8976c40 con 0x558ba863ba50 2024-09-17T03:43:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.383+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558ba8966070 con 0x558ba865c730 2024-09-17T03:43:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.383+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x558ba8969e80 con 0x558ba8633870 2024-09-17T03:43:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6c1438640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a2f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6c1438640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a2f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51258/0 (socket says 172.21.15.146:51258) 2024-09-17T03:43:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6c1438640 1 -- 172.21.15.146:0/535981155 learned_addr learned my addr 172.21.15.146:0/535981155 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6c0c37640 1 --2- 172.21.15.146:0/535981155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba865c730 0x558ba8a4bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6bbfff640 1 --2- 172.21.15.146:0/535981155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba8633870 0x558ba8a2eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6c1438640 1 -- 172.21.15.146:0/535981155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba8633870 msgr2=0x558ba8a2eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6c1438640 1 --2- 172.21.15.146:0/535981155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba8633870 0x558ba8a2eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6c1438640 1 -- 172.21.15.146:0/535981155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba865c730 msgr2=0x558ba8a4bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6c1438640 1 --2- 172.21.15.146:0/535981155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba865c730 0x558ba8a4bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6c1438640 1 -- 172.21.15.146:0/535981155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba8740ba0 con 0x558ba863ba50 2024-09-17T03:43:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6c1438640 1 --2- 172.21.15.146:0/535981155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a2f000 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4002230 tx=0x7fe6b4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67243490575e93aa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6b27fc640 1 -- 172.21.15.146:0/535981155 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4006790 con 0x558ba863ba50 2024-09-17T03:43:10.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6b27fc640 1 -- 172.21.15.146:0/535981155 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6b4011460 con 0x558ba863ba50 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.384+0000 7fe6b27fc640 1 -- 172.21.15.146:0/535981155 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4011850 con 0x558ba863ba50 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.385+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/535981155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 msgr2=0x558ba8a2f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.385+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/535981155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a2f000 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4002230 tx=0x7fe6b4003d40 comp rx=0 tx=0).stop 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.385+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/535981155 shutdown_connections 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.385+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/535981155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a2f000 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.385+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/535981155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba8633870 0x558ba8a2eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.385+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/535981155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba865c730 0x558ba8a4bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.385+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/535981155 >> 172.21.15.146:0/535981155 conn(0x558ba8650880 msgr2=0x558ba8a04ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.385+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/535981155 shutdown_connections 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.385+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/535981155 wait complete. 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.386+0000 7fe6c9e0d740 1 -- start start 2024-09-17T03:43:10.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.386+0000 7fe6c9e0d740 1 Processor -- start 2024-09-17T03:43:10.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.387+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba8633870 0x558ba8a48ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.387+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba863ba50 0x558ba8a04170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.387+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba865c730 0x558ba8a046b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.387+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558ba86d6ae0 con 0x558ba8633870 2024-09-17T03:43:10.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.387+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558ba88ec870 con 0x558ba863ba50 2024-09-17T03:43:10.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.387+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x558ba8a48290 con 0x558ba865c730 2024-09-17T03:43:10.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.387+0000 7fe6c9e0d740 10 client.0 _ll_register_callbacks cb 0x558ba891a2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:43:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c0c37640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba8633870 0x558ba8a48ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c0c37640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba8633870 0x558ba8a48ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51270/0 (socket says 172.21.15.146:51270) 2024-09-17T03:43:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c0c37640 1 -- 172.21.15.146:0/123974773 learned_addr learned my addr 172.21.15.146:0/123974773 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6bbfff640 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba863ba50 0x558ba8a04170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c1438640 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba865c730 0x558ba8a046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c0c37640 1 -- 172.21.15.146:0/123974773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba865c730 msgr2=0x558ba8a046b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c0c37640 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba865c730 0x558ba8a046b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c0c37640 1 -- 172.21.15.146:0/123974773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba863ba50 msgr2=0x558ba8a04170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c0c37640 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba863ba50 0x558ba8a04170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c0c37640 1 -- 172.21.15.146:0/123974773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba86a5a40 con 0x558ba8633870 2024-09-17T03:43:10.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c0c37640 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba8633870 0x558ba8a48ba0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009c70 tx=0x7fe6ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bb96b6145c7bad server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe69b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:43:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe69b7fe640 1 -- 172.21.15.146:0/123974773 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac04f030 con 0x558ba8633870 2024-09-17T03:43:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe69b7fe640 1 -- 172.21.15.146:0/123974773 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fe6ac03ec10 con 0x558ba8633870 2024-09-17T03:43:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/123974773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6b4011460 con 0x558ba8633870 2024-09-17T03:43:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe69b7fe640 1 -- 172.21.15.146:0/123974773 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7fe6ac058050 con 0x558ba8633870 2024-09-17T03:43:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c9e0d740 10 client.9957 fetch_fsmap learned FSMap version 113 2024-09-17T03:43:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.388+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/123974773 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x558ba87a1330 con 0x558ba8633870 2024-09-17T03:43:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.389+0000 7fe69b7fe640 1 -- 172.21.15.146:0/123974773 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6b4011460 con 0x558ba8633870 2024-09-17T03:43:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.389+0000 7fe69b7fe640 1 -- 172.21.15.146:0/123974773 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7fe6ac05b020 con 0x558ba8633870 2024-09-17T03:43:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.389+0000 7fe6c9e0d740 10 client.9957 fetch_fsmap finished waiting for FSMap version 113 2024-09-17T03:43:10.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.389+0000 7fe6c9e0d740 10 client.9957 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T03:43:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.389+0000 7fe6c9e0d740 20 client.9957 populate_metadata read hostname 'smithi146' 2024-09-17T03:43:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.389+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x558ba861b300 0x558ba8a59ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.389+0000 7fe6c9e0d740 4 client.9957 mds_command: new command op to 9783 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:43:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.389+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/123974773 --> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ba8978b90 con 0x558ba861b300 2024-09-17T03:43:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.389+0000 7fe6bbfff640 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x558ba861b300 0x558ba8a59ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.389+0000 7fe69b7fe640 10 client.9957 ms_handle_connect on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.389+0000 7fe6bbfff640 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x558ba861b300 0x558ba8a59ae0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6730cce7cd31db6 server_cookie=a4cfd6ad7ef18ce6 in_seq=0 out_seq=0 2024-09-17T03:43:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe69b7fe640 1 -- 172.21.15.146:0/123974773 <== mds.0 v2:172.21.15.146:6833/2786424389 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ba8978b90 con 0x558ba861b300 2024-09-17T03:43:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe69b7fe640 10 client.9957 handle_command_reply: tid=0 2024-09-17T03:43:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe6c9e0d740 1 client.9957 shutdown 2024-09-17T03:43:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/123974773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba8633870 msgr2=0x558ba8a48ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba8633870 0x558ba8a48ba0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009c70 tx=0x7fe6ac0046c0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/123974773 shutdown_connections 2024-09-17T03:43:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x558ba861b300 0x558ba8a59ae0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba865c730 0x558ba8a046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe69b7fe640 0 client.9957 ms_handle_reset on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba863ba50 0x558ba8a04170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/123974773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba8633870 0x558ba8a48ba0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/123974773 >> 172.21.15.146:0/123974773 conn(0x558ba8650880 msgr2=0x558ba8a2ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/123974773 shutdown_connections 2024-09-17T03:43:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.390+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/123974773 wait complete. 2024-09-17T03:43:10.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.391+0000 7fe6c9e0d740 20 client.9957 trim_cache size 0 max 16384 2024-09-17T03:43:10.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.409+0000 7fe6c9e0d740 1 Processor -- start 2024-09-17T03:43:10.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.409+0000 7fe6c9e0d740 1 -- start start 2024-09-17T03:43:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba861b300 0x558ba89ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba8633870 0x558ba8a6ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a6cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc200480 con 0x558ba863ba50 2024-09-17T03:43:10.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1ff4c0 con 0x558ba8633870 2024-09-17T03:43:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe6bc0c7240 con 0x558ba861b300 2024-09-17T03:43:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c1438640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a6cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c1438640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a6cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51276/0 (socket says 172.21.15.146:51276) 2024-09-17T03:43:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c1438640 1 -- 172.21.15.146:0/2067256398 learned_addr learned my addr 172.21.15.146:0/2067256398 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c0c37640 1 --2- 172.21.15.146:0/2067256398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba861b300 0x558ba89ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6bbfff640 1 --2- 172.21.15.146:0/2067256398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba8633870 0x558ba8a6ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c1438640 1 -- 172.21.15.146:0/2067256398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba861b300 msgr2=0x558ba89ff5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c1438640 1 --2- 172.21.15.146:0/2067256398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba861b300 0x558ba89ff5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c1438640 1 -- 172.21.15.146:0/2067256398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba8633870 msgr2=0x558ba8a6ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c1438640 1 --2- 172.21.15.146:0/2067256398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba8633870 0x558ba8a6ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c1438640 1 -- 172.21.15.146:0/2067256398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba873eea0 con 0x558ba863ba50 2024-09-17T03:43:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.410+0000 7fe6c1438640 1 --2- 172.21.15.146:0/2067256398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a6cfa0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4004000 tx=0x7fe6b4001d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6c87e156eb0cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.411+0000 7fe6b1ffb640 1 -- 172.21.15.146:0/2067256398 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4006790 con 0x558ba863ba50 2024-09-17T03:43:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.411+0000 7fe6b1ffb640 1 -- 172.21.15.146:0/2067256398 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6b4012440 con 0x558ba863ba50 2024-09-17T03:43:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.411+0000 7fe6b1ffb640 1 -- 172.21.15.146:0/2067256398 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4012870 con 0x558ba863ba50 2024-09-17T03:43:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.411+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2067256398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 msgr2=0x558ba8a6cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.411+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/2067256398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a6cfa0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4004000 tx=0x7fe6b4001d70 comp rx=0 tx=0).stop 2024-09-17T03:43:10.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.411+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2067256398 shutdown_connections 2024-09-17T03:43:10.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.411+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/2067256398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba863ba50 0x558ba8a6cfa0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.411+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/2067256398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba8633870 0x558ba8a6ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.411+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/2067256398 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba861b300 0x558ba89ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.411+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2067256398 >> 172.21.15.146:0/2067256398 conn(0x558ba8650880 msgr2=0x558ba8a42ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.411+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2067256398 shutdown_connections 2024-09-17T03:43:10.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.412+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2067256398 wait complete. 2024-09-17T03:43:10.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.412+0000 7fe6c9e0d740 1 -- start start 2024-09-17T03:43:10.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.413+0000 7fe6c9e0d740 1 Processor -- start 2024-09-17T03:43:10.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba861b300 0x558ba8a03150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba8633870 0x558ba8ab2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c9e0d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba863ba50 0x558ba8a41810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558ba8a06180 con 0x558ba861b300 2024-09-17T03:43:10.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1ff030 con 0x558ba8633870 2024-09-17T03:43:10.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c9e0d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x558ba8ac96e0 con 0x558ba863ba50 2024-09-17T03:43:10.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c9e0d740 10 client.0 _ll_register_callbacks cb 0x7fe6ac036070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:43:10.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c0c37640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba861b300 0x558ba8a03150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c0c37640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba861b300 0x558ba8a03150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51290/0 (socket says 172.21.15.146:51290) 2024-09-17T03:43:10.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c0c37640 1 -- 172.21.15.146:0/2122762599 learned_addr learned my addr 172.21.15.146:0/2122762599 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c1438640 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba863ba50 0x558ba8a41810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6bbfff640 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba8633870 0x558ba8ab2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c0c37640 1 -- 172.21.15.146:0/2122762599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba863ba50 msgr2=0x558ba8a41810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c0c37640 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba863ba50 0x558ba8a41810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c0c37640 1 -- 172.21.15.146:0/2122762599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba8633870 msgr2=0x558ba8ab2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c0c37640 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba8633870 0x558ba8ab2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c0c37640 1 -- 172.21.15.146:0/2122762599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba8a4d850 con 0x558ba861b300 2024-09-17T03:43:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe6c0c37640 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba861b300 0x558ba8a03150 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009c70 tx=0x7fe6ac003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68927133aa43c6e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.414+0000 7fe69b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:43:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe69b7fe640 1 -- 172.21.15.146:0/2122762599 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac04f070 con 0x558ba861b300 2024-09-17T03:43:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe69b7fe640 1 -- 172.21.15.146:0/2122762599 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fe6ac003d70 con 0x558ba861b300 2024-09-17T03:43:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2122762599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6b4012440 con 0x558ba861b300 2024-09-17T03:43:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe69b7fe640 1 -- 172.21.15.146:0/2122762599 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7fe6ac066050 con 0x558ba861b300 2024-09-17T03:43:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe6c9e0d740 10 client.9963 fetch_fsmap learned FSMap version 113 2024-09-17T03:43:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2122762599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x558ba8a4cd00 con 0x558ba861b300 2024-09-17T03:43:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe69b7fe640 1 -- 172.21.15.146:0/2122762599 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6b4012440 con 0x558ba861b300 2024-09-17T03:43:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe69b7fe640 1 -- 172.21.15.146:0/2122762599 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7fe6ac069020 con 0x558ba861b300 2024-09-17T03:43:10.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe6c9e0d740 10 client.9963 fetch_fsmap finished waiting for FSMap version 113 2024-09-17T03:43:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe6c9e0d740 10 client.9963 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T03:43:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe6c9e0d740 20 client.9963 populate_metadata read hostname 'smithi146' 2024-09-17T03:43:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x558ba85f0740 0x558ba8a41d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe6c9e0d740 4 client.9963 mds_command: new command op to 9783 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-17T03:43:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2122762599 --> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x558ba8974640 con 0x558ba85f0740 2024-09-17T03:43:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.415+0000 7fe6bbfff640 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x558ba85f0740 0x558ba8a41d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.416+0000 7fe69b7fe640 10 client.9963 ms_handle_connect on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.416+0000 7fe6bbfff640 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x558ba85f0740 0x558ba8a41d50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=323c0fb5c1676370 server_cookie=9dd71f2a35242f3c in_seq=0 out_seq=0 2024-09-17T03:43:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.418+0000 7fe69b7fe640 1 -- 172.21.15.146:0/2122762599 <== mds.0 v2:172.21.15.146:6833/2786424389 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558ba8974640 con 0x558ba85f0740 2024-09-17T03:43:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.418+0000 7fe69b7fe640 10 client.9963 handle_command_reply: tid=0 2024-09-17T03:43:10.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.418+0000 7fe6c9e0d740 1 client.9963 shutdown 2024-09-17T03:43:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2122762599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba861b300 msgr2=0x558ba8a03150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba861b300 0x558ba8a03150 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009c70 tx=0x7fe6ac003c50 comp rx=0 tx=0).stop 2024-09-17T03:43:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2122762599 shutdown_connections 2024-09-17T03:43:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x558ba85f0740 0x558ba8a41d50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe69b7fe640 0 client.9963 ms_handle_reset on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558ba863ba50 0x558ba8a41810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558ba8633870 0x558ba8ab2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe6c9e0d740 1 --2- 172.21.15.146:0/2122762599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558ba861b300 0x558ba8a03150 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2122762599 >> 172.21.15.146:0/2122762599 conn(0x558ba8650880 msgr2=0x558ba8a48190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2122762599 shutdown_connections 2024-09-17T03:43:10.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe6c9e0d740 1 -- 172.21.15.146:0/2122762599 wait complete. 2024-09-17T03:43:10.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.419+0000 7fe6c9e0d740 20 client.9963 trim_cache size 0 max 16384 2024-09-17T03:43:10.426 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:43:10.426 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:43:10.426 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "bd5b3cc3-a45e-4a38-a252-006634f58bf4", 2024-09-17T03:43:10.426 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:43:10.426 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:43:10.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe69c078bc0 msgr2=0x7fe69c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe69c078bc0 0x7fe69c07b0d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac035000 tx=0x7fe6ac02d040 comp rx=0 tx=0).stop 2024-09-17T03:43:10.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/1287875956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc154880 msgr2=0x7fe6bc0c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc154880 0x7fe6bc0c87f0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4004e90 tx=0x7fe6a4001630 comp rx=0 tx=0).stop 2024-09-17T03:43:10.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/1287875956 shutdown_connections 2024-09-17T03:43:10.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe69c078bc0 0x7fe69c07b0d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6bc0c8d30 0x7fe6bc1f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6bc154880 0x7fe6bc0c87f0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 --2- 172.21.15.146:0/1287875956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6a8003a30 0x7fe6bc0c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/1287875956 >> 172.21.15.146:0/1287875956 conn(0x7fe6bc09ba20 msgr2=0x7fe6bc0d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/1287875956 shutdown_connections 2024-09-17T03:43:10.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.420+0000 7fe6c2e9b640 1 -- 172.21.15.146:0/1287875956 wait complete. 2024-09-17T03:43:10.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:43:10.431 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub pause 2024-09-17T03:43:10.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.568+0000 7fcd15fa8640 1 -- 172.21.15.146:0/2476832872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1015c9f0 msgr2=0x7fcd101526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.568+0000 7fcd15fa8640 1 --2- 172.21.15.146:0/2476832872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1015c9f0 0x7fcd101526a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcd00009830 tx=0x7fcd0002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.569+0000 7fcd15fa8640 1 -- 172.21.15.146:0/2476832872 shutdown_connections 2024-09-17T03:43:10.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.569+0000 7fcd15fa8640 1 --2- 172.21.15.146:0/2476832872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1015c9f0 0x7fcd101526a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.569+0000 7fcd15fa8640 1 -- 172.21.15.146:0/2476832872 >> 172.21.15.146:0/2476832872 conn(0x7fcd1006d3c0 msgr2=0x7fcd100b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.569+0000 7fcd15fa8640 1 -- 172.21.15.146:0/2476832872 shutdown_connections 2024-09-17T03:43:10.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.569+0000 7fcd15fa8640 1 -- 172.21.15.146:0/2476832872 wait complete. 2024-09-17T03:43:10.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.571+0000 7fcd15fa8640 1 Processor -- start 2024-09-17T03:43:10.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.571+0000 7fcd15fa8640 1 -- start start 2024-09-17T03:43:10.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd15fa8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100b4100 0x7fcd100b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd15fa8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd10154fd0 0x7fcd100b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd15fa8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1014eee0 0x7fcd10154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd15fa8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd100d05b0 con 0x7fcd10154fd0 2024-09-17T03:43:10.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd15fa8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd100b4720 con 0x7fcd1014eee0 2024-09-17T03:43:10.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd15fa8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcd100d0730 con 0x7fcd100b4100 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd10154fd0 0x7fcd100b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0f7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100b4100 0x7fcd100b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1014eee0 0x7fcd10154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd10154fd0 0x7fcd100b29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51306/0 (socket says 172.21.15.146:51306) 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0effd640 1 -- 172.21.15.146:0/4159095279 learned_addr learned my addr 172.21.15.146:0/4159095279 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0effd640 1 -- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100b4100 msgr2=0x7fcd100b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0effd640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100b4100 0x7fcd100b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0effd640 1 -- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1014eee0 msgr2=0x7fcd10154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0effd640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1014eee0 0x7fcd10154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0effd640 1 -- 172.21.15.146:0/4159095279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd101f5260 con 0x7fcd10154fd0 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0ffff640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1014eee0 0x7fcd10154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.573+0000 7fcd0f7fe640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100b4100 0x7fcd100b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:43:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.574+0000 7fcd0effd640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd10154fd0 0x7fcd100b29b0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400c410 tx=0x7fcd0400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.574+0000 7fccf7fff640 1 -- 172.21.15.146:0/4159095279 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04011790 con 0x7fcd10154fd0 2024-09-17T03:43:10.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.574+0000 7fcd15fa8640 1 -- 172.21.15.146:0/4159095279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd101f5760 con 0x7fcd10154fd0 2024-09-17T03:43:10.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.574+0000 7fcd15fa8640 1 -- 172.21.15.146:0/4159095279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd101f5d20 con 0x7fcd10154fd0 2024-09-17T03:43:10.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.574+0000 7fccf7fff640 1 -- 172.21.15.146:0/4159095279 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd04017070 con 0x7fcd10154fd0 2024-09-17T03:43:10.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.574+0000 7fccf7fff640 1 -- 172.21.15.146:0/4159095279 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04011cc0 con 0x7fcd10154fd0 2024-09-17T03:43:10.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.576+0000 7fccf7fff640 1 -- 172.21.15.146:0/4159095279 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd0401c460 con 0x7fcd10154fd0 2024-09-17T03:43:10.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.577+0000 7fccf7fff640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fccfc07cfb0 0x7fccfc07f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.577+0000 7fccf7fff640 1 -- 172.21.15.146:0/4159095279 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fcd0409a7c0 con 0x7fcd10154fd0 2024-09-17T03:43:10.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.577+0000 7fcd0f7fe640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fccfc07cfb0 0x7fccfc07f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.577+0000 7fcd0f7fe640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fccfc07cfb0 0x7fccfc07f4c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fcd00034000 tx=0x7fcd00004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.578+0000 7fcd1cfee740 1 Processor -- start 2024-09-17T03:43:10.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.578+0000 7fcd1cfee740 1 -- start start 2024-09-17T03:43:10.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.579+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b69f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.579+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 0x563d5b681fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.579+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b28f6b0 0x563d5b682520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.579+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563d5b5cabd0 con 0x563d5b2b0390 2024-09-17T03:43:10.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.579+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563d5b5ba000 con 0x563d5b28f6b0 2024-09-17T03:43:10.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.579+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x563d5b5bde10 con 0x563d5b2874d0 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.579+0000 7fcd0f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b69f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.579+0000 7fcd0f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b69f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51308/0 (socket says 172.21.15.146:51308) 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.579+0000 7fcd0f7fe640 1 -- 172.21.15.146:0/1560480751 learned_addr learned my addr 172.21.15.146:0/1560480751 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.579+0000 7fcd0effd640 1 --2- 172.21.15.146:0/1560480751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 0x563d5b681fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.579+0000 7fcd0ffff640 1 --2- 172.21.15.146:0/1560480751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b28f6b0 0x563d5b682520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.580+0000 7fcd0effd640 1 -- 172.21.15.146:0/1560480751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b28f6b0 msgr2=0x563d5b682520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.580+0000 7fcd0effd640 1 --2- 172.21.15.146:0/1560480751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b28f6b0 0x563d5b682520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.580+0000 7fcd0effd640 1 -- 172.21.15.146:0/1560480751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 msgr2=0x563d5b69f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.580+0000 7fcd0effd640 1 --2- 172.21.15.146:0/1560480751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b69f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.580+0000 7fcd0effd640 1 -- 172.21.15.146:0/1560480751 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d5b3927d0 con 0x563d5b2874d0 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.580+0000 7fcd0f7fe640 1 --2- 172.21.15.146:0/1560480751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b69f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.580+0000 7fcd0effd640 1 --2- 172.21.15.146:0/1560480751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 0x563d5b681fe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcd04098cc0 tx=0x7fcd04062210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=477601260ab416e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.580+0000 7fccf57fa640 1 -- 172.21.15.146:0/1560480751 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0406bf60 con 0x563d5b2874d0 2024-09-17T03:43:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.580+0000 7fccf57fa640 1 -- 172.21.15.146:0/1560480751 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd0406bad0 con 0x563d5b2874d0 2024-09-17T03:43:10.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.580+0000 7fccf57fa640 1 -- 172.21.15.146:0/1560480751 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04069360 con 0x563d5b2874d0 2024-09-17T03:43:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.581+0000 7fcd1cfee740 1 -- 172.21.15.146:0/1560480751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 msgr2=0x563d5b681fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.581+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/1560480751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 0x563d5b681fe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcd04098cc0 tx=0x7fcd04062210 comp rx=0 tx=0).stop 2024-09-17T03:43:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.581+0000 7fcd1cfee740 1 -- 172.21.15.146:0/1560480751 shutdown_connections 2024-09-17T03:43:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.581+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/1560480751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b28f6b0 0x563d5b682520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.581+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/1560480751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 0x563d5b681fe0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.581+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/1560480751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b69f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.581+0000 7fcd1cfee740 1 -- 172.21.15.146:0/1560480751 >> 172.21.15.146:0/1560480751 conn(0x563d5b2a44e0 msgr2=0x563d5b658200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.581+0000 7fcd1cfee740 1 -- 172.21.15.146:0/1560480751 shutdown_connections 2024-09-17T03:43:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.581+0000 7fcd1cfee740 1 -- 172.21.15.146:0/1560480751 wait complete. 2024-09-17T03:43:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.582+0000 7fcd1cfee740 1 -- start start 2024-09-17T03:43:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.582+0000 7fcd1cfee740 1 Processor -- start 2024-09-17T03:43:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.584+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 0x563d5b66f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.584+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b28f6b0 0x563d5b695820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.584+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b6987f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.584+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563d5b32a740 con 0x563d5b2b0390 2024-09-17T03:43:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.584+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563d5b55f540 con 0x563d5b2874d0 2024-09-17T03:43:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.584+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x563d5b66ff00 con 0x563d5b28f6b0 2024-09-17T03:43:10.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.584+0000 7fcd1cfee740 10 client.0 _ll_register_callbacks cb 0x563d5b55e0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd0f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 0x563d5b66f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b6987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd0effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b28f6b0 0x563d5b695820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd0f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 0x563d5b66f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:40262/0 (socket says 172.21.15.146:40262) 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd0f7fe640 1 -- 172.21.15.146:0/653742530 learned_addr learned my addr 172.21.15.146:0/653742530 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd0ffff640 1 -- 172.21.15.146:0/653742530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b28f6b0 msgr2=0x563d5b695820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd0ffff640 1 --2- 172.21.15.146:0/653742530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b28f6b0 0x563d5b695820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd0ffff640 1 -- 172.21.15.146:0/653742530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 msgr2=0x563d5b66f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd0ffff640 1 --2- 172.21.15.146:0/653742530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 0x563d5b66f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd0ffff640 1 -- 172.21.15.146:0/653742530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d5b2f96a0 con 0x563d5b2b0390 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd0ffff640 1 --2- 172.21.15.146:0/653742530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b6987f0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x563d5b67a2e0 tx=0x7fcd08012e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596a552e4254cd42 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fccee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fccee7fc640 1 -- 172.21.15.146:0/653742530 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08019020 con 0x563d5b2b0390 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fccee7fc640 1 -- 172.21.15.146:0/653742530 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fcd08003c40 con 0x563d5b2b0390 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.585+0000 7fcd1cfee740 1 -- 172.21.15.146:0/653742530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd0406bad0 con 0x563d5b2b0390 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fccee7fc640 1 -- 172.21.15.146:0/653742530 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7fcd08023050 con 0x563d5b2b0390 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fcd1cfee740 10 client.9975 fetch_fsmap learned FSMap version 113 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fcd1cfee740 1 -- 172.21.15.146:0/653742530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x563d5b3f2f60 con 0x563d5b2b0390 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fccee7fc640 1 -- 172.21.15.146:0/653742530 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd0406bad0 con 0x563d5b2b0390 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fccee7fc640 1 -- 172.21.15.146:0/653742530 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7fcd08026020 con 0x563d5b2b0390 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fcd1cfee740 10 client.9975 fetch_fsmap finished waiting for FSMap version 113 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fcd1cfee740 10 client.9975 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fcd1cfee740 20 client.9975 populate_metadata read hostname 'smithi146' 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/653742530 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x563d5b26ef60 0x563d5b697690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fcd1cfee740 4 client.9975 mds_command: new command op to 9783 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:43:10.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fcd1cfee740 1 -- 172.21.15.146:0/653742530 --> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d5b5ccb20 con 0x563d5b26ef60 2024-09-17T03:43:10.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.586+0000 7fcd0f7fe640 1 --2- 172.21.15.146:0/653742530 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x563d5b26ef60 0x563d5b697690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.587+0000 7fcd0f7fe640 1 --2- 172.21.15.146:0/653742530 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x563d5b26ef60 0x563d5b697690 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22fbd349f9ea9893 server_cookie=fffa277a0086f19e in_seq=0 out_seq=0 2024-09-17T03:43:10.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.587+0000 7fccee7fc640 10 client.9975 ms_handle_connect on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fccee7fc640 1 -- 172.21.15.146:0/653742530 <== mds.0 v2:172.21.15.146:6833/2786424389 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d5b5ccb20 con 0x563d5b26ef60 2024-09-17T03:43:10.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fccee7fc640 10 client.9975 handle_command_reply: tid=0 2024-09-17T03:43:10.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fcd1cfee740 1 client.9975 shutdown 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fcd1cfee740 1 -- 172.21.15.146:0/653742530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 msgr2=0x563d5b6987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/653742530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b6987f0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x563d5b67a2e0 tx=0x7fcd08012e10 comp rx=0 tx=0).stop 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fcd1cfee740 1 -- 172.21.15.146:0/653742530 shutdown_connections 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/653742530 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x563d5b26ef60 0x563d5b697690 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/653742530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b6987f0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/653742530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b28f6b0 0x563d5b695820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/653742530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 0x563d5b66f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fcd1cfee740 1 -- 172.21.15.146:0/653742530 >> 172.21.15.146:0/653742530 conn(0x563d5b2a44e0 msgr2=0x563d5b6515b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fccee7fc640 0 client.9975 ms_handle_reset on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fcd1cfee740 1 -- 172.21.15.146:0/653742530 shutdown_connections 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.590+0000 7fcd1cfee740 1 -- 172.21.15.146:0/653742530 wait complete. 2024-09-17T03:43:10.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.591+0000 7fcd1cfee740 20 client.9975 trim_cache size 0 max 16384 2024-09-17T03:43:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.609+0000 7fcd1cfee740 1 Processor -- start 2024-09-17T03:43:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.609+0000 7fcd1cfee740 1 -- start start 2024-09-17T03:43:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.610+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 0x563d5b6c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b28f6b0 0x563d5b696180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b716d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101fdcf0 con 0x563d5b2b0390 2024-09-17T03:43:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1006f200 con 0x563d5b2874d0 2024-09-17T03:43:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcd10156ed0 con 0x563d5b28f6b0 2024-09-17T03:43:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b716d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0f7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 0x563d5b6c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b716d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51328/0 (socket says 172.21.15.146:51328) 2024-09-17T03:43:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0ffff640 1 -- 172.21.15.146:0/2652613819 learned_addr learned my addr 172.21.15.146:0/2652613819 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0effd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b28f6b0 0x563d5b696180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0f7fe640 1 -- 172.21.15.146:0/2652613819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b28f6b0 msgr2=0x563d5b696180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0f7fe640 1 --2- 172.21.15.146:0/2652613819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b28f6b0 0x563d5b696180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0f7fe640 1 -- 172.21.15.146:0/2652613819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 msgr2=0x563d5b716d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0f7fe640 1 --2- 172.21.15.146:0/2652613819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b716d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0f7fe640 1 -- 172.21.15.146:0/2652613819 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d5b390ad0 con 0x563d5b2874d0 2024-09-17T03:43:10.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0ffff640 1 --2- 172.21.15.146:0/2652613819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b716d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:43:10.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.611+0000 7fcd0f7fe640 1 --2- 172.21.15.146:0/2652613819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 0x563d5b6c02c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x563d5b695f60 tx=0x7fcd0003e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c2012a10acf2aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.612+0000 7fccf4ff9640 1 -- 172.21.15.146:0/2652613819 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00005020 con 0x563d5b2874d0 2024-09-17T03:43:10.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.612+0000 7fccf4ff9640 1 -- 172.21.15.146:0/2652613819 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd000051e0 con 0x563d5b2874d0 2024-09-17T03:43:10.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.612+0000 7fccf4ff9640 1 -- 172.21.15.146:0/2652613819 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00005630 con 0x563d5b2874d0 2024-09-17T03:43:10.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.612+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2652613819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 msgr2=0x563d5b6c02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.612+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/2652613819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 0x563d5b6c02c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x563d5b695f60 tx=0x7fcd0003e040 comp rx=0 tx=0).stop 2024-09-17T03:43:10.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.613+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2652613819 shutdown_connections 2024-09-17T03:43:10.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.613+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/2652613819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b716d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.613+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/2652613819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b28f6b0 0x563d5b696180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.613+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/2652613819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b2874d0 0x563d5b6c02c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.613+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2652613819 >> 172.21.15.146:0/2652613819 conn(0x563d5b2a44e0 msgr2=0x563d5b6534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.613+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2652613819 shutdown_connections 2024-09-17T03:43:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.613+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2652613819 wait complete. 2024-09-17T03:43:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.614+0000 7fcd1cfee740 1 -- start start 2024-09-17T03:43:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.614+0000 7fcd1cfee740 1 Processor -- start 2024-09-17T03:43:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.615+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 0x563d5b6be9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.615+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b28f6b0 0x563d5b71c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.615+0000 7fcd1cfee740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b7050e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.615+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1006ebb0 con 0x563d5b2b0390 2024-09-17T03:43:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.615+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563d5b653bf0 con 0x563d5b28f6b0 2024-09-17T03:43:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.615+0000 7fcd1cfee740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x563d5b6bf2b0 con 0x563d5b2874d0 2024-09-17T03:43:10.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.615+0000 7fcd1cfee740 10 client.0 _ll_register_callbacks cb 0x7fcd08001db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:43:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.615+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b7050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0f7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 0x563d5b6be9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b28f6b0 0x563d5b71c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b7050e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51340/0 (socket says 172.21.15.146:51340) 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0ffff640 1 -- 172.21.15.146:0/2882076104 learned_addr learned my addr 172.21.15.146:0/2882076104 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0f7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 0x563d5b6be9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:37678/0 (socket says 172.21.15.146:37678) 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0effd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b28f6b0 0x563d5b71c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:40282/0 (socket says 172.21.15.146:40282) 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0ffff640 1 -- 172.21.15.146:0/2882076104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 msgr2=0x563d5b6be9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0ffff640 1 --2- 172.21.15.146:0/2882076104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 0x563d5b6be9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0ffff640 1 -- 172.21.15.146:0/2882076104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b28f6b0 msgr2=0x563d5b71c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0ffff640 1 --2- 172.21.15.146:0/2882076104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b28f6b0 0x563d5b71c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0ffff640 1 -- 172.21.15.146:0/2882076104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d5b651b10 con 0x563d5b2b0390 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd0ffff640 1 --2- 172.21.15.146:0/2882076104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b7050e0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fcd08010e10 tx=0x7fcd080017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13f05493bef8adf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fccee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fccee7fc640 1 -- 172.21.15.146:0/2882076104 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08019040 con 0x563d5b2b0390 2024-09-17T03:43:10.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fccee7fc640 1 -- 172.21.15.146:0/2882076104 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fcd080052e0 con 0x563d5b2b0390 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.616+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2882076104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd000051e0 con 0x563d5b2b0390 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fccee7fc640 1 -- 172.21.15.146:0/2882076104 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7fcd08037050 con 0x563d5b2b0390 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fcd1cfee740 10 client.9981 fetch_fsmap learned FSMap version 113 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2882076104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x563d5b6988a0 con 0x563d5b2b0390 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fccee7fc640 1 -- 172.21.15.146:0/2882076104 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd000051e0 con 0x563d5b2b0390 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fccee7fc640 1 -- 172.21.15.146:0/2882076104 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7fcd0803a020 con 0x563d5b2b0390 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fcd1cfee740 10 client.9981 fetch_fsmap finished waiting for FSMap version 113 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fcd1cfee740 10 client.9981 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fcd1cfee740 20 client.9981 populate_metadata read hostname 'smithi146' 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/2882076104 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x563d5b71ceb0 0x563d5b705620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fcd1cfee740 4 client.9981 mds_command: new command op to 9783 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2882076104 --> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x563d5b5c85d0 con 0x563d5b71ceb0 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fcd0f7fe640 1 --2- 172.21.15.146:0/2882076104 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x563d5b71ceb0 0x563d5b705620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.617+0000 7fccee7fc640 10 client.9981 ms_handle_connect on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.618+0000 7fcd0f7fe640 1 --2- 172.21.15.146:0/2882076104 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x563d5b71ceb0 0x563d5b705620 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20eb50626e280764 server_cookie=4b806a6d89962032 in_seq=0 out_seq=0 2024-09-17T03:43:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fccee7fc640 1 -- 172.21.15.146:0/2882076104 <== mds.0 v2:172.21.15.146:6833/2786424389 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563d5b5c85d0 con 0x563d5b71ceb0 2024-09-17T03:43:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fccee7fc640 10 client.9981 handle_command_reply: tid=0 2024-09-17T03:43:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fcd1cfee740 1 client.9981 shutdown 2024-09-17T03:43:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2882076104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 msgr2=0x563d5b7050e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/2882076104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b7050e0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fcd08010e10 tx=0x7fcd080017e0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2882076104 shutdown_connections 2024-09-17T03:43:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/2882076104 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x563d5b71ceb0 0x563d5b705620 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fccee7fc640 0 client.9981 ms_handle_reset on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/2882076104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563d5b2b0390 0x563d5b7050e0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/2882076104 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563d5b28f6b0 0x563d5b71c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fcd1cfee740 1 --2- 172.21.15.146:0/2882076104 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563d5b2874d0 0x563d5b6be9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2882076104 >> 172.21.15.146:0/2882076104 conn(0x563d5b2a44e0 msgr2=0x563d5b658ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.632+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2882076104 shutdown_connections 2024-09-17T03:43:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd1cfee740 1 -- 172.21.15.146:0/2882076104 wait complete. 2024-09-17T03:43:10.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd1cfee740 20 client.9981 trim_cache size 0 max 16384 2024-09-17T03:43:10.633 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:43:10.633 INFO:teuthology.orchestra.run.smithi146.stdout: "message": "", 2024-09-17T03:43:10.633 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2024-09-17T03:43:10.634 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:43:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd15fa8640 1 -- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fccfc07cfb0 msgr2=0x7fccfc07f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd15fa8640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fccfc07cfb0 0x7fccfc07f4c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fcd00034000 tx=0x7fcd00004730 comp rx=0 tx=0).stop 2024-09-17T03:43:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd15fa8640 1 -- 172.21.15.146:0/4159095279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd10154fd0 msgr2=0x7fcd100b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd15fa8640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd10154fd0 0x7fcd100b29b0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400c410 tx=0x7fcd0400c8d0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd15fa8640 1 -- 172.21.15.146:0/4159095279 shutdown_connections 2024-09-17T03:43:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd15fa8640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fccfc07cfb0 0x7fccfc07f4c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd15fa8640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd1014eee0 0x7fcd10154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd15fa8640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd10154fd0 0x7fcd100b29b0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd15fa8640 1 --2- 172.21.15.146:0/4159095279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd100b4100 0x7fcd100b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.633+0000 7fcd15fa8640 1 -- 172.21.15.146:0/4159095279 >> 172.21.15.146:0/4159095279 conn(0x7fcd1006d3c0 msgr2=0x7fcd100b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.634+0000 7fcd15fa8640 1 -- 172.21.15.146:0/4159095279 shutdown_connections 2024-09-17T03:43:10.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.634+0000 7fcd15fa8640 1 -- 172.21.15.146:0/4159095279 wait complete. 2024-09-17T03:43:10.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:43:10.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub status 2024-09-17T03:43:10.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.759+0000 7f1da915e640 1 -- 172.21.15.146:0/3001730966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1da415c9f0 msgr2=0x7f1da41526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.759+0000 7f1da915e640 1 --2- 172.21.15.146:0/3001730966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1da415c9f0 0x7f1da41526a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1da415d000 tx=0x7f1d9402a510 comp rx=0 tx=0).stop 2024-09-17T03:43:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.759+0000 7f1da915e640 1 -- 172.21.15.146:0/3001730966 shutdown_connections 2024-09-17T03:43:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.759+0000 7f1da915e640 1 --2- 172.21.15.146:0/3001730966 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1da40701e0 0x7f1da40cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.759+0000 7f1da915e640 1 --2- 172.21.15.146:0/3001730966 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1da415c9f0 0x7f1da41526a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.759+0000 7f1da915e640 1 -- 172.21.15.146:0/3001730966 >> 172.21.15.146:0/3001730966 conn(0x7f1da406d3c0 msgr2=0x7f1da40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.759+0000 7f1da915e640 1 -- 172.21.15.146:0/3001730966 shutdown_connections 2024-09-17T03:43:10.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.759+0000 7f1da915e640 1 -- 172.21.15.146:0/3001730966 wait complete. 2024-09-17T03:43:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.761+0000 7f1da915e640 1 Processor -- start 2024-09-17T03:43:10.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.761+0000 7f1da915e640 1 -- start start 2024-09-17T03:43:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da915e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1da40b4100 0x7f1da414d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da915e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1da4147af0 0x7f1da40b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da915e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da41e79a0 0x7f1da40b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da915e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40d0770 con 0x7f1da41e79a0 2024-09-17T03:43:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da915e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40d05f0 con 0x7f1da4147af0 2024-09-17T03:43:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da915e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1da40d08f0 con 0x7f1da40b4100 2024-09-17T03:43:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da41e79a0 0x7f1da40b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da41e79a0 0x7f1da40b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51348/0 (socket says 172.21.15.146:51348) 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da359e640 1 -- 172.21.15.146:0/2424001844 learned_addr learned my addr 172.21.15.146:0/2424001844 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da2d9d640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1da40b4100 0x7f1da414d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1d9a59c640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1da4147af0 0x7f1da40b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da359e640 1 -- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1da40b4100 msgr2=0x7f1da414d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da359e640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1da40b4100 0x7f1da414d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da359e640 1 -- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1da4147af0 msgr2=0x7f1da40b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da359e640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1da4147af0 0x7f1da40b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da359e640 1 -- 172.21.15.146:0/2424001844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da414d9b0 con 0x7f1da41e79a0 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da359e640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da41e79a0 0x7f1da40b2190 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009fd0 tx=0x7f1d9c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1d9bfff640 1 -- 172.21.15.146:0/2424001844 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c003970 con 0x7f1da41e79a0 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1d9bfff640 1 -- 172.21.15.146:0/2424001844 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d9c003c20 con 0x7f1da41e79a0 2024-09-17T03:43:10.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1da915e640 1 -- 172.21.15.146:0/2424001844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da41f6820 con 0x7f1da41e79a0 2024-09-17T03:43:10.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.763+0000 7f1d9bfff640 1 -- 172.21.15.146:0/2424001844 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c004280 con 0x7f1da41e79a0 2024-09-17T03:43:10.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.764+0000 7f1da915e640 1 -- 172.21.15.146:0/2424001844 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da41f6de0 con 0x7f1da41e79a0 2024-09-17T03:43:10.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.765+0000 7f1d9bfff640 1 -- 172.21.15.146:0/2424001844 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1d9c01d020 con 0x7f1da41e79a0 2024-09-17T03:43:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.766+0000 7f1d9bfff640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d84078b90 0x7f1d8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.766+0000 7f1d9bfff640 1 -- 172.21.15.146:0/2424001844 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f1d9c09b150 con 0x7f1da41e79a0 2024-09-17T03:43:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.766+0000 7f1da2d9d640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d84078b90 0x7f1d8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.766+0000 7f1da2d9d640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d84078b90 0x7f1d8407b0a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1d94034000 tx=0x7f1d94004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.767+0000 7f1db00ca740 1 Processor -- start 2024-09-17T03:43:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.767+0000 7f1db00ca740 1 -- start start 2024-09-17T03:43:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.768+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4f0390 0x56236e8c1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.768+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4c74d0 0x56236e8c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.768+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4cf6b0 0x56236e8deb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.768+0000 7f1db00ca740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56236e80aa60 con 0x56236e4c74d0 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.768+0000 7f1db00ca740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56236e7f9e90 con 0x56236e4cf6b0 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.768+0000 7f1db00ca740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56236e7fdca0 con 0x56236e4f0390 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.768+0000 7f1d9a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4c74d0 0x56236e8c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.768+0000 7f1d9a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4c74d0 0x56236e8c1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51354/0 (socket says 172.21.15.146:51354) 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.768+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4f0390 0x56236e8c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.768+0000 7f1d9a59c640 1 -- 172.21.15.146:0/3656539349 learned_addr learned my addr 172.21.15.146:0/3656539349 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.768+0000 7f1da359e640 1 --2- 172.21.15.146:0/3656539349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4cf6b0 0x56236e8deb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.769+0000 7f1d9a59c640 1 -- 172.21.15.146:0/3656539349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4f0390 msgr2=0x56236e8c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.769+0000 7f1d9a59c640 1 --2- 172.21.15.146:0/3656539349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4f0390 0x56236e8c1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.769+0000 7f1d9a59c640 1 -- 172.21.15.146:0/3656539349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4cf6b0 msgr2=0x56236e8deb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.769+0000 7f1d9a59c640 1 --2- 172.21.15.146:0/3656539349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4cf6b0 0x56236e8deb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.769+0000 7f1d9a59c640 1 -- 172.21.15.146:0/3656539349 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56236e5d27d0 con 0x56236e4c74d0 2024-09-17T03:43:10.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.769+0000 7f1d9a59c640 1 --2- 172.21.15.146:0/3656539349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4c74d0 0x56236e8c1c80 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c001790 tx=0x7f1d8c007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84dba56e4d276f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.769+0000 7f1d98d99640 1 -- 172.21.15.146:0/3656539349 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0052e0 con 0x56236e4c74d0 2024-09-17T03:43:10.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.769+0000 7f1d98d99640 1 -- 172.21.15.146:0/3656539349 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d8c018070 con 0x56236e4c74d0 2024-09-17T03:43:10.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.769+0000 7f1d98d99640 1 -- 172.21.15.146:0/3656539349 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00fa10 con 0x56236e4c74d0 2024-09-17T03:43:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.770+0000 7f1db00ca740 1 -- 172.21.15.146:0/3656539349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4c74d0 msgr2=0x56236e8c1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.770+0000 7f1db00ca740 1 --2- 172.21.15.146:0/3656539349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4c74d0 0x56236e8c1c80 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c001790 tx=0x7f1d8c007e30 comp rx=0 tx=0).stop 2024-09-17T03:43:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.770+0000 7f1db00ca740 1 -- 172.21.15.146:0/3656539349 shutdown_connections 2024-09-17T03:43:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.770+0000 7f1db00ca740 1 --2- 172.21.15.146:0/3656539349 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4cf6b0 0x56236e8deb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.770+0000 7f1db00ca740 1 --2- 172.21.15.146:0/3656539349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4c74d0 0x56236e8c1c80 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.770+0000 7f1db00ca740 1 --2- 172.21.15.146:0/3656539349 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4f0390 0x56236e8c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.770+0000 7f1db00ca740 1 -- 172.21.15.146:0/3656539349 >> 172.21.15.146:0/3656539349 conn(0x56236e4e44e0 msgr2=0x56236e897a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.770+0000 7f1db00ca740 1 -- 172.21.15.146:0/3656539349 shutdown_connections 2024-09-17T03:43:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.770+0000 7f1db00ca740 1 -- 172.21.15.146:0/3656539349 wait complete. 2024-09-17T03:43:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.771+0000 7f1db00ca740 1 -- start start 2024-09-17T03:43:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.771+0000 7f1db00ca740 1 Processor -- start 2024-09-17T03:43:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4c74d0 0x56236e8ef950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4cf6b0 0x56236e8a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e896920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1db00ca740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56236e56a740 con 0x56236e4f0390 2024-09-17T03:43:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1db00ca740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56236e79f970 con 0x56236e4c74d0 2024-09-17T03:43:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1db00ca740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56236e8c21c0 con 0x56236e4cf6b0 2024-09-17T03:43:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1db00ca740 10 client.0 _ll_register_callbacks cb 0x56236e7a2be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:43:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1da359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e896920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1da359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e896920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51356/0 (socket says 172.21.15.146:51356) 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4c74d0 0x56236e8ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1da359e640 1 -- 172.21.15.146:0/1402620530 learned_addr learned my addr 172.21.15.146:0/1402620530 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.772+0000 7f1d9a59c640 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4cf6b0 0x56236e8a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1da359e640 1 -- 172.21.15.146:0/1402620530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4cf6b0 msgr2=0x56236e8a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1da359e640 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4cf6b0 0x56236e8a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1da359e640 1 -- 172.21.15.146:0/1402620530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4c74d0 msgr2=0x56236e8ef950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1da359e640 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4c74d0 0x56236e8ef950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1da359e640 1 -- 172.21.15.146:0/1402620530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56236e55b970 con 0x56236e4f0390 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1d9a59c640 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4cf6b0 0x56236e8a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1da359e640 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e896920 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c062ce0 tx=0x7f1d9c062af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fddb10ba7b6a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1d81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1d81ffb640 1 -- 172.21.15.146:0/1402620530 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c06c8c0 con 0x56236e4f0390 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1d81ffb640 1 -- 172.21.15.146:0/1402620530 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f1d9c06c430 con 0x56236e4f0390 2024-09-17T03:43:10.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1db00ca740 1 -- 172.21.15.146:0/1402620530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d8c018070 con 0x56236e4f0390 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1d81ffb640 1 -- 172.21.15.146:0/1402620530 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f1d9c06c630 con 0x56236e4f0390 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1db00ca740 10 client.9990 fetch_fsmap learned FSMap version 113 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1db00ca740 1 -- 172.21.15.146:0/1402620530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x56236e5396a0 con 0x56236e4f0390 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1d81ffb640 1 -- 172.21.15.146:0/1402620530 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d8c018070 con 0x56236e4f0390 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1d81ffb640 1 -- 172.21.15.146:0/1402620530 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7f1d9c00b040 con 0x56236e4f0390 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1db00ca740 10 client.9990 fetch_fsmap finished waiting for FSMap version 113 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1db00ca740 10 client.9990 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1db00ca740 20 client.9990 populate_metadata read hostname 'smithi146' 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1db00ca740 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x56236e4aef60 0x56236e8d51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1db00ca740 4 client.9990 mds_command: new command op to 9783 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.773+0000 7f1db00ca740 1 -- 172.21.15.146:0/1402620530 --> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56236e80c9b0 con 0x56236e4aef60 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.774+0000 7f1da2d9d640 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x56236e4aef60 0x56236e8d51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.774+0000 7f1d81ffb640 10 client.9990 ms_handle_connect on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.774+0000 7f1da2d9d640 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x56236e4aef60 0x56236e8d51e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc82179a0fb1b0b7 server_cookie=e61e49dd04912f10 in_seq=0 out_seq=0 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1d81ffb640 1 -- 172.21.15.146:0/1402620530 <== mds.0 v2:172.21.15.146:6833/2786424389 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56236e80c9b0 con 0x56236e4aef60 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1d81ffb640 10 client.9990 handle_command_reply: tid=0 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 1 client.9990 shutdown 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 1 -- 172.21.15.146:0/1402620530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 msgr2=0x56236e896920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e896920 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c062ce0 tx=0x7f1d9c062af0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 1 -- 172.21.15.146:0/1402620530 shutdown_connections 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x56236e4aef60 0x56236e8d51e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e896920 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4cf6b0 0x56236e8a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1d81ffb640 0 client.9990 ms_handle_reset on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 1 --2- 172.21.15.146:0/1402620530 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4c74d0 0x56236e8ef950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 1 -- 172.21.15.146:0/1402620530 >> 172.21.15.146:0/1402620530 conn(0x56236e4e44e0 msgr2=0x56236e890cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 1 -- 172.21.15.146:0/1402620530 shutdown_connections 2024-09-17T03:43:10.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 1 -- 172.21.15.146:0/1402620530 wait complete. 2024-09-17T03:43:10.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.775+0000 7f1db00ca740 20 client.9990 trim_cache size 0 max 16384 2024-09-17T03:43:10.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.792+0000 7f1db00ca740 1 Processor -- start 2024-09-17T03:43:10.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.793+0000 7f1db00ca740 1 -- start start 2024-09-17T03:43:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4c74d0 0x56236e8dcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4cf6b0 0x56236e9003d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e900910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1db00ca740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1da42000a0 con 0x56236e4f0390 2024-09-17T03:43:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1db00ca740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41ff0c0 con 0x56236e4cf6b0 2024-09-17T03:43:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1db00ca740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1da41f3c10 con 0x56236e4c74d0 2024-09-17T03:43:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1da359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e900910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1da359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e900910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51360/0 (socket says 172.21.15.146:51360) 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1da359e640 1 -- 172.21.15.146:0/4245162058 learned_addr learned my addr 172.21.15.146:0/4245162058 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1d9a59c640 1 --2- 172.21.15.146:0/4245162058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4cf6b0 0x56236e9003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1da2d9d640 1 --2- 172.21.15.146:0/4245162058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4c74d0 0x56236e8dcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1da359e640 1 -- 172.21.15.146:0/4245162058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4c74d0 msgr2=0x56236e8dcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1da359e640 1 --2- 172.21.15.146:0/4245162058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4c74d0 0x56236e8dcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1da359e640 1 -- 172.21.15.146:0/4245162058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4cf6b0 msgr2=0x56236e9003d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1da359e640 1 --2- 172.21.15.146:0/4245162058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4cf6b0 0x56236e9003d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1da359e640 1 -- 172.21.15.146:0/4245162058 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56236e8dd270 con 0x56236e4f0390 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.794+0000 7f1da359e640 1 --2- 172.21.15.146:0/4245162058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e900910 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0097f0 tx=0x7f1d9c0995e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eba669324613d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1d83fff640 1 -- 172.21.15.146:0/4245162058 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c07d140 con 0x56236e4f0390 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1d83fff640 1 -- 172.21.15.146:0/4245162058 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d9c00b040 con 0x56236e4f0390 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1d83fff640 1 -- 172.21.15.146:0/4245162058 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00e0b0 con 0x56236e4f0390 2024-09-17T03:43:10.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1db00ca740 1 -- 172.21.15.146:0/4245162058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 msgr2=0x56236e900910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1db00ca740 1 --2- 172.21.15.146:0/4245162058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e900910 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0097f0 tx=0x7f1d9c0995e0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1db00ca740 1 -- 172.21.15.146:0/4245162058 shutdown_connections 2024-09-17T03:43:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1db00ca740 1 --2- 172.21.15.146:0/4245162058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4f0390 0x56236e900910 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1db00ca740 1 --2- 172.21.15.146:0/4245162058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4cf6b0 0x56236e9003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1db00ca740 1 --2- 172.21.15.146:0/4245162058 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4c74d0 0x56236e8dcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1db00ca740 1 -- 172.21.15.146:0/4245162058 >> 172.21.15.146:0/4245162058 conn(0x56236e4e44e0 msgr2=0x56236e890cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1db00ca740 1 -- 172.21.15.146:0/4245162058 shutdown_connections 2024-09-17T03:43:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.795+0000 7f1db00ca740 1 -- 172.21.15.146:0/4245162058 wait complete. 2024-09-17T03:43:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.796+0000 7f1db00ca740 1 -- start start 2024-09-17T03:43:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.796+0000 7f1db00ca740 1 Processor -- start 2024-09-17T03:43:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.797+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4c74d0 0x56236e9009e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.797+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4cf6b0 0x56236e940fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.797+0000 7f1db00ca740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4f0390 0x56236e8d6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.797+0000 7f1db00ca740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56236e8942c0 con 0x56236e4cf6b0 2024-09-17T03:43:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.797+0000 7f1db00ca740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41fea70 con 0x56236e4f0390 2024-09-17T03:43:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.797+0000 7f1db00ca740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56236e8982b0 con 0x56236e4c74d0 2024-09-17T03:43:10.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1db00ca740 10 client.0 _ll_register_callbacks cb 0x7f1d9c0629c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d9a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4cf6b0 0x56236e940fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d9a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4cf6b0 0x56236e940fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51374/0 (socket says 172.21.15.146:51374) 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d9a59c640 1 -- 172.21.15.146:0/3466923453 learned_addr learned my addr 172.21.15.146:0/3466923453 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4c74d0 0x56236e9009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1da359e640 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4f0390 0x56236e8d6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d9a59c640 1 -- 172.21.15.146:0/3466923453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4c74d0 msgr2=0x56236e9009e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d9a59c640 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4c74d0 0x56236e9009e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d9a59c640 1 -- 172.21.15.146:0/3466923453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4f0390 msgr2=0x56236e8d6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d9a59c640 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4f0390 0x56236e8d6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d9a59c640 1 -- 172.21.15.146:0/3466923453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56236e8baf40 con 0x56236e4cf6b0 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d9a59c640 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4cf6b0 0x56236e940fb0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x56236e8995d0 tx=0x7f1d8c007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3c113aba2ff5c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:43:10.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d81ffb640 1 -- 172.21.15.146:0/3466923453 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0052e0 con 0x56236e4cf6b0 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d81ffb640 1 -- 172.21.15.146:0/3466923453 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f1d8c007510 con 0x56236e4cf6b0 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1db00ca740 1 -- 172.21.15.146:0/3466923453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d9c00b040 con 0x56236e4cf6b0 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1d81ffb640 1 -- 172.21.15.146:0/3466923453 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f1d8c02e050 con 0x56236e4cf6b0 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1db00ca740 10 client.9996 fetch_fsmap learned FSMap version 113 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.798+0000 7f1db00ca740 1 -- 172.21.15.146:0/3466923453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x56236e8d4090 con 0x56236e4cf6b0 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1d81ffb640 1 -- 172.21.15.146:0/3466923453 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d9c00b040 con 0x56236e4cf6b0 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1d81ffb640 1 -- 172.21.15.146:0/3466923453 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7f1d8c031020 con 0x56236e4cf6b0 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1db00ca740 10 client.9996 fetch_fsmap finished waiting for FSMap version 113 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1db00ca740 10 client.9996 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1db00ca740 20 client.9996 populate_metadata read hostname 'smithi146' 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1db00ca740 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x56236e9442d0 0x56236e8f6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1db00ca740 4 client.9996 mds_command: new command op to 9783 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1db00ca740 1 -- 172.21.15.146:0/3466923453 --> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56236e808460 con 0x56236e9442d0 2024-09-17T03:43:10.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1da2d9d640 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x56236e9442d0 0x56236e8f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1d81ffb640 10 client.9996 ms_handle_connect on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1da2d9d640 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x56236e9442d0 0x56236e8f6060 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fba939105721c48c server_cookie=181b3c7567cff4d8 in_seq=0 out_seq=0 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1d81ffb640 1 -- 172.21.15.146:0/3466923453 <== mds.0 v2:172.21.15.146:6833/2786424389 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x56236e808460 con 0x56236e9442d0 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1d81ffb640 10 client.9996 handle_command_reply: tid=0 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.799+0000 7f1db00ca740 1 client.9996 shutdown 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1db00ca740 1 -- 172.21.15.146:0/3466923453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4cf6b0 msgr2=0x56236e940fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1db00ca740 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4cf6b0 0x56236e940fb0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x56236e8995d0 tx=0x7f1d8c007420 comp rx=0 tx=0).stop 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1db00ca740 1 -- 172.21.15.146:0/3466923453 shutdown_connections 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1db00ca740 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.146:6833/2786424389,v1:172.21.15.146:6835/2786424389] conn(0x56236e9442d0 0x56236e8f6060 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1db00ca740 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56236e4f0390 0x56236e8d6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1db00ca740 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56236e4cf6b0 0x56236e940fb0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1db00ca740 1 --2- 172.21.15.146:0/3466923453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56236e4c74d0 0x56236e9009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1d81ffb640 0 client.9996 ms_handle_reset on v2:172.21.15.146:6833/2786424389 2024-09-17T03:43:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1db00ca740 1 -- 172.21.15.146:0/3466923453 >> 172.21.15.146:0/3466923453 conn(0x56236e4e44e0 msgr2=0x56236e8be7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1db00ca740 1 -- 172.21.15.146:0/3466923453 shutdown_connections 2024-09-17T03:43:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1db00ca740 1 -- 172.21.15.146:0/3466923453 wait complete. 2024-09-17T03:43:10.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1db00ca740 20 client.9996 trim_cache size 0 max 16384 2024-09-17T03:43:10.805 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:43:10.805 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "PAUSED (684 inodes in the stack)", 2024-09-17T03:43:10.805 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:43:10.805 INFO:teuthology.orchestra.run.smithi146.stdout: "bd5b3cc3-a45e-4a38-a252-006634f58bf4": { 2024-09-17T03:43:10.805 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "bd5b3cc3-a45e-4a38-a252-006634f58bf4", 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: "bd5b3cc3-a45e-4a38-a252-006634f58bf4": { 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:43:10.416304+0000", 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:10.806 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:10.807 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:43:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 -- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d84078b90 msgr2=0x7f1d8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d84078b90 0x7f1d8407b0a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1d94034000 tx=0x7f1d94004730 comp rx=0 tx=0).stop 2024-09-17T03:43:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 -- 172.21.15.146:0/2424001844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da41e79a0 msgr2=0x7f1da40b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da41e79a0 0x7f1da40b2190 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009fd0 tx=0x7f1d9c00c740 comp rx=0 tx=0).stop 2024-09-17T03:43:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 -- 172.21.15.146:0/2424001844 shutdown_connections 2024-09-17T03:43:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1d84078b90 0x7f1d8407b0a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da41e79a0 0x7f1da40b2190 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1da4147af0 0x7f1da40b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 --2- 172.21.15.146:0/2424001844 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1da40b4100 0x7f1da414d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 -- 172.21.15.146:0/2424001844 >> 172.21.15.146:0/2424001844 conn(0x7f1da406d3c0 msgr2=0x7f1da40745a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 -- 172.21.15.146:0/2424001844 shutdown_connections 2024-09-17T03:43:10.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.800+0000 7f1da915e640 1 -- 172.21.15.146:0/2424001844 wait complete. 2024-09-17T03:43:10.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.924+0000 7f6e17fff640 1 -- 172.21.15.146:0/2795224679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e00004800 msgr2=0x7f6e00004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.924+0000 7f6e17fff640 1 --2- 172.21.15.146:0/2795224679 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e00004800 0x7f6e00004c50 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c001880 tx=0x7f6e00005830 comp rx=0 tx=0).stop 2024-09-17T03:43:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.924+0000 7f6e177fe640 1 -- 172.21.15.146:0/2795224679 reap_dead start 2024-09-17T03:43:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.924+0000 7f6e17fff640 1 -- 172.21.15.146:0/2795224679 shutdown_connections 2024-09-17T03:43:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.924+0000 7f6e17fff640 1 -- 172.21.15.146:0/2795224679 >> 172.21.15.146:0/2795224679 conn(0x7f6e180d10a0 msgr2=0x7f6e180d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.924+0000 7f6e17fff640 1 -- 172.21.15.146:0/2795224679 shutdown_connections 2024-09-17T03:43:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.924+0000 7f6e17fff640 1 -- 172.21.15.146:0/2795224679 wait complete. 2024-09-17T03:43:10.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.926+0000 7f6e17fff640 1 Processor -- start 2024-09-17T03:43:10.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.926+0000 7f6e17fff640 1 -- start start 2024-09-17T03:43:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.927+0000 7f6e17fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e00004800 0x7f6e180cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e17fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e1815b540 0x7f6e180b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e17fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e180ce3b0 0x7f6e180b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e17fff640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6e180cf090 con 0x7f6e00004800 2024-09-17T03:43:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e17fff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6e180cef10 con 0x7f6e1815b540 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e17fff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6e180cf210 con 0x7f6e180ce3b0 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e16ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e00004800 0x7f6e180cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e16ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e00004800 0x7f6e180cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51396/0 (socket says 172.21.15.146:51396) 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e16ffd640 1 -- 172.21.15.146:0/1968141628 learned_addr learned my addr 172.21.15.146:0/1968141628 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e167fc640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e1815b540 0x7f6e180b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e177fe640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e180ce3b0 0x7f6e180b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e16ffd640 1 -- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e180ce3b0 msgr2=0x7f6e180b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e16ffd640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e180ce3b0 0x7f6e180b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e16ffd640 1 -- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e1815b540 msgr2=0x7f6e180b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e16ffd640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e1815b540 0x7f6e180b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e16ffd640 1 -- 172.21.15.146:0/1968141628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1814cfa0 con 0x7f6e00004800 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e16ffd640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e00004800 0x7f6e180cacb0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f6e08006400 tx=0x7f6e080039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6dfffff640 1 -- 172.21.15.146:0/1968141628 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e08015070 con 0x7f6e00004800 2024-09-17T03:43:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6dfffff640 1 -- 172.21.15.146:0/1968141628 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e08011860 con 0x7f6e00004800 2024-09-17T03:43:10.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e17fff640 1 -- 172.21.15.146:0/1968141628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1814d280 con 0x7f6e00004800 2024-09-17T03:43:10.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6dfffff640 1 -- 172.21.15.146:0/1968141628 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e08011cb0 con 0x7f6e00004800 2024-09-17T03:43:10.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.928+0000 7f6e17fff640 1 -- 172.21.15.146:0/1968141628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e1814a990 con 0x7f6e00004800 2024-09-17T03:43:10.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.929+0000 7f6e17fff640 1 -- 172.21.15.146:0/1968141628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e18076760 con 0x7f6e00004800 2024-09-17T03:43:10.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.930+0000 7f6dfffff640 1 -- 172.21.15.146:0/1968141628 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e08018070 con 0x7f6e00004800 2024-09-17T03:43:10.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.930+0000 7f6dfffff640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e04078bc0 0x7f6e0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:10.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.931+0000 7f6dfffff640 1 -- 172.21.15.146:0/1968141628 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f6e0809b910 con 0x7f6e00004800 2024-09-17T03:43:10.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.931+0000 7f6e167fc640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e04078bc0 0x7f6e0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:10.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.931+0000 7f6e167fc640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e04078bc0 0x7f6e0407b0d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c001850 tx=0x7f6e0c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:10.935+0000 7f6dfffff640 1 -- 172.21.15.146:0/1968141628 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e18076760 con 0x7f6e00004800 2024-09-17T03:43:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.144+0000 7f6e17fff640 1 -- 172.21.15.146:0/1968141628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e180b42d0 con 0x7f6e00004800 2024-09-17T03:43:11.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.145+0000 7f6dfffff640 1 -- 172.21.15.146:0/1968141628 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7f6e080637a0 con 0x7f6e00004800 2024-09-17T03:43:11.144 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:11.145 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:43:11.145 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:43:11.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 -- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e04078bc0 msgr2=0x7f6e0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e04078bc0 0x7f6e0407b0d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c001850 tx=0x7f6e0c0013b0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 -- 172.21.15.146:0/1968141628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e00004800 msgr2=0x7f6e180cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e00004800 0x7f6e180cacb0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f6e08006400 tx=0x7f6e080039c0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 -- 172.21.15.146:0/1968141628 shutdown_connections 2024-09-17T03:43:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e04078bc0 0x7f6e0407b0d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6e180ce3b0 0x7f6e180b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6e1815b540 0x7f6e180b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 --2- 172.21.15.146:0/1968141628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e00004800 0x7f6e180cacb0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 -- 172.21.15.146:0/1968141628 >> 172.21.15.146:0/1968141628 conn(0x7f6e180d10a0 msgr2=0x7f6e1815d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 -- 172.21.15.146:0/1968141628 shutdown_connections 2024-09-17T03:43:11.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.147+0000 7f6e17fff640 1 -- 172.21.15.146:0/1968141628 wait complete. 2024-09-17T03:43:11.158 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:43:11.158 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:43:11.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.273+0000 7f4382ede640 1 -- 172.21.15.146:0/25303257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4364004d40 msgr2=0x7f4364005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:11.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.273+0000 7f4382ede640 1 --2- 172.21.15.146:0/25303257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4364004d40 0x7f4364005150 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f4374009ed0 tx=0x7f4364005830 comp rx=0 tx=0).stop 2024-09-17T03:43:11.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.273+0000 7f438147b640 1 -- 172.21.15.146:0/25303257 reap_dead start 2024-09-17T03:43:11.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.273+0000 7f4382ede640 1 -- 172.21.15.146:0/25303257 shutdown_connections 2024-09-17T03:43:11.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.273+0000 7f4382ede640 1 -- 172.21.15.146:0/25303257 >> 172.21.15.146:0/25303257 conn(0x7f437c0b7b20 msgr2=0x7f437c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:11.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.273+0000 7f4382ede640 1 -- 172.21.15.146:0/25303257 shutdown_connections 2024-09-17T03:43:11.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.273+0000 7f4382ede640 1 -- 172.21.15.146:0/25303257 wait complete. 2024-09-17T03:43:11.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.275+0000 7f4382ede640 1 Processor -- start 2024-09-17T03:43:11.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.275+0000 7f4382ede640 1 -- start start 2024-09-17T03:43:11.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f4382ede640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4364004d40 0x7f437c157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:11.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f4382ede640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f437c1459a0 0x7f437c146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:11.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f4382ede640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c146770 0x7f437c1f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:11.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f4382ede640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f437c15ceb0 con 0x7f437c146770 2024-09-17T03:43:11.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f4382ede640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f437c15cd30 con 0x7f437c1459a0 2024-09-17T03:43:11.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f4382ede640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f437c15d030 con 0x7f4364004d40 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f438147b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c146770 0x7f437c1f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f437bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f437c1459a0 0x7f437c146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f4380c7a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4364004d40 0x7f437c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f438147b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c146770 0x7f437c1f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51406/0 (socket says 172.21.15.146:51406) 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f437bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f437c1459a0 0x7f437c146230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.146:40378/0 (socket says 172.21.15.146:40378) 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f438147b640 1 -- 172.21.15.146:0/2414709644 learned_addr learned my addr 172.21.15.146:0/2414709644 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f438147b640 1 -- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4364004d40 msgr2=0x7f437c157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f438147b640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4364004d40 0x7f437c157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f438147b640 1 -- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f437c1459a0 msgr2=0x7f437c146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f438147b640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f437c1459a0 0x7f437c146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f438147b640 1 -- 172.21.15.146:0/2414709644 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c156460 con 0x7f437c146770 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f438147b640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c146770 0x7f437c1f6ac0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f4374002230 tx=0x7f4374034c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:11.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f43797fa640 1 -- 172.21.15.146:0/2414709644 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374043070 con 0x7f437c146770 2024-09-17T03:43:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f43797fa640 1 -- 172.21.15.146:0/2414709644 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4374034cd0 con 0x7f437c146770 2024-09-17T03:43:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f4382ede640 1 -- 172.21.15.146:0/2414709644 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437c156740 con 0x7f437c146770 2024-09-17T03:43:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.277+0000 7f43797fa640 1 -- 172.21.15.146:0/2414709644 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374038040 con 0x7f437c146770 2024-09-17T03:43:11.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.278+0000 7f4382ede640 1 -- 172.21.15.146:0/2414709644 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f437c156d00 con 0x7f437c146770 2024-09-17T03:43:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.279+0000 7f4382ede640 1 -- 172.21.15.146:0/2414709644 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f437c1561d0 con 0x7f437c146770 2024-09-17T03:43:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.279+0000 7f43797fa640 1 -- 172.21.15.146:0/2414709644 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4374046070 con 0x7f437c146770 2024-09-17T03:43:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.280+0000 7f43797fa640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4368078b90 0x7f436807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.280+0000 7f43797fa640 1 -- 172.21.15.146:0/2414709644 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f43740bad80 con 0x7f437c146770 2024-09-17T03:43:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.280+0000 7f4380c7a640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4368078b90 0x7f436807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:11.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.280+0000 7f4380c7a640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4368078b90 0x7f436807b0a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f436c001330 tx=0x7f436c006910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.284+0000 7f43797fa640 1 -- 172.21.15.146:0/2414709644 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4374082b70 con 0x7f437c146770 2024-09-17T03:43:11.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.528+0000 7f4382ede640 1 -- 172.21.15.146:0/2414709644 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f437c1590c0 con 0x7f437c146770 2024-09-17T03:43:11.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.528+0000 7f43797fa640 1 -- 172.21.15.146:0/2414709644 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7f43740875a0 con 0x7f437c146770 2024-09-17T03:43:11.527 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:11.527 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":636,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":908,"data_bytes":929207110,"bytes_used":2199003136,"bytes_avail":770895110144,"bytes_total":773094113280,"write_bytes_sec":77371232,"read_op_per_sec":0,"write_op_per_sec":75},"fsmap":{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9783}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2024-09-17T03:42:39.945755+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:43:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 -- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4368078b90 msgr2=0x7f436807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4368078b90 0x7f436807b0a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f436c001330 tx=0x7f436c006910 comp rx=0 tx=0).stop 2024-09-17T03:43:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 -- 172.21.15.146:0/2414709644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c146770 msgr2=0x7f437c1f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c146770 0x7f437c1f6ac0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f4374002230 tx=0x7f4374034c60 comp rx=0 tx=0).stop 2024-09-17T03:43:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 -- 172.21.15.146:0/2414709644 shutdown_connections 2024-09-17T03:43:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4368078b90 0x7f436807b0a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f437c146770 0x7f437c1f6ac0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f437c1459a0 0x7f437c146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 --2- 172.21.15.146:0/2414709644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4364004d40 0x7f437c157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 -- 172.21.15.146:0/2414709644 >> 172.21.15.146:0/2414709644 conn(0x7f437c0b7b20 msgr2=0x7f437c070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 -- 172.21.15.146:0/2414709644 shutdown_connections 2024-09-17T03:43:11.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:11.531+0000 7f4382ede640 1 -- 172.21.15.146:0/2414709644 wait complete. 2024-09-17T03:43:11.541 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:43:12.542 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.670+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/48422702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a680b36b0 msgr2=0x7f0a680b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.670+0000 7f0a6dcb2640 1 --2- 172.21.15.146:0/48422702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a680b36b0 0x7f0a680b3c00 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f0a680b7680 tx=0x7f0a5802a560 comp rx=0 tx=0).stop 2024-09-17T03:43:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.670+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/48422702 shutdown_connections 2024-09-17T03:43:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.670+0000 7f0a6dcb2640 1 --2- 172.21.15.146:0/48422702 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a68069240 0x7f0a680d2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.670+0000 7f0a6dcb2640 1 --2- 172.21.15.146:0/48422702 >> v2:172.21.15.179:3300/0 conn(0x7f0a6815ec30 0x7f0a68068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.670+0000 7f0a6dcb2640 1 --2- 172.21.15.146:0/48422702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a680b36b0 0x7f0a680b3c00 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.670+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/48422702 >> 172.21.15.146:0/48422702 conn(0x7f0a680d4960 msgr2=0x7f0a680d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.670+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/48422702 shutdown_connections 2024-09-17T03:43:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.670+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/48422702 wait complete. 2024-09-17T03:43:12.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.672+0000 7f0a6dcb2640 1 Processor -- start 2024-09-17T03:43:12.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.672+0000 7f0a6dcb2640 1 -- start start 2024-09-17T03:43:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.673+0000 7f0a6dcb2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a68069240 0x7f0a68157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.673+0000 7f0a6dcb2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a680b36b0 0x7f0a680b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.673+0000 7f0a6dcb2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a6815ec30 0x7f0a68146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.673+0000 7f0a6dcb2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a680d35a0 con 0x7f0a680b36b0 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.673+0000 7f0a6dcb2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0a680d3420 con 0x7f0a68069240 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.673+0000 7f0a6dcb2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0a680d3720 con 0x7f0a6815ec30 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a66ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a680b36b0 0x7f0a680b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a66ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a680b36b0 0x7f0a680b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51414/0 (socket says 172.21.15.146:51414) 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a66ffd640 1 -- 172.21.15.146:0/3844448557 learned_addr learned my addr 172.21.15.146:0/3844448557 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a677fe640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a68069240 0x7f0a68157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a67fff640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a6815ec30 0x7f0a68146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a66ffd640 1 -- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a6815ec30 msgr2=0x7f0a68146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a66ffd640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a6815ec30 0x7f0a68146da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a66ffd640 1 -- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a68069240 msgr2=0x7f0a68157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a66ffd640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a68069240 0x7f0a68157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a66ffd640 1 -- 172.21.15.146:0/3844448557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a680b3220 con 0x7f0a680b36b0 2024-09-17T03:43:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a677fe640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a68069240 0x7f0a68157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:43:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a66ffd640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a680b36b0 0x7f0a680b2ce0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c970 tx=0x7f0a5c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a4ffff640 1 -- 172.21.15.146:0/3844448557 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c007bb0 con 0x7f0a680b36b0 2024-09-17T03:43:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a4ffff640 1 -- 172.21.15.146:0/3844448557 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a5c007e40 con 0x7f0a680b36b0 2024-09-17T03:43:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/3844448557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a68157520 con 0x7f0a680b36b0 2024-09-17T03:43:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a4ffff640 1 -- 172.21.15.146:0/3844448557 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c00f6b0 con 0x7f0a680b36b0 2024-09-17T03:43:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.674+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/3844448557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a681577c0 con 0x7f0a680b36b0 2024-09-17T03:43:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.675+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/3844448557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a68146ad0 con 0x7f0a680b36b0 2024-09-17T03:43:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.676+0000 7f0a4ffff640 1 -- 172.21.15.146:0/3844448557 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a5c00f850 con 0x7f0a680b36b0 2024-09-17T03:43:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.676+0000 7f0a4ffff640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078b90 0x7f0a5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.677+0000 7f0a4ffff640 1 -- 172.21.15.146:0/3844448557 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f0a5c09b4e0 con 0x7f0a680b36b0 2024-09-17T03:43:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.677+0000 7f0a677fe640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078b90 0x7f0a5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:12.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.677+0000 7f0a677fe640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078b90 0x7f0a5407b0a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0a58033000 tx=0x7f0a58004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:12.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.681+0000 7f0a4ffff640 1 -- 172.21.15.146:0/3844448557 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a680b3220 con 0x7f0a680b36b0 2024-09-17T03:43:12.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.895+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/3844448557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a6815bd20 con 0x7f0a680b36b0 2024-09-17T03:43:12.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.895+0000 7f0a4ffff640 1 -- 172.21.15.146:0/3844448557 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7f0a6815bd20 con 0x7f0a680b36b0 2024-09-17T03:43:12.895 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:12.895 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:43:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:43:12.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078b90 msgr2=0x7f0a5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:12.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078b90 0x7f0a5407b0a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0a58033000 tx=0x7f0a58004730 comp rx=0 tx=0).stop 2024-09-17T03:43:12.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/3844448557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a680b36b0 msgr2=0x7f0a680b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:12.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a680b36b0 0x7f0a680b2ce0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c970 tx=0x7f0a5c00ce30 comp rx=0 tx=0).stop 2024-09-17T03:43:12.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/3844448557 shutdown_connections 2024-09-17T03:43:12.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a54078b90 0x7f0a5407b0a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a6815ec30 0x7f0a68146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a680b36b0 0x7f0a680b2ce0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 --2- 172.21.15.146:0/3844448557 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a68069240 0x7f0a68157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/3844448557 >> 172.21.15.146:0/3844448557 conn(0x7f0a680d4960 msgr2=0x7f0a6815c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/3844448557 shutdown_connections 2024-09-17T03:43:12.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:12.898+0000 7f0a6dcb2640 1 -- 172.21.15.146:0/3844448557 wait complete. 2024-09-17T03:43:12.908 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:43:12.908 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:43:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.026+0000 7f4fe529b640 1 -- 172.21.15.146:0/3102817816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b3870 msgr2=0x7f4fe00cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.026+0000 7f4fe529b640 1 --2- 172.21.15.146:0/3102817816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b3870 0x7f4fe00cf370 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009830 tx=0x7f4fd002a480 comp rx=0 tx=0).stop 2024-09-17T03:43:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.026+0000 7f4fe529b640 1 -- 172.21.15.146:0/3102817816 shutdown_connections 2024-09-17T03:43:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.026+0000 7f4fe529b640 1 --2- 172.21.15.146:0/3102817816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe01620f0 0x7f4fe006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:13.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.026+0000 7f4fe529b640 1 --2- 172.21.15.146:0/3102817816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b3870 0x7f4fe00cf370 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:13.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.026+0000 7f4fe529b640 1 -- 172.21.15.146:0/3102817816 >> 172.21.15.146:0/3102817816 conn(0x7f4fe00d4be0 msgr2=0x7f4fe00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:13.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.026+0000 7f4fe529b640 1 -- 172.21.15.146:0/3102817816 shutdown_connections 2024-09-17T03:43:13.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.026+0000 7f4fe529b640 1 -- 172.21.15.146:0/3102817816 wait complete. 2024-09-17T03:43:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.028+0000 7f4fe529b640 1 Processor -- start 2024-09-17T03:43:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.028+0000 7f4fe529b640 1 -- start start 2024-09-17T03:43:13.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fe529b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe006f270 0x7f4fe01e97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:13.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fe529b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b3870 0x7f4fe015d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:13.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fe529b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fe01620f0 0x7f4fe014aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:13.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fe529b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe00d43b0 con 0x7f4fe00b3870 2024-09-17T03:43:13.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fe529b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe0162fb0 con 0x7f4fe01620f0 2024-09-17T03:43:13.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fe529b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe01ea070 con 0x7f4fe006f270 2024-09-17T03:43:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fde7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b3870 0x7f4fe015d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fde7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b3870 0x7f4fe015d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51440/0 (socket says 172.21.15.146:51440) 2024-09-17T03:43:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fde7fc640 1 -- 172.21.15.146:0/80610946 learned_addr learned my addr 172.21.15.146:0/80610946 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fdeffd640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe006f270 0x7f4fe01e97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:13.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fdf7fe640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fe01620f0 0x7f4fe014aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:13.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fde7fc640 1 -- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe006f270 msgr2=0x7f4fe01e97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:13.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fde7fc640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe006f270 0x7f4fe01e97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:13.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fde7fc640 1 -- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fe01620f0 msgr2=0x7f4fe014aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:13.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fde7fc640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fe01620f0 0x7f4fe014aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:13.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.029+0000 7f4fde7fc640 1 -- 172.21.15.146:0/80610946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe015d640 con 0x7f4fe00b3870 2024-09-17T03:43:13.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.030+0000 7f4fde7fc640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b3870 0x7f4fe015d100 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400d6d0 tx=0x7f4fd400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:13.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.030+0000 7f4fc77fe640 1 -- 172.21.15.146:0/80610946 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4017070 con 0x7f4fe00b3870 2024-09-17T03:43:13.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.030+0000 7f4fc77fe640 1 -- 172.21.15.146:0/80610946 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fd4005310 con 0x7f4fe00b3870 2024-09-17T03:43:13.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.030+0000 7f4fe529b640 1 -- 172.21.15.146:0/80610946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe0149c00 con 0x7f4fe00b3870 2024-09-17T03:43:13.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.030+0000 7f4fc77fe640 1 -- 172.21.15.146:0/80610946 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4009820 con 0x7f4fe00b3870 2024-09-17T03:43:13.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.030+0000 7f4fe529b640 1 -- 172.21.15.146:0/80610946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe014a1c0 con 0x7f4fe00b3870 2024-09-17T03:43:13.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.031+0000 7f4fe529b640 1 -- 172.21.15.146:0/80610946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe0149970 con 0x7f4fe00b3870 2024-09-17T03:43:13.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.032+0000 7f4fc77fe640 1 -- 172.21.15.146:0/80610946 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4fd40099c0 con 0x7f4fe00b3870 2024-09-17T03:43:13.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.033+0000 7f4fc77fe640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fcc078b90 0x7f4fcc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:13.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.033+0000 7f4fc77fe640 1 -- 172.21.15.146:0/80610946 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f4fd409adb0 con 0x7f4fe00b3870 2024-09-17T03:43:13.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.033+0000 7f4fdeffd640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fcc078b90 0x7f4fcc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:13.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.033+0000 7f4fdeffd640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fcc078b90 0x7f4fcc07b0a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0034000 tx=0x7f4fd0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.037+0000 7f4fc77fe640 1 -- 172.21.15.146:0/80610946 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4fd4063280 con 0x7f4fe00b3870 2024-09-17T03:43:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.281+0000 7f4fe529b640 1 -- 172.21.15.146:0/80610946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4fe01634a0 con 0x7f4fe00b3870 2024-09-17T03:43:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.281+0000 7f4fc77fe640 1 -- 172.21.15.146:0/80610946 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7f4fd4062b80 con 0x7f4fe00b3870 2024-09-17T03:43:13.281 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:13.282 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":637,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":908,"data_bytes":929207110,"bytes_used":2199003136,"bytes_avail":770895110144,"bytes_total":773094113280,"write_bytes_sec":77370500,"read_op_per_sec":0,"write_op_per_sec":75},"fsmap":{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9783}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2024-09-17T03:42:39.945755+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:43:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.283+0000 7f4fe529b640 1 -- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fcc078b90 msgr2=0x7f4fcc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.283+0000 7f4fe529b640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fcc078b90 0x7f4fcc07b0a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0034000 tx=0x7f4fd0004730 comp rx=0 tx=0).stop 2024-09-17T03:43:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.283+0000 7f4fe529b640 1 -- 172.21.15.146:0/80610946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b3870 msgr2=0x7f4fe015d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.283+0000 7f4fe529b640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b3870 0x7f4fe015d100 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400d6d0 tx=0x7f4fd400db90 comp rx=0 tx=0).stop 2024-09-17T03:43:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.284+0000 7f4fe529b640 1 -- 172.21.15.146:0/80610946 shutdown_connections 2024-09-17T03:43:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.284+0000 7f4fe529b640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4fcc078b90 0x7f4fcc07b0a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.284+0000 7f4fe529b640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fe01620f0 0x7f4fe014aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.284+0000 7f4fe529b640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fe00b3870 0x7f4fe015d100 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.284+0000 7f4fe529b640 1 --2- 172.21.15.146:0/80610946 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fe006f270 0x7f4fe01e97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.284+0000 7f4fe529b640 1 -- 172.21.15.146:0/80610946 >> 172.21.15.146:0/80610946 conn(0x7f4fe00d4be0 msgr2=0x7f4fe00b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.284+0000 7f4fe529b640 1 -- 172.21.15.146:0/80610946 shutdown_connections 2024-09-17T03:43:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:13.284+0000 7f4fe529b640 1 -- 172.21.15.146:0/80610946 wait complete. 2024-09-17T03:43:13.294 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:43:14.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:14.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.423+0000 7f4fad5ba640 1 -- 172.21.15.146:0/3561267000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90004d40 msgr2=0x7f4f900051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:14.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.423+0000 7f4fad5ba640 1 --2- 172.21.15.146:0/3561267000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90004d40 0x7f4f900051f0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0006fa0 tx=0x7f4f90005830 comp rx=0 tx=0).stop 2024-09-17T03:43:14.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.424+0000 7f4fa77fe640 1 -- 172.21.15.146:0/3561267000 reap_dead start 2024-09-17T03:43:14.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.424+0000 7f4fad5ba640 1 -- 172.21.15.146:0/3561267000 shutdown_connections 2024-09-17T03:43:14.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.424+0000 7f4fad5ba640 1 -- 172.21.15.146:0/3561267000 >> 172.21.15.146:0/3561267000 conn(0x7f4fa80d4be0 msgr2=0x7f4fa80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:14.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.424+0000 7f4fad5ba640 1 -- 172.21.15.146:0/3561267000 shutdown_connections 2024-09-17T03:43:14.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.424+0000 7f4fad5ba640 1 -- 172.21.15.146:0/3561267000 wait complete. 2024-09-17T03:43:14.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.426+0000 7f4fad5ba640 1 Processor -- start 2024-09-17T03:43:14.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.426+0000 7f4fad5ba640 1 -- start start 2024-09-17T03:43:14.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fad5ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fa80c7ea0 0x7f4fa81ea9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:14.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fad5ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa8153b00 0x7f4fa81eaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:14.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fad5ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fa8157ab0 0x7f4fa8157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:14.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fad5ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa80d38a0 con 0x7f4fa8153b00 2024-09-17T03:43:14.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fad5ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa80cf770 con 0x7f4fa8157ab0 2024-09-17T03:43:14.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fad5ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa80d3a20 con 0x7f4fa80c7ea0 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fa67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa8153b00 0x7f4fa81eaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fa67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa8153b00 0x7f4fa81eaee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51466/0 (socket says 172.21.15.146:51466) 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fa67fc640 1 -- 172.21.15.146:0/958483701 learned_addr learned my addr 172.21.15.146:0/958483701 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fa77fe640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fa8157ab0 0x7f4fa8157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fa6ffd640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fa80c7ea0 0x7f4fa81ea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fa67fc640 1 -- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fa80c7ea0 msgr2=0x7f4fa81ea9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fa67fc640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fa80c7ea0 0x7f4fa81ea9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fa67fc640 1 -- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fa8157ab0 msgr2=0x7f4fa8157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fa67fc640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fa8157ab0 0x7f4fa8157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fa67fc640 1 -- 172.21.15.146:0/958483701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa80c83a0 con 0x7f4fa8153b00 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.427+0000 7f4fa67fc640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa8153b00 0x7f4fa81eaee0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f4f98003fb0 tx=0x7f4f98006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:14.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.428+0000 7f4f8f7fe640 1 -- 172.21.15.146:0/958483701 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98015070 con 0x7f4fa8153b00 2024-09-17T03:43:14.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.428+0000 7f4f8f7fe640 1 -- 172.21.15.146:0/958483701 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f9800f960 con 0x7f4fa8153b00 2024-09-17T03:43:14.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.428+0000 7f4fad5ba640 1 -- 172.21.15.146:0/958483701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa80c8680 con 0x7f4fa8153b00 2024-09-17T03:43:14.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.428+0000 7f4f8f7fe640 1 -- 172.21.15.146:0/958483701 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9800fdb0 con 0x7f4fa8153b00 2024-09-17T03:43:14.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.428+0000 7f4fad5ba640 1 -- 172.21.15.146:0/958483701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa80c8c40 con 0x7f4fa8153b00 2024-09-17T03:43:14.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.429+0000 7f4fad5ba640 1 -- 172.21.15.146:0/958483701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa80cb820 con 0x7f4fa8153b00 2024-09-17T03:43:14.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.430+0000 7f4f8f7fe640 1 -- 172.21.15.146:0/958483701 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f98011430 con 0x7f4fa8153b00 2024-09-17T03:43:14.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.430+0000 7f4f8f7fe640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f94078b90 0x7f4f9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:14.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.430+0000 7f4f8f7fe640 1 -- 172.21.15.146:0/958483701 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f4f9809b980 con 0x7f4fa8153b00 2024-09-17T03:43:14.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.430+0000 7f4fa6ffd640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f94078b90 0x7f4f9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:14.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.431+0000 7f4fa6ffd640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f94078b90 0x7f4f9407b0a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80b6550 tx=0x7f4f9c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:14.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.435+0000 7f4f8f7fe640 1 -- 172.21.15.146:0/958483701 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f98063890 con 0x7f4fa8153b00 2024-09-17T03:43:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.648+0000 7f4fad5ba640 1 -- 172.21.15.146:0/958483701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fa80b6e20 con 0x7f4fa8153b00 2024-09-17T03:43:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.648+0000 7f4f8f7fe640 1 -- 172.21.15.146:0/958483701 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7f4f980682c0 con 0x7f4fa8153b00 2024-09-17T03:43:14.648 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:14.648 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:43:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:43:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 -- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f94078b90 msgr2=0x7f4f9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f94078b90 0x7f4f9407b0a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80b6550 tx=0x7f4f9c005f90 comp rx=0 tx=0).stop 2024-09-17T03:43:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 -- 172.21.15.146:0/958483701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa8153b00 msgr2=0x7f4fa81eaee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa8153b00 0x7f4fa81eaee0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f4f98003fb0 tx=0x7f4f98006430 comp rx=0 tx=0).stop 2024-09-17T03:43:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 -- 172.21.15.146:0/958483701 shutdown_connections 2024-09-17T03:43:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f94078b90 0x7f4f9407b0a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4fa8157ab0 0x7f4fa8157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa8153b00 0x7f4fa81eaee0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 --2- 172.21.15.146:0/958483701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4fa80c7ea0 0x7f4fa81ea9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 -- 172.21.15.146:0/958483701 >> 172.21.15.146:0/958483701 conn(0x7f4fa80d4be0 msgr2=0x7f4fa815dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 -- 172.21.15.146:0/958483701 shutdown_connections 2024-09-17T03:43:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.650+0000 7f4fad5ba640 1 -- 172.21.15.146:0/958483701 wait complete. 2024-09-17T03:43:14.661 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:43:14.661 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:43:14.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.773+0000 7f2e1f230640 1 -- 172.21.15.146:0/3853414836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e180b5750 msgr2=0x7f2e180b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.773+0000 7f2e1f230640 1 --2- 172.21.15.146:0/3853414836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e180b5750 0x7f2e180b3620 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f2e180b1a60 tx=0x7f2e0802a560 comp rx=0 tx=0).stop 2024-09-17T03:43:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.773+0000 7f2e1f230640 1 -- 172.21.15.146:0/3853414836 shutdown_connections 2024-09-17T03:43:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.773+0000 7f2e1f230640 1 --2- 172.21.15.146:0/3853414836 >> v2:172.21.15.179:3300/0 conn(0x7f2e180b3b60 0x7f2e1815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.773+0000 7f2e1f230640 1 --2- 172.21.15.146:0/3853414836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e180b5750 0x7f2e180b3620 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.773+0000 7f2e1f230640 1 -- 172.21.15.146:0/3853414836 >> 172.21.15.146:0/3853414836 conn(0x7f2e180b7b20 msgr2=0x7f2e1809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.773+0000 7f2e1f230640 1 -- 172.21.15.146:0/3853414836 shutdown_connections 2024-09-17T03:43:14.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.773+0000 7f2e1f230640 1 -- 172.21.15.146:0/3853414836 wait complete. 2024-09-17T03:43:14.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.774+0000 7f2e1f230640 1 Processor -- start 2024-09-17T03:43:14.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.774+0000 7f2e1f230640 1 -- start start 2024-09-17T03:43:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1f230640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e180b3b60 0x7f2e1814b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1f230640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e180b5750 0x7f2e181f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1f230640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e180b5ce0 0x7f2e1814a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1f230640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1815d420 con 0x7f2e180b5ce0 2024-09-17T03:43:14.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1f230640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1815d2a0 con 0x7f2e180b3b60 2024-09-17T03:43:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1f230640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1815d5a0 con 0x7f2e180b5750 2024-09-17T03:43:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1d7cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e180b5ce0 0x7f2e1814a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1d7cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e180b5ce0 0x7f2e1814a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51476/0 (socket says 172.21.15.146:51476) 2024-09-17T03:43:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1d7cd640 1 -- 172.21.15.146:0/896926328 learned_addr learned my addr 172.21.15.146:0/896926328 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1cfcc640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e180b3b60 0x7f2e1814b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e0ffff640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e180b5750 0x7f2e181f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1d7cd640 1 -- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e180b5750 msgr2=0x7f2e181f9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:14.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1d7cd640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e180b5750 0x7f2e181f9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1d7cd640 1 -- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e180b3b60 msgr2=0x7f2e1814b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1d7cd640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e180b3b60 0x7f2e1814b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.776+0000 7f2e1d7cd640 1 -- 172.21.15.146:0/896926328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e181f9c90 con 0x7f2e180b5ce0 2024-09-17T03:43:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.777+0000 7f2e1d7cd640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e180b5ce0 0x7f2e1814a9a0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000e6d0 tx=0x7f2e1000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.777+0000 7f2e0d7fa640 1 -- 172.21.15.146:0/896926328 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000cab0 con 0x7f2e180b5ce0 2024-09-17T03:43:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.777+0000 7f2e0d7fa640 1 -- 172.21.15.146:0/896926328 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e1000cc50 con 0x7f2e180b5ce0 2024-09-17T03:43:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.777+0000 7f2e1f230640 1 -- 172.21.15.146:0/896926328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1814d760 con 0x7f2e180b5ce0 2024-09-17T03:43:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.777+0000 7f2e0d7fa640 1 -- 172.21.15.146:0/896926328 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e10005280 con 0x7f2e180b5ce0 2024-09-17T03:43:14.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.777+0000 7f2e1f230640 1 -- 172.21.15.146:0/896926328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e1814dd20 con 0x7f2e180b5ce0 2024-09-17T03:43:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.778+0000 7f2e1f230640 1 -- 172.21.15.146:0/896926328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e1814d4d0 con 0x7f2e180b5ce0 2024-09-17T03:43:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.779+0000 7f2e0d7fa640 1 -- 172.21.15.146:0/896926328 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2e10005440 con 0x7f2e180b5ce0 2024-09-17T03:43:14.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.779+0000 7f2e0d7fa640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e04078b90 0x7f2e0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.779+0000 7f2e0d7fa640 1 -- 172.21.15.146:0/896926328 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f2e1009b860 con 0x7f2e180b5ce0 2024-09-17T03:43:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.779+0000 7f2e1cfcc640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e04078b90 0x7f2e0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.780+0000 7f2e1cfcc640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e04078b90 0x7f2e0407b0a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2e14001e20 tx=0x7f2e14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:14.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:14.783+0000 7f2e0d7fa640 1 -- 172.21.15.146:0/896926328 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2e1000ce20 con 0x7f2e180b5ce0 2024-09-17T03:43:15.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.024+0000 7f2e1f230640 1 -- 172.21.15.146:0/896926328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2e1814b810 con 0x7f2e180b5ce0 2024-09-17T03:43:15.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.025+0000 7f2e0d7fa640 1 -- 172.21.15.146:0/896926328 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1490 (secure 0 0 0) 0x7f2e100637c0 con 0x7f2e180b5ce0 2024-09-17T03:43:15.024 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:15.025 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":639,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":998,"data_bytes":1023578950,"bytes_used":2402426880,"bytes_avail":770691686400,"bytes_total":773094113280,"write_bytes_sec":85239742,"read_op_per_sec":0,"write_op_per_sec":83},"fsmap":{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9783}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2024-09-17T03:42:39.945755+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:43:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 -- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e04078b90 msgr2=0x7f2e0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e04078b90 0x7f2e0407b0a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2e14001e20 tx=0x7f2e14009040 comp rx=0 tx=0).stop 2024-09-17T03:43:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 -- 172.21.15.146:0/896926328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e180b5ce0 msgr2=0x7f2e1814a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e180b5ce0 0x7f2e1814a9a0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000e6d0 tx=0x7f2e1000eb90 comp rx=0 tx=0).stop 2024-09-17T03:43:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 -- 172.21.15.146:0/896926328 shutdown_connections 2024-09-17T03:43:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2e04078b90 0x7f2e0407b0a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e180b5ce0 0x7f2e1814a9a0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2e180b5750 0x7f2e181f9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 --2- 172.21.15.146:0/896926328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e180b3b60 0x7f2e1814b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 -- 172.21.15.146:0/896926328 >> 172.21.15.146:0/896926328 conn(0x7f2e180b7b20 msgr2=0x7f2e1806e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 -- 172.21.15.146:0/896926328 shutdown_connections 2024-09-17T03:43:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:15.027+0000 7f2e1f230640 1 -- 172.21.15.146:0/896926328 wait complete. 2024-09-17T03:43:15.037 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:43:16.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.159+0000 7f48b7a0a640 1 -- 172.21.15.146:0/1802613719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b006f440 msgr2=0x7f48b00d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.159+0000 7f48b7a0a640 1 --2- 172.21.15.146:0/1802613719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b006f440 0x7f48b00d3190 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f48a8005fd0 tx=0x7f48a802aa10 comp rx=0 tx=0).stop 2024-09-17T03:43:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.159+0000 7f48b7a0a640 1 -- 172.21.15.146:0/1802613719 shutdown_connections 2024-09-17T03:43:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.159+0000 7f48b7a0a640 1 --2- 172.21.15.146:0/1802613719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b006f440 0x7f48b00d3190 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.159+0000 7f48b7a0a640 1 --2- 172.21.15.146:0/1802613719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b00b3870 0x7f48b00cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.159+0000 7f48b7a0a640 1 -- 172.21.15.146:0/1802613719 >> 172.21.15.146:0/1802613719 conn(0x7f48b00d4be0 msgr2=0x7f48b00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.159+0000 7f48b7a0a640 1 -- 172.21.15.146:0/1802613719 shutdown_connections 2024-09-17T03:43:16.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.159+0000 7f48b7a0a640 1 -- 172.21.15.146:0/1802613719 wait complete. 2024-09-17T03:43:16.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.161+0000 7f48b7a0a640 1 Processor -- start 2024-09-17T03:43:16.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.161+0000 7f48b7a0a640 1 -- start start 2024-09-17T03:43:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.162+0000 7f48b7a0a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b00b3870 0x7f48b00cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.162+0000 7f48b7a0a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b01620f0 0x7f48b01501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b7a0a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48b014df20 0x7f48b014d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b7a0a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f48b00d3ae0 con 0x7f48b01620f0 2024-09-17T03:43:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b7a0a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f48b00d3960 con 0x7f48b014df20 2024-09-17T03:43:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b7a0a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f48b00d3c60 con 0x7f48b00b3870 2024-09-17T03:43:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b4fa5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b01620f0 0x7f48b01501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b4fa5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b01620f0 0x7f48b01501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51486/0 (socket says 172.21.15.146:51486) 2024-09-17T03:43:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b4fa5640 1 -- 172.21.15.146:0/772466157 learned_addr learned my addr 172.21.15.146:0/772466157 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:16.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b57a6640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b00b3870 0x7f48b00cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b5fa7640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48b014df20 0x7f48b014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b4fa5640 1 -- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b00b3870 msgr2=0x7f48b00cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b4fa5640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b00b3870 0x7f48b00cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b4fa5640 1 -- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48b014df20 msgr2=0x7f48b014d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b4fa5640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48b014df20 0x7f48b014d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b4fa5640 1 -- 172.21.15.146:0/772466157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b00b57e0 con 0x7f48b01620f0 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b4fa5640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b01620f0 0x7f48b01501e0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f48a000c370 tx=0x7f48a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48a5ffb640 1 -- 172.21.15.146:0/772466157 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0017070 con 0x7f48b01620f0 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48a5ffb640 1 -- 172.21.15.146:0/772466157 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48a00053c0 con 0x7f48b01620f0 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48b7a0a640 1 -- 172.21.15.146:0/772466157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b00b5ac0 con 0x7f48b01620f0 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.163+0000 7f48a5ffb640 1 -- 172.21.15.146:0/772466157 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0003850 con 0x7f48b01620f0 2024-09-17T03:43:16.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.164+0000 7f48b7a0a640 1 -- 172.21.15.146:0/772466157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b014e3d0 con 0x7f48b01620f0 2024-09-17T03:43:16.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.165+0000 7f48b7a0a640 1 -- 172.21.15.146:0/772466157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b00d3190 con 0x7f48b01620f0 2024-09-17T03:43:16.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.166+0000 7f48a5ffb640 1 -- 172.21.15.146:0/772466157 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f48a001a070 con 0x7f48b01620f0 2024-09-17T03:43:16.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.166+0000 7f48a5ffb640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4894078b90 0x7f489407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:16.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.166+0000 7f48a5ffb640 1 -- 172.21.15.146:0/772466157 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f48a0099fa0 con 0x7f48b01620f0 2024-09-17T03:43:16.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.166+0000 7f48b57a6640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4894078b90 0x7f489407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:16.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.167+0000 7f48b57a6640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4894078b90 0x7f489407b0a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00bb50 tx=0x7f48ac00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:16.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.171+0000 7f48a5ffb640 1 -- 172.21.15.146:0/772466157 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f48a0061e20 con 0x7f48b01620f0 2024-09-17T03:43:16.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.384+0000 7f48b7a0a640 1 -- 172.21.15.146:0/772466157 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48b0150ce0 con 0x7f48b01620f0 2024-09-17T03:43:16.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.385+0000 7f48a5ffb640 1 -- 172.21.15.146:0/772466157 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7f48a0066850 con 0x7f48b01620f0 2024-09-17T03:43:16.384 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:16.384 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:43:16.385 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 -- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4894078b90 msgr2=0x7f489407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4894078b90 0x7f489407b0a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00bb50 tx=0x7f48ac00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 -- 172.21.15.146:0/772466157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b01620f0 msgr2=0x7f48b01501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b01620f0 0x7f48b01501e0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f48a000c370 tx=0x7f48a000c830 comp rx=0 tx=0).stop 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 -- 172.21.15.146:0/772466157 shutdown_connections 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4894078b90 0x7f489407b0a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f48b014df20 0x7f48b014d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b01620f0 0x7f48b01501e0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 --2- 172.21.15.146:0/772466157 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f48b00b3870 0x7f48b00cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 -- 172.21.15.146:0/772466157 >> 172.21.15.146:0/772466157 conn(0x7f48b00d4be0 msgr2=0x7f48b015dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 -- 172.21.15.146:0/772466157 shutdown_connections 2024-09-17T03:43:16.387 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.387+0000 7f48b7a0a640 1 -- 172.21.15.146:0/772466157 wait complete. 2024-09-17T03:43:16.397 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T03:43:16.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:43:16.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.512+0000 7f8d97d20640 1 -- 172.21.15.146:0/3151846488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c003fd0 msgr2=0x7f8d7c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:16.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.512+0000 7f8d97d20640 1 --2- 172.21.15.146:0/3151846488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c003fd0 0x7f8d7c004800 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000c290 tx=0x7f8d7c005830 comp rx=0 tx=0).stop 2024-09-17T03:43:16.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.512+0000 7f8d962bd640 1 -- 172.21.15.146:0/3151846488 reap_dead start 2024-09-17T03:43:16.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.512+0000 7f8d97d20640 1 -- 172.21.15.146:0/3151846488 shutdown_connections 2024-09-17T03:43:16.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.512+0000 7f8d97d20640 1 -- 172.21.15.146:0/3151846488 >> 172.21.15.146:0/3151846488 conn(0x7f8d9006d3c0 msgr2=0x7f8d900b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:16.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.512+0000 7f8d97d20640 1 -- 172.21.15.146:0/3151846488 shutdown_connections 2024-09-17T03:43:16.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.512+0000 7f8d97d20640 1 -- 172.21.15.146:0/3151846488 wait complete. 2024-09-17T03:43:16.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.514+0000 7f8d97d20640 1 Processor -- start 2024-09-17T03:43:16.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.514+0000 7f8d97d20640 1 -- start start 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.515+0000 7f8d97d20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d7c003fd0 0x7f8d9015bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.515+0000 7f8d97d20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901438a0 0x7f8d900cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.515+0000 7f8d97d20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d900cf450 0x7f8d900cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.515+0000 7f8d97d20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8d900703c0 con 0x7f8d901438a0 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.515+0000 7f8d97d20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8d90070240 con 0x7f8d7c003fd0 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.515+0000 7f8d97d20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8d90070540 con 0x7f8d900cf450 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.515+0000 7f8d952bb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901438a0 0x7f8d900cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.515+0000 7f8d952bb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901438a0 0x7f8d900cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51516/0 (socket says 172.21.15.146:51516) 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.515+0000 7f8d952bb640 1 -- 172.21.15.146:0/15590877 learned_addr learned my addr 172.21.15.146:0/15590877 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d962bd640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d900cf450 0x7f8d900cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d95abc640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d7c003fd0 0x7f8d9015bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:16.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d952bb640 1 -- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d900cf450 msgr2=0x7f8d900cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d952bb640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d900cf450 0x7f8d900cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d952bb640 1 -- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d7c003fd0 msgr2=0x7f8d9015bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d952bb640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d7c003fd0 0x7f8d9015bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d952bb640 1 -- 172.21.15.146:0/15590877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d900cf860 con 0x7f8d901438a0 2024-09-17T03:43:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d962bd640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d900cf450 0x7f8d900cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d952bb640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901438a0 0x7f8d900cef10 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000c3b0 tx=0x7f8d80001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d867fc640 1 -- 172.21.15.146:0/15590877 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80031040 con 0x7f8d901438a0 2024-09-17T03:43:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d867fc640 1 -- 172.21.15.146:0/15590877 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d800035f0 con 0x7f8d901438a0 2024-09-17T03:43:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d97d20640 1 -- 172.21.15.146:0/15590877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d901e9430 con 0x7f8d901438a0 2024-09-17T03:43:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d867fc640 1 -- 172.21.15.146:0/15590877 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80003a20 con 0x7f8d901438a0 2024-09-17T03:43:16.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.516+0000 7f8d97d20640 1 -- 172.21.15.146:0/15590877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d901e99f0 con 0x7f8d901438a0 2024-09-17T03:43:16.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.517+0000 7f8d97d20640 1 -- 172.21.15.146:0/15590877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d901e91a0 con 0x7f8d901438a0 2024-09-17T03:43:16.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.518+0000 7f8d867fc640 1 -- 172.21.15.146:0/15590877 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d80034070 con 0x7f8d901438a0 2024-09-17T03:43:16.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.519+0000 7f8d867fc640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d74078b90 0x7f8d7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:16.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.519+0000 7f8d867fc640 1 -- 172.21.15.146:0/15590877 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f8d800baca0 con 0x7f8d901438a0 2024-09-17T03:43:16.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.519+0000 7f8d95abc640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d74078b90 0x7f8d7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:16.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.519+0000 7f8d95abc640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d74078b90 0x7f8d7407b0a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009bb0 tx=0x7f8d8c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:16.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.523+0000 7f8d867fc640 1 -- 172.21.15.146:0/15590877 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8d900cf860 con 0x7f8d901438a0 2024-09-17T03:43:16.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.770+0000 7f8d97d20640 1 -- 172.21.15.146:0/15590877 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8d9006fd00 con 0x7f8d901438a0 2024-09-17T03:43:16.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.771+0000 7f8d867fc640 1 -- 172.21.15.146:0/15590877 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f8d800830e0 con 0x7f8d901438a0 2024-09-17T03:43:16.770 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:16.770 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":641,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076737307,"bytes_used":2606325760,"bytes_avail":770487787520,"bytes_total":773094113280,"write_bytes_sec":81811215,"read_op_per_sec":0,"write_op_per_sec":87},"fsmap":{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9783}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-17T03:43:15.954703+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:43:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 -- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d74078b90 msgr2=0x7f8d7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d74078b90 0x7f8d7407b0a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009bb0 tx=0x7f8d8c005f90 comp rx=0 tx=0).stop 2024-09-17T03:43:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 -- 172.21.15.146:0/15590877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901438a0 msgr2=0x7f8d900cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901438a0 0x7f8d900cef10 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000c3b0 tx=0x7f8d80001d20 comp rx=0 tx=0).stop 2024-09-17T03:43:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 -- 172.21.15.146:0/15590877 shutdown_connections 2024-09-17T03:43:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8d74078b90 0x7f8d7407b0a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8d900cf450 0x7f8d900cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d901438a0 0x7f8d900cef10 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 --2- 172.21.15.146:0/15590877 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d7c003fd0 0x7f8d9015bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 -- 172.21.15.146:0/15590877 >> 172.21.15.146:0/15590877 conn(0x7f8d9006d3c0 msgr2=0x7f8d9015e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 -- 172.21.15.146:0/15590877 shutdown_connections 2024-09-17T03:43:16.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:16.773+0000 7f8d97d20640 1 -- 172.21.15.146:0/15590877 wait complete. 2024-09-17T03:43:16.783 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-17T03:43:16.784 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:43:16.784 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:43:16.794 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:43:16.794 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'d', 'b', 'a'} 2024-09-17T03:43:16.795 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-09-17T03:43:16.948 INFO:teuthology.orchestra.run.smithi146.stdout:{"mds_beacon_grace":"15.000000"} 2024-09-17T03:43:16.948 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-09-17T03:43:16.948 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:17.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.062+0000 7f1544a7e640 1 -- 172.21.15.146:0/3857344083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15400cd840 msgr2=0x7f15400b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:17.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.062+0000 7f1544a7e640 1 --2- 172.21.15.146:0/3857344083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15400cd840 0x7f15400b5680 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f1534009830 tx=0x7f153402a480 comp rx=0 tx=0).stop 2024-09-17T03:43:17.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.062+0000 7f1544a7e640 1 -- 172.21.15.146:0/3857344083 shutdown_connections 2024-09-17T03:43:17.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.062+0000 7f1544a7e640 1 --2- 172.21.15.146:0/3857344083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15400cd840 0x7f15400b5680 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:17.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.062+0000 7f1544a7e640 1 --2- 172.21.15.146:0/3857344083 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f154015c8e0 0x7f154006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:17.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.062+0000 7f1544a7e640 1 -- 172.21.15.146:0/3857344083 >> 172.21.15.146:0/3857344083 conn(0x7f15400b3150 msgr2=0x7f15400b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:17.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.062+0000 7f1544a7e640 1 -- 172.21.15.146:0/3857344083 shutdown_connections 2024-09-17T03:43:17.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.062+0000 7f1544a7e640 1 -- 172.21.15.146:0/3857344083 wait complete. 2024-09-17T03:43:17.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.064+0000 7f1544a7e640 1 Processor -- start 2024-09-17T03:43:17.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.064+0000 7f1544a7e640 1 -- start start 2024-09-17T03:43:17.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.065+0000 7f1544a7e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15400cd840 0x7f154014d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:17.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.065+0000 7f1544a7e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15400cdc50 0x7f1540150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:17.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.065+0000 7f1544a7e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f154015c8e0 0x7f15401514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:17.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.065+0000 7f1544a7e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f15400b5f50 con 0x7f15400cdc50 2024-09-17T03:43:17.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.065+0000 7f1544a7e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f15400b5dd0 con 0x7f15400cd840 2024-09-17T03:43:17.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.065+0000 7f1544a7e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1540073580 con 0x7f154015c8e0 2024-09-17T03:43:17.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.065+0000 7f153dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15400cdc50 0x7f1540150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:17.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.065+0000 7f153dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15400cdc50 0x7f1540150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51538/0 (socket says 172.21.15.146:51538) 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.065+0000 7f153dd9b640 1 -- 172.21.15.146:0/1208249112 learned_addr learned my addr 172.21.15.146:0/1208249112 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f153ed9d640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f154015c8e0 0x7f15401514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f153e59c640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15400cd840 0x7f154014d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f153dd9b640 1 -- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f154015c8e0 msgr2=0x7f15401514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f153dd9b640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f154015c8e0 0x7f15401514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f153dd9b640 1 -- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15400cd840 msgr2=0x7f154014d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f153dd9b640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15400cd840 0x7f154014d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f153dd9b640 1 -- 172.21.15.146:0/1208249112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15401f64a0 con 0x7f15400cdc50 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f153ed9d640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f154015c8e0 0x7f15401514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f153e59c640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15400cd840 0x7f154014d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f153dd9b640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15400cdc50 0x7f1540150f70 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f1534009950 tx=0x7f1534033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f152effd640 1 -- 172.21.15.146:0/1208249112 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1534031d60 con 0x7f15400cdc50 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f152effd640 1 -- 172.21.15.146:0/1208249112 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1534033e10 con 0x7f15400cdc50 2024-09-17T03:43:17.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f1544a7e640 1 -- 172.21.15.146:0/1208249112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154014d810 con 0x7f15400cdc50 2024-09-17T03:43:17.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f152effd640 1 -- 172.21.15.146:0/1208249112 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1534005260 con 0x7f15400cdc50 2024-09-17T03:43:17.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.066+0000 7f1544a7e640 1 -- 172.21.15.146:0/1208249112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15401f5b70 con 0x7f15400cdc50 2024-09-17T03:43:17.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.067+0000 7f1544a7e640 1 -- 172.21.15.146:0/1208249112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15400b5680 con 0x7f15400cdc50 2024-09-17T03:43:17.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.068+0000 7f152effd640 1 -- 172.21.15.146:0/1208249112 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1534005400 con 0x7f15400cdc50 2024-09-17T03:43:17.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.068+0000 7f152effd640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1520078b90 0x7f152007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:17.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.069+0000 7f152effd640 1 -- 172.21.15.146:0/1208249112 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f15340bc050 con 0x7f15400cdc50 2024-09-17T03:43:17.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.069+0000 7f153e59c640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1520078b90 0x7f152007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:17.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.069+0000 7f153e59c640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1520078b90 0x7f152007b0a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1530005c40 tx=0x7f153000a410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:17.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.073+0000 7f152effd640 1 -- 172.21.15.146:0/1208249112 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f153403f030 con 0x7f15400cdc50 2024-09-17T03:43:17.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.289+0000 7f1544a7e640 1 -- 172.21.15.146:0/1208249112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15401545b0 con 0x7f15400cdc50 2024-09-17T03:43:17.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.289+0000 7f152effd640 1 -- 172.21.15.146:0/1208249112 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7f1534084520 con 0x7f15400cdc50 2024-09-17T03:43:17.289 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:17.289 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:43:17.289 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:43:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.291+0000 7f1544a7e640 1 -- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1520078b90 msgr2=0x7f152007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.291+0000 7f1544a7e640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1520078b90 0x7f152007b0a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1530005c40 tx=0x7f153000a410 comp rx=0 tx=0).stop 2024-09-17T03:43:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.292+0000 7f1544a7e640 1 -- 172.21.15.146:0/1208249112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15400cdc50 msgr2=0x7f1540150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.292+0000 7f1544a7e640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15400cdc50 0x7f1540150f70 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f1534009950 tx=0x7f1534033c20 comp rx=0 tx=0).stop 2024-09-17T03:43:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.292+0000 7f1544a7e640 1 -- 172.21.15.146:0/1208249112 shutdown_connections 2024-09-17T03:43:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.292+0000 7f1544a7e640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1520078b90 0x7f152007b0a0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.292+0000 7f1544a7e640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f154015c8e0 0x7f15401514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.292+0000 7f1544a7e640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15400cdc50 0x7f1540150f70 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.292+0000 7f1544a7e640 1 --2- 172.21.15.146:0/1208249112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15400cd840 0x7f154014d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.292+0000 7f1544a7e640 1 -- 172.21.15.146:0/1208249112 >> 172.21.15.146:0/1208249112 conn(0x7f15400b3150 msgr2=0x7f15400b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.292+0000 7f1544a7e640 1 -- 172.21.15.146:0/1208249112 shutdown_connections 2024-09-17T03:43:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:17.292+0000 7f1544a7e640 1 -- 172.21.15.146:0/1208249112 wait complete. 2024-09-17T03:43:17.302 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-17T03:43:22.303 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.431+0000 7f72f8990640 1 -- 172.21.15.146:0/2960605553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f41620f0 msgr2=0x7f72f406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.431+0000 7f72f8990640 1 --2- 172.21.15.146:0/2960605553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f41620f0 0x7f72f406ed30 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f72f4069ce0 tx=0x7f72e802a4b0 comp rx=0 tx=0).stop 2024-09-17T03:43:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.432+0000 7f72f8990640 1 -- 172.21.15.146:0/2960605553 shutdown_connections 2024-09-17T03:43:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.432+0000 7f72f8990640 1 --2- 172.21.15.146:0/2960605553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72f406f270 0x7f72f41628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.432+0000 7f72f8990640 1 --2- 172.21.15.146:0/2960605553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f41620f0 0x7f72f406ed30 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.432+0000 7f72f8990640 1 --2- 172.21.15.146:0/2960605553 >> v2:172.21.15.179:3300/0 conn(0x7f72f40b3870 0x7f72f40cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.432+0000 7f72f8990640 1 -- 172.21.15.146:0/2960605553 >> 172.21.15.146:0/2960605553 conn(0x7f72f40d4be0 msgr2=0x7f72f40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.432+0000 7f72f8990640 1 -- 172.21.15.146:0/2960605553 shutdown_connections 2024-09-17T03:43:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.432+0000 7f72f8990640 1 -- 172.21.15.146:0/2960605553 wait complete. 2024-09-17T03:43:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.434+0000 7f72f8990640 1 Processor -- start 2024-09-17T03:43:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.434+0000 7f72f8990640 1 -- start start 2024-09-17T03:43:22.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f8990640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72f406f270 0x7f72f40b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:22.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f8990640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f40b3870 0x7f72f40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:22.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f8990640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72f41620f0 0x7f72f415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:22.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f8990640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4163170 con 0x7f72f40b3870 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f8990640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4162ff0 con 0x7f72f406f270 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f8990640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f72f41632f0 con 0x7f72f41620f0 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f40b3870 0x7f72f40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f40b3870 0x7f72f40c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39148/0 (socket says 172.21.15.146:39148) 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f1d9b640 1 -- 172.21.15.146:0/3125256536 learned_addr learned my addr 172.21.15.146:0/3125256536 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f259c640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72f406f270 0x7f72f40b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f2d9d640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72f41620f0 0x7f72f415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f1d9b640 1 -- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72f41620f0 msgr2=0x7f72f415ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f1d9b640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72f41620f0 0x7f72f415ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f1d9b640 1 -- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72f406f270 msgr2=0x7f72f40b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f1d9b640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72f406f270 0x7f72f40b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.435+0000 7f72f1d9b640 1 -- 172.21.15.146:0/3125256536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f40ca2c0 con 0x7f72f40b3870 2024-09-17T03:43:22.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.436+0000 7f72f1d9b640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f40b3870 0x7f72f40c9d80 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f72e8005fd0 tx=0x7f72e80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.436+0000 7f72e2ffd640 1 -- 172.21.15.146:0/3125256536 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e803e030 con 0x7f72f40b3870 2024-09-17T03:43:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.436+0000 7f72e2ffd640 1 -- 172.21.15.146:0/3125256536 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72e80047a0 con 0x7f72f40b3870 2024-09-17T03:43:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.436+0000 7f72f8990640 1 -- 172.21.15.146:0/3125256536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f41f6810 con 0x7f72f40b3870 2024-09-17T03:43:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.436+0000 7f72e2ffd640 1 -- 172.21.15.146:0/3125256536 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8035040 con 0x7f72f40b3870 2024-09-17T03:43:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.436+0000 7f72f8990640 1 -- 172.21.15.146:0/3125256536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f41f6dd0 con 0x7f72f40b3870 2024-09-17T03:43:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.437+0000 7f72f8990640 1 -- 172.21.15.146:0/3125256536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f41f6580 con 0x7f72f40b3870 2024-09-17T03:43:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.438+0000 7f72e2ffd640 1 -- 172.21.15.146:0/3125256536 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72e8041030 con 0x7f72f40b3870 2024-09-17T03:43:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.438+0000 7f72e2ffd640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72d4078bc0 0x7f72d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.438+0000 7f72e2ffd640 1 -- 172.21.15.146:0/3125256536 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f72e80bb480 con 0x7f72f40b3870 2024-09-17T03:43:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.439+0000 7f72f259c640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72d4078bc0 0x7f72d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.439+0000 7f72f259c640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72d4078bc0 0x7f72d407b0d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f72e4005fd0 tx=0x7f72e400a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.443+0000 7f72e2ffd640 1 -- 172.21.15.146:0/3125256536 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72e8083390 con 0x7f72f40b3870 2024-09-17T03:43:22.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.658+0000 7f72f8990640 1 -- 172.21.15.146:0/3125256536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72f415f770 con 0x7f72f40b3870 2024-09-17T03:43:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.659+0000 7f72e2ffd640 1 -- 172.21.15.146:0/3125256536 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7f72f415f770 con 0x7f72f40b3870 2024-09-17T03:43:22.658 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:22.658 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:43:22.658 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:43:22.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 -- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72d4078bc0 msgr2=0x7f72d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:22.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72d4078bc0 0x7f72d407b0d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f72e4005fd0 tx=0x7f72e400a250 comp rx=0 tx=0).stop 2024-09-17T03:43:22.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 -- 172.21.15.146:0/3125256536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f40b3870 msgr2=0x7f72f40c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:22.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f40b3870 0x7f72f40c9d80 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f72e8005fd0 tx=0x7f72e80039e0 comp rx=0 tx=0).stop 2024-09-17T03:43:22.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 -- 172.21.15.146:0/3125256536 shutdown_connections 2024-09-17T03:43:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f72d4078bc0 0x7f72d407b0d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72f41620f0 0x7f72f415ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72f40b3870 0x7f72f40c9d80 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 --2- 172.21.15.146:0/3125256536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72f406f270 0x7f72f40b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 -- 172.21.15.146:0/3125256536 >> 172.21.15.146:0/3125256536 conn(0x7f72f40d4be0 msgr2=0x7f72f40d3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 -- 172.21.15.146:0/3125256536 shutdown_connections 2024-09-17T03:43:22.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:22.661+0000 7f72f8990640 1 -- 172.21.15.146:0/3125256536 wait complete. 2024-09-17T03:43:22.672 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-17T03:43:27.673 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.801+0000 7f5bd18f9640 1 -- 172.21.15.146:0/1867495429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bcc0d0710 msgr2=0x7f5bcc0cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.801+0000 7f5bd18f9640 1 --2- 172.21.15.146:0/1867495429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bcc0d0710 0x7f5bcc0cf170 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0d0b20 tx=0x7f5bbc02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:43:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.801+0000 7f5bd18f9640 1 -- 172.21.15.146:0/1867495429 shutdown_connections 2024-09-17T03:43:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.801+0000 7f5bd18f9640 1 --2- 172.21.15.146:0/1867495429 >> v2:172.21.15.179:3300/0 conn(0x7f5bcc0cf6b0 0x7f5bcc161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.801+0000 7f5bd18f9640 1 --2- 172.21.15.146:0/1867495429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bcc0d0710 0x7f5bcc0cf170 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.801+0000 7f5bd18f9640 1 -- 172.21.15.146:0/1867495429 >> 172.21.15.146:0/1867495429 conn(0x7f5bcc09ba20 msgr2=0x7f5bcc0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.801+0000 7f5bd18f9640 1 -- 172.21.15.146:0/1867495429 shutdown_connections 2024-09-17T03:43:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.801+0000 7f5bd18f9640 1 -- 172.21.15.146:0/1867495429 wait complete. 2024-09-17T03:43:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.803+0000 7f5bd18f9640 1 Processor -- start 2024-09-17T03:43:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.803+0000 7f5bd18f9640 1 -- start start 2024-09-17T03:43:27.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.804+0000 7f5bd18f9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bcc0b47c0 0x7f5bcc15f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:27.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.804+0000 7f5bd18f9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bcc0cf6b0 0x7f5bcc0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:27.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.804+0000 7f5bd18f9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bcc0d0710 0x7f5bcc0cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:27.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bd18f9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc0b1de0 con 0x7f5bcc0b47c0 2024-09-17T03:43:27.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bd18f9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc162080 con 0x7f5bcc0cf6b0 2024-09-17T03:43:27.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bd18f9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5bcc0b1f60 con 0x7f5bcc0d0710 2024-09-17T03:43:27.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bcaffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bcc0b47c0 0x7f5bcc15f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:27.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bcaffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bcc0b47c0 0x7f5bcc15f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38668/0 (socket says 172.21.15.146:38668) 2024-09-17T03:43:27.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bcaffd640 1 -- 172.21.15.146:0/2277365246 learned_addr learned my addr 172.21.15.146:0/2277365246 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:27.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bca7fc640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bcc0cf6b0 0x7f5bcc0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:27.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bcb7fe640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bcc0d0710 0x7f5bcc0cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:27.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bcaffd640 1 -- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bcc0d0710 msgr2=0x7f5bcc0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:27.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bcaffd640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bcc0d0710 0x7f5bcc0cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:27.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bcaffd640 1 -- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bcc0cf6b0 msgr2=0x7f5bcc0cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:27.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bcaffd640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bcc0cf6b0 0x7f5bcc0cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:27.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bcaffd640 1 -- 172.21.15.146:0/2277365246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc0cac50 con 0x7f5bcc0b47c0 2024-09-17T03:43:27.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bcaffd640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bcc0b47c0 0x7f5bcc15f610 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc034040 tx=0x7f5bbc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:27.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bb3fff640 1 -- 172.21.15.146:0/2277365246 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc03e030 con 0x7f5bcc0b47c0 2024-09-17T03:43:27.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bb3fff640 1 -- 172.21.15.146:0/2277365246 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bbc0047a0 con 0x7f5bcc0b47c0 2024-09-17T03:43:27.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bd18f9640 1 -- 172.21.15.146:0/2277365246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bcc1e8390 con 0x7f5bcc0b47c0 2024-09-17T03:43:27.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bb3fff640 1 -- 172.21.15.146:0/2277365246 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc035040 con 0x7f5bcc0b47c0 2024-09-17T03:43:27.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.805+0000 7f5bd18f9640 1 -- 172.21.15.146:0/2277365246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bcc15fff0 con 0x7f5bcc0b47c0 2024-09-17T03:43:27.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.806+0000 7f5bd18f9640 1 -- 172.21.15.146:0/2277365246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bcc0cf170 con 0x7f5bcc0b47c0 2024-09-17T03:43:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.807+0000 7f5bb3fff640 1 -- 172.21.15.146:0/2277365246 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5bbc041030 con 0x7f5bcc0b47c0 2024-09-17T03:43:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.808+0000 7f5bb3fff640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bb8078b90 0x7f5bb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.808+0000 7f5bb3fff640 1 -- 172.21.15.146:0/2277365246 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f5bbc0bb5a0 con 0x7f5bcc0b47c0 2024-09-17T03:43:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.808+0000 7f5bca7fc640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bb8078b90 0x7f5bb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.808+0000 7f5bca7fc640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bb8078b90 0x7f5bb807b0a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0005d70 tx=0x7f5bc0005d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:27.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:27.812+0000 7f5bb3fff640 1 -- 172.21.15.146:0/2277365246 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5bbc083b00 con 0x7f5bcc0b47c0 2024-09-17T03:43:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.021+0000 7f5bd18f9640 1 -- 172.21.15.146:0/2277365246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bcc0ced70 con 0x7f5bcc0b47c0 2024-09-17T03:43:28.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.022+0000 7f5bb3fff640 1 -- 172.21.15.146:0/2277365246 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7f5bbc083400 con 0x7f5bcc0b47c0 2024-09-17T03:43:28.021 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:28.021 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:43:28.022 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:43:28.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 -- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bb8078b90 msgr2=0x7f5bb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bb8078b90 0x7f5bb807b0a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0005d70 tx=0x7f5bc0005d00 comp rx=0 tx=0).stop 2024-09-17T03:43:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 -- 172.21.15.146:0/2277365246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bcc0b47c0 msgr2=0x7f5bcc15f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bcc0b47c0 0x7f5bcc15f610 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc034040 tx=0x7f5bbc0039e0 comp rx=0 tx=0).stop 2024-09-17T03:43:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 -- 172.21.15.146:0/2277365246 shutdown_connections 2024-09-17T03:43:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bb8078b90 0x7f5bb807b0a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bcc0d0710 0x7f5bcc0cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bcc0cf6b0 0x7f5bcc0cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 --2- 172.21.15.146:0/2277365246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bcc0b47c0 0x7f5bcc15f610 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 -- 172.21.15.146:0/2277365246 >> 172.21.15.146:0/2277365246 conn(0x7f5bcc09ba20 msgr2=0x7f5bcc0b7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 -- 172.21.15.146:0/2277365246 shutdown_connections 2024-09-17T03:43:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:28.024+0000 7f5bd18f9640 1 -- 172.21.15.146:0/2277365246 wait complete. 2024-09-17T03:43:28.035 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-17T03:43:29.086 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:43:29.089 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:43:33.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:33.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.163+0000 7fe8fffff640 1 -- 172.21.15.146:0/1843805474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9000b35c0 msgr2=0x7fe9000b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:33.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.163+0000 7fe8fffff640 1 --2- 172.21.15.146:0/1843805474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9000b35c0 0x7fe9000b2750 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0005fd0 tx=0x7fe8f002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:43:33.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.163+0000 7fe8fffff640 1 -- 172.21.15.146:0/1843805474 shutdown_connections 2024-09-17T03:43:33.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.163+0000 7fe8fffff640 1 --2- 172.21.15.146:0/1843805474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9000b35c0 0x7fe9000b2750 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:33.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.163+0000 7fe8fffff640 1 -- 172.21.15.146:0/1843805474 >> 172.21.15.146:0/1843805474 conn(0x7fe9000b6660 msgr2=0x7fe9000b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:33.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.163+0000 7fe8fffff640 1 -- 172.21.15.146:0/1843805474 shutdown_connections 2024-09-17T03:43:33.164 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.163+0000 7fe8fffff640 1 -- 172.21.15.146:0/1843805474 wait complete. 2024-09-17T03:43:33.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.165+0000 7fe8fffff640 1 Processor -- start 2024-09-17T03:43:33.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.165+0000 7fe8fffff640 1 -- start start 2024-09-17T03:43:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.166+0000 7fe8fffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9000b35c0 0x7fe90009ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8fffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe900160240 0x7fe9001e8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8fffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe90014f5b0 0x7fe9001e9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8fffff640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe9001536b0 con 0x7fe90014f5b0 2024-09-17T03:43:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8fffff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe900153530 con 0x7fe900160240 2024-09-17T03:43:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8fffff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe900153830 con 0x7fe9000b35c0 2024-09-17T03:43:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8ff7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe90014f5b0 0x7fe9001e9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8ff7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe90014f5b0 0x7fe9001e9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38692/0 (socket says 172.21.15.146:38692) 2024-09-17T03:43:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8ff7fe640 1 -- 172.21.15.146:0/2056212816 learned_addr learned my addr 172.21.15.146:0/2056212816 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8fe7fc640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe900160240 0x7fe9001e8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8feffd640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9000b35c0 0x7fe90009ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8ff7fe640 1 -- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9000b35c0 msgr2=0x7fe90009ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8ff7fe640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9000b35c0 0x7fe90009ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8ff7fe640 1 -- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe900160240 msgr2=0x7fe9001e8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8ff7fe640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe900160240 0x7fe9001e8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8ff7fe640 1 -- 172.21.15.146:0/2056212816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe900156c20 con 0x7fe90014f5b0 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8feffd640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9000b35c0 0x7fe90009ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8ff7fe640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe90014f5b0 0x7fe9001e9490 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800b440 tx=0x7fe8f800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8f77fe640 1 -- 172.21.15.146:0/2056212816 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8011830 con 0x7fe90014f5b0 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8f77fe640 1 -- 172.21.15.146:0/2056212816 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8f8016070 con 0x7fe90014f5b0 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8f77fe640 1 -- 172.21.15.146:0/2056212816 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8011d60 con 0x7fe90014f5b0 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8fffff640 1 -- 172.21.15.146:0/2056212816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9001f6a80 con 0x7fe90014f5b0 2024-09-17T03:43:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.167+0000 7fe8fffff640 1 -- 172.21.15.146:0/2056212816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9001f7040 con 0x7fe90014f5b0 2024-09-17T03:43:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.168+0000 7fe8fffff640 1 -- 172.21.15.146:0/2056212816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9000b2750 con 0x7fe90014f5b0 2024-09-17T03:43:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.169+0000 7fe8f77fe640 1 -- 172.21.15.146:0/2056212816 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8f801b460 con 0x7fe90014f5b0 2024-09-17T03:43:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.170+0000 7fe8f77fe640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8e0078b90 0x7fe8e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.170+0000 7fe8f77fe640 1 -- 172.21.15.146:0/2056212816 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fe8f809a6e0 con 0x7fe90014f5b0 2024-09-17T03:43:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.170+0000 7fe8feffd640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8e0078b90 0x7fe8e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.171+0000 7fe8feffd640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8e0078b90 0x7fe8e007b0a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0034000 tx=0x7fe8f0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:33.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.174+0000 7fe8f77fe640 1 -- 172.21.15.146:0/2056212816 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8f8020020 con 0x7fe90014f5b0 2024-09-17T03:43:33.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.388+0000 7fe8fffff640 1 -- 172.21.15.146:0/2056212816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe90006f4d0 con 0x7fe90014f5b0 2024-09-17T03:43:33.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.388+0000 7fe8f77fe640 1 -- 172.21.15.146:0/2056212816 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5242 (secure 0 0 0) 0x7fe900156c20 con 0x7fe90014f5b0 2024-09-17T03:43:33.389 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:33.389 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"btime":"2024-09-17T03:42:55:184009+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":8545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:42:54.541307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9783},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9783":{"gid":9783,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/2786424389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2786424389},{"type":"v1","addr":"172.21.15.146:6835","nonce":2786424389}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9783,"qdb_cluster":[9783]},"id":11}]} 2024-09-17T03:43:33.389 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 113 2024-09-17T03:43:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 -- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8e0078b90 msgr2=0x7fe8e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8e0078b90 0x7fe8e007b0a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0034000 tx=0x7fe8f0004ab0 comp rx=0 tx=0).stop 2024-09-17T03:43:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 -- 172.21.15.146:0/2056212816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe90014f5b0 msgr2=0x7fe9001e9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe90014f5b0 0x7fe9001e9490 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800b440 tx=0x7fe8f800b900 comp rx=0 tx=0).stop 2024-09-17T03:43:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 -- 172.21.15.146:0/2056212816 shutdown_connections 2024-09-17T03:43:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8e0078b90 0x7fe8e007b0a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe90014f5b0 0x7fe9001e9490 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe900160240 0x7fe9001e8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 --2- 172.21.15.146:0/2056212816 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9000b35c0 0x7fe90009ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 -- 172.21.15.146:0/2056212816 >> 172.21.15.146:0/2056212816 conn(0x7fe9000b6660 msgr2=0x7fe9000b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 -- 172.21.15.146:0/2056212816 shutdown_connections 2024-09-17T03:43:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:33.391+0000 7fe8fffff640 1 -- 172.21.15.146:0/2056212816 wait complete. 2024-09-17T03:43:33.402 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-17T03:43:38.403 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.527+0000 7f448c1df640 1 -- 172.21.15.146:0/2434949870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44840d3ce0 msgr2=0x7f448415ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.527+0000 7f448c1df640 1 --2- 172.21.15.146:0/2434949870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44840d3ce0 0x7f448415ec30 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f44840b7680 tx=0x7f447c02aac0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.528+0000 7f448c1df640 1 -- 172.21.15.146:0/2434949870 shutdown_connections 2024-09-17T03:43:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.528+0000 7f448c1df640 1 --2- 172.21.15.146:0/2434949870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44840d3ce0 0x7f448415ec30 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.528+0000 7f448c1df640 1 --2- 172.21.15.146:0/2434949870 >> v2:172.21.15.179:3300/0 conn(0x7f4484069410 0x7f44840b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.528+0000 7f448c1df640 1 -- 172.21.15.146:0/2434949870 >> 172.21.15.146:0/2434949870 conn(0x7f44840d4960 msgr2=0x7f44840d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.528+0000 7f448c1df640 1 -- 172.21.15.146:0/2434949870 shutdown_connections 2024-09-17T03:43:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.528+0000 7f448c1df640 1 -- 172.21.15.146:0/2434949870 wait complete. 2024-09-17T03:43:38.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.529+0000 7f448c1df640 1 Processor -- start 2024-09-17T03:43:38.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.530+0000 7f448c1df640 1 -- start start 2024-09-17T03:43:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448c1df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44840b36b0 0x7f4484153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448c1df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44840d3ce0 0x7f44841f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:38.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448c1df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44841678a0 0x7f448415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448c1df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4484168c50 con 0x7f44840d3ce0 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448c1df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4484168ad0 con 0x7f44840b36b0 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448c1df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4484168dd0 con 0x7f44841678a0 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448977a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44840d3ce0 0x7f44841f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448977a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44840d3ce0 0x7f44841f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57360/0 (socket says 172.21.15.146:57360) 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448977a640 1 -- 172.21.15.146:0/3160300856 learned_addr learned my addr 172.21.15.146:0/3160300856 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f4489f7b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44840b36b0 0x7f4484153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448a77c640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44841678a0 0x7f448415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448977a640 1 -- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44841678a0 msgr2=0x7f448415bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448977a640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44841678a0 0x7f448415bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448977a640 1 -- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44840b36b0 msgr2=0x7f4484153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448977a640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44840b36b0 0x7f4484153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.531+0000 7f448977a640 1 -- 172.21.15.146:0/3160300856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4484160750 con 0x7f44840d3ce0 2024-09-17T03:43:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.532+0000 7f448977a640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44840d3ce0 0x7f44841f6150 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f447400e790 tx=0x7f447400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.532+0000 7f447a7fc640 1 -- 172.21.15.146:0/3160300856 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447400eea0 con 0x7f44840d3ce0 2024-09-17T03:43:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.532+0000 7f447a7fc640 1 -- 172.21.15.146:0/3160300856 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f447400ccc0 con 0x7f44840d3ce0 2024-09-17T03:43:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.532+0000 7f448c1df640 1 -- 172.21.15.146:0/3160300856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4484160c50 con 0x7f44840d3ce0 2024-09-17T03:43:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.532+0000 7f447a7fc640 1 -- 172.21.15.146:0/3160300856 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474004280 con 0x7f44840d3ce0 2024-09-17T03:43:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.532+0000 7f448c1df640 1 -- 172.21.15.146:0/3160300856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44841f5950 con 0x7f44840d3ce0 2024-09-17T03:43:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.533+0000 7f448c1df640 1 -- 172.21.15.146:0/3160300856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44840b3c00 con 0x7f44840d3ce0 2024-09-17T03:43:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.534+0000 7f447a7fc640 1 -- 172.21.15.146:0/3160300856 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44740035f0 con 0x7f44840d3ce0 2024-09-17T03:43:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.534+0000 7f447a7fc640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4468078b90 0x7f446807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.534+0000 7f447a7fc640 1 -- 172.21.15.146:0/3160300856 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5795+0+0 (secure 0 0 0) 0x7f447409b590 con 0x7f44840d3ce0 2024-09-17T03:43:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.535+0000 7f4489f7b640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4468078b90 0x7f446807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.535+0000 7f4489f7b640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4468078b90 0x7f446807b0a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4480001720 tx=0x7f4480009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:38.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.539+0000 7f447a7fc640 1 -- 172.21.15.146:0/3160300856 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4474063320 con 0x7f44840d3ce0 2024-09-17T03:43:38.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.756+0000 7f448c1df640 1 -- 172.21.15.146:0/3160300856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44841609e0 con 0x7f44840d3ce0 2024-09-17T03:43:38.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.757+0000 7f447a7fc640 1 -- 172.21.15.146:0/3160300856 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+4416 (secure 0 0 0) 0x7f4474067d50 con 0x7f44840d3ce0 2024-09-17T03:43:38.757 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:38.757 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":117,"btime":"2024-09-17T03:43:38:382965+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:43:38.382959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":155,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8545":{"gid":8545,"name":"d","rank":0,"incarnation":114,"state":"up:active","state_seq":15,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8545,"qdb_cluster":[8545]},"id":11}]} 2024-09-17T03:43:38.757 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 117 2024-09-17T03:43:38.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 -- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4468078b90 msgr2=0x7f446807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:38.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4468078b90 0x7f446807b0a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4480001720 tx=0x7f4480009040 comp rx=0 tx=0).stop 2024-09-17T03:43:38.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 -- 172.21.15.146:0/3160300856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44840d3ce0 msgr2=0x7f44841f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:38.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44840d3ce0 0x7f44841f6150 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f447400e790 tx=0x7f447400ec50 comp rx=0 tx=0).stop 2024-09-17T03:43:38.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 -- 172.21.15.146:0/3160300856 shutdown_connections 2024-09-17T03:43:38.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4468078b90 0x7f446807b0a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f44841678a0 0x7f448415bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44840d3ce0 0x7f44841f6150 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 --2- 172.21.15.146:0/3160300856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44840b36b0 0x7f4484153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 -- 172.21.15.146:0/3160300856 >> 172.21.15.146:0/3160300856 conn(0x7f44840d4960 msgr2=0x7f44840b9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 -- 172.21.15.146:0/3160300856 shutdown_connections 2024-09-17T03:43:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.759+0000 7f448c1df640 1 -- 172.21.15.146:0/3160300856 wait complete. 2024-09-17T03:43:38.771 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-09-17T03:43:38.771 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.895+0000 7f6429830640 1 -- 172.21.15.146:0/1135581194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64240cd5d0 msgr2=0x7f64240cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.895+0000 7f6429830640 1 --2- 172.21.15.146:0/1135581194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64240cd5d0 0x7f64240cd9e0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f641c005fd0 tx=0x7f641c02a820 comp rx=0 tx=0).stop 2024-09-17T03:43:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.895+0000 7f6429830640 1 -- 172.21.15.146:0/1135581194 shutdown_connections 2024-09-17T03:43:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.895+0000 7f6429830640 1 --2- 172.21.15.146:0/1135581194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64240cd5d0 0x7f64240cd9e0 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.895+0000 7f6429830640 1 --2- 172.21.15.146:0/1135581194 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64240b47c0 0x7f64240cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.895+0000 7f6429830640 1 -- 172.21.15.146:0/1135581194 >> 172.21.15.146:0/1135581194 conn(0x7f642409ba20 msgr2=0x7f64240b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.895+0000 7f6429830640 1 -- 172.21.15.146:0/1135581194 shutdown_connections 2024-09-17T03:43:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.895+0000 7f6429830640 1 -- 172.21.15.146:0/1135581194 wait complete. 2024-09-17T03:43:38.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.897+0000 7f6429830640 1 Processor -- start 2024-09-17T03:43:38.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.897+0000 7f6429830640 1 -- start start 2024-09-17T03:43:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.898+0000 7f6429830640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64240b47c0 0x7f64241f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f6429830640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64240cd5d0 0x7f64240cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f6429830640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64240d0710 0x7f64241e8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f6429830640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f64240b1de0 con 0x7f64240cd5d0 2024-09-17T03:43:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f6429830640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f64240b80a0 con 0x7f64240d0710 2024-09-17T03:43:38.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f6429830640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f64240b1f60 con 0x7f64240b47c0 2024-09-17T03:43:38.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f64227fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64240cd5d0 0x7f64240cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:38.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f64227fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64240cd5d0 0x7f64240cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57372/0 (socket says 172.21.15.146:57372) 2024-09-17T03:43:38.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f64227fc640 1 -- 172.21.15.146:0/3134853447 learned_addr learned my addr 172.21.15.146:0/3134853447 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:38.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f6422ffd640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64240b47c0 0x7f64241f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:38.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f64237fe640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64240d0710 0x7f64241e8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:38.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f64227fc640 1 -- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64240b47c0 msgr2=0x7f64241f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:38.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f64227fc640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64240b47c0 0x7f64241f3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f64227fc640 1 -- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64240d0710 msgr2=0x7f64241e8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:38.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f64227fc640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64240d0710 0x7f64241e8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:38.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f64227fc640 1 -- 172.21.15.146:0/3134853447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64240cbe30 con 0x7f64240cd5d0 2024-09-17T03:43:38.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f64227fc640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64240cd5d0 0x7f64240cb8f0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f641800e790 tx=0x7f641800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:38.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f640bfff640 1 -- 172.21.15.146:0/3134853447 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641800eea0 con 0x7f64240cd5d0 2024-09-17T03:43:38.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f640bfff640 1 -- 172.21.15.146:0/3134853447 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f641800cdb0 con 0x7f64240cd5d0 2024-09-17T03:43:38.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f6429830640 1 -- 172.21.15.146:0/3134853447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64241f3e90 con 0x7f64240cd5d0 2024-09-17T03:43:38.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f640bfff640 1 -- 172.21.15.146:0/3134853447 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418010690 con 0x7f64240cd5d0 2024-09-17T03:43:38.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.899+0000 7f6429830640 1 -- 172.21.15.146:0/3134853447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64241f4450 con 0x7f64240cd5d0 2024-09-17T03:43:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.901+0000 7f6429830640 1 -- 172.21.15.146:0/3134853447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64240cd090 con 0x7f64240cd5d0 2024-09-17T03:43:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.902+0000 7f640bfff640 1 -- 172.21.15.146:0/3134853447 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6418010830 con 0x7f64240cd5d0 2024-09-17T03:43:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.902+0000 7f640bfff640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6410078bc0 0x7f641007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.902+0000 7f640bfff640 1 -- 172.21.15.146:0/3134853447 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5795+0+0 (secure 0 0 0) 0x7f641809bf60 con 0x7f64240cd5d0 2024-09-17T03:43:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.902+0000 7f6422ffd640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6410078bc0 0x7f641007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:38.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.903+0000 7f6422ffd640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6410078bc0 0x7f641007b0d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6414001720 tx=0x7f6414007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:38.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:38.906+0000 7f640bfff640 1 -- 172.21.15.146:0/3134853447 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f64240cbe30 con 0x7f64240cd5d0 2024-09-17T03:43:39.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.118+0000 7f6429830640 1 -- 172.21.15.146:0/3134853447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64240cfd50 con 0x7f64240cd5d0 2024-09-17T03:43:39.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.118+0000 7f640bfff640 1 -- 172.21.15.146:0/3134853447 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+4416 (secure 0 0 0) 0x7f6418063cf0 con 0x7f64240cd5d0 2024-09-17T03:43:39.118 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:39.119 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":117,"btime":"2024-09-17T03:43:38:382965+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:43:38.382959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":155,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8545":{"gid":8545,"name":"d","rank":0,"incarnation":114,"state":"up:active","state_seq":15,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8545,"qdb_cluster":[8545]},"id":11}]} 2024-09-17T03:43:39.119 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 117 2024-09-17T03:43:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 -- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6410078bc0 msgr2=0x7f641007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6410078bc0 0x7f641007b0d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6414001720 tx=0x7f6414007e90 comp rx=0 tx=0).stop 2024-09-17T03:43:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 -- 172.21.15.146:0/3134853447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64240cd5d0 msgr2=0x7f64240cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64240cd5d0 0x7f64240cb8f0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f641800e790 tx=0x7f641800ec50 comp rx=0 tx=0).stop 2024-09-17T03:43:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 -- 172.21.15.146:0/3134853447 shutdown_connections 2024-09-17T03:43:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6410078bc0 0x7f641007b0d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f64240d0710 0x7f64241e8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64240cd5d0 0x7f64240cb8f0 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 --2- 172.21.15.146:0/3134853447 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f64240b47c0 0x7f64241f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 -- 172.21.15.146:0/3134853447 >> 172.21.15.146:0/3134853447 conn(0x7f642409ba20 msgr2=0x7f64241e5770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 -- 172.21.15.146:0/3134853447 shutdown_connections 2024-09-17T03:43:39.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.120+0000 7f6429830640 1 -- 172.21.15.146:0/3134853447 wait complete. 2024-09-17T03:43:39.133 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-17T03:43:39.133 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:43:39.140 INFO:tasks.ceph.mds.d.smithi179.stderr:2024-09-17T03:43:39.138+0000 7f206484f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:43:39.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.247+0000 7f3dabf43640 1 -- 172.21.15.146:0/1546368323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da40b5380 msgr2=0x7f3da4166460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:39.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.247+0000 7f3dabf43640 1 --2- 172.21.15.146:0/1546368323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da40b5380 0x7f3da4166460 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c005fd0 tx=0x7f3d9c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.247+0000 7f3dabf43640 1 -- 172.21.15.146:0/1546368323 shutdown_connections 2024-09-17T03:43:39.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.247+0000 7f3dabf43640 1 --2- 172.21.15.146:0/1546368323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da40b5380 0x7f3da4166460 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.247+0000 7f3dabf43640 1 -- 172.21.15.146:0/1546368323 >> 172.21.15.146:0/1546368323 conn(0x7f3da40b2060 msgr2=0x7f3da40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:39.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.247+0000 7f3dabf43640 1 -- 172.21.15.146:0/1546368323 shutdown_connections 2024-09-17T03:43:39.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.247+0000 7f3dabf43640 1 -- 172.21.15.146:0/1546368323 wait complete. 2024-09-17T03:43:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.249+0000 7f3dabf43640 1 Processor -- start 2024-09-17T03:43:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.249+0000 7f3dabf43640 1 -- start start 2024-09-17T03:43:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.250+0000 7f3dabf43640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3da4072680 0x7f3da4152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.250+0000 7f3dabf43640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da40b5380 0x7f3da40abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.250+0000 7f3dabf43640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3da415b770 0x7f3da40ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.250+0000 7f3dabf43640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3da4166d30 con 0x7f3da40b5380 2024-09-17T03:43:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.250+0000 7f3dabf43640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3da4166bb0 con 0x7f3da415b770 2024-09-17T03:43:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.250+0000 7f3dabf43640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3da4166eb0 con 0x7f3da4072680 2024-09-17T03:43:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.250+0000 7f3da94de640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da40b5380 0x7f3da40abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.250+0000 7f3da94de640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da40b5380 0x7f3da40abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57384/0 (socket says 172.21.15.146:57384) 2024-09-17T03:43:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.250+0000 7f3da94de640 1 -- 172.21.15.146:0/2431295756 learned_addr learned my addr 172.21.15.146:0/2431295756 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.250+0000 7f3daa4e0640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3da415b770 0x7f3da40ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.250+0000 7f3da9cdf640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3da4072680 0x7f3da4152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.251+0000 7f3da94de640 1 -- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3da4072680 msgr2=0x7f3da4152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.251+0000 7f3da94de640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3da4072680 0x7f3da4152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.251+0000 7f3da94de640 1 -- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3da415b770 msgr2=0x7f3da40ac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.251+0000 7f3da94de640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3da415b770 0x7f3da40ac170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.251+0000 7f3da94de640 1 -- 172.21.15.146:0/2431295756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da40ae5b0 con 0x7f3da40b5380 2024-09-17T03:43:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.251+0000 7f3da94de640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da40b5380 0x7f3da40abc30 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800c3c0 tx=0x7f3d9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.251+0000 7f3da27fc640 1 -- 172.21.15.146:0/2431295756 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98017070 con 0x7f3da40b5380 2024-09-17T03:43:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.251+0000 7f3da27fc640 1 -- 172.21.15.146:0/2431295756 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d980053c0 con 0x7f3da40b5380 2024-09-17T03:43:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.251+0000 7f3dabf43640 1 -- 172.21.15.146:0/2431295756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da415e8b0 con 0x7f3da40b5380 2024-09-17T03:43:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.251+0000 7f3da27fc640 1 -- 172.21.15.146:0/2431295756 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d980038a0 con 0x7f3da40b5380 2024-09-17T03:43:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.251+0000 7f3dabf43640 1 -- 172.21.15.146:0/2431295756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da40ae870 con 0x7f3da40b5380 2024-09-17T03:43:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.252+0000 7f3dabf43640 1 -- 172.21.15.146:0/2431295756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da415e620 con 0x7f3da40b5380 2024-09-17T03:43:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.253+0000 7f3da27fc640 1 -- 172.21.15.146:0/2431295756 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d9801a070 con 0x7f3da40b5380 2024-09-17T03:43:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.254+0000 7f3da27fc640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3d90078bc0 0x7f3d9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.254+0000 7f3da27fc640 1 -- 172.21.15.146:0/2431295756 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5795+0+0 (secure 0 0 0) 0x7f3d98099f90 con 0x7f3da40b5380 2024-09-17T03:43:39.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.254+0000 7f3da9cdf640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3d90078bc0 0x7f3d9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:39.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.254+0000 7f3da9cdf640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3d90078bc0 0x7f3d9007b0d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3d94000f60 tx=0x7f3d94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.258+0000 7f3da27fc640 1 -- 172.21.15.146:0/2431295756 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3d98061db0 con 0x7f3da40b5380 2024-09-17T03:43:39.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.503+0000 7f3dabf43640 1 -- 172.21.15.146:0/2431295756 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3da406fe10 con 0x7f3da40b5380 2024-09-17T03:43:39.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.504+0000 7f3da27fc640 1 -- 172.21.15.146:0/2431295756 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1485 (secure 0 0 0) 0x7f3d980667e0 con 0x7f3da40b5380 2024-09-17T03:43:39.504 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:39.504 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":664,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":155,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076737307,"bytes_used":2606358528,"bytes_avail":770487754752,"bytes_total":773094113280,"read_bytes_sec":6961,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":117,"btime":"2024-09-17T03:43:38:382965+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":8545}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-09-17T03:43:35.960326+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:43:39.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 -- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3d90078bc0 msgr2=0x7f3d9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:39.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3d90078bc0 0x7f3d9007b0d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3d94000f60 tx=0x7f3d94009040 comp rx=0 tx=0).stop 2024-09-17T03:43:39.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 -- 172.21.15.146:0/2431295756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da40b5380 msgr2=0x7f3da40abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:39.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da40b5380 0x7f3da40abc30 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800c3c0 tx=0x7f3d9800c880 comp rx=0 tx=0).stop 2024-09-17T03:43:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 -- 172.21.15.146:0/2431295756 shutdown_connections 2024-09-17T03:43:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3d90078bc0 0x7f3d9007b0d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3da415b770 0x7f3da40ac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da40b5380 0x7f3da40abc30 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 --2- 172.21.15.146:0/2431295756 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3da4072680 0x7f3da4152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 -- 172.21.15.146:0/2431295756 >> 172.21.15.146:0/2431295756 conn(0x7f3da40b2060 msgr2=0x7f3da40afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 -- 172.21.15.146:0/2431295756 shutdown_connections 2024-09-17T03:43:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.506+0000 7f3dabf43640 1 -- 172.21.15.146:0/2431295756 wait complete. 2024-09-17T03:43:39.518 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:43:39.518 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:43:39.518 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:43:39.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:43:39.596 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:43:39.597 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:43:39.597 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:43:39.597 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:43:39.613 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:43:39.613 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:43:39.671 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:43:39.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.823+0000 7fc099119640 1 -- 172.21.15.146:0/3135042451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0800041c0 msgr2=0x7fc080004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:39.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.823+0000 7fc099119640 1 --2- 172.21.15.146:0/3135042451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0800041c0 0x7fc080004800 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fc07c006f80 tx=0x7fc080005830 comp rx=0 tx=0).stop 2024-09-17T03:43:39.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.823+0000 7fc09359e640 1 -- 172.21.15.146:0/3135042451 reap_dead start 2024-09-17T03:43:39.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.823+0000 7fc099119640 1 -- 172.21.15.146:0/3135042451 shutdown_connections 2024-09-17T03:43:39.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.823+0000 7fc099119640 1 -- 172.21.15.146:0/3135042451 >> 172.21.15.146:0/3135042451 conn(0x7fc09409ba20 msgr2=0x7fc0940b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:39.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.823+0000 7fc099119640 1 -- 172.21.15.146:0/3135042451 shutdown_connections 2024-09-17T03:43:39.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.823+0000 7fc099119640 1 -- 172.21.15.146:0/3135042451 wait complete. 2024-09-17T03:43:39.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.825+0000 7fc099119640 1 Processor -- start 2024-09-17T03:43:39.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.825+0000 7fc099119640 1 -- start start 2024-09-17T03:43:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.826+0000 7fc099119640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0800041c0 0x7fc09415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.826+0000 7fc099119640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0940b1570 0x7fc0940b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.826+0000 7fc099119640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0940b0920 0x7fc09409c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.826+0000 7fc099119640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc0940b2f00 con 0x7fc0940b0920 2024-09-17T03:43:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.826+0000 7fc099119640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc0940b80a0 con 0x7fc0800041c0 2024-09-17T03:43:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.826+0000 7fc099119640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc0940cf170 con 0x7fc0940b1570 2024-09-17T03:43:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.826+0000 7fc09359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0940b0920 0x7fc09409c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.826+0000 7fc09359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0940b0920 0x7fc09409c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57404/0 (socket says 172.21.15.146:57404) 2024-09-17T03:43:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.826+0000 7fc09359e640 1 -- 172.21.15.146:0/4233341231 learned_addr learned my addr 172.21.15.146:0/4233341231 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.826+0000 7fc092d9d640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0800041c0 0x7fc09415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.826+0000 7fc08bfff640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0940b1570 0x7fc0940b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.827+0000 7fc09359e640 1 -- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0940b1570 msgr2=0x7fc0940b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.827+0000 7fc09359e640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0940b1570 0x7fc0940b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.827+0000 7fc09359e640 1 -- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0800041c0 msgr2=0x7fc09415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.827+0000 7fc09359e640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0800041c0 0x7fc09415c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.827+0000 7fc09359e640 1 -- 172.21.15.146:0/4233341231 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0940b0d30 con 0x7fc0940b0920 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.827+0000 7fc09359e640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0940b0920 0x7fc09409c4a0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fc094073550 tx=0x7fc08c006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.827+0000 7fc08b7fe640 1 -- 172.21.15.146:0/4233341231 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c011900 con 0x7fc0940b0920 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.827+0000 7fc08b7fe640 1 -- 172.21.15.146:0/4233341231 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc08c018070 con 0x7fc0940b0920 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.827+0000 7fc08b7fe640 1 -- 172.21.15.146:0/4233341231 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c011d00 con 0x7fc0940b0920 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.827+0000 7fc099119640 1 -- 172.21.15.146:0/4233341231 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0940cbd90 con 0x7fc0940b0920 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.827+0000 7fc099119640 1 -- 172.21.15.146:0/4233341231 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0941f4150 con 0x7fc0940b0920 2024-09-17T03:43:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.828+0000 7fc099119640 1 -- 172.21.15.146:0/4233341231 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0940b3150 con 0x7fc0940b0920 2024-09-17T03:43:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.829+0000 7fc08b7fe640 1 -- 172.21.15.146:0/4233341231 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc08c01d460 con 0x7fc0940b0920 2024-09-17T03:43:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.829+0000 7fc08b7fe640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc074078bc0 0x7fc07407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.829+0000 7fc08b7fe640 1 -- 172.21.15.146:0/4233341231 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5795+0+0 (secure 0 0 0) 0x7fc08c09b550 con 0x7fc0940b0920 2024-09-17T03:43:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.829+0000 7fc092d9d640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc074078bc0 0x7fc07407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:39.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.830+0000 7fc092d9d640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc074078bc0 0x7fc07407b0d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc084009bb0 tx=0x7fc084005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:39.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:39.834+0000 7fc08b7fe640 1 -- 172.21.15.146:0/4233341231 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0940b3150 con 0x7fc0940b0920 2024-09-17T03:43:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.018+0000 7fc099119640 1 -- 172.21.15.146:0/4233341231 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc0940b4f70 con 0x7fc0940b0920 2024-09-17T03:43:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.019+0000 7fc08b7fe640 1 -- 172.21.15.146:0/4233341231 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v155) ==== 80+0+124 (secure 0 0 0) 0x7fc0940b4f70 con 0x7fc0940b0920 2024-09-17T03:43:40.019 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6835/2786424389 2024-09-18T03:43:35.362527+0000 2024-09-17T03:43:40.019 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146:6833/2786424389 2024-09-18T03:43:35.362527+0000 2024-09-17T03:43:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:listed 2 entries 2024-09-17T03:43:40.021 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 -- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc074078bc0 msgr2=0x7fc07407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc074078bc0 0x7fc07407b0d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc084009bb0 tx=0x7fc084005f90 comp rx=0 tx=0).stop 2024-09-17T03:43:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 -- 172.21.15.146:0/4233341231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0940b0920 msgr2=0x7fc09409c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0940b0920 0x7fc09409c4a0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fc094073550 tx=0x7fc08c006430 comp rx=0 tx=0).stop 2024-09-17T03:43:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 -- 172.21.15.146:0/4233341231 shutdown_connections 2024-09-17T03:43:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc074078bc0 0x7fc07407b0d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0940b0920 0x7fc09409c4a0 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc0940b1570 0x7fc0940b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 --2- 172.21.15.146:0/4233341231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0800041c0 0x7fc09415c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 -- 172.21.15.146:0/4233341231 >> 172.21.15.146:0/4233341231 conn(0x7fc09409ba20 msgr2=0x7fc0940cd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:40.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 -- 172.21.15.146:0/4233341231 shutdown_connections 2024-09-17T03:43:40.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.021+0000 7fc099119640 1 -- 172.21.15.146:0/4233341231 wait complete. 2024-09-17T03:43:40.033 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:43:40.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:43:40.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:43:40.091 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:43:40.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:43:40.091 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:43:40.107 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:43:40.107 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:43:40.107 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:43:40.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:43:40.124 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:43:40.124 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:43:40.124 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:43:40.165 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:43:40.165 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:43:40.166 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:43:40.166 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:43:40.183 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:43:40.183 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:40.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.317+0000 7f38d987e640 1 -- 172.21.15.146:0/2443923997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38d406f440 msgr2=0x7f38d4169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.317+0000 7f38d987e640 1 --2- 172.21.15.146:0/2443923997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38d406f440 0x7f38d4169c10 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f38cc005fd0 tx=0x7f38cc02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.317+0000 7f38d987e640 1 -- 172.21.15.146:0/2443923997 shutdown_connections 2024-09-17T03:43:40.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.317+0000 7f38d987e640 1 --2- 172.21.15.146:0/2443923997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38d406f440 0x7f38d4169c10 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.317+0000 7f38d987e640 1 -- 172.21.15.146:0/2443923997 >> 172.21.15.146:0/2443923997 conn(0x7f38d40d4be0 msgr2=0x7f38d40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:40.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.317+0000 7f38d987e640 1 -- 172.21.15.146:0/2443923997 shutdown_connections 2024-09-17T03:43:40.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.317+0000 7f38d987e640 1 -- 172.21.15.146:0/2443923997 wait complete. 2024-09-17T03:43:40.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.319+0000 7f38d987e640 1 Processor -- start 2024-09-17T03:43:40.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.319+0000 7f38d987e640 1 -- start start 2024-09-17T03:43:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d987e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38d40b3870 0x7f38d40ce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d987e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38d40cf370 0x7f38d40c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d987e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38d40cb8a0 0x7f38d41f92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d987e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f38d416a2d0 con 0x7f38d40b3870 2024-09-17T03:43:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d987e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f38d416a150 con 0x7f38d40cf370 2024-09-17T03:43:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d987e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f38d416a450 con 0x7f38d40cb8a0 2024-09-17T03:43:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38d40b3870 0x7f38d40ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38d40b3870 0x7f38d40ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57414/0 (socket says 172.21.15.146:57414) 2024-09-17T03:43:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d2ffd640 1 -- 172.21.15.146:0/1277503472 learned_addr learned my addr 172.21.15.146:0/1277503472 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:40.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38ca7fc640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38d40cf370 0x7f38d40c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d37fe640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38d40cb8a0 0x7f38d41f92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d2ffd640 1 -- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38d40cb8a0 msgr2=0x7f38d41f92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d2ffd640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38d40cb8a0 0x7f38d41f92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d2ffd640 1 -- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38d40cf370 msgr2=0x7f38d40c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d2ffd640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38d40cf370 0x7f38d40c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d2ffd640 1 -- 172.21.15.146:0/1277503472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d40cd7a0 con 0x7f38d40b3870 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d2ffd640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38d40b3870 0x7f38d40ce560 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f38c400c370 tx=0x7f38c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d0ff9640 1 -- 172.21.15.146:0/1277503472 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4017070 con 0x7f38d40b3870 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d0ff9640 1 -- 172.21.15.146:0/1277503472 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38c40035f0 con 0x7f38d40b3870 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d987e640 1 -- 172.21.15.146:0/1277503472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d40cda80 con 0x7f38d40b3870 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d0ff9640 1 -- 172.21.15.146:0/1277503472 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4003a40 con 0x7f38d40b3870 2024-09-17T03:43:40.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.321+0000 7f38d987e640 1 -- 172.21.15.146:0/1277503472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d40ce040 con 0x7f38d40b3870 2024-09-17T03:43:40.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.322+0000 7f38d987e640 1 -- 172.21.15.146:0/1277503472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d41620f0 con 0x7f38d40b3870 2024-09-17T03:43:40.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.323+0000 7f38d0ff9640 1 -- 172.21.15.146:0/1277503472 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38c401a070 con 0x7f38d40b3870 2024-09-17T03:43:40.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.324+0000 7f38d0ff9640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38b4078b90 0x7f38b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:40.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.324+0000 7f38d0ff9640 1 -- 172.21.15.146:0/1277503472 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5795+0+0 (secure 0 0 0) 0x7f38c4099f00 con 0x7f38d40b3870 2024-09-17T03:43:40.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.324+0000 7f38ca7fc640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38b4078b90 0x7f38b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:40.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.325+0000 7f38ca7fc640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38b4078b90 0x7f38b407b0a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f38bc000f60 tx=0x7f38bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:40.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.328+0000 7f38d0ff9640 1 -- 172.21.15.146:0/1277503472 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f38c4061d20 con 0x7f38d40b3870 2024-09-17T03:43:40.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.542+0000 7f38d987e640 1 -- 172.21.15.146:0/1277503472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38d415ae00 con 0x7f38d40b3870 2024-09-17T03:43:40.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.542+0000 7f38d0ff9640 1 -- 172.21.15.146:0/1277503472 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+4416 (secure 0 0 0) 0x7f38c4066750 con 0x7f38d40b3870 2024-09-17T03:43:40.543 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:40.543 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":117,"btime":"2024-09-17T03:43:38:382965+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:43:38.382959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":155,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8545":{"gid":8545,"name":"d","rank":0,"incarnation":114,"state":"up:active","state_seq":15,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8545,"qdb_cluster":[8545]},"id":11}]} 2024-09-17T03:43:40.543 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 117 2024-09-17T03:43:40.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 -- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38b4078b90 msgr2=0x7f38b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38b4078b90 0x7f38b407b0a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f38bc000f60 tx=0x7f38bc009040 comp rx=0 tx=0).stop 2024-09-17T03:43:40.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 -- 172.21.15.146:0/1277503472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38d40b3870 msgr2=0x7f38d40ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38d40b3870 0x7f38d40ce560 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f38c400c370 tx=0x7f38c400c830 comp rx=0 tx=0).stop 2024-09-17T03:43:40.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 -- 172.21.15.146:0/1277503472 shutdown_connections 2024-09-17T03:43:40.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38b4078b90 0x7f38b407b0a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38d40cb8a0 0x7f38d41f92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38d40cf370 0x7f38d40c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 --2- 172.21.15.146:0/1277503472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38d40b3870 0x7f38d40ce560 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 -- 172.21.15.146:0/1277503472 >> 172.21.15.146:0/1277503472 conn(0x7f38d40d4be0 msgr2=0x7f38d40cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:40.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 -- 172.21.15.146:0/1277503472 shutdown_connections 2024-09-17T03:43:40.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.545+0000 7f38d987e640 1 -- 172.21.15.146:0/1277503472 wait complete. 2024-09-17T03:43:40.557 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:40.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.670+0000 7f4d37b62640 1 -- 172.21.15.146:0/893617792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d18003fd0 msgr2=0x7f4d18004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.670+0000 7f4d37b62640 1 --2- 172.21.15.146:0/893617792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d18003fd0 0x7f4d18004800 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f4d24001eb0 tx=0x7f4d18005830 comp rx=0 tx=0).stop 2024-09-17T03:43:40.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.670+0000 7f4d360ff640 1 -- 172.21.15.146:0/893617792 reap_dead start 2024-09-17T03:43:40.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.670+0000 7f4d37b62640 1 -- 172.21.15.146:0/893617792 shutdown_connections 2024-09-17T03:43:40.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.670+0000 7f4d37b62640 1 -- 172.21.15.146:0/893617792 >> 172.21.15.146:0/893617792 conn(0x7f4d3009ba20 msgr2=0x7f4d300b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:40.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.670+0000 7f4d37b62640 1 -- 172.21.15.146:0/893617792 shutdown_connections 2024-09-17T03:43:40.671 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.670+0000 7f4d37b62640 1 -- 172.21.15.146:0/893617792 wait complete. 2024-09-17T03:43:40.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.672+0000 7f4d37b62640 1 Processor -- start 2024-09-17T03:43:40.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.672+0000 7f4d37b62640 1 -- start start 2024-09-17T03:43:40.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d37b62640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d18003fd0 0x7f4d3014e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:40.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d37b62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d300c9750 0x7f4d300c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:40.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d37b62640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d300c8260 0x7f4d300c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:40.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d37b62640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d30161cc0 con 0x7f4d300c9750 2024-09-17T03:43:40.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d37b62640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4d30161b40 con 0x7f4d300c8260 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d37b62640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4d30161e40 con 0x7f4d18003fd0 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d350fd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d300c9750 0x7f4d300c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d350fd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d300c9750 0x7f4d300c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57430/0 (socket says 172.21.15.146:57430) 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d350fd640 1 -- 172.21.15.146:0/1180226338 learned_addr learned my addr 172.21.15.146:0/1180226338 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d358fe640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d18003fd0 0x7f4d3014e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d360ff640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d300c8260 0x7f4d300c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d350fd640 1 -- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d18003fd0 msgr2=0x7f4d3014e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d350fd640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d18003fd0 0x7f4d3014e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d350fd640 1 -- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d300c8260 msgr2=0x7f4d300c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d350fd640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d300c8260 0x7f4d300c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.673+0000 7f4d350fd640 1 -- 172.21.15.146:0/1180226338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d300c8bb0 con 0x7f4d300c9750 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.674+0000 7f4d350fd640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d300c9750 0x7f4d300c9b60 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c3d0 tx=0x7f4d24006c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:40.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.674+0000 7f4d2e7fc640 1 -- 172.21.15.146:0/1180226338 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24031040 con 0x7f4d300c9750 2024-09-17T03:43:40.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.674+0000 7f4d2e7fc640 1 -- 172.21.15.146:0/1180226338 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d240035f0 con 0x7f4d300c9750 2024-09-17T03:43:40.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.674+0000 7f4d37b62640 1 -- 172.21.15.146:0/1180226338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3014ef00 con 0x7f4d300c9750 2024-09-17T03:43:40.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.674+0000 7f4d2e7fc640 1 -- 172.21.15.146:0/1180226338 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24003a60 con 0x7f4d300c9750 2024-09-17T03:43:40.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.674+0000 7f4d37b62640 1 -- 172.21.15.146:0/1180226338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d30151730 con 0x7f4d300c9750 2024-09-17T03:43:40.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.675+0000 7f4d37b62640 1 -- 172.21.15.146:0/1180226338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d300ca260 con 0x7f4d300c9750 2024-09-17T03:43:40.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.676+0000 7f4d2e7fc640 1 -- 172.21.15.146:0/1180226338 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d24034070 con 0x7f4d300c9750 2024-09-17T03:43:40.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.676+0000 7f4d2e7fc640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d1c078bc0 0x7f4d1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:40.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.676+0000 7f4d2e7fc640 1 -- 172.21.15.146:0/1180226338 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5795+0+0 (secure 0 0 0) 0x7f4d240bb1e0 con 0x7f4d300c9750 2024-09-17T03:43:40.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.676+0000 7f4d358fe640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d1c078bc0 0x7f4d1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:40.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.677+0000 7f4d358fe640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d1c078bc0 0x7f4d1c07b0d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4d20005fd0 tx=0x7f4d20009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:40.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.681+0000 7f4d2e7fc640 1 -- 172.21.15.146:0/1180226338 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4d24045060 con 0x7f4d300c9750 2024-09-17T03:43:40.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.891+0000 7f4d37b62640 1 -- 172.21.15.146:0/1180226338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d300cf170 con 0x7f4d300c9750 2024-09-17T03:43:40.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.891+0000 7f4d2e7fc640 1 -- 172.21.15.146:0/1180226338 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+4416 (secure 0 0 0) 0x7f4d300c8bb0 con 0x7f4d300c9750 2024-09-17T03:43:40.892 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:40.892 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":117,"btime":"2024-09-17T03:43:38:382965+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:43:38.382959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":155,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8545":{"gid":8545,"name":"d","rank":0,"incarnation":114,"state":"up:active","state_seq":15,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8545,"qdb_cluster":[8545]},"id":11}]} 2024-09-17T03:43:40.892 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 117 2024-09-17T03:43:40.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 -- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d1c078bc0 msgr2=0x7f4d1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d1c078bc0 0x7f4d1c07b0d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4d20005fd0 tx=0x7f4d20009500 comp rx=0 tx=0).stop 2024-09-17T03:43:40.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 -- 172.21.15.146:0/1180226338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d300c9750 msgr2=0x7f4d300c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:40.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d300c9750 0x7f4d300c9b60 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c3d0 tx=0x7f4d24006c50 comp rx=0 tx=0).stop 2024-09-17T03:43:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 -- 172.21.15.146:0/1180226338 shutdown_connections 2024-09-17T03:43:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d1c078bc0 0x7f4d1c07b0d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d300c8260 0x7f4d300c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d300c9750 0x7f4d300c9b60 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 --2- 172.21.15.146:0/1180226338 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d18003fd0 0x7f4d3014e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 -- 172.21.15.146:0/1180226338 >> 172.21.15.146:0/1180226338 conn(0x7f4d3009ba20 msgr2=0x7f4d300b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 -- 172.21.15.146:0/1180226338 shutdown_connections 2024-09-17T03:43:40.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:40.894+0000 7f4d37b62640 1 -- 172.21.15.146:0/1180226338 wait complete. 2024-09-17T03:43:40.906 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:43:41.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.018+0000 7fc747e8b640 1 -- 172.21.15.146:0/3913978349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7400b5750 msgr2=0x7fc7400b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.018+0000 7fc747e8b640 1 --2- 172.21.15.146:0/3913978349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7400b5750 0x7fc7400b3620 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7fc7400b5390 tx=0x7fc73002a560 comp rx=0 tx=0).stop 2024-09-17T03:43:41.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.018+0000 7fc747e8b640 1 -- 172.21.15.146:0/3913978349 shutdown_connections 2024-09-17T03:43:41.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.018+0000 7fc747e8b640 1 --2- 172.21.15.146:0/3913978349 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7400b5750 0x7fc7400b3620 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.018+0000 7fc747e8b640 1 --2- 172.21.15.146:0/3913978349 >> v2:172.21.15.179:3300/0 conn(0x7fc7400b5ce0 0x7fc7400b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.018+0000 7fc747e8b640 1 -- 172.21.15.146:0/3913978349 >> 172.21.15.146:0/3913978349 conn(0x7fc7400b7b20 msgr2=0x7fc74009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:41.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.018+0000 7fc747e8b640 1 -- 172.21.15.146:0/3913978349 shutdown_connections 2024-09-17T03:43:41.019 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.018+0000 7fc747e8b640 1 -- 172.21.15.146:0/3913978349 wait complete. 2024-09-17T03:43:41.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.020+0000 7fc747e8b640 1 Processor -- start 2024-09-17T03:43:41.020 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.020+0000 7fc747e8b640 1 -- start start 2024-09-17T03:43:41.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.021+0000 7fc747e8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7400b3b60 0x7fc74014a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.021+0000 7fc747e8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7400b5750 0x7fc7401f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.021+0000 7fc747e8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7400b5ce0 0x7fc7401f9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.021+0000 7fc747e8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc7400b27b0 con 0x7fc7400b5750 2024-09-17T03:43:41.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.021+0000 7fc747e8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc74015dcc0 con 0x7fc7400b5ce0 2024-09-17T03:43:41.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.021+0000 7fc747e8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc7400b2930 con 0x7fc7400b3b60 2024-09-17T03:43:41.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.021+0000 7fc745426640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7400b5750 0x7fc7401f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.021+0000 7fc745426640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7400b5750 0x7fc7401f90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57446/0 (socket says 172.21.15.146:57446) 2024-09-17T03:43:41.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.021+0000 7fc745426640 1 -- 172.21.15.146:0/796381549 learned_addr learned my addr 172.21.15.146:0/796381549 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:41.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.021+0000 7fc745c27640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7400b3b60 0x7fc74014a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.021+0000 7fc746428640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7400b5ce0 0x7fc7401f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc745426640 1 -- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7400b3b60 msgr2=0x7fc74014a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc745426640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7400b3b60 0x7fc74014a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc745426640 1 -- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7400b5ce0 msgr2=0x7fc7401f9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc745426640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7400b5ce0 0x7fc7401f9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc745426640 1 -- 172.21.15.146:0/796381549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7400a0080 con 0x7fc7400b5750 2024-09-17T03:43:41.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc746428640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7400b5ce0 0x7fc7401f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:41.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc745426640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7400b5750 0x7fc7401f90c0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7fc730000c00 tx=0x7fc7300039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:41.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc7367fc640 1 -- 172.21.15.146:0/796381549 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73003e030 con 0x7fc7400b5750 2024-09-17T03:43:41.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc7367fc640 1 -- 172.21.15.146:0/796381549 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7300047a0 con 0x7fc7400b5750 2024-09-17T03:43:41.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc747e8b640 1 -- 172.21.15.146:0/796381549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7400a0360 con 0x7fc7400b5750 2024-09-17T03:43:41.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc7367fc640 1 -- 172.21.15.146:0/796381549 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc730035040 con 0x7fc7400b5750 2024-09-17T03:43:41.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.022+0000 7fc747e8b640 1 -- 172.21.15.146:0/796381549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc74015fd90 con 0x7fc7400b5750 2024-09-17T03:43:41.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.023+0000 7fc747e8b640 1 -- 172.21.15.146:0/796381549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7401f6a30 con 0x7fc7400b5750 2024-09-17T03:43:41.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.024+0000 7fc7367fc640 1 -- 172.21.15.146:0/796381549 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc730041030 con 0x7fc7400b5750 2024-09-17T03:43:41.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.024+0000 7fc7367fc640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc724078b90 0x7fc72407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.024+0000 7fc7367fc640 1 -- 172.21.15.146:0/796381549 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5795+0+0 (secure 0 0 0) 0x7fc7300bb5d0 con 0x7fc7400b5750 2024-09-17T03:43:41.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.025+0000 7fc745c27640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc724078b90 0x7fc72407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.025+0000 7fc745c27640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc724078b90 0x7fc72407b0a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0058c0 tx=0x7fc73c005f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:41.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.028+0000 7fc7367fc640 1 -- 172.21.15.146:0/796381549 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc7400b3f70 con 0x7fc7400b5750 2024-09-17T03:43:41.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.207+0000 7fc747e8b640 1 -- 172.21.15.146:0/796381549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc74009d7f0 con 0x7fc7400b5750 2024-09-17T03:43:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.208+0000 7fc7367fc640 1 -- 172.21.15.146:0/796381549 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16910 (secure 0 0 0) 0x7fc730083360 con 0x7fc7400b5750 2024-09-17T03:43:41.208 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:41.208 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":155,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:43:35.362585+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:42:49.151769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T03:42:50.476593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/2786424389":"2024-09-18T03:43:35.362527+0000","172.21.15.146:6833/2786424389":"2024-09-18T03:43:35.362527+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:43:41.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 -- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc724078b90 msgr2=0x7fc72407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc724078b90 0x7fc72407b0a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0058c0 tx=0x7fc73c005f60 comp rx=0 tx=0).stop 2024-09-17T03:43:41.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 -- 172.21.15.146:0/796381549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7400b5750 msgr2=0x7fc7401f90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7400b5750 0x7fc7401f90c0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7fc730000c00 tx=0x7fc7300039e0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 -- 172.21.15.146:0/796381549 shutdown_connections 2024-09-17T03:43:41.210 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc724078b90 0x7fc72407b0a0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7400b5ce0 0x7fc7401f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7400b5750 0x7fc7401f90c0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 --2- 172.21.15.146:0/796381549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc7400b3b60 0x7fc74014a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 -- 172.21.15.146:0/796381549 >> 172.21.15.146:0/796381549 conn(0x7fc7400b7b20 msgr2=0x7fc74015a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:41.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 -- 172.21.15.146:0/796381549 shutdown_connections 2024-09-17T03:43:41.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.210+0000 7fc747e8b640 1 -- 172.21.15.146:0/796381549 wait complete. 2024-09-17T03:43:41.223 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:43:41.223 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.336+0000 7f0db709b640 1 -- 172.21.15.146:0/3686422141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d98003a30 msgr2=0x7f0d98003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.336+0000 7f0db709b640 1 --2- 172.21.15.146:0/3686422141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d98003a30 0x7f0d98003ea0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f0dac001dc0 tx=0x7f0d98005830 comp rx=0 tx=0).stop 2024-09-17T03:43:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.336+0000 7f0db5638640 1 -- 172.21.15.146:0/3686422141 reap_dead start 2024-09-17T03:43:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.336+0000 7f0db709b640 1 -- 172.21.15.146:0/3686422141 shutdown_connections 2024-09-17T03:43:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.336+0000 7f0db709b640 1 -- 172.21.15.146:0/3686422141 >> 172.21.15.146:0/3686422141 conn(0x7f0db00b3150 msgr2=0x7f0db00b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.336+0000 7f0db709b640 1 -- 172.21.15.146:0/3686422141 shutdown_connections 2024-09-17T03:43:41.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.336+0000 7f0db709b640 1 -- 172.21.15.146:0/3686422141 wait complete. 2024-09-17T03:43:41.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.338+0000 7f0db709b640 1 Processor -- start 2024-09-17T03:43:41.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.338+0000 7f0db709b640 1 -- start start 2024-09-17T03:43:41.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.339+0000 7f0db709b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d98003a30 0x7f0db01f9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.339+0000 7f0db709b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db0150e80 0x7f0db006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.339+0000 7f0db709b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0151290 0x7f0db006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.339+0000 7f0db709b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0db00b5cc0 con 0x7f0db0151290 2024-09-17T03:43:41.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.339+0000 7f0db709b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0db00b5b40 con 0x7f0db0150e80 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.339+0000 7f0db709b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0db00b5e40 con 0x7f0d98003a30 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.339+0000 7f0db5638640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0151290 0x7f0db006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db5638640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0151290 0x7f0db006d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57464/0 (socket says 172.21.15.146:57464) 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db5638640 1 -- 172.21.15.146:0/1293681322 learned_addr learned my addr 172.21.15.146:0/1293681322 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db4e37640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d98003a30 0x7f0db01f9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0da7fff640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db0150e80 0x7f0db006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db5638640 1 -- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d98003a30 msgr2=0x7f0db01f9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db5638640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d98003a30 0x7f0db01f9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db5638640 1 -- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db0150e80 msgr2=0x7f0db006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db5638640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db0150e80 0x7f0db006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db5638640 1 -- 172.21.15.146:0/1293681322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db00aa8a0 con 0x7f0db0151290 2024-09-17T03:43:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db4e37640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d98003a30 0x7f0db01f9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:43:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0da7fff640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db0150e80 0x7f0db006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:43:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db5638640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0151290 0x7f0db006d190 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f0db0072080 tx=0x7f0da80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0da57fa640 1 -- 172.21.15.146:0/1293681322 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8011840 con 0x7f0db0151290 2024-09-17T03:43:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0da57fa640 1 -- 172.21.15.146:0/1293681322 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0da8017070 con 0x7f0db0151290 2024-09-17T03:43:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0da57fa640 1 -- 172.21.15.146:0/1293681322 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8011c20 con 0x7f0db0151290 2024-09-17T03:43:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db709b640 1 -- 172.21.15.146:0/1293681322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db01fa010 con 0x7f0db0151290 2024-09-17T03:43:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.340+0000 7f0db709b640 1 -- 172.21.15.146:0/1293681322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db00aadf0 con 0x7f0db0151290 2024-09-17T03:43:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.341+0000 7f0db709b640 1 -- 172.21.15.146:0/1293681322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db00d10b0 con 0x7f0db0151290 2024-09-17T03:43:41.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.342+0000 7f0da57fa640 1 -- 172.21.15.146:0/1293681322 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0da801c460 con 0x7f0db0151290 2024-09-17T03:43:41.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.342+0000 7f0da57fa640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d9c078bc0 0x7f0d9c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.342+0000 7f0da57fa640 1 -- 172.21.15.146:0/1293681322 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5795+0+0 (secure 0 0 0) 0x7f0da809b5e0 con 0x7f0db0151290 2024-09-17T03:43:41.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.343+0000 7f0db4e37640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d9c078bc0 0x7f0d9c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.343+0000 7f0db4e37640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d9c078bc0 0x7f0d9c07b0d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0dac032000 tx=0x7f0dac001510 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:41.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.347+0000 7f0da57fa640 1 -- 172.21.15.146:0/1293681322 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0db00d10b0 con 0x7f0db0151290 2024-09-17T03:43:41.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.556+0000 7f0db709b640 1 -- 172.21.15.146:0/1293681322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0db00c6db0 con 0x7f0db0151290 2024-09-17T03:43:41.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.557+0000 7f0da57fa640 1 -- 172.21.15.146:0/1293681322 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+4416 (secure 0 0 0) 0x7f0db01fa010 con 0x7f0db0151290 2024-09-17T03:43:41.557 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:41.557 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":117,"btime":"2024-09-17T03:43:38:382965+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:43:38.382959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":155,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8545":{"gid":8545,"name":"d","rank":0,"incarnation":114,"state":"up:active","state_seq":15,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8545,"qdb_cluster":[8545]},"id":11}]} 2024-09-17T03:43:41.557 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 117 2024-09-17T03:43:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 -- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d9c078bc0 msgr2=0x7f0d9c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d9c078bc0 0x7f0d9c07b0d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0dac032000 tx=0x7f0dac001510 comp rx=0 tx=0).stop 2024-09-17T03:43:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 -- 172.21.15.146:0/1293681322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0151290 msgr2=0x7f0db006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0151290 0x7f0db006d190 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f0db0072080 tx=0x7f0da80039c0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 -- 172.21.15.146:0/1293681322 shutdown_connections 2024-09-17T03:43:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d9c078bc0 0x7f0d9c07b0d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db0151290 0x7f0db006d190 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0db0150e80 0x7f0db006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 --2- 172.21.15.146:0/1293681322 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d98003a30 0x7f0db01f9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 -- 172.21.15.146:0/1293681322 >> 172.21.15.146:0/1293681322 conn(0x7f0db00b3150 msgr2=0x7f0db015a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 -- 172.21.15.146:0/1293681322 shutdown_connections 2024-09-17T03:43:41.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.559+0000 7f0db709b640 1 -- 172.21.15.146:0/1293681322 wait complete. 2024-09-17T03:43:41.571 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:41.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.683+0000 7fea739ba640 1 -- 172.21.15.146:0/2146877872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea6c0b3830 msgr2=0x7fea6c0b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.683+0000 7fea739ba640 1 --2- 172.21.15.146:0/2146877872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea6c0b3830 0x7fea6c0b3c40 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fea6c071740 tx=0x7fea6402bb50 comp rx=0 tx=0).stop 2024-09-17T03:43:41.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.683+0000 7fea739ba640 1 -- 172.21.15.146:0/2146877872 shutdown_connections 2024-09-17T03:43:41.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.683+0000 7fea739ba640 1 --2- 172.21.15.146:0/2146877872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea6c0b3830 0x7fea6c0b3c40 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.683+0000 7fea739ba640 1 --2- 172.21.15.146:0/2146877872 >> v2:172.21.15.179:3300/0 conn(0x7fea6c06e870 0x7fea6c151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.683+0000 7fea739ba640 1 -- 172.21.15.146:0/2146877872 >> 172.21.15.146:0/2146877872 conn(0x7fea6c0b2950 msgr2=0x7fea6c0b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:41.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.683+0000 7fea739ba640 1 -- 172.21.15.146:0/2146877872 shutdown_connections 2024-09-17T03:43:41.684 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.683+0000 7fea739ba640 1 -- 172.21.15.146:0/2146877872 wait complete. 2024-09-17T03:43:41.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.685+0000 7fea739ba640 1 Processor -- start 2024-09-17T03:43:41.685 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.685+0000 7fea739ba640 1 -- start start 2024-09-17T03:43:41.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea739ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea6c06e870 0x7fea6c1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea739ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea6c0af890 0x7fea6c1f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea739ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea6c0b3830 0x7fea6c1f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.687 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea739ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c0d1140 con 0x7fea6c0b3830 2024-09-17T03:43:41.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea739ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c0d0fc0 con 0x7fea6c06e870 2024-09-17T03:43:41.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea739ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fea6c0d12c0 con 0x7fea6c0af890 2024-09-17T03:43:41.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea71f57640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea6c0b3830 0x7fea6c1f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea71f57640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea6c0b3830 0x7fea6c1f6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57478/0 (socket says 172.21.15.146:57478) 2024-09-17T03:43:41.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea71f57640 1 -- 172.21.15.146:0/3976855125 learned_addr learned my addr 172.21.15.146:0/3976855125 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:41.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea71756640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea6c06e870 0x7fea6c1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea70f55640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea6c0af890 0x7fea6c1f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.688 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea71f57640 1 -- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea6c0af890 msgr2=0x7fea6c1f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea71f57640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea6c0af890 0x7fea6c1f6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea71f57640 1 -- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea6c06e870 msgr2=0x7fea6c1582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea71f57640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea6c06e870 0x7fea6c1582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea71f57640 1 -- 172.21.15.146:0/3976855125 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6c1f78d0 con 0x7fea6c0b3830 2024-09-17T03:43:41.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.686+0000 7fea71756640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea6c06e870 0x7fea6c1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:43:41.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.687+0000 7fea71f57640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea6c0b3830 0x7fea6c1f6f90 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fea6400adb0 tx=0x7fea6402d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:41.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.687+0000 7fea61ffb640 1 -- 172.21.15.146:0/3976855125 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea640044d0 con 0x7fea6c0b3830 2024-09-17T03:43:41.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.687+0000 7fea61ffb640 1 -- 172.21.15.146:0/3976855125 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea64004760 con 0x7fea6c0b3830 2024-09-17T03:43:41.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.687+0000 7fea739ba640 1 -- 172.21.15.146:0/3976855125 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6c1f75f0 con 0x7fea6c0b3830 2024-09-17T03:43:41.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.687+0000 7fea61ffb640 1 -- 172.21.15.146:0/3976855125 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6402e6e0 con 0x7fea6c0b3830 2024-09-17T03:43:41.689 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.687+0000 7fea739ba640 1 -- 172.21.15.146:0/3976855125 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea6c1f3850 con 0x7fea6c0b3830 2024-09-17T03:43:41.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.688+0000 7fea739ba640 1 -- 172.21.15.146:0/3976855125 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea6c151ee0 con 0x7fea6c0b3830 2024-09-17T03:43:41.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.689+0000 7fea61ffb640 1 -- 172.21.15.146:0/3976855125 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea6402e880 con 0x7fea6c0b3830 2024-09-17T03:43:41.690 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.689+0000 7fea61ffb640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea50078b90 0x7fea5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:41.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.689+0000 7fea61ffb640 1 -- 172.21.15.146:0/3976855125 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5795+0+0 (secure 0 0 0) 0x7fea640bc600 con 0x7fea6c0b3830 2024-09-17T03:43:41.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.689+0000 7fea71756640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea50078b90 0x7fea5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:41.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.690+0000 7fea71756640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea50078b90 0x7fea5007b0a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fea68009aa0 tx=0x7fea68005db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:41.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.694+0000 7fea61ffb640 1 -- 172.21.15.146:0/3976855125 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea64046060 con 0x7fea6c0b3830 2024-09-17T03:43:41.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.903+0000 7fea739ba640 1 -- 172.21.15.146:0/3976855125 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea6c15c950 con 0x7fea6c0b3830 2024-09-17T03:43:41.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.904+0000 7fea61ffb640 1 -- 172.21.15.146:0/3976855125 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) ==== 95+0+4416 (secure 0 0 0) 0x7fea64033070 con 0x7fea6c0b3830 2024-09-17T03:43:41.904 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:41.904 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":117,"btime":"2024-09-17T03:43:38:382965+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:42:51.507886+0000","modified":"2024-09-17T03:43:38.382959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":155,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8545":{"gid":8545,"name":"d","rank":0,"incarnation":114,"state":"up:active","state_seq":15,"addr":"172.21.15.179:6837/3591121123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3591121123},{"type":"v1","addr":"172.21.15.179:6837","nonce":3591121123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8545,"qdb_cluster":[8545]},"id":11}]} 2024-09-17T03:43:41.904 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 117 2024-09-17T03:43:41.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 -- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea50078b90 msgr2=0x7fea5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea50078b90 0x7fea5007b0a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fea68009aa0 tx=0x7fea68005db0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 -- 172.21.15.146:0/3976855125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea6c0b3830 msgr2=0x7fea6c1f6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:41.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea6c0b3830 0x7fea6c1f6f90 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fea6400adb0 tx=0x7fea6402d8e0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 -- 172.21.15.146:0/3976855125 shutdown_connections 2024-09-17T03:43:41.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea50078b90 0x7fea5007b0a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea6c0b3830 0x7fea6c1f6f90 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea6c0af890 0x7fea6c1f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 --2- 172.21.15.146:0/3976855125 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea6c06e870 0x7fea6c1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:41.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 -- 172.21.15.146:0/3976855125 >> 172.21.15.146:0/3976855125 conn(0x7fea6c0b2950 msgr2=0x7fea6c14d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:41.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 -- 172.21.15.146:0/3976855125 shutdown_connections 2024-09-17T03:43:41.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:41.906+0000 7fea739ba640 1 -- 172.21.15.146:0/3976855125 wait complete. 2024-09-17T03:43:41.918 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:43:42.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.030+0000 7f320d2ec640 1 -- 172.21.15.146:0/4289539455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32080b61f0 msgr2=0x7f32080b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.030+0000 7f320d2ec640 1 --2- 172.21.15.146:0/4289539455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32080b61f0 0x7f32080b6600 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3200009830 tx=0x7f320002a480 comp rx=0 tx=0).stop 2024-09-17T03:43:42.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.030+0000 7f320d2ec640 1 -- 172.21.15.146:0/4289539455 shutdown_connections 2024-09-17T03:43:42.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.030+0000 7f320d2ec640 1 --2- 172.21.15.146:0/4289539455 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32080b61f0 0x7f32080b6600 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.030+0000 7f320d2ec640 1 --2- 172.21.15.146:0/4289539455 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32080cfca0 0x7f32080cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.030+0000 7f320d2ec640 1 -- 172.21.15.146:0/4289539455 >> 172.21.15.146:0/4289539455 conn(0x7f32080d11f0 msgr2=0x7f32080d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:42.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.030+0000 7f320d2ec640 1 -- 172.21.15.146:0/4289539455 shutdown_connections 2024-09-17T03:43:42.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.030+0000 7f320d2ec640 1 -- 172.21.15.146:0/4289539455 wait complete. 2024-09-17T03:43:42.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.032+0000 7f320d2ec640 1 Processor -- start 2024-09-17T03:43:42.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.032+0000 7f320d2ec640 1 -- start start 2024-09-17T03:43:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f320d2ec640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32080b61f0 0x7f32081f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f320d2ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32080cfca0 0x7f320814ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f320d2ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f320815f1a0 0x7f320814a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f320d2ec640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f32080695b0 con 0x7f32080b61f0 2024-09-17T03:43:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f320d2ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3208069430 con 0x7f320815f1a0 2024-09-17T03:43:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f320d2ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3208069730 con 0x7f32080cfca0 2024-09-17T03:43:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f3206ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32080b61f0 0x7f32081f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f3206ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32080b61f0 0x7f32081f8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57490/0 (socket says 172.21.15.146:57490) 2024-09-17T03:43:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f3206ffd640 1 -- 172.21.15.146:0/4024163341 learned_addr learned my addr 172.21.15.146:0/4024163341 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f32067fc640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32080cfca0 0x7f320814ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f32077fe640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f320815f1a0 0x7f320814a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f3206ffd640 1 -- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32080cfca0 msgr2=0x7f320814ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f3206ffd640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32080cfca0 0x7f320814ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f3206ffd640 1 -- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f320815f1a0 msgr2=0x7f320814a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f3206ffd640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f320815f1a0 0x7f320814a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f3206ffd640 1 -- 172.21.15.146:0/4024163341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320814cfd0 con 0x7f32080b61f0 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.034+0000 7f3206ffd640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32080b61f0 0x7f32081f8f30 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f31f800cbf0 tx=0x7f31f800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.035+0000 7f31ef7fe640 1 -- 172.21.15.146:0/4024163341 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f8016020 con 0x7f32080b61f0 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.035+0000 7f31ef7fe640 1 -- 172.21.15.146:0/4024163341 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31f800ad30 con 0x7f32080b61f0 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.035+0000 7f320d2ec640 1 -- 172.21.15.146:0/4024163341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32081f98e0 con 0x7f32080b61f0 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.035+0000 7f31ef7fe640 1 -- 172.21.15.146:0/4024163341 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f8012680 con 0x7f32080b61f0 2024-09-17T03:43:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.035+0000 7f320d2ec640 1 -- 172.21.15.146:0/4024163341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320814c290 con 0x7f32080b61f0 2024-09-17T03:43:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.036+0000 7f320d2ec640 1 -- 172.21.15.146:0/4024163341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32081f9e00 con 0x7f32080b61f0 2024-09-17T03:43:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.036+0000 7f31ef7fe640 1 -- 172.21.15.146:0/4024163341 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31f8019020 con 0x7f32080b61f0 2024-09-17T03:43:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.037+0000 7f31ef7fe640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31f4078bc0 0x7f31f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.037+0000 7f31ef7fe640 1 -- 172.21.15.146:0/4024163341 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5795+0+0 (secure 0 0 0) 0x7f31f809b240 con 0x7f32080b61f0 2024-09-17T03:43:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.037+0000 7f32067fc640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31f4078bc0 0x7f31f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.038+0000 7f32067fc640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31f4078bc0 0x7f31f407b0d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0095f0 tx=0x7f31fc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:42.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.041+0000 7f31ef7fe640 1 -- 172.21.15.146:0/4024163341 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f31f8020020 con 0x7f32080b61f0 2024-09-17T03:43:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.216+0000 7f320d2ec640 1 -- 172.21.15.146:0/4024163341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3208069c50 con 0x7f32080b61f0 2024-09-17T03:43:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.217+0000 7f31ef7fe640 1 -- 172.21.15.146:0/4024163341 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16910 (secure 0 0 0) 0x7f32080b6b40 con 0x7f32080b61f0 2024-09-17T03:43:42.218 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:42.218 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":155,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:43:35.362585+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:42:49.151769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T03:42:50.476593+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/2786424389":"2024-09-18T03:43:35.362527+0000","172.21.15.146:6833/2786424389":"2024-09-18T03:43:35.362527+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:43:42.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.219+0000 7f320d2ec640 1 -- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31f4078bc0 msgr2=0x7f31f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.219+0000 7f320d2ec640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31f4078bc0 0x7f31f407b0d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0095f0 tx=0x7f31fc005f90 comp rx=0 tx=0).stop 2024-09-17T03:43:42.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.219+0000 7f320d2ec640 1 -- 172.21.15.146:0/4024163341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32080b61f0 msgr2=0x7f32081f8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.219+0000 7f320d2ec640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32080b61f0 0x7f32081f8f30 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f31f800cbf0 tx=0x7f31f800a060 comp rx=0 tx=0).stop 2024-09-17T03:43:42.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.219+0000 7f320d2ec640 1 -- 172.21.15.146:0/4024163341 shutdown_connections 2024-09-17T03:43:42.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.219+0000 7f320d2ec640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31f4078bc0 0x7f31f407b0d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.219+0000 7f320d2ec640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f320815f1a0 0x7f320814a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.219+0000 7f320d2ec640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f32080cfca0 0x7f320814ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.219+0000 7f320d2ec640 1 --2- 172.21.15.146:0/4024163341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32080b61f0 0x7f32081f8f30 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.219+0000 7f320d2ec640 1 -- 172.21.15.146:0/4024163341 >> 172.21.15.146:0/4024163341 conn(0x7f32080d11f0 msgr2=0x7f32080b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:42.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.220+0000 7f320d2ec640 1 -- 172.21.15.146:0/4024163341 shutdown_connections 2024-09-17T03:43:42.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.220+0000 7f320d2ec640 1 -- 172.21.15.146:0/4024163341 wait complete. 2024-09-17T03:43:42.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:43:42.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.346+0000 7fa75ce7e640 1 -- 172.21.15.146:0/758622388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7580b3b60 msgr2=0x7fa75815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.346+0000 7fa75ce7e640 1 --2- 172.21.15.146:0/758622388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7580b3b60 0x7fa75815caa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa750005fd0 tx=0x7fa75002aa90 comp rx=0 tx=0).stop 2024-09-17T03:43:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.346+0000 7fa75ce7e640 1 -- 172.21.15.146:0/758622388 shutdown_connections 2024-09-17T03:43:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.346+0000 7fa75ce7e640 1 --2- 172.21.15.146:0/758622388 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7580b3b60 0x7fa75815caa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.346+0000 7fa75ce7e640 1 --2- 172.21.15.146:0/758622388 >> v2:172.21.15.179:3300/0 conn(0x7fa7580b5750 0x7fa7580b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.346+0000 7fa75ce7e640 1 -- 172.21.15.146:0/758622388 >> 172.21.15.146:0/758622388 conn(0x7fa7580b7b20 msgr2=0x7fa75809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.346+0000 7fa75ce7e640 1 -- 172.21.15.146:0/758622388 shutdown_connections 2024-09-17T03:43:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.346+0000 7fa75ce7e640 1 -- 172.21.15.146:0/758622388 wait complete. 2024-09-17T03:43:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.348+0000 7fa75ce7e640 1 Processor -- start 2024-09-17T03:43:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.348+0000 7fa75ce7e640 1 -- start start 2024-09-17T03:43:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.349+0000 7fa75ce7e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7580b3b60 0x7fa7581e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.349+0000 7fa75ce7e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7580b5750 0x7fa75809c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.349+0000 7fa75ce7e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7580b5ce0 0x7fa75815f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.349+0000 7fa75ce7e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa75815d510 con 0x7fa7580b3b60 2024-09-17T03:43:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.349+0000 7fa75ce7e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa75815d390 con 0x7fa7580b5750 2024-09-17T03:43:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.349+0000 7fa75ce7e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa75815d690 con 0x7fa7580b5ce0 2024-09-17T03:43:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.349+0000 7fa75659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7580b3b60 0x7fa7581e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.349+0000 7fa75659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7580b3b60 0x7fa7581e53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57506/0 (socket says 172.21.15.146:57506) 2024-09-17T03:43:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.349+0000 7fa75659c640 1 -- 172.21.15.146:0/3363196443 learned_addr learned my addr 172.21.15.146:0/3363196443 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.349+0000 7fa74ffff640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7580b5750 0x7fa75809c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.349+0000 7fa756d9d640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7580b5ce0 0x7fa75815f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa75659c640 1 -- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7580b5ce0 msgr2=0x7fa75815f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa75659c640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7580b5ce0 0x7fa75815f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa75659c640 1 -- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7580b5750 msgr2=0x7fa75809c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa75659c640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7580b5750 0x7fa75809c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa75659c640 1 -- 172.21.15.146:0/3363196443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75809d170 con 0x7fa7580b3b60 2024-09-17T03:43:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa74ffff640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7580b5750 0x7fa75809c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa75659c640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7580b3b60 0x7fa7581e53d0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c3a0 tx=0x7fa74800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa74effd640 1 -- 172.21.15.146:0/3363196443 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748017070 con 0x7fa7580b3b60 2024-09-17T03:43:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa74effd640 1 -- 172.21.15.146:0/3363196443 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7480053c0 con 0x7fa7580b3b60 2024-09-17T03:43:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa74effd640 1 -- 172.21.15.146:0/3363196443 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748003850 con 0x7fa7580b3b60 2024-09-17T03:43:42.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa75ce7e640 1 -- 172.21.15.146:0/3363196443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75809d450 con 0x7fa7580b3b60 2024-09-17T03:43:42.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.350+0000 7fa75ce7e640 1 -- 172.21.15.146:0/3363196443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa758144300 con 0x7fa7580b3b60 2024-09-17T03:43:42.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.351+0000 7fa75ce7e640 1 -- 172.21.15.146:0/3363196443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75815db40 con 0x7fa7580b3b60 2024-09-17T03:43:42.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.352+0000 7fa74effd640 1 -- 172.21.15.146:0/3363196443 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa74801a070 con 0x7fa7580b3b60 2024-09-17T03:43:42.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.352+0000 7fa74effd640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa738078b90 0x7fa73807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.352+0000 7fa74effd640 1 -- 172.21.15.146:0/3363196443 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5795+0+0 (secure 0 0 0) 0x7fa74809a010 con 0x7fa7580b3b60 2024-09-17T03:43:42.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.353+0000 7fa74ffff640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa738078b90 0x7fa73807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.353+0000 7fa74ffff640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa738078b90 0x7fa73807b0a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa7580a08b0 tx=0x7fa740005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:42.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.357+0000 7fa74effd640 1 -- 172.21.15.146:0/3363196443 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa7580b3f70 con 0x7fa7580b3b60 2024-09-17T03:43:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.570+0000 7fa75ce7e640 1 -- 172.21.15.146:0/3363196443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa75809bd40 con 0x7fa7580b3b60 2024-09-17T03:43:42.571 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:43:42.571+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:43:42.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.572+0000 7fa74effd640 1 -- 172.21.15.146:0/3363196443 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v118) ==== 161+0+0 (secure 0 0 0) 0x7fa748061e40 con 0x7fa7580b3b60 2024-09-17T03:43:42.573 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:43:42.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 -- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa738078b90 msgr2=0x7fa73807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa738078b90 0x7fa73807b0a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa7580a08b0 tx=0x7fa740005f90 comp rx=0 tx=0).stop 2024-09-17T03:43:42.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 -- 172.21.15.146:0/3363196443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7580b3b60 msgr2=0x7fa7581e53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7580b3b60 0x7fa7581e53d0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c3a0 tx=0x7fa74800c860 comp rx=0 tx=0).stop 2024-09-17T03:43:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 -- 172.21.15.146:0/3363196443 shutdown_connections 2024-09-17T03:43:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa738078b90 0x7fa73807b0a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7580b5ce0 0x7fa75815f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7580b5750 0x7fa75809c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 --2- 172.21.15.146:0/3363196443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7580b3b60 0x7fa7581e53d0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 -- 172.21.15.146:0/3363196443 >> 172.21.15.146:0/3363196443 conn(0x7fa7580b7b20 msgr2=0x7fa758071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 -- 172.21.15.146:0/3363196443 shutdown_connections 2024-09-17T03:43:42.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.575+0000 7fa75ce7e640 1 -- 172.21.15.146:0/3363196443 wait complete. 2024-09-17T03:43:42.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:43:42.644 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:43:42.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.704+0000 7fdde1f13640 1 -- 172.21.15.146:0/4026170396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdddc0b4370 msgr2=0x7fdddc0b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.704+0000 7fdde1f13640 1 --2- 172.21.15.146:0/4026170396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdddc0b4370 0x7fdddc0b4780 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fddd4005fd0 tx=0x7fddd402a820 comp rx=0 tx=0).stop 2024-09-17T03:43:42.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.704+0000 7fdde1f13640 1 -- 172.21.15.146:0/4026170396 shutdown_connections 2024-09-17T03:43:42.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.704+0000 7fdde1f13640 1 --2- 172.21.15.146:0/4026170396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdddc0b4370 0x7fdddc0b4780 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.704+0000 7fdde1f13640 1 --2- 172.21.15.146:0/4026170396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdddc072680 0x7fdddc072a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.704+0000 7fdde1f13640 1 -- 172.21.15.146:0/4026170396 >> 172.21.15.146:0/4026170396 conn(0x7fdddc0b2060 msgr2=0x7fdddc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:42.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.704+0000 7fdde1f13640 1 -- 172.21.15.146:0/4026170396 shutdown_connections 2024-09-17T03:43:42.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.704+0000 7fdde1f13640 1 -- 172.21.15.146:0/4026170396 wait complete. 2024-09-17T03:43:42.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.706+0000 7fdde1f13640 1 Processor -- start 2024-09-17T03:43:42.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.706+0000 7fdde1f13640 1 -- start start 2024-09-17T03:43:42.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdde1f13640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdddc072680 0x7fdddc0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdde1f13640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdddc0b4370 0x7fdddc14d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdde1f13640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdddc15b770 0x7fdddc15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdde1f13640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc0b4e40 con 0x7fdddc15b770 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdde1f13640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc0b4cc0 con 0x7fdddc0b4370 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdde1f13640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdddc0b4fc0 con 0x7fdddc072680 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdddbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdddc15b770 0x7fdddc15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdddbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdddc15b770 0x7fdddc15a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57516/0 (socket says 172.21.15.146:57516) 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdddbfff640 1 -- 172.21.15.146:0/2656097843 learned_addr learned my addr 172.21.15.146:0/2656097843 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdddaffd640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdddc0b4370 0x7fdddc14d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdddb7fe640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdddc072680 0x7fdddc0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdddbfff640 1 -- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdddc072680 msgr2=0x7fdddc0af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdddbfff640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdddc072680 0x7fdddc0af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdddbfff640 1 -- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdddc0b4370 msgr2=0x7fdddc14d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdddbfff640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdddc0b4370 0x7fdddc14d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:42.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.707+0000 7fdddbfff640 1 -- 172.21.15.146:0/2656097843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdddc0ace00 con 0x7fdddc15b770 2024-09-17T03:43:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.708+0000 7fdddbfff640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdddc15b770 0x7fdddc15a8e0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fddd4035040 tx=0x7fddd4032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.708+0000 7fddc3fff640 1 -- 172.21.15.146:0/2656097843 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4037040 con 0x7fdddc15b770 2024-09-17T03:43:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.708+0000 7fddc3fff640 1 -- 172.21.15.146:0/2656097843 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddd4042070 con 0x7fdddc15b770 2024-09-17T03:43:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.708+0000 7fddc3fff640 1 -- 172.21.15.146:0/2656097843 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4003e60 con 0x7fdddc15b770 2024-09-17T03:43:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.708+0000 7fdde1f13640 1 -- 172.21.15.146:0/2656097843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdddc1f6f40 con 0x7fdddc15b770 2024-09-17T03:43:42.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.708+0000 7fdde1f13640 1 -- 172.21.15.146:0/2656097843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdddc1f7500 con 0x7fdddc15b770 2024-09-17T03:43:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.709+0000 7fdde1f13640 1 -- 172.21.15.146:0/2656097843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdddc0b5550 con 0x7fdddc15b770 2024-09-17T03:43:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.710+0000 7fddc3fff640 1 -- 172.21.15.146:0/2656097843 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fddd4004260 con 0x7fdddc15b770 2024-09-17T03:43:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.711+0000 7fddc3fff640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fddc8078b90 0x7fddc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.711+0000 7fddc3fff640 1 -- 172.21.15.146:0/2656097843 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5881+0+0 (secure 0 0 0) 0x7fddd40bbac0 con 0x7fdddc15b770 2024-09-17T03:43:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.711+0000 7fdddb7fe640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fddc8078b90 0x7fddc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.711+0000 7fdddb7fe640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fddc8078b90 0x7fddc807b0a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0013f0 tx=0x7fddcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:42.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.715+0000 7fddc3fff640 1 -- 172.21.15.146:0/2656097843 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fddd4083e60 con 0x7fdddc15b770 2024-09-17T03:43:42.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:42.928+0000 7fdde1f13640 1 -- 172.21.15.146:0/2656097843 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdddc155540 con 0x7fdddc15b770 2024-09-17T03:43:43.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.574+0000 7fddc3fff640 1 -- 172.21.15.146:0/2656097843 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v119) ==== 104+0+0 (secure 0 0 0) 0x7fddd4083760 con 0x7fdddc15b770 2024-09-17T03:43:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.576+0000 7fdde1f13640 1 -- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fddc8078b90 msgr2=0x7fddc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.576+0000 7fdde1f13640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fddc8078b90 0x7fddc807b0a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0013f0 tx=0x7fddcc009040 comp rx=0 tx=0).stop 2024-09-17T03:43:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.576+0000 7fdde1f13640 1 -- 172.21.15.146:0/2656097843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdddc15b770 msgr2=0x7fdddc15a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.576+0000 7fdde1f13640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdddc15b770 0x7fdddc15a8e0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fddd4035040 tx=0x7fddd4032c60 comp rx=0 tx=0).stop 2024-09-17T03:43:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.576+0000 7fdde1f13640 1 -- 172.21.15.146:0/2656097843 shutdown_connections 2024-09-17T03:43:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.576+0000 7fdde1f13640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fddc8078b90 0x7fddc807b0a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.576+0000 7fdde1f13640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdddc15b770 0x7fdddc15a8e0 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.576+0000 7fdde1f13640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdddc0b4370 0x7fdddc14d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.576+0000 7fdde1f13640 1 --2- 172.21.15.146:0/2656097843 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdddc072680 0x7fdddc0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:43.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.576+0000 7fdde1f13640 1 -- 172.21.15.146:0/2656097843 >> 172.21.15.146:0/2656097843 conn(0x7fdddc0b2060 msgr2=0x7fdddc0cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:43.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.577+0000 7fdde1f13640 1 -- 172.21.15.146:0/2656097843 shutdown_connections 2024-09-17T03:43:43.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.577+0000 7fdde1f13640 1 -- 172.21.15.146:0/2656097843 wait complete. 2024-09-17T03:43:43.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:43:43.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.707+0000 7faf7615f640 1 -- 172.21.15.146:0/3080875246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf58004800 msgr2=0x7faf58004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:43.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.707+0000 7faf7615f640 1 --2- 172.21.15.146:0/3080875246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf58004800 0x7faf58004c10 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7faf64001830 tx=0x7faf58005830 comp rx=0 tx=0).stop 2024-09-17T03:43:43.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.707+0000 7faf6ffff640 1 -- 172.21.15.146:0/3080875246 reap_dead start 2024-09-17T03:43:43.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.707+0000 7faf7615f640 1 -- 172.21.15.146:0/3080875246 shutdown_connections 2024-09-17T03:43:43.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.707+0000 7faf7615f640 1 -- 172.21.15.146:0/3080875246 >> 172.21.15.146:0/3080875246 conn(0x7faf700d4be0 msgr2=0x7faf700d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:43.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.707+0000 7faf7615f640 1 -- 172.21.15.146:0/3080875246 shutdown_connections 2024-09-17T03:43:43.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.707+0000 7faf7615f640 1 -- 172.21.15.146:0/3080875246 wait complete. 2024-09-17T03:43:43.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.709+0000 7faf7615f640 1 Processor -- start 2024-09-17T03:43:43.709 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.709+0000 7faf7615f640 1 -- start start 2024-09-17T03:43:43.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.710+0000 7faf7615f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58004800 0x7faf701f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:43.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.710+0000 7faf7615f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf700b59a0 0x7faf700ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:43.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.710+0000 7faf7615f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf700cb910 0x7faf700b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:43.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.710+0000 7faf7615f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf700d4320 con 0x7faf700b59a0 2024-09-17T03:43:43.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.710+0000 7faf7615f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faf700d41a0 con 0x7faf58004800 2024-09-17T03:43:43.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.710+0000 7faf7615f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7faf700d44a0 con 0x7faf700cb910 2024-09-17T03:43:43.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.710+0000 7faf6effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf700b59a0 0x7faf700ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:43.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.710+0000 7faf6effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf700b59a0 0x7faf700ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57534/0 (socket says 172.21.15.146:57534) 2024-09-17T03:43:43.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.710+0000 7faf6effd640 1 -- 172.21.15.146:0/3355341038 learned_addr learned my addr 172.21.15.146:0/3355341038 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:43.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.710+0000 7faf6ffff640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf700cb910 0x7faf700b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:43.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.710+0000 7faf6f7fe640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58004800 0x7faf701f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:43.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf6effd640 1 -- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf700cb910 msgr2=0x7faf700b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:43.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf6effd640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf700cb910 0x7faf700b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:43.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf6effd640 1 -- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58004800 msgr2=0x7faf701f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:43.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf6effd640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58004800 0x7faf701f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:43.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf6effd640 1 -- 172.21.15.146:0/3355341038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf700b4400 con 0x7faf700b59a0 2024-09-17T03:43:43.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf6ffff640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf700cb910 0x7faf700b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:43:43.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf6f7fe640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58004800 0x7faf701f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:43:43.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf6effd640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf700b59a0 0x7faf700ce9e0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7faf6402aa50 tx=0x7faf640060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:43.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf57fff640 1 -- 172.21.15.146:0/3355341038 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64003a00 con 0x7faf700b59a0 2024-09-17T03:43:43.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf57fff640 1 -- 172.21.15.146:0/3355341038 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf64003c90 con 0x7faf700b59a0 2024-09-17T03:43:43.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf7615f640 1 -- 172.21.15.146:0/3355341038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf700b4900 con 0x7faf700b59a0 2024-09-17T03:43:43.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf57fff640 1 -- 172.21.15.146:0/3355341038 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf640336e0 con 0x7faf700b59a0 2024-09-17T03:43:43.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.711+0000 7faf7615f640 1 -- 172.21.15.146:0/3355341038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf700b4ec0 con 0x7faf700b59a0 2024-09-17T03:43:43.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.712+0000 7faf7615f640 1 -- 172.21.15.146:0/3355341038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf700b4650 con 0x7faf700b59a0 2024-09-17T03:43:43.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.713+0000 7faf57fff640 1 -- 172.21.15.146:0/3355341038 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf64045020 con 0x7faf700b59a0 2024-09-17T03:43:43.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.713+0000 7faf57fff640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf5c078b90 0x7faf5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:43.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.713+0000 7faf57fff640 1 -- 172.21.15.146:0/3355341038 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5881+0+0 (secure 0 0 0) 0x7faf640bad10 con 0x7faf700b59a0 2024-09-17T03:43:43.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.714+0000 7faf6f7fe640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf5c078b90 0x7faf5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:43.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.714+0000 7faf6f7fe640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf5c078b90 0x7faf5c07b0a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7faf60001c80 tx=0x7faf60001bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:43.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.718+0000 7faf57fff640 1 -- 172.21.15.146:0/3355341038 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf640831c0 con 0x7faf700b59a0 2024-09-17T03:43:43.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:43.895+0000 7faf7615f640 1 -- 172.21.15.146:0/3355341038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7faf701620f0 con 0x7faf700b59a0 2024-09-17T03:43:44.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.580+0000 7faf57fff640 1 -- 172.21.15.146:0/3355341038 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v157) ==== 181+0+0 (secure 0 0 0) 0x7faf64082ac0 con 0x7faf700b59a0 2024-09-17T03:43:44.581 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:43:44.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.583+0000 7faf7615f640 1 -- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf5c078b90 msgr2=0x7faf5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:44.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.583+0000 7faf7615f640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf5c078b90 0x7faf5c07b0a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7faf60001c80 tx=0x7faf60001bd0 comp rx=0 tx=0).stop 2024-09-17T03:43:44.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.583+0000 7faf7615f640 1 -- 172.21.15.146:0/3355341038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf700b59a0 msgr2=0x7faf700ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:44.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.583+0000 7faf7615f640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf700b59a0 0x7faf700ce9e0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7faf6402aa50 tx=0x7faf640060e0 comp rx=0 tx=0).stop 2024-09-17T03:43:44.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.583+0000 7faf7615f640 1 -- 172.21.15.146:0/3355341038 shutdown_connections 2024-09-17T03:43:44.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.583+0000 7faf7615f640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf5c078b90 0x7faf5c07b0a0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:44.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.584+0000 7faf7615f640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf700cb910 0x7faf700b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:44.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.584+0000 7faf7615f640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf700b59a0 0x7faf700ce9e0 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:44.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.584+0000 7faf7615f640 1 --2- 172.21.15.146:0/3355341038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf58004800 0x7faf701f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:44.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.584+0000 7faf7615f640 1 -- 172.21.15.146:0/3355341038 >> 172.21.15.146:0/3355341038 conn(0x7faf700d4be0 msgr2=0x7faf7015daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:44.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.584+0000 7faf7615f640 1 -- 172.21.15.146:0/3355341038 shutdown_connections 2024-09-17T03:43:44.585 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.584+0000 7faf7615f640 1 -- 172.21.15.146:0/3355341038 wait complete. 2024-09-17T03:43:44.598 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:43:44.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.723+0000 7ff8bdc40640 1 -- 172.21.15.146:0/2898564305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b80d0710 msgr2=0x7ff8b80cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:44.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.723+0000 7ff8bdc40640 1 --2- 172.21.15.146:0/2898564305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b80d0710 0x7ff8b80cf170 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80d0b20 tx=0x7ff8a802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:43:44.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.723+0000 7ff8bdc40640 1 -- 172.21.15.146:0/2898564305 shutdown_connections 2024-09-17T03:43:44.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.723+0000 7ff8bdc40640 1 --2- 172.21.15.146:0/2898564305 >> v2:172.21.15.179:3300/0 conn(0x7ff8b80cf6b0 0x7ff8b8161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:44.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.723+0000 7ff8bdc40640 1 --2- 172.21.15.146:0/2898564305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b80d0710 0x7ff8b80cf170 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:44.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.723+0000 7ff8bdc40640 1 -- 172.21.15.146:0/2898564305 >> 172.21.15.146:0/2898564305 conn(0x7ff8b809ba20 msgr2=0x7ff8b80b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:44.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.723+0000 7ff8bdc40640 1 -- 172.21.15.146:0/2898564305 shutdown_connections 2024-09-17T03:43:44.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.723+0000 7ff8bdc40640 1 -- 172.21.15.146:0/2898564305 wait complete. 2024-09-17T03:43:44.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.725+0000 7ff8bdc40640 1 Processor -- start 2024-09-17T03:43:44.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.725+0000 7ff8bdc40640 1 -- start start 2024-09-17T03:43:44.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.726+0000 7ff8bdc40640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b80b47c0 0x7ff8b81f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.726+0000 7ff8bdc40640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8b80cf6b0 0x7ff8b815a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8bdc40640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8b80d0710 0x7ff8b80c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8bdc40640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b80b1de0 con 0x7ff8b80b47c0 2024-09-17T03:43:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8bdc40640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b8162080 con 0x7ff8b80cf6b0 2024-09-17T03:43:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8bdc40640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b80b1f60 con 0x7ff8b80d0710 2024-09-17T03:43:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8b77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b80b47c0 0x7ff8b81f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8b77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b80b47c0 0x7ff8b81f3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57560/0 (socket says 172.21.15.146:57560) 2024-09-17T03:43:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8b77fe640 1 -- 172.21.15.146:0/366875691 learned_addr learned my addr 172.21.15.146:0/366875691 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8b77fe640 1 -- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8b80d0710 msgr2=0x7ff8b80c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8b77fe640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8b80d0710 0x7ff8b80c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8b77fe640 1 -- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8b80cf6b0 msgr2=0x7ff8b815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8b77fe640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8b80cf6b0 0x7ff8b815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8b77fe640 1 -- 172.21.15.146:0/366875691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b81f4280 con 0x7ff8b80b47c0 2024-09-17T03:43:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8b77fe640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b80b47c0 0x7ff8b81f3d40 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7ff8a802aa90 tx=0x7ff8a8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff89ffff640 1 -- 172.21.15.146:0/366875691 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8031d60 con 0x7ff8b80b47c0 2024-09-17T03:43:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff89ffff640 1 -- 172.21.15.146:0/366875691 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8a8033e10 con 0x7ff8b80b47c0 2024-09-17T03:43:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff89ffff640 1 -- 172.21.15.146:0/366875691 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8005260 con 0x7ff8b80b47c0 2024-09-17T03:43:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8bdc40640 1 -- 172.21.15.146:0/366875691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b815f570 con 0x7ff8b80b47c0 2024-09-17T03:43:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.727+0000 7ff8bdc40640 1 -- 172.21.15.146:0/366875691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b81f3540 con 0x7ff8b80b47c0 2024-09-17T03:43:44.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.728+0000 7ff8bdc40640 1 -- 172.21.15.146:0/366875691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b80cf170 con 0x7ff8b80b47c0 2024-09-17T03:43:44.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.729+0000 7ff89ffff640 1 -- 172.21.15.146:0/366875691 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8a8005400 con 0x7ff8b80b47c0 2024-09-17T03:43:44.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.729+0000 7ff89ffff640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff8a4078bc0 0x7ff8a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:44.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.730+0000 7ff89ffff640 1 -- 172.21.15.146:0/366875691 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5443+0+0 (secure 0 0 0) 0x7ff8a80bbf20 con 0x7ff8b80b47c0 2024-09-17T03:43:44.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.730+0000 7ff8b6ffd640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff8a4078bc0 0x7ff8a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:44.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.730+0000 7ff8b6ffd640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff8a4078bc0 0x7ff8a407b0d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80cf550 tx=0x7ff8ac005bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:44.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.734+0000 7ff89ffff640 1 -- 172.21.15.146:0/366875691 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff8a803f030 con 0x7ff8b80b47c0 2024-09-17T03:43:44.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:44.906+0000 7ff8bdc40640 1 -- 172.21.15.146:0/366875691 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff8b80ced70 con 0x7ff8b80b47c0 2024-09-17T03:43:45.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.591+0000 7ff89ffff640 1 -- 172.21.15.146:0/366875691 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v158) ==== 169+0+0 (secure 0 0 0) 0x7ff8a80844f0 con 0x7ff8b80b47c0 2024-09-17T03:43:45.592 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:43:45.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.596+0000 7ff8bdc40640 1 -- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff8a4078bc0 msgr2=0x7ff8a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:45.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.596+0000 7ff8bdc40640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff8a4078bc0 0x7ff8a407b0d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff8b80cf550 tx=0x7ff8ac005bd0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.596+0000 7ff8bdc40640 1 -- 172.21.15.146:0/366875691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b80b47c0 msgr2=0x7ff8b81f3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:45.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.596+0000 7ff8bdc40640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b80b47c0 0x7ff8b81f3d40 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7ff8a802aa90 tx=0x7ff8a8033c20 comp rx=0 tx=0).stop 2024-09-17T03:43:45.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.596+0000 7ff8bdc40640 1 -- 172.21.15.146:0/366875691 shutdown_connections 2024-09-17T03:43:45.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.596+0000 7ff8bdc40640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff8a4078bc0 0x7ff8a407b0d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.596+0000 7ff8bdc40640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8b80d0710 0x7ff8b80c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.596+0000 7ff8bdc40640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8b80cf6b0 0x7ff8b815a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.596+0000 7ff8bdc40640 1 --2- 172.21.15.146:0/366875691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8b80b47c0 0x7ff8b81f3d40 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.596+0000 7ff8bdc40640 1 -- 172.21.15.146:0/366875691 >> 172.21.15.146:0/366875691 conn(0x7ff8b809ba20 msgr2=0x7ff8b80b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:45.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.597+0000 7ff8bdc40640 1 -- 172.21.15.146:0/366875691 shutdown_connections 2024-09-17T03:43:45.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.597+0000 7ff8bdc40640 1 -- 172.21.15.146:0/366875691 wait complete. 2024-09-17T03:43:45.615 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:43:45.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.733+0000 7f10c0b58640 1 -- 172.21.15.146:0/2841647609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10bc15c8e0 msgr2=0x7f10bc06f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:45.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.733+0000 7f10c0b58640 1 --2- 172.21.15.146:0/2841647609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10bc15c8e0 0x7f10bc06f580 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009830 tx=0x7f10ac02a480 comp rx=0 tx=0).stop 2024-09-17T03:43:45.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.733+0000 7f10c0b58640 1 -- 172.21.15.146:0/2841647609 shutdown_connections 2024-09-17T03:43:45.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.733+0000 7f10c0b58640 1 --2- 172.21.15.146:0/2841647609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10bc0cd840 0x7f10bc0b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.733+0000 7f10c0b58640 1 --2- 172.21.15.146:0/2841647609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10bc15c8e0 0x7f10bc06f580 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.733+0000 7f10c0b58640 1 -- 172.21.15.146:0/2841647609 >> 172.21.15.146:0/2841647609 conn(0x7f10bc0b3150 msgr2=0x7f10bc0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:45.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.733+0000 7f10c0b58640 1 -- 172.21.15.146:0/2841647609 shutdown_connections 2024-09-17T03:43:45.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.733+0000 7f10c0b58640 1 -- 172.21.15.146:0/2841647609 wait complete. 2024-09-17T03:43:45.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.735+0000 7f10c0b58640 1 Processor -- start 2024-09-17T03:43:45.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.735+0000 7f10c0b58640 1 -- start start 2024-09-17T03:43:45.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10c0b58640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10bc0cd840 0x7f10bc1f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:45.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10c0b58640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10bc0cdc50 0x7f10bc1f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:45.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10c0b58640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10bc15c8e0 0x7f10bc06ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:45.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10c0b58640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc073580 con 0x7f10bc0cd840 2024-09-17T03:43:45.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10c0b58640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f10bc0b5e10 con 0x7f10bc15c8e0 2024-09-17T03:43:45.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10c0b58640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f10bc073700 con 0x7f10bc0cdc50 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10ba59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10bc0cd840 0x7f10bc1f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10ba59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10bc0cd840 0x7f10bc1f3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57578/0 (socket says 172.21.15.146:57578) 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10ba59c640 1 -- 172.21.15.146:0/3976135257 learned_addr learned my addr 172.21.15.146:0/3976135257 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10b1d9b640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10bc0cdc50 0x7f10bc1f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10bad9d640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10bc15c8e0 0x7f10bc06ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10ba59c640 1 -- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10bc0cdc50 msgr2=0x7f10bc1f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10ba59c640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10bc0cdc50 0x7f10bc1f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10ba59c640 1 -- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10bc15c8e0 msgr2=0x7f10bc06ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10ba59c640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10bc15c8e0 0x7f10bc06ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10ba59c640 1 -- 172.21.15.146:0/3976135257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10bc1f7df0 con 0x7f10bc0cd840 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.737+0000 7f10ba59c640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10bc0cd840 0x7f10bc1f3850 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f10ac000c00 tx=0x7f10ac033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.738+0000 7f10b37fe640 1 -- 172.21.15.146:0/3976135257 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac005c90 con 0x7f10bc0cd840 2024-09-17T03:43:45.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.738+0000 7f10b37fe640 1 -- 172.21.15.146:0/3976135257 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10ac031e50 con 0x7f10bc0cd840 2024-09-17T03:43:45.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.738+0000 7f10c0b58640 1 -- 172.21.15.146:0/3976135257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10bc1f3ea0 con 0x7f10bc0cd840 2024-09-17T03:43:45.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.738+0000 7f10b37fe640 1 -- 172.21.15.146:0/3976135257 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac0332f0 con 0x7f10bc0cd840 2024-09-17T03:43:45.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.738+0000 7f10c0b58640 1 -- 172.21.15.146:0/3976135257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10bc1f4460 con 0x7f10bc0cd840 2024-09-17T03:43:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.739+0000 7f10c0b58640 1 -- 172.21.15.146:0/3976135257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10bc073bb0 con 0x7f10bc0cd840 2024-09-17T03:43:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.739+0000 7f10b37fe640 1 -- 172.21.15.146:0/3976135257 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10ac033490 con 0x7f10bc0cd840 2024-09-17T03:43:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.740+0000 7f10b37fe640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f109c078bc0 0x7f109c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.740+0000 7f10b37fe640 1 -- 172.21.15.146:0/3976135257 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5029+0+0 (secure 0 0 0) 0x7f10ac0bbcd0 con 0x7f10bc0cd840 2024-09-17T03:43:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.740+0000 7f10b1d9b640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f109c078bc0 0x7f109c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.741+0000 7f10b1d9b640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f109c078bc0 0x7f109c07b0d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f10bc15e060 tx=0x7f10a400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:45.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.744+0000 7f10b37fe640 1 -- 172.21.15.146:0/3976135257 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f10bc1f7df0 con 0x7f10bc0cd840 2024-09-17T03:43:45.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.930+0000 7f10c0b58640 1 -- 172.21.15.146:0/3976135257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f10bc0b5640 con 0x7f10bc0cd840 2024-09-17T03:43:45.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.936+0000 7f10b37fe640 1 -- 172.21.15.146:0/3976135257 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v59) ==== 71+0+0 (secure 0 0 0) 0x7f10ac03f030 con 0x7f10bc0cd840 2024-09-17T03:43:45.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 -- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f109c078bc0 msgr2=0x7f109c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:45.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f109c078bc0 0x7f109c07b0d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f10bc15e060 tx=0x7f10a400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 -- 172.21.15.146:0/3976135257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10bc0cd840 msgr2=0x7f10bc1f3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:45.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10bc0cd840 0x7f10bc1f3850 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f10ac000c00 tx=0x7f10ac033c90 comp rx=0 tx=0).stop 2024-09-17T03:43:45.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 -- 172.21.15.146:0/3976135257 shutdown_connections 2024-09-17T03:43:45.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f109c078bc0 0x7f109c07b0d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f10bc15c8e0 0x7f10bc06ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f10bc0cdc50 0x7f10bc1f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 --2- 172.21.15.146:0/3976135257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10bc0cd840 0x7f10bc1f3850 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:45.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 -- 172.21.15.146:0/3976135257 >> 172.21.15.146:0/3976135257 conn(0x7f10bc0b3150 msgr2=0x7f10bc0ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:45.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 -- 172.21.15.146:0/3976135257 shutdown_connections 2024-09-17T03:43:45.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:45.940+0000 7f10c0b58640 1 -- 172.21.15.146:0/3976135257 wait complete. 2024-09-17T03:43:45.952 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-17T03:43:46.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.084+0000 7ff600e8b640 1 -- 172.21.15.146:0/2413508394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc070350 msgr2=0x7ff5fc072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:46.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.084+0000 7ff600e8b640 1 --2- 172.21.15.146:0/2413508394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc070350 0x7ff5fc072680 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00098e0 tx=0x7ff5f002a530 comp rx=0 tx=0).stop 2024-09-17T03:43:46.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.084+0000 7ff600e8b640 1 -- 172.21.15.146:0/2413508394 shutdown_connections 2024-09-17T03:43:46.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.084+0000 7ff600e8b640 1 --2- 172.21.15.146:0/2413508394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc070350 0x7ff5fc072680 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.084+0000 7ff600e8b640 1 --2- 172.21.15.146:0/2413508394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc15b770 0x7ff5fc06fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.084+0000 7ff600e8b640 1 -- 172.21.15.146:0/2413508394 >> 172.21.15.146:0/2413508394 conn(0x7ff5fc0b2060 msgr2=0x7ff5fc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:46.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.084+0000 7ff600e8b640 1 -- 172.21.15.146:0/2413508394 shutdown_connections 2024-09-17T03:43:46.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.084+0000 7ff600e8b640 1 -- 172.21.15.146:0/2413508394 wait complete. 2024-09-17T03:43:46.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.086+0000 7ff600e8b640 1 Processor -- start 2024-09-17T03:43:46.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.086+0000 7ff600e8b640 1 -- start start 2024-09-17T03:43:46.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff600e8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc070350 0x7ff5fc151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:46.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff600e8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc072bc0 0x7ff5fc140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff600e8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5fc15b770 0x7ff5fc140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff600e8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc15f9f0 con 0x7ff5fc070350 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff600e8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc0b5590 con 0x7ff5fc15b770 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff600e8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc15fb70 con 0x7ff5fc072bc0 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff5fa59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc070350 0x7ff5fc151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff5fa59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc070350 0x7ff5fc151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57594/0 (socket says 172.21.15.146:57594) 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff5fa59c640 1 -- 172.21.15.146:0/242094377 learned_addr learned my addr 172.21.15.146:0/242094377 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff5f9d9b640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc072bc0 0x7ff5fc140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff5fad9d640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5fc15b770 0x7ff5fc140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff5fa59c640 1 -- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc072bc0 msgr2=0x7ff5fc140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.087+0000 7ff5fa59c640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc072bc0 0x7ff5fc140670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.088+0000 7ff5fa59c640 1 -- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5fc15b770 msgr2=0x7ff5fc140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:46.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.088+0000 7ff5fa59c640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5fc15b770 0x7ff5fc140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.088+0000 7ff5fa59c640 1 -- 172.21.15.146:0/242094377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc1524c0 con 0x7ff5fc070350 2024-09-17T03:43:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.088+0000 7ff5f9d9b640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc072bc0 0x7ff5fc140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.088+0000 7ff5fa59c640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc070350 0x7ff5fc151f80 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00e790 tx=0x7ff5ec00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.088+0000 7ff5eaffd640 1 -- 172.21.15.146:0/242094377 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec00eea0 con 0x7ff5fc070350 2024-09-17T03:43:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.088+0000 7ff5eaffd640 1 -- 172.21.15.146:0/242094377 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5ec00cdb0 con 0x7ff5fc070350 2024-09-17T03:43:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.088+0000 7ff600e8b640 1 -- 172.21.15.146:0/242094377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc152940 con 0x7ff5fc070350 2024-09-17T03:43:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.088+0000 7ff5eaffd640 1 -- 172.21.15.146:0/242094377 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec010690 con 0x7ff5fc070350 2024-09-17T03:43:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.088+0000 7ff600e8b640 1 -- 172.21.15.146:0/242094377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5fc152f00 con 0x7ff5fc070350 2024-09-17T03:43:46.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.089+0000 7ff600e8b640 1 -- 172.21.15.146:0/242094377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5fc1600a0 con 0x7ff5fc070350 2024-09-17T03:43:46.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.090+0000 7ff5eaffd640 1 -- 172.21.15.146:0/242094377 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff5ec010830 con 0x7ff5fc070350 2024-09-17T03:43:46.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.090+0000 7ff5eaffd640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5dc078bc0 0x7ff5dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:46.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.090+0000 7ff5eaffd640 1 -- 172.21.15.146:0/242094377 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5029+0+0 (secure 0 0 0) 0x7ff5ec09b520 con 0x7ff5fc070350 2024-09-17T03:43:46.091 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.091+0000 7ff5f9d9b640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5dc078bc0 0x7ff5dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:46.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.091+0000 7ff5f9d9b640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5dc078bc0 0x7ff5dc07b0d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0034000 tx=0x7ff5f0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:46.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.095+0000 7ff5eaffd640 1 -- 172.21.15.146:0/242094377 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff5ec063b80 con 0x7ff5fc070350 2024-09-17T03:43:46.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.340+0000 7ff600e8b640 1 -- 172.21.15.146:0/242094377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7ff5fc1561f0 con 0x7ff5fc070350 2024-09-17T03:43:46.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.593+0000 7ff5eaffd640 1 -- 172.21.15.146:0/242094377 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v521) ==== 166+0+0 (secure 0 0 0) 0x7ff5ec063480 con 0x7ff5fc070350 2024-09-17T03:43:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 -- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5dc078bc0 msgr2=0x7ff5dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5dc078bc0 0x7ff5dc07b0d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0034000 tx=0x7ff5f0004730 comp rx=0 tx=0).stop 2024-09-17T03:43:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 -- 172.21.15.146:0/242094377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc070350 msgr2=0x7ff5fc151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc070350 0x7ff5fc151f80 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00e790 tx=0x7ff5ec00ec50 comp rx=0 tx=0).stop 2024-09-17T03:43:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 -- 172.21.15.146:0/242094377 shutdown_connections 2024-09-17T03:43:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff5dc078bc0 0x7ff5dc07b0d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff5fc15b770 0x7ff5fc140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff5fc072bc0 0x7ff5fc140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 --2- 172.21.15.146:0/242094377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5fc070350 0x7ff5fc151f80 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 -- 172.21.15.146:0/242094377 >> 172.21.15.146:0/242094377 conn(0x7ff5fc0b2060 msgr2=0x7ff5fc0b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:46.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 -- 172.21.15.146:0/242094377 shutdown_connections 2024-09-17T03:43:46.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.596+0000 7ff600e8b640 1 -- 172.21.15.146:0/242094377 wait complete. 2024-09-17T03:43:46.608 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-17T03:43:46.608 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-17T03:43:46.609 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:43:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.722+0000 7ff9589c3640 1 -- 172.21.15.146:0/3974138994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9540b55f0 msgr2=0x7ff954070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.722+0000 7ff9589c3640 1 --2- 172.21.15.146:0/3974138994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9540b55f0 0x7ff954070be0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7ff944005fd0 tx=0x7ff94402a940 comp rx=0 tx=0).stop 2024-09-17T03:43:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.722+0000 7ff9589c3640 1 -- 172.21.15.146:0/3974138994 shutdown_connections 2024-09-17T03:43:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.722+0000 7ff9589c3640 1 --2- 172.21.15.146:0/3974138994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9540b55f0 0x7ff954070be0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.722+0000 7ff9589c3640 1 -- 172.21.15.146:0/3974138994 >> 172.21.15.146:0/3974138994 conn(0x7ff9540b3410 msgr2=0x7ff9540b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.722+0000 7ff9589c3640 1 -- 172.21.15.146:0/3974138994 shutdown_connections 2024-09-17T03:43:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.722+0000 7ff9589c3640 1 -- 172.21.15.146:0/3974138994 wait complete. 2024-09-17T03:43:46.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.724+0000 7ff9589c3640 1 Processor -- start 2024-09-17T03:43:46.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.724+0000 7ff9589c3640 1 -- start start 2024-09-17T03:43:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.725+0000 7ff9589c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff95406dd60 0x7ff954159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.725+0000 7ff9589c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff954071120 0x7ff954157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:46.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff9589c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9540b55f0 0x7ff954154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:46.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff9589c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff95415c0a0 con 0x7ff9540b55f0 2024-09-17T03:43:46.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff9589c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff95415bf20 con 0x7ff954071120 2024-09-17T03:43:46.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff9589c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff95415c220 con 0x7ff95406dd60 2024-09-17T03:43:46.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff952d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9540b55f0 0x7ff954154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:46.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff952d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9540b55f0 0x7ff954154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57616/0 (socket says 172.21.15.146:57616) 2024-09-17T03:43:46.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff952d9d640 1 -- 172.21.15.146:0/3597325868 learned_addr learned my addr 172.21.15.146:0/3597325868 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:46.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff951d9b640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff954071120 0x7ff954157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff95259c640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff95406dd60 0x7ff954159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff952d9d640 1 -- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff95406dd60 msgr2=0x7ff954159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff952d9d640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff95406dd60 0x7ff954159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff952d9d640 1 -- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff954071120 msgr2=0x7ff954157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff952d9d640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff954071120 0x7ff954157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff952d9d640 1 -- 172.21.15.146:0/3597325868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9541f3e40 con 0x7ff9540b55f0 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff95259c640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff95406dd60 0x7ff954159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff952d9d640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9540b55f0 0x7ff954154fc0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00c3f0 tx=0x7ff94c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff942ffd640 1 -- 172.21.15.146:0/3597325868 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c017070 con 0x7ff9540b55f0 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff942ffd640 1 -- 172.21.15.146:0/3597325868 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff94c0053c0 con 0x7ff9540b55f0 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff9589c3640 1 -- 172.21.15.146:0/3597325868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9541f4120 con 0x7ff9540b55f0 2024-09-17T03:43:46.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff942ffd640 1 -- 172.21.15.146:0/3597325868 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c003850 con 0x7ff9540b55f0 2024-09-17T03:43:46.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.726+0000 7ff9589c3640 1 -- 172.21.15.146:0/3597325868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9541f46e0 con 0x7ff9540b55f0 2024-09-17T03:43:46.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.727+0000 7ff9589c3640 1 -- 172.21.15.146:0/3597325868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9540b18f0 con 0x7ff9540b55f0 2024-09-17T03:43:46.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.728+0000 7ff942ffd640 1 -- 172.21.15.146:0/3597325868 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff94c01a070 con 0x7ff9540b55f0 2024-09-17T03:43:46.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.729+0000 7ff942ffd640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff934078bc0 0x7ff93407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:46.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.729+0000 7ff942ffd640 1 -- 172.21.15.146:0/3597325868 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5029+0+0 (secure 0 0 0) 0x7ff94c099d60 con 0x7ff9540b55f0 2024-09-17T03:43:46.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.729+0000 7ff95259c640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff934078bc0 0x7ff93407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:46.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.730+0000 7ff95259c640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff934078bc0 0x7ff93407b0d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff944034000 tx=0x7ff944004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:46.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.733+0000 7ff942ffd640 1 -- 172.21.15.146:0/3597325868 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff9540b18f0 con 0x7ff9540b55f0 2024-09-17T03:43:46.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.908+0000 7ff9589c3640 1 -- 172.21.15.146:0/3597325868 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff95415c6d0 con 0x7ff9540b55f0 2024-09-17T03:43:46.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.909+0000 7ff942ffd640 1 -- 172.21.15.146:0/3597325868 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) ==== 74+0+13224 (secure 0 0 0) 0x7ff94c061e30 con 0x7ff9540b55f0 2024-09-17T03:43:46.909 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:46.910 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":158,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:43:45.582019+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6837/3591121123":"2024-09-18T03:43:42.572651+0000","172.21.15.179:6835/3591121123":"2024-09-18T03:43:42.572651+0000","172.21.15.146:6835/2786424389":"2024-09-18T03:43:35.362527+0000","172.21.15.146:6833/2786424389":"2024-09-18T03:43:35.362527+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:43:46.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.911+0000 7ff9589c3640 1 -- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff934078bc0 msgr2=0x7ff93407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:46.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.911+0000 7ff9589c3640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff934078bc0 0x7ff93407b0d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff944034000 tx=0x7ff944004ab0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.911+0000 7ff9589c3640 1 -- 172.21.15.146:0/3597325868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9540b55f0 msgr2=0x7ff954154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:46.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.911+0000 7ff9589c3640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9540b55f0 0x7ff954154fc0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00c3f0 tx=0x7ff94c00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.912+0000 7ff9589c3640 1 -- 172.21.15.146:0/3597325868 shutdown_connections 2024-09-17T03:43:46.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.912+0000 7ff9589c3640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff934078bc0 0x7ff93407b0d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.912+0000 7ff9589c3640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9540b55f0 0x7ff954154fc0 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.912+0000 7ff9589c3640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff954071120 0x7ff954157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.912+0000 7ff9589c3640 1 --2- 172.21.15.146:0/3597325868 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff95406dd60 0x7ff954159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.912+0000 7ff9589c3640 1 -- 172.21.15.146:0/3597325868 >> 172.21.15.146:0/3597325868 conn(0x7ff9540b3410 msgr2=0x7ff954151ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.912+0000 7ff9589c3640 1 -- 172.21.15.146:0/3597325868 shutdown_connections 2024-09-17T03:43:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:46.912+0000 7ff9589c3640 1 -- 172.21.15.146:0/3597325868 wait complete. 2024-09-17T03:43:46.924 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:43:46.925 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:43:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.042+0000 7fae80464640 1 -- 172.21.15.146:0/1238195620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae64004800 msgr2=0x7fae64004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.042+0000 7fae80464640 1 --2- 172.21.15.146:0/1238195620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae64004800 0x7fae64004c10 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7fae68001820 tx=0x7fae64005830 comp rx=0 tx=0).stop 2024-09-17T03:43:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.042+0000 7fae7ea01640 1 -- 172.21.15.146:0/1238195620 reap_dead start 2024-09-17T03:43:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.042+0000 7fae80464640 1 -- 172.21.15.146:0/1238195620 shutdown_connections 2024-09-17T03:43:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.042+0000 7fae80464640 1 -- 172.21.15.146:0/1238195620 >> 172.21.15.146:0/1238195620 conn(0x7fae780b2060 msgr2=0x7fae780b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.042+0000 7fae80464640 1 -- 172.21.15.146:0/1238195620 shutdown_connections 2024-09-17T03:43:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.042+0000 7fae80464640 1 -- 172.21.15.146:0/1238195620 wait complete. 2024-09-17T03:43:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.044+0000 7fae80464640 1 Processor -- start 2024-09-17T03:43:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.044+0000 7fae80464640 1 -- start start 2024-09-17T03:43:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.045+0000 7fae80464640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae64004800 0x7fae781f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.045+0000 7fae80464640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae780ac130 0x7fae780aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.045+0000 7fae80464640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae780adc50 0x7fae780ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.045+0000 7fae80464640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fae7806e470 con 0x7fae780ac130 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.045+0000 7fae80464640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fae780b4dc0 con 0x7fae780adc50 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.045+0000 7fae80464640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fae7806e5f0 con 0x7fae64004800 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.045+0000 7fae7d9ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae780ac130 0x7fae780aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.045+0000 7fae7d9ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae780ac130 0x7fae780aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57642/0 (socket says 172.21.15.146:57642) 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.045+0000 7fae7d9ff640 1 -- 172.21.15.146:0/121330888 learned_addr learned my addr 172.21.15.146:0/121330888 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.045+0000 7fae7ea01640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae780adc50 0x7fae780ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.045+0000 7fae7e200640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae64004800 0x7fae781f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.046+0000 7fae7d9ff640 1 -- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae64004800 msgr2=0x7fae781f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.046+0000 7fae7d9ff640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae64004800 0x7fae781f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.046+0000 7fae7d9ff640 1 -- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae780adc50 msgr2=0x7fae780ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:47.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.046+0000 7fae7d9ff640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae780adc50 0x7fae780ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.046+0000 7fae7d9ff640 1 -- 172.21.15.146:0/121330888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae780ab090 con 0x7fae780ac130 2024-09-17T03:43:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.046+0000 7fae7d9ff640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae780ac130 0x7fae780aef50 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fae6802aa40 tx=0x7fae680060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.046+0000 7fae6effd640 1 -- 172.21.15.146:0/121330888 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68003a00 con 0x7fae780ac130 2024-09-17T03:43:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.046+0000 7fae6effd640 1 -- 172.21.15.146:0/121330888 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae68003c90 con 0x7fae780ac130 2024-09-17T03:43:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.046+0000 7fae6effd640 1 -- 172.21.15.146:0/121330888 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae680336e0 con 0x7fae780ac130 2024-09-17T03:43:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.046+0000 7fae80464640 1 -- 172.21.15.146:0/121330888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae780ab370 con 0x7fae780ac130 2024-09-17T03:43:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.046+0000 7fae80464640 1 -- 172.21.15.146:0/121330888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae780ab930 con 0x7fae780ac130 2024-09-17T03:43:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.047+0000 7fae80464640 1 -- 172.21.15.146:0/121330888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae780aae00 con 0x7fae780ac130 2024-09-17T03:43:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.048+0000 7fae6effd640 1 -- 172.21.15.146:0/121330888 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae68045020 con 0x7fae780ac130 2024-09-17T03:43:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.048+0000 7fae6effd640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae5c078bc0 0x7fae5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.049+0000 7fae6effd640 1 -- 172.21.15.146:0/121330888 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5029+0+0 (secure 0 0 0) 0x7fae680ba8e0 con 0x7fae780ac130 2024-09-17T03:43:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.049+0000 7fae7e200640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae5c078bc0 0x7fae5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.049+0000 7fae7e200640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae5c078bc0 0x7fae5c07b0d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fae74006c60 tx=0x7fae740011c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:47.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.053+0000 7fae6effd640 1 -- 172.21.15.146:0/121330888 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fae68082970 con 0x7fae780ac130 2024-09-17T03:43:47.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.230+0000 7fae80464640 1 -- 172.21.15.146:0/121330888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fae7815ead0 con 0x7fae780ac130 2024-09-17T03:43:47.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.230+0000 7fae6effd640 1 -- 172.21.15.146:0/121330888 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) ==== 93+0+10 (secure 0 0 0) 0x7fae680873a0 con 0x7fae780ac130 2024-09-17T03:43:47.231 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:43:47.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.232+0000 7fae80464640 1 -- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae5c078bc0 msgr2=0x7fae5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:47.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.232+0000 7fae80464640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae5c078bc0 0x7fae5c07b0d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fae74006c60 tx=0x7fae740011c0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.232+0000 7fae80464640 1 -- 172.21.15.146:0/121330888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae780ac130 msgr2=0x7fae780aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:47.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.232+0000 7fae80464640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae780ac130 0x7fae780aef50 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fae6802aa40 tx=0x7fae680060e0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.232+0000 7fae80464640 1 -- 172.21.15.146:0/121330888 shutdown_connections 2024-09-17T03:43:47.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.232+0000 7fae80464640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fae5c078bc0 0x7fae5c07b0d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.232+0000 7fae80464640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae780adc50 0x7fae780ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.232+0000 7fae80464640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae780ac130 0x7fae780aef50 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.232+0000 7fae80464640 1 --2- 172.21.15.146:0/121330888 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fae64004800 0x7fae781f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.232+0000 7fae80464640 1 -- 172.21.15.146:0/121330888 >> 172.21.15.146:0/121330888 conn(0x7fae780b2060 msgr2=0x7fae78075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:47.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.232+0000 7fae80464640 1 -- 172.21.15.146:0/121330888 shutdown_connections 2024-09-17T03:43:47.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.233+0000 7fae80464640 1 -- 172.21.15.146:0/121330888 wait complete. 2024-09-17T03:43:47.245 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-17T03:43:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.358+0000 7f8413fff640 1 -- 172.21.15.146:0/2930096910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8414160790 msgr2=0x7f84140b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.358+0000 7f8413fff640 1 --2- 172.21.15.146:0/2930096910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8414160790 0x7f84140b3f70 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f83fc005fd0 tx=0x7f83fc02a540 comp rx=0 tx=0).stop 2024-09-17T03:43:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.358+0000 7f8413fff640 1 -- 172.21.15.146:0/2930096910 shutdown_connections 2024-09-17T03:43:47.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.358+0000 7f8413fff640 1 --2- 172.21.15.146:0/2930096910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8414160790 0x7f84140b3f70 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.358+0000 7f8413fff640 1 --2- 172.21.15.146:0/2930096910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8414071100 0x7f8414160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.358+0000 7f8413fff640 1 -- 172.21.15.146:0/2930096910 >> 172.21.15.146:0/2930096910 conn(0x7f84140b2860 msgr2=0x7f84140b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.358+0000 7f8413fff640 1 -- 172.21.15.146:0/2930096910 shutdown_connections 2024-09-17T03:43:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.358+0000 7f8413fff640 1 -- 172.21.15.146:0/2930096910 wait complete. 2024-09-17T03:43:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.360+0000 7f8413fff640 1 Processor -- start 2024-09-17T03:43:47.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.360+0000 7f8413fff640 1 -- start start 2024-09-17T03:43:47.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.361+0000 7f8413fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8414071100 0x7f84140afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.361+0000 7f8413fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84140b44b0 0x7f84141f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.361+0000 7f8413fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8414160790 0x7f841415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.361+0000 7f8413fff640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f841415d370 con 0x7f84140b44b0 2024-09-17T03:43:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.361+0000 7f8413fff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f84140d0240 con 0x7f8414160790 2024-09-17T03:43:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.361+0000 7f8413fff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f841415d4f0 con 0x7f8414071100 2024-09-17T03:43:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.361+0000 7f84127fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84140b44b0 0x7f84141f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.361+0000 7f84127fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84140b44b0 0x7f84141f44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56658/0 (socket says 172.21.15.146:56658) 2024-09-17T03:43:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.361+0000 7f84127fc640 1 -- 172.21.15.146:0/450089697 learned_addr learned my addr 172.21.15.146:0/450089697 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f8412ffd640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8414071100 0x7f84140afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f84137fe640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8414160790 0x7f841415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f84127fc640 1 -- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8414071100 msgr2=0x7f84140afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f84127fc640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8414071100 0x7f84140afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f84127fc640 1 -- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8414160790 msgr2=0x7f841415ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f84127fc640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8414160790 0x7f841415ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f84127fc640 1 -- 172.21.15.146:0/450089697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8414156740 con 0x7f84140b44b0 2024-09-17T03:43:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f84137fe640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8414160790 0x7f841415ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f84127fc640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84140b44b0 0x7f84141f44a0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f83fc034040 tx=0x7f83fc003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f840b7fe640 1 -- 172.21.15.146:0/450089697 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc03e030 con 0x7f84140b44b0 2024-09-17T03:43:47.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f840b7fe640 1 -- 172.21.15.146:0/450089697 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83fc003e00 con 0x7f84140b44b0 2024-09-17T03:43:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f8413fff640 1 -- 172.21.15.146:0/450089697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84141f49e0 con 0x7f84140b44b0 2024-09-17T03:43:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f840b7fe640 1 -- 172.21.15.146:0/450089697 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc035040 con 0x7f84140b44b0 2024-09-17T03:43:47.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.362+0000 7f8413fff640 1 -- 172.21.15.146:0/450089697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8414159e50 con 0x7f84140b44b0 2024-09-17T03:43:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.363+0000 7f8413fff640 1 -- 172.21.15.146:0/450089697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841415da10 con 0x7f84140b44b0 2024-09-17T03:43:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.364+0000 7f840b7fe640 1 -- 172.21.15.146:0/450089697 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f83fc041030 con 0x7f84140b44b0 2024-09-17T03:43:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.364+0000 7f840b7fe640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f83f4078b90 0x7f83f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.364+0000 7f840b7fe640 1 -- 172.21.15.146:0/450089697 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5029+0+0 (secure 0 0 0) 0x7f83fc0bb130 con 0x7f84140b44b0 2024-09-17T03:43:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.365+0000 7f8412ffd640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f83f4078b90 0x7f83f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.365+0000 7f8412ffd640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f83f4078b90 0x7f83f407b0a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8404005fd0 tx=0x7f84040095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:47.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.369+0000 7f840b7fe640 1 -- 172.21.15.146:0/450089697 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84141f49e0 con 0x7f84140b44b0 2024-09-17T03:43:47.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:47.611+0000 7f8413fff640 1 -- 172.21.15.146:0/450089697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f8414075660 con 0x7f84140b44b0 2024-09-17T03:43:48.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.601+0000 7f840b7fe640 1 -- 172.21.15.146:0/450089697 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v523) ==== 162+0+0 (secure 0 0 0) 0x7f83fc0832e0 con 0x7f84140b44b0 2024-09-17T03:43:48.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.604+0000 7f8413fff640 1 -- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f83f4078b90 msgr2=0x7f83f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:48.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.604+0000 7f8413fff640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f83f4078b90 0x7f83f407b0a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8404005fd0 tx=0x7f84040095e0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.604+0000 7f8413fff640 1 -- 172.21.15.146:0/450089697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84140b44b0 msgr2=0x7f84141f44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:48.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.604+0000 7f8413fff640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84140b44b0 0x7f84141f44a0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f83fc034040 tx=0x7f83fc003910 comp rx=0 tx=0).stop 2024-09-17T03:43:48.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.604+0000 7f8413fff640 1 -- 172.21.15.146:0/450089697 shutdown_connections 2024-09-17T03:43:48.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.604+0000 7f8413fff640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f83f4078b90 0x7f83f407b0a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.604+0000 7f8413fff640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8414160790 0x7f841415ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.604+0000 7f8413fff640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84140b44b0 0x7f84141f44a0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.604+0000 7f8413fff640 1 --2- 172.21.15.146:0/450089697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8414071100 0x7f84140afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.604+0000 7f8413fff640 1 -- 172.21.15.146:0/450089697 >> 172.21.15.146:0/450089697 conn(0x7f84140b2860 msgr2=0x7f84140d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:48.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.605+0000 7f8413fff640 1 -- 172.21.15.146:0/450089697 shutdown_connections 2024-09-17T03:43:48.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.605+0000 7f8413fff640 1 -- 172.21.15.146:0/450089697 wait complete. 2024-09-17T03:43:48.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:43:48.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.737+0000 7f9d5c901640 1 -- 172.21.15.146:0/380508387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d580cd840 msgr2=0x7f9d580b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.737+0000 7f9d5c901640 1 --2- 172.21.15.146:0/380508387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d580cd840 0x7f9d580b5680 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009830 tx=0x7f9d4c02a480 comp rx=0 tx=0).stop 2024-09-17T03:43:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.737+0000 7f9d5c901640 1 -- 172.21.15.146:0/380508387 shutdown_connections 2024-09-17T03:43:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.737+0000 7f9d5c901640 1 --2- 172.21.15.146:0/380508387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d580cd840 0x7f9d580b5680 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.737+0000 7f9d5c901640 1 --2- 172.21.15.146:0/380508387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d5815c8e0 0x7f9d5806f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.737+0000 7f9d5c901640 1 -- 172.21.15.146:0/380508387 >> 172.21.15.146:0/380508387 conn(0x7f9d580b3150 msgr2=0x7f9d580b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.737+0000 7f9d5c901640 1 -- 172.21.15.146:0/380508387 shutdown_connections 2024-09-17T03:43:48.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.737+0000 7f9d5c901640 1 -- 172.21.15.146:0/380508387 wait complete. 2024-09-17T03:43:48.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.739+0000 7f9d5c901640 1 Processor -- start 2024-09-17T03:43:48.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.739+0000 7f9d5c901640 1 -- start start 2024-09-17T03:43:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.740+0000 7f9d5c901640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d580cd840 0x7f9d581e5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.740+0000 7f9d5c901640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d580cdc50 0x7f9d581e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.740+0000 7f9d5c901640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d5815c8e0 0x7f9d581e43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.740+0000 7f9d5c901640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9d580b5f50 con 0x7f9d580cdc50 2024-09-17T03:43:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.740+0000 7f9d5c901640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9d580b5dd0 con 0x7f9d5815c8e0 2024-09-17T03:43:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.740+0000 7f9d5c901640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9d58073580 con 0x7f9d580cd840 2024-09-17T03:43:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d55d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d580cdc50 0x7f9d581e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d55d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d580cdc50 0x7f9d581e3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56688/0 (socket says 172.21.15.146:56688) 2024-09-17T03:43:48.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d55d9b640 1 -- 172.21.15.146:0/3342771967 learned_addr learned my addr 172.21.15.146:0/3342771967 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d56d9d640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d5815c8e0 0x7f9d581e43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d5659c640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d580cd840 0x7f9d581e5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d55d9b640 1 -- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d580cd840 msgr2=0x7f9d581e5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d55d9b640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d580cd840 0x7f9d581e5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d55d9b640 1 -- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d5815c8e0 msgr2=0x7f9d581e43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d55d9b640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d5815c8e0 0x7f9d581e43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d55d9b640 1 -- 172.21.15.146:0/3342771967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d581e6330 con 0x7f9d580cdc50 2024-09-17T03:43:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d56d9d640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d5815c8e0 0x7f9d581e43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d55d9b640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d580cdc50 0x7f9d581e3eb0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c000c00 tx=0x7f9d4c033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d46ffd640 1 -- 172.21.15.146:0/3342771967 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c031d60 con 0x7f9d580cdc50 2024-09-17T03:43:48.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d46ffd640 1 -- 172.21.15.146:0/3342771967 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d4c0330d0 con 0x7f9d580cdc50 2024-09-17T03:43:48.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d5c901640 1 -- 172.21.15.146:0/3342771967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d581e6610 con 0x7f9d580cdc50 2024-09-17T03:43:48.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d46ffd640 1 -- 172.21.15.146:0/3342771967 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c033520 con 0x7f9d580cdc50 2024-09-17T03:43:48.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.741+0000 7f9d5c901640 1 -- 172.21.15.146:0/3342771967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d58156350 con 0x7f9d580cdc50 2024-09-17T03:43:48.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.742+0000 7f9d5c901640 1 -- 172.21.15.146:0/3342771967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d581e6850 con 0x7f9d580cdc50 2024-09-17T03:43:48.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.743+0000 7f9d46ffd640 1 -- 172.21.15.146:0/3342771967 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d4c0035f0 con 0x7f9d580cdc50 2024-09-17T03:43:48.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.744+0000 7f9d46ffd640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d38078bc0 0x7f9d3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:48.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.744+0000 7f9d46ffd640 1 -- 172.21.15.146:0/3342771967 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5029+0+0 (secure 0 0 0) 0x7f9d4c0bbfe0 con 0x7f9d580cdc50 2024-09-17T03:43:48.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.744+0000 7f9d5659c640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d38078bc0 0x7f9d3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:48.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.745+0000 7f9d5659c640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d38078bc0 0x7f9d3807b0d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009f20 tx=0x7f9d480094f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:48.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.748+0000 7f9d46ffd640 1 -- 172.21.15.146:0/3342771967 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9d4c03f030 con 0x7f9d580cdc50 2024-09-17T03:43:48.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.924+0000 7f9d5c901640 1 -- 172.21.15.146:0/3342771967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f9d580b5680 con 0x7f9d580cdc50 2024-09-17T03:43:48.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.925+0000 7f9d46ffd640 1 -- 172.21.15.146:0/3342771967 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v59) ==== 59+0+2294 (secure 0 0 0) 0x7f9d4c08be20 con 0x7f9d580cdc50 2024-09-17T03:43:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:43:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:43:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:43:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:43:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:43:48.925 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:43:48.926 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:43:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:43:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:43:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:43:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:43:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:43:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:43:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:43:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:43:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:43:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:43:48.927 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:43:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 -- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d38078bc0 msgr2=0x7f9d3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d38078bc0 0x7f9d3807b0d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009f20 tx=0x7f9d480094f0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 -- 172.21.15.146:0/3342771967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d580cdc50 msgr2=0x7f9d581e3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:48.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d580cdc50 0x7f9d581e3eb0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c000c00 tx=0x7f9d4c033d60 comp rx=0 tx=0).stop 2024-09-17T03:43:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 -- 172.21.15.146:0/3342771967 shutdown_connections 2024-09-17T03:43:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d38078bc0 0x7f9d3807b0d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d5815c8e0 0x7f9d581e43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d580cdc50 0x7f9d581e3eb0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 --2- 172.21.15.146:0/3342771967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d580cd840 0x7f9d581e5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 -- 172.21.15.146:0/3342771967 >> 172.21.15.146:0/3342771967 conn(0x7f9d580b3150 msgr2=0x7f9d5815ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 -- 172.21.15.146:0/3342771967 shutdown_connections 2024-09-17T03:43:48.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:48.927+0000 7f9d5c901640 1 -- 172.21.15.146:0/3342771967 wait complete. 2024-09-17T03:43:48.939 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:43:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.056+0000 7f7da1c7f640 1 -- 172.21.15.146:0/191467935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d84003a50 msgr2=0x7f7d84003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.056+0000 7f7da1c7f640 1 --2- 172.21.15.146:0/191467935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d84003a50 0x7f7d84003ec0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009b50 tx=0x7f7d84005830 comp rx=0 tx=0).stop 2024-09-17T03:43:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.056+0000 7f7da1c7f640 1 -- 172.21.15.146:0/191467935 shutdown_connections 2024-09-17T03:43:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.056+0000 7f7da1c7f640 1 --2- 172.21.15.146:0/191467935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d84003a50 0x7f7d84003ec0 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.056+0000 7f7da1c7f640 1 -- 172.21.15.146:0/191467935 >> 172.21.15.146:0/191467935 conn(0x7f7d9c0b3410 msgr2=0x7f7d9c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.056+0000 7f7da1c7f640 1 -- 172.21.15.146:0/191467935 shutdown_connections 2024-09-17T03:43:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.056+0000 7f7da1c7f640 1 -- 172.21.15.146:0/191467935 wait complete. 2024-09-17T03:43:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.058+0000 7f7da1c7f640 1 Processor -- start 2024-09-17T03:43:49.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.058+0000 7f7da1c7f640 1 -- start start 2024-09-17T03:43:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7da1c7f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d84003a50 0x7f7d9c1f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7da1c7f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d9c1f0050 0x7f7d9c1f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7da1c7f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c1f6630 0x7f7d9c1f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7da1c7f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c06e2f0 con 0x7f7d9c1f6630 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7da1c7f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c06e170 con 0x7f7d84003a50 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7da1c7f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9c06e470 con 0x7f7d9c1f0050 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7d9bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c1f6630 0x7f7d9c1f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7d9bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c1f6630 0x7f7d9c1f5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56706/0 (socket says 172.21.15.146:56706) 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7d9bfff640 1 -- 172.21.15.146:0/2442157422 learned_addr learned my addr 172.21.15.146:0/2442157422 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7d9b7fe640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d84003a50 0x7f7d9c1f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7d9affd640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d9c1f0050 0x7f7d9c1f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7d9bfff640 1 -- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d9c1f0050 msgr2=0x7f7d9c1f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7d9bfff640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d9c1f0050 0x7f7d9c1f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7d9bfff640 1 -- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d84003a50 msgr2=0x7f7d9c1f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7d9bfff640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d84003a50 0x7f7d9c1f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.059+0000 7f7d9bfff640 1 -- 172.21.15.146:0/2442157422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9c1f3b10 con 0x7f7d9c1f6630 2024-09-17T03:43:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.060+0000 7f7d9bfff640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c1f6630 0x7f7d9c1f5fd0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0b1110 tx=0x7f7d9400eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.060+0000 7f7d83fff640 1 -- 172.21.15.146:0/2442157422 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9400ca10 con 0x7f7d9c1f6630 2024-09-17T03:43:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.060+0000 7f7d83fff640 1 -- 172.21.15.146:0/2442157422 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d94015070 con 0x7f7d9c1f6630 2024-09-17T03:43:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.060+0000 7f7da1c7f640 1 -- 172.21.15.146:0/2442157422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9c1f3de0 con 0x7f7d9c1f6630 2024-09-17T03:43:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.060+0000 7f7d83fff640 1 -- 172.21.15.146:0/2442157422 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94011560 con 0x7f7d9c1f6630 2024-09-17T03:43:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.060+0000 7f7da1c7f640 1 -- 172.21.15.146:0/2442157422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d9c1f43a0 con 0x7f7d9c1f6630 2024-09-17T03:43:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.061+0000 7f7da1c7f640 1 -- 172.21.15.146:0/2442157422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d9c0b4530 con 0x7f7d9c1f6630 2024-09-17T03:43:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.062+0000 7f7d83fff640 1 -- 172.21.15.146:0/2442157422 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d94011700 con 0x7f7d9c1f6630 2024-09-17T03:43:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.062+0000 7f7d83fff640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d88078b90 0x7f7d8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.063+0000 7f7d83fff640 1 -- 172.21.15.146:0/2442157422 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5029+0+0 (secure 0 0 0) 0x7f7d9409cc40 con 0x7f7d9c1f6630 2024-09-17T03:43:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.063+0000 7f7d9b7fe640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d88078b90 0x7f7d8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.063+0000 7f7d9b7fe640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d88078b90 0x7f7d8807b0a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c035000 tx=0x7f7d8c0046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:49.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.067+0000 7f7d83fff640 1 -- 172.21.15.146:0/2442157422 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d94064d60 con 0x7f7d9c1f6630 2024-09-17T03:43:49.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.242+0000 7f7da1c7f640 1 -- 172.21.15.146:0/2442157422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7d9c15ea90 con 0x7f7d9c1f6630 2024-09-17T03:43:49.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.246+0000 7f7d83fff640 1 -- 172.21.15.146:0/2442157422 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v60)=0 v60) ==== 122+0+0 (secure 0 0 0) 0x7f7d94069790 con 0x7f7d9c1f6630 2024-09-17T03:43:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.248+0000 7f7da1c7f640 1 -- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d88078b90 msgr2=0x7f7d8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.248+0000 7f7da1c7f640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d88078b90 0x7f7d8807b0a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c035000 tx=0x7f7d8c0046c0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.248+0000 7f7da1c7f640 1 -- 172.21.15.146:0/2442157422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c1f6630 msgr2=0x7f7d9c1f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.248+0000 7f7da1c7f640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c1f6630 0x7f7d9c1f5fd0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0b1110 tx=0x7f7d9400eb60 comp rx=0 tx=0).stop 2024-09-17T03:43:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.248+0000 7f7da1c7f640 1 -- 172.21.15.146:0/2442157422 shutdown_connections 2024-09-17T03:43:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.248+0000 7f7da1c7f640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7d88078b90 0x7f7d8807b0a0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.248+0000 7f7da1c7f640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d9c1f6630 0x7f7d9c1f5fd0 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.248+0000 7f7da1c7f640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7d9c1f0050 0x7f7d9c1f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.248+0000 7f7da1c7f640 1 --2- 172.21.15.146:0/2442157422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7d84003a50 0x7f7d9c1f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.248+0000 7f7da1c7f640 1 -- 172.21.15.146:0/2442157422 >> 172.21.15.146:0/2442157422 conn(0x7f7d9c0b3410 msgr2=0x7f7d9c152160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:49.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.249+0000 7f7da1c7f640 1 -- 172.21.15.146:0/2442157422 shutdown_connections 2024-09-17T03:43:49.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.249+0000 7f7da1c7f640 1 -- 172.21.15.146:0/2442157422 wait complete. 2024-09-17T03:43:49.260 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:43:49.261 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:43:49.300 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:43:49.356 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:43:49.356 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:43:49.356 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:43:49.372 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:43:49.372 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:43:49.372 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:43:49.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:43:49.390 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:43:49.390 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:43:49.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:43:49.428 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:43:49.429 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:43:49.446 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:43:49.447 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:43:49.447 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:49.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.582+0000 7fb33598a640 1 -- 172.21.15.146:0/3442168452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3300b3870 msgr2=0x7fb3300cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:49.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.582+0000 7fb33598a640 1 --2- 172.21.15.146:0/3442168452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3300b3870 0x7fb3300cf370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb320009830 tx=0x7fb32002a480 comp rx=0 tx=0).stop 2024-09-17T03:43:49.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.582+0000 7fb33598a640 1 -- 172.21.15.146:0/3442168452 shutdown_connections 2024-09-17T03:43:49.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.582+0000 7fb33598a640 1 --2- 172.21.15.146:0/3442168452 >> v2:172.21.15.179:3300/0 conn(0x7fb3301620f0 0x7fb33006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.582+0000 7fb33598a640 1 --2- 172.21.15.146:0/3442168452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3300b3870 0x7fb3300cf370 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.582+0000 7fb33598a640 1 -- 172.21.15.146:0/3442168452 >> 172.21.15.146:0/3442168452 conn(0x7fb3300d4be0 msgr2=0x7fb3300d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:49.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.582+0000 7fb33598a640 1 -- 172.21.15.146:0/3442168452 shutdown_connections 2024-09-17T03:43:49.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.582+0000 7fb33598a640 1 -- 172.21.15.146:0/3442168452 wait complete. 2024-09-17T03:43:49.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.584+0000 7fb33598a640 1 Processor -- start 2024-09-17T03:43:49.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.584+0000 7fb33598a640 1 -- start start 2024-09-17T03:43:49.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.585+0000 7fb33598a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb33006f270 0x7fb33014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.585+0000 7fb33598a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300b3870 0x7fb3300c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.585+0000 7fb33598a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3301620f0 0x7fb3300c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.585+0000 7fb33598a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb3300d43b0 con 0x7fb3300b3870 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.585+0000 7fb33598a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb330162fb0 con 0x7fb3301620f0 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.585+0000 7fb33598a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb33014de10 con 0x7fb33006f270 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.585+0000 7fb3267fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300b3870 0x7fb3300c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.585+0000 7fb3267fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300b3870 0x7fb3300c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56718/0 (socket says 172.21.15.146:56718) 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.585+0000 7fb3267fc640 1 -- 172.21.15.146:0/1480489902 learned_addr learned my addr 172.21.15.146:0/1480489902 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb32f7fe640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3301620f0 0x7fb3300c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb32effd640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb33006f270 0x7fb33014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb3267fc640 1 -- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb33006f270 msgr2=0x7fb33014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb3267fc640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb33006f270 0x7fb33014d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb3267fc640 1 -- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3301620f0 msgr2=0x7fb3300c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb3267fc640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3301620f0 0x7fb3300c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb3267fc640 1 -- 172.21.15.146:0/1480489902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3301f66c0 con 0x7fb3300b3870 2024-09-17T03:43:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb32effd640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb33006f270 0x7fb33014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:43:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb3267fc640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300b3870 0x7fb3300c9950 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fb31800e9f0 tx=0x7fb31800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb32cff9640 1 -- 172.21.15.146:0/1480489902 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31800cd20 con 0x7fb3300b3870 2024-09-17T03:43:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb32cff9640 1 -- 172.21.15.146:0/1480489902 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb318004020 con 0x7fb3300b3870 2024-09-17T03:43:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb33598a640 1 -- 172.21.15.146:0/1480489902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33015d1f0 con 0x7fb3300b3870 2024-09-17T03:43:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb32cff9640 1 -- 172.21.15.146:0/1480489902 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318004470 con 0x7fb3300b3870 2024-09-17T03:43:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.586+0000 7fb33598a640 1 -- 172.21.15.146:0/1480489902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3301f6940 con 0x7fb3300b3870 2024-09-17T03:43:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.587+0000 7fb33598a640 1 -- 172.21.15.146:0/1480489902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb330163460 con 0x7fb3300b3870 2024-09-17T03:43:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.588+0000 7fb32cff9640 1 -- 172.21.15.146:0/1480489902 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3180035f0 con 0x7fb3300b3870 2024-09-17T03:43:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.588+0000 7fb32cff9640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 0x7fb31007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.588+0000 7fb32cff9640 1 -- 172.21.15.146:0/1480489902 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5029+0+0 (secure 0 0 0) 0x7fb31809b440 con 0x7fb3300b3870 2024-09-17T03:43:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.589+0000 7fb32effd640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 0x7fb31007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.589+0000 7fb32effd640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 0x7fb31007b0a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb320034000 tx=0x7fb320004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.593+0000 7fb32cff9640 1 -- 172.21.15.146:0/1480489902 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb3301f66c0 con 0x7fb3300b3870 2024-09-17T03:43:49.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.807+0000 7fb33598a640 1 -- 172.21.15.146:0/1480489902 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3300d2bd0 con 0x7fb3300b3870 2024-09-17T03:43:49.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.807+0000 7fb32cff9640 1 -- 172.21.15.146:0/1480489902 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+3096 (secure 0 0 0) 0x7fb318063b30 con 0x7fb3300b3870 2024-09-17T03:43:49.808 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:49.808 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":119,"btime":"2024-09-17T03:43:43:574157+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7721,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/423870749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":423870749},{"type":"v1","addr":"172.21.15.146:6834","nonce":423870749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":7730,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2731940990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2731940990},{"type":"v1","addr":"172.21.15.179:6836","nonce":2731940990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":108},{"gid":7976,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/3515191531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3515191531},{"type":"v1","addr":"172.21.15.179:6837","nonce":3515191531}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[]} 2024-09-17T03:43:49.809 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 119 2024-09-17T03:43:49.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 -- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 msgr2=0x7fb31007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:49.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 0x7fb31007b0a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb320034000 tx=0x7fb320004730 comp rx=0 tx=0).stop 2024-09-17T03:43:49.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 -- 172.21.15.146:0/1480489902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300b3870 msgr2=0x7fb3300c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:49.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300b3870 0x7fb3300c9950 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fb31800e9f0 tx=0x7fb31800eeb0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 -- 172.21.15.146:0/1480489902 shutdown_connections 2024-09-17T03:43:49.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 0x7fb31007b0a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3301620f0 0x7fb3300c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300b3870 0x7fb3300c9950 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 --2- 172.21.15.146:0/1480489902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb33006f270 0x7fb33014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:49.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 -- 172.21.15.146:0/1480489902 >> 172.21.15.146:0/1480489902 conn(0x7fb3300d4be0 msgr2=0x7fb3301600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:49.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 -- 172.21.15.146:0/1480489902 shutdown_connections 2024-09-17T03:43:49.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:49.810+0000 7fb33598a640 1 -- 172.21.15.146:0/1480489902 wait complete. 2024-09-17T03:43:49.822 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:43:49.822 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:43:49.822 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:43:49.822 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:43:49.823 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:43:49.823 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:43:49.823 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:43:49.823 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:43:49.823 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:43:49.824 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:43:49.824 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:43:49.824 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:43:49.824 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:43:49.824 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:43:49.826 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:43:49.826 DEBUG:teuthology.parallel:result is None 2024-09-17T03:43:49.831 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:43:49.832 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:43:49.835 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:43:49.835 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:43:49.839 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:43:49.839 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:43:49.874 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:43:49.874 DEBUG:teuthology.parallel:result is None 2024-09-17T03:43:49.881 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:43:49.881 DEBUG:teuthology.parallel:result is None 2024-09-17T03:43:49.882 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:43:49.883 DEBUG:teuthology.parallel:result is None 2024-09-17T03:43:49.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:43:49.911 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:43:49.962 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:43:49.974 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:43:49.974 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:43:50.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.003+0000 7f6ea559d640 1 -- 172.21.15.146:0/3267141117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ea00d0eb0 msgr2=0x7f6ea00b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:50.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.003+0000 7f6ea559d640 1 --2- 172.21.15.146:0/3267141117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ea00d0eb0 0x7f6ea00b1900 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f6e94005fd0 tx=0x7f6e9402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.003+0000 7f6ea559d640 1 -- 172.21.15.146:0/3267141117 shutdown_connections 2024-09-17T03:43:50.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.003+0000 7f6ea559d640 1 --2- 172.21.15.146:0/3267141117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea00b7780 0x7f6ea00b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.003+0000 7f6ea559d640 1 --2- 172.21.15.146:0/3267141117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ea00d0eb0 0x7f6ea00b1900 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.003+0000 7f6ea559d640 1 -- 172.21.15.146:0/3267141117 >> 172.21.15.146:0/3267141117 conn(0x7f6ea009ba20 msgr2=0x7f6ea00b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:50.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.003+0000 7f6ea559d640 1 -- 172.21.15.146:0/3267141117 shutdown_connections 2024-09-17T03:43:50.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.003+0000 7f6ea559d640 1 -- 172.21.15.146:0/3267141117 wait complete. 2024-09-17T03:43:50.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.005+0000 7f6ea559d640 1 Processor -- start 2024-09-17T03:43:50.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.005+0000 7f6ea559d640 1 -- start start 2024-09-17T03:43:50.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.006+0000 7f6ea559d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea0070e90 0x7f6ea015a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:50.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.006+0000 7f6ea559d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ea00b7780 0x7f6ea01f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:50.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.006+0000 7f6ea559d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0159cc0 0x7f6ea009cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:50.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.006+0000 7f6ea559d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea00b58f0 con 0x7f6ea00b7780 2024-09-17T03:43:50.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.006+0000 7f6ea559d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea00b5770 con 0x7f6ea0159cc0 2024-09-17T03:43:50.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.006+0000 7f6ea559d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea00b5a70 con 0x7f6ea0070e90 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.006+0000 7f6e9f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ea00b7780 0x7f6ea01f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.006+0000 7f6e9f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ea00b7780 0x7f6ea01f3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56766/0 (socket says 172.21.15.146:56766) 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.006+0000 7f6e9f7fe640 1 -- 172.21.15.146:0/644592750 learned_addr learned my addr 172.21.15.146:0/644592750 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6e9ffff640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea0070e90 0x7f6ea015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6ea4d9c640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0159cc0 0x7f6ea009cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6e9f7fe640 1 -- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea0070e90 msgr2=0x7f6ea015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6e9f7fe640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea0070e90 0x7f6ea015a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6e9f7fe640 1 -- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0159cc0 msgr2=0x7f6ea009cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6e9f7fe640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0159cc0 0x7f6ea009cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6e9f7fe640 1 -- 172.21.15.146:0/644592750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea015adb0 con 0x7f6ea00b7780 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6e9ffff640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea0070e90 0x7f6ea015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:43:50.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6ea4d9c640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0159cc0 0x7f6ea009cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:43:50.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6e9f7fe640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ea00b7780 0x7f6ea01f3020 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f6e94000c00 tx=0x7f6e940038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:50.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6e9cff9640 1 -- 172.21.15.146:0/644592750 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9403e030 con 0x7f6ea00b7780 2024-09-17T03:43:50.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6e9cff9640 1 -- 172.21.15.146:0/644592750 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e94003ca0 con 0x7f6ea00b7780 2024-09-17T03:43:50.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6ea559d640 1 -- 172.21.15.146:0/644592750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea01f3b30 con 0x7f6ea00b7780 2024-09-17T03:43:50.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6e9cff9640 1 -- 172.21.15.146:0/644592750 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94035040 con 0x7f6ea00b7780 2024-09-17T03:43:50.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.007+0000 7f6ea559d640 1 -- 172.21.15.146:0/644592750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea01594c0 con 0x7f6ea00b7780 2024-09-17T03:43:50.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.008+0000 7f6ea559d640 1 -- 172.21.15.146:0/644592750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea00b1900 con 0x7f6ea00b7780 2024-09-17T03:43:50.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.009+0000 7f6e9cff9640 1 -- 172.21.15.146:0/644592750 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e94041030 con 0x7f6ea00b7780 2024-09-17T03:43:50.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.009+0000 7f6e9cff9640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e8c078b90 0x7f6e8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:50.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.009+0000 7f6e9cff9640 1 -- 172.21.15.146:0/644592750 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5029+0+0 (secure 0 0 0) 0x7f6e940bb020 con 0x7f6ea00b7780 2024-09-17T03:43:50.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.010+0000 7f6e9ffff640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e8c078b90 0x7f6e8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:50.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.010+0000 7f6e9ffff640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e8c078b90 0x7f6e8c07b0a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000f60 tx=0x7f6e90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:50.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.014+0000 7f6e9cff9640 1 -- 172.21.15.146:0/644592750 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e94083790 con 0x7f6ea00b7780 2024-09-17T03:43:50.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.199+0000 7f6ea559d640 1 -- 172.21.15.146:0/644592750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6ea015ce90 con 0x7f6ea00b7780 2024-09-17T03:43:50.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.615+0000 7f6e9cff9640 1 -- 172.21.15.146:0/644592750 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v160) ==== 97+0+0 (secure 0 0 0) 0x7f6e94083090 con 0x7f6ea00b7780 2024-09-17T03:43:50.616 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:43:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.618+0000 7f6ea559d640 1 -- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e8c078b90 msgr2=0x7f6e8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.618+0000 7f6ea559d640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e8c078b90 0x7f6e8c07b0a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000f60 tx=0x7f6e90009040 comp rx=0 tx=0).stop 2024-09-17T03:43:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.618+0000 7f6ea559d640 1 -- 172.21.15.146:0/644592750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ea00b7780 msgr2=0x7f6ea01f3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.618+0000 7f6ea559d640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ea00b7780 0x7f6ea01f3020 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f6e94000c00 tx=0x7f6e940038a0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.618+0000 7f6ea559d640 1 -- 172.21.15.146:0/644592750 shutdown_connections 2024-09-17T03:43:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.618+0000 7f6ea559d640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6e8c078b90 0x7f6e8c07b0a0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.618+0000 7f6ea559d640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ea0159cc0 0x7f6ea009cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.618+0000 7f6ea559d640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ea00b7780 0x7f6ea01f3020 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.618+0000 7f6ea559d640 1 --2- 172.21.15.146:0/644592750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6ea0070e90 0x7f6ea015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.618+0000 7f6ea559d640 1 -- 172.21.15.146:0/644592750 >> 172.21.15.146:0/644592750 conn(0x7f6ea009ba20 msgr2=0x7f6ea00cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.619+0000 7f6ea559d640 1 -- 172.21.15.146:0/644592750 shutdown_connections 2024-09-17T03:43:50.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.619+0000 7f6ea559d640 1 -- 172.21.15.146:0/644592750 wait complete. 2024-09-17T03:43:50.632 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:43:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.785+0000 7f52b798b640 1 -- 172.21.15.146:0/279267312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b0162f10 msgr2=0x7f52b015f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.785+0000 7f52b798b640 1 --2- 172.21.15.146:0/279267312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b0162f10 0x7f52b015f030 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009830 tx=0x7f52ac02a510 comp rx=0 tx=0).stop 2024-09-17T03:43:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.785+0000 7f52b798b640 1 -- 172.21.15.146:0/279267312 shutdown_connections 2024-09-17T03:43:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.785+0000 7f52b798b640 1 --2- 172.21.15.146:0/279267312 >> v2:172.21.15.179:3300/0 conn(0x7f52b0073350 0x7f52b006fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.785+0000 7f52b798b640 1 --2- 172.21.15.146:0/279267312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b0162f10 0x7f52b015f030 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.785+0000 7f52b798b640 1 -- 172.21.15.146:0/279267312 >> 172.21.15.146:0/279267312 conn(0x7f52b006d3c0 msgr2=0x7f52b00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.785+0000 7f52b798b640 1 -- 172.21.15.146:0/279267312 shutdown_connections 2024-09-17T03:43:50.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.785+0000 7f52b798b640 1 -- 172.21.15.146:0/279267312 wait complete. 2024-09-17T03:43:50.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.787+0000 7f52b798b640 1 Processor -- start 2024-09-17T03:43:50.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.787+0000 7f52b798b640 1 -- start start 2024-09-17T03:43:50.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.788+0000 7f52b798b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b0162f10 0x7f52b00cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:50.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.788+0000 7f52b798b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b0163320 0x7f52b01f9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:50.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.788+0000 7f52b798b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b01f97c0 0x7f52b01e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:50.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.788+0000 7f52b798b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0162910 con 0x7f52b01f97c0 2024-09-17T03:43:50.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.788+0000 7f52b798b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f52b015f7c0 con 0x7f52b0163320 2024-09-17T03:43:50.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.788+0000 7f52b798b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f52b0070240 con 0x7f52b0162f10 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.788+0000 7f52b5f28640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b01f97c0 0x7f52b01e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.788+0000 7f52b5f28640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b01f97c0 0x7f52b01e9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56776/0 (socket says 172.21.15.146:56776) 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.788+0000 7f52b5f28640 1 -- 172.21.15.146:0/991821701 learned_addr learned my addr 172.21.15.146:0/991821701 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.788+0000 7f52b5727640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b0162f10 0x7f52b00cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.788+0000 7f52b4f26640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b0163320 0x7f52b01f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.789+0000 7f52b5f28640 1 -- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b0162f10 msgr2=0x7f52b00cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.789+0000 7f52b5f28640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b0162f10 0x7f52b00cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.789+0000 7f52b5f28640 1 -- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b0163320 msgr2=0x7f52b01f9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.789+0000 7f52b5f28640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b0163320 0x7f52b01f9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.789+0000 7f52b5f28640 1 -- 172.21.15.146:0/991821701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b01f55c0 con 0x7f52b01f97c0 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.789+0000 7f52b5f28640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b01f97c0 0x7f52b01e9d40 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f52a800ec20 tx=0x7f52a800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.789+0000 7f52a5ffb640 1 -- 172.21.15.146:0/991821701 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8003b70 con 0x7f52b01f97c0 2024-09-17T03:43:50.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.789+0000 7f52a5ffb640 1 -- 172.21.15.146:0/991821701 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52a8003e00 con 0x7f52b01f97c0 2024-09-17T03:43:50.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.789+0000 7f52b798b640 1 -- 172.21.15.146:0/991821701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b01f5880 con 0x7f52b01f97c0 2024-09-17T03:43:50.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.789+0000 7f52a5ffb640 1 -- 172.21.15.146:0/991821701 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8004280 con 0x7f52b01f97c0 2024-09-17T03:43:50.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.789+0000 7f52b798b640 1 -- 172.21.15.146:0/991821701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b01f5e40 con 0x7f52b01f97c0 2024-09-17T03:43:50.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.790+0000 7f52b798b640 1 -- 172.21.15.146:0/991821701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b00706f0 con 0x7f52b01f97c0 2024-09-17T03:43:50.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.791+0000 7f52a5ffb640 1 -- 172.21.15.146:0/991821701 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52a8004420 con 0x7f52b01f97c0 2024-09-17T03:43:50.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.792+0000 7f52a5ffb640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5294078b90 0x7f529407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:50.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.792+0000 7f52a5ffb640 1 -- 172.21.15.146:0/991821701 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4857+0+0 (secure 0 0 0) 0x7f52a809b750 con 0x7f52b01f97c0 2024-09-17T03:43:50.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.792+0000 7f52b5727640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5294078b90 0x7f529407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:50.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.792+0000 7f52b5727640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5294078b90 0x7f529407b0a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f52ac034000 tx=0x7f52ac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:50.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:50.796+0000 7f52a5ffb640 1 -- 172.21.15.146:0/991821701 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f52a8063920 con 0x7f52b01f97c0 2024-09-17T03:43:51.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.041+0000 7f52b798b640 1 -- 172.21.15.146:0/991821701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f52b006fca0 con 0x7f52b01f97c0 2024-09-17T03:43:51.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.042+0000 7f52a5ffb640 1 -- 172.21.15.146:0/991821701 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) ==== 80+0+5304 (secure 0 0 0) 0x7f52a8068350 con 0x7f52b01f97c0 2024-09-17T03:43:51.042 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:51.042 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:43:51.042 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:43:51.042 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.042 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:43:51.042 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:43:51.042 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.042 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:43:51.042 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:43:51.044 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:43:51.045 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.046 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.046 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.046 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.046 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:43:51.046 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:43:51.046 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.046 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:43:51.046 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:43:51.046 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.046 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:43:51.047 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.048 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.049 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:43:51.049 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:43:51.049 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.049 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:43:51.049 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:43:51.049 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.049 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.049 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.049 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.049 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:43:51.050 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.051 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:43:51.052 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:43:51.053 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:43:51.053 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:43:51.053 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.053 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.053 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.053 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:43:51.053 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:43:51.053 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.053 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:43:51.053 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:43:51.053 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.054 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:43:51.055 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:43:51.056 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:43:51.056 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:43:51.056 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.056 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.056 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:43:51.056 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:43:51.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 -- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5294078b90 msgr2=0x7f529407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:51.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5294078b90 0x7f529407b0a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f52ac034000 tx=0x7f52ac004730 comp rx=0 tx=0).stop 2024-09-17T03:43:51.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 -- 172.21.15.146:0/991821701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b01f97c0 msgr2=0x7f52b01e9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:51.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b01f97c0 0x7f52b01e9d40 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f52a800ec20 tx=0x7f52a800c6a0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 -- 172.21.15.146:0/991821701 shutdown_connections 2024-09-17T03:43:51.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5294078b90 0x7f529407b0a0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b01f97c0 0x7f52b01e9d40 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b0163320 0x7f52b01f9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 --2- 172.21.15.146:0/991821701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b0162f10 0x7f52b00cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 -- 172.21.15.146:0/991821701 >> 172.21.15.146:0/991821701 conn(0x7f52b006d3c0 msgr2=0x7f52b01444e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:51.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 -- 172.21.15.146:0/991821701 shutdown_connections 2024-09-17T03:43:51.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.044+0000 7f52b798b640 1 -- 172.21.15.146:0/991821701 wait complete. 2024-09-17T03:43:51.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:43:51.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.171+0000 7fb334b83640 1 -- 172.21.15.146:0/3557352878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb33015c8e0 msgr2=0x7fb33006f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:51.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.171+0000 7fb334b83640 1 --2- 172.21.15.146:0/3557352878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb33015c8e0 0x7fb33006f580 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fb320009830 tx=0x7fb32002a480 comp rx=0 tx=0).stop 2024-09-17T03:43:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.171+0000 7fb334b83640 1 -- 172.21.15.146:0/3557352878 shutdown_connections 2024-09-17T03:43:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.171+0000 7fb334b83640 1 --2- 172.21.15.146:0/3557352878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3300cd840 0x7fb3300b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.171+0000 7fb334b83640 1 --2- 172.21.15.146:0/3557352878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb33015c8e0 0x7fb33006f580 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.171+0000 7fb334b83640 1 -- 172.21.15.146:0/3557352878 >> 172.21.15.146:0/3557352878 conn(0x7fb3300b3150 msgr2=0x7fb3300b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.172+0000 7fb334b83640 1 -- 172.21.15.146:0/3557352878 shutdown_connections 2024-09-17T03:43:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.172+0000 7fb334b83640 1 -- 172.21.15.146:0/3557352878 wait complete. 2024-09-17T03:43:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.173+0000 7fb334b83640 1 Processor -- start 2024-09-17T03:43:51.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.173+0000 7fb334b83640 1 -- start start 2024-09-17T03:43:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb334b83640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3300cd840 0x7fb330156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb334b83640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300cdc50 0x7fb3301f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb334b83640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb33015c8e0 0x7fb330143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb334b83640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb330073580 con 0x7fb3300cdc50 2024-09-17T03:43:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb334b83640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb3300b5e10 con 0x7fb33015c8e0 2024-09-17T03:43:51.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb334b83640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb330073700 con 0x7fb3300cd840 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb327fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300cdc50 0x7fb3301f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb327fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300cdc50 0x7fb3301f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56790/0 (socket says 172.21.15.146:56790) 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb327fff640 1 -- 172.21.15.146:0/3168300442 learned_addr learned my addr 172.21.15.146:0/3168300442 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb32e59c640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3300cd840 0x7fb330156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb32ed9d640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb33015c8e0 0x7fb330143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb327fff640 1 -- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3300cd840 msgr2=0x7fb330156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb327fff640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3300cd840 0x7fb330156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb327fff640 1 -- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb33015c8e0 msgr2=0x7fb330143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb327fff640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb33015c8e0 0x7fb330143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb327fff640 1 -- 172.21.15.146:0/3168300442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3301517f0 con 0x7fb3300cdc50 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb327fff640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300cdc50 0x7fb3301f5ee0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7fb31800c970 tx=0x7fb31800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.175+0000 7fb326ffd640 1 -- 172.21.15.146:0/3168300442 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318004220 con 0x7fb3300cdc50 2024-09-17T03:43:51.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.176+0000 7fb326ffd640 1 -- 172.21.15.146:0/3168300442 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3180044b0 con 0x7fb3300cdc50 2024-09-17T03:43:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.176+0000 7fb334b83640 1 -- 172.21.15.146:0/3168300442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3301f6a50 con 0x7fb3300cdc50 2024-09-17T03:43:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.176+0000 7fb326ffd640 1 -- 172.21.15.146:0/3168300442 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318007c10 con 0x7fb3300cdc50 2024-09-17T03:43:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.176+0000 7fb334b83640 1 -- 172.21.15.146:0/3168300442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb330156350 con 0x7fb3300cdc50 2024-09-17T03:43:51.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.177+0000 7fb334b83640 1 -- 172.21.15.146:0/3168300442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb330073bb0 con 0x7fb3300cdc50 2024-09-17T03:43:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.177+0000 7fb326ffd640 1 -- 172.21.15.146:0/3168300442 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb318003610 con 0x7fb3300cdc50 2024-09-17T03:43:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.178+0000 7fb326ffd640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 0x7fb31007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.178+0000 7fb326ffd640 1 -- 172.21.15.146:0/3168300442 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4857+0+0 (secure 0 0 0) 0x7fb31809ad80 con 0x7fb3300cdc50 2024-09-17T03:43:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.178+0000 7fb32e59c640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 0x7fb31007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:51.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.179+0000 7fb32e59c640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 0x7fb31007b0a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb320034000 tx=0x7fb320004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:51.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.183+0000 7fb326ffd640 1 -- 172.21.15.146:0/3168300442 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb318014030 con 0x7fb3300cdc50 2024-09-17T03:43:51.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.360+0000 7fb334b83640 1 -- 172.21.15.146:0/3168300442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb3301f67e0 con 0x7fb3300cdc50 2024-09-17T03:43:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.361+0000 7fb326ffd640 1 -- 172.21.15.146:0/3168300442 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v161) ==== 84+0+65 (secure 0 0 0) 0x7fb3180635a0 con 0x7fb3300cdc50 2024-09-17T03:43:51.361 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:51.361 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:43:51.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:43:51.361 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:43:51.361 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:43:51.361 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:43:51.362 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:43:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 -- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 msgr2=0x7fb31007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 0x7fb31007b0a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb320034000 tx=0x7fb320004730 comp rx=0 tx=0).stop 2024-09-17T03:43:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 -- 172.21.15.146:0/3168300442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300cdc50 msgr2=0x7fb3301f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300cdc50 0x7fb3301f5ee0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7fb31800c970 tx=0x7fb31800ce30 comp rx=0 tx=0).stop 2024-09-17T03:43:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 -- 172.21.15.146:0/3168300442 shutdown_connections 2024-09-17T03:43:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb310078b90 0x7fb31007b0a0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb33015c8e0 0x7fb330143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3300cdc50 0x7fb3301f5ee0 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 --2- 172.21.15.146:0/3168300442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb3300cd840 0x7fb330156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 -- 172.21.15.146:0/3168300442 >> 172.21.15.146:0/3168300442 conn(0x7fb3300b3150 msgr2=0x7fb33015ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:51.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 -- 172.21.15.146:0/3168300442 shutdown_connections 2024-09-17T03:43:51.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.363+0000 7fb334b83640 1 -- 172.21.15.146:0/3168300442 wait complete. 2024-09-17T03:43:51.375 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:43:51.375 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:43:51.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.491+0000 7f3510d39640 1 -- 172.21.15.146:0/1007807916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c072df0 msgr2=0x7f350c15ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:51.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.491+0000 7f3510d39640 1 --2- 172.21.15.146:0/1007807916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c072df0 0x7f350c15ead0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009820 tx=0x7f34f402a5a0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.491+0000 7f3510d39640 1 -- 172.21.15.146:0/1007807916 shutdown_connections 2024-09-17T03:43:51.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.491+0000 7f3510d39640 1 --2- 172.21.15.146:0/1007807916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c072df0 0x7f350c15ead0 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.491+0000 7f3510d39640 1 -- 172.21.15.146:0/1007807916 >> 172.21.15.146:0/1007807916 conn(0x7f350c0b2060 msgr2=0x7f350c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:51.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.491+0000 7f3510d39640 1 -- 172.21.15.146:0/1007807916 shutdown_connections 2024-09-17T03:43:51.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.491+0000 7f3510d39640 1 -- 172.21.15.146:0/1007807916 wait complete. 2024-09-17T03:43:51.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.493+0000 7f3510d39640 1 Processor -- start 2024-09-17T03:43:51.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.494+0000 7f3510d39640 1 -- start start 2024-09-17T03:43:51.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f3510d39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c072df0 0x7f350c1f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:51.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f3510d39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f350c0b3360 0x7f350c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f3510d39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f350c15f010 0x7f350c159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f3510d39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f350c06e5f0 con 0x7f350c072df0 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f3510d39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f350c06e470 con 0x7f350c15f010 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f3510d39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f350c06e770 con 0x7f350c0b3360 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f350a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c072df0 0x7f350c1f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f350a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c072df0 0x7f350c1f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56810/0 (socket says 172.21.15.146:56810) 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f350a59c640 1 -- 172.21.15.146:0/1076770793 learned_addr learned my addr 172.21.15.146:0/1076770793 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f3501d9b640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f350c0b3360 0x7f350c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f350ad9d640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f350c15f010 0x7f350c159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f350a59c640 1 -- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f350c0b3360 msgr2=0x7f350c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f350a59c640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f350c0b3360 0x7f350c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f350a59c640 1 -- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f350c15f010 msgr2=0x7f350c159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:51.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f350a59c640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f350c15f010 0x7f350c159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f350a59c640 1 -- 172.21.15.146:0/1076770793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350c152070 con 0x7f350c072df0 2024-09-17T03:43:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f350ad9d640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f350c15f010 0x7f350c159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f3501d9b640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f350c0b3360 0x7f350c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f350a59c640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c072df0 0x7f350c1f6630 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00c3a0 tx=0x7f34fc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.495+0000 7f35037fe640 1 -- 172.21.15.146:0/1076770793 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc017070 con 0x7f350c072df0 2024-09-17T03:43:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.496+0000 7f35037fe640 1 -- 172.21.15.146:0/1076770793 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34fc0053c0 con 0x7f350c072df0 2024-09-17T03:43:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.496+0000 7f3510d39640 1 -- 172.21.15.146:0/1076770793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350c1f6b70 con 0x7f350c072df0 2024-09-17T03:43:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.496+0000 7f35037fe640 1 -- 172.21.15.146:0/1076770793 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc003850 con 0x7f350c072df0 2024-09-17T03:43:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.496+0000 7f3510d39640 1 -- 172.21.15.146:0/1076770793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350c152310 con 0x7f350c072df0 2024-09-17T03:43:51.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.496+0000 7f3510d39640 1 -- 172.21.15.146:0/1076770793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f350c15ead0 con 0x7f350c072df0 2024-09-17T03:43:51.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.497+0000 7f35037fe640 1 -- 172.21.15.146:0/1076770793 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34fc01a070 con 0x7f350c072df0 2024-09-17T03:43:51.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.498+0000 7f35037fe640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ec078bc0 0x7f34ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:51.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.498+0000 7f35037fe640 1 -- 172.21.15.146:0/1076770793 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4857+0+0 (secure 0 0 0) 0x7f34fc099d40 con 0x7f350c072df0 2024-09-17T03:43:51.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.498+0000 7f3501d9b640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ec078bc0 0x7f34ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:51.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.499+0000 7f3501d9b640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ec078bc0 0x7f34ec07b0d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f34f4034000 tx=0x7f34f4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:51.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.503+0000 7f35037fe640 1 -- 172.21.15.146:0/1076770793 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f34fc062560 con 0x7f350c072df0 2024-09-17T03:43:51.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:51.680+0000 7f3510d39640 1 -- 172.21.15.146:0/1076770793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f350c0761f0 con 0x7f350c072df0 2024-09-17T03:43:52.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.623+0000 7f35037fe640 1 -- 172.21.15.146:0/1076770793 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v162) ==== 138+0+0 (secure 0 0 0) 0x7f34fc061e60 con 0x7f350c072df0 2024-09-17T03:43:52.623 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:43:52.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 -- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ec078bc0 msgr2=0x7f34ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ec078bc0 0x7f34ec07b0d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f34f4034000 tx=0x7f34f4004730 comp rx=0 tx=0).stop 2024-09-17T03:43:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 -- 172.21.15.146:0/1076770793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c072df0 msgr2=0x7f350c1f6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c072df0 0x7f350c1f6630 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00c3a0 tx=0x7f34fc00c860 comp rx=0 tx=0).stop 2024-09-17T03:43:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 -- 172.21.15.146:0/1076770793 shutdown_connections 2024-09-17T03:43:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f34ec078bc0 0x7f34ec07b0d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f350c15f010 0x7f350c159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f350c0b3360 0x7f350c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 --2- 172.21.15.146:0/1076770793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f350c072df0 0x7f350c1f6630 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 -- 172.21.15.146:0/1076770793 >> 172.21.15.146:0/1076770793 conn(0x7f350c0b2060 msgr2=0x7f350c0affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 -- 172.21.15.146:0/1076770793 shutdown_connections 2024-09-17T03:43:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.627+0000 7f3510d39640 1 -- 172.21.15.146:0/1076770793 wait complete. 2024-09-17T03:43:52.645 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:43:52.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.773+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/740431840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c00b9c30 msgr2=0x7fc6c00d3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:52.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.773+0000 7fc6c6e9b640 1 --2- 172.21.15.146:0/740431840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c00b9c30 0x7fc6c00d3100 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00d46c0 tx=0x7fc6bc02a510 comp rx=0 tx=0).stop 2024-09-17T03:43:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.773+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/740431840 shutdown_connections 2024-09-17T03:43:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.773+0000 7fc6c6e9b640 1 --2- 172.21.15.146:0/740431840 >> v2:172.21.15.179:3300/0 conn(0x7fc6c00cf270 0x7fc6c00b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.773+0000 7fc6c6e9b640 1 --2- 172.21.15.146:0/740431840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c00b9c30 0x7fc6c00d3100 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.773+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/740431840 >> 172.21.15.146:0/740431840 conn(0x7fc6c00d1460 msgr2=0x7fc6c00d1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.773+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/740431840 shutdown_connections 2024-09-17T03:43:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.773+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/740431840 wait complete. 2024-09-17T03:43:52.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.775+0000 7fc6c6e9b640 1 Processor -- start 2024-09-17T03:43:52.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.775+0000 7fc6c6e9b640 1 -- start start 2024-09-17T03:43:52.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6c6e9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c00b6bd0 0x7fc6c015d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6c6e9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c00b9c30 0x7fc6c0150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6c6e9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c00cf270 0x7fc6c00ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6c6e9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c0069410 con 0x7fc6c00b9c30 2024-09-17T03:43:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6c6e9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c00b9010 con 0x7fc6c00cf270 2024-09-17T03:43:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6c6e9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c0069590 con 0x7fc6c00b6bd0 2024-09-17T03:43:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6b7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c00b9c30 0x7fc6c0150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6c4c37640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c00b6bd0 0x7fc6c015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6b7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c00b9c30 0x7fc6c0150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56822/0 (socket says 172.21.15.146:56822) 2024-09-17T03:43:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6c4c37640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c00b6bd0 0x7fc6c015d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:33474/0 (socket says 172.21.15.146:33474) 2024-09-17T03:43:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6b7fff640 1 -- 172.21.15.146:0/3254405490 learned_addr learned my addr 172.21.15.146:0/3254405490 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.776+0000 7fc6c5438640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c00cf270 0x7fc6c00ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6b7fff640 1 -- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c00b6bd0 msgr2=0x7fc6c015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6b7fff640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c00b6bd0 0x7fc6c015d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6b7fff640 1 -- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c00cf270 msgr2=0x7fc6c00ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6b7fff640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c00cf270 0x7fc6c00ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6b7fff640 1 -- 172.21.15.146:0/3254405490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c015f9c0 con 0x7fc6c00b9c30 2024-09-17T03:43:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6c4c37640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c00b6bd0 0x7fc6c015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:43:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6c5438640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c00cf270 0x7fc6c00ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:43:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6b7fff640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c00b9c30 0x7fc6c0150bd0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000e9c0 tx=0x7fc6b000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6b57fa640 1 -- 172.21.15.146:0/3254405490 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000cd80 con 0x7fc6c00b9c30 2024-09-17T03:43:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6b57fa640 1 -- 172.21.15.146:0/3254405490 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6b0004020 con 0x7fc6c00b9c30 2024-09-17T03:43:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/3254405490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c015fca0 con 0x7fc6c00b9c30 2024-09-17T03:43:52.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6b57fa640 1 -- 172.21.15.146:0/3254405490 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0004450 con 0x7fc6c00b9c30 2024-09-17T03:43:52.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.777+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/3254405490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c0160260 con 0x7fc6c00b9c30 2024-09-17T03:43:52.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.778+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/3254405490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c01f6730 con 0x7fc6c00b9c30 2024-09-17T03:43:52.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.779+0000 7fc6b57fa640 1 -- 172.21.15.146:0/3254405490 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6b00035f0 con 0x7fc6c00b9c30 2024-09-17T03:43:52.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.779+0000 7fc6b57fa640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6ac078b90 0x7fc6ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:52.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.780+0000 7fc6b57fa640 1 -- 172.21.15.146:0/3254405490 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5227+0+0 (secure 0 0 0) 0x7fc6b009b210 con 0x7fc6c00b9c30 2024-09-17T03:43:52.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.780+0000 7fc6c4c37640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6ac078b90 0x7fc6ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:52.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.780+0000 7fc6c4c37640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6ac078b90 0x7fc6ac07b0a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc034000 tx=0x7fc6bc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:52.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.784+0000 7fc6b57fa640 1 -- 172.21.15.146:0/3254405490 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc6b0063300 con 0x7fc6c00b9c30 2024-09-17T03:43:52.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:52.960+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/3254405490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc6c0069a80 con 0x7fc6c00b9c30 2024-09-17T03:43:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.625+0000 7fc6b57fa640 1 -- 172.21.15.146:0/3254405490 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v163) ==== 170+0+0 (secure 0 0 0) 0x7fc6b0067d30 con 0x7fc6c00b9c30 2024-09-17T03:43:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:43:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6ac078b90 msgr2=0x7fc6ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6ac078b90 0x7fc6ac07b0a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc034000 tx=0x7fc6bc004730 comp rx=0 tx=0).stop 2024-09-17T03:43:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/3254405490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c00b9c30 msgr2=0x7fc6c0150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c00b9c30 0x7fc6c0150bd0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000e9c0 tx=0x7fc6b000ee80 comp rx=0 tx=0).stop 2024-09-17T03:43:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/3254405490 shutdown_connections 2024-09-17T03:43:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6ac078b90 0x7fc6ac07b0a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c00cf270 0x7fc6c00ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c00b9c30 0x7fc6c0150bd0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:53.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 --2- 172.21.15.146:0/3254405490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c00b6bd0 0x7fc6c015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:53.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/3254405490 >> 172.21.15.146:0/3254405490 conn(0x7fc6c00d1460 msgr2=0x7fc6c00b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:53.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/3254405490 shutdown_connections 2024-09-17T03:43:53.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.629+0000 7fc6c6e9b640 1 -- 172.21.15.146:0/3254405490 wait complete. 2024-09-17T03:43:53.658 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:43:53.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.776+0000 7f83499c3640 1 -- 172.21.15.146:0/2248784112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8330003a50 msgr2=0x7f8330003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.776+0000 7f83499c3640 1 --2- 172.21.15.146:0/2248784112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8330003a50 0x7f8330003ee0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f8334009b50 tx=0x7f8330005830 comp rx=0 tx=0).stop 2024-09-17T03:43:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.776+0000 7f83499c3640 1 -- 172.21.15.146:0/2248784112 shutdown_connections 2024-09-17T03:43:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.776+0000 7f83499c3640 1 --2- 172.21.15.146:0/2248784112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8330003a50 0x7f8330003ee0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.776+0000 7f83499c3640 1 -- 172.21.15.146:0/2248784112 >> 172.21.15.146:0/2248784112 conn(0x7f83440d4be0 msgr2=0x7f83440d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.776+0000 7f83499c3640 1 -- 172.21.15.146:0/2248784112 shutdown_connections 2024-09-17T03:43:53.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.776+0000 7f83499c3640 1 -- 172.21.15.146:0/2248784112 wait complete. 2024-09-17T03:43:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.778+0000 7f83499c3640 1 Processor -- start 2024-09-17T03:43:53.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.778+0000 7f83499c3640 1 -- start start 2024-09-17T03:43:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.779+0000 7f83499c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8330003a50 0x7f83440b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.779+0000 7f83499c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83440cb8a0 0x7f8344153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.779+0000 7f83499c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83440ccfd0 0x7f83440cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.779+0000 7f83499c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f83440cf810 con 0x7f83440ccfd0 2024-09-17T03:43:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.779+0000 7f83499c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f83440cf690 con 0x7f83440cb8a0 2024-09-17T03:43:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.779+0000 7f83499c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f834406ed30 con 0x7f8330003a50 2024-09-17T03:43:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.779+0000 7f83437fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83440ccfd0 0x7f83440cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.779+0000 7f83437fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83440ccfd0 0x7f83440cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56842/0 (socket says 172.21.15.146:56842) 2024-09-17T03:43:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.779+0000 7f83437fe640 1 -- 172.21.15.146:0/56217964 learned_addr learned my addr 172.21.15.146:0/56217964 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.779+0000 7f8342ffd640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8330003a50 0x7f83440b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.779+0000 7f833a7fc640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83440cb8a0 0x7f8344153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f83437fe640 1 -- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8330003a50 msgr2=0x7f83440b6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f83437fe640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8330003a50 0x7f83440b6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f83437fe640 1 -- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83440cb8a0 msgr2=0x7f8344153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f83437fe640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83440cb8a0 0x7f8344153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f83437fe640 1 -- 172.21.15.146:0/56217964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83440cd920 con 0x7f83440ccfd0 2024-09-17T03:43:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f8342ffd640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8330003a50 0x7f83440b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f833a7fc640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83440cb8a0 0x7f8344153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f83437fe640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83440ccfd0 0x7f83440cd3e0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f834408d590 tx=0x7f833c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f8340ff9640 1 -- 172.21.15.146:0/56217964 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c015070 con 0x7f83440ccfd0 2024-09-17T03:43:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f8340ff9640 1 -- 172.21.15.146:0/56217964 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f833c00cd50 con 0x7f83440ccfd0 2024-09-17T03:43:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f8340ff9640 1 -- 172.21.15.146:0/56217964 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c0116c0 con 0x7f83440ccfd0 2024-09-17T03:43:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f83499c3640 1 -- 172.21.15.146:0/56217964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83440cc080 con 0x7f83440ccfd0 2024-09-17T03:43:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.780+0000 7f83499c3640 1 -- 172.21.15.146:0/56217964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83440cc640 con 0x7f83440ccfd0 2024-09-17T03:43:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.781+0000 7f83499c3640 1 -- 172.21.15.146:0/56217964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f834406f220 con 0x7f83440ccfd0 2024-09-17T03:43:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.782+0000 7f8340ff9640 1 -- 172.21.15.146:0/56217964 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f833c018070 con 0x7f83440ccfd0 2024-09-17T03:43:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.782+0000 7f8340ff9640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8324078b90 0x7f832407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.783+0000 7f8340ff9640 1 -- 172.21.15.146:0/56217964 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5609+0+0 (secure 0 0 0) 0x7f833c09b150 con 0x7f83440ccfd0 2024-09-17T03:43:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.783+0000 7f8342ffd640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8324078b90 0x7f832407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.783+0000 7f8342ffd640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8324078b90 0x7f832407b0a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8334035000 tx=0x7f83340046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:53.788+0000 7f8340ff9640 1 -- 172.21.15.146:0/56217964 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f83440cd920 con 0x7f83440ccfd0 2024-09-17T03:43:54.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.001+0000 7f83499c3640 1 -- 172.21.15.146:0/56217964 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f83440cbe10 con 0x7f83440ccfd0 2024-09-17T03:43:54.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.656+0000 7f8340ff9640 1 -- 172.21.15.146:0/56217964 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v122) ==== 174+0+0 (secure 0 0 0) 0x7f833c063710 con 0x7f83440ccfd0 2024-09-17T03:43:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 24 and data pool 25 2024-09-17T03:43:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.667+0000 7f83499c3640 1 -- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8324078b90 msgr2=0x7f832407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.667+0000 7f83499c3640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8324078b90 0x7f832407b0a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8334035000 tx=0x7f83340046c0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.667+0000 7f83499c3640 1 -- 172.21.15.146:0/56217964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83440ccfd0 msgr2=0x7f83440cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:54.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.668+0000 7f83499c3640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83440ccfd0 0x7f83440cd3e0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f834408d590 tx=0x7f833c00ed10 comp rx=0 tx=0).stop 2024-09-17T03:43:54.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.669+0000 7f83499c3640 1 -- 172.21.15.146:0/56217964 shutdown_connections 2024-09-17T03:43:54.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.670+0000 7f83499c3640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8324078b90 0x7f832407b0a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.670+0000 7f83499c3640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83440ccfd0 0x7f83440cd3e0 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.670+0000 7f83499c3640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83440cb8a0 0x7f8344153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.670+0000 7f83499c3640 1 --2- 172.21.15.146:0/56217964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8330003a50 0x7f83440b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.670+0000 7f83499c3640 1 -- 172.21.15.146:0/56217964 >> 172.21.15.146:0/56217964 conn(0x7f83440d4be0 msgr2=0x7f83440d3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.672+0000 7f83499c3640 1 -- 172.21.15.146:0/56217964 shutdown_connections 2024-09-17T03:43:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.672+0000 7f83499c3640 1 -- 172.21.15.146:0/56217964 wait complete. 2024-09-17T03:43:54.686 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:43:54.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.800+0000 7f98944c5640 1 -- 172.21.15.146:0/1108822986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988c15b770 msgr2=0x7f988c06fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:54.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.800+0000 7f98944c5640 1 --2- 172.21.15.146:0/1108822986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988c15b770 0x7f988c06fe10 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f988c073180 tx=0x7f988802a4b0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.800+0000 7f98944c5640 1 -- 172.21.15.146:0/1108822986 shutdown_connections 2024-09-17T03:43:54.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.800+0000 7f98944c5640 1 --2- 172.21.15.146:0/1108822986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f988c072bc0 0x7f988c15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.800+0000 7f98944c5640 1 --2- 172.21.15.146:0/1108822986 >> v2:172.21.15.179:3300/0 conn(0x7f988c070350 0x7f988c072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.800+0000 7f98944c5640 1 --2- 172.21.15.146:0/1108822986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988c15b770 0x7f988c06fe10 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.800+0000 7f98944c5640 1 -- 172.21.15.146:0/1108822986 >> 172.21.15.146:0/1108822986 conn(0x7f988c0b2060 msgr2=0x7f988c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:54.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.800+0000 7f98944c5640 1 -- 172.21.15.146:0/1108822986 shutdown_connections 2024-09-17T03:43:54.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.800+0000 7f98944c5640 1 -- 172.21.15.146:0/1108822986 wait complete. 2024-09-17T03:43:54.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.802+0000 7f98944c5640 1 Processor -- start 2024-09-17T03:43:54.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.802+0000 7f98944c5640 1 -- start start 2024-09-17T03:43:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.803+0000 7f98944c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f988c070350 0x7f988c1f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.803+0000 7f98944c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988c072bc0 0x7f988c1f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:54.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.803+0000 7f98944c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f988c15b770 0x7f988c1f6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.803+0000 7f98944c5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f988c15fbb0 con 0x7f988c072bc0 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.803+0000 7f98944c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f988c15fa30 con 0x7f988c070350 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.803+0000 7f98944c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f988c15fd30 con 0x7f988c15b770 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.803+0000 7f9891a60640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988c072bc0 0x7f988c1f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.803+0000 7f9891a60640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988c072bc0 0x7f988c1f5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56870/0 (socket says 172.21.15.146:56870) 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.803+0000 7f9891a60640 1 -- 172.21.15.146:0/81036584 learned_addr learned my addr 172.21.15.146:0/81036584 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.803+0000 7f9892261640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f988c070350 0x7f988c1f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.803+0000 7f9892a62640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f988c15b770 0x7f988c1f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.804+0000 7f9891a60640 1 -- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f988c15b770 msgr2=0x7f988c1f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.804+0000 7f9891a60640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f988c15b770 0x7f988c1f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.804+0000 7f9891a60640 1 -- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f988c070350 msgr2=0x7f988c1f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.804+0000 7f9891a60640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f988c070350 0x7f988c1f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.804+0000 7f9891a60640 1 -- 172.21.15.146:0/81036584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988c1525b0 con 0x7f988c072bc0 2024-09-17T03:43:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.804+0000 7f9891a60640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988c072bc0 0x7f988c1f5840 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f987c00d720 tx=0x7f987c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.804+0000 7f9882ffd640 1 -- 172.21.15.146:0/81036584 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c017070 con 0x7f988c072bc0 2024-09-17T03:43:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.804+0000 7f9882ffd640 1 -- 172.21.15.146:0/81036584 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f987c004310 con 0x7f988c072bc0 2024-09-17T03:43:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.804+0000 7f9882ffd640 1 -- 172.21.15.146:0/81036584 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c009c30 con 0x7f988c072bc0 2024-09-17T03:43:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.804+0000 7f98944c5640 1 -- 172.21.15.146:0/81036584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988c152890 con 0x7f988c072bc0 2024-09-17T03:43:54.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.804+0000 7f98944c5640 1 -- 172.21.15.146:0/81036584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f988c152e50 con 0x7f988c072bc0 2024-09-17T03:43:54.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.805+0000 7f98944c5640 1 -- 172.21.15.146:0/81036584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f988c15f2e0 con 0x7f988c072bc0 2024-09-17T03:43:54.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.806+0000 7f9882ffd640 1 -- 172.21.15.146:0/81036584 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f987c0035f0 con 0x7f988c072bc0 2024-09-17T03:43:54.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.806+0000 7f9882ffd640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9870078b90 0x7f987007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:54.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.806+0000 7f9882ffd640 1 -- 172.21.15.146:0/81036584 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5709+0+0 (secure 0 0 0) 0x7f987c09acc0 con 0x7f988c072bc0 2024-09-17T03:43:54.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.807+0000 7f9892261640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9870078b90 0x7f987007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:54.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.807+0000 7f9892261640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9870078b90 0x7f987007b0a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9888033000 tx=0x7f9888004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:54.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.811+0000 7f9882ffd640 1 -- 172.21.15.146:0/81036584 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f987c062b40 con 0x7f988c072bc0 2024-09-17T03:43:54.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.986+0000 7f98944c5640 1 -- 172.21.15.146:0/81036584 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f988c152340 con 0x7f988c072bc0 2024-09-17T03:43:54.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.987+0000 7f9882ffd640 1 -- 172.21.15.146:0/81036584 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) ==== 74+0+16800 (secure 0 0 0) 0x7f987c067570 con 0x7f988c072bc0 2024-09-17T03:43:54.988 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:54.988 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":164,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:43:54.003132+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:43:51.685842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T03:43:52.965620+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:43:54.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 -- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9870078b90 msgr2=0x7f987007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:54.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9870078b90 0x7f987007b0a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9888033000 tx=0x7f9888004730 comp rx=0 tx=0).stop 2024-09-17T03:43:54.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 -- 172.21.15.146:0/81036584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988c072bc0 msgr2=0x7f988c1f5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:54.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988c072bc0 0x7f988c1f5840 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f987c00d720 tx=0x7f987c00dbe0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 -- 172.21.15.146:0/81036584 shutdown_connections 2024-09-17T03:43:54.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9870078b90 0x7f987007b0a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f988c15b770 0x7f988c1f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f988c072bc0 0x7f988c1f5840 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 --2- 172.21.15.146:0/81036584 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f988c070350 0x7f988c1f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:54.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 -- 172.21.15.146:0/81036584 >> 172.21.15.146:0/81036584 conn(0x7f988c0b2060 msgr2=0x7f988c0d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:54.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 -- 172.21.15.146:0/81036584 shutdown_connections 2024-09-17T03:43:54.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:54.990+0000 7f98944c5640 1 -- 172.21.15.146:0/81036584 wait complete. 2024-09-17T03:43:55.002 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:43:55.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.115+0000 7faec855e640 1 -- 172.21.15.146:0/2221781976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faec0145ce0 msgr2=0x7faec006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:55.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.115+0000 7faec855e640 1 --2- 172.21.15.146:0/2221781976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faec0145ce0 0x7faec006d190 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7faec0071ce0 tx=0x7faeb002a520 comp rx=0 tx=0).stop 2024-09-17T03:43:55.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.115+0000 7faec855e640 1 -- 172.21.15.146:0/2221781976 shutdown_connections 2024-09-17T03:43:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.115+0000 7faec855e640 1 --2- 172.21.15.146:0/2221781976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faec0145ce0 0x7faec006d190 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.115+0000 7faec855e640 1 --2- 172.21.15.146:0/2221781976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faec0146230 0x7faec006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.115+0000 7faec855e640 1 -- 172.21.15.146:0/2221781976 >> 172.21.15.146:0/2221781976 conn(0x7faec00b3150 msgr2=0x7faec00b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.115+0000 7faec855e640 1 -- 172.21.15.146:0/2221781976 shutdown_connections 2024-09-17T03:43:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.115+0000 7faec855e640 1 -- 172.21.15.146:0/2221781976 wait complete. 2024-09-17T03:43:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.117+0000 7faec855e640 1 Processor -- start 2024-09-17T03:43:55.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.117+0000 7faec855e640 1 -- start start 2024-09-17T03:43:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec855e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faec0073580 0x7faec015ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec855e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faec0145ce0 0x7faec015f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec855e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faec0146230 0x7faec01f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec855e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faec00d0660 con 0x7faec0145ce0 2024-09-17T03:43:55.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec855e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faec00742b0 con 0x7faec0146230 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec855e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7faec00d07e0 con 0x7faec0073580 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec5af9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faec0145ce0 0x7faec015f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec5af9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faec0145ce0 0x7faec015f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56898/0 (socket says 172.21.15.146:56898) 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec5af9640 1 -- 172.21.15.146:0/2719883302 learned_addr learned my addr 172.21.15.146:0/2719883302 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec62fa640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faec0073580 0x7faec015ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec6afb640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faec0146230 0x7faec01f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec5af9640 1 -- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faec0073580 msgr2=0x7faec015ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec5af9640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faec0073580 0x7faec015ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec5af9640 1 -- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faec0146230 msgr2=0x7faec01f7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec5af9640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faec0146230 0x7faec01f7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.118+0000 7faec5af9640 1 -- 172.21.15.146:0/2719883302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec01e78e0 con 0x7faec0145ce0 2024-09-17T03:43:55.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.119+0000 7faec5af9640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faec0145ce0 0x7faec015f170 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7faeb0034040 tx=0x7faeb00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.119+0000 7faeb6ffd640 1 -- 172.21.15.146:0/2719883302 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb003e030 con 0x7faec0145ce0 2024-09-17T03:43:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.119+0000 7faeb6ffd640 1 -- 172.21.15.146:0/2719883302 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faeb00047a0 con 0x7faec0145ce0 2024-09-17T03:43:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.119+0000 7faec855e640 1 -- 172.21.15.146:0/2719883302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec01e7bc0 con 0x7faec0145ce0 2024-09-17T03:43:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.119+0000 7faeb6ffd640 1 -- 172.21.15.146:0/2719883302 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0035040 con 0x7faec0145ce0 2024-09-17T03:43:55.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.119+0000 7faec855e640 1 -- 172.21.15.146:0/2719883302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec01e8180 con 0x7faec0145ce0 2024-09-17T03:43:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.120+0000 7faec855e640 1 -- 172.21.15.146:0/2719883302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec01e7640 con 0x7faec0145ce0 2024-09-17T03:43:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.121+0000 7faeb6ffd640 1 -- 172.21.15.146:0/2719883302 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faeb0041030 con 0x7faec0145ce0 2024-09-17T03:43:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.121+0000 7faeb6ffd640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faea4078b90 0x7faea407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.121+0000 7faeb6ffd640 1 -- 172.21.15.146:0/2719883302 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5709+0+0 (secure 0 0 0) 0x7faeb00bbb60 con 0x7faec0145ce0 2024-09-17T03:43:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.121+0000 7faec62fa640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faea4078b90 0x7faea407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:55.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.122+0000 7faec62fa640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faea4078b90 0x7faea407b0a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7faebc0058c0 tx=0x7faebc005d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:55.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.125+0000 7faeb6ffd640 1 -- 172.21.15.146:0/2719883302 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faec01e7640 con 0x7faec0145ce0 2024-09-17T03:43:55.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.299+0000 7faec855e640 1 -- 172.21.15.146:0/2719883302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faec0073990 con 0x7faec0145ce0 2024-09-17T03:43:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.300+0000 7faeb6ffd640 1 -- 172.21.15.146:0/2719883302 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) ==== 74+0+16800 (secure 0 0 0) 0x7faeb0083fa0 con 0x7faec0145ce0 2024-09-17T03:43:55.300 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:55.301 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":164,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:43:54.003132+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:43:51.685842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T03:43:52.965620+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 -- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faea4078b90 msgr2=0x7faea407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faea4078b90 0x7faea407b0a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7faebc0058c0 tx=0x7faebc005d80 comp rx=0 tx=0).stop 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 -- 172.21.15.146:0/2719883302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faec0145ce0 msgr2=0x7faec015f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faec0145ce0 0x7faec015f170 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7faeb0034040 tx=0x7faeb00039e0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 -- 172.21.15.146:0/2719883302 shutdown_connections 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faea4078b90 0x7faea407b0a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faec0146230 0x7faec01f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faec0145ce0 0x7faec015f170 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 --2- 172.21.15.146:0/2719883302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faec0073580 0x7faec015ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 -- 172.21.15.146:0/2719883302 >> 172.21.15.146:0/2719883302 conn(0x7faec00b3150 msgr2=0x7faec00d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 -- 172.21.15.146:0/2719883302 shutdown_connections 2024-09-17T03:43:55.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.302+0000 7faec855e640 1 -- 172.21.15.146:0/2719883302 wait complete. 2024-09-17T03:43:55.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:43:55.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.432+0000 7facc77c3640 1 -- 172.21.15.146:0/468506821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc00cfc40 msgr2=0x7facc015ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:55.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.432+0000 7facc77c3640 1 --2- 172.21.15.146:0/468506821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc00cfc40 0x7facc015ead0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7facb0009820 tx=0x7facb002a510 comp rx=0 tx=0).stop 2024-09-17T03:43:55.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.432+0000 7facc77c3640 1 -- 172.21.15.146:0/468506821 shutdown_connections 2024-09-17T03:43:55.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.432+0000 7facc77c3640 1 --2- 172.21.15.146:0/468506821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc00cfc40 0x7facc015ead0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.432+0000 7facc77c3640 1 --2- 172.21.15.146:0/468506821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facc00b3360 0x7facc0072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.432+0000 7facc77c3640 1 -- 172.21.15.146:0/468506821 >> 172.21.15.146:0/468506821 conn(0x7facc00b2060 msgr2=0x7facc00b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:55.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.432+0000 7facc77c3640 1 -- 172.21.15.146:0/468506821 shutdown_connections 2024-09-17T03:43:55.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.432+0000 7facc77c3640 1 -- 172.21.15.146:0/468506821 wait complete. 2024-09-17T03:43:55.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.434+0000 7facc77c3640 1 Processor -- start 2024-09-17T03:43:55.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.434+0000 7facc77c3640 1 -- start start 2024-09-17T03:43:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.435+0000 7facc77c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc00b3360 0x7facc014d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.435+0000 7facc77c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facc00cfc40 0x7facc014bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.435+0000 7facc77c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc015f010 0x7facc013f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.435+0000 7facc77c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7facc006e800 con 0x7facc00b3360 2024-09-17T03:43:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.435+0000 7facc77c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7facc006e680 con 0x7facc015f010 2024-09-17T03:43:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.435+0000 7facc77c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7facc006e980 con 0x7facc00cfc40 2024-09-17T03:43:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.435+0000 7facc555f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc00b3360 0x7facc014d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.435+0000 7facc555f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc00b3360 0x7facc014d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56908/0 (socket says 172.21.15.146:56908) 2024-09-17T03:43:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.435+0000 7facc555f640 1 -- 172.21.15.146:0/4125455934 learned_addr learned my addr 172.21.15.146:0/4125455934 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.435+0000 7facc5d60640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc015f010 0x7facc013f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.435+0000 7facc4d5e640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facc00cfc40 0x7facc014bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.436+0000 7facc555f640 1 -- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facc00cfc40 msgr2=0x7facc014bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.436+0000 7facc555f640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facc00cfc40 0x7facc014bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.436+0000 7facc555f640 1 -- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc015f010 msgr2=0x7facc013f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.436+0000 7facc555f640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc015f010 0x7facc013f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.436+0000 7facc555f640 1 -- 172.21.15.146:0/4125455934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc014c800 con 0x7facc00b3360 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.436+0000 7facc555f640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc00b3360 0x7facc014d4b0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7facbc00e790 tx=0x7facbc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.436+0000 7facb5ffb640 1 -- 172.21.15.146:0/4125455934 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc00eea0 con 0x7facc00b3360 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.436+0000 7facb5ffb640 1 -- 172.21.15.146:0/4125455934 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7facbc00cdb0 con 0x7facc00b3360 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.436+0000 7facc77c3640 1 -- 172.21.15.146:0/4125455934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc014b1a0 con 0x7facc00b3360 2024-09-17T03:43:55.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.436+0000 7facb5ffb640 1 -- 172.21.15.146:0/4125455934 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc010690 con 0x7facc00b3360 2024-09-17T03:43:55.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.436+0000 7facc77c3640 1 -- 172.21.15.146:0/4125455934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc014b760 con 0x7facc00b3360 2024-09-17T03:43:55.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.437+0000 7facc77c3640 1 -- 172.21.15.146:0/4125455934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc00b4cd0 con 0x7facc00b3360 2024-09-17T03:43:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.438+0000 7facb5ffb640 1 -- 172.21.15.146:0/4125455934 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7facbc010830 con 0x7facc00b3360 2024-09-17T03:43:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.439+0000 7facb5ffb640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faca4078b90 0x7faca407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.439+0000 7facb5ffb640 1 -- 172.21.15.146:0/4125455934 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5709+0+0 (secure 0 0 0) 0x7facbc09b6e0 con 0x7facc00b3360 2024-09-17T03:43:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.439+0000 7facc4d5e640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faca4078b90 0x7faca407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:55.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.439+0000 7facc4d5e640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faca4078b90 0x7faca407b0a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7facb0034000 tx=0x7facb0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:55.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.443+0000 7facb5ffb640 1 -- 172.21.15.146:0/4125455934 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7facbc0634d0 con 0x7facc00b3360 2024-09-17T03:43:55.619 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-09-17T03:43:55.619+0000 7febb06a1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:43:55.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:55.653+0000 7facc77c3640 1 -- 172.21.15.146:0/4125455934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7facc014c1c0 con 0x7facc00b3360 2024-09-17T03:43:56.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.645+0000 7facb5ffb640 1 -- 172.21.15.146:0/4125455934 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v124) ==== 118+0+0 (secure 0 0 0) 0x7facbc067f00 con 0x7facc00b3360 2024-09-17T03:43:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.648+0000 7facc77c3640 1 -- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faca4078b90 msgr2=0x7faca407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.648+0000 7facc77c3640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faca4078b90 0x7faca407b0a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7facb0034000 tx=0x7facb0004730 comp rx=0 tx=0).stop 2024-09-17T03:43:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.648+0000 7facc77c3640 1 -- 172.21.15.146:0/4125455934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc00b3360 msgr2=0x7facc014d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.648+0000 7facc77c3640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc00b3360 0x7facc014d4b0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7facbc00e790 tx=0x7facbc00ec50 comp rx=0 tx=0).stop 2024-09-17T03:43:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.648+0000 7facc77c3640 1 -- 172.21.15.146:0/4125455934 shutdown_connections 2024-09-17T03:43:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.648+0000 7facc77c3640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faca4078b90 0x7faca407b0a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.648+0000 7facc77c3640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc015f010 0x7facc013f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.648+0000 7facc77c3640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facc00cfc40 0x7facc014bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.648+0000 7facc77c3640 1 --2- 172.21.15.146:0/4125455934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facc00b3360 0x7facc014d4b0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.648+0000 7facc77c3640 1 -- 172.21.15.146:0/4125455934 >> 172.21.15.146:0/4125455934 conn(0x7facc00b2060 msgr2=0x7facc00b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:56.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.649+0000 7facc77c3640 1 -- 172.21.15.146:0/4125455934 shutdown_connections 2024-09-17T03:43:56.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.649+0000 7facc77c3640 1 -- 172.21.15.146:0/4125455934 wait complete. 2024-09-17T03:43:56.663 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:43:56.663 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:43:56.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.786+0000 7f7887425640 1 -- 172.21.15.146:0/2590411553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788006f3d0 msgr2=0x7f78800b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.786+0000 7f7887425640 1 --2- 172.21.15.146:0/2590411553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788006f3d0 0x7f78800b3b60 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f78800726f0 tx=0x7f787002a560 comp rx=0 tx=0).stop 2024-09-17T03:43:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.786+0000 7f7887425640 1 -- 172.21.15.146:0/2590411553 shutdown_connections 2024-09-17T03:43:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.786+0000 7f7887425640 1 --2- 172.21.15.146:0/2590411553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78800b40a0 0x7f788015ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.786+0000 7f7887425640 1 --2- 172.21.15.146:0/2590411553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788006f3d0 0x7f78800b3b60 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.786+0000 7f7887425640 1 --2- 172.21.15.146:0/2590411553 >> v2:172.21.15.179:3300/0 conn(0x7f7880144900 0x7f7880144380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.786+0000 7f7887425640 1 -- 172.21.15.146:0/2590411553 >> 172.21.15.146:0/2590411553 conn(0x7f788006d3c0 msgr2=0x7f78800b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.786+0000 7f7887425640 1 -- 172.21.15.146:0/2590411553 shutdown_connections 2024-09-17T03:43:56.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.786+0000 7f7887425640 1 -- 172.21.15.146:0/2590411553 wait complete. 2024-09-17T03:43:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.788+0000 7f7887425640 1 Processor -- start 2024-09-17T03:43:56.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.788+0000 7f7887425640 1 -- start start 2024-09-17T03:43:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.789+0000 7f7887425640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788006f3d0 0x7f78800af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:56.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.789+0000 7f7887425640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78800b40a0 0x7f78801400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.789+0000 7f7887425640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7880144900 0x7f78801e6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.789+0000 7f7887425640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f788015f350 con 0x7f7880144900 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.789+0000 7f7887425640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f788015f1d0 con 0x7f788006f3d0 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.789+0000 7f7887425640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f788015f4d0 con 0x7f78800b40a0 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.789+0000 7f78859c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7880144900 0x7f78801e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.789+0000 7f78859c2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7880144900 0x7f78801e6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56926/0 (socket says 172.21.15.146:56926) 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.789+0000 7f78859c2640 1 -- 172.21.15.146:0/1312307399 learned_addr learned my addr 172.21.15.146:0/1312307399 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.789+0000 7f78849c0640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78800b40a0 0x7f78801400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.789+0000 7f78851c1640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788006f3d0 0x7f78800af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.790+0000 7f78859c2640 1 -- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78800b40a0 msgr2=0x7f78801400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.790+0000 7f78859c2640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78800b40a0 0x7f78801400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.790+0000 7f78859c2640 1 -- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788006f3d0 msgr2=0x7f78800af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.790+0000 7f78859c2640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788006f3d0 0x7f78800af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.790+0000 7f78859c2640 1 -- 172.21.15.146:0/1312307399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78801f5ed0 con 0x7f7880144900 2024-09-17T03:43:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.790+0000 7f78859c2640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7880144900 0x7f78801e6650 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f787800b9a0 tx=0x7f787800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.790+0000 7f7875ffb640 1 -- 172.21.15.146:0/1312307399 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878019070 con 0x7f7880144900 2024-09-17T03:43:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.790+0000 7f7875ffb640 1 -- 172.21.15.146:0/1312307399 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f787800ccb0 con 0x7f7880144900 2024-09-17T03:43:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.790+0000 7f7875ffb640 1 -- 172.21.15.146:0/1312307399 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78780146a0 con 0x7f7880144900 2024-09-17T03:43:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.790+0000 7f7887425640 1 -- 172.21.15.146:0/1312307399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78800b0290 con 0x7f7880144900 2024-09-17T03:43:56.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.790+0000 7f7887425640 1 -- 172.21.15.146:0/1312307399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78801f6440 con 0x7f7880144900 2024-09-17T03:43:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.791+0000 7f7887425640 1 -- 172.21.15.146:0/1312307399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7880074510 con 0x7f7880144900 2024-09-17T03:43:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.792+0000 7f7875ffb640 1 -- 172.21.15.146:0/1312307399 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f787801c070 con 0x7f7880144900 2024-09-17T03:43:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.792+0000 7f7875ffb640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7864078bc0 0x7f786407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.792+0000 7f7875ffb640 1 -- 172.21.15.146:0/1312307399 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f787809a9a0 con 0x7f7880144900 2024-09-17T03:43:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.792+0000 7f78851c1640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7864078bc0 0x7f786407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:56.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.793+0000 7f78851c1640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7864078bc0 0x7f786407b0d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f787c00a490 tx=0x7f787c00a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:56.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:56.796+0000 7f7875ffb640 1 -- 172.21.15.146:0/1312307399 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7878062820 con 0x7f7880144900 2024-09-17T03:43:57.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.007+0000 7f7887425640 1 -- 172.21.15.146:0/1312307399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f78800b4820 con 0x7f7880144900 2024-09-17T03:43:57.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.672+0000 7f7875ffb640 1 -- 172.21.15.146:0/1312307399 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v125) ==== 122+0+0 (secure 0 0 0) 0x7f7878067250 con 0x7f7880144900 2024-09-17T03:43:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 -- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7864078bc0 msgr2=0x7f786407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7864078bc0 0x7f786407b0d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f787c00a490 tx=0x7f787c00a420 comp rx=0 tx=0).stop 2024-09-17T03:43:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 -- 172.21.15.146:0/1312307399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7880144900 msgr2=0x7f78801e6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7880144900 0x7f78801e6650 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f787800b9a0 tx=0x7f787800be60 comp rx=0 tx=0).stop 2024-09-17T03:43:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 -- 172.21.15.146:0/1312307399 shutdown_connections 2024-09-17T03:43:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7864078bc0 0x7f786407b0d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7880144900 0x7f78801e6650 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78800b40a0 0x7f78801400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 --2- 172.21.15.146:0/1312307399 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f788006f3d0 0x7f78800af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 -- 172.21.15.146:0/1312307399 >> 172.21.15.146:0/1312307399 conn(0x7f788006d3c0 msgr2=0x7f7880142b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 -- 172.21.15.146:0/1312307399 shutdown_connections 2024-09-17T03:43:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.675+0000 7f7887425640 1 -- 172.21.15.146:0/1312307399 wait complete. 2024-09-17T03:43:57.688 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:43:57.688 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:43:57.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.804+0000 7f37af80a640 1 -- 172.21.15.146:0/257319219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3794004800 msgr2=0x7f3794004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:57.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.804+0000 7f37af80a640 1 --2- 172.21.15.146:0/257319219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3794004800 0x7f3794004c10 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f379800c260 tx=0x7f3794005830 comp rx=0 tx=0).stop 2024-09-17T03:43:57.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.804+0000 7f37adda7640 1 -- 172.21.15.146:0/257319219 reap_dead start 2024-09-17T03:43:57.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.804+0000 7f37af80a640 1 -- 172.21.15.146:0/257319219 shutdown_connections 2024-09-17T03:43:57.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.804+0000 7f37af80a640 1 -- 172.21.15.146:0/257319219 >> 172.21.15.146:0/257319219 conn(0x7f37a80b3150 msgr2=0x7f37a80b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:57.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.804+0000 7f37af80a640 1 -- 172.21.15.146:0/257319219 shutdown_connections 2024-09-17T03:43:57.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.804+0000 7f37af80a640 1 -- 172.21.15.146:0/257319219 wait complete. 2024-09-17T03:43:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.806+0000 7f37af80a640 1 Processor -- start 2024-09-17T03:43:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.806+0000 7f37af80a640 1 -- start start 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.807+0000 7f37af80a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3794004800 0x7f37a81465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.807+0000 7f37af80a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a81f24c0 0x7f37a8148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.807+0000 7f37af80a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a8149460 0x7f37a8149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.807+0000 7f37af80a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f37a806f700 con 0x7f37a81f24c0 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37af80a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f37a806f580 con 0x7f37a8149460 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37af80a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f37a806f880 con 0x7f3794004800 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37acda5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a81f24c0 0x7f37a8148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37acda5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a81f24c0 0x7f37a8148f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43810/0 (socket says 172.21.15.146:43810) 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37acda5640 1 -- 172.21.15.146:0/240549516 learned_addr learned my addr 172.21.15.146:0/240549516 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37acda5640 1 -- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3794004800 msgr2=0x7f37a81465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37acda5640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3794004800 0x7f37a81465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37acda5640 1 -- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a8149460 msgr2=0x7f37a8149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:57.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37acda5640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a8149460 0x7f37a8149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:57.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37acda5640 1 -- 172.21.15.146:0/240549516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a81f2cb0 con 0x7f37a81f24c0 2024-09-17T03:43:57.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37acda5640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a81f24c0 0x7f37a8148f20 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f379802b0f0 tx=0x7f3798001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:57.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f379dffb640 1 -- 172.21.15.146:0/240549516 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798031040 con 0x7f37a81f24c0 2024-09-17T03:43:57.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f379dffb640 1 -- 172.21.15.146:0/240549516 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37980035f0 con 0x7f37a81f24c0 2024-09-17T03:43:57.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f379dffb640 1 -- 172.21.15.146:0/240549516 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798003a40 con 0x7f37a81f24c0 2024-09-17T03:43:57.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.808+0000 7f37af80a640 1 -- 172.21.15.146:0/240549516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a81f2f90 con 0x7f37a81f24c0 2024-09-17T03:43:57.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.809+0000 7f37af80a640 1 -- 172.21.15.146:0/240549516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a80af280 con 0x7f37a81f24c0 2024-09-17T03:43:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.809+0000 7f37af80a640 1 -- 172.21.15.146:0/240549516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a81f2a20 con 0x7f37a81f24c0 2024-09-17T03:43:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.810+0000 7f379dffb640 1 -- 172.21.15.146:0/240549516 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3798034070 con 0x7f37a81f24c0 2024-09-17T03:43:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.811+0000 7f379dffb640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f378c078bf0 0x7f378c07b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.811+0000 7f379dffb640 1 -- 172.21.15.146:0/240549516 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f37980bad90 con 0x7f37a81f24c0 2024-09-17T03:43:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.811+0000 7f37ad5a6640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f378c078bf0 0x7f378c07b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.812+0000 7f37ad5a6640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f378c078bf0 0x7f378c07b100 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009900 tx=0x7f37a4005d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:57.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:57.815+0000 7f379dffb640 1 -- 172.21.15.146:0/240549516 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3798083240 con 0x7f37a81f24c0 2024-09-17T03:43:58.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.024+0000 7f37af80a640 1 -- 172.21.15.146:0/240549516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37a80b4ba0 con 0x7f37a81f24c0 2024-09-17T03:43:58.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.024+0000 7f379dffb640 1 -- 172.21.15.146:0/240549516 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5245 (secure 0 0 0) 0x7f3798082b40 con 0x7f37a81f24c0 2024-09-17T03:43:58.025 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:58.025 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":125,"btime":"2024-09-17T03:43:57:668195+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2920792926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2920792926},{"type":"v1","addr":"172.21.15.179:6837","nonce":2920792926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8917,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/154430395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":154430395},{"type":"v1","addr":"172.21.15.179:6836","nonce":154430395}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":10242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/465040613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":465040613},{"type":"v1","addr":"172.21.15.146:6833","nonce":465040613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:43:54.003090+0000","modified":"2024-09-17T03:43:57.009133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10251":{"gid":10251,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3868966088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868966088},{"type":"v1","addr":"172.21.15.146:6835","nonce":3868966088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10251,"qdb_cluster":[10251]},"id":12}]} 2024-09-17T03:43:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 125 2024-09-17T03:43:58.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 -- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f378c078bf0 msgr2=0x7f378c07b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f378c078bf0 0x7f378c07b100 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009900 tx=0x7f37a4005d50 comp rx=0 tx=0).stop 2024-09-17T03:43:58.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 -- 172.21.15.146:0/240549516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a81f24c0 msgr2=0x7f37a8148f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a81f24c0 0x7f37a8148f20 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f379802b0f0 tx=0x7f3798001cb0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 -- 172.21.15.146:0/240549516 shutdown_connections 2024-09-17T03:43:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f378c078bf0 0x7f378c07b100 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37a8149460 0x7f37a8149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37a81f24c0 0x7f37a8148f20 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 --2- 172.21.15.146:0/240549516 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3794004800 0x7f37a81465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 -- 172.21.15.146:0/240549516 >> 172.21.15.146:0/240549516 conn(0x7f37a80b3150 msgr2=0x7f37a8073580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 -- 172.21.15.146:0/240549516 shutdown_connections 2024-09-17T03:43:58.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.027+0000 7f37af80a640 1 -- 172.21.15.146:0/240549516 wait complete. 2024-09-17T03:43:58.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:43:58.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.151+0000 7f3b5ad71640 1 -- 172.21.15.146:0/2580145209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c0052d0 msgr2=0x7f3b3c005910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.151+0000 7f3b5ad71640 1 --2- 172.21.15.146:0/2580145209 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c0052d0 0x7f3b3c005910 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f3b540b5800 tx=0x7f3b3c006940 comp rx=0 tx=0).stop 2024-09-17T03:43:58.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.151+0000 7f3b5930e640 1 -- 172.21.15.146:0/2580145209 reap_dead start 2024-09-17T03:43:58.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.151+0000 7f3b5ad71640 1 -- 172.21.15.146:0/2580145209 shutdown_connections 2024-09-17T03:43:58.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.151+0000 7f3b5ad71640 1 -- 172.21.15.146:0/2580145209 >> 172.21.15.146:0/2580145209 conn(0x7f3b540b2060 msgr2=0x7f3b540b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:58.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.151+0000 7f3b5ad71640 1 -- 172.21.15.146:0/2580145209 shutdown_connections 2024-09-17T03:43:58.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.152+0000 7f3b5ad71640 1 -- 172.21.15.146:0/2580145209 wait complete. 2024-09-17T03:43:58.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.153+0000 7f3b5ad71640 1 Processor -- start 2024-09-17T03:43:58.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.153+0000 7f3b5ad71640 1 -- start start 2024-09-17T03:43:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5ad71640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3c0052d0 0x7f3b5415dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5ad71640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b54141c70 0x7f3b54154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5ad71640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b54142080 0x7f3b54154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5ad71640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5415ec50 con 0x7f3b54142080 2024-09-17T03:43:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5ad71640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5415ead0 con 0x7f3b54141c70 2024-09-17T03:43:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5ad71640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5415edd0 con 0x7f3b3c0052d0 2024-09-17T03:43:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5930e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b54142080 0x7f3b54154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5930e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b54142080 0x7f3b54154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43830/0 (socket says 172.21.15.146:43830) 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5930e640 1 -- 172.21.15.146:0/3483941144 learned_addr learned my addr 172.21.15.146:0/3483941144 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b58b0d640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3c0052d0 0x7f3b5415dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b53fff640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b54141c70 0x7f3b54154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5930e640 1 -- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3c0052d0 msgr2=0x7f3b5415dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5930e640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3c0052d0 0x7f3b5415dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5930e640 1 -- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b54141c70 msgr2=0x7f3b54154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5930e640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b54141c70 0x7f3b54154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5930e640 1 -- 172.21.15.146:0/3483941144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b541f6e30 con 0x7f3b54142080 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b53fff640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b54141c70 0x7f3b54154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.155+0000 7f3b5930e640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b54142080 0x7f3b54154680 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f3b54071960 tx=0x7f3b4c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.156+0000 7f3b517fa640 1 -- 172.21.15.146:0/3483941144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011630 con 0x7f3b54142080 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.156+0000 7f3b517fa640 1 -- 172.21.15.146:0/3483941144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b4c018070 con 0x7f3b54142080 2024-09-17T03:43:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.156+0000 7f3b5ad71640 1 -- 172.21.15.146:0/3483941144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b541f7110 con 0x7f3b54142080 2024-09-17T03:43:58.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.156+0000 7f3b517fa640 1 -- 172.21.15.146:0/3483941144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011a90 con 0x7f3b54142080 2024-09-17T03:43:58.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.156+0000 7f3b5ad71640 1 -- 172.21.15.146:0/3483941144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b541f76d0 con 0x7f3b54142080 2024-09-17T03:43:58.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.157+0000 7f3b5ad71640 1 -- 172.21.15.146:0/3483941144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5406e760 con 0x7f3b54142080 2024-09-17T03:43:58.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.157+0000 7f3b517fa640 1 -- 172.21.15.146:0/3483941144 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b4c011c30 con 0x7f3b54142080 2024-09-17T03:43:58.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.158+0000 7f3b517fa640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3b40078b90 0x7f3b4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.158+0000 7f3b517fa640 1 -- 172.21.15.146:0/3483941144 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f3b4c09b370 con 0x7f3b54142080 2024-09-17T03:43:58.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.158+0000 7f3b58b0d640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3b40078b90 0x7f3b4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.159+0000 7f3b58b0d640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3b40078b90 0x7f3b4007b0a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3b44001410 tx=0x7f3b440012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:58.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.162+0000 7f3b517fa640 1 -- 172.21.15.146:0/3483941144 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3b4c063710 con 0x7f3b54142080 2024-09-17T03:43:58.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.336+0000 7f3b5ad71640 1 -- 172.21.15.146:0/3483941144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b540b0d30 con 0x7f3b54142080 2024-09-17T03:43:58.338 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.338+0000 7f3b517fa640 1 -- 172.21.15.146:0/3483941144 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16787 (secure 0 0 0) 0x7f3b4c063010 con 0x7f3b54142080 2024-09-17T03:43:58.338 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:58.338 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":165,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:43:55.643610+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:43:51.685842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T03:43:52.965620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:43:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 -- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3b40078b90 msgr2=0x7f3b4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3b40078b90 0x7f3b4007b0a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3b44001410 tx=0x7f3b440012e0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 -- 172.21.15.146:0/3483941144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b54142080 msgr2=0x7f3b54154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b54142080 0x7f3b54154680 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f3b54071960 tx=0x7f3b4c0017a0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 -- 172.21.15.146:0/3483941144 shutdown_connections 2024-09-17T03:43:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3b40078b90 0x7f3b4007b0a0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b54142080 0x7f3b54154680 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b54141c70 0x7f3b54154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 --2- 172.21.15.146:0/3483941144 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b3c0052d0 0x7f3b5415dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 -- 172.21.15.146:0/3483941144 >> 172.21.15.146:0/3483941144 conn(0x7f3b540b2060 msgr2=0x7f3b54155000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 -- 172.21.15.146:0/3483941144 shutdown_connections 2024-09-17T03:43:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.340+0000 7f3b5ad71640 1 -- 172.21.15.146:0/3483941144 wait complete. 2024-09-17T03:43:58.352 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:43:58.352 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:43:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.465+0000 7f7b694ec640 1 -- 172.21.15.146:0/2167351299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b641620f0 msgr2=0x7f7b6406ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.465+0000 7f7b694ec640 1 --2- 172.21.15.146:0/2167351299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b641620f0 0x7f7b6406ed30 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f7b58005fd0 tx=0x7f7b5802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.465+0000 7f7b694ec640 1 -- 172.21.15.146:0/2167351299 shutdown_connections 2024-09-17T03:43:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.465+0000 7f7b694ec640 1 --2- 172.21.15.146:0/2167351299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b641620f0 0x7f7b6406ed30 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.465+0000 7f7b694ec640 1 --2- 172.21.15.146:0/2167351299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b640b3870 0x7f7b640cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.465+0000 7f7b694ec640 1 -- 172.21.15.146:0/2167351299 >> 172.21.15.146:0/2167351299 conn(0x7f7b640d4be0 msgr2=0x7f7b640d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.465+0000 7f7b694ec640 1 -- 172.21.15.146:0/2167351299 shutdown_connections 2024-09-17T03:43:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.465+0000 7f7b694ec640 1 -- 172.21.15.146:0/2167351299 wait complete. 2024-09-17T03:43:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.467+0000 7f7b694ec640 1 Processor -- start 2024-09-17T03:43:58.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.467+0000 7f7b694ec640 1 -- start start 2024-09-17T03:43:58.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b694ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b6406f270 0x7f7b641f9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b694ec640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b640b3870 0x7f7b6414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b694ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b641620f0 0x7f7b640ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b694ec640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7b64162fb0 con 0x7f7b640b3870 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b694ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7b640d43b0 con 0x7f7b641620f0 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b694ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7b64163130 con 0x7f7b6406f270 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b627fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b640b3870 0x7f7b6414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b627fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b640b3870 0x7f7b6414a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43856/0 (socket says 172.21.15.146:43856) 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b627fc640 1 -- 172.21.15.146:0/170742458 learned_addr learned my addr 172.21.15.146:0/170742458 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b62ffd640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b6406f270 0x7f7b641f9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b637fe640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b641620f0 0x7f7b640ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b627fc640 1 -- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b6406f270 msgr2=0x7f7b641f9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b627fc640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b6406f270 0x7f7b641f9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b627fc640 1 -- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b641620f0 msgr2=0x7f7b640ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b627fc640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b641620f0 0x7f7b640ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.468+0000 7f7b627fc640 1 -- 172.21.15.146:0/170742458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b641fa450 con 0x7f7b640b3870 2024-09-17T03:43:58.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.469+0000 7f7b627fc640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b640b3870 0x7f7b6414a530 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f7b58006010 tx=0x7f7b580038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:58.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.469+0000 7f7b4b7fe640 1 -- 172.21.15.146:0/170742458 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5803e030 con 0x7f7b640b3870 2024-09-17T03:43:58.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.469+0000 7f7b4b7fe640 1 -- 172.21.15.146:0/170742458 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b58003d90 con 0x7f7b640b3870 2024-09-17T03:43:58.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.469+0000 7f7b694ec640 1 -- 172.21.15.146:0/170742458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b641e89d0 con 0x7f7b640b3870 2024-09-17T03:43:58.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.469+0000 7f7b4b7fe640 1 -- 172.21.15.146:0/170742458 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b58035040 con 0x7f7b640b3870 2024-09-17T03:43:58.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.469+0000 7f7b694ec640 1 -- 172.21.15.146:0/170742458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b641f63e0 con 0x7f7b640b3870 2024-09-17T03:43:58.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.470+0000 7f7b694ec640 1 -- 172.21.15.146:0/170742458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b641f5ef0 con 0x7f7b640b3870 2024-09-17T03:43:58.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.470+0000 7f7b4b7fe640 1 -- 172.21.15.146:0/170742458 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b58041030 con 0x7f7b640b3870 2024-09-17T03:43:58.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.471+0000 7f7b4b7fe640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b50078bc0 0x7f7b5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.471+0000 7f7b4b7fe640 1 -- 172.21.15.146:0/170742458 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f7b580bb3d0 con 0x7f7b640b3870 2024-09-17T03:43:58.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.471+0000 7f7b62ffd640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b50078bc0 0x7f7b5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.472+0000 7f7b62ffd640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b50078bc0 0x7f7b5007b0d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7b54005fd0 tx=0x7f7b540095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:58.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.475+0000 7f7b4b7fe640 1 -- 172.21.15.146:0/170742458 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b641fa450 con 0x7f7b640b3870 2024-09-17T03:43:58.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.649+0000 7f7b694ec640 1 -- 172.21.15.146:0/170742458 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b64163620 con 0x7f7b50078bc0 2024-09-17T03:43:58.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.654+0000 7f7b4b7fe640 1 -- 172.21.15.146:0/170742458 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248359 (secure 0 0 0) 0x7f7b64163620 con 0x7f7b50078bc0 2024-09-17T03:43:58.657 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:58.658 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:43:58.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 -- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b50078bc0 msgr2=0x7f7b5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b50078bc0 0x7f7b5007b0d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f7b54005fd0 tx=0x7f7b540095e0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 -- 172.21.15.146:0/170742458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b640b3870 msgr2=0x7f7b6414a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b640b3870 0x7f7b6414a530 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f7b58006010 tx=0x7f7b580038a0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 -- 172.21.15.146:0/170742458 shutdown_connections 2024-09-17T03:43:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b50078bc0 0x7f7b5007b0d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b641620f0 0x7f7b640ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b640b3870 0x7f7b6414a530 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 --2- 172.21.15.146:0/170742458 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b6406f270 0x7f7b641f9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 -- 172.21.15.146:0/170742458 >> 172.21.15.146:0/170742458 conn(0x7f7b640d4be0 msgr2=0x7f7b641602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 -- 172.21.15.146:0/170742458 shutdown_connections 2024-09-17T03:43:58.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.657+0000 7f7b694ec640 1 -- 172.21.15.146:0/170742458 wait complete. 2024-09-17T03:43:58.669 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":494,"stamp":"2024-09-17T03:43:57.965540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":104,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":456872,"kb_used_data":17188,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754517848,"statfs":{"total":773094113280,"available":772626276352,"internally_reserved":0,"allocated":17600512,"data_stored":8386160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.335168"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.643650+0000","last_change":"2024-09-17T03:43:53.643650+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.643650+0000","last_undegraded":"2024-09-17T03:43:53.643650+0000","last_fullsized":"2024-09-17T03:43:53.643650+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638475+0000","last_change":"2024-09-17T03:43:53.638475+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638475+0000","last_undegraded":"2024-09-17T03:43:53.638475+0000","last_fullsized":"2024-09-17T03:43:53.638475+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635612+0000","last_change":"2024-09-17T03:43:53.635612+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635612+0000","last_undegraded":"2024-09-17T03:43:53.635612+0000","last_fullsized":"2024-09-17T03:43:53.635612+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636821+0000","last_change":"2024-09-17T03:43:53.636821+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636821+0000","last_undegraded":"2024-09-17T03:43:53.636821+0000","last_fullsized":"2024-09-17T03:43:53.636821+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.641313+0000","last_change":"2024-09-17T03:43:53.641313+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.641313+0000","last_undegraded":"2024-09-17T03:43:53.641313+0000","last_fullsized":"2024-09-17T03:43:53.641313+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635123+0000","last_change":"2024-09-17T03:43:53.635123+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635123+0000","last_undegraded":"2024-09-17T03:43:53.635123+0000","last_fullsized":"2024-09-17T03:43:53.635123+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639696+0000","last_change":"2024-09-17T03:43:53.639696+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639696+0000","last_undegraded":"2024-09-17T03:43:53.639696+0000","last_fullsized":"2024-09-17T03:43:53.639696+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647561+0000","last_change":"2024-09-17T03:43:54.655319+0000","last_active":"2024-09-17T03:43:55.647561+0000","last_peered":"2024-09-17T03:43:55.647561+0000","last_clean":"2024-09-17T03:43:55.647561+0000","last_became_active":"2024-09-17T03:43:54.655022+0000","last_became_peered":"2024-09-17T03:43:54.655022+0000","last_unstale":"2024-09-17T03:43:55.647561+0000","last_undegraded":"2024-09-17T03:43:55.647561+0000","last_fullsized":"2024-09-17T03:43:55.647561+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:19.101578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984059+0000","last_change":"2024-09-17T03:43:54.667783+0000","last_active":"2024-09-17T03:43:55.984059+0000","last_peered":"2024-09-17T03:43:55.984059+0000","last_clean":"2024-09-17T03:43:55.984059+0000","last_became_active":"2024-09-17T03:43:54.667437+0000","last_became_peered":"2024-09-17T03:43:54.667437+0000","last_unstale":"2024-09-17T03:43:55.984059+0000","last_undegraded":"2024-09-17T03:43:55.984059+0000","last_fullsized":"2024-09-17T03:43:55.984059+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:40.158899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637798+0000","last_change":"2024-09-17T03:43:53.637798+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637798+0000","last_undegraded":"2024-09-17T03:43:53.637798+0000","last_fullsized":"2024-09-17T03:43:53.637798+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639578+0000","last_change":"2024-09-17T03:43:53.639578+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639578+0000","last_undegraded":"2024-09-17T03:43:53.639578+0000","last_fullsized":"2024-09-17T03:43:53.639578+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636288+0000","last_change":"2024-09-17T03:43:53.636288+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636288+0000","last_undegraded":"2024-09-17T03:43:53.636288+0000","last_fullsized":"2024-09-17T03:43:53.636288+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636418+0000","last_change":"2024-09-17T03:43:53.636418+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636418+0000","last_undegraded":"2024-09-17T03:43:53.636418+0000","last_fullsized":"2024-09-17T03:43:53.636418+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983964+0000","last_change":"2024-09-17T03:43:54.667596+0000","last_active":"2024-09-17T03:43:55.983964+0000","last_peered":"2024-09-17T03:43:55.983964+0000","last_clean":"2024-09-17T03:43:55.983964+0000","last_became_active":"2024-09-17T03:43:54.667088+0000","last_became_peered":"2024-09-17T03:43:54.667088+0000","last_unstale":"2024-09-17T03:43:55.983964+0000","last_undegraded":"2024-09-17T03:43:55.983964+0000","last_fullsized":"2024-09-17T03:43:55.983964+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:25.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637365+0000","last_change":"2024-09-17T03:43:53.637365+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637365+0000","last_undegraded":"2024-09-17T03:43:53.637365+0000","last_fullsized":"2024-09-17T03:43:53.637365+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647641+0000","last_change":"2024-09-17T03:43:54.665060+0000","last_active":"2024-09-17T03:43:55.647641+0000","last_peered":"2024-09-17T03:43:55.647641+0000","last_clean":"2024-09-17T03:43:55.647641+0000","last_became_active":"2024-09-17T03:43:54.664742+0000","last_became_peered":"2024-09-17T03:43:54.664742+0000","last_unstale":"2024-09-17T03:43:55.647641+0000","last_undegraded":"2024-09-17T03:43:55.647641+0000","last_fullsized":"2024-09-17T03:43:55.647641+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:45.262140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635178+0000","last_change":"2024-09-17T03:43:53.635178+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635178+0000","last_undegraded":"2024-09-17T03:43:53.635178+0000","last_fullsized":"2024-09-17T03:43:53.635178+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640752+0000","last_change":"2024-09-17T03:43:53.640752+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640752+0000","last_undegraded":"2024-09-17T03:43:53.640752+0000","last_fullsized":"2024-09-17T03:43:53.640752+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639406+0000","last_change":"2024-09-17T03:43:53.639406+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639406+0000","last_undegraded":"2024-09-17T03:43:53.639406+0000","last_fullsized":"2024-09-17T03:43:53.639406+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639480+0000","last_change":"2024-09-17T03:43:53.639480+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639480+0000","last_undegraded":"2024-09-17T03:43:53.639480+0000","last_fullsized":"2024-09-17T03:43:53.639480+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640830+0000","last_change":"2024-09-17T03:43:53.640830+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640830+0000","last_undegraded":"2024-09-17T03:43:53.640830+0000","last_fullsized":"2024-09-17T03:43:53.640830+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637865+0000","last_change":"2024-09-17T03:43:53.637865+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637865+0000","last_undegraded":"2024-09-17T03:43:53.637865+0000","last_fullsized":"2024-09-17T03:43:53.637865+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634598+0000","last_change":"2024-09-17T03:43:53.634598+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634598+0000","last_undegraded":"2024-09-17T03:43:53.634598+0000","last_fullsized":"2024-09-17T03:43:53.634598+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647790+0000","last_change":"2024-09-17T03:43:54.666755+0000","last_active":"2024-09-17T03:43:55.647790+0000","last_peered":"2024-09-17T03:43:55.647790+0000","last_clean":"2024-09-17T03:43:55.647790+0000","last_became_active":"2024-09-17T03:43:54.666432+0000","last_became_peered":"2024-09-17T03:43:54.666432+0000","last_unstale":"2024-09-17T03:43:55.647790+0000","last_undegraded":"2024-09-17T03:43:55.647790+0000","last_fullsized":"2024-09-17T03:43:55.647790+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:05.826937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640033+0000","last_change":"2024-09-17T03:43:53.640033+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640033+0000","last_undegraded":"2024-09-17T03:43:53.640033+0000","last_fullsized":"2024-09-17T03:43:53.640033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638133+0000","last_change":"2024-09-17T03:43:53.638133+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638133+0000","last_undegraded":"2024-09-17T03:43:53.638133+0000","last_fullsized":"2024-09-17T03:43:53.638133+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.633823+0000","last_change":"2024-09-17T03:43:53.633823+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.633823+0000","last_undegraded":"2024-09-17T03:43:53.633823+0000","last_fullsized":"2024-09-17T03:43:53.633823+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.633750+0000","last_change":"2024-09-17T03:43:53.633750+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.633750+0000","last_undegraded":"2024-09-17T03:43:53.633750+0000","last_fullsized":"2024-09-17T03:43:53.633750+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635784+0000","last_change":"2024-09-17T03:43:53.635784+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635784+0000","last_undegraded":"2024-09-17T03:43:53.635784+0000","last_fullsized":"2024-09-17T03:43:53.635784+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983636+0000","last_change":"2024-09-17T03:43:54.663609+0000","last_active":"2024-09-17T03:43:55.983636+0000","last_peered":"2024-09-17T03:43:55.983636+0000","last_clean":"2024-09-17T03:43:55.983636+0000","last_became_active":"2024-09-17T03:43:54.663199+0000","last_became_peered":"2024-09-17T03:43:54.663199+0000","last_unstale":"2024-09-17T03:43:55.983636+0000","last_undegraded":"2024-09-17T03:43:55.983636+0000","last_fullsized":"2024-09-17T03:43:55.983636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:59.078819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634054+0000","last_change":"2024-09-17T03:43:53.634054+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634054+0000","last_undegraded":"2024-09-17T03:43:53.634054+0000","last_fullsized":"2024-09-17T03:43:53.634054+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634542+0000","last_change":"2024-09-17T03:43:53.634542+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634542+0000","last_undegraded":"2024-09-17T03:43:53.634542+0000","last_fullsized":"2024-09-17T03:43:53.634542+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647855+0000","last_change":"2024-09-17T03:43:54.665630+0000","last_active":"2024-09-17T03:43:55.647855+0000","last_peered":"2024-09-17T03:43:55.647855+0000","last_clean":"2024-09-17T03:43:55.647855+0000","last_became_active":"2024-09-17T03:43:54.665303+0000","last_became_peered":"2024-09-17T03:43:54.665303+0000","last_unstale":"2024-09-17T03:43:55.647855+0000","last_undegraded":"2024-09-17T03:43:55.647855+0000","last_fullsized":"2024-09-17T03:43:55.647855+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:34.015909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649282+0000","last_change":"2024-09-17T03:43:53.642888+0000","last_active":"2024-09-17T03:43:53.649282+0000","last_peered":"2024-09-17T03:43:53.649282+0000","last_clean":"2024-09-17T03:43:53.649282+0000","last_became_active":"2024-09-17T03:43:53.642585+0000","last_became_peered":"2024-09-17T03:43:53.642585+0000","last_unstale":"2024-09-17T03:43:53.649282+0000","last_undegraded":"2024-09-17T03:43:53.649282+0000","last_fullsized":"2024-09-17T03:43:53.649282+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:53.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637567+0000","last_change":"2024-09-17T03:43:53.637567+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637567+0000","last_undegraded":"2024-09-17T03:43:53.637567+0000","last_fullsized":"2024-09-17T03:43:53.637567+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984083+0000","last_change":"2024-09-17T03:43:53.647661+0000","last_active":"2024-09-17T03:43:55.984083+0000","last_peered":"2024-09-17T03:43:55.984083+0000","last_clean":"2024-09-17T03:43:55.984083+0000","last_became_active":"2024-09-17T03:43:53.647274+0000","last_became_peered":"2024-09-17T03:43:53.647274+0000","last_unstale":"2024-09-17T03:43:55.984083+0000","last_undegraded":"2024-09-17T03:43:55.984083+0000","last_fullsized":"2024-09-17T03:43:55.984083+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:35.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640246+0000","last_change":"2024-09-17T03:43:53.640246+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640246+0000","last_undegraded":"2024-09-17T03:43:53.640246+0000","last_fullsized":"2024-09-17T03:43:53.640246+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.646357+0000","last_change":"2024-09-17T03:43:53.644185+0000","last_active":"2024-09-17T03:43:53.646357+0000","last_peered":"2024-09-17T03:43:53.646357+0000","last_clean":"2024-09-17T03:43:53.646357+0000","last_became_active":"2024-09-17T03:43:53.643895+0000","last_became_peered":"2024-09-17T03:43:53.643895+0000","last_unstale":"2024-09-17T03:43:53.646357+0000","last_undegraded":"2024-09-17T03:43:53.646357+0000","last_fullsized":"2024-09-17T03:43:53.646357+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:05.871783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984016+0000","last_change":"2024-09-17T03:43:54.663996+0000","last_active":"2024-09-17T03:43:55.984016+0000","last_peered":"2024-09-17T03:43:55.984016+0000","last_clean":"2024-09-17T03:43:55.984016+0000","last_became_active":"2024-09-17T03:43:54.663664+0000","last_became_peered":"2024-09-17T03:43:54.663664+0000","last_unstale":"2024-09-17T03:43:55.984016+0000","last_undegraded":"2024-09-17T03:43:55.984016+0000","last_fullsized":"2024-09-17T03:43:55.984016+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:46.673846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649569+0000","last_change":"2024-09-17T03:43:53.648032+0000","last_active":"2024-09-17T03:43:53.649569+0000","last_peered":"2024-09-17T03:43:53.649569+0000","last_clean":"2024-09-17T03:43:53.649569+0000","last_became_active":"2024-09-17T03:43:53.647737+0000","last_became_peered":"2024-09-17T03:43:53.647737+0000","last_unstale":"2024-09-17T03:43:53.649569+0000","last_undegraded":"2024-09-17T03:43:53.649569+0000","last_fullsized":"2024-09-17T03:43:53.649569+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:16.374027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637382+0000","last_change":"2024-09-17T03:43:53.637382+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637382+0000","last_undegraded":"2024-09-17T03:43:53.637382+0000","last_fullsized":"2024-09-17T03:43:53.637382+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649368+0000","last_change":"2024-09-17T03:43:53.645679+0000","last_active":"2024-09-17T03:43:53.649368+0000","last_peered":"2024-09-17T03:43:53.649368+0000","last_clean":"2024-09-17T03:43:53.649368+0000","last_became_active":"2024-09-17T03:43:53.645360+0000","last_became_peered":"2024-09-17T03:43:53.645360+0000","last_unstale":"2024-09-17T03:43:53.649368+0000","last_undegraded":"2024-09-17T03:43:53.649368+0000","last_fullsized":"2024-09-17T03:43:53.649368+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:11.108836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647690+0000","last_change":"2024-09-17T03:43:54.672348+0000","last_active":"2024-09-17T03:43:55.647690+0000","last_peered":"2024-09-17T03:43:55.647690+0000","last_clean":"2024-09-17T03:43:55.647690+0000","last_became_active":"2024-09-17T03:43:54.670870+0000","last_became_peered":"2024-09-17T03:43:54.670870+0000","last_unstale":"2024-09-17T03:43:55.647690+0000","last_undegraded":"2024-09-17T03:43:55.647690+0000","last_fullsized":"2024-09-17T03:43:55.647690+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:41.754485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647702+0000","last_change":"2024-09-17T03:43:53.643291+0000","last_active":"2024-09-17T03:43:55.647702+0000","last_peered":"2024-09-17T03:43:55.647702+0000","last_clean":"2024-09-17T03:43:55.647702+0000","last_became_active":"2024-09-17T03:43:53.642982+0000","last_became_peered":"2024-09-17T03:43:53.642982+0000","last_unstale":"2024-09-17T03:43:55.647702+0000","last_undegraded":"2024-09-17T03:43:55.647702+0000","last_fullsized":"2024-09-17T03:43:55.647702+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:54.167248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638697+0000","last_change":"2024-09-17T03:43:53.638697+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638697+0000","last_undegraded":"2024-09-17T03:43:53.638697+0000","last_fullsized":"2024-09-17T03:43:53.638697+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653343+0000","last_change":"2024-09-17T03:43:53.652597+0000","last_active":"2024-09-17T03:43:53.653343+0000","last_peered":"2024-09-17T03:43:53.653343+0000","last_clean":"2024-09-17T03:43:53.653343+0000","last_became_active":"2024-09-17T03:43:53.652283+0000","last_became_peered":"2024-09-17T03:43:53.652283+0000","last_unstale":"2024-09-17T03:43:53.653343+0000","last_undegraded":"2024-09-17T03:43:53.653343+0000","last_fullsized":"2024-09-17T03:43:53.653343+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:55.072264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634529+0000","last_change":"2024-09-17T03:43:53.634529+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634529+0000","last_undegraded":"2024-09-17T03:43:53.634529+0000","last_fullsized":"2024-09-17T03:43:53.634529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.650791+0000","last_change":"2024-09-17T03:43:53.647225+0000","last_active":"2024-09-17T03:43:53.650791+0000","last_peered":"2024-09-17T03:43:53.650791+0000","last_clean":"2024-09-17T03:43:53.650791+0000","last_became_active":"2024-09-17T03:43:53.646763+0000","last_became_peered":"2024-09-17T03:43:53.646763+0000","last_unstale":"2024-09-17T03:43:53.650791+0000","last_undegraded":"2024-09-17T03:43:53.650791+0000","last_fullsized":"2024-09-17T03:43:53.650791+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:05.871783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.648113+0000","last_change":"2024-09-17T03:43:54.664068+0000","last_active":"2024-09-17T03:43:55.648113+0000","last_peered":"2024-09-17T03:43:55.648113+0000","last_clean":"2024-09-17T03:43:55.648113+0000","last_became_active":"2024-09-17T03:43:54.663753+0000","last_became_peered":"2024-09-17T03:43:54.663753+0000","last_unstale":"2024-09-17T03:43:55.648113+0000","last_undegraded":"2024-09-17T03:43:55.648113+0000","last_fullsized":"2024-09-17T03:43:55.648113+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:37.532930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649927+0000","last_change":"2024-09-17T03:43:53.648637+0000","last_active":"2024-09-17T03:43:53.649927+0000","last_peered":"2024-09-17T03:43:53.649927+0000","last_clean":"2024-09-17T03:43:53.649927+0000","last_became_active":"2024-09-17T03:43:53.648309+0000","last_became_peered":"2024-09-17T03:43:53.648309+0000","last_unstale":"2024-09-17T03:43:53.649927+0000","last_undegraded":"2024-09-17T03:43:53.649927+0000","last_fullsized":"2024-09-17T03:43:53.649927+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:40.122831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639212+0000","last_change":"2024-09-17T03:43:53.639212+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639212+0000","last_undegraded":"2024-09-17T03:43:53.639212+0000","last_fullsized":"2024-09-17T03:43:53.639212+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653546+0000","last_change":"2024-09-17T03:43:53.653098+0000","last_active":"2024-09-17T03:43:53.653546+0000","last_peered":"2024-09-17T03:43:53.653546+0000","last_clean":"2024-09-17T03:43:53.653546+0000","last_became_active":"2024-09-17T03:43:53.652666+0000","last_became_peered":"2024-09-17T03:43:53.652666+0000","last_unstale":"2024-09-17T03:43:53.653546+0000","last_undegraded":"2024-09-17T03:43:53.653546+0000","last_fullsized":"2024-09-17T03:43:53.653546+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:26.208737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638941+0000","last_change":"2024-09-17T03:43:53.638941+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638941+0000","last_undegraded":"2024-09-17T03:43:53.638941+0000","last_fullsized":"2024-09-17T03:43:53.638941+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.646490+0000","last_change":"2024-09-17T03:43:53.643543+0000","last_active":"2024-09-17T03:43:53.646490+0000","last_peered":"2024-09-17T03:43:53.646490+0000","last_clean":"2024-09-17T03:43:53.646490+0000","last_became_active":"2024-09-17T03:43:53.642998+0000","last_became_peered":"2024-09-17T03:43:53.642998+0000","last_unstale":"2024-09-17T03:43:53.646490+0000","last_undegraded":"2024-09-17T03:43:53.646490+0000","last_fullsized":"2024-09-17T03:43:53.646490+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:20.916357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.633751+0000","last_change":"2024-09-17T03:43:53.633751+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.633751+0000","last_undegraded":"2024-09-17T03:43:53.633751+0000","last_fullsized":"2024-09-17T03:43:53.633751+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.652105+0000","last_change":"2024-09-17T03:43:53.650497+0000","last_active":"2024-09-17T03:43:53.652105+0000","last_peered":"2024-09-17T03:43:53.652105+0000","last_clean":"2024-09-17T03:43:53.652105+0000","last_became_active":"2024-09-17T03:43:53.650200+0000","last_became_peered":"2024-09-17T03:43:53.650200+0000","last_unstale":"2024-09-17T03:43:53.652105+0000","last_undegraded":"2024-09-17T03:43:53.652105+0000","last_fullsized":"2024-09-17T03:43:53.652105+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:21.394716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638286+0000","last_change":"2024-09-17T03:43:53.638286+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638286+0000","last_undegraded":"2024-09-17T03:43:53.638286+0000","last_fullsized":"2024-09-17T03:43:53.638286+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.650344+0000","last_change":"2024-09-17T03:43:53.648900+0000","last_active":"2024-09-17T03:43:53.650344+0000","last_peered":"2024-09-17T03:43:53.650344+0000","last_clean":"2024-09-17T03:43:53.650344+0000","last_became_active":"2024-09-17T03:43:53.648385+0000","last_became_peered":"2024-09-17T03:43:53.648385+0000","last_unstale":"2024-09-17T03:43:53.650344+0000","last_undegraded":"2024-09-17T03:43:53.650344+0000","last_fullsized":"2024-09-17T03:43:53.650344+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:26.061975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983703+0000","last_change":"2024-09-17T03:43:54.665253+0000","last_active":"2024-09-17T03:43:55.983703+0000","last_peered":"2024-09-17T03:43:55.983703+0000","last_clean":"2024-09-17T03:43:55.983703+0000","last_became_active":"2024-09-17T03:43:54.664937+0000","last_became_peered":"2024-09-17T03:43:54.664937+0000","last_unstale":"2024-09-17T03:43:55.983703+0000","last_undegraded":"2024-09-17T03:43:55.983703+0000","last_fullsized":"2024-09-17T03:43:55.983703+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:01.731823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647291+0000","last_change":"2024-09-17T03:43:53.647484+0000","last_active":"2024-09-17T03:43:55.647291+0000","last_peered":"2024-09-17T03:43:55.647291+0000","last_clean":"2024-09-17T03:43:55.647291+0000","last_became_active":"2024-09-17T03:43:53.647194+0000","last_became_peered":"2024-09-17T03:43:53.647194+0000","last_unstale":"2024-09-17T03:43:55.647291+0000","last_undegraded":"2024-09-17T03:43:55.647291+0000","last_fullsized":"2024-09-17T03:43:55.647291+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:20.612852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638176+0000","last_change":"2024-09-17T03:43:53.638176+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638176+0000","last_undegraded":"2024-09-17T03:43:53.638176+0000","last_fullsized":"2024-09-17T03:43:53.638176+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653176+0000","last_change":"2024-09-17T03:43:53.652497+0000","last_active":"2024-09-17T03:43:53.653176+0000","last_peered":"2024-09-17T03:43:53.653176+0000","last_clean":"2024-09-17T03:43:53.653176+0000","last_became_active":"2024-09-17T03:43:53.651068+0000","last_became_peered":"2024-09-17T03:43:53.651068+0000","last_unstale":"2024-09-17T03:43:53.653176+0000","last_undegraded":"2024-09-17T03:43:53.653176+0000","last_fullsized":"2024-09-17T03:43:53.653176+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:04.341701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637266+0000","last_change":"2024-09-17T03:43:53.637266+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637266+0000","last_undegraded":"2024-09-17T03:43:53.637266+0000","last_fullsized":"2024-09-17T03:43:53.637266+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649313+0000","last_change":"2024-09-17T03:43:53.643934+0000","last_active":"2024-09-17T03:43:53.649313+0000","last_peered":"2024-09-17T03:43:53.649313+0000","last_clean":"2024-09-17T03:43:53.649313+0000","last_became_active":"2024-09-17T03:43:53.643624+0000","last_became_peered":"2024-09-17T03:43:53.643624+0000","last_unstale":"2024-09-17T03:43:53.649313+0000","last_undegraded":"2024-09-17T03:43:53.649313+0000","last_fullsized":"2024-09-17T03:43:53.649313+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:25.977167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984066+0000","last_change":"2024-09-17T03:43:54.671058+0000","last_active":"2024-09-17T03:43:55.984066+0000","last_peered":"2024-09-17T03:43:55.984066+0000","last_clean":"2024-09-17T03:43:55.984066+0000","last_became_active":"2024-09-17T03:43:54.670052+0000","last_became_peered":"2024-09-17T03:43:54.670052+0000","last_unstale":"2024-09-17T03:43:55.984066+0000","last_undegraded":"2024-09-17T03:43:55.984066+0000","last_fullsized":"2024-09-17T03:43:55.984066+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:29.400392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647787+0000","last_change":"2024-09-17T03:43:53.649241+0000","last_active":"2024-09-17T03:43:55.647787+0000","last_peered":"2024-09-17T03:43:55.647787+0000","last_clean":"2024-09-17T03:43:55.647787+0000","last_became_active":"2024-09-17T03:43:53.648942+0000","last_became_peered":"2024-09-17T03:43:53.648942+0000","last_unstale":"2024-09-17T03:43:55.647787+0000","last_undegraded":"2024-09-17T03:43:55.647787+0000","last_fullsized":"2024-09-17T03:43:55.647787+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983902+0000","last_change":"2024-09-17T03:43:54.662331+0000","last_active":"2024-09-17T03:43:55.983902+0000","last_peered":"2024-09-17T03:43:55.983902+0000","last_clean":"2024-09-17T03:43:55.983902+0000","last_became_active":"2024-09-17T03:43:54.661020+0000","last_became_peered":"2024-09-17T03:43:54.661020+0000","last_unstale":"2024-09-17T03:43:55.983902+0000","last_undegraded":"2024-09-17T03:43:55.983902+0000","last_fullsized":"2024-09-17T03:43:55.983902+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:48.585042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.652175+0000","last_change":"2024-09-17T03:43:53.651532+0000","last_active":"2024-09-17T03:43:53.652175+0000","last_peered":"2024-09-17T03:43:53.652175+0000","last_clean":"2024-09-17T03:43:53.652175+0000","last_became_active":"2024-09-17T03:43:53.651190+0000","last_became_peered":"2024-09-17T03:43:53.651190+0000","last_unstale":"2024-09-17T03:43:53.652175+0000","last_undegraded":"2024-09-17T03:43:53.652175+0000","last_fullsized":"2024-09-17T03:43:53.652175+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:13.978089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639534+0000","last_change":"2024-09-17T03:43:53.639534+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639534+0000","last_undegraded":"2024-09-17T03:43:53.639534+0000","last_fullsized":"2024-09-17T03:43:53.639534+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.648583+0000","last_change":"2024-09-17T03:43:53.646384+0000","last_active":"2024-09-17T03:43:53.648583+0000","last_peered":"2024-09-17T03:43:53.648583+0000","last_clean":"2024-09-17T03:43:53.648583+0000","last_became_active":"2024-09-17T03:43:53.646041+0000","last_became_peered":"2024-09-17T03:43:53.646041+0000","last_unstale":"2024-09-17T03:43:53.648583+0000","last_undegraded":"2024-09-17T03:43:53.648583+0000","last_fullsized":"2024-09-17T03:43:53.648583+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:20.916357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636893+0000","last_change":"2024-09-17T03:43:53.636893+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636893+0000","last_undegraded":"2024-09-17T03:43:53.636893+0000","last_fullsized":"2024-09-17T03:43:53.636893+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649283+0000","last_change":"2024-09-17T03:43:53.645944+0000","last_active":"2024-09-17T03:43:53.649283+0000","last_peered":"2024-09-17T03:43:53.649283+0000","last_clean":"2024-09-17T03:43:53.649283+0000","last_became_active":"2024-09-17T03:43:53.645640+0000","last_became_peered":"2024-09-17T03:43:53.645640+0000","last_unstale":"2024-09-17T03:43:53.649283+0000","last_undegraded":"2024-09-17T03:43:53.649283+0000","last_fullsized":"2024-09-17T03:43:53.649283+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:27.524711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637653+0000","last_change":"2024-09-17T03:43:53.637653+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637653+0000","last_undegraded":"2024-09-17T03:43:53.637653+0000","last_fullsized":"2024-09-17T03:43:53.637653+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649893+0000","last_change":"2024-09-17T03:43:53.648560+0000","last_active":"2024-09-17T03:43:53.649893+0000","last_peered":"2024-09-17T03:43:53.649893+0000","last_clean":"2024-09-17T03:43:53.649893+0000","last_became_active":"2024-09-17T03:43:53.648255+0000","last_became_peered":"2024-09-17T03:43:53.648255+0000","last_unstale":"2024-09-17T03:43:53.649893+0000","last_undegraded":"2024-09-17T03:43:53.649893+0000","last_fullsized":"2024-09-17T03:43:53.649893+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:04.159623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640284+0000","last_change":"2024-09-17T03:43:53.640284+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640284+0000","last_undegraded":"2024-09-17T03:43:53.640284+0000","last_fullsized":"2024-09-17T03:43:53.640284+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649600+0000","last_change":"2024-09-17T03:43:53.647435+0000","last_active":"2024-09-17T03:43:53.649600+0000","last_peered":"2024-09-17T03:43:53.649600+0000","last_clean":"2024-09-17T03:43:53.649600+0000","last_became_active":"2024-09-17T03:43:53.647090+0000","last_became_peered":"2024-09-17T03:43:53.647090+0000","last_unstale":"2024-09-17T03:43:53.649600+0000","last_undegraded":"2024-09-17T03:43:53.649600+0000","last_fullsized":"2024-09-17T03:43:53.649600+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:07.644765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.643498+0000","last_change":"2024-09-17T03:43:53.643498+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.643498+0000","last_undegraded":"2024-09-17T03:43:53.643498+0000","last_fullsized":"2024-09-17T03:43:53.643498+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983757+0000","last_change":"2024-09-17T03:43:53.650612+0000","last_active":"2024-09-17T03:43:55.983757+0000","last_peered":"2024-09-17T03:43:55.983757+0000","last_clean":"2024-09-17T03:43:55.983757+0000","last_became_active":"2024-09-17T03:43:53.650247+0000","last_became_peered":"2024-09-17T03:43:53.650247+0000","last_unstale":"2024-09-17T03:43:55.983757+0000","last_undegraded":"2024-09-17T03:43:55.983757+0000","last_fullsized":"2024-09-17T03:43:55.983757+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:11.707083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634165+0000","last_change":"2024-09-17T03:43:53.634165+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634165+0000","last_undegraded":"2024-09-17T03:43:53.634165+0000","last_fullsized":"2024-09-17T03:43:53.634165+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653158+0000","last_change":"2024-09-17T03:43:53.652033+0000","last_active":"2024-09-17T03:43:53.653158+0000","last_peered":"2024-09-17T03:43:53.653158+0000","last_clean":"2024-09-17T03:43:53.653158+0000","last_became_active":"2024-09-17T03:43:53.651598+0000","last_became_peered":"2024-09-17T03:43:53.651598+0000","last_unstale":"2024-09-17T03:43:53.653158+0000","last_undegraded":"2024-09-17T03:43:53.653158+0000","last_fullsized":"2024-09-17T03:43:53.653158+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:54.720646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637062+0000","last_change":"2024-09-17T03:43:53.637062+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637062+0000","last_undegraded":"2024-09-17T03:43:53.637062+0000","last_fullsized":"2024-09-17T03:43:53.637062+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.651661+0000","last_change":"2024-09-17T03:43:53.650894+0000","last_active":"2024-09-17T03:43:53.651661+0000","last_peered":"2024-09-17T03:43:53.651661+0000","last_clean":"2024-09-17T03:43:53.651661+0000","last_became_active":"2024-09-17T03:43:53.650585+0000","last_became_peered":"2024-09-17T03:43:53.650585+0000","last_unstale":"2024-09-17T03:43:53.651661+0000","last_undegraded":"2024-09-17T03:43:53.651661+0000","last_fullsized":"2024-09-17T03:43:53.651661+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:32.571954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647562+0000","last_change":"2024-09-17T03:43:54.668026+0000","last_active":"2024-09-17T03:43:55.647562+0000","last_peered":"2024-09-17T03:43:55.647562+0000","last_clean":"2024-09-17T03:43:55.647562+0000","last_became_active":"2024-09-17T03:43:54.667733+0000","last_became_peered":"2024-09-17T03:43:54.667733+0000","last_unstale":"2024-09-17T03:43:55.647562+0000","last_undegraded":"2024-09-17T03:43:55.647562+0000","last_fullsized":"2024-09-17T03:43:55.647562+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:29.670536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.650843+0000","last_change":"2024-09-17T03:43:53.649967+0000","last_active":"2024-09-17T03:43:53.650843+0000","last_peered":"2024-09-17T03:43:53.650843+0000","last_clean":"2024-09-17T03:43:53.650843+0000","last_became_active":"2024-09-17T03:43:53.649642+0000","last_became_peered":"2024-09-17T03:43:53.649642+0000","last_unstale":"2024-09-17T03:43:53.650843+0000","last_undegraded":"2024-09-17T03:43:53.650843+0000","last_fullsized":"2024-09-17T03:43:53.650843+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:00.932873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647921+0000","last_change":"2024-09-17T03:43:54.666057+0000","last_active":"2024-09-17T03:43:55.647921+0000","last_peered":"2024-09-17T03:43:55.647921+0000","last_clean":"2024-09-17T03:43:55.647921+0000","last_became_active":"2024-09-17T03:43:54.665692+0000","last_became_peered":"2024-09-17T03:43:54.665692+0000","last_unstale":"2024-09-17T03:43:55.647921+0000","last_undegraded":"2024-09-17T03:43:55.647921+0000","last_fullsized":"2024-09-17T03:43:55.647921+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:35.834253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647451+0000","last_change":"2024-09-17T03:43:53.648302+0000","last_active":"2024-09-17T03:43:55.647451+0000","last_peered":"2024-09-17T03:43:55.647451+0000","last_clean":"2024-09-17T03:43:55.647451+0000","last_became_active":"2024-09-17T03:43:53.647956+0000","last_became_peered":"2024-09-17T03:43:53.647956+0000","last_unstale":"2024-09-17T03:43:55.647451+0000","last_undegraded":"2024-09-17T03:43:55.647451+0000","last_fullsized":"2024-09-17T03:43:55.647451+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:06.888162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640232+0000","last_change":"2024-09-17T03:43:53.640232+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640232+0000","last_undegraded":"2024-09-17T03:43:53.640232+0000","last_fullsized":"2024-09-17T03:43:53.640232+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983991+0000","last_change":"2024-09-17T03:43:53.646019+0000","last_active":"2024-09-17T03:43:55.983991+0000","last_peered":"2024-09-17T03:43:55.983991+0000","last_clean":"2024-09-17T03:43:55.983991+0000","last_became_active":"2024-09-17T03:43:53.645555+0000","last_became_peered":"2024-09-17T03:43:53.645555+0000","last_unstale":"2024-09-17T03:43:55.983991+0000","last_undegraded":"2024-09-17T03:43:55.983991+0000","last_fullsized":"2024-09-17T03:43:55.983991+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:12.150493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.641592+0000","last_change":"2024-09-17T03:43:53.641592+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.641592+0000","last_undegraded":"2024-09-17T03:43:53.641592+0000","last_fullsized":"2024-09-17T03:43:53.641592+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983792+0000","last_change":"2024-09-17T03:43:53.648330+0000","last_active":"2024-09-17T03:43:55.983792+0000","last_peered":"2024-09-17T03:43:55.983792+0000","last_clean":"2024-09-17T03:43:55.983792+0000","last_became_active":"2024-09-17T03:43:53.648045+0000","last_became_peered":"2024-09-17T03:43:53.648045+0000","last_unstale":"2024-09-17T03:43:55.983792+0000","last_undegraded":"2024-09-17T03:43:55.983792+0000","last_fullsized":"2024-09-17T03:43:55.983792+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:26.973084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639774+0000","last_change":"2024-09-17T03:43:53.639774+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639774+0000","last_undegraded":"2024-09-17T03:43:53.639774+0000","last_fullsized":"2024-09-17T03:43:53.639774+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649737+0000","last_change":"2024-09-17T03:43:53.648567+0000","last_active":"2024-09-17T03:43:53.649737+0000","last_peered":"2024-09-17T03:43:53.649737+0000","last_clean":"2024-09-17T03:43:53.649737+0000","last_became_active":"2024-09-17T03:43:53.648198+0000","last_became_peered":"2024-09-17T03:43:53.648198+0000","last_unstale":"2024-09-17T03:43:53.649737+0000","last_undegraded":"2024-09-17T03:43:53.649737+0000","last_fullsized":"2024-09-17T03:43:53.649737+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:45.353160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634696+0000","last_change":"2024-09-17T03:43:53.634696+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634696+0000","last_undegraded":"2024-09-17T03:43:53.634696+0000","last_fullsized":"2024-09-17T03:43:53.634696+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.640773+0000","last_change":"2024-09-17T03:43:53.636144+0000","last_active":"2024-09-17T03:43:53.640773+0000","last_peered":"2024-09-17T03:43:53.640773+0000","last_clean":"2024-09-17T03:43:53.640773+0000","last_became_active":"2024-09-17T03:43:53.635853+0000","last_became_peered":"2024-09-17T03:43:53.635853+0000","last_unstale":"2024-09-17T03:43:53.640773+0000","last_undegraded":"2024-09-17T03:43:53.640773+0000","last_fullsized":"2024-09-17T03:43:53.640773+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:25.838359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637757+0000","last_change":"2024-09-17T03:43:53.637757+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637757+0000","last_undegraded":"2024-09-17T03:43:53.637757+0000","last_fullsized":"2024-09-17T03:43:53.637757+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.652056+0000","last_change":"2024-09-17T03:43:53.650336+0000","last_active":"2024-09-17T03:43:53.652056+0000","last_peered":"2024-09-17T03:43:53.652056+0000","last_clean":"2024-09-17T03:43:53.652056+0000","last_became_active":"2024-09-17T03:43:53.649990+0000","last_became_peered":"2024-09-17T03:43:53.649990+0000","last_unstale":"2024-09-17T03:43:53.652056+0000","last_undegraded":"2024-09-17T03:43:53.652056+0000","last_fullsized":"2024-09-17T03:43:53.652056+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:01.238542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":371,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.643514+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:43:53.643514+0000","last_peered":"2024-09-17T03:43:53.643514+0000","last_clean":"2024-09-17T03:43:53.643514+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:43:53.643514+0000","last_undegraded":"2024-09-17T03:43:53.643514+0000","last_fullsized":"2024-09-17T03:43:53.643514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509577,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60140,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311700,"statfs":{"total":96636764160,"available":96575180800,"internally_reserved":0,"allocated":2637824,"data_stored":1487753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509577,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59556,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312284,"statfs":{"total":96636764160,"available":96575778816,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509577,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63716,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308124,"statfs":{"total":96636764160,"available":96571518976,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509577,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55396,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316444,"statfs":{"total":96636764160,"available":96580038656,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509578,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55396,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316444,"statfs":{"total":96636764160,"available":96580038656,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51816,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320024,"statfs":{"total":96636764160,"available":96583704576,"internally_reserved":0,"allocated":2637824,"data_stored":1487753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55416,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316424,"statfs":{"total":96636764160,"available":96580018176,"internally_reserved":0,"allocated":2068480,"data_stored":910460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55436,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316404,"statfs":{"total":96636764160,"available":96579997696,"internally_reserved":0,"allocated":2080768,"data_stored":910654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:43:58.674 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:43:58.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.823+0000 7f8f65d7b640 1 -- 172.21.15.146:0/3273259527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f600cdc50 msgr2=0x7f8f600b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.823+0000 7f8f65d7b640 1 --2- 172.21.15.146:0/3273259527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f600cdc50 0x7f8f600b4ba0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8f58005fd0 tx=0x7f8f5802aa10 comp rx=0 tx=0).stop 2024-09-17T03:43:58.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.823+0000 7f8f65d7b640 1 -- 172.21.15.146:0/3273259527 shutdown_connections 2024-09-17T03:43:58.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.823+0000 7f8f65d7b640 1 --2- 172.21.15.146:0/3273259527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f600cdc50 0x7f8f600b4ba0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.823+0000 7f8f65d7b640 1 --2- 172.21.15.146:0/3273259527 >> v2:172.21.15.179:3300/0 conn(0x7f8f6015c8e0 0x7f8f6006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.823+0000 7f8f65d7b640 1 -- 172.21.15.146:0/3273259527 >> 172.21.15.146:0/3273259527 conn(0x7f8f600b3150 msgr2=0x7f8f600b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:58.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.823+0000 7f8f65d7b640 1 -- 172.21.15.146:0/3273259527 shutdown_connections 2024-09-17T03:43:58.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.823+0000 7f8f65d7b640 1 -- 172.21.15.146:0/3273259527 wait complete. 2024-09-17T03:43:58.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.825+0000 7f8f65d7b640 1 Processor -- start 2024-09-17T03:43:58.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.825+0000 7f8f65d7b640 1 -- start start 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.826+0000 7f8f65d7b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f600cd840 0x7f8f60151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.826+0000 7f8f65d7b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f600cdc50 0x7f8f60142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.826+0000 7f8f65d7b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f6015c8e0 0x7f8f60156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.826+0000 7f8f65d7b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8f60073580 con 0x7f8f600cdc50 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.826+0000 7f8f65d7b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8f600b5460 con 0x7f8f6015c8e0 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.826+0000 7f8f65d7b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8f60073700 con 0x7f8f600cd840 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f5effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f600cdc50 0x7f8f60142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f5effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f600cdc50 0x7f8f60142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43868/0 (socket says 172.21.15.146:43868) 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f5effd640 1 -- 172.21.15.146:0/2609490112 learned_addr learned my addr 172.21.15.146:0/2609490112 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f5ffff640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f6015c8e0 0x7f8f60156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f5f7fe640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f600cd840 0x7f8f60151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f5effd640 1 -- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f600cd840 msgr2=0x7f8f60151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f5effd640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f600cd840 0x7f8f60151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f5effd640 1 -- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f6015c8e0 msgr2=0x7f8f60156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f5effd640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f6015c8e0 0x7f8f60156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f5effd640 1 -- 172.21.15.146:0/2609490112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f60151840 con 0x7f8f600cdc50 2024-09-17T03:43:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f5effd640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f600cdc50 0x7f8f60142d80 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400e690 tx=0x7f8f5400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f47fff640 1 -- 172.21.15.146:0/2609490112 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f540052d0 con 0x7f8f600cdc50 2024-09-17T03:43:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f47fff640 1 -- 172.21.15.146:0/2609490112 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f540016c0 con 0x7f8f600cdc50 2024-09-17T03:43:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f65d7b640 1 -- 172.21.15.146:0/2609490112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f60150260 con 0x7f8f600cdc50 2024-09-17T03:43:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f47fff640 1 -- 172.21.15.146:0/2609490112 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54001af0 con 0x7f8f600cdc50 2024-09-17T03:43:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.827+0000 7f8f65d7b640 1 -- 172.21.15.146:0/2609490112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f60150820 con 0x7f8f600cdc50 2024-09-17T03:43:58.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.829+0000 7f8f65d7b640 1 -- 172.21.15.146:0/2609490112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f600b4ba0 con 0x7f8f600cdc50 2024-09-17T03:43:58.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.829+0000 7f8f47fff640 1 -- 172.21.15.146:0/2609490112 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f540035f0 con 0x7f8f600cdc50 2024-09-17T03:43:58.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.829+0000 7f8f47fff640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f4c078b90 0x7f8f4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.829+0000 7f8f47fff640 1 -- 172.21.15.146:0/2609490112 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f8f5409d3a0 con 0x7f8f600cdc50 2024-09-17T03:43:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.830+0000 7f8f5f7fe640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f4c078b90 0x7f8f4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.830+0000 7f8f5f7fe640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f4c078b90 0x7f8f4c07b0a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8f500095f0 tx=0x7f8f50005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:58.834 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:58.834+0000 7f8f47fff640 1 -- 172.21.15.146:0/2609490112 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f54016020 con 0x7f8f600cdc50 2024-09-17T03:43:59.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.005+0000 7f8f65d7b640 1 -- 172.21.15.146:0/2609490112 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f6015eac0 con 0x7f8f4c078b90 2024-09-17T03:43:59.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.010+0000 7f8f47fff640 1 -- 172.21.15.146:0/2609490112 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248359 (secure 0 0 0) 0x7f8f6015eac0 con 0x7f8f4c078b90 2024-09-17T03:43:59.013 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:59.014 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:43:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.013+0000 7f8f65d7b640 1 -- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f4c078b90 msgr2=0x7f8f4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.013+0000 7f8f65d7b640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f4c078b90 0x7f8f4c07b0a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8f500095f0 tx=0x7f8f50005f90 comp rx=0 tx=0).stop 2024-09-17T03:43:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.013+0000 7f8f65d7b640 1 -- 172.21.15.146:0/2609490112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f600cdc50 msgr2=0x7f8f60142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.013+0000 7f8f65d7b640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f600cdc50 0x7f8f60142d80 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400e690 tx=0x7f8f5400eb50 comp rx=0 tx=0).stop 2024-09-17T03:43:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.013+0000 7f8f65d7b640 1 -- 172.21.15.146:0/2609490112 shutdown_connections 2024-09-17T03:43:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.013+0000 7f8f65d7b640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8f4c078b90 0x7f8f4c07b0a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.013+0000 7f8f65d7b640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8f6015c8e0 0x7f8f60156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.013+0000 7f8f65d7b640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f600cdc50 0x7f8f60142d80 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.013+0000 7f8f65d7b640 1 --2- 172.21.15.146:0/2609490112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8f600cd840 0x7f8f60151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.013+0000 7f8f65d7b640 1 -- 172.21.15.146:0/2609490112 >> 172.21.15.146:0/2609490112 conn(0x7f8f600b3150 msgr2=0x7f8f600d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:59.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.014+0000 7f8f65d7b640 1 -- 172.21.15.146:0/2609490112 shutdown_connections 2024-09-17T03:43:59.017 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.014+0000 7f8f65d7b640 1 -- 172.21.15.146:0/2609490112 wait complete. 2024-09-17T03:43:59.025 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":494,"stamp":"2024-09-17T03:43:57.965540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":104,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":456872,"kb_used_data":17188,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754517848,"statfs":{"total":773094113280,"available":772626276352,"internally_reserved":0,"allocated":17600512,"data_stored":8386160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.335168"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.643650+0000","last_change":"2024-09-17T03:43:53.643650+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.643650+0000","last_undegraded":"2024-09-17T03:43:53.643650+0000","last_fullsized":"2024-09-17T03:43:53.643650+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638475+0000","last_change":"2024-09-17T03:43:53.638475+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638475+0000","last_undegraded":"2024-09-17T03:43:53.638475+0000","last_fullsized":"2024-09-17T03:43:53.638475+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635612+0000","last_change":"2024-09-17T03:43:53.635612+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635612+0000","last_undegraded":"2024-09-17T03:43:53.635612+0000","last_fullsized":"2024-09-17T03:43:53.635612+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636821+0000","last_change":"2024-09-17T03:43:53.636821+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636821+0000","last_undegraded":"2024-09-17T03:43:53.636821+0000","last_fullsized":"2024-09-17T03:43:53.636821+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.641313+0000","last_change":"2024-09-17T03:43:53.641313+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.641313+0000","last_undegraded":"2024-09-17T03:43:53.641313+0000","last_fullsized":"2024-09-17T03:43:53.641313+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635123+0000","last_change":"2024-09-17T03:43:53.635123+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635123+0000","last_undegraded":"2024-09-17T03:43:53.635123+0000","last_fullsized":"2024-09-17T03:43:53.635123+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639696+0000","last_change":"2024-09-17T03:43:53.639696+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639696+0000","last_undegraded":"2024-09-17T03:43:53.639696+0000","last_fullsized":"2024-09-17T03:43:53.639696+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647561+0000","last_change":"2024-09-17T03:43:54.655319+0000","last_active":"2024-09-17T03:43:55.647561+0000","last_peered":"2024-09-17T03:43:55.647561+0000","last_clean":"2024-09-17T03:43:55.647561+0000","last_became_active":"2024-09-17T03:43:54.655022+0000","last_became_peered":"2024-09-17T03:43:54.655022+0000","last_unstale":"2024-09-17T03:43:55.647561+0000","last_undegraded":"2024-09-17T03:43:55.647561+0000","last_fullsized":"2024-09-17T03:43:55.647561+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:19.101578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984059+0000","last_change":"2024-09-17T03:43:54.667783+0000","last_active":"2024-09-17T03:43:55.984059+0000","last_peered":"2024-09-17T03:43:55.984059+0000","last_clean":"2024-09-17T03:43:55.984059+0000","last_became_active":"2024-09-17T03:43:54.667437+0000","last_became_peered":"2024-09-17T03:43:54.667437+0000","last_unstale":"2024-09-17T03:43:55.984059+0000","last_undegraded":"2024-09-17T03:43:55.984059+0000","last_fullsized":"2024-09-17T03:43:55.984059+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:40.158899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637798+0000","last_change":"2024-09-17T03:43:53.637798+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637798+0000","last_undegraded":"2024-09-17T03:43:53.637798+0000","last_fullsized":"2024-09-17T03:43:53.637798+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639578+0000","last_change":"2024-09-17T03:43:53.639578+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639578+0000","last_undegraded":"2024-09-17T03:43:53.639578+0000","last_fullsized":"2024-09-17T03:43:53.639578+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636288+0000","last_change":"2024-09-17T03:43:53.636288+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636288+0000","last_undegraded":"2024-09-17T03:43:53.636288+0000","last_fullsized":"2024-09-17T03:43:53.636288+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636418+0000","last_change":"2024-09-17T03:43:53.636418+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636418+0000","last_undegraded":"2024-09-17T03:43:53.636418+0000","last_fullsized":"2024-09-17T03:43:53.636418+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983964+0000","last_change":"2024-09-17T03:43:54.667596+0000","last_active":"2024-09-17T03:43:55.983964+0000","last_peered":"2024-09-17T03:43:55.983964+0000","last_clean":"2024-09-17T03:43:55.983964+0000","last_became_active":"2024-09-17T03:43:54.667088+0000","last_became_peered":"2024-09-17T03:43:54.667088+0000","last_unstale":"2024-09-17T03:43:55.983964+0000","last_undegraded":"2024-09-17T03:43:55.983964+0000","last_fullsized":"2024-09-17T03:43:55.983964+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:25.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637365+0000","last_change":"2024-09-17T03:43:53.637365+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637365+0000","last_undegraded":"2024-09-17T03:43:53.637365+0000","last_fullsized":"2024-09-17T03:43:53.637365+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647641+0000","last_change":"2024-09-17T03:43:54.665060+0000","last_active":"2024-09-17T03:43:55.647641+0000","last_peered":"2024-09-17T03:43:55.647641+0000","last_clean":"2024-09-17T03:43:55.647641+0000","last_became_active":"2024-09-17T03:43:54.664742+0000","last_became_peered":"2024-09-17T03:43:54.664742+0000","last_unstale":"2024-09-17T03:43:55.647641+0000","last_undegraded":"2024-09-17T03:43:55.647641+0000","last_fullsized":"2024-09-17T03:43:55.647641+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:45.262140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635178+0000","last_change":"2024-09-17T03:43:53.635178+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635178+0000","last_undegraded":"2024-09-17T03:43:53.635178+0000","last_fullsized":"2024-09-17T03:43:53.635178+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640752+0000","last_change":"2024-09-17T03:43:53.640752+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640752+0000","last_undegraded":"2024-09-17T03:43:53.640752+0000","last_fullsized":"2024-09-17T03:43:53.640752+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639406+0000","last_change":"2024-09-17T03:43:53.639406+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639406+0000","last_undegraded":"2024-09-17T03:43:53.639406+0000","last_fullsized":"2024-09-17T03:43:53.639406+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639480+0000","last_change":"2024-09-17T03:43:53.639480+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639480+0000","last_undegraded":"2024-09-17T03:43:53.639480+0000","last_fullsized":"2024-09-17T03:43:53.639480+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640830+0000","last_change":"2024-09-17T03:43:53.640830+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640830+0000","last_undegraded":"2024-09-17T03:43:53.640830+0000","last_fullsized":"2024-09-17T03:43:53.640830+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637865+0000","last_change":"2024-09-17T03:43:53.637865+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637865+0000","last_undegraded":"2024-09-17T03:43:53.637865+0000","last_fullsized":"2024-09-17T03:43:53.637865+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634598+0000","last_change":"2024-09-17T03:43:53.634598+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634598+0000","last_undegraded":"2024-09-17T03:43:53.634598+0000","last_fullsized":"2024-09-17T03:43:53.634598+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647790+0000","last_change":"2024-09-17T03:43:54.666755+0000","last_active":"2024-09-17T03:43:55.647790+0000","last_peered":"2024-09-17T03:43:55.647790+0000","last_clean":"2024-09-17T03:43:55.647790+0000","last_became_active":"2024-09-17T03:43:54.666432+0000","last_became_peered":"2024-09-17T03:43:54.666432+0000","last_unstale":"2024-09-17T03:43:55.647790+0000","last_undegraded":"2024-09-17T03:43:55.647790+0000","last_fullsized":"2024-09-17T03:43:55.647790+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:05.826937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640033+0000","last_change":"2024-09-17T03:43:53.640033+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640033+0000","last_undegraded":"2024-09-17T03:43:53.640033+0000","last_fullsized":"2024-09-17T03:43:53.640033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638133+0000","last_change":"2024-09-17T03:43:53.638133+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638133+0000","last_undegraded":"2024-09-17T03:43:53.638133+0000","last_fullsized":"2024-09-17T03:43:53.638133+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.633823+0000","last_change":"2024-09-17T03:43:53.633823+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.633823+0000","last_undegraded":"2024-09-17T03:43:53.633823+0000","last_fullsized":"2024-09-17T03:43:53.633823+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.633750+0000","last_change":"2024-09-17T03:43:53.633750+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.633750+0000","last_undegraded":"2024-09-17T03:43:53.633750+0000","last_fullsized":"2024-09-17T03:43:53.633750+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635784+0000","last_change":"2024-09-17T03:43:53.635784+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635784+0000","last_undegraded":"2024-09-17T03:43:53.635784+0000","last_fullsized":"2024-09-17T03:43:53.635784+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983636+0000","last_change":"2024-09-17T03:43:54.663609+0000","last_active":"2024-09-17T03:43:55.983636+0000","last_peered":"2024-09-17T03:43:55.983636+0000","last_clean":"2024-09-17T03:43:55.983636+0000","last_became_active":"2024-09-17T03:43:54.663199+0000","last_became_peered":"2024-09-17T03:43:54.663199+0000","last_unstale":"2024-09-17T03:43:55.983636+0000","last_undegraded":"2024-09-17T03:43:55.983636+0000","last_fullsized":"2024-09-17T03:43:55.983636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:59.078819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634054+0000","last_change":"2024-09-17T03:43:53.634054+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634054+0000","last_undegraded":"2024-09-17T03:43:53.634054+0000","last_fullsized":"2024-09-17T03:43:53.634054+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634542+0000","last_change":"2024-09-17T03:43:53.634542+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634542+0000","last_undegraded":"2024-09-17T03:43:53.634542+0000","last_fullsized":"2024-09-17T03:43:53.634542+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647855+0000","last_change":"2024-09-17T03:43:54.665630+0000","last_active":"2024-09-17T03:43:55.647855+0000","last_peered":"2024-09-17T03:43:55.647855+0000","last_clean":"2024-09-17T03:43:55.647855+0000","last_became_active":"2024-09-17T03:43:54.665303+0000","last_became_peered":"2024-09-17T03:43:54.665303+0000","last_unstale":"2024-09-17T03:43:55.647855+0000","last_undegraded":"2024-09-17T03:43:55.647855+0000","last_fullsized":"2024-09-17T03:43:55.647855+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:34.015909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649282+0000","last_change":"2024-09-17T03:43:53.642888+0000","last_active":"2024-09-17T03:43:53.649282+0000","last_peered":"2024-09-17T03:43:53.649282+0000","last_clean":"2024-09-17T03:43:53.649282+0000","last_became_active":"2024-09-17T03:43:53.642585+0000","last_became_peered":"2024-09-17T03:43:53.642585+0000","last_unstale":"2024-09-17T03:43:53.649282+0000","last_undegraded":"2024-09-17T03:43:53.649282+0000","last_fullsized":"2024-09-17T03:43:53.649282+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:53.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637567+0000","last_change":"2024-09-17T03:43:53.637567+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637567+0000","last_undegraded":"2024-09-17T03:43:53.637567+0000","last_fullsized":"2024-09-17T03:43:53.637567+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984083+0000","last_change":"2024-09-17T03:43:53.647661+0000","last_active":"2024-09-17T03:43:55.984083+0000","last_peered":"2024-09-17T03:43:55.984083+0000","last_clean":"2024-09-17T03:43:55.984083+0000","last_became_active":"2024-09-17T03:43:53.647274+0000","last_became_peered":"2024-09-17T03:43:53.647274+0000","last_unstale":"2024-09-17T03:43:55.984083+0000","last_undegraded":"2024-09-17T03:43:55.984083+0000","last_fullsized":"2024-09-17T03:43:55.984083+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:35.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640246+0000","last_change":"2024-09-17T03:43:53.640246+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640246+0000","last_undegraded":"2024-09-17T03:43:53.640246+0000","last_fullsized":"2024-09-17T03:43:53.640246+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.646357+0000","last_change":"2024-09-17T03:43:53.644185+0000","last_active":"2024-09-17T03:43:53.646357+0000","last_peered":"2024-09-17T03:43:53.646357+0000","last_clean":"2024-09-17T03:43:53.646357+0000","last_became_active":"2024-09-17T03:43:53.643895+0000","last_became_peered":"2024-09-17T03:43:53.643895+0000","last_unstale":"2024-09-17T03:43:53.646357+0000","last_undegraded":"2024-09-17T03:43:53.646357+0000","last_fullsized":"2024-09-17T03:43:53.646357+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:05.871783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984016+0000","last_change":"2024-09-17T03:43:54.663996+0000","last_active":"2024-09-17T03:43:55.984016+0000","last_peered":"2024-09-17T03:43:55.984016+0000","last_clean":"2024-09-17T03:43:55.984016+0000","last_became_active":"2024-09-17T03:43:54.663664+0000","last_became_peered":"2024-09-17T03:43:54.663664+0000","last_unstale":"2024-09-17T03:43:55.984016+0000","last_undegraded":"2024-09-17T03:43:55.984016+0000","last_fullsized":"2024-09-17T03:43:55.984016+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:46.673846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649569+0000","last_change":"2024-09-17T03:43:53.648032+0000","last_active":"2024-09-17T03:43:53.649569+0000","last_peered":"2024-09-17T03:43:53.649569+0000","last_clean":"2024-09-17T03:43:53.649569+0000","last_became_active":"2024-09-17T03:43:53.647737+0000","last_became_peered":"2024-09-17T03:43:53.647737+0000","last_unstale":"2024-09-17T03:43:53.649569+0000","last_undegraded":"2024-09-17T03:43:53.649569+0000","last_fullsized":"2024-09-17T03:43:53.649569+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:16.374027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637382+0000","last_change":"2024-09-17T03:43:53.637382+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637382+0000","last_undegraded":"2024-09-17T03:43:53.637382+0000","last_fullsized":"2024-09-17T03:43:53.637382+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649368+0000","last_change":"2024-09-17T03:43:53.645679+0000","last_active":"2024-09-17T03:43:53.649368+0000","last_peered":"2024-09-17T03:43:53.649368+0000","last_clean":"2024-09-17T03:43:53.649368+0000","last_became_active":"2024-09-17T03:43:53.645360+0000","last_became_peered":"2024-09-17T03:43:53.645360+0000","last_unstale":"2024-09-17T03:43:53.649368+0000","last_undegraded":"2024-09-17T03:43:53.649368+0000","last_fullsized":"2024-09-17T03:43:53.649368+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:11.108836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647690+0000","last_change":"2024-09-17T03:43:54.672348+0000","last_active":"2024-09-17T03:43:55.647690+0000","last_peered":"2024-09-17T03:43:55.647690+0000","last_clean":"2024-09-17T03:43:55.647690+0000","last_became_active":"2024-09-17T03:43:54.670870+0000","last_became_peered":"2024-09-17T03:43:54.670870+0000","last_unstale":"2024-09-17T03:43:55.647690+0000","last_undegraded":"2024-09-17T03:43:55.647690+0000","last_fullsized":"2024-09-17T03:43:55.647690+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:41.754485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647702+0000","last_change":"2024-09-17T03:43:53.643291+0000","last_active":"2024-09-17T03:43:55.647702+0000","last_peered":"2024-09-17T03:43:55.647702+0000","last_clean":"2024-09-17T03:43:55.647702+0000","last_became_active":"2024-09-17T03:43:53.642982+0000","last_became_peered":"2024-09-17T03:43:53.642982+0000","last_unstale":"2024-09-17T03:43:55.647702+0000","last_undegraded":"2024-09-17T03:43:55.647702+0000","last_fullsized":"2024-09-17T03:43:55.647702+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:54.167248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638697+0000","last_change":"2024-09-17T03:43:53.638697+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638697+0000","last_undegraded":"2024-09-17T03:43:53.638697+0000","last_fullsized":"2024-09-17T03:43:53.638697+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653343+0000","last_change":"2024-09-17T03:43:53.652597+0000","last_active":"2024-09-17T03:43:53.653343+0000","last_peered":"2024-09-17T03:43:53.653343+0000","last_clean":"2024-09-17T03:43:53.653343+0000","last_became_active":"2024-09-17T03:43:53.652283+0000","last_became_peered":"2024-09-17T03:43:53.652283+0000","last_unstale":"2024-09-17T03:43:53.653343+0000","last_undegraded":"2024-09-17T03:43:53.653343+0000","last_fullsized":"2024-09-17T03:43:53.653343+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:55.072264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634529+0000","last_change":"2024-09-17T03:43:53.634529+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634529+0000","last_undegraded":"2024-09-17T03:43:53.634529+0000","last_fullsized":"2024-09-17T03:43:53.634529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.650791+0000","last_change":"2024-09-17T03:43:53.647225+0000","last_active":"2024-09-17T03:43:53.650791+0000","last_peered":"2024-09-17T03:43:53.650791+0000","last_clean":"2024-09-17T03:43:53.650791+0000","last_became_active":"2024-09-17T03:43:53.646763+0000","last_became_peered":"2024-09-17T03:43:53.646763+0000","last_unstale":"2024-09-17T03:43:53.650791+0000","last_undegraded":"2024-09-17T03:43:53.650791+0000","last_fullsized":"2024-09-17T03:43:53.650791+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:05.871783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.648113+0000","last_change":"2024-09-17T03:43:54.664068+0000","last_active":"2024-09-17T03:43:55.648113+0000","last_peered":"2024-09-17T03:43:55.648113+0000","last_clean":"2024-09-17T03:43:55.648113+0000","last_became_active":"2024-09-17T03:43:54.663753+0000","last_became_peered":"2024-09-17T03:43:54.663753+0000","last_unstale":"2024-09-17T03:43:55.648113+0000","last_undegraded":"2024-09-17T03:43:55.648113+0000","last_fullsized":"2024-09-17T03:43:55.648113+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:37.532930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649927+0000","last_change":"2024-09-17T03:43:53.648637+0000","last_active":"2024-09-17T03:43:53.649927+0000","last_peered":"2024-09-17T03:43:53.649927+0000","last_clean":"2024-09-17T03:43:53.649927+0000","last_became_active":"2024-09-17T03:43:53.648309+0000","last_became_peered":"2024-09-17T03:43:53.648309+0000","last_unstale":"2024-09-17T03:43:53.649927+0000","last_undegraded":"2024-09-17T03:43:53.649927+0000","last_fullsized":"2024-09-17T03:43:53.649927+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:40.122831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639212+0000","last_change":"2024-09-17T03:43:53.639212+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639212+0000","last_undegraded":"2024-09-17T03:43:53.639212+0000","last_fullsized":"2024-09-17T03:43:53.639212+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653546+0000","last_change":"2024-09-17T03:43:53.653098+0000","last_active":"2024-09-17T03:43:53.653546+0000","last_peered":"2024-09-17T03:43:53.653546+0000","last_clean":"2024-09-17T03:43:53.653546+0000","last_became_active":"2024-09-17T03:43:53.652666+0000","last_became_peered":"2024-09-17T03:43:53.652666+0000","last_unstale":"2024-09-17T03:43:53.653546+0000","last_undegraded":"2024-09-17T03:43:53.653546+0000","last_fullsized":"2024-09-17T03:43:53.653546+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:26.208737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638941+0000","last_change":"2024-09-17T03:43:53.638941+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638941+0000","last_undegraded":"2024-09-17T03:43:53.638941+0000","last_fullsized":"2024-09-17T03:43:53.638941+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.646490+0000","last_change":"2024-09-17T03:43:53.643543+0000","last_active":"2024-09-17T03:43:53.646490+0000","last_peered":"2024-09-17T03:43:53.646490+0000","last_clean":"2024-09-17T03:43:53.646490+0000","last_became_active":"2024-09-17T03:43:53.642998+0000","last_became_peered":"2024-09-17T03:43:53.642998+0000","last_unstale":"2024-09-17T03:43:53.646490+0000","last_undegraded":"2024-09-17T03:43:53.646490+0000","last_fullsized":"2024-09-17T03:43:53.646490+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:20.916357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.633751+0000","last_change":"2024-09-17T03:43:53.633751+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.633751+0000","last_undegraded":"2024-09-17T03:43:53.633751+0000","last_fullsized":"2024-09-17T03:43:53.633751+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.652105+0000","last_change":"2024-09-17T03:43:53.650497+0000","last_active":"2024-09-17T03:43:53.652105+0000","last_peered":"2024-09-17T03:43:53.652105+0000","last_clean":"2024-09-17T03:43:53.652105+0000","last_became_active":"2024-09-17T03:43:53.650200+0000","last_became_peered":"2024-09-17T03:43:53.650200+0000","last_unstale":"2024-09-17T03:43:53.652105+0000","last_undegraded":"2024-09-17T03:43:53.652105+0000","last_fullsized":"2024-09-17T03:43:53.652105+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:21.394716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638286+0000","last_change":"2024-09-17T03:43:53.638286+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638286+0000","last_undegraded":"2024-09-17T03:43:53.638286+0000","last_fullsized":"2024-09-17T03:43:53.638286+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.650344+0000","last_change":"2024-09-17T03:43:53.648900+0000","last_active":"2024-09-17T03:43:53.650344+0000","last_peered":"2024-09-17T03:43:53.650344+0000","last_clean":"2024-09-17T03:43:53.650344+0000","last_became_active":"2024-09-17T03:43:53.648385+0000","last_became_peered":"2024-09-17T03:43:53.648385+0000","last_unstale":"2024-09-17T03:43:53.650344+0000","last_undegraded":"2024-09-17T03:43:53.650344+0000","last_fullsized":"2024-09-17T03:43:53.650344+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:26.061975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983703+0000","last_change":"2024-09-17T03:43:54.665253+0000","last_active":"2024-09-17T03:43:55.983703+0000","last_peered":"2024-09-17T03:43:55.983703+0000","last_clean":"2024-09-17T03:43:55.983703+0000","last_became_active":"2024-09-17T03:43:54.664937+0000","last_became_peered":"2024-09-17T03:43:54.664937+0000","last_unstale":"2024-09-17T03:43:55.983703+0000","last_undegraded":"2024-09-17T03:43:55.983703+0000","last_fullsized":"2024-09-17T03:43:55.983703+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:01.731823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647291+0000","last_change":"2024-09-17T03:43:53.647484+0000","last_active":"2024-09-17T03:43:55.647291+0000","last_peered":"2024-09-17T03:43:55.647291+0000","last_clean":"2024-09-17T03:43:55.647291+0000","last_became_active":"2024-09-17T03:43:53.647194+0000","last_became_peered":"2024-09-17T03:43:53.647194+0000","last_unstale":"2024-09-17T03:43:55.647291+0000","last_undegraded":"2024-09-17T03:43:55.647291+0000","last_fullsized":"2024-09-17T03:43:55.647291+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:20.612852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638176+0000","last_change":"2024-09-17T03:43:53.638176+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638176+0000","last_undegraded":"2024-09-17T03:43:53.638176+0000","last_fullsized":"2024-09-17T03:43:53.638176+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653176+0000","last_change":"2024-09-17T03:43:53.652497+0000","last_active":"2024-09-17T03:43:53.653176+0000","last_peered":"2024-09-17T03:43:53.653176+0000","last_clean":"2024-09-17T03:43:53.653176+0000","last_became_active":"2024-09-17T03:43:53.651068+0000","last_became_peered":"2024-09-17T03:43:53.651068+0000","last_unstale":"2024-09-17T03:43:53.653176+0000","last_undegraded":"2024-09-17T03:43:53.653176+0000","last_fullsized":"2024-09-17T03:43:53.653176+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:04.341701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637266+0000","last_change":"2024-09-17T03:43:53.637266+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637266+0000","last_undegraded":"2024-09-17T03:43:53.637266+0000","last_fullsized":"2024-09-17T03:43:53.637266+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649313+0000","last_change":"2024-09-17T03:43:53.643934+0000","last_active":"2024-09-17T03:43:53.649313+0000","last_peered":"2024-09-17T03:43:53.649313+0000","last_clean":"2024-09-17T03:43:53.649313+0000","last_became_active":"2024-09-17T03:43:53.643624+0000","last_became_peered":"2024-09-17T03:43:53.643624+0000","last_unstale":"2024-09-17T03:43:53.649313+0000","last_undegraded":"2024-09-17T03:43:53.649313+0000","last_fullsized":"2024-09-17T03:43:53.649313+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:25.977167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984066+0000","last_change":"2024-09-17T03:43:54.671058+0000","last_active":"2024-09-17T03:43:55.984066+0000","last_peered":"2024-09-17T03:43:55.984066+0000","last_clean":"2024-09-17T03:43:55.984066+0000","last_became_active":"2024-09-17T03:43:54.670052+0000","last_became_peered":"2024-09-17T03:43:54.670052+0000","last_unstale":"2024-09-17T03:43:55.984066+0000","last_undegraded":"2024-09-17T03:43:55.984066+0000","last_fullsized":"2024-09-17T03:43:55.984066+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:29.400392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647787+0000","last_change":"2024-09-17T03:43:53.649241+0000","last_active":"2024-09-17T03:43:55.647787+0000","last_peered":"2024-09-17T03:43:55.647787+0000","last_clean":"2024-09-17T03:43:55.647787+0000","last_became_active":"2024-09-17T03:43:53.648942+0000","last_became_peered":"2024-09-17T03:43:53.648942+0000","last_unstale":"2024-09-17T03:43:55.647787+0000","last_undegraded":"2024-09-17T03:43:55.647787+0000","last_fullsized":"2024-09-17T03:43:55.647787+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983902+0000","last_change":"2024-09-17T03:43:54.662331+0000","last_active":"2024-09-17T03:43:55.983902+0000","last_peered":"2024-09-17T03:43:55.983902+0000","last_clean":"2024-09-17T03:43:55.983902+0000","last_became_active":"2024-09-17T03:43:54.661020+0000","last_became_peered":"2024-09-17T03:43:54.661020+0000","last_unstale":"2024-09-17T03:43:55.983902+0000","last_undegraded":"2024-09-17T03:43:55.983902+0000","last_fullsized":"2024-09-17T03:43:55.983902+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:48.585042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.652175+0000","last_change":"2024-09-17T03:43:53.651532+0000","last_active":"2024-09-17T03:43:53.652175+0000","last_peered":"2024-09-17T03:43:53.652175+0000","last_clean":"2024-09-17T03:43:53.652175+0000","last_became_active":"2024-09-17T03:43:53.651190+0000","last_became_peered":"2024-09-17T03:43:53.651190+0000","last_unstale":"2024-09-17T03:43:53.652175+0000","last_undegraded":"2024-09-17T03:43:53.652175+0000","last_fullsized":"2024-09-17T03:43:53.652175+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:13.978089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639534+0000","last_change":"2024-09-17T03:43:53.639534+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639534+0000","last_undegraded":"2024-09-17T03:43:53.639534+0000","last_fullsized":"2024-09-17T03:43:53.639534+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.648583+0000","last_change":"2024-09-17T03:43:53.646384+0000","last_active":"2024-09-17T03:43:53.648583+0000","last_peered":"2024-09-17T03:43:53.648583+0000","last_clean":"2024-09-17T03:43:53.648583+0000","last_became_active":"2024-09-17T03:43:53.646041+0000","last_became_peered":"2024-09-17T03:43:53.646041+0000","last_unstale":"2024-09-17T03:43:53.648583+0000","last_undegraded":"2024-09-17T03:43:53.648583+0000","last_fullsized":"2024-09-17T03:43:53.648583+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:20.916357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636893+0000","last_change":"2024-09-17T03:43:53.636893+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636893+0000","last_undegraded":"2024-09-17T03:43:53.636893+0000","last_fullsized":"2024-09-17T03:43:53.636893+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649283+0000","last_change":"2024-09-17T03:43:53.645944+0000","last_active":"2024-09-17T03:43:53.649283+0000","last_peered":"2024-09-17T03:43:53.649283+0000","last_clean":"2024-09-17T03:43:53.649283+0000","last_became_active":"2024-09-17T03:43:53.645640+0000","last_became_peered":"2024-09-17T03:43:53.645640+0000","last_unstale":"2024-09-17T03:43:53.649283+0000","last_undegraded":"2024-09-17T03:43:53.649283+0000","last_fullsized":"2024-09-17T03:43:53.649283+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:27.524711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637653+0000","last_change":"2024-09-17T03:43:53.637653+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637653+0000","last_undegraded":"2024-09-17T03:43:53.637653+0000","last_fullsized":"2024-09-17T03:43:53.637653+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649893+0000","last_change":"2024-09-17T03:43:53.648560+0000","last_active":"2024-09-17T03:43:53.649893+0000","last_peered":"2024-09-17T03:43:53.649893+0000","last_clean":"2024-09-17T03:43:53.649893+0000","last_became_active":"2024-09-17T03:43:53.648255+0000","last_became_peered":"2024-09-17T03:43:53.648255+0000","last_unstale":"2024-09-17T03:43:53.649893+0000","last_undegraded":"2024-09-17T03:43:53.649893+0000","last_fullsized":"2024-09-17T03:43:53.649893+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:04.159623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640284+0000","last_change":"2024-09-17T03:43:53.640284+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640284+0000","last_undegraded":"2024-09-17T03:43:53.640284+0000","last_fullsized":"2024-09-17T03:43:53.640284+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649600+0000","last_change":"2024-09-17T03:43:53.647435+0000","last_active":"2024-09-17T03:43:53.649600+0000","last_peered":"2024-09-17T03:43:53.649600+0000","last_clean":"2024-09-17T03:43:53.649600+0000","last_became_active":"2024-09-17T03:43:53.647090+0000","last_became_peered":"2024-09-17T03:43:53.647090+0000","last_unstale":"2024-09-17T03:43:53.649600+0000","last_undegraded":"2024-09-17T03:43:53.649600+0000","last_fullsized":"2024-09-17T03:43:53.649600+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:07.644765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.643498+0000","last_change":"2024-09-17T03:43:53.643498+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.643498+0000","last_undegraded":"2024-09-17T03:43:53.643498+0000","last_fullsized":"2024-09-17T03:43:53.643498+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983757+0000","last_change":"2024-09-17T03:43:53.650612+0000","last_active":"2024-09-17T03:43:55.983757+0000","last_peered":"2024-09-17T03:43:55.983757+0000","last_clean":"2024-09-17T03:43:55.983757+0000","last_became_active":"2024-09-17T03:43:53.650247+0000","last_became_peered":"2024-09-17T03:43:53.650247+0000","last_unstale":"2024-09-17T03:43:55.983757+0000","last_undegraded":"2024-09-17T03:43:55.983757+0000","last_fullsized":"2024-09-17T03:43:55.983757+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:11.707083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634165+0000","last_change":"2024-09-17T03:43:53.634165+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634165+0000","last_undegraded":"2024-09-17T03:43:53.634165+0000","last_fullsized":"2024-09-17T03:43:53.634165+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653158+0000","last_change":"2024-09-17T03:43:53.652033+0000","last_active":"2024-09-17T03:43:53.653158+0000","last_peered":"2024-09-17T03:43:53.653158+0000","last_clean":"2024-09-17T03:43:53.653158+0000","last_became_active":"2024-09-17T03:43:53.651598+0000","last_became_peered":"2024-09-17T03:43:53.651598+0000","last_unstale":"2024-09-17T03:43:53.653158+0000","last_undegraded":"2024-09-17T03:43:53.653158+0000","last_fullsized":"2024-09-17T03:43:53.653158+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:54.720646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637062+0000","last_change":"2024-09-17T03:43:53.637062+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637062+0000","last_undegraded":"2024-09-17T03:43:53.637062+0000","last_fullsized":"2024-09-17T03:43:53.637062+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.651661+0000","last_change":"2024-09-17T03:43:53.650894+0000","last_active":"2024-09-17T03:43:53.651661+0000","last_peered":"2024-09-17T03:43:53.651661+0000","last_clean":"2024-09-17T03:43:53.651661+0000","last_became_active":"2024-09-17T03:43:53.650585+0000","last_became_peered":"2024-09-17T03:43:53.650585+0000","last_unstale":"2024-09-17T03:43:53.651661+0000","last_undegraded":"2024-09-17T03:43:53.651661+0000","last_fullsized":"2024-09-17T03:43:53.651661+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:32.571954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647562+0000","last_change":"2024-09-17T03:43:54.668026+0000","last_active":"2024-09-17T03:43:55.647562+0000","last_peered":"2024-09-17T03:43:55.647562+0000","last_clean":"2024-09-17T03:43:55.647562+0000","last_became_active":"2024-09-17T03:43:54.667733+0000","last_became_peered":"2024-09-17T03:43:54.667733+0000","last_unstale":"2024-09-17T03:43:55.647562+0000","last_undegraded":"2024-09-17T03:43:55.647562+0000","last_fullsized":"2024-09-17T03:43:55.647562+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:29.670536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.650843+0000","last_change":"2024-09-17T03:43:53.649967+0000","last_active":"2024-09-17T03:43:53.650843+0000","last_peered":"2024-09-17T03:43:53.650843+0000","last_clean":"2024-09-17T03:43:53.650843+0000","last_became_active":"2024-09-17T03:43:53.649642+0000","last_became_peered":"2024-09-17T03:43:53.649642+0000","last_unstale":"2024-09-17T03:43:53.650843+0000","last_undegraded":"2024-09-17T03:43:53.650843+0000","last_fullsized":"2024-09-17T03:43:53.650843+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:00.932873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647921+0000","last_change":"2024-09-17T03:43:54.666057+0000","last_active":"2024-09-17T03:43:55.647921+0000","last_peered":"2024-09-17T03:43:55.647921+0000","last_clean":"2024-09-17T03:43:55.647921+0000","last_became_active":"2024-09-17T03:43:54.665692+0000","last_became_peered":"2024-09-17T03:43:54.665692+0000","last_unstale":"2024-09-17T03:43:55.647921+0000","last_undegraded":"2024-09-17T03:43:55.647921+0000","last_fullsized":"2024-09-17T03:43:55.647921+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:35.834253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647451+0000","last_change":"2024-09-17T03:43:53.648302+0000","last_active":"2024-09-17T03:43:55.647451+0000","last_peered":"2024-09-17T03:43:55.647451+0000","last_clean":"2024-09-17T03:43:55.647451+0000","last_became_active":"2024-09-17T03:43:53.647956+0000","last_became_peered":"2024-09-17T03:43:53.647956+0000","last_unstale":"2024-09-17T03:43:55.647451+0000","last_undegraded":"2024-09-17T03:43:55.647451+0000","last_fullsized":"2024-09-17T03:43:55.647451+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:06.888162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640232+0000","last_change":"2024-09-17T03:43:53.640232+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640232+0000","last_undegraded":"2024-09-17T03:43:53.640232+0000","last_fullsized":"2024-09-17T03:43:53.640232+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983991+0000","last_change":"2024-09-17T03:43:53.646019+0000","last_active":"2024-09-17T03:43:55.983991+0000","last_peered":"2024-09-17T03:43:55.983991+0000","last_clean":"2024-09-17T03:43:55.983991+0000","last_became_active":"2024-09-17T03:43:53.645555+0000","last_became_peered":"2024-09-17T03:43:53.645555+0000","last_unstale":"2024-09-17T03:43:55.983991+0000","last_undegraded":"2024-09-17T03:43:55.983991+0000","last_fullsized":"2024-09-17T03:43:55.983991+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:12.150493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.641592+0000","last_change":"2024-09-17T03:43:53.641592+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.641592+0000","last_undegraded":"2024-09-17T03:43:53.641592+0000","last_fullsized":"2024-09-17T03:43:53.641592+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983792+0000","last_change":"2024-09-17T03:43:53.648330+0000","last_active":"2024-09-17T03:43:55.983792+0000","last_peered":"2024-09-17T03:43:55.983792+0000","last_clean":"2024-09-17T03:43:55.983792+0000","last_became_active":"2024-09-17T03:43:53.648045+0000","last_became_peered":"2024-09-17T03:43:53.648045+0000","last_unstale":"2024-09-17T03:43:55.983792+0000","last_undegraded":"2024-09-17T03:43:55.983792+0000","last_fullsized":"2024-09-17T03:43:55.983792+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:26.973084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639774+0000","last_change":"2024-09-17T03:43:53.639774+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639774+0000","last_undegraded":"2024-09-17T03:43:53.639774+0000","last_fullsized":"2024-09-17T03:43:53.639774+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649737+0000","last_change":"2024-09-17T03:43:53.648567+0000","last_active":"2024-09-17T03:43:53.649737+0000","last_peered":"2024-09-17T03:43:53.649737+0000","last_clean":"2024-09-17T03:43:53.649737+0000","last_became_active":"2024-09-17T03:43:53.648198+0000","last_became_peered":"2024-09-17T03:43:53.648198+0000","last_unstale":"2024-09-17T03:43:53.649737+0000","last_undegraded":"2024-09-17T03:43:53.649737+0000","last_fullsized":"2024-09-17T03:43:53.649737+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:45.353160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634696+0000","last_change":"2024-09-17T03:43:53.634696+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634696+0000","last_undegraded":"2024-09-17T03:43:53.634696+0000","last_fullsized":"2024-09-17T03:43:53.634696+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.640773+0000","last_change":"2024-09-17T03:43:53.636144+0000","last_active":"2024-09-17T03:43:53.640773+0000","last_peered":"2024-09-17T03:43:53.640773+0000","last_clean":"2024-09-17T03:43:53.640773+0000","last_became_active":"2024-09-17T03:43:53.635853+0000","last_became_peered":"2024-09-17T03:43:53.635853+0000","last_unstale":"2024-09-17T03:43:53.640773+0000","last_undegraded":"2024-09-17T03:43:53.640773+0000","last_fullsized":"2024-09-17T03:43:53.640773+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:25.838359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637757+0000","last_change":"2024-09-17T03:43:53.637757+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637757+0000","last_undegraded":"2024-09-17T03:43:53.637757+0000","last_fullsized":"2024-09-17T03:43:53.637757+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.652056+0000","last_change":"2024-09-17T03:43:53.650336+0000","last_active":"2024-09-17T03:43:53.652056+0000","last_peered":"2024-09-17T03:43:53.652056+0000","last_clean":"2024-09-17T03:43:53.652056+0000","last_became_active":"2024-09-17T03:43:53.649990+0000","last_became_peered":"2024-09-17T03:43:53.649990+0000","last_unstale":"2024-09-17T03:43:53.652056+0000","last_undegraded":"2024-09-17T03:43:53.652056+0000","last_fullsized":"2024-09-17T03:43:53.652056+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:01.238542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":371,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.643514+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:43:53.643514+0000","last_peered":"2024-09-17T03:43:53.643514+0000","last_clean":"2024-09-17T03:43:53.643514+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:43:53.643514+0000","last_undegraded":"2024-09-17T03:43:53.643514+0000","last_fullsized":"2024-09-17T03:43:53.643514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509577,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60140,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311700,"statfs":{"total":96636764160,"available":96575180800,"internally_reserved":0,"allocated":2637824,"data_stored":1487753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509577,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59556,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312284,"statfs":{"total":96636764160,"available":96575778816,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509577,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63716,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308124,"statfs":{"total":96636764160,"available":96571518976,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509577,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55396,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316444,"statfs":{"total":96636764160,"available":96580038656,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509578,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55396,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316444,"statfs":{"total":96636764160,"available":96580038656,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51816,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320024,"statfs":{"total":96636764160,"available":96583704576,"internally_reserved":0,"allocated":2637824,"data_stored":1487753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55416,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316424,"statfs":{"total":96636764160,"available":96580018176,"internally_reserved":0,"allocated":2068480,"data_stored":910460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55436,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316404,"statfs":{"total":96636764160,"available":96579997696,"internally_reserved":0,"allocated":2080768,"data_stored":910654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:43:59.029 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:43:59.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.179+0000 7f750027e640 1 -- 172.21.15.146:0/3376509875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f8072df0 msgr2=0x7f74f815ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.179+0000 7f750027e640 1 --2- 172.21.15.146:0/3376509875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f8072df0 0x7f74f815ead0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f74e800a930 tx=0x7f74e802b8f0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.179+0000 7f750027e640 1 -- 172.21.15.146:0/3376509875 shutdown_connections 2024-09-17T03:43:59.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.179+0000 7f750027e640 1 --2- 172.21.15.146:0/3376509875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f8072df0 0x7f74f815ead0 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.179+0000 7f750027e640 1 -- 172.21.15.146:0/3376509875 >> 172.21.15.146:0/3376509875 conn(0x7f74f80b2060 msgr2=0x7f74f80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:59.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.179+0000 7f750027e640 1 -- 172.21.15.146:0/3376509875 shutdown_connections 2024-09-17T03:43:59.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.179+0000 7f750027e640 1 -- 172.21.15.146:0/3376509875 wait complete. 2024-09-17T03:43:59.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.181+0000 7f750027e640 1 Processor -- start 2024-09-17T03:43:59.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.181+0000 7f750027e640 1 -- start start 2024-09-17T03:43:59.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.182+0000 7f750027e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f8072df0 0x7f74f814c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.182+0000 7f750027e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74f80b3360 0x7f74f8150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.182+0000 7f750027e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74f815f010 0x7f74f814b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.182+0000 7f750027e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f74f806e5f0 con 0x7f74f8072df0 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.182+0000 7f750027e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f74f806e470 con 0x7f74f815f010 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.182+0000 7f750027e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f74f806e770 con 0x7f74f80b3360 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.182+0000 7f74fe01a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f8072df0 0x7f74f814c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.182+0000 7f74fe01a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f8072df0 0x7f74f814c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43878/0 (socket says 172.21.15.146:43878) 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.182+0000 7f74fe01a640 1 -- 172.21.15.146:0/1465502598 learned_addr learned my addr 172.21.15.146:0/1465502598 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f74fe01a640 1 -- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74f80b3360 msgr2=0x7f74f8150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f74fd819640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74f80b3360 0x7f74f8150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f74fe81b640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74f815f010 0x7f74f814b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f74fe01a640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74f80b3360 0x7f74f8150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f74fe01a640 1 -- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74f815f010 msgr2=0x7f74f814b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f74fe01a640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74f815f010 0x7f74f814b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f74fe01a640 1 -- 172.21.15.146:0/1465502598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f814fa50 con 0x7f74f8072df0 2024-09-17T03:43:59.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f74fe01a640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f8072df0 0x7f74f814c510 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f74f400c400 tx=0x7f74f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:59.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f74eeffd640 1 -- 172.21.15.146:0/1465502598 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4017070 con 0x7f74f8072df0 2024-09-17T03:43:59.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f74eeffd640 1 -- 172.21.15.146:0/1465502598 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74f40053c0 con 0x7f74f8072df0 2024-09-17T03:43:59.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f74eeffd640 1 -- 172.21.15.146:0/1465502598 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4003850 con 0x7f74f8072df0 2024-09-17T03:43:59.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f750027e640 1 -- 172.21.15.146:0/1465502598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f814fd30 con 0x7f74f8072df0 2024-09-17T03:43:59.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.183+0000 7f750027e640 1 -- 172.21.15.146:0/1465502598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f81503a0 con 0x7f74f8072df0 2024-09-17T03:43:59.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.184+0000 7f750027e640 1 -- 172.21.15.146:0/1465502598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f815ead0 con 0x7f74f8072df0 2024-09-17T03:43:59.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.185+0000 7f74eeffd640 1 -- 172.21.15.146:0/1465502598 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74f401a070 con 0x7f74f8072df0 2024-09-17T03:43:59.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.185+0000 7f74eeffd640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74dc078b90 0x7f74dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.185+0000 7f74eeffd640 1 -- 172.21.15.146:0/1465502598 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f74f409a020 con 0x7f74f8072df0 2024-09-17T03:43:59.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.186+0000 7f74fd819640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74dc078b90 0x7f74dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.186+0000 7f74fd819640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74dc078b90 0x7f74dc07b0a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f74e8036000 tx=0x7f74e8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:59.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.190+0000 7f74eeffd640 1 -- 172.21.15.146:0/1465502598 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f74f4062580 con 0x7f74f8072df0 2024-09-17T03:43:59.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.361+0000 7f750027e640 1 -- 172.21.15.146:0/1465502598 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74f8076230 con 0x7f74dc078b90 2024-09-17T03:43:59.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.366+0000 7f74eeffd640 1 -- 172.21.15.146:0/1465502598 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248359 (secure 0 0 0) 0x7f74f8076230 con 0x7f74dc078b90 2024-09-17T03:43:59.368 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:59.369 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:43:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 -- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74dc078b90 msgr2=0x7f74dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74dc078b90 0x7f74dc07b0a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f74e8036000 tx=0x7f74e8004730 comp rx=0 tx=0).stop 2024-09-17T03:43:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 -- 172.21.15.146:0/1465502598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f8072df0 msgr2=0x7f74f814c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f8072df0 0x7f74f814c510 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f74f400c400 tx=0x7f74f400c8c0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 -- 172.21.15.146:0/1465502598 shutdown_connections 2024-09-17T03:43:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f74dc078b90 0x7f74dc07b0a0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74f815f010 0x7f74f814b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74f80b3360 0x7f74f8150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 --2- 172.21.15.146:0/1465502598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74f8072df0 0x7f74f814c510 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 -- 172.21.15.146:0/1465502598 >> 172.21.15.146:0/1465502598 conn(0x7f74f80b2060 msgr2=0x7f74f80b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 -- 172.21.15.146:0/1465502598 shutdown_connections 2024-09-17T03:43:59.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.369+0000 7f750027e640 1 -- 172.21.15.146:0/1465502598 wait complete. 2024-09-17T03:43:59.380 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":494,"stamp":"2024-09-17T03:43:57.965540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":104,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":456872,"kb_used_data":17188,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754517848,"statfs":{"total":773094113280,"available":772626276352,"internally_reserved":0,"allocated":17600512,"data_stored":8386160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.335168"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.643650+0000","last_change":"2024-09-17T03:43:53.643650+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.643650+0000","last_undegraded":"2024-09-17T03:43:53.643650+0000","last_fullsized":"2024-09-17T03:43:53.643650+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638475+0000","last_change":"2024-09-17T03:43:53.638475+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638475+0000","last_undegraded":"2024-09-17T03:43:53.638475+0000","last_fullsized":"2024-09-17T03:43:53.638475+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635612+0000","last_change":"2024-09-17T03:43:53.635612+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635612+0000","last_undegraded":"2024-09-17T03:43:53.635612+0000","last_fullsized":"2024-09-17T03:43:53.635612+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636821+0000","last_change":"2024-09-17T03:43:53.636821+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636821+0000","last_undegraded":"2024-09-17T03:43:53.636821+0000","last_fullsized":"2024-09-17T03:43:53.636821+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.641313+0000","last_change":"2024-09-17T03:43:53.641313+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.641313+0000","last_undegraded":"2024-09-17T03:43:53.641313+0000","last_fullsized":"2024-09-17T03:43:53.641313+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635123+0000","last_change":"2024-09-17T03:43:53.635123+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635123+0000","last_undegraded":"2024-09-17T03:43:53.635123+0000","last_fullsized":"2024-09-17T03:43:53.635123+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639696+0000","last_change":"2024-09-17T03:43:53.639696+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639696+0000","last_undegraded":"2024-09-17T03:43:53.639696+0000","last_fullsized":"2024-09-17T03:43:53.639696+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647561+0000","last_change":"2024-09-17T03:43:54.655319+0000","last_active":"2024-09-17T03:43:55.647561+0000","last_peered":"2024-09-17T03:43:55.647561+0000","last_clean":"2024-09-17T03:43:55.647561+0000","last_became_active":"2024-09-17T03:43:54.655022+0000","last_became_peered":"2024-09-17T03:43:54.655022+0000","last_unstale":"2024-09-17T03:43:55.647561+0000","last_undegraded":"2024-09-17T03:43:55.647561+0000","last_fullsized":"2024-09-17T03:43:55.647561+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:19.101578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984059+0000","last_change":"2024-09-17T03:43:54.667783+0000","last_active":"2024-09-17T03:43:55.984059+0000","last_peered":"2024-09-17T03:43:55.984059+0000","last_clean":"2024-09-17T03:43:55.984059+0000","last_became_active":"2024-09-17T03:43:54.667437+0000","last_became_peered":"2024-09-17T03:43:54.667437+0000","last_unstale":"2024-09-17T03:43:55.984059+0000","last_undegraded":"2024-09-17T03:43:55.984059+0000","last_fullsized":"2024-09-17T03:43:55.984059+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:40.158899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637798+0000","last_change":"2024-09-17T03:43:53.637798+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637798+0000","last_undegraded":"2024-09-17T03:43:53.637798+0000","last_fullsized":"2024-09-17T03:43:53.637798+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639578+0000","last_change":"2024-09-17T03:43:53.639578+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639578+0000","last_undegraded":"2024-09-17T03:43:53.639578+0000","last_fullsized":"2024-09-17T03:43:53.639578+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636288+0000","last_change":"2024-09-17T03:43:53.636288+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636288+0000","last_undegraded":"2024-09-17T03:43:53.636288+0000","last_fullsized":"2024-09-17T03:43:53.636288+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636418+0000","last_change":"2024-09-17T03:43:53.636418+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636418+0000","last_undegraded":"2024-09-17T03:43:53.636418+0000","last_fullsized":"2024-09-17T03:43:53.636418+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983964+0000","last_change":"2024-09-17T03:43:54.667596+0000","last_active":"2024-09-17T03:43:55.983964+0000","last_peered":"2024-09-17T03:43:55.983964+0000","last_clean":"2024-09-17T03:43:55.983964+0000","last_became_active":"2024-09-17T03:43:54.667088+0000","last_became_peered":"2024-09-17T03:43:54.667088+0000","last_unstale":"2024-09-17T03:43:55.983964+0000","last_undegraded":"2024-09-17T03:43:55.983964+0000","last_fullsized":"2024-09-17T03:43:55.983964+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:25.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637365+0000","last_change":"2024-09-17T03:43:53.637365+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637365+0000","last_undegraded":"2024-09-17T03:43:53.637365+0000","last_fullsized":"2024-09-17T03:43:53.637365+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647641+0000","last_change":"2024-09-17T03:43:54.665060+0000","last_active":"2024-09-17T03:43:55.647641+0000","last_peered":"2024-09-17T03:43:55.647641+0000","last_clean":"2024-09-17T03:43:55.647641+0000","last_became_active":"2024-09-17T03:43:54.664742+0000","last_became_peered":"2024-09-17T03:43:54.664742+0000","last_unstale":"2024-09-17T03:43:55.647641+0000","last_undegraded":"2024-09-17T03:43:55.647641+0000","last_fullsized":"2024-09-17T03:43:55.647641+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:45.262140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635178+0000","last_change":"2024-09-17T03:43:53.635178+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635178+0000","last_undegraded":"2024-09-17T03:43:53.635178+0000","last_fullsized":"2024-09-17T03:43:53.635178+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640752+0000","last_change":"2024-09-17T03:43:53.640752+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640752+0000","last_undegraded":"2024-09-17T03:43:53.640752+0000","last_fullsized":"2024-09-17T03:43:53.640752+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639406+0000","last_change":"2024-09-17T03:43:53.639406+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639406+0000","last_undegraded":"2024-09-17T03:43:53.639406+0000","last_fullsized":"2024-09-17T03:43:53.639406+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639480+0000","last_change":"2024-09-17T03:43:53.639480+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639480+0000","last_undegraded":"2024-09-17T03:43:53.639480+0000","last_fullsized":"2024-09-17T03:43:53.639480+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640830+0000","last_change":"2024-09-17T03:43:53.640830+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640830+0000","last_undegraded":"2024-09-17T03:43:53.640830+0000","last_fullsized":"2024-09-17T03:43:53.640830+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637865+0000","last_change":"2024-09-17T03:43:53.637865+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637865+0000","last_undegraded":"2024-09-17T03:43:53.637865+0000","last_fullsized":"2024-09-17T03:43:53.637865+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634598+0000","last_change":"2024-09-17T03:43:53.634598+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634598+0000","last_undegraded":"2024-09-17T03:43:53.634598+0000","last_fullsized":"2024-09-17T03:43:53.634598+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647790+0000","last_change":"2024-09-17T03:43:54.666755+0000","last_active":"2024-09-17T03:43:55.647790+0000","last_peered":"2024-09-17T03:43:55.647790+0000","last_clean":"2024-09-17T03:43:55.647790+0000","last_became_active":"2024-09-17T03:43:54.666432+0000","last_became_peered":"2024-09-17T03:43:54.666432+0000","last_unstale":"2024-09-17T03:43:55.647790+0000","last_undegraded":"2024-09-17T03:43:55.647790+0000","last_fullsized":"2024-09-17T03:43:55.647790+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:05.826937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640033+0000","last_change":"2024-09-17T03:43:53.640033+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640033+0000","last_undegraded":"2024-09-17T03:43:53.640033+0000","last_fullsized":"2024-09-17T03:43:53.640033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638133+0000","last_change":"2024-09-17T03:43:53.638133+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638133+0000","last_undegraded":"2024-09-17T03:43:53.638133+0000","last_fullsized":"2024-09-17T03:43:53.638133+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.633823+0000","last_change":"2024-09-17T03:43:53.633823+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.633823+0000","last_undegraded":"2024-09-17T03:43:53.633823+0000","last_fullsized":"2024-09-17T03:43:53.633823+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.633750+0000","last_change":"2024-09-17T03:43:53.633750+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.633750+0000","last_undegraded":"2024-09-17T03:43:53.633750+0000","last_fullsized":"2024-09-17T03:43:53.633750+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.635784+0000","last_change":"2024-09-17T03:43:53.635784+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.635784+0000","last_undegraded":"2024-09-17T03:43:53.635784+0000","last_fullsized":"2024-09-17T03:43:53.635784+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983636+0000","last_change":"2024-09-17T03:43:54.663609+0000","last_active":"2024-09-17T03:43:55.983636+0000","last_peered":"2024-09-17T03:43:55.983636+0000","last_clean":"2024-09-17T03:43:55.983636+0000","last_became_active":"2024-09-17T03:43:54.663199+0000","last_became_peered":"2024-09-17T03:43:54.663199+0000","last_unstale":"2024-09-17T03:43:55.983636+0000","last_undegraded":"2024-09-17T03:43:55.983636+0000","last_fullsized":"2024-09-17T03:43:55.983636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:59.078819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634054+0000","last_change":"2024-09-17T03:43:53.634054+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634054+0000","last_undegraded":"2024-09-17T03:43:53.634054+0000","last_fullsized":"2024-09-17T03:43:53.634054+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634542+0000","last_change":"2024-09-17T03:43:53.634542+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634542+0000","last_undegraded":"2024-09-17T03:43:53.634542+0000","last_fullsized":"2024-09-17T03:43:53.634542+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647855+0000","last_change":"2024-09-17T03:43:54.665630+0000","last_active":"2024-09-17T03:43:55.647855+0000","last_peered":"2024-09-17T03:43:55.647855+0000","last_clean":"2024-09-17T03:43:55.647855+0000","last_became_active":"2024-09-17T03:43:54.665303+0000","last_became_peered":"2024-09-17T03:43:54.665303+0000","last_unstale":"2024-09-17T03:43:55.647855+0000","last_undegraded":"2024-09-17T03:43:55.647855+0000","last_fullsized":"2024-09-17T03:43:55.647855+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:34.015909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649282+0000","last_change":"2024-09-17T03:43:53.642888+0000","last_active":"2024-09-17T03:43:53.649282+0000","last_peered":"2024-09-17T03:43:53.649282+0000","last_clean":"2024-09-17T03:43:53.649282+0000","last_became_active":"2024-09-17T03:43:53.642585+0000","last_became_peered":"2024-09-17T03:43:53.642585+0000","last_unstale":"2024-09-17T03:43:53.649282+0000","last_undegraded":"2024-09-17T03:43:53.649282+0000","last_fullsized":"2024-09-17T03:43:53.649282+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:53.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637567+0000","last_change":"2024-09-17T03:43:53.637567+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637567+0000","last_undegraded":"2024-09-17T03:43:53.637567+0000","last_fullsized":"2024-09-17T03:43:53.637567+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984083+0000","last_change":"2024-09-17T03:43:53.647661+0000","last_active":"2024-09-17T03:43:55.984083+0000","last_peered":"2024-09-17T03:43:55.984083+0000","last_clean":"2024-09-17T03:43:55.984083+0000","last_became_active":"2024-09-17T03:43:53.647274+0000","last_became_peered":"2024-09-17T03:43:53.647274+0000","last_unstale":"2024-09-17T03:43:55.984083+0000","last_undegraded":"2024-09-17T03:43:55.984083+0000","last_fullsized":"2024-09-17T03:43:55.984083+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:35.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640246+0000","last_change":"2024-09-17T03:43:53.640246+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640246+0000","last_undegraded":"2024-09-17T03:43:53.640246+0000","last_fullsized":"2024-09-17T03:43:53.640246+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.646357+0000","last_change":"2024-09-17T03:43:53.644185+0000","last_active":"2024-09-17T03:43:53.646357+0000","last_peered":"2024-09-17T03:43:53.646357+0000","last_clean":"2024-09-17T03:43:53.646357+0000","last_became_active":"2024-09-17T03:43:53.643895+0000","last_became_peered":"2024-09-17T03:43:53.643895+0000","last_unstale":"2024-09-17T03:43:53.646357+0000","last_undegraded":"2024-09-17T03:43:53.646357+0000","last_fullsized":"2024-09-17T03:43:53.646357+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:05.871783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984016+0000","last_change":"2024-09-17T03:43:54.663996+0000","last_active":"2024-09-17T03:43:55.984016+0000","last_peered":"2024-09-17T03:43:55.984016+0000","last_clean":"2024-09-17T03:43:55.984016+0000","last_became_active":"2024-09-17T03:43:54.663664+0000","last_became_peered":"2024-09-17T03:43:54.663664+0000","last_unstale":"2024-09-17T03:43:55.984016+0000","last_undegraded":"2024-09-17T03:43:55.984016+0000","last_fullsized":"2024-09-17T03:43:55.984016+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:46.673846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649569+0000","last_change":"2024-09-17T03:43:53.648032+0000","last_active":"2024-09-17T03:43:53.649569+0000","last_peered":"2024-09-17T03:43:53.649569+0000","last_clean":"2024-09-17T03:43:53.649569+0000","last_became_active":"2024-09-17T03:43:53.647737+0000","last_became_peered":"2024-09-17T03:43:53.647737+0000","last_unstale":"2024-09-17T03:43:53.649569+0000","last_undegraded":"2024-09-17T03:43:53.649569+0000","last_fullsized":"2024-09-17T03:43:53.649569+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:16.374027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637382+0000","last_change":"2024-09-17T03:43:53.637382+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637382+0000","last_undegraded":"2024-09-17T03:43:53.637382+0000","last_fullsized":"2024-09-17T03:43:53.637382+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649368+0000","last_change":"2024-09-17T03:43:53.645679+0000","last_active":"2024-09-17T03:43:53.649368+0000","last_peered":"2024-09-17T03:43:53.649368+0000","last_clean":"2024-09-17T03:43:53.649368+0000","last_became_active":"2024-09-17T03:43:53.645360+0000","last_became_peered":"2024-09-17T03:43:53.645360+0000","last_unstale":"2024-09-17T03:43:53.649368+0000","last_undegraded":"2024-09-17T03:43:53.649368+0000","last_fullsized":"2024-09-17T03:43:53.649368+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:11.108836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647690+0000","last_change":"2024-09-17T03:43:54.672348+0000","last_active":"2024-09-17T03:43:55.647690+0000","last_peered":"2024-09-17T03:43:55.647690+0000","last_clean":"2024-09-17T03:43:55.647690+0000","last_became_active":"2024-09-17T03:43:54.670870+0000","last_became_peered":"2024-09-17T03:43:54.670870+0000","last_unstale":"2024-09-17T03:43:55.647690+0000","last_undegraded":"2024-09-17T03:43:55.647690+0000","last_fullsized":"2024-09-17T03:43:55.647690+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:41.754485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647702+0000","last_change":"2024-09-17T03:43:53.643291+0000","last_active":"2024-09-17T03:43:55.647702+0000","last_peered":"2024-09-17T03:43:55.647702+0000","last_clean":"2024-09-17T03:43:55.647702+0000","last_became_active":"2024-09-17T03:43:53.642982+0000","last_became_peered":"2024-09-17T03:43:53.642982+0000","last_unstale":"2024-09-17T03:43:55.647702+0000","last_undegraded":"2024-09-17T03:43:55.647702+0000","last_fullsized":"2024-09-17T03:43:55.647702+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:54.167248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638697+0000","last_change":"2024-09-17T03:43:53.638697+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638697+0000","last_undegraded":"2024-09-17T03:43:53.638697+0000","last_fullsized":"2024-09-17T03:43:53.638697+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653343+0000","last_change":"2024-09-17T03:43:53.652597+0000","last_active":"2024-09-17T03:43:53.653343+0000","last_peered":"2024-09-17T03:43:53.653343+0000","last_clean":"2024-09-17T03:43:53.653343+0000","last_became_active":"2024-09-17T03:43:53.652283+0000","last_became_peered":"2024-09-17T03:43:53.652283+0000","last_unstale":"2024-09-17T03:43:53.653343+0000","last_undegraded":"2024-09-17T03:43:53.653343+0000","last_fullsized":"2024-09-17T03:43:53.653343+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:55.072264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634529+0000","last_change":"2024-09-17T03:43:53.634529+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634529+0000","last_undegraded":"2024-09-17T03:43:53.634529+0000","last_fullsized":"2024-09-17T03:43:53.634529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.650791+0000","last_change":"2024-09-17T03:43:53.647225+0000","last_active":"2024-09-17T03:43:53.650791+0000","last_peered":"2024-09-17T03:43:53.650791+0000","last_clean":"2024-09-17T03:43:53.650791+0000","last_became_active":"2024-09-17T03:43:53.646763+0000","last_became_peered":"2024-09-17T03:43:53.646763+0000","last_unstale":"2024-09-17T03:43:53.650791+0000","last_undegraded":"2024-09-17T03:43:53.650791+0000","last_fullsized":"2024-09-17T03:43:53.650791+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:05.871783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.648113+0000","last_change":"2024-09-17T03:43:54.664068+0000","last_active":"2024-09-17T03:43:55.648113+0000","last_peered":"2024-09-17T03:43:55.648113+0000","last_clean":"2024-09-17T03:43:55.648113+0000","last_became_active":"2024-09-17T03:43:54.663753+0000","last_became_peered":"2024-09-17T03:43:54.663753+0000","last_unstale":"2024-09-17T03:43:55.648113+0000","last_undegraded":"2024-09-17T03:43:55.648113+0000","last_fullsized":"2024-09-17T03:43:55.648113+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:37.532930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649927+0000","last_change":"2024-09-17T03:43:53.648637+0000","last_active":"2024-09-17T03:43:53.649927+0000","last_peered":"2024-09-17T03:43:53.649927+0000","last_clean":"2024-09-17T03:43:53.649927+0000","last_became_active":"2024-09-17T03:43:53.648309+0000","last_became_peered":"2024-09-17T03:43:53.648309+0000","last_unstale":"2024-09-17T03:43:53.649927+0000","last_undegraded":"2024-09-17T03:43:53.649927+0000","last_fullsized":"2024-09-17T03:43:53.649927+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:40.122831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639212+0000","last_change":"2024-09-17T03:43:53.639212+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639212+0000","last_undegraded":"2024-09-17T03:43:53.639212+0000","last_fullsized":"2024-09-17T03:43:53.639212+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653546+0000","last_change":"2024-09-17T03:43:53.653098+0000","last_active":"2024-09-17T03:43:53.653546+0000","last_peered":"2024-09-17T03:43:53.653546+0000","last_clean":"2024-09-17T03:43:53.653546+0000","last_became_active":"2024-09-17T03:43:53.652666+0000","last_became_peered":"2024-09-17T03:43:53.652666+0000","last_unstale":"2024-09-17T03:43:53.653546+0000","last_undegraded":"2024-09-17T03:43:53.653546+0000","last_fullsized":"2024-09-17T03:43:53.653546+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:26.208737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638941+0000","last_change":"2024-09-17T03:43:53.638941+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638941+0000","last_undegraded":"2024-09-17T03:43:53.638941+0000","last_fullsized":"2024-09-17T03:43:53.638941+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.646490+0000","last_change":"2024-09-17T03:43:53.643543+0000","last_active":"2024-09-17T03:43:53.646490+0000","last_peered":"2024-09-17T03:43:53.646490+0000","last_clean":"2024-09-17T03:43:53.646490+0000","last_became_active":"2024-09-17T03:43:53.642998+0000","last_became_peered":"2024-09-17T03:43:53.642998+0000","last_unstale":"2024-09-17T03:43:53.646490+0000","last_undegraded":"2024-09-17T03:43:53.646490+0000","last_fullsized":"2024-09-17T03:43:53.646490+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:20.916357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.633751+0000","last_change":"2024-09-17T03:43:53.633751+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.633751+0000","last_undegraded":"2024-09-17T03:43:53.633751+0000","last_fullsized":"2024-09-17T03:43:53.633751+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.652105+0000","last_change":"2024-09-17T03:43:53.650497+0000","last_active":"2024-09-17T03:43:53.652105+0000","last_peered":"2024-09-17T03:43:53.652105+0000","last_clean":"2024-09-17T03:43:53.652105+0000","last_became_active":"2024-09-17T03:43:53.650200+0000","last_became_peered":"2024-09-17T03:43:53.650200+0000","last_unstale":"2024-09-17T03:43:53.652105+0000","last_undegraded":"2024-09-17T03:43:53.652105+0000","last_fullsized":"2024-09-17T03:43:53.652105+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:21.394716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638286+0000","last_change":"2024-09-17T03:43:53.638286+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638286+0000","last_undegraded":"2024-09-17T03:43:53.638286+0000","last_fullsized":"2024-09-17T03:43:53.638286+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.650344+0000","last_change":"2024-09-17T03:43:53.648900+0000","last_active":"2024-09-17T03:43:53.650344+0000","last_peered":"2024-09-17T03:43:53.650344+0000","last_clean":"2024-09-17T03:43:53.650344+0000","last_became_active":"2024-09-17T03:43:53.648385+0000","last_became_peered":"2024-09-17T03:43:53.648385+0000","last_unstale":"2024-09-17T03:43:53.650344+0000","last_undegraded":"2024-09-17T03:43:53.650344+0000","last_fullsized":"2024-09-17T03:43:53.650344+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:26.061975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983703+0000","last_change":"2024-09-17T03:43:54.665253+0000","last_active":"2024-09-17T03:43:55.983703+0000","last_peered":"2024-09-17T03:43:55.983703+0000","last_clean":"2024-09-17T03:43:55.983703+0000","last_became_active":"2024-09-17T03:43:54.664937+0000","last_became_peered":"2024-09-17T03:43:54.664937+0000","last_unstale":"2024-09-17T03:43:55.983703+0000","last_undegraded":"2024-09-17T03:43:55.983703+0000","last_fullsized":"2024-09-17T03:43:55.983703+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:01.731823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647291+0000","last_change":"2024-09-17T03:43:53.647484+0000","last_active":"2024-09-17T03:43:55.647291+0000","last_peered":"2024-09-17T03:43:55.647291+0000","last_clean":"2024-09-17T03:43:55.647291+0000","last_became_active":"2024-09-17T03:43:53.647194+0000","last_became_peered":"2024-09-17T03:43:53.647194+0000","last_unstale":"2024-09-17T03:43:55.647291+0000","last_undegraded":"2024-09-17T03:43:55.647291+0000","last_fullsized":"2024-09-17T03:43:55.647291+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:20.612852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.638176+0000","last_change":"2024-09-17T03:43:53.638176+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.638176+0000","last_undegraded":"2024-09-17T03:43:53.638176+0000","last_fullsized":"2024-09-17T03:43:53.638176+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653176+0000","last_change":"2024-09-17T03:43:53.652497+0000","last_active":"2024-09-17T03:43:53.653176+0000","last_peered":"2024-09-17T03:43:53.653176+0000","last_clean":"2024-09-17T03:43:53.653176+0000","last_became_active":"2024-09-17T03:43:53.651068+0000","last_became_peered":"2024-09-17T03:43:53.651068+0000","last_unstale":"2024-09-17T03:43:53.653176+0000","last_undegraded":"2024-09-17T03:43:53.653176+0000","last_fullsized":"2024-09-17T03:43:53.653176+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:04.341701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637266+0000","last_change":"2024-09-17T03:43:53.637266+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637266+0000","last_undegraded":"2024-09-17T03:43:53.637266+0000","last_fullsized":"2024-09-17T03:43:53.637266+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649313+0000","last_change":"2024-09-17T03:43:53.643934+0000","last_active":"2024-09-17T03:43:53.649313+0000","last_peered":"2024-09-17T03:43:53.649313+0000","last_clean":"2024-09-17T03:43:53.649313+0000","last_became_active":"2024-09-17T03:43:53.643624+0000","last_became_peered":"2024-09-17T03:43:53.643624+0000","last_unstale":"2024-09-17T03:43:53.649313+0000","last_undegraded":"2024-09-17T03:43:53.649313+0000","last_fullsized":"2024-09-17T03:43:53.649313+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:25.977167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984066+0000","last_change":"2024-09-17T03:43:54.671058+0000","last_active":"2024-09-17T03:43:55.984066+0000","last_peered":"2024-09-17T03:43:55.984066+0000","last_clean":"2024-09-17T03:43:55.984066+0000","last_became_active":"2024-09-17T03:43:54.670052+0000","last_became_peered":"2024-09-17T03:43:54.670052+0000","last_unstale":"2024-09-17T03:43:55.984066+0000","last_undegraded":"2024-09-17T03:43:55.984066+0000","last_fullsized":"2024-09-17T03:43:55.984066+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:29.400392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647787+0000","last_change":"2024-09-17T03:43:53.649241+0000","last_active":"2024-09-17T03:43:55.647787+0000","last_peered":"2024-09-17T03:43:55.647787+0000","last_clean":"2024-09-17T03:43:55.647787+0000","last_became_active":"2024-09-17T03:43:53.648942+0000","last_became_peered":"2024-09-17T03:43:53.648942+0000","last_unstale":"2024-09-17T03:43:55.647787+0000","last_undegraded":"2024-09-17T03:43:55.647787+0000","last_fullsized":"2024-09-17T03:43:55.647787+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983902+0000","last_change":"2024-09-17T03:43:54.662331+0000","last_active":"2024-09-17T03:43:55.983902+0000","last_peered":"2024-09-17T03:43:55.983902+0000","last_clean":"2024-09-17T03:43:55.983902+0000","last_became_active":"2024-09-17T03:43:54.661020+0000","last_became_peered":"2024-09-17T03:43:54.661020+0000","last_unstale":"2024-09-17T03:43:55.983902+0000","last_undegraded":"2024-09-17T03:43:55.983902+0000","last_fullsized":"2024-09-17T03:43:55.983902+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:48.585042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.652175+0000","last_change":"2024-09-17T03:43:53.651532+0000","last_active":"2024-09-17T03:43:53.652175+0000","last_peered":"2024-09-17T03:43:53.652175+0000","last_clean":"2024-09-17T03:43:53.652175+0000","last_became_active":"2024-09-17T03:43:53.651190+0000","last_became_peered":"2024-09-17T03:43:53.651190+0000","last_unstale":"2024-09-17T03:43:53.652175+0000","last_undegraded":"2024-09-17T03:43:53.652175+0000","last_fullsized":"2024-09-17T03:43:53.652175+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:13.978089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639534+0000","last_change":"2024-09-17T03:43:53.639534+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639534+0000","last_undegraded":"2024-09-17T03:43:53.639534+0000","last_fullsized":"2024-09-17T03:43:53.639534+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.648583+0000","last_change":"2024-09-17T03:43:53.646384+0000","last_active":"2024-09-17T03:43:53.648583+0000","last_peered":"2024-09-17T03:43:53.648583+0000","last_clean":"2024-09-17T03:43:53.648583+0000","last_became_active":"2024-09-17T03:43:53.646041+0000","last_became_peered":"2024-09-17T03:43:53.646041+0000","last_unstale":"2024-09-17T03:43:53.648583+0000","last_undegraded":"2024-09-17T03:43:53.648583+0000","last_fullsized":"2024-09-17T03:43:53.648583+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:20.916357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.636893+0000","last_change":"2024-09-17T03:43:53.636893+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.636893+0000","last_undegraded":"2024-09-17T03:43:53.636893+0000","last_fullsized":"2024-09-17T03:43:53.636893+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649283+0000","last_change":"2024-09-17T03:43:53.645944+0000","last_active":"2024-09-17T03:43:53.649283+0000","last_peered":"2024-09-17T03:43:53.649283+0000","last_clean":"2024-09-17T03:43:53.649283+0000","last_became_active":"2024-09-17T03:43:53.645640+0000","last_became_peered":"2024-09-17T03:43:53.645640+0000","last_unstale":"2024-09-17T03:43:53.649283+0000","last_undegraded":"2024-09-17T03:43:53.649283+0000","last_fullsized":"2024-09-17T03:43:53.649283+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:27.524711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637653+0000","last_change":"2024-09-17T03:43:53.637653+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637653+0000","last_undegraded":"2024-09-17T03:43:53.637653+0000","last_fullsized":"2024-09-17T03:43:53.637653+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649893+0000","last_change":"2024-09-17T03:43:53.648560+0000","last_active":"2024-09-17T03:43:53.649893+0000","last_peered":"2024-09-17T03:43:53.649893+0000","last_clean":"2024-09-17T03:43:53.649893+0000","last_became_active":"2024-09-17T03:43:53.648255+0000","last_became_peered":"2024-09-17T03:43:53.648255+0000","last_unstale":"2024-09-17T03:43:53.649893+0000","last_undegraded":"2024-09-17T03:43:53.649893+0000","last_fullsized":"2024-09-17T03:43:53.649893+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:04.159623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640284+0000","last_change":"2024-09-17T03:43:53.640284+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640284+0000","last_undegraded":"2024-09-17T03:43:53.640284+0000","last_fullsized":"2024-09-17T03:43:53.640284+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649600+0000","last_change":"2024-09-17T03:43:53.647435+0000","last_active":"2024-09-17T03:43:53.649600+0000","last_peered":"2024-09-17T03:43:53.649600+0000","last_clean":"2024-09-17T03:43:53.649600+0000","last_became_active":"2024-09-17T03:43:53.647090+0000","last_became_peered":"2024-09-17T03:43:53.647090+0000","last_unstale":"2024-09-17T03:43:53.649600+0000","last_undegraded":"2024-09-17T03:43:53.649600+0000","last_fullsized":"2024-09-17T03:43:53.649600+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:07.644765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.643498+0000","last_change":"2024-09-17T03:43:53.643498+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.643498+0000","last_undegraded":"2024-09-17T03:43:53.643498+0000","last_fullsized":"2024-09-17T03:43:53.643498+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983757+0000","last_change":"2024-09-17T03:43:53.650612+0000","last_active":"2024-09-17T03:43:55.983757+0000","last_peered":"2024-09-17T03:43:55.983757+0000","last_clean":"2024-09-17T03:43:55.983757+0000","last_became_active":"2024-09-17T03:43:53.650247+0000","last_became_peered":"2024-09-17T03:43:53.650247+0000","last_unstale":"2024-09-17T03:43:55.983757+0000","last_undegraded":"2024-09-17T03:43:55.983757+0000","last_fullsized":"2024-09-17T03:43:55.983757+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:11.707083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634165+0000","last_change":"2024-09-17T03:43:53.634165+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634165+0000","last_undegraded":"2024-09-17T03:43:53.634165+0000","last_fullsized":"2024-09-17T03:43:53.634165+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.653158+0000","last_change":"2024-09-17T03:43:53.652033+0000","last_active":"2024-09-17T03:43:53.653158+0000","last_peered":"2024-09-17T03:43:53.653158+0000","last_clean":"2024-09-17T03:43:53.653158+0000","last_became_active":"2024-09-17T03:43:53.651598+0000","last_became_peered":"2024-09-17T03:43:53.651598+0000","last_unstale":"2024-09-17T03:43:53.653158+0000","last_undegraded":"2024-09-17T03:43:53.653158+0000","last_fullsized":"2024-09-17T03:43:53.653158+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:54.720646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637062+0000","last_change":"2024-09-17T03:43:53.637062+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637062+0000","last_undegraded":"2024-09-17T03:43:53.637062+0000","last_fullsized":"2024-09-17T03:43:53.637062+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.651661+0000","last_change":"2024-09-17T03:43:53.650894+0000","last_active":"2024-09-17T03:43:53.651661+0000","last_peered":"2024-09-17T03:43:53.651661+0000","last_clean":"2024-09-17T03:43:53.651661+0000","last_became_active":"2024-09-17T03:43:53.650585+0000","last_became_peered":"2024-09-17T03:43:53.650585+0000","last_unstale":"2024-09-17T03:43:53.651661+0000","last_undegraded":"2024-09-17T03:43:53.651661+0000","last_fullsized":"2024-09-17T03:43:53.651661+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:32.571954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647562+0000","last_change":"2024-09-17T03:43:54.668026+0000","last_active":"2024-09-17T03:43:55.647562+0000","last_peered":"2024-09-17T03:43:55.647562+0000","last_clean":"2024-09-17T03:43:55.647562+0000","last_became_active":"2024-09-17T03:43:54.667733+0000","last_became_peered":"2024-09-17T03:43:54.667733+0000","last_unstale":"2024-09-17T03:43:55.647562+0000","last_undegraded":"2024-09-17T03:43:55.647562+0000","last_fullsized":"2024-09-17T03:43:55.647562+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:29.670536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.650843+0000","last_change":"2024-09-17T03:43:53.649967+0000","last_active":"2024-09-17T03:43:53.650843+0000","last_peered":"2024-09-17T03:43:53.650843+0000","last_clean":"2024-09-17T03:43:53.650843+0000","last_became_active":"2024-09-17T03:43:53.649642+0000","last_became_peered":"2024-09-17T03:43:53.649642+0000","last_unstale":"2024-09-17T03:43:53.650843+0000","last_undegraded":"2024-09-17T03:43:53.650843+0000","last_fullsized":"2024-09-17T03:43:53.650843+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:00.932873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647921+0000","last_change":"2024-09-17T03:43:54.666057+0000","last_active":"2024-09-17T03:43:55.647921+0000","last_peered":"2024-09-17T03:43:55.647921+0000","last_clean":"2024-09-17T03:43:55.647921+0000","last_became_active":"2024-09-17T03:43:54.665692+0000","last_became_peered":"2024-09-17T03:43:54.665692+0000","last_unstale":"2024-09-17T03:43:55.647921+0000","last_undegraded":"2024-09-17T03:43:55.647921+0000","last_fullsized":"2024-09-17T03:43:55.647921+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:35.834253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647451+0000","last_change":"2024-09-17T03:43:53.648302+0000","last_active":"2024-09-17T03:43:55.647451+0000","last_peered":"2024-09-17T03:43:55.647451+0000","last_clean":"2024-09-17T03:43:55.647451+0000","last_became_active":"2024-09-17T03:43:53.647956+0000","last_became_peered":"2024-09-17T03:43:53.647956+0000","last_unstale":"2024-09-17T03:43:55.647451+0000","last_undegraded":"2024-09-17T03:43:55.647451+0000","last_fullsized":"2024-09-17T03:43:55.647451+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:06.888162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.640232+0000","last_change":"2024-09-17T03:43:53.640232+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.640232+0000","last_undegraded":"2024-09-17T03:43:53.640232+0000","last_fullsized":"2024-09-17T03:43:53.640232+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983991+0000","last_change":"2024-09-17T03:43:53.646019+0000","last_active":"2024-09-17T03:43:55.983991+0000","last_peered":"2024-09-17T03:43:55.983991+0000","last_clean":"2024-09-17T03:43:55.983991+0000","last_became_active":"2024-09-17T03:43:53.645555+0000","last_became_peered":"2024-09-17T03:43:53.645555+0000","last_unstale":"2024-09-17T03:43:55.983991+0000","last_undegraded":"2024-09-17T03:43:55.983991+0000","last_fullsized":"2024-09-17T03:43:55.983991+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:12.150493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.641592+0000","last_change":"2024-09-17T03:43:53.641592+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.641592+0000","last_undegraded":"2024-09-17T03:43:53.641592+0000","last_fullsized":"2024-09-17T03:43:53.641592+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983792+0000","last_change":"2024-09-17T03:43:53.648330+0000","last_active":"2024-09-17T03:43:55.983792+0000","last_peered":"2024-09-17T03:43:55.983792+0000","last_clean":"2024-09-17T03:43:55.983792+0000","last_became_active":"2024-09-17T03:43:53.648045+0000","last_became_peered":"2024-09-17T03:43:53.648045+0000","last_unstale":"2024-09-17T03:43:55.983792+0000","last_undegraded":"2024-09-17T03:43:55.983792+0000","last_fullsized":"2024-09-17T03:43:55.983792+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:26.973084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.639774+0000","last_change":"2024-09-17T03:43:53.639774+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.639774+0000","last_undegraded":"2024-09-17T03:43:53.639774+0000","last_fullsized":"2024-09-17T03:43:53.639774+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.649737+0000","last_change":"2024-09-17T03:43:53.648567+0000","last_active":"2024-09-17T03:43:53.649737+0000","last_peered":"2024-09-17T03:43:53.649737+0000","last_clean":"2024-09-17T03:43:53.649737+0000","last_became_active":"2024-09-17T03:43:53.648198+0000","last_became_peered":"2024-09-17T03:43:53.648198+0000","last_unstale":"2024-09-17T03:43:53.649737+0000","last_undegraded":"2024-09-17T03:43:53.649737+0000","last_fullsized":"2024-09-17T03:43:53.649737+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:45.353160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.634696+0000","last_change":"2024-09-17T03:43:53.634696+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.634696+0000","last_undegraded":"2024-09-17T03:43:53.634696+0000","last_fullsized":"2024-09-17T03:43:53.634696+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.640773+0000","last_change":"2024-09-17T03:43:53.636144+0000","last_active":"2024-09-17T03:43:53.640773+0000","last_peered":"2024-09-17T03:43:53.640773+0000","last_clean":"2024-09-17T03:43:53.640773+0000","last_became_active":"2024-09-17T03:43:53.635853+0000","last_became_peered":"2024-09-17T03:43:53.635853+0000","last_unstale":"2024-09-17T03:43:53.640773+0000","last_undegraded":"2024-09-17T03:43:53.640773+0000","last_fullsized":"2024-09-17T03:43:53.640773+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:25.838359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":163,"state":"creating+peering","last_fresh":"2024-09-17T03:43:53.637757+0000","last_change":"2024-09-17T03:43:53.637757+0000","last_active":"2024-09-17T03:43:53.624874+0000","last_peered":"2024-09-17T03:43:53.624874+0000","last_clean":"2024-09-17T03:43:53.624874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:43:53.637757+0000","last_undegraded":"2024-09-17T03:43:53.637757+0000","last_fullsized":"2024-09-17T03:43:53.637757+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.652056+0000","last_change":"2024-09-17T03:43:53.650336+0000","last_active":"2024-09-17T03:43:53.652056+0000","last_peered":"2024-09-17T03:43:53.652056+0000","last_clean":"2024-09-17T03:43:53.652056+0000","last_became_active":"2024-09-17T03:43:53.649990+0000","last_became_peered":"2024-09-17T03:43:53.649990+0000","last_unstale":"2024-09-17T03:43:53.652056+0000","last_undegraded":"2024-09-17T03:43:53.652056+0000","last_fullsized":"2024-09-17T03:43:53.652056+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:01.238542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":371,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T03:43:53.643514+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:43:53.643514+0000","last_peered":"2024-09-17T03:43:53.643514+0000","last_clean":"2024-09-17T03:43:53.643514+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:43:53.643514+0000","last_undegraded":"2024-09-17T03:43:53.643514+0000","last_fullsized":"2024-09-17T03:43:53.643514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509577,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60140,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311700,"statfs":{"total":96636764160,"available":96575180800,"internally_reserved":0,"allocated":2637824,"data_stored":1487753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509577,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59556,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312284,"statfs":{"total":96636764160,"available":96575778816,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509577,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63716,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308124,"statfs":{"total":96636764160,"available":96571518976,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509577,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55396,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316444,"statfs":{"total":96636764160,"available":96580038656,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509578,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55396,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316444,"statfs":{"total":96636764160,"available":96580038656,"internally_reserved":0,"allocated":2043904,"data_stored":897385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509578,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51816,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320024,"statfs":{"total":96636764160,"available":96583704576,"internally_reserved":0,"allocated":2637824,"data_stored":1487753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55416,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316424,"statfs":{"total":96636764160,"available":96580018176,"internally_reserved":0,"allocated":2068480,"data_stored":910460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55436,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316404,"statfs":{"total":96636764160,"available":96579997696,"internally_reserved":0,"allocated":2080768,"data_stored":910654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:43:59.384 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3f is not active+clean 2024-09-17T03:43:59.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.643650+0000', 'last_change': '2024-09-17T03:43:53.643650+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.643650+0000', 'last_undegraded': '2024-09-17T03:43:53.643650+0000', 'last_fullsized': '2024-09-17T03:43:53.643650+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:43:59.384 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3e is not active+clean 2024-09-17T03:43:59.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.638475+0000', 'last_change': '2024-09-17T03:43:53.638475+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.638475+0000', 'last_undegraded': '2024-09-17T03:43:53.638475+0000', 'last_fullsized': '2024-09-17T03:43:53.638475+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:43:59.384 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3d is not active+clean 2024-09-17T03:43:59.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.635612+0000', 'last_change': '2024-09-17T03:43:53.635612+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.635612+0000', 'last_undegraded': '2024-09-17T03:43:53.635612+0000', 'last_fullsized': '2024-09-17T03:43:53.635612+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:43:59.385 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3c is not active+clean 2024-09-17T03:43:59.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.636821+0000', 'last_change': '2024-09-17T03:43:53.636821+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.636821+0000', 'last_undegraded': '2024-09-17T03:43:53.636821+0000', 'last_fullsized': '2024-09-17T03:43:53.636821+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:43:59.385 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3b is not active+clean 2024-09-17T03:43:59.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.641313+0000', 'last_change': '2024-09-17T03:43:53.641313+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.641313+0000', 'last_undegraded': '2024-09-17T03:43:53.641313+0000', 'last_fullsized': '2024-09-17T03:43:53.641313+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:43:59.385 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3a is not active+clean 2024-09-17T03:43:59.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.635123+0000', 'last_change': '2024-09-17T03:43:53.635123+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.635123+0000', 'last_undegraded': '2024-09-17T03:43:53.635123+0000', 'last_fullsized': '2024-09-17T03:43:53.635123+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:43:59.385 INFO:tasks.ceph.ceph_manager.ceph:PG 25.39 is not active+clean 2024-09-17T03:43:59.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.639696+0000', 'last_change': '2024-09-17T03:43:53.639696+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.639696+0000', 'last_undegraded': '2024-09-17T03:43:53.639696+0000', 'last_fullsized': '2024-09-17T03:43:53.639696+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:43:59.386 INFO:tasks.ceph.ceph_manager.ceph:PG 25.36 is not active+clean 2024-09-17T03:43:59.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.637798+0000', 'last_change': '2024-09-17T03:43:53.637798+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.637798+0000', 'last_undegraded': '2024-09-17T03:43:53.637798+0000', 'last_fullsized': '2024-09-17T03:43:53.637798+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:43:59.386 INFO:tasks.ceph.ceph_manager.ceph:PG 25.35 is not active+clean 2024-09-17T03:43:59.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.639578+0000', 'last_change': '2024-09-17T03:43:53.639578+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.639578+0000', 'last_undegraded': '2024-09-17T03:43:53.639578+0000', 'last_fullsized': '2024-09-17T03:43:53.639578+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:43:59.386 INFO:tasks.ceph.ceph_manager.ceph:PG 25.34 is not active+clean 2024-09-17T03:43:59.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.636288+0000', 'last_change': '2024-09-17T03:43:53.636288+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.636288+0000', 'last_undegraded': '2024-09-17T03:43:53.636288+0000', 'last_fullsized': '2024-09-17T03:43:53.636288+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:43:59.386 INFO:tasks.ceph.ceph_manager.ceph:PG 25.33 is not active+clean 2024-09-17T03:43:59.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.636418+0000', 'last_change': '2024-09-17T03:43:53.636418+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.636418+0000', 'last_undegraded': '2024-09-17T03:43:53.636418+0000', 'last_fullsized': '2024-09-17T03:43:53.636418+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:43:59.386 INFO:tasks.ceph.ceph_manager.ceph:PG 25.31 is not active+clean 2024-09-17T03:43:59.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.637365+0000', 'last_change': '2024-09-17T03:43:53.637365+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.637365+0000', 'last_undegraded': '2024-09-17T03:43:53.637365+0000', 'last_fullsized': '2024-09-17T03:43:53.637365+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:43:59.387 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2f is not active+clean 2024-09-17T03:43:59.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.635178+0000', 'last_change': '2024-09-17T03:43:53.635178+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.635178+0000', 'last_undegraded': '2024-09-17T03:43:53.635178+0000', 'last_fullsized': '2024-09-17T03:43:53.635178+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:43:59.387 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2e is not active+clean 2024-09-17T03:43:59.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.640752+0000', 'last_change': '2024-09-17T03:43:53.640752+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.640752+0000', 'last_undegraded': '2024-09-17T03:43:53.640752+0000', 'last_fullsized': '2024-09-17T03:43:53.640752+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:43:59.387 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2d is not active+clean 2024-09-17T03:43:59.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.639406+0000', 'last_change': '2024-09-17T03:43:53.639406+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.639406+0000', 'last_undegraded': '2024-09-17T03:43:53.639406+0000', 'last_fullsized': '2024-09-17T03:43:53.639406+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:43:59.387 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2c is not active+clean 2024-09-17T03:43:59.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.639480+0000', 'last_change': '2024-09-17T03:43:53.639480+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.639480+0000', 'last_undegraded': '2024-09-17T03:43:53.639480+0000', 'last_fullsized': '2024-09-17T03:43:53.639480+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:43:59.388 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2b is not active+clean 2024-09-17T03:43:59.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.640830+0000', 'last_change': '2024-09-17T03:43:53.640830+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.640830+0000', 'last_undegraded': '2024-09-17T03:43:53.640830+0000', 'last_fullsized': '2024-09-17T03:43:53.640830+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:43:59.388 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2a is not active+clean 2024-09-17T03:43:59.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.637865+0000', 'last_change': '2024-09-17T03:43:53.637865+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.637865+0000', 'last_undegraded': '2024-09-17T03:43:53.637865+0000', 'last_fullsized': '2024-09-17T03:43:53.637865+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:43:59.388 INFO:tasks.ceph.ceph_manager.ceph:PG 25.29 is not active+clean 2024-09-17T03:43:59.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.634598+0000', 'last_change': '2024-09-17T03:43:53.634598+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.634598+0000', 'last_undegraded': '2024-09-17T03:43:53.634598+0000', 'last_fullsized': '2024-09-17T03:43:53.634598+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:43:59.388 INFO:tasks.ceph.ceph_manager.ceph:PG 25.27 is not active+clean 2024-09-17T03:43:59.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.640033+0000', 'last_change': '2024-09-17T03:43:53.640033+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.640033+0000', 'last_undegraded': '2024-09-17T03:43:53.640033+0000', 'last_fullsized': '2024-09-17T03:43:53.640033+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:43:59.389 INFO:tasks.ceph.ceph_manager.ceph:PG 25.26 is not active+clean 2024-09-17T03:43:59.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.638133+0000', 'last_change': '2024-09-17T03:43:53.638133+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.638133+0000', 'last_undegraded': '2024-09-17T03:43:53.638133+0000', 'last_fullsized': '2024-09-17T03:43:53.638133+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:43:59.389 INFO:tasks.ceph.ceph_manager.ceph:PG 25.25 is not active+clean 2024-09-17T03:43:59.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.633823+0000', 'last_change': '2024-09-17T03:43:53.633823+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.633823+0000', 'last_undegraded': '2024-09-17T03:43:53.633823+0000', 'last_fullsized': '2024-09-17T03:43:53.633823+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:43:59.389 INFO:tasks.ceph.ceph_manager.ceph:PG 25.24 is not active+clean 2024-09-17T03:43:59.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.633750+0000', 'last_change': '2024-09-17T03:43:53.633750+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.633750+0000', 'last_undegraded': '2024-09-17T03:43:53.633750+0000', 'last_fullsized': '2024-09-17T03:43:53.633750+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:43:59.389 INFO:tasks.ceph.ceph_manager.ceph:PG 25.23 is not active+clean 2024-09-17T03:43:59.389 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.635784+0000', 'last_change': '2024-09-17T03:43:53.635784+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.635784+0000', 'last_undegraded': '2024-09-17T03:43:53.635784+0000', 'last_fullsized': '2024-09-17T03:43:53.635784+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:43:59.390 INFO:tasks.ceph.ceph_manager.ceph:PG 25.21 is not active+clean 2024-09-17T03:43:59.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.634054+0000', 'last_change': '2024-09-17T03:43:53.634054+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.634054+0000', 'last_undegraded': '2024-09-17T03:43:53.634054+0000', 'last_fullsized': '2024-09-17T03:43:53.634054+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:43:59.390 INFO:tasks.ceph.ceph_manager.ceph:PG 25.20 is not active+clean 2024-09-17T03:43:59.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.634542+0000', 'last_change': '2024-09-17T03:43:53.634542+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.634542+0000', 'last_undegraded': '2024-09-17T03:43:53.634542+0000', 'last_fullsized': '2024-09-17T03:43:53.634542+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:43:59.390 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1f is not active+clean 2024-09-17T03:43:59.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.637567+0000', 'last_change': '2024-09-17T03:43:53.637567+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.637567+0000', 'last_undegraded': '2024-09-17T03:43:53.637567+0000', 'last_fullsized': '2024-09-17T03:43:53.637567+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:43:59.390 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1c is not active+clean 2024-09-17T03:43:59.390 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.640246+0000', 'last_change': '2024-09-17T03:43:53.640246+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.640246+0000', 'last_undegraded': '2024-09-17T03:43:53.640246+0000', 'last_fullsized': '2024-09-17T03:43:53.640246+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:43:59.391 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1a is not active+clean 2024-09-17T03:43:59.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.637382+0000', 'last_change': '2024-09-17T03:43:53.637382+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.637382+0000', 'last_undegraded': '2024-09-17T03:43:53.637382+0000', 'last_fullsized': '2024-09-17T03:43:53.637382+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:43:59.391 INFO:tasks.ceph.ceph_manager.ceph:PG 25.19 is not active+clean 2024-09-17T03:43:59.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.638697+0000', 'last_change': '2024-09-17T03:43:53.638697+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.638697+0000', 'last_undegraded': '2024-09-17T03:43:53.638697+0000', 'last_fullsized': '2024-09-17T03:43:53.638697+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:43:59.391 INFO:tasks.ceph.ceph_manager.ceph:PG 25.16 is not active+clean 2024-09-17T03:43:59.391 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.634529+0000', 'last_change': '2024-09-17T03:43:53.634529+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.634529+0000', 'last_undegraded': '2024-09-17T03:43:53.634529+0000', 'last_fullsized': '2024-09-17T03:43:53.634529+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:43:59.392 INFO:tasks.ceph.ceph_manager.ceph:PG 25.14 is not active+clean 2024-09-17T03:43:59.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.639212+0000', 'last_change': '2024-09-17T03:43:53.639212+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.639212+0000', 'last_undegraded': '2024-09-17T03:43:53.639212+0000', 'last_fullsized': '2024-09-17T03:43:53.639212+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:43:59.392 INFO:tasks.ceph.ceph_manager.ceph:PG 25.15 is not active+clean 2024-09-17T03:43:59.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.638941+0000', 'last_change': '2024-09-17T03:43:53.638941+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.638941+0000', 'last_undegraded': '2024-09-17T03:43:53.638941+0000', 'last_fullsized': '2024-09-17T03:43:53.638941+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:43:59.392 INFO:tasks.ceph.ceph_manager.ceph:PG 25.12 is not active+clean 2024-09-17T03:43:59.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.633751+0000', 'last_change': '2024-09-17T03:43:53.633751+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.633751+0000', 'last_undegraded': '2024-09-17T03:43:53.633751+0000', 'last_fullsized': '2024-09-17T03:43:53.633751+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:43:59.392 INFO:tasks.ceph.ceph_manager.ceph:PG 25.13 is not active+clean 2024-09-17T03:43:59.392 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.638286+0000', 'last_change': '2024-09-17T03:43:53.638286+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.638286+0000', 'last_undegraded': '2024-09-17T03:43:53.638286+0000', 'last_fullsized': '2024-09-17T03:43:53.638286+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:43:59.393 INFO:tasks.ceph.ceph_manager.ceph:PG 25.11 is not active+clean 2024-09-17T03:43:59.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.638176+0000', 'last_change': '2024-09-17T03:43:53.638176+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.638176+0000', 'last_undegraded': '2024-09-17T03:43:53.638176+0000', 'last_fullsized': '2024-09-17T03:43:53.638176+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:43:59.393 INFO:tasks.ceph.ceph_manager.ceph:PG 25.e is not active+clean 2024-09-17T03:43:59.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.637266+0000', 'last_change': '2024-09-17T03:43:53.637266+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.637266+0000', 'last_undegraded': '2024-09-17T03:43:53.637266+0000', 'last_fullsized': '2024-09-17T03:43:53.637266+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:43:59.393 INFO:tasks.ceph.ceph_manager.ceph:PG 25.d is not active+clean 2024-09-17T03:43:59.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.639534+0000', 'last_change': '2024-09-17T03:43:53.639534+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.639534+0000', 'last_undegraded': '2024-09-17T03:43:53.639534+0000', 'last_fullsized': '2024-09-17T03:43:53.639534+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:43:59.393 INFO:tasks.ceph.ceph_manager.ceph:PG 25.a is not active+clean 2024-09-17T03:43:59.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.636893+0000', 'last_change': '2024-09-17T03:43:53.636893+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.636893+0000', 'last_undegraded': '2024-09-17T03:43:53.636893+0000', 'last_fullsized': '2024-09-17T03:43:53.636893+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:43:59.393 INFO:tasks.ceph.ceph_manager.ceph:PG 25.b is not active+clean 2024-09-17T03:43:59.393 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.637653+0000', 'last_change': '2024-09-17T03:43:53.637653+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.637653+0000', 'last_undegraded': '2024-09-17T03:43:53.637653+0000', 'last_fullsized': '2024-09-17T03:43:53.637653+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:43:59.393 INFO:tasks.ceph.ceph_manager.ceph:PG 25.8 is not active+clean 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.640284+0000', 'last_change': '2024-09-17T03:43:53.640284+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.640284+0000', 'last_undegraded': '2024-09-17T03:43:53.640284+0000', 'last_fullsized': '2024-09-17T03:43:53.640284+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:PG 25.9 is not active+clean 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.643498+0000', 'last_change': '2024-09-17T03:43:53.643498+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.643498+0000', 'last_undegraded': '2024-09-17T03:43:53.643498+0000', 'last_fullsized': '2024-09-17T03:43:53.643498+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:PG 25.6 is not active+clean 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.634165+0000', 'last_change': '2024-09-17T03:43:53.634165+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.634165+0000', 'last_undegraded': '2024-09-17T03:43:53.634165+0000', 'last_fullsized': '2024-09-17T03:43:53.634165+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:PG 25.7 is not active+clean 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.637062+0000', 'last_change': '2024-09-17T03:43:53.637062+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.637062+0000', 'last_undegraded': '2024-09-17T03:43:53.637062+0000', 'last_fullsized': '2024-09-17T03:43:53.637062+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2 is not active+clean 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.640232+0000', 'last_change': '2024-09-17T03:43:53.640232+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.640232+0000', 'last_undegraded': '2024-09-17T03:43:53.640232+0000', 'last_fullsized': '2024-09-17T03:43:53.640232+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3 is not active+clean 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.641592+0000', 'last_change': '2024-09-17T03:43:53.641592+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.641592+0000', 'last_undegraded': '2024-09-17T03:43:53.641592+0000', 'last_fullsized': '2024-09-17T03:43:53.641592+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:43:59.394 INFO:tasks.ceph.ceph_manager.ceph:PG 25.0 is not active+clean 2024-09-17T03:43:59.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.639774+0000', 'last_change': '2024-09-17T03:43:53.639774+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.639774+0000', 'last_undegraded': '2024-09-17T03:43:53.639774+0000', 'last_fullsized': '2024-09-17T03:43:53.639774+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:43:59.395 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1 is not active+clean 2024-09-17T03:43:59.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.634696+0000', 'last_change': '2024-09-17T03:43:53.634696+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.634696+0000', 'last_undegraded': '2024-09-17T03:43:53.634696+0000', 'last_fullsized': '2024-09-17T03:43:53.634696+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:43:59.395 INFO:tasks.ceph.ceph_manager.ceph:PG 25.18 is not active+clean 2024-09-17T03:43:59.395 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 163, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:43:53.637757+0000', 'last_change': '2024-09-17T03:43:53.637757+0000', 'last_active': '2024-09-17T03:43:53.624874+0000', 'last_peered': '2024-09-17T03:43:53.624874+0000', 'last_clean': '2024-09-17T03:43:53.624874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:43:53.637757+0000', 'last_undegraded': '2024-09-17T03:43:53.637757+0000', 'last_fullsized': '2024-09-17T03:43:53.637757+0000', 'mapping_epoch': 163, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 163, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'last_clean_scrub_stamp': '2024-09-17T03:43:53.624874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:43:59.395 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:43:59.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:43:59.424 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:43:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.534+0000 7ff09f982640 1 -- 172.21.15.146:0/3248564562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980cdc50 msgr2=0x7ff0980b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.534+0000 7ff09f982640 1 --2- 172.21.15.146:0/3248564562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980cdc50 0x7ff0980b4ba0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7ff090005fd0 tx=0x7ff09002a820 comp rx=0 tx=0).stop 2024-09-17T03:43:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.534+0000 7ff09f982640 1 -- 172.21.15.146:0/3248564562 shutdown_connections 2024-09-17T03:43:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.534+0000 7ff09f982640 1 --2- 172.21.15.146:0/3248564562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980cdc50 0x7ff0980b4ba0 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.534+0000 7ff09f982640 1 --2- 172.21.15.146:0/3248564562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09815c8e0 0x7ff09806f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.534+0000 7ff09f982640 1 -- 172.21.15.146:0/3248564562 >> 172.21.15.146:0/3248564562 conn(0x7ff0980b3150 msgr2=0x7ff0980b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.534+0000 7ff09f982640 1 -- 172.21.15.146:0/3248564562 shutdown_connections 2024-09-17T03:43:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.534+0000 7ff09f982640 1 -- 172.21.15.146:0/3248564562 wait complete. 2024-09-17T03:43:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.536+0000 7ff09f982640 1 Processor -- start 2024-09-17T03:43:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.536+0000 7ff09f982640 1 -- start start 2024-09-17T03:43:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09f982640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0980cd840 0x7ff098141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09f982640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980cdc50 0x7ff0981573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09f982640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09815c8e0 0x7ff098154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09f982640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff0980b5470 con 0x7ff0980cdc50 2024-09-17T03:43:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09f982640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff0980b52f0 con 0x7ff0980cd840 2024-09-17T03:43:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09f982640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff098073580 con 0x7ff09815c8e0 2024-09-17T03:43:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09cf1d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980cdc50 0x7ff0981573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09cf1d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980cdc50 0x7ff0981573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43894/0 (socket says 172.21.15.146:43894) 2024-09-17T03:43:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09cf1d640 1 -- 172.21.15.146:0/589615320 learned_addr learned my addr 172.21.15.146:0/589615320 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09df1f640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09815c8e0 0x7ff098154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09d71e640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0980cd840 0x7ff098141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09cf1d640 1 -- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09815c8e0 msgr2=0x7ff098154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09cf1d640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09815c8e0 0x7ff098154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09cf1d640 1 -- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0980cd840 msgr2=0x7ff098141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09cf1d640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0980cd840 0x7ff098141780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09cf1d640 1 -- 172.21.15.146:0/589615320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0981441e0 con 0x7ff0980cdc50 2024-09-17T03:43:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09df1f640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09815c8e0 0x7ff098154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:43:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.537+0000 7ff09cf1d640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980cdc50 0x7ff0981573a0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7ff08800c390 tx=0x7ff08800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.538+0000 7ff08dffb640 1 -- 172.21.15.146:0/589615320 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088017070 con 0x7ff0980cdc50 2024-09-17T03:43:59.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.538+0000 7ff08dffb640 1 -- 172.21.15.146:0/589615320 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0880035f0 con 0x7ff0980cdc50 2024-09-17T03:43:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.538+0000 7ff08dffb640 1 -- 172.21.15.146:0/589615320 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088003a20 con 0x7ff0980cdc50 2024-09-17T03:43:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.538+0000 7ff09f982640 1 -- 172.21.15.146:0/589615320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0981444c0 con 0x7ff0980cdc50 2024-09-17T03:43:59.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.538+0000 7ff09f982640 1 -- 172.21.15.146:0/589615320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff098144a80 con 0x7ff0980cdc50 2024-09-17T03:43:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.539+0000 7ff09f982640 1 -- 172.21.15.146:0/589615320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0980b4ba0 con 0x7ff0980cdc50 2024-09-17T03:43:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.540+0000 7ff08dffb640 1 -- 172.21.15.146:0/589615320 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff08801a070 con 0x7ff0980cdc50 2024-09-17T03:43:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.540+0000 7ff08dffb640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff07c078b90 0x7ff07c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.540+0000 7ff08dffb640 1 -- 172.21.15.146:0/589615320 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7ff08809a070 con 0x7ff0980cdc50 2024-09-17T03:43:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.540+0000 7ff09d71e640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff07c078b90 0x7ff07c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.541+0000 7ff09d71e640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff07c078b90 0x7ff07c07b0a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff09400b810 tx=0x7ff094008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:59.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.545+0000 7ff08dffb640 1 -- 172.21.15.146:0/589615320 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff0880624b0 con 0x7ff0980cdc50 2024-09-17T03:43:59.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.788+0000 7ff09f982640 1 -- 172.21.15.146:0/589615320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff098143f70 con 0x7ff0980cdc50 2024-09-17T03:43:59.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.788+0000 7ff08dffb640 1 -- 172.21.15.146:0/589615320 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1304 (secure 0 0 0) 0x7ff088061db0 con 0x7ff0980cdc50 2024-09-17T03:43:59.788 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:43:59.789 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":684,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":165,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":49},{"state_name":"active+clean","count":48}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590368,"bytes_used":467836928,"bytes_avail":772626276352,"bytes_total":773094113280,"inactive_pgs_ratio":0.50515460968017578,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":125,"btime":"2024-09-17T03:43:57:668195+0000","id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"a","status":"up:active","gid":10251}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-17T03:43:49.963839+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:43:59.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 -- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff07c078b90 msgr2=0x7ff07c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff07c078b90 0x7ff07c07b0a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff09400b810 tx=0x7ff094008040 comp rx=0 tx=0).stop 2024-09-17T03:43:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 -- 172.21.15.146:0/589615320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980cdc50 msgr2=0x7ff0981573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980cdc50 0x7ff0981573a0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7ff08800c390 tx=0x7ff08800c850 comp rx=0 tx=0).stop 2024-09-17T03:43:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 -- 172.21.15.146:0/589615320 shutdown_connections 2024-09-17T03:43:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff07c078b90 0x7ff07c07b0a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff09815c8e0 0x7ff098154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0980cdc50 0x7ff0981573a0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 --2- 172.21.15.146:0/589615320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff0980cd840 0x7ff098141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 -- 172.21.15.146:0/589615320 >> 172.21.15.146:0/589615320 conn(0x7ff0980b3150 msgr2=0x7ff098075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:59.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 -- 172.21.15.146:0/589615320 shutdown_connections 2024-09-17T03:43:59.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.790+0000 7ff09f982640 1 -- 172.21.15.146:0/589615320 wait complete. 2024-09-17T03:43:59.802 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:43:59.802 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:43:59.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.916+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3192774283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b00b3870 msgr2=0x7fc8b00cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.916+0000 7fc8b5a20640 1 --2- 172.21.15.146:0/3192774283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b00b3870 0x7fc8b00cf370 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0068e80 tx=0x7fc8a002a890 comp rx=0 tx=0).stop 2024-09-17T03:43:59.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.916+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3192774283 shutdown_connections 2024-09-17T03:43:59.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.916+0000 7fc8b5a20640 1 --2- 172.21.15.146:0/3192774283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b00b3870 0x7fc8b00cf370 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.916+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3192774283 >> 172.21.15.146:0/3192774283 conn(0x7fc8b00d4be0 msgr2=0x7fc8b00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:43:59.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.916+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3192774283 shutdown_connections 2024-09-17T03:43:59.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.916+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3192774283 wait complete. 2024-09-17T03:43:59.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.917+0000 7fc8b5a20640 1 Processor -- start 2024-09-17T03:43:59.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.918+0000 7fc8b5a20640 1 -- start start 2024-09-17T03:43:59.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8b5a20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8b00b3870 0x7fc8b00b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8b5a20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b01620f0 0x7fc8b01f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8b5a20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8b01f6010 0x7fc8b00b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8b5a20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b00d3ce0 con 0x7fc8b01620f0 2024-09-17T03:43:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8b5a20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b00d3b60 con 0x7fc8b01f6010 2024-09-17T03:43:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8b5a20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b00d3e60 con 0x7fc8b00b3870 2024-09-17T03:43:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8ae7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b01620f0 0x7fc8b01f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8ae7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b01620f0 0x7fc8b01f5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43916/0 (socket says 172.21.15.146:43916) 2024-09-17T03:43:59.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8ae7fc640 1 -- 172.21.15.146:0/3297279112 learned_addr learned my addr 172.21.15.146:0/3297279112 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8af7fe640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8b01f6010 0x7fc8b00b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8aeffd640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8b00b3870 0x7fc8b00b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8ae7fc640 1 -- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8b00b3870 msgr2=0x7fc8b00b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8ae7fc640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8b00b3870 0x7fc8b00b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8ae7fc640 1 -- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8b01f6010 msgr2=0x7fc8b00b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8ae7fc640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8b01f6010 0x7fc8b00b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.919+0000 7fc8ae7fc640 1 -- 172.21.15.146:0/3297279112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b01f6700 con 0x7fc8b01620f0 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.920+0000 7fc8ae7fc640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b01620f0 0x7fc8b01f5ad0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400c370 tx=0x7fc8a400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.920+0000 7fc897fff640 1 -- 172.21.15.146:0/3297279112 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4017070 con 0x7fc8b01620f0 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.920+0000 7fc897fff640 1 -- 172.21.15.146:0/3297279112 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8a40035f0 con 0x7fc8b01620f0 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.920+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3297279112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b00cc7d0 con 0x7fc8b01620f0 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.920+0000 7fc897fff640 1 -- 172.21.15.146:0/3297279112 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4003a40 con 0x7fc8b01620f0 2024-09-17T03:43:59.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.920+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3297279112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b00b4890 con 0x7fc8b01620f0 2024-09-17T03:43:59.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.921+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3297279112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b00ccee0 con 0x7fc8b01620f0 2024-09-17T03:43:59.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.922+0000 7fc897fff640 1 -- 172.21.15.146:0/3297279112 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc8a401a070 con 0x7fc8b01620f0 2024-09-17T03:43:59.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.922+0000 7fc897fff640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc89c078b90 0x7fc89c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:43:59.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.922+0000 7fc897fff640 1 -- 172.21.15.146:0/3297279112 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fc8a409a2b0 con 0x7fc8b01620f0 2024-09-17T03:43:59.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.922+0000 7fc8aeffd640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc89c078b90 0x7fc89c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:43:59.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.923+0000 7fc8aeffd640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc89c078b90 0x7fc89c07b0a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0034000 tx=0x7fc8a0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:43:59.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:43:59.926+0000 7fc897fff640 1 -- 172.21.15.146:0/3297279112 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc8a4021020 con 0x7fc8b01620f0 2024-09-17T03:44:00.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.098+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3297279112 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc8b01f69e0 con 0x7fc89c078b90 2024-09-17T03:44:00.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.103+0000 7fc897fff640 1 -- 172.21.15.146:0/3297279112 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252474 (secure 0 0 0) 0x7fc8b01f69e0 con 0x7fc89c078b90 2024-09-17T03:44:00.106 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:00.107 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:44:00.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc89c078b90 msgr2=0x7fc89c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:00.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc89c078b90 0x7fc89c07b0a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0034000 tx=0x7fc8a0004ab0 comp rx=0 tx=0).stop 2024-09-17T03:44:00.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3297279112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b01620f0 msgr2=0x7fc8b01f5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:00.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b01620f0 0x7fc8b01f5ad0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400c370 tx=0x7fc8a400c830 comp rx=0 tx=0).stop 2024-09-17T03:44:00.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3297279112 shutdown_connections 2024-09-17T03:44:00.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc89c078b90 0x7fc89c07b0a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:00.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc8b01f6010 0x7fc8b00b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:00.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b01620f0 0x7fc8b01f5ad0 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:00.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 --2- 172.21.15.146:0/3297279112 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc8b00b3870 0x7fc8b00b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:00.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3297279112 >> 172.21.15.146:0/3297279112 conn(0x7fc8b00d4be0 msgr2=0x7fc8b015d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:00.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3297279112 shutdown_connections 2024-09-17T03:44:00.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:00.106+0000 7fc8b5a20640 1 -- 172.21.15.146:0/3297279112 wait complete. 2024-09-17T03:44:00.121 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":495,"stamp":"2024-09-17T03:43:59.966084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":457056,"kb_used_data":17384,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754517664,"statfs":{"total":773094113280,"available":772626087936,"internally_reserved":0,"allocated":17801216,"data_stored":8469236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.332804"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953840+0000","last_change":"2024-09-17T03:43:54.670351+0000","last_active":"2024-09-17T03:43:55.953840+0000","last_peered":"2024-09-17T03:43:55.953840+0000","last_clean":"2024-09-17T03:43:55.953840+0000","last_became_active":"2024-09-17T03:43:54.669817+0000","last_became_peered":"2024-09-17T03:43:54.669817+0000","last_unstale":"2024-09-17T03:43:55.953840+0000","last_undegraded":"2024-09-17T03:43:55.953840+0000","last_fullsized":"2024-09-17T03:43:55.953840+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:57.947479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653332+0000","last_change":"2024-09-17T03:43:54.663366+0000","last_active":"2024-09-17T03:43:55.653332+0000","last_peered":"2024-09-17T03:43:55.653332+0000","last_clean":"2024-09-17T03:43:55.653332+0000","last_became_active":"2024-09-17T03:43:54.660448+0000","last_became_peered":"2024-09-17T03:43:54.660448+0000","last_unstale":"2024-09-17T03:43:55.653332+0000","last_undegraded":"2024-09-17T03:43:55.653332+0000","last_fullsized":"2024-09-17T03:43:55.653332+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:29.473870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668106+0000","last_change":"2024-09-17T03:43:54.660263+0000","last_active":"2024-09-17T03:43:55.668106+0000","last_peered":"2024-09-17T03:43:55.668106+0000","last_clean":"2024-09-17T03:43:55.668106+0000","last_became_active":"2024-09-17T03:43:54.659968+0000","last_became_peered":"2024-09-17T03:43:54.659968+0000","last_unstale":"2024-09-17T03:43:55.668106+0000","last_undegraded":"2024-09-17T03:43:55.668106+0000","last_fullsized":"2024-09-17T03:43:55.668106+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:05.447689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653172+0000","last_change":"2024-09-17T03:43:54.658889+0000","last_active":"2024-09-17T03:43:55.653172+0000","last_peered":"2024-09-17T03:43:55.653172+0000","last_clean":"2024-09-17T03:43:55.653172+0000","last_became_active":"2024-09-17T03:43:54.658575+0000","last_became_peered":"2024-09-17T03:43:54.658575+0000","last_unstale":"2024-09-17T03:43:55.653172+0000","last_undegraded":"2024-09-17T03:43:55.653172+0000","last_fullsized":"2024-09-17T03:43:55.653172+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:06.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983362+0000","last_change":"2024-09-17T03:43:54.673122+0000","last_active":"2024-09-17T03:43:55.983362+0000","last_peered":"2024-09-17T03:43:55.983362+0000","last_clean":"2024-09-17T03:43:55.983362+0000","last_became_active":"2024-09-17T03:43:54.671190+0000","last_became_peered":"2024-09-17T03:43:54.671190+0000","last_unstale":"2024-09-17T03:43:55.983362+0000","last_undegraded":"2024-09-17T03:43:55.983362+0000","last_fullsized":"2024-09-17T03:43:55.983362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:24.511657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668001+0000","last_change":"2024-09-17T03:43:54.660740+0000","last_active":"2024-09-17T03:43:55.668001+0000","last_peered":"2024-09-17T03:43:55.668001+0000","last_clean":"2024-09-17T03:43:55.668001+0000","last_became_active":"2024-09-17T03:43:54.660405+0000","last_became_peered":"2024-09-17T03:43:54.660405+0000","last_unstale":"2024-09-17T03:43:55.668001+0000","last_undegraded":"2024-09-17T03:43:55.668001+0000","last_fullsized":"2024-09-17T03:43:55.668001+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:30.367976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653087+0000","last_change":"2024-09-17T03:43:54.655685+0000","last_active":"2024-09-17T03:43:55.653087+0000","last_peered":"2024-09-17T03:43:55.653087+0000","last_clean":"2024-09-17T03:43:55.653087+0000","last_became_active":"2024-09-17T03:43:54.655326+0000","last_became_peered":"2024-09-17T03:43:54.655326+0000","last_unstale":"2024-09-17T03:43:55.653087+0000","last_undegraded":"2024-09-17T03:43:55.653087+0000","last_fullsized":"2024-09-17T03:43:55.653087+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:58.242356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647561+0000","last_change":"2024-09-17T03:43:54.655319+0000","last_active":"2024-09-17T03:43:55.647561+0000","last_peered":"2024-09-17T03:43:55.647561+0000","last_clean":"2024-09-17T03:43:55.647561+0000","last_became_active":"2024-09-17T03:43:54.655022+0000","last_became_peered":"2024-09-17T03:43:54.655022+0000","last_unstale":"2024-09-17T03:43:55.647561+0000","last_undegraded":"2024-09-17T03:43:55.647561+0000","last_fullsized":"2024-09-17T03:43:55.647561+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:19.101578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984059+0000","last_change":"2024-09-17T03:43:54.667783+0000","last_active":"2024-09-17T03:43:55.984059+0000","last_peered":"2024-09-17T03:43:55.984059+0000","last_clean":"2024-09-17T03:43:55.984059+0000","last_became_active":"2024-09-17T03:43:54.667437+0000","last_became_peered":"2024-09-17T03:43:54.667437+0000","last_unstale":"2024-09-17T03:43:55.984059+0000","last_undegraded":"2024-09-17T03:43:55.984059+0000","last_fullsized":"2024-09-17T03:43:55.984059+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:40.158899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.665986+0000","last_change":"2024-09-17T03:43:54.661088+0000","last_active":"2024-09-17T03:43:55.665986+0000","last_peered":"2024-09-17T03:43:55.665986+0000","last_clean":"2024-09-17T03:43:55.665986+0000","last_became_active":"2024-09-17T03:43:54.660784+0000","last_became_peered":"2024-09-17T03:43:54.660784+0000","last_unstale":"2024-09-17T03:43:55.665986+0000","last_undegraded":"2024-09-17T03:43:55.665986+0000","last_fullsized":"2024-09-17T03:43:55.665986+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.008860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653933+0000","last_change":"2024-09-17T03:43:54.670145+0000","last_active":"2024-09-17T03:43:55.653933+0000","last_peered":"2024-09-17T03:43:55.653933+0000","last_clean":"2024-09-17T03:43:55.653933+0000","last_became_active":"2024-09-17T03:43:54.669327+0000","last_became_peered":"2024-09-17T03:43:54.669327+0000","last_unstale":"2024-09-17T03:43:55.653933+0000","last_undegraded":"2024-09-17T03:43:55.653933+0000","last_fullsized":"2024-09-17T03:43:55.653933+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:29.473870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653392+0000","last_change":"2024-09-17T03:43:54.664401+0000","last_active":"2024-09-17T03:43:55.653392+0000","last_peered":"2024-09-17T03:43:55.653392+0000","last_clean":"2024-09-17T03:43:55.653392+0000","last_became_active":"2024-09-17T03:43:54.664052+0000","last_became_peered":"2024-09-17T03:43:54.664052+0000","last_unstale":"2024-09-17T03:43:55.653392+0000","last_undegraded":"2024-09-17T03:43:55.653392+0000","last_fullsized":"2024-09-17T03:43:55.653392+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:05.447689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.652803+0000","last_change":"2024-09-17T03:43:54.662932+0000","last_active":"2024-09-17T03:43:55.652803+0000","last_peered":"2024-09-17T03:43:55.652803+0000","last_clean":"2024-09-17T03:43:55.652803+0000","last_became_active":"2024-09-17T03:43:54.662580+0000","last_became_peered":"2024-09-17T03:43:54.662580+0000","last_unstale":"2024-09-17T03:43:55.652803+0000","last_undegraded":"2024-09-17T03:43:55.652803+0000","last_fullsized":"2024-09-17T03:43:55.652803+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:31.707876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983964+0000","last_change":"2024-09-17T03:43:54.667596+0000","last_active":"2024-09-17T03:43:55.983964+0000","last_peered":"2024-09-17T03:43:55.983964+0000","last_clean":"2024-09-17T03:43:55.983964+0000","last_became_active":"2024-09-17T03:43:54.667088+0000","last_became_peered":"2024-09-17T03:43:54.667088+0000","last_unstale":"2024-09-17T03:43:55.983964+0000","last_undegraded":"2024-09-17T03:43:55.983964+0000","last_fullsized":"2024-09-17T03:43:55.983964+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:25.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.652939+0000","last_change":"2024-09-17T03:43:54.663235+0000","last_active":"2024-09-17T03:43:55.652939+0000","last_peered":"2024-09-17T03:43:55.652939+0000","last_clean":"2024-09-17T03:43:55.652939+0000","last_became_active":"2024-09-17T03:43:54.662722+0000","last_became_peered":"2024-09-17T03:43:54.662722+0000","last_unstale":"2024-09-17T03:43:55.652939+0000","last_undegraded":"2024-09-17T03:43:55.652939+0000","last_fullsized":"2024-09-17T03:43:55.652939+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:55.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647641+0000","last_change":"2024-09-17T03:43:54.665060+0000","last_active":"2024-09-17T03:43:55.647641+0000","last_peered":"2024-09-17T03:43:55.647641+0000","last_clean":"2024-09-17T03:43:55.647641+0000","last_became_active":"2024-09-17T03:43:54.664742+0000","last_became_peered":"2024-09-17T03:43:54.664742+0000","last_unstale":"2024-09-17T03:43:55.647641+0000","last_undegraded":"2024-09-17T03:43:55.647641+0000","last_fullsized":"2024-09-17T03:43:55.647641+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:45.262140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983766+0000","last_change":"2024-09-17T03:43:54.655313+0000","last_active":"2024-09-17T03:43:55.983766+0000","last_peered":"2024-09-17T03:43:55.983766+0000","last_clean":"2024-09-17T03:43:55.983766+0000","last_became_active":"2024-09-17T03:43:54.655023+0000","last_became_peered":"2024-09-17T03:43:54.655023+0000","last_unstale":"2024-09-17T03:43:55.983766+0000","last_undegraded":"2024-09-17T03:43:55.983766+0000","last_fullsized":"2024-09-17T03:43:55.983766+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:09.377734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953725+0000","last_change":"2024-09-17T03:43:54.660146+0000","last_active":"2024-09-17T03:43:55.953725+0000","last_peered":"2024-09-17T03:43:55.953725+0000","last_clean":"2024-09-17T03:43:55.953725+0000","last_became_active":"2024-09-17T03:43:54.659812+0000","last_became_peered":"2024-09-17T03:43:54.659812+0000","last_unstale":"2024-09-17T03:43:55.953725+0000","last_undegraded":"2024-09-17T03:43:55.953725+0000","last_fullsized":"2024-09-17T03:43:55.953725+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:34.425270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666033+0000","last_change":"2024-09-17T03:43:54.659805+0000","last_active":"2024-09-17T03:43:55.666033+0000","last_peered":"2024-09-17T03:43:55.666033+0000","last_clean":"2024-09-17T03:43:55.666033+0000","last_became_active":"2024-09-17T03:43:54.659375+0000","last_became_peered":"2024-09-17T03:43:54.659375+0000","last_unstale":"2024-09-17T03:43:55.666033+0000","last_undegraded":"2024-09-17T03:43:55.666033+0000","last_fullsized":"2024-09-17T03:43:55.666033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.667931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983480+0000","last_change":"2024-09-17T03:43:54.654095+0000","last_active":"2024-09-17T03:43:55.983480+0000","last_peered":"2024-09-17T03:43:55.983480+0000","last_clean":"2024-09-17T03:43:55.983480+0000","last_became_active":"2024-09-17T03:43:54.653775+0000","last_became_peered":"2024-09-17T03:43:54.653775+0000","last_unstale":"2024-09-17T03:43:55.983480+0000","last_undegraded":"2024-09-17T03:43:55.983480+0000","last_fullsized":"2024-09-17T03:43:55.983480+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:15.242599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983495+0000","last_change":"2024-09-17T03:43:54.670276+0000","last_active":"2024-09-17T03:43:55.983495+0000","last_peered":"2024-09-17T03:43:55.983495+0000","last_clean":"2024-09-17T03:43:55.983495+0000","last_became_active":"2024-09-17T03:43:54.669960+0000","last_became_peered":"2024-09-17T03:43:54.669960+0000","last_unstale":"2024-09-17T03:43:55.983495+0000","last_undegraded":"2024-09-17T03:43:55.983495+0000","last_fullsized":"2024-09-17T03:43:55.983495+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:48.955113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.665942+0000","last_change":"2024-09-17T03:43:54.655746+0000","last_active":"2024-09-17T03:43:55.665942+0000","last_peered":"2024-09-17T03:43:55.665942+0000","last_clean":"2024-09-17T03:43:55.665942+0000","last_became_active":"2024-09-17T03:43:54.655430+0000","last_became_peered":"2024-09-17T03:43:54.655430+0000","last_unstale":"2024-09-17T03:43:55.665942+0000","last_undegraded":"2024-09-17T03:43:55.665942+0000","last_fullsized":"2024-09-17T03:43:55.665942+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:15.309160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.667960+0000","last_change":"2024-09-17T03:43:54.659310+0000","last_active":"2024-09-17T03:43:55.667960+0000","last_peered":"2024-09-17T03:43:55.667960+0000","last_clean":"2024-09-17T03:43:55.667960+0000","last_became_active":"2024-09-17T03:43:54.659017+0000","last_became_peered":"2024-09-17T03:43:54.659017+0000","last_unstale":"2024-09-17T03:43:55.667960+0000","last_undegraded":"2024-09-17T03:43:55.667960+0000","last_fullsized":"2024-09-17T03:43:55.667960+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:55.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647790+0000","last_change":"2024-09-17T03:43:54.666755+0000","last_active":"2024-09-17T03:43:55.647790+0000","last_peered":"2024-09-17T03:43:55.647790+0000","last_clean":"2024-09-17T03:43:55.647790+0000","last_became_active":"2024-09-17T03:43:54.666432+0000","last_became_peered":"2024-09-17T03:43:54.666432+0000","last_unstale":"2024-09-17T03:43:55.647790+0000","last_undegraded":"2024-09-17T03:43:55.647790+0000","last_fullsized":"2024-09-17T03:43:55.647790+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:05.826937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653950+0000","last_change":"2024-09-17T03:43:54.653143+0000","last_active":"2024-09-17T03:43:55.653950+0000","last_peered":"2024-09-17T03:43:55.653950+0000","last_clean":"2024-09-17T03:43:55.653950+0000","last_became_active":"2024-09-17T03:43:54.652786+0000","last_became_peered":"2024-09-17T03:43:54.652786+0000","last_unstale":"2024-09-17T03:43:55.653950+0000","last_undegraded":"2024-09-17T03:43:55.653950+0000","last_fullsized":"2024-09-17T03:43:55.653950+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:38.206012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653892+0000","last_change":"2024-09-17T03:43:54.665727+0000","last_active":"2024-09-17T03:43:55.653892+0000","last_peered":"2024-09-17T03:43:55.653892+0000","last_clean":"2024-09-17T03:43:55.653892+0000","last_became_active":"2024-09-17T03:43:54.665433+0000","last_became_peered":"2024-09-17T03:43:54.665433+0000","last_unstale":"2024-09-17T03:43:55.653892+0000","last_undegraded":"2024-09-17T03:43:55.653892+0000","last_fullsized":"2024-09-17T03:43:55.653892+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:06.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668228+0000","last_change":"2024-09-17T03:43:54.669860+0000","last_active":"2024-09-17T03:43:55.668228+0000","last_peered":"2024-09-17T03:43:55.668228+0000","last_clean":"2024-09-17T03:43:55.668228+0000","last_became_active":"2024-09-17T03:43:54.669545+0000","last_became_peered":"2024-09-17T03:43:54.669545+0000","last_unstale":"2024-09-17T03:43:55.668228+0000","last_undegraded":"2024-09-17T03:43:55.668228+0000","last_fullsized":"2024-09-17T03:43:55.668228+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:38.206012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983573+0000","last_change":"2024-09-17T03:43:54.660913+0000","last_active":"2024-09-17T03:43:55.983573+0000","last_peered":"2024-09-17T03:43:55.983573+0000","last_clean":"2024-09-17T03:43:55.983573+0000","last_became_active":"2024-09-17T03:43:54.660576+0000","last_became_peered":"2024-09-17T03:43:54.660576+0000","last_unstale":"2024-09-17T03:43:55.983573+0000","last_undegraded":"2024-09-17T03:43:55.983573+0000","last_fullsized":"2024-09-17T03:43:55.983573+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:22.304762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653068+0000","last_change":"2024-09-17T03:43:54.663685+0000","last_active":"2024-09-17T03:43:55.653068+0000","last_peered":"2024-09-17T03:43:55.653068+0000","last_clean":"2024-09-17T03:43:55.653068+0000","last_became_active":"2024-09-17T03:43:54.663382+0000","last_became_peered":"2024-09-17T03:43:54.663382+0000","last_unstale":"2024-09-17T03:43:55.653068+0000","last_undegraded":"2024-09-17T03:43:55.653068+0000","last_fullsized":"2024-09-17T03:43:55.653068+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:30.367976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983636+0000","last_change":"2024-09-17T03:43:54.663609+0000","last_active":"2024-09-17T03:43:55.983636+0000","last_peered":"2024-09-17T03:43:55.983636+0000","last_clean":"2024-09-17T03:43:55.983636+0000","last_became_active":"2024-09-17T03:43:54.663199+0000","last_became_peered":"2024-09-17T03:43:54.663199+0000","last_unstale":"2024-09-17T03:43:55.983636+0000","last_undegraded":"2024-09-17T03:43:55.983636+0000","last_fullsized":"2024-09-17T03:43:55.983636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:59.078819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668073+0000","last_change":"2024-09-17T03:43:54.667040+0000","last_active":"2024-09-17T03:43:55.668073+0000","last_peered":"2024-09-17T03:43:55.668073+0000","last_clean":"2024-09-17T03:43:55.668073+0000","last_became_active":"2024-09-17T03:43:54.666713+0000","last_became_peered":"2024-09-17T03:43:54.666713+0000","last_unstale":"2024-09-17T03:43:55.668073+0000","last_undegraded":"2024-09-17T03:43:55.668073+0000","last_fullsized":"2024-09-17T03:43:55.668073+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:06.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983242+0000","last_change":"2024-09-17T03:43:54.656706+0000","last_active":"2024-09-17T03:43:55.983242+0000","last_peered":"2024-09-17T03:43:55.983242+0000","last_clean":"2024-09-17T03:43:55.983242+0000","last_became_active":"2024-09-17T03:43:54.656393+0000","last_became_peered":"2024-09-17T03:43:54.656393+0000","last_unstale":"2024-09-17T03:43:55.983242+0000","last_undegraded":"2024-09-17T03:43:55.983242+0000","last_fullsized":"2024-09-17T03:43:55.983242+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:43.014067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647855+0000","last_change":"2024-09-17T03:43:54.665630+0000","last_active":"2024-09-17T03:43:55.647855+0000","last_peered":"2024-09-17T03:43:55.647855+0000","last_clean":"2024-09-17T03:43:55.647855+0000","last_became_active":"2024-09-17T03:43:54.665303+0000","last_became_peered":"2024-09-17T03:43:54.665303+0000","last_unstale":"2024-09-17T03:43:55.647855+0000","last_undegraded":"2024-09-17T03:43:55.647855+0000","last_fullsized":"2024-09-17T03:43:55.647855+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:34.015909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"164'4","reported_seq":19,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983748+0000","last_change":"2024-09-17T03:43:53.642888+0000","last_active":"2024-09-17T03:43:55.983748+0000","last_peered":"2024-09-17T03:43:55.983748+0000","last_clean":"2024-09-17T03:43:55.983748+0000","last_became_active":"2024-09-17T03:43:53.642585+0000","last_became_peered":"2024-09-17T03:43:53.642585+0000","last_unstale":"2024-09-17T03:43:55.983748+0000","last_undegraded":"2024-09-17T03:43:55.983748+0000","last_fullsized":"2024-09-17T03:43:55.983748+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:11.713533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666263+0000","last_change":"2024-09-17T03:43:54.657437+0000","last_active":"2024-09-17T03:43:55.666263+0000","last_peered":"2024-09-17T03:43:55.666263+0000","last_clean":"2024-09-17T03:43:55.666263+0000","last_became_active":"2024-09-17T03:43:54.657125+0000","last_became_peered":"2024-09-17T03:43:54.657125+0000","last_unstale":"2024-09-17T03:43:55.666263+0000","last_undegraded":"2024-09-17T03:43:55.666263+0000","last_fullsized":"2024-09-17T03:43:55.666263+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:39.513939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984083+0000","last_change":"2024-09-17T03:43:53.647661+0000","last_active":"2024-09-17T03:43:55.984083+0000","last_peered":"2024-09-17T03:43:55.984083+0000","last_clean":"2024-09-17T03:43:55.984083+0000","last_became_active":"2024-09-17T03:43:53.647274+0000","last_became_peered":"2024-09-17T03:43:53.647274+0000","last_unstale":"2024-09-17T03:43:55.984083+0000","last_undegraded":"2024-09-17T03:43:55.984083+0000","last_fullsized":"2024-09-17T03:43:55.984083+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:35.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.652888+0000","last_change":"2024-09-17T03:43:54.656859+0000","last_active":"2024-09-17T03:43:55.652888+0000","last_peered":"2024-09-17T03:43:55.652888+0000","last_clean":"2024-09-17T03:43:55.652888+0000","last_became_active":"2024-09-17T03:43:54.655671+0000","last_became_peered":"2024-09-17T03:43:54.655671+0000","last_unstale":"2024-09-17T03:43:55.652888+0000","last_undegraded":"2024-09-17T03:43:55.652888+0000","last_fullsized":"2024-09-17T03:43:55.652888+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:07.673710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668277+0000","last_change":"2024-09-17T03:43:53.644185+0000","last_active":"2024-09-17T03:43:55.668277+0000","last_peered":"2024-09-17T03:43:55.668277+0000","last_clean":"2024-09-17T03:43:55.668277+0000","last_became_active":"2024-09-17T03:43:53.643895+0000","last_became_peered":"2024-09-17T03:43:53.643895+0000","last_unstale":"2024-09-17T03:43:55.668277+0000","last_undegraded":"2024-09-17T03:43:55.668277+0000","last_fullsized":"2024-09-17T03:43:55.668277+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:25.740044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984016+0000","last_change":"2024-09-17T03:43:54.663996+0000","last_active":"2024-09-17T03:43:55.984016+0000","last_peered":"2024-09-17T03:43:55.984016+0000","last_clean":"2024-09-17T03:43:55.984016+0000","last_became_active":"2024-09-17T03:43:54.663664+0000","last_became_peered":"2024-09-17T03:43:54.663664+0000","last_unstale":"2024-09-17T03:43:55.984016+0000","last_undegraded":"2024-09-17T03:43:55.984016+0000","last_fullsized":"2024-09-17T03:43:55.984016+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:46.673846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653566+0000","last_change":"2024-09-17T03:43:53.648032+0000","last_active":"2024-09-17T03:43:55.653566+0000","last_peered":"2024-09-17T03:43:55.653566+0000","last_clean":"2024-09-17T03:43:55.653566+0000","last_became_active":"2024-09-17T03:43:53.647737+0000","last_became_peered":"2024-09-17T03:43:53.647737+0000","last_unstale":"2024-09-17T03:43:55.653566+0000","last_undegraded":"2024-09-17T03:43:55.653566+0000","last_fullsized":"2024-09-17T03:43:55.653566+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:26.178906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666159+0000","last_change":"2024-09-17T03:43:54.655510+0000","last_active":"2024-09-17T03:43:55.666159+0000","last_peered":"2024-09-17T03:43:55.666159+0000","last_clean":"2024-09-17T03:43:55.666159+0000","last_became_active":"2024-09-17T03:43:54.655067+0000","last_became_peered":"2024-09-17T03:43:54.655067+0000","last_unstale":"2024-09-17T03:43:55.666159+0000","last_undegraded":"2024-09-17T03:43:55.666159+0000","last_fullsized":"2024-09-17T03:43:55.666159+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:36.760548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983647+0000","last_change":"2024-09-17T03:43:53.645679+0000","last_active":"2024-09-17T03:43:55.983647+0000","last_peered":"2024-09-17T03:43:55.983647+0000","last_clean":"2024-09-17T03:43:55.983647+0000","last_became_active":"2024-09-17T03:43:53.645360+0000","last_became_peered":"2024-09-17T03:43:53.645360+0000","last_unstale":"2024-09-17T03:43:55.983647+0000","last_undegraded":"2024-09-17T03:43:55.983647+0000","last_fullsized":"2024-09-17T03:43:55.983647+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:29.767020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647690+0000","last_change":"2024-09-17T03:43:54.672348+0000","last_active":"2024-09-17T03:43:55.647690+0000","last_peered":"2024-09-17T03:43:55.647690+0000","last_clean":"2024-09-17T03:43:55.647690+0000","last_became_active":"2024-09-17T03:43:54.670870+0000","last_became_peered":"2024-09-17T03:43:54.670870+0000","last_unstale":"2024-09-17T03:43:55.647690+0000","last_undegraded":"2024-09-17T03:43:55.647690+0000","last_fullsized":"2024-09-17T03:43:55.647690+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:41.754485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647702+0000","last_change":"2024-09-17T03:43:53.643291+0000","last_active":"2024-09-17T03:43:55.647702+0000","last_peered":"2024-09-17T03:43:55.647702+0000","last_clean":"2024-09-17T03:43:55.647702+0000","last_became_active":"2024-09-17T03:43:53.642982+0000","last_became_peered":"2024-09-17T03:43:53.642982+0000","last_unstale":"2024-09-17T03:43:55.647702+0000","last_undegraded":"2024-09-17T03:43:55.647702+0000","last_fullsized":"2024-09-17T03:43:55.647702+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:54.167248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653295+0000","last_change":"2024-09-17T03:43:54.661816+0000","last_active":"2024-09-17T03:43:55.653295+0000","last_peered":"2024-09-17T03:43:55.653295+0000","last_clean":"2024-09-17T03:43:55.653295+0000","last_became_active":"2024-09-17T03:43:54.661515+0000","last_became_peered":"2024-09-17T03:43:54.661515+0000","last_unstale":"2024-09-17T03:43:55.653295+0000","last_undegraded":"2024-09-17T03:43:55.653295+0000","last_fullsized":"2024-09-17T03:43:55.653295+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:58.320480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953288+0000","last_change":"2024-09-17T03:43:53.652597+0000","last_active":"2024-09-17T03:43:55.953288+0000","last_peered":"2024-09-17T03:43:55.953288+0000","last_clean":"2024-09-17T03:43:55.953288+0000","last_became_active":"2024-09-17T03:43:53.652283+0000","last_became_peered":"2024-09-17T03:43:53.652283+0000","last_unstale":"2024-09-17T03:43:55.953288+0000","last_undegraded":"2024-09-17T03:43:55.953288+0000","last_fullsized":"2024-09-17T03:43:55.953288+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:52.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668293+0000","last_change":"2024-09-17T03:43:54.668503+0000","last_active":"2024-09-17T03:43:55.668293+0000","last_peered":"2024-09-17T03:43:55.668293+0000","last_clean":"2024-09-17T03:43:55.668293+0000","last_became_active":"2024-09-17T03:43:54.668220+0000","last_became_peered":"2024-09-17T03:43:54.668220+0000","last_unstale":"2024-09-17T03:43:55.668293+0000","last_undegraded":"2024-09-17T03:43:55.668293+0000","last_fullsized":"2024-09-17T03:43:55.668293+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:36.587426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653858+0000","last_change":"2024-09-17T03:43:53.647225+0000","last_active":"2024-09-17T03:43:55.653858+0000","last_peered":"2024-09-17T03:43:55.653858+0000","last_clean":"2024-09-17T03:43:55.653858+0000","last_became_active":"2024-09-17T03:43:53.646763+0000","last_became_peered":"2024-09-17T03:43:53.646763+0000","last_unstale":"2024-09-17T03:43:55.653858+0000","last_undegraded":"2024-09-17T03:43:55.653858+0000","last_fullsized":"2024-09-17T03:43:55.653858+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:46.546050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.648113+0000","last_change":"2024-09-17T03:43:54.664068+0000","last_active":"2024-09-17T03:43:55.648113+0000","last_peered":"2024-09-17T03:43:55.648113+0000","last_clean":"2024-09-17T03:43:55.648113+0000","last_became_active":"2024-09-17T03:43:54.663753+0000","last_became_peered":"2024-09-17T03:43:54.663753+0000","last_unstale":"2024-09-17T03:43:55.648113+0000","last_undegraded":"2024-09-17T03:43:55.648113+0000","last_fullsized":"2024-09-17T03:43:55.648113+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:37.532930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983579+0000","last_change":"2024-09-17T03:43:53.648637+0000","last_active":"2024-09-17T03:43:55.983579+0000","last_peered":"2024-09-17T03:43:55.983579+0000","last_clean":"2024-09-17T03:43:55.983579+0000","last_became_active":"2024-09-17T03:43:53.648309+0000","last_became_peered":"2024-09-17T03:43:53.648309+0000","last_unstale":"2024-09-17T03:43:55.983579+0000","last_undegraded":"2024-09-17T03:43:55.983579+0000","last_fullsized":"2024-09-17T03:43:55.983579+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:41.779984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653566+0000","last_change":"2024-09-17T03:43:54.659618+0000","last_active":"2024-09-17T03:43:55.653566+0000","last_peered":"2024-09-17T03:43:55.653566+0000","last_clean":"2024-09-17T03:43:55.653566+0000","last_became_active":"2024-09-17T03:43:54.659308+0000","last_became_peered":"2024-09-17T03:43:54.659308+0000","last_unstale":"2024-09-17T03:43:55.653566+0000","last_undegraded":"2024-09-17T03:43:55.653566+0000","last_fullsized":"2024-09-17T03:43:55.653566+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:30.367976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"164'3","reported_seq":18,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983470+0000","last_change":"2024-09-17T03:43:53.653098+0000","last_active":"2024-09-17T03:43:55.983470+0000","last_peered":"2024-09-17T03:43:55.983470+0000","last_clean":"2024-09-17T03:43:55.983470+0000","last_became_active":"2024-09-17T03:43:53.652666+0000","last_became_peered":"2024-09-17T03:43:53.652666+0000","last_unstale":"2024-09-17T03:43:55.983470+0000","last_undegraded":"2024-09-17T03:43:55.983470+0000","last_fullsized":"2024-09-17T03:43:55.983470+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:56.001326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666018+0000","last_change":"2024-09-17T03:43:54.655431+0000","last_active":"2024-09-17T03:43:55.666018+0000","last_peered":"2024-09-17T03:43:55.666018+0000","last_clean":"2024-09-17T03:43:55.666018+0000","last_became_active":"2024-09-17T03:43:54.654905+0000","last_became_peered":"2024-09-17T03:43:54.654905+0000","last_unstale":"2024-09-17T03:43:55.666018+0000","last_undegraded":"2024-09-17T03:43:55.666018+0000","last_fullsized":"2024-09-17T03:43:55.666018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:34.425270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"164'6","reported_seq":21,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668074+0000","last_change":"2024-09-17T03:43:53.643543+0000","last_active":"2024-09-17T03:43:55.668074+0000","last_peered":"2024-09-17T03:43:55.668074+0000","last_clean":"2024-09-17T03:43:55.668074+0000","last_became_active":"2024-09-17T03:43:53.642998+0000","last_became_peered":"2024-09-17T03:43:53.642998+0000","last_unstale":"2024-09-17T03:43:55.668074+0000","last_undegraded":"2024-09-17T03:43:55.668074+0000","last_fullsized":"2024-09-17T03:43:55.668074+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:03.525769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668104+0000","last_change":"2024-09-17T03:43:54.665211+0000","last_active":"2024-09-17T03:43:55.668104+0000","last_peered":"2024-09-17T03:43:55.668104+0000","last_clean":"2024-09-17T03:43:55.668104+0000","last_became_active":"2024-09-17T03:43:54.664846+0000","last_became_peered":"2024-09-17T03:43:54.664846+0000","last_unstale":"2024-09-17T03:43:55.668104+0000","last_undegraded":"2024-09-17T03:43:55.668104+0000","last_fullsized":"2024-09-17T03:43:55.668104+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:03.927544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953567+0000","last_change":"2024-09-17T03:43:53.650497+0000","last_active":"2024-09-17T03:43:55.953567+0000","last_peered":"2024-09-17T03:43:55.953567+0000","last_clean":"2024-09-17T03:43:55.953567+0000","last_became_active":"2024-09-17T03:43:53.650200+0000","last_became_peered":"2024-09-17T03:43:53.650200+0000","last_unstale":"2024-09-17T03:43:55.953567+0000","last_undegraded":"2024-09-17T03:43:55.953567+0000","last_fullsized":"2024-09-17T03:43:55.953567+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:53.225162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653265+0000","last_change":"2024-09-17T03:43:54.667662+0000","last_active":"2024-09-17T03:43:55.653265+0000","last_peered":"2024-09-17T03:43:55.653265+0000","last_clean":"2024-09-17T03:43:55.653265+0000","last_became_active":"2024-09-17T03:43:54.666158+0000","last_became_peered":"2024-09-17T03:43:54.666158+0000","last_unstale":"2024-09-17T03:43:55.653265+0000","last_undegraded":"2024-09-17T03:43:55.653265+0000","last_fullsized":"2024-09-17T03:43:55.653265+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:31.707876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666317+0000","last_change":"2024-09-17T03:43:53.648900+0000","last_active":"2024-09-17T03:43:55.666317+0000","last_peered":"2024-09-17T03:43:55.666317+0000","last_clean":"2024-09-17T03:43:55.666317+0000","last_became_active":"2024-09-17T03:43:53.648385+0000","last_became_peered":"2024-09-17T03:43:53.648385+0000","last_unstale":"2024-09-17T03:43:55.666317+0000","last_undegraded":"2024-09-17T03:43:55.666317+0000","last_fullsized":"2024-09-17T03:43:55.666317+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:50.103164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983703+0000","last_change":"2024-09-17T03:43:54.665253+0000","last_active":"2024-09-17T03:43:55.983703+0000","last_peered":"2024-09-17T03:43:55.983703+0000","last_clean":"2024-09-17T03:43:55.983703+0000","last_became_active":"2024-09-17T03:43:54.664937+0000","last_became_peered":"2024-09-17T03:43:54.664937+0000","last_unstale":"2024-09-17T03:43:55.983703+0000","last_undegraded":"2024-09-17T03:43:55.983703+0000","last_fullsized":"2024-09-17T03:43:55.983703+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:01.731823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647291+0000","last_change":"2024-09-17T03:43:53.647484+0000","last_active":"2024-09-17T03:43:55.647291+0000","last_peered":"2024-09-17T03:43:55.647291+0000","last_clean":"2024-09-17T03:43:55.647291+0000","last_became_active":"2024-09-17T03:43:53.647194+0000","last_became_peered":"2024-09-17T03:43:53.647194+0000","last_unstale":"2024-09-17T03:43:55.647291+0000","last_undegraded":"2024-09-17T03:43:55.647291+0000","last_fullsized":"2024-09-17T03:43:55.647291+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:20.612852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666022+0000","last_change":"2024-09-17T03:43:54.654916+0000","last_active":"2024-09-17T03:43:55.666022+0000","last_peered":"2024-09-17T03:43:55.666022+0000","last_clean":"2024-09-17T03:43:55.666022+0000","last_became_active":"2024-09-17T03:43:54.654519+0000","last_became_peered":"2024-09-17T03:43:54.654519+0000","last_unstale":"2024-09-17T03:43:55.666022+0000","last_undegraded":"2024-09-17T03:43:55.666022+0000","last_fullsized":"2024-09-17T03:43:55.666022+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:16.522301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"164'8","reported_seq":23,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953418+0000","last_change":"2024-09-17T03:43:53.652497+0000","last_active":"2024-09-17T03:43:55.953418+0000","last_peered":"2024-09-17T03:43:55.953418+0000","last_clean":"2024-09-17T03:43:55.953418+0000","last_became_active":"2024-09-17T03:43:53.651068+0000","last_became_peered":"2024-09-17T03:43:53.651068+0000","last_unstale":"2024-09-17T03:43:55.953418+0000","last_undegraded":"2024-09-17T03:43:55.953418+0000","last_fullsized":"2024-09-17T03:43:55.953418+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:41.360098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666093+0000","last_change":"2024-09-17T03:43:54.656572+0000","last_active":"2024-09-17T03:43:55.666093+0000","last_peered":"2024-09-17T03:43:55.666093+0000","last_clean":"2024-09-17T03:43:55.666093+0000","last_became_active":"2024-09-17T03:43:54.656268+0000","last_became_peered":"2024-09-17T03:43:54.656268+0000","last_unstale":"2024-09-17T03:43:55.666093+0000","last_undegraded":"2024-09-17T03:43:55.666093+0000","last_fullsized":"2024-09-17T03:43:55.666093+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:30.082373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983857+0000","last_change":"2024-09-17T03:43:53.643934+0000","last_active":"2024-09-17T03:43:55.983857+0000","last_peered":"2024-09-17T03:43:55.983857+0000","last_clean":"2024-09-17T03:43:55.983857+0000","last_became_active":"2024-09-17T03:43:53.643624+0000","last_became_peered":"2024-09-17T03:43:53.643624+0000","last_unstale":"2024-09-17T03:43:55.983857+0000","last_undegraded":"2024-09-17T03:43:55.983857+0000","last_fullsized":"2024-09-17T03:43:55.983857+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:13.192719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984066+0000","last_change":"2024-09-17T03:43:54.671058+0000","last_active":"2024-09-17T03:43:55.984066+0000","last_peered":"2024-09-17T03:43:55.984066+0000","last_clean":"2024-09-17T03:43:55.984066+0000","last_became_active":"2024-09-17T03:43:54.670052+0000","last_became_peered":"2024-09-17T03:43:54.670052+0000","last_unstale":"2024-09-17T03:43:55.984066+0000","last_undegraded":"2024-09-17T03:43:55.984066+0000","last_fullsized":"2024-09-17T03:43:55.984066+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:29.400392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647787+0000","last_change":"2024-09-17T03:43:53.649241+0000","last_active":"2024-09-17T03:43:55.647787+0000","last_peered":"2024-09-17T03:43:55.647787+0000","last_clean":"2024-09-17T03:43:55.647787+0000","last_became_active":"2024-09-17T03:43:53.648942+0000","last_became_peered":"2024-09-17T03:43:53.648942+0000","last_unstale":"2024-09-17T03:43:55.647787+0000","last_undegraded":"2024-09-17T03:43:55.647787+0000","last_fullsized":"2024-09-17T03:43:55.647787+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983902+0000","last_change":"2024-09-17T03:43:54.662331+0000","last_active":"2024-09-17T03:43:55.983902+0000","last_peered":"2024-09-17T03:43:55.983902+0000","last_clean":"2024-09-17T03:43:55.983902+0000","last_became_active":"2024-09-17T03:43:54.661020+0000","last_became_peered":"2024-09-17T03:43:54.661020+0000","last_unstale":"2024-09-17T03:43:55.983902+0000","last_undegraded":"2024-09-17T03:43:55.983902+0000","last_fullsized":"2024-09-17T03:43:55.983902+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:48.585042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953715+0000","last_change":"2024-09-17T03:43:53.651532+0000","last_active":"2024-09-17T03:43:55.953715+0000","last_peered":"2024-09-17T03:43:55.953715+0000","last_clean":"2024-09-17T03:43:55.953715+0000","last_became_active":"2024-09-17T03:43:53.651190+0000","last_became_peered":"2024-09-17T03:43:53.651190+0000","last_unstale":"2024-09-17T03:43:55.953715+0000","last_undegraded":"2024-09-17T03:43:55.953715+0000","last_fullsized":"2024-09-17T03:43:55.953715+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:22.381161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.652914+0000","last_change":"2024-09-17T03:43:54.658246+0000","last_active":"2024-09-17T03:43:55.652914+0000","last_peered":"2024-09-17T03:43:55.652914+0000","last_clean":"2024-09-17T03:43:55.652914+0000","last_became_active":"2024-09-17T03:43:54.657906+0000","last_became_peered":"2024-09-17T03:43:54.657906+0000","last_unstale":"2024-09-17T03:43:55.652914+0000","last_undegraded":"2024-09-17T03:43:55.652914+0000","last_fullsized":"2024-09-17T03:43:55.652914+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:58.320480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653652+0000","last_change":"2024-09-17T03:43:53.646384+0000","last_active":"2024-09-17T03:43:55.653652+0000","last_peered":"2024-09-17T03:43:55.653652+0000","last_clean":"2024-09-17T03:43:55.653652+0000","last_became_active":"2024-09-17T03:43:53.646041+0000","last_became_peered":"2024-09-17T03:43:53.646041+0000","last_unstale":"2024-09-17T03:43:55.653652+0000","last_undegraded":"2024-09-17T03:43:55.653652+0000","last_fullsized":"2024-09-17T03:43:55.653652+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:26.178906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666245+0000","last_change":"2024-09-17T03:43:54.658117+0000","last_active":"2024-09-17T03:43:55.666245+0000","last_peered":"2024-09-17T03:43:55.666245+0000","last_clean":"2024-09-17T03:43:55.666245+0000","last_became_active":"2024-09-17T03:43:54.657645+0000","last_became_peered":"2024-09-17T03:43:54.657645+0000","last_unstale":"2024-09-17T03:43:55.666245+0000","last_undegraded":"2024-09-17T03:43:55.666245+0000","last_fullsized":"2024-09-17T03:43:55.666245+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:49.097755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.667975+0000","last_change":"2024-09-17T03:43:53.645944+0000","last_active":"2024-09-17T03:43:55.667975+0000","last_peered":"2024-09-17T03:43:55.667975+0000","last_clean":"2024-09-17T03:43:55.667975+0000","last_became_active":"2024-09-17T03:43:53.645640+0000","last_became_peered":"2024-09-17T03:43:53.645640+0000","last_unstale":"2024-09-17T03:43:55.667975+0000","last_undegraded":"2024-09-17T03:43:55.667975+0000","last_fullsized":"2024-09-17T03:43:55.667975+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:41.194237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653497+0000","last_change":"2024-09-17T03:43:54.662287+0000","last_active":"2024-09-17T03:43:55.653497+0000","last_peered":"2024-09-17T03:43:55.653497+0000","last_clean":"2024-09-17T03:43:55.653497+0000","last_became_active":"2024-09-17T03:43:54.658300+0000","last_became_peered":"2024-09-17T03:43:54.658300+0000","last_unstale":"2024-09-17T03:43:55.653497+0000","last_undegraded":"2024-09-17T03:43:55.653497+0000","last_fullsized":"2024-09-17T03:43:55.653497+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:55.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983342+0000","last_change":"2024-09-17T03:43:53.648560+0000","last_active":"2024-09-17T03:43:55.983342+0000","last_peered":"2024-09-17T03:43:55.983342+0000","last_clean":"2024-09-17T03:43:55.983342+0000","last_became_active":"2024-09-17T03:43:53.648255+0000","last_became_peered":"2024-09-17T03:43:53.648255+0000","last_unstale":"2024-09-17T03:43:55.983342+0000","last_undegraded":"2024-09-17T03:43:55.983342+0000","last_fullsized":"2024-09-17T03:43:55.983342+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:39.482101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.654169+0000","last_change":"2024-09-17T03:43:54.669393+0000","last_active":"2024-09-17T03:43:55.654169+0000","last_peered":"2024-09-17T03:43:55.654169+0000","last_clean":"2024-09-17T03:43:55.654169+0000","last_became_active":"2024-09-17T03:43:54.669051+0000","last_became_peered":"2024-09-17T03:43:54.669051+0000","last_unstale":"2024-09-17T03:43:55.654169+0000","last_undegraded":"2024-09-17T03:43:55.654169+0000","last_fullsized":"2024-09-17T03:43:55.654169+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:36.587426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668255+0000","last_change":"2024-09-17T03:43:53.647435+0000","last_active":"2024-09-17T03:43:55.668255+0000","last_peered":"2024-09-17T03:43:55.668255+0000","last_clean":"2024-09-17T03:43:55.668255+0000","last_became_active":"2024-09-17T03:43:53.647090+0000","last_became_peered":"2024-09-17T03:43:53.647090+0000","last_unstale":"2024-09-17T03:43:55.668255+0000","last_undegraded":"2024-09-17T03:43:55.668255+0000","last_fullsized":"2024-09-17T03:43:55.668255+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:44.725915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983752+0000","last_change":"2024-09-17T03:43:54.663121+0000","last_active":"2024-09-17T03:43:55.983752+0000","last_peered":"2024-09-17T03:43:55.983752+0000","last_clean":"2024-09-17T03:43:55.983752+0000","last_became_active":"2024-09-17T03:43:54.662731+0000","last_became_peered":"2024-09-17T03:43:54.662731+0000","last_unstale":"2024-09-17T03:43:55.983752+0000","last_undegraded":"2024-09-17T03:43:55.983752+0000","last_fullsized":"2024-09-17T03:43:55.983752+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:28.469099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983757+0000","last_change":"2024-09-17T03:43:53.650612+0000","last_active":"2024-09-17T03:43:55.983757+0000","last_peered":"2024-09-17T03:43:55.983757+0000","last_clean":"2024-09-17T03:43:55.983757+0000","last_became_active":"2024-09-17T03:43:53.650247+0000","last_became_peered":"2024-09-17T03:43:53.650247+0000","last_unstale":"2024-09-17T03:43:55.983757+0000","last_undegraded":"2024-09-17T03:43:55.983757+0000","last_fullsized":"2024-09-17T03:43:55.983757+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:11.707083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983651+0000","last_change":"2024-09-17T03:43:54.659675+0000","last_active":"2024-09-17T03:43:55.983651+0000","last_peered":"2024-09-17T03:43:55.983651+0000","last_clean":"2024-09-17T03:43:55.983651+0000","last_became_active":"2024-09-17T03:43:54.659366+0000","last_became_peered":"2024-09-17T03:43:54.659366+0000","last_unstale":"2024-09-17T03:43:55.983651+0000","last_undegraded":"2024-09-17T03:43:55.983651+0000","last_fullsized":"2024-09-17T03:43:55.983651+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:18.578319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953773+0000","last_change":"2024-09-17T03:43:53.652033+0000","last_active":"2024-09-17T03:43:55.953773+0000","last_peered":"2024-09-17T03:43:55.953773+0000","last_clean":"2024-09-17T03:43:55.953773+0000","last_became_active":"2024-09-17T03:43:53.651598+0000","last_became_peered":"2024-09-17T03:43:53.651598+0000","last_unstale":"2024-09-17T03:43:55.953773+0000","last_undegraded":"2024-09-17T03:43:55.953773+0000","last_fullsized":"2024-09-17T03:43:55.953773+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:05.445692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666317+0000","last_change":"2024-09-17T03:43:54.667335+0000","last_active":"2024-09-17T03:43:55.666317+0000","last_peered":"2024-09-17T03:43:55.666317+0000","last_clean":"2024-09-17T03:43:55.666317+0000","last_became_active":"2024-09-17T03:43:54.666855+0000","last_became_peered":"2024-09-17T03:43:54.666855+0000","last_unstale":"2024-09-17T03:43:55.666317+0000","last_undegraded":"2024-09-17T03:43:55.666317+0000","last_fullsized":"2024-09-17T03:43:55.666317+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:24.796267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"165'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666347+0000","last_change":"2024-09-17T03:43:53.650894+0000","last_active":"2024-09-17T03:43:55.666347+0000","last_peered":"2024-09-17T03:43:55.666347+0000","last_clean":"2024-09-17T03:43:55.666347+0000","last_became_active":"2024-09-17T03:43:53.650585+0000","last_became_peered":"2024-09-17T03:43:53.650585+0000","last_unstale":"2024-09-17T03:43:55.666347+0000","last_undegraded":"2024-09-17T03:43:55.666347+0000","last_fullsized":"2024-09-17T03:43:55.666347+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647562+0000","last_change":"2024-09-17T03:43:54.668026+0000","last_active":"2024-09-17T03:43:55.647562+0000","last_peered":"2024-09-17T03:43:55.647562+0000","last_clean":"2024-09-17T03:43:55.647562+0000","last_became_active":"2024-09-17T03:43:54.667733+0000","last_became_peered":"2024-09-17T03:43:54.667733+0000","last_unstale":"2024-09-17T03:43:55.647562+0000","last_undegraded":"2024-09-17T03:43:55.647562+0000","last_fullsized":"2024-09-17T03:43:55.647562+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:29.670536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666242+0000","last_change":"2024-09-17T03:43:53.649967+0000","last_active":"2024-09-17T03:43:55.666242+0000","last_peered":"2024-09-17T03:43:55.666242+0000","last_clean":"2024-09-17T03:43:55.666242+0000","last_became_active":"2024-09-17T03:43:53.649642+0000","last_became_peered":"2024-09-17T03:43:53.649642+0000","last_unstale":"2024-09-17T03:43:55.666242+0000","last_undegraded":"2024-09-17T03:43:55.666242+0000","last_fullsized":"2024-09-17T03:43:55.666242+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:59.929273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647921+0000","last_change":"2024-09-17T03:43:54.666057+0000","last_active":"2024-09-17T03:43:55.647921+0000","last_peered":"2024-09-17T03:43:55.647921+0000","last_clean":"2024-09-17T03:43:55.647921+0000","last_became_active":"2024-09-17T03:43:54.665692+0000","last_became_peered":"2024-09-17T03:43:54.665692+0000","last_unstale":"2024-09-17T03:43:55.647921+0000","last_undegraded":"2024-09-17T03:43:55.647921+0000","last_fullsized":"2024-09-17T03:43:55.647921+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:35.834253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647451+0000","last_change":"2024-09-17T03:43:53.648302+0000","last_active":"2024-09-17T03:43:55.647451+0000","last_peered":"2024-09-17T03:43:55.647451+0000","last_clean":"2024-09-17T03:43:55.647451+0000","last_became_active":"2024-09-17T03:43:53.647956+0000","last_became_peered":"2024-09-17T03:43:53.647956+0000","last_unstale":"2024-09-17T03:43:55.647451+0000","last_undegraded":"2024-09-17T03:43:55.647451+0000","last_fullsized":"2024-09-17T03:43:55.647451+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:06.888162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953613+0000","last_change":"2024-09-17T03:43:54.667145+0000","last_active":"2024-09-17T03:43:55.953613+0000","last_peered":"2024-09-17T03:43:55.953613+0000","last_clean":"2024-09-17T03:43:55.953613+0000","last_became_active":"2024-09-17T03:43:54.666817+0000","last_became_peered":"2024-09-17T03:43:54.666817+0000","last_unstale":"2024-09-17T03:43:55.953613+0000","last_undegraded":"2024-09-17T03:43:55.953613+0000","last_fullsized":"2024-09-17T03:43:55.953613+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.008860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983991+0000","last_change":"2024-09-17T03:43:53.646019+0000","last_active":"2024-09-17T03:43:55.983991+0000","last_peered":"2024-09-17T03:43:55.983991+0000","last_clean":"2024-09-17T03:43:55.983991+0000","last_became_active":"2024-09-17T03:43:53.645555+0000","last_became_peered":"2024-09-17T03:43:53.645555+0000","last_unstale":"2024-09-17T03:43:55.983991+0000","last_undegraded":"2024-09-17T03:43:55.983991+0000","last_fullsized":"2024-09-17T03:43:55.983991+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:12.150493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953642+0000","last_change":"2024-09-17T03:43:54.666953+0000","last_active":"2024-09-17T03:43:55.953642+0000","last_peered":"2024-09-17T03:43:55.953642+0000","last_clean":"2024-09-17T03:43:55.953642+0000","last_became_active":"2024-09-17T03:43:54.666590+0000","last_became_peered":"2024-09-17T03:43:54.666590+0000","last_unstale":"2024-09-17T03:43:55.953642+0000","last_undegraded":"2024-09-17T03:43:55.953642+0000","last_fullsized":"2024-09-17T03:43:55.953642+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:04.799939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983792+0000","last_change":"2024-09-17T03:43:53.648330+0000","last_active":"2024-09-17T03:43:55.983792+0000","last_peered":"2024-09-17T03:43:55.983792+0000","last_clean":"2024-09-17T03:43:55.983792+0000","last_became_active":"2024-09-17T03:43:53.648045+0000","last_became_peered":"2024-09-17T03:43:53.648045+0000","last_unstale":"2024-09-17T03:43:55.983792+0000","last_undegraded":"2024-09-17T03:43:55.983792+0000","last_fullsized":"2024-09-17T03:43:55.983792+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:26.973084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.654323+0000","last_change":"2024-09-17T03:43:54.661278+0000","last_active":"2024-09-17T03:43:55.654323+0000","last_peered":"2024-09-17T03:43:55.654323+0000","last_clean":"2024-09-17T03:43:55.654323+0000","last_became_active":"2024-09-17T03:43:54.660981+0000","last_became_peered":"2024-09-17T03:43:54.660981+0000","last_unstale":"2024-09-17T03:43:55.654323+0000","last_undegraded":"2024-09-17T03:43:55.654323+0000","last_fullsized":"2024-09-17T03:43:55.654323+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:27.067530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653106+0000","last_change":"2024-09-17T03:43:53.648567+0000","last_active":"2024-09-17T03:43:55.653106+0000","last_peered":"2024-09-17T03:43:55.653106+0000","last_clean":"2024-09-17T03:43:55.653106+0000","last_became_active":"2024-09-17T03:43:53.648198+0000","last_became_peered":"2024-09-17T03:43:53.648198+0000","last_unstale":"2024-09-17T03:43:55.653106+0000","last_undegraded":"2024-09-17T03:43:55.653106+0000","last_fullsized":"2024-09-17T03:43:55.653106+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:46.546050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983272+0000","last_change":"2024-09-17T03:43:54.668432+0000","last_active":"2024-09-17T03:43:55.983272+0000","last_peered":"2024-09-17T03:43:55.983272+0000","last_clean":"2024-09-17T03:43:55.983272+0000","last_became_active":"2024-09-17T03:43:54.668119+0000","last_became_peered":"2024-09-17T03:43:54.668119+0000","last_unstale":"2024-09-17T03:43:55.983272+0000","last_undegraded":"2024-09-17T03:43:55.983272+0000","last_fullsized":"2024-09-17T03:43:55.983272+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:40.679646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.667919+0000","last_change":"2024-09-17T03:43:53.636144+0000","last_active":"2024-09-17T03:43:55.667919+0000","last_peered":"2024-09-17T03:43:55.667919+0000","last_clean":"2024-09-17T03:43:55.667919+0000","last_became_active":"2024-09-17T03:43:53.635853+0000","last_became_peered":"2024-09-17T03:43:53.635853+0000","last_unstale":"2024-09-17T03:43:55.667919+0000","last_undegraded":"2024-09-17T03:43:55.667919+0000","last_fullsized":"2024-09-17T03:43:55.667919+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:54.139465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.665758+0000","last_change":"2024-09-17T03:43:54.662636+0000","last_active":"2024-09-17T03:43:55.665758+0000","last_peered":"2024-09-17T03:43:55.665758+0000","last_clean":"2024-09-17T03:43:55.665758+0000","last_became_active":"2024-09-17T03:43:54.662343+0000","last_became_peered":"2024-09-17T03:43:54.662343+0000","last_unstale":"2024-09-17T03:43:55.665758+0000","last_undegraded":"2024-09-17T03:43:55.665758+0000","last_fullsized":"2024-09-17T03:43:55.665758+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:02.385182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953498+0000","last_change":"2024-09-17T03:43:53.650336+0000","last_active":"2024-09-17T03:43:55.953498+0000","last_peered":"2024-09-17T03:43:55.953498+0000","last_clean":"2024-09-17T03:43:55.953498+0000","last_became_active":"2024-09-17T03:43:53.649990+0000","last_became_peered":"2024-09-17T03:43:53.649990+0000","last_unstale":"2024-09-17T03:43:55.953498+0000","last_undegraded":"2024-09-17T03:43:55.953498+0000","last_fullsized":"2024-09-17T03:43:55.953498+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:28.317830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":375,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.954013+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:43:55.954013+0000","last_peered":"2024-09-17T03:43:55.954013+0000","last_clean":"2024-09-17T03:43:55.954013+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:43:55.954013+0000","last_undegraded":"2024-09-17T03:43:55.954013+0000","last_fullsized":"2024-09-17T03:43:55.954013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509578,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60168,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311672,"statfs":{"total":96636764160,"available":96575152128,"internally_reserved":0,"allocated":2670592,"data_stored":1500932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509578,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":2068480,"data_stored":910460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509578,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63752,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308088,"statfs":{"total":96636764160,"available":96571482112,"internally_reserved":0,"allocated":2084864,"data_stored":912654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509578,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55432,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316408,"statfs":{"total":96636764160,"available":96580001792,"internally_reserved":0,"allocated":2080768,"data_stored":911154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509579,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55428,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316412,"statfs":{"total":96636764160,"available":96580005888,"internally_reserved":0,"allocated":2080768,"data_stored":912072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509579,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51844,"kb_used_data":2604,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319996,"statfs":{"total":96636764160,"available":96583675904,"internally_reserved":0,"allocated":2666496,"data_stored":1500850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55416,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316424,"statfs":{"total":96636764160,"available":96580018176,"internally_reserved":0,"allocated":2068480,"data_stored":910460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55436,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316404,"statfs":{"total":96636764160,"available":96579997696,"internally_reserved":0,"allocated":2080768,"data_stored":910654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:44:03.126 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:44:03.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.253+0000 7f9ab77df640 1 -- 172.21.15.146:0/1377300543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ab00b3250 msgr2=0x7f9ab00b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:03.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.253+0000 7f9ab77df640 1 --2- 172.21.15.146:0/1377300543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ab00b3250 0x7f9ab00b1f40 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009830 tx=0x7f9aa002a510 comp rx=0 tx=0).stop 2024-09-17T03:44:03.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.254+0000 7f9ab77df640 1 -- 172.21.15.146:0/1377300543 shutdown_connections 2024-09-17T03:44:03.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.254+0000 7f9ab77df640 1 --2- 172.21.15.146:0/1377300543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ab00b2480 0x7f9ab00b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.254+0000 7f9ab77df640 1 --2- 172.21.15.146:0/1377300543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ab00b3250 0x7f9ab00b1f40 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.254+0000 7f9ab77df640 1 -- 172.21.15.146:0/1377300543 >> 172.21.15.146:0/1377300543 conn(0x7f9ab009ba20 msgr2=0x7f9ab00b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.254+0000 7f9ab77df640 1 -- 172.21.15.146:0/1377300543 shutdown_connections 2024-09-17T03:44:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.254+0000 7f9ab77df640 1 -- 172.21.15.146:0/1377300543 wait complete. 2024-09-17T03:44:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.255+0000 7f9ab77df640 1 Processor -- start 2024-09-17T03:44:03.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.256+0000 7f9ab77df640 1 -- start start 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab77df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ab00b2480 0x7f9ab0142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab77df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ab00b3250 0x7f9ab01f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab77df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ab00b4f20 0x7f9ab01f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab77df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab0160b70 con 0x7f9ab00b3250 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab77df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab00b1320 con 0x7f9ab00b2480 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab77df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab0160cf0 con 0x7f9ab00b4f20 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab4d7a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ab00b3250 0x7f9ab01f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab4d7a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ab00b3250 0x7f9ab01f6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43940/0 (socket says 172.21.15.146:43940) 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab4d7a640 1 -- 172.21.15.146:0/518081882 learned_addr learned my addr 172.21.15.146:0/518081882 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab557b640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ab00b2480 0x7f9ab0142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab5d7c640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ab00b4f20 0x7f9ab01f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab4d7a640 1 -- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ab00b4f20 msgr2=0x7f9ab01f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab4d7a640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ab00b4f20 0x7f9ab01f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab4d7a640 1 -- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ab00b2480 msgr2=0x7f9ab0142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab4d7a640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ab00b2480 0x7f9ab0142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab4d7a640 1 -- 172.21.15.146:0/518081882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab01e63a0 con 0x7f9ab00b3250 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab557b640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ab00b2480 0x7f9ab0142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab5d7c640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ab00b4f20 0x7f9ab01f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.257+0000 7f9ab4d7a640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ab00b3250 0x7f9ab01f6180 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009950 tx=0x7f9aa0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.258+0000 7f9aa5ffb640 1 -- 172.21.15.146:0/518081882 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0031d60 con 0x7f9ab00b3250 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.258+0000 7f9aa5ffb640 1 -- 172.21.15.146:0/518081882 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aa0033e10 con 0x7f9ab00b3250 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.258+0000 7f9ab77df640 1 -- 172.21.15.146:0/518081882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab01f9790 con 0x7f9ab00b3250 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.258+0000 7f9aa5ffb640 1 -- 172.21.15.146:0/518081882 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0033310 con 0x7f9ab00b3250 2024-09-17T03:44:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.258+0000 7f9ab77df640 1 -- 172.21.15.146:0/518081882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab01f5980 con 0x7f9ab00b3250 2024-09-17T03:44:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.259+0000 7f9ab77df640 1 -- 172.21.15.146:0/518081882 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab00b08d0 con 0x7f9ab00b3250 2024-09-17T03:44:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.260+0000 7f9aa5ffb640 1 -- 172.21.15.146:0/518081882 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9aa00334b0 con 0x7f9ab00b3250 2024-09-17T03:44:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.260+0000 7f9aa5ffb640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a94078bc0 0x7f9a9407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:03.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.260+0000 7f9aa5ffb640 1 -- 172.21.15.146:0/518081882 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f9aa00bc100 con 0x7f9ab00b3250 2024-09-17T03:44:03.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.260+0000 7f9ab557b640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a94078bc0 0x7f9a9407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:03.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.261+0000 7f9ab557b640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a94078bc0 0x7f9a9407b0d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9aac001220 tx=0x7f9aac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:03.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.265+0000 7f9aa5ffb640 1 -- 172.21.15.146:0/518081882 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9aa003f030 con 0x7f9ab00b3250 2024-09-17T03:44:03.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.435+0000 7f9ab77df640 1 -- 172.21.15.146:0/518081882 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9ab0072390 con 0x7f9a94078bc0 2024-09-17T03:44:03.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.440+0000 7f9aa5ffb640 1 -- 172.21.15.146:0/518081882 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252474 (secure 0 0 0) 0x7f9ab0072390 con 0x7f9a94078bc0 2024-09-17T03:44:03.442 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:03.443 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:44:03.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 -- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a94078bc0 msgr2=0x7f9a9407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:03.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a94078bc0 0x7f9a9407b0d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9aac001220 tx=0x7f9aac009040 comp rx=0 tx=0).stop 2024-09-17T03:44:03.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 -- 172.21.15.146:0/518081882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ab00b3250 msgr2=0x7f9ab01f6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:03.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ab00b3250 0x7f9ab01f6180 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009950 tx=0x7f9aa0033c20 comp rx=0 tx=0).stop 2024-09-17T03:44:03.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 -- 172.21.15.146:0/518081882 shutdown_connections 2024-09-17T03:44:03.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a94078bc0 0x7f9a9407b0d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ab00b4f20 0x7f9ab01f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ab00b3250 0x7f9ab01f6180 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 --2- 172.21.15.146:0/518081882 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ab00b2480 0x7f9ab0142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 -- 172.21.15.146:0/518081882 >> 172.21.15.146:0/518081882 conn(0x7f9ab009ba20 msgr2=0x7f9ab00b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:03.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 -- 172.21.15.146:0/518081882 shutdown_connections 2024-09-17T03:44:03.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.443+0000 7f9ab77df640 1 -- 172.21.15.146:0/518081882 wait complete. 2024-09-17T03:44:03.455 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":496,"stamp":"2024-09-17T03:44:01.966696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":457056,"kb_used_data":17384,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754517664,"statfs":{"total":773094113280,"available":772626087936,"internally_reserved":0,"allocated":17801216,"data_stored":8469236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002108"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953840+0000","last_change":"2024-09-17T03:43:54.670351+0000","last_active":"2024-09-17T03:43:55.953840+0000","last_peered":"2024-09-17T03:43:55.953840+0000","last_clean":"2024-09-17T03:43:55.953840+0000","last_became_active":"2024-09-17T03:43:54.669817+0000","last_became_peered":"2024-09-17T03:43:54.669817+0000","last_unstale":"2024-09-17T03:43:55.953840+0000","last_undegraded":"2024-09-17T03:43:55.953840+0000","last_fullsized":"2024-09-17T03:43:55.953840+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:57.947479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653332+0000","last_change":"2024-09-17T03:43:54.663366+0000","last_active":"2024-09-17T03:43:55.653332+0000","last_peered":"2024-09-17T03:43:55.653332+0000","last_clean":"2024-09-17T03:43:55.653332+0000","last_became_active":"2024-09-17T03:43:54.660448+0000","last_became_peered":"2024-09-17T03:43:54.660448+0000","last_unstale":"2024-09-17T03:43:55.653332+0000","last_undegraded":"2024-09-17T03:43:55.653332+0000","last_fullsized":"2024-09-17T03:43:55.653332+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:29.473870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668106+0000","last_change":"2024-09-17T03:43:54.660263+0000","last_active":"2024-09-17T03:43:55.668106+0000","last_peered":"2024-09-17T03:43:55.668106+0000","last_clean":"2024-09-17T03:43:55.668106+0000","last_became_active":"2024-09-17T03:43:54.659968+0000","last_became_peered":"2024-09-17T03:43:54.659968+0000","last_unstale":"2024-09-17T03:43:55.668106+0000","last_undegraded":"2024-09-17T03:43:55.668106+0000","last_fullsized":"2024-09-17T03:43:55.668106+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:05.447689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653172+0000","last_change":"2024-09-17T03:43:54.658889+0000","last_active":"2024-09-17T03:43:55.653172+0000","last_peered":"2024-09-17T03:43:55.653172+0000","last_clean":"2024-09-17T03:43:55.653172+0000","last_became_active":"2024-09-17T03:43:54.658575+0000","last_became_peered":"2024-09-17T03:43:54.658575+0000","last_unstale":"2024-09-17T03:43:55.653172+0000","last_undegraded":"2024-09-17T03:43:55.653172+0000","last_fullsized":"2024-09-17T03:43:55.653172+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:06.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983362+0000","last_change":"2024-09-17T03:43:54.673122+0000","last_active":"2024-09-17T03:43:55.983362+0000","last_peered":"2024-09-17T03:43:55.983362+0000","last_clean":"2024-09-17T03:43:55.983362+0000","last_became_active":"2024-09-17T03:43:54.671190+0000","last_became_peered":"2024-09-17T03:43:54.671190+0000","last_unstale":"2024-09-17T03:43:55.983362+0000","last_undegraded":"2024-09-17T03:43:55.983362+0000","last_fullsized":"2024-09-17T03:43:55.983362+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:24.511657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668001+0000","last_change":"2024-09-17T03:43:54.660740+0000","last_active":"2024-09-17T03:43:55.668001+0000","last_peered":"2024-09-17T03:43:55.668001+0000","last_clean":"2024-09-17T03:43:55.668001+0000","last_became_active":"2024-09-17T03:43:54.660405+0000","last_became_peered":"2024-09-17T03:43:54.660405+0000","last_unstale":"2024-09-17T03:43:55.668001+0000","last_undegraded":"2024-09-17T03:43:55.668001+0000","last_fullsized":"2024-09-17T03:43:55.668001+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:30.367976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653087+0000","last_change":"2024-09-17T03:43:54.655685+0000","last_active":"2024-09-17T03:43:55.653087+0000","last_peered":"2024-09-17T03:43:55.653087+0000","last_clean":"2024-09-17T03:43:55.653087+0000","last_became_active":"2024-09-17T03:43:54.655326+0000","last_became_peered":"2024-09-17T03:43:54.655326+0000","last_unstale":"2024-09-17T03:43:55.653087+0000","last_undegraded":"2024-09-17T03:43:55.653087+0000","last_fullsized":"2024-09-17T03:43:55.653087+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:58.242356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647561+0000","last_change":"2024-09-17T03:43:54.655319+0000","last_active":"2024-09-17T03:43:55.647561+0000","last_peered":"2024-09-17T03:43:55.647561+0000","last_clean":"2024-09-17T03:43:55.647561+0000","last_became_active":"2024-09-17T03:43:54.655022+0000","last_became_peered":"2024-09-17T03:43:54.655022+0000","last_unstale":"2024-09-17T03:43:55.647561+0000","last_undegraded":"2024-09-17T03:43:55.647561+0000","last_fullsized":"2024-09-17T03:43:55.647561+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:19.101578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984059+0000","last_change":"2024-09-17T03:43:54.667783+0000","last_active":"2024-09-17T03:43:55.984059+0000","last_peered":"2024-09-17T03:43:55.984059+0000","last_clean":"2024-09-17T03:43:55.984059+0000","last_became_active":"2024-09-17T03:43:54.667437+0000","last_became_peered":"2024-09-17T03:43:54.667437+0000","last_unstale":"2024-09-17T03:43:55.984059+0000","last_undegraded":"2024-09-17T03:43:55.984059+0000","last_fullsized":"2024-09-17T03:43:55.984059+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:40.158899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.665986+0000","last_change":"2024-09-17T03:43:54.661088+0000","last_active":"2024-09-17T03:43:55.665986+0000","last_peered":"2024-09-17T03:43:55.665986+0000","last_clean":"2024-09-17T03:43:55.665986+0000","last_became_active":"2024-09-17T03:43:54.660784+0000","last_became_peered":"2024-09-17T03:43:54.660784+0000","last_unstale":"2024-09-17T03:43:55.665986+0000","last_undegraded":"2024-09-17T03:43:55.665986+0000","last_fullsized":"2024-09-17T03:43:55.665986+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.008860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653933+0000","last_change":"2024-09-17T03:43:54.670145+0000","last_active":"2024-09-17T03:43:55.653933+0000","last_peered":"2024-09-17T03:43:55.653933+0000","last_clean":"2024-09-17T03:43:55.653933+0000","last_became_active":"2024-09-17T03:43:54.669327+0000","last_became_peered":"2024-09-17T03:43:54.669327+0000","last_unstale":"2024-09-17T03:43:55.653933+0000","last_undegraded":"2024-09-17T03:43:55.653933+0000","last_fullsized":"2024-09-17T03:43:55.653933+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:29.473870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653392+0000","last_change":"2024-09-17T03:43:54.664401+0000","last_active":"2024-09-17T03:43:55.653392+0000","last_peered":"2024-09-17T03:43:55.653392+0000","last_clean":"2024-09-17T03:43:55.653392+0000","last_became_active":"2024-09-17T03:43:54.664052+0000","last_became_peered":"2024-09-17T03:43:54.664052+0000","last_unstale":"2024-09-17T03:43:55.653392+0000","last_undegraded":"2024-09-17T03:43:55.653392+0000","last_fullsized":"2024-09-17T03:43:55.653392+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:05.447689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.652803+0000","last_change":"2024-09-17T03:43:54.662932+0000","last_active":"2024-09-17T03:43:55.652803+0000","last_peered":"2024-09-17T03:43:55.652803+0000","last_clean":"2024-09-17T03:43:55.652803+0000","last_became_active":"2024-09-17T03:43:54.662580+0000","last_became_peered":"2024-09-17T03:43:54.662580+0000","last_unstale":"2024-09-17T03:43:55.652803+0000","last_undegraded":"2024-09-17T03:43:55.652803+0000","last_fullsized":"2024-09-17T03:43:55.652803+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:31.707876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983964+0000","last_change":"2024-09-17T03:43:54.667596+0000","last_active":"2024-09-17T03:43:55.983964+0000","last_peered":"2024-09-17T03:43:55.983964+0000","last_clean":"2024-09-17T03:43:55.983964+0000","last_became_active":"2024-09-17T03:43:54.667088+0000","last_became_peered":"2024-09-17T03:43:54.667088+0000","last_unstale":"2024-09-17T03:43:55.983964+0000","last_undegraded":"2024-09-17T03:43:55.983964+0000","last_fullsized":"2024-09-17T03:43:55.983964+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:25.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.652939+0000","last_change":"2024-09-17T03:43:54.663235+0000","last_active":"2024-09-17T03:43:55.652939+0000","last_peered":"2024-09-17T03:43:55.652939+0000","last_clean":"2024-09-17T03:43:55.652939+0000","last_became_active":"2024-09-17T03:43:54.662722+0000","last_became_peered":"2024-09-17T03:43:54.662722+0000","last_unstale":"2024-09-17T03:43:55.652939+0000","last_undegraded":"2024-09-17T03:43:55.652939+0000","last_fullsized":"2024-09-17T03:43:55.652939+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:55.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647641+0000","last_change":"2024-09-17T03:43:54.665060+0000","last_active":"2024-09-17T03:43:55.647641+0000","last_peered":"2024-09-17T03:43:55.647641+0000","last_clean":"2024-09-17T03:43:55.647641+0000","last_became_active":"2024-09-17T03:43:54.664742+0000","last_became_peered":"2024-09-17T03:43:54.664742+0000","last_unstale":"2024-09-17T03:43:55.647641+0000","last_undegraded":"2024-09-17T03:43:55.647641+0000","last_fullsized":"2024-09-17T03:43:55.647641+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:45.262140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983766+0000","last_change":"2024-09-17T03:43:54.655313+0000","last_active":"2024-09-17T03:43:55.983766+0000","last_peered":"2024-09-17T03:43:55.983766+0000","last_clean":"2024-09-17T03:43:55.983766+0000","last_became_active":"2024-09-17T03:43:54.655023+0000","last_became_peered":"2024-09-17T03:43:54.655023+0000","last_unstale":"2024-09-17T03:43:55.983766+0000","last_undegraded":"2024-09-17T03:43:55.983766+0000","last_fullsized":"2024-09-17T03:43:55.983766+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:09.377734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953725+0000","last_change":"2024-09-17T03:43:54.660146+0000","last_active":"2024-09-17T03:43:55.953725+0000","last_peered":"2024-09-17T03:43:55.953725+0000","last_clean":"2024-09-17T03:43:55.953725+0000","last_became_active":"2024-09-17T03:43:54.659812+0000","last_became_peered":"2024-09-17T03:43:54.659812+0000","last_unstale":"2024-09-17T03:43:55.953725+0000","last_undegraded":"2024-09-17T03:43:55.953725+0000","last_fullsized":"2024-09-17T03:43:55.953725+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:34.425270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666033+0000","last_change":"2024-09-17T03:43:54.659805+0000","last_active":"2024-09-17T03:43:55.666033+0000","last_peered":"2024-09-17T03:43:55.666033+0000","last_clean":"2024-09-17T03:43:55.666033+0000","last_became_active":"2024-09-17T03:43:54.659375+0000","last_became_peered":"2024-09-17T03:43:54.659375+0000","last_unstale":"2024-09-17T03:43:55.666033+0000","last_undegraded":"2024-09-17T03:43:55.666033+0000","last_fullsized":"2024-09-17T03:43:55.666033+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.667931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983480+0000","last_change":"2024-09-17T03:43:54.654095+0000","last_active":"2024-09-17T03:43:55.983480+0000","last_peered":"2024-09-17T03:43:55.983480+0000","last_clean":"2024-09-17T03:43:55.983480+0000","last_became_active":"2024-09-17T03:43:54.653775+0000","last_became_peered":"2024-09-17T03:43:54.653775+0000","last_unstale":"2024-09-17T03:43:55.983480+0000","last_undegraded":"2024-09-17T03:43:55.983480+0000","last_fullsized":"2024-09-17T03:43:55.983480+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:15.242599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983495+0000","last_change":"2024-09-17T03:43:54.670276+0000","last_active":"2024-09-17T03:43:55.983495+0000","last_peered":"2024-09-17T03:43:55.983495+0000","last_clean":"2024-09-17T03:43:55.983495+0000","last_became_active":"2024-09-17T03:43:54.669960+0000","last_became_peered":"2024-09-17T03:43:54.669960+0000","last_unstale":"2024-09-17T03:43:55.983495+0000","last_undegraded":"2024-09-17T03:43:55.983495+0000","last_fullsized":"2024-09-17T03:43:55.983495+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:48.955113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.665942+0000","last_change":"2024-09-17T03:43:54.655746+0000","last_active":"2024-09-17T03:43:55.665942+0000","last_peered":"2024-09-17T03:43:55.665942+0000","last_clean":"2024-09-17T03:43:55.665942+0000","last_became_active":"2024-09-17T03:43:54.655430+0000","last_became_peered":"2024-09-17T03:43:54.655430+0000","last_unstale":"2024-09-17T03:43:55.665942+0000","last_undegraded":"2024-09-17T03:43:55.665942+0000","last_fullsized":"2024-09-17T03:43:55.665942+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:15.309160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.667960+0000","last_change":"2024-09-17T03:43:54.659310+0000","last_active":"2024-09-17T03:43:55.667960+0000","last_peered":"2024-09-17T03:43:55.667960+0000","last_clean":"2024-09-17T03:43:55.667960+0000","last_became_active":"2024-09-17T03:43:54.659017+0000","last_became_peered":"2024-09-17T03:43:54.659017+0000","last_unstale":"2024-09-17T03:43:55.667960+0000","last_undegraded":"2024-09-17T03:43:55.667960+0000","last_fullsized":"2024-09-17T03:43:55.667960+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:55.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647790+0000","last_change":"2024-09-17T03:43:54.666755+0000","last_active":"2024-09-17T03:43:55.647790+0000","last_peered":"2024-09-17T03:43:55.647790+0000","last_clean":"2024-09-17T03:43:55.647790+0000","last_became_active":"2024-09-17T03:43:54.666432+0000","last_became_peered":"2024-09-17T03:43:54.666432+0000","last_unstale":"2024-09-17T03:43:55.647790+0000","last_undegraded":"2024-09-17T03:43:55.647790+0000","last_fullsized":"2024-09-17T03:43:55.647790+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:05.826937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653950+0000","last_change":"2024-09-17T03:43:54.653143+0000","last_active":"2024-09-17T03:43:55.653950+0000","last_peered":"2024-09-17T03:43:55.653950+0000","last_clean":"2024-09-17T03:43:55.653950+0000","last_became_active":"2024-09-17T03:43:54.652786+0000","last_became_peered":"2024-09-17T03:43:54.652786+0000","last_unstale":"2024-09-17T03:43:55.653950+0000","last_undegraded":"2024-09-17T03:43:55.653950+0000","last_fullsized":"2024-09-17T03:43:55.653950+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:38.206012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653892+0000","last_change":"2024-09-17T03:43:54.665727+0000","last_active":"2024-09-17T03:43:55.653892+0000","last_peered":"2024-09-17T03:43:55.653892+0000","last_clean":"2024-09-17T03:43:55.653892+0000","last_became_active":"2024-09-17T03:43:54.665433+0000","last_became_peered":"2024-09-17T03:43:54.665433+0000","last_unstale":"2024-09-17T03:43:55.653892+0000","last_undegraded":"2024-09-17T03:43:55.653892+0000","last_fullsized":"2024-09-17T03:43:55.653892+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:06.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668228+0000","last_change":"2024-09-17T03:43:54.669860+0000","last_active":"2024-09-17T03:43:55.668228+0000","last_peered":"2024-09-17T03:43:55.668228+0000","last_clean":"2024-09-17T03:43:55.668228+0000","last_became_active":"2024-09-17T03:43:54.669545+0000","last_became_peered":"2024-09-17T03:43:54.669545+0000","last_unstale":"2024-09-17T03:43:55.668228+0000","last_undegraded":"2024-09-17T03:43:55.668228+0000","last_fullsized":"2024-09-17T03:43:55.668228+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:38.206012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983573+0000","last_change":"2024-09-17T03:43:54.660913+0000","last_active":"2024-09-17T03:43:55.983573+0000","last_peered":"2024-09-17T03:43:55.983573+0000","last_clean":"2024-09-17T03:43:55.983573+0000","last_became_active":"2024-09-17T03:43:54.660576+0000","last_became_peered":"2024-09-17T03:43:54.660576+0000","last_unstale":"2024-09-17T03:43:55.983573+0000","last_undegraded":"2024-09-17T03:43:55.983573+0000","last_fullsized":"2024-09-17T03:43:55.983573+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:22.304762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653068+0000","last_change":"2024-09-17T03:43:54.663685+0000","last_active":"2024-09-17T03:43:55.653068+0000","last_peered":"2024-09-17T03:43:55.653068+0000","last_clean":"2024-09-17T03:43:55.653068+0000","last_became_active":"2024-09-17T03:43:54.663382+0000","last_became_peered":"2024-09-17T03:43:54.663382+0000","last_unstale":"2024-09-17T03:43:55.653068+0000","last_undegraded":"2024-09-17T03:43:55.653068+0000","last_fullsized":"2024-09-17T03:43:55.653068+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:30.367976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983636+0000","last_change":"2024-09-17T03:43:54.663609+0000","last_active":"2024-09-17T03:43:55.983636+0000","last_peered":"2024-09-17T03:43:55.983636+0000","last_clean":"2024-09-17T03:43:55.983636+0000","last_became_active":"2024-09-17T03:43:54.663199+0000","last_became_peered":"2024-09-17T03:43:54.663199+0000","last_unstale":"2024-09-17T03:43:55.983636+0000","last_undegraded":"2024-09-17T03:43:55.983636+0000","last_fullsized":"2024-09-17T03:43:55.983636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:59.078819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668073+0000","last_change":"2024-09-17T03:43:54.667040+0000","last_active":"2024-09-17T03:43:55.668073+0000","last_peered":"2024-09-17T03:43:55.668073+0000","last_clean":"2024-09-17T03:43:55.668073+0000","last_became_active":"2024-09-17T03:43:54.666713+0000","last_became_peered":"2024-09-17T03:43:54.666713+0000","last_unstale":"2024-09-17T03:43:55.668073+0000","last_undegraded":"2024-09-17T03:43:55.668073+0000","last_fullsized":"2024-09-17T03:43:55.668073+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:06.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983242+0000","last_change":"2024-09-17T03:43:54.656706+0000","last_active":"2024-09-17T03:43:55.983242+0000","last_peered":"2024-09-17T03:43:55.983242+0000","last_clean":"2024-09-17T03:43:55.983242+0000","last_became_active":"2024-09-17T03:43:54.656393+0000","last_became_peered":"2024-09-17T03:43:54.656393+0000","last_unstale":"2024-09-17T03:43:55.983242+0000","last_undegraded":"2024-09-17T03:43:55.983242+0000","last_fullsized":"2024-09-17T03:43:55.983242+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:43.014067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647855+0000","last_change":"2024-09-17T03:43:54.665630+0000","last_active":"2024-09-17T03:43:55.647855+0000","last_peered":"2024-09-17T03:43:55.647855+0000","last_clean":"2024-09-17T03:43:55.647855+0000","last_became_active":"2024-09-17T03:43:54.665303+0000","last_became_peered":"2024-09-17T03:43:54.665303+0000","last_unstale":"2024-09-17T03:43:55.647855+0000","last_undegraded":"2024-09-17T03:43:55.647855+0000","last_fullsized":"2024-09-17T03:43:55.647855+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:34.015909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"164'4","reported_seq":19,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983748+0000","last_change":"2024-09-17T03:43:53.642888+0000","last_active":"2024-09-17T03:43:55.983748+0000","last_peered":"2024-09-17T03:43:55.983748+0000","last_clean":"2024-09-17T03:43:55.983748+0000","last_became_active":"2024-09-17T03:43:53.642585+0000","last_became_peered":"2024-09-17T03:43:53.642585+0000","last_unstale":"2024-09-17T03:43:55.983748+0000","last_undegraded":"2024-09-17T03:43:55.983748+0000","last_fullsized":"2024-09-17T03:43:55.983748+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:11.713533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666263+0000","last_change":"2024-09-17T03:43:54.657437+0000","last_active":"2024-09-17T03:43:55.666263+0000","last_peered":"2024-09-17T03:43:55.666263+0000","last_clean":"2024-09-17T03:43:55.666263+0000","last_became_active":"2024-09-17T03:43:54.657125+0000","last_became_peered":"2024-09-17T03:43:54.657125+0000","last_unstale":"2024-09-17T03:43:55.666263+0000","last_undegraded":"2024-09-17T03:43:55.666263+0000","last_fullsized":"2024-09-17T03:43:55.666263+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:39.513939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984083+0000","last_change":"2024-09-17T03:43:53.647661+0000","last_active":"2024-09-17T03:43:55.984083+0000","last_peered":"2024-09-17T03:43:55.984083+0000","last_clean":"2024-09-17T03:43:55.984083+0000","last_became_active":"2024-09-17T03:43:53.647274+0000","last_became_peered":"2024-09-17T03:43:53.647274+0000","last_unstale":"2024-09-17T03:43:55.984083+0000","last_undegraded":"2024-09-17T03:43:55.984083+0000","last_fullsized":"2024-09-17T03:43:55.984083+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:35.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.652888+0000","last_change":"2024-09-17T03:43:54.656859+0000","last_active":"2024-09-17T03:43:55.652888+0000","last_peered":"2024-09-17T03:43:55.652888+0000","last_clean":"2024-09-17T03:43:55.652888+0000","last_became_active":"2024-09-17T03:43:54.655671+0000","last_became_peered":"2024-09-17T03:43:54.655671+0000","last_unstale":"2024-09-17T03:43:55.652888+0000","last_undegraded":"2024-09-17T03:43:55.652888+0000","last_fullsized":"2024-09-17T03:43:55.652888+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:07.673710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668277+0000","last_change":"2024-09-17T03:43:53.644185+0000","last_active":"2024-09-17T03:43:55.668277+0000","last_peered":"2024-09-17T03:43:55.668277+0000","last_clean":"2024-09-17T03:43:55.668277+0000","last_became_active":"2024-09-17T03:43:53.643895+0000","last_became_peered":"2024-09-17T03:43:53.643895+0000","last_unstale":"2024-09-17T03:43:55.668277+0000","last_undegraded":"2024-09-17T03:43:55.668277+0000","last_fullsized":"2024-09-17T03:43:55.668277+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:25.740044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984016+0000","last_change":"2024-09-17T03:43:54.663996+0000","last_active":"2024-09-17T03:43:55.984016+0000","last_peered":"2024-09-17T03:43:55.984016+0000","last_clean":"2024-09-17T03:43:55.984016+0000","last_became_active":"2024-09-17T03:43:54.663664+0000","last_became_peered":"2024-09-17T03:43:54.663664+0000","last_unstale":"2024-09-17T03:43:55.984016+0000","last_undegraded":"2024-09-17T03:43:55.984016+0000","last_fullsized":"2024-09-17T03:43:55.984016+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:46.673846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653566+0000","last_change":"2024-09-17T03:43:53.648032+0000","last_active":"2024-09-17T03:43:55.653566+0000","last_peered":"2024-09-17T03:43:55.653566+0000","last_clean":"2024-09-17T03:43:55.653566+0000","last_became_active":"2024-09-17T03:43:53.647737+0000","last_became_peered":"2024-09-17T03:43:53.647737+0000","last_unstale":"2024-09-17T03:43:55.653566+0000","last_undegraded":"2024-09-17T03:43:55.653566+0000","last_fullsized":"2024-09-17T03:43:55.653566+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:26.178906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666159+0000","last_change":"2024-09-17T03:43:54.655510+0000","last_active":"2024-09-17T03:43:55.666159+0000","last_peered":"2024-09-17T03:43:55.666159+0000","last_clean":"2024-09-17T03:43:55.666159+0000","last_became_active":"2024-09-17T03:43:54.655067+0000","last_became_peered":"2024-09-17T03:43:54.655067+0000","last_unstale":"2024-09-17T03:43:55.666159+0000","last_undegraded":"2024-09-17T03:43:55.666159+0000","last_fullsized":"2024-09-17T03:43:55.666159+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:36.760548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983647+0000","last_change":"2024-09-17T03:43:53.645679+0000","last_active":"2024-09-17T03:43:55.983647+0000","last_peered":"2024-09-17T03:43:55.983647+0000","last_clean":"2024-09-17T03:43:55.983647+0000","last_became_active":"2024-09-17T03:43:53.645360+0000","last_became_peered":"2024-09-17T03:43:53.645360+0000","last_unstale":"2024-09-17T03:43:55.983647+0000","last_undegraded":"2024-09-17T03:43:55.983647+0000","last_fullsized":"2024-09-17T03:43:55.983647+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:29.767020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647690+0000","last_change":"2024-09-17T03:43:54.672348+0000","last_active":"2024-09-17T03:43:55.647690+0000","last_peered":"2024-09-17T03:43:55.647690+0000","last_clean":"2024-09-17T03:43:55.647690+0000","last_became_active":"2024-09-17T03:43:54.670870+0000","last_became_peered":"2024-09-17T03:43:54.670870+0000","last_unstale":"2024-09-17T03:43:55.647690+0000","last_undegraded":"2024-09-17T03:43:55.647690+0000","last_fullsized":"2024-09-17T03:43:55.647690+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:41.754485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647702+0000","last_change":"2024-09-17T03:43:53.643291+0000","last_active":"2024-09-17T03:43:55.647702+0000","last_peered":"2024-09-17T03:43:55.647702+0000","last_clean":"2024-09-17T03:43:55.647702+0000","last_became_active":"2024-09-17T03:43:53.642982+0000","last_became_peered":"2024-09-17T03:43:53.642982+0000","last_unstale":"2024-09-17T03:43:55.647702+0000","last_undegraded":"2024-09-17T03:43:55.647702+0000","last_fullsized":"2024-09-17T03:43:55.647702+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:54.167248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653295+0000","last_change":"2024-09-17T03:43:54.661816+0000","last_active":"2024-09-17T03:43:55.653295+0000","last_peered":"2024-09-17T03:43:55.653295+0000","last_clean":"2024-09-17T03:43:55.653295+0000","last_became_active":"2024-09-17T03:43:54.661515+0000","last_became_peered":"2024-09-17T03:43:54.661515+0000","last_unstale":"2024-09-17T03:43:55.653295+0000","last_undegraded":"2024-09-17T03:43:55.653295+0000","last_fullsized":"2024-09-17T03:43:55.653295+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:58.320480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953288+0000","last_change":"2024-09-17T03:43:53.652597+0000","last_active":"2024-09-17T03:43:55.953288+0000","last_peered":"2024-09-17T03:43:55.953288+0000","last_clean":"2024-09-17T03:43:55.953288+0000","last_became_active":"2024-09-17T03:43:53.652283+0000","last_became_peered":"2024-09-17T03:43:53.652283+0000","last_unstale":"2024-09-17T03:43:55.953288+0000","last_undegraded":"2024-09-17T03:43:55.953288+0000","last_fullsized":"2024-09-17T03:43:55.953288+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:52.501672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668293+0000","last_change":"2024-09-17T03:43:54.668503+0000","last_active":"2024-09-17T03:43:55.668293+0000","last_peered":"2024-09-17T03:43:55.668293+0000","last_clean":"2024-09-17T03:43:55.668293+0000","last_became_active":"2024-09-17T03:43:54.668220+0000","last_became_peered":"2024-09-17T03:43:54.668220+0000","last_unstale":"2024-09-17T03:43:55.668293+0000","last_undegraded":"2024-09-17T03:43:55.668293+0000","last_fullsized":"2024-09-17T03:43:55.668293+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:36.587426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653858+0000","last_change":"2024-09-17T03:43:53.647225+0000","last_active":"2024-09-17T03:43:55.653858+0000","last_peered":"2024-09-17T03:43:55.653858+0000","last_clean":"2024-09-17T03:43:55.653858+0000","last_became_active":"2024-09-17T03:43:53.646763+0000","last_became_peered":"2024-09-17T03:43:53.646763+0000","last_unstale":"2024-09-17T03:43:55.653858+0000","last_undegraded":"2024-09-17T03:43:55.653858+0000","last_fullsized":"2024-09-17T03:43:55.653858+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:46.546050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.648113+0000","last_change":"2024-09-17T03:43:54.664068+0000","last_active":"2024-09-17T03:43:55.648113+0000","last_peered":"2024-09-17T03:43:55.648113+0000","last_clean":"2024-09-17T03:43:55.648113+0000","last_became_active":"2024-09-17T03:43:54.663753+0000","last_became_peered":"2024-09-17T03:43:54.663753+0000","last_unstale":"2024-09-17T03:43:55.648113+0000","last_undegraded":"2024-09-17T03:43:55.648113+0000","last_fullsized":"2024-09-17T03:43:55.648113+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:37.532930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983579+0000","last_change":"2024-09-17T03:43:53.648637+0000","last_active":"2024-09-17T03:43:55.983579+0000","last_peered":"2024-09-17T03:43:55.983579+0000","last_clean":"2024-09-17T03:43:55.983579+0000","last_became_active":"2024-09-17T03:43:53.648309+0000","last_became_peered":"2024-09-17T03:43:53.648309+0000","last_unstale":"2024-09-17T03:43:55.983579+0000","last_undegraded":"2024-09-17T03:43:55.983579+0000","last_fullsized":"2024-09-17T03:43:55.983579+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:41.779984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653566+0000","last_change":"2024-09-17T03:43:54.659618+0000","last_active":"2024-09-17T03:43:55.653566+0000","last_peered":"2024-09-17T03:43:55.653566+0000","last_clean":"2024-09-17T03:43:55.653566+0000","last_became_active":"2024-09-17T03:43:54.659308+0000","last_became_peered":"2024-09-17T03:43:54.659308+0000","last_unstale":"2024-09-17T03:43:55.653566+0000","last_undegraded":"2024-09-17T03:43:55.653566+0000","last_fullsized":"2024-09-17T03:43:55.653566+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:30.367976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"164'3","reported_seq":18,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983470+0000","last_change":"2024-09-17T03:43:53.653098+0000","last_active":"2024-09-17T03:43:55.983470+0000","last_peered":"2024-09-17T03:43:55.983470+0000","last_clean":"2024-09-17T03:43:55.983470+0000","last_became_active":"2024-09-17T03:43:53.652666+0000","last_became_peered":"2024-09-17T03:43:53.652666+0000","last_unstale":"2024-09-17T03:43:55.983470+0000","last_undegraded":"2024-09-17T03:43:55.983470+0000","last_fullsized":"2024-09-17T03:43:55.983470+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:56.001326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666018+0000","last_change":"2024-09-17T03:43:54.655431+0000","last_active":"2024-09-17T03:43:55.666018+0000","last_peered":"2024-09-17T03:43:55.666018+0000","last_clean":"2024-09-17T03:43:55.666018+0000","last_became_active":"2024-09-17T03:43:54.654905+0000","last_became_peered":"2024-09-17T03:43:54.654905+0000","last_unstale":"2024-09-17T03:43:55.666018+0000","last_undegraded":"2024-09-17T03:43:55.666018+0000","last_fullsized":"2024-09-17T03:43:55.666018+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:34.425270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"164'6","reported_seq":21,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668074+0000","last_change":"2024-09-17T03:43:53.643543+0000","last_active":"2024-09-17T03:43:55.668074+0000","last_peered":"2024-09-17T03:43:55.668074+0000","last_clean":"2024-09-17T03:43:55.668074+0000","last_became_active":"2024-09-17T03:43:53.642998+0000","last_became_peered":"2024-09-17T03:43:53.642998+0000","last_unstale":"2024-09-17T03:43:55.668074+0000","last_undegraded":"2024-09-17T03:43:55.668074+0000","last_fullsized":"2024-09-17T03:43:55.668074+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:03.525769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668104+0000","last_change":"2024-09-17T03:43:54.665211+0000","last_active":"2024-09-17T03:43:55.668104+0000","last_peered":"2024-09-17T03:43:55.668104+0000","last_clean":"2024-09-17T03:43:55.668104+0000","last_became_active":"2024-09-17T03:43:54.664846+0000","last_became_peered":"2024-09-17T03:43:54.664846+0000","last_unstale":"2024-09-17T03:43:55.668104+0000","last_undegraded":"2024-09-17T03:43:55.668104+0000","last_fullsized":"2024-09-17T03:43:55.668104+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:03.927544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953567+0000","last_change":"2024-09-17T03:43:53.650497+0000","last_active":"2024-09-17T03:43:55.953567+0000","last_peered":"2024-09-17T03:43:55.953567+0000","last_clean":"2024-09-17T03:43:55.953567+0000","last_became_active":"2024-09-17T03:43:53.650200+0000","last_became_peered":"2024-09-17T03:43:53.650200+0000","last_unstale":"2024-09-17T03:43:55.953567+0000","last_undegraded":"2024-09-17T03:43:55.953567+0000","last_fullsized":"2024-09-17T03:43:55.953567+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:53.225162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653265+0000","last_change":"2024-09-17T03:43:54.667662+0000","last_active":"2024-09-17T03:43:55.653265+0000","last_peered":"2024-09-17T03:43:55.653265+0000","last_clean":"2024-09-17T03:43:55.653265+0000","last_became_active":"2024-09-17T03:43:54.666158+0000","last_became_peered":"2024-09-17T03:43:54.666158+0000","last_unstale":"2024-09-17T03:43:55.653265+0000","last_undegraded":"2024-09-17T03:43:55.653265+0000","last_fullsized":"2024-09-17T03:43:55.653265+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:31.707876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666317+0000","last_change":"2024-09-17T03:43:53.648900+0000","last_active":"2024-09-17T03:43:55.666317+0000","last_peered":"2024-09-17T03:43:55.666317+0000","last_clean":"2024-09-17T03:43:55.666317+0000","last_became_active":"2024-09-17T03:43:53.648385+0000","last_became_peered":"2024-09-17T03:43:53.648385+0000","last_unstale":"2024-09-17T03:43:55.666317+0000","last_undegraded":"2024-09-17T03:43:55.666317+0000","last_fullsized":"2024-09-17T03:43:55.666317+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:50.103164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983703+0000","last_change":"2024-09-17T03:43:54.665253+0000","last_active":"2024-09-17T03:43:55.983703+0000","last_peered":"2024-09-17T03:43:55.983703+0000","last_clean":"2024-09-17T03:43:55.983703+0000","last_became_active":"2024-09-17T03:43:54.664937+0000","last_became_peered":"2024-09-17T03:43:54.664937+0000","last_unstale":"2024-09-17T03:43:55.983703+0000","last_undegraded":"2024-09-17T03:43:55.983703+0000","last_fullsized":"2024-09-17T03:43:55.983703+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:01.731823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647291+0000","last_change":"2024-09-17T03:43:53.647484+0000","last_active":"2024-09-17T03:43:55.647291+0000","last_peered":"2024-09-17T03:43:55.647291+0000","last_clean":"2024-09-17T03:43:55.647291+0000","last_became_active":"2024-09-17T03:43:53.647194+0000","last_became_peered":"2024-09-17T03:43:53.647194+0000","last_unstale":"2024-09-17T03:43:55.647291+0000","last_undegraded":"2024-09-17T03:43:55.647291+0000","last_fullsized":"2024-09-17T03:43:55.647291+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:20.612852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666022+0000","last_change":"2024-09-17T03:43:54.654916+0000","last_active":"2024-09-17T03:43:55.666022+0000","last_peered":"2024-09-17T03:43:55.666022+0000","last_clean":"2024-09-17T03:43:55.666022+0000","last_became_active":"2024-09-17T03:43:54.654519+0000","last_became_peered":"2024-09-17T03:43:54.654519+0000","last_unstale":"2024-09-17T03:43:55.666022+0000","last_undegraded":"2024-09-17T03:43:55.666022+0000","last_fullsized":"2024-09-17T03:43:55.666022+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:16.522301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"164'8","reported_seq":23,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953418+0000","last_change":"2024-09-17T03:43:53.652497+0000","last_active":"2024-09-17T03:43:55.953418+0000","last_peered":"2024-09-17T03:43:55.953418+0000","last_clean":"2024-09-17T03:43:55.953418+0000","last_became_active":"2024-09-17T03:43:53.651068+0000","last_became_peered":"2024-09-17T03:43:53.651068+0000","last_unstale":"2024-09-17T03:43:55.953418+0000","last_undegraded":"2024-09-17T03:43:55.953418+0000","last_fullsized":"2024-09-17T03:43:55.953418+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:41.360098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666093+0000","last_change":"2024-09-17T03:43:54.656572+0000","last_active":"2024-09-17T03:43:55.666093+0000","last_peered":"2024-09-17T03:43:55.666093+0000","last_clean":"2024-09-17T03:43:55.666093+0000","last_became_active":"2024-09-17T03:43:54.656268+0000","last_became_peered":"2024-09-17T03:43:54.656268+0000","last_unstale":"2024-09-17T03:43:55.666093+0000","last_undegraded":"2024-09-17T03:43:55.666093+0000","last_fullsized":"2024-09-17T03:43:55.666093+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:30.082373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983857+0000","last_change":"2024-09-17T03:43:53.643934+0000","last_active":"2024-09-17T03:43:55.983857+0000","last_peered":"2024-09-17T03:43:55.983857+0000","last_clean":"2024-09-17T03:43:55.983857+0000","last_became_active":"2024-09-17T03:43:53.643624+0000","last_became_peered":"2024-09-17T03:43:53.643624+0000","last_unstale":"2024-09-17T03:43:55.983857+0000","last_undegraded":"2024-09-17T03:43:55.983857+0000","last_fullsized":"2024-09-17T03:43:55.983857+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:13.192719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.984066+0000","last_change":"2024-09-17T03:43:54.671058+0000","last_active":"2024-09-17T03:43:55.984066+0000","last_peered":"2024-09-17T03:43:55.984066+0000","last_clean":"2024-09-17T03:43:55.984066+0000","last_became_active":"2024-09-17T03:43:54.670052+0000","last_became_peered":"2024-09-17T03:43:54.670052+0000","last_unstale":"2024-09-17T03:43:55.984066+0000","last_undegraded":"2024-09-17T03:43:55.984066+0000","last_fullsized":"2024-09-17T03:43:55.984066+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:29.400392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647787+0000","last_change":"2024-09-17T03:43:53.649241+0000","last_active":"2024-09-17T03:43:55.647787+0000","last_peered":"2024-09-17T03:43:55.647787+0000","last_clean":"2024-09-17T03:43:55.647787+0000","last_became_active":"2024-09-17T03:43:53.648942+0000","last_became_peered":"2024-09-17T03:43:53.648942+0000","last_unstale":"2024-09-17T03:43:55.647787+0000","last_undegraded":"2024-09-17T03:43:55.647787+0000","last_fullsized":"2024-09-17T03:43:55.647787+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:52.040153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983902+0000","last_change":"2024-09-17T03:43:54.662331+0000","last_active":"2024-09-17T03:43:55.983902+0000","last_peered":"2024-09-17T03:43:55.983902+0000","last_clean":"2024-09-17T03:43:55.983902+0000","last_became_active":"2024-09-17T03:43:54.661020+0000","last_became_peered":"2024-09-17T03:43:54.661020+0000","last_unstale":"2024-09-17T03:43:55.983902+0000","last_undegraded":"2024-09-17T03:43:55.983902+0000","last_fullsized":"2024-09-17T03:43:55.983902+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:48.585042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"164'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953715+0000","last_change":"2024-09-17T03:43:53.651532+0000","last_active":"2024-09-17T03:43:55.953715+0000","last_peered":"2024-09-17T03:43:55.953715+0000","last_clean":"2024-09-17T03:43:55.953715+0000","last_became_active":"2024-09-17T03:43:53.651190+0000","last_became_peered":"2024-09-17T03:43:53.651190+0000","last_unstale":"2024-09-17T03:43:55.953715+0000","last_undegraded":"2024-09-17T03:43:55.953715+0000","last_fullsized":"2024-09-17T03:43:55.953715+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:22.381161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.652914+0000","last_change":"2024-09-17T03:43:54.658246+0000","last_active":"2024-09-17T03:43:55.652914+0000","last_peered":"2024-09-17T03:43:55.652914+0000","last_clean":"2024-09-17T03:43:55.652914+0000","last_became_active":"2024-09-17T03:43:54.657906+0000","last_became_peered":"2024-09-17T03:43:54.657906+0000","last_unstale":"2024-09-17T03:43:55.652914+0000","last_undegraded":"2024-09-17T03:43:55.652914+0000","last_fullsized":"2024-09-17T03:43:55.652914+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:58.320480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653652+0000","last_change":"2024-09-17T03:43:53.646384+0000","last_active":"2024-09-17T03:43:55.653652+0000","last_peered":"2024-09-17T03:43:55.653652+0000","last_clean":"2024-09-17T03:43:55.653652+0000","last_became_active":"2024-09-17T03:43:53.646041+0000","last_became_peered":"2024-09-17T03:43:53.646041+0000","last_unstale":"2024-09-17T03:43:55.653652+0000","last_undegraded":"2024-09-17T03:43:55.653652+0000","last_fullsized":"2024-09-17T03:43:55.653652+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:26.178906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666245+0000","last_change":"2024-09-17T03:43:54.658117+0000","last_active":"2024-09-17T03:43:55.666245+0000","last_peered":"2024-09-17T03:43:55.666245+0000","last_clean":"2024-09-17T03:43:55.666245+0000","last_became_active":"2024-09-17T03:43:54.657645+0000","last_became_peered":"2024-09-17T03:43:54.657645+0000","last_unstale":"2024-09-17T03:43:55.666245+0000","last_undegraded":"2024-09-17T03:43:55.666245+0000","last_fullsized":"2024-09-17T03:43:55.666245+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:49.097755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.667975+0000","last_change":"2024-09-17T03:43:53.645944+0000","last_active":"2024-09-17T03:43:55.667975+0000","last_peered":"2024-09-17T03:43:55.667975+0000","last_clean":"2024-09-17T03:43:55.667975+0000","last_became_active":"2024-09-17T03:43:53.645640+0000","last_became_peered":"2024-09-17T03:43:53.645640+0000","last_unstale":"2024-09-17T03:43:55.667975+0000","last_undegraded":"2024-09-17T03:43:55.667975+0000","last_fullsized":"2024-09-17T03:43:55.667975+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:41.194237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653497+0000","last_change":"2024-09-17T03:43:54.662287+0000","last_active":"2024-09-17T03:43:55.653497+0000","last_peered":"2024-09-17T03:43:55.653497+0000","last_clean":"2024-09-17T03:43:55.653497+0000","last_became_active":"2024-09-17T03:43:54.658300+0000","last_became_peered":"2024-09-17T03:43:54.658300+0000","last_unstale":"2024-09-17T03:43:55.653497+0000","last_undegraded":"2024-09-17T03:43:55.653497+0000","last_fullsized":"2024-09-17T03:43:55.653497+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:55.613283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983342+0000","last_change":"2024-09-17T03:43:53.648560+0000","last_active":"2024-09-17T03:43:55.983342+0000","last_peered":"2024-09-17T03:43:55.983342+0000","last_clean":"2024-09-17T03:43:55.983342+0000","last_became_active":"2024-09-17T03:43:53.648255+0000","last_became_peered":"2024-09-17T03:43:53.648255+0000","last_unstale":"2024-09-17T03:43:55.983342+0000","last_undegraded":"2024-09-17T03:43:55.983342+0000","last_fullsized":"2024-09-17T03:43:55.983342+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:39.482101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.654169+0000","last_change":"2024-09-17T03:43:54.669393+0000","last_active":"2024-09-17T03:43:55.654169+0000","last_peered":"2024-09-17T03:43:55.654169+0000","last_clean":"2024-09-17T03:43:55.654169+0000","last_became_active":"2024-09-17T03:43:54.669051+0000","last_became_peered":"2024-09-17T03:43:54.669051+0000","last_unstale":"2024-09-17T03:43:55.654169+0000","last_undegraded":"2024-09-17T03:43:55.654169+0000","last_fullsized":"2024-09-17T03:43:55.654169+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:36.587426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.668255+0000","last_change":"2024-09-17T03:43:53.647435+0000","last_active":"2024-09-17T03:43:55.668255+0000","last_peered":"2024-09-17T03:43:55.668255+0000","last_clean":"2024-09-17T03:43:55.668255+0000","last_became_active":"2024-09-17T03:43:53.647090+0000","last_became_peered":"2024-09-17T03:43:53.647090+0000","last_unstale":"2024-09-17T03:43:55.668255+0000","last_undegraded":"2024-09-17T03:43:55.668255+0000","last_fullsized":"2024-09-17T03:43:55.668255+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:44.725915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983752+0000","last_change":"2024-09-17T03:43:54.663121+0000","last_active":"2024-09-17T03:43:55.983752+0000","last_peered":"2024-09-17T03:43:55.983752+0000","last_clean":"2024-09-17T03:43:55.983752+0000","last_became_active":"2024-09-17T03:43:54.662731+0000","last_became_peered":"2024-09-17T03:43:54.662731+0000","last_unstale":"2024-09-17T03:43:55.983752+0000","last_undegraded":"2024-09-17T03:43:55.983752+0000","last_fullsized":"2024-09-17T03:43:55.983752+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:28.469099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983757+0000","last_change":"2024-09-17T03:43:53.650612+0000","last_active":"2024-09-17T03:43:55.983757+0000","last_peered":"2024-09-17T03:43:55.983757+0000","last_clean":"2024-09-17T03:43:55.983757+0000","last_became_active":"2024-09-17T03:43:53.650247+0000","last_became_peered":"2024-09-17T03:43:53.650247+0000","last_unstale":"2024-09-17T03:43:55.983757+0000","last_undegraded":"2024-09-17T03:43:55.983757+0000","last_fullsized":"2024-09-17T03:43:55.983757+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:11.707083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983651+0000","last_change":"2024-09-17T03:43:54.659675+0000","last_active":"2024-09-17T03:43:55.983651+0000","last_peered":"2024-09-17T03:43:55.983651+0000","last_clean":"2024-09-17T03:43:55.983651+0000","last_became_active":"2024-09-17T03:43:54.659366+0000","last_became_peered":"2024-09-17T03:43:54.659366+0000","last_unstale":"2024-09-17T03:43:55.983651+0000","last_undegraded":"2024-09-17T03:43:55.983651+0000","last_fullsized":"2024-09-17T03:43:55.983651+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:18.578319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"164'2","reported_seq":17,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953773+0000","last_change":"2024-09-17T03:43:53.652033+0000","last_active":"2024-09-17T03:43:55.953773+0000","last_peered":"2024-09-17T03:43:55.953773+0000","last_clean":"2024-09-17T03:43:55.953773+0000","last_became_active":"2024-09-17T03:43:53.651598+0000","last_became_peered":"2024-09-17T03:43:53.651598+0000","last_unstale":"2024-09-17T03:43:55.953773+0000","last_undegraded":"2024-09-17T03:43:55.953773+0000","last_fullsized":"2024-09-17T03:43:55.953773+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:05.445692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666317+0000","last_change":"2024-09-17T03:43:54.667335+0000","last_active":"2024-09-17T03:43:55.666317+0000","last_peered":"2024-09-17T03:43:55.666317+0000","last_clean":"2024-09-17T03:43:55.666317+0000","last_became_active":"2024-09-17T03:43:54.666855+0000","last_became_peered":"2024-09-17T03:43:54.666855+0000","last_unstale":"2024-09-17T03:43:55.666317+0000","last_undegraded":"2024-09-17T03:43:55.666317+0000","last_fullsized":"2024-09-17T03:43:55.666317+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:24.796267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"165'1","reported_seq":16,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666347+0000","last_change":"2024-09-17T03:43:53.650894+0000","last_active":"2024-09-17T03:43:55.666347+0000","last_peered":"2024-09-17T03:43:55.666347+0000","last_clean":"2024-09-17T03:43:55.666347+0000","last_became_active":"2024-09-17T03:43:53.650585+0000","last_became_peered":"2024-09-17T03:43:53.650585+0000","last_unstale":"2024-09-17T03:43:55.666347+0000","last_undegraded":"2024-09-17T03:43:55.666347+0000","last_fullsized":"2024-09-17T03:43:55.666347+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:26.258699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647562+0000","last_change":"2024-09-17T03:43:54.668026+0000","last_active":"2024-09-17T03:43:55.647562+0000","last_peered":"2024-09-17T03:43:55.647562+0000","last_clean":"2024-09-17T03:43:55.647562+0000","last_became_active":"2024-09-17T03:43:54.667733+0000","last_became_peered":"2024-09-17T03:43:54.667733+0000","last_unstale":"2024-09-17T03:43:55.647562+0000","last_undegraded":"2024-09-17T03:43:55.647562+0000","last_fullsized":"2024-09-17T03:43:55.647562+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:29.670536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.666242+0000","last_change":"2024-09-17T03:43:53.649967+0000","last_active":"2024-09-17T03:43:55.666242+0000","last_peered":"2024-09-17T03:43:55.666242+0000","last_clean":"2024-09-17T03:43:55.666242+0000","last_became_active":"2024-09-17T03:43:53.649642+0000","last_became_peered":"2024-09-17T03:43:53.649642+0000","last_unstale":"2024-09-17T03:43:55.666242+0000","last_undegraded":"2024-09-17T03:43:55.666242+0000","last_fullsized":"2024-09-17T03:43:55.666242+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:59.929273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647921+0000","last_change":"2024-09-17T03:43:54.666057+0000","last_active":"2024-09-17T03:43:55.647921+0000","last_peered":"2024-09-17T03:43:55.647921+0000","last_clean":"2024-09-17T03:43:55.647921+0000","last_became_active":"2024-09-17T03:43:54.665692+0000","last_became_peered":"2024-09-17T03:43:54.665692+0000","last_unstale":"2024-09-17T03:43:55.647921+0000","last_undegraded":"2024-09-17T03:43:55.647921+0000","last_fullsized":"2024-09-17T03:43:55.647921+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:35.834253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.647451+0000","last_change":"2024-09-17T03:43:53.648302+0000","last_active":"2024-09-17T03:43:55.647451+0000","last_peered":"2024-09-17T03:43:55.647451+0000","last_clean":"2024-09-17T03:43:55.647451+0000","last_became_active":"2024-09-17T03:43:53.647956+0000","last_became_peered":"2024-09-17T03:43:53.647956+0000","last_unstale":"2024-09-17T03:43:55.647451+0000","last_undegraded":"2024-09-17T03:43:55.647451+0000","last_fullsized":"2024-09-17T03:43:55.647451+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:06.888162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953613+0000","last_change":"2024-09-17T03:43:54.667145+0000","last_active":"2024-09-17T03:43:55.953613+0000","last_peered":"2024-09-17T03:43:55.953613+0000","last_clean":"2024-09-17T03:43:55.953613+0000","last_became_active":"2024-09-17T03:43:54.666817+0000","last_became_peered":"2024-09-17T03:43:54.666817+0000","last_unstale":"2024-09-17T03:43:55.953613+0000","last_undegraded":"2024-09-17T03:43:55.953613+0000","last_fullsized":"2024-09-17T03:43:55.953613+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:05.008860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983991+0000","last_change":"2024-09-17T03:43:53.646019+0000","last_active":"2024-09-17T03:43:55.983991+0000","last_peered":"2024-09-17T03:43:55.983991+0000","last_clean":"2024-09-17T03:43:55.983991+0000","last_became_active":"2024-09-17T03:43:53.645555+0000","last_became_peered":"2024-09-17T03:43:53.645555+0000","last_unstale":"2024-09-17T03:43:55.983991+0000","last_undegraded":"2024-09-17T03:43:55.983991+0000","last_fullsized":"2024-09-17T03:43:55.983991+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:12.150493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953642+0000","last_change":"2024-09-17T03:43:54.666953+0000","last_active":"2024-09-17T03:43:55.953642+0000","last_peered":"2024-09-17T03:43:55.953642+0000","last_clean":"2024-09-17T03:43:55.953642+0000","last_became_active":"2024-09-17T03:43:54.666590+0000","last_became_peered":"2024-09-17T03:43:54.666590+0000","last_unstale":"2024-09-17T03:43:55.953642+0000","last_undegraded":"2024-09-17T03:43:55.953642+0000","last_fullsized":"2024-09-17T03:43:55.953642+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:04.799939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983792+0000","last_change":"2024-09-17T03:43:53.648330+0000","last_active":"2024-09-17T03:43:55.983792+0000","last_peered":"2024-09-17T03:43:55.983792+0000","last_clean":"2024-09-17T03:43:55.983792+0000","last_became_active":"2024-09-17T03:43:53.648045+0000","last_became_peered":"2024-09-17T03:43:53.648045+0000","last_unstale":"2024-09-17T03:43:55.983792+0000","last_undegraded":"2024-09-17T03:43:55.983792+0000","last_fullsized":"2024-09-17T03:43:55.983792+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:26.973084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.654323+0000","last_change":"2024-09-17T03:43:54.661278+0000","last_active":"2024-09-17T03:43:55.654323+0000","last_peered":"2024-09-17T03:43:55.654323+0000","last_clean":"2024-09-17T03:43:55.654323+0000","last_became_active":"2024-09-17T03:43:54.660981+0000","last_became_peered":"2024-09-17T03:43:54.660981+0000","last_unstale":"2024-09-17T03:43:55.654323+0000","last_undegraded":"2024-09-17T03:43:55.654323+0000","last_fullsized":"2024-09-17T03:43:55.654323+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:27.067530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.653106+0000","last_change":"2024-09-17T03:43:53.648567+0000","last_active":"2024-09-17T03:43:55.653106+0000","last_peered":"2024-09-17T03:43:55.653106+0000","last_clean":"2024-09-17T03:43:55.653106+0000","last_became_active":"2024-09-17T03:43:53.648198+0000","last_became_peered":"2024-09-17T03:43:53.648198+0000","last_unstale":"2024-09-17T03:43:55.653106+0000","last_undegraded":"2024-09-17T03:43:55.653106+0000","last_fullsized":"2024-09-17T03:43:55.653106+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:46.546050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.983272+0000","last_change":"2024-09-17T03:43:54.668432+0000","last_active":"2024-09-17T03:43:55.983272+0000","last_peered":"2024-09-17T03:43:55.983272+0000","last_clean":"2024-09-17T03:43:55.983272+0000","last_became_active":"2024-09-17T03:43:54.668119+0000","last_became_peered":"2024-09-17T03:43:54.668119+0000","last_unstale":"2024-09-17T03:43:55.983272+0000","last_undegraded":"2024-09-17T03:43:55.983272+0000","last_fullsized":"2024-09-17T03:43:55.983272+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:40.679646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.667919+0000","last_change":"2024-09-17T03:43:53.636144+0000","last_active":"2024-09-17T03:43:55.667919+0000","last_peered":"2024-09-17T03:43:55.667919+0000","last_clean":"2024-09-17T03:43:55.667919+0000","last_became_active":"2024-09-17T03:43:53.635853+0000","last_became_peered":"2024-09-17T03:43:53.635853+0000","last_unstale":"2024-09-17T03:43:55.667919+0000","last_undegraded":"2024-09-17T03:43:55.667919+0000","last_fullsized":"2024-09-17T03:43:55.667919+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:54.139465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.665758+0000","last_change":"2024-09-17T03:43:54.662636+0000","last_active":"2024-09-17T03:43:55.665758+0000","last_peered":"2024-09-17T03:43:55.665758+0000","last_clean":"2024-09-17T03:43:55.665758+0000","last_became_active":"2024-09-17T03:43:54.662343+0000","last_became_peered":"2024-09-17T03:43:54.662343+0000","last_unstale":"2024-09-17T03:43:55.665758+0000","last_undegraded":"2024-09-17T03:43:55.665758+0000","last_fullsized":"2024-09-17T03:43:55.665758+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:53.624874+0000","last_clean_scrub_stamp":"2024-09-17T03:43:53.624874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:02.385182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":15,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.953498+0000","last_change":"2024-09-17T03:43:53.650336+0000","last_active":"2024-09-17T03:43:55.953498+0000","last_peered":"2024-09-17T03:43:55.953498+0000","last_clean":"2024-09-17T03:43:55.953498+0000","last_became_active":"2024-09-17T03:43:53.649990+0000","last_became_peered":"2024-09-17T03:43:53.649990+0000","last_unstale":"2024-09-17T03:43:55.953498+0000","last_undegraded":"2024-09-17T03:43:55.953498+0000","last_fullsized":"2024-09-17T03:43:55.953498+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:43:52.619319+0000","last_clean_scrub_stamp":"2024-09-17T03:43:52.619319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:28.317830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":375,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:43:55.954013+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:43:55.954013+0000","last_peered":"2024-09-17T03:43:55.954013+0000","last_clean":"2024-09-17T03:43:55.954013+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:43:55.954013+0000","last_undegraded":"2024-09-17T03:43:55.954013+0000","last_fullsized":"2024-09-17T03:43:55.954013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509578,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60168,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311672,"statfs":{"total":96636764160,"available":96575152128,"internally_reserved":0,"allocated":2670592,"data_stored":1500932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509578,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":2068480,"data_stored":910460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509578,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63752,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308088,"statfs":{"total":96636764160,"available":96571482112,"internally_reserved":0,"allocated":2084864,"data_stored":912654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509578,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55432,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316408,"statfs":{"total":96636764160,"available":96580001792,"internally_reserved":0,"allocated":2080768,"data_stored":911154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509579,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55428,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316412,"statfs":{"total":96636764160,"available":96580005888,"internally_reserved":0,"allocated":2080768,"data_stored":912072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509579,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51844,"kb_used_data":2604,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319996,"statfs":{"total":96636764160,"available":96583675904,"internally_reserved":0,"allocated":2666496,"data_stored":1500850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55416,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316424,"statfs":{"total":96636764160,"available":96580018176,"internally_reserved":0,"allocated":2068480,"data_stored":910460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55436,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316404,"statfs":{"total":96636764160,"available":96579997696,"internally_reserved":0,"allocated":2080768,"data_stored":910654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:44:03.459 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:44:03.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:44:03.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.615+0000 7efefa598640 1 -- 172.21.15.146:0/1958591749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efef40b6590 msgr2=0x7efef40b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:03.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.615+0000 7efefa598640 1 --2- 172.21.15.146:0/1958591749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efef40b6590 0x7efef40b69a0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7efef4073640 tx=0x7efedc02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.615+0000 7efefa598640 1 -- 172.21.15.146:0/1958591749 shutdown_connections 2024-09-17T03:44:03.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.615+0000 7efefa598640 1 --2- 172.21.15.146:0/1958591749 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efef40b57a0 0x7efef40b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.615+0000 7efefa598640 1 --2- 172.21.15.146:0/1958591749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efef40b6590 0x7efef40b69a0 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.615+0000 7efefa598640 1 --2- 172.21.15.146:0/1958591749 >> v2:172.21.15.179:3300/0 conn(0x7efef415c8e0 0x7efef40b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.615+0000 7efefa598640 1 -- 172.21.15.146:0/1958591749 >> 172.21.15.146:0/1958591749 conn(0x7efef409ba20 msgr2=0x7efef40b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:03.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.615+0000 7efefa598640 1 -- 172.21.15.146:0/1958591749 shutdown_connections 2024-09-17T03:44:03.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.615+0000 7efefa598640 1 -- 172.21.15.146:0/1958591749 wait complete. 2024-09-17T03:44:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.617+0000 7efefa598640 1 Processor -- start 2024-09-17T03:44:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.617+0000 7efefa598640 1 -- start start 2024-09-17T03:44:03.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.618+0000 7efefa598640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efef40b57a0 0x7efef41f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.618+0000 7efefa598640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efef40b6590 0x7efef4140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.618+0000 7efefa598640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efef415c8e0 0x7efef4143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.618+0000 7efefa598640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efef40b1ff0 con 0x7efef415c8e0 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.618+0000 7efefa598640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efef40b1e70 con 0x7efef40b6590 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.618+0000 7efefa598640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efef40b2170 con 0x7efef40b57a0 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef8b35640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efef415c8e0 0x7efef4143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef8b35640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efef415c8e0 0x7efef4143390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43968/0 (socket says 172.21.15.146:43968) 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef8b35640 1 -- 172.21.15.146:0/1577749880 learned_addr learned my addr 172.21.15.146:0/1577749880 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef37fe640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efef40b6590 0x7efef4140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef3fff640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efef40b57a0 0x7efef41f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef8b35640 1 -- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efef40b57a0 msgr2=0x7efef41f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef8b35640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efef40b57a0 0x7efef41f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef8b35640 1 -- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efef40b6590 msgr2=0x7efef4140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:03.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef8b35640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efef40b6590 0x7efef4140b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef8b35640 1 -- 172.21.15.146:0/1577749880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef4150aa0 con 0x7efef415c8e0 2024-09-17T03:44:03.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef8b35640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efef415c8e0 0x7efef4143390 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7efeec00b9a0 tx=0x7efeec00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:03.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef0ff9640 1 -- 172.21.15.146:0/1577749880 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec019070 con 0x7efef415c8e0 2024-09-17T03:44:03.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef0ff9640 1 -- 172.21.15.146:0/1577749880 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efeec00ccb0 con 0x7efef415c8e0 2024-09-17T03:44:03.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efefa598640 1 -- 172.21.15.146:0/1577749880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef4150d60 con 0x7efef415c8e0 2024-09-17T03:44:03.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efef0ff9640 1 -- 172.21.15.146:0/1577749880 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec0146a0 con 0x7efef415c8e0 2024-09-17T03:44:03.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.619+0000 7efefa598640 1 -- 172.21.15.146:0/1577749880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef41569e0 con 0x7efef415c8e0 2024-09-17T03:44:03.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.620+0000 7efefa598640 1 -- 172.21.15.146:0/1577749880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef40b26f0 con 0x7efef415c8e0 2024-09-17T03:44:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.621+0000 7efef0ff9640 1 -- 172.21.15.146:0/1577749880 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efeec01c070 con 0x7efef415c8e0 2024-09-17T03:44:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.622+0000 7efef0ff9640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efed4078b90 0x7efed407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.622+0000 7efef0ff9640 1 -- 172.21.15.146:0/1577749880 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7efeec09aa30 con 0x7efef415c8e0 2024-09-17T03:44:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.622+0000 7efef3fff640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efed4078b90 0x7efed407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.623+0000 7efef3fff640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efed4078b90 0x7efed407b0a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7efee40098e0 tx=0x7efee4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:03.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.626+0000 7efef0ff9640 1 -- 172.21.15.146:0/1577749880 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efeec062830 con 0x7efef415c8e0 2024-09-17T03:44:03.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.868+0000 7efefa598640 1 -- 172.21.15.146:0/1577749880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7efef41f4920 con 0x7efef415c8e0 2024-09-17T03:44:03.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.870+0000 7efef0ff9640 1 -- 172.21.15.146:0/1577749880 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) ==== 190+0+147 (secure 0 0 0) 0x7efeec067260 con 0x7efef415c8e0 2024-09-17T03:44:03.871 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:44:03.871 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:44:03.871 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:44:03.871 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:44:03.871 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:44:03.871 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:44:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 -- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efed4078b90 msgr2=0x7efed407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efed4078b90 0x7efed407b0a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7efee40098e0 tx=0x7efee4009060 comp rx=0 tx=0).stop 2024-09-17T03:44:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 -- 172.21.15.146:0/1577749880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efef415c8e0 msgr2=0x7efef4143390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efef415c8e0 0x7efef4143390 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7efeec00b9a0 tx=0x7efeec00be60 comp rx=0 tx=0).stop 2024-09-17T03:44:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 -- 172.21.15.146:0/1577749880 shutdown_connections 2024-09-17T03:44:03.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efed4078b90 0x7efed407b0a0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efef415c8e0 0x7efef4143390 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efef40b6590 0x7efef4140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 --2- 172.21.15.146:0/1577749880 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efef40b57a0 0x7efef41f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:03.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 -- 172.21.15.146:0/1577749880 >> 172.21.15.146:0/1577749880 conn(0x7efef409ba20 msgr2=0x7efef4070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:03.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 -- 172.21.15.146:0/1577749880 shutdown_connections 2024-09-17T03:44:03.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.873+0000 7efefa598640 1 -- 172.21.15.146:0/1577749880 wait complete. 2024-09-17T03:44:03.885 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:44:03.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.998+0000 7f3efa612640 1 -- 172.21.15.146:0/2346620116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3edc004d40 msgr2=0x7f3edc0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:03.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.998+0000 7f3efa612640 1 --2- 172.21.15.146:0/2346620116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3edc004d40 0x7f3edc0051f0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f3eec001d90 tx=0x7f3edc005830 comp rx=0 tx=0).stop 2024-09-17T03:44:03.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.998+0000 7f3ef8baf640 1 -- 172.21.15.146:0/2346620116 reap_dead start 2024-09-17T03:44:03.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.998+0000 7f3efa612640 1 -- 172.21.15.146:0/2346620116 shutdown_connections 2024-09-17T03:44:03.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.998+0000 7f3efa612640 1 -- 172.21.15.146:0/2346620116 >> 172.21.15.146:0/2346620116 conn(0x7f3ef40b3410 msgr2=0x7f3ef40b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:03.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.998+0000 7f3efa612640 1 -- 172.21.15.146:0/2346620116 shutdown_connections 2024-09-17T03:44:03.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:03.998+0000 7f3efa612640 1 -- 172.21.15.146:0/2346620116 wait complete. 2024-09-17T03:44:04.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.000+0000 7f3efa612640 1 Processor -- start 2024-09-17T03:44:04.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.000+0000 7f3efa612640 1 -- start start 2024-09-17T03:44:04.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.001+0000 7f3efa612640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3edc004d40 0x7f3ef4156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.001+0000 7f3efa612640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ef40cfde0 0x7f3ef40d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.001+0000 7f3efa612640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef41f2a10 0x7f3ef41f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.001+0000 7f3efa612640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef4070f70 con 0x7f3ef40cfde0 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.001+0000 7f3efa612640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef4070df0 con 0x7f3edc004d40 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.001+0000 7f3efa612640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef415bd10 con 0x7f3ef41f2a10 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.001+0000 7f3ef37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ef40cfde0 0x7f3ef40d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.001+0000 7f3ef37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ef40cfde0 0x7f3ef40d01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43988/0 (socket says 172.21.15.146:43988) 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.001+0000 7f3ef37fe640 1 -- 172.21.15.146:0/2665138309 learned_addr learned my addr 172.21.15.146:0/2665138309 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef8baf640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef41f2a10 0x7f3ef41f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef3fff640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3edc004d40 0x7f3ef4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef37fe640 1 -- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef41f2a10 msgr2=0x7f3ef41f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef37fe640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef41f2a10 0x7f3ef41f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef37fe640 1 -- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3edc004d40 msgr2=0x7f3ef4156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef37fe640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3edc004d40 0x7f3ef4156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef37fe640 1 -- 172.21.15.146:0/2665138309 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef40d0730 con 0x7f3ef40cfde0 2024-09-17T03:44:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef8baf640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef41f2a10 0x7f3ef41f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef3fff640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3edc004d40 0x7f3ef4156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef37fe640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ef40cfde0 0x7f3ef40d01f0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8001b60 tx=0x7f3ee80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef0ff9640 1 -- 172.21.15.146:0/2665138309 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8015070 con 0x7f3ef40cfde0 2024-09-17T03:44:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef0ff9640 1 -- 172.21.15.146:0/2665138309 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ee8011900 con 0x7f3ef40cfde0 2024-09-17T03:44:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3efa612640 1 -- 172.21.15.146:0/2665138309 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef41e5fd0 con 0x7f3ef40cfde0 2024-09-17T03:44:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3ef0ff9640 1 -- 172.21.15.146:0/2665138309 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8011d50 con 0x7f3ef40cfde0 2024-09-17T03:44:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.002+0000 7f3efa612640 1 -- 172.21.15.146:0/2665138309 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef41e5210 con 0x7f3ef40cfde0 2024-09-17T03:44:04.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.003+0000 7f3efa612640 1 -- 172.21.15.146:0/2665138309 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef4156d10 con 0x7f3ef40cfde0 2024-09-17T03:44:04.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.004+0000 7f3ef0ff9640 1 -- 172.21.15.146:0/2665138309 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ee8018070 con 0x7f3ef40cfde0 2024-09-17T03:44:04.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.005+0000 7f3ef0ff9640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ee0078b90 0x7f3ee007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.005+0000 7f3ef0ff9640 1 -- 172.21.15.146:0/2665138309 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f3ee809bae0 con 0x7f3ef40cfde0 2024-09-17T03:44:04.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.005+0000 7f3ef3fff640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ee0078b90 0x7f3ee007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.005+0000 7f3ef3fff640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ee0078b90 0x7f3ee007b0a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009b40 tx=0x7f3ee4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:04.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.009+0000 7f3ef0ff9640 1 -- 172.21.15.146:0/2665138309 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ef40d0730 con 0x7f3ef40cfde0 2024-09-17T03:44:04.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.216+0000 7f3efa612640 1 -- 172.21.15.146:0/2665138309 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ef40b4530 con 0x7f3ef40cfde0 2024-09-17T03:44:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.217+0000 7f3ef0ff9640 1 -- 172.21.15.146:0/2665138309 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5245 (secure 0 0 0) 0x7f3ee8063fc0 con 0x7f3ef40cfde0 2024-09-17T03:44:04.217 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:04.217 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":125,"btime":"2024-09-17T03:43:57:668195+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2920792926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2920792926},{"type":"v1","addr":"172.21.15.179:6837","nonce":2920792926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8917,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/154430395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":154430395},{"type":"v1","addr":"172.21.15.179:6836","nonce":154430395}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":10242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/465040613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":465040613},{"type":"v1","addr":"172.21.15.146:6833","nonce":465040613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:43:54.003090+0000","modified":"2024-09-17T03:43:57.009133+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10251":{"gid":10251,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3868966088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868966088},{"type":"v1","addr":"172.21.15.146:6835","nonce":3868966088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10251,"qdb_cluster":[10251]},"id":12}]} 2024-09-17T03:44:04.217 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 125 2024-09-17T03:44:04.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 -- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ee0078b90 msgr2=0x7f3ee007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ee0078b90 0x7f3ee007b0a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009b40 tx=0x7f3ee4005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:04.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 -- 172.21.15.146:0/2665138309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ef40cfde0 msgr2=0x7f3ef40d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ef40cfde0 0x7f3ef40d01f0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8001b60 tx=0x7f3ee80039c0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 -- 172.21.15.146:0/2665138309 shutdown_connections 2024-09-17T03:44:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ee0078b90 0x7f3ee007b0a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ef41f2a10 0x7f3ef41f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ef40cfde0 0x7f3ef40d01f0 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 --2- 172.21.15.146:0/2665138309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3edc004d40 0x7f3ef4156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 -- 172.21.15.146:0/2665138309 >> 172.21.15.146:0/2665138309 conn(0x7f3ef40b3410 msgr2=0x7f3ef40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 -- 172.21.15.146:0/2665138309 shutdown_connections 2024-09-17T03:44:04.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.219+0000 7f3efa612640 1 -- 172.21.15.146:0/2665138309 wait complete. 2024-09-17T03:44:04.634 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 125, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:43:54.003090+0000', 'modified': '2024-09-17T03:43:57.009133+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10251': {'gid': 10251, 'name': 'a', 'rank': 0, 'incarnation': 122, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/3868966088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 3868966088}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3868966088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10251, 'qdb_cluster': [10251]} 2024-09-17T03:44:04.634 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:44:04.635 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:44:04.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.750+0000 7fe1ca382640 1 -- 172.21.15.146:0/3444992116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac004000 msgr2=0x7fe1ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.750+0000 7fe1ca382640 1 --2- 172.21.15.146:0/3444992116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac004000 0x7fe1ac004800 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c290 tx=0x7fe1ac005830 comp rx=0 tx=0).stop 2024-09-17T03:44:04.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.750+0000 7fe1c891f640 1 -- 172.21.15.146:0/3444992116 reap_dead start 2024-09-17T03:44:04.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.750+0000 7fe1ca382640 1 -- 172.21.15.146:0/3444992116 shutdown_connections 2024-09-17T03:44:04.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.750+0000 7fe1ca382640 1 -- 172.21.15.146:0/3444992116 >> 172.21.15.146:0/3444992116 conn(0x7fe1c40b7b20 msgr2=0x7fe1c409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:04.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.750+0000 7fe1ca382640 1 -- 172.21.15.146:0/3444992116 shutdown_connections 2024-09-17T03:44:04.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.750+0000 7fe1ca382640 1 -- 172.21.15.146:0/3444992116 wait complete. 2024-09-17T03:44:04.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.752+0000 7fe1ca382640 1 Processor -- start 2024-09-17T03:44:04.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.752+0000 7fe1ca382640 1 -- start start 2024-09-17T03:44:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1ca382640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1ac004000 0x7fe1c41f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1ca382640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c409d100 0x7fe1c41f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1ca382640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1c41f7230 0x7fe1c415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1ca382640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c40b1920 con 0x7fe1c409d100 2024-09-17T03:44:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1ca382640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c40b17a0 con 0x7fe1ac004000 2024-09-17T03:44:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1ca382640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c415d1b0 con 0x7fe1c41f7230 2024-09-17T03:44:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c409d100 0x7fe1c41f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c409d100 0x7fe1c41f6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44004/0 (socket says 172.21.15.146:44004) 2024-09-17T03:44:04.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c37fe640 1 -- 172.21.15.146:0/1031419280 learned_addr learned my addr 172.21.15.146:0/1031419280 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c891f640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1c41f7230 0x7fe1c415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c3fff640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1ac004000 0x7fe1c41f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c37fe640 1 -- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1c41f7230 msgr2=0x7fe1c415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1c41f7230 0x7fe1c415e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c37fe640 1 -- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1ac004000 msgr2=0x7fe1c41f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1ac004000 0x7fe1c41f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c37fe640 1 -- 172.21.15.146:0/1031419280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c409f680 con 0x7fe1c409d100 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c409d100 0x7fe1c41f6cf0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fe1b802b110 tx=0x7fe1b8004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.754+0000 7fe1c0ff9640 1 -- 172.21.15.146:0/1031419280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8031040 con 0x7fe1c409d100 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.755+0000 7fe1c0ff9640 1 -- 172.21.15.146:0/1031419280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1b8006440 con 0x7fe1c409d100 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.755+0000 7fe1c0ff9640 1 -- 172.21.15.146:0/1031419280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8006c30 con 0x7fe1c409d100 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.755+0000 7fe1ca382640 1 -- 172.21.15.146:0/1031419280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c409f960 con 0x7fe1c409d100 2024-09-17T03:44:04.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.755+0000 7fe1ca382640 1 -- 172.21.15.146:0/1031419280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c409ff20 con 0x7fe1c409d100 2024-09-17T03:44:04.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.756+0000 7fe1c0ff9640 1 -- 172.21.15.146:0/1031419280 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1b8034070 con 0x7fe1c409d100 2024-09-17T03:44:04.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.757+0000 7fe1c0ff9640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1b0078b90 0x7fe1b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.757+0000 7fe1c0ff9640 1 -- 172.21.15.146:0/1031419280 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fe1b80bad40 con 0x7fe1c409d100 2024-09-17T03:44:04.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.757+0000 7fe1c3fff640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1b0078b90 0x7fe1b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.758+0000 7fe1d13cc740 1 Processor -- start 2024-09-17T03:44:04.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.758+0000 7fe1c3fff640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1b0078b90 0x7fe1b007b0a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009b90 tx=0x7fe1b4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:04.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.758+0000 7fe1d13cc740 1 -- start start 2024-09-17T03:44:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e8a8270 0x56507ec79fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec7a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e887590 0x56507ec973e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56507ebc2820 con 0x56507e87f3b0 2024-09-17T03:44:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56507ebb1c50 con 0x56507e887590 2024-09-17T03:44:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56507ebb5a60 con 0x56507e8a8270 2024-09-17T03:44:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1c37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec7a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1c37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec7a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44012/0 (socket says 172.21.15.146:44012) 2024-09-17T03:44:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1c37fe640 1 -- 172.21.15.146:0/2383577453 learned_addr learned my addr 172.21.15.146:0/2383577453 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:04.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1c3fff640 1 --2- 172.21.15.146:0/2383577453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e8a8270 0x56507ec79fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1c891f640 1 --2- 172.21.15.146:0/2383577453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e887590 0x56507ec973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1c37fe640 1 -- 172.21.15.146:0/2383577453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e8a8270 msgr2=0x56507ec79fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/2383577453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e8a8270 0x56507ec79fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1c37fe640 1 -- 172.21.15.146:0/2383577453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e887590 msgr2=0x56507ec973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/2383577453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e887590 0x56507ec973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1c37fe640 1 -- 172.21.15.146:0/2383577453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56507e913850 con 0x56507e87f3b0 2024-09-17T03:44:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.759+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/2383577453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec7a4e0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80b9320 tx=0x7fe1b8082440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7af387c42cd582 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1a9ffb640 1 -- 172.21.15.146:0/2383577453 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8045040 con 0x56507e87f3b0 2024-09-17T03:44:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1a9ffb640 1 -- 172.21.15.146:0/2383577453 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1b8087030 con 0x56507e87f3b0 2024-09-17T03:44:04.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1a9ffb640 1 -- 172.21.15.146:0/2383577453 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80a5030 con 0x56507e87f3b0 2024-09-17T03:44:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2383577453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 msgr2=0x56507ec7a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2383577453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec7a4e0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80b9320 tx=0x7fe1b8082440 comp rx=0 tx=0).stop 2024-09-17T03:44:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2383577453 shutdown_connections 2024-09-17T03:44:04.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2383577453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e887590 0x56507ec973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2383577453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec7a4e0 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2383577453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e8a8270 0x56507ec79fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2383577453 >> 172.21.15.146:0/2383577453 conn(0x56507e89c3c0 msgr2=0x56507ec50260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2383577453 shutdown_connections 2024-09-17T03:44:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.760+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2383577453 wait complete. 2024-09-17T03:44:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.761+0000 7fe1d13cc740 1 -- start start 2024-09-17T03:44:04.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.762+0000 7fe1d13cc740 1 Processor -- start 2024-09-17T03:44:04.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec756d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e887590 0x56507eca75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e8a8270 0x56507ec8d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56507e922620 con 0x56507e87f3b0 2024-09-17T03:44:04.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56507eb575f0 con 0x56507e8a8270 2024-09-17T03:44:04.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56507ebb1c50 con 0x56507e887590 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1d13cc740 10 client.0 _ll_register_callbacks cb 0x56507eb5b0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1c3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1c3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec756d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44026/0 (socket says 172.21.15.146:44026) 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1c3fff640 1 -- 172.21.15.146:0/2279864024 learned_addr learned my addr 172.21.15.146:0/2279864024 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e887590 0x56507eca75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1c891f640 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e8a8270 0x56507ec8d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1c3fff640 1 -- 172.21.15.146:0/2279864024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e887590 msgr2=0x56507eca75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1c3fff640 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e887590 0x56507eca75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1c3fff640 1 -- 172.21.15.146:0/2279864024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e8a8270 msgr2=0x56507ec8d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1c3fff640 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e8a8270 0x56507ec8d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.763+0000 7fe1c3fff640 1 -- 172.21.15.146:0/2279864024 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56507e98a6b0 con 0x56507e87f3b0 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1c3fff640 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec756d0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40045e0 tx=0x7fe1b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f800bf3e12214f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2279864024 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b401e670 con 0x56507e87f3b0 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2279864024 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fe1b4018070 con 0x56507e87f3b0 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2279864024 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1b8087030 con 0x56507e87f3b0 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2279864024 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7fe1b401e810 con 0x56507e87f3b0 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1d13cc740 10 client.10407 fetch_fsmap learned FSMap version 125 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2279864024 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x56507ec735e0 con 0x56507e87f3b0 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2279864024 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1b8087030 con 0x56507e87f3b0 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2279864024 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7fe1b4032050 con 0x56507e87f3b0 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1d13cc740 10 client.10407 fetch_fsmap finished waiting for FSMap version 125 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1d13cc740 10 client.10407 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1d13cc740 20 client.10407 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56507e866e40 0x56507ec73de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1d13cc740 4 client.10407 mds_command: new command op to 10251 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:44:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2279864024 --> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56507ebc4770 con 0x56507e866e40 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.764+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56507e866e40 0x56507ec73de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.765+0000 7fe1a2ffd640 10 client.10407 ms_handle_connect on v2:172.21.15.146:6834/3868966088 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.765+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56507e866e40 0x56507ec73de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2b6593df8634a6d server_cookie=94d83df5ae392f55 in_seq=0 out_seq=0 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.765+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2279864024 <== mds.0 v2:172.21.15.146:6834/3868966088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56507ebc4770 con 0x56507e866e40 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.765+0000 7fe1a2ffd640 10 client.10407 handle_command_reply: tid=0 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.765+0000 7fe1d13cc740 1 client.10407 shutdown 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2279864024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 msgr2=0x56507ec756d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec756d0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40045e0 tx=0x7fe1b40046c0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2279864024 shutdown_connections 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56507e866e40 0x56507ec73de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e8a8270 0x56507ec8d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1a2ffd640 0 client.10407 ms_handle_reset on v2:172.21.15.146:6834/3868966088 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e887590 0x56507eca75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2279864024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ec756d0 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2279864024 >> 172.21.15.146:0/2279864024 conn(0x56507e89c3c0 msgr2=0x56507ec492a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:04.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2279864024 shutdown_connections 2024-09-17T03:44:04.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2279864024 wait complete. 2024-09-17T03:44:04.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.766+0000 7fe1d13cc740 20 client.10407 trim_cache size 0 max 16384 2024-09-17T03:44:04.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.784+0000 7fe1d13cc740 1 Processor -- start 2024-09-17T03:44:04.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.784+0000 7fe1d13cc740 1 -- start start 2024-09-17T03:44:04.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.785+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e87f3b0 0x56507ec75430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.785+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e887590 0x56507ed0e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.785+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e8a8270 0x56507ed0ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.785+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41ff490 con 0x56507e8a8270 2024-09-17T03:44:04.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.785+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41f3f30 con 0x56507e887590 2024-09-17T03:44:04.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.785+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c41fee70 con 0x56507e87f3b0 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.785+0000 7fe1c891f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e8a8270 0x56507ed0ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.785+0000 7fe1c891f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e8a8270 0x56507ed0ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44034/0 (socket says 172.21.15.146:44034) 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.785+0000 7fe1c891f640 1 -- 172.21.15.146:0/270900147 learned_addr learned my addr 172.21.15.146:0/270900147 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.786+0000 7fe1c891f640 1 -- 172.21.15.146:0/270900147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e87f3b0 msgr2=0x56507ec75430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.786+0000 7fe1c891f640 1 --2- 172.21.15.146:0/270900147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e87f3b0 0x56507ec75430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.786+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/270900147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e887590 0x56507ed0e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.786+0000 7fe1c891f640 1 -- 172.21.15.146:0/270900147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e887590 msgr2=0x56507ed0e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.786+0000 7fe1c891f640 1 --2- 172.21.15.146:0/270900147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e887590 0x56507ed0e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.786+0000 7fe1c891f640 1 -- 172.21.15.146:0/270900147 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56507ec8f6c0 con 0x56507e8a8270 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.786+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/270900147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e887590 0x56507ed0e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.786+0000 7fe1c891f640 1 --2- 172.21.15.146:0/270900147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e8a8270 0x56507ed0ec20 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc003f70 tx=0x7fe1bc001db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e819661216bcad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.786+0000 7fe1a97fa640 1 -- 172.21.15.146:0/270900147 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc002000 con 0x56507e8a8270 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.786+0000 7fe1a97fa640 1 -- 172.21.15.146:0/270900147 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1bc0064e0 con 0x56507e8a8270 2024-09-17T03:44:04.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.786+0000 7fe1a97fa640 1 -- 172.21.15.146:0/270900147 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc012440 con 0x56507e8a8270 2024-09-17T03:44:04.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.787+0000 7fe1d13cc740 1 -- 172.21.15.146:0/270900147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e8a8270 msgr2=0x56507ed0ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.787+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/270900147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e8a8270 0x56507ed0ec20 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc003f70 tx=0x7fe1bc001db0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.787+0000 7fe1d13cc740 1 -- 172.21.15.146:0/270900147 shutdown_connections 2024-09-17T03:44:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.787+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/270900147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e8a8270 0x56507ed0ec20 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.787+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/270900147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e887590 0x56507ed0e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.787+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/270900147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e87f3b0 0x56507ec75430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.787+0000 7fe1d13cc740 1 -- 172.21.15.146:0/270900147 >> 172.21.15.146:0/270900147 conn(0x56507e89c3c0 msgr2=0x56507ec8e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.787+0000 7fe1d13cc740 1 -- 172.21.15.146:0/270900147 shutdown_connections 2024-09-17T03:44:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.787+0000 7fe1d13cc740 1 -- 172.21.15.146:0/270900147 wait complete. 2024-09-17T03:44:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.788+0000 7fe1d13cc740 1 -- start start 2024-09-17T03:44:04.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.788+0000 7fe1d13cc740 1 Processor -- start 2024-09-17T03:44:04.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ecaa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e887590 0x56507ed0b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1d13cc740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e8a8270 0x56507ecb7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56507ec68950 con 0x56507e87f3b0 2024-09-17T03:44:04.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56507ebc2820 con 0x56507e8a8270 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1d13cc740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56507ec724c0 con 0x56507e887590 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1d13cc740 10 client.0 _ll_register_callbacks cb 0x7fe1b4012bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1c3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ecaa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1c3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ecaa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44040/0 (socket says 172.21.15.146:44040) 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1c3fff640 1 -- 172.21.15.146:0/2364404283 learned_addr learned my addr 172.21.15.146:0/2364404283 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1c891f640 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e8a8270 0x56507ecb7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.789+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e887590 0x56507ed0b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1c3fff640 1 -- 172.21.15.146:0/2364404283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e887590 msgr2=0x56507ed0b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1c3fff640 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e887590 0x56507ed0b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1c3fff640 1 -- 172.21.15.146:0/2364404283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e8a8270 msgr2=0x56507ecb7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1c3fff640 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e8a8270 0x56507ecb7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1c3fff640 1 -- 172.21.15.146:0/2364404283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56507ed0d440 con 0x56507e87f3b0 2024-09-17T03:44:04.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e887590 0x56507ed0b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1c891f640 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e8a8270 0x56507ecb7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1c3fff640 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ecaa430 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40128e0 tx=0x7fe1b4034720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd628f0f6df40e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2364404283 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4039060 con 0x56507e87f3b0 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2364404283 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fe1b4026040 con 0x56507e87f3b0 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2364404283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1bc0064e0 con 0x56507e87f3b0 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2364404283 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7fe1b403f050 con 0x56507e87f3b0 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1d13cc740 10 client.10413 fetch_fsmap learned FSMap version 125 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2364404283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x56507ed0d870 con 0x56507e87f3b0 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2364404283 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1bc0064e0 con 0x56507e87f3b0 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2364404283 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7fe1b4042020 con 0x56507e87f3b0 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1d13cc740 10 client.10413 fetch_fsmap finished waiting for FSMap version 125 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1d13cc740 10 client.10413 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:44:04.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1d13cc740 20 client.10413 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56507ec495c0 0x56507eca29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1d13cc740 4 client.10413 mds_command: new command op to 10251 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2364404283 --> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] -- command(tid 0: {"prefix": "status"}) -- 0x56507ebc0220 con 0x56507ec495c0 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.790+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56507ec495c0 0x56507eca29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1a2ffd640 10 client.10413 ms_handle_connect on v2:172.21.15.146:6834/3868966088 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1c37fe640 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56507ec495c0 0x56507eca29e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95c135e7a8717092 server_cookie=42c26f1ecb120564 in_seq=0 out_seq=0 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1a2ffd640 1 -- 172.21.15.146:0/2364404283 <== mds.0 v2:172.21.15.146:6834/3868966088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x56507ebc0220 con 0x56507ec495c0 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1a2ffd640 10 client.10413 handle_command_reply: tid=0 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1d13cc740 1 client.10413 shutdown 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2364404283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 msgr2=0x56507ecaa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ecaa430 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40128e0 tx=0x7fe1b4034720 comp rx=0 tx=0).stop 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2364404283 shutdown_connections 2024-09-17T03:44:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56507ec495c0 0x56507eca29e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56507e8a8270 0x56507ecb7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1a2ffd640 0 client.10413 ms_handle_reset on v2:172.21.15.146:6834/3868966088 2024-09-17T03:44:04.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56507e887590 0x56507ed0b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1d13cc740 1 --2- 172.21.15.146:0/2364404283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56507e87f3b0 0x56507ecaa430 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.791+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2364404283 >> 172.21.15.146:0/2364404283 conn(0x56507e89c3c0 msgr2=0x56507ec51180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:04.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2364404283 shutdown_connections 2024-09-17T03:44:04.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1d13cc740 1 -- 172.21.15.146:0/2364404283 wait complete. 2024-09-17T03:44:04.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1d13cc740 20 client.10413 trim_cache size 0 max 16384 2024-09-17T03:44:04.797 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:44:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:44:04.797 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:44:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 10251, 2024-09-17T03:44:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:44:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:44:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:44:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.135856446, 2024-09-17T03:44:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 125, 2024-09-17T03:44:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 165, 2024-09-17T03:44:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 165, 2024-09-17T03:44:04.798 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 14.828220415000001 2024-09-17T03:44:04.798 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:44:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 -- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1b0078b90 msgr2=0x7fe1b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1b0078b90 0x7fe1b007b0a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009b90 tx=0x7fe1b4005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 -- 172.21.15.146:0/1031419280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c409d100 msgr2=0x7fe1c41f6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c409d100 0x7fe1c41f6cf0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fe1b802b110 tx=0x7fe1b8004df0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 -- 172.21.15.146:0/1031419280 shutdown_connections 2024-09-17T03:44:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1b0078b90 0x7fe1b007b0a0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1c41f7230 0x7fe1c415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1c409d100 0x7fe1c41f6cf0 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 --2- 172.21.15.146:0/1031419280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1ac004000 0x7fe1c41f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 -- 172.21.15.146:0/1031419280 >> 172.21.15.146:0/1031419280 conn(0x7fe1c40b7b20 msgr2=0x7fe1c415bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 -- 172.21.15.146:0/1031419280 shutdown_connections 2024-09-17T03:44:04.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.792+0000 7fe1ca382640 1 -- 172.21.15.146:0/1031419280 wait complete. 2024-09-17T03:44:04.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:44:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.917+0000 7f84d1557640 1 -- 172.21.15.146:0/778146996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84b8003c60 msgr2=0x7f84b80040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.917+0000 7f84d1557640 1 --2- 172.21.15.146:0/778146996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84b8003c60 0x7f84b80040b0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f84c4006e50 tx=0x7f84b8005830 comp rx=0 tx=0).stop 2024-09-17T03:44:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.917+0000 7f84cb7fe640 1 -- 172.21.15.146:0/778146996 reap_dead start 2024-09-17T03:44:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.917+0000 7f84d1557640 1 -- 172.21.15.146:0/778146996 shutdown_connections 2024-09-17T03:44:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.917+0000 7f84d1557640 1 -- 172.21.15.146:0/778146996 >> 172.21.15.146:0/778146996 conn(0x7f84cc0d11f0 msgr2=0x7f84cc0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.918+0000 7f84d1557640 1 -- 172.21.15.146:0/778146996 shutdown_connections 2024-09-17T03:44:04.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.918+0000 7f84d1557640 1 -- 172.21.15.146:0/778146996 wait complete. 2024-09-17T03:44:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.919+0000 7f84d1557640 1 Processor -- start 2024-09-17T03:44:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.919+0000 7f84d1557640 1 -- start start 2024-09-17T03:44:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84d1557640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84b8003c60 0x7f84cc153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84d1557640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84cc152b10 0x7f84cc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84d1557640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc1f93f0 0x7f84cc1f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84d1557640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc069220 con 0x7f84cc1f93f0 2024-09-17T03:44:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84d1557640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc0cf4b0 con 0x7f84cc152b10 2024-09-17T03:44:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84d1557640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f84cc0693a0 con 0x7f84b8003c60 2024-09-17T03:44:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84cb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc1f93f0 0x7f84cc1f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84cb7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc1f93f0 0x7f84cc1f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44070/0 (socket says 172.21.15.146:44070) 2024-09-17T03:44:04.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84cb7fe640 1 -- 172.21.15.146:0/2253145697 learned_addr learned my addr 172.21.15.146:0/2253145697 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84ca7fc640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84cc152b10 0x7f84cc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84caffd640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84b8003c60 0x7f84cc153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84cb7fe640 1 -- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84b8003c60 msgr2=0x7f84cc153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84cb7fe640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84b8003c60 0x7f84cc153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84cb7fe640 1 -- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84cc152b10 msgr2=0x7f84cc152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:04.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84cb7fe640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84cc152b10 0x7f84cc152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:04.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84cb7fe640 1 -- 172.21.15.146:0/2253145697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc156a60 con 0x7f84cc1f93f0 2024-09-17T03:44:04.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84cb7fe640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc1f93f0 0x7f84cc1f9800 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f84bc001330 tx=0x7f84bc006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:04.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84c37fe640 1 -- 172.21.15.146:0/2253145697 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00f960 con 0x7f84cc1f93f0 2024-09-17T03:44:04.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.921+0000 7f84c37fe640 1 -- 172.21.15.146:0/2253145697 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84bc018070 con 0x7f84cc1f93f0 2024-09-17T03:44:04.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.922+0000 7f84d1557640 1 -- 172.21.15.146:0/2253145697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84cc153460 con 0x7f84cc1f93f0 2024-09-17T03:44:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.922+0000 7f84c37fe640 1 -- 172.21.15.146:0/2253145697 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00fdc0 con 0x7f84cc1f93f0 2024-09-17T03:44:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.922+0000 7f84d1557640 1 -- 172.21.15.146:0/2253145697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84cc156780 con 0x7f84cc1f93f0 2024-09-17T03:44:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.923+0000 7f84d1557640 1 -- 172.21.15.146:0/2253145697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84cc069930 con 0x7f84cc1f93f0 2024-09-17T03:44:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.923+0000 7f84c37fe640 1 -- 172.21.15.146:0/2253145697 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84bc01d460 con 0x7f84cc1f93f0 2024-09-17T03:44:04.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.924+0000 7f84c37fe640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84ac078b90 0x7f84ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.924+0000 7f84c37fe640 1 -- 172.21.15.146:0/2253145697 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f84bc09b480 con 0x7f84cc1f93f0 2024-09-17T03:44:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.924+0000 7f84caffd640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84ac078b90 0x7f84ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.925+0000 7f84caffd640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84ac078b90 0x7f84ac07b0a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f84c4033000 tx=0x7f84c4001850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:04.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:04.929+0000 7f84c37fe640 1 -- 172.21.15.146:0/2253145697 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84cc153460 con 0x7f84cc1f93f0 2024-09-17T03:44:05.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.143+0000 7f84d1557640 1 -- 172.21.15.146:0/2253145697 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f84cc0c7ff0 con 0x7f84cc1f93f0 2024-09-17T03:44:05.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.144+0000 7f84c37fe640 1 -- 172.21.15.146:0/2253145697 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v125) ==== 53+0+73 (secure 0 0 0) 0x7f84bc0638c0 con 0x7f84cc1f93f0 2024-09-17T03:44:05.145 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:44:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 -- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84ac078b90 msgr2=0x7f84ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84ac078b90 0x7f84ac07b0a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f84c4033000 tx=0x7f84c4001850 comp rx=0 tx=0).stop 2024-09-17T03:44:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 -- 172.21.15.146:0/2253145697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc1f93f0 msgr2=0x7f84cc1f9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc1f93f0 0x7f84cc1f9800 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f84bc001330 tx=0x7f84bc006430 comp rx=0 tx=0).stop 2024-09-17T03:44:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 -- 172.21.15.146:0/2253145697 shutdown_connections 2024-09-17T03:44:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f84ac078b90 0x7f84ac07b0a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc1f93f0 0x7f84cc1f9800 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:05.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f84cc152b10 0x7f84cc152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 --2- 172.21.15.146:0/2253145697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f84b8003c60 0x7f84cc153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 -- 172.21.15.146:0/2253145697 >> 172.21.15.146:0/2253145697 conn(0x7f84cc0d11f0 msgr2=0x7f84cc0b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 -- 172.21.15.146:0/2253145697 shutdown_connections 2024-09-17T03:44:05.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05.146+0000 7f84d1557640 1 -- 172.21.15.146:0/2253145697 wait complete. 2024-09-17T03:44:05.158 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:44:05.158 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:44:05.158 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:44:05.158 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:44:05.158 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:44:05.158 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:44:05.158 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:44:05.158 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:44:05.158 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:44:05.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:05.159 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:44:05.174 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:44:05.175 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42127sec preferred_lft 42127sec 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:44:05.176 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:05.177 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:44:05.177 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:44:05.177 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:44:05.177 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:05.177 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:44:05.177 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:44:05.177 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:44:05.177 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:05.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:05.178 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:44:05.240 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:44:05.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:05.241 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:44:05.297 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:44:05.297 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:44:05.297 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:44:05.297 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:44:05.297 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:44:05.298 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:44:05.298 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:05.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:44:05.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:44:05.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:44:05.298 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:05.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:44:05.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:05.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:05.422 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:44:05.437 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:44:05.438 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:44:05.438 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:44:05.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:05.438 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:44:05.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:44:05.503 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:44:05.558 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:44:05.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:44:05.559 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:44:05.614 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:44:05.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:05.614 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:44:05.709 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:44:05.709 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:44:05.709 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:44:05.720 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:44:05.720 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:44:05.720 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:44:05.720 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:44:05.720 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:44:05.726 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:44:05.727 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:44:05.727 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:44:05.727 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:44:05.727 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:44:05.727 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:44:05.727 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:44:05.727 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:44:05.727 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:44:05.727 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:44:05.728 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:44:05.728 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:44:05.728 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:44:05.729 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:44:05.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:05.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:44:05.756 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:44:05.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:05.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:05.855 INFO:teuthology.orchestra.run.smithi146.stdout:client8129 2024-09-17T03:44:05.856 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:44:05.856 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:44:05.871 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:05.872 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:05.872 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.0 2024-09-17T03:44:05.872 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:05.872 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:05.872 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:05.872 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:05.978 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:05.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:05.979 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809739 s, 129 MB/s 2024-09-17T03:44:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:05.987 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665503 s, 158 MB/s 2024-09-17T03:44:05.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:05.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:05.998 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877227 s, 120 MB/s 2024-09-17T03:44:06.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.006 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655113 s, 160 MB/s 2024-09-17T03:44:06.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873831 s, 120 MB/s 2024-09-17T03:44:06.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.027 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840606 s, 125 MB/s 2024-09-17T03:44:06.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.036 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804389 s, 130 MB/s 2024-09-17T03:44:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767323 s, 137 MB/s 2024-09-17T03:44:06.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.055 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754582 s, 139 MB/s 2024-09-17T03:44:06.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.064 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075962 s, 138 MB/s 2024-09-17T03:44:06.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.073 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712302 s, 147 MB/s 2024-09-17T03:44:06.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.081 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695456 s, 151 MB/s 2024-09-17T03:44:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594642 s, 176 MB/s 2024-09-17T03:44:06.097 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.097 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.098 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677443 s, 155 MB/s 2024-09-17T03:44:06.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.106 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068835 s, 152 MB/s 2024-09-17T03:44:06.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714708 s, 147 MB/s 2024-09-17T03:44:06.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.126 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858232 s, 122 MB/s 2024-09-17T03:44:06.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.135 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720343 s, 146 MB/s 2024-09-17T03:44:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753337 s, 139 MB/s 2024-09-17T03:44:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.152 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.153 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705874 s, 149 MB/s 2024-09-17T03:44:06.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.160 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610881 s, 172 MB/s 2024-09-17T03:44:06.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677709 s, 155 MB/s 2024-09-17T03:44:06.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.177 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695656 s, 151 MB/s 2024-09-17T03:44:06.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596104 s, 176 MB/s 2024-09-17T03:44:06.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713004 s, 147 MB/s 2024-09-17T03:44:06.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.204 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765944 s, 137 MB/s 2024-09-17T03:44:06.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.213 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747871 s, 140 MB/s 2024-09-17T03:44:06.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.222 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727002 s, 144 MB/s 2024-09-17T03:44:06.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.231 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786365 s, 133 MB/s 2024-09-17T03:44:06.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.239 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610671 s, 172 MB/s 2024-09-17T03:44:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.247 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613975 s, 171 MB/s 2024-09-17T03:44:06.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.255 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595403 s, 176 MB/s 2024-09-17T03:44:06.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:06.261 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:06.261 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:06.262 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.1 2024-09-17T03:44:06.262 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:06.262 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:06.262 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:06.262 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:06.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:06.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.322 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784548 s, 134 MB/s 2024-09-17T03:44:06.330 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.331 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697723 s, 150 MB/s 2024-09-17T03:44:06.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.339 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685361 s, 153 MB/s 2024-09-17T03:44:06.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.349 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783815 s, 134 MB/s 2024-09-17T03:44:06.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.358 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720055 s, 146 MB/s 2024-09-17T03:44:06.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.367 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746322 s, 140 MB/s 2024-09-17T03:44:06.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.375 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666304 s, 157 MB/s 2024-09-17T03:44:06.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.384 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714322 s, 147 MB/s 2024-09-17T03:44:06.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699747 s, 150 MB/s 2024-09-17T03:44:06.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.400 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615602 s, 170 MB/s 2024-09-17T03:44:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.409 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687897 s, 152 MB/s 2024-09-17T03:44:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764807 s, 137 MB/s 2024-09-17T03:44:06.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.427 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662944 s, 158 MB/s 2024-09-17T03:44:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666153 s, 157 MB/s 2024-09-17T03:44:06.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073005 s, 144 MB/s 2024-09-17T03:44:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597225 s, 176 MB/s 2024-09-17T03:44:06.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.461 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696869 s, 150 MB/s 2024-09-17T03:44:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061802 s, 170 MB/s 2024-09-17T03:44:06.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.478 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779463 s, 135 MB/s 2024-09-17T03:44:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.488 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752772 s, 139 MB/s 2024-09-17T03:44:06.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.496 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651279 s, 161 MB/s 2024-09-17T03:44:06.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.504 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631372 s, 166 MB/s 2024-09-17T03:44:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.512 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644855 s, 163 MB/s 2024-09-17T03:44:06.521 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.521 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.521 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725784 s, 144 MB/s 2024-09-17T03:44:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.530 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676326 s, 155 MB/s 2024-09-17T03:44:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.537 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601397 s, 174 MB/s 2024-09-17T03:44:06.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.546 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617757 s, 170 MB/s 2024-09-17T03:44:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745273 s, 141 MB/s 2024-09-17T03:44:06.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.562 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595565 s, 176 MB/s 2024-09-17T03:44:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.570 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627513 s, 167 MB/s 2024-09-17T03:44:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677179 s, 155 MB/s 2024-09-17T03:44:06.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.586 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609125 s, 172 MB/s 2024-09-17T03:44:06.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:06.593 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:06.593 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:06.593 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.2 2024-09-17T03:44:06.593 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:06.594 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:06.594 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:06.594 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:06.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622155 s, 169 MB/s 2024-09-17T03:44:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753798 s, 139 MB/s 2024-09-17T03:44:06.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631798 s, 166 MB/s 2024-09-17T03:44:06.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.677 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604548 s, 173 MB/s 2024-09-17T03:44:06.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.686 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007463 s, 141 MB/s 2024-09-17T03:44:06.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730778 s, 143 MB/s 2024-09-17T03:44:06.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.704 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741647 s, 141 MB/s 2024-09-17T03:44:06.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.712 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593576 s, 177 MB/s 2024-09-17T03:44:06.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.722 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752291 s, 139 MB/s 2024-09-17T03:44:06.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766871 s, 137 MB/s 2024-09-17T03:44:06.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.739 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688397 s, 152 MB/s 2024-09-17T03:44:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.748 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716036 s, 146 MB/s 2024-09-17T03:44:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.756 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678654 s, 155 MB/s 2024-09-17T03:44:06.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.765 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608428 s, 172 MB/s 2024-09-17T03:44:06.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.773 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655794 s, 160 MB/s 2024-09-17T03:44:06.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.780 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601227 s, 174 MB/s 2024-09-17T03:44:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.789 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657793 s, 159 MB/s 2024-09-17T03:44:06.797 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.797 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.797 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067568 s, 155 MB/s 2024-09-17T03:44:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595191 s, 176 MB/s 2024-09-17T03:44:06.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.813 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638809 s, 164 MB/s 2024-09-17T03:44:06.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.822 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710217 s, 148 MB/s 2024-09-17T03:44:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.830 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628183 s, 167 MB/s 2024-09-17T03:44:06.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.838 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659927 s, 159 MB/s 2024-09-17T03:44:06.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754266 s, 139 MB/s 2024-09-17T03:44:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066921 s, 157 MB/s 2024-09-17T03:44:06.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730674 s, 144 MB/s 2024-09-17T03:44:06.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738368 s, 142 MB/s 2024-09-17T03:44:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586061 s, 179 MB/s 2024-09-17T03:44:06.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636993 s, 165 MB/s 2024-09-17T03:44:06.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058654 s, 179 MB/s 2024-09-17T03:44:06.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610508 s, 172 MB/s 2024-09-17T03:44:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721612 s, 145 MB/s 2024-09-17T03:44:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:06.920 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:06.921 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:06.921 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.3 2024-09-17T03:44:06.921 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:06.921 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:06.921 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:06.921 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:06.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:06.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739658 s, 142 MB/s 2024-09-17T03:44:06.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.990 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072014 s, 146 MB/s 2024-09-17T03:44:06.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:06.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:06.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736322 s, 142 MB/s 2024-09-17T03:44:07.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667669 s, 157 MB/s 2024-09-17T03:44:07.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.016 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735966 s, 142 MB/s 2024-09-17T03:44:07.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.025 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716552 s, 146 MB/s 2024-09-17T03:44:07.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.034 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689906 s, 152 MB/s 2024-09-17T03:44:07.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625462 s, 168 MB/s 2024-09-17T03:44:07.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.050 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689641 s, 152 MB/s 2024-09-17T03:44:07.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.058 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651498 s, 161 MB/s 2024-09-17T03:44:07.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.067 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679196 s, 154 MB/s 2024-09-17T03:44:07.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.076 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697945 s, 150 MB/s 2024-09-17T03:44:07.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691571 s, 152 MB/s 2024-09-17T03:44:07.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.092 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622666 s, 168 MB/s 2024-09-17T03:44:07.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.101 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706173 s, 148 MB/s 2024-09-17T03:44:07.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.111 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724832 s, 145 MB/s 2024-09-17T03:44:07.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.118 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642744 s, 163 MB/s 2024-09-17T03:44:07.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664493 s, 158 MB/s 2024-09-17T03:44:07.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.136 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729339 s, 144 MB/s 2024-09-17T03:44:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728265 s, 144 MB/s 2024-09-17T03:44:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736652 s, 142 MB/s 2024-09-17T03:44:07.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.163 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715819 s, 146 MB/s 2024-09-17T03:44:07.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.172 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744662 s, 141 MB/s 2024-09-17T03:44:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.180 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614974 s, 171 MB/s 2024-09-17T03:44:07.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.189 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732227 s, 143 MB/s 2024-09-17T03:44:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606479 s, 173 MB/s 2024-09-17T03:44:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632208 s, 166 MB/s 2024-09-17T03:44:07.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.213 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630268 s, 166 MB/s 2024-09-17T03:44:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658805 s, 159 MB/s 2024-09-17T03:44:07.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.230 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670054 s, 156 MB/s 2024-09-17T03:44:07.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668187 s, 157 MB/s 2024-09-17T03:44:07.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.246 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638304 s, 164 MB/s 2024-09-17T03:44:07.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:07.252 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:07.253 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:07.253 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.4 2024-09-17T03:44:07.253 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:07.253 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:07.253 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:07.253 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:07.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:07.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673382 s, 156 MB/s 2024-09-17T03:44:07.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677289 s, 155 MB/s 2024-09-17T03:44:07.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.328 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645267 s, 163 MB/s 2024-09-17T03:44:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746909 s, 140 MB/s 2024-09-17T03:44:07.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.346 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647016 s, 162 MB/s 2024-09-17T03:44:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673684 s, 156 MB/s 2024-09-17T03:44:07.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651655 s, 161 MB/s 2024-09-17T03:44:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686224 s, 153 MB/s 2024-09-17T03:44:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679205 s, 154 MB/s 2024-09-17T03:44:07.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.387 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646701 s, 162 MB/s 2024-09-17T03:44:07.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655579 s, 160 MB/s 2024-09-17T03:44:07.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.404 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683813 s, 153 MB/s 2024-09-17T03:44:07.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.413 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656424 s, 160 MB/s 2024-09-17T03:44:07.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.421 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699245 s, 150 MB/s 2024-09-17T03:44:07.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.430 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712975 s, 147 MB/s 2024-09-17T03:44:07.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.438 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641595 s, 163 MB/s 2024-09-17T03:44:07.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609368 s, 172 MB/s 2024-09-17T03:44:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.455 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662535 s, 158 MB/s 2024-09-17T03:44:07.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.463 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669125 s, 157 MB/s 2024-09-17T03:44:07.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.471 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610525 s, 172 MB/s 2024-09-17T03:44:07.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.479 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673289 s, 156 MB/s 2024-09-17T03:44:07.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600547 s, 175 MB/s 2024-09-17T03:44:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662561 s, 158 MB/s 2024-09-17T03:44:07.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.504 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646812 s, 162 MB/s 2024-09-17T03:44:07.512 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.512 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.512 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689383 s, 152 MB/s 2024-09-17T03:44:07.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.521 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686205 s, 153 MB/s 2024-09-17T03:44:07.528 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.528 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.528 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594202 s, 176 MB/s 2024-09-17T03:44:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.537 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651608 s, 161 MB/s 2024-09-17T03:44:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.545 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655915 s, 160 MB/s 2024-09-17T03:44:07.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725312 s, 145 MB/s 2024-09-17T03:44:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.562 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066684 s, 157 MB/s 2024-09-17T03:44:07.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.571 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650303 s, 161 MB/s 2024-09-17T03:44:07.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:07.577 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:07.577 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:07.577 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.5 2024-09-17T03:44:07.577 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:07.577 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:07.577 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:07.578 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:07.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:07.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.637 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067654 s, 155 MB/s 2024-09-17T03:44:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657061 s, 160 MB/s 2024-09-17T03:44:07.653 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067304 s, 156 MB/s 2024-09-17T03:44:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622258 s, 169 MB/s 2024-09-17T03:44:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678523 s, 155 MB/s 2024-09-17T03:44:07.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.678 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645559 s, 162 MB/s 2024-09-17T03:44:07.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.687 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665242 s, 158 MB/s 2024-09-17T03:44:07.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610639 s, 172 MB/s 2024-09-17T03:44:07.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.702 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594819 s, 176 MB/s 2024-09-17T03:44:07.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.711 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727145 s, 144 MB/s 2024-09-17T03:44:07.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.719 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611103 s, 172 MB/s 2024-09-17T03:44:07.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.727 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675472 s, 155 MB/s 2024-09-17T03:44:07.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.736 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669043 s, 157 MB/s 2024-09-17T03:44:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651725 s, 161 MB/s 2024-09-17T03:44:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.752 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632848 s, 166 MB/s 2024-09-17T03:44:07.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649428 s, 161 MB/s 2024-09-17T03:44:07.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.769 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726527 s, 144 MB/s 2024-09-17T03:44:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.778 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670881 s, 156 MB/s 2024-09-17T03:44:07.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641073 s, 164 MB/s 2024-09-17T03:44:07.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584008 s, 180 MB/s 2024-09-17T03:44:07.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666408 s, 157 MB/s 2024-09-17T03:44:07.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.810 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654491 s, 160 MB/s 2024-09-17T03:44:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610509 s, 172 MB/s 2024-09-17T03:44:07.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.826 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663139 s, 158 MB/s 2024-09-17T03:44:07.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.834 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648538 s, 162 MB/s 2024-09-17T03:44:07.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.842 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589503 s, 178 MB/s 2024-09-17T03:44:07.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.850 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633357 s, 166 MB/s 2024-09-17T03:44:07.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.860 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748851 s, 140 MB/s 2024-09-17T03:44:07.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.868 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670689 s, 156 MB/s 2024-09-17T03:44:07.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.876 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656817 s, 160 MB/s 2024-09-17T03:44:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.885 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661825 s, 158 MB/s 2024-09-17T03:44:07.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.892 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.893 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650145 s, 161 MB/s 2024-09-17T03:44:07.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:07.899 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:07.899 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:07.899 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.6 2024-09-17T03:44:07.899 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:07.899 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:07.900 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:07.900 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:07.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:07.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753627 s, 139 MB/s 2024-09-17T03:44:07.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.967 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607926 s, 172 MB/s 2024-09-17T03:44:07.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.975 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066342 s, 158 MB/s 2024-09-17T03:44:07.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610381 s, 172 MB/s 2024-09-17T03:44:07.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.991 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663413 s, 158 MB/s 2024-09-17T03:44:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641035 s, 164 MB/s 2024-09-17T03:44:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726608 s, 144 MB/s 2024-09-17T03:44:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713021 s, 147 MB/s 2024-09-17T03:44:08.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687878 s, 152 MB/s 2024-09-17T03:44:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754514 s, 139 MB/s 2024-09-17T03:44:08.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.043 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651811 s, 161 MB/s 2024-09-17T03:44:08.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653649 s, 160 MB/s 2024-09-17T03:44:08.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623429 s, 168 MB/s 2024-09-17T03:44:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738029 s, 142 MB/s 2024-09-17T03:44:08.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.076 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604263 s, 174 MB/s 2024-09-17T03:44:08.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.085 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670445 s, 156 MB/s 2024-09-17T03:44:08.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.094 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.094 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737341 s, 142 MB/s 2024-09-17T03:44:08.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.103 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655456 s, 160 MB/s 2024-09-17T03:44:08.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.111 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729364 s, 144 MB/s 2024-09-17T03:44:08.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657284 s, 160 MB/s 2024-09-17T03:44:08.128 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.128 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.129 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692379 s, 151 MB/s 2024-09-17T03:44:08.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.137 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738844 s, 142 MB/s 2024-09-17T03:44:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.145 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667095 s, 157 MB/s 2024-09-17T03:44:08.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.154 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678193 s, 155 MB/s 2024-09-17T03:44:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668105 s, 157 MB/s 2024-09-17T03:44:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652484 s, 161 MB/s 2024-09-17T03:44:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736883 s, 142 MB/s 2024-09-17T03:44:08.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.188 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681117 s, 154 MB/s 2024-09-17T03:44:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634469 s, 165 MB/s 2024-09-17T03:44:08.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.204 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062212 s, 169 MB/s 2024-09-17T03:44:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645603 s, 162 MB/s 2024-09-17T03:44:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760937 s, 138 MB/s 2024-09-17T03:44:08.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:08.228 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:08.228 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:08.229 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.7 2024-09-17T03:44:08.229 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:08.229 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:08.229 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:08.229 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:08.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:08.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.288 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067496 s, 155 MB/s 2024-09-17T03:44:08.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.297 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746217 s, 141 MB/s 2024-09-17T03:44:08.304 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.305 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610558 s, 172 MB/s 2024-09-17T03:44:08.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.313 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580121 s, 181 MB/s 2024-09-17T03:44:08.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.321 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.321 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655746 s, 160 MB/s 2024-09-17T03:44:08.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.329 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613184 s, 171 MB/s 2024-09-17T03:44:08.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.337 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714059 s, 147 MB/s 2024-09-17T03:44:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652711 s, 161 MB/s 2024-09-17T03:44:08.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.353 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591269 s, 177 MB/s 2024-09-17T03:44:08.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721853 s, 145 MB/s 2024-09-17T03:44:08.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063381 s, 165 MB/s 2024-09-17T03:44:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678178 s, 155 MB/s 2024-09-17T03:44:08.386 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.387 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644187 s, 163 MB/s 2024-09-17T03:44:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642599 s, 163 MB/s 2024-09-17T03:44:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066697 s, 157 MB/s 2024-09-17T03:44:08.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727298 s, 144 MB/s 2024-09-17T03:44:08.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.421 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674462 s, 155 MB/s 2024-09-17T03:44:08.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.428 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599779 s, 175 MB/s 2024-09-17T03:44:08.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.436 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599676 s, 175 MB/s 2024-09-17T03:44:08.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597842 s, 175 MB/s 2024-09-17T03:44:08.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063791 s, 164 MB/s 2024-09-17T03:44:08.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.461 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679884 s, 154 MB/s 2024-09-17T03:44:08.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.469 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069989 s, 150 MB/s 2024-09-17T03:44:08.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.478 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066517 s, 158 MB/s 2024-09-17T03:44:08.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.485 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578293 s, 181 MB/s 2024-09-17T03:44:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777222 s, 135 MB/s 2024-09-17T03:44:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.502 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573719 s, 183 MB/s 2024-09-17T03:44:08.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.511 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670731 s, 156 MB/s 2024-09-17T03:44:08.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585817 s, 179 MB/s 2024-09-17T03:44:08.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.526 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595818 s, 176 MB/s 2024-09-17T03:44:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.534 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610346 s, 172 MB/s 2024-09-17T03:44:08.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610885 s, 172 MB/s 2024-09-17T03:44:08.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:08.549 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:08.549 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:08.549 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.8 2024-09-17T03:44:08.549 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:08.549 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:08.549 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:08.549 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:08.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:08.608 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.608 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.609 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066823 s, 157 MB/s 2024-09-17T03:44:08.617 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.618 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741645 s, 141 MB/s 2024-09-17T03:44:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.625 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588132 s, 178 MB/s 2024-09-17T03:44:08.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.634 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662291 s, 158 MB/s 2024-09-17T03:44:08.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.642 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685727 s, 153 MB/s 2024-09-17T03:44:08.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742456 s, 141 MB/s 2024-09-17T03:44:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.659 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611574 s, 171 MB/s 2024-09-17T03:44:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.668 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665683 s, 158 MB/s 2024-09-17T03:44:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657683 s, 159 MB/s 2024-09-17T03:44:08.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.685 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666267 s, 157 MB/s 2024-09-17T03:44:08.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.693 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628234 s, 167 MB/s 2024-09-17T03:44:08.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.702 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698371 s, 150 MB/s 2024-09-17T03:44:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.711 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755017 s, 139 MB/s 2024-09-17T03:44:08.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.719 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649035 s, 162 MB/s 2024-09-17T03:44:08.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.727 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621515 s, 169 MB/s 2024-09-17T03:44:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.735 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665986 s, 157 MB/s 2024-09-17T03:44:08.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663736 s, 158 MB/s 2024-09-17T03:44:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074077 s, 142 MB/s 2024-09-17T03:44:08.761 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.761 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.761 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667796 s, 157 MB/s 2024-09-17T03:44:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.769 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612481 s, 171 MB/s 2024-09-17T03:44:08.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.777 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646863 s, 162 MB/s 2024-09-17T03:44:08.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675144 s, 155 MB/s 2024-09-17T03:44:08.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.794 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654425 s, 160 MB/s 2024-09-17T03:44:08.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736313 s, 142 MB/s 2024-09-17T03:44:08.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655901 s, 160 MB/s 2024-09-17T03:44:08.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.821 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699839 s, 150 MB/s 2024-09-17T03:44:08.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660587 s, 159 MB/s 2024-09-17T03:44:08.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736176 s, 142 MB/s 2024-09-17T03:44:08.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066729 s, 157 MB/s 2024-09-17T03:44:08.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.854 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581677 s, 180 MB/s 2024-09-17T03:44:08.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603505 s, 174 MB/s 2024-09-17T03:44:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588145 s, 178 MB/s 2024-09-17T03:44:08.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:08.877 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:08.877 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:08.877 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.9 2024-09-17T03:44:08.877 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:08.877 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:08.877 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:08.877 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673526 s, 156 MB/s 2024-09-17T03:44:08.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.945 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746158 s, 141 MB/s 2024-09-17T03:44:08.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.954 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068066 s, 154 MB/s 2024-09-17T03:44:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.961 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624003 s, 168 MB/s 2024-09-17T03:44:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.969 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613992 s, 171 MB/s 2024-09-17T03:44:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.977 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589264 s, 178 MB/s 2024-09-17T03:44:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.986 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687246 s, 153 MB/s 2024-09-17T03:44:08.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:08.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:08.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599477 s, 175 MB/s 2024-09-17T03:44:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069646 s, 151 MB/s 2024-09-17T03:44:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.010 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645881 s, 162 MB/s 2024-09-17T03:44:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.018 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642313 s, 163 MB/s 2024-09-17T03:44:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.027 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635059 s, 165 MB/s 2024-09-17T03:44:09.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.035 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626025 s, 167 MB/s 2024-09-17T03:44:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686562 s, 153 MB/s 2024-09-17T03:44:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629735 s, 167 MB/s 2024-09-17T03:44:09.060 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.061 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729356 s, 144 MB/s 2024-09-17T03:44:09.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.069 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658702 s, 159 MB/s 2024-09-17T03:44:09.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.078 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722854 s, 145 MB/s 2024-09-17T03:44:09.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.086 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593837 s, 177 MB/s 2024-09-17T03:44:09.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.093 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583556 s, 180 MB/s 2024-09-17T03:44:09.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748041 s, 140 MB/s 2024-09-17T03:44:09.112 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.112 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.112 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755062 s, 139 MB/s 2024-09-17T03:44:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734437 s, 143 MB/s 2024-09-17T03:44:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590162 s, 178 MB/s 2024-09-17T03:44:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684614 s, 153 MB/s 2024-09-17T03:44:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.145 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591476 s, 177 MB/s 2024-09-17T03:44:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734892 s, 143 MB/s 2024-09-17T03:44:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662655 s, 158 MB/s 2024-09-17T03:44:09.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.171 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720684 s, 145 MB/s 2024-09-17T03:44:09.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.180 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759549 s, 138 MB/s 2024-09-17T03:44:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.188 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640888 s, 164 MB/s 2024-09-17T03:44:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726921 s, 144 MB/s 2024-09-17T03:44:09.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:09.203 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:09.204 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:09.204 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.10 2024-09-17T03:44:09.204 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:09.204 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:09.204 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:09.204 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:09.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.262 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061411 s, 171 MB/s 2024-09-17T03:44:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601589 s, 174 MB/s 2024-09-17T03:44:09.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.278 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671489 s, 156 MB/s 2024-09-17T03:44:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658878 s, 159 MB/s 2024-09-17T03:44:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600383 s, 175 MB/s 2024-09-17T03:44:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.302 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625123 s, 168 MB/s 2024-09-17T03:44:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611357 s, 172 MB/s 2024-09-17T03:44:09.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604234 s, 174 MB/s 2024-09-17T03:44:09.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.326 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645671 s, 162 MB/s 2024-09-17T03:44:09.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681344 s, 154 MB/s 2024-09-17T03:44:09.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.343 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601832 s, 174 MB/s 2024-09-17T03:44:09.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.350 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584541 s, 179 MB/s 2024-09-17T03:44:09.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.359 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723015 s, 145 MB/s 2024-09-17T03:44:09.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.368 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664039 s, 158 MB/s 2024-09-17T03:44:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654723 s, 160 MB/s 2024-09-17T03:44:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067232 s, 156 MB/s 2024-09-17T03:44:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642312 s, 163 MB/s 2024-09-17T03:44:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683047 s, 154 MB/s 2024-09-17T03:44:09.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.410 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722811 s, 145 MB/s 2024-09-17T03:44:09.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679063 s, 154 MB/s 2024-09-17T03:44:09.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.427 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697251 s, 150 MB/s 2024-09-17T03:44:09.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621936 s, 169 MB/s 2024-09-17T03:44:09.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727809 s, 144 MB/s 2024-09-17T03:44:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670446 s, 156 MB/s 2024-09-17T03:44:09.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.462 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747881 s, 140 MB/s 2024-09-17T03:44:09.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686098 s, 153 MB/s 2024-09-17T03:44:09.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.479 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702073 s, 149 MB/s 2024-09-17T03:44:09.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652923 s, 161 MB/s 2024-09-17T03:44:09.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.496 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748545 s, 140 MB/s 2024-09-17T03:44:09.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.504 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637082 s, 165 MB/s 2024-09-17T03:44:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.512 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648076 s, 162 MB/s 2024-09-17T03:44:09.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.520 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650827 s, 161 MB/s 2024-09-17T03:44:09.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:09.527 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:09.527 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:09.527 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.11 2024-09-17T03:44:09.527 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:09.527 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:09.527 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:09.527 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:09.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:09.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.586 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676791 s, 155 MB/s 2024-09-17T03:44:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682401 s, 154 MB/s 2024-09-17T03:44:09.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.602 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584885 s, 179 MB/s 2024-09-17T03:44:09.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678107 s, 155 MB/s 2024-09-17T03:44:09.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.620 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733835 s, 143 MB/s 2024-09-17T03:44:09.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.628 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664892 s, 158 MB/s 2024-09-17T03:44:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.636 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681295 s, 154 MB/s 2024-09-17T03:44:09.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.645 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721908 s, 145 MB/s 2024-09-17T03:44:09.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683074 s, 154 MB/s 2024-09-17T03:44:09.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.662 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656235 s, 160 MB/s 2024-09-17T03:44:09.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.671 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682795 s, 154 MB/s 2024-09-17T03:44:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.679 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068902 s, 152 MB/s 2024-09-17T03:44:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.688 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753037 s, 139 MB/s 2024-09-17T03:44:09.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653608 s, 160 MB/s 2024-09-17T03:44:09.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743122 s, 141 MB/s 2024-09-17T03:44:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663373 s, 158 MB/s 2024-09-17T03:44:09.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.722 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597521 s, 175 MB/s 2024-09-17T03:44:09.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.730 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682178 s, 154 MB/s 2024-09-17T03:44:09.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.739 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673949 s, 156 MB/s 2024-09-17T03:44:09.747 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.747 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.747 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649742 s, 161 MB/s 2024-09-17T03:44:09.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.755 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646588 s, 162 MB/s 2024-09-17T03:44:09.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.764 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073318 s, 143 MB/s 2024-09-17T03:44:09.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.772 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657638 s, 159 MB/s 2024-09-17T03:44:09.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.780 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646845 s, 162 MB/s 2024-09-17T03:44:09.788 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.788 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.788 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608674 s, 172 MB/s 2024-09-17T03:44:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.796 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647779 s, 162 MB/s 2024-09-17T03:44:09.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.806 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075506 s, 139 MB/s 2024-09-17T03:44:09.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.813 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604149 s, 174 MB/s 2024-09-17T03:44:09.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.823 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751114 s, 140 MB/s 2024-09-17T03:44:09.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.831 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655057 s, 160 MB/s 2024-09-17T03:44:09.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.840 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727128 s, 144 MB/s 2024-09-17T03:44:09.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642932 s, 163 MB/s 2024-09-17T03:44:09.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:09.855 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:09.855 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:09.856 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.12 2024-09-17T03:44:09.856 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:09.856 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:09.856 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:09.856 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:09.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:09.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678162 s, 155 MB/s 2024-09-17T03:44:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598472 s, 175 MB/s 2024-09-17T03:44:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714589 s, 147 MB/s 2024-09-17T03:44:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648652 s, 162 MB/s 2024-09-17T03:44:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059589 s, 176 MB/s 2024-09-17T03:44:09.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743585 s, 141 MB/s 2024-09-17T03:44:09.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.964 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582044 s, 180 MB/s 2024-09-17T03:44:09.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.973 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706752 s, 148 MB/s 2024-09-17T03:44:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007361 s, 142 MB/s 2024-09-17T03:44:09.990 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:09.990 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:09.990 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648356 s, 162 MB/s 2024-09-17T03:44:10.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.000 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079229 s, 132 MB/s 2024-09-17T03:44:10.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.009 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715643 s, 147 MB/s 2024-09-17T03:44:10.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.018 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065453 s, 160 MB/s 2024-09-17T03:44:10.027 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.028 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788456 s, 133 MB/s 2024-09-17T03:44:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731019 s, 143 MB/s 2024-09-17T03:44:10.045 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.045 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.045 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642834 s, 163 MB/s 2024-09-17T03:44:10.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.054 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671244 s, 156 MB/s 2024-09-17T03:44:10.063 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.063 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.063 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777029 s, 135 MB/s 2024-09-17T03:44:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.073 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713186 s, 147 MB/s 2024-09-17T03:44:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.082 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798473 s, 131 MB/s 2024-09-17T03:44:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654075 s, 160 MB/s 2024-09-17T03:44:10.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.099 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648199 s, 162 MB/s 2024-09-17T03:44:10.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.109 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739973 s, 142 MB/s 2024-09-17T03:44:10.117 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.118 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729702 s, 144 MB/s 2024-09-17T03:44:10.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.126 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611234 s, 172 MB/s 2024-09-17T03:44:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.134 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667425 s, 157 MB/s 2024-09-17T03:44:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.142 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059544 s, 176 MB/s 2024-09-17T03:44:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.151 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742102 s, 141 MB/s 2024-09-17T03:44:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.160 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658247 s, 159 MB/s 2024-09-17T03:44:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650302 s, 161 MB/s 2024-09-17T03:44:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653168 s, 161 MB/s 2024-09-17T03:44:10.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635179 s, 165 MB/s 2024-09-17T03:44:10.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:10.190 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:10.191 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:10.191 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.13 2024-09-17T03:44:10.191 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:10.191 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:10.191 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:10.191 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:10.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:10.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.249 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651146 s, 161 MB/s 2024-09-17T03:44:10.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657208 s, 160 MB/s 2024-09-17T03:44:10.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.266 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073942 s, 142 MB/s 2024-09-17T03:44:10.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.274 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598285 s, 175 MB/s 2024-09-17T03:44:10.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.282 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636677 s, 165 MB/s 2024-09-17T03:44:10.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697499 s, 150 MB/s 2024-09-17T03:44:10.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649308 s, 161 MB/s 2024-09-17T03:44:10.307 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654878 s, 160 MB/s 2024-09-17T03:44:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659644 s, 159 MB/s 2024-09-17T03:44:10.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705087 s, 149 MB/s 2024-09-17T03:44:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592647 s, 177 MB/s 2024-09-17T03:44:10.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.340 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590621 s, 178 MB/s 2024-09-17T03:44:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.348 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650449 s, 161 MB/s 2024-09-17T03:44:10.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.358 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758928 s, 138 MB/s 2024-09-17T03:44:10.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.366 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660122 s, 159 MB/s 2024-09-17T03:44:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.375 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722701 s, 145 MB/s 2024-09-17T03:44:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.383 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638271 s, 164 MB/s 2024-09-17T03:44:10.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.391 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065381 s, 160 MB/s 2024-09-17T03:44:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757842 s, 138 MB/s 2024-09-17T03:44:10.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.408 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637305 s, 165 MB/s 2024-09-17T03:44:10.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.417 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690665 s, 152 MB/s 2024-09-17T03:44:10.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719097 s, 146 MB/s 2024-09-17T03:44:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.434 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640698 s, 164 MB/s 2024-09-17T03:44:10.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.442 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643548 s, 163 MB/s 2024-09-17T03:44:10.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720416 s, 146 MB/s 2024-09-17T03:44:10.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.460 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722959 s, 145 MB/s 2024-09-17T03:44:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.467 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608679 s, 172 MB/s 2024-09-17T03:44:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684638 s, 153 MB/s 2024-09-17T03:44:10.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.484 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601827 s, 174 MB/s 2024-09-17T03:44:10.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.493 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074705 s, 140 MB/s 2024-09-17T03:44:10.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.502 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687289 s, 153 MB/s 2024-09-17T03:44:10.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.509 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585517 s, 179 MB/s 2024-09-17T03:44:10.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:10.516 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:10.516 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:10.516 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.14 2024-09-17T03:44:10.516 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:10.516 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:10.516 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:10.516 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:10.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.575 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651994 s, 161 MB/s 2024-09-17T03:44:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592021 s, 177 MB/s 2024-09-17T03:44:10.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617644 s, 170 MB/s 2024-09-17T03:44:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073636 s, 142 MB/s 2024-09-17T03:44:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.608 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673324 s, 156 MB/s 2024-09-17T03:44:10.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648759 s, 162 MB/s 2024-09-17T03:44:10.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.623 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609937 s, 172 MB/s 2024-09-17T03:44:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.631 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626603 s, 167 MB/s 2024-09-17T03:44:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.640 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677064 s, 155 MB/s 2024-09-17T03:44:10.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.647 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584916 s, 179 MB/s 2024-09-17T03:44:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659362 s, 159 MB/s 2024-09-17T03:44:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.664 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668543 s, 157 MB/s 2024-09-17T03:44:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.673 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070636 s, 148 MB/s 2024-09-17T03:44:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620853 s, 169 MB/s 2024-09-17T03:44:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664918 s, 158 MB/s 2024-09-17T03:44:10.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.698 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665757 s, 158 MB/s 2024-09-17T03:44:10.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.707 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731188 s, 143 MB/s 2024-09-17T03:44:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.715 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657921 s, 159 MB/s 2024-09-17T03:44:10.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.724 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657001 s, 160 MB/s 2024-09-17T03:44:10.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061476 s, 171 MB/s 2024-09-17T03:44:10.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.740 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655923 s, 160 MB/s 2024-09-17T03:44:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.749 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747143 s, 140 MB/s 2024-09-17T03:44:10.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.758 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730862 s, 143 MB/s 2024-09-17T03:44:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059534 s, 176 MB/s 2024-09-17T03:44:10.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.775 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067841 s, 155 MB/s 2024-09-17T03:44:10.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.783 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658262 s, 159 MB/s 2024-09-17T03:44:10.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.791 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636206 s, 165 MB/s 2024-09-17T03:44:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.799 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664284 s, 158 MB/s 2024-09-17T03:44:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.807 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636119 s, 165 MB/s 2024-09-17T03:44:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.815 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654706 s, 160 MB/s 2024-09-17T03:44:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.824 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073255 s, 143 MB/s 2024-09-17T03:44:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645 s, 163 MB/s 2024-09-17T03:44:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:10.839 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:10.839 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:10.839 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.15 2024-09-17T03:44:10.839 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:10.839 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:10.839 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:10.840 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:10.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:10.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.898 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663153 s, 158 MB/s 2024-09-17T03:44:10.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654644 s, 160 MB/s 2024-09-17T03:44:10.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658435 s, 159 MB/s 2024-09-17T03:44:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.924 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778194 s, 135 MB/s 2024-09-17T03:44:10.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666127 s, 157 MB/s 2024-09-17T03:44:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641797 s, 163 MB/s 2024-09-17T03:44:10.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.949 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689171 s, 152 MB/s 2024-09-17T03:44:10.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.958 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661418 s, 159 MB/s 2024-09-17T03:44:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.967 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740431 s, 142 MB/s 2024-09-17T03:44:10.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.975 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592148 s, 177 MB/s 2024-09-17T03:44:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645693 s, 162 MB/s 2024-09-17T03:44:10.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.991 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064997 s, 161 MB/s 2024-09-17T03:44:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:10.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629702 s, 167 MB/s 2024-09-17T03:44:11.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.008 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713595 s, 147 MB/s 2024-09-17T03:44:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731589 s, 143 MB/s 2024-09-17T03:44:11.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.025 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062334 s, 168 MB/s 2024-09-17T03:44:11.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.034 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655561 s, 160 MB/s 2024-09-17T03:44:11.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648982 s, 162 MB/s 2024-09-17T03:44:11.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.051 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728361 s, 144 MB/s 2024-09-17T03:44:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673055 s, 156 MB/s 2024-09-17T03:44:11.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.068 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667212 s, 157 MB/s 2024-09-17T03:44:11.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.076 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663327 s, 158 MB/s 2024-09-17T03:44:11.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669575 s, 157 MB/s 2024-09-17T03:44:11.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.093 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737664 s, 142 MB/s 2024-09-17T03:44:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583815 s, 180 MB/s 2024-09-17T03:44:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597986 s, 175 MB/s 2024-09-17T03:44:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.118 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743454 s, 141 MB/s 2024-09-17T03:44:11.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717845 s, 146 MB/s 2024-09-17T03:44:11.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.135 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699473 s, 150 MB/s 2024-09-17T03:44:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.143 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612969 s, 171 MB/s 2024-09-17T03:44:11.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.151 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652039 s, 161 MB/s 2024-09-17T03:44:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615448 s, 170 MB/s 2024-09-17T03:44:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:11.166 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:11.166 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:11.166 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.16 2024-09-17T03:44:11.166 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:11.166 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:11.166 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:11.167 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:11.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.225 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621156 s, 169 MB/s 2024-09-17T03:44:11.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.234 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733968 s, 143 MB/s 2024-09-17T03:44:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062547 s, 168 MB/s 2024-09-17T03:44:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653675 s, 160 MB/s 2024-09-17T03:44:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.258 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655235 s, 160 MB/s 2024-09-17T03:44:11.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663452 s, 158 MB/s 2024-09-17T03:44:11.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682028 s, 154 MB/s 2024-09-17T03:44:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601346 s, 174 MB/s 2024-09-17T03:44:11.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671751 s, 156 MB/s 2024-09-17T03:44:11.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641378 s, 163 MB/s 2024-09-17T03:44:11.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691611 s, 152 MB/s 2024-09-17T03:44:11.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637807 s, 164 MB/s 2024-09-17T03:44:11.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655321 s, 160 MB/s 2024-09-17T03:44:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667319 s, 157 MB/s 2024-09-17T03:44:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759857 s, 138 MB/s 2024-09-17T03:44:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588856 s, 178 MB/s 2024-09-17T03:44:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.358 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688557 s, 152 MB/s 2024-09-17T03:44:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697948 s, 150 MB/s 2024-09-17T03:44:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.375 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649408 s, 161 MB/s 2024-09-17T03:44:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.384 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709987 s, 148 MB/s 2024-09-17T03:44:11.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668012 s, 157 MB/s 2024-09-17T03:44:11.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.402 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724875 s, 145 MB/s 2024-09-17T03:44:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.409 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588965 s, 178 MB/s 2024-09-17T03:44:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.417 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600956 s, 174 MB/s 2024-09-17T03:44:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738633 s, 142 MB/s 2024-09-17T03:44:11.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674758 s, 155 MB/s 2024-09-17T03:44:11.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.443 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631867 s, 166 MB/s 2024-09-17T03:44:11.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723706 s, 145 MB/s 2024-09-17T03:44:11.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600607 s, 175 MB/s 2024-09-17T03:44:11.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.467 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588115 s, 178 MB/s 2024-09-17T03:44:11.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651623 s, 161 MB/s 2024-09-17T03:44:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614299 s, 171 MB/s 2024-09-17T03:44:11.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:11.490 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:11.490 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:11.490 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.17 2024-09-17T03:44:11.490 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:11.490 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:11.490 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:11.490 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:11.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650632 s, 161 MB/s 2024-09-17T03:44:11.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.557 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637165 s, 165 MB/s 2024-09-17T03:44:11.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065377 s, 160 MB/s 2024-09-17T03:44:11.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728212 s, 144 MB/s 2024-09-17T03:44:11.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.583 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664546 s, 158 MB/s 2024-09-17T03:44:11.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.591 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613486 s, 171 MB/s 2024-09-17T03:44:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650543 s, 161 MB/s 2024-09-17T03:44:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639574 s, 164 MB/s 2024-09-17T03:44:11.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675144 s, 155 MB/s 2024-09-17T03:44:11.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.624 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674824 s, 155 MB/s 2024-09-17T03:44:11.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.633 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681953 s, 154 MB/s 2024-09-17T03:44:11.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.641 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688898 s, 152 MB/s 2024-09-17T03:44:11.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626864 s, 167 MB/s 2024-09-17T03:44:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.659 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789239 s, 133 MB/s 2024-09-17T03:44:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.668 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667512 s, 157 MB/s 2024-09-17T03:44:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606639 s, 173 MB/s 2024-09-17T03:44:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658159 s, 159 MB/s 2024-09-17T03:44:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670629 s, 156 MB/s 2024-09-17T03:44:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.700 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058947 s, 178 MB/s 2024-09-17T03:44:11.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.708 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660222 s, 159 MB/s 2024-09-17T03:44:11.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.717 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733495 s, 143 MB/s 2024-09-17T03:44:11.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.726 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652015 s, 161 MB/s 2024-09-17T03:44:11.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.733 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060353 s, 174 MB/s 2024-09-17T03:44:11.741 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.742 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640864 s, 164 MB/s 2024-09-17T03:44:11.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.750 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672597 s, 156 MB/s 2024-09-17T03:44:11.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.759 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667098 s, 157 MB/s 2024-09-17T03:44:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.767 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652137 s, 161 MB/s 2024-09-17T03:44:11.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.776 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073443 s, 143 MB/s 2024-09-17T03:44:11.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.784 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663005 s, 158 MB/s 2024-09-17T03:44:11.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650911 s, 161 MB/s 2024-09-17T03:44:11.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.801 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677677 s, 155 MB/s 2024-09-17T03:44:11.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603166 s, 174 MB/s 2024-09-17T03:44:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:11.815 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:11.815 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:11.815 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.18 2024-09-17T03:44:11.816 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:11.816 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:11.816 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:11.816 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:11.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:11.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592429 s, 177 MB/s 2024-09-17T03:44:11.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729251 s, 144 MB/s 2024-09-17T03:44:11.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595088 s, 176 MB/s 2024-09-17T03:44:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657538 s, 159 MB/s 2024-09-17T03:44:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.908 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730057 s, 144 MB/s 2024-09-17T03:44:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607887 s, 172 MB/s 2024-09-17T03:44:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753056 s, 139 MB/s 2024-09-17T03:44:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613029 s, 171 MB/s 2024-09-17T03:44:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642142 s, 163 MB/s 2024-09-17T03:44:11.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673106 s, 156 MB/s 2024-09-17T03:44:11.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607686 s, 173 MB/s 2024-09-17T03:44:11.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.966 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635995 s, 165 MB/s 2024-09-17T03:44:11.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.974 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666481 s, 157 MB/s 2024-09-17T03:44:11.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635148 s, 165 MB/s 2024-09-17T03:44:11.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585211 s, 179 MB/s 2024-09-17T03:44:11.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:11.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:11.998 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066581 s, 157 MB/s 2024-09-17T03:44:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742639 s, 141 MB/s 2024-09-17T03:44:12.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.015 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703824 s, 149 MB/s 2024-09-17T03:44:12.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.024 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644085 s, 163 MB/s 2024-09-17T03:44:12.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.033 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715529 s, 147 MB/s 2024-09-17T03:44:12.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680702 s, 154 MB/s 2024-09-17T03:44:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726734 s, 144 MB/s 2024-09-17T03:44:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654702 s, 160 MB/s 2024-09-17T03:44:12.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.067 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657747 s, 159 MB/s 2024-09-17T03:44:12.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.075 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641406 s, 163 MB/s 2024-09-17T03:44:12.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.082 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593227 s, 177 MB/s 2024-09-17T03:44:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.091 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662971 s, 158 MB/s 2024-09-17T03:44:12.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.098 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593398 s, 177 MB/s 2024-09-17T03:44:12.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.107 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696957 s, 150 MB/s 2024-09-17T03:44:12.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655214 s, 160 MB/s 2024-09-17T03:44:12.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.124 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069198 s, 152 MB/s 2024-09-17T03:44:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734208 s, 143 MB/s 2024-09-17T03:44:12.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:12.139 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:12.140 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:12.140 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.19 2024-09-17T03:44:12.140 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:12.140 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:12.140 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:12.140 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:12.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654202 s, 160 MB/s 2024-09-17T03:44:12.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.207 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678023 s, 155 MB/s 2024-09-17T03:44:12.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.216 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684214 s, 153 MB/s 2024-09-17T03:44:12.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.224 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657057 s, 160 MB/s 2024-09-17T03:44:12.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674416 s, 155 MB/s 2024-09-17T03:44:12.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608837 s, 172 MB/s 2024-09-17T03:44:12.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.249 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659736 s, 159 MB/s 2024-09-17T03:44:12.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625956 s, 168 MB/s 2024-09-17T03:44:12.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670817 s, 156 MB/s 2024-09-17T03:44:12.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.273 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676552 s, 155 MB/s 2024-09-17T03:44:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.282 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638816 s, 164 MB/s 2024-09-17T03:44:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726049 s, 144 MB/s 2024-09-17T03:44:12.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591711 s, 177 MB/s 2024-09-17T03:44:12.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.306 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646785 s, 162 MB/s 2024-09-17T03:44:12.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.315 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655042 s, 160 MB/s 2024-09-17T03:44:12.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645902 s, 162 MB/s 2024-09-17T03:44:12.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.331 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067513 s, 155 MB/s 2024-09-17T03:44:12.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.340 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660316 s, 159 MB/s 2024-09-17T03:44:12.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.348 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654378 s, 160 MB/s 2024-09-17T03:44:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.357 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068242 s, 154 MB/s 2024-09-17T03:44:12.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.366 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748839 s, 140 MB/s 2024-09-17T03:44:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656302 s, 160 MB/s 2024-09-17T03:44:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.383 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682094 s, 154 MB/s 2024-09-17T03:44:12.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.391 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653738 s, 160 MB/s 2024-09-17T03:44:12.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.400 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755313 s, 139 MB/s 2024-09-17T03:44:12.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.408 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578269 s, 181 MB/s 2024-09-17T03:44:12.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.416 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653246 s, 161 MB/s 2024-09-17T03:44:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723682 s, 145 MB/s 2024-09-17T03:44:12.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.434 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695458 s, 151 MB/s 2024-09-17T03:44:12.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.442 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065201 s, 161 MB/s 2024-09-17T03:44:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.450 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599955 s, 175 MB/s 2024-09-17T03:44:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644513 s, 163 MB/s 2024-09-17T03:44:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:12.465 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:12.465 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:12.465 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.20 2024-09-17T03:44:12.465 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:12.466 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:12.466 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:12.466 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:12.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:12.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.525 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.525 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590748 s, 177 MB/s 2024-09-17T03:44:12.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.532 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620351 s, 169 MB/s 2024-09-17T03:44:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.541 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670288 s, 156 MB/s 2024-09-17T03:44:12.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.550 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653899 s, 160 MB/s 2024-09-17T03:44:12.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.558 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665157 s, 158 MB/s 2024-09-17T03:44:12.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575437 s, 182 MB/s 2024-09-17T03:44:12.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760709 s, 138 MB/s 2024-09-17T03:44:12.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576914 s, 182 MB/s 2024-09-17T03:44:12.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.594 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669691 s, 157 MB/s 2024-09-17T03:44:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645756 s, 162 MB/s 2024-09-17T03:44:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607483 s, 173 MB/s 2024-09-17T03:44:12.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660201 s, 159 MB/s 2024-09-17T03:44:12.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.622 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598773 s, 175 MB/s 2024-09-17T03:44:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.630 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640038 s, 164 MB/s 2024-09-17T03:44:12.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.638 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064959 s, 161 MB/s 2024-09-17T03:44:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646903 s, 162 MB/s 2024-09-17T03:44:12.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590085 s, 178 MB/s 2024-09-17T03:44:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.662 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666797 s, 157 MB/s 2024-09-17T03:44:12.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.672 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766949 s, 137 MB/s 2024-09-17T03:44:12.680 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.680 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.680 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653881 s, 160 MB/s 2024-09-17T03:44:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.688 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659627 s, 159 MB/s 2024-09-17T03:44:12.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653949 s, 160 MB/s 2024-09-17T03:44:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653091 s, 161 MB/s 2024-09-17T03:44:12.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.713 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647629 s, 162 MB/s 2024-09-17T03:44:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.722 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748235 s, 140 MB/s 2024-09-17T03:44:12.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723419 s, 145 MB/s 2024-09-17T03:44:12.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.740 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731298 s, 143 MB/s 2024-09-17T03:44:12.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.748 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636276 s, 165 MB/s 2024-09-17T03:44:12.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.756 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642204 s, 163 MB/s 2024-09-17T03:44:12.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.764 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606955 s, 173 MB/s 2024-09-17T03:44:12.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.773 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681197 s, 154 MB/s 2024-09-17T03:44:12.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648251 s, 162 MB/s 2024-09-17T03:44:12.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:12.787 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:12.787 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:12.787 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.21 2024-09-17T03:44:12.787 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:12.788 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:12.788 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:12.788 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:12.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:12.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067861 s, 155 MB/s 2024-09-17T03:44:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.855 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633081 s, 166 MB/s 2024-09-17T03:44:12.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783164 s, 134 MB/s 2024-09-17T03:44:12.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663604 s, 158 MB/s 2024-09-17T03:44:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600379 s, 175 MB/s 2024-09-17T03:44:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662448 s, 158 MB/s 2024-09-17T03:44:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622966 s, 168 MB/s 2024-09-17T03:44:12.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752085 s, 139 MB/s 2024-09-17T03:44:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725076 s, 145 MB/s 2024-09-17T03:44:12.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.923 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656484 s, 160 MB/s 2024-09-17T03:44:12.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756273 s, 139 MB/s 2024-09-17T03:44:12.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667845 s, 157 MB/s 2024-09-17T03:44:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.949 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633989 s, 165 MB/s 2024-09-17T03:44:12.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.958 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740707 s, 142 MB/s 2024-09-17T03:44:12.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.967 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711426 s, 147 MB/s 2024-09-17T03:44:12.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.976 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749556 s, 140 MB/s 2024-09-17T03:44:12.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.984 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659316 s, 159 MB/s 2024-09-17T03:44:12.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:12.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:12.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680815 s, 154 MB/s 2024-09-17T03:44:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668472 s, 157 MB/s 2024-09-17T03:44:13.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.009 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670324 s, 156 MB/s 2024-09-17T03:44:13.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060868 s, 172 MB/s 2024-09-17T03:44:13.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.027 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766736 s, 137 MB/s 2024-09-17T03:44:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.036 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754698 s, 139 MB/s 2024-09-17T03:44:13.044 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.045 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.045 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667062 s, 157 MB/s 2024-09-17T03:44:13.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594283 s, 176 MB/s 2024-09-17T03:44:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667 s, 157 MB/s 2024-09-17T03:44:13.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.069 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698861 s, 150 MB/s 2024-09-17T03:44:13.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601746 s, 174 MB/s 2024-09-17T03:44:13.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.086 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682243 s, 154 MB/s 2024-09-17T03:44:13.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.094 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612024 s, 171 MB/s 2024-09-17T03:44:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670913 s, 156 MB/s 2024-09-17T03:44:13.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.110 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630599 s, 166 MB/s 2024-09-17T03:44:13.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:13.117 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:13.117 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:13.117 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.22 2024-09-17T03:44:13.118 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:13.118 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:13.118 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:13.118 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:13.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777305 s, 135 MB/s 2024-09-17T03:44:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591059 s, 177 MB/s 2024-09-17T03:44:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662772 s, 158 MB/s 2024-09-17T03:44:13.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594442 s, 176 MB/s 2024-09-17T03:44:13.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654525 s, 160 MB/s 2024-09-17T03:44:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625683 s, 168 MB/s 2024-09-17T03:44:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.225 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594996 s, 176 MB/s 2024-09-17T03:44:13.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640032 s, 164 MB/s 2024-09-17T03:44:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728354 s, 144 MB/s 2024-09-17T03:44:13.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066619 s, 157 MB/s 2024-09-17T03:44:13.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.258 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672573 s, 156 MB/s 2024-09-17T03:44:13.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661795 s, 158 MB/s 2024-09-17T03:44:13.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673555 s, 156 MB/s 2024-09-17T03:44:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.284 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747985 s, 140 MB/s 2024-09-17T03:44:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669651 s, 157 MB/s 2024-09-17T03:44:13.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.301 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679966 s, 154 MB/s 2024-09-17T03:44:13.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.309 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650525 s, 161 MB/s 2024-09-17T03:44:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660511 s, 159 MB/s 2024-09-17T03:44:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598974 s, 175 MB/s 2024-09-17T03:44:13.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663419 s, 158 MB/s 2024-09-17T03:44:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686375 s, 153 MB/s 2024-09-17T03:44:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646682 s, 162 MB/s 2024-09-17T03:44:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738629 s, 142 MB/s 2024-09-17T03:44:13.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722645 s, 145 MB/s 2024-09-17T03:44:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.377 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636792 s, 165 MB/s 2024-09-17T03:44:13.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673864 s, 156 MB/s 2024-09-17T03:44:13.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.394 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671222 s, 156 MB/s 2024-09-17T03:44:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590535 s, 178 MB/s 2024-09-17T03:44:13.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.413 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654769 s, 160 MB/s 2024-09-17T03:44:13.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693518 s, 151 MB/s 2024-09-17T03:44:13.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647957 s, 162 MB/s 2024-09-17T03:44:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742306 s, 141 MB/s 2024-09-17T03:44:13.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:13.442 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:13.442 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:13.442 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.23 2024-09-17T03:44:13.442 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:13.442 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:13.442 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:13.442 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:13.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.501 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683937 s, 153 MB/s 2024-09-17T03:44:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623354 s, 168 MB/s 2024-09-17T03:44:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.517 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624018 s, 168 MB/s 2024-09-17T03:44:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682095 s, 154 MB/s 2024-09-17T03:44:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735019 s, 143 MB/s 2024-09-17T03:44:13.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740781 s, 142 MB/s 2024-09-17T03:44:13.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060421 s, 174 MB/s 2024-09-17T03:44:13.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068392 s, 153 MB/s 2024-09-17T03:44:13.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610301 s, 172 MB/s 2024-09-17T03:44:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757986 s, 138 MB/s 2024-09-17T03:44:13.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.586 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635819 s, 165 MB/s 2024-09-17T03:44:13.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.594 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673113 s, 156 MB/s 2024-09-17T03:44:13.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.602 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576483 s, 182 MB/s 2024-09-17T03:44:13.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.609 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579587 s, 181 MB/s 2024-09-17T03:44:13.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.620 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632014 s, 166 MB/s 2024-09-17T03:44:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.627 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718582 s, 146 MB/s 2024-09-17T03:44:13.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660131 s, 159 MB/s 2024-09-17T03:44:13.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.643 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672634 s, 156 MB/s 2024-09-17T03:44:13.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.651 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569724 s, 184 MB/s 2024-09-17T03:44:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.660 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657706 s, 159 MB/s 2024-09-17T03:44:13.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.667 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652556 s, 161 MB/s 2024-09-17T03:44:13.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713778 s, 147 MB/s 2024-09-17T03:44:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.685 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708444 s, 148 MB/s 2024-09-17T03:44:13.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731445 s, 143 MB/s 2024-09-17T03:44:13.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.701 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590515 s, 178 MB/s 2024-09-17T03:44:13.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.710 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634311 s, 165 MB/s 2024-09-17T03:44:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.719 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736605 s, 142 MB/s 2024-09-17T03:44:13.726 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.726 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.727 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594355 s, 176 MB/s 2024-09-17T03:44:13.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.735 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640305 s, 164 MB/s 2024-09-17T03:44:13.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.743 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656771 s, 160 MB/s 2024-09-17T03:44:13.751 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.751 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.751 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060567 s, 173 MB/s 2024-09-17T03:44:13.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687552 s, 153 MB/s 2024-09-17T03:44:13.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:13.766 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:13.766 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:13.766 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.24 2024-09-17T03:44:13.766 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:13.766 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:13.766 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:13.766 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:13.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:13.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578997 s, 181 MB/s 2024-09-17T03:44:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.832 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654219 s, 160 MB/s 2024-09-17T03:44:13.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.840 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666848 s, 157 MB/s 2024-09-17T03:44:13.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660374 s, 159 MB/s 2024-09-17T03:44:13.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.857 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665407 s, 158 MB/s 2024-09-17T03:44:13.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589933 s, 178 MB/s 2024-09-17T03:44:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718629 s, 146 MB/s 2024-09-17T03:44:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594151 s, 176 MB/s 2024-09-17T03:44:13.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640999 s, 164 MB/s 2024-09-17T03:44:13.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750693 s, 140 MB/s 2024-09-17T03:44:13.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.907 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641041 s, 164 MB/s 2024-09-17T03:44:13.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671127 s, 156 MB/s 2024-09-17T03:44:13.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716498 s, 146 MB/s 2024-09-17T03:44:13.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677105 s, 155 MB/s 2024-09-17T03:44:13.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.942 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690815 s, 152 MB/s 2024-09-17T03:44:13.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655304 s, 160 MB/s 2024-09-17T03:44:13.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.958 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064578 s, 162 MB/s 2024-09-17T03:44:13.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645281 s, 162 MB/s 2024-09-17T03:44:13.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.975 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741409 s, 141 MB/s 2024-09-17T03:44:13.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646214 s, 162 MB/s 2024-09-17T03:44:13.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:13.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:13.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695923 s, 151 MB/s 2024-09-17T03:44:14.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.000 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661412 s, 159 MB/s 2024-09-17T03:44:14.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.008 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600506 s, 175 MB/s 2024-09-17T03:44:14.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.015 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591604 s, 177 MB/s 2024-09-17T03:44:14.024 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.024 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.024 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673621 s, 156 MB/s 2024-09-17T03:44:14.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.033 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734141 s, 143 MB/s 2024-09-17T03:44:14.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599282 s, 175 MB/s 2024-09-17T03:44:14.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.050 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584302 s, 179 MB/s 2024-09-17T03:44:14.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.057 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676357 s, 155 MB/s 2024-09-17T03:44:14.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674933 s, 155 MB/s 2024-09-17T03:44:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.073 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599251 s, 175 MB/s 2024-09-17T03:44:14.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.081 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577727 s, 182 MB/s 2024-09-17T03:44:14.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:14.087 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:14.087 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:14.087 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.25 2024-09-17T03:44:14.087 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:14.087 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:14.087 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:14.087 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:14.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:14.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.146 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664483 s, 158 MB/s 2024-09-17T03:44:14.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.153 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579799 s, 181 MB/s 2024-09-17T03:44:14.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690584 s, 152 MB/s 2024-09-17T03:44:14.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.170 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637587 s, 164 MB/s 2024-09-17T03:44:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662455 s, 158 MB/s 2024-09-17T03:44:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748242 s, 140 MB/s 2024-09-17T03:44:14.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.195 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598374 s, 175 MB/s 2024-09-17T03:44:14.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.203 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680238 s, 154 MB/s 2024-09-17T03:44:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634961 s, 165 MB/s 2024-09-17T03:44:14.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.220 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660205 s, 159 MB/s 2024-09-17T03:44:14.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608023 s, 172 MB/s 2024-09-17T03:44:14.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069934 s, 150 MB/s 2024-09-17T03:44:14.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580574 s, 181 MB/s 2024-09-17T03:44:14.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.252 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591037 s, 177 MB/s 2024-09-17T03:44:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.259 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057055 s, 184 MB/s 2024-09-17T03:44:14.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608102 s, 172 MB/s 2024-09-17T03:44:14.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.276 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729587 s, 144 MB/s 2024-09-17T03:44:14.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.285 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686225 s, 153 MB/s 2024-09-17T03:44:14.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.293 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599216 s, 175 MB/s 2024-09-17T03:44:14.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.301 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633829 s, 165 MB/s 2024-09-17T03:44:14.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690784 s, 152 MB/s 2024-09-17T03:44:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.319 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644192 s, 163 MB/s 2024-09-17T03:44:14.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586965 s, 179 MB/s 2024-09-17T03:44:14.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725637 s, 145 MB/s 2024-09-17T03:44:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596019 s, 176 MB/s 2024-09-17T03:44:14.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667104 s, 157 MB/s 2024-09-17T03:44:14.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.360 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724939 s, 145 MB/s 2024-09-17T03:44:14.368 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712171 s, 147 MB/s 2024-09-17T03:44:14.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607242 s, 173 MB/s 2024-09-17T03:44:14.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.384 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063796 s, 164 MB/s 2024-09-17T03:44:14.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679045 s, 154 MB/s 2024-09-17T03:44:14.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651238 s, 161 MB/s 2024-09-17T03:44:14.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:14.408 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:14.408 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:14.408 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.26 2024-09-17T03:44:14.408 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:14.408 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:14.408 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:14.408 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:14.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677431 s, 155 MB/s 2024-09-17T03:44:14.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678385 s, 155 MB/s 2024-09-17T03:44:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626044 s, 167 MB/s 2024-09-17T03:44:14.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.492 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687762 s, 152 MB/s 2024-09-17T03:44:14.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.501 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675283 s, 155 MB/s 2024-09-17T03:44:14.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727074 s, 144 MB/s 2024-09-17T03:44:14.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657064 s, 160 MB/s 2024-09-17T03:44:14.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.526 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685792 s, 153 MB/s 2024-09-17T03:44:14.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.535 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679209 s, 154 MB/s 2024-09-17T03:44:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723451 s, 145 MB/s 2024-09-17T03:44:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.553 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074377 s, 141 MB/s 2024-09-17T03:44:14.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.562 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703966 s, 149 MB/s 2024-09-17T03:44:14.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593418 s, 177 MB/s 2024-09-17T03:44:14.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.578 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644373 s, 163 MB/s 2024-09-17T03:44:14.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.586 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648758 s, 162 MB/s 2024-09-17T03:44:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.594 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625429 s, 168 MB/s 2024-09-17T03:44:14.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.602 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665384 s, 158 MB/s 2024-09-17T03:44:14.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.611 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673496 s, 156 MB/s 2024-09-17T03:44:14.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.620 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730672 s, 144 MB/s 2024-09-17T03:44:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.629 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727242 s, 144 MB/s 2024-09-17T03:44:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726886 s, 144 MB/s 2024-09-17T03:44:14.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.645 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061238 s, 171 MB/s 2024-09-17T03:44:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663384 s, 158 MB/s 2024-09-17T03:44:14.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.663 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727541 s, 144 MB/s 2024-09-17T03:44:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653557 s, 160 MB/s 2024-09-17T03:44:14.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.679 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682001 s, 154 MB/s 2024-09-17T03:44:14.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.688 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667302 s, 157 MB/s 2024-09-17T03:44:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772443 s, 136 MB/s 2024-09-17T03:44:14.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.706 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680381 s, 154 MB/s 2024-09-17T03:44:14.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.714 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658633 s, 159 MB/s 2024-09-17T03:44:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654728 s, 160 MB/s 2024-09-17T03:44:14.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654175 s, 160 MB/s 2024-09-17T03:44:14.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:14.737 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:14.738 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:14.738 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.27 2024-09-17T03:44:14.738 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:14.738 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:14.738 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:14.738 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:14.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626244 s, 167 MB/s 2024-09-17T03:44:14.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.805 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657115 s, 160 MB/s 2024-09-17T03:44:14.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.813 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699147 s, 150 MB/s 2024-09-17T03:44:14.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.822 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674376 s, 155 MB/s 2024-09-17T03:44:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.830 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595926 s, 176 MB/s 2024-09-17T03:44:14.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784702 s, 134 MB/s 2024-09-17T03:44:14.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642728 s, 163 MB/s 2024-09-17T03:44:14.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662192 s, 158 MB/s 2024-09-17T03:44:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646507 s, 162 MB/s 2024-09-17T03:44:14.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073206 s, 143 MB/s 2024-09-17T03:44:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592084 s, 177 MB/s 2024-09-17T03:44:14.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735406 s, 143 MB/s 2024-09-17T03:44:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721657 s, 145 MB/s 2024-09-17T03:44:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732427 s, 143 MB/s 2024-09-17T03:44:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.916 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640322 s, 164 MB/s 2024-09-17T03:44:14.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723862 s, 145 MB/s 2024-09-17T03:44:14.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644462 s, 163 MB/s 2024-09-17T03:44:14.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668824 s, 157 MB/s 2024-09-17T03:44:14.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.949 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646957 s, 162 MB/s 2024-09-17T03:44:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636408 s, 165 MB/s 2024-09-17T03:44:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.965 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606289 s, 173 MB/s 2024-09-17T03:44:14.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.974 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651679 s, 161 MB/s 2024-09-17T03:44:14.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728616 s, 144 MB/s 2024-09-17T03:44:14.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:14.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:14.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815011 s, 129 MB/s 2024-09-17T03:44:15.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.002 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662822 s, 158 MB/s 2024-09-17T03:44:15.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.010 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687662 s, 152 MB/s 2024-09-17T03:44:15.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.019 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691961 s, 152 MB/s 2024-09-17T03:44:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732574 s, 143 MB/s 2024-09-17T03:44:15.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.037 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665919 s, 157 MB/s 2024-09-17T03:44:15.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.046 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693072 s, 151 MB/s 2024-09-17T03:44:15.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.055 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696402 s, 151 MB/s 2024-09-17T03:44:15.063 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.063 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.063 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649037 s, 162 MB/s 2024-09-17T03:44:15.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:15.072 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:15.072 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:15.072 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.28 2024-09-17T03:44:15.072 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:15.072 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:15.073 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:15.073 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:15.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.155 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607141 s, 173 MB/s 2024-09-17T03:44:15.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.163 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696155 s, 151 MB/s 2024-09-17T03:44:15.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731909 s, 143 MB/s 2024-09-17T03:44:15.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.182 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683572 s, 153 MB/s 2024-09-17T03:44:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066414 s, 158 MB/s 2024-09-17T03:44:15.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.199 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656348 s, 160 MB/s 2024-09-17T03:44:15.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.208 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073958 s, 142 MB/s 2024-09-17T03:44:15.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728866 s, 144 MB/s 2024-09-17T03:44:15.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744213 s, 141 MB/s 2024-09-17T03:44:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.236 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649742 s, 161 MB/s 2024-09-17T03:44:15.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597579 s, 175 MB/s 2024-09-17T03:44:15.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007209 s, 145 MB/s 2024-09-17T03:44:15.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720707 s, 145 MB/s 2024-09-17T03:44:15.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650499 s, 161 MB/s 2024-09-17T03:44:15.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719588 s, 146 MB/s 2024-09-17T03:44:15.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729514 s, 144 MB/s 2024-09-17T03:44:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652633 s, 161 MB/s 2024-09-17T03:44:15.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694178 s, 151 MB/s 2024-09-17T03:44:15.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613498 s, 171 MB/s 2024-09-17T03:44:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739079 s, 142 MB/s 2024-09-17T03:44:15.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643318 s, 163 MB/s 2024-09-17T03:44:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.344 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720653 s, 146 MB/s 2024-09-17T03:44:15.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598726 s, 175 MB/s 2024-09-17T03:44:15.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.361 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658622 s, 159 MB/s 2024-09-17T03:44:15.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588642 s, 178 MB/s 2024-09-17T03:44:15.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.377 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604776 s, 173 MB/s 2024-09-17T03:44:15.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647239 s, 162 MB/s 2024-09-17T03:44:15.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.394 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731737 s, 143 MB/s 2024-09-17T03:44:15.402 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.402 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.402 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623229 s, 168 MB/s 2024-09-17T03:44:15.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.410 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625943 s, 168 MB/s 2024-09-17T03:44:15.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579587 s, 181 MB/s 2024-09-17T03:44:15.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657731 s, 159 MB/s 2024-09-17T03:44:15.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:15.433 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:15.433 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:15.433 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.29 2024-09-17T03:44:15.433 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:15.433 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:15.433 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:15.433 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:15.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:15.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.492 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731169 s, 143 MB/s 2024-09-17T03:44:15.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.501 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680462 s, 154 MB/s 2024-09-17T03:44:15.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.510 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725699 s, 144 MB/s 2024-09-17T03:44:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673736 s, 156 MB/s 2024-09-17T03:44:15.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.526 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687298 s, 153 MB/s 2024-09-17T03:44:15.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.535 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645543 s, 162 MB/s 2024-09-17T03:44:15.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615595 s, 170 MB/s 2024-09-17T03:44:15.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.550 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593552 s, 177 MB/s 2024-09-17T03:44:15.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.559 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723262 s, 145 MB/s 2024-09-17T03:44:15.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.568 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648391 s, 162 MB/s 2024-09-17T03:44:15.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.576 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688692 s, 152 MB/s 2024-09-17T03:44:15.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.585 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649016 s, 162 MB/s 2024-09-17T03:44:15.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.593 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066218 s, 158 MB/s 2024-09-17T03:44:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661179 s, 159 MB/s 2024-09-17T03:44:15.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653023 s, 161 MB/s 2024-09-17T03:44:15.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.618 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668859 s, 157 MB/s 2024-09-17T03:44:15.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.627 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695923 s, 151 MB/s 2024-09-17T03:44:15.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066241 s, 158 MB/s 2024-09-17T03:44:15.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.643 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651101 s, 161 MB/s 2024-09-17T03:44:15.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.651 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626357 s, 167 MB/s 2024-09-17T03:44:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592151 s, 177 MB/s 2024-09-17T03:44:15.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.667 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066446 s, 158 MB/s 2024-09-17T03:44:15.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.677 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736744 s, 142 MB/s 2024-09-17T03:44:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648115 s, 162 MB/s 2024-09-17T03:44:15.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073151 s, 143 MB/s 2024-09-17T03:44:15.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.704 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635016 s, 165 MB/s 2024-09-17T03:44:15.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.712 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588995 s, 178 MB/s 2024-09-17T03:44:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663845 s, 158 MB/s 2024-09-17T03:44:15.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.729 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670925 s, 156 MB/s 2024-09-17T03:44:15.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.736 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582401 s, 180 MB/s 2024-09-17T03:44:15.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.745 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591992 s, 177 MB/s 2024-09-17T03:44:15.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.753 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611256 s, 172 MB/s 2024-09-17T03:44:15.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:15.759 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:15.760 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:15.760 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.30 2024-09-17T03:44:15.760 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:15.760 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:15.760 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:15.760 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:15.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:15.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.820 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713567 s, 147 MB/s 2024-09-17T03:44:15.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751749 s, 139 MB/s 2024-09-17T03:44:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.838 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737109 s, 142 MB/s 2024-09-17T03:44:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660109 s, 159 MB/s 2024-09-17T03:44:15.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.855 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608865 s, 172 MB/s 2024-09-17T03:44:15.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698956 s, 150 MB/s 2024-09-17T03:44:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059106 s, 177 MB/s 2024-09-17T03:44:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653234 s, 161 MB/s 2024-09-17T03:44:15.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675832 s, 155 MB/s 2024-09-17T03:44:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.898 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602573 s, 174 MB/s 2024-09-17T03:44:15.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.907 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629134 s, 167 MB/s 2024-09-17T03:44:15.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643226 s, 163 MB/s 2024-09-17T03:44:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728407 s, 144 MB/s 2024-09-17T03:44:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639998 s, 164 MB/s 2024-09-17T03:44:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.942 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626704 s, 167 MB/s 2024-09-17T03:44:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650609 s, 161 MB/s 2024-09-17T03:44:15.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615421 s, 170 MB/s 2024-09-17T03:44:15.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.968 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647112 s, 162 MB/s 2024-09-17T03:44:15.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.977 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727317 s, 144 MB/s 2024-09-17T03:44:15.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.986 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650067 s, 161 MB/s 2024-09-17T03:44:15.995 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:15.995 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:15.995 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716232 s, 146 MB/s 2024-09-17T03:44:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.004 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704333 s, 149 MB/s 2024-09-17T03:44:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578343 s, 181 MB/s 2024-09-17T03:44:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.021 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653924 s, 160 MB/s 2024-09-17T03:44:16.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647082 s, 162 MB/s 2024-09-17T03:44:16.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.037 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641219 s, 164 MB/s 2024-09-17T03:44:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748439 s, 140 MB/s 2024-09-17T03:44:16.056 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.056 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.056 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767541 s, 137 MB/s 2024-09-17T03:44:16.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668039 s, 157 MB/s 2024-09-17T03:44:16.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.079 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648459 s, 162 MB/s 2024-09-17T03:44:16.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.083 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741759 s, 141 MB/s 2024-09-17T03:44:16.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.092 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651746 s, 161 MB/s 2024-09-17T03:44:16.092 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:16.098 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T03:44:16.098 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:16.098 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.31 2024-09-17T03:44:16.098 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2024-09-17T03:44:16.098 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T03:44:16.098 DEBUG:teuthology.orchestra.run.smithi146:> done 2024-09-17T03:44:16.098 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:16.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:16.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.158 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653427 s, 160 MB/s 2024-09-17T03:44:16.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730465 s, 144 MB/s 2024-09-17T03:44:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672079 s, 156 MB/s 2024-09-17T03:44:16.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661652 s, 158 MB/s 2024-09-17T03:44:16.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736637 s, 142 MB/s 2024-09-17T03:44:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057426 s, 183 MB/s 2024-09-17T03:44:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691478 s, 152 MB/s 2024-09-17T03:44:16.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.220 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688636 s, 152 MB/s 2024-09-17T03:44:16.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666289 s, 157 MB/s 2024-09-17T03:44:16.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772276 s, 136 MB/s 2024-09-17T03:44:16.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.247 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634236 s, 165 MB/s 2024-09-17T03:44:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.256 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738846 s, 142 MB/s 2024-09-17T03:44:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658686 s, 159 MB/s 2024-09-17T03:44:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632415 s, 166 MB/s 2024-09-17T03:44:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.282 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581157 s, 180 MB/s 2024-09-17T03:44:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072684 s, 144 MB/s 2024-09-17T03:44:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.299 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621191 s, 169 MB/s 2024-09-17T03:44:16.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.309 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074452 s, 141 MB/s 2024-09-17T03:44:16.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636588 s, 165 MB/s 2024-09-17T03:44:16.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.326 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609465 s, 172 MB/s 2024-09-17T03:44:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642425 s, 163 MB/s 2024-09-17T03:44:16.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.343 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633779 s, 165 MB/s 2024-09-17T03:44:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647198 s, 162 MB/s 2024-09-17T03:44:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598892 s, 175 MB/s 2024-09-17T03:44:16.368 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.368 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.368 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654469 s, 160 MB/s 2024-09-17T03:44:16.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625744 s, 168 MB/s 2024-09-17T03:44:16.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658157 s, 159 MB/s 2024-09-17T03:44:16.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638466 s, 164 MB/s 2024-09-17T03:44:16.402 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.402 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.402 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664598 s, 158 MB/s 2024-09-17T03:44:16.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.410 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578503 s, 181 MB/s 2024-09-17T03:44:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.419 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679111 s, 154 MB/s 2024-09-17T03:44:16.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2024-09-17T03:44:16.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2024-09-17T03:44:16.428 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670953 s, 156 MB/s 2024-09-17T03:44:16.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:16.434 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-09-17T03:44:16.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.551+0000 7ff33cd20640 1 -- 172.21.15.146:0/1012573640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3380b5ce0 msgr2=0x7ff3380b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:16.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.551+0000 7ff33cd20640 1 --2- 172.21.15.146:0/1012573640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3380b5ce0 0x7ff3380b1320 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7ff3380b8440 tx=0x7ff32802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:44:16.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.551+0000 7ff33cd20640 1 -- 172.21.15.146:0/1012573640 shutdown_connections 2024-09-17T03:44:16.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.551+0000 7ff33cd20640 1 --2- 172.21.15.146:0/1012573640 >> v2:172.21.15.179:3300/0 conn(0x7ff3380b5750 0x7ff3380b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:16.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.551+0000 7ff33cd20640 1 --2- 172.21.15.146:0/1012573640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3380b5ce0 0x7ff3380b1320 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:16.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.551+0000 7ff33cd20640 1 -- 172.21.15.146:0/1012573640 >> 172.21.15.146:0/1012573640 conn(0x7ff3380b7b20 msgr2=0x7ff33809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:16.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.551+0000 7ff33cd20640 1 -- 172.21.15.146:0/1012573640 shutdown_connections 2024-09-17T03:44:16.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.551+0000 7ff33cd20640 1 -- 172.21.15.146:0/1012573640 wait complete. 2024-09-17T03:44:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.553+0000 7ff33cd20640 1 Processor -- start 2024-09-17T03:44:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.553+0000 7ff33cd20640 1 -- start start 2024-09-17T03:44:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff33cd20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3380b3b60 0x7ff3381f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff33cd20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3380b5750 0x7ff33809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff33cd20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3380b5ce0 0x7ff3381f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff33cd20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff3380b27b0 con 0x7ff3380b5ce0 2024-09-17T03:44:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff33cd20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff33815dcc0 con 0x7ff3380b3b60 2024-09-17T03:44:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff33cd20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff3380b2930 con 0x7ff3380b5750 2024-09-17T03:44:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff336d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3380b5ce0 0x7ff3381f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff336d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3380b5ce0 0x7ff3381f6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50766/0 (socket says 172.21.15.146:50766) 2024-09-17T03:44:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff336d9d640 1 -- 172.21.15.146:0/3646319189 learned_addr learned my addr 172.21.15.146:0/3646319189 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff33659c640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3380b3b60 0x7ff3381f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff32dd9b640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3380b5750 0x7ff33809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff336d9d640 1 -- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3380b5750 msgr2=0x7ff33809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff336d9d640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3380b5750 0x7ff33809ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff336d9d640 1 -- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3380b3b60 msgr2=0x7ff3381f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:16.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff336d9d640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3380b3b60 0x7ff3381f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff336d9d640 1 -- 172.21.15.146:0/3646319189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3381f47b0 con 0x7ff3380b5ce0 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.555+0000 7ff336d9d640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3380b5ce0 0x7ff3381f6de0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7ff330002230 tx=0x7ff33000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.556+0000 7ff32f7fe640 1 -- 172.21.15.146:0/3646319189 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330003b70 con 0x7ff3380b5ce0 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.556+0000 7ff32f7fe640 1 -- 172.21.15.146:0/3646319189 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff330003d10 con 0x7ff3380b5ce0 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.556+0000 7ff32f7fe640 1 -- 172.21.15.146:0/3646319189 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330005330 con 0x7ff3380b5ce0 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.556+0000 7ff33cd20640 1 -- 172.21.15.146:0/3646319189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff338156e40 con 0x7ff3380b5ce0 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.556+0000 7ff33cd20640 1 -- 172.21.15.146:0/3646319189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff338154480 con 0x7ff3380b5ce0 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.557+0000 7ff33cd20640 1 -- 172.21.15.146:0/3646319189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3380b2de0 con 0x7ff3380b5ce0 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.557+0000 7ff32f7fe640 1 -- 172.21.15.146:0/3646319189 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff3300056e0 con 0x7ff3380b5ce0 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.558+0000 7ff32f7fe640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff318078bc0 0x7ff31807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.558+0000 7ff32f7fe640 1 -- 172.21.15.146:0/3646319189 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7ff33009abf0 con 0x7ff3380b5ce0 2024-09-17T03:44:16.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.558+0000 7ff33659c640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff318078bc0 0x7ff31807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:16.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.559+0000 7ff33659c640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff318078bc0 0x7ff31807b0d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff328033000 tx=0x7ff328004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:16.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.562+0000 7ff32f7fe640 1 -- 172.21.15.146:0/3646319189 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff3381f47b0 con 0x7ff3380b5ce0 2024-09-17T03:44:16.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:16.774+0000 7ff33cd20640 1 -- 172.21.15.146:0/3646319189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7ff338156bd0 con 0x7ff3380b5ce0 2024-09-17T03:44:17.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.042+0000 7ff32f7fe640 1 -- 172.21.15.146:0/3646319189 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v126) ==== 105+0+0 (secure 0 0 0) 0x7ff3380b3f70 con 0x7ff3380b5ce0 2024-09-17T03:44:17.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 -- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff318078bc0 msgr2=0x7ff31807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:17.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff318078bc0 0x7ff31807b0d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff328033000 tx=0x7ff328004730 comp rx=0 tx=0).stop 2024-09-17T03:44:17.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 -- 172.21.15.146:0/3646319189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3380b5ce0 msgr2=0x7ff3381f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:17.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3380b5ce0 0x7ff3381f6de0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7ff330002230 tx=0x7ff33000cb90 comp rx=0 tx=0).stop 2024-09-17T03:44:17.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 -- 172.21.15.146:0/3646319189 shutdown_connections 2024-09-17T03:44:17.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff318078bc0 0x7ff31807b0d0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:17.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3380b5ce0 0x7ff3381f6de0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:17.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3380b5750 0x7ff33809ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:17.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 --2- 172.21.15.146:0/3646319189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3380b3b60 0x7ff3381f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:17.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 -- 172.21.15.146:0/3646319189 >> 172.21.15.146:0/3646319189 conn(0x7ff3380b7b20 msgr2=0x7ff3380b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:17.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 -- 172.21.15.146:0/3646319189 shutdown_connections 2024-09-17T03:44:17.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.045+0000 7ff33cd20640 1 -- 172.21.15.146:0/3646319189 wait complete. 2024-09-17T03:44:17.056 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-17T03:44:17.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.172+0000 7fb16dbc3640 1 -- 172.21.15.146:0/2409485344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680b3b60 msgr2=0x7fb16815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:17.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.172+0000 7fb16dbc3640 1 --2- 172.21.15.146:0/2409485344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680b3b60 0x7fb16815caa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb160005fd0 tx=0x7fb16002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:44:17.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.173+0000 7fb16dbc3640 1 -- 172.21.15.146:0/2409485344 shutdown_connections 2024-09-17T03:44:17.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.173+0000 7fb16dbc3640 1 --2- 172.21.15.146:0/2409485344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680b3b60 0x7fb16815caa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:17.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.173+0000 7fb16dbc3640 1 --2- 172.21.15.146:0/2409485344 >> v2:172.21.15.179:3300/0 conn(0x7fb1680b5750 0x7fb1680b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:17.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.173+0000 7fb16dbc3640 1 -- 172.21.15.146:0/2409485344 >> 172.21.15.146:0/2409485344 conn(0x7fb1680b7b20 msgr2=0x7fb16809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:17.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.173+0000 7fb16dbc3640 1 -- 172.21.15.146:0/2409485344 shutdown_connections 2024-09-17T03:44:17.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.173+0000 7fb16dbc3640 1 -- 172.21.15.146:0/2409485344 wait complete. 2024-09-17T03:44:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.174+0000 7fb16dbc3640 1 Processor -- start 2024-09-17T03:44:17.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.175+0000 7fb16dbc3640 1 -- start start 2024-09-17T03:44:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb16dbc3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1680b3b60 0x7fb1681565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb16dbc3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680b5750 0x7fb1680c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb16dbc3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1680b5ce0 0x7fb16809d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb16dbc3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb16815d4b0 con 0x7fb1680b3b60 2024-09-17T03:44:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb16dbc3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb16815d330 con 0x7fb1680b5ce0 2024-09-17T03:44:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb16dbc3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb16815d630 con 0x7fb1680b5750 2024-09-17T03:44:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb1677fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1680b3b60 0x7fb1681565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb1677fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1680b3b60 0x7fb1681565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49710/0 (socket says 172.21.15.146:49710) 2024-09-17T03:44:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb1677fe640 1 -- 172.21.15.146:0/4252700210 learned_addr learned my addr 172.21.15.146:0/4252700210 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb166ffd640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680b5750 0x7fb1680c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb167fff640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1680b5ce0 0x7fb16809d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb1677fe640 1 -- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680b5750 msgr2=0x7fb1680c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb1677fe640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680b5750 0x7fb1680c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb1677fe640 1 -- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1680b5ce0 msgr2=0x7fb16809d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb1677fe640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1680b5ce0 0x7fb16809d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb1677fe640 1 -- 172.21.15.146:0/4252700210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1680d28d0 con 0x7fb1680b3b60 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb167fff640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1680b5ce0 0x7fb16809d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.176+0000 7fb1677fe640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1680b3b60 0x7fb1681565b0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7fb15800c730 tx=0x7fb15800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.177+0000 7fb15ffff640 1 -- 172.21.15.146:0/4252700210 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb158016020 con 0x7fb1680b3b60 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.177+0000 7fb15ffff640 1 -- 172.21.15.146:0/4252700210 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb15800a950 con 0x7fb1680b3b60 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.177+0000 7fb16dbc3640 1 -- 172.21.15.146:0/4252700210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16809c7d0 con 0x7fb1680b3b60 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.177+0000 7fb15ffff640 1 -- 172.21.15.146:0/4252700210 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15800ada0 con 0x7fb1680b3b60 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.177+0000 7fb16dbc3640 1 -- 172.21.15.146:0/4252700210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16809cd90 con 0x7fb1680b3b60 2024-09-17T03:44:17.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.178+0000 7fb16dbc3640 1 -- 172.21.15.146:0/4252700210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16815dae0 con 0x7fb1680b3b60 2024-09-17T03:44:17.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.178+0000 7fb15ffff640 1 -- 172.21.15.146:0/4252700210 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb158019020 con 0x7fb1680b3b60 2024-09-17T03:44:17.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.179+0000 7fb15ffff640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb148078b90 0x7fb14807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:17.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.179+0000 7fb15ffff640 1 -- 172.21.15.146:0/4252700210 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fb15809a950 con 0x7fb1680b3b60 2024-09-17T03:44:17.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.179+0000 7fb166ffd640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb148078b90 0x7fb14807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:17.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.180+0000 7fb166ffd640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb148078b90 0x7fb14807b0a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb16809e3f0 tx=0x7fb150005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.184+0000 7fb15ffff640 1 -- 172.21.15.146:0/4252700210 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb158020030 con 0x7fb1680b3b60 2024-09-17T03:44:17.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:17.396+0000 7fb16dbc3640 1 -- 172.21.15.146:0/4252700210 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fb16815fd00 con 0x7fb1680b3b60 2024-09-17T03:44:18.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.056+0000 7fb15ffff640 1 -- 172.21.15.146:0/4252700210 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v127) ==== 121+0+0 (secure 0 0 0) 0x7fb1680b3f70 con 0x7fb1680b3b60 2024-09-17T03:44:18.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 -- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb148078b90 msgr2=0x7fb14807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb148078b90 0x7fb14807b0a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb16809e3f0 tx=0x7fb150005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:18.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 -- 172.21.15.146:0/4252700210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1680b3b60 msgr2=0x7fb1681565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1680b3b60 0x7fb1681565b0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7fb15800c730 tx=0x7fb15800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 -- 172.21.15.146:0/4252700210 shutdown_connections 2024-09-17T03:44:18.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb148078b90 0x7fb14807b0a0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1680b5ce0 0x7fb16809d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb1680b5750 0x7fb1680c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 --2- 172.21.15.146:0/4252700210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1680b3b60 0x7fb1681565b0 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 -- 172.21.15.146:0/4252700210 >> 172.21.15.146:0/4252700210 conn(0x7fb1680b7b20 msgr2=0x7fb16809bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:18.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 -- 172.21.15.146:0/4252700210 shutdown_connections 2024-09-17T03:44:18.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.059+0000 7fb16dbc3640 1 -- 172.21.15.146:0/4252700210 wait complete. 2024-09-17T03:44:18.072 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:44:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.189+0000 7fd2b455e640 1 -- 172.21.15.146:0/3184209631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0b4530 msgr2=0x7fd2ac0b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.189+0000 7fd2b455e640 1 --2- 172.21.15.146:0/3184209631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0b4530 0x7fd2ac0b4940 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fd29c005fd0 tx=0x7fd29c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.189+0000 7fd2b455e640 1 -- 172.21.15.146:0/3184209631 shutdown_connections 2024-09-17T03:44:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.189+0000 7fd2b455e640 1 --2- 172.21.15.146:0/3184209631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2ac06dd60 0x7fd2ac06e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.189+0000 7fd2b455e640 1 --2- 172.21.15.146:0/3184209631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0b4530 0x7fd2ac0b4940 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.189+0000 7fd2b455e640 1 -- 172.21.15.146:0/3184209631 >> 172.21.15.146:0/3184209631 conn(0x7fd2ac0b3410 msgr2=0x7fd2ac0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.189+0000 7fd2b455e640 1 -- 172.21.15.146:0/3184209631 shutdown_connections 2024-09-17T03:44:18.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.189+0000 7fd2b455e640 1 -- 172.21.15.146:0/3184209631 wait complete. 2024-09-17T03:44:18.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.191+0000 7fd2b455e640 1 Processor -- start 2024-09-17T03:44:18.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.191+0000 7fd2b455e640 1 -- start start 2024-09-17T03:44:18.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.192+0000 7fd2b455e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2ac06dd60 0x7fd2ac1f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.192+0000 7fd2b455e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2ac0b4530 0x7fd2ac13d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.192+0000 7fd2b455e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0b55f0 0x7fd2ac154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.192+0000 7fd2b455e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac15be90 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.192+0000 7fd2b455e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac15bd10 con 0x7fd2ac0b4530 2024-09-17T03:44:18.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.192+0000 7fd2b455e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac15c010 con 0x7fd2ac06dd60 2024-09-17T03:44:18.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b2afb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0b55f0 0x7fd2ac154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b2afb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0b55f0 0x7fd2ac154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49738/0 (socket says 172.21.15.146:49738) 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b2afb640 1 -- 172.21.15.146:0/2364420299 learned_addr learned my addr 172.21.15.146:0/2364420299 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b1af9640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2ac0b4530 0x7fd2ac13d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b22fa640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2ac06dd60 0x7fd2ac1f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b2afb640 1 -- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2ac06dd60 msgr2=0x7fd2ac1f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b2afb640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2ac06dd60 0x7fd2ac1f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b2afb640 1 -- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2ac0b4530 msgr2=0x7fd2ac13d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b2afb640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2ac0b4530 0x7fd2ac13d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b2afb640 1 -- 172.21.15.146:0/2364420299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac1f6480 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b2afb640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0b55f0 0x7fd2ac154ca0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400e990 tx=0x7fd2a400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2a2ffd640 1 -- 172.21.15.146:0/2364420299 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4004d20 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2a2ffd640 1 -- 172.21.15.146:0/2364420299 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2a400caa0 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b455e640 1 -- 172.21.15.146:0/2364420299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ac1f6760 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2a2ffd640 1 -- 172.21.15.146:0/2364420299 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4005020 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.193+0000 7fd2b455e640 1 -- 172.21.15.146:0/2364420299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ac1f26a0 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.194+0000 7fd2b455e640 1 -- 172.21.15.146:0/2364420299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ac06e170 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.195+0000 7fd2a2ffd640 1 -- 172.21.15.146:0/2364420299 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd2a40051c0 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.195+0000 7fd2a2ffd640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd290078b90 0x7fd29007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.195+0000 7fd2a2ffd640 1 -- 172.21.15.146:0/2364420299 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fd2a409b600 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.196+0000 7fd2b22fa640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd290078b90 0x7fd29007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.196+0000 7fd2b22fa640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd290078b90 0x7fd29007b0a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80016c0 tx=0x7fd2a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:18.199 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.200+0000 7fd2a2ffd640 1 -- 172.21.15.146:0/2364420299 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd2a4016030 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.408+0000 7fd2b455e640 1 -- 172.21.15.146:0/2364420299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2ac1f6210 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.408+0000 7fd2a2ffd640 1 -- 172.21.15.146:0/2364420299 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) ==== 95+0+5252 (secure 0 0 0) 0x7fd2a40633f0 con 0x7fd2ac0b55f0 2024-09-17T03:44:18.408 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:18.408 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"btime":"2024-09-17T03:44:18:062384+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2920792926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2920792926},{"type":"v1","addr":"172.21.15.179:6837","nonce":2920792926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8917,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/154430395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":154430395},{"type":"v1","addr":"172.21.15.179:6836","nonce":154430395}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":128,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T03:43:54.003090+0000","modified":"2024-09-17T03:44:18.062369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10242":{"gid":10242,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/465040613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":465040613},{"type":"v1","addr":"172.21.15.146:6833","nonce":465040613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10251":{"gid":10251,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3868966088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868966088},{"type":"v1","addr":"172.21.15.146:6835","nonce":3868966088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10251,"qdb_cluster":[10251]},"id":12}]} 2024-09-17T03:44:18.409 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2024-09-17T03:44:18.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 -- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd290078b90 msgr2=0x7fd29007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd290078b90 0x7fd29007b0a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80016c0 tx=0x7fd2a8009040 comp rx=0 tx=0).stop 2024-09-17T03:44:18.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 -- 172.21.15.146:0/2364420299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0b55f0 msgr2=0x7fd2ac154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0b55f0 0x7fd2ac154ca0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400e990 tx=0x7fd2a400ee50 comp rx=0 tx=0).stop 2024-09-17T03:44:18.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 -- 172.21.15.146:0/2364420299 shutdown_connections 2024-09-17T03:44:18.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd290078b90 0x7fd29007b0a0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2ac0b55f0 0x7fd2ac154ca0 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2ac0b4530 0x7fd2ac13d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 --2- 172.21.15.146:0/2364420299 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd2ac06dd60 0x7fd2ac1f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 -- 172.21.15.146:0/2364420299 >> 172.21.15.146:0/2364420299 conn(0x7fd2ac0b3410 msgr2=0x7fd2ac15e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:18.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 -- 172.21.15.146:0/2364420299 shutdown_connections 2024-09-17T03:44:18.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.411+0000 7fd2b455e640 1 -- 172.21.15.146:0/2364420299 wait complete. 2024-09-17T03:44:18.824 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 128, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-17T03:43:54.003090+0000', 'modified': '2024-09-17T03:44:18.062369+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10242': {'gid': 10242, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.146:6833/465040613', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 465040613}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 465040613}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_10251': {'gid': 10251, 'name': 'a', 'rank': 0, 'incarnation': 122, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/3868966088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 3868966088}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3868966088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10251, 'qdb_cluster': [10251]} 2024-09-17T03:44:18.824 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:44:18.824 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:44:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.941+0000 7f9ebdee6640 1 -- 172.21.15.146:0/427085336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb80b3870 msgr2=0x7f9eb80cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.941+0000 7f9ebdee6640 1 --2- 172.21.15.146:0/427085336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb80b3870 0x7f9eb80cf370 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009830 tx=0x7f9ea002a480 comp rx=0 tx=0).stop 2024-09-17T03:44:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.941+0000 7f9ebdee6640 1 -- 172.21.15.146:0/427085336 shutdown_connections 2024-09-17T03:44:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.941+0000 7f9ebdee6640 1 --2- 172.21.15.146:0/427085336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb806f440 0x7f9eb80d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.941+0000 7f9ebdee6640 1 --2- 172.21.15.146:0/427085336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb80b3870 0x7f9eb80cf370 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.941+0000 7f9ebdee6640 1 -- 172.21.15.146:0/427085336 >> 172.21.15.146:0/427085336 conn(0x7f9eb80d4be0 msgr2=0x7f9eb80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.941+0000 7f9ebdee6640 1 -- 172.21.15.146:0/427085336 shutdown_connections 2024-09-17T03:44:18.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.941+0000 7f9ebdee6640 1 -- 172.21.15.146:0/427085336 wait complete. 2024-09-17T03:44:18.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.943+0000 7f9ebdee6640 1 Processor -- start 2024-09-17T03:44:18.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.943+0000 7f9ebdee6640 1 -- start start 2024-09-17T03:44:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9ebdee6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb80b3870 0x7f9eb814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9ebdee6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb81620f0 0x7f9eb81f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9ebdee6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb81f6520 0x7f9eb80b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9ebdee6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb80d3a90 con 0x7f9eb80b3870 2024-09-17T03:44:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9ebdee6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb80d3910 con 0x7f9eb81620f0 2024-09-17T03:44:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9ebdee6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb80d3c10 con 0x7f9eb81f6520 2024-09-17T03:44:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb80b3870 0x7f9eb814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb80b3870 0x7f9eb814eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49758/0 (socket says 172.21.15.146:49758) 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eb77fe640 1 -- 172.21.15.146:0/4017077331 learned_addr learned my addr 172.21.15.146:0/4017077331 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eb7fff640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb81f6520 0x7f9eb80b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eb77fe640 1 -- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb81f6520 msgr2=0x7f9eb80b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eb77fe640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb81f6520 0x7f9eb80b6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eb77fe640 1 -- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb81620f0 msgr2=0x7f9eb81f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eb77fe640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb81620f0 0x7f9eb81f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eb77fe640 1 -- 172.21.15.146:0/4017077331 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb815d2e0 con 0x7f9eb80b3870 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eb77fe640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb80b3870 0x7f9eb814eba0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0000c00 tx=0x7f9ea0033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eaffff640 1 -- 172.21.15.146:0/4017077331 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0031d60 con 0x7f9eb80b3870 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eaffff640 1 -- 172.21.15.146:0/4017077331 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ea00330d0 con 0x7f9eb80b3870 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9ebdee6640 1 -- 172.21.15.146:0/4017077331 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb81f9a70 con 0x7f9eb80b3870 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9eaffff640 1 -- 172.21.15.146:0/4017077331 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0033520 con 0x7f9eb80b3870 2024-09-17T03:44:18.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.945+0000 7f9ebdee6640 1 -- 172.21.15.146:0/4017077331 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb81f5a40 con 0x7f9eb80b3870 2024-09-17T03:44:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.947+0000 7f9eaffff640 1 -- 172.21.15.146:0/4017077331 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ea00035f0 con 0x7f9eb80b3870 2024-09-17T03:44:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.948+0000 7f9eaffff640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e98078bc0 0x7f9e9807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.948+0000 7f9eaffff640 1 -- 172.21.15.146:0/4017077331 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f9ea00bc2f0 con 0x7f9eb80b3870 2024-09-17T03:44:18.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.948+0000 7f9eb6ffd640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e98078bc0 0x7f9e9807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.949+0000 7f9eb6ffd640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e98078bc0 0x7f9e9807b0d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8000f60 tx=0x7f9ea8007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.949+0000 7f9ec4e54740 1 Processor -- start 2024-09-17T03:44:18.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.949+0000 7f9ec4e54740 1 -- start start 2024-09-17T03:44:18.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.950+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da23270 0x56547ddf4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.950+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547ddf54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.950+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da02590 0x56547de123e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.950+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56547dd3d820 con 0x56547d9fa3b0 2024-09-17T03:44:18.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.950+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56547dd2cc50 con 0x56547da02590 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.950+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56547dd30a60 con 0x56547da23270 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.950+0000 7f9eb6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547ddf54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.950+0000 7f9eb6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547ddf54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49770/0 (socket says 172.21.15.146:49770) 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.950+0000 7f9eb6ffd640 1 -- 172.21.15.146:0/2791121043 learned_addr learned my addr 172.21.15.146:0/2791121043 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.950+0000 7f9eb77fe640 1 --2- 172.21.15.146:0/2791121043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da23270 0x56547ddf4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.950+0000 7f9eb7fff640 1 --2- 172.21.15.146:0/2791121043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da02590 0x56547de123e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.951+0000 7f9eb6ffd640 1 -- 172.21.15.146:0/2791121043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da23270 msgr2=0x56547ddf4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.951+0000 7f9eb6ffd640 1 --2- 172.21.15.146:0/2791121043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da23270 0x56547ddf4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.951+0000 7f9eb6ffd640 1 -- 172.21.15.146:0/2791121043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da02590 msgr2=0x56547de123e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.951+0000 7f9eb6ffd640 1 --2- 172.21.15.146:0/2791121043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da02590 0x56547de123e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.951+0000 7f9eb6ffd640 1 -- 172.21.15.146:0/2791121043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56547da8e850 con 0x56547d9fa3b0 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.951+0000 7f9eb6ffd640 1 --2- 172.21.15.146:0/2791121043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547ddf54e0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8016860 tx=0x7f9ea800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fafa87aac28672 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:18.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.951+0000 7f9ead7fa640 1 -- 172.21.15.146:0/2791121043 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8024070 con 0x56547d9fa3b0 2024-09-17T03:44:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.951+0000 7f9ead7fa640 1 -- 172.21.15.146:0/2791121043 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ea80162e0 con 0x56547d9fa3b0 2024-09-17T03:44:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.951+0000 7f9ead7fa640 1 -- 172.21.15.146:0/2791121043 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8013b10 con 0x56547d9fa3b0 2024-09-17T03:44:18.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.952+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2791121043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 msgr2=0x56547ddf54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.952+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/2791121043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547ddf54e0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8016860 tx=0x7f9ea800f000 comp rx=0 tx=0).stop 2024-09-17T03:44:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.952+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2791121043 shutdown_connections 2024-09-17T03:44:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.952+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/2791121043 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da02590 0x56547de123e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.952+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/2791121043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547ddf54e0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.952+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/2791121043 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da23270 0x56547ddf4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.952+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2791121043 >> 172.21.15.146:0/2791121043 conn(0x56547da173c0 msgr2=0x56547ddcb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.952+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2791121043 shutdown_connections 2024-09-17T03:44:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.952+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2791121043 wait complete. 2024-09-17T03:44:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.953+0000 7f9ec4e54740 1 -- start start 2024-09-17T03:44:18.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.953+0000 7f9ec4e54740 1 Processor -- start 2024-09-17T03:44:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.954+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547d9fa3b0 0x56547dde33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.954+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da02590 0x56547de08f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.954+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da23270 0x56547de12310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.954+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56547da9d620 con 0x56547da02590 2024-09-17T03:44:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.954+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56547dcd25f0 con 0x56547d9fa3b0 2024-09-17T03:44:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.954+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56547ddf5a20 con 0x56547da23270 2024-09-17T03:44:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.954+0000 7f9ec4e54740 10 client.0 _ll_register_callbacks cb 0x56547dcd60a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:18.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.954+0000 7f9eb6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da02590 0x56547de08f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.954+0000 7f9eb6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da02590 0x56547de08f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49778/0 (socket says 172.21.15.146:49778) 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.954+0000 7f9eb6ffd640 1 -- 172.21.15.146:0/961471936 learned_addr learned my addr 172.21.15.146:0/961471936 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9eb7fff640 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da23270 0x56547de12310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9eb77fe640 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547d9fa3b0 0x56547dde33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9eb6ffd640 1 -- 172.21.15.146:0/961471936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da23270 msgr2=0x56547de12310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9eb6ffd640 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da23270 0x56547de12310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9eb6ffd640 1 -- 172.21.15.146:0/961471936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547d9fa3b0 msgr2=0x56547dde33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9eb6ffd640 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547d9fa3b0 0x56547dde33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9eb6ffd640 1 -- 172.21.15.146:0/961471936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56547db056b0 con 0x56547da02590 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9eb77fe640 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547d9fa3b0 0x56547dde33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9eb6ffd640 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da02590 0x56547de08f70 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x56547ddcce30 tx=0x7f9ea8005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e4047302338e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:18.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9e967fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9e967fc640 1 -- 172.21.15.146:0/961471936 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea802c020 con 0x56547da02590 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9e967fc640 1 -- 172.21.15.146:0/961471936 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f9ea80138b0 con 0x56547da02590 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9ec4e54740 1 -- 172.21.15.146:0/961471936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ea80162e0 con 0x56547da02590 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9e967fc640 1 -- 172.21.15.146:0/961471936 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7f9ea8033050 con 0x56547da02590 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9ec4e54740 10 client.10455 fetch_fsmap learned FSMap version 128 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9ec4e54740 1 -- 172.21.15.146:0/961471936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x56547de09ae0 con 0x56547da02590 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.955+0000 7f9e967fc640 1 -- 172.21.15.146:0/961471936 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ea80162e0 con 0x56547da02590 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.956+0000 7f9e967fc640 1 -- 172.21.15.146:0/961471936 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) ==== 3490+0+0 (secure 0 0 0) 0x7f9ea8036020 con 0x56547da02590 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.956+0000 7f9ec4e54740 10 client.10455 fetch_fsmap finished waiting for FSMap version 128 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.956+0000 7f9ec4e54740 10 client.10455 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.956+0000 7f9ec4e54740 20 client.10455 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.956+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56547d9e1e40 0x56547dded2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.956+0000 7f9ec4e54740 4 client.10455 mds_command: new command op to 10251 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:44:18.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.956+0000 7f9ec4e54740 1 -- 172.21.15.146:0/961471936 --> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56547dd3f770 con 0x56547d9e1e40 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.956+0000 7f9eb77fe640 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56547d9e1e40 0x56547dded2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.956+0000 7f9eb77fe640 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56547d9e1e40 0x56547dded2d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cfee528f0f3f0e6 server_cookie=714053b5276f8dbb in_seq=0 out_seq=0 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.956+0000 7f9e967fc640 10 client.10455 ms_handle_connect on v2:172.21.15.146:6834/3868966088 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9e967fc640 1 -- 172.21.15.146:0/961471936 <== mds.0 v2:172.21.15.146:6834/3868966088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56547dd3f770 con 0x56547d9e1e40 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9e967fc640 10 client.10455 handle_command_reply: tid=0 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 1 client.10455 shutdown 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 1 -- 172.21.15.146:0/961471936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da02590 msgr2=0x56547de08f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da02590 0x56547de08f70 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x56547ddcce30 tx=0x7f9ea8005630 comp rx=0 tx=0).stop 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 1 -- 172.21.15.146:0/961471936 shutdown_connections 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56547d9e1e40 0x56547dded2d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da23270 0x56547de12310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9e967fc640 0 client.10455 ms_handle_reset on v2:172.21.15.146:6834/3868966088 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da02590 0x56547de08f70 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/961471936 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547d9fa3b0 0x56547dde33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 1 -- 172.21.15.146:0/961471936 >> 172.21.15.146:0/961471936 conn(0x56547da173c0 msgr2=0x56547dde4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 1 -- 172.21.15.146:0/961471936 shutdown_connections 2024-09-17T03:44:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 1 -- 172.21.15.146:0/961471936 wait complete. 2024-09-17T03:44:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.957+0000 7f9ec4e54740 20 client.10455 trim_cache size 0 max 16384 2024-09-17T03:44:18.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.975+0000 7f9ec4e54740 1 Processor -- start 2024-09-17T03:44:18.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.975+0000 7f9ec4e54740 1 -- start start 2024-09-17T03:44:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.976+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547d9fa3b0 0x56547de060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.976+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da02590 0x56547ddf2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.976+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da23270 0x56547ddf3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.976+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb82021f0 con 0x56547da23270 2024-09-17T03:44:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.976+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb80cbc50 con 0x56547da02590 2024-09-17T03:44:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.976+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb80cc2a0 con 0x56547d9fa3b0 2024-09-17T03:44:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eb7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da23270 0x56547ddf3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eb7fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da23270 0x56547ddf3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49780/0 (socket says 172.21.15.146:49780) 2024-09-17T03:44:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eb7fff640 1 -- 172.21.15.146:0/439666693 learned_addr learned my addr 172.21.15.146:0/439666693 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eb7fff640 1 -- 172.21.15.146:0/439666693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547d9fa3b0 msgr2=0x56547de060a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eb7fff640 1 --2- 172.21.15.146:0/439666693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547d9fa3b0 0x56547de060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eb7fff640 1 -- 172.21.15.146:0/439666693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da02590 msgr2=0x56547ddf2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:18.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eb7fff640 1 --2- 172.21.15.146:0/439666693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da02590 0x56547ddf2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eb7fff640 1 -- 172.21.15.146:0/439666693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56547de09f50 con 0x56547da23270 2024-09-17T03:44:18.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eb7fff640 1 --2- 172.21.15.146:0/439666693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da23270 0x56547ddf3110 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000be70 tx=0x7f9eb0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c56a6a388533b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:18.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eacff9640 1 -- 172.21.15.146:0/439666693 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb001b420 con 0x56547da23270 2024-09-17T03:44:18.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eacff9640 1 -- 172.21.15.146:0/439666693 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9eb001b5c0 con 0x56547da23270 2024-09-17T03:44:18.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.977+0000 7f9eacff9640 1 -- 172.21.15.146:0/439666693 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb001b9d0 con 0x56547da23270 2024-09-17T03:44:18.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.978+0000 7f9ec4e54740 1 -- 172.21.15.146:0/439666693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da23270 msgr2=0x56547ddf3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.978+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/439666693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da23270 0x56547ddf3110 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000be70 tx=0x7f9eb0011810 comp rx=0 tx=0).stop 2024-09-17T03:44:18.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.978+0000 7f9ec4e54740 1 -- 172.21.15.146:0/439666693 shutdown_connections 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.978+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/439666693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547da23270 0x56547ddf3110 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.978+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/439666693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da02590 0x56547ddf2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.978+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/439666693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547d9fa3b0 0x56547de060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.978+0000 7f9ec4e54740 1 -- 172.21.15.146:0/439666693 >> 172.21.15.146:0/439666693 conn(0x56547da173c0 msgr2=0x56547de11f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.978+0000 7f9ec4e54740 1 -- 172.21.15.146:0/439666693 shutdown_connections 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.978+0000 7f9ec4e54740 1 -- 172.21.15.146:0/439666693 wait complete. 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.979+0000 7f9ec4e54740 1 -- start start 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.979+0000 7f9ec4e54740 1 Processor -- start 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.980+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547de75180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.980+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da02590 0x56547ddf4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.980+0000 7f9ec4e54740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da23270 0x56547ddf54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.980+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x56547dde3920 con 0x56547d9fa3b0 2024-09-17T03:44:18.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.980+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56547de08a40 con 0x56547da23270 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.980+0000 7f9ec4e54740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56547ddee4f0 con 0x56547da02590 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.980+0000 7f9ec4e54740 10 client.0 _ll_register_callbacks cb 0x7f9ea8022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.980+0000 7f9eb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547de75180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.980+0000 7f9eb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547de75180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49794/0 (socket says 172.21.15.146:49794) 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.980+0000 7f9eb77fe640 1 -- 172.21.15.146:0/2609516687 learned_addr learned my addr 172.21.15.146:0/2609516687 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9eb6ffd640 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da02590 0x56547ddf4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9eb7fff640 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da23270 0x56547ddf54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9eb77fe640 1 -- 172.21.15.146:0/2609516687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da02590 msgr2=0x56547ddf4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9eb77fe640 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da02590 0x56547ddf4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9eb77fe640 1 -- 172.21.15.146:0/2609516687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da23270 msgr2=0x56547ddf54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9eb77fe640 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da23270 0x56547ddf54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9eb77fe640 1 -- 172.21.15.146:0/2609516687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56547de937e0 con 0x56547d9fa3b0 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9eb77fe640 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547de75180 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0084070 tx=0x7f9ea0080730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ddb3267cc4cd62 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:18.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9e967fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9e967fc640 1 -- 172.21.15.146:0/2609516687 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea008da50 con 0x56547d9fa3b0 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9e967fc640 1 -- 172.21.15.146:0/2609516687 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f9ea00336c0 con 0x56547d9fa3b0 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2609516687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb001b5c0 con 0x56547d9fa3b0 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9e967fc640 1 -- 172.21.15.146:0/2609516687 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7f9ea0080350 con 0x56547d9fa3b0 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9ec4e54740 10 client.10461 fetch_fsmap learned FSMap version 128 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2609516687 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x56547ddecd70 con 0x56547d9fa3b0 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9e967fc640 1 -- 172.21.15.146:0/2609516687 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9eb001b5c0 con 0x56547d9fa3b0 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9e967fc640 1 -- 172.21.15.146:0/2609516687 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) ==== 3490+0+0 (secure 0 0 0) 0x7f9ea004b030 con 0x56547d9fa3b0 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9ec4e54740 10 client.10461 fetch_fsmap finished waiting for FSMap version 128 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9ec4e54740 10 client.10461 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.981+0000 7f9ec4e54740 20 client.10461 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56547de32110 0x56547de8f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:18.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 4 client.10461 mds_command: new command op to 10251 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2609516687 --> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] -- command(tid 0: {"prefix": "status"}) -- 0x56547dd3b220 con 0x56547de32110 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9eb6ffd640 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56547de32110 0x56547de8f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9e967fc640 10 client.10461 ms_handle_connect on v2:172.21.15.146:6834/3868966088 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9eb6ffd640 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56547de32110 0x56547de8f3b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94ae59e1b2670562 server_cookie=f58582344a3c4ea8 in_seq=0 out_seq=0 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9e967fc640 1 -- 172.21.15.146:0/2609516687 <== mds.0 v2:172.21.15.146:6834/3868966088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x56547dd3b220 con 0x56547de32110 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9e967fc640 10 client.10461 handle_command_reply: tid=0 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 client.10461 shutdown 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2609516687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 msgr2=0x56547de75180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547de75180 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0084070 tx=0x7f9ea0080730 comp rx=0 tx=0).stop 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2609516687 shutdown_connections 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.146:6834/3868966088,v1:172.21.15.146:6835/3868966088] conn(0x56547de32110 0x56547de8f3b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56547da23270 0x56547ddf54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9e967fc640 0 client.10461 ms_handle_reset on v2:172.21.15.146:6834/3868966088 2024-09-17T03:44:18.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56547da02590 0x56547ddf4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 --2- 172.21.15.146:0/2609516687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56547d9fa3b0 0x56547de75180 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2609516687 >> 172.21.15.146:0/2609516687 conn(0x56547da173c0 msgr2=0x56547de11f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:18.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2609516687 shutdown_connections 2024-09-17T03:44:18.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.982+0000 7f9ec4e54740 1 -- 172.21.15.146:0/2609516687 wait complete. 2024-09-17T03:44:18.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ec4e54740 20 client.10461 trim_cache size 0 max 16384 2024-09-17T03:44:18.988 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:44:18.988 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:44:18.988 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:44:18.988 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 10251, 2024-09-17T03:44:18.989 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:44:18.989 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:44:18.989 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:44:18.989 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 24.325829084999999, 2024-09-17T03:44:18.989 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 128, 2024-09-17T03:44:18.989 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 165, 2024-09-17T03:44:18.989 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 165, 2024-09-17T03:44:18.989 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 29.018193118999999 2024-09-17T03:44:18.989 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:44:18.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 -- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e98078bc0 msgr2=0x7f9e9807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e98078bc0 0x7f9e9807b0d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8000f60 tx=0x7f9ea8007a50 comp rx=0 tx=0).stop 2024-09-17T03:44:18.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 -- 172.21.15.146:0/4017077331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb80b3870 msgr2=0x7f9eb814eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:18.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb80b3870 0x7f9eb814eba0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0000c00 tx=0x7f9ea0033d60 comp rx=0 tx=0).stop 2024-09-17T03:44:18.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 -- 172.21.15.146:0/4017077331 shutdown_connections 2024-09-17T03:44:18.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e98078bc0 0x7f9e9807b0d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb81f6520 0x7f9eb80b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb81620f0 0x7f9eb81f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 --2- 172.21.15.146:0/4017077331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb80b3870 0x7f9eb814eba0 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:18.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 -- 172.21.15.146:0/4017077331 >> 172.21.15.146:0/4017077331 conn(0x7f9eb80d4be0 msgr2=0x7f9eb815dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:18.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 -- 172.21.15.146:0/4017077331 shutdown_connections 2024-09-17T03:44:18.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:18.983+0000 7f9ebdee6640 1 -- 172.21.15.146:0/4017077331 wait complete. 2024-09-17T03:44:18.993 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub start /scrub_control_test_path recursive 2024-09-17T03:44:19.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.112+0000 7f2f98664640 1 -- 172.21.15.146:0/1306682514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f7c004800 msgr2=0x7f2f7c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.112+0000 7f2f98664640 1 --2- 172.21.15.146:0/1306682514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f7c004800 0x7f2f7c004c50 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f2f800017d0 tx=0x7f2f7c005830 comp rx=0 tx=0).stop 2024-09-17T03:44:19.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.112+0000 7f2f96c01640 1 -- 172.21.15.146:0/1306682514 reap_dead start 2024-09-17T03:44:19.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.112+0000 7f2f98664640 1 -- 172.21.15.146:0/1306682514 shutdown_connections 2024-09-17T03:44:19.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.112+0000 7f2f98664640 1 -- 172.21.15.146:0/1306682514 >> 172.21.15.146:0/1306682514 conn(0x7f2f900b7b20 msgr2=0x7f2f9009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.112+0000 7f2f98664640 1 -- 172.21.15.146:0/1306682514 shutdown_connections 2024-09-17T03:44:19.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.112+0000 7f2f98664640 1 -- 172.21.15.146:0/1306682514 wait complete. 2024-09-17T03:44:19.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.114+0000 7f2f98664640 1 Processor -- start 2024-09-17T03:44:19.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.114+0000 7f2f98664640 1 -- start start 2024-09-17T03:44:19.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.115+0000 7f2f98664640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f7c004800 0x7f2f901487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.115+0000 7f2f98664640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f90158670 0x7f2f9009e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.115+0000 7f2f98664640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f90158a80 0x7f2f9009e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.115+0000 7f2f98664640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9006e750 con 0x7f2f90158a80 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.115+0000 7f2f98664640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2f900b7680 con 0x7f2f7c004800 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.115+0000 7f2f98664640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2f90167cc0 con 0x7f2f90158670 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f96c01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f90158a80 0x7f2f9009e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f96c01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f90158a80 0x7f2f9009e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49820/0 (socket says 172.21.15.146:49820) 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f96c01640 1 -- 172.21.15.146:0/423350890 learned_addr learned my addr 172.21.15.146:0/423350890 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f95bff640 1 --2- 172.21.15.146:0/423350890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f90158670 0x7f2f9009e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f96400640 1 --2- 172.21.15.146:0/423350890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f7c004800 0x7f2f901487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f96c01640 1 -- 172.21.15.146:0/423350890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f90158670 msgr2=0x7f2f9009e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f96c01640 1 --2- 172.21.15.146:0/423350890 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f90158670 0x7f2f9009e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f96c01640 1 -- 172.21.15.146:0/423350890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f7c004800 msgr2=0x7f2f901487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f96c01640 1 --2- 172.21.15.146:0/423350890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f7c004800 0x7f2f901487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f96c01640 1 -- 172.21.15.146:0/423350890 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9009d4a0 con 0x7f2f90158a80 2024-09-17T03:44:19.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f96c01640 1 --2- 172.21.15.146:0/423350890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f90158a80 0x7f2f9009e9d0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f2f90074450 tx=0x7f2f88011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f86ffd640 1 -- 172.21.15.146:0/423350890 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800f8f0 con 0x7f2f90158a80 2024-09-17T03:44:19.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f86ffd640 1 -- 172.21.15.146:0/423350890 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f8800fab0 con 0x7f2f90158a80 2024-09-17T03:44:19.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f98664640 1 -- 172.21.15.146:0/423350890 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9009d780 con 0x7f2f90158a80 2024-09-17T03:44:19.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f86ffd640 1 -- 172.21.15.146:0/423350890 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88005020 con 0x7f2f90158a80 2024-09-17T03:44:19.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.116+0000 7f2f98664640 1 -- 172.21.15.146:0/423350890 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f90156070 con 0x7f2f90158a80 2024-09-17T03:44:19.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.118+0000 7f2f86ffd640 1 -- 172.21.15.146:0/423350890 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f880051c0 con 0x7f2f90158a80 2024-09-17T03:44:19.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.119+0000 7f2f86ffd640 1 --2- 172.21.15.146:0/423350890 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f74078bc0 0x7f2f7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.119+0000 7f2f86ffd640 1 -- 172.21.15.146:0/423350890 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f2f8809b4a0 con 0x7f2f90158a80 2024-09-17T03:44:19.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.119+0000 7f2f96400640 1 --2- 172.21.15.146:0/423350890 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f74078bc0 0x7f2f7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.119 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.119+0000 7f2f96400640 1 --2- 172.21.15.146:0/423350890 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f74078bc0 0x7f2f7407b0d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c002230 tx=0x7f2f8c006f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.120+0000 7f2f9f5cf740 1 Processor -- start 2024-09-17T03:44:19.120 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.120+0000 7f2f9f5cf740 1 -- start start 2024-09-17T03:44:19.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56474d0 0x55f1c5a349a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c561e610 0x55f1c5a097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c56267f0 0x55f1c5a09d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f1c5961a30 con 0x55f1c561e610 2024-09-17T03:44:19.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f1c5950e60 con 0x55f1c56267f0 2024-09-17T03:44:19.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f1c5954c70 con 0x55f1c56474d0 2024-09-17T03:44:19.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f95bff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c561e610 0x55f1c5a097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f95bff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c561e610 0x55f1c5a097f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49830/0 (socket says 172.21.15.146:49830) 2024-09-17T03:44:19.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f95bff640 1 -- 172.21.15.146:0/4237624244 learned_addr learned my addr 172.21.15.146:0/4237624244 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f96400640 1 --2- 172.21.15.146:0/4237624244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56474d0 0x55f1c5a349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f96c01640 1 --2- 172.21.15.146:0/4237624244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c56267f0 0x55f1c5a09d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f95bff640 1 -- 172.21.15.146:0/4237624244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56474d0 msgr2=0x55f1c5a349a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f95bff640 1 --2- 172.21.15.146:0/4237624244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56474d0 0x55f1c5a349a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f95bff640 1 -- 172.21.15.146:0/4237624244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c56267f0 msgr2=0x55f1c5a09d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f95bff640 1 --2- 172.21.15.146:0/4237624244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c56267f0 0x55f1c5a09d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.121+0000 7f2f95bff640 1 -- 172.21.15.146:0/4237624244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1c58f7190 con 0x55f1c561e610 2024-09-17T03:44:19.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.122+0000 7f2f95bff640 1 --2- 172.21.15.146:0/4237624244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c561e610 0x55f1c5a097f0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f2f800018f0 tx=0x7f2f800012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fece3c8b33ec85 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.122+0000 7f2f73fff640 1 -- 172.21.15.146:0/4237624244 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80006360 con 0x55f1c561e610 2024-09-17T03:44:19.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.122+0000 7f2f73fff640 1 -- 172.21.15.146:0/4237624244 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f80044070 con 0x55f1c561e610 2024-09-17T03:44:19.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.122+0000 7f2f73fff640 1 -- 172.21.15.146:0/4237624244 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80003830 con 0x55f1c561e610 2024-09-17T03:44:19.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.123+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4237624244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c561e610 msgr2=0x55f1c5a097f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.123+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/4237624244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c561e610 0x55f1c5a097f0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f2f800018f0 tx=0x7f2f800012f0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.123+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4237624244 shutdown_connections 2024-09-17T03:44:19.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.123+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/4237624244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c56267f0 0x55f1c5a09d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.123+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/4237624244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c561e610 0x55f1c5a097f0 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.123+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/4237624244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56474d0 0x55f1c5a349a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.123+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4237624244 >> 172.21.15.146:0/4237624244 conn(0x55f1c563b620 msgr2=0x55f1c59efc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.123+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4237624244 shutdown_connections 2024-09-17T03:44:19.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.123+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4237624244 wait complete. 2024-09-17T03:44:19.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.124+0000 7f2f9f5cf740 1 -- start start 2024-09-17T03:44:19.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.124+0000 7f2f9f5cf740 1 Processor -- start 2024-09-17T03:44:19.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c561e610 0x55f1c5a2a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56267f0 0x55f1c5a198d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a33980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f1c56c1880 con 0x55f1c56474d0 2024-09-17T03:44:19.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f1c58d75a0 con 0x55f1c561e610 2024-09-17T03:44:19.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f1c5a07870 con 0x55f1c56267f0 2024-09-17T03:44:19.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f9f5cf740 10 client.0 _ll_register_callbacks cb 0x55f1c5905a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:19.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f96c01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a33980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f96c01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a33980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49838/0 (socket says 172.21.15.146:49838) 2024-09-17T03:44:19.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f96c01640 1 -- 172.21.15.146:0/4060611543 learned_addr learned my addr 172.21.15.146:0/4060611543 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f95bff640 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56267f0 0x55f1c5a198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.125+0000 7f2f96400640 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c561e610 0x55f1c5a2a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f96c01640 1 -- 172.21.15.146:0/4060611543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56267f0 msgr2=0x55f1c5a198d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f96c01640 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56267f0 0x55f1c5a198d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f96c01640 1 -- 172.21.15.146:0/4060611543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c561e610 msgr2=0x55f1c5a2a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f96c01640 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c561e610 0x55f1c5a2a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f96c01640 1 -- 172.21.15.146:0/4060611543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1c572b940 con 0x55f1c56474d0 2024-09-17T03:44:19.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f96400640 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c561e610 0x55f1c5a2a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:19.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f96c01640 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a33980 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f2f88062ef0 tx=0x7f2f88062d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3eb2759f751875 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f717fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:19.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f717fa640 1 -- 172.21.15.146:0/4060611543 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88067c20 con 0x55f1c56474d0 2024-09-17T03:44:19.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f717fa640 1 -- 172.21.15.146:0/4060611543 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f2f88062450 con 0x55f1c56474d0 2024-09-17T03:44:19.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4060611543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f1c5927420 con 0x55f1c56474d0 2024-09-17T03:44:19.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f717fa640 1 -- 172.21.15.146:0/4060611543 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7f2f8806cb60 con 0x55f1c56474d0 2024-09-17T03:44:19.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f9f5cf740 10 client.10473 fetch_fsmap learned FSMap version 128 2024-09-17T03:44:19.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4060611543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x55f1c578c0d0 con 0x55f1c56474d0 2024-09-17T03:44:19.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f717fa640 1 -- 172.21.15.146:0/4060611543 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f1c5927420 con 0x55f1c56474d0 2024-09-17T03:44:19.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f717fa640 1 -- 172.21.15.146:0/4060611543 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) ==== 3490+0+0 (secure 0 0 0) 0x7f2f8807a020 con 0x55f1c56474d0 2024-09-17T03:44:19.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f9f5cf740 10 client.10473 fetch_fsmap finished waiting for FSMap version 128 2024-09-17T03:44:19.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f9f5cf740 10 client.10473 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:44:19.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f9f5cf740 20 client.10473 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:19.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55f1c56062b0 0x55f1c5a2ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f9f5cf740 4 client.10473 mds_command: new command op to 10242 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:44:19.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.126+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4060611543 --> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1c5963980 con 0x55f1c56062b0 2024-09-17T03:44:19.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.127+0000 7f2f96400640 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55f1c56062b0 0x55f1c5a2ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.127+0000 7f2f717fa640 10 client.10473 ms_handle_connect on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.127+0000 7f2f96400640 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55f1c56062b0 0x55f1c5a2ff30 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10242 client_cookie=f10b3585e9a4d41f server_cookie=571515aef6323182 in_seq=0 out_seq=0 2024-09-17T03:44:19.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f717fa640 1 -- 172.21.15.146:0/4060611543 <== mds.10242 v2:172.21.15.146:6832/465040613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1c5963980 con 0x55f1c56062b0 2024-09-17T03:44:19.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f717fa640 10 client.10473 handle_command_reply: tid=0 2024-09-17T03:44:19.139 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 1 client.10473 shutdown 2024-09-17T03:44:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4060611543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 msgr2=0x55f1c5a33980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a33980 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f2f88062ef0 tx=0x7f2f88062d00 comp rx=0 tx=0).stop 2024-09-17T03:44:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4060611543 shutdown_connections 2024-09-17T03:44:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55f1c56062b0 0x55f1c5a2ff30 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a33980 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56267f0 0x55f1c5a198d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/4060611543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c561e610 0x55f1c5a2a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f717fa640 0 client.10473 ms_handle_reset on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4060611543 >> 172.21.15.146:0/4060611543 conn(0x55f1c563b620 msgr2=0x55f1c59ea9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4060611543 shutdown_connections 2024-09-17T03:44:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/4060611543 wait complete. 2024-09-17T03:44:19.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.128+0000 7f2f9f5cf740 20 client.10473 trim_cache size 0 max 16384 2024-09-17T03:44:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.146+0000 7f2f9f5cf740 1 Processor -- start 2024-09-17T03:44:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.146+0000 7f2f9f5cf740 1 -- start start 2024-09-17T03:44:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.147+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c561e610 0x55f1c5a2a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.147+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56267f0 0x55f1c5a19620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.147+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a19b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.147+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f90202690 con 0x55f1c56474d0 2024-09-17T03:44:19.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.147+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2f90157260 con 0x55f1c561e610 2024-09-17T03:44:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.147+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2f90201090 con 0x55f1c56267f0 2024-09-17T03:44:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.147+0000 7f2f96c01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a19b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.147+0000 7f2f96c01640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a19b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49852/0 (socket says 172.21.15.146:49852) 2024-09-17T03:44:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.147+0000 7f2f96c01640 1 -- 172.21.15.146:0/1063892344 learned_addr learned my addr 172.21.15.146:0/1063892344 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.148+0000 7f2f96c01640 1 -- 172.21.15.146:0/1063892344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56267f0 msgr2=0x55f1c5a19620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.148+0000 7f2f96c01640 1 --2- 172.21.15.146:0/1063892344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56267f0 0x55f1c5a19620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.148+0000 7f2f96c01640 1 -- 172.21.15.146:0/1063892344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c561e610 msgr2=0x55f1c5a2a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.148+0000 7f2f96c01640 1 --2- 172.21.15.146:0/1063892344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c561e610 0x55f1c5a2a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.148+0000 7f2f96c01640 1 -- 172.21.15.146:0/1063892344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1c56907e0 con 0x55f1c56474d0 2024-09-17T03:44:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.148+0000 7f2f96c01640 1 --2- 172.21.15.146:0/1063892344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a19b60 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f2f88005c20 tx=0x7f2f88062b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68f67c1a7901320 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.148+0000 7f2f737fe640 1 -- 172.21.15.146:0/1063892344 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88067c20 con 0x55f1c56474d0 2024-09-17T03:44:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.148+0000 7f2f737fe640 1 -- 172.21.15.146:0/1063892344 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f88062450 con 0x55f1c56474d0 2024-09-17T03:44:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.148+0000 7f2f737fe640 1 -- 172.21.15.146:0/1063892344 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8804ade0 con 0x55f1c56474d0 2024-09-17T03:44:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.149+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/1063892344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 msgr2=0x55f1c5a19b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.149+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/1063892344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a19b60 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f2f88005c20 tx=0x7f2f88062b60 comp rx=0 tx=0).stop 2024-09-17T03:44:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.149+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/1063892344 shutdown_connections 2024-09-17T03:44:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.149+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/1063892344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56474d0 0x55f1c5a19b60 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.149+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/1063892344 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c56267f0 0x55f1c5a19620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.149+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/1063892344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c561e610 0x55f1c5a2a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.149+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/1063892344 >> 172.21.15.146:0/1063892344 conn(0x55f1c563b620 msgr2=0x55f1c5a349a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.149+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/1063892344 shutdown_connections 2024-09-17T03:44:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.149+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/1063892344 wait complete. 2024-09-17T03:44:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.150+0000 7f2f9f5cf740 1 -- start start 2024-09-17T03:44:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.150+0000 7f2f9f5cf740 1 Processor -- start 2024-09-17T03:44:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c561e610 0x55f1c5a17740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56267f0 0x55f1c5a19810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f9f5cf740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c56474d0 0x55f1c5ab2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f1c5a07600 con 0x55f1c56267f0 2024-09-17T03:44:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f1c5a18d30 con 0x55f1c56474d0 2024-09-17T03:44:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f9f5cf740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f1c5a06870 con 0x55f1c561e610 2024-09-17T03:44:19.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f9f5cf740 10 client.0 _ll_register_callbacks cb 0x7f2f88062fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:19.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f95bff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56267f0 0x55f1c5a19810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f95bff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56267f0 0x55f1c5a19810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49856/0 (socket says 172.21.15.146:49856) 2024-09-17T03:44:19.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f95bff640 1 -- 172.21.15.146:0/3464629445 learned_addr learned my addr 172.21.15.146:0/3464629445 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f96c01640 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c56474d0 0x55f1c5ab2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.151+0000 7f2f96400640 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c561e610 0x55f1c5a17740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f95bff640 1 -- 172.21.15.146:0/3464629445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c561e610 msgr2=0x55f1c5a17740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f95bff640 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c561e610 0x55f1c5a17740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f95bff640 1 -- 172.21.15.146:0/3464629445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c56474d0 msgr2=0x55f1c5ab2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f95bff640 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c56474d0 0x55f1c5ab2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f95bff640 1 -- 172.21.15.146:0/3464629445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1c591dfb0 con 0x55f1c56267f0 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f95bff640 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56267f0 0x55f1c5a19810 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f2f800017a0 tx=0x7f2f80001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a75632337ab3626 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f717fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f717fa640 1 -- 172.21.15.146:0/3464629445 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80057060 con 0x55f1c56267f0 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f717fa640 1 -- 172.21.15.146:0/3464629445 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f2f800035f0 con 0x55f1c56267f0 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/3464629445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f88062450 con 0x55f1c56267f0 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f717fa640 1 -- 172.21.15.146:0/3464629445 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7f2f800037f0 con 0x55f1c56267f0 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f9f5cf740 10 client.10479 fetch_fsmap learned FSMap version 128 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/3464629445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x55f1c5a57250 con 0x55f1c56267f0 2024-09-17T03:44:19.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f717fa640 1 -- 172.21.15.146:0/3464629445 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f88062450 con 0x55f1c56267f0 2024-09-17T03:44:19.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f717fa640 1 -- 172.21.15.146:0/3464629445 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) ==== 3490+0+0 (secure 0 0 0) 0x7f2f8003e070 con 0x55f1c56267f0 2024-09-17T03:44:19.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f9f5cf740 10 client.10479 fetch_fsmap finished waiting for FSMap version 128 2024-09-17T03:44:19.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f9f5cf740 10 client.10479 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:44:19.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f9f5cf740 20 client.10479 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:19.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55f1c5a296b0 0x55f1c5a561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.152+0000 7f2f9f5cf740 4 client.10479 mds_command: new command op to 10242 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-17T03:44:19.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.153+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/3464629445 --> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55f1c595f430 con 0x55f1c5a296b0 2024-09-17T03:44:19.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.153+0000 7f2f96400640 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55f1c5a296b0 0x55f1c5a561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.153+0000 7f2f717fa640 10 client.10479 ms_handle_connect on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.153+0000 7f2f96400640 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55f1c5a296b0 0x55f1c5a561d0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10242 client_cookie=cd0b3561019173da server_cookie=a47c914e4a5fa075 in_seq=0 out_seq=0 2024-09-17T03:44:19.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.153+0000 7f2f717fa640 1 -- 172.21.15.146:0/3464629445 <== mds.10242 v2:172.21.15.146:6832/465040613 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55f1c595f430 con 0x55f1c5a296b0 2024-09-17T03:44:19.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.153+0000 7f2f717fa640 10 client.10479 handle_command_reply: tid=0 2024-09-17T03:44:19.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.153+0000 7f2f9f5cf740 1 client.10479 shutdown 2024-09-17T03:44:19.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.153+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/3464629445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56267f0 msgr2=0x55f1c5a19810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.153+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56267f0 0x55f1c5a19810 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f2f800017a0 tx=0x7f2f80001170 comp rx=0 tx=0).stop 2024-09-17T03:44:19.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.154+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/3464629445 shutdown_connections 2024-09-17T03:44:19.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.154+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55f1c5a296b0 0x55f1c5a561d0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.154+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f1c56474d0 0x55f1c5ab2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.154+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f1c56267f0 0x55f1c5a19810 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.154+0000 7f2f717fa640 0 client.10479 ms_handle_reset on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.154+0000 7f2f9f5cf740 1 --2- 172.21.15.146:0/3464629445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f1c561e610 0x55f1c5a17740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.154+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/3464629445 >> 172.21.15.146:0/3464629445 conn(0x55f1c563b620 msgr2=0x55f1c5a349a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.154+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/3464629445 shutdown_connections 2024-09-17T03:44:19.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.154+0000 7f2f9f5cf740 1 -- 172.21.15.146:0/3464629445 wait complete. 2024-09-17T03:44:19.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.154+0000 7f2f9f5cf740 20 client.10479 trim_cache size 0 max 16384 2024-09-17T03:44:19.163 INFO:teuthology.orchestra.run.smithi146.stderr:Error EINVAL: MDS is not active 2024-09-17T03:44:19.164 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T03:44:19.164 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub pause 2024-09-17T03:44:19.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.281+0000 7fec2b463640 1 -- 172.21.15.146:0/366184490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2406f270 msgr2=0x7fec241628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.281+0000 7fec2b463640 1 --2- 172.21.15.146:0/366184490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2406f270 0x7fec241628a0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fec2408d2b0 tx=0x7fec1c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.282+0000 7fec2b463640 1 -- 172.21.15.146:0/366184490 shutdown_connections 2024-09-17T03:44:19.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.282+0000 7fec2b463640 1 --2- 172.21.15.146:0/366184490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2406f270 0x7fec241628a0 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.282+0000 7fec2b463640 1 --2- 172.21.15.146:0/366184490 >> v2:172.21.15.179:3300/0 conn(0x7fec241620f0 0x7fec2406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.282+0000 7fec2b463640 1 --2- 172.21.15.146:0/366184490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b3870 0x7fec240cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.282+0000 7fec2b463640 1 -- 172.21.15.146:0/366184490 >> 172.21.15.146:0/366184490 conn(0x7fec240d4be0 msgr2=0x7fec240d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.282+0000 7fec2b463640 1 -- 172.21.15.146:0/366184490 shutdown_connections 2024-09-17T03:44:19.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.282+0000 7fec2b463640 1 -- 172.21.15.146:0/366184490 wait complete. 2024-09-17T03:44:19.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.284+0000 7fec2b463640 1 Processor -- start 2024-09-17T03:44:19.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.284+0000 7fec2b463640 1 -- start start 2024-09-17T03:44:19.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec2b463640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2406f270 0x7fec241fa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec2b463640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b3870 0x7fec24157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec2b463640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec241620f0 0x7fec240cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec2b463640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fec24163170 con 0x7fec2406f270 2024-09-17T03:44:19.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec2b463640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec24162ff0 con 0x7fec241620f0 2024-09-17T03:44:19.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec2b463640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fec241632f0 con 0x7fec240b3870 2024-09-17T03:44:19.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec291ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2406f270 0x7fec241fa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec291ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2406f270 0x7fec241fa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49884/0 (socket says 172.21.15.146:49884) 2024-09-17T03:44:19.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec291ff640 1 -- 172.21.15.146:0/3803724645 learned_addr learned my addr 172.21.15.146:0/3803724645 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec289fe640 1 --2- 172.21.15.146:0/3803724645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b3870 0x7fec24157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec29a00640 1 --2- 172.21.15.146:0/3803724645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec241620f0 0x7fec240cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec291ff640 1 -- 172.21.15.146:0/3803724645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b3870 msgr2=0x7fec24157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec291ff640 1 --2- 172.21.15.146:0/3803724645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec240b3870 0x7fec24157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec291ff640 1 -- 172.21.15.146:0/3803724645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec241620f0 msgr2=0x7fec240cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec291ff640 1 --2- 172.21.15.146:0/3803724645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec241620f0 0x7fec240cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec291ff640 1 -- 172.21.15.146:0/3803724645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec240cb8a0 con 0x7fec2406f270 2024-09-17T03:44:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.285+0000 7fec291ff640 1 --2- 172.21.15.146:0/3803724645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2406f270 0x7fec241fa0d0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fec1400eb30 tx=0x7fec1400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.286+0000 7fec21ffb640 1 -- 172.21.15.146:0/3803724645 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14004b20 con 0x7fec2406f270 2024-09-17T03:44:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.286+0000 7fec2b463640 1 -- 172.21.15.146:0/3803724645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec241f64f0 con 0x7fec2406f270 2024-09-17T03:44:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.286+0000 7fec21ffb640 1 -- 172.21.15.146:0/3803724645 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec14004ce0 con 0x7fec2406f270 2024-09-17T03:44:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.286+0000 7fec21ffb640 1 -- 172.21.15.146:0/3803724645 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14005280 con 0x7fec2406f270 2024-09-17T03:44:19.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.286+0000 7fec2b463640 1 -- 172.21.15.146:0/3803724645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec241f6ab0 con 0x7fec2406f270 2024-09-17T03:44:19.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.288+0000 7fec21ffb640 1 -- 172.21.15.146:0/3803724645 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec14005420 con 0x7fec2406f270 2024-09-17T03:44:19.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.288+0000 7fec21ffb640 1 --2- 172.21.15.146:0/3803724645 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec10078b90 0x7fec1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.289+0000 7fec21ffb640 1 -- 172.21.15.146:0/3803724645 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fec1409bb00 con 0x7fec2406f270 2024-09-17T03:44:19.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.289+0000 7fec289fe640 1 --2- 172.21.15.146:0/3803724645 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec10078b90 0x7fec1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.289+0000 7fec289fe640 1 --2- 172.21.15.146:0/3803724645 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec10078b90 0x7fec1007b0a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fec240cde40 tx=0x7fec18005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.289+0000 7fec323d3740 1 Processor -- start 2024-09-17T03:44:19.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.289+0000 7fec323d3740 1 -- start start 2024-09-17T03:44:19.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec323d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab12a0c0 0x55d1ab518ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec323d3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab101200 0x55d1ab4fb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec323d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab1093e0 0x55d1ab4fbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec323d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d1ab444c60 con 0x55d1ab1093e0 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec323d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d1ab434090 con 0x55d1ab12a0c0 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec323d3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d1ab437ea0 con 0x55d1ab101200 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec29a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab1093e0 0x55d1ab4fbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec29a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab1093e0 0x55d1ab4fbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49894/0 (socket says 172.21.15.146:49894) 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec29a00640 1 -- 172.21.15.146:0/301100339 learned_addr learned my addr 172.21.15.146:0/301100339 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec291ff640 1 --2- 172.21.15.146:0/301100339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab12a0c0 0x55d1ab518ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec289fe640 1 --2- 172.21.15.146:0/301100339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab101200 0x55d1ab4fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec29a00640 1 -- 172.21.15.146:0/301100339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab101200 msgr2=0x55d1ab4fb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec29a00640 1 --2- 172.21.15.146:0/301100339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab101200 0x55d1ab4fb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec29a00640 1 -- 172.21.15.146:0/301100339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab12a0c0 msgr2=0x55d1ab518ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec29a00640 1 --2- 172.21.15.146:0/301100339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab12a0c0 0x55d1ab518ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec29a00640 1 -- 172.21.15.146:0/301100339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ab126120 con 0x55d1ab1093e0 2024-09-17T03:44:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.291+0000 7fec29a00640 1 --2- 172.21.15.146:0/301100339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab1093e0 0x55d1ab4fbeb0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fec1c02aac0 tx=0x7fec1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81905a5051f35b91 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec0affd640 1 -- 172.21.15.146:0/301100339 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c040070 con 0x55d1ab1093e0 2024-09-17T03:44:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec0affd640 1 -- 172.21.15.146:0/301100339 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec1c004040 con 0x55d1ab1093e0 2024-09-17T03:44:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec0affd640 1 -- 172.21.15.146:0/301100339 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c035040 con 0x55d1ab1093e0 2024-09-17T03:44:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec323d3740 1 -- 172.21.15.146:0/301100339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab1093e0 msgr2=0x55d1ab4fbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec323d3740 1 --2- 172.21.15.146:0/301100339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab1093e0 0x55d1ab4fbeb0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fec1c02aac0 tx=0x7fec1c0046c0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec323d3740 1 -- 172.21.15.146:0/301100339 shutdown_connections 2024-09-17T03:44:19.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec323d3740 1 --2- 172.21.15.146:0/301100339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab1093e0 0x55d1ab4fbeb0 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec323d3740 1 --2- 172.21.15.146:0/301100339 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab101200 0x55d1ab4fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec323d3740 1 --2- 172.21.15.146:0/301100339 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab12a0c0 0x55d1ab518ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec323d3740 1 -- 172.21.15.146:0/301100339 >> 172.21.15.146:0/301100339 conn(0x55d1ab11e210 msgr2=0x55d1ab4d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec323d3740 1 -- 172.21.15.146:0/301100339 shutdown_connections 2024-09-17T03:44:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.292+0000 7fec323d3740 1 -- 172.21.15.146:0/301100339 wait complete. 2024-09-17T03:44:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.293+0000 7fec323d3740 1 -- start start 2024-09-17T03:44:19.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.293+0000 7fec323d3740 1 Processor -- start 2024-09-17T03:44:19.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec323d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab101200 0x55d1ab512180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec323d3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab510d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec323d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab526200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec323d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d1ab1a4470 con 0x55d1ab12a0c0 2024-09-17T03:44:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec323d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d1ab3ba410 con 0x55d1ab101200 2024-09-17T03:44:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec323d3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d1ab511830 con 0x55d1ab1093e0 2024-09-17T03:44:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec323d3740 10 client.0 _ll_register_callbacks cb 0x55d1ab42d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec29a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab526200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec291ff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab101200 0x55d1ab512180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec29a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab526200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49900/0 (socket says 172.21.15.146:49900) 2024-09-17T03:44:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec29a00640 1 -- 172.21.15.146:0/1852592983 learned_addr learned my addr 172.21.15.146:0/1852592983 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec289fe640 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab510d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec29a00640 1 -- 172.21.15.146:0/1852592983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 msgr2=0x55d1ab510d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec29a00640 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab510d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec29a00640 1 -- 172.21.15.146:0/1852592983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab101200 msgr2=0x55d1ab512180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec29a00640 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab101200 0x55d1ab512180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec29a00640 1 -- 172.21.15.146:0/1852592983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1ab20c500 con 0x55d1ab12a0c0 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.295+0000 7fec291ff640 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab101200 0x55d1ab512180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec29a00640 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab526200 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0099c0 tx=0x7fec1c004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920ce163cf11b443 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec03fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec03fff640 1 -- 172.21.15.146:0/1852592983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c04d060 con 0x55d1ab12a0c0 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec03fff640 1 -- 172.21.15.146:0/1852592983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fec1c003800 con 0x55d1ab12a0c0 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec323d3740 1 -- 172.21.15.146:0/1852592983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec1c004040 con 0x55d1ab12a0c0 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec03fff640 1 -- 172.21.15.146:0/1852592983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7fec1c053050 con 0x55d1ab12a0c0 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec323d3740 10 client.10491 fetch_fsmap learned FSMap version 128 2024-09-17T03:44:19.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec323d3740 1 -- 172.21.15.146:0/1852592983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x55d1ab26cc90 con 0x55d1ab12a0c0 2024-09-17T03:44:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec03fff640 1 -- 172.21.15.146:0/1852592983 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec1c004040 con 0x55d1ab12a0c0 2024-09-17T03:44:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec03fff640 1 -- 172.21.15.146:0/1852592983 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) ==== 3490+0+0 (secure 0 0 0) 0x7fec1c056020 con 0x55d1ab12a0c0 2024-09-17T03:44:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec323d3740 10 client.10491 fetch_fsmap finished waiting for FSMap version 128 2024-09-17T03:44:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec323d3740 10 client.10491 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:44:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec323d3740 20 client.10491 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:19.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec323d3740 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55d1ab0e8ea0 0x55d1ab528e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec323d3740 4 client.10491 mds_command: new command op to 10242 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec323d3740 1 -- 172.21.15.146:0/1852592983 --> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1ab446bb0 con 0x55d1ab0e8ea0 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.296+0000 7fec291ff640 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55d1ab0e8ea0 0x55d1ab528e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.297+0000 7fec03fff640 10 client.10491 ms_handle_connect on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.297+0000 7fec291ff640 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55d1ab0e8ea0 0x55d1ab528e70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10242 client_cookie=48e612f84e37b50f server_cookie=3d21bbb4eecea353 in_seq=0 out_seq=0 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.297+0000 7fec03fff640 1 -- 172.21.15.146:0/1852592983 <== mds.10242 v2:172.21.15.146:6832/465040613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1ab446bb0 con 0x55d1ab0e8ea0 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.297+0000 7fec03fff640 10 client.10491 handle_command_reply: tid=0 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.297+0000 7fec323d3740 1 client.10491 shutdown 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec323d3740 1 -- 172.21.15.146:0/1852592983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 msgr2=0x55d1ab526200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec323d3740 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab526200 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0099c0 tx=0x7fec1c004420 comp rx=0 tx=0).stop 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec323d3740 1 -- 172.21.15.146:0/1852592983 shutdown_connections 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec323d3740 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55d1ab0e8ea0 0x55d1ab528e70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec323d3740 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab526200 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec03fff640 0 client.10491 ms_handle_reset on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec323d3740 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab510d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec323d3740 1 --2- 172.21.15.146:0/1852592983 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab101200 0x55d1ab512180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec323d3740 1 -- 172.21.15.146:0/1852592983 >> 172.21.15.146:0/1852592983 conn(0x55d1ab11e210 msgr2=0x55d1ab4d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec323d3740 1 -- 172.21.15.146:0/1852592983 shutdown_connections 2024-09-17T03:44:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec323d3740 1 -- 172.21.15.146:0/1852592983 wait complete. 2024-09-17T03:44:19.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.298+0000 7fec323d3740 20 client.10491 trim_cache size 0 max 16384 2024-09-17T03:44:19.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.315+0000 7fec323d3740 1 Processor -- start 2024-09-17T03:44:19.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.315+0000 7fec323d3740 1 -- start start 2024-09-17T03:44:19.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.316+0000 7fec323d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab101200 0x55d1ab512330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.316+0000 7fec323d3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab4fc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.316+0000 7fec323d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab12a0c0 0x55d1ab516fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.316+0000 7fec323d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fec24202290 con 0x55d1ab101200 2024-09-17T03:44:19.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.316+0000 7fec323d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec24159360 con 0x55d1ab12a0c0 2024-09-17T03:44:19.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.316+0000 7fec323d3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fec24200cb0 con 0x55d1ab1093e0 2024-09-17T03:44:19.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.316+0000 7fec291ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab101200 0x55d1ab512330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.316+0000 7fec291ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab101200 0x55d1ab512330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49902/0 (socket says 172.21.15.146:49902) 2024-09-17T03:44:19.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.316+0000 7fec291ff640 1 -- 172.21.15.146:0/558172860 learned_addr learned my addr 172.21.15.146:0/558172860 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec289fe640 1 --2- 172.21.15.146:0/558172860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab4fc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec29a00640 1 --2- 172.21.15.146:0/558172860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab12a0c0 0x55d1ab516fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec291ff640 1 -- 172.21.15.146:0/558172860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 msgr2=0x55d1ab4fc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec291ff640 1 --2- 172.21.15.146:0/558172860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab4fc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec291ff640 1 -- 172.21.15.146:0/558172860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab12a0c0 msgr2=0x55d1ab516fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec291ff640 1 --2- 172.21.15.146:0/558172860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab12a0c0 0x55d1ab516fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec291ff640 1 -- 172.21.15.146:0/558172860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ab1733d0 con 0x55d1ab101200 2024-09-17T03:44:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec29a00640 1 --2- 172.21.15.146:0/558172860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab12a0c0 0x55d1ab516fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec291ff640 1 --2- 172.21.15.146:0/558172860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab101200 0x55d1ab512330 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fec14060ac0 tx=0x7fec14087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b9f2d1d70578ff server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec0a7fc640 1 -- 172.21.15.146:0/558172860 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14063f50 con 0x55d1ab101200 2024-09-17T03:44:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec0a7fc640 1 -- 172.21.15.146:0/558172860 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec14084070 con 0x55d1ab101200 2024-09-17T03:44:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.317+0000 7fec0a7fc640 1 -- 172.21.15.146:0/558172860 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14063850 con 0x55d1ab101200 2024-09-17T03:44:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.318+0000 7fec323d3740 1 -- 172.21.15.146:0/558172860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab101200 msgr2=0x55d1ab512330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.318+0000 7fec323d3740 1 --2- 172.21.15.146:0/558172860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab101200 0x55d1ab512330 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fec14060ac0 tx=0x7fec14087040 comp rx=0 tx=0).stop 2024-09-17T03:44:19.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.318+0000 7fec323d3740 1 -- 172.21.15.146:0/558172860 shutdown_connections 2024-09-17T03:44:19.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.318+0000 7fec323d3740 1 --2- 172.21.15.146:0/558172860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab12a0c0 0x55d1ab516fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.318+0000 7fec323d3740 1 --2- 172.21.15.146:0/558172860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab4fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.318+0000 7fec323d3740 1 --2- 172.21.15.146:0/558172860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab101200 0x55d1ab512330 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.318+0000 7fec323d3740 1 -- 172.21.15.146:0/558172860 >> 172.21.15.146:0/558172860 conn(0x55d1ab11e210 msgr2=0x55d1ab4f8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.318+0000 7fec323d3740 1 -- 172.21.15.146:0/558172860 shutdown_connections 2024-09-17T03:44:19.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.318+0000 7fec323d3740 1 -- 172.21.15.146:0/558172860 wait complete. 2024-09-17T03:44:19.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.319+0000 7fec323d3740 1 -- start start 2024-09-17T03:44:19.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.319+0000 7fec323d3740 1 Processor -- start 2024-09-17T03:44:19.328 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T03:44:19.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec323d3740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab101200 0x55d1ab592460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec323d3740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab512330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec323d3740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab512870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec323d3740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55d1ab511320 con 0x55d1ab12a0c0 2024-09-17T03:44:19.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec323d3740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d1ab514fb0 con 0x55d1ab101200 2024-09-17T03:44:19.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec323d3740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d1ab513a80 con 0x55d1ab1093e0 2024-09-17T03:44:19.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec323d3740 10 client.0 _ll_register_callbacks cb 0x7fec1400cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:19.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec29a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab512870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec29a00640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab512870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49918/0 (socket says 172.21.15.146:49918) 2024-09-17T03:44:19.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec29a00640 1 -- 172.21.15.146:0/2072789555 learned_addr learned my addr 172.21.15.146:0/2072789555 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec289fe640 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab512330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec291ff640 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab101200 0x55d1ab592460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec29a00640 1 -- 172.21.15.146:0/2072789555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 msgr2=0x55d1ab512330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec29a00640 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab512330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec29a00640 1 -- 172.21.15.146:0/2072789555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab101200 msgr2=0x55d1ab592460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec29a00640 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab101200 0x55d1ab592460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.320+0000 7fec29a00640 1 -- 172.21.15.146:0/2072789555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1ab4ebbe0 con 0x55d1ab12a0c0 2024-09-17T03:44:19.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec29a00640 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab512870 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fec1c006010 tx=0x7fec1c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c69df6543ec972c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec03fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec03fff640 1 -- 172.21.15.146:0/2072789555 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c035070 con 0x55d1ab12a0c0 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec03fff640 1 -- 172.21.15.146:0/2072789555 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fec1c005490 con 0x55d1ab12a0c0 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec323d3740 1 -- 172.21.15.146:0/2072789555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec14084070 con 0x55d1ab12a0c0 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec03fff640 1 -- 172.21.15.146:0/2072789555 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7fec1c05f050 con 0x55d1ab12a0c0 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec323d3740 10 client.10497 fetch_fsmap learned FSMap version 128 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec323d3740 1 -- 172.21.15.146:0/2072789555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x55d1ab5929a0 con 0x55d1ab12a0c0 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec03fff640 1 -- 172.21.15.146:0/2072789555 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec14084070 con 0x55d1ab12a0c0 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec03fff640 1 -- 172.21.15.146:0/2072789555 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) ==== 3490+0+0 (secure 0 0 0) 0x7fec1c056040 con 0x55d1ab12a0c0 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec323d3740 10 client.10497 fetch_fsmap finished waiting for FSMap version 128 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec323d3740 10 client.10497 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec323d3740 20 client.10497 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec323d3740 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55d1ab538e00 0x55d1ab595090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec323d3740 4 client.10497 mds_command: new command op to 10242 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-17T03:44:19.331 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec323d3740 1 -- 172.21.15.146:0/2072789555 --> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55d1ab442660 con 0x55d1ab538e00 2024-09-17T03:44:19.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.321+0000 7fec291ff640 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55d1ab538e00 0x55d1ab595090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec03fff640 10 client.10497 ms_handle_connect on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec291ff640 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55d1ab538e00 0x55d1ab595090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10242 client_cookie=d955ce9f3b8cc807 server_cookie=19016ad574147d84 in_seq=0 out_seq=0 2024-09-17T03:44:19.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec03fff640 1 -- 172.21.15.146:0/2072789555 <== mds.10242 v2:172.21.15.146:6832/465040613 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55d1ab442660 con 0x55d1ab538e00 2024-09-17T03:44:19.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec03fff640 10 client.10497 handle_command_reply: tid=0 2024-09-17T03:44:19.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 1 client.10497 shutdown 2024-09-17T03:44:19.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 1 -- 172.21.15.146:0/2072789555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 msgr2=0x55d1ab512870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab512870 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fec1c006010 tx=0x7fec1c003f90 comp rx=0 tx=0).stop 2024-09-17T03:44:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 1 -- 172.21.15.146:0/2072789555 shutdown_connections 2024-09-17T03:44:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55d1ab538e00 0x55d1ab595090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d1ab12a0c0 0x55d1ab512870 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d1ab1093e0 0x55d1ab512330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 1 --2- 172.21.15.146:0/2072789555 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d1ab101200 0x55d1ab592460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec03fff640 0 client.10497 ms_handle_reset on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 1 -- 172.21.15.146:0/2072789555 >> 172.21.15.146:0/2072789555 conn(0x55d1ab11e210 msgr2=0x55d1ab4d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 1 -- 172.21.15.146:0/2072789555 shutdown_connections 2024-09-17T03:44:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 1 -- 172.21.15.146:0/2072789555 wait complete. 2024-09-17T03:44:19.333 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.322+0000 7fec323d3740 20 client.10497 trim_cache size 0 max 16384 2024-09-17T03:44:19.334 INFO:teuthology.orchestra.run.smithi146.stderr:Error EINVAL: MDS is not active 2024-09-17T03:44:19.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub abort 2024-09-17T03:44:19.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.450+0000 7f110d50b640 1 -- 172.21.15.146:0/630629279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11080b5750 msgr2=0x7f11080b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.450+0000 7f110d50b640 1 --2- 172.21.15.146:0/630629279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11080b5750 0x7f11080b3620 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f10f0005fd0 tx=0x7f10f002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.450+0000 7f110d50b640 1 -- 172.21.15.146:0/630629279 shutdown_connections 2024-09-17T03:44:19.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.450+0000 7f110d50b640 1 --2- 172.21.15.146:0/630629279 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11080b5750 0x7f11080b3620 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.450+0000 7f110d50b640 1 --2- 172.21.15.146:0/630629279 >> v2:172.21.15.179:3300/0 conn(0x7f11080b5ce0 0x7f11080b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.450+0000 7f110d50b640 1 -- 172.21.15.146:0/630629279 >> 172.21.15.146:0/630629279 conn(0x7f11080b7b20 msgr2=0x7f110809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.450+0000 7f110d50b640 1 -- 172.21.15.146:0/630629279 shutdown_connections 2024-09-17T03:44:19.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.450+0000 7f110d50b640 1 -- 172.21.15.146:0/630629279 wait complete. 2024-09-17T03:44:19.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.452+0000 7f110d50b640 1 Processor -- start 2024-09-17T03:44:19.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.452+0000 7f110d50b640 1 -- start start 2024-09-17T03:44:19.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.453+0000 7f110d50b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11080b3b60 0x7f110815f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.453+0000 7f110d50b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11080b5750 0x7f110814d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.453+0000 7f110d50b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11080b5ce0 0x7f110814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.453+0000 7f110d50b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11080b27b0 con 0x7f11080b5ce0 2024-09-17T03:44:19.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.453+0000 7f110d50b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f110815dd00 con 0x7f11080b5750 2024-09-17T03:44:19.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.453+0000 7f110d50b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f11080b2930 con 0x7f11080b3b60 2024-09-17T03:44:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f11077fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11080b5ce0 0x7f110814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f11077fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11080b5ce0 0x7f110814dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49930/0 (socket says 172.21.15.146:49930) 2024-09-17T03:44:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f11077fe640 1 -- 172.21.15.146:0/1645809763 learned_addr learned my addr 172.21.15.146:0/1645809763 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f11067fc640 1 --2- 172.21.15.146:0/1645809763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11080b5750 0x7f110814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f1106ffd640 1 --2- 172.21.15.146:0/1645809763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11080b3b60 0x7f110815f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f11077fe640 1 -- 172.21.15.146:0/1645809763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11080b3b60 msgr2=0x7f110815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f11077fe640 1 --2- 172.21.15.146:0/1645809763 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f11080b3b60 0x7f110815f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f11077fe640 1 -- 172.21.15.146:0/1645809763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11080b5750 msgr2=0x7f110814d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f11077fe640 1 --2- 172.21.15.146:0/1645809763 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11080b5750 0x7f110814d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f11077fe640 1 -- 172.21.15.146:0/1645809763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11080c7fd0 con 0x7f11080b5ce0 2024-09-17T03:44:19.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f11077fe640 1 --2- 172.21.15.146:0/1645809763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11080b5ce0 0x7f110814dd30 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f110000c3c0 tx=0x7f110000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f10ff7fe640 1 -- 172.21.15.146:0/1645809763 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100017070 con 0x7f11080b5ce0 2024-09-17T03:44:19.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f10ff7fe640 1 -- 172.21.15.146:0/1645809763 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11000053c0 con 0x7f11080b5ce0 2024-09-17T03:44:19.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f110d50b640 1 -- 172.21.15.146:0/1645809763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11080c82b0 con 0x7f11080b5ce0 2024-09-17T03:44:19.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f10ff7fe640 1 -- 172.21.15.146:0/1645809763 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100003850 con 0x7f11080b5ce0 2024-09-17T03:44:19.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.454+0000 7f110d50b640 1 -- 172.21.15.146:0/1645809763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11080a0010 con 0x7f11080b5ce0 2024-09-17T03:44:19.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.456+0000 7f10ff7fe640 1 -- 172.21.15.146:0/1645809763 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f110001a070 con 0x7f11080b5ce0 2024-09-17T03:44:19.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.457+0000 7f10ff7fe640 1 --2- 172.21.15.146:0/1645809763 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f10e8078b90 0x7f10e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.457+0000 7f10ff7fe640 1 -- 172.21.15.146:0/1645809763 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f1100099fe0 con 0x7f11080b5ce0 2024-09-17T03:44:19.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.457+0000 7f1106ffd640 1 --2- 172.21.15.146:0/1645809763 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f10e8078b90 0x7f10e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.457+0000 7f1106ffd640 1 --2- 172.21.15.146:0/1645809763 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f10e8078b90 0x7f10e807b0a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f10f8005fd0 tx=0x7f10f8009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.458+0000 7f111447b740 1 Processor -- start 2024-09-17T03:44:19.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.458+0000 7f111447b740 1 -- start start 2024-09-17T03:44:19.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.459+0000 7f111447b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83540c0 0x55a4f8725970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.459+0000 7f111447b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f832b200 0x55a4f8725eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.459+0000 7f111447b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8742db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.459+0000 7f111447b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a4f866ec60 con 0x55a4f83540c0 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.459+0000 7f111447b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a4f865e090 con 0x55a4f832b200 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.459+0000 7f111447b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a4f8661ea0 con 0x55a4f83333e0 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.459+0000 7f1106ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83540c0 0x55a4f8725970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.459+0000 7f1106ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83540c0 0x55a4f8725970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49946/0 (socket says 172.21.15.146:49946) 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.459+0000 7f1106ffd640 1 -- 172.21.15.146:0/1531901751 learned_addr learned my addr 172.21.15.146:0/1531901751 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.459+0000 7f11077fe640 1 --2- 172.21.15.146:0/1531901751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8742db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.459+0000 7f11067fc640 1 --2- 172.21.15.146:0/1531901751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f832b200 0x55a4f8725eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.460+0000 7f1106ffd640 1 -- 172.21.15.146:0/1531901751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 msgr2=0x55a4f8742db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.460+0000 7f1106ffd640 1 --2- 172.21.15.146:0/1531901751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8742db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.460+0000 7f1106ffd640 1 -- 172.21.15.146:0/1531901751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f832b200 msgr2=0x55a4f8725eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.460+0000 7f1106ffd640 1 --2- 172.21.15.146:0/1531901751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f832b200 0x55a4f8725eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.460+0000 7f1106ffd640 1 -- 172.21.15.146:0/1531901751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f8350120 con 0x55a4f83540c0 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.460+0000 7f1106ffd640 1 --2- 172.21.15.146:0/1531901751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83540c0 0x55a4f8725970 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f10f8003ba0 tx=0x7f10f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819cc7b53185a9d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.460+0000 7f10fcff9640 1 -- 172.21.15.146:0/1531901751 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8026480 con 0x55a4f83540c0 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.460+0000 7f10fcff9640 1 -- 172.21.15.146:0/1531901751 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10f8026710 con 0x55a4f83540c0 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.460+0000 7f10fcff9640 1 -- 172.21.15.146:0/1531901751 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8026b00 con 0x55a4f83540c0 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.461+0000 7f111447b740 1 -- 172.21.15.146:0/1531901751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83540c0 msgr2=0x55a4f8725970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.461+0000 7f111447b740 1 --2- 172.21.15.146:0/1531901751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83540c0 0x55a4f8725970 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f10f8003ba0 tx=0x7f10f8014000 comp rx=0 tx=0).stop 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.461+0000 7f111447b740 1 -- 172.21.15.146:0/1531901751 shutdown_connections 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.461+0000 7f111447b740 1 --2- 172.21.15.146:0/1531901751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8742db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.461+0000 7f111447b740 1 --2- 172.21.15.146:0/1531901751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f832b200 0x55a4f8725eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.461+0000 7f111447b740 1 --2- 172.21.15.146:0/1531901751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83540c0 0x55a4f8725970 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.461+0000 7f111447b740 1 -- 172.21.15.146:0/1531901751 >> 172.21.15.146:0/1531901751 conn(0x55a4f8348210 msgr2=0x55a4f86fbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.461+0000 7f111447b740 1 -- 172.21.15.146:0/1531901751 shutdown_connections 2024-09-17T03:44:19.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.461+0000 7f111447b740 1 -- 172.21.15.146:0/1531901751 wait complete. 2024-09-17T03:44:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.462+0000 7f111447b740 1 -- start start 2024-09-17T03:44:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.462+0000 7f111447b740 1 Processor -- start 2024-09-17T03:44:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.463+0000 7f111447b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.463+0000 7f111447b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8737560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.463+0000 7f111447b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 0x55a4f8742d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.463+0000 7f111447b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a4f83ce470 con 0x55a4f832b200 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.463+0000 7f111447b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a4f85e4410 con 0x55a4f83540c0 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.463+0000 7f111447b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a4f87263f0 con 0x55a4f83333e0 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.463+0000 7f111447b740 10 client.0 _ll_register_callbacks cb 0x55a4f86571c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.463+0000 7f1106ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.463+0000 7f1106ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49950/0 (socket says 172.21.15.146:49950) 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.463+0000 7f1106ffd640 1 -- 172.21.15.146:0/3916649442 learned_addr learned my addr 172.21.15.146:0/3916649442 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.463+0000 7f11067fc640 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8737560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f11077fe640 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 0x55a4f8742d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f1106ffd640 1 -- 172.21.15.146:0/3916649442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 msgr2=0x55a4f8737560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f1106ffd640 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8737560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f1106ffd640 1 -- 172.21.15.146:0/3916649442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 msgr2=0x55a4f8742d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f1106ffd640 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 0x55a4f8742d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f1106ffd640 1 -- 172.21.15.146:0/3916649442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4f8436500 con 0x55a4f832b200 2024-09-17T03:44:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f1106ffd640 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873bc50 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f10f80044d0 tx=0x7f10f8009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4361b1b07b22c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f10e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f10e5ffb640 1 -- 172.21.15.146:0/3916649442 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f80268c0 con 0x55a4f832b200 2024-09-17T03:44:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f10e5ffb640 1 -- 172.21.15.146:0/3916649442 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f10f8026a60 con 0x55a4f832b200 2024-09-17T03:44:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f111447b740 1 -- 172.21.15.146:0/3916649442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10f8026710 con 0x55a4f832b200 2024-09-17T03:44:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f10e5ffb640 1 -- 172.21.15.146:0/3916649442 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7f10f8026c60 con 0x55a4f832b200 2024-09-17T03:44:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f111447b740 10 client.10506 fetch_fsmap learned FSMap version 128 2024-09-17T03:44:19.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f111447b740 1 -- 172.21.15.146:0/3916649442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x55a4f8496c90 con 0x55a4f832b200 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f10e5ffb640 1 -- 172.21.15.146:0/3916649442 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10f8026710 con 0x55a4f832b200 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f10e5ffb640 1 -- 172.21.15.146:0/3916649442 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) ==== 3490+0+0 (secure 0 0 0) 0x7f10f8030420 con 0x55a4f832b200 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f111447b740 10 client.10506 fetch_fsmap finished waiting for FSMap version 128 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f111447b740 10 client.10506 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f111447b740 20 client.10506 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.464+0000 7f111447b740 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55a4f8312ea0 0x55a4f874f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.465+0000 7f111447b740 4 client.10506 mds_command: new command op to 10242 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.465+0000 7f111447b740 1 -- 172.21.15.146:0/3916649442 --> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4f8670bb0 con 0x55a4f8312ea0 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.465+0000 7f11067fc640 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55a4f8312ea0 0x55a4f874f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.465+0000 7f10e5ffb640 10 client.10506 ms_handle_connect on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.465+0000 7f11067fc640 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55a4f8312ea0 0x55a4f874f9f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10242 client_cookie=26767b573f5dd6e6 server_cookie=57da494f189dfe8c in_seq=0 out_seq=0 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.465+0000 7f10e5ffb640 1 -- 172.21.15.146:0/3916649442 <== mds.10242 v2:172.21.15.146:6832/465040613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a4f8670bb0 con 0x55a4f8312ea0 2024-09-17T03:44:19.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.465+0000 7f10e5ffb640 10 client.10506 handle_command_reply: tid=0 2024-09-17T03:44:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 1 client.10506 shutdown 2024-09-17T03:44:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 1 -- 172.21.15.146:0/3916649442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 msgr2=0x55a4f873bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873bc50 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f10f80044d0 tx=0x7f10f8009570 comp rx=0 tx=0).stop 2024-09-17T03:44:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 1 -- 172.21.15.146:0/3916649442 shutdown_connections 2024-09-17T03:44:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55a4f8312ea0 0x55a4f874f9f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 0x55a4f8742d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8737560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 1 --2- 172.21.15.146:0/3916649442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873bc50 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 1 -- 172.21.15.146:0/3916649442 >> 172.21.15.146:0/3916649442 conn(0x55a4f8348210 msgr2=0x55a4f8742380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f10e5ffb640 0 client.10506 ms_handle_reset on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 1 -- 172.21.15.146:0/3916649442 shutdown_connections 2024-09-17T03:44:19.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 1 -- 172.21.15.146:0/3916649442 wait complete. 2024-09-17T03:44:19.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.466+0000 7f111447b740 20 client.10506 trim_cache size 0 max 16384 2024-09-17T03:44:19.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.483+0000 7f111447b740 1 Processor -- start 2024-09-17T03:44:19.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.483+0000 7f111447b740 1 -- start start 2024-09-17T03:44:19.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.484+0000 7f111447b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f832b200 0x55a4f8764eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.484+0000 7f111447b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83333e0 0x55a4f8722390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.484+0000 7f111447b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 0x55a4f87228d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.484+0000 7f111447b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f11081fffe0 con 0x55a4f83333e0 2024-09-17T03:44:19.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.484+0000 7f111447b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f110809f060 con 0x55a4f83540c0 2024-09-17T03:44:19.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.484+0000 7f111447b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f110809f6b0 con 0x55a4f832b200 2024-09-17T03:44:19.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.484+0000 7f11067fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83333e0 0x55a4f8722390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.484+0000 7f11067fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83333e0 0x55a4f8722390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49952/0 (socket says 172.21.15.146:49952) 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.484+0000 7f11067fc640 1 -- 172.21.15.146:0/1127398463 learned_addr learned my addr 172.21.15.146:0/1127398463 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.485+0000 7f11067fc640 1 -- 172.21.15.146:0/1127398463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f832b200 msgr2=0x55a4f8764eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.485+0000 7f11067fc640 1 --2- 172.21.15.146:0/1127398463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f832b200 0x55a4f8764eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.485+0000 7f11067fc640 1 -- 172.21.15.146:0/1127398463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 msgr2=0x55a4f87228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.485+0000 7f11067fc640 1 --2- 172.21.15.146:0/1127398463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 0x55a4f87228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.485+0000 7f11067fc640 1 -- 172.21.15.146:0/1127398463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f839d3d0 con 0x55a4f83333e0 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.485+0000 7f11067fc640 1 --2- 172.21.15.146:0/1127398463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83333e0 0x55a4f8722390 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009230 tx=0x7f10f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e154705557f1b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.485+0000 7f10e7fff640 1 -- 172.21.15.146:0/1127398463 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0035040 con 0x55a4f83333e0 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.485+0000 7f10e7fff640 1 -- 172.21.15.146:0/1127398463 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10f0004470 con 0x55a4f83333e0 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.485+0000 7f10e7fff640 1 -- 172.21.15.146:0/1127398463 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0003830 con 0x55a4f83333e0 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.486+0000 7f111447b740 1 -- 172.21.15.146:0/1127398463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83333e0 msgr2=0x55a4f8722390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.486+0000 7f111447b740 1 --2- 172.21.15.146:0/1127398463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83333e0 0x55a4f8722390 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009230 tx=0x7f10f0004730 comp rx=0 tx=0).stop 2024-09-17T03:44:19.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.486+0000 7f111447b740 1 -- 172.21.15.146:0/1127398463 shutdown_connections 2024-09-17T03:44:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.486+0000 7f111447b740 1 --2- 172.21.15.146:0/1127398463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 0x55a4f87228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.486+0000 7f111447b740 1 --2- 172.21.15.146:0/1127398463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f83333e0 0x55a4f8722390 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.486+0000 7f111447b740 1 --2- 172.21.15.146:0/1127398463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f832b200 0x55a4f8764eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.486+0000 7f111447b740 1 -- 172.21.15.146:0/1127398463 >> 172.21.15.146:0/1127398463 conn(0x55a4f8348210 msgr2=0x55a4f86fbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.486+0000 7f111447b740 1 -- 172.21.15.146:0/1127398463 shutdown_connections 2024-09-17T03:44:19.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.486+0000 7f111447b740 1 -- 172.21.15.146:0/1127398463 wait complete. 2024-09-17T03:44:19.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.487+0000 7f111447b740 1 -- start start 2024-09-17T03:44:19.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.487+0000 7f111447b740 1 Processor -- start 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f111447b740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f111447b740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8722580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f111447b740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 0x55a4f87badb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f111447b740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a4f8739230 con 0x55a4f832b200 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f111447b740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a4f8743240 con 0x55a4f83540c0 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f111447b740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a4f8713c50 con 0x55a4f83333e0 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f111447b740 10 client.0 _ll_register_callbacks cb 0x7f10f0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f1106ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f1106ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49962/0 (socket says 172.21.15.146:49962) 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f1106ffd640 1 -- 172.21.15.146:0/2312522815 learned_addr learned my addr 172.21.15.146:0/2312522815 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f11067fc640 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8722580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f11077fe640 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 0x55a4f87badb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f1106ffd640 1 -- 172.21.15.146:0/2312522815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 msgr2=0x55a4f8722580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f1106ffd640 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8722580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f1106ffd640 1 -- 172.21.15.146:0/2312522815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 msgr2=0x55a4f87badb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f1106ffd640 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 0x55a4f87badb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.488+0000 7f1106ffd640 1 -- 172.21.15.146:0/2312522815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4f877f570 con 0x55a4f832b200 2024-09-17T03:44:19.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f1106ffd640 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873cca0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009270 tx=0x7f10f80098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3394478cc97a8df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f10e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:19.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f10e5ffb640 1 -- 172.21.15.146:0/2312522815 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8041060 con 0x55a4f832b200 2024-09-17T03:44:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f10e5ffb640 1 -- 172.21.15.146:0/2312522815 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f10f802c040 con 0x55a4f832b200 2024-09-17T03:44:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f111447b740 1 -- 172.21.15.146:0/2312522815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10f0004470 con 0x55a4f832b200 2024-09-17T03:44:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f10e5ffb640 1 -- 172.21.15.146:0/2312522815 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7f10f8030b30 con 0x55a4f832b200 2024-09-17T03:44:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f111447b740 10 client.10512 fetch_fsmap learned FSMap version 128 2024-09-17T03:44:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f111447b740 1 -- 172.21.15.146:0/2312522815 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x55a4f8742d20 con 0x55a4f832b200 2024-09-17T03:44:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f10e5ffb640 1 -- 172.21.15.146:0/2312522815 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10f0004470 con 0x55a4f832b200 2024-09-17T03:44:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f10e5ffb640 1 -- 172.21.15.146:0/2312522815 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) ==== 3490+0+0 (secure 0 0 0) 0x7f10f804a080 con 0x55a4f832b200 2024-09-17T03:44:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f111447b740 10 client.10512 fetch_fsmap finished waiting for FSMap version 128 2024-09-17T03:44:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f111447b740 10 client.10512 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:44:19.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f111447b740 20 client.10512 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f111447b740 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55a4f87c8980 0x55a4f87393b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f111447b740 4 client.10512 mds_command: new command op to 10242 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f111447b740 1 -- 172.21.15.146:0/2312522815 --> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55a4f866c660 con 0x55a4f87c8980 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.489+0000 7f11067fc640 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55a4f87c8980 0x55a4f87393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f10e5ffb640 10 client.10512 ms_handle_connect on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f11067fc640 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55a4f87c8980 0x55a4f87393b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10242 client_cookie=ccda00b3c5637100 server_cookie=6c93595a495299a1 in_seq=0 out_seq=0 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f10e5ffb640 1 -- 172.21.15.146:0/2312522815 <== mds.10242 v2:172.21.15.146:6832/465040613 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55a4f866c660 con 0x55a4f87c8980 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f10e5ffb640 10 client.10512 handle_command_reply: tid=0 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 1 client.10512 shutdown 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 1 -- 172.21.15.146:0/2312522815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 msgr2=0x55a4f873cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873cca0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009270 tx=0x7f10f80098c0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 1 -- 172.21.15.146:0/2312522815 shutdown_connections 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55a4f87c8980 0x55a4f87393b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a4f83540c0 0x55a4f87badb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f10e5ffb640 0 client.10512 ms_handle_reset on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a4f83333e0 0x55a4f8722580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 1 --2- 172.21.15.146:0/2312522815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a4f832b200 0x55a4f873cca0 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 1 -- 172.21.15.146:0/2312522815 >> 172.21.15.146:0/2312522815 conn(0x55a4f8348210 msgr2=0x55a4f8751d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 1 -- 172.21.15.146:0/2312522815 shutdown_connections 2024-09-17T03:44:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 1 -- 172.21.15.146:0/2312522815 wait complete. 2024-09-17T03:44:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.490+0000 7f111447b740 20 client.10512 trim_cache size 0 max 16384 2024-09-17T03:44:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:Error EINVAL: MDS is not active 2024-09-17T03:44:19.497 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T03:44:19.497 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub resume 2024-09-17T03:44:19.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.613+0000 7f1b457c3640 1 -- 172.21.15.146:0/3054359847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b4015b770 msgr2=0x7f1b4006fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.613+0000 7f1b457c3640 1 --2- 172.21.15.146:0/3054359847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b4015b770 0x7f1b4006fe10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009830 tx=0x7f1b3002a410 comp rx=0 tx=0).stop 2024-09-17T03:44:19.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.613+0000 7f1b457c3640 1 -- 172.21.15.146:0/3054359847 shutdown_connections 2024-09-17T03:44:19.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.613+0000 7f1b457c3640 1 --2- 172.21.15.146:0/3054359847 >> v2:172.21.15.179:3300/0 conn(0x7f1b40070350 0x7f1b40072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.613+0000 7f1b457c3640 1 --2- 172.21.15.146:0/3054359847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b4015b770 0x7f1b4006fe10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.613+0000 7f1b457c3640 1 -- 172.21.15.146:0/3054359847 >> 172.21.15.146:0/3054359847 conn(0x7f1b400b2060 msgr2=0x7f1b400b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.613+0000 7f1b457c3640 1 -- 172.21.15.146:0/3054359847 shutdown_connections 2024-09-17T03:44:19.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.613+0000 7f1b457c3640 1 -- 172.21.15.146:0/3054359847 wait complete. 2024-09-17T03:44:19.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.615+0000 7f1b457c3640 1 Processor -- start 2024-09-17T03:44:19.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.615+0000 7f1b457c3640 1 -- start start 2024-09-17T03:44:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.616+0000 7f1b457c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b40070350 0x7f1b40155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.616+0000 7f1b457c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40072bc0 0x7f1b40152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.616+0000 7f1b457c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b4015b770 0x7f1b400aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.616+0000 7f1b457c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4015f9f0 con 0x7f1b40072bc0 2024-09-17T03:44:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.616+0000 7f1b457c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b400b5590 con 0x7f1b4015b770 2024-09-17T03:44:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.616+0000 7f1b457c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4015fb70 con 0x7f1b40070350 2024-09-17T03:44:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b3e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40072bc0 0x7f1b40152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b3e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40072bc0 0x7f1b40152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49976/0 (socket says 172.21.15.146:49976) 2024-09-17T03:44:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/2630116708 learned_addr learned my addr 172.21.15.146:0/2630116708 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b3effd640 1 --2- 172.21.15.146:0/2630116708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b40070350 0x7f1b40155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b3f7fe640 1 --2- 172.21.15.146:0/2630116708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b4015b770 0x7f1b400aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/2630116708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b40070350 msgr2=0x7f1b40155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b3e7fc640 1 --2- 172.21.15.146:0/2630116708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1b40070350 0x7f1b40155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/2630116708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b4015b770 msgr2=0x7f1b400aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b3e7fc640 1 --2- 172.21.15.146:0/2630116708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b4015b770 0x7f1b400aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/2630116708 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b40155d40 con 0x7f1b40072bc0 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b3e7fc640 1 --2- 172.21.15.146:0/2630116708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40072bc0 0x7f1b40152b90 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400e9f0 tx=0x7f1b3400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b277fe640 1 -- 172.21.15.146:0/2630116708 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400cd80 con 0x7f1b40072bc0 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b277fe640 1 -- 172.21.15.146:0/2630116708 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b34004020 con 0x7f1b40072bc0 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b277fe640 1 -- 172.21.15.146:0/2630116708 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34004470 con 0x7f1b40072bc0 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b457c3640 1 -- 172.21.15.146:0/2630116708 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b40155a60 con 0x7f1b40072bc0 2024-09-17T03:44:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.617+0000 7f1b457c3640 1 -- 172.21.15.146:0/2630116708 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b401f6320 con 0x7f1b40072bc0 2024-09-17T03:44:19.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.619+0000 7f1b277fe640 1 -- 172.21.15.146:0/2630116708 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b34005030 con 0x7f1b40072bc0 2024-09-17T03:44:19.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.620+0000 7f1b277fe640 1 --2- 172.21.15.146:0/2630116708 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b2c078b90 0x7f1b2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.620+0000 7f1b277fe640 1 -- 172.21.15.146:0/2630116708 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f1b3409b5b0 con 0x7f1b40072bc0 2024-09-17T03:44:19.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.620+0000 7f1b3effd640 1 --2- 172.21.15.146:0/2630116708 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b2c078b90 0x7f1b2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.620+0000 7f1b4c813740 1 Processor -- start 2024-09-17T03:44:19.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.620+0000 7f1b4c813740 1 -- start start 2024-09-17T03:44:19.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.621+0000 7f1b3effd640 1 --2- 172.21.15.146:0/2630116708 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1b2c078b90 0x7f1b2c07b0a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1b30034000 tx=0x7f1b30004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02bf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a02a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69feaf6b0 0x55c6a02a2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b4c813740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c6a01eabd0 con 0x55c69fed0390 2024-09-17T03:44:19.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b4c813740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c6a01da000 con 0x55c69feaf6b0 2024-09-17T03:44:19.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b4c813740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c6a01dde10 con 0x55c69fea74d0 2024-09-17T03:44:19.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b3effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b3effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02bf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49984/0 (socket says 172.21.15.146:49984) 2024-09-17T03:44:19.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b3effd640 1 -- 172.21.15.146:0/1665746257 learned_addr learned my addr 172.21.15.146:0/1665746257 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b3e7fc640 1 --2- 172.21.15.146:0/1665746257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a02a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b3f7fe640 1 --2- 172.21.15.146:0/1665746257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69feaf6b0 0x55c6a02a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b3effd640 1 -- 172.21.15.146:0/1665746257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 msgr2=0x55c6a02a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b3effd640 1 --2- 172.21.15.146:0/1665746257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a02a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b3effd640 1 -- 172.21.15.146:0/1665746257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69feaf6b0 msgr2=0x55c6a02a2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b3effd640 1 --2- 172.21.15.146:0/1665746257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69feaf6b0 0x55c6a02a2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b3effd640 1 -- 172.21.15.146:0/1665746257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c69ffb27d0 con 0x55c69fed0390 2024-09-17T03:44:19.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.622+0000 7f1b3effd640 1 --2- 172.21.15.146:0/1665746257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02bf310 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f1b3002aa00 tx=0x7f1b3002c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e46cfeffd1c0c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.623+0000 7f1b24ff9640 1 -- 172.21.15.146:0/1665746257 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30037040 con 0x55c69fed0390 2024-09-17T03:44:19.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.623+0000 7f1b24ff9640 1 -- 172.21.15.146:0/1665746257 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b3004e070 con 0x55c69fed0390 2024-09-17T03:44:19.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.623+0000 7f1b24ff9640 1 -- 172.21.15.146:0/1665746257 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30003d00 con 0x55c69fed0390 2024-09-17T03:44:19.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.623+0000 7f1b4c813740 1 -- 172.21.15.146:0/1665746257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 msgr2=0x55c6a02bf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.623+0000 7f1b4c813740 1 --2- 172.21.15.146:0/1665746257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02bf310 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f1b3002aa00 tx=0x7f1b3002c050 comp rx=0 tx=0).stop 2024-09-17T03:44:19.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.623+0000 7f1b4c813740 1 -- 172.21.15.146:0/1665746257 shutdown_connections 2024-09-17T03:44:19.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.623+0000 7f1b4c813740 1 --2- 172.21.15.146:0/1665746257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69feaf6b0 0x55c6a02a2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.623+0000 7f1b4c813740 1 --2- 172.21.15.146:0/1665746257 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a02a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.623+0000 7f1b4c813740 1 --2- 172.21.15.146:0/1665746257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02bf310 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.623+0000 7f1b4c813740 1 -- 172.21.15.146:0/1665746257 >> 172.21.15.146:0/1665746257 conn(0x55c69fec44e0 msgr2=0x55c6a0278200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.624+0000 7f1b4c813740 1 -- 172.21.15.146:0/1665746257 shutdown_connections 2024-09-17T03:44:19.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.624+0000 7f1b4c813740 1 -- 172.21.15.146:0/1665746257 wait complete. 2024-09-17T03:44:19.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.624+0000 7f1b4c813740 1 -- start start 2024-09-17T03:44:19.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.624+0000 7f1b4c813740 1 Processor -- start 2024-09-17T03:44:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a02b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a0290700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 0x55c6a02cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b4c813740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c69ff4a740 con 0x55c69feaf6b0 2024-09-17T03:44:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b4c813740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c6a017f540 con 0x55c69fed0390 2024-09-17T03:44:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b4c813740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c6a02b7cb0 con 0x55c69fea74d0 2024-09-17T03:44:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b4c813740 10 client.0 _ll_register_callbacks cb 0x55c6a017e0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a0290700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a0290700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49990/0 (socket says 172.21.15.146:49990) 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/2090037460 learned_addr learned my addr 172.21.15.146:0/2090037460 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3effd640 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a02b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3f7fe640 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 0x55c6a02cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/2090037460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 msgr2=0x55c6a02b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3e7fc640 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a02b73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/2090037460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 msgr2=0x55c6a02cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3e7fc640 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 0x55c6a02cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/2090037460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c69ff196a0 con 0x55c69feaf6b0 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3f7fe640 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 0x55c6a02cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b3e7fc640 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a0290700 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f1b34004610 tx=0x7f1b34063870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5b46b705931bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b1dffb640 1 -- 172.21.15.146:0/2090037460 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3401d030 con 0x55c69feaf6b0 2024-09-17T03:44:19.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b1dffb640 1 -- 172.21.15.146:0/2090037460 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f1b3409b0c0 con 0x55c69feaf6b0 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.626+0000 7f1b4c813740 1 -- 172.21.15.146:0/2090037460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b3004e070 con 0x55c69feaf6b0 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b1dffb640 1 -- 172.21.15.146:0/2090037460 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7f1b34067d50 con 0x55c69feaf6b0 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b4c813740 10 client.10524 fetch_fsmap learned FSMap version 128 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b4c813740 1 -- 172.21.15.146:0/2090037460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x55c6a0012f60 con 0x55c69feaf6b0 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b1dffb640 1 -- 172.21.15.146:0/2090037460 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b3004e070 con 0x55c69feaf6b0 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b1dffb640 1 -- 172.21.15.146:0/2090037460 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) ==== 3490+0+0 (secure 0 0 0) 0x7f1b34085af0 con 0x55c69feaf6b0 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b4c813740 10 client.10524 fetch_fsmap finished waiting for FSMap version 128 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b4c813740 10 client.10524 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b4c813740 20 client.10524 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b4c813740 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55c69fe8ef60 0x55c6a02b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b4c813740 4 client.10524 mds_command: new command op to 10242 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b4c813740 1 -- 172.21.15.146:0/2090037460 --> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6a01ecb20 con 0x55c69fe8ef60 2024-09-17T03:44:19.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b3effd640 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55c69fe8ef60 0x55c6a02b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b1dffb640 10 client.10524 ms_handle_connect on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.627+0000 7f1b3effd640 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55c69fe8ef60 0x55c6a02b3ab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10242 client_cookie=7f47d1208ac82158 server_cookie=ac1ab5b0eab4d5e4 in_seq=0 out_seq=0 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b1dffb640 1 -- 172.21.15.146:0/2090037460 <== mds.10242 v2:172.21.15.146:6832/465040613 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c6a01ecb20 con 0x55c69fe8ef60 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b1dffb640 10 client.10524 handle_command_reply: tid=0 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b4c813740 1 client.10524 shutdown 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b4c813740 1 -- 172.21.15.146:0/2090037460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 msgr2=0x55c6a0290700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b4c813740 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a0290700 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f1b34004610 tx=0x7f1b34063870 comp rx=0 tx=0).stop 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b4c813740 1 -- 172.21.15.146:0/2090037460 shutdown_connections 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b4c813740 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55c69fe8ef60 0x55c6a02b3ab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b4c813740 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 0x55c6a02cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b4c813740 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a0290700 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b1dffb640 0 client.10524 ms_handle_reset on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b4c813740 1 --2- 172.21.15.146:0/2090037460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a02b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b4c813740 1 -- 172.21.15.146:0/2090037460 >> 172.21.15.146:0/2090037460 conn(0x55c69fec44e0 msgr2=0x55c6a02917a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b4c813740 1 -- 172.21.15.146:0/2090037460 shutdown_connections 2024-09-17T03:44:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.628+0000 7f1b4c813740 1 -- 172.21.15.146:0/2090037460 wait complete. 2024-09-17T03:44:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.629+0000 7f1b4c813740 20 client.10524 trim_cache size 0 max 16384 2024-09-17T03:44:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.646+0000 7f1b4c813740 1 Processor -- start 2024-09-17T03:44:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.646+0000 7f1b4c813740 1 -- start start 2024-09-17T03:44:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.647+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a02dfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.647+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69feaf6b0 0x55c6a02e0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.647+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.647+0000 7f1b4c813740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1b40202140 con 0x55c69fed0390 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.647+0000 7f1b4c813740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1b401f9d30 con 0x55c69feaf6b0 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.647+0000 7f1b4c813740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4006f040 con 0x55c69fea74d0 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.647+0000 7f1b3f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.647+0000 7f1b3f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50000/0 (socket says 172.21.15.146:50000) 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.648+0000 7f1b3f7fe640 1 -- 172.21.15.146:0/2354013396 learned_addr learned my addr 172.21.15.146:0/2354013396 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.648+0000 7f1b3f7fe640 1 -- 172.21.15.146:0/2354013396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 msgr2=0x55c6a02dfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.648+0000 7f1b3f7fe640 1 --2- 172.21.15.146:0/2354013396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a02dfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.648+0000 7f1b3f7fe640 1 -- 172.21.15.146:0/2354013396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69feaf6b0 msgr2=0x55c6a02e0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.648+0000 7f1b3f7fe640 1 --2- 172.21.15.146:0/2354013396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69feaf6b0 0x55c6a02e0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.648+0000 7f1b3f7fe640 1 -- 172.21.15.146:0/2354013396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c69ffb0ad0 con 0x55c69fed0390 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.648+0000 7f1b3f7fe640 1 --2- 172.21.15.146:0/2354013396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02cb430 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f1b38014640 tx=0x7f1b38001590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53649e25180401d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.648+0000 7f1b1ffff640 1 -- 172.21.15.146:0/2354013396 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b380166f0 con 0x55c69fed0390 2024-09-17T03:44:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.648+0000 7f1b1ffff640 1 -- 172.21.15.146:0/2354013396 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b38016980 con 0x55c69fed0390 2024-09-17T03:44:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.648+0000 7f1b1ffff640 1 -- 172.21.15.146:0/2354013396 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38016dd0 con 0x55c69fed0390 2024-09-17T03:44:19.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.649+0000 7f1b4c813740 1 -- 172.21.15.146:0/2354013396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 msgr2=0x55c6a02cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.649+0000 7f1b4c813740 1 --2- 172.21.15.146:0/2354013396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02cb430 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f1b38014640 tx=0x7f1b38001590 comp rx=0 tx=0).stop 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.649+0000 7f1b4c813740 1 -- 172.21.15.146:0/2354013396 shutdown_connections 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.649+0000 7f1b4c813740 1 --2- 172.21.15.146:0/2354013396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69fed0390 0x55c6a02cb430 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.649+0000 7f1b4c813740 1 --2- 172.21.15.146:0/2354013396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69feaf6b0 0x55c6a02e0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.649+0000 7f1b4c813740 1 --2- 172.21.15.146:0/2354013396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a02dfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.649+0000 7f1b4c813740 1 -- 172.21.15.146:0/2354013396 >> 172.21.15.146:0/2354013396 conn(0x55c69fec44e0 msgr2=0x55c6a02902e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.649+0000 7f1b4c813740 1 -- 172.21.15.146:0/2354013396 shutdown_connections 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.649+0000 7f1b4c813740 1 -- 172.21.15.146:0/2354013396 wait complete. 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.650+0000 7f1b4c813740 1 -- start start 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.650+0000 7f1b4c813740 1 Processor -- start 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a0333280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a02cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b4c813740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 0x55c6a02cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b4c813740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c6a02b6b40 con 0x55c69feaf6b0 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b4c813740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c6a02b79f0 con 0x55c69fed0390 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b4c813740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c6a02cce10 con 0x55c69fea74d0 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b4c813740 10 client.0 _ll_register_callbacks cb 0x7f1b3405f250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b3e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a02cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b3e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a02cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50002/0 (socket says 172.21.15.146:50002) 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/4251912666 learned_addr learned my addr 172.21.15.146:0/4251912666 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b3f7fe640 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 0x55c6a02cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b3effd640 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a0333280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/4251912666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 msgr2=0x55c6a0333280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b3e7fc640 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a0333280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/4251912666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 msgr2=0x55c6a02cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b3e7fc640 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 0x55c6a02cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b3e7fc640 1 -- 172.21.15.146:0/4251912666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a0340db0 con 0x55c69feaf6b0 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.651+0000 7f1b3f7fe640 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 0x55c6a02cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b3e7fc640 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a02cb430 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f1b34060590 tx=0x7f1b340629e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbab92b24bc2fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b1dffb640 1 -- 172.21.15.146:0/4251912666 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3401d070 con 0x55c69feaf6b0 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b1dffb640 1 -- 172.21.15.146:0/4251912666 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f1b3405ec70 con 0x55c69feaf6b0 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b4c813740 1 -- 172.21.15.146:0/4251912666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b38016980 con 0x55c69feaf6b0 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b1dffb640 1 -- 172.21.15.146:0/4251912666 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) ==== 24+0+0 (secure 0 0 0) 0x7f1b34062a90 con 0x55c69feaf6b0 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b4c813740 10 client.10530 fetch_fsmap learned FSMap version 128 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b4c813740 1 -- 172.21.15.146:0/4251912666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) -- 0x55c6a02df9c0 con 0x55c69feaf6b0 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b1dffb640 1 -- 172.21.15.146:0/4251912666 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b38016980 con 0x55c69feaf6b0 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b1dffb640 1 -- 172.21.15.146:0/4251912666 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) ==== 3490+0+0 (secure 0 0 0) 0x7f1b3409b070 con 0x55c69feaf6b0 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b4c813740 10 client.10530 fetch_fsmap finished waiting for FSMap version 128 2024-09-17T03:44:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b4c813740 10 client.10530 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b4c813740 20 client.10530 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b4c813740 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55c6a0340630 0x55c6a02b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b4c813740 4 client.10530 mds_command: new command op to 10242 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b4c813740 1 -- 172.21.15.146:0/4251912666 --> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55c6a01e85d0 con 0x55c6a0340630 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.652+0000 7f1b3effd640 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55c6a0340630 0x55c6a02b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b1dffb640 10 client.10530 ms_handle_connect on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b3effd640 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55c6a0340630 0x55c6a02b5350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10242 client_cookie=b293ab952f7f9c6f server_cookie=9b27a14820ff2327 in_seq=0 out_seq=0 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b1dffb640 1 -- 172.21.15.146:0/4251912666 <== mds.10242 v2:172.21.15.146:6832/465040613 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55c6a01e85d0 con 0x55c6a0340630 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b1dffb640 10 client.10530 handle_command_reply: tid=0 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 1 client.10530 shutdown 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 1 -- 172.21.15.146:0/4251912666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 msgr2=0x55c6a02cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a02cb430 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f1b34060590 tx=0x7f1b340629e0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 1 -- 172.21.15.146:0/4251912666 shutdown_connections 2024-09-17T03:44:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.146:6832/465040613,v1:172.21.15.146:6833/465040613] conn(0x55c6a0340630 0x55c6a02b5350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c69fed0390 0x55c6a02cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c69feaf6b0 0x55c6a02cb430 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 1 --2- 172.21.15.146:0/4251912666 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c69fea74d0 0x55c6a0333280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b1dffb640 0 client.10530 ms_handle_reset on v2:172.21.15.146:6832/465040613 2024-09-17T03:44:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 1 -- 172.21.15.146:0/4251912666 >> 172.21.15.146:0/4251912666 conn(0x55c69fec44e0 msgr2=0x55c6a02a1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 1 -- 172.21.15.146:0/4251912666 shutdown_connections 2024-09-17T03:44:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 1 -- 172.21.15.146:0/4251912666 wait complete. 2024-09-17T03:44:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.653+0000 7f1b4c813740 20 client.10530 trim_cache size 0 max 16384 2024-09-17T03:44:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:Error EINVAL: MDS is not active 2024-09-17T03:44:19.659 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T03:44:19.659 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:44:19.660 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:44:19.695 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:44:19.738 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:44:19.738 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:44:19.739 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:44:19.739 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:44:19.755 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:44:19.755 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:44:19.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:44:19.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.965+0000 7f7803e9b640 1 -- 172.21.15.146:0/2668088192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77fc0b3d30 msgr2=0x7f77fc15caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.965+0000 7f7803e9b640 1 --2- 172.21.15.146:0/2668088192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77fc0b3d30 0x7f77fc15caa0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f77f4005fd0 tx=0x7f77f402aa00 comp rx=0 tx=0).stop 2024-09-17T03:44:19.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.965+0000 7f7803e9b640 1 -- 172.21.15.146:0/2668088192 shutdown_connections 2024-09-17T03:44:19.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.965+0000 7f7803e9b640 1 --2- 172.21.15.146:0/2668088192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77fc0b3d30 0x7f77fc15caa0 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.965+0000 7f7803e9b640 1 --2- 172.21.15.146:0/2668088192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77fc0b5ce0 0x7f77fc0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.965+0000 7f7803e9b640 1 -- 172.21.15.146:0/2668088192 >> 172.21.15.146:0/2668088192 conn(0x7f77fc0b7b20 msgr2=0x7f77fc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:19.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.965+0000 7f7803e9b640 1 -- 172.21.15.146:0/2668088192 shutdown_connections 2024-09-17T03:44:19.966 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.965+0000 7f7803e9b640 1 -- 172.21.15.146:0/2668088192 wait complete. 2024-09-17T03:44:19.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.967+0000 7f7803e9b640 1 Processor -- start 2024-09-17T03:44:19.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.967+0000 7f7803e9b640 1 -- start start 2024-09-17T03:44:19.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.968+0000 7f7803e9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77fc0b5750 0x7f77fc143b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.968+0000 7f7803e9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77fc0b5ce0 0x7f77fc1570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.968+0000 7f7803e9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77fc154740 0x7f77fc154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.968+0000 7f7803e9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc15d460 con 0x7f77fc0b5ce0 2024-09-17T03:44:19.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.968+0000 7f7803e9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc15d2e0 con 0x7f77fc0b5750 2024-09-17T03:44:19.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.968+0000 7f7803e9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f77fc15d5e0 con 0x7f77fc154740 2024-09-17T03:44:19.969 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.968+0000 7f7801436640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77fc0b5ce0 0x7f77fc1570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.968+0000 7f7801436640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77fc0b5ce0 0x7f77fc1570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50012/0 (socket says 172.21.15.146:50012) 2024-09-17T03:44:19.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.968+0000 7f7801436640 1 -- 172.21.15.146:0/3638068614 learned_addr learned my addr 172.21.15.146:0/3638068614 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:19.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.968+0000 7f7801c37640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77fc0b5750 0x7f77fc143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.968+0000 7f7802438640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77fc154740 0x7f77fc154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.969+0000 7f7801436640 1 -- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77fc154740 msgr2=0x7f77fc154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.969+0000 7f7801436640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77fc154740 0x7f77fc154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.969+0000 7f7801436640 1 -- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77fc0b5750 msgr2=0x7f77fc143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:19.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.969+0000 7f7801436640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77fc0b5750 0x7f77fc143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:19.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.969+0000 7f7801436640 1 -- 172.21.15.146:0/3638068614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc155090 con 0x7f77fc0b5ce0 2024-09-17T03:44:19.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.969+0000 7f7801436640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77fc0b5ce0 0x7f77fc1570e0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00b3f0 tx=0x7f77ec00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.969+0000 7f77f27fc640 1 -- 172.21.15.146:0/3638068614 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec015020 con 0x7f77fc0b5ce0 2024-09-17T03:44:19.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.969+0000 7f77f27fc640 1 -- 172.21.15.146:0/3638068614 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77ec011920 con 0x7f77fc0b5ce0 2024-09-17T03:44:19.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.969+0000 7f7803e9b640 1 -- 172.21.15.146:0/3638068614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77fc06df20 con 0x7f77fc0b5ce0 2024-09-17T03:44:19.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.969+0000 7f77f27fc640 1 -- 172.21.15.146:0/3638068614 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec011d70 con 0x7f77fc0b5ce0 2024-09-17T03:44:19.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.969+0000 7f7803e9b640 1 -- 172.21.15.146:0/3638068614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77fc06e4e0 con 0x7f77fc0b5ce0 2024-09-17T03:44:19.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.970+0000 7f7803e9b640 1 -- 172.21.15.146:0/3638068614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77fc15daa0 con 0x7f77fc0b5ce0 2024-09-17T03:44:19.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.971+0000 7f77f27fc640 1 -- 172.21.15.146:0/3638068614 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77ec018020 con 0x7f77fc0b5ce0 2024-09-17T03:44:19.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.972+0000 7f77f27fc640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e0078bc0 0x7f77e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:19.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.972+0000 7f77f27fc640 1 -- 172.21.15.146:0/3638068614 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f77ec09a8e0 con 0x7f77fc0b5ce0 2024-09-17T03:44:19.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.972+0000 7f7801c37640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e0078bc0 0x7f77e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:19.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.973+0000 7f7801c37640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e0078bc0 0x7f77e007b0d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f77f80058c0 tx=0x7f77f8005f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:19.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:19.977+0000 7f77f27fc640 1 -- 172.21.15.146:0/3638068614 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f77ec01f030 con 0x7f77fc0b5ce0 2024-09-17T03:44:20.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.174+0000 7f7803e9b640 1 -- 172.21.15.146:0/3638068614 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f77fc158bc0 con 0x7f77fc0b5ce0 2024-09-17T03:44:20.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.175+0000 7f77f27fc640 1 -- 172.21.15.146:0/3638068614 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v165) ==== 80+0+0 (secure 0 0 0) 0x7f77fc155090 con 0x7f77fc0b5ce0 2024-09-17T03:44:20.174 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:44:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 -- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e0078bc0 msgr2=0x7f77e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e0078bc0 0x7f77e007b0d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f77f80058c0 tx=0x7f77f8005f60 comp rx=0 tx=0).stop 2024-09-17T03:44:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 -- 172.21.15.146:0/3638068614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77fc0b5ce0 msgr2=0x7f77fc1570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77fc0b5ce0 0x7f77fc1570e0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00b3f0 tx=0x7f77ec00b8b0 comp rx=0 tx=0).stop 2024-09-17T03:44:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 -- 172.21.15.146:0/3638068614 shutdown_connections 2024-09-17T03:44:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e0078bc0 0x7f77e007b0d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77fc154740 0x7f77fc154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77fc0b5ce0 0x7f77fc1570e0 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 --2- 172.21.15.146:0/3638068614 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77fc0b5750 0x7f77fc143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 -- 172.21.15.146:0/3638068614 >> 172.21.15.146:0/3638068614 conn(0x7f77fc0b7b20 msgr2=0x7f77fc159770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 -- 172.21.15.146:0/3638068614 shutdown_connections 2024-09-17T03:44:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:20.177+0000 7f7803e9b640 1 -- 172.21.15.146:0/3638068614 wait complete. 2024-09-17T03:44:20.187 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:44:20.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:20.188 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:44:20.924 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:44:20.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:20.924 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:44:20.940 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:44:20.940 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:44:20.940 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:44:20.958 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:44:20.959 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:44:20.959 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:44:20.959 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:44:20.997 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:44:20.997 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:44:20.997 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:44:20.997 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:44:21.015 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:44:21.016 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:44:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.152+0000 7f2567139640 1 -- 172.21.15.146:0/1723286525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2548003a00 msgr2=0x7f2548003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.152+0000 7f2567139640 1 --2- 172.21.15.146:0/1723286525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2548003a00 0x7f2548003e70 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f2550009b50 tx=0x7f2548005830 comp rx=0 tx=0).stop 2024-09-17T03:44:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.152+0000 7f25656d6640 1 -- 172.21.15.146:0/1723286525 reap_dead start 2024-09-17T03:44:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.152+0000 7f2567139640 1 -- 172.21.15.146:0/1723286525 shutdown_connections 2024-09-17T03:44:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.152+0000 7f2567139640 1 -- 172.21.15.146:0/1723286525 >> 172.21.15.146:0/1723286525 conn(0x7f25600d11f0 msgr2=0x7f25600d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.152+0000 7f2567139640 1 -- 172.21.15.146:0/1723286525 shutdown_connections 2024-09-17T03:44:21.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.152+0000 7f2567139640 1 -- 172.21.15.146:0/1723286525 wait complete. 2024-09-17T03:44:21.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.154+0000 7f2567139640 1 Processor -- start 2024-09-17T03:44:21.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.154+0000 7f2567139640 1 -- start start 2024-09-17T03:44:21.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.155+0000 7f2567139640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2548003a00 0x7f25601f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.155+0000 7f2567139640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600cc3f0 0x7f25600ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.155+0000 7f2567139640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25600cab00 0x7f25600cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.155+0000 7f2567139640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f25600d0070 con 0x7f25600cab00 2024-09-17T03:44:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.155+0000 7f2567139640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f25600cfef0 con 0x7f2548003a00 2024-09-17T03:44:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.155+0000 7f2567139640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2560069220 con 0x7f25600cc3f0 2024-09-17T03:44:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f25656d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25600cab00 0x7f25600cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f25656d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25600cab00 0x7f25600cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50026/0 (socket says 172.21.15.146:50026) 2024-09-17T03:44:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f25656d6640 1 -- 172.21.15.146:0/1558588430 learned_addr learned my addr 172.21.15.146:0/1558588430 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f2564ed5640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2548003a00 0x7f25601f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f255ffff640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600cc3f0 0x7f25600ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f25656d6640 1 -- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600cc3f0 msgr2=0x7f25600ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f25656d6640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600cc3f0 0x7f25600ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f25656d6640 1 -- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2548003a00 msgr2=0x7f25601f6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f25656d6640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2548003a00 0x7f25601f6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f25656d6640 1 -- 172.21.15.146:0/1558588430 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25600cb930 con 0x7f25600cab00 2024-09-17T03:44:21.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f25656d6640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25600cab00 0x7f25600cdd20 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f2558001330 tx=0x7f255800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:21.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f255d7fa640 1 -- 172.21.15.146:0/1558588430 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255800cba0 con 0x7f25600cab00 2024-09-17T03:44:21.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f255d7fa640 1 -- 172.21.15.146:0/1558588430 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2558018070 con 0x7f25600cab00 2024-09-17T03:44:21.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f2567139640 1 -- 172.21.15.146:0/1558588430 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256015ab60 con 0x7f25600cab00 2024-09-17T03:44:21.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f255d7fa640 1 -- 172.21.15.146:0/1558588430 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25580116c0 con 0x7f25600cab00 2024-09-17T03:44:21.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.156+0000 7f2567139640 1 -- 172.21.15.146:0/1558588430 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25600cbed0 con 0x7f25600cab00 2024-09-17T03:44:21.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.157+0000 7f2567139640 1 -- 172.21.15.146:0/1558588430 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f256015a8d0 con 0x7f25600cab00 2024-09-17T03:44:21.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.158+0000 7f255d7fa640 1 -- 172.21.15.146:0/1558588430 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2558011860 con 0x7f25600cab00 2024-09-17T03:44:21.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.159+0000 7f255d7fa640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f254c078b90 0x7f254c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.159+0000 7f255d7fa640 1 -- 172.21.15.146:0/1558588430 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f255809b0e0 con 0x7f25600cab00 2024-09-17T03:44:21.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.159+0000 7f2564ed5640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f254c078b90 0x7f254c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.160+0000 7f2564ed5640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f254c078b90 0x7f254c07b0a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2550035000 tx=0x7f255002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.164+0000 7f255d7fa640 1 -- 172.21.15.146:0/1558588430 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f25580635b0 con 0x7f25600cab00 2024-09-17T03:44:21.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.377+0000 7f2567139640 1 -- 172.21.15.146:0/1558588430 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25600cef40 con 0x7f25600cab00 2024-09-17T03:44:21.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.377+0000 7f255d7fa640 1 -- 172.21.15.146:0/1558588430 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) ==== 95+0+5252 (secure 0 0 0) 0x7f2558062eb0 con 0x7f25600cab00 2024-09-17T03:44:21.377 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:21.377 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"btime":"2024-09-17T03:44:18:062384+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2920792926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2920792926},{"type":"v1","addr":"172.21.15.179:6837","nonce":2920792926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8917,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/154430395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":154430395},{"type":"v1","addr":"172.21.15.179:6836","nonce":154430395}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":128,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T03:43:54.003090+0000","modified":"2024-09-17T03:44:18.062369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10242":{"gid":10242,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/465040613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":465040613},{"type":"v1","addr":"172.21.15.146:6833","nonce":465040613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10251":{"gid":10251,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3868966088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868966088},{"type":"v1","addr":"172.21.15.146:6835","nonce":3868966088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10251,"qdb_cluster":[10251]},"id":12}]} 2024-09-17T03:44:21.377 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2024-09-17T03:44:21.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 -- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f254c078b90 msgr2=0x7f254c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f254c078b90 0x7f254c07b0a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2550035000 tx=0x7f255002d040 comp rx=0 tx=0).stop 2024-09-17T03:44:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 -- 172.21.15.146:0/1558588430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25600cab00 msgr2=0x7f25600cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25600cab00 0x7f25600cdd20 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f2558001330 tx=0x7f255800ed10 comp rx=0 tx=0).stop 2024-09-17T03:44:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 -- 172.21.15.146:0/1558588430 shutdown_connections 2024-09-17T03:44:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f254c078b90 0x7f254c07b0a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25600cab00 0x7f25600cdd20 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25600cc3f0 0x7f25600ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 --2- 172.21.15.146:0/1558588430 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2548003a00 0x7f25601f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 -- 172.21.15.146:0/1558588430 >> 172.21.15.146:0/1558588430 conn(0x7f25600d11f0 msgr2=0x7f25600b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 -- 172.21.15.146:0/1558588430 shutdown_connections 2024-09-17T03:44:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.379+0000 7f2567139640 1 -- 172.21.15.146:0/1558588430 wait complete. 2024-09-17T03:44:21.390 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:44:21.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.504+0000 7fac793c3640 1 -- 172.21.15.146:0/539448276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c004800 msgr2=0x7fac5c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.505+0000 7fac793c3640 1 --2- 172.21.15.146:0/539448276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c004800 0x7fac5c004c10 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fac740b10b0 tx=0x7fac5c005830 comp rx=0 tx=0).stop 2024-09-17T03:44:21.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.505+0000 7fac793c3640 1 -- 172.21.15.146:0/539448276 shutdown_connections 2024-09-17T03:44:21.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.505+0000 7fac793c3640 1 --2- 172.21.15.146:0/539448276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c004800 0x7fac5c004c10 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.505+0000 7fac793c3640 1 -- 172.21.15.146:0/539448276 >> 172.21.15.146:0/539448276 conn(0x7fac7406dd60 msgr2=0x7fac7406e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:21.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.505+0000 7fac793c3640 1 -- 172.21.15.146:0/539448276 shutdown_connections 2024-09-17T03:44:21.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.505+0000 7fac793c3640 1 -- 172.21.15.146:0/539448276 wait complete. 2024-09-17T03:44:21.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.506+0000 7fac793c3640 1 Processor -- start 2024-09-17T03:44:21.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.507+0000 7fac793c3640 1 -- start start 2024-09-17T03:44:21.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac793c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c004800 0x7fac74155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac793c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac740cfd20 0x7fac741f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac793c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac7415a9d0 0x7fac7415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac793c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fac7406fe70 con 0x7fac5c004800 2024-09-17T03:44:21.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac793c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fac7406fcf0 con 0x7fac740cfd20 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac793c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fac74073580 con 0x7fac7415a9d0 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac72ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c004800 0x7fac74155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac72ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c004800 0x7fac74155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50038/0 (socket says 172.21.15.146:50038) 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac72ffd640 1 -- 172.21.15.146:0/1800626364 learned_addr learned my addr 172.21.15.146:0/1800626364 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac727fc640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac740cfd20 0x7fac741f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac737fe640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac7415a9d0 0x7fac7415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac72ffd640 1 -- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac7415a9d0 msgr2=0x7fac7415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac72ffd640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac7415a9d0 0x7fac7415ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac72ffd640 1 -- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac740cfd20 msgr2=0x7fac741f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac72ffd640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac740cfd20 0x7fac741f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac72ffd640 1 -- 172.21.15.146:0/1800626364 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac741f8ff0 con 0x7fac5c004800 2024-09-17T03:44:21.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.508+0000 7fac72ffd640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c004800 0x7fac74155b20 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fac64004d90 tx=0x7fac64001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:21.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.509+0000 7fac5b7fe640 1 -- 172.21.15.146:0/1800626364 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64017070 con 0x7fac5c004800 2024-09-17T03:44:21.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.509+0000 7fac5b7fe640 1 -- 172.21.15.146:0/1800626364 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac640106b0 con 0x7fac5c004800 2024-09-17T03:44:21.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.509+0000 7fac793c3640 1 -- 172.21.15.146:0/1800626364 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac741f92d0 con 0x7fac5c004800 2024-09-17T03:44:21.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.509+0000 7fac5b7fe640 1 -- 172.21.15.146:0/1800626364 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64010ac0 con 0x7fac5c004800 2024-09-17T03:44:21.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.509+0000 7fac793c3640 1 -- 172.21.15.146:0/1800626364 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac740d0130 con 0x7fac5c004800 2024-09-17T03:44:21.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.510+0000 7fac793c3640 1 -- 172.21.15.146:0/1800626364 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac74073ae0 con 0x7fac5c004800 2024-09-17T03:44:21.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.510+0000 7fac5b7fe640 1 -- 172.21.15.146:0/1800626364 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac64010c60 con 0x7fac5c004800 2024-09-17T03:44:21.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.511+0000 7fac5b7fe640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac60078b90 0x7fac6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.511+0000 7fac5b7fe640 1 -- 172.21.15.146:0/1800626364 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fac6409a860 con 0x7fac5c004800 2024-09-17T03:44:21.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.511+0000 7fac727fc640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac60078b90 0x7fac6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.512+0000 7fac727fc640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac60078b90 0x7fac6007b0a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fac68035000 tx=0x7fac680046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:21.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.516+0000 7fac5b7fe640 1 -- 172.21.15.146:0/1800626364 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fac640625d0 con 0x7fac5c004800 2024-09-17T03:44:21.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.724+0000 7fac793c3640 1 -- 172.21.15.146:0/1800626364 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac740b3290 con 0x7fac5c004800 2024-09-17T03:44:21.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.725+0000 7fac5b7fe640 1 -- 172.21.15.146:0/1800626364 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) ==== 95+0+5252 (secure 0 0 0) 0x7fac6409a020 con 0x7fac5c004800 2024-09-17T03:44:21.724 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:21.724 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"btime":"2024-09-17T03:44:18:062384+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2920792926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2920792926},{"type":"v1","addr":"172.21.15.179:6837","nonce":2920792926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8917,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/154430395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":154430395},{"type":"v1","addr":"172.21.15.179:6836","nonce":154430395}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":128,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T03:43:54.003090+0000","modified":"2024-09-17T03:44:18.062369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10242":{"gid":10242,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/465040613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":465040613},{"type":"v1","addr":"172.21.15.146:6833","nonce":465040613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10251":{"gid":10251,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3868966088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868966088},{"type":"v1","addr":"172.21.15.146:6835","nonce":3868966088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10251,"qdb_cluster":[10251]},"id":12}]} 2024-09-17T03:44:21.724 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2024-09-17T03:44:21.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 -- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac60078b90 msgr2=0x7fac6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac60078b90 0x7fac6007b0a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fac68035000 tx=0x7fac680046c0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 -- 172.21.15.146:0/1800626364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c004800 msgr2=0x7fac74155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c004800 0x7fac74155b20 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fac64004d90 tx=0x7fac64001630 comp rx=0 tx=0).stop 2024-09-17T03:44:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 -- 172.21.15.146:0/1800626364 shutdown_connections 2024-09-17T03:44:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac60078b90 0x7fac6007b0a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fac7415a9d0 0x7fac7415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fac740cfd20 0x7fac741f5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 --2- 172.21.15.146:0/1800626364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c004800 0x7fac74155b20 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 -- 172.21.15.146:0/1800626364 >> 172.21.15.146:0/1800626364 conn(0x7fac7406dd60 msgr2=0x7fac7415e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 -- 172.21.15.146:0/1800626364 shutdown_connections 2024-09-17T03:44:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.727+0000 7fac793c3640 1 -- 172.21.15.146:0/1800626364 wait complete. 2024-09-17T03:44:21.738 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:44:21.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.852+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/1390856318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf5c004000 msgr2=0x7fcf5c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.852+0000 7fcf7a8bd640 1 --2- 172.21.15.146:0/1390856318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf5c004000 0x7fcf5c004800 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7fcf740b0700 tx=0x7fcf5c005830 comp rx=0 tx=0).stop 2024-09-17T03:44:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.852+0000 7fcf78e5a640 1 -- 172.21.15.146:0/1390856318 reap_dead start 2024-09-17T03:44:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.852+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/1390856318 shutdown_connections 2024-09-17T03:44:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.852+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/1390856318 >> 172.21.15.146:0/1390856318 conn(0x7fcf740b3410 msgr2=0x7fcf740b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.852+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/1390856318 shutdown_connections 2024-09-17T03:44:21.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.852+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/1390856318 wait complete. 2024-09-17T03:44:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.854+0000 7fcf7a8bd640 1 Processor -- start 2024-09-17T03:44:21.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.854+0000 7fcf7a8bd640 1 -- start start 2024-09-17T03:44:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.855+0000 7fcf7a8bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf5c004000 0x7fcf7415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.855+0000 7fcf7a8bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf740d1370 0x7fcf7414ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.855+0000 7fcf7a8bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740ce690 0x7fcf740ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.855+0000 7fcf7a8bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74070df0 con 0x7fcf740d1370 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.855+0000 7fcf7a8bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcf740b4eb0 con 0x7fcf5c004000 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.855+0000 7fcf7a8bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcf74070f70 con 0x7fcf740ce690 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.855+0000 7fcf737fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf740d1370 0x7fcf7414ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.855+0000 7fcf737fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf740d1370 0x7fcf7414ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50066/0 (socket says 172.21.15.146:50066) 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.855+0000 7fcf737fe640 1 -- 172.21.15.146:0/322860 learned_addr learned my addr 172.21.15.146:0/322860 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf737fe640 1 -- 172.21.15.146:0/322860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740ce690 msgr2=0x7fcf740ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf73fff640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf5c004000 0x7fcf7415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf78e5a640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740ce690 0x7fcf740ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf737fe640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740ce690 0x7fcf740ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf737fe640 1 -- 172.21.15.146:0/322860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf5c004000 msgr2=0x7fcf7415a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf737fe640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf5c004000 0x7fcf7415a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf737fe640 1 -- 172.21.15.146:0/322860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf741599b0 con 0x7fcf740d1370 2024-09-17T03:44:21.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf737fe640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf740d1370 0x7fcf7414ecc0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800c320 tx=0x7fcf68003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf70ff9640 1 -- 172.21.15.146:0/322860 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf68001cb0 con 0x7fcf740d1370 2024-09-17T03:44:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf70ff9640 1 -- 172.21.15.146:0/322860 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf680014d0 con 0x7fcf740d1370 2024-09-17T03:44:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf70ff9640 1 -- 172.21.15.146:0/322860 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6802e470 con 0x7fcf740d1370 2024-09-17T03:44:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/322860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf74159c90 con 0x7fcf740d1370 2024-09-17T03:44:21.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.856+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/322860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf740cf0f0 con 0x7fcf740d1370 2024-09-17T03:44:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.857+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/322860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf740d18c0 con 0x7fcf740d1370 2024-09-17T03:44:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.858+0000 7fcf70ff9640 1 -- 172.21.15.146:0/322860 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf68035020 con 0x7fcf740d1370 2024-09-17T03:44:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.859+0000 7fcf70ff9640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf60078bf0 0x7fcf6007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.859+0000 7fcf70ff9640 1 -- 172.21.15.146:0/322860 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fcf680bb0d0 con 0x7fcf740d1370 2024-09-17T03:44:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.859+0000 7fcf73fff640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf60078bf0 0x7fcf6007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:21.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.859+0000 7fcf73fff640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf60078bf0 0x7fcf6007b100 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009a40 tx=0x7fcf64005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:21.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:21.863+0000 7fcf70ff9640 1 -- 172.21.15.146:0/322860 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcf68047030 con 0x7fcf740d1370 2024-09-17T03:44:22.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.038+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/322860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf740b4530 con 0x7fcf740d1370 2024-09-17T03:44:22.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.039+0000 7fcf70ff9640 1 -- 172.21.15.146:0/322860 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16787 (secure 0 0 0) 0x7fcf6803e070 con 0x7fcf740d1370 2024-09-17T03:44:22.039 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:22.039 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":165,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:43:55.643610+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:43:51.685842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T03:43:52.965620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:44:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.041+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/322860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf60078bf0 msgr2=0x7fcf6007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.041+0000 7fcf7a8bd640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf60078bf0 0x7fcf6007b100 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009a40 tx=0x7fcf64005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.041+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/322860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf740d1370 msgr2=0x7fcf7414ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.041+0000 7fcf7a8bd640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf740d1370 0x7fcf7414ecc0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800c320 tx=0x7fcf68003e00 comp rx=0 tx=0).stop 2024-09-17T03:44:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.041+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/322860 shutdown_connections 2024-09-17T03:44:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.041+0000 7fcf7a8bd640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf60078bf0 0x7fcf6007b100 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.041+0000 7fcf7a8bd640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf740ce690 0x7fcf740ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.041+0000 7fcf7a8bd640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf740d1370 0x7fcf7414ecc0 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.041+0000 7fcf7a8bd640 1 --2- 172.21.15.146:0/322860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf5c004000 0x7fcf7415a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.041+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/322860 >> 172.21.15.146:0/322860 conn(0x7fcf740b3410 msgr2=0x7fcf740b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.042+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/322860 shutdown_connections 2024-09-17T03:44:22.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.042+0000 7fcf7a8bd640 1 -- 172.21.15.146:0/322860 wait complete. 2024-09-17T03:44:22.053 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:44:22.053 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:44:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.168+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/3821080511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd780d0710 msgr2=0x7fcd780cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.168+0000 7fcd7f3e6640 1 --2- 172.21.15.146:0/3821080511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd780d0710 0x7fcd780cf170 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7fcd780743d0 tx=0x7fcd6802a9c0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.168+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/3821080511 shutdown_connections 2024-09-17T03:44:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.168+0000 7fcd7f3e6640 1 --2- 172.21.15.146:0/3821080511 >> v2:172.21.15.179:3300/0 conn(0x7fcd780b47c0 0x7fcd78161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.168+0000 7fcd7f3e6640 1 --2- 172.21.15.146:0/3821080511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd780cf6b0 0x7fcd78161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.168+0000 7fcd7f3e6640 1 --2- 172.21.15.146:0/3821080511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd780d0710 0x7fcd780cf170 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.168+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/3821080511 >> 172.21.15.146:0/3821080511 conn(0x7fcd7809ba20 msgr2=0x7fcd780b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.168+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/3821080511 shutdown_connections 2024-09-17T03:44:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.168+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/3821080511 wait complete. 2024-09-17T03:44:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.170+0000 7fcd7f3e6640 1 Processor -- start 2024-09-17T03:44:22.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.170+0000 7fcd7f3e6640 1 -- start start 2024-09-17T03:44:22.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7f3e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd780b47c0 0x7fcd780b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7f3e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd780cf6b0 0x7fcd781f96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7f3e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd780d0710 0x7fcd781f9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7f3e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78162030 con 0x7fcd780b47c0 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7f3e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78161eb0 con 0x7fcd780d0710 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7f3e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcd780cd090 con 0x7fcd780cf6b0 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7d182640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd780b47c0 0x7fcd780b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7d182640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd780b47c0 0x7fcd780b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50086/0 (socket says 172.21.15.146:50086) 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7d182640 1 -- 172.21.15.146:0/379349072 learned_addr learned my addr 172.21.15.146:0/379349072 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7c981640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd780cf6b0 0x7fcd781f96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7d983640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd780d0710 0x7fcd781f9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7d182640 1 -- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd780cf6b0 msgr2=0x7fcd781f96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7d182640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd780cf6b0 0x7fcd781f96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7d182640 1 -- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd780d0710 msgr2=0x7fcd781f9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7d182640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd780d0710 0x7fcd781f9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7d182640 1 -- 172.21.15.146:0/379349072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd78159fe0 con 0x7fcd780b47c0 2024-09-17T03:44:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.171+0000 7fcd7d983640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd780d0710 0x7fcd781f9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.172+0000 7fcd7c981640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd780cf6b0 0x7fcd781f96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.172+0000 7fcd7d182640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd780b47c0 0x7fcd780b2b00 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7fcd68006010 tx=0x7fcd68003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.172+0000 7fcd75ffb640 1 -- 172.21.15.146:0/379349072 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd68034040 con 0x7fcd780b47c0 2024-09-17T03:44:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.172+0000 7fcd75ffb640 1 -- 172.21.15.146:0/379349072 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd68004640 con 0x7fcd780b47c0 2024-09-17T03:44:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.172+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/379349072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7815a2c0 con 0x7fcd780b47c0 2024-09-17T03:44:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.172+0000 7fcd75ffb640 1 -- 172.21.15.146:0/379349072 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd68045480 con 0x7fcd780b47c0 2024-09-17T03:44:22.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.172+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/379349072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd7815a880 con 0x7fcd780b47c0 2024-09-17T03:44:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.173+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/379349072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd780cf170 con 0x7fcd780b47c0 2024-09-17T03:44:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.174+0000 7fcd75ffb640 1 -- 172.21.15.146:0/379349072 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd68037020 con 0x7fcd780b47c0 2024-09-17T03:44:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.174+0000 7fcd75ffb640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd64078b90 0x7fcd6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.174+0000 7fcd75ffb640 1 -- 172.21.15.146:0/379349072 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fcd680bc6d0 con 0x7fcd780b47c0 2024-09-17T03:44:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.175+0000 7fcd7c981640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd64078b90 0x7fcd6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.175+0000 7fcd7c981640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd64078b90 0x7fcd6407b0a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fcd780c95a0 tx=0x7fcd6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:22.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.179+0000 7fcd75ffb640 1 -- 172.21.15.146:0/379349072 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcd68084ba0 con 0x7fcd780b47c0 2024-09-17T03:44:22.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.390+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/379349072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd780ced70 con 0x7fcd780b47c0 2024-09-17T03:44:22.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.391+0000 7fcd75ffb640 1 -- 172.21.15.146:0/379349072 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) ==== 95+0+5252 (secure 0 0 0) 0x7fcd680844a0 con 0x7fcd780b47c0 2024-09-17T03:44:22.390 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:22.390 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"btime":"2024-09-17T03:44:18:062384+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2920792926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2920792926},{"type":"v1","addr":"172.21.15.179:6837","nonce":2920792926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8917,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/154430395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":154430395},{"type":"v1","addr":"172.21.15.179:6836","nonce":154430395}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":128,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T03:43:54.003090+0000","modified":"2024-09-17T03:44:18.062369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10242":{"gid":10242,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/465040613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":465040613},{"type":"v1","addr":"172.21.15.146:6833","nonce":465040613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10251":{"gid":10251,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3868966088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868966088},{"type":"v1","addr":"172.21.15.146:6835","nonce":3868966088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10251,"qdb_cluster":[10251]},"id":12}]} 2024-09-17T03:44:22.390 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2024-09-17T03:44:22.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd64078b90 msgr2=0x7fcd6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd64078b90 0x7fcd6407b0a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fcd780c95a0 tx=0x7fcd6c008040 comp rx=0 tx=0).stop 2024-09-17T03:44:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/379349072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd780b47c0 msgr2=0x7fcd780b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd780b47c0 0x7fcd780b2b00 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7fcd68006010 tx=0x7fcd68003f90 comp rx=0 tx=0).stop 2024-09-17T03:44:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/379349072 shutdown_connections 2024-09-17T03:44:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd64078b90 0x7fcd6407b0a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd780d0710 0x7fcd781f9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd780cf6b0 0x7fcd781f96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 --2- 172.21.15.146:0/379349072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd780b47c0 0x7fcd780b2b00 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/379349072 >> 172.21.15.146:0/379349072 conn(0x7fcd7809ba20 msgr2=0x7fcd7815f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/379349072 shutdown_connections 2024-09-17T03:44:22.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.393+0000 7fcd7f3e6640 1 -- 172.21.15.146:0/379349072 wait complete. 2024-09-17T03:44:22.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:44:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.520+0000 7f89fe0d5640 1 -- 172.21.15.146:0/2278327668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89f815ef10 msgr2=0x7f89f806deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.520+0000 7f89fe0d5640 1 --2- 172.21.15.146:0/2278327668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89f815ef10 0x7f89f806deb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f89e8005fd0 tx=0x7f89e802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.521+0000 7f89fe0d5640 1 -- 172.21.15.146:0/2278327668 shutdown_connections 2024-09-17T03:44:22.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.521+0000 7f89fe0d5640 1 --2- 172.21.15.146:0/2278327668 >> v2:172.21.15.179:3300/0 conn(0x7f89f806e3f0 0x7f89f806e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.521+0000 7f89fe0d5640 1 --2- 172.21.15.146:0/2278327668 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89f815ef10 0x7f89f806deb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.521+0000 7f89fe0d5640 1 -- 172.21.15.146:0/2278327668 >> 172.21.15.146:0/2278327668 conn(0x7f89f80b7b20 msgr2=0x7f89f809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.521+0000 7f89fe0d5640 1 -- 172.21.15.146:0/2278327668 shutdown_connections 2024-09-17T03:44:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.521+0000 7f89fe0d5640 1 -- 172.21.15.146:0/2278327668 wait complete. 2024-09-17T03:44:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.522+0000 7f89fe0d5640 1 Processor -- start 2024-09-17T03:44:22.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.523+0000 7f89fe0d5640 1 -- start start 2024-09-17T03:44:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89fe0d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f806e3f0 0x7f89f809f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89fe0d5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89f806eed0 0x7f89f81538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89fe0d5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89f815ef10 0x7f89f8161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89fe0d5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f89f80b6f00 con 0x7f89f806e3f0 2024-09-17T03:44:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89fe0d5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f89f80b6d80 con 0x7f89f815ef10 2024-09-17T03:44:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89fe0d5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89f80b7080 con 0x7f89f806eed0 2024-09-17T03:44:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89f77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f806e3f0 0x7f89f809f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89f77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f806e3f0 0x7f89f809f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50088/0 (socket says 172.21.15.146:50088) 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89f77fe640 1 -- 172.21.15.146:0/1336974799 learned_addr learned my addr 172.21.15.146:0/1336974799 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89f6ffd640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89f806eed0 0x7f89f81538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89f7fff640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89f815ef10 0x7f89f8161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89f77fe640 1 -- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89f806eed0 msgr2=0x7f89f81538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89f77fe640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89f806eed0 0x7f89f81538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89f77fe640 1 -- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89f815ef10 msgr2=0x7f89f8161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89f77fe640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89f815ef10 0x7f89f8161550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89f77fe640 1 -- 172.21.15.146:0/1336974799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f8154770 con 0x7f89f806e3f0 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.524+0000 7f89f77fe640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f806e3f0 0x7f89f809f670 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009b30 tx=0x7f89e8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.525+0000 7f89dffff640 1 -- 172.21.15.146:0/1336974799 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8031990 con 0x7f89f806e3f0 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.525+0000 7f89dffff640 1 -- 172.21.15.146:0/1336974799 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89e8031c20 con 0x7f89f806e3f0 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.525+0000 7f89fe0d5640 1 -- 172.21.15.146:0/1336974799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f809e5d0 con 0x7f89f806e3f0 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.525+0000 7f89dffff640 1 -- 172.21.15.146:0/1336974799 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e80332d0 con 0x7f89f806e3f0 2024-09-17T03:44:22.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.525+0000 7f89fe0d5640 1 -- 172.21.15.146:0/1336974799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f809eb90 con 0x7f89f806e3f0 2024-09-17T03:44:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.526+0000 7f89fe0d5640 1 -- 172.21.15.146:0/1336974799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f80b7610 con 0x7f89f806e3f0 2024-09-17T03:44:22.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.526+0000 7f89dffff640 1 -- 172.21.15.146:0/1336974799 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f89e8033470 con 0x7f89f806e3f0 2024-09-17T03:44:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.527+0000 7f89dffff640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89e4078b90 0x7f89e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.527+0000 7f89dffff640 1 -- 172.21.15.146:0/1336974799 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f89e80bc080 con 0x7f89f806e3f0 2024-09-17T03:44:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.527+0000 7f89f6ffd640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89e4078b90 0x7f89e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.528+0000 7f89f6ffd640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89e4078b90 0x7f89e407b0a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f89f80b0960 tx=0x7f89ec005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:22.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.532+0000 7f89dffff640 1 -- 172.21.15.146:0/1336974799 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89e803f030 con 0x7f89f806e3f0 2024-09-17T03:44:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.743+0000 7f89fe0d5640 1 -- 172.21.15.146:0/1336974799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89f80b0990 con 0x7f89f806e3f0 2024-09-17T03:44:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.743+0000 7f89dffff640 1 -- 172.21.15.146:0/1336974799 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) ==== 95+0+5252 (secure 0 0 0) 0x7f89e80317b0 con 0x7f89f806e3f0 2024-09-17T03:44:22.743 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:22.743 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"btime":"2024-09-17T03:44:18:062384+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2920792926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2920792926},{"type":"v1","addr":"172.21.15.179:6837","nonce":2920792926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8917,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/154430395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":154430395},{"type":"v1","addr":"172.21.15.179:6836","nonce":154430395}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":128,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T03:43:54.003090+0000","modified":"2024-09-17T03:44:18.062369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10242":{"gid":10242,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.146:6833/465040613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":465040613},{"type":"v1","addr":"172.21.15.146:6833","nonce":465040613}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10251":{"gid":10251,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3868966088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868966088},{"type":"v1","addr":"172.21.15.146:6835","nonce":3868966088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10251,"qdb_cluster":[10251]},"id":12}]} 2024-09-17T03:44:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2024-09-17T03:44:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.745+0000 7f89fe0d5640 1 -- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89e4078b90 msgr2=0x7f89e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.745+0000 7f89fe0d5640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89e4078b90 0x7f89e407b0a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f89f80b0960 tx=0x7f89ec005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.745+0000 7f89fe0d5640 1 -- 172.21.15.146:0/1336974799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f806e3f0 msgr2=0x7f89f809f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.745+0000 7f89fe0d5640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f806e3f0 0x7f89f809f670 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009b30 tx=0x7f89e8003970 comp rx=0 tx=0).stop 2024-09-17T03:44:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.745+0000 7f89fe0d5640 1 -- 172.21.15.146:0/1336974799 shutdown_connections 2024-09-17T03:44:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.745+0000 7f89fe0d5640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f89e4078b90 0x7f89e407b0a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.745+0000 7f89fe0d5640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89f815ef10 0x7f89f8161550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.745+0000 7f89fe0d5640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89f806eed0 0x7f89f81538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.745+0000 7f89fe0d5640 1 --2- 172.21.15.146:0/1336974799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89f806e3f0 0x7f89f809f670 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.745+0000 7f89fe0d5640 1 -- 172.21.15.146:0/1336974799 >> 172.21.15.146:0/1336974799 conn(0x7f89f80b7b20 msgr2=0x7f89f80b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.746+0000 7f89fe0d5640 1 -- 172.21.15.146:0/1336974799 shutdown_connections 2024-09-17T03:44:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.746+0000 7f89fe0d5640 1 -- 172.21.15.146:0/1336974799 wait complete. 2024-09-17T03:44:22.757 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:44:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.873+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/4005920266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0806f270 msgr2=0x7f0b080d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.873+0000 7f0b0eb8b640 1 --2- 172.21.15.146:0/4005920266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0806f270 0x7f0b080d3190 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f0b00005fd0 tx=0x7f0b0002aa10 comp rx=0 tx=0).stop 2024-09-17T03:44:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.873+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/4005920266 shutdown_connections 2024-09-17T03:44:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.873+0000 7f0b0eb8b640 1 --2- 172.21.15.146:0/4005920266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0806f270 0x7f0b080d3190 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.873+0000 7f0b0eb8b640 1 --2- 172.21.15.146:0/4005920266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b080cf370 0x7f0b0806ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.873+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/4005920266 >> 172.21.15.146:0/4005920266 conn(0x7f0b080d4be0 msgr2=0x7f0b080d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.873+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/4005920266 shutdown_connections 2024-09-17T03:44:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.873+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/4005920266 wait complete. 2024-09-17T03:44:22.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.875+0000 7f0b0eb8b640 1 Processor -- start 2024-09-17T03:44:22.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.875+0000 7f0b0eb8b640 1 -- start start 2024-09-17T03:44:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0eb8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0806f270 0x7f0b080caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0eb8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b080b3870 0x7f0b080b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0eb8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b080cf370 0x7f0b081f9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0eb8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0b080d3ae0 con 0x7f0b0806f270 2024-09-17T03:44:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0eb8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0b080d3960 con 0x7f0b080b3870 2024-09-17T03:44:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0eb8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0b080d3c60 con 0x7f0b080cf370 2024-09-17T03:44:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0c927640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0806f270 0x7f0b080caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0c927640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0806f270 0x7f0b080caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50114/0 (socket says 172.21.15.146:50114) 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0c927640 1 -- 172.21.15.146:0/318051302 learned_addr learned my addr 172.21.15.146:0/318051302 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0d128640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b080cf370 0x7f0b081f9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b07fff640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b080b3870 0x7f0b080b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0c927640 1 -- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b080cf370 msgr2=0x7f0b081f9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0c927640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b080cf370 0x7f0b081f9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0c927640 1 -- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b080b3870 msgr2=0x7f0b080b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0c927640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b080b3870 0x7f0b080b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0c927640 1 -- 172.21.15.146:0/318051302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b080caf60 con 0x7f0b0806f270 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0c927640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0806f270 0x7f0b080caa20 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00c370 tx=0x7f0afc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b057fa640 1 -- 172.21.15.146:0/318051302 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc0052d0 con 0x7f0b0806f270 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b057fa640 1 -- 172.21.15.146:0/318051302 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0afc007020 con 0x7f0b0806f270 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/318051302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b081fa760 con 0x7f0b0806f270 2024-09-17T03:44:22.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.877+0000 7f0b057fa640 1 -- 172.21.15.146:0/318051302 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc007470 con 0x7f0b0806f270 2024-09-17T03:44:22.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.878+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/318051302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b080b6400 con 0x7f0b0806f270 2024-09-17T03:44:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.878+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/318051302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b080d3190 con 0x7f0b0806f270 2024-09-17T03:44:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.879+0000 7f0b057fa640 1 -- 172.21.15.146:0/318051302 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0afc0067d0 con 0x7f0b0806f270 2024-09-17T03:44:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.880+0000 7f0b057fa640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078bc0 0x7f0aec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.880+0000 7f0b057fa640 1 -- 172.21.15.146:0/318051302 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f0afc09a150 con 0x7f0b0806f270 2024-09-17T03:44:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.880+0000 7f0b07fff640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078bc0 0x7f0aec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:22.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.881+0000 7f0b07fff640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078bc0 0x7f0aec07b0d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0b080ceb60 tx=0x7f0af400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:22.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:22.884+0000 7f0b057fa640 1 -- 172.21.15.146:0/318051302 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b0806f680 con 0x7f0b0806f270 2024-09-17T03:44:23.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.059+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/318051302 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b080b35e0 con 0x7f0b0806f270 2024-09-17T03:44:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.061+0000 7f0b057fa640 1 -- 172.21.15.146:0/318051302 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16787 (secure 0 0 0) 0x7f0afc061f40 con 0x7f0b0806f270 2024-09-17T03:44:23.060 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:23.060 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":165,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:43:55.643610+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:43:51.685842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T03:43:52.965620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:44:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078bc0 msgr2=0x7f0aec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078bc0 0x7f0aec07b0d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0b080ceb60 tx=0x7f0af400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/318051302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0806f270 msgr2=0x7f0b080caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0806f270 0x7f0b080caa20 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00c370 tx=0x7f0afc00c830 comp rx=0 tx=0).stop 2024-09-17T03:44:23.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/318051302 shutdown_connections 2024-09-17T03:44:23.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0aec078bc0 0x7f0aec07b0d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b080cf370 0x7f0b081f9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b080b3870 0x7f0b080b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 --2- 172.21.15.146:0/318051302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0806f270 0x7f0b080caa20 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/318051302 >> 172.21.15.146:0/318051302 conn(0x7f0b080d4be0 msgr2=0x7f0b081620f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:23.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/318051302 shutdown_connections 2024-09-17T03:44:23.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.063+0000 7f0b0eb8b640 1 -- 172.21.15.146:0/318051302 wait complete. 2024-09-17T03:44:23.075 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:44:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.190+0000 7f6925e9b640 1 -- 172.21.15.146:0/2354570704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692015f1a0 msgr2=0x7f69200cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.190+0000 7f6925e9b640 1 --2- 172.21.15.146:0/2354570704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692015f1a0 0x7f69200cfca0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f692015cd70 tx=0x7f691002a980 comp rx=0 tx=0).stop 2024-09-17T03:44:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.191+0000 7f6925e9b640 1 -- 172.21.15.146:0/2354570704 shutdown_connections 2024-09-17T03:44:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.191+0000 7f6925e9b640 1 --2- 172.21.15.146:0/2354570704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69200b61f0 0x7f69200b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.191+0000 7f6925e9b640 1 --2- 172.21.15.146:0/2354570704 >> v2:172.21.15.179:3300/0 conn(0x7f69201631a0 0x7f69200cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.191+0000 7f6925e9b640 1 --2- 172.21.15.146:0/2354570704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692015f1a0 0x7f69200cfca0 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.191+0000 7f6925e9b640 1 -- 172.21.15.146:0/2354570704 >> 172.21.15.146:0/2354570704 conn(0x7f69200d11f0 msgr2=0x7f69200d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.191+0000 7f6925e9b640 1 -- 172.21.15.146:0/2354570704 shutdown_connections 2024-09-17T03:44:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.191+0000 7f6925e9b640 1 -- 172.21.15.146:0/2354570704 wait complete. 2024-09-17T03:44:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.192+0000 7f6925e9b640 1 Processor -- start 2024-09-17T03:44:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.193+0000 7f6925e9b640 1 -- start start 2024-09-17T03:44:23.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f6925e9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69200b61f0 0x7f6920154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:23.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f6925e9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f692015f1a0 0x7f6920153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f6925e9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69201631a0 0x7f69200ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f6925e9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69200693a0 con 0x7f69200b61f0 2024-09-17T03:44:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f6925e9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6920069220 con 0x7f69201631a0 2024-09-17T03:44:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f6925e9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6920069520 con 0x7f692015f1a0 2024-09-17T03:44:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69200b61f0 0x7f6920154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69200b61f0 0x7f6920154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50120/0 (socket says 172.21.15.146:50120) 2024-09-17T03:44:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691f7fe640 1 -- 172.21.15.146:0/2443125493 learned_addr learned my addr 172.21.15.146:0/2443125493 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691effd640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f692015f1a0 0x7f6920153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691ffff640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69201631a0 0x7f69200ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:23.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691f7fe640 1 -- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f692015f1a0 msgr2=0x7f6920153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691f7fe640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f692015f1a0 0x7f6920153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691f7fe640 1 -- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69201631a0 msgr2=0x7f69200ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691f7fe640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69201631a0 0x7f69200ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691f7fe640 1 -- 172.21.15.146:0/2443125493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6920155460 con 0x7f69200b61f0 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691effd640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f692015f1a0 0x7f6920153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691ffff640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69201631a0 0x7f69200ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.194+0000 7f691f7fe640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69200b61f0 0x7f6920154f20 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f6910009bf0 tx=0x7f6910003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.195+0000 7f6907fff640 1 -- 172.21.15.146:0/2443125493 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6910034040 con 0x7f69200b61f0 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.195+0000 7f6907fff640 1 -- 172.21.15.146:0/2443125493 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69100045c0 con 0x7f69200b61f0 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.195+0000 7f6925e9b640 1 -- 172.21.15.146:0/2443125493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69200c9300 con 0x7f69200b61f0 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.195+0000 7f6907fff640 1 -- 172.21.15.146:0/2443125493 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6910045480 con 0x7f69200b61f0 2024-09-17T03:44:23.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.195+0000 7f6925e9b640 1 -- 172.21.15.146:0/2443125493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69200c98c0 con 0x7f69200b61f0 2024-09-17T03:44:23.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.196+0000 7f6925e9b640 1 -- 172.21.15.146:0/2443125493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6920155630 con 0x7f69200b61f0 2024-09-17T03:44:23.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.196+0000 7f6907fff640 1 -- 172.21.15.146:0/2443125493 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6910037020 con 0x7f69200b61f0 2024-09-17T03:44:23.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.197+0000 7f6907fff640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f690c078bc0 0x7f690c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:23.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.197+0000 7f6907fff640 1 -- 172.21.15.146:0/2443125493 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f69100bc670 con 0x7f69200b61f0 2024-09-17T03:44:23.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.197+0000 7f691effd640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f690c078bc0 0x7f690c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:23.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.198+0000 7f691effd640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f690c078bc0 0x7f690c07b0d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6914005fd0 tx=0x7f6914005d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:23.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.201+0000 7f6907fff640 1 -- 172.21.15.146:0/2443125493 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6910084ac0 con 0x7f69200b61f0 2024-09-17T03:44:23.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.414+0000 7f6925e9b640 1 -- 172.21.15.146:0/2443125493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6920069a40 con 0x7f69200b61f0 2024-09-17T03:44:23.413 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:44:23.414+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:44:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.416+0000 7f6907fff640 1 -- 172.21.15.146:0/2443125493 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v129) ==== 161+0+0 (secure 0 0 0) 0x7f69100843c0 con 0x7f69200b61f0 2024-09-17T03:44:23.415 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:44:23.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.419+0000 7f6925e9b640 1 -- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f690c078bc0 msgr2=0x7f690c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.419+0000 7f6925e9b640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f690c078bc0 0x7f690c07b0d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6914005fd0 tx=0x7f6914005d10 comp rx=0 tx=0).stop 2024-09-17T03:44:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.419+0000 7f6925e9b640 1 -- 172.21.15.146:0/2443125493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69200b61f0 msgr2=0x7f6920154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.419+0000 7f6925e9b640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69200b61f0 0x7f6920154f20 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f6910009bf0 tx=0x7f6910003f90 comp rx=0 tx=0).stop 2024-09-17T03:44:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.419+0000 7f6925e9b640 1 -- 172.21.15.146:0/2443125493 shutdown_connections 2024-09-17T03:44:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.419+0000 7f6925e9b640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f690c078bc0 0x7f690c07b0d0 secure :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6914005fd0 tx=0x7f6914005d10 comp rx=0 tx=0).stop 2024-09-17T03:44:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.419+0000 7f6925e9b640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f69201631a0 0x7f69200ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.419+0000 7f6925e9b640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f692015f1a0 0x7f6920153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.419+0000 7f6925e9b640 1 --2- 172.21.15.146:0/2443125493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69200b61f0 0x7f6920154f20 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.419+0000 7f6925e9b640 1 -- 172.21.15.146:0/2443125493 >> 172.21.15.146:0/2443125493 conn(0x7f69200d11f0 msgr2=0x7f69200b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.420+0000 7f6925e9b640 1 -- 172.21.15.146:0/2443125493 shutdown_connections 2024-09-17T03:44:23.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.420+0000 7f6925e9b640 1 -- 172.21.15.146:0/2443125493 wait complete. 2024-09-17T03:44:23.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:44:23.483 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:44:23.490 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:44:23.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.557+0000 7f66d732b640 1 -- 172.21.15.146:0/3937994803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d00b5ce0 msgr2=0x7f66d00b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:23.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.557+0000 7f66d732b640 1 --2- 172.21.15.146:0/3937994803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d00b5ce0 0x7f66d00b1320 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f66cc005fd0 tx=0x7f66cc02a530 comp rx=0 tx=0).stop 2024-09-17T03:44:23.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.558+0000 7f66d732b640 1 -- 172.21.15.146:0/3937994803 shutdown_connections 2024-09-17T03:44:23.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.558+0000 7f66d732b640 1 --2- 172.21.15.146:0/3937994803 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d00b5750 0x7f66d00b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.558+0000 7f66d732b640 1 --2- 172.21.15.146:0/3937994803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d00b5ce0 0x7f66d00b1320 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.558+0000 7f66d732b640 1 -- 172.21.15.146:0/3937994803 >> 172.21.15.146:0/3937994803 conn(0x7f66d00b7b20 msgr2=0x7f66d009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:23.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.558+0000 7f66d732b640 1 -- 172.21.15.146:0/3937994803 shutdown_connections 2024-09-17T03:44:23.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.558+0000 7f66d732b640 1 -- 172.21.15.146:0/3937994803 wait complete. 2024-09-17T03:44:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.559+0000 7f66d732b640 1 Processor -- start 2024-09-17T03:44:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.559+0000 7f66d732b640 1 -- start start 2024-09-17T03:44:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d732b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d00b3b60 0x7f66d01f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d732b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d00b5750 0x7f66d0158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d732b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d00b5ce0 0x7f66d009f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d732b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66d00b27b0 con 0x7f66d00b3b60 2024-09-17T03:44:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d732b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f66d015dd00 con 0x7f66d00b5ce0 2024-09-17T03:44:23.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d732b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f66d00b2930 con 0x7f66d00b5750 2024-09-17T03:44:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d50c7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d00b3b60 0x7f66d01f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d50c7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d00b3b60 0x7f66d01f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50180/0 (socket says 172.21.15.146:50180) 2024-09-17T03:44:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d50c7640 1 -- 172.21.15.146:0/1265085986 learned_addr learned my addr 172.21.15.146:0/1265085986 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d48c6640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d00b5750 0x7f66d0158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d58c8640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d00b5ce0 0x7f66d009f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d50c7640 1 -- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d00b5750 msgr2=0x7f66d0158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d50c7640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d00b5750 0x7f66d0158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d50c7640 1 -- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d00b5ce0 msgr2=0x7f66d009f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d50c7640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d00b5ce0 0x7f66d009f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d50c7640 1 -- 172.21.15.146:0/1265085986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d01f7c60 con 0x7f66d00b3b60 2024-09-17T03:44:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d50c7640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d00b3b60 0x7f66d01f71a0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f66cc034040 tx=0x7f66cc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66c5ffb640 1 -- 172.21.15.146:0/1265085986 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc03e030 con 0x7f66d00b3b60 2024-09-17T03:44:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66c5ffb640 1 -- 172.21.15.146:0/1265085986 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66cc0047a0 con 0x7f66d00b3b60 2024-09-17T03:44:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66d732b640 1 -- 172.21.15.146:0/1265085986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d01f7f40 con 0x7f66d00b3b60 2024-09-17T03:44:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.561+0000 7f66c5ffb640 1 -- 172.21.15.146:0/1265085986 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc035040 con 0x7f66d00b3b60 2024-09-17T03:44:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.562+0000 7f66d732b640 1 -- 172.21.15.146:0/1265085986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d01f76e0 con 0x7f66d00b3b60 2024-09-17T03:44:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.563+0000 7f66d732b640 1 -- 172.21.15.146:0/1265085986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d0154c90 con 0x7f66d00b3b60 2024-09-17T03:44:23.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.563+0000 7f66c5ffb640 1 -- 172.21.15.146:0/1265085986 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66cc041030 con 0x7f66d00b3b60 2024-09-17T03:44:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.564+0000 7f66c5ffb640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b4078b90 0x7f66b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.564+0000 7f66c5ffb640 1 -- 172.21.15.146:0/1265085986 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5795+0+0 (secure 0 0 0) 0x7f66cc0bb690 con 0x7f66d00b3b60 2024-09-17T03:44:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.564+0000 7f66d48c6640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b4078b90 0x7f66b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.565+0000 7f66d48c6640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b4078b90 0x7f66b407b0a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f66c0005fd0 tx=0x7f66c0005d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.568+0000 7f66c5ffb640 1 -- 172.21.15.146:0/1265085986 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f66d00b3f70 con 0x7f66d00b3b60 2024-09-17T03:44:23.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:23.777+0000 7f66d732b640 1 -- 172.21.15.146:0/1265085986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f66d00b2de0 con 0x7f66d00b3b60 2024-09-17T03:44:24.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.425+0000 7f66c5ffb640 1 -- 172.21.15.146:0/1265085986 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v130) ==== 104+0+0 (secure 0 0 0) 0x7f66cc083b00 con 0x7f66d00b3b60 2024-09-17T03:44:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.427+0000 7f66d732b640 1 -- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b4078b90 msgr2=0x7f66b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.427+0000 7f66d732b640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b4078b90 0x7f66b407b0a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f66c0005fd0 tx=0x7f66c0005d80 comp rx=0 tx=0).stop 2024-09-17T03:44:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.427+0000 7f66d732b640 1 -- 172.21.15.146:0/1265085986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d00b3b60 msgr2=0x7f66d01f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.427+0000 7f66d732b640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d00b3b60 0x7f66d01f71a0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f66cc034040 tx=0x7f66cc0039e0 comp rx=0 tx=0).stop 2024-09-17T03:44:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.427+0000 7f66d732b640 1 -- 172.21.15.146:0/1265085986 shutdown_connections 2024-09-17T03:44:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.427+0000 7f66d732b640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f66b4078b90 0x7f66b407b0a0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.427+0000 7f66d732b640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f66d00b5ce0 0x7f66d009f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.427+0000 7f66d732b640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66d00b5750 0x7f66d0158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.427+0000 7f66d732b640 1 --2- 172.21.15.146:0/1265085986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66d00b3b60 0x7f66d01f71a0 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.427+0000 7f66d732b640 1 -- 172.21.15.146:0/1265085986 >> 172.21.15.146:0/1265085986 conn(0x7f66d00b7b20 msgr2=0x7f66d0070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.428+0000 7f66d732b640 1 -- 172.21.15.146:0/1265085986 shutdown_connections 2024-09-17T03:44:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.428+0000 7f66d732b640 1 -- 172.21.15.146:0/1265085986 wait complete. 2024-09-17T03:44:24.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:44:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.562+0000 7f6b90739640 1 -- 172.21.15.146:0/1913214275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b74004dd0 msgr2=0x7f6b740052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.562+0000 7f6b90739640 1 --2- 172.21.15.146:0/1913214275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b74004dd0 0x7f6b740052a0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000c640 tx=0x7f6b74005830 comp rx=0 tx=0).stop 2024-09-17T03:44:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.562+0000 7f6b8ecd6640 1 -- 172.21.15.146:0/1913214275 reap_dead start 2024-09-17T03:44:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.563+0000 7f6b90739640 1 -- 172.21.15.146:0/1913214275 shutdown_connections 2024-09-17T03:44:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.563+0000 7f6b90739640 1 -- 172.21.15.146:0/1913214275 >> 172.21.15.146:0/1913214275 conn(0x7f6b8806d3c0 msgr2=0x7f6b880b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.563+0000 7f6b90739640 1 -- 172.21.15.146:0/1913214275 shutdown_connections 2024-09-17T03:44:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.563+0000 7f6b90739640 1 -- 172.21.15.146:0/1913214275 wait complete. 2024-09-17T03:44:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.564+0000 7f6b90739640 1 Processor -- start 2024-09-17T03:44:24.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.564+0000 7f6b90739640 1 -- start start 2024-09-17T03:44:24.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b90739640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b74004dd0 0x7f6b880ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:24.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b90739640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b881509e0 0x7f6b880ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:24.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b90739640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b880ae840 0x7f6b881454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:24.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b90739640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8806fad0 con 0x7f6b880ae840 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b90739640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6b880d0930 con 0x7f6b74004dd0 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b90739640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6b8806fc50 con 0x7f6b881509e0 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b8ecd6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b880ae840 0x7f6b881454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b8ecd6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b880ae840 0x7f6b881454f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50202/0 (socket says 172.21.15.146:50202) 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b8ecd6640 1 -- 172.21.15.146:0/238450988 learned_addr learned my addr 172.21.15.146:0/238450988 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b8e4d5640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b74004dd0 0x7f6b880ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b8dcd4640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b881509e0 0x7f6b880ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b8ecd6640 1 -- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b881509e0 msgr2=0x7f6b880ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b8ecd6640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b881509e0 0x7f6b880ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b8ecd6640 1 -- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b74004dd0 msgr2=0x7f6b880ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b8ecd6640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b74004dd0 0x7f6b880ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:24.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b8ecd6640 1 -- 172.21.15.146:0/238450988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b880b1c30 con 0x7f6b880ae840 2024-09-17T03:44:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b8ecd6640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b880ae840 0x7f6b881454f0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000c760 tx=0x7f6b80001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.566+0000 7f6b7effd640 1 -- 172.21.15.146:0/238450988 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8002bae0 con 0x7f6b880ae840 2024-09-17T03:44:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.567+0000 7f6b7effd640 1 -- 172.21.15.146:0/238450988 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b8002bd70 con 0x7f6b880ae840 2024-09-17T03:44:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.567+0000 7f6b90739640 1 -- 172.21.15.146:0/238450988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b880b1f10 con 0x7f6b880ae840 2024-09-17T03:44:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.567+0000 7f6b7effd640 1 -- 172.21.15.146:0/238450988 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80006300 con 0x7f6b880ae840 2024-09-17T03:44:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.567+0000 7f6b90739640 1 -- 172.21.15.146:0/238450988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b880b24d0 con 0x7f6b880ae840 2024-09-17T03:44:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.567+0000 7f6b90739640 1 -- 172.21.15.146:0/238450988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b8815c9f0 con 0x7f6b880ae840 2024-09-17T03:44:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.568+0000 7f6b7effd640 1 -- 172.21.15.146:0/238450988 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b800064a0 con 0x7f6b880ae840 2024-09-17T03:44:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.569+0000 7f6b7effd640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b6c078b90 0x7f6b6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.569+0000 7f6b7effd640 1 -- 172.21.15.146:0/238450988 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5795+0+0 (secure 0 0 0) 0x7f6b800bad80 con 0x7f6b880ae840 2024-09-17T03:44:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.569+0000 7f6b8e4d5640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b6c078b90 0x7f6b6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.570+0000 7f6b8e4d5640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b6c078b90 0x7f6b6c07b0a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6b880b07a0 tx=0x7f6b84006d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.574+0000 7f6b7effd640 1 -- 172.21.15.146:0/238450988 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6b80082a90 con 0x7f6b880ae840 2024-09-17T03:44:24.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:24.750+0000 7f6b90739640 1 -- 172.21.15.146:0/238450988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6b880d1610 con 0x7f6b880ae840 2024-09-17T03:44:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.428+0000 7f6b7effd640 1 -- 172.21.15.146:0/238450988 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v167) ==== 181+0+0 (secure 0 0 0) 0x7f6b800874c0 con 0x7f6b880ae840 2024-09-17T03:44:25.427 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:44:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.430+0000 7f6b90739640 1 -- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b6c078b90 msgr2=0x7f6b6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.430+0000 7f6b90739640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b6c078b90 0x7f6b6c07b0a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6b880b07a0 tx=0x7f6b84006d80 comp rx=0 tx=0).stop 2024-09-17T03:44:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.430+0000 7f6b90739640 1 -- 172.21.15.146:0/238450988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b880ae840 msgr2=0x7f6b881454f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.430+0000 7f6b90739640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b880ae840 0x7f6b881454f0 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000c760 tx=0x7f6b80001aa0 comp rx=0 tx=0).stop 2024-09-17T03:44:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.430+0000 7f6b90739640 1 -- 172.21.15.146:0/238450988 shutdown_connections 2024-09-17T03:44:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.430+0000 7f6b90739640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b6c078b90 0x7f6b6c07b0a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.430+0000 7f6b90739640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b880ae840 0x7f6b881454f0 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.430+0000 7f6b90739640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b881509e0 0x7f6b880ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.430+0000 7f6b90739640 1 --2- 172.21.15.146:0/238450988 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b74004dd0 0x7f6b880ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.430+0000 7f6b90739640 1 -- 172.21.15.146:0/238450988 >> 172.21.15.146:0/238450988 conn(0x7f6b8806d3c0 msgr2=0x7f6b880cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.430+0000 7f6b90739640 1 -- 172.21.15.146:0/238450988 shutdown_connections 2024-09-17T03:44:25.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.431+0000 7f6b90739640 1 -- 172.21.15.146:0/238450988 wait complete. 2024-09-17T03:44:25.445 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:44:25.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.567+0000 7fedd56a9640 1 -- 172.21.15.146:0/3092385974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedbc003a30 msgr2=0x7fedbc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:25.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.567+0000 7fedd56a9640 1 --2- 172.21.15.146:0/3092385974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedbc003a30 0x7fedbc003ea0 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009b30 tx=0x7fedbc005830 comp rx=0 tx=0).stop 2024-09-17T03:44:25.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.567+0000 7fedcf7fe640 1 -- 172.21.15.146:0/3092385974 reap_dead start 2024-09-17T03:44:25.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.567+0000 7fedd56a9640 1 -- 172.21.15.146:0/3092385974 shutdown_connections 2024-09-17T03:44:25.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.567+0000 7fedd56a9640 1 -- 172.21.15.146:0/3092385974 >> 172.21.15.146:0/3092385974 conn(0x7fedd00d4be0 msgr2=0x7fedd00d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:25.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.568+0000 7fedd56a9640 1 -- 172.21.15.146:0/3092385974 shutdown_connections 2024-09-17T03:44:25.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.568+0000 7fedd56a9640 1 -- 172.21.15.146:0/3092385974 wait complete. 2024-09-17T03:44:25.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.569+0000 7fedd56a9640 1 Processor -- start 2024-09-17T03:44:25.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.569+0000 7fedd56a9640 1 -- start start 2024-09-17T03:44:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedd56a9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedbc003a30 0x7fedd00b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedd56a9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd00cb8a0 0x7fedd014c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedd56a9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedd015b850 0x7fedd014ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedd56a9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fedd00d38a0 con 0x7fedd00cb8a0 2024-09-17T03:44:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedd56a9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fedd00cf770 con 0x7fedd015b850 2024-09-17T03:44:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedd56a9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fedd00d3a20 con 0x7fedbc003a30 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedc67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd00cb8a0 0x7fedd014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedc67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd00cb8a0 0x7fedd014c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50222/0 (socket says 172.21.15.146:50222) 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedc67fc640 1 -- 172.21.15.146:0/1984303036 learned_addr learned my addr 172.21.15.146:0/1984303036 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedcf7fe640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedd015b850 0x7fedd014ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedceffd640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedbc003a30 0x7fedd00b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedc67fc640 1 -- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedbc003a30 msgr2=0x7fedd00b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedc67fc640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedbc003a30 0x7fedd00b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedc67fc640 1 -- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedd015b850 msgr2=0x7fedd014ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedc67fc640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedd015b850 0x7fedd014ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedc67fc640 1 -- 172.21.15.146:0/1984303036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd014d200 con 0x7fedd00cb8a0 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.571+0000 7fedc67fc640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd00cb8a0 0x7fedd014c780 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fedb8004f00 tx=0x7fedb8001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.572+0000 7fedc7fff640 1 -- 172.21.15.146:0/1984303036 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8015020 con 0x7fedd00cb8a0 2024-09-17T03:44:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.572+0000 7fedc7fff640 1 -- 172.21.15.146:0/1984303036 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedb8011960 con 0x7fedd00cb8a0 2024-09-17T03:44:25.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.572+0000 7fedc7fff640 1 -- 172.21.15.146:0/1984303036 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8011d70 con 0x7fedd00cb8a0 2024-09-17T03:44:25.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.572+0000 7fedd56a9640 1 -- 172.21.15.146:0/1984303036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd014d4b0 con 0x7fedd00cb8a0 2024-09-17T03:44:25.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.572+0000 7fedd56a9640 1 -- 172.21.15.146:0/1984303036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd015fb10 con 0x7fedd00cb8a0 2024-09-17T03:44:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.573+0000 7fedd56a9640 1 -- 172.21.15.146:0/1984303036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd00d3fb0 con 0x7fedd00cb8a0 2024-09-17T03:44:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.573+0000 7fedc7fff640 1 -- 172.21.15.146:0/1984303036 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fedb8018020 con 0x7fedd00cb8a0 2024-09-17T03:44:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.574+0000 7fedc7fff640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedb0078bc0 0x7fedb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.574+0000 7fedc7fff640 1 -- 172.21.15.146:0/1984303036 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5357+0+0 (secure 0 0 0) 0x7fedb809b5b0 con 0x7fedd00cb8a0 2024-09-17T03:44:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.574+0000 7fedceffd640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedb0078bc0 0x7fedb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:25.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.575+0000 7fedceffd640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedb0078bc0 0x7fedb007b0d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fedc0034000 tx=0x7fedc00046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:25.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.578+0000 7fedc7fff640 1 -- 172.21.15.146:0/1984303036 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fedb801f020 con 0x7fedd00cb8a0 2024-09-17T03:44:25.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:25.754+0000 7fedd56a9640 1 -- 172.21.15.146:0/1984303036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fedd00d2bd0 con 0x7fedd00cb8a0 2024-09-17T03:44:26.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.434+0000 7fedc7fff640 1 -- 172.21.15.146:0/1984303036 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v168) ==== 169+0+0 (secure 0 0 0) 0x7fedb8063480 con 0x7fedd00cb8a0 2024-09-17T03:44:26.434 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:44:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 -- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedb0078bc0 msgr2=0x7fedb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedb0078bc0 0x7fedb007b0d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fedc0034000 tx=0x7fedc00046c0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 -- 172.21.15.146:0/1984303036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd00cb8a0 msgr2=0x7fedd014c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd00cb8a0 0x7fedd014c780 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fedb8004f00 tx=0x7fedb8001630 comp rx=0 tx=0).stop 2024-09-17T03:44:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 -- 172.21.15.146:0/1984303036 shutdown_connections 2024-09-17T03:44:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fedb0078bc0 0x7fedb007b0d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fedd015b850 0x7fedd014ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedd00cb8a0 0x7fedd014c780 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 --2- 172.21.15.146:0/1984303036 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fedbc003a30 0x7fedd00b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 -- 172.21.15.146:0/1984303036 >> 172.21.15.146:0/1984303036 conn(0x7fedd00d4be0 msgr2=0x7fedd00cfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 -- 172.21.15.146:0/1984303036 shutdown_connections 2024-09-17T03:44:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.439+0000 7fedd56a9640 1 -- 172.21.15.146:0/1984303036 wait complete. 2024-09-17T03:44:26.458 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:44:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.577+0000 7f4386182640 1 -- 172.21.15.146:0/3105293344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43800b4530 msgr2=0x7f43800b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.577+0000 7f4386182640 1 --2- 172.21.15.146:0/3105293344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43800b4530 0x7f43800b4940 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f43801603a0 tx=0x7f436802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.577+0000 7f4386182640 1 -- 172.21.15.146:0/3105293344 shutdown_connections 2024-09-17T03:44:26.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.577+0000 7f4386182640 1 --2- 172.21.15.146:0/3105293344 >> v2:172.21.15.179:3300/0 conn(0x7f438006dd60 0x7f438006e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.577+0000 7f4386182640 1 --2- 172.21.15.146:0/3105293344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43800b4530 0x7f43800b4940 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.577+0000 7f4386182640 1 -- 172.21.15.146:0/3105293344 >> 172.21.15.146:0/3105293344 conn(0x7f43800b3410 msgr2=0x7f43800b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:26.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.577+0000 7f4386182640 1 -- 172.21.15.146:0/3105293344 shutdown_connections 2024-09-17T03:44:26.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.577+0000 7f4386182640 1 -- 172.21.15.146:0/3105293344 wait complete. 2024-09-17T03:44:26.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.578+0000 7f4386182640 1 Processor -- start 2024-09-17T03:44:26.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.578+0000 7f4386182640 1 -- start start 2024-09-17T03:44:26.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f4386182640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f438006dd60 0x7f43800aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:26.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f4386182640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43800b4530 0x7f43801f9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:26.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f4386182640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43800b55f0 0x7f438015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:26.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f4386182640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f438015bd10 con 0x7f438006dd60 2024-09-17T03:44:26.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f4386182640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f43800b5c10 con 0x7f43800b55f0 2024-09-17T03:44:26.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f4386182640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f438015be90 con 0x7f43800b4530 2024-09-17T03:44:26.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f438006dd60 0x7f43800aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:26.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f438006dd60 0x7f43800aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50252/0 (socket says 172.21.15.146:50252) 2024-09-17T03:44:26.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437f7fe640 1 -- 172.21.15.146:0/2463505050 learned_addr learned my addr 172.21.15.146:0/2463505050 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:26.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437ffff640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43800b55f0 0x7f438015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:26.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f4377fff640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43800b4530 0x7f43801f9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437f7fe640 1 -- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43800b4530 msgr2=0x7f43801f9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437f7fe640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43800b4530 0x7f43801f9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437f7fe640 1 -- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43800b55f0 msgr2=0x7f438015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437f7fe640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43800b55f0 0x7f438015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437f7fe640 1 -- 172.21.15.146:0/2463505050 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43801f5c00 con 0x7f438006dd60 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437ffff640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43800b55f0 0x7f438015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f4377fff640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43800b4530 0x7f43801f9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437f7fe640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f438006dd60 0x7f43800aef20 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f437000c370 tx=0x7f437000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.580+0000 7f437cff9640 1 -- 172.21.15.146:0/2463505050 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43700052d0 con 0x7f438006dd60 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.581+0000 7f437cff9640 1 -- 172.21.15.146:0/2463505050 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4370007020 con 0x7f438006dd60 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.581+0000 7f4386182640 1 -- 172.21.15.146:0/2463505050 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43801f5ee0 con 0x7f438006dd60 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.581+0000 7f437cff9640 1 -- 172.21.15.146:0/2463505050 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370007470 con 0x7f438006dd60 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.581+0000 7f4386182640 1 -- 172.21.15.146:0/2463505050 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43801f64a0 con 0x7f438006dd60 2024-09-17T03:44:26.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.581+0000 7f4386182640 1 -- 172.21.15.146:0/2463505050 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438006e170 con 0x7f438006dd60 2024-09-17T03:44:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.582+0000 7f437cff9640 1 -- 172.21.15.146:0/2463505050 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43700067d0 con 0x7f438006dd60 2024-09-17T03:44:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.583+0000 7f437cff9640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4360078b90 0x7f436007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:26.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.583+0000 7f437cff9640 1 -- 172.21.15.146:0/2463505050 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4943+0+0 (secure 0 0 0) 0x7f4370099e90 con 0x7f438006dd60 2024-09-17T03:44:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.583+0000 7f4377fff640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4360078b90 0x7f436007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:26.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.583+0000 7f4377fff640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4360078b90 0x7f436007b0a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4368033000 tx=0x7f4368004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.587+0000 7f437cff9640 1 -- 172.21.15.146:0/2463505050 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f438006e6b0 con 0x7f438006dd60 2024-09-17T03:44:26.800 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.801+0000 7f4386182640 1 -- 172.21.15.146:0/2463505050 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f438015c720 con 0x7f438006dd60 2024-09-17T03:44:26.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.805+0000 7f437cff9640 1 -- 172.21.15.146:0/2463505050 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v61) ==== 71+0+0 (secure 0 0 0) 0x7f4370062660 con 0x7f438006dd60 2024-09-17T03:44:26.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 -- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4360078b90 msgr2=0x7f436007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:26.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4360078b90 0x7f436007b0a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4368033000 tx=0x7f4368004730 comp rx=0 tx=0).stop 2024-09-17T03:44:26.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 -- 172.21.15.146:0/2463505050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f438006dd60 msgr2=0x7f43800aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:26.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f438006dd60 0x7f43800aef20 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f437000c370 tx=0x7f437000c830 comp rx=0 tx=0).stop 2024-09-17T03:44:26.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 -- 172.21.15.146:0/2463505050 shutdown_connections 2024-09-17T03:44:26.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4360078b90 0x7f436007b0a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f43800b55f0 0x7f438015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f43800b4530 0x7f43801f9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 --2- 172.21.15.146:0/2463505050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f438006dd60 0x7f43800aef20 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 -- 172.21.15.146:0/2463505050 >> 172.21.15.146:0/2463505050 conn(0x7f43800b3410 msgr2=0x7f43800d1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:26.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 -- 172.21.15.146:0/2463505050 shutdown_connections 2024-09-17T03:44:26.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.807+0000 7f4386182640 1 -- 172.21.15.146:0/2463505050 wait complete. 2024-09-17T03:44:26.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-17T03:44:26.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.932+0000 7f5a0cf21640 1 -- 172.21.15.146:0/4279539315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a0815c9f0 msgr2=0x7f5a081526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.932+0000 7f5a0cf21640 1 --2- 172.21.15.146:0/4279539315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a0815c9f0 0x7f5a081526a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5a0815d000 tx=0x7f59f802a890 comp rx=0 tx=0).stop 2024-09-17T03:44:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.932+0000 7f5a0cf21640 1 -- 172.21.15.146:0/4279539315 shutdown_connections 2024-09-17T03:44:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.932+0000 7f5a0cf21640 1 --2- 172.21.15.146:0/4279539315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a080b4100 0x7f5a0806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.932+0000 7f5a0cf21640 1 --2- 172.21.15.146:0/4279539315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a0815c9f0 0x7f5a081526a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.932+0000 7f5a0cf21640 1 -- 172.21.15.146:0/4279539315 >> 172.21.15.146:0/4279539315 conn(0x7f5a0806d3c0 msgr2=0x7f5a080b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.932+0000 7f5a0cf21640 1 -- 172.21.15.146:0/4279539315 shutdown_connections 2024-09-17T03:44:26.932 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.932+0000 7f5a0cf21640 1 -- 172.21.15.146:0/4279539315 wait complete. 2024-09-17T03:44:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.934+0000 7f5a0cf21640 1 Processor -- start 2024-09-17T03:44:26.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.934+0000 7f5a0cf21640 1 -- start start 2024-09-17T03:44:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.935+0000 7f5a0cf21640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a080b4100 0x7f5a08140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.935+0000 7f5a0cf21640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a080b4510 0x7f5a0814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.935+0000 7f5a0cf21640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a0814df20 0x7f5a0814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.935+0000 7f5a0cf21640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5a080d0730 con 0x7f5a080b4510 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.935+0000 7f5a0cf21640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5a080d05b0 con 0x7f5a0814df20 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.935+0000 7f5a0cf21640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5a080d08b0 con 0x7f5a080b4100 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.935+0000 7f5a05d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a080b4510 0x7f5a0814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.935+0000 7f5a0659c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a080b4100 0x7f5a08140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a0659c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a080b4100 0x7f5a08140610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.146:43042/0 (socket says 172.21.15.146:43042) 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a05d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a080b4510 0x7f5a0814d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50256/0 (socket says 172.21.15.146:50256) 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a0659c640 1 -- 172.21.15.146:0/1958600042 learned_addr learned my addr 172.21.15.146:0/1958600042 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a06d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a0814df20 0x7f5a0814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a0659c640 1 -- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a0814df20 msgr2=0x7f5a0814e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a0659c640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a0814df20 0x7f5a0814e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a0659c640 1 -- 172.21.15.146:0/1958600042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a080b4510 msgr2=0x7f5a0814d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a0659c640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a080b4510 0x7f5a0814d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a0659c640 1 -- 172.21.15.146:0/1958600042 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0814bf10 con 0x7f5a080b4100 2024-09-17T03:44:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a0659c640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a080b4100 0x7f5a08140610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009ca0 tx=0x7f59f8031610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f59feffd640 1 -- 172.21.15.146:0/1958600042 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8003e00 con 0x7f5a080b4100 2024-09-17T03:44:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f59feffd640 1 -- 172.21.15.146:0/1958600042 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59f8031a60 con 0x7f5a080b4100 2024-09-17T03:44:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a0cf21640 1 -- 172.21.15.146:0/1958600042 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0814c1f0 con 0x7f5a080b4100 2024-09-17T03:44:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f59feffd640 1 -- 172.21.15.146:0/1958600042 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f80330d0 con 0x7f5a080b4100 2024-09-17T03:44:26.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.936+0000 7f5a0cf21640 1 -- 172.21.15.146:0/1958600042 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a08154320 con 0x7f5a080b4100 2024-09-17T03:44:26.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.937+0000 7f5a0cf21640 1 -- 172.21.15.146:0/1958600042 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a08153e30 con 0x7f5a080b4100 2024-09-17T03:44:26.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.938+0000 7f59feffd640 1 -- 172.21.15.146:0/1958600042 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59f8066d10 con 0x7f5a080b4100 2024-09-17T03:44:26.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.938+0000 7f59feffd640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59e8078b90 0x7f59e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:26.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.939+0000 7f59feffd640 1 -- 172.21.15.146:0/1958600042 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(168..168 src has 1..168) ==== 4943+0+0 (secure 0 0 0) 0x7f59f80bbe00 con 0x7f5a080b4100 2024-09-17T03:44:26.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.939+0000 7f5a05d9b640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59e8078b90 0x7f59e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:26.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.939+0000 7f5a05d9b640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59e8078b90 0x7f59e807b0a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a0814c830 tx=0x7f59f0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:26.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:26.943+0000 7f59feffd640 1 -- 172.21.15.146:0/1958600042 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f59f803f030 con 0x7f5a080b4100 2024-09-17T03:44:27.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.182+0000 7f5a0cf21640 1 -- 172.21.15.146:0/1958600042 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f5a0815c9f0 con 0x7f5a080b4100 2024-09-17T03:44:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.440+0000 7f59feffd640 1 -- 172.21.15.146:0/1958600042 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v554) ==== 159+0+0 (secure 0 0 0) 0x7f59f8083fd0 con 0x7f5a080b4100 2024-09-17T03:44:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 -- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59e8078b90 msgr2=0x7f59e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59e8078b90 0x7f59e807b0a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a0814c830 tx=0x7f59f0005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 -- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a080b4100 msgr2=0x7f5a08140610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a080b4100 0x7f5a08140610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009ca0 tx=0x7f59f8031610 comp rx=0 tx=0).stop 2024-09-17T03:44:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 -- 172.21.15.146:0/1958600042 shutdown_connections 2024-09-17T03:44:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f59e8078b90 0x7f59e807b0a0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a0814df20 0x7f5a0814e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a080b4510 0x7f5a0814d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 --2- 172.21.15.146:0/1958600042 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a080b4100 0x7f5a08140610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 -- 172.21.15.146:0/1958600042 >> 172.21.15.146:0/1958600042 conn(0x7f5a0806d3c0 msgr2=0x7f5a0815e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 -- 172.21.15.146:0/1958600042 shutdown_connections 2024-09-17T03:44:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.442+0000 7f5a0cf21640 1 -- 172.21.15.146:0/1958600042 wait complete. 2024-09-17T03:44:27.453 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-17T03:44:27.454 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-17T03:44:27.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:44:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.569+0000 7fcd9ab69640 1 -- 172.21.15.146:0/760113450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd84003a30 msgr2=0x7fcd84003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.569+0000 7fcd9ab69640 1 --2- 172.21.15.146:0/760113450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd84003a30 0x7fcd84003ea0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800c3f0 tx=0x7fcd84005830 comp rx=0 tx=0).stop 2024-09-17T03:44:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.569+0000 7fcd99106640 1 -- 172.21.15.146:0/760113450 reap_dead start 2024-09-17T03:44:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.569+0000 7fcd9ab69640 1 -- 172.21.15.146:0/760113450 shutdown_connections 2024-09-17T03:44:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.569+0000 7fcd9ab69640 1 -- 172.21.15.146:0/760113450 >> 172.21.15.146:0/760113450 conn(0x7fcd940b7b20 msgr2=0x7fcd9409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.569+0000 7fcd9ab69640 1 -- 172.21.15.146:0/760113450 shutdown_connections 2024-09-17T03:44:27.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.569+0000 7fcd9ab69640 1 -- 172.21.15.146:0/760113450 wait complete. 2024-09-17T03:44:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.571+0000 7fcd9ab69640 1 Processor -- start 2024-09-17T03:44:27.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.571+0000 7fcd9ab69640 1 -- start start 2024-09-17T03:44:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd9ab69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd84003a30 0x7fcd9409e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd9ab69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9409d870 0x7fcd94154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd9ab69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd9409fd30 0x7fcd940a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd9ab69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9415d1b0 con 0x7fcd9409d870 2024-09-17T03:44:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd9ab69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcd940b38b0 con 0x7fcd9409fd30 2024-09-17T03:44:27.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd9ab69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcd9415d330 con 0x7fcd84003a30 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd93fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9409d870 0x7fcd94154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd93fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9409d870 0x7fcd94154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44922/0 (socket says 172.21.15.146:44922) 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd93fff640 1 -- 172.21.15.146:0/1532345051 learned_addr learned my addr 172.21.15.146:0/1532345051 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd98905640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd84003a30 0x7fcd9409e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd99106640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd9409fd30 0x7fcd940a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd93fff640 1 -- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd84003a30 msgr2=0x7fcd9409e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd93fff640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd84003a30 0x7fcd9409e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd93fff640 1 -- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd9409fd30 msgr2=0x7fcd940a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd93fff640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd9409fd30 0x7fcd940a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd93fff640 1 -- 172.21.15.146:0/1532345051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd940a0680 con 0x7fcd9409d870 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd93fff640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9409d870 0x7fcd94154d90 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7fcd80011a80 tx=0x7fcd80011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd917fa640 1 -- 172.21.15.146:0/1532345051 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000fe10 con 0x7fcd9409d870 2024-09-17T03:44:27.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd917fa640 1 -- 172.21.15.146:0/1532345051 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd80016070 con 0x7fcd9409d870 2024-09-17T03:44:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd9ab69640 1 -- 172.21.15.146:0/1532345051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd941552d0 con 0x7fcd9409d870 2024-09-17T03:44:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd917fa640 1 -- 172.21.15.146:0/1532345051 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80012690 con 0x7fcd9409d870 2024-09-17T03:44:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.573+0000 7fcd9ab69640 1 -- 172.21.15.146:0/1532345051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd94155770 con 0x7fcd9409d870 2024-09-17T03:44:27.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.574+0000 7fcd9ab69640 1 -- 172.21.15.146:0/1532345051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd9415d8c0 con 0x7fcd9409d870 2024-09-17T03:44:27.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.575+0000 7fcd917fa640 1 -- 172.21.15.146:0/1532345051 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd80018030 con 0x7fcd9409d870 2024-09-17T03:44:27.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.576+0000 7fcd917fa640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd78078b90 0x7fcd7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:27.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.576+0000 7fcd917fa640 1 -- 172.21.15.146:0/1532345051 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4943+0+0 (secure 0 0 0) 0x7fcd8009b190 con 0x7fcd9409d870 2024-09-17T03:44:27.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.576+0000 7fcd98905640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd78078b90 0x7fcd7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:27.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.577+0000 7fcd98905640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd78078b90 0x7fcd7807b0a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fcd88033000 tx=0x7fcd8802d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:27.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.580+0000 7fcd917fa640 1 -- 172.21.15.146:0/1532345051 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcd800633a0 con 0x7fcd9409d870 2024-09-17T03:44:27.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.755+0000 7fcd9ab69640 1 -- 172.21.15.146:0/1532345051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd9409ed70 con 0x7fcd9409d870 2024-09-17T03:44:27.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.756+0000 7fcd917fa640 1 -- 172.21.15.146:0/1532345051 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) ==== 74+0+13092 (secure 0 0 0) 0x7fcd80067dd0 con 0x7fcd9409d870 2024-09-17T03:44:27.755 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:27.756 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":168,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:44:26.428727+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/3868966088":"2024-09-18T03:44:23.414963+0000","172.21.15.146:6834/3868966088":"2024-09-18T03:44:23.414963+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:44:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.758+0000 7fcd9ab69640 1 -- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd78078b90 msgr2=0x7fcd7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.758+0000 7fcd9ab69640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd78078b90 0x7fcd7807b0a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fcd88033000 tx=0x7fcd8802d040 comp rx=0 tx=0).stop 2024-09-17T03:44:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.758+0000 7fcd9ab69640 1 -- 172.21.15.146:0/1532345051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9409d870 msgr2=0x7fcd94154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.758+0000 7fcd9ab69640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9409d870 0x7fcd94154d90 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7fcd80011a80 tx=0x7fcd80011f40 comp rx=0 tx=0).stop 2024-09-17T03:44:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.759+0000 7fcd9ab69640 1 -- 172.21.15.146:0/1532345051 shutdown_connections 2024-09-17T03:44:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.759+0000 7fcd9ab69640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcd78078b90 0x7fcd7807b0a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.759+0000 7fcd9ab69640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcd9409fd30 0x7fcd940a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.759+0000 7fcd9ab69640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9409d870 0x7fcd94154d90 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.759+0000 7fcd9ab69640 1 --2- 172.21.15.146:0/1532345051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcd84003a30 0x7fcd9409e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.759+0000 7fcd9ab69640 1 -- 172.21.15.146:0/1532345051 >> 172.21.15.146:0/1532345051 conn(0x7fcd940b7b20 msgr2=0x7fcd9415fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.759+0000 7fcd9ab69640 1 -- 172.21.15.146:0/1532345051 shutdown_connections 2024-09-17T03:44:27.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.759+0000 7fcd9ab69640 1 -- 172.21.15.146:0/1532345051 wait complete. 2024-09-17T03:44:27.769 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:44:27.770 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:44:27.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.886+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/1193903990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2df80b3870 msgr2=0x7f2df80cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.886+0000 7f2dfd5f1640 1 --2- 172.21.15.146:0/1193903990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2df80b3870 0x7f2df80cf370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009830 tx=0x7f2de802a480 comp rx=0 tx=0).stop 2024-09-17T03:44:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.886+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/1193903990 shutdown_connections 2024-09-17T03:44:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.886+0000 7f2dfd5f1640 1 --2- 172.21.15.146:0/1193903990 >> v2:172.21.15.179:3300/0 conn(0x7f2df806f440 0x7f2df80d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.886+0000 7f2dfd5f1640 1 --2- 172.21.15.146:0/1193903990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2df80b3870 0x7f2df80cf370 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.886+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/1193903990 >> 172.21.15.146:0/1193903990 conn(0x7f2df80d4be0 msgr2=0x7f2df80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.886+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/1193903990 shutdown_connections 2024-09-17T03:44:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.886+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/1193903990 wait complete. 2024-09-17T03:44:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.888+0000 7f2dfd5f1640 1 Processor -- start 2024-09-17T03:44:27.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.888+0000 7f2dfd5f1640 1 -- start start 2024-09-17T03:44:27.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.889+0000 7f2dfd5f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2df80b3870 0x7f2df80b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:27.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.889+0000 7f2dfd5f1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df81620f0 0x7f2df81e86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:27.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.889+0000 7f2dfd5f1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2df81ea3a0 0x7f2df81ea7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:27.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.889+0000 7f2dfd5f1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2df80d3ae0 con 0x7f2df81620f0 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.889+0000 7f2dfd5f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2df80d3960 con 0x7f2df80b3870 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.889+0000 7f2dfd5f1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2df80d3c60 con 0x7f2df81ea3a0 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.889+0000 7f2dee7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df81620f0 0x7f2df81e86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.889+0000 7f2dee7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df81620f0 0x7f2df81e86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44932/0 (socket says 172.21.15.146:44932) 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.889+0000 7f2dee7fc640 1 -- 172.21.15.146:0/453154578 learned_addr learned my addr 172.21.15.146:0/453154578 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.889+0000 7f2df77fe640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2df81ea3a0 0x7f2df81ea7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.889+0000 7f2df6ffd640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2df80b3870 0x7f2df80b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.890+0000 7f2dee7fc640 1 -- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2df81ea3a0 msgr2=0x7f2df81ea7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.890+0000 7f2dee7fc640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2df81ea3a0 0x7f2df81ea7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.890+0000 7f2dee7fc640 1 -- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2df80b3870 msgr2=0x7f2df80b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.890+0000 7f2dee7fc640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2df80b3870 0x7f2df80b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.890+0000 7f2dee7fc640 1 -- 172.21.15.146:0/453154578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df81eacf0 con 0x7f2df81620f0 2024-09-17T03:44:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.890+0000 7f2dee7fc640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df81620f0 0x7f2df81e86a0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f2de000c400 tx=0x7f2de000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.890+0000 7f2deffff640 1 -- 172.21.15.146:0/453154578 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0011790 con 0x7f2df81620f0 2024-09-17T03:44:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.890+0000 7f2deffff640 1 -- 172.21.15.146:0/453154578 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2de0017070 con 0x7f2df81620f0 2024-09-17T03:44:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.890+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/453154578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df81e8fd0 con 0x7f2df81620f0 2024-09-17T03:44:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.890+0000 7f2deffff640 1 -- 172.21.15.146:0/453154578 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0011cc0 con 0x7f2df81620f0 2024-09-17T03:44:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.890+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/453154578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df81e9590 con 0x7f2df81620f0 2024-09-17T03:44:27.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.891+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/453154578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df80d3190 con 0x7f2df81620f0 2024-09-17T03:44:27.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.892+0000 7f2deffff640 1 -- 172.21.15.146:0/453154578 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2de001c460 con 0x7f2df81620f0 2024-09-17T03:44:27.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.893+0000 7f2deffff640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dd8078b90 0x7f2dd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:27.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.893+0000 7f2deffff640 1 -- 172.21.15.146:0/453154578 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4943+0+0 (secure 0 0 0) 0x7f2de009a340 con 0x7f2df81620f0 2024-09-17T03:44:27.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.893+0000 7f2df6ffd640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dd8078b90 0x7f2dd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:27.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.893+0000 7f2df6ffd640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dd8078b90 0x7f2dd807b0a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2de8034000 tx=0x7f2de8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:27.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:27.897+0000 7f2deffff640 1 -- 172.21.15.146:0/453154578 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2de0021020 con 0x7f2df81620f0 2024-09-17T03:44:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.074+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/453154578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2df80d2bd0 con 0x7f2df81620f0 2024-09-17T03:44:28.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.074+0000 7f2deffff640 1 -- 172.21.15.146:0/453154578 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v168) ==== 93+0+10 (secure 0 0 0) 0x7f2df81eacf0 con 0x7f2df81620f0 2024-09-17T03:44:28.073 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.076+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dd8078b90 msgr2=0x7f2dd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.076+0000 7f2dfd5f1640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dd8078b90 0x7f2dd807b0a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2de8034000 tx=0x7f2de8004730 comp rx=0 tx=0).stop 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.076+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/453154578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df81620f0 msgr2=0x7f2df81e86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.076+0000 7f2dfd5f1640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df81620f0 0x7f2df81e86a0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f2de000c400 tx=0x7f2de000c800 comp rx=0 tx=0).stop 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.076+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/453154578 shutdown_connections 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.076+0000 7f2dfd5f1640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2dd8078b90 0x7f2dd807b0a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.076+0000 7f2dfd5f1640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2df81ea3a0 0x7f2df81ea7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.076+0000 7f2dfd5f1640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2df81620f0 0x7f2df81e86a0 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.076+0000 7f2dfd5f1640 1 --2- 172.21.15.146:0/453154578 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2df80b3870 0x7f2df80b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.076+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/453154578 >> 172.21.15.146:0/453154578 conn(0x7f2df80d4be0 msgr2=0x7f2df80b6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.077+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/453154578 shutdown_connections 2024-09-17T03:44:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.077+0000 7f2dfd5f1640 1 -- 172.21.15.146:0/453154578 wait complete. 2024-09-17T03:44:28.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-17T03:44:28.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.201+0000 7f4ccc4de640 1 -- 172.21.15.146:0/3383080638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc40701e0 msgr2=0x7f4cc40cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.201+0000 7f4ccc4de640 1 --2- 172.21.15.146:0/3383080638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc40701e0 0x7f4cc40cfea0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009830 tx=0x7f4cbc02a510 comp rx=0 tx=0).stop 2024-09-17T03:44:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.201+0000 7f4ccc4de640 1 -- 172.21.15.146:0/3383080638 shutdown_connections 2024-09-17T03:44:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.201+0000 7f4ccc4de640 1 --2- 172.21.15.146:0/3383080638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc40701e0 0x7f4cc40cfea0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.201+0000 7f4ccc4de640 1 -- 172.21.15.146:0/3383080638 >> 172.21.15.146:0/3383080638 conn(0x7f4cc406d3c0 msgr2=0x7f4cc40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.201+0000 7f4ccc4de640 1 -- 172.21.15.146:0/3383080638 shutdown_connections 2024-09-17T03:44:28.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.201+0000 7f4ccc4de640 1 -- 172.21.15.146:0/3383080638 wait complete. 2024-09-17T03:44:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.203+0000 7f4ccc4de640 1 Processor -- start 2024-09-17T03:44:28.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.203+0000 7f4ccc4de640 1 -- start start 2024-09-17T03:44:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.204+0000 7f4ccc4de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc40b4100 0x7f4cc40b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.204+0000 7f4ccc4de640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc41f2970 0x7f4cc40aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.204+0000 7f4ccc4de640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc41f5ed0 0x7f4cc414c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.204+0000 7f4ccc4de640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc40d0560 con 0x7f4cc41f2970 2024-09-17T03:44:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.204+0000 7f4ccc4de640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc40d03e0 con 0x7f4cc41f5ed0 2024-09-17T03:44:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.204+0000 7f4ccc4de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc40d06e0 con 0x7f4cc40b4100 2024-09-17T03:44:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.204+0000 7f4cc9a79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc41f2970 0x7f4cc40aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.204+0000 7f4cc9a79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc41f2970 0x7f4cc40aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44948/0 (socket says 172.21.15.146:44948) 2024-09-17T03:44:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.204+0000 7f4cc9a79640 1 -- 172.21.15.146:0/999325684 learned_addr learned my addr 172.21.15.146:0/999325684 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:28.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4ccaa7b640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc41f5ed0 0x7f4cc414c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4cca27a640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc40b4100 0x7f4cc40b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4cc9a79640 1 -- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc40b4100 msgr2=0x7f4cc40b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4cc9a79640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc40b4100 0x7f4cc40b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4cc9a79640 1 -- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc41f5ed0 msgr2=0x7f4cc414c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4cc9a79640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc41f5ed0 0x7f4cc414c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4cc9a79640 1 -- 172.21.15.146:0/999325684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc40b2730 con 0x7f4cc41f2970 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4cc9a79640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc41f2970 0x7f4cc40aab50 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800b3f0 tx=0x7f4cb800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4cc2ffd640 1 -- 172.21.15.146:0/999325684 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800f8a0 con 0x7f4cc41f2970 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4cc2ffd640 1 -- 172.21.15.146:0/999325684 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cb800fb30 con 0x7f4cc41f2970 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4ccc4de640 1 -- 172.21.15.146:0/999325684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc41f1e90 con 0x7f4cc41f2970 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4cc2ffd640 1 -- 172.21.15.146:0/999325684 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8010470 con 0x7f4cc41f2970 2024-09-17T03:44:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.205+0000 7f4ccc4de640 1 -- 172.21.15.146:0/999325684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc41f2450 con 0x7f4cc41f2970 2024-09-17T03:44:28.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.206+0000 7f4ccc4de640 1 -- 172.21.15.146:0/999325684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc40b24a0 con 0x7f4cc41f2970 2024-09-17T03:44:28.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.207+0000 7f4cc2ffd640 1 -- 172.21.15.146:0/999325684 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4cb8010610 con 0x7f4cc41f2970 2024-09-17T03:44:28.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.207+0000 7f4cc2ffd640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078b90 0x7f4cb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:28.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.207+0000 7f4cc2ffd640 1 -- 172.21.15.146:0/999325684 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4943+0+0 (secure 0 0 0) 0x7f4cb809c880 con 0x7f4cc41f2970 2024-09-17T03:44:28.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.208+0000 7f4cca27a640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078b90 0x7f4cb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:28.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.208+0000 7f4cca27a640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078b90 0x7f4cb007b0a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40b07a0 tx=0x7f4cb40019f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:28.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.212+0000 7f4cc2ffd640 1 -- 172.21.15.146:0/999325684 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4cb8015030 con 0x7f4cc41f2970 2024-09-17T03:44:28.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:28.456+0000 7f4ccc4de640 1 -- 172.21.15.146:0/999325684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f4cc41f1c80 con 0x7f4cc41f2970 2024-09-17T03:44:29.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.443+0000 7f4cc2ffd640 1 -- 172.21.15.146:0/999325684 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v556) ==== 143+0+0 (secure 0 0 0) 0x7f4cb8064970 con 0x7f4cc41f2970 2024-09-17T03:44:29.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.446+0000 7f4ccc4de640 1 -- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078b90 msgr2=0x7f4cb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:29.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.446+0000 7f4ccc4de640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078b90 0x7f4cb007b0a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40b07a0 tx=0x7f4cb40019f0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.446+0000 7f4ccc4de640 1 -- 172.21.15.146:0/999325684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc41f2970 msgr2=0x7f4cc40aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:29.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.446+0000 7f4ccc4de640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc41f2970 0x7f4cc40aab50 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800b3f0 tx=0x7f4cb800b8b0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.447+0000 7f4ccc4de640 1 -- 172.21.15.146:0/999325684 shutdown_connections 2024-09-17T03:44:29.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.447+0000 7f4ccc4de640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4cb0078b90 0x7f4cb007b0a0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.447+0000 7f4ccc4de640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4cc41f5ed0 0x7f4cc414c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.447+0000 7f4ccc4de640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4cc41f2970 0x7f4cc40aab50 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.447+0000 7f4ccc4de640 1 --2- 172.21.15.146:0/999325684 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4cc40b4100 0x7f4cc40b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.447+0000 7f4ccc4de640 1 -- 172.21.15.146:0/999325684 >> 172.21.15.146:0/999325684 conn(0x7f4cc406d3c0 msgr2=0x7f4cc4151260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:29.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.447+0000 7f4ccc4de640 1 -- 172.21.15.146:0/999325684 shutdown_connections 2024-09-17T03:44:29.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.447+0000 7f4ccc4de640 1 -- 172.21.15.146:0/999325684 wait complete. 2024-09-17T03:44:29.460 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:44:29.544 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:44:29.547 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:44:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.582+0000 7f810780a640 1 -- 172.21.15.146:0/946268251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81000b4f30 msgr2=0x7f810015b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.582+0000 7f810780a640 1 --2- 172.21.15.146:0/946268251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81000b4f30 0x7f810015b770 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009830 tx=0x7f80fc02a510 comp rx=0 tx=0).stop 2024-09-17T03:44:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.582+0000 7f810780a640 1 -- 172.21.15.146:0/946268251 shutdown_connections 2024-09-17T03:44:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.582+0000 7f810780a640 1 --2- 172.21.15.146:0/946268251 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8100074ae0 0x7f810006f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.582+0000 7f810780a640 1 --2- 172.21.15.146:0/946268251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81000b4f30 0x7f810015b770 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.582+0000 7f810780a640 1 -- 172.21.15.146:0/946268251 >> 172.21.15.146:0/946268251 conn(0x7f81000b2db0 msgr2=0x7f81000b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.582+0000 7f810780a640 1 -- 172.21.15.146:0/946268251 shutdown_connections 2024-09-17T03:44:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.582+0000 7f810780a640 1 -- 172.21.15.146:0/946268251 wait complete. 2024-09-17T03:44:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.584+0000 7f810780a640 1 Processor -- start 2024-09-17T03:44:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.584+0000 7f810780a640 1 -- start start 2024-09-17T03:44:29.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.585+0000 7f810780a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81000b3c90 0x7f810009e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:29.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.585+0000 7f810780a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81000b4f30 0x7f8100158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:29.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.585+0000 7f810780a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81001f4ac0 0x7f81001546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:29.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.585+0000 7f810780a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f81000af300 con 0x7f81000b3c90 2024-09-17T03:44:29.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.585+0000 7f810780a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f81000af180 con 0x7f81000b4f30 2024-09-17T03:44:29.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.585+0000 7f810780a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f81000af480 con 0x7f81001f4ac0 2024-09-17T03:44:29.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.585+0000 7f81055a6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81000b3c90 0x7f810009e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.585+0000 7f81055a6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81000b3c90 0x7f810009e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44968/0 (socket says 172.21.15.146:44968) 2024-09-17T03:44:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.585+0000 7f81055a6640 1 -- 172.21.15.146:0/2938030424 learned_addr learned my addr 172.21.15.146:0/2938030424 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f8105da7640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81001f4ac0 0x7f81001546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f8104da5640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81000b4f30 0x7f8100158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f81055a6640 1 -- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81001f4ac0 msgr2=0x7f81001546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f81055a6640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81001f4ac0 0x7f81001546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f81055a6640 1 -- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81000b4f30 msgr2=0x7f8100158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f81055a6640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81000b4f30 0x7f8100158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f81055a6640 1 -- 172.21.15.146:0/2938030424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81001f3d60 con 0x7f81000b3c90 2024-09-17T03:44:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f8105da7640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81001f4ac0 0x7f81001546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f8104da5640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81000b4f30 0x7f8100158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:29.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f81055a6640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81000b3c90 0x7f810009e3f0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f80fc02ab00 tx=0x7f80fc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:29.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f80f5ffb640 1 -- 172.21.15.146:0/2938030424 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc031d60 con 0x7f81000b3c90 2024-09-17T03:44:29.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f80f5ffb640 1 -- 172.21.15.146:0/2938030424 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80fc033e10 con 0x7f81000b3c90 2024-09-17T03:44:29.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f810780a640 1 -- 172.21.15.146:0/2938030424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8100158da0 con 0x7f81000b3c90 2024-09-17T03:44:29.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f80f5ffb640 1 -- 172.21.15.146:0/2938030424 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc005260 con 0x7f81000b3c90 2024-09-17T03:44:29.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.586+0000 7f810780a640 1 -- 172.21.15.146:0/2938030424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81001f3fe0 con 0x7f81000b3c90 2024-09-17T03:44:29.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.587+0000 7f810780a640 1 -- 172.21.15.146:0/2938030424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81000af9a0 con 0x7f81000b3c90 2024-09-17T03:44:29.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.588+0000 7f80f5ffb640 1 -- 172.21.15.146:0/2938030424 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f80fc005400 con 0x7f81000b3c90 2024-09-17T03:44:29.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.589+0000 7f80f5ffb640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80e4078b90 0x7f80e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:29.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.589+0000 7f80f5ffb640 1 -- 172.21.15.146:0/2938030424 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4943+0+0 (secure 0 0 0) 0x7f80fc0bbd70 con 0x7f81000b3c90 2024-09-17T03:44:29.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.589+0000 7f8104da5640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80e4078b90 0x7f80e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:29.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.589+0000 7f8104da5640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80e4078b90 0x7f80e407b0a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f810015acc0 tx=0x7f80f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.593+0000 7f80f5ffb640 1 -- 172.21.15.146:0/2938030424 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f81001f3d60 con 0x7f81000b3c90 2024-09-17T03:44:29.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.766+0000 7f810780a640 1 -- 172.21.15.146:0/2938030424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f81000d0a40 con 0x7f81000b3c90 2024-09-17T03:44:29.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.767+0000 7f80f5ffb640 1 -- 172.21.15.146:0/2938030424 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v61) ==== 59+0+2294 (secure 0 0 0) 0x7f80fc03f030 con 0x7f81000b3c90 2024-09-17T03:44:29.766 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:44:29.767 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:44:29.767 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:44:29.768 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:44:29.769 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:44:29.770 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:44:29.770 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:44:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 -- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80e4078b90 msgr2=0x7f80e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80e4078b90 0x7f80e407b0a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f810015acc0 tx=0x7f80f0009040 comp rx=0 tx=0).stop 2024-09-17T03:44:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 -- 172.21.15.146:0/2938030424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81000b3c90 msgr2=0x7f810009e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81000b3c90 0x7f810009e3f0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f80fc02ab00 tx=0x7f80fc033c20 comp rx=0 tx=0).stop 2024-09-17T03:44:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 -- 172.21.15.146:0/2938030424 shutdown_connections 2024-09-17T03:44:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80e4078b90 0x7f80e407b0a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81001f4ac0 0x7f81001546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81000b4f30 0x7f8100158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 --2- 172.21.15.146:0/2938030424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81000b3c90 0x7f810009e3f0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 -- 172.21.15.146:0/2938030424 >> 172.21.15.146:0/2938030424 conn(0x7f81000b2db0 msgr2=0x7f8100070560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 -- 172.21.15.146:0/2938030424 shutdown_connections 2024-09-17T03:44:29.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.769+0000 7f810780a640 1 -- 172.21.15.146:0/2938030424 wait complete. 2024-09-17T03:44:29.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:44:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.937+0000 7fb83dddf640 1 -- 172.21.15.146:0/927786156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8380b5750 msgr2=0x7fb8380b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.937+0000 7fb83dddf640 1 --2- 172.21.15.146:0/927786156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8380b5750 0x7fb8380b3620 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb820009830 tx=0x7fb82002a530 comp rx=0 tx=0).stop 2024-09-17T03:44:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.937+0000 7fb83dddf640 1 -- 172.21.15.146:0/927786156 shutdown_connections 2024-09-17T03:44:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.937+0000 7fb83dddf640 1 --2- 172.21.15.146:0/927786156 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8380b5750 0x7fb8380b3620 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.937+0000 7fb83dddf640 1 -- 172.21.15.146:0/927786156 >> 172.21.15.146:0/927786156 conn(0x7fb8380b7b20 msgr2=0x7fb83809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.937+0000 7fb83dddf640 1 -- 172.21.15.146:0/927786156 shutdown_connections 2024-09-17T03:44:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.937+0000 7fb83dddf640 1 -- 172.21.15.146:0/927786156 wait complete. 2024-09-17T03:44:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.939+0000 7fb83dddf640 1 Processor -- start 2024-09-17T03:44:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.939+0000 7fb83dddf640 1 -- start start 2024-09-17T03:44:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb83dddf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8380b3b60 0x7fb838143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb83dddf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8380b5750 0x7fb83809fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb83dddf640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8380b5ce0 0x7fb8381e9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb83dddf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb83815d650 con 0x7fb8380b5750 2024-09-17T03:44:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb83dddf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb83815d4d0 con 0x7fb8380b3b60 2024-09-17T03:44:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb83dddf640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb83815d7d0 con 0x7fb8380b5ce0 2024-09-17T03:44:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb82effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8380b5750 0x7fb83809fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb82effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8380b5750 0x7fb83809fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44976/0 (socket says 172.21.15.146:44976) 2024-09-17T03:44:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb82effd640 1 -- 172.21.15.146:0/818054386 learned_addr learned my addr 172.21.15.146:0/818054386 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb8377fe640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8380b3b60 0x7fb838143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb837fff640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8380b5ce0 0x7fb8381e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb82effd640 1 -- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8380b5ce0 msgr2=0x7fb8381e9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb82effd640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8380b5ce0 0x7fb8381e9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb82effd640 1 -- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8380b3b60 msgr2=0x7fb838143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb82effd640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8380b3b60 0x7fb838143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb82effd640 1 -- 172.21.15.146:0/818054386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb838146740 con 0x7fb8380b5750 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb82effd640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8380b5750 0x7fb83809fb30 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fb82002ab20 tx=0x7fb820033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb834ff9640 1 -- 172.21.15.146:0/818054386 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820031d60 con 0x7fb8380b5750 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb834ff9640 1 -- 172.21.15.146:0/818054386 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb820033e10 con 0x7fb8380b5750 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb834ff9640 1 -- 172.21.15.146:0/818054386 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820005260 con 0x7fb8380b5750 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.941+0000 7fb83dddf640 1 -- 172.21.15.146:0/818054386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb838146a20 con 0x7fb8380b5750 2024-09-17T03:44:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.942+0000 7fb83dddf640 1 -- 172.21.15.146:0/818054386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb838146fe0 con 0x7fb8380b5750 2024-09-17T03:44:29.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.942+0000 7fb83dddf640 1 -- 172.21.15.146:0/818054386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8380a0600 con 0x7fb8380b5750 2024-09-17T03:44:29.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.943+0000 7fb834ff9640 1 -- 172.21.15.146:0/818054386 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb820005400 con 0x7fb8380b5750 2024-09-17T03:44:29.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.944+0000 7fb834ff9640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078b90 0x7fb81807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:29.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.944+0000 7fb834ff9640 1 -- 172.21.15.146:0/818054386 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4943+0+0 (secure 0 0 0) 0x7fb8200bba00 con 0x7fb8380b5750 2024-09-17T03:44:29.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.944+0000 7fb8377fe640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078b90 0x7fb81807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:29.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.944+0000 7fb8377fe640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078b90 0x7fb81807b0a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb828000f60 tx=0x7fb828009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:29.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:29.948+0000 7fb834ff9640 1 -- 172.21.15.146:0/818054386 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb82003f030 con 0x7fb8380b5750 2024-09-17T03:44:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.124+0000 7fb83dddf640 1 -- 172.21.15.146:0/818054386 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb838157970 con 0x7fb8380b5750 2024-09-17T03:44:30.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.128+0000 7fb834ff9640 1 -- 172.21.15.146:0/818054386 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v62)=0 v62) ==== 122+0+0 (secure 0 0 0) 0x7fb820084260 con 0x7fb8380b5750 2024-09-17T03:44:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 -- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078b90 msgr2=0x7fb81807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078b90 0x7fb81807b0a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb828000f60 tx=0x7fb828009040 comp rx=0 tx=0).stop 2024-09-17T03:44:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 -- 172.21.15.146:0/818054386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8380b5750 msgr2=0x7fb83809fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8380b5750 0x7fb83809fb30 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fb82002ab20 tx=0x7fb820033c20 comp rx=0 tx=0).stop 2024-09-17T03:44:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 -- 172.21.15.146:0/818054386 shutdown_connections 2024-09-17T03:44:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb818078b90 0x7fb81807b0a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb8380b5ce0 0x7fb8381e9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8380b5750 0x7fb83809fb30 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 --2- 172.21.15.146:0/818054386 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8380b3b60 0x7fb838143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 -- 172.21.15.146:0/818054386 >> 172.21.15.146:0/818054386 conn(0x7fb8380b7b20 msgr2=0x7fb838156870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:30.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 -- 172.21.15.146:0/818054386 shutdown_connections 2024-09-17T03:44:30.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.130+0000 7fb83dddf640 1 -- 172.21.15.146:0/818054386 wait complete. 2024-09-17T03:44:30.141 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:44:30.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:44:30.222 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:44:30.267 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:44:30.267 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:44:30.267 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:44:30.283 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:44:30.283 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:44:30.283 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:44:30.301 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:44:30.301 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:44:30.301 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:44:30.338 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:44:30.339 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:44:30.339 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:44:30.359 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:44:30.359 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:44:30.360 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:44:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.493+0000 7fe8e47a1640 1 -- 172.21.15.146:0/274961153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8003a00 msgr2=0x7fe8c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.493+0000 7fe8e47a1640 1 --2- 172.21.15.146:0/274961153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8003a00 0x7fe8c8003e70 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009ed0 tx=0x7fe8c8005830 comp rx=0 tx=0).stop 2024-09-17T03:44:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.493+0000 7fe8e2d3e640 1 -- 172.21.15.146:0/274961153 reap_dead start 2024-09-17T03:44:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.493+0000 7fe8e47a1640 1 -- 172.21.15.146:0/274961153 shutdown_connections 2024-09-17T03:44:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.493+0000 7fe8e47a1640 1 -- 172.21.15.146:0/274961153 >> 172.21.15.146:0/274961153 conn(0x7fe8dc0b3150 msgr2=0x7fe8dc0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.493+0000 7fe8e47a1640 1 -- 172.21.15.146:0/274961153 shutdown_connections 2024-09-17T03:44:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.493+0000 7fe8e47a1640 1 -- 172.21.15.146:0/274961153 wait complete. 2024-09-17T03:44:30.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.495+0000 7fe8e47a1640 1 Processor -- start 2024-09-17T03:44:30.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.495+0000 7fe8e47a1640 1 -- start start 2024-09-17T03:44:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.496+0000 7fe8e47a1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c8003a00 0x7fe8dc1528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.496+0000 7fe8e47a1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8dc147080 0x7fe8dc0b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.496+0000 7fe8e47a1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8dc0b28f0 0x7fe8dc146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.496+0000 7fe8e47a1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc06f700 con 0x7fe8dc147080 2024-09-17T03:44:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.496+0000 7fe8e47a1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc06f580 con 0x7fe8dc0b28f0 2024-09-17T03:44:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.496+0000 7fe8e47a1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe8dc06f880 con 0x7fe8c8003a00 2024-09-17T03:44:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e1d3c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8dc147080 0x7fe8dc0b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e1d3c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8dc147080 0x7fe8dc0b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44994/0 (socket says 172.21.15.146:44994) 2024-09-17T03:44:30.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e1d3c640 1 -- 172.21.15.146:0/150433155 learned_addr learned my addr 172.21.15.146:0/150433155 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e253d640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c8003a00 0x7fe8dc1528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e2d3e640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8dc0b28f0 0x7fe8dc146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e1d3c640 1 -- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c8003a00 msgr2=0x7fe8dc1528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e1d3c640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c8003a00 0x7fe8dc1528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e1d3c640 1 -- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8dc0b28f0 msgr2=0x7fe8dc146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e1d3c640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8dc0b28f0 0x7fe8dc146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e1d3c640 1 -- 172.21.15.146:0/150433155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc0b2d00 con 0x7fe8dc147080 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e1d3c640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8dc147080 0x7fe8dc0b23b0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc006680 tx=0x7fe8cc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8d2ffd640 1 -- 172.21.15.146:0/150433155 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc015070 con 0x7fe8dc147080 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8d2ffd640 1 -- 172.21.15.146:0/150433155 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8cc011840 con 0x7fe8dc147080 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e47a1640 1 -- 172.21.15.146:0/150433155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc147790 con 0x7fe8dc147080 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8d2ffd640 1 -- 172.21.15.146:0/150433155 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc011c70 con 0x7fe8dc147080 2024-09-17T03:44:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.497+0000 7fe8e47a1640 1 -- 172.21.15.146:0/150433155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc150950 con 0x7fe8dc147080 2024-09-17T03:44:30.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.498+0000 7fe8e47a1640 1 -- 172.21.15.146:0/150433155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc0b4ba0 con 0x7fe8dc147080 2024-09-17T03:44:30.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.499+0000 7fe8d2ffd640 1 -- 172.21.15.146:0/150433155 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8cc018070 con 0x7fe8dc147080 2024-09-17T03:44:30.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.500+0000 7fe8d2ffd640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8c0078b90 0x7fe8c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:30.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.500+0000 7fe8d2ffd640 1 -- 172.21.15.146:0/150433155 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 4943+0+0 (secure 0 0 0) 0x7fe8cc09b9f0 con 0x7fe8dc147080 2024-09-17T03:44:30.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.500+0000 7fe8e253d640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8c0078b90 0x7fe8c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:30.500 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.500+0000 7fe8e253d640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8c0078b90 0x7fe8c007b0a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009ed0 tx=0x7fe8d8004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:30.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.503+0000 7fe8d2ffd640 1 -- 172.21.15.146:0/150433155 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8dc0b2d00 con 0x7fe8dc147080 2024-09-17T03:44:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.713+0000 7fe8e47a1640 1 -- 172.21.15.146:0/150433155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8dc15da70 con 0x7fe8dc147080 2024-09-17T03:44:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.713+0000 7fe8d2ffd640 1 -- 172.21.15.146:0/150433155 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) ==== 95+0+3927 (secure 0 0 0) 0x7fe8cc064210 con 0x7fe8dc147080 2024-09-17T03:44:30.713 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:30.713 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":130,"btime":"2024-09-17T03:44:24:417014+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2920792926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2920792926},{"type":"v1","addr":"172.21.15.179:6837","nonce":2920792926}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":8917,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/154430395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":154430395},{"type":"v1","addr":"172.21.15.179:6836","nonce":154430395}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":121},{"gid":10584,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/2528392136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2528392136},{"type":"v1","addr":"172.21.15.146:6833","nonce":2528392136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":130},{"gid":10593,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3919948880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3919948880},{"type":"v1","addr":"172.21.15.146:6835","nonce":3919948880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":130}],"filesystems":[]} 2024-09-17T03:44:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 130 2024-09-17T03:44:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 -- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8c0078b90 msgr2=0x7fe8c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8c0078b90 0x7fe8c007b0a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009ed0 tx=0x7fe8d8004a40 comp rx=0 tx=0).stop 2024-09-17T03:44:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 -- 172.21.15.146:0/150433155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8dc147080 msgr2=0x7fe8dc0b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8dc147080 0x7fe8dc0b23b0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc006680 tx=0x7fe8cc0039c0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 -- 172.21.15.146:0/150433155 shutdown_connections 2024-09-17T03:44:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe8c0078b90 0x7fe8c007b0a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8dc0b28f0 0x7fe8dc146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8dc147080 0x7fe8dc0b23b0 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 --2- 172.21.15.146:0/150433155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe8c8003a00 0x7fe8dc1528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 -- 172.21.15.146:0/150433155 >> 172.21.15.146:0/150433155 conn(0x7fe8dc0b3150 msgr2=0x7fe8dc0b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:30.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 -- 172.21.15.146:0/150433155 shutdown_connections 2024-09-17T03:44:30.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.715+0000 7fe8e47a1640 1 -- 172.21.15.146:0/150433155 wait complete. 2024-09-17T03:44:30.726 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:44:30.726 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:44:30.727 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:44:30.727 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:44:30.727 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:44:30.727 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:44:30.727 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:44:30.727 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:44:30.727 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:44:30.728 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:44:30.728 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:44:30.728 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:44:30.728 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:44:30.728 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:44:30.728 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:44:30.729 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:44:30.739 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:44:30.740 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:44:30.741 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:44:30.741 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:44:30.742 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:44:30.742 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:44:30.743 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:44:30.743 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:44:30.783 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:44:30.784 DEBUG:teuthology.parallel:result is None 2024-09-17T03:44:30.785 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:44:30.785 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:44:30.785 DEBUG:teuthology.parallel:result is None 2024-09-17T03:44:30.785 DEBUG:teuthology.parallel:result is None 2024-09-17T03:44:30.786 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:44:30.786 DEBUG:teuthology.parallel:result is None 2024-09-17T03:44:30.788 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:44:30.871 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:44:30.872 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:44:30.877 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:44:30.877 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:44:30.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.910+0000 7feaa2377640 1 -- 172.21.15.146:0/326498311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea9c0701f0 msgr2=0x7fea9c0b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:30.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.910+0000 7feaa2377640 1 --2- 172.21.15.146:0/326498311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea9c0701f0 0x7fea9c0b4cc0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7fea94005fd0 tx=0x7fea9402aa90 comp rx=0 tx=0).stop 2024-09-17T03:44:30.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.910+0000 7feaa2377640 1 -- 172.21.15.146:0/326498311 shutdown_connections 2024-09-17T03:44:30.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.910+0000 7feaa2377640 1 --2- 172.21.15.146:0/326498311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea9c0701f0 0x7fea9c0b4cc0 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.910+0000 7feaa2377640 1 --2- 172.21.15.146:0/326498311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c152920 0x7fea9c073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.910+0000 7feaa2377640 1 -- 172.21.15.146:0/326498311 >> 172.21.15.146:0/326498311 conn(0x7fea9c06dd60 msgr2=0x7fea9c06e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.910+0000 7feaa2377640 1 -- 172.21.15.146:0/326498311 shutdown_connections 2024-09-17T03:44:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.910+0000 7feaa2377640 1 -- 172.21.15.146:0/326498311 wait complete. 2024-09-17T03:44:30.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.911+0000 7feaa2377640 1 Processor -- start 2024-09-17T03:44:30.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.912+0000 7feaa2377640 1 -- start start 2024-09-17T03:44:30.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7feaa2377640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0701f0 0x7fea9c0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:30.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7feaa2377640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c073ac0 0x7fea9c1f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:30.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7feaa2377640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea9c152920 0x7fea9c0b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:30.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7feaa2377640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c0b5590 con 0x7fea9c152920 2024-09-17T03:44:30.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7feaa2377640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c0b5410 con 0x7fea9c073ac0 2024-09-17T03:44:30.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7feaa2377640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fea9c0b5710 con 0x7fea9c0701f0 2024-09-17T03:44:30.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7feaa0914640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea9c152920 0x7fea9c0b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:30.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7feaa0914640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea9c152920 0x7fea9c0b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45048/0 (socket says 172.21.15.146:45048) 2024-09-17T03:44:30.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7fea9bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0701f0 0x7fea9c0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:30.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7fea9b7fe640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c073ac0 0x7fea9c1f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:30.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7feaa0914640 1 -- 172.21.15.146:0/4178267095 learned_addr learned my addr 172.21.15.146:0/4178267095 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:30.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7fea9bfff640 1 -- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c073ac0 msgr2=0x7fea9c1f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:30.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7fea9bfff640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c073ac0 0x7fea9c1f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7fea9bfff640 1 -- 172.21.15.146:0/4178267095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea9c152920 msgr2=0x7fea9c0b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:30.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7fea9bfff640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea9c152920 0x7fea9c0b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:30.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7fea9bfff640 1 -- 172.21.15.146:0/4178267095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9c15aab0 con 0x7fea9c0701f0 2024-09-17T03:44:30.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7fea9b7fe640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c073ac0 0x7fea9c1f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:44:30.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.913+0000 7feaa0914640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea9c152920 0x7fea9c0b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:44:30.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.914+0000 7fea9bfff640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0701f0 0x7fea9c0afa80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009890 tx=0x7fea8c009c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:30.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.914+0000 7fea98ff9640 1 -- 172.21.15.146:0/4178267095 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c004020 con 0x7fea9c0701f0 2024-09-17T03:44:30.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.914+0000 7fea98ff9640 1 -- 172.21.15.146:0/4178267095 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea8c0041c0 con 0x7fea9c0701f0 2024-09-17T03:44:30.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.914+0000 7feaa2377640 1 -- 172.21.15.146:0/4178267095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9c15ad90 con 0x7fea9c0701f0 2024-09-17T03:44:30.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.914+0000 7fea98ff9640 1 -- 172.21.15.146:0/4178267095 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c005020 con 0x7fea9c0701f0 2024-09-17T03:44:30.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.914+0000 7feaa2377640 1 -- 172.21.15.146:0/4178267095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9c15b350 con 0x7fea9c0701f0 2024-09-17T03:44:30.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.915+0000 7feaa2377640 1 -- 172.21.15.146:0/4178267095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9c0b5bc0 con 0x7fea9c0701f0 2024-09-17T03:44:30.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.916+0000 7fea98ff9640 1 -- 172.21.15.146:0/4178267095 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea8c01f020 con 0x7fea9c0701f0 2024-09-17T03:44:30.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.916+0000 7fea98ff9640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea88078bc0 0x7fea8807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:30.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.916+0000 7fea98ff9640 1 -- 172.21.15.146:0/4178267095 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(168..168 src has 1..168) ==== 4943+0+0 (secure 0 0 0) 0x7fea8c09bfe0 con 0x7fea9c0701f0 2024-09-17T03:44:30.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.916+0000 7fea9b7fe640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea88078bc0 0x7fea8807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:30.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.917+0000 7fea9b7fe640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea88078bc0 0x7fea8807b0d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fea9c1f5c40 tx=0x7fea90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:30.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:30.921+0000 7fea98ff9640 1 -- 172.21.15.146:0/4178267095 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea8c0640e0 con 0x7fea9c0701f0 2024-09-17T03:44:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.108+0000 7feaa2377640 1 -- 172.21.15.146:0/4178267095 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fea9c0ce9e0 con 0x7fea9c0701f0 2024-09-17T03:44:31.466 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.466+0000 7fea98ff9640 1 -- 172.21.15.146:0/4178267095 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v170) ==== 97+0+0 (secure 0 0 0) 0x7fea8c068b10 con 0x7fea9c0701f0 2024-09-17T03:44:31.466 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:44:31.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.468+0000 7feaa2377640 1 -- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea88078bc0 msgr2=0x7fea8807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:31.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.468+0000 7feaa2377640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea88078bc0 0x7fea8807b0d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fea9c1f5c40 tx=0x7fea90009040 comp rx=0 tx=0).stop 2024-09-17T03:44:31.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.468+0000 7feaa2377640 1 -- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0701f0 msgr2=0x7fea9c0afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:31.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.469+0000 7feaa2377640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0701f0 0x7fea9c0afa80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009890 tx=0x7fea8c009c90 comp rx=0 tx=0).stop 2024-09-17T03:44:31.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.469+0000 7feaa2377640 1 -- 172.21.15.146:0/4178267095 shutdown_connections 2024-09-17T03:44:31.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.469+0000 7feaa2377640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea88078bc0 0x7fea8807b0d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.469+0000 7feaa2377640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea9c152920 0x7fea9c0b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.469+0000 7feaa2377640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea9c073ac0 0x7fea9c1f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.469+0000 7feaa2377640 1 --2- 172.21.15.146:0/4178267095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea9c0701f0 0x7fea9c0afa80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.469+0000 7feaa2377640 1 -- 172.21.15.146:0/4178267095 >> 172.21.15.146:0/4178267095 conn(0x7fea9c06dd60 msgr2=0x7fea9c154e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.469+0000 7feaa2377640 1 -- 172.21.15.146:0/4178267095 shutdown_connections 2024-09-17T03:44:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.469+0000 7feaa2377640 1 -- 172.21.15.146:0/4178267095 wait complete. 2024-09-17T03:44:31.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:44:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.595+0000 7f01fe957640 1 -- 172.21.15.146:0/124107523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01e0004800 msgr2=0x7f01e0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.595+0000 7f01fe957640 1 --2- 172.21.15.146:0/124107523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01e0004800 0x7f01e0004c10 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00c290 tx=0x7f01e0005830 comp rx=0 tx=0).stop 2024-09-17T03:44:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.595+0000 7f01fcef4640 1 -- 172.21.15.146:0/124107523 reap_dead start 2024-09-17T03:44:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.595+0000 7f01fe957640 1 -- 172.21.15.146:0/124107523 shutdown_connections 2024-09-17T03:44:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.595+0000 7f01fe957640 1 -- 172.21.15.146:0/124107523 >> 172.21.15.146:0/124107523 conn(0x7f01f80b7b20 msgr2=0x7f01f809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.595+0000 7f01fe957640 1 -- 172.21.15.146:0/124107523 shutdown_connections 2024-09-17T03:44:31.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.595+0000 7f01fe957640 1 -- 172.21.15.146:0/124107523 wait complete. 2024-09-17T03:44:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.597+0000 7f01fe957640 1 Processor -- start 2024-09-17T03:44:31.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.597+0000 7f01fe957640 1 -- start start 2024-09-17T03:44:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.598+0000 7f01fe957640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01e0004800 0x7f01f8153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.598+0000 7f01fe957640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01f8155ef0 0x7f01f81f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.598+0000 7f01fe957640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f8153d40 0x7f01f81e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.598+0000 7f01fe957640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f01f815d1b0 con 0x7f01f8155ef0 2024-09-17T03:44:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.598+0000 7f01fe957640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f01f80b1840 con 0x7f01e0004800 2024-09-17T03:44:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.598+0000 7f01fe957640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f01f815d330 con 0x7f01f8153d40 2024-09-17T03:44:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.598+0000 7f01f77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01f8155ef0 0x7f01f81f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.598+0000 7f01f77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01f8155ef0 0x7f01f81f3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45076/0 (socket says 172.21.15.146:45076) 2024-09-17T03:44:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.598+0000 7f01f77fe640 1 -- 172.21.15.146:0/172600379 learned_addr learned my addr 172.21.15.146:0/172600379 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01f7fff640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01e0004800 0x7f01f8153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01fcef4640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f8153d40 0x7f01f81e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01f77fe640 1 -- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f8153d40 msgr2=0x7f01f81e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01f77fe640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f8153d40 0x7f01f81e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01f77fe640 1 -- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01e0004800 msgr2=0x7f01f8153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01f77fe640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01e0004800 0x7f01f8153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01f77fe640 1 -- 172.21.15.146:0/172600379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f8156640 con 0x7f01f8155ef0 2024-09-17T03:44:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01f77fe640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01f8155ef0 0x7f01f81f3940 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f01ec02b110 tx=0x7f01ec001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01f4ff9640 1 -- 172.21.15.146:0/172600379 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec031040 con 0x7f01f8155ef0 2024-09-17T03:44:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01f4ff9640 1 -- 172.21.15.146:0/172600379 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01ec0035f0 con 0x7f01f8155ef0 2024-09-17T03:44:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01fe957640 1 -- 172.21.15.146:0/172600379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f8156920 con 0x7f01f8155ef0 2024-09-17T03:44:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01f4ff9640 1 -- 172.21.15.146:0/172600379 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec003a20 con 0x7f01f8155ef0 2024-09-17T03:44:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.599+0000 7f01fe957640 1 -- 172.21.15.146:0/172600379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f81e53e0 con 0x7f01f8155ef0 2024-09-17T03:44:31.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.600+0000 7f01fe957640 1 -- 172.21.15.146:0/172600379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f80b7440 con 0x7f01f8155ef0 2024-09-17T03:44:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.601+0000 7f01f4ff9640 1 -- 172.21.15.146:0/172600379 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01ec034070 con 0x7f01f8155ef0 2024-09-17T03:44:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.601+0000 7f01f4ff9640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01e4078b90 0x7f01e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.602+0000 7f01f4ff9640 1 -- 172.21.15.146:0/172600379 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 4857+0+0 (secure 0 0 0) 0x7f01ec0ba980 con 0x7f01f8155ef0 2024-09-17T03:44:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.602+0000 7f01f7fff640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01e4078b90 0x7f01e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:31.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.602+0000 7f01f7fff640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01e4078b90 0x7f01e407b0a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f01e8003700 tx=0x7f01e800b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.606+0000 7f01f4ff9640 1 -- 172.21.15.146:0/172600379 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01f80b7440 con 0x7f01f8155ef0 2024-09-17T03:44:31.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.847+0000 7f01fe957640 1 -- 172.21.15.146:0/172600379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f01f815d8c0 con 0x7f01f8155ef0 2024-09-17T03:44:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.847+0000 7f01f4ff9640 1 -- 172.21.15.146:0/172600379 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) ==== 80+0+5304 (secure 0 0 0) 0x7f01ec047020 con 0x7f01f8155ef0 2024-09-17T03:44:31.847 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:31.847 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:44:31.847 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:44:31.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.847 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:44:31.847 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:44:31.847 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.847 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:44:31.847 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:44:31.848 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:44:31.848 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.848 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.848 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:44:31.848 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:44:31.848 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.848 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:44:31.848 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:44:31.848 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:44:31.849 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.849 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.849 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:44:31.849 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:44:31.849 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.849 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:44:31.850 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:44:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:44:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:44:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:44:31.851 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.853 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:44:31.853 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:44:31.853 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.853 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:44:31.853 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:44:31.853 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.853 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.854 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:44:31.854 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:44:31.854 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.854 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:44:31.854 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:44:31.854 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.854 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.854 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.854 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:44:31.854 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:44:31.855 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.855 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:44:31.855 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:44:31.855 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.855 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.855 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.855 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:44:31.855 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:44:31.856 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.856 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:44:31.856 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:44:31.856 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.856 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.856 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.856 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:44:31.856 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:44:31.856 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.857 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:44:31.857 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:44:31.857 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.857 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.857 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.857 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:44:31.857 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:44:31.858 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.858 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:44:31.858 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:44:31.858 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.858 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.858 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.858 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:44:31.859 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:44:31.859 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.859 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:44:31.859 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:44:31.859 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:44:31.859 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.859 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.859 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:44:31.859 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:44:31.860 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:44:31.861 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:44:31.862 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:44:31.863 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:44:31.864 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.864 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:31.864 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:44:31.864 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:44:31.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.849+0000 7f01fe957640 1 -- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01e4078b90 msgr2=0x7f01e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:31.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.849+0000 7f01fe957640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01e4078b90 0x7f01e407b0a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f01e8003700 tx=0x7f01e800b260 comp rx=0 tx=0).stop 2024-09-17T03:44:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.849+0000 7f01fe957640 1 -- 172.21.15.146:0/172600379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01f8155ef0 msgr2=0x7f01f81f3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.849+0000 7f01fe957640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01f8155ef0 0x7f01f81f3940 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f01ec02b110 tx=0x7f01ec001d20 comp rx=0 tx=0).stop 2024-09-17T03:44:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.850+0000 7f01fe957640 1 -- 172.21.15.146:0/172600379 shutdown_connections 2024-09-17T03:44:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.850+0000 7f01fe957640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f01e4078b90 0x7f01e407b0a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.850+0000 7f01fe957640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01f8153d40 0x7f01f81e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.850+0000 7f01fe957640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01f8155ef0 0x7f01f81f3940 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.850+0000 7f01fe957640 1 --2- 172.21.15.146:0/172600379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01e0004800 0x7f01f8153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.850+0000 7f01fe957640 1 -- 172.21.15.146:0/172600379 >> 172.21.15.146:0/172600379 conn(0x7f01f80b7b20 msgr2=0x7f01f81e89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.850+0000 7f01fe957640 1 -- 172.21.15.146:0/172600379 shutdown_connections 2024-09-17T03:44:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.850+0000 7f01fe957640 1 -- 172.21.15.146:0/172600379 wait complete. 2024-09-17T03:44:31.867 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:44:31.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.981+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2889977629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c0b5750 msgr2=0x7f8b5c0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:31.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.981+0000 7f8b63b4a640 1 --2- 172.21.15.146:0/2889977629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c0b5750 0x7f8b5c0b3620 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009830 tx=0x7f8b5802a510 comp rx=0 tx=0).stop 2024-09-17T03:44:31.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.981+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2889977629 shutdown_connections 2024-09-17T03:44:31.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.981+0000 7f8b63b4a640 1 --2- 172.21.15.146:0/2889977629 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c0b5750 0x7f8b5c0b3620 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.981+0000 7f8b63b4a640 1 --2- 172.21.15.146:0/2889977629 >> v2:172.21.15.179:3300/0 conn(0x7f8b5c0b5ce0 0x7f8b5c0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.981+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2889977629 >> 172.21.15.146:0/2889977629 conn(0x7f8b5c0b7b20 msgr2=0x7f8b5c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:31.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.981+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2889977629 shutdown_connections 2024-09-17T03:44:31.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.981+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2889977629 wait complete. 2024-09-17T03:44:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.983+0000 7f8b63b4a640 1 Processor -- start 2024-09-17T03:44:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.983+0000 7f8b63b4a640 1 -- start start 2024-09-17T03:44:31.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.984+0000 7f8b63b4a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b5c0b3b60 0x7f8b5c155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:31.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.984+0000 7f8b63b4a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c0b5750 0x7f8b5c14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:31.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.984+0000 7f8b63b4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b5c0b5ce0 0x7f8b5c1585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:31.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.984+0000 7f8b63b4a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c0b27b0 con 0x7f8b5c0b5ce0 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.984+0000 7f8b63b4a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c15dd00 con 0x7f8b5c0b3b60 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.984+0000 7f8b63b4a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5c0b2930 con 0x7f8b5c0b5750 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.984+0000 7f8b620e7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b5c0b5ce0 0x7f8b5c1585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.984+0000 7f8b620e7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b5c0b5ce0 0x7f8b5c1585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45080/0 (socket says 172.21.15.146:45080) 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.984+0000 7f8b620e7640 1 -- 172.21.15.146:0/2119564621 learned_addr learned my addr 172.21.15.146:0/2119564621 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.984+0000 7f8b618e6640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b5c0b3b60 0x7f8b5c155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.984+0000 7f8b610e5640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c0b5750 0x7f8b5c14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.985+0000 7f8b620e7640 1 -- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c0b5750 msgr2=0x7f8b5c14e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.985+0000 7f8b620e7640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c0b5750 0x7f8b5c14e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.985+0000 7f8b620e7640 1 -- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b5c0b3b60 msgr2=0x7f8b5c155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.985+0000 7f8b620e7640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b5c0b3b60 0x7f8b5c155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.985+0000 7f8b620e7640 1 -- 172.21.15.146:0/2119564621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c152bb0 con 0x7f8b5c0b5ce0 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.985+0000 7f8b620e7640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b5c0b5ce0 0x7f8b5c1585e0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400cad0 tx=0x7f8b5400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:31.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.985+0000 7f8b527fc640 1 -- 172.21.15.146:0/2119564621 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54016020 con 0x7f8b5c0b5ce0 2024-09-17T03:44:31.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.985+0000 7f8b527fc640 1 -- 172.21.15.146:0/2119564621 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b5400ad20 con 0x7f8b5c0b5ce0 2024-09-17T03:44:31.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.985+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2119564621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c1f6ef0 con 0x7f8b5c0b5ce0 2024-09-17T03:44:31.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.985+0000 7f8b527fc640 1 -- 172.21.15.146:0/2119564621 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54012680 con 0x7f8b5c0b5ce0 2024-09-17T03:44:31.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.985+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2119564621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c14ef00 con 0x7f8b5c0b5ce0 2024-09-17T03:44:31.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.986+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2119564621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5c152920 con 0x7f8b5c0b5ce0 2024-09-17T03:44:31.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.987+0000 7f8b527fc640 1 -- 172.21.15.146:0/2119564621 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b54019020 con 0x7f8b5c0b5ce0 2024-09-17T03:44:31.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.988+0000 7f8b527fc640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b40078b90 0x7f8b4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:31.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.988+0000 7f8b527fc640 1 -- 172.21.15.146:0/2119564621 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 4857+0+0 (secure 0 0 0) 0x7f8b5409aea0 con 0x7f8b5c0b5ce0 2024-09-17T03:44:31.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.988+0000 7f8b618e6640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b40078b90 0x7f8b4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:31.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.989+0000 7f8b618e6640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b40078b90 0x7f8b4007b0a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0095f0 tx=0x7f8b4c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:31.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:31.993+0000 7f8b527fc640 1 -- 172.21.15.146:0/2119564621 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b54020020 con 0x7f8b5c0b5ce0 2024-09-17T03:44:32.170 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.171+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2119564621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8b5c0b2de0 con 0x7f8b5c0b5ce0 2024-09-17T03:44:32.171 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.172+0000 7f8b527fc640 1 -- 172.21.15.146:0/2119564621 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v172) ==== 84+0+65 (secure 0 0 0) 0x7f8b5c0b3f70 con 0x7f8b5c0b5ce0 2024-09-17T03:44:32.171 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:32.171 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:44:32.171 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:44:32.171 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:44:32.171 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:44:32.172 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:32.172 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:44:32.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b40078b90 msgr2=0x7f8b4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:32.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b40078b90 0x7f8b4007b0a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0095f0 tx=0x7f8b4c005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:32.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2119564621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b5c0b5ce0 msgr2=0x7f8b5c1585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:32.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b5c0b5ce0 0x7f8b5c1585e0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400cad0 tx=0x7f8b5400cf90 comp rx=0 tx=0).stop 2024-09-17T03:44:32.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2119564621 shutdown_connections 2024-09-17T03:44:32.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8b40078b90 0x7f8b4007b0a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:32.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b5c0b5ce0 0x7f8b5c1585e0 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:32.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8b5c0b5750 0x7f8b5c14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:32.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 --2- 172.21.15.146:0/2119564621 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b5c0b3b60 0x7f8b5c155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:32.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2119564621 >> 172.21.15.146:0/2119564621 conn(0x7f8b5c0b7b20 msgr2=0x7f8b5c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:32.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2119564621 shutdown_connections 2024-09-17T03:44:32.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.174+0000 7f8b63b4a640 1 -- 172.21.15.146:0/2119564621 wait complete. 2024-09-17T03:44:32.185 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:44:32.185 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:44:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.303+0000 7f2b8fda1640 1 -- 172.21.15.146:0/409735645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b70003a00 msgr2=0x7f2b70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.303+0000 7f2b8fda1640 1 --2- 172.21.15.146:0/409735645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b70003a00 0x7f2b70003e70 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009b50 tx=0x7f2b70005830 comp rx=0 tx=0).stop 2024-09-17T03:44:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.303+0000 7f2b8e33e640 1 -- 172.21.15.146:0/409735645 reap_dead start 2024-09-17T03:44:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.303+0000 7f2b8fda1640 1 -- 172.21.15.146:0/409735645 shutdown_connections 2024-09-17T03:44:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.303+0000 7f2b8fda1640 1 -- 172.21.15.146:0/409735645 >> 172.21.15.146:0/409735645 conn(0x7f2b880b7b20 msgr2=0x7f2b8809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.303+0000 7f2b8fda1640 1 -- 172.21.15.146:0/409735645 shutdown_connections 2024-09-17T03:44:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.303+0000 7f2b8fda1640 1 -- 172.21.15.146:0/409735645 wait complete. 2024-09-17T03:44:32.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.305+0000 7f2b8fda1640 1 Processor -- start 2024-09-17T03:44:32.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.305+0000 7f2b8fda1640 1 -- start start 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8fda1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b70003a00 0x7f2b881574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8fda1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b881e7460 0x7f2b881f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8fda1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b881f5b90 0x7f2b880d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8fda1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8815cc20 con 0x7f2b70003a00 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8fda1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8815caa0 con 0x7f2b881f5b90 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8fda1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2b8815cda0 con 0x7f2b881e7460 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8db3d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b70003a00 0x7f2b881574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8db3d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b70003a00 0x7f2b881574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45098/0 (socket says 172.21.15.146:45098) 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8db3d640 1 -- 172.21.15.146:0/594827520 learned_addr learned my addr 172.21.15.146:0/594827520 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8d33c640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b881e7460 0x7f2b881f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8e33e640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b881f5b90 0x7f2b880d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8db3d640 1 -- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b881e7460 msgr2=0x7f2b881f5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8db3d640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b881e7460 0x7f2b881f5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8db3d640 1 -- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b881f5b90 msgr2=0x7f2b880d1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8db3d640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b881f5b90 0x7f2b880d1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8db3d640 1 -- 172.21.15.146:0/594827520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8806df00 con 0x7f2b70003a00 2024-09-17T03:44:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8d33c640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b881e7460 0x7f2b881f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.306+0000 7f2b8e33e640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b881f5b90 0x7f2b880d1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.307+0000 7f2b8db3d640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b70003a00 0x7f2b881574a0 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009a70 tx=0x7f2b780336d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.307+0000 7f2b867fc640 1 -- 172.21.15.146:0/594827520 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78043070 con 0x7f2b70003a00 2024-09-17T03:44:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.307+0000 7f2b867fc640 1 -- 172.21.15.146:0/594827520 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b78004120 con 0x7f2b70003a00 2024-09-17T03:44:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.307+0000 7f2b8fda1640 1 -- 172.21.15.146:0/594827520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b881e7ba0 con 0x7f2b70003a00 2024-09-17T03:44:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.307+0000 7f2b867fc640 1 -- 172.21.15.146:0/594827520 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78038040 con 0x7f2b70003a00 2024-09-17T03:44:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.307+0000 7f2b8fda1640 1 -- 172.21.15.146:0/594827520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b880d21e0 con 0x7f2b70003a00 2024-09-17T03:44:32.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.308+0000 7f2b8fda1640 1 -- 172.21.15.146:0/594827520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b880b1320 con 0x7f2b70003a00 2024-09-17T03:44:32.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.309+0000 7f2b867fc640 1 -- 172.21.15.146:0/594827520 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b78046070 con 0x7f2b70003a00 2024-09-17T03:44:32.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.309+0000 7f2b867fc640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078b90 0x7f2b7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:32.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.309+0000 7f2b867fc640 1 -- 172.21.15.146:0/594827520 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 4857+0+0 (secure 0 0 0) 0x7f2b780bae50 con 0x7f2b70003a00 2024-09-17T03:44:32.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.309+0000 7f2b8d33c640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078b90 0x7f2b7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:32.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.310+0000 7f2b8d33c640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078b90 0x7f2b7407b0a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000c00 tx=0x7f2b7c001540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:32.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.313+0000 7f2b867fc640 1 -- 172.21.15.146:0/594827520 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2b78083020 con 0x7f2b70003a00 2024-09-17T03:44:32.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:32.491+0000 7f2b8fda1640 1 -- 172.21.15.146:0/594827520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2b88071300 con 0x7f2b70003a00 2024-09-17T03:44:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.479+0000 7f2b867fc640 1 -- 172.21.15.146:0/594827520 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v173) ==== 138+0+0 (secure 0 0 0) 0x7f2b78087a50 con 0x7f2b70003a00 2024-09-17T03:44:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:44:33.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.482+0000 7f2b8fda1640 1 -- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078b90 msgr2=0x7f2b7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:33.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.482+0000 7f2b8fda1640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078b90 0x7f2b7407b0a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000c00 tx=0x7f2b7c001540 comp rx=0 tx=0).stop 2024-09-17T03:44:33.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.482+0000 7f2b8fda1640 1 -- 172.21.15.146:0/594827520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b70003a00 msgr2=0x7f2b881574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:33.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.482+0000 7f2b8fda1640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b70003a00 0x7f2b881574a0 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009a70 tx=0x7f2b780336d0 comp rx=0 tx=0).stop 2024-09-17T03:44:33.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.482+0000 7f2b8fda1640 1 -- 172.21.15.146:0/594827520 shutdown_connections 2024-09-17T03:44:33.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.482+0000 7f2b8fda1640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b74078b90 0x7f2b7407b0a0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:33.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.482+0000 7f2b8fda1640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b881f5b90 0x7f2b880d1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:33.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.482+0000 7f2b8fda1640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b881e7460 0x7f2b881f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:33.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.482+0000 7f2b8fda1640 1 --2- 172.21.15.146:0/594827520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b70003a00 0x7f2b881574a0 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:33.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.482+0000 7f2b8fda1640 1 -- 172.21.15.146:0/594827520 >> 172.21.15.146:0/594827520 conn(0x7f2b880b7b20 msgr2=0x7f2b88071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:33.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.482+0000 7f2b8fda1640 1 -- 172.21.15.146:0/594827520 shutdown_connections 2024-09-17T03:44:33.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.483+0000 7f2b8fda1640 1 -- 172.21.15.146:0/594827520 wait complete. 2024-09-17T03:44:33.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:44:33.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.625+0000 7f96391e6640 1 -- 172.21.15.146:0/2646779321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96340b5350 msgr2=0x7f96341589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:33.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.625+0000 7f96391e6640 1 --2- 172.21.15.146:0/2646779321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96340b5350 0x7f96341589e0 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f9628005fd0 tx=0x7f962802b7d0 comp rx=0 tx=0).stop 2024-09-17T03:44:33.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.625+0000 7f96391e6640 1 -- 172.21.15.146:0/2646779321 shutdown_connections 2024-09-17T03:44:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.625+0000 7f96391e6640 1 --2- 172.21.15.146:0/2646779321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96340b5350 0x7f96341589e0 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.625+0000 7f96391e6640 1 --2- 172.21.15.146:0/2646779321 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f963415f5f0 0x7f9634073e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.625+0000 7f96391e6640 1 -- 172.21.15.146:0/2646779321 >> 172.21.15.146:0/2646779321 conn(0x7f96340b2950 msgr2=0x7f963406cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.625+0000 7f96391e6640 1 -- 172.21.15.146:0/2646779321 shutdown_connections 2024-09-17T03:44:33.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.625+0000 7f96391e6640 1 -- 172.21.15.146:0/2646779321 wait complete. 2024-09-17T03:44:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.627+0000 7f96391e6640 1 Processor -- start 2024-09-17T03:44:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.627+0000 7f96391e6640 1 -- start start 2024-09-17T03:44:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.628+0000 7f96391e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963406f320 0x7f9634152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.628+0000 7f96391e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96340b5350 0x7f96341e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.628+0000 7f96391e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f963415f5f0 0x7f96341e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.628+0000 7f96391e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f963406d730 con 0x7f963406f320 2024-09-17T03:44:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.628+0000 7f96391e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f963406d5b0 con 0x7f963415f5f0 2024-09-17T03:44:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.628+0000 7f96391e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f963406d8b0 con 0x7f96340b5350 2024-09-17T03:44:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.628+0000 7f9632d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963406f320 0x7f9634152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.628+0000 7f9632d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963406f320 0x7f9634152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45104/0 (socket says 172.21.15.146:45104) 2024-09-17T03:44:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.628+0000 7f9632d9d640 1 -- 172.21.15.146:0/96382859 learned_addr learned my addr 172.21.15.146:0/96382859 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.628+0000 7f963259c640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96340b5350 0x7f96341e69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.628+0000 7f963359e640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f963415f5f0 0x7f96341e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f9632d9d640 1 -- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96340b5350 msgr2=0x7f96341e69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f9632d9d640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96340b5350 0x7f96341e69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f9632d9d640 1 -- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f963415f5f0 msgr2=0x7f96341e6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f9632d9d640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f963415f5f0 0x7f96341e6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f9632d9d640 1 -- 172.21.15.146:0/96382859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9634156c10 con 0x7f963406f320 2024-09-17T03:44:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f963359e640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f963415f5f0 0x7f96341e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f9632d9d640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963406f320 0x7f9634152070 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f9624007930 tx=0x7f9624007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f961b7fe640 1 -- 172.21.15.146:0/96382859 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962400e6f0 con 0x7f963406f320 2024-09-17T03:44:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f961b7fe640 1 -- 172.21.15.146:0/96382859 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f962400e890 con 0x7f963406f320 2024-09-17T03:44:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f961b7fe640 1 -- 172.21.15.146:0/96382859 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962400ece0 con 0x7f963406f320 2024-09-17T03:44:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f96391e6640 1 -- 172.21.15.146:0/96382859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9634156ef0 con 0x7f963406f320 2024-09-17T03:44:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.629+0000 7f96391e6640 1 -- 172.21.15.146:0/96382859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963415b690 con 0x7f963406f320 2024-09-17T03:44:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.630+0000 7f96391e6640 1 -- 172.21.15.146:0/96382859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96341589e0 con 0x7f963406f320 2024-09-17T03:44:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.631+0000 7f961b7fe640 1 -- 172.21.15.146:0/96382859 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f962400a440 con 0x7f963406f320 2024-09-17T03:44:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.631+0000 7f961b7fe640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9620078bc0 0x7f962007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.631+0000 7f961b7fe640 1 -- 172.21.15.146:0/96382859 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5227+0+0 (secure 0 0 0) 0x7f962409ca60 con 0x7f963406f320 2024-09-17T03:44:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.632+0000 7f963259c640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9620078bc0 0x7f962007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.632+0000 7f963259c640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9620078bc0 0x7f962007b0d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9628035000 tx=0x7f9628004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:33.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.636+0000 7f961b7fe640 1 -- 172.21.15.146:0/96382859 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9624065080 con 0x7f963406f320 2024-09-17T03:44:33.811 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:33.812+0000 7f96391e6640 1 -- 172.21.15.146:0/96382859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f96340afbe0 con 0x7f963406f320 2024-09-17T03:44:34.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.486+0000 7f961b7fe640 1 -- 172.21.15.146:0/96382859 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v174) ==== 170+0+0 (secure 0 0 0) 0x7f9624064980 con 0x7f963406f320 2024-09-17T03:44:34.485 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.489+0000 7f96391e6640 1 -- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9620078bc0 msgr2=0x7f962007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.489+0000 7f96391e6640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9620078bc0 0x7f962007b0d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9628035000 tx=0x7f9628004730 comp rx=0 tx=0).stop 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.489+0000 7f96391e6640 1 -- 172.21.15.146:0/96382859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963406f320 msgr2=0x7f9634152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.489+0000 7f96391e6640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963406f320 0x7f9634152070 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f9624007930 tx=0x7f9624007df0 comp rx=0 tx=0).stop 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.489+0000 7f96391e6640 1 -- 172.21.15.146:0/96382859 shutdown_connections 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.489+0000 7f96391e6640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9620078bc0 0x7f962007b0d0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.489+0000 7f96391e6640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f963415f5f0 0x7f96341e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.489+0000 7f96391e6640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96340b5350 0x7f96341e69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.489+0000 7f96391e6640 1 --2- 172.21.15.146:0/96382859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f963406f320 0x7f9634152070 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.489+0000 7f96391e6640 1 -- 172.21.15.146:0/96382859 >> 172.21.15.146:0/96382859 conn(0x7f96340b2950 msgr2=0x7f96340cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.490+0000 7f96391e6640 1 -- 172.21.15.146:0/96382859 shutdown_connections 2024-09-17T03:44:34.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.490+0000 7f96391e6640 1 -- 172.21.15.146:0/96382859 wait complete. 2024-09-17T03:44:34.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:44:34.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.640+0000 7f1091a69640 1 -- 172.21.15.146:0/2227150877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078004d40 msgr2=0x7f1078005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:34.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.640+0000 7f1091a69640 1 --2- 172.21.15.146:0/2227150877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078004d40 0x7f1078005150 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f1084005fd0 tx=0x7f1078005830 comp rx=0 tx=0).stop 2024-09-17T03:44:34.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.640+0000 7f108bfff640 1 -- 172.21.15.146:0/2227150877 reap_dead start 2024-09-17T03:44:34.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.640+0000 7f1091a69640 1 -- 172.21.15.146:0/2227150877 shutdown_connections 2024-09-17T03:44:34.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.640+0000 7f1091a69640 1 -- 172.21.15.146:0/2227150877 >> 172.21.15.146:0/2227150877 conn(0x7f108c0b2060 msgr2=0x7f108c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:34.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.640+0000 7f1091a69640 1 -- 172.21.15.146:0/2227150877 shutdown_connections 2024-09-17T03:44:34.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.640+0000 7f1091a69640 1 -- 172.21.15.146:0/2227150877 wait complete. 2024-09-17T03:44:34.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.642+0000 7f1091a69640 1 Processor -- start 2024-09-17T03:44:34.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.642+0000 7f1091a69640 1 -- start start 2024-09-17T03:44:34.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f1091a69640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078004d40 0x7f108c0ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:34.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f1091a69640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f108c0ad3a0 0x7f108c1f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:34.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f1091a69640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f108c1f6030 0x7f108c1f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:34.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f1091a69640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f108c15ec50 con 0x7f1078004d40 2024-09-17T03:44:34.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f1091a69640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f108c15ead0 con 0x7f108c0ad3a0 2024-09-17T03:44:34.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f1091a69640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f108c15edd0 con 0x7f108c1f6030 2024-09-17T03:44:34.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f108b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078004d40 0x7f108c0ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:34.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f108b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078004d40 0x7f108c0ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45122/0 (socket says 172.21.15.146:45122) 2024-09-17T03:44:34.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f108b7fe640 1 -- 172.21.15.146:0/1462172820 learned_addr learned my addr 172.21.15.146:0/1462172820 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:34.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f1083fff640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f108c0ad3a0 0x7f108c1f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:34.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f108bfff640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f108c1f6030 0x7f108c1f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:34.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f108b7fe640 1 -- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f108c1f6030 msgr2=0x7f108c1f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:34.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f108b7fe640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f108c1f6030 0x7f108c1f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:34.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f108b7fe640 1 -- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f108c0ad3a0 msgr2=0x7f108c1f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:34.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f108b7fe640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f108c0ad3a0 0x7f108c1f5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:34.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.643+0000 7f108b7fe640 1 -- 172.21.15.146:0/1462172820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c0ad7b0 con 0x7f1078004d40 2024-09-17T03:44:34.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.644+0000 7f108b7fe640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078004d40 0x7f108c0ace60 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f107c003850 tx=0x7f107c003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:34.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.644+0000 7f1088ff9640 1 -- 172.21.15.146:0/1462172820 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c015070 con 0x7f1078004d40 2024-09-17T03:44:34.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.644+0000 7f1088ff9640 1 -- 172.21.15.146:0/1462172820 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f107c00fc60 con 0x7f1078004d40 2024-09-17T03:44:34.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.644+0000 7f1088ff9640 1 -- 172.21.15.146:0/1462172820 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c003e40 con 0x7f1078004d40 2024-09-17T03:44:34.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.644+0000 7f1091a69640 1 -- 172.21.15.146:0/1462172820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108c1f2950 con 0x7f1078004d40 2024-09-17T03:44:34.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.644+0000 7f1091a69640 1 -- 172.21.15.146:0/1462172820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f108c1f2f10 con 0x7f1078004d40 2024-09-17T03:44:34.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.645+0000 7f1091a69640 1 -- 172.21.15.146:0/1462172820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f108c06ef40 con 0x7f1078004d40 2024-09-17T03:44:34.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.646+0000 7f1088ff9640 1 -- 172.21.15.146:0/1462172820 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f107c011430 con 0x7f1078004d40 2024-09-17T03:44:34.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.646+0000 7f1088ff9640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 0x7f106c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:34.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.646+0000 7f1088ff9640 1 -- 172.21.15.146:0/1462172820 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5609+0+0 (secure 0 0 0) 0x7f107c09bb90 con 0x7f1078004d40 2024-09-17T03:44:34.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.647+0000 7f1083fff640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 0x7f106c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:34.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.647+0000 7f1083fff640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 0x7f106c07b0a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f108c0cf550 tx=0x7f1074005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:34.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.651+0000 7f1088ff9640 1 -- 172.21.15.146:0/1462172820 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f108c0ad7b0 con 0x7f1078004d40 2024-09-17T03:44:34.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:34.865+0000 7f1091a69640 1 -- 172.21.15.146:0/1462172820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f108c1557b0 con 0x7f1078004d40 2024-09-17T03:44:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.487+0000 7f1088ff9640 1 -- 172.21.15.146:0/1462172820 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v133) ==== 174+0+0 (secure 0 0 0) 0x7f108c15f420 con 0x7f1078004d40 2024-09-17T03:44:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 26 and data pool 27 2024-09-17T03:44:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.491+0000 7f1091a69640 1 -- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 msgr2=0x7f106c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.491+0000 7f1091a69640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 0x7f106c07b0a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f108c0cf550 tx=0x7f1074005f30 comp rx=0 tx=0).stop 2024-09-17T03:44:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.492+0000 7f1091a69640 1 -- 172.21.15.146:0/1462172820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078004d40 msgr2=0x7f108c0ace60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:35.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.492+0000 7f1091a69640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078004d40 0x7f108c0ace60 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f107c003850 tx=0x7f107c003c50 comp rx=0 tx=0).stop 2024-09-17T03:44:35.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.494+0000 7f1091a69640 1 -- 172.21.15.146:0/1462172820 shutdown_connections 2024-09-17T03:44:35.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.494+0000 7f1091a69640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f106c078b90 0x7f106c07b0a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.494+0000 7f1091a69640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f108c1f6030 0x7f108c1f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.494+0000 7f1091a69640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f108c0ad3a0 0x7f108c1f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.494+0000 7f1091a69640 1 --2- 172.21.15.146:0/1462172820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1078004d40 0x7f108c0ace60 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.494+0000 7f1091a69640 1 -- 172.21.15.146:0/1462172820 >> 172.21.15.146:0/1462172820 conn(0x7f108c0b2060 msgr2=0x7f108c15d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.504+0000 7f1091a69640 1 -- 172.21.15.146:0/1462172820 shutdown_connections 2024-09-17T03:44:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.504+0000 7f1091a69640 1 -- 172.21.15.146:0/1462172820 wait complete. 2024-09-17T03:44:35.527 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:44:35.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.642+0000 7f9936cb6640 1 -- 172.21.15.146:0/2197761105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9918004800 msgr2=0x7f9918004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:35.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.642+0000 7f9936cb6640 1 --2- 172.21.15.146:0/2197761105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9918004800 0x7f9918004c10 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f99300b7fe0 tx=0x7f9918005830 comp rx=0 tx=0).stop 2024-09-17T03:44:35.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.642+0000 7f9936cb6640 1 -- 172.21.15.146:0/2197761105 shutdown_connections 2024-09-17T03:44:35.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.642+0000 7f9936cb6640 1 --2- 172.21.15.146:0/2197761105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9918004800 0x7f9918004c10 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.642+0000 7f9936cb6640 1 -- 172.21.15.146:0/2197761105 >> 172.21.15.146:0/2197761105 conn(0x7f99300b7b20 msgr2=0x7f993009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:35.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.642+0000 7f9936cb6640 1 -- 172.21.15.146:0/2197761105 shutdown_connections 2024-09-17T03:44:35.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.642+0000 7f9936cb6640 1 -- 172.21.15.146:0/2197761105 wait complete. 2024-09-17T03:44:35.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.643+0000 7f9936cb6640 1 Processor -- start 2024-09-17T03:44:35.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.644+0000 7f9936cb6640 1 -- start start 2024-09-17T03:44:35.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9936cb6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9918004800 0x7f99301480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:35.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9936cb6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9930153750 0x7f993015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:35.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9936cb6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993015efc0 0x7f99301f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:35.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9936cb6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f99300b1320 con 0x7f993015efc0 2024-09-17T03:44:35.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9936cb6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f99300b3880 con 0x7f9918004800 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9936cb6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f99300b14a0 con 0x7f9930153750 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9935253640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993015efc0 0x7f99301f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9935253640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993015efc0 0x7f99301f3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45144/0 (socket says 172.21.15.146:45144) 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9935253640 1 -- 172.21.15.146:0/1158736460 learned_addr learned my addr 172.21.15.146:0/1158736460 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9934a52640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9918004800 0x7f99301480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f992ffff640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9930153750 0x7f993015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9935253640 1 -- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9930153750 msgr2=0x7f993015ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9935253640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9930153750 0x7f993015ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9935253640 1 -- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9918004800 msgr2=0x7f99301480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9935253640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9918004800 0x7f99301480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.645+0000 7f9935253640 1 -- 172.21.15.146:0/1158736460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993015f3d0 con 0x7f993015efc0 2024-09-17T03:44:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.646+0000 7f9935253640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993015efc0 0x7f99301f3990 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f99300b1a30 tx=0x7f9928006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.646+0000 7f992d7fa640 1 -- 172.21.15.146:0/1158736460 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928017070 con 0x7f993015efc0 2024-09-17T03:44:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.646+0000 7f992d7fa640 1 -- 172.21.15.146:0/1158736460 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99280109a0 con 0x7f993015efc0 2024-09-17T03:44:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.646+0000 7f9936cb6640 1 -- 172.21.15.146:0/1158736460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9930148630 con 0x7f993015efc0 2024-09-17T03:44:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.646+0000 7f992d7fa640 1 -- 172.21.15.146:0/1158736460 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928010df0 con 0x7f993015efc0 2024-09-17T03:44:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.646+0000 7f9936cb6640 1 -- 172.21.15.146:0/1158736460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99301f7280 con 0x7f993015efc0 2024-09-17T03:44:35.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.647+0000 7f9936cb6640 1 -- 172.21.15.146:0/1158736460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99300b20a0 con 0x7f993015efc0 2024-09-17T03:44:35.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.647+0000 7f992d7fa640 1 -- 172.21.15.146:0/1158736460 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f992801a070 con 0x7f993015efc0 2024-09-17T03:44:35.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.648+0000 7f992d7fa640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f991c078bc0 0x7f991c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:35.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.648+0000 7f992d7fa640 1 -- 172.21.15.146:0/1158736460 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5709+0+0 (secure 0 0 0) 0x7f992809ac10 con 0x7f993015efc0 2024-09-17T03:44:35.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.648+0000 7f9934a52640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f991c078bc0 0x7f991c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:35.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.649+0000 7f9934a52640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f991c078bc0 0x7f991c07b0d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9920000c00 tx=0x7f9920006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.653+0000 7f992d7fa640 1 -- 172.21.15.146:0/1158736460 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f993015f3d0 con 0x7f993015efc0 2024-09-17T03:44:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.827+0000 7f9936cb6640 1 -- 172.21.15.146:0/1158736460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9930071120 con 0x7f993015efc0 2024-09-17T03:44:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.829+0000 7f992d7fa640 1 -- 172.21.15.146:0/1158736460 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) ==== 74+0+16804 (secure 0 0 0) 0x7f992809e070 con 0x7f993015efc0 2024-09-17T03:44:35.829 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:35.830 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":175,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:44:34.867014+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:44:32.495473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T03:44:33.816918+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:44:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 -- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f991c078bc0 msgr2=0x7f991c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f991c078bc0 0x7f991c07b0d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9920000c00 tx=0x7f9920006b70 comp rx=0 tx=0).stop 2024-09-17T03:44:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 -- 172.21.15.146:0/1158736460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993015efc0 msgr2=0x7f99301f3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993015efc0 0x7f99301f3990 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f99300b1a30 tx=0x7f9928006420 comp rx=0 tx=0).stop 2024-09-17T03:44:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 -- 172.21.15.146:0/1158736460 shutdown_connections 2024-09-17T03:44:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f991c078bc0 0x7f991c07b0d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993015efc0 0x7f99301f3990 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9930153750 0x7f993015ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 --2- 172.21.15.146:0/1158736460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9918004800 0x7f99301480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 -- 172.21.15.146:0/1158736460 >> 172.21.15.146:0/1158736460 conn(0x7f99300b7b20 msgr2=0x7f993015b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:35.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 -- 172.21.15.146:0/1158736460 shutdown_connections 2024-09-17T03:44:35.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.831+0000 7f9936cb6640 1 -- 172.21.15.146:0/1158736460 wait complete. 2024-09-17T03:44:35.843 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:44:35.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.956+0000 7fbccd207640 1 -- 172.21.15.146:0/3765047978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb4004800 msgr2=0x7fbcb4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:35.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.956+0000 7fbccd207640 1 --2- 172.21.15.146:0/3765047978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb4004800 0x7fbcb4004c10 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80b7fe0 tx=0x7fbcb4005830 comp rx=0 tx=0).stop 2024-09-17T03:44:35.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.956+0000 7fbcc759e640 1 -- 172.21.15.146:0/3765047978 reap_dead start 2024-09-17T03:44:35.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.956+0000 7fbccd207640 1 -- 172.21.15.146:0/3765047978 shutdown_connections 2024-09-17T03:44:35.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.956+0000 7fbccd207640 1 -- 172.21.15.146:0/3765047978 >> 172.21.15.146:0/3765047978 conn(0x7fbcc80b7b20 msgr2=0x7fbcc809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:35.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.956+0000 7fbccd207640 1 -- 172.21.15.146:0/3765047978 shutdown_connections 2024-09-17T03:44:35.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.956+0000 7fbccd207640 1 -- 172.21.15.146:0/3765047978 wait complete. 2024-09-17T03:44:35.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.958+0000 7fbccd207640 1 Processor -- start 2024-09-17T03:44:35.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.959+0000 7fbccd207640 1 -- start start 2024-09-17T03:44:35.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbccd207640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb4004800 0x7fbcc81f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:35.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbccd207640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcc809e8c0 0x7fbcc809fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:35.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbccd207640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcc81f6570 0x7fbcc81f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbccd207640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc815caa0 con 0x7fbcb4004800 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbccd207640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc815cc20 con 0x7fbcc81f6570 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbccd207640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc815cda0 con 0x7fbcc809e8c0 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcc6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb4004800 0x7fbcc81f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcc6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb4004800 0x7fbcc81f4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45156/0 (socket says 172.21.15.146:45156) 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcc6d9d640 1 -- 172.21.15.146:0/3069150361 learned_addr learned my addr 172.21.15.146:0/3069150361 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcbe59c640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcc809e8c0 0x7fbcc809fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcc759e640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcc81f6570 0x7fbcc81f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcc6d9d640 1 -- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcc809e8c0 msgr2=0x7fbcc809fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcc6d9d640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcc809e8c0 0x7fbcc809fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcc6d9d640 1 -- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcc81f6570 msgr2=0x7fbcc81f6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:35.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcc6d9d640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcc81f6570 0x7fbcc81f6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:35.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcc6d9d640 1 -- 172.21.15.146:0/3069150361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc814fdb0 con 0x7fbcb4004800 2024-09-17T03:44:35.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcc6d9d640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb4004800 0x7fbcc81f4140 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800fa00 tx=0x7fbcb800fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:35.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.960+0000 7fbcbffff640 1 -- 172.21.15.146:0/3069150361 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8015070 con 0x7fbcb4004800 2024-09-17T03:44:35.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.961+0000 7fbcbffff640 1 -- 172.21.15.146:0/3069150361 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcb800be00 con 0x7fbcb4004800 2024-09-17T03:44:35.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.961+0000 7fbccd207640 1 -- 172.21.15.146:0/3069150361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc809edf0 con 0x7fbcb4004800 2024-09-17T03:44:35.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.961+0000 7fbcbffff640 1 -- 172.21.15.146:0/3069150361 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8004260 con 0x7fbcb4004800 2024-09-17T03:44:35.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.961+0000 7fbccd207640 1 -- 172.21.15.146:0/3069150361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc809f3b0 con 0x7fbcb4004800 2024-09-17T03:44:35.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.961+0000 7fbccd207640 1 -- 172.21.15.146:0/3069150361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc80b1320 con 0x7fbcb4004800 2024-09-17T03:44:35.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.962+0000 7fbcbffff640 1 -- 172.21.15.146:0/3069150361 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcb80035f0 con 0x7fbcb4004800 2024-09-17T03:44:35.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.963+0000 7fbcbffff640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbca8078bc0 0x7fbca807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:35.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.963+0000 7fbcbffff640 1 -- 172.21.15.146:0/3069150361 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5709+0+0 (secure 0 0 0) 0x7fbcb809b850 con 0x7fbcb4004800 2024-09-17T03:44:35.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.963+0000 7fbcbe59c640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbca8078bc0 0x7fbca807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:35.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.963+0000 7fbcbe59c640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbca8078bc0 0x7fbca807b0d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0033000 tx=0x7fbcb0038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:35.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:35.967+0000 7fbcbffff640 1 -- 172.21.15.146:0/3069150361 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbcb80636d0 con 0x7fbcb4004800 2024-09-17T03:44:36.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.142+0000 7fbccd207640 1 -- 172.21.15.146:0/3069150361 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbcc8159a30 con 0x7fbcb4004800 2024-09-17T03:44:36.144 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.144+0000 7fbcbffff640 1 -- 172.21.15.146:0/3069150361 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) ==== 74+0+16804 (secure 0 0 0) 0x7fbcb8068100 con 0x7fbcb4004800 2024-09-17T03:44:36.144 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:36.144 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":175,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:44:34.867014+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:44:32.495473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T03:44:33.816918+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:44:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 -- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbca8078bc0 msgr2=0x7fbca807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbca8078bc0 0x7fbca807b0d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0033000 tx=0x7fbcb0038040 comp rx=0 tx=0).stop 2024-09-17T03:44:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 -- 172.21.15.146:0/3069150361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb4004800 msgr2=0x7fbcc81f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb4004800 0x7fbcc81f4140 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800fa00 tx=0x7fbcb800fec0 comp rx=0 tx=0).stop 2024-09-17T03:44:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 -- 172.21.15.146:0/3069150361 shutdown_connections 2024-09-17T03:44:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbca8078bc0 0x7fbca807b0d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbcc81f6570 0x7fbcc81f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcc809e8c0 0x7fbcc809fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 --2- 172.21.15.146:0/3069150361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb4004800 0x7fbcc81f4140 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 -- 172.21.15.146:0/3069150361 >> 172.21.15.146:0/3069150361 conn(0x7fbcc80b7b20 msgr2=0x7fbcc8070720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 -- 172.21.15.146:0/3069150361 shutdown_connections 2024-09-17T03:44:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.146+0000 7fbccd207640 1 -- 172.21.15.146:0/3069150361 wait complete. 2024-09-17T03:44:36.158 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:44:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.276+0000 7f942c1e6640 1 -- 172.21.15.146:0/2255820870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94241631a0 msgr2=0x7f94240cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.276+0000 7f942c1e6640 1 --2- 172.21.15.146:0/2255820870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94241631a0 0x7f94240cef40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9414009830 tx=0x7f941402a410 comp rx=0 tx=0).stop 2024-09-17T03:44:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.276+0000 7f942c1e6640 1 -- 172.21.15.146:0/2255820870 shutdown_connections 2024-09-17T03:44:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.276+0000 7f942c1e6640 1 --2- 172.21.15.146:0/2255820870 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f94241631a0 0x7f94240cef40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.276+0000 7f942c1e6640 1 --2- 172.21.15.146:0/2255820870 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f942415f1a0 0x7f94240cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.276+0000 7f942c1e6640 1 -- 172.21.15.146:0/2255820870 >> 172.21.15.146:0/2255820870 conn(0x7f94240d11f0 msgr2=0x7f94240d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.276+0000 7f942c1e6640 1 -- 172.21.15.146:0/2255820870 shutdown_connections 2024-09-17T03:44:36.277 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.276+0000 7f942c1e6640 1 -- 172.21.15.146:0/2255820870 wait complete. 2024-09-17T03:44:36.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.278+0000 7f942c1e6640 1 Processor -- start 2024-09-17T03:44:36.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.278+0000 7f942c1e6640 1 -- start start 2024-09-17T03:44:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.279+0000 7f942c1e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94240b61f0 0x7f94241f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.279+0000 7f942c1e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f942415f1a0 0x7f94241f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.279+0000 7f942c1e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94241631a0 0x7f94240b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.279+0000 7f942c1e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f94240693a0 con 0x7f94241631a0 2024-09-17T03:44:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.279+0000 7f942c1e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9424069220 con 0x7f942415f1a0 2024-09-17T03:44:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.279+0000 7f942c1e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9424069520 con 0x7f94240b61f0 2024-09-17T03:44:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.279+0000 7f942a783640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94241631a0 0x7f94240b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f942a783640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94241631a0 0x7f94240b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45164/0 (socket says 172.21.15.146:45164) 2024-09-17T03:44:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f942a783640 1 -- 172.21.15.146:0/1708345805 learned_addr learned my addr 172.21.15.146:0/1708345805 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f9429781640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f942415f1a0 0x7f94241f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f9429f82640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94240b61f0 0x7f94241f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f942a783640 1 -- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94240b61f0 msgr2=0x7f94241f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f942a783640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94240b61f0 0x7f94241f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f942a783640 1 -- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f942415f1a0 msgr2=0x7f94241f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f942a783640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f942415f1a0 0x7f94241f9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f942a783640 1 -- 172.21.15.146:0/1708345805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94241f5ba0 con 0x7f94241631a0 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f942a783640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94241631a0 0x7f94240b51e0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c480 tx=0x7f941c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f941a7fc640 1 -- 172.21.15.146:0/1708345805 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c016020 con 0x7f94241631a0 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f941a7fc640 1 -- 172.21.15.146:0/1708345805 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f941c012940 con 0x7f94241631a0 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f942c1e6640 1 -- 172.21.15.146:0/1708345805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94241f5e80 con 0x7f94241631a0 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f941a7fc640 1 -- 172.21.15.146:0/1708345805 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c012d90 con 0x7f94241631a0 2024-09-17T03:44:36.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.280+0000 7f942c1e6640 1 -- 172.21.15.146:0/1708345805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94241f6440 con 0x7f94241631a0 2024-09-17T03:44:36.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.281+0000 7f942c1e6640 1 -- 172.21.15.146:0/1708345805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94241f5910 con 0x7f94241631a0 2024-09-17T03:44:36.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.282+0000 7f941a7fc640 1 -- 172.21.15.146:0/1708345805 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f941c019020 con 0x7f94241631a0 2024-09-17T03:44:36.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.282+0000 7f941a7fc640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9408078bc0 0x7f940807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:36.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.283+0000 7f941a7fc640 1 -- 172.21.15.146:0/1708345805 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5709+0+0 (secure 0 0 0) 0x7f941c09ac80 con 0x7f94241631a0 2024-09-17T03:44:36.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.283+0000 7f9429f82640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9408078bc0 0x7f940807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:36.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.283+0000 7f9429f82640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9408078bc0 0x7f940807b0d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9420005fd0 tx=0x7f9420009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:36.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.287+0000 7f941a7fc640 1 -- 172.21.15.146:0/1708345805 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f941c020020 con 0x7f94241631a0 2024-09-17T03:44:36.499 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:36.499+0000 7f942c1e6640 1 -- 172.21.15.146:0/1708345805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f94240699c0 con 0x7f94241631a0 2024-09-17T03:44:37.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.512+0000 7f941a7fc640 1 -- 172.21.15.146:0/1708345805 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v135) ==== 118+0+0 (secure 0 0 0) 0x7f941c062a80 con 0x7f94241631a0 2024-09-17T03:44:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 -- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9408078bc0 msgr2=0x7f940807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9408078bc0 0x7f940807b0d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9420005fd0 tx=0x7f9420009500 comp rx=0 tx=0).stop 2024-09-17T03:44:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 -- 172.21.15.146:0/1708345805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94241631a0 msgr2=0x7f94240b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94241631a0 0x7f94240b51e0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c480 tx=0x7f941c00c940 comp rx=0 tx=0).stop 2024-09-17T03:44:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 -- 172.21.15.146:0/1708345805 shutdown_connections 2024-09-17T03:44:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9408078bc0 0x7f940807b0d0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94241631a0 0x7f94240b51e0 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f942415f1a0 0x7f94241f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 --2- 172.21.15.146:0/1708345805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f94240b61f0 0x7f94241f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 -- 172.21.15.146:0/1708345805 >> 172.21.15.146:0/1708345805 conn(0x7f94240d11f0 msgr2=0x7f942415d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 -- 172.21.15.146:0/1708345805 shutdown_connections 2024-09-17T03:44:37.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.515+0000 7f942c1e6640 1 -- 172.21.15.146:0/1708345805 wait complete. 2024-09-17T03:44:37.530 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:44:37.530 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:44:37.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.654+0000 7f132238b640 1 -- 172.21.15.146:0/1588712944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1304004800 msgr2=0x7f1304004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:37.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.654+0000 7f132238b640 1 --2- 172.21.15.146:0/1588712944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1304004800 0x7f1304004c10 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f131c072e10 tx=0x7f1304005830 comp rx=0 tx=0).stop 2024-09-17T03:44:37.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.654+0000 7f132238b640 1 -- 172.21.15.146:0/1588712944 shutdown_connections 2024-09-17T03:44:37.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.654+0000 7f132238b640 1 --2- 172.21.15.146:0/1588712944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1304004800 0x7f1304004c10 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:37.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.654+0000 7f132238b640 1 -- 172.21.15.146:0/1588712944 >> 172.21.15.146:0/1588712944 conn(0x7f131c0b7b20 msgr2=0x7f131c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:37.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.654+0000 7f132238b640 1 -- 172.21.15.146:0/1588712944 shutdown_connections 2024-09-17T03:44:37.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.654+0000 7f132238b640 1 -- 172.21.15.146:0/1588712944 wait complete. 2024-09-17T03:44:37.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.656+0000 7f132238b640 1 Processor -- start 2024-09-17T03:44:37.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.656+0000 7f132238b640 1 -- start start 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.657+0000 7f132238b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1304004800 0x7f131c1f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.657+0000 7f132238b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f131c1559e0 0x7f131c1f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.657+0000 7f132238b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f131c153a70 0x7f131c153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.657+0000 7f132238b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f131c0b1920 con 0x7f1304004800 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.657+0000 7f132238b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f131c0b17a0 con 0x7f131c1559e0 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.657+0000 7f132238b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f131c0b3620 con 0x7f131c153a70 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.657+0000 7f131bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1304004800 0x7f131c1f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.657+0000 7f131bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1304004800 0x7f131c1f3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48012/0 (socket says 172.21.15.146:48012) 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.657+0000 7f131bfff640 1 -- 172.21.15.146:0/2943097476 learned_addr learned my addr 172.21.15.146:0/2943097476 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.657+0000 7f131b7fe640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f131c1559e0 0x7f131c1f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.657+0000 7f1320928640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f131c153a70 0x7f131c153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:37.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.658+0000 7f131bfff640 1 -- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f131c153a70 msgr2=0x7f131c153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.658+0000 7f131bfff640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f131c153a70 0x7f131c153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.658+0000 7f131bfff640 1 -- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f131c1559e0 msgr2=0x7f131c1f0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.658+0000 7f131bfff640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f131c1559e0 0x7f131c1f0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.658+0000 7f131bfff640 1 -- 172.21.15.146:0/2943097476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c1f4050 con 0x7f1304004800 2024-09-17T03:44:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.658+0000 7f131bfff640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1304004800 0x7f131c1f3b10 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f130c011ae0 tx=0x7f130c009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.658+0000 7f1318ff9640 1 -- 172.21.15.146:0/2943097476 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c00fcb0 con 0x7f1304004800 2024-09-17T03:44:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.658+0000 7f1318ff9640 1 -- 172.21.15.146:0/2943097476 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f130c00fe50 con 0x7f1304004800 2024-09-17T03:44:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.658+0000 7f132238b640 1 -- 172.21.15.146:0/2943097476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131c1543c0 con 0x7f1304004800 2024-09-17T03:44:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.658+0000 7f1318ff9640 1 -- 172.21.15.146:0/2943097476 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c004280 con 0x7f1304004800 2024-09-17T03:44:37.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.658+0000 7f132238b640 1 -- 172.21.15.146:0/2943097476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131c1f0a80 con 0x7f1304004800 2024-09-17T03:44:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.659+0000 7f132238b640 1 -- 172.21.15.146:0/2943097476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131c0b3b80 con 0x7f1304004800 2024-09-17T03:44:37.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.660+0000 7f1318ff9640 1 -- 172.21.15.146:0/2943097476 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f130c0035f0 con 0x7f1304004800 2024-09-17T03:44:37.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.660+0000 7f1318ff9640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1308078b90 0x7f130807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:37.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.660+0000 7f1318ff9640 1 -- 172.21.15.146:0/2943097476 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f130c09b820 con 0x7f1304004800 2024-09-17T03:44:37.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.661+0000 7f131b7fe640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1308078b90 0x7f130807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:37.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.661+0000 7f131b7fe640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1308078b90 0x7f130807b0a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1310033000 tx=0x7f1310000fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:37.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.665+0000 7f1318ff9640 1 -- 172.21.15.146:0/2943097476 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f131c1543c0 con 0x7f1304004800 2024-09-17T03:44:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:37.876+0000 7f132238b640 1 -- 172.21.15.146:0/2943097476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f131c0b2930 con 0x7f1304004800 2024-09-17T03:44:38.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.519+0000 7f1318ff9640 1 -- 172.21.15.146:0/2943097476 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v136) ==== 122+0+0 (secure 0 0 0) 0x7f131c1f4050 con 0x7f1304004800 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 -- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1308078b90 msgr2=0x7f130807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1308078b90 0x7f130807b0a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1310033000 tx=0x7f1310000fe0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 -- 172.21.15.146:0/2943097476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1304004800 msgr2=0x7f131c1f3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1304004800 0x7f131c1f3b10 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f130c011ae0 tx=0x7f130c009f10 comp rx=0 tx=0).stop 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 -- 172.21.15.146:0/2943097476 shutdown_connections 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1308078b90 0x7f130807b0a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f131c153a70 0x7f131c153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f131c1559e0 0x7f131c1f0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 --2- 172.21.15.146:0/2943097476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1304004800 0x7f131c1f3b10 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 -- 172.21.15.146:0/2943097476 >> 172.21.15.146:0/2943097476 conn(0x7f131c0b7b20 msgr2=0x7f131c0b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 -- 172.21.15.146:0/2943097476 shutdown_connections 2024-09-17T03:44:38.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.523+0000 7f132238b640 1 -- 172.21.15.146:0/2943097476 wait complete. 2024-09-17T03:44:38.538 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:44:38.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:44:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.657+0000 7f451f590640 1 -- 172.21.15.146:0/2819915854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4500004800 msgr2=0x7f4500004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.657+0000 7f451f590640 1 --2- 172.21.15.146:0/2819915854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4500004800 0x7f4500004c10 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f45180b7fe0 tx=0x7f4500005830 comp rx=0 tx=0).stop 2024-09-17T03:44:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.657+0000 7f451f590640 1 -- 172.21.15.146:0/2819915854 shutdown_connections 2024-09-17T03:44:38.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.657+0000 7f451f590640 1 --2- 172.21.15.146:0/2819915854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4500004800 0x7f4500004c10 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.657+0000 7f451f590640 1 -- 172.21.15.146:0/2819915854 >> 172.21.15.146:0/2819915854 conn(0x7f45180b7b20 msgr2=0x7f451809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.657+0000 7f451f590640 1 -- 172.21.15.146:0/2819915854 shutdown_connections 2024-09-17T03:44:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.657+0000 7f451f590640 1 -- 172.21.15.146:0/2819915854 wait complete. 2024-09-17T03:44:38.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.659+0000 7f451f590640 1 Processor -- start 2024-09-17T03:44:38.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.659+0000 7f451f590640 1 -- start start 2024-09-17T03:44:38.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451f590640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4500004800 0x7f4518152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451f590640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4518157580 0x7f45181e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451f590640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4518153120 0x7f45181e7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451f590640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f45180b3620 con 0x7f4518157580 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451f590640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f45180b1750 con 0x7f4518153120 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451f590640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f45180b37a0 con 0x7f4500004800 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451cb2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4518157580 0x7f45181e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451cb2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4518157580 0x7f45181e6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48036/0 (socket says 172.21.15.146:48036) 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451cb2b640 1 -- 172.21.15.146:0/242437459 learned_addr learned my addr 172.21.15.146:0/242437459 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451d32c640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4500004800 0x7f4518152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451db2d640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4518153120 0x7f45181e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451cb2b640 1 -- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4500004800 msgr2=0x7f4518152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451cb2b640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4500004800 0x7f4518152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451cb2b640 1 -- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4518153120 msgr2=0x7f45181e7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:38.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451cb2b640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4518153120 0x7f45181e7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.660+0000 7f451cb2b640 1 -- 172.21.15.146:0/242437459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4518154dc0 con 0x7f4518157580 2024-09-17T03:44:38.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.661+0000 7f451cb2b640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4518157580 0x7f45181e6fe0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c3a0 tx=0x7f450c001d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:38.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.661+0000 7f4515ffb640 1 -- 172.21.15.146:0/242437459 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c031040 con 0x7f4518157580 2024-09-17T03:44:38.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.661+0000 7f4515ffb640 1 -- 172.21.15.146:0/242437459 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f450c0035f0 con 0x7f4518157580 2024-09-17T03:44:38.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.661+0000 7f451f590640 1 -- 172.21.15.146:0/242437459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4518152980 con 0x7f4518157580 2024-09-17T03:44:38.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.661+0000 7f4515ffb640 1 -- 172.21.15.146:0/242437459 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c003a20 con 0x7f4518157580 2024-09-17T03:44:38.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.661+0000 7f451f590640 1 -- 172.21.15.146:0/242437459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4518154930 con 0x7f4518157580 2024-09-17T03:44:38.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.662+0000 7f451f590640 1 -- 172.21.15.146:0/242437459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45180b3d00 con 0x7f4518157580 2024-09-17T03:44:38.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.663+0000 7f4515ffb640 1 -- 172.21.15.146:0/242437459 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f450c03e030 con 0x7f4518157580 2024-09-17T03:44:38.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.663+0000 7f4515ffb640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4504078bc0 0x7f450407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:38.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.663+0000 7f4515ffb640 1 -- 172.21.15.146:0/242437459 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f450c0ba7e0 con 0x7f4518157580 2024-09-17T03:44:38.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.664+0000 7f451d32c640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4504078bc0 0x7f450407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:38.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.664+0000 7f451d32c640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4504078bc0 0x7f450407b0d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f451806c6a0 tx=0x7f45080049b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:38.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.668+0000 7f4515ffb640 1 -- 172.21.15.146:0/242437459 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f450c0825e0 con 0x7f4518157580 2024-09-17T03:44:38.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.877+0000 7f451f590640 1 -- 172.21.15.146:0/242437459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4518071780 con 0x7f4518157580 2024-09-17T03:44:38.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.878+0000 7f4515ffb640 1 -- 172.21.15.146:0/242437459 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5250 (secure 0 0 0) 0x7f450c087010 con 0x7f4518157580 2024-09-17T03:44:38.878 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:38.878 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"btime":"2024-09-17T03:44:38:513917+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8309,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2438790201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2438790201},{"type":"v1","addr":"172.21.15.146:6835","nonce":2438790201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3707736043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3707736043},{"type":"v1","addr":"172.21.15.179:6836","nonce":3707736043}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2895389304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2895389304},{"type":"v1","addr":"172.21.15.179:6837","nonce":2895389304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:44:34.866944+0000","modified":"2024-09-17T03:44:37.878491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10671},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10671":{"gid":10671,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/2269642448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2269642448},{"type":"v1","addr":"172.21.15.146:6834","nonce":2269642448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10671,"qdb_cluster":[10671]},"id":13}]} 2024-09-17T03:44:38.878 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2024-09-17T03:44:38.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 -- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4504078bc0 msgr2=0x7f450407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:38.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4504078bc0 0x7f450407b0d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f451806c6a0 tx=0x7f45080049b0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 -- 172.21.15.146:0/242437459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4518157580 msgr2=0x7f45181e6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:38.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4518157580 0x7f45181e6fe0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c3a0 tx=0x7f450c001d60 comp rx=0 tx=0).stop 2024-09-17T03:44:38.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 -- 172.21.15.146:0/242437459 shutdown_connections 2024-09-17T03:44:38.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4504078bc0 0x7f450407b0d0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4518153120 0x7f45181e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4518157580 0x7f45181e6fe0 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 --2- 172.21.15.146:0/242437459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4500004800 0x7f4518152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:38.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 -- 172.21.15.146:0/242437459 >> 172.21.15.146:0/242437459 conn(0x7f45180b7b20 msgr2=0x7f45181e8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:38.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 -- 172.21.15.146:0/242437459 shutdown_connections 2024-09-17T03:44:38.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:38.880+0000 7f451f590640 1 -- 172.21.15.146:0/242437459 wait complete. 2024-09-17T03:44:38.892 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:44:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.005+0000 7f6cd600a640 1 -- 172.21.15.146:0/1696961355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd0072bc0 msgr2=0x7f6cd015f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.005+0000 7f6cd600a640 1 --2- 172.21.15.146:0/1696961355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd0072bc0 0x7f6cd015f2e0 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f6cd006e1d0 tx=0x7f6cc802a9b0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.005+0000 7f6cd600a640 1 -- 172.21.15.146:0/1696961355 shutdown_connections 2024-09-17T03:44:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.005+0000 7f6cd600a640 1 --2- 172.21.15.146:0/1696961355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd0072bc0 0x7f6cd015f2e0 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.005+0000 7f6cd600a640 1 --2- 172.21.15.146:0/1696961355 >> v2:172.21.15.179:3300/0 conn(0x7f6cd0070350 0x7f6cd0072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.005+0000 7f6cd600a640 1 --2- 172.21.15.146:0/1696961355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd015b770 0x7f6cd006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.005+0000 7f6cd600a640 1 -- 172.21.15.146:0/1696961355 >> 172.21.15.146:0/1696961355 conn(0x7f6cd00b2060 msgr2=0x7f6cd00b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.005+0000 7f6cd600a640 1 -- 172.21.15.146:0/1696961355 shutdown_connections 2024-09-17T03:44:39.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.005+0000 7f6cd600a640 1 -- 172.21.15.146:0/1696961355 wait complete. 2024-09-17T03:44:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.007+0000 7f6cd600a640 1 Processor -- start 2024-09-17T03:44:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.007+0000 7f6cd600a640 1 -- start start 2024-09-17T03:44:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.008+0000 7f6cd600a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd0070350 0x7f6cd015cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.008+0000 7f6cd600a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cd0072bc0 0x7f6cd014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.008+0000 7f6cd600a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd015b770 0x7f6cd015d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.008+0000 7f6cd600a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd015fbb0 con 0x7f6cd0070350 2024-09-17T03:44:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.008+0000 7f6cd600a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd015fa30 con 0x7f6cd0072bc0 2024-09-17T03:44:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.008+0000 7f6cd600a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd015fd30 con 0x7f6cd015b770 2024-09-17T03:44:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.008+0000 7f6ccf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd0070350 0x7f6cd015cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.008+0000 7f6ccf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd0070350 0x7f6cd015cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48040/0 (socket says 172.21.15.146:48040) 2024-09-17T03:44:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.008+0000 7f6ccf7fe640 1 -- 172.21.15.146:0/1854702662 learned_addr learned my addr 172.21.15.146:0/1854702662 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6cceffd640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cd0072bc0 0x7f6cd014cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6ccf7fe640 1 -- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd015b770 msgr2=0x7f6cd015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6ccf7fe640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd015b770 0x7f6cd015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6ccf7fe640 1 -- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cd0072bc0 msgr2=0x7f6cd014cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6ccf7fe640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cd0072bc0 0x7f6cd014cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6ccf7fe640 1 -- 172.21.15.146:0/1854702662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd0153840 con 0x7f6cd0070350 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6cceffd640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cd0072bc0 0x7f6cd014cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6ccf7fe640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd0070350 0x7f6cd015cde0 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000d700 tx=0x7f6cc000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6cb7fff640 1 -- 172.21.15.146:0/1854702662 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0017070 con 0x7f6cd0070350 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6cb7fff640 1 -- 172.21.15.146:0/1854702662 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc0005310 con 0x7f6cd0070350 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6cd600a640 1 -- 172.21.15.146:0/1854702662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd0153b20 con 0x7f6cd0070350 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6cb7fff640 1 -- 172.21.15.146:0/1854702662 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0009820 con 0x7f6cd0070350 2024-09-17T03:44:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.009+0000 7f6cd600a640 1 -- 172.21.15.146:0/1854702662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd01540e0 con 0x7f6cd0070350 2024-09-17T03:44:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.010+0000 7f6cd600a640 1 -- 172.21.15.146:0/1854702662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd00d12c0 con 0x7f6cd0070350 2024-09-17T03:44:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.011+0000 7f6cb7fff640 1 -- 172.21.15.146:0/1854702662 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6cc00099c0 con 0x7f6cd0070350 2024-09-17T03:44:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.011+0000 7f6cb7fff640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6cbc078b90 0x7f6cbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.011+0000 7f6cb7fff640 1 -- 172.21.15.146:0/1854702662 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f6cc009ad90 con 0x7f6cd0070350 2024-09-17T03:44:39.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.011+0000 7f6cceffd640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6cbc078b90 0x7f6cbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:39.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.012+0000 7f6cceffd640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6cbc078b90 0x7f6cbc07b0a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4005ca0 tx=0x7f6cc4005e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:39.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.016+0000 7f6cb7fff640 1 -- 172.21.15.146:0/1854702662 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6cd00d12c0 con 0x7f6cd0070350 2024-09-17T03:44:39.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.190+0000 7f6cd600a640 1 -- 172.21.15.146:0/1854702662 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cd0072680 con 0x7f6cd0070350 2024-09-17T03:44:39.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.191+0000 7f6cb7fff640 1 -- 172.21.15.146:0/1854702662 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16791 (secure 0 0 0) 0x7f6cc00631d0 con 0x7f6cd0070350 2024-09-17T03:44:39.191 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:39.191 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":176,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:44:36.488481+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:44:32.495473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T03:44:33.816918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:44:39.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 -- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6cbc078b90 msgr2=0x7f6cbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6cbc078b90 0x7f6cbc07b0a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4005ca0 tx=0x7f6cc4005e20 comp rx=0 tx=0).stop 2024-09-17T03:44:39.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 -- 172.21.15.146:0/1854702662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd0070350 msgr2=0x7f6cd015cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd0070350 0x7f6cd015cde0 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000d700 tx=0x7f6cc000dbc0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 -- 172.21.15.146:0/1854702662 shutdown_connections 2024-09-17T03:44:39.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6cbc078b90 0x7f6cbc07b0a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6cd015b770 0x7f6cd015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cd0072bc0 0x7f6cd014cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 --2- 172.21.15.146:0/1854702662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cd0070350 0x7f6cd015cde0 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 -- 172.21.15.146:0/1854702662 >> 172.21.15.146:0/1854702662 conn(0x7f6cd00b2060 msgr2=0x7f6cd006ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:39.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 -- 172.21.15.146:0/1854702662 shutdown_connections 2024-09-17T03:44:39.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.193+0000 7f6cd600a640 1 -- 172.21.15.146:0/1854702662 wait complete. 2024-09-17T03:44:39.205 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:44:39.206 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:44:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.317+0000 7f7e928c4640 1 -- 172.21.15.146:0/1590423033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8c0b3d30 msgr2=0x7f7e8c1677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.317+0000 7f7e928c4640 1 --2- 172.21.15.146:0/1590423033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8c0b3d30 0x7f7e8c1677c0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f7e84005fd0 tx=0x7f7e8402a820 comp rx=0 tx=0).stop 2024-09-17T03:44:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.317+0000 7f7e928c4640 1 -- 172.21.15.146:0/1590423033 shutdown_connections 2024-09-17T03:44:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.317+0000 7f7e928c4640 1 --2- 172.21.15.146:0/1590423033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8c0b3d30 0x7f7e8c1677c0 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.317+0000 7f7e928c4640 1 -- 172.21.15.146:0/1590423033 >> 172.21.15.146:0/1590423033 conn(0x7f7e8c0b7b20 msgr2=0x7f7e8c09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.317+0000 7f7e928c4640 1 -- 172.21.15.146:0/1590423033 shutdown_connections 2024-09-17T03:44:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.317+0000 7f7e928c4640 1 -- 172.21.15.146:0/1590423033 wait complete. 2024-09-17T03:44:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.319+0000 7f7e928c4640 1 Processor -- start 2024-09-17T03:44:39.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.319+0000 7f7e928c4640 1 -- start start 2024-09-17T03:44:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.320+0000 7f7e928c4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e8c0b5750 0x7f7e8c1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.320+0000 7f7e928c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8c0b5ce0 0x7f7e8c14c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.320+0000 7f7e928c4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e8c14f250 0x7f7e8c15b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.320+0000 7f7e928c4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c167f10 con 0x7f7e8c0b5ce0 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.320+0000 7f7e928c4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c15de10 con 0x7f7e8c14f250 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.320+0000 7f7e928c4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7e8c168090 con 0x7f7e8c0b5750 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.320+0000 7f7e8b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8c0b5ce0 0x7f7e8c14c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.320+0000 7f7e8b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8c0b5ce0 0x7f7e8c14c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48060/0 (socket says 172.21.15.146:48060) 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.320+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/2468214461 learned_addr learned my addr 172.21.15.146:0/2468214461 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e90e61640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e8c14f250 0x7f7e8c15b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e8bfff640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e8c0b5750 0x7f7e8c1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e8c0b5750 msgr2=0x7f7e8c1559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e8b7fe640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e8c0b5750 0x7f7e8c1559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e8c14f250 msgr2=0x7f7e8c15b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e8b7fe640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e8c14f250 0x7f7e8c15b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e8b7fe640 1 -- 172.21.15.146:0/2468214461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c14ca50 con 0x7f7e8c0b5ce0 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e8bfff640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e8c0b5750 0x7f7e8c1559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e8b7fe640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8c0b5ce0 0x7f7e8c14c510 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009fd0 tx=0x7f7e8000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:39.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e88ff9640 1 -- 172.21.15.146:0/2468214461 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80015020 con 0x7f7e8c0b5ce0 2024-09-17T03:44:39.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e88ff9640 1 -- 172.21.15.146:0/2468214461 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e80011920 con 0x7f7e8c0b5ce0 2024-09-17T03:44:39.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e88ff9640 1 -- 172.21.15.146:0/2468214461 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80011d50 con 0x7f7e8c0b5ce0 2024-09-17T03:44:39.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e928c4640 1 -- 172.21.15.146:0/2468214461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c1562a0 con 0x7f7e8c0b5ce0 2024-09-17T03:44:39.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.321+0000 7f7e928c4640 1 -- 172.21.15.146:0/2468214461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c152050 con 0x7f7e8c0b5ce0 2024-09-17T03:44:39.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.322+0000 7f7e928c4640 1 -- 172.21.15.146:0/2468214461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c156010 con 0x7f7e8c0b5ce0 2024-09-17T03:44:39.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.323+0000 7f7e88ff9640 1 -- 172.21.15.146:0/2468214461 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e80018020 con 0x7f7e8c0b5ce0 2024-09-17T03:44:39.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.323+0000 7f7e88ff9640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e78078bc0 0x7f7e7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.323+0000 7f7e88ff9640 1 -- 172.21.15.146:0/2468214461 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f7e8009abb0 con 0x7f7e8c0b5ce0 2024-09-17T03:44:39.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.324+0000 7f7e8bfff640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e78078bc0 0x7f7e7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:39.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.324+0000 7f7e8bfff640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e78078bc0 0x7f7e7807b0d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0016a0 tx=0x7f7e7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.328+0000 7f7e88ff9640 1 -- 172.21.15.146:0/2468214461 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e8001f020 con 0x7f7e8c0b5ce0 2024-09-17T03:44:39.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.498+0000 7f7e928c4640 1 -- 172.21.15.146:0/2468214461 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e8c0b1320 con 0x7f7e78078bc0 2024-09-17T03:44:39.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.502+0000 7f7e88ff9640 1 -- 172.21.15.146:0/2468214461 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248703 (secure 0 0 0) 0x7f7e8c0b1320 con 0x7f7e78078bc0 2024-09-17T03:44:39.505 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:39.506 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:44:39.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 -- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e78078bc0 msgr2=0x7f7e7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e78078bc0 0x7f7e7807b0d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0016a0 tx=0x7f7e7c009040 comp rx=0 tx=0).stop 2024-09-17T03:44:39.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 -- 172.21.15.146:0/2468214461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8c0b5ce0 msgr2=0x7f7e8c14c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8c0b5ce0 0x7f7e8c14c510 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009fd0 tx=0x7f7e8000b870 comp rx=0 tx=0).stop 2024-09-17T03:44:39.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 -- 172.21.15.146:0/2468214461 shutdown_connections 2024-09-17T03:44:39.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7e78078bc0 0x7f7e7807b0d0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e8c14f250 0x7f7e8c15b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8c0b5ce0 0x7f7e8c14c510 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 --2- 172.21.15.146:0/2468214461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7e8c0b5750 0x7f7e8c1559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 -- 172.21.15.146:0/2468214461 >> 172.21.15.146:0/2468214461 conn(0x7f7e8c0b7b20 msgr2=0x7f7e8c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:39.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 -- 172.21.15.146:0/2468214461 shutdown_connections 2024-09-17T03:44:39.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.506+0000 7f7e928c4640 1 -- 172.21.15.146:0/2468214461 wait complete. 2024-09-17T03:44:39.517 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":525,"stamp":"2024-09-17T03:44:37.976502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":467588,"kb_used_data":18240,"kb_used_omap":12,"kb_used_meta":449139,"kb_avail":754507132,"statfs":{"total":773094113280,"available":772615303168,"internally_reserved":0,"allocated":18677760,"data_stored":8854680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":459918897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.493909"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.496508+0000","last_change":"2024-09-17T03:44:34.496508+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.496508+0000","last_undegraded":"2024-09-17T03:44:34.496508+0000","last_fullsized":"2024-09-17T03:44:34.496508+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091399+0000","last_change":"2024-09-17T03:44:35.511226+0000","last_active":"2024-09-17T03:44:37.091399+0000","last_peered":"2024-09-17T03:44:37.091399+0000","last_clean":"2024-09-17T03:44:37.091399+0000","last_became_active":"2024-09-17T03:44:35.510919+0000","last_became_peered":"2024-09-17T03:44:35.510919+0000","last_unstale":"2024-09-17T03:44:37.091399+0000","last_undegraded":"2024-09-17T03:44:37.091399+0000","last_fullsized":"2024-09-17T03:44:37.091399+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:13.140658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.499378+0000","last_change":"2024-09-17T03:44:34.499378+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.499378+0000","last_undegraded":"2024-09-17T03:44:34.499378+0000","last_fullsized":"2024-09-17T03:44:34.499378+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.498907+0000","last_change":"2024-09-17T03:44:34.498907+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.498907+0000","last_undegraded":"2024-09-17T03:44:34.498907+0000","last_fullsized":"2024-09-17T03:44:34.498907+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.496099+0000","last_change":"2024-09-17T03:44:34.496099+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.496099+0000","last_undegraded":"2024-09-17T03:44:34.496099+0000","last_fullsized":"2024-09-17T03:44:34.496099+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.501528+0000","last_change":"2024-09-17T03:44:34.501528+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.501528+0000","last_undegraded":"2024-09-17T03:44:34.501528+0000","last_fullsized":"2024-09-17T03:44:34.501528+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.496667+0000","last_change":"2024-09-17T03:44:34.496667+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.496667+0000","last_undegraded":"2024-09-17T03:44:34.496667+0000","last_fullsized":"2024-09-17T03:44:34.496667+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.499603+0000","last_change":"2024-09-17T03:44:34.499603+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.499603+0000","last_undegraded":"2024-09-17T03:44:34.499603+0000","last_fullsized":"2024-09-17T03:44:34.499603+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091476+0000","last_change":"2024-09-17T03:44:35.510397+0000","last_active":"2024-09-17T03:44:37.091476+0000","last_peered":"2024-09-17T03:44:37.091476+0000","last_clean":"2024-09-17T03:44:37.091476+0000","last_became_active":"2024-09-17T03:44:35.510097+0000","last_became_peered":"2024-09-17T03:44:35.510097+0000","last_unstale":"2024-09-17T03:44:37.091476+0000","last_undegraded":"2024-09-17T03:44:37.091476+0000","last_fullsized":"2024-09-17T03:44:37.091476+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:54.322849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704318+0000","last_change":"2024-09-17T03:44:35.523683+0000","last_active":"2024-09-17T03:44:36.704318+0000","last_peered":"2024-09-17T03:44:36.704318+0000","last_clean":"2024-09-17T03:44:36.704318+0000","last_became_active":"2024-09-17T03:44:35.523362+0000","last_became_peered":"2024-09-17T03:44:35.523362+0000","last_unstale":"2024-09-17T03:44:36.704318+0000","last_undegraded":"2024-09-17T03:44:36.704318+0000","last_fullsized":"2024-09-17T03:44:36.704318+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:47.040157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.495928+0000","last_change":"2024-09-17T03:44:34.495928+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.495928+0000","last_undegraded":"2024-09-17T03:44:34.495928+0000","last_fullsized":"2024-09-17T03:44:34.495928+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492196+0000","last_change":"2024-09-17T03:44:34.492196+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492196+0000","last_undegraded":"2024-09-17T03:44:34.492196+0000","last_fullsized":"2024-09-17T03:44:34.492196+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492931+0000","last_change":"2024-09-17T03:44:34.492931+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492931+0000","last_undegraded":"2024-09-17T03:44:34.492931+0000","last_fullsized":"2024-09-17T03:44:34.492931+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.495214+0000","last_change":"2024-09-17T03:44:34.495214+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.495214+0000","last_undegraded":"2024-09-17T03:44:34.495214+0000","last_fullsized":"2024-09-17T03:44:34.495214+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494335+0000","last_change":"2024-09-17T03:44:34.494335+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494335+0000","last_undegraded":"2024-09-17T03:44:34.494335+0000","last_fullsized":"2024-09-17T03:44:34.494335+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704050+0000","last_change":"2024-09-17T03:44:35.518950+0000","last_active":"2024-09-17T03:44:36.704050+0000","last_peered":"2024-09-17T03:44:36.704050+0000","last_clean":"2024-09-17T03:44:36.704050+0000","last_became_active":"2024-09-17T03:44:35.518668+0000","last_became_peered":"2024-09-17T03:44:35.518668+0000","last_unstale":"2024-09-17T03:44:36.704050+0000","last_undegraded":"2024-09-17T03:44:36.704050+0000","last_fullsized":"2024-09-17T03:44:36.704050+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:01.877073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494840+0000","last_change":"2024-09-17T03:44:34.494840+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494840+0000","last_undegraded":"2024-09-17T03:44:34.494840+0000","last_fullsized":"2024-09-17T03:44:34.494840+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704369+0000","last_change":"2024-09-17T03:44:35.522929+0000","last_active":"2024-09-17T03:44:36.704369+0000","last_peered":"2024-09-17T03:44:36.704369+0000","last_clean":"2024-09-17T03:44:36.704369+0000","last_became_active":"2024-09-17T03:44:35.522419+0000","last_became_peered":"2024-09-17T03:44:35.522419+0000","last_unstale":"2024-09-17T03:44:36.704369+0000","last_undegraded":"2024-09-17T03:44:36.704369+0000","last_fullsized":"2024-09-17T03:44:36.704369+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:27.801044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704537+0000","last_change":"2024-09-17T03:44:35.523107+0000","last_active":"2024-09-17T03:44:36.704537+0000","last_peered":"2024-09-17T03:44:36.704537+0000","last_clean":"2024-09-17T03:44:36.704537+0000","last_became_active":"2024-09-17T03:44:35.522655+0000","last_became_peered":"2024-09-17T03:44:35.522655+0000","last_unstale":"2024-09-17T03:44:36.704537+0000","last_undegraded":"2024-09-17T03:44:36.704537+0000","last_fullsized":"2024-09-17T03:44:36.704537+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:38.500491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.498021+0000","last_change":"2024-09-17T03:44:34.498021+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.498021+0000","last_undegraded":"2024-09-17T03:44:34.498021+0000","last_fullsized":"2024-09-17T03:44:34.498021+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.498452+0000","last_change":"2024-09-17T03:44:34.498452+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.498452+0000","last_undegraded":"2024-09-17T03:44:34.498452+0000","last_fullsized":"2024-09-17T03:44:34.498452+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493136+0000","last_change":"2024-09-17T03:44:34.493136+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493136+0000","last_undegraded":"2024-09-17T03:44:34.493136+0000","last_fullsized":"2024-09-17T03:44:34.493136+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.495295+0000","last_change":"2024-09-17T03:44:34.495295+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.495295+0000","last_undegraded":"2024-09-17T03:44:34.495295+0000","last_fullsized":"2024-09-17T03:44:34.495295+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.498125+0000","last_change":"2024-09-17T03:44:34.498125+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.498125+0000","last_undegraded":"2024-09-17T03:44:34.498125+0000","last_fullsized":"2024-09-17T03:44:34.498125+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091224+0000","last_change":"2024-09-17T03:44:35.515781+0000","last_active":"2024-09-17T03:44:37.091224+0000","last_peered":"2024-09-17T03:44:37.091224+0000","last_clean":"2024-09-17T03:44:37.091224+0000","last_became_active":"2024-09-17T03:44:35.515189+0000","last_became_peered":"2024-09-17T03:44:35.515189+0000","last_unstale":"2024-09-17T03:44:37.091224+0000","last_undegraded":"2024-09-17T03:44:37.091224+0000","last_fullsized":"2024-09-17T03:44:37.091224+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:28.320921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494450+0000","last_change":"2024-09-17T03:44:34.494450+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494450+0000","last_undegraded":"2024-09-17T03:44:34.494450+0000","last_fullsized":"2024-09-17T03:44:34.494450+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492514+0000","last_change":"2024-09-17T03:44:34.492514+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492514+0000","last_undegraded":"2024-09-17T03:44:34.492514+0000","last_fullsized":"2024-09-17T03:44:34.492514+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.495353+0000","last_change":"2024-09-17T03:44:34.495353+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.495353+0000","last_undegraded":"2024-09-17T03:44:34.495353+0000","last_fullsized":"2024-09-17T03:44:34.495353+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493940+0000","last_change":"2024-09-17T03:44:34.493940+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493940+0000","last_undegraded":"2024-09-17T03:44:34.493940+0000","last_fullsized":"2024-09-17T03:44:34.493940+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091089+0000","last_change":"2024-09-17T03:44:35.507298+0000","last_active":"2024-09-17T03:44:37.091089+0000","last_peered":"2024-09-17T03:44:37.091089+0000","last_clean":"2024-09-17T03:44:37.091089+0000","last_became_active":"2024-09-17T03:44:35.506929+0000","last_became_peered":"2024-09-17T03:44:35.506929+0000","last_unstale":"2024-09-17T03:44:37.091089+0000","last_undegraded":"2024-09-17T03:44:37.091089+0000","last_fullsized":"2024-09-17T03:44:37.091089+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:52.753354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704158+0000","last_change":"2024-09-17T03:44:35.511788+0000","last_active":"2024-09-17T03:44:36.704158+0000","last_peered":"2024-09-17T03:44:36.704158+0000","last_clean":"2024-09-17T03:44:36.704158+0000","last_became_active":"2024-09-17T03:44:35.511502+0000","last_became_peered":"2024-09-17T03:44:35.511502+0000","last_unstale":"2024-09-17T03:44:36.704158+0000","last_undegraded":"2024-09-17T03:44:36.704158+0000","last_fullsized":"2024-09-17T03:44:36.704158+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:17.382875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494354+0000","last_change":"2024-09-17T03:44:34.494354+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494354+0000","last_undegraded":"2024-09-17T03:44:34.494354+0000","last_fullsized":"2024-09-17T03:44:34.494354+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091331+0000","last_change":"2024-09-17T03:44:35.517115+0000","last_active":"2024-09-17T03:44:37.091331+0000","last_peered":"2024-09-17T03:44:37.091331+0000","last_clean":"2024-09-17T03:44:37.091331+0000","last_became_active":"2024-09-17T03:44:35.515962+0000","last_became_peered":"2024-09-17T03:44:35.515962+0000","last_unstale":"2024-09-17T03:44:37.091331+0000","last_undegraded":"2024-09-17T03:44:37.091331+0000","last_fullsized":"2024-09-17T03:44:37.091331+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:14.022854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505985+0000","last_change":"2024-09-17T03:44:34.504463+0000","last_active":"2024-09-17T03:44:34.505985+0000","last_peered":"2024-09-17T03:44:34.505985+0000","last_clean":"2024-09-17T03:44:34.505985+0000","last_became_active":"2024-09-17T03:44:34.504157+0000","last_became_peered":"2024-09-17T03:44:34.504157+0000","last_unstale":"2024-09-17T03:44:34.505985+0000","last_undegraded":"2024-09-17T03:44:34.505985+0000","last_fullsized":"2024-09-17T03:44:34.505985+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:47.037958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493104+0000","last_change":"2024-09-17T03:44:34.493104+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493104+0000","last_undegraded":"2024-09-17T03:44:34.493104+0000","last_fullsized":"2024-09-17T03:44:34.493104+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091596+0000","last_change":"2024-09-17T03:44:34.504505+0000","last_active":"2024-09-17T03:44:37.091596+0000","last_peered":"2024-09-17T03:44:37.091596+0000","last_clean":"2024-09-17T03:44:37.091596+0000","last_became_active":"2024-09-17T03:44:34.504196+0000","last_became_peered":"2024-09-17T03:44:34.504196+0000","last_unstale":"2024-09-17T03:44:37.091596+0000","last_undegraded":"2024-09-17T03:44:37.091596+0000","last_fullsized":"2024-09-17T03:44:37.091596+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:24.474885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494292+0000","last_change":"2024-09-17T03:44:34.494292+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494292+0000","last_undegraded":"2024-09-17T03:44:34.494292+0000","last_fullsized":"2024-09-17T03:44:34.494292+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.507711+0000","last_change":"2024-09-17T03:44:34.504667+0000","last_active":"2024-09-17T03:44:34.507711+0000","last_peered":"2024-09-17T03:44:34.507711+0000","last_clean":"2024-09-17T03:44:34.507711+0000","last_became_active":"2024-09-17T03:44:34.504379+0000","last_became_peered":"2024-09-17T03:44:34.504379+0000","last_unstale":"2024-09-17T03:44:34.507711+0000","last_undegraded":"2024-09-17T03:44:34.507711+0000","last_fullsized":"2024-09-17T03:44:34.507711+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:06.522828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704463+0000","last_change":"2024-09-17T03:44:35.524639+0000","last_active":"2024-09-17T03:44:36.704463+0000","last_peered":"2024-09-17T03:44:36.704463+0000","last_clean":"2024-09-17T03:44:36.704463+0000","last_became_active":"2024-09-17T03:44:35.523895+0000","last_became_peered":"2024-09-17T03:44:35.523895+0000","last_unstale":"2024-09-17T03:44:36.704463+0000","last_undegraded":"2024-09-17T03:44:36.704463+0000","last_fullsized":"2024-09-17T03:44:36.704463+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:10.381259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.508832+0000","last_change":"2024-09-17T03:44:34.508067+0000","last_active":"2024-09-17T03:44:34.508832+0000","last_peered":"2024-09-17T03:44:34.508832+0000","last_clean":"2024-09-17T03:44:34.508832+0000","last_became_active":"2024-09-17T03:44:34.507724+0000","last_became_peered":"2024-09-17T03:44:34.507724+0000","last_unstale":"2024-09-17T03:44:34.508832+0000","last_undegraded":"2024-09-17T03:44:34.508832+0000","last_fullsized":"2024-09-17T03:44:34.508832+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:55.250638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.497977+0000","last_change":"2024-09-17T03:44:34.497977+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.497977+0000","last_undegraded":"2024-09-17T03:44:34.497977+0000","last_fullsized":"2024-09-17T03:44:34.497977+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.510695+0000","last_change":"2024-09-17T03:44:34.508184+0000","last_active":"2024-09-17T03:44:34.510695+0000","last_peered":"2024-09-17T03:44:34.510695+0000","last_clean":"2024-09-17T03:44:34.510695+0000","last_became_active":"2024-09-17T03:44:34.507648+0000","last_became_peered":"2024-09-17T03:44:34.507648+0000","last_unstale":"2024-09-17T03:44:34.510695+0000","last_undegraded":"2024-09-17T03:44:34.510695+0000","last_fullsized":"2024-09-17T03:44:34.510695+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:26.303566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.497890+0000","last_change":"2024-09-17T03:44:34.497890+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.497890+0000","last_undegraded":"2024-09-17T03:44:34.497890+0000","last_fullsized":"2024-09-17T03:44:34.497890+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.512364+0000","last_change":"2024-09-17T03:44:34.508918+0000","last_active":"2024-09-17T03:44:34.512364+0000","last_peered":"2024-09-17T03:44:34.512364+0000","last_clean":"2024-09-17T03:44:34.512364+0000","last_became_active":"2024-09-17T03:44:34.508610+0000","last_became_peered":"2024-09-17T03:44:34.508610+0000","last_unstale":"2024-09-17T03:44:34.512364+0000","last_undegraded":"2024-09-17T03:44:34.512364+0000","last_fullsized":"2024-09-17T03:44:34.512364+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:23.781060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.497144+0000","last_change":"2024-09-17T03:44:34.497144+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.497144+0000","last_undegraded":"2024-09-17T03:44:34.497144+0000","last_fullsized":"2024-09-17T03:44:34.497144+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.508475+0000","last_change":"2024-09-17T03:44:34.507308+0000","last_active":"2024-09-17T03:44:34.508475+0000","last_peered":"2024-09-17T03:44:34.508475+0000","last_clean":"2024-09-17T03:44:34.508475+0000","last_became_active":"2024-09-17T03:44:34.506910+0000","last_became_peered":"2024-09-17T03:44:34.506910+0000","last_unstale":"2024-09-17T03:44:34.508475+0000","last_undegraded":"2024-09-17T03:44:34.508475+0000","last_fullsized":"2024-09-17T03:44:34.508475+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:24.315158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.497418+0000","last_change":"2024-09-17T03:44:34.497418+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.497418+0000","last_undegraded":"2024-09-17T03:44:34.497418+0000","last_fullsized":"2024-09-17T03:44:34.497418+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505515+0000","last_change":"2024-09-17T03:44:34.504070+0000","last_active":"2024-09-17T03:44:34.505515+0000","last_peered":"2024-09-17T03:44:34.505515+0000","last_clean":"2024-09-17T03:44:34.505515+0000","last_became_active":"2024-09-17T03:44:34.503697+0000","last_became_peered":"2024-09-17T03:44:34.503697+0000","last_unstale":"2024-09-17T03:44:34.505515+0000","last_undegraded":"2024-09-17T03:44:34.505515+0000","last_fullsized":"2024-09-17T03:44:34.505515+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:35.579214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494719+0000","last_change":"2024-09-17T03:44:34.494719+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494719+0000","last_undegraded":"2024-09-17T03:44:34.494719+0000","last_fullsized":"2024-09-17T03:44:34.494719+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505694+0000","last_change":"2024-09-17T03:44:34.504467+0000","last_active":"2024-09-17T03:44:34.505694+0000","last_peered":"2024-09-17T03:44:34.505694+0000","last_clean":"2024-09-17T03:44:34.505694+0000","last_became_active":"2024-09-17T03:44:34.504157+0000","last_became_peered":"2024-09-17T03:44:34.504157+0000","last_unstale":"2024-09-17T03:44:34.505694+0000","last_undegraded":"2024-09-17T03:44:34.505694+0000","last_fullsized":"2024-09-17T03:44:34.505694+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:31.235225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.497067+0000","last_change":"2024-09-17T03:44:34.497067+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.497067+0000","last_undegraded":"2024-09-17T03:44:34.497067+0000","last_fullsized":"2024-09-17T03:44:34.497067+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"175'3","reported_seq":18,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704588+0000","last_change":"2024-09-17T03:44:34.508692+0000","last_active":"2024-09-17T03:44:36.704588+0000","last_peered":"2024-09-17T03:44:36.704588+0000","last_clean":"2024-09-17T03:44:36.704588+0000","last_became_active":"2024-09-17T03:44:34.508213+0000","last_became_peered":"2024-09-17T03:44:34.508213+0000","last_unstale":"2024-09-17T03:44:36.704588+0000","last_undegraded":"2024-09-17T03:44:36.704588+0000","last_fullsized":"2024-09-17T03:44:36.704588+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:14.238753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492722+0000","last_change":"2024-09-17T03:44:34.492722+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492722+0000","last_undegraded":"2024-09-17T03:44:34.492722+0000","last_fullsized":"2024-09-17T03:44:34.492722+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.507953+0000","last_change":"2024-09-17T03:44:34.506888+0000","last_active":"2024-09-17T03:44:34.507953+0000","last_peered":"2024-09-17T03:44:34.507953+0000","last_clean":"2024-09-17T03:44:34.507953+0000","last_became_active":"2024-09-17T03:44:34.506553+0000","last_became_peered":"2024-09-17T03:44:34.506553+0000","last_unstale":"2024-09-17T03:44:34.507953+0000","last_undegraded":"2024-09-17T03:44:34.507953+0000","last_fullsized":"2024-09-17T03:44:34.507953+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:21.896272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.501057+0000","last_change":"2024-09-17T03:44:34.501057+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.501057+0000","last_undegraded":"2024-09-17T03:44:34.501057+0000","last_fullsized":"2024-09-17T03:44:34.501057+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.508816+0000","last_change":"2024-09-17T03:44:34.507298+0000","last_active":"2024-09-17T03:44:34.508816+0000","last_peered":"2024-09-17T03:44:34.508816+0000","last_clean":"2024-09-17T03:44:34.508816+0000","last_became_active":"2024-09-17T03:44:34.506960+0000","last_became_peered":"2024-09-17T03:44:34.506960+0000","last_unstale":"2024-09-17T03:44:34.508816+0000","last_undegraded":"2024-09-17T03:44:34.508816+0000","last_fullsized":"2024-09-17T03:44:34.508816+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:35.930832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704386+0000","last_change":"2024-09-17T03:44:35.520707+0000","last_active":"2024-09-17T03:44:36.704386+0000","last_peered":"2024-09-17T03:44:36.704386+0000","last_clean":"2024-09-17T03:44:36.704386+0000","last_became_active":"2024-09-17T03:44:35.520292+0000","last_became_peered":"2024-09-17T03:44:35.520292+0000","last_unstale":"2024-09-17T03:44:36.704386+0000","last_undegraded":"2024-09-17T03:44:36.704386+0000","last_fullsized":"2024-09-17T03:44:36.704386+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:35.032797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.502447+0000","last_change":"2024-09-17T03:44:34.500426+0000","last_active":"2024-09-17T03:44:34.502447+0000","last_peered":"2024-09-17T03:44:34.502447+0000","last_clean":"2024-09-17T03:44:34.502447+0000","last_became_active":"2024-09-17T03:44:34.500104+0000","last_became_peered":"2024-09-17T03:44:34.500104+0000","last_unstale":"2024-09-17T03:44:34.502447+0000","last_undegraded":"2024-09-17T03:44:34.502447+0000","last_fullsized":"2024-09-17T03:44:34.502447+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:30.961731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493925+0000","last_change":"2024-09-17T03:44:34.493925+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493925+0000","last_undegraded":"2024-09-17T03:44:34.493925+0000","last_fullsized":"2024-09-17T03:44:34.493925+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.703928+0000","last_change":"2024-09-17T03:44:34.506973+0000","last_active":"2024-09-17T03:44:36.703928+0000","last_peered":"2024-09-17T03:44:36.703928+0000","last_clean":"2024-09-17T03:44:36.703928+0000","last_became_active":"2024-09-17T03:44:34.506658+0000","last_became_peered":"2024-09-17T03:44:34.506658+0000","last_unstale":"2024-09-17T03:44:36.703928+0000","last_undegraded":"2024-09-17T03:44:36.703928+0000","last_fullsized":"2024-09-17T03:44:36.703928+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:31.118656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492716+0000","last_change":"2024-09-17T03:44:34.492716+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492716+0000","last_undegraded":"2024-09-17T03:44:34.492716+0000","last_fullsized":"2024-09-17T03:44:34.492716+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.507804+0000","last_change":"2024-09-17T03:44:34.505502+0000","last_active":"2024-09-17T03:44:34.507804+0000","last_peered":"2024-09-17T03:44:34.507804+0000","last_clean":"2024-09-17T03:44:34.507804+0000","last_became_active":"2024-09-17T03:44:34.505206+0000","last_became_peered":"2024-09-17T03:44:34.505206+0000","last_unstale":"2024-09-17T03:44:34.507804+0000","last_undegraded":"2024-09-17T03:44:34.507804+0000","last_fullsized":"2024-09-17T03:44:34.507804+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:05.103706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091511+0000","last_change":"2024-09-17T03:44:35.507591+0000","last_active":"2024-09-17T03:44:37.091511+0000","last_peered":"2024-09-17T03:44:37.091511+0000","last_clean":"2024-09-17T03:44:37.091511+0000","last_became_active":"2024-09-17T03:44:35.507301+0000","last_became_peered":"2024-09-17T03:44:35.507301+0000","last_unstale":"2024-09-17T03:44:37.091511+0000","last_undegraded":"2024-09-17T03:44:37.091511+0000","last_fullsized":"2024-09-17T03:44:37.091511+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:31.039012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.510899+0000","last_change":"2024-09-17T03:44:34.507954+0000","last_active":"2024-09-17T03:44:34.510899+0000","last_peered":"2024-09-17T03:44:34.510899+0000","last_clean":"2024-09-17T03:44:34.510899+0000","last_became_active":"2024-09-17T03:44:34.507591+0000","last_became_peered":"2024-09-17T03:44:34.507591+0000","last_unstale":"2024-09-17T03:44:34.510899+0000","last_undegraded":"2024-09-17T03:44:34.510899+0000","last_fullsized":"2024-09-17T03:44:34.510899+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:35.930832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091406+0000","last_change":"2024-09-17T03:44:35.515476+0000","last_active":"2024-09-17T03:44:37.091406+0000","last_peered":"2024-09-17T03:44:37.091406+0000","last_clean":"2024-09-17T03:44:37.091406+0000","last_became_active":"2024-09-17T03:44:35.514206+0000","last_became_peered":"2024-09-17T03:44:35.514206+0000","last_unstale":"2024-09-17T03:44:37.091406+0000","last_undegraded":"2024-09-17T03:44:37.091406+0000","last_fullsized":"2024-09-17T03:44:37.091406+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:37.648386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091604+0000","last_change":"2024-09-17T03:44:34.510346+0000","last_active":"2024-09-17T03:44:37.091604+0000","last_peered":"2024-09-17T03:44:37.091604+0000","last_clean":"2024-09-17T03:44:37.091604+0000","last_became_active":"2024-09-17T03:44:34.510051+0000","last_became_peered":"2024-09-17T03:44:34.510051+0000","last_unstale":"2024-09-17T03:44:37.091604+0000","last_undegraded":"2024-09-17T03:44:37.091604+0000","last_fullsized":"2024-09-17T03:44:37.091604+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:23.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494840+0000","last_change":"2024-09-17T03:44:34.494840+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494840+0000","last_undegraded":"2024-09-17T03:44:34.494840+0000","last_fullsized":"2024-09-17T03:44:34.494840+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704615+0000","last_change":"2024-09-17T03:44:34.509125+0000","last_active":"2024-09-17T03:44:36.704615+0000","last_peered":"2024-09-17T03:44:36.704615+0000","last_clean":"2024-09-17T03:44:36.704615+0000","last_became_active":"2024-09-17T03:44:34.507891+0000","last_became_peered":"2024-09-17T03:44:34.507891+0000","last_unstale":"2024-09-17T03:44:36.704615+0000","last_undegraded":"2024-09-17T03:44:36.704615+0000","last_fullsized":"2024-09-17T03:44:36.704615+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:06.654036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704396+0000","last_change":"2024-09-17T03:44:35.513414+0000","last_active":"2024-09-17T03:44:36.704396+0000","last_peered":"2024-09-17T03:44:36.704396+0000","last_clean":"2024-09-17T03:44:36.704396+0000","last_became_active":"2024-09-17T03:44:35.513121+0000","last_became_peered":"2024-09-17T03:44:35.513121+0000","last_unstale":"2024-09-17T03:44:36.704396+0000","last_undegraded":"2024-09-17T03:44:36.704396+0000","last_fullsized":"2024-09-17T03:44:36.704396+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:51.926469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.509797+0000","last_change":"2024-09-17T03:44:34.508494+0000","last_active":"2024-09-17T03:44:34.509797+0000","last_peered":"2024-09-17T03:44:34.509797+0000","last_clean":"2024-09-17T03:44:34.509797+0000","last_became_active":"2024-09-17T03:44:34.508171+0000","last_became_peered":"2024-09-17T03:44:34.508171+0000","last_unstale":"2024-09-17T03:44:34.509797+0000","last_undegraded":"2024-09-17T03:44:34.509797+0000","last_fullsized":"2024-09-17T03:44:34.509797+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:57.347223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704363+0000","last_change":"2024-09-17T03:44:35.517037+0000","last_active":"2024-09-17T03:44:36.704363+0000","last_peered":"2024-09-17T03:44:36.704363+0000","last_clean":"2024-09-17T03:44:36.704363+0000","last_became_active":"2024-09-17T03:44:35.516713+0000","last_became_peered":"2024-09-17T03:44:35.516713+0000","last_unstale":"2024-09-17T03:44:36.704363+0000","last_undegraded":"2024-09-17T03:44:36.704363+0000","last_fullsized":"2024-09-17T03:44:36.704363+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:16.789412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704298+0000","last_change":"2024-09-17T03:44:34.507042+0000","last_active":"2024-09-17T03:44:36.704298+0000","last_peered":"2024-09-17T03:44:36.704298+0000","last_clean":"2024-09-17T03:44:36.704298+0000","last_became_active":"2024-09-17T03:44:34.506712+0000","last_became_peered":"2024-09-17T03:44:34.506712+0000","last_unstale":"2024-09-17T03:44:36.704298+0000","last_undegraded":"2024-09-17T03:44:36.704298+0000","last_fullsized":"2024-09-17T03:44:36.704298+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:34.767116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493319+0000","last_change":"2024-09-17T03:44:34.493319+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493319+0000","last_undegraded":"2024-09-17T03:44:34.493319+0000","last_fullsized":"2024-09-17T03:44:34.493319+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.509192+0000","last_change":"2024-09-17T03:44:34.504134+0000","last_active":"2024-09-17T03:44:34.509192+0000","last_peered":"2024-09-17T03:44:34.509192+0000","last_clean":"2024-09-17T03:44:34.509192+0000","last_became_active":"2024-09-17T03:44:34.503719+0000","last_became_peered":"2024-09-17T03:44:34.503719+0000","last_unstale":"2024-09-17T03:44:34.509192+0000","last_undegraded":"2024-09-17T03:44:34.509192+0000","last_fullsized":"2024-09-17T03:44:34.509192+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:31.470158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091143+0000","last_change":"2024-09-17T03:44:35.506822+0000","last_active":"2024-09-17T03:44:37.091143+0000","last_peered":"2024-09-17T03:44:37.091143+0000","last_clean":"2024-09-17T03:44:37.091143+0000","last_became_active":"2024-09-17T03:44:35.506454+0000","last_became_peered":"2024-09-17T03:44:35.506454+0000","last_unstale":"2024-09-17T03:44:37.091143+0000","last_undegraded":"2024-09-17T03:44:37.091143+0000","last_fullsized":"2024-09-17T03:44:37.091143+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:13.279683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.501743+0000","last_change":"2024-09-17T03:44:34.499354+0000","last_active":"2024-09-17T03:44:34.501743+0000","last_peered":"2024-09-17T03:44:34.501743+0000","last_clean":"2024-09-17T03:44:34.501743+0000","last_became_active":"2024-09-17T03:44:34.498887+0000","last_became_peered":"2024-09-17T03:44:34.498887+0000","last_unstale":"2024-09-17T03:44:34.501743+0000","last_undegraded":"2024-09-17T03:44:34.501743+0000","last_fullsized":"2024-09-17T03:44:34.501743+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:41.546631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494647+0000","last_change":"2024-09-17T03:44:34.494647+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494647+0000","last_undegraded":"2024-09-17T03:44:34.494647+0000","last_fullsized":"2024-09-17T03:44:34.494647+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.511506+0000","last_change":"2024-09-17T03:44:34.510288+0000","last_active":"2024-09-17T03:44:34.511506+0000","last_peered":"2024-09-17T03:44:34.511506+0000","last_clean":"2024-09-17T03:44:34.511506+0000","last_became_active":"2024-09-17T03:44:34.509945+0000","last_became_peered":"2024-09-17T03:44:34.509945+0000","last_unstale":"2024-09-17T03:44:34.511506+0000","last_undegraded":"2024-09-17T03:44:34.511506+0000","last_fullsized":"2024-09-17T03:44:34.511506+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:58.067682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492092+0000","last_change":"2024-09-17T03:44:34.492092+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492092+0000","last_undegraded":"2024-09-17T03:44:34.492092+0000","last_fullsized":"2024-09-17T03:44:34.492092+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505713+0000","last_change":"2024-09-17T03:44:34.504336+0000","last_active":"2024-09-17T03:44:34.505713+0000","last_peered":"2024-09-17T03:44:34.505713+0000","last_clean":"2024-09-17T03:44:34.505713+0000","last_became_active":"2024-09-17T03:44:34.504005+0000","last_became_peered":"2024-09-17T03:44:34.504005+0000","last_unstale":"2024-09-17T03:44:34.505713+0000","last_undegraded":"2024-09-17T03:44:34.505713+0000","last_fullsized":"2024-09-17T03:44:34.505713+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:11.268392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493419+0000","last_change":"2024-09-17T03:44:34.493419+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493419+0000","last_undegraded":"2024-09-17T03:44:34.493419+0000","last_fullsized":"2024-09-17T03:44:34.493419+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.507986+0000","last_change":"2024-09-17T03:44:34.506730+0000","last_active":"2024-09-17T03:44:34.507986+0000","last_peered":"2024-09-17T03:44:34.507986+0000","last_clean":"2024-09-17T03:44:34.507986+0000","last_became_active":"2024-09-17T03:44:34.506425+0000","last_became_peered":"2024-09-17T03:44:34.506425+0000","last_unstale":"2024-09-17T03:44:34.507986+0000","last_undegraded":"2024-09-17T03:44:34.507986+0000","last_fullsized":"2024-09-17T03:44:34.507986+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:26.099434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091119+0000","last_change":"2024-09-17T03:44:35.514014+0000","last_active":"2024-09-17T03:44:37.091119+0000","last_peered":"2024-09-17T03:44:37.091119+0000","last_clean":"2024-09-17T03:44:37.091119+0000","last_became_active":"2024-09-17T03:44:35.513696+0000","last_became_peered":"2024-09-17T03:44:35.513696+0000","last_unstale":"2024-09-17T03:44:37.091119+0000","last_undegraded":"2024-09-17T03:44:37.091119+0000","last_fullsized":"2024-09-17T03:44:37.091119+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:37.810185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.511482+0000","last_change":"2024-09-17T03:44:34.507786+0000","last_active":"2024-09-17T03:44:34.511482+0000","last_peered":"2024-09-17T03:44:34.511482+0000","last_clean":"2024-09-17T03:44:34.511482+0000","last_became_active":"2024-09-17T03:44:34.506839+0000","last_became_peered":"2024-09-17T03:44:34.506839+0000","last_unstale":"2024-09-17T03:44:34.511482+0000","last_undegraded":"2024-09-17T03:44:34.511482+0000","last_fullsized":"2024-09-17T03:44:34.511482+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:45.200268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492617+0000","last_change":"2024-09-17T03:44:34.492617+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492617+0000","last_undegraded":"2024-09-17T03:44:34.492617+0000","last_fullsized":"2024-09-17T03:44:34.492617+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505675+0000","last_change":"2024-09-17T03:44:34.504327+0000","last_active":"2024-09-17T03:44:34.505675+0000","last_peered":"2024-09-17T03:44:34.505675+0000","last_clean":"2024-09-17T03:44:34.505675+0000","last_became_active":"2024-09-17T03:44:34.504030+0000","last_became_peered":"2024-09-17T03:44:34.504030+0000","last_unstale":"2024-09-17T03:44:34.505675+0000","last_undegraded":"2024-09-17T03:44:34.505675+0000","last_fullsized":"2024-09-17T03:44:34.505675+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:54.697720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493740+0000","last_change":"2024-09-17T03:44:34.493740+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493740+0000","last_undegraded":"2024-09-17T03:44:34.493740+0000","last_fullsized":"2024-09-17T03:44:34.493740+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.513300+0000","last_change":"2024-09-17T03:44:34.512828+0000","last_active":"2024-09-17T03:44:34.513300+0000","last_peered":"2024-09-17T03:44:34.513300+0000","last_clean":"2024-09-17T03:44:34.513300+0000","last_became_active":"2024-09-17T03:44:34.512469+0000","last_became_peered":"2024-09-17T03:44:34.512469+0000","last_unstale":"2024-09-17T03:44:34.513300+0000","last_undegraded":"2024-09-17T03:44:34.513300+0000","last_fullsized":"2024-09-17T03:44:34.513300+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:26.742795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493438+0000","last_change":"2024-09-17T03:44:34.493438+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493438+0000","last_undegraded":"2024-09-17T03:44:34.493438+0000","last_fullsized":"2024-09-17T03:44:34.493438+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.510725+0000","last_change":"2024-09-17T03:44:34.508966+0000","last_active":"2024-09-17T03:44:34.510725+0000","last_peered":"2024-09-17T03:44:34.510725+0000","last_clean":"2024-09-17T03:44:34.510725+0000","last_became_active":"2024-09-17T03:44:34.508648+0000","last_became_peered":"2024-09-17T03:44:34.508648+0000","last_unstale":"2024-09-17T03:44:34.510725+0000","last_undegraded":"2024-09-17T03:44:34.510725+0000","last_fullsized":"2024-09-17T03:44:34.510725+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:45.815093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493336+0000","last_change":"2024-09-17T03:44:34.493336+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493336+0000","last_undegraded":"2024-09-17T03:44:34.493336+0000","last_fullsized":"2024-09-17T03:44:34.493336+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505672+0000","last_change":"2024-09-17T03:44:34.503673+0000","last_active":"2024-09-17T03:44:34.505672+0000","last_peered":"2024-09-17T03:44:34.505672+0000","last_clean":"2024-09-17T03:44:34.505672+0000","last_became_active":"2024-09-17T03:44:34.503331+0000","last_became_peered":"2024-09-17T03:44:34.503331+0000","last_unstale":"2024-09-17T03:44:34.505672+0000","last_undegraded":"2024-09-17T03:44:34.505672+0000","last_fullsized":"2024-09-17T03:44:34.505672+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:07.117266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091048+0000","last_change":"2024-09-17T03:44:35.508733+0000","last_active":"2024-09-17T03:44:37.091048+0000","last_peered":"2024-09-17T03:44:37.091048+0000","last_clean":"2024-09-17T03:44:37.091048+0000","last_became_active":"2024-09-17T03:44:35.508398+0000","last_became_peered":"2024-09-17T03:44:35.508398+0000","last_unstale":"2024-09-17T03:44:37.091048+0000","last_undegraded":"2024-09-17T03:44:37.091048+0000","last_fullsized":"2024-09-17T03:44:37.091048+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505490+0000","last_change":"2024-09-17T03:44:34.500723+0000","last_active":"2024-09-17T03:44:34.505490+0000","last_peered":"2024-09-17T03:44:34.505490+0000","last_clean":"2024-09-17T03:44:34.505490+0000","last_became_active":"2024-09-17T03:44:34.500367+0000","last_became_peered":"2024-09-17T03:44:34.500367+0000","last_unstale":"2024-09-17T03:44:34.505490+0000","last_undegraded":"2024-09-17T03:44:34.505490+0000","last_fullsized":"2024-09-17T03:44:34.505490+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:24.315158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494724+0000","last_change":"2024-09-17T03:44:34.494724+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494724+0000","last_undegraded":"2024-09-17T03:44:34.494724+0000","last_fullsized":"2024-09-17T03:44:34.494724+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.509223+0000","last_change":"2024-09-17T03:44:34.508290+0000","last_active":"2024-09-17T03:44:34.509223+0000","last_peered":"2024-09-17T03:44:34.509223+0000","last_clean":"2024-09-17T03:44:34.509223+0000","last_became_active":"2024-09-17T03:44:34.507990+0000","last_became_peered":"2024-09-17T03:44:34.507990+0000","last_unstale":"2024-09-17T03:44:34.509223+0000","last_undegraded":"2024-09-17T03:44:34.509223+0000","last_fullsized":"2024-09-17T03:44:34.509223+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:33.360239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":390,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.499983+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:44:34.499983+0000","last_peered":"2024-09-17T03:44:34.499983+0000","last_clean":"2024-09-17T03:44:34.499983+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:44:34.499983+0000","last_undegraded":"2024-09-17T03:44:34.499983+0000","last_fullsized":"2024-09-17T03:44:34.499983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509585,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60260,"kb_used_data":2704,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311580,"statfs":{"total":96636764160,"available":96575057920,"internally_reserved":0,"allocated":2768896,"data_stored":1544678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59680,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312160,"statfs":{"total":96636764160,"available":96575651840,"internally_reserved":0,"allocated":2174976,"data_stored":954310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509585,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65200,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306640,"statfs":{"total":96636764160,"available":96569999360,"internally_reserved":0,"allocated":2174976,"data_stored":954310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55524,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316316,"statfs":{"total":96636764160,"available":96579907584,"internally_reserved":0,"allocated":2174976,"data_stored":954310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509586,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59684,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312156,"statfs":{"total":96636764160,"available":96575647744,"internally_reserved":0,"allocated":2174976,"data_stored":954310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509586,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56100,"kb_used_data":2704,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315740,"statfs":{"total":96636764160,"available":96579317760,"internally_reserved":0,"allocated":2768896,"data_stored":1544678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55568,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316272,"statfs":{"total":96636764160,"available":96579862528,"internally_reserved":0,"allocated":2215936,"data_stored":974242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55572,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316268,"statfs":{"total":96636764160,"available":96579858432,"internally_reserved":0,"allocated":2224128,"data_stored":973842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:44:39.522 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:44:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.672+0000 7ff77d8ec640 1 -- 172.21.15.146:0/4218860185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff764003a00 msgr2=0x7ff764003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.672+0000 7ff77d8ec640 1 --2- 172.21.15.146:0/4218860185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff764003a00 0x7ff764003e70 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7ff770009ed0 tx=0x7ff764005830 comp rx=0 tx=0).stop 2024-09-17T03:44:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.672+0000 7ff7777fe640 1 -- 172.21.15.146:0/4218860185 reap_dead start 2024-09-17T03:44:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.672+0000 7ff77d8ec640 1 -- 172.21.15.146:0/4218860185 shutdown_connections 2024-09-17T03:44:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.672+0000 7ff77d8ec640 1 -- 172.21.15.146:0/4218860185 >> 172.21.15.146:0/4218860185 conn(0x7ff77806dd60 msgr2=0x7ff77806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.672+0000 7ff77d8ec640 1 -- 172.21.15.146:0/4218860185 shutdown_connections 2024-09-17T03:44:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.672+0000 7ff77d8ec640 1 -- 172.21.15.146:0/4218860185 wait complete. 2024-09-17T03:44:39.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.674+0000 7ff77d8ec640 1 Processor -- start 2024-09-17T03:44:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.674+0000 7ff77d8ec640 1 -- start start 2024-09-17T03:44:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.675+0000 7ff77d8ec640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff764003a00 0x7ff778159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.675+0000 7ff77d8ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff778159bd0 0x7ff7781f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.675+0000 7ff77d8ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7781f6f50 0x7ff7781f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.675+0000 7ff77d8ec640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff77815e160 con 0x7ff764003a00 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.675+0000 7ff77d8ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff77815dfe0 con 0x7ff7781f6f50 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.675+0000 7ff77d8ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff778073a70 con 0x7ff778159bd0 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.675+0000 7ff776ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff764003a00 0x7ff778159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.675+0000 7ff776ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff764003a00 0x7ff778159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48090/0 (socket says 172.21.15.146:48090) 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.675+0000 7ff776ffd640 1 -- 172.21.15.146:0/629292887 learned_addr learned my addr 172.21.15.146:0/629292887 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.675+0000 7ff7777fe640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7781f6f50 0x7ff7781f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.675+0000 7ff7767fc640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff778159bd0 0x7ff7781f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff776ffd640 1 -- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff778159bd0 msgr2=0x7ff7781f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff776ffd640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff778159bd0 0x7ff7781f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff776ffd640 1 -- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7781f6f50 msgr2=0x7ff7781f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff776ffd640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7781f6f50 0x7ff7781f7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff776ffd640 1 -- 172.21.15.146:0/629292887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff778159fe0 con 0x7ff764003a00 2024-09-17T03:44:39.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff7767fc640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff778159bd0 0x7ff7781f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:39.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff776ffd640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff764003a00 0x7ff778159690 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7ff770009ed0 tx=0x7ff770033e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:39.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff76ffff640 1 -- 172.21.15.146:0/629292887 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770043070 con 0x7ff764003a00 2024-09-17T03:44:39.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff76ffff640 1 -- 172.21.15.146:0/629292887 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff770003c60 con 0x7ff764003a00 2024-09-17T03:44:39.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff77d8ec640 1 -- 172.21.15.146:0/629292887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7781f3770 con 0x7ff764003a00 2024-09-17T03:44:39.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff76ffff640 1 -- 172.21.15.146:0/629292887 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770038040 con 0x7ff764003a00 2024-09-17T03:44:39.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.676+0000 7ff77d8ec640 1 -- 172.21.15.146:0/629292887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7781f3d30 con 0x7ff764003a00 2024-09-17T03:44:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.677+0000 7ff77d8ec640 1 -- 172.21.15.146:0/629292887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff77815f1c0 con 0x7ff764003a00 2024-09-17T03:44:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.678+0000 7ff76ffff640 1 -- 172.21.15.146:0/629292887 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff770004290 con 0x7ff764003a00 2024-09-17T03:44:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.678+0000 7ff76ffff640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff758078bc0 0x7ff75807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.678+0000 7ff76ffff640 1 -- 172.21.15.146:0/629292887 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7ff7700bb9f0 con 0x7ff764003a00 2024-09-17T03:44:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.678+0000 7ff7767fc640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff758078bc0 0x7ff75807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:39.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.679+0000 7ff7767fc640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff758078bc0 0x7ff75807b0d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff778154a70 tx=0x7ff760005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:39.683 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.683+0000 7ff76ffff640 1 -- 172.21.15.146:0/629292887 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff77815f1c0 con 0x7ff764003a00 2024-09-17T03:44:39.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.853+0000 7ff77d8ec640 1 -- 172.21.15.146:0/629292887 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7780ca0d0 con 0x7ff758078bc0 2024-09-17T03:44:39.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.858+0000 7ff76ffff640 1 -- 172.21.15.146:0/629292887 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248703 (secure 0 0 0) 0x7ff76005db90 con 0x7ff758078bc0 2024-09-17T03:44:39.860 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:39.861 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:44:39.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 -- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff758078bc0 msgr2=0x7ff75807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff758078bc0 0x7ff75807b0d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff778154a70 tx=0x7ff760005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:39.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 -- 172.21.15.146:0/629292887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff764003a00 msgr2=0x7ff778159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:39.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff764003a00 0x7ff778159690 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7ff770009ed0 tx=0x7ff770033e40 comp rx=0 tx=0).stop 2024-09-17T03:44:39.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 -- 172.21.15.146:0/629292887 shutdown_connections 2024-09-17T03:44:39.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff758078bc0 0x7ff75807b0d0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7781f6f50 0x7ff7781f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff778159bd0 0x7ff7781f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 --2- 172.21.15.146:0/629292887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff764003a00 0x7ff778159690 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:39.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 -- 172.21.15.146:0/629292887 >> 172.21.15.146:0/629292887 conn(0x7ff77806dd60 msgr2=0x7ff778160820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:39.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 -- 172.21.15.146:0/629292887 shutdown_connections 2024-09-17T03:44:39.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:39.861+0000 7ff77d8ec640 1 -- 172.21.15.146:0/629292887 wait complete. 2024-09-17T03:44:39.873 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":525,"stamp":"2024-09-17T03:44:37.976502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":467588,"kb_used_data":18240,"kb_used_omap":12,"kb_used_meta":449139,"kb_avail":754507132,"statfs":{"total":773094113280,"available":772615303168,"internally_reserved":0,"allocated":18677760,"data_stored":8854680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":459918897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.493909"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.496508+0000","last_change":"2024-09-17T03:44:34.496508+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.496508+0000","last_undegraded":"2024-09-17T03:44:34.496508+0000","last_fullsized":"2024-09-17T03:44:34.496508+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091399+0000","last_change":"2024-09-17T03:44:35.511226+0000","last_active":"2024-09-17T03:44:37.091399+0000","last_peered":"2024-09-17T03:44:37.091399+0000","last_clean":"2024-09-17T03:44:37.091399+0000","last_became_active":"2024-09-17T03:44:35.510919+0000","last_became_peered":"2024-09-17T03:44:35.510919+0000","last_unstale":"2024-09-17T03:44:37.091399+0000","last_undegraded":"2024-09-17T03:44:37.091399+0000","last_fullsized":"2024-09-17T03:44:37.091399+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:13.140658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.499378+0000","last_change":"2024-09-17T03:44:34.499378+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.499378+0000","last_undegraded":"2024-09-17T03:44:34.499378+0000","last_fullsized":"2024-09-17T03:44:34.499378+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.498907+0000","last_change":"2024-09-17T03:44:34.498907+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.498907+0000","last_undegraded":"2024-09-17T03:44:34.498907+0000","last_fullsized":"2024-09-17T03:44:34.498907+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.496099+0000","last_change":"2024-09-17T03:44:34.496099+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.496099+0000","last_undegraded":"2024-09-17T03:44:34.496099+0000","last_fullsized":"2024-09-17T03:44:34.496099+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.501528+0000","last_change":"2024-09-17T03:44:34.501528+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.501528+0000","last_undegraded":"2024-09-17T03:44:34.501528+0000","last_fullsized":"2024-09-17T03:44:34.501528+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.496667+0000","last_change":"2024-09-17T03:44:34.496667+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.496667+0000","last_undegraded":"2024-09-17T03:44:34.496667+0000","last_fullsized":"2024-09-17T03:44:34.496667+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.499603+0000","last_change":"2024-09-17T03:44:34.499603+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.499603+0000","last_undegraded":"2024-09-17T03:44:34.499603+0000","last_fullsized":"2024-09-17T03:44:34.499603+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091476+0000","last_change":"2024-09-17T03:44:35.510397+0000","last_active":"2024-09-17T03:44:37.091476+0000","last_peered":"2024-09-17T03:44:37.091476+0000","last_clean":"2024-09-17T03:44:37.091476+0000","last_became_active":"2024-09-17T03:44:35.510097+0000","last_became_peered":"2024-09-17T03:44:35.510097+0000","last_unstale":"2024-09-17T03:44:37.091476+0000","last_undegraded":"2024-09-17T03:44:37.091476+0000","last_fullsized":"2024-09-17T03:44:37.091476+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:54.322849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704318+0000","last_change":"2024-09-17T03:44:35.523683+0000","last_active":"2024-09-17T03:44:36.704318+0000","last_peered":"2024-09-17T03:44:36.704318+0000","last_clean":"2024-09-17T03:44:36.704318+0000","last_became_active":"2024-09-17T03:44:35.523362+0000","last_became_peered":"2024-09-17T03:44:35.523362+0000","last_unstale":"2024-09-17T03:44:36.704318+0000","last_undegraded":"2024-09-17T03:44:36.704318+0000","last_fullsized":"2024-09-17T03:44:36.704318+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:47.040157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.495928+0000","last_change":"2024-09-17T03:44:34.495928+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.495928+0000","last_undegraded":"2024-09-17T03:44:34.495928+0000","last_fullsized":"2024-09-17T03:44:34.495928+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492196+0000","last_change":"2024-09-17T03:44:34.492196+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492196+0000","last_undegraded":"2024-09-17T03:44:34.492196+0000","last_fullsized":"2024-09-17T03:44:34.492196+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492931+0000","last_change":"2024-09-17T03:44:34.492931+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492931+0000","last_undegraded":"2024-09-17T03:44:34.492931+0000","last_fullsized":"2024-09-17T03:44:34.492931+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.495214+0000","last_change":"2024-09-17T03:44:34.495214+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.495214+0000","last_undegraded":"2024-09-17T03:44:34.495214+0000","last_fullsized":"2024-09-17T03:44:34.495214+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494335+0000","last_change":"2024-09-17T03:44:34.494335+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494335+0000","last_undegraded":"2024-09-17T03:44:34.494335+0000","last_fullsized":"2024-09-17T03:44:34.494335+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704050+0000","last_change":"2024-09-17T03:44:35.518950+0000","last_active":"2024-09-17T03:44:36.704050+0000","last_peered":"2024-09-17T03:44:36.704050+0000","last_clean":"2024-09-17T03:44:36.704050+0000","last_became_active":"2024-09-17T03:44:35.518668+0000","last_became_peered":"2024-09-17T03:44:35.518668+0000","last_unstale":"2024-09-17T03:44:36.704050+0000","last_undegraded":"2024-09-17T03:44:36.704050+0000","last_fullsized":"2024-09-17T03:44:36.704050+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:01.877073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494840+0000","last_change":"2024-09-17T03:44:34.494840+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494840+0000","last_undegraded":"2024-09-17T03:44:34.494840+0000","last_fullsized":"2024-09-17T03:44:34.494840+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704369+0000","last_change":"2024-09-17T03:44:35.522929+0000","last_active":"2024-09-17T03:44:36.704369+0000","last_peered":"2024-09-17T03:44:36.704369+0000","last_clean":"2024-09-17T03:44:36.704369+0000","last_became_active":"2024-09-17T03:44:35.522419+0000","last_became_peered":"2024-09-17T03:44:35.522419+0000","last_unstale":"2024-09-17T03:44:36.704369+0000","last_undegraded":"2024-09-17T03:44:36.704369+0000","last_fullsized":"2024-09-17T03:44:36.704369+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:27.801044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704537+0000","last_change":"2024-09-17T03:44:35.523107+0000","last_active":"2024-09-17T03:44:36.704537+0000","last_peered":"2024-09-17T03:44:36.704537+0000","last_clean":"2024-09-17T03:44:36.704537+0000","last_became_active":"2024-09-17T03:44:35.522655+0000","last_became_peered":"2024-09-17T03:44:35.522655+0000","last_unstale":"2024-09-17T03:44:36.704537+0000","last_undegraded":"2024-09-17T03:44:36.704537+0000","last_fullsized":"2024-09-17T03:44:36.704537+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:38.500491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.498021+0000","last_change":"2024-09-17T03:44:34.498021+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.498021+0000","last_undegraded":"2024-09-17T03:44:34.498021+0000","last_fullsized":"2024-09-17T03:44:34.498021+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.498452+0000","last_change":"2024-09-17T03:44:34.498452+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.498452+0000","last_undegraded":"2024-09-17T03:44:34.498452+0000","last_fullsized":"2024-09-17T03:44:34.498452+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493136+0000","last_change":"2024-09-17T03:44:34.493136+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493136+0000","last_undegraded":"2024-09-17T03:44:34.493136+0000","last_fullsized":"2024-09-17T03:44:34.493136+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.495295+0000","last_change":"2024-09-17T03:44:34.495295+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.495295+0000","last_undegraded":"2024-09-17T03:44:34.495295+0000","last_fullsized":"2024-09-17T03:44:34.495295+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.498125+0000","last_change":"2024-09-17T03:44:34.498125+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.498125+0000","last_undegraded":"2024-09-17T03:44:34.498125+0000","last_fullsized":"2024-09-17T03:44:34.498125+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091224+0000","last_change":"2024-09-17T03:44:35.515781+0000","last_active":"2024-09-17T03:44:37.091224+0000","last_peered":"2024-09-17T03:44:37.091224+0000","last_clean":"2024-09-17T03:44:37.091224+0000","last_became_active":"2024-09-17T03:44:35.515189+0000","last_became_peered":"2024-09-17T03:44:35.515189+0000","last_unstale":"2024-09-17T03:44:37.091224+0000","last_undegraded":"2024-09-17T03:44:37.091224+0000","last_fullsized":"2024-09-17T03:44:37.091224+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:28.320921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494450+0000","last_change":"2024-09-17T03:44:34.494450+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494450+0000","last_undegraded":"2024-09-17T03:44:34.494450+0000","last_fullsized":"2024-09-17T03:44:34.494450+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492514+0000","last_change":"2024-09-17T03:44:34.492514+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492514+0000","last_undegraded":"2024-09-17T03:44:34.492514+0000","last_fullsized":"2024-09-17T03:44:34.492514+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.495353+0000","last_change":"2024-09-17T03:44:34.495353+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.495353+0000","last_undegraded":"2024-09-17T03:44:34.495353+0000","last_fullsized":"2024-09-17T03:44:34.495353+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493940+0000","last_change":"2024-09-17T03:44:34.493940+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493940+0000","last_undegraded":"2024-09-17T03:44:34.493940+0000","last_fullsized":"2024-09-17T03:44:34.493940+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091089+0000","last_change":"2024-09-17T03:44:35.507298+0000","last_active":"2024-09-17T03:44:37.091089+0000","last_peered":"2024-09-17T03:44:37.091089+0000","last_clean":"2024-09-17T03:44:37.091089+0000","last_became_active":"2024-09-17T03:44:35.506929+0000","last_became_peered":"2024-09-17T03:44:35.506929+0000","last_unstale":"2024-09-17T03:44:37.091089+0000","last_undegraded":"2024-09-17T03:44:37.091089+0000","last_fullsized":"2024-09-17T03:44:37.091089+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:52.753354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704158+0000","last_change":"2024-09-17T03:44:35.511788+0000","last_active":"2024-09-17T03:44:36.704158+0000","last_peered":"2024-09-17T03:44:36.704158+0000","last_clean":"2024-09-17T03:44:36.704158+0000","last_became_active":"2024-09-17T03:44:35.511502+0000","last_became_peered":"2024-09-17T03:44:35.511502+0000","last_unstale":"2024-09-17T03:44:36.704158+0000","last_undegraded":"2024-09-17T03:44:36.704158+0000","last_fullsized":"2024-09-17T03:44:36.704158+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:17.382875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494354+0000","last_change":"2024-09-17T03:44:34.494354+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494354+0000","last_undegraded":"2024-09-17T03:44:34.494354+0000","last_fullsized":"2024-09-17T03:44:34.494354+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091331+0000","last_change":"2024-09-17T03:44:35.517115+0000","last_active":"2024-09-17T03:44:37.091331+0000","last_peered":"2024-09-17T03:44:37.091331+0000","last_clean":"2024-09-17T03:44:37.091331+0000","last_became_active":"2024-09-17T03:44:35.515962+0000","last_became_peered":"2024-09-17T03:44:35.515962+0000","last_unstale":"2024-09-17T03:44:37.091331+0000","last_undegraded":"2024-09-17T03:44:37.091331+0000","last_fullsized":"2024-09-17T03:44:37.091331+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:14.022854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505985+0000","last_change":"2024-09-17T03:44:34.504463+0000","last_active":"2024-09-17T03:44:34.505985+0000","last_peered":"2024-09-17T03:44:34.505985+0000","last_clean":"2024-09-17T03:44:34.505985+0000","last_became_active":"2024-09-17T03:44:34.504157+0000","last_became_peered":"2024-09-17T03:44:34.504157+0000","last_unstale":"2024-09-17T03:44:34.505985+0000","last_undegraded":"2024-09-17T03:44:34.505985+0000","last_fullsized":"2024-09-17T03:44:34.505985+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:47.037958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493104+0000","last_change":"2024-09-17T03:44:34.493104+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493104+0000","last_undegraded":"2024-09-17T03:44:34.493104+0000","last_fullsized":"2024-09-17T03:44:34.493104+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091596+0000","last_change":"2024-09-17T03:44:34.504505+0000","last_active":"2024-09-17T03:44:37.091596+0000","last_peered":"2024-09-17T03:44:37.091596+0000","last_clean":"2024-09-17T03:44:37.091596+0000","last_became_active":"2024-09-17T03:44:34.504196+0000","last_became_peered":"2024-09-17T03:44:34.504196+0000","last_unstale":"2024-09-17T03:44:37.091596+0000","last_undegraded":"2024-09-17T03:44:37.091596+0000","last_fullsized":"2024-09-17T03:44:37.091596+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:24.474885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494292+0000","last_change":"2024-09-17T03:44:34.494292+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494292+0000","last_undegraded":"2024-09-17T03:44:34.494292+0000","last_fullsized":"2024-09-17T03:44:34.494292+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.507711+0000","last_change":"2024-09-17T03:44:34.504667+0000","last_active":"2024-09-17T03:44:34.507711+0000","last_peered":"2024-09-17T03:44:34.507711+0000","last_clean":"2024-09-17T03:44:34.507711+0000","last_became_active":"2024-09-17T03:44:34.504379+0000","last_became_peered":"2024-09-17T03:44:34.504379+0000","last_unstale":"2024-09-17T03:44:34.507711+0000","last_undegraded":"2024-09-17T03:44:34.507711+0000","last_fullsized":"2024-09-17T03:44:34.507711+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:06.522828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704463+0000","last_change":"2024-09-17T03:44:35.524639+0000","last_active":"2024-09-17T03:44:36.704463+0000","last_peered":"2024-09-17T03:44:36.704463+0000","last_clean":"2024-09-17T03:44:36.704463+0000","last_became_active":"2024-09-17T03:44:35.523895+0000","last_became_peered":"2024-09-17T03:44:35.523895+0000","last_unstale":"2024-09-17T03:44:36.704463+0000","last_undegraded":"2024-09-17T03:44:36.704463+0000","last_fullsized":"2024-09-17T03:44:36.704463+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:10.381259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.508832+0000","last_change":"2024-09-17T03:44:34.508067+0000","last_active":"2024-09-17T03:44:34.508832+0000","last_peered":"2024-09-17T03:44:34.508832+0000","last_clean":"2024-09-17T03:44:34.508832+0000","last_became_active":"2024-09-17T03:44:34.507724+0000","last_became_peered":"2024-09-17T03:44:34.507724+0000","last_unstale":"2024-09-17T03:44:34.508832+0000","last_undegraded":"2024-09-17T03:44:34.508832+0000","last_fullsized":"2024-09-17T03:44:34.508832+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:55.250638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.497977+0000","last_change":"2024-09-17T03:44:34.497977+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.497977+0000","last_undegraded":"2024-09-17T03:44:34.497977+0000","last_fullsized":"2024-09-17T03:44:34.497977+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.510695+0000","last_change":"2024-09-17T03:44:34.508184+0000","last_active":"2024-09-17T03:44:34.510695+0000","last_peered":"2024-09-17T03:44:34.510695+0000","last_clean":"2024-09-17T03:44:34.510695+0000","last_became_active":"2024-09-17T03:44:34.507648+0000","last_became_peered":"2024-09-17T03:44:34.507648+0000","last_unstale":"2024-09-17T03:44:34.510695+0000","last_undegraded":"2024-09-17T03:44:34.510695+0000","last_fullsized":"2024-09-17T03:44:34.510695+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:26.303566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.497890+0000","last_change":"2024-09-17T03:44:34.497890+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.497890+0000","last_undegraded":"2024-09-17T03:44:34.497890+0000","last_fullsized":"2024-09-17T03:44:34.497890+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.512364+0000","last_change":"2024-09-17T03:44:34.508918+0000","last_active":"2024-09-17T03:44:34.512364+0000","last_peered":"2024-09-17T03:44:34.512364+0000","last_clean":"2024-09-17T03:44:34.512364+0000","last_became_active":"2024-09-17T03:44:34.508610+0000","last_became_peered":"2024-09-17T03:44:34.508610+0000","last_unstale":"2024-09-17T03:44:34.512364+0000","last_undegraded":"2024-09-17T03:44:34.512364+0000","last_fullsized":"2024-09-17T03:44:34.512364+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:23.781060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.497144+0000","last_change":"2024-09-17T03:44:34.497144+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.497144+0000","last_undegraded":"2024-09-17T03:44:34.497144+0000","last_fullsized":"2024-09-17T03:44:34.497144+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.508475+0000","last_change":"2024-09-17T03:44:34.507308+0000","last_active":"2024-09-17T03:44:34.508475+0000","last_peered":"2024-09-17T03:44:34.508475+0000","last_clean":"2024-09-17T03:44:34.508475+0000","last_became_active":"2024-09-17T03:44:34.506910+0000","last_became_peered":"2024-09-17T03:44:34.506910+0000","last_unstale":"2024-09-17T03:44:34.508475+0000","last_undegraded":"2024-09-17T03:44:34.508475+0000","last_fullsized":"2024-09-17T03:44:34.508475+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:24.315158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.497418+0000","last_change":"2024-09-17T03:44:34.497418+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.497418+0000","last_undegraded":"2024-09-17T03:44:34.497418+0000","last_fullsized":"2024-09-17T03:44:34.497418+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505515+0000","last_change":"2024-09-17T03:44:34.504070+0000","last_active":"2024-09-17T03:44:34.505515+0000","last_peered":"2024-09-17T03:44:34.505515+0000","last_clean":"2024-09-17T03:44:34.505515+0000","last_became_active":"2024-09-17T03:44:34.503697+0000","last_became_peered":"2024-09-17T03:44:34.503697+0000","last_unstale":"2024-09-17T03:44:34.505515+0000","last_undegraded":"2024-09-17T03:44:34.505515+0000","last_fullsized":"2024-09-17T03:44:34.505515+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:35.579214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494719+0000","last_change":"2024-09-17T03:44:34.494719+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494719+0000","last_undegraded":"2024-09-17T03:44:34.494719+0000","last_fullsized":"2024-09-17T03:44:34.494719+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505694+0000","last_change":"2024-09-17T03:44:34.504467+0000","last_active":"2024-09-17T03:44:34.505694+0000","last_peered":"2024-09-17T03:44:34.505694+0000","last_clean":"2024-09-17T03:44:34.505694+0000","last_became_active":"2024-09-17T03:44:34.504157+0000","last_became_peered":"2024-09-17T03:44:34.504157+0000","last_unstale":"2024-09-17T03:44:34.505694+0000","last_undegraded":"2024-09-17T03:44:34.505694+0000","last_fullsized":"2024-09-17T03:44:34.505694+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:31.235225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.497067+0000","last_change":"2024-09-17T03:44:34.497067+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.497067+0000","last_undegraded":"2024-09-17T03:44:34.497067+0000","last_fullsized":"2024-09-17T03:44:34.497067+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"175'3","reported_seq":18,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704588+0000","last_change":"2024-09-17T03:44:34.508692+0000","last_active":"2024-09-17T03:44:36.704588+0000","last_peered":"2024-09-17T03:44:36.704588+0000","last_clean":"2024-09-17T03:44:36.704588+0000","last_became_active":"2024-09-17T03:44:34.508213+0000","last_became_peered":"2024-09-17T03:44:34.508213+0000","last_unstale":"2024-09-17T03:44:36.704588+0000","last_undegraded":"2024-09-17T03:44:36.704588+0000","last_fullsized":"2024-09-17T03:44:36.704588+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:14.238753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492722+0000","last_change":"2024-09-17T03:44:34.492722+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492722+0000","last_undegraded":"2024-09-17T03:44:34.492722+0000","last_fullsized":"2024-09-17T03:44:34.492722+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.507953+0000","last_change":"2024-09-17T03:44:34.506888+0000","last_active":"2024-09-17T03:44:34.507953+0000","last_peered":"2024-09-17T03:44:34.507953+0000","last_clean":"2024-09-17T03:44:34.507953+0000","last_became_active":"2024-09-17T03:44:34.506553+0000","last_became_peered":"2024-09-17T03:44:34.506553+0000","last_unstale":"2024-09-17T03:44:34.507953+0000","last_undegraded":"2024-09-17T03:44:34.507953+0000","last_fullsized":"2024-09-17T03:44:34.507953+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:21.896272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.501057+0000","last_change":"2024-09-17T03:44:34.501057+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.501057+0000","last_undegraded":"2024-09-17T03:44:34.501057+0000","last_fullsized":"2024-09-17T03:44:34.501057+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.508816+0000","last_change":"2024-09-17T03:44:34.507298+0000","last_active":"2024-09-17T03:44:34.508816+0000","last_peered":"2024-09-17T03:44:34.508816+0000","last_clean":"2024-09-17T03:44:34.508816+0000","last_became_active":"2024-09-17T03:44:34.506960+0000","last_became_peered":"2024-09-17T03:44:34.506960+0000","last_unstale":"2024-09-17T03:44:34.508816+0000","last_undegraded":"2024-09-17T03:44:34.508816+0000","last_fullsized":"2024-09-17T03:44:34.508816+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:35.930832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704386+0000","last_change":"2024-09-17T03:44:35.520707+0000","last_active":"2024-09-17T03:44:36.704386+0000","last_peered":"2024-09-17T03:44:36.704386+0000","last_clean":"2024-09-17T03:44:36.704386+0000","last_became_active":"2024-09-17T03:44:35.520292+0000","last_became_peered":"2024-09-17T03:44:35.520292+0000","last_unstale":"2024-09-17T03:44:36.704386+0000","last_undegraded":"2024-09-17T03:44:36.704386+0000","last_fullsized":"2024-09-17T03:44:36.704386+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:35.032797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.502447+0000","last_change":"2024-09-17T03:44:34.500426+0000","last_active":"2024-09-17T03:44:34.502447+0000","last_peered":"2024-09-17T03:44:34.502447+0000","last_clean":"2024-09-17T03:44:34.502447+0000","last_became_active":"2024-09-17T03:44:34.500104+0000","last_became_peered":"2024-09-17T03:44:34.500104+0000","last_unstale":"2024-09-17T03:44:34.502447+0000","last_undegraded":"2024-09-17T03:44:34.502447+0000","last_fullsized":"2024-09-17T03:44:34.502447+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:30.961731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493925+0000","last_change":"2024-09-17T03:44:34.493925+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493925+0000","last_undegraded":"2024-09-17T03:44:34.493925+0000","last_fullsized":"2024-09-17T03:44:34.493925+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.703928+0000","last_change":"2024-09-17T03:44:34.506973+0000","last_active":"2024-09-17T03:44:36.703928+0000","last_peered":"2024-09-17T03:44:36.703928+0000","last_clean":"2024-09-17T03:44:36.703928+0000","last_became_active":"2024-09-17T03:44:34.506658+0000","last_became_peered":"2024-09-17T03:44:34.506658+0000","last_unstale":"2024-09-17T03:44:36.703928+0000","last_undegraded":"2024-09-17T03:44:36.703928+0000","last_fullsized":"2024-09-17T03:44:36.703928+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:31.118656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492716+0000","last_change":"2024-09-17T03:44:34.492716+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492716+0000","last_undegraded":"2024-09-17T03:44:34.492716+0000","last_fullsized":"2024-09-17T03:44:34.492716+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.507804+0000","last_change":"2024-09-17T03:44:34.505502+0000","last_active":"2024-09-17T03:44:34.507804+0000","last_peered":"2024-09-17T03:44:34.507804+0000","last_clean":"2024-09-17T03:44:34.507804+0000","last_became_active":"2024-09-17T03:44:34.505206+0000","last_became_peered":"2024-09-17T03:44:34.505206+0000","last_unstale":"2024-09-17T03:44:34.507804+0000","last_undegraded":"2024-09-17T03:44:34.507804+0000","last_fullsized":"2024-09-17T03:44:34.507804+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:05.103706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091511+0000","last_change":"2024-09-17T03:44:35.507591+0000","last_active":"2024-09-17T03:44:37.091511+0000","last_peered":"2024-09-17T03:44:37.091511+0000","last_clean":"2024-09-17T03:44:37.091511+0000","last_became_active":"2024-09-17T03:44:35.507301+0000","last_became_peered":"2024-09-17T03:44:35.507301+0000","last_unstale":"2024-09-17T03:44:37.091511+0000","last_undegraded":"2024-09-17T03:44:37.091511+0000","last_fullsized":"2024-09-17T03:44:37.091511+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:31.039012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.510899+0000","last_change":"2024-09-17T03:44:34.507954+0000","last_active":"2024-09-17T03:44:34.510899+0000","last_peered":"2024-09-17T03:44:34.510899+0000","last_clean":"2024-09-17T03:44:34.510899+0000","last_became_active":"2024-09-17T03:44:34.507591+0000","last_became_peered":"2024-09-17T03:44:34.507591+0000","last_unstale":"2024-09-17T03:44:34.510899+0000","last_undegraded":"2024-09-17T03:44:34.510899+0000","last_fullsized":"2024-09-17T03:44:34.510899+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:35.930832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091406+0000","last_change":"2024-09-17T03:44:35.515476+0000","last_active":"2024-09-17T03:44:37.091406+0000","last_peered":"2024-09-17T03:44:37.091406+0000","last_clean":"2024-09-17T03:44:37.091406+0000","last_became_active":"2024-09-17T03:44:35.514206+0000","last_became_peered":"2024-09-17T03:44:35.514206+0000","last_unstale":"2024-09-17T03:44:37.091406+0000","last_undegraded":"2024-09-17T03:44:37.091406+0000","last_fullsized":"2024-09-17T03:44:37.091406+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:37.648386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091604+0000","last_change":"2024-09-17T03:44:34.510346+0000","last_active":"2024-09-17T03:44:37.091604+0000","last_peered":"2024-09-17T03:44:37.091604+0000","last_clean":"2024-09-17T03:44:37.091604+0000","last_became_active":"2024-09-17T03:44:34.510051+0000","last_became_peered":"2024-09-17T03:44:34.510051+0000","last_unstale":"2024-09-17T03:44:37.091604+0000","last_undegraded":"2024-09-17T03:44:37.091604+0000","last_fullsized":"2024-09-17T03:44:37.091604+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:23.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494840+0000","last_change":"2024-09-17T03:44:34.494840+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494840+0000","last_undegraded":"2024-09-17T03:44:34.494840+0000","last_fullsized":"2024-09-17T03:44:34.494840+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704615+0000","last_change":"2024-09-17T03:44:34.509125+0000","last_active":"2024-09-17T03:44:36.704615+0000","last_peered":"2024-09-17T03:44:36.704615+0000","last_clean":"2024-09-17T03:44:36.704615+0000","last_became_active":"2024-09-17T03:44:34.507891+0000","last_became_peered":"2024-09-17T03:44:34.507891+0000","last_unstale":"2024-09-17T03:44:36.704615+0000","last_undegraded":"2024-09-17T03:44:36.704615+0000","last_fullsized":"2024-09-17T03:44:36.704615+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:06.654036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704396+0000","last_change":"2024-09-17T03:44:35.513414+0000","last_active":"2024-09-17T03:44:36.704396+0000","last_peered":"2024-09-17T03:44:36.704396+0000","last_clean":"2024-09-17T03:44:36.704396+0000","last_became_active":"2024-09-17T03:44:35.513121+0000","last_became_peered":"2024-09-17T03:44:35.513121+0000","last_unstale":"2024-09-17T03:44:36.704396+0000","last_undegraded":"2024-09-17T03:44:36.704396+0000","last_fullsized":"2024-09-17T03:44:36.704396+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:51.926469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.509797+0000","last_change":"2024-09-17T03:44:34.508494+0000","last_active":"2024-09-17T03:44:34.509797+0000","last_peered":"2024-09-17T03:44:34.509797+0000","last_clean":"2024-09-17T03:44:34.509797+0000","last_became_active":"2024-09-17T03:44:34.508171+0000","last_became_peered":"2024-09-17T03:44:34.508171+0000","last_unstale":"2024-09-17T03:44:34.509797+0000","last_undegraded":"2024-09-17T03:44:34.509797+0000","last_fullsized":"2024-09-17T03:44:34.509797+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:57.347223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704363+0000","last_change":"2024-09-17T03:44:35.517037+0000","last_active":"2024-09-17T03:44:36.704363+0000","last_peered":"2024-09-17T03:44:36.704363+0000","last_clean":"2024-09-17T03:44:36.704363+0000","last_became_active":"2024-09-17T03:44:35.516713+0000","last_became_peered":"2024-09-17T03:44:35.516713+0000","last_unstale":"2024-09-17T03:44:36.704363+0000","last_undegraded":"2024-09-17T03:44:36.704363+0000","last_fullsized":"2024-09-17T03:44:36.704363+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:16.789412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704298+0000","last_change":"2024-09-17T03:44:34.507042+0000","last_active":"2024-09-17T03:44:36.704298+0000","last_peered":"2024-09-17T03:44:36.704298+0000","last_clean":"2024-09-17T03:44:36.704298+0000","last_became_active":"2024-09-17T03:44:34.506712+0000","last_became_peered":"2024-09-17T03:44:34.506712+0000","last_unstale":"2024-09-17T03:44:36.704298+0000","last_undegraded":"2024-09-17T03:44:36.704298+0000","last_fullsized":"2024-09-17T03:44:36.704298+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:34.767116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493319+0000","last_change":"2024-09-17T03:44:34.493319+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493319+0000","last_undegraded":"2024-09-17T03:44:34.493319+0000","last_fullsized":"2024-09-17T03:44:34.493319+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.509192+0000","last_change":"2024-09-17T03:44:34.504134+0000","last_active":"2024-09-17T03:44:34.509192+0000","last_peered":"2024-09-17T03:44:34.509192+0000","last_clean":"2024-09-17T03:44:34.509192+0000","last_became_active":"2024-09-17T03:44:34.503719+0000","last_became_peered":"2024-09-17T03:44:34.503719+0000","last_unstale":"2024-09-17T03:44:34.509192+0000","last_undegraded":"2024-09-17T03:44:34.509192+0000","last_fullsized":"2024-09-17T03:44:34.509192+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:31.470158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091143+0000","last_change":"2024-09-17T03:44:35.506822+0000","last_active":"2024-09-17T03:44:37.091143+0000","last_peered":"2024-09-17T03:44:37.091143+0000","last_clean":"2024-09-17T03:44:37.091143+0000","last_became_active":"2024-09-17T03:44:35.506454+0000","last_became_peered":"2024-09-17T03:44:35.506454+0000","last_unstale":"2024-09-17T03:44:37.091143+0000","last_undegraded":"2024-09-17T03:44:37.091143+0000","last_fullsized":"2024-09-17T03:44:37.091143+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:13.279683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.501743+0000","last_change":"2024-09-17T03:44:34.499354+0000","last_active":"2024-09-17T03:44:34.501743+0000","last_peered":"2024-09-17T03:44:34.501743+0000","last_clean":"2024-09-17T03:44:34.501743+0000","last_became_active":"2024-09-17T03:44:34.498887+0000","last_became_peered":"2024-09-17T03:44:34.498887+0000","last_unstale":"2024-09-17T03:44:34.501743+0000","last_undegraded":"2024-09-17T03:44:34.501743+0000","last_fullsized":"2024-09-17T03:44:34.501743+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:41.546631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494647+0000","last_change":"2024-09-17T03:44:34.494647+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494647+0000","last_undegraded":"2024-09-17T03:44:34.494647+0000","last_fullsized":"2024-09-17T03:44:34.494647+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.511506+0000","last_change":"2024-09-17T03:44:34.510288+0000","last_active":"2024-09-17T03:44:34.511506+0000","last_peered":"2024-09-17T03:44:34.511506+0000","last_clean":"2024-09-17T03:44:34.511506+0000","last_became_active":"2024-09-17T03:44:34.509945+0000","last_became_peered":"2024-09-17T03:44:34.509945+0000","last_unstale":"2024-09-17T03:44:34.511506+0000","last_undegraded":"2024-09-17T03:44:34.511506+0000","last_fullsized":"2024-09-17T03:44:34.511506+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:58.067682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492092+0000","last_change":"2024-09-17T03:44:34.492092+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492092+0000","last_undegraded":"2024-09-17T03:44:34.492092+0000","last_fullsized":"2024-09-17T03:44:34.492092+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505713+0000","last_change":"2024-09-17T03:44:34.504336+0000","last_active":"2024-09-17T03:44:34.505713+0000","last_peered":"2024-09-17T03:44:34.505713+0000","last_clean":"2024-09-17T03:44:34.505713+0000","last_became_active":"2024-09-17T03:44:34.504005+0000","last_became_peered":"2024-09-17T03:44:34.504005+0000","last_unstale":"2024-09-17T03:44:34.505713+0000","last_undegraded":"2024-09-17T03:44:34.505713+0000","last_fullsized":"2024-09-17T03:44:34.505713+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:11.268392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493419+0000","last_change":"2024-09-17T03:44:34.493419+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493419+0000","last_undegraded":"2024-09-17T03:44:34.493419+0000","last_fullsized":"2024-09-17T03:44:34.493419+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.507986+0000","last_change":"2024-09-17T03:44:34.506730+0000","last_active":"2024-09-17T03:44:34.507986+0000","last_peered":"2024-09-17T03:44:34.507986+0000","last_clean":"2024-09-17T03:44:34.507986+0000","last_became_active":"2024-09-17T03:44:34.506425+0000","last_became_peered":"2024-09-17T03:44:34.506425+0000","last_unstale":"2024-09-17T03:44:34.507986+0000","last_undegraded":"2024-09-17T03:44:34.507986+0000","last_fullsized":"2024-09-17T03:44:34.507986+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:26.099434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091119+0000","last_change":"2024-09-17T03:44:35.514014+0000","last_active":"2024-09-17T03:44:37.091119+0000","last_peered":"2024-09-17T03:44:37.091119+0000","last_clean":"2024-09-17T03:44:37.091119+0000","last_became_active":"2024-09-17T03:44:35.513696+0000","last_became_peered":"2024-09-17T03:44:35.513696+0000","last_unstale":"2024-09-17T03:44:37.091119+0000","last_undegraded":"2024-09-17T03:44:37.091119+0000","last_fullsized":"2024-09-17T03:44:37.091119+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:37.810185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.511482+0000","last_change":"2024-09-17T03:44:34.507786+0000","last_active":"2024-09-17T03:44:34.511482+0000","last_peered":"2024-09-17T03:44:34.511482+0000","last_clean":"2024-09-17T03:44:34.511482+0000","last_became_active":"2024-09-17T03:44:34.506839+0000","last_became_peered":"2024-09-17T03:44:34.506839+0000","last_unstale":"2024-09-17T03:44:34.511482+0000","last_undegraded":"2024-09-17T03:44:34.511482+0000","last_fullsized":"2024-09-17T03:44:34.511482+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:45.200268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.492617+0000","last_change":"2024-09-17T03:44:34.492617+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.492617+0000","last_undegraded":"2024-09-17T03:44:34.492617+0000","last_fullsized":"2024-09-17T03:44:34.492617+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505675+0000","last_change":"2024-09-17T03:44:34.504327+0000","last_active":"2024-09-17T03:44:34.505675+0000","last_peered":"2024-09-17T03:44:34.505675+0000","last_clean":"2024-09-17T03:44:34.505675+0000","last_became_active":"2024-09-17T03:44:34.504030+0000","last_became_peered":"2024-09-17T03:44:34.504030+0000","last_unstale":"2024-09-17T03:44:34.505675+0000","last_undegraded":"2024-09-17T03:44:34.505675+0000","last_fullsized":"2024-09-17T03:44:34.505675+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:54.697720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493740+0000","last_change":"2024-09-17T03:44:34.493740+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493740+0000","last_undegraded":"2024-09-17T03:44:34.493740+0000","last_fullsized":"2024-09-17T03:44:34.493740+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.513300+0000","last_change":"2024-09-17T03:44:34.512828+0000","last_active":"2024-09-17T03:44:34.513300+0000","last_peered":"2024-09-17T03:44:34.513300+0000","last_clean":"2024-09-17T03:44:34.513300+0000","last_became_active":"2024-09-17T03:44:34.512469+0000","last_became_peered":"2024-09-17T03:44:34.512469+0000","last_unstale":"2024-09-17T03:44:34.513300+0000","last_undegraded":"2024-09-17T03:44:34.513300+0000","last_fullsized":"2024-09-17T03:44:34.513300+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:26.742795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493438+0000","last_change":"2024-09-17T03:44:34.493438+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493438+0000","last_undegraded":"2024-09-17T03:44:34.493438+0000","last_fullsized":"2024-09-17T03:44:34.493438+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.510725+0000","last_change":"2024-09-17T03:44:34.508966+0000","last_active":"2024-09-17T03:44:34.510725+0000","last_peered":"2024-09-17T03:44:34.510725+0000","last_clean":"2024-09-17T03:44:34.510725+0000","last_became_active":"2024-09-17T03:44:34.508648+0000","last_became_peered":"2024-09-17T03:44:34.508648+0000","last_unstale":"2024-09-17T03:44:34.510725+0000","last_undegraded":"2024-09-17T03:44:34.510725+0000","last_fullsized":"2024-09-17T03:44:34.510725+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:45.815093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.493336+0000","last_change":"2024-09-17T03:44:34.493336+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.493336+0000","last_undegraded":"2024-09-17T03:44:34.493336+0000","last_fullsized":"2024-09-17T03:44:34.493336+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505672+0000","last_change":"2024-09-17T03:44:34.503673+0000","last_active":"2024-09-17T03:44:34.505672+0000","last_peered":"2024-09-17T03:44:34.505672+0000","last_clean":"2024-09-17T03:44:34.505672+0000","last_became_active":"2024-09-17T03:44:34.503331+0000","last_became_peered":"2024-09-17T03:44:34.503331+0000","last_unstale":"2024-09-17T03:44:34.505672+0000","last_undegraded":"2024-09-17T03:44:34.505672+0000","last_fullsized":"2024-09-17T03:44:34.505672+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:07.117266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091048+0000","last_change":"2024-09-17T03:44:35.508733+0000","last_active":"2024-09-17T03:44:37.091048+0000","last_peered":"2024-09-17T03:44:37.091048+0000","last_clean":"2024-09-17T03:44:37.091048+0000","last_became_active":"2024-09-17T03:44:35.508398+0000","last_became_peered":"2024-09-17T03:44:35.508398+0000","last_unstale":"2024-09-17T03:44:37.091048+0000","last_undegraded":"2024-09-17T03:44:37.091048+0000","last_fullsized":"2024-09-17T03:44:37.091048+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.505490+0000","last_change":"2024-09-17T03:44:34.500723+0000","last_active":"2024-09-17T03:44:34.505490+0000","last_peered":"2024-09-17T03:44:34.505490+0000","last_clean":"2024-09-17T03:44:34.505490+0000","last_became_active":"2024-09-17T03:44:34.500367+0000","last_became_peered":"2024-09-17T03:44:34.500367+0000","last_unstale":"2024-09-17T03:44:34.505490+0000","last_undegraded":"2024-09-17T03:44:34.505490+0000","last_fullsized":"2024-09-17T03:44:34.505490+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:24.315158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2024-09-17T03:44:34.494724+0000","last_change":"2024-09-17T03:44:34.494724+0000","last_active":"2024-09-17T03:44:34.480039+0000","last_peered":"2024-09-17T03:44:34.480039+0000","last_clean":"2024-09-17T03:44:34.480039+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:44:34.494724+0000","last_undegraded":"2024-09-17T03:44:34.494724+0000","last_fullsized":"2024-09-17T03:44:34.494724+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":10,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.509223+0000","last_change":"2024-09-17T03:44:34.508290+0000","last_active":"2024-09-17T03:44:34.509223+0000","last_peered":"2024-09-17T03:44:34.509223+0000","last_clean":"2024-09-17T03:44:34.509223+0000","last_became_active":"2024-09-17T03:44:34.507990+0000","last_became_peered":"2024-09-17T03:44:34.507990+0000","last_unstale":"2024-09-17T03:44:34.509223+0000","last_undegraded":"2024-09-17T03:44:34.509223+0000","last_fullsized":"2024-09-17T03:44:34.509223+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:33.360239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":390,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T03:44:34.499983+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:44:34.499983+0000","last_peered":"2024-09-17T03:44:34.499983+0000","last_clean":"2024-09-17T03:44:34.499983+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:44:34.499983+0000","last_undegraded":"2024-09-17T03:44:34.499983+0000","last_fullsized":"2024-09-17T03:44:34.499983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509585,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60260,"kb_used_data":2704,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311580,"statfs":{"total":96636764160,"available":96575057920,"internally_reserved":0,"allocated":2768896,"data_stored":1544678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59680,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312160,"statfs":{"total":96636764160,"available":96575651840,"internally_reserved":0,"allocated":2174976,"data_stored":954310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509585,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65200,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306640,"statfs":{"total":96636764160,"available":96569999360,"internally_reserved":0,"allocated":2174976,"data_stored":954310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55524,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316316,"statfs":{"total":96636764160,"available":96579907584,"internally_reserved":0,"allocated":2174976,"data_stored":954310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509586,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59684,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312156,"statfs":{"total":96636764160,"available":96575647744,"internally_reserved":0,"allocated":2174976,"data_stored":954310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509586,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56100,"kb_used_data":2704,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315740,"statfs":{"total":96636764160,"available":96579317760,"internally_reserved":0,"allocated":2768896,"data_stored":1544678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55568,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316272,"statfs":{"total":96636764160,"available":96579862528,"internally_reserved":0,"allocated":2215936,"data_stored":974242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55572,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316268,"statfs":{"total":96636764160,"available":96579858432,"internally_reserved":0,"allocated":2224128,"data_stored":973842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:44:39.877 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:44:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.026+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/2173728083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8dc003a30 msgr2=0x7fd8dc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.026+0000 7fd8f7aa9640 1 --2- 172.21.15.146:0/2173728083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8dc003a30 0x7fd8dc003ea0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c4a0 tx=0x7fd8dc005830 comp rx=0 tx=0).stop 2024-09-17T03:44:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.026+0000 7fd8f6046640 1 -- 172.21.15.146:0/2173728083 reap_dead start 2024-09-17T03:44:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.026+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/2173728083 shutdown_connections 2024-09-17T03:44:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.026+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/2173728083 >> 172.21.15.146:0/2173728083 conn(0x7fd8f00b7b20 msgr2=0x7fd8f009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.026+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/2173728083 shutdown_connections 2024-09-17T03:44:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.026+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/2173728083 wait complete. 2024-09-17T03:44:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.028+0000 7fd8f7aa9640 1 Processor -- start 2024-09-17T03:44:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.028+0000 7fd8f7aa9640 1 -- start start 2024-09-17T03:44:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.029+0000 7fd8f7aa9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8dc003a30 0x7fd8f0152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.029+0000 7fd8f7aa9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8f0156b40 0x7fd8f0156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.029+0000 7fd8f7aa9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f01f6b40 0x7fd8f01f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.029+0000 7fd8f7aa9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f015d1b0 con 0x7fd8dc003a30 2024-09-17T03:44:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.029+0000 7fd8f7aa9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f00b38b0 con 0x7fd8f01f6b40 2024-09-17T03:44:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.029+0000 7fd8f7aa9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f015d330 con 0x7fd8f0156b40 2024-09-17T03:44:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.029+0000 7fd8f5845640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8dc003a30 0x7fd8f0152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.029+0000 7fd8f5845640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8dc003a30 0x7fd8f0152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48108/0 (socket says 172.21.15.146:48108) 2024-09-17T03:44:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.029+0000 7fd8f5845640 1 -- 172.21.15.146:0/1728124921 learned_addr learned my addr 172.21.15.146:0/1728124921 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8f5044640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8f0156b40 0x7fd8f0156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8f6046640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f01f6b40 0x7fd8f01f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8f5845640 1 -- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8f0156b40 msgr2=0x7fd8f0156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8f5845640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8f0156b40 0x7fd8f0156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8f5845640 1 -- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f01f6b40 msgr2=0x7fd8f01f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8f5845640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f01f6b40 0x7fd8f01f6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8f5845640 1 -- 172.21.15.146:0/1728124921 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f01f7490 con 0x7fd8dc003a30 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8f6046640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f01f6b40 0x7fd8f01f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8f5845640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8dc003a30 0x7fd8f0152b10 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec000c00 tx=0x7fd8ec006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8e67fc640 1 -- 172.21.15.146:0/1728124921 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec043070 con 0x7fd8dc003a30 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8e67fc640 1 -- 172.21.15.146:0/1728124921 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8ec03a070 con 0x7fd8dc003a30 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8e67fc640 1 -- 172.21.15.146:0/1728124921 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec02b880 con 0x7fd8dc003a30 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/1728124921 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f0154d80 con 0x7fd8dc003a30 2024-09-17T03:44:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.030+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/1728124921 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f0155340 con 0x7fd8dc003a30 2024-09-17T03:44:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.031+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/1728124921 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f015d8c0 con 0x7fd8dc003a30 2024-09-17T03:44:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.032+0000 7fd8e67fc640 1 -- 172.21.15.146:0/1728124921 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8ec03c070 con 0x7fd8dc003a30 2024-09-17T03:44:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.032+0000 7fd8e67fc640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d4078b90 0x7fd8d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.032+0000 7fd8e67fc640 1 -- 172.21.15.146:0/1728124921 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fd8ec0ba460 con 0x7fd8dc003a30 2024-09-17T03:44:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.033+0000 7fd8f5044640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d4078b90 0x7fd8d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.033+0000 7fd8f5044640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d4078b90 0x7fd8d407b0a0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0154090 tx=0x7fd8e0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.037+0000 7fd8e67fc640 1 -- 172.21.15.146:0/1728124921 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd8f01f7490 con 0x7fd8dc003a30 2024-09-17T03:44:40.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.206+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/1728124921 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8f0158c60 con 0x7fd8d4078b90 2024-09-17T03:44:40.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.211+0000 7fd8e67fc640 1 -- 172.21.15.146:0/1728124921 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252477 (secure 0 0 0) 0x7fd8e005ea50 con 0x7fd8d4078b90 2024-09-17T03:44:40.214 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:44:40.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d4078b90 msgr2=0x7fd8d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d4078b90 0x7fd8d407b0a0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0154090 tx=0x7fd8e0005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:40.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/1728124921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8dc003a30 msgr2=0x7fd8f0152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8dc003a30 0x7fd8f0152b10 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec000c00 tx=0x7fd8ec006060 comp rx=0 tx=0).stop 2024-09-17T03:44:40.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/1728124921 shutdown_connections 2024-09-17T03:44:40.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d4078b90 0x7fd8d407b0a0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8f01f6b40 0x7fd8f01f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8f0156b40 0x7fd8f0156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 --2- 172.21.15.146:0/1728124921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8dc003a30 0x7fd8f0152b10 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/1728124921 >> 172.21.15.146:0/1728124921 conn(0x7fd8f00b7b20 msgr2=0x7fd8f015fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:40.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/1728124921 shutdown_connections 2024-09-17T03:44:40.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.214+0000 7fd8f7aa9640 1 -- 172.21.15.146:0/1728124921 wait complete. 2024-09-17T03:44:40.226 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":526,"stamp":"2024-09-17T03:44:39.977080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":467840,"kb_used_data":18504,"kb_used_omap":12,"kb_used_meta":449139,"kb_avail":754506880,"statfs":{"total":773094113280,"available":772615045120,"internally_reserved":0,"allocated":18948096,"data_stored":8974836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":459918897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001718"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091840+0000","last_change":"2024-09-17T03:44:35.501652+0000","last_active":"2024-09-17T03:44:37.091840+0000","last_peered":"2024-09-17T03:44:37.091840+0000","last_clean":"2024-09-17T03:44:37.091840+0000","last_became_active":"2024-09-17T03:44:35.501332+0000","last_became_peered":"2024-09-17T03:44:35.501332+0000","last_unstale":"2024-09-17T03:44:37.091840+0000","last_undegraded":"2024-09-17T03:44:37.091840+0000","last_fullsized":"2024-09-17T03:44:37.091840+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:53.854135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091399+0000","last_change":"2024-09-17T03:44:35.511226+0000","last_active":"2024-09-17T03:44:37.091399+0000","last_peered":"2024-09-17T03:44:37.091399+0000","last_clean":"2024-09-17T03:44:37.091399+0000","last_became_active":"2024-09-17T03:44:35.510919+0000","last_became_peered":"2024-09-17T03:44:35.510919+0000","last_unstale":"2024-09-17T03:44:37.091399+0000","last_undegraded":"2024-09-17T03:44:37.091399+0000","last_fullsized":"2024-09-17T03:44:37.091399+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:13.140658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736901+0000","last_change":"2024-09-17T03:44:35.505142+0000","last_active":"2024-09-17T03:44:36.736901+0000","last_peered":"2024-09-17T03:44:36.736901+0000","last_clean":"2024-09-17T03:44:36.736901+0000","last_became_active":"2024-09-17T03:44:35.503630+0000","last_became_peered":"2024-09-17T03:44:35.503630+0000","last_unstale":"2024-09-17T03:44:36.736901+0000","last_undegraded":"2024-09-17T03:44:36.736901+0000","last_fullsized":"2024-09-17T03:44:36.736901+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:32.237378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560359+0000","last_change":"2024-09-17T03:44:35.516826+0000","last_active":"2024-09-17T03:44:36.560359+0000","last_peered":"2024-09-17T03:44:36.560359+0000","last_clean":"2024-09-17T03:44:36.560359+0000","last_became_active":"2024-09-17T03:44:35.516467+0000","last_became_peered":"2024-09-17T03:44:35.516467+0000","last_unstale":"2024-09-17T03:44:36.560359+0000","last_undegraded":"2024-09-17T03:44:36.560359+0000","last_fullsized":"2024-09-17T03:44:36.560359+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:06.727326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492653+0000","last_change":"2024-09-17T03:44:35.517344+0000","last_active":"2024-09-17T03:44:36.492653+0000","last_peered":"2024-09-17T03:44:36.492653+0000","last_clean":"2024-09-17T03:44:36.492653+0000","last_became_active":"2024-09-17T03:44:35.516994+0000","last_became_peered":"2024-09-17T03:44:35.516994+0000","last_unstale":"2024-09-17T03:44:36.492653+0000","last_undegraded":"2024-09-17T03:44:36.492653+0000","last_fullsized":"2024-09-17T03:44:36.492653+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:05.651432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492943+0000","last_change":"2024-09-17T03:44:35.513238+0000","last_active":"2024-09-17T03:44:36.492943+0000","last_peered":"2024-09-17T03:44:36.492943+0000","last_clean":"2024-09-17T03:44:36.492943+0000","last_became_active":"2024-09-17T03:44:35.512950+0000","last_became_peered":"2024-09-17T03:44:35.512950+0000","last_unstale":"2024-09-17T03:44:36.492943+0000","last_undegraded":"2024-09-17T03:44:36.492943+0000","last_fullsized":"2024-09-17T03:44:36.492943+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:27.101587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091170+0000","last_change":"2024-09-17T03:44:35.511166+0000","last_active":"2024-09-17T03:44:37.091170+0000","last_peered":"2024-09-17T03:44:37.091170+0000","last_clean":"2024-09-17T03:44:37.091170+0000","last_became_active":"2024-09-17T03:44:35.510859+0000","last_became_peered":"2024-09-17T03:44:35.510859+0000","last_unstale":"2024-09-17T03:44:37.091170+0000","last_undegraded":"2024-09-17T03:44:37.091170+0000","last_fullsized":"2024-09-17T03:44:37.091170+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:43.512265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492353+0000","last_change":"2024-09-17T03:44:35.509502+0000","last_active":"2024-09-17T03:44:36.492353+0000","last_peered":"2024-09-17T03:44:36.492353+0000","last_clean":"2024-09-17T03:44:36.492353+0000","last_became_active":"2024-09-17T03:44:35.509199+0000","last_became_peered":"2024-09-17T03:44:35.509199+0000","last_unstale":"2024-09-17T03:44:36.492353+0000","last_undegraded":"2024-09-17T03:44:36.492353+0000","last_fullsized":"2024-09-17T03:44:36.492353+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:20.369104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091476+0000","last_change":"2024-09-17T03:44:35.510397+0000","last_active":"2024-09-17T03:44:37.091476+0000","last_peered":"2024-09-17T03:44:37.091476+0000","last_clean":"2024-09-17T03:44:37.091476+0000","last_became_active":"2024-09-17T03:44:35.510097+0000","last_became_peered":"2024-09-17T03:44:35.510097+0000","last_unstale":"2024-09-17T03:44:37.091476+0000","last_undegraded":"2024-09-17T03:44:37.091476+0000","last_fullsized":"2024-09-17T03:44:37.091476+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:54.322849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704318+0000","last_change":"2024-09-17T03:44:35.523683+0000","last_active":"2024-09-17T03:44:36.704318+0000","last_peered":"2024-09-17T03:44:36.704318+0000","last_clean":"2024-09-17T03:44:36.704318+0000","last_became_active":"2024-09-17T03:44:35.523362+0000","last_became_peered":"2024-09-17T03:44:35.523362+0000","last_unstale":"2024-09-17T03:44:36.704318+0000","last_undegraded":"2024-09-17T03:44:36.704318+0000","last_fullsized":"2024-09-17T03:44:36.704318+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:47.040157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736998+0000","last_change":"2024-09-17T03:44:35.522118+0000","last_active":"2024-09-17T03:44:36.736998+0000","last_peered":"2024-09-17T03:44:36.736998+0000","last_clean":"2024-09-17T03:44:36.736998+0000","last_became_active":"2024-09-17T03:44:35.521106+0000","last_became_peered":"2024-09-17T03:44:35.521106+0000","last_unstale":"2024-09-17T03:44:36.736998+0000","last_undegraded":"2024-09-17T03:44:36.736998+0000","last_fullsized":"2024-09-17T03:44:36.736998+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:48.040111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496008+0000","last_change":"2024-09-17T03:44:35.511467+0000","last_active":"2024-09-17T03:44:36.496008+0000","last_peered":"2024-09-17T03:44:36.496008+0000","last_clean":"2024-09-17T03:44:36.496008+0000","last_became_active":"2024-09-17T03:44:35.510852+0000","last_became_peered":"2024-09-17T03:44:35.510852+0000","last_unstale":"2024-09-17T03:44:36.496008+0000","last_undegraded":"2024-09-17T03:44:36.496008+0000","last_fullsized":"2024-09-17T03:44:36.496008+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:47.965353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496731+0000","last_change":"2024-09-17T03:44:35.498609+0000","last_active":"2024-09-17T03:44:36.496731+0000","last_peered":"2024-09-17T03:44:36.496731+0000","last_clean":"2024-09-17T03:44:36.496731+0000","last_became_active":"2024-09-17T03:44:35.498220+0000","last_became_peered":"2024-09-17T03:44:35.498220+0000","last_unstale":"2024-09-17T03:44:36.496731+0000","last_undegraded":"2024-09-17T03:44:36.496731+0000","last_fullsized":"2024-09-17T03:44:36.496731+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:31.628305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091377+0000","last_change":"2024-09-17T03:44:35.498274+0000","last_active":"2024-09-17T03:44:37.091377+0000","last_peered":"2024-09-17T03:44:37.091377+0000","last_clean":"2024-09-17T03:44:37.091377+0000","last_became_active":"2024-09-17T03:44:35.497945+0000","last_became_peered":"2024-09-17T03:44:35.497945+0000","last_unstale":"2024-09-17T03:44:37.091377+0000","last_undegraded":"2024-09-17T03:44:37.091377+0000","last_fullsized":"2024-09-17T03:44:37.091377+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:58.351462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091265+0000","last_change":"2024-09-17T03:44:35.502806+0000","last_active":"2024-09-17T03:44:37.091265+0000","last_peered":"2024-09-17T03:44:37.091265+0000","last_clean":"2024-09-17T03:44:37.091265+0000","last_became_active":"2024-09-17T03:44:35.502487+0000","last_became_peered":"2024-09-17T03:44:35.502487+0000","last_unstale":"2024-09-17T03:44:37.091265+0000","last_undegraded":"2024-09-17T03:44:37.091265+0000","last_fullsized":"2024-09-17T03:44:37.091265+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.717384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704050+0000","last_change":"2024-09-17T03:44:35.518950+0000","last_active":"2024-09-17T03:44:36.704050+0000","last_peered":"2024-09-17T03:44:36.704050+0000","last_clean":"2024-09-17T03:44:36.704050+0000","last_became_active":"2024-09-17T03:44:35.518668+0000","last_became_peered":"2024-09-17T03:44:35.518668+0000","last_unstale":"2024-09-17T03:44:36.704050+0000","last_undegraded":"2024-09-17T03:44:36.704050+0000","last_fullsized":"2024-09-17T03:44:36.704050+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:01.877073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091816+0000","last_change":"2024-09-17T03:44:35.501005+0000","last_active":"2024-09-17T03:44:37.091816+0000","last_peered":"2024-09-17T03:44:37.091816+0000","last_clean":"2024-09-17T03:44:37.091816+0000","last_became_active":"2024-09-17T03:44:35.500713+0000","last_became_peered":"2024-09-17T03:44:35.500713+0000","last_unstale":"2024-09-17T03:44:37.091816+0000","last_undegraded":"2024-09-17T03:44:37.091816+0000","last_fullsized":"2024-09-17T03:44:37.091816+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:50.341011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704369+0000","last_change":"2024-09-17T03:44:35.522929+0000","last_active":"2024-09-17T03:44:36.704369+0000","last_peered":"2024-09-17T03:44:36.704369+0000","last_clean":"2024-09-17T03:44:36.704369+0000","last_became_active":"2024-09-17T03:44:35.522419+0000","last_became_peered":"2024-09-17T03:44:35.522419+0000","last_unstale":"2024-09-17T03:44:36.704369+0000","last_undegraded":"2024-09-17T03:44:36.704369+0000","last_fullsized":"2024-09-17T03:44:36.704369+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:27.801044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704537+0000","last_change":"2024-09-17T03:44:35.523107+0000","last_active":"2024-09-17T03:44:36.704537+0000","last_peered":"2024-09-17T03:44:36.704537+0000","last_clean":"2024-09-17T03:44:36.704537+0000","last_became_active":"2024-09-17T03:44:35.522655+0000","last_became_peered":"2024-09-17T03:44:35.522655+0000","last_unstale":"2024-09-17T03:44:36.704537+0000","last_undegraded":"2024-09-17T03:44:36.704537+0000","last_fullsized":"2024-09-17T03:44:36.704537+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:38.500491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492728+0000","last_change":"2024-09-17T03:44:35.512596+0000","last_active":"2024-09-17T03:44:36.492728+0000","last_peered":"2024-09-17T03:44:36.492728+0000","last_clean":"2024-09-17T03:44:36.492728+0000","last_became_active":"2024-09-17T03:44:35.512241+0000","last_became_peered":"2024-09-17T03:44:35.512241+0000","last_unstale":"2024-09-17T03:44:36.492728+0000","last_undegraded":"2024-09-17T03:44:36.492728+0000","last_fullsized":"2024-09-17T03:44:36.492728+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:14.720703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560145+0000","last_change":"2024-09-17T03:44:35.509155+0000","last_active":"2024-09-17T03:44:36.560145+0000","last_peered":"2024-09-17T03:44:36.560145+0000","last_clean":"2024-09-17T03:44:36.560145+0000","last_became_active":"2024-09-17T03:44:35.508764+0000","last_became_peered":"2024-09-17T03:44:35.508764+0000","last_unstale":"2024-09-17T03:44:36.560145+0000","last_undegraded":"2024-09-17T03:44:36.560145+0000","last_fullsized":"2024-09-17T03:44:36.560145+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:39.874649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495869+0000","last_change":"2024-09-17T03:44:35.514858+0000","last_active":"2024-09-17T03:44:36.495869+0000","last_peered":"2024-09-17T03:44:36.495869+0000","last_clean":"2024-09-17T03:44:36.495869+0000","last_became_active":"2024-09-17T03:44:35.514478+0000","last_became_peered":"2024-09-17T03:44:35.514478+0000","last_unstale":"2024-09-17T03:44:36.495869+0000","last_undegraded":"2024-09-17T03:44:36.495869+0000","last_fullsized":"2024-09-17T03:44:36.495869+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:15.280435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495700+0000","last_change":"2024-09-17T03:44:35.509000+0000","last_active":"2024-09-17T03:44:36.495700+0000","last_peered":"2024-09-17T03:44:36.495700+0000","last_clean":"2024-09-17T03:44:36.495700+0000","last_became_active":"2024-09-17T03:44:35.507413+0000","last_became_peered":"2024-09-17T03:44:35.507413+0000","last_unstale":"2024-09-17T03:44:36.495700+0000","last_undegraded":"2024-09-17T03:44:36.495700+0000","last_fullsized":"2024-09-17T03:44:36.495700+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:45.655104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.559968+0000","last_change":"2024-09-17T03:44:35.509513+0000","last_active":"2024-09-17T03:44:36.559968+0000","last_peered":"2024-09-17T03:44:36.559968+0000","last_clean":"2024-09-17T03:44:36.559968+0000","last_became_active":"2024-09-17T03:44:35.509188+0000","last_became_peered":"2024-09-17T03:44:35.509188+0000","last_unstale":"2024-09-17T03:44:36.559968+0000","last_undegraded":"2024-09-17T03:44:36.559968+0000","last_fullsized":"2024-09-17T03:44:36.559968+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:37.993184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091224+0000","last_change":"2024-09-17T03:44:35.515781+0000","last_active":"2024-09-17T03:44:37.091224+0000","last_peered":"2024-09-17T03:44:37.091224+0000","last_clean":"2024-09-17T03:44:37.091224+0000","last_became_active":"2024-09-17T03:44:35.515189+0000","last_became_peered":"2024-09-17T03:44:35.515189+0000","last_unstale":"2024-09-17T03:44:37.091224+0000","last_undegraded":"2024-09-17T03:44:37.091224+0000","last_fullsized":"2024-09-17T03:44:37.091224+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:28.320921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091829+0000","last_change":"2024-09-17T03:44:35.510737+0000","last_active":"2024-09-17T03:44:37.091829+0000","last_peered":"2024-09-17T03:44:37.091829+0000","last_clean":"2024-09-17T03:44:37.091829+0000","last_became_active":"2024-09-17T03:44:35.510434+0000","last_became_peered":"2024-09-17T03:44:35.510434+0000","last_unstale":"2024-09-17T03:44:37.091829+0000","last_undegraded":"2024-09-17T03:44:37.091829+0000","last_fullsized":"2024-09-17T03:44:37.091829+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:34.100442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495871+0000","last_change":"2024-09-17T03:44:35.511390+0000","last_active":"2024-09-17T03:44:36.495871+0000","last_peered":"2024-09-17T03:44:36.495871+0000","last_clean":"2024-09-17T03:44:36.495871+0000","last_became_active":"2024-09-17T03:44:35.510575+0000","last_became_peered":"2024-09-17T03:44:35.510575+0000","last_unstale":"2024-09-17T03:44:36.495871+0000","last_undegraded":"2024-09-17T03:44:36.495871+0000","last_fullsized":"2024-09-17T03:44:36.495871+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:17.523096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736731+0000","last_change":"2024-09-17T03:44:35.506964+0000","last_active":"2024-09-17T03:44:36.736731+0000","last_peered":"2024-09-17T03:44:36.736731+0000","last_clean":"2024-09-17T03:44:36.736731+0000","last_became_active":"2024-09-17T03:44:35.506673+0000","last_became_peered":"2024-09-17T03:44:35.506673+0000","last_unstale":"2024-09-17T03:44:36.736731+0000","last_undegraded":"2024-09-17T03:44:36.736731+0000","last_fullsized":"2024-09-17T03:44:36.736731+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:55.838810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496252+0000","last_change":"2024-09-17T03:44:35.510967+0000","last_active":"2024-09-17T03:44:36.496252+0000","last_peered":"2024-09-17T03:44:36.496252+0000","last_clean":"2024-09-17T03:44:36.496252+0000","last_became_active":"2024-09-17T03:44:35.510633+0000","last_became_peered":"2024-09-17T03:44:35.510633+0000","last_unstale":"2024-09-17T03:44:36.496252+0000","last_undegraded":"2024-09-17T03:44:36.496252+0000","last_fullsized":"2024-09-17T03:44:36.496252+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:57.377466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091089+0000","last_change":"2024-09-17T03:44:35.507298+0000","last_active":"2024-09-17T03:44:37.091089+0000","last_peered":"2024-09-17T03:44:37.091089+0000","last_clean":"2024-09-17T03:44:37.091089+0000","last_became_active":"2024-09-17T03:44:35.506929+0000","last_became_peered":"2024-09-17T03:44:35.506929+0000","last_unstale":"2024-09-17T03:44:37.091089+0000","last_undegraded":"2024-09-17T03:44:37.091089+0000","last_fullsized":"2024-09-17T03:44:37.091089+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:52.753354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704158+0000","last_change":"2024-09-17T03:44:35.511788+0000","last_active":"2024-09-17T03:44:36.704158+0000","last_peered":"2024-09-17T03:44:36.704158+0000","last_clean":"2024-09-17T03:44:36.704158+0000","last_became_active":"2024-09-17T03:44:35.511502+0000","last_became_peered":"2024-09-17T03:44:35.511502+0000","last_unstale":"2024-09-17T03:44:36.704158+0000","last_undegraded":"2024-09-17T03:44:36.704158+0000","last_fullsized":"2024-09-17T03:44:36.704158+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:17.382875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091087+0000","last_change":"2024-09-17T03:44:35.503091+0000","last_active":"2024-09-17T03:44:37.091087+0000","last_peered":"2024-09-17T03:44:37.091087+0000","last_clean":"2024-09-17T03:44:37.091087+0000","last_became_active":"2024-09-17T03:44:35.502779+0000","last_became_peered":"2024-09-17T03:44:35.502779+0000","last_unstale":"2024-09-17T03:44:37.091087+0000","last_undegraded":"2024-09-17T03:44:37.091087+0000","last_fullsized":"2024-09-17T03:44:37.091087+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:57.611510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091331+0000","last_change":"2024-09-17T03:44:35.517115+0000","last_active":"2024-09-17T03:44:37.091331+0000","last_peered":"2024-09-17T03:44:37.091331+0000","last_clean":"2024-09-17T03:44:37.091331+0000","last_became_active":"2024-09-17T03:44:35.515962+0000","last_became_peered":"2024-09-17T03:44:35.515962+0000","last_unstale":"2024-09-17T03:44:37.091331+0000","last_undegraded":"2024-09-17T03:44:37.091331+0000","last_fullsized":"2024-09-17T03:44:37.091331+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:14.022854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"175'4","reported_seq":19,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495904+0000","last_change":"2024-09-17T03:44:34.504463+0000","last_active":"2024-09-17T03:44:36.495904+0000","last_peered":"2024-09-17T03:44:36.495904+0000","last_clean":"2024-09-17T03:44:36.495904+0000","last_became_active":"2024-09-17T03:44:34.504157+0000","last_became_peered":"2024-09-17T03:44:34.504157+0000","last_unstale":"2024-09-17T03:44:36.495904+0000","last_undegraded":"2024-09-17T03:44:36.495904+0000","last_fullsized":"2024-09-17T03:44:36.495904+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:22.218666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495607+0000","last_change":"2024-09-17T03:44:35.501626+0000","last_active":"2024-09-17T03:44:36.495607+0000","last_peered":"2024-09-17T03:44:36.495607+0000","last_clean":"2024-09-17T03:44:36.495607+0000","last_became_active":"2024-09-17T03:44:35.501175+0000","last_became_peered":"2024-09-17T03:44:35.501175+0000","last_unstale":"2024-09-17T03:44:36.495607+0000","last_undegraded":"2024-09-17T03:44:36.495607+0000","last_fullsized":"2024-09-17T03:44:36.495607+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:45.864026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091596+0000","last_change":"2024-09-17T03:44:34.504505+0000","last_active":"2024-09-17T03:44:37.091596+0000","last_peered":"2024-09-17T03:44:37.091596+0000","last_clean":"2024-09-17T03:44:37.091596+0000","last_became_active":"2024-09-17T03:44:34.504196+0000","last_became_peered":"2024-09-17T03:44:34.504196+0000","last_unstale":"2024-09-17T03:44:37.091596+0000","last_undegraded":"2024-09-17T03:44:37.091596+0000","last_fullsized":"2024-09-17T03:44:37.091596+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:24.474885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091469+0000","last_change":"2024-09-17T03:44:35.503935+0000","last_active":"2024-09-17T03:44:37.091469+0000","last_peered":"2024-09-17T03:44:37.091469+0000","last_clean":"2024-09-17T03:44:37.091469+0000","last_became_active":"2024-09-17T03:44:35.503023+0000","last_became_peered":"2024-09-17T03:44:35.503023+0000","last_unstale":"2024-09-17T03:44:37.091469+0000","last_undegraded":"2024-09-17T03:44:37.091469+0000","last_fullsized":"2024-09-17T03:44:37.091469+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:10.739917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.737085+0000","last_change":"2024-09-17T03:44:34.504667+0000","last_active":"2024-09-17T03:44:36.737085+0000","last_peered":"2024-09-17T03:44:36.737085+0000","last_clean":"2024-09-17T03:44:36.737085+0000","last_became_active":"2024-09-17T03:44:34.504379+0000","last_became_peered":"2024-09-17T03:44:34.504379+0000","last_unstale":"2024-09-17T03:44:36.737085+0000","last_undegraded":"2024-09-17T03:44:36.737085+0000","last_fullsized":"2024-09-17T03:44:36.737085+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:12.682497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704463+0000","last_change":"2024-09-17T03:44:35.524639+0000","last_active":"2024-09-17T03:44:36.704463+0000","last_peered":"2024-09-17T03:44:36.704463+0000","last_clean":"2024-09-17T03:44:36.704463+0000","last_became_active":"2024-09-17T03:44:35.523895+0000","last_became_peered":"2024-09-17T03:44:35.523895+0000","last_unstale":"2024-09-17T03:44:36.704463+0000","last_undegraded":"2024-09-17T03:44:36.704463+0000","last_fullsized":"2024-09-17T03:44:36.704463+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:10.381259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560581+0000","last_change":"2024-09-17T03:44:34.508067+0000","last_active":"2024-09-17T03:44:36.560581+0000","last_peered":"2024-09-17T03:44:36.560581+0000","last_clean":"2024-09-17T03:44:36.560581+0000","last_became_active":"2024-09-17T03:44:34.507724+0000","last_became_peered":"2024-09-17T03:44:34.507724+0000","last_unstale":"2024-09-17T03:44:36.560581+0000","last_undegraded":"2024-09-17T03:44:36.560581+0000","last_fullsized":"2024-09-17T03:44:36.560581+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:52.721696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560052+0000","last_change":"2024-09-17T03:44:35.518249+0000","last_active":"2024-09-17T03:44:36.560052+0000","last_peered":"2024-09-17T03:44:36.560052+0000","last_clean":"2024-09-17T03:44:36.560052+0000","last_became_active":"2024-09-17T03:44:35.517928+0000","last_became_peered":"2024-09-17T03:44:35.517928+0000","last_unstale":"2024-09-17T03:44:36.560052+0000","last_undegraded":"2024-09-17T03:44:36.560052+0000","last_fullsized":"2024-09-17T03:44:36.560052+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:46.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.493100+0000","last_change":"2024-09-17T03:44:34.508184+0000","last_active":"2024-09-17T03:44:36.493100+0000","last_peered":"2024-09-17T03:44:36.493100+0000","last_clean":"2024-09-17T03:44:36.493100+0000","last_became_active":"2024-09-17T03:44:34.507648+0000","last_became_peered":"2024-09-17T03:44:34.507648+0000","last_unstale":"2024-09-17T03:44:36.493100+0000","last_undegraded":"2024-09-17T03:44:36.493100+0000","last_fullsized":"2024-09-17T03:44:36.493100+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:45.906545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492571+0000","last_change":"2024-09-17T03:44:35.505629+0000","last_active":"2024-09-17T03:44:36.492571+0000","last_peered":"2024-09-17T03:44:36.492571+0000","last_clean":"2024-09-17T03:44:36.492571+0000","last_became_active":"2024-09-17T03:44:35.505324+0000","last_became_peered":"2024-09-17T03:44:35.505324+0000","last_unstale":"2024-09-17T03:44:36.492571+0000","last_undegraded":"2024-09-17T03:44:36.492571+0000","last_fullsized":"2024-09-17T03:44:36.492571+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:01.846555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492310+0000","last_change":"2024-09-17T03:44:34.508918+0000","last_active":"2024-09-17T03:44:36.492310+0000","last_peered":"2024-09-17T03:44:36.492310+0000","last_clean":"2024-09-17T03:44:36.492310+0000","last_became_active":"2024-09-17T03:44:34.508610+0000","last_became_peered":"2024-09-17T03:44:34.508610+0000","last_unstale":"2024-09-17T03:44:36.492310+0000","last_undegraded":"2024-09-17T03:44:36.492310+0000","last_fullsized":"2024-09-17T03:44:36.492310+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:46.202281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560045+0000","last_change":"2024-09-17T03:44:35.515640+0000","last_active":"2024-09-17T03:44:36.560045+0000","last_peered":"2024-09-17T03:44:36.560045+0000","last_clean":"2024-09-17T03:44:36.560045+0000","last_became_active":"2024-09-17T03:44:35.515192+0000","last_became_peered":"2024-09-17T03:44:35.515192+0000","last_unstale":"2024-09-17T03:44:36.560045+0000","last_undegraded":"2024-09-17T03:44:36.560045+0000","last_fullsized":"2024-09-17T03:44:36.560045+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:30.298955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495492+0000","last_change":"2024-09-17T03:44:34.507308+0000","last_active":"2024-09-17T03:44:36.495492+0000","last_peered":"2024-09-17T03:44:36.495492+0000","last_clean":"2024-09-17T03:44:36.495492+0000","last_became_active":"2024-09-17T03:44:34.506910+0000","last_became_peered":"2024-09-17T03:44:34.506910+0000","last_unstale":"2024-09-17T03:44:36.495492+0000","last_undegraded":"2024-09-17T03:44:36.495492+0000","last_fullsized":"2024-09-17T03:44:36.495492+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:23.781060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560481+0000","last_change":"2024-09-17T03:44:35.512499+0000","last_active":"2024-09-17T03:44:36.560481+0000","last_peered":"2024-09-17T03:44:36.560481+0000","last_clean":"2024-09-17T03:44:36.560481+0000","last_became_active":"2024-09-17T03:44:35.512152+0000","last_became_peered":"2024-09-17T03:44:35.512152+0000","last_unstale":"2024-09-17T03:44:36.560481+0000","last_undegraded":"2024-09-17T03:44:36.560481+0000","last_fullsized":"2024-09-17T03:44:36.560481+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:06.457427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492695+0000","last_change":"2024-09-17T03:44:34.504070+0000","last_active":"2024-09-17T03:44:36.492695+0000","last_peered":"2024-09-17T03:44:36.492695+0000","last_clean":"2024-09-17T03:44:36.492695+0000","last_became_active":"2024-09-17T03:44:34.503697+0000","last_became_peered":"2024-09-17T03:44:34.503697+0000","last_unstale":"2024-09-17T03:44:36.492695+0000","last_undegraded":"2024-09-17T03:44:36.492695+0000","last_fullsized":"2024-09-17T03:44:36.492695+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:19.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736950+0000","last_change":"2024-09-17T03:44:35.505813+0000","last_active":"2024-09-17T03:44:36.736950+0000","last_peered":"2024-09-17T03:44:36.736950+0000","last_clean":"2024-09-17T03:44:36.736950+0000","last_became_active":"2024-09-17T03:44:35.504368+0000","last_became_peered":"2024-09-17T03:44:35.504368+0000","last_unstale":"2024-09-17T03:44:36.736950+0000","last_undegraded":"2024-09-17T03:44:36.736950+0000","last_fullsized":"2024-09-17T03:44:36.736950+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:25.317311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496031+0000","last_change":"2024-09-17T03:44:34.504467+0000","last_active":"2024-09-17T03:44:36.496031+0000","last_peered":"2024-09-17T03:44:36.496031+0000","last_clean":"2024-09-17T03:44:36.496031+0000","last_became_active":"2024-09-17T03:44:34.504157+0000","last_became_peered":"2024-09-17T03:44:34.504157+0000","last_unstale":"2024-09-17T03:44:36.496031+0000","last_undegraded":"2024-09-17T03:44:36.496031+0000","last_fullsized":"2024-09-17T03:44:36.496031+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:45.906545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560514+0000","last_change":"2024-09-17T03:44:35.514270+0000","last_active":"2024-09-17T03:44:36.560514+0000","last_peered":"2024-09-17T03:44:36.560514+0000","last_clean":"2024-09-17T03:44:36.560514+0000","last_became_active":"2024-09-17T03:44:35.513969+0000","last_became_peered":"2024-09-17T03:44:35.513969+0000","last_unstale":"2024-09-17T03:44:36.560514+0000","last_undegraded":"2024-09-17T03:44:36.560514+0000","last_fullsized":"2024-09-17T03:44:36.560514+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:57.611510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"175'3","reported_seq":18,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704588+0000","last_change":"2024-09-17T03:44:34.508692+0000","last_active":"2024-09-17T03:44:36.704588+0000","last_peered":"2024-09-17T03:44:36.704588+0000","last_clean":"2024-09-17T03:44:36.704588+0000","last_became_active":"2024-09-17T03:44:34.508213+0000","last_became_peered":"2024-09-17T03:44:34.508213+0000","last_unstale":"2024-09-17T03:44:36.704588+0000","last_undegraded":"2024-09-17T03:44:36.704588+0000","last_fullsized":"2024-09-17T03:44:36.704588+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:14.238753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091807+0000","last_change":"2024-09-17T03:44:35.506966+0000","last_active":"2024-09-17T03:44:37.091807+0000","last_peered":"2024-09-17T03:44:37.091807+0000","last_clean":"2024-09-17T03:44:37.091807+0000","last_became_active":"2024-09-17T03:44:35.503150+0000","last_became_peered":"2024-09-17T03:44:35.503150+0000","last_unstale":"2024-09-17T03:44:37.091807+0000","last_undegraded":"2024-09-17T03:44:37.091807+0000","last_fullsized":"2024-09-17T03:44:37.091807+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:06.497317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"175'6","reported_seq":21,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560677+0000","last_change":"2024-09-17T03:44:34.506888+0000","last_active":"2024-09-17T03:44:36.560677+0000","last_peered":"2024-09-17T03:44:36.560677+0000","last_clean":"2024-09-17T03:44:36.560677+0000","last_became_active":"2024-09-17T03:44:34.506553+0000","last_became_peered":"2024-09-17T03:44:34.506553+0000","last_unstale":"2024-09-17T03:44:36.560677+0000","last_undegraded":"2024-09-17T03:44:36.560677+0000","last_fullsized":"2024-09-17T03:44:36.560677+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:12.270553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492990+0000","last_change":"2024-09-17T03:44:35.518401+0000","last_active":"2024-09-17T03:44:36.492990+0000","last_peered":"2024-09-17T03:44:36.492990+0000","last_clean":"2024-09-17T03:44:36.492990+0000","last_became_active":"2024-09-17T03:44:35.517803+0000","last_became_peered":"2024-09-17T03:44:35.517803+0000","last_unstale":"2024-09-17T03:44:36.492990+0000","last_undegraded":"2024-09-17T03:44:36.492990+0000","last_fullsized":"2024-09-17T03:44:36.492990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:22.898425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496033+0000","last_change":"2024-09-17T03:44:34.507298+0000","last_active":"2024-09-17T03:44:36.496033+0000","last_peered":"2024-09-17T03:44:36.496033+0000","last_clean":"2024-09-17T03:44:36.496033+0000","last_became_active":"2024-09-17T03:44:34.506960+0000","last_became_peered":"2024-09-17T03:44:34.506960+0000","last_unstale":"2024-09-17T03:44:36.496033+0000","last_undegraded":"2024-09-17T03:44:36.496033+0000","last_fullsized":"2024-09-17T03:44:36.496033+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:45.815093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704386+0000","last_change":"2024-09-17T03:44:35.520707+0000","last_active":"2024-09-17T03:44:36.704386+0000","last_peered":"2024-09-17T03:44:36.704386+0000","last_clean":"2024-09-17T03:44:36.704386+0000","last_became_active":"2024-09-17T03:44:35.520292+0000","last_became_peered":"2024-09-17T03:44:35.520292+0000","last_unstale":"2024-09-17T03:44:36.704386+0000","last_undegraded":"2024-09-17T03:44:36.704386+0000","last_fullsized":"2024-09-17T03:44:36.704386+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:35.032797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496096+0000","last_change":"2024-09-17T03:44:34.500426+0000","last_active":"2024-09-17T03:44:36.496096+0000","last_peered":"2024-09-17T03:44:36.496096+0000","last_clean":"2024-09-17T03:44:36.496096+0000","last_became_active":"2024-09-17T03:44:34.500104+0000","last_became_peered":"2024-09-17T03:44:34.500104+0000","last_unstale":"2024-09-17T03:44:36.496096+0000","last_undegraded":"2024-09-17T03:44:36.496096+0000","last_fullsized":"2024-09-17T03:44:36.496096+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:58.067682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736523+0000","last_change":"2024-09-17T03:44:35.505736+0000","last_active":"2024-09-17T03:44:36.736523+0000","last_peered":"2024-09-17T03:44:36.736523+0000","last_clean":"2024-09-17T03:44:36.736523+0000","last_became_active":"2024-09-17T03:44:35.503782+0000","last_became_peered":"2024-09-17T03:44:35.503782+0000","last_unstale":"2024-09-17T03:44:36.736523+0000","last_undegraded":"2024-09-17T03:44:36.736523+0000","last_fullsized":"2024-09-17T03:44:36.736523+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:42.793594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.703928+0000","last_change":"2024-09-17T03:44:34.506973+0000","last_active":"2024-09-17T03:44:36.703928+0000","last_peered":"2024-09-17T03:44:36.703928+0000","last_clean":"2024-09-17T03:44:36.703928+0000","last_became_active":"2024-09-17T03:44:34.506658+0000","last_became_peered":"2024-09-17T03:44:34.506658+0000","last_unstale":"2024-09-17T03:44:36.703928+0000","last_undegraded":"2024-09-17T03:44:36.703928+0000","last_fullsized":"2024-09-17T03:44:36.703928+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:31.118656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091494+0000","last_change":"2024-09-17T03:44:35.509972+0000","last_active":"2024-09-17T03:44:37.091494+0000","last_peered":"2024-09-17T03:44:37.091494+0000","last_clean":"2024-09-17T03:44:37.091494+0000","last_became_active":"2024-09-17T03:44:35.509645+0000","last_became_peered":"2024-09-17T03:44:35.509645+0000","last_unstale":"2024-09-17T03:44:37.091494+0000","last_undegraded":"2024-09-17T03:44:37.091494+0000","last_fullsized":"2024-09-17T03:44:37.091494+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:56.436755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"175'8","reported_seq":23,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736732+0000","last_change":"2024-09-17T03:44:34.505502+0000","last_active":"2024-09-17T03:44:36.736732+0000","last_peered":"2024-09-17T03:44:36.736732+0000","last_clean":"2024-09-17T03:44:36.736732+0000","last_became_active":"2024-09-17T03:44:34.505206+0000","last_became_peered":"2024-09-17T03:44:34.505206+0000","last_unstale":"2024-09-17T03:44:36.736732+0000","last_undegraded":"2024-09-17T03:44:36.736732+0000","last_fullsized":"2024-09-17T03:44:36.736732+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:22.213850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091511+0000","last_change":"2024-09-17T03:44:35.507591+0000","last_active":"2024-09-17T03:44:37.091511+0000","last_peered":"2024-09-17T03:44:37.091511+0000","last_clean":"2024-09-17T03:44:37.091511+0000","last_became_active":"2024-09-17T03:44:35.507301+0000","last_became_peered":"2024-09-17T03:44:35.507301+0000","last_unstale":"2024-09-17T03:44:37.091511+0000","last_undegraded":"2024-09-17T03:44:37.091511+0000","last_fullsized":"2024-09-17T03:44:37.091511+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:31.039012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492795+0000","last_change":"2024-09-17T03:44:34.507954+0000","last_active":"2024-09-17T03:44:36.492795+0000","last_peered":"2024-09-17T03:44:36.492795+0000","last_clean":"2024-09-17T03:44:36.492795+0000","last_became_active":"2024-09-17T03:44:34.507591+0000","last_became_peered":"2024-09-17T03:44:34.507591+0000","last_unstale":"2024-09-17T03:44:36.492795+0000","last_undegraded":"2024-09-17T03:44:36.492795+0000","last_fullsized":"2024-09-17T03:44:36.492795+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:38.758785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091406+0000","last_change":"2024-09-17T03:44:35.515476+0000","last_active":"2024-09-17T03:44:37.091406+0000","last_peered":"2024-09-17T03:44:37.091406+0000","last_clean":"2024-09-17T03:44:37.091406+0000","last_became_active":"2024-09-17T03:44:35.514206+0000","last_became_peered":"2024-09-17T03:44:35.514206+0000","last_unstale":"2024-09-17T03:44:37.091406+0000","last_undegraded":"2024-09-17T03:44:37.091406+0000","last_fullsized":"2024-09-17T03:44:37.091406+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:37.648386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091604+0000","last_change":"2024-09-17T03:44:34.510346+0000","last_active":"2024-09-17T03:44:37.091604+0000","last_peered":"2024-09-17T03:44:37.091604+0000","last_clean":"2024-09-17T03:44:37.091604+0000","last_became_active":"2024-09-17T03:44:34.510051+0000","last_became_peered":"2024-09-17T03:44:34.510051+0000","last_unstale":"2024-09-17T03:44:37.091604+0000","last_undegraded":"2024-09-17T03:44:37.091604+0000","last_fullsized":"2024-09-17T03:44:37.091604+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:23.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736741+0000","last_change":"2024-09-17T03:44:35.511999+0000","last_active":"2024-09-17T03:44:36.736741+0000","last_peered":"2024-09-17T03:44:36.736741+0000","last_clean":"2024-09-17T03:44:36.736741+0000","last_became_active":"2024-09-17T03:44:35.511709+0000","last_became_peered":"2024-09-17T03:44:35.511709+0000","last_unstale":"2024-09-17T03:44:36.736741+0000","last_undegraded":"2024-09-17T03:44:36.736741+0000","last_fullsized":"2024-09-17T03:44:36.736741+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:31.963884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704615+0000","last_change":"2024-09-17T03:44:34.509125+0000","last_active":"2024-09-17T03:44:36.704615+0000","last_peered":"2024-09-17T03:44:36.704615+0000","last_clean":"2024-09-17T03:44:36.704615+0000","last_became_active":"2024-09-17T03:44:34.507891+0000","last_became_peered":"2024-09-17T03:44:34.507891+0000","last_unstale":"2024-09-17T03:44:36.704615+0000","last_undegraded":"2024-09-17T03:44:36.704615+0000","last_fullsized":"2024-09-17T03:44:36.704615+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:06.654036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704396+0000","last_change":"2024-09-17T03:44:35.513414+0000","last_active":"2024-09-17T03:44:36.704396+0000","last_peered":"2024-09-17T03:44:36.704396+0000","last_clean":"2024-09-17T03:44:36.704396+0000","last_became_active":"2024-09-17T03:44:35.513121+0000","last_became_peered":"2024-09-17T03:44:35.513121+0000","last_unstale":"2024-09-17T03:44:36.704396+0000","last_undegraded":"2024-09-17T03:44:36.704396+0000","last_fullsized":"2024-09-17T03:44:36.704396+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:51.926469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736934+0000","last_change":"2024-09-17T03:44:34.508494+0000","last_active":"2024-09-17T03:44:36.736934+0000","last_peered":"2024-09-17T03:44:36.736934+0000","last_clean":"2024-09-17T03:44:36.736934+0000","last_became_active":"2024-09-17T03:44:34.508171+0000","last_became_peered":"2024-09-17T03:44:34.508171+0000","last_unstale":"2024-09-17T03:44:36.736934+0000","last_undegraded":"2024-09-17T03:44:36.736934+0000","last_fullsized":"2024-09-17T03:44:36.736934+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:22.342508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704363+0000","last_change":"2024-09-17T03:44:35.517037+0000","last_active":"2024-09-17T03:44:36.704363+0000","last_peered":"2024-09-17T03:44:36.704363+0000","last_clean":"2024-09-17T03:44:36.704363+0000","last_became_active":"2024-09-17T03:44:35.516713+0000","last_became_peered":"2024-09-17T03:44:35.516713+0000","last_unstale":"2024-09-17T03:44:36.704363+0000","last_undegraded":"2024-09-17T03:44:36.704363+0000","last_fullsized":"2024-09-17T03:44:36.704363+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:16.789412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704298+0000","last_change":"2024-09-17T03:44:34.507042+0000","last_active":"2024-09-17T03:44:36.704298+0000","last_peered":"2024-09-17T03:44:36.704298+0000","last_clean":"2024-09-17T03:44:36.704298+0000","last_became_active":"2024-09-17T03:44:34.506712+0000","last_became_peered":"2024-09-17T03:44:34.506712+0000","last_unstale":"2024-09-17T03:44:36.704298+0000","last_undegraded":"2024-09-17T03:44:36.704298+0000","last_fullsized":"2024-09-17T03:44:36.704298+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:34.767116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736689+0000","last_change":"2024-09-17T03:44:35.506088+0000","last_active":"2024-09-17T03:44:36.736689+0000","last_peered":"2024-09-17T03:44:36.736689+0000","last_clean":"2024-09-17T03:44:36.736689+0000","last_became_active":"2024-09-17T03:44:35.505780+0000","last_became_peered":"2024-09-17T03:44:35.505780+0000","last_unstale":"2024-09-17T03:44:36.736689+0000","last_undegraded":"2024-09-17T03:44:36.736689+0000","last_fullsized":"2024-09-17T03:44:36.736689+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:41.789994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091870+0000","last_change":"2024-09-17T03:44:34.504134+0000","last_active":"2024-09-17T03:44:37.091870+0000","last_peered":"2024-09-17T03:44:37.091870+0000","last_clean":"2024-09-17T03:44:37.091870+0000","last_became_active":"2024-09-17T03:44:34.503719+0000","last_became_peered":"2024-09-17T03:44:34.503719+0000","last_unstale":"2024-09-17T03:44:37.091870+0000","last_undegraded":"2024-09-17T03:44:37.091870+0000","last_fullsized":"2024-09-17T03:44:37.091870+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:15.619123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091143+0000","last_change":"2024-09-17T03:44:35.506822+0000","last_active":"2024-09-17T03:44:37.091143+0000","last_peered":"2024-09-17T03:44:37.091143+0000","last_clean":"2024-09-17T03:44:37.091143+0000","last_became_active":"2024-09-17T03:44:35.506454+0000","last_became_peered":"2024-09-17T03:44:35.506454+0000","last_unstale":"2024-09-17T03:44:37.091143+0000","last_undegraded":"2024-09-17T03:44:37.091143+0000","last_fullsized":"2024-09-17T03:44:37.091143+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:13.279683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091520+0000","last_change":"2024-09-17T03:44:34.499354+0000","last_active":"2024-09-17T03:44:37.091520+0000","last_peered":"2024-09-17T03:44:37.091520+0000","last_clean":"2024-09-17T03:44:37.091520+0000","last_became_active":"2024-09-17T03:44:34.498887+0000","last_became_peered":"2024-09-17T03:44:34.498887+0000","last_unstale":"2024-09-17T03:44:37.091520+0000","last_undegraded":"2024-09-17T03:44:37.091520+0000","last_fullsized":"2024-09-17T03:44:37.091520+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496525+0000","last_change":"2024-09-17T03:44:35.503472+0000","last_active":"2024-09-17T03:44:36.496525+0000","last_peered":"2024-09-17T03:44:36.496525+0000","last_clean":"2024-09-17T03:44:36.496525+0000","last_became_active":"2024-09-17T03:44:35.502874+0000","last_became_peered":"2024-09-17T03:44:35.502874+0000","last_unstale":"2024-09-17T03:44:36.496525+0000","last_undegraded":"2024-09-17T03:44:36.496525+0000","last_fullsized":"2024-09-17T03:44:36.496525+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:10.937538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492554+0000","last_change":"2024-09-17T03:44:34.510288+0000","last_active":"2024-09-17T03:44:36.492554+0000","last_peered":"2024-09-17T03:44:36.492554+0000","last_clean":"2024-09-17T03:44:36.492554+0000","last_became_active":"2024-09-17T03:44:34.509945+0000","last_became_peered":"2024-09-17T03:44:34.509945+0000","last_unstale":"2024-09-17T03:44:36.492554+0000","last_undegraded":"2024-09-17T03:44:36.492554+0000","last_fullsized":"2024-09-17T03:44:36.492554+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:42.238194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495656+0000","last_change":"2024-09-17T03:44:35.511600+0000","last_active":"2024-09-17T03:44:36.495656+0000","last_peered":"2024-09-17T03:44:36.495656+0000","last_clean":"2024-09-17T03:44:36.495656+0000","last_became_active":"2024-09-17T03:44:35.511281+0000","last_became_peered":"2024-09-17T03:44:35.511281+0000","last_unstale":"2024-09-17T03:44:36.495656+0000","last_undegraded":"2024-09-17T03:44:36.495656+0000","last_fullsized":"2024-09-17T03:44:36.495656+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:12.015745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736905+0000","last_change":"2024-09-17T03:44:34.504336+0000","last_active":"2024-09-17T03:44:36.736905+0000","last_peered":"2024-09-17T03:44:36.736905+0000","last_clean":"2024-09-17T03:44:36.736905+0000","last_became_active":"2024-09-17T03:44:34.504005+0000","last_became_peered":"2024-09-17T03:44:34.504005+0000","last_unstale":"2024-09-17T03:44:36.736905+0000","last_undegraded":"2024-09-17T03:44:36.736905+0000","last_fullsized":"2024-09-17T03:44:36.736905+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:09.876455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.092117+0000","last_change":"2024-09-17T03:44:35.509517+0000","last_active":"2024-09-17T03:44:37.092117+0000","last_peered":"2024-09-17T03:44:37.092117+0000","last_clean":"2024-09-17T03:44:37.092117+0000","last_became_active":"2024-09-17T03:44:35.508452+0000","last_became_peered":"2024-09-17T03:44:35.508452+0000","last_unstale":"2024-09-17T03:44:37.092117+0000","last_undegraded":"2024-09-17T03:44:37.092117+0000","last_fullsized":"2024-09-17T03:44:37.092117+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:15.431678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"176'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560345+0000","last_change":"2024-09-17T03:44:34.506730+0000","last_active":"2024-09-17T03:44:36.560345+0000","last_peered":"2024-09-17T03:44:36.560345+0000","last_clean":"2024-09-17T03:44:36.560345+0000","last_became_active":"2024-09-17T03:44:34.506425+0000","last_became_peered":"2024-09-17T03:44:34.506425+0000","last_unstale":"2024-09-17T03:44:36.560345+0000","last_undegraded":"2024-09-17T03:44:36.560345+0000","last_fullsized":"2024-09-17T03:44:36.560345+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:52.461258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091119+0000","last_change":"2024-09-17T03:44:35.514014+0000","last_active":"2024-09-17T03:44:37.091119+0000","last_peered":"2024-09-17T03:44:37.091119+0000","last_clean":"2024-09-17T03:44:37.091119+0000","last_became_active":"2024-09-17T03:44:35.513696+0000","last_became_peered":"2024-09-17T03:44:35.513696+0000","last_unstale":"2024-09-17T03:44:37.091119+0000","last_undegraded":"2024-09-17T03:44:37.091119+0000","last_fullsized":"2024-09-17T03:44:37.091119+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:37.810185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492744+0000","last_change":"2024-09-17T03:44:34.507786+0000","last_active":"2024-09-17T03:44:36.492744+0000","last_peered":"2024-09-17T03:44:36.492744+0000","last_clean":"2024-09-17T03:44:36.492744+0000","last_became_active":"2024-09-17T03:44:34.506839+0000","last_became_peered":"2024-09-17T03:44:34.506839+0000","last_unstale":"2024-09-17T03:44:36.492744+0000","last_undegraded":"2024-09-17T03:44:36.492744+0000","last_fullsized":"2024-09-17T03:44:36.492744+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:55.162172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496397+0000","last_change":"2024-09-17T03:44:35.497407+0000","last_active":"2024-09-17T03:44:36.496397+0000","last_peered":"2024-09-17T03:44:36.496397+0000","last_clean":"2024-09-17T03:44:36.496397+0000","last_became_active":"2024-09-17T03:44:35.497085+0000","last_became_peered":"2024-09-17T03:44:35.497085+0000","last_unstale":"2024-09-17T03:44:36.496397+0000","last_undegraded":"2024-09-17T03:44:36.496397+0000","last_fullsized":"2024-09-17T03:44:36.496397+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:38.802645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736939+0000","last_change":"2024-09-17T03:44:34.504327+0000","last_active":"2024-09-17T03:44:36.736939+0000","last_peered":"2024-09-17T03:44:36.736939+0000","last_clean":"2024-09-17T03:44:36.736939+0000","last_became_active":"2024-09-17T03:44:34.504030+0000","last_became_peered":"2024-09-17T03:44:34.504030+0000","last_unstale":"2024-09-17T03:44:36.736939+0000","last_undegraded":"2024-09-17T03:44:36.736939+0000","last_fullsized":"2024-09-17T03:44:36.736939+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:38.341868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091683+0000","last_change":"2024-09-17T03:44:35.506474+0000","last_active":"2024-09-17T03:44:37.091683+0000","last_peered":"2024-09-17T03:44:37.091683+0000","last_clean":"2024-09-17T03:44:37.091683+0000","last_became_active":"2024-09-17T03:44:35.503283+0000","last_became_peered":"2024-09-17T03:44:35.503283+0000","last_unstale":"2024-09-17T03:44:37.091683+0000","last_undegraded":"2024-09-17T03:44:37.091683+0000","last_fullsized":"2024-09-17T03:44:37.091683+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:43.220358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560307+0000","last_change":"2024-09-17T03:44:34.512828+0000","last_active":"2024-09-17T03:44:36.560307+0000","last_peered":"2024-09-17T03:44:36.560307+0000","last_clean":"2024-09-17T03:44:36.560307+0000","last_became_active":"2024-09-17T03:44:34.512469+0000","last_became_peered":"2024-09-17T03:44:34.512469+0000","last_unstale":"2024-09-17T03:44:36.560307+0000","last_undegraded":"2024-09-17T03:44:36.560307+0000","last_fullsized":"2024-09-17T03:44:36.560307+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:48.427101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496486+0000","last_change":"2024-09-17T03:44:35.517753+0000","last_active":"2024-09-17T03:44:36.496486+0000","last_peered":"2024-09-17T03:44:36.496486+0000","last_clean":"2024-09-17T03:44:36.496486+0000","last_became_active":"2024-09-17T03:44:35.517073+0000","last_became_peered":"2024-09-17T03:44:35.517073+0000","last_unstale":"2024-09-17T03:44:36.496486+0000","last_undegraded":"2024-09-17T03:44:36.496486+0000","last_fullsized":"2024-09-17T03:44:36.496486+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:17.733361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.493143+0000","last_change":"2024-09-17T03:44:34.508966+0000","last_active":"2024-09-17T03:44:36.493143+0000","last_peered":"2024-09-17T03:44:36.493143+0000","last_clean":"2024-09-17T03:44:36.493143+0000","last_became_active":"2024-09-17T03:44:34.508648+0000","last_became_peered":"2024-09-17T03:44:34.508648+0000","last_unstale":"2024-09-17T03:44:36.493143+0000","last_undegraded":"2024-09-17T03:44:36.493143+0000","last_fullsized":"2024-09-17T03:44:36.493143+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:53.757515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736588+0000","last_change":"2024-09-17T03:44:35.505100+0000","last_active":"2024-09-17T03:44:36.736588+0000","last_peered":"2024-09-17T03:44:36.736588+0000","last_clean":"2024-09-17T03:44:36.736588+0000","last_became_active":"2024-09-17T03:44:35.503366+0000","last_became_peered":"2024-09-17T03:44:35.503366+0000","last_unstale":"2024-09-17T03:44:36.736588+0000","last_undegraded":"2024-09-17T03:44:36.736588+0000","last_fullsized":"2024-09-17T03:44:36.736588+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:14.432674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496211+0000","last_change":"2024-09-17T03:44:34.503673+0000","last_active":"2024-09-17T03:44:36.496211+0000","last_peered":"2024-09-17T03:44:36.496211+0000","last_clean":"2024-09-17T03:44:36.496211+0000","last_became_active":"2024-09-17T03:44:34.503331+0000","last_became_peered":"2024-09-17T03:44:34.503331+0000","last_unstale":"2024-09-17T03:44:36.496211+0000","last_undegraded":"2024-09-17T03:44:36.496211+0000","last_fullsized":"2024-09-17T03:44:36.496211+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:53.757515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091048+0000","last_change":"2024-09-17T03:44:35.508733+0000","last_active":"2024-09-17T03:44:37.091048+0000","last_peered":"2024-09-17T03:44:37.091048+0000","last_clean":"2024-09-17T03:44:37.091048+0000","last_became_active":"2024-09-17T03:44:35.508398+0000","last_became_peered":"2024-09-17T03:44:35.508398+0000","last_unstale":"2024-09-17T03:44:37.091048+0000","last_undegraded":"2024-09-17T03:44:37.091048+0000","last_fullsized":"2024-09-17T03:44:37.091048+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496570+0000","last_change":"2024-09-17T03:44:34.500723+0000","last_active":"2024-09-17T03:44:36.496570+0000","last_peered":"2024-09-17T03:44:36.496570+0000","last_clean":"2024-09-17T03:44:36.496570+0000","last_became_active":"2024-09-17T03:44:34.500367+0000","last_became_peered":"2024-09-17T03:44:34.500367+0000","last_unstale":"2024-09-17T03:44:36.496570+0000","last_undegraded":"2024-09-17T03:44:36.496570+0000","last_fullsized":"2024-09-17T03:44:36.496570+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:34.083730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091453+0000","last_change":"2024-09-17T03:44:35.501366+0000","last_active":"2024-09-17T03:44:37.091453+0000","last_peered":"2024-09-17T03:44:37.091453+0000","last_clean":"2024-09-17T03:44:37.091453+0000","last_became_active":"2024-09-17T03:44:35.500193+0000","last_became_peered":"2024-09-17T03:44:35.500193+0000","last_unstale":"2024-09-17T03:44:37.091453+0000","last_undegraded":"2024-09-17T03:44:37.091453+0000","last_fullsized":"2024-09-17T03:44:37.091453+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:43.710871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496716+0000","last_change":"2024-09-17T03:44:34.508290+0000","last_active":"2024-09-17T03:44:36.496716+0000","last_peered":"2024-09-17T03:44:36.496716+0000","last_clean":"2024-09-17T03:44:36.496716+0000","last_became_active":"2024-09-17T03:44:34.507990+0000","last_became_peered":"2024-09-17T03:44:34.507990+0000","last_unstale":"2024-09-17T03:44:36.496716+0000","last_undegraded":"2024-09-17T03:44:36.496716+0000","last_fullsized":"2024-09-17T03:44:36.496716+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:09.176398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":394,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560164+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:44:36.560164+0000","last_peered":"2024-09-17T03:44:36.560164+0000","last_clean":"2024-09-17T03:44:36.560164+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:44:36.560164+0000","last_undegraded":"2024-09-17T03:44:36.560164+0000","last_fullsized":"2024-09-17T03:44:36.560164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509586,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60308,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311532,"statfs":{"total":96636764160,"available":96575008768,"internally_reserved":0,"allocated":2818048,"data_stored":1565640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509586,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59720,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312120,"statfs":{"total":96636764160,"available":96575610880,"internally_reserved":0,"allocated":2215936,"data_stored":974242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509586,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65248,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306592,"statfs":{"total":96636764160,"available":96569950208,"internally_reserved":0,"allocated":2232320,"data_stored":975376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509586,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55556,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316284,"statfs":{"total":96636764160,"available":96579874816,"internally_reserved":0,"allocated":2211840,"data_stored":973660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509587,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2220032,"data_stored":973716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509587,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56140,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315700,"statfs":{"total":96636764160,"available":96579276800,"internally_reserved":0,"allocated":2809856,"data_stored":1564118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55568,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316272,"statfs":{"total":96636764160,"available":96579862528,"internally_reserved":0,"allocated":2215936,"data_stored":974242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55572,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316268,"statfs":{"total":96636764160,"available":96579858432,"internally_reserved":0,"allocated":2224128,"data_stored":973842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:44:40.230 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:44:40.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.378+0000 7efffe64a640 1 -- 172.21.15.146:0/3965278267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff8071120 msgr2=0x7efff80b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.378+0000 7efffe64a640 1 --2- 172.21.15.146:0/3965278267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff8071120 0x7efff80b4530 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7efff8072fa0 tx=0x7effec02a530 comp rx=0 tx=0).stop 2024-09-17T03:44:40.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.378+0000 7efffe64a640 1 -- 172.21.15.146:0/3965278267 shutdown_connections 2024-09-17T03:44:40.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.378+0000 7efffe64a640 1 --2- 172.21.15.146:0/3965278267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff8071120 0x7efff80b4530 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.378+0000 7efffe64a640 1 --2- 172.21.15.146:0/3965278267 >> v2:172.21.15.179:3300/0 conn(0x7efff80b55f0 0x7efff8070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.378+0000 7efffe64a640 1 -- 172.21.15.146:0/3965278267 >> 172.21.15.146:0/3965278267 conn(0x7efff80b3410 msgr2=0x7efff80b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:40.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.378+0000 7efffe64a640 1 -- 172.21.15.146:0/3965278267 shutdown_connections 2024-09-17T03:44:40.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.378+0000 7efffe64a640 1 -- 172.21.15.146:0/3965278267 wait complete. 2024-09-17T03:44:40.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.380+0000 7efffe64a640 1 Processor -- start 2024-09-17T03:44:40.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.380+0000 7efffe64a640 1 -- start start 2024-09-17T03:44:40.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efffe64a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff8071120 0x7efff8154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efffe64a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff80b4a70 0x7efff813da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efffe64a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff80b55f0 0x7efff813df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efffe64a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efff815bd10 con 0x7efff80b4a70 2024-09-17T03:44:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efffe64a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efff806e680 con 0x7efff8071120 2024-09-17T03:44:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efffe64a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efff815be90 con 0x7efff80b55f0 2024-09-17T03:44:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff80b4a70 0x7efff813da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff80b4a70 0x7efff813da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48124/0 (socket says 172.21.15.146:48124) 2024-09-17T03:44:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff77fe640 1 -- 172.21.15.146:0/1088938940 learned_addr learned my addr 172.21.15.146:0/1088938940 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff7fff640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff8071120 0x7efff8154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efffcbe7640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff80b55f0 0x7efff813df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff77fe640 1 -- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff80b55f0 msgr2=0x7efff813df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff77fe640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff80b55f0 0x7efff813df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff77fe640 1 -- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff8071120 msgr2=0x7efff8154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff77fe640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff8071120 0x7efff8154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff77fe640 1 -- 172.21.15.146:0/1088938940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff81f6790 con 0x7efff80b4a70 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efffcbe7640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff80b55f0 0x7efff813df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff77fe640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff80b4a70 0x7efff813da40 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7effec009780 tx=0x7effec033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff4ff9640 1 -- 172.21.15.146:0/1088938940 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec031d60 con 0x7efff80b4a70 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efff4ff9640 1 -- 172.21.15.146:0/1088938940 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effec033e10 con 0x7efff80b4a70 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.382+0000 7efffe64a640 1 -- 172.21.15.146:0/1088938940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff8141d60 con 0x7efff80b4a70 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.383+0000 7efff4ff9640 1 -- 172.21.15.146:0/1088938940 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec005260 con 0x7efff80b4a70 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.383+0000 7efffe64a640 1 -- 172.21.15.146:0/1088938940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff8142320 con 0x7efff80b4a70 2024-09-17T03:44:40.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.384+0000 7efffe64a640 1 -- 172.21.15.146:0/1088938940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff80b4530 con 0x7efff80b4a70 2024-09-17T03:44:40.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.384+0000 7efff4ff9640 1 -- 172.21.15.146:0/1088938940 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7effec005400 con 0x7efff80b4a70 2024-09-17T03:44:40.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.385+0000 7efff4ff9640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078bc0 0x7effe407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.385+0000 7efff4ff9640 1 -- 172.21.15.146:0/1088938940 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7effec0bbdb0 con 0x7efff80b4a70 2024-09-17T03:44:40.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.385+0000 7efff7fff640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078bc0 0x7effe407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.386+0000 7efff7fff640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078bc0 0x7effe407b0d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7effe8009b30 tx=0x7effe8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.390+0000 7efff4ff9640 1 -- 172.21.15.146:0/1088938940 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7effec03f030 con 0x7efff80b4a70 2024-09-17T03:44:40.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.635+0000 7efffe64a640 1 -- 172.21.15.146:0/1088938940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7efff8141b10 con 0x7efff80b4a70 2024-09-17T03:44:40.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.636+0000 7efff4ff9640 1 -- 172.21.15.146:0/1088938940 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1351 (secure 0 0 0) 0x7effec083b90 con 0x7efff80b4a70 2024-09-17T03:44:40.636 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:40.636 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":725,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":176,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":479068160,"bytes_avail":772615045120,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":136,"btime":"2024-09-17T03:44:38:513917+0000","id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"a","status":"up:active","gid":10671}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":33,"modified":"2024-09-17T03:44:23.973008+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:44:40.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 -- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078bc0 msgr2=0x7effe407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078bc0 0x7effe407b0d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7effe8009b30 tx=0x7effe8005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:40.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 -- 172.21.15.146:0/1088938940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff80b4a70 msgr2=0x7efff813da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff80b4a70 0x7efff813da40 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7effec009780 tx=0x7effec033c20 comp rx=0 tx=0).stop 2024-09-17T03:44:40.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 -- 172.21.15.146:0/1088938940 shutdown_connections 2024-09-17T03:44:40.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effe4078bc0 0x7effe407b0d0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efff80b55f0 0x7efff813df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efff80b4a70 0x7efff813da40 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 --2- 172.21.15.146:0/1088938940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efff8071120 0x7efff8154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 -- 172.21.15.146:0/1088938940 >> 172.21.15.146:0/1088938940 conn(0x7efff80b3410 msgr2=0x7efff806dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:40.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 -- 172.21.15.146:0/1088938940 shutdown_connections 2024-09-17T03:44:40.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.638+0000 7efffe64a640 1 -- 172.21.15.146:0/1088938940 wait complete. 2024-09-17T03:44:40.650 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:44:40.651 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:44:40.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.763+0000 7f56fff13640 1 -- 172.21.15.146:0/706643138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56f80b3b60 msgr2=0x7f56f815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.763+0000 7f56fff13640 1 --2- 172.21.15.146:0/706643138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56f80b3b60 0x7f56f815caa0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f56f0005fd0 tx=0x7f56f002aa90 comp rx=0 tx=0).stop 2024-09-17T03:44:40.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.763+0000 7f56fff13640 1 -- 172.21.15.146:0/706643138 shutdown_connections 2024-09-17T03:44:40.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.763+0000 7f56fff13640 1 --2- 172.21.15.146:0/706643138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56f80b3b60 0x7f56f815caa0 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.763+0000 7f56fff13640 1 --2- 172.21.15.146:0/706643138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56f80b5750 0x7f56f80b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.763+0000 7f56fff13640 1 -- 172.21.15.146:0/706643138 >> 172.21.15.146:0/706643138 conn(0x7f56f80b7b20 msgr2=0x7f56f809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:40.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.763+0000 7f56fff13640 1 -- 172.21.15.146:0/706643138 shutdown_connections 2024-09-17T03:44:40.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.763+0000 7f56fff13640 1 -- 172.21.15.146:0/706643138 wait complete. 2024-09-17T03:44:40.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.765+0000 7f56fff13640 1 Processor -- start 2024-09-17T03:44:40.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.765+0000 7f56fff13640 1 -- start start 2024-09-17T03:44:40.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.766+0000 7f56fff13640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56f80b3b60 0x7f56f814e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.766+0000 7f56fff13640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56f80b5750 0x7f56f8151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.766+0000 7f56fff13640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56f80b5ce0 0x7f56f81f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.766+0000 7f56fff13640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f56f815d460 con 0x7f56f80b3b60 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.766+0000 7f56fff13640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f56f815d2e0 con 0x7f56f80b5750 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.766+0000 7f56fff13640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f56f815d5e0 con 0x7f56f80b5ce0 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.766+0000 7f56fdcaf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56f80b3b60 0x7f56f814e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.766+0000 7f56fdcaf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56f80b3b60 0x7f56f814e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48154/0 (socket says 172.21.15.146:48154) 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.766+0000 7f56fdcaf640 1 -- 172.21.15.146:0/830914723 learned_addr learned my addr 172.21.15.146:0/830914723 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56fd4ae640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56f80b5750 0x7f56f8151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56fe4b0640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56f80b5ce0 0x7f56f81f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56fdcaf640 1 -- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56f80b5ce0 msgr2=0x7f56f81f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56fdcaf640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56f80b5ce0 0x7f56f81f3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56fdcaf640 1 -- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56f80b5750 msgr2=0x7f56f8151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56fdcaf640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56f80b5750 0x7f56f8151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56fdcaf640 1 -- 172.21.15.146:0/830914723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f81508e0 con 0x7f56f80b3b60 2024-09-17T03:44:40.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56fd4ae640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56f80b5750 0x7f56f8151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:40.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56fdcaf640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56f80b3b60 0x7f56f814e050 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f56f400c3d0 tx=0x7f56f400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:40.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56ee7fc640 1 -- 172.21.15.146:0/830914723 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4017070 con 0x7f56f80b3b60 2024-09-17T03:44:40.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56ee7fc640 1 -- 172.21.15.146:0/830914723 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56f40053c0 con 0x7f56f80b3b60 2024-09-17T03:44:40.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56fff13640 1 -- 172.21.15.146:0/830914723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f814e590 con 0x7f56f80b3b60 2024-09-17T03:44:40.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56ee7fc640 1 -- 172.21.15.146:0/830914723 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4003850 con 0x7f56f80b3b60 2024-09-17T03:44:40.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.767+0000 7f56fff13640 1 -- 172.21.15.146:0/830914723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f8150e90 con 0x7f56f80b3b60 2024-09-17T03:44:40.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.768+0000 7f56fff13640 1 -- 172.21.15.146:0/830914723 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f815c500 con 0x7f56f80b3b60 2024-09-17T03:44:40.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.769+0000 7f56ee7fc640 1 -- 172.21.15.146:0/830914723 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f56f401a070 con 0x7f56f80b3b60 2024-09-17T03:44:40.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.769+0000 7f56ee7fc640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56dc078b90 0x7f56dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:40.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.769+0000 7f56ee7fc640 1 -- 172.21.15.146:0/830914723 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f56f409a0b0 con 0x7f56f80b3b60 2024-09-17T03:44:40.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.770+0000 7f56fd4ae640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56dc078b90 0x7f56dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:40.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.770+0000 7f56fd4ae640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56dc078b90 0x7f56dc07b0a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f56f81501a0 tx=0x7f56e8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.774+0000 7f56ee7fc640 1 -- 172.21.15.146:0/830914723 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f56f815c500 con 0x7f56f80b3b60 2024-09-17T03:44:40.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.945+0000 7f56fff13640 1 -- 172.21.15.146:0/830914723 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56f8156280 con 0x7f56dc078b90 2024-09-17T03:44:40.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.950+0000 7f56ee7fc640 1 -- 172.21.15.146:0/830914723 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252477 (secure 0 0 0) 0x7f56f8156280 con 0x7f56dc078b90 2024-09-17T03:44:40.953 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:40.954 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:44:40.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 -- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56dc078b90 msgr2=0x7f56dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56dc078b90 0x7f56dc07b0a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f56f81501a0 tx=0x7f56e8005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 -- 172.21.15.146:0/830914723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56f80b3b60 msgr2=0x7f56f814e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56f80b3b60 0x7f56f814e050 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f56f400c3d0 tx=0x7f56f400c890 comp rx=0 tx=0).stop 2024-09-17T03:44:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 -- 172.21.15.146:0/830914723 shutdown_connections 2024-09-17T03:44:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f56dc078b90 0x7f56dc07b0a0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f56f80b5ce0 0x7f56f81f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f56f80b5750 0x7f56f8151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 --2- 172.21.15.146:0/830914723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56f80b3b60 0x7f56f814e050 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 -- 172.21.15.146:0/830914723 >> 172.21.15.146:0/830914723 conn(0x7f56f80b7b20 msgr2=0x7f56f815b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 -- 172.21.15.146:0/830914723 shutdown_connections 2024-09-17T03:44:40.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:40.953+0000 7f56fff13640 1 -- 172.21.15.146:0/830914723 wait complete. 2024-09-17T03:44:40.965 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":526,"stamp":"2024-09-17T03:44:39.977080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":467840,"kb_used_data":18504,"kb_used_omap":12,"kb_used_meta":449139,"kb_avail":754506880,"statfs":{"total":773094113280,"available":772615045120,"internally_reserved":0,"allocated":18948096,"data_stored":8974836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":459918897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001718"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091840+0000","last_change":"2024-09-17T03:44:35.501652+0000","last_active":"2024-09-17T03:44:37.091840+0000","last_peered":"2024-09-17T03:44:37.091840+0000","last_clean":"2024-09-17T03:44:37.091840+0000","last_became_active":"2024-09-17T03:44:35.501332+0000","last_became_peered":"2024-09-17T03:44:35.501332+0000","last_unstale":"2024-09-17T03:44:37.091840+0000","last_undegraded":"2024-09-17T03:44:37.091840+0000","last_fullsized":"2024-09-17T03:44:37.091840+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:53.854135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091399+0000","last_change":"2024-09-17T03:44:35.511226+0000","last_active":"2024-09-17T03:44:37.091399+0000","last_peered":"2024-09-17T03:44:37.091399+0000","last_clean":"2024-09-17T03:44:37.091399+0000","last_became_active":"2024-09-17T03:44:35.510919+0000","last_became_peered":"2024-09-17T03:44:35.510919+0000","last_unstale":"2024-09-17T03:44:37.091399+0000","last_undegraded":"2024-09-17T03:44:37.091399+0000","last_fullsized":"2024-09-17T03:44:37.091399+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:13.140658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736901+0000","last_change":"2024-09-17T03:44:35.505142+0000","last_active":"2024-09-17T03:44:36.736901+0000","last_peered":"2024-09-17T03:44:36.736901+0000","last_clean":"2024-09-17T03:44:36.736901+0000","last_became_active":"2024-09-17T03:44:35.503630+0000","last_became_peered":"2024-09-17T03:44:35.503630+0000","last_unstale":"2024-09-17T03:44:36.736901+0000","last_undegraded":"2024-09-17T03:44:36.736901+0000","last_fullsized":"2024-09-17T03:44:36.736901+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:32.237378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560359+0000","last_change":"2024-09-17T03:44:35.516826+0000","last_active":"2024-09-17T03:44:36.560359+0000","last_peered":"2024-09-17T03:44:36.560359+0000","last_clean":"2024-09-17T03:44:36.560359+0000","last_became_active":"2024-09-17T03:44:35.516467+0000","last_became_peered":"2024-09-17T03:44:35.516467+0000","last_unstale":"2024-09-17T03:44:36.560359+0000","last_undegraded":"2024-09-17T03:44:36.560359+0000","last_fullsized":"2024-09-17T03:44:36.560359+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:06.727326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492653+0000","last_change":"2024-09-17T03:44:35.517344+0000","last_active":"2024-09-17T03:44:36.492653+0000","last_peered":"2024-09-17T03:44:36.492653+0000","last_clean":"2024-09-17T03:44:36.492653+0000","last_became_active":"2024-09-17T03:44:35.516994+0000","last_became_peered":"2024-09-17T03:44:35.516994+0000","last_unstale":"2024-09-17T03:44:36.492653+0000","last_undegraded":"2024-09-17T03:44:36.492653+0000","last_fullsized":"2024-09-17T03:44:36.492653+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:05.651432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492943+0000","last_change":"2024-09-17T03:44:35.513238+0000","last_active":"2024-09-17T03:44:36.492943+0000","last_peered":"2024-09-17T03:44:36.492943+0000","last_clean":"2024-09-17T03:44:36.492943+0000","last_became_active":"2024-09-17T03:44:35.512950+0000","last_became_peered":"2024-09-17T03:44:35.512950+0000","last_unstale":"2024-09-17T03:44:36.492943+0000","last_undegraded":"2024-09-17T03:44:36.492943+0000","last_fullsized":"2024-09-17T03:44:36.492943+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:27.101587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091170+0000","last_change":"2024-09-17T03:44:35.511166+0000","last_active":"2024-09-17T03:44:37.091170+0000","last_peered":"2024-09-17T03:44:37.091170+0000","last_clean":"2024-09-17T03:44:37.091170+0000","last_became_active":"2024-09-17T03:44:35.510859+0000","last_became_peered":"2024-09-17T03:44:35.510859+0000","last_unstale":"2024-09-17T03:44:37.091170+0000","last_undegraded":"2024-09-17T03:44:37.091170+0000","last_fullsized":"2024-09-17T03:44:37.091170+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:43.512265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492353+0000","last_change":"2024-09-17T03:44:35.509502+0000","last_active":"2024-09-17T03:44:36.492353+0000","last_peered":"2024-09-17T03:44:36.492353+0000","last_clean":"2024-09-17T03:44:36.492353+0000","last_became_active":"2024-09-17T03:44:35.509199+0000","last_became_peered":"2024-09-17T03:44:35.509199+0000","last_unstale":"2024-09-17T03:44:36.492353+0000","last_undegraded":"2024-09-17T03:44:36.492353+0000","last_fullsized":"2024-09-17T03:44:36.492353+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:20.369104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091476+0000","last_change":"2024-09-17T03:44:35.510397+0000","last_active":"2024-09-17T03:44:37.091476+0000","last_peered":"2024-09-17T03:44:37.091476+0000","last_clean":"2024-09-17T03:44:37.091476+0000","last_became_active":"2024-09-17T03:44:35.510097+0000","last_became_peered":"2024-09-17T03:44:35.510097+0000","last_unstale":"2024-09-17T03:44:37.091476+0000","last_undegraded":"2024-09-17T03:44:37.091476+0000","last_fullsized":"2024-09-17T03:44:37.091476+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:54.322849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704318+0000","last_change":"2024-09-17T03:44:35.523683+0000","last_active":"2024-09-17T03:44:36.704318+0000","last_peered":"2024-09-17T03:44:36.704318+0000","last_clean":"2024-09-17T03:44:36.704318+0000","last_became_active":"2024-09-17T03:44:35.523362+0000","last_became_peered":"2024-09-17T03:44:35.523362+0000","last_unstale":"2024-09-17T03:44:36.704318+0000","last_undegraded":"2024-09-17T03:44:36.704318+0000","last_fullsized":"2024-09-17T03:44:36.704318+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:47.040157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736998+0000","last_change":"2024-09-17T03:44:35.522118+0000","last_active":"2024-09-17T03:44:36.736998+0000","last_peered":"2024-09-17T03:44:36.736998+0000","last_clean":"2024-09-17T03:44:36.736998+0000","last_became_active":"2024-09-17T03:44:35.521106+0000","last_became_peered":"2024-09-17T03:44:35.521106+0000","last_unstale":"2024-09-17T03:44:36.736998+0000","last_undegraded":"2024-09-17T03:44:36.736998+0000","last_fullsized":"2024-09-17T03:44:36.736998+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:48.040111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496008+0000","last_change":"2024-09-17T03:44:35.511467+0000","last_active":"2024-09-17T03:44:36.496008+0000","last_peered":"2024-09-17T03:44:36.496008+0000","last_clean":"2024-09-17T03:44:36.496008+0000","last_became_active":"2024-09-17T03:44:35.510852+0000","last_became_peered":"2024-09-17T03:44:35.510852+0000","last_unstale":"2024-09-17T03:44:36.496008+0000","last_undegraded":"2024-09-17T03:44:36.496008+0000","last_fullsized":"2024-09-17T03:44:36.496008+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:47.965353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496731+0000","last_change":"2024-09-17T03:44:35.498609+0000","last_active":"2024-09-17T03:44:36.496731+0000","last_peered":"2024-09-17T03:44:36.496731+0000","last_clean":"2024-09-17T03:44:36.496731+0000","last_became_active":"2024-09-17T03:44:35.498220+0000","last_became_peered":"2024-09-17T03:44:35.498220+0000","last_unstale":"2024-09-17T03:44:36.496731+0000","last_undegraded":"2024-09-17T03:44:36.496731+0000","last_fullsized":"2024-09-17T03:44:36.496731+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:31.628305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091377+0000","last_change":"2024-09-17T03:44:35.498274+0000","last_active":"2024-09-17T03:44:37.091377+0000","last_peered":"2024-09-17T03:44:37.091377+0000","last_clean":"2024-09-17T03:44:37.091377+0000","last_became_active":"2024-09-17T03:44:35.497945+0000","last_became_peered":"2024-09-17T03:44:35.497945+0000","last_unstale":"2024-09-17T03:44:37.091377+0000","last_undegraded":"2024-09-17T03:44:37.091377+0000","last_fullsized":"2024-09-17T03:44:37.091377+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:58.351462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091265+0000","last_change":"2024-09-17T03:44:35.502806+0000","last_active":"2024-09-17T03:44:37.091265+0000","last_peered":"2024-09-17T03:44:37.091265+0000","last_clean":"2024-09-17T03:44:37.091265+0000","last_became_active":"2024-09-17T03:44:35.502487+0000","last_became_peered":"2024-09-17T03:44:35.502487+0000","last_unstale":"2024-09-17T03:44:37.091265+0000","last_undegraded":"2024-09-17T03:44:37.091265+0000","last_fullsized":"2024-09-17T03:44:37.091265+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.717384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704050+0000","last_change":"2024-09-17T03:44:35.518950+0000","last_active":"2024-09-17T03:44:36.704050+0000","last_peered":"2024-09-17T03:44:36.704050+0000","last_clean":"2024-09-17T03:44:36.704050+0000","last_became_active":"2024-09-17T03:44:35.518668+0000","last_became_peered":"2024-09-17T03:44:35.518668+0000","last_unstale":"2024-09-17T03:44:36.704050+0000","last_undegraded":"2024-09-17T03:44:36.704050+0000","last_fullsized":"2024-09-17T03:44:36.704050+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:01.877073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091816+0000","last_change":"2024-09-17T03:44:35.501005+0000","last_active":"2024-09-17T03:44:37.091816+0000","last_peered":"2024-09-17T03:44:37.091816+0000","last_clean":"2024-09-17T03:44:37.091816+0000","last_became_active":"2024-09-17T03:44:35.500713+0000","last_became_peered":"2024-09-17T03:44:35.500713+0000","last_unstale":"2024-09-17T03:44:37.091816+0000","last_undegraded":"2024-09-17T03:44:37.091816+0000","last_fullsized":"2024-09-17T03:44:37.091816+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:50.341011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704369+0000","last_change":"2024-09-17T03:44:35.522929+0000","last_active":"2024-09-17T03:44:36.704369+0000","last_peered":"2024-09-17T03:44:36.704369+0000","last_clean":"2024-09-17T03:44:36.704369+0000","last_became_active":"2024-09-17T03:44:35.522419+0000","last_became_peered":"2024-09-17T03:44:35.522419+0000","last_unstale":"2024-09-17T03:44:36.704369+0000","last_undegraded":"2024-09-17T03:44:36.704369+0000","last_fullsized":"2024-09-17T03:44:36.704369+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:27.801044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704537+0000","last_change":"2024-09-17T03:44:35.523107+0000","last_active":"2024-09-17T03:44:36.704537+0000","last_peered":"2024-09-17T03:44:36.704537+0000","last_clean":"2024-09-17T03:44:36.704537+0000","last_became_active":"2024-09-17T03:44:35.522655+0000","last_became_peered":"2024-09-17T03:44:35.522655+0000","last_unstale":"2024-09-17T03:44:36.704537+0000","last_undegraded":"2024-09-17T03:44:36.704537+0000","last_fullsized":"2024-09-17T03:44:36.704537+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:38.500491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492728+0000","last_change":"2024-09-17T03:44:35.512596+0000","last_active":"2024-09-17T03:44:36.492728+0000","last_peered":"2024-09-17T03:44:36.492728+0000","last_clean":"2024-09-17T03:44:36.492728+0000","last_became_active":"2024-09-17T03:44:35.512241+0000","last_became_peered":"2024-09-17T03:44:35.512241+0000","last_unstale":"2024-09-17T03:44:36.492728+0000","last_undegraded":"2024-09-17T03:44:36.492728+0000","last_fullsized":"2024-09-17T03:44:36.492728+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:14.720703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560145+0000","last_change":"2024-09-17T03:44:35.509155+0000","last_active":"2024-09-17T03:44:36.560145+0000","last_peered":"2024-09-17T03:44:36.560145+0000","last_clean":"2024-09-17T03:44:36.560145+0000","last_became_active":"2024-09-17T03:44:35.508764+0000","last_became_peered":"2024-09-17T03:44:35.508764+0000","last_unstale":"2024-09-17T03:44:36.560145+0000","last_undegraded":"2024-09-17T03:44:36.560145+0000","last_fullsized":"2024-09-17T03:44:36.560145+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:39.874649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495869+0000","last_change":"2024-09-17T03:44:35.514858+0000","last_active":"2024-09-17T03:44:36.495869+0000","last_peered":"2024-09-17T03:44:36.495869+0000","last_clean":"2024-09-17T03:44:36.495869+0000","last_became_active":"2024-09-17T03:44:35.514478+0000","last_became_peered":"2024-09-17T03:44:35.514478+0000","last_unstale":"2024-09-17T03:44:36.495869+0000","last_undegraded":"2024-09-17T03:44:36.495869+0000","last_fullsized":"2024-09-17T03:44:36.495869+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:15.280435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495700+0000","last_change":"2024-09-17T03:44:35.509000+0000","last_active":"2024-09-17T03:44:36.495700+0000","last_peered":"2024-09-17T03:44:36.495700+0000","last_clean":"2024-09-17T03:44:36.495700+0000","last_became_active":"2024-09-17T03:44:35.507413+0000","last_became_peered":"2024-09-17T03:44:35.507413+0000","last_unstale":"2024-09-17T03:44:36.495700+0000","last_undegraded":"2024-09-17T03:44:36.495700+0000","last_fullsized":"2024-09-17T03:44:36.495700+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:45.655104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.559968+0000","last_change":"2024-09-17T03:44:35.509513+0000","last_active":"2024-09-17T03:44:36.559968+0000","last_peered":"2024-09-17T03:44:36.559968+0000","last_clean":"2024-09-17T03:44:36.559968+0000","last_became_active":"2024-09-17T03:44:35.509188+0000","last_became_peered":"2024-09-17T03:44:35.509188+0000","last_unstale":"2024-09-17T03:44:36.559968+0000","last_undegraded":"2024-09-17T03:44:36.559968+0000","last_fullsized":"2024-09-17T03:44:36.559968+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:37.993184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091224+0000","last_change":"2024-09-17T03:44:35.515781+0000","last_active":"2024-09-17T03:44:37.091224+0000","last_peered":"2024-09-17T03:44:37.091224+0000","last_clean":"2024-09-17T03:44:37.091224+0000","last_became_active":"2024-09-17T03:44:35.515189+0000","last_became_peered":"2024-09-17T03:44:35.515189+0000","last_unstale":"2024-09-17T03:44:37.091224+0000","last_undegraded":"2024-09-17T03:44:37.091224+0000","last_fullsized":"2024-09-17T03:44:37.091224+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:28.320921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091829+0000","last_change":"2024-09-17T03:44:35.510737+0000","last_active":"2024-09-17T03:44:37.091829+0000","last_peered":"2024-09-17T03:44:37.091829+0000","last_clean":"2024-09-17T03:44:37.091829+0000","last_became_active":"2024-09-17T03:44:35.510434+0000","last_became_peered":"2024-09-17T03:44:35.510434+0000","last_unstale":"2024-09-17T03:44:37.091829+0000","last_undegraded":"2024-09-17T03:44:37.091829+0000","last_fullsized":"2024-09-17T03:44:37.091829+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:34.100442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495871+0000","last_change":"2024-09-17T03:44:35.511390+0000","last_active":"2024-09-17T03:44:36.495871+0000","last_peered":"2024-09-17T03:44:36.495871+0000","last_clean":"2024-09-17T03:44:36.495871+0000","last_became_active":"2024-09-17T03:44:35.510575+0000","last_became_peered":"2024-09-17T03:44:35.510575+0000","last_unstale":"2024-09-17T03:44:36.495871+0000","last_undegraded":"2024-09-17T03:44:36.495871+0000","last_fullsized":"2024-09-17T03:44:36.495871+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:17.523096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736731+0000","last_change":"2024-09-17T03:44:35.506964+0000","last_active":"2024-09-17T03:44:36.736731+0000","last_peered":"2024-09-17T03:44:36.736731+0000","last_clean":"2024-09-17T03:44:36.736731+0000","last_became_active":"2024-09-17T03:44:35.506673+0000","last_became_peered":"2024-09-17T03:44:35.506673+0000","last_unstale":"2024-09-17T03:44:36.736731+0000","last_undegraded":"2024-09-17T03:44:36.736731+0000","last_fullsized":"2024-09-17T03:44:36.736731+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:55.838810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496252+0000","last_change":"2024-09-17T03:44:35.510967+0000","last_active":"2024-09-17T03:44:36.496252+0000","last_peered":"2024-09-17T03:44:36.496252+0000","last_clean":"2024-09-17T03:44:36.496252+0000","last_became_active":"2024-09-17T03:44:35.510633+0000","last_became_peered":"2024-09-17T03:44:35.510633+0000","last_unstale":"2024-09-17T03:44:36.496252+0000","last_undegraded":"2024-09-17T03:44:36.496252+0000","last_fullsized":"2024-09-17T03:44:36.496252+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:57.377466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091089+0000","last_change":"2024-09-17T03:44:35.507298+0000","last_active":"2024-09-17T03:44:37.091089+0000","last_peered":"2024-09-17T03:44:37.091089+0000","last_clean":"2024-09-17T03:44:37.091089+0000","last_became_active":"2024-09-17T03:44:35.506929+0000","last_became_peered":"2024-09-17T03:44:35.506929+0000","last_unstale":"2024-09-17T03:44:37.091089+0000","last_undegraded":"2024-09-17T03:44:37.091089+0000","last_fullsized":"2024-09-17T03:44:37.091089+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:52.753354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704158+0000","last_change":"2024-09-17T03:44:35.511788+0000","last_active":"2024-09-17T03:44:36.704158+0000","last_peered":"2024-09-17T03:44:36.704158+0000","last_clean":"2024-09-17T03:44:36.704158+0000","last_became_active":"2024-09-17T03:44:35.511502+0000","last_became_peered":"2024-09-17T03:44:35.511502+0000","last_unstale":"2024-09-17T03:44:36.704158+0000","last_undegraded":"2024-09-17T03:44:36.704158+0000","last_fullsized":"2024-09-17T03:44:36.704158+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:17.382875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091087+0000","last_change":"2024-09-17T03:44:35.503091+0000","last_active":"2024-09-17T03:44:37.091087+0000","last_peered":"2024-09-17T03:44:37.091087+0000","last_clean":"2024-09-17T03:44:37.091087+0000","last_became_active":"2024-09-17T03:44:35.502779+0000","last_became_peered":"2024-09-17T03:44:35.502779+0000","last_unstale":"2024-09-17T03:44:37.091087+0000","last_undegraded":"2024-09-17T03:44:37.091087+0000","last_fullsized":"2024-09-17T03:44:37.091087+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:57.611510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091331+0000","last_change":"2024-09-17T03:44:35.517115+0000","last_active":"2024-09-17T03:44:37.091331+0000","last_peered":"2024-09-17T03:44:37.091331+0000","last_clean":"2024-09-17T03:44:37.091331+0000","last_became_active":"2024-09-17T03:44:35.515962+0000","last_became_peered":"2024-09-17T03:44:35.515962+0000","last_unstale":"2024-09-17T03:44:37.091331+0000","last_undegraded":"2024-09-17T03:44:37.091331+0000","last_fullsized":"2024-09-17T03:44:37.091331+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:14.022854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"175'4","reported_seq":19,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495904+0000","last_change":"2024-09-17T03:44:34.504463+0000","last_active":"2024-09-17T03:44:36.495904+0000","last_peered":"2024-09-17T03:44:36.495904+0000","last_clean":"2024-09-17T03:44:36.495904+0000","last_became_active":"2024-09-17T03:44:34.504157+0000","last_became_peered":"2024-09-17T03:44:34.504157+0000","last_unstale":"2024-09-17T03:44:36.495904+0000","last_undegraded":"2024-09-17T03:44:36.495904+0000","last_fullsized":"2024-09-17T03:44:36.495904+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:22.218666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495607+0000","last_change":"2024-09-17T03:44:35.501626+0000","last_active":"2024-09-17T03:44:36.495607+0000","last_peered":"2024-09-17T03:44:36.495607+0000","last_clean":"2024-09-17T03:44:36.495607+0000","last_became_active":"2024-09-17T03:44:35.501175+0000","last_became_peered":"2024-09-17T03:44:35.501175+0000","last_unstale":"2024-09-17T03:44:36.495607+0000","last_undegraded":"2024-09-17T03:44:36.495607+0000","last_fullsized":"2024-09-17T03:44:36.495607+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:45.864026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091596+0000","last_change":"2024-09-17T03:44:34.504505+0000","last_active":"2024-09-17T03:44:37.091596+0000","last_peered":"2024-09-17T03:44:37.091596+0000","last_clean":"2024-09-17T03:44:37.091596+0000","last_became_active":"2024-09-17T03:44:34.504196+0000","last_became_peered":"2024-09-17T03:44:34.504196+0000","last_unstale":"2024-09-17T03:44:37.091596+0000","last_undegraded":"2024-09-17T03:44:37.091596+0000","last_fullsized":"2024-09-17T03:44:37.091596+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:24.474885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091469+0000","last_change":"2024-09-17T03:44:35.503935+0000","last_active":"2024-09-17T03:44:37.091469+0000","last_peered":"2024-09-17T03:44:37.091469+0000","last_clean":"2024-09-17T03:44:37.091469+0000","last_became_active":"2024-09-17T03:44:35.503023+0000","last_became_peered":"2024-09-17T03:44:35.503023+0000","last_unstale":"2024-09-17T03:44:37.091469+0000","last_undegraded":"2024-09-17T03:44:37.091469+0000","last_fullsized":"2024-09-17T03:44:37.091469+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:10.739917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.737085+0000","last_change":"2024-09-17T03:44:34.504667+0000","last_active":"2024-09-17T03:44:36.737085+0000","last_peered":"2024-09-17T03:44:36.737085+0000","last_clean":"2024-09-17T03:44:36.737085+0000","last_became_active":"2024-09-17T03:44:34.504379+0000","last_became_peered":"2024-09-17T03:44:34.504379+0000","last_unstale":"2024-09-17T03:44:36.737085+0000","last_undegraded":"2024-09-17T03:44:36.737085+0000","last_fullsized":"2024-09-17T03:44:36.737085+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:12.682497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704463+0000","last_change":"2024-09-17T03:44:35.524639+0000","last_active":"2024-09-17T03:44:36.704463+0000","last_peered":"2024-09-17T03:44:36.704463+0000","last_clean":"2024-09-17T03:44:36.704463+0000","last_became_active":"2024-09-17T03:44:35.523895+0000","last_became_peered":"2024-09-17T03:44:35.523895+0000","last_unstale":"2024-09-17T03:44:36.704463+0000","last_undegraded":"2024-09-17T03:44:36.704463+0000","last_fullsized":"2024-09-17T03:44:36.704463+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:10.381259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560581+0000","last_change":"2024-09-17T03:44:34.508067+0000","last_active":"2024-09-17T03:44:36.560581+0000","last_peered":"2024-09-17T03:44:36.560581+0000","last_clean":"2024-09-17T03:44:36.560581+0000","last_became_active":"2024-09-17T03:44:34.507724+0000","last_became_peered":"2024-09-17T03:44:34.507724+0000","last_unstale":"2024-09-17T03:44:36.560581+0000","last_undegraded":"2024-09-17T03:44:36.560581+0000","last_fullsized":"2024-09-17T03:44:36.560581+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:52.721696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560052+0000","last_change":"2024-09-17T03:44:35.518249+0000","last_active":"2024-09-17T03:44:36.560052+0000","last_peered":"2024-09-17T03:44:36.560052+0000","last_clean":"2024-09-17T03:44:36.560052+0000","last_became_active":"2024-09-17T03:44:35.517928+0000","last_became_peered":"2024-09-17T03:44:35.517928+0000","last_unstale":"2024-09-17T03:44:36.560052+0000","last_undegraded":"2024-09-17T03:44:36.560052+0000","last_fullsized":"2024-09-17T03:44:36.560052+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:46.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.493100+0000","last_change":"2024-09-17T03:44:34.508184+0000","last_active":"2024-09-17T03:44:36.493100+0000","last_peered":"2024-09-17T03:44:36.493100+0000","last_clean":"2024-09-17T03:44:36.493100+0000","last_became_active":"2024-09-17T03:44:34.507648+0000","last_became_peered":"2024-09-17T03:44:34.507648+0000","last_unstale":"2024-09-17T03:44:36.493100+0000","last_undegraded":"2024-09-17T03:44:36.493100+0000","last_fullsized":"2024-09-17T03:44:36.493100+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:45.906545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492571+0000","last_change":"2024-09-17T03:44:35.505629+0000","last_active":"2024-09-17T03:44:36.492571+0000","last_peered":"2024-09-17T03:44:36.492571+0000","last_clean":"2024-09-17T03:44:36.492571+0000","last_became_active":"2024-09-17T03:44:35.505324+0000","last_became_peered":"2024-09-17T03:44:35.505324+0000","last_unstale":"2024-09-17T03:44:36.492571+0000","last_undegraded":"2024-09-17T03:44:36.492571+0000","last_fullsized":"2024-09-17T03:44:36.492571+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:01.846555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492310+0000","last_change":"2024-09-17T03:44:34.508918+0000","last_active":"2024-09-17T03:44:36.492310+0000","last_peered":"2024-09-17T03:44:36.492310+0000","last_clean":"2024-09-17T03:44:36.492310+0000","last_became_active":"2024-09-17T03:44:34.508610+0000","last_became_peered":"2024-09-17T03:44:34.508610+0000","last_unstale":"2024-09-17T03:44:36.492310+0000","last_undegraded":"2024-09-17T03:44:36.492310+0000","last_fullsized":"2024-09-17T03:44:36.492310+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:46.202281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560045+0000","last_change":"2024-09-17T03:44:35.515640+0000","last_active":"2024-09-17T03:44:36.560045+0000","last_peered":"2024-09-17T03:44:36.560045+0000","last_clean":"2024-09-17T03:44:36.560045+0000","last_became_active":"2024-09-17T03:44:35.515192+0000","last_became_peered":"2024-09-17T03:44:35.515192+0000","last_unstale":"2024-09-17T03:44:36.560045+0000","last_undegraded":"2024-09-17T03:44:36.560045+0000","last_fullsized":"2024-09-17T03:44:36.560045+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:30.298955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495492+0000","last_change":"2024-09-17T03:44:34.507308+0000","last_active":"2024-09-17T03:44:36.495492+0000","last_peered":"2024-09-17T03:44:36.495492+0000","last_clean":"2024-09-17T03:44:36.495492+0000","last_became_active":"2024-09-17T03:44:34.506910+0000","last_became_peered":"2024-09-17T03:44:34.506910+0000","last_unstale":"2024-09-17T03:44:36.495492+0000","last_undegraded":"2024-09-17T03:44:36.495492+0000","last_fullsized":"2024-09-17T03:44:36.495492+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:23.781060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560481+0000","last_change":"2024-09-17T03:44:35.512499+0000","last_active":"2024-09-17T03:44:36.560481+0000","last_peered":"2024-09-17T03:44:36.560481+0000","last_clean":"2024-09-17T03:44:36.560481+0000","last_became_active":"2024-09-17T03:44:35.512152+0000","last_became_peered":"2024-09-17T03:44:35.512152+0000","last_unstale":"2024-09-17T03:44:36.560481+0000","last_undegraded":"2024-09-17T03:44:36.560481+0000","last_fullsized":"2024-09-17T03:44:36.560481+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:06.457427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492695+0000","last_change":"2024-09-17T03:44:34.504070+0000","last_active":"2024-09-17T03:44:36.492695+0000","last_peered":"2024-09-17T03:44:36.492695+0000","last_clean":"2024-09-17T03:44:36.492695+0000","last_became_active":"2024-09-17T03:44:34.503697+0000","last_became_peered":"2024-09-17T03:44:34.503697+0000","last_unstale":"2024-09-17T03:44:36.492695+0000","last_undegraded":"2024-09-17T03:44:36.492695+0000","last_fullsized":"2024-09-17T03:44:36.492695+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:19.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736950+0000","last_change":"2024-09-17T03:44:35.505813+0000","last_active":"2024-09-17T03:44:36.736950+0000","last_peered":"2024-09-17T03:44:36.736950+0000","last_clean":"2024-09-17T03:44:36.736950+0000","last_became_active":"2024-09-17T03:44:35.504368+0000","last_became_peered":"2024-09-17T03:44:35.504368+0000","last_unstale":"2024-09-17T03:44:36.736950+0000","last_undegraded":"2024-09-17T03:44:36.736950+0000","last_fullsized":"2024-09-17T03:44:36.736950+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:25.317311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496031+0000","last_change":"2024-09-17T03:44:34.504467+0000","last_active":"2024-09-17T03:44:36.496031+0000","last_peered":"2024-09-17T03:44:36.496031+0000","last_clean":"2024-09-17T03:44:36.496031+0000","last_became_active":"2024-09-17T03:44:34.504157+0000","last_became_peered":"2024-09-17T03:44:34.504157+0000","last_unstale":"2024-09-17T03:44:36.496031+0000","last_undegraded":"2024-09-17T03:44:36.496031+0000","last_fullsized":"2024-09-17T03:44:36.496031+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:45.906545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560514+0000","last_change":"2024-09-17T03:44:35.514270+0000","last_active":"2024-09-17T03:44:36.560514+0000","last_peered":"2024-09-17T03:44:36.560514+0000","last_clean":"2024-09-17T03:44:36.560514+0000","last_became_active":"2024-09-17T03:44:35.513969+0000","last_became_peered":"2024-09-17T03:44:35.513969+0000","last_unstale":"2024-09-17T03:44:36.560514+0000","last_undegraded":"2024-09-17T03:44:36.560514+0000","last_fullsized":"2024-09-17T03:44:36.560514+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:57.611510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"175'3","reported_seq":18,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704588+0000","last_change":"2024-09-17T03:44:34.508692+0000","last_active":"2024-09-17T03:44:36.704588+0000","last_peered":"2024-09-17T03:44:36.704588+0000","last_clean":"2024-09-17T03:44:36.704588+0000","last_became_active":"2024-09-17T03:44:34.508213+0000","last_became_peered":"2024-09-17T03:44:34.508213+0000","last_unstale":"2024-09-17T03:44:36.704588+0000","last_undegraded":"2024-09-17T03:44:36.704588+0000","last_fullsized":"2024-09-17T03:44:36.704588+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:14.238753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091807+0000","last_change":"2024-09-17T03:44:35.506966+0000","last_active":"2024-09-17T03:44:37.091807+0000","last_peered":"2024-09-17T03:44:37.091807+0000","last_clean":"2024-09-17T03:44:37.091807+0000","last_became_active":"2024-09-17T03:44:35.503150+0000","last_became_peered":"2024-09-17T03:44:35.503150+0000","last_unstale":"2024-09-17T03:44:37.091807+0000","last_undegraded":"2024-09-17T03:44:37.091807+0000","last_fullsized":"2024-09-17T03:44:37.091807+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:06.497317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"175'6","reported_seq":21,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560677+0000","last_change":"2024-09-17T03:44:34.506888+0000","last_active":"2024-09-17T03:44:36.560677+0000","last_peered":"2024-09-17T03:44:36.560677+0000","last_clean":"2024-09-17T03:44:36.560677+0000","last_became_active":"2024-09-17T03:44:34.506553+0000","last_became_peered":"2024-09-17T03:44:34.506553+0000","last_unstale":"2024-09-17T03:44:36.560677+0000","last_undegraded":"2024-09-17T03:44:36.560677+0000","last_fullsized":"2024-09-17T03:44:36.560677+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:12.270553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492990+0000","last_change":"2024-09-17T03:44:35.518401+0000","last_active":"2024-09-17T03:44:36.492990+0000","last_peered":"2024-09-17T03:44:36.492990+0000","last_clean":"2024-09-17T03:44:36.492990+0000","last_became_active":"2024-09-17T03:44:35.517803+0000","last_became_peered":"2024-09-17T03:44:35.517803+0000","last_unstale":"2024-09-17T03:44:36.492990+0000","last_undegraded":"2024-09-17T03:44:36.492990+0000","last_fullsized":"2024-09-17T03:44:36.492990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:22.898425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496033+0000","last_change":"2024-09-17T03:44:34.507298+0000","last_active":"2024-09-17T03:44:36.496033+0000","last_peered":"2024-09-17T03:44:36.496033+0000","last_clean":"2024-09-17T03:44:36.496033+0000","last_became_active":"2024-09-17T03:44:34.506960+0000","last_became_peered":"2024-09-17T03:44:34.506960+0000","last_unstale":"2024-09-17T03:44:36.496033+0000","last_undegraded":"2024-09-17T03:44:36.496033+0000","last_fullsized":"2024-09-17T03:44:36.496033+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:45.815093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704386+0000","last_change":"2024-09-17T03:44:35.520707+0000","last_active":"2024-09-17T03:44:36.704386+0000","last_peered":"2024-09-17T03:44:36.704386+0000","last_clean":"2024-09-17T03:44:36.704386+0000","last_became_active":"2024-09-17T03:44:35.520292+0000","last_became_peered":"2024-09-17T03:44:35.520292+0000","last_unstale":"2024-09-17T03:44:36.704386+0000","last_undegraded":"2024-09-17T03:44:36.704386+0000","last_fullsized":"2024-09-17T03:44:36.704386+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:35.032797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496096+0000","last_change":"2024-09-17T03:44:34.500426+0000","last_active":"2024-09-17T03:44:36.496096+0000","last_peered":"2024-09-17T03:44:36.496096+0000","last_clean":"2024-09-17T03:44:36.496096+0000","last_became_active":"2024-09-17T03:44:34.500104+0000","last_became_peered":"2024-09-17T03:44:34.500104+0000","last_unstale":"2024-09-17T03:44:36.496096+0000","last_undegraded":"2024-09-17T03:44:36.496096+0000","last_fullsized":"2024-09-17T03:44:36.496096+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:58.067682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736523+0000","last_change":"2024-09-17T03:44:35.505736+0000","last_active":"2024-09-17T03:44:36.736523+0000","last_peered":"2024-09-17T03:44:36.736523+0000","last_clean":"2024-09-17T03:44:36.736523+0000","last_became_active":"2024-09-17T03:44:35.503782+0000","last_became_peered":"2024-09-17T03:44:35.503782+0000","last_unstale":"2024-09-17T03:44:36.736523+0000","last_undegraded":"2024-09-17T03:44:36.736523+0000","last_fullsized":"2024-09-17T03:44:36.736523+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:42.793594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.703928+0000","last_change":"2024-09-17T03:44:34.506973+0000","last_active":"2024-09-17T03:44:36.703928+0000","last_peered":"2024-09-17T03:44:36.703928+0000","last_clean":"2024-09-17T03:44:36.703928+0000","last_became_active":"2024-09-17T03:44:34.506658+0000","last_became_peered":"2024-09-17T03:44:34.506658+0000","last_unstale":"2024-09-17T03:44:36.703928+0000","last_undegraded":"2024-09-17T03:44:36.703928+0000","last_fullsized":"2024-09-17T03:44:36.703928+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:31.118656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091494+0000","last_change":"2024-09-17T03:44:35.509972+0000","last_active":"2024-09-17T03:44:37.091494+0000","last_peered":"2024-09-17T03:44:37.091494+0000","last_clean":"2024-09-17T03:44:37.091494+0000","last_became_active":"2024-09-17T03:44:35.509645+0000","last_became_peered":"2024-09-17T03:44:35.509645+0000","last_unstale":"2024-09-17T03:44:37.091494+0000","last_undegraded":"2024-09-17T03:44:37.091494+0000","last_fullsized":"2024-09-17T03:44:37.091494+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:56.436755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"175'8","reported_seq":23,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736732+0000","last_change":"2024-09-17T03:44:34.505502+0000","last_active":"2024-09-17T03:44:36.736732+0000","last_peered":"2024-09-17T03:44:36.736732+0000","last_clean":"2024-09-17T03:44:36.736732+0000","last_became_active":"2024-09-17T03:44:34.505206+0000","last_became_peered":"2024-09-17T03:44:34.505206+0000","last_unstale":"2024-09-17T03:44:36.736732+0000","last_undegraded":"2024-09-17T03:44:36.736732+0000","last_fullsized":"2024-09-17T03:44:36.736732+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:22.213850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091511+0000","last_change":"2024-09-17T03:44:35.507591+0000","last_active":"2024-09-17T03:44:37.091511+0000","last_peered":"2024-09-17T03:44:37.091511+0000","last_clean":"2024-09-17T03:44:37.091511+0000","last_became_active":"2024-09-17T03:44:35.507301+0000","last_became_peered":"2024-09-17T03:44:35.507301+0000","last_unstale":"2024-09-17T03:44:37.091511+0000","last_undegraded":"2024-09-17T03:44:37.091511+0000","last_fullsized":"2024-09-17T03:44:37.091511+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:31.039012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492795+0000","last_change":"2024-09-17T03:44:34.507954+0000","last_active":"2024-09-17T03:44:36.492795+0000","last_peered":"2024-09-17T03:44:36.492795+0000","last_clean":"2024-09-17T03:44:36.492795+0000","last_became_active":"2024-09-17T03:44:34.507591+0000","last_became_peered":"2024-09-17T03:44:34.507591+0000","last_unstale":"2024-09-17T03:44:36.492795+0000","last_undegraded":"2024-09-17T03:44:36.492795+0000","last_fullsized":"2024-09-17T03:44:36.492795+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:38.758785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091406+0000","last_change":"2024-09-17T03:44:35.515476+0000","last_active":"2024-09-17T03:44:37.091406+0000","last_peered":"2024-09-17T03:44:37.091406+0000","last_clean":"2024-09-17T03:44:37.091406+0000","last_became_active":"2024-09-17T03:44:35.514206+0000","last_became_peered":"2024-09-17T03:44:35.514206+0000","last_unstale":"2024-09-17T03:44:37.091406+0000","last_undegraded":"2024-09-17T03:44:37.091406+0000","last_fullsized":"2024-09-17T03:44:37.091406+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:37.648386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091604+0000","last_change":"2024-09-17T03:44:34.510346+0000","last_active":"2024-09-17T03:44:37.091604+0000","last_peered":"2024-09-17T03:44:37.091604+0000","last_clean":"2024-09-17T03:44:37.091604+0000","last_became_active":"2024-09-17T03:44:34.510051+0000","last_became_peered":"2024-09-17T03:44:34.510051+0000","last_unstale":"2024-09-17T03:44:37.091604+0000","last_undegraded":"2024-09-17T03:44:37.091604+0000","last_fullsized":"2024-09-17T03:44:37.091604+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:23.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736741+0000","last_change":"2024-09-17T03:44:35.511999+0000","last_active":"2024-09-17T03:44:36.736741+0000","last_peered":"2024-09-17T03:44:36.736741+0000","last_clean":"2024-09-17T03:44:36.736741+0000","last_became_active":"2024-09-17T03:44:35.511709+0000","last_became_peered":"2024-09-17T03:44:35.511709+0000","last_unstale":"2024-09-17T03:44:36.736741+0000","last_undegraded":"2024-09-17T03:44:36.736741+0000","last_fullsized":"2024-09-17T03:44:36.736741+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:31.963884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704615+0000","last_change":"2024-09-17T03:44:34.509125+0000","last_active":"2024-09-17T03:44:36.704615+0000","last_peered":"2024-09-17T03:44:36.704615+0000","last_clean":"2024-09-17T03:44:36.704615+0000","last_became_active":"2024-09-17T03:44:34.507891+0000","last_became_peered":"2024-09-17T03:44:34.507891+0000","last_unstale":"2024-09-17T03:44:36.704615+0000","last_undegraded":"2024-09-17T03:44:36.704615+0000","last_fullsized":"2024-09-17T03:44:36.704615+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:06.654036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704396+0000","last_change":"2024-09-17T03:44:35.513414+0000","last_active":"2024-09-17T03:44:36.704396+0000","last_peered":"2024-09-17T03:44:36.704396+0000","last_clean":"2024-09-17T03:44:36.704396+0000","last_became_active":"2024-09-17T03:44:35.513121+0000","last_became_peered":"2024-09-17T03:44:35.513121+0000","last_unstale":"2024-09-17T03:44:36.704396+0000","last_undegraded":"2024-09-17T03:44:36.704396+0000","last_fullsized":"2024-09-17T03:44:36.704396+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:51.926469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736934+0000","last_change":"2024-09-17T03:44:34.508494+0000","last_active":"2024-09-17T03:44:36.736934+0000","last_peered":"2024-09-17T03:44:36.736934+0000","last_clean":"2024-09-17T03:44:36.736934+0000","last_became_active":"2024-09-17T03:44:34.508171+0000","last_became_peered":"2024-09-17T03:44:34.508171+0000","last_unstale":"2024-09-17T03:44:36.736934+0000","last_undegraded":"2024-09-17T03:44:36.736934+0000","last_fullsized":"2024-09-17T03:44:36.736934+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:22.342508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704363+0000","last_change":"2024-09-17T03:44:35.517037+0000","last_active":"2024-09-17T03:44:36.704363+0000","last_peered":"2024-09-17T03:44:36.704363+0000","last_clean":"2024-09-17T03:44:36.704363+0000","last_became_active":"2024-09-17T03:44:35.516713+0000","last_became_peered":"2024-09-17T03:44:35.516713+0000","last_unstale":"2024-09-17T03:44:36.704363+0000","last_undegraded":"2024-09-17T03:44:36.704363+0000","last_fullsized":"2024-09-17T03:44:36.704363+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:16.789412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704298+0000","last_change":"2024-09-17T03:44:34.507042+0000","last_active":"2024-09-17T03:44:36.704298+0000","last_peered":"2024-09-17T03:44:36.704298+0000","last_clean":"2024-09-17T03:44:36.704298+0000","last_became_active":"2024-09-17T03:44:34.506712+0000","last_became_peered":"2024-09-17T03:44:34.506712+0000","last_unstale":"2024-09-17T03:44:36.704298+0000","last_undegraded":"2024-09-17T03:44:36.704298+0000","last_fullsized":"2024-09-17T03:44:36.704298+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:34.767116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736689+0000","last_change":"2024-09-17T03:44:35.506088+0000","last_active":"2024-09-17T03:44:36.736689+0000","last_peered":"2024-09-17T03:44:36.736689+0000","last_clean":"2024-09-17T03:44:36.736689+0000","last_became_active":"2024-09-17T03:44:35.505780+0000","last_became_peered":"2024-09-17T03:44:35.505780+0000","last_unstale":"2024-09-17T03:44:36.736689+0000","last_undegraded":"2024-09-17T03:44:36.736689+0000","last_fullsized":"2024-09-17T03:44:36.736689+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:41.789994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091870+0000","last_change":"2024-09-17T03:44:34.504134+0000","last_active":"2024-09-17T03:44:37.091870+0000","last_peered":"2024-09-17T03:44:37.091870+0000","last_clean":"2024-09-17T03:44:37.091870+0000","last_became_active":"2024-09-17T03:44:34.503719+0000","last_became_peered":"2024-09-17T03:44:34.503719+0000","last_unstale":"2024-09-17T03:44:37.091870+0000","last_undegraded":"2024-09-17T03:44:37.091870+0000","last_fullsized":"2024-09-17T03:44:37.091870+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:15.619123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091143+0000","last_change":"2024-09-17T03:44:35.506822+0000","last_active":"2024-09-17T03:44:37.091143+0000","last_peered":"2024-09-17T03:44:37.091143+0000","last_clean":"2024-09-17T03:44:37.091143+0000","last_became_active":"2024-09-17T03:44:35.506454+0000","last_became_peered":"2024-09-17T03:44:35.506454+0000","last_unstale":"2024-09-17T03:44:37.091143+0000","last_undegraded":"2024-09-17T03:44:37.091143+0000","last_fullsized":"2024-09-17T03:44:37.091143+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:13.279683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091520+0000","last_change":"2024-09-17T03:44:34.499354+0000","last_active":"2024-09-17T03:44:37.091520+0000","last_peered":"2024-09-17T03:44:37.091520+0000","last_clean":"2024-09-17T03:44:37.091520+0000","last_became_active":"2024-09-17T03:44:34.498887+0000","last_became_peered":"2024-09-17T03:44:34.498887+0000","last_unstale":"2024-09-17T03:44:37.091520+0000","last_undegraded":"2024-09-17T03:44:37.091520+0000","last_fullsized":"2024-09-17T03:44:37.091520+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496525+0000","last_change":"2024-09-17T03:44:35.503472+0000","last_active":"2024-09-17T03:44:36.496525+0000","last_peered":"2024-09-17T03:44:36.496525+0000","last_clean":"2024-09-17T03:44:36.496525+0000","last_became_active":"2024-09-17T03:44:35.502874+0000","last_became_peered":"2024-09-17T03:44:35.502874+0000","last_unstale":"2024-09-17T03:44:36.496525+0000","last_undegraded":"2024-09-17T03:44:36.496525+0000","last_fullsized":"2024-09-17T03:44:36.496525+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:10.937538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492554+0000","last_change":"2024-09-17T03:44:34.510288+0000","last_active":"2024-09-17T03:44:36.492554+0000","last_peered":"2024-09-17T03:44:36.492554+0000","last_clean":"2024-09-17T03:44:36.492554+0000","last_became_active":"2024-09-17T03:44:34.509945+0000","last_became_peered":"2024-09-17T03:44:34.509945+0000","last_unstale":"2024-09-17T03:44:36.492554+0000","last_undegraded":"2024-09-17T03:44:36.492554+0000","last_fullsized":"2024-09-17T03:44:36.492554+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:42.238194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495656+0000","last_change":"2024-09-17T03:44:35.511600+0000","last_active":"2024-09-17T03:44:36.495656+0000","last_peered":"2024-09-17T03:44:36.495656+0000","last_clean":"2024-09-17T03:44:36.495656+0000","last_became_active":"2024-09-17T03:44:35.511281+0000","last_became_peered":"2024-09-17T03:44:35.511281+0000","last_unstale":"2024-09-17T03:44:36.495656+0000","last_undegraded":"2024-09-17T03:44:36.495656+0000","last_fullsized":"2024-09-17T03:44:36.495656+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:12.015745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736905+0000","last_change":"2024-09-17T03:44:34.504336+0000","last_active":"2024-09-17T03:44:36.736905+0000","last_peered":"2024-09-17T03:44:36.736905+0000","last_clean":"2024-09-17T03:44:36.736905+0000","last_became_active":"2024-09-17T03:44:34.504005+0000","last_became_peered":"2024-09-17T03:44:34.504005+0000","last_unstale":"2024-09-17T03:44:36.736905+0000","last_undegraded":"2024-09-17T03:44:36.736905+0000","last_fullsized":"2024-09-17T03:44:36.736905+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:09.876455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.092117+0000","last_change":"2024-09-17T03:44:35.509517+0000","last_active":"2024-09-17T03:44:37.092117+0000","last_peered":"2024-09-17T03:44:37.092117+0000","last_clean":"2024-09-17T03:44:37.092117+0000","last_became_active":"2024-09-17T03:44:35.508452+0000","last_became_peered":"2024-09-17T03:44:35.508452+0000","last_unstale":"2024-09-17T03:44:37.092117+0000","last_undegraded":"2024-09-17T03:44:37.092117+0000","last_fullsized":"2024-09-17T03:44:37.092117+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:15.431678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"176'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560345+0000","last_change":"2024-09-17T03:44:34.506730+0000","last_active":"2024-09-17T03:44:36.560345+0000","last_peered":"2024-09-17T03:44:36.560345+0000","last_clean":"2024-09-17T03:44:36.560345+0000","last_became_active":"2024-09-17T03:44:34.506425+0000","last_became_peered":"2024-09-17T03:44:34.506425+0000","last_unstale":"2024-09-17T03:44:36.560345+0000","last_undegraded":"2024-09-17T03:44:36.560345+0000","last_fullsized":"2024-09-17T03:44:36.560345+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:52.461258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091119+0000","last_change":"2024-09-17T03:44:35.514014+0000","last_active":"2024-09-17T03:44:37.091119+0000","last_peered":"2024-09-17T03:44:37.091119+0000","last_clean":"2024-09-17T03:44:37.091119+0000","last_became_active":"2024-09-17T03:44:35.513696+0000","last_became_peered":"2024-09-17T03:44:35.513696+0000","last_unstale":"2024-09-17T03:44:37.091119+0000","last_undegraded":"2024-09-17T03:44:37.091119+0000","last_fullsized":"2024-09-17T03:44:37.091119+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:37.810185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492744+0000","last_change":"2024-09-17T03:44:34.507786+0000","last_active":"2024-09-17T03:44:36.492744+0000","last_peered":"2024-09-17T03:44:36.492744+0000","last_clean":"2024-09-17T03:44:36.492744+0000","last_became_active":"2024-09-17T03:44:34.506839+0000","last_became_peered":"2024-09-17T03:44:34.506839+0000","last_unstale":"2024-09-17T03:44:36.492744+0000","last_undegraded":"2024-09-17T03:44:36.492744+0000","last_fullsized":"2024-09-17T03:44:36.492744+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:55.162172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496397+0000","last_change":"2024-09-17T03:44:35.497407+0000","last_active":"2024-09-17T03:44:36.496397+0000","last_peered":"2024-09-17T03:44:36.496397+0000","last_clean":"2024-09-17T03:44:36.496397+0000","last_became_active":"2024-09-17T03:44:35.497085+0000","last_became_peered":"2024-09-17T03:44:35.497085+0000","last_unstale":"2024-09-17T03:44:36.496397+0000","last_undegraded":"2024-09-17T03:44:36.496397+0000","last_fullsized":"2024-09-17T03:44:36.496397+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:38.802645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736939+0000","last_change":"2024-09-17T03:44:34.504327+0000","last_active":"2024-09-17T03:44:36.736939+0000","last_peered":"2024-09-17T03:44:36.736939+0000","last_clean":"2024-09-17T03:44:36.736939+0000","last_became_active":"2024-09-17T03:44:34.504030+0000","last_became_peered":"2024-09-17T03:44:34.504030+0000","last_unstale":"2024-09-17T03:44:36.736939+0000","last_undegraded":"2024-09-17T03:44:36.736939+0000","last_fullsized":"2024-09-17T03:44:36.736939+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:38.341868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091683+0000","last_change":"2024-09-17T03:44:35.506474+0000","last_active":"2024-09-17T03:44:37.091683+0000","last_peered":"2024-09-17T03:44:37.091683+0000","last_clean":"2024-09-17T03:44:37.091683+0000","last_became_active":"2024-09-17T03:44:35.503283+0000","last_became_peered":"2024-09-17T03:44:35.503283+0000","last_unstale":"2024-09-17T03:44:37.091683+0000","last_undegraded":"2024-09-17T03:44:37.091683+0000","last_fullsized":"2024-09-17T03:44:37.091683+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:43.220358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560307+0000","last_change":"2024-09-17T03:44:34.512828+0000","last_active":"2024-09-17T03:44:36.560307+0000","last_peered":"2024-09-17T03:44:36.560307+0000","last_clean":"2024-09-17T03:44:36.560307+0000","last_became_active":"2024-09-17T03:44:34.512469+0000","last_became_peered":"2024-09-17T03:44:34.512469+0000","last_unstale":"2024-09-17T03:44:36.560307+0000","last_undegraded":"2024-09-17T03:44:36.560307+0000","last_fullsized":"2024-09-17T03:44:36.560307+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:48.427101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496486+0000","last_change":"2024-09-17T03:44:35.517753+0000","last_active":"2024-09-17T03:44:36.496486+0000","last_peered":"2024-09-17T03:44:36.496486+0000","last_clean":"2024-09-17T03:44:36.496486+0000","last_became_active":"2024-09-17T03:44:35.517073+0000","last_became_peered":"2024-09-17T03:44:35.517073+0000","last_unstale":"2024-09-17T03:44:36.496486+0000","last_undegraded":"2024-09-17T03:44:36.496486+0000","last_fullsized":"2024-09-17T03:44:36.496486+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:17.733361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.493143+0000","last_change":"2024-09-17T03:44:34.508966+0000","last_active":"2024-09-17T03:44:36.493143+0000","last_peered":"2024-09-17T03:44:36.493143+0000","last_clean":"2024-09-17T03:44:36.493143+0000","last_became_active":"2024-09-17T03:44:34.508648+0000","last_became_peered":"2024-09-17T03:44:34.508648+0000","last_unstale":"2024-09-17T03:44:36.493143+0000","last_undegraded":"2024-09-17T03:44:36.493143+0000","last_fullsized":"2024-09-17T03:44:36.493143+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:53.757515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736588+0000","last_change":"2024-09-17T03:44:35.505100+0000","last_active":"2024-09-17T03:44:36.736588+0000","last_peered":"2024-09-17T03:44:36.736588+0000","last_clean":"2024-09-17T03:44:36.736588+0000","last_became_active":"2024-09-17T03:44:35.503366+0000","last_became_peered":"2024-09-17T03:44:35.503366+0000","last_unstale":"2024-09-17T03:44:36.736588+0000","last_undegraded":"2024-09-17T03:44:36.736588+0000","last_fullsized":"2024-09-17T03:44:36.736588+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:14.432674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496211+0000","last_change":"2024-09-17T03:44:34.503673+0000","last_active":"2024-09-17T03:44:36.496211+0000","last_peered":"2024-09-17T03:44:36.496211+0000","last_clean":"2024-09-17T03:44:36.496211+0000","last_became_active":"2024-09-17T03:44:34.503331+0000","last_became_peered":"2024-09-17T03:44:34.503331+0000","last_unstale":"2024-09-17T03:44:36.496211+0000","last_undegraded":"2024-09-17T03:44:36.496211+0000","last_fullsized":"2024-09-17T03:44:36.496211+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:53.757515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091048+0000","last_change":"2024-09-17T03:44:35.508733+0000","last_active":"2024-09-17T03:44:37.091048+0000","last_peered":"2024-09-17T03:44:37.091048+0000","last_clean":"2024-09-17T03:44:37.091048+0000","last_became_active":"2024-09-17T03:44:35.508398+0000","last_became_peered":"2024-09-17T03:44:35.508398+0000","last_unstale":"2024-09-17T03:44:37.091048+0000","last_undegraded":"2024-09-17T03:44:37.091048+0000","last_fullsized":"2024-09-17T03:44:37.091048+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496570+0000","last_change":"2024-09-17T03:44:34.500723+0000","last_active":"2024-09-17T03:44:36.496570+0000","last_peered":"2024-09-17T03:44:36.496570+0000","last_clean":"2024-09-17T03:44:36.496570+0000","last_became_active":"2024-09-17T03:44:34.500367+0000","last_became_peered":"2024-09-17T03:44:34.500367+0000","last_unstale":"2024-09-17T03:44:36.496570+0000","last_undegraded":"2024-09-17T03:44:36.496570+0000","last_fullsized":"2024-09-17T03:44:36.496570+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:34.083730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091453+0000","last_change":"2024-09-17T03:44:35.501366+0000","last_active":"2024-09-17T03:44:37.091453+0000","last_peered":"2024-09-17T03:44:37.091453+0000","last_clean":"2024-09-17T03:44:37.091453+0000","last_became_active":"2024-09-17T03:44:35.500193+0000","last_became_peered":"2024-09-17T03:44:35.500193+0000","last_unstale":"2024-09-17T03:44:37.091453+0000","last_undegraded":"2024-09-17T03:44:37.091453+0000","last_fullsized":"2024-09-17T03:44:37.091453+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:43.710871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496716+0000","last_change":"2024-09-17T03:44:34.508290+0000","last_active":"2024-09-17T03:44:36.496716+0000","last_peered":"2024-09-17T03:44:36.496716+0000","last_clean":"2024-09-17T03:44:36.496716+0000","last_became_active":"2024-09-17T03:44:34.507990+0000","last_became_peered":"2024-09-17T03:44:34.507990+0000","last_unstale":"2024-09-17T03:44:36.496716+0000","last_undegraded":"2024-09-17T03:44:36.496716+0000","last_fullsized":"2024-09-17T03:44:36.496716+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:09.176398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":394,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560164+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:44:36.560164+0000","last_peered":"2024-09-17T03:44:36.560164+0000","last_clean":"2024-09-17T03:44:36.560164+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:44:36.560164+0000","last_undegraded":"2024-09-17T03:44:36.560164+0000","last_fullsized":"2024-09-17T03:44:36.560164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509586,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60308,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311532,"statfs":{"total":96636764160,"available":96575008768,"internally_reserved":0,"allocated":2818048,"data_stored":1565640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509586,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59720,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312120,"statfs":{"total":96636764160,"available":96575610880,"internally_reserved":0,"allocated":2215936,"data_stored":974242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509586,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65248,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306592,"statfs":{"total":96636764160,"available":96569950208,"internally_reserved":0,"allocated":2232320,"data_stored":975376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509586,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55556,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316284,"statfs":{"total":96636764160,"available":96579874816,"internally_reserved":0,"allocated":2211840,"data_stored":973660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509587,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2220032,"data_stored":973716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509587,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56140,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315700,"statfs":{"total":96636764160,"available":96579276800,"internally_reserved":0,"allocated":2809856,"data_stored":1564118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55568,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316272,"statfs":{"total":96636764160,"available":96579862528,"internally_reserved":0,"allocated":2215936,"data_stored":974242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55572,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316268,"statfs":{"total":96636764160,"available":96579858432,"internally_reserved":0,"allocated":2224128,"data_stored":973842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:44:41.459 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-09-17T03:44:41.458+0000 7f252630b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:44:43.971 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:44:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.098+0000 7f50fbc9b640 1 -- 172.21.15.146:0/2457964875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f40b4370 msgr2=0x7f50f41657f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.098+0000 7f50fbc9b640 1 --2- 172.21.15.146:0/2457964875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f40b4370 0x7f50f41657f0 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f50ec005fd0 tx=0x7f50ec02bc80 comp rx=0 tx=0).stop 2024-09-17T03:44:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.099+0000 7f50fbc9b640 1 -- 172.21.15.146:0/2457964875 shutdown_connections 2024-09-17T03:44:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.099+0000 7f50fbc9b640 1 --2- 172.21.15.146:0/2457964875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f40b4370 0x7f50f41657f0 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.099+0000 7f50fbc9b640 1 -- 172.21.15.146:0/2457964875 >> 172.21.15.146:0/2457964875 conn(0x7f50f40b2060 msgr2=0x7f50f40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.099+0000 7f50fbc9b640 1 -- 172.21.15.146:0/2457964875 shutdown_connections 2024-09-17T03:44:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.099+0000 7f50fbc9b640 1 -- 172.21.15.146:0/2457964875 wait complete. 2024-09-17T03:44:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.100+0000 7f50fbc9b640 1 Processor -- start 2024-09-17T03:44:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.100+0000 7f50fbc9b640 1 -- start start 2024-09-17T03:44:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fbc9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f4072470 0x7f50f41f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fbc9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f40b50f0 0x7f50f40cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fbc9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f414ad90 0x7f50f4151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fbc9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f50f4165d30 con 0x7f50f414ad90 2024-09-17T03:44:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fbc9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f50f4070770 con 0x7f50f4072470 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fbc9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f50f4165eb0 con 0x7f50f40b50f0 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fa238640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f414ad90 0x7f50f4151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fa238640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f414ad90 0x7f50f4151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48178/0 (socket says 172.21.15.146:48178) 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fa238640 1 -- 172.21.15.146:0/110882328 learned_addr learned my addr 172.21.15.146:0/110882328 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50f9a37640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f4072470 0x7f50f41f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50f9236640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f40b50f0 0x7f50f40cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fa238640 1 -- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f40b50f0 msgr2=0x7f50f40cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fa238640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f40b50f0 0x7f50f40cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fa238640 1 -- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f4072470 msgr2=0x7f50f41f6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fa238640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f4072470 0x7f50f41f6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fa238640 1 -- 172.21.15.146:0/110882328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f41f73e0 con 0x7f50f414ad90 2024-09-17T03:44:44.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50f9236640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f40b50f0 0x7f50f40cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:44.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.102+0000 7f50fa238640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f414ad90 0x7f50f4151250 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00ade0 tx=0x7f50ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:44.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.103+0000 7f50ea7fc640 1 -- 172.21.15.146:0/110882328 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec03d480 con 0x7f50f414ad90 2024-09-17T03:44:44.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.103+0000 7f50ea7fc640 1 -- 172.21.15.146:0/110882328 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50ec042070 con 0x7f50f414ad90 2024-09-17T03:44:44.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.103+0000 7f50fbc9b640 1 -- 172.21.15.146:0/110882328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f41f76c0 con 0x7f50f414ad90 2024-09-17T03:44:44.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.103+0000 7f50ea7fc640 1 -- 172.21.15.146:0/110882328 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec03d990 con 0x7f50f414ad90 2024-09-17T03:44:44.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.103+0000 7f50fbc9b640 1 -- 172.21.15.146:0/110882328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f40ce770 con 0x7f50f414ad90 2024-09-17T03:44:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.104+0000 7f50fbc9b640 1 -- 172.21.15.146:0/110882328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f40ce9d0 con 0x7f50f414ad90 2024-09-17T03:44:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.105+0000 7f50ea7fc640 1 -- 172.21.15.146:0/110882328 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f50ec03db30 con 0x7f50f414ad90 2024-09-17T03:44:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.105+0000 7f50ea7fc640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f50d8078bc0 0x7f50d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.105+0000 7f50ea7fc640 1 -- 172.21.15.146:0/110882328 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f50ec0bc820 con 0x7f50f414ad90 2024-09-17T03:44:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.105+0000 7f50f9a37640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f50d8078bc0 0x7f50d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.106+0000 7f50f9a37640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f50d8078bc0 0x7f50d807b0d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000f60 tx=0x7f50f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:44.109 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.110+0000 7f50ea7fc640 1 -- 172.21.15.146:0/110882328 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f50ec084cf0 con 0x7f50f414ad90 2024-09-17T03:44:44.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.283+0000 7f50fbc9b640 1 -- 172.21.15.146:0/110882328 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50f40cf630 con 0x7f50d8078bc0 2024-09-17T03:44:44.287 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.287+0000 7f50ea7fc640 1 -- 172.21.15.146:0/110882328 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252453 (secure 0 0 0) 0x7f50f40cf630 con 0x7f50d8078bc0 2024-09-17T03:44:44.291 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:44.292 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 -- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f50d8078bc0 msgr2=0x7f50d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f50d8078bc0 0x7f50d807b0d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000f60 tx=0x7f50f0009040 comp rx=0 tx=0).stop 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 -- 172.21.15.146:0/110882328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f414ad90 msgr2=0x7f50f4151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f414ad90 0x7f50f4151250 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00ade0 tx=0x7f50ec004270 comp rx=0 tx=0).stop 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 -- 172.21.15.146:0/110882328 shutdown_connections 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f50d8078bc0 0x7f50d807b0d0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50f414ad90 0x7f50f4151250 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f50f40b50f0 0x7f50f40cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 --2- 172.21.15.146:0/110882328 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f50f4072470 0x7f50f41f6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 -- 172.21.15.146:0/110882328 >> 172.21.15.146:0/110882328 conn(0x7f50f40b2060 msgr2=0x7f50f40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 -- 172.21.15.146:0/110882328 shutdown_connections 2024-09-17T03:44:44.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.291+0000 7f50fbc9b640 1 -- 172.21.15.146:0/110882328 wait complete. 2024-09-17T03:44:44.302 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":528,"stamp":"2024-09-17T03:44:43.978300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":467840,"kb_used_data":18504,"kb_used_omap":12,"kb_used_meta":449139,"kb_avail":754506880,"statfs":{"total":773094113280,"available":772615045120,"internally_reserved":0,"allocated":18948096,"data_stored":8974836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":459918897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.488442"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091840+0000","last_change":"2024-09-17T03:44:35.501652+0000","last_active":"2024-09-17T03:44:37.091840+0000","last_peered":"2024-09-17T03:44:37.091840+0000","last_clean":"2024-09-17T03:44:37.091840+0000","last_became_active":"2024-09-17T03:44:35.501332+0000","last_became_peered":"2024-09-17T03:44:35.501332+0000","last_unstale":"2024-09-17T03:44:37.091840+0000","last_undegraded":"2024-09-17T03:44:37.091840+0000","last_fullsized":"2024-09-17T03:44:37.091840+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:53.854135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091399+0000","last_change":"2024-09-17T03:44:35.511226+0000","last_active":"2024-09-17T03:44:37.091399+0000","last_peered":"2024-09-17T03:44:37.091399+0000","last_clean":"2024-09-17T03:44:37.091399+0000","last_became_active":"2024-09-17T03:44:35.510919+0000","last_became_peered":"2024-09-17T03:44:35.510919+0000","last_unstale":"2024-09-17T03:44:37.091399+0000","last_undegraded":"2024-09-17T03:44:37.091399+0000","last_fullsized":"2024-09-17T03:44:37.091399+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:13.140658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736901+0000","last_change":"2024-09-17T03:44:35.505142+0000","last_active":"2024-09-17T03:44:36.736901+0000","last_peered":"2024-09-17T03:44:36.736901+0000","last_clean":"2024-09-17T03:44:36.736901+0000","last_became_active":"2024-09-17T03:44:35.503630+0000","last_became_peered":"2024-09-17T03:44:35.503630+0000","last_unstale":"2024-09-17T03:44:36.736901+0000","last_undegraded":"2024-09-17T03:44:36.736901+0000","last_fullsized":"2024-09-17T03:44:36.736901+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:32.237378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560359+0000","last_change":"2024-09-17T03:44:35.516826+0000","last_active":"2024-09-17T03:44:36.560359+0000","last_peered":"2024-09-17T03:44:36.560359+0000","last_clean":"2024-09-17T03:44:36.560359+0000","last_became_active":"2024-09-17T03:44:35.516467+0000","last_became_peered":"2024-09-17T03:44:35.516467+0000","last_unstale":"2024-09-17T03:44:36.560359+0000","last_undegraded":"2024-09-17T03:44:36.560359+0000","last_fullsized":"2024-09-17T03:44:36.560359+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:06.727326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492653+0000","last_change":"2024-09-17T03:44:35.517344+0000","last_active":"2024-09-17T03:44:36.492653+0000","last_peered":"2024-09-17T03:44:36.492653+0000","last_clean":"2024-09-17T03:44:36.492653+0000","last_became_active":"2024-09-17T03:44:35.516994+0000","last_became_peered":"2024-09-17T03:44:35.516994+0000","last_unstale":"2024-09-17T03:44:36.492653+0000","last_undegraded":"2024-09-17T03:44:36.492653+0000","last_fullsized":"2024-09-17T03:44:36.492653+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:05.651432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492943+0000","last_change":"2024-09-17T03:44:35.513238+0000","last_active":"2024-09-17T03:44:36.492943+0000","last_peered":"2024-09-17T03:44:36.492943+0000","last_clean":"2024-09-17T03:44:36.492943+0000","last_became_active":"2024-09-17T03:44:35.512950+0000","last_became_peered":"2024-09-17T03:44:35.512950+0000","last_unstale":"2024-09-17T03:44:36.492943+0000","last_undegraded":"2024-09-17T03:44:36.492943+0000","last_fullsized":"2024-09-17T03:44:36.492943+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:27.101587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091170+0000","last_change":"2024-09-17T03:44:35.511166+0000","last_active":"2024-09-17T03:44:37.091170+0000","last_peered":"2024-09-17T03:44:37.091170+0000","last_clean":"2024-09-17T03:44:37.091170+0000","last_became_active":"2024-09-17T03:44:35.510859+0000","last_became_peered":"2024-09-17T03:44:35.510859+0000","last_unstale":"2024-09-17T03:44:37.091170+0000","last_undegraded":"2024-09-17T03:44:37.091170+0000","last_fullsized":"2024-09-17T03:44:37.091170+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:43.512265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492353+0000","last_change":"2024-09-17T03:44:35.509502+0000","last_active":"2024-09-17T03:44:36.492353+0000","last_peered":"2024-09-17T03:44:36.492353+0000","last_clean":"2024-09-17T03:44:36.492353+0000","last_became_active":"2024-09-17T03:44:35.509199+0000","last_became_peered":"2024-09-17T03:44:35.509199+0000","last_unstale":"2024-09-17T03:44:36.492353+0000","last_undegraded":"2024-09-17T03:44:36.492353+0000","last_fullsized":"2024-09-17T03:44:36.492353+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:20.369104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091476+0000","last_change":"2024-09-17T03:44:35.510397+0000","last_active":"2024-09-17T03:44:37.091476+0000","last_peered":"2024-09-17T03:44:37.091476+0000","last_clean":"2024-09-17T03:44:37.091476+0000","last_became_active":"2024-09-17T03:44:35.510097+0000","last_became_peered":"2024-09-17T03:44:35.510097+0000","last_unstale":"2024-09-17T03:44:37.091476+0000","last_undegraded":"2024-09-17T03:44:37.091476+0000","last_fullsized":"2024-09-17T03:44:37.091476+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:54.322849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704318+0000","last_change":"2024-09-17T03:44:35.523683+0000","last_active":"2024-09-17T03:44:36.704318+0000","last_peered":"2024-09-17T03:44:36.704318+0000","last_clean":"2024-09-17T03:44:36.704318+0000","last_became_active":"2024-09-17T03:44:35.523362+0000","last_became_peered":"2024-09-17T03:44:35.523362+0000","last_unstale":"2024-09-17T03:44:36.704318+0000","last_undegraded":"2024-09-17T03:44:36.704318+0000","last_fullsized":"2024-09-17T03:44:36.704318+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:47.040157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736998+0000","last_change":"2024-09-17T03:44:35.522118+0000","last_active":"2024-09-17T03:44:36.736998+0000","last_peered":"2024-09-17T03:44:36.736998+0000","last_clean":"2024-09-17T03:44:36.736998+0000","last_became_active":"2024-09-17T03:44:35.521106+0000","last_became_peered":"2024-09-17T03:44:35.521106+0000","last_unstale":"2024-09-17T03:44:36.736998+0000","last_undegraded":"2024-09-17T03:44:36.736998+0000","last_fullsized":"2024-09-17T03:44:36.736998+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:48.040111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496008+0000","last_change":"2024-09-17T03:44:35.511467+0000","last_active":"2024-09-17T03:44:36.496008+0000","last_peered":"2024-09-17T03:44:36.496008+0000","last_clean":"2024-09-17T03:44:36.496008+0000","last_became_active":"2024-09-17T03:44:35.510852+0000","last_became_peered":"2024-09-17T03:44:35.510852+0000","last_unstale":"2024-09-17T03:44:36.496008+0000","last_undegraded":"2024-09-17T03:44:36.496008+0000","last_fullsized":"2024-09-17T03:44:36.496008+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:47.965353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496731+0000","last_change":"2024-09-17T03:44:35.498609+0000","last_active":"2024-09-17T03:44:36.496731+0000","last_peered":"2024-09-17T03:44:36.496731+0000","last_clean":"2024-09-17T03:44:36.496731+0000","last_became_active":"2024-09-17T03:44:35.498220+0000","last_became_peered":"2024-09-17T03:44:35.498220+0000","last_unstale":"2024-09-17T03:44:36.496731+0000","last_undegraded":"2024-09-17T03:44:36.496731+0000","last_fullsized":"2024-09-17T03:44:36.496731+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:31.628305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091377+0000","last_change":"2024-09-17T03:44:35.498274+0000","last_active":"2024-09-17T03:44:37.091377+0000","last_peered":"2024-09-17T03:44:37.091377+0000","last_clean":"2024-09-17T03:44:37.091377+0000","last_became_active":"2024-09-17T03:44:35.497945+0000","last_became_peered":"2024-09-17T03:44:35.497945+0000","last_unstale":"2024-09-17T03:44:37.091377+0000","last_undegraded":"2024-09-17T03:44:37.091377+0000","last_fullsized":"2024-09-17T03:44:37.091377+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:58.351462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091265+0000","last_change":"2024-09-17T03:44:35.502806+0000","last_active":"2024-09-17T03:44:37.091265+0000","last_peered":"2024-09-17T03:44:37.091265+0000","last_clean":"2024-09-17T03:44:37.091265+0000","last_became_active":"2024-09-17T03:44:35.502487+0000","last_became_peered":"2024-09-17T03:44:35.502487+0000","last_unstale":"2024-09-17T03:44:37.091265+0000","last_undegraded":"2024-09-17T03:44:37.091265+0000","last_fullsized":"2024-09-17T03:44:37.091265+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:15.717384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704050+0000","last_change":"2024-09-17T03:44:35.518950+0000","last_active":"2024-09-17T03:44:36.704050+0000","last_peered":"2024-09-17T03:44:36.704050+0000","last_clean":"2024-09-17T03:44:36.704050+0000","last_became_active":"2024-09-17T03:44:35.518668+0000","last_became_peered":"2024-09-17T03:44:35.518668+0000","last_unstale":"2024-09-17T03:44:36.704050+0000","last_undegraded":"2024-09-17T03:44:36.704050+0000","last_fullsized":"2024-09-17T03:44:36.704050+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:01.877073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091816+0000","last_change":"2024-09-17T03:44:35.501005+0000","last_active":"2024-09-17T03:44:37.091816+0000","last_peered":"2024-09-17T03:44:37.091816+0000","last_clean":"2024-09-17T03:44:37.091816+0000","last_became_active":"2024-09-17T03:44:35.500713+0000","last_became_peered":"2024-09-17T03:44:35.500713+0000","last_unstale":"2024-09-17T03:44:37.091816+0000","last_undegraded":"2024-09-17T03:44:37.091816+0000","last_fullsized":"2024-09-17T03:44:37.091816+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:50.341011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704369+0000","last_change":"2024-09-17T03:44:35.522929+0000","last_active":"2024-09-17T03:44:36.704369+0000","last_peered":"2024-09-17T03:44:36.704369+0000","last_clean":"2024-09-17T03:44:36.704369+0000","last_became_active":"2024-09-17T03:44:35.522419+0000","last_became_peered":"2024-09-17T03:44:35.522419+0000","last_unstale":"2024-09-17T03:44:36.704369+0000","last_undegraded":"2024-09-17T03:44:36.704369+0000","last_fullsized":"2024-09-17T03:44:36.704369+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:27.801044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704537+0000","last_change":"2024-09-17T03:44:35.523107+0000","last_active":"2024-09-17T03:44:36.704537+0000","last_peered":"2024-09-17T03:44:36.704537+0000","last_clean":"2024-09-17T03:44:36.704537+0000","last_became_active":"2024-09-17T03:44:35.522655+0000","last_became_peered":"2024-09-17T03:44:35.522655+0000","last_unstale":"2024-09-17T03:44:36.704537+0000","last_undegraded":"2024-09-17T03:44:36.704537+0000","last_fullsized":"2024-09-17T03:44:36.704537+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:38.500491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492728+0000","last_change":"2024-09-17T03:44:35.512596+0000","last_active":"2024-09-17T03:44:36.492728+0000","last_peered":"2024-09-17T03:44:36.492728+0000","last_clean":"2024-09-17T03:44:36.492728+0000","last_became_active":"2024-09-17T03:44:35.512241+0000","last_became_peered":"2024-09-17T03:44:35.512241+0000","last_unstale":"2024-09-17T03:44:36.492728+0000","last_undegraded":"2024-09-17T03:44:36.492728+0000","last_fullsized":"2024-09-17T03:44:36.492728+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:14.720703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560145+0000","last_change":"2024-09-17T03:44:35.509155+0000","last_active":"2024-09-17T03:44:36.560145+0000","last_peered":"2024-09-17T03:44:36.560145+0000","last_clean":"2024-09-17T03:44:36.560145+0000","last_became_active":"2024-09-17T03:44:35.508764+0000","last_became_peered":"2024-09-17T03:44:35.508764+0000","last_unstale":"2024-09-17T03:44:36.560145+0000","last_undegraded":"2024-09-17T03:44:36.560145+0000","last_fullsized":"2024-09-17T03:44:36.560145+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:39.874649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495869+0000","last_change":"2024-09-17T03:44:35.514858+0000","last_active":"2024-09-17T03:44:36.495869+0000","last_peered":"2024-09-17T03:44:36.495869+0000","last_clean":"2024-09-17T03:44:36.495869+0000","last_became_active":"2024-09-17T03:44:35.514478+0000","last_became_peered":"2024-09-17T03:44:35.514478+0000","last_unstale":"2024-09-17T03:44:36.495869+0000","last_undegraded":"2024-09-17T03:44:36.495869+0000","last_fullsized":"2024-09-17T03:44:36.495869+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:15.280435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495700+0000","last_change":"2024-09-17T03:44:35.509000+0000","last_active":"2024-09-17T03:44:36.495700+0000","last_peered":"2024-09-17T03:44:36.495700+0000","last_clean":"2024-09-17T03:44:36.495700+0000","last_became_active":"2024-09-17T03:44:35.507413+0000","last_became_peered":"2024-09-17T03:44:35.507413+0000","last_unstale":"2024-09-17T03:44:36.495700+0000","last_undegraded":"2024-09-17T03:44:36.495700+0000","last_fullsized":"2024-09-17T03:44:36.495700+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:45.655104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.559968+0000","last_change":"2024-09-17T03:44:35.509513+0000","last_active":"2024-09-17T03:44:36.559968+0000","last_peered":"2024-09-17T03:44:36.559968+0000","last_clean":"2024-09-17T03:44:36.559968+0000","last_became_active":"2024-09-17T03:44:35.509188+0000","last_became_peered":"2024-09-17T03:44:35.509188+0000","last_unstale":"2024-09-17T03:44:36.559968+0000","last_undegraded":"2024-09-17T03:44:36.559968+0000","last_fullsized":"2024-09-17T03:44:36.559968+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:37.993184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091224+0000","last_change":"2024-09-17T03:44:35.515781+0000","last_active":"2024-09-17T03:44:37.091224+0000","last_peered":"2024-09-17T03:44:37.091224+0000","last_clean":"2024-09-17T03:44:37.091224+0000","last_became_active":"2024-09-17T03:44:35.515189+0000","last_became_peered":"2024-09-17T03:44:35.515189+0000","last_unstale":"2024-09-17T03:44:37.091224+0000","last_undegraded":"2024-09-17T03:44:37.091224+0000","last_fullsized":"2024-09-17T03:44:37.091224+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:28.320921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091829+0000","last_change":"2024-09-17T03:44:35.510737+0000","last_active":"2024-09-17T03:44:37.091829+0000","last_peered":"2024-09-17T03:44:37.091829+0000","last_clean":"2024-09-17T03:44:37.091829+0000","last_became_active":"2024-09-17T03:44:35.510434+0000","last_became_peered":"2024-09-17T03:44:35.510434+0000","last_unstale":"2024-09-17T03:44:37.091829+0000","last_undegraded":"2024-09-17T03:44:37.091829+0000","last_fullsized":"2024-09-17T03:44:37.091829+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:34.100442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495871+0000","last_change":"2024-09-17T03:44:35.511390+0000","last_active":"2024-09-17T03:44:36.495871+0000","last_peered":"2024-09-17T03:44:36.495871+0000","last_clean":"2024-09-17T03:44:36.495871+0000","last_became_active":"2024-09-17T03:44:35.510575+0000","last_became_peered":"2024-09-17T03:44:35.510575+0000","last_unstale":"2024-09-17T03:44:36.495871+0000","last_undegraded":"2024-09-17T03:44:36.495871+0000","last_fullsized":"2024-09-17T03:44:36.495871+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:17.523096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736731+0000","last_change":"2024-09-17T03:44:35.506964+0000","last_active":"2024-09-17T03:44:36.736731+0000","last_peered":"2024-09-17T03:44:36.736731+0000","last_clean":"2024-09-17T03:44:36.736731+0000","last_became_active":"2024-09-17T03:44:35.506673+0000","last_became_peered":"2024-09-17T03:44:35.506673+0000","last_unstale":"2024-09-17T03:44:36.736731+0000","last_undegraded":"2024-09-17T03:44:36.736731+0000","last_fullsized":"2024-09-17T03:44:36.736731+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:55.838810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496252+0000","last_change":"2024-09-17T03:44:35.510967+0000","last_active":"2024-09-17T03:44:36.496252+0000","last_peered":"2024-09-17T03:44:36.496252+0000","last_clean":"2024-09-17T03:44:36.496252+0000","last_became_active":"2024-09-17T03:44:35.510633+0000","last_became_peered":"2024-09-17T03:44:35.510633+0000","last_unstale":"2024-09-17T03:44:36.496252+0000","last_undegraded":"2024-09-17T03:44:36.496252+0000","last_fullsized":"2024-09-17T03:44:36.496252+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:57.377466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091089+0000","last_change":"2024-09-17T03:44:35.507298+0000","last_active":"2024-09-17T03:44:37.091089+0000","last_peered":"2024-09-17T03:44:37.091089+0000","last_clean":"2024-09-17T03:44:37.091089+0000","last_became_active":"2024-09-17T03:44:35.506929+0000","last_became_peered":"2024-09-17T03:44:35.506929+0000","last_unstale":"2024-09-17T03:44:37.091089+0000","last_undegraded":"2024-09-17T03:44:37.091089+0000","last_fullsized":"2024-09-17T03:44:37.091089+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:52.753354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704158+0000","last_change":"2024-09-17T03:44:35.511788+0000","last_active":"2024-09-17T03:44:36.704158+0000","last_peered":"2024-09-17T03:44:36.704158+0000","last_clean":"2024-09-17T03:44:36.704158+0000","last_became_active":"2024-09-17T03:44:35.511502+0000","last_became_peered":"2024-09-17T03:44:35.511502+0000","last_unstale":"2024-09-17T03:44:36.704158+0000","last_undegraded":"2024-09-17T03:44:36.704158+0000","last_fullsized":"2024-09-17T03:44:36.704158+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:17.382875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091087+0000","last_change":"2024-09-17T03:44:35.503091+0000","last_active":"2024-09-17T03:44:37.091087+0000","last_peered":"2024-09-17T03:44:37.091087+0000","last_clean":"2024-09-17T03:44:37.091087+0000","last_became_active":"2024-09-17T03:44:35.502779+0000","last_became_peered":"2024-09-17T03:44:35.502779+0000","last_unstale":"2024-09-17T03:44:37.091087+0000","last_undegraded":"2024-09-17T03:44:37.091087+0000","last_fullsized":"2024-09-17T03:44:37.091087+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:57.611510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091331+0000","last_change":"2024-09-17T03:44:35.517115+0000","last_active":"2024-09-17T03:44:37.091331+0000","last_peered":"2024-09-17T03:44:37.091331+0000","last_clean":"2024-09-17T03:44:37.091331+0000","last_became_active":"2024-09-17T03:44:35.515962+0000","last_became_peered":"2024-09-17T03:44:35.515962+0000","last_unstale":"2024-09-17T03:44:37.091331+0000","last_undegraded":"2024-09-17T03:44:37.091331+0000","last_fullsized":"2024-09-17T03:44:37.091331+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:14.022854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"175'4","reported_seq":19,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495904+0000","last_change":"2024-09-17T03:44:34.504463+0000","last_active":"2024-09-17T03:44:36.495904+0000","last_peered":"2024-09-17T03:44:36.495904+0000","last_clean":"2024-09-17T03:44:36.495904+0000","last_became_active":"2024-09-17T03:44:34.504157+0000","last_became_peered":"2024-09-17T03:44:34.504157+0000","last_unstale":"2024-09-17T03:44:36.495904+0000","last_undegraded":"2024-09-17T03:44:36.495904+0000","last_fullsized":"2024-09-17T03:44:36.495904+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:22.218666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495607+0000","last_change":"2024-09-17T03:44:35.501626+0000","last_active":"2024-09-17T03:44:36.495607+0000","last_peered":"2024-09-17T03:44:36.495607+0000","last_clean":"2024-09-17T03:44:36.495607+0000","last_became_active":"2024-09-17T03:44:35.501175+0000","last_became_peered":"2024-09-17T03:44:35.501175+0000","last_unstale":"2024-09-17T03:44:36.495607+0000","last_undegraded":"2024-09-17T03:44:36.495607+0000","last_fullsized":"2024-09-17T03:44:36.495607+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:45.864026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091596+0000","last_change":"2024-09-17T03:44:34.504505+0000","last_active":"2024-09-17T03:44:37.091596+0000","last_peered":"2024-09-17T03:44:37.091596+0000","last_clean":"2024-09-17T03:44:37.091596+0000","last_became_active":"2024-09-17T03:44:34.504196+0000","last_became_peered":"2024-09-17T03:44:34.504196+0000","last_unstale":"2024-09-17T03:44:37.091596+0000","last_undegraded":"2024-09-17T03:44:37.091596+0000","last_fullsized":"2024-09-17T03:44:37.091596+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:24.474885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091469+0000","last_change":"2024-09-17T03:44:35.503935+0000","last_active":"2024-09-17T03:44:37.091469+0000","last_peered":"2024-09-17T03:44:37.091469+0000","last_clean":"2024-09-17T03:44:37.091469+0000","last_became_active":"2024-09-17T03:44:35.503023+0000","last_became_peered":"2024-09-17T03:44:35.503023+0000","last_unstale":"2024-09-17T03:44:37.091469+0000","last_undegraded":"2024-09-17T03:44:37.091469+0000","last_fullsized":"2024-09-17T03:44:37.091469+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:10.739917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.737085+0000","last_change":"2024-09-17T03:44:34.504667+0000","last_active":"2024-09-17T03:44:36.737085+0000","last_peered":"2024-09-17T03:44:36.737085+0000","last_clean":"2024-09-17T03:44:36.737085+0000","last_became_active":"2024-09-17T03:44:34.504379+0000","last_became_peered":"2024-09-17T03:44:34.504379+0000","last_unstale":"2024-09-17T03:44:36.737085+0000","last_undegraded":"2024-09-17T03:44:36.737085+0000","last_fullsized":"2024-09-17T03:44:36.737085+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:12.682497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704463+0000","last_change":"2024-09-17T03:44:35.524639+0000","last_active":"2024-09-17T03:44:36.704463+0000","last_peered":"2024-09-17T03:44:36.704463+0000","last_clean":"2024-09-17T03:44:36.704463+0000","last_became_active":"2024-09-17T03:44:35.523895+0000","last_became_peered":"2024-09-17T03:44:35.523895+0000","last_unstale":"2024-09-17T03:44:36.704463+0000","last_undegraded":"2024-09-17T03:44:36.704463+0000","last_fullsized":"2024-09-17T03:44:36.704463+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:10.381259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560581+0000","last_change":"2024-09-17T03:44:34.508067+0000","last_active":"2024-09-17T03:44:36.560581+0000","last_peered":"2024-09-17T03:44:36.560581+0000","last_clean":"2024-09-17T03:44:36.560581+0000","last_became_active":"2024-09-17T03:44:34.507724+0000","last_became_peered":"2024-09-17T03:44:34.507724+0000","last_unstale":"2024-09-17T03:44:36.560581+0000","last_undegraded":"2024-09-17T03:44:36.560581+0000","last_fullsized":"2024-09-17T03:44:36.560581+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:52.721696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560052+0000","last_change":"2024-09-17T03:44:35.518249+0000","last_active":"2024-09-17T03:44:36.560052+0000","last_peered":"2024-09-17T03:44:36.560052+0000","last_clean":"2024-09-17T03:44:36.560052+0000","last_became_active":"2024-09-17T03:44:35.517928+0000","last_became_peered":"2024-09-17T03:44:35.517928+0000","last_unstale":"2024-09-17T03:44:36.560052+0000","last_undegraded":"2024-09-17T03:44:36.560052+0000","last_fullsized":"2024-09-17T03:44:36.560052+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:46.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.493100+0000","last_change":"2024-09-17T03:44:34.508184+0000","last_active":"2024-09-17T03:44:36.493100+0000","last_peered":"2024-09-17T03:44:36.493100+0000","last_clean":"2024-09-17T03:44:36.493100+0000","last_became_active":"2024-09-17T03:44:34.507648+0000","last_became_peered":"2024-09-17T03:44:34.507648+0000","last_unstale":"2024-09-17T03:44:36.493100+0000","last_undegraded":"2024-09-17T03:44:36.493100+0000","last_fullsized":"2024-09-17T03:44:36.493100+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:45.906545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492571+0000","last_change":"2024-09-17T03:44:35.505629+0000","last_active":"2024-09-17T03:44:36.492571+0000","last_peered":"2024-09-17T03:44:36.492571+0000","last_clean":"2024-09-17T03:44:36.492571+0000","last_became_active":"2024-09-17T03:44:35.505324+0000","last_became_peered":"2024-09-17T03:44:35.505324+0000","last_unstale":"2024-09-17T03:44:36.492571+0000","last_undegraded":"2024-09-17T03:44:36.492571+0000","last_fullsized":"2024-09-17T03:44:36.492571+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:01.846555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492310+0000","last_change":"2024-09-17T03:44:34.508918+0000","last_active":"2024-09-17T03:44:36.492310+0000","last_peered":"2024-09-17T03:44:36.492310+0000","last_clean":"2024-09-17T03:44:36.492310+0000","last_became_active":"2024-09-17T03:44:34.508610+0000","last_became_peered":"2024-09-17T03:44:34.508610+0000","last_unstale":"2024-09-17T03:44:36.492310+0000","last_undegraded":"2024-09-17T03:44:36.492310+0000","last_fullsized":"2024-09-17T03:44:36.492310+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:46.202281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560045+0000","last_change":"2024-09-17T03:44:35.515640+0000","last_active":"2024-09-17T03:44:36.560045+0000","last_peered":"2024-09-17T03:44:36.560045+0000","last_clean":"2024-09-17T03:44:36.560045+0000","last_became_active":"2024-09-17T03:44:35.515192+0000","last_became_peered":"2024-09-17T03:44:35.515192+0000","last_unstale":"2024-09-17T03:44:36.560045+0000","last_undegraded":"2024-09-17T03:44:36.560045+0000","last_fullsized":"2024-09-17T03:44:36.560045+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:30.298955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495492+0000","last_change":"2024-09-17T03:44:34.507308+0000","last_active":"2024-09-17T03:44:36.495492+0000","last_peered":"2024-09-17T03:44:36.495492+0000","last_clean":"2024-09-17T03:44:36.495492+0000","last_became_active":"2024-09-17T03:44:34.506910+0000","last_became_peered":"2024-09-17T03:44:34.506910+0000","last_unstale":"2024-09-17T03:44:36.495492+0000","last_undegraded":"2024-09-17T03:44:36.495492+0000","last_fullsized":"2024-09-17T03:44:36.495492+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:23.781060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560481+0000","last_change":"2024-09-17T03:44:35.512499+0000","last_active":"2024-09-17T03:44:36.560481+0000","last_peered":"2024-09-17T03:44:36.560481+0000","last_clean":"2024-09-17T03:44:36.560481+0000","last_became_active":"2024-09-17T03:44:35.512152+0000","last_became_peered":"2024-09-17T03:44:35.512152+0000","last_unstale":"2024-09-17T03:44:36.560481+0000","last_undegraded":"2024-09-17T03:44:36.560481+0000","last_fullsized":"2024-09-17T03:44:36.560481+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:06.457427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492695+0000","last_change":"2024-09-17T03:44:34.504070+0000","last_active":"2024-09-17T03:44:36.492695+0000","last_peered":"2024-09-17T03:44:36.492695+0000","last_clean":"2024-09-17T03:44:36.492695+0000","last_became_active":"2024-09-17T03:44:34.503697+0000","last_became_peered":"2024-09-17T03:44:34.503697+0000","last_unstale":"2024-09-17T03:44:36.492695+0000","last_undegraded":"2024-09-17T03:44:36.492695+0000","last_fullsized":"2024-09-17T03:44:36.492695+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:19.746915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736950+0000","last_change":"2024-09-17T03:44:35.505813+0000","last_active":"2024-09-17T03:44:36.736950+0000","last_peered":"2024-09-17T03:44:36.736950+0000","last_clean":"2024-09-17T03:44:36.736950+0000","last_became_active":"2024-09-17T03:44:35.504368+0000","last_became_peered":"2024-09-17T03:44:35.504368+0000","last_unstale":"2024-09-17T03:44:36.736950+0000","last_undegraded":"2024-09-17T03:44:36.736950+0000","last_fullsized":"2024-09-17T03:44:36.736950+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:25.317311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496031+0000","last_change":"2024-09-17T03:44:34.504467+0000","last_active":"2024-09-17T03:44:36.496031+0000","last_peered":"2024-09-17T03:44:36.496031+0000","last_clean":"2024-09-17T03:44:36.496031+0000","last_became_active":"2024-09-17T03:44:34.504157+0000","last_became_peered":"2024-09-17T03:44:34.504157+0000","last_unstale":"2024-09-17T03:44:36.496031+0000","last_undegraded":"2024-09-17T03:44:36.496031+0000","last_fullsized":"2024-09-17T03:44:36.496031+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:45.906545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560514+0000","last_change":"2024-09-17T03:44:35.514270+0000","last_active":"2024-09-17T03:44:36.560514+0000","last_peered":"2024-09-17T03:44:36.560514+0000","last_clean":"2024-09-17T03:44:36.560514+0000","last_became_active":"2024-09-17T03:44:35.513969+0000","last_became_peered":"2024-09-17T03:44:35.513969+0000","last_unstale":"2024-09-17T03:44:36.560514+0000","last_undegraded":"2024-09-17T03:44:36.560514+0000","last_fullsized":"2024-09-17T03:44:36.560514+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:57.611510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"175'3","reported_seq":18,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704588+0000","last_change":"2024-09-17T03:44:34.508692+0000","last_active":"2024-09-17T03:44:36.704588+0000","last_peered":"2024-09-17T03:44:36.704588+0000","last_clean":"2024-09-17T03:44:36.704588+0000","last_became_active":"2024-09-17T03:44:34.508213+0000","last_became_peered":"2024-09-17T03:44:34.508213+0000","last_unstale":"2024-09-17T03:44:36.704588+0000","last_undegraded":"2024-09-17T03:44:36.704588+0000","last_fullsized":"2024-09-17T03:44:36.704588+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:14.238753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091807+0000","last_change":"2024-09-17T03:44:35.506966+0000","last_active":"2024-09-17T03:44:37.091807+0000","last_peered":"2024-09-17T03:44:37.091807+0000","last_clean":"2024-09-17T03:44:37.091807+0000","last_became_active":"2024-09-17T03:44:35.503150+0000","last_became_peered":"2024-09-17T03:44:35.503150+0000","last_unstale":"2024-09-17T03:44:37.091807+0000","last_undegraded":"2024-09-17T03:44:37.091807+0000","last_fullsized":"2024-09-17T03:44:37.091807+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:06.497317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"175'6","reported_seq":21,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560677+0000","last_change":"2024-09-17T03:44:34.506888+0000","last_active":"2024-09-17T03:44:36.560677+0000","last_peered":"2024-09-17T03:44:36.560677+0000","last_clean":"2024-09-17T03:44:36.560677+0000","last_became_active":"2024-09-17T03:44:34.506553+0000","last_became_peered":"2024-09-17T03:44:34.506553+0000","last_unstale":"2024-09-17T03:44:36.560677+0000","last_undegraded":"2024-09-17T03:44:36.560677+0000","last_fullsized":"2024-09-17T03:44:36.560677+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:12.270553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492990+0000","last_change":"2024-09-17T03:44:35.518401+0000","last_active":"2024-09-17T03:44:36.492990+0000","last_peered":"2024-09-17T03:44:36.492990+0000","last_clean":"2024-09-17T03:44:36.492990+0000","last_became_active":"2024-09-17T03:44:35.517803+0000","last_became_peered":"2024-09-17T03:44:35.517803+0000","last_unstale":"2024-09-17T03:44:36.492990+0000","last_undegraded":"2024-09-17T03:44:36.492990+0000","last_fullsized":"2024-09-17T03:44:36.492990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:22.898425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496033+0000","last_change":"2024-09-17T03:44:34.507298+0000","last_active":"2024-09-17T03:44:36.496033+0000","last_peered":"2024-09-17T03:44:36.496033+0000","last_clean":"2024-09-17T03:44:36.496033+0000","last_became_active":"2024-09-17T03:44:34.506960+0000","last_became_peered":"2024-09-17T03:44:34.506960+0000","last_unstale":"2024-09-17T03:44:36.496033+0000","last_undegraded":"2024-09-17T03:44:36.496033+0000","last_fullsized":"2024-09-17T03:44:36.496033+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:45.815093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704386+0000","last_change":"2024-09-17T03:44:35.520707+0000","last_active":"2024-09-17T03:44:36.704386+0000","last_peered":"2024-09-17T03:44:36.704386+0000","last_clean":"2024-09-17T03:44:36.704386+0000","last_became_active":"2024-09-17T03:44:35.520292+0000","last_became_peered":"2024-09-17T03:44:35.520292+0000","last_unstale":"2024-09-17T03:44:36.704386+0000","last_undegraded":"2024-09-17T03:44:36.704386+0000","last_fullsized":"2024-09-17T03:44:36.704386+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:35.032797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496096+0000","last_change":"2024-09-17T03:44:34.500426+0000","last_active":"2024-09-17T03:44:36.496096+0000","last_peered":"2024-09-17T03:44:36.496096+0000","last_clean":"2024-09-17T03:44:36.496096+0000","last_became_active":"2024-09-17T03:44:34.500104+0000","last_became_peered":"2024-09-17T03:44:34.500104+0000","last_unstale":"2024-09-17T03:44:36.496096+0000","last_undegraded":"2024-09-17T03:44:36.496096+0000","last_fullsized":"2024-09-17T03:44:36.496096+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:58.067682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736523+0000","last_change":"2024-09-17T03:44:35.505736+0000","last_active":"2024-09-17T03:44:36.736523+0000","last_peered":"2024-09-17T03:44:36.736523+0000","last_clean":"2024-09-17T03:44:36.736523+0000","last_became_active":"2024-09-17T03:44:35.503782+0000","last_became_peered":"2024-09-17T03:44:35.503782+0000","last_unstale":"2024-09-17T03:44:36.736523+0000","last_undegraded":"2024-09-17T03:44:36.736523+0000","last_fullsized":"2024-09-17T03:44:36.736523+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:42.793594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.703928+0000","last_change":"2024-09-17T03:44:34.506973+0000","last_active":"2024-09-17T03:44:36.703928+0000","last_peered":"2024-09-17T03:44:36.703928+0000","last_clean":"2024-09-17T03:44:36.703928+0000","last_became_active":"2024-09-17T03:44:34.506658+0000","last_became_peered":"2024-09-17T03:44:34.506658+0000","last_unstale":"2024-09-17T03:44:36.703928+0000","last_undegraded":"2024-09-17T03:44:36.703928+0000","last_fullsized":"2024-09-17T03:44:36.703928+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:31.118656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091494+0000","last_change":"2024-09-17T03:44:35.509972+0000","last_active":"2024-09-17T03:44:37.091494+0000","last_peered":"2024-09-17T03:44:37.091494+0000","last_clean":"2024-09-17T03:44:37.091494+0000","last_became_active":"2024-09-17T03:44:35.509645+0000","last_became_peered":"2024-09-17T03:44:35.509645+0000","last_unstale":"2024-09-17T03:44:37.091494+0000","last_undegraded":"2024-09-17T03:44:37.091494+0000","last_fullsized":"2024-09-17T03:44:37.091494+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:56.436755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"175'8","reported_seq":23,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736732+0000","last_change":"2024-09-17T03:44:34.505502+0000","last_active":"2024-09-17T03:44:36.736732+0000","last_peered":"2024-09-17T03:44:36.736732+0000","last_clean":"2024-09-17T03:44:36.736732+0000","last_became_active":"2024-09-17T03:44:34.505206+0000","last_became_peered":"2024-09-17T03:44:34.505206+0000","last_unstale":"2024-09-17T03:44:36.736732+0000","last_undegraded":"2024-09-17T03:44:36.736732+0000","last_fullsized":"2024-09-17T03:44:36.736732+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:22.213850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091511+0000","last_change":"2024-09-17T03:44:35.507591+0000","last_active":"2024-09-17T03:44:37.091511+0000","last_peered":"2024-09-17T03:44:37.091511+0000","last_clean":"2024-09-17T03:44:37.091511+0000","last_became_active":"2024-09-17T03:44:35.507301+0000","last_became_peered":"2024-09-17T03:44:35.507301+0000","last_unstale":"2024-09-17T03:44:37.091511+0000","last_undegraded":"2024-09-17T03:44:37.091511+0000","last_fullsized":"2024-09-17T03:44:37.091511+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:31.039012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492795+0000","last_change":"2024-09-17T03:44:34.507954+0000","last_active":"2024-09-17T03:44:36.492795+0000","last_peered":"2024-09-17T03:44:36.492795+0000","last_clean":"2024-09-17T03:44:36.492795+0000","last_became_active":"2024-09-17T03:44:34.507591+0000","last_became_peered":"2024-09-17T03:44:34.507591+0000","last_unstale":"2024-09-17T03:44:36.492795+0000","last_undegraded":"2024-09-17T03:44:36.492795+0000","last_fullsized":"2024-09-17T03:44:36.492795+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:38.758785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091406+0000","last_change":"2024-09-17T03:44:35.515476+0000","last_active":"2024-09-17T03:44:37.091406+0000","last_peered":"2024-09-17T03:44:37.091406+0000","last_clean":"2024-09-17T03:44:37.091406+0000","last_became_active":"2024-09-17T03:44:35.514206+0000","last_became_peered":"2024-09-17T03:44:35.514206+0000","last_unstale":"2024-09-17T03:44:37.091406+0000","last_undegraded":"2024-09-17T03:44:37.091406+0000","last_fullsized":"2024-09-17T03:44:37.091406+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:37.648386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091604+0000","last_change":"2024-09-17T03:44:34.510346+0000","last_active":"2024-09-17T03:44:37.091604+0000","last_peered":"2024-09-17T03:44:37.091604+0000","last_clean":"2024-09-17T03:44:37.091604+0000","last_became_active":"2024-09-17T03:44:34.510051+0000","last_became_peered":"2024-09-17T03:44:34.510051+0000","last_unstale":"2024-09-17T03:44:37.091604+0000","last_undegraded":"2024-09-17T03:44:37.091604+0000","last_fullsized":"2024-09-17T03:44:37.091604+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:23.988642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736741+0000","last_change":"2024-09-17T03:44:35.511999+0000","last_active":"2024-09-17T03:44:36.736741+0000","last_peered":"2024-09-17T03:44:36.736741+0000","last_clean":"2024-09-17T03:44:36.736741+0000","last_became_active":"2024-09-17T03:44:35.511709+0000","last_became_peered":"2024-09-17T03:44:35.511709+0000","last_unstale":"2024-09-17T03:44:36.736741+0000","last_undegraded":"2024-09-17T03:44:36.736741+0000","last_fullsized":"2024-09-17T03:44:36.736741+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:31.963884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704615+0000","last_change":"2024-09-17T03:44:34.509125+0000","last_active":"2024-09-17T03:44:36.704615+0000","last_peered":"2024-09-17T03:44:36.704615+0000","last_clean":"2024-09-17T03:44:36.704615+0000","last_became_active":"2024-09-17T03:44:34.507891+0000","last_became_peered":"2024-09-17T03:44:34.507891+0000","last_unstale":"2024-09-17T03:44:36.704615+0000","last_undegraded":"2024-09-17T03:44:36.704615+0000","last_fullsized":"2024-09-17T03:44:36.704615+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:06.654036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704396+0000","last_change":"2024-09-17T03:44:35.513414+0000","last_active":"2024-09-17T03:44:36.704396+0000","last_peered":"2024-09-17T03:44:36.704396+0000","last_clean":"2024-09-17T03:44:36.704396+0000","last_became_active":"2024-09-17T03:44:35.513121+0000","last_became_peered":"2024-09-17T03:44:35.513121+0000","last_unstale":"2024-09-17T03:44:36.704396+0000","last_undegraded":"2024-09-17T03:44:36.704396+0000","last_fullsized":"2024-09-17T03:44:36.704396+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:51.926469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736934+0000","last_change":"2024-09-17T03:44:34.508494+0000","last_active":"2024-09-17T03:44:36.736934+0000","last_peered":"2024-09-17T03:44:36.736934+0000","last_clean":"2024-09-17T03:44:36.736934+0000","last_became_active":"2024-09-17T03:44:34.508171+0000","last_became_peered":"2024-09-17T03:44:34.508171+0000","last_unstale":"2024-09-17T03:44:36.736934+0000","last_undegraded":"2024-09-17T03:44:36.736934+0000","last_fullsized":"2024-09-17T03:44:36.736934+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:22.342508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704363+0000","last_change":"2024-09-17T03:44:35.517037+0000","last_active":"2024-09-17T03:44:36.704363+0000","last_peered":"2024-09-17T03:44:36.704363+0000","last_clean":"2024-09-17T03:44:36.704363+0000","last_became_active":"2024-09-17T03:44:35.516713+0000","last_became_peered":"2024-09-17T03:44:35.516713+0000","last_unstale":"2024-09-17T03:44:36.704363+0000","last_undegraded":"2024-09-17T03:44:36.704363+0000","last_fullsized":"2024-09-17T03:44:36.704363+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:16.789412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.704298+0000","last_change":"2024-09-17T03:44:34.507042+0000","last_active":"2024-09-17T03:44:36.704298+0000","last_peered":"2024-09-17T03:44:36.704298+0000","last_clean":"2024-09-17T03:44:36.704298+0000","last_became_active":"2024-09-17T03:44:34.506712+0000","last_became_peered":"2024-09-17T03:44:34.506712+0000","last_unstale":"2024-09-17T03:44:36.704298+0000","last_undegraded":"2024-09-17T03:44:36.704298+0000","last_fullsized":"2024-09-17T03:44:36.704298+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:34.767116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736689+0000","last_change":"2024-09-17T03:44:35.506088+0000","last_active":"2024-09-17T03:44:36.736689+0000","last_peered":"2024-09-17T03:44:36.736689+0000","last_clean":"2024-09-17T03:44:36.736689+0000","last_became_active":"2024-09-17T03:44:35.505780+0000","last_became_peered":"2024-09-17T03:44:35.505780+0000","last_unstale":"2024-09-17T03:44:36.736689+0000","last_undegraded":"2024-09-17T03:44:36.736689+0000","last_fullsized":"2024-09-17T03:44:36.736689+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:41.789994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091870+0000","last_change":"2024-09-17T03:44:34.504134+0000","last_active":"2024-09-17T03:44:37.091870+0000","last_peered":"2024-09-17T03:44:37.091870+0000","last_clean":"2024-09-17T03:44:37.091870+0000","last_became_active":"2024-09-17T03:44:34.503719+0000","last_became_peered":"2024-09-17T03:44:34.503719+0000","last_unstale":"2024-09-17T03:44:37.091870+0000","last_undegraded":"2024-09-17T03:44:37.091870+0000","last_fullsized":"2024-09-17T03:44:37.091870+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:15.619123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091143+0000","last_change":"2024-09-17T03:44:35.506822+0000","last_active":"2024-09-17T03:44:37.091143+0000","last_peered":"2024-09-17T03:44:37.091143+0000","last_clean":"2024-09-17T03:44:37.091143+0000","last_became_active":"2024-09-17T03:44:35.506454+0000","last_became_peered":"2024-09-17T03:44:35.506454+0000","last_unstale":"2024-09-17T03:44:37.091143+0000","last_undegraded":"2024-09-17T03:44:37.091143+0000","last_fullsized":"2024-09-17T03:44:37.091143+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:13.279683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091520+0000","last_change":"2024-09-17T03:44:34.499354+0000","last_active":"2024-09-17T03:44:37.091520+0000","last_peered":"2024-09-17T03:44:37.091520+0000","last_clean":"2024-09-17T03:44:37.091520+0000","last_became_active":"2024-09-17T03:44:34.498887+0000","last_became_peered":"2024-09-17T03:44:34.498887+0000","last_unstale":"2024-09-17T03:44:37.091520+0000","last_undegraded":"2024-09-17T03:44:37.091520+0000","last_fullsized":"2024-09-17T03:44:37.091520+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:05.946572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496525+0000","last_change":"2024-09-17T03:44:35.503472+0000","last_active":"2024-09-17T03:44:36.496525+0000","last_peered":"2024-09-17T03:44:36.496525+0000","last_clean":"2024-09-17T03:44:36.496525+0000","last_became_active":"2024-09-17T03:44:35.502874+0000","last_became_peered":"2024-09-17T03:44:35.502874+0000","last_unstale":"2024-09-17T03:44:36.496525+0000","last_undegraded":"2024-09-17T03:44:36.496525+0000","last_fullsized":"2024-09-17T03:44:36.496525+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:10.937538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492554+0000","last_change":"2024-09-17T03:44:34.510288+0000","last_active":"2024-09-17T03:44:36.492554+0000","last_peered":"2024-09-17T03:44:36.492554+0000","last_clean":"2024-09-17T03:44:36.492554+0000","last_became_active":"2024-09-17T03:44:34.509945+0000","last_became_peered":"2024-09-17T03:44:34.509945+0000","last_unstale":"2024-09-17T03:44:36.492554+0000","last_undegraded":"2024-09-17T03:44:36.492554+0000","last_fullsized":"2024-09-17T03:44:36.492554+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:42.238194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.495656+0000","last_change":"2024-09-17T03:44:35.511600+0000","last_active":"2024-09-17T03:44:36.495656+0000","last_peered":"2024-09-17T03:44:36.495656+0000","last_clean":"2024-09-17T03:44:36.495656+0000","last_became_active":"2024-09-17T03:44:35.511281+0000","last_became_peered":"2024-09-17T03:44:35.511281+0000","last_unstale":"2024-09-17T03:44:36.495656+0000","last_undegraded":"2024-09-17T03:44:36.495656+0000","last_fullsized":"2024-09-17T03:44:36.495656+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:12.015745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"175'2","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736905+0000","last_change":"2024-09-17T03:44:34.504336+0000","last_active":"2024-09-17T03:44:36.736905+0000","last_peered":"2024-09-17T03:44:36.736905+0000","last_clean":"2024-09-17T03:44:36.736905+0000","last_became_active":"2024-09-17T03:44:34.504005+0000","last_became_peered":"2024-09-17T03:44:34.504005+0000","last_unstale":"2024-09-17T03:44:36.736905+0000","last_undegraded":"2024-09-17T03:44:36.736905+0000","last_fullsized":"2024-09-17T03:44:36.736905+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:09.876455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.092117+0000","last_change":"2024-09-17T03:44:35.509517+0000","last_active":"2024-09-17T03:44:37.092117+0000","last_peered":"2024-09-17T03:44:37.092117+0000","last_clean":"2024-09-17T03:44:37.092117+0000","last_became_active":"2024-09-17T03:44:35.508452+0000","last_became_peered":"2024-09-17T03:44:35.508452+0000","last_unstale":"2024-09-17T03:44:37.092117+0000","last_undegraded":"2024-09-17T03:44:37.092117+0000","last_fullsized":"2024-09-17T03:44:37.092117+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:15.431678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"176'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560345+0000","last_change":"2024-09-17T03:44:34.506730+0000","last_active":"2024-09-17T03:44:36.560345+0000","last_peered":"2024-09-17T03:44:36.560345+0000","last_clean":"2024-09-17T03:44:36.560345+0000","last_became_active":"2024-09-17T03:44:34.506425+0000","last_became_peered":"2024-09-17T03:44:34.506425+0000","last_unstale":"2024-09-17T03:44:36.560345+0000","last_undegraded":"2024-09-17T03:44:36.560345+0000","last_fullsized":"2024-09-17T03:44:36.560345+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:52.461258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091119+0000","last_change":"2024-09-17T03:44:35.514014+0000","last_active":"2024-09-17T03:44:37.091119+0000","last_peered":"2024-09-17T03:44:37.091119+0000","last_clean":"2024-09-17T03:44:37.091119+0000","last_became_active":"2024-09-17T03:44:35.513696+0000","last_became_peered":"2024-09-17T03:44:35.513696+0000","last_unstale":"2024-09-17T03:44:37.091119+0000","last_undegraded":"2024-09-17T03:44:37.091119+0000","last_fullsized":"2024-09-17T03:44:37.091119+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:37.810185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.492744+0000","last_change":"2024-09-17T03:44:34.507786+0000","last_active":"2024-09-17T03:44:36.492744+0000","last_peered":"2024-09-17T03:44:36.492744+0000","last_clean":"2024-09-17T03:44:36.492744+0000","last_became_active":"2024-09-17T03:44:34.506839+0000","last_became_peered":"2024-09-17T03:44:34.506839+0000","last_unstale":"2024-09-17T03:44:36.492744+0000","last_undegraded":"2024-09-17T03:44:36.492744+0000","last_fullsized":"2024-09-17T03:44:36.492744+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:55.162172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496397+0000","last_change":"2024-09-17T03:44:35.497407+0000","last_active":"2024-09-17T03:44:36.496397+0000","last_peered":"2024-09-17T03:44:36.496397+0000","last_clean":"2024-09-17T03:44:36.496397+0000","last_became_active":"2024-09-17T03:44:35.497085+0000","last_became_peered":"2024-09-17T03:44:35.497085+0000","last_unstale":"2024-09-17T03:44:36.496397+0000","last_undegraded":"2024-09-17T03:44:36.496397+0000","last_fullsized":"2024-09-17T03:44:36.496397+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:38.802645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736939+0000","last_change":"2024-09-17T03:44:34.504327+0000","last_active":"2024-09-17T03:44:36.736939+0000","last_peered":"2024-09-17T03:44:36.736939+0000","last_clean":"2024-09-17T03:44:36.736939+0000","last_became_active":"2024-09-17T03:44:34.504030+0000","last_became_peered":"2024-09-17T03:44:34.504030+0000","last_unstale":"2024-09-17T03:44:36.736939+0000","last_undegraded":"2024-09-17T03:44:36.736939+0000","last_fullsized":"2024-09-17T03:44:36.736939+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:38.341868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091683+0000","last_change":"2024-09-17T03:44:35.506474+0000","last_active":"2024-09-17T03:44:37.091683+0000","last_peered":"2024-09-17T03:44:37.091683+0000","last_clean":"2024-09-17T03:44:37.091683+0000","last_became_active":"2024-09-17T03:44:35.503283+0000","last_became_peered":"2024-09-17T03:44:35.503283+0000","last_unstale":"2024-09-17T03:44:37.091683+0000","last_undegraded":"2024-09-17T03:44:37.091683+0000","last_fullsized":"2024-09-17T03:44:37.091683+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:43.220358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560307+0000","last_change":"2024-09-17T03:44:34.512828+0000","last_active":"2024-09-17T03:44:36.560307+0000","last_peered":"2024-09-17T03:44:36.560307+0000","last_clean":"2024-09-17T03:44:36.560307+0000","last_became_active":"2024-09-17T03:44:34.512469+0000","last_became_peered":"2024-09-17T03:44:34.512469+0000","last_unstale":"2024-09-17T03:44:36.560307+0000","last_undegraded":"2024-09-17T03:44:36.560307+0000","last_fullsized":"2024-09-17T03:44:36.560307+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:48.427101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496486+0000","last_change":"2024-09-17T03:44:35.517753+0000","last_active":"2024-09-17T03:44:36.496486+0000","last_peered":"2024-09-17T03:44:36.496486+0000","last_clean":"2024-09-17T03:44:36.496486+0000","last_became_active":"2024-09-17T03:44:35.517073+0000","last_became_peered":"2024-09-17T03:44:35.517073+0000","last_unstale":"2024-09-17T03:44:36.496486+0000","last_undegraded":"2024-09-17T03:44:36.496486+0000","last_fullsized":"2024-09-17T03:44:36.496486+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:17.733361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.493143+0000","last_change":"2024-09-17T03:44:34.508966+0000","last_active":"2024-09-17T03:44:36.493143+0000","last_peered":"2024-09-17T03:44:36.493143+0000","last_clean":"2024-09-17T03:44:36.493143+0000","last_became_active":"2024-09-17T03:44:34.508648+0000","last_became_peered":"2024-09-17T03:44:34.508648+0000","last_unstale":"2024-09-17T03:44:36.493143+0000","last_undegraded":"2024-09-17T03:44:36.493143+0000","last_fullsized":"2024-09-17T03:44:36.493143+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:53.757515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.736588+0000","last_change":"2024-09-17T03:44:35.505100+0000","last_active":"2024-09-17T03:44:36.736588+0000","last_peered":"2024-09-17T03:44:36.736588+0000","last_clean":"2024-09-17T03:44:36.736588+0000","last_became_active":"2024-09-17T03:44:35.503366+0000","last_became_peered":"2024-09-17T03:44:35.503366+0000","last_unstale":"2024-09-17T03:44:36.736588+0000","last_undegraded":"2024-09-17T03:44:36.736588+0000","last_fullsized":"2024-09-17T03:44:36.736588+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:14.432674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496211+0000","last_change":"2024-09-17T03:44:34.503673+0000","last_active":"2024-09-17T03:44:36.496211+0000","last_peered":"2024-09-17T03:44:36.496211+0000","last_clean":"2024-09-17T03:44:36.496211+0000","last_became_active":"2024-09-17T03:44:34.503331+0000","last_became_peered":"2024-09-17T03:44:34.503331+0000","last_unstale":"2024-09-17T03:44:36.496211+0000","last_undegraded":"2024-09-17T03:44:36.496211+0000","last_fullsized":"2024-09-17T03:44:36.496211+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:53.757515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091048+0000","last_change":"2024-09-17T03:44:35.508733+0000","last_active":"2024-09-17T03:44:37.091048+0000","last_peered":"2024-09-17T03:44:37.091048+0000","last_clean":"2024-09-17T03:44:37.091048+0000","last_became_active":"2024-09-17T03:44:35.508398+0000","last_became_peered":"2024-09-17T03:44:35.508398+0000","last_unstale":"2024-09-17T03:44:37.091048+0000","last_undegraded":"2024-09-17T03:44:37.091048+0000","last_fullsized":"2024-09-17T03:44:37.091048+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:22.623906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496570+0000","last_change":"2024-09-17T03:44:34.500723+0000","last_active":"2024-09-17T03:44:36.496570+0000","last_peered":"2024-09-17T03:44:36.496570+0000","last_clean":"2024-09-17T03:44:36.496570+0000","last_became_active":"2024-09-17T03:44:34.500367+0000","last_became_peered":"2024-09-17T03:44:34.500367+0000","last_unstale":"2024-09-17T03:44:36.496570+0000","last_undegraded":"2024-09-17T03:44:36.496570+0000","last_fullsized":"2024-09-17T03:44:36.496570+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:34.083730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:37.091453+0000","last_change":"2024-09-17T03:44:35.501366+0000","last_active":"2024-09-17T03:44:37.091453+0000","last_peered":"2024-09-17T03:44:37.091453+0000","last_clean":"2024-09-17T03:44:37.091453+0000","last_became_active":"2024-09-17T03:44:35.500193+0000","last_became_peered":"2024-09-17T03:44:35.500193+0000","last_unstale":"2024-09-17T03:44:37.091453+0000","last_undegraded":"2024-09-17T03:44:37.091453+0000","last_fullsized":"2024-09-17T03:44:37.091453+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:34.480039+0000","last_clean_scrub_stamp":"2024-09-17T03:44:34.480039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:43.710871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"175'1","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.496716+0000","last_change":"2024-09-17T03:44:34.508290+0000","last_active":"2024-09-17T03:44:36.496716+0000","last_peered":"2024-09-17T03:44:36.496716+0000","last_clean":"2024-09-17T03:44:36.496716+0000","last_became_active":"2024-09-17T03:44:34.507990+0000","last_became_peered":"2024-09-17T03:44:34.507990+0000","last_unstale":"2024-09-17T03:44:36.496716+0000","last_undegraded":"2024-09-17T03:44:36.496716+0000","last_fullsized":"2024-09-17T03:44:36.496716+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:44:33.477886+0000","last_clean_scrub_stamp":"2024-09-17T03:44:33.477886+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:09.176398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":394,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-17T03:44:36.560164+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:44:36.560164+0000","last_peered":"2024-09-17T03:44:36.560164+0000","last_clean":"2024-09-17T03:44:36.560164+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:44:36.560164+0000","last_undegraded":"2024-09-17T03:44:36.560164+0000","last_fullsized":"2024-09-17T03:44:36.560164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509586,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60308,"kb_used_data":2752,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311532,"statfs":{"total":96636764160,"available":96575008768,"internally_reserved":0,"allocated":2818048,"data_stored":1565640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509586,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59720,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312120,"statfs":{"total":96636764160,"available":96575610880,"internally_reserved":0,"allocated":2215936,"data_stored":974242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509586,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65248,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306592,"statfs":{"total":96636764160,"available":96569950208,"internally_reserved":0,"allocated":2232320,"data_stored":975376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509586,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55556,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316284,"statfs":{"total":96636764160,"available":96579874816,"internally_reserved":0,"allocated":2211840,"data_stored":973660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509587,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2220032,"data_stored":973716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509587,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56140,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315700,"statfs":{"total":96636764160,"available":96579276800,"internally_reserved":0,"allocated":2809856,"data_stored":1564118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55568,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316272,"statfs":{"total":96636764160,"available":96579862528,"internally_reserved":0,"allocated":2215936,"data_stored":974242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55572,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316268,"statfs":{"total":96636764160,"available":96579858432,"internally_reserved":0,"allocated":2224128,"data_stored":973842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:44:44.307 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:44:44.307 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:44:44.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.463+0000 7f0fc3913640 1 -- 172.21.15.146:0/1110620406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fbc0d2330 msgr2=0x7f0fbc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.463+0000 7f0fc3913640 1 --2- 172.21.15.146:0/1110620406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fbc0d2330 0x7f0fbc068d00 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc08d250 tx=0x7f0fb802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.463+0000 7f0fc3913640 1 -- 172.21.15.146:0/1110620406 shutdown_connections 2024-09-17T03:44:44.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.463+0000 7f0fc3913640 1 --2- 172.21.15.146:0/1110620406 >> v2:172.21.15.179:3300/0 conn(0x7f0fbc0b8ea0 0x7f0fbc069240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.463+0000 7f0fc3913640 1 --2- 172.21.15.146:0/1110620406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fbc0d2330 0x7f0fbc068d00 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.463+0000 7f0fc3913640 1 -- 172.21.15.146:0/1110620406 >> 172.21.15.146:0/1110620406 conn(0x7f0fbc06d070 msgr2=0x7f0fbc06d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:44.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.463+0000 7f0fc3913640 1 -- 172.21.15.146:0/1110620406 shutdown_connections 2024-09-17T03:44:44.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.463+0000 7f0fc3913640 1 -- 172.21.15.146:0/1110620406 wait complete. 2024-09-17T03:44:44.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.465+0000 7f0fc3913640 1 Processor -- start 2024-09-17T03:44:44.465 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.465+0000 7f0fc3913640 1 -- start start 2024-09-17T03:44:44.467 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc3913640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fbc0b8ea0 0x7f0fbc1e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc3913640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fbc0d2330 0x7f0fbc0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc3913640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fbc15eda0 0x7f0fbc0cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc3913640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc0cf6d0 con 0x7f0fbc0d2330 2024-09-17T03:44:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc3913640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc069ab0 con 0x7f0fbc0b8ea0 2024-09-17T03:44:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc3913640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc0cf850 con 0x7f0fbc15eda0 2024-09-17T03:44:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc0eae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fbc0d2330 0x7f0fbc0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc0eae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fbc0d2330 0x7f0fbc0cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48200/0 (socket says 172.21.15.146:48200) 2024-09-17T03:44:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc0eae640 1 -- 172.21.15.146:0/1412533488 learned_addr learned my addr 172.21.15.146:0/1412533488 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc16af640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fbc0b8ea0 0x7f0fbc1e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc1eb0640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fbc15eda0 0x7f0fbc0cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc0eae640 1 -- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fbc15eda0 msgr2=0x7f0fbc0cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc0eae640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fbc15eda0 0x7f0fbc0cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc0eae640 1 -- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fbc0b8ea0 msgr2=0x7f0fbc1e7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc0eae640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fbc0b8ea0 0x7f0fbc1e7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.466+0000 7f0fc0eae640 1 -- 172.21.15.146:0/1412533488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc0cb5b0 con 0x7f0fbc0d2330 2024-09-17T03:44:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.467+0000 7f0fc0eae640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fbc0d2330 0x7f0fbc0cb070 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00c3d0 tx=0x7f0fac00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.467+0000 7f0fb1ffb640 1 -- 172.21.15.146:0/1412533488 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac017070 con 0x7f0fbc0d2330 2024-09-17T03:44:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.467+0000 7f0fb1ffb640 1 -- 172.21.15.146:0/1412533488 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fac0053c0 con 0x7f0fbc0d2330 2024-09-17T03:44:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.467+0000 7f0fc3913640 1 -- 172.21.15.146:0/1412533488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc1e8840 con 0x7f0fbc0d2330 2024-09-17T03:44:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.467+0000 7f0fb1ffb640 1 -- 172.21.15.146:0/1412533488 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac003850 con 0x7f0fbc0d2330 2024-09-17T03:44:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.467+0000 7f0fc3913640 1 -- 172.21.15.146:0/1412533488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc0c83c0 con 0x7f0fbc0d2330 2024-09-17T03:44:44.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.468+0000 7f0fc3913640 1 -- 172.21.15.146:0/1412533488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fbc06a010 con 0x7f0fbc0d2330 2024-09-17T03:44:44.470 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.469+0000 7f0fb1ffb640 1 -- 172.21.15.146:0/1412533488 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0fac01a070 con 0x7f0fbc0d2330 2024-09-17T03:44:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.469+0000 7f0fb1ffb640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fa0078b90 0x7f0fa007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.470+0000 7f0fb1ffb640 1 -- 172.21.15.146:0/1412533488 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f0fac099ff0 con 0x7f0fbc0d2330 2024-09-17T03:44:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.470+0000 7f0fc16af640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fa0078b90 0x7f0fa007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.470+0000 7f0fc16af640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fa0078b90 0x7f0fa007b0a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8033000 tx=0x7f0fb8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:44.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.474+0000 7f0fb1ffb640 1 -- 172.21.15.146:0/1412533488 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0fac061df0 con 0x7f0fbc0d2330 2024-09-17T03:44:44.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.721+0000 7f0fc3913640 1 -- 172.21.15.146:0/1412533488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0fbc074810 con 0x7f0fbc0d2330 2024-09-17T03:44:44.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.726+0000 7f0fb1ffb640 1 -- 172.21.15.146:0/1412533488 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) ==== 190+0+147 (secure 0 0 0) 0x7f0fac066820 con 0x7f0fbc0d2330 2024-09-17T03:44:44.726 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:44:44.726 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:44:44.726 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:44:44.726 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:44:44.726 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:44:44.727 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:44:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 -- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fa0078b90 msgr2=0x7f0fa007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fa0078b90 0x7f0fa007b0a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8033000 tx=0x7f0fb8004730 comp rx=0 tx=0).stop 2024-09-17T03:44:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 -- 172.21.15.146:0/1412533488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fbc0d2330 msgr2=0x7f0fbc0cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fbc0d2330 0x7f0fbc0cb070 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00c3d0 tx=0x7f0fac00c890 comp rx=0 tx=0).stop 2024-09-17T03:44:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 -- 172.21.15.146:0/1412533488 shutdown_connections 2024-09-17T03:44:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0fa0078b90 0x7f0fa007b0a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0fbc15eda0 0x7f0fbc0cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fbc0d2330 0x7f0fbc0cb070 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 --2- 172.21.15.146:0/1412533488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0fbc0b8ea0 0x7f0fbc1e7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 -- 172.21.15.146:0/1412533488 >> 172.21.15.146:0/1412533488 conn(0x7f0fbc06d070 msgr2=0x7f0fbc160b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 -- 172.21.15.146:0/1412533488 shutdown_connections 2024-09-17T03:44:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.728+0000 7f0fc3913640 1 -- 172.21.15.146:0/1412533488 wait complete. 2024-09-17T03:44:44.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:44:44.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.853+0000 7fb26d7c3640 1 -- 172.21.15.146:0/4234469129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb254004d40 msgr2=0x7fb254005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.853+0000 7fb26d7c3640 1 --2- 172.21.15.146:0/4234469129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb254004d40 0x7fb254005210 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7fb260002230 tx=0x7fb254005830 comp rx=0 tx=0).stop 2024-09-17T03:44:44.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.853+0000 7fb2677fe640 1 -- 172.21.15.146:0/4234469129 reap_dead start 2024-09-17T03:44:44.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.853+0000 7fb26d7c3640 1 -- 172.21.15.146:0/4234469129 shutdown_connections 2024-09-17T03:44:44.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.853+0000 7fb26d7c3640 1 -- 172.21.15.146:0/4234469129 >> 172.21.15.146:0/4234469129 conn(0x7fb2680d11f0 msgr2=0x7fb2680d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:44.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.853+0000 7fb26d7c3640 1 -- 172.21.15.146:0/4234469129 shutdown_connections 2024-09-17T03:44:44.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.853+0000 7fb26d7c3640 1 -- 172.21.15.146:0/4234469129 wait complete. 2024-09-17T03:44:44.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.855+0000 7fb26d7c3640 1 Processor -- start 2024-09-17T03:44:44.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.855+0000 7fb26d7c3640 1 -- start start 2024-09-17T03:44:44.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.856+0000 7fb26d7c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb26814cc90 0x7fb2681f8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.856+0000 7fb26d7c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2681f9270 0x7fb2681f9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.856+0000 7fb26d7c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb26815f9f0 0x7fb26815fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.856+0000 7fb26d7c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb2680d3b60 con 0x7fb2681f9270 2024-09-17T03:44:44.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.856+0000 7fb26d7c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb2680b39c0 con 0x7fb26814cc90 2024-09-17T03:44:44.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.856+0000 7fb26d7c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb2680d3ce0 con 0x7fb26815f9f0 2024-09-17T03:44:44.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2681f9270 0x7fb2681f9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25e7fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2681f9270 0x7fb2681f9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48228/0 (socket says 172.21.15.146:48228) 2024-09-17T03:44:44.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25e7fc640 1 -- 172.21.15.146:0/1021564099 learned_addr learned my addr 172.21.15.146:0/1021564099 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:44.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb266ffd640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb26814cc90 0x7fb2681f8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb2677fe640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb26815f9f0 0x7fb26815fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25e7fc640 1 -- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb26815f9f0 msgr2=0x7fb26815fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25e7fc640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb26815f9f0 0x7fb26815fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25e7fc640 1 -- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb26814cc90 msgr2=0x7fb2681f8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:44.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25e7fc640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb26814cc90 0x7fb2681f8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:44.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25e7fc640 1 -- 172.21.15.146:0/1021564099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26815f260 con 0x7fb2681f9270 2024-09-17T03:44:44.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25e7fc640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2681f9270 0x7fb2681f9680 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7fb25000f9d0 tx=0x7fb25000fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:44.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25ffff640 1 -- 172.21.15.146:0/1021564099 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25000bcb0 con 0x7fb2681f9270 2024-09-17T03:44:44.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25ffff640 1 -- 172.21.15.146:0/1021564099 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb250004030 con 0x7fb2681f9270 2024-09-17T03:44:44.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb26d7c3640 1 -- 172.21.15.146:0/1021564099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb268161a20 con 0x7fb2681f9270 2024-09-17T03:44:44.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb25ffff640 1 -- 172.21.15.146:0/1021564099 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250004400 con 0x7fb2681f9270 2024-09-17T03:44:44.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.857+0000 7fb26d7c3640 1 -- 172.21.15.146:0/1021564099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb268155c20 con 0x7fb2681f9270 2024-09-17T03:44:44.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.858+0000 7fb26d7c3640 1 -- 172.21.15.146:0/1021564099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb268069900 con 0x7fb2681f9270 2024-09-17T03:44:44.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.859+0000 7fb25ffff640 1 -- 172.21.15.146:0/1021564099 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb2500035f0 con 0x7fb2681f9270 2024-09-17T03:44:44.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.859+0000 7fb25ffff640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb248078b90 0x7fb24807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:44.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.860+0000 7fb25ffff640 1 -- 172.21.15.146:0/1021564099 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fb25009b660 con 0x7fb2681f9270 2024-09-17T03:44:44.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.860+0000 7fb266ffd640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb248078b90 0x7fb24807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:44.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.860+0000 7fb266ffd640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb248078b90 0x7fb24807b0a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb26815dcb0 tx=0x7fb25800b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:44.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:44.864+0000 7fb25ffff640 1 -- 172.21.15.146:0/1021564099 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb250063570 con 0x7fb2681f9270 2024-09-17T03:44:45.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.072+0000 7fb26d7c3640 1 -- 172.21.15.146:0/1021564099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb26815e210 con 0x7fb2681f9270 2024-09-17T03:44:45.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.073+0000 7fb25ffff640 1 -- 172.21.15.146:0/1021564099 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5250 (secure 0 0 0) 0x7fb250067fa0 con 0x7fb2681f9270 2024-09-17T03:44:45.073 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:45.073 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"btime":"2024-09-17T03:44:38:513917+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8309,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2438790201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2438790201},{"type":"v1","addr":"172.21.15.146:6835","nonce":2438790201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3707736043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3707736043},{"type":"v1","addr":"172.21.15.179:6836","nonce":3707736043}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2895389304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2895389304},{"type":"v1","addr":"172.21.15.179:6837","nonce":2895389304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:44:34.866944+0000","modified":"2024-09-17T03:44:37.878491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10671},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10671":{"gid":10671,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/2269642448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2269642448},{"type":"v1","addr":"172.21.15.146:6834","nonce":2269642448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10671,"qdb_cluster":[10671]},"id":13}]} 2024-09-17T03:44:45.073 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2024-09-17T03:44:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 -- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb248078b90 msgr2=0x7fb24807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb248078b90 0x7fb24807b0a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb26815dcb0 tx=0x7fb25800b260 comp rx=0 tx=0).stop 2024-09-17T03:44:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 -- 172.21.15.146:0/1021564099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2681f9270 msgr2=0x7fb2681f9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2681f9270 0x7fb2681f9680 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7fb25000f9d0 tx=0x7fb25000fe90 comp rx=0 tx=0).stop 2024-09-17T03:44:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 -- 172.21.15.146:0/1021564099 shutdown_connections 2024-09-17T03:44:45.075 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb248078b90 0x7fb24807b0a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb26815f9f0 0x7fb26815fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2681f9270 0x7fb2681f9680 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 --2- 172.21.15.146:0/1021564099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb26814cc90 0x7fb2681f8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 -- 172.21.15.146:0/1021564099 >> 172.21.15.146:0/1021564099 conn(0x7fb2680d11f0 msgr2=0x7fb268159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:45.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 -- 172.21.15.146:0/1021564099 shutdown_connections 2024-09-17T03:44:45.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.075+0000 7fb26d7c3640 1 -- 172.21.15.146:0/1021564099 wait complete. 2024-09-17T03:44:45.490 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 136, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:44:34.866944+0000', 'modified': '2024-09-17T03:44:37.878491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10671}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10671': {'gid': 10671, 'name': 'a', 'rank': 0, 'incarnation': 133, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6834/2269642448', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 2269642448}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 2269642448}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10671, 'qdb_cluster': [10671]} 2024-09-17T03:44:45.490 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:44:45.490 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:44:45.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.608+0000 7f6c92e8b640 1 -- 172.21.15.146:0/257205376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c8c15f010 msgr2=0x7f6c8c1515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.608+0000 7f6c92e8b640 1 --2- 172.21.15.146:0/257205376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c8c15f010 0x7f6c8c1515a0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0713a0 tx=0x7f6c8402aa30 comp rx=0 tx=0).stop 2024-09-17T03:44:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.608+0000 7f6c92e8b640 1 -- 172.21.15.146:0/257205376 shutdown_connections 2024-09-17T03:44:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.608+0000 7f6c92e8b640 1 --2- 172.21.15.146:0/257205376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c8c15f010 0x7f6c8c1515a0 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.608+0000 7f6c92e8b640 1 --2- 172.21.15.146:0/257205376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c0cfc40 0x7f6c8c15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.608+0000 7f6c92e8b640 1 --2- 172.21.15.146:0/257205376 >> v2:172.21.15.179:3300/0 conn(0x7f6c8c0b3360 0x7f6c8c072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.608+0000 7f6c92e8b640 1 -- 172.21.15.146:0/257205376 >> 172.21.15.146:0/257205376 conn(0x7f6c8c0b2060 msgr2=0x7f6c8c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.608+0000 7f6c92e8b640 1 -- 172.21.15.146:0/257205376 shutdown_connections 2024-09-17T03:44:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.608+0000 7f6c92e8b640 1 -- 172.21.15.146:0/257205376 wait complete. 2024-09-17T03:44:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.610+0000 7f6c92e8b640 1 Processor -- start 2024-09-17T03:44:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.610+0000 7f6c92e8b640 1 -- start start 2024-09-17T03:44:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.611+0000 7f6c92e8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c0b3360 0x7f6c8c145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.611+0000 7f6c92e8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c8c0cfc40 0x7f6c8c14d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.611+0000 7f6c92e8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c15f010 0x7f6c8c14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.611+0000 7f6c92e8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c06e800 con 0x7f6c8c0cfc40 2024-09-17T03:44:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.611+0000 7f6c92e8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c06e680 con 0x7f6c8c15f010 2024-09-17T03:44:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.611+0000 7f6c92e8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c06e980 con 0x7f6c8c0b3360 2024-09-17T03:44:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.611+0000 7f6c8bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c8c0cfc40 0x7f6c8c14d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.611+0000 7f6c8bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c8c0cfc40 0x7f6c8c14d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48246/0 (socket says 172.21.15.146:48246) 2024-09-17T03:44:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.611+0000 7f6c8bfff640 1 -- 172.21.15.146:0/2051366719 learned_addr learned my addr 172.21.15.146:0/2051366719 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c90c27640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c0b3360 0x7f6c8c145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c91428640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c15f010 0x7f6c8c14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c8bfff640 1 -- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c0b3360 msgr2=0x7f6c8c145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c8bfff640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c0b3360 0x7f6c8c145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c8bfff640 1 -- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c15f010 msgr2=0x7f6c8c14d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c8bfff640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c15f010 0x7f6c8c14d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c8bfff640 1 -- 172.21.15.146:0/2051366719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c14fe60 con 0x7f6c8c0cfc40 2024-09-17T03:44:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c90c27640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c0b3360 0x7f6c8c145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c91428640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c15f010 0x7f6c8c14d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c8bfff640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c8c0cfc40 0x7f6c8c14d030 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000d680 tx=0x7f6c8000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:45.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c897fa640 1 -- 172.21.15.146:0/2051366719 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c80017070 con 0x7f6c8c0cfc40 2024-09-17T03:44:45.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c897fa640 1 -- 172.21.15.146:0/2051366719 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c80004330 con 0x7f6c8c0cfc40 2024-09-17T03:44:45.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c897fa640 1 -- 172.21.15.146:0/2051366719 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c80009a80 con 0x7f6c8c0cfc40 2024-09-17T03:44:45.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c92e8b640 1 -- 172.21.15.146:0/2051366719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8c1f70c0 con 0x7f6c8c0cfc40 2024-09-17T03:44:45.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.612+0000 7f6c92e8b640 1 -- 172.21.15.146:0/2051366719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8c1f7680 con 0x7f6c8c0cfc40 2024-09-17T03:44:45.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.614+0000 7f6c897fa640 1 -- 172.21.15.146:0/2051366719 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c80009c20 con 0x7f6c8c0cfc40 2024-09-17T03:44:45.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.615+0000 7f6c897fa640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 0x7f6c7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.615+0000 7f6c897fa640 1 -- 172.21.15.146:0/2051366719 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f6c8009adc0 con 0x7f6c8c0cfc40 2024-09-17T03:44:45.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.615+0000 7f6c90c27640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 0x7f6c7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.615+0000 7f6c99df7740 1 Processor -- start 2024-09-17T03:44:45.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.615+0000 7f6c99df7740 1 -- start start 2024-09-17T03:44:45.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.615+0000 7f6c90c27640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 0x7f6c7807b0a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00bb40 tx=0x7f6c7c005e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.616+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b80fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.616+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef27863b0 0x55eef2b814e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.616+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 0x55eef2b9e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.616+0000 7f6c99df7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55eef2ac9820 con 0x55eef27af270 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.616+0000 7f6c99df7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55eef2ab8c50 con 0x55eef278e590 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.616+0000 7f6c99df7740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55eef2abca60 con 0x55eef27863b0 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c90c27640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b80fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c90c27640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b80fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48256/0 (socket says 172.21.15.146:48256) 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c90c27640 1 -- 172.21.15.146:0/2094599077 learned_addr learned my addr 172.21.15.146:0/2094599077 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c90c27640 1 -- 172.21.15.146:0/2094599077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef27863b0 msgr2=0x55eef2b814e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c91428640 1 --2- 172.21.15.146:0/2094599077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 0x55eef2b9e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c8bfff640 1 --2- 172.21.15.146:0/2094599077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef27863b0 0x55eef2b814e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c90c27640 1 --2- 172.21.15.146:0/2094599077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef27863b0 0x55eef2b814e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c90c27640 1 -- 172.21.15.146:0/2094599077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 msgr2=0x55eef2b9e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c90c27640 1 --2- 172.21.15.146:0/2094599077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 0x55eef2b9e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c90c27640 1 -- 172.21.15.146:0/2094599077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eef281a850 con 0x55eef27af270 2024-09-17T03:44:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c8bfff640 1 --2- 172.21.15.146:0/2094599077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef27863b0 0x55eef2b814e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c91428640 1 --2- 172.21.15.146:0/2094599077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 0x55eef2b9e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c90c27640 1 --2- 172.21.15.146:0/2094599077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b80fa0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00fe40 tx=0x7f6c7c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a8961cbd8fa602 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c727fc640 1 -- 172.21.15.146:0/2094599077 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c022070 con 0x55eef27af270 2024-09-17T03:44:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c727fc640 1 -- 172.21.15.146:0/2094599077 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c7c01e740 con 0x55eef27af270 2024-09-17T03:44:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.617+0000 7f6c727fc640 1 -- 172.21.15.146:0/2094599077 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c01eb50 con 0x55eef27af270 2024-09-17T03:44:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.618+0000 7f6c99df7740 1 -- 172.21.15.146:0/2094599077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 msgr2=0x55eef2b80fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.618+0000 7f6c99df7740 1 --2- 172.21.15.146:0/2094599077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b80fa0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00fe40 tx=0x7f6c7c012000 comp rx=0 tx=0).stop 2024-09-17T03:44:45.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.618+0000 7f6c99df7740 1 -- 172.21.15.146:0/2094599077 shutdown_connections 2024-09-17T03:44:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.618+0000 7f6c99df7740 1 --2- 172.21.15.146:0/2094599077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 0x55eef2b9e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.618+0000 7f6c99df7740 1 --2- 172.21.15.146:0/2094599077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef27863b0 0x55eef2b814e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.618+0000 7f6c99df7740 1 --2- 172.21.15.146:0/2094599077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b80fa0 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.618+0000 7f6c99df7740 1 -- 172.21.15.146:0/2094599077 >> 172.21.15.146:0/2094599077 conn(0x55eef27a33c0 msgr2=0x55eef2b57260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.618+0000 7f6c99df7740 1 -- 172.21.15.146:0/2094599077 shutdown_connections 2024-09-17T03:44:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.618+0000 7f6c99df7740 1 -- 172.21.15.146:0/2094599077 wait complete. 2024-09-17T03:44:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.619+0000 7f6c99df7740 1 -- start start 2024-09-17T03:44:45.623 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.619+0000 7f6c99df7740 1 Processor -- start 2024-09-17T03:44:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef27863b0 0x55eef2bac380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 0x55eef2b506c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b9e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c99df7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55eef2829620 con 0x55eef27af270 2024-09-17T03:44:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c99df7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55eef2a5e5f0 con 0x55eef278e590 2024-09-17T03:44:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c99df7740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55eef2b81a20 con 0x55eef27863b0 2024-09-17T03:44:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c99df7740 10 client.0 _ll_register_callbacks cb 0x55eef2a620a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c91428640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b9e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c91428640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b9e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48258/0 (socket says 172.21.15.146:48258) 2024-09-17T03:44:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c91428640 1 -- 172.21.15.146:0/4010489496 learned_addr learned my addr 172.21.15.146:0/4010489496 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c91428640 1 -- 172.21.15.146:0/4010489496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef27863b0 msgr2=0x55eef2bac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c90c27640 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef27863b0 0x55eef2bac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c8bfff640 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 0x55eef2b506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c91428640 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef27863b0 0x55eef2bac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c91428640 1 -- 172.21.15.146:0/4010489496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 msgr2=0x55eef2b506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c91428640 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 0x55eef2b506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c91428640 1 -- 172.21.15.146:0/4010489496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eef28916b0 con 0x55eef27af270 2024-09-17T03:44:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c8bfff640 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 0x55eef2b506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c91428640 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b9e140 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f6c84005fd0 tx=0x7f6c84009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9dceb7c466099ec server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:45.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/4010489496 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84033040 con 0x55eef27af270 2024-09-17T03:44:45.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/4010489496 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f6c84003b80 con 0x55eef27af270 2024-09-17T03:44:45.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.621+0000 7f6c99df7740 1 -- 172.21.15.146:0/4010489496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c7c01e740 con 0x55eef27af270 2024-09-17T03:44:45.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/4010489496 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f6c84003d80 con 0x55eef27af270 2024-09-17T03:44:45.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c99df7740 10 client.10824 fetch_fsmap learned FSMap version 136 2024-09-17T03:44:45.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c99df7740 1 -- 172.21.15.146:0/4010489496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55eef2b9f000 con 0x55eef27af270 2024-09-17T03:44:45.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/4010489496 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c7c01e740 con 0x55eef27af270 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/4010489496 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7f6c84004b40 con 0x55eef27af270 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c99df7740 10 client.10824 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c99df7740 10 client.10824 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c99df7740 20 client.10824 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c99df7740 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55eef276de40 0x55eef2bae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c99df7740 4 client.10824 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c99df7740 1 -- 172.21.15.146:0/4010489496 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eef2acb770 con 0x55eef276de40 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c90c27640 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55eef276de40 0x55eef2bae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c6b7fe640 10 client.10824 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.622+0000 7f6c90c27640 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55eef276de40 0x55eef2bae7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bac3b398a17c01fe server_cookie=d87e534f392afda in_seq=0 out_seq=0 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/4010489496 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eef2acb770 con 0x55eef276de40 2024-09-17T03:44:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c6b7fe640 10 client.10824 handle_command_reply: tid=0 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c99df7740 1 client.10824 shutdown 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c99df7740 1 -- 172.21.15.146:0/4010489496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 msgr2=0x55eef2b9e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c99df7740 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b9e140 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f6c84005fd0 tx=0x7f6c84009490 comp rx=0 tx=0).stop 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c99df7740 1 -- 172.21.15.146:0/4010489496 shutdown_connections 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c99df7740 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55eef276de40 0x55eef2bae7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c99df7740 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2b9e140 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c99df7740 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef278e590 0x55eef2b506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c6b7fe640 0 client.10824 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c99df7740 1 --2- 172.21.15.146:0/4010489496 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef27863b0 0x55eef2bac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.623+0000 7f6c99df7740 1 -- 172.21.15.146:0/4010489496 >> 172.21.15.146:0/4010489496 conn(0x55eef27a33c0 msgr2=0x55eef2b9d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.624+0000 7f6c99df7740 1 -- 172.21.15.146:0/4010489496 shutdown_connections 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.624+0000 7f6c99df7740 1 -- 172.21.15.146:0/4010489496 wait complete. 2024-09-17T03:44:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.624+0000 7f6c99df7740 20 client.10824 trim_cache size 0 max 16384 2024-09-17T03:44:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.642+0000 7f6c99df7740 1 Processor -- start 2024-09-17T03:44:45.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.642+0000 7f6c99df7740 1 -- start start 2024-09-17T03:44:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27863b0 0x55eef2b80060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef278e590 0x55eef2bb4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef27af270 0x55eef2bb5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c99df7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c14eb30 con 0x55eef27863b0 2024-09-17T03:44:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c99df7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c14de90 con 0x55eef27af270 2024-09-17T03:44:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c99df7740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c14e4e0 con 0x55eef278e590 2024-09-17T03:44:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c90c27640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27863b0 0x55eef2b80060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c90c27640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27863b0 0x55eef2b80060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48262/0 (socket says 172.21.15.146:48262) 2024-09-17T03:44:45.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c90c27640 1 -- 172.21.15.146:0/1112526356 learned_addr learned my addr 172.21.15.146:0/1112526356 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c90c27640 1 -- 172.21.15.146:0/1112526356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef278e590 msgr2=0x55eef2bb4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c90c27640 1 --2- 172.21.15.146:0/1112526356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef278e590 0x55eef2bb4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c90c27640 1 -- 172.21.15.146:0/1112526356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef27af270 msgr2=0x55eef2bb5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c90c27640 1 --2- 172.21.15.146:0/1112526356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef27af270 0x55eef2bb5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.643+0000 7f6c90c27640 1 -- 172.21.15.146:0/1112526356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eef2b9ea30 con 0x55eef27863b0 2024-09-17T03:44:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.644+0000 7f6c90c27640 1 --2- 172.21.15.146:0/1112526356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27863b0 0x55eef2b80060 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c021000 tx=0x7f6c7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d0bc395ea88f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:45.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.644+0000 7f6c71ffb640 1 -- 172.21.15.146:0/1112526356 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c015040 con 0x55eef27863b0 2024-09-17T03:44:45.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.644+0000 7f6c71ffb640 1 -- 172.21.15.146:0/1112526356 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c7c01e940 con 0x55eef27863b0 2024-09-17T03:44:45.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.644+0000 7f6c71ffb640 1 -- 172.21.15.146:0/1112526356 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c022040 con 0x55eef27863b0 2024-09-17T03:44:45.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.644+0000 7f6c99df7740 1 -- 172.21.15.146:0/1112526356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27863b0 msgr2=0x55eef2b80060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.644+0000 7f6c99df7740 1 --2- 172.21.15.146:0/1112526356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27863b0 0x55eef2b80060 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c021000 tx=0x7f6c7c0046c0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.645+0000 7f6c99df7740 1 -- 172.21.15.146:0/1112526356 shutdown_connections 2024-09-17T03:44:45.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.645+0000 7f6c99df7740 1 --2- 172.21.15.146:0/1112526356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef27af270 0x55eef2bb5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.645+0000 7f6c99df7740 1 --2- 172.21.15.146:0/1112526356 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef278e590 0x55eef2bb4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.645+0000 7f6c99df7740 1 --2- 172.21.15.146:0/1112526356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27863b0 0x55eef2b80060 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.645+0000 7f6c99df7740 1 -- 172.21.15.146:0/1112526356 >> 172.21.15.146:0/1112526356 conn(0x55eef27a33c0 msgr2=0x55eef2b6ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.645+0000 7f6c99df7740 1 -- 172.21.15.146:0/1112526356 shutdown_connections 2024-09-17T03:44:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.645+0000 7f6c99df7740 1 -- 172.21.15.146:0/1112526356 wait complete. 2024-09-17T03:44:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.645+0000 7f6c99df7740 1 -- start start 2024-09-17T03:44:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.646+0000 7f6c99df7740 1 Processor -- start 2024-09-17T03:44:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef27863b0 0x55eef2c1b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef278e590 0x55eef2bb4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c99df7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2bb5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c99df7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55eef2b9e680 con 0x55eef27af270 2024-09-17T03:44:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c99df7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55eef2b94790 con 0x55eef27863b0 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c99df7740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55eef2b956c0 con 0x55eef278e590 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c99df7740 10 client.0 _ll_register_callbacks cb 0x7f6c84009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c91428640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2bb5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c91428640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2bb5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48270/0 (socket says 172.21.15.146:48270) 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c91428640 1 -- 172.21.15.146:0/353552250 learned_addr learned my addr 172.21.15.146:0/353552250 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c90c27640 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef27863b0 0x55eef2c1b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c8bfff640 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef278e590 0x55eef2bb4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c91428640 1 -- 172.21.15.146:0/353552250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef278e590 msgr2=0x55eef2bb4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c91428640 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef278e590 0x55eef2bb4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c91428640 1 -- 172.21.15.146:0/353552250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef27863b0 msgr2=0x55eef2c1b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c91428640 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef27863b0 0x55eef2c1b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.647+0000 7f6c91428640 1 -- 172.21.15.146:0/353552250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eef2bbf2e0 con 0x55eef27af270 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c91428640 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2bb5320 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009d60 tx=0x7f6c84004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e6667bf90e7268 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:45.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/353552250 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84033070 con 0x55eef27af270 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/353552250 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f6c8403f070 con 0x55eef27af270 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c99df7740 1 -- 172.21.15.146:0/353552250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c7c01e940 con 0x55eef27af270 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/353552250 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f6c84004680 con 0x55eef27af270 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c99df7740 10 client.10830 fetch_fsmap learned FSMap version 136 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c99df7740 1 -- 172.21.15.146:0/353552250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55eef2b9a7f0 con 0x55eef27af270 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/353552250 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c7c01e940 con 0x55eef27af270 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/353552250 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7f6c84043470 con 0x55eef27af270 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c99df7740 10 client.10830 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c99df7740 10 client.10830 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c99df7740 20 client.10830 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c99df7740 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55eef2c20100 0x55eef2b7d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c99df7740 4 client.10830 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c99df7740 1 -- 172.21.15.146:0/353552250 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "status"}) -- 0x55eef2b94050 con 0x55eef2c20100 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.648+0000 7f6c90c27640 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55eef2c20100 0x55eef2b7d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c6b7fe640 10 client.10830 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c90c27640 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55eef2c20100 0x55eef2b7d2b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac008bd1ffb79e53 server_cookie=204e96da0de9cd74 in_seq=0 out_seq=0 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c6b7fe640 1 -- 172.21.15.146:0/353552250 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x55eef2b94050 con 0x55eef2c20100 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c6b7fe640 10 client.10830 handle_command_reply: tid=0 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 1 client.10830 shutdown 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 1 -- 172.21.15.146:0/353552250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 msgr2=0x55eef2bb5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2bb5320 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009d60 tx=0x7f6c84004380 comp rx=0 tx=0).stop 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 1 -- 172.21.15.146:0/353552250 shutdown_connections 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55eef2c20100 0x55eef2b7d2b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eef27af270 0x55eef2bb5320 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c6b7fe640 0 client.10830 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eef278e590 0x55eef2bb4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 1 --2- 172.21.15.146:0/353552250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eef27863b0 0x55eef2c1b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 1 -- 172.21.15.146:0/353552250 >> 172.21.15.146:0/353552250 conn(0x55eef27a33c0 msgr2=0x55eef2b6eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 1 -- 172.21.15.146:0/353552250 shutdown_connections 2024-09-17T03:44:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 1 -- 172.21.15.146:0/353552250 wait complete. 2024-09-17T03:44:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.649+0000 7f6c99df7740 20 client.10830 trim_cache size 0 max 16384 2024-09-17T03:44:45.659 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:44:45.659 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:44:45.660 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:44:45.660 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 10671, 2024-09-17T03:44:45.660 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:44:45.660 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:44:45.660 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:44:45.660 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.161815499999999, 2024-09-17T03:44:45.660 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 136, 2024-09-17T03:44:45.660 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 176, 2024-09-17T03:44:45.660 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 176, 2024-09-17T03:44:45.660 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 14.776312506 2024-09-17T03:44:45.660 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 -- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 msgr2=0x7f6c7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 0x7f6c7807b0a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00bb40 tx=0x7f6c7c005e70 comp rx=0 tx=0).stop 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 -- 172.21.15.146:0/2051366719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c8c0cfc40 msgr2=0x7f6c8c14d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c8c0cfc40 0x7f6c8c14d030 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000d680 tx=0x7f6c8000db40 comp rx=0 tx=0).stop 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 -- 172.21.15.146:0/2051366719 shutdown_connections 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6c78078b90 0x7f6c7807b0a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c8c15f010 0x7f6c8c14d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c8c0cfc40 0x7f6c8c14d030 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 --2- 172.21.15.146:0/2051366719 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c8c0b3360 0x7f6c8c145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 -- 172.21.15.146:0/2051366719 >> 172.21.15.146:0/2051366719 conn(0x7f6c8c0b2060 msgr2=0x7f6c8c15b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 -- 172.21.15.146:0/2051366719 shutdown_connections 2024-09-17T03:44:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.650+0000 7f6c92e8b640 1 -- 172.21.15.146:0/2051366719 wait complete. 2024-09-17T03:44:45.663 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:44:45.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.776+0000 7fed16a4d640 1 -- 172.21.15.146:0/1811009715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed1006f270 msgr2=0x7fed101628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.776+0000 7fed16a4d640 1 --2- 172.21.15.146:0/1811009715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed1006f270 0x7fed101628a0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fed100b73c0 tx=0x7fed0802a980 comp rx=0 tx=0).stop 2024-09-17T03:44:45.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.776+0000 7fed16a4d640 1 -- 172.21.15.146:0/1811009715 shutdown_connections 2024-09-17T03:44:45.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.776+0000 7fed16a4d640 1 --2- 172.21.15.146:0/1811009715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed1006f270 0x7fed101628a0 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.776+0000 7fed16a4d640 1 --2- 172.21.15.146:0/1811009715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed101620f0 0x7fed1006ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.776+0000 7fed16a4d640 1 --2- 172.21.15.146:0/1811009715 >> v2:172.21.15.179:3300/0 conn(0x7fed100b3870 0x7fed100cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.776+0000 7fed16a4d640 1 -- 172.21.15.146:0/1811009715 >> 172.21.15.146:0/1811009715 conn(0x7fed100d4be0 msgr2=0x7fed100d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:45.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.776+0000 7fed16a4d640 1 -- 172.21.15.146:0/1811009715 shutdown_connections 2024-09-17T03:44:45.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.776+0000 7fed16a4d640 1 -- 172.21.15.146:0/1811009715 wait complete. 2024-09-17T03:44:45.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.778+0000 7fed16a4d640 1 Processor -- start 2024-09-17T03:44:45.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.778+0000 7fed16a4d640 1 -- start start 2024-09-17T03:44:45.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed16a4d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed1006f270 0x7fed1014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed16a4d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed100b3870 0x7fed101f91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed16a4d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed101620f0 0x7fed101f9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed16a4d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fed10163170 con 0x7fed100b3870 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed16a4d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fed10162ff0 con 0x7fed1006f270 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed16a4d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fed101632f0 con 0x7fed101620f0 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed0f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed100b3870 0x7fed101f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed0f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed100b3870 0x7fed101f91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48280/0 (socket says 172.21.15.146:48280) 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed0f7fe640 1 -- 172.21.15.146:0/956285165 learned_addr learned my addr 172.21.15.146:0/956285165 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed0ffff640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed1006f270 0x7fed1014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed14fea640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed101620f0 0x7fed101f9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed0f7fe640 1 -- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed101620f0 msgr2=0x7fed101f9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed0f7fe640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed101620f0 0x7fed101f9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed0f7fe640 1 -- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed1006f270 msgr2=0x7fed1014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:45.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed0f7fe640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed1006f270 0x7fed1014d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:45.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed0f7fe640 1 -- 172.21.15.146:0/956285165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed10150660 con 0x7fed100b3870 2024-09-17T03:44:45.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.779+0000 7fed14fea640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed101620f0 0x7fed101f9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:45.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.780+0000 7fed0f7fe640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed100b3870 0x7fed101f91d0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fed0400d740 tx=0x7fed0400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:45.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.780+0000 7fed0cff9640 1 -- 172.21.15.146:0/956285165 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed04017070 con 0x7fed100b3870 2024-09-17T03:44:45.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.780+0000 7fed0cff9640 1 -- 172.21.15.146:0/956285165 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed0400de50 con 0x7fed100b3870 2024-09-17T03:44:45.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.780+0000 7fed16a4d640 1 -- 172.21.15.146:0/956285165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed10150940 con 0x7fed100b3870 2024-09-17T03:44:45.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.780+0000 7fed0cff9640 1 -- 172.21.15.146:0/956285165 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed04004020 con 0x7fed100b3870 2024-09-17T03:44:45.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.780+0000 7fed16a4d640 1 -- 172.21.15.146:0/956285165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed100ccf80 con 0x7fed100b3870 2024-09-17T03:44:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.781+0000 7fed16a4d640 1 -- 172.21.15.146:0/956285165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed101503d0 con 0x7fed100b3870 2024-09-17T03:44:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.782+0000 7fed0cff9640 1 -- 172.21.15.146:0/956285165 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed040041c0 con 0x7fed100b3870 2024-09-17T03:44:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.782+0000 7fed0cff9640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecfc078b90 0x7fecfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.783+0000 7fed0cff9640 1 -- 172.21.15.146:0/956285165 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fed0409af70 con 0x7fed100b3870 2024-09-17T03:44:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.783+0000 7fed0ffff640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecfc078b90 0x7fecfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:45.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.783+0000 7fed0ffff640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecfc078b90 0x7fecfc07b0a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fed00009b30 tx=0x7fed00005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:45.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.787+0000 7fed0cff9640 1 -- 172.21.15.146:0/956285165 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fed04020020 con 0x7fed100b3870 2024-09-17T03:44:45.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.998+0000 7fed16a4d640 1 -- 172.21.15.146:0/956285165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fed100cf370 con 0x7fed100b3870 2024-09-17T03:44:45.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:45.998+0000 7fed0cff9640 1 -- 172.21.15.146:0/956285165 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v136) ==== 53+0+73 (secure 0 0 0) 0x7fed04063440 con 0x7fed100b3870 2024-09-17T03:44:45.998 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:44:46.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 -- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecfc078b90 msgr2=0x7fecfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:46.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecfc078b90 0x7fecfc07b0a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fed00009b30 tx=0x7fed00005f90 comp rx=0 tx=0).stop 2024-09-17T03:44:46.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 -- 172.21.15.146:0/956285165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed100b3870 msgr2=0x7fed101f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:46.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed100b3870 0x7fed101f91d0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fed0400d740 tx=0x7fed0400dc00 comp rx=0 tx=0).stop 2024-09-17T03:44:46.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 -- 172.21.15.146:0/956285165 shutdown_connections 2024-09-17T03:44:46.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecfc078b90 0x7fecfc07b0a0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fed101620f0 0x7fed101f9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed100b3870 0x7fed101f91d0 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 --2- 172.21.15.146:0/956285165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed1006f270 0x7fed1014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 -- 172.21.15.146:0/956285165 >> 172.21.15.146:0/956285165 conn(0x7fed100d4be0 msgr2=0x7fed1015f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:46.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 -- 172.21.15.146:0/956285165 shutdown_connections 2024-09-17T03:44:46.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.000+0000 7fed16a4d640 1 -- 172.21.15.146:0/956285165 wait complete. 2024-09-17T03:44:46.012 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:44:46.012 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:44:46.012 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:44:46.012 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:44:46.012 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:44:46.012 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:44:46.012 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:44:46.012 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:44:46.013 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:44:46.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:46.013 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:44:46.029 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:44:46.029 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:44:46.029 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:44:46.029 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:46.029 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:44:46.029 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:46.029 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:44:46.030 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:44:46.030 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:44:46.030 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:44:46.030 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:44:46.030 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:44:46.030 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:44:46.030 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:44:46.030 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:44:46.030 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:44:46.030 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:44:46.030 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42086sec preferred_lft 42086sec 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:44:46.031 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:46.032 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:44:46.032 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:44:46.032 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:44:46.032 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:44:46.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:46.032 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:44:46.093 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:44:46.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:46.094 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:44:46.151 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:44:46.151 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:44:46.151 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:44:46.152 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:44:46.152 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:44:46.152 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:44:46.152 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:44:46.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:44:46.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:44:46.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:44:46.152 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:44:46.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:44:46.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:46.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:46.278 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:44:46.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:44:46.293 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:44:46.294 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:44:46.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:46.294 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:44:46.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:44:46.359 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:44:46.415 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:44:46.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:44:46.415 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:44:46.470 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:44:46.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:46.470 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:44:46.564 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:44:46.565 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:44:46.565 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:44:46.575 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:44:46.575 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:44:46.575 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:44:46.576 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:44:46.576 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:44:46.581 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:44:46.581 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:44:46.581 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:44:46.581 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:44:46.582 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:44:46.582 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:44:46.582 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:44:46.582 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:44:46.582 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:44:46.582 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:44:46.583 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:44:46.583 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:44:46.583 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:44:46.584 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:44:46.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:46.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:44:46.609 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:44:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:44:46.703 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:44:46.709 INFO:teuthology.orchestra.run.smithi146.stdout:client10839 2024-09-17T03:44:46.709 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:44:46.709 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:44:46.725 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-17T03:44:46.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.881+0000 7fd7a9af9640 1 -- 172.21.15.146:0/2380848821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a40cdc50 msgr2=0x7fd7a40b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:46.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.881+0000 7fd7a9af9640 1 --2- 172.21.15.146:0/2380848821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a40cdc50 0x7fd7a40b4ba0 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4070300 tx=0x7fd79c02a9a0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.881+0000 7fd7a9af9640 1 -- 172.21.15.146:0/2380848821 shutdown_connections 2024-09-17T03:44:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.881+0000 7fd7a9af9640 1 --2- 172.21.15.146:0/2380848821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a40cdc50 0x7fd7a40b4ba0 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.881+0000 7fd7a9af9640 1 --2- 172.21.15.146:0/2380848821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a40cd840 0x7fd7a40b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.881+0000 7fd7a9af9640 1 --2- 172.21.15.146:0/2380848821 >> v2:172.21.15.179:3300/0 conn(0x7fd7a415c8e0 0x7fd7a406f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.881+0000 7fd7a9af9640 1 -- 172.21.15.146:0/2380848821 >> 172.21.15.146:0/2380848821 conn(0x7fd7a40b3150 msgr2=0x7fd7a40b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.882+0000 7fd7a9af9640 1 -- 172.21.15.146:0/2380848821 shutdown_connections 2024-09-17T03:44:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.882+0000 7fd7a9af9640 1 -- 172.21.15.146:0/2380848821 wait complete. 2024-09-17T03:44:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.883+0000 7fd7a9af9640 1 Processor -- start 2024-09-17T03:44:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.883+0000 7fd7a9af9640 1 -- start start 2024-09-17T03:44:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a9af9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a40cd840 0x7fd7a4155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a9af9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a40cdc50 0x7fd7a4151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a9af9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a415c8e0 0x7fd7a4151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a9af9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a40b5470 con 0x7fd7a415c8e0 2024-09-17T03:44:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a9af9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a40b52f0 con 0x7fd7a40cd840 2024-09-17T03:44:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a9af9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a40b5f30 con 0x7fd7a40cdc50 2024-09-17T03:44:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a415c8e0 0x7fd7a4151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a415c8e0 0x7fd7a4151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48300/0 (socket says 172.21.15.146:48300) 2024-09-17T03:44:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a3fff640 1 -- 172.21.15.146:0/477931142 learned_addr learned my addr 172.21.15.146:0/477931142 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a40cd840 0x7fd7a4155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a2ffd640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a40cdc50 0x7fd7a4151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a3fff640 1 -- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a40cdc50 msgr2=0x7fd7a4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a3fff640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a40cdc50 0x7fd7a4151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a3fff640 1 -- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a40cd840 msgr2=0x7fd7a4155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a3fff640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a40cd840 0x7fd7a4155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a3fff640 1 -- 172.21.15.146:0/477931142 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a41f40a0 con 0x7fd7a415c8e0 2024-09-17T03:44:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd7a3fff640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a415c8e0 0x7fd7a4151c50 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7fd79c02af90 tx=0x7fd79c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.885+0000 7fd78bfff640 1 -- 172.21.15.146:0/477931142 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c033050 con 0x7fd7a415c8e0 2024-09-17T03:44:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.886+0000 7fd78bfff640 1 -- 172.21.15.146:0/477931142 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd79c0044d0 con 0x7fd7a415c8e0 2024-09-17T03:44:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.886+0000 7fd7a9af9640 1 -- 172.21.15.146:0/477931142 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a4136c90 con 0x7fd7a415c8e0 2024-09-17T03:44:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.886+0000 7fd78bfff640 1 -- 172.21.15.146:0/477931142 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c038450 con 0x7fd7a415c8e0 2024-09-17T03:44:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.886+0000 7fd7a9af9640 1 -- 172.21.15.146:0/477931142 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a4150f10 con 0x7fd7a415c8e0 2024-09-17T03:44:46.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.888+0000 7fd78bfff640 1 -- 172.21.15.146:0/477931142 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd79c036070 con 0x7fd7a415c8e0 2024-09-17T03:44:46.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.888+0000 7fd78bfff640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd790078b90 0x7fd79007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.889+0000 7fd78bfff640 1 -- 172.21.15.146:0/477931142 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fd79c0bbf70 con 0x7fd7a415c8e0 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.889+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd790078b90 0x7fd79007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.889+0000 7fd7b0a69740 1 Processor -- start 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.889+0000 7fd7b0a69740 1 -- start start 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.889+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd790078b90 0x7fd79007b0a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd7940098e0 tx=0x7fd794009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e523571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52357710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52374610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556e5229f8e0 con 0x556e51f85390 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556e5228ed10 con 0x556e51f5c4d0 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x556e52292b20 con 0x556e51f646b0 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7a37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e523571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7a37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e523571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48308/0 (socket says 172.21.15.146:48308) 2024-09-17T03:44:46.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7a37fe640 1 -- 172.21.15.146:0/3447803598 learned_addr learned my addr 172.21.15.146:0/3447803598 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7a2ffd640 1 --2- 172.21.15.146:0/3447803598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52357710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7a37fe640 1 -- 172.21.15.146:0/3447803598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 msgr2=0x556e52374610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/3447803598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52374610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7a37fe640 1 -- 172.21.15.146:0/3447803598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 msgr2=0x556e52357710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/3447803598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52357710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7a37fe640 1 -- 172.21.15.146:0/3447803598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e51ff0970 con 0x556e51f85390 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7a2ffd640 1 --2- 172.21.15.146:0/3447803598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52357710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/3447803598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e523571d0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7fd79400eb70 tx=0x7fd794011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c5cb0a0014829b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7897fa640 1 -- 172.21.15.146:0/3447803598 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79401b040 con 0x556e51f85390 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7897fa640 1 -- 172.21.15.146:0/3447803598 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd794024070 con 0x556e51f85390 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.891+0000 7fd7897fa640 1 -- 172.21.15.146:0/3447803598 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794015d70 con 0x556e51f85390 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.892+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3447803598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 msgr2=0x556e523571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:46.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.892+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/3447803598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e523571d0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7fd79400eb70 tx=0x7fd794011000 comp rx=0 tx=0).stop 2024-09-17T03:44:46.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.892+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3447803598 shutdown_connections 2024-09-17T03:44:46.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.892+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/3447803598 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52374610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.892+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/3447803598 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52357710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.892+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/3447803598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e523571d0 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.892+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3447803598 >> 172.21.15.146:0/3447803598 conn(0x556e51f794e0 msgr2=0x556e5232d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:46.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.892+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3447803598 shutdown_connections 2024-09-17T03:44:46.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.892+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3447803598 wait complete. 2024-09-17T03:44:46.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.893+0000 7fd7b0a69740 1 -- start start 2024-09-17T03:44:46.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.893+0000 7fd7b0a69740 1 Processor -- start 2024-09-17T03:44:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52385020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52367c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556e51fff740 con 0x556e51f85390 2024-09-17T03:44:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556e522347f0 con 0x556e51f5c4d0 2024-09-17T03:44:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x556e52357c50 con 0x556e51f646b0 2024-09-17T03:44:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7b0a69740 10 client.0 _ll_register_callbacks cb 0x556e522382a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48310/0 (socket says 172.21.15.146:48310) 2024-09-17T03:44:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7a3fff640 1 -- 172.21.15.146:0/1683754632 learned_addr learned my addr 172.21.15.146:0/1683754632 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7a2ffd640 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52367c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52385020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7a3fff640 1 -- 172.21.15.146:0/1683754632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 msgr2=0x556e52367c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7a3fff640 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52367c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7a3fff640 1 -- 172.21.15.146:0/1683754632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 msgr2=0x556e52385020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7a3fff640 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52385020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7a3fff640 1 -- 172.21.15.146:0/1683754632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e520677d0 con 0x556e51f85390 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7a3fff640 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374370 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fd79c031fd0 tx=0x7fd79c084410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f5162fad346a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7827fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7827fc640 1 -- 172.21.15.146:0/1683754632 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c099e60 con 0x556e51f85390 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7827fc640 1 -- 172.21.15.146:0/1683754632 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fd79c06f170 con 0x556e51f85390 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7b0a69740 1 -- 172.21.15.146:0/1683754632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd794024070 con 0x556e51f85390 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7827fc640 1 -- 172.21.15.146:0/1683754632 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fd79c0aa030 con 0x556e51f85390 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.895+0000 7fd7b0a69740 10 client.10851 fetch_fsmap learned FSMap version 136 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7b0a69740 1 -- 172.21.15.146:0/1683754632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x556e5236a660 con 0x556e51f85390 2024-09-17T03:44:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7827fc640 1 -- 172.21.15.146:0/1683754632 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd794024070 con 0x556e51f85390 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7827fc640 1 -- 172.21.15.146:0/1683754632 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7fd79c040070 con 0x556e51f85390 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7b0a69740 10 client.10851 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7b0a69740 10 client.10851 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7b0a69740 20 client.10851 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x556e51f43f60 0x556e52368dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7b0a69740 4 client.10851 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7b0a69740 1 -- 172.21.15.146:0/1683754632 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e522a1830 con 0x556e51f43f60 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x556e51f43f60 0x556e52368dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7827fc640 10 client.10851 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.896+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x556e51f43f60 0x556e52368dc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84b1c55ad362af50 server_cookie=1b93160bbccce168 in_seq=0 out_seq=0 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7827fc640 1 -- 172.21.15.146:0/1683754632 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556e522a1830 con 0x556e51f43f60 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7827fc640 10 client.10851 handle_command_reply: tid=0 2024-09-17T03:44:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 1 client.10851 shutdown 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 1 -- 172.21.15.146:0/1683754632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 msgr2=0x556e52374370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374370 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fd79c031fd0 tx=0x7fd79c084410 comp rx=0 tx=0).stop 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 1 -- 172.21.15.146:0/1683754632 shutdown_connections 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x556e51f43f60 0x556e52368dc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374370 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52367c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7827fc640 0 client.10851 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/1683754632 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52385020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 1 -- 172.21.15.146:0/1683754632 >> 172.21.15.146:0/1683754632 conn(0x556e51f794e0 msgr2=0x556e52373be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 1 -- 172.21.15.146:0/1683754632 shutdown_connections 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 1 -- 172.21.15.146:0/1683754632 wait complete. 2024-09-17T03:44:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.897+0000 7fd7b0a69740 20 client.10851 trim_cache size 0 max 16384 2024-09-17T03:44:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.911+0000 7fd7b0a69740 1 Processor -- start 2024-09-17T03:44:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.911+0000 7fd7b0a69740 1 -- start start 2024-09-17T03:44:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.912+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52393fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.912+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52373de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.912+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.912+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a42002d0 con 0x556e51f85390 2024-09-17T03:44:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.912+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a41ff2b0 con 0x556e51f5c4d0 2024-09-17T03:44:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.912+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a4139680 con 0x556e51f646b0 2024-09-17T03:44:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.912+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.912+0000 7fd7a3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48314/0 (socket says 172.21.15.146:48314) 2024-09-17T03:44:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.912+0000 7fd7a3fff640 1 -- 172.21.15.146:0/4172396742 learned_addr learned my addr 172.21.15.146:0/4172396742 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/4172396742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52393fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd7a2ffd640 1 --2- 172.21.15.146:0/4172396742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52373de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd7a3fff640 1 -- 172.21.15.146:0/4172396742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 msgr2=0x556e52373de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd7a3fff640 1 --2- 172.21.15.146:0/4172396742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52373de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd7a3fff640 1 -- 172.21.15.146:0/4172396742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 msgr2=0x556e52393fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd7a3fff640 1 --2- 172.21.15.146:0/4172396742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52393fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd7a3fff640 1 -- 172.21.15.146:0/4172396742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e5236e0d0 con 0x556e51f85390 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/4172396742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52393fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd7a2ffd640 1 --2- 172.21.15.146:0/4172396742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52373de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd7a3fff640 1 --2- 172.21.15.146:0/4172396742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374320 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fd79c09e170 tx=0x7fd79c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f192ad01e2f1d282 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd788ff9640 1 -- 172.21.15.146:0/4172396742 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c099e60 con 0x556e51f85390 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd788ff9640 1 -- 172.21.15.146:0/4172396742 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd79c088050 con 0x556e51f85390 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.913+0000 7fd788ff9640 1 -- 172.21.15.146:0/4172396742 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c083560 con 0x556e51f85390 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.914+0000 7fd7b0a69740 1 -- 172.21.15.146:0/4172396742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 msgr2=0x556e52374320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.914+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/4172396742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374320 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fd79c09e170 tx=0x7fd79c009780 comp rx=0 tx=0).stop 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.914+0000 7fd7b0a69740 1 -- 172.21.15.146:0/4172396742 shutdown_connections 2024-09-17T03:44:46.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.914+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/4172396742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f85390 0x556e52374320 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.914+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/4172396742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e52373de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.914+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/4172396742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f5c4d0 0x556e52393fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.914+0000 7fd7b0a69740 1 -- 172.21.15.146:0/4172396742 >> 172.21.15.146:0/4172396742 conn(0x556e51f794e0 msgr2=0x556e52367c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.914+0000 7fd7b0a69740 1 -- 172.21.15.146:0/4172396742 shutdown_connections 2024-09-17T03:44:46.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.914+0000 7fd7b0a69740 1 -- 172.21.15.146:0/4172396742 wait complete. 2024-09-17T03:44:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.915+0000 7fd7b0a69740 1 -- start start 2024-09-17T03:44:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.915+0000 7fd7b0a69740 1 Processor -- start 2024-09-17T03:44:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f5c4d0 0x556e523d7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e523537b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7b0a69740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f85390 0x556e52353cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a41fed00 con 0x556e51f5c4d0 2024-09-17T03:44:46.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556e5236c5a0 con 0x556e51f85390 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7b0a69740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x556e52366690 con 0x556e51f646b0 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7b0a69740 10 client.0 _ll_register_callbacks cb 0x7fd79c004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7a37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f5c4d0 0x556e523d7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7a37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f5c4d0 0x556e523d7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48324/0 (socket says 172.21.15.146:48324) 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7a37fe640 1 -- 172.21.15.146:0/3311410429 learned_addr learned my addr 172.21.15.146:0/3311410429 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7a3fff640 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f85390 0x556e52353cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7a2ffd640 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e523537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7a37fe640 1 -- 172.21.15.146:0/3311410429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 msgr2=0x556e523537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e523537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7a37fe640 1 -- 172.21.15.146:0/3311410429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f85390 msgr2=0x556e52353cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f85390 0x556e52353cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.916+0000 7fd7a37fe640 1 -- 172.21.15.146:0/3311410429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e52322d40 con 0x556e51f5c4d0 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7a37fe640 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f5c4d0 0x556e523d7380 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7fd794020000 tx=0x7fd794015880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37d023fba4ce056 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7827fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7827fc640 1 -- 172.21.15.146:0/3311410429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794033610 con 0x556e51f5c4d0 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7827fc640 1 -- 172.21.15.146:0/3311410429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fd7940337b0 con 0x556e51f5c4d0 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3311410429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd79c088050 con 0x556e51f5c4d0 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7827fc640 1 -- 172.21.15.146:0/3311410429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fd794044050 con 0x556e51f5c4d0 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7b0a69740 10 client.10857 fetch_fsmap learned FSMap version 136 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3311410429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x556e523d78c0 con 0x556e51f5c4d0 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7827fc640 1 -- 172.21.15.146:0/3311410429 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd79c088050 con 0x556e51f5c4d0 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7827fc640 1 -- 172.21.15.146:0/3311410429 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7fd794047020 con 0x556e51f5c4d0 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7b0a69740 10 client.10857 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7b0a69740 10 client.10857 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7b0a69740 20 client.10857 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:46.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x556e523943a0 0x556e52368dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7b0a69740 4 client.10857 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3311410429 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e5229d2e0 con 0x556e523943a0 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.917+0000 7fd7a2ffd640 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x556e523943a0 0x556e52368dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7827fc640 10 client.10857 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7a2ffd640 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x556e523943a0 0x556e52368dc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f0ebbc7445b28be server_cookie=3a4378a65e3ed2b1 in_seq=0 out_seq=0 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7827fc640 1 -- 172.21.15.146:0/3311410429 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e5229d2e0 con 0x556e523943a0 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7827fc640 10 client.10857 handle_command_reply: tid=0 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 1 client.10857 shutdown 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3311410429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f5c4d0 msgr2=0x556e523d7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f5c4d0 0x556e523d7380 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7fd794020000 tx=0x7fd794015880 comp rx=0 tx=0).stop 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3311410429 shutdown_connections 2024-09-17T03:44:46.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x556e523943a0 0x556e52368dc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556e51f85390 0x556e52353cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7827fc640 0 client.10857 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556e51f646b0 0x556e523537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 1 --2- 172.21.15.146:0/3311410429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e51f5c4d0 0x556e523d7380 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3311410429 >> 172.21.15.146:0/3311410429 conn(0x556e51f794e0 msgr2=0x556e52367a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3311410429 shutdown_connections 2024-09-17T03:44:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 1 -- 172.21.15.146:0/3311410429 wait complete. 2024-09-17T03:44:46.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.918+0000 7fd7b0a69740 20 client.10857 trim_cache size 0 max 16384 2024-09-17T03:44:46.926 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2024-09-17T03:44:46.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 -- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd790078b90 msgr2=0x7fd79007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:46.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd790078b90 0x7fd79007b0a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd7940098e0 tx=0x7fd794009060 comp rx=0 tx=0).stop 2024-09-17T03:44:46.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 -- 172.21.15.146:0/477931142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a415c8e0 msgr2=0x7fd7a4151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:46.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a415c8e0 0x7fd7a4151c50 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7fd79c02af90 tx=0x7fd79c003f10 comp rx=0 tx=0).stop 2024-09-17T03:44:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 -- 172.21.15.146:0/477931142 shutdown_connections 2024-09-17T03:44:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd790078b90 0x7fd79007b0a0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7a415c8e0 0x7fd7a4151c50 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7a40cdc50 0x7fd7a4151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 --2- 172.21.15.146:0/477931142 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7a40cd840 0x7fd7a4155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 -- 172.21.15.146:0/477931142 >> 172.21.15.146:0/477931142 conn(0x7fd7a40b3150 msgr2=0x7fd7a40b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 -- 172.21.15.146:0/477931142 shutdown_connections 2024-09-17T03:44:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:46.919+0000 7fd7a9af9640 1 -- 172.21.15.146:0/477931142 wait complete. 2024-09-17T03:44:46.933 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T03:44:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.044+0000 7fa38cc8b640 1 -- 172.21.15.146:0/1573368065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3880b3870 msgr2=0x7fa3880cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.044+0000 7fa38cc8b640 1 --2- 172.21.15.146:0/1573368065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3880b3870 0x7fa3880cf370 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7fa3880b3d00 tx=0x7fa37802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.044+0000 7fa38cc8b640 1 -- 172.21.15.146:0/1573368065 shutdown_connections 2024-09-17T03:44:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.044+0000 7fa38cc8b640 1 --2- 172.21.15.146:0/1573368065 >> v2:172.21.15.179:3300/0 conn(0x7fa3881620f0 0x7fa38806ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.044+0000 7fa38cc8b640 1 --2- 172.21.15.146:0/1573368065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3880b3870 0x7fa3880cf370 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.044+0000 7fa38cc8b640 1 -- 172.21.15.146:0/1573368065 >> 172.21.15.146:0/1573368065 conn(0x7fa3880d4be0 msgr2=0x7fa3880d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.044+0000 7fa38cc8b640 1 -- 172.21.15.146:0/1573368065 shutdown_connections 2024-09-17T03:44:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.044+0000 7fa38cc8b640 1 -- 172.21.15.146:0/1573368065 wait complete. 2024-09-17T03:44:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.046+0000 7fa38cc8b640 1 Processor -- start 2024-09-17T03:44:47.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.046+0000 7fa38cc8b640 1 -- start start 2024-09-17T03:44:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38cc8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa38806f270 0x7fa388156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38cc8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3880b3870 0x7fa3880b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38cc8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3881620f0 0x7fa3881f95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38cc8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa388162670 con 0x7fa38806f270 2024-09-17T03:44:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38cc8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa3880d43b0 con 0x7fa3880b3870 2024-09-17T03:44:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38cc8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa388162fb0 con 0x7fa3881620f0 2024-09-17T03:44:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa38806f270 0x7fa388156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa38806f270 0x7fa388156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48348/0 (socket says 172.21.15.146:48348) 2024-09-17T03:44:47.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38659c640 1 -- 172.21.15.146:0/2522198794 learned_addr learned my addr 172.21.15.146:0/2522198794 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa37ffff640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3880b3870 0x7fa3880b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa386d9d640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3881620f0 0x7fa3881f95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38659c640 1 -- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3881620f0 msgr2=0x7fa3881f95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38659c640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3881620f0 0x7fa3881f95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38659c640 1 -- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3880b3870 msgr2=0x7fa3880b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38659c640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3880b3870 0x7fa3880b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38659c640 1 -- 172.21.15.146:0/2522198794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3880b6c00 con 0x7fa38806f270 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa38659c640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa38806f270 0x7fa388156670 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7fa378034040 tx=0x7fa378003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.048+0000 7fa37effd640 1 -- 172.21.15.146:0/2522198794 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37803e030 con 0x7fa38806f270 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.049+0000 7fa37effd640 1 -- 172.21.15.146:0/2522198794 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa378003e00 con 0x7fa38806f270 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.049+0000 7fa37effd640 1 -- 172.21.15.146:0/2522198794 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378035040 con 0x7fa38806f270 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.049+0000 7fa38cc8b640 1 -- 172.21.15.146:0/2522198794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3881fa290 con 0x7fa38806f270 2024-09-17T03:44:47.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.049+0000 7fa38cc8b640 1 -- 172.21.15.146:0/2522198794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3880cae90 con 0x7fa38806f270 2024-09-17T03:44:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.050+0000 7fa38cc8b640 1 -- 172.21.15.146:0/2522198794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3881634c0 con 0x7fa38806f270 2024-09-17T03:44:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.050+0000 7fa37effd640 1 -- 172.21.15.146:0/2522198794 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa378041030 con 0x7fa38806f270 2024-09-17T03:44:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.051+0000 7fa37effd640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa368078b90 0x7fa36807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.051+0000 7fa37effd640 1 -- 172.21.15.146:0/2522198794 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fa3780bb4e0 con 0x7fa38806f270 2024-09-17T03:44:47.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.051+0000 7fa37ffff640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa368078b90 0x7fa36807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.052+0000 7fa37ffff640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa368078b90 0x7fa36807b0a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa388075ee0 tx=0x7fa37000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.055+0000 7fa37effd640 1 -- 172.21.15.146:0/2522198794 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa3880b6c00 con 0x7fa38806f270 2024-09-17T03:44:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.268+0000 7fa38cc8b640 1 -- 172.21.15.146:0/2522198794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa3881fa460 con 0x7fa38806f270 2024-09-17T03:44:47.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.268+0000 7fa37effd640 1 -- 172.21.15.146:0/2522198794 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa38806f680 con 0x7fa38806f270 2024-09-17T03:44:47.268 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:44:47.269 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T03:44:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 -- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa368078b90 msgr2=0x7fa36807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa368078b90 0x7fa36807b0a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa388075ee0 tx=0x7fa37000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 -- 172.21.15.146:0/2522198794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa38806f270 msgr2=0x7fa388156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa38806f270 0x7fa388156670 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7fa378034040 tx=0x7fa378003910 comp rx=0 tx=0).stop 2024-09-17T03:44:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 -- 172.21.15.146:0/2522198794 shutdown_connections 2024-09-17T03:44:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa368078b90 0x7fa36807b0a0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3881620f0 0x7fa3881f95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3880b3870 0x7fa3880b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 --2- 172.21.15.146:0/2522198794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa38806f270 0x7fa388156670 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 -- 172.21.15.146:0/2522198794 >> 172.21.15.146:0/2522198794 conn(0x7fa3880d4be0 msgr2=0x7fa3880b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 -- 172.21.15.146:0/2522198794 shutdown_connections 2024-09-17T03:44:47.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.271+0000 7fa38cc8b640 1 -- 172.21.15.146:0/2522198794 wait complete. 2024-09-17T03:44:47.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:47.283 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub start '~mdsdir' recursive 2024-09-17T03:44:47.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.400+0000 7fc97aee5640 1 -- 172.21.15.146:0/2185505947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9740b3d30 msgr2=0x7fc97415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.400+0000 7fc97aee5640 1 --2- 172.21.15.146:0/2185505947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9740b3d30 0x7fc97415caa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009830 tx=0x7fc96c02a510 comp rx=0 tx=0).stop 2024-09-17T03:44:47.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.400+0000 7fc97aee5640 1 -- 172.21.15.146:0/2185505947 shutdown_connections 2024-09-17T03:44:47.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.400+0000 7fc97aee5640 1 --2- 172.21.15.146:0/2185505947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9740b3d30 0x7fc97415caa0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.400+0000 7fc97aee5640 1 --2- 172.21.15.146:0/2185505947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9740b5ce0 0x7fc9740b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.400+0000 7fc97aee5640 1 -- 172.21.15.146:0/2185505947 >> 172.21.15.146:0/2185505947 conn(0x7fc9740b7b20 msgr2=0x7fc97409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.401+0000 7fc97aee5640 1 -- 172.21.15.146:0/2185505947 shutdown_connections 2024-09-17T03:44:47.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.401+0000 7fc97aee5640 1 -- 172.21.15.146:0/2185505947 wait complete. 2024-09-17T03:44:47.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.402+0000 7fc97aee5640 1 Processor -- start 2024-09-17T03:44:47.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.402+0000 7fc97aee5640 1 -- start start 2024-09-17T03:44:47.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc97aee5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9740b5750 0x7fc974141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc97aee5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9740b5ce0 0x7fc97415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc97aee5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc97414de50 0x7fc97415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc97aee5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc97415d460 con 0x7fc9740b5750 2024-09-17T03:44:47.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc97aee5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc97415d2e0 con 0x7fc97414de50 2024-09-17T03:44:47.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc97aee5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc97415d5e0 con 0x7fc9740b5ce0 2024-09-17T03:44:47.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc978c81640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9740b5750 0x7fc974141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc978c81640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9740b5750 0x7fc974141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60244/0 (socket says 172.21.15.146:60244) 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc978c81640 1 -- 172.21.15.146:0/4241882040 learned_addr learned my addr 172.21.15.146:0/4241882040 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc979482640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc97414de50 0x7fc97415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc973fff640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9740b5ce0 0x7fc97415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc978c81640 1 -- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9740b5ce0 msgr2=0x7fc97415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc978c81640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9740b5ce0 0x7fc97415ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc978c81640 1 -- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc97414de50 msgr2=0x7fc97415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc978c81640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc97414de50 0x7fc97415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc978c81640 1 -- 172.21.15.146:0/4241882040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc974150e10 con 0x7fc9740b5750 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc973fff640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9740b5ce0 0x7fc97415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc978c81640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9740b5750 0x7fc974141f20 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7fc96400e9f0 tx=0x7fc96400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.404+0000 7fc9717fa640 1 -- 172.21.15.146:0/4241882040 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96400cd20 con 0x7fc9740b5750 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.405+0000 7fc9717fa640 1 -- 172.21.15.146:0/4241882040 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc964004020 con 0x7fc9740b5750 2024-09-17T03:44:47.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.405+0000 7fc9717fa640 1 -- 172.21.15.146:0/4241882040 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964004470 con 0x7fc9740b5750 2024-09-17T03:44:47.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.405+0000 7fc97aee5640 1 -- 172.21.15.146:0/4241882040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97415fb10 con 0x7fc9740b5750 2024-09-17T03:44:47.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.405+0000 7fc97aee5640 1 -- 172.21.15.146:0/4241882040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9741e4fd0 con 0x7fc9740b5750 2024-09-17T03:44:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.406+0000 7fc9717fa640 1 -- 172.21.15.146:0/4241882040 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9640035f0 con 0x7fc9740b5750 2024-09-17T03:44:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.407+0000 7fc9717fa640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc960078b90 0x7fc96007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.407+0000 7fc9717fa640 1 -- 172.21.15.146:0/4241882040 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fc96409b710 con 0x7fc9740b5750 2024-09-17T03:44:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.407+0000 7fc973fff640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc960078b90 0x7fc96007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.408+0000 7fc973fff640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc960078b90 0x7fc96007b0a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc974072630 tx=0x7fc968009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.408+0000 7fc981e56740 1 Processor -- start 2024-09-17T03:44:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.408+0000 7fc981e56740 1 -- start start 2024-09-17T03:44:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.409+0000 7fc981e56740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6f25b0 0x55905eae1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.409+0000 7fc981e56740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6c96f0 0x55905eac3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.409+0000 7fc981e56740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6d18d0 0x55905eac4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.409+0000 7fc981e56740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55905ea0ca80 con 0x55905e6c96f0 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.409+0000 7fc981e56740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55905e9fbeb0 con 0x55905e6f25b0 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.409+0000 7fc981e56740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55905e9ffcc0 con 0x55905e6d18d0 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.409+0000 7fc973fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6c96f0 0x55905eac3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.409+0000 7fc973fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6c96f0 0x55905eac3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60252/0 (socket says 172.21.15.146:60252) 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.409+0000 7fc973fff640 1 -- 172.21.15.146:0/2438417311 learned_addr learned my addr 172.21.15.146:0/2438417311 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.409+0000 7fc978c81640 1 --2- 172.21.15.146:0/2438417311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6f25b0 0x55905eae1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.409+0000 7fc979482640 1 --2- 172.21.15.146:0/2438417311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6d18d0 0x55905eac4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.410+0000 7fc973fff640 1 -- 172.21.15.146:0/2438417311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6d18d0 msgr2=0x55905eac4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.410+0000 7fc973fff640 1 --2- 172.21.15.146:0/2438417311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6d18d0 0x55905eac4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.410+0000 7fc973fff640 1 -- 172.21.15.146:0/2438417311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6f25b0 msgr2=0x55905eae1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.410+0000 7fc973fff640 1 --2- 172.21.15.146:0/2438417311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6f25b0 0x55905eae1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.410+0000 7fc973fff640 1 -- 172.21.15.146:0/2438417311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55905e7d6a20 con 0x55905e6c96f0 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.410+0000 7fc978c81640 1 --2- 172.21.15.146:0/2438417311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6f25b0 0x55905eae1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:44:47.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.410+0000 7fc973fff640 1 --2- 172.21.15.146:0/2438417311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6c96f0 0x55905eac3d40 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7fc96800ef70 tx=0x7fc968011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d92170e8e0819cb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.410+0000 7fc95a7fc640 1 -- 172.21.15.146:0/2438417311 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968005300 con 0x55905e6c96f0 2024-09-17T03:44:47.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.410+0000 7fc95a7fc640 1 -- 172.21.15.146:0/2438417311 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9680054a0 con 0x55905e6c96f0 2024-09-17T03:44:47.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.410+0000 7fc95a7fc640 1 -- 172.21.15.146:0/2438417311 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968005670 con 0x55905e6c96f0 2024-09-17T03:44:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.411+0000 7fc981e56740 1 -- 172.21.15.146:0/2438417311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6c96f0 msgr2=0x55905eac3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.411+0000 7fc981e56740 1 --2- 172.21.15.146:0/2438417311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6c96f0 0x55905eac3d40 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7fc96800ef70 tx=0x7fc968011000 comp rx=0 tx=0).stop 2024-09-17T03:44:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.411+0000 7fc981e56740 1 -- 172.21.15.146:0/2438417311 shutdown_connections 2024-09-17T03:44:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.411+0000 7fc981e56740 1 --2- 172.21.15.146:0/2438417311 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6d18d0 0x55905eac4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.411+0000 7fc981e56740 1 --2- 172.21.15.146:0/2438417311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6c96f0 0x55905eac3d40 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.411+0000 7fc981e56740 1 --2- 172.21.15.146:0/2438417311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6f25b0 0x55905eae1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.411+0000 7fc981e56740 1 -- 172.21.15.146:0/2438417311 >> 172.21.15.146:0/2438417311 conn(0x55905e6e6700 msgr2=0x55905ea99f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.411+0000 7fc981e56740 1 -- 172.21.15.146:0/2438417311 shutdown_connections 2024-09-17T03:44:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.411+0000 7fc981e56740 1 -- 172.21.15.146:0/2438417311 wait complete. 2024-09-17T03:44:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.412+0000 7fc981e56740 1 -- start start 2024-09-17T03:44:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.412+0000 7fc981e56740 1 Processor -- start 2024-09-17T03:44:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.413+0000 7fc981e56740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905ead8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.413+0000 7fc981e56740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905ead5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.413+0000 7fc981e56740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6f25b0 0x55905eaed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.413+0000 7fc981e56740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55905e76c960 con 0x55905e6d18d0 2024-09-17T03:44:47.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.413+0000 7fc981e56740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55905e982670 con 0x55905e6c96f0 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.413+0000 7fc981e56740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55905ead5d50 con 0x55905e6f25b0 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.413+0000 7fc981e56740 10 client.0 _ll_register_callbacks cb 0x55905e9f53e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.413+0000 7fc973fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905ead5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.413+0000 7fc973fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905ead5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60258/0 (socket says 172.21.15.146:60258) 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.413+0000 7fc973fff640 1 -- 172.21.15.146:0/1411510033 learned_addr learned my addr 172.21.15.146:0/1411510033 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc978c81640 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905ead8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc979482640 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6f25b0 0x55905eaed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc973fff640 1 -- 172.21.15.146:0/1411510033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6f25b0 msgr2=0x55905eaed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc973fff640 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6f25b0 0x55905eaed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc973fff640 1 -- 172.21.15.146:0/1411510033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 msgr2=0x55905ead8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc973fff640 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905ead8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc973fff640 1 -- 172.21.15.146:0/1411510033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55905e73b8c0 con 0x55905e6d18d0 2024-09-17T03:44:47.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc979482640 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6f25b0 0x55905eaed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc973fff640 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905ead5450 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7fc968001f50 tx=0x7fc968005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64dec587a77b1f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc9537fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc9537fe640 1 -- 172.21.15.146:0/1411510033 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968005300 con 0x55905e6d18d0 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc9537fe640 1 -- 172.21.15.146:0/1411510033 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fc96802cb20 con 0x55905e6d18d0 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc981e56740 1 -- 172.21.15.146:0/1411510033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9680054a0 con 0x55905e6d18d0 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc9537fe640 1 -- 172.21.15.146:0/1411510033 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fc96802cd20 con 0x55905e6d18d0 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc981e56740 10 client.10872 fetch_fsmap learned FSMap version 136 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc981e56740 1 -- 172.21.15.146:0/1411510033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55905e8371b0 con 0x55905e6d18d0 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc9537fe640 1 -- 172.21.15.146:0/1411510033 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9680054a0 con 0x55905e6d18d0 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc9537fe640 1 -- 172.21.15.146:0/1411510033 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7fc968014070 con 0x55905e6d18d0 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc981e56740 10 client.10872 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc981e56740 10 client.10872 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-17T03:44:47.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc981e56740 20 client.10872 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc981e56740 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55905e6b1180 0x55905eac09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc981e56740 4 client.10872 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.414+0000 7fc981e56740 1 -- 172.21.15.146:0/1411510033 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55905ea0e9d0 con 0x55905e6b1180 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.415+0000 7fc978c81640 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55905e6b1180 0x55905eac09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.415+0000 7fc9537fe640 10 client.10872 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.415+0000 7fc978c81640 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55905e6b1180 0x55905eac09f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b146cf7ffaa93e08 server_cookie=469cfb01bdd3a1f6 in_seq=0 out_seq=0 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc9537fe640 1 -- 172.21.15.146:0/1411510033 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55905ea0e9d0 con 0x55905e6b1180 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc9537fe640 10 client.10872 handle_command_reply: tid=0 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 1 client.10872 shutdown 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 1 -- 172.21.15.146:0/1411510033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 msgr2=0x55905ead5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905ead5450 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7fc968001f50 tx=0x7fc968005880 comp rx=0 tx=0).stop 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 1 -- 172.21.15.146:0/1411510033 shutdown_connections 2024-09-17T03:44:47.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55905e6b1180 0x55905eac09f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6f25b0 0x55905eaed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905ead5450 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc9537fe640 0 client.10872 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:47.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 1 --2- 172.21.15.146:0/1411510033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905ead8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 1 -- 172.21.15.146:0/1411510033 >> 172.21.15.146:0/1411510033 conn(0x55905e6e6700 msgr2=0x55905ea93170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 1 -- 172.21.15.146:0/1411510033 shutdown_connections 2024-09-17T03:44:47.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 1 -- 172.21.15.146:0/1411510033 wait complete. 2024-09-17T03:44:47.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.416+0000 7fc981e56740 20 client.10872 trim_cache size 0 max 16384 2024-09-17T03:44:47.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.434+0000 7fc981e56740 1 Processor -- start 2024-09-17T03:44:47.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.434+0000 7fc981e56740 1 -- start start 2024-09-17T03:44:47.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.435+0000 7fc981e56740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905eabb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.435+0000 7fc981e56740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6d18d0 0x55905eabb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.435+0000 7fc981e56740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6f25b0 0x55905eb01910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.435+0000 7fc981e56740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc974200130 con 0x55905e6f25b0 2024-09-17T03:44:47.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.435+0000 7fc981e56740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741ff1a0 con 0x55905e6c96f0 2024-09-17T03:44:47.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.435+0000 7fc981e56740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc9741f7a80 con 0x55905e6d18d0 2024-09-17T03:44:47.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.435+0000 7fc979482640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6f25b0 0x55905eb01910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.435+0000 7fc979482640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6f25b0 0x55905eb01910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60270/0 (socket says 172.21.15.146:60270) 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.435+0000 7fc979482640 1 -- 172.21.15.146:0/1477495547 learned_addr learned my addr 172.21.15.146:0/1477495547 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.435+0000 7fc978c81640 1 --2- 172.21.15.146:0/1477495547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905eabb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.435+0000 7fc973fff640 1 --2- 172.21.15.146:0/1477495547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6d18d0 0x55905eabb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.436+0000 7fc979482640 1 -- 172.21.15.146:0/1477495547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6d18d0 msgr2=0x55905eabb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.436+0000 7fc979482640 1 --2- 172.21.15.146:0/1477495547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6d18d0 0x55905eabb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.436+0000 7fc979482640 1 -- 172.21.15.146:0/1477495547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 msgr2=0x55905eabb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.436+0000 7fc979482640 1 --2- 172.21.15.146:0/1477495547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905eabb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.436+0000 7fc979482640 1 -- 172.21.15.146:0/1477495547 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55905e7d4d20 con 0x55905e6f25b0 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.436+0000 7fc979482640 1 --2- 172.21.15.146:0/1477495547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6f25b0 0x55905eb01910 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7fc96c004310 tx=0x7fc96c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ace1d45388f63bd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.436+0000 7fc959ffb640 1 -- 172.21.15.146:0/1477495547 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c004370 con 0x55905e6f25b0 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.436+0000 7fc959ffb640 1 -- 172.21.15.146:0/1477495547 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc96c005020 con 0x55905e6f25b0 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.436+0000 7fc959ffb640 1 -- 172.21.15.146:0/1477495547 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0053f0 con 0x55905e6f25b0 2024-09-17T03:44:47.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.437+0000 7fc981e56740 1 -- 172.21.15.146:0/1477495547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6f25b0 msgr2=0x55905eb01910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.437+0000 7fc981e56740 1 --2- 172.21.15.146:0/1477495547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6f25b0 0x55905eb01910 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7fc96c004310 tx=0x7fc96c0046c0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.437+0000 7fc981e56740 1 -- 172.21.15.146:0/1477495547 shutdown_connections 2024-09-17T03:44:47.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.437+0000 7fc981e56740 1 --2- 172.21.15.146:0/1477495547 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6f25b0 0x55905eb01910 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.437+0000 7fc981e56740 1 --2- 172.21.15.146:0/1477495547 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6d18d0 0x55905eabb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.437+0000 7fc981e56740 1 --2- 172.21.15.146:0/1477495547 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905eabb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.437+0000 7fc981e56740 1 -- 172.21.15.146:0/1477495547 >> 172.21.15.146:0/1477495547 conn(0x55905e6e6700 msgr2=0x55905eaf17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.437+0000 7fc981e56740 1 -- 172.21.15.146:0/1477495547 shutdown_connections 2024-09-17T03:44:47.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.437+0000 7fc981e56740 1 -- 172.21.15.146:0/1477495547 wait complete. 2024-09-17T03:44:47.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.437+0000 7fc981e56740 1 -- start start 2024-09-17T03:44:47.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.438+0000 7fc981e56740 1 Processor -- start 2024-09-17T03:44:47.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc981e56740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905eb54ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc981e56740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905eb61740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc981e56740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6f25b0 0x55905eae23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc981e56740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55905ea941f0 con 0x55905e6d18d0 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc981e56740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741508f0 con 0x55905e6c96f0 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc981e56740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55905eaf1420 con 0x55905e6f25b0 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc981e56740 10 client.0 _ll_register_callbacks cb 0x7fc96800ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc973fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905eb61740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc973fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905eb61740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60272/0 (socket says 172.21.15.146:60272) 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc973fff640 1 -- 172.21.15.146:0/2693346830 learned_addr learned my addr 172.21.15.146:0/2693346830 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc978c81640 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905eb54ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc979482640 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6f25b0 0x55905eae23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc973fff640 1 -- 172.21.15.146:0/2693346830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6f25b0 msgr2=0x55905eae23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc973fff640 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6f25b0 0x55905eae23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc973fff640 1 -- 172.21.15.146:0/2693346830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 msgr2=0x55905eb54ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc973fff640 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905eb54ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.439+0000 7fc973fff640 1 -- 172.21.15.146:0/2693346830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55905eb01ed0 con 0x55905e6d18d0 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc973fff640 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905eb61740 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7fc96800eb60 tx=0x7fc968004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee60410e292a3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc9537fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc9537fe640 1 -- 172.21.15.146:0/2693346830 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968039030 con 0x55905e6d18d0 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc9537fe640 1 -- 172.21.15.146:0/2693346830 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fc96801e040 con 0x55905e6d18d0 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc981e56740 1 -- 172.21.15.146:0/2693346830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc96c005020 con 0x55905e6d18d0 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc9537fe640 1 -- 172.21.15.146:0/2693346830 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7fc968042050 con 0x55905e6d18d0 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc981e56740 10 client.10878 fetch_fsmap learned FSMap version 136 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc981e56740 1 -- 172.21.15.146:0/2693346830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55905eb55010 con 0x55905e6d18d0 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc9537fe640 1 -- 172.21.15.146:0/2693346830 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc96c005020 con 0x55905e6d18d0 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc9537fe640 1 -- 172.21.15.146:0/2693346830 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7fc968045020 con 0x55905e6d18d0 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc981e56740 10 client.10878 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc981e56740 10 client.10878 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc981e56740 20 client.10878 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:47.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc981e56740 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55905eac3d40 0x55905eabb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc981e56740 4 client.10878 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc981e56740 1 -- 172.21.15.146:0/2693346830 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55905ea0a480 con 0x55905eac3d40 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.440+0000 7fc978c81640 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55905eac3d40 0x55905eabb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.441+0000 7fc9537fe640 10 client.10878 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.441+0000 7fc978c81640 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55905eac3d40 0x55905eabb370 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa95fd4e0ffcdeb7 server_cookie=8892afff8a78f5fd in_seq=0 out_seq=0 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.441+0000 7fc9537fe640 1 -- 172.21.15.146:0/2693346830 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55905ea0a480 con 0x55905eac3d40 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.441+0000 7fc9537fe640 10 client.10878 handle_command_reply: tid=0 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.441+0000 7fc981e56740 1 client.10878 shutdown 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.441+0000 7fc981e56740 1 -- 172.21.15.146:0/2693346830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 msgr2=0x55905eb61740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.441+0000 7fc981e56740 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905eb61740 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7fc96800eb60 tx=0x7fc968004f40 comp rx=0 tx=0).stop 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc981e56740 1 -- 172.21.15.146:0/2693346830 shutdown_connections 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc981e56740 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x55905eac3d40 0x55905eabb370 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc981e56740 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55905e6f25b0 0x55905eae23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc981e56740 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55905e6d18d0 0x55905eb61740 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc9537fe640 0 client.10878 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:47.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc981e56740 1 --2- 172.21.15.146:0/2693346830 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55905e6c96f0 0x55905eb54ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc981e56740 1 -- 172.21.15.146:0/2693346830 >> 172.21.15.146:0/2693346830 conn(0x55905e6e6700 msgr2=0x55905eadf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc981e56740 1 -- 172.21.15.146:0/2693346830 shutdown_connections 2024-09-17T03:44:47.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc981e56740 1 -- 172.21.15.146:0/2693346830 wait complete. 2024-09-17T03:44:47.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc981e56740 20 client.10878 trim_cache size 0 max 16384 2024-09-17T03:44:47.447 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:44:47.447 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:44:47.447 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "6216482b-2ac2-48e4-ab02-cbb74033422b", 2024-09-17T03:44:47.447 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:44:47.448 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:44:47.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 -- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc960078b90 msgr2=0x7fc96007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc960078b90 0x7fc96007b0a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc974072630 tx=0x7fc968009040 comp rx=0 tx=0).stop 2024-09-17T03:44:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 -- 172.21.15.146:0/4241882040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9740b5750 msgr2=0x7fc974141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9740b5750 0x7fc974141f20 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7fc96400e9f0 tx=0x7fc96400eeb0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 -- 172.21.15.146:0/4241882040 shutdown_connections 2024-09-17T03:44:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc960078b90 0x7fc96007b0a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc97414de50 0x7fc97415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9740b5ce0 0x7fc97415ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 --2- 172.21.15.146:0/4241882040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9740b5750 0x7fc974141f20 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 -- 172.21.15.146:0/4241882040 >> 172.21.15.146:0/4241882040 conn(0x7fc9740b7b20 msgr2=0x7fc9740b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 -- 172.21.15.146:0/4241882040 shutdown_connections 2024-09-17T03:44:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.442+0000 7fc97aee5640 1 -- 172.21.15.146:0/4241882040 wait complete. 2024-09-17T03:44:47.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:44:47.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-17T03:44:47.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.570+0000 7f34939ad640 1 -- 172.21.15.146:0/1552109525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cfca0 msgr2=0x7f348c0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.570+0000 7f34939ad640 1 --2- 172.21.15.146:0/1552109525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cfca0 0x7f348c0cef40 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f347c005fd0 tx=0x7f347c02a540 comp rx=0 tx=0).stop 2024-09-17T03:44:47.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.570+0000 7f34939ad640 1 -- 172.21.15.146:0/1552109525 shutdown_connections 2024-09-17T03:44:47.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.570+0000 7f34939ad640 1 --2- 172.21.15.146:0/1552109525 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f348c0b61f0 0x7f348c0b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.570+0000 7f34939ad640 1 --2- 172.21.15.146:0/1552109525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cfca0 0x7f348c0cef40 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.570+0000 7f34939ad640 1 -- 172.21.15.146:0/1552109525 >> 172.21.15.146:0/1552109525 conn(0x7f348c0d11f0 msgr2=0x7f348c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.570+0000 7f34939ad640 1 -- 172.21.15.146:0/1552109525 shutdown_connections 2024-09-17T03:44:47.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.570+0000 7f34939ad640 1 -- 172.21.15.146:0/1552109525 wait complete. 2024-09-17T03:44:47.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.572+0000 7f34939ad640 1 Processor -- start 2024-09-17T03:44:47.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.572+0000 7f34939ad640 1 -- start start 2024-09-17T03:44:47.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f34939ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f348c0b61f0 0x7f348c159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f34939ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cfca0 0x7f348c14a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f34939ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f348c15f1a0 0x7f348c1f9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f34939ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f348c0695b0 con 0x7f348c0cfca0 2024-09-17T03:44:47.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f34939ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f348c069430 con 0x7f348c15f1a0 2024-09-17T03:44:47.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f34939ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f348c069730 con 0x7f348c0b61f0 2024-09-17T03:44:47.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f3490f48640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cfca0 0x7f348c14a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f3490f48640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cfca0 0x7f348c14a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60288/0 (socket says 172.21.15.146:60288) 2024-09-17T03:44:47.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f3490f48640 1 -- 172.21.15.146:0/447523432 learned_addr learned my addr 172.21.15.146:0/447523432 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:47.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f3491749640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f348c0b61f0 0x7f348c159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f3491f4a640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f348c15f1a0 0x7f348c1f9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f3490f48640 1 -- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f348c0b61f0 msgr2=0x7f348c159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f3490f48640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f348c0b61f0 0x7f348c159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f3490f48640 1 -- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f348c15f1a0 msgr2=0x7f348c1f9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f3490f48640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f348c15f1a0 0x7f348c1f9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.573+0000 7f3490f48640 1 -- 172.21.15.146:0/447523432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c0cbd70 con 0x7f348c0cfca0 2024-09-17T03:44:47.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.574+0000 7f3490f48640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cfca0 0x7f348c14a280 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f347c034040 tx=0x7f347c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.574+0000 7f3481ffb640 1 -- 172.21.15.146:0/447523432 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c03e030 con 0x7f348c0cfca0 2024-09-17T03:44:47.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.574+0000 7f3481ffb640 1 -- 172.21.15.146:0/447523432 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f347c003d90 con 0x7f348c0cfca0 2024-09-17T03:44:47.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.574+0000 7f34939ad640 1 -- 172.21.15.146:0/447523432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348c1f7310 con 0x7f348c0cfca0 2024-09-17T03:44:47.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.574+0000 7f3481ffb640 1 -- 172.21.15.146:0/447523432 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c035040 con 0x7f348c0cfca0 2024-09-17T03:44:47.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.574+0000 7f34939ad640 1 -- 172.21.15.146:0/447523432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348c0cd370 con 0x7f348c0cfca0 2024-09-17T03:44:47.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.576+0000 7f3481ffb640 1 -- 172.21.15.146:0/447523432 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f347c041030 con 0x7f348c0cfca0 2024-09-17T03:44:47.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.576+0000 7f3481ffb640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 0x7f347007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.576+0000 7f3481ffb640 1 -- 172.21.15.146:0/447523432 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f347c0bb690 con 0x7f348c0cfca0 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.577+0000 7f3491749640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 0x7f347007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.577+0000 7f3491749640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 0x7f347007b0a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3488001720 tx=0x7f3488009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.577+0000 7f349a9f7740 1 Processor -- start 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.577+0000 7f349a9f7740 1 -- start start 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3f0390 0x5615da7dca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3cf6b0 0x5615da7b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f349a9f7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5615da70aa60 con 0x5615da3c74d0 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f349a9f7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5615da6f9e90 con 0x5615da3f0390 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f349a9f7740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5615da6fdca0 con 0x5615da3cf6b0 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3490f48640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3490f48640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60290/0 (socket says 172.21.15.146:60290) 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3490f48640 1 -- 172.21.15.146:0/1119852716 learned_addr learned my addr 172.21.15.146:0/1119852716 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:47.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3491749640 1 --2- 172.21.15.146:0/1119852716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3f0390 0x5615da7dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3491f4a640 1 --2- 172.21.15.146:0/1119852716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3cf6b0 0x5615da7b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3490f48640 1 -- 172.21.15.146:0/1119852716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3cf6b0 msgr2=0x5615da7b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3490f48640 1 --2- 172.21.15.146:0/1119852716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3cf6b0 0x5615da7b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3490f48640 1 -- 172.21.15.146:0/1119852716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3f0390 msgr2=0x5615da7dca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3490f48640 1 --2- 172.21.15.146:0/1119852716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3f0390 0x5615da7dca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3490f48640 1 -- 172.21.15.146:0/1119852716 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615da4d27d0 con 0x5615da3c74d0 2024-09-17T03:44:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3491f4a640 1 --2- 172.21.15.146:0/1119852716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3cf6b0 0x5615da7b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3490f48640 1 --2- 172.21.15.146:0/1119852716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7b1860 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f347c0b9c70 tx=0x7f347c082ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2070b6b38e134ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3476ffd640 1 -- 172.21.15.146:0/1119852716 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c048040 con 0x5615da3c74d0 2024-09-17T03:44:47.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3476ffd640 1 -- 172.21.15.146:0/1119852716 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f347c0835a0 con 0x5615da3c74d0 2024-09-17T03:44:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.579+0000 7f3476ffd640 1 -- 172.21.15.146:0/1119852716 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c083a40 con 0x5615da3c74d0 2024-09-17T03:44:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.580+0000 7f349a9f7740 1 -- 172.21.15.146:0/1119852716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 msgr2=0x5615da7b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.580+0000 7f349a9f7740 1 --2- 172.21.15.146:0/1119852716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7b1860 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f347c0b9c70 tx=0x7f347c082ef0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.580+0000 7f349a9f7740 1 -- 172.21.15.146:0/1119852716 shutdown_connections 2024-09-17T03:44:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.580+0000 7f349a9f7740 1 --2- 172.21.15.146:0/1119852716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3cf6b0 0x5615da7b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.580+0000 7f349a9f7740 1 --2- 172.21.15.146:0/1119852716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7b1860 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.580+0000 7f349a9f7740 1 --2- 172.21.15.146:0/1119852716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3f0390 0x5615da7dca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.580+0000 7f349a9f7740 1 -- 172.21.15.146:0/1119852716 >> 172.21.15.146:0/1119852716 conn(0x5615da3e44e0 msgr2=0x5615da797d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.580+0000 7f349a9f7740 1 -- 172.21.15.146:0/1119852716 shutdown_connections 2024-09-17T03:44:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.580+0000 7f349a9f7740 1 -- 172.21.15.146:0/1119852716 wait complete. 2024-09-17T03:44:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.581+0000 7f349a9f7740 1 -- start start 2024-09-17T03:44:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.581+0000 7f349a9f7740 1 Processor -- start 2024-09-17T03:44:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3cf6b0 0x5615da7c2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3f0390 0x5615da7eee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f349a9f7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5615da46a740 con 0x5615da3c74d0 2024-09-17T03:44:47.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f349a9f7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5615da69f970 con 0x5615da3cf6b0 2024-09-17T03:44:47.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f349a9f7740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5615da70aa60 con 0x5615da3f0390 2024-09-17T03:44:47.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f349a9f7740 10 client.0 _ll_register_callbacks cb 0x5615da6ae780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:47.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f3491749640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f3491749640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60304/0 (socket says 172.21.15.146:60304) 2024-09-17T03:44:47.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f3491749640 1 -- 172.21.15.146:0/3759236939 learned_addr learned my addr 172.21.15.146:0/3759236939 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:47.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f3491f4a640 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3f0390 0x5615da7eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f3490f48640 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3cf6b0 0x5615da7c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f3491749640 1 -- 172.21.15.146:0/3759236939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3f0390 msgr2=0x5615da7eee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f3491749640 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3f0390 0x5615da7eee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f3491749640 1 -- 172.21.15.146:0/3759236939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3cf6b0 msgr2=0x5615da7c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f3491749640 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3cf6b0 0x5615da7c2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f3491749640 1 -- 172.21.15.146:0/3759236939 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615da45b970 con 0x5615da3c74d0 2024-09-17T03:44:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f3491749640 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7ae2c0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f3488014700 tx=0x7f3488000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9232cdc8c1ffb89c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f346bfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f346bfff640 1 -- 172.21.15.146:0/3759236939 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3488025020 con 0x5615da3c74d0 2024-09-17T03:44:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f346bfff640 1 -- 172.21.15.146:0/3759236939 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f3488013740 con 0x5615da3c74d0 2024-09-17T03:44:47.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.583+0000 7f349a9f7740 1 -- 172.21.15.146:0/3759236939 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f347c0835a0 con 0x5615da3c74d0 2024-09-17T03:44:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f346bfff640 1 -- 172.21.15.146:0/3759236939 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f348802f050 con 0x5615da3c74d0 2024-09-17T03:44:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f349a9f7740 10 client.10890 fetch_fsmap learned FSMap version 136 2024-09-17T03:44:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f349a9f7740 1 -- 172.21.15.146:0/3759236939 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x5615da4396a0 con 0x5615da3c74d0 2024-09-17T03:44:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f346bfff640 1 -- 172.21.15.146:0/3759236939 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f347c0835a0 con 0x5615da3c74d0 2024-09-17T03:44:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f346bfff640 1 -- 172.21.15.146:0/3759236939 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7f3488032020 con 0x5615da3c74d0 2024-09-17T03:44:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f349a9f7740 10 client.10890 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:44:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f349a9f7740 10 client.10890 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-17T03:44:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f349a9f7740 20 client.10890 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f349a9f7740 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5615da3aef60 0x5615da7d48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f349a9f7740 4 client.10890 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:44:47.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f349a9f7740 1 -- 172.21.15.146:0/3759236939 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615da70c9b0 con 0x5615da3aef60 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f3490f48640 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5615da3aef60 0x5615da7d48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.584+0000 7f346bfff640 10 client.10890 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f3490f48640 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5615da3aef60 0x5615da7d48d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20f9d6b5e1179616 server_cookie=ebf034ab1e667e94 in_seq=0 out_seq=0 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f346bfff640 1 -- 172.21.15.146:0/3759236939 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5615da70c9b0 con 0x5615da3aef60 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f346bfff640 10 client.10890 handle_command_reply: tid=0 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f349a9f7740 1 client.10890 shutdown 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f349a9f7740 1 -- 172.21.15.146:0/3759236939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 msgr2=0x5615da7ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f349a9f7740 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7ae2c0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f3488014700 tx=0x7f3488000ed0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f349a9f7740 1 -- 172.21.15.146:0/3759236939 shutdown_connections 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f349a9f7740 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5615da3aef60 0x5615da7d48d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f349a9f7740 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3f0390 0x5615da7eee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f349a9f7740 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3cf6b0 0x5615da7c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f346bfff640 0 client.10890 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:47.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f349a9f7740 1 --2- 172.21.15.146:0/3759236939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3c74d0 0x5615da7ae2c0 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.585+0000 7f349a9f7740 1 -- 172.21.15.146:0/3759236939 >> 172.21.15.146:0/3759236939 conn(0x5615da3e44e0 msgr2=0x5615da792e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.586+0000 7f349a9f7740 1 -- 172.21.15.146:0/3759236939 shutdown_connections 2024-09-17T03:44:47.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.586+0000 7f349a9f7740 1 -- 172.21.15.146:0/3759236939 wait complete. 2024-09-17T03:44:47.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.586+0000 7f349a9f7740 20 client.10890 trim_cache size 0 max 16384 2024-09-17T03:44:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.603+0000 7f349a9f7740 1 Processor -- start 2024-09-17T03:44:47.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.603+0000 7f349a9f7740 1 -- start start 2024-09-17T03:44:47.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.604+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3c74d0 0x5615da7b1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3cf6b0 0x5615da7b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3f0390 0x5615da797960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f349a9f7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f348c2023c0 con 0x5615da3cf6b0 2024-09-17T03:44:47.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f349a9f7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f348c0ce1c0 con 0x5615da3f0390 2024-09-17T03:44:47.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f349a9f7740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f348c14d700 con 0x5615da3c74d0 2024-09-17T03:44:47.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3490f48640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3cf6b0 0x5615da7b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3490f48640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3cf6b0 0x5615da7b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60318/0 (socket says 172.21.15.146:60318) 2024-09-17T03:44:47.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3490f48640 1 -- 172.21.15.146:0/405674536 learned_addr learned my addr 172.21.15.146:0/405674536 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:47.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3491f4a640 1 --2- 172.21.15.146:0/405674536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3f0390 0x5615da797960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3491749640 1 --2- 172.21.15.146:0/405674536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3c74d0 0x5615da7b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3490f48640 1 -- 172.21.15.146:0/405674536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3c74d0 msgr2=0x5615da7b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3490f48640 1 --2- 172.21.15.146:0/405674536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3c74d0 0x5615da7b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3490f48640 1 -- 172.21.15.146:0/405674536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3f0390 msgr2=0x5615da797960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3490f48640 1 --2- 172.21.15.146:0/405674536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3f0390 0x5615da797960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3490f48640 1 -- 172.21.15.146:0/405674536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615da7ddaf0 con 0x5615da3cf6b0 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3491749640 1 --2- 172.21.15.146:0/405674536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3c74d0 0x5615da7b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3491f4a640 1 --2- 172.21.15.146:0/405674536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3f0390 0x5615da797960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f3490f48640 1 --2- 172.21.15.146:0/405674536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3cf6b0 0x5615da7b1b60 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f347c02ab30 tx=0x7f347c02a540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b712d15d8c962681 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f34767fc640 1 -- 172.21.15.146:0/405674536 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c048040 con 0x5615da3cf6b0 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f34767fc640 1 -- 172.21.15.146:0/405674536 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f347c06e070 con 0x5615da3cf6b0 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.605+0000 7f34767fc640 1 -- 172.21.15.146:0/405674536 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c083a60 con 0x5615da3cf6b0 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.606+0000 7f349a9f7740 1 -- 172.21.15.146:0/405674536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3cf6b0 msgr2=0x5615da7b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.606+0000 7f349a9f7740 1 --2- 172.21.15.146:0/405674536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3cf6b0 0x5615da7b1b60 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f347c02ab30 tx=0x7f347c02a540 comp rx=0 tx=0).stop 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.606+0000 7f349a9f7740 1 -- 172.21.15.146:0/405674536 shutdown_connections 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.606+0000 7f349a9f7740 1 --2- 172.21.15.146:0/405674536 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3f0390 0x5615da797960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.606+0000 7f349a9f7740 1 --2- 172.21.15.146:0/405674536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3cf6b0 0x5615da7b1b60 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.606+0000 7f349a9f7740 1 --2- 172.21.15.146:0/405674536 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3c74d0 0x5615da7b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.606+0000 7f349a9f7740 1 -- 172.21.15.146:0/405674536 >> 172.21.15.146:0/405674536 conn(0x5615da3e44e0 msgr2=0x5615da78d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.606+0000 7f349a9f7740 1 -- 172.21.15.146:0/405674536 shutdown_connections 2024-09-17T03:44:47.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.606+0000 7f349a9f7740 1 -- 172.21.15.146:0/405674536 wait complete. 2024-09-17T03:44:47.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.607+0000 7f349a9f7740 1 -- start start 2024-09-17T03:44:47.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.607+0000 7f349a9f7740 1 Processor -- start 2024-09-17T03:44:47.613 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.608+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3c74d0 0x5615da855100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.608+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3cf6b0 0x5615da797960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.608+0000 7f349a9f7740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3f0390 0x5615da797ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.608+0000 7f349a9f7740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f348c0cdb70 con 0x5615da3f0390 2024-09-17T03:44:47.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.608+0000 7f349a9f7740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5615da7dd8b0 con 0x5615da3cf6b0 2024-09-17T03:44:47.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.608+0000 7f349a9f7740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5615da7dced0 con 0x5615da3c74d0 2024-09-17T03:44:47.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.608+0000 7f349a9f7740 10 client.0 _ll_register_callbacks cb 0x7f3488001400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:44:47.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f3491f4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3f0390 0x5615da797ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f3491f4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3f0390 0x5615da797ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60322/0 (socket says 172.21.15.146:60322) 2024-09-17T03:44:47.614 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f3491f4a640 1 -- 172.21.15.146:0/2081749100 learned_addr learned my addr 172.21.15.146:0/2081749100 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:44:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f3491749640 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3c74d0 0x5615da855100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f3490f48640 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3cf6b0 0x5615da797960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f3491f4a640 1 -- 172.21.15.146:0/2081749100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3c74d0 msgr2=0x5615da855100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f3491f4a640 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3c74d0 0x5615da855100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f3491f4a640 1 -- 172.21.15.146:0/2081749100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3cf6b0 msgr2=0x5615da797960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:44:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f3491f4a640 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3cf6b0 0x5615da797960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f3491f4a640 1 -- 172.21.15.146:0/2081749100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615da855640 con 0x5615da3f0390 2024-09-17T03:44:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f3491f4a640 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3f0390 0x5615da797ea0 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f348c068d40 tx=0x7f3484012bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4490d1f7ed4fa4f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:44:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f346bfff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:44:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f346bfff640 1 -- 172.21.15.146:0/2081749100 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484021060 con 0x5615da3f0390 2024-09-17T03:44:47.615 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f346bfff640 1 -- 172.21.15.146:0/2081749100 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f3484003d80 con 0x5615da3f0390 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f349a9f7740 1 -- 172.21.15.146:0/2081749100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f347c06e070 con 0x5615da3f0390 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f346bfff640 1 -- 172.21.15.146:0/2081749100 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f3484027050 con 0x5615da3f0390 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f349a9f7740 10 client.10896 fetch_fsmap learned FSMap version 136 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f349a9f7740 1 -- 172.21.15.146:0/2081749100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x5615da7eed80 con 0x5615da3f0390 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.609+0000 7f346bfff640 1 -- 172.21.15.146:0/2081749100 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f347c06e070 con 0x5615da3f0390 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f346bfff640 1 -- 172.21.15.146:0/2081749100 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7f348402a020 con 0x5615da3f0390 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f349a9f7740 10 client.10896 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f349a9f7740 10 client.10896 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f349a9f7740 20 client.10896 populate_metadata read hostname 'smithi146' 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f349a9f7740 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5615da7b1c10 0x5615da85e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f349a9f7740 4 client.10896 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f349a9f7740 1 -- 172.21.15.146:0/2081749100 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5615da708460 con 0x5615da7b1c10 2024-09-17T03:44:47.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f3491749640 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5615da7b1c10 0x5615da85e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f346bfff640 10 client.10896 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f3491749640 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5615da7b1c10 0x5615da85e820 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bbede0b10cd2479 server_cookie=bb20ad4f5024949e in_seq=0 out_seq=0 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f346bfff640 1 -- 172.21.15.146:0/2081749100 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+574 (crc 0 0 0) 0x5615da708460 con 0x5615da7b1c10 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f346bfff640 10 client.10896 handle_command_reply: tid=0 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.610+0000 7f349a9f7740 1 client.10896 shutdown 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f349a9f7740 1 -- 172.21.15.146:0/2081749100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3f0390 msgr2=0x5615da797ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f349a9f7740 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3f0390 0x5615da797ea0 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f348c068d40 tx=0x7f3484012bd0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f349a9f7740 1 -- 172.21.15.146:0/2081749100 shutdown_connections 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f349a9f7740 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5615da7b1c10 0x5615da85e820 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f349a9f7740 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5615da3f0390 0x5615da797ea0 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f349a9f7740 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5615da3cf6b0 0x5615da797960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f346bfff640 0 client.10896 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f349a9f7740 1 --2- 172.21.15.146:0/2081749100 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5615da3c74d0 0x5615da855100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f349a9f7740 1 -- 172.21.15.146:0/2081749100 >> 172.21.15.146:0/2081749100 conn(0x5615da3e44e0 msgr2=0x5615da7add10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f349a9f7740 1 -- 172.21.15.146:0/2081749100 shutdown_connections 2024-09-17T03:44:47.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f349a9f7740 1 -- 172.21.15.146:0/2081749100 wait complete. 2024-09-17T03:44:47.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f349a9f7740 20 client.10896 trim_cache size 0 max 16384 2024-09-17T03:44:47.618 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:44:47.618 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:44:47.618 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:44:47.618 INFO:teuthology.orchestra.run.smithi146.stdout: "6216482b-2ac2-48e4-ab02-cbb74033422b": { 2024-09-17T03:44:47.618 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "~mds0", 2024-09-17T03:44:47.618 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "6216482b-2ac2-48e4-ab02-cbb74033422b", 2024-09-17T03:44:47.618 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: "6216482b-2ac2-48e4-ab02-cbb74033422b": { 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:44:47.441800+0000", 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "~mdsdir", 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:47.619 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:44:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:44:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 -- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 msgr2=0x7f347007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 0x7f347007b0a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3488001720 tx=0x7f3488009040 comp rx=0 tx=0).stop 2024-09-17T03:44:47.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 -- 172.21.15.146:0/447523432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cfca0 msgr2=0x7f348c14a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:44:47.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cfca0 0x7f348c14a280 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f347c034040 tx=0x7f347c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 -- 172.21.15.146:0/447523432 shutdown_connections 2024-09-17T03:44:47.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3470078b90 0x7f347007b0a0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f348c15f1a0 0x7f348c1f9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f348c0cfca0 0x7f348c14a280 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 --2- 172.21.15.146:0/447523432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f348c0b61f0 0x7f348c159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:44:47.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 -- 172.21.15.146:0/447523432 >> 172.21.15.146:0/447523432 conn(0x7f348c0d11f0 msgr2=0x7f348c15d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:44:47.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 -- 172.21.15.146:0/447523432 shutdown_connections 2024-09-17T03:44:47.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:44:47.611+0000 7f34939ad640 1 -- 172.21.15.146:0/447523432 wait complete. 2024-09-17T03:44:47.623 INFO:tasks.cephfs.filesystem:scrub status for tag:6216482b-2ac2-48e4-ab02-cbb74033422b - {'path': '~mds0', 'tag': '6216482b-2ac2-48e4-ab02-cbb74033422b', 'options': 'recursive'} 2024-09-17T03:44:59.905 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:44:59.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:45:17.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:17.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-17T03:45:17.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.751+0000 7facb1d3a640 1 -- 172.21.15.146:0/1926402129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facac0b5750 msgr2=0x7facac0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.751+0000 7facb1d3a640 1 --2- 172.21.15.146:0/1926402129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facac0b5750 0x7facac0b3620 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7faca0009830 tx=0x7faca002a510 comp rx=0 tx=0).stop 2024-09-17T03:45:17.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.751+0000 7facb1d3a640 1 -- 172.21.15.146:0/1926402129 shutdown_connections 2024-09-17T03:45:17.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.751+0000 7facb1d3a640 1 --2- 172.21.15.146:0/1926402129 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0b3b60 0x7facac15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.751+0000 7facb1d3a640 1 --2- 172.21.15.146:0/1926402129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facac0b5750 0x7facac0b3620 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.751+0000 7facb1d3a640 1 -- 172.21.15.146:0/1926402129 >> 172.21.15.146:0/1926402129 conn(0x7facac0b7b20 msgr2=0x7facac09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.751+0000 7facb1d3a640 1 -- 172.21.15.146:0/1926402129 shutdown_connections 2024-09-17T03:45:17.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.751+0000 7facb1d3a640 1 -- 172.21.15.146:0/1926402129 wait complete. 2024-09-17T03:45:17.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.753+0000 7facb1d3a640 1 Processor -- start 2024-09-17T03:45:17.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.753+0000 7facb1d3a640 1 -- start start 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.754+0000 7facb1d3a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facac0b3b60 0x7facac14a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.754+0000 7facb1d3a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facac0b5750 0x7facac0b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.754+0000 7facb1d3a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0b5ce0 0x7facac143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.754+0000 7facb1d3a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7facac15d4b0 con 0x7facac0b3b60 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.754+0000 7facb1d3a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7facac15d330 con 0x7facac0b5750 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.754+0000 7facb1d3a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7facac15d630 con 0x7facac0b5ce0 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.754+0000 7facab7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facac0b3b60 0x7facac14a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.754+0000 7facab7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facac0b3b60 0x7facac14a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34012/0 (socket says 172.21.15.146:34012) 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.754+0000 7facab7fe640 1 -- 172.21.15.146:0/1775133677 learned_addr learned my addr 172.21.15.146:0/1775133677 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.754+0000 7facaaffd640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facac0b5750 0x7facac0b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.754+0000 7facabfff640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0b5ce0 0x7facac143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7facab7fe640 1 -- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0b5ce0 msgr2=0x7facac143750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7facab7fe640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0b5ce0 0x7facac143750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7facab7fe640 1 -- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facac0b5750 msgr2=0x7facac0b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7facab7fe640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facac0b5750 0x7facac0b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7facab7fe640 1 -- 172.21.15.146:0/1775133677 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facac147190 con 0x7facac0b3b60 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7facaaffd640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facac0b5750 0x7facac0b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7facabfff640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0b5ce0 0x7facac143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7facab7fe640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facac0b3b60 0x7facac14a4b0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00c3f0 tx=0x7fac9c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7fac93fff640 1 -- 172.21.15.146:0/1775133677 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c017070 con 0x7facac0b3b60 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7fac93fff640 1 -- 172.21.15.146:0/1775133677 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac9c0035f0 con 0x7facac0b3b60 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7facb1d3a640 1 -- 172.21.15.146:0/1775133677 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facac1f70a0 con 0x7facac0b3b60 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7fac93fff640 1 -- 172.21.15.146:0/1775133677 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c003a40 con 0x7facac0b3b60 2024-09-17T03:45:17.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.755+0000 7facb1d3a640 1 -- 172.21.15.146:0/1775133677 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facac1e5040 con 0x7facac0b3b60 2024-09-17T03:45:17.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.757+0000 7fac93fff640 1 -- 172.21.15.146:0/1775133677 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac9c01a070 con 0x7facac0b3b60 2024-09-17T03:45:17.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.757+0000 7fac93fff640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac98078bc0 0x7fac9807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.758+0000 7fac93fff640 1 -- 172.21.15.146:0/1775133677 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fac9c09a030 con 0x7facac0b3b60 2024-09-17T03:45:17.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.758+0000 7facaaffd640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac98078bc0 0x7fac9807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.758+0000 7facb8ca4740 1 Processor -- start 2024-09-17T03:45:17.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.758+0000 7facb8ca4740 1 -- start start 2024-09-17T03:45:17.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.758+0000 7facaaffd640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac98078bc0 0x7fac9807b0d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7faca0034000 tx=0x7faca0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a5933a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a5908860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 0x5651a5908da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facb8ca4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5651a5861a60 con 0x5651a551e4d0 2024-09-17T03:45:17.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facb8ca4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5651a5850e90 con 0x5651a5547390 2024-09-17T03:45:17.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facb8ca4740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5651a5854ca0 con 0x5651a55266b0 2024-09-17T03:45:17.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facaaffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a5908860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facaaffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a5908860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34016/0 (socket says 172.21.15.146:34016) 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facaaffd640 1 -- 172.21.15.146:0/1198421769 learned_addr learned my addr 172.21.15.146:0/1198421769 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facab7fe640 1 --2- 172.21.15.146:0/1198421769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a5933a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facabfff640 1 --2- 172.21.15.146:0/1198421769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 0x5651a5908da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facaaffd640 1 -- 172.21.15.146:0/1198421769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 msgr2=0x5651a5908da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facaaffd640 1 --2- 172.21.15.146:0/1198421769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 0x5651a5908da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facaaffd640 1 -- 172.21.15.146:0/1198421769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 msgr2=0x5651a5933a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facaaffd640 1 --2- 172.21.15.146:0/1198421769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a5933a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.760+0000 7facaaffd640 1 -- 172.21.15.146:0/1198421769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a56297d0 con 0x5651a551e4d0 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.761+0000 7facaaffd640 1 --2- 172.21.15.146:0/1198421769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a5908860 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7faca002ab00 tx=0x7faca003d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f02f1447851335b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.761+0000 7fac917fa640 1 -- 172.21.15.146:0/1198421769 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0003e10 con 0x5651a551e4d0 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.761+0000 7fac917fa640 1 -- 172.21.15.146:0/1198421769 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faca0048510 con 0x5651a551e4d0 2024-09-17T03:45:17.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.761+0000 7fac917fa640 1 -- 172.21.15.146:0/1198421769 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0048920 con 0x5651a551e4d0 2024-09-17T03:45:17.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.762+0000 7facb8ca4740 1 -- 172.21.15.146:0/1198421769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 msgr2=0x5651a5908860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.762+0000 7facb8ca4740 1 --2- 172.21.15.146:0/1198421769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a5908860 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7faca002ab00 tx=0x7faca003d070 comp rx=0 tx=0).stop 2024-09-17T03:45:17.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.762+0000 7facb8ca4740 1 -- 172.21.15.146:0/1198421769 shutdown_connections 2024-09-17T03:45:17.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.762+0000 7facb8ca4740 1 --2- 172.21.15.146:0/1198421769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 0x5651a5908da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.762+0000 7facb8ca4740 1 --2- 172.21.15.146:0/1198421769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a5908860 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.762+0000 7facb8ca4740 1 --2- 172.21.15.146:0/1198421769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a5933a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.762+0000 7facb8ca4740 1 -- 172.21.15.146:0/1198421769 >> 172.21.15.146:0/1198421769 conn(0x5651a553b4e0 msgr2=0x5651a58eed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.762+0000 7facb8ca4740 1 -- 172.21.15.146:0/1198421769 shutdown_connections 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.762+0000 7facb8ca4740 1 -- 172.21.15.146:0/1198421769 wait complete. 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.763+0000 7facb8ca4740 1 -- start start 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.763+0000 7facb8ca4740 1 Processor -- start 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a551e4d0 0x5651a5929710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a55266b0 0x5651a58ee770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a58eecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facb8ca4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5651a55c1740 con 0x5651a55266b0 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facb8ca4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5651a57f6970 con 0x5651a5547390 2024-09-17T03:45:17.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facb8ca4740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5651a5917d40 con 0x5651a551e4d0 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facb8ca4740 10 client.0 _ll_register_callbacks cb 0x5651a5805780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facaaffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a55266b0 0x5651a58ee770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facaaffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a55266b0 0x5651a58ee770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34022/0 (socket says 172.21.15.146:34022) 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facaaffd640 1 -- 172.21.15.146:0/766983986 learned_addr learned my addr 172.21.15.146:0/766983986 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facabfff640 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a58eecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facab7fe640 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a551e4d0 0x5651a5929710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facaaffd640 1 -- 172.21.15.146:0/766983986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a551e4d0 msgr2=0x5651a5929710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facaaffd640 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a551e4d0 0x5651a5929710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facaaffd640 1 -- 172.21.15.146:0/766983986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 msgr2=0x5651a58eecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facaaffd640 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a58eecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facaaffd640 1 -- 172.21.15.146:0/766983986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a55b2970 con 0x5651a55266b0 2024-09-17T03:45:17.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facab7fe640 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a551e4d0 0x5651a5929710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.764+0000 7facabfff640 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a58eecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7facaaffd640 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a55266b0 0x5651a58ee770 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7faca00095f0 tx=0x7faca0003fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f75b362f30ba8e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7fac8a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7fac8a7fc640 1 -- 172.21.15.146:0/766983986 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca004aca0 con 0x5651a55266b0 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7fac8a7fc640 1 -- 172.21.15.146:0/766983986 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7faca004ae40 con 0x5651a55266b0 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7facb8ca4740 1 -- 172.21.15.146:0/766983986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faca0048510 con 0x5651a55266b0 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7fac8a7fc640 1 -- 172.21.15.146:0/766983986 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7faca0061050 con 0x5651a55266b0 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7facb8ca4740 10 client.10911 fetch_fsmap learned FSMap version 136 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7facb8ca4740 1 -- 172.21.15.146:0/766983986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x5651a55906a0 con 0x5651a55266b0 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7fac8a7fc640 1 -- 172.21.15.146:0/766983986 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faca0048510 con 0x5651a55266b0 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7fac8a7fc640 1 -- 172.21.15.146:0/766983986 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7faca0064020 con 0x5651a55266b0 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7facb8ca4740 10 client.10911 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:45:17.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7facb8ca4740 10 client.10911 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7facb8ca4740 20 client.10911 populate_metadata read hostname 'smithi146' 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7facb8ca4740 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5651a5505f60 0x5651a5946250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7facb8ca4740 4 client.10911 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7facb8ca4740 1 -- 172.21.15.146:0/766983986 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651a58639b0 con 0x5651a5505f60 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.765+0000 7facab7fe640 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5651a5505f60 0x5651a5946250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7fac8a7fc640 10 client.10911 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7facab7fe640 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5651a5505f60 0x5651a5946250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59afa98b508ac76b server_cookie=173c8d2f33c077b8 in_seq=0 out_seq=0 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7fac8a7fc640 1 -- 172.21.15.146:0/766983986 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5651a58639b0 con 0x5651a5505f60 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7fac8a7fc640 10 client.10911 handle_command_reply: tid=0 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7facb8ca4740 1 client.10911 shutdown 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7facb8ca4740 1 -- 172.21.15.146:0/766983986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a55266b0 msgr2=0x5651a58ee770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7facb8ca4740 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a55266b0 0x5651a58ee770 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7faca00095f0 tx=0x7faca0003fd0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7facb8ca4740 1 -- 172.21.15.146:0/766983986 shutdown_connections 2024-09-17T03:45:17.770 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7facb8ca4740 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5651a5505f60 0x5651a5946250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7facb8ca4740 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a58eecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7facb8ca4740 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a55266b0 0x5651a58ee770 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7facb8ca4740 1 --2- 172.21.15.146:0/766983986 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a551e4d0 0x5651a5929710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.766+0000 7fac8a7fc640 0 client.10911 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:45:17.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.767+0000 7facb8ca4740 1 -- 172.21.15.146:0/766983986 >> 172.21.15.146:0/766983986 conn(0x5651a553b4e0 msgr2=0x5651a58e9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.767+0000 7facb8ca4740 1 -- 172.21.15.146:0/766983986 shutdown_connections 2024-09-17T03:45:17.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.767+0000 7facb8ca4740 1 -- 172.21.15.146:0/766983986 wait complete. 2024-09-17T03:45:17.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.767+0000 7facb8ca4740 20 client.10911 trim_cache size 0 max 16384 2024-09-17T03:45:17.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.784+0000 7facb8ca4740 1 Processor -- start 2024-09-17T03:45:17.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.784+0000 7facb8ca4740 1 -- start start 2024-09-17T03:45:17.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.785+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a592fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 0x5651a59303c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a5956710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facb8ca4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7facac1fff60 con 0x5651a551e4d0 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facb8ca4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7facac1ff090 con 0x5651a5547390 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facb8ca4740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7facac1f3ce0 con 0x5651a55266b0 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facab7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a592fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facab7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a592fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34024/0 (socket says 172.21.15.146:34024) 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facab7fe640 1 -- 172.21.15.146:0/224101808 learned_addr learned my addr 172.21.15.146:0/224101808 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facab7fe640 1 -- 172.21.15.146:0/224101808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 msgr2=0x5651a59303c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facab7fe640 1 --2- 172.21.15.146:0/224101808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 0x5651a59303c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facab7fe640 1 -- 172.21.15.146:0/224101808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 msgr2=0x5651a5956710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facab7fe640 1 --2- 172.21.15.146:0/224101808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a5956710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facab7fe640 1 -- 172.21.15.146:0/224101808 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a58ef370 con 0x5651a551e4d0 2024-09-17T03:45:17.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7facab7fe640 1 --2- 172.21.15.146:0/224101808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a592fe80 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fac9c001030 tx=0x7fac9c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e933026c83199f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7fac90ff9640 1 -- 172.21.15.146:0/224101808 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c061d70 con 0x5651a551e4d0 2024-09-17T03:45:17.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7fac90ff9640 1 -- 172.21.15.146:0/224101808 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac9c066040 con 0x5651a551e4d0 2024-09-17T03:45:17.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.786+0000 7fac90ff9640 1 -- 172.21.15.146:0/224101808 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c06b790 con 0x5651a551e4d0 2024-09-17T03:45:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.787+0000 7facb8ca4740 1 -- 172.21.15.146:0/224101808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 msgr2=0x5651a592fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.787+0000 7facb8ca4740 1 --2- 172.21.15.146:0/224101808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a592fe80 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fac9c001030 tx=0x7fac9c014040 comp rx=0 tx=0).stop 2024-09-17T03:45:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.787+0000 7facb8ca4740 1 -- 172.21.15.146:0/224101808 shutdown_connections 2024-09-17T03:45:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.787+0000 7facb8ca4740 1 --2- 172.21.15.146:0/224101808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a5547390 0x5651a5956710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.787+0000 7facb8ca4740 1 --2- 172.21.15.146:0/224101808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 0x5651a59303c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.787+0000 7facb8ca4740 1 --2- 172.21.15.146:0/224101808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a551e4d0 0x5651a592fe80 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.787+0000 7facb8ca4740 1 -- 172.21.15.146:0/224101808 >> 172.21.15.146:0/224101808 conn(0x5651a553b4e0 msgr2=0x5651a58efd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.787+0000 7facb8ca4740 1 -- 172.21.15.146:0/224101808 shutdown_connections 2024-09-17T03:45:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.787+0000 7facb8ca4740 1 -- 172.21.15.146:0/224101808 wait complete. 2024-09-17T03:45:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.788+0000 7facb8ca4740 1 -- start start 2024-09-17T03:45:17.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.788+0000 7facb8ca4740 1 Processor -- start 2024-09-17T03:45:17.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.789+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a551e4d0 0x5651a59b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.789+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 0x5651a5916cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.789+0000 7facb8ca4740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a5547390 0x5651a5917210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.789+0000 7facb8ca4740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7facac1f4300 con 0x5651a5547390 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.789+0000 7facb8ca4740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5651a58e7f90 con 0x5651a551e4d0 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.789+0000 7facb8ca4740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5651a58ee770 con 0x5651a55266b0 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.789+0000 7facb8ca4740 10 client.0 _ll_register_callbacks cb 0x7fac9c005560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.789+0000 7facabfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a5547390 0x5651a5917210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facabfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a5547390 0x5651a5917210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34034/0 (socket says 172.21.15.146:34034) 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facabfff640 1 -- 172.21.15.146:0/606183638 learned_addr learned my addr 172.21.15.146:0/606183638 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facab7fe640 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a551e4d0 0x5651a59b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facaaffd640 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 0x5651a5916cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facabfff640 1 -- 172.21.15.146:0/606183638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 msgr2=0x5651a5916cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facabfff640 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 0x5651a5916cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facabfff640 1 -- 172.21.15.146:0/606183638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a551e4d0 msgr2=0x5651a59b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facabfff640 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a551e4d0 0x5651a59b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facabfff640 1 -- 172.21.15.146:0/606183638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a594bb30 con 0x5651a5547390 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facabfff640 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a5547390 0x5651a5917210 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7faca4013800 tx=0x7faca4013cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e701678a80c3b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7fac8a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7fac8a7fc640 1 -- 172.21.15.146:0/606183638 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4004d20 con 0x5651a5547390 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7fac8a7fc640 1 -- 172.21.15.146:0/606183638 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7faca4011b50 con 0x5651a5547390 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facb8ca4740 1 -- 172.21.15.146:0/606183638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac9c066040 con 0x5651a5547390 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7fac8a7fc640 1 -- 172.21.15.146:0/606183638 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7faca4025050 con 0x5651a5547390 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facb8ca4740 10 client.10917 fetch_fsmap learned FSMap version 136 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7facb8ca4740 1 -- 172.21.15.146:0/606183638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x5651a59196b0 con 0x5651a5547390 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7fac8a7fc640 1 -- 172.21.15.146:0/606183638 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac9c066040 con 0x5651a5547390 2024-09-17T03:45:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.790+0000 7fac8a7fc640 1 -- 172.21.15.146:0/606183638 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7faca4028020 con 0x5651a5547390 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 10 client.10917 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 10 client.10917 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 20 client.10917 populate_metadata read hostname 'smithi146' 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5651a5918870 0x5651a5918c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 4 client.10917 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 1 -- 172.21.15.146:0/606183638 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5651a585f460 con 0x5651a5918870 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facab7fe640 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5651a5918870 0x5651a5918c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7fac8a7fc640 10 client.10917 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facab7fe640 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5651a5918870 0x5651a5918c80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3015d74b155f73 server_cookie=a00eaf81c810b14d in_seq=0 out_seq=0 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7fac8a7fc640 1 -- 172.21.15.146:0/606183638 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+380 (crc 0 0 0) 0x5651a585f460 con 0x5651a5918870 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7fac8a7fc640 10 client.10917 handle_command_reply: tid=0 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 1 client.10917 shutdown 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 1 -- 172.21.15.146:0/606183638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a5547390 msgr2=0x5651a5917210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a5547390 0x5651a5917210 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7faca4013800 tx=0x7faca4013cc0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 1 -- 172.21.15.146:0/606183638 shutdown_connections 2024-09-17T03:45:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x5651a5918870 0x5651a5918c80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5651a5547390 0x5651a5917210 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7fac8a7fc640 0 client.10917 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:45:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5651a55266b0 0x5651a5916cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 1 --2- 172.21.15.146:0/606183638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5651a551e4d0 0x5651a59b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.791+0000 7facb8ca4740 1 -- 172.21.15.146:0/606183638 >> 172.21.15.146:0/606183638 conn(0x5651a553b4e0 msgr2=0x5651a5928d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb8ca4740 1 -- 172.21.15.146:0/606183638 shutdown_connections 2024-09-17T03:45:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb8ca4740 1 -- 172.21.15.146:0/606183638 wait complete. 2024-09-17T03:45:17.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb8ca4740 20 client.10917 trim_cache size 0 max 16384 2024-09-17T03:45:17.796 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {}, 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: "6216482b-2ac2-48e4-ab02-cbb74033422b": { 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:44:47.441800+0000", 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "~mdsdir", 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:17.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:17.798 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:45:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 -- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac98078bc0 msgr2=0x7fac9807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac98078bc0 0x7fac9807b0d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7faca0034000 tx=0x7faca0004730 comp rx=0 tx=0).stop 2024-09-17T03:45:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 -- 172.21.15.146:0/1775133677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facac0b3b60 msgr2=0x7facac14a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facac0b3b60 0x7facac14a4b0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00c3f0 tx=0x7fac9c00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 -- 172.21.15.146:0/1775133677 shutdown_connections 2024-09-17T03:45:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fac98078bc0 0x7fac9807b0d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7facac0b5ce0 0x7facac143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facac0b5750 0x7facac0b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 --2- 172.21.15.146:0/1775133677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facac0b3b60 0x7facac14a4b0 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 -- 172.21.15.146:0/1775133677 >> 172.21.15.146:0/1775133677 conn(0x7facac0b7b20 msgr2=0x7facac15b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 -- 172.21.15.146:0/1775133677 shutdown_connections 2024-09-17T03:45:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.792+0000 7facb1d3a640 1 -- 172.21.15.146:0/1775133677 wait complete. 2024-09-17T03:45:17.802 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:45:17.803 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-17T03:45:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.919+0000 7f0e74332640 1 -- 172.21.15.146:0/3602310240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e6c070350 msgr2=0x7f0e6c072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.919+0000 7f0e74332640 1 --2- 172.21.15.146:0/3602310240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e6c070350 0x7f0e6c072680 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c071f20 tx=0x7f0e5c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.919+0000 7f0e74332640 1 -- 172.21.15.146:0/3602310240 shutdown_connections 2024-09-17T03:45:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.919+0000 7f0e74332640 1 --2- 172.21.15.146:0/3602310240 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e6c070350 0x7f0e6c072680 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.919+0000 7f0e74332640 1 --2- 172.21.15.146:0/3602310240 >> v2:172.21.15.179:3300/0 conn(0x7f0e6c15b770 0x7f0e6c06fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.919+0000 7f0e74332640 1 -- 172.21.15.146:0/3602310240 >> 172.21.15.146:0/3602310240 conn(0x7f0e6c0b2060 msgr2=0x7f0e6c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.919+0000 7f0e74332640 1 -- 172.21.15.146:0/3602310240 shutdown_connections 2024-09-17T03:45:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.919+0000 7f0e74332640 1 -- 172.21.15.146:0/3602310240 wait complete. 2024-09-17T03:45:17.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.921+0000 7f0e74332640 1 Processor -- start 2024-09-17T03:45:17.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.921+0000 7f0e74332640 1 -- start start 2024-09-17T03:45:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.922+0000 7f0e74332640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e6c070350 0x7f0e6c1428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.922+0000 7f0e74332640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e6c072bc0 0x7f0e6c1f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.922+0000 7f0e74332640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e6c15b770 0x7f0e6c1f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.922+0000 7f0e74332640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c15f9f0 con 0x7f0e6c072bc0 2024-09-17T03:45:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.922+0000 7f0e74332640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c0b5590 con 0x7f0e6c15b770 2024-09-17T03:45:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.922+0000 7f0e74332640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0e6c15fb70 con 0x7f0e6c070350 2024-09-17T03:45:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.922+0000 7f0e718cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e6c072bc0 0x7f0e6c1f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.922+0000 7f0e718cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e6c072bc0 0x7f0e6c1f5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34060/0 (socket says 172.21.15.146:34060) 2024-09-17T03:45:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.922+0000 7f0e718cd640 1 -- 172.21.15.146:0/1066923337 learned_addr learned my addr 172.21.15.146:0/1066923337 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.922+0000 7f0e720ce640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e6c070350 0x7f0e6c1428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.922+0000 7f0e728cf640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e6c15b770 0x7f0e6c1f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e718cd640 1 -- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e6c070350 msgr2=0x7f0e6c1428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e718cd640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e6c070350 0x7f0e6c1428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e718cd640 1 -- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e6c15b770 msgr2=0x7f0e6c1f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e718cd640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e6c15b770 0x7f0e6c1f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e718cd640 1 -- 172.21.15.146:0/1066923337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c1f58b0 con 0x7f0e6c072bc0 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e720ce640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e6c070350 0x7f0e6c1428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e728cf640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e6c15b770 0x7f0e6c1f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e718cd640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e6c072bc0 0x7f0e6c1f5db0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c02aa90 tx=0x7f0e5c005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e62ffd640 1 -- 172.21.15.146:0/1066923337 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c03f070 con 0x7f0e6c072bc0 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e62ffd640 1 -- 172.21.15.146:0/1066923337 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e5c004340 con 0x7f0e6c072bc0 2024-09-17T03:45:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e62ffd640 1 -- 172.21.15.146:0/1066923337 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c031bb0 con 0x7f0e6c072bc0 2024-09-17T03:45:17.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e74332640 1 -- 172.21.15.146:0/1066923337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6c1456a0 con 0x7f0e6c072bc0 2024-09-17T03:45:17.925 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.923+0000 7f0e74332640 1 -- 172.21.15.146:0/1066923337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6c145c60 con 0x7f0e6c072bc0 2024-09-17T03:45:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.925+0000 7f0e62ffd640 1 -- 172.21.15.146:0/1066923337 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e5c042070 con 0x7f0e6c072bc0 2024-09-17T03:45:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.926+0000 7f0e62ffd640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e50078bc0 0x7f0e5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.926+0000 7f0e62ffd640 1 -- 172.21.15.146:0/1066923337 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f0e5c0bbf90 con 0x7f0e6c072bc0 2024-09-17T03:45:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.926+0000 7f0e720ce640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e50078bc0 0x7f0e5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.927+0000 7f0e7b29e740 1 Processor -- start 2024-09-17T03:45:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.927+0000 7f0e720ce640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e50078bc0 0x7f0e5007b0d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0e68005fd0 tx=0x7f0e68009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.927+0000 7f0e7b29e740 1 -- start start 2024-09-17T03:45:17.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.928+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc311d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.928+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff8364d0 0x563dffc31710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.928+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff83e6b0 0x563dffc4e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.928+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563dffb798e0 con 0x563dff85f390 2024-09-17T03:45:17.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.928+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563dffb68d10 con 0x563dff83e6b0 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.928+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x563dffb6cb20 con 0x563dff8364d0 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.928+0000 7f0e720ce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc311d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.928+0000 7f0e720ce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc311d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34068/0 (socket says 172.21.15.146:34068) 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.928+0000 7f0e720ce640 1 -- 172.21.15.146:0/79963135 learned_addr learned my addr 172.21.15.146:0/79963135 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.928+0000 7f0e718cd640 1 --2- 172.21.15.146:0/79963135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff8364d0 0x563dffc31710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.928+0000 7f0e728cf640 1 --2- 172.21.15.146:0/79963135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff83e6b0 0x563dffc4e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.929+0000 7f0e720ce640 1 -- 172.21.15.146:0/79963135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff8364d0 msgr2=0x563dffc31710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.929+0000 7f0e720ce640 1 --2- 172.21.15.146:0/79963135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff8364d0 0x563dffc31710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.929+0000 7f0e720ce640 1 -- 172.21.15.146:0/79963135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff83e6b0 msgr2=0x563dffc4e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.929+0000 7f0e720ce640 1 --2- 172.21.15.146:0/79963135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff83e6b0 0x563dffc4e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.929+0000 7f0e720ce640 1 -- 172.21.15.146:0/79963135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dff8ca970 con 0x563dff85f390 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.929+0000 7f0e720ce640 1 --2- 172.21.15.146:0/79963135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc311d0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7f0e68011780 tx=0x7f0e68013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bad870d4c455072 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.929+0000 7f0e4ffff640 1 -- 172.21.15.146:0/79963135 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6800e940 con 0x563dff85f390 2024-09-17T03:45:17.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.929+0000 7f0e4ffff640 1 -- 172.21.15.146:0/79963135 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e6800ebd0 con 0x563dff85f390 2024-09-17T03:45:17.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.929+0000 7f0e4ffff640 1 -- 172.21.15.146:0/79963135 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6801e420 con 0x563dff85f390 2024-09-17T03:45:17.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.930+0000 7f0e7b29e740 1 -- 172.21.15.146:0/79963135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 msgr2=0x563dffc311d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.930+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/79963135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc311d0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7f0e68011780 tx=0x7f0e68013000 comp rx=0 tx=0).stop 2024-09-17T03:45:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.930+0000 7f0e7b29e740 1 -- 172.21.15.146:0/79963135 shutdown_connections 2024-09-17T03:45:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.930+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/79963135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff83e6b0 0x563dffc4e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.930+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/79963135 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff8364d0 0x563dffc31710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.930+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/79963135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc311d0 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.930+0000 7f0e7b29e740 1 -- 172.21.15.146:0/79963135 >> 172.21.15.146:0/79963135 conn(0x563dff8534e0 msgr2=0x563dffc07490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.930+0000 7f0e7b29e740 1 -- 172.21.15.146:0/79963135 shutdown_connections 2024-09-17T03:45:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.930+0000 7f0e7b29e740 1 -- 172.21.15.146:0/79963135 wait complete. 2024-09-17T03:45:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.931+0000 7f0e7b29e740 1 -- start start 2024-09-17T03:45:17.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.931+0000 7f0e7b29e740 1 Processor -- start 2024-09-17T03:45:17.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.932+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff8364d0 0x563dffc44860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.932+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff83e6b0 0x563dffc1f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.932+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc42dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.932+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563dff8d9740 con 0x563dff85f390 2024-09-17T03:45:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.932+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x563dffb0e7f0 con 0x563dff8364d0 2024-09-17T03:45:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.932+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x563dffc31c50 con 0x563dff83e6b0 2024-09-17T03:45:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e7b29e740 10 client.0 _ll_register_callbacks cb 0x563dffb122a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:45:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e728cf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc42dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e728cf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc42dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34082/0 (socket says 172.21.15.146:34082) 2024-09-17T03:45:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e728cf640 1 -- 172.21.15.146:0/1304324298 learned_addr learned my addr 172.21.15.146:0/1304324298 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e718cd640 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff83e6b0 0x563dffc1f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e720ce640 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff8364d0 0x563dffc44860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e728cf640 1 -- 172.21.15.146:0/1304324298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff83e6b0 msgr2=0x563dffc1f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e728cf640 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff83e6b0 0x563dffc1f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e728cf640 1 -- 172.21.15.146:0/1304324298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff8364d0 msgr2=0x563dffc44860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e728cf640 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff8364d0 0x563dffc44860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e728cf640 1 -- 172.21.15.146:0/1304324298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dff9417d0 con 0x563dff85f390 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e728cf640 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc42dc0 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f0e64001e70 tx=0x7f0e640116e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02b52b197da844c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/1304324298 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e640052e0 con 0x563dff85f390 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/1304324298 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f0e640035f0 con 0x563dff85f390 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e7b29e740 1 -- 172.21.15.146:0/1304324298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e6800ebd0 con 0x563dff85f390 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/1304324298 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f0e64022050 con 0x563dff85f390 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e7b29e740 10 client.10932 fetch_fsmap learned FSMap version 136 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.933+0000 7f0e7b29e740 1 -- 172.21.15.146:0/1304324298 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x563dffc29ba0 con 0x563dff85f390 2024-09-17T03:45:17.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.934+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/1304324298 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e6800ebd0 con 0x563dff85f390 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.934+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/1304324298 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7f0e64025020 con 0x563dff85f390 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.934+0000 7f0e7b29e740 10 client.10932 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.934+0000 7f0e7b29e740 10 client.10932 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.934+0000 7f0e7b29e740 20 client.10932 populate_metadata read hostname 'smithi146' 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.934+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x563dff81df60 0x563dffc4f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.934+0000 7f0e7b29e740 4 client.10932 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.934+0000 7f0e7b29e740 1 -- 172.21.15.146:0/1304324298 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dffb7b830 con 0x563dff81df60 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.934+0000 7f0e720ce640 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x563dff81df60 0x563dffc4f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.934+0000 7f0e4d7fa640 10 client.10932 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.934+0000 7f0e720ce640 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x563dff81df60 0x563dffc4f3e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=663b9b3b0dabc12a server_cookie=cbbfaae9f9e08720 in_seq=0 out_seq=0 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/1304324298 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563dffb7b830 con 0x563dff81df60 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e4d7fa640 10 client.10932 handle_command_reply: tid=0 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 1 client.10932 shutdown 2024-09-17T03:45:17.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 1 -- 172.21.15.146:0/1304324298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 msgr2=0x563dffc42dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc42dc0 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f0e64001e70 tx=0x7f0e640116e0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 1 -- 172.21.15.146:0/1304324298 shutdown_connections 2024-09-17T03:45:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x563dff81df60 0x563dffc4f3e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc42dc0 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff83e6b0 0x563dffc1f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/1304324298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff8364d0 0x563dffc44860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e4d7fa640 0 client.10932 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:45:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 1 -- 172.21.15.146:0/1304324298 >> 172.21.15.146:0/1304324298 conn(0x563dff8534e0 msgr2=0x563dffc4dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 1 -- 172.21.15.146:0/1304324298 shutdown_connections 2024-09-17T03:45:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 1 -- 172.21.15.146:0/1304324298 wait complete. 2024-09-17T03:45:17.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.935+0000 7f0e7b29e740 20 client.10932 trim_cache size 0 max 16384 2024-09-17T03:45:17.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.949+0000 7f0e7b29e740 1 Processor -- start 2024-09-17T03:45:17.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.949+0000 7f0e7b29e740 1 -- start start 2024-09-17T03:45:17.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.950+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff8364d0 0x563dffc421b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.950+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff83e6b0 0x563dffc44350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.950+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc44890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.950+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c2022b0 con 0x563dff85f390 2024-09-17T03:45:17.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.950+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c201320 con 0x563dff83e6b0 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.950+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0e6c15ea10 con 0x563dff8364d0 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.950+0000 7f0e728cf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc44890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.950+0000 7f0e728cf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc44890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34090/0 (socket says 172.21.15.146:34090) 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.950+0000 7f0e728cf640 1 -- 172.21.15.146:0/4039518355 learned_addr learned my addr 172.21.15.146:0/4039518355 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e718cd640 1 --2- 172.21.15.146:0/4039518355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff83e6b0 0x563dffc44350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e720ce640 1 --2- 172.21.15.146:0/4039518355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff8364d0 0x563dffc421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e728cf640 1 -- 172.21.15.146:0/4039518355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff8364d0 msgr2=0x563dffc421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e728cf640 1 --2- 172.21.15.146:0/4039518355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff8364d0 0x563dffc421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e728cf640 1 -- 172.21.15.146:0/4039518355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff83e6b0 msgr2=0x563dffc44350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e728cf640 1 --2- 172.21.15.146:0/4039518355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff83e6b0 0x563dffc44350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e728cf640 1 -- 172.21.15.146:0/4039518355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dffc08420 con 0x563dff85f390 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e718cd640 1 --2- 172.21.15.146:0/4039518355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff83e6b0 0x563dffc44350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:17.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e720ce640 1 --2- 172.21.15.146:0/4039518355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff8364d0 0x563dffc421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e728cf640 1 --2- 172.21.15.146:0/4039518355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc44890 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f0e64011f40 tx=0x7f0e64011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af28cb9401fa55a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e4f7fe640 1 -- 172.21.15.146:0/4039518355 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e640052e0 con 0x563dff85f390 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e4f7fe640 1 -- 172.21.15.146:0/4039518355 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e6401a070 con 0x563dff85f390 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.951+0000 7f0e4f7fe640 1 -- 172.21.15.146:0/4039518355 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e640035f0 con 0x563dff85f390 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.952+0000 7f0e7b29e740 1 -- 172.21.15.146:0/4039518355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 msgr2=0x563dffc44890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.952+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/4039518355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc44890 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f0e64011f40 tx=0x7f0e64011f70 comp rx=0 tx=0).stop 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.952+0000 7f0e7b29e740 1 -- 172.21.15.146:0/4039518355 shutdown_connections 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.952+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/4039518355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff85f390 0x563dffc44890 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.952+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/4039518355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff83e6b0 0x563dffc44350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.952+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/4039518355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff8364d0 0x563dffc421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.952+0000 7f0e7b29e740 1 -- 172.21.15.146:0/4039518355 >> 172.21.15.146:0/4039518355 conn(0x563dff8534e0 msgr2=0x563dffbfcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.952+0000 7f0e7b29e740 1 -- 172.21.15.146:0/4039518355 shutdown_connections 2024-09-17T03:45:17.953 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.952+0000 7f0e7b29e740 1 -- 172.21.15.146:0/4039518355 wait complete. 2024-09-17T03:45:17.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.953+0000 7f0e7b29e740 1 -- start start 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.953+0000 7f0e7b29e740 1 Processor -- start 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.954+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff8364d0 0x563dffc44760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.954+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff83e6b0 0x563dffcc80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.954+0000 7f0e7b29e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff85f390 0x563dffc6dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.954+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x563dffc435c0 con 0x563dff83e6b0 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.954+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c1f9ac0 con 0x563dff8364d0 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.954+0000 7f0e7b29e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x563dffc1f8d0 con 0x563dff85f390 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.954+0000 7f0e7b29e740 10 client.0 _ll_register_callbacks cb 0x7f0e64001240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.954+0000 7f0e718cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff83e6b0 0x563dffcc80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.954+0000 7f0e718cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff83e6b0 0x563dffcc80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34100/0 (socket says 172.21.15.146:34100) 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.954+0000 7f0e718cd640 1 -- 172.21.15.146:0/3883607751 learned_addr learned my addr 172.21.15.146:0/3883607751 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.954+0000 7f0e720ce640 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff8364d0 0x563dffc44760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e728cf640 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff85f390 0x563dffc6dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e718cd640 1 -- 172.21.15.146:0/3883607751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff85f390 msgr2=0x563dffc6dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e718cd640 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff85f390 0x563dffc6dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e718cd640 1 -- 172.21.15.146:0/3883607751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff8364d0 msgr2=0x563dffc44760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e718cd640 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff8364d0 0x563dffc44760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e718cd640 1 -- 172.21.15.146:0/3883607751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dffc31480 con 0x563dff83e6b0 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e718cd640 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff83e6b0 0x563dffcc80c0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c033fd0 tx=0x7f0e5c0aa220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717d5f3e75fc4039 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/3883607751 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c049040 con 0x563dff83e6b0 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/3883607751 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f0e5c084130 con 0x563dff83e6b0 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e7b29e740 1 -- 172.21.15.146:0/3883607751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e6401a070 con 0x563dff83e6b0 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/3883607751 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f0e5c09e020 con 0x563dff83e6b0 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e7b29e740 10 client.10938 fetch_fsmap learned FSMap version 136 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e7b29e740 1 -- 172.21.15.146:0/3883607751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x563dffc6e5e0 con 0x563dff83e6b0 2024-09-17T03:45:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/3883607751 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e6401a070 con 0x563dff83e6b0 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/3883607751 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7f0e5c08bb30 con 0x563dff83e6b0 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e7b29e740 10 client.10938 fetch_fsmap finished waiting for FSMap version 136 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e7b29e740 10 client.10938 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e7b29e740 20 client.10938 populate_metadata read hostname 'smithi146' 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x563dffc4f1b0 0x563dffc4f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e7b29e740 4 client.10938 mds_command: new command op to 10671 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.955+0000 7f0e7b29e740 1 -- 172.21.15.146:0/3883607751 --> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563dffb772e0 con 0x563dffc4f1b0 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e720ce640 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x563dffc4f1b0 0x563dffc4f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e4d7fa640 10 client.10938 ms_handle_connect on v2:172.21.15.146:6832/2269642448 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e720ce640 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x563dffc4f1b0 0x563dffc4f5c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14972a894e76ff05 server_cookie=e71d97ed7350325b in_seq=0 out_seq=0 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e4d7fa640 1 -- 172.21.15.146:0/3883607751 <== mds.0 v2:172.21.15.146:6832/2269642448 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563dffb772e0 con 0x563dffc4f1b0 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e4d7fa640 10 client.10938 handle_command_reply: tid=0 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e7b29e740 1 client.10938 shutdown 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e7b29e740 1 -- 172.21.15.146:0/3883607751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff83e6b0 msgr2=0x563dffcc80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff83e6b0 0x563dffcc80c0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c033fd0 tx=0x7f0e5c0aa220 comp rx=0 tx=0).stop 2024-09-17T03:45:17.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e7b29e740 1 -- 172.21.15.146:0/3883607751 shutdown_connections 2024-09-17T03:45:17.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.146:6832/2269642448,v1:172.21.15.146:6834/2269642448] conn(0x563dffc4f1b0 0x563dffc4f5c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x563dff85f390 0x563dffc6dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563dff83e6b0 0x563dffcc80c0 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e4d7fa640 0 client.10938 ms_handle_reset on v2:172.21.15.146:6832/2269642448 2024-09-17T03:45:17.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e7b29e740 1 --2- 172.21.15.146:0/3883607751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563dff8364d0 0x563dffc44760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.956+0000 7f0e7b29e740 1 -- 172.21.15.146:0/3883607751 >> 172.21.15.146:0/3883607751 conn(0x563dff8534e0 msgr2=0x563dffc2e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e7b29e740 1 -- 172.21.15.146:0/3883607751 shutdown_connections 2024-09-17T03:45:17.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e7b29e740 1 -- 172.21.15.146:0/3883607751 wait complete. 2024-09-17T03:45:17.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e7b29e740 20 client.10938 trim_cache size 0 max 16384 2024-09-17T03:45:17.961 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2024-09-17T03:45:17.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 -- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e50078bc0 msgr2=0x7f0e5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e50078bc0 0x7f0e5007b0d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0e68005fd0 tx=0x7f0e68009500 comp rx=0 tx=0).stop 2024-09-17T03:45:17.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 -- 172.21.15.146:0/1066923337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e6c072bc0 msgr2=0x7f0e6c1f5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:17.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e6c072bc0 0x7f0e6c1f5db0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c02aa90 tx=0x7f0e5c005270 comp rx=0 tx=0).stop 2024-09-17T03:45:17.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 -- 172.21.15.146:0/1066923337 shutdown_connections 2024-09-17T03:45:17.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e50078bc0 0x7f0e5007b0d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e6c15b770 0x7f0e6c1f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e6c072bc0 0x7f0e6c1f5db0 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 --2- 172.21.15.146:0/1066923337 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e6c070350 0x7f0e6c1428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:17.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 -- 172.21.15.146:0/1066923337 >> 172.21.15.146:0/1066923337 conn(0x7f0e6c0b2060 msgr2=0x7f0e6c0af210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:17.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 -- 172.21.15.146:0/1066923337 shutdown_connections 2024-09-17T03:45:17.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:17.957+0000 7f0e74332640 1 -- 172.21.15.146:0/1066923337 wait complete. 2024-09-17T03:45:17.967 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T03:45:18.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.080+0000 7fee54ff1640 1 -- 172.21.15.146:0/2626390600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee500b3d30 msgr2=0x7fee501677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:18.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.080+0000 7fee54ff1640 1 --2- 172.21.15.146:0/2626390600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee500b3d30 0x7fee501677c0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7fee48005fd0 tx=0x7fee4802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.081+0000 7fee54ff1640 1 -- 172.21.15.146:0/2626390600 shutdown_connections 2024-09-17T03:45:18.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.081+0000 7fee54ff1640 1 --2- 172.21.15.146:0/2626390600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee500b3d30 0x7fee501677c0 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.081+0000 7fee54ff1640 1 -- 172.21.15.146:0/2626390600 >> 172.21.15.146:0/2626390600 conn(0x7fee500b7b20 msgr2=0x7fee5009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:18.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.081+0000 7fee54ff1640 1 -- 172.21.15.146:0/2626390600 shutdown_connections 2024-09-17T03:45:18.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.081+0000 7fee54ff1640 1 -- 172.21.15.146:0/2626390600 wait complete. 2024-09-17T03:45:18.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.083+0000 7fee54ff1640 1 Processor -- start 2024-09-17T03:45:18.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.083+0000 7fee54ff1640 1 -- start start 2024-09-17T03:45:18.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee54ff1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee500b5750 0x7fee501573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:18.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee54ff1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee500b5ce0 0x7fee501395e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:18.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee54ff1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee501592d0 0x7fee501596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:18.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee54ff1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fee50167f10 con 0x7fee500b5ce0 2024-09-17T03:45:18.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee54ff1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fee5015ddb0 con 0x7fee501592d0 2024-09-17T03:45:18.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee54ff1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fee50168090 con 0x7fee500b5750 2024-09-17T03:45:18.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee45d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee500b5ce0 0x7fee501395e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:18.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee45d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee500b5ce0 0x7fee501395e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34130/0 (socket says 172.21.15.146:34130) 2024-09-17T03:45:18.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee45d9b640 1 -- 172.21.15.146:0/2697648928 learned_addr learned my addr 172.21.15.146:0/2697648928 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:18.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee4ed9d640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee501592d0 0x7fee501596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:18.085 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee4e59c640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee500b5750 0x7fee501573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:18.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee45d9b640 1 -- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee500b5750 msgr2=0x7fee501573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:18.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee45d9b640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee500b5750 0x7fee501573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee45d9b640 1 -- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee501592d0 msgr2=0x7fee501596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:18.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee45d9b640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee501592d0 0x7fee501596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.084+0000 7fee45d9b640 1 -- 172.21.15.146:0/2697648928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee50159c20 con 0x7fee500b5ce0 2024-09-17T03:45:18.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.085+0000 7fee45d9b640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee500b5ce0 0x7fee501395e0 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fee3800c340 tx=0x7fee3800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:18.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.085+0000 7fee477fe640 1 -- 172.21.15.146:0/2697648928 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38017070 con 0x7fee500b5ce0 2024-09-17T03:45:18.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.085+0000 7fee477fe640 1 -- 172.21.15.146:0/2697648928 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee380053c0 con 0x7fee500b5ce0 2024-09-17T03:45:18.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.085+0000 7fee477fe640 1 -- 172.21.15.146:0/2697648928 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38003850 con 0x7fee500b5ce0 2024-09-17T03:45:18.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.085+0000 7fee54ff1640 1 -- 172.21.15.146:0/2697648928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee501578e0 con 0x7fee500b5ce0 2024-09-17T03:45:18.086 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.085+0000 7fee54ff1640 1 -- 172.21.15.146:0/2697648928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee501f7020 con 0x7fee500b5ce0 2024-09-17T03:45:18.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.086+0000 7fee54ff1640 1 -- 172.21.15.146:0/2697648928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee500b1320 con 0x7fee500b5ce0 2024-09-17T03:45:18.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.087+0000 7fee477fe640 1 -- 172.21.15.146:0/2697648928 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee3801a070 con 0x7fee500b5ce0 2024-09-17T03:45:18.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.087+0000 7fee477fe640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee30078b90 0x7fee3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:18.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.087+0000 7fee477fe640 1 -- 172.21.15.146:0/2697648928 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fee3809a080 con 0x7fee500b5ce0 2024-09-17T03:45:18.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.087+0000 7fee4e59c640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee30078b90 0x7fee3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:18.088 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.088+0000 7fee4e59c640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee30078b90 0x7fee3007b0a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fee40007fd0 tx=0x7fee40001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:18.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.092+0000 7fee477fe640 1 -- 172.21.15.146:0/2697648928 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fee38061e60 con 0x7fee500b5ce0 2024-09-17T03:45:18.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.302+0000 7fee54ff1640 1 -- 172.21.15.146:0/2697648928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fee5015a940 con 0x7fee500b5ce0 2024-09-17T03:45:18.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.302+0000 7fee477fe640 1 -- 172.21.15.146:0/2697648928 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fee38066890 con 0x7fee500b5ce0 2024-09-17T03:45:18.302 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:18.302 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T03:45:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.304+0000 7fee54ff1640 1 -- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee30078b90 msgr2=0x7fee3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.304+0000 7fee54ff1640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee30078b90 0x7fee3007b0a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fee40007fd0 tx=0x7fee40001370 comp rx=0 tx=0).stop 2024-09-17T03:45:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.304+0000 7fee54ff1640 1 -- 172.21.15.146:0/2697648928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee500b5ce0 msgr2=0x7fee501395e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.304+0000 7fee54ff1640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee500b5ce0 0x7fee501395e0 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7fee3800c340 tx=0x7fee3800c800 comp rx=0 tx=0).stop 2024-09-17T03:45:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.304+0000 7fee54ff1640 1 -- 172.21.15.146:0/2697648928 shutdown_connections 2024-09-17T03:45:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.304+0000 7fee54ff1640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fee30078b90 0x7fee3007b0a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.304+0000 7fee54ff1640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fee501592d0 0x7fee501596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.304+0000 7fee54ff1640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee500b5ce0 0x7fee501395e0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.304+0000 7fee54ff1640 1 --2- 172.21.15.146:0/2697648928 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fee500b5750 0x7fee501573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.304+0000 7fee54ff1640 1 -- 172.21.15.146:0/2697648928 >> 172.21.15.146:0/2697648928 conn(0x7fee500b7b20 msgr2=0x7fee50167240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:18.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.305+0000 7fee54ff1640 1 -- 172.21.15.146:0/2697648928 shutdown_connections 2024-09-17T03:45:18.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.305+0000 7fee54ff1640 1 -- 172.21.15.146:0/2697648928 wait complete. 2024-09-17T03:45:18.315 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:45:18.316 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:45:18.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:45:18.400 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:45:18.400 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:45:18.401 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:45:18.401 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:45:18.416 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:45:18.417 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:45:18.472 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:45:18.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.630+0000 7f1271425640 1 -- 172.21.15.146:0/207560418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c073ac0 msgr2=0x7f126c06fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:18.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.630+0000 7f1271425640 1 --2- 172.21.15.146:0/207560418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c073ac0 0x7f126c06fae0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f126c159910 tx=0x7f125402a560 comp rx=0 tx=0).stop 2024-09-17T03:45:18.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.630+0000 7f1271425640 1 -- 172.21.15.146:0/207560418 shutdown_connections 2024-09-17T03:45:18.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.630+0000 7f1271425640 1 --2- 172.21.15.146:0/207560418 >> v2:172.21.15.179:3300/0 conn(0x7f126c070020 0x7f126c15f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.630+0000 7f1271425640 1 --2- 172.21.15.146:0/207560418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c073ac0 0x7f126c06fae0 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.630+0000 7f1271425640 1 --2- 172.21.15.146:0/207560418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c152920 0x7f126c073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.630+0000 7f1271425640 1 -- 172.21.15.146:0/207560418 >> 172.21.15.146:0/207560418 conn(0x7f126c06dd60 msgr2=0x7f126c06e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:18.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.630+0000 7f1271425640 1 -- 172.21.15.146:0/207560418 shutdown_connections 2024-09-17T03:45:18.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.630+0000 7f1271425640 1 -- 172.21.15.146:0/207560418 wait complete. 2024-09-17T03:45:18.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.632+0000 7f1271425640 1 Processor -- start 2024-09-17T03:45:18.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.632+0000 7f1271425640 1 -- start start 2024-09-17T03:45:18.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f1271425640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c070020 0x7f126c155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f1271425640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c073ac0 0x7f126c14e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f1271425640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c152920 0x7f126c0d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f1271425640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f126c15f9f0 con 0x7f126c070020 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f1271425640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f126c15f870 con 0x7f126c152920 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f1271425640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f126c15fb70 con 0x7f126c073ac0 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f126affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c070020 0x7f126c155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f126affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c070020 0x7f126c155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34140/0 (socket says 172.21.15.146:34140) 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f126affd640 1 -- 172.21.15.146:0/3736190266 learned_addr learned my addr 172.21.15.146:0/3736190266 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f12627fc640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c073ac0 0x7f126c14e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f126b7fe640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c152920 0x7f126c0d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f126affd640 1 -- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c073ac0 msgr2=0x7f126c14e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f126affd640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c073ac0 0x7f126c14e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f126affd640 1 -- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c152920 msgr2=0x7f126c0d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:18.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f126affd640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c152920 0x7f126c0d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f126affd640 1 -- 172.21.15.146:0/3736190266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c1e5b60 con 0x7f126c070020 2024-09-17T03:45:18.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f12627fc640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c073ac0 0x7f126c14e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:18.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f126b7fe640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c152920 0x7f126c0d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:18.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f126affd640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c070020 0x7f126c155d20 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f125c00e7c0 tx=0x7f125c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:18.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f1263fff640 1 -- 172.21.15.146:0/3736190266 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c00cc60 con 0x7f126c070020 2024-09-17T03:45:18.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f1263fff640 1 -- 172.21.15.146:0/3736190266 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f125c00ce20 con 0x7f126c070020 2024-09-17T03:45:18.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.634+0000 7f1263fff640 1 -- 172.21.15.146:0/3736190266 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c005280 con 0x7f126c070020 2024-09-17T03:45:18.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.635+0000 7f1271425640 1 -- 172.21.15.146:0/3736190266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126c1e50e0 con 0x7f126c070020 2024-09-17T03:45:18.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.635+0000 7f1271425640 1 -- 172.21.15.146:0/3736190266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f126c1f5f80 con 0x7f126c070020 2024-09-17T03:45:18.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.636+0000 7f1271425640 1 -- 172.21.15.146:0/3736190266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f126c160020 con 0x7f126c070020 2024-09-17T03:45:18.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.636+0000 7f1263fff640 1 -- 172.21.15.146:0/3736190266 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f125c005420 con 0x7f126c070020 2024-09-17T03:45:18.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.637+0000 7f1263fff640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f124c078bc0 0x7f124c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:18.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.637+0000 7f1263fff640 1 -- 172.21.15.146:0/3736190266 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f125c09b5b0 con 0x7f126c070020 2024-09-17T03:45:18.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.637+0000 7f12627fc640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f124c078bc0 0x7f124c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:18.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.638+0000 7f12627fc640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f124c078bc0 0x7f124c07b0d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1254033000 tx=0x7f1254004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:18.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.641+0000 7f1263fff640 1 -- 172.21.15.146:0/3736190266 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f125c063a80 con 0x7f126c070020 2024-09-17T03:45:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.832+0000 7f1271425640 1 -- 172.21.15.146:0/3736190266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f126c1e5d30 con 0x7f126c070020 2024-09-17T03:45:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.833+0000 7f1263fff640 1 -- 172.21.15.146:0/3736190266 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v176) ==== 80+0+0 (secure 0 0 0) 0x7f125c063380 con 0x7f126c070020 2024-09-17T03:45:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:45:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.835+0000 7f1271425640 1 -- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f124c078bc0 msgr2=0x7f124c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.835+0000 7f1271425640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f124c078bc0 0x7f124c07b0d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1254033000 tx=0x7f1254004730 comp rx=0 tx=0).stop 2024-09-17T03:45:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.835+0000 7f1271425640 1 -- 172.21.15.146:0/3736190266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c070020 msgr2=0x7f126c155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.835+0000 7f1271425640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c070020 0x7f126c155d20 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f125c00e7c0 tx=0x7f125c00ec80 comp rx=0 tx=0).stop 2024-09-17T03:45:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.835+0000 7f1271425640 1 -- 172.21.15.146:0/3736190266 shutdown_connections 2024-09-17T03:45:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.835+0000 7f1271425640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f124c078bc0 0x7f124c07b0d0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.835+0000 7f1271425640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f126c152920 0x7f126c0d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.835+0000 7f1271425640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f126c073ac0 0x7f126c14e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.835+0000 7f1271425640 1 --2- 172.21.15.146:0/3736190266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f126c070020 0x7f126c155d20 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:18.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.836+0000 7f1271425640 1 -- 172.21.15.146:0/3736190266 >> 172.21.15.146:0/3736190266 conn(0x7f126c06dd60 msgr2=0x7f126c06e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:18.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.836+0000 7f1271425640 1 -- 172.21.15.146:0/3736190266 shutdown_connections 2024-09-17T03:45:18.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:18.836+0000 7f1271425640 1 -- 172.21.15.146:0/3736190266 wait complete. 2024-09-17T03:45:18.847 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:45:18.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:18.847 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:45:18.875 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:45:18.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:18.876 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:45:18.932 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:45:18.932 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:45:18.932 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:45:18.952 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:45:18.952 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:45:18.952 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:45:18.952 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:45:18.987 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:45:18.987 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:45:18.987 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:45:18.987 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:45:19.011 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:45:19.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:45:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.141+0000 7fbce9494640 1 -- 172.21.15.146:0/2995651146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40b5750 msgr2=0x7fbce40b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.141+0000 7fbce9494640 1 --2- 172.21.15.146:0/2995651146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40b5750 0x7fbce40b3620 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7fbccc005fd0 tx=0x7fbccc02a530 comp rx=0 tx=0).stop 2024-09-17T03:45:19.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.141+0000 7fbce9494640 1 -- 172.21.15.146:0/2995651146 shutdown_connections 2024-09-17T03:45:19.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.141+0000 7fbce9494640 1 --2- 172.21.15.146:0/2995651146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40b5750 0x7fbce40b3620 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.141+0000 7fbce9494640 1 --2- 172.21.15.146:0/2995651146 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce40b5ce0 0x7fbce40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.141+0000 7fbce9494640 1 -- 172.21.15.146:0/2995651146 >> 172.21.15.146:0/2995651146 conn(0x7fbce40b7b20 msgr2=0x7fbce409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:19.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.141+0000 7fbce9494640 1 -- 172.21.15.146:0/2995651146 shutdown_connections 2024-09-17T03:45:19.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.141+0000 7fbce9494640 1 -- 172.21.15.146:0/2995651146 wait complete. 2024-09-17T03:45:19.141 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.143+0000 7fbce9494640 1 Processor -- start 2024-09-17T03:45:19.142 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.143+0000 7fbce9494640 1 -- start start 2024-09-17T03:45:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.144+0000 7fbce9494640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40b3b60 0x7fbce4155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.144+0000 7fbce9494640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce40b5750 0x7fbce409ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.144+0000 7fbce9494640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce40b5ce0 0x7fbce41f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.144+0000 7fbce9494640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbce40b27b0 con 0x7fbce40b3b60 2024-09-17T03:45:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.144+0000 7fbce9494640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbce415dd00 con 0x7fbce40b5750 2024-09-17T03:45:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.144+0000 7fbce9494640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbce40b2930 con 0x7fbce40b5ce0 2024-09-17T03:45:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.144+0000 7fbce2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40b3b60 0x7fbce4155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.144+0000 7fbce2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40b3b60 0x7fbce4155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34160/0 (socket says 172.21.15.146:34160) 2024-09-17T03:45:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.144+0000 7fbce2ffd640 1 -- 172.21.15.146:0/1720558103 learned_addr learned my addr 172.21.15.146:0/1720558103 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:19.145 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.144+0000 7fbcda7fc640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce40b5750 0x7fbce409ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.144+0000 7fbce37fe640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce40b5ce0 0x7fbce41f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbce2ffd640 1 -- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce40b5ce0 msgr2=0x7fbce41f7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbce2ffd640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce40b5ce0 0x7fbce41f7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbce2ffd640 1 -- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce40b5750 msgr2=0x7fbce409ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbce2ffd640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce40b5750 0x7fbce409ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbce2ffd640 1 -- 172.21.15.146:0/1720558103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce40c82d0 con 0x7fbce40b3b60 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbce37fe640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce40b5ce0 0x7fbce41f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbce2ffd640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40b3b60 0x7fbce4155580 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400b410 tx=0x7fbcd400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbcdbfff640 1 -- 172.21.15.146:0/1720558103 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4015020 con 0x7fbce40b3b60 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbcdbfff640 1 -- 172.21.15.146:0/1720558103 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcd4011940 con 0x7fbce40b3b60 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbcdbfff640 1 -- 172.21.15.146:0/1720558103 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4011d90 con 0x7fbce40b3b60 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbce9494640 1 -- 172.21.15.146:0/1720558103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce40c85b0 con 0x7fbce40b3b60 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.145+0000 7fbce9494640 1 -- 172.21.15.146:0/1720558103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce409dee0 con 0x7fbce40b3b60 2024-09-17T03:45:19.146 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.146+0000 7fbce9494640 1 -- 172.21.15.146:0/1720558103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce40c8ad0 con 0x7fbce40b3b60 2024-09-17T03:45:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.147+0000 7fbcdbfff640 1 -- 172.21.15.146:0/1720558103 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcd4018020 con 0x7fbce40b3b60 2024-09-17T03:45:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.147+0000 7fbcdbfff640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcc4078b90 0x7fbcc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.147+0000 7fbcdbfff640 1 -- 172.21.15.146:0/1720558103 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fbcd409ad50 con 0x7fbce40b3b60 2024-09-17T03:45:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.147+0000 7fbcda7fc640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcc4078b90 0x7fbcc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.147 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.148+0000 7fbcda7fc640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcc4078b90 0x7fbcc407b0a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbccc033000 tx=0x7fbccc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:19.150 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.151+0000 7fbcdbfff640 1 -- 172.21.15.146:0/1720558103 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbcd409e030 con 0x7fbce40b3b60 2024-09-17T03:45:19.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.364+0000 7fbce9494640 1 -- 172.21.15.146:0/1720558103 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbce40b6a10 con 0x7fbce40b3b60 2024-09-17T03:45:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.365+0000 7fbcdbfff640 1 -- 172.21.15.146:0/1720558103 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5250 (secure 0 0 0) 0x7fbce40b6a10 con 0x7fbce40b3b60 2024-09-17T03:45:19.364 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:19.364 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"btime":"2024-09-17T03:44:38:513917+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8309,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2438790201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2438790201},{"type":"v1","addr":"172.21.15.146:6835","nonce":2438790201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3707736043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3707736043},{"type":"v1","addr":"172.21.15.179:6836","nonce":3707736043}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2895389304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2895389304},{"type":"v1","addr":"172.21.15.179:6837","nonce":2895389304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:44:34.866944+0000","modified":"2024-09-17T03:44:37.878491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10671},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10671":{"gid":10671,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/2269642448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2269642448},{"type":"v1","addr":"172.21.15.146:6834","nonce":2269642448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10671,"qdb_cluster":[10671]},"id":13}]} 2024-09-17T03:45:19.364 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2024-09-17T03:45:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 -- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcc4078b90 msgr2=0x7fbcc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcc4078b90 0x7fbcc407b0a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbccc033000 tx=0x7fbccc004730 comp rx=0 tx=0).stop 2024-09-17T03:45:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 -- 172.21.15.146:0/1720558103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40b3b60 msgr2=0x7fbce4155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40b3b60 0x7fbce4155580 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400b410 tx=0x7fbcd400b8d0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 -- 172.21.15.146:0/1720558103 shutdown_connections 2024-09-17T03:45:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbcc4078b90 0x7fbcc407b0a0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.366 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbce40b5ce0 0x7fbce41f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce40b5750 0x7fbce409ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 --2- 172.21.15.146:0/1720558103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce40b3b60 0x7fbce4155580 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 -- 172.21.15.146:0/1720558103 >> 172.21.15.146:0/1720558103 conn(0x7fbce40b7b20 msgr2=0x7fbce4071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 -- 172.21.15.146:0/1720558103 shutdown_connections 2024-09-17T03:45:19.367 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.367+0000 7fbce9494640 1 -- 172.21.15.146:0/1720558103 wait complete. 2024-09-17T03:45:19.378 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:45:19.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.492+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3756294528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f40b5750 msgr2=0x7f12f40b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.491 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.492+0000 7f12f8ad3640 1 --2- 172.21.15.146:0/3756294528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f40b5750 0x7f12f40b3620 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009830 tx=0x7f12e802a510 comp rx=0 tx=0).stop 2024-09-17T03:45:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.492+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3756294528 shutdown_connections 2024-09-17T03:45:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.492+0000 7f12f8ad3640 1 --2- 172.21.15.146:0/3756294528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f40b3b60 0x7f12f415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.492+0000 7f12f8ad3640 1 --2- 172.21.15.146:0/3756294528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f40b5750 0x7f12f40b3620 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.492+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3756294528 >> 172.21.15.146:0/3756294528 conn(0x7f12f40b7b20 msgr2=0x7f12f409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.492+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3756294528 shutdown_connections 2024-09-17T03:45:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.492+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3756294528 wait complete. 2024-09-17T03:45:19.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.494+0000 7f12f8ad3640 1 Processor -- start 2024-09-17T03:45:19.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.494+0000 7f12f8ad3640 1 -- start start 2024-09-17T03:45:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f8ad3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f40b3b60 0x7f12f41f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f8ad3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f40b5750 0x7f12f414ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f8ad3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f40b5ce0 0x7f12f41f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f8ad3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f12f415d4b0 con 0x7f12f40b5ce0 2024-09-17T03:45:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f8ad3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12f415d330 con 0x7f12f40b5750 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f8ad3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f12f415d630 con 0x7f12f40b3b60 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f40b5ce0 0x7f12f41f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f40b5ce0 0x7f12f41f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34176/0 (socket says 172.21.15.146:34176) 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f2d9d640 1 -- 172.21.15.146:0/3388019716 learned_addr learned my addr 172.21.15.146:0/3388019716 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f1d9b640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f40b5750 0x7f12f414ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f259c640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f40b3b60 0x7f12f41f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f2d9d640 1 -- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f40b3b60 msgr2=0x7f12f41f77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f2d9d640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f40b3b60 0x7f12f41f77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f2d9d640 1 -- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f40b5750 msgr2=0x7f12f414ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f2d9d640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f40b5750 0x7f12f414ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.495+0000 7f12f2d9d640 1 -- 172.21.15.146:0/3388019716 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f41f42b0 con 0x7f12f40b5ce0 2024-09-17T03:45:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.496+0000 7f12f2d9d640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f40b5ce0 0x7f12f41f3680 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00e960 tx=0x7f12ec00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:19.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.496+0000 7f12e2ffd640 1 -- 172.21.15.146:0/3388019716 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec004d20 con 0x7f12f40b5ce0 2024-09-17T03:45:19.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.496+0000 7f12e2ffd640 1 -- 172.21.15.146:0/3388019716 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12ec00cb20 con 0x7f12f40b5ce0 2024-09-17T03:45:19.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.496+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3388019716 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f41f4590 con 0x7f12f40b5ce0 2024-09-17T03:45:19.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.496+0000 7f12e2ffd640 1 -- 172.21.15.146:0/3388019716 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec005020 con 0x7f12f40b5ce0 2024-09-17T03:45:19.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.496+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3388019716 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f41f6fd0 con 0x7f12f40b5ce0 2024-09-17T03:45:19.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.497+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3388019716 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f415dae0 con 0x7f12f40b5ce0 2024-09-17T03:45:19.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.498+0000 7f12e2ffd640 1 -- 172.21.15.146:0/3388019716 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f12ec0051c0 con 0x7f12f40b5ce0 2024-09-17T03:45:19.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.498+0000 7f12e2ffd640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12d4078b90 0x7f12d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.498+0000 7f12e2ffd640 1 -- 172.21.15.146:0/3388019716 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f12ec09b5f0 con 0x7f12f40b5ce0 2024-09-17T03:45:19.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.498+0000 7f12f259c640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12d4078b90 0x7f12d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.499+0000 7f12f259c640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12d4078b90 0x7f12d407b0a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f12e4001720 tx=0x7f12e4007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:19.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.503+0000 7f12e2ffd640 1 -- 172.21.15.146:0/3388019716 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f12ec016030 con 0x7f12f40b5ce0 2024-09-17T03:45:19.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.713+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3388019716 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12f409bfb0 con 0x7f12f40b5ce0 2024-09-17T03:45:19.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.714+0000 7f12e2ffd640 1 -- 172.21.15.146:0/3388019716 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5250 (secure 0 0 0) 0x7f12ec0633f0 con 0x7f12f40b5ce0 2024-09-17T03:45:19.717 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:19.717 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"btime":"2024-09-17T03:44:38:513917+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8309,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2438790201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2438790201},{"type":"v1","addr":"172.21.15.146:6835","nonce":2438790201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3707736043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3707736043},{"type":"v1","addr":"172.21.15.179:6836","nonce":3707736043}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2895389304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2895389304},{"type":"v1","addr":"172.21.15.179:6837","nonce":2895389304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:44:34.866944+0000","modified":"2024-09-17T03:44:37.878491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10671},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10671":{"gid":10671,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/2269642448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2269642448},{"type":"v1","addr":"172.21.15.146:6834","nonce":2269642448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10671,"qdb_cluster":[10671]},"id":13}]} 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12d4078b90 msgr2=0x7f12d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12d4078b90 0x7f12d407b0a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f12e4001720 tx=0x7f12e4007e90 comp rx=0 tx=0).stop 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3388019716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f40b5ce0 msgr2=0x7f12f41f3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f40b5ce0 0x7f12f41f3680 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00e960 tx=0x7f12ec00ee20 comp rx=0 tx=0).stop 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3388019716 shutdown_connections 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f12d4078b90 0x7f12d407b0a0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12f40b5ce0 0x7f12f41f3680 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12f40b5750 0x7f12f414ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 --2- 172.21.15.146:0/3388019716 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12f40b3b60 0x7f12f41f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3388019716 >> 172.21.15.146:0/3388019716 conn(0x7f12f40b7b20 msgr2=0x7f12f41564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:19.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3388019716 shutdown_connections 2024-09-17T03:45:19.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.716+0000 7f12f8ad3640 1 -- 172.21.15.146:0/3388019716 wait complete. 2024-09-17T03:45:19.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:45:19.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.841+0000 7fca88e7e640 1 -- 172.21.15.146:0/2816065561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca840b5ce0 msgr2=0x7fca840b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.841+0000 7fca88e7e640 1 --2- 172.21.15.146:0/2816065561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca840b5ce0 0x7fca840b1320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fca74009860 tx=0x7fca7402a530 comp rx=0 tx=0).stop 2024-09-17T03:45:19.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.841+0000 7fca88e7e640 1 -- 172.21.15.146:0/2816065561 shutdown_connections 2024-09-17T03:45:19.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.841+0000 7fca88e7e640 1 --2- 172.21.15.146:0/2816065561 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca840b5ce0 0x7fca840b1320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.841+0000 7fca88e7e640 1 -- 172.21.15.146:0/2816065561 >> 172.21.15.146:0/2816065561 conn(0x7fca840b7b20 msgr2=0x7fca8409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:19.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.841+0000 7fca88e7e640 1 -- 172.21.15.146:0/2816065561 shutdown_connections 2024-09-17T03:45:19.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.841+0000 7fca88e7e640 1 -- 172.21.15.146:0/2816065561 wait complete. 2024-09-17T03:45:19.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.843+0000 7fca88e7e640 1 Processor -- start 2024-09-17T03:45:19.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.843+0000 7fca88e7e640 1 -- start start 2024-09-17T03:45:19.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.844+0000 7fca88e7e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca840b5750 0x7fca84156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.844+0000 7fca88e7e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca840b5ce0 0x7fca84151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.844+0000 7fca88e7e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca84151690 0x7fca841537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.844+0000 7fca88e7e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fca8415d650 con 0x7fca840b5750 2024-09-17T03:45:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.844+0000 7fca88e7e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fca8415d4d0 con 0x7fca84151690 2024-09-17T03:45:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.844+0000 7fca88e7e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fca8415d7d0 con 0x7fca840b5ce0 2024-09-17T03:45:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.844+0000 7fca8259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca840b5750 0x7fca84156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca8259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca840b5750 0x7fca84156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34192/0 (socket says 172.21.15.146:34192) 2024-09-17T03:45:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca8259c640 1 -- 172.21.15.146:0/494100461 learned_addr learned my addr 172.21.15.146:0/494100461 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca82d9d640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca84151690 0x7fca841537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca79d9b640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca840b5ce0 0x7fca84151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca8259c640 1 -- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca840b5ce0 msgr2=0x7fca84151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca8259c640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca840b5ce0 0x7fca84151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca8259c640 1 -- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca84151690 msgr2=0x7fca841537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:19.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca8259c640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca84151690 0x7fca841537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:19.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca8259c640 1 -- 172.21.15.146:0/494100461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca84151e40 con 0x7fca840b5750 2024-09-17T03:45:19.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca82d9d640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca84151690 0x7fca841537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:19.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca8259c640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca840b5750 0x7fca84156930 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7fca7402ab20 tx=0x7fca74003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:19.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca7b7fe640 1 -- 172.21.15.146:0/494100461 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74005c90 con 0x7fca840b5750 2024-09-17T03:45:19.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca7b7fe640 1 -- 172.21.15.146:0/494100461 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca74005020 con 0x7fca840b5750 2024-09-17T03:45:19.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca88e7e640 1 -- 172.21.15.146:0/494100461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca84152120 con 0x7fca840b5750 2024-09-17T03:45:19.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca7b7fe640 1 -- 172.21.15.146:0/494100461 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74005410 con 0x7fca840b5750 2024-09-17T03:45:19.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.845+0000 7fca88e7e640 1 -- 172.21.15.146:0/494100461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca841526e0 con 0x7fca840b5750 2024-09-17T03:45:19.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.846+0000 7fca88e7e640 1 -- 172.21.15.146:0/494100461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca8415dc80 con 0x7fca840b5750 2024-09-17T03:45:19.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.847+0000 7fca7b7fe640 1 -- 172.21.15.146:0/494100461 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca740317c0 con 0x7fca840b5750 2024-09-17T03:45:19.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.847+0000 7fca7b7fe640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fca64078bc0 0x7fca6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:19.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.847+0000 7fca7b7fe640 1 -- 172.21.15.146:0/494100461 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fca740bbd80 con 0x7fca840b5750 2024-09-17T03:45:19.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.848+0000 7fca79d9b640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fca64078bc0 0x7fca6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:19.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.848+0000 7fca79d9b640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fca64078bc0 0x7fca6407b0d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fca84148c30 tx=0x7fca6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:19.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:19.852+0000 7fca7b7fe640 1 -- 172.21.15.146:0/494100461 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fca7403f030 con 0x7fca840b5750 2024-09-17T03:45:20.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.025+0000 7fca88e7e640 1 -- 172.21.15.146:0/494100461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca8406b100 con 0x7fca840b5750 2024-09-17T03:45:20.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.026+0000 7fca7b7fe640 1 -- 172.21.15.146:0/494100461 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16791 (secure 0 0 0) 0x7fca74084140 con 0x7fca840b5750 2024-09-17T03:45:20.025 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:20.025 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":176,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:44:36.488481+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:44:32.495473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T03:44:33.816918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:45:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 -- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fca64078bc0 msgr2=0x7fca6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fca64078bc0 0x7fca6407b0d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fca84148c30 tx=0x7fca6c009040 comp rx=0 tx=0).stop 2024-09-17T03:45:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 -- 172.21.15.146:0/494100461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca840b5750 msgr2=0x7fca84156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca840b5750 0x7fca84156930 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7fca7402ab20 tx=0x7fca74003c10 comp rx=0 tx=0).stop 2024-09-17T03:45:20.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 -- 172.21.15.146:0/494100461 shutdown_connections 2024-09-17T03:45:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fca64078bc0 0x7fca6407b0d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fca84151690 0x7fca841537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fca840b5ce0 0x7fca84151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 --2- 172.21.15.146:0/494100461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca840b5750 0x7fca84156930 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 -- 172.21.15.146:0/494100461 >> 172.21.15.146:0/494100461 conn(0x7fca840b7b20 msgr2=0x7fca84159700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 -- 172.21.15.146:0/494100461 shutdown_connections 2024-09-17T03:45:20.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.028+0000 7fca88e7e640 1 -- 172.21.15.146:0/494100461 wait complete. 2024-09-17T03:45:20.039 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:45:20.039 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:45:20.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.153+0000 7f09ddf07640 1 -- 172.21.15.146:0/1765237413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8160c00 msgr2=0x7f09d815d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.153+0000 7f09ddf07640 1 --2- 172.21.15.146:0/1765237413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8160c00 0x7f09d815d980 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0098e0 tx=0x7f09cc02a5e0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.153+0000 7f09ddf07640 1 -- 172.21.15.146:0/1765237413 shutdown_connections 2024-09-17T03:45:20.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.153+0000 7f09ddf07640 1 --2- 172.21.15.146:0/1765237413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d8073480 0x7f09d8073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.153+0000 7f09ddf07640 1 --2- 172.21.15.146:0/1765237413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8160c00 0x7f09d815d980 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.153+0000 7f09ddf07640 1 -- 172.21.15.146:0/1765237413 >> 172.21.15.146:0/1765237413 conn(0x7f09d80b2060 msgr2=0x7f09d80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:20.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.153+0000 7f09ddf07640 1 -- 172.21.15.146:0/1765237413 shutdown_connections 2024-09-17T03:45:20.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.153+0000 7f09ddf07640 1 -- 172.21.15.146:0/1765237413 wait complete. 2024-09-17T03:45:20.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.155+0000 7f09ddf07640 1 Processor -- start 2024-09-17T03:45:20.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.155+0000 7f09ddf07640 1 -- start start 2024-09-17T03:45:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.156+0000 7f09ddf07640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09d8073480 0x7f09d8140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.156+0000 7f09ddf07640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8153a60 0x7f09d8156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.156+0000 7f09ddf07640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d8140970 0x7f09d80b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.156+0000 7f09ddf07640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f09d8073f50 con 0x7f09d8153a60 2024-09-17T03:45:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.156+0000 7f09ddf07640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f09d8073dd0 con 0x7f09d8073480 2024-09-17T03:45:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.156+0000 7f09ddf07640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f09d80740d0 con 0x7f09d8140970 2024-09-17T03:45:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.156+0000 7f09d6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8153a60 0x7f09d8156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.156+0000 7f09d6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8153a60 0x7f09d8156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34218/0 (socket says 172.21.15.146:34218) 2024-09-17T03:45:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.156+0000 7f09d6ffd640 1 -- 172.21.15.146:0/3531620008 learned_addr learned my addr 172.21.15.146:0/3531620008 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.156+0000 7f09d77fe640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09d8073480 0x7f09d8140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.157 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.156+0000 7f09d7fff640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d8140970 0x7f09d80b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09d6ffd640 1 -- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d8140970 msgr2=0x7f09d80b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09d6ffd640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d8140970 0x7f09d80b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09d6ffd640 1 -- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09d8073480 msgr2=0x7f09d8140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09d6ffd640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09d8073480 0x7f09d8140100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09d6ffd640 1 -- 172.21.15.146:0/3531620008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d8156f80 con 0x7f09d8153a60 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09d7fff640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d8140970 0x7f09d80b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09d6ffd640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8153a60 0x7f09d8156670 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f09cc009a00 tx=0x7f09cc0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09bffff640 1 -- 172.21.15.146:0/3531620008 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc03f070 con 0x7f09d8153a60 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09bffff640 1 -- 172.21.15.146:0/3531620008 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09cc004050 con 0x7f09d8153a60 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09bffff640 1 -- 172.21.15.146:0/3531620008 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0044a0 con 0x7f09d8153a60 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09ddf07640 1 -- 172.21.15.146:0/3531620008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d8158b60 con 0x7f09d8153a60 2024-09-17T03:45:20.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.157+0000 7f09ddf07640 1 -- 172.21.15.146:0/3531620008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d8158e00 con 0x7f09d8153a60 2024-09-17T03:45:20.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.158+0000 7f09ddf07640 1 -- 172.21.15.146:0/3531620008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d8073890 con 0x7f09d8153a60 2024-09-17T03:45:20.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.159+0000 7f09bffff640 1 -- 172.21.15.146:0/3531620008 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09cc042070 con 0x7f09d8153a60 2024-09-17T03:45:20.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.159+0000 7f09bffff640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09c4078b90 0x7f09c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.159+0000 7f09bffff640 1 -- 172.21.15.146:0/3531620008 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f09cc0bbae0 con 0x7f09d8153a60 2024-09-17T03:45:20.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.160+0000 7f09d77fe640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09c4078b90 0x7f09c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.160+0000 7f09d77fe640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09c4078b90 0x7f09c407b0a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f09c8001720 tx=0x7f09c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:20.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.164+0000 7f09bffff640 1 -- 172.21.15.146:0/3531620008 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f09d8158b60 con 0x7f09d8153a60 2024-09-17T03:45:20.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.374+0000 7f09ddf07640 1 -- 172.21.15.146:0/3531620008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09d81e83f0 con 0x7f09d8153a60 2024-09-17T03:45:20.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.375+0000 7f09bffff640 1 -- 172.21.15.146:0/3531620008 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5250 (secure 0 0 0) 0x7f09cc0838d0 con 0x7f09d8153a60 2024-09-17T03:45:20.374 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:20.375 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"btime":"2024-09-17T03:44:38:513917+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8309,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2438790201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2438790201},{"type":"v1","addr":"172.21.15.146:6835","nonce":2438790201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3707736043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3707736043},{"type":"v1","addr":"172.21.15.179:6836","nonce":3707736043}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2895389304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2895389304},{"type":"v1","addr":"172.21.15.179:6837","nonce":2895389304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:44:34.866944+0000","modified":"2024-09-17T03:44:37.878491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10671},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10671":{"gid":10671,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/2269642448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2269642448},{"type":"v1","addr":"172.21.15.146:6834","nonce":2269642448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10671,"qdb_cluster":[10671]},"id":13}]} 2024-09-17T03:45:20.375 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2024-09-17T03:45:20.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 -- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09c4078b90 msgr2=0x7f09c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09c4078b90 0x7f09c407b0a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f09c8001720 tx=0x7f09c8009040 comp rx=0 tx=0).stop 2024-09-17T03:45:20.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 -- 172.21.15.146:0/3531620008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8153a60 msgr2=0x7f09d8156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8153a60 0x7f09d8156670 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f09cc009a00 tx=0x7f09cc0049d0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 -- 172.21.15.146:0/3531620008 shutdown_connections 2024-09-17T03:45:20.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f09c4078b90 0x7f09c407b0a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f09d8140970 0x7f09d80b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8153a60 0x7f09d8156670 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 --2- 172.21.15.146:0/3531620008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f09d8073480 0x7f09d8140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 -- 172.21.15.146:0/3531620008 >> 172.21.15.146:0/3531620008 conn(0x7f09d80b2060 msgr2=0x7f09d8152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:20.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 -- 172.21.15.146:0/3531620008 shutdown_connections 2024-09-17T03:45:20.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.377+0000 7f09ddf07640 1 -- 172.21.15.146:0/3531620008 wait complete. 2024-09-17T03:45:20.388 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:45:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.503+0000 7fb0ba33a640 1 -- 172.21.15.146:0/122356666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b415b770 msgr2=0x7fb0b406fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.503+0000 7fb0ba33a640 1 --2- 172.21.15.146:0/122356666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b415b770 0x7fb0b406fe10 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4005fd0 tx=0x7fb0a402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.504+0000 7fb0ba33a640 1 -- 172.21.15.146:0/122356666 shutdown_connections 2024-09-17T03:45:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.504+0000 7fb0ba33a640 1 --2- 172.21.15.146:0/122356666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b415b770 0x7fb0b406fe10 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.504+0000 7fb0ba33a640 1 -- 172.21.15.146:0/122356666 >> 172.21.15.146:0/122356666 conn(0x7fb0b40b2060 msgr2=0x7fb0b40b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:20.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.504+0000 7fb0ba33a640 1 -- 172.21.15.146:0/122356666 shutdown_connections 2024-09-17T03:45:20.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.504+0000 7fb0ba33a640 1 -- 172.21.15.146:0/122356666 wait complete. 2024-09-17T03:45:20.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.505+0000 7fb0ba33a640 1 Processor -- start 2024-09-17T03:45:20.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.506+0000 7fb0ba33a640 1 -- start start 2024-09-17T03:45:20.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0ba33a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b4070350 0x7fb0b415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0ba33a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b415b770 0x7fb0b415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0ba33a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b414e980 0x7fb0b415e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0ba33a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b40b5080 con 0x7fb0b415b770 2024-09-17T03:45:20.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0ba33a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b40b4f00 con 0x7fb0b414e980 2024-09-17T03:45:20.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0ba33a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b40b5200 con 0x7fb0b4070350 2024-09-17T03:45:20.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b415b770 0x7fb0b415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0b37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b415b770 0x7fb0b415e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34236/0 (socket says 172.21.15.146:34236) 2024-09-17T03:45:20.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0b37fe640 1 -- 172.21.15.146:0/456921985 learned_addr learned my addr 172.21.15.146:0/456921985 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:20.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0b88d7640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b414e980 0x7fb0b415e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0b3fff640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b4070350 0x7fb0b415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0b37fe640 1 -- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b4070350 msgr2=0x7fb0b415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0b37fe640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b4070350 0x7fb0b415bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0b37fe640 1 -- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b414e980 msgr2=0x7fb0b415e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0b37fe640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b414e980 0x7fb0b415e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0b37fe640 1 -- 172.21.15.146:0/456921985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b41f1fc0 con 0x7fb0b415b770 2024-09-17T03:45:20.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.507+0000 7fb0b37fe640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b415b770 0x7fb0b415e1b0 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c430 tx=0x7fb0a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:20.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.508+0000 7fb0b0ff9640 1 -- 172.21.15.146:0/456921985 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8017070 con 0x7fb0b415b770 2024-09-17T03:45:20.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.508+0000 7fb0b0ff9640 1 -- 172.21.15.146:0/456921985 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0a80053e0 con 0x7fb0b415b770 2024-09-17T03:45:20.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.508+0000 7fb0ba33a640 1 -- 172.21.15.146:0/456921985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b41530e0 con 0x7fb0b415b770 2024-09-17T03:45:20.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.508+0000 7fb0b0ff9640 1 -- 172.21.15.146:0/456921985 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8003850 con 0x7fb0b415b770 2024-09-17T03:45:20.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.508+0000 7fb0ba33a640 1 -- 172.21.15.146:0/456921985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b41536a0 con 0x7fb0b415b770 2024-09-17T03:45:20.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.509+0000 7fb0ba33a640 1 -- 172.21.15.146:0/456921985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b4152e30 con 0x7fb0b415b770 2024-09-17T03:45:20.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.509+0000 7fb0b0ff9640 1 -- 172.21.15.146:0/456921985 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb0a801a070 con 0x7fb0b415b770 2024-09-17T03:45:20.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.510+0000 7fb0b0ff9640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0a0078b90 0x7fb0a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.510+0000 7fb0b0ff9640 1 -- 172.21.15.146:0/456921985 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fb0a809a0b0 con 0x7fb0b415b770 2024-09-17T03:45:20.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.510+0000 7fb0b3fff640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0a0078b90 0x7fb0a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.511+0000 7fb0b3fff640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0a0078b90 0x7fb0a007b0a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4033000 tx=0x7fb0a4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:20.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.515+0000 7fb0b0ff9640 1 -- 172.21.15.146:0/456921985 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb0a8061ea0 con 0x7fb0b415b770 2024-09-17T03:45:20.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.726+0000 7fb0ba33a640 1 -- 172.21.15.146:0/456921985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0b406fe10 con 0x7fb0b415b770 2024-09-17T03:45:20.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.726+0000 7fb0b0ff9640 1 -- 172.21.15.146:0/456921985 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5250 (secure 0 0 0) 0x7fb0a80668d0 con 0x7fb0b415b770 2024-09-17T03:45:20.726 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:20.726 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"btime":"2024-09-17T03:44:38:513917+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8309,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2438790201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2438790201},{"type":"v1","addr":"172.21.15.146:6835","nonce":2438790201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3707736043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3707736043},{"type":"v1","addr":"172.21.15.179:6836","nonce":3707736043}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2895389304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2895389304},{"type":"v1","addr":"172.21.15.179:6837","nonce":2895389304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:44:34.866944+0000","modified":"2024-09-17T03:44:37.878491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10671},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10671":{"gid":10671,"name":"a","rank":0,"incarnation":133,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6834/2269642448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2269642448},{"type":"v1","addr":"172.21.15.146:6834","nonce":2269642448}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10671,"qdb_cluster":[10671]},"id":13}]} 2024-09-17T03:45:20.726 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2024-09-17T03:45:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 -- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0a0078b90 msgr2=0x7fb0a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0a0078b90 0x7fb0a007b0a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb0a4033000 tx=0x7fb0a4004730 comp rx=0 tx=0).stop 2024-09-17T03:45:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 -- 172.21.15.146:0/456921985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b415b770 msgr2=0x7fb0b415e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b415b770 0x7fb0b415e1b0 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800c430 tx=0x7fb0a800c8f0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 -- 172.21.15.146:0/456921985 shutdown_connections 2024-09-17T03:45:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb0a0078b90 0x7fb0a007b0a0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0b414e980 0x7fb0b415e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b415b770 0x7fb0b415e1b0 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 --2- 172.21.15.146:0/456921985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb0b4070350 0x7fb0b415bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 -- 172.21.15.146:0/456921985 >> 172.21.15.146:0/456921985 conn(0x7fb0b40b2060 msgr2=0x7fb0b4072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 -- 172.21.15.146:0/456921985 shutdown_connections 2024-09-17T03:45:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.729+0000 7fb0ba33a640 1 -- 172.21.15.146:0/456921985 wait complete. 2024-09-17T03:45:20.741 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:45:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.854+0000 7f38f017b640 1 -- 172.21.15.146:0/2070969371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e806f0a0 msgr2=0x7f38e81688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.854+0000 7f38f017b640 1 --2- 172.21.15.146:0/2070969371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e806f0a0 0x7f38e81688b0 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f38e0005fd0 tx=0x7f38e002aa90 comp rx=0 tx=0).stop 2024-09-17T03:45:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.854+0000 7f38f017b640 1 -- 172.21.15.146:0/2070969371 shutdown_connections 2024-09-17T03:45:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.854+0000 7f38f017b640 1 --2- 172.21.15.146:0/2070969371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e806f0a0 0x7f38e81688b0 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.854+0000 7f38f017b640 1 --2- 172.21.15.146:0/2070969371 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38e815ef10 0x7f38e806deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.854+0000 7f38f017b640 1 -- 172.21.15.146:0/2070969371 >> 172.21.15.146:0/2070969371 conn(0x7f38e80b7b20 msgr2=0x7f38e809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.854+0000 7f38f017b640 1 -- 172.21.15.146:0/2070969371 shutdown_connections 2024-09-17T03:45:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.854+0000 7f38f017b640 1 -- 172.21.15.146:0/2070969371 wait complete. 2024-09-17T03:45:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.856+0000 7f38f017b640 1 Processor -- start 2024-09-17T03:45:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.856+0000 7f38f017b640 1 -- start start 2024-09-17T03:45:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.857+0000 7f38f017b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e806e3f0 0x7f38e8154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.857+0000 7f38f017b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38e815ef10 0x7f38e814c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.857+0000 7f38f017b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38e8152160 0x7f38e8152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38f017b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f38e8168f70 con 0x7f38e806e3f0 2024-09-17T03:45:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38f017b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f38e8168df0 con 0x7f38e815ef10 2024-09-17T03:45:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38f017b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f38e81690f0 con 0x7f38e8152160 2024-09-17T03:45:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38edf17640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e806e3f0 0x7f38e8154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38edf17640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e806e3f0 0x7f38e8154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34246/0 (socket says 172.21.15.146:34246) 2024-09-17T03:45:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38edf17640 1 -- 172.21.15.146:0/1114204201 learned_addr learned my addr 172.21.15.146:0/1114204201 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:20.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38ee718640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38e8152160 0x7f38e8152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38ed716640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38e815ef10 0x7f38e814c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38edf17640 1 -- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38e8152160 msgr2=0x7f38e8152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38edf17640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38e8152160 0x7f38e8152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38edf17640 1 -- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38e815ef10 msgr2=0x7f38e814c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38edf17640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38e815ef10 0x7f38e814c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38edf17640 1 -- 172.21.15.146:0/1114204201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e8152ab0 con 0x7f38e806e3f0 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38edf17640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e806e3f0 0x7f38e8154610 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f38e400d770 tx=0x7f38e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38de7fc640 1 -- 172.21.15.146:0/1114204201 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4017070 con 0x7f38e806e3f0 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38de7fc640 1 -- 172.21.15.146:0/1114204201 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38e4009d20 con 0x7f38e806e3f0 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38de7fc640 1 -- 172.21.15.146:0/1114204201 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e40106c0 con 0x7f38e806e3f0 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38f017b640 1 -- 172.21.15.146:0/1114204201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e814e170 con 0x7f38e806e3f0 2024-09-17T03:45:20.859 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.858+0000 7f38f017b640 1 -- 172.21.15.146:0/1114204201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e814d840 con 0x7f38e806e3f0 2024-09-17T03:45:20.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.860+0000 7f38f017b640 1 -- 172.21.15.146:0/1114204201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e815e760 con 0x7f38e806e3f0 2024-09-17T03:45:20.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.860+0000 7f38de7fc640 1 -- 172.21.15.146:0/1114204201 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38e401a070 con 0x7f38e806e3f0 2024-09-17T03:45:20.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.861+0000 7f38de7fc640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38cc078bc0 0x7f38cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:20.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.861+0000 7f38de7fc640 1 -- 172.21.15.146:0/1114204201 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7f38e409ae00 con 0x7f38e806e3f0 2024-09-17T03:45:20.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.861+0000 7f38ed716640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38cc078bc0 0x7f38cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:20.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.861+0000 7f38ed716640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38cc078bc0 0x7f38cc07b0d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f38e80726d0 tx=0x7f38d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:20.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:20.865+0000 7f38de7fc640 1 -- 172.21.15.146:0/1114204201 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f38e815e760 con 0x7f38e806e3f0 2024-09-17T03:45:21.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.041+0000 7f38f017b640 1 -- 172.21.15.146:0/1114204201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38e806deb0 con 0x7f38e806e3f0 2024-09-17T03:45:21.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.042+0000 7f38de7fc640 1 -- 172.21.15.146:0/1114204201 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16791 (secure 0 0 0) 0x7f38e8152ab0 con 0x7f38e806e3f0 2024-09-17T03:45:21.042 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:21.042 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":176,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:44:36.488481+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:44:32.495473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T03:44:33.816918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:45:21.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 -- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38cc078bc0 msgr2=0x7f38cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:21.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38cc078bc0 0x7f38cc07b0d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f38e80726d0 tx=0x7f38d8009040 comp rx=0 tx=0).stop 2024-09-17T03:45:21.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 -- 172.21.15.146:0/1114204201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e806e3f0 msgr2=0x7f38e8154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:21.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e806e3f0 0x7f38e8154610 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f38e400d770 tx=0x7f38e400dc30 comp rx=0 tx=0).stop 2024-09-17T03:45:21.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 -- 172.21.15.146:0/1114204201 shutdown_connections 2024-09-17T03:45:21.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f38cc078bc0 0x7f38cc07b0d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38e8152160 0x7f38e8152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38e815ef10 0x7f38e814c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 --2- 172.21.15.146:0/1114204201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38e806e3f0 0x7f38e8154610 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 -- 172.21.15.146:0/1114204201 >> 172.21.15.146:0/1114204201 conn(0x7f38e80b7b20 msgr2=0x7f38e815bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:21.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 -- 172.21.15.146:0/1114204201 shutdown_connections 2024-09-17T03:45:21.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.045+0000 7f38f017b640 1 -- 172.21.15.146:0/1114204201 wait complete. 2024-09-17T03:45:21.056 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:45:21.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.172+0000 7fdbb84a9640 1 -- 172.21.15.146:0/418735242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb00b5ce0 msgr2=0x7fdbb00b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:21.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.172+0000 7fdbb84a9640 1 --2- 172.21.15.146:0/418735242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb00b5ce0 0x7fdbb00b1320 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009830 tx=0x7fdbac02a510 comp rx=0 tx=0).stop 2024-09-17T03:45:21.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.172+0000 7fdbb84a9640 1 -- 172.21.15.146:0/418735242 shutdown_connections 2024-09-17T03:45:21.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.172+0000 7fdbb84a9640 1 --2- 172.21.15.146:0/418735242 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbb00b3d30 0x7fdbb015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.172+0000 7fdbb84a9640 1 --2- 172.21.15.146:0/418735242 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb00b5ce0 0x7fdbb00b1320 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.172+0000 7fdbb84a9640 1 -- 172.21.15.146:0/418735242 >> 172.21.15.146:0/418735242 conn(0x7fdbb00b7b20 msgr2=0x7fdbb009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:21.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.172+0000 7fdbb84a9640 1 -- 172.21.15.146:0/418735242 shutdown_connections 2024-09-17T03:45:21.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.172+0000 7fdbb84a9640 1 -- 172.21.15.146:0/418735242 wait complete. 2024-09-17T03:45:21.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.174+0000 7fdbb84a9640 1 Processor -- start 2024-09-17T03:45:21.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.174+0000 7fdbb84a9640 1 -- start start 2024-09-17T03:45:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.175+0000 7fdbb84a9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbb00b5750 0x7fdbb0144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.175+0000 7fdbb84a9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb00b5ce0 0x7fdbb0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.175+0000 7fdbb84a9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbb01502a0 0x7fdbb0072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.175+0000 7fdbb84a9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb015d4b0 con 0x7fdbb00b5750 2024-09-17T03:45:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.175+0000 7fdbb84a9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb015d330 con 0x7fdbb00b5ce0 2024-09-17T03:45:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.175+0000 7fdbb84a9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb015d630 con 0x7fdbb01502a0 2024-09-17T03:45:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.175+0000 7fdbb6245640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbb00b5750 0x7fdbb0144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.175+0000 7fdbb6245640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbb00b5750 0x7fdbb0144020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34250/0 (socket says 172.21.15.146:34250) 2024-09-17T03:45:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.175+0000 7fdbb6245640 1 -- 172.21.15.146:0/2007069502 learned_addr learned my addr 172.21.15.146:0/2007069502 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.175+0000 7fdbb6a46640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbb01502a0 0x7fdbb0072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.175+0000 7fdbb5a44640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb00b5ce0 0x7fdbb0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.176+0000 7fdbb6245640 1 -- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbb01502a0 msgr2=0x7fdbb0072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.176+0000 7fdbb6245640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbb01502a0 0x7fdbb0072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.176+0000 7fdbb6245640 1 -- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb00b5ce0 msgr2=0x7fdbb0071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.176+0000 7fdbb6245640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb00b5ce0 0x7fdbb0071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.176+0000 7fdbb6245640 1 -- 172.21.15.146:0/2007069502 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb01511a0 con 0x7fdbb00b5750 2024-09-17T03:45:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.176+0000 7fdbb6245640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbb00b5750 0x7fdbb0144020 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7fdbac02ab00 tx=0x7fdbac033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.176+0000 7fdba6ffd640 1 -- 172.21.15.146:0/2007069502 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac031d60 con 0x7fdbb00b5750 2024-09-17T03:45:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.176+0000 7fdba6ffd640 1 -- 172.21.15.146:0/2007069502 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbac033e10 con 0x7fdbb00b5750 2024-09-17T03:45:21.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.176+0000 7fdbb84a9640 1 -- 172.21.15.146:0/2007069502 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb0151480 con 0x7fdbb00b5750 2024-09-17T03:45:21.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.176+0000 7fdba6ffd640 1 -- 172.21.15.146:0/2007069502 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac005260 con 0x7fdbb00b5750 2024-09-17T03:45:21.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.176+0000 7fdbb84a9640 1 -- 172.21.15.146:0/2007069502 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb01f3800 con 0x7fdbb00b5750 2024-09-17T03:45:21.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.177+0000 7fdbb84a9640 1 -- 172.21.15.146:0/2007069502 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb015ecd0 con 0x7fdbb00b5750 2024-09-17T03:45:21.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.178+0000 7fdba6ffd640 1 -- 172.21.15.146:0/2007069502 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbac005400 con 0x7fdbb00b5750 2024-09-17T03:45:21.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.178+0000 7fdba6ffd640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb94078bc0 0x7fdb9407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:21.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.178+0000 7fdba6ffd640 1 -- 172.21.15.146:0/2007069502 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5709+0+0 (secure 0 0 0) 0x7fdbac0bbe00 con 0x7fdbb00b5750 2024-09-17T03:45:21.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.179+0000 7fdbb5a44640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb94078bc0 0x7fdb9407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:21.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.179+0000 7fdbb5a44640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb94078bc0 0x7fdb9407b0d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdbb01e7c60 tx=0x7fdba0007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:21.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.183+0000 7fdba6ffd640 1 -- 172.21.15.146:0/2007069502 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdbac03f030 con 0x7fdbb00b5750 2024-09-17T03:45:21.390 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.391+0000 7fdbb84a9640 1 -- 172.21.15.146:0/2007069502 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdbb015c170 con 0x7fdbb00b5750 2024-09-17T03:45:21.391 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:45:21.392+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:45:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.394+0000 7fdba6ffd640 1 -- 172.21.15.146:0/2007069502 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v137) ==== 161+0+0 (secure 0 0 0) 0x7fdbac083b70 con 0x7fdbb00b5750 2024-09-17T03:45:21.393 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:45:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.396+0000 7fdbb84a9640 1 -- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb94078bc0 msgr2=0x7fdb9407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.397+0000 7fdbb84a9640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb94078bc0 0x7fdb9407b0d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdbb01e7c60 tx=0x7fdba0007e90 comp rx=0 tx=0).stop 2024-09-17T03:45:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.397+0000 7fdbb84a9640 1 -- 172.21.15.146:0/2007069502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbb00b5750 msgr2=0x7fdbb0144020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.397+0000 7fdbb84a9640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbb00b5750 0x7fdbb0144020 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7fdbac02ab00 tx=0x7fdbac033c20 comp rx=0 tx=0).stop 2024-09-17T03:45:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.397+0000 7fdbb84a9640 1 -- 172.21.15.146:0/2007069502 shutdown_connections 2024-09-17T03:45:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.397+0000 7fdbb84a9640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdb94078bc0 0x7fdb9407b0d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.397+0000 7fdbb84a9640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbb01502a0 0x7fdbb0072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.397+0000 7fdbb84a9640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbb00b5ce0 0x7fdbb0071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.397+0000 7fdbb84a9640 1 --2- 172.21.15.146:0/2007069502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbb00b5750 0x7fdbb0144020 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.397+0000 7fdbb84a9640 1 -- 172.21.15.146:0/2007069502 >> 172.21.15.146:0/2007069502 conn(0x7fdbb00b7b20 msgr2=0x7fdbb00b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.397+0000 7fdbb84a9640 1 -- 172.21.15.146:0/2007069502 shutdown_connections 2024-09-17T03:45:21.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.397+0000 7fdbb84a9640 1 -- 172.21.15.146:0/2007069502 wait complete. 2024-09-17T03:45:21.398 INFO:tasks.ceph.mds.a.smithi146.stderr: -3596> 2024-09-17T03:44:41.458+0000 7f252630b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:45:21.408 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:45:21.453 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:45:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.526+0000 7f6695c0e640 1 -- 172.21.15.146:0/3121381616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690153af0 msgr2=0x7f669015ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.526+0000 7f6695c0e640 1 --2- 172.21.15.146:0/3121381616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690153af0 0x7f669015ce70 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f6680005fd0 tx=0x7f668002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.526+0000 7f6695c0e640 1 -- 172.21.15.146:0/3121381616 shutdown_connections 2024-09-17T03:45:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.526+0000 7f6695c0e640 1 --2- 172.21.15.146:0/3121381616 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6690073c00 0x7f66900cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.526+0000 7f6695c0e640 1 --2- 172.21.15.146:0/3121381616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690153af0 0x7f669015ce70 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.526+0000 7f6695c0e640 1 -- 172.21.15.146:0/3121381616 >> 172.21.15.146:0/3121381616 conn(0x7f66900b3410 msgr2=0x7f66900b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.526+0000 7f6695c0e640 1 -- 172.21.15.146:0/3121381616 shutdown_connections 2024-09-17T03:45:21.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.526+0000 7f6695c0e640 1 -- 172.21.15.146:0/3121381616 wait complete. 2024-09-17T03:45:21.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.528+0000 7f6695c0e640 1 Processor -- start 2024-09-17T03:45:21.527 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.528+0000 7f6695c0e640 1 -- start start 2024-09-17T03:45:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f6695c0e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66900cdf10 0x7f669014d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f6695c0e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690153af0 0x7f669014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f6695c0e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6690156b10 0x7f669014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f6695c0e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f66900d03a0 con 0x7f6690153af0 2024-09-17T03:45:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f6695c0e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f66900d0220 con 0x7f6690156b10 2024-09-17T03:45:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f6695c0e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f66900d0520 con 0x7f66900cdf10 2024-09-17T03:45:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f668effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690153af0 0x7f669014dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f668effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690153af0 0x7f669014dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34292/0 (socket says 172.21.15.146:34292) 2024-09-17T03:45:21.530 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f668effd640 1 -- 172.21.15.146:0/858817248 learned_addr learned my addr 172.21.15.146:0/858817248 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f668f7fe640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66900cdf10 0x7f669014d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f668ffff640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6690156b10 0x7f669014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f668effd640 1 -- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66900cdf10 msgr2=0x7f669014d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f668effd640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66900cdf10 0x7f669014d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f668effd640 1 -- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6690156b10 msgr2=0x7f669014e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f668effd640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6690156b10 0x7f669014e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f668effd640 1 -- 172.21.15.146:0/858817248 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6690158200 con 0x7f6690153af0 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f668effd640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690153af0 0x7f669014dc70 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f668400c370 tx=0x7f668400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f6677fff640 1 -- 172.21.15.146:0/858817248 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66840052d0 con 0x7f6690153af0 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f6677fff640 1 -- 172.21.15.146:0/858817248 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6684007020 con 0x7f6690153af0 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f6695c0e640 1 -- 172.21.15.146:0/858817248 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6690155200 con 0x7f6690153af0 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f6677fff640 1 -- 172.21.15.146:0/858817248 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684007470 con 0x7f6690153af0 2024-09-17T03:45:21.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.530+0000 7f6695c0e640 1 -- 172.21.15.146:0/858817248 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66901557c0 con 0x7f6690153af0 2024-09-17T03:45:21.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.531+0000 7f6695c0e640 1 -- 172.21.15.146:0/858817248 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66900d09d0 con 0x7f6690153af0 2024-09-17T03:45:21.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.532+0000 7f6677fff640 1 -- 172.21.15.146:0/858817248 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66840067d0 con 0x7f6690153af0 2024-09-17T03:45:21.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.533+0000 7f6677fff640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f667c078b90 0x7f667c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:21.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.533+0000 7f6677fff640 1 -- 172.21.15.146:0/858817248 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5795+0+0 (secure 0 0 0) 0x7f668409a1d0 con 0x7f6690153af0 2024-09-17T03:45:21.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.533+0000 7f668f7fe640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f667c078b90 0x7f667c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:21.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.534+0000 7f668f7fe640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f667c078b90 0x7f667c07b0a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6680033000 tx=0x7f6680004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.537+0000 7f6677fff640 1 -- 172.21.15.146:0/858817248 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6690070ac0 con 0x7f6690153af0 2024-09-17T03:45:21.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:21.749+0000 7f6695c0e640 1 -- 172.21.15.146:0/858817248 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f669014e6f0 con 0x7f6690153af0 2024-09-17T03:45:22.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.395+0000 7f6677fff640 1 -- 172.21.15.146:0/858817248 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v138) ==== 104+0+0 (secure 0 0 0) 0x7f6684061f60 con 0x7f6690153af0 2024-09-17T03:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.398+0000 7f6695c0e640 1 -- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f667c078b90 msgr2=0x7f667c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.398+0000 7f6695c0e640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f667c078b90 0x7f667c07b0a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6680033000 tx=0x7f6680004730 comp rx=0 tx=0).stop 2024-09-17T03:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.398+0000 7f6695c0e640 1 -- 172.21.15.146:0/858817248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690153af0 msgr2=0x7f669014dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.398+0000 7f6695c0e640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690153af0 0x7f669014dc70 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f668400c370 tx=0x7f668400c830 comp rx=0 tx=0).stop 2024-09-17T03:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.398+0000 7f6695c0e640 1 -- 172.21.15.146:0/858817248 shutdown_connections 2024-09-17T03:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.398+0000 7f6695c0e640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f667c078b90 0x7f667c07b0a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.398+0000 7f6695c0e640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6690156b10 0x7f669014e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.398+0000 7f6695c0e640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6690153af0 0x7f669014dc70 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:22.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.398+0000 7f6695c0e640 1 --2- 172.21.15.146:0/858817248 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f66900cdf10 0x7f669014d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.399+0000 7f6695c0e640 1 -- 172.21.15.146:0/858817248 >> 172.21.15.146:0/858817248 conn(0x7f66900b3410 msgr2=0x7f669015f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.399+0000 7f6695c0e640 1 -- 172.21.15.146:0/858817248 shutdown_connections 2024-09-17T03:45:22.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.399+0000 7f6695c0e640 1 -- 172.21.15.146:0/858817248 wait complete. 2024-09-17T03:45:22.413 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:45:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.538+0000 7effef982640 1 -- 172.21.15.146:0/803790524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effe815f010 msgr2=0x7effe81515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.538+0000 7effef982640 1 --2- 172.21.15.146:0/803790524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effe815f010 0x7effe81515a0 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7effe80b3120 tx=0x7effe002a530 comp rx=0 tx=0).stop 2024-09-17T03:45:22.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.538+0000 7effef982640 1 -- 172.21.15.146:0/803790524 shutdown_connections 2024-09-17T03:45:22.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.538+0000 7effef982640 1 --2- 172.21.15.146:0/803790524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effe815f010 0x7effe81515a0 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:22.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.538+0000 7effef982640 1 --2- 172.21.15.146:0/803790524 >> v2:172.21.15.179:3300/0 conn(0x7effe8072df0 0x7effe815ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:22.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.538+0000 7effef982640 1 -- 172.21.15.146:0/803790524 >> 172.21.15.146:0/803790524 conn(0x7effe80b2060 msgr2=0x7effe80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:22.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.538+0000 7effef982640 1 -- 172.21.15.146:0/803790524 shutdown_connections 2024-09-17T03:45:22.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.538+0000 7effef982640 1 -- 172.21.15.146:0/803790524 wait complete. 2024-09-17T03:45:22.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.540+0000 7effef982640 1 Processor -- start 2024-09-17T03:45:22.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.540+0000 7effef982640 1 -- start start 2024-09-17T03:45:22.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effef982640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8072df0 0x7effe814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:22.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effef982640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effe80b3360 0x7effe81f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:22.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effef982640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effe815f010 0x7effe8148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effef982640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7effe8152010 con 0x7effe80b3360 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effef982640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7effe8151e90 con 0x7effe8072df0 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effef982640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7effe8152190 con 0x7effe815f010 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effecf1d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effe80b3360 0x7effe81f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effecf1d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effe80b3360 0x7effe81f3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34318/0 (socket says 172.21.15.146:34318) 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effecf1d640 1 -- 172.21.15.146:0/613879847 learned_addr learned my addr 172.21.15.146:0/613879847 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effed71e640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8072df0 0x7effe814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effedf1f640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effe815f010 0x7effe8148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effecf1d640 1 -- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effe815f010 msgr2=0x7effe8148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effecf1d640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effe815f010 0x7effe8148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effecf1d640 1 -- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8072df0 msgr2=0x7effe814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effecf1d640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8072df0 0x7effe814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.541+0000 7effecf1d640 1 -- 172.21.15.146:0/613879847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe8146ca0 con 0x7effe80b3360 2024-09-17T03:45:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.542+0000 7effecf1d640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effe80b3360 0x7effe81f3330 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7effd800c970 tx=0x7effd800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.542+0000 7effddffb640 1 -- 172.21.15.146:0/613879847 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8007bb0 con 0x7effe80b3360 2024-09-17T03:45:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.542+0000 7effddffb640 1 -- 172.21.15.146:0/613879847 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effd8007e40 con 0x7effe80b3360 2024-09-17T03:45:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.542+0000 7effef982640 1 -- 172.21.15.146:0/613879847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe814cfa0 con 0x7effe80b3360 2024-09-17T03:45:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.542+0000 7effddffb640 1 -- 172.21.15.146:0/613879847 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8005290 con 0x7effe80b3360 2024-09-17T03:45:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.542+0000 7effef982640 1 -- 172.21.15.146:0/613879847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe8147240 con 0x7effe80b3360 2024-09-17T03:45:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.543+0000 7effef982640 1 -- 172.21.15.146:0/613879847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe80b5470 con 0x7effe80b3360 2024-09-17T03:45:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.544+0000 7effddffb640 1 -- 172.21.15.146:0/613879847 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7effd8005430 con 0x7effe80b3360 2024-09-17T03:45:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.544+0000 7effddffb640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effcc078bc0 0x7effcc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.544+0000 7effddffb640 1 -- 172.21.15.146:0/613879847 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5795+0+0 (secure 0 0 0) 0x7effd809b280 con 0x7effe80b3360 2024-09-17T03:45:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.544+0000 7effed71e640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effcc078bc0 0x7effcc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.545+0000 7effed71e640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effcc078bc0 0x7effcc07b0d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7effe40012e0 tx=0x7effe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:22.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.549+0000 7effddffb640 1 -- 172.21.15.146:0/613879847 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7effe80b5470 con 0x7effe80b3360 2024-09-17T03:45:22.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:22.727+0000 7effef982640 1 -- 172.21.15.146:0/613879847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7effe815ead0 con 0x7effe80b3360 2024-09-17T03:45:23.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.644+0000 7effddffb640 1 -- 172.21.15.146:0/613879847 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v178) ==== 181+0+0 (secure 0 0 0) 0x7effd8014070 con 0x7effe80b3360 2024-09-17T03:45:23.643 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 -- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effcc078bc0 msgr2=0x7effcc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effcc078bc0 0x7effcc07b0d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7effe40012e0 tx=0x7effe4009040 comp rx=0 tx=0).stop 2024-09-17T03:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 -- 172.21.15.146:0/613879847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effe80b3360 msgr2=0x7effe81f3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effe80b3360 0x7effe81f3330 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7effd800c970 tx=0x7effd800ce30 comp rx=0 tx=0).stop 2024-09-17T03:45:23.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 -- 172.21.15.146:0/613879847 shutdown_connections 2024-09-17T03:45:23.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7effcc078bc0 0x7effcc07b0d0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:23.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effe815f010 0x7effe8148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:23.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effe80b3360 0x7effe81f3330 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:23.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 --2- 172.21.15.146:0/613879847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effe8072df0 0x7effe814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:23.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 -- 172.21.15.146:0/613879847 >> 172.21.15.146:0/613879847 conn(0x7effe80b2060 msgr2=0x7effe8150de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:23.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 -- 172.21.15.146:0/613879847 shutdown_connections 2024-09-17T03:45:23.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.648+0000 7effef982640 1 -- 172.21.15.146:0/613879847 wait complete. 2024-09-17T03:45:23.662 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:45:23.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.783+0000 7fa0e4771640 1 -- 172.21.15.146:0/2673836754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc0b3b60 msgr2=0x7fa0dc15caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:23.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.783+0000 7fa0e4771640 1 --2- 172.21.15.146:0/2673836754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc0b3b60 0x7fa0dc15caa0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc0b8440 tx=0x7fa0d402a820 comp rx=0 tx=0).stop 2024-09-17T03:45:23.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.784+0000 7fa0e4771640 1 -- 172.21.15.146:0/2673836754 shutdown_connections 2024-09-17T03:45:23.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.784+0000 7fa0e4771640 1 --2- 172.21.15.146:0/2673836754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc0b3b60 0x7fa0dc15caa0 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:23.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.784+0000 7fa0e4771640 1 --2- 172.21.15.146:0/2673836754 >> v2:172.21.15.179:3300/0 conn(0x7fa0dc0b5750 0x7fa0dc0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:23.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.784+0000 7fa0e4771640 1 -- 172.21.15.146:0/2673836754 >> 172.21.15.146:0/2673836754 conn(0x7fa0dc0b7b20 msgr2=0x7fa0dc09ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:23.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.784+0000 7fa0e4771640 1 -- 172.21.15.146:0/2673836754 shutdown_connections 2024-09-17T03:45:23.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.784+0000 7fa0e4771640 1 -- 172.21.15.146:0/2673836754 wait complete. 2024-09-17T03:45:23.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.785+0000 7fa0e4771640 1 Processor -- start 2024-09-17T03:45:23.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.785+0000 7fa0e4771640 1 -- start start 2024-09-17T03:45:23.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e4771640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0dc0b3b60 0x7fa0dc151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:23.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e4771640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc0b5750 0x7fa0dc1f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:23.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e4771640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0dc0b5ce0 0x7fa0dc14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:23.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e4771640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc15d480 con 0x7fa0dc0b5750 2024-09-17T03:45:23.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e4771640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc15d300 con 0x7fa0dc0b3b60 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e4771640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa0dc15d600 con 0x7fa0dc0b5ce0 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e1d0c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc0b5750 0x7fa0dc1f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e1d0c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc0b5750 0x7fa0dc1f9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34328/0 (socket says 172.21.15.146:34328) 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e1d0c640 1 -- 172.21.15.146:0/3107491688 learned_addr learned my addr 172.21.15.146:0/3107491688 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e250d640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0dc0b3b60 0x7fa0dc151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e2d0e640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0dc0b5ce0 0x7fa0dc14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e1d0c640 1 -- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0dc0b5ce0 msgr2=0x7fa0dc14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e1d0c640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0dc0b5ce0 0x7fa0dc14db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e1d0c640 1 -- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0dc0b3b60 msgr2=0x7fa0dc151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e1d0c640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0dc0b3b60 0x7fa0dc151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e1d0c640 1 -- 172.21.15.146:0/3107491688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc06ee10 con 0x7fa0dc0b5750 2024-09-17T03:45:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e250d640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0dc0b3b60 0x7fa0dc151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e2d0e640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0dc0b5ce0 0x7fa0dc14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0e1d0c640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc0b5750 0x7fa0dc1f9380 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00d6a0 tx=0x7fa0cc00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0d2ffd640 1 -- 172.21.15.146:0/3107491688 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc017070 con 0x7fa0dc0b5750 2024-09-17T03:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.787+0000 7fa0d2ffd640 1 -- 172.21.15.146:0/3107491688 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0cc004310 con 0x7fa0dc0b5750 2024-09-17T03:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.788+0000 7fa0e4771640 1 -- 172.21.15.146:0/3107491688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0dc06f0f0 con 0x7fa0dc0b5750 2024-09-17T03:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.788+0000 7fa0d2ffd640 1 -- 172.21.15.146:0/3107491688 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc009a80 con 0x7fa0dc0b5750 2024-09-17T03:45:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.788+0000 7fa0e4771640 1 -- 172.21.15.146:0/3107491688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0dc06f6b0 con 0x7fa0dc0b5750 2024-09-17T03:45:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.789+0000 7fa0e4771640 1 -- 172.21.15.146:0/3107491688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0dc15e760 con 0x7fa0dc0b5750 2024-09-17T03:45:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.789+0000 7fa0d2ffd640 1 -- 172.21.15.146:0/3107491688 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0cc009c20 con 0x7fa0dc0b5750 2024-09-17T03:45:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.790+0000 7fa0d2ffd640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa0c0078b90 0x7fa0c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.790+0000 7fa0d2ffd640 1 -- 172.21.15.146:0/3107491688 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5357+0+0 (secure 0 0 0) 0x7fa0cc09ab50 con 0x7fa0dc0b5750 2024-09-17T03:45:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.790+0000 7fa0e250d640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa0c0078b90 0x7fa0c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.791+0000 7fa0e250d640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa0c0078b90 0x7fa0c007b0a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8007fd0 tx=0x7fa0d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.795+0000 7fa0d2ffd640 1 -- 172.21.15.146:0/3107491688 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa0cc063210 con 0x7fa0dc0b5750 2024-09-17T03:45:23.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:23.968+0000 7fa0e4771640 1 -- 172.21.15.146:0/3107491688 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa0dc15dab0 con 0x7fa0dc0b5750 2024-09-17T03:45:24.649 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.649+0000 7fa0d2ffd640 1 -- 172.21.15.146:0/3107491688 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v179) ==== 169+0+0 (secure 0 0 0) 0x7fa0cc062b10 con 0x7fa0dc0b5750 2024-09-17T03:45:24.649 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:45:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.653+0000 7fa0e4771640 1 -- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa0c0078b90 msgr2=0x7fa0c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.653+0000 7fa0e4771640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa0c0078b90 0x7fa0c007b0a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8007fd0 tx=0x7fa0d8009040 comp rx=0 tx=0).stop 2024-09-17T03:45:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.653+0000 7fa0e4771640 1 -- 172.21.15.146:0/3107491688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc0b5750 msgr2=0x7fa0dc1f9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.653+0000 7fa0e4771640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc0b5750 0x7fa0dc1f9380 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00d6a0 tx=0x7fa0cc00db60 comp rx=0 tx=0).stop 2024-09-17T03:45:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.653+0000 7fa0e4771640 1 -- 172.21.15.146:0/3107491688 shutdown_connections 2024-09-17T03:45:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.653+0000 7fa0e4771640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa0c0078b90 0x7fa0c007b0a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.653+0000 7fa0e4771640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa0dc0b5ce0 0x7fa0dc14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.653+0000 7fa0e4771640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0dc0b5750 0x7fa0dc1f9380 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.653+0000 7fa0e4771640 1 --2- 172.21.15.146:0/3107491688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0dc0b3b60 0x7fa0dc151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.653+0000 7fa0e4771640 1 -- 172.21.15.146:0/3107491688 >> 172.21.15.146:0/3107491688 conn(0x7fa0dc0b7b20 msgr2=0x7fa0dc0d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:24.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.654+0000 7fa0e4771640 1 -- 172.21.15.146:0/3107491688 shutdown_connections 2024-09-17T03:45:24.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.654+0000 7fa0e4771640 1 -- 172.21.15.146:0/3107491688 wait complete. 2024-09-17T03:45:24.667 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.788+0000 7f4a7c54a640 1 -- 172.21.15.146:0/3719159037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a7415f1a0 msgr2=0x7f4a740cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.788+0000 7f4a7c54a640 1 --2- 172.21.15.146:0/3719159037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a7415f1a0 0x7f4a740cfca0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7f4a70005fd0 tx=0x7f4a7002aa10 comp rx=0 tx=0).stop 2024-09-17T03:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.788+0000 7f4a7c54a640 1 -- 172.21.15.146:0/3719159037 shutdown_connections 2024-09-17T03:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.788+0000 7f4a7c54a640 1 --2- 172.21.15.146:0/3719159037 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a740b61f0 0x7f4a740b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.788+0000 7f4a7c54a640 1 --2- 172.21.15.146:0/3719159037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a7415f1a0 0x7f4a740cfca0 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.788+0000 7f4a7c54a640 1 -- 172.21.15.146:0/3719159037 >> 172.21.15.146:0/3719159037 conn(0x7f4a740d11f0 msgr2=0x7f4a740d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.788+0000 7f4a7c54a640 1 -- 172.21.15.146:0/3719159037 shutdown_connections 2024-09-17T03:45:24.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.788+0000 7f4a7c54a640 1 -- 172.21.15.146:0/3719159037 wait complete. 2024-09-17T03:45:24.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.790+0000 7f4a7c54a640 1 Processor -- start 2024-09-17T03:45:24.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.790+0000 7f4a7c54a640 1 -- start start 2024-09-17T03:45:24.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7c54a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740b61f0 0x7f4a740cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:24.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7c54a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a7415f1a0 0x7f4a740cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7c54a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a741631a0 0x7f4a740b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7c54a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4a740695b0 con 0x7f4a740b61f0 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7c54a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74069430 con 0x7f4a7415f1a0 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7c54a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4a74069730 con 0x7f4a741631a0 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7a2e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740b61f0 0x7f4a740cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7a2e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740b61f0 0x7f4a740cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34358/0 (socket says 172.21.15.146:34358) 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7a2e6640 1 -- 172.21.15.146:0/2389880172 learned_addr learned my addr 172.21.15.146:0/2389880172 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a79ae5640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a7415f1a0 0x7f4a740cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7aae7640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a741631a0 0x7f4a740b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7a2e6640 1 -- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a741631a0 msgr2=0x7f4a740b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7a2e6640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a741631a0 0x7f4a740b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7a2e6640 1 -- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a7415f1a0 msgr2=0x7f4a740cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:24.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7a2e6640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a7415f1a0 0x7f4a740cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7a2e6640 1 -- 172.21.15.146:0/2389880172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a741f5b70 con 0x7f4a740b61f0 2024-09-17T03:45:24.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.791+0000 7f4a7aae7640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a741631a0 0x7f4a740b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:24.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.792+0000 7f4a7a2e6640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740b61f0 0x7f4a740cc230 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f4a70006010 tx=0x7f4a70003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:24.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.792+0000 7f4a6affd640 1 -- 172.21.15.146:0/2389880172 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70046070 con 0x7f4a740b61f0 2024-09-17T03:45:24.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.792+0000 7f4a6affd640 1 -- 172.21.15.146:0/2389880172 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a70004700 con 0x7f4a740b61f0 2024-09-17T03:45:24.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.792+0000 7f4a7c54a640 1 -- 172.21.15.146:0/2389880172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a741f5e50 con 0x7f4a740b61f0 2024-09-17T03:45:24.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.792+0000 7f4a6affd640 1 -- 172.21.15.146:0/2389880172 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70033070 con 0x7f4a740b61f0 2024-09-17T03:45:24.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.792+0000 7f4a7c54a640 1 -- 172.21.15.146:0/2389880172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a741f6410 con 0x7f4a740b61f0 2024-09-17T03:45:24.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.793+0000 7f4a7c54a640 1 -- 172.21.15.146:0/2389880172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a74069be0 con 0x7f4a740b61f0 2024-09-17T03:45:24.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.794+0000 7f4a6affd640 1 -- 172.21.15.146:0/2389880172 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a70049070 con 0x7f4a740b61f0 2024-09-17T03:45:24.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.794+0000 7f4a6affd640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a58078b90 0x7f4a5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:24.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.794+0000 7f4a6affd640 1 -- 172.21.15.146:0/2389880172 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f4a700bbbc0 con 0x7f4a740b61f0 2024-09-17T03:45:24.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.795+0000 7f4a79ae5640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a58078b90 0x7f4a5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:24.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.795+0000 7f4a79ae5640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a58078b90 0x7f4a5807b0a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4a740ba3f0 tx=0x7f4a64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:24.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.798+0000 7f4a6affd640 1 -- 172.21.15.146:0/2389880172 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a7003e070 con 0x7f4a740b61f0 2024-09-17T03:45:24.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.972+0000 7f4a7c54a640 1 -- 172.21.15.146:0/2389880172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f4a740c7ff0 con 0x7f4a740b61f0 2024-09-17T03:45:24.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.977+0000 7f4a6affd640 1 -- 172.21.15.146:0/2389880172 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v63) ==== 71+0+0 (secure 0 0 0) 0x7f4a70083d90 con 0x7f4a740b61f0 2024-09-17T03:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.979+0000 7f4a7c54a640 1 -- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a58078b90 msgr2=0x7f4a5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:24.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.979+0000 7f4a7c54a640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a58078b90 0x7f4a5807b0a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4a740ba3f0 tx=0x7f4a64009040 comp rx=0 tx=0).stop 2024-09-17T03:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.979+0000 7f4a7c54a640 1 -- 172.21.15.146:0/2389880172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740b61f0 msgr2=0x7f4a740cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.979+0000 7f4a7c54a640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740b61f0 0x7f4a740cc230 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f4a70006010 tx=0x7f4a70003f90 comp rx=0 tx=0).stop 2024-09-17T03:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.979+0000 7f4a7c54a640 1 -- 172.21.15.146:0/2389880172 shutdown_connections 2024-09-17T03:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.979+0000 7f4a7c54a640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4a58078b90 0x7f4a5807b0a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.979+0000 7f4a7c54a640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a741631a0 0x7f4a740b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.979+0000 7f4a7c54a640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a7415f1a0 0x7f4a740cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.979+0000 7f4a7c54a640 1 --2- 172.21.15.146:0/2389880172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740b61f0 0x7f4a740cc230 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.979+0000 7f4a7c54a640 1 -- 172.21.15.146:0/2389880172 >> 172.21.15.146:0/2389880172 conn(0x7f4a740d11f0 msgr2=0x7f4a74075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.980+0000 7f4a7c54a640 1 -- 172.21.15.146:0/2389880172 shutdown_connections 2024-09-17T03:45:24.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:24.980+0000 7f4a7c54a640 1 -- 172.21.15.146:0/2389880172 wait complete. 2024-09-17T03:45:24.990 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-17T03:45:25.105 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.106+0000 7f85c564d640 1 -- 172.21.15.146:0/1533929093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ac004800 msgr2=0x7f85ac004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.106+0000 7f85c564d640 1 --2- 172.21.15.146:0/1533929093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85ac004800 0x7f85ac004c10 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f85a8006f60 tx=0x7f85ac005830 comp rx=0 tx=0).stop 2024-09-17T03:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.106+0000 7f85bf7fe640 1 -- 172.21.15.146:0/1533929093 reap_dead start 2024-09-17T03:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.106+0000 7f85c564d640 1 -- 172.21.15.146:0/1533929093 shutdown_connections 2024-09-17T03:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.106+0000 7f85c564d640 1 -- 172.21.15.146:0/1533929093 >> 172.21.15.146:0/1533929093 conn(0x7f85c00b3410 msgr2=0x7f85c00b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.106+0000 7f85c564d640 1 -- 172.21.15.146:0/1533929093 shutdown_connections 2024-09-17T03:45:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.106+0000 7f85c564d640 1 -- 172.21.15.146:0/1533929093 wait complete. 2024-09-17T03:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.108+0000 7f85c564d640 1 Processor -- start 2024-09-17T03:45:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.108+0000 7f85c564d640 1 -- start start 2024-09-17T03:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.109+0000 7f85c564d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85c0146890 0x7f85c014f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.109+0000 7f85c564d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85c014fd90 0x7f85c01f8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.109+0000 7f85c564d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85c01f9020 0x7f85c006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.109+0000 7f85c564d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f85c00b5c10 con 0x7f85c014fd90 2024-09-17T03:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.109+0000 7f85c564d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f85c006e680 con 0x7f85c01f9020 2024-09-17T03:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.109+0000 7f85c564d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f85c00b4940 con 0x7f85c0146890 2024-09-17T03:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.109+0000 7f85b67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85c014fd90 0x7f85c01f8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.109+0000 7f85b67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85c014fd90 0x7f85c01f8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34374/0 (socket says 172.21.15.146:34374) 2024-09-17T03:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.109+0000 7f85b67fc640 1 -- 172.21.15.146:0/2639131878 learned_addr learned my addr 172.21.15.146:0/2639131878 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:25.110 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85beffd640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85c0146890 0x7f85c014f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85bf7fe640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85c01f9020 0x7f85c006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85b67fc640 1 -- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85c0146890 msgr2=0x7f85c014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85b67fc640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85c0146890 0x7f85c014f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85b67fc640 1 -- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85c01f9020 msgr2=0x7f85c006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85b67fc640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85c01f9020 0x7f85c006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85b67fc640 1 -- 172.21.15.146:0/2639131878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c0150540 con 0x7f85c014fd90 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85b67fc640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85c014fd90 0x7f85c01f8ae0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f85a802b050 tx=0x7f85a8006cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85b7fff640 1 -- 172.21.15.146:0/2639131878 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8031070 con 0x7f85c014fd90 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85b7fff640 1 -- 172.21.15.146:0/2639131878 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85a80036d0 con 0x7f85c014fd90 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85c564d640 1 -- 172.21.15.146:0/2639131878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c01f9930 con 0x7f85c014fd90 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85b7fff640 1 -- 172.21.15.146:0/2639131878 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8003ac0 con 0x7f85c014fd90 2024-09-17T03:45:25.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.110+0000 7f85c564d640 1 -- 172.21.15.146:0/2639131878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c0145db0 con 0x7f85c014fd90 2024-09-17T03:45:25.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.111+0000 7f85c564d640 1 -- 172.21.15.146:0/2639131878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c00764c0 con 0x7f85c014fd90 2024-09-17T03:45:25.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.112+0000 7f85b7fff640 1 -- 172.21.15.146:0/2639131878 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f85a8034070 con 0x7f85c014fd90 2024-09-17T03:45:25.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.112+0000 7f85b7fff640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85a0078b90 0x7f85a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:25.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.112+0000 7f85b7fff640 1 -- 172.21.15.146:0/2639131878 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f85a80bab40 con 0x7f85c014fd90 2024-09-17T03:45:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.113+0000 7f85beffd640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85a0078b90 0x7f85a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.113+0000 7f85beffd640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85a0078b90 0x7f85a007b0a0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f85c01538b0 tx=0x7f85b0006d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.117+0000 7f85b7fff640 1 -- 172.21.15.146:0/2639131878 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f85c00764c0 con 0x7f85c014fd90 2024-09-17T03:45:25.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.357+0000 7f85c564d640 1 -- 172.21.15.146:0/2639131878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f85c00b1520 con 0x7f85c014fd90 2024-09-17T03:45:25.650 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.651+0000 7f85b7fff640 1 -- 172.21.15.146:0/2639131878 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v598) ==== 140+0+0 (secure 0 0 0) 0x7f85a8082cd0 con 0x7f85c014fd90 2024-09-17T03:45:25.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 -- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85a0078b90 msgr2=0x7f85a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:25.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85a0078b90 0x7f85a007b0a0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f85c01538b0 tx=0x7f85b0006d60 comp rx=0 tx=0).stop 2024-09-17T03:45:25.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 -- 172.21.15.146:0/2639131878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85c014fd90 msgr2=0x7f85c01f8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:25.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85c014fd90 0x7f85c01f8ae0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f85a802b050 tx=0x7f85a8006cd0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 -- 172.21.15.146:0/2639131878 shutdown_connections 2024-09-17T03:45:25.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85a0078b90 0x7f85a007b0a0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85c01f9020 0x7f85c006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85c014fd90 0x7f85c01f8ae0 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 --2- 172.21.15.146:0/2639131878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f85c0146890 0x7f85c014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 -- 172.21.15.146:0/2639131878 >> 172.21.15.146:0/2639131878 conn(0x7f85c00b3410 msgr2=0x7f85c0151f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:25.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 -- 172.21.15.146:0/2639131878 shutdown_connections 2024-09-17T03:45:25.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.654+0000 7f85c564d640 1 -- 172.21.15.146:0/2639131878 wait complete. 2024-09-17T03:45:25.665 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-17T03:45:25.665 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-17T03:45:25.666 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:45:25.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.780+0000 7f6318bda640 1 -- 172.21.15.146:0/472118241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63140b3d30 msgr2=0x7f63141677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:25.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.780+0000 7f6318bda640 1 --2- 172.21.15.146:0/472118241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63140b3d30 0x7f63141677c0 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f630c005fd0 tx=0x7f630c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.780+0000 7f6318bda640 1 -- 172.21.15.146:0/472118241 shutdown_connections 2024-09-17T03:45:25.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.780+0000 7f6318bda640 1 --2- 172.21.15.146:0/472118241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63140b3d30 0x7f63141677c0 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.780+0000 7f6318bda640 1 -- 172.21.15.146:0/472118241 >> 172.21.15.146:0/472118241 conn(0x7f63140b7b20 msgr2=0x7f631409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:25.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.781+0000 7f6318bda640 1 -- 172.21.15.146:0/472118241 shutdown_connections 2024-09-17T03:45:25.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.781+0000 7f6318bda640 1 -- 172.21.15.146:0/472118241 wait complete. 2024-09-17T03:45:25.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.783+0000 7f6318bda640 1 Processor -- start 2024-09-17T03:45:25.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.783+0000 7f6318bda640 1 -- start start 2024-09-17T03:45:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6318bda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63140b5750 0x7f631414cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6318bda640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63140b5ce0 0x7f6314154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6318bda640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631414f150 0x7f631414c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:25.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6318bda640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6314167f10 con 0x7f631414f150 2024-09-17T03:45:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6318bda640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f631415ddb0 con 0x7f63140b5750 2024-09-17T03:45:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6318bda640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6314168090 con 0x7f63140b5ce0 2024-09-17T03:45:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6312d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631414f150 0x7f631414c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6312d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631414f150 0x7f631414c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34400/0 (socket says 172.21.15.146:34400) 2024-09-17T03:45:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6312d9d640 1 -- 172.21.15.146:0/3827005192 learned_addr learned my addr 172.21.15.146:0/3827005192 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f631259c640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63140b5750 0x7f631414cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6309d9b640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63140b5ce0 0x7f6314154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6312d9d640 1 -- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63140b5ce0 msgr2=0x7f6314154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6312d9d640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63140b5ce0 0x7f6314154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6312d9d640 1 -- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63140b5750 msgr2=0x7f631414cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6312d9d640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63140b5750 0x7f631414cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6312d9d640 1 -- 172.21.15.146:0/3827005192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631414c990 con 0x7f631414f150 2024-09-17T03:45:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.784+0000 7f6309d9b640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63140b5ce0 0x7f6314154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.785+0000 7f6312d9d640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631414f150 0x7f631414c450 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f630c02aea0 tx=0x7f630c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.785+0000 7f630b7fe640 1 -- 172.21.15.146:0/3827005192 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c031ba0 con 0x7f631414f150 2024-09-17T03:45:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.785+0000 7f630b7fe640 1 -- 172.21.15.146:0/3827005192 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f630c031e30 con 0x7f631414f150 2024-09-17T03:45:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.785+0000 7f630b7fe640 1 -- 172.21.15.146:0/3827005192 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c033310 con 0x7f631414f150 2024-09-17T03:45:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.785+0000 7f6318bda640 1 -- 172.21.15.146:0/3827005192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631414d430 con 0x7f631414f150 2024-09-17T03:45:25.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.785+0000 7f6318bda640 1 -- 172.21.15.146:0/3827005192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f631414d9f0 con 0x7f631414f150 2024-09-17T03:45:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.786+0000 7f6318bda640 1 -- 172.21.15.146:0/3827005192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63140b1320 con 0x7f631414f150 2024-09-17T03:45:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.787+0000 7f630b7fe640 1 -- 172.21.15.146:0/3827005192 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f630c0334b0 con 0x7f631414f150 2024-09-17T03:45:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.787+0000 7f630b7fe640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62f4078b90 0x7f62f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.787+0000 7f630b7fe640 1 -- 172.21.15.146:0/3827005192 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f630c0bbff0 con 0x7f631414f150 2024-09-17T03:45:25.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.787+0000 7f631259c640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62f4078b90 0x7f62f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:25.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.788+0000 7f631259c640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62f4078b90 0x7f62f407b0a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6304000f60 tx=0x7f6304009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:25.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.792+0000 7f630b7fe640 1 -- 172.21.15.146:0/3827005192 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f630c03f030 con 0x7f631414f150 2024-09-17T03:45:25.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.965+0000 7f6318bda640 1 -- 172.21.15.146:0/3827005192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f631415a0a0 con 0x7f631414f150 2024-09-17T03:45:25.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.966+0000 7f630b7fe640 1 -- 172.21.15.146:0/3827005192 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) ==== 74+0+13092 (secure 0 0 0) 0x7f630c084730 con 0x7f631414f150 2024-09-17T03:45:25.965 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:25.965 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":179,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:45:24.644778+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/2269642448":"2024-09-18T03:45:21.392734+0000","172.21.15.146:6832/2269642448":"2024-09-18T03:45:21.392734+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:45:25.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 -- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62f4078b90 msgr2=0x7f62f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62f4078b90 0x7f62f407b0a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6304000f60 tx=0x7f6304009040 comp rx=0 tx=0).stop 2024-09-17T03:45:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 -- 172.21.15.146:0/3827005192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631414f150 msgr2=0x7f631414c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631414f150 0x7f631414c450 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f630c02aea0 tx=0x7f630c003c20 comp rx=0 tx=0).stop 2024-09-17T03:45:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 -- 172.21.15.146:0/3827005192 shutdown_connections 2024-09-17T03:45:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62f4078b90 0x7f62f407b0a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f631414f150 0x7f631414c450 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f63140b5ce0 0x7f6314154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 --2- 172.21.15.146:0/3827005192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f63140b5750 0x7f631414cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 -- 172.21.15.146:0/3827005192 >> 172.21.15.146:0/3827005192 conn(0x7f63140b7b20 msgr2=0x7f63140d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 -- 172.21.15.146:0/3827005192 shutdown_connections 2024-09-17T03:45:25.968 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:25.968+0000 7f6318bda640 1 -- 172.21.15.146:0/3827005192 wait complete. 2024-09-17T03:45:25.980 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:45:25.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:45:26.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.098+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2184278824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45d015f1a0 msgr2=0x7f45d00cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:26.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.098+0000 7f45d4ecc640 1 --2- 172.21.15.146:0/2184278824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45d015f1a0 0x7f45d00cfca0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f45c0009830 tx=0x7f45c002a480 comp rx=0 tx=0).stop 2024-09-17T03:45:26.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.098+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2184278824 shutdown_connections 2024-09-17T03:45:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.098+0000 7f45d4ecc640 1 --2- 172.21.15.146:0/2184278824 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45d01631a0 0x7f45d00cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.098+0000 7f45d4ecc640 1 --2- 172.21.15.146:0/2184278824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45d015f1a0 0x7f45d00cfca0 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.098+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2184278824 >> 172.21.15.146:0/2184278824 conn(0x7f45d00d11f0 msgr2=0x7f45d00d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.098+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2184278824 shutdown_connections 2024-09-17T03:45:26.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.098+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2184278824 wait complete. 2024-09-17T03:45:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.100+0000 7f45d4ecc640 1 Processor -- start 2024-09-17T03:45:26.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.100+0000 7f45d4ecc640 1 -- start start 2024-09-17T03:45:26.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.101+0000 7f45d4ecc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45d00b61f0 0x7f45d00ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:26.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.101+0000 7f45d4ecc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45d015f1a0 0x7f45d00caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:26.101 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.101+0000 7f45d4ecc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45d01631a0 0x7f45d015b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.101+0000 7f45d4ecc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f45d00695b0 con 0x7f45d00b61f0 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.101+0000 7f45d4ecc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0069430 con 0x7f45d015f1a0 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.101+0000 7f45d4ecc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f45d0069730 con 0x7f45d01631a0 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.101+0000 7f45ce59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45d00b61f0 0x7f45d00ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.101+0000 7f45ce59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45d00b61f0 0x7f45d00ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34426/0 (socket says 172.21.15.146:34426) 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.101+0000 7f45ce59c640 1 -- 172.21.15.146:0/2299978883 learned_addr learned my addr 172.21.15.146:0/2299978883 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.101+0000 7f45cdd9b640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45d015f1a0 0x7f45d00caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.101+0000 7f45ced9d640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45d01631a0 0x7f45d015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.102+0000 7f45ce59c640 1 -- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45d01631a0 msgr2=0x7f45d015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.102+0000 7f45ce59c640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45d01631a0 0x7f45d015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.102+0000 7f45ce59c640 1 -- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45d015f1a0 msgr2=0x7f45d00caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.102+0000 7f45ce59c640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45d015f1a0 0x7f45d00caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.102+0000 7f45ce59c640 1 -- 172.21.15.146:0/2299978883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d00c8cc0 con 0x7f45d00b61f0 2024-09-17T03:45:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.102+0000 7f45ce59c640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45d00b61f0 0x7f45d00ca590 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f45c002aa70 tx=0x7f45c0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.102+0000 7f45beffd640 1 -- 172.21.15.146:0/2299978883 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0031d60 con 0x7f45d00b61f0 2024-09-17T03:45:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.102+0000 7f45beffd640 1 -- 172.21.15.146:0/2299978883 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45c0033e10 con 0x7f45d00b61f0 2024-09-17T03:45:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.102+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2299978883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d00c8fa0 con 0x7f45d00b61f0 2024-09-17T03:45:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.102+0000 7f45beffd640 1 -- 172.21.15.146:0/2299978883 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0005260 con 0x7f45d00b61f0 2024-09-17T03:45:26.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.102+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2299978883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d00c9560 con 0x7f45d00b61f0 2024-09-17T03:45:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.103+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2299978883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d0069be0 con 0x7f45d00b61f0 2024-09-17T03:45:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.104+0000 7f45beffd640 1 -- 172.21.15.146:0/2299978883 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f45c0005400 con 0x7f45d00b61f0 2024-09-17T03:45:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.104+0000 7f45beffd640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f45b0078b90 0x7f45b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.104+0000 7f45beffd640 1 -- 172.21.15.146:0/2299978883 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f45c00bbce0 con 0x7f45d00b61f0 2024-09-17T03:45:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.105+0000 7f45cdd9b640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f45b0078b90 0x7f45b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:26.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.105+0000 7f45cdd9b640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f45b0078b90 0x7f45b007b0a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f45c4005d70 tx=0x7f45c4005d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:26.108 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.109+0000 7f45beffd640 1 -- 172.21.15.146:0/2299978883 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f45c003f030 con 0x7f45d00b61f0 2024-09-17T03:45:26.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.282+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2299978883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f45d00c7ff0 con 0x7f45d00b61f0 2024-09-17T03:45:26.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.282+0000 7f45beffd640 1 -- 172.21.15.146:0/2299978883 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v179) ==== 93+0+10 (secure 0 0 0) 0x7f45c0084420 con 0x7f45d00b61f0 2024-09-17T03:45:26.281 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:45:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.284+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f45b0078b90 msgr2=0x7f45b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.284+0000 7f45d4ecc640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f45b0078b90 0x7f45b007b0a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f45c4005d70 tx=0x7f45c4005d00 comp rx=0 tx=0).stop 2024-09-17T03:45:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.284+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2299978883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45d00b61f0 msgr2=0x7f45d00ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.284+0000 7f45d4ecc640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45d00b61f0 0x7f45d00ca590 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f45c002aa70 tx=0x7f45c0033c20 comp rx=0 tx=0).stop 2024-09-17T03:45:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.284+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2299978883 shutdown_connections 2024-09-17T03:45:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.284+0000 7f45d4ecc640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f45b0078b90 0x7f45b007b0a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.284+0000 7f45d4ecc640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45d01631a0 0x7f45d015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.284+0000 7f45d4ecc640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45d015f1a0 0x7f45d00caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.284+0000 7f45d4ecc640 1 --2- 172.21.15.146:0/2299978883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45d00b61f0 0x7f45d00ca590 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.284+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2299978883 >> 172.21.15.146:0/2299978883 conn(0x7f45d00d11f0 msgr2=0x7f45d00b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:26.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.284+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2299978883 shutdown_connections 2024-09-17T03:45:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.285+0000 7f45d4ecc640 1 -- 172.21.15.146:0/2299978883 wait complete. 2024-09-17T03:45:26.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-17T03:45:26.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.411+0000 7f986a2f2640 1 -- 172.21.15.146:0/2834647848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986415b770 msgr2=0x7f986406fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:26.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.411+0000 7f986a2f2640 1 --2- 172.21.15.146:0/2834647848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986415b770 0x7f986406fe10 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f98640cfe20 tx=0x7f985402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.411+0000 7f986a2f2640 1 -- 172.21.15.146:0/2834647848 shutdown_connections 2024-09-17T03:45:26.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.411+0000 7f986a2f2640 1 --2- 172.21.15.146:0/2834647848 >> v2:172.21.15.179:3300/0 conn(0x7f9864072d90 0x7f98640b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.411+0000 7f986a2f2640 1 --2- 172.21.15.146:0/2834647848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986415b770 0x7f986406fe10 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.411+0000 7f986a2f2640 1 -- 172.21.15.146:0/2834647848 >> 172.21.15.146:0/2834647848 conn(0x7f98640b2060 msgr2=0x7f98640b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:26.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.411+0000 7f986a2f2640 1 -- 172.21.15.146:0/2834647848 shutdown_connections 2024-09-17T03:45:26.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.411+0000 7f986a2f2640 1 -- 172.21.15.146:0/2834647848 wait complete. 2024-09-17T03:45:26.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.413+0000 7f986a2f2640 1 Processor -- start 2024-09-17T03:45:26.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.413+0000 7f986a2f2640 1 -- start start 2024-09-17T03:45:26.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f986a2f2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9864070350 0x7f9864159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:26.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f986a2f2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986415b770 0x7f98640ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:26.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f986a2f2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98641428c0 0x7f98640aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:26.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f986a2f2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f98640b4db0 con 0x7f986415b770 2024-09-17T03:45:26.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f986a2f2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f98640b4c30 con 0x7f9864070350 2024-09-17T03:45:26.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f986a2f2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f98640b4f30 con 0x7f98641428c0 2024-09-17T03:45:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f98637fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986415b770 0x7f98640ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f98637fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986415b770 0x7f98640ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34444/0 (socket says 172.21.15.146:34444) 2024-09-17T03:45:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f98637fe640 1 -- 172.21.15.146:0/4121070654 learned_addr learned my addr 172.21.15.146:0/4121070654 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f9863fff640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9864070350 0x7f9864159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f986888f640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98641428c0 0x7f98640aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f98637fe640 1 -- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98641428c0 msgr2=0x7f98640aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f98637fe640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98641428c0 0x7f98640aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f98637fe640 1 -- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9864070350 msgr2=0x7f9864159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f98637fe640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9864070350 0x7f9864159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:26.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f98637fe640 1 -- 172.21.15.146:0/4121070654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9864144e00 con 0x7f986415b770 2024-09-17T03:45:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.414+0000 7f986888f640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98641428c0 0x7f98640aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.415+0000 7f98637fe640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986415b770 0x7f98640ae890 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f985800c3c0 tx=0x7f985800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.415+0000 7f9860ff9640 1 -- 172.21.15.146:0/4121070654 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858017070 con 0x7f986415b770 2024-09-17T03:45:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.415+0000 7f9860ff9640 1 -- 172.21.15.146:0/4121070654 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98580035f0 con 0x7f986415b770 2024-09-17T03:45:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.415+0000 7f986a2f2640 1 -- 172.21.15.146:0/4121070654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9864145250 con 0x7f986415b770 2024-09-17T03:45:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.415+0000 7f9860ff9640 1 -- 172.21.15.146:0/4121070654 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858003ac0 con 0x7f986415b770 2024-09-17T03:45:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.415+0000 7f986a2f2640 1 -- 172.21.15.146:0/4121070654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9864145810 con 0x7f986415b770 2024-09-17T03:45:26.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.416+0000 7f986a2f2640 1 -- 172.21.15.146:0/4121070654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98640b54c0 con 0x7f986415b770 2024-09-17T03:45:26.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.417+0000 7f9860ff9640 1 -- 172.21.15.146:0/4121070654 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f985801a070 con 0x7f986415b770 2024-09-17T03:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.417+0000 7f9860ff9640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9850078b90 0x7f985007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.417+0000 7f9860ff9640 1 -- 172.21.15.146:0/4121070654 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f9858099b40 con 0x7f986415b770 2024-09-17T03:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.418+0000 7f9863fff640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9850078b90 0x7f985007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:26.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.418+0000 7f9863fff640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9850078b90 0x7f985007b0a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9854034000 tx=0x7f9854004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:26.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.422+0000 7f9860ff9640 1 -- 172.21.15.146:0/4121070654 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9864144e00 con 0x7f986415b770 2024-09-17T03:45:26.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:26.667+0000 7f986a2f2640 1 -- 172.21.15.146:0/4121070654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f9864157810 con 0x7f986415b770 2024-09-17T03:45:27.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.660+0000 7f9860ff9640 1 -- 172.21.15.146:0/4121070654 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v600) ==== 136+0+0 (secure 0 0 0) 0x7f986415bb80 con 0x7f986415b770 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.663+0000 7f986a2f2640 1 -- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9850078b90 msgr2=0x7f985007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.663+0000 7f986a2f2640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9850078b90 0x7f985007b0a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9854034000 tx=0x7f9854004730 comp rx=0 tx=0).stop 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.663+0000 7f986a2f2640 1 -- 172.21.15.146:0/4121070654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986415b770 msgr2=0x7f98640ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.663+0000 7f986a2f2640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986415b770 0x7f98640ae890 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f985800c3c0 tx=0x7f985800c880 comp rx=0 tx=0).stop 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.663+0000 7f986a2f2640 1 -- 172.21.15.146:0/4121070654 shutdown_connections 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.663+0000 7f986a2f2640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9850078b90 0x7f985007b0a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.663+0000 7f986a2f2640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f98641428c0 0x7f98640aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.663+0000 7f986a2f2640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f986415b770 0x7f98640ae890 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.663+0000 7f986a2f2640 1 --2- 172.21.15.146:0/4121070654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9864070350 0x7f9864159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.664+0000 7f986a2f2640 1 -- 172.21.15.146:0/4121070654 >> 172.21.15.146:0/4121070654 conn(0x7f98640b2060 msgr2=0x7f9864072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.664+0000 7f986a2f2640 1 -- 172.21.15.146:0/4121070654 shutdown_connections 2024-09-17T03:45:27.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.664+0000 7f986a2f2640 1 -- 172.21.15.146:0/4121070654 wait complete. 2024-09-17T03:45:27.677 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:45:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.797+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3764536787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815eaf0 msgr2=0x7f9fa806fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.797+0000 7f9faf6d3640 1 --2- 172.21.15.146:0/3764536787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815eaf0 0x7f9fa806fdc0 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4005fd0 tx=0x7f9fa402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.797+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3764536787 shutdown_connections 2024-09-17T03:45:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.797+0000 7f9faf6d3640 1 --2- 172.21.15.146:0/3764536787 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa80b6220 0x7f9fa80734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.797+0000 7f9faf6d3640 1 --2- 172.21.15.146:0/3764536787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815eaf0 0x7f9fa806fdc0 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.797+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3764536787 >> 172.21.15.146:0/3764536787 conn(0x7f9fa80b3410 msgr2=0x7f9fa80b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.797+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3764536787 shutdown_connections 2024-09-17T03:45:27.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.797+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3764536787 wait complete. 2024-09-17T03:45:27.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.799+0000 7f9faf6d3640 1 Processor -- start 2024-09-17T03:45:27.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.799+0000 7f9faf6d3640 1 -- start start 2024-09-17T03:45:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.800+0000 7f9faf6d3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8073a30 0x7f9fa80afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.800+0000 7f9faf6d3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa80b6220 0x7f9fa8146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.800+0000 7f9faf6d3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815eaf0 0x7f9fa80b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.800+0000 7f9faf6d3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa80b67b0 con 0x7f9fa815eaf0 2024-09-17T03:45:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.800+0000 7f9faf6d3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa80b6630 con 0x7f9fa8073a30 2024-09-17T03:45:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.800+0000 7f9faf6d3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa806d360 con 0x7f9fa80b6220 2024-09-17T03:45:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.800+0000 7f9fadc70640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815eaf0 0x7f9fa80b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9fadc70640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815eaf0 0x7f9fa80b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48726/0 (socket says 172.21.15.146:48726) 2024-09-17T03:45:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9fadc70640 1 -- 172.21.15.146:0/3316856421 learned_addr learned my addr 172.21.15.146:0/3316856421 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9fad46f640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8073a30 0x7f9fa80afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:27.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9facc6e640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa80b6220 0x7f9fa8146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9fadc70640 1 -- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa80b6220 msgr2=0x7f9fa8146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9fadc70640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa80b6220 0x7f9fa8146de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9fadc70640 1 -- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8073a30 msgr2=0x7f9fa80afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9fadc70640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8073a30 0x7f9fa80afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9fadc70640 1 -- 172.21.15.146:0/3316856421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa80aec30 con 0x7f9fa815eaf0 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9fad46f640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8073a30 0x7f9fa80afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9fadc70640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815eaf0 0x7f9fa80b04f0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000c730 tx=0x7f9fa000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9f9dffb640 1 -- 172.21.15.146:0/3316856421 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0003b70 con 0x7f9fa815eaf0 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9f9dffb640 1 -- 172.21.15.146:0/3316856421 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fa0003d10 con 0x7f9fa815eaf0 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3316856421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa80aef10 con 0x7f9fa815eaf0 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9f9dffb640 1 -- 172.21.15.146:0/3316856421 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0005330 con 0x7f9fa815eaf0 2024-09-17T03:45:27.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.801+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3316856421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa80af7b0 con 0x7f9fa815eaf0 2024-09-17T03:45:27.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.802+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3316856421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa806dbd0 con 0x7f9fa815eaf0 2024-09-17T03:45:27.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.803+0000 7f9f9dffb640 1 -- 172.21.15.146:0/3316856421 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9fa00054d0 con 0x7f9fa815eaf0 2024-09-17T03:45:27.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.804+0000 7f9f9dffb640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f8c078b90 0x7f9f8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:27.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.804+0000 7f9f9dffb640 1 -- 172.21.15.146:0/3316856421 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f9fa009a7f0 con 0x7f9fa815eaf0 2024-09-17T03:45:27.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.804+0000 7f9fad46f640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f8c078b90 0x7f9f8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:27.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.804+0000 7f9fad46f640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f8c078b90 0x7f9f8c07b0a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4033000 tx=0x7f9fa4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:27.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.808+0000 7f9f9dffb640 1 -- 172.21.15.146:0/3316856421 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9fa8073e40 con 0x7f9fa815eaf0 2024-09-17T03:45:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.986+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3316856421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f9fa8050ff0 con 0x7f9fa815eaf0 2024-09-17T03:45:27.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.987+0000 7f9f9dffb640 1 -- 172.21.15.146:0/3316856421 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v63) ==== 59+0+2294 (secure 0 0 0) 0x7f9fa0062f30 con 0x7f9fa815eaf0 2024-09-17T03:45:27.986 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:45:27.986 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:45:27.986 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:45:27.986 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:45:27.986 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:45:27.987 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:45:27.988 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:45:27.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f8c078b90 msgr2=0x7f9f8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:27.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f8c078b90 0x7f9f8c07b0a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4033000 tx=0x7f9fa4004730 comp rx=0 tx=0).stop 2024-09-17T03:45:27.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3316856421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815eaf0 msgr2=0x7f9fa80b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815eaf0 0x7f9fa80b04f0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000c730 tx=0x7f9fa000cb30 comp rx=0 tx=0).stop 2024-09-17T03:45:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3316856421 shutdown_connections 2024-09-17T03:45:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9f8c078b90 0x7f9f8c07b0a0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815eaf0 0x7f9fa80b04f0 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9fa80b6220 0x7f9fa8146de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 --2- 172.21.15.146:0/3316856421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9fa8073a30 0x7f9fa80afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3316856421 >> 172.21.15.146:0/3316856421 conn(0x7f9fa80b3410 msgr2=0x7f9fa815c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3316856421 shutdown_connections 2024-09-17T03:45:27.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:27.989+0000 7f9faf6d3640 1 -- 172.21.15.146:0/3316856421 wait complete. 2024-09-17T03:45:28.000 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:45:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.117+0000 7fd9d6d90640 1 -- 172.21.15.146:0/2429304316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d01631a0 msgr2=0x7fd9d00cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:28.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.117+0000 7fd9d6d90640 1 --2- 172.21.15.146:0/2429304316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d01631a0 0x7fd9d00cef40 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4005fd0 tx=0x7fd9c402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.117+0000 7fd9d6d90640 1 -- 172.21.15.146:0/2429304316 shutdown_connections 2024-09-17T03:45:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.117+0000 7fd9d6d90640 1 --2- 172.21.15.146:0/2429304316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d01631a0 0x7fd9d00cef40 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.117+0000 7fd9d6d90640 1 --2- 172.21.15.146:0/2429304316 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015f1a0 0x7fd9d00cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.117+0000 7fd9d6d90640 1 -- 172.21.15.146:0/2429304316 >> 172.21.15.146:0/2429304316 conn(0x7fd9d00d11f0 msgr2=0x7fd9d00d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.117+0000 7fd9d6d90640 1 -- 172.21.15.146:0/2429304316 shutdown_connections 2024-09-17T03:45:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.117+0000 7fd9d6d90640 1 -- 172.21.15.146:0/2429304316 wait complete. 2024-09-17T03:45:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.118+0000 7fd9d6d90640 1 Processor -- start 2024-09-17T03:45:28.118 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.118+0000 7fd9d6d90640 1 -- start start 2024-09-17T03:45:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d6d90640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d00b61f0 0x7fd9d01f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d6d90640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015f1a0 0x7fd9d0148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d6d90640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d01631a0 0x7fd9d01487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d6d90640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d00695f0 con 0x7fd9d01631a0 2024-09-17T03:45:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d6d90640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0069470 con 0x7fd9d00b61f0 2024-09-17T03:45:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d6d90640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d0069770 con 0x7fd9d015f1a0 2024-09-17T03:45:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d532d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d01631a0 0x7fd9d01487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d532d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d01631a0 0x7fd9d01487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48738/0 (socket says 172.21.15.146:48738) 2024-09-17T03:45:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d532d640 1 -- 172.21.15.146:0/1910732528 learned_addr learned my addr 172.21.15.146:0/1910732528 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9cffff640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015f1a0 0x7fd9d0148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d4b2c640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d00b61f0 0x7fd9d01f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d532d640 1 -- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015f1a0 msgr2=0x7fd9d0148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d532d640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015f1a0 0x7fd9d0148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d532d640 1 -- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d00b61f0 msgr2=0x7fd9d01f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d532d640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d00b61f0 0x7fd9d01f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.120+0000 7fd9d532d640 1 -- 172.21.15.146:0/1910732528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d01f99b0 con 0x7fd9d01631a0 2024-09-17T03:45:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.121+0000 7fd9d532d640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d01631a0 0x7fd9d01487a0 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800b970 tx=0x7fd9c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.121+0000 7fd9cd7fa640 1 -- 172.21.15.146:0/1910732528 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8019070 con 0x7fd9d01631a0 2024-09-17T03:45:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.121+0000 7fd9cd7fa640 1 -- 172.21.15.146:0/1910732528 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9c800cc30 con 0x7fd9d01631a0 2024-09-17T03:45:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.121+0000 7fd9d6d90640 1 -- 172.21.15.146:0/1910732528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d01f9c90 con 0x7fd9d01631a0 2024-09-17T03:45:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.121+0000 7fd9cd7fa640 1 -- 172.21.15.146:0/1910732528 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80146a0 con 0x7fd9d01631a0 2024-09-17T03:45:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.121+0000 7fd9d6d90640 1 -- 172.21.15.146:0/1910732528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d01fa250 con 0x7fd9d01631a0 2024-09-17T03:45:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.122+0000 7fd9d6d90640 1 -- 172.21.15.146:0/1910732528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d0069c20 con 0x7fd9d01631a0 2024-09-17T03:45:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.122+0000 7fd9cd7fa640 1 -- 172.21.15.146:0/1910732528 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9c801c070 con 0x7fd9d01631a0 2024-09-17T03:45:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.123+0000 7fd9cd7fa640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078b90 0x7fd9bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.123+0000 7fd9cd7fa640 1 -- 172.21.15.146:0/1910732528 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7fd9c809a790 con 0x7fd9d01631a0 2024-09-17T03:45:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.123+0000 7fd9d4b2c640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078b90 0x7fd9bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:28.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.124+0000 7fd9d4b2c640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078b90 0x7fd9bc07b0a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00058c0 tx=0x7fd9c0005f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.128+0000 7fd9cd7fa640 1 -- 172.21.15.146:0/1910732528 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9c8062880 con 0x7fd9d01631a0 2024-09-17T03:45:28.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.305+0000 7fd9d6d90640 1 -- 172.21.15.146:0/1910732528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd9d00d2a10 con 0x7fd9d01631a0 2024-09-17T03:45:28.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.309+0000 7fd9cd7fa640 1 -- 172.21.15.146:0/1910732528 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) ==== 122+0+0 (secure 0 0 0) 0x7fd9c80672b0 con 0x7fd9d01631a0 2024-09-17T03:45:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 -- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078b90 msgr2=0x7fd9bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078b90 0x7fd9bc07b0a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00058c0 tx=0x7fd9c0005f60 comp rx=0 tx=0).stop 2024-09-17T03:45:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 -- 172.21.15.146:0/1910732528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d01631a0 msgr2=0x7fd9d01487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d01631a0 0x7fd9d01487a0 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800b970 tx=0x7fd9c800be30 comp rx=0 tx=0).stop 2024-09-17T03:45:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 -- 172.21.15.146:0/1910732528 shutdown_connections 2024-09-17T03:45:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd9bc078b90 0x7fd9bc07b0a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d01631a0 0x7fd9d01487a0 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd9d015f1a0 0x7fd9d0148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 --2- 172.21.15.146:0/1910732528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd9d00b61f0 0x7fd9d01f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 -- 172.21.15.146:0/1910732528 >> 172.21.15.146:0/1910732528 conn(0x7fd9d00d11f0 msgr2=0x7fd9d00b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 -- 172.21.15.146:0/1910732528 shutdown_connections 2024-09-17T03:45:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.311+0000 7fd9d6d90640 1 -- 172.21.15.146:0/1910732528 wait complete. 2024-09-17T03:45:28.322 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:45:28.322 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:45:28.360 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:45:28.406 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:45:28.406 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:45:28.406 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:45:28.422 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:45:28.422 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:45:28.422 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:45:28.441 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:45:28.441 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:45:28.441 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:45:28.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:45:28.479 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:45:28.479 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:45:28.499 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:45:28.499 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:45:28.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:45:28.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.634+0000 7fbd403a8640 1 -- 172.21.15.146:0/117963877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd380b3b60 msgr2=0x7fbd380b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:28.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.634+0000 7fbd403a8640 1 --2- 172.21.15.146:0/117963877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd380b3b60 0x7fbd380b20a0 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7fbd380b5390 tx=0x7fbd3002a560 comp rx=0 tx=0).stop 2024-09-17T03:45:28.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.634+0000 7fbd403a8640 1 -- 172.21.15.146:0/117963877 shutdown_connections 2024-09-17T03:45:28.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.634+0000 7fbd403a8640 1 --2- 172.21.15.146:0/117963877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd380b3b60 0x7fbd380b20a0 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.634+0000 7fbd403a8640 1 --2- 172.21.15.146:0/117963877 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd380b5750 0x7fbd380b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.634+0000 7fbd403a8640 1 --2- 172.21.15.146:0/117963877 >> v2:172.21.15.179:3300/0 conn(0x7fbd380b5ce0 0x7fbd380b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.634+0000 7fbd403a8640 1 -- 172.21.15.146:0/117963877 >> 172.21.15.146:0/117963877 conn(0x7fbd380b7b20 msgr2=0x7fbd3809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:28.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.634+0000 7fbd403a8640 1 -- 172.21.15.146:0/117963877 shutdown_connections 2024-09-17T03:45:28.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.634+0000 7fbd403a8640 1 -- 172.21.15.146:0/117963877 wait complete. 2024-09-17T03:45:28.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.636+0000 7fbd403a8640 1 Processor -- start 2024-09-17T03:45:28.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.636+0000 7fbd403a8640 1 -- start start 2024-09-17T03:45:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd403a8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd380b3b60 0x7fbd3814d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd403a8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd380b5750 0x7fbd38158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd403a8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd380b5ce0 0x7fbd38159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd403a8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd380b2970 con 0x7fbd380b5ce0 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd403a8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbd380b27f0 con 0x7fbd380b5750 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd403a8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbd380b2af0 con 0x7fbd380b3b60 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd3e945640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd380b5ce0 0x7fbd38159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd3e945640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd380b5ce0 0x7fbd38159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48746/0 (socket says 172.21.15.146:48746) 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd3e945640 1 -- 172.21.15.146:0/4244075645 learned_addr learned my addr 172.21.15.146:0/4244075645 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd3e144640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd380b3b60 0x7fbd3814d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd3d943640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd380b5750 0x7fbd38158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd3e945640 1 -- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd380b3b60 msgr2=0x7fbd3814d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd3e945640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd380b3b60 0x7fbd3814d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd3e945640 1 -- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd380b5750 msgr2=0x7fbd38158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd3e945640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd380b5750 0x7fbd38158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.637+0000 7fbd3e945640 1 -- 172.21.15.146:0/4244075645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3815fad0 con 0x7fbd380b5ce0 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.638+0000 7fbd3e945640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd380b5ce0 0x7fbd38159140 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7fbd30034040 tx=0x7fbd30003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.638+0000 7fbd2effd640 1 -- 172.21.15.146:0/4244075645 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3003e030 con 0x7fbd380b5ce0 2024-09-17T03:45:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.638+0000 7fbd2effd640 1 -- 172.21.15.146:0/4244075645 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd30003e50 con 0x7fbd380b5ce0 2024-09-17T03:45:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.638+0000 7fbd403a8640 1 -- 172.21.15.146:0/4244075645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3815d960 con 0x7fbd380b5ce0 2024-09-17T03:45:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.638+0000 7fbd2effd640 1 -- 172.21.15.146:0/4244075645 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd30035040 con 0x7fbd380b5ce0 2024-09-17T03:45:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.638+0000 7fbd403a8640 1 -- 172.21.15.146:0/4244075645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd381543f0 con 0x7fbd380b5ce0 2024-09-17T03:45:28.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.639+0000 7fbd403a8640 1 -- 172.21.15.146:0/4244075645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd381526e0 con 0x7fbd380b5ce0 2024-09-17T03:45:28.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.639+0000 7fbd2effd640 1 -- 172.21.15.146:0/4244075645 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd30041030 con 0x7fbd380b5ce0 2024-09-17T03:45:28.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.640+0000 7fbd2effd640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd1c078b90 0x7fbd1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:28.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.640+0000 7fbd2effd640 1 -- 172.21.15.146:0/4244075645 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7fbd300bb270 con 0x7fbd380b5ce0 2024-09-17T03:45:28.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.640+0000 7fbd3e144640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd1c078b90 0x7fbd1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:28.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.641+0000 7fbd3e144640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd1c078b90 0x7fbd1c07b0a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400ae50 tx=0x7fbd3400a540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:28.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.644+0000 7fbd2effd640 1 -- 172.21.15.146:0/4244075645 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd300833f0 con 0x7fbd380b5ce0 2024-09-17T03:45:28.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.858+0000 7fbd403a8640 1 -- 172.21.15.146:0/4244075645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd381559f0 con 0x7fbd380b5ce0 2024-09-17T03:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.859+0000 7fbd2effd640 1 -- 172.21.15.146:0/4244075645 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) ==== 95+0+3929 (secure 0 0 0) 0x7fbd30087e20 con 0x7fbd380b5ce0 2024-09-17T03:45:28.858 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:28.858 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":138,"btime":"2024-09-17T03:45:22:394523+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8309,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2438790201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2438790201},{"type":"v1","addr":"172.21.15.146:6835","nonce":2438790201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/3707736043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3707736043},{"type":"v1","addr":"172.21.15.179:6836","nonce":3707736043}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":9247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2895389304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2895389304},{"type":"v1","addr":"172.21.15.179:6837","nonce":2895389304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132},{"gid":11007,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2471535796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2471535796},{"type":"v1","addr":"172.21.15.146:6834","nonce":2471535796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":138}],"filesystems":[]} 2024-09-17T03:45:28.858 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 138 2024-09-17T03:45:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 -- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd1c078b90 msgr2=0x7fbd1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd1c078b90 0x7fbd1c07b0a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400ae50 tx=0x7fbd3400a540 comp rx=0 tx=0).stop 2024-09-17T03:45:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 -- 172.21.15.146:0/4244075645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd380b5ce0 msgr2=0x7fbd38159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd380b5ce0 0x7fbd38159140 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7fbd30034040 tx=0x7fbd30003960 comp rx=0 tx=0).stop 2024-09-17T03:45:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 -- 172.21.15.146:0/4244075645 shutdown_connections 2024-09-17T03:45:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd1c078b90 0x7fbd1c07b0a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd380b5ce0 0x7fbd38159140 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd380b5750 0x7fbd38158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 --2- 172.21.15.146:0/4244075645 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd380b3b60 0x7fbd3814d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:28.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 -- 172.21.15.146:0/4244075645 >> 172.21.15.146:0/4244075645 conn(0x7fbd380b7b20 msgr2=0x7fbd3815bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:28.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 -- 172.21.15.146:0/4244075645 shutdown_connections 2024-09-17T03:45:28.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:28.861+0000 7fbd403a8640 1 -- 172.21.15.146:0/4244075645 wait complete. 2024-09-17T03:45:28.872 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:45:28.873 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:45:28.873 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:45:28.873 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:45:28.873 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:45:28.873 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:45:28.874 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:45:28.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:45:28.874 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:45:28.874 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:45:28.874 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:45:28.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:45:28.874 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:45:28.874 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:45:28.875 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:45:28.875 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:45:28.883 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:45:28.883 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:45:28.886 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:45:28.886 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:45:28.891 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:45:28.891 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:45:28.929 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:45:28.930 DEBUG:teuthology.parallel:result is None 2024-09-17T03:45:28.931 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:45:28.931 DEBUG:teuthology.parallel:result is None 2024-09-17T03:45:28.934 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:45:28.934 DEBUG:teuthology.parallel:result is None 2024-09-17T03:45:29.014 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:45:29.014 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:45:29.027 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:45:29.966 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:45:29.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:45:34.430 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-17T03:45:34.890 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:45:34.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:45:34.893 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:45:34.894 DEBUG:teuthology.parallel:result is None 2024-09-17T03:45:34.894 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:45:34.988 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:45:35.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.023+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3255612534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f180b4530 msgr2=0x7f4f180b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:35.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.023+0000 7f4f1f7ad640 1 --2- 172.21.15.146:0/3255612534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f180b4530 0x7f4f180b4940 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c005fd0 tx=0x7f4f0c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:45:35.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.023+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3255612534 shutdown_connections 2024-09-17T03:45:35.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.023+0000 7f4f1f7ad640 1 --2- 172.21.15.146:0/3255612534 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f1806dd60 0x7f4f1806e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:35.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.023+0000 7f4f1f7ad640 1 --2- 172.21.15.146:0/3255612534 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f180b4530 0x7f4f180b4940 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:35.023 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.024+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3255612534 >> 172.21.15.146:0/3255612534 conn(0x7f4f180b3410 msgr2=0x7f4f180b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:35.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.024+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3255612534 shutdown_connections 2024-09-17T03:45:35.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.024+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3255612534 wait complete. 2024-09-17T03:45:35.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.025+0000 7f4f1f7ad640 1 Processor -- start 2024-09-17T03:45:35.024 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.025+0000 7f4f1f7ad640 1 -- start start 2024-09-17T03:45:35.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1f7ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f1806dd60 0x7f4f18139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:35.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1f7ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f180b4530 0x7f4f1815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:35.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1f7ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f180b55f0 0x7f4f1815acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:35.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1f7ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1815be90 con 0x7f4f1806dd60 2024-09-17T03:45:35.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1f7ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1815bd10 con 0x7f4f180b55f0 2024-09-17T03:45:35.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1f7ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1815c010 con 0x7f4f180b4530 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1d549640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f1806dd60 0x7f4f18139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1d549640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f1806dd60 0x7f4f18139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48796/0 (socket says 172.21.15.146:48796) 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1d549640 1 -- 172.21.15.146:0/3212505543 learned_addr learned my addr 172.21.15.146:0/3212505543 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1cd48640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f180b4530 0x7f4f1815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1dd4a640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f180b55f0 0x7f4f1815acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1d549640 1 -- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f180b4530 msgr2=0x7f4f1815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1d549640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f180b4530 0x7f4f1815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1d549640 1 -- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f180b55f0 msgr2=0x7f4f1815acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1d549640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f180b55f0 0x7f4f1815acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1d549640 1 -- 172.21.15.146:0/3212505543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1814b740 con 0x7f4f1806dd60 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.027+0000 7f4f1d549640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f1806dd60 0x7f4f18139e80 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800c370 tx=0x7f4f0800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.028+0000 7f4f15ffb640 1 -- 172.21.15.146:0/3212505543 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08017070 con 0x7f4f1806dd60 2024-09-17T03:45:35.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.028+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3212505543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1814ba20 con 0x7f4f1806dd60 2024-09-17T03:45:35.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.028+0000 7f4f15ffb640 1 -- 172.21.15.146:0/3212505543 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f080053c0 con 0x7f4f1806dd60 2024-09-17T03:45:35.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.028+0000 7f4f15ffb640 1 -- 172.21.15.146:0/3212505543 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08003850 con 0x7f4f1806dd60 2024-09-17T03:45:35.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.028+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3212505543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f1814bfe0 con 0x7f4f1806dd60 2024-09-17T03:45:35.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.029+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3212505543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f1806e170 con 0x7f4f1806dd60 2024-09-17T03:45:35.029 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.030+0000 7f4f15ffb640 1 -- 172.21.15.146:0/3212505543 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f0801a070 con 0x7f4f1806dd60 2024-09-17T03:45:35.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.030+0000 7f4f15ffb640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f04078bc0 0x7f4f0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:35.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.030+0000 7f4f15ffb640 1 -- 172.21.15.146:0/3212505543 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 4943+0+0 (secure 0 0 0) 0x7f4f08099d40 con 0x7f4f1806dd60 2024-09-17T03:45:35.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.030+0000 7f4f1cd48640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f04078bc0 0x7f4f0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:35.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.031+0000 7f4f1cd48640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f04078bc0 0x7f4f0407b0d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c033000 tx=0x7f4f0c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:35.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.035+0000 7f4f15ffb640 1 -- 172.21.15.146:0/3212505543 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f1806e6b0 con 0x7f4f1806dd60 2024-09-17T03:45:35.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:35.226+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3212505543 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4f180b38c0 con 0x7f4f1806dd60 2024-09-17T03:45:36.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.058+0000 7f4f15ffb640 1 -- 172.21.15.146:0/3212505543 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v184) ==== 97+0+0 (secure 0 0 0) 0x7f4f08062490 con 0x7f4f1806dd60 2024-09-17T03:45:36.057 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:45:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f04078bc0 msgr2=0x7f4f0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f04078bc0 0x7f4f0407b0d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c033000 tx=0x7f4f0c004730 comp rx=0 tx=0).stop 2024-09-17T03:45:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3212505543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f1806dd60 msgr2=0x7f4f18139e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f1806dd60 0x7f4f18139e80 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800c370 tx=0x7f4f0800c830 comp rx=0 tx=0).stop 2024-09-17T03:45:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3212505543 shutdown_connections 2024-09-17T03:45:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4f04078bc0 0x7f4f0407b0d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f180b55f0 0x7f4f1815acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4f180b4530 0x7f4f1815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 --2- 172.21.15.146:0/3212505543 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f1806dd60 0x7f4f18139e80 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3212505543 >> 172.21.15.146:0/3212505543 conn(0x7f4f180b3410 msgr2=0x7f4f1814d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3212505543 shutdown_connections 2024-09-17T03:45:36.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.061+0000 7f4f1f7ad640 1 -- 172.21.15.146:0/3212505543 wait complete. 2024-09-17T03:45:36.073 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:45:36.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.188+0000 7fecd2d39640 1 -- 172.21.15.146:0/629520017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feccc0cf370 msgr2=0x7feccc06ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.188+0000 7fecd2d39640 1 --2- 172.21.15.146:0/629520017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feccc0cf370 0x7feccc06ed30 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7feccc0cf110 tx=0x7fecc002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.188+0000 7fecd2d39640 1 -- 172.21.15.146:0/629520017 shutdown_connections 2024-09-17T03:45:36.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.188+0000 7fecd2d39640 1 --2- 172.21.15.146:0/629520017 >> v2:172.21.15.179:3300/0 conn(0x7feccc06f270 0x7feccc0d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.188+0000 7fecd2d39640 1 --2- 172.21.15.146:0/629520017 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feccc0cf370 0x7feccc06ed30 unknown :-1 s=CLOSED pgs=2395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.188+0000 7fecd2d39640 1 -- 172.21.15.146:0/629520017 >> 172.21.15.146:0/629520017 conn(0x7feccc0d4be0 msgr2=0x7feccc0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:36.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.188+0000 7fecd2d39640 1 -- 172.21.15.146:0/629520017 shutdown_connections 2024-09-17T03:45:36.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.188+0000 7fecd2d39640 1 -- 172.21.15.146:0/629520017 wait complete. 2024-09-17T03:45:36.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.189+0000 7fecd2d39640 1 Processor -- start 2024-09-17T03:45:36.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.190+0000 7fecd2d39640 1 -- start start 2024-09-17T03:45:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd2d39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feccc06f270 0x7feccc0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd2d39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feccc0b3870 0x7feccc0b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd2d39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feccc0cf370 0x7feccc0b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd2d39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7feccc0d3a60 con 0x7feccc0cf370 2024-09-17T03:45:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd2d39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feccc0d38e0 con 0x7feccc0b3870 2024-09-17T03:45:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd2d39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7feccc0d3be0 con 0x7feccc06f270 2024-09-17T03:45:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd12d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feccc0cf370 0x7feccc0b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd12d6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feccc0cf370 0x7feccc0b57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48814/0 (socket says 172.21.15.146:48814) 2024-09-17T03:45:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd12d6640 1 -- 172.21.15.146:0/3736354967 learned_addr learned my addr 172.21.15.146:0/3736354967 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7feccbfff640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feccc0b3870 0x7feccc0b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:36.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd0ad5640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feccc06f270 0x7feccc0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd12d6640 1 -- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feccc06f270 msgr2=0x7feccc0ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd12d6640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feccc06f270 0x7feccc0ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd12d6640 1 -- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feccc0b3870 msgr2=0x7feccc0b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd12d6640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feccc0b3870 0x7feccc0b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.191+0000 7fecd12d6640 1 -- 172.21.15.146:0/3736354967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc0c9530 con 0x7feccc0cf370 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.192+0000 7fecd12d6640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feccc0cf370 0x7feccc0b57e0 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e960 tx=0x7fecc400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.192+0000 7fecc97fa640 1 -- 172.21.15.146:0/3736354967 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4004d20 con 0x7feccc0cf370 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.192+0000 7fecc97fa640 1 -- 172.21.15.146:0/3736354967 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecc400cac0 con 0x7feccc0cf370 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.192+0000 7fecd2d39640 1 -- 172.21.15.146:0/3736354967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc0c9810 con 0x7feccc0cf370 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.192+0000 7fecc97fa640 1 -- 172.21.15.146:0/3736354967 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4005020 con 0x7feccc0cf370 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.192+0000 7fecd2d39640 1 -- 172.21.15.146:0/3736354967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc0c9dd0 con 0x7feccc0cf370 2024-09-17T03:45:36.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.193+0000 7fecd2d39640 1 -- 172.21.15.146:0/3736354967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feccc0d3190 con 0x7feccc0cf370 2024-09-17T03:45:36.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.194+0000 7fecc97fa640 1 -- 172.21.15.146:0/3736354967 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fecc40051c0 con 0x7feccc0cf370 2024-09-17T03:45:36.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.194+0000 7fecc97fa640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecb8078bc0 0x7fecb807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.194+0000 7fecc97fa640 1 -- 172.21.15.146:0/3736354967 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4857+0+0 (secure 0 0 0) 0x7fecc409b260 con 0x7feccc0cf370 2024-09-17T03:45:36.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.194+0000 7fecd0ad5640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecb8078bc0 0x7fecb807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:36.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.195+0000 7fecd0ad5640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecb8078bc0 0x7fecb807b0d0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fecbc000f60 tx=0x7fecbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:36.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.199+0000 7fecc97fa640 1 -- 172.21.15.146:0/3736354967 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fecc4016030 con 0x7feccc0cf370 2024-09-17T03:45:36.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.437+0000 7fecd2d39640 1 -- 172.21.15.146:0/3736354967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7feccc15e220 con 0x7feccc0cf370 2024-09-17T03:45:36.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.437+0000 7fecc97fa640 1 -- 172.21.15.146:0/3736354967 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) ==== 80+0+5304 (secure 0 0 0) 0x7fecc40633a0 con 0x7feccc0cf370 2024-09-17T03:45:36.436 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.437 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.438 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.438 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:45:36.438 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:45:36.438 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.438 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:45:36.438 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:45:36.438 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:45:36.438 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.438 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:45:36.439 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:45:36.440 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.441 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.442 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.443 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.444 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.445 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:45:36.446 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:45:36.447 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.448 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:45:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:45:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:45:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:45:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:45:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.449 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:45:36.450 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:45:36.451 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:45:36.451 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:45:36.451 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.451 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.451 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:45:36.451 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:45:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.439+0000 7fecd2d39640 1 -- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecb8078bc0 msgr2=0x7fecb807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.439+0000 7fecd2d39640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecb8078bc0 0x7fecb807b0d0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fecbc000f60 tx=0x7fecbc009040 comp rx=0 tx=0).stop 2024-09-17T03:45:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.439+0000 7fecd2d39640 1 -- 172.21.15.146:0/3736354967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feccc0cf370 msgr2=0x7feccc0b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.439+0000 7fecd2d39640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feccc0cf370 0x7feccc0b57e0 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e960 tx=0x7fecc400ee20 comp rx=0 tx=0).stop 2024-09-17T03:45:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.439+0000 7fecd2d39640 1 -- 172.21.15.146:0/3736354967 shutdown_connections 2024-09-17T03:45:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.440+0000 7fecd2d39640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fecb8078bc0 0x7fecb807b0d0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.440+0000 7fecd2d39640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feccc0cf370 0x7feccc0b57e0 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.440+0000 7fecd2d39640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feccc0b3870 0x7feccc0b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.440+0000 7fecd2d39640 1 --2- 172.21.15.146:0/3736354967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feccc06f270 0x7feccc0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.440+0000 7fecd2d39640 1 -- 172.21.15.146:0/3736354967 >> 172.21.15.146:0/3736354967 conn(0x7feccc0d4be0 msgr2=0x7feccc0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.440+0000 7fecd2d39640 1 -- 172.21.15.146:0/3736354967 shutdown_connections 2024-09-17T03:45:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.440+0000 7fecd2d39640 1 -- 172.21.15.146:0/3736354967 wait complete. 2024-09-17T03:45:36.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:45:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.568+0000 7f5198b50640 1 -- 172.21.15.146:0/1022616540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51940b5ce0 msgr2=0x7f51940b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.568+0000 7f5198b50640 1 --2- 172.21.15.146:0/1022616540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51940b5ce0 0x7f51940b1320 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5184009830 tx=0x7f518402a510 comp rx=0 tx=0).stop 2024-09-17T03:45:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.568+0000 7f5198b50640 1 -- 172.21.15.146:0/1022616540 shutdown_connections 2024-09-17T03:45:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.568+0000 7f5198b50640 1 --2- 172.21.15.146:0/1022616540 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51940b3d30 0x7f519415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.568+0000 7f5198b50640 1 --2- 172.21.15.146:0/1022616540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51940b5ce0 0x7f51940b1320 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.568+0000 7f5198b50640 1 -- 172.21.15.146:0/1022616540 >> 172.21.15.146:0/1022616540 conn(0x7f51940b7b20 msgr2=0x7f519409ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.568+0000 7f5198b50640 1 -- 172.21.15.146:0/1022616540 shutdown_connections 2024-09-17T03:45:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.568+0000 7f5198b50640 1 -- 172.21.15.146:0/1022616540 wait complete. 2024-09-17T03:45:36.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.570+0000 7f5198b50640 1 Processor -- start 2024-09-17T03:45:36.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.570+0000 7f5198b50640 1 -- start start 2024-09-17T03:45:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5198b50640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51940b5750 0x7f5194152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5198b50640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51940b5ce0 0x7f51941e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5198b50640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5194150660 0x7f51941ea010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5198b50640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f519415d4b0 con 0x7f5194150660 2024-09-17T03:45:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5198b50640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f519415d330 con 0x7f51940b5750 2024-09-17T03:45:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5198b50640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f519415d630 con 0x7f51940b5ce0 2024-09-17T03:45:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5192d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5194150660 0x7f51941ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5192d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5194150660 0x7f51941ea010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48828/0 (socket says 172.21.15.146:48828) 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5192d9d640 1 -- 172.21.15.146:0/1979666657 learned_addr learned my addr 172.21.15.146:0/1979666657 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f519259c640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51940b5750 0x7f5194152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5191d9b640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51940b5ce0 0x7f51941e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5192d9d640 1 -- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51940b5ce0 msgr2=0x7f51941e9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5192d9d640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51940b5ce0 0x7f51941e9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5192d9d640 1 -- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51940b5750 msgr2=0x7f5194152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5192d9d640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51940b5750 0x7f5194152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5192d9d640 1 -- 172.21.15.146:0/1979666657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51941e55b0 con 0x7f5194150660 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5191d9b640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51940b5ce0 0x7f51941e9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f519259c640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51940b5750 0x7f5194152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5192d9d640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5194150660 0x7f51941ea010 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f518c00eab0 tx=0x7f518c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5182ffd640 1 -- 172.21.15.146:0/1979666657 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c00cea0 con 0x7f5194150660 2024-09-17T03:45:36.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5182ffd640 1 -- 172.21.15.146:0/1979666657 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f518c004b20 con 0x7f5194150660 2024-09-17T03:45:36.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5198b50640 1 -- 172.21.15.146:0/1979666657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51941e5890 con 0x7f5194150660 2024-09-17T03:45:36.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5182ffd640 1 -- 172.21.15.146:0/1979666657 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518c005020 con 0x7f5194150660 2024-09-17T03:45:36.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.572+0000 7f5198b50640 1 -- 172.21.15.146:0/1979666657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51941e5e50 con 0x7f5194150660 2024-09-17T03:45:36.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.574+0000 7f5198b50640 1 -- 172.21.15.146:0/1979666657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f519415db50 con 0x7f5194150660 2024-09-17T03:45:36.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.574+0000 7f5182ffd640 1 -- 172.21.15.146:0/1979666657 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f518c0051c0 con 0x7f5194150660 2024-09-17T03:45:36.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.575+0000 7f5182ffd640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5174078b90 0x7f517407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.575+0000 7f5182ffd640 1 -- 172.21.15.146:0/1979666657 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4857+0+0 (secure 0 0 0) 0x7f518c09b6b0 con 0x7f5194150660 2024-09-17T03:45:36.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.575+0000 7f519259c640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5174078b90 0x7f517407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:36.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.576+0000 7f519259c640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5174078b90 0x7f517407b0a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5184034000 tx=0x7f5184004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:36.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.579+0000 7f5182ffd640 1 -- 172.21.15.146:0/1979666657 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f518c063ee0 con 0x7f5194150660 2024-09-17T03:45:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.754+0000 7f5198b50640 1 -- 172.21.15.146:0/1979666657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f51941e78d0 con 0x7f5194150660 2024-09-17T03:45:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.754+0000 7f5182ffd640 1 -- 172.21.15.146:0/1979666657 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v184) ==== 84+0+65 (secure 0 0 0) 0x7f518c0637e0 con 0x7f5194150660 2024-09-17T03:45:36.753 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:36.754 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:45:36.754 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:45:36.754 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:45:36.754 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:45:36.754 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:36.754 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:45:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.756+0000 7f5198b50640 1 -- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5174078b90 msgr2=0x7f517407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.756+0000 7f5198b50640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5174078b90 0x7f517407b0a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5184034000 tx=0x7f5184004730 comp rx=0 tx=0).stop 2024-09-17T03:45:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.756+0000 7f5198b50640 1 -- 172.21.15.146:0/1979666657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5194150660 msgr2=0x7f51941ea010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.756+0000 7f5198b50640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5194150660 0x7f51941ea010 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f518c00eab0 tx=0x7f518c00ef70 comp rx=0 tx=0).stop 2024-09-17T03:45:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.756+0000 7f5198b50640 1 -- 172.21.15.146:0/1979666657 shutdown_connections 2024-09-17T03:45:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.756+0000 7f5198b50640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5174078b90 0x7f517407b0a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.756+0000 7f5198b50640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5194150660 0x7f51941ea010 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.756+0000 7f5198b50640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f51940b5ce0 0x7f51941e9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.756+0000 7f5198b50640 1 --2- 172.21.15.146:0/1979666657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51940b5750 0x7f5194152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.756+0000 7f5198b50640 1 -- 172.21.15.146:0/1979666657 >> 172.21.15.146:0/1979666657 conn(0x7f51940b7b20 msgr2=0x7f51940b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.757+0000 7f5198b50640 1 -- 172.21.15.146:0/1979666657 shutdown_connections 2024-09-17T03:45:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.757+0000 7f5198b50640 1 -- 172.21.15.146:0/1979666657 wait complete. 2024-09-17T03:45:36.768 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:45:36.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:45:36.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.887+0000 7fea7f512640 1 -- 172.21.15.146:0/2013866227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea64004800 msgr2=0x7fea64004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.887+0000 7fea7f512640 1 --2- 172.21.15.146:0/2013866227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea64004800 0x7fea64004c10 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7fea7815ccb0 tx=0x7fea64005830 comp rx=0 tx=0).stop 2024-09-17T03:45:36.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.887+0000 7fea7daaf640 1 -- 172.21.15.146:0/2013866227 reap_dead start 2024-09-17T03:45:36.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.887+0000 7fea7f512640 1 -- 172.21.15.146:0/2013866227 shutdown_connections 2024-09-17T03:45:36.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.887+0000 7fea7f512640 1 -- 172.21.15.146:0/2013866227 >> 172.21.15.146:0/2013866227 conn(0x7fea780b3150 msgr2=0x7fea780b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:36.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.887+0000 7fea7f512640 1 -- 172.21.15.146:0/2013866227 shutdown_connections 2024-09-17T03:45:36.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.887+0000 7fea7f512640 1 -- 172.21.15.146:0/2013866227 wait complete. 2024-09-17T03:45:36.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.889+0000 7fea7f512640 1 Processor -- start 2024-09-17T03:45:36.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.889+0000 7fea7f512640 1 -- start start 2024-09-17T03:45:36.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.890+0000 7fea7f512640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea64004800 0x7fea78153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.890+0000 7fea7f512640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea78146b00 0x7fea78073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.890+0000 7fea7f512640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea78073ac0 0x7fea781f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.890+0000 7fea7f512640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fea780aeca0 con 0x7fea64004800 2024-09-17T03:45:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.890+0000 7fea7f512640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fea7806d5d0 con 0x7fea78146b00 2024-09-17T03:45:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.890+0000 7fea7f512640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fea780aee20 con 0x7fea78073ac0 2024-09-17T03:45:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.890+0000 7fea7d2ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea64004800 0x7fea78153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.890+0000 7fea7d2ae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea64004800 0x7fea78153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48840/0 (socket says 172.21.15.146:48840) 2024-09-17T03:45:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.890+0000 7fea7d2ae640 1 -- 172.21.15.146:0/44654071 learned_addr learned my addr 172.21.15.146:0/44654071 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.891+0000 7fea7d2ae640 1 -- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea78073ac0 msgr2=0x7fea781f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.891+0000 7fea7d2ae640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea78073ac0 0x7fea781f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.891+0000 7fea7d2ae640 1 -- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea78146b00 msgr2=0x7fea78073580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.891+0000 7fea7d2ae640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea78146b00 0x7fea78073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.891+0000 7fea7d2ae640 1 -- 172.21.15.146:0/44654071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea78073ed0 con 0x7fea64004800 2024-09-17T03:45:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.891+0000 7fea7d2ae640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea64004800 0x7fea78153380 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fea740119d0 tx=0x7fea74011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.891+0000 7fea6dffb640 1 -- 172.21.15.146:0/44654071 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7401f070 con 0x7fea64004800 2024-09-17T03:45:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.891+0000 7fea6dffb640 1 -- 172.21.15.146:0/44654071 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea7400fe40 con 0x7fea64004800 2024-09-17T03:45:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.891+0000 7fea7f512640 1 -- 172.21.15.146:0/44654071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea78161620 con 0x7fea64004800 2024-09-17T03:45:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.891+0000 7fea6dffb640 1 -- 172.21.15.146:0/44654071 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea740126b0 con 0x7fea64004800 2024-09-17T03:45:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.891+0000 7fea7f512640 1 -- 172.21.15.146:0/44654071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea78161be0 con 0x7fea64004800 2024-09-17T03:45:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.892+0000 7fea7f512640 1 -- 172.21.15.146:0/44654071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea78155980 con 0x7fea64004800 2024-09-17T03:45:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.893+0000 7fea6dffb640 1 -- 172.21.15.146:0/44654071 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea74022070 con 0x7fea64004800 2024-09-17T03:45:36.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.893+0000 7fea6dffb640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea5c078bc0 0x7fea5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:36.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.893+0000 7fea6dffb640 1 -- 172.21.15.146:0/44654071 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 4857+0+0 (secure 0 0 0) 0x7fea7409b370 con 0x7fea64004800 2024-09-17T03:45:36.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.894+0000 7fea7caad640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea5c078bc0 0x7fea5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:36.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.894+0000 7fea7caad640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea5c078bc0 0x7fea5c07b0d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fea68033000 tx=0x7fea78162ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:36.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:36.898+0000 7fea6dffb640 1 -- 172.21.15.146:0/44654071 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea78073ed0 con 0x7fea64004800 2024-09-17T03:45:37.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:37.073+0000 7fea7f512640 1 -- 172.21.15.146:0/44654071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fea78071320 con 0x7fea64004800 2024-09-17T03:45:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.066+0000 7fea6dffb640 1 -- 172.21.15.146:0/44654071 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v185) ==== 138+0+0 (secure 0 0 0) 0x7fea740634b0 con 0x7fea64004800 2024-09-17T03:45:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:45:38.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 -- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea5c078bc0 msgr2=0x7fea5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:38.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea5c078bc0 0x7fea5c07b0d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fea68033000 tx=0x7fea78162ee0 comp rx=0 tx=0).stop 2024-09-17T03:45:38.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 -- 172.21.15.146:0/44654071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea64004800 msgr2=0x7fea78153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:38.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea64004800 0x7fea78153380 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fea740119d0 tx=0x7fea74011e90 comp rx=0 tx=0).stop 2024-09-17T03:45:38.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 -- 172.21.15.146:0/44654071 shutdown_connections 2024-09-17T03:45:38.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fea5c078bc0 0x7fea5c07b0d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:38.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fea78073ac0 0x7fea781f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:38.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea78146b00 0x7fea78073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:38.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 --2- 172.21.15.146:0/44654071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea64004800 0x7fea78153380 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:38.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 -- 172.21.15.146:0/44654071 >> 172.21.15.146:0/44654071 conn(0x7fea780b3150 msgr2=0x7fea78154eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:38.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 -- 172.21.15.146:0/44654071 shutdown_connections 2024-09-17T03:45:38.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.069+0000 7fea7f512640 1 -- 172.21.15.146:0/44654071 wait complete. 2024-09-17T03:45:38.086 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:45:38.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.213+0000 7fb78978b640 1 -- 172.21.15.146:0/1631667444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c004800 msgr2=0x7fb76c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:38.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.213+0000 7fb78978b640 1 --2- 172.21.15.146:0/1631667444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c004800 0x7fb76c004c10 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7fb778006fd0 tx=0x7fb76c005830 comp rx=0 tx=0).stop 2024-09-17T03:45:38.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.213+0000 7fb78978b640 1 -- 172.21.15.146:0/1631667444 shutdown_connections 2024-09-17T03:45:38.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.213+0000 7fb78978b640 1 --2- 172.21.15.146:0/1631667444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c004800 0x7fb76c004c10 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:38.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.213+0000 7fb78978b640 1 -- 172.21.15.146:0/1631667444 >> 172.21.15.146:0/1631667444 conn(0x7fb7840d1460 msgr2=0x7fb7840d1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:38.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.213+0000 7fb78978b640 1 -- 172.21.15.146:0/1631667444 shutdown_connections 2024-09-17T03:45:38.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.213+0000 7fb78978b640 1 -- 172.21.15.146:0/1631667444 wait complete. 2024-09-17T03:45:38.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.215+0000 7fb78978b640 1 Processor -- start 2024-09-17T03:45:38.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.215+0000 7fb78978b640 1 -- start start 2024-09-17T03:45:38.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.216+0000 7fb78978b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c004800 0x7fb784150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:38.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.216+0000 7fb78978b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7840c8f90 0x7fb7841f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:38.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.216+0000 7fb78978b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7840cb840 0x7fb7840cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.216+0000 7fb78978b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840b6690 con 0x7fb76c004800 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.216+0000 7fb78978b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840d36f0 con 0x7fb7840cb840 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.216+0000 7fb78978b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb7840b6810 con 0x7fb7840c8f90 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.216+0000 7fb782ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c004800 0x7fb784150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.216+0000 7fb782ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c004800 0x7fb784150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45310/0 (socket says 172.21.15.146:45310) 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.216+0000 7fb782ffd640 1 -- 172.21.15.146:0/2491707730 learned_addr learned my addr 172.21.15.146:0/2491707730 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb7827fc640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7840c8f90 0x7fb7841f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb7837fe640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7840cb840 0x7fb7840cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb782ffd640 1 -- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7840c8f90 msgr2=0x7fb7841f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb782ffd640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7840c8f90 0x7fb7841f59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb782ffd640 1 -- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7840cb840 msgr2=0x7fb7840cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb782ffd640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7840cb840 0x7fb7840cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb782ffd640 1 -- 172.21.15.146:0/2491707730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7840cc190 con 0x7fb76c004800 2024-09-17T03:45:38.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb7837fe640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7840cb840 0x7fb7840cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:38.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb782ffd640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c004800 0x7fb784150d60 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7fb774004d60 tx=0x7fb774001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:38.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb76b7fe640 1 -- 172.21.15.146:0/2491707730 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7740107d0 con 0x7fb76c004800 2024-09-17T03:45:38.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb76b7fe640 1 -- 172.21.15.146:0/2491707730 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb774016070 con 0x7fb76c004800 2024-09-17T03:45:38.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb78978b640 1 -- 172.21.15.146:0/2491707730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7841f5f30 con 0x7fb76c004800 2024-09-17T03:45:38.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb76b7fe640 1 -- 172.21.15.146:0/2491707730 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774010d00 con 0x7fb76c004800 2024-09-17T03:45:38.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.217+0000 7fb78978b640 1 -- 172.21.15.146:0/2491707730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7840ccc00 con 0x7fb76c004800 2024-09-17T03:45:38.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.218+0000 7fb78978b640 1 -- 172.21.15.146:0/2491707730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7840b6d70 con 0x7fb76c004800 2024-09-17T03:45:38.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.219+0000 7fb76b7fe640 1 -- 172.21.15.146:0/2491707730 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb77401b460 con 0x7fb76c004800 2024-09-17T03:45:38.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.220+0000 7fb76b7fe640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb770078bc0 0x7fb77007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:38.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.220+0000 7fb76b7fe640 1 -- 172.21.15.146:0/2491707730 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5227+0+0 (secure 0 0 0) 0x7fb77409b270 con 0x7fb76c004800 2024-09-17T03:45:38.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.220+0000 7fb7827fc640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb770078bc0 0x7fb77007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:38.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.220+0000 7fb7827fc640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb770078bc0 0x7fb77007b0d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb778033000 tx=0x7fb78408daf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:38.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.224+0000 7fb76b7fe640 1 -- 172.21.15.146:0/2491707730 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb7840cc190 con 0x7fb76c004800 2024-09-17T03:45:38.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:38.402+0000 7fb78978b640 1 -- 172.21.15.146:0/2491707730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb7840d1ac0 con 0x7fb76c004800 2024-09-17T03:45:39.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.068+0000 7fb76b7fe640 1 -- 172.21.15.146:0/2491707730 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v186) ==== 170+0+0 (secure 0 0 0) 0x7fb774063920 con 0x7fb76c004800 2024-09-17T03:45:39.067 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:45:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 -- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb770078bc0 msgr2=0x7fb77007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb770078bc0 0x7fb77007b0d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb778033000 tx=0x7fb78408daf0 comp rx=0 tx=0).stop 2024-09-17T03:45:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 -- 172.21.15.146:0/2491707730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c004800 msgr2=0x7fb784150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c004800 0x7fb784150d60 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7fb774004d60 tx=0x7fb774001630 comp rx=0 tx=0).stop 2024-09-17T03:45:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 -- 172.21.15.146:0/2491707730 shutdown_connections 2024-09-17T03:45:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb770078bc0 0x7fb77007b0d0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7840cb840 0x7fb7840cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7840c8f90 0x7fb7841f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:39.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 --2- 172.21.15.146:0/2491707730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb76c004800 0x7fb784150d60 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:39.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 -- 172.21.15.146:0/2491707730 >> 172.21.15.146:0/2491707730 conn(0x7fb7840d1460 msgr2=0x7fb784075d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:39.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 -- 172.21.15.146:0/2491707730 shutdown_connections 2024-09-17T03:45:39.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.071+0000 7fb78978b640 1 -- 172.21.15.146:0/2491707730 wait complete. 2024-09-17T03:45:39.097 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:45:39.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.215+0000 7ff750e94640 1 -- 172.21.15.146:0/84312644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff74c0cf6b0 msgr2=0x7ff74c161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:39.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.215+0000 7ff750e94640 1 --2- 172.21.15.146:0/84312644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff74c0cf6b0 0x7ff74c161220 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0740d0 tx=0x7ff73402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:45:39.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.215+0000 7ff750e94640 1 -- 172.21.15.146:0/84312644 shutdown_connections 2024-09-17T03:45:39.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.215+0000 7ff750e94640 1 --2- 172.21.15.146:0/84312644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff74c0cf6b0 0x7ff74c161220 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:39.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.215+0000 7ff750e94640 1 --2- 172.21.15.146:0/84312644 >> v2:172.21.15.179:3300/0 conn(0x7ff74c0d0710 0x7ff74c0cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:39.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.215+0000 7ff750e94640 1 -- 172.21.15.146:0/84312644 >> 172.21.15.146:0/84312644 conn(0x7ff74c09ba20 msgr2=0x7ff74c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:39.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.215+0000 7ff750e94640 1 -- 172.21.15.146:0/84312644 shutdown_connections 2024-09-17T03:45:39.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.215+0000 7ff750e94640 1 -- 172.21.15.146:0/84312644 wait complete. 2024-09-17T03:45:39.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.217+0000 7ff750e94640 1 Processor -- start 2024-09-17T03:45:39.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.217+0000 7ff750e94640 1 -- start start 2024-09-17T03:45:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff750e94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff74c0b47c0 0x7ff74c0c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff750e94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff74c0cf6b0 0x7ff74c1607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff750e94640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff74c0d0710 0x7ff74c06f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff750e94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c0b1de0 con 0x7ff74c0b47c0 2024-09-17T03:45:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff750e94640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c162080 con 0x7ff74c0cf6b0 2024-09-17T03:45:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff750e94640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c0b1f60 con 0x7ff74c0d0710 2024-09-17T03:45:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff74a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff74c0b47c0 0x7ff74c0c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:39.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff74a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff74c0b47c0 0x7ff74c0c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45324/0 (socket says 172.21.15.146:45324) 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff74a59c640 1 -- 172.21.15.146:0/50518461 learned_addr learned my addr 172.21.15.146:0/50518461 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff743fff640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff74c0cf6b0 0x7ff74c1607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff74ad9d640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff74c0d0710 0x7ff74c06f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff74a59c640 1 -- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff74c0d0710 msgr2=0x7ff74c06f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff74a59c640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff74c0d0710 0x7ff74c06f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff74a59c640 1 -- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff74c0cf6b0 msgr2=0x7ff74c1607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff74a59c640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff74c0cf6b0 0x7ff74c1607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff74a59c640 1 -- 172.21.15.146:0/50518461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c06dee0 con 0x7ff74c0b47c0 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff74a59c640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff74c0b47c0 0x7ff74c0c8890 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00b440 tx=0x7ff73c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.219+0000 7ff742ffd640 1 -- 172.21.15.146:0/50518461 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c015020 con 0x7ff74c0b47c0 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.220+0000 7ff742ffd640 1 -- 172.21.15.146:0/50518461 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff73c011980 con 0x7ff74c0b47c0 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.220+0000 7ff742ffd640 1 -- 172.21.15.146:0/50518461 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c011dd0 con 0x7ff74c0b47c0 2024-09-17T03:45:39.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.220+0000 7ff750e94640 1 -- 172.21.15.146:0/50518461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74c06e1c0 con 0x7ff74c0b47c0 2024-09-17T03:45:39.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.220+0000 7ff750e94640 1 -- 172.21.15.146:0/50518461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74c06e780 con 0x7ff74c0b47c0 2024-09-17T03:45:39.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.221+0000 7ff750e94640 1 -- 172.21.15.146:0/50518461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff74c0cf170 con 0x7ff74c0b47c0 2024-09-17T03:45:39.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.221+0000 7ff742ffd640 1 -- 172.21.15.146:0/50518461 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff73c018020 con 0x7ff74c0b47c0 2024-09-17T03:45:39.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.222+0000 7ff742ffd640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff72c078b90 0x7ff72c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:39.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.222+0000 7ff742ffd640 1 -- 172.21.15.146:0/50518461 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5609+0+0 (secure 0 0 0) 0x7ff73c09ad30 con 0x7ff74c0b47c0 2024-09-17T03:45:39.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.222+0000 7ff743fff640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff72c078b90 0x7ff72c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:39.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.223+0000 7ff743fff640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff72c078b90 0x7ff72c07b0a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff734033000 tx=0x7ff734004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:39.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.227+0000 7ff742ffd640 1 -- 172.21.15.146:0/50518461 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff73c01f020 con 0x7ff74c0b47c0 2024-09-17T03:45:39.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:39.437+0000 7ff750e94640 1 -- 172.21.15.146:0/50518461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff74c0ced70 con 0x7ff74c0b47c0 2024-09-17T03:45:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.089+0000 7ff742ffd640 1 -- 172.21.15.146:0/50518461 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v142) ==== 174+0+0 (secure 0 0 0) 0x7ff73c00d040 con 0x7ff74c0b47c0 2024-09-17T03:45:40.090 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 28 and data pool 29 2024-09-17T03:45:40.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 -- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff72c078b90 msgr2=0x7ff72c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff72c078b90 0x7ff72c07b0a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff734033000 tx=0x7ff734004730 comp rx=0 tx=0).stop 2024-09-17T03:45:40.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 -- 172.21.15.146:0/50518461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff74c0b47c0 msgr2=0x7ff74c0c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff74c0b47c0 0x7ff74c0c8890 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00b440 tx=0x7ff73c00b900 comp rx=0 tx=0).stop 2024-09-17T03:45:40.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 -- 172.21.15.146:0/50518461 shutdown_connections 2024-09-17T03:45:40.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff72c078b90 0x7ff72c07b0a0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff74c0d0710 0x7ff74c06f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff74c0cf6b0 0x7ff74c1607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 --2- 172.21.15.146:0/50518461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff74c0b47c0 0x7ff74c0c8890 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 -- 172.21.15.146:0/50518461 >> 172.21.15.146:0/50518461 conn(0x7ff74c09ba20 msgr2=0x7ff74c0b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:40.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 -- 172.21.15.146:0/50518461 shutdown_connections 2024-09-17T03:45:40.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.097+0000 7ff750e94640 1 -- 172.21.15.146:0/50518461 wait complete. 2024-09-17T03:45:40.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:45:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.231+0000 7f8e3d686640 1 -- 172.21.15.146:0/3738143902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380b5750 msgr2=0x7f8e380b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.231+0000 7f8e3d686640 1 --2- 172.21.15.146:0/3738143902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380b5750 0x7f8e380b3620 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f8e380b1a60 tx=0x7f8e2c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.231+0000 7f8e3d686640 1 -- 172.21.15.146:0/3738143902 shutdown_connections 2024-09-17T03:45:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.231+0000 7f8e3d686640 1 --2- 172.21.15.146:0/3738143902 >> v2:172.21.15.179:3300/0 conn(0x7f8e380b3b60 0x7f8e3815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.231+0000 7f8e3d686640 1 --2- 172.21.15.146:0/3738143902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380b5750 0x7f8e380b3620 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.231+0000 7f8e3d686640 1 -- 172.21.15.146:0/3738143902 >> 172.21.15.146:0/3738143902 conn(0x7f8e380b7b20 msgr2=0x7f8e3809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.231+0000 7f8e3d686640 1 -- 172.21.15.146:0/3738143902 shutdown_connections 2024-09-17T03:45:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.231+0000 7f8e3d686640 1 -- 172.21.15.146:0/3738143902 wait complete. 2024-09-17T03:45:40.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.233+0000 7f8e3d686640 1 Processor -- start 2024-09-17T03:45:40.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.233+0000 7f8e3d686640 1 -- start start 2024-09-17T03:45:40.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e3d686640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380b3b60 0x7f8e3809ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e3d686640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e380b5750 0x7f8e381555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e3d686640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e380b5ce0 0x7f8e3815b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e3d686640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3815d420 con 0x7f8e380b3b60 2024-09-17T03:45:40.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e3d686640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3815d2a0 con 0x7f8e380b5750 2024-09-17T03:45:40.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e3d686640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8e3815d5a0 con 0x7f8e380b5ce0 2024-09-17T03:45:40.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e36ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380b3b60 0x7f8e3809ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:40.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e36ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380b3b60 0x7f8e3809ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45340/0 (socket says 172.21.15.146:45340) 2024-09-17T03:45:40.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e36ffd640 1 -- 172.21.15.146:0/939021878 learned_addr learned my addr 172.21.15.146:0/939021878 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e367fc640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e380b5750 0x7f8e381555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e36ffd640 1 -- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e380b5ce0 msgr2=0x7f8e3815b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e36ffd640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e380b5ce0 0x7f8e3815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e36ffd640 1 -- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e380b5750 msgr2=0x7f8e381555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e36ffd640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e380b5750 0x7f8e381555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e36ffd640 1 -- 172.21.15.146:0/939021878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e381f3a20 con 0x7f8e380b3b60 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e367fc640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e380b5750 0x7f8e381555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e36ffd640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380b3b60 0x7f8e3809ebf0 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800b420 tx=0x7f8e2800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e1f7fe640 1 -- 172.21.15.146:0/939021878 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28011830 con 0x7f8e380b3b60 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e1f7fe640 1 -- 172.21.15.146:0/939021878 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e28016070 con 0x7f8e380b3b60 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e3d686640 1 -- 172.21.15.146:0/939021878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e381f3d00 con 0x7f8e380b3b60 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e1f7fe640 1 -- 172.21.15.146:0/939021878 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28011d60 con 0x7f8e380b3b60 2024-09-17T03:45:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.235+0000 7f8e3d686640 1 -- 172.21.15.146:0/939021878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e381f42c0 con 0x7f8e380b3b60 2024-09-17T03:45:40.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.236+0000 7f8e3d686640 1 -- 172.21.15.146:0/939021878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e3815da70 con 0x7f8e380b3b60 2024-09-17T03:45:40.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.237+0000 7f8e1f7fe640 1 -- 172.21.15.146:0/939021878 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e2801b460 con 0x7f8e380b3b60 2024-09-17T03:45:40.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.238+0000 7f8e1f7fe640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e24078bc0 0x7f8e2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.238+0000 7f8e1f7fe640 1 -- 172.21.15.146:0/939021878 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f8e2809a9e0 con 0x7f8e380b3b60 2024-09-17T03:45:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.238+0000 7f8e367fc640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e24078bc0 0x7f8e2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.238+0000 7f8e367fc640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e24078bc0 0x7f8e2407b0d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c033000 tx=0x7f8e2c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.242+0000 7f8e1f7fe640 1 -- 172.21.15.146:0/939021878 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e28062eb0 con 0x7f8e380b3b60 2024-09-17T03:45:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.420+0000 7f8e3d686640 1 -- 172.21.15.146:0/939021878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e38157200 con 0x7f8e380b3b60 2024-09-17T03:45:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.421+0000 7f8e1f7fe640 1 -- 172.21.15.146:0/939021878 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) ==== 74+0+16800 (secure 0 0 0) 0x7f8e280627b0 con 0x7f8e380b3b60 2024-09-17T03:45:40.421 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:40.422 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":187,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:45:39.438963+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:45:37.078416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-17T03:45:38.406641+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:45:40.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 -- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e24078bc0 msgr2=0x7f8e2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e24078bc0 0x7f8e2407b0d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c033000 tx=0x7f8e2c004730 comp rx=0 tx=0).stop 2024-09-17T03:45:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 -- 172.21.15.146:0/939021878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380b3b60 msgr2=0x7f8e3809ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380b3b60 0x7f8e3809ebf0 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800b420 tx=0x7f8e2800b8e0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 -- 172.21.15.146:0/939021878 shutdown_connections 2024-09-17T03:45:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e24078bc0 0x7f8e2407b0d0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e380b5ce0 0x7f8e3815b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e380b5750 0x7f8e381555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 --2- 172.21.15.146:0/939021878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380b3b60 0x7f8e3809ebf0 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 -- 172.21.15.146:0/939021878 >> 172.21.15.146:0/939021878 conn(0x7f8e380b7b20 msgr2=0x7f8e38157bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 -- 172.21.15.146:0/939021878 shutdown_connections 2024-09-17T03:45:40.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.423+0000 7f8e3d686640 1 -- 172.21.15.146:0/939021878 wait complete. 2024-09-17T03:45:40.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:45:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.549+0000 7fcf900c5640 1 -- 172.21.15.146:0/857148668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880b3b60 msgr2=0x7fcf8815caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.549+0000 7fcf900c5640 1 --2- 172.21.15.146:0/857148668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880b3b60 0x7fcf8815caa0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7fcf880b8440 tx=0x7fcf8002aa30 comp rx=0 tx=0).stop 2024-09-17T03:45:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.549+0000 7fcf900c5640 1 -- 172.21.15.146:0/857148668 shutdown_connections 2024-09-17T03:45:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.549+0000 7fcf900c5640 1 --2- 172.21.15.146:0/857148668 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880b3b60 0x7fcf8815caa0 unknown :-1 s=CLOSED pgs=2408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.549+0000 7fcf900c5640 1 --2- 172.21.15.146:0/857148668 >> v2:172.21.15.179:3300/0 conn(0x7fcf880b5750 0x7fcf880b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.549+0000 7fcf900c5640 1 -- 172.21.15.146:0/857148668 >> 172.21.15.146:0/857148668 conn(0x7fcf880b7b20 msgr2=0x7fcf8809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.549+0000 7fcf900c5640 1 -- 172.21.15.146:0/857148668 shutdown_connections 2024-09-17T03:45:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.549+0000 7fcf900c5640 1 -- 172.21.15.146:0/857148668 wait complete. 2024-09-17T03:45:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.551+0000 7fcf900c5640 1 Processor -- start 2024-09-17T03:45:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.551+0000 7fcf900c5640 1 -- start start 2024-09-17T03:45:40.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf900c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880b3b60 0x7fcf88155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf900c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf880b5750 0x7fcf8814e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf900c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf880b5ce0 0x7fcf8815f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf900c5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8815d480 con 0x7fcf880b3b60 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf900c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8815d300 con 0x7fcf880b5ce0 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf900c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcf8815d600 con 0x7fcf880b5750 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf8de61640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880b3b60 0x7fcf88155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf8de61640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880b3b60 0x7fcf88155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45364/0 (socket says 172.21.15.146:45364) 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf8de61640 1 -- 172.21.15.146:0/3501073477 learned_addr learned my addr 172.21.15.146:0/3501073477 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf8e662640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf880b5ce0 0x7fcf8815f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf8d660640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf880b5750 0x7fcf8814e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf8de61640 1 -- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf880b5750 msgr2=0x7fcf8814e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf8de61640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf880b5750 0x7fcf8814e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf8de61640 1 -- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf880b5ce0 msgr2=0x7fcf8815f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf8de61640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf880b5ce0 0x7fcf8815f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.552+0000 7fcf8de61640 1 -- 172.21.15.146:0/3501073477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf88150fd0 con 0x7fcf880b3b60 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.553+0000 7fcf8de61640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880b3b60 0x7fcf88155490 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c3d0 tx=0x7fcf8400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.553+0000 7fcf7e7fc640 1 -- 172.21.15.146:0/3501073477 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf84017070 con 0x7fcf880b3b60 2024-09-17T03:45:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.553+0000 7fcf7e7fc640 1 -- 172.21.15.146:0/3501073477 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf840053c0 con 0x7fcf880b3b60 2024-09-17T03:45:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.553+0000 7fcf900c5640 1 -- 172.21.15.146:0/3501073477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf881512b0 con 0x7fcf880b3b60 2024-09-17T03:45:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.553+0000 7fcf7e7fc640 1 -- 172.21.15.146:0/3501073477 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf84003850 con 0x7fcf880b3b60 2024-09-17T03:45:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.553+0000 7fcf900c5640 1 -- 172.21.15.146:0/3501073477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf88153da0 con 0x7fcf880b3b60 2024-09-17T03:45:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.554+0000 7fcf900c5640 1 -- 172.21.15.146:0/3501073477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8815dab0 con 0x7fcf880b3b60 2024-09-17T03:45:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.555+0000 7fcf7e7fc640 1 -- 172.21.15.146:0/3501073477 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf8401a070 con 0x7fcf880b3b60 2024-09-17T03:45:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.555+0000 7fcf7e7fc640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf6c078b90 0x7fcf6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.555+0000 7fcf7e7fc640 1 -- 172.21.15.146:0/3501073477 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7fcf8409a000 con 0x7fcf880b3b60 2024-09-17T03:45:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.555+0000 7fcf8d660640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf6c078b90 0x7fcf6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.556+0000 7fcf8d660640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf6c078b90 0x7fcf6c07b0a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fcf881ee420 tx=0x7fcf7800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:40.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.560+0000 7fcf7e7fc640 1 -- 172.21.15.146:0/3501073477 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcf880b3f70 con 0x7fcf880b3b60 2024-09-17T03:45:40.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.737+0000 7fcf900c5640 1 -- 172.21.15.146:0/3501073477 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf880b2f90 con 0x7fcf880b3b60 2024-09-17T03:45:40.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.738+0000 7fcf7e7fc640 1 -- 172.21.15.146:0/3501073477 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) ==== 74+0+16800 (secure 0 0 0) 0x7fcf84061df0 con 0x7fcf880b3b60 2024-09-17T03:45:40.738 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:40.739 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":187,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:45:39.438963+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:45:37.078416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-17T03:45:38.406641+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:45:40.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 -- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf6c078b90 msgr2=0x7fcf6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf6c078b90 0x7fcf6c07b0a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fcf881ee420 tx=0x7fcf7800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 -- 172.21.15.146:0/3501073477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880b3b60 msgr2=0x7fcf88155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880b3b60 0x7fcf88155490 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c3d0 tx=0x7fcf8400c890 comp rx=0 tx=0).stop 2024-09-17T03:45:40.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 -- 172.21.15.146:0/3501073477 shutdown_connections 2024-09-17T03:45:40.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcf6c078b90 0x7fcf6c07b0a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf880b5ce0 0x7fcf8815f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf880b5750 0x7fcf8814e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 --2- 172.21.15.146:0/3501073477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880b3b60 0x7fcf88155490 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 -- 172.21.15.146:0/3501073477 >> 172.21.15.146:0/3501073477 conn(0x7fcf880b7b20 msgr2=0x7fcf88156420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:40.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 -- 172.21.15.146:0/3501073477 shutdown_connections 2024-09-17T03:45:40.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.740+0000 7fcf900c5640 1 -- 172.21.15.146:0/3501073477 wait complete. 2024-09-17T03:45:40.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:45:40.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.868+0000 7f24e0af2640 1 -- 172.21.15.146:0/1686633156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24dc0cfca0 msgr2=0x7f24dc0cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.868+0000 7f24e0af2640 1 --2- 172.21.15.146:0/1686633156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24dc0cfca0 0x7f24dc0cef40 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7f24dc068f10 tx=0x7f24d002a530 comp rx=0 tx=0).stop 2024-09-17T03:45:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.868+0000 7f24e0af2640 1 -- 172.21.15.146:0/1686633156 shutdown_connections 2024-09-17T03:45:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.868+0000 7f24e0af2640 1 --2- 172.21.15.146:0/1686633156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24dc0cfca0 0x7f24dc0cef40 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.868+0000 7f24e0af2640 1 -- 172.21.15.146:0/1686633156 >> 172.21.15.146:0/1686633156 conn(0x7f24dc0d11f0 msgr2=0x7f24dc0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.868+0000 7f24e0af2640 1 -- 172.21.15.146:0/1686633156 shutdown_connections 2024-09-17T03:45:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.868+0000 7f24e0af2640 1 -- 172.21.15.146:0/1686633156 wait complete. 2024-09-17T03:45:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.870+0000 7f24e0af2640 1 Processor -- start 2024-09-17T03:45:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.870+0000 7f24e0af2640 1 -- start start 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.871+0000 7f24e0af2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24dc0b61f0 0x7f24dc14ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.871+0000 7f24e0af2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24dc0cfca0 0x7f24dc0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.871+0000 7f24e0af2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24dc15f1a0 0x7f24dc15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.871+0000 7f24e0af2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc069660 con 0x7f24dc0cfca0 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.871+0000 7f24e0af2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc0694e0 con 0x7f24dc0b61f0 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.871+0000 7f24e0af2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f24dc0697e0 con 0x7f24dc15f1a0 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.871+0000 7f24d9d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24dc0cfca0 0x7f24dc0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24d9d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24dc0cfca0 0x7f24dc0cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45394/0 (socket says 172.21.15.146:45394) 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24d9d9b640 1 -- 172.21.15.146:0/3764528304 learned_addr learned my addr 172.21.15.146:0/3764528304 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24da59c640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24dc0b61f0 0x7f24dc14ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24dad9d640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24dc15f1a0 0x7f24dc15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:40.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24d9d9b640 1 -- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24dc15f1a0 msgr2=0x7f24dc15dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24d9d9b640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24dc15f1a0 0x7f24dc15dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24d9d9b640 1 -- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24dc0b61f0 msgr2=0x7f24dc14ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24d9d9b640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24dc0b61f0 0x7f24dc14ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24d9d9b640 1 -- 172.21.15.146:0/3764528304 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24dc14f9c0 con 0x7f24dc0cfca0 2024-09-17T03:45:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24d9d9b640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24dc0cfca0 0x7f24dc0cddd0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f24d0000c00 tx=0x7f24d00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24caffd640 1 -- 172.21.15.146:0/3764528304 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d003e030 con 0x7f24dc0cfca0 2024-09-17T03:45:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24caffd640 1 -- 172.21.15.146:0/3764528304 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24d00047a0 con 0x7f24dc0cfca0 2024-09-17T03:45:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24e0af2640 1 -- 172.21.15.146:0/3764528304 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24dc14d3d0 con 0x7f24dc0cfca0 2024-09-17T03:45:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24caffd640 1 -- 172.21.15.146:0/3764528304 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0035040 con 0x7f24dc0cfca0 2024-09-17T03:45:40.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.872+0000 7f24e0af2640 1 -- 172.21.15.146:0/3764528304 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24dc14ff60 con 0x7f24dc0cfca0 2024-09-17T03:45:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.873+0000 7f24e0af2640 1 -- 172.21.15.146:0/3764528304 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24dc069c30 con 0x7f24dc0cfca0 2024-09-17T03:45:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.874+0000 7f24caffd640 1 -- 172.21.15.146:0/3764528304 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24d0041030 con 0x7f24dc0cfca0 2024-09-17T03:45:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.875+0000 7f24caffd640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24bc078b90 0x7f24bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.875+0000 7f24caffd640 1 -- 172.21.15.146:0/3764528304 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f24d00bb5f0 con 0x7f24dc0cfca0 2024-09-17T03:45:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.875+0000 7f24da59c640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24bc078b90 0x7f24bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.875+0000 7f24da59c640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24bc078b90 0x7f24bc07b0a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f24cc001e20 tx=0x7f24cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:40.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:40.879+0000 7f24caffd640 1 -- 172.21.15.146:0/3764528304 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f24d00833f0 con 0x7f24dc0cfca0 2024-09-17T03:45:41.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:41.090+0000 7f24e0af2640 1 -- 172.21.15.146:0/3764528304 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f24dc0c7ff0 con 0x7f24dc0cfca0 2024-09-17T03:45:41.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-17T03:45:42.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.094+0000 7f24caffd640 1 -- 172.21.15.146:0/3764528304 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v144) ==== 118+0+0 (secure 0 0 0) 0x7f24d0087e20 con 0x7f24dc0cfca0 2024-09-17T03:45:42.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 -- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24bc078b90 msgr2=0x7f24bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:42.097 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24bc078b90 0x7f24bc07b0a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f24cc001e20 tx=0x7f24cc009040 comp rx=0 tx=0).stop 2024-09-17T03:45:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 -- 172.21.15.146:0/3764528304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24dc0cfca0 msgr2=0x7f24dc0cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24dc0cfca0 0x7f24dc0cddd0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f24d0000c00 tx=0x7f24d00039e0 comp rx=0 tx=0).stop 2024-09-17T03:45:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 -- 172.21.15.146:0/3764528304 shutdown_connections 2024-09-17T03:45:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24bc078b90 0x7f24bc07b0a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24dc15f1a0 0x7f24dc15dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24dc0cfca0 0x7f24dc0cddd0 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 --2- 172.21.15.146:0/3764528304 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24dc0b61f0 0x7f24dc14ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 -- 172.21.15.146:0/3764528304 >> 172.21.15.146:0/3764528304 conn(0x7f24dc0d11f0 msgr2=0x7f24dc15d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 -- 172.21.15.146:0/3764528304 shutdown_connections 2024-09-17T03:45:42.098 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.097+0000 7f24e0af2640 1 -- 172.21.15.146:0/3764528304 wait complete. 2024-09-17T03:45:42.110 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:45:42.110 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:45:42.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.229+0000 7f084db82640 1 -- 172.21.15.146:0/3659500738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08480b61f0 msgr2=0x7f08480b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:42.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.229+0000 7f084db82640 1 --2- 172.21.15.146:0/3659500738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08480b61f0 0x7f08480b6600 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f084806e100 tx=0x7f084002a980 comp rx=0 tx=0).stop 2024-09-17T03:45:42.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.229+0000 7f084db82640 1 -- 172.21.15.146:0/3659500738 shutdown_connections 2024-09-17T03:45:42.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.229+0000 7f084db82640 1 --2- 172.21.15.146:0/3659500738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08480b61f0 0x7f08480b6600 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:42.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.229+0000 7f084db82640 1 --2- 172.21.15.146:0/3659500738 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08481631a0 0x7f08480cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:42.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.229+0000 7f084db82640 1 --2- 172.21.15.146:0/3659500738 >> v2:172.21.15.179:3300/0 conn(0x7f084815f1a0 0x7f08480cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:42.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.229+0000 7f084db82640 1 -- 172.21.15.146:0/3659500738 >> 172.21.15.146:0/3659500738 conn(0x7f08480d11f0 msgr2=0x7f08480d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:42.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.229+0000 7f084db82640 1 -- 172.21.15.146:0/3659500738 shutdown_connections 2024-09-17T03:45:42.230 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.229+0000 7f084db82640 1 -- 172.21.15.146:0/3659500738 wait complete. 2024-09-17T03:45:42.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.231+0000 7f084db82640 1 Processor -- start 2024-09-17T03:45:42.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.231+0000 7f084db82640 1 -- start start 2024-09-17T03:45:42.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.232+0000 7f084db82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08480b61f0 0x7f08481584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:42.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.232+0000 7f084db82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f084815f1a0 0x7f08481e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:42.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.232+0000 7f084db82640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08481631a0 0x7f08481e89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.232+0000 7f084db82640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f08480693a0 con 0x7f084815f1a0 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.232+0000 7f084db82640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0848069220 con 0x7f08480b61f0 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.232+0000 7f084db82640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0848069520 con 0x7f08481631a0 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.232+0000 7f0846ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f084815f1a0 0x7f08481e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.232+0000 7f0846ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f084815f1a0 0x7f08481e84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45400/0 (socket says 172.21.15.146:45400) 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.232+0000 7f0846ffd640 1 -- 172.21.15.146:0/1403162925 learned_addr learned my addr 172.21.15.146:0/1403162925 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.232+0000 7f08477fe640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08480b61f0 0x7f08481584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.232+0000 7f0847fff640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08481631a0 0x7f08481e89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.233+0000 7f0846ffd640 1 -- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08481631a0 msgr2=0x7f08481e89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.233+0000 7f0846ffd640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08481631a0 0x7f08481e89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.233+0000 7f0846ffd640 1 -- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08480b61f0 msgr2=0x7f08481584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.233+0000 7f0846ffd640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08480b61f0 0x7f08481584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:42.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.233+0000 7f0846ffd640 1 -- 172.21.15.146:0/1403162925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08480cc260 con 0x7f084815f1a0 2024-09-17T03:45:42.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.233+0000 7f0846ffd640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f084815f1a0 0x7f08481e84b0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7f083c00d770 tx=0x7f083c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:42.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.233+0000 7f082ffff640 1 -- 172.21.15.146:0/1403162925 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c017070 con 0x7f084815f1a0 2024-09-17T03:45:42.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.233+0000 7f082ffff640 1 -- 172.21.15.146:0/1403162925 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f083c009d20 con 0x7f084815f1a0 2024-09-17T03:45:42.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.233+0000 7f084db82640 1 -- 172.21.15.146:0/1403162925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08480cc540 con 0x7f084815f1a0 2024-09-17T03:45:42.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.233+0000 7f082ffff640 1 -- 172.21.15.146:0/1403162925 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0106c0 con 0x7f084815f1a0 2024-09-17T03:45:42.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.233+0000 7f084db82640 1 -- 172.21.15.146:0/1403162925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08480ccb00 con 0x7f084815f1a0 2024-09-17T03:45:42.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.235+0000 7f084db82640 1 -- 172.21.15.146:0/1403162925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08480cdbc0 con 0x7f084815f1a0 2024-09-17T03:45:42.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.236+0000 7f082ffff640 1 -- 172.21.15.146:0/1403162925 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f083c01a070 con 0x7f084815f1a0 2024-09-17T03:45:42.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.237+0000 7f082ffff640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0834078b90 0x7f083407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:42.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.237+0000 7f082ffff640 1 -- 172.21.15.146:0/1403162925 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f083c09ada0 con 0x7f084815f1a0 2024-09-17T03:45:42.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.237+0000 7f08477fe640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0834078b90 0x7f083407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:42.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.238+0000 7f08477fe640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0834078b90 0x7f083407b0a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f0838004630 tx=0x7f083800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:42.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.241+0000 7f082ffff640 1 -- 172.21.15.146:0/1403162925 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f083c062ba0 con 0x7f084815f1a0 2024-09-17T03:45:42.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:42.452+0000 7f084db82640 1 -- 172.21.15.146:0/1403162925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0848069a40 con 0x7f084815f1a0 2024-09-17T03:45:43.096 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.096+0000 7f082ffff640 1 -- 172.21.15.146:0/1403162925 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v145) ==== 122+0+0 (secure 0 0 0) 0x7f083c0675d0 con 0x7f084815f1a0 2024-09-17T03:45:43.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 -- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0834078b90 msgr2=0x7f083407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0834078b90 0x7f083407b0a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f0838004630 tx=0x7f083800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 -- 172.21.15.146:0/1403162925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f084815f1a0 msgr2=0x7f08481e84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f084815f1a0 0x7f08481e84b0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7f083c00d770 tx=0x7f083c00dc30 comp rx=0 tx=0).stop 2024-09-17T03:45:43.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 -- 172.21.15.146:0/1403162925 shutdown_connections 2024-09-17T03:45:43.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0834078b90 0x7f083407b0a0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.099 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f08481631a0 0x7f08481e89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f084815f1a0 0x7f08481e84b0 unknown :-1 s=CLOSED pgs=2414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 --2- 172.21.15.146:0/1403162925 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f08480b61f0 0x7f08481584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 -- 172.21.15.146:0/1403162925 >> 172.21.15.146:0/1403162925 conn(0x7f08480d11f0 msgr2=0x7f08480b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:43.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 -- 172.21.15.146:0/1403162925 shutdown_connections 2024-09-17T03:45:43.100 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.099+0000 7f084db82640 1 -- 172.21.15.146:0/1403162925 wait complete. 2024-09-17T03:45:43.114 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:45:43.114 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:45:43.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.233+0000 7f98325da640 1 -- 172.21.15.146:0/354033123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9814003fd0 msgr2=0x7f9814004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.233+0000 7f98325da640 1 --2- 172.21.15.146:0/354033123 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9814003fd0 0x7f9814004800 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f982c074210 tx=0x7f9814005830 comp rx=0 tx=0).stop 2024-09-17T03:45:43.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.233+0000 7f9830b77640 1 -- 172.21.15.146:0/354033123 reap_dead start 2024-09-17T03:45:43.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.233+0000 7f98325da640 1 -- 172.21.15.146:0/354033123 shutdown_connections 2024-09-17T03:45:43.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.233+0000 7f98325da640 1 -- 172.21.15.146:0/354033123 >> 172.21.15.146:0/354033123 conn(0x7f982c0b3150 msgr2=0x7f982c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:43.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.233+0000 7f98325da640 1 -- 172.21.15.146:0/354033123 shutdown_connections 2024-09-17T03:45:43.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.233+0000 7f98325da640 1 -- 172.21.15.146:0/354033123 wait complete. 2024-09-17T03:45:43.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.235+0000 7f98325da640 1 Processor -- start 2024-09-17T03:45:43.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.235+0000 7f98325da640 1 -- start start 2024-09-17T03:45:43.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.236+0000 7f98325da640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9814003fd0 0x7f982c1e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.236+0000 7f98325da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f982c149c10 0x7f982c1465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.236+0000 7f98325da640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f982c148f90 0x7f982c1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.236+0000 7f98325da640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0b5010 con 0x7f9814003fd0 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.236+0000 7f98325da640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0b4e90 con 0x7f982c149c10 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.236+0000 7f98325da640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f982c0b5190 con 0x7f982c148f90 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f982bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9814003fd0 0x7f982c1e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f982bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9814003fd0 0x7f982c1e71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45432/0 (socket says 172.21.15.146:45432) 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f982bfff640 1 -- 172.21.15.146:0/2992849864 learned_addr learned my addr 172.21.15.146:0/2992849864 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f9830b77640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f982c148f90 0x7f982c1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f982b7fe640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f982c149c10 0x7f982c1465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f982bfff640 1 -- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f982c148f90 msgr2=0x7f982c1493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f982bfff640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f982c148f90 0x7f982c1493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f982bfff640 1 -- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f982c149c10 msgr2=0x7f982c1465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f982bfff640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f982c149c10 0x7f982c1465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f982bfff640 1 -- 172.21.15.146:0/2992849864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c1498e0 con 0x7f9814003fd0 2024-09-17T03:45:43.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f9830b77640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f982c148f90 0x7f982c1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:43.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f982b7fe640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f982c149c10 0x7f982c1465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:43.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f982bfff640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9814003fd0 0x7f982c1e71c0 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f981c011ae0 tx=0x7f981c009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:43.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f9828ff9640 1 -- 172.21.15.146:0/2992849864 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c00fcb0 con 0x7f9814003fd0 2024-09-17T03:45:43.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f9828ff9640 1 -- 172.21.15.146:0/2992849864 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f981c00fe50 con 0x7f9814003fd0 2024-09-17T03:45:43.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f9828ff9640 1 -- 172.21.15.146:0/2992849864 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c004280 con 0x7f9814003fd0 2024-09-17T03:45:43.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f98325da640 1 -- 172.21.15.146:0/2992849864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c1e8b20 con 0x7f9814003fd0 2024-09-17T03:45:43.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.237+0000 7f98325da640 1 -- 172.21.15.146:0/2992849864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c1e7d60 con 0x7f9814003fd0 2024-09-17T03:45:43.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.238+0000 7f98325da640 1 -- 172.21.15.146:0/2992849864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982c06f580 con 0x7f9814003fd0 2024-09-17T03:45:43.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.239+0000 7f9828ff9640 1 -- 172.21.15.146:0/2992849864 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f981c0035f0 con 0x7f9814003fd0 2024-09-17T03:45:43.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.240+0000 7f9828ff9640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9818078bc0 0x7f981807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.240+0000 7f9828ff9640 1 -- 172.21.15.146:0/2992849864 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f981c09b8e0 con 0x7f9814003fd0 2024-09-17T03:45:43.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.240+0000 7f982b7fe640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9818078bc0 0x7f981807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:43.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.240+0000 7f982b7fe640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9818078bc0 0x7f981807b0d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9820033000 tx=0x7f982c06ffe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:43.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.244+0000 7f9828ff9640 1 -- 172.21.15.146:0/2992849864 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f982c1498e0 con 0x7f9814003fd0 2024-09-17T03:45:43.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.454+0000 7f98325da640 1 -- 172.21.15.146:0/2992849864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f982c15baa0 con 0x7f9814003fd0 2024-09-17T03:45:43.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.454+0000 7f9828ff9640 1 -- 172.21.15.146:0/2992849864 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) ==== 95+0+5245 (secure 0 0 0) 0x7f981c063d20 con 0x7f9814003fd0 2024-09-17T03:45:43.455 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:43.455 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":145,"btime":"2024-09-17T03:45:43:095701+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/190399628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":190399628},{"type":"v1","addr":"172.21.15.179:6837","nonce":190399628}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":9565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/748249037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":748249037},{"type":"v1","addr":"172.21.15.179:6835","nonce":748249037}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":11097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1562825832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1562825832},{"type":"v1","addr":"172.21.15.146:6834","nonce":1562825832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:45:39.438921+0000","modified":"2024-09-17T03:45:42.453930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11100":{"gid":11100,"name":"a","rank":0,"incarnation":142,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2793356470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2793356470},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793356470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11100,"qdb_cluster":[11100]},"id":14}]} 2024-09-17T03:45:43.455 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 145 2024-09-17T03:45:43.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.456+0000 7f98325da640 1 -- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9818078bc0 msgr2=0x7f981807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.456+0000 7f98325da640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9818078bc0 0x7f981807b0d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9820033000 tx=0x7f982c06ffe0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.456+0000 7f98325da640 1 -- 172.21.15.146:0/2992849864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9814003fd0 msgr2=0x7f982c1e71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.456+0000 7f98325da640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9814003fd0 0x7f982c1e71c0 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f981c011ae0 tx=0x7f981c009f10 comp rx=0 tx=0).stop 2024-09-17T03:45:43.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.456+0000 7f98325da640 1 -- 172.21.15.146:0/2992849864 shutdown_connections 2024-09-17T03:45:43.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.456+0000 7f98325da640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9818078bc0 0x7f981807b0d0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.456+0000 7f98325da640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f982c148f90 0x7f982c1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.456+0000 7f98325da640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f982c149c10 0x7f982c1465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.456+0000 7f98325da640 1 --2- 172.21.15.146:0/2992849864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9814003fd0 0x7f982c1e71c0 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.457+0000 7f98325da640 1 -- 172.21.15.146:0/2992849864 >> 172.21.15.146:0/2992849864 conn(0x7f982c0b3150 msgr2=0x7f982c070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:43.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.457+0000 7f98325da640 1 -- 172.21.15.146:0/2992849864 shutdown_connections 2024-09-17T03:45:43.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.457+0000 7f98325da640 1 -- 172.21.15.146:0/2992849864 wait complete. 2024-09-17T03:45:43.468 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:45:43.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.581+0000 7f91c25e6640 1 -- 172.21.15.146:0/3357298817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91bc06f440 msgr2=0x7f91bc0d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.581+0000 7f91c25e6640 1 --2- 172.21.15.146:0/3357298817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91bc06f440 0x7f91bc0d3190 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0b73c0 tx=0x7f91b402a980 comp rx=0 tx=0).stop 2024-09-17T03:45:43.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.581+0000 7f91c25e6640 1 -- 172.21.15.146:0/3357298817 shutdown_connections 2024-09-17T03:45:43.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.581+0000 7f91c25e6640 1 --2- 172.21.15.146:0/3357298817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91bc06f440 0x7f91bc0d3190 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.581+0000 7f91c25e6640 1 --2- 172.21.15.146:0/3357298817 >> v2:172.21.15.179:3300/0 conn(0x7f91bc0b3870 0x7f91bc0cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.581+0000 7f91c25e6640 1 -- 172.21.15.146:0/3357298817 >> 172.21.15.146:0/3357298817 conn(0x7f91bc0d4be0 msgr2=0x7f91bc0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:43.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.581+0000 7f91c25e6640 1 -- 172.21.15.146:0/3357298817 shutdown_connections 2024-09-17T03:45:43.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.581+0000 7f91c25e6640 1 -- 172.21.15.146:0/3357298817 wait complete. 2024-09-17T03:45:43.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.583+0000 7f91c25e6640 1 Processor -- start 2024-09-17T03:45:43.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.583+0000 7f91c25e6640 1 -- start start 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.584+0000 7f91c25e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91bc0b3870 0x7f91bc1f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.584+0000 7f91c25e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91bc1620f0 0x7f91bc0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.584+0000 7f91c25e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91bc0cc800 0x7f91bc0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.584+0000 7f91c25e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc0d3a60 con 0x7f91bc0b3870 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.584+0000 7f91c25e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc0d38e0 con 0x7f91bc0cc800 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.584+0000 7f91c25e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f91bc0d3be0 con 0x7f91bc1620f0 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.584+0000 7f91bbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91bc0b3870 0x7f91bc1f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.584+0000 7f91bbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91bc0b3870 0x7f91bc1f2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45452/0 (socket says 172.21.15.146:45452) 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.584+0000 7f91bbfff640 1 -- 172.21.15.146:0/3236315876 learned_addr learned my addr 172.21.15.146:0/3236315876 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91bb7fe640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91bc1620f0 0x7f91bc0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91c0b83640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91bc0cc800 0x7f91bc0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:43.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91bbfff640 1 -- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91bc1620f0 msgr2=0x7f91bc0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91bbfff640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91bc1620f0 0x7f91bc0cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91bbfff640 1 -- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91bc0cc800 msgr2=0x7f91bc0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91bbfff640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91bc0cc800 0x7f91bc0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91bbfff640 1 -- 172.21.15.146:0/3236315876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc0cba40 con 0x7f91bc0b3870 2024-09-17T03:45:43.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91bbfff640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91bc0b3870 0x7f91bc1f2d80 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00b410 tx=0x7f91ac00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:43.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91b8ff9640 1 -- 172.21.15.146:0/3236315876 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac015020 con 0x7f91bc0b3870 2024-09-17T03:45:43.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91b8ff9640 1 -- 172.21.15.146:0/3236315876 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91ac011940 con 0x7f91bc0b3870 2024-09-17T03:45:43.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91c25e6640 1 -- 172.21.15.146:0/3236315876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91bc0cbd20 con 0x7f91bc0b3870 2024-09-17T03:45:43.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91b8ff9640 1 -- 172.21.15.146:0/3236315876 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac011d90 con 0x7f91bc0b3870 2024-09-17T03:45:43.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.585+0000 7f91c25e6640 1 -- 172.21.15.146:0/3236315876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91bc0cc2e0 con 0x7f91bc0b3870 2024-09-17T03:45:43.588 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.586+0000 7f91c25e6640 1 -- 172.21.15.146:0/3236315876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91bc0d3190 con 0x7f91bc0b3870 2024-09-17T03:45:43.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.587+0000 7f91b8ff9640 1 -- 172.21.15.146:0/3236315876 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f91ac018020 con 0x7f91bc0b3870 2024-09-17T03:45:43.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.588+0000 7f91b8ff9640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f919c078b90 0x7f919c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.588+0000 7f91b8ff9640 1 -- 172.21.15.146:0/3236315876 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f91ac09ac20 con 0x7f91bc0b3870 2024-09-17T03:45:43.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.588+0000 7f91bb7fe640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f919c078b90 0x7f919c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:43.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.588+0000 7f91bb7fe640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f919c078b90 0x7f919c07b0a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0cced0 tx=0x7f91a4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:43.592 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.592+0000 7f91b8ff9640 1 -- 172.21.15.146:0/3236315876 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f91ac01f020 con 0x7f91bc0b3870 2024-09-17T03:45:43.768 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.768+0000 7f91c25e6640 1 -- 172.21.15.146:0/3236315876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91bc0d2bd0 con 0x7f91bc0b3870 2024-09-17T03:45:43.769 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.769+0000 7f91b8ff9640 1 -- 172.21.15.146:0/3236315876 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+16787 (secure 0 0 0) 0x7f91ac062a20 con 0x7f91bc0b3870 2024-09-17T03:45:43.770 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:43.770 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":188,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:45:41.077566+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:45:37.078416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-17T03:45:38.406641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:45:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.771+0000 7f91c25e6640 1 -- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f919c078b90 msgr2=0x7f919c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.771+0000 7f91c25e6640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f919c078b90 0x7f919c07b0a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0cced0 tx=0x7f91a4009060 comp rx=0 tx=0).stop 2024-09-17T03:45:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.771+0000 7f91c25e6640 1 -- 172.21.15.146:0/3236315876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91bc0b3870 msgr2=0x7f91bc1f2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.771+0000 7f91c25e6640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91bc0b3870 0x7f91bc1f2d80 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00b410 tx=0x7f91ac00b8d0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.771+0000 7f91c25e6640 1 -- 172.21.15.146:0/3236315876 shutdown_connections 2024-09-17T03:45:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.771+0000 7f91c25e6640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f919c078b90 0x7f919c07b0a0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.771+0000 7f91c25e6640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f91bc0cc800 0x7f91bc0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.771+0000 7f91c25e6640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91bc1620f0 0x7f91bc0cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.771+0000 7f91c25e6640 1 --2- 172.21.15.146:0/3236315876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91bc0b3870 0x7f91bc1f2d80 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.771+0000 7f91c25e6640 1 -- 172.21.15.146:0/3236315876 >> 172.21.15.146:0/3236315876 conn(0x7f91bc0d4be0 msgr2=0x7f91bc0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:43.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.772+0000 7f91c25e6640 1 -- 172.21.15.146:0/3236315876 shutdown_connections 2024-09-17T03:45:43.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.772+0000 7f91c25e6640 1 -- 172.21.15.146:0/3236315876 wait complete. 2024-09-17T03:45:43.784 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:45:43.784 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:45:43.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.898+0000 7f861694a640 1 -- 172.21.15.146:0/2436061927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86100b5750 msgr2=0x7f86100b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.898+0000 7f861694a640 1 --2- 172.21.15.146:0/2436061927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86100b5750 0x7f86100b3620 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f86100b5390 tx=0x7f860402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.898+0000 7f861694a640 1 -- 172.21.15.146:0/2436061927 shutdown_connections 2024-09-17T03:45:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.898+0000 7f861694a640 1 --2- 172.21.15.146:0/2436061927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86100b5750 0x7f86100b3620 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.898+0000 7f861694a640 1 --2- 172.21.15.146:0/2436061927 >> v2:172.21.15.179:3300/0 conn(0x7f86100b5ce0 0x7f86100b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.898+0000 7f861694a640 1 -- 172.21.15.146:0/2436061927 >> 172.21.15.146:0/2436061927 conn(0x7f86100b7b20 msgr2=0x7f861009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.898+0000 7f861694a640 1 -- 172.21.15.146:0/2436061927 shutdown_connections 2024-09-17T03:45:43.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.898+0000 7f861694a640 1 -- 172.21.15.146:0/2436061927 wait complete. 2024-09-17T03:45:43.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.900+0000 7f861694a640 1 Processor -- start 2024-09-17T03:45:43.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.900+0000 7f861694a640 1 -- start start 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.901+0000 7f861694a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86100b3b60 0x7f86101480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.901+0000 7f861694a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86100b5750 0x7f8610158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.901+0000 7f861694a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86100b5ce0 0x7f8610159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.901+0000 7f861694a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f86100b27b0 con 0x7f86100b5750 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.901+0000 7f861694a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f861015dcc0 con 0x7f86100b5ce0 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.901+0000 7f861694a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f86100b2930 con 0x7f86100b3b60 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86100b5750 0x7f8610158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86100b5750 0x7f8610158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45474/0 (socket says 172.21.15.146:45474) 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860f7fe640 1 -- 172.21.15.146:0/3611713788 learned_addr learned my addr 172.21.15.146:0/3611713788 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860f7fe640 1 -- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86100b3b60 msgr2=0x7f86101480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860f7fe640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86100b3b60 0x7f86101480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860f7fe640 1 -- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86100b5ce0 msgr2=0x7f8610159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860f7fe640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86100b5ce0 0x7f8610159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860f7fe640 1 -- 172.21.15.146:0/3611713788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861014ef80 con 0x7f86100b5750 2024-09-17T03:45:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860f7fe640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86100b5750 0x7f8610158c00 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f8604009850 tx=0x7f8604003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860cff9640 1 -- 172.21.15.146:0/3611713788 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860403e030 con 0x7f86100b5750 2024-09-17T03:45:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860cff9640 1 -- 172.21.15.146:0/3611713788 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8604003e00 con 0x7f86100b5750 2024-09-17T03:45:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f861694a640 1 -- 172.21.15.146:0/3611713788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861014f220 con 0x7f86100b5750 2024-09-17T03:45:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f860cff9640 1 -- 172.21.15.146:0/3611713788 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604035040 con 0x7f86100b5750 2024-09-17T03:45:43.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.902+0000 7f861694a640 1 -- 172.21.15.146:0/3611713788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f861014f7e0 con 0x7f86100b5750 2024-09-17T03:45:43.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.903+0000 7f861694a640 1 -- 172.21.15.146:0/3611713788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86100b2de0 con 0x7f86100b5750 2024-09-17T03:45:43.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.904+0000 7f860cff9640 1 -- 172.21.15.146:0/3611713788 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8604041030 con 0x7f86100b5750 2024-09-17T03:45:43.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.904+0000 7f860cff9640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85fc078bc0 0x7f85fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:43.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.905+0000 7f860cff9640 1 -- 172.21.15.146:0/3611713788 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f86040bb560 con 0x7f86100b5750 2024-09-17T03:45:43.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.905+0000 7f860ffff640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85fc078bc0 0x7f85fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:43.905 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.905+0000 7f860ffff640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85fc078bc0 0x7f85fc07b0d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f860000b980 tx=0x7f8600005ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:43.909+0000 7f860cff9640 1 -- 172.21.15.146:0/3611713788 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f86040839b0 con 0x7f86100b5750 2024-09-17T03:45:44.082 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.082+0000 7f861694a640 1 -- 172.21.15.146:0/3611713788 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f861015a660 con 0x7f85fc078bc0 2024-09-17T03:45:44.087 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.087+0000 7f860cff9640 1 -- 172.21.15.146:0/3611713788 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248200 (secure 0 0 0) 0x7f861015a660 con 0x7f85fc078bc0 2024-09-17T03:45:44.090 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:44.092 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:45:44.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 -- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85fc078bc0 msgr2=0x7f85fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.093 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85fc078bc0 0x7f85fc07b0d0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f860000b980 tx=0x7f8600005ce0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 -- 172.21.15.146:0/3611713788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86100b5750 msgr2=0x7f8610158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86100b5750 0x7f8610158c00 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f8604009850 tx=0x7f8604003910 comp rx=0 tx=0).stop 2024-09-17T03:45:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 -- 172.21.15.146:0/3611713788 shutdown_connections 2024-09-17T03:45:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f85fc078bc0 0x7f85fc07b0d0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f86100b5ce0 0x7f8610159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86100b5750 0x7f8610158c00 unknown :-1 s=CLOSED pgs=2421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 --2- 172.21.15.146:0/3611713788 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f86100b3b60 0x7f86101480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 -- 172.21.15.146:0/3611713788 >> 172.21.15.146:0/3611713788 conn(0x7f86100b7b20 msgr2=0x7f86100b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 -- 172.21.15.146:0/3611713788 shutdown_connections 2024-09-17T03:45:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.090+0000 7f861694a640 1 -- 172.21.15.146:0/3611713788 wait complete. 2024-09-17T03:45:44.102 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":570,"stamp":"2024-09-17T03:45:43.995072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":468836,"kb_used_data":19492,"kb_used_omap":12,"kb_used_meta":449139,"kb_avail":754505884,"statfs":{"total":773094113280,"available":772614025216,"internally_reserved":0,"allocated":19959808,"data_stored":9422543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":459918897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.927923"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075903+0000","last_change":"2024-09-17T03:45:39.075903+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075903+0000","last_undegraded":"2024-09-17T03:45:39.075903+0000","last_fullsized":"2024-09-17T03:45:39.075903+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.081051+0000","last_change":"2024-09-17T03:45:39.081051+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.081051+0000","last_undegraded":"2024-09-17T03:45:39.081051+0000","last_fullsized":"2024-09-17T03:45:39.081051+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074723+0000","last_change":"2024-09-17T03:45:39.074723+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074723+0000","last_undegraded":"2024-09-17T03:45:39.074723+0000","last_fullsized":"2024-09-17T03:45:39.074723+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.077089+0000","last_change":"2024-09-17T03:45:39.077089+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.077089+0000","last_undegraded":"2024-09-17T03:45:39.077089+0000","last_fullsized":"2024-09-17T03:45:39.077089+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076736+0000","last_change":"2024-09-17T03:45:39.076736+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076736+0000","last_undegraded":"2024-09-17T03:45:39.076736+0000","last_fullsized":"2024-09-17T03:45:39.076736+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080839+0000","last_change":"2024-09-17T03:45:40.094260+0000","last_active":"2024-09-17T03:45:41.080839+0000","last_peered":"2024-09-17T03:45:41.080839+0000","last_clean":"2024-09-17T03:45:41.080839+0000","last_became_active":"2024-09-17T03:45:40.093926+0000","last_became_peered":"2024-09-17T03:45:40.093926+0000","last_unstale":"2024-09-17T03:45:41.080839+0000","last_undegraded":"2024-09-17T03:45:41.080839+0000","last_fullsized":"2024-09-17T03:45:41.080839+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:51.030663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074911+0000","last_change":"2024-09-17T03:45:39.074911+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074911+0000","last_undegraded":"2024-09-17T03:45:39.074911+0000","last_fullsized":"2024-09-17T03:45:39.074911+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078031+0000","last_change":"2024-09-17T03:45:39.078031+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078031+0000","last_undegraded":"2024-09-17T03:45:39.078031+0000","last_fullsized":"2024-09-17T03:45:39.078031+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075242+0000","last_change":"2024-09-17T03:45:39.075242+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075242+0000","last_undegraded":"2024-09-17T03:45:39.075242+0000","last_fullsized":"2024-09-17T03:45:39.075242+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081022+0000","last_change":"2024-09-17T03:45:40.088843+0000","last_active":"2024-09-17T03:45:41.081022+0000","last_peered":"2024-09-17T03:45:41.081022+0000","last_clean":"2024-09-17T03:45:41.081022+0000","last_became_active":"2024-09-17T03:45:40.088441+0000","last_became_peered":"2024-09-17T03:45:40.088441+0000","last_unstale":"2024-09-17T03:45:41.081022+0000","last_undegraded":"2024-09-17T03:45:41.081022+0000","last_fullsized":"2024-09-17T03:45:41.081022+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:25.818571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076898+0000","last_change":"2024-09-17T03:45:39.076898+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076898+0000","last_undegraded":"2024-09-17T03:45:39.076898+0000","last_fullsized":"2024-09-17T03:45:39.076898+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080082+0000","last_change":"2024-09-17T03:45:39.080082+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080082+0000","last_undegraded":"2024-09-17T03:45:39.080082+0000","last_fullsized":"2024-09-17T03:45:39.080082+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079648+0000","last_change":"2024-09-17T03:45:39.079648+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079648+0000","last_undegraded":"2024-09-17T03:45:39.079648+0000","last_fullsized":"2024-09-17T03:45:39.079648+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236781+0000","last_change":"2024-09-17T03:45:40.097641+0000","last_active":"2024-09-17T03:45:42.236781+0000","last_peered":"2024-09-17T03:45:42.236781+0000","last_clean":"2024-09-17T03:45:42.236781+0000","last_became_active":"2024-09-17T03:45:40.097332+0000","last_became_peered":"2024-09-17T03:45:40.097332+0000","last_unstale":"2024-09-17T03:45:42.236781+0000","last_undegraded":"2024-09-17T03:45:42.236781+0000","last_fullsized":"2024-09-17T03:45:42.236781+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:05.537118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078267+0000","last_change":"2024-09-17T03:45:39.078267+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078267+0000","last_undegraded":"2024-09-17T03:45:39.078267+0000","last_fullsized":"2024-09-17T03:45:39.078267+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.077965+0000","last_change":"2024-09-17T03:45:39.077965+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.077965+0000","last_undegraded":"2024-09-17T03:45:39.077965+0000","last_fullsized":"2024-09-17T03:45:39.077965+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236848+0000","last_change":"2024-09-17T03:45:40.096699+0000","last_active":"2024-09-17T03:45:42.236848+0000","last_peered":"2024-09-17T03:45:42.236848+0000","last_clean":"2024-09-17T03:45:42.236848+0000","last_became_active":"2024-09-17T03:45:40.096266+0000","last_became_peered":"2024-09-17T03:45:40.096266+0000","last_unstale":"2024-09-17T03:45:42.236848+0000","last_undegraded":"2024-09-17T03:45:42.236848+0000","last_fullsized":"2024-09-17T03:45:42.236848+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:33.456335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081247+0000","last_change":"2024-09-17T03:45:40.099955+0000","last_active":"2024-09-17T03:45:41.081247+0000","last_peered":"2024-09-17T03:45:41.081247+0000","last_clean":"2024-09-17T03:45:41.081247+0000","last_became_active":"2024-09-17T03:45:40.099354+0000","last_became_peered":"2024-09-17T03:45:40.099354+0000","last_unstale":"2024-09-17T03:45:41.081247+0000","last_undegraded":"2024-09-17T03:45:41.081247+0000","last_fullsized":"2024-09-17T03:45:41.081247+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:44.534249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078571+0000","last_change":"2024-09-17T03:45:39.078571+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078571+0000","last_undegraded":"2024-09-17T03:45:39.078571+0000","last_fullsized":"2024-09-17T03:45:39.078571+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081175+0000","last_change":"2024-09-17T03:45:40.086824+0000","last_active":"2024-09-17T03:45:41.081175+0000","last_peered":"2024-09-17T03:45:41.081175+0000","last_clean":"2024-09-17T03:45:41.081175+0000","last_became_active":"2024-09-17T03:45:40.086494+0000","last_became_peered":"2024-09-17T03:45:40.086494+0000","last_unstale":"2024-09-17T03:45:41.081175+0000","last_undegraded":"2024-09-17T03:45:41.081175+0000","last_fullsized":"2024-09-17T03:45:41.081175+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:37.172331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076200+0000","last_change":"2024-09-17T03:45:39.076200+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076200+0000","last_undegraded":"2024-09-17T03:45:39.076200+0000","last_fullsized":"2024-09-17T03:45:39.076200+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078806+0000","last_change":"2024-09-17T03:45:39.078806+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078806+0000","last_undegraded":"2024-09-17T03:45:39.078806+0000","last_fullsized":"2024-09-17T03:45:39.078806+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073115+0000","last_change":"2024-09-17T03:45:39.073115+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073115+0000","last_undegraded":"2024-09-17T03:45:39.073115+0000","last_fullsized":"2024-09-17T03:45:39.073115+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080048+0000","last_change":"2024-09-17T03:45:39.080048+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080048+0000","last_undegraded":"2024-09-17T03:45:39.080048+0000","last_fullsized":"2024-09-17T03:45:39.080048+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075372+0000","last_change":"2024-09-17T03:45:39.075372+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075372+0000","last_undegraded":"2024-09-17T03:45:39.075372+0000","last_fullsized":"2024-09-17T03:45:39.075372+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076918+0000","last_change":"2024-09-17T03:45:39.076918+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076918+0000","last_undegraded":"2024-09-17T03:45:39.076918+0000","last_fullsized":"2024-09-17T03:45:39.076918+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075469+0000","last_change":"2024-09-17T03:45:39.075469+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075469+0000","last_undegraded":"2024-09-17T03:45:39.075469+0000","last_fullsized":"2024-09-17T03:45:39.075469+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081077+0000","last_change":"2024-09-17T03:45:40.086000+0000","last_active":"2024-09-17T03:45:41.081077+0000","last_peered":"2024-09-17T03:45:41.081077+0000","last_clean":"2024-09-17T03:45:41.081077+0000","last_became_active":"2024-09-17T03:45:40.085687+0000","last_became_peered":"2024-09-17T03:45:40.085687+0000","last_unstale":"2024-09-17T03:45:41.081077+0000","last_undegraded":"2024-09-17T03:45:41.081077+0000","last_fullsized":"2024-09-17T03:45:41.081077+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:00.244977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236769+0000","last_change":"2024-09-17T03:45:40.115475+0000","last_active":"2024-09-17T03:45:42.236769+0000","last_peered":"2024-09-17T03:45:42.236769+0000","last_clean":"2024-09-17T03:45:42.236769+0000","last_became_active":"2024-09-17T03:45:40.115119+0000","last_became_peered":"2024-09-17T03:45:40.115119+0000","last_unstale":"2024-09-17T03:45:42.236769+0000","last_undegraded":"2024-09-17T03:45:42.236769+0000","last_fullsized":"2024-09-17T03:45:42.236769+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:28.743773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074566+0000","last_change":"2024-09-17T03:45:39.074566+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074566+0000","last_undegraded":"2024-09-17T03:45:39.074566+0000","last_fullsized":"2024-09-17T03:45:39.074566+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.081282+0000","last_change":"2024-09-17T03:45:39.081282+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.081282+0000","last_undegraded":"2024-09-17T03:45:39.081282+0000","last_fullsized":"2024-09-17T03:45:39.081282+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078984+0000","last_change":"2024-09-17T03:45:39.078984+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078984+0000","last_undegraded":"2024-09-17T03:45:39.078984+0000","last_fullsized":"2024-09-17T03:45:39.078984+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073306+0000","last_change":"2024-09-17T03:45:39.073306+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073306+0000","last_undegraded":"2024-09-17T03:45:39.073306+0000","last_fullsized":"2024-09-17T03:45:39.073306+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.088440+0000","last_change":"2024-09-17T03:45:39.087440+0000","last_active":"2024-09-17T03:45:39.088440+0000","last_peered":"2024-09-17T03:45:39.088440+0000","last_clean":"2024-09-17T03:45:39.088440+0000","last_became_active":"2024-09-17T03:45:39.086846+0000","last_became_peered":"2024-09-17T03:45:39.086846+0000","last_unstale":"2024-09-17T03:45:39.088440+0000","last_undegraded":"2024-09-17T03:45:39.088440+0000","last_fullsized":"2024-09-17T03:45:39.088440+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:17.792016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074721+0000","last_change":"2024-09-17T03:45:39.074721+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074721+0000","last_undegraded":"2024-09-17T03:45:39.074721+0000","last_fullsized":"2024-09-17T03:45:39.074721+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090581+0000","last_change":"2024-09-17T03:45:39.088533+0000","last_active":"2024-09-17T03:45:39.090581+0000","last_peered":"2024-09-17T03:45:39.090581+0000","last_clean":"2024-09-17T03:45:39.090581+0000","last_became_active":"2024-09-17T03:45:39.088224+0000","last_became_peered":"2024-09-17T03:45:39.088224+0000","last_unstale":"2024-09-17T03:45:39.090581+0000","last_undegraded":"2024-09-17T03:45:39.090581+0000","last_fullsized":"2024-09-17T03:45:39.090581+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:10.528815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236802+0000","last_change":"2024-09-17T03:45:40.115893+0000","last_active":"2024-09-17T03:45:42.236802+0000","last_peered":"2024-09-17T03:45:42.236802+0000","last_clean":"2024-09-17T03:45:42.236802+0000","last_became_active":"2024-09-17T03:45:40.114920+0000","last_became_peered":"2024-09-17T03:45:40.114920+0000","last_unstale":"2024-09-17T03:45:42.236802+0000","last_undegraded":"2024-09-17T03:45:42.236802+0000","last_fullsized":"2024-09-17T03:45:42.236802+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:18.878101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091413+0000","last_change":"2024-09-17T03:45:39.089597+0000","last_active":"2024-09-17T03:45:39.091413+0000","last_peered":"2024-09-17T03:45:39.091413+0000","last_clean":"2024-09-17T03:45:39.091413+0000","last_became_active":"2024-09-17T03:45:39.089273+0000","last_became_peered":"2024-09-17T03:45:39.089273+0000","last_unstale":"2024-09-17T03:45:39.091413+0000","last_undegraded":"2024-09-17T03:45:39.091413+0000","last_fullsized":"2024-09-17T03:45:39.091413+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:20.201366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074049+0000","last_change":"2024-09-17T03:45:39.074049+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074049+0000","last_undegraded":"2024-09-17T03:45:39.074049+0000","last_fullsized":"2024-09-17T03:45:39.074049+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.089266+0000","last_change":"2024-09-17T03:45:39.087754+0000","last_active":"2024-09-17T03:45:39.089266+0000","last_peered":"2024-09-17T03:45:39.089266+0000","last_clean":"2024-09-17T03:45:39.089266+0000","last_became_active":"2024-09-17T03:45:39.087430+0000","last_became_peered":"2024-09-17T03:45:39.087430+0000","last_unstale":"2024-09-17T03:45:39.089266+0000","last_undegraded":"2024-09-17T03:45:39.089266+0000","last_fullsized":"2024-09-17T03:45:39.089266+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:59.744416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075603+0000","last_change":"2024-09-17T03:45:39.075603+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075603+0000","last_undegraded":"2024-09-17T03:45:39.075603+0000","last_fullsized":"2024-09-17T03:45:39.075603+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091014+0000","last_change":"2024-09-17T03:45:39.088456+0000","last_active":"2024-09-17T03:45:39.091014+0000","last_peered":"2024-09-17T03:45:39.091014+0000","last_clean":"2024-09-17T03:45:39.091014+0000","last_became_active":"2024-09-17T03:45:39.088150+0000","last_became_peered":"2024-09-17T03:45:39.088150+0000","last_unstale":"2024-09-17T03:45:39.091014+0000","last_undegraded":"2024-09-17T03:45:39.091014+0000","last_fullsized":"2024-09-17T03:45:39.091014+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:56.658865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080945+0000","last_change":"2024-09-17T03:45:40.085937+0000","last_active":"2024-09-17T03:45:41.080945+0000","last_peered":"2024-09-17T03:45:41.080945+0000","last_clean":"2024-09-17T03:45:41.080945+0000","last_became_active":"2024-09-17T03:45:40.085615+0000","last_became_peered":"2024-09-17T03:45:40.085615+0000","last_unstale":"2024-09-17T03:45:41.080945+0000","last_undegraded":"2024-09-17T03:45:41.080945+0000","last_fullsized":"2024-09-17T03:45:41.080945+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:42.747919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236272+0000","last_change":"2024-09-17T03:45:39.088411+0000","last_active":"2024-09-17T03:45:42.236272+0000","last_peered":"2024-09-17T03:45:42.236272+0000","last_clean":"2024-09-17T03:45:42.236272+0000","last_became_active":"2024-09-17T03:45:39.088023+0000","last_became_peered":"2024-09-17T03:45:39.088023+0000","last_unstale":"2024-09-17T03:45:42.236272+0000","last_undegraded":"2024-09-17T03:45:42.236272+0000","last_fullsized":"2024-09-17T03:45:42.236272+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.002205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078676+0000","last_change":"2024-09-17T03:45:39.078676+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078676+0000","last_undegraded":"2024-09-17T03:45:39.078676+0000","last_fullsized":"2024-09-17T03:45:39.078676+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080963+0000","last_change":"2024-09-17T03:45:39.084140+0000","last_active":"2024-09-17T03:45:41.080963+0000","last_peered":"2024-09-17T03:45:41.080963+0000","last_clean":"2024-09-17T03:45:41.080963+0000","last_became_active":"2024-09-17T03:45:39.083831+0000","last_became_peered":"2024-09-17T03:45:39.083831+0000","last_unstale":"2024-09-17T03:45:41.080963+0000","last_undegraded":"2024-09-17T03:45:41.080963+0000","last_fullsized":"2024-09-17T03:45:41.080963+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:44.013378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080538+0000","last_change":"2024-09-17T03:45:39.080538+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080538+0000","last_undegraded":"2024-09-17T03:45:39.080538+0000","last_fullsized":"2024-09-17T03:45:39.080538+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091084+0000","last_change":"2024-09-17T03:45:39.084802+0000","last_active":"2024-09-17T03:45:39.091084+0000","last_peered":"2024-09-17T03:45:39.091084+0000","last_clean":"2024-09-17T03:45:39.091084+0000","last_became_active":"2024-09-17T03:45:39.084430+0000","last_became_peered":"2024-09-17T03:45:39.084430+0000","last_unstale":"2024-09-17T03:45:39.091084+0000","last_undegraded":"2024-09-17T03:45:39.091084+0000","last_fullsized":"2024-09-17T03:45:39.091084+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:22.720102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074912+0000","last_change":"2024-09-17T03:45:39.074912+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074912+0000","last_undegraded":"2024-09-17T03:45:39.074912+0000","last_fullsized":"2024-09-17T03:45:39.074912+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.087580+0000","last_change":"2024-09-17T03:45:39.085430+0000","last_active":"2024-09-17T03:45:39.087580+0000","last_peered":"2024-09-17T03:45:39.087580+0000","last_clean":"2024-09-17T03:45:39.087580+0000","last_became_active":"2024-09-17T03:45:39.085114+0000","last_became_peered":"2024-09-17T03:45:39.085114+0000","last_unstale":"2024-09-17T03:45:39.087580+0000","last_undegraded":"2024-09-17T03:45:39.087580+0000","last_fullsized":"2024-09-17T03:45:39.087580+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:28.360646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236975+0000","last_change":"2024-09-17T03:45:40.115366+0000","last_active":"2024-09-17T03:45:42.236975+0000","last_peered":"2024-09-17T03:45:42.236975+0000","last_clean":"2024-09-17T03:45:42.236975+0000","last_became_active":"2024-09-17T03:45:40.115007+0000","last_became_peered":"2024-09-17T03:45:40.115007+0000","last_unstale":"2024-09-17T03:45:42.236975+0000","last_undegraded":"2024-09-17T03:45:42.236975+0000","last_fullsized":"2024-09-17T03:45:42.236975+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:00.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086341+0000","last_change":"2024-09-17T03:45:39.084620+0000","last_active":"2024-09-17T03:45:39.086341+0000","last_peered":"2024-09-17T03:45:39.086341+0000","last_clean":"2024-09-17T03:45:39.086341+0000","last_became_active":"2024-09-17T03:45:39.084322+0000","last_became_peered":"2024-09-17T03:45:39.084322+0000","last_unstale":"2024-09-17T03:45:39.086341+0000","last_undegraded":"2024-09-17T03:45:39.086341+0000","last_fullsized":"2024-09-17T03:45:39.086341+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:23.419518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076428+0000","last_change":"2024-09-17T03:45:39.076428+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076428+0000","last_undegraded":"2024-09-17T03:45:39.076428+0000","last_fullsized":"2024-09-17T03:45:39.076428+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"187'6","reported_seq":21,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081163+0000","last_change":"2024-09-17T03:45:39.081186+0000","last_active":"2024-09-17T03:45:41.081163+0000","last_peered":"2024-09-17T03:45:41.081163+0000","last_clean":"2024-09-17T03:45:41.081163+0000","last_became_active":"2024-09-17T03:45:39.080858+0000","last_became_peered":"2024-09-17T03:45:39.080858+0000","last_unstale":"2024-09-17T03:45:41.081163+0000","last_undegraded":"2024-09-17T03:45:41.081163+0000","last_fullsized":"2024-09-17T03:45:41.081163+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:50.084175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078360+0000","last_change":"2024-09-17T03:45:39.078360+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078360+0000","last_undegraded":"2024-09-17T03:45:39.078360+0000","last_fullsized":"2024-09-17T03:45:39.078360+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.092592+0000","last_change":"2024-09-17T03:45:39.092139+0000","last_active":"2024-09-17T03:45:39.092592+0000","last_peered":"2024-09-17T03:45:39.092592+0000","last_clean":"2024-09-17T03:45:39.092592+0000","last_became_active":"2024-09-17T03:45:39.091812+0000","last_became_peered":"2024-09-17T03:45:39.091812+0000","last_unstale":"2024-09-17T03:45:39.092592+0000","last_undegraded":"2024-09-17T03:45:39.092592+0000","last_fullsized":"2024-09-17T03:45:39.092592+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:49.444116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078432+0000","last_change":"2024-09-17T03:45:39.078432+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078432+0000","last_undegraded":"2024-09-17T03:45:39.078432+0000","last_fullsized":"2024-09-17T03:45:39.078432+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.088181+0000","last_change":"2024-09-17T03:45:39.086455+0000","last_active":"2024-09-17T03:45:39.088181+0000","last_peered":"2024-09-17T03:45:39.088181+0000","last_clean":"2024-09-17T03:45:39.088181+0000","last_became_active":"2024-09-17T03:45:39.085888+0000","last_became_peered":"2024-09-17T03:45:39.085888+0000","last_unstale":"2024-09-17T03:45:39.088181+0000","last_undegraded":"2024-09-17T03:45:39.088181+0000","last_fullsized":"2024-09-17T03:45:39.088181+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:53.691121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074412+0000","last_change":"2024-09-17T03:45:39.074412+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074412+0000","last_undegraded":"2024-09-17T03:45:39.074412+0000","last_fullsized":"2024-09-17T03:45:39.074412+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091272+0000","last_change":"2024-09-17T03:45:39.090706+0000","last_active":"2024-09-17T03:45:39.091272+0000","last_peered":"2024-09-17T03:45:39.091272+0000","last_clean":"2024-09-17T03:45:39.091272+0000","last_became_active":"2024-09-17T03:45:39.089835+0000","last_became_peered":"2024-09-17T03:45:39.089835+0000","last_unstale":"2024-09-17T03:45:39.091272+0000","last_undegraded":"2024-09-17T03:45:39.091272+0000","last_fullsized":"2024-09-17T03:45:39.091272+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:08.367552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236471+0000","last_change":"2024-09-17T03:45:40.104541+0000","last_active":"2024-09-17T03:45:42.236471+0000","last_peered":"2024-09-17T03:45:42.236471+0000","last_clean":"2024-09-17T03:45:42.236471+0000","last_became_active":"2024-09-17T03:45:40.103770+0000","last_became_peered":"2024-09-17T03:45:40.103770+0000","last_unstale":"2024-09-17T03:45:42.236471+0000","last_undegraded":"2024-09-17T03:45:42.236471+0000","last_fullsized":"2024-09-17T03:45:42.236471+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:58.697052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090280+0000","last_change":"2024-09-17T03:45:39.086594+0000","last_active":"2024-09-17T03:45:39.090280+0000","last_peered":"2024-09-17T03:45:39.090280+0000","last_clean":"2024-09-17T03:45:39.090280+0000","last_became_active":"2024-09-17T03:45:39.086203+0000","last_became_peered":"2024-09-17T03:45:39.086203+0000","last_unstale":"2024-09-17T03:45:39.090280+0000","last_undegraded":"2024-09-17T03:45:39.090280+0000","last_fullsized":"2024-09-17T03:45:39.090280+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:36.052401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075198+0000","last_change":"2024-09-17T03:45:39.075198+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075198+0000","last_undegraded":"2024-09-17T03:45:39.075198+0000","last_fullsized":"2024-09-17T03:45:39.075198+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091563+0000","last_change":"2024-09-17T03:45:39.089285+0000","last_active":"2024-09-17T03:45:39.091563+0000","last_peered":"2024-09-17T03:45:39.091563+0000","last_clean":"2024-09-17T03:45:39.091563+0000","last_became_active":"2024-09-17T03:45:39.088977+0000","last_became_peered":"2024-09-17T03:45:39.088977+0000","last_unstale":"2024-09-17T03:45:39.091563+0000","last_undegraded":"2024-09-17T03:45:39.091563+0000","last_fullsized":"2024-09-17T03:45:39.091563+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:43.241792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081068+0000","last_change":"2024-09-17T03:45:40.099585+0000","last_active":"2024-09-17T03:45:41.081068+0000","last_peered":"2024-09-17T03:45:41.081068+0000","last_clean":"2024-09-17T03:45:41.081068+0000","last_became_active":"2024-09-17T03:45:40.098940+0000","last_became_peered":"2024-09-17T03:45:40.098940+0000","last_unstale":"2024-09-17T03:45:41.081068+0000","last_undegraded":"2024-09-17T03:45:41.081068+0000","last_fullsized":"2024-09-17T03:45:41.081068+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:37.932568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.083776+0000","last_change":"2024-09-17T03:45:39.082611+0000","last_active":"2024-09-17T03:45:39.083776+0000","last_peered":"2024-09-17T03:45:39.083776+0000","last_clean":"2024-09-17T03:45:39.083776+0000","last_became_active":"2024-09-17T03:45:39.082270+0000","last_became_peered":"2024-09-17T03:45:39.082270+0000","last_unstale":"2024-09-17T03:45:39.083776+0000","last_undegraded":"2024-09-17T03:45:39.083776+0000","last_fullsized":"2024-09-17T03:45:39.083776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:28.552320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076773+0000","last_change":"2024-09-17T03:45:39.076773+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076773+0000","last_undegraded":"2024-09-17T03:45:39.076773+0000","last_fullsized":"2024-09-17T03:45:39.076773+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091411+0000","last_change":"2024-09-17T03:45:39.087408+0000","last_active":"2024-09-17T03:45:39.091411+0000","last_peered":"2024-09-17T03:45:39.091411+0000","last_clean":"2024-09-17T03:45:39.091411+0000","last_became_active":"2024-09-17T03:45:39.087095+0000","last_became_peered":"2024-09-17T03:45:39.087095+0000","last_unstale":"2024-09-17T03:45:39.091411+0000","last_undegraded":"2024-09-17T03:45:39.091411+0000","last_fullsized":"2024-09-17T03:45:39.091411+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:40.161338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.072636+0000","last_change":"2024-09-17T03:45:39.072636+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.072636+0000","last_undegraded":"2024-09-17T03:45:39.072636+0000","last_fullsized":"2024-09-17T03:45:39.072636+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081218+0000","last_change":"2024-09-17T03:45:39.082669+0000","last_active":"2024-09-17T03:45:41.081218+0000","last_peered":"2024-09-17T03:45:41.081218+0000","last_clean":"2024-09-17T03:45:41.081218+0000","last_became_active":"2024-09-17T03:45:39.081790+0000","last_became_peered":"2024-09-17T03:45:39.081790+0000","last_unstale":"2024-09-17T03:45:41.081218+0000","last_undegraded":"2024-09-17T03:45:41.081218+0000","last_fullsized":"2024-09-17T03:45:41.081218+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:48.624264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.082401+0000","last_change":"2024-09-17T03:45:39.082401+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.082401+0000","last_undegraded":"2024-09-17T03:45:39.082401+0000","last_fullsized":"2024-09-17T03:45:39.082401+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086316+0000","last_change":"2024-09-17T03:45:39.079373+0000","last_active":"2024-09-17T03:45:39.086316+0000","last_peered":"2024-09-17T03:45:39.086316+0000","last_clean":"2024-09-17T03:45:39.086316+0000","last_became_active":"2024-09-17T03:45:39.079052+0000","last_became_peered":"2024-09-17T03:45:39.079052+0000","last_unstale":"2024-09-17T03:45:39.086316+0000","last_undegraded":"2024-09-17T03:45:39.086316+0000","last_fullsized":"2024-09-17T03:45:39.086316+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:57.303940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075938+0000","last_change":"2024-09-17T03:45:39.075938+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075938+0000","last_undegraded":"2024-09-17T03:45:39.075938+0000","last_fullsized":"2024-09-17T03:45:39.075938+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236655+0000","last_change":"2024-09-17T03:45:39.089753+0000","last_active":"2024-09-17T03:45:42.236655+0000","last_peered":"2024-09-17T03:45:42.236655+0000","last_clean":"2024-09-17T03:45:42.236655+0000","last_became_active":"2024-09-17T03:45:39.088599+0000","last_became_peered":"2024-09-17T03:45:39.088599+0000","last_unstale":"2024-09-17T03:45:42.236655+0000","last_undegraded":"2024-09-17T03:45:42.236655+0000","last_fullsized":"2024-09-17T03:45:42.236655+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:44.430375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074408+0000","last_change":"2024-09-17T03:45:39.074408+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074408+0000","last_undegraded":"2024-09-17T03:45:39.074408+0000","last_fullsized":"2024-09-17T03:45:39.074408+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236558+0000","last_change":"2024-09-17T03:45:39.087163+0000","last_active":"2024-09-17T03:45:42.236558+0000","last_peered":"2024-09-17T03:45:42.236558+0000","last_clean":"2024-09-17T03:45:42.236558+0000","last_became_active":"2024-09-17T03:45:39.086829+0000","last_became_peered":"2024-09-17T03:45:39.086829+0000","last_unstale":"2024-09-17T03:45:42.236558+0000","last_undegraded":"2024-09-17T03:45:42.236558+0000","last_fullsized":"2024-09-17T03:45:42.236558+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:21.031481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080254+0000","last_change":"2024-09-17T03:45:39.080254+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080254+0000","last_undegraded":"2024-09-17T03:45:39.080254+0000","last_fullsized":"2024-09-17T03:45:39.080254+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.089279+0000","last_change":"2024-09-17T03:45:39.081129+0000","last_active":"2024-09-17T03:45:39.089279+0000","last_peered":"2024-09-17T03:45:39.089279+0000","last_clean":"2024-09-17T03:45:39.089279+0000","last_became_active":"2024-09-17T03:45:39.080824+0000","last_became_peered":"2024-09-17T03:45:39.080824+0000","last_unstale":"2024-09-17T03:45:39.089279+0000","last_undegraded":"2024-09-17T03:45:39.089279+0000","last_fullsized":"2024-09-17T03:45:39.089279+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:14.851401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079612+0000","last_change":"2024-09-17T03:45:39.079612+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079612+0000","last_undegraded":"2024-09-17T03:45:39.079612+0000","last_fullsized":"2024-09-17T03:45:39.079612+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.092754+0000","last_change":"2024-09-17T03:45:39.092155+0000","last_active":"2024-09-17T03:45:39.092754+0000","last_peered":"2024-09-17T03:45:39.092754+0000","last_clean":"2024-09-17T03:45:39.092754+0000","last_became_active":"2024-09-17T03:45:39.091803+0000","last_became_peered":"2024-09-17T03:45:39.091803+0000","last_unstale":"2024-09-17T03:45:39.092754+0000","last_undegraded":"2024-09-17T03:45:39.092754+0000","last_fullsized":"2024-09-17T03:45:39.092754+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:30.581209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073105+0000","last_change":"2024-09-17T03:45:39.073105+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073105+0000","last_undegraded":"2024-09-17T03:45:39.073105+0000","last_fullsized":"2024-09-17T03:45:39.073105+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091136+0000","last_change":"2024-09-17T03:45:39.084693+0000","last_active":"2024-09-17T03:45:39.091136+0000","last_peered":"2024-09-17T03:45:39.091136+0000","last_clean":"2024-09-17T03:45:39.091136+0000","last_became_active":"2024-09-17T03:45:39.084367+0000","last_became_peered":"2024-09-17T03:45:39.084367+0000","last_unstale":"2024-09-17T03:45:39.091136+0000","last_undegraded":"2024-09-17T03:45:39.091136+0000","last_fullsized":"2024-09-17T03:45:39.091136+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:21.772713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076289+0000","last_change":"2024-09-17T03:45:39.076289+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076289+0000","last_undegraded":"2024-09-17T03:45:39.076289+0000","last_fullsized":"2024-09-17T03:45:39.076289+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091383+0000","last_change":"2024-09-17T03:45:39.087016+0000","last_active":"2024-09-17T03:45:39.091383+0000","last_peered":"2024-09-17T03:45:39.091383+0000","last_clean":"2024-09-17T03:45:39.091383+0000","last_became_active":"2024-09-17T03:45:39.086671+0000","last_became_peered":"2024-09-17T03:45:39.086671+0000","last_unstale":"2024-09-17T03:45:39.091383+0000","last_undegraded":"2024-09-17T03:45:39.091383+0000","last_fullsized":"2024-09-17T03:45:39.091383+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:19.011769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079037+0000","last_change":"2024-09-17T03:45:39.079037+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079037+0000","last_undegraded":"2024-09-17T03:45:39.079037+0000","last_fullsized":"2024-09-17T03:45:39.079037+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091928+0000","last_change":"2024-09-17T03:45:39.091076+0000","last_active":"2024-09-17T03:45:39.091928+0000","last_peered":"2024-09-17T03:45:39.091928+0000","last_clean":"2024-09-17T03:45:39.091928+0000","last_became_active":"2024-09-17T03:45:39.090678+0000","last_became_peered":"2024-09-17T03:45:39.090678+0000","last_unstale":"2024-09-17T03:45:39.091928+0000","last_undegraded":"2024-09-17T03:45:39.091928+0000","last_fullsized":"2024-09-17T03:45:39.091928+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:57.888711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079276+0000","last_change":"2024-09-17T03:45:39.079276+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079276+0000","last_undegraded":"2024-09-17T03:45:39.079276+0000","last_fullsized":"2024-09-17T03:45:39.079276+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236611+0000","last_change":"2024-09-17T03:45:39.092305+0000","last_active":"2024-09-17T03:45:42.236611+0000","last_peered":"2024-09-17T03:45:42.236611+0000","last_clean":"2024-09-17T03:45:42.236611+0000","last_became_active":"2024-09-17T03:45:39.091982+0000","last_became_peered":"2024-09-17T03:45:39.091982+0000","last_unstale":"2024-09-17T03:45:42.236611+0000","last_undegraded":"2024-09-17T03:45:42.236611+0000","last_fullsized":"2024-09-17T03:45:42.236611+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:31.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073819+0000","last_change":"2024-09-17T03:45:39.073819+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073819+0000","last_undegraded":"2024-09-17T03:45:39.073819+0000","last_fullsized":"2024-09-17T03:45:39.073819+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.085964+0000","last_change":"2024-09-17T03:45:39.084602+0000","last_active":"2024-09-17T03:45:39.085964+0000","last_peered":"2024-09-17T03:45:39.085964+0000","last_clean":"2024-09-17T03:45:39.085964+0000","last_became_active":"2024-09-17T03:45:39.084286+0000","last_became_peered":"2024-09-17T03:45:39.084286+0000","last_unstale":"2024-09-17T03:45:39.085964+0000","last_undegraded":"2024-09-17T03:45:39.085964+0000","last_fullsized":"2024-09-17T03:45:39.085964+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:23.641470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073813+0000","last_change":"2024-09-17T03:45:39.073813+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073813+0000","last_undegraded":"2024-09-17T03:45:39.073813+0000","last_fullsized":"2024-09-17T03:45:39.073813+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090953+0000","last_change":"2024-09-17T03:45:39.089774+0000","last_active":"2024-09-17T03:45:39.090953+0000","last_peered":"2024-09-17T03:45:39.090953+0000","last_clean":"2024-09-17T03:45:39.090953+0000","last_became_active":"2024-09-17T03:45:39.089502+0000","last_became_peered":"2024-09-17T03:45:39.089502+0000","last_unstale":"2024-09-17T03:45:39.090953+0000","last_undegraded":"2024-09-17T03:45:39.090953+0000","last_fullsized":"2024-09-17T03:45:39.090953+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:38.714674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.072524+0000","last_change":"2024-09-17T03:45:39.072524+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.072524+0000","last_undegraded":"2024-09-17T03:45:39.072524+0000","last_fullsized":"2024-09-17T03:45:39.072524+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086606+0000","last_change":"2024-09-17T03:45:39.080285+0000","last_active":"2024-09-17T03:45:39.086606+0000","last_peered":"2024-09-17T03:45:39.086606+0000","last_clean":"2024-09-17T03:45:39.086606+0000","last_became_active":"2024-09-17T03:45:39.079973+0000","last_became_peered":"2024-09-17T03:45:39.079973+0000","last_unstale":"2024-09-17T03:45:39.086606+0000","last_undegraded":"2024-09-17T03:45:39.086606+0000","last_fullsized":"2024-09-17T03:45:39.086606+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:16.852797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073628+0000","last_change":"2024-09-17T03:45:39.073628+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073628+0000","last_undegraded":"2024-09-17T03:45:39.073628+0000","last_fullsized":"2024-09-17T03:45:39.073628+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"187'2","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236742+0000","last_change":"2024-09-17T03:45:39.090713+0000","last_active":"2024-09-17T03:45:42.236742+0000","last_peered":"2024-09-17T03:45:42.236742+0000","last_clean":"2024-09-17T03:45:42.236742+0000","last_became_active":"2024-09-17T03:45:39.090324+0000","last_became_peered":"2024-09-17T03:45:39.090324+0000","last_unstale":"2024-09-17T03:45:42.236742+0000","last_undegraded":"2024-09-17T03:45:42.236742+0000","last_fullsized":"2024-09-17T03:45:42.236742+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:27.632921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":413,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.073852+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:45:39.073852+0000","last_peered":"2024-09-17T03:45:39.073852+0000","last_clean":"2024-09-17T03:45:39.073852+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:45:39.073852+0000","last_undegraded":"2024-09-17T03:45:39.073852+0000","last_fullsized":"2024-09-17T03:45:39.073852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509598,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60432,"kb_used_data":2868,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311408,"statfs":{"total":96636764160,"available":96574881792,"internally_reserved":0,"allocated":2936832,"data_stored":1619468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59848,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311992,"statfs":{"total":96636764160,"available":96575479808,"internally_reserved":0,"allocated":2342912,"data_stored":1029100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509598,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55676,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316164,"statfs":{"total":96636764160,"available":96579751936,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509599,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56272,"kb_used_data":2868,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":2936832,"data_stored":1619468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55708,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316132,"statfs":{"total":96636764160,"available":96579719168,"internally_reserved":0,"allocated":2367488,"data_stored":1042175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55732,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316108,"statfs":{"total":96636764160,"available":96579694592,"internally_reserved":0,"allocated":2383872,"data_stored":1043857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:45:44.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:45:44.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.255+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/2626308937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c00b3b60 msgr2=0x7fc5c015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.255+0000 7fc5c5b8e640 1 --2- 172.21.15.146:0/2626308937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c00b3b60 0x7fc5c015caa0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8005fd0 tx=0x7fc5b802a530 comp rx=0 tx=0).stop 2024-09-17T03:45:44.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.255+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/2626308937 shutdown_connections 2024-09-17T03:45:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.255+0000 7fc5c5b8e640 1 --2- 172.21.15.146:0/2626308937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c00b3b60 0x7fc5c015caa0 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.255+0000 7fc5c5b8e640 1 --2- 172.21.15.146:0/2626308937 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c00b5750 0x7fc5c00b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.255+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/2626308937 >> 172.21.15.146:0/2626308937 conn(0x7fc5c00b7b20 msgr2=0x7fc5c009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.255+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/2626308937 shutdown_connections 2024-09-17T03:45:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.255+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/2626308937 wait complete. 2024-09-17T03:45:44.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.257+0000 7fc5c5b8e640 1 Processor -- start 2024-09-17T03:45:44.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.257+0000 7fc5c5b8e640 1 -- start start 2024-09-17T03:45:44.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5c5b8e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c00b3b60 0x7fc5c014f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5c5b8e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c00b5750 0x7fc5c01f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5c5b8e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5c00b5ce0 0x7fc5c00c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5c5b8e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c015d460 con 0x7fc5c00b5750 2024-09-17T03:45:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5c5b8e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c015d2e0 con 0x7fc5c00b5ce0 2024-09-17T03:45:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5c5b8e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c015d5e0 con 0x7fc5c00b3b60 2024-09-17T03:45:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5beffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c00b5750 0x7fc5c01f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5beffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c00b5750 0x7fc5c01f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45500/0 (socket says 172.21.15.146:45500) 2024-09-17T03:45:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5beffd640 1 -- 172.21.15.146:0/30858433 learned_addr learned my addr 172.21.15.146:0/30858433 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5bf7fe640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c00b3b60 0x7fc5c014f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5bffff640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5c00b5ce0 0x7fc5c00c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5beffd640 1 -- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c00b3b60 msgr2=0x7fc5c014f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5beffd640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c00b3b60 0x7fc5c014f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5beffd640 1 -- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5c00b5ce0 msgr2=0x7fc5c00c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5beffd640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5c00b5ce0 0x7fc5c00c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.258+0000 7fc5beffd640 1 -- 172.21.15.146:0/30858433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c00c7570 con 0x7fc5c00b5750 2024-09-17T03:45:44.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.259+0000 7fc5beffd640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c00b5750 0x7fc5c01f3760 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400c9a0 tx=0x7fc5b400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:44.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.259+0000 7fc5a7fff640 1 -- 172.21.15.146:0/30858433 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4007bb0 con 0x7fc5c00b5750 2024-09-17T03:45:44.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.259+0000 7fc5a7fff640 1 -- 172.21.15.146:0/30858433 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5b4007e40 con 0x7fc5c00b5750 2024-09-17T03:45:44.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.259+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/30858433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c01574c0 con 0x7fc5c00b5750 2024-09-17T03:45:44.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.259+0000 7fc5a7fff640 1 -- 172.21.15.146:0/30858433 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b400f690 con 0x7fc5c00b5750 2024-09-17T03:45:44.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.259+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/30858433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c01f4600 con 0x7fc5c00b5750 2024-09-17T03:45:44.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.260+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/30858433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c015caa0 con 0x7fc5c00b5750 2024-09-17T03:45:44.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.261+0000 7fc5a7fff640 1 -- 172.21.15.146:0/30858433 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc5b4018400 con 0x7fc5c00b5750 2024-09-17T03:45:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.261+0000 7fc5a7fff640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 0x7fc5ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.261+0000 7fc5a7fff640 1 -- 172.21.15.146:0/30858433 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fc5b409b3e0 con 0x7fc5c00b5750 2024-09-17T03:45:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.261+0000 7fc5bf7fe640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 0x7fc5ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.262+0000 7fc5bf7fe640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 0x7fc5ac07b0d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000b450 tx=0x7fc5b000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:44.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.266+0000 7fc5a7fff640 1 -- 172.21.15.146:0/30858433 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc5b4014030 con 0x7fc5c00b5750 2024-09-17T03:45:44.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.435+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/30858433 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc5c015be80 con 0x7fc5ac078bc0 2024-09-17T03:45:44.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.440+0000 7fc5a7fff640 1 -- 172.21.15.146:0/30858433 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248200 (secure 0 0 0) 0x7fc5c015be80 con 0x7fc5ac078bc0 2024-09-17T03:45:44.443 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:44.444 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:45:44.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.443+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 msgr2=0x7fc5ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.443+0000 7fc5c5b8e640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 0x7fc5ac07b0d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000b450 tx=0x7fc5b000d040 comp rx=0 tx=0).stop 2024-09-17T03:45:44.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.443+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/30858433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c00b5750 msgr2=0x7fc5c01f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.443+0000 7fc5c5b8e640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c00b5750 0x7fc5c01f3760 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7fc5b400c9a0 tx=0x7fc5b400ce60 comp rx=0 tx=0).stop 2024-09-17T03:45:44.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.444+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/30858433 shutdown_connections 2024-09-17T03:45:44.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.444+0000 7fc5c5b8e640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc5ac078bc0 0x7fc5ac07b0d0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.444+0000 7fc5c5b8e640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5c00b5ce0 0x7fc5c00c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.444+0000 7fc5c5b8e640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5c00b5750 0x7fc5c01f3760 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.444+0000 7fc5c5b8e640 1 --2- 172.21.15.146:0/30858433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc5c00b3b60 0x7fc5c014f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.444+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/30858433 >> 172.21.15.146:0/30858433 conn(0x7fc5c00b7b20 msgr2=0x7fc5c0159400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:44.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.444+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/30858433 shutdown_connections 2024-09-17T03:45:44.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.444+0000 7fc5c5b8e640 1 -- 172.21.15.146:0/30858433 wait complete. 2024-09-17T03:45:44.455 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":570,"stamp":"2024-09-17T03:45:43.995072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":468836,"kb_used_data":19492,"kb_used_omap":12,"kb_used_meta":449139,"kb_avail":754505884,"statfs":{"total":773094113280,"available":772614025216,"internally_reserved":0,"allocated":19959808,"data_stored":9422543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":459918897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.927923"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075903+0000","last_change":"2024-09-17T03:45:39.075903+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075903+0000","last_undegraded":"2024-09-17T03:45:39.075903+0000","last_fullsized":"2024-09-17T03:45:39.075903+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.081051+0000","last_change":"2024-09-17T03:45:39.081051+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.081051+0000","last_undegraded":"2024-09-17T03:45:39.081051+0000","last_fullsized":"2024-09-17T03:45:39.081051+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074723+0000","last_change":"2024-09-17T03:45:39.074723+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074723+0000","last_undegraded":"2024-09-17T03:45:39.074723+0000","last_fullsized":"2024-09-17T03:45:39.074723+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.077089+0000","last_change":"2024-09-17T03:45:39.077089+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.077089+0000","last_undegraded":"2024-09-17T03:45:39.077089+0000","last_fullsized":"2024-09-17T03:45:39.077089+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076736+0000","last_change":"2024-09-17T03:45:39.076736+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076736+0000","last_undegraded":"2024-09-17T03:45:39.076736+0000","last_fullsized":"2024-09-17T03:45:39.076736+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080839+0000","last_change":"2024-09-17T03:45:40.094260+0000","last_active":"2024-09-17T03:45:41.080839+0000","last_peered":"2024-09-17T03:45:41.080839+0000","last_clean":"2024-09-17T03:45:41.080839+0000","last_became_active":"2024-09-17T03:45:40.093926+0000","last_became_peered":"2024-09-17T03:45:40.093926+0000","last_unstale":"2024-09-17T03:45:41.080839+0000","last_undegraded":"2024-09-17T03:45:41.080839+0000","last_fullsized":"2024-09-17T03:45:41.080839+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:51.030663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074911+0000","last_change":"2024-09-17T03:45:39.074911+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074911+0000","last_undegraded":"2024-09-17T03:45:39.074911+0000","last_fullsized":"2024-09-17T03:45:39.074911+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078031+0000","last_change":"2024-09-17T03:45:39.078031+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078031+0000","last_undegraded":"2024-09-17T03:45:39.078031+0000","last_fullsized":"2024-09-17T03:45:39.078031+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075242+0000","last_change":"2024-09-17T03:45:39.075242+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075242+0000","last_undegraded":"2024-09-17T03:45:39.075242+0000","last_fullsized":"2024-09-17T03:45:39.075242+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081022+0000","last_change":"2024-09-17T03:45:40.088843+0000","last_active":"2024-09-17T03:45:41.081022+0000","last_peered":"2024-09-17T03:45:41.081022+0000","last_clean":"2024-09-17T03:45:41.081022+0000","last_became_active":"2024-09-17T03:45:40.088441+0000","last_became_peered":"2024-09-17T03:45:40.088441+0000","last_unstale":"2024-09-17T03:45:41.081022+0000","last_undegraded":"2024-09-17T03:45:41.081022+0000","last_fullsized":"2024-09-17T03:45:41.081022+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:25.818571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076898+0000","last_change":"2024-09-17T03:45:39.076898+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076898+0000","last_undegraded":"2024-09-17T03:45:39.076898+0000","last_fullsized":"2024-09-17T03:45:39.076898+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080082+0000","last_change":"2024-09-17T03:45:39.080082+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080082+0000","last_undegraded":"2024-09-17T03:45:39.080082+0000","last_fullsized":"2024-09-17T03:45:39.080082+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079648+0000","last_change":"2024-09-17T03:45:39.079648+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079648+0000","last_undegraded":"2024-09-17T03:45:39.079648+0000","last_fullsized":"2024-09-17T03:45:39.079648+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236781+0000","last_change":"2024-09-17T03:45:40.097641+0000","last_active":"2024-09-17T03:45:42.236781+0000","last_peered":"2024-09-17T03:45:42.236781+0000","last_clean":"2024-09-17T03:45:42.236781+0000","last_became_active":"2024-09-17T03:45:40.097332+0000","last_became_peered":"2024-09-17T03:45:40.097332+0000","last_unstale":"2024-09-17T03:45:42.236781+0000","last_undegraded":"2024-09-17T03:45:42.236781+0000","last_fullsized":"2024-09-17T03:45:42.236781+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:05.537118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078267+0000","last_change":"2024-09-17T03:45:39.078267+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078267+0000","last_undegraded":"2024-09-17T03:45:39.078267+0000","last_fullsized":"2024-09-17T03:45:39.078267+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.077965+0000","last_change":"2024-09-17T03:45:39.077965+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.077965+0000","last_undegraded":"2024-09-17T03:45:39.077965+0000","last_fullsized":"2024-09-17T03:45:39.077965+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236848+0000","last_change":"2024-09-17T03:45:40.096699+0000","last_active":"2024-09-17T03:45:42.236848+0000","last_peered":"2024-09-17T03:45:42.236848+0000","last_clean":"2024-09-17T03:45:42.236848+0000","last_became_active":"2024-09-17T03:45:40.096266+0000","last_became_peered":"2024-09-17T03:45:40.096266+0000","last_unstale":"2024-09-17T03:45:42.236848+0000","last_undegraded":"2024-09-17T03:45:42.236848+0000","last_fullsized":"2024-09-17T03:45:42.236848+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:33.456335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081247+0000","last_change":"2024-09-17T03:45:40.099955+0000","last_active":"2024-09-17T03:45:41.081247+0000","last_peered":"2024-09-17T03:45:41.081247+0000","last_clean":"2024-09-17T03:45:41.081247+0000","last_became_active":"2024-09-17T03:45:40.099354+0000","last_became_peered":"2024-09-17T03:45:40.099354+0000","last_unstale":"2024-09-17T03:45:41.081247+0000","last_undegraded":"2024-09-17T03:45:41.081247+0000","last_fullsized":"2024-09-17T03:45:41.081247+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:44.534249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078571+0000","last_change":"2024-09-17T03:45:39.078571+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078571+0000","last_undegraded":"2024-09-17T03:45:39.078571+0000","last_fullsized":"2024-09-17T03:45:39.078571+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081175+0000","last_change":"2024-09-17T03:45:40.086824+0000","last_active":"2024-09-17T03:45:41.081175+0000","last_peered":"2024-09-17T03:45:41.081175+0000","last_clean":"2024-09-17T03:45:41.081175+0000","last_became_active":"2024-09-17T03:45:40.086494+0000","last_became_peered":"2024-09-17T03:45:40.086494+0000","last_unstale":"2024-09-17T03:45:41.081175+0000","last_undegraded":"2024-09-17T03:45:41.081175+0000","last_fullsized":"2024-09-17T03:45:41.081175+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:37.172331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076200+0000","last_change":"2024-09-17T03:45:39.076200+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076200+0000","last_undegraded":"2024-09-17T03:45:39.076200+0000","last_fullsized":"2024-09-17T03:45:39.076200+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078806+0000","last_change":"2024-09-17T03:45:39.078806+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078806+0000","last_undegraded":"2024-09-17T03:45:39.078806+0000","last_fullsized":"2024-09-17T03:45:39.078806+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073115+0000","last_change":"2024-09-17T03:45:39.073115+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073115+0000","last_undegraded":"2024-09-17T03:45:39.073115+0000","last_fullsized":"2024-09-17T03:45:39.073115+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080048+0000","last_change":"2024-09-17T03:45:39.080048+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080048+0000","last_undegraded":"2024-09-17T03:45:39.080048+0000","last_fullsized":"2024-09-17T03:45:39.080048+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075372+0000","last_change":"2024-09-17T03:45:39.075372+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075372+0000","last_undegraded":"2024-09-17T03:45:39.075372+0000","last_fullsized":"2024-09-17T03:45:39.075372+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076918+0000","last_change":"2024-09-17T03:45:39.076918+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076918+0000","last_undegraded":"2024-09-17T03:45:39.076918+0000","last_fullsized":"2024-09-17T03:45:39.076918+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075469+0000","last_change":"2024-09-17T03:45:39.075469+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075469+0000","last_undegraded":"2024-09-17T03:45:39.075469+0000","last_fullsized":"2024-09-17T03:45:39.075469+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081077+0000","last_change":"2024-09-17T03:45:40.086000+0000","last_active":"2024-09-17T03:45:41.081077+0000","last_peered":"2024-09-17T03:45:41.081077+0000","last_clean":"2024-09-17T03:45:41.081077+0000","last_became_active":"2024-09-17T03:45:40.085687+0000","last_became_peered":"2024-09-17T03:45:40.085687+0000","last_unstale":"2024-09-17T03:45:41.081077+0000","last_undegraded":"2024-09-17T03:45:41.081077+0000","last_fullsized":"2024-09-17T03:45:41.081077+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:00.244977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236769+0000","last_change":"2024-09-17T03:45:40.115475+0000","last_active":"2024-09-17T03:45:42.236769+0000","last_peered":"2024-09-17T03:45:42.236769+0000","last_clean":"2024-09-17T03:45:42.236769+0000","last_became_active":"2024-09-17T03:45:40.115119+0000","last_became_peered":"2024-09-17T03:45:40.115119+0000","last_unstale":"2024-09-17T03:45:42.236769+0000","last_undegraded":"2024-09-17T03:45:42.236769+0000","last_fullsized":"2024-09-17T03:45:42.236769+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:28.743773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074566+0000","last_change":"2024-09-17T03:45:39.074566+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074566+0000","last_undegraded":"2024-09-17T03:45:39.074566+0000","last_fullsized":"2024-09-17T03:45:39.074566+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.081282+0000","last_change":"2024-09-17T03:45:39.081282+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.081282+0000","last_undegraded":"2024-09-17T03:45:39.081282+0000","last_fullsized":"2024-09-17T03:45:39.081282+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078984+0000","last_change":"2024-09-17T03:45:39.078984+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078984+0000","last_undegraded":"2024-09-17T03:45:39.078984+0000","last_fullsized":"2024-09-17T03:45:39.078984+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073306+0000","last_change":"2024-09-17T03:45:39.073306+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073306+0000","last_undegraded":"2024-09-17T03:45:39.073306+0000","last_fullsized":"2024-09-17T03:45:39.073306+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.088440+0000","last_change":"2024-09-17T03:45:39.087440+0000","last_active":"2024-09-17T03:45:39.088440+0000","last_peered":"2024-09-17T03:45:39.088440+0000","last_clean":"2024-09-17T03:45:39.088440+0000","last_became_active":"2024-09-17T03:45:39.086846+0000","last_became_peered":"2024-09-17T03:45:39.086846+0000","last_unstale":"2024-09-17T03:45:39.088440+0000","last_undegraded":"2024-09-17T03:45:39.088440+0000","last_fullsized":"2024-09-17T03:45:39.088440+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:17.792016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074721+0000","last_change":"2024-09-17T03:45:39.074721+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074721+0000","last_undegraded":"2024-09-17T03:45:39.074721+0000","last_fullsized":"2024-09-17T03:45:39.074721+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090581+0000","last_change":"2024-09-17T03:45:39.088533+0000","last_active":"2024-09-17T03:45:39.090581+0000","last_peered":"2024-09-17T03:45:39.090581+0000","last_clean":"2024-09-17T03:45:39.090581+0000","last_became_active":"2024-09-17T03:45:39.088224+0000","last_became_peered":"2024-09-17T03:45:39.088224+0000","last_unstale":"2024-09-17T03:45:39.090581+0000","last_undegraded":"2024-09-17T03:45:39.090581+0000","last_fullsized":"2024-09-17T03:45:39.090581+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:10.528815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236802+0000","last_change":"2024-09-17T03:45:40.115893+0000","last_active":"2024-09-17T03:45:42.236802+0000","last_peered":"2024-09-17T03:45:42.236802+0000","last_clean":"2024-09-17T03:45:42.236802+0000","last_became_active":"2024-09-17T03:45:40.114920+0000","last_became_peered":"2024-09-17T03:45:40.114920+0000","last_unstale":"2024-09-17T03:45:42.236802+0000","last_undegraded":"2024-09-17T03:45:42.236802+0000","last_fullsized":"2024-09-17T03:45:42.236802+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:18.878101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091413+0000","last_change":"2024-09-17T03:45:39.089597+0000","last_active":"2024-09-17T03:45:39.091413+0000","last_peered":"2024-09-17T03:45:39.091413+0000","last_clean":"2024-09-17T03:45:39.091413+0000","last_became_active":"2024-09-17T03:45:39.089273+0000","last_became_peered":"2024-09-17T03:45:39.089273+0000","last_unstale":"2024-09-17T03:45:39.091413+0000","last_undegraded":"2024-09-17T03:45:39.091413+0000","last_fullsized":"2024-09-17T03:45:39.091413+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:20.201366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074049+0000","last_change":"2024-09-17T03:45:39.074049+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074049+0000","last_undegraded":"2024-09-17T03:45:39.074049+0000","last_fullsized":"2024-09-17T03:45:39.074049+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.089266+0000","last_change":"2024-09-17T03:45:39.087754+0000","last_active":"2024-09-17T03:45:39.089266+0000","last_peered":"2024-09-17T03:45:39.089266+0000","last_clean":"2024-09-17T03:45:39.089266+0000","last_became_active":"2024-09-17T03:45:39.087430+0000","last_became_peered":"2024-09-17T03:45:39.087430+0000","last_unstale":"2024-09-17T03:45:39.089266+0000","last_undegraded":"2024-09-17T03:45:39.089266+0000","last_fullsized":"2024-09-17T03:45:39.089266+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:59.744416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075603+0000","last_change":"2024-09-17T03:45:39.075603+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075603+0000","last_undegraded":"2024-09-17T03:45:39.075603+0000","last_fullsized":"2024-09-17T03:45:39.075603+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091014+0000","last_change":"2024-09-17T03:45:39.088456+0000","last_active":"2024-09-17T03:45:39.091014+0000","last_peered":"2024-09-17T03:45:39.091014+0000","last_clean":"2024-09-17T03:45:39.091014+0000","last_became_active":"2024-09-17T03:45:39.088150+0000","last_became_peered":"2024-09-17T03:45:39.088150+0000","last_unstale":"2024-09-17T03:45:39.091014+0000","last_undegraded":"2024-09-17T03:45:39.091014+0000","last_fullsized":"2024-09-17T03:45:39.091014+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:56.658865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080945+0000","last_change":"2024-09-17T03:45:40.085937+0000","last_active":"2024-09-17T03:45:41.080945+0000","last_peered":"2024-09-17T03:45:41.080945+0000","last_clean":"2024-09-17T03:45:41.080945+0000","last_became_active":"2024-09-17T03:45:40.085615+0000","last_became_peered":"2024-09-17T03:45:40.085615+0000","last_unstale":"2024-09-17T03:45:41.080945+0000","last_undegraded":"2024-09-17T03:45:41.080945+0000","last_fullsized":"2024-09-17T03:45:41.080945+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:42.747919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236272+0000","last_change":"2024-09-17T03:45:39.088411+0000","last_active":"2024-09-17T03:45:42.236272+0000","last_peered":"2024-09-17T03:45:42.236272+0000","last_clean":"2024-09-17T03:45:42.236272+0000","last_became_active":"2024-09-17T03:45:39.088023+0000","last_became_peered":"2024-09-17T03:45:39.088023+0000","last_unstale":"2024-09-17T03:45:42.236272+0000","last_undegraded":"2024-09-17T03:45:42.236272+0000","last_fullsized":"2024-09-17T03:45:42.236272+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.002205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078676+0000","last_change":"2024-09-17T03:45:39.078676+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078676+0000","last_undegraded":"2024-09-17T03:45:39.078676+0000","last_fullsized":"2024-09-17T03:45:39.078676+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080963+0000","last_change":"2024-09-17T03:45:39.084140+0000","last_active":"2024-09-17T03:45:41.080963+0000","last_peered":"2024-09-17T03:45:41.080963+0000","last_clean":"2024-09-17T03:45:41.080963+0000","last_became_active":"2024-09-17T03:45:39.083831+0000","last_became_peered":"2024-09-17T03:45:39.083831+0000","last_unstale":"2024-09-17T03:45:41.080963+0000","last_undegraded":"2024-09-17T03:45:41.080963+0000","last_fullsized":"2024-09-17T03:45:41.080963+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:44.013378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080538+0000","last_change":"2024-09-17T03:45:39.080538+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080538+0000","last_undegraded":"2024-09-17T03:45:39.080538+0000","last_fullsized":"2024-09-17T03:45:39.080538+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091084+0000","last_change":"2024-09-17T03:45:39.084802+0000","last_active":"2024-09-17T03:45:39.091084+0000","last_peered":"2024-09-17T03:45:39.091084+0000","last_clean":"2024-09-17T03:45:39.091084+0000","last_became_active":"2024-09-17T03:45:39.084430+0000","last_became_peered":"2024-09-17T03:45:39.084430+0000","last_unstale":"2024-09-17T03:45:39.091084+0000","last_undegraded":"2024-09-17T03:45:39.091084+0000","last_fullsized":"2024-09-17T03:45:39.091084+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:22.720102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074912+0000","last_change":"2024-09-17T03:45:39.074912+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074912+0000","last_undegraded":"2024-09-17T03:45:39.074912+0000","last_fullsized":"2024-09-17T03:45:39.074912+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.087580+0000","last_change":"2024-09-17T03:45:39.085430+0000","last_active":"2024-09-17T03:45:39.087580+0000","last_peered":"2024-09-17T03:45:39.087580+0000","last_clean":"2024-09-17T03:45:39.087580+0000","last_became_active":"2024-09-17T03:45:39.085114+0000","last_became_peered":"2024-09-17T03:45:39.085114+0000","last_unstale":"2024-09-17T03:45:39.087580+0000","last_undegraded":"2024-09-17T03:45:39.087580+0000","last_fullsized":"2024-09-17T03:45:39.087580+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:28.360646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236975+0000","last_change":"2024-09-17T03:45:40.115366+0000","last_active":"2024-09-17T03:45:42.236975+0000","last_peered":"2024-09-17T03:45:42.236975+0000","last_clean":"2024-09-17T03:45:42.236975+0000","last_became_active":"2024-09-17T03:45:40.115007+0000","last_became_peered":"2024-09-17T03:45:40.115007+0000","last_unstale":"2024-09-17T03:45:42.236975+0000","last_undegraded":"2024-09-17T03:45:42.236975+0000","last_fullsized":"2024-09-17T03:45:42.236975+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:00.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086341+0000","last_change":"2024-09-17T03:45:39.084620+0000","last_active":"2024-09-17T03:45:39.086341+0000","last_peered":"2024-09-17T03:45:39.086341+0000","last_clean":"2024-09-17T03:45:39.086341+0000","last_became_active":"2024-09-17T03:45:39.084322+0000","last_became_peered":"2024-09-17T03:45:39.084322+0000","last_unstale":"2024-09-17T03:45:39.086341+0000","last_undegraded":"2024-09-17T03:45:39.086341+0000","last_fullsized":"2024-09-17T03:45:39.086341+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:23.419518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076428+0000","last_change":"2024-09-17T03:45:39.076428+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076428+0000","last_undegraded":"2024-09-17T03:45:39.076428+0000","last_fullsized":"2024-09-17T03:45:39.076428+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"187'6","reported_seq":21,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081163+0000","last_change":"2024-09-17T03:45:39.081186+0000","last_active":"2024-09-17T03:45:41.081163+0000","last_peered":"2024-09-17T03:45:41.081163+0000","last_clean":"2024-09-17T03:45:41.081163+0000","last_became_active":"2024-09-17T03:45:39.080858+0000","last_became_peered":"2024-09-17T03:45:39.080858+0000","last_unstale":"2024-09-17T03:45:41.081163+0000","last_undegraded":"2024-09-17T03:45:41.081163+0000","last_fullsized":"2024-09-17T03:45:41.081163+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:50.084175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078360+0000","last_change":"2024-09-17T03:45:39.078360+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078360+0000","last_undegraded":"2024-09-17T03:45:39.078360+0000","last_fullsized":"2024-09-17T03:45:39.078360+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.092592+0000","last_change":"2024-09-17T03:45:39.092139+0000","last_active":"2024-09-17T03:45:39.092592+0000","last_peered":"2024-09-17T03:45:39.092592+0000","last_clean":"2024-09-17T03:45:39.092592+0000","last_became_active":"2024-09-17T03:45:39.091812+0000","last_became_peered":"2024-09-17T03:45:39.091812+0000","last_unstale":"2024-09-17T03:45:39.092592+0000","last_undegraded":"2024-09-17T03:45:39.092592+0000","last_fullsized":"2024-09-17T03:45:39.092592+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:49.444116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078432+0000","last_change":"2024-09-17T03:45:39.078432+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078432+0000","last_undegraded":"2024-09-17T03:45:39.078432+0000","last_fullsized":"2024-09-17T03:45:39.078432+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.088181+0000","last_change":"2024-09-17T03:45:39.086455+0000","last_active":"2024-09-17T03:45:39.088181+0000","last_peered":"2024-09-17T03:45:39.088181+0000","last_clean":"2024-09-17T03:45:39.088181+0000","last_became_active":"2024-09-17T03:45:39.085888+0000","last_became_peered":"2024-09-17T03:45:39.085888+0000","last_unstale":"2024-09-17T03:45:39.088181+0000","last_undegraded":"2024-09-17T03:45:39.088181+0000","last_fullsized":"2024-09-17T03:45:39.088181+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:53.691121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074412+0000","last_change":"2024-09-17T03:45:39.074412+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074412+0000","last_undegraded":"2024-09-17T03:45:39.074412+0000","last_fullsized":"2024-09-17T03:45:39.074412+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091272+0000","last_change":"2024-09-17T03:45:39.090706+0000","last_active":"2024-09-17T03:45:39.091272+0000","last_peered":"2024-09-17T03:45:39.091272+0000","last_clean":"2024-09-17T03:45:39.091272+0000","last_became_active":"2024-09-17T03:45:39.089835+0000","last_became_peered":"2024-09-17T03:45:39.089835+0000","last_unstale":"2024-09-17T03:45:39.091272+0000","last_undegraded":"2024-09-17T03:45:39.091272+0000","last_fullsized":"2024-09-17T03:45:39.091272+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:08.367552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236471+0000","last_change":"2024-09-17T03:45:40.104541+0000","last_active":"2024-09-17T03:45:42.236471+0000","last_peered":"2024-09-17T03:45:42.236471+0000","last_clean":"2024-09-17T03:45:42.236471+0000","last_became_active":"2024-09-17T03:45:40.103770+0000","last_became_peered":"2024-09-17T03:45:40.103770+0000","last_unstale":"2024-09-17T03:45:42.236471+0000","last_undegraded":"2024-09-17T03:45:42.236471+0000","last_fullsized":"2024-09-17T03:45:42.236471+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:58.697052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090280+0000","last_change":"2024-09-17T03:45:39.086594+0000","last_active":"2024-09-17T03:45:39.090280+0000","last_peered":"2024-09-17T03:45:39.090280+0000","last_clean":"2024-09-17T03:45:39.090280+0000","last_became_active":"2024-09-17T03:45:39.086203+0000","last_became_peered":"2024-09-17T03:45:39.086203+0000","last_unstale":"2024-09-17T03:45:39.090280+0000","last_undegraded":"2024-09-17T03:45:39.090280+0000","last_fullsized":"2024-09-17T03:45:39.090280+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:36.052401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075198+0000","last_change":"2024-09-17T03:45:39.075198+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075198+0000","last_undegraded":"2024-09-17T03:45:39.075198+0000","last_fullsized":"2024-09-17T03:45:39.075198+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091563+0000","last_change":"2024-09-17T03:45:39.089285+0000","last_active":"2024-09-17T03:45:39.091563+0000","last_peered":"2024-09-17T03:45:39.091563+0000","last_clean":"2024-09-17T03:45:39.091563+0000","last_became_active":"2024-09-17T03:45:39.088977+0000","last_became_peered":"2024-09-17T03:45:39.088977+0000","last_unstale":"2024-09-17T03:45:39.091563+0000","last_undegraded":"2024-09-17T03:45:39.091563+0000","last_fullsized":"2024-09-17T03:45:39.091563+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:43.241792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081068+0000","last_change":"2024-09-17T03:45:40.099585+0000","last_active":"2024-09-17T03:45:41.081068+0000","last_peered":"2024-09-17T03:45:41.081068+0000","last_clean":"2024-09-17T03:45:41.081068+0000","last_became_active":"2024-09-17T03:45:40.098940+0000","last_became_peered":"2024-09-17T03:45:40.098940+0000","last_unstale":"2024-09-17T03:45:41.081068+0000","last_undegraded":"2024-09-17T03:45:41.081068+0000","last_fullsized":"2024-09-17T03:45:41.081068+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:37.932568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.083776+0000","last_change":"2024-09-17T03:45:39.082611+0000","last_active":"2024-09-17T03:45:39.083776+0000","last_peered":"2024-09-17T03:45:39.083776+0000","last_clean":"2024-09-17T03:45:39.083776+0000","last_became_active":"2024-09-17T03:45:39.082270+0000","last_became_peered":"2024-09-17T03:45:39.082270+0000","last_unstale":"2024-09-17T03:45:39.083776+0000","last_undegraded":"2024-09-17T03:45:39.083776+0000","last_fullsized":"2024-09-17T03:45:39.083776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:28.552320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076773+0000","last_change":"2024-09-17T03:45:39.076773+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076773+0000","last_undegraded":"2024-09-17T03:45:39.076773+0000","last_fullsized":"2024-09-17T03:45:39.076773+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091411+0000","last_change":"2024-09-17T03:45:39.087408+0000","last_active":"2024-09-17T03:45:39.091411+0000","last_peered":"2024-09-17T03:45:39.091411+0000","last_clean":"2024-09-17T03:45:39.091411+0000","last_became_active":"2024-09-17T03:45:39.087095+0000","last_became_peered":"2024-09-17T03:45:39.087095+0000","last_unstale":"2024-09-17T03:45:39.091411+0000","last_undegraded":"2024-09-17T03:45:39.091411+0000","last_fullsized":"2024-09-17T03:45:39.091411+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:40.161338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.072636+0000","last_change":"2024-09-17T03:45:39.072636+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.072636+0000","last_undegraded":"2024-09-17T03:45:39.072636+0000","last_fullsized":"2024-09-17T03:45:39.072636+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081218+0000","last_change":"2024-09-17T03:45:39.082669+0000","last_active":"2024-09-17T03:45:41.081218+0000","last_peered":"2024-09-17T03:45:41.081218+0000","last_clean":"2024-09-17T03:45:41.081218+0000","last_became_active":"2024-09-17T03:45:39.081790+0000","last_became_peered":"2024-09-17T03:45:39.081790+0000","last_unstale":"2024-09-17T03:45:41.081218+0000","last_undegraded":"2024-09-17T03:45:41.081218+0000","last_fullsized":"2024-09-17T03:45:41.081218+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:48.624264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.082401+0000","last_change":"2024-09-17T03:45:39.082401+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.082401+0000","last_undegraded":"2024-09-17T03:45:39.082401+0000","last_fullsized":"2024-09-17T03:45:39.082401+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086316+0000","last_change":"2024-09-17T03:45:39.079373+0000","last_active":"2024-09-17T03:45:39.086316+0000","last_peered":"2024-09-17T03:45:39.086316+0000","last_clean":"2024-09-17T03:45:39.086316+0000","last_became_active":"2024-09-17T03:45:39.079052+0000","last_became_peered":"2024-09-17T03:45:39.079052+0000","last_unstale":"2024-09-17T03:45:39.086316+0000","last_undegraded":"2024-09-17T03:45:39.086316+0000","last_fullsized":"2024-09-17T03:45:39.086316+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:57.303940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075938+0000","last_change":"2024-09-17T03:45:39.075938+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075938+0000","last_undegraded":"2024-09-17T03:45:39.075938+0000","last_fullsized":"2024-09-17T03:45:39.075938+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236655+0000","last_change":"2024-09-17T03:45:39.089753+0000","last_active":"2024-09-17T03:45:42.236655+0000","last_peered":"2024-09-17T03:45:42.236655+0000","last_clean":"2024-09-17T03:45:42.236655+0000","last_became_active":"2024-09-17T03:45:39.088599+0000","last_became_peered":"2024-09-17T03:45:39.088599+0000","last_unstale":"2024-09-17T03:45:42.236655+0000","last_undegraded":"2024-09-17T03:45:42.236655+0000","last_fullsized":"2024-09-17T03:45:42.236655+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:44.430375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074408+0000","last_change":"2024-09-17T03:45:39.074408+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074408+0000","last_undegraded":"2024-09-17T03:45:39.074408+0000","last_fullsized":"2024-09-17T03:45:39.074408+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236558+0000","last_change":"2024-09-17T03:45:39.087163+0000","last_active":"2024-09-17T03:45:42.236558+0000","last_peered":"2024-09-17T03:45:42.236558+0000","last_clean":"2024-09-17T03:45:42.236558+0000","last_became_active":"2024-09-17T03:45:39.086829+0000","last_became_peered":"2024-09-17T03:45:39.086829+0000","last_unstale":"2024-09-17T03:45:42.236558+0000","last_undegraded":"2024-09-17T03:45:42.236558+0000","last_fullsized":"2024-09-17T03:45:42.236558+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:21.031481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080254+0000","last_change":"2024-09-17T03:45:39.080254+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080254+0000","last_undegraded":"2024-09-17T03:45:39.080254+0000","last_fullsized":"2024-09-17T03:45:39.080254+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.089279+0000","last_change":"2024-09-17T03:45:39.081129+0000","last_active":"2024-09-17T03:45:39.089279+0000","last_peered":"2024-09-17T03:45:39.089279+0000","last_clean":"2024-09-17T03:45:39.089279+0000","last_became_active":"2024-09-17T03:45:39.080824+0000","last_became_peered":"2024-09-17T03:45:39.080824+0000","last_unstale":"2024-09-17T03:45:39.089279+0000","last_undegraded":"2024-09-17T03:45:39.089279+0000","last_fullsized":"2024-09-17T03:45:39.089279+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:14.851401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079612+0000","last_change":"2024-09-17T03:45:39.079612+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079612+0000","last_undegraded":"2024-09-17T03:45:39.079612+0000","last_fullsized":"2024-09-17T03:45:39.079612+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.092754+0000","last_change":"2024-09-17T03:45:39.092155+0000","last_active":"2024-09-17T03:45:39.092754+0000","last_peered":"2024-09-17T03:45:39.092754+0000","last_clean":"2024-09-17T03:45:39.092754+0000","last_became_active":"2024-09-17T03:45:39.091803+0000","last_became_peered":"2024-09-17T03:45:39.091803+0000","last_unstale":"2024-09-17T03:45:39.092754+0000","last_undegraded":"2024-09-17T03:45:39.092754+0000","last_fullsized":"2024-09-17T03:45:39.092754+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:30.581209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073105+0000","last_change":"2024-09-17T03:45:39.073105+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073105+0000","last_undegraded":"2024-09-17T03:45:39.073105+0000","last_fullsized":"2024-09-17T03:45:39.073105+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091136+0000","last_change":"2024-09-17T03:45:39.084693+0000","last_active":"2024-09-17T03:45:39.091136+0000","last_peered":"2024-09-17T03:45:39.091136+0000","last_clean":"2024-09-17T03:45:39.091136+0000","last_became_active":"2024-09-17T03:45:39.084367+0000","last_became_peered":"2024-09-17T03:45:39.084367+0000","last_unstale":"2024-09-17T03:45:39.091136+0000","last_undegraded":"2024-09-17T03:45:39.091136+0000","last_fullsized":"2024-09-17T03:45:39.091136+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:21.772713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076289+0000","last_change":"2024-09-17T03:45:39.076289+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076289+0000","last_undegraded":"2024-09-17T03:45:39.076289+0000","last_fullsized":"2024-09-17T03:45:39.076289+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091383+0000","last_change":"2024-09-17T03:45:39.087016+0000","last_active":"2024-09-17T03:45:39.091383+0000","last_peered":"2024-09-17T03:45:39.091383+0000","last_clean":"2024-09-17T03:45:39.091383+0000","last_became_active":"2024-09-17T03:45:39.086671+0000","last_became_peered":"2024-09-17T03:45:39.086671+0000","last_unstale":"2024-09-17T03:45:39.091383+0000","last_undegraded":"2024-09-17T03:45:39.091383+0000","last_fullsized":"2024-09-17T03:45:39.091383+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:19.011769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079037+0000","last_change":"2024-09-17T03:45:39.079037+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079037+0000","last_undegraded":"2024-09-17T03:45:39.079037+0000","last_fullsized":"2024-09-17T03:45:39.079037+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091928+0000","last_change":"2024-09-17T03:45:39.091076+0000","last_active":"2024-09-17T03:45:39.091928+0000","last_peered":"2024-09-17T03:45:39.091928+0000","last_clean":"2024-09-17T03:45:39.091928+0000","last_became_active":"2024-09-17T03:45:39.090678+0000","last_became_peered":"2024-09-17T03:45:39.090678+0000","last_unstale":"2024-09-17T03:45:39.091928+0000","last_undegraded":"2024-09-17T03:45:39.091928+0000","last_fullsized":"2024-09-17T03:45:39.091928+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:57.888711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079276+0000","last_change":"2024-09-17T03:45:39.079276+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079276+0000","last_undegraded":"2024-09-17T03:45:39.079276+0000","last_fullsized":"2024-09-17T03:45:39.079276+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236611+0000","last_change":"2024-09-17T03:45:39.092305+0000","last_active":"2024-09-17T03:45:42.236611+0000","last_peered":"2024-09-17T03:45:42.236611+0000","last_clean":"2024-09-17T03:45:42.236611+0000","last_became_active":"2024-09-17T03:45:39.091982+0000","last_became_peered":"2024-09-17T03:45:39.091982+0000","last_unstale":"2024-09-17T03:45:42.236611+0000","last_undegraded":"2024-09-17T03:45:42.236611+0000","last_fullsized":"2024-09-17T03:45:42.236611+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:31.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073819+0000","last_change":"2024-09-17T03:45:39.073819+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073819+0000","last_undegraded":"2024-09-17T03:45:39.073819+0000","last_fullsized":"2024-09-17T03:45:39.073819+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.085964+0000","last_change":"2024-09-17T03:45:39.084602+0000","last_active":"2024-09-17T03:45:39.085964+0000","last_peered":"2024-09-17T03:45:39.085964+0000","last_clean":"2024-09-17T03:45:39.085964+0000","last_became_active":"2024-09-17T03:45:39.084286+0000","last_became_peered":"2024-09-17T03:45:39.084286+0000","last_unstale":"2024-09-17T03:45:39.085964+0000","last_undegraded":"2024-09-17T03:45:39.085964+0000","last_fullsized":"2024-09-17T03:45:39.085964+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:23.641470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073813+0000","last_change":"2024-09-17T03:45:39.073813+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073813+0000","last_undegraded":"2024-09-17T03:45:39.073813+0000","last_fullsized":"2024-09-17T03:45:39.073813+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090953+0000","last_change":"2024-09-17T03:45:39.089774+0000","last_active":"2024-09-17T03:45:39.090953+0000","last_peered":"2024-09-17T03:45:39.090953+0000","last_clean":"2024-09-17T03:45:39.090953+0000","last_became_active":"2024-09-17T03:45:39.089502+0000","last_became_peered":"2024-09-17T03:45:39.089502+0000","last_unstale":"2024-09-17T03:45:39.090953+0000","last_undegraded":"2024-09-17T03:45:39.090953+0000","last_fullsized":"2024-09-17T03:45:39.090953+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:38.714674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.072524+0000","last_change":"2024-09-17T03:45:39.072524+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.072524+0000","last_undegraded":"2024-09-17T03:45:39.072524+0000","last_fullsized":"2024-09-17T03:45:39.072524+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086606+0000","last_change":"2024-09-17T03:45:39.080285+0000","last_active":"2024-09-17T03:45:39.086606+0000","last_peered":"2024-09-17T03:45:39.086606+0000","last_clean":"2024-09-17T03:45:39.086606+0000","last_became_active":"2024-09-17T03:45:39.079973+0000","last_became_peered":"2024-09-17T03:45:39.079973+0000","last_unstale":"2024-09-17T03:45:39.086606+0000","last_undegraded":"2024-09-17T03:45:39.086606+0000","last_fullsized":"2024-09-17T03:45:39.086606+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:16.852797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073628+0000","last_change":"2024-09-17T03:45:39.073628+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073628+0000","last_undegraded":"2024-09-17T03:45:39.073628+0000","last_fullsized":"2024-09-17T03:45:39.073628+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"187'2","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236742+0000","last_change":"2024-09-17T03:45:39.090713+0000","last_active":"2024-09-17T03:45:42.236742+0000","last_peered":"2024-09-17T03:45:42.236742+0000","last_clean":"2024-09-17T03:45:42.236742+0000","last_became_active":"2024-09-17T03:45:39.090324+0000","last_became_peered":"2024-09-17T03:45:39.090324+0000","last_unstale":"2024-09-17T03:45:42.236742+0000","last_undegraded":"2024-09-17T03:45:42.236742+0000","last_fullsized":"2024-09-17T03:45:42.236742+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:27.632921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":413,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.073852+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:45:39.073852+0000","last_peered":"2024-09-17T03:45:39.073852+0000","last_clean":"2024-09-17T03:45:39.073852+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:45:39.073852+0000","last_undegraded":"2024-09-17T03:45:39.073852+0000","last_fullsized":"2024-09-17T03:45:39.073852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509598,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60432,"kb_used_data":2868,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311408,"statfs":{"total":96636764160,"available":96574881792,"internally_reserved":0,"allocated":2936832,"data_stored":1619468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59848,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311992,"statfs":{"total":96636764160,"available":96575479808,"internally_reserved":0,"allocated":2342912,"data_stored":1029100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509598,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55676,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316164,"statfs":{"total":96636764160,"available":96579751936,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509599,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56272,"kb_used_data":2868,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":2936832,"data_stored":1619468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55708,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316132,"statfs":{"total":96636764160,"available":96579719168,"internally_reserved":0,"allocated":2367488,"data_stored":1042175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55732,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316108,"statfs":{"total":96636764160,"available":96579694592,"internally_reserved":0,"allocated":2383872,"data_stored":1043857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:45:44.459 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:45:44.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.609+0000 7f07d7f2b640 1 -- 172.21.15.146:0/4206788280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07d015ec30 msgr2=0x7f07d0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.609+0000 7f07d7f2b640 1 --2- 172.21.15.146:0/4206788280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07d015ec30 0x7f07d0068d00 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f07d0074f00 tx=0x7f07c002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.609+0000 7f07d7f2b640 1 -- 172.21.15.146:0/4206788280 shutdown_connections 2024-09-17T03:45:44.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.609+0000 7f07d7f2b640 1 --2- 172.21.15.146:0/4206788280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07d015ec30 0x7f07d0068d00 unknown :-1 s=CLOSED pgs=2424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.609+0000 7f07d7f2b640 1 --2- 172.21.15.146:0/4206788280 >> v2:172.21.15.179:3300/0 conn(0x7f07d00b36b0 0x7f07d00b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.609+0000 7f07d7f2b640 1 -- 172.21.15.146:0/4206788280 >> 172.21.15.146:0/4206788280 conn(0x7f07d00d4960 msgr2=0x7f07d00d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:44.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.610+0000 7f07d7f2b640 1 -- 172.21.15.146:0/4206788280 shutdown_connections 2024-09-17T03:45:44.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.610+0000 7f07d7f2b640 1 -- 172.21.15.146:0/4206788280 wait complete. 2024-09-17T03:45:44.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.611+0000 7f07d7f2b640 1 Processor -- start 2024-09-17T03:45:44.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.611+0000 7f07d7f2b640 1 -- start start 2024-09-17T03:45:44.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d7f2b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07d0069240 0x7f07d00ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.616 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d7f2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07d00b36b0 0x7f07d01f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d7f2b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07d015ec30 0x7f07d01f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d7f2b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f07d00d3770 con 0x7f07d00b36b0 2024-09-17T03:45:44.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d7f2b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f07d00d35f0 con 0x7f07d0069240 2024-09-17T03:45:44.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d7f2b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f07d00d38f0 con 0x7f07d015ec30 2024-09-17T03:45:44.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d54c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07d00b36b0 0x7f07d01f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d54c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07d00b36b0 0x7f07d01f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45514/0 (socket says 172.21.15.146:45514) 2024-09-17T03:45:44.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d54c6640 1 -- 172.21.15.146:0/3491818088 learned_addr learned my addr 172.21.15.146:0/3491818088 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:44.617 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d54c6640 1 -- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07d015ec30 msgr2=0x7f07d01f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d64c8640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07d015ec30 0x7f07d01f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d5cc7640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07d0069240 0x7f07d00ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d54c6640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07d015ec30 0x7f07d01f6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d54c6640 1 -- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07d0069240 msgr2=0x7f07d00ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d54c6640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07d0069240 0x7f07d00ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d54c6640 1 -- 172.21.15.146:0/3491818088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d01f6ad0 con 0x7f07d00b36b0 2024-09-17T03:45:44.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d54c6640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07d00b36b0 0x7f07d01f5d50 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f07c0034040 tx=0x7f07c00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07c67fc640 1 -- 172.21.15.146:0/3491818088 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c003e030 con 0x7f07d00b36b0 2024-09-17T03:45:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07c67fc640 1 -- 172.21.15.146:0/3491818088 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07c00047a0 con 0x7f07d00b36b0 2024-09-17T03:45:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07d7f2b640 1 -- 172.21.15.146:0/3491818088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d01f7090 con 0x7f07d00b36b0 2024-09-17T03:45:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.613+0000 7f07c67fc640 1 -- 172.21.15.146:0/3491818088 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0035040 con 0x7f07d00b36b0 2024-09-17T03:45:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.614+0000 7f07d7f2b640 1 -- 172.21.15.146:0/3491818088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d01f7650 con 0x7f07d00b36b0 2024-09-17T03:45:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.614+0000 7f07d7f2b640 1 -- 172.21.15.146:0/3491818088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d00b9e40 con 0x7f07d00b36b0 2024-09-17T03:45:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.615+0000 7f07c67fc640 1 -- 172.21.15.146:0/3491818088 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07c0041030 con 0x7f07d00b36b0 2024-09-17T03:45:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.616+0000 7f07c67fc640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f07b4078bc0 0x7f07b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.616+0000 7f07c67fc640 1 -- 172.21.15.146:0/3491818088 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f07c00bb490 con 0x7f07d00b36b0 2024-09-17T03:45:44.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.616+0000 7f07d5cc7640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f07b4078bc0 0x7f07b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.616+0000 7f07d5cc7640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f07b4078bc0 0x7f07b407b0d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0058c0 tx=0x7f07cc005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:44.620 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.620+0000 7f07c67fc640 1 -- 172.21.15.146:0/3491818088 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f07d00b9e40 con 0x7f07d00b36b0 2024-09-17T03:45:44.678 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-09-17T03:45:44.677+0000 7fdca0e54640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:45:44.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.791+0000 7f07d7f2b640 1 -- 172.21.15.146:0/3491818088 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07d01f6860 con 0x7f07b4078bc0 2024-09-17T03:45:44.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.796+0000 7f07c67fc640 1 -- 172.21.15.146:0/3491818088 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248200 (secure 0 0 0) 0x7f07d01f6860 con 0x7f07b4078bc0 2024-09-17T03:45:44.799 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 -- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f07b4078bc0 msgr2=0x7f07b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f07b4078bc0 0x7f07b407b0d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0058c0 tx=0x7f07cc005850 comp rx=0 tx=0).stop 2024-09-17T03:45:44.801 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 -- 172.21.15.146:0/3491818088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07d00b36b0 msgr2=0x7f07d01f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07d00b36b0 0x7f07d01f5d50 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f07c0034040 tx=0x7f07c00039e0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 -- 172.21.15.146:0/3491818088 shutdown_connections 2024-09-17T03:45:44.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f07b4078bc0 0x7f07b407b0d0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f07d015ec30 0x7f07d01f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07d00b36b0 0x7f07d01f5d50 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 --2- 172.21.15.146:0/3491818088 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07d0069240 0x7f07d00ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 -- 172.21.15.146:0/3491818088 >> 172.21.15.146:0/3491818088 conn(0x7f07d00d4960 msgr2=0x7f07d00b94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:44.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 -- 172.21.15.146:0/3491818088 shutdown_connections 2024-09-17T03:45:44.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.799+0000 7f07d7f2b640 1 -- 172.21.15.146:0/3491818088 wait complete. 2024-09-17T03:45:44.811 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":570,"stamp":"2024-09-17T03:45:43.995072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":468836,"kb_used_data":19492,"kb_used_omap":12,"kb_used_meta":449139,"kb_avail":754505884,"statfs":{"total":773094113280,"available":772614025216,"internally_reserved":0,"allocated":19959808,"data_stored":9422543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":459918897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.927923"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075903+0000","last_change":"2024-09-17T03:45:39.075903+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075903+0000","last_undegraded":"2024-09-17T03:45:39.075903+0000","last_fullsized":"2024-09-17T03:45:39.075903+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.081051+0000","last_change":"2024-09-17T03:45:39.081051+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.081051+0000","last_undegraded":"2024-09-17T03:45:39.081051+0000","last_fullsized":"2024-09-17T03:45:39.081051+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074723+0000","last_change":"2024-09-17T03:45:39.074723+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074723+0000","last_undegraded":"2024-09-17T03:45:39.074723+0000","last_fullsized":"2024-09-17T03:45:39.074723+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.077089+0000","last_change":"2024-09-17T03:45:39.077089+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.077089+0000","last_undegraded":"2024-09-17T03:45:39.077089+0000","last_fullsized":"2024-09-17T03:45:39.077089+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076736+0000","last_change":"2024-09-17T03:45:39.076736+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076736+0000","last_undegraded":"2024-09-17T03:45:39.076736+0000","last_fullsized":"2024-09-17T03:45:39.076736+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080839+0000","last_change":"2024-09-17T03:45:40.094260+0000","last_active":"2024-09-17T03:45:41.080839+0000","last_peered":"2024-09-17T03:45:41.080839+0000","last_clean":"2024-09-17T03:45:41.080839+0000","last_became_active":"2024-09-17T03:45:40.093926+0000","last_became_peered":"2024-09-17T03:45:40.093926+0000","last_unstale":"2024-09-17T03:45:41.080839+0000","last_undegraded":"2024-09-17T03:45:41.080839+0000","last_fullsized":"2024-09-17T03:45:41.080839+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:51.030663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074911+0000","last_change":"2024-09-17T03:45:39.074911+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074911+0000","last_undegraded":"2024-09-17T03:45:39.074911+0000","last_fullsized":"2024-09-17T03:45:39.074911+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078031+0000","last_change":"2024-09-17T03:45:39.078031+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078031+0000","last_undegraded":"2024-09-17T03:45:39.078031+0000","last_fullsized":"2024-09-17T03:45:39.078031+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075242+0000","last_change":"2024-09-17T03:45:39.075242+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075242+0000","last_undegraded":"2024-09-17T03:45:39.075242+0000","last_fullsized":"2024-09-17T03:45:39.075242+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081022+0000","last_change":"2024-09-17T03:45:40.088843+0000","last_active":"2024-09-17T03:45:41.081022+0000","last_peered":"2024-09-17T03:45:41.081022+0000","last_clean":"2024-09-17T03:45:41.081022+0000","last_became_active":"2024-09-17T03:45:40.088441+0000","last_became_peered":"2024-09-17T03:45:40.088441+0000","last_unstale":"2024-09-17T03:45:41.081022+0000","last_undegraded":"2024-09-17T03:45:41.081022+0000","last_fullsized":"2024-09-17T03:45:41.081022+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:25.818571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076898+0000","last_change":"2024-09-17T03:45:39.076898+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076898+0000","last_undegraded":"2024-09-17T03:45:39.076898+0000","last_fullsized":"2024-09-17T03:45:39.076898+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080082+0000","last_change":"2024-09-17T03:45:39.080082+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080082+0000","last_undegraded":"2024-09-17T03:45:39.080082+0000","last_fullsized":"2024-09-17T03:45:39.080082+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079648+0000","last_change":"2024-09-17T03:45:39.079648+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079648+0000","last_undegraded":"2024-09-17T03:45:39.079648+0000","last_fullsized":"2024-09-17T03:45:39.079648+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236781+0000","last_change":"2024-09-17T03:45:40.097641+0000","last_active":"2024-09-17T03:45:42.236781+0000","last_peered":"2024-09-17T03:45:42.236781+0000","last_clean":"2024-09-17T03:45:42.236781+0000","last_became_active":"2024-09-17T03:45:40.097332+0000","last_became_peered":"2024-09-17T03:45:40.097332+0000","last_unstale":"2024-09-17T03:45:42.236781+0000","last_undegraded":"2024-09-17T03:45:42.236781+0000","last_fullsized":"2024-09-17T03:45:42.236781+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:05.537118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078267+0000","last_change":"2024-09-17T03:45:39.078267+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078267+0000","last_undegraded":"2024-09-17T03:45:39.078267+0000","last_fullsized":"2024-09-17T03:45:39.078267+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.077965+0000","last_change":"2024-09-17T03:45:39.077965+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.077965+0000","last_undegraded":"2024-09-17T03:45:39.077965+0000","last_fullsized":"2024-09-17T03:45:39.077965+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236848+0000","last_change":"2024-09-17T03:45:40.096699+0000","last_active":"2024-09-17T03:45:42.236848+0000","last_peered":"2024-09-17T03:45:42.236848+0000","last_clean":"2024-09-17T03:45:42.236848+0000","last_became_active":"2024-09-17T03:45:40.096266+0000","last_became_peered":"2024-09-17T03:45:40.096266+0000","last_unstale":"2024-09-17T03:45:42.236848+0000","last_undegraded":"2024-09-17T03:45:42.236848+0000","last_fullsized":"2024-09-17T03:45:42.236848+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:33.456335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081247+0000","last_change":"2024-09-17T03:45:40.099955+0000","last_active":"2024-09-17T03:45:41.081247+0000","last_peered":"2024-09-17T03:45:41.081247+0000","last_clean":"2024-09-17T03:45:41.081247+0000","last_became_active":"2024-09-17T03:45:40.099354+0000","last_became_peered":"2024-09-17T03:45:40.099354+0000","last_unstale":"2024-09-17T03:45:41.081247+0000","last_undegraded":"2024-09-17T03:45:41.081247+0000","last_fullsized":"2024-09-17T03:45:41.081247+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:44.534249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078571+0000","last_change":"2024-09-17T03:45:39.078571+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078571+0000","last_undegraded":"2024-09-17T03:45:39.078571+0000","last_fullsized":"2024-09-17T03:45:39.078571+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081175+0000","last_change":"2024-09-17T03:45:40.086824+0000","last_active":"2024-09-17T03:45:41.081175+0000","last_peered":"2024-09-17T03:45:41.081175+0000","last_clean":"2024-09-17T03:45:41.081175+0000","last_became_active":"2024-09-17T03:45:40.086494+0000","last_became_peered":"2024-09-17T03:45:40.086494+0000","last_unstale":"2024-09-17T03:45:41.081175+0000","last_undegraded":"2024-09-17T03:45:41.081175+0000","last_fullsized":"2024-09-17T03:45:41.081175+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:37.172331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076200+0000","last_change":"2024-09-17T03:45:39.076200+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076200+0000","last_undegraded":"2024-09-17T03:45:39.076200+0000","last_fullsized":"2024-09-17T03:45:39.076200+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078806+0000","last_change":"2024-09-17T03:45:39.078806+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078806+0000","last_undegraded":"2024-09-17T03:45:39.078806+0000","last_fullsized":"2024-09-17T03:45:39.078806+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073115+0000","last_change":"2024-09-17T03:45:39.073115+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073115+0000","last_undegraded":"2024-09-17T03:45:39.073115+0000","last_fullsized":"2024-09-17T03:45:39.073115+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080048+0000","last_change":"2024-09-17T03:45:39.080048+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080048+0000","last_undegraded":"2024-09-17T03:45:39.080048+0000","last_fullsized":"2024-09-17T03:45:39.080048+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075372+0000","last_change":"2024-09-17T03:45:39.075372+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075372+0000","last_undegraded":"2024-09-17T03:45:39.075372+0000","last_fullsized":"2024-09-17T03:45:39.075372+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076918+0000","last_change":"2024-09-17T03:45:39.076918+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076918+0000","last_undegraded":"2024-09-17T03:45:39.076918+0000","last_fullsized":"2024-09-17T03:45:39.076918+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075469+0000","last_change":"2024-09-17T03:45:39.075469+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075469+0000","last_undegraded":"2024-09-17T03:45:39.075469+0000","last_fullsized":"2024-09-17T03:45:39.075469+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081077+0000","last_change":"2024-09-17T03:45:40.086000+0000","last_active":"2024-09-17T03:45:41.081077+0000","last_peered":"2024-09-17T03:45:41.081077+0000","last_clean":"2024-09-17T03:45:41.081077+0000","last_became_active":"2024-09-17T03:45:40.085687+0000","last_became_peered":"2024-09-17T03:45:40.085687+0000","last_unstale":"2024-09-17T03:45:41.081077+0000","last_undegraded":"2024-09-17T03:45:41.081077+0000","last_fullsized":"2024-09-17T03:45:41.081077+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:00.244977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236769+0000","last_change":"2024-09-17T03:45:40.115475+0000","last_active":"2024-09-17T03:45:42.236769+0000","last_peered":"2024-09-17T03:45:42.236769+0000","last_clean":"2024-09-17T03:45:42.236769+0000","last_became_active":"2024-09-17T03:45:40.115119+0000","last_became_peered":"2024-09-17T03:45:40.115119+0000","last_unstale":"2024-09-17T03:45:42.236769+0000","last_undegraded":"2024-09-17T03:45:42.236769+0000","last_fullsized":"2024-09-17T03:45:42.236769+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:28.743773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074566+0000","last_change":"2024-09-17T03:45:39.074566+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074566+0000","last_undegraded":"2024-09-17T03:45:39.074566+0000","last_fullsized":"2024-09-17T03:45:39.074566+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.081282+0000","last_change":"2024-09-17T03:45:39.081282+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.081282+0000","last_undegraded":"2024-09-17T03:45:39.081282+0000","last_fullsized":"2024-09-17T03:45:39.081282+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078984+0000","last_change":"2024-09-17T03:45:39.078984+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078984+0000","last_undegraded":"2024-09-17T03:45:39.078984+0000","last_fullsized":"2024-09-17T03:45:39.078984+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073306+0000","last_change":"2024-09-17T03:45:39.073306+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073306+0000","last_undegraded":"2024-09-17T03:45:39.073306+0000","last_fullsized":"2024-09-17T03:45:39.073306+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.088440+0000","last_change":"2024-09-17T03:45:39.087440+0000","last_active":"2024-09-17T03:45:39.088440+0000","last_peered":"2024-09-17T03:45:39.088440+0000","last_clean":"2024-09-17T03:45:39.088440+0000","last_became_active":"2024-09-17T03:45:39.086846+0000","last_became_peered":"2024-09-17T03:45:39.086846+0000","last_unstale":"2024-09-17T03:45:39.088440+0000","last_undegraded":"2024-09-17T03:45:39.088440+0000","last_fullsized":"2024-09-17T03:45:39.088440+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:17.792016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074721+0000","last_change":"2024-09-17T03:45:39.074721+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074721+0000","last_undegraded":"2024-09-17T03:45:39.074721+0000","last_fullsized":"2024-09-17T03:45:39.074721+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090581+0000","last_change":"2024-09-17T03:45:39.088533+0000","last_active":"2024-09-17T03:45:39.090581+0000","last_peered":"2024-09-17T03:45:39.090581+0000","last_clean":"2024-09-17T03:45:39.090581+0000","last_became_active":"2024-09-17T03:45:39.088224+0000","last_became_peered":"2024-09-17T03:45:39.088224+0000","last_unstale":"2024-09-17T03:45:39.090581+0000","last_undegraded":"2024-09-17T03:45:39.090581+0000","last_fullsized":"2024-09-17T03:45:39.090581+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:10.528815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236802+0000","last_change":"2024-09-17T03:45:40.115893+0000","last_active":"2024-09-17T03:45:42.236802+0000","last_peered":"2024-09-17T03:45:42.236802+0000","last_clean":"2024-09-17T03:45:42.236802+0000","last_became_active":"2024-09-17T03:45:40.114920+0000","last_became_peered":"2024-09-17T03:45:40.114920+0000","last_unstale":"2024-09-17T03:45:42.236802+0000","last_undegraded":"2024-09-17T03:45:42.236802+0000","last_fullsized":"2024-09-17T03:45:42.236802+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:18.878101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091413+0000","last_change":"2024-09-17T03:45:39.089597+0000","last_active":"2024-09-17T03:45:39.091413+0000","last_peered":"2024-09-17T03:45:39.091413+0000","last_clean":"2024-09-17T03:45:39.091413+0000","last_became_active":"2024-09-17T03:45:39.089273+0000","last_became_peered":"2024-09-17T03:45:39.089273+0000","last_unstale":"2024-09-17T03:45:39.091413+0000","last_undegraded":"2024-09-17T03:45:39.091413+0000","last_fullsized":"2024-09-17T03:45:39.091413+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:20.201366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074049+0000","last_change":"2024-09-17T03:45:39.074049+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074049+0000","last_undegraded":"2024-09-17T03:45:39.074049+0000","last_fullsized":"2024-09-17T03:45:39.074049+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.089266+0000","last_change":"2024-09-17T03:45:39.087754+0000","last_active":"2024-09-17T03:45:39.089266+0000","last_peered":"2024-09-17T03:45:39.089266+0000","last_clean":"2024-09-17T03:45:39.089266+0000","last_became_active":"2024-09-17T03:45:39.087430+0000","last_became_peered":"2024-09-17T03:45:39.087430+0000","last_unstale":"2024-09-17T03:45:39.089266+0000","last_undegraded":"2024-09-17T03:45:39.089266+0000","last_fullsized":"2024-09-17T03:45:39.089266+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:59.744416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075603+0000","last_change":"2024-09-17T03:45:39.075603+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075603+0000","last_undegraded":"2024-09-17T03:45:39.075603+0000","last_fullsized":"2024-09-17T03:45:39.075603+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091014+0000","last_change":"2024-09-17T03:45:39.088456+0000","last_active":"2024-09-17T03:45:39.091014+0000","last_peered":"2024-09-17T03:45:39.091014+0000","last_clean":"2024-09-17T03:45:39.091014+0000","last_became_active":"2024-09-17T03:45:39.088150+0000","last_became_peered":"2024-09-17T03:45:39.088150+0000","last_unstale":"2024-09-17T03:45:39.091014+0000","last_undegraded":"2024-09-17T03:45:39.091014+0000","last_fullsized":"2024-09-17T03:45:39.091014+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:56.658865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080945+0000","last_change":"2024-09-17T03:45:40.085937+0000","last_active":"2024-09-17T03:45:41.080945+0000","last_peered":"2024-09-17T03:45:41.080945+0000","last_clean":"2024-09-17T03:45:41.080945+0000","last_became_active":"2024-09-17T03:45:40.085615+0000","last_became_peered":"2024-09-17T03:45:40.085615+0000","last_unstale":"2024-09-17T03:45:41.080945+0000","last_undegraded":"2024-09-17T03:45:41.080945+0000","last_fullsized":"2024-09-17T03:45:41.080945+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:42.747919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236272+0000","last_change":"2024-09-17T03:45:39.088411+0000","last_active":"2024-09-17T03:45:42.236272+0000","last_peered":"2024-09-17T03:45:42.236272+0000","last_clean":"2024-09-17T03:45:42.236272+0000","last_became_active":"2024-09-17T03:45:39.088023+0000","last_became_peered":"2024-09-17T03:45:39.088023+0000","last_unstale":"2024-09-17T03:45:42.236272+0000","last_undegraded":"2024-09-17T03:45:42.236272+0000","last_fullsized":"2024-09-17T03:45:42.236272+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.002205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078676+0000","last_change":"2024-09-17T03:45:39.078676+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078676+0000","last_undegraded":"2024-09-17T03:45:39.078676+0000","last_fullsized":"2024-09-17T03:45:39.078676+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080963+0000","last_change":"2024-09-17T03:45:39.084140+0000","last_active":"2024-09-17T03:45:41.080963+0000","last_peered":"2024-09-17T03:45:41.080963+0000","last_clean":"2024-09-17T03:45:41.080963+0000","last_became_active":"2024-09-17T03:45:39.083831+0000","last_became_peered":"2024-09-17T03:45:39.083831+0000","last_unstale":"2024-09-17T03:45:41.080963+0000","last_undegraded":"2024-09-17T03:45:41.080963+0000","last_fullsized":"2024-09-17T03:45:41.080963+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:44.013378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080538+0000","last_change":"2024-09-17T03:45:39.080538+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080538+0000","last_undegraded":"2024-09-17T03:45:39.080538+0000","last_fullsized":"2024-09-17T03:45:39.080538+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091084+0000","last_change":"2024-09-17T03:45:39.084802+0000","last_active":"2024-09-17T03:45:39.091084+0000","last_peered":"2024-09-17T03:45:39.091084+0000","last_clean":"2024-09-17T03:45:39.091084+0000","last_became_active":"2024-09-17T03:45:39.084430+0000","last_became_peered":"2024-09-17T03:45:39.084430+0000","last_unstale":"2024-09-17T03:45:39.091084+0000","last_undegraded":"2024-09-17T03:45:39.091084+0000","last_fullsized":"2024-09-17T03:45:39.091084+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:22.720102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074912+0000","last_change":"2024-09-17T03:45:39.074912+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074912+0000","last_undegraded":"2024-09-17T03:45:39.074912+0000","last_fullsized":"2024-09-17T03:45:39.074912+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.087580+0000","last_change":"2024-09-17T03:45:39.085430+0000","last_active":"2024-09-17T03:45:39.087580+0000","last_peered":"2024-09-17T03:45:39.087580+0000","last_clean":"2024-09-17T03:45:39.087580+0000","last_became_active":"2024-09-17T03:45:39.085114+0000","last_became_peered":"2024-09-17T03:45:39.085114+0000","last_unstale":"2024-09-17T03:45:39.087580+0000","last_undegraded":"2024-09-17T03:45:39.087580+0000","last_fullsized":"2024-09-17T03:45:39.087580+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:28.360646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236975+0000","last_change":"2024-09-17T03:45:40.115366+0000","last_active":"2024-09-17T03:45:42.236975+0000","last_peered":"2024-09-17T03:45:42.236975+0000","last_clean":"2024-09-17T03:45:42.236975+0000","last_became_active":"2024-09-17T03:45:40.115007+0000","last_became_peered":"2024-09-17T03:45:40.115007+0000","last_unstale":"2024-09-17T03:45:42.236975+0000","last_undegraded":"2024-09-17T03:45:42.236975+0000","last_fullsized":"2024-09-17T03:45:42.236975+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:00.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086341+0000","last_change":"2024-09-17T03:45:39.084620+0000","last_active":"2024-09-17T03:45:39.086341+0000","last_peered":"2024-09-17T03:45:39.086341+0000","last_clean":"2024-09-17T03:45:39.086341+0000","last_became_active":"2024-09-17T03:45:39.084322+0000","last_became_peered":"2024-09-17T03:45:39.084322+0000","last_unstale":"2024-09-17T03:45:39.086341+0000","last_undegraded":"2024-09-17T03:45:39.086341+0000","last_fullsized":"2024-09-17T03:45:39.086341+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:23.419518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076428+0000","last_change":"2024-09-17T03:45:39.076428+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076428+0000","last_undegraded":"2024-09-17T03:45:39.076428+0000","last_fullsized":"2024-09-17T03:45:39.076428+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"187'6","reported_seq":21,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081163+0000","last_change":"2024-09-17T03:45:39.081186+0000","last_active":"2024-09-17T03:45:41.081163+0000","last_peered":"2024-09-17T03:45:41.081163+0000","last_clean":"2024-09-17T03:45:41.081163+0000","last_became_active":"2024-09-17T03:45:39.080858+0000","last_became_peered":"2024-09-17T03:45:39.080858+0000","last_unstale":"2024-09-17T03:45:41.081163+0000","last_undegraded":"2024-09-17T03:45:41.081163+0000","last_fullsized":"2024-09-17T03:45:41.081163+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:50.084175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078360+0000","last_change":"2024-09-17T03:45:39.078360+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078360+0000","last_undegraded":"2024-09-17T03:45:39.078360+0000","last_fullsized":"2024-09-17T03:45:39.078360+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.092592+0000","last_change":"2024-09-17T03:45:39.092139+0000","last_active":"2024-09-17T03:45:39.092592+0000","last_peered":"2024-09-17T03:45:39.092592+0000","last_clean":"2024-09-17T03:45:39.092592+0000","last_became_active":"2024-09-17T03:45:39.091812+0000","last_became_peered":"2024-09-17T03:45:39.091812+0000","last_unstale":"2024-09-17T03:45:39.092592+0000","last_undegraded":"2024-09-17T03:45:39.092592+0000","last_fullsized":"2024-09-17T03:45:39.092592+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:49.444116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078432+0000","last_change":"2024-09-17T03:45:39.078432+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078432+0000","last_undegraded":"2024-09-17T03:45:39.078432+0000","last_fullsized":"2024-09-17T03:45:39.078432+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.088181+0000","last_change":"2024-09-17T03:45:39.086455+0000","last_active":"2024-09-17T03:45:39.088181+0000","last_peered":"2024-09-17T03:45:39.088181+0000","last_clean":"2024-09-17T03:45:39.088181+0000","last_became_active":"2024-09-17T03:45:39.085888+0000","last_became_peered":"2024-09-17T03:45:39.085888+0000","last_unstale":"2024-09-17T03:45:39.088181+0000","last_undegraded":"2024-09-17T03:45:39.088181+0000","last_fullsized":"2024-09-17T03:45:39.088181+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:53.691121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074412+0000","last_change":"2024-09-17T03:45:39.074412+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074412+0000","last_undegraded":"2024-09-17T03:45:39.074412+0000","last_fullsized":"2024-09-17T03:45:39.074412+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091272+0000","last_change":"2024-09-17T03:45:39.090706+0000","last_active":"2024-09-17T03:45:39.091272+0000","last_peered":"2024-09-17T03:45:39.091272+0000","last_clean":"2024-09-17T03:45:39.091272+0000","last_became_active":"2024-09-17T03:45:39.089835+0000","last_became_peered":"2024-09-17T03:45:39.089835+0000","last_unstale":"2024-09-17T03:45:39.091272+0000","last_undegraded":"2024-09-17T03:45:39.091272+0000","last_fullsized":"2024-09-17T03:45:39.091272+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:08.367552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236471+0000","last_change":"2024-09-17T03:45:40.104541+0000","last_active":"2024-09-17T03:45:42.236471+0000","last_peered":"2024-09-17T03:45:42.236471+0000","last_clean":"2024-09-17T03:45:42.236471+0000","last_became_active":"2024-09-17T03:45:40.103770+0000","last_became_peered":"2024-09-17T03:45:40.103770+0000","last_unstale":"2024-09-17T03:45:42.236471+0000","last_undegraded":"2024-09-17T03:45:42.236471+0000","last_fullsized":"2024-09-17T03:45:42.236471+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:58.697052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090280+0000","last_change":"2024-09-17T03:45:39.086594+0000","last_active":"2024-09-17T03:45:39.090280+0000","last_peered":"2024-09-17T03:45:39.090280+0000","last_clean":"2024-09-17T03:45:39.090280+0000","last_became_active":"2024-09-17T03:45:39.086203+0000","last_became_peered":"2024-09-17T03:45:39.086203+0000","last_unstale":"2024-09-17T03:45:39.090280+0000","last_undegraded":"2024-09-17T03:45:39.090280+0000","last_fullsized":"2024-09-17T03:45:39.090280+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:36.052401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075198+0000","last_change":"2024-09-17T03:45:39.075198+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075198+0000","last_undegraded":"2024-09-17T03:45:39.075198+0000","last_fullsized":"2024-09-17T03:45:39.075198+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091563+0000","last_change":"2024-09-17T03:45:39.089285+0000","last_active":"2024-09-17T03:45:39.091563+0000","last_peered":"2024-09-17T03:45:39.091563+0000","last_clean":"2024-09-17T03:45:39.091563+0000","last_became_active":"2024-09-17T03:45:39.088977+0000","last_became_peered":"2024-09-17T03:45:39.088977+0000","last_unstale":"2024-09-17T03:45:39.091563+0000","last_undegraded":"2024-09-17T03:45:39.091563+0000","last_fullsized":"2024-09-17T03:45:39.091563+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:43.241792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081068+0000","last_change":"2024-09-17T03:45:40.099585+0000","last_active":"2024-09-17T03:45:41.081068+0000","last_peered":"2024-09-17T03:45:41.081068+0000","last_clean":"2024-09-17T03:45:41.081068+0000","last_became_active":"2024-09-17T03:45:40.098940+0000","last_became_peered":"2024-09-17T03:45:40.098940+0000","last_unstale":"2024-09-17T03:45:41.081068+0000","last_undegraded":"2024-09-17T03:45:41.081068+0000","last_fullsized":"2024-09-17T03:45:41.081068+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:37.932568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.083776+0000","last_change":"2024-09-17T03:45:39.082611+0000","last_active":"2024-09-17T03:45:39.083776+0000","last_peered":"2024-09-17T03:45:39.083776+0000","last_clean":"2024-09-17T03:45:39.083776+0000","last_became_active":"2024-09-17T03:45:39.082270+0000","last_became_peered":"2024-09-17T03:45:39.082270+0000","last_unstale":"2024-09-17T03:45:39.083776+0000","last_undegraded":"2024-09-17T03:45:39.083776+0000","last_fullsized":"2024-09-17T03:45:39.083776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:28.552320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076773+0000","last_change":"2024-09-17T03:45:39.076773+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076773+0000","last_undegraded":"2024-09-17T03:45:39.076773+0000","last_fullsized":"2024-09-17T03:45:39.076773+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091411+0000","last_change":"2024-09-17T03:45:39.087408+0000","last_active":"2024-09-17T03:45:39.091411+0000","last_peered":"2024-09-17T03:45:39.091411+0000","last_clean":"2024-09-17T03:45:39.091411+0000","last_became_active":"2024-09-17T03:45:39.087095+0000","last_became_peered":"2024-09-17T03:45:39.087095+0000","last_unstale":"2024-09-17T03:45:39.091411+0000","last_undegraded":"2024-09-17T03:45:39.091411+0000","last_fullsized":"2024-09-17T03:45:39.091411+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:40.161338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.072636+0000","last_change":"2024-09-17T03:45:39.072636+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.072636+0000","last_undegraded":"2024-09-17T03:45:39.072636+0000","last_fullsized":"2024-09-17T03:45:39.072636+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081218+0000","last_change":"2024-09-17T03:45:39.082669+0000","last_active":"2024-09-17T03:45:41.081218+0000","last_peered":"2024-09-17T03:45:41.081218+0000","last_clean":"2024-09-17T03:45:41.081218+0000","last_became_active":"2024-09-17T03:45:39.081790+0000","last_became_peered":"2024-09-17T03:45:39.081790+0000","last_unstale":"2024-09-17T03:45:41.081218+0000","last_undegraded":"2024-09-17T03:45:41.081218+0000","last_fullsized":"2024-09-17T03:45:41.081218+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:48.624264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.082401+0000","last_change":"2024-09-17T03:45:39.082401+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.082401+0000","last_undegraded":"2024-09-17T03:45:39.082401+0000","last_fullsized":"2024-09-17T03:45:39.082401+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086316+0000","last_change":"2024-09-17T03:45:39.079373+0000","last_active":"2024-09-17T03:45:39.086316+0000","last_peered":"2024-09-17T03:45:39.086316+0000","last_clean":"2024-09-17T03:45:39.086316+0000","last_became_active":"2024-09-17T03:45:39.079052+0000","last_became_peered":"2024-09-17T03:45:39.079052+0000","last_unstale":"2024-09-17T03:45:39.086316+0000","last_undegraded":"2024-09-17T03:45:39.086316+0000","last_fullsized":"2024-09-17T03:45:39.086316+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:57.303940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075938+0000","last_change":"2024-09-17T03:45:39.075938+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075938+0000","last_undegraded":"2024-09-17T03:45:39.075938+0000","last_fullsized":"2024-09-17T03:45:39.075938+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236655+0000","last_change":"2024-09-17T03:45:39.089753+0000","last_active":"2024-09-17T03:45:42.236655+0000","last_peered":"2024-09-17T03:45:42.236655+0000","last_clean":"2024-09-17T03:45:42.236655+0000","last_became_active":"2024-09-17T03:45:39.088599+0000","last_became_peered":"2024-09-17T03:45:39.088599+0000","last_unstale":"2024-09-17T03:45:42.236655+0000","last_undegraded":"2024-09-17T03:45:42.236655+0000","last_fullsized":"2024-09-17T03:45:42.236655+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:44.430375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074408+0000","last_change":"2024-09-17T03:45:39.074408+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074408+0000","last_undegraded":"2024-09-17T03:45:39.074408+0000","last_fullsized":"2024-09-17T03:45:39.074408+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236558+0000","last_change":"2024-09-17T03:45:39.087163+0000","last_active":"2024-09-17T03:45:42.236558+0000","last_peered":"2024-09-17T03:45:42.236558+0000","last_clean":"2024-09-17T03:45:42.236558+0000","last_became_active":"2024-09-17T03:45:39.086829+0000","last_became_peered":"2024-09-17T03:45:39.086829+0000","last_unstale":"2024-09-17T03:45:42.236558+0000","last_undegraded":"2024-09-17T03:45:42.236558+0000","last_fullsized":"2024-09-17T03:45:42.236558+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:21.031481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080254+0000","last_change":"2024-09-17T03:45:39.080254+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080254+0000","last_undegraded":"2024-09-17T03:45:39.080254+0000","last_fullsized":"2024-09-17T03:45:39.080254+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.089279+0000","last_change":"2024-09-17T03:45:39.081129+0000","last_active":"2024-09-17T03:45:39.089279+0000","last_peered":"2024-09-17T03:45:39.089279+0000","last_clean":"2024-09-17T03:45:39.089279+0000","last_became_active":"2024-09-17T03:45:39.080824+0000","last_became_peered":"2024-09-17T03:45:39.080824+0000","last_unstale":"2024-09-17T03:45:39.089279+0000","last_undegraded":"2024-09-17T03:45:39.089279+0000","last_fullsized":"2024-09-17T03:45:39.089279+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:14.851401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079612+0000","last_change":"2024-09-17T03:45:39.079612+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079612+0000","last_undegraded":"2024-09-17T03:45:39.079612+0000","last_fullsized":"2024-09-17T03:45:39.079612+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.092754+0000","last_change":"2024-09-17T03:45:39.092155+0000","last_active":"2024-09-17T03:45:39.092754+0000","last_peered":"2024-09-17T03:45:39.092754+0000","last_clean":"2024-09-17T03:45:39.092754+0000","last_became_active":"2024-09-17T03:45:39.091803+0000","last_became_peered":"2024-09-17T03:45:39.091803+0000","last_unstale":"2024-09-17T03:45:39.092754+0000","last_undegraded":"2024-09-17T03:45:39.092754+0000","last_fullsized":"2024-09-17T03:45:39.092754+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:30.581209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073105+0000","last_change":"2024-09-17T03:45:39.073105+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073105+0000","last_undegraded":"2024-09-17T03:45:39.073105+0000","last_fullsized":"2024-09-17T03:45:39.073105+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091136+0000","last_change":"2024-09-17T03:45:39.084693+0000","last_active":"2024-09-17T03:45:39.091136+0000","last_peered":"2024-09-17T03:45:39.091136+0000","last_clean":"2024-09-17T03:45:39.091136+0000","last_became_active":"2024-09-17T03:45:39.084367+0000","last_became_peered":"2024-09-17T03:45:39.084367+0000","last_unstale":"2024-09-17T03:45:39.091136+0000","last_undegraded":"2024-09-17T03:45:39.091136+0000","last_fullsized":"2024-09-17T03:45:39.091136+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:21.772713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076289+0000","last_change":"2024-09-17T03:45:39.076289+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076289+0000","last_undegraded":"2024-09-17T03:45:39.076289+0000","last_fullsized":"2024-09-17T03:45:39.076289+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091383+0000","last_change":"2024-09-17T03:45:39.087016+0000","last_active":"2024-09-17T03:45:39.091383+0000","last_peered":"2024-09-17T03:45:39.091383+0000","last_clean":"2024-09-17T03:45:39.091383+0000","last_became_active":"2024-09-17T03:45:39.086671+0000","last_became_peered":"2024-09-17T03:45:39.086671+0000","last_unstale":"2024-09-17T03:45:39.091383+0000","last_undegraded":"2024-09-17T03:45:39.091383+0000","last_fullsized":"2024-09-17T03:45:39.091383+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:19.011769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079037+0000","last_change":"2024-09-17T03:45:39.079037+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079037+0000","last_undegraded":"2024-09-17T03:45:39.079037+0000","last_fullsized":"2024-09-17T03:45:39.079037+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091928+0000","last_change":"2024-09-17T03:45:39.091076+0000","last_active":"2024-09-17T03:45:39.091928+0000","last_peered":"2024-09-17T03:45:39.091928+0000","last_clean":"2024-09-17T03:45:39.091928+0000","last_became_active":"2024-09-17T03:45:39.090678+0000","last_became_peered":"2024-09-17T03:45:39.090678+0000","last_unstale":"2024-09-17T03:45:39.091928+0000","last_undegraded":"2024-09-17T03:45:39.091928+0000","last_fullsized":"2024-09-17T03:45:39.091928+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:57.888711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079276+0000","last_change":"2024-09-17T03:45:39.079276+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079276+0000","last_undegraded":"2024-09-17T03:45:39.079276+0000","last_fullsized":"2024-09-17T03:45:39.079276+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236611+0000","last_change":"2024-09-17T03:45:39.092305+0000","last_active":"2024-09-17T03:45:42.236611+0000","last_peered":"2024-09-17T03:45:42.236611+0000","last_clean":"2024-09-17T03:45:42.236611+0000","last_became_active":"2024-09-17T03:45:39.091982+0000","last_became_peered":"2024-09-17T03:45:39.091982+0000","last_unstale":"2024-09-17T03:45:42.236611+0000","last_undegraded":"2024-09-17T03:45:42.236611+0000","last_fullsized":"2024-09-17T03:45:42.236611+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:31.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073819+0000","last_change":"2024-09-17T03:45:39.073819+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073819+0000","last_undegraded":"2024-09-17T03:45:39.073819+0000","last_fullsized":"2024-09-17T03:45:39.073819+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.085964+0000","last_change":"2024-09-17T03:45:39.084602+0000","last_active":"2024-09-17T03:45:39.085964+0000","last_peered":"2024-09-17T03:45:39.085964+0000","last_clean":"2024-09-17T03:45:39.085964+0000","last_became_active":"2024-09-17T03:45:39.084286+0000","last_became_peered":"2024-09-17T03:45:39.084286+0000","last_unstale":"2024-09-17T03:45:39.085964+0000","last_undegraded":"2024-09-17T03:45:39.085964+0000","last_fullsized":"2024-09-17T03:45:39.085964+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:23.641470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073813+0000","last_change":"2024-09-17T03:45:39.073813+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073813+0000","last_undegraded":"2024-09-17T03:45:39.073813+0000","last_fullsized":"2024-09-17T03:45:39.073813+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090953+0000","last_change":"2024-09-17T03:45:39.089774+0000","last_active":"2024-09-17T03:45:39.090953+0000","last_peered":"2024-09-17T03:45:39.090953+0000","last_clean":"2024-09-17T03:45:39.090953+0000","last_became_active":"2024-09-17T03:45:39.089502+0000","last_became_peered":"2024-09-17T03:45:39.089502+0000","last_unstale":"2024-09-17T03:45:39.090953+0000","last_undegraded":"2024-09-17T03:45:39.090953+0000","last_fullsized":"2024-09-17T03:45:39.090953+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:38.714674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.072524+0000","last_change":"2024-09-17T03:45:39.072524+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.072524+0000","last_undegraded":"2024-09-17T03:45:39.072524+0000","last_fullsized":"2024-09-17T03:45:39.072524+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086606+0000","last_change":"2024-09-17T03:45:39.080285+0000","last_active":"2024-09-17T03:45:39.086606+0000","last_peered":"2024-09-17T03:45:39.086606+0000","last_clean":"2024-09-17T03:45:39.086606+0000","last_became_active":"2024-09-17T03:45:39.079973+0000","last_became_peered":"2024-09-17T03:45:39.079973+0000","last_unstale":"2024-09-17T03:45:39.086606+0000","last_undegraded":"2024-09-17T03:45:39.086606+0000","last_fullsized":"2024-09-17T03:45:39.086606+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:16.852797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073628+0000","last_change":"2024-09-17T03:45:39.073628+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073628+0000","last_undegraded":"2024-09-17T03:45:39.073628+0000","last_fullsized":"2024-09-17T03:45:39.073628+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"187'2","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236742+0000","last_change":"2024-09-17T03:45:39.090713+0000","last_active":"2024-09-17T03:45:42.236742+0000","last_peered":"2024-09-17T03:45:42.236742+0000","last_clean":"2024-09-17T03:45:42.236742+0000","last_became_active":"2024-09-17T03:45:39.090324+0000","last_became_peered":"2024-09-17T03:45:39.090324+0000","last_unstale":"2024-09-17T03:45:42.236742+0000","last_undegraded":"2024-09-17T03:45:42.236742+0000","last_fullsized":"2024-09-17T03:45:42.236742+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:27.632921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":413,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.073852+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:45:39.073852+0000","last_peered":"2024-09-17T03:45:39.073852+0000","last_clean":"2024-09-17T03:45:39.073852+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:45:39.073852+0000","last_undegraded":"2024-09-17T03:45:39.073852+0000","last_fullsized":"2024-09-17T03:45:39.073852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509598,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60432,"kb_used_data":2868,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311408,"statfs":{"total":96636764160,"available":96574881792,"internally_reserved":0,"allocated":2936832,"data_stored":1619468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59848,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311992,"statfs":{"total":96636764160,"available":96575479808,"internally_reserved":0,"allocated":2342912,"data_stored":1029100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509598,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55676,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316164,"statfs":{"total":96636764160,"available":96579751936,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509599,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56272,"kb_used_data":2868,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":2936832,"data_stored":1619468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55708,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316132,"statfs":{"total":96636764160,"available":96579719168,"internally_reserved":0,"allocated":2367488,"data_stored":1042175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55732,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316108,"statfs":{"total":96636764160,"available":96579694592,"internally_reserved":0,"allocated":2383872,"data_stored":1043857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:45:44.815 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3f is not active+clean 2024-09-17T03:45:44.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.075903+0000', 'last_change': '2024-09-17T03:45:39.075903+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.075903+0000', 'last_undegraded': '2024-09-17T03:45:39.075903+0000', 'last_fullsized': '2024-09-17T03:45:39.075903+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:45:44.816 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3e is not active+clean 2024-09-17T03:45:44.816 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.081051+0000', 'last_change': '2024-09-17T03:45:39.081051+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.081051+0000', 'last_undegraded': '2024-09-17T03:45:39.081051+0000', 'last_fullsized': '2024-09-17T03:45:39.081051+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:45:44.817 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3d is not active+clean 2024-09-17T03:45:44.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.074723+0000', 'last_change': '2024-09-17T03:45:39.074723+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.074723+0000', 'last_undegraded': '2024-09-17T03:45:39.074723+0000', 'last_fullsized': '2024-09-17T03:45:39.074723+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.817 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3c is not active+clean 2024-09-17T03:45:44.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.077089+0000', 'last_change': '2024-09-17T03:45:39.077089+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.077089+0000', 'last_undegraded': '2024-09-17T03:45:39.077089+0000', 'last_fullsized': '2024-09-17T03:45:39.077089+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:45:44.817 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3b is not active+clean 2024-09-17T03:45:44.817 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.076736+0000', 'last_change': '2024-09-17T03:45:39.076736+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.076736+0000', 'last_undegraded': '2024-09-17T03:45:39.076736+0000', 'last_fullsized': '2024-09-17T03:45:39.076736+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:45:44.817 INFO:tasks.ceph.ceph_manager.ceph:PG 29.39 is not active+clean 2024-09-17T03:45:44.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.074911+0000', 'last_change': '2024-09-17T03:45:39.074911+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.074911+0000', 'last_undegraded': '2024-09-17T03:45:39.074911+0000', 'last_fullsized': '2024-09-17T03:45:39.074911+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.818 INFO:tasks.ceph.ceph_manager.ceph:PG 29.38 is not active+clean 2024-09-17T03:45:44.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.078031+0000', 'last_change': '2024-09-17T03:45:39.078031+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.078031+0000', 'last_undegraded': '2024-09-17T03:45:39.078031+0000', 'last_fullsized': '2024-09-17T03:45:39.078031+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:45:44.818 INFO:tasks.ceph.ceph_manager.ceph:PG 29.37 is not active+clean 2024-09-17T03:45:44.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.075242+0000', 'last_change': '2024-09-17T03:45:39.075242+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.075242+0000', 'last_undegraded': '2024-09-17T03:45:39.075242+0000', 'last_fullsized': '2024-09-17T03:45:39.075242+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.818 INFO:tasks.ceph.ceph_manager.ceph:PG 29.35 is not active+clean 2024-09-17T03:45:44.818 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.076898+0000', 'last_change': '2024-09-17T03:45:39.076898+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.076898+0000', 'last_undegraded': '2024-09-17T03:45:39.076898+0000', 'last_fullsized': '2024-09-17T03:45:39.076898+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:45:44.819 INFO:tasks.ceph.ceph_manager.ceph:PG 29.34 is not active+clean 2024-09-17T03:45:44.819 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.080082+0000', 'last_change': '2024-09-17T03:45:39.080082+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.080082+0000', 'last_undegraded': '2024-09-17T03:45:39.080082+0000', 'last_fullsized': '2024-09-17T03:45:39.080082+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:45:44.819 INFO:tasks.ceph.ceph_manager.ceph:PG 29.33 is not active+clean 2024-09-17T03:45:44.819 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.079648+0000', 'last_change': '2024-09-17T03:45:39.079648+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.079648+0000', 'last_undegraded': '2024-09-17T03:45:39.079648+0000', 'last_fullsized': '2024-09-17T03:45:39.079648+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:45:44.819 INFO:tasks.ceph.ceph_manager.ceph:PG 29.31 is not active+clean 2024-09-17T03:45:44.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.078267+0000', 'last_change': '2024-09-17T03:45:39.078267+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.078267+0000', 'last_undegraded': '2024-09-17T03:45:39.078267+0000', 'last_fullsized': '2024-09-17T03:45:39.078267+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:45:44.820 INFO:tasks.ceph.ceph_manager.ceph:PG 29.30 is not active+clean 2024-09-17T03:45:44.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.077965+0000', 'last_change': '2024-09-17T03:45:39.077965+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.077965+0000', 'last_undegraded': '2024-09-17T03:45:39.077965+0000', 'last_fullsized': '2024-09-17T03:45:39.077965+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:45:44.820 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2d is not active+clean 2024-09-17T03:45:44.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.078571+0000', 'last_change': '2024-09-17T03:45:39.078571+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.078571+0000', 'last_undegraded': '2024-09-17T03:45:39.078571+0000', 'last_fullsized': '2024-09-17T03:45:39.078571+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:45:44.821 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2b is not active+clean 2024-09-17T03:45:44.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.076200+0000', 'last_change': '2024-09-17T03:45:39.076200+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.076200+0000', 'last_undegraded': '2024-09-17T03:45:39.076200+0000', 'last_fullsized': '2024-09-17T03:45:39.076200+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:45:44.821 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2a is not active+clean 2024-09-17T03:45:44.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.078806+0000', 'last_change': '2024-09-17T03:45:39.078806+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.078806+0000', 'last_undegraded': '2024-09-17T03:45:39.078806+0000', 'last_fullsized': '2024-09-17T03:45:39.078806+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:45:44.821 INFO:tasks.ceph.ceph_manager.ceph:PG 29.29 is not active+clean 2024-09-17T03:45:44.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.073115+0000', 'last_change': '2024-09-17T03:45:39.073115+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.073115+0000', 'last_undegraded': '2024-09-17T03:45:39.073115+0000', 'last_fullsized': '2024-09-17T03:45:39.073115+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:45:44.821 INFO:tasks.ceph.ceph_manager.ceph:PG 29.28 is not active+clean 2024-09-17T03:45:44.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.080048+0000', 'last_change': '2024-09-17T03:45:39.080048+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.080048+0000', 'last_undegraded': '2024-09-17T03:45:39.080048+0000', 'last_fullsized': '2024-09-17T03:45:39.080048+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:45:44.822 INFO:tasks.ceph.ceph_manager.ceph:PG 29.27 is not active+clean 2024-09-17T03:45:44.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.075372+0000', 'last_change': '2024-09-17T03:45:39.075372+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.075372+0000', 'last_undegraded': '2024-09-17T03:45:39.075372+0000', 'last_fullsized': '2024-09-17T03:45:39.075372+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:45:44.822 INFO:tasks.ceph.ceph_manager.ceph:PG 29.26 is not active+clean 2024-09-17T03:45:44.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.076918+0000', 'last_change': '2024-09-17T03:45:39.076918+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.076918+0000', 'last_undegraded': '2024-09-17T03:45:39.076918+0000', 'last_fullsized': '2024-09-17T03:45:39.076918+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:45:44.822 INFO:tasks.ceph.ceph_manager.ceph:PG 29.25 is not active+clean 2024-09-17T03:45:44.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.075469+0000', 'last_change': '2024-09-17T03:45:39.075469+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.075469+0000', 'last_undegraded': '2024-09-17T03:45:39.075469+0000', 'last_fullsized': '2024-09-17T03:45:39.075469+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:45:44.822 INFO:tasks.ceph.ceph_manager.ceph:PG 29.22 is not active+clean 2024-09-17T03:45:44.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.074566+0000', 'last_change': '2024-09-17T03:45:39.074566+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.074566+0000', 'last_undegraded': '2024-09-17T03:45:39.074566+0000', 'last_fullsized': '2024-09-17T03:45:39.074566+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:45:44.823 INFO:tasks.ceph.ceph_manager.ceph:PG 29.21 is not active+clean 2024-09-17T03:45:44.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.081282+0000', 'last_change': '2024-09-17T03:45:39.081282+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.081282+0000', 'last_undegraded': '2024-09-17T03:45:39.081282+0000', 'last_fullsized': '2024-09-17T03:45:39.081282+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:45:44.823 INFO:tasks.ceph.ceph_manager.ceph:PG 29.20 is not active+clean 2024-09-17T03:45:44.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.078984+0000', 'last_change': '2024-09-17T03:45:39.078984+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.078984+0000', 'last_undegraded': '2024-09-17T03:45:39.078984+0000', 'last_fullsized': '2024-09-17T03:45:39.078984+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:45:44.823 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1e is not active+clean 2024-09-17T03:45:44.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.073306+0000', 'last_change': '2024-09-17T03:45:39.073306+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.073306+0000', 'last_undegraded': '2024-09-17T03:45:39.073306+0000', 'last_fullsized': '2024-09-17T03:45:39.073306+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.824 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1f is not active+clean 2024-09-17T03:45:44.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.074721+0000', 'last_change': '2024-09-17T03:45:39.074721+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.074721+0000', 'last_undegraded': '2024-09-17T03:45:39.074721+0000', 'last_fullsized': '2024-09-17T03:45:39.074721+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:45:44.824 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1a is not active+clean 2024-09-17T03:45:44.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.074049+0000', 'last_change': '2024-09-17T03:45:39.074049+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.074049+0000', 'last_undegraded': '2024-09-17T03:45:39.074049+0000', 'last_fullsized': '2024-09-17T03:45:39.074049+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:45:44.824 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1b is not active+clean 2024-09-17T03:45:44.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.075603+0000', 'last_change': '2024-09-17T03:45:39.075603+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.075603+0000', 'last_undegraded': '2024-09-17T03:45:39.075603+0000', 'last_fullsized': '2024-09-17T03:45:39.075603+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:45:44.824 INFO:tasks.ceph.ceph_manager.ceph:PG 29.19 is not active+clean 2024-09-17T03:45:44.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.078676+0000', 'last_change': '2024-09-17T03:45:39.078676+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.078676+0000', 'last_undegraded': '2024-09-17T03:45:39.078676+0000', 'last_fullsized': '2024-09-17T03:45:39.078676+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:45:44.825 INFO:tasks.ceph.ceph_manager.ceph:PG 29.16 is not active+clean 2024-09-17T03:45:44.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.080538+0000', 'last_change': '2024-09-17T03:45:39.080538+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.080538+0000', 'last_undegraded': '2024-09-17T03:45:39.080538+0000', 'last_fullsized': '2024-09-17T03:45:39.080538+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:45:44.825 INFO:tasks.ceph.ceph_manager.ceph:PG 29.17 is not active+clean 2024-09-17T03:45:44.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.074912+0000', 'last_change': '2024-09-17T03:45:39.074912+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.074912+0000', 'last_undegraded': '2024-09-17T03:45:39.074912+0000', 'last_fullsized': '2024-09-17T03:45:39.074912+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:45:44.825 INFO:tasks.ceph.ceph_manager.ceph:PG 29.15 is not active+clean 2024-09-17T03:45:44.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.076428+0000', 'last_change': '2024-09-17T03:45:39.076428+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.076428+0000', 'last_undegraded': '2024-09-17T03:45:39.076428+0000', 'last_fullsized': '2024-09-17T03:45:39.076428+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:45:44.825 INFO:tasks.ceph.ceph_manager.ceph:PG 29.12 is not active+clean 2024-09-17T03:45:44.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.078360+0000', 'last_change': '2024-09-17T03:45:39.078360+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.078360+0000', 'last_undegraded': '2024-09-17T03:45:39.078360+0000', 'last_fullsized': '2024-09-17T03:45:39.078360+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:45:44.826 INFO:tasks.ceph.ceph_manager.ceph:PG 29.13 is not active+clean 2024-09-17T03:45:44.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.078432+0000', 'last_change': '2024-09-17T03:45:39.078432+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.078432+0000', 'last_undegraded': '2024-09-17T03:45:39.078432+0000', 'last_fullsized': '2024-09-17T03:45:39.078432+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.826 INFO:tasks.ceph.ceph_manager.ceph:PG 29.10 is not active+clean 2024-09-17T03:45:44.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.074412+0000', 'last_change': '2024-09-17T03:45:39.074412+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.074412+0000', 'last_undegraded': '2024-09-17T03:45:39.074412+0000', 'last_fullsized': '2024-09-17T03:45:39.074412+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.826 INFO:tasks.ceph.ceph_manager.ceph:PG 29.e is not active+clean 2024-09-17T03:45:44.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.075198+0000', 'last_change': '2024-09-17T03:45:39.075198+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.075198+0000', 'last_undegraded': '2024-09-17T03:45:39.075198+0000', 'last_fullsized': '2024-09-17T03:45:39.075198+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:45:44.826 INFO:tasks.ceph.ceph_manager.ceph:PG 29.c is not active+clean 2024-09-17T03:45:44.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.076773+0000', 'last_change': '2024-09-17T03:45:39.076773+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.076773+0000', 'last_undegraded': '2024-09-17T03:45:39.076773+0000', 'last_fullsized': '2024-09-17T03:45:39.076773+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.826 INFO:tasks.ceph.ceph_manager.ceph:PG 29.d is not active+clean 2024-09-17T03:45:44.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.072636+0000', 'last_change': '2024-09-17T03:45:39.072636+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.072636+0000', 'last_undegraded': '2024-09-17T03:45:39.072636+0000', 'last_fullsized': '2024-09-17T03:45:39.072636+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.826 INFO:tasks.ceph.ceph_manager.ceph:PG 29.a is not active+clean 2024-09-17T03:45:44.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.082401+0000', 'last_change': '2024-09-17T03:45:39.082401+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.082401+0000', 'last_undegraded': '2024-09-17T03:45:39.082401+0000', 'last_fullsized': '2024-09-17T03:45:39.082401+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:45:44.827 INFO:tasks.ceph.ceph_manager.ceph:PG 29.b is not active+clean 2024-09-17T03:45:44.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.075938+0000', 'last_change': '2024-09-17T03:45:39.075938+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.075938+0000', 'last_undegraded': '2024-09-17T03:45:39.075938+0000', 'last_fullsized': '2024-09-17T03:45:39.075938+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.827 INFO:tasks.ceph.ceph_manager.ceph:PG 29.8 is not active+clean 2024-09-17T03:45:44.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.074408+0000', 'last_change': '2024-09-17T03:45:39.074408+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.074408+0000', 'last_undegraded': '2024-09-17T03:45:39.074408+0000', 'last_fullsized': '2024-09-17T03:45:39.074408+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:45:44.827 INFO:tasks.ceph.ceph_manager.ceph:PG 29.9 is not active+clean 2024-09-17T03:45:44.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.080254+0000', 'last_change': '2024-09-17T03:45:39.080254+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.080254+0000', 'last_undegraded': '2024-09-17T03:45:39.080254+0000', 'last_fullsized': '2024-09-17T03:45:39.080254+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:45:44.827 INFO:tasks.ceph.ceph_manager.ceph:PG 29.6 is not active+clean 2024-09-17T03:45:44.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.079612+0000', 'last_change': '2024-09-17T03:45:39.079612+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.079612+0000', 'last_undegraded': '2024-09-17T03:45:39.079612+0000', 'last_fullsized': '2024-09-17T03:45:39.079612+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:45:44.827 INFO:tasks.ceph.ceph_manager.ceph:PG 29.7 is not active+clean 2024-09-17T03:45:44.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.073105+0000', 'last_change': '2024-09-17T03:45:39.073105+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.073105+0000', 'last_undegraded': '2024-09-17T03:45:39.073105+0000', 'last_fullsized': '2024-09-17T03:45:39.073105+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.828 INFO:tasks.ceph.ceph_manager.ceph:PG 29.4 is not active+clean 2024-09-17T03:45:44.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.076289+0000', 'last_change': '2024-09-17T03:45:39.076289+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.076289+0000', 'last_undegraded': '2024-09-17T03:45:39.076289+0000', 'last_fullsized': '2024-09-17T03:45:39.076289+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.828 INFO:tasks.ceph.ceph_manager.ceph:PG 29.5 is not active+clean 2024-09-17T03:45:44.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.079037+0000', 'last_change': '2024-09-17T03:45:39.079037+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.079037+0000', 'last_undegraded': '2024-09-17T03:45:39.079037+0000', 'last_fullsized': '2024-09-17T03:45:39.079037+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:45:44.828 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2 is not active+clean 2024-09-17T03:45:44.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.079276+0000', 'last_change': '2024-09-17T03:45:39.079276+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.079276+0000', 'last_undegraded': '2024-09-17T03:45:39.079276+0000', 'last_fullsized': '2024-09-17T03:45:39.079276+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:45:44.829 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3 is not active+clean 2024-09-17T03:45:44.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.073819+0000', 'last_change': '2024-09-17T03:45:39.073819+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.073819+0000', 'last_undegraded': '2024-09-17T03:45:39.073819+0000', 'last_fullsized': '2024-09-17T03:45:39.073819+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.829 INFO:tasks.ceph.ceph_manager.ceph:PG 29.0 is not active+clean 2024-09-17T03:45:44.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.073813+0000', 'last_change': '2024-09-17T03:45:39.073813+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.073813+0000', 'last_undegraded': '2024-09-17T03:45:39.073813+0000', 'last_fullsized': '2024-09-17T03:45:39.073813+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:45:44.829 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1 is not active+clean 2024-09-17T03:45:44.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.072524+0000', 'last_change': '2024-09-17T03:45:39.072524+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.072524+0000', 'last_undegraded': '2024-09-17T03:45:39.072524+0000', 'last_fullsized': '2024-09-17T03:45:39.072524+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:45:44.829 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1c is not active+clean 2024-09-17T03:45:44.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 186, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:45:39.073628+0000', 'last_change': '2024-09-17T03:45:39.073628+0000', 'last_active': '2024-09-17T03:45:39.066232+0000', 'last_peered': '2024-09-17T03:45:39.066232+0000', 'last_clean': '2024-09-17T03:45:39.066232+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:45:39.073628+0000', 'last_undegraded': '2024-09-17T03:45:39.073628+0000', 'last_fullsized': '2024-09-17T03:45:39.073628+0000', 'mapping_epoch': 186, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 186, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'last_clean_scrub_stamp': '2024-09-17T03:45:39.066232+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:45:44.830 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:45:44.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.962+0000 7f53424c5640 1 -- 172.21.15.146:0/4189113445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c0b4510 msgr2=0x7f533c070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.962+0000 7f53424c5640 1 --2- 172.21.15.146:0/4189113445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c0b4510 0x7f533c070010 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f533c0726f0 tx=0x7f533402aa30 comp rx=0 tx=0).stop 2024-09-17T03:45:44.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.962+0000 7f53424c5640 1 -- 172.21.15.146:0/4189113445 shutdown_connections 2024-09-17T03:45:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.962+0000 7f53424c5640 1 --2- 172.21.15.146:0/4189113445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c0b4510 0x7f533c070010 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.962+0000 7f53424c5640 1 --2- 172.21.15.146:0/4189113445 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533c0b4100 0x7f533c06fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.962+0000 7f53424c5640 1 --2- 172.21.15.146:0/4189113445 >> v2:172.21.15.179:3300/0 conn(0x7f533c15c9f0 0x7f533c1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.962+0000 7f53424c5640 1 -- 172.21.15.146:0/4189113445 >> 172.21.15.146:0/4189113445 conn(0x7f533c06d3c0 msgr2=0x7f533c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:44.964 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.962+0000 7f53424c5640 1 -- 172.21.15.146:0/4189113445 shutdown_connections 2024-09-17T03:45:44.965 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.962+0000 7f53424c5640 1 -- 172.21.15.146:0/4189113445 wait complete. 2024-09-17T03:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.964+0000 7f53424c5640 1 Processor -- start 2024-09-17T03:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.964+0000 7f53424c5640 1 -- start start 2024-09-17T03:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f53424c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533c0b4100 0x7f533c14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f53424c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f533c0b4510 0x7f533c1e6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f53424c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c14f620 0x7f533c1e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f53424c5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f533c0d04e0 con 0x7f533c14f620 2024-09-17T03:45:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f53424c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f533c0d0360 con 0x7f533c0b4510 2024-09-17T03:45:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f53424c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f533c0d0660 con 0x7f533c0b4100 2024-09-17T03:45:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f5340a62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c14f620 0x7f533c1e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f5340a62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c14f620 0x7f533c1e66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45536/0 (socket says 172.21.15.146:45536) 2024-09-17T03:45:44.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f5340a62640 1 -- 172.21.15.146:0/4092284011 learned_addr learned my addr 172.21.15.146:0/4092284011 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:44.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f533bfff640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533c0b4100 0x7f533c14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.973 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f533b7fe640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f533c0b4510 0x7f533c1e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f5340a62640 1 -- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533c0b4100 msgr2=0x7f533c14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f5340a62640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533c0b4100 0x7f533c14ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f5340a62640 1 -- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f533c0b4510 msgr2=0x7f533c1e6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f5340a62640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f533c0b4510 0x7f533c1e6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.965+0000 7f5340a62640 1 -- 172.21.15.146:0/4092284011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c1f71e0 con 0x7f533c14f620 2024-09-17T03:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.966+0000 7f5340a62640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c14f620 0x7f533c1e66d0 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7f5334009d60 tx=0x7f5334003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:44.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.966+0000 7f5338ff9640 1 -- 172.21.15.146:0/4092284011 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334033050 con 0x7f533c14f620 2024-09-17T03:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.966+0000 7f5338ff9640 1 -- 172.21.15.146:0/4092284011 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5334004450 con 0x7f533c14f620 2024-09-17T03:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.966+0000 7f53424c5640 1 -- 172.21.15.146:0/4092284011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533c1f74c0 con 0x7f533c14f620 2024-09-17T03:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.966+0000 7f5338ff9640 1 -- 172.21.15.146:0/4092284011 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334038450 con 0x7f533c14f620 2024-09-17T03:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.966+0000 7f53424c5640 1 -- 172.21.15.146:0/4092284011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533c1f7a80 con 0x7f533c14f620 2024-09-17T03:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.967+0000 7f53424c5640 1 -- 172.21.15.146:0/4092284011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533c15c9f0 con 0x7f533c14f620 2024-09-17T03:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.967+0000 7f5338ff9640 1 -- 172.21.15.146:0/4092284011 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5334036070 con 0x7f533c14f620 2024-09-17T03:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.968+0000 7f5338ff9640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5328078b90 0x7f532807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.968+0000 7f5338ff9640 1 -- 172.21.15.146:0/4092284011 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f53340bc180 con 0x7f533c14f620 2024-09-17T03:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.968+0000 7f533bfff640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5328078b90 0x7f532807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:44.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.969+0000 7f533bfff640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5328078b90 0x7f532807b0a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f533c0b07a0 tx=0x7f532c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:44.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:44.973+0000 7f5338ff9640 1 -- 172.21.15.146:0/4092284011 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5334083f70 con 0x7f533c14f620 2024-09-17T03:45:45.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.225+0000 7f53424c5640 1 -- 172.21.15.146:0/4092284011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f533c1f6f70 con 0x7f533c14f620 2024-09-17T03:45:45.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.226+0000 7f5338ff9640 1 -- 172.21.15.146:0/4092284011 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1564 (secure 0 0 0) 0x7f53340889a0 con 0x7f533c14f620 2024-09-17T03:45:45.226 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:45.226 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":789,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":188,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":51},{"state_name":"active+clean","count":46}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":591980,"bytes_used":480088064,"bytes_avail":772614025216,"bytes_total":773094113280,"inactive_pgs_ratio":0.52577316761016846,"write_bytes_sec":518,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":145,"btime":"2024-09-17T03:45:43:095701+0000","id":14,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":14,"rank":0,"name":"a","status":"up:active","gid":11100}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":37,"modified":"2024-09-17T03:45:33.992723+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 -- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5328078b90 msgr2=0x7f532807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5328078b90 0x7f532807b0a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f533c0b07a0 tx=0x7f532c00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 -- 172.21.15.146:0/4092284011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c14f620 msgr2=0x7f533c1e66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c14f620 0x7f533c1e66d0 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7f5334009d60 tx=0x7f5334003f10 comp rx=0 tx=0).stop 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 -- 172.21.15.146:0/4092284011 shutdown_connections 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5328078b90 0x7f532807b0a0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f533c14f620 0x7f533c1e66d0 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f533c0b4510 0x7f533c1e6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 --2- 172.21.15.146:0/4092284011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f533c0b4100 0x7f533c14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 -- 172.21.15.146:0/4092284011 >> 172.21.15.146:0/4092284011 conn(0x7f533c06d3c0 msgr2=0x7f533c0cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 -- 172.21.15.146:0/4092284011 shutdown_connections 2024-09-17T03:45:45.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.228+0000 7f53424c5640 1 -- 172.21.15.146:0/4092284011 wait complete. 2024-09-17T03:45:45.240 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:45:45.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:45:45.354 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.354+0000 7fe5ed43f640 1 -- 172.21.15.146:0/3227558070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e80b3870 msgr2=0x7fe5e80cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:45.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.354+0000 7fe5ed43f640 1 --2- 172.21.15.146:0/3227558070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e80b3870 0x7fe5e80cf370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009830 tx=0x7fe5d802a480 comp rx=0 tx=0).stop 2024-09-17T03:45:45.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.354+0000 7fe5ed43f640 1 -- 172.21.15.146:0/3227558070 shutdown_connections 2024-09-17T03:45:45.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.354+0000 7fe5ed43f640 1 --2- 172.21.15.146:0/3227558070 >> v2:172.21.15.179:3300/0 conn(0x7fe5e81620f0 0x7fe5e806ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.354+0000 7fe5ed43f640 1 --2- 172.21.15.146:0/3227558070 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e80b3870 0x7fe5e80cf370 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.354+0000 7fe5ed43f640 1 -- 172.21.15.146:0/3227558070 >> 172.21.15.146:0/3227558070 conn(0x7fe5e80d4be0 msgr2=0x7fe5e80d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:45.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.354+0000 7fe5ed43f640 1 -- 172.21.15.146:0/3227558070 shutdown_connections 2024-09-17T03:45:45.355 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.354+0000 7fe5ed43f640 1 -- 172.21.15.146:0/3227558070 wait complete. 2024-09-17T03:45:45.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.356+0000 7fe5ed43f640 1 Processor -- start 2024-09-17T03:45:45.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.356+0000 7fe5ed43f640 1 -- start start 2024-09-17T03:45:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.357+0000 7fe5ed43f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e806f270 0x7fe5e80ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5ed43f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e80b3870 0x7fe5e814fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5ed43f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5e81620f0 0x7fe5e80cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:45.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5ed43f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e80d43b0 con 0x7fe5e81620f0 2024-09-17T03:45:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5ed43f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e8162fb0 con 0x7fe5e806f270 2024-09-17T03:45:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5ed43f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e80cd4d0 con 0x7fe5e80b3870 2024-09-17T03:45:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5e77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5e81620f0 0x7fe5e80cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5e77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5e81620f0 0x7fe5e80cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45552/0 (socket says 172.21.15.146:45552) 2024-09-17T03:45:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5e77fe640 1 -- 172.21.15.146:0/206786262 learned_addr learned my addr 172.21.15.146:0/206786262 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5de7fc640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e80b3870 0x7fe5e814fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5e6ffd640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e806f270 0x7fe5e80ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5e77fe640 1 -- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e80b3870 msgr2=0x7fe5e814fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5e77fe640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e80b3870 0x7fe5e814fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5e77fe640 1 -- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e806f270 msgr2=0x7fe5e80ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:45.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5e77fe640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e806f270 0x7fe5e80ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5e77fe640 1 -- 172.21.15.146:0/206786262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e80b43f0 con 0x7fe5e81620f0 2024-09-17T03:45:45.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5e6ffd640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e806f270 0x7fe5e80ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:45.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5e77fe640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5e81620f0 0x7fe5e80cc9e0 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000cb10 tx=0x7fe5e000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:45.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5dffff640 1 -- 172.21.15.146:0/206786262 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0016020 con 0x7fe5e81620f0 2024-09-17T03:45:45.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.358+0000 7fe5dffff640 1 -- 172.21.15.146:0/206786262 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5e000ad00 con 0x7fe5e81620f0 2024-09-17T03:45:45.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.359+0000 7fe5dffff640 1 -- 172.21.15.146:0/206786262 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0012680 con 0x7fe5e81620f0 2024-09-17T03:45:45.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.359+0000 7fe5ed43f640 1 -- 172.21.15.146:0/206786262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e80b46d0 con 0x7fe5e81620f0 2024-09-17T03:45:45.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.359+0000 7fe5ed43f640 1 -- 172.21.15.146:0/206786262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e80b4c90 con 0x7fe5e81620f0 2024-09-17T03:45:45.362 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.360+0000 7fe5ed43f640 1 -- 172.21.15.146:0/206786262 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e8163460 con 0x7fe5e81620f0 2024-09-17T03:45:45.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.360+0000 7fe5dffff640 1 -- 172.21.15.146:0/206786262 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe5e0019020 con 0x7fe5e81620f0 2024-09-17T03:45:45.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.361+0000 7fe5dffff640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe5c8078bc0 0x7fe5c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:45.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.361+0000 7fe5dffff640 1 -- 172.21.15.146:0/206786262 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fe5e009b370 con 0x7fe5e81620f0 2024-09-17T03:45:45.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.361+0000 7fe5e6ffd640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe5c8078bc0 0x7fe5c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:45.363 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.361+0000 7fe5e6ffd640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe5c8078bc0 0x7fe5c807b0d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8034000 tx=0x7fe5d8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:45.365 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.365+0000 7fe5dffff640 1 -- 172.21.15.146:0/206786262 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe5e0020020 con 0x7fe5e81620f0 2024-09-17T03:45:45.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.539+0000 7fe5ed43f640 1 -- 172.21.15.146:0/206786262 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5e8162670 con 0x7fe5c8078bc0 2024-09-17T03:45:45.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.543+0000 7fe5dffff640 1 -- 172.21.15.146:0/206786262 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248200 (secure 0 0 0) 0x7fe5d8004450 con 0x7fe5c8078bc0 2024-09-17T03:45:45.546 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:45.547 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:45:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 -- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe5c8078bc0 msgr2=0x7fe5c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe5c8078bc0 0x7fe5c807b0d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8034000 tx=0x7fe5d8004730 comp rx=0 tx=0).stop 2024-09-17T03:45:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 -- 172.21.15.146:0/206786262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5e81620f0 msgr2=0x7fe5e80cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:45.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5e81620f0 0x7fe5e80cc9e0 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000cb10 tx=0x7fe5e000a060 comp rx=0 tx=0).stop 2024-09-17T03:45:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 -- 172.21.15.146:0/206786262 shutdown_connections 2024-09-17T03:45:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe5c8078bc0 0x7fe5c807b0d0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5e81620f0 0x7fe5e80cc9e0 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe5e80b3870 0x7fe5e814fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 --2- 172.21.15.146:0/206786262 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe5e806f270 0x7fe5e80ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 -- 172.21.15.146:0/206786262 >> 172.21.15.146:0/206786262 conn(0x7fe5e80d4be0 msgr2=0x7fe5e815e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 -- 172.21.15.146:0/206786262 shutdown_connections 2024-09-17T03:45:45.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:45.546+0000 7fe5ed43f640 1 -- 172.21.15.146:0/206786262 wait complete. 2024-09-17T03:45:45.558 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":570,"stamp":"2024-09-17T03:45:43.995072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":468836,"kb_used_data":19492,"kb_used_omap":12,"kb_used_meta":449139,"kb_avail":754505884,"statfs":{"total":773094113280,"available":772614025216,"internally_reserved":0,"allocated":19959808,"data_stored":9422543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":459918897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.927923"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075903+0000","last_change":"2024-09-17T03:45:39.075903+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075903+0000","last_undegraded":"2024-09-17T03:45:39.075903+0000","last_fullsized":"2024-09-17T03:45:39.075903+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.081051+0000","last_change":"2024-09-17T03:45:39.081051+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.081051+0000","last_undegraded":"2024-09-17T03:45:39.081051+0000","last_fullsized":"2024-09-17T03:45:39.081051+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074723+0000","last_change":"2024-09-17T03:45:39.074723+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074723+0000","last_undegraded":"2024-09-17T03:45:39.074723+0000","last_fullsized":"2024-09-17T03:45:39.074723+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.077089+0000","last_change":"2024-09-17T03:45:39.077089+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.077089+0000","last_undegraded":"2024-09-17T03:45:39.077089+0000","last_fullsized":"2024-09-17T03:45:39.077089+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076736+0000","last_change":"2024-09-17T03:45:39.076736+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076736+0000","last_undegraded":"2024-09-17T03:45:39.076736+0000","last_fullsized":"2024-09-17T03:45:39.076736+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080839+0000","last_change":"2024-09-17T03:45:40.094260+0000","last_active":"2024-09-17T03:45:41.080839+0000","last_peered":"2024-09-17T03:45:41.080839+0000","last_clean":"2024-09-17T03:45:41.080839+0000","last_became_active":"2024-09-17T03:45:40.093926+0000","last_became_peered":"2024-09-17T03:45:40.093926+0000","last_unstale":"2024-09-17T03:45:41.080839+0000","last_undegraded":"2024-09-17T03:45:41.080839+0000","last_fullsized":"2024-09-17T03:45:41.080839+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:51.030663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074911+0000","last_change":"2024-09-17T03:45:39.074911+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074911+0000","last_undegraded":"2024-09-17T03:45:39.074911+0000","last_fullsized":"2024-09-17T03:45:39.074911+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078031+0000","last_change":"2024-09-17T03:45:39.078031+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078031+0000","last_undegraded":"2024-09-17T03:45:39.078031+0000","last_fullsized":"2024-09-17T03:45:39.078031+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075242+0000","last_change":"2024-09-17T03:45:39.075242+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075242+0000","last_undegraded":"2024-09-17T03:45:39.075242+0000","last_fullsized":"2024-09-17T03:45:39.075242+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081022+0000","last_change":"2024-09-17T03:45:40.088843+0000","last_active":"2024-09-17T03:45:41.081022+0000","last_peered":"2024-09-17T03:45:41.081022+0000","last_clean":"2024-09-17T03:45:41.081022+0000","last_became_active":"2024-09-17T03:45:40.088441+0000","last_became_peered":"2024-09-17T03:45:40.088441+0000","last_unstale":"2024-09-17T03:45:41.081022+0000","last_undegraded":"2024-09-17T03:45:41.081022+0000","last_fullsized":"2024-09-17T03:45:41.081022+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:25.818571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076898+0000","last_change":"2024-09-17T03:45:39.076898+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076898+0000","last_undegraded":"2024-09-17T03:45:39.076898+0000","last_fullsized":"2024-09-17T03:45:39.076898+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080082+0000","last_change":"2024-09-17T03:45:39.080082+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080082+0000","last_undegraded":"2024-09-17T03:45:39.080082+0000","last_fullsized":"2024-09-17T03:45:39.080082+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079648+0000","last_change":"2024-09-17T03:45:39.079648+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079648+0000","last_undegraded":"2024-09-17T03:45:39.079648+0000","last_fullsized":"2024-09-17T03:45:39.079648+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236781+0000","last_change":"2024-09-17T03:45:40.097641+0000","last_active":"2024-09-17T03:45:42.236781+0000","last_peered":"2024-09-17T03:45:42.236781+0000","last_clean":"2024-09-17T03:45:42.236781+0000","last_became_active":"2024-09-17T03:45:40.097332+0000","last_became_peered":"2024-09-17T03:45:40.097332+0000","last_unstale":"2024-09-17T03:45:42.236781+0000","last_undegraded":"2024-09-17T03:45:42.236781+0000","last_fullsized":"2024-09-17T03:45:42.236781+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:05.537118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078267+0000","last_change":"2024-09-17T03:45:39.078267+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078267+0000","last_undegraded":"2024-09-17T03:45:39.078267+0000","last_fullsized":"2024-09-17T03:45:39.078267+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.077965+0000","last_change":"2024-09-17T03:45:39.077965+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.077965+0000","last_undegraded":"2024-09-17T03:45:39.077965+0000","last_fullsized":"2024-09-17T03:45:39.077965+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236848+0000","last_change":"2024-09-17T03:45:40.096699+0000","last_active":"2024-09-17T03:45:42.236848+0000","last_peered":"2024-09-17T03:45:42.236848+0000","last_clean":"2024-09-17T03:45:42.236848+0000","last_became_active":"2024-09-17T03:45:40.096266+0000","last_became_peered":"2024-09-17T03:45:40.096266+0000","last_unstale":"2024-09-17T03:45:42.236848+0000","last_undegraded":"2024-09-17T03:45:42.236848+0000","last_fullsized":"2024-09-17T03:45:42.236848+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:33.456335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081247+0000","last_change":"2024-09-17T03:45:40.099955+0000","last_active":"2024-09-17T03:45:41.081247+0000","last_peered":"2024-09-17T03:45:41.081247+0000","last_clean":"2024-09-17T03:45:41.081247+0000","last_became_active":"2024-09-17T03:45:40.099354+0000","last_became_peered":"2024-09-17T03:45:40.099354+0000","last_unstale":"2024-09-17T03:45:41.081247+0000","last_undegraded":"2024-09-17T03:45:41.081247+0000","last_fullsized":"2024-09-17T03:45:41.081247+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:44.534249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078571+0000","last_change":"2024-09-17T03:45:39.078571+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078571+0000","last_undegraded":"2024-09-17T03:45:39.078571+0000","last_fullsized":"2024-09-17T03:45:39.078571+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081175+0000","last_change":"2024-09-17T03:45:40.086824+0000","last_active":"2024-09-17T03:45:41.081175+0000","last_peered":"2024-09-17T03:45:41.081175+0000","last_clean":"2024-09-17T03:45:41.081175+0000","last_became_active":"2024-09-17T03:45:40.086494+0000","last_became_peered":"2024-09-17T03:45:40.086494+0000","last_unstale":"2024-09-17T03:45:41.081175+0000","last_undegraded":"2024-09-17T03:45:41.081175+0000","last_fullsized":"2024-09-17T03:45:41.081175+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:37.172331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076200+0000","last_change":"2024-09-17T03:45:39.076200+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076200+0000","last_undegraded":"2024-09-17T03:45:39.076200+0000","last_fullsized":"2024-09-17T03:45:39.076200+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078806+0000","last_change":"2024-09-17T03:45:39.078806+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078806+0000","last_undegraded":"2024-09-17T03:45:39.078806+0000","last_fullsized":"2024-09-17T03:45:39.078806+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073115+0000","last_change":"2024-09-17T03:45:39.073115+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073115+0000","last_undegraded":"2024-09-17T03:45:39.073115+0000","last_fullsized":"2024-09-17T03:45:39.073115+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080048+0000","last_change":"2024-09-17T03:45:39.080048+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080048+0000","last_undegraded":"2024-09-17T03:45:39.080048+0000","last_fullsized":"2024-09-17T03:45:39.080048+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075372+0000","last_change":"2024-09-17T03:45:39.075372+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075372+0000","last_undegraded":"2024-09-17T03:45:39.075372+0000","last_fullsized":"2024-09-17T03:45:39.075372+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076918+0000","last_change":"2024-09-17T03:45:39.076918+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076918+0000","last_undegraded":"2024-09-17T03:45:39.076918+0000","last_fullsized":"2024-09-17T03:45:39.076918+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075469+0000","last_change":"2024-09-17T03:45:39.075469+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075469+0000","last_undegraded":"2024-09-17T03:45:39.075469+0000","last_fullsized":"2024-09-17T03:45:39.075469+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081077+0000","last_change":"2024-09-17T03:45:40.086000+0000","last_active":"2024-09-17T03:45:41.081077+0000","last_peered":"2024-09-17T03:45:41.081077+0000","last_clean":"2024-09-17T03:45:41.081077+0000","last_became_active":"2024-09-17T03:45:40.085687+0000","last_became_peered":"2024-09-17T03:45:40.085687+0000","last_unstale":"2024-09-17T03:45:41.081077+0000","last_undegraded":"2024-09-17T03:45:41.081077+0000","last_fullsized":"2024-09-17T03:45:41.081077+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:00.244977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236769+0000","last_change":"2024-09-17T03:45:40.115475+0000","last_active":"2024-09-17T03:45:42.236769+0000","last_peered":"2024-09-17T03:45:42.236769+0000","last_clean":"2024-09-17T03:45:42.236769+0000","last_became_active":"2024-09-17T03:45:40.115119+0000","last_became_peered":"2024-09-17T03:45:40.115119+0000","last_unstale":"2024-09-17T03:45:42.236769+0000","last_undegraded":"2024-09-17T03:45:42.236769+0000","last_fullsized":"2024-09-17T03:45:42.236769+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:28.743773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074566+0000","last_change":"2024-09-17T03:45:39.074566+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074566+0000","last_undegraded":"2024-09-17T03:45:39.074566+0000","last_fullsized":"2024-09-17T03:45:39.074566+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.081282+0000","last_change":"2024-09-17T03:45:39.081282+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.081282+0000","last_undegraded":"2024-09-17T03:45:39.081282+0000","last_fullsized":"2024-09-17T03:45:39.081282+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078984+0000","last_change":"2024-09-17T03:45:39.078984+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078984+0000","last_undegraded":"2024-09-17T03:45:39.078984+0000","last_fullsized":"2024-09-17T03:45:39.078984+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073306+0000","last_change":"2024-09-17T03:45:39.073306+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073306+0000","last_undegraded":"2024-09-17T03:45:39.073306+0000","last_fullsized":"2024-09-17T03:45:39.073306+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.088440+0000","last_change":"2024-09-17T03:45:39.087440+0000","last_active":"2024-09-17T03:45:39.088440+0000","last_peered":"2024-09-17T03:45:39.088440+0000","last_clean":"2024-09-17T03:45:39.088440+0000","last_became_active":"2024-09-17T03:45:39.086846+0000","last_became_peered":"2024-09-17T03:45:39.086846+0000","last_unstale":"2024-09-17T03:45:39.088440+0000","last_undegraded":"2024-09-17T03:45:39.088440+0000","last_fullsized":"2024-09-17T03:45:39.088440+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:17.792016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074721+0000","last_change":"2024-09-17T03:45:39.074721+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074721+0000","last_undegraded":"2024-09-17T03:45:39.074721+0000","last_fullsized":"2024-09-17T03:45:39.074721+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090581+0000","last_change":"2024-09-17T03:45:39.088533+0000","last_active":"2024-09-17T03:45:39.090581+0000","last_peered":"2024-09-17T03:45:39.090581+0000","last_clean":"2024-09-17T03:45:39.090581+0000","last_became_active":"2024-09-17T03:45:39.088224+0000","last_became_peered":"2024-09-17T03:45:39.088224+0000","last_unstale":"2024-09-17T03:45:39.090581+0000","last_undegraded":"2024-09-17T03:45:39.090581+0000","last_fullsized":"2024-09-17T03:45:39.090581+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:10.528815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236802+0000","last_change":"2024-09-17T03:45:40.115893+0000","last_active":"2024-09-17T03:45:42.236802+0000","last_peered":"2024-09-17T03:45:42.236802+0000","last_clean":"2024-09-17T03:45:42.236802+0000","last_became_active":"2024-09-17T03:45:40.114920+0000","last_became_peered":"2024-09-17T03:45:40.114920+0000","last_unstale":"2024-09-17T03:45:42.236802+0000","last_undegraded":"2024-09-17T03:45:42.236802+0000","last_fullsized":"2024-09-17T03:45:42.236802+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:18.878101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091413+0000","last_change":"2024-09-17T03:45:39.089597+0000","last_active":"2024-09-17T03:45:39.091413+0000","last_peered":"2024-09-17T03:45:39.091413+0000","last_clean":"2024-09-17T03:45:39.091413+0000","last_became_active":"2024-09-17T03:45:39.089273+0000","last_became_peered":"2024-09-17T03:45:39.089273+0000","last_unstale":"2024-09-17T03:45:39.091413+0000","last_undegraded":"2024-09-17T03:45:39.091413+0000","last_fullsized":"2024-09-17T03:45:39.091413+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:20.201366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074049+0000","last_change":"2024-09-17T03:45:39.074049+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074049+0000","last_undegraded":"2024-09-17T03:45:39.074049+0000","last_fullsized":"2024-09-17T03:45:39.074049+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.089266+0000","last_change":"2024-09-17T03:45:39.087754+0000","last_active":"2024-09-17T03:45:39.089266+0000","last_peered":"2024-09-17T03:45:39.089266+0000","last_clean":"2024-09-17T03:45:39.089266+0000","last_became_active":"2024-09-17T03:45:39.087430+0000","last_became_peered":"2024-09-17T03:45:39.087430+0000","last_unstale":"2024-09-17T03:45:39.089266+0000","last_undegraded":"2024-09-17T03:45:39.089266+0000","last_fullsized":"2024-09-17T03:45:39.089266+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:59.744416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075603+0000","last_change":"2024-09-17T03:45:39.075603+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075603+0000","last_undegraded":"2024-09-17T03:45:39.075603+0000","last_fullsized":"2024-09-17T03:45:39.075603+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091014+0000","last_change":"2024-09-17T03:45:39.088456+0000","last_active":"2024-09-17T03:45:39.091014+0000","last_peered":"2024-09-17T03:45:39.091014+0000","last_clean":"2024-09-17T03:45:39.091014+0000","last_became_active":"2024-09-17T03:45:39.088150+0000","last_became_peered":"2024-09-17T03:45:39.088150+0000","last_unstale":"2024-09-17T03:45:39.091014+0000","last_undegraded":"2024-09-17T03:45:39.091014+0000","last_fullsized":"2024-09-17T03:45:39.091014+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:56.658865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080945+0000","last_change":"2024-09-17T03:45:40.085937+0000","last_active":"2024-09-17T03:45:41.080945+0000","last_peered":"2024-09-17T03:45:41.080945+0000","last_clean":"2024-09-17T03:45:41.080945+0000","last_became_active":"2024-09-17T03:45:40.085615+0000","last_became_peered":"2024-09-17T03:45:40.085615+0000","last_unstale":"2024-09-17T03:45:41.080945+0000","last_undegraded":"2024-09-17T03:45:41.080945+0000","last_fullsized":"2024-09-17T03:45:41.080945+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:42.747919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236272+0000","last_change":"2024-09-17T03:45:39.088411+0000","last_active":"2024-09-17T03:45:42.236272+0000","last_peered":"2024-09-17T03:45:42.236272+0000","last_clean":"2024-09-17T03:45:42.236272+0000","last_became_active":"2024-09-17T03:45:39.088023+0000","last_became_peered":"2024-09-17T03:45:39.088023+0000","last_unstale":"2024-09-17T03:45:42.236272+0000","last_undegraded":"2024-09-17T03:45:42.236272+0000","last_fullsized":"2024-09-17T03:45:42.236272+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.002205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078676+0000","last_change":"2024-09-17T03:45:39.078676+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078676+0000","last_undegraded":"2024-09-17T03:45:39.078676+0000","last_fullsized":"2024-09-17T03:45:39.078676+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080963+0000","last_change":"2024-09-17T03:45:39.084140+0000","last_active":"2024-09-17T03:45:41.080963+0000","last_peered":"2024-09-17T03:45:41.080963+0000","last_clean":"2024-09-17T03:45:41.080963+0000","last_became_active":"2024-09-17T03:45:39.083831+0000","last_became_peered":"2024-09-17T03:45:39.083831+0000","last_unstale":"2024-09-17T03:45:41.080963+0000","last_undegraded":"2024-09-17T03:45:41.080963+0000","last_fullsized":"2024-09-17T03:45:41.080963+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:44.013378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080538+0000","last_change":"2024-09-17T03:45:39.080538+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080538+0000","last_undegraded":"2024-09-17T03:45:39.080538+0000","last_fullsized":"2024-09-17T03:45:39.080538+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091084+0000","last_change":"2024-09-17T03:45:39.084802+0000","last_active":"2024-09-17T03:45:39.091084+0000","last_peered":"2024-09-17T03:45:39.091084+0000","last_clean":"2024-09-17T03:45:39.091084+0000","last_became_active":"2024-09-17T03:45:39.084430+0000","last_became_peered":"2024-09-17T03:45:39.084430+0000","last_unstale":"2024-09-17T03:45:39.091084+0000","last_undegraded":"2024-09-17T03:45:39.091084+0000","last_fullsized":"2024-09-17T03:45:39.091084+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:22.720102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074912+0000","last_change":"2024-09-17T03:45:39.074912+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074912+0000","last_undegraded":"2024-09-17T03:45:39.074912+0000","last_fullsized":"2024-09-17T03:45:39.074912+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.087580+0000","last_change":"2024-09-17T03:45:39.085430+0000","last_active":"2024-09-17T03:45:39.087580+0000","last_peered":"2024-09-17T03:45:39.087580+0000","last_clean":"2024-09-17T03:45:39.087580+0000","last_became_active":"2024-09-17T03:45:39.085114+0000","last_became_peered":"2024-09-17T03:45:39.085114+0000","last_unstale":"2024-09-17T03:45:39.087580+0000","last_undegraded":"2024-09-17T03:45:39.087580+0000","last_fullsized":"2024-09-17T03:45:39.087580+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:28.360646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236975+0000","last_change":"2024-09-17T03:45:40.115366+0000","last_active":"2024-09-17T03:45:42.236975+0000","last_peered":"2024-09-17T03:45:42.236975+0000","last_clean":"2024-09-17T03:45:42.236975+0000","last_became_active":"2024-09-17T03:45:40.115007+0000","last_became_peered":"2024-09-17T03:45:40.115007+0000","last_unstale":"2024-09-17T03:45:42.236975+0000","last_undegraded":"2024-09-17T03:45:42.236975+0000","last_fullsized":"2024-09-17T03:45:42.236975+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:00.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086341+0000","last_change":"2024-09-17T03:45:39.084620+0000","last_active":"2024-09-17T03:45:39.086341+0000","last_peered":"2024-09-17T03:45:39.086341+0000","last_clean":"2024-09-17T03:45:39.086341+0000","last_became_active":"2024-09-17T03:45:39.084322+0000","last_became_peered":"2024-09-17T03:45:39.084322+0000","last_unstale":"2024-09-17T03:45:39.086341+0000","last_undegraded":"2024-09-17T03:45:39.086341+0000","last_fullsized":"2024-09-17T03:45:39.086341+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:23.419518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076428+0000","last_change":"2024-09-17T03:45:39.076428+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076428+0000","last_undegraded":"2024-09-17T03:45:39.076428+0000","last_fullsized":"2024-09-17T03:45:39.076428+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"187'6","reported_seq":21,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081163+0000","last_change":"2024-09-17T03:45:39.081186+0000","last_active":"2024-09-17T03:45:41.081163+0000","last_peered":"2024-09-17T03:45:41.081163+0000","last_clean":"2024-09-17T03:45:41.081163+0000","last_became_active":"2024-09-17T03:45:39.080858+0000","last_became_peered":"2024-09-17T03:45:39.080858+0000","last_unstale":"2024-09-17T03:45:41.081163+0000","last_undegraded":"2024-09-17T03:45:41.081163+0000","last_fullsized":"2024-09-17T03:45:41.081163+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:50.084175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078360+0000","last_change":"2024-09-17T03:45:39.078360+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078360+0000","last_undegraded":"2024-09-17T03:45:39.078360+0000","last_fullsized":"2024-09-17T03:45:39.078360+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.092592+0000","last_change":"2024-09-17T03:45:39.092139+0000","last_active":"2024-09-17T03:45:39.092592+0000","last_peered":"2024-09-17T03:45:39.092592+0000","last_clean":"2024-09-17T03:45:39.092592+0000","last_became_active":"2024-09-17T03:45:39.091812+0000","last_became_peered":"2024-09-17T03:45:39.091812+0000","last_unstale":"2024-09-17T03:45:39.092592+0000","last_undegraded":"2024-09-17T03:45:39.092592+0000","last_fullsized":"2024-09-17T03:45:39.092592+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:49.444116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.078432+0000","last_change":"2024-09-17T03:45:39.078432+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.078432+0000","last_undegraded":"2024-09-17T03:45:39.078432+0000","last_fullsized":"2024-09-17T03:45:39.078432+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.088181+0000","last_change":"2024-09-17T03:45:39.086455+0000","last_active":"2024-09-17T03:45:39.088181+0000","last_peered":"2024-09-17T03:45:39.088181+0000","last_clean":"2024-09-17T03:45:39.088181+0000","last_became_active":"2024-09-17T03:45:39.085888+0000","last_became_peered":"2024-09-17T03:45:39.085888+0000","last_unstale":"2024-09-17T03:45:39.088181+0000","last_undegraded":"2024-09-17T03:45:39.088181+0000","last_fullsized":"2024-09-17T03:45:39.088181+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:53.691121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074412+0000","last_change":"2024-09-17T03:45:39.074412+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074412+0000","last_undegraded":"2024-09-17T03:45:39.074412+0000","last_fullsized":"2024-09-17T03:45:39.074412+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091272+0000","last_change":"2024-09-17T03:45:39.090706+0000","last_active":"2024-09-17T03:45:39.091272+0000","last_peered":"2024-09-17T03:45:39.091272+0000","last_clean":"2024-09-17T03:45:39.091272+0000","last_became_active":"2024-09-17T03:45:39.089835+0000","last_became_peered":"2024-09-17T03:45:39.089835+0000","last_unstale":"2024-09-17T03:45:39.091272+0000","last_undegraded":"2024-09-17T03:45:39.091272+0000","last_fullsized":"2024-09-17T03:45:39.091272+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:08.367552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236471+0000","last_change":"2024-09-17T03:45:40.104541+0000","last_active":"2024-09-17T03:45:42.236471+0000","last_peered":"2024-09-17T03:45:42.236471+0000","last_clean":"2024-09-17T03:45:42.236471+0000","last_became_active":"2024-09-17T03:45:40.103770+0000","last_became_peered":"2024-09-17T03:45:40.103770+0000","last_unstale":"2024-09-17T03:45:42.236471+0000","last_undegraded":"2024-09-17T03:45:42.236471+0000","last_fullsized":"2024-09-17T03:45:42.236471+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:58.697052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090280+0000","last_change":"2024-09-17T03:45:39.086594+0000","last_active":"2024-09-17T03:45:39.090280+0000","last_peered":"2024-09-17T03:45:39.090280+0000","last_clean":"2024-09-17T03:45:39.090280+0000","last_became_active":"2024-09-17T03:45:39.086203+0000","last_became_peered":"2024-09-17T03:45:39.086203+0000","last_unstale":"2024-09-17T03:45:39.090280+0000","last_undegraded":"2024-09-17T03:45:39.090280+0000","last_fullsized":"2024-09-17T03:45:39.090280+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:36.052401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075198+0000","last_change":"2024-09-17T03:45:39.075198+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075198+0000","last_undegraded":"2024-09-17T03:45:39.075198+0000","last_fullsized":"2024-09-17T03:45:39.075198+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091563+0000","last_change":"2024-09-17T03:45:39.089285+0000","last_active":"2024-09-17T03:45:39.091563+0000","last_peered":"2024-09-17T03:45:39.091563+0000","last_clean":"2024-09-17T03:45:39.091563+0000","last_became_active":"2024-09-17T03:45:39.088977+0000","last_became_peered":"2024-09-17T03:45:39.088977+0000","last_unstale":"2024-09-17T03:45:39.091563+0000","last_undegraded":"2024-09-17T03:45:39.091563+0000","last_fullsized":"2024-09-17T03:45:39.091563+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:43.241792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081068+0000","last_change":"2024-09-17T03:45:40.099585+0000","last_active":"2024-09-17T03:45:41.081068+0000","last_peered":"2024-09-17T03:45:41.081068+0000","last_clean":"2024-09-17T03:45:41.081068+0000","last_became_active":"2024-09-17T03:45:40.098940+0000","last_became_peered":"2024-09-17T03:45:40.098940+0000","last_unstale":"2024-09-17T03:45:41.081068+0000","last_undegraded":"2024-09-17T03:45:41.081068+0000","last_fullsized":"2024-09-17T03:45:41.081068+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:37.932568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.083776+0000","last_change":"2024-09-17T03:45:39.082611+0000","last_active":"2024-09-17T03:45:39.083776+0000","last_peered":"2024-09-17T03:45:39.083776+0000","last_clean":"2024-09-17T03:45:39.083776+0000","last_became_active":"2024-09-17T03:45:39.082270+0000","last_became_peered":"2024-09-17T03:45:39.082270+0000","last_unstale":"2024-09-17T03:45:39.083776+0000","last_undegraded":"2024-09-17T03:45:39.083776+0000","last_fullsized":"2024-09-17T03:45:39.083776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:28.552320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076773+0000","last_change":"2024-09-17T03:45:39.076773+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076773+0000","last_undegraded":"2024-09-17T03:45:39.076773+0000","last_fullsized":"2024-09-17T03:45:39.076773+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091411+0000","last_change":"2024-09-17T03:45:39.087408+0000","last_active":"2024-09-17T03:45:39.091411+0000","last_peered":"2024-09-17T03:45:39.091411+0000","last_clean":"2024-09-17T03:45:39.091411+0000","last_became_active":"2024-09-17T03:45:39.087095+0000","last_became_peered":"2024-09-17T03:45:39.087095+0000","last_unstale":"2024-09-17T03:45:39.091411+0000","last_undegraded":"2024-09-17T03:45:39.091411+0000","last_fullsized":"2024-09-17T03:45:39.091411+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:40.161338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.072636+0000","last_change":"2024-09-17T03:45:39.072636+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.072636+0000","last_undegraded":"2024-09-17T03:45:39.072636+0000","last_fullsized":"2024-09-17T03:45:39.072636+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081218+0000","last_change":"2024-09-17T03:45:39.082669+0000","last_active":"2024-09-17T03:45:41.081218+0000","last_peered":"2024-09-17T03:45:41.081218+0000","last_clean":"2024-09-17T03:45:41.081218+0000","last_became_active":"2024-09-17T03:45:39.081790+0000","last_became_peered":"2024-09-17T03:45:39.081790+0000","last_unstale":"2024-09-17T03:45:41.081218+0000","last_undegraded":"2024-09-17T03:45:41.081218+0000","last_fullsized":"2024-09-17T03:45:41.081218+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:48.624264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.082401+0000","last_change":"2024-09-17T03:45:39.082401+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.082401+0000","last_undegraded":"2024-09-17T03:45:39.082401+0000","last_fullsized":"2024-09-17T03:45:39.082401+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086316+0000","last_change":"2024-09-17T03:45:39.079373+0000","last_active":"2024-09-17T03:45:39.086316+0000","last_peered":"2024-09-17T03:45:39.086316+0000","last_clean":"2024-09-17T03:45:39.086316+0000","last_became_active":"2024-09-17T03:45:39.079052+0000","last_became_peered":"2024-09-17T03:45:39.079052+0000","last_unstale":"2024-09-17T03:45:39.086316+0000","last_undegraded":"2024-09-17T03:45:39.086316+0000","last_fullsized":"2024-09-17T03:45:39.086316+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:57.303940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.075938+0000","last_change":"2024-09-17T03:45:39.075938+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.075938+0000","last_undegraded":"2024-09-17T03:45:39.075938+0000","last_fullsized":"2024-09-17T03:45:39.075938+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236655+0000","last_change":"2024-09-17T03:45:39.089753+0000","last_active":"2024-09-17T03:45:42.236655+0000","last_peered":"2024-09-17T03:45:42.236655+0000","last_clean":"2024-09-17T03:45:42.236655+0000","last_became_active":"2024-09-17T03:45:39.088599+0000","last_became_peered":"2024-09-17T03:45:39.088599+0000","last_unstale":"2024-09-17T03:45:42.236655+0000","last_undegraded":"2024-09-17T03:45:42.236655+0000","last_fullsized":"2024-09-17T03:45:42.236655+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:44.430375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.074408+0000","last_change":"2024-09-17T03:45:39.074408+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.074408+0000","last_undegraded":"2024-09-17T03:45:39.074408+0000","last_fullsized":"2024-09-17T03:45:39.074408+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236558+0000","last_change":"2024-09-17T03:45:39.087163+0000","last_active":"2024-09-17T03:45:42.236558+0000","last_peered":"2024-09-17T03:45:42.236558+0000","last_clean":"2024-09-17T03:45:42.236558+0000","last_became_active":"2024-09-17T03:45:39.086829+0000","last_became_peered":"2024-09-17T03:45:39.086829+0000","last_unstale":"2024-09-17T03:45:42.236558+0000","last_undegraded":"2024-09-17T03:45:42.236558+0000","last_fullsized":"2024-09-17T03:45:42.236558+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:21.031481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.080254+0000","last_change":"2024-09-17T03:45:39.080254+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.080254+0000","last_undegraded":"2024-09-17T03:45:39.080254+0000","last_fullsized":"2024-09-17T03:45:39.080254+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.089279+0000","last_change":"2024-09-17T03:45:39.081129+0000","last_active":"2024-09-17T03:45:39.089279+0000","last_peered":"2024-09-17T03:45:39.089279+0000","last_clean":"2024-09-17T03:45:39.089279+0000","last_became_active":"2024-09-17T03:45:39.080824+0000","last_became_peered":"2024-09-17T03:45:39.080824+0000","last_unstale":"2024-09-17T03:45:39.089279+0000","last_undegraded":"2024-09-17T03:45:39.089279+0000","last_fullsized":"2024-09-17T03:45:39.089279+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:14.851401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079612+0000","last_change":"2024-09-17T03:45:39.079612+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079612+0000","last_undegraded":"2024-09-17T03:45:39.079612+0000","last_fullsized":"2024-09-17T03:45:39.079612+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.092754+0000","last_change":"2024-09-17T03:45:39.092155+0000","last_active":"2024-09-17T03:45:39.092754+0000","last_peered":"2024-09-17T03:45:39.092754+0000","last_clean":"2024-09-17T03:45:39.092754+0000","last_became_active":"2024-09-17T03:45:39.091803+0000","last_became_peered":"2024-09-17T03:45:39.091803+0000","last_unstale":"2024-09-17T03:45:39.092754+0000","last_undegraded":"2024-09-17T03:45:39.092754+0000","last_fullsized":"2024-09-17T03:45:39.092754+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:30.581209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073105+0000","last_change":"2024-09-17T03:45:39.073105+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073105+0000","last_undegraded":"2024-09-17T03:45:39.073105+0000","last_fullsized":"2024-09-17T03:45:39.073105+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091136+0000","last_change":"2024-09-17T03:45:39.084693+0000","last_active":"2024-09-17T03:45:39.091136+0000","last_peered":"2024-09-17T03:45:39.091136+0000","last_clean":"2024-09-17T03:45:39.091136+0000","last_became_active":"2024-09-17T03:45:39.084367+0000","last_became_peered":"2024-09-17T03:45:39.084367+0000","last_unstale":"2024-09-17T03:45:39.091136+0000","last_undegraded":"2024-09-17T03:45:39.091136+0000","last_fullsized":"2024-09-17T03:45:39.091136+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:21.772713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.076289+0000","last_change":"2024-09-17T03:45:39.076289+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.076289+0000","last_undegraded":"2024-09-17T03:45:39.076289+0000","last_fullsized":"2024-09-17T03:45:39.076289+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091383+0000","last_change":"2024-09-17T03:45:39.087016+0000","last_active":"2024-09-17T03:45:39.091383+0000","last_peered":"2024-09-17T03:45:39.091383+0000","last_clean":"2024-09-17T03:45:39.091383+0000","last_became_active":"2024-09-17T03:45:39.086671+0000","last_became_peered":"2024-09-17T03:45:39.086671+0000","last_unstale":"2024-09-17T03:45:39.091383+0000","last_undegraded":"2024-09-17T03:45:39.091383+0000","last_fullsized":"2024-09-17T03:45:39.091383+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:19.011769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079037+0000","last_change":"2024-09-17T03:45:39.079037+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079037+0000","last_undegraded":"2024-09-17T03:45:39.079037+0000","last_fullsized":"2024-09-17T03:45:39.079037+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.091928+0000","last_change":"2024-09-17T03:45:39.091076+0000","last_active":"2024-09-17T03:45:39.091928+0000","last_peered":"2024-09-17T03:45:39.091928+0000","last_clean":"2024-09-17T03:45:39.091928+0000","last_became_active":"2024-09-17T03:45:39.090678+0000","last_became_peered":"2024-09-17T03:45:39.090678+0000","last_unstale":"2024-09-17T03:45:39.091928+0000","last_undegraded":"2024-09-17T03:45:39.091928+0000","last_fullsized":"2024-09-17T03:45:39.091928+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:57.888711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.079276+0000","last_change":"2024-09-17T03:45:39.079276+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.079276+0000","last_undegraded":"2024-09-17T03:45:39.079276+0000","last_fullsized":"2024-09-17T03:45:39.079276+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236611+0000","last_change":"2024-09-17T03:45:39.092305+0000","last_active":"2024-09-17T03:45:42.236611+0000","last_peered":"2024-09-17T03:45:42.236611+0000","last_clean":"2024-09-17T03:45:42.236611+0000","last_became_active":"2024-09-17T03:45:39.091982+0000","last_became_peered":"2024-09-17T03:45:39.091982+0000","last_unstale":"2024-09-17T03:45:42.236611+0000","last_undegraded":"2024-09-17T03:45:42.236611+0000","last_fullsized":"2024-09-17T03:45:42.236611+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:31.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073819+0000","last_change":"2024-09-17T03:45:39.073819+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073819+0000","last_undegraded":"2024-09-17T03:45:39.073819+0000","last_fullsized":"2024-09-17T03:45:39.073819+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.085964+0000","last_change":"2024-09-17T03:45:39.084602+0000","last_active":"2024-09-17T03:45:39.085964+0000","last_peered":"2024-09-17T03:45:39.085964+0000","last_clean":"2024-09-17T03:45:39.085964+0000","last_became_active":"2024-09-17T03:45:39.084286+0000","last_became_peered":"2024-09-17T03:45:39.084286+0000","last_unstale":"2024-09-17T03:45:39.085964+0000","last_undegraded":"2024-09-17T03:45:39.085964+0000","last_fullsized":"2024-09-17T03:45:39.085964+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:23.641470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073813+0000","last_change":"2024-09-17T03:45:39.073813+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073813+0000","last_undegraded":"2024-09-17T03:45:39.073813+0000","last_fullsized":"2024-09-17T03:45:39.073813+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.090953+0000","last_change":"2024-09-17T03:45:39.089774+0000","last_active":"2024-09-17T03:45:39.090953+0000","last_peered":"2024-09-17T03:45:39.090953+0000","last_clean":"2024-09-17T03:45:39.090953+0000","last_became_active":"2024-09-17T03:45:39.089502+0000","last_became_peered":"2024-09-17T03:45:39.089502+0000","last_unstale":"2024-09-17T03:45:39.090953+0000","last_undegraded":"2024-09-17T03:45:39.090953+0000","last_fullsized":"2024-09-17T03:45:39.090953+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:38.714674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.072524+0000","last_change":"2024-09-17T03:45:39.072524+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.072524+0000","last_undegraded":"2024-09-17T03:45:39.072524+0000","last_fullsized":"2024-09-17T03:45:39.072524+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.086606+0000","last_change":"2024-09-17T03:45:39.080285+0000","last_active":"2024-09-17T03:45:39.086606+0000","last_peered":"2024-09-17T03:45:39.086606+0000","last_clean":"2024-09-17T03:45:39.086606+0000","last_became_active":"2024-09-17T03:45:39.079973+0000","last_became_peered":"2024-09-17T03:45:39.079973+0000","last_unstale":"2024-09-17T03:45:39.086606+0000","last_undegraded":"2024-09-17T03:45:39.086606+0000","last_fullsized":"2024-09-17T03:45:39.086606+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:16.852797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":1,"reported_epoch":186,"state":"creating+peering","last_fresh":"2024-09-17T03:45:39.073628+0000","last_change":"2024-09-17T03:45:39.073628+0000","last_active":"2024-09-17T03:45:39.066232+0000","last_peered":"2024-09-17T03:45:39.066232+0000","last_clean":"2024-09-17T03:45:39.066232+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:45:39.073628+0000","last_undegraded":"2024-09-17T03:45:39.073628+0000","last_fullsized":"2024-09-17T03:45:39.073628+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"187'2","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236742+0000","last_change":"2024-09-17T03:45:39.090713+0000","last_active":"2024-09-17T03:45:42.236742+0000","last_peered":"2024-09-17T03:45:42.236742+0000","last_clean":"2024-09-17T03:45:42.236742+0000","last_became_active":"2024-09-17T03:45:39.090324+0000","last_became_peered":"2024-09-17T03:45:39.090324+0000","last_unstale":"2024-09-17T03:45:42.236742+0000","last_undegraded":"2024-09-17T03:45:42.236742+0000","last_fullsized":"2024-09-17T03:45:42.236742+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:27.632921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":413,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-17T03:45:39.073852+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:45:39.073852+0000","last_peered":"2024-09-17T03:45:39.073852+0000","last_clean":"2024-09-17T03:45:39.073852+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:45:39.073852+0000","last_undegraded":"2024-09-17T03:45:39.073852+0000","last_fullsized":"2024-09-17T03:45:39.073852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509598,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60432,"kb_used_data":2868,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311408,"statfs":{"total":96636764160,"available":96574881792,"internally_reserved":0,"allocated":2936832,"data_stored":1619468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59848,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311992,"statfs":{"total":96636764160,"available":96575479808,"internally_reserved":0,"allocated":2342912,"data_stored":1029100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65336,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306504,"statfs":{"total":96636764160,"available":96569860096,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509598,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55676,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316164,"statfs":{"total":96636764160,"available":96579751936,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59832,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312008,"statfs":{"total":96636764160,"available":96575496192,"internally_reserved":0,"allocated":2330624,"data_stored":1022825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509599,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56272,"kb_used_data":2868,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":2936832,"data_stored":1619468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55708,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316132,"statfs":{"total":96636764160,"available":96579719168,"internally_reserved":0,"allocated":2367488,"data_stored":1042175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55732,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316108,"statfs":{"total":96636764160,"available":96579694592,"internally_reserved":0,"allocated":2383872,"data_stored":1043857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:45:48.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:45:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.691+0000 7fbeff427640 1 -- 172.21.15.146:0/1288503437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef815c9f0 msgr2=0x7fbef81526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.691+0000 7fbeff427640 1 --2- 172.21.15.146:0/1288503437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef815c9f0 0x7fbef81526a0 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7fbef815d000 tx=0x7fbef402a890 comp rx=0 tx=0).stop 2024-09-17T03:45:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.691+0000 7fbeff427640 1 -- 172.21.15.146:0/1288503437 shutdown_connections 2024-09-17T03:45:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.691+0000 7fbeff427640 1 --2- 172.21.15.146:0/1288503437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbef80b4100 0x7fbef806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.691+0000 7fbeff427640 1 --2- 172.21.15.146:0/1288503437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef815c9f0 0x7fbef81526a0 unknown :-1 s=CLOSED pgs=2430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.691+0000 7fbeff427640 1 -- 172.21.15.146:0/1288503437 >> 172.21.15.146:0/1288503437 conn(0x7fbef806d3c0 msgr2=0x7fbef80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.691+0000 7fbeff427640 1 -- 172.21.15.146:0/1288503437 shutdown_connections 2024-09-17T03:45:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.691+0000 7fbeff427640 1 -- 172.21.15.146:0/1288503437 wait complete. 2024-09-17T03:45:48.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.693+0000 7fbeff427640 1 Processor -- start 2024-09-17T03:45:48.693 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.693+0000 7fbeff427640 1 -- start start 2024-09-17T03:45:48.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.694+0000 7fbeff427640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbef80b4100 0x7fbef81f7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:48.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.694+0000 7fbeff427640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef80b4510 0x7fbef814b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.694+0000 7fbeff427640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8155d40 0x7fbef81f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.694+0000 7fbeff427640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbef80d0730 con 0x7fbef8155d40 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.694+0000 7fbeff427640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbef80d05b0 con 0x7fbef80b4510 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.694+0000 7fbeff427640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbef80d08b0 con 0x7fbef80b4100 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.694+0000 7fbefd9c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8155d40 0x7fbef81f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.694+0000 7fbefd9c4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8155d40 0x7fbef81f3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38640/0 (socket says 172.21.15.146:38640) 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.694+0000 7fbefd9c4640 1 -- 172.21.15.146:0/183219412 learned_addr learned my addr 172.21.15.146:0/183219412 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.694+0000 7fbefd1c3640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbef80b4100 0x7fbef81f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.694+0000 7fbefc9c2640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef80b4510 0x7fbef814b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbefd9c4640 1 -- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbef80b4100 msgr2=0x7fbef81f7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbefd9c4640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbef80b4100 0x7fbef81f7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:48.696 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbefd9c4640 1 -- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef80b4510 msgr2=0x7fbef814b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbefd9c4640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef80b4510 0x7fbef814b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbefd9c4640 1 -- 172.21.15.146:0/183219412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef81f3700 con 0x7fbef8155d40 2024-09-17T03:45:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbefc9c2640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef80b4510 0x7fbef814b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbefd9c4640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8155d40 0x7fbef81f3ee0 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7fbef000c370 tx=0x7fbef000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbeedffb640 1 -- 172.21.15.146:0/183219412 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0017070 con 0x7fbef8155d40 2024-09-17T03:45:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbeedffb640 1 -- 172.21.15.146:0/183219412 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbef00035f0 con 0x7fbef8155d40 2024-09-17T03:45:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbeff427640 1 -- 172.21.15.146:0/183219412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef814c690 con 0x7fbef8155d40 2024-09-17T03:45:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbeedffb640 1 -- 172.21.15.146:0/183219412 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0003a40 con 0x7fbef8155d40 2024-09-17T03:45:48.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.695+0000 7fbeff427640 1 -- 172.21.15.146:0/183219412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef81f39c0 con 0x7fbef8155d40 2024-09-17T03:45:48.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.696+0000 7fbeff427640 1 -- 172.21.15.146:0/183219412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef815c9f0 con 0x7fbef8155d40 2024-09-17T03:45:48.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.697+0000 7fbeedffb640 1 -- 172.21.15.146:0/183219412 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbef001a070 con 0x7fbef8155d40 2024-09-17T03:45:48.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.697+0000 7fbeedffb640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbedc078bc0 0x7fbedc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:48.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.697+0000 7fbeedffb640 1 -- 172.21.15.146:0/183219412 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fbef0099ea0 con 0x7fbef8155d40 2024-09-17T03:45:48.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.698+0000 7fbefd1c3640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbedc078bc0 0x7fbedc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:48.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.698+0000 7fbefd1c3640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbedc078bc0 0x7fbedc07b0d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fbef4034000 tx=0x7fbef4004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:48.702 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.702+0000 7fbeedffb640 1 -- 172.21.15.146:0/183219412 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbef0061d30 con 0x7fbef8155d40 2024-09-17T03:45:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.873+0000 7fbeff427640 1 -- 172.21.15.146:0/183219412 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbef814cbb0 con 0x7fbedc078bc0 2024-09-17T03:45:48.878 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.878+0000 7fbeedffb640 1 -- 172.21.15.146:0/183219412 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252457 (secure 0 0 0) 0x7fbef4003d00 con 0x7fbedc078bc0 2024-09-17T03:45:48.881 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:48.882 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:45:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 -- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbedc078bc0 msgr2=0x7fbedc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbedc078bc0 0x7fbedc07b0d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fbef4034000 tx=0x7fbef4004ab0 comp rx=0 tx=0).stop 2024-09-17T03:45:48.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 -- 172.21.15.146:0/183219412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8155d40 msgr2=0x7fbef81f3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8155d40 0x7fbef81f3ee0 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7fbef000c370 tx=0x7fbef000c830 comp rx=0 tx=0).stop 2024-09-17T03:45:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 -- 172.21.15.146:0/183219412 shutdown_connections 2024-09-17T03:45:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbedc078bc0 0x7fbedc07b0d0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8155d40 0x7fbef81f3ee0 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbef80b4510 0x7fbef814b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 --2- 172.21.15.146:0/183219412 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbef80b4100 0x7fbef81f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 -- 172.21.15.146:0/183219412 >> 172.21.15.146:0/183219412 conn(0x7fbef806d3c0 msgr2=0x7fbef81526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 -- 172.21.15.146:0/183219412 shutdown_connections 2024-09-17T03:45:48.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:48.881+0000 7fbeff427640 1 -- 172.21.15.146:0/183219412 wait complete. 2024-09-17T03:45:48.893 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":572,"stamp":"2024-09-17T03:45:47.996329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":469056,"kb_used_data":19720,"kb_used_omap":12,"kb_used_meta":449139,"kb_avail":754505664,"statfs":{"total":773094113280,"available":772613799936,"internally_reserved":0,"allocated":20193280,"data_stored":9522956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":459918897},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002262"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101619+0000","last_change":"2024-09-17T03:45:40.109363+0000","last_active":"2024-09-17T03:45:41.101619+0000","last_peered":"2024-09-17T03:45:41.101619+0000","last_clean":"2024-09-17T03:45:41.101619+0000","last_became_active":"2024-09-17T03:45:40.108994+0000","last_became_peered":"2024-09-17T03:45:40.108994+0000","last_unstale":"2024-09-17T03:45:41.101619+0000","last_undegraded":"2024-09-17T03:45:41.101619+0000","last_fullsized":"2024-09-17T03:45:41.101619+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:48.716151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.082863+0000","last_change":"2024-09-17T03:45:40.106727+0000","last_active":"2024-09-17T03:45:41.082863+0000","last_peered":"2024-09-17T03:45:41.082863+0000","last_clean":"2024-09-17T03:45:41.082863+0000","last_became_active":"2024-09-17T03:45:40.106031+0000","last_became_peered":"2024-09-17T03:45:40.106031+0000","last_unstale":"2024-09-17T03:45:41.082863+0000","last_undegraded":"2024-09-17T03:45:41.082863+0000","last_fullsized":"2024-09-17T03:45:41.082863+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:42.953873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083318+0000","last_change":"2024-09-17T03:45:40.095602+0000","last_active":"2024-09-17T03:45:41.083318+0000","last_peered":"2024-09-17T03:45:41.083318+0000","last_clean":"2024-09-17T03:45:41.083318+0000","last_became_active":"2024-09-17T03:45:40.095249+0000","last_became_peered":"2024-09-17T03:45:40.095249+0000","last_unstale":"2024-09-17T03:45:41.083318+0000","last_undegraded":"2024-09-17T03:45:41.083318+0000","last_fullsized":"2024-09-17T03:45:41.083318+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:28.173425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.237220+0000","last_change":"2024-09-17T03:45:40.096940+0000","last_active":"2024-09-17T03:45:42.237220+0000","last_peered":"2024-09-17T03:45:42.237220+0000","last_clean":"2024-09-17T03:45:42.237220+0000","last_became_active":"2024-09-17T03:45:40.096619+0000","last_became_peered":"2024-09-17T03:45:40.096619+0000","last_unstale":"2024-09-17T03:45:42.237220+0000","last_undegraded":"2024-09-17T03:45:42.237220+0000","last_fullsized":"2024-09-17T03:45:42.237220+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:46.564211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236803+0000","last_change":"2024-09-17T03:45:40.089909+0000","last_active":"2024-09-17T03:45:42.236803+0000","last_peered":"2024-09-17T03:45:42.236803+0000","last_clean":"2024-09-17T03:45:42.236803+0000","last_became_active":"2024-09-17T03:45:40.089620+0000","last_became_peered":"2024-09-17T03:45:40.089620+0000","last_unstale":"2024-09-17T03:45:42.236803+0000","last_undegraded":"2024-09-17T03:45:42.236803+0000","last_fullsized":"2024-09-17T03:45:42.236803+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:19.545100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080839+0000","last_change":"2024-09-17T03:45:40.094260+0000","last_active":"2024-09-17T03:45:41.080839+0000","last_peered":"2024-09-17T03:45:41.080839+0000","last_clean":"2024-09-17T03:45:41.080839+0000","last_became_active":"2024-09-17T03:45:40.093926+0000","last_became_peered":"2024-09-17T03:45:40.093926+0000","last_unstale":"2024-09-17T03:45:41.080839+0000","last_undegraded":"2024-09-17T03:45:41.080839+0000","last_fullsized":"2024-09-17T03:45:41.080839+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:51.030663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083084+0000","last_change":"2024-09-17T03:45:40.094278+0000","last_active":"2024-09-17T03:45:41.083084+0000","last_peered":"2024-09-17T03:45:41.083084+0000","last_clean":"2024-09-17T03:45:41.083084+0000","last_became_active":"2024-09-17T03:45:40.093809+0000","last_became_peered":"2024-09-17T03:45:40.093809+0000","last_unstale":"2024-09-17T03:45:41.083084+0000","last_undegraded":"2024-09-17T03:45:41.083084+0000","last_fullsized":"2024-09-17T03:45:41.083084+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:02.719779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.103244+0000","last_change":"2024-09-17T03:45:40.090029+0000","last_active":"2024-09-17T03:45:41.103244+0000","last_peered":"2024-09-17T03:45:41.103244+0000","last_clean":"2024-09-17T03:45:41.103244+0000","last_became_active":"2024-09-17T03:45:40.089398+0000","last_became_peered":"2024-09-17T03:45:40.089398+0000","last_unstale":"2024-09-17T03:45:41.103244+0000","last_undegraded":"2024-09-17T03:45:41.103244+0000","last_fullsized":"2024-09-17T03:45:41.103244+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:18.861387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083652+0000","last_change":"2024-09-17T03:45:40.103252+0000","last_active":"2024-09-17T03:45:41.083652+0000","last_peered":"2024-09-17T03:45:41.083652+0000","last_clean":"2024-09-17T03:45:41.083652+0000","last_became_active":"2024-09-17T03:45:40.102619+0000","last_became_peered":"2024-09-17T03:45:40.102619+0000","last_unstale":"2024-09-17T03:45:41.083652+0000","last_undegraded":"2024-09-17T03:45:41.083652+0000","last_fullsized":"2024-09-17T03:45:41.083652+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:49.010490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081022+0000","last_change":"2024-09-17T03:45:40.088843+0000","last_active":"2024-09-17T03:45:41.081022+0000","last_peered":"2024-09-17T03:45:41.081022+0000","last_clean":"2024-09-17T03:45:41.081022+0000","last_became_active":"2024-09-17T03:45:40.088441+0000","last_became_peered":"2024-09-17T03:45:40.088441+0000","last_unstale":"2024-09-17T03:45:41.081022+0000","last_undegraded":"2024-09-17T03:45:41.081022+0000","last_fullsized":"2024-09-17T03:45:41.081022+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:25.818571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101337+0000","last_change":"2024-09-17T03:45:40.103455+0000","last_active":"2024-09-17T03:45:41.101337+0000","last_peered":"2024-09-17T03:45:41.101337+0000","last_clean":"2024-09-17T03:45:41.101337+0000","last_became_active":"2024-09-17T03:45:40.102595+0000","last_became_peered":"2024-09-17T03:45:40.102595+0000","last_unstale":"2024-09-17T03:45:41.101337+0000","last_undegraded":"2024-09-17T03:45:41.101337+0000","last_fullsized":"2024-09-17T03:45:41.101337+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:35.974427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083968+0000","last_change":"2024-09-17T03:45:40.095454+0000","last_active":"2024-09-17T03:45:41.083968+0000","last_peered":"2024-09-17T03:45:41.083968+0000","last_clean":"2024-09-17T03:45:41.083968+0000","last_became_active":"2024-09-17T03:45:40.095139+0000","last_became_peered":"2024-09-17T03:45:40.095139+0000","last_unstale":"2024-09-17T03:45:41.083968+0000","last_undegraded":"2024-09-17T03:45:41.083968+0000","last_fullsized":"2024-09-17T03:45:41.083968+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:10.144426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.082707+0000","last_change":"2024-09-17T03:45:40.094557+0000","last_active":"2024-09-17T03:45:41.082707+0000","last_peered":"2024-09-17T03:45:41.082707+0000","last_clean":"2024-09-17T03:45:41.082707+0000","last_became_active":"2024-09-17T03:45:40.094076+0000","last_became_peered":"2024-09-17T03:45:40.094076+0000","last_unstale":"2024-09-17T03:45:41.082707+0000","last_undegraded":"2024-09-17T03:45:41.082707+0000","last_fullsized":"2024-09-17T03:45:41.082707+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:52.060228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236781+0000","last_change":"2024-09-17T03:45:40.097641+0000","last_active":"2024-09-17T03:45:42.236781+0000","last_peered":"2024-09-17T03:45:42.236781+0000","last_clean":"2024-09-17T03:45:42.236781+0000","last_became_active":"2024-09-17T03:45:40.097332+0000","last_became_peered":"2024-09-17T03:45:40.097332+0000","last_unstale":"2024-09-17T03:45:42.236781+0000","last_undegraded":"2024-09-17T03:45:42.236781+0000","last_fullsized":"2024-09-17T03:45:42.236781+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:05.537118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236004+0000","last_change":"2024-09-17T03:45:40.097995+0000","last_active":"2024-09-17T03:45:42.236004+0000","last_peered":"2024-09-17T03:45:42.236004+0000","last_clean":"2024-09-17T03:45:42.236004+0000","last_became_active":"2024-09-17T03:45:40.097696+0000","last_became_peered":"2024-09-17T03:45:40.097696+0000","last_unstale":"2024-09-17T03:45:42.236004+0000","last_undegraded":"2024-09-17T03:45:42.236004+0000","last_fullsized":"2024-09-17T03:45:42.236004+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:25.583518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.084354+0000","last_change":"2024-09-17T03:45:40.094406+0000","last_active":"2024-09-17T03:45:41.084354+0000","last_peered":"2024-09-17T03:45:41.084354+0000","last_clean":"2024-09-17T03:45:41.084354+0000","last_became_active":"2024-09-17T03:45:40.094060+0000","last_became_peered":"2024-09-17T03:45:40.094060+0000","last_unstale":"2024-09-17T03:45:41.084354+0000","last_undegraded":"2024-09-17T03:45:41.084354+0000","last_fullsized":"2024-09-17T03:45:41.084354+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:54.243093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236848+0000","last_change":"2024-09-17T03:45:40.096699+0000","last_active":"2024-09-17T03:45:42.236848+0000","last_peered":"2024-09-17T03:45:42.236848+0000","last_clean":"2024-09-17T03:45:42.236848+0000","last_became_active":"2024-09-17T03:45:40.096266+0000","last_became_peered":"2024-09-17T03:45:40.096266+0000","last_unstale":"2024-09-17T03:45:42.236848+0000","last_undegraded":"2024-09-17T03:45:42.236848+0000","last_fullsized":"2024-09-17T03:45:42.236848+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:33.456335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081247+0000","last_change":"2024-09-17T03:45:40.099955+0000","last_active":"2024-09-17T03:45:41.081247+0000","last_peered":"2024-09-17T03:45:41.081247+0000","last_clean":"2024-09-17T03:45:41.081247+0000","last_became_active":"2024-09-17T03:45:40.099354+0000","last_became_peered":"2024-09-17T03:45:40.099354+0000","last_unstale":"2024-09-17T03:45:41.081247+0000","last_undegraded":"2024-09-17T03:45:41.081247+0000","last_fullsized":"2024-09-17T03:45:41.081247+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:44.534249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.237352+0000","last_change":"2024-09-17T03:45:40.105386+0000","last_active":"2024-09-17T03:45:42.237352+0000","last_peered":"2024-09-17T03:45:42.237352+0000","last_clean":"2024-09-17T03:45:42.237352+0000","last_became_active":"2024-09-17T03:45:40.104837+0000","last_became_peered":"2024-09-17T03:45:40.104837+0000","last_unstale":"2024-09-17T03:45:42.237352+0000","last_undegraded":"2024-09-17T03:45:42.237352+0000","last_fullsized":"2024-09-17T03:45:42.237352+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:15.708302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081175+0000","last_change":"2024-09-17T03:45:40.086824+0000","last_active":"2024-09-17T03:45:41.081175+0000","last_peered":"2024-09-17T03:45:41.081175+0000","last_clean":"2024-09-17T03:45:41.081175+0000","last_became_active":"2024-09-17T03:45:40.086494+0000","last_became_peered":"2024-09-17T03:45:40.086494+0000","last_unstale":"2024-09-17T03:45:41.081175+0000","last_undegraded":"2024-09-17T03:45:41.081175+0000","last_fullsized":"2024-09-17T03:45:41.081175+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:37.172331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236942+0000","last_change":"2024-09-17T03:45:40.102736+0000","last_active":"2024-09-17T03:45:42.236942+0000","last_peered":"2024-09-17T03:45:42.236942+0000","last_clean":"2024-09-17T03:45:42.236942+0000","last_became_active":"2024-09-17T03:45:40.102412+0000","last_became_peered":"2024-09-17T03:45:40.102412+0000","last_unstale":"2024-09-17T03:45:42.236942+0000","last_undegraded":"2024-09-17T03:45:42.236942+0000","last_fullsized":"2024-09-17T03:45:42.236942+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:52.265139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236132+0000","last_change":"2024-09-17T03:45:40.090690+0000","last_active":"2024-09-17T03:45:42.236132+0000","last_peered":"2024-09-17T03:45:42.236132+0000","last_clean":"2024-09-17T03:45:42.236132+0000","last_became_active":"2024-09-17T03:45:40.090393+0000","last_became_peered":"2024-09-17T03:45:40.090393+0000","last_unstale":"2024-09-17T03:45:42.236132+0000","last_undegraded":"2024-09-17T03:45:42.236132+0000","last_fullsized":"2024-09-17T03:45:42.236132+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:59.493411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101115+0000","last_change":"2024-09-17T03:45:40.102054+0000","last_active":"2024-09-17T03:45:41.101115+0000","last_peered":"2024-09-17T03:45:41.101115+0000","last_clean":"2024-09-17T03:45:41.101115+0000","last_became_active":"2024-09-17T03:45:40.101688+0000","last_became_peered":"2024-09-17T03:45:40.101688+0000","last_unstale":"2024-09-17T03:45:41.101115+0000","last_undegraded":"2024-09-17T03:45:41.101115+0000","last_fullsized":"2024-09-17T03:45:41.101115+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:05.546514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236039+0000","last_change":"2024-09-17T03:45:40.089257+0000","last_active":"2024-09-17T03:45:42.236039+0000","last_peered":"2024-09-17T03:45:42.236039+0000","last_clean":"2024-09-17T03:45:42.236039+0000","last_became_active":"2024-09-17T03:45:40.088880+0000","last_became_peered":"2024-09-17T03:45:40.088880+0000","last_unstale":"2024-09-17T03:45:42.236039+0000","last_undegraded":"2024-09-17T03:45:42.236039+0000","last_fullsized":"2024-09-17T03:45:42.236039+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:58.440328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101648+0000","last_change":"2024-09-17T03:45:40.110258+0000","last_active":"2024-09-17T03:45:41.101648+0000","last_peered":"2024-09-17T03:45:41.101648+0000","last_clean":"2024-09-17T03:45:41.101648+0000","last_became_active":"2024-09-17T03:45:40.109928+0000","last_became_peered":"2024-09-17T03:45:40.109928+0000","last_unstale":"2024-09-17T03:45:41.101648+0000","last_undegraded":"2024-09-17T03:45:41.101648+0000","last_fullsized":"2024-09-17T03:45:41.101648+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:29.676905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.103569+0000","last_change":"2024-09-17T03:45:40.096815+0000","last_active":"2024-09-17T03:45:41.103569+0000","last_peered":"2024-09-17T03:45:41.103569+0000","last_clean":"2024-09-17T03:45:41.103569+0000","last_became_active":"2024-09-17T03:45:40.096491+0000","last_became_peered":"2024-09-17T03:45:40.096491+0000","last_unstale":"2024-09-17T03:45:41.103569+0000","last_undegraded":"2024-09-17T03:45:41.103569+0000","last_fullsized":"2024-09-17T03:45:41.103569+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:27.484618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101683+0000","last_change":"2024-09-17T03:45:40.103813+0000","last_active":"2024-09-17T03:45:41.101683+0000","last_peered":"2024-09-17T03:45:41.101683+0000","last_clean":"2024-09-17T03:45:41.101683+0000","last_became_active":"2024-09-17T03:45:40.103064+0000","last_became_peered":"2024-09-17T03:45:40.103064+0000","last_unstale":"2024-09-17T03:45:41.101683+0000","last_undegraded":"2024-09-17T03:45:41.101683+0000","last_fullsized":"2024-09-17T03:45:41.101683+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:40.251469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081077+0000","last_change":"2024-09-17T03:45:40.086000+0000","last_active":"2024-09-17T03:45:41.081077+0000","last_peered":"2024-09-17T03:45:41.081077+0000","last_clean":"2024-09-17T03:45:41.081077+0000","last_became_active":"2024-09-17T03:45:40.085687+0000","last_became_peered":"2024-09-17T03:45:40.085687+0000","last_unstale":"2024-09-17T03:45:41.081077+0000","last_undegraded":"2024-09-17T03:45:41.081077+0000","last_fullsized":"2024-09-17T03:45:41.081077+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:00.244977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236769+0000","last_change":"2024-09-17T03:45:40.115475+0000","last_active":"2024-09-17T03:45:42.236769+0000","last_peered":"2024-09-17T03:45:42.236769+0000","last_clean":"2024-09-17T03:45:42.236769+0000","last_became_active":"2024-09-17T03:45:40.115119+0000","last_became_peered":"2024-09-17T03:45:40.115119+0000","last_unstale":"2024-09-17T03:45:42.236769+0000","last_undegraded":"2024-09-17T03:45:42.236769+0000","last_fullsized":"2024-09-17T03:45:42.236769+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:28.743773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101192+0000","last_change":"2024-09-17T03:45:40.111818+0000","last_active":"2024-09-17T03:45:41.101192+0000","last_peered":"2024-09-17T03:45:41.101192+0000","last_clean":"2024-09-17T03:45:41.101192+0000","last_became_active":"2024-09-17T03:45:40.111519+0000","last_became_peered":"2024-09-17T03:45:40.111519+0000","last_unstale":"2024-09-17T03:45:41.101192+0000","last_undegraded":"2024-09-17T03:45:41.101192+0000","last_fullsized":"2024-09-17T03:45:41.101192+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:46.561711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.235971+0000","last_change":"2024-09-17T03:45:40.100391+0000","last_active":"2024-09-17T03:45:42.235971+0000","last_peered":"2024-09-17T03:45:42.235971+0000","last_clean":"2024-09-17T03:45:42.235971+0000","last_became_active":"2024-09-17T03:45:40.100097+0000","last_became_peered":"2024-09-17T03:45:40.100097+0000","last_unstale":"2024-09-17T03:45:42.235971+0000","last_undegraded":"2024-09-17T03:45:42.235971+0000","last_fullsized":"2024-09-17T03:45:42.235971+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:11.083510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.235906+0000","last_change":"2024-09-17T03:45:40.108853+0000","last_active":"2024-09-17T03:45:42.235906+0000","last_peered":"2024-09-17T03:45:42.235906+0000","last_clean":"2024-09-17T03:45:42.235906+0000","last_became_active":"2024-09-17T03:45:40.108505+0000","last_became_peered":"2024-09-17T03:45:40.108505+0000","last_unstale":"2024-09-17T03:45:42.235906+0000","last_undegraded":"2024-09-17T03:45:42.235906+0000","last_fullsized":"2024-09-17T03:45:42.235906+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:57.732210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.084659+0000","last_change":"2024-09-17T03:45:40.110379+0000","last_active":"2024-09-17T03:45:41.084659+0000","last_peered":"2024-09-17T03:45:41.084659+0000","last_clean":"2024-09-17T03:45:41.084659+0000","last_became_active":"2024-09-17T03:45:40.110047+0000","last_became_peered":"2024-09-17T03:45:40.110047+0000","last_unstale":"2024-09-17T03:45:41.084659+0000","last_undegraded":"2024-09-17T03:45:41.084659+0000","last_fullsized":"2024-09-17T03:45:41.084659+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:46.895849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"187'4","reported_seq":19,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236457+0000","last_change":"2024-09-17T03:45:39.087440+0000","last_active":"2024-09-17T03:45:42.236457+0000","last_peered":"2024-09-17T03:45:42.236457+0000","last_clean":"2024-09-17T03:45:42.236457+0000","last_became_active":"2024-09-17T03:45:39.086846+0000","last_became_peered":"2024-09-17T03:45:39.086846+0000","last_unstale":"2024-09-17T03:45:42.236457+0000","last_undegraded":"2024-09-17T03:45:42.236457+0000","last_fullsized":"2024-09-17T03:45:42.236457+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:01.230481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.103563+0000","last_change":"2024-09-17T03:45:40.096482+0000","last_active":"2024-09-17T03:45:41.103563+0000","last_peered":"2024-09-17T03:45:41.103563+0000","last_clean":"2024-09-17T03:45:41.103563+0000","last_became_active":"2024-09-17T03:45:40.096111+0000","last_became_peered":"2024-09-17T03:45:40.096111+0000","last_unstale":"2024-09-17T03:45:41.103563+0000","last_undegraded":"2024-09-17T03:45:41.103563+0000","last_fullsized":"2024-09-17T03:45:41.103563+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:32.031291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"187'1","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.084076+0000","last_change":"2024-09-17T03:45:39.088533+0000","last_active":"2024-09-17T03:45:41.084076+0000","last_peered":"2024-09-17T03:45:41.084076+0000","last_clean":"2024-09-17T03:45:41.084076+0000","last_became_active":"2024-09-17T03:45:39.088224+0000","last_became_peered":"2024-09-17T03:45:39.088224+0000","last_unstale":"2024-09-17T03:45:41.084076+0000","last_undegraded":"2024-09-17T03:45:41.084076+0000","last_fullsized":"2024-09-17T03:45:41.084076+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:11.999666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236802+0000","last_change":"2024-09-17T03:45:40.115893+0000","last_active":"2024-09-17T03:45:42.236802+0000","last_peered":"2024-09-17T03:45:42.236802+0000","last_clean":"2024-09-17T03:45:42.236802+0000","last_became_active":"2024-09-17T03:45:40.114920+0000","last_became_peered":"2024-09-17T03:45:40.114920+0000","last_unstale":"2024-09-17T03:45:42.236802+0000","last_undegraded":"2024-09-17T03:45:42.236802+0000","last_fullsized":"2024-09-17T03:45:42.236802+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:18.878101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"187'2","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.084175+0000","last_change":"2024-09-17T03:45:39.089597+0000","last_active":"2024-09-17T03:45:41.084175+0000","last_peered":"2024-09-17T03:45:41.084175+0000","last_clean":"2024-09-17T03:45:41.084175+0000","last_became_active":"2024-09-17T03:45:39.089273+0000","last_became_peered":"2024-09-17T03:45:39.089273+0000","last_unstale":"2024-09-17T03:45:41.084175+0000","last_undegraded":"2024-09-17T03:45:41.084175+0000","last_fullsized":"2024-09-17T03:45:41.084175+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:23.419518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101138+0000","last_change":"2024-09-17T03:45:40.112653+0000","last_active":"2024-09-17T03:45:41.101138+0000","last_peered":"2024-09-17T03:45:41.101138+0000","last_clean":"2024-09-17T03:45:41.101138+0000","last_became_active":"2024-09-17T03:45:40.112324+0000","last_became_peered":"2024-09-17T03:45:40.112324+0000","last_unstale":"2024-09-17T03:45:41.101138+0000","last_undegraded":"2024-09-17T03:45:41.101138+0000","last_fullsized":"2024-09-17T03:45:41.101138+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:54.707254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"187'1","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.103415+0000","last_change":"2024-09-17T03:45:39.087754+0000","last_active":"2024-09-17T03:45:41.103415+0000","last_peered":"2024-09-17T03:45:41.103415+0000","last_clean":"2024-09-17T03:45:41.103415+0000","last_became_active":"2024-09-17T03:45:39.087430+0000","last_became_peered":"2024-09-17T03:45:39.087430+0000","last_unstale":"2024-09-17T03:45:41.103415+0000","last_undegraded":"2024-09-17T03:45:41.103415+0000","last_fullsized":"2024-09-17T03:45:41.103415+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:49.235195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.237035+0000","last_change":"2024-09-17T03:45:40.111005+0000","last_active":"2024-09-17T03:45:42.237035+0000","last_peered":"2024-09-17T03:45:42.237035+0000","last_clean":"2024-09-17T03:45:42.237035+0000","last_became_active":"2024-09-17T03:45:40.110677+0000","last_became_peered":"2024-09-17T03:45:40.110677+0000","last_unstale":"2024-09-17T03:45:42.237035+0000","last_undegraded":"2024-09-17T03:45:42.237035+0000","last_fullsized":"2024-09-17T03:45:42.237035+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:13.144808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"187'1","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.082962+0000","last_change":"2024-09-17T03:45:39.088456+0000","last_active":"2024-09-17T03:45:41.082962+0000","last_peered":"2024-09-17T03:45:41.082962+0000","last_clean":"2024-09-17T03:45:41.082962+0000","last_became_active":"2024-09-17T03:45:39.088150+0000","last_became_peered":"2024-09-17T03:45:39.088150+0000","last_unstale":"2024-09-17T03:45:41.082962+0000","last_undegraded":"2024-09-17T03:45:41.082962+0000","last_fullsized":"2024-09-17T03:45:41.082962+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:50.786034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080945+0000","last_change":"2024-09-17T03:45:40.085937+0000","last_active":"2024-09-17T03:45:41.080945+0000","last_peered":"2024-09-17T03:45:41.080945+0000","last_clean":"2024-09-17T03:45:41.080945+0000","last_became_active":"2024-09-17T03:45:40.085615+0000","last_became_peered":"2024-09-17T03:45:40.085615+0000","last_unstale":"2024-09-17T03:45:41.080945+0000","last_undegraded":"2024-09-17T03:45:41.080945+0000","last_fullsized":"2024-09-17T03:45:41.080945+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:42.747919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236272+0000","last_change":"2024-09-17T03:45:39.088411+0000","last_active":"2024-09-17T03:45:42.236272+0000","last_peered":"2024-09-17T03:45:42.236272+0000","last_clean":"2024-09-17T03:45:42.236272+0000","last_became_active":"2024-09-17T03:45:39.088023+0000","last_became_peered":"2024-09-17T03:45:39.088023+0000","last_unstale":"2024-09-17T03:45:42.236272+0000","last_undegraded":"2024-09-17T03:45:42.236272+0000","last_fullsized":"2024-09-17T03:45:42.236272+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.002205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083556+0000","last_change":"2024-09-17T03:45:40.104508+0000","last_active":"2024-09-17T03:45:41.083556+0000","last_peered":"2024-09-17T03:45:41.083556+0000","last_clean":"2024-09-17T03:45:41.083556+0000","last_became_active":"2024-09-17T03:45:40.104179+0000","last_became_peered":"2024-09-17T03:45:40.104179+0000","last_unstale":"2024-09-17T03:45:41.083556+0000","last_undegraded":"2024-09-17T03:45:41.083556+0000","last_fullsized":"2024-09-17T03:45:41.083556+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:43.512306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.080963+0000","last_change":"2024-09-17T03:45:39.084140+0000","last_active":"2024-09-17T03:45:41.080963+0000","last_peered":"2024-09-17T03:45:41.080963+0000","last_clean":"2024-09-17T03:45:41.080963+0000","last_became_active":"2024-09-17T03:45:39.083831+0000","last_became_peered":"2024-09-17T03:45:39.083831+0000","last_unstale":"2024-09-17T03:45:41.080963+0000","last_undegraded":"2024-09-17T03:45:41.080963+0000","last_fullsized":"2024-09-17T03:45:41.080963+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:44.013378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083865+0000","last_change":"2024-09-17T03:45:40.106388+0000","last_active":"2024-09-17T03:45:41.083865+0000","last_peered":"2024-09-17T03:45:41.083865+0000","last_clean":"2024-09-17T03:45:41.083865+0000","last_became_active":"2024-09-17T03:45:40.105600+0000","last_became_peered":"2024-09-17T03:45:40.105600+0000","last_unstale":"2024-09-17T03:45:41.083865+0000","last_undegraded":"2024-09-17T03:45:41.083865+0000","last_fullsized":"2024-09-17T03:45:41.083865+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:44.338920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101871+0000","last_change":"2024-09-17T03:45:39.084802+0000","last_active":"2024-09-17T03:45:41.101871+0000","last_peered":"2024-09-17T03:45:41.101871+0000","last_clean":"2024-09-17T03:45:41.101871+0000","last_became_active":"2024-09-17T03:45:39.084430+0000","last_became_peered":"2024-09-17T03:45:39.084430+0000","last_unstale":"2024-09-17T03:45:41.101871+0000","last_undegraded":"2024-09-17T03:45:41.101871+0000","last_fullsized":"2024-09-17T03:45:41.101871+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:01.609015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101796+0000","last_change":"2024-09-17T03:45:40.107718+0000","last_active":"2024-09-17T03:45:41.101796+0000","last_peered":"2024-09-17T03:45:41.101796+0000","last_clean":"2024-09-17T03:45:41.101796+0000","last_became_active":"2024-09-17T03:45:40.107337+0000","last_became_peered":"2024-09-17T03:45:40.107337+0000","last_unstale":"2024-09-17T03:45:41.101796+0000","last_undegraded":"2024-09-17T03:45:41.101796+0000","last_fullsized":"2024-09-17T03:45:41.101796+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:55:13.912090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236315+0000","last_change":"2024-09-17T03:45:39.085430+0000","last_active":"2024-09-17T03:45:42.236315+0000","last_peered":"2024-09-17T03:45:42.236315+0000","last_clean":"2024-09-17T03:45:42.236315+0000","last_became_active":"2024-09-17T03:45:39.085114+0000","last_became_peered":"2024-09-17T03:45:39.085114+0000","last_unstale":"2024-09-17T03:45:42.236315+0000","last_undegraded":"2024-09-17T03:45:42.236315+0000","last_fullsized":"2024-09-17T03:45:42.236315+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:43.065021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236975+0000","last_change":"2024-09-17T03:45:40.115366+0000","last_active":"2024-09-17T03:45:42.236975+0000","last_peered":"2024-09-17T03:45:42.236975+0000","last_clean":"2024-09-17T03:45:42.236975+0000","last_became_active":"2024-09-17T03:45:40.115007+0000","last_became_peered":"2024-09-17T03:45:40.115007+0000","last_unstale":"2024-09-17T03:45:42.236975+0000","last_undegraded":"2024-09-17T03:45:42.236975+0000","last_fullsized":"2024-09-17T03:45:42.236975+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:00.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"187'3","reported_seq":18,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.237501+0000","last_change":"2024-09-17T03:45:39.084620+0000","last_active":"2024-09-17T03:45:42.237501+0000","last_peered":"2024-09-17T03:45:42.237501+0000","last_clean":"2024-09-17T03:45:42.237501+0000","last_became_active":"2024-09-17T03:45:39.084322+0000","last_became_peered":"2024-09-17T03:45:39.084322+0000","last_unstale":"2024-09-17T03:45:42.237501+0000","last_undegraded":"2024-09-17T03:45:42.237501+0000","last_fullsized":"2024-09-17T03:45:42.237501+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:41.573274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101659+0000","last_change":"2024-09-17T03:45:40.109247+0000","last_active":"2024-09-17T03:45:41.101659+0000","last_peered":"2024-09-17T03:45:41.101659+0000","last_clean":"2024-09-17T03:45:41.101659+0000","last_became_active":"2024-09-17T03:45:40.108892+0000","last_became_peered":"2024-09-17T03:45:40.108892+0000","last_unstale":"2024-09-17T03:45:41.101659+0000","last_undegraded":"2024-09-17T03:45:41.101659+0000","last_fullsized":"2024-09-17T03:45:41.101659+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:03.973274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"187'6","reported_seq":21,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081163+0000","last_change":"2024-09-17T03:45:39.081186+0000","last_active":"2024-09-17T03:45:41.081163+0000","last_peered":"2024-09-17T03:45:41.081163+0000","last_clean":"2024-09-17T03:45:41.081163+0000","last_became_active":"2024-09-17T03:45:39.080858+0000","last_became_peered":"2024-09-17T03:45:39.080858+0000","last_unstale":"2024-09-17T03:45:41.081163+0000","last_undegraded":"2024-09-17T03:45:41.081163+0000","last_fullsized":"2024-09-17T03:45:41.081163+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:50.084175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236373+0000","last_change":"2024-09-17T03:45:40.088854+0000","last_active":"2024-09-17T03:45:42.236373+0000","last_peered":"2024-09-17T03:45:42.236373+0000","last_clean":"2024-09-17T03:45:42.236373+0000","last_became_active":"2024-09-17T03:45:40.088544+0000","last_became_peered":"2024-09-17T03:45:40.088544+0000","last_unstale":"2024-09-17T03:45:42.236373+0000","last_undegraded":"2024-09-17T03:45:42.236373+0000","last_fullsized":"2024-09-17T03:45:42.236373+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:49.226051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"187'2","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.103478+0000","last_change":"2024-09-17T03:45:39.092139+0000","last_active":"2024-09-17T03:45:41.103478+0000","last_peered":"2024-09-17T03:45:41.103478+0000","last_clean":"2024-09-17T03:45:41.103478+0000","last_became_active":"2024-09-17T03:45:39.091812+0000","last_became_peered":"2024-09-17T03:45:39.091812+0000","last_unstale":"2024-09-17T03:45:41.103478+0000","last_undegraded":"2024-09-17T03:45:41.103478+0000","last_fullsized":"2024-09-17T03:45:41.103478+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:18.860525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083371+0000","last_change":"2024-09-17T03:45:40.108158+0000","last_active":"2024-09-17T03:45:41.083371+0000","last_peered":"2024-09-17T03:45:41.083371+0000","last_clean":"2024-09-17T03:45:41.083371+0000","last_became_active":"2024-09-17T03:45:40.099269+0000","last_became_peered":"2024-09-17T03:45:40.099269+0000","last_unstale":"2024-09-17T03:45:41.083371+0000","last_undegraded":"2024-09-17T03:45:41.083371+0000","last_fullsized":"2024-09-17T03:45:41.083371+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:19.545100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236533+0000","last_change":"2024-09-17T03:45:39.086455+0000","last_active":"2024-09-17T03:45:42.236533+0000","last_peered":"2024-09-17T03:45:42.236533+0000","last_clean":"2024-09-17T03:45:42.236533+0000","last_became_active":"2024-09-17T03:45:39.085888+0000","last_became_peered":"2024-09-17T03:45:39.085888+0000","last_unstale":"2024-09-17T03:45:42.236533+0000","last_undegraded":"2024-09-17T03:45:42.236533+0000","last_fullsized":"2024-09-17T03:45:42.236533+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:17.250037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.082482+0000","last_change":"2024-09-17T03:45:40.098165+0000","last_active":"2024-09-17T03:45:41.082482+0000","last_peered":"2024-09-17T03:45:41.082482+0000","last_clean":"2024-09-17T03:45:41.082482+0000","last_became_active":"2024-09-17T03:45:40.097290+0000","last_became_peered":"2024-09-17T03:45:40.097290+0000","last_unstale":"2024-09-17T03:45:41.082482+0000","last_undegraded":"2024-09-17T03:45:41.082482+0000","last_fullsized":"2024-09-17T03:45:41.082482+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:58.440328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236673+0000","last_change":"2024-09-17T03:45:39.090706+0000","last_active":"2024-09-17T03:45:42.236673+0000","last_peered":"2024-09-17T03:45:42.236673+0000","last_clean":"2024-09-17T03:45:42.236673+0000","last_became_active":"2024-09-17T03:45:39.089835+0000","last_became_peered":"2024-09-17T03:45:39.089835+0000","last_unstale":"2024-09-17T03:45:42.236673+0000","last_undegraded":"2024-09-17T03:45:42.236673+0000","last_fullsized":"2024-09-17T03:45:42.236673+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:43.454739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236471+0000","last_change":"2024-09-17T03:45:40.104541+0000","last_active":"2024-09-17T03:45:42.236471+0000","last_peered":"2024-09-17T03:45:42.236471+0000","last_clean":"2024-09-17T03:45:42.236471+0000","last_became_active":"2024-09-17T03:45:40.103770+0000","last_became_peered":"2024-09-17T03:45:40.103770+0000","last_unstale":"2024-09-17T03:45:42.236471+0000","last_undegraded":"2024-09-17T03:45:42.236471+0000","last_fullsized":"2024-09-17T03:45:42.236471+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:58.697052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"187'8","reported_seq":23,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.084344+0000","last_change":"2024-09-17T03:45:39.086594+0000","last_active":"2024-09-17T03:45:41.084344+0000","last_peered":"2024-09-17T03:45:41.084344+0000","last_clean":"2024-09-17T03:45:41.084344+0000","last_became_active":"2024-09-17T03:45:39.086203+0000","last_became_peered":"2024-09-17T03:45:39.086203+0000","last_unstale":"2024-09-17T03:45:41.084344+0000","last_undegraded":"2024-09-17T03:45:41.084344+0000","last_fullsized":"2024-09-17T03:45:41.084344+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:00.106118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.103600+0000","last_change":"2024-09-17T03:45:40.090325+0000","last_active":"2024-09-17T03:45:41.103600+0000","last_peered":"2024-09-17T03:45:41.103600+0000","last_clean":"2024-09-17T03:45:41.103600+0000","last_became_active":"2024-09-17T03:45:40.089657+0000","last_became_peered":"2024-09-17T03:45:40.089657+0000","last_unstale":"2024-09-17T03:45:41.103600+0000","last_undegraded":"2024-09-17T03:45:41.103600+0000","last_fullsized":"2024-09-17T03:45:41.103600+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:32.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"187'1","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083916+0000","last_change":"2024-09-17T03:45:39.089285+0000","last_active":"2024-09-17T03:45:41.083916+0000","last_peered":"2024-09-17T03:45:41.083916+0000","last_clean":"2024-09-17T03:45:41.083916+0000","last_became_active":"2024-09-17T03:45:39.088977+0000","last_became_peered":"2024-09-17T03:45:39.088977+0000","last_unstale":"2024-09-17T03:45:41.083916+0000","last_undegraded":"2024-09-17T03:45:41.083916+0000","last_fullsized":"2024-09-17T03:45:41.083916+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:49.755455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081068+0000","last_change":"2024-09-17T03:45:40.099585+0000","last_active":"2024-09-17T03:45:41.081068+0000","last_peered":"2024-09-17T03:45:41.081068+0000","last_clean":"2024-09-17T03:45:41.081068+0000","last_became_active":"2024-09-17T03:45:40.098940+0000","last_became_peered":"2024-09-17T03:45:40.098940+0000","last_unstale":"2024-09-17T03:45:41.081068+0000","last_undegraded":"2024-09-17T03:45:41.081068+0000","last_fullsized":"2024-09-17T03:45:41.081068+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:37.932568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"187'2","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236424+0000","last_change":"2024-09-17T03:45:39.082611+0000","last_active":"2024-09-17T03:45:42.236424+0000","last_peered":"2024-09-17T03:45:42.236424+0000","last_clean":"2024-09-17T03:45:42.236424+0000","last_became_active":"2024-09-17T03:45:39.082270+0000","last_became_peered":"2024-09-17T03:45:39.082270+0000","last_unstale":"2024-09-17T03:45:42.236424+0000","last_undegraded":"2024-09-17T03:45:42.236424+0000","last_fullsized":"2024-09-17T03:45:42.236424+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:58.326255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083652+0000","last_change":"2024-09-17T03:45:40.101680+0000","last_active":"2024-09-17T03:45:41.083652+0000","last_peered":"2024-09-17T03:45:41.083652+0000","last_clean":"2024-09-17T03:45:41.083652+0000","last_became_active":"2024-09-17T03:45:40.100821+0000","last_became_peered":"2024-09-17T03:45:40.100821+0000","last_unstale":"2024-09-17T03:45:41.083652+0000","last_undegraded":"2024-09-17T03:45:41.083652+0000","last_fullsized":"2024-09-17T03:45:41.083652+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:15.708302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"187'1","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101872+0000","last_change":"2024-09-17T03:45:39.087408+0000","last_active":"2024-09-17T03:45:41.101872+0000","last_peered":"2024-09-17T03:45:41.101872+0000","last_clean":"2024-09-17T03:45:41.101872+0000","last_became_active":"2024-09-17T03:45:39.087095+0000","last_became_peered":"2024-09-17T03:45:39.087095+0000","last_unstale":"2024-09-17T03:45:41.101872+0000","last_undegraded":"2024-09-17T03:45:41.101872+0000","last_fullsized":"2024-09-17T03:45:41.101872+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:16.584759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083381+0000","last_change":"2024-09-17T03:45:40.106348+0000","last_active":"2024-09-17T03:45:41.083381+0000","last_peered":"2024-09-17T03:45:41.083381+0000","last_clean":"2024-09-17T03:45:41.083381+0000","last_became_active":"2024-09-17T03:45:40.103629+0000","last_became_peered":"2024-09-17T03:45:40.103629+0000","last_unstale":"2024-09-17T03:45:41.083381+0000","last_undegraded":"2024-09-17T03:45:41.083381+0000","last_fullsized":"2024-09-17T03:45:41.083381+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:52.265139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.081218+0000","last_change":"2024-09-17T03:45:39.082669+0000","last_active":"2024-09-17T03:45:41.081218+0000","last_peered":"2024-09-17T03:45:41.081218+0000","last_clean":"2024-09-17T03:45:41.081218+0000","last_became_active":"2024-09-17T03:45:39.081790+0000","last_became_peered":"2024-09-17T03:45:39.081790+0000","last_unstale":"2024-09-17T03:45:41.081218+0000","last_undegraded":"2024-09-17T03:45:41.081218+0000","last_fullsized":"2024-09-17T03:45:41.081218+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:48.624264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236782+0000","last_change":"2024-09-17T03:45:40.094684+0000","last_active":"2024-09-17T03:45:42.236782+0000","last_peered":"2024-09-17T03:45:42.236782+0000","last_clean":"2024-09-17T03:45:42.236782+0000","last_became_active":"2024-09-17T03:45:40.094369+0000","last_became_peered":"2024-09-17T03:45:40.094369+0000","last_unstale":"2024-09-17T03:45:42.236782+0000","last_undegraded":"2024-09-17T03:45:42.236782+0000","last_fullsized":"2024-09-17T03:45:42.236782+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:28.173425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"187'2","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083977+0000","last_change":"2024-09-17T03:45:39.079373+0000","last_active":"2024-09-17T03:45:41.083977+0000","last_peered":"2024-09-17T03:45:41.083977+0000","last_clean":"2024-09-17T03:45:41.083977+0000","last_became_active":"2024-09-17T03:45:39.079052+0000","last_became_peered":"2024-09-17T03:45:39.079052+0000","last_unstale":"2024-09-17T03:45:41.083977+0000","last_undegraded":"2024-09-17T03:45:41.083977+0000","last_fullsized":"2024-09-17T03:45:41.083977+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:03.346006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083791+0000","last_change":"2024-09-17T03:45:40.109472+0000","last_active":"2024-09-17T03:45:41.083791+0000","last_peered":"2024-09-17T03:45:41.083791+0000","last_clean":"2024-09-17T03:45:41.083791+0000","last_became_active":"2024-09-17T03:45:40.109130+0000","last_became_peered":"2024-09-17T03:45:40.109130+0000","last_unstale":"2024-09-17T03:45:41.083791+0000","last_undegraded":"2024-09-17T03:45:41.083791+0000","last_fullsized":"2024-09-17T03:45:41.083791+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:58.828186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236655+0000","last_change":"2024-09-17T03:45:39.089753+0000","last_active":"2024-09-17T03:45:42.236655+0000","last_peered":"2024-09-17T03:45:42.236655+0000","last_clean":"2024-09-17T03:45:42.236655+0000","last_became_active":"2024-09-17T03:45:39.088599+0000","last_became_peered":"2024-09-17T03:45:39.088599+0000","last_unstale":"2024-09-17T03:45:42.236655+0000","last_undegraded":"2024-09-17T03:45:42.236655+0000","last_fullsized":"2024-09-17T03:45:42.236655+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:44.430375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.103368+0000","last_change":"2024-09-17T03:45:40.090356+0000","last_active":"2024-09-17T03:45:41.103368+0000","last_peered":"2024-09-17T03:45:41.103368+0000","last_clean":"2024-09-17T03:45:41.103368+0000","last_became_active":"2024-09-17T03:45:40.089755+0000","last_became_peered":"2024-09-17T03:45:40.089755+0000","last_unstale":"2024-09-17T03:45:41.103368+0000","last_undegraded":"2024-09-17T03:45:41.103368+0000","last_fullsized":"2024-09-17T03:45:41.103368+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:30.517254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236558+0000","last_change":"2024-09-17T03:45:39.087163+0000","last_active":"2024-09-17T03:45:42.236558+0000","last_peered":"2024-09-17T03:45:42.236558+0000","last_clean":"2024-09-17T03:45:42.236558+0000","last_became_active":"2024-09-17T03:45:39.086829+0000","last_became_peered":"2024-09-17T03:45:39.086829+0000","last_unstale":"2024-09-17T03:45:42.236558+0000","last_undegraded":"2024-09-17T03:45:42.236558+0000","last_fullsized":"2024-09-17T03:45:42.236558+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:21.031481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236316+0000","last_change":"2024-09-17T03:45:40.091978+0000","last_active":"2024-09-17T03:45:42.236316+0000","last_peered":"2024-09-17T03:45:42.236316+0000","last_clean":"2024-09-17T03:45:42.236316+0000","last_became_active":"2024-09-17T03:45:40.091686+0000","last_became_peered":"2024-09-17T03:45:40.091686+0000","last_unstale":"2024-09-17T03:45:42.236316+0000","last_undegraded":"2024-09-17T03:45:42.236316+0000","last_fullsized":"2024-09-17T03:45:42.236316+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:02.719779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.082751+0000","last_change":"2024-09-17T03:45:39.081129+0000","last_active":"2024-09-17T03:45:41.082751+0000","last_peered":"2024-09-17T03:45:41.082751+0000","last_clean":"2024-09-17T03:45:41.082751+0000","last_became_active":"2024-09-17T03:45:39.080824+0000","last_became_peered":"2024-09-17T03:45:39.080824+0000","last_unstale":"2024-09-17T03:45:41.082751+0000","last_undegraded":"2024-09-17T03:45:41.082751+0000","last_fullsized":"2024-09-17T03:45:41.082751+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:09.886067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.237297+0000","last_change":"2024-09-17T03:45:40.096815+0000","last_active":"2024-09-17T03:45:42.237297+0000","last_peered":"2024-09-17T03:45:42.237297+0000","last_clean":"2024-09-17T03:45:42.237297+0000","last_became_active":"2024-09-17T03:45:40.096486+0000","last_became_peered":"2024-09-17T03:45:40.096486+0000","last_unstale":"2024-09-17T03:45:42.237297+0000","last_undegraded":"2024-09-17T03:45:42.237297+0000","last_fullsized":"2024-09-17T03:45:42.237297+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:31.536903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"187'2","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.237398+0000","last_change":"2024-09-17T03:45:39.092155+0000","last_active":"2024-09-17T03:45:42.237398+0000","last_peered":"2024-09-17T03:45:42.237398+0000","last_clean":"2024-09-17T03:45:42.237398+0000","last_became_active":"2024-09-17T03:45:39.091803+0000","last_became_peered":"2024-09-17T03:45:39.091803+0000","last_unstale":"2024-09-17T03:45:42.237398+0000","last_undegraded":"2024-09-17T03:45:42.237398+0000","last_fullsized":"2024-09-17T03:45:42.237398+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:01.337089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083703+0000","last_change":"2024-09-17T03:45:40.095819+0000","last_active":"2024-09-17T03:45:41.083703+0000","last_peered":"2024-09-17T03:45:41.083703+0000","last_clean":"2024-09-17T03:45:41.083703+0000","last_became_active":"2024-09-17T03:45:40.095395+0000","last_became_peered":"2024-09-17T03:45:40.095395+0000","last_unstale":"2024-09-17T03:45:41.083703+0000","last_undegraded":"2024-09-17T03:45:41.083703+0000","last_fullsized":"2024-09-17T03:45:41.083703+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:46.564211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"188'1","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101543+0000","last_change":"2024-09-17T03:45:39.084693+0000","last_active":"2024-09-17T03:45:41.101543+0000","last_peered":"2024-09-17T03:45:41.101543+0000","last_clean":"2024-09-17T03:45:41.101543+0000","last_became_active":"2024-09-17T03:45:39.084367+0000","last_became_peered":"2024-09-17T03:45:39.084367+0000","last_unstale":"2024-09-17T03:45:41.101543+0000","last_undegraded":"2024-09-17T03:45:41.101543+0000","last_fullsized":"2024-09-17T03:45:41.101543+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:21.498595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083730+0000","last_change":"2024-09-17T03:45:40.099596+0000","last_active":"2024-09-17T03:45:41.083730+0000","last_peered":"2024-09-17T03:45:41.083730+0000","last_clean":"2024-09-17T03:45:41.083730+0000","last_became_active":"2024-09-17T03:45:40.099248+0000","last_became_peered":"2024-09-17T03:45:40.099248+0000","last_unstale":"2024-09-17T03:45:41.083730+0000","last_undegraded":"2024-09-17T03:45:41.083730+0000","last_fullsized":"2024-09-17T03:45:41.083730+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:31.536903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101866+0000","last_change":"2024-09-17T03:45:39.087016+0000","last_active":"2024-09-17T03:45:41.101866+0000","last_peered":"2024-09-17T03:45:41.101866+0000","last_clean":"2024-09-17T03:45:41.101866+0000","last_became_active":"2024-09-17T03:45:39.086671+0000","last_became_peered":"2024-09-17T03:45:39.086671+0000","last_unstale":"2024-09-17T03:45:41.101866+0000","last_undegraded":"2024-09-17T03:45:41.101866+0000","last_fullsized":"2024-09-17T03:45:41.101866+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:50.830796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.237328+0000","last_change":"2024-09-17T03:45:40.087219+0000","last_active":"2024-09-17T03:45:42.237328+0000","last_peered":"2024-09-17T03:45:42.237328+0000","last_clean":"2024-09-17T03:45:42.237328+0000","last_became_active":"2024-09-17T03:45:40.086895+0000","last_became_peered":"2024-09-17T03:45:40.086895+0000","last_unstale":"2024-09-17T03:45:42.237328+0000","last_undegraded":"2024-09-17T03:45:42.237328+0000","last_fullsized":"2024-09-17T03:45:42.237328+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:58.828186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083924+0000","last_change":"2024-09-17T03:45:39.091076+0000","last_active":"2024-09-17T03:45:41.083924+0000","last_peered":"2024-09-17T03:45:41.083924+0000","last_clean":"2024-09-17T03:45:41.083924+0000","last_became_active":"2024-09-17T03:45:39.090678+0000","last_became_peered":"2024-09-17T03:45:39.090678+0000","last_unstale":"2024-09-17T03:45:41.083924+0000","last_undegraded":"2024-09-17T03:45:41.083924+0000","last_fullsized":"2024-09-17T03:45:41.083924+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:23.202737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.082890+0000","last_change":"2024-09-17T03:45:40.095864+0000","last_active":"2024-09-17T03:45:41.082890+0000","last_peered":"2024-09-17T03:45:41.082890+0000","last_clean":"2024-09-17T03:45:41.082890+0000","last_became_active":"2024-09-17T03:45:40.094154+0000","last_became_peered":"2024-09-17T03:45:40.094154+0000","last_unstale":"2024-09-17T03:45:41.082890+0000","last_undegraded":"2024-09-17T03:45:41.082890+0000","last_fullsized":"2024-09-17T03:45:41.082890+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:09.305791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236611+0000","last_change":"2024-09-17T03:45:39.092305+0000","last_active":"2024-09-17T03:45:42.236611+0000","last_peered":"2024-09-17T03:45:42.236611+0000","last_clean":"2024-09-17T03:45:42.236611+0000","last_became_active":"2024-09-17T03:45:39.091982+0000","last_became_peered":"2024-09-17T03:45:39.091982+0000","last_unstale":"2024-09-17T03:45:42.236611+0000","last_undegraded":"2024-09-17T03:45:42.236611+0000","last_fullsized":"2024-09-17T03:45:42.236611+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:31.823747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.083649+0000","last_change":"2024-09-17T03:45:40.098574+0000","last_active":"2024-09-17T03:45:41.083649+0000","last_peered":"2024-09-17T03:45:41.083649+0000","last_clean":"2024-09-17T03:45:41.083649+0000","last_became_active":"2024-09-17T03:45:40.098158+0000","last_became_peered":"2024-09-17T03:45:40.098158+0000","last_unstale":"2024-09-17T03:45:41.083649+0000","last_undegraded":"2024-09-17T03:45:41.083649+0000","last_fullsized":"2024-09-17T03:45:41.083649+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:13.144808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236577+0000","last_change":"2024-09-17T03:45:39.084602+0000","last_active":"2024-09-17T03:45:42.236577+0000","last_peered":"2024-09-17T03:45:42.236577+0000","last_clean":"2024-09-17T03:45:42.236577+0000","last_became_active":"2024-09-17T03:45:39.084286+0000","last_became_peered":"2024-09-17T03:45:39.084286+0000","last_unstale":"2024-09-17T03:45:42.236577+0000","last_undegraded":"2024-09-17T03:45:42.236577+0000","last_fullsized":"2024-09-17T03:45:42.236577+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:34.968325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.082579+0000","last_change":"2024-09-17T03:45:40.094917+0000","last_active":"2024-09-17T03:45:41.082579+0000","last_peered":"2024-09-17T03:45:41.082579+0000","last_clean":"2024-09-17T03:45:41.082579+0000","last_became_active":"2024-09-17T03:45:40.093544+0000","last_became_peered":"2024-09-17T03:45:40.093544+0000","last_unstale":"2024-09-17T03:45:41.082579+0000","last_undegraded":"2024-09-17T03:45:41.082579+0000","last_fullsized":"2024-09-17T03:45:41.082579+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:38.874975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236712+0000","last_change":"2024-09-17T03:45:39.089774+0000","last_active":"2024-09-17T03:45:42.236712+0000","last_peered":"2024-09-17T03:45:42.236712+0000","last_clean":"2024-09-17T03:45:42.236712+0000","last_became_active":"2024-09-17T03:45:39.089502+0000","last_became_peered":"2024-09-17T03:45:39.089502+0000","last_unstale":"2024-09-17T03:45:42.236712+0000","last_undegraded":"2024-09-17T03:45:42.236712+0000","last_fullsized":"2024-09-17T03:45:42.236712+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:02.093294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101112+0000","last_change":"2024-09-17T03:45:40.112918+0000","last_active":"2024-09-17T03:45:41.101112+0000","last_peered":"2024-09-17T03:45:41.101112+0000","last_clean":"2024-09-17T03:45:41.101112+0000","last_became_active":"2024-09-17T03:45:40.112589+0000","last_became_peered":"2024-09-17T03:45:40.112589+0000","last_unstale":"2024-09-17T03:45:41.101112+0000","last_undegraded":"2024-09-17T03:45:41.101112+0000","last_fullsized":"2024-09-17T03:45:41.101112+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:03.833078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.082879+0000","last_change":"2024-09-17T03:45:39.080285+0000","last_active":"2024-09-17T03:45:41.082879+0000","last_peered":"2024-09-17T03:45:41.082879+0000","last_clean":"2024-09-17T03:45:41.082879+0000","last_became_active":"2024-09-17T03:45:39.079973+0000","last_became_peered":"2024-09-17T03:45:39.079973+0000","last_unstale":"2024-09-17T03:45:41.082879+0000","last_undegraded":"2024-09-17T03:45:41.082879+0000","last_fullsized":"2024-09-17T03:45:41.082879+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:48.608216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101436+0000","last_change":"2024-09-17T03:45:40.104963+0000","last_active":"2024-09-17T03:45:41.101436+0000","last_peered":"2024-09-17T03:45:41.101436+0000","last_clean":"2024-09-17T03:45:41.101436+0000","last_became_active":"2024-09-17T03:45:40.104498+0000","last_became_peered":"2024-09-17T03:45:40.104498+0000","last_unstale":"2024-09-17T03:45:41.101436+0000","last_undegraded":"2024-09-17T03:45:41.101436+0000","last_fullsized":"2024-09-17T03:45:41.101436+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:39.066232+0000","last_clean_scrub_stamp":"2024-09-17T03:45:39.066232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:38.771893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"187'2","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:42.236742+0000","last_change":"2024-09-17T03:45:39.090713+0000","last_active":"2024-09-17T03:45:42.236742+0000","last_peered":"2024-09-17T03:45:42.236742+0000","last_clean":"2024-09-17T03:45:42.236742+0000","last_became_active":"2024-09-17T03:45:39.090324+0000","last_became_peered":"2024-09-17T03:45:39.090324+0000","last_unstale":"2024-09-17T03:45:42.236742+0000","last_undegraded":"2024-09-17T03:45:42.236742+0000","last_fullsized":"2024-09-17T03:45:42.236742+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:45:38.060130+0000","last_clean_scrub_stamp":"2024-09-17T03:45:38.060130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:27.632921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":417,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-17T03:45:41.101006+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:45:41.101006+0000","last_peered":"2024-09-17T03:45:41.101006+0000","last_clean":"2024-09-17T03:45:41.101006+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:45:41.101006+0000","last_undegraded":"2024-09-17T03:45:41.101006+0000","last_fullsized":"2024-09-17T03:45:41.101006+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509599,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60456,"kb_used_data":2896,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311384,"statfs":{"total":96636764160,"available":96574857216,"internally_reserved":0,"allocated":2965504,"data_stored":1632613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509599,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59880,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311960,"statfs":{"total":96636764160,"available":96575447040,"internally_reserved":0,"allocated":2375680,"data_stored":1042231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509599,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65376,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306464,"statfs":{"total":96636764160,"available":96569819136,"internally_reserved":0,"allocated":2371584,"data_stored":1042757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509599,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55732,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316108,"statfs":{"total":96636764160,"available":96579694592,"internally_reserved":0,"allocated":2387968,"data_stored":1043843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509600,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59872,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311968,"statfs":{"total":96636764160,"available":96575455232,"internally_reserved":0,"allocated":2371584,"data_stored":1042265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509600,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56300,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315540,"statfs":{"total":96636764160,"available":96579112960,"internally_reserved":0,"allocated":2969600,"data_stored":1633215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575007,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55708,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316132,"statfs":{"total":96636764160,"available":96579719168,"internally_reserved":0,"allocated":2367488,"data_stored":1042175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575007,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55732,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316108,"statfs":{"total":96636764160,"available":96579694592,"internally_reserved":0,"allocated":2383872,"data_stored":1043857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:45:48.897 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:45:48.898 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:45:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.055+0000 7fa4c629b640 1 -- 172.21.15.146:0/1988299938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c01604c0 msgr2=0x7fa4c01608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.055+0000 7fa4c629b640 1 --2- 172.21.15.146:0/1988299938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c01604c0 0x7fa4c01608d0 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4009830 tx=0x7fa4b402a510 comp rx=0 tx=0).stop 2024-09-17T03:45:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.055+0000 7fa4c629b640 1 -- 172.21.15.146:0/1988299938 shutdown_connections 2024-09-17T03:45:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.055+0000 7fa4c629b640 1 --2- 172.21.15.146:0/1988299938 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c00b0280 0x7fa4c00b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.055+0000 7fa4c629b640 1 --2- 172.21.15.146:0/1988299938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c01604c0 0x7fa4c01608d0 unknown :-1 s=CLOSED pgs=2433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.055+0000 7fa4c629b640 1 -- 172.21.15.146:0/1988299938 >> 172.21.15.146:0/1988299938 conn(0x7fa4c00b7ab0 msgr2=0x7fa4c009ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.055+0000 7fa4c629b640 1 -- 172.21.15.146:0/1988299938 shutdown_connections 2024-09-17T03:45:49.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.055+0000 7fa4c629b640 1 -- 172.21.15.146:0/1988299938 wait complete. 2024-09-17T03:45:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.057+0000 7fa4c629b640 1 Processor -- start 2024-09-17T03:45:49.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.057+0000 7fa4c629b640 1 -- start start 2024-09-17T03:45:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4c629b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c00b0280 0x7fa4c014bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4c629b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c015a5e0 0x7fa4c015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4c629b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c01604c0 0x7fa4c015d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4c629b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c00b0d50 con 0x7fa4c00b0280 2024-09-17T03:45:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4c629b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c00b0bd0 con 0x7fa4c01604c0 2024-09-17T03:45:49.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4c629b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c00b0ed0 con 0x7fa4c015a5e0 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c00b0280 0x7fa4c014bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c00b0280 0x7fa4c014bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38664/0 (socket says 172.21.15.146:38664) 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bffff640 1 -- 172.21.15.146:0/1539319229 learned_addr learned my addr 172.21.15.146:0/1539319229 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bf7fe640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c015a5e0 0x7fa4c015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4c4838640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c01604c0 0x7fa4c015d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bffff640 1 -- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c015a5e0 msgr2=0x7fa4c015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bffff640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c015a5e0 0x7fa4c015d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bffff640 1 -- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c01604c0 msgr2=0x7fa4c015d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bffff640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c01604c0 0x7fa4c015d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bffff640 1 -- 172.21.15.146:0/1539319229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c01f5720 con 0x7fa4c00b0280 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bf7fe640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c015a5e0 0x7fa4c015d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bffff640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c00b0280 0x7fa4c014bf70 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c3f0 tx=0x7fa4b000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bcff9640 1 -- 172.21.15.146:0/1539319229 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0017070 con 0x7fa4c00b0280 2024-09-17T03:45:49.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.059+0000 7fa4bcff9640 1 -- 172.21.15.146:0/1539319229 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4b00035f0 con 0x7fa4c00b0280 2024-09-17T03:45:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.060+0000 7fa4c629b640 1 -- 172.21.15.146:0/1539319229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c0159bc0 con 0x7fa4c00b0280 2024-09-17T03:45:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.060+0000 7fa4bcff9640 1 -- 172.21.15.146:0/1539319229 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0003a40 con 0x7fa4c00b0280 2024-09-17T03:45:49.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.060+0000 7fa4c629b640 1 -- 172.21.15.146:0/1539319229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c006e840 con 0x7fa4c00b0280 2024-09-17T03:45:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.060+0000 7fa4c629b640 1 -- 172.21.15.146:0/1539319229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c00b1410 con 0x7fa4c00b0280 2024-09-17T03:45:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.061+0000 7fa4bcff9640 1 -- 172.21.15.146:0/1539319229 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa4b001a070 con 0x7fa4c00b0280 2024-09-17T03:45:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.062+0000 7fa4bcff9640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4ac078b90 0x7fa4ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.062+0000 7fa4bcff9640 1 -- 172.21.15.146:0/1539319229 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fa4b0099f80 con 0x7fa4c00b0280 2024-09-17T03:45:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.062+0000 7fa4bf7fe640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4ac078b90 0x7fa4ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:49.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.062+0000 7fa4bf7fe640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4ac078b90 0x7fa4ac07b0a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4034000 tx=0x7fa4b4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:49.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.066+0000 7fa4bcff9640 1 -- 172.21.15.146:0/1539319229 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa4c00b6f00 con 0x7fa4c00b0280 2024-09-17T03:45:49.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.309+0000 7fa4c629b640 1 -- 172.21.15.146:0/1539319229 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa4c015c750 con 0x7fa4c00b0280 2024-09-17T03:45:49.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.314+0000 7fa4bcff9640 1 -- 172.21.15.146:0/1539319229 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) ==== 190+0+147 (secure 0 0 0) 0x7fa4b0062450 con 0x7fa4c00b0280 2024-09-17T03:45:49.314 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:45:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:45:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:45:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:45:49.314 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:45:49.315 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:45:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 -- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4ac078b90 msgr2=0x7fa4ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4ac078b90 0x7fa4ac07b0a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4034000 tx=0x7fa4b4004730 comp rx=0 tx=0).stop 2024-09-17T03:45:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 -- 172.21.15.146:0/1539319229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c00b0280 msgr2=0x7fa4c014bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c00b0280 0x7fa4c014bf70 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c3f0 tx=0x7fa4b000c8b0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 -- 172.21.15.146:0/1539319229 shutdown_connections 2024-09-17T03:45:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa4ac078b90 0x7fa4ac07b0a0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4c01604c0 0x7fa4c015d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4c015a5e0 0x7fa4c015d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 --2- 172.21.15.146:0/1539319229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c00b0280 0x7fa4c014bf70 unknown :-1 s=CLOSED pgs=2434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 -- 172.21.15.146:0/1539319229 >> 172.21.15.146:0/1539319229 conn(0x7fa4c00b7ab0 msgr2=0x7fa4c0075d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 -- 172.21.15.146:0/1539319229 shutdown_connections 2024-09-17T03:45:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.316+0000 7fa4c629b640 1 -- 172.21.15.146:0/1539319229 wait complete. 2024-09-17T03:45:49.328 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:45:49.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.442+0000 7f0aa22bd640 1 -- 172.21.15.146:0/2049789274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a84004800 msgr2=0x7f0a84004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:49.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.442+0000 7f0aa22bd640 1 --2- 172.21.15.146:0/2049789274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a84004800 0x7f0a84004c10 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009b50 tx=0x7f0a84005830 comp rx=0 tx=0).stop 2024-09-17T03:45:49.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.442+0000 7f0aa22bd640 1 -- 172.21.15.146:0/2049789274 shutdown_connections 2024-09-17T03:45:49.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.442+0000 7f0aa22bd640 1 --2- 172.21.15.146:0/2049789274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a84004800 0x7f0a84004c10 unknown :-1 s=CLOSED pgs=2436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.442+0000 7f0aa22bd640 1 -- 172.21.15.146:0/2049789274 >> 172.21.15.146:0/2049789274 conn(0x7f0a9c0d4be0 msgr2=0x7f0a9c0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:49.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.442+0000 7f0aa22bd640 1 -- 172.21.15.146:0/2049789274 shutdown_connections 2024-09-17T03:45:49.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.442+0000 7f0aa22bd640 1 -- 172.21.15.146:0/2049789274 wait complete. 2024-09-17T03:45:49.443 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.444+0000 7f0aa22bd640 1 Processor -- start 2024-09-17T03:45:49.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.444+0000 7f0aa22bd640 1 -- start start 2024-09-17T03:45:49.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0aa22bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a84004800 0x7f0a9c1540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0aa22bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9c157770 0x7f0a9c158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0aa22bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a9c157b80 0x7f0a9c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0aa22bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c06f0c0 con 0x7f0a84004800 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0aa22bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c06ef40 con 0x7f0a9c157b80 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0aa22bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9c1620f0 con 0x7f0a9c157770 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0a9bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a84004800 0x7f0a9c1540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0a9bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a84004800 0x7f0a9c1540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38688/0 (socket says 172.21.15.146:38688) 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0a9bfff640 1 -- 172.21.15.146:0/599279609 learned_addr learned my addr 172.21.15.146:0/599279609 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0a9bfff640 1 -- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9c157770 msgr2=0x7f0a9c158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0a9b7fe640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9c157770 0x7f0a9c158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0aa085a640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a9c157b80 0x7f0a9c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:49.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0a9bfff640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9c157770 0x7f0a9c158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0a9bfff640 1 -- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a9c157b80 msgr2=0x7f0a9c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0a9bfff640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a9c157b80 0x7f0a9c158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.445+0000 7f0a9bfff640 1 -- 172.21.15.146:0/599279609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c15abd0 con 0x7f0a84004800 2024-09-17T03:45:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.446+0000 7f0a9bfff640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a84004800 0x7f0a9c1540d0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c006f20 tx=0x7f0a8c0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.446+0000 7f0a98ff9640 1 -- 172.21.15.146:0/599279609 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c015020 con 0x7f0a84004800 2024-09-17T03:45:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.446+0000 7f0a98ff9640 1 -- 172.21.15.146:0/599279609 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a8c0109c0 con 0x7f0a84004800 2024-09-17T03:45:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.446+0000 7f0aa22bd640 1 -- 172.21.15.146:0/599279609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9c15aeb0 con 0x7f0a84004800 2024-09-17T03:45:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.446+0000 7f0a98ff9640 1 -- 172.21.15.146:0/599279609 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c010e10 con 0x7f0a84004800 2024-09-17T03:45:49.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.446+0000 7f0aa22bd640 1 -- 172.21.15.146:0/599279609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9c154610 con 0x7f0a84004800 2024-09-17T03:45:49.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.447+0000 7f0aa22bd640 1 -- 172.21.15.146:0/599279609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9c0767e0 con 0x7f0a84004800 2024-09-17T03:45:49.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.448+0000 7f0a98ff9640 1 -- 172.21.15.146:0/599279609 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a8c018020 con 0x7f0a84004800 2024-09-17T03:45:49.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.448+0000 7f0a98ff9640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a88078b90 0x7f0a8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:49.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.448+0000 7f0a98ff9640 1 -- 172.21.15.146:0/599279609 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f0a8c09b5c0 con 0x7f0a84004800 2024-09-17T03:45:49.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.449+0000 7f0a9b7fe640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a88078b90 0x7f0a8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:49.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.449+0000 7f0a9b7fe640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a88078b90 0x7f0a8807b0a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0a90035000 tx=0x7f0a900046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:49.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.453+0000 7f0a98ff9640 1 -- 172.21.15.146:0/599279609 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a8c01f030 con 0x7f0a84004800 2024-09-17T03:45:49.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.666+0000 7f0aa22bd640 1 -- 172.21.15.146:0/599279609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a9c1625e0 con 0x7f0a84004800 2024-09-17T03:45:49.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.667+0000 7f0a98ff9640 1 -- 172.21.15.146:0/599279609 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) ==== 95+0+5245 (secure 0 0 0) 0x7f0a9c06f680 con 0x7f0a84004800 2024-09-17T03:45:49.667 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:49.667 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":145,"btime":"2024-09-17T03:45:43:095701+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/190399628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":190399628},{"type":"v1","addr":"172.21.15.179:6837","nonce":190399628}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":9565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/748249037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":748249037},{"type":"v1","addr":"172.21.15.179:6835","nonce":748249037}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":11097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1562825832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1562825832},{"type":"v1","addr":"172.21.15.146:6834","nonce":1562825832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:45:39.438921+0000","modified":"2024-09-17T03:45:42.453930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11100":{"gid":11100,"name":"a","rank":0,"incarnation":142,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2793356470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2793356470},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793356470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11100,"qdb_cluster":[11100]},"id":14}]} 2024-09-17T03:45:49.668 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 145 2024-09-17T03:45:49.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 -- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a88078b90 msgr2=0x7f0a8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:49.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a88078b90 0x7f0a8807b0a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0a90035000 tx=0x7f0a900046c0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 -- 172.21.15.146:0/599279609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a84004800 msgr2=0x7f0a9c1540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a84004800 0x7f0a9c1540d0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c006f20 tx=0x7f0a8c0049d0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 -- 172.21.15.146:0/599279609 shutdown_connections 2024-09-17T03:45:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0a88078b90 0x7f0a8807b0a0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0a9c157b80 0x7f0a9c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0a9c157770 0x7f0a9c158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 --2- 172.21.15.146:0/599279609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a84004800 0x7f0a9c1540d0 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 -- 172.21.15.146:0/599279609 >> 172.21.15.146:0/599279609 conn(0x7f0a9c0d4be0 msgr2=0x7f0a9c0b7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 -- 172.21.15.146:0/599279609 shutdown_connections 2024-09-17T03:45:49.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:49.669+0000 7f0aa22bd640 1 -- 172.21.15.146:0/599279609 wait complete. 2024-09-17T03:45:50.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 145, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:45:39.438921+0000', 'modified': '2024-09-17T03:45:42.453930+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11100}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11100': {'gid': 11100, 'name': 'a', 'rank': 0, 'incarnation': 142, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.146:6835/2793356470', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 2793356470}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2793356470}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11100, 'qdb_cluster': [11100]} 2024-09-17T03:45:50.084 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:45:50.084 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:45:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.201+0000 7f92af869640 1 -- 172.21.15.146:0/3822054948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9290005280 msgr2=0x7f929000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.201+0000 7f92af869640 1 --2- 172.21.15.146:0/3822054948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9290005280 0x7f929000b9c0 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f92a0001800 tx=0x7f9290005830 comp rx=0 tx=0).stop 2024-09-17T03:45:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.201+0000 7f92af869640 1 -- 172.21.15.146:0/3822054948 shutdown_connections 2024-09-17T03:45:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.201+0000 7f92af869640 1 --2- 172.21.15.146:0/3822054948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9290005280 0x7f929000b9c0 unknown :-1 s=CLOSED pgs=2439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.201+0000 7f92af869640 1 -- 172.21.15.146:0/3822054948 >> 172.21.15.146:0/3822054948 conn(0x7f92a80b7b20 msgr2=0x7f92a809ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.201+0000 7f92af869640 1 -- 172.21.15.146:0/3822054948 shutdown_connections 2024-09-17T03:45:50.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.201+0000 7f92af869640 1 -- 172.21.15.146:0/3822054948 wait complete. 2024-09-17T03:45:50.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.203+0000 7f92af869640 1 Processor -- start 2024-09-17T03:45:50.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.203+0000 7f92af869640 1 -- start start 2024-09-17T03:45:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92af869640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9290005280 0x7f92a8142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92af869640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92a81f7550 0x7f92a8153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92af869640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92a8141c60 0x7f92a8152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92af869640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f92a80b18d0 con 0x7f92a81f7550 2024-09-17T03:45:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92af869640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92a80b1750 con 0x7f9290005280 2024-09-17T03:45:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92af869640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f92a80b3620 con 0x7f92a8141c60 2024-09-17T03:45:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92ace04640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92a81f7550 0x7f92a8153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92ace04640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92a81f7550 0x7f92a8153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38708/0 (socket says 172.21.15.146:38708) 2024-09-17T03:45:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92ace04640 1 -- 172.21.15.146:0/2976022343 learned_addr learned my addr 172.21.15.146:0/2976022343 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92ad605640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9290005280 0x7f92a8142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92ade06640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92a8141c60 0x7f92a8152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92ace04640 1 -- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92a8141c60 msgr2=0x7f92a8152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92ace04640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92a8141c60 0x7f92a8152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92ace04640 1 -- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9290005280 msgr2=0x7f92a8142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92ace04640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9290005280 0x7f92a8142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.204+0000 7f92ace04640 1 -- 172.21.15.146:0/2976022343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a8151490 con 0x7f92a81f7550 2024-09-17T03:45:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.205+0000 7f92ace04640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92a81f7550 0x7f92a8153e40 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f929c00e590 tx=0x7f929c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.205+0000 7f92a5ffb640 1 -- 172.21.15.146:0/2976022343 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c015070 con 0x7f92a81f7550 2024-09-17T03:45:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.205+0000 7f92a5ffb640 1 -- 172.21.15.146:0/2976022343 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f929c010980 con 0x7f92a81f7550 2024-09-17T03:45:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.205+0000 7f92af869640 1 -- 172.21.15.146:0/2976022343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a8151770 con 0x7f92a81f7550 2024-09-17T03:45:50.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.205+0000 7f92a5ffb640 1 -- 172.21.15.146:0/2976022343 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c010dd0 con 0x7f92a81f7550 2024-09-17T03:45:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.205+0000 7f92af869640 1 -- 172.21.15.146:0/2976022343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a8151d30 con 0x7f92a81f7550 2024-09-17T03:45:50.208 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.207+0000 7f92a5ffb640 1 -- 172.21.15.146:0/2976022343 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f929c018070 con 0x7f92a81f7550 2024-09-17T03:45:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.207+0000 7f92a5ffb640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9294078b90 0x7f929407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.207+0000 7f92a5ffb640 1 -- 172.21.15.146:0/2976022343 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f929c09b020 con 0x7f92a81f7550 2024-09-17T03:45:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.208+0000 7f92ad605640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9294078b90 0x7f929407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.208+0000 7f92ad605640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9294078b90 0x7f929407b0a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f92980097f0 tx=0x7f9298009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.208+0000 7f92b67d8740 1 Processor -- start 2024-09-17T03:45:50.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.208+0000 7f92b67d8740 1 -- start start 2024-09-17T03:45:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.209+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc74fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.209+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecc75500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.209+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecc92400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92b67d8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5639ecbbd820 con 0x5639ec8a3270 2024-09-17T03:45:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92b67d8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5639ecbacc50 con 0x5639ec87a3b0 2024-09-17T03:45:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92b67d8740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5639ecbb0a60 con 0x5639ec882590 2024-09-17T03:45:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ad605640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc74fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ad605640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc74fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38714/0 (socket says 172.21.15.146:38714) 2024-09-17T03:45:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ad605640 1 -- 172.21.15.146:0/3969304405 learned_addr learned my addr 172.21.15.146:0/3969304405 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ade06640 1 --2- 172.21.15.146:0/3969304405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecc92400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ace04640 1 --2- 172.21.15.146:0/3969304405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecc75500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ad605640 1 -- 172.21.15.146:0/3969304405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 msgr2=0x5639ecc92400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ad605640 1 --2- 172.21.15.146:0/3969304405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecc92400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ad605640 1 -- 172.21.15.146:0/3969304405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 msgr2=0x5639ecc75500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ad605640 1 --2- 172.21.15.146:0/3969304405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecc75500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ad605640 1 -- 172.21.15.146:0/3969304405 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ec90e850 con 0x5639ec8a3270 2024-09-17T03:45:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ade06640 1 --2- 172.21.15.146:0/3969304405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecc92400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f92ad605640 1 --2- 172.21.15.146:0/3969304405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc74fc0 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 crypto rx=0x7f929800f8f0 tx=0x7f9298016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422cb02a7f11f643 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:50.213 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f928effd640 1 -- 172.21.15.146:0/3969304405 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929802c070 con 0x5639ec8a3270 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f928effd640 1 -- 172.21.15.146:0/3969304405 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9298027470 con 0x5639ec8a3270 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.210+0000 7f928effd640 1 -- 172.21.15.146:0/3969304405 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298027680 con 0x5639ec8a3270 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.211+0000 7f92b67d8740 1 -- 172.21.15.146:0/3969304405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 msgr2=0x5639ecc74fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.211+0000 7f92b67d8740 1 --2- 172.21.15.146:0/3969304405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc74fc0 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 crypto rx=0x7f929800f8f0 tx=0x7f9298016000 comp rx=0 tx=0).stop 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.211+0000 7f92b67d8740 1 -- 172.21.15.146:0/3969304405 shutdown_connections 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.211+0000 7f92b67d8740 1 --2- 172.21.15.146:0/3969304405 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecc92400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.211+0000 7f92b67d8740 1 --2- 172.21.15.146:0/3969304405 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecc75500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.211+0000 7f92b67d8740 1 --2- 172.21.15.146:0/3969304405 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc74fc0 unknown :-1 s=CLOSED pgs=2441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.211+0000 7f92b67d8740 1 -- 172.21.15.146:0/3969304405 >> 172.21.15.146:0/3969304405 conn(0x5639ec8973c0 msgr2=0x5639ecc4b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.211+0000 7f92b67d8740 1 -- 172.21.15.146:0/3969304405 shutdown_connections 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.211+0000 7f92b67d8740 1 -- 172.21.15.146:0/3969304405 wait complete. 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.212+0000 7f92b67d8740 1 -- start start 2024-09-17T03:45:50.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.212+0000 7f92b67d8740 1 Processor -- start 2024-09-17T03:45:50.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec87a3b0 0x5639ecc62d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecca2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec8a3270 0x5639ecc933a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92b67d8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5639ec91d620 con 0x5639ec87a3b0 2024-09-17T03:45:50.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92b67d8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5639ecb525f0 con 0x5639ec8a3270 2024-09-17T03:45:50.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92b67d8740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5639ecc75a40 con 0x5639ec882590 2024-09-17T03:45:50.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92b67d8740 10 client.0 _ll_register_callbacks cb 0x5639ecb560a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:45:50.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ad605640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec87a3b0 0x5639ecc62d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ad605640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec87a3b0 0x5639ecc62d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38724/0 (socket says 172.21.15.146:38724) 2024-09-17T03:45:50.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ad605640 1 -- 172.21.15.146:0/1065387742 learned_addr learned my addr 172.21.15.146:0/1065387742 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:50.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ade06640 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec8a3270 0x5639ecc933a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ace04640 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecca2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.219 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ad605640 1 -- 172.21.15.146:0/1065387742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 msgr2=0x5639ecca2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ad605640 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecca2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ad605640 1 -- 172.21.15.146:0/1065387742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec8a3270 msgr2=0x5639ecc933a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ad605640 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec8a3270 0x5639ecc933a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ad605640 1 -- 172.21.15.146:0/1065387742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ec9856b0 con 0x5639ec87a3b0 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ade06640 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec8a3270 0x5639ecc933a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92ad605640 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec87a3b0 0x5639ecc62d10 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f929802a040 tx=0x7f9298027a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2434c1d7769dd12 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f9287fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f9287fff640 1 -- 172.21.15.146:0/1065387742 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929802c070 con 0x5639ec87a3b0 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f9287fff640 1 -- 172.21.15.146:0/1065387742 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f9298032440 con 0x5639ec87a3b0 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.214+0000 7f92b67d8740 1 -- 172.21.15.146:0/1065387742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9298027470 con 0x5639ec87a3b0 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f9287fff640 1 -- 172.21.15.146:0/1065387742 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=145) ==== 24+0+0 (secure 0 0 0) 0x7f929803e050 con 0x5639ec87a3b0 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f92b67d8740 10 client.11247 fetch_fsmap learned FSMap version 145 2024-09-17T03:45:50.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f92b67d8740 1 -- 172.21.15.146:0/1065387742 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=145,monmap=2+}) -- 0x5639ecc938e0 con 0x5639ec87a3b0 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f9287fff640 1 -- 172.21.15.146:0/1065387742 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9298027470 con 0x5639ec87a3b0 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f9287fff640 1 -- 172.21.15.146:0/1065387742 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 145) ==== 3502+0+0 (secure 0 0 0) 0x7f9298004b20 con 0x5639ec87a3b0 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f92b67d8740 10 client.11247 fetch_fsmap finished waiting for FSMap version 145 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f92b67d8740 10 client.11247 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f92b67d8740 20 client.11247 populate_metadata read hostname 'smithi146' 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f92b67d8740 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5639ec861e40 0x5639ecc86bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f92b67d8740 4 client.11247 mds_command: new command op to 11100 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f92b67d8740 1 -- 172.21.15.146:0/1065387742 --> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639ecbbf770 con 0x5639ec861e40 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f92ace04640 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5639ec861e40 0x5639ecc86bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f9287fff640 10 client.11247 ms_handle_connect on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.215+0000 7f92ace04640 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5639ec861e40 0x5639ecc86bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a43d677965b589a2 server_cookie=d78867449a4954df in_seq=0 out_seq=0 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f9287fff640 1 -- 172.21.15.146:0/1065387742 <== mds.0 v2:172.21.15.146:6833/2793356470 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5639ecbbf770 con 0x5639ec861e40 2024-09-17T03:45:50.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f9287fff640 10 client.11247 handle_command_reply: tid=0 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f92b67d8740 1 client.11247 shutdown 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f92b67d8740 1 -- 172.21.15.146:0/1065387742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec87a3b0 msgr2=0x5639ecc62d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f92b67d8740 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec87a3b0 0x5639ecc62d10 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f929802a040 tx=0x7f9298027a20 comp rx=0 tx=0).stop 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f92b67d8740 1 -- 172.21.15.146:0/1065387742 shutdown_connections 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f92b67d8740 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5639ec861e40 0x5639ecc86bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f92b67d8740 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec8a3270 0x5639ecc933a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f92b67d8740 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecca2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f92b67d8740 1 --2- 172.21.15.146:0/1065387742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec87a3b0 0x5639ecc62d10 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f9287fff640 0 client.11247 ms_handle_reset on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f92b67d8740 1 -- 172.21.15.146:0/1065387742 >> 172.21.15.146:0/1065387742 conn(0x5639ec8973c0 msgr2=0x5639ecc45b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f92b67d8740 1 -- 172.21.15.146:0/1065387742 shutdown_connections 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.216+0000 7f92b67d8740 1 -- 172.21.15.146:0/1065387742 wait complete. 2024-09-17T03:45:50.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.217+0000 7f92b67d8740 20 client.11247 trim_cache size 0 max 16384 2024-09-17T03:45:50.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.234+0000 7f92b67d8740 1 Processor -- start 2024-09-17T03:45:50.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.234+0000 7f92b67d8740 1 -- start start 2024-09-17T03:45:50.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecc62b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec882590 0x5639ecc44550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec8a3270 0x5639ecc44a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92b67d8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f92a81ff2b0 con 0x5639ec882590 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92b67d8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92a81f3d10 con 0x5639ec87a3b0 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92b67d8740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f92a81fec90 con 0x5639ec8a3270 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92ace04640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec882590 0x5639ecc44550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92ace04640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec882590 0x5639ecc44550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38736/0 (socket says 172.21.15.146:38736) 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92ace04640 1 -- 172.21.15.146:0/1122955722 learned_addr learned my addr 172.21.15.146:0/1122955722 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92ace04640 1 -- 172.21.15.146:0/1122955722 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec8a3270 msgr2=0x5639ecc44a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92ace04640 1 --2- 172.21.15.146:0/1122955722 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec8a3270 0x5639ecc44a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92ace04640 1 -- 172.21.15.146:0/1122955722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 msgr2=0x5639ecc62b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92ace04640 1 --2- 172.21.15.146:0/1122955722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecc62b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92ace04640 1 -- 172.21.15.146:0/1122955722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639ecc63e90 con 0x5639ec882590 2024-09-17T03:45:50.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f92ace04640 1 --2- 172.21.15.146:0/1122955722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec882590 0x5639ecc44550 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f929c060110 tx=0x7f929c05ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fd85dee0cd3c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:50.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f928e7fc640 1 -- 172.21.15.146:0/1122955722 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c07d070 con 0x5639ec882590 2024-09-17T03:45:50.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f928e7fc640 1 -- 172.21.15.146:0/1122955722 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f929c089130 con 0x5639ec882590 2024-09-17T03:45:50.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.236+0000 7f928e7fc640 1 -- 172.21.15.146:0/1122955722 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c04e070 con 0x5639ec882590 2024-09-17T03:45:50.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.237+0000 7f92b67d8740 1 -- 172.21.15.146:0/1122955722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec882590 msgr2=0x5639ecc44550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.237+0000 7f92b67d8740 1 --2- 172.21.15.146:0/1122955722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec882590 0x5639ecc44550 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f929c060110 tx=0x7f929c05ee40 comp rx=0 tx=0).stop 2024-09-17T03:45:50.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.237+0000 7f92b67d8740 1 -- 172.21.15.146:0/1122955722 shutdown_connections 2024-09-17T03:45:50.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.237+0000 7f92b67d8740 1 --2- 172.21.15.146:0/1122955722 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec8a3270 0x5639ecc44a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.237+0000 7f92b67d8740 1 --2- 172.21.15.146:0/1122955722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec882590 0x5639ecc44550 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.237+0000 7f92b67d8740 1 --2- 172.21.15.146:0/1122955722 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecc62b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.237+0000 7f92b67d8740 1 -- 172.21.15.146:0/1122955722 >> 172.21.15.146:0/1122955722 conn(0x5639ec8973c0 msgr2=0x5639ecc47060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:50.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.237+0000 7f92b67d8740 1 -- 172.21.15.146:0/1122955722 shutdown_connections 2024-09-17T03:45:50.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.237+0000 7f92b67d8740 1 -- 172.21.15.146:0/1122955722 wait complete. 2024-09-17T03:45:50.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.238+0000 7f92b67d8740 1 -- start start 2024-09-17T03:45:50.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.238+0000 7f92b67d8740 1 Processor -- start 2024-09-17T03:45:50.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.239+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecd0ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.239+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecc44550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.239+0000 7f92b67d8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc44a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.239+0000 7f92b67d8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5639ecc61730 con 0x5639ec8a3270 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.239+0000 7f92b67d8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5639ecc62120 con 0x5639ec87a3b0 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.239+0000 7f92b67d8740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5639ecc61cf0 con 0x5639ec882590 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92b67d8740 10 client.0 _ll_register_callbacks cb 0x7f929802a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ade06640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc44a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ade06640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc44a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38740/0 (socket says 172.21.15.146:38740) 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ade06640 1 -- 172.21.15.146:0/3862219989 learned_addr learned my addr 172.21.15.146:0/3862219989 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ad605640 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecd0ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ace04640 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecc44550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ade06640 1 -- 172.21.15.146:0/3862219989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 msgr2=0x5639ecc44550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:50.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ade06640 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecc44550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ade06640 1 -- 172.21.15.146:0/3862219989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 msgr2=0x5639ecd0ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:50.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ade06640 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecd0ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ade06640 1 -- 172.21.15.146:0/3862219989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639ecc40bb0 con 0x5639ec8a3270 2024-09-17T03:45:50.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ad605640 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecd0ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:50.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92ade06640 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc44a90 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7f92a0001920 tx=0x7f92a0006530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15628a099b1f1ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:50.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f9287fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:45:50.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f9287fff640 1 -- 172.21.15.146:0/3862219989 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a00068c0 con 0x5639ec8a3270 2024-09-17T03:45:50.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f9287fff640 1 -- 172.21.15.146:0/3862219989 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f92a00037f0 con 0x5639ec8a3270 2024-09-17T03:45:50.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92b67d8740 1 -- 172.21.15.146:0/3862219989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f929c089130 con 0x5639ec8a3270 2024-09-17T03:45:50.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f9287fff640 1 -- 172.21.15.146:0/3862219989 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=145) ==== 24+0+0 (secure 0 0 0) 0x7f92a00039f0 con 0x5639ec8a3270 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92b67d8740 10 client.11253 fetch_fsmap learned FSMap version 145 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.240+0000 7f92b67d8740 1 -- 172.21.15.146:0/3862219989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=145,monmap=2+}) -- 0x5639ecd0e860 con 0x5639ec8a3270 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.241+0000 7f9287fff640 1 -- 172.21.15.146:0/3862219989 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f929c089130 con 0x5639ec8a3270 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.241+0000 7f9287fff640 1 -- 172.21.15.146:0/3862219989 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 145) ==== 3502+0+0 (secure 0 0 0) 0x7f92a004f080 con 0x5639ec8a3270 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.241+0000 7f92b67d8740 10 client.11253 fetch_fsmap finished waiting for FSMap version 145 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.241+0000 7f92b67d8740 10 client.11253 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.241+0000 7f92b67d8740 20 client.11253 populate_metadata read hostname 'smithi146' 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.241+0000 7f92b67d8740 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5639ecd127f0 0x5639ecc74c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.241+0000 7f92b67d8740 4 client.11253 mds_command: new command op to 11100 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.241+0000 7f92b67d8740 1 -- 172.21.15.146:0/3862219989 --> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] -- command(tid 0: {"prefix": "status"}) -- 0x5639ecbbb220 con 0x5639ecd127f0 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.241+0000 7f92ad605640 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5639ecd127f0 0x5639ecc74c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.241+0000 7f9287fff640 10 client.11253 ms_handle_connect on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.241+0000 7f92ad605640 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5639ecd127f0 0x5639ecc74c60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94d6d06a72c12280 server_cookie=a06b04d122690927 in_seq=0 out_seq=0 2024-09-17T03:45:50.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f9287fff640 1 -- 172.21.15.146:0/3862219989 <== mds.0 v2:172.21.15.146:6833/2793356470 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x5639ecbbb220 con 0x5639ecd127f0 2024-09-17T03:45:50.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f9287fff640 10 client.11253 handle_command_reply: tid=0 2024-09-17T03:45:50.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 1 client.11253 shutdown 2024-09-17T03:45:50.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 1 -- 172.21.15.146:0/3862219989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 msgr2=0x5639ecc44a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc44a90 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7f92a0001920 tx=0x7f92a0006530 comp rx=0 tx=0).stop 2024-09-17T03:45:50.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 1 -- 172.21.15.146:0/3862219989 shutdown_connections 2024-09-17T03:45:50.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5639ecd127f0 0x5639ecc74c60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639ec8a3270 0x5639ecc44a90 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5639ec882590 0x5639ecc44550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f9287fff640 0 client.11253 ms_handle_reset on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:50.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 1 --2- 172.21.15.146:0/3862219989 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5639ec87a3b0 0x5639ecd0ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 1 -- 172.21.15.146:0/3862219989 >> 172.21.15.146:0/3862219989 conn(0x5639ec8973c0 msgr2=0x5639ecc89780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:50.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 1 -- 172.21.15.146:0/3862219989 shutdown_connections 2024-09-17T03:45:50.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 1 -- 172.21.15.146:0/3862219989 wait complete. 2024-09-17T03:45:50.248 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.242+0000 7f92b67d8740 20 client.11253 trim_cache size 0 max 16384 2024-09-17T03:45:50.248 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 11100, 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.153849501, 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 145, 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 188, 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 188, 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 21.226346286999998 2024-09-17T03:45:50.249 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:45:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 -- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9294078b90 msgr2=0x7f929407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9294078b90 0x7f929407b0a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f92980097f0 tx=0x7f9298009500 comp rx=0 tx=0).stop 2024-09-17T03:45:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 -- 172.21.15.146:0/2976022343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92a81f7550 msgr2=0x7f92a8153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92a81f7550 0x7f92a8153e40 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f929c00e590 tx=0x7f929c00ea50 comp rx=0 tx=0).stop 2024-09-17T03:45:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 -- 172.21.15.146:0/2976022343 shutdown_connections 2024-09-17T03:45:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9294078b90 0x7f929407b0a0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92a8141c60 0x7f92a8152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92a81f7550 0x7f92a8153e40 unknown :-1 s=CLOSED pgs=2440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 --2- 172.21.15.146:0/2976022343 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9290005280 0x7f92a8142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 -- 172.21.15.146:0/2976022343 >> 172.21.15.146:0/2976022343 conn(0x7f92a80b7b20 msgr2=0x7f92a80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 -- 172.21.15.146:0/2976022343 shutdown_connections 2024-09-17T03:45:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.243+0000 7f92af869640 1 -- 172.21.15.146:0/2976022343 wait complete. 2024-09-17T03:45:50.254 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:45:50.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.369+0000 7f0195af9640 1 -- 172.21.15.146:0/4046487881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01780040b0 msgr2=0x7f0178004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.369+0000 7f0195af9640 1 --2- 172.21.15.146:0/4046487881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01780040b0 0x7f0178004800 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7f01840016b0 tx=0x7f0178005830 comp rx=0 tx=0).stop 2024-09-17T03:45:50.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.369+0000 7f018ffff640 1 -- 172.21.15.146:0/4046487881 reap_dead start 2024-09-17T03:45:50.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.369+0000 7f0195af9640 1 -- 172.21.15.146:0/4046487881 shutdown_connections 2024-09-17T03:45:50.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.369+0000 7f0195af9640 1 -- 172.21.15.146:0/4046487881 >> 172.21.15.146:0/4046487881 conn(0x7f01900b2060 msgr2=0x7f01900b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:50.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.369+0000 7f0195af9640 1 -- 172.21.15.146:0/4046487881 shutdown_connections 2024-09-17T03:45:50.370 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.369+0000 7f0195af9640 1 -- 172.21.15.146:0/4046487881 wait complete. 2024-09-17T03:45:50.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.371+0000 7f0195af9640 1 Processor -- start 2024-09-17T03:45:50.371 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.371+0000 7f0195af9640 1 -- start start 2024-09-17T03:45:50.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.372+0000 7f0195af9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01780040b0 0x7f0190153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.372+0000 7f0195af9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019014dd30 0x7f0190142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.372+0000 7f0195af9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0190156f90 0x7f01901573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.372+0000 7f0195af9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f01900b4a80 con 0x7f0190156f90 2024-09-17T03:45:50.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.372+0000 7f0195af9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0190070180 con 0x7f01780040b0 2024-09-17T03:45:50.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.372+0000 7f0195af9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f01900b4c00 con 0x7f019014dd30 2024-09-17T03:45:50.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.372+0000 7f018ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0190156f90 0x7f01901573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.372+0000 7f018ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0190156f90 0x7f01901573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38756/0 (socket says 172.21.15.146:38756) 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.372+0000 7f018ffff640 1 -- 172.21.15.146:0/3896579685 learned_addr learned my addr 172.21.15.146:0/3896579685 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f018f7fe640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01780040b0 0x7f0190153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f018effd640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019014dd30 0x7f0190142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f018ffff640 1 -- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019014dd30 msgr2=0x7f0190142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f018ffff640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019014dd30 0x7f0190142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f018ffff640 1 -- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01780040b0 msgr2=0x7f0190153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f018ffff640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01780040b0 0x7f0190153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f018ffff640 1 -- 172.21.15.146:0/3896579685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01901578e0 con 0x7f0190156f90 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f018ffff640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0190156f90 0x7f01901573a0 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7f0188002230 tx=0x7f0188006790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f0177fff640 1 -- 172.21.15.146:0/3896579685 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018800e8c0 con 0x7f0190156f90 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f0177fff640 1 -- 172.21.15.146:0/3896579685 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f018800eb70 con 0x7f0190156f90 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f0195af9640 1 -- 172.21.15.146:0/3896579685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0190153b30 con 0x7f0190156f90 2024-09-17T03:45:50.375 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f0177fff640 1 -- 172.21.15.146:0/3896579685 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0188011460 con 0x7f0190156f90 2024-09-17T03:45:50.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.373+0000 7f0195af9640 1 -- 172.21.15.146:0/3896579685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01901540f0 con 0x7f0190156f90 2024-09-17T03:45:50.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.374+0000 7f0195af9640 1 -- 172.21.15.146:0/3896579685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01900b4370 con 0x7f0190156f90 2024-09-17T03:45:50.376 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.375+0000 7f0177fff640 1 -- 172.21.15.146:0/3896579685 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0188019020 con 0x7f0190156f90 2024-09-17T03:45:50.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.375+0000 7f0177fff640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f017c078b90 0x7f017c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:50.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.376+0000 7f0177fff640 1 -- 172.21.15.146:0/3896579685 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f018809ab30 con 0x7f0190156f90 2024-09-17T03:45:50.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.376+0000 7f018f7fe640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f017c078b90 0x7f017c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:50.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.376+0000 7f018f7fe640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f017c078b90 0x7f017c07b0a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f018000dba0 tx=0x7f018000d390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:50.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.380+0000 7f0177fff640 1 -- 172.21.15.146:0/3896579685 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0188020020 con 0x7f0190156f90 2024-09-17T03:45:50.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.590+0000 7f0195af9640 1 -- 172.21.15.146:0/3896579685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f01900b0fa0 con 0x7f0190156f90 2024-09-17T03:45:50.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.590+0000 7f0177fff640 1 -- 172.21.15.146:0/3896579685 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v145) ==== 53+0+73 (secure 0 0 0) 0x7f01901578e0 con 0x7f0190156f90 2024-09-17T03:45:50.590 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:45:50.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 -- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f017c078b90 msgr2=0x7f017c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f017c078b90 0x7f017c07b0a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f018000dba0 tx=0x7f018000d390 comp rx=0 tx=0).stop 2024-09-17T03:45:50.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 -- 172.21.15.146:0/3896579685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0190156f90 msgr2=0x7f01901573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:50.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0190156f90 0x7f01901573a0 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7f0188002230 tx=0x7f0188006790 comp rx=0 tx=0).stop 2024-09-17T03:45:50.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 -- 172.21.15.146:0/3896579685 shutdown_connections 2024-09-17T03:45:50.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f017c078b90 0x7f017c07b0a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0190156f90 0x7f01901573a0 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f019014dd30 0x7f0190142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 --2- 172.21.15.146:0/3896579685 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01780040b0 0x7f0190153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:50.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 -- 172.21.15.146:0/3896579685 >> 172.21.15.146:0/3896579685 conn(0x7f01900b2060 msgr2=0x7f01900ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:50.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 -- 172.21.15.146:0/3896579685 shutdown_connections 2024-09-17T03:45:50.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50.592+0000 7f0195af9640 1 -- 172.21.15.146:0/3896579685 wait complete. 2024-09-17T03:45:50.604 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:45:50.604 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:45:50.605 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:45:50.605 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:45:50.605 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:45:50.605 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:45:50.605 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:45:50.605 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:45:50.605 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:45:50.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:50.605 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:45:50.621 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:45:50.621 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:45:50.622 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42021sec preferred_lft 42021sec 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:45:50.623 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:45:50.624 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:45:50.624 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:45:50.624 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:45:50.624 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:45:50.624 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:45:50.624 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:45:50.624 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:45:50.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:50.624 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:45:50.686 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:45:50.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:50.687 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:45:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:45:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:45:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:45:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:45:50.744 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:45:50.745 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:45:50.745 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:45:50.745 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:45:50.745 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:45:50.745 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:45:50.745 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:45:50.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:45:50.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:45:50.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:50.870 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:45:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:45:50.886 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:45:50.886 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:45:50.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:50.887 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:45:50.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:45:50.951 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:45:51.006 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:45:51.007 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:45:51.007 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:45:51.062 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:45:51.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:51.062 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:45:51.156 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:45:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:45:51.157 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:45:51.167 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:45:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:45:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:45:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:45:51.168 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:45:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:45:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:45:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:45:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:45:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:45:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:45:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:45:51.173 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:45:51.174 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:45:51.174 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:45:51.174 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:45:51.174 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:45:51.174 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:45:51.175 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:45:51.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:51.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:45:51.200 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:45:51.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:45:51.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:45:51.301 INFO:teuthology.orchestra.run.smithi146.stdout:client8663 2024-09-17T03:45:51.301 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:45:51.302 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:45:51.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:51.319 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-17T03:45:51.378 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:45:51.378 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:45:51.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:51.435 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-17T03:45:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records in 2024-09-17T03:45:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records out 2024-09-17T03:45:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.040032 s, 157 MB/s 2024-09-17T03:45:51.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:45:51.535 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:45:51.577 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2024-09-17T03:45:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2024-09-17T03:45:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:45:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2024-09-17T03:45:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2024-09-17T03:45:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2024-09-17T03:45:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.577 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.578 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.579 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.580 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2024-09-17T03:45:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2024-09-17T03:45:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:45:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2024-09-17T03:45:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2024-09-17T03:45:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2024-09-17T03:45:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2024-09-17T03:45:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2024-09-17T03:45:51.581 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2024-09-17T03:45:51.582 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:45:51.583 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2024-09-17T03:45:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:45:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:45:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2024-09-17T03:45:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.584 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2024-09-17T03:45:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:45:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2024-09-17T03:45:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T03:45:51.584 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2024-09-17T03:45:51.585 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:45:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2024-09-17T03:45:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2024-09-17T03:45:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:45:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:45:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:45:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:45:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:45:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:45:51.586 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:45:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2024-09-17T03:45:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:45:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:45:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: mon down mkfs grace = 300 2024-09-17T03:45:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.587 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2024-09-17T03:45:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2024-09-17T03:45:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2024-09-17T03:45:51.587 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2024-09-17T03:45:51.588 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:45:51.588 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:45:51.588 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2024-09-17T03:45:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2024-09-17T03:45:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2024-09-17T03:45:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2024-09-17T03:45:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-09-17T03:45:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-09-17T03:45:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-09-17T03:45:51.588 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-09-17T03:45:51.589 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2024-09-17T03:45:51.589 INFO:teuthology.orchestra.run.smithi146.stdout: mds cache max size = 1000 2024-09-17T03:45:51.589 INFO:teuthology.orchestra.run.smithi146.stdout: mds log max segments = 1 2024-09-17T03:45:51.589 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = False 2024-09-17T03:45:51.590 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-17T03:45:51.590 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-17T03:45:51.590 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:45:51.590 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-17T03:45:51.590 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.591 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-17T03:45:51.591 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.591 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-17T03:45:51.591 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.591 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-17T03:45:51.591 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-17T03:45:51.591 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.591 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-17T03:45:51.592 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-17T03:45:51.592 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.592 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:45:51.592 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-17T03:45:51.592 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.592 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:45:51.592 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:45:51.592 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.592 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-17T03:45:51.593 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-17T03:45:51.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-17T03:45:51.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:45:51.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:45:51.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-17T03:45:51.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:45:51.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-17T03:45:51.593 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:45:51.594 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:45:51.594 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-17T03:45:51.594 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.594 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:45:51.594 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.594 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-17T03:45:51.594 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.594 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-17T03:45:51.595 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.595 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-17T03:45:51.595 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-17T03:45:51.595 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-17T03:45:51.595 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.146,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-17T03:45:51.595 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2024-09-17T03:45:51.595 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:45:51.595 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.595 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-17T03:45:51.596 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-17T03:45:51.596 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.596 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-17T03:45:51.596 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-17T03:45:51.596 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:45:51.596 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.597 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-17T03:45:51.597 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-17T03:45:51.597 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.597 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-17T03:45:51.597 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-17T03:45:51.597 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-17T03:45:51.597 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-09-17T03:45:51.597 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.597 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-17T03:45:51.598 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:45:51.599 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:45:51.600 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.601 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: mon down mkfs grace = 300 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-17T03:45:51.602 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout: mds cache max size = 1000 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout: mds log max segments = 1 2024-09-17T03:45:51.603 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = False 2024-09-17T03:45:51.605 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:45:51.647 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:45:51.689 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2024-09-17T03:45:51.689 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2024-09-17T03:45:51.689 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:45:51.689 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2024-09-17T03:45:51.689 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.689 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2024-09-17T03:45:51.689 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.689 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2024-09-17T03:45:51.689 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.689 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2024-09-17T03:45:51.690 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:45:51.691 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2024-09-17T03:45:51.692 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.693 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2024-09-17T03:45:51.694 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:45:51.695 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:45:51.696 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.697 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: mon down mkfs grace = 300 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2024-09-17T03:45:51.698 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout: mds cache max size = 1000 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout: mds log max segments = 1 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = False 2024-09-17T03:45:51.699 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = False 2024-09-17T03:45:51.700 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-17T03:45:51.700 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-17T03:45:51.700 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:45:51.700 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-17T03:45:51.700 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.700 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-17T03:45:51.700 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:45:51.701 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.702 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.146,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-17T03:45:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-17T03:45:51.705 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:45:51.706 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-17T03:45:51.707 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:45:51.708 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: mon down mkfs grace = 300 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-17T03:45:51.709 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout: mds cache max size = 1000 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout: mds log max segments = 1 2024-09-17T03:45:51.710 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = False 2024-09-17T03:45:51.711 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = False 2024-09-17T03:45:51.712 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:45:51.712 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:45:51.712 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-09-17T03:45:51.712 DEBUG:teuthology.orchestra.run.smithi146:> import json 2024-09-17T03:45:51.712 DEBUG:teuthology.orchestra.run.smithi146:> import sys 2024-09-17T03:45:51.713 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:45:51.713 DEBUG:teuthology.orchestra.run.smithi146:> try: 2024-09-17T03:45:51.713 DEBUG:teuthology.orchestra.run.smithi146:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-17T03:45:51.713 DEBUG:teuthology.orchestra.run.smithi146:> except OSError as e: 2024-09-17T03:45:51.713 DEBUG:teuthology.orchestra.run.smithi146:> sys.exit(e.errno) 2024-09-17T03:45:51.713 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:45:51.713 DEBUG:teuthology.orchestra.run.smithi146:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-17T03:45:51.713 DEBUG:teuthology.orchestra.run.smithi146:> print(json.dumps( 2024-09-17T03:45:51.713 DEBUG:teuthology.orchestra.run.smithi146:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-17T03:45:51.713 DEBUG:teuthology.orchestra.run.smithi146:> indent=2)) 2024-09-17T03:45:51.713 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:45:51.818 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:45:51.819 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mode": 33188, 2024-09-17T03:45:51.819 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ino": 1099511627777, 2024-09-17T03:45:51.819 INFO:teuthology.orchestra.run.smithi146.stdout: "st_dev": 41, 2024-09-17T03:45:51.819 INFO:teuthology.orchestra.run.smithi146.stdout: "st_nlink": 1, 2024-09-17T03:45:51.819 INFO:teuthology.orchestra.run.smithi146.stdout: "st_uid": 1000, 2024-09-17T03:45:51.819 INFO:teuthology.orchestra.run.smithi146.stdout: "st_gid": 1333, 2024-09-17T03:45:51.819 INFO:teuthology.orchestra.run.smithi146.stdout: "st_size": 6291456, 2024-09-17T03:45:51.819 INFO:teuthology.orchestra.run.smithi146.stdout: "st_atime": 1726544751.4908104, 2024-09-17T03:45:51.819 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mtime": 1726544751.51181, 2024-09-17T03:45:51.819 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ctime": 1726544751.51181 2024-09-17T03:45:51.819 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:45:51.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:45:51.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:45:51.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.980+0000 7f3942f82640 1 -- 172.21.15.146:0/4250742177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f393c1617a0 msgr2=0x7f393c163bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:51.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.980+0000 7f3942f82640 1 --2- 172.21.15.146:0/4250742177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f393c1617a0 0x7f393c163bc0 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f393c0d1900 tx=0x7f392c02a410 comp rx=0 tx=0).stop 2024-09-17T03:45:51.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.980+0000 7f3942f82640 1 -- 172.21.15.146:0/4250742177 shutdown_connections 2024-09-17T03:45:51.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.980+0000 7f3942f82640 1 --2- 172.21.15.146:0/4250742177 >> v2:172.21.15.179:3300/0 conn(0x7f393c164100 0x7f393c166520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:51.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.980+0000 7f3942f82640 1 --2- 172.21.15.146:0/4250742177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f393c1617a0 0x7f393c163bc0 unknown :-1 s=CLOSED pgs=2449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:51.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.980+0000 7f3942f82640 1 -- 172.21.15.146:0/4250742177 >> 172.21.15.146:0/4250742177 conn(0x7f393c0b41b0 msgr2=0x7f393c0b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:51.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.980+0000 7f3942f82640 1 -- 172.21.15.146:0/4250742177 shutdown_connections 2024-09-17T03:45:51.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.980+0000 7f3942f82640 1 -- 172.21.15.146:0/4250742177 wait complete. 2024-09-17T03:45:51.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.982+0000 7f3942f82640 1 Processor -- start 2024-09-17T03:45:51.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.982+0000 7f3942f82640 1 -- start start 2024-09-17T03:45:51.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.983+0000 7f3942f82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f393c1600b0 0x7f393c14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.983+0000 7f3942f82640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f393c1617a0 0x7f393c1513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.983+0000 7f3942f82640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f393c164100 0x7f393c151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.983+0000 7f3942f82640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f393c166df0 con 0x7f393c1600b0 2024-09-17T03:45:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.983+0000 7f3942f82640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f393c166c70 con 0x7f393c1617a0 2024-09-17T03:45:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.983+0000 7f3942f82640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f393c166f70 con 0x7f393c164100 2024-09-17T03:45:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.983+0000 7f3940d1e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f393c1600b0 0x7f393c14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.983+0000 7f3940d1e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f393c1600b0 0x7f393c14fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38770/0 (socket says 172.21.15.146:38770) 2024-09-17T03:45:51.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.983+0000 7f3940d1e640 1 -- 172.21.15.146:0/1766604819 learned_addr learned my addr 172.21.15.146:0/1766604819 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f394151f640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f393c164100 0x7f393c151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f3940d1e640 1 -- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f393c164100 msgr2=0x7f393c151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f3940d1e640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f393c164100 0x7f393c151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f3940d1e640 1 -- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f393c1617a0 msgr2=0x7f393c1513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f3933fff640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f393c1617a0 0x7f393c1513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f3940d1e640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f393c1617a0 0x7f393c1513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f3940d1e640 1 -- 172.21.15.146:0/1766604819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393c151fa0 con 0x7f393c1600b0 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f3940d1e640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f393c1600b0 0x7f393c14fe10 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7f393800c3c0 tx=0x7f393800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f39317fa640 1 -- 172.21.15.146:0/1766604819 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938017070 con 0x7f393c1600b0 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f39317fa640 1 -- 172.21.15.146:0/1766604819 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3938003610 con 0x7f393c1600b0 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f3942f82640 1 -- 172.21.15.146:0/1766604819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f393c152280 con 0x7f393c1600b0 2024-09-17T03:45:51.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f39317fa640 1 -- 172.21.15.146:0/1766604819 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938003a60 con 0x7f393c1600b0 2024-09-17T03:45:51.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.984+0000 7f3942f82640 1 -- 172.21.15.146:0/1766604819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f393c0b3010 con 0x7f393c1600b0 2024-09-17T03:45:51.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.985+0000 7f3942f82640 1 -- 172.21.15.146:0/1766604819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f393c0b65c0 con 0x7f393c1600b0 2024-09-17T03:45:51.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.986+0000 7f39317fa640 1 -- 172.21.15.146:0/1766604819 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f393801a070 con 0x7f393c1600b0 2024-09-17T03:45:51.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.986+0000 7f39317fa640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3928078b90 0x7f392807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:51.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.986+0000 7f39317fa640 1 -- 172.21.15.146:0/1766604819 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f3938099ed0 con 0x7f393c1600b0 2024-09-17T03:45:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.987+0000 7f3933fff640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3928078b90 0x7f392807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:51.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.987+0000 7f3933fff640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3928078b90 0x7f392807b0a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f392c034000 tx=0x7f392c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:51.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:51.991+0000 7f39317fa640 1 -- 172.21.15.146:0/1766604819 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39380623a0 con 0x7f393c1600b0 2024-09-17T03:45:52.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.202+0000 7f3942f82640 1 -- 172.21.15.146:0/1766604819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f393c15f1f0 con 0x7f393c1600b0 2024-09-17T03:45:52.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.203+0000 7f39317fa640 1 -- 172.21.15.146:0/1766604819 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) ==== 95+0+5245 (secure 0 0 0) 0x7f3938061ca0 con 0x7f393c1600b0 2024-09-17T03:45:52.203 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:45:52.203 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":145,"btime":"2024-09-17T03:45:43:095701+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/190399628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":190399628},{"type":"v1","addr":"172.21.15.179:6837","nonce":190399628}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":9565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/748249037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":748249037},{"type":"v1","addr":"172.21.15.179:6835","nonce":748249037}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":11097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1562825832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1562825832},{"type":"v1","addr":"172.21.15.146:6834","nonce":1562825832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:45:39.438921+0000","modified":"2024-09-17T03:45:42.453930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11100":{"gid":11100,"name":"a","rank":0,"incarnation":142,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2793356470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2793356470},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793356470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11100,"qdb_cluster":[11100]},"id":14}]} 2024-09-17T03:45:52.203 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 145 2024-09-17T03:45:52.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 -- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3928078b90 msgr2=0x7f392807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3928078b90 0x7f392807b0a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f392c034000 tx=0x7f392c004730 comp rx=0 tx=0).stop 2024-09-17T03:45:52.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 -- 172.21.15.146:0/1766604819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f393c1600b0 msgr2=0x7f393c14fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f393c1600b0 0x7f393c14fe10 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7f393800c3c0 tx=0x7f393800c880 comp rx=0 tx=0).stop 2024-09-17T03:45:52.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 -- 172.21.15.146:0/1766604819 shutdown_connections 2024-09-17T03:45:52.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3928078b90 0x7f392807b0a0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f393c164100 0x7f393c151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f393c1617a0 0x7f393c1513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 --2- 172.21.15.146:0/1766604819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f393c1600b0 0x7f393c14fe10 unknown :-1 s=CLOSED pgs=2450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 -- 172.21.15.146:0/1766604819 >> 172.21.15.146:0/1766604819 conn(0x7f393c0b41b0 msgr2=0x7f393c0b6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 -- 172.21.15.146:0/1766604819 shutdown_connections 2024-09-17T03:45:52.206 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.205+0000 7f3942f82640 1 -- 172.21.15.146:0/1766604819 wait complete. 2024-09-17T03:45:52.217 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-17T03:45:52.347 INFO:teuthology.orchestra.run.smithi146.stdout:{"message":"","return_code":0} 2024-09-17T03:45:52.348 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T03:45:52.348 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2024-09-17T03:45:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.405+0000 7fa351cf3f40 1 Processor -- start 2024-09-17T03:45:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.405+0000 7fa351cf3f40 1 -- start start 2024-09-17T03:45:52.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.406+0000 7fa351cf3f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa334002910 0x55cbdd63dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.406+0000 7fa351cf3f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76ccf0 0x55cbdd76d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.406+0000 7fa351cf3f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cbdd76d640 0x55cbdd7764a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.406+0000 7fa351cf3f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cbdd5bc430 con 0x55cbdd76ccf0 2024-09-17T03:45:52.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.406+0000 7fa351cf3f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cbdd5c91f0 con 0x7fa334002910 2024-09-17T03:45:52.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.406+0000 7fa351cf3f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55cbdd55dd60 con 0x55cbdd76d640 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.406+0000 7fa34afac640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76ccf0 0x55cbdd76d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.406+0000 7fa34afac640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76ccf0 0x55cbdd76d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38778/0 (socket says 172.21.15.146:38778) 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.406+0000 7fa34afac640 1 -- 172.21.15.146:0/1416387315 learned_addr learned my addr 172.21.15.146:0/1416387315 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa34b7ad640 1 --2- 172.21.15.146:0/1416387315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa334002910 0x55cbdd63dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa34bfae640 1 --2- 172.21.15.146:0/1416387315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cbdd76d640 0x55cbdd7764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa34afac640 1 -- 172.21.15.146:0/1416387315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cbdd76d640 msgr2=0x55cbdd7764a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa34afac640 1 --2- 172.21.15.146:0/1416387315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cbdd76d640 0x55cbdd7764a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa34afac640 1 -- 172.21.15.146:0/1416387315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa334002910 msgr2=0x55cbdd63dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa34afac640 1 --2- 172.21.15.146:0/1416387315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa334002910 0x55cbdd63dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa34afac640 1 -- 172.21.15.146:0/1416387315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbdd6c8d40 con 0x55cbdd76ccf0 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa34b7ad640 1 --2- 172.21.15.146:0/1416387315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa334002910 0x55cbdd63dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa34afac640 1 --2- 172.21.15.146:0/1416387315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76ccf0 0x55cbdd76d100 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7fa340002040 tx=0x7fa340003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1183ad337454b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa349faa640 1 -- 172.21.15.146:0/1416387315 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340062020 con 0x55cbdd76ccf0 2024-09-17T03:45:52.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa349faa640 1 -- 172.21.15.146:0/1416387315 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa34005e400 con 0x55cbdd76ccf0 2024-09-17T03:45:52.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.407+0000 7fa349faa640 1 -- 172.21.15.146:0/1416387315 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34005e830 con 0x55cbdd76ccf0 2024-09-17T03:45:52.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.408+0000 7fa351cf3f40 1 -- 172.21.15.146:0/1416387315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76ccf0 msgr2=0x55cbdd76d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.408+0000 7fa351cf3f40 1 --2- 172.21.15.146:0/1416387315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76ccf0 0x55cbdd76d100 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7fa340002040 tx=0x7fa340003020 comp rx=0 tx=0).stop 2024-09-17T03:45:52.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.408+0000 7fa351cf3f40 1 -- 172.21.15.146:0/1416387315 shutdown_connections 2024-09-17T03:45:52.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.408+0000 7fa351cf3f40 1 --2- 172.21.15.146:0/1416387315 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55cbdd76d640 0x55cbdd7764a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.408+0000 7fa351cf3f40 1 --2- 172.21.15.146:0/1416387315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76ccf0 0x55cbdd76d100 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.408+0000 7fa351cf3f40 1 --2- 172.21.15.146:0/1416387315 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa334002910 0x55cbdd63dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.408+0000 7fa351cf3f40 1 -- 172.21.15.146:0/1416387315 >> 172.21.15.146:0/1416387315 conn(0x55cbdd52eac0 msgr2=0x55cbdd6cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.408+0000 7fa351cf3f40 1 -- 172.21.15.146:0/1416387315 shutdown_connections 2024-09-17T03:45:52.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.408+0000 7fa351cf3f40 1 -- 172.21.15.146:0/1416387315 wait complete. 2024-09-17T03:45:52.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.409+0000 7fa351cf3f40 1 Processor -- start 2024-09-17T03:45:52.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.409+0000 7fa351cf3f40 1 -- start start 2024-09-17T03:45:52.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa351cf3f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cbdd76ccf0 0x55cbdd77a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa351cf3f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76d640 0x55cbdd6e3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa351cf3f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa334002910 0x55cbdd6e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa351cf3f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55cbdd6c3d30 con 0x55cbdd76d640 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa351cf3f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55cbdd6c8aa0 con 0x55cbdd76ccf0 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa351cf3f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55cbdd6c3a50 con 0x7fa334002910 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa34afac640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76d640 0x55cbdd6e3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa34afac640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76d640 0x55cbdd6e3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38794/0 (socket says 172.21.15.146:38794) 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa34afac640 1 -- 172.21.15.146:0/3657347459 learned_addr learned my addr 172.21.15.146:0/3657347459 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa34b7ad640 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cbdd76ccf0 0x55cbdd77a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa34bfae640 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa334002910 0x55cbdd6e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa34afac640 1 -- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa334002910 msgr2=0x55cbdd6e3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa34afac640 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa334002910 0x55cbdd6e3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa34afac640 1 -- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cbdd76ccf0 msgr2=0x55cbdd77a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa34afac640 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55cbdd76ccf0 0x55cbdd77a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa34afac640 1 -- 172.21.15.146:0/3657347459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbdd6c5000 con 0x55cbdd76d640 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.410+0000 7fa34afac640 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76d640 0x55cbdd6e3660 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7fa340061040 tx=0x7fa3400569e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.411+0000 7fa348fa8640 1 -- 172.21.15.146:0/3657347459 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340062070 con 0x55cbdd76d640 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.411+0000 7fa348fa8640 1 -- 172.21.15.146:0/3657347459 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa340067420 con 0x55cbdd76d640 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.411+0000 7fa351cf3f40 1 -- 172.21.15.146:0/3657347459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cbdd77b3c0 con 0x55cbdd76d640 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.411+0000 7fa348fa8640 1 -- 172.21.15.146:0/3657347459 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340056e60 con 0x55cbdd76d640 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.411+0000 7fa351cf3f40 1 -- 172.21.15.146:0/3657347459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbdd77b980 con 0x55cbdd76d640 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.412+0000 7fa348fa8640 1 -- 172.21.15.146:0/3657347459 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa340065020 con 0x55cbdd76d640 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.413+0000 7fa348fa8640 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3380775a0 0x7fa338079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.413+0000 7fa348fa8640 1 -- 172.21.15.146:0/3657347459 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fa34005a020 con 0x55cbdd76d640 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.413+0000 7fa34b7ad640 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3380775a0 0x7fa338079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.413+0000 7fa351cf3f40 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x55cbdd77ae80 0x55cbdd6de9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.413+0000 7fa351cf3f40 1 -- 172.21.15.146:0/3657347459 --> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] -- osd_op(unknown.0.0:1 29.7 29:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e188) -- 0x55cbdd6e1600 con 0x55cbdd77ae80 2024-09-17T03:45:52.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.413+0000 7fa34bfae640 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x55cbdd77ae80 0x55cbdd6de9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.413+0000 7fa34b7ad640 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3380775a0 0x7fa338079ab0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa33c001050 tx=0x7fa33c003040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.414+0000 7fa34bfae640 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x55cbdd77ae80 0x55cbdd6de9d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa34bfae640 1 -- 172.21.15.146:0/3657347459 <== osd.6 v2:172.21.15.179:6810/1755575046 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v188'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa344009bd0 con 0x55cbdd77ae80 2024-09-17T03:45:52.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa351cf3f40 1 -- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x55cbdd77ae80 msgr2=0x55cbdd6de9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa351cf3f40 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x55cbdd77ae80 0x55cbdd6de9d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa351cf3f40 1 -- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3380775a0 msgr2=0x7fa338079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa351cf3f40 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3380775a0 0x7fa338079ab0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa33c001050 tx=0x7fa33c003040 comp rx=0 tx=0).stop 2024-09-17T03:45:52.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa351cf3f40 1 -- 172.21.15.146:0/3657347459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76d640 msgr2=0x55cbdd6e3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa351cf3f40 1 --2- 172.21.15.146:0/3657347459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cbdd76d640 0x55cbdd6e3660 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7fa340061040 tx=0x7fa3400569e0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa34bfae640 1 -- 172.21.15.146:0/3657347459 reap_dead start 2024-09-17T03:45:52.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa351cf3f40 1 -- 172.21.15.146:0/3657347459 shutdown_connections 2024-09-17T03:45:52.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa351cf3f40 1 -- 172.21.15.146:0/3657347459 >> 172.21.15.146:0/3657347459 conn(0x55cbdd52eac0 msgr2=0x55cbdd6e51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa351cf3f40 1 -- 172.21.15.146:0/3657347459 shutdown_connections 2024-09-17T03:45:52.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.415+0000 7fa351cf3f40 1 -- 172.21.15.146:0/3657347459 wait complete. 2024-09-17T03:45:52.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:52.419 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub start / recursive,repair 2024-09-17T03:45:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.536+0000 7f9eb87f1640 1 -- 172.21.15.146:0/568850723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb015ba00 msgr2=0x7f9eb00b0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.536+0000 7f9eb87f1640 1 --2- 172.21.15.146:0/568850723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb015ba00 0x7f9eb00b0710 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0005fd0 tx=0x7f9ea002a540 comp rx=0 tx=0).stop 2024-09-17T03:45:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.536+0000 7f9eb87f1640 1 -- 172.21.15.146:0/568850723 shutdown_connections 2024-09-17T03:45:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.536+0000 7f9eb87f1640 1 --2- 172.21.15.146:0/568850723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb015ba00 0x7f9eb00b0710 unknown :-1 s=CLOSED pgs=2455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.536+0000 7f9eb87f1640 1 --2- 172.21.15.146:0/568850723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb0074000 0x7f9eb0071210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.536+0000 7f9eb87f1640 1 -- 172.21.15.146:0/568850723 >> 172.21.15.146:0/568850723 conn(0x7f9eb006de90 msgr2=0x7f9eb006e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.536+0000 7f9eb87f1640 1 -- 172.21.15.146:0/568850723 shutdown_connections 2024-09-17T03:45:52.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.536+0000 7f9eb87f1640 1 -- 172.21.15.146:0/568850723 wait complete. 2024-09-17T03:45:52.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.538+0000 7f9eb87f1640 1 Processor -- start 2024-09-17T03:45:52.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.538+0000 7f9eb87f1640 1 -- start start 2024-09-17T03:45:52.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb87f1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb0074000 0x7f9eb014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb87f1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb00b0c50 0x7f9eb01f9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb87f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb015ba00 0x7f9eb006cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb87f1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb015fdc0 con 0x7f9eb0074000 2024-09-17T03:45:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb87f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb006faf0 con 0x7f9eb015ba00 2024-09-17T03:45:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb87f1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb015ff40 con 0x7f9eb00b0c50 2024-09-17T03:45:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb658d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb0074000 0x7f9eb014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb658d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb0074000 0x7f9eb014c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38798/0 (socket says 172.21.15.146:38798) 2024-09-17T03:45:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb658d640 1 -- 172.21.15.146:0/2742850680 learned_addr learned my addr 172.21.15.146:0/2742850680 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb5d8c640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb00b0c50 0x7f9eb01f9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb6d8e640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb015ba00 0x7f9eb006cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb658d640 1 -- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb00b0c50 msgr2=0x7f9eb01f9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb658d640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb00b0c50 0x7f9eb01f9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb658d640 1 -- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb015ba00 msgr2=0x7f9eb006cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb658d640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb015ba00 0x7f9eb006cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.539+0000 7f9eb658d640 1 -- 172.21.15.146:0/2742850680 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb014c590 con 0x7f9eb0074000 2024-09-17T03:45:52.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.540+0000 7f9eb658d640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb0074000 0x7f9eb014c050 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00eb60 tx=0x7f9eac00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.540+0000 7f9ea6ffd640 1 -- 172.21.15.146:0/2742850680 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac010630 con 0x7f9eb0074000 2024-09-17T03:45:52.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.540+0000 7f9ea6ffd640 1 -- 172.21.15.146:0/2742850680 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9eac0108c0 con 0x7f9eb0074000 2024-09-17T03:45:52.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.540+0000 7f9ea6ffd640 1 -- 172.21.15.146:0/2742850680 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac010d10 con 0x7f9eb0074000 2024-09-17T03:45:52.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.540+0000 7f9eb87f1640 1 -- 172.21.15.146:0/2742850680 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb0157f30 con 0x7f9eb0074000 2024-09-17T03:45:52.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.540+0000 7f9eb87f1640 1 -- 172.21.15.146:0/2742850680 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb00aebe0 con 0x7f9eb0074000 2024-09-17T03:45:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.542+0000 7f9ea6ffd640 1 -- 172.21.15.146:0/2742850680 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9eac018420 con 0x7f9eb0074000 2024-09-17T03:45:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.542+0000 7f9ea6ffd640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e94078b90 0x7f9e9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.542+0000 7f9ea6ffd640 1 -- 172.21.15.146:0/2742850680 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f9eac09ba60 con 0x7f9eb0074000 2024-09-17T03:45:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.542+0000 7f9eb5d8c640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e94078b90 0x7f9e9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.543+0000 7f9eb5d8c640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e94078b90 0x7f9e9407b0a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0033000 tx=0x7f9ea0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.543+0000 7f9ebf841740 1 Processor -- start 2024-09-17T03:45:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.543+0000 7f9ebf841740 1 -- start start 2024-09-17T03:45:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.544+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584d7410 0x556c588a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.544+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584ae550 0x556c588aa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c588c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9ebf841740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556c587f2120 con 0x556c584b6730 2024-09-17T03:45:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9ebf841740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556c587e1550 con 0x556c584d7410 2024-09-17T03:45:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9ebf841740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x556c587e5360 con 0x556c584ae550 2024-09-17T03:45:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb6d8e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c588c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb6d8e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c588c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38808/0 (socket says 172.21.15.146:38808) 2024-09-17T03:45:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb6d8e640 1 -- 172.21.15.146:0/2581828535 learned_addr learned my addr 172.21.15.146:0/2581828535 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb5d8c640 1 --2- 172.21.15.146:0/2581828535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584ae550 0x556c588aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb658d640 1 --2- 172.21.15.146:0/2581828535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584d7410 0x556c588a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb6d8e640 1 -- 172.21.15.146:0/2581828535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584ae550 msgr2=0x556c588aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb6d8e640 1 --2- 172.21.15.146:0/2581828535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584ae550 0x556c588aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb6d8e640 1 -- 172.21.15.146:0/2581828535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584d7410 msgr2=0x556c588a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb6d8e640 1 --2- 172.21.15.146:0/2581828535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584d7410 0x556c588a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb6d8e640 1 -- 172.21.15.146:0/2581828535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c584d3470 con 0x556c584b6730 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb658d640 1 --2- 172.21.15.146:0/2581828535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584d7410 0x556c588a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9eb6d8e640 1 --2- 172.21.15.146:0/2581828535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c588c7150 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8001740 tx=0x7f9ea8007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9540997b3339783 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9e93fff640 1 -- 172.21.15.146:0/2581828535 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80052e0 con 0x556c584b6730 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9e93fff640 1 -- 172.21.15.146:0/2581828535 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ea8018070 con 0x556c584b6730 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.545+0000 7f9e93fff640 1 -- 172.21.15.146:0/2581828535 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea800fa10 con 0x556c584b6730 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.546+0000 7f9ebf841740 1 -- 172.21.15.146:0/2581828535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 msgr2=0x556c588c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.546+0000 7f9ebf841740 1 --2- 172.21.15.146:0/2581828535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c588c7150 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8001740 tx=0x7f9ea8007db0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.546+0000 7f9ebf841740 1 -- 172.21.15.146:0/2581828535 shutdown_connections 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.546+0000 7f9ebf841740 1 --2- 172.21.15.146:0/2581828535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c588c7150 unknown :-1 s=CLOSED pgs=2457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.546+0000 7f9ebf841740 1 --2- 172.21.15.146:0/2581828535 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584ae550 0x556c588aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.546+0000 7f9ebf841740 1 --2- 172.21.15.146:0/2581828535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584d7410 0x556c588a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.546+0000 7f9ebf841740 1 -- 172.21.15.146:0/2581828535 >> 172.21.15.146:0/2581828535 conn(0x556c584cb560 msgr2=0x556c5887ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.546+0000 7f9ebf841740 1 -- 172.21.15.146:0/2581828535 shutdown_connections 2024-09-17T03:45:52.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.546+0000 7f9ebf841740 1 -- 172.21.15.146:0/2581828535 wait complete. 2024-09-17T03:45:52.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.547+0000 7f9ebf841740 1 -- start start 2024-09-17T03:45:52.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.547+0000 7f9ebf841740 1 Processor -- start 2024-09-17T03:45:52.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584ae550 0x556c588885c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c5887ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584d7410 0x556c58894390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9ebf841740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556c585517c0 con 0x556c584b6730 2024-09-17T03:45:52.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9ebf841740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556c58786890 con 0x556c584d7410 2024-09-17T03:45:52.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9ebf841740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x556c588aa790 con 0x556c584ae550 2024-09-17T03:45:52.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9ebf841740 10 client.0 _ll_register_callbacks cb 0x556c587dace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:45:52.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9eb5d8c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c5887ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9eb5d8c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c5887ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38810/0 (socket says 172.21.15.146:38810) 2024-09-17T03:45:52.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9eb5d8c640 1 -- 172.21.15.146:0/1137726056 learned_addr learned my addr 172.21.15.146:0/1137726056 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9eb658d640 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584ae550 0x556c588885c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9eb6d8e640 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584d7410 0x556c58894390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9eb5d8c640 1 -- 172.21.15.146:0/1137726056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584ae550 msgr2=0x556c588885c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9eb5d8c640 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584ae550 0x556c588885c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9eb5d8c640 1 -- 172.21.15.146:0/1137726056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584d7410 msgr2=0x556c58894390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9eb5d8c640 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584d7410 0x556c58894390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9eb5d8c640 1 -- 172.21.15.146:0/1137726056 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c585b77e0 con 0x556c584b6730 2024-09-17T03:45:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9eb5d8c640 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c5887ef60 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0006010 tx=0x7f9ea0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fb57fcc6b0a8dd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9e917fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:45:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9e917fa640 1 -- 172.21.15.146:0/1137726056 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea004d020 con 0x556c584b6730 2024-09-17T03:45:52.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9e917fa640 1 -- 172.21.15.146:0/1137726056 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f9ea0003b40 con 0x556c584b6730 2024-09-17T03:45:52.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.549+0000 7f9ebf841740 1 -- 172.21.15.146:0/1137726056 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ea8018070 con 0x556c584b6730 2024-09-17T03:45:52.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9e917fa640 1 -- 172.21.15.146:0/1137726056 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=145) ==== 24+0+0 (secure 0 0 0) 0x7f9ea0057050 con 0x556c584b6730 2024-09-17T03:45:52.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9ebf841740 10 client.11289 fetch_fsmap learned FSMap version 145 2024-09-17T03:45:52.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9ebf841740 1 -- 172.21.15.146:0/1137726056 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=145,monmap=2+}) -- 0x556c58617f70 con 0x556c584b6730 2024-09-17T03:45:52.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9e917fa640 1 -- 172.21.15.146:0/1137726056 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ea8018070 con 0x556c584b6730 2024-09-17T03:45:52.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9e917fa640 1 -- 172.21.15.146:0/1137726056 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 145) ==== 3502+0+0 (secure 0 0 0) 0x7f9ea005a020 con 0x556c584b6730 2024-09-17T03:45:52.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9ebf841740 10 client.11289 fetch_fsmap finished waiting for FSMap version 145 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9ebf841740 10 client.11289 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9ebf841740 20 client.11289 populate_metadata read hostname 'smithi146' 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9ebf841740 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x556c584961f0 0x556c588bc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9ebf841740 4 client.11289 mds_command: new command op to 11100 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9ebf841740 1 -- 172.21.15.146:0/1137726056 --> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c587f4070 con 0x556c584961f0 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9eb658d640 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x556c584961f0 0x556c588bc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.550+0000 7f9e917fa640 10 client.11289 ms_handle_connect on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9eb658d640 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x556c584961f0 0x556c588bc3a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea0c84cf8f9854b1 server_cookie=27e64d7362352a1d in_seq=0 out_seq=0 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9e917fa640 1 -- 172.21.15.146:0/1137726056 <== mds.0 v2:172.21.15.146:6833/2793356470 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c587f4070 con 0x556c584961f0 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9e917fa640 10 client.11289 handle_command_reply: tid=0 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9ebf841740 1 client.11289 shutdown 2024-09-17T03:45:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9ebf841740 1 -- 172.21.15.146:0/1137726056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 msgr2=0x556c5887ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9ebf841740 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c5887ef60 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0006010 tx=0x7f9ea0009260 comp rx=0 tx=0).stop 2024-09-17T03:45:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9ebf841740 1 -- 172.21.15.146:0/1137726056 shutdown_connections 2024-09-17T03:45:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9ebf841740 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x556c584961f0 0x556c588bc3a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9ebf841740 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584d7410 0x556c58894390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9e917fa640 0 client.11289 ms_handle_reset on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9ebf841740 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c5887ef60 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.551+0000 7f9ebf841740 1 --2- 172.21.15.146:0/1137726056 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584ae550 0x556c588885c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.552+0000 7f9ebf841740 1 -- 172.21.15.146:0/1137726056 >> 172.21.15.146:0/1137726056 conn(0x556c584cb560 msgr2=0x556c5887a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.552+0000 7f9ebf841740 1 -- 172.21.15.146:0/1137726056 shutdown_connections 2024-09-17T03:45:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.552+0000 7f9ebf841740 1 -- 172.21.15.146:0/1137726056 wait complete. 2024-09-17T03:45:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.552+0000 7f9ebf841740 20 client.11289 trim_cache size 0 max 16384 2024-09-17T03:45:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.569+0000 7f9ebf841740 1 Processor -- start 2024-09-17T03:45:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.569+0000 7f9ebf841740 1 -- start start 2024-09-17T03:45:52.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584961f0 0x556c58898180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584ae550 0x556c588c5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c58880370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9ebf841740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb0202440 con 0x556c584b6730 2024-09-17T03:45:52.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9ebf841740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb015aee0 con 0x556c584ae550 2024-09-17T03:45:52.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9ebf841740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb015a250 con 0x556c584961f0 2024-09-17T03:45:52.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb6d8e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c58880370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb6d8e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c58880370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38812/0 (socket says 172.21.15.146:38812) 2024-09-17T03:45:52.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb6d8e640 1 -- 172.21.15.146:0/1770229105 learned_addr learned my addr 172.21.15.146:0/1770229105 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb658d640 1 --2- 172.21.15.146:0/1770229105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584961f0 0x556c58898180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb5d8c640 1 --2- 172.21.15.146:0/1770229105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584ae550 0x556c588c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb6d8e640 1 -- 172.21.15.146:0/1770229105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584961f0 msgr2=0x556c58898180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb6d8e640 1 --2- 172.21.15.146:0/1770229105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584961f0 0x556c58898180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb6d8e640 1 -- 172.21.15.146:0/1770229105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584ae550 msgr2=0x556c588c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb6d8e640 1 --2- 172.21.15.146:0/1770229105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584ae550 0x556c588c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb6d8e640 1 -- 172.21.15.146:0/1770229105 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c588c5fd0 con 0x556c584b6730 2024-09-17T03:45:52.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb658d640 1 --2- 172.21.15.146:0/1770229105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584961f0 0x556c58898180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:45:52.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9eb6d8e640 1 --2- 172.21.15.146:0/1770229105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c58880370 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x556c58881ba0 tx=0x7f9ea8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905f9a31a78c4671 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9e937fe640 1 -- 172.21.15.146:0/1770229105 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8007020 con 0x556c584b6730 2024-09-17T03:45:52.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9e937fe640 1 -- 172.21.15.146:0/1770229105 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ea8018030 con 0x556c584b6730 2024-09-17T03:45:52.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.571+0000 7f9e937fe640 1 -- 172.21.15.146:0/1770229105 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8007460 con 0x556c584b6730 2024-09-17T03:45:52.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.572+0000 7f9ebf841740 1 -- 172.21.15.146:0/1770229105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 msgr2=0x556c58880370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.572+0000 7f9ebf841740 1 --2- 172.21.15.146:0/1770229105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c58880370 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x556c58881ba0 tx=0x7f9ea8000ed0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.572+0000 7f9ebf841740 1 -- 172.21.15.146:0/1770229105 shutdown_connections 2024-09-17T03:45:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.572+0000 7f9ebf841740 1 --2- 172.21.15.146:0/1770229105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584b6730 0x556c58880370 unknown :-1 s=CLOSED pgs=2459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.572+0000 7f9ebf841740 1 --2- 172.21.15.146:0/1770229105 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584ae550 0x556c588c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.572+0000 7f9ebf841740 1 --2- 172.21.15.146:0/1770229105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584961f0 0x556c58898180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.572+0000 7f9ebf841740 1 -- 172.21.15.146:0/1770229105 >> 172.21.15.146:0/1770229105 conn(0x556c584cb560 msgr2=0x556c588a79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.572+0000 7f9ebf841740 1 -- 172.21.15.146:0/1770229105 shutdown_connections 2024-09-17T03:45:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.572+0000 7f9ebf841740 1 -- 172.21.15.146:0/1770229105 wait complete. 2024-09-17T03:45:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.573+0000 7f9ebf841740 1 -- start start 2024-09-17T03:45:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.573+0000 7f9ebf841740 1 Processor -- start 2024-09-17T03:45:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584961f0 0x556c5892cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584ae550 0x556c588bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9ebf841740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584b6730 0x556c588bd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9ebf841740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x556c588a8170 con 0x556c584ae550 2024-09-17T03:45:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9ebf841740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb015a870 con 0x556c584b6730 2024-09-17T03:45:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9ebf841740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x556c58944990 con 0x556c584961f0 2024-09-17T03:45:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9ebf841740 10 client.0 _ll_register_callbacks cb 0x7f9ea0040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:45:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9eb5d8c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584ae550 0x556c588bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9eb5d8c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584ae550 0x556c588bc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38820/0 (socket says 172.21.15.146:38820) 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9eb5d8c640 1 -- 172.21.15.146:0/4194707847 learned_addr learned my addr 172.21.15.146:0/4194707847 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9eb658d640 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584961f0 0x556c5892cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9eb6d8e640 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584b6730 0x556c588bd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9eb5d8c640 1 -- 172.21.15.146:0/4194707847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584961f0 msgr2=0x556c5892cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9eb5d8c640 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584961f0 0x556c5892cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9eb5d8c640 1 -- 172.21.15.146:0/4194707847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584b6730 msgr2=0x556c588bd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9eb5d8c640 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584b6730 0x556c588bd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9eb5d8c640 1 -- 172.21.15.146:0/4194707847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c58520720 con 0x556c584ae550 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9eb5d8c640 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584ae550 0x556c588bc980 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f9ea003f040 tx=0x7f9ea0005440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201410500a264b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9e917fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9e917fa640 1 -- 172.21.15.146:0/4194707847 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0060060 con 0x556c584ae550 2024-09-17T03:45:52.581 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9e917fa640 1 -- 172.21.15.146:0/4194707847 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f9ea0004ea0 con 0x556c584ae550 2024-09-17T03:45:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.575+0000 7f9ebf841740 1 -- 172.21.15.146:0/4194707847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ea8018030 con 0x556c584ae550 2024-09-17T03:45:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9e917fa640 1 -- 172.21.15.146:0/4194707847 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=145) ==== 24+0+0 (secure 0 0 0) 0x7f9ea0066050 con 0x556c584ae550 2024-09-17T03:45:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9ebf841740 10 client.11295 fetch_fsmap learned FSMap version 145 2024-09-17T03:45:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9ebf841740 1 -- 172.21.15.146:0/4194707847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=145,monmap=2+}) -- 0x556c588becb0 con 0x556c584ae550 2024-09-17T03:45:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9e917fa640 1 -- 172.21.15.146:0/4194707847 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ea8018030 con 0x556c584ae550 2024-09-17T03:45:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9e917fa640 1 -- 172.21.15.146:0/4194707847 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 145) ==== 3502+0+0 (secure 0 0 0) 0x7f9ea0069020 con 0x556c584ae550 2024-09-17T03:45:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9ebf841740 10 client.11295 fetch_fsmap finished waiting for FSMap version 145 2024-09-17T03:45:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9ebf841740 10 client.11295 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-17T03:45:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9ebf841740 20 client.11295 populate_metadata read hostname 'smithi146' 2024-09-17T03:45:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9ebf841740 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x556c5846b630 0x556c588bda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.582 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9ebf841740 4 client.11295 mds_command: new command op to 11100 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9ebf841740 1 -- 172.21.15.146:0/4194707847 --> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x556c588baf90 con 0x556c5846b630 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9eb658d640 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x556c5846b630 0x556c588bda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.576+0000 7f9e917fa640 10 client.11295 ms_handle_connect on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.577+0000 7f9eb658d640 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x556c5846b630 0x556c588bda00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92f7f21cdc9335ae server_cookie=3aaf68fa396d4768 in_seq=0 out_seq=0 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9e917fa640 1 -- 172.21.15.146:0/4194707847 <== mds.0 v2:172.21.15.146:6833/2793356470 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556c588baf90 con 0x556c5846b630 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9e917fa640 10 client.11295 handle_command_reply: tid=0 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 1 client.11295 shutdown 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 1 -- 172.21.15.146:0/4194707847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584ae550 msgr2=0x556c588bc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584ae550 0x556c588bc980 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f9ea003f040 tx=0x7f9ea0005440 comp rx=0 tx=0).stop 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 1 -- 172.21.15.146:0/4194707847 shutdown_connections 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x556c5846b630 0x556c588bda00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556c584b6730 0x556c588bd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c584ae550 0x556c588bc980 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9e917fa640 0 client.11295 ms_handle_reset on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 1 --2- 172.21.15.146:0/4194707847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556c584961f0 0x556c5892cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 1 -- 172.21.15.146:0/4194707847 >> 172.21.15.146:0/4194707847 conn(0x556c584cb560 msgr2=0x556c588a79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 1 -- 172.21.15.146:0/4194707847 shutdown_connections 2024-09-17T03:45:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 1 -- 172.21.15.146:0/4194707847 wait complete. 2024-09-17T03:45:52.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.578+0000 7f9ebf841740 20 client.11295 trim_cache size 0 max 16384 2024-09-17T03:45:52.584 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:45:52.585 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:45:52.585 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "2f5cfe06-8f74-4574-b046-5ffca103e801", 2024-09-17T03:45:52.585 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:45:52.585 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:45:52.585 INFO:tasks.ceph.mds.a.smithi146.stderr:2024-09-17T03:45:52.579+0000 7fdc9ce4c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 pv8 ap=4 DIRTYPARENT s=5242880 n(v0 rc2024-09-17T03:45:51.508810+0000 b5242880 1=1+0)->n(v0 rc2024-09-17T03:45:51.511810+0000 b6291456 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={8663=0-12582912@1} caps={8663=pAsxLsXsxFcb/pAsxXsxFxwb@5},l=8663 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x5629e15a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(29)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T03:45:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 -- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e94078b90 msgr2=0x7f9e9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e94078b90 0x7f9e9407b0a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0033000 tx=0x7f9ea0004730 comp rx=0 tx=0).stop 2024-09-17T03:45:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 -- 172.21.15.146:0/2742850680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb0074000 msgr2=0x7f9eb014c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb0074000 0x7f9eb014c050 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00eb60 tx=0x7f9eac00c6a0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 -- 172.21.15.146:0/2742850680 shutdown_connections 2024-09-17T03:45:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9e94078b90 0x7f9e9407b0a0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9eb015ba00 0x7f9eb006cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9eb00b0c50 0x7f9eb01f9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 --2- 172.21.15.146:0/2742850680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eb0074000 0x7f9eb014c050 unknown :-1 s=CLOSED pgs=2456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 -- 172.21.15.146:0/2742850680 >> 172.21.15.146:0/2742850680 conn(0x7f9eb006de90 msgr2=0x7f9eb015bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 -- 172.21.15.146:0/2742850680 shutdown_connections 2024-09-17T03:45:52.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.579+0000 7f9eb87f1640 1 -- 172.21.15.146:0/2742850680 wait complete. 2024-09-17T03:45:52.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:45:52.591 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-17T03:45:52.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.706+0000 7f4ec5f39640 1 -- 172.21.15.146:0/414058011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ec00d31e0 msgr2=0x7f4ec00cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.706+0000 7f4ec5f39640 1 --2- 172.21.15.146:0/414058011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ec00d31e0 0x7f4ec00cebc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009820 tx=0x7f4eb002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.707+0000 7f4ec5f39640 1 -- 172.21.15.146:0/414058011 shutdown_connections 2024-09-17T03:45:52.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.707+0000 7f4ec5f39640 1 --2- 172.21.15.146:0/414058011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ec00d1220 0x7f4ec00b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.707+0000 7f4ec5f39640 1 --2- 172.21.15.146:0/414058011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ec00d31e0 0x7f4ec00cebc0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.707+0000 7f4ec5f39640 1 -- 172.21.15.146:0/414058011 >> 172.21.15.146:0/414058011 conn(0x7f4ec00d26c0 msgr2=0x7f4ec00d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.707+0000 7f4ec5f39640 1 -- 172.21.15.146:0/414058011 shutdown_connections 2024-09-17T03:45:52.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.707+0000 7f4ec5f39640 1 -- 172.21.15.146:0/414058011 wait complete. 2024-09-17T03:45:52.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.708+0000 7f4ec5f39640 1 Processor -- start 2024-09-17T03:45:52.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.709+0000 7f4ec5f39640 1 -- start start 2024-09-17T03:45:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ec5f39640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ec00d31e0 0x7f4ec00cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ec5f39640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ec015cbe0 0x7f4ec009f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ec5f39640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ec009fde0 0x7f4ec009d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ec5f39640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00b64b0 con 0x7f4ec015cbe0 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ec5f39640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00b6330 con 0x7f4ec00d31e0 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ec5f39640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec00b6630 con 0x7f4ec009fde0 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ebeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ec015cbe0 0x7f4ec009f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ebeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ec015cbe0 0x7f4ec009f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38826/0 (socket says 172.21.15.146:38826) 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ebeffd640 1 -- 172.21.15.146:0/266157501 learned_addr learned my addr 172.21.15.146:0/266157501 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ec00d31e0 0x7f4ec00cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ebffff640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ec009fde0 0x7f4ec009d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ebeffd640 1 -- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ec009fde0 msgr2=0x7f4ec009d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ebeffd640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ec009fde0 0x7f4ec009d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ebeffd640 1 -- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ec00d31e0 msgr2=0x7f4ec00cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ebeffd640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ec00d31e0 0x7f4ec00cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ebeffd640 1 -- 172.21.15.146:0/266157501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec00cc960 con 0x7f4ec015cbe0 2024-09-17T03:45:52.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.710+0000 7f4ebeffd640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ec015cbe0 0x7f4ec009f8a0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c500 tx=0x7f4ea800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.711+0000 7f4eb7fff640 1 -- 172.21.15.146:0/266157501 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8016020 con 0x7f4ec015cbe0 2024-09-17T03:45:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.711+0000 7f4eb7fff640 1 -- 172.21.15.146:0/266157501 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ea8012940 con 0x7f4ec015cbe0 2024-09-17T03:45:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.711+0000 7f4ec5f39640 1 -- 172.21.15.146:0/266157501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec00cc0c0 con 0x7f4ec015cbe0 2024-09-17T03:45:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.711+0000 7f4eb7fff640 1 -- 172.21.15.146:0/266157501 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8012d90 con 0x7f4ec015cbe0 2024-09-17T03:45:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.711+0000 7f4ec5f39640 1 -- 172.21.15.146:0/266157501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec00cc680 con 0x7f4ec015cbe0 2024-09-17T03:45:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.712+0000 7f4eb7fff640 1 -- 172.21.15.146:0/266157501 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4ea8019020 con 0x7f4ec015cbe0 2024-09-17T03:45:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.713+0000 7f4eb7fff640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ea0078b90 0x7f4ea007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.713+0000 7f4eb7fff640 1 -- 172.21.15.146:0/266157501 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f4ea809ab40 con 0x7f4ec015cbe0 2024-09-17T03:45:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.713+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ea0078b90 0x7f4ea007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.714+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ea0078b90 0x7f4ea007b0a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0034000 tx=0x7f4eb0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.714+0000 7f4eccea8740 1 Processor -- start 2024-09-17T03:45:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.714+0000 7f4eccea8740 1 -- start start 2024-09-17T03:45:52.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.715+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c993390390 0x55c99377ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.715+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9933674d0 0x55c993751860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.715+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c99336f6b0 0x55c993751da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.715+0000 7f4eccea8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c9936aaa60 con 0x55c993390390 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.715+0000 7f4eccea8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c993699e90 con 0x55c9933674d0 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.715+0000 7f4eccea8740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c99369dca0 con 0x55c99336f6b0 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.715+0000 7f4ebf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c993390390 0x55c99377ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4ebf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c993390390 0x55c99377ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38842/0 (socket says 172.21.15.146:38842) 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4ebf7fe640 1 -- 172.21.15.146:0/831090696 learned_addr learned my addr 172.21.15.146:0/831090696 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4ebffff640 1 --2- 172.21.15.146:0/831090696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c99336f6b0 0x55c993751da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4ebeffd640 1 --2- 172.21.15.146:0/831090696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9933674d0 0x55c993751860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4ebf7fe640 1 -- 172.21.15.146:0/831090696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c99336f6b0 msgr2=0x55c993751da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/831090696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c99336f6b0 0x55c993751da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4ebf7fe640 1 -- 172.21.15.146:0/831090696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9933674d0 msgr2=0x55c993751860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/831090696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9933674d0 0x55c993751860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4ebf7fe640 1 -- 172.21.15.146:0/831090696 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9934727d0 con 0x55c993390390 2024-09-17T03:45:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/831090696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c993390390 0x55c99377ca10 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0004480 tx=0x7f4eb003e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20e632d74ef1d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4eb57fa640 1 -- 172.21.15.146:0/831090696 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0003e30 con 0x55c993390390 2024-09-17T03:45:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4eb57fa640 1 -- 172.21.15.146:0/831090696 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4eb0005140 con 0x55c993390390 2024-09-17T03:45:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.716+0000 7f4eb57fa640 1 -- 172.21.15.146:0/831090696 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0005570 con 0x55c993390390 2024-09-17T03:45:52.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.717+0000 7f4eccea8740 1 -- 172.21.15.146:0/831090696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c993390390 msgr2=0x55c99377ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.717+0000 7f4eccea8740 1 --2- 172.21.15.146:0/831090696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c993390390 0x55c99377ca10 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0004480 tx=0x7f4eb003e070 comp rx=0 tx=0).stop 2024-09-17T03:45:52.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.717+0000 7f4eccea8740 1 -- 172.21.15.146:0/831090696 shutdown_connections 2024-09-17T03:45:52.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.717+0000 7f4eccea8740 1 --2- 172.21.15.146:0/831090696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c99336f6b0 0x55c993751da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.723 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.717+0000 7f4eccea8740 1 --2- 172.21.15.146:0/831090696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9933674d0 0x55c993751860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.717+0000 7f4eccea8740 1 --2- 172.21.15.146:0/831090696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c993390390 0x55c99377ca10 unknown :-1 s=CLOSED pgs=2463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.717+0000 7f4eccea8740 1 -- 172.21.15.146:0/831090696 >> 172.21.15.146:0/831090696 conn(0x55c9933844e0 msgr2=0x55c993737d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.717+0000 7f4eccea8740 1 -- 172.21.15.146:0/831090696 shutdown_connections 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.717+0000 7f4eccea8740 1 -- 172.21.15.146:0/831090696 wait complete. 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.718+0000 7f4eccea8740 1 -- start start 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.718+0000 7f4eccea8740 1 Processor -- start 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.719+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9933674d0 0x55c993773870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.719+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937766f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.719+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c993390390 0x55c993777fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.719+0000 7f4eccea8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c99340a740 con 0x55c99336f6b0 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.719+0000 7f4eccea8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c99363f970 con 0x55c9933674d0 2024-09-17T03:45:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.719+0000 7f4eccea8740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c993776c30 con 0x55c993390390 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.719+0000 7f4eccea8740 10 client.0 _ll_register_callbacks cb 0x55c99364e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.719+0000 7f4ebeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937766f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.719+0000 7f4ebeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937766f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38852/0 (socket says 172.21.15.146:38852) 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.719+0000 7f4ebeffd640 1 -- 172.21.15.146:0/3026553115 learned_addr learned my addr 172.21.15.146:0/3026553115 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4ebffff640 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c993390390 0x55c993777fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9933674d0 0x55c993773870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4ebeffd640 1 -- 172.21.15.146:0/3026553115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c993390390 msgr2=0x55c993777fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4ebeffd640 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c993390390 0x55c993777fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4ebeffd640 1 -- 172.21.15.146:0/3026553115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9933674d0 msgr2=0x55c993773870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4ebeffd640 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9933674d0 0x55c993773870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4ebeffd640 1 -- 172.21.15.146:0/3026553115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9933fb970 con 0x55c99336f6b0 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9933674d0 0x55c993773870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:45:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4ebeffd640 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937766f0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80990a0 tx=0x7f4ea80621b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53f5cfeb0e9d3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4e9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/3026553115 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8087070 con 0x55c99336f6b0 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/3026553115 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f4ea805e270 con 0x55c99336f6b0 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4eccea8740 1 -- 172.21.15.146:0/3026553115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4eb0005140 con 0x55c99336f6b0 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/3026553115 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=145) ==== 24+0+0 (secure 0 0 0) 0x7f4ea8067020 con 0x55c99336f6b0 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4eccea8740 10 client.11307 fetch_fsmap learned FSMap version 145 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4eccea8740 1 -- 172.21.15.146:0/3026553115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=145,monmap=2+}) -- 0x55c9933d96a0 con 0x55c99336f6b0 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/3026553115 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4eb0005140 con 0x55c99336f6b0 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.720+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/3026553115 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 145) ==== 3502+0+0 (secure 0 0 0) 0x7f4ea805e470 con 0x55c99336f6b0 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.721+0000 7f4eccea8740 10 client.11307 fetch_fsmap finished waiting for FSMap version 145 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.721+0000 7f4eccea8740 10 client.11307 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-17T03:45:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.721+0000 7f4eccea8740 20 client.11307 populate_metadata read hostname 'smithi146' 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.721+0000 7f4eccea8740 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x55c99334ef60 0x55c99378f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.721+0000 7f4eccea8740 4 client.11307 mds_command: new command op to 11100 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.721+0000 7f4eccea8740 1 -- 172.21.15.146:0/3026553115 --> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9936ac9b0 con 0x55c99334ef60 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.721+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x55c99334ef60 0x55c99378f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.721+0000 7f4e9e7fc640 10 client.11307 ms_handle_connect on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.721+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x55c99334ef60 0x55c99378f6d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a884fb7cc323dff server_cookie=f686933e204318ee in_seq=0 out_seq=0 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/3026553115 <== mds.0 v2:172.21.15.146:6833/2793356470 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c9936ac9b0 con 0x55c99334ef60 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4e9e7fc640 10 client.11307 handle_command_reply: tid=0 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 1 client.11307 shutdown 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 1 -- 172.21.15.146:0/3026553115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 msgr2=0x55c9937766f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937766f0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80990a0 tx=0x7f4ea80621b0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 1 -- 172.21.15.146:0/3026553115 shutdown_connections 2024-09-17T03:45:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x55c99334ef60 0x55c99378f6d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c993390390 0x55c993777fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4e9e7fc640 0 client.11307 ms_handle_reset on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937766f0 unknown :-1 s=CLOSED pgs=2464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 1 --2- 172.21.15.146:0/3026553115 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c9933674d0 0x55c993773870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 1 -- 172.21.15.146:0/3026553115 >> 172.21.15.146:0/3026553115 conn(0x55c9933844e0 msgr2=0x55c993751d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 1 -- 172.21.15.146:0/3026553115 shutdown_connections 2024-09-17T03:45:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 1 -- 172.21.15.146:0/3026553115 wait complete. 2024-09-17T03:45:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.722+0000 7f4eccea8740 20 client.11307 trim_cache size 0 max 16384 2024-09-17T03:45:52.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.739+0000 7f4eccea8740 1 Processor -- start 2024-09-17T03:45:52.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.740+0000 7f4eccea8740 1 -- start start 2024-09-17T03:45:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c9933674d0 0x55c993750a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c99336f6b0 0x55c993732b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c993390390 0x55c993761e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4eccea8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec01fffe0 con 0x55c9933674d0 2024-09-17T03:45:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4eccea8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec01ff000 con 0x55c99336f6b0 2024-09-17T03:45:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4eccea8740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec00ca5d0 con 0x55c993390390 2024-09-17T03:45:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4ebf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c9933674d0 0x55c993750a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4ebf7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c9933674d0 0x55c993750a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38856/0 (socket says 172.21.15.146:38856) 2024-09-17T03:45:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4ebf7fe640 1 -- 172.21.15.146:0/2193615769 learned_addr learned my addr 172.21.15.146:0/2193615769 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4ebeffd640 1 --2- 172.21.15.146:0/2193615769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c99336f6b0 0x55c993732b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4ebffff640 1 --2- 172.21.15.146:0/2193615769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c993390390 0x55c993761e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4ebf7fe640 1 -- 172.21.15.146:0/2193615769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c993390390 msgr2=0x55c993761e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/2193615769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c993390390 0x55c993761e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4ebf7fe640 1 -- 172.21.15.146:0/2193615769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c99336f6b0 msgr2=0x55c993732b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/2193615769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c99336f6b0 0x55c993732b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4ebf7fe640 1 -- 172.21.15.146:0/2193615769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c993776240 con 0x55c9933674d0 2024-09-17T03:45:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.741+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/2193615769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c9933674d0 0x55c993750a10 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f4eb002a4e0 tx=0x7f4eb003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceff598e00a6f1dd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.742+0000 7f4eb4ff9640 1 -- 172.21.15.146:0/2193615769 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0005340 con 0x55c9933674d0 2024-09-17T03:45:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.742+0000 7f4eb4ff9640 1 -- 172.21.15.146:0/2193615769 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4eb00054e0 con 0x55c9933674d0 2024-09-17T03:45:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.742+0000 7f4eb4ff9640 1 -- 172.21.15.146:0/2193615769 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00056b0 con 0x55c9933674d0 2024-09-17T03:45:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.742+0000 7f4eccea8740 1 -- 172.21.15.146:0/2193615769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c9933674d0 msgr2=0x55c993750a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.742+0000 7f4eccea8740 1 --2- 172.21.15.146:0/2193615769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c9933674d0 0x55c993750a10 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f4eb002a4e0 tx=0x7f4eb003e000 comp rx=0 tx=0).stop 2024-09-17T03:45:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.743+0000 7f4eccea8740 1 -- 172.21.15.146:0/2193615769 shutdown_connections 2024-09-17T03:45:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.743+0000 7f4eccea8740 1 --2- 172.21.15.146:0/2193615769 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c993390390 0x55c993761e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.743+0000 7f4eccea8740 1 --2- 172.21.15.146:0/2193615769 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c99336f6b0 0x55c993732b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.743+0000 7f4eccea8740 1 --2- 172.21.15.146:0/2193615769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c9933674d0 0x55c993750a10 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.743+0000 7f4eccea8740 1 -- 172.21.15.146:0/2193615769 >> 172.21.15.146:0/2193615769 conn(0x55c9933844e0 msgr2=0x55c993751620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.743+0000 7f4eccea8740 1 -- 172.21.15.146:0/2193615769 shutdown_connections 2024-09-17T03:45:52.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.743+0000 7f4eccea8740 1 -- 172.21.15.146:0/2193615769 wait complete. 2024-09-17T03:45:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.743+0000 7f4eccea8740 1 -- start start 2024-09-17T03:45:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.743+0000 7f4eccea8740 1 Processor -- start 2024-09-17T03:45:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9933674d0 0x55c9937778a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4eccea8740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c993390390 0x55c99375e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4eccea8740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec01feb50 con 0x55c99336f6b0 2024-09-17T03:45:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4eccea8740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c99375f9d0 con 0x55c993390390 2024-09-17T03:45:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4eccea8740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c9937a1480 con 0x55c9933674d0 2024-09-17T03:45:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4eccea8740 10 client.0 _ll_register_callbacks cb 0x7f4ea800c450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:45:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4ebeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4ebeffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38858/0 (socket says 172.21.15.146:38858) 2024-09-17T03:45:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4ebeffd640 1 -- 172.21.15.146:0/802554686 learned_addr learned my addr 172.21.15.146:0/802554686 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:45:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9933674d0 0x55c9937778a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4ebffff640 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c993390390 0x55c99375e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4ebeffd640 1 -- 172.21.15.146:0/802554686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9933674d0 msgr2=0x55c9937778a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4ebeffd640 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9933674d0 0x55c9937778a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4ebeffd640 1 -- 172.21.15.146:0/802554686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c993390390 msgr2=0x55c99375e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4ebeffd640 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c993390390 0x55c99375e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4ebeffd640 1 -- 172.21.15.146:0/802554686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9938046c0 con 0x55c99336f6b0 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4ebeffd640 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937ffc70 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800cec0 tx=0x7f4ea8061fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f248d2eccd000a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4e9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/802554686 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8087050 con 0x55c99336f6b0 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4eccea8740 1 -- 172.21.15.146:0/802554686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4eb00054e0 con 0x55c99336f6b0 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.745+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/802554686 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f4ea806dbb0 con 0x55c99336f6b0 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/802554686 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=145) ==== 24+0+0 (secure 0 0 0) 0x7f4ea804a0b0 con 0x55c99336f6b0 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4eccea8740 10 client.11313 fetch_fsmap learned FSMap version 145 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4eccea8740 1 -- 172.21.15.146:0/802554686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=145,monmap=2+}) -- 0x55c9937a0c80 con 0x55c99336f6b0 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/802554686 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4eb00054e0 con 0x55c99336f6b0 2024-09-17T03:45:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/802554686 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 145) ==== 3502+0+0 (secure 0 0 0) 0x7f4ea80615f0 con 0x55c99336f6b0 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4eccea8740 10 client.11313 fetch_fsmap finished waiting for FSMap version 145 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4eccea8740 10 client.11313 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4eccea8740 20 client.11313 populate_metadata read hostname 'smithi146' 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4eccea8740 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x55c99375ea90 0x55c9938037c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4eccea8740 4 client.11313 mds_command: new command op to 11100 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4eccea8740 1 -- 172.21.15.146:0/802554686 --> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c9936a8460 con 0x55c99375ea90 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x55c99375ea90 0x55c9938037c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4e9e7fc640 10 client.11313 ms_handle_connect on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.746+0000 7f4ebf7fe640 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x55c99375ea90 0x55c9938037c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b1f3d5e3371316b server_cookie=328b5df76d5f8730 in_seq=0 out_seq=0 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4e9e7fc640 1 -- 172.21.15.146:0/802554686 <== mds.0 v2:172.21.15.146:6833/2793356470 1 ==== command_reply(tid 0: 0 ) ==== 8+0+571 (crc 0 0 0) 0x55c9936a8460 con 0x55c99375ea90 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4e9e7fc640 10 client.11313 handle_command_reply: tid=0 2024-09-17T03:45:52.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 1 client.11313 shutdown 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 1 -- 172.21.15.146:0/802554686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 msgr2=0x55c9937ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937ffc70 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800cec0 tx=0x7f4ea8061fa0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 1 -- 172.21.15.146:0/802554686 shutdown_connections 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x55c99375ea90 0x55c9938037c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c993390390 0x55c99375e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c99336f6b0 0x55c9937ffc70 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4e9e7fc640 0 client.11313 ms_handle_reset on v2:172.21.15.146:6833/2793356470 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 1 --2- 172.21.15.146:0/802554686 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c9933674d0 0x55c9937778a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 1 -- 172.21.15.146:0/802554686 >> 172.21.15.146:0/802554686 conn(0x55c9933844e0 msgr2=0x55c993761e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 1 -- 172.21.15.146:0/802554686 shutdown_connections 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 1 -- 172.21.15.146:0/802554686 wait complete. 2024-09-17T03:45:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4eccea8740 20 client.11313 trim_cache size 0 max 16384 2024-09-17T03:45:52.755 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:45:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:45:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:45:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "2f5cfe06-8f74-4574-b046-5ffca103e801": { 2024-09-17T03:45:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:45:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "2f5cfe06-8f74-4574-b046-5ffca103e801", 2024-09-17T03:45:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive,repair" 2024-09-17T03:45:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:45:52.755 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:45:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "2f5cfe06-8f74-4574-b046-5ffca103e801": { 2024-09-17T03:45:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:45:52.577793+0000", 2024-09-17T03:45:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:45:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:45:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:45:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:45:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:45:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:52.756 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:45:52.756 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:45:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4ec5f39640 1 -- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ea0078b90 msgr2=0x7f4ea007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4ec5f39640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ea0078b90 0x7f4ea007b0a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0034000 tx=0x7f4eb0004730 comp rx=0 tx=0).stop 2024-09-17T03:45:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4ec5f39640 1 -- 172.21.15.146:0/266157501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ec015cbe0 msgr2=0x7f4ec009f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:45:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.747+0000 7f4ec5f39640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ec015cbe0 0x7f4ec009f8a0 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c500 tx=0x7f4ea800c9c0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.748+0000 7f4ec5f39640 1 -- 172.21.15.146:0/266157501 shutdown_connections 2024-09-17T03:45:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.748+0000 7f4ec5f39640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4ea0078b90 0x7f4ea007b0a0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.748+0000 7f4ec5f39640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4ec009fde0 0x7f4ec009d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.748+0000 7f4ec5f39640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ec015cbe0 0x7f4ec009f8a0 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.748+0000 7f4ec5f39640 1 --2- 172.21.15.146:0/266157501 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4ec00d31e0 0x7f4ec00cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:45:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.748+0000 7f4ec5f39640 1 -- 172.21.15.146:0/266157501 >> 172.21.15.146:0/266157501 conn(0x7f4ec00d26c0 msgr2=0x7f4ec00c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:45:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.748+0000 7f4ec5f39640 1 -- 172.21.15.146:0/266157501 shutdown_connections 2024-09-17T03:45:52.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:45:52.748+0000 7f4ec5f39640 1 -- 172.21.15.146:0/266157501 wait complete. 2024-09-17T03:45:52.759 INFO:tasks.cephfs.filesystem:scrub status for tag:2f5cfe06-8f74-4574-b046-5ffca103e801 - {'path': '/', 'tag': '2f5cfe06-8f74-4574-b046-5ffca103e801', 'options': 'recursive,repair'} 2024-09-17T03:46:00.030 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:46:00.033 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:46:22.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:22.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-17T03:46:22.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.892+0000 7f162a85c640 1 -- 172.21.15.146:0/1648502624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16241617a0 msgr2=0x7f1624163bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:22.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.892+0000 7f162a85c640 1 --2- 172.21.15.146:0/1648502624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16241617a0 0x7f1624163bc0 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 crypto rx=0x7f16240d1900 tx=0x7f161802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.892+0000 7f162a85c640 1 -- 172.21.15.146:0/1648502624 shutdown_connections 2024-09-17T03:46:22.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.892+0000 7f162a85c640 1 --2- 172.21.15.146:0/1648502624 >> v2:172.21.15.179:3300/0 conn(0x7f1624164100 0x7f1624166520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.892+0000 7f162a85c640 1 --2- 172.21.15.146:0/1648502624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16241617a0 0x7f1624163bc0 unknown :-1 s=CLOSED pgs=2467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.892+0000 7f162a85c640 1 -- 172.21.15.146:0/1648502624 >> 172.21.15.146:0/1648502624 conn(0x7f16240b41b0 msgr2=0x7f16240b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:22.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.892+0000 7f162a85c640 1 -- 172.21.15.146:0/1648502624 shutdown_connections 2024-09-17T03:46:22.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.892+0000 7f162a85c640 1 -- 172.21.15.146:0/1648502624 wait complete. 2024-09-17T03:46:22.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.894+0000 7f162a85c640 1 Processor -- start 2024-09-17T03:46:22.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.894+0000 7f162a85c640 1 -- start start 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.895+0000 7f162a85c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16241600b0 0x7f16241630d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.895+0000 7f162a85c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16241617a0 0x7f162415ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.895+0000 7f162a85c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1624164100 0x7f162415f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.895+0000 7f162a85c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1624166df0 con 0x7f16241617a0 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.895+0000 7f162a85c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1624166c70 con 0x7f16241600b0 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.895+0000 7f162a85c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1624166f70 con 0x7f1624164100 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.895+0000 7f16237fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16241617a0 0x7f162415ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.895+0000 7f16237fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16241617a0 0x7f162415ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57110/0 (socket says 172.21.15.146:57110) 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.895+0000 7f16237fe640 1 -- 172.21.15.146:0/2998854856 learned_addr learned my addr 172.21.15.146:0/2998854856 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.895+0000 7f1628df9640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1624164100 0x7f162415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.895+0000 7f1623fff640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16241600b0 0x7f16241630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.896+0000 7f16237fe640 1 -- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1624164100 msgr2=0x7f162415f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.896+0000 7f16237fe640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1624164100 0x7f162415f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.896+0000 7f16237fe640 1 -- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16241600b0 msgr2=0x7f16241630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.896+0000 7f16237fe640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16241600b0 0x7f16241630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.896+0000 7f16237fe640 1 -- 172.21.15.146:0/2998854856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16241f6f80 con 0x7f16241617a0 2024-09-17T03:46:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.896+0000 7f16237fe640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16241617a0 0x7f162415ece0 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f1618000c00 tx=0x7f1618003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.896+0000 7f1620ff9640 1 -- 172.21.15.146:0/2998854856 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161803e030 con 0x7f16241617a0 2024-09-17T03:46:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.896+0000 7f1620ff9640 1 -- 172.21.15.146:0/2998854856 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1618003d10 con 0x7f16241617a0 2024-09-17T03:46:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.896+0000 7f162a85c640 1 -- 172.21.15.146:0/2998854856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16241f7260 con 0x7f16241617a0 2024-09-17T03:46:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.896+0000 7f1620ff9640 1 -- 172.21.15.146:0/2998854856 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1618035040 con 0x7f16241617a0 2024-09-17T03:46:22.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.896+0000 7f162a85c640 1 -- 172.21.15.146:0/2998854856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16241f7820 con 0x7f16241617a0 2024-09-17T03:46:22.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.898+0000 7f1620ff9640 1 -- 172.21.15.146:0/2998854856 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1618041030 con 0x7f16241617a0 2024-09-17T03:46:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.899+0000 7f1620ff9640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1610078b90 0x7f161007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.899+0000 7f1620ff9640 1 -- 172.21.15.146:0/2998854856 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f16180bb350 con 0x7f16241617a0 2024-09-17T03:46:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.899+0000 7f1623fff640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1610078b90 0x7f161007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.899+0000 7f16317cb740 1 Processor -- start 2024-09-17T03:46:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.899+0000 7f1623fff640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1610078b90 0x7f161007b0a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1614007fd0 tx=0x7f1614009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:22.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.899+0000 7f16317cb740 1 -- start start 2024-09-17T03:46:22.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f16317cb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4cd390 0x5617ba8baa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f16317cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4a44d0 0x5617ba870530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f16317cb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4ac6b0 0x5617ba89b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f16317cb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5617ba7e7a60 con 0x5617ba4cd390 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f16317cb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5617ba7d6e90 con 0x5617ba4a44d0 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f16317cb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5617ba7daca0 con 0x5617ba4ac6b0 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1623fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4cd390 0x5617ba8baa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1623fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4cd390 0x5617ba8baa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57120/0 (socket says 172.21.15.146:57120) 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1623fff640 1 -- 172.21.15.146:0/722383353 learned_addr learned my addr 172.21.15.146:0/722383353 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f16237fe640 1 --2- 172.21.15.146:0/722383353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4a44d0 0x5617ba870530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1628df9640 1 --2- 172.21.15.146:0/722383353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4ac6b0 0x5617ba89b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1623fff640 1 -- 172.21.15.146:0/722383353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4ac6b0 msgr2=0x5617ba89b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:22.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1623fff640 1 --2- 172.21.15.146:0/722383353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4ac6b0 0x5617ba89b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1623fff640 1 -- 172.21.15.146:0/722383353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4a44d0 msgr2=0x5617ba870530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1623fff640 1 --2- 172.21.15.146:0/722383353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4a44d0 0x5617ba870530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1623fff640 1 -- 172.21.15.146:0/722383353 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ba5af7d0 con 0x5617ba4cd390 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1623fff640 1 --2- 172.21.15.146:0/722383353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4cd390 0x5617ba8baa50 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f161400f960 tx=0x7f1614012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddbbd3253585809 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1609ffb640 1 -- 172.21.15.146:0/722383353 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614025070 con 0x5617ba4cd390 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1609ffb640 1 -- 172.21.15.146:0/722383353 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f161401b050 con 0x5617ba4cd390 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.901+0000 7f1609ffb640 1 -- 172.21.15.146:0/722383353 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614014e40 con 0x5617ba4cd390 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.902+0000 7f16317cb740 1 -- 172.21.15.146:0/722383353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4cd390 msgr2=0x5617ba8baa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.902+0000 7f16317cb740 1 --2- 172.21.15.146:0/722383353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4cd390 0x5617ba8baa50 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f161400f960 tx=0x7f1614012000 comp rx=0 tx=0).stop 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.902+0000 7f16317cb740 1 -- 172.21.15.146:0/722383353 shutdown_connections 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.902+0000 7f16317cb740 1 --2- 172.21.15.146:0/722383353 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4ac6b0 0x5617ba89b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.902+0000 7f16317cb740 1 --2- 172.21.15.146:0/722383353 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4a44d0 0x5617ba870530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.902+0000 7f16317cb740 1 --2- 172.21.15.146:0/722383353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4cd390 0x5617ba8baa50 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.902+0000 7f16317cb740 1 -- 172.21.15.146:0/722383353 >> 172.21.15.146:0/722383353 conn(0x5617ba4c14e0 msgr2=0x5617ba874d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:22.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.902+0000 7f16317cb740 1 -- 172.21.15.146:0/722383353 shutdown_connections 2024-09-17T03:46:22.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.902+0000 7f16317cb740 1 -- 172.21.15.146:0/722383353 wait complete. 2024-09-17T03:46:22.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.903+0000 7f16317cb740 1 -- start start 2024-09-17T03:46:22.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.903+0000 7f16317cb740 1 Processor -- start 2024-09-17T03:46:22.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f16317cb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f16317cb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4ac6b0 0x5617ba8ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f16317cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4cd390 0x5617ba8cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f16317cb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5617ba547740 con 0x5617ba4a44d0 2024-09-17T03:46:22.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f16317cb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5617ba77c970 con 0x5617ba4cd390 2024-09-17T03:46:22.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f16317cb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5617ba8cf3c0 con 0x5617ba4ac6b0 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1623fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f16317cb740 10 client.0 _ll_register_callbacks cb 0x5617ba78b780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1623fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8d16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57136/0 (socket says 172.21.15.146:57136) 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1623fff640 1 -- 172.21.15.146:0/792473523 learned_addr learned my addr 172.21.15.146:0/792473523 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1628df9640 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4cd390 0x5617ba8cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f16237fe640 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4ac6b0 0x5617ba8ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1623fff640 1 -- 172.21.15.146:0/792473523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4ac6b0 msgr2=0x5617ba8ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1623fff640 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4ac6b0 0x5617ba8ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1623fff640 1 -- 172.21.15.146:0/792473523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4cd390 msgr2=0x5617ba8cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1623fff640 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4cd390 0x5617ba8cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1623fff640 1 -- 172.21.15.146:0/792473523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ba538970 con 0x5617ba4a44d0 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1623fff640 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8d16c0 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x5617ba8b3bd0 tx=0x7f1614020a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a577c5a61ff986 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.905+0000 7f1602ffd640 1 -- 172.21.15.146:0/792473523 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614025050 con 0x5617ba4a44d0 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f1602ffd640 1 -- 172.21.15.146:0/792473523 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f161402c450 con 0x5617ba4a44d0 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f16317cb740 1 -- 172.21.15.146:0/792473523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f161401b050 con 0x5617ba4a44d0 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f1602ffd640 1 -- 172.21.15.146:0/792473523 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=145) ==== 24+0+0 (secure 0 0 0) 0x7f1614039050 con 0x5617ba4a44d0 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f16317cb740 10 client.11325 fetch_fsmap learned FSMap version 145 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f16317cb740 1 -- 172.21.15.146:0/792473523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=145,monmap=2+}) -- 0x5617ba5166a0 con 0x5617ba4a44d0 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f1602ffd640 1 -- 172.21.15.146:0/792473523 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f161401b050 con 0x5617ba4a44d0 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f1602ffd640 1 -- 172.21.15.146:0/792473523 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 145) ==== 3502+0+0 (secure 0 0 0) 0x7f161403c020 con 0x5617ba4a44d0 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f16317cb740 10 client.11325 fetch_fsmap finished waiting for FSMap version 145 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f16317cb740 10 client.11325 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f16317cb740 20 client.11325 populate_metadata read hostname 'smithi146' 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f16317cb740 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5617ba48bf60 0x5617ba8cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f16317cb740 4 client.11325 mds_command: new command op to 11100 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f16317cb740 1 -- 172.21.15.146:0/792473523 --> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617ba7e99b0 con 0x5617ba48bf60 2024-09-17T03:46:22.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.906+0000 7f16237fe640 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5617ba48bf60 0x5617ba8cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f1602ffd640 10 client.11325 ms_handle_connect on v2:172.21.15.146:6833/2793356470 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f16237fe640 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5617ba48bf60 0x5617ba8cee10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb86e3fb3baa66bf server_cookie=3e1a2b9ed7e3bbf6 in_seq=0 out_seq=0 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f1602ffd640 1 -- 172.21.15.146:0/792473523 <== mds.0 v2:172.21.15.146:6833/2793356470 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5617ba7e99b0 con 0x5617ba48bf60 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f1602ffd640 10 client.11325 handle_command_reply: tid=0 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f16317cb740 1 client.11325 shutdown 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f16317cb740 1 -- 172.21.15.146:0/792473523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 msgr2=0x5617ba8d16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f16317cb740 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8d16c0 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x5617ba8b3bd0 tx=0x7f1614020a00 comp rx=0 tx=0).stop 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f16317cb740 1 -- 172.21.15.146:0/792473523 shutdown_connections 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f16317cb740 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5617ba48bf60 0x5617ba8cee10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f16317cb740 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4cd390 0x5617ba8cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f16317cb740 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4ac6b0 0x5617ba8ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f1602ffd640 0 client.11325 ms_handle_reset on v2:172.21.15.146:6833/2793356470 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f16317cb740 1 --2- 172.21.15.146:0/792473523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8d16c0 unknown :-1 s=CLOSED pgs=2470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.907+0000 7f16317cb740 1 -- 172.21.15.146:0/792473523 >> 172.21.15.146:0/792473523 conn(0x5617ba4c14e0 msgr2=0x5617ba875c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.908+0000 7f16317cb740 1 -- 172.21.15.146:0/792473523 shutdown_connections 2024-09-17T03:46:22.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.908+0000 7f16317cb740 1 -- 172.21.15.146:0/792473523 wait complete. 2024-09-17T03:46:22.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.908+0000 7f16317cb740 20 client.11325 trim_cache size 0 max 16384 2024-09-17T03:46:22.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.925+0000 7f16317cb740 1 Processor -- start 2024-09-17T03:46:22.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.925+0000 7f16317cb740 1 -- start start 2024-09-17T03:46:22.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.926+0000 7f16317cb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.926+0000 7f16317cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4ac6b0 0x5617ba8ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.926+0000 7f16317cb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4cd390 0x5617ba8704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.926+0000 7f16317cb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f16241fdeb0 con 0x5617ba4a44d0 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.926+0000 7f16317cb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f162406f2c0 con 0x5617ba4ac6b0 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.926+0000 7f16317cb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1624153a40 con 0x5617ba4cd390 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f1623fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f1623fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57148/0 (socket says 172.21.15.146:57148) 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f1623fff640 1 -- 172.21.15.146:0/3661742511 learned_addr learned my addr 172.21.15.146:0/3661742511 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f1623fff640 1 -- 172.21.15.146:0/3661742511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4cd390 msgr2=0x5617ba8704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f1623fff640 1 --2- 172.21.15.146:0/3661742511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4cd390 0x5617ba8704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f1623fff640 1 -- 172.21.15.146:0/3661742511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4ac6b0 msgr2=0x5617ba8ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f1623fff640 1 --2- 172.21.15.146:0/3661742511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4ac6b0 0x5617ba8ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f1623fff640 1 -- 172.21.15.146:0/3661742511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ba8bc7e0 con 0x5617ba4a44d0 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f1623fff640 1 --2- 172.21.15.146:0/3661742511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8ce800 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f1614001dc0 tx=0x7f1614020a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0522cfee4caf54c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f16097fa640 1 -- 172.21.15.146:0/3661742511 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614025070 con 0x5617ba4a44d0 2024-09-17T03:46:22.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f16097fa640 1 -- 172.21.15.146:0/3661742511 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f161401b040 con 0x5617ba4a44d0 2024-09-17T03:46:22.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.927+0000 7f16097fa640 1 -- 172.21.15.146:0/3661742511 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161402ca70 con 0x5617ba4a44d0 2024-09-17T03:46:22.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.928+0000 7f16317cb740 1 -- 172.21.15.146:0/3661742511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 msgr2=0x5617ba8ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:22.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.928+0000 7f16317cb740 1 --2- 172.21.15.146:0/3661742511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8ce800 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f1614001dc0 tx=0x7f1614020a70 comp rx=0 tx=0).stop 2024-09-17T03:46:22.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.928+0000 7f16317cb740 1 -- 172.21.15.146:0/3661742511 shutdown_connections 2024-09-17T03:46:22.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.928+0000 7f16317cb740 1 --2- 172.21.15.146:0/3661742511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4cd390 0x5617ba8704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.928+0000 7f16317cb740 1 --2- 172.21.15.146:0/3661742511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4ac6b0 0x5617ba8ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.928+0000 7f16317cb740 1 --2- 172.21.15.146:0/3661742511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4a44d0 0x5617ba8ce800 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.928+0000 7f16317cb740 1 -- 172.21.15.146:0/3661742511 >> 172.21.15.146:0/3661742511 conn(0x5617ba4c14e0 msgr2=0x5617ba86a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:22.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.928+0000 7f16317cb740 1 -- 172.21.15.146:0/3661742511 shutdown_connections 2024-09-17T03:46:22.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.928+0000 7f16317cb740 1 -- 172.21.15.146:0/3661742511 wait complete. 2024-09-17T03:46:22.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.929+0000 7f16317cb740 1 -- start start 2024-09-17T03:46:22.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.929+0000 7f16317cb740 1 Processor -- start 2024-09-17T03:46:22.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.930+0000 7f16317cb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4a44d0 0x5617ba93c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.930+0000 7f16317cb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4ac6b0 0x5617ba8bb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.930+0000 7f16317cb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4cd390 0x5617ba8bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.930+0000 7f16317cb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1624166130 con 0x5617ba4ac6b0 2024-09-17T03:46:22.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.930+0000 7f16317cb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5617ba875310 con 0x5617ba4cd390 2024-09-17T03:46:22.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.930+0000 7f16317cb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5617ba8c3720 con 0x5617ba4a44d0 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.930+0000 7f16317cb740 10 client.0 _ll_register_callbacks cb 0x7f1614023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.930+0000 7f16237fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4ac6b0 0x5617ba8bb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.930+0000 7f16237fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4ac6b0 0x5617ba8bb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57158/0 (socket says 172.21.15.146:57158) 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.930+0000 7f16237fe640 1 -- 172.21.15.146:0/1042227867 learned_addr learned my addr 172.21.15.146:0/1042227867 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.930+0000 7f1623fff640 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4a44d0 0x5617ba93c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f1628df9640 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4cd390 0x5617ba8bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16237fe640 1 -- 172.21.15.146:0/1042227867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4a44d0 msgr2=0x5617ba93c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16237fe640 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4a44d0 0x5617ba93c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16237fe640 1 -- 172.21.15.146:0/1042227867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4cd390 msgr2=0x5617ba8bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16237fe640 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4cd390 0x5617ba8bbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16237fe640 1 -- 172.21.15.146:0/1042227867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ba8c4320 con 0x5617ba4ac6b0 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f1628df9640 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4cd390 0x5617ba8bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:22.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16237fe640 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4ac6b0 0x5617ba8bb740 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x7f1618005fd0 tx=0x7f16180bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52963f52c1d7224e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f1602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f1602ffd640 1 -- 172.21.15.146:0/1042227867 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1618048040 con 0x5617ba4ac6b0 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f1602ffd640 1 -- 172.21.15.146:0/1042227867 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f161807f440 con 0x5617ba4ac6b0 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16317cb740 1 -- 172.21.15.146:0/1042227867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f161401b040 con 0x5617ba4ac6b0 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f1602ffd640 1 -- 172.21.15.146:0/1042227867 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=145) ==== 24+0+0 (secure 0 0 0) 0x7f16180831d0 con 0x5617ba4ac6b0 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16317cb740 10 client.11331 fetch_fsmap learned FSMap version 145 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16317cb740 1 -- 172.21.15.146:0/1042227867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=145,monmap=2+}) -- 0x5617ba876640 con 0x5617ba4ac6b0 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f1602ffd640 1 -- 172.21.15.146:0/1042227867 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f161401b040 con 0x5617ba4ac6b0 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f1602ffd640 1 -- 172.21.15.146:0/1042227867 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 145) ==== 3502+0+0 (secure 0 0 0) 0x7f161808c620 con 0x5617ba4ac6b0 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16317cb740 10 client.11331 fetch_fsmap finished waiting for FSMap version 145 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16317cb740 10 client.11331 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.a 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16317cb740 20 client.11331 populate_metadata read hostname 'smithi146' 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16317cb740 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5617ba8c2f40 0x5617ba8d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:22.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16317cb740 4 client.11331 mds_command: new command op to 11100 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.931+0000 7f16317cb740 1 -- 172.21.15.146:0/1042227867 --> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5617ba7e5460 con 0x5617ba8c2f40 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f1623fff640 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5617ba8c2f40 0x5617ba8d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f1602ffd640 10 client.11331 ms_handle_connect on v2:172.21.15.146:6833/2793356470 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f1623fff640 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5617ba8c2f40 0x5617ba8d1260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69be903a94e5551f server_cookie=97cb389a5eb7d368 in_seq=0 out_seq=0 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f1602ffd640 1 -- 172.21.15.146:0/1042227867 <== mds.0 v2:172.21.15.146:6833/2793356470 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x5617ba7e5460 con 0x5617ba8c2f40 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f1602ffd640 10 client.11331 handle_command_reply: tid=0 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f16317cb740 1 client.11331 shutdown 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f16317cb740 1 -- 172.21.15.146:0/1042227867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4ac6b0 msgr2=0x5617ba8bb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f16317cb740 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4ac6b0 0x5617ba8bb740 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x7f1618005fd0 tx=0x7f16180bb040 comp rx=0 tx=0).stop 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f16317cb740 1 -- 172.21.15.146:0/1042227867 shutdown_connections 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f16317cb740 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.146:6833/2793356470,v1:172.21.15.146:6835/2793356470] conn(0x5617ba8c2f40 0x5617ba8d1260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f16317cb740 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5617ba4cd390 0x5617ba8bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f16317cb740 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5617ba4ac6b0 0x5617ba8bb740 unknown :-1 s=CLOSED pgs=2472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f16317cb740 1 --2- 172.21.15.146:0/1042227867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5617ba4a44d0 0x5617ba93c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f1602ffd640 0 client.11331 ms_handle_reset on v2:172.21.15.146:6833/2793356470 2024-09-17T03:46:22.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.932+0000 7f16317cb740 1 -- 172.21.15.146:0/1042227867 >> 172.21.15.146:0/1042227867 conn(0x5617ba4c14e0 msgr2=0x5617ba86a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:22.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f16317cb740 1 -- 172.21.15.146:0/1042227867 shutdown_connections 2024-09-17T03:46:22.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f16317cb740 1 -- 172.21.15.146:0/1042227867 wait complete. 2024-09-17T03:46:22.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f16317cb740 20 client.11331 trim_cache size 0 max 16384 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {}, 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "2f5cfe06-8f74-4574-b046-5ffca103e801": { 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:45:52.577793+0000", 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:22.938 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:22.939 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:46:22.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 -- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1610078b90 msgr2=0x7f161007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:22.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1610078b90 0x7f161007b0a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1614007fd0 tx=0x7f1614009040 comp rx=0 tx=0).stop 2024-09-17T03:46:22.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 -- 172.21.15.146:0/2998854856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16241617a0 msgr2=0x7f162415ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:22.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16241617a0 0x7f162415ece0 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f1618000c00 tx=0x7f1618003820 comp rx=0 tx=0).stop 2024-09-17T03:46:22.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 -- 172.21.15.146:0/2998854856 shutdown_connections 2024-09-17T03:46:22.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1610078b90 0x7f161007b0a0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1624164100 0x7f162415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16241617a0 0x7f162415ece0 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 --2- 172.21.15.146:0/2998854856 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16241600b0 0x7f16241630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:22.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 -- 172.21.15.146:0/2998854856 >> 172.21.15.146:0/2998854856 conn(0x7f16240b41b0 msgr2=0x7f162415a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:22.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 -- 172.21.15.146:0/2998854856 shutdown_connections 2024-09-17T03:46:22.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:22.933+0000 7f162a85c640 1 -- 172.21.15.146:0/2998854856 wait complete. 2024-09-17T03:46:22.944 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> import json 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> import sys 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> try: 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> except OSError as e: 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> sys.exit(e.errno) 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:46:22.945 DEBUG:teuthology.orchestra.run.smithi146:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-17T03:46:22.946 DEBUG:teuthology.orchestra.run.smithi146:> print(json.dumps( 2024-09-17T03:46:22.946 DEBUG:teuthology.orchestra.run.smithi146:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-17T03:46:22.946 DEBUG:teuthology.orchestra.run.smithi146:> indent=2)) 2024-09-17T03:46:22.946 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:46:23.013 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:46:23.013 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mode": 33188, 2024-09-17T03:46:23.013 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ino": 1099511627777, 2024-09-17T03:46:23.013 INFO:teuthology.orchestra.run.smithi146.stdout: "st_dev": 41, 2024-09-17T03:46:23.013 INFO:teuthology.orchestra.run.smithi146.stdout: "st_nlink": 1, 2024-09-17T03:46:23.013 INFO:teuthology.orchestra.run.smithi146.stdout: "st_uid": 1000, 2024-09-17T03:46:23.013 INFO:teuthology.orchestra.run.smithi146.stdout: "st_gid": 1333, 2024-09-17T03:46:23.013 INFO:teuthology.orchestra.run.smithi146.stdout: "st_size": 6291456, 2024-09-17T03:46:23.013 INFO:teuthology.orchestra.run.smithi146.stdout: "st_atime": 1726544751.4908104, 2024-09-17T03:46:23.014 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mtime": 1726544751.51181, 2024-09-17T03:46:23.014 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ctime": 1726544751.51181 2024-09-17T03:46:23.014 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:46:23.015 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:46:23.022 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.177+0000 7f87858f2640 1 -- 172.21.15.146:0/2421327669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87800d4420 msgr2=0x7f87800d1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.177+0000 7f87858f2640 1 --2- 172.21.15.146:0/2421327669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87800d4420 0x7f87800d1840 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7f8778005fd0 tx=0x7f877802a620 comp rx=0 tx=0).stop 2024-09-17T03:46:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.177+0000 7f87858f2640 1 -- 172.21.15.146:0/2421327669 shutdown_connections 2024-09-17T03:46:23.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.177+0000 7f87858f2640 1 --2- 172.21.15.146:0/2421327669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87800d4420 0x7f87800d1840 unknown :-1 s=CLOSED pgs=2473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.177+0000 7f87858f2640 1 --2- 172.21.15.146:0/2421327669 >> v2:172.21.15.179:3300/0 conn(0x7f87800d2800 0x7f87800d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.177+0000 7f87858f2640 1 -- 172.21.15.146:0/2421327669 >> 172.21.15.146:0/2421327669 conn(0x7f878006ecd0 msgr2=0x7f878006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:23.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.177+0000 7f87858f2640 1 -- 172.21.15.146:0/2421327669 shutdown_connections 2024-09-17T03:46:23.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.177+0000 7f87858f2640 1 -- 172.21.15.146:0/2421327669 wait complete. 2024-09-17T03:46:23.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.179+0000 7f87858f2640 1 Processor -- start 2024-09-17T03:46:23.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.179+0000 7f87858f2640 1 -- start start 2024-09-17T03:46:23.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f87858f2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87800cf150 0x7f878015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f87858f2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87800d2800 0x7f87800cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f87858f2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87800d4420 0x7f87800b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f87858f2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f87800b6a80 con 0x7f87800cf150 2024-09-17T03:46:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f87858f2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f878015f110 con 0x7f87800d4420 2024-09-17T03:46:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f87858f2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f87800b6c00 con 0x7f87800d2800 2024-09-17T03:46:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87800cf150 0x7f878015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87800cf150 0x7f878015ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57170/0 (socket says 172.21.15.146:57170) 2024-09-17T03:46:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877effd640 1 -- 172.21.15.146:0/4167969061 learned_addr learned my addr 172.21.15.146:0/4167969061 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877e7fc640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87800d2800 0x7f87800cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877f7fe640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87800d4420 0x7f87800b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877effd640 1 -- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87800d2800 msgr2=0x7f87800cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877effd640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87800d2800 0x7f87800cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877effd640 1 -- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87800d4420 msgr2=0x7f87800b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877effd640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87800d4420 0x7f87800b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877effd640 1 -- 172.21.15.146:0/4167969061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87801f6210 con 0x7f87800cf150 2024-09-17T03:46:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877f7fe640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87800d4420 0x7f87800b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:23.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.180+0000 7f877e7fc640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87800d2800 0x7f87800cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.181+0000 7f877effd640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87800cf150 0x7f878015ae70 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f877000eb30 tx=0x7f877000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.181+0000 7f8767fff640 1 -- 172.21.15.146:0/4167969061 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770010430 con 0x7f87800cf150 2024-09-17T03:46:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.181+0000 7f8767fff640 1 -- 172.21.15.146:0/4167969061 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87700105d0 con 0x7f87800cf150 2024-09-17T03:46:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.181+0000 7f87858f2640 1 -- 172.21.15.146:0/4167969061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87800cead0 con 0x7f87800cf150 2024-09-17T03:46:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.181+0000 7f8767fff640 1 -- 172.21.15.146:0/4167969061 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770010a20 con 0x7f87800cf150 2024-09-17T03:46:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.181+0000 7f87858f2640 1 -- 172.21.15.146:0/4167969061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87801f67b0 con 0x7f87800cf150 2024-09-17T03:46:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.182+0000 7f87858f2640 1 -- 172.21.15.146:0/4167969061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87800b70b0 con 0x7f87800cf150 2024-09-17T03:46:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.183+0000 7f8767fff640 1 -- 172.21.15.146:0/4167969061 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8770010bc0 con 0x7f87800cf150 2024-09-17T03:46:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.183+0000 7f8767fff640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f876c078bc0 0x7f876c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.184+0000 7f8767fff640 1 -- 172.21.15.146:0/4167969061 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f877009b9b0 con 0x7f87800cf150 2024-09-17T03:46:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.184+0000 7f877e7fc640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f876c078bc0 0x7f876c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.184+0000 7f877e7fc640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f876c078bc0 0x7f876c07b0d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f878015bee0 tx=0x7f8774009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.188+0000 7f8767fff640 1 -- 172.21.15.146:0/4167969061 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8770063f10 con 0x7f87800cf150 2024-09-17T03:46:23.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.396+0000 7f87858f2640 1 -- 172.21.15.146:0/4167969061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f878015b590 con 0x7f87800cf150 2024-09-17T03:46:23.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.397+0000 7f8767fff640 1 -- 172.21.15.146:0/4167969061 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) ==== 95+0+5245 (secure 0 0 0) 0x7f8770063810 con 0x7f87800cf150 2024-09-17T03:46:23.396 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:23.396 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":145,"btime":"2024-09-17T03:45:43:095701+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/190399628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":190399628},{"type":"v1","addr":"172.21.15.179:6837","nonce":190399628}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":9565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/748249037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":748249037},{"type":"v1","addr":"172.21.15.179:6835","nonce":748249037}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":11097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1562825832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1562825832},{"type":"v1","addr":"172.21.15.146:6834","nonce":1562825832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:45:39.438921+0000","modified":"2024-09-17T03:45:42.453930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11100":{"gid":11100,"name":"a","rank":0,"incarnation":142,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2793356470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2793356470},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793356470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11100,"qdb_cluster":[11100]},"id":14}]} 2024-09-17T03:46:23.397 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 145 2024-09-17T03:46:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.399+0000 7f87858f2640 1 -- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f876c078bc0 msgr2=0x7f876c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.399+0000 7f87858f2640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f876c078bc0 0x7f876c07b0d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f878015bee0 tx=0x7f8774009040 comp rx=0 tx=0).stop 2024-09-17T03:46:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.399+0000 7f87858f2640 1 -- 172.21.15.146:0/4167969061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87800cf150 msgr2=0x7f878015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.399+0000 7f87858f2640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87800cf150 0x7f878015ae70 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f877000eb30 tx=0x7f877000c2d0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.399+0000 7f87858f2640 1 -- 172.21.15.146:0/4167969061 shutdown_connections 2024-09-17T03:46:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.399+0000 7f87858f2640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f876c078bc0 0x7f876c07b0d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.399+0000 7f87858f2640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87800d4420 0x7f87800b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.399+0000 7f87858f2640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87800d2800 0x7f87800cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.399+0000 7f87858f2640 1 --2- 172.21.15.146:0/4167969061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87800cf150 0x7f878015ae70 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.399+0000 7f87858f2640 1 -- 172.21.15.146:0/4167969061 >> 172.21.15.146:0/4167969061 conn(0x7f878006ecd0 msgr2=0x7f87800d48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.400+0000 7f87858f2640 1 -- 172.21.15.146:0/4167969061 shutdown_connections 2024-09-17T03:46:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.400+0000 7f87858f2640 1 -- 172.21.15.146:0/4167969061 wait complete. 2024-09-17T03:46:23.411 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-17T03:46:23.538 INFO:teuthology.orchestra.run.smithi146.stdout:{"message":"","return_code":0} 2024-09-17T03:46:23.538 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T03:46:23.539 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-17T03:46:23.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.595+0000 7f2937676f40 1 Processor -- start 2024-09-17T03:46:23.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.595+0000 7f2937676f40 1 -- start start 2024-09-17T03:46:23.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2937676f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb931e2560 0x55eb931e14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2937676f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eb93257080 0x55eb932535c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2937676f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb9326e7d0 0x55eb93253b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2937676f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55eb930eed60 con 0x55eb9326e7d0 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2937676f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55eb9314d430 con 0x55eb931e2560 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2937676f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55eb931e0490 con 0x55eb93257080 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2931931640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb9326e7d0 0x55eb93253b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2931931640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb9326e7d0 0x55eb93253b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57174/0 (socket says 172.21.15.146:57174) 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2931931640 1 -- 172.21.15.146:0/3981700740 learned_addr learned my addr 172.21.15.146:0/3981700740 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2931130640 1 --2- 172.21.15.146:0/3981700740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb931e2560 0x55eb931e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f293092f640 1 --2- 172.21.15.146:0/3981700740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eb93257080 0x55eb932535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2931931640 1 -- 172.21.15.146:0/3981700740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eb93257080 msgr2=0x55eb932535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:23.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2931931640 1 --2- 172.21.15.146:0/3981700740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eb93257080 0x55eb932535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.596+0000 7f2931931640 1 -- 172.21.15.146:0/3981700740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb931e2560 msgr2=0x55eb931e14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f2931931640 1 --2- 172.21.15.146:0/3981700740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb931e2560 0x55eb931e14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f2931931640 1 -- 172.21.15.146:0/3981700740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb93276910 con 0x55eb9326e7d0 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f293092f640 1 --2- 172.21.15.146:0/3981700740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eb93257080 0x55eb932535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f2931130640 1 --2- 172.21.15.146:0/3981700740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb931e2560 0x55eb931e14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f2931931640 1 --2- 172.21.15.146:0/3981700740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb9326e7d0 0x55eb93253b00 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7f292c00a850 tx=0x7f292c00ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926bb91e72e0800d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f292b7fe640 1 -- 172.21.15.146:0/3981700740 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c00db30 con 0x55eb9326e7d0 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f292b7fe640 1 -- 172.21.15.146:0/3981700740 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f292c00dcd0 con 0x55eb9326e7d0 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f292b7fe640 1 -- 172.21.15.146:0/3981700740 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c00f690 con 0x55eb9326e7d0 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f2937676f40 1 -- 172.21.15.146:0/3981700740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb9326e7d0 msgr2=0x55eb93253b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f2937676f40 1 --2- 172.21.15.146:0/3981700740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb9326e7d0 0x55eb93253b00 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7f292c00a850 tx=0x7f292c00ad10 comp rx=0 tx=0).stop 2024-09-17T03:46:23.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f2937676f40 1 -- 172.21.15.146:0/3981700740 shutdown_connections 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f2937676f40 1 --2- 172.21.15.146:0/3981700740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb9326e7d0 0x55eb93253b00 unknown :-1 s=CLOSED pgs=2475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f2937676f40 1 --2- 172.21.15.146:0/3981700740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eb93257080 0x55eb932535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f2937676f40 1 --2- 172.21.15.146:0/3981700740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb931e2560 0x55eb931e14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.597+0000 7f2937676f40 1 -- 172.21.15.146:0/3981700740 >> 172.21.15.146:0/3981700740 conn(0x55eb930bfac0 msgr2=0x55eb93276ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.598+0000 7f2937676f40 1 -- 172.21.15.146:0/3981700740 shutdown_connections 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.598+0000 7f2937676f40 1 -- 172.21.15.146:0/3981700740 wait complete. 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.598+0000 7f2937676f40 1 Processor -- start 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.598+0000 7f2937676f40 1 -- start start 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f2937676f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb931e2560 0x55eb9326ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f2937676f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb93257080 0x55eb931e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f2937676f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eb9326e7d0 0x55eb93251ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f2937676f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55eb93252cb0 con 0x55eb93257080 2024-09-17T03:46:23.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f2937676f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55eb93256090 con 0x55eb931e2560 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f2937676f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55eb932562e0 con 0x55eb9326e7d0 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f293092f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb93257080 0x55eb931e4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f293092f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb93257080 0x55eb931e4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57186/0 (socket says 172.21.15.146:57186) 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f293092f640 1 -- 172.21.15.146:0/3241585641 learned_addr learned my addr 172.21.15.146:0/3241585641 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f2931931640 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eb9326e7d0 0x55eb93251ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f2931130640 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb931e2560 0x55eb9326ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f293092f640 1 -- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eb9326e7d0 msgr2=0x55eb93251ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f293092f640 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55eb9326e7d0 0x55eb93251ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f293092f640 1 -- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb931e2560 msgr2=0x55eb9326ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f293092f640 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55eb931e2560 0x55eb9326ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f293092f640 1 -- 172.21.15.146:0/3241585641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb932775d0 con 0x55eb93257080 2024-09-17T03:46:23.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f293092f640 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb93257080 0x55eb931e4d60 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f291c00df60 tx=0x7f291c00df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:23.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f292a7fc640 1 -- 172.21.15.146:0/3241585641 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c00be60 con 0x55eb93257080 2024-09-17T03:46:23.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f292a7fc640 1 -- 172.21.15.146:0/3241585641 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f291c016070 con 0x55eb93257080 2024-09-17T03:46:23.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f2937676f40 1 -- 172.21.15.146:0/3241585641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb93252a70 con 0x55eb93257080 2024-09-17T03:46:23.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f292a7fc640 1 -- 172.21.15.146:0/3241585641 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c001610 con 0x55eb93257080 2024-09-17T03:46:23.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.600+0000 7f2937676f40 1 -- 172.21.15.146:0/3241585641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb931e6960 con 0x55eb93257080 2024-09-17T03:46:23.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.602+0000 7f292a7fc640 1 -- 172.21.15.146:0/3241585641 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f291c0017b0 con 0x55eb93257080 2024-09-17T03:46:23.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.603+0000 7f292a7fc640 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2914077570 0x7f2914079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.603+0000 7f292a7fc640 1 -- 172.21.15.146:0/3241585641 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f291c099a10 con 0x55eb93257080 2024-09-17T03:46:23.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.603+0000 7f2931130640 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2914077570 0x7f2914079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.603+0000 7f2937676f40 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x55eb9330bfb0 0x55eb93254ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:23.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.603+0000 7f2937676f40 1 -- 172.21.15.146:0/3241585641 --> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] -- osd_op(unknown.0.0:1 29.7 29:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e188) -- 0x55eb93252000 con 0x55eb9330bfb0 2024-09-17T03:46:23.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.603+0000 7f2931931640 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x55eb9330bfb0 0x55eb93254ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:23.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.603+0000 7f2931130640 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2914077570 0x7f2914079a80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2924055000 tx=0x7f2924058040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2931931640 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x55eb9330bfb0 0x55eb93254ea0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2931931640 1 -- 172.21.15.146:0/3241585641 <== osd.6 v2:172.21.15.179:6810/1755575046 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f292c00b040 con 0x55eb9330bfb0 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2937676f40 1 -- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x55eb9330bfb0 msgr2=0x55eb93254ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2937676f40 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x55eb9330bfb0 0x55eb93254ea0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2937676f40 1 -- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2914077570 msgr2=0x7f2914079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2937676f40 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2914077570 0x7f2914079a80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2924055000 tx=0x7f2924058040 comp rx=0 tx=0).stop 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2937676f40 1 -- 172.21.15.146:0/3241585641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb93257080 msgr2=0x55eb931e4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2937676f40 1 --2- 172.21.15.146:0/3241585641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eb93257080 0x55eb931e4d60 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f291c00df60 tx=0x7f291c00df90 comp rx=0 tx=0).stop 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2931931640 1 -- 172.21.15.146:0/3241585641 reap_dead start 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2937676f40 1 -- 172.21.15.146:0/3241585641 shutdown_connections 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2937676f40 1 -- 172.21.15.146:0/3241585641 >> 172.21.15.146:0/3241585641 conn(0x55eb930bfac0 msgr2=0x55eb93275d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2937676f40 1 -- 172.21.15.146:0/3241585641 shutdown_connections 2024-09-17T03:46:23.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:23.604+0000 7f2937676f40 1 -- 172.21.15.146:0/3241585641 wait complete. 2024-09-17T03:46:23.610 INFO:teuthology.orchestra.run.smithi146.stdout:Ysixmegssubdir  2024-09-17T03:46:23.611 DEBUG:teuthology.orchestra.run.smithi146:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-17T03:46:23.724 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:46:23.724 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 1099511627777, 2024-09-17T03:46:23.724 INFO:teuthology.orchestra.run.smithi146.stdout: "ancestors": [ 2024-09-17T03:46:23.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:23.725 INFO:teuthology.orchestra.run.smithi146.stdout: "dirino": 1099511627776, 2024-09-17T03:46:23.725 INFO:teuthology.orchestra.run.smithi146.stdout: "dname": "sixmegs", 2024-09-17T03:46:23.725 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 8 2024-09-17T03:46:23.725 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:23.725 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:23.725 INFO:teuthology.orchestra.run.smithi146.stdout: "dirino": 1, 2024-09-17T03:46:23.726 INFO:teuthology.orchestra.run.smithi146.stdout: "dname": "subdir", 2024-09-17T03:46:23.726 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 11 2024-09-17T03:46:23.726 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:23.726 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2024-09-17T03:46:23.726 INFO:teuthology.orchestra.run.smithi146.stdout: "pool": 29, 2024-09-17T03:46:23.726 INFO:teuthology.orchestra.run.smithi146.stdout: "old_pools": [] 2024-09-17T03:46:23.726 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:46:23.727 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:23.734 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:46:23.734 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:46:23.769 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:46:23.811 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:46:23.811 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:46:23.811 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:46:23.811 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:23.828 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:46:23.828 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:23.885 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:46:24.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.039+0000 7f2818dda640 1 -- 172.21.15.146:0/2889250229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28140d14a0 msgr2=0x7f2814160ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.039+0000 7f2818dda640 1 --2- 172.21.15.146:0/2889250229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28140d14a0 0x7f2814160ff0 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009830 tx=0x7f27fc02a510 comp rx=0 tx=0).stop 2024-09-17T03:46:24.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.039+0000 7f2818dda640 1 -- 172.21.15.146:0/2889250229 shutdown_connections 2024-09-17T03:46:24.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.039+0000 7f2818dda640 1 --2- 172.21.15.146:0/2889250229 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28140ccb80 0x7f28140cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.039+0000 7f2818dda640 1 --2- 172.21.15.146:0/2889250229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28140d14a0 0x7f2814160ff0 unknown :-1 s=CLOSED pgs=2478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.039+0000 7f2818dda640 1 -- 172.21.15.146:0/2889250229 >> 172.21.15.146:0/2889250229 conn(0x7f281406d170 msgr2=0x7f281406d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:24.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.039+0000 7f2818dda640 1 -- 172.21.15.146:0/2889250229 shutdown_connections 2024-09-17T03:46:24.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.039+0000 7f2818dda640 1 -- 172.21.15.146:0/2889250229 wait complete. 2024-09-17T03:46:24.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.041+0000 7f2818dda640 1 Processor -- start 2024-09-17T03:46:24.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.041+0000 7f2818dda640 1 -- start start 2024-09-17T03:46:24.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2818dda640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28140ccb80 0x7f28141520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2818dda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f281415cff0 0x7f28141f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.043 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2818dda640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28141f6d00 0x7f28141f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2818dda640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f28140cfbd0 con 0x7f28141f6d00 2024-09-17T03:46:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2818dda640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f28140cfa50 con 0x7f281415cff0 2024-09-17T03:46:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2818dda640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f28140cfd50 con 0x7f28140ccb80 2024-09-17T03:46:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2812d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28141f6d00 0x7f28141f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2812d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28141f6d00 0x7f28141f7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57196/0 (socket says 172.21.15.146:57196) 2024-09-17T03:46:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2812d9d640 1 -- 172.21.15.146:0/1303831875 learned_addr learned my addr 172.21.15.146:0/1303831875 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2809d9b640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f281415cff0 0x7f28141f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f281259c640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28140ccb80 0x7f28141520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2812d9d640 1 -- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28140ccb80 msgr2=0x7f28141520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2812d9d640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28140ccb80 0x7f28141520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2812d9d640 1 -- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f281415cff0 msgr2=0x7f28141f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2812d9d640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f281415cff0 0x7f28141f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2812d9d640 1 -- 172.21.15.146:0/1303831875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28140ae590 con 0x7f28141f6d00 2024-09-17T03:46:24.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2812d9d640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28141f6d00 0x7f28141f7110 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7f280c00d9d0 tx=0x7f280c00de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:24.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f280b7fe640 1 -- 172.21.15.146:0/1303831875 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c017070 con 0x7f28141f6d00 2024-09-17T03:46:24.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f280b7fe640 1 -- 172.21.15.146:0/1303831875 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f280c003970 con 0x7f28141f6d00 2024-09-17T03:46:24.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2818dda640 1 -- 172.21.15.146:0/1303831875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28140ae870 con 0x7f28141f6d00 2024-09-17T03:46:24.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f280b7fe640 1 -- 172.21.15.146:0/1303831875 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c00be60 con 0x7f28141f6d00 2024-09-17T03:46:24.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.043+0000 7f2818dda640 1 -- 172.21.15.146:0/1303831875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28140b0ad0 con 0x7f28141f6d00 2024-09-17T03:46:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.045+0000 7f2818dda640 1 -- 172.21.15.146:0/1303831875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28140b2d30 con 0x7f28141f6d00 2024-09-17T03:46:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.045+0000 7f280b7fe640 1 -- 172.21.15.146:0/1303831875 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f280c010460 con 0x7f28141f6d00 2024-09-17T03:46:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.046+0000 7f280b7fe640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f27f4078b90 0x7f27f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.046+0000 7f280b7fe640 1 -- 172.21.15.146:0/1303831875 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f280c09b090 con 0x7f28141f6d00 2024-09-17T03:46:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.046+0000 7f281259c640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f27f4078b90 0x7f27f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.046+0000 7f281259c640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f27f4078b90 0x7f27f407b0a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2804000f60 tx=0x7f2804009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:24.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.050+0000 7f280b7fe640 1 -- 172.21.15.146:0/1303831875 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f280c062e90 con 0x7f28141f6d00 2024-09-17T03:46:24.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.234+0000 7f2818dda640 1 -- 172.21.15.146:0/1303831875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f28140d0270 con 0x7f28141f6d00 2024-09-17T03:46:24.234 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.235+0000 7f280b7fe640 1 -- 172.21.15.146:0/1303831875 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v188) ==== 80+0+0 (secure 0 0 0) 0x7f280c0678c0 con 0x7f28141f6d00 2024-09-17T03:46:24.234 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:46:24.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 -- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f27f4078b90 msgr2=0x7f27f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f27f4078b90 0x7f27f407b0a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2804000f60 tx=0x7f2804009040 comp rx=0 tx=0).stop 2024-09-17T03:46:24.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 -- 172.21.15.146:0/1303831875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28141f6d00 msgr2=0x7f28141f7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28141f6d00 0x7f28141f7110 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7f280c00d9d0 tx=0x7f280c00de90 comp rx=0 tx=0).stop 2024-09-17T03:46:24.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 -- 172.21.15.146:0/1303831875 shutdown_connections 2024-09-17T03:46:24.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f27f4078b90 0x7f27f407b0a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28141f6d00 0x7f28141f7110 unknown :-1 s=CLOSED pgs=2479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f281415cff0 0x7f28141f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 --2- 172.21.15.146:0/1303831875 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f28140ccb80 0x7f28141520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 -- 172.21.15.146:0/1303831875 >> 172.21.15.146:0/1303831875 conn(0x7f281406d170 msgr2=0x7f28141530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:24.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 -- 172.21.15.146:0/1303831875 shutdown_connections 2024-09-17T03:46:24.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.237+0000 7f2818dda640 1 -- 172.21.15.146:0/1303831875 wait complete. 2024-09-17T03:46:24.247 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:46:24.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:24.248 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:46:24.303 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:46:24.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:24.304 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:46:24.323 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:46:24.323 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:46:24.323 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:24.344 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:46:24.344 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:46:24.345 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:46:24.345 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:24.379 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:46:24.379 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:46:24.379 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:46:24.379 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:24.401 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:46:24.401 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.533+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2192018126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc004800 msgr2=0x7f90cc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.533+0000 7f90e9ed5640 1 --2- 172.21.15.146:0/2192018126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc004800 0x7f90cc004c10 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7f90d80016c0 tx=0x7f90cc005830 comp rx=0 tx=0).stop 2024-09-17T03:46:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.533+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2192018126 shutdown_connections 2024-09-17T03:46:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.533+0000 7f90e9ed5640 1 --2- 172.21.15.146:0/2192018126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90cc004800 0x7f90cc004c10 unknown :-1 s=CLOSED pgs=2481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.533+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2192018126 >> 172.21.15.146:0/2192018126 conn(0x7f90e40b41b0 msgr2=0x7f90e40b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.533+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2192018126 shutdown_connections 2024-09-17T03:46:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.533+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2192018126 wait complete. 2024-09-17T03:46:24.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.535+0000 7f90e9ed5640 1 Processor -- start 2024-09-17T03:46:24.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.535+0000 7f90e9ed5640 1 -- start start 2024-09-17T03:46:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e9ed5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90cc004800 0x7f90e4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e9ed5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e4157f40 0x7f90e41f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e9ed5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e41579f0 0x7f90e41f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e9ed5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f90e40b6950 con 0x7f90e4157f40 2024-09-17T03:46:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e9ed5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f90e40b67d0 con 0x7f90e41579f0 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e9ed5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f90e40b6ad0 con 0x7f90cc004800 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e4157f40 0x7f90e41f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e37fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90cc004800 0x7f90e4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e2ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e4157f40 0x7f90e41f6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57218/0 (socket says 172.21.15.146:57218) 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e2ffd640 1 -- 172.21.15.146:0/2469212867 learned_addr learned my addr 172.21.15.146:0/2469212867 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e3fff640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e41579f0 0x7f90e41f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e2ffd640 1 -- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90cc004800 msgr2=0x7f90e4156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e2ffd640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90cc004800 0x7f90e4156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e2ffd640 1 -- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e41579f0 msgr2=0x7f90e41f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e2ffd640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e41579f0 0x7f90e41f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e2ffd640 1 -- 172.21.15.146:0/2469212867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e41f7710 con 0x7f90e4157f40 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.537+0000 7f90e2ffd640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e4157f40 0x7f90e41f6a40 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f90d80017e0 tx=0x7f90d80063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:24.538 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.538+0000 7f90cbfff640 1 -- 172.21.15.146:0/2469212867 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8042070 con 0x7f90e4157f40 2024-09-17T03:46:24.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.538+0000 7f90cbfff640 1 -- 172.21.15.146:0/2469212867 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90d8039070 con 0x7f90e4157f40 2024-09-17T03:46:24.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.538+0000 7f90cbfff640 1 -- 172.21.15.146:0/2469212867 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8003d70 con 0x7f90e4157f40 2024-09-17T03:46:24.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.538+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2469212867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e409dd60 con 0x7f90e4157f40 2024-09-17T03:46:24.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.538+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2469212867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e409da30 con 0x7f90e4157f40 2024-09-17T03:46:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.539+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2469212867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e40b7030 con 0x7f90e4157f40 2024-09-17T03:46:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.540+0000 7f90cbfff640 1 -- 172.21.15.146:0/2469212867 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90d803b070 con 0x7f90e4157f40 2024-09-17T03:46:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.540+0000 7f90cbfff640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f90d0078b90 0x7f90d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.540+0000 7f90cbfff640 1 -- 172.21.15.146:0/2469212867 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f90d80ba180 con 0x7f90e4157f40 2024-09-17T03:46:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.540+0000 7f90e37fe640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f90d0078b90 0x7f90d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.541+0000 7f90e37fe640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f90d0078b90 0x7f90d007b0a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f90d4006fd0 tx=0x7f90d4006f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:24.543 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.545+0000 7f90cbfff640 1 -- 172.21.15.146:0/2469212867 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f90d8082090 con 0x7f90e4157f40 2024-09-17T03:46:24.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.757+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2469212867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90e40b2240 con 0x7f90e4157f40 2024-09-17T03:46:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.757+0000 7f90cbfff640 1 -- 172.21.15.146:0/2469212867 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) ==== 95+0+5245 (secure 0 0 0) 0x7f90d8086ac0 con 0x7f90e4157f40 2024-09-17T03:46:24.757 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:24.757 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":145,"btime":"2024-09-17T03:45:43:095701+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/190399628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":190399628},{"type":"v1","addr":"172.21.15.179:6837","nonce":190399628}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":9565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/748249037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":748249037},{"type":"v1","addr":"172.21.15.179:6835","nonce":748249037}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":11097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1562825832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1562825832},{"type":"v1","addr":"172.21.15.146:6834","nonce":1562825832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:45:39.438921+0000","modified":"2024-09-17T03:45:42.453930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11100":{"gid":11100,"name":"a","rank":0,"incarnation":142,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2793356470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2793356470},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793356470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11100,"qdb_cluster":[11100]},"id":14}]} 2024-09-17T03:46:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 145 2024-09-17T03:46:24.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f90d0078b90 msgr2=0x7f90d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f90d0078b90 0x7f90d007b0a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f90d4006fd0 tx=0x7f90d4006f20 comp rx=0 tx=0).stop 2024-09-17T03:46:24.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2469212867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e4157f40 msgr2=0x7f90e41f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e4157f40 0x7f90e41f6a40 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7f90d80017e0 tx=0x7f90d80063a0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2469212867 shutdown_connections 2024-09-17T03:46:24.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f90d0078b90 0x7f90d007b0a0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f90e41579f0 0x7f90e41f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90e4157f40 0x7f90e41f6a40 unknown :-1 s=CLOSED pgs=2482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 --2- 172.21.15.146:0/2469212867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f90cc004800 0x7f90e4156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2469212867 >> 172.21.15.146:0/2469212867 conn(0x7f90e40b41b0 msgr2=0x7f90e40d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:24.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2469212867 shutdown_connections 2024-09-17T03:46:24.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.760+0000 7f90e9ed5640 1 -- 172.21.15.146:0/2469212867 wait complete. 2024-09-17T03:46:24.770 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.884+0000 7f78073ad640 1 -- 172.21.15.146:0/3407258554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780006e340 msgr2=0x7f780006f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.884+0000 7f78073ad640 1 --2- 172.21.15.146:0/3407258554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780006e340 0x7f780006f910 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00a940 tx=0x7f77fc02b850 comp rx=0 tx=0).stop 2024-09-17T03:46:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.884+0000 7f78073ad640 1 -- 172.21.15.146:0/3407258554 shutdown_connections 2024-09-17T03:46:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.884+0000 7f78073ad640 1 --2- 172.21.15.146:0/3407258554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780006e340 0x7f780006f910 unknown :-1 s=CLOSED pgs=2484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.884+0000 7f78073ad640 1 -- 172.21.15.146:0/3407258554 >> 172.21.15.146:0/3407258554 conn(0x7f78000b2790 msgr2=0x7f78000d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.885+0000 7f78073ad640 1 -- 172.21.15.146:0/3407258554 shutdown_connections 2024-09-17T03:46:24.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.885+0000 7f78073ad640 1 -- 172.21.15.146:0/3407258554 wait complete. 2024-09-17T03:46:24.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.886+0000 7f78073ad640 1 Processor -- start 2024-09-17T03:46:24.885 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.886+0000 7f78073ad640 1 -- start start 2024-09-17T03:46:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f78073ad640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780006e340 0x7f78000b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f78073ad640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f780014a540 0x7f780013eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f78073ad640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78000ae8b0 0x7f78000aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f78073ad640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f78000b4de0 con 0x7f780006e340 2024-09-17T03:46:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f78073ad640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78000b4c60 con 0x7f78000ae8b0 2024-09-17T03:46:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f78073ad640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f78000b4f60 con 0x7f780014a540 2024-09-17T03:46:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f7805149640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780006e340 0x7f78000b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f7805149640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780006e340 0x7f78000b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57242/0 (socket says 172.21.15.146:57242) 2024-09-17T03:46:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f7805149640 1 -- 172.21.15.146:0/3118383439 learned_addr learned my addr 172.21.15.146:0/3118383439 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f7804948640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f780014a540 0x7f780013eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f780594a640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78000ae8b0 0x7f78000aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f7805149640 1 -- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f780014a540 msgr2=0x7f780013eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f7805149640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f780014a540 0x7f780013eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f7805149640 1 -- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78000ae8b0 msgr2=0x7f78000aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f7805149640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78000ae8b0 0x7f78000aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f7805149640 1 -- 172.21.15.146:0/3118383439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78000af200 con 0x7f780006e340 2024-09-17T03:46:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f7804948640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f780014a540 0x7f780013eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f780594a640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78000ae8b0 0x7f78000aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f7805149640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780006e340 0x7f78000b1b40 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f77fc02be40 tx=0x7f77fc003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f77f5ffb640 1 -- 172.21.15.146:0/3118383439 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc041030 con 0x7f780006e340 2024-09-17T03:46:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f77f5ffb640 1 -- 172.21.15.146:0/3118383439 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77fc005110 con 0x7f780006e340 2024-09-17T03:46:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f78073ad640 1 -- 172.21.15.146:0/3118383439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7800141730 con 0x7f780006e340 2024-09-17T03:46:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.888+0000 7f77f5ffb640 1 -- 172.21.15.146:0/3118383439 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc005540 con 0x7f780006e340 2024-09-17T03:46:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.889+0000 7f78073ad640 1 -- 172.21.15.146:0/3118383439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7800141cf0 con 0x7f780006e340 2024-09-17T03:46:24.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.890+0000 7f78073ad640 1 -- 172.21.15.146:0/3118383439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78001423b0 con 0x7f780006e340 2024-09-17T03:46:24.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.890+0000 7f77f5ffb640 1 -- 172.21.15.146:0/3118383439 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77fc044070 con 0x7f780006e340 2024-09-17T03:46:24.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.891+0000 7f77f5ffb640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e4078b90 0x7f77e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:24.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.891+0000 7f77f5ffb640 1 -- 172.21.15.146:0/3118383439 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f77fc0bbe60 con 0x7f780006e340 2024-09-17T03:46:24.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.891+0000 7f7804948640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e4078b90 0x7f77e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:24.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.891+0000 7f7804948640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e4078b90 0x7f77e407b0a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f78000b1ad0 tx=0x7f77f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:24.894 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:24.895+0000 7f77f5ffb640 1 -- 172.21.15.146:0/3118383439 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f78001423b0 con 0x7f780006e340 2024-09-17T03:46:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.103+0000 7f78073ad640 1 -- 172.21.15.146:0/3118383439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78000b5450 con 0x7f780006e340 2024-09-17T03:46:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.104+0000 7f77f5ffb640 1 -- 172.21.15.146:0/3118383439 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) ==== 95+0+5245 (secure 0 0 0) 0x7f78000af200 con 0x7f780006e340 2024-09-17T03:46:25.103 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:25.103 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":145,"btime":"2024-09-17T03:45:43:095701+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/190399628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":190399628},{"type":"v1","addr":"172.21.15.179:6837","nonce":190399628}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":9565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/748249037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":748249037},{"type":"v1","addr":"172.21.15.179:6835","nonce":748249037}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":11097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1562825832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1562825832},{"type":"v1","addr":"172.21.15.146:6834","nonce":1562825832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:45:39.438921+0000","modified":"2024-09-17T03:45:42.453930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11100":{"gid":11100,"name":"a","rank":0,"incarnation":142,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2793356470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2793356470},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793356470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11100,"qdb_cluster":[11100]},"id":14}]} 2024-09-17T03:46:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 145 2024-09-17T03:46:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 -- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e4078b90 msgr2=0x7f77e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e4078b90 0x7f77e407b0a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f78000b1ad0 tx=0x7f77f0009040 comp rx=0 tx=0).stop 2024-09-17T03:46:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 -- 172.21.15.146:0/3118383439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780006e340 msgr2=0x7f78000b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780006e340 0x7f78000b1b40 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f77fc02be40 tx=0x7f77fc003ca0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 -- 172.21.15.146:0/3118383439 shutdown_connections 2024-09-17T03:46:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f77e4078b90 0x7f77e407b0a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78000ae8b0 0x7f78000aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f780014a540 0x7f780013eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 --2- 172.21.15.146:0/3118383439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780006e340 0x7f78000b1b40 unknown :-1 s=CLOSED pgs=2485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 -- 172.21.15.146:0/3118383439 >> 172.21.15.146:0/3118383439 conn(0x7f78000b2790 msgr2=0x7f7800158380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 -- 172.21.15.146:0/3118383439 shutdown_connections 2024-09-17T03:46:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.106+0000 7f78073ad640 1 -- 172.21.15.146:0/3118383439 wait complete. 2024-09-17T03:46:25.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:46:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.232+0000 7f550be8b640 1 -- 172.21.15.146:0/854862635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ec003fd0 msgr2=0x7f54ec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.231 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.232+0000 7f550be8b640 1 --2- 172.21.15.146:0/854862635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54ec003fd0 0x7f54ec004800 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009b20 tx=0x7f54ec005830 comp rx=0 tx=0).stop 2024-09-17T03:46:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.232+0000 7f550a428640 1 -- 172.21.15.146:0/854862635 reap_dead start 2024-09-17T03:46:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.232+0000 7f550be8b640 1 -- 172.21.15.146:0/854862635 shutdown_connections 2024-09-17T03:46:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.232+0000 7f550be8b640 1 -- 172.21.15.146:0/854862635 >> 172.21.15.146:0/854862635 conn(0x7f55040b3880 msgr2=0x7f55040d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.232+0000 7f550be8b640 1 -- 172.21.15.146:0/854862635 shutdown_connections 2024-09-17T03:46:25.232 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.232+0000 7f550be8b640 1 -- 172.21.15.146:0/854862635 wait complete. 2024-09-17T03:46:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.234+0000 7f550be8b640 1 Processor -- start 2024-09-17T03:46:25.233 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.234+0000 7f550be8b640 1 -- start start 2024-09-17T03:46:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550be8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54ec003fd0 0x7f55041522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550be8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5504152a30 0x7f550406cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550be8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f550414bc80 0x7f550406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550be8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f55040d0fa0 con 0x7f550414bc80 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550be8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f55040d0e20 con 0x7f54ec003fd0 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550be8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f55040d1120 con 0x7f5504152a30 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550a428640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f550414bc80 0x7f550406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550a428640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f550414bc80 0x7f550406d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57272/0 (socket says 172.21.15.146:57272) 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550a428640 1 -- 172.21.15.146:0/468233382 learned_addr learned my addr 172.21.15.146:0/468233382 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f5509c27640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54ec003fd0 0x7f55041522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f5509426640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5504152a30 0x7f550406cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550a428640 1 -- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5504152a30 msgr2=0x7f550406cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550a428640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5504152a30 0x7f550406cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550a428640 1 -- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54ec003fd0 msgr2=0x7f55041522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550a428640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54ec003fd0 0x7f55041522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f550a428640 1 -- 172.21.15.146:0/468233382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5504158970 con 0x7f550414bc80 2024-09-17T03:46:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.235+0000 7f5509c27640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54ec003fd0 0x7f55041522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.236+0000 7f550a428640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f550414bc80 0x7f550406d2c0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f5504073540 tx=0x7f54fc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.236+0000 7f55027fc640 1 -- 172.21.15.146:0/468233382 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc015070 con 0x7f550414bc80 2024-09-17T03:46:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.236+0000 7f55027fc640 1 -- 172.21.15.146:0/468233382 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54fc011840 con 0x7f550414bc80 2024-09-17T03:46:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.236+0000 7f550be8b640 1 -- 172.21.15.146:0/468233382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5504156f50 con 0x7f550414bc80 2024-09-17T03:46:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.236+0000 7f55027fc640 1 -- 172.21.15.146:0/468233382 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc011c90 con 0x7f550414bc80 2024-09-17T03:46:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.236+0000 7f550be8b640 1 -- 172.21.15.146:0/468233382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550415a490 con 0x7f550414bc80 2024-09-17T03:46:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.237+0000 7f550be8b640 1 -- 172.21.15.146:0/468233382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55040739c0 con 0x7f550414bc80 2024-09-17T03:46:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.238+0000 7f55027fc640 1 -- 172.21.15.146:0/468233382 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f54fc018070 con 0x7f550414bc80 2024-09-17T03:46:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.238+0000 7f55027fc640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f54f0078b90 0x7f54f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.238+0000 7f55027fc640 1 -- 172.21.15.146:0/468233382 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f54fc09b7e0 con 0x7f550414bc80 2024-09-17T03:46:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.238+0000 7f5509c27640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f54f0078b90 0x7f54f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.239+0000 7f5509c27640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f54f0078b90 0x7f54f007b0a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f54f4005fd0 tx=0x7f54f40094a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:25.242 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.243+0000 7f55027fc640 1 -- 172.21.15.146:0/468233382 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5504073f00 con 0x7f550414bc80 2024-09-17T03:46:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.416+0000 7f550be8b640 1 -- 172.21.15.146:0/468233382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55040b6790 con 0x7f550414bc80 2024-09-17T03:46:25.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.417+0000 7f55027fc640 1 -- 172.21.15.146:0/468233382 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+16787 (secure 0 0 0) 0x7f54fc063d40 con 0x7f550414bc80 2024-09-17T03:46:25.417 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:25.417 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":188,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:45:41.077566+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:45:37.078416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-17T03:45:38.406641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:46:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 -- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f54f0078b90 msgr2=0x7f54f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f54f0078b90 0x7f54f007b0a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f54f4005fd0 tx=0x7f54f40094a0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 -- 172.21.15.146:0/468233382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f550414bc80 msgr2=0x7f550406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f550414bc80 0x7f550406d2c0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f5504073540 tx=0x7f54fc0039c0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 -- 172.21.15.146:0/468233382 shutdown_connections 2024-09-17T03:46:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f54f0078b90 0x7f54f007b0a0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f550414bc80 0x7f550406d2c0 unknown :-1 s=CLOSED pgs=2488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5504152a30 0x7f550406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 --2- 172.21.15.146:0/468233382 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54ec003fd0 0x7f55041522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 -- 172.21.15.146:0/468233382 >> 172.21.15.146:0/468233382 conn(0x7f55040b3880 msgr2=0x7f55040b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 -- 172.21.15.146:0/468233382 shutdown_connections 2024-09-17T03:46:25.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.420+0000 7f550be8b640 1 -- 172.21.15.146:0/468233382 wait complete. 2024-09-17T03:46:25.430 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:46:25.431 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:25.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.545+0000 7f75f97e6640 1 -- 172.21.15.146:0/1239842052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f40d1a10 msgr2=0x7f75f40d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.545+0000 7f75f97e6640 1 --2- 172.21.15.146:0/1239842052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f40d1a10 0x7f75f40d3410 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f75f4163630 tx=0x7f75dc02a530 comp rx=0 tx=0).stop 2024-09-17T03:46:25.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.545+0000 7f75f97e6640 1 -- 172.21.15.146:0/1239842052 shutdown_connections 2024-09-17T03:46:25.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.545+0000 7f75f97e6640 1 --2- 172.21.15.146:0/1239842052 >> v2:172.21.15.179:3300/0 conn(0x7f75f40cf150 0x7f75f40d3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.545+0000 7f75f97e6640 1 --2- 172.21.15.146:0/1239842052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f40d1a10 0x7f75f40d3410 unknown :-1 s=CLOSED pgs=2490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.544 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.545+0000 7f75f97e6640 1 -- 172.21.15.146:0/1239842052 >> 172.21.15.146:0/1239842052 conn(0x7f75f406ecd0 msgr2=0x7f75f406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:25.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.545+0000 7f75f97e6640 1 -- 172.21.15.146:0/1239842052 shutdown_connections 2024-09-17T03:46:25.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.545+0000 7f75f97e6640 1 -- 172.21.15.146:0/1239842052 wait complete. 2024-09-17T03:46:25.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.546+0000 7f75f97e6640 1 Processor -- start 2024-09-17T03:46:25.545 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.547+0000 7f75f97e6640 1 -- start start 2024-09-17T03:46:25.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f97e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75f40cf150 0x7f75f40b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f97e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75f40d2800 0x7f75f4151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f97e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f4152aa0 0x7f75f4152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f97e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f75f40d4010 con 0x7f75f4152aa0 2024-09-17T03:46:25.548 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f97e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f75f40d3e90 con 0x7f75f40cf150 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f97e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f75f40d4190 con 0x7f75f40d2800 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f4152aa0 0x7f75f4152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f4152aa0 0x7f75f4152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57284/0 (socket says 172.21.15.146:57284) 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f37fe640 1 -- 172.21.15.146:0/1419917267 learned_addr learned my addr 172.21.15.146:0/1419917267 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f2ffd640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75f40cf150 0x7f75f40b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75ea7fc640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75f40d2800 0x7f75f4151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f37fe640 1 -- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75f40d2800 msgr2=0x7f75f4151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f37fe640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75f40d2800 0x7f75f4151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f37fe640 1 -- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75f40cf150 msgr2=0x7f75f40b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f37fe640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75f40cf150 0x7f75f40b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.548+0000 7f75f37fe640 1 -- 172.21.15.146:0/1419917267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f40b48a0 con 0x7f75f4152aa0 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.549+0000 7f75f37fe640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f4152aa0 0x7f75f4152eb0 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00cab0 tx=0x7f75ec00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:25.549 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.549+0000 7f75ebfff640 1 -- 172.21.15.146:0/1419917267 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec007d90 con 0x7f75f4152aa0 2024-09-17T03:46:25.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.549+0000 7f75ebfff640 1 -- 172.21.15.146:0/1419917267 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75ec00f540 con 0x7f75f4152aa0 2024-09-17T03:46:25.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.549+0000 7f75f97e6640 1 -- 172.21.15.146:0/1419917267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f40b4b80 con 0x7f75f4152aa0 2024-09-17T03:46:25.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.549+0000 7f75ebfff640 1 -- 172.21.15.146:0/1419917267 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec00f990 con 0x7f75f4152aa0 2024-09-17T03:46:25.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.549+0000 7f75f97e6640 1 -- 172.21.15.146:0/1419917267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f40b5140 con 0x7f75f4152aa0 2024-09-17T03:46:25.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.550+0000 7f75f97e6640 1 -- 172.21.15.146:0/1419917267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f40d09c0 con 0x7f75f4152aa0 2024-09-17T03:46:25.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.551+0000 7f75ebfff640 1 -- 172.21.15.146:0/1419917267 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75ec00fb30 con 0x7f75f4152aa0 2024-09-17T03:46:25.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.551+0000 7f75ebfff640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f75d4078b90 0x7f75d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.551+0000 7f75ebfff640 1 -- 172.21.15.146:0/1419917267 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f75ec09b800 con 0x7f75f4152aa0 2024-09-17T03:46:25.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.551+0000 7f75f2ffd640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f75d4078b90 0x7f75d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.552+0000 7f75f2ffd640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f75d4078b90 0x7f75d407b0a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f75f4163890 tx=0x7f75e4007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:25.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.555+0000 7f75ebfff640 1 -- 172.21.15.146:0/1419917267 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f75f40d09c0 con 0x7f75f4152aa0 2024-09-17T03:46:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.764+0000 7f75f97e6640 1 -- 172.21.15.146:0/1419917267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75f40d3410 con 0x7f75f4152aa0 2024-09-17T03:46:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.764+0000 7f75ebfff640 1 -- 172.21.15.146:0/1419917267 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) ==== 95+0+5245 (secure 0 0 0) 0x7f75ec014070 con 0x7f75f4152aa0 2024-09-17T03:46:25.763 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:25.764 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":145,"btime":"2024-09-17T03:45:43:095701+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/190399628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":190399628},{"type":"v1","addr":"172.21.15.179:6837","nonce":190399628}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":9565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/748249037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":748249037},{"type":"v1","addr":"172.21.15.179:6835","nonce":748249037}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":11097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1562825832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1562825832},{"type":"v1","addr":"172.21.15.146:6834","nonce":1562825832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:45:39.438921+0000","modified":"2024-09-17T03:45:42.453930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11100":{"gid":11100,"name":"a","rank":0,"incarnation":142,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2793356470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2793356470},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793356470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11100,"qdb_cluster":[11100]},"id":14}]} 2024-09-17T03:46:25.764 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 145 2024-09-17T03:46:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.766+0000 7f75f97e6640 1 -- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f75d4078b90 msgr2=0x7f75d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.766+0000 7f75f97e6640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f75d4078b90 0x7f75d407b0a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f75f4163890 tx=0x7f75e4007eb0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.767+0000 7f75f97e6640 1 -- 172.21.15.146:0/1419917267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f4152aa0 msgr2=0x7f75f4152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.767+0000 7f75f97e6640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f4152aa0 0x7f75f4152eb0 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00cab0 tx=0x7f75ec00cf70 comp rx=0 tx=0).stop 2024-09-17T03:46:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.767+0000 7f75f97e6640 1 -- 172.21.15.146:0/1419917267 shutdown_connections 2024-09-17T03:46:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.767+0000 7f75f97e6640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f75d4078b90 0x7f75d407b0a0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.767+0000 7f75f97e6640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f4152aa0 0x7f75f4152eb0 unknown :-1 s=CLOSED pgs=2491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.767+0000 7f75f97e6640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f75f40d2800 0x7f75f4151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.767+0000 7f75f97e6640 1 --2- 172.21.15.146:0/1419917267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75f40cf150 0x7f75f40b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.767+0000 7f75f97e6640 1 -- 172.21.15.146:0/1419917267 >> 172.21.15.146:0/1419917267 conn(0x7f75f406ecd0 msgr2=0x7f75f40b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.767+0000 7f75f97e6640 1 -- 172.21.15.146:0/1419917267 shutdown_connections 2024-09-17T03:46:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.767+0000 7f75f97e6640 1 -- 172.21.15.146:0/1419917267 wait complete. 2024-09-17T03:46:25.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:25.891 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.892+0000 7fc6c91c6640 1 -- 172.21.15.146:0/3330296386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c40b0cc0 msgr2=0x7fc6c415ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.892+0000 7fc6c91c6640 1 --2- 172.21.15.146:0/3330296386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c40b0cc0 0x7fc6c415ca20 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4159be0 tx=0x7fc6b402aac0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.892+0000 7fc6c91c6640 1 -- 172.21.15.146:0/3330296386 shutdown_connections 2024-09-17T03:46:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.892+0000 7fc6c91c6640 1 --2- 172.21.15.146:0/3330296386 >> v2:172.21.15.179:3300/0 conn(0x7fc6c415f600 0x7fc6c415fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.892+0000 7fc6c91c6640 1 --2- 172.21.15.146:0/3330296386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c40b0cc0 0x7fc6c415ca20 unknown :-1 s=CLOSED pgs=2493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.892+0000 7fc6c91c6640 1 -- 172.21.15.146:0/3330296386 >> 172.21.15.146:0/3330296386 conn(0x7fc6c40d16c0 msgr2=0x7fc6c40d1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.892+0000 7fc6c91c6640 1 -- 172.21.15.146:0/3330296386 shutdown_connections 2024-09-17T03:46:25.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.892+0000 7fc6c91c6640 1 -- 172.21.15.146:0/3330296386 wait complete. 2024-09-17T03:46:25.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.894+0000 7fc6c91c6640 1 Processor -- start 2024-09-17T03:46:25.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.894+0000 7fc6c91c6640 1 -- start start 2024-09-17T03:46:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.895+0000 7fc6c91c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c40734e0 0x7fc6c40b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.895+0000 7fc6c91c6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c40b0cc0 0x7fc6c414fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c91c6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c415f600 0x7fc6c40b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c91c6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c4070590 con 0x7fc6c40734e0 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c91c6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c4070410 con 0x7fc6c415f600 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c91c6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c4070710 con 0x7fc6c40b0cc0 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c40734e0 0x7fc6c40b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c2d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c40734e0 0x7fc6c40b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57306/0 (socket says 172.21.15.146:57306) 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c2d9d640 1 -- 172.21.15.146:0/889927776 learned_addr learned my addr 172.21.15.146:0/889927776 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c259c640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c40b0cc0 0x7fc6c414fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c359e640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c415f600 0x7fc6c40b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c2d9d640 1 -- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c40b0cc0 msgr2=0x7fc6c414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c2d9d640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c40b0cc0 0x7fc6c414fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c2d9d640 1 -- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c415f600 msgr2=0x7fc6c40b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c2d9d640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c415f600 0x7fc6c40b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c2d9d640 1 -- 172.21.15.146:0/889927776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c4150520 con 0x7fc6c40734e0 2024-09-17T03:46:25.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c359e640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c415f600 0x7fc6c40b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:25.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c259c640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c40b0cc0 0x7fc6c414fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:25.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c2d9d640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c40734e0 0x7fc6c40b4db0 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4000f80 tx=0x7fc6b4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:25.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6ab7fe640 1 -- 172.21.15.146:0/889927776 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4044070 con 0x7fc6c40734e0 2024-09-17T03:46:25.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c91c6640 1 -- 172.21.15.146:0/889927776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c4150800 con 0x7fc6c40734e0 2024-09-17T03:46:25.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6ab7fe640 1 -- 172.21.15.146:0/889927776 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6b4004250 con 0x7fc6c40734e0 2024-09-17T03:46:25.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6ab7fe640 1 -- 172.21.15.146:0/889927776 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40046c0 con 0x7fc6c40734e0 2024-09-17T03:46:25.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.896+0000 7fc6c91c6640 1 -- 172.21.15.146:0/889927776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c4150dc0 con 0x7fc6c40734e0 2024-09-17T03:46:25.898 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.897+0000 7fc6c91c6640 1 -- 172.21.15.146:0/889927776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c4070c60 con 0x7fc6c40734e0 2024-09-17T03:46:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.898+0000 7fc6ab7fe640 1 -- 172.21.15.146:0/889927776 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6b4036400 con 0x7fc6c40734e0 2024-09-17T03:46:25.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.899+0000 7fc6ab7fe640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6b0078bc0 0x7fc6b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.899+0000 7fc6ab7fe640 1 -- 172.21.15.146:0/889927776 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fc6b40bb420 con 0x7fc6c40734e0 2024-09-17T03:46:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.899+0000 7fc6c259c640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6b0078bc0 0x7fc6b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:25.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.899+0000 7fc6c259c640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6b0078bc0 0x7fc6b007b0d0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc6c415ba00 tx=0x7fc6b8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:25.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:25.903+0000 7fc6ab7fe640 1 -- 172.21.15.146:0/889927776 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc6b4032030 con 0x7fc6c40734e0 2024-09-17T03:46:26.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.113+0000 7fc6c91c6640 1 -- 172.21.15.146:0/889927776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6c4076200 con 0x7fc6c40734e0 2024-09-17T03:46:26.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.113+0000 7fc6ab7fe640 1 -- 172.21.15.146:0/889927776 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 145 v145) ==== 95+0+5245 (secure 0 0 0) 0x7fc6b4083870 con 0x7fc6c40734e0 2024-09-17T03:46:26.112 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:26.113 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":145,"btime":"2024-09-17T03:45:43:095701+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/190399628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":190399628},{"type":"v1","addr":"172.21.15.179:6837","nonce":190399628}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":9565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/748249037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":748249037},{"type":"v1","addr":"172.21.15.179:6835","nonce":748249037}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":11097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1562825832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1562825832},{"type":"v1","addr":"172.21.15.146:6834","nonce":1562825832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140}],"filesystems":[{"mdsmap":{"epoch":145,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:45:39.438921+0000","modified":"2024-09-17T03:45:42.453930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11100":{"gid":11100,"name":"a","rank":0,"incarnation":142,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/2793356470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2793356470},{"type":"v1","addr":"172.21.15.146:6835","nonce":2793356470}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11100,"qdb_cluster":[11100]},"id":14}]} 2024-09-17T03:46:26.113 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 145 2024-09-17T03:46:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 -- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6b0078bc0 msgr2=0x7fc6b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6b0078bc0 0x7fc6b007b0d0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc6c415ba00 tx=0x7fc6b8005f90 comp rx=0 tx=0).stop 2024-09-17T03:46:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 -- 172.21.15.146:0/889927776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c40734e0 msgr2=0x7fc6c40b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c40734e0 0x7fc6c40b4db0 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4000f80 tx=0x7fc6b4003ce0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 -- 172.21.15.146:0/889927776 shutdown_connections 2024-09-17T03:46:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc6b0078bc0 0x7fc6b007b0d0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6c415f600 0x7fc6c40b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6c40b0cc0 0x7fc6c414fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 --2- 172.21.15.146:0/889927776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c40734e0 0x7fc6c40b4db0 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 -- 172.21.15.146:0/889927776 >> 172.21.15.146:0/889927776 conn(0x7fc6c40d16c0 msgr2=0x7fc6c415ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:26.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 -- 172.21.15.146:0/889927776 shutdown_connections 2024-09-17T03:46:26.116 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.116+0000 7fc6c91c6640 1 -- 172.21.15.146:0/889927776 wait complete. 2024-09-17T03:46:26.127 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:46:26.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.239+0000 7f1419bda640 1 -- 172.21.15.146:0/514537523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14140d15e0 msgr2=0x7f14140b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.239+0000 7f1419bda640 1 --2- 172.21.15.146:0/514537523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14140d15e0 0x7f14140b6330 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7f141406ad20 tx=0x7f140c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:46:26.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.239+0000 7f1419bda640 1 -- 172.21.15.146:0/514537523 shutdown_connections 2024-09-17T03:46:26.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.239+0000 7f1419bda640 1 --2- 172.21.15.146:0/514537523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14140d15e0 0x7f14140b6330 unknown :-1 s=CLOSED pgs=2495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.239+0000 7f1419bda640 1 --2- 172.21.15.146:0/514537523 >> v2:172.21.15.179:3300/0 conn(0x7f141415ed40 0x7f14140d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.239+0000 7f1419bda640 1 --2- 172.21.15.146:0/514537523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14140b36b0 0x7f1414163440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.239+0000 7f1419bda640 1 -- 172.21.15.146:0/514537523 >> 172.21.15.146:0/514537523 conn(0x7f141406ecf0 msgr2=0x7f141406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:26.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.239+0000 7f1419bda640 1 -- 172.21.15.146:0/514537523 shutdown_connections 2024-09-17T03:46:26.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.240+0000 7f1419bda640 1 -- 172.21.15.146:0/514537523 wait complete. 2024-09-17T03:46:26.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.241+0000 7f1419bda640 1 Processor -- start 2024-09-17T03:46:26.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.241+0000 7f1419bda640 1 -- start start 2024-09-17T03:46:26.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1419bda640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14140b36b0 0x7f14140b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1419bda640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14140d15e0 0x7f14140b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1419bda640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f141415ed40 0x7f14141f9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1419bda640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f14140b6870 con 0x7f14140d15e0 2024-09-17T03:46:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1419bda640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f14140d0420 con 0x7f141415ed40 2024-09-17T03:46:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1419bda640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f14140b69f0 con 0x7f14140b36b0 2024-09-17T03:46:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1412ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14140d15e0 0x7f14140b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1412ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14140d15e0 0x7f14140b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57322/0 (socket says 172.21.15.146:57322) 2024-09-17T03:46:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1412ffd640 1 -- 172.21.15.146:0/2774111011 learned_addr learned my addr 172.21.15.146:0/2774111011 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1413fff640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f141415ed40 0x7f14141f9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f14137fe640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14140b36b0 0x7f14140b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1412ffd640 1 -- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14140b36b0 msgr2=0x7f14140b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1412ffd640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14140b36b0 0x7f14140b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1412ffd640 1 -- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f141415ed40 msgr2=0x7f14141f9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1412ffd640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f141415ed40 0x7f14141f9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1412ffd640 1 -- 172.21.15.146:0/2774111011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1414151aa0 con 0x7f14140d15e0 2024-09-17T03:46:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f1412ffd640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14140d15e0 0x7f14140b2ae0 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7f140800d700 tx=0x7f140800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.243+0000 7f13fbfff640 1 -- 172.21.15.146:0/2774111011 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408017070 con 0x7f14140d15e0 2024-09-17T03:46:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.244+0000 7f13fbfff640 1 -- 172.21.15.146:0/2774111011 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1408009b10 con 0x7f14140d15e0 2024-09-17T03:46:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.244+0000 7f13fbfff640 1 -- 172.21.15.146:0/2774111011 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408010460 con 0x7f14140d15e0 2024-09-17T03:46:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.244+0000 7f1419bda640 1 -- 172.21.15.146:0/2774111011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1414151d80 con 0x7f14140d15e0 2024-09-17T03:46:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.244+0000 7f1419bda640 1 -- 172.21.15.146:0/2774111011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1414152340 con 0x7f14140d15e0 2024-09-17T03:46:26.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.245+0000 7f1419bda640 1 -- 172.21.15.146:0/2774111011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14140b6f10 con 0x7f14140d15e0 2024-09-17T03:46:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.245+0000 7f13fbfff640 1 -- 172.21.15.146:0/2774111011 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f140801a070 con 0x7f14140d15e0 2024-09-17T03:46:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.246+0000 7f13fbfff640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1400078b90 0x7f140007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.246+0000 7f13fbfff640 1 -- 172.21.15.146:0/2774111011 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f140809acc0 con 0x7f14140d15e0 2024-09-17T03:46:26.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.246+0000 7f14137fe640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1400078b90 0x7f140007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.246+0000 7f14137fe640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1400078b90 0x7f140007b0a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f140400bb30 tx=0x7f140400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:26.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.250+0000 7f13fbfff640 1 -- 172.21.15.146:0/2774111011 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1408062b40 con 0x7f14140d15e0 2024-09-17T03:46:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.426+0000 7f1419bda640 1 -- 172.21.15.146:0/2774111011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f141415d670 con 0x7f14140d15e0 2024-09-17T03:46:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.427+0000 7f13fbfff640 1 -- 172.21.15.146:0/2774111011 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+16787 (secure 0 0 0) 0x7f1408067570 con 0x7f14140d15e0 2024-09-17T03:46:26.427 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:26.427 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":188,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:45:41.077566+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:45:37.078416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-17T03:45:38.406641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:46:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 -- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1400078b90 msgr2=0x7f140007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1400078b90 0x7f140007b0a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f140400bb30 tx=0x7f140400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 -- 172.21.15.146:0/2774111011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14140d15e0 msgr2=0x7f14140b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14140d15e0 0x7f14140b2ae0 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7f140800d700 tx=0x7f140800dbc0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 -- 172.21.15.146:0/2774111011 shutdown_connections 2024-09-17T03:46:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1400078b90 0x7f140007b0a0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f141415ed40 0x7f14141f9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14140d15e0 0x7f14140b2ae0 unknown :-1 s=CLOSED pgs=2496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 --2- 172.21.15.146:0/2774111011 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f14140b36b0 0x7f14140b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 -- 172.21.15.146:0/2774111011 >> 172.21.15.146:0/2774111011 conn(0x7f141406ecf0 msgr2=0x7f141415df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:26.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 -- 172.21.15.146:0/2774111011 shutdown_connections 2024-09-17T03:46:26.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.429+0000 7f1419bda640 1 -- 172.21.15.146:0/2774111011 wait complete. 2024-09-17T03:46:26.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:46:26.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.554+0000 7f9c8d1da640 1 -- 172.21.15.146:0/126512725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c880d1050 msgr2=0x7f9c880cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.554+0000 7f9c8d1da640 1 --2- 172.21.15.146:0/126512725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c880d1050 0x7f9c880cd0a0 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009ca0 tx=0x7f9c8002aa60 comp rx=0 tx=0).stop 2024-09-17T03:46:26.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.554+0000 7f9c8d1da640 1 -- 172.21.15.146:0/126512725 shutdown_connections 2024-09-17T03:46:26.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.554+0000 7f9c8d1da640 1 --2- 172.21.15.146:0/126512725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c880d1050 0x7f9c880cd0a0 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.554+0000 7f9c8d1da640 1 --2- 172.21.15.146:0/126512725 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c8815cbe0 0x7f9c880d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.554+0000 7f9c8d1da640 1 --2- 172.21.15.146:0/126512725 >> v2:172.21.15.179:3300/0 conn(0x7f9c880d31e0 0x7f9c880cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.554+0000 7f9c8d1da640 1 -- 172.21.15.146:0/126512725 >> 172.21.15.146:0/126512725 conn(0x7f9c880d26c0 msgr2=0x7f9c880d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:26.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.555+0000 7f9c8d1da640 1 -- 172.21.15.146:0/126512725 shutdown_connections 2024-09-17T03:46:26.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.555+0000 7f9c8d1da640 1 -- 172.21.15.146:0/126512725 wait complete. 2024-09-17T03:46:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.556+0000 7f9c8d1da640 1 Processor -- start 2024-09-17T03:46:26.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.557+0000 7f9c8d1da640 1 -- start start 2024-09-17T03:46:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c8d1da640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c880d1050 0x7f9c8809f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c8d1da640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c880d31e0 0x7f9c881f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c8d1da640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8815cbe0 0x7f9c881f9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c8d1da640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9c880cd970 con 0x7f9c880d31e0 2024-09-17T03:46:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c8d1da640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c880cd7f0 con 0x7f9c8815cbe0 2024-09-17T03:46:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c8d1da640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9c880cdaf0 con 0x7f9c880d1050 2024-09-17T03:46:26.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c7e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c880d31e0 0x7f9c881f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c7e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c880d31e0 0x7f9c881f90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57334/0 (socket says 172.21.15.146:57334) 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c7e59c640 1 -- 172.21.15.146:0/1196943022 learned_addr learned my addr 172.21.15.146:0/1196943022 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c86d9d640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c880d1050 0x7f9c8809f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c8759e640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8815cbe0 0x7f9c881f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c7e59c640 1 -- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c880d1050 msgr2=0x7f9c8809f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c7e59c640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c880d1050 0x7f9c8809f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c7e59c640 1 -- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8815cbe0 msgr2=0x7f9c881f9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.558+0000 7f9c7e59c640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8815cbe0 0x7f9c881f9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.559+0000 7f9c7e59c640 1 -- 172.21.15.146:0/1196943022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8806f080 con 0x7f9c880d31e0 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.559+0000 7f9c7e59c640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c880d31e0 0x7f9c881f90e0 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000d700 tx=0x7f9c7000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.559+0000 7f9c7ffff640 1 -- 172.21.15.146:0/1196943022 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70017070 con 0x7f9c880d31e0 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.559+0000 7f9c7ffff640 1 -- 172.21.15.146:0/1196943022 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c70005310 con 0x7f9c880d31e0 2024-09-17T03:46:26.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.559+0000 7f9c8d1da640 1 -- 172.21.15.146:0/1196943022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8806f360 con 0x7f9c880d31e0 2024-09-17T03:46:26.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.559+0000 7f9c7ffff640 1 -- 172.21.15.146:0/1196943022 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70009820 con 0x7f9c880d31e0 2024-09-17T03:46:26.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.559+0000 7f9c8d1da640 1 -- 172.21.15.146:0/1196943022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c8809e2b0 con 0x7f9c880d31e0 2024-09-17T03:46:26.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.560+0000 7f9c8d1da640 1 -- 172.21.15.146:0/1196943022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c8806edf0 con 0x7f9c880d31e0 2024-09-17T03:46:26.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.561+0000 7f9c7ffff640 1 -- 172.21.15.146:0/1196943022 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c700099c0 con 0x7f9c880d31e0 2024-09-17T03:46:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.561+0000 7f9c7ffff640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9c68078bc0 0x7f9c6807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.561+0000 7f9c7ffff640 1 -- 172.21.15.146:0/1196943022 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f9c7009adc0 con 0x7f9c880d31e0 2024-09-17T03:46:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.562+0000 7f9c86d9d640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9c68078bc0 0x7f9c6807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.562+0000 7f9c86d9d640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9c68078bc0 0x7f9c6807b0d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9c780058e0 tx=0x7f9c78005f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:26.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.566+0000 7f9c7ffff640 1 -- 172.21.15.146:0/1196943022 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9c70062b30 con 0x7f9c880d31e0 2024-09-17T03:46:26.774 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.775+0000 7f9c8d1da640 1 -- 172.21.15.146:0/1196943022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9c8809cb00 con 0x7f9c880d31e0 2024-09-17T03:46:26.775 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:46:26.776+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:46:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.779+0000 7f9c7ffff640 1 -- 172.21.15.146:0/1196943022 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v146) ==== 161+0+0 (secure 0 0 0) 0x7f9c70067560 con 0x7f9c880d31e0 2024-09-17T03:46:26.778 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:46:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 -- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9c68078bc0 msgr2=0x7f9c6807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9c68078bc0 0x7f9c6807b0d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9c780058e0 tx=0x7f9c78005f70 comp rx=0 tx=0).stop 2024-09-17T03:46:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 -- 172.21.15.146:0/1196943022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c880d31e0 msgr2=0x7f9c881f90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c880d31e0 0x7f9c881f90e0 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000d700 tx=0x7f9c7000dbc0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 -- 172.21.15.146:0/1196943022 shutdown_connections 2024-09-17T03:46:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9c68078bc0 0x7f9c6807b0d0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c8815cbe0 0x7f9c881f9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c880d31e0 0x7f9c881f90e0 unknown :-1 s=CLOSED pgs=2498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 --2- 172.21.15.146:0/1196943022 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c880d1050 0x7f9c8809f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 -- 172.21.15.146:0/1196943022 >> 172.21.15.146:0/1196943022 conn(0x7f9c880d26c0 msgr2=0x7f9c880b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 -- 172.21.15.146:0/1196943022 shutdown_connections 2024-09-17T03:46:26.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.782+0000 7f9c8d1da640 1 -- 172.21.15.146:0/1196943022 wait complete. 2024-09-17T03:46:26.785 INFO:tasks.ceph.mds.a.smithi146.stderr: -7406> 2024-09-17T03:45:44.677+0000 7fdca0e54640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:46:26.789 INFO:tasks.ceph.mds.a.smithi146.stderr: -3903> 2024-09-17T03:45:52.579+0000 7fdc9ce4c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 pv8 ap=4 DIRTYPARENT s=5242880 n(v0 rc2024-09-17T03:45:51.508810+0000 b5242880 1=1+0)->n(v0 rc2024-09-17T03:45:51.511810+0000 b6291456 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={8663=0-12582912@1} caps={8663=pAsxLsXsxFcb/pAsxXsxFxwb@5},l=8663 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x5629e15a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(29)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T03:46:26.794 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:46:26.843 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:46:26.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.914+0000 7fc9f952b640 1 -- 172.21.15.146:0/3878643158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f415bb20 msgr2=0x7fc9f40cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.914+0000 7fc9f952b640 1 --2- 172.21.15.146:0/3878643158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f415bb20 0x7fc9f40cf9c0 secure :-1 s=READY pgs=2502 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40ae280 tx=0x7fc9e402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.914+0000 7fc9f952b640 1 -- 172.21.15.146:0/3878643158 shutdown_connections 2024-09-17T03:46:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.914+0000 7fc9f952b640 1 --2- 172.21.15.146:0/3878643158 >> v2:172.21.15.179:3300/0 conn(0x7fc9f40cff00 0x7fc9f40cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.914+0000 7fc9f952b640 1 --2- 172.21.15.146:0/3878643158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f415bb20 0x7fc9f40cf9c0 unknown :-1 s=CLOSED pgs=2502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.914+0000 7fc9f952b640 1 -- 172.21.15.146:0/3878643158 >> 172.21.15.146:0/3878643158 conn(0x7fc9f40d0ce0 msgr2=0x7fc9f40d10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.914+0000 7fc9f952b640 1 -- 172.21.15.146:0/3878643158 shutdown_connections 2024-09-17T03:46:26.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.914+0000 7fc9f952b640 1 -- 172.21.15.146:0/3878643158 wait complete. 2024-09-17T03:46:26.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.916+0000 7fc9f952b640 1 Processor -- start 2024-09-17T03:46:26.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.916+0000 7fc9f952b640 1 -- start start 2024-09-17T03:46:26.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.917+0000 7fc9f952b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9f40ccd50 0x7fc9f41f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.917+0000 7fc9f952b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9f40cff00 0x7fc9f40b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.917+0000 7fc9f952b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f415bb20 0x7fc9f40b6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.917+0000 7fc9f952b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f40cbbc0 con 0x7fc9f415bb20 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.917+0000 7fc9f952b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f40cba40 con 0x7fc9f40cff00 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.917+0000 7fc9f952b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f40cbd40 con 0x7fc9f40ccd50 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.917+0000 7fc9f37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f415bb20 0x7fc9f40b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.917+0000 7fc9f37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f415bb20 0x7fc9f40b6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57380/0 (socket says 172.21.15.146:57380) 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.917+0000 7fc9f37fe640 1 -- 172.21.15.146:0/3224826073 learned_addr learned my addr 172.21.15.146:0/3224826073 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.917+0000 7fc9f27fc640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9f40cff00 0x7fc9f40b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.917+0000 7fc9f2ffd640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9f40ccd50 0x7fc9f41f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9f37fe640 1 -- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9f40ccd50 msgr2=0x7fc9f41f3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9f37fe640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9f40ccd50 0x7fc9f41f3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9f37fe640 1 -- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9f40cff00 msgr2=0x7fc9f40b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9f37fe640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9f40cff00 0x7fc9f40b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9f37fe640 1 -- 172.21.15.146:0/3224826073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f409cf60 con 0x7fc9f415bb20 2024-09-17T03:46:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9f2ffd640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9f40ccd50 0x7fc9f41f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9f37fe640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f415bb20 0x7fc9f40b6850 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00cae0 tx=0x7fc9ec00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9db7fe640 1 -- 172.21.15.146:0/3224826073 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec016020 con 0x7fc9f415bb20 2024-09-17T03:46:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9db7fe640 1 -- 172.21.15.146:0/3224826073 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9ec00ad30 con 0x7fc9f415bb20 2024-09-17T03:46:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9f952b640 1 -- 172.21.15.146:0/3224826073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f409d240 con 0x7fc9f415bb20 2024-09-17T03:46:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9db7fe640 1 -- 172.21.15.146:0/3224826073 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec012680 con 0x7fc9f415bb20 2024-09-17T03:46:26.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.918+0000 7fc9f952b640 1 -- 172.21.15.146:0/3224826073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f409d800 con 0x7fc9f415bb20 2024-09-17T03:46:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.919+0000 7fc9f952b640 1 -- 172.21.15.146:0/3224826073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f41578e0 con 0x7fc9f415bb20 2024-09-17T03:46:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.920+0000 7fc9db7fe640 1 -- 172.21.15.146:0/3224826073 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9ec019020 con 0x7fc9f415bb20 2024-09-17T03:46:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.920+0000 7fc9db7fe640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9e0078b90 0x7fc9e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.920+0000 7fc9db7fe640 1 -- 172.21.15.146:0/3224826073 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5795+0+0 (secure 0 0 0) 0x7fc9ec09b300 con 0x7fc9f415bb20 2024-09-17T03:46:26.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.920+0000 7fc9f2ffd640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9e0078b90 0x7fc9e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:26.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.921+0000 7fc9f2ffd640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9e0078b90 0x7fc9e007b0a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4034000 tx=0x7fc9e4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:26.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:26.925+0000 7fc9db7fe640 1 -- 172.21.15.146:0/3224826073 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc9ec020020 con 0x7fc9f415bb20 2024-09-17T03:46:27.138 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.139+0000 7fc9f952b640 1 -- 172.21.15.146:0/3224826073 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc9f40cede0 con 0x7fc9f415bb20 2024-09-17T03:46:27.782 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.783+0000 7fc9db7fe640 1 -- 172.21.15.146:0/3224826073 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v147) ==== 104+0+0 (secure 0 0 0) 0x7fc9ec0636e0 con 0x7fc9f415bb20 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 -- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9e0078b90 msgr2=0x7fc9e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9e0078b90 0x7fc9e007b0a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4034000 tx=0x7fc9e4004730 comp rx=0 tx=0).stop 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 -- 172.21.15.146:0/3224826073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f415bb20 msgr2=0x7fc9f40b6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f415bb20 0x7fc9f40b6850 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00cae0 tx=0x7fc9ec00a060 comp rx=0 tx=0).stop 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 -- 172.21.15.146:0/3224826073 shutdown_connections 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9e0078b90 0x7fc9e007b0a0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f415bb20 0x7fc9f40b6850 unknown :-1 s=CLOSED pgs=2503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9f40cff00 0x7fc9f40b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 --2- 172.21.15.146:0/3224826073 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9f40ccd50 0x7fc9f41f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 -- 172.21.15.146:0/3224826073 >> 172.21.15.146:0/3224826073 conn(0x7fc9f40d0ce0 msgr2=0x7fc9f415c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 -- 172.21.15.146:0/3224826073 shutdown_connections 2024-09-17T03:46:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.785+0000 7fc9f952b640 1 -- 172.21.15.146:0/3224826073 wait complete. 2024-09-17T03:46:27.798 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:46:27.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.916+0000 7f095684a640 1 -- 172.21.15.146:0/2675638723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f095015f490 msgr2=0x7f0950073c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:27.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.916+0000 7f095684a640 1 --2- 172.21.15.146:0/2675638723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f095015f490 0x7f0950073c10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0944009860 tx=0x7f094402a530 comp rx=0 tx=0).stop 2024-09-17T03:46:27.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.917+0000 7f095684a640 1 -- 172.21.15.146:0/2675638723 shutdown_connections 2024-09-17T03:46:27.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.917+0000 7f095684a640 1 --2- 172.21.15.146:0/2675638723 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f095015f490 0x7f0950073c10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:27.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.917+0000 7f095684a640 1 -- 172.21.15.146:0/2675638723 >> 172.21.15.146:0/2675638723 conn(0x7f095006e2b0 msgr2=0x7f095006e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:27.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.917+0000 7f095684a640 1 -- 172.21.15.146:0/2675638723 shutdown_connections 2024-09-17T03:46:27.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.917+0000 7f095684a640 1 -- 172.21.15.146:0/2675638723 wait complete. 2024-09-17T03:46:27.917 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.918+0000 7f095684a640 1 Processor -- start 2024-09-17T03:46:27.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.919+0000 7f095684a640 1 -- start start 2024-09-17T03:46:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f095684a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0950145160 0x7f09500b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f095684a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f095015f490 0x7f09500b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f095684a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f095015f8a0 0x7f0950142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f095684a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0950074150 con 0x7f0950145160 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f095684a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f09500d0f90 con 0x7f095015f8a0 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f095684a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f09500742d0 con 0x7f095015f490 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f094ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0950145160 0x7f09500b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f094ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0950145160 0x7f09500b5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55686/0 (socket says 172.21.15.146:55686) 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f094ffff640 1 -- 172.21.15.146:0/2845586967 learned_addr learned my addr 172.21.15.146:0/2845586967 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f094ffff640 1 -- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f095015f490 msgr2=0x7f09500b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f094f7fe640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f095015f490 0x7f09500b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f094ffff640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f095015f490 0x7f09500b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f0954de7640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f095015f8a0 0x7f0950142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f094ffff640 1 -- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f095015f8a0 msgr2=0x7f0950142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:27.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f094ffff640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f095015f8a0 0x7f0950142e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:27.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f094ffff640 1 -- 172.21.15.146:0/2845586967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09500aac90 con 0x7f0950145160 2024-09-17T03:46:27.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f094ffff640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0950145160 0x7f09500b5410 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f094000c430 tx=0x7f094000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:27.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.920+0000 7f094cff9640 1 -- 172.21.15.146:0/2845586967 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940017070 con 0x7f0950145160 2024-09-17T03:46:27.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.921+0000 7f095684a640 1 -- 172.21.15.146:0/2845586967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09501f4510 con 0x7f0950145160 2024-09-17T03:46:27.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.921+0000 7f094cff9640 1 -- 172.21.15.146:0/2845586967 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09400053e0 con 0x7f0950145160 2024-09-17T03:46:27.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.921+0000 7f094cff9640 1 -- 172.21.15.146:0/2845586967 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940003850 con 0x7f0950145160 2024-09-17T03:46:27.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.921+0000 7f095684a640 1 -- 172.21.15.146:0/2845586967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09501f3a30 con 0x7f0950145160 2024-09-17T03:46:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.922+0000 7f095684a640 1 -- 172.21.15.146:0/2845586967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0950073c10 con 0x7f0950145160 2024-09-17T03:46:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.922+0000 7f094cff9640 1 -- 172.21.15.146:0/2845586967 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f094001a070 con 0x7f0950145160 2024-09-17T03:46:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.923+0000 7f094cff9640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f093c078b90 0x7f093c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.923+0000 7f094cff9640 1 -- 172.21.15.146:0/2845586967 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5795+0+0 (secure 0 0 0) 0x7f094009a210 con 0x7f0950145160 2024-09-17T03:46:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.923+0000 7f094f7fe640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f093c078b90 0x7f093c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.923+0000 7f094f7fe640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f093c078b90 0x7f093c07b0a0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0944034000 tx=0x7f0944004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:27.927+0000 7f094cff9640 1 -- 172.21.15.146:0/2845586967 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0940062570 con 0x7f0950145160 2024-09-17T03:46:28.104 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.105+0000 7f095684a640 1 -- 172.21.15.146:0/2845586967 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0950069ae0 con 0x7f0950145160 2024-09-17T03:46:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.792+0000 7f094cff9640 1 -- 172.21.15.146:0/2845586967 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v190) ==== 181+0+0 (secure 0 0 0) 0x7f0940061e70 con 0x7f0950145160 2024-09-17T03:46:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:46:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.795+0000 7f095684a640 1 -- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f093c078b90 msgr2=0x7f093c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.795+0000 7f095684a640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f093c078b90 0x7f093c07b0a0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0944034000 tx=0x7f0944004730 comp rx=0 tx=0).stop 2024-09-17T03:46:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.795+0000 7f095684a640 1 -- 172.21.15.146:0/2845586967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0950145160 msgr2=0x7f09500b5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.795+0000 7f095684a640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0950145160 0x7f09500b5410 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7f094000c430 tx=0x7f094000c8f0 comp rx=0 tx=0).stop 2024-09-17T03:46:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.796+0000 7f095684a640 1 -- 172.21.15.146:0/2845586967 shutdown_connections 2024-09-17T03:46:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.796+0000 7f095684a640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f093c078b90 0x7f093c07b0a0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:28.795 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.796+0000 7f095684a640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f095015f8a0 0x7f0950142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.796+0000 7f095684a640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f095015f490 0x7f09500b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.796+0000 7f095684a640 1 --2- 172.21.15.146:0/2845586967 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0950145160 0x7f09500b5410 unknown :-1 s=CLOSED pgs=2505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.796+0000 7f095684a640 1 -- 172.21.15.146:0/2845586967 >> 172.21.15.146:0/2845586967 conn(0x7f095006e2b0 msgr2=0x7f09500b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.796+0000 7f095684a640 1 -- 172.21.15.146:0/2845586967 shutdown_connections 2024-09-17T03:46:28.796 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.796+0000 7f095684a640 1 -- 172.21.15.146:0/2845586967 wait complete. 2024-09-17T03:46:28.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:46:28.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.936+0000 7fcc15d62640 1 -- 172.21.15.146:0/200111394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbf8004800 msgr2=0x7fcbf8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:28.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.936+0000 7fcc15d62640 1 --2- 172.21.15.146:0/200111394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbf8004800 0x7fcbf8004c10 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7fcc100c81d0 tx=0x7fcbf8005830 comp rx=0 tx=0).stop 2024-09-17T03:46:28.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.936+0000 7fcc0ffff640 1 -- 172.21.15.146:0/200111394 reap_dead start 2024-09-17T03:46:28.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.936+0000 7fcc15d62640 1 -- 172.21.15.146:0/200111394 shutdown_connections 2024-09-17T03:46:28.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.936+0000 7fcc15d62640 1 -- 172.21.15.146:0/200111394 >> 172.21.15.146:0/200111394 conn(0x7fcc1009ddc0 msgr2=0x7fcc100d4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:28.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.936+0000 7fcc15d62640 1 -- 172.21.15.146:0/200111394 shutdown_connections 2024-09-17T03:46:28.936 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.936+0000 7fcc15d62640 1 -- 172.21.15.146:0/200111394 wait complete. 2024-09-17T03:46:28.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.938+0000 7fcc15d62640 1 Processor -- start 2024-09-17T03:46:28.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.938+0000 7fcc15d62640 1 -- start start 2024-09-17T03:46:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.939+0000 7fcc15d62640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbf8004800 0x7fcc1015e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.939+0000 7fcc15d62640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc1015be20 0x7fcc101616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.939+0000 7fcc15d62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc1015c230 0x7fcc10161c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.939+0000 7fcc15d62640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1006d410 con 0x7fcc1015c230 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.939+0000 7fcc15d62640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1006d290 con 0x7fcc1015be20 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.939+0000 7fcc15d62640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1006d590 con 0x7fcbf8004800 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.939+0000 7fcc0ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc1015c230 0x7fcc10161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.939+0000 7fcc0ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc1015c230 0x7fcc10161c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55698/0 (socket says 172.21.15.146:55698) 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.939+0000 7fcc0ffff640 1 -- 172.21.15.146:0/3200918147 learned_addr learned my addr 172.21.15.146:0/3200918147 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcc0f7fe640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbf8004800 0x7fcc1015e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcc0effd640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc1015be20 0x7fcc101616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcc0ffff640 1 -- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbf8004800 msgr2=0x7fcc1015e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcc0ffff640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbf8004800 0x7fcc1015e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcc0ffff640 1 -- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc1015be20 msgr2=0x7fcc101616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcc0ffff640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc1015be20 0x7fcc101616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcc0ffff640 1 -- 172.21.15.146:0/3200918147 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc100a25f0 con 0x7fcc1015c230 2024-09-17T03:46:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcc0ffff640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc1015c230 0x7fcc10161c10 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7fcc1008f020 tx=0x7fcc08006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcbf7fff640 1 -- 172.21.15.146:0/3200918147 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08015070 con 0x7fcc1015c230 2024-09-17T03:46:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcbf7fff640 1 -- 172.21.15.146:0/3200918147 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc0800fa60 con 0x7fcc1015c230 2024-09-17T03:46:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcc15d62640 1 -- 172.21.15.146:0/3200918147 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc101f8fb0 con 0x7fcc1015c230 2024-09-17T03:46:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcbf7fff640 1 -- 172.21.15.146:0/3200918147 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08011430 con 0x7fcc1015c230 2024-09-17T03:46:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.940+0000 7fcc15d62640 1 -- 172.21.15.146:0/3200918147 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc101f9570 con 0x7fcc1015c230 2024-09-17T03:46:28.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.941+0000 7fcc15d62640 1 -- 172.21.15.146:0/3200918147 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc100d2cf0 con 0x7fcc1015c230 2024-09-17T03:46:28.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.942+0000 7fcbf7fff640 1 -- 172.21.15.146:0/3200918147 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc080115d0 con 0x7fcc1015c230 2024-09-17T03:46:28.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.943+0000 7fcbf7fff640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcbfc078bc0 0x7fcbfc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:28.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.943+0000 7fcbf7fff640 1 -- 172.21.15.146:0/3200918147 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 5357+0+0 (secure 0 0 0) 0x7fcc0809b800 con 0x7fcc1015c230 2024-09-17T03:46:28.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.943+0000 7fcc0f7fe640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcbfc078bc0 0x7fcbfc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:28.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.943+0000 7fcc0f7fe640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcbfc078bc0 0x7fcbfc07b0d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fcc00000c00 tx=0x7fcc00006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:28.947+0000 7fcbf7fff640 1 -- 172.21.15.146:0/3200918147 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc08063870 con 0x7fcc1015c230 2024-09-17T03:46:29.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.125+0000 7fcc15d62640 1 -- 172.21.15.146:0/3200918147 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcc100d1540 con 0x7fcc1015c230 2024-09-17T03:46:29.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.794+0000 7fcbf7fff640 1 -- 172.21.15.146:0/3200918147 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v191) ==== 169+0+0 (secure 0 0 0) 0x7fcc080682a0 con 0x7fcc1015c230 2024-09-17T03:46:29.793 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.797+0000 7fcc15d62640 1 -- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcbfc078bc0 msgr2=0x7fcbfc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.797+0000 7fcc15d62640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcbfc078bc0 0x7fcbfc07b0d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fcc00000c00 tx=0x7fcc00006b70 comp rx=0 tx=0).stop 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.797+0000 7fcc15d62640 1 -- 172.21.15.146:0/3200918147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc1015c230 msgr2=0x7fcc10161c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.797+0000 7fcc15d62640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc1015c230 0x7fcc10161c10 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7fcc1008f020 tx=0x7fcc08006720 comp rx=0 tx=0).stop 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.797+0000 7fcc15d62640 1 -- 172.21.15.146:0/3200918147 shutdown_connections 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.797+0000 7fcc15d62640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcbfc078bc0 0x7fcbfc07b0d0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.797+0000 7fcc15d62640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc1015c230 0x7fcc10161c10 unknown :-1 s=CLOSED pgs=2508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.797+0000 7fcc15d62640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcc1015be20 0x7fcc101616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.797+0000 7fcc15d62640 1 --2- 172.21.15.146:0/3200918147 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcbf8004800 0x7fcc1015e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.797+0000 7fcc15d62640 1 -- 172.21.15.146:0/3200918147 >> 172.21.15.146:0/3200918147 conn(0x7fcc1009ddc0 msgr2=0x7fcc100b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.798+0000 7fcc15d62640 1 -- 172.21.15.146:0/3200918147 shutdown_connections 2024-09-17T03:46:29.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.798+0000 7fcc15d62640 1 -- 172.21.15.146:0/3200918147 wait complete. 2024-09-17T03:46:29.817 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:46:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.937+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2792703584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e5c15f600 msgr2=0x7f8e5c15fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.937+0000 7f8e62d4a640 1 --2- 172.21.15.146:0/2792703584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e5c15f600 0x7f8e5c15fa10 secure :-1 s=READY pgs=2510 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c075460 tx=0x7f8e4802a530 comp rx=0 tx=0).stop 2024-09-17T03:46:29.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.937+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2792703584 shutdown_connections 2024-09-17T03:46:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.937+0000 7f8e62d4a640 1 --2- 172.21.15.146:0/2792703584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e5c15f600 0x7f8e5c15fa10 unknown :-1 s=CLOSED pgs=2510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.937+0000 7f8e62d4a640 1 --2- 172.21.15.146:0/2792703584 >> v2:172.21.15.179:3300/0 conn(0x7f8e5c0b0cc0 0x7f8e5c15ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.937+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2792703584 >> 172.21.15.146:0/2792703584 conn(0x7f8e5c0d16c0 msgr2=0x7f8e5c0d1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.937+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2792703584 shutdown_connections 2024-09-17T03:46:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.937+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2792703584 wait complete. 2024-09-17T03:46:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.939+0000 7f8e62d4a640 1 Processor -- start 2024-09-17T03:46:29.939 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.939+0000 7f8e62d4a640 1 -- start start 2024-09-17T03:46:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.940+0000 7f8e62d4a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e5c0734e0 0x7f8e5c0cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.940+0000 7f8e62d4a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e5c0b0cc0 0x7f8e5c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.940+0000 7f8e62d4a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e5c15f600 0x7f8e5c06cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.940+0000 7f8e62d4a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c070640 con 0x7f8e5c0734e0 2024-09-17T03:46:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.940+0000 7f8e62d4a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c0704c0 con 0x7f8e5c0b0cc0 2024-09-17T03:46:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.940+0000 7f8e62d4a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5c0707c0 con 0x7f8e5c15f600 2024-09-17T03:46:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e60ae6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e5c0734e0 0x7f8e5c0cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e60ae6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e5c0734e0 0x7f8e5c0cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55726/0 (socket says 172.21.15.146:55726) 2024-09-17T03:46:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e60ae6640 1 -- 172.21.15.146:0/2778540806 learned_addr learned my addr 172.21.15.146:0/2778540806 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:29.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e5bfff640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e5c0b0cc0 0x7f8e5c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e612e7640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e5c15f600 0x7f8e5c06cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e60ae6640 1 -- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e5c15f600 msgr2=0x7f8e5c06cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e60ae6640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e5c15f600 0x7f8e5c06cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e60ae6640 1 -- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e5c0b0cc0 msgr2=0x7f8e5c0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e60ae6640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e5c0b0cc0 0x7f8e5c0b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e60ae6640 1 -- 172.21.15.146:0/2778540806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c15a590 con 0x7f8e5c0734e0 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e612e7640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e5c15f600 0x7f8e5c06cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e60ae6640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e5c0734e0 0x7f8e5c0cb620 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000c970 tx=0x7f8e5000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e597fa640 1 -- 172.21.15.146:0/2778540806 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50007bb0 con 0x7f8e5c0734e0 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e597fa640 1 -- 172.21.15.146:0/2778540806 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e50007e40 con 0x7f8e5c0734e0 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2778540806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5c15a870 con 0x7f8e5c0734e0 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e597fa640 1 -- 172.21.15.146:0/2778540806 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50005280 con 0x7f8e5c0734e0 2024-09-17T03:46:29.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.941+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2778540806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5c15ae30 con 0x7f8e5c0734e0 2024-09-17T03:46:29.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.942+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2778540806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e5c070ce0 con 0x7f8e5c0734e0 2024-09-17T03:46:29.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.943+0000 7f8e597fa640 1 -- 172.21.15.146:0/2778540806 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e50005420 con 0x7f8e5c0734e0 2024-09-17T03:46:29.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.944+0000 7f8e597fa640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e40078bc0 0x7f8e4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:29.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.944+0000 7f8e597fa640 1 -- 172.21.15.146:0/2778540806 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f8e5009ae00 con 0x7f8e5c0734e0 2024-09-17T03:46:29.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.944+0000 7f8e5bfff640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e40078bc0 0x7f8e4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:29.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.945+0000 7f8e5bfff640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e40078bc0 0x7f8e4007b0d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8e48034000 tx=0x7f8e48004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:29.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:29.948+0000 7f8e597fa640 1 -- 172.21.15.146:0/2778540806 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e50014030 con 0x7f8e5c0734e0 2024-09-17T03:46:30.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.124+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2778540806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f8e5c0d1ec0 con 0x7f8e5c0734e0 2024-09-17T03:46:30.127 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.128+0000 7f8e597fa640 1 -- 172.21.15.146:0/2778540806 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v65) ==== 71+0+0 (secure 0 0 0) 0x7f8e50063040 con 0x7f8e5c0734e0 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e40078bc0 msgr2=0x7f8e4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e40078bc0 0x7f8e4007b0d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8e48034000 tx=0x7f8e48004730 comp rx=0 tx=0).stop 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2778540806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e5c0734e0 msgr2=0x7f8e5c0cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e5c0734e0 0x7f8e5c0cb620 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000c970 tx=0x7f8e5000ce30 comp rx=0 tx=0).stop 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2778540806 shutdown_connections 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f8e40078bc0 0x7f8e4007b0d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e5c15f600 0x7f8e5c06cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e5c0b0cc0 0x7f8e5c0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 --2- 172.21.15.146:0/2778540806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e5c0734e0 0x7f8e5c0cb620 unknown :-1 s=CLOSED pgs=2511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2778540806 >> 172.21.15.146:0/2778540806 conn(0x7f8e5c0d16c0 msgr2=0x7f8e5c0b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2778540806 shutdown_connections 2024-09-17T03:46:30.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.130+0000 7f8e62d4a640 1 -- 172.21.15.146:0/2778540806 wait complete. 2024-09-17T03:46:30.141 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-17T03:46:30.189 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:46:30.191 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:46:30.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.257+0000 7f252ae7e640 1 -- 172.21.15.146:0/858928824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25240d0fc0 msgr2=0x7f252406dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:30.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.257+0000 7f252ae7e640 1 --2- 172.21.15.146:0/858928824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25240d0fc0 0x7f252406dec0 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7f2524074620 tx=0x7f251802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.257+0000 7f252ae7e640 1 -- 172.21.15.146:0/858928824 shutdown_connections 2024-09-17T03:46:30.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.257+0000 7f252ae7e640 1 --2- 172.21.15.146:0/858928824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25240d0fc0 0x7f252406dec0 unknown :-1 s=CLOSED pgs=2512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.257+0000 7f252ae7e640 1 --2- 172.21.15.146:0/858928824 >> v2:172.21.15.179:3300/0 conn(0x7f252406fc00 0x7f252415b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.257+0000 7f252ae7e640 1 -- 172.21.15.146:0/858928824 >> 172.21.15.146:0/858928824 conn(0x7f25240b34c0 msgr2=0x7f25240b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:30.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.257+0000 7f252ae7e640 1 -- 172.21.15.146:0/858928824 shutdown_connections 2024-09-17T03:46:30.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.257+0000 7f252ae7e640 1 -- 172.21.15.146:0/858928824 wait complete. 2024-09-17T03:46:30.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.259+0000 7f252ae7e640 1 Processor -- start 2024-09-17T03:46:30.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.259+0000 7f252ae7e640 1 -- start start 2024-09-17T03:46:30.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252ae7e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252406e400 0x7f2524154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:30.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252ae7e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f252406fc00 0x7f252415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:30.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252ae7e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25240d0fc0 0x7f2524146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:30.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252ae7e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f25240712c0 con 0x7f25240d0fc0 2024-09-17T03:46:30.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252ae7e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2524073cc0 con 0x7f252406fc00 2024-09-17T03:46:30.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252ae7e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f25241f36e0 con 0x7f252406e400 2024-09-17T03:46:30.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252941b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25240d0fc0 0x7f2524146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:30.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252941b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25240d0fc0 0x7f2524146fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55742/0 (socket says 172.21.15.146:55742) 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252941b640 1 -- 172.21.15.146:0/97744151 learned_addr learned my addr 172.21.15.146:0/97744151 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f2523fff640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f252406fc00 0x7f252415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f2528c1a640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252406e400 0x7f2524154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252941b640 1 -- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252406e400 msgr2=0x7f2524154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252941b640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252406e400 0x7f2524154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252941b640 1 -- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f252406fc00 msgr2=0x7f252415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252941b640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f252406fc00 0x7f252415cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252941b640 1 -- 172.21.15.146:0/97744151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2524154e30 con 0x7f25240d0fc0 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f2528c1a640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252406e400 0x7f2524154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252941b640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25240d0fc0 0x7f2524146fd0 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f251c00c600 tx=0x7f251c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f25217fa640 1 -- 172.21.15.146:0/97744151 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c0052d0 con 0x7f25240d0fc0 2024-09-17T03:46:30.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f25217fa640 1 -- 172.21.15.146:0/97744151 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f251c001620 con 0x7f25240d0fc0 2024-09-17T03:46:30.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252ae7e640 1 -- 172.21.15.146:0/97744151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2524147510 con 0x7f25240d0fc0 2024-09-17T03:46:30.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f25217fa640 1 -- 172.21.15.146:0/97744151 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c001a70 con 0x7f25240d0fc0 2024-09-17T03:46:30.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.261+0000 7f252ae7e640 1 -- 172.21.15.146:0/97744151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f252415c400 con 0x7f25240d0fc0 2024-09-17T03:46:30.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.262+0000 7f252ae7e640 1 -- 172.21.15.146:0/97744151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2524074220 con 0x7f25240d0fc0 2024-09-17T03:46:30.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.263+0000 7f25217fa640 1 -- 172.21.15.146:0/97744151 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f251c0035f0 con 0x7f25240d0fc0 2024-09-17T03:46:30.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.263+0000 7f25217fa640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2510078bc0 0x7f251007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:30.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.264+0000 7f25217fa640 1 -- 172.21.15.146:0/97744151 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f251c09d4e0 con 0x7f25240d0fc0 2024-09-17T03:46:30.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.264+0000 7f2528c1a640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2510078bc0 0x7f251007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:30.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.264+0000 7f2528c1a640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2510078bc0 0x7f251007b0d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f2514005fd0 tx=0x7f2514009480 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:30.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.268+0000 7f25217fa640 1 -- 172.21.15.146:0/97744151 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f251c01f020 con 0x7f25240d0fc0 2024-09-17T03:46:30.509 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.510+0000 7f252ae7e640 1 -- 172.21.15.146:0/97744151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f2524154bc0 con 0x7f25240d0fc0 2024-09-17T03:46:30.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.804+0000 7f25217fa640 1 -- 172.21.15.146:0/97744151 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v646) ==== 133+0+0 (secure 0 0 0) 0x7f2524147510 con 0x7f25240d0fc0 2024-09-17T03:46:30.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 -- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2510078bc0 msgr2=0x7f251007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:30.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2510078bc0 0x7f251007b0d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f2514005fd0 tx=0x7f2514009480 comp rx=0 tx=0).stop 2024-09-17T03:46:30.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 -- 172.21.15.146:0/97744151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25240d0fc0 msgr2=0x7f2524146fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25240d0fc0 0x7f2524146fd0 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f251c00c600 tx=0x7f251c00cac0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 -- 172.21.15.146:0/97744151 shutdown_connections 2024-09-17T03:46:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2510078bc0 0x7f251007b0d0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25240d0fc0 0x7f2524146fd0 unknown :-1 s=CLOSED pgs=2513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f252406fc00 0x7f252415cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 --2- 172.21.15.146:0/97744151 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f252406e400 0x7f2524154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 -- 172.21.15.146:0/97744151 >> 172.21.15.146:0/97744151 conn(0x7f25240b34c0 msgr2=0x7f25240b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:30.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 -- 172.21.15.146:0/97744151 shutdown_connections 2024-09-17T03:46:30.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.807+0000 7f252ae7e640 1 -- 172.21.15.146:0/97744151 wait complete. 2024-09-17T03:46:30.817 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-17T03:46:30.818 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) 2024-09-17T03:46:30.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:46:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.971+0000 7f716a47e640 1 -- 172.21.15.146:0/102906273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641652e0 msgr2=0x7f7164167700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.971+0000 7f716a47e640 1 --2- 172.21.15.146:0/102906273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641652e0 0x7f7164167700 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7f715c005fd0 tx=0x7f715c02a780 comp rx=0 tx=0).stop 2024-09-17T03:46:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.972+0000 7f716a47e640 1 -- 172.21.15.146:0/102906273 shutdown_connections 2024-09-17T03:46:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.972+0000 7f716a47e640 1 --2- 172.21.15.146:0/102906273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641652e0 0x7f7164167700 unknown :-1 s=CLOSED pgs=2515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.972+0000 7f716a47e640 1 -- 172.21.15.146:0/102906273 >> 172.21.15.146:0/102906273 conn(0x7f71640b41b0 msgr2=0x7f71640b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.972+0000 7f716a47e640 1 -- 172.21.15.146:0/102906273 shutdown_connections 2024-09-17T03:46:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.972+0000 7f716a47e640 1 -- 172.21.15.146:0/102906273 wait complete. 2024-09-17T03:46:30.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.973+0000 7f716a47e640 1 Processor -- start 2024-09-17T03:46:30.972 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.974+0000 7f716a47e640 1 -- start start 2024-09-17T03:46:30.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f716a47e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71641600b0 0x7f7164155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:30.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f716a47e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641617a0 0x7f7164166180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f716a47e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71641652e0 0x7f71641f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f716a47e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7164167fd0 con 0x7f71641617a0 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f716a47e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7164167e50 con 0x7f71641652e0 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f716a47e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7164168150 con 0x7f71641600b0 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f71637fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641617a0 0x7f7164166180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f71637fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641617a0 0x7f7164166180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55748/0 (socket says 172.21.15.146:55748) 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f71637fe640 1 -- 172.21.15.146:0/1830984102 learned_addr learned my addr 172.21.15.146:0/1830984102 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f7168a1b640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71641652e0 0x7f71641f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f7163fff640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71641600b0 0x7f7164155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f71637fe640 1 -- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71641600b0 msgr2=0x7f7164155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f71637fe640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71641600b0 0x7f7164155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f71637fe640 1 -- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71641652e0 msgr2=0x7f71641f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:30.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f71637fe640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71641652e0 0x7f71641f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f71637fe640 1 -- 172.21.15.146:0/1830984102 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716415cb40 con 0x7f71641617a0 2024-09-17T03:46:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.975+0000 7f71637fe640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641617a0 0x7f7164166180 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7f715800b420 tx=0x7f715800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.976+0000 7f7160ff9640 1 -- 172.21.15.146:0/1830984102 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158011830 con 0x7f71641617a0 2024-09-17T03:46:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.976+0000 7f7160ff9640 1 -- 172.21.15.146:0/1830984102 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7158016070 con 0x7f71641617a0 2024-09-17T03:46:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.976+0000 7f716a47e640 1 -- 172.21.15.146:0/1830984102 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716415ce20 con 0x7f71641617a0 2024-09-17T03:46:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.976+0000 7f7160ff9640 1 -- 172.21.15.146:0/1830984102 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158011d60 con 0x7f71641617a0 2024-09-17T03:46:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.976+0000 7f716a47e640 1 -- 172.21.15.146:0/1830984102 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71640b1d80 con 0x7f71641617a0 2024-09-17T03:46:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.977+0000 7f716a47e640 1 -- 172.21.15.146:0/1830984102 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716415c8b0 con 0x7f71641617a0 2024-09-17T03:46:30.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.977+0000 7f7160ff9640 1 -- 172.21.15.146:0/1830984102 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f715801b460 con 0x7f71641617a0 2024-09-17T03:46:30.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.978+0000 7f7160ff9640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7150078b90 0x7f715007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:30.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.978+0000 7f7160ff9640 1 -- 172.21.15.146:0/1830984102 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f715809a420 con 0x7f71641617a0 2024-09-17T03:46:30.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.978+0000 7f7163fff640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7150078b90 0x7f715007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:30.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.978+0000 7f7163fff640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7150078b90 0x7f715007b0a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f71640d1660 tx=0x7f7154009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:30.982+0000 7f7160ff9640 1 -- 172.21.15.146:0/1830984102 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7158020020 con 0x7f71641617a0 2024-09-17T03:46:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.158+0000 7f716a47e640 1 -- 172.21.15.146:0/1830984102 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71640b65c0 con 0x7f71641617a0 2024-09-17T03:46:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.159+0000 7f7160ff9640 1 -- 172.21.15.146:0/1830984102 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) ==== 74+0+13092 (secure 0 0 0) 0x7f71580625a0 con 0x7f71641617a0 2024-09-17T03:46:31.158 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:31.158 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":191,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:46:29.793177+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/2793356470":"2024-09-18T03:46:26.776329+0000","172.21.15.146:6833/2793356470":"2024-09-18T03:46:26.776329+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:46:31.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.161+0000 7f716a47e640 1 -- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7150078b90 msgr2=0x7f715007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:31.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.161+0000 7f716a47e640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7150078b90 0x7f715007b0a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f71640d1660 tx=0x7f7154009040 comp rx=0 tx=0).stop 2024-09-17T03:46:31.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.161+0000 7f716a47e640 1 -- 172.21.15.146:0/1830984102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641617a0 msgr2=0x7f7164166180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:31.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.161+0000 7f716a47e640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641617a0 0x7f7164166180 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7f715800b420 tx=0x7f715800b8e0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.161+0000 7f716a47e640 1 -- 172.21.15.146:0/1830984102 shutdown_connections 2024-09-17T03:46:31.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.161+0000 7f716a47e640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7150078b90 0x7f715007b0a0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.161+0000 7f716a47e640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f71641652e0 0x7f71641f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.161+0000 7f716a47e640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641617a0 0x7f7164166180 unknown :-1 s=CLOSED pgs=2516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.161+0000 7f716a47e640 1 --2- 172.21.15.146:0/1830984102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f71641600b0 0x7f7164155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.161+0000 7f716a47e640 1 -- 172.21.15.146:0/1830984102 >> 172.21.15.146:0/1830984102 conn(0x7f71640b41b0 msgr2=0x7f7164071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.162+0000 7f716a47e640 1 -- 172.21.15.146:0/1830984102 shutdown_connections 2024-09-17T03:46:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.162+0000 7f716a47e640 1 -- 172.21.15.146:0/1830984102 wait complete. 2024-09-17T03:46:31.172 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:46:31.172 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:46:31.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.289+0000 7ff2d4d20640 1 -- 172.21.15.146:0/67378118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d015edf0 msgr2=0x7ff2d00cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:31.288 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.289+0000 7ff2d4d20640 1 --2- 172.21.15.146:0/67378118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d015edf0 0x7ff2d00cf3c0 secure :-1 s=READY pgs=2517 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00cb890 tx=0x7ff2c002aa30 comp rx=0 tx=0).stop 2024-09-17T03:46:31.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.289+0000 7ff2d4d20640 1 -- 172.21.15.146:0/67378118 shutdown_connections 2024-09-17T03:46:31.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.289+0000 7ff2d4d20640 1 --2- 172.21.15.146:0/67378118 >> v2:172.21.15.179:3300/0 conn(0x7ff2d0069230 0x7ff2d0069640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.289+0000 7ff2d4d20640 1 --2- 172.21.15.146:0/67378118 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d015edf0 0x7ff2d00cf3c0 unknown :-1 s=CLOSED pgs=2517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.289+0000 7ff2d4d20640 1 -- 172.21.15.146:0/67378118 >> 172.21.15.146:0/67378118 conn(0x7ff2d00d1770 msgr2=0x7ff2d00d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:31.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.289+0000 7ff2d4d20640 1 -- 172.21.15.146:0/67378118 shutdown_connections 2024-09-17T03:46:31.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.289+0000 7ff2d4d20640 1 -- 172.21.15.146:0/67378118 wait complete. 2024-09-17T03:46:31.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.291+0000 7ff2d4d20640 1 Processor -- start 2024-09-17T03:46:31.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.291+0000 7ff2d4d20640 1 -- start start 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.292+0000 7ff2d4d20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d0069230 0x7ff2d0154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.292+0000 7ff2d4d20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2d015edf0 0x7ff2d00cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.292+0000 7ff2d4d20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2d01629c0 0x7ff2d00cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.292+0000 7ff2d4d20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d006e940 con 0x7ff2d0069230 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.292+0000 7ff2d4d20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d00b3b10 con 0x7ff2d015edf0 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.292+0000 7ff2d4d20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d00d4210 con 0x7ff2d01629c0 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.292+0000 7ff2ce59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d0069230 0x7ff2d0154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.292+0000 7ff2ce59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d0069230 0x7ff2d0154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55774/0 (socket says 172.21.15.146:55774) 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.292+0000 7ff2ce59c640 1 -- 172.21.15.146:0/990459793 learned_addr learned my addr 172.21.15.146:0/990459793 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.292+0000 7ff2cdd9b640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2d015edf0 0x7ff2d00cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.292+0000 7ff2ced9d640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2d01629c0 0x7ff2d00cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:31.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2ce59c640 1 -- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2d01629c0 msgr2=0x7ff2d00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2ce59c640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2d01629c0 0x7ff2d00cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2ce59c640 1 -- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2d015edf0 msgr2=0x7ff2d00cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2ce59c640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2d015edf0 0x7ff2d00cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2ce59c640 1 -- 172.21.15.146:0/990459793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d00cb9b0 con 0x7ff2d0069230 2024-09-17T03:46:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2ced9d640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2d01629c0 0x7ff2d00cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2ce59c640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d0069230 0x7ff2d0154200 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009d60 tx=0x7ff2c0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2c6ffd640 1 -- 172.21.15.146:0/990459793 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0033050 con 0x7ff2d0069230 2024-09-17T03:46:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2c6ffd640 1 -- 172.21.15.146:0/990459793 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2c00045c0 con 0x7ff2d0069230 2024-09-17T03:46:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2d4d20640 1 -- 172.21.15.146:0/990459793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d0154740 con 0x7ff2d0069230 2024-09-17T03:46:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2c6ffd640 1 -- 172.21.15.146:0/990459793 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0038450 con 0x7ff2d0069230 2024-09-17T03:46:31.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.293+0000 7ff2d4d20640 1 -- 172.21.15.146:0/990459793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d00ce810 con 0x7ff2d0069230 2024-09-17T03:46:31.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.294+0000 7ff2d4d20640 1 -- 172.21.15.146:0/990459793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d0069640 con 0x7ff2d0069230 2024-09-17T03:46:31.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.295+0000 7ff2c6ffd640 1 -- 172.21.15.146:0/990459793 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2c0036070 con 0x7ff2d0069230 2024-09-17T03:46:31.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.295+0000 7ff2c6ffd640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff2b0078bc0 0x7ff2b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:31.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.295+0000 7ff2c6ffd640 1 -- 172.21.15.146:0/990459793 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7ff2c00bbc90 con 0x7ff2d0069230 2024-09-17T03:46:31.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.295+0000 7ff2cdd9b640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff2b0078bc0 0x7ff2b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:31.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.296+0000 7ff2cdd9b640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff2b0078bc0 0x7ff2b007b0d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00b4350 tx=0x7ff2b8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:31.299 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.300+0000 7ff2c6ffd640 1 -- 172.21.15.146:0/990459793 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2c0084460 con 0x7ff2d0069230 2024-09-17T03:46:31.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.472+0000 7ff2d4d20640 1 -- 172.21.15.146:0/990459793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff2d01614d0 con 0x7ff2d0069230 2024-09-17T03:46:31.471 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.472+0000 7ff2c6ffd640 1 -- 172.21.15.146:0/990459793 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v191) ==== 93+0+10 (secure 0 0 0) 0x7ff2c0083d60 con 0x7ff2d0069230 2024-09-17T03:46:31.472 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:46:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.474+0000 7ff2d4d20640 1 -- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff2b0078bc0 msgr2=0x7ff2b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.474+0000 7ff2d4d20640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff2b0078bc0 0x7ff2b007b0d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00b4350 tx=0x7ff2b8005f90 comp rx=0 tx=0).stop 2024-09-17T03:46:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.474+0000 7ff2d4d20640 1 -- 172.21.15.146:0/990459793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d0069230 msgr2=0x7ff2d0154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.474+0000 7ff2d4d20640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d0069230 0x7ff2d0154200 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009d60 tx=0x7ff2c0003f90 comp rx=0 tx=0).stop 2024-09-17T03:46:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.474+0000 7ff2d4d20640 1 -- 172.21.15.146:0/990459793 shutdown_connections 2024-09-17T03:46:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.474+0000 7ff2d4d20640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff2b0078bc0 0x7ff2b007b0d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.474+0000 7ff2d4d20640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2d01629c0 0x7ff2d00cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.474+0000 7ff2d4d20640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2d015edf0 0x7ff2d00cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.474+0000 7ff2d4d20640 1 --2- 172.21.15.146:0/990459793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d0069230 0x7ff2d0154200 unknown :-1 s=CLOSED pgs=2518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.474+0000 7ff2d4d20640 1 -- 172.21.15.146:0/990459793 >> 172.21.15.146:0/990459793 conn(0x7ff2d00d1770 msgr2=0x7ff2d01618a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:31.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.475+0000 7ff2d4d20640 1 -- 172.21.15.146:0/990459793 shutdown_connections 2024-09-17T03:46:31.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.475+0000 7ff2d4d20640 1 -- 172.21.15.146:0/990459793 wait complete. 2024-09-17T03:46:31.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2024-09-17T03:46:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.599+0000 7fbd2bd20640 1 -- 172.21.15.146:0/462686162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd10003c30 msgr2=0x7fbd10004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.599+0000 7fbd2bd20640 1 --2- 172.21.15.146:0/462686162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd10003c30 0x7fbd10004080 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7fbd20001880 tx=0x7fbd10005830 comp rx=0 tx=0).stop 2024-09-17T03:46:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.599+0000 7fbd2bd20640 1 -- 172.21.15.146:0/462686162 shutdown_connections 2024-09-17T03:46:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.599+0000 7fbd2bd20640 1 --2- 172.21.15.146:0/462686162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd10003c30 0x7fbd10004080 unknown :-1 s=CLOSED pgs=2520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.599+0000 7fbd2bd20640 1 -- 172.21.15.146:0/462686162 >> 172.21.15.146:0/462686162 conn(0x7fbd240b41b0 msgr2=0x7fbd240b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.599+0000 7fbd2bd20640 1 -- 172.21.15.146:0/462686162 shutdown_connections 2024-09-17T03:46:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.599+0000 7fbd2bd20640 1 -- 172.21.15.146:0/462686162 wait complete. 2024-09-17T03:46:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.601+0000 7fbd2bd20640 1 Processor -- start 2024-09-17T03:46:31.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.601+0000 7fbd2bd20640 1 -- start start 2024-09-17T03:46:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.602+0000 7fbd2bd20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd10003c30 0x7fbd241621e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.602+0000 7fbd2bd20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd241557c0 0x7fbd2415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.602+0000 7fbd2bd20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd240cfc60 0x7fbd2415ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.602+0000 7fbd2bd20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbd240b6950 con 0x7fbd240cfc60 2024-09-17T03:46:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.602+0000 7fbd2bd20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbd240b67d0 con 0x7fbd241557c0 2024-09-17T03:46:31.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.602+0000 7fbd2bd20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbd240b6ad0 con 0x7fbd10003c30 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd2a2bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd240cfc60 0x7fbd2415ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd2a2bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd240cfc60 0x7fbd2415ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55794/0 (socket says 172.21.15.146:55794) 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd2a2bd640 1 -- 172.21.15.146:0/4257818 learned_addr learned my addr 172.21.15.146:0/4257818 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd292bb640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd241557c0 0x7fbd2415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd29abc640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd10003c30 0x7fbd241621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd2a2bd640 1 -- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd10003c30 msgr2=0x7fbd241621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd2a2bd640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd10003c30 0x7fbd241621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd2a2bd640 1 -- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd241557c0 msgr2=0x7fbd2415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd2a2bd640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd241557c0 0x7fbd2415a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd2a2bd640 1 -- 172.21.15.146:0/4257818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd24164ad0 con 0x7fbd240cfc60 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd292bb640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd241557c0 0x7fbd2415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:31.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd2a2bd640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd240cfc60 0x7fbd2415ac40 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c005fd0 tx=0x7fbd1c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd1a7fc640 1 -- 172.21.15.146:0/4257818 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c003d80 con 0x7fbd240cfc60 2024-09-17T03:46:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd1a7fc640 1 -- 172.21.15.146:0/4257818 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd1c004b20 con 0x7fbd240cfc60 2024-09-17T03:46:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd2bd20640 1 -- 172.21.15.146:0/4257818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2415bc00 con 0x7fbd240cfc60 2024-09-17T03:46:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd1a7fc640 1 -- 172.21.15.146:0/4257818 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c004030 con 0x7fbd240cfc60 2024-09-17T03:46:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.603+0000 7fbd2bd20640 1 -- 172.21.15.146:0/4257818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd241642d0 con 0x7fbd240cfc60 2024-09-17T03:46:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.604+0000 7fbd2bd20640 1 -- 172.21.15.146:0/4257818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd2415b970 con 0x7fbd240cfc60 2024-09-17T03:46:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.605+0000 7fbd1a7fc640 1 -- 172.21.15.146:0/4257818 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd1c0041d0 con 0x7fbd240cfc60 2024-09-17T03:46:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.606+0000 7fbd1a7fc640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd08078b90 0x7fbd0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.606+0000 7fbd1a7fc640 1 -- 172.21.15.146:0/4257818 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7fbd1c09b930 con 0x7fbd240cfc60 2024-09-17T03:46:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.606+0000 7fbd29abc640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd08078b90 0x7fbd0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.606+0000 7fbd29abc640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd08078b90 0x7fbd0807b0a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fbd20001850 tx=0x7fbd200013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:31.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.610+0000 7fbd1a7fc640 1 -- 172.21.15.146:0/4257818 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd1c064100 con 0x7fbd240cfc60 2024-09-17T03:46:31.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:31.853+0000 7fbd2bd20640 1 -- 172.21.15.146:0/4257818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) -- 0x7fbd240b7030 con 0x7fbd240cfc60 2024-09-17T03:46:32.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.811+0000 7fbd1a7fc640 1 -- 172.21.15.146:0/4257818 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v648) ==== 150+0+0 (secure 0 0 0) 0x7fbd1c063a00 con 0x7fbd240cfc60 2024-09-17T03:46:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 -- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd08078b90 msgr2=0x7fbd0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd08078b90 0x7fbd0807b0a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fbd20001850 tx=0x7fbd200013b0 comp rx=0 tx=0).stop 2024-09-17T03:46:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 -- 172.21.15.146:0/4257818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd240cfc60 msgr2=0x7fbd2415ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd240cfc60 0x7fbd2415ac40 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c005fd0 tx=0x7fbd1c00f790 comp rx=0 tx=0).stop 2024-09-17T03:46:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 -- 172.21.15.146:0/4257818 shutdown_connections 2024-09-17T03:46:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbd08078b90 0x7fbd0807b0a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd240cfc60 0x7fbd2415ac40 unknown :-1 s=CLOSED pgs=2521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd241557c0 0x7fbd2415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 --2- 172.21.15.146:0/4257818 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbd10003c30 0x7fbd241621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 -- 172.21.15.146:0/4257818 >> 172.21.15.146:0/4257818 conn(0x7fbd240b41b0 msgr2=0x7fbd2415e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 -- 172.21.15.146:0/4257818 shutdown_connections 2024-09-17T03:46:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.814+0000 7fbd2bd20640 1 -- 172.21.15.146:0/4257818 wait complete. 2024-09-17T03:46:32.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:46:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.942+0000 7fdbea943640 1 -- 172.21.15.146:0/338242491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd0003c10 msgr2=0x7fdbd0004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:32.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.942+0000 7fdbea943640 1 --2- 172.21.15.146:0/338242491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd0003c10 0x7fdbd0004060 secure :-1 s=READY pgs=2523 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc001880 tx=0x7fdbd0005830 comp rx=0 tx=0).stop 2024-09-17T03:46:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.942+0000 7fdbe8ee0640 1 -- 172.21.15.146:0/338242491 reap_dead start 2024-09-17T03:46:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.942+0000 7fdbea943640 1 -- 172.21.15.146:0/338242491 shutdown_connections 2024-09-17T03:46:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.942+0000 7fdbea943640 1 -- 172.21.15.146:0/338242491 >> 172.21.15.146:0/338242491 conn(0x7fdbe40b41b0 msgr2=0x7fdbe40b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.942+0000 7fdbea943640 1 -- 172.21.15.146:0/338242491 shutdown_connections 2024-09-17T03:46:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.942+0000 7fdbea943640 1 -- 172.21.15.146:0/338242491 wait complete. 2024-09-17T03:46:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.944+0000 7fdbea943640 1 Processor -- start 2024-09-17T03:46:32.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.944+0000 7fdbea943640 1 -- start start 2024-09-17T03:46:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.945+0000 7fdbea943640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbd0003c10 0x7fdbe41f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.945+0000 7fdbea943640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe41561c0 0x7fdbe40cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.945+0000 7fdbea943640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbe4159880 0x7fdbe4159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.945+0000 7fdbea943640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe4161f40 con 0x7fdbe41561c0 2024-09-17T03:46:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.945+0000 7fdbea943640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe4161dc0 con 0x7fdbd0003c10 2024-09-17T03:46:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.945+0000 7fdbea943640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe41620c0 con 0x7fdbe4159880 2024-09-17T03:46:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.945+0000 7fdbe37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe41561c0 0x7fdbe40cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.945+0000 7fdbe37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe41561c0 0x7fdbe40cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55810/0 (socket says 172.21.15.146:55810) 2024-09-17T03:46:32.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.945+0000 7fdbe37fe640 1 -- 172.21.15.146:0/1222425956 learned_addr learned my addr 172.21.15.146:0/1222425956 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe3fff640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbd0003c10 0x7fdbe41f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe8ee0640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbe4159880 0x7fdbe4159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe37fe640 1 -- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbe4159880 msgr2=0x7fdbe4159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe37fe640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbe4159880 0x7fdbe4159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe37fe640 1 -- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbd0003c10 msgr2=0x7fdbe41f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe37fe640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbd0003c10 0x7fdbe41f34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe37fe640 1 -- 172.21.15.146:0/1222425956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe415a1d0 con 0x7fdbe41561c0 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe8ee0640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbe4159880 0x7fdbe4159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe37fe640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe41561c0 0x7fdbe40cfc10 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4011ae0 tx=0x7fdbd4009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe0ff9640 1 -- 172.21.15.146:0/1222425956 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd401e070 con 0x7fdbe41561c0 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe0ff9640 1 -- 172.21.15.146:0/1222425956 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbd4004480 con 0x7fdbe41561c0 2024-09-17T03:46:32.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbea943640 1 -- 172.21.15.146:0/1222425956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe4156cf0 con 0x7fdbe41561c0 2024-09-17T03:46:32.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbe0ff9640 1 -- 172.21.15.146:0/1222425956 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400fc60 con 0x7fdbe41561c0 2024-09-17T03:46:32.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.946+0000 7fdbea943640 1 -- 172.21.15.146:0/1222425956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe41567a0 con 0x7fdbe41561c0 2024-09-17T03:46:32.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.947+0000 7fdbea943640 1 -- 172.21.15.146:0/1222425956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe40b65c0 con 0x7fdbe41561c0 2024-09-17T03:46:32.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.948+0000 7fdbe0ff9640 1 -- 172.21.15.146:0/1222425956 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbd4021070 con 0x7fdbe41561c0 2024-09-17T03:46:32.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.949+0000 7fdbe0ff9640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbc4078b90 0x7fdbc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:32.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.949+0000 7fdbe0ff9640 1 -- 172.21.15.146:0/1222425956 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7fdbd409b4c0 con 0x7fdbe41561c0 2024-09-17T03:46:32.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.949+0000 7fdbe3fff640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbc4078b90 0x7fdbc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:32.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.949+0000 7fdbe3fff640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbc4078b90 0x7fdbc407b0a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc001850 tx=0x7fdbcc0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:32.952 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:32.953+0000 7fdbe0ff9640 1 -- 172.21.15.146:0/1222425956 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdbe415a1d0 con 0x7fdbe41561c0 2024-09-17T03:46:33.128 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.129+0000 7fdbea943640 1 -- 172.21.15.146:0/1222425956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fdbe4156f80 con 0x7fdbe41561c0 2024-09-17T03:46:33.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.130+0000 7fdbe0ff9640 1 -- 172.21.15.146:0/1222425956 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v65) ==== 59+0+2294 (secure 0 0 0) 0x7fdbd40635b0 con 0x7fdbe41561c0 2024-09-17T03:46:33.129 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:46:33.129 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:46:33.129 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:46:33.129 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:46:33.130 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:46:33.130 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:46:33.130 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:46:33.130 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:46:33.130 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:46:33.130 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:46:33.130 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:46:33.130 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:46:33.130 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:46:33.131 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:46:33.132 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:46:33.132 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:46:33.132 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:46:33.132 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:46:33.132 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:46:33.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 -- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbc4078b90 msgr2=0x7fdbc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:33.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbc4078b90 0x7fdbc407b0a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc001850 tx=0x7fdbcc0013b0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 -- 172.21.15.146:0/1222425956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe41561c0 msgr2=0x7fdbe40cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:33.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe41561c0 0x7fdbe40cfc10 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4011ae0 tx=0x7fdbd4009e40 comp rx=0 tx=0).stop 2024-09-17T03:46:33.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 -- 172.21.15.146:0/1222425956 shutdown_connections 2024-09-17T03:46:33.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbc4078b90 0x7fdbc407b0a0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbe4159880 0x7fdbe4159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe41561c0 0x7fdbe40cfc10 unknown :-1 s=CLOSED pgs=2524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 --2- 172.21.15.146:0/1222425956 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbd0003c10 0x7fdbe41f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 -- 172.21.15.146:0/1222425956 >> 172.21.15.146:0/1222425956 conn(0x7fdbe40b41b0 msgr2=0x7fdbe40707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:33.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 -- 172.21.15.146:0/1222425956 shutdown_connections 2024-09-17T03:46:33.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.132+0000 7fdbea943640 1 -- 172.21.15.146:0/1222425956 wait complete. 2024-09-17T03:46:33.143 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:46:33.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.260+0000 7fb67807f640 1 -- 172.21.15.146:0/2047403114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6700d31e0 msgr2=0x7fb6700cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:33.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.260+0000 7fb67807f640 1 --2- 172.21.15.146:0/2047403114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6700d31e0 0x7fb6700cebc0 secure :-1 s=READY pgs=2525 cs=0 l=1 rev1=1 crypto rx=0x7fb670075770 tx=0x7fb66002aa30 comp rx=0 tx=0).stop 2024-09-17T03:46:33.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.260+0000 7fb67807f640 1 -- 172.21.15.146:0/2047403114 shutdown_connections 2024-09-17T03:46:33.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.260+0000 7fb67807f640 1 --2- 172.21.15.146:0/2047403114 >> v2:172.21.15.179:3300/0 conn(0x7fb67015cbe0 0x7fb6700d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.260+0000 7fb67807f640 1 --2- 172.21.15.146:0/2047403114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6700d31e0 0x7fb6700cebc0 unknown :-1 s=CLOSED pgs=2525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.260+0000 7fb67807f640 1 -- 172.21.15.146:0/2047403114 >> 172.21.15.146:0/2047403114 conn(0x7fb6700d26c0 msgr2=0x7fb6700d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:33.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.260+0000 7fb67807f640 1 -- 172.21.15.146:0/2047403114 shutdown_connections 2024-09-17T03:46:33.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.260+0000 7fb67807f640 1 -- 172.21.15.146:0/2047403114 wait complete. 2024-09-17T03:46:33.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.262+0000 7fb67807f640 1 Processor -- start 2024-09-17T03:46:33.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.262+0000 7fb67807f640 1 -- start start 2024-09-17T03:46:33.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67807f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6700d1050 0x7fb67015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:33.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67807f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6700d31e0 0x7fb6701f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:33.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67807f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67015cbe0 0x7fb6701f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67807f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb6700cd7b0 con 0x7fb67015cbe0 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67807f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb6700b6cf0 con 0x7fb6700d31e0 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67807f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb6700cd930 con 0x7fb6700d1050 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67661c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67015cbe0 0x7fb6701f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67661c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67015cbe0 0x7fb6701f55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55820/0 (socket says 172.21.15.146:55820) 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67661c640 1 -- 172.21.15.146:0/2264334582 learned_addr learned my addr 172.21.15.146:0/2264334582 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb675e1b640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6700d1050 0x7fb67015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67561a640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6700d31e0 0x7fb6701f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67661c640 1 -- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6700d1050 msgr2=0x7fb67015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67661c640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6700d1050 0x7fb67015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67661c640 1 -- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6700d31e0 msgr2=0x7fb6701f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67661c640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6700d31e0 0x7fb6701f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67661c640 1 -- 172.21.15.146:0/2264334582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67015ef50 con 0x7fb67015cbe0 2024-09-17T03:46:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.263+0000 7fb67561a640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6700d31e0 0x7fb6701f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.264+0000 7fb67661c640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67015cbe0 0x7fb6701f55f0 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c3f0 tx=0x7fb66800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.264+0000 7fb66e7fc640 1 -- 172.21.15.146:0/2264334582 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668017070 con 0x7fb67015cbe0 2024-09-17T03:46:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.264+0000 7fb66e7fc640 1 -- 172.21.15.146:0/2264334582 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6680053c0 con 0x7fb67015cbe0 2024-09-17T03:46:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.264+0000 7fb67807f640 1 -- 172.21.15.146:0/2264334582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67015f230 con 0x7fb67015cbe0 2024-09-17T03:46:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.264+0000 7fb66e7fc640 1 -- 172.21.15.146:0/2264334582 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668003850 con 0x7fb67015cbe0 2024-09-17T03:46:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.264+0000 7fb67807f640 1 -- 172.21.15.146:0/2264334582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6701f5fb0 con 0x7fb67015cbe0 2024-09-17T03:46:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.265+0000 7fb67807f640 1 -- 172.21.15.146:0/2264334582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6700cc560 con 0x7fb67015cbe0 2024-09-17T03:46:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.265+0000 7fb66e7fc640 1 -- 172.21.15.146:0/2264334582 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb66801a070 con 0x7fb67015cbe0 2024-09-17T03:46:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.266+0000 7fb66e7fc640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb65c078b90 0x7fb65c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.266+0000 7fb66e7fc640 1 -- 172.21.15.146:0/2264334582 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7fb668099de0 con 0x7fb67015cbe0 2024-09-17T03:46:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.266+0000 7fb675e1b640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb65c078b90 0x7fb65c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.267+0000 7fb675e1b640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb65c078b90 0x7fb65c07b0a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb660035000 tx=0x7fb660004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:33.269 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.270+0000 7fb66e7fc640 1 -- 172.21.15.146:0/2264334582 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6700d1460 con 0x7fb67015cbe0 2024-09-17T03:46:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.444+0000 7fb67807f640 1 -- 172.21.15.146:0/2264334582 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb670072600 con 0x7fb67015cbe0 2024-09-17T03:46:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.448+0000 7fb66e7fc640 1 -- 172.21.15.146:0/2264334582 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v66)=0 v66) ==== 122+0+0 (secure 0 0 0) 0x7fb670072600 con 0x7fb67015cbe0 2024-09-17T03:46:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.450+0000 7fb67807f640 1 -- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb65c078b90 msgr2=0x7fb65c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.450+0000 7fb67807f640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb65c078b90 0x7fb65c07b0a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb660035000 tx=0x7fb660004ab0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.451+0000 7fb67807f640 1 -- 172.21.15.146:0/2264334582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67015cbe0 msgr2=0x7fb6701f55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.451+0000 7fb67807f640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67015cbe0 0x7fb6701f55f0 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c3f0 tx=0x7fb66800c8b0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.451+0000 7fb67807f640 1 -- 172.21.15.146:0/2264334582 shutdown_connections 2024-09-17T03:46:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.451+0000 7fb67807f640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb65c078b90 0x7fb65c07b0a0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.451+0000 7fb67807f640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb67015cbe0 0x7fb6701f55f0 unknown :-1 s=CLOSED pgs=2526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.451+0000 7fb67807f640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb6700d31e0 0x7fb6701f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.451+0000 7fb67807f640 1 --2- 172.21.15.146:0/2264334582 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb6700d1050 0x7fb67015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.451+0000 7fb67807f640 1 -- 172.21.15.146:0/2264334582 >> 172.21.15.146:0/2264334582 conn(0x7fb6700d26c0 msgr2=0x7fb670071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.451+0000 7fb67807f640 1 -- 172.21.15.146:0/2264334582 shutdown_connections 2024-09-17T03:46:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.451+0000 7fb67807f640 1 -- 172.21.15.146:0/2264334582 wait complete. 2024-09-17T03:46:33.461 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:46:33.461 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:46:33.508 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:46:33.559 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:46:33.559 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:46:33.559 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:33.575 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:46:33.575 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:46:33.575 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:33.592 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:46:33.593 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:46:33.593 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:33.631 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:46:33.631 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:46:33.631 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:33.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:46:33.649 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:46:33.649 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:33.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.783+0000 7f04feb62640 1 -- 172.21.15.146:0/2307687467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04f80d4420 msgr2=0x7f04f80d1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:33.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.783+0000 7f04feb62640 1 --2- 172.21.15.146:0/2307687467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04f80d4420 0x7f04f80d1840 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 crypto rx=0x7f04f0005fd0 tx=0x7f04f002a900 comp rx=0 tx=0).stop 2024-09-17T03:46:33.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.783+0000 7f04feb62640 1 -- 172.21.15.146:0/2307687467 shutdown_connections 2024-09-17T03:46:33.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.783+0000 7f04feb62640 1 --2- 172.21.15.146:0/2307687467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04f80d4420 0x7f04f80d1840 unknown :-1 s=CLOSED pgs=2528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.783+0000 7f04feb62640 1 --2- 172.21.15.146:0/2307687467 >> v2:172.21.15.179:3300/0 conn(0x7f04f80d2800 0x7f04f80d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.783+0000 7f04feb62640 1 -- 172.21.15.146:0/2307687467 >> 172.21.15.146:0/2307687467 conn(0x7f04f806ecd0 msgr2=0x7f04f806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:33.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.783+0000 7f04feb62640 1 -- 172.21.15.146:0/2307687467 shutdown_connections 2024-09-17T03:46:33.783 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.783+0000 7f04feb62640 1 -- 172.21.15.146:0/2307687467 wait complete. 2024-09-17T03:46:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.785+0000 7f04feb62640 1 Processor -- start 2024-09-17T03:46:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.785+0000 7f04feb62640 1 -- start start 2024-09-17T03:46:33.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.786+0000 7f04feb62640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04f80cf150 0x7f04f81f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:33.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.786+0000 7f04feb62640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f80d2800 0x7f04f80b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:33.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04feb62640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f80d4420 0x7f04f80b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:33.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04feb62640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f04f80b6a80 con 0x7f04f80cf150 2024-09-17T03:46:33.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04feb62640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f04f815f110 con 0x7f04f80d4420 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04feb62640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f04f80b6c00 con 0x7f04f80d2800 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04fc8fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04f80cf150 0x7f04f81f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04fc8fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04f80cf150 0x7f04f81f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55832/0 (socket says 172.21.15.146:55832) 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04fc8fe640 1 -- 172.21.15.146:0/3782060459 learned_addr learned my addr 172.21.15.146:0/3782060459 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04fd0ff640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f80d4420 0x7f04f80b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04effff640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f80d2800 0x7f04f80b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04fc8fe640 1 -- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f80d2800 msgr2=0x7f04f80b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04fc8fe640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f80d2800 0x7f04f80b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04fc8fe640 1 -- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f80d4420 msgr2=0x7f04f80b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04fc8fe640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f80d4420 0x7f04f80b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04fc8fe640 1 -- 172.21.15.146:0/3782060459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f80aca60 con 0x7f04f80cf150 2024-09-17T03:46:33.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04effff640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f80d2800 0x7f04f80b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:33.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04fc8fe640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04f80cf150 0x7f04f81f89e0 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c970 tx=0x7f04f400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:33.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04ed7fa640 1 -- 172.21.15.146:0/3782060459 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4007bb0 con 0x7f04f80cf150 2024-09-17T03:46:33.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04ed7fa640 1 -- 172.21.15.146:0/3782060459 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04f4007e40 con 0x7f04f80cf150 2024-09-17T03:46:33.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04feb62640 1 -- 172.21.15.146:0/3782060459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f81f9950 con 0x7f04f80cf150 2024-09-17T03:46:33.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04ed7fa640 1 -- 172.21.15.146:0/3782060459 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4005280 con 0x7f04f80cf150 2024-09-17T03:46:33.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.787+0000 7f04feb62640 1 -- 172.21.15.146:0/3782060459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f81f9f10 con 0x7f04f80cf150 2024-09-17T03:46:33.789 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.788+0000 7f04feb62640 1 -- 172.21.15.146:0/3782060459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f81fa150 con 0x7f04f80cf150 2024-09-17T03:46:33.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.789+0000 7f04ed7fa640 1 -- 172.21.15.146:0/3782060459 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f04f4005420 con 0x7f04f80cf150 2024-09-17T03:46:33.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.790+0000 7f04ed7fa640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f04e4078b90 0x7f04e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:33.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.790+0000 7f04ed7fa640 1 -- 172.21.15.146:0/3782060459 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f04f409adc0 con 0x7f04f80cf150 2024-09-17T03:46:33.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.790+0000 7f04effff640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f04e4078b90 0x7f04e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:33.790 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.790+0000 7f04effff640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f04e4078b90 0x7f04e407b0a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f04f80b7df0 tx=0x7f04e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:33.793 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:33.794+0000 7f04ed7fa640 1 -- 172.21.15.146:0/3782060459 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f04f4014030 con 0x7f04f80cf150 2024-09-17T03:46:34.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.003+0000 7f04feb62640 1 -- 172.21.15.146:0/3782060459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04f80b7120 con 0x7f04f80cf150 2024-09-17T03:46:34.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.004+0000 7f04ed7fa640 1 -- 172.21.15.146:0/3782060459 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 147 v147) ==== 95+0+3924 (secure 0 0 0) 0x7f04f4063000 con 0x7f04f80cf150 2024-09-17T03:46:34.003 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:34.004 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":147,"btime":"2024-09-17T03:46:27:780115+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8579,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/190399628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":190399628},{"type":"v1","addr":"172.21.15.179:6837","nonce":190399628}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":9565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/748249037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":748249037},{"type":"v1","addr":"172.21.15.179:6835","nonce":748249037}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":11097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1562825832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1562825832},{"type":"v1","addr":"172.21.15.146:6834","nonce":1562825832}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":140},{"gid":11409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3249695890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3249695890},{"type":"v1","addr":"172.21.15.146:6835","nonce":3249695890}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":147}],"filesystems":[]} 2024-09-17T03:46:34.004 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 147 2024-09-17T03:46:34.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 -- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f04e4078b90 msgr2=0x7f04e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:34.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f04e4078b90 0x7f04e407b0a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f04f80b7df0 tx=0x7f04e8009040 comp rx=0 tx=0).stop 2024-09-17T03:46:34.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 -- 172.21.15.146:0/3782060459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04f80cf150 msgr2=0x7f04f81f89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:34.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04f80cf150 0x7f04f81f89e0 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c970 tx=0x7f04f400ce30 comp rx=0 tx=0).stop 2024-09-17T03:46:34.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 -- 172.21.15.146:0/3782060459 shutdown_connections 2024-09-17T03:46:34.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f04e4078b90 0x7f04e407b0a0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f80d4420 0x7f04f80b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f80d2800 0x7f04f80b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 --2- 172.21.15.146:0/3782060459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04f80cf150 0x7f04f81f89e0 unknown :-1 s=CLOSED pgs=2529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 -- 172.21.15.146:0/3782060459 >> 172.21.15.146:0/3782060459 conn(0x7f04f806ecd0 msgr2=0x7f04f815be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:34.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 -- 172.21.15.146:0/3782060459 shutdown_connections 2024-09-17T03:46:34.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.006+0000 7f04feb62640 1 -- 172.21.15.146:0/3782060459 wait complete. 2024-09-17T03:46:34.017 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:46:34.017 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:46:34.017 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:46:34.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:46:34.018 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:46:34.018 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:46:34.018 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:46:34.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:46:34.018 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:46:34.018 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:46:34.019 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:46:34.019 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:46:34.019 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:46:34.019 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:46:34.019 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:46:34.019 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:46:34.028 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:46:34.028 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:46:34.030 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:46:34.030 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:46:34.031 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:46:34.031 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:46:34.032 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:46:34.032 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:46:34.073 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:46:34.073 DEBUG:teuthology.parallel:result is None 2024-09-17T03:46:34.074 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:46:34.075 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:46:34.075 DEBUG:teuthology.parallel:result is None 2024-09-17T03:46:34.075 DEBUG:teuthology.parallel:result is None 2024-09-17T03:46:34.076 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:46:34.076 DEBUG:teuthology.parallel:result is None 2024-09-17T03:46:34.076 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:46:34.161 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:46:34.161 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:46:34.170 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:46:34.170 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:46:34.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.197+0000 7fe105acc640 1 -- 172.21.15.146:0/1176840328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1000d2800 msgr2=0x7fe1000d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:34.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.197+0000 7fe105acc640 1 --2- 172.21.15.146:0/1176840328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1000d2800 0x7fe1000d1300 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0009900 tx=0x7fe0f002a6e0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.197+0000 7fe105acc640 1 -- 172.21.15.146:0/1176840328 shutdown_connections 2024-09-17T03:46:34.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.197+0000 7fe105acc640 1 --2- 172.21.15.146:0/1176840328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1000d2800 0x7fe1000d1300 unknown :-1 s=CLOSED pgs=2535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.197+0000 7fe105acc640 1 -- 172.21.15.146:0/1176840328 >> 172.21.15.146:0/1176840328 conn(0x7fe10006ecd0 msgr2=0x7fe10006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:34.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.197+0000 7fe105acc640 1 -- 172.21.15.146:0/1176840328 shutdown_connections 2024-09-17T03:46:34.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.197+0000 7fe105acc640 1 -- 172.21.15.146:0/1176840328 wait complete. 2024-09-17T03:46:34.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.199+0000 7fe105acc640 1 Processor -- start 2024-09-17T03:46:34.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.199+0000 7fe105acc640 1 -- start start 2024-09-17T03:46:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.200+0000 7fe105acc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1000cf150 0x7fe10014dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.200+0000 7fe105acc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1000d2800 0x7fe1000cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.200+0000 7fe105acc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1000d4420 0x7fe1000cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.200+0000 7fe105acc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1000d1840 con 0x7fe1000d4420 2024-09-17T03:46:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe105acc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe10015f000 con 0x7fe1000cf150 2024-09-17T03:46:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe105acc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe1000d19c0 con 0x7fe1000d2800 2024-09-17T03:46:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0fffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1000d4420 0x7fe1000cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0fffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1000d4420 0x7fe1000cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55894/0 (socket says 172.21.15.146:55894) 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0fffff640 1 -- 172.21.15.146:0/4029685962 learned_addr learned my addr 172.21.15.146:0/4029685962 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0ff7fe640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1000cf150 0x7fe10014dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0feffd640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1000d2800 0x7fe1000cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0fffff640 1 -- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1000d2800 msgr2=0x7fe1000cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0fffff640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1000d2800 0x7fe1000cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0fffff640 1 -- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1000cf150 msgr2=0x7fe10014dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0fffff640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1000cf150 0x7fe10014dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0fffff640 1 -- 172.21.15.146:0/4029685962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1000cd230 con 0x7fe1000d4420 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0feffd640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1000d2800 0x7fe1000cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0fffff640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1000d4420 0x7fe1000cccf0 secure :-1 s=READY pgs=2536 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800c730 tx=0x7fe0f800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0e7fff640 1 -- 172.21.15.146:0/4029685962 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8003b70 con 0x7fe1000d4420 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0e7fff640 1 -- 172.21.15.146:0/4029685962 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0f8003d10 con 0x7fe1000d4420 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe105acc640 1 -- 172.21.15.146:0/4029685962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10015b2a0 con 0x7fe1000d4420 2024-09-17T03:46:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe0e7fff640 1 -- 172.21.15.146:0/4029685962 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8005330 con 0x7fe1000d4420 2024-09-17T03:46:34.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.201+0000 7fe105acc640 1 -- 172.21.15.146:0/4029685962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1000cbcd0 con 0x7fe1000d4420 2024-09-17T03:46:34.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.202+0000 7fe105acc640 1 -- 172.21.15.146:0/4029685962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1000d1300 con 0x7fe1000d4420 2024-09-17T03:46:34.203 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.203+0000 7fe0e7fff640 1 -- 172.21.15.146:0/4029685962 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe0f80054d0 con 0x7fe1000d4420 2024-09-17T03:46:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.204+0000 7fe0e7fff640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe0ec078bc0 0x7fe0ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.204+0000 7fe0e7fff640 1 -- 172.21.15.146:0/4029685962 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7fe0f809a6c0 con 0x7fe1000d4420 2024-09-17T03:46:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.204+0000 7fe0ff7fe640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe0ec078bc0 0x7fe0ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:34.204 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.205+0000 7fe0ff7fe640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe0ec078bc0 0x7fe0ec07b0d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0033000 tx=0x7fe0f0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:34.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.208+0000 7fe0e7fff640 1 -- 172.21.15.146:0/4029685962 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe0f8062e90 con 0x7fe1000d4420 2024-09-17T03:46:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.394+0000 7fe105acc640 1 -- 172.21.15.146:0/4029685962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe1000cf730 con 0x7fe1000d4420 2024-09-17T03:46:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.828+0000 7fe0e7fff640 1 -- 172.21.15.146:0/4029685962 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v193) ==== 97+0+0 (secure 0 0 0) 0x7fe0f8062790 con 0x7fe1000d4420 2024-09-17T03:46:34.828 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:46:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 -- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe0ec078bc0 msgr2=0x7fe0ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe0ec078bc0 0x7fe0ec07b0d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0033000 tx=0x7fe0f0004730 comp rx=0 tx=0).stop 2024-09-17T03:46:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 -- 172.21.15.146:0/4029685962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1000d4420 msgr2=0x7fe1000cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1000d4420 0x7fe1000cccf0 secure :-1 s=READY pgs=2536 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800c730 tx=0x7fe0f800cb30 comp rx=0 tx=0).stop 2024-09-17T03:46:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 -- 172.21.15.146:0/4029685962 shutdown_connections 2024-09-17T03:46:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe0ec078bc0 0x7fe0ec07b0d0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1000d4420 0x7fe1000cccf0 unknown :-1 s=CLOSED pgs=2536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1000d2800 0x7fe1000cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 --2- 172.21.15.146:0/4029685962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1000cf150 0x7fe10014dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 -- 172.21.15.146:0/4029685962 >> 172.21.15.146:0/4029685962 conn(0x7fe10006ecd0 msgr2=0x7fe1000d48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 -- 172.21.15.146:0/4029685962 shutdown_connections 2024-09-17T03:46:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.831+0000 7fe105acc640 1 -- 172.21.15.146:0/4029685962 wait complete. 2024-09-17T03:46:34.843 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:46:34.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.956+0000 7fbb890c5640 1 -- 172.21.15.146:0/3653053822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb840b6b00 msgr2=0x7fbb840b6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:34.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.956+0000 7fbb890c5640 1 --2- 172.21.15.146:0/3653053822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb840b6b00 0x7fbb840b6f10 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7fbb84073f20 tx=0x7fbb6c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.956+0000 7fbb890c5640 1 -- 172.21.15.146:0/3653053822 shutdown_connections 2024-09-17T03:46:34.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.957+0000 7fbb890c5640 1 --2- 172.21.15.146:0/3653053822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb840b6b00 0x7fbb840b6f10 unknown :-1 s=CLOSED pgs=2538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.957+0000 7fbb890c5640 1 --2- 172.21.15.146:0/3653053822 >> v2:172.21.15.179:3300/0 conn(0x7fbb841600b0 0x7fbb840b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.957+0000 7fbb890c5640 1 -- 172.21.15.146:0/3653053822 >> 172.21.15.146:0/3653053822 conn(0x7fbb840b41b0 msgr2=0x7fbb840b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:34.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.957+0000 7fbb890c5640 1 -- 172.21.15.146:0/3653053822 shutdown_connections 2024-09-17T03:46:34.956 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.957+0000 7fbb890c5640 1 -- 172.21.15.146:0/3653053822 wait complete. 2024-09-17T03:46:34.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.958+0000 7fbb890c5640 1 Processor -- start 2024-09-17T03:46:34.957 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.959+0000 7fbb890c5640 1 -- start start 2024-09-17T03:46:34.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb890c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb840b6b00 0x7fbb84150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:34.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb890c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb840b7450 0x7fbb841f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:34.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb890c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb841600b0 0x7fbb840cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:34.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb890c5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fbb84166ee0 con 0x7fbb840b7450 2024-09-17T03:46:34.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb890c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbb840b7c10 con 0x7fbb841600b0 2024-09-17T03:46:34.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb890c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbb84167060 con 0x7fbb840b6b00 2024-09-17T03:46:34.960 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb7a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb840b7450 0x7fbb841f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb7a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb840b7450 0x7fbb841f3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55912/0 (socket says 172.21.15.146:55912) 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb7a59c640 1 -- 172.21.15.146:0/2315894482 learned_addr learned my addr 172.21.15.146:0/2315894482 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb8359e640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb841600b0 0x7fbb840cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb82d9d640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb840b6b00 0x7fbb84150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb7a59c640 1 -- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb840b6b00 msgr2=0x7fbb84150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb7a59c640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb840b6b00 0x7fbb84150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb7a59c640 1 -- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb841600b0 msgr2=0x7fbb840cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb7a59c640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb841600b0 0x7fbb840cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.960+0000 7fbb7a59c640 1 -- 172.21.15.146:0/2315894482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8415aab0 con 0x7fbb840b7450 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.961+0000 7fbb7a59c640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb840b7450 0x7fbb841f3fe0 secure :-1 s=READY pgs=2539 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c000c00 tx=0x7fbb6c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.961+0000 7fbb7bfff640 1 -- 172.21.15.146:0/2315894482 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c03e030 con 0x7fbb840b7450 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.961+0000 7fbb7bfff640 1 -- 172.21.15.146:0/2315894482 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb6c0047a0 con 0x7fbb840b7450 2024-09-17T03:46:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.961+0000 7fbb7bfff640 1 -- 172.21.15.146:0/2315894482 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c035040 con 0x7fbb840b7450 2024-09-17T03:46:34.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.961+0000 7fbb890c5640 1 -- 172.21.15.146:0/2315894482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8415ad90 con 0x7fbb840b7450 2024-09-17T03:46:34.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.961+0000 7fbb890c5640 1 -- 172.21.15.146:0/2315894482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb840cec20 con 0x7fbb840b7450 2024-09-17T03:46:34.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.962+0000 7fbb890c5640 1 -- 172.21.15.146:0/2315894482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb840b6f10 con 0x7fbb840b7450 2024-09-17T03:46:34.962 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.963+0000 7fbb7bfff640 1 -- 172.21.15.146:0/2315894482 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb6c041030 con 0x7fbb840b7450 2024-09-17T03:46:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.963+0000 7fbb7bfff640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb64078bc0 0x7fbb6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.963+0000 7fbb7bfff640 1 -- 172.21.15.146:0/2315894482 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 4857+0+0 (secure 0 0 0) 0x7fbb6c0bb140 con 0x7fbb840b7450 2024-09-17T03:46:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.964+0000 7fbb82d9d640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb64078bc0 0x7fbb6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.964+0000 7fbb82d9d640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb64078bc0 0x7fbb6407b0d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fbb74005860 tx=0x7fbb74005f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:34.967 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:34.968+0000 7fbb7bfff640 1 -- 172.21.15.146:0/2315894482 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbb6c083310 con 0x7fbb840b7450 2024-09-17T03:46:35.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.210+0000 7fbb890c5640 1 -- 172.21.15.146:0/2315894482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbb8415f4c0 con 0x7fbb840b7450 2024-09-17T03:46:35.209 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.210+0000 7fbb7bfff640 1 -- 172.21.15.146:0/2315894482 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) ==== 80+0+5304 (secure 0 0 0) 0x7fbb6c087d40 con 0x7fbb840b7450 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.210 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:46:35.211 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.212 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.213 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.214 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.215 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.216 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.217 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:46:35.217 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:46:35.217 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.217 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:46:35.217 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:46:35.217 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.217 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.217 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.217 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:46:35.218 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.219 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:46:35.220 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.221 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:46:35.221 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:46:35.221 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:46:35.221 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:46:35.221 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.221 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.221 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.221 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:46:35.221 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:46:35.221 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:46:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:46:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:46:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:46:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:46:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.222 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:46:35.223 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:46:35.223 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.223 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.223 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:46:35.223 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.223 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:46:35.223 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:46:35.223 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:46:35.223 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:46:35.223 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:46:35.223 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:46:35.224 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.224 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.224 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:46:35.224 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:46:35.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.212+0000 7fbb890c5640 1 -- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb64078bc0 msgr2=0x7fbb6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:35.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.212+0000 7fbb890c5640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb64078bc0 0x7fbb6407b0d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fbb74005860 tx=0x7fbb74005f70 comp rx=0 tx=0).stop 2024-09-17T03:46:35.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.212+0000 7fbb890c5640 1 -- 172.21.15.146:0/2315894482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb840b7450 msgr2=0x7fbb841f3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:35.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.212+0000 7fbb890c5640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb840b7450 0x7fbb841f3fe0 secure :-1 s=READY pgs=2539 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c000c00 tx=0x7fbb6c0039e0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.225 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.212+0000 7fbb890c5640 1 -- 172.21.15.146:0/2315894482 shutdown_connections 2024-09-17T03:46:35.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.212+0000 7fbb890c5640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fbb64078bc0 0x7fbb6407b0d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.212+0000 7fbb890c5640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbb841600b0 0x7fbb840cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.212+0000 7fbb890c5640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb840b7450 0x7fbb841f3fe0 unknown :-1 s=CLOSED pgs=2539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.212+0000 7fbb890c5640 1 --2- 172.21.15.146:0/2315894482 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbb840b6b00 0x7fbb84150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.212+0000 7fbb890c5640 1 -- 172.21.15.146:0/2315894482 >> 172.21.15.146:0/2315894482 conn(0x7fbb840b41b0 msgr2=0x7fbb84071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:35.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.213+0000 7fbb890c5640 1 -- 172.21.15.146:0/2315894482 shutdown_connections 2024-09-17T03:46:35.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.213+0000 7fbb890c5640 1 -- 172.21.15.146:0/2315894482 wait complete. 2024-09-17T03:46:35.227 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:46:35.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.340+0000 7f728ef32640 1 -- 172.21.15.146:0/1939035486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7288070fc0 msgr2=0x7f728815c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:35.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.340+0000 7f728ef32640 1 --2- 172.21.15.146:0/1939035486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7288070fc0 0x7f728815c9a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f72780098e0 tx=0x7f727802a530 comp rx=0 tx=0).stop 2024-09-17T03:46:35.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.340+0000 7f728ef32640 1 -- 172.21.15.146:0/1939035486 shutdown_connections 2024-09-17T03:46:35.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.340+0000 7f728ef32640 1 --2- 172.21.15.146:0/1939035486 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72880cfe10 0x7f72880d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.340+0000 7f728ef32640 1 --2- 172.21.15.146:0/1939035486 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7288070fc0 0x7f728815c9a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.340+0000 7f728ef32640 1 -- 172.21.15.146:0/1939035486 >> 172.21.15.146:0/1939035486 conn(0x7f72880b3880 msgr2=0x7f72880d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:35.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.340+0000 7f728ef32640 1 -- 172.21.15.146:0/1939035486 shutdown_connections 2024-09-17T03:46:35.340 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.340+0000 7f728ef32640 1 -- 172.21.15.146:0/1939035486 wait complete. 2024-09-17T03:46:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.342+0000 7f728ef32640 1 Processor -- start 2024-09-17T03:46:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.342+0000 7f728ef32640 1 -- start start 2024-09-17T03:46:35.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ef32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7288070fc0 0x7f728814aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:35.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ef32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72880735b0 0x7f7288150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:35.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ef32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72880cfe10 0x7f728814cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:35.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ef32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f72880d0af0 con 0x7f7288070fc0 2024-09-17T03:46:35.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ef32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f72880d0970 con 0x7f72880735b0 2024-09-17T03:46:35.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ef32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f72880d0c70 con 0x7f72880cfe10 2024-09-17T03:46:35.344 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ccce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7288070fc0 0x7f728814aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ccce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7288070fc0 0x7f728814aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55918/0 (socket says 172.21.15.146:55918) 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ccce640 1 -- 172.21.15.146:0/3367594376 learned_addr learned my addr 172.21.15.146:0/3367594376 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f7287fff640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72880735b0 0x7f7288150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728d4cf640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72880cfe10 0x7f728814cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ccce640 1 -- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72880cfe10 msgr2=0x7f728814cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ccce640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72880cfe10 0x7f728814cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ccce640 1 -- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72880735b0 msgr2=0x7f7288150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ccce640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72880735b0 0x7f7288150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ccce640 1 -- 172.21.15.146:0/3367594376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72881f9d70 con 0x7f7288070fc0 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728d4cf640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72880cfe10 0x7f728814cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ccce640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7288070fc0 0x7f728814aad0 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7f727802ab20 tx=0x7f7278004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:35.345 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f72857fa640 1 -- 172.21.15.146:0/3367594376 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278005cf0 con 0x7f7288070fc0 2024-09-17T03:46:35.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f72857fa640 1 -- 172.21.15.146:0/3367594376 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7278004e50 con 0x7f7288070fc0 2024-09-17T03:46:35.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f728ef32640 1 -- 172.21.15.146:0/3367594376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72881fa050 con 0x7f7288070fc0 2024-09-17T03:46:35.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.344+0000 7f72857fa640 1 -- 172.21.15.146:0/3367594376 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278031df0 con 0x7f7288070fc0 2024-09-17T03:46:35.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.345+0000 7f728ef32640 1 -- 172.21.15.146:0/3367594376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f728814b110 con 0x7f7288070fc0 2024-09-17T03:46:35.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.346+0000 7f728ef32640 1 -- 172.21.15.146:0/3367594376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72881fa570 con 0x7f7288070fc0 2024-09-17T03:46:35.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.346+0000 7f72857fa640 1 -- 172.21.15.146:0/3367594376 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7278005040 con 0x7f7288070fc0 2024-09-17T03:46:35.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.347+0000 7f72857fa640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7274078b90 0x7f727407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:35.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.347+0000 7f72857fa640 1 -- 172.21.15.146:0/3367594376 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 4857+0+0 (secure 0 0 0) 0x7f72780bbc80 con 0x7f7288070fc0 2024-09-17T03:46:35.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.347+0000 7f7287fff640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7274078b90 0x7f727407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:35.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.348+0000 7f7287fff640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7274078b90 0x7f727407b0a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f72881ed170 tx=0x7f727c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:35.350 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.352+0000 7f72857fa640 1 -- 172.21.15.146:0/3367594376 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72881fa570 con 0x7f7288070fc0 2024-09-17T03:46:35.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.529+0000 7f728ef32640 1 -- 172.21.15.146:0/3367594376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f728815c9a0 con 0x7f7288070fc0 2024-09-17T03:46:35.528 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.529+0000 7f72857fa640 1 -- 172.21.15.146:0/3367594376 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v195) ==== 84+0+65 (secure 0 0 0) 0x7f727803f030 con 0x7f7288070fc0 2024-09-17T03:46:35.528 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:35.529 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:46:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:46:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:46:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:46:35.529 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:46:35.529 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:46:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.531+0000 7f728ef32640 1 -- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7274078b90 msgr2=0x7f727407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.531+0000 7f728ef32640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7274078b90 0x7f727407b0a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f72881ed170 tx=0x7f727c009040 comp rx=0 tx=0).stop 2024-09-17T03:46:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.531+0000 7f728ef32640 1 -- 172.21.15.146:0/3367594376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7288070fc0 msgr2=0x7f728814aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.531+0000 7f728ef32640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7288070fc0 0x7f728814aad0 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7f727802ab20 tx=0x7f7278004a50 comp rx=0 tx=0).stop 2024-09-17T03:46:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.531+0000 7f728ef32640 1 -- 172.21.15.146:0/3367594376 shutdown_connections 2024-09-17T03:46:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.531+0000 7f728ef32640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7274078b90 0x7f727407b0a0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.531+0000 7f728ef32640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72880cfe10 0x7f728814cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.531+0000 7f728ef32640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72880735b0 0x7f7288150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.532+0000 7f728ef32640 1 --2- 172.21.15.146:0/3367594376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7288070fc0 0x7f728814aad0 unknown :-1 s=CLOSED pgs=2540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.532+0000 7f728ef32640 1 -- 172.21.15.146:0/3367594376 >> 172.21.15.146:0/3367594376 conn(0x7f72880b3880 msgr2=0x7f72880b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:35.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.532+0000 7f728ef32640 1 -- 172.21.15.146:0/3367594376 shutdown_connections 2024-09-17T03:46:35.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.532+0000 7f728ef32640 1 -- 172.21.15.146:0/3367594376 wait complete. 2024-09-17T03:46:35.543 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:46:35.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:46:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.663+0000 7fc752513640 1 -- 172.21.15.146:0/1515285323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc734004800 msgr2=0x7fc734004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.663+0000 7fc752513640 1 --2- 172.21.15.146:0/1515285323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc734004800 0x7fc734004c10 secure :-1 s=READY pgs=2542 cs=0 l=1 rev1=1 crypto rx=0x7fc7400016c0 tx=0x7fc734005830 comp rx=0 tx=0).stop 2024-09-17T03:46:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.663+0000 7fc752513640 1 -- 172.21.15.146:0/1515285323 shutdown_connections 2024-09-17T03:46:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.663+0000 7fc752513640 1 --2- 172.21.15.146:0/1515285323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc734004800 0x7fc734004c10 unknown :-1 s=CLOSED pgs=2542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.663+0000 7fc752513640 1 -- 172.21.15.146:0/1515285323 >> 172.21.15.146:0/1515285323 conn(0x7fc74c09dd60 msgr2=0x7fc74c0d4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.663+0000 7fc752513640 1 -- 172.21.15.146:0/1515285323 shutdown_connections 2024-09-17T03:46:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.663+0000 7fc752513640 1 -- 172.21.15.146:0/1515285323 wait complete. 2024-09-17T03:46:35.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.665+0000 7fc752513640 1 Processor -- start 2024-09-17T03:46:35.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.665+0000 7fc752513640 1 -- start start 2024-09-17T03:46:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc752513640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc734004800 0x7fc74c1f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc752513640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc74c1f91f0 0x7fc74c1f9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc752513640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc74c1e5ff0 0x7fc74c1e6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc752513640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c0d17b0 con 0x7fc734004800 2024-09-17T03:46:35.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc752513640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc74c0d1630 con 0x7fc74c1e5ff0 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc752513640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc74c0d1930 con 0x7fc74c1f91f0 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc74bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc734004800 0x7fc74c1f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc74bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc734004800 0x7fc74c1f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55934/0 (socket says 172.21.15.146:55934) 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc74bfff640 1 -- 172.21.15.146:0/3502570293 learned_addr learned my addr 172.21.15.146:0/3502570293 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc750ab0640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc74c1e5ff0 0x7fc74c1e6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc74b7fe640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc74c1f91f0 0x7fc74c1f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc74bfff640 1 -- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc74c1f91f0 msgr2=0x7fc74c1f9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc74bfff640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc74c1f91f0 0x7fc74c1f9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc74bfff640 1 -- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc74c1e5ff0 msgr2=0x7fc74c1e6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc74bfff640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc74c1e5ff0 0x7fc74c1e6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc74bfff640 1 -- 172.21.15.146:0/3502570293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc74c1f5940 con 0x7fc734004800 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.666+0000 7fc74b7fe640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc74c1f91f0 0x7fc74c1f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.667+0000 7fc74bfff640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc734004800 0x7fc74c1f2e80 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7fc73c006de0 tx=0x7fc73c0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:35.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.667+0000 7fc748ff9640 1 -- 172.21.15.146:0/3502570293 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c015020 con 0x7fc734004800 2024-09-17T03:46:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.667+0000 7fc748ff9640 1 -- 172.21.15.146:0/3502570293 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc73c011960 con 0x7fc734004800 2024-09-17T03:46:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.667+0000 7fc748ff9640 1 -- 172.21.15.146:0/3502570293 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c011d90 con 0x7fc734004800 2024-09-17T03:46:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.667+0000 7fc752513640 1 -- 172.21.15.146:0/3502570293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc74c1e6940 con 0x7fc734004800 2024-09-17T03:46:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.667+0000 7fc752513640 1 -- 172.21.15.146:0/3502570293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc74c1f5ea0 con 0x7fc734004800 2024-09-17T03:46:35.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.668+0000 7fc752513640 1 -- 172.21.15.146:0/3502570293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc74c0b8f60 con 0x7fc734004800 2024-09-17T03:46:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.668+0000 7fc748ff9640 1 -- 172.21.15.146:0/3502570293 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc73c018020 con 0x7fc734004800 2024-09-17T03:46:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.669+0000 7fc748ff9640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc738078bc0 0x7fc73807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.669+0000 7fc748ff9640 1 -- 172.21.15.146:0/3502570293 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 4857+0+0 (secure 0 0 0) 0x7fc73c09b4a0 con 0x7fc734004800 2024-09-17T03:46:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.670+0000 7fc74b7fe640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc738078bc0 0x7fc73807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.670+0000 7fc74b7fe640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc738078bc0 0x7fc73807b0d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fc740032000 tx=0x7fc740001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.674+0000 7fc748ff9640 1 -- 172.21.15.146:0/3502570293 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc74c0b8f60 con 0x7fc734004800 2024-09-17T03:46:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:35.848+0000 7fc752513640 1 -- 172.21.15.146:0/3502570293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc74c06e250 con 0x7fc734004800 2024-09-17T03:46:36.833 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.834+0000 7fc748ff9640 1 -- 172.21.15.146:0/3502570293 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v196) ==== 138+0+0 (secure 0 0 0) 0x7fc73c01f020 con 0x7fc734004800 2024-09-17T03:46:36.833 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:46:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 -- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc738078bc0 msgr2=0x7fc73807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc738078bc0 0x7fc73807b0d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fc740032000 tx=0x7fc740001190 comp rx=0 tx=0).stop 2024-09-17T03:46:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 -- 172.21.15.146:0/3502570293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc734004800 msgr2=0x7fc74c1f2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc734004800 0x7fc74c1f2e80 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7fc73c006de0 tx=0x7fc73c0049d0 comp rx=0 tx=0).stop 2024-09-17T03:46:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 -- 172.21.15.146:0/3502570293 shutdown_connections 2024-09-17T03:46:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc738078bc0 0x7fc73807b0d0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc74c1e5ff0 0x7fc74c1e6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc74c1f91f0 0x7fc74c1f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 --2- 172.21.15.146:0/3502570293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc734004800 0x7fc74c1f2e80 unknown :-1 s=CLOSED pgs=2543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 -- 172.21.15.146:0/3502570293 >> 172.21.15.146:0/3502570293 conn(0x7fc74c09dd60 msgr2=0x7fc74c0d2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 -- 172.21.15.146:0/3502570293 shutdown_connections 2024-09-17T03:46:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.838+0000 7fc752513640 1 -- 172.21.15.146:0/3502570293 wait complete. 2024-09-17T03:46:36.855 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:46:36.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.982+0000 7f5534d32640 1 -- 172.21.15.146:0/2210075646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5530069940 msgr2=0x7f55300cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:36.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.982+0000 7f5534d32640 1 --2- 172.21.15.146:0/2210075646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5530069940 0x7f55300cf3c0 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 crypto rx=0x7f55300d0520 tx=0x7f552402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:46:36.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.982+0000 7f5534d32640 1 -- 172.21.15.146:0/2210075646 shutdown_connections 2024-09-17T03:46:36.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.982+0000 7f5534d32640 1 --2- 172.21.15.146:0/2210075646 >> v2:172.21.15.179:3300/0 conn(0x7f55300d3200 0x7f55300d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:36.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.982+0000 7f5534d32640 1 --2- 172.21.15.146:0/2210075646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5530069940 0x7f55300cf3c0 unknown :-1 s=CLOSED pgs=2544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:36.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.982+0000 7f5534d32640 1 -- 172.21.15.146:0/2210075646 >> 172.21.15.146:0/2210075646 conn(0x7f55300d1770 msgr2=0x7f55300d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:36.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.982+0000 7f5534d32640 1 -- 172.21.15.146:0/2210075646 shutdown_connections 2024-09-17T03:46:36.982 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.982+0000 7f5534d32640 1 -- 172.21.15.146:0/2210075646 wait complete. 2024-09-17T03:46:36.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.984+0000 7f5534d32640 1 Processor -- start 2024-09-17T03:46:36.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.984+0000 7f5534d32640 1 -- start start 2024-09-17T03:46:36.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.985+0000 7f5534d32640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55300d3200 0x7f5530161870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:36.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.985+0000 7f5534d32640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f553015edf0 0x7f5530154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.985+0000 7f5534d32640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530161db0 0x7f5530155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.985+0000 7f5534d32640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f55300d3b50 con 0x7f553015edf0 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.985+0000 7f5534d32640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f55300b3b10 con 0x7f5530161db0 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.985+0000 7f5534d32640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f55300d3cd0 con 0x7f55300d3200 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.985+0000 7f552dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f553015edf0 0x7f5530154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.985+0000 7f552dd9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f553015edf0 0x7f5530154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:55956/0 (socket says 172.21.15.146:55956) 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.985+0000 7f552dd9b640 1 -- 172.21.15.146:0/2131918028 learned_addr learned my addr 172.21.15.146:0/2131918028 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.985+0000 7f552ed9d640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530161db0 0x7f5530155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f552e59c640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55300d3200 0x7f5530161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f552dd9b640 1 -- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55300d3200 msgr2=0x7f5530161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f552dd9b640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55300d3200 0x7f5530161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f552dd9b640 1 -- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530161db0 msgr2=0x7f5530155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f552dd9b640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530161db0 0x7f5530155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f552dd9b640 1 -- 172.21.15.146:0/2131918028 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5530155a60 con 0x7f553015edf0 2024-09-17T03:46:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f552e59c640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55300d3200 0x7f5530161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f552ed9d640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530161db0 0x7f5530155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f552dd9b640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f553015edf0 0x7f5530154be0 secure :-1 s=READY pgs=2545 cs=0 l=1 rev1=1 crypto rx=0x7f5524034040 tx=0x7f55240039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f551effd640 1 -- 172.21.15.146:0/2131918028 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552403e030 con 0x7f553015edf0 2024-09-17T03:46:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f551effd640 1 -- 172.21.15.146:0/2131918028 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55240047a0 con 0x7f553015edf0 2024-09-17T03:46:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f5534d32640 1 -- 172.21.15.146:0/2131918028 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5530155d00 con 0x7f553015edf0 2024-09-17T03:46:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f551effd640 1 -- 172.21.15.146:0/2131918028 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524035040 con 0x7f553015edf0 2024-09-17T03:46:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.986+0000 7f5534d32640 1 -- 172.21.15.146:0/2131918028 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55300b5190 con 0x7f553015edf0 2024-09-17T03:46:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.987+0000 7f5534d32640 1 -- 172.21.15.146:0/2131918028 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55300cf3c0 con 0x7f553015edf0 2024-09-17T03:46:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.988+0000 7f551effd640 1 -- 172.21.15.146:0/2131918028 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5524041030 con 0x7f553015edf0 2024-09-17T03:46:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.988+0000 7f551effd640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5510078b90 0x7f551007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.988+0000 7f551effd640 1 -- 172.21.15.146:0/2131918028 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5227+0+0 (secure 0 0 0) 0x7f55240bb2b0 con 0x7f553015edf0 2024-09-17T03:46:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.989+0000 7f552e59c640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5510078b90 0x7f551007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.989+0000 7f552e59c640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5510078b90 0x7f551007b0a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f553008da20 tx=0x7f55200073a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:36.993+0000 7f551effd640 1 -- 172.21.15.146:0/2131918028 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5524083960 con 0x7f553015edf0 2024-09-17T03:46:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.170+0000 7f5534d32640 1 -- 172.21.15.146:0/2131918028 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f55300d1dd0 con 0x7f553015edf0 2024-09-17T03:46:37.835 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.836+0000 7f551effd640 1 -- 172.21.15.146:0/2131918028 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v197) ==== 170+0+0 (secure 0 0 0) 0x7f5524083260 con 0x7f553015edf0 2024-09-17T03:46:37.835 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:46:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.839+0000 7f5534d32640 1 -- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5510078b90 msgr2=0x7f551007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.840+0000 7f5534d32640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5510078b90 0x7f551007b0a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f553008da20 tx=0x7f55200073a0 comp rx=0 tx=0).stop 2024-09-17T03:46:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.840+0000 7f5534d32640 1 -- 172.21.15.146:0/2131918028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f553015edf0 msgr2=0x7f5530154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.840+0000 7f5534d32640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f553015edf0 0x7f5530154be0 secure :-1 s=READY pgs=2545 cs=0 l=1 rev1=1 crypto rx=0x7f5524034040 tx=0x7f55240039e0 comp rx=0 tx=0).stop 2024-09-17T03:46:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.840+0000 7f5534d32640 1 -- 172.21.15.146:0/2131918028 shutdown_connections 2024-09-17T03:46:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.840+0000 7f5534d32640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5510078b90 0x7f551007b0a0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.840+0000 7f5534d32640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5530161db0 0x7f5530155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.840+0000 7f5534d32640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f553015edf0 0x7f5530154be0 unknown :-1 s=CLOSED pgs=2545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.840+0000 7f5534d32640 1 --2- 172.21.15.146:0/2131918028 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f55300d3200 0x7f5530161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.840+0000 7f5534d32640 1 -- 172.21.15.146:0/2131918028 >> 172.21.15.146:0/2131918028 conn(0x7f55300d1770 msgr2=0x7f553015cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.840+0000 7f5534d32640 1 -- 172.21.15.146:0/2131918028 shutdown_connections 2024-09-17T03:46:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.840+0000 7f5534d32640 1 -- 172.21.15.146:0/2131918028 wait complete. 2024-09-17T03:46:37.863 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:46:37.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.985+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/2092507548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2415fc60 msgr2=0x7f2f241628f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:37.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.985+0000 7f2f2b1e6640 1 --2- 172.21.15.146:0/2092507548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2415fc60 0x7f2f241628f0 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7f2f14005fd0 tx=0x7f2f1402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:46:37.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.985+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/2092507548 shutdown_connections 2024-09-17T03:46:37.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.985+0000 7f2f2b1e6640 1 --2- 172.21.15.146:0/2092507548 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f240cff50 0x7f2f240690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:37.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.985+0000 7f2f2b1e6640 1 --2- 172.21.15.146:0/2092507548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2415fc60 0x7f2f241628f0 unknown :-1 s=CLOSED pgs=2546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:37.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.985+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/2092507548 >> 172.21.15.146:0/2092507548 conn(0x7f2f240d4cd0 msgr2=0x7f2f240d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:37.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.985+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/2092507548 shutdown_connections 2024-09-17T03:46:37.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.985+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/2092507548 wait complete. 2024-09-17T03:46:37.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.987+0000 7f2f2b1e6640 1 Processor -- start 2024-09-17T03:46:37.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.987+0000 7f2f2b1e6640 1 -- start start 2024-09-17T03:46:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.988+0000 7f2f2b1e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f240cfb40 0x7f2f240ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.988+0000 7f2f2b1e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f240cff50 0x7f2f241f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.988+0000 7f2f2b1e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f2415fc60 0x7f2f241f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.988+0000 7f2f2b1e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24160290 con 0x7f2f240cfb40 2024-09-17T03:46:37.989 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.988+0000 7f2f2b1e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24163040 con 0x7f2f240cff50 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.988+0000 7f2f2b1e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2f240d3380 con 0x7f2f2415fc60 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f28f82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f240cfb40 0x7f2f240ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f28f82640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f240cfb40 0x7f2f240ce330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38578/0 (socket says 172.21.15.146:38578) 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f28f82640 1 -- 172.21.15.146:0/892212155 learned_addr learned my addr 172.21.15.146:0/892212155 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f29783640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f2415fc60 0x7f2f241f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f23fff640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f240cff50 0x7f2f241f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f28f82640 1 -- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f2415fc60 msgr2=0x7f2f241f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f28f82640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f2415fc60 0x7f2f241f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f28f82640 1 -- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f240cff50 msgr2=0x7f2f241f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f28f82640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f240cff50 0x7f2f241f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f28f82640 1 -- 172.21.15.146:0/892212155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2415b7a0 con 0x7f2f240cfb40 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f28f82640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f240cfb40 0x7f2f240ce330 secure :-1 s=READY pgs=2547 cs=0 l=1 rev1=1 crypto rx=0x7f2f14000c00 tx=0x7f2f140038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f217fa640 1 -- 172.21.15.146:0/892212155 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1403e030 con 0x7f2f240cfb40 2024-09-17T03:46:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f217fa640 1 -- 172.21.15.146:0/892212155 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f14003ca0 con 0x7f2f240cfb40 2024-09-17T03:46:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f217fa640 1 -- 172.21.15.146:0/892212155 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f14035040 con 0x7f2f240cfb40 2024-09-17T03:46:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/892212155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f241f6420 con 0x7f2f240cfb40 2024-09-17T03:46:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.989+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/892212155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f241f69e0 con 0x7f2f240cfb40 2024-09-17T03:46:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.990+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/892212155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f240696d0 con 0x7f2f240cfb40 2024-09-17T03:46:37.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.991+0000 7f2f217fa640 1 -- 172.21.15.146:0/892212155 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f14041030 con 0x7f2f240cfb40 2024-09-17T03:46:37.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.992+0000 7f2f217fa640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f04078b90 0x7f2f0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:37.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.992+0000 7f2f217fa640 1 -- 172.21.15.146:0/892212155 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 5609+0+0 (secure 0 0 0) 0x7f2f140bb170 con 0x7f2f240cfb40 2024-09-17T03:46:37.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.992+0000 7f2f23fff640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f04078b90 0x7f2f0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:37.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.992+0000 7f2f23fff640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f04078b90 0x7f2f0407b0a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f2f241ecc50 tx=0x7f2f0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:37.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:37.996+0000 7f2f217fa640 1 -- 172.21.15.146:0/892212155 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f14083050 con 0x7f2f240cfb40 2024-09-17T03:46:38.207 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.208+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/892212155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2f241f8ea0 con 0x7f2f240cfb40 2024-09-17T03:46:38.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.856+0000 7f2f217fa640 1 -- 172.21.15.146:0/892212155 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 30 and data pool 31 v150) ==== 174+0+0 (secure 0 0 0) 0x7f2f14087a80 con 0x7f2f240cfb40 2024-09-17T03:46:38.855 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 30 and data pool 31 2024-09-17T03:46:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.862+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f04078b90 msgr2=0x7f2f0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.862+0000 7f2f2b1e6640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f04078b90 0x7f2f0407b0a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f2f241ecc50 tx=0x7f2f0c009040 comp rx=0 tx=0).stop 2024-09-17T03:46:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.862+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/892212155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f240cfb40 msgr2=0x7f2f240ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.862+0000 7f2f2b1e6640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f240cfb40 0x7f2f240ce330 secure :-1 s=READY pgs=2547 cs=0 l=1 rev1=1 crypto rx=0x7f2f14000c00 tx=0x7f2f140038a0 comp rx=0 tx=0).stop 2024-09-17T03:46:38.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.868+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/892212155 shutdown_connections 2024-09-17T03:46:38.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.868+0000 7f2f2b1e6640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2f04078b90 0x7f2f0407b0a0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:38.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.868+0000 7f2f2b1e6640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2f2415fc60 0x7f2f241f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:38.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.868+0000 7f2f2b1e6640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f240cff50 0x7f2f241f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:38.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.868+0000 7f2f2b1e6640 1 --2- 172.21.15.146:0/892212155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f240cfb40 0x7f2f240ce330 unknown :-1 s=CLOSED pgs=2547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:38.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.868+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/892212155 >> 172.21.15.146:0/892212155 conn(0x7f2f240d4cd0 msgr2=0x7f2f24160a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:38.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.872+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/892212155 shutdown_connections 2024-09-17T03:46:38.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:38.873+0000 7f2f2b1e6640 1 -- 172.21.15.146:0/892212155 wait complete. 2024-09-17T03:46:38.891 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:46:39.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.006+0000 7f5f26362640 1 -- 172.21.15.146:0/722409480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f200cd5d0 msgr2=0x7f5f200af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.006+0000 7f5f26362640 1 --2- 172.21.15.146:0/722409480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f200cd5d0 0x7f5f200af900 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 crypto rx=0x7f5f14005fd0 tx=0x7f5f1402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.006+0000 7f5f26362640 1 -- 172.21.15.146:0/722409480 shutdown_connections 2024-09-17T03:46:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.006+0000 7f5f26362640 1 --2- 172.21.15.146:0/722409480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f200b5400 0x7f5f200ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.006+0000 7f5f26362640 1 --2- 172.21.15.146:0/722409480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f200cd5d0 0x7f5f200af900 unknown :-1 s=CLOSED pgs=2548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.006+0000 7f5f26362640 1 -- 172.21.15.146:0/722409480 >> 172.21.15.146:0/722409480 conn(0x7f5f200b2790 msgr2=0x7f5f200d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.006+0000 7f5f26362640 1 -- 172.21.15.146:0/722409480 shutdown_connections 2024-09-17T03:46:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.006+0000 7f5f26362640 1 -- 172.21.15.146:0/722409480 wait complete. 2024-09-17T03:46:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.008+0000 7f5f26362640 1 Processor -- start 2024-09-17T03:46:39.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.008+0000 7f5f26362640 1 -- start start 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.009+0000 7f5f26362640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f200b5400 0x7f5f2015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.009+0000 7f5f26362640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f2015b2a0 0x7f5f20147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.009+0000 7f5f26362640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f20159660 0x7f5f20159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.009+0000 7f5f26362640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5f200cedf0 con 0x7f5f200b5400 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.009+0000 7f5f26362640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5f200cec70 con 0x7f5f2015b2a0 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.009+0000 7f5f26362640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5f200cef70 con 0x7f5f20159660 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.009+0000 7f5f1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f200b5400 0x7f5f2015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.009+0000 7f5f1ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f200b5400 0x7f5f2015f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38606/0 (socket says 172.21.15.146:38606) 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.009+0000 7f5f1ffff640 1 -- 172.21.15.146:0/1033412916 learned_addr learned my addr 172.21.15.146:0/1033412916 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.009+0000 7f5f248ff640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f20159660 0x7f5f20159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.009+0000 7f5f1f7fe640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f2015b2a0 0x7f5f20147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f1ffff640 1 -- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f20159660 msgr2=0x7f5f20159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f1ffff640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f20159660 0x7f5f20159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f1ffff640 1 -- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f2015b2a0 msgr2=0x7f5f20147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f1ffff640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f2015b2a0 0x7f5f20147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f1ffff640 1 -- 172.21.15.146:0/1033412916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f20159fb0 con 0x7f5f200b5400 2024-09-17T03:46:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f1f7fe640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f2015b2a0 0x7f5f20147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f248ff640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f20159660 0x7f5f20159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f1ffff640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f200b5400 0x7f5f2015f4e0 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c3a0 tx=0x7f5f1000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f1cff9640 1 -- 172.21.15.146:0/1033412916 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10017070 con 0x7f5f200b5400 2024-09-17T03:46:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f1cff9640 1 -- 172.21.15.146:0/1033412916 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f100053c0 con 0x7f5f200b5400 2024-09-17T03:46:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f26362640 1 -- 172.21.15.146:0/1033412916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f20157cb0 con 0x7f5f200b5400 2024-09-17T03:46:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f1cff9640 1 -- 172.21.15.146:0/1033412916 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10003850 con 0x7f5f200b5400 2024-09-17T03:46:39.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.010+0000 7f5f26362640 1 -- 172.21.15.146:0/1033412916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f201f6e40 con 0x7f5f200b5400 2024-09-17T03:46:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.011+0000 7f5f26362640 1 -- 172.21.15.146:0/1033412916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f200ce3d0 con 0x7f5f200b5400 2024-09-17T03:46:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.012+0000 7f5f1cff9640 1 -- 172.21.15.146:0/1033412916 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f1001a070 con 0x7f5f200b5400 2024-09-17T03:46:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.012+0000 7f5f1cff9640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f0c078b90 0x7f5f0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.013+0000 7f5f1cff9640 1 -- 172.21.15.146:0/1033412916 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 5709+0+0 (secure 0 0 0) 0x7f5f1009a000 con 0x7f5f200b5400 2024-09-17T03:46:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.013+0000 7f5f1f7fe640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f0c078b90 0x7f5f0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.013+0000 7f5f1f7fe640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f0c078b90 0x7f5f0c07b0a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f5f14033000 tx=0x7f5f14004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:39.016 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.017+0000 7f5f1cff9640 1 -- 172.21.15.146:0/1033412916 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5f20159fb0 con 0x7f5f200b5400 2024-09-17T03:46:39.192 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.193+0000 7f5f26362640 1 -- 172.21.15.146:0/1033412916 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f200b4fd0 con 0x7f5f200b5400 2024-09-17T03:46:39.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.194+0000 7f5f1cff9640 1 -- 172.21.15.146:0/1033412916 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) ==== 74+0+16740 (secure 0 0 0) 0x7f5f10062560 con 0x7f5f200b5400 2024-09-17T03:46:39.194 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:39.194 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":198,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:46:38.209047+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:46:35.852577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_data","create_time":"2024-09-17T03:46:37.175209+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:46:39.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 -- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f0c078b90 msgr2=0x7f5f0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f0c078b90 0x7f5f0c07b0a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f5f14033000 tx=0x7f5f14004730 comp rx=0 tx=0).stop 2024-09-17T03:46:39.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 -- 172.21.15.146:0/1033412916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f200b5400 msgr2=0x7f5f2015f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f200b5400 0x7f5f2015f4e0 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c3a0 tx=0x7f5f1000c860 comp rx=0 tx=0).stop 2024-09-17T03:46:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 -- 172.21.15.146:0/1033412916 shutdown_connections 2024-09-17T03:46:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5f0c078b90 0x7f5f0c07b0a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5f20159660 0x7f5f20159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5f2015b2a0 0x7f5f20147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 --2- 172.21.15.146:0/1033412916 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f200b5400 0x7f5f2015f4e0 unknown :-1 s=CLOSED pgs=2549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 -- 172.21.15.146:0/1033412916 >> 172.21.15.146:0/1033412916 conn(0x7f5f200b2790 msgr2=0x7f5f2006f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 -- 172.21.15.146:0/1033412916 shutdown_connections 2024-09-17T03:46:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.197+0000 7f5f26362640 1 -- 172.21.15.146:0/1033412916 wait complete. 2024-09-17T03:46:39.208 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:46:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.322+0000 7fb28fd6e640 1 -- 172.21.15.146:0/2693695433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2880d31e0 msgr2=0x7fb2880cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.322+0000 7fb28fd6e640 1 --2- 172.21.15.146:0/2693695433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2880d31e0 0x7fb2880cebc0 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 crypto rx=0x7fb2840098e0 tx=0x7fb28402a530 comp rx=0 tx=0).stop 2024-09-17T03:46:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.322+0000 7fb28fd6e640 1 -- 172.21.15.146:0/2693695433 shutdown_connections 2024-09-17T03:46:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.322+0000 7fb28fd6e640 1 --2- 172.21.15.146:0/2693695433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880d1220 0x7fb2880b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.322+0000 7fb28fd6e640 1 --2- 172.21.15.146:0/2693695433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2880d31e0 0x7fb2880cebc0 unknown :-1 s=CLOSED pgs=2550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.322+0000 7fb28fd6e640 1 -- 172.21.15.146:0/2693695433 >> 172.21.15.146:0/2693695433 conn(0x7fb2880d26c0 msgr2=0x7fb2880d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.322+0000 7fb28fd6e640 1 -- 172.21.15.146:0/2693695433 shutdown_connections 2024-09-17T03:46:39.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.322+0000 7fb28fd6e640 1 -- 172.21.15.146:0/2693695433 wait complete. 2024-09-17T03:46:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.324+0000 7fb28fd6e640 1 Processor -- start 2024-09-17T03:46:39.323 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.324+0000 7fb28fd6e640 1 -- start start 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.325+0000 7fb28fd6e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880d31e0 0x7fb288151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.325+0000 7fb28fd6e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb28815cbe0 0x7fb2881e6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.325+0000 7fb28fd6e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb288152500 0x7fb2880b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.325+0000 7fb28fd6e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb2880b64b0 con 0x7fb28815cbe0 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.325+0000 7fb28fd6e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb2880b6330 con 0x7fb288152500 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.325+0000 7fb28fd6e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb2880b6630 con 0x7fb2880d31e0 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.325+0000 7fb28d309640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb28815cbe0 0x7fb2881e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.325+0000 7fb28d309640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb28815cbe0 0x7fb2881e6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38624/0 (socket says 172.21.15.146:38624) 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.325+0000 7fb28d309640 1 -- 172.21.15.146:0/29254334 learned_addr learned my addr 172.21.15.146:0/29254334 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.325+0000 7fb28db0a640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880d31e0 0x7fb288151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.325+0000 7fb28e30b640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb288152500 0x7fb2880b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb28d309640 1 -- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880d31e0 msgr2=0x7fb288151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb28d309640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880d31e0 0x7fb288151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb28d309640 1 -- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb288152500 msgr2=0x7fb2880b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb28d309640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb288152500 0x7fb2880b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb28d309640 1 -- 172.21.15.146:0/29254334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28815f280 con 0x7fb28815cbe0 2024-09-17T03:46:39.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb28db0a640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880d31e0 0x7fb288151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:39.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb28d309640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb28815cbe0 0x7fb2881e6470 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7fb27800b420 tx=0x7fb27800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:39.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb27e7fc640 1 -- 172.21.15.146:0/29254334 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb278011830 con 0x7fb28815cbe0 2024-09-17T03:46:39.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb27e7fc640 1 -- 172.21.15.146:0/29254334 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb278016070 con 0x7fb28815cbe0 2024-09-17T03:46:39.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb28fd6e640 1 -- 172.21.15.146:0/29254334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28815fcf0 con 0x7fb28815cbe0 2024-09-17T03:46:39.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb27e7fc640 1 -- 172.21.15.146:0/29254334 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb278011d60 con 0x7fb28815cbe0 2024-09-17T03:46:39.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.326+0000 7fb28fd6e640 1 -- 172.21.15.146:0/29254334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2881e6ab0 con 0x7fb28815cbe0 2024-09-17T03:46:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.327+0000 7fb28fd6e640 1 -- 172.21.15.146:0/29254334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb288160210 con 0x7fb28815cbe0 2024-09-17T03:46:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.328+0000 7fb27e7fc640 1 -- 172.21.15.146:0/29254334 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb27801b460 con 0x7fb28815cbe0 2024-09-17T03:46:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.328+0000 7fb27e7fc640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb26c078bc0 0x7fb26c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.328+0000 7fb27e7fc640 1 -- 172.21.15.146:0/29254334 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 5709+0+0 (secure 0 0 0) 0x7fb27809a8c0 con 0x7fb28815cbe0 2024-09-17T03:46:39.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.329+0000 7fb28db0a640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb26c078bc0 0x7fb26c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.329 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.329+0000 7fb28db0a640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb26c078bc0 0x7fb26c07b0d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb284034000 tx=0x7fb284004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:39.332 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.333+0000 7fb27e7fc640 1 -- 172.21.15.146:0/29254334 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb288160210 con 0x7fb28815cbe0 2024-09-17T03:46:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.508+0000 7fb28fd6e640 1 -- 172.21.15.146:0/29254334 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb28806d310 con 0x7fb28815cbe0 2024-09-17T03:46:39.508 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.509+0000 7fb27e7fc640 1 -- 172.21.15.146:0/29254334 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) ==== 74+0+16740 (secure 0 0 0) 0x7fb28806d310 con 0x7fb28815cbe0 2024-09-17T03:46:39.509 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:39.509 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":198,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:46:38.209047+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:46:35.852577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_data","create_time":"2024-09-17T03:46:37.175209+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 -- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb26c078bc0 msgr2=0x7fb26c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb26c078bc0 0x7fb26c07b0d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb284034000 tx=0x7fb284004730 comp rx=0 tx=0).stop 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 -- 172.21.15.146:0/29254334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb28815cbe0 msgr2=0x7fb2881e6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb28815cbe0 0x7fb2881e6470 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7fb27800b420 tx=0x7fb27800b8e0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 -- 172.21.15.146:0/29254334 shutdown_connections 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb26c078bc0 0x7fb26c07b0d0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb288152500 0x7fb2880b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb28815cbe0 0x7fb2881e6470 unknown :-1 s=CLOSED pgs=2551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 --2- 172.21.15.146:0/29254334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2880d31e0 0x7fb288151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 -- 172.21.15.146:0/29254334 >> 172.21.15.146:0/29254334 conn(0x7fb2880d26c0 msgr2=0x7fb2880b4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 -- 172.21.15.146:0/29254334 shutdown_connections 2024-09-17T03:46:39.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.511+0000 7fb28fd6e640 1 -- 172.21.15.146:0/29254334 wait complete. 2024-09-17T03:46:39.522 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:46:39.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.641+0000 7f5a4dd83640 1 -- 172.21.15.146:0/2059038784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a30003a50 msgr2=0x7f5a30003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.641+0000 7f5a4dd83640 1 --2- 172.21.15.146:0/2059038784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a30003a50 0x7f5a30003ec0 secure :-1 s=READY pgs=2553 cs=0 l=1 rev1=1 crypto rx=0x7f5a38001180 tx=0x7f5a30005830 comp rx=0 tx=0).stop 2024-09-17T03:46:39.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.641+0000 7f5a4dd83640 1 -- 172.21.15.146:0/2059038784 shutdown_connections 2024-09-17T03:46:39.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.641+0000 7f5a4dd83640 1 --2- 172.21.15.146:0/2059038784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a30003a50 0x7f5a30003ec0 unknown :-1 s=CLOSED pgs=2553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.641+0000 7f5a4dd83640 1 -- 172.21.15.146:0/2059038784 >> 172.21.15.146:0/2059038784 conn(0x7f5a480d26c0 msgr2=0x7f5a480d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.641+0000 7f5a4dd83640 1 -- 172.21.15.146:0/2059038784 shutdown_connections 2024-09-17T03:46:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.641+0000 7f5a4dd83640 1 -- 172.21.15.146:0/2059038784 wait complete. 2024-09-17T03:46:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.643+0000 7f5a4dd83640 1 Processor -- start 2024-09-17T03:46:39.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.643+0000 7f5a4dd83640 1 -- start start 2024-09-17T03:46:39.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.644+0000 7f5a4dd83640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a30003a50 0x7f5a4809c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.644+0000 7f5a4dd83640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a481f4b50 0x7f5a480cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.644+0000 7f5a4dd83640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a480cc440 0x7f5a480b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.644+0000 7f5a4dd83640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4815cd60 con 0x7f5a480cc440 2024-09-17T03:46:39.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.644+0000 7f5a4dd83640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4815cbe0 con 0x7f5a30003a50 2024-09-17T03:46:39.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.644+0000 7f5a4dd83640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4815cee0 con 0x7f5a481f4b50 2024-09-17T03:46:39.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a47fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a480cc440 0x7f5a480b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a47fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a480cc440 0x7f5a480b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38646/0 (socket says 172.21.15.146:38646) 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a47fff640 1 -- 172.21.15.146:0/516118072 learned_addr learned my addr 172.21.15.146:0/516118072 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a46ffd640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a481f4b50 0x7f5a480cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a477fe640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a30003a50 0x7f5a4809c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a47fff640 1 -- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a481f4b50 msgr2=0x7f5a480cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a47fff640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a481f4b50 0x7f5a480cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a47fff640 1 -- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a30003a50 msgr2=0x7f5a4809c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a47fff640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a30003a50 0x7f5a4809c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a47fff640 1 -- 172.21.15.146:0/516118072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4809d060 con 0x7f5a480cc440 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a46ffd640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a481f4b50 0x7f5a480cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a47fff640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a480cc440 0x7f5a480b21b0 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 crypto rx=0x7f5a480746e0 tx=0x7f5a400019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a2ffff640 1 -- 172.21.15.146:0/516118072 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40011870 con 0x7f5a480cc440 2024-09-17T03:46:39.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a2ffff640 1 -- 172.21.15.146:0/516118072 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a40017070 con 0x7f5a480cc440 2024-09-17T03:46:39.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a4dd83640 1 -- 172.21.15.146:0/516118072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4809d340 con 0x7f5a480cc440 2024-09-17T03:46:39.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a2ffff640 1 -- 172.21.15.146:0/516118072 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40011da0 con 0x7f5a480cc440 2024-09-17T03:46:39.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.645+0000 7f5a4dd83640 1 -- 172.21.15.146:0/516118072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a480b1c90 con 0x7f5a480cc440 2024-09-17T03:46:39.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.646+0000 7f5a4dd83640 1 -- 172.21.15.146:0/516118072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4809cdd0 con 0x7f5a480cc440 2024-09-17T03:46:39.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.647+0000 7f5a2ffff640 1 -- 172.21.15.146:0/516118072 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a4001c460 con 0x7f5a480cc440 2024-09-17T03:46:39.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.648+0000 7f5a2ffff640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a34078bc0 0x7f5a3407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:39.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.648+0000 7f5a2ffff640 1 -- 172.21.15.146:0/516118072 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 5709+0+0 (secure 0 0 0) 0x7f5a4009b380 con 0x7f5a480cc440 2024-09-17T03:46:39.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.648+0000 7f5a477fe640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a34078bc0 0x7f5a3407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:39.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.648+0000 7f5a477fe640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a34078bc0 0x7f5a3407b0d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f5a38033000 tx=0x7f5a38001110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:39.651 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.652+0000 7f5a2ffff640 1 -- 172.21.15.146:0/516118072 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5a400638e0 con 0x7f5a480cc440 2024-09-17T03:46:39.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:39.862+0000 7f5a4dd83640 1 -- 172.21.15.146:0/516118072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5a480d2f80 con 0x7f5a480cc440 2024-09-17T03:46:40.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.868+0000 7f5a2ffff640 1 -- 172.21.15.146:0/516118072 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v153) ==== 118+0+0 (secure 0 0 0) 0x7f5a480d2f80 con 0x7f5a480cc440 2024-09-17T03:46:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 -- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a34078bc0 msgr2=0x7f5a3407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a34078bc0 0x7f5a3407b0d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f5a38033000 tx=0x7f5a38001110 comp rx=0 tx=0).stop 2024-09-17T03:46:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 -- 172.21.15.146:0/516118072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a480cc440 msgr2=0x7f5a480b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a480cc440 0x7f5a480b21b0 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 crypto rx=0x7f5a480746e0 tx=0x7f5a400019b0 comp rx=0 tx=0).stop 2024-09-17T03:46:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 -- 172.21.15.146:0/516118072 shutdown_connections 2024-09-17T03:46:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5a34078bc0 0x7f5a3407b0d0 secure :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f5a38033000 tx=0x7f5a38001110 comp rx=0 tx=0).stop 2024-09-17T03:46:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a480cc440 0x7f5a480b21b0 unknown :-1 s=CLOSED pgs=2554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5a481f4b50 0x7f5a480cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 --2- 172.21.15.146:0/516118072 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5a30003a50 0x7f5a4809c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 -- 172.21.15.146:0/516118072 >> 172.21.15.146:0/516118072 conn(0x7f5a480d26c0 msgr2=0x7f5a4815f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 -- 172.21.15.146:0/516118072 shutdown_connections 2024-09-17T03:46:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:40.871+0000 7f5a4dd83640 1 -- 172.21.15.146:0/516118072 wait complete. 2024-09-17T03:46:40.884 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:46:40.884 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:46:41.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.008+0000 7f9a665c3640 1 -- 172.21.15.146:0/2413688684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6015c9a0 msgr2=0x7f9a600d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.008+0000 7f9a665c3640 1 --2- 172.21.15.146:0/2413688684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6015c9a0 0x7f9a600d0520 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 crypto rx=0x7f9a58005fd0 tx=0x7f9a5802aa10 comp rx=0 tx=0).stop 2024-09-17T03:46:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.008+0000 7f9a665c3640 1 -- 172.21.15.146:0/2413688684 shutdown_connections 2024-09-17T03:46:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.008+0000 7f9a665c3640 1 --2- 172.21.15.146:0/2413688684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6015c9a0 0x7f9a600d0520 unknown :-1 s=CLOSED pgs=2556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.008+0000 7f9a665c3640 1 -- 172.21.15.146:0/2413688684 >> 172.21.15.146:0/2413688684 conn(0x7f9a600b3880 msgr2=0x7f9a600d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.008+0000 7f9a665c3640 1 -- 172.21.15.146:0/2413688684 shutdown_connections 2024-09-17T03:46:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.008+0000 7f9a665c3640 1 -- 172.21.15.146:0/2413688684 wait complete. 2024-09-17T03:46:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.010+0000 7f9a665c3640 1 Processor -- start 2024-09-17T03:46:41.009 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.010+0000 7f9a665c3640 1 -- start start 2024-09-17T03:46:41.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.011+0000 7f9a665c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a60070fc0 0x7f9a60140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:41.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.011+0000 7f9a665c3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a6015c9a0 0x7f9a6013d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:41.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.011+0000 7f9a665c3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a601e1d90 0x7f9a60153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:41.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.011+0000 7f9a665c3640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9a600d0df0 con 0x7f9a60070fc0 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.011+0000 7f9a665c3640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9a600d0c70 con 0x7f9a6015c9a0 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.011+0000 7f9a665c3640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9a600d0f70 con 0x7f9a601e1d90 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.011+0000 7f9a5ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a60070fc0 0x7f9a60140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.011+0000 7f9a5ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a60070fc0 0x7f9a60140d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38658/0 (socket says 172.21.15.146:38658) 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.011+0000 7f9a5ffff640 1 -- 172.21.15.146:0/2520826333 learned_addr learned my addr 172.21.15.146:0/2520826333 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.011+0000 7f9a5f7fe640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a6015c9a0 0x7f9a6013d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.011+0000 7f9a64b60640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a601e1d90 0x7f9a60153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a5ffff640 1 -- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a601e1d90 msgr2=0x7f9a60153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a5ffff640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a601e1d90 0x7f9a60153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a5ffff640 1 -- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a6015c9a0 msgr2=0x7f9a6013d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a5ffff640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a6015c9a0 0x7f9a6013d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a5ffff640 1 -- 172.21.15.146:0/2520826333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a601f7380 con 0x7f9a60070fc0 2024-09-17T03:46:41.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a5f7fe640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a6015c9a0 0x7f9a6013d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:41.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a5ffff640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a60070fc0 0x7f9a60140d40 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000b410 tx=0x7f9a5000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:41.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a5cff9640 1 -- 172.21.15.146:0/2520826333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50015020 con 0x7f9a60070fc0 2024-09-17T03:46:41.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a665c3640 1 -- 172.21.15.146:0/2520826333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6013de00 con 0x7f9a60070fc0 2024-09-17T03:46:41.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a5cff9640 1 -- 172.21.15.146:0/2520826333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a50011920 con 0x7f9a60070fc0 2024-09-17T03:46:41.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a5cff9640 1 -- 172.21.15.146:0/2520826333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50011d70 con 0x7f9a60070fc0 2024-09-17T03:46:41.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.012+0000 7f9a665c3640 1 -- 172.21.15.146:0/2520826333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a601f78d0 con 0x7f9a60070fc0 2024-09-17T03:46:41.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.013+0000 7f9a665c3640 1 -- 172.21.15.146:0/2520826333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a6015b820 con 0x7f9a60070fc0 2024-09-17T03:46:41.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.014+0000 7f9a5cff9640 1 -- 172.21.15.146:0/2520826333 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a50018020 con 0x7f9a60070fc0 2024-09-17T03:46:41.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.014+0000 7f9a5cff9640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a4c078b90 0x7f9a4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:41.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.014+0000 7f9a5cff9640 1 -- 172.21.15.146:0/2520826333 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f9a5009ac60 con 0x7f9a60070fc0 2024-09-17T03:46:41.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.014+0000 7f9a5f7fe640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a4c078b90 0x7f9a4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:41.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.015+0000 7f9a5f7fe640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a4c078b90 0x7f9a4c07b0a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f9a60158740 tx=0x7f9a54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:41.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.019+0000 7f9a5cff9640 1 -- 172.21.15.146:0/2520826333 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9a6015b820 con 0x7f9a60070fc0 2024-09-17T03:46:41.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.228+0000 7f9a665c3640 1 -- 172.21.15.146:0/2520826333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9a600735b0 con 0x7f9a60070fc0 2024-09-17T03:46:41.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.874+0000 7f9a5cff9640 1 -- 172.21.15.146:0/2520826333 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v154) ==== 122+0+0 (secure 0 0 0) 0x7f9a50063020 con 0x7f9a60070fc0 2024-09-17T03:46:41.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.876+0000 7f9a665c3640 1 -- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a4c078b90 msgr2=0x7f9a4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:41.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.877+0000 7f9a665c3640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a4c078b90 0x7f9a4c07b0a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f9a60158740 tx=0x7f9a54009040 comp rx=0 tx=0).stop 2024-09-17T03:46:41.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.877+0000 7f9a665c3640 1 -- 172.21.15.146:0/2520826333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a60070fc0 msgr2=0x7f9a60140d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:41.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.877+0000 7f9a665c3640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a60070fc0 0x7f9a60140d40 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000b410 tx=0x7f9a5000b8d0 comp rx=0 tx=0).stop 2024-09-17T03:46:41.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.877+0000 7f9a665c3640 1 -- 172.21.15.146:0/2520826333 shutdown_connections 2024-09-17T03:46:41.926 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.877+0000 7f9a665c3640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9a4c078b90 0x7f9a4c07b0a0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.877+0000 7f9a665c3640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9a601e1d90 0x7f9a60153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.877+0000 7f9a665c3640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9a6015c9a0 0x7f9a6013d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.877+0000 7f9a665c3640 1 --2- 172.21.15.146:0/2520826333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a60070fc0 0x7f9a60140d40 unknown :-1 s=CLOSED pgs=2557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.877+0000 7f9a665c3640 1 -- 172.21.15.146:0/2520826333 >> 172.21.15.146:0/2520826333 conn(0x7f9a600b3880 msgr2=0x7f9a600737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.877+0000 7f9a665c3640 1 -- 172.21.15.146:0/2520826333 shutdown_connections 2024-09-17T03:46:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:41.877+0000 7f9a665c3640 1 -- 172.21.15.146:0/2520826333 wait complete. 2024-09-17T03:46:41.927 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:46:41.927 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:42.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.048+0000 7f393e8bd640 1 -- 172.21.15.146:0/3445365010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3924003fd0 msgr2=0x7f3924004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.048+0000 7f393e8bd640 1 --2- 172.21.15.146:0/3445365010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3924003fd0 0x7f3924004800 secure :-1 s=READY pgs=2559 cs=0 l=1 rev1=1 crypto rx=0x7f3920009b50 tx=0x7f3924005830 comp rx=0 tx=0).stop 2024-09-17T03:46:42.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.048+0000 7f393ce5a640 1 -- 172.21.15.146:0/3445365010 reap_dead start 2024-09-17T03:46:42.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.048+0000 7f393e8bd640 1 -- 172.21.15.146:0/3445365010 shutdown_connections 2024-09-17T03:46:42.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.048+0000 7f393e8bd640 1 -- 172.21.15.146:0/3445365010 >> 172.21.15.146:0/3445365010 conn(0x7f39380d26a0 msgr2=0x7f39380d2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:42.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.048+0000 7f393e8bd640 1 -- 172.21.15.146:0/3445365010 shutdown_connections 2024-09-17T03:46:42.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.048+0000 7f393e8bd640 1 -- 172.21.15.146:0/3445365010 wait complete. 2024-09-17T03:46:42.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.050+0000 7f393e8bd640 1 Processor -- start 2024-09-17T03:46:42.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.050+0000 7f393e8bd640 1 -- start start 2024-09-17T03:46:42.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.051+0000 7f393e8bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3924003fd0 0x7f393809fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.051+0000 7f393e8bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3938150b90 0x7f393815fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.051+0000 7f393e8bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f393815ffa0 0x7f39381f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.051+0000 7f393e8bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f39380b7d00 con 0x7f3938150b90 2024-09-17T03:46:42.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.051+0000 7f393e8bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f39380ce540 con 0x7f393815ffa0 2024-09-17T03:46:42.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.051+0000 7f393e8bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f39380b7e80 con 0x7f3924003fd0 2024-09-17T03:46:42.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.051+0000 7f39377fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3938150b90 0x7f393815fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.051+0000 7f39377fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3938150b90 0x7f393815fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38672/0 (socket says 172.21.15.146:38672) 2024-09-17T03:46:42.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.051+0000 7f39377fe640 1 -- 172.21.15.146:0/892711752 learned_addr learned my addr 172.21.15.146:0/892711752 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:42.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.051+0000 7f393ce5a640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f393815ffa0 0x7f39381f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.051+0000 7f3937fff640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3924003fd0 0x7f393809fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f39377fe640 1 -- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3924003fd0 msgr2=0x7f393809fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f39377fe640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3924003fd0 0x7f393809fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f39377fe640 1 -- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f393815ffa0 msgr2=0x7f39381f7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f39377fe640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f393815ffa0 0x7f39381f7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f39377fe640 1 -- 172.21.15.146:0/892711752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39381603b0 con 0x7f3938150b90 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f393ce5a640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f393815ffa0 0x7f39381f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f39377fe640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3938150b90 0x7f393815fa60 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7f392002b4f0 tx=0x7f3920033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f3934ff9640 1 -- 172.21.15.146:0/892711752 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920038040 con 0x7f3938150b90 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f3934ff9640 1 -- 172.21.15.146:0/892711752 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3920004020 con 0x7f3938150b90 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f3934ff9640 1 -- 172.21.15.146:0/892711752 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3920004450 con 0x7f3938150b90 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f393e8bd640 1 -- 172.21.15.146:0/892711752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39381f4250 con 0x7f3938150b90 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.052+0000 7f393e8bd640 1 -- 172.21.15.146:0/892711752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39381f4810 con 0x7f3938150b90 2024-09-17T03:46:42.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.053+0000 7f393e8bd640 1 -- 172.21.15.146:0/892711752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39381f3fc0 con 0x7f3938150b90 2024-09-17T03:46:42.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.054+0000 7f3934ff9640 1 -- 172.21.15.146:0/892711752 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3920045020 con 0x7f3938150b90 2024-09-17T03:46:42.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.054+0000 7f3934ff9640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078bc0 0x7f391807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.054+0000 7f3934ff9640 1 -- 172.21.15.146:0/892711752 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f39200bb690 con 0x7f3938150b90 2024-09-17T03:46:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.055+0000 7f3937fff640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078bc0 0x7f391807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.055+0000 7f3937fff640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078bc0 0x7f391807b0d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f3928009a00 tx=0x7f3928005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.059+0000 7f3934ff9640 1 -- 172.21.15.146:0/892711752 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39381603b0 con 0x7f3938150b90 2024-09-17T03:46:42.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.268+0000 7f393e8bd640 1 -- 172.21.15.146:0/892711752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39380cf3e0 con 0x7f3938150b90 2024-09-17T03:46:42.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.269+0000 7f3934ff9640 1 -- 172.21.15.146:0/892711752 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 154 v154) ==== 95+0+5241 (secure 0 0 0) 0x7f3920083b60 con 0x7f3938150b90 2024-09-17T03:46:42.268 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:42.268 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":154,"btime":"2024-09-17T03:46:41:868652+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2786459468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2786459468},{"type":"v1","addr":"172.21.15.179:6837","nonce":2786459468}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/35044870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":35044870},{"type":"v1","addr":"172.21.15.146:6835","nonce":35044870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4262340236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4262340236},{"type":"v1","addr":"172.21.15.179:6836","nonce":4262340236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149}],"filesystems":[{"mdsmap":{"epoch":154,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:46:38.209003+0000","modified":"2024-09-17T03:46:41.229411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11496":{"gid":11496,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/172455759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":172455759},{"type":"v1","addr":"172.21.15.146:6833","nonce":172455759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11496,"qdb_cluster":[11496]},"id":15}]} 2024-09-17T03:46:42.269 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 154 2024-09-17T03:46:42.270 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 -- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078bc0 msgr2=0x7f391807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078bc0 0x7f391807b0d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f3928009a00 tx=0x7f3928005f90 comp rx=0 tx=0).stop 2024-09-17T03:46:42.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 -- 172.21.15.146:0/892711752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3938150b90 msgr2=0x7f393815fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3938150b90 0x7f393815fa60 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7f392002b4f0 tx=0x7f3920033670 comp rx=0 tx=0).stop 2024-09-17T03:46:42.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 -- 172.21.15.146:0/892711752 shutdown_connections 2024-09-17T03:46:42.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3918078bc0 0x7f391807b0d0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f393815ffa0 0x7f39381f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3938150b90 0x7f393815fa60 unknown :-1 s=CLOSED pgs=2560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 --2- 172.21.15.146:0/892711752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3924003fd0 0x7f393809fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 -- 172.21.15.146:0/892711752 >> 172.21.15.146:0/892711752 conn(0x7f39380d26a0 msgr2=0x7f39380b6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:42.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 -- 172.21.15.146:0/892711752 shutdown_connections 2024-09-17T03:46:42.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.271+0000 7f393e8bd640 1 -- 172.21.15.146:0/892711752 wait complete. 2024-09-17T03:46:42.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:46:42.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.396+0000 7f6936539640 1 -- 172.21.15.146:0/3862895854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930070fc0 msgr2=0x7f693015c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.396+0000 7f6936539640 1 --2- 172.21.15.146:0/3862895854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930070fc0 0x7f693015c9a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f69200098e0 tx=0x7f692002a530 comp rx=0 tx=0).stop 2024-09-17T03:46:42.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.396+0000 7f6936539640 1 -- 172.21.15.146:0/3862895854 shutdown_connections 2024-09-17T03:46:42.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.396+0000 7f6936539640 1 --2- 172.21.15.146:0/3862895854 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69300cfe10 0x7f69300d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.396+0000 7f6936539640 1 --2- 172.21.15.146:0/3862895854 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930070fc0 0x7f693015c9a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.396+0000 7f6936539640 1 -- 172.21.15.146:0/3862895854 >> 172.21.15.146:0/3862895854 conn(0x7f69300b3880 msgr2=0x7f69300d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:42.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.396+0000 7f6936539640 1 -- 172.21.15.146:0/3862895854 shutdown_connections 2024-09-17T03:46:42.396 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.396+0000 7f6936539640 1 -- 172.21.15.146:0/3862895854 wait complete. 2024-09-17T03:46:42.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.398+0000 7f6936539640 1 Processor -- start 2024-09-17T03:46:42.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.398+0000 7f6936539640 1 -- start start 2024-09-17T03:46:42.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.399+0000 7f6936539640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930070fc0 0x7f69301f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.399+0000 7f6936539640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69300735b0 0x7f693013bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.399+0000 7f6936539640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69300cfe10 0x7f693013e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.399+0000 7f6936539640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f69300d0af0 con 0x7f69300735b0 2024-09-17T03:46:42.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.399+0000 7f6936539640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f69300d0970 con 0x7f6930070fc0 2024-09-17T03:46:42.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.399+0000 7f6936539640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f69300d0c70 con 0x7f69300cfe10 2024-09-17T03:46:42.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.399+0000 7f692f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69300735b0 0x7f693013bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.399+0000 7f692f7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69300735b0 0x7f693013bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38686/0 (socket says 172.21.15.146:38686) 2024-09-17T03:46:42.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.399+0000 7f692f7fe640 1 -- 172.21.15.146:0/168128169 learned_addr learned my addr 172.21.15.146:0/168128169 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:42.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.399+0000 7f6934ad6640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69300cfe10 0x7f693013e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.399+0000 7f692ffff640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930070fc0 0x7f69301f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.400+0000 7f692f7fe640 1 -- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69300cfe10 msgr2=0x7f693013e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.401 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.400+0000 7f692f7fe640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69300cfe10 0x7f693013e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.400+0000 7f692f7fe640 1 -- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930070fc0 msgr2=0x7f69301f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.400+0000 7f692f7fe640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930070fc0 0x7f69301f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.400+0000 7f692f7fe640 1 -- 172.21.15.146:0/168128169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693013f470 con 0x7f69300735b0 2024-09-17T03:46:42.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.400+0000 7f692f7fe640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69300735b0 0x7f693013bf20 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 crypto rx=0x7f692400c3a0 tx=0x7f692400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:42.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.400+0000 7f692cff9640 1 -- 172.21.15.146:0/168128169 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924017070 con 0x7f69300735b0 2024-09-17T03:46:42.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.400+0000 7f692cff9640 1 -- 172.21.15.146:0/168128169 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69240053c0 con 0x7f69300735b0 2024-09-17T03:46:42.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.400+0000 7f6936539640 1 -- 172.21.15.146:0/168128169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f693013f750 con 0x7f69300735b0 2024-09-17T03:46:42.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.400+0000 7f692cff9640 1 -- 172.21.15.146:0/168128169 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924003850 con 0x7f69300735b0 2024-09-17T03:46:42.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.400+0000 7f6936539640 1 -- 172.21.15.146:0/168128169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69301f41e0 con 0x7f69300735b0 2024-09-17T03:46:42.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.401+0000 7f6936539640 1 -- 172.21.15.146:0/168128169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f693013f1e0 con 0x7f69300735b0 2024-09-17T03:46:42.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.402+0000 7f692cff9640 1 -- 172.21.15.146:0/168128169 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f692401a070 con 0x7f69300735b0 2024-09-17T03:46:42.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.402+0000 7f692cff9640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f691c078b90 0x7f691c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.402+0000 7f692cff9640 1 -- 172.21.15.146:0/168128169 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f6924099ee0 con 0x7f69300735b0 2024-09-17T03:46:42.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.403+0000 7f692ffff640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f691c078b90 0x7f691c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.403+0000 7f692ffff640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f691c078b90 0x7f691c07b0a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6920034000 tx=0x7f6920004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:42.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.407+0000 7f692cff9640 1 -- 172.21.15.146:0/168128169 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6924061d70 con 0x7f69300735b0 2024-09-17T03:46:42.583 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.583+0000 7f6936539640 1 -- 172.21.15.146:0/168128169 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f693015c9a0 con 0x7f69300735b0 2024-09-17T03:46:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.585+0000 7f692cff9640 1 -- 172.21.15.146:0/168128169 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) ==== 74+0+16727 (secure 0 0 0) 0x7f69240667a0 con 0x7f69300735b0 2024-09-17T03:46:42.584 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:42.584 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":199,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:46:39.856551+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:46:35.852577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_data","create_time":"2024-09-17T03:46:37.175209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:46:42.586 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 -- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f691c078b90 msgr2=0x7f691c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f691c078b90 0x7f691c07b0a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6920034000 tx=0x7f6920004730 comp rx=0 tx=0).stop 2024-09-17T03:46:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 -- 172.21.15.146:0/168128169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69300735b0 msgr2=0x7f693013bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69300735b0 0x7f693013bf20 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 crypto rx=0x7f692400c3a0 tx=0x7f692400c7a0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 -- 172.21.15.146:0/168128169 shutdown_connections 2024-09-17T03:46:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f691c078b90 0x7f691c07b0a0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f69300cfe10 0x7f693013e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69300735b0 0x7f693013bf20 unknown :-1 s=CLOSED pgs=2561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 --2- 172.21.15.146:0/168128169 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6930070fc0 0x7f69301f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 -- 172.21.15.146:0/168128169 >> 172.21.15.146:0/168128169 conn(0x7f69300b3880 msgr2=0x7f693014efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 -- 172.21.15.146:0/168128169 shutdown_connections 2024-09-17T03:46:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.587+0000 7f6936539640 1 -- 172.21.15.146:0/168128169 wait complete. 2024-09-17T03:46:42.598 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:46:42.598 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:46:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.712+0000 7f0e7be15640 1 -- 172.21.15.146:0/1065474845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e7415f540 msgr2=0x7f0e7415f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.712+0000 7f0e7be15640 1 --2- 172.21.15.146:0/1065474845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e7415f540 0x7f0e7415f950 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 crypto rx=0x7f0e74074610 tx=0x7f0e6c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.712+0000 7f0e7be15640 1 -- 172.21.15.146:0/1065474845 shutdown_connections 2024-09-17T03:46:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.712+0000 7f0e7be15640 1 --2- 172.21.15.146:0/1065474845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e7415f540 0x7f0e7415f950 unknown :-1 s=CLOSED pgs=2562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.712+0000 7f0e7be15640 1 --2- 172.21.15.146:0/1065474845 >> v2:172.21.15.179:3300/0 conn(0x7f0e740735b0 0x7f0e740739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.712+0000 7f0e7be15640 1 --2- 172.21.15.146:0/1065474845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e74070fc0 0x7f0e7415c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.712+0000 7f0e7be15640 1 -- 172.21.15.146:0/1065474845 >> 172.21.15.146:0/1065474845 conn(0x7f0e740b3880 msgr2=0x7f0e740d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.712+0000 7f0e7be15640 1 -- 172.21.15.146:0/1065474845 shutdown_connections 2024-09-17T03:46:42.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.712+0000 7f0e7be15640 1 -- 172.21.15.146:0/1065474845 wait complete. 2024-09-17T03:46:42.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.714+0000 7f0e7be15640 1 Processor -- start 2024-09-17T03:46:42.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.714+0000 7f0e7be15640 1 -- start start 2024-09-17T03:46:42.715 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e7be15640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e74070fc0 0x7f0e741e8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e7be15640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e740735b0 0x7f0e74143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e7be15640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e7415f540 0x7f0e74143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e7be15640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7415fe90 con 0x7f0e74070fc0 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e7be15640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0e74156450 con 0x7f0e740735b0 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e7be15640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0e74160010 con 0x7f0e7415f540 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e79bb1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e74070fc0 0x7f0e741e8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e79bb1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e74070fc0 0x7f0e741e8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38710/0 (socket says 172.21.15.146:38710) 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e79bb1640 1 -- 172.21.15.146:0/2090443355 learned_addr learned my addr 172.21.15.146:0/2090443355 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e793b0640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e740735b0 0x7f0e74143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e7a3b2640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e7415f540 0x7f0e74143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e79bb1640 1 -- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e7415f540 msgr2=0x7f0e74143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e79bb1640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e7415f540 0x7f0e74143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e79bb1640 1 -- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e740735b0 msgr2=0x7f0e74143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e79bb1640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e740735b0 0x7f0e74143830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e79bb1640 1 -- 172.21.15.146:0/2090443355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e74141820 con 0x7f0e74070fc0 2024-09-17T03:46:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.715+0000 7f0e7a3b2640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e7415f540 0x7f0e74143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.716+0000 7f0e79bb1640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e74070fc0 0x7f0e741e8750 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000d9a0 tx=0x7f0e7000de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.716+0000 7f0e6a7fc640 1 -- 172.21.15.146:0/2090443355 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e70017070 con 0x7f0e74070fc0 2024-09-17T03:46:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.716+0000 7f0e6a7fc640 1 -- 172.21.15.146:0/2090443355 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e7000be00 con 0x7f0e74070fc0 2024-09-17T03:46:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.716+0000 7f0e6a7fc640 1 -- 172.21.15.146:0/2090443355 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e700106c0 con 0x7f0e74070fc0 2024-09-17T03:46:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.716+0000 7f0e7be15640 1 -- 172.21.15.146:0/2090443355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e741445c0 con 0x7f0e74070fc0 2024-09-17T03:46:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.716+0000 7f0e7be15640 1 -- 172.21.15.146:0/2090443355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e74158040 con 0x7f0e74070fc0 2024-09-17T03:46:42.717 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.717+0000 7f0e7be15640 1 -- 172.21.15.146:0/2090443355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e74070ba0 con 0x7f0e74070fc0 2024-09-17T03:46:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.717+0000 7f0e6a7fc640 1 -- 172.21.15.146:0/2090443355 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e7001a070 con 0x7f0e74070fc0 2024-09-17T03:46:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.718+0000 7f0e6a7fc640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e58078b90 0x7f0e5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.718+0000 7f0e6a7fc640 1 -- 172.21.15.146:0/2090443355 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f0e7009b1c0 con 0x7f0e74070fc0 2024-09-17T03:46:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.718+0000 7f0e793b0640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e58078b90 0x7f0e5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.719+0000 7f0e793b0640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e58078b90 0x7f0e5807b0a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f0e74154bc0 tx=0x7f0e64005e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.722+0000 7f0e6a7fc640 1 -- 172.21.15.146:0/2090443355 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0e74070ba0 con 0x7f0e74070fc0 2024-09-17T03:46:42.893 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.893+0000 7f0e7be15640 1 -- 172.21.15.146:0/2090443355 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e740739c0 con 0x7f0e58078b90 2024-09-17T03:46:42.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.898+0000 7f0e6a7fc640 1 -- 172.21.15.146:0/2090443355 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249912 (secure 0 0 0) 0x7f0e740739c0 con 0x7f0e58078b90 2024-09-17T03:46:42.900 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:42.902 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 -- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e58078b90 msgr2=0x7f0e5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e58078b90 0x7f0e5807b0a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f0e74154bc0 tx=0x7f0e64005e30 comp rx=0 tx=0).stop 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 -- 172.21.15.146:0/2090443355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e74070fc0 msgr2=0x7f0e741e8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e74070fc0 0x7f0e741e8750 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000d9a0 tx=0x7f0e7000de60 comp rx=0 tx=0).stop 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 -- 172.21.15.146:0/2090443355 shutdown_connections 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0e58078b90 0x7f0e5807b0a0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0e7415f540 0x7f0e74143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0e740735b0 0x7f0e74143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 --2- 172.21.15.146:0/2090443355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e74070fc0 0x7f0e741e8750 unknown :-1 s=CLOSED pgs=2563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 -- 172.21.15.146:0/2090443355 >> 172.21.15.146:0/2090443355 conn(0x7f0e740b3880 msgr2=0x7f0e7406cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 -- 172.21.15.146:0/2090443355 shutdown_connections 2024-09-17T03:46:42.904 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:42.902+0000 7f0e7be15640 1 -- 172.21.15.146:0/2090443355 wait complete. 2024-09-17T03:46:42.913 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":610,"stamp":"2024-09-17T03:46:42.010897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":131,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474188,"kb_used_data":20660,"kb_used_omap":12,"kb_used_meta":453299,"kb_avail":754500532,"statfs":{"total":773094113280,"available":772608544768,"internally_reserved":0,"allocated":21155840,"data_stored":9942963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":464178737},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.175042"},"pg_stats":[{"pgid":"31.3f","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873864+0000","last_change":"2024-09-17T03:46:38.871668+0000","last_active":"2024-09-17T03:46:38.873864+0000","last_peered":"2024-09-17T03:46:38.873864+0000","last_clean":"2024-09-17T03:46:38.873864+0000","last_became_active":"2024-09-17T03:46:38.871334+0000","last_became_peered":"2024-09-17T03:46:38.871334+0000","last_unstale":"2024-09-17T03:46:38.873864+0000","last_undegraded":"2024-09-17T03:46:38.873864+0000","last_fullsized":"2024-09-17T03:46:38.873864+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:33.859485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884639+0000","last_change":"2024-09-17T03:46:38.879231+0000","last_active":"2024-09-17T03:46:38.884639+0000","last_peered":"2024-09-17T03:46:38.884639+0000","last_clean":"2024-09-17T03:46:38.884639+0000","last_became_active":"2024-09-17T03:46:38.878901+0000","last_became_peered":"2024-09-17T03:46:38.878901+0000","last_unstale":"2024-09-17T03:46:38.884639+0000","last_undegraded":"2024-09-17T03:46:38.884639+0000","last_fullsized":"2024-09-17T03:46:38.884639+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:40.395914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868060+0000","last_change":"2024-09-17T03:46:38.866452+0000","last_active":"2024-09-17T03:46:38.868060+0000","last_peered":"2024-09-17T03:46:38.868060+0000","last_clean":"2024-09-17T03:46:38.868060+0000","last_became_active":"2024-09-17T03:46:38.866088+0000","last_became_peered":"2024-09-17T03:46:38.866088+0000","last_unstale":"2024-09-17T03:46:38.868060+0000","last_undegraded":"2024-09-17T03:46:38.868060+0000","last_fullsized":"2024-09-17T03:46:38.868060+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:50.828365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.864979+0000","last_change":"2024-09-17T03:46:38.862117+0000","last_active":"2024-09-17T03:46:38.864979+0000","last_peered":"2024-09-17T03:46:38.864979+0000","last_clean":"2024-09-17T03:46:38.864979+0000","last_became_active":"2024-09-17T03:46:38.861759+0000","last_became_peered":"2024-09-17T03:46:38.861759+0000","last_unstale":"2024-09-17T03:46:38.864979+0000","last_undegraded":"2024-09-17T03:46:38.864979+0000","last_fullsized":"2024-09-17T03:46:38.864979+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:03.120246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879159+0000","last_change":"2024-09-17T03:46:38.877127+0000","last_active":"2024-09-17T03:46:38.879159+0000","last_peered":"2024-09-17T03:46:38.879159+0000","last_clean":"2024-09-17T03:46:38.879159+0000","last_became_active":"2024-09-17T03:46:38.876807+0000","last_became_peered":"2024-09-17T03:46:38.876807+0000","last_unstale":"2024-09-17T03:46:38.879159+0000","last_undegraded":"2024-09-17T03:46:38.879159+0000","last_fullsized":"2024-09-17T03:46:38.879159+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:36.353553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872714+0000","last_change":"2024-09-17T03:46:38.866116+0000","last_active":"2024-09-17T03:46:38.872714+0000","last_peered":"2024-09-17T03:46:38.872714+0000","last_clean":"2024-09-17T03:46:38.872714+0000","last_became_active":"2024-09-17T03:46:38.865806+0000","last_became_peered":"2024-09-17T03:46:38.865806+0000","last_unstale":"2024-09-17T03:46:38.872714+0000","last_undegraded":"2024-09-17T03:46:38.872714+0000","last_fullsized":"2024-09-17T03:46:38.872714+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:59.762164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878063+0000","last_change":"2024-09-17T03:46:38.876509+0000","last_active":"2024-09-17T03:46:38.878063+0000","last_peered":"2024-09-17T03:46:38.878063+0000","last_clean":"2024-09-17T03:46:38.878063+0000","last_became_active":"2024-09-17T03:46:38.876170+0000","last_became_peered":"2024-09-17T03:46:38.876170+0000","last_unstale":"2024-09-17T03:46:38.878063+0000","last_undegraded":"2024-09-17T03:46:38.878063+0000","last_fullsized":"2024-09-17T03:46:38.878063+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:07.118394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871684+0000","last_change":"2024-09-17T03:46:38.869498+0000","last_active":"2024-09-17T03:46:38.871684+0000","last_peered":"2024-09-17T03:46:38.871684+0000","last_clean":"2024-09-17T03:46:38.871684+0000","last_became_active":"2024-09-17T03:46:38.869166+0000","last_became_peered":"2024-09-17T03:46:38.869166+0000","last_unstale":"2024-09-17T03:46:38.871684+0000","last_undegraded":"2024-09-17T03:46:38.871684+0000","last_fullsized":"2024-09-17T03:46:38.871684+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.132290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883071+0000","last_change":"2024-09-17T03:46:38.874775+0000","last_active":"2024-09-17T03:46:38.883071+0000","last_peered":"2024-09-17T03:46:38.883071+0000","last_clean":"2024-09-17T03:46:38.883071+0000","last_became_active":"2024-09-17T03:46:38.874487+0000","last_became_peered":"2024-09-17T03:46:38.874487+0000","last_unstale":"2024-09-17T03:46:38.883071+0000","last_undegraded":"2024-09-17T03:46:38.883071+0000","last_fullsized":"2024-09-17T03:46:38.883071+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:41.649494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871053+0000","last_change":"2024-09-17T03:46:38.864701+0000","last_active":"2024-09-17T03:46:38.871053+0000","last_peered":"2024-09-17T03:46:38.871053+0000","last_clean":"2024-09-17T03:46:38.871053+0000","last_became_active":"2024-09-17T03:46:38.864315+0000","last_became_peered":"2024-09-17T03:46:38.864315+0000","last_unstale":"2024-09-17T03:46:38.871053+0000","last_undegraded":"2024-09-17T03:46:38.871053+0000","last_fullsized":"2024-09-17T03:46:38.871053+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:23.297852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879231+0000","last_change":"2024-09-17T03:46:38.877166+0000","last_active":"2024-09-17T03:46:38.879231+0000","last_peered":"2024-09-17T03:46:38.879231+0000","last_clean":"2024-09-17T03:46:38.879231+0000","last_became_active":"2024-09-17T03:46:38.876853+0000","last_became_peered":"2024-09-17T03:46:38.876853+0000","last_unstale":"2024-09-17T03:46:38.879231+0000","last_undegraded":"2024-09-17T03:46:38.879231+0000","last_fullsized":"2024-09-17T03:46:38.879231+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:22.583146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873963+0000","last_change":"2024-09-17T03:46:38.871599+0000","last_active":"2024-09-17T03:46:38.873963+0000","last_peered":"2024-09-17T03:46:38.873963+0000","last_clean":"2024-09-17T03:46:38.873963+0000","last_became_active":"2024-09-17T03:46:38.871279+0000","last_became_peered":"2024-09-17T03:46:38.871279+0000","last_unstale":"2024-09-17T03:46:38.873963+0000","last_undegraded":"2024-09-17T03:46:38.873963+0000","last_fullsized":"2024-09-17T03:46:38.873963+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:39.019606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878350+0000","last_change":"2024-09-17T03:46:38.877390+0000","last_active":"2024-09-17T03:46:38.878350+0000","last_peered":"2024-09-17T03:46:38.878350+0000","last_clean":"2024-09-17T03:46:38.878350+0000","last_became_active":"2024-09-17T03:46:38.877043+0000","last_became_peered":"2024-09-17T03:46:38.877043+0000","last_unstale":"2024-09-17T03:46:38.878350+0000","last_undegraded":"2024-09-17T03:46:38.878350+0000","last_fullsized":"2024-09-17T03:46:38.878350+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:52.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856633+0000","last_change":"2024-09-17T03:46:38.855444+0000","last_active":"2024-09-17T03:46:38.856633+0000","last_peered":"2024-09-17T03:46:38.856633+0000","last_clean":"2024-09-17T03:46:38.856633+0000","last_became_active":"2024-09-17T03:46:38.855104+0000","last_became_peered":"2024-09-17T03:46:38.855104+0000","last_unstale":"2024-09-17T03:46:38.856633+0000","last_undegraded":"2024-09-17T03:46:38.856633+0000","last_fullsized":"2024-09-17T03:46:38.856633+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:45.332349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871069+0000","last_change":"2024-09-17T03:46:38.869122+0000","last_active":"2024-09-17T03:46:38.871069+0000","last_peered":"2024-09-17T03:46:38.871069+0000","last_clean":"2024-09-17T03:46:38.871069+0000","last_became_active":"2024-09-17T03:46:38.868818+0000","last_became_peered":"2024-09-17T03:46:38.868818+0000","last_unstale":"2024-09-17T03:46:38.871069+0000","last_undegraded":"2024-09-17T03:46:38.871069+0000","last_fullsized":"2024-09-17T03:46:38.871069+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:47.484288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874564+0000","last_change":"2024-09-17T03:46:38.873994+0000","last_active":"2024-09-17T03:46:38.874564+0000","last_peered":"2024-09-17T03:46:38.874564+0000","last_clean":"2024-09-17T03:46:38.874564+0000","last_became_active":"2024-09-17T03:46:38.873589+0000","last_became_peered":"2024-09-17T03:46:38.873589+0000","last_unstale":"2024-09-17T03:46:38.874564+0000","last_undegraded":"2024-09-17T03:46:38.874564+0000","last_fullsized":"2024-09-17T03:46:38.874564+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:12.986513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872593+0000","last_change":"2024-09-17T03:46:38.869135+0000","last_active":"2024-09-17T03:46:38.872593+0000","last_peered":"2024-09-17T03:46:38.872593+0000","last_clean":"2024-09-17T03:46:38.872593+0000","last_became_active":"2024-09-17T03:46:38.868524+0000","last_became_peered":"2024-09-17T03:46:38.868524+0000","last_unstale":"2024-09-17T03:46:38.872593+0000","last_undegraded":"2024-09-17T03:46:38.872593+0000","last_fullsized":"2024-09-17T03:46:38.872593+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:39.027714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872689+0000","last_change":"2024-09-17T03:46:38.871659+0000","last_active":"2024-09-17T03:46:38.872689+0000","last_peered":"2024-09-17T03:46:38.872689+0000","last_clean":"2024-09-17T03:46:38.872689+0000","last_became_active":"2024-09-17T03:46:38.871304+0000","last_became_peered":"2024-09-17T03:46:38.871304+0000","last_unstale":"2024-09-17T03:46:38.872689+0000","last_undegraded":"2024-09-17T03:46:38.872689+0000","last_fullsized":"2024-09-17T03:46:38.872689+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:42.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868055+0000","last_change":"2024-09-17T03:46:38.862294+0000","last_active":"2024-09-17T03:46:38.868055+0000","last_peered":"2024-09-17T03:46:38.868055+0000","last_clean":"2024-09-17T03:46:38.868055+0000","last_became_active":"2024-09-17T03:46:38.861912+0000","last_became_peered":"2024-09-17T03:46:38.861912+0000","last_unstale":"2024-09-17T03:46:38.868055+0000","last_undegraded":"2024-09-17T03:46:38.868055+0000","last_fullsized":"2024-09-17T03:46:38.868055+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:45.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883740+0000","last_change":"2024-09-17T03:46:38.876742+0000","last_active":"2024-09-17T03:46:38.883740+0000","last_peered":"2024-09-17T03:46:38.883740+0000","last_clean":"2024-09-17T03:46:38.883740+0000","last_became_active":"2024-09-17T03:46:38.876441+0000","last_became_peered":"2024-09-17T03:46:38.876441+0000","last_unstale":"2024-09-17T03:46:38.883740+0000","last_undegraded":"2024-09-17T03:46:38.883740+0000","last_fullsized":"2024-09-17T03:46:38.883740+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:24.794528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.864971+0000","last_change":"2024-09-17T03:46:38.862445+0000","last_active":"2024-09-17T03:46:38.864971+0000","last_peered":"2024-09-17T03:46:38.864971+0000","last_clean":"2024-09-17T03:46:38.864971+0000","last_became_active":"2024-09-17T03:46:38.861998+0000","last_became_peered":"2024-09-17T03:46:38.861998+0000","last_unstale":"2024-09-17T03:46:38.864971+0000","last_undegraded":"2024-09-17T03:46:38.864971+0000","last_fullsized":"2024-09-17T03:46:38.864971+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:55.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879214+0000","last_change":"2024-09-17T03:46:38.877664+0000","last_active":"2024-09-17T03:46:38.879214+0000","last_peered":"2024-09-17T03:46:38.879214+0000","last_clean":"2024-09-17T03:46:38.879214+0000","last_became_active":"2024-09-17T03:46:38.877375+0000","last_became_peered":"2024-09-17T03:46:38.877375+0000","last_unstale":"2024-09-17T03:46:38.879214+0000","last_undegraded":"2024-09-17T03:46:38.879214+0000","last_fullsized":"2024-09-17T03:46:38.879214+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:17.248059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.882971+0000","last_change":"2024-09-17T03:46:38.874450+0000","last_active":"2024-09-17T03:46:38.882971+0000","last_peered":"2024-09-17T03:46:38.882971+0000","last_clean":"2024-09-17T03:46:38.882971+0000","last_became_active":"2024-09-17T03:46:38.873914+0000","last_became_peered":"2024-09-17T03:46:38.873914+0000","last_unstale":"2024-09-17T03:46:38.882971+0000","last_undegraded":"2024-09-17T03:46:38.882971+0000","last_fullsized":"2024-09-17T03:46:38.882971+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:18.270227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.885019+0000","last_change":"2024-09-17T03:46:38.880123+0000","last_active":"2024-09-17T03:46:38.885019+0000","last_peered":"2024-09-17T03:46:38.885019+0000","last_clean":"2024-09-17T03:46:38.885019+0000","last_became_active":"2024-09-17T03:46:38.879828+0000","last_became_peered":"2024-09-17T03:46:38.879828+0000","last_unstale":"2024-09-17T03:46:38.885019+0000","last_undegraded":"2024-09-17T03:46:38.885019+0000","last_fullsized":"2024-09-17T03:46:38.885019+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.132290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872413+0000","last_change":"2024-09-17T03:46:38.864173+0000","last_active":"2024-09-17T03:46:38.872413+0000","last_peered":"2024-09-17T03:46:38.872413+0000","last_clean":"2024-09-17T03:46:38.872413+0000","last_became_active":"2024-09-17T03:46:38.863861+0000","last_became_peered":"2024-09-17T03:46:38.863861+0000","last_unstale":"2024-09-17T03:46:38.872413+0000","last_undegraded":"2024-09-17T03:46:38.872413+0000","last_fullsized":"2024-09-17T03:46:38.872413+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:14.514064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.877166+0000","last_change":"2024-09-17T03:46:38.875927+0000","last_active":"2024-09-17T03:46:38.877166+0000","last_peered":"2024-09-17T03:46:38.877166+0000","last_clean":"2024-09-17T03:46:38.877166+0000","last_became_active":"2024-09-17T03:46:38.875618+0000","last_became_peered":"2024-09-17T03:46:38.875618+0000","last_unstale":"2024-09-17T03:46:38.877166+0000","last_undegraded":"2024-09-17T03:46:38.877166+0000","last_fullsized":"2024-09-17T03:46:38.877166+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:08.073928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873903+0000","last_change":"2024-09-17T03:46:38.870813+0000","last_active":"2024-09-17T03:46:38.873903+0000","last_peered":"2024-09-17T03:46:38.873903+0000","last_clean":"2024-09-17T03:46:38.873903+0000","last_became_active":"2024-09-17T03:46:38.870493+0000","last_became_peered":"2024-09-17T03:46:38.870493+0000","last_unstale":"2024-09-17T03:46:38.873903+0000","last_undegraded":"2024-09-17T03:46:38.873903+0000","last_fullsized":"2024-09-17T03:46:38.873903+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:28.445042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1e","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878982+0000","last_change":"2024-09-17T03:46:37.849807+0000","last_active":"2024-09-17T03:46:38.878982+0000","last_peered":"2024-09-17T03:46:38.878982+0000","last_clean":"2024-09-17T03:46:38.878982+0000","last_became_active":"2024-09-17T03:46:37.849384+0000","last_became_peered":"2024-09-17T03:46:37.849384+0000","last_unstale":"2024-09-17T03:46:38.878982+0000","last_undegraded":"2024-09-17T03:46:38.878982+0000","last_fullsized":"2024-09-17T03:46:38.878982+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:56.687816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872914+0000","last_change":"2024-09-17T03:46:38.864532+0000","last_active":"2024-09-17T03:46:38.872914+0000","last_peered":"2024-09-17T03:46:38.872914+0000","last_clean":"2024-09-17T03:46:38.872914+0000","last_became_active":"2024-09-17T03:46:38.864221+0000","last_became_peered":"2024-09-17T03:46:38.864221+0000","last_unstale":"2024-09-17T03:46:38.872914+0000","last_undegraded":"2024-09-17T03:46:38.872914+0000","last_fullsized":"2024-09-17T03:46:38.872914+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.402855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841827+0000","last_change":"2024-09-17T03:46:36.841827+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841827+0000","last_undegraded":"2024-09-17T03:46:36.841827+0000","last_fullsized":"2024-09-17T03:46:36.841827+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.859231+0000","last_change":"2024-09-17T03:46:38.857502+0000","last_active":"2024-09-17T03:46:38.859231+0000","last_peered":"2024-09-17T03:46:38.859231+0000","last_clean":"2024-09-17T03:46:38.859231+0000","last_became_active":"2024-09-17T03:46:38.857193+0000","last_became_peered":"2024-09-17T03:46:38.857193+0000","last_unstale":"2024-09-17T03:46:38.859231+0000","last_undegraded":"2024-09-17T03:46:38.859231+0000","last_fullsized":"2024-09-17T03:46:38.859231+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:57.596324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.843011+0000","last_change":"2024-09-17T03:46:36.843011+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.843011+0000","last_undegraded":"2024-09-17T03:46:36.843011+0000","last_fullsized":"2024-09-17T03:46:36.843011+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872348+0000","last_change":"2024-09-17T03:46:38.863432+0000","last_active":"2024-09-17T03:46:38.872348+0000","last_peered":"2024-09-17T03:46:38.872348+0000","last_clean":"2024-09-17T03:46:38.872348+0000","last_became_active":"2024-09-17T03:46:38.863073+0000","last_became_peered":"2024-09-17T03:46:38.863073+0000","last_unstale":"2024-09-17T03:46:38.872348+0000","last_undegraded":"2024-09-17T03:46:38.872348+0000","last_fullsized":"2024-09-17T03:46:38.872348+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:38.721703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1b","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874483+0000","last_change":"2024-09-17T03:46:37.857697+0000","last_active":"2024-09-17T03:46:38.874483+0000","last_peered":"2024-09-17T03:46:38.874483+0000","last_clean":"2024-09-17T03:46:38.874483+0000","last_became_active":"2024-09-17T03:46:37.857396+0000","last_became_peered":"2024-09-17T03:46:37.857396+0000","last_unstale":"2024-09-17T03:46:38.874483+0000","last_undegraded":"2024-09-17T03:46:38.874483+0000","last_fullsized":"2024-09-17T03:46:38.874483+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:47.376600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878548+0000","last_change":"2024-09-17T03:46:38.877940+0000","last_active":"2024-09-17T03:46:38.878548+0000","last_peered":"2024-09-17T03:46:38.878548+0000","last_clean":"2024-09-17T03:46:38.878548+0000","last_became_active":"2024-09-17T03:46:38.877521+0000","last_became_peered":"2024-09-17T03:46:38.877521+0000","last_unstale":"2024-09-17T03:46:38.878548+0000","last_undegraded":"2024-09-17T03:46:38.878548+0000","last_fullsized":"2024-09-17T03:46:38.878548+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:35.037081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884389+0000","last_change":"2024-09-17T03:46:37.853555+0000","last_active":"2024-09-17T03:46:38.884389+0000","last_peered":"2024-09-17T03:46:38.884389+0000","last_clean":"2024-09-17T03:46:38.884389+0000","last_became_active":"2024-09-17T03:46:37.853225+0000","last_became_peered":"2024-09-17T03:46:37.853225+0000","last_unstale":"2024-09-17T03:46:38.884389+0000","last_undegraded":"2024-09-17T03:46:38.884389+0000","last_fullsized":"2024-09-17T03:46:38.884389+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:52.469536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856579+0000","last_change":"2024-09-17T03:46:37.856566+0000","last_active":"2024-09-17T03:46:38.856579+0000","last_peered":"2024-09-17T03:46:38.856579+0000","last_clean":"2024-09-17T03:46:38.856579+0000","last_became_active":"2024-09-17T03:46:37.856251+0000","last_became_peered":"2024-09-17T03:46:37.856251+0000","last_unstale":"2024-09-17T03:46:38.856579+0000","last_undegraded":"2024-09-17T03:46:38.856579+0000","last_fullsized":"2024-09-17T03:46:38.856579+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:11.674372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.875351+0000","last_change":"2024-09-17T03:46:38.874486+0000","last_active":"2024-09-17T03:46:38.875351+0000","last_peered":"2024-09-17T03:46:38.875351+0000","last_clean":"2024-09-17T03:46:38.875351+0000","last_became_active":"2024-09-17T03:46:38.874172+0000","last_became_peered":"2024-09-17T03:46:38.874172+0000","last_unstale":"2024-09-17T03:46:38.875351+0000","last_undegraded":"2024-09-17T03:46:38.875351+0000","last_fullsized":"2024-09-17T03:46:38.875351+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:57.693671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841994+0000","last_change":"2024-09-17T03:46:36.841994+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841994+0000","last_undegraded":"2024-09-17T03:46:36.841994+0000","last_fullsized":"2024-09-17T03:46:36.841994+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883287+0000","last_change":"2024-09-17T03:46:38.875932+0000","last_active":"2024-09-17T03:46:38.883287+0000","last_peered":"2024-09-17T03:46:38.883287+0000","last_clean":"2024-09-17T03:46:38.883287+0000","last_became_active":"2024-09-17T03:46:38.875606+0000","last_became_peered":"2024-09-17T03:46:38.875606+0000","last_unstale":"2024-09-17T03:46:38.883287+0000","last_undegraded":"2024-09-17T03:46:38.883287+0000","last_fullsized":"2024-09-17T03:46:38.883287+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:59.503799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.853027+0000","last_change":"2024-09-17T03:46:37.859345+0000","last_active":"2024-09-17T03:46:38.853027+0000","last_peered":"2024-09-17T03:46:38.853027+0000","last_clean":"2024-09-17T03:46:38.853027+0000","last_became_active":"2024-09-17T03:46:37.859006+0000","last_became_peered":"2024-09-17T03:46:37.859006+0000","last_unstale":"2024-09-17T03:46:38.853027+0000","last_undegraded":"2024-09-17T03:46:38.853027+0000","last_fullsized":"2024-09-17T03:46:38.853027+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:10.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874637+0000","last_change":"2024-09-17T03:46:38.871889+0000","last_active":"2024-09-17T03:46:38.874637+0000","last_peered":"2024-09-17T03:46:38.874637+0000","last_clean":"2024-09-17T03:46:38.874637+0000","last_became_active":"2024-09-17T03:46:38.871405+0000","last_became_peered":"2024-09-17T03:46:38.871405+0000","last_unstale":"2024-09-17T03:46:38.874637+0000","last_undegraded":"2024-09-17T03:46:38.874637+0000","last_fullsized":"2024-09-17T03:46:38.874637+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:11.581943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842752+0000","last_change":"2024-09-17T03:46:36.842752+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842752+0000","last_undegraded":"2024-09-17T03:46:36.842752+0000","last_fullsized":"2024-09-17T03:46:36.842752+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.15","version":"198'3","reported_seq":16,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884805+0000","last_change":"2024-09-17T03:46:37.857029+0000","last_active":"2024-09-17T03:46:38.884805+0000","last_peered":"2024-09-17T03:46:38.884805+0000","last_clean":"2024-09-17T03:46:38.884805+0000","last_became_active":"2024-09-17T03:46:37.856738+0000","last_became_peered":"2024-09-17T03:46:37.856738+0000","last_unstale":"2024-09-17T03:46:38.884805+0000","last_undegraded":"2024-09-17T03:46:38.884805+0000","last_fullsized":"2024-09-17T03:46:38.884805+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:01.595359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872102+0000","last_change":"2024-09-17T03:46:38.867964+0000","last_active":"2024-09-17T03:46:38.872102+0000","last_peered":"2024-09-17T03:46:38.872102+0000","last_clean":"2024-09-17T03:46:38.872102+0000","last_became_active":"2024-09-17T03:46:38.867541+0000","last_became_peered":"2024-09-17T03:46:38.867541+0000","last_unstale":"2024-09-17T03:46:38.872102+0000","last_undegraded":"2024-09-17T03:46:38.872102+0000","last_fullsized":"2024-09-17T03:46:38.872102+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:40.395914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.14","version":"198'6","reported_seq":19,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.886872+0000","last_change":"2024-09-17T03:46:37.861154+0000","last_active":"2024-09-17T03:46:38.886872+0000","last_peered":"2024-09-17T03:46:38.886872+0000","last_clean":"2024-09-17T03:46:38.886872+0000","last_became_active":"2024-09-17T03:46:37.860819+0000","last_became_peered":"2024-09-17T03:46:37.860819+0000","last_unstale":"2024-09-17T03:46:38.886872+0000","last_undegraded":"2024-09-17T03:46:38.886872+0000","last_fullsized":"2024-09-17T03:46:38.886872+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:33.736709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871744+0000","last_change":"2024-09-17T03:46:38.869534+0000","last_active":"2024-09-17T03:46:38.871744+0000","last_peered":"2024-09-17T03:46:38.871744+0000","last_clean":"2024-09-17T03:46:38.871744+0000","last_became_active":"2024-09-17T03:46:38.869205+0000","last_became_peered":"2024-09-17T03:46:38.869205+0000","last_unstale":"2024-09-17T03:46:38.871744+0000","last_undegraded":"2024-09-17T03:46:38.871744+0000","last_fullsized":"2024-09-17T03:46:38.871744+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:27.696745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.13","version":"198'2","reported_seq":15,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884557+0000","last_change":"2024-09-17T03:46:37.857360+0000","last_active":"2024-09-17T03:46:38.884557+0000","last_peered":"2024-09-17T03:46:38.884557+0000","last_clean":"2024-09-17T03:46:38.884557+0000","last_became_active":"2024-09-17T03:46:37.857041+0000","last_became_peered":"2024-09-17T03:46:37.857041+0000","last_unstale":"2024-09-17T03:46:38.884557+0000","last_undegraded":"2024-09-17T03:46:38.884557+0000","last_fullsized":"2024-09-17T03:46:38.884557+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:15.827164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868255+0000","last_change":"2024-09-17T03:46:38.866013+0000","last_active":"2024-09-17T03:46:38.868255+0000","last_peered":"2024-09-17T03:46:38.868255+0000","last_clean":"2024-09-17T03:46:38.868255+0000","last_became_active":"2024-09-17T03:46:38.865682+0000","last_became_peered":"2024-09-17T03:46:38.865682+0000","last_unstale":"2024-09-17T03:46:38.868255+0000","last_undegraded":"2024-09-17T03:46:38.868255+0000","last_fullsized":"2024-09-17T03:46:38.868255+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:53.452915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841916+0000","last_change":"2024-09-17T03:46:36.841916+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841916+0000","last_undegraded":"2024-09-17T03:46:36.841916+0000","last_fullsized":"2024-09-17T03:46:36.841916+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.877632+0000","last_change":"2024-09-17T03:46:38.876700+0000","last_active":"2024-09-17T03:46:38.877632+0000","last_peered":"2024-09-17T03:46:38.877632+0000","last_clean":"2024-09-17T03:46:38.877632+0000","last_became_active":"2024-09-17T03:46:38.876391+0000","last_became_peered":"2024-09-17T03:46:38.876391+0000","last_unstale":"2024-09-17T03:46:38.877632+0000","last_undegraded":"2024-09-17T03:46:38.877632+0000","last_fullsized":"2024-09-17T03:46:38.877632+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:42.280443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856153+0000","last_change":"2024-09-17T03:46:37.851640+0000","last_active":"2024-09-17T03:46:38.856153+0000","last_peered":"2024-09-17T03:46:38.856153+0000","last_clean":"2024-09-17T03:46:38.856153+0000","last_became_active":"2024-09-17T03:46:37.851293+0000","last_became_peered":"2024-09-17T03:46:37.851293+0000","last_unstale":"2024-09-17T03:46:38.856153+0000","last_undegraded":"2024-09-17T03:46:38.856153+0000","last_fullsized":"2024-09-17T03:46:38.856153+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:38.013751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873248+0000","last_change":"2024-09-17T03:46:38.872576+0000","last_active":"2024-09-17T03:46:38.873248+0000","last_peered":"2024-09-17T03:46:38.873248+0000","last_clean":"2024-09-17T03:46:38.873248+0000","last_became_active":"2024-09-17T03:46:38.872235+0000","last_became_peered":"2024-09-17T03:46:38.872235+0000","last_unstale":"2024-09-17T03:46:38.873248+0000","last_undegraded":"2024-09-17T03:46:38.873248+0000","last_fullsized":"2024-09-17T03:46:38.873248+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:22.527655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.10","version":"198'8","reported_seq":21,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883901+0000","last_change":"2024-09-17T03:46:37.859205+0000","last_active":"2024-09-17T03:46:38.883901+0000","last_peered":"2024-09-17T03:46:38.883901+0000","last_clean":"2024-09-17T03:46:38.883901+0000","last_became_active":"2024-09-17T03:46:37.858827+0000","last_became_peered":"2024-09-17T03:46:37.858827+0000","last_unstale":"2024-09-17T03:46:38.883901+0000","last_undegraded":"2024-09-17T03:46:38.883901+0000","last_fullsized":"2024-09-17T03:46:38.883901+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:52.447059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873714+0000","last_change":"2024-09-17T03:46:38.870343+0000","last_active":"2024-09-17T03:46:38.873714+0000","last_peered":"2024-09-17T03:46:38.873714+0000","last_clean":"2024-09-17T03:46:38.873714+0000","last_became_active":"2024-09-17T03:46:38.870050+0000","last_became_peered":"2024-09-17T03:46:38.870050+0000","last_unstale":"2024-09-17T03:46:38.873714+0000","last_undegraded":"2024-09-17T03:46:38.873714+0000","last_fullsized":"2024-09-17T03:46:38.873714+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:41.722010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.f","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879122+0000","last_change":"2024-09-17T03:46:37.856352+0000","last_active":"2024-09-17T03:46:38.879122+0000","last_peered":"2024-09-17T03:46:38.879122+0000","last_clean":"2024-09-17T03:46:38.879122+0000","last_became_active":"2024-09-17T03:46:37.855823+0000","last_became_peered":"2024-09-17T03:46:37.855823+0000","last_unstale":"2024-09-17T03:46:38.879122+0000","last_undegraded":"2024-09-17T03:46:38.879122+0000","last_fullsized":"2024-09-17T03:46:38.879122+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:32.853630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842235+0000","last_change":"2024-09-17T03:46:36.842235+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842235+0000","last_undegraded":"2024-09-17T03:46:36.842235+0000","last_fullsized":"2024-09-17T03:46:36.842235+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871988+0000","last_change":"2024-09-17T03:46:38.869114+0000","last_active":"2024-09-17T03:46:38.871988+0000","last_peered":"2024-09-17T03:46:38.871988+0000","last_clean":"2024-09-17T03:46:38.871988+0000","last_became_active":"2024-09-17T03:46:38.868763+0000","last_became_peered":"2024-09-17T03:46:38.868763+0000","last_unstale":"2024-09-17T03:46:38.871988+0000","last_undegraded":"2024-09-17T03:46:38.871988+0000","last_fullsized":"2024-09-17T03:46:38.871988+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:21.384878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.d","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.875112+0000","last_change":"2024-09-17T03:46:37.855339+0000","last_active":"2024-09-17T03:46:38.875112+0000","last_peered":"2024-09-17T03:46:38.875112+0000","last_clean":"2024-09-17T03:46:38.875112+0000","last_became_active":"2024-09-17T03:46:37.854766+0000","last_became_peered":"2024-09-17T03:46:37.854766+0000","last_unstale":"2024-09-17T03:46:38.875112+0000","last_undegraded":"2024-09-17T03:46:38.875112+0000","last_fullsized":"2024-09-17T03:46:38.875112+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:25.106006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.865023+0000","last_change":"2024-09-17T03:46:38.858260+0000","last_active":"2024-09-17T03:46:38.865023+0000","last_peered":"2024-09-17T03:46:38.865023+0000","last_clean":"2024-09-17T03:46:38.865023+0000","last_became_active":"2024-09-17T03:46:38.856652+0000","last_became_peered":"2024-09-17T03:46:38.856652+0000","last_unstale":"2024-09-17T03:46:38.865023+0000","last_undegraded":"2024-09-17T03:46:38.865023+0000","last_fullsized":"2024-09-17T03:46:38.865023+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:14.476439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856659+0000","last_change":"2024-09-17T03:46:37.858541+0000","last_active":"2024-09-17T03:46:38.856659+0000","last_peered":"2024-09-17T03:46:38.856659+0000","last_clean":"2024-09-17T03:46:38.856659+0000","last_became_active":"2024-09-17T03:46:37.857850+0000","last_became_peered":"2024-09-17T03:46:37.857850+0000","last_unstale":"2024-09-17T03:46:38.856659+0000","last_undegraded":"2024-09-17T03:46:38.856659+0000","last_fullsized":"2024-09-17T03:46:38.856659+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:06.112538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868122+0000","last_change":"2024-09-17T03:46:38.860988+0000","last_active":"2024-09-17T03:46:38.868122+0000","last_peered":"2024-09-17T03:46:38.868122+0000","last_clean":"2024-09-17T03:46:38.868122+0000","last_became_active":"2024-09-17T03:46:38.860657+0000","last_became_peered":"2024-09-17T03:46:38.860657+0000","last_unstale":"2024-09-17T03:46:38.868122+0000","last_undegraded":"2024-09-17T03:46:38.868122+0000","last_fullsized":"2024-09-17T03:46:38.868122+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:37.643112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842262+0000","last_change":"2024-09-17T03:46:36.842262+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842262+0000","last_undegraded":"2024-09-17T03:46:36.842262+0000","last_fullsized":"2024-09-17T03:46:36.842262+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873819+0000","last_change":"2024-09-17T03:46:38.872416+0000","last_active":"2024-09-17T03:46:38.873819+0000","last_peered":"2024-09-17T03:46:38.873819+0000","last_clean":"2024-09-17T03:46:38.873819+0000","last_became_active":"2024-09-17T03:46:38.872130+0000","last_became_peered":"2024-09-17T03:46:38.872130+0000","last_unstale":"2024-09-17T03:46:38.873819+0000","last_undegraded":"2024-09-17T03:46:38.873819+0000","last_fullsized":"2024-09-17T03:46:38.873819+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:12.680228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856452+0000","last_change":"2024-09-17T03:46:37.856091+0000","last_active":"2024-09-17T03:46:38.856452+0000","last_peered":"2024-09-17T03:46:38.856452+0000","last_clean":"2024-09-17T03:46:38.856452+0000","last_became_active":"2024-09-17T03:46:37.855774+0000","last_became_peered":"2024-09-17T03:46:37.855774+0000","last_unstale":"2024-09-17T03:46:38.856452+0000","last_undegraded":"2024-09-17T03:46:38.856452+0000","last_fullsized":"2024-09-17T03:46:38.856452+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:20.379023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.881413+0000","last_change":"2024-09-17T03:46:38.872310+0000","last_active":"2024-09-17T03:46:38.881413+0000","last_peered":"2024-09-17T03:46:38.881413+0000","last_clean":"2024-09-17T03:46:38.881413+0000","last_became_active":"2024-09-17T03:46:38.871997+0000","last_became_peered":"2024-09-17T03:46:38.871997+0000","last_unstale":"2024-09-17T03:46:38.881413+0000","last_undegraded":"2024-09-17T03:46:38.881413+0000","last_fullsized":"2024-09-17T03:46:38.881413+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:21.541289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.858485+0000","last_change":"2024-09-17T03:46:37.855038+0000","last_active":"2024-09-17T03:46:38.858485+0000","last_peered":"2024-09-17T03:46:38.858485+0000","last_clean":"2024-09-17T03:46:38.858485+0000","last_became_active":"2024-09-17T03:46:37.854645+0000","last_became_peered":"2024-09-17T03:46:37.854645+0000","last_unstale":"2024-09-17T03:46:38.858485+0000","last_undegraded":"2024-09-17T03:46:38.858485+0000","last_fullsized":"2024-09-17T03:46:38.858485+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:09.904657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.857199+0000","last_change":"2024-09-17T03:46:38.855559+0000","last_active":"2024-09-17T03:46:38.857199+0000","last_peered":"2024-09-17T03:46:38.857199+0000","last_clean":"2024-09-17T03:46:38.857199+0000","last_became_active":"2024-09-17T03:46:38.855179+0000","last_became_peered":"2024-09-17T03:46:38.855179+0000","last_unstale":"2024-09-17T03:46:38.857199+0000","last_undegraded":"2024-09-17T03:46:38.857199+0000","last_fullsized":"2024-09-17T03:46:38.857199+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:30.305040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.854811+0000","last_change":"2024-09-17T03:46:37.850967+0000","last_active":"2024-09-17T03:46:38.854811+0000","last_peered":"2024-09-17T03:46:38.854811+0000","last_clean":"2024-09-17T03:46:38.854811+0000","last_became_active":"2024-09-17T03:46:37.849133+0000","last_became_peered":"2024-09-17T03:46:37.849133+0000","last_unstale":"2024-09-17T03:46:38.854811+0000","last_undegraded":"2024-09-17T03:46:38.854811+0000","last_fullsized":"2024-09-17T03:46:38.854811+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:27.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.867364+0000","last_change":"2024-09-17T03:46:38.864300+0000","last_active":"2024-09-17T03:46:38.867364+0000","last_peered":"2024-09-17T03:46:38.867364+0000","last_clean":"2024-09-17T03:46:38.867364+0000","last_became_active":"2024-09-17T03:46:38.863911+0000","last_became_peered":"2024-09-17T03:46:38.863911+0000","last_unstale":"2024-09-17T03:46:38.867364+0000","last_undegraded":"2024-09-17T03:46:38.867364+0000","last_fullsized":"2024-09-17T03:46:38.867364+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:24.794528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.7","version":"198'2","reported_seq":15,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878231+0000","last_change":"2024-09-17T03:46:37.861906+0000","last_active":"2024-09-17T03:46:38.878231+0000","last_peered":"2024-09-17T03:46:38.878231+0000","last_clean":"2024-09-17T03:46:38.878231+0000","last_became_active":"2024-09-17T03:46:37.861585+0000","last_became_peered":"2024-09-17T03:46:37.861585+0000","last_unstale":"2024-09-17T03:46:38.878231+0000","last_undegraded":"2024-09-17T03:46:38.878231+0000","last_fullsized":"2024-09-17T03:46:38.878231+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:21.971121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.885637+0000","last_change":"2024-09-17T03:46:38.884951+0000","last_active":"2024-09-17T03:46:38.885637+0000","last_peered":"2024-09-17T03:46:38.885637+0000","last_clean":"2024-09-17T03:46:38.885637+0000","last_became_active":"2024-09-17T03:46:38.884466+0000","last_became_peered":"2024-09-17T03:46:38.884466+0000","last_unstale":"2024-09-17T03:46:38.885637+0000","last_undegraded":"2024-09-17T03:46:38.885637+0000","last_fullsized":"2024-09-17T03:46:38.885637+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:11.881066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842859+0000","last_change":"2024-09-17T03:46:36.842859+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842859+0000","last_undegraded":"2024-09-17T03:46:36.842859+0000","last_fullsized":"2024-09-17T03:46:36.842859+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.881353+0000","last_change":"2024-09-17T03:46:38.873157+0000","last_active":"2024-09-17T03:46:38.881353+0000","last_peered":"2024-09-17T03:46:38.881353+0000","last_clean":"2024-09-17T03:46:38.881353+0000","last_became_active":"2024-09-17T03:46:38.871901+0000","last_became_peered":"2024-09-17T03:46:38.871901+0000","last_unstale":"2024-09-17T03:46:38.881353+0000","last_undegraded":"2024-09-17T03:46:38.881353+0000","last_fullsized":"2024-09-17T03:46:38.881353+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:38.788056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.858748+0000","last_change":"2024-09-17T03:46:37.856607+0000","last_active":"2024-09-17T03:46:38.858748+0000","last_peered":"2024-09-17T03:46:38.858748+0000","last_clean":"2024-09-17T03:46:38.858748+0000","last_became_active":"2024-09-17T03:46:37.856210+0000","last_became_peered":"2024-09-17T03:46:37.856210+0000","last_unstale":"2024-09-17T03:46:38.858748+0000","last_undegraded":"2024-09-17T03:46:38.858748+0000","last_fullsized":"2024-09-17T03:46:38.858748+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.093398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873039+0000","last_change":"2024-09-17T03:46:38.858182+0000","last_active":"2024-09-17T03:46:38.873039+0000","last_peered":"2024-09-17T03:46:38.873039+0000","last_clean":"2024-09-17T03:46:38.873039+0000","last_became_active":"2024-09-17T03:46:38.857886+0000","last_became_peered":"2024-09-17T03:46:38.857886+0000","last_unstale":"2024-09-17T03:46:38.873039+0000","last_undegraded":"2024-09-17T03:46:38.873039+0000","last_fullsized":"2024-09-17T03:46:38.873039+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:35.037081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856707+0000","last_change":"2024-09-17T03:46:37.860656+0000","last_active":"2024-09-17T03:46:38.856707+0000","last_peered":"2024-09-17T03:46:38.856707+0000","last_clean":"2024-09-17T03:46:38.856707+0000","last_became_active":"2024-09-17T03:46:37.860363+0000","last_became_peered":"2024-09-17T03:46:37.860363+0000","last_unstale":"2024-09-17T03:46:38.856707+0000","last_undegraded":"2024-09-17T03:46:38.856707+0000","last_fullsized":"2024-09-17T03:46:38.856707+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:51.416909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871718+0000","last_change":"2024-09-17T03:46:38.869909+0000","last_active":"2024-09-17T03:46:38.871718+0000","last_peered":"2024-09-17T03:46:38.871718+0000","last_clean":"2024-09-17T03:46:38.871718+0000","last_became_active":"2024-09-17T03:46:38.869591+0000","last_became_peered":"2024-09-17T03:46:38.869591+0000","last_unstale":"2024-09-17T03:46:38.871718+0000","last_undegraded":"2024-09-17T03:46:38.871718+0000","last_fullsized":"2024-09-17T03:46:38.871718+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:11.881066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.859758+0000","last_change":"2024-09-17T03:46:37.858101+0000","last_active":"2024-09-17T03:46:38.859758+0000","last_peered":"2024-09-17T03:46:38.859758+0000","last_clean":"2024-09-17T03:46:38.859758+0000","last_became_active":"2024-09-17T03:46:37.857577+0000","last_became_peered":"2024-09-17T03:46:37.857577+0000","last_unstale":"2024-09-17T03:46:38.859758+0000","last_undegraded":"2024-09-17T03:46:38.859758+0000","last_fullsized":"2024-09-17T03:46:38.859758+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:58.497943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868076+0000","last_change":"2024-09-17T03:46:38.861305+0000","last_active":"2024-09-17T03:46:38.868076+0000","last_peered":"2024-09-17T03:46:38.868076+0000","last_clean":"2024-09-17T03:46:38.868076+0000","last_became_active":"2024-09-17T03:46:38.860980+0000","last_became_peered":"2024-09-17T03:46:38.860980+0000","last_unstale":"2024-09-17T03:46:38.868076+0000","last_undegraded":"2024-09-17T03:46:38.868076+0000","last_fullsized":"2024-09-17T03:46:38.868076+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:47.778627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.850086+0000","last_change":"2024-09-17T03:46:37.861053+0000","last_active":"2024-09-17T03:46:38.850086+0000","last_peered":"2024-09-17T03:46:38.850086+0000","last_clean":"2024-09-17T03:46:38.850086+0000","last_became_active":"2024-09-17T03:46:37.860753+0000","last_became_peered":"2024-09-17T03:46:37.860753+0000","last_unstale":"2024-09-17T03:46:38.850086+0000","last_undegraded":"2024-09-17T03:46:38.850086+0000","last_fullsized":"2024-09-17T03:46:38.850086+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:48.523839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871032+0000","last_change":"2024-09-17T03:46:38.865353+0000","last_active":"2024-09-17T03:46:38.871032+0000","last_peered":"2024-09-17T03:46:38.871032+0000","last_clean":"2024-09-17T03:46:38.871032+0000","last_became_active":"2024-09-17T03:46:38.864736+0000","last_became_peered":"2024-09-17T03:46:38.864736+0000","last_unstale":"2024-09-17T03:46:38.871032+0000","last_undegraded":"2024-09-17T03:46:38.871032+0000","last_fullsized":"2024-09-17T03:46:38.871032+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:08.952464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.840913+0000","last_change":"2024-09-17T03:46:36.840913+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.840913+0000","last_undegraded":"2024-09-17T03:46:36.840913+0000","last_fullsized":"2024-09-17T03:46:36.840913+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884678+0000","last_change":"2024-09-17T03:46:38.882784+0000","last_active":"2024-09-17T03:46:38.884678+0000","last_peered":"2024-09-17T03:46:38.884678+0000","last_clean":"2024-09-17T03:46:38.884678+0000","last_became_active":"2024-09-17T03:46:38.882232+0000","last_became_peered":"2024-09-17T03:46:38.882232+0000","last_unstale":"2024-09-17T03:46:38.884678+0000","last_undegraded":"2024-09-17T03:46:38.884678+0000","last_fullsized":"2024-09-17T03:46:38.884678+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:27.696745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.840592+0000","last_change":"2024-09-17T03:46:36.840592+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.840592+0000","last_undegraded":"2024-09-17T03:46:36.840592+0000","last_fullsized":"2024-09-17T03:46:36.840592+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841813+0000","last_change":"2024-09-17T03:46:36.841813+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841813+0000","last_undegraded":"2024-09-17T03:46:36.841813+0000","last_fullsized":"2024-09-17T03:46:36.841813+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":436,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856745+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:46:38.856745+0000","last_peered":"2024-09-17T03:46:38.856745+0000","last_clean":"2024-09-17T03:46:38.856745+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:46:38.856745+0000","last_undegraded":"2024-09-17T03:46:38.856745+0000","last_fullsized":"2024-09-17T03:46:38.856745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":6},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509610,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60588,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311252,"statfs":{"total":96636764160,"available":96574722048,"internally_reserved":0,"allocated":3096576,"data_stored":1689513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509610,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60012,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311828,"statfs":{"total":96636764160,"available":96575311872,"internally_reserved":0,"allocated":2506752,"data_stored":1099679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509610,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65524,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306316,"statfs":{"total":96636764160,"available":96569667584,"internally_reserved":0,"allocated":2519040,"data_stored":1100779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509610,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55844,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315996,"statfs":{"total":96636764160,"available":96579579904,"internally_reserved":0,"allocated":2502656,"data_stored":1099165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509611,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59992,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311848,"statfs":{"total":96636764160,"available":96575332352,"internally_reserved":0,"allocated":2486272,"data_stored":1092300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509611,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56428,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315412,"statfs":{"total":96636764160,"available":96578981888,"internally_reserved":0,"allocated":3096576,"data_stored":1689477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575017,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55820,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316020,"statfs":{"total":96636764160,"available":96579604480,"internally_reserved":0,"allocated":2473984,"data_stored":1086025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575017,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59980,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311860,"statfs":{"total":96636764160,"available":96575344640,"internally_reserved":0,"allocated":2473984,"data_stored":1086025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:46:42.917 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:46:43.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.067+0000 7fe6e792b640 1 -- 172.21.15.146:0/2055392984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6c8003a00 msgr2=0x7fe6c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.067+0000 7fe6e792b640 1 --2- 172.21.15.146:0/2055392984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6c8003a00 0x7fe6c8003e70 secure :-1 s=READY pgs=2565 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000c760 tx=0x7fe6c8005830 comp rx=0 tx=0).stop 2024-09-17T03:46:43.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.067+0000 7fe6e5ec8640 1 -- 172.21.15.146:0/2055392984 reap_dead start 2024-09-17T03:46:43.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.067+0000 7fe6e792b640 1 -- 172.21.15.146:0/2055392984 shutdown_connections 2024-09-17T03:46:43.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.067+0000 7fe6e792b640 1 -- 172.21.15.146:0/2055392984 >> 172.21.15.146:0/2055392984 conn(0x7fe6e00b2790 msgr2=0x7fe6e00d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:43.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.067+0000 7fe6e792b640 1 -- 172.21.15.146:0/2055392984 shutdown_connections 2024-09-17T03:46:43.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.067+0000 7fe6e792b640 1 -- 172.21.15.146:0/2055392984 wait complete. 2024-09-17T03:46:43.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.069+0000 7fe6e792b640 1 Processor -- start 2024-09-17T03:46:43.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.069+0000 7fe6e792b640 1 -- start start 2024-09-17T03:46:43.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.070+0000 7fe6e792b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6c8003a00 0x7fe6e0147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.070+0000 7fe6e792b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e00aebf0 0x7fe6e00af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.070+0000 7fe6e792b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e00cef90 0x7fe6e00cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.070+0000 7fe6e792b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e00ce9f0 con 0x7fe6e00aebf0 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.070+0000 7fe6e792b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e0070860 con 0x7fe6c8003a00 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.070+0000 7fe6e792b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e00ceb70 con 0x7fe6e00cef90 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.070+0000 7fe6e4ec6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e00aebf0 0x7fe6e00af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.070+0000 7fe6e4ec6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e00aebf0 0x7fe6e00af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38728/0 (socket says 172.21.15.146:38728) 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.070+0000 7fe6e4ec6640 1 -- 172.21.15.146:0/1387091491 learned_addr learned my addr 172.21.15.146:0/1387091491 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6e56c7640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6c8003a00 0x7fe6e0147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6e5ec8640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e00cef90 0x7fe6e00cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6e4ec6640 1 -- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e00cef90 msgr2=0x7fe6e00cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6e4ec6640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e00cef90 0x7fe6e00cf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6e4ec6640 1 -- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6c8003a00 msgr2=0x7fe6e0147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6e4ec6640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6c8003a00 0x7fe6e0147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6e4ec6640 1 -- 172.21.15.146:0/1387091491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e00cf8e0 con 0x7fe6e00aebf0 2024-09-17T03:46:43.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6e56c7640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6c8003a00 0x7fe6e0147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:43.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6e4ec6640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e00aebf0 0x7fe6e00af000 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4011830 tx=0x7fe6d4011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:43.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6ddffb640 1 -- 172.21.15.146:0/1387091491 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4004460 con 0x7fe6e00aebf0 2024-09-17T03:46:43.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6ddffb640 1 -- 172.21.15.146:0/1387091491 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6d4016070 con 0x7fe6e00aebf0 2024-09-17T03:46:43.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6e792b640 1 -- 172.21.15.146:0/1387091491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e00ad7e0 con 0x7fe6e00aebf0 2024-09-17T03:46:43.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6ddffb640 1 -- 172.21.15.146:0/1387091491 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400fb80 con 0x7fe6e00aebf0 2024-09-17T03:46:43.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.071+0000 7fe6e792b640 1 -- 172.21.15.146:0/1387091491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e00adda0 con 0x7fe6e00aebf0 2024-09-17T03:46:43.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.072+0000 7fe6e792b640 1 -- 172.21.15.146:0/1387091491 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e015ec00 con 0x7fe6e00aebf0 2024-09-17T03:46:43.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.073+0000 7fe6ddffb640 1 -- 172.21.15.146:0/1387091491 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe6d4018030 con 0x7fe6e00aebf0 2024-09-17T03:46:43.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.074+0000 7fe6ddffb640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6cc078b90 0x7fe6cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.074+0000 7fe6ddffb640 1 -- 172.21.15.146:0/1387091491 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7fe6d409b560 con 0x7fe6e00aebf0 2024-09-17T03:46:43.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.074+0000 7fe6e56c7640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6cc078b90 0x7fe6cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.074+0000 7fe6e56c7640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6cc078b90 0x7fe6cc07b0a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0033000 tx=0x7fe6d0037040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:43.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.078+0000 7fe6ddffb640 1 -- 172.21.15.146:0/1387091491 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe6e00cf8e0 con 0x7fe6e00aebf0 2024-09-17T03:46:43.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.247+0000 7fe6e792b640 1 -- 172.21.15.146:0/1387091491 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6e00ad570 con 0x7fe6cc078b90 2024-09-17T03:46:43.251 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.252+0000 7fe6ddffb640 1 -- 172.21.15.146:0/1387091491 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249912 (secure 0 0 0) 0x7fe6d0081050 con 0x7fe6cc078b90 2024-09-17T03:46:43.253 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:43.254 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:46:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 -- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6cc078b90 msgr2=0x7fe6cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6cc078b90 0x7fe6cc07b0a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0033000 tx=0x7fe6d0037040 comp rx=0 tx=0).stop 2024-09-17T03:46:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 -- 172.21.15.146:0/1387091491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e00aebf0 msgr2=0x7fe6e00af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e00aebf0 0x7fe6e00af000 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4011830 tx=0x7fe6d4011cf0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 -- 172.21.15.146:0/1387091491 shutdown_connections 2024-09-17T03:46:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe6cc078b90 0x7fe6cc07b0a0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe6e00cef90 0x7fe6e00cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.256 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e00aebf0 0x7fe6e00af000 unknown :-1 s=CLOSED pgs=2566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 --2- 172.21.15.146:0/1387091491 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe6c8003a00 0x7fe6e0147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 -- 172.21.15.146:0/1387091491 >> 172.21.15.146:0/1387091491 conn(0x7fe6e00b2790 msgr2=0x7fe6e00b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:43.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 -- 172.21.15.146:0/1387091491 shutdown_connections 2024-09-17T03:46:43.257 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.255+0000 7fe6e792b640 1 -- 172.21.15.146:0/1387091491 wait complete. 2024-09-17T03:46:43.266 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":610,"stamp":"2024-09-17T03:46:42.010897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":131,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474188,"kb_used_data":20660,"kb_used_omap":12,"kb_used_meta":453299,"kb_avail":754500532,"statfs":{"total":773094113280,"available":772608544768,"internally_reserved":0,"allocated":21155840,"data_stored":9942963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":464178737},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.175042"},"pg_stats":[{"pgid":"31.3f","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873864+0000","last_change":"2024-09-17T03:46:38.871668+0000","last_active":"2024-09-17T03:46:38.873864+0000","last_peered":"2024-09-17T03:46:38.873864+0000","last_clean":"2024-09-17T03:46:38.873864+0000","last_became_active":"2024-09-17T03:46:38.871334+0000","last_became_peered":"2024-09-17T03:46:38.871334+0000","last_unstale":"2024-09-17T03:46:38.873864+0000","last_undegraded":"2024-09-17T03:46:38.873864+0000","last_fullsized":"2024-09-17T03:46:38.873864+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:33.859485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884639+0000","last_change":"2024-09-17T03:46:38.879231+0000","last_active":"2024-09-17T03:46:38.884639+0000","last_peered":"2024-09-17T03:46:38.884639+0000","last_clean":"2024-09-17T03:46:38.884639+0000","last_became_active":"2024-09-17T03:46:38.878901+0000","last_became_peered":"2024-09-17T03:46:38.878901+0000","last_unstale":"2024-09-17T03:46:38.884639+0000","last_undegraded":"2024-09-17T03:46:38.884639+0000","last_fullsized":"2024-09-17T03:46:38.884639+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:40.395914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868060+0000","last_change":"2024-09-17T03:46:38.866452+0000","last_active":"2024-09-17T03:46:38.868060+0000","last_peered":"2024-09-17T03:46:38.868060+0000","last_clean":"2024-09-17T03:46:38.868060+0000","last_became_active":"2024-09-17T03:46:38.866088+0000","last_became_peered":"2024-09-17T03:46:38.866088+0000","last_unstale":"2024-09-17T03:46:38.868060+0000","last_undegraded":"2024-09-17T03:46:38.868060+0000","last_fullsized":"2024-09-17T03:46:38.868060+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:50.828365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.864979+0000","last_change":"2024-09-17T03:46:38.862117+0000","last_active":"2024-09-17T03:46:38.864979+0000","last_peered":"2024-09-17T03:46:38.864979+0000","last_clean":"2024-09-17T03:46:38.864979+0000","last_became_active":"2024-09-17T03:46:38.861759+0000","last_became_peered":"2024-09-17T03:46:38.861759+0000","last_unstale":"2024-09-17T03:46:38.864979+0000","last_undegraded":"2024-09-17T03:46:38.864979+0000","last_fullsized":"2024-09-17T03:46:38.864979+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:03.120246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879159+0000","last_change":"2024-09-17T03:46:38.877127+0000","last_active":"2024-09-17T03:46:38.879159+0000","last_peered":"2024-09-17T03:46:38.879159+0000","last_clean":"2024-09-17T03:46:38.879159+0000","last_became_active":"2024-09-17T03:46:38.876807+0000","last_became_peered":"2024-09-17T03:46:38.876807+0000","last_unstale":"2024-09-17T03:46:38.879159+0000","last_undegraded":"2024-09-17T03:46:38.879159+0000","last_fullsized":"2024-09-17T03:46:38.879159+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:36.353553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872714+0000","last_change":"2024-09-17T03:46:38.866116+0000","last_active":"2024-09-17T03:46:38.872714+0000","last_peered":"2024-09-17T03:46:38.872714+0000","last_clean":"2024-09-17T03:46:38.872714+0000","last_became_active":"2024-09-17T03:46:38.865806+0000","last_became_peered":"2024-09-17T03:46:38.865806+0000","last_unstale":"2024-09-17T03:46:38.872714+0000","last_undegraded":"2024-09-17T03:46:38.872714+0000","last_fullsized":"2024-09-17T03:46:38.872714+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:59.762164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878063+0000","last_change":"2024-09-17T03:46:38.876509+0000","last_active":"2024-09-17T03:46:38.878063+0000","last_peered":"2024-09-17T03:46:38.878063+0000","last_clean":"2024-09-17T03:46:38.878063+0000","last_became_active":"2024-09-17T03:46:38.876170+0000","last_became_peered":"2024-09-17T03:46:38.876170+0000","last_unstale":"2024-09-17T03:46:38.878063+0000","last_undegraded":"2024-09-17T03:46:38.878063+0000","last_fullsized":"2024-09-17T03:46:38.878063+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:07.118394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871684+0000","last_change":"2024-09-17T03:46:38.869498+0000","last_active":"2024-09-17T03:46:38.871684+0000","last_peered":"2024-09-17T03:46:38.871684+0000","last_clean":"2024-09-17T03:46:38.871684+0000","last_became_active":"2024-09-17T03:46:38.869166+0000","last_became_peered":"2024-09-17T03:46:38.869166+0000","last_unstale":"2024-09-17T03:46:38.871684+0000","last_undegraded":"2024-09-17T03:46:38.871684+0000","last_fullsized":"2024-09-17T03:46:38.871684+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.132290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883071+0000","last_change":"2024-09-17T03:46:38.874775+0000","last_active":"2024-09-17T03:46:38.883071+0000","last_peered":"2024-09-17T03:46:38.883071+0000","last_clean":"2024-09-17T03:46:38.883071+0000","last_became_active":"2024-09-17T03:46:38.874487+0000","last_became_peered":"2024-09-17T03:46:38.874487+0000","last_unstale":"2024-09-17T03:46:38.883071+0000","last_undegraded":"2024-09-17T03:46:38.883071+0000","last_fullsized":"2024-09-17T03:46:38.883071+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:41.649494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871053+0000","last_change":"2024-09-17T03:46:38.864701+0000","last_active":"2024-09-17T03:46:38.871053+0000","last_peered":"2024-09-17T03:46:38.871053+0000","last_clean":"2024-09-17T03:46:38.871053+0000","last_became_active":"2024-09-17T03:46:38.864315+0000","last_became_peered":"2024-09-17T03:46:38.864315+0000","last_unstale":"2024-09-17T03:46:38.871053+0000","last_undegraded":"2024-09-17T03:46:38.871053+0000","last_fullsized":"2024-09-17T03:46:38.871053+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:23.297852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879231+0000","last_change":"2024-09-17T03:46:38.877166+0000","last_active":"2024-09-17T03:46:38.879231+0000","last_peered":"2024-09-17T03:46:38.879231+0000","last_clean":"2024-09-17T03:46:38.879231+0000","last_became_active":"2024-09-17T03:46:38.876853+0000","last_became_peered":"2024-09-17T03:46:38.876853+0000","last_unstale":"2024-09-17T03:46:38.879231+0000","last_undegraded":"2024-09-17T03:46:38.879231+0000","last_fullsized":"2024-09-17T03:46:38.879231+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:22.583146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873963+0000","last_change":"2024-09-17T03:46:38.871599+0000","last_active":"2024-09-17T03:46:38.873963+0000","last_peered":"2024-09-17T03:46:38.873963+0000","last_clean":"2024-09-17T03:46:38.873963+0000","last_became_active":"2024-09-17T03:46:38.871279+0000","last_became_peered":"2024-09-17T03:46:38.871279+0000","last_unstale":"2024-09-17T03:46:38.873963+0000","last_undegraded":"2024-09-17T03:46:38.873963+0000","last_fullsized":"2024-09-17T03:46:38.873963+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:39.019606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878350+0000","last_change":"2024-09-17T03:46:38.877390+0000","last_active":"2024-09-17T03:46:38.878350+0000","last_peered":"2024-09-17T03:46:38.878350+0000","last_clean":"2024-09-17T03:46:38.878350+0000","last_became_active":"2024-09-17T03:46:38.877043+0000","last_became_peered":"2024-09-17T03:46:38.877043+0000","last_unstale":"2024-09-17T03:46:38.878350+0000","last_undegraded":"2024-09-17T03:46:38.878350+0000","last_fullsized":"2024-09-17T03:46:38.878350+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:52.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856633+0000","last_change":"2024-09-17T03:46:38.855444+0000","last_active":"2024-09-17T03:46:38.856633+0000","last_peered":"2024-09-17T03:46:38.856633+0000","last_clean":"2024-09-17T03:46:38.856633+0000","last_became_active":"2024-09-17T03:46:38.855104+0000","last_became_peered":"2024-09-17T03:46:38.855104+0000","last_unstale":"2024-09-17T03:46:38.856633+0000","last_undegraded":"2024-09-17T03:46:38.856633+0000","last_fullsized":"2024-09-17T03:46:38.856633+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:45.332349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871069+0000","last_change":"2024-09-17T03:46:38.869122+0000","last_active":"2024-09-17T03:46:38.871069+0000","last_peered":"2024-09-17T03:46:38.871069+0000","last_clean":"2024-09-17T03:46:38.871069+0000","last_became_active":"2024-09-17T03:46:38.868818+0000","last_became_peered":"2024-09-17T03:46:38.868818+0000","last_unstale":"2024-09-17T03:46:38.871069+0000","last_undegraded":"2024-09-17T03:46:38.871069+0000","last_fullsized":"2024-09-17T03:46:38.871069+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:47.484288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874564+0000","last_change":"2024-09-17T03:46:38.873994+0000","last_active":"2024-09-17T03:46:38.874564+0000","last_peered":"2024-09-17T03:46:38.874564+0000","last_clean":"2024-09-17T03:46:38.874564+0000","last_became_active":"2024-09-17T03:46:38.873589+0000","last_became_peered":"2024-09-17T03:46:38.873589+0000","last_unstale":"2024-09-17T03:46:38.874564+0000","last_undegraded":"2024-09-17T03:46:38.874564+0000","last_fullsized":"2024-09-17T03:46:38.874564+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:12.986513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872593+0000","last_change":"2024-09-17T03:46:38.869135+0000","last_active":"2024-09-17T03:46:38.872593+0000","last_peered":"2024-09-17T03:46:38.872593+0000","last_clean":"2024-09-17T03:46:38.872593+0000","last_became_active":"2024-09-17T03:46:38.868524+0000","last_became_peered":"2024-09-17T03:46:38.868524+0000","last_unstale":"2024-09-17T03:46:38.872593+0000","last_undegraded":"2024-09-17T03:46:38.872593+0000","last_fullsized":"2024-09-17T03:46:38.872593+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:39.027714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872689+0000","last_change":"2024-09-17T03:46:38.871659+0000","last_active":"2024-09-17T03:46:38.872689+0000","last_peered":"2024-09-17T03:46:38.872689+0000","last_clean":"2024-09-17T03:46:38.872689+0000","last_became_active":"2024-09-17T03:46:38.871304+0000","last_became_peered":"2024-09-17T03:46:38.871304+0000","last_unstale":"2024-09-17T03:46:38.872689+0000","last_undegraded":"2024-09-17T03:46:38.872689+0000","last_fullsized":"2024-09-17T03:46:38.872689+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:42.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868055+0000","last_change":"2024-09-17T03:46:38.862294+0000","last_active":"2024-09-17T03:46:38.868055+0000","last_peered":"2024-09-17T03:46:38.868055+0000","last_clean":"2024-09-17T03:46:38.868055+0000","last_became_active":"2024-09-17T03:46:38.861912+0000","last_became_peered":"2024-09-17T03:46:38.861912+0000","last_unstale":"2024-09-17T03:46:38.868055+0000","last_undegraded":"2024-09-17T03:46:38.868055+0000","last_fullsized":"2024-09-17T03:46:38.868055+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:45.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883740+0000","last_change":"2024-09-17T03:46:38.876742+0000","last_active":"2024-09-17T03:46:38.883740+0000","last_peered":"2024-09-17T03:46:38.883740+0000","last_clean":"2024-09-17T03:46:38.883740+0000","last_became_active":"2024-09-17T03:46:38.876441+0000","last_became_peered":"2024-09-17T03:46:38.876441+0000","last_unstale":"2024-09-17T03:46:38.883740+0000","last_undegraded":"2024-09-17T03:46:38.883740+0000","last_fullsized":"2024-09-17T03:46:38.883740+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:24.794528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.864971+0000","last_change":"2024-09-17T03:46:38.862445+0000","last_active":"2024-09-17T03:46:38.864971+0000","last_peered":"2024-09-17T03:46:38.864971+0000","last_clean":"2024-09-17T03:46:38.864971+0000","last_became_active":"2024-09-17T03:46:38.861998+0000","last_became_peered":"2024-09-17T03:46:38.861998+0000","last_unstale":"2024-09-17T03:46:38.864971+0000","last_undegraded":"2024-09-17T03:46:38.864971+0000","last_fullsized":"2024-09-17T03:46:38.864971+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:55.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879214+0000","last_change":"2024-09-17T03:46:38.877664+0000","last_active":"2024-09-17T03:46:38.879214+0000","last_peered":"2024-09-17T03:46:38.879214+0000","last_clean":"2024-09-17T03:46:38.879214+0000","last_became_active":"2024-09-17T03:46:38.877375+0000","last_became_peered":"2024-09-17T03:46:38.877375+0000","last_unstale":"2024-09-17T03:46:38.879214+0000","last_undegraded":"2024-09-17T03:46:38.879214+0000","last_fullsized":"2024-09-17T03:46:38.879214+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:17.248059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.882971+0000","last_change":"2024-09-17T03:46:38.874450+0000","last_active":"2024-09-17T03:46:38.882971+0000","last_peered":"2024-09-17T03:46:38.882971+0000","last_clean":"2024-09-17T03:46:38.882971+0000","last_became_active":"2024-09-17T03:46:38.873914+0000","last_became_peered":"2024-09-17T03:46:38.873914+0000","last_unstale":"2024-09-17T03:46:38.882971+0000","last_undegraded":"2024-09-17T03:46:38.882971+0000","last_fullsized":"2024-09-17T03:46:38.882971+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:18.270227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.885019+0000","last_change":"2024-09-17T03:46:38.880123+0000","last_active":"2024-09-17T03:46:38.885019+0000","last_peered":"2024-09-17T03:46:38.885019+0000","last_clean":"2024-09-17T03:46:38.885019+0000","last_became_active":"2024-09-17T03:46:38.879828+0000","last_became_peered":"2024-09-17T03:46:38.879828+0000","last_unstale":"2024-09-17T03:46:38.885019+0000","last_undegraded":"2024-09-17T03:46:38.885019+0000","last_fullsized":"2024-09-17T03:46:38.885019+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.132290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872413+0000","last_change":"2024-09-17T03:46:38.864173+0000","last_active":"2024-09-17T03:46:38.872413+0000","last_peered":"2024-09-17T03:46:38.872413+0000","last_clean":"2024-09-17T03:46:38.872413+0000","last_became_active":"2024-09-17T03:46:38.863861+0000","last_became_peered":"2024-09-17T03:46:38.863861+0000","last_unstale":"2024-09-17T03:46:38.872413+0000","last_undegraded":"2024-09-17T03:46:38.872413+0000","last_fullsized":"2024-09-17T03:46:38.872413+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:14.514064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.877166+0000","last_change":"2024-09-17T03:46:38.875927+0000","last_active":"2024-09-17T03:46:38.877166+0000","last_peered":"2024-09-17T03:46:38.877166+0000","last_clean":"2024-09-17T03:46:38.877166+0000","last_became_active":"2024-09-17T03:46:38.875618+0000","last_became_peered":"2024-09-17T03:46:38.875618+0000","last_unstale":"2024-09-17T03:46:38.877166+0000","last_undegraded":"2024-09-17T03:46:38.877166+0000","last_fullsized":"2024-09-17T03:46:38.877166+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:08.073928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873903+0000","last_change":"2024-09-17T03:46:38.870813+0000","last_active":"2024-09-17T03:46:38.873903+0000","last_peered":"2024-09-17T03:46:38.873903+0000","last_clean":"2024-09-17T03:46:38.873903+0000","last_became_active":"2024-09-17T03:46:38.870493+0000","last_became_peered":"2024-09-17T03:46:38.870493+0000","last_unstale":"2024-09-17T03:46:38.873903+0000","last_undegraded":"2024-09-17T03:46:38.873903+0000","last_fullsized":"2024-09-17T03:46:38.873903+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:28.445042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1e","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878982+0000","last_change":"2024-09-17T03:46:37.849807+0000","last_active":"2024-09-17T03:46:38.878982+0000","last_peered":"2024-09-17T03:46:38.878982+0000","last_clean":"2024-09-17T03:46:38.878982+0000","last_became_active":"2024-09-17T03:46:37.849384+0000","last_became_peered":"2024-09-17T03:46:37.849384+0000","last_unstale":"2024-09-17T03:46:38.878982+0000","last_undegraded":"2024-09-17T03:46:38.878982+0000","last_fullsized":"2024-09-17T03:46:38.878982+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:56.687816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872914+0000","last_change":"2024-09-17T03:46:38.864532+0000","last_active":"2024-09-17T03:46:38.872914+0000","last_peered":"2024-09-17T03:46:38.872914+0000","last_clean":"2024-09-17T03:46:38.872914+0000","last_became_active":"2024-09-17T03:46:38.864221+0000","last_became_peered":"2024-09-17T03:46:38.864221+0000","last_unstale":"2024-09-17T03:46:38.872914+0000","last_undegraded":"2024-09-17T03:46:38.872914+0000","last_fullsized":"2024-09-17T03:46:38.872914+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.402855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841827+0000","last_change":"2024-09-17T03:46:36.841827+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841827+0000","last_undegraded":"2024-09-17T03:46:36.841827+0000","last_fullsized":"2024-09-17T03:46:36.841827+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.859231+0000","last_change":"2024-09-17T03:46:38.857502+0000","last_active":"2024-09-17T03:46:38.859231+0000","last_peered":"2024-09-17T03:46:38.859231+0000","last_clean":"2024-09-17T03:46:38.859231+0000","last_became_active":"2024-09-17T03:46:38.857193+0000","last_became_peered":"2024-09-17T03:46:38.857193+0000","last_unstale":"2024-09-17T03:46:38.859231+0000","last_undegraded":"2024-09-17T03:46:38.859231+0000","last_fullsized":"2024-09-17T03:46:38.859231+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:57.596324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.843011+0000","last_change":"2024-09-17T03:46:36.843011+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.843011+0000","last_undegraded":"2024-09-17T03:46:36.843011+0000","last_fullsized":"2024-09-17T03:46:36.843011+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872348+0000","last_change":"2024-09-17T03:46:38.863432+0000","last_active":"2024-09-17T03:46:38.872348+0000","last_peered":"2024-09-17T03:46:38.872348+0000","last_clean":"2024-09-17T03:46:38.872348+0000","last_became_active":"2024-09-17T03:46:38.863073+0000","last_became_peered":"2024-09-17T03:46:38.863073+0000","last_unstale":"2024-09-17T03:46:38.872348+0000","last_undegraded":"2024-09-17T03:46:38.872348+0000","last_fullsized":"2024-09-17T03:46:38.872348+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:38.721703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1b","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874483+0000","last_change":"2024-09-17T03:46:37.857697+0000","last_active":"2024-09-17T03:46:38.874483+0000","last_peered":"2024-09-17T03:46:38.874483+0000","last_clean":"2024-09-17T03:46:38.874483+0000","last_became_active":"2024-09-17T03:46:37.857396+0000","last_became_peered":"2024-09-17T03:46:37.857396+0000","last_unstale":"2024-09-17T03:46:38.874483+0000","last_undegraded":"2024-09-17T03:46:38.874483+0000","last_fullsized":"2024-09-17T03:46:38.874483+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:47.376600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878548+0000","last_change":"2024-09-17T03:46:38.877940+0000","last_active":"2024-09-17T03:46:38.878548+0000","last_peered":"2024-09-17T03:46:38.878548+0000","last_clean":"2024-09-17T03:46:38.878548+0000","last_became_active":"2024-09-17T03:46:38.877521+0000","last_became_peered":"2024-09-17T03:46:38.877521+0000","last_unstale":"2024-09-17T03:46:38.878548+0000","last_undegraded":"2024-09-17T03:46:38.878548+0000","last_fullsized":"2024-09-17T03:46:38.878548+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:35.037081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884389+0000","last_change":"2024-09-17T03:46:37.853555+0000","last_active":"2024-09-17T03:46:38.884389+0000","last_peered":"2024-09-17T03:46:38.884389+0000","last_clean":"2024-09-17T03:46:38.884389+0000","last_became_active":"2024-09-17T03:46:37.853225+0000","last_became_peered":"2024-09-17T03:46:37.853225+0000","last_unstale":"2024-09-17T03:46:38.884389+0000","last_undegraded":"2024-09-17T03:46:38.884389+0000","last_fullsized":"2024-09-17T03:46:38.884389+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:52.469536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856579+0000","last_change":"2024-09-17T03:46:37.856566+0000","last_active":"2024-09-17T03:46:38.856579+0000","last_peered":"2024-09-17T03:46:38.856579+0000","last_clean":"2024-09-17T03:46:38.856579+0000","last_became_active":"2024-09-17T03:46:37.856251+0000","last_became_peered":"2024-09-17T03:46:37.856251+0000","last_unstale":"2024-09-17T03:46:38.856579+0000","last_undegraded":"2024-09-17T03:46:38.856579+0000","last_fullsized":"2024-09-17T03:46:38.856579+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:11.674372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.875351+0000","last_change":"2024-09-17T03:46:38.874486+0000","last_active":"2024-09-17T03:46:38.875351+0000","last_peered":"2024-09-17T03:46:38.875351+0000","last_clean":"2024-09-17T03:46:38.875351+0000","last_became_active":"2024-09-17T03:46:38.874172+0000","last_became_peered":"2024-09-17T03:46:38.874172+0000","last_unstale":"2024-09-17T03:46:38.875351+0000","last_undegraded":"2024-09-17T03:46:38.875351+0000","last_fullsized":"2024-09-17T03:46:38.875351+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:57.693671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841994+0000","last_change":"2024-09-17T03:46:36.841994+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841994+0000","last_undegraded":"2024-09-17T03:46:36.841994+0000","last_fullsized":"2024-09-17T03:46:36.841994+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883287+0000","last_change":"2024-09-17T03:46:38.875932+0000","last_active":"2024-09-17T03:46:38.883287+0000","last_peered":"2024-09-17T03:46:38.883287+0000","last_clean":"2024-09-17T03:46:38.883287+0000","last_became_active":"2024-09-17T03:46:38.875606+0000","last_became_peered":"2024-09-17T03:46:38.875606+0000","last_unstale":"2024-09-17T03:46:38.883287+0000","last_undegraded":"2024-09-17T03:46:38.883287+0000","last_fullsized":"2024-09-17T03:46:38.883287+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:59.503799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.853027+0000","last_change":"2024-09-17T03:46:37.859345+0000","last_active":"2024-09-17T03:46:38.853027+0000","last_peered":"2024-09-17T03:46:38.853027+0000","last_clean":"2024-09-17T03:46:38.853027+0000","last_became_active":"2024-09-17T03:46:37.859006+0000","last_became_peered":"2024-09-17T03:46:37.859006+0000","last_unstale":"2024-09-17T03:46:38.853027+0000","last_undegraded":"2024-09-17T03:46:38.853027+0000","last_fullsized":"2024-09-17T03:46:38.853027+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:10.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874637+0000","last_change":"2024-09-17T03:46:38.871889+0000","last_active":"2024-09-17T03:46:38.874637+0000","last_peered":"2024-09-17T03:46:38.874637+0000","last_clean":"2024-09-17T03:46:38.874637+0000","last_became_active":"2024-09-17T03:46:38.871405+0000","last_became_peered":"2024-09-17T03:46:38.871405+0000","last_unstale":"2024-09-17T03:46:38.874637+0000","last_undegraded":"2024-09-17T03:46:38.874637+0000","last_fullsized":"2024-09-17T03:46:38.874637+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:11.581943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842752+0000","last_change":"2024-09-17T03:46:36.842752+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842752+0000","last_undegraded":"2024-09-17T03:46:36.842752+0000","last_fullsized":"2024-09-17T03:46:36.842752+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.15","version":"198'3","reported_seq":16,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884805+0000","last_change":"2024-09-17T03:46:37.857029+0000","last_active":"2024-09-17T03:46:38.884805+0000","last_peered":"2024-09-17T03:46:38.884805+0000","last_clean":"2024-09-17T03:46:38.884805+0000","last_became_active":"2024-09-17T03:46:37.856738+0000","last_became_peered":"2024-09-17T03:46:37.856738+0000","last_unstale":"2024-09-17T03:46:38.884805+0000","last_undegraded":"2024-09-17T03:46:38.884805+0000","last_fullsized":"2024-09-17T03:46:38.884805+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:01.595359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872102+0000","last_change":"2024-09-17T03:46:38.867964+0000","last_active":"2024-09-17T03:46:38.872102+0000","last_peered":"2024-09-17T03:46:38.872102+0000","last_clean":"2024-09-17T03:46:38.872102+0000","last_became_active":"2024-09-17T03:46:38.867541+0000","last_became_peered":"2024-09-17T03:46:38.867541+0000","last_unstale":"2024-09-17T03:46:38.872102+0000","last_undegraded":"2024-09-17T03:46:38.872102+0000","last_fullsized":"2024-09-17T03:46:38.872102+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:40.395914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.14","version":"198'6","reported_seq":19,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.886872+0000","last_change":"2024-09-17T03:46:37.861154+0000","last_active":"2024-09-17T03:46:38.886872+0000","last_peered":"2024-09-17T03:46:38.886872+0000","last_clean":"2024-09-17T03:46:38.886872+0000","last_became_active":"2024-09-17T03:46:37.860819+0000","last_became_peered":"2024-09-17T03:46:37.860819+0000","last_unstale":"2024-09-17T03:46:38.886872+0000","last_undegraded":"2024-09-17T03:46:38.886872+0000","last_fullsized":"2024-09-17T03:46:38.886872+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:33.736709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871744+0000","last_change":"2024-09-17T03:46:38.869534+0000","last_active":"2024-09-17T03:46:38.871744+0000","last_peered":"2024-09-17T03:46:38.871744+0000","last_clean":"2024-09-17T03:46:38.871744+0000","last_became_active":"2024-09-17T03:46:38.869205+0000","last_became_peered":"2024-09-17T03:46:38.869205+0000","last_unstale":"2024-09-17T03:46:38.871744+0000","last_undegraded":"2024-09-17T03:46:38.871744+0000","last_fullsized":"2024-09-17T03:46:38.871744+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:27.696745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.13","version":"198'2","reported_seq":15,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884557+0000","last_change":"2024-09-17T03:46:37.857360+0000","last_active":"2024-09-17T03:46:38.884557+0000","last_peered":"2024-09-17T03:46:38.884557+0000","last_clean":"2024-09-17T03:46:38.884557+0000","last_became_active":"2024-09-17T03:46:37.857041+0000","last_became_peered":"2024-09-17T03:46:37.857041+0000","last_unstale":"2024-09-17T03:46:38.884557+0000","last_undegraded":"2024-09-17T03:46:38.884557+0000","last_fullsized":"2024-09-17T03:46:38.884557+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:15.827164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868255+0000","last_change":"2024-09-17T03:46:38.866013+0000","last_active":"2024-09-17T03:46:38.868255+0000","last_peered":"2024-09-17T03:46:38.868255+0000","last_clean":"2024-09-17T03:46:38.868255+0000","last_became_active":"2024-09-17T03:46:38.865682+0000","last_became_peered":"2024-09-17T03:46:38.865682+0000","last_unstale":"2024-09-17T03:46:38.868255+0000","last_undegraded":"2024-09-17T03:46:38.868255+0000","last_fullsized":"2024-09-17T03:46:38.868255+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:53.452915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841916+0000","last_change":"2024-09-17T03:46:36.841916+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841916+0000","last_undegraded":"2024-09-17T03:46:36.841916+0000","last_fullsized":"2024-09-17T03:46:36.841916+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.877632+0000","last_change":"2024-09-17T03:46:38.876700+0000","last_active":"2024-09-17T03:46:38.877632+0000","last_peered":"2024-09-17T03:46:38.877632+0000","last_clean":"2024-09-17T03:46:38.877632+0000","last_became_active":"2024-09-17T03:46:38.876391+0000","last_became_peered":"2024-09-17T03:46:38.876391+0000","last_unstale":"2024-09-17T03:46:38.877632+0000","last_undegraded":"2024-09-17T03:46:38.877632+0000","last_fullsized":"2024-09-17T03:46:38.877632+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:42.280443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856153+0000","last_change":"2024-09-17T03:46:37.851640+0000","last_active":"2024-09-17T03:46:38.856153+0000","last_peered":"2024-09-17T03:46:38.856153+0000","last_clean":"2024-09-17T03:46:38.856153+0000","last_became_active":"2024-09-17T03:46:37.851293+0000","last_became_peered":"2024-09-17T03:46:37.851293+0000","last_unstale":"2024-09-17T03:46:38.856153+0000","last_undegraded":"2024-09-17T03:46:38.856153+0000","last_fullsized":"2024-09-17T03:46:38.856153+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:38.013751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873248+0000","last_change":"2024-09-17T03:46:38.872576+0000","last_active":"2024-09-17T03:46:38.873248+0000","last_peered":"2024-09-17T03:46:38.873248+0000","last_clean":"2024-09-17T03:46:38.873248+0000","last_became_active":"2024-09-17T03:46:38.872235+0000","last_became_peered":"2024-09-17T03:46:38.872235+0000","last_unstale":"2024-09-17T03:46:38.873248+0000","last_undegraded":"2024-09-17T03:46:38.873248+0000","last_fullsized":"2024-09-17T03:46:38.873248+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:22.527655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.10","version":"198'8","reported_seq":21,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883901+0000","last_change":"2024-09-17T03:46:37.859205+0000","last_active":"2024-09-17T03:46:38.883901+0000","last_peered":"2024-09-17T03:46:38.883901+0000","last_clean":"2024-09-17T03:46:38.883901+0000","last_became_active":"2024-09-17T03:46:37.858827+0000","last_became_peered":"2024-09-17T03:46:37.858827+0000","last_unstale":"2024-09-17T03:46:38.883901+0000","last_undegraded":"2024-09-17T03:46:38.883901+0000","last_fullsized":"2024-09-17T03:46:38.883901+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:52.447059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873714+0000","last_change":"2024-09-17T03:46:38.870343+0000","last_active":"2024-09-17T03:46:38.873714+0000","last_peered":"2024-09-17T03:46:38.873714+0000","last_clean":"2024-09-17T03:46:38.873714+0000","last_became_active":"2024-09-17T03:46:38.870050+0000","last_became_peered":"2024-09-17T03:46:38.870050+0000","last_unstale":"2024-09-17T03:46:38.873714+0000","last_undegraded":"2024-09-17T03:46:38.873714+0000","last_fullsized":"2024-09-17T03:46:38.873714+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:41.722010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.f","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879122+0000","last_change":"2024-09-17T03:46:37.856352+0000","last_active":"2024-09-17T03:46:38.879122+0000","last_peered":"2024-09-17T03:46:38.879122+0000","last_clean":"2024-09-17T03:46:38.879122+0000","last_became_active":"2024-09-17T03:46:37.855823+0000","last_became_peered":"2024-09-17T03:46:37.855823+0000","last_unstale":"2024-09-17T03:46:38.879122+0000","last_undegraded":"2024-09-17T03:46:38.879122+0000","last_fullsized":"2024-09-17T03:46:38.879122+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:32.853630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842235+0000","last_change":"2024-09-17T03:46:36.842235+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842235+0000","last_undegraded":"2024-09-17T03:46:36.842235+0000","last_fullsized":"2024-09-17T03:46:36.842235+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871988+0000","last_change":"2024-09-17T03:46:38.869114+0000","last_active":"2024-09-17T03:46:38.871988+0000","last_peered":"2024-09-17T03:46:38.871988+0000","last_clean":"2024-09-17T03:46:38.871988+0000","last_became_active":"2024-09-17T03:46:38.868763+0000","last_became_peered":"2024-09-17T03:46:38.868763+0000","last_unstale":"2024-09-17T03:46:38.871988+0000","last_undegraded":"2024-09-17T03:46:38.871988+0000","last_fullsized":"2024-09-17T03:46:38.871988+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:21.384878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.d","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.875112+0000","last_change":"2024-09-17T03:46:37.855339+0000","last_active":"2024-09-17T03:46:38.875112+0000","last_peered":"2024-09-17T03:46:38.875112+0000","last_clean":"2024-09-17T03:46:38.875112+0000","last_became_active":"2024-09-17T03:46:37.854766+0000","last_became_peered":"2024-09-17T03:46:37.854766+0000","last_unstale":"2024-09-17T03:46:38.875112+0000","last_undegraded":"2024-09-17T03:46:38.875112+0000","last_fullsized":"2024-09-17T03:46:38.875112+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:25.106006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.865023+0000","last_change":"2024-09-17T03:46:38.858260+0000","last_active":"2024-09-17T03:46:38.865023+0000","last_peered":"2024-09-17T03:46:38.865023+0000","last_clean":"2024-09-17T03:46:38.865023+0000","last_became_active":"2024-09-17T03:46:38.856652+0000","last_became_peered":"2024-09-17T03:46:38.856652+0000","last_unstale":"2024-09-17T03:46:38.865023+0000","last_undegraded":"2024-09-17T03:46:38.865023+0000","last_fullsized":"2024-09-17T03:46:38.865023+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:14.476439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856659+0000","last_change":"2024-09-17T03:46:37.858541+0000","last_active":"2024-09-17T03:46:38.856659+0000","last_peered":"2024-09-17T03:46:38.856659+0000","last_clean":"2024-09-17T03:46:38.856659+0000","last_became_active":"2024-09-17T03:46:37.857850+0000","last_became_peered":"2024-09-17T03:46:37.857850+0000","last_unstale":"2024-09-17T03:46:38.856659+0000","last_undegraded":"2024-09-17T03:46:38.856659+0000","last_fullsized":"2024-09-17T03:46:38.856659+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:06.112538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868122+0000","last_change":"2024-09-17T03:46:38.860988+0000","last_active":"2024-09-17T03:46:38.868122+0000","last_peered":"2024-09-17T03:46:38.868122+0000","last_clean":"2024-09-17T03:46:38.868122+0000","last_became_active":"2024-09-17T03:46:38.860657+0000","last_became_peered":"2024-09-17T03:46:38.860657+0000","last_unstale":"2024-09-17T03:46:38.868122+0000","last_undegraded":"2024-09-17T03:46:38.868122+0000","last_fullsized":"2024-09-17T03:46:38.868122+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:37.643112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842262+0000","last_change":"2024-09-17T03:46:36.842262+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842262+0000","last_undegraded":"2024-09-17T03:46:36.842262+0000","last_fullsized":"2024-09-17T03:46:36.842262+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873819+0000","last_change":"2024-09-17T03:46:38.872416+0000","last_active":"2024-09-17T03:46:38.873819+0000","last_peered":"2024-09-17T03:46:38.873819+0000","last_clean":"2024-09-17T03:46:38.873819+0000","last_became_active":"2024-09-17T03:46:38.872130+0000","last_became_peered":"2024-09-17T03:46:38.872130+0000","last_unstale":"2024-09-17T03:46:38.873819+0000","last_undegraded":"2024-09-17T03:46:38.873819+0000","last_fullsized":"2024-09-17T03:46:38.873819+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:12.680228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856452+0000","last_change":"2024-09-17T03:46:37.856091+0000","last_active":"2024-09-17T03:46:38.856452+0000","last_peered":"2024-09-17T03:46:38.856452+0000","last_clean":"2024-09-17T03:46:38.856452+0000","last_became_active":"2024-09-17T03:46:37.855774+0000","last_became_peered":"2024-09-17T03:46:37.855774+0000","last_unstale":"2024-09-17T03:46:38.856452+0000","last_undegraded":"2024-09-17T03:46:38.856452+0000","last_fullsized":"2024-09-17T03:46:38.856452+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:20.379023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.881413+0000","last_change":"2024-09-17T03:46:38.872310+0000","last_active":"2024-09-17T03:46:38.881413+0000","last_peered":"2024-09-17T03:46:38.881413+0000","last_clean":"2024-09-17T03:46:38.881413+0000","last_became_active":"2024-09-17T03:46:38.871997+0000","last_became_peered":"2024-09-17T03:46:38.871997+0000","last_unstale":"2024-09-17T03:46:38.881413+0000","last_undegraded":"2024-09-17T03:46:38.881413+0000","last_fullsized":"2024-09-17T03:46:38.881413+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:21.541289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.858485+0000","last_change":"2024-09-17T03:46:37.855038+0000","last_active":"2024-09-17T03:46:38.858485+0000","last_peered":"2024-09-17T03:46:38.858485+0000","last_clean":"2024-09-17T03:46:38.858485+0000","last_became_active":"2024-09-17T03:46:37.854645+0000","last_became_peered":"2024-09-17T03:46:37.854645+0000","last_unstale":"2024-09-17T03:46:38.858485+0000","last_undegraded":"2024-09-17T03:46:38.858485+0000","last_fullsized":"2024-09-17T03:46:38.858485+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:09.904657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.857199+0000","last_change":"2024-09-17T03:46:38.855559+0000","last_active":"2024-09-17T03:46:38.857199+0000","last_peered":"2024-09-17T03:46:38.857199+0000","last_clean":"2024-09-17T03:46:38.857199+0000","last_became_active":"2024-09-17T03:46:38.855179+0000","last_became_peered":"2024-09-17T03:46:38.855179+0000","last_unstale":"2024-09-17T03:46:38.857199+0000","last_undegraded":"2024-09-17T03:46:38.857199+0000","last_fullsized":"2024-09-17T03:46:38.857199+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:30.305040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.854811+0000","last_change":"2024-09-17T03:46:37.850967+0000","last_active":"2024-09-17T03:46:38.854811+0000","last_peered":"2024-09-17T03:46:38.854811+0000","last_clean":"2024-09-17T03:46:38.854811+0000","last_became_active":"2024-09-17T03:46:37.849133+0000","last_became_peered":"2024-09-17T03:46:37.849133+0000","last_unstale":"2024-09-17T03:46:38.854811+0000","last_undegraded":"2024-09-17T03:46:38.854811+0000","last_fullsized":"2024-09-17T03:46:38.854811+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:27.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.867364+0000","last_change":"2024-09-17T03:46:38.864300+0000","last_active":"2024-09-17T03:46:38.867364+0000","last_peered":"2024-09-17T03:46:38.867364+0000","last_clean":"2024-09-17T03:46:38.867364+0000","last_became_active":"2024-09-17T03:46:38.863911+0000","last_became_peered":"2024-09-17T03:46:38.863911+0000","last_unstale":"2024-09-17T03:46:38.867364+0000","last_undegraded":"2024-09-17T03:46:38.867364+0000","last_fullsized":"2024-09-17T03:46:38.867364+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:24.794528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.7","version":"198'2","reported_seq":15,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878231+0000","last_change":"2024-09-17T03:46:37.861906+0000","last_active":"2024-09-17T03:46:38.878231+0000","last_peered":"2024-09-17T03:46:38.878231+0000","last_clean":"2024-09-17T03:46:38.878231+0000","last_became_active":"2024-09-17T03:46:37.861585+0000","last_became_peered":"2024-09-17T03:46:37.861585+0000","last_unstale":"2024-09-17T03:46:38.878231+0000","last_undegraded":"2024-09-17T03:46:38.878231+0000","last_fullsized":"2024-09-17T03:46:38.878231+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:21.971121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.885637+0000","last_change":"2024-09-17T03:46:38.884951+0000","last_active":"2024-09-17T03:46:38.885637+0000","last_peered":"2024-09-17T03:46:38.885637+0000","last_clean":"2024-09-17T03:46:38.885637+0000","last_became_active":"2024-09-17T03:46:38.884466+0000","last_became_peered":"2024-09-17T03:46:38.884466+0000","last_unstale":"2024-09-17T03:46:38.885637+0000","last_undegraded":"2024-09-17T03:46:38.885637+0000","last_fullsized":"2024-09-17T03:46:38.885637+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:11.881066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842859+0000","last_change":"2024-09-17T03:46:36.842859+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842859+0000","last_undegraded":"2024-09-17T03:46:36.842859+0000","last_fullsized":"2024-09-17T03:46:36.842859+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.881353+0000","last_change":"2024-09-17T03:46:38.873157+0000","last_active":"2024-09-17T03:46:38.881353+0000","last_peered":"2024-09-17T03:46:38.881353+0000","last_clean":"2024-09-17T03:46:38.881353+0000","last_became_active":"2024-09-17T03:46:38.871901+0000","last_became_peered":"2024-09-17T03:46:38.871901+0000","last_unstale":"2024-09-17T03:46:38.881353+0000","last_undegraded":"2024-09-17T03:46:38.881353+0000","last_fullsized":"2024-09-17T03:46:38.881353+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:38.788056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.858748+0000","last_change":"2024-09-17T03:46:37.856607+0000","last_active":"2024-09-17T03:46:38.858748+0000","last_peered":"2024-09-17T03:46:38.858748+0000","last_clean":"2024-09-17T03:46:38.858748+0000","last_became_active":"2024-09-17T03:46:37.856210+0000","last_became_peered":"2024-09-17T03:46:37.856210+0000","last_unstale":"2024-09-17T03:46:38.858748+0000","last_undegraded":"2024-09-17T03:46:38.858748+0000","last_fullsized":"2024-09-17T03:46:38.858748+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.093398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873039+0000","last_change":"2024-09-17T03:46:38.858182+0000","last_active":"2024-09-17T03:46:38.873039+0000","last_peered":"2024-09-17T03:46:38.873039+0000","last_clean":"2024-09-17T03:46:38.873039+0000","last_became_active":"2024-09-17T03:46:38.857886+0000","last_became_peered":"2024-09-17T03:46:38.857886+0000","last_unstale":"2024-09-17T03:46:38.873039+0000","last_undegraded":"2024-09-17T03:46:38.873039+0000","last_fullsized":"2024-09-17T03:46:38.873039+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:35.037081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856707+0000","last_change":"2024-09-17T03:46:37.860656+0000","last_active":"2024-09-17T03:46:38.856707+0000","last_peered":"2024-09-17T03:46:38.856707+0000","last_clean":"2024-09-17T03:46:38.856707+0000","last_became_active":"2024-09-17T03:46:37.860363+0000","last_became_peered":"2024-09-17T03:46:37.860363+0000","last_unstale":"2024-09-17T03:46:38.856707+0000","last_undegraded":"2024-09-17T03:46:38.856707+0000","last_fullsized":"2024-09-17T03:46:38.856707+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:51.416909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871718+0000","last_change":"2024-09-17T03:46:38.869909+0000","last_active":"2024-09-17T03:46:38.871718+0000","last_peered":"2024-09-17T03:46:38.871718+0000","last_clean":"2024-09-17T03:46:38.871718+0000","last_became_active":"2024-09-17T03:46:38.869591+0000","last_became_peered":"2024-09-17T03:46:38.869591+0000","last_unstale":"2024-09-17T03:46:38.871718+0000","last_undegraded":"2024-09-17T03:46:38.871718+0000","last_fullsized":"2024-09-17T03:46:38.871718+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:11.881066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.859758+0000","last_change":"2024-09-17T03:46:37.858101+0000","last_active":"2024-09-17T03:46:38.859758+0000","last_peered":"2024-09-17T03:46:38.859758+0000","last_clean":"2024-09-17T03:46:38.859758+0000","last_became_active":"2024-09-17T03:46:37.857577+0000","last_became_peered":"2024-09-17T03:46:37.857577+0000","last_unstale":"2024-09-17T03:46:38.859758+0000","last_undegraded":"2024-09-17T03:46:38.859758+0000","last_fullsized":"2024-09-17T03:46:38.859758+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:58.497943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868076+0000","last_change":"2024-09-17T03:46:38.861305+0000","last_active":"2024-09-17T03:46:38.868076+0000","last_peered":"2024-09-17T03:46:38.868076+0000","last_clean":"2024-09-17T03:46:38.868076+0000","last_became_active":"2024-09-17T03:46:38.860980+0000","last_became_peered":"2024-09-17T03:46:38.860980+0000","last_unstale":"2024-09-17T03:46:38.868076+0000","last_undegraded":"2024-09-17T03:46:38.868076+0000","last_fullsized":"2024-09-17T03:46:38.868076+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:47.778627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.850086+0000","last_change":"2024-09-17T03:46:37.861053+0000","last_active":"2024-09-17T03:46:38.850086+0000","last_peered":"2024-09-17T03:46:38.850086+0000","last_clean":"2024-09-17T03:46:38.850086+0000","last_became_active":"2024-09-17T03:46:37.860753+0000","last_became_peered":"2024-09-17T03:46:37.860753+0000","last_unstale":"2024-09-17T03:46:38.850086+0000","last_undegraded":"2024-09-17T03:46:38.850086+0000","last_fullsized":"2024-09-17T03:46:38.850086+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:48.523839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871032+0000","last_change":"2024-09-17T03:46:38.865353+0000","last_active":"2024-09-17T03:46:38.871032+0000","last_peered":"2024-09-17T03:46:38.871032+0000","last_clean":"2024-09-17T03:46:38.871032+0000","last_became_active":"2024-09-17T03:46:38.864736+0000","last_became_peered":"2024-09-17T03:46:38.864736+0000","last_unstale":"2024-09-17T03:46:38.871032+0000","last_undegraded":"2024-09-17T03:46:38.871032+0000","last_fullsized":"2024-09-17T03:46:38.871032+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:08.952464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.840913+0000","last_change":"2024-09-17T03:46:36.840913+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.840913+0000","last_undegraded":"2024-09-17T03:46:36.840913+0000","last_fullsized":"2024-09-17T03:46:36.840913+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884678+0000","last_change":"2024-09-17T03:46:38.882784+0000","last_active":"2024-09-17T03:46:38.884678+0000","last_peered":"2024-09-17T03:46:38.884678+0000","last_clean":"2024-09-17T03:46:38.884678+0000","last_became_active":"2024-09-17T03:46:38.882232+0000","last_became_peered":"2024-09-17T03:46:38.882232+0000","last_unstale":"2024-09-17T03:46:38.884678+0000","last_undegraded":"2024-09-17T03:46:38.884678+0000","last_fullsized":"2024-09-17T03:46:38.884678+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:27.696745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.840592+0000","last_change":"2024-09-17T03:46:36.840592+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.840592+0000","last_undegraded":"2024-09-17T03:46:36.840592+0000","last_fullsized":"2024-09-17T03:46:36.840592+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841813+0000","last_change":"2024-09-17T03:46:36.841813+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841813+0000","last_undegraded":"2024-09-17T03:46:36.841813+0000","last_fullsized":"2024-09-17T03:46:36.841813+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":436,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856745+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:46:38.856745+0000","last_peered":"2024-09-17T03:46:38.856745+0000","last_clean":"2024-09-17T03:46:38.856745+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:46:38.856745+0000","last_undegraded":"2024-09-17T03:46:38.856745+0000","last_fullsized":"2024-09-17T03:46:38.856745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":6},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509610,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60588,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311252,"statfs":{"total":96636764160,"available":96574722048,"internally_reserved":0,"allocated":3096576,"data_stored":1689513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509610,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60012,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311828,"statfs":{"total":96636764160,"available":96575311872,"internally_reserved":0,"allocated":2506752,"data_stored":1099679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509610,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65524,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306316,"statfs":{"total":96636764160,"available":96569667584,"internally_reserved":0,"allocated":2519040,"data_stored":1100779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509610,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55844,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315996,"statfs":{"total":96636764160,"available":96579579904,"internally_reserved":0,"allocated":2502656,"data_stored":1099165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509611,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59992,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311848,"statfs":{"total":96636764160,"available":96575332352,"internally_reserved":0,"allocated":2486272,"data_stored":1092300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509611,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56428,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315412,"statfs":{"total":96636764160,"available":96578981888,"internally_reserved":0,"allocated":3096576,"data_stored":1689477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575017,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55820,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316020,"statfs":{"total":96636764160,"available":96579604480,"internally_reserved":0,"allocated":2473984,"data_stored":1086025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575017,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59980,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311860,"statfs":{"total":96636764160,"available":96575344640,"internally_reserved":0,"allocated":2473984,"data_stored":1086025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:46:43.270 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:46:43.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.419+0000 7f0b0c790640 1 -- 172.21.15.146:0/99570826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0415fc60 msgr2=0x7f0b041628f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.419+0000 7f0b0c790640 1 --2- 172.21.15.146:0/99570826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0415fc60 0x7f0b041628f0 secure :-1 s=READY pgs=2568 cs=0 l=1 rev1=1 crypto rx=0x7f0b00005fd0 tx=0x7f0b0002a540 comp rx=0 tx=0).stop 2024-09-17T03:46:43.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.419+0000 7f0b0c790640 1 -- 172.21.15.146:0/99570826 shutdown_connections 2024-09-17T03:46:43.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.419+0000 7f0b0c790640 1 --2- 172.21.15.146:0/99570826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b0415fc60 0x7f0b041628f0 unknown :-1 s=CLOSED pgs=2568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.419+0000 7f0b0c790640 1 -- 172.21.15.146:0/99570826 >> 172.21.15.146:0/99570826 conn(0x7f0b040d4cd0 msgr2=0x7f0b040d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:43.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.419+0000 7f0b0c790640 1 -- 172.21.15.146:0/99570826 shutdown_connections 2024-09-17T03:46:43.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.419+0000 7f0b0c790640 1 -- 172.21.15.146:0/99570826 wait complete. 2024-09-17T03:46:43.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.421+0000 7f0b0c790640 1 Processor -- start 2024-09-17T03:46:43.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.421+0000 7f0b0c790640 1 -- start start 2024-09-17T03:46:43.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b0c790640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b040cfb40 0x7f0b041502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b0c790640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b040cff50 0x7f0b041495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b0c790640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0415fc60 0x7f0b04149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b0c790640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0b040d3380 con 0x7f0b040cff50 2024-09-17T03:46:43.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b0c790640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0b04163040 con 0x7f0b0415fc60 2024-09-17T03:46:43.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b0c790640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0b040d3500 con 0x7f0b040cfb40 2024-09-17T03:46:43.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b09d2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b040cff50 0x7f0b041495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b09d2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b040cff50 0x7f0b041495c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38738/0 (socket says 172.21.15.146:38738) 2024-09-17T03:46:43.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b09d2b640 1 -- 172.21.15.146:0/2658770307 learned_addr learned my addr 172.21.15.146:0/2658770307 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:43.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b0a52c640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b040cfb40 0x7f0b041502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.423 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b09d2b640 1 -- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b040cfb40 msgr2=0x7f0b041502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b09d2b640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b040cfb40 0x7f0b041502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b09d2b640 1 -- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0415fc60 msgr2=0x7f0b04149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b0ad2d640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0415fc60 0x7f0b04149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b09d2b640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0415fc60 0x7f0b04149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b09d2b640 1 -- 172.21.15.146:0/2658770307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b040cea60 con 0x7f0b040cff50 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.422+0000 7f0b0ad2d640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0415fc60 0x7f0b04149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.423+0000 7f0b09d2b640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b040cff50 0x7f0b041495c0 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009fd0 tx=0x7f0af400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.423+0000 7f0afaffd640 1 -- 172.21.15.146:0/2658770307 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4015020 con 0x7f0b040cff50 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.423+0000 7f0b0c790640 1 -- 172.21.15.146:0/2658770307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b041f9a70 con 0x7f0b040cff50 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.423+0000 7f0afaffd640 1 -- 172.21.15.146:0/2658770307 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0af4011920 con 0x7f0b040cff50 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.423+0000 7f0afaffd640 1 -- 172.21.15.146:0/2658770307 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4011d50 con 0x7f0b040cff50 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.423+0000 7f0b0c790640 1 -- 172.21.15.146:0/2658770307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b041fa030 con 0x7f0b040cff50 2024-09-17T03:46:43.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.424+0000 7f0b0c790640 1 -- 172.21.15.146:0/2658770307 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b040699a0 con 0x7f0b040cff50 2024-09-17T03:46:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.424+0000 7f0afaffd640 1 -- 172.21.15.146:0/2658770307 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0af4018020 con 0x7f0b040cff50 2024-09-17T03:46:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.425+0000 7f0afaffd640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0ae8078b90 0x7f0ae807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.425+0000 7f0afaffd640 1 -- 172.21.15.146:0/2658770307 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f0af409ac30 con 0x7f0b040cff50 2024-09-17T03:46:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.425+0000 7f0b0a52c640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0ae8078b90 0x7f0ae807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.426+0000 7f0b0a52c640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0ae8078b90 0x7f0ae807b0a0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f0b00033000 tx=0x7f0b00004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:43.428 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.429+0000 7f0afaffd640 1 -- 172.21.15.146:0/2658770307 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0af401f020 con 0x7f0b040cff50 2024-09-17T03:46:43.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.600+0000 7f0b0c790640 1 -- 172.21.15.146:0/2658770307 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b041f9800 con 0x7f0ae8078b90 2024-09-17T03:46:43.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.604+0000 7f0afaffd640 1 -- 172.21.15.146:0/2658770307 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249912 (secure 0 0 0) 0x7f0b041f9800 con 0x7f0ae8078b90 2024-09-17T03:46:43.606 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:43.608 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:46:43.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 -- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0ae8078b90 msgr2=0x7f0ae807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0ae8078b90 0x7f0ae807b0a0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f0b00033000 tx=0x7f0b00004730 comp rx=0 tx=0).stop 2024-09-17T03:46:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 -- 172.21.15.146:0/2658770307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b040cff50 msgr2=0x7f0b041495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b040cff50 0x7f0b041495c0 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009fd0 tx=0x7f0af400b870 comp rx=0 tx=0).stop 2024-09-17T03:46:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 -- 172.21.15.146:0/2658770307 shutdown_connections 2024-09-17T03:46:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0ae8078b90 0x7f0ae807b0a0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0b0415fc60 0x7f0b04149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b040cff50 0x7f0b041495c0 unknown :-1 s=CLOSED pgs=2569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 --2- 172.21.15.146:0/2658770307 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0b040cfb40 0x7f0b041502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 -- 172.21.15.146:0/2658770307 >> 172.21.15.146:0/2658770307 conn(0x7f0b040d4cd0 msgr2=0x7f0b041621a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 -- 172.21.15.146:0/2658770307 shutdown_connections 2024-09-17T03:46:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.607+0000 7f0b0c790640 1 -- 172.21.15.146:0/2658770307 wait complete. 2024-09-17T03:46:43.618 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":610,"stamp":"2024-09-17T03:46:42.010897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":131,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474188,"kb_used_data":20660,"kb_used_omap":12,"kb_used_meta":453299,"kb_avail":754500532,"statfs":{"total":773094113280,"available":772608544768,"internally_reserved":0,"allocated":21155840,"data_stored":9942963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":464178737},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.175042"},"pg_stats":[{"pgid":"31.3f","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873864+0000","last_change":"2024-09-17T03:46:38.871668+0000","last_active":"2024-09-17T03:46:38.873864+0000","last_peered":"2024-09-17T03:46:38.873864+0000","last_clean":"2024-09-17T03:46:38.873864+0000","last_became_active":"2024-09-17T03:46:38.871334+0000","last_became_peered":"2024-09-17T03:46:38.871334+0000","last_unstale":"2024-09-17T03:46:38.873864+0000","last_undegraded":"2024-09-17T03:46:38.873864+0000","last_fullsized":"2024-09-17T03:46:38.873864+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:33.859485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884639+0000","last_change":"2024-09-17T03:46:38.879231+0000","last_active":"2024-09-17T03:46:38.884639+0000","last_peered":"2024-09-17T03:46:38.884639+0000","last_clean":"2024-09-17T03:46:38.884639+0000","last_became_active":"2024-09-17T03:46:38.878901+0000","last_became_peered":"2024-09-17T03:46:38.878901+0000","last_unstale":"2024-09-17T03:46:38.884639+0000","last_undegraded":"2024-09-17T03:46:38.884639+0000","last_fullsized":"2024-09-17T03:46:38.884639+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:40.395914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868060+0000","last_change":"2024-09-17T03:46:38.866452+0000","last_active":"2024-09-17T03:46:38.868060+0000","last_peered":"2024-09-17T03:46:38.868060+0000","last_clean":"2024-09-17T03:46:38.868060+0000","last_became_active":"2024-09-17T03:46:38.866088+0000","last_became_peered":"2024-09-17T03:46:38.866088+0000","last_unstale":"2024-09-17T03:46:38.868060+0000","last_undegraded":"2024-09-17T03:46:38.868060+0000","last_fullsized":"2024-09-17T03:46:38.868060+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:50.828365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.864979+0000","last_change":"2024-09-17T03:46:38.862117+0000","last_active":"2024-09-17T03:46:38.864979+0000","last_peered":"2024-09-17T03:46:38.864979+0000","last_clean":"2024-09-17T03:46:38.864979+0000","last_became_active":"2024-09-17T03:46:38.861759+0000","last_became_peered":"2024-09-17T03:46:38.861759+0000","last_unstale":"2024-09-17T03:46:38.864979+0000","last_undegraded":"2024-09-17T03:46:38.864979+0000","last_fullsized":"2024-09-17T03:46:38.864979+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:03.120246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879159+0000","last_change":"2024-09-17T03:46:38.877127+0000","last_active":"2024-09-17T03:46:38.879159+0000","last_peered":"2024-09-17T03:46:38.879159+0000","last_clean":"2024-09-17T03:46:38.879159+0000","last_became_active":"2024-09-17T03:46:38.876807+0000","last_became_peered":"2024-09-17T03:46:38.876807+0000","last_unstale":"2024-09-17T03:46:38.879159+0000","last_undegraded":"2024-09-17T03:46:38.879159+0000","last_fullsized":"2024-09-17T03:46:38.879159+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:36.353553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872714+0000","last_change":"2024-09-17T03:46:38.866116+0000","last_active":"2024-09-17T03:46:38.872714+0000","last_peered":"2024-09-17T03:46:38.872714+0000","last_clean":"2024-09-17T03:46:38.872714+0000","last_became_active":"2024-09-17T03:46:38.865806+0000","last_became_peered":"2024-09-17T03:46:38.865806+0000","last_unstale":"2024-09-17T03:46:38.872714+0000","last_undegraded":"2024-09-17T03:46:38.872714+0000","last_fullsized":"2024-09-17T03:46:38.872714+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:59.762164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878063+0000","last_change":"2024-09-17T03:46:38.876509+0000","last_active":"2024-09-17T03:46:38.878063+0000","last_peered":"2024-09-17T03:46:38.878063+0000","last_clean":"2024-09-17T03:46:38.878063+0000","last_became_active":"2024-09-17T03:46:38.876170+0000","last_became_peered":"2024-09-17T03:46:38.876170+0000","last_unstale":"2024-09-17T03:46:38.878063+0000","last_undegraded":"2024-09-17T03:46:38.878063+0000","last_fullsized":"2024-09-17T03:46:38.878063+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:07.118394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871684+0000","last_change":"2024-09-17T03:46:38.869498+0000","last_active":"2024-09-17T03:46:38.871684+0000","last_peered":"2024-09-17T03:46:38.871684+0000","last_clean":"2024-09-17T03:46:38.871684+0000","last_became_active":"2024-09-17T03:46:38.869166+0000","last_became_peered":"2024-09-17T03:46:38.869166+0000","last_unstale":"2024-09-17T03:46:38.871684+0000","last_undegraded":"2024-09-17T03:46:38.871684+0000","last_fullsized":"2024-09-17T03:46:38.871684+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.132290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883071+0000","last_change":"2024-09-17T03:46:38.874775+0000","last_active":"2024-09-17T03:46:38.883071+0000","last_peered":"2024-09-17T03:46:38.883071+0000","last_clean":"2024-09-17T03:46:38.883071+0000","last_became_active":"2024-09-17T03:46:38.874487+0000","last_became_peered":"2024-09-17T03:46:38.874487+0000","last_unstale":"2024-09-17T03:46:38.883071+0000","last_undegraded":"2024-09-17T03:46:38.883071+0000","last_fullsized":"2024-09-17T03:46:38.883071+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:41.649494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871053+0000","last_change":"2024-09-17T03:46:38.864701+0000","last_active":"2024-09-17T03:46:38.871053+0000","last_peered":"2024-09-17T03:46:38.871053+0000","last_clean":"2024-09-17T03:46:38.871053+0000","last_became_active":"2024-09-17T03:46:38.864315+0000","last_became_peered":"2024-09-17T03:46:38.864315+0000","last_unstale":"2024-09-17T03:46:38.871053+0000","last_undegraded":"2024-09-17T03:46:38.871053+0000","last_fullsized":"2024-09-17T03:46:38.871053+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:23.297852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879231+0000","last_change":"2024-09-17T03:46:38.877166+0000","last_active":"2024-09-17T03:46:38.879231+0000","last_peered":"2024-09-17T03:46:38.879231+0000","last_clean":"2024-09-17T03:46:38.879231+0000","last_became_active":"2024-09-17T03:46:38.876853+0000","last_became_peered":"2024-09-17T03:46:38.876853+0000","last_unstale":"2024-09-17T03:46:38.879231+0000","last_undegraded":"2024-09-17T03:46:38.879231+0000","last_fullsized":"2024-09-17T03:46:38.879231+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:22.583146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873963+0000","last_change":"2024-09-17T03:46:38.871599+0000","last_active":"2024-09-17T03:46:38.873963+0000","last_peered":"2024-09-17T03:46:38.873963+0000","last_clean":"2024-09-17T03:46:38.873963+0000","last_became_active":"2024-09-17T03:46:38.871279+0000","last_became_peered":"2024-09-17T03:46:38.871279+0000","last_unstale":"2024-09-17T03:46:38.873963+0000","last_undegraded":"2024-09-17T03:46:38.873963+0000","last_fullsized":"2024-09-17T03:46:38.873963+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:39.019606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878350+0000","last_change":"2024-09-17T03:46:38.877390+0000","last_active":"2024-09-17T03:46:38.878350+0000","last_peered":"2024-09-17T03:46:38.878350+0000","last_clean":"2024-09-17T03:46:38.878350+0000","last_became_active":"2024-09-17T03:46:38.877043+0000","last_became_peered":"2024-09-17T03:46:38.877043+0000","last_unstale":"2024-09-17T03:46:38.878350+0000","last_undegraded":"2024-09-17T03:46:38.878350+0000","last_fullsized":"2024-09-17T03:46:38.878350+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:52.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856633+0000","last_change":"2024-09-17T03:46:38.855444+0000","last_active":"2024-09-17T03:46:38.856633+0000","last_peered":"2024-09-17T03:46:38.856633+0000","last_clean":"2024-09-17T03:46:38.856633+0000","last_became_active":"2024-09-17T03:46:38.855104+0000","last_became_peered":"2024-09-17T03:46:38.855104+0000","last_unstale":"2024-09-17T03:46:38.856633+0000","last_undegraded":"2024-09-17T03:46:38.856633+0000","last_fullsized":"2024-09-17T03:46:38.856633+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:45.332349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871069+0000","last_change":"2024-09-17T03:46:38.869122+0000","last_active":"2024-09-17T03:46:38.871069+0000","last_peered":"2024-09-17T03:46:38.871069+0000","last_clean":"2024-09-17T03:46:38.871069+0000","last_became_active":"2024-09-17T03:46:38.868818+0000","last_became_peered":"2024-09-17T03:46:38.868818+0000","last_unstale":"2024-09-17T03:46:38.871069+0000","last_undegraded":"2024-09-17T03:46:38.871069+0000","last_fullsized":"2024-09-17T03:46:38.871069+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:47.484288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874564+0000","last_change":"2024-09-17T03:46:38.873994+0000","last_active":"2024-09-17T03:46:38.874564+0000","last_peered":"2024-09-17T03:46:38.874564+0000","last_clean":"2024-09-17T03:46:38.874564+0000","last_became_active":"2024-09-17T03:46:38.873589+0000","last_became_peered":"2024-09-17T03:46:38.873589+0000","last_unstale":"2024-09-17T03:46:38.874564+0000","last_undegraded":"2024-09-17T03:46:38.874564+0000","last_fullsized":"2024-09-17T03:46:38.874564+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:12.986513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872593+0000","last_change":"2024-09-17T03:46:38.869135+0000","last_active":"2024-09-17T03:46:38.872593+0000","last_peered":"2024-09-17T03:46:38.872593+0000","last_clean":"2024-09-17T03:46:38.872593+0000","last_became_active":"2024-09-17T03:46:38.868524+0000","last_became_peered":"2024-09-17T03:46:38.868524+0000","last_unstale":"2024-09-17T03:46:38.872593+0000","last_undegraded":"2024-09-17T03:46:38.872593+0000","last_fullsized":"2024-09-17T03:46:38.872593+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:39.027714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872689+0000","last_change":"2024-09-17T03:46:38.871659+0000","last_active":"2024-09-17T03:46:38.872689+0000","last_peered":"2024-09-17T03:46:38.872689+0000","last_clean":"2024-09-17T03:46:38.872689+0000","last_became_active":"2024-09-17T03:46:38.871304+0000","last_became_peered":"2024-09-17T03:46:38.871304+0000","last_unstale":"2024-09-17T03:46:38.872689+0000","last_undegraded":"2024-09-17T03:46:38.872689+0000","last_fullsized":"2024-09-17T03:46:38.872689+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:42.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868055+0000","last_change":"2024-09-17T03:46:38.862294+0000","last_active":"2024-09-17T03:46:38.868055+0000","last_peered":"2024-09-17T03:46:38.868055+0000","last_clean":"2024-09-17T03:46:38.868055+0000","last_became_active":"2024-09-17T03:46:38.861912+0000","last_became_peered":"2024-09-17T03:46:38.861912+0000","last_unstale":"2024-09-17T03:46:38.868055+0000","last_undegraded":"2024-09-17T03:46:38.868055+0000","last_fullsized":"2024-09-17T03:46:38.868055+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:45.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883740+0000","last_change":"2024-09-17T03:46:38.876742+0000","last_active":"2024-09-17T03:46:38.883740+0000","last_peered":"2024-09-17T03:46:38.883740+0000","last_clean":"2024-09-17T03:46:38.883740+0000","last_became_active":"2024-09-17T03:46:38.876441+0000","last_became_peered":"2024-09-17T03:46:38.876441+0000","last_unstale":"2024-09-17T03:46:38.883740+0000","last_undegraded":"2024-09-17T03:46:38.883740+0000","last_fullsized":"2024-09-17T03:46:38.883740+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:24.794528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.864971+0000","last_change":"2024-09-17T03:46:38.862445+0000","last_active":"2024-09-17T03:46:38.864971+0000","last_peered":"2024-09-17T03:46:38.864971+0000","last_clean":"2024-09-17T03:46:38.864971+0000","last_became_active":"2024-09-17T03:46:38.861998+0000","last_became_peered":"2024-09-17T03:46:38.861998+0000","last_unstale":"2024-09-17T03:46:38.864971+0000","last_undegraded":"2024-09-17T03:46:38.864971+0000","last_fullsized":"2024-09-17T03:46:38.864971+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:55.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879214+0000","last_change":"2024-09-17T03:46:38.877664+0000","last_active":"2024-09-17T03:46:38.879214+0000","last_peered":"2024-09-17T03:46:38.879214+0000","last_clean":"2024-09-17T03:46:38.879214+0000","last_became_active":"2024-09-17T03:46:38.877375+0000","last_became_peered":"2024-09-17T03:46:38.877375+0000","last_unstale":"2024-09-17T03:46:38.879214+0000","last_undegraded":"2024-09-17T03:46:38.879214+0000","last_fullsized":"2024-09-17T03:46:38.879214+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:17.248059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.882971+0000","last_change":"2024-09-17T03:46:38.874450+0000","last_active":"2024-09-17T03:46:38.882971+0000","last_peered":"2024-09-17T03:46:38.882971+0000","last_clean":"2024-09-17T03:46:38.882971+0000","last_became_active":"2024-09-17T03:46:38.873914+0000","last_became_peered":"2024-09-17T03:46:38.873914+0000","last_unstale":"2024-09-17T03:46:38.882971+0000","last_undegraded":"2024-09-17T03:46:38.882971+0000","last_fullsized":"2024-09-17T03:46:38.882971+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:18.270227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.885019+0000","last_change":"2024-09-17T03:46:38.880123+0000","last_active":"2024-09-17T03:46:38.885019+0000","last_peered":"2024-09-17T03:46:38.885019+0000","last_clean":"2024-09-17T03:46:38.885019+0000","last_became_active":"2024-09-17T03:46:38.879828+0000","last_became_peered":"2024-09-17T03:46:38.879828+0000","last_unstale":"2024-09-17T03:46:38.885019+0000","last_undegraded":"2024-09-17T03:46:38.885019+0000","last_fullsized":"2024-09-17T03:46:38.885019+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.132290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872413+0000","last_change":"2024-09-17T03:46:38.864173+0000","last_active":"2024-09-17T03:46:38.872413+0000","last_peered":"2024-09-17T03:46:38.872413+0000","last_clean":"2024-09-17T03:46:38.872413+0000","last_became_active":"2024-09-17T03:46:38.863861+0000","last_became_peered":"2024-09-17T03:46:38.863861+0000","last_unstale":"2024-09-17T03:46:38.872413+0000","last_undegraded":"2024-09-17T03:46:38.872413+0000","last_fullsized":"2024-09-17T03:46:38.872413+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:14.514064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.877166+0000","last_change":"2024-09-17T03:46:38.875927+0000","last_active":"2024-09-17T03:46:38.877166+0000","last_peered":"2024-09-17T03:46:38.877166+0000","last_clean":"2024-09-17T03:46:38.877166+0000","last_became_active":"2024-09-17T03:46:38.875618+0000","last_became_peered":"2024-09-17T03:46:38.875618+0000","last_unstale":"2024-09-17T03:46:38.877166+0000","last_undegraded":"2024-09-17T03:46:38.877166+0000","last_fullsized":"2024-09-17T03:46:38.877166+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:08.073928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873903+0000","last_change":"2024-09-17T03:46:38.870813+0000","last_active":"2024-09-17T03:46:38.873903+0000","last_peered":"2024-09-17T03:46:38.873903+0000","last_clean":"2024-09-17T03:46:38.873903+0000","last_became_active":"2024-09-17T03:46:38.870493+0000","last_became_peered":"2024-09-17T03:46:38.870493+0000","last_unstale":"2024-09-17T03:46:38.873903+0000","last_undegraded":"2024-09-17T03:46:38.873903+0000","last_fullsized":"2024-09-17T03:46:38.873903+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:28.445042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1e","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878982+0000","last_change":"2024-09-17T03:46:37.849807+0000","last_active":"2024-09-17T03:46:38.878982+0000","last_peered":"2024-09-17T03:46:38.878982+0000","last_clean":"2024-09-17T03:46:38.878982+0000","last_became_active":"2024-09-17T03:46:37.849384+0000","last_became_peered":"2024-09-17T03:46:37.849384+0000","last_unstale":"2024-09-17T03:46:38.878982+0000","last_undegraded":"2024-09-17T03:46:38.878982+0000","last_fullsized":"2024-09-17T03:46:38.878982+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:56.687816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872914+0000","last_change":"2024-09-17T03:46:38.864532+0000","last_active":"2024-09-17T03:46:38.872914+0000","last_peered":"2024-09-17T03:46:38.872914+0000","last_clean":"2024-09-17T03:46:38.872914+0000","last_became_active":"2024-09-17T03:46:38.864221+0000","last_became_peered":"2024-09-17T03:46:38.864221+0000","last_unstale":"2024-09-17T03:46:38.872914+0000","last_undegraded":"2024-09-17T03:46:38.872914+0000","last_fullsized":"2024-09-17T03:46:38.872914+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.402855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841827+0000","last_change":"2024-09-17T03:46:36.841827+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841827+0000","last_undegraded":"2024-09-17T03:46:36.841827+0000","last_fullsized":"2024-09-17T03:46:36.841827+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.859231+0000","last_change":"2024-09-17T03:46:38.857502+0000","last_active":"2024-09-17T03:46:38.859231+0000","last_peered":"2024-09-17T03:46:38.859231+0000","last_clean":"2024-09-17T03:46:38.859231+0000","last_became_active":"2024-09-17T03:46:38.857193+0000","last_became_peered":"2024-09-17T03:46:38.857193+0000","last_unstale":"2024-09-17T03:46:38.859231+0000","last_undegraded":"2024-09-17T03:46:38.859231+0000","last_fullsized":"2024-09-17T03:46:38.859231+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:57.596324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.843011+0000","last_change":"2024-09-17T03:46:36.843011+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.843011+0000","last_undegraded":"2024-09-17T03:46:36.843011+0000","last_fullsized":"2024-09-17T03:46:36.843011+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872348+0000","last_change":"2024-09-17T03:46:38.863432+0000","last_active":"2024-09-17T03:46:38.872348+0000","last_peered":"2024-09-17T03:46:38.872348+0000","last_clean":"2024-09-17T03:46:38.872348+0000","last_became_active":"2024-09-17T03:46:38.863073+0000","last_became_peered":"2024-09-17T03:46:38.863073+0000","last_unstale":"2024-09-17T03:46:38.872348+0000","last_undegraded":"2024-09-17T03:46:38.872348+0000","last_fullsized":"2024-09-17T03:46:38.872348+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:38.721703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1b","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874483+0000","last_change":"2024-09-17T03:46:37.857697+0000","last_active":"2024-09-17T03:46:38.874483+0000","last_peered":"2024-09-17T03:46:38.874483+0000","last_clean":"2024-09-17T03:46:38.874483+0000","last_became_active":"2024-09-17T03:46:37.857396+0000","last_became_peered":"2024-09-17T03:46:37.857396+0000","last_unstale":"2024-09-17T03:46:38.874483+0000","last_undegraded":"2024-09-17T03:46:38.874483+0000","last_fullsized":"2024-09-17T03:46:38.874483+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:47.376600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878548+0000","last_change":"2024-09-17T03:46:38.877940+0000","last_active":"2024-09-17T03:46:38.878548+0000","last_peered":"2024-09-17T03:46:38.878548+0000","last_clean":"2024-09-17T03:46:38.878548+0000","last_became_active":"2024-09-17T03:46:38.877521+0000","last_became_peered":"2024-09-17T03:46:38.877521+0000","last_unstale":"2024-09-17T03:46:38.878548+0000","last_undegraded":"2024-09-17T03:46:38.878548+0000","last_fullsized":"2024-09-17T03:46:38.878548+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:35.037081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884389+0000","last_change":"2024-09-17T03:46:37.853555+0000","last_active":"2024-09-17T03:46:38.884389+0000","last_peered":"2024-09-17T03:46:38.884389+0000","last_clean":"2024-09-17T03:46:38.884389+0000","last_became_active":"2024-09-17T03:46:37.853225+0000","last_became_peered":"2024-09-17T03:46:37.853225+0000","last_unstale":"2024-09-17T03:46:38.884389+0000","last_undegraded":"2024-09-17T03:46:38.884389+0000","last_fullsized":"2024-09-17T03:46:38.884389+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:52.469536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856579+0000","last_change":"2024-09-17T03:46:37.856566+0000","last_active":"2024-09-17T03:46:38.856579+0000","last_peered":"2024-09-17T03:46:38.856579+0000","last_clean":"2024-09-17T03:46:38.856579+0000","last_became_active":"2024-09-17T03:46:37.856251+0000","last_became_peered":"2024-09-17T03:46:37.856251+0000","last_unstale":"2024-09-17T03:46:38.856579+0000","last_undegraded":"2024-09-17T03:46:38.856579+0000","last_fullsized":"2024-09-17T03:46:38.856579+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:11.674372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.875351+0000","last_change":"2024-09-17T03:46:38.874486+0000","last_active":"2024-09-17T03:46:38.875351+0000","last_peered":"2024-09-17T03:46:38.875351+0000","last_clean":"2024-09-17T03:46:38.875351+0000","last_became_active":"2024-09-17T03:46:38.874172+0000","last_became_peered":"2024-09-17T03:46:38.874172+0000","last_unstale":"2024-09-17T03:46:38.875351+0000","last_undegraded":"2024-09-17T03:46:38.875351+0000","last_fullsized":"2024-09-17T03:46:38.875351+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:57.693671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841994+0000","last_change":"2024-09-17T03:46:36.841994+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841994+0000","last_undegraded":"2024-09-17T03:46:36.841994+0000","last_fullsized":"2024-09-17T03:46:36.841994+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883287+0000","last_change":"2024-09-17T03:46:38.875932+0000","last_active":"2024-09-17T03:46:38.883287+0000","last_peered":"2024-09-17T03:46:38.883287+0000","last_clean":"2024-09-17T03:46:38.883287+0000","last_became_active":"2024-09-17T03:46:38.875606+0000","last_became_peered":"2024-09-17T03:46:38.875606+0000","last_unstale":"2024-09-17T03:46:38.883287+0000","last_undegraded":"2024-09-17T03:46:38.883287+0000","last_fullsized":"2024-09-17T03:46:38.883287+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:59.503799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.853027+0000","last_change":"2024-09-17T03:46:37.859345+0000","last_active":"2024-09-17T03:46:38.853027+0000","last_peered":"2024-09-17T03:46:38.853027+0000","last_clean":"2024-09-17T03:46:38.853027+0000","last_became_active":"2024-09-17T03:46:37.859006+0000","last_became_peered":"2024-09-17T03:46:37.859006+0000","last_unstale":"2024-09-17T03:46:38.853027+0000","last_undegraded":"2024-09-17T03:46:38.853027+0000","last_fullsized":"2024-09-17T03:46:38.853027+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:10.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874637+0000","last_change":"2024-09-17T03:46:38.871889+0000","last_active":"2024-09-17T03:46:38.874637+0000","last_peered":"2024-09-17T03:46:38.874637+0000","last_clean":"2024-09-17T03:46:38.874637+0000","last_became_active":"2024-09-17T03:46:38.871405+0000","last_became_peered":"2024-09-17T03:46:38.871405+0000","last_unstale":"2024-09-17T03:46:38.874637+0000","last_undegraded":"2024-09-17T03:46:38.874637+0000","last_fullsized":"2024-09-17T03:46:38.874637+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:11.581943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842752+0000","last_change":"2024-09-17T03:46:36.842752+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842752+0000","last_undegraded":"2024-09-17T03:46:36.842752+0000","last_fullsized":"2024-09-17T03:46:36.842752+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.15","version":"198'3","reported_seq":16,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884805+0000","last_change":"2024-09-17T03:46:37.857029+0000","last_active":"2024-09-17T03:46:38.884805+0000","last_peered":"2024-09-17T03:46:38.884805+0000","last_clean":"2024-09-17T03:46:38.884805+0000","last_became_active":"2024-09-17T03:46:37.856738+0000","last_became_peered":"2024-09-17T03:46:37.856738+0000","last_unstale":"2024-09-17T03:46:38.884805+0000","last_undegraded":"2024-09-17T03:46:38.884805+0000","last_fullsized":"2024-09-17T03:46:38.884805+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:01.595359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872102+0000","last_change":"2024-09-17T03:46:38.867964+0000","last_active":"2024-09-17T03:46:38.872102+0000","last_peered":"2024-09-17T03:46:38.872102+0000","last_clean":"2024-09-17T03:46:38.872102+0000","last_became_active":"2024-09-17T03:46:38.867541+0000","last_became_peered":"2024-09-17T03:46:38.867541+0000","last_unstale":"2024-09-17T03:46:38.872102+0000","last_undegraded":"2024-09-17T03:46:38.872102+0000","last_fullsized":"2024-09-17T03:46:38.872102+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:40.395914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.14","version":"198'6","reported_seq":19,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.886872+0000","last_change":"2024-09-17T03:46:37.861154+0000","last_active":"2024-09-17T03:46:38.886872+0000","last_peered":"2024-09-17T03:46:38.886872+0000","last_clean":"2024-09-17T03:46:38.886872+0000","last_became_active":"2024-09-17T03:46:37.860819+0000","last_became_peered":"2024-09-17T03:46:37.860819+0000","last_unstale":"2024-09-17T03:46:38.886872+0000","last_undegraded":"2024-09-17T03:46:38.886872+0000","last_fullsized":"2024-09-17T03:46:38.886872+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:33.736709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871744+0000","last_change":"2024-09-17T03:46:38.869534+0000","last_active":"2024-09-17T03:46:38.871744+0000","last_peered":"2024-09-17T03:46:38.871744+0000","last_clean":"2024-09-17T03:46:38.871744+0000","last_became_active":"2024-09-17T03:46:38.869205+0000","last_became_peered":"2024-09-17T03:46:38.869205+0000","last_unstale":"2024-09-17T03:46:38.871744+0000","last_undegraded":"2024-09-17T03:46:38.871744+0000","last_fullsized":"2024-09-17T03:46:38.871744+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:27.696745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.13","version":"198'2","reported_seq":15,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884557+0000","last_change":"2024-09-17T03:46:37.857360+0000","last_active":"2024-09-17T03:46:38.884557+0000","last_peered":"2024-09-17T03:46:38.884557+0000","last_clean":"2024-09-17T03:46:38.884557+0000","last_became_active":"2024-09-17T03:46:37.857041+0000","last_became_peered":"2024-09-17T03:46:37.857041+0000","last_unstale":"2024-09-17T03:46:38.884557+0000","last_undegraded":"2024-09-17T03:46:38.884557+0000","last_fullsized":"2024-09-17T03:46:38.884557+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:15.827164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868255+0000","last_change":"2024-09-17T03:46:38.866013+0000","last_active":"2024-09-17T03:46:38.868255+0000","last_peered":"2024-09-17T03:46:38.868255+0000","last_clean":"2024-09-17T03:46:38.868255+0000","last_became_active":"2024-09-17T03:46:38.865682+0000","last_became_peered":"2024-09-17T03:46:38.865682+0000","last_unstale":"2024-09-17T03:46:38.868255+0000","last_undegraded":"2024-09-17T03:46:38.868255+0000","last_fullsized":"2024-09-17T03:46:38.868255+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:53.452915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841916+0000","last_change":"2024-09-17T03:46:36.841916+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841916+0000","last_undegraded":"2024-09-17T03:46:36.841916+0000","last_fullsized":"2024-09-17T03:46:36.841916+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.877632+0000","last_change":"2024-09-17T03:46:38.876700+0000","last_active":"2024-09-17T03:46:38.877632+0000","last_peered":"2024-09-17T03:46:38.877632+0000","last_clean":"2024-09-17T03:46:38.877632+0000","last_became_active":"2024-09-17T03:46:38.876391+0000","last_became_peered":"2024-09-17T03:46:38.876391+0000","last_unstale":"2024-09-17T03:46:38.877632+0000","last_undegraded":"2024-09-17T03:46:38.877632+0000","last_fullsized":"2024-09-17T03:46:38.877632+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:42.280443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856153+0000","last_change":"2024-09-17T03:46:37.851640+0000","last_active":"2024-09-17T03:46:38.856153+0000","last_peered":"2024-09-17T03:46:38.856153+0000","last_clean":"2024-09-17T03:46:38.856153+0000","last_became_active":"2024-09-17T03:46:37.851293+0000","last_became_peered":"2024-09-17T03:46:37.851293+0000","last_unstale":"2024-09-17T03:46:38.856153+0000","last_undegraded":"2024-09-17T03:46:38.856153+0000","last_fullsized":"2024-09-17T03:46:38.856153+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:38.013751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873248+0000","last_change":"2024-09-17T03:46:38.872576+0000","last_active":"2024-09-17T03:46:38.873248+0000","last_peered":"2024-09-17T03:46:38.873248+0000","last_clean":"2024-09-17T03:46:38.873248+0000","last_became_active":"2024-09-17T03:46:38.872235+0000","last_became_peered":"2024-09-17T03:46:38.872235+0000","last_unstale":"2024-09-17T03:46:38.873248+0000","last_undegraded":"2024-09-17T03:46:38.873248+0000","last_fullsized":"2024-09-17T03:46:38.873248+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:22.527655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.10","version":"198'8","reported_seq":21,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883901+0000","last_change":"2024-09-17T03:46:37.859205+0000","last_active":"2024-09-17T03:46:38.883901+0000","last_peered":"2024-09-17T03:46:38.883901+0000","last_clean":"2024-09-17T03:46:38.883901+0000","last_became_active":"2024-09-17T03:46:37.858827+0000","last_became_peered":"2024-09-17T03:46:37.858827+0000","last_unstale":"2024-09-17T03:46:38.883901+0000","last_undegraded":"2024-09-17T03:46:38.883901+0000","last_fullsized":"2024-09-17T03:46:38.883901+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:52.447059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873714+0000","last_change":"2024-09-17T03:46:38.870343+0000","last_active":"2024-09-17T03:46:38.873714+0000","last_peered":"2024-09-17T03:46:38.873714+0000","last_clean":"2024-09-17T03:46:38.873714+0000","last_became_active":"2024-09-17T03:46:38.870050+0000","last_became_peered":"2024-09-17T03:46:38.870050+0000","last_unstale":"2024-09-17T03:46:38.873714+0000","last_undegraded":"2024-09-17T03:46:38.873714+0000","last_fullsized":"2024-09-17T03:46:38.873714+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:41.722010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.f","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879122+0000","last_change":"2024-09-17T03:46:37.856352+0000","last_active":"2024-09-17T03:46:38.879122+0000","last_peered":"2024-09-17T03:46:38.879122+0000","last_clean":"2024-09-17T03:46:38.879122+0000","last_became_active":"2024-09-17T03:46:37.855823+0000","last_became_peered":"2024-09-17T03:46:37.855823+0000","last_unstale":"2024-09-17T03:46:38.879122+0000","last_undegraded":"2024-09-17T03:46:38.879122+0000","last_fullsized":"2024-09-17T03:46:38.879122+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:32.853630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842235+0000","last_change":"2024-09-17T03:46:36.842235+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842235+0000","last_undegraded":"2024-09-17T03:46:36.842235+0000","last_fullsized":"2024-09-17T03:46:36.842235+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871988+0000","last_change":"2024-09-17T03:46:38.869114+0000","last_active":"2024-09-17T03:46:38.871988+0000","last_peered":"2024-09-17T03:46:38.871988+0000","last_clean":"2024-09-17T03:46:38.871988+0000","last_became_active":"2024-09-17T03:46:38.868763+0000","last_became_peered":"2024-09-17T03:46:38.868763+0000","last_unstale":"2024-09-17T03:46:38.871988+0000","last_undegraded":"2024-09-17T03:46:38.871988+0000","last_fullsized":"2024-09-17T03:46:38.871988+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:21.384878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.d","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.875112+0000","last_change":"2024-09-17T03:46:37.855339+0000","last_active":"2024-09-17T03:46:38.875112+0000","last_peered":"2024-09-17T03:46:38.875112+0000","last_clean":"2024-09-17T03:46:38.875112+0000","last_became_active":"2024-09-17T03:46:37.854766+0000","last_became_peered":"2024-09-17T03:46:37.854766+0000","last_unstale":"2024-09-17T03:46:38.875112+0000","last_undegraded":"2024-09-17T03:46:38.875112+0000","last_fullsized":"2024-09-17T03:46:38.875112+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:25.106006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.865023+0000","last_change":"2024-09-17T03:46:38.858260+0000","last_active":"2024-09-17T03:46:38.865023+0000","last_peered":"2024-09-17T03:46:38.865023+0000","last_clean":"2024-09-17T03:46:38.865023+0000","last_became_active":"2024-09-17T03:46:38.856652+0000","last_became_peered":"2024-09-17T03:46:38.856652+0000","last_unstale":"2024-09-17T03:46:38.865023+0000","last_undegraded":"2024-09-17T03:46:38.865023+0000","last_fullsized":"2024-09-17T03:46:38.865023+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:14.476439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856659+0000","last_change":"2024-09-17T03:46:37.858541+0000","last_active":"2024-09-17T03:46:38.856659+0000","last_peered":"2024-09-17T03:46:38.856659+0000","last_clean":"2024-09-17T03:46:38.856659+0000","last_became_active":"2024-09-17T03:46:37.857850+0000","last_became_peered":"2024-09-17T03:46:37.857850+0000","last_unstale":"2024-09-17T03:46:38.856659+0000","last_undegraded":"2024-09-17T03:46:38.856659+0000","last_fullsized":"2024-09-17T03:46:38.856659+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:06.112538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868122+0000","last_change":"2024-09-17T03:46:38.860988+0000","last_active":"2024-09-17T03:46:38.868122+0000","last_peered":"2024-09-17T03:46:38.868122+0000","last_clean":"2024-09-17T03:46:38.868122+0000","last_became_active":"2024-09-17T03:46:38.860657+0000","last_became_peered":"2024-09-17T03:46:38.860657+0000","last_unstale":"2024-09-17T03:46:38.868122+0000","last_undegraded":"2024-09-17T03:46:38.868122+0000","last_fullsized":"2024-09-17T03:46:38.868122+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:37.643112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842262+0000","last_change":"2024-09-17T03:46:36.842262+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842262+0000","last_undegraded":"2024-09-17T03:46:36.842262+0000","last_fullsized":"2024-09-17T03:46:36.842262+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873819+0000","last_change":"2024-09-17T03:46:38.872416+0000","last_active":"2024-09-17T03:46:38.873819+0000","last_peered":"2024-09-17T03:46:38.873819+0000","last_clean":"2024-09-17T03:46:38.873819+0000","last_became_active":"2024-09-17T03:46:38.872130+0000","last_became_peered":"2024-09-17T03:46:38.872130+0000","last_unstale":"2024-09-17T03:46:38.873819+0000","last_undegraded":"2024-09-17T03:46:38.873819+0000","last_fullsized":"2024-09-17T03:46:38.873819+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:12.680228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856452+0000","last_change":"2024-09-17T03:46:37.856091+0000","last_active":"2024-09-17T03:46:38.856452+0000","last_peered":"2024-09-17T03:46:38.856452+0000","last_clean":"2024-09-17T03:46:38.856452+0000","last_became_active":"2024-09-17T03:46:37.855774+0000","last_became_peered":"2024-09-17T03:46:37.855774+0000","last_unstale":"2024-09-17T03:46:38.856452+0000","last_undegraded":"2024-09-17T03:46:38.856452+0000","last_fullsized":"2024-09-17T03:46:38.856452+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:20.379023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.881413+0000","last_change":"2024-09-17T03:46:38.872310+0000","last_active":"2024-09-17T03:46:38.881413+0000","last_peered":"2024-09-17T03:46:38.881413+0000","last_clean":"2024-09-17T03:46:38.881413+0000","last_became_active":"2024-09-17T03:46:38.871997+0000","last_became_peered":"2024-09-17T03:46:38.871997+0000","last_unstale":"2024-09-17T03:46:38.881413+0000","last_undegraded":"2024-09-17T03:46:38.881413+0000","last_fullsized":"2024-09-17T03:46:38.881413+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:21.541289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.858485+0000","last_change":"2024-09-17T03:46:37.855038+0000","last_active":"2024-09-17T03:46:38.858485+0000","last_peered":"2024-09-17T03:46:38.858485+0000","last_clean":"2024-09-17T03:46:38.858485+0000","last_became_active":"2024-09-17T03:46:37.854645+0000","last_became_peered":"2024-09-17T03:46:37.854645+0000","last_unstale":"2024-09-17T03:46:38.858485+0000","last_undegraded":"2024-09-17T03:46:38.858485+0000","last_fullsized":"2024-09-17T03:46:38.858485+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:09.904657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.857199+0000","last_change":"2024-09-17T03:46:38.855559+0000","last_active":"2024-09-17T03:46:38.857199+0000","last_peered":"2024-09-17T03:46:38.857199+0000","last_clean":"2024-09-17T03:46:38.857199+0000","last_became_active":"2024-09-17T03:46:38.855179+0000","last_became_peered":"2024-09-17T03:46:38.855179+0000","last_unstale":"2024-09-17T03:46:38.857199+0000","last_undegraded":"2024-09-17T03:46:38.857199+0000","last_fullsized":"2024-09-17T03:46:38.857199+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:30.305040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.854811+0000","last_change":"2024-09-17T03:46:37.850967+0000","last_active":"2024-09-17T03:46:38.854811+0000","last_peered":"2024-09-17T03:46:38.854811+0000","last_clean":"2024-09-17T03:46:38.854811+0000","last_became_active":"2024-09-17T03:46:37.849133+0000","last_became_peered":"2024-09-17T03:46:37.849133+0000","last_unstale":"2024-09-17T03:46:38.854811+0000","last_undegraded":"2024-09-17T03:46:38.854811+0000","last_fullsized":"2024-09-17T03:46:38.854811+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:27.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.867364+0000","last_change":"2024-09-17T03:46:38.864300+0000","last_active":"2024-09-17T03:46:38.867364+0000","last_peered":"2024-09-17T03:46:38.867364+0000","last_clean":"2024-09-17T03:46:38.867364+0000","last_became_active":"2024-09-17T03:46:38.863911+0000","last_became_peered":"2024-09-17T03:46:38.863911+0000","last_unstale":"2024-09-17T03:46:38.867364+0000","last_undegraded":"2024-09-17T03:46:38.867364+0000","last_fullsized":"2024-09-17T03:46:38.867364+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:24.794528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.7","version":"198'2","reported_seq":15,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878231+0000","last_change":"2024-09-17T03:46:37.861906+0000","last_active":"2024-09-17T03:46:38.878231+0000","last_peered":"2024-09-17T03:46:38.878231+0000","last_clean":"2024-09-17T03:46:38.878231+0000","last_became_active":"2024-09-17T03:46:37.861585+0000","last_became_peered":"2024-09-17T03:46:37.861585+0000","last_unstale":"2024-09-17T03:46:38.878231+0000","last_undegraded":"2024-09-17T03:46:38.878231+0000","last_fullsized":"2024-09-17T03:46:38.878231+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:21.971121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.885637+0000","last_change":"2024-09-17T03:46:38.884951+0000","last_active":"2024-09-17T03:46:38.885637+0000","last_peered":"2024-09-17T03:46:38.885637+0000","last_clean":"2024-09-17T03:46:38.885637+0000","last_became_active":"2024-09-17T03:46:38.884466+0000","last_became_peered":"2024-09-17T03:46:38.884466+0000","last_unstale":"2024-09-17T03:46:38.885637+0000","last_undegraded":"2024-09-17T03:46:38.885637+0000","last_fullsized":"2024-09-17T03:46:38.885637+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:11.881066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.842859+0000","last_change":"2024-09-17T03:46:36.842859+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.842859+0000","last_undegraded":"2024-09-17T03:46:36.842859+0000","last_fullsized":"2024-09-17T03:46:36.842859+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.881353+0000","last_change":"2024-09-17T03:46:38.873157+0000","last_active":"2024-09-17T03:46:38.881353+0000","last_peered":"2024-09-17T03:46:38.881353+0000","last_clean":"2024-09-17T03:46:38.881353+0000","last_became_active":"2024-09-17T03:46:38.871901+0000","last_became_peered":"2024-09-17T03:46:38.871901+0000","last_unstale":"2024-09-17T03:46:38.881353+0000","last_undegraded":"2024-09-17T03:46:38.881353+0000","last_fullsized":"2024-09-17T03:46:38.881353+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:38.788056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.858748+0000","last_change":"2024-09-17T03:46:37.856607+0000","last_active":"2024-09-17T03:46:38.858748+0000","last_peered":"2024-09-17T03:46:38.858748+0000","last_clean":"2024-09-17T03:46:38.858748+0000","last_became_active":"2024-09-17T03:46:37.856210+0000","last_became_peered":"2024-09-17T03:46:37.856210+0000","last_unstale":"2024-09-17T03:46:38.858748+0000","last_undegraded":"2024-09-17T03:46:38.858748+0000","last_fullsized":"2024-09-17T03:46:38.858748+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.093398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873039+0000","last_change":"2024-09-17T03:46:38.858182+0000","last_active":"2024-09-17T03:46:38.873039+0000","last_peered":"2024-09-17T03:46:38.873039+0000","last_clean":"2024-09-17T03:46:38.873039+0000","last_became_active":"2024-09-17T03:46:38.857886+0000","last_became_peered":"2024-09-17T03:46:38.857886+0000","last_unstale":"2024-09-17T03:46:38.873039+0000","last_undegraded":"2024-09-17T03:46:38.873039+0000","last_fullsized":"2024-09-17T03:46:38.873039+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:35.037081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856707+0000","last_change":"2024-09-17T03:46:37.860656+0000","last_active":"2024-09-17T03:46:38.856707+0000","last_peered":"2024-09-17T03:46:38.856707+0000","last_clean":"2024-09-17T03:46:38.856707+0000","last_became_active":"2024-09-17T03:46:37.860363+0000","last_became_peered":"2024-09-17T03:46:37.860363+0000","last_unstale":"2024-09-17T03:46:38.856707+0000","last_undegraded":"2024-09-17T03:46:38.856707+0000","last_fullsized":"2024-09-17T03:46:38.856707+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:51.416909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871718+0000","last_change":"2024-09-17T03:46:38.869909+0000","last_active":"2024-09-17T03:46:38.871718+0000","last_peered":"2024-09-17T03:46:38.871718+0000","last_clean":"2024-09-17T03:46:38.871718+0000","last_became_active":"2024-09-17T03:46:38.869591+0000","last_became_peered":"2024-09-17T03:46:38.869591+0000","last_unstale":"2024-09-17T03:46:38.871718+0000","last_undegraded":"2024-09-17T03:46:38.871718+0000","last_fullsized":"2024-09-17T03:46:38.871718+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:11.881066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.859758+0000","last_change":"2024-09-17T03:46:37.858101+0000","last_active":"2024-09-17T03:46:38.859758+0000","last_peered":"2024-09-17T03:46:38.859758+0000","last_clean":"2024-09-17T03:46:38.859758+0000","last_became_active":"2024-09-17T03:46:37.857577+0000","last_became_peered":"2024-09-17T03:46:37.857577+0000","last_unstale":"2024-09-17T03:46:38.859758+0000","last_undegraded":"2024-09-17T03:46:38.859758+0000","last_fullsized":"2024-09-17T03:46:38.859758+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:58.497943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868076+0000","last_change":"2024-09-17T03:46:38.861305+0000","last_active":"2024-09-17T03:46:38.868076+0000","last_peered":"2024-09-17T03:46:38.868076+0000","last_clean":"2024-09-17T03:46:38.868076+0000","last_became_active":"2024-09-17T03:46:38.860980+0000","last_became_peered":"2024-09-17T03:46:38.860980+0000","last_unstale":"2024-09-17T03:46:38.868076+0000","last_undegraded":"2024-09-17T03:46:38.868076+0000","last_fullsized":"2024-09-17T03:46:38.868076+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:47.778627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.850086+0000","last_change":"2024-09-17T03:46:37.861053+0000","last_active":"2024-09-17T03:46:38.850086+0000","last_peered":"2024-09-17T03:46:38.850086+0000","last_clean":"2024-09-17T03:46:38.850086+0000","last_became_active":"2024-09-17T03:46:37.860753+0000","last_became_peered":"2024-09-17T03:46:37.860753+0000","last_unstale":"2024-09-17T03:46:38.850086+0000","last_undegraded":"2024-09-17T03:46:38.850086+0000","last_fullsized":"2024-09-17T03:46:38.850086+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:48.523839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871032+0000","last_change":"2024-09-17T03:46:38.865353+0000","last_active":"2024-09-17T03:46:38.871032+0000","last_peered":"2024-09-17T03:46:38.871032+0000","last_clean":"2024-09-17T03:46:38.871032+0000","last_became_active":"2024-09-17T03:46:38.864736+0000","last_became_peered":"2024-09-17T03:46:38.864736+0000","last_unstale":"2024-09-17T03:46:38.871032+0000","last_undegraded":"2024-09-17T03:46:38.871032+0000","last_fullsized":"2024-09-17T03:46:38.871032+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:08.952464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.840913+0000","last_change":"2024-09-17T03:46:36.840913+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.840913+0000","last_undegraded":"2024-09-17T03:46:36.840913+0000","last_fullsized":"2024-09-17T03:46:36.840913+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884678+0000","last_change":"2024-09-17T03:46:38.882784+0000","last_active":"2024-09-17T03:46:38.884678+0000","last_peered":"2024-09-17T03:46:38.884678+0000","last_clean":"2024-09-17T03:46:38.884678+0000","last_became_active":"2024-09-17T03:46:38.882232+0000","last_became_peered":"2024-09-17T03:46:38.882232+0000","last_unstale":"2024-09-17T03:46:38.884678+0000","last_undegraded":"2024-09-17T03:46:38.884678+0000","last_fullsized":"2024-09-17T03:46:38.884678+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:27.696745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.840592+0000","last_change":"2024-09-17T03:46:36.840592+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.840592+0000","last_undegraded":"2024-09-17T03:46:36.840592+0000","last_fullsized":"2024-09-17T03:46:36.840592+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:46:37.834370+0000","last_change":"2024-09-17T03:46:37.834370+0000","last_active":"2024-09-17T03:46:37.834370+0000","last_peered":"2024-09-17T03:46:37.834370+0000","last_clean":"2024-09-17T03:46:37.834370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:37.834370+0000","last_undegraded":"2024-09-17T03:46:37.834370+0000","last_fullsized":"2024-09-17T03:46:37.834370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":1,"reported_epoch":196,"state":"creating+peering","last_fresh":"2024-09-17T03:46:36.841813+0000","last_change":"2024-09-17T03:46:36.841813+0000","last_active":"2024-09-17T03:46:36.828514+0000","last_peered":"2024-09-17T03:46:36.828514+0000","last_clean":"2024-09-17T03:46:36.828514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:46:36.841813+0000","last_undegraded":"2024-09-17T03:46:36.841813+0000","last_fullsized":"2024-09-17T03:46:36.841813+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":436,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856745+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:46:38.856745+0000","last_peered":"2024-09-17T03:46:38.856745+0000","last_clean":"2024-09-17T03:46:38.856745+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:46:38.856745+0000","last_undegraded":"2024-09-17T03:46:38.856745+0000","last_fullsized":"2024-09-17T03:46:38.856745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":6},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509610,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60588,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311252,"statfs":{"total":96636764160,"available":96574722048,"internally_reserved":0,"allocated":3096576,"data_stored":1689513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509610,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60012,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311828,"statfs":{"total":96636764160,"available":96575311872,"internally_reserved":0,"allocated":2506752,"data_stored":1099679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509610,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65524,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306316,"statfs":{"total":96636764160,"available":96569667584,"internally_reserved":0,"allocated":2519040,"data_stored":1100779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509610,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55844,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315996,"statfs":{"total":96636764160,"available":96579579904,"internally_reserved":0,"allocated":2502656,"data_stored":1099165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509611,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59992,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311848,"statfs":{"total":96636764160,"available":96575332352,"internally_reserved":0,"allocated":2486272,"data_stored":1092300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509611,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56428,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315412,"statfs":{"total":96636764160,"available":96578981888,"internally_reserved":0,"allocated":3096576,"data_stored":1689477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575017,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55820,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316020,"statfs":{"total":96636764160,"available":96579604480,"internally_reserved":0,"allocated":2473984,"data_stored":1086025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575017,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59980,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311860,"statfs":{"total":96636764160,"available":96575344640,"internally_reserved":0,"allocated":2473984,"data_stored":1086025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:46:43.622 INFO:tasks.ceph.ceph_manager.ceph:PG 31.3d is not active+clean 2024-09-17T03:46:43.622 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '31.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:46:37.834370+0000', 'last_change': '2024-09-17T03:46:37.834370+0000', 'last_active': '2024-09-17T03:46:37.834370+0000', 'last_peered': '2024-09-17T03:46:37.834370+0000', 'last_clean': '2024-09-17T03:46:37.834370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:37.834370+0000', 'last_undegraded': '2024-09-17T03:46:37.834370+0000', 'last_fullsized': '2024-09-17T03:46:37.834370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:46:43.622 INFO:tasks.ceph.ceph_manager.ceph:PG 31.3b is not active+clean 2024-09-17T03:46:43.622 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '31.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:46:37.834370+0000', 'last_change': '2024-09-17T03:46:37.834370+0000', 'last_active': '2024-09-17T03:46:37.834370+0000', 'last_peered': '2024-09-17T03:46:37.834370+0000', 'last_clean': '2024-09-17T03:46:37.834370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:37.834370+0000', 'last_undegraded': '2024-09-17T03:46:37.834370+0000', 'last_fullsized': '2024-09-17T03:46:37.834370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:46:43.623 INFO:tasks.ceph.ceph_manager.ceph:PG 31.30 is not active+clean 2024-09-17T03:46:43.623 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '31.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:46:37.834370+0000', 'last_change': '2024-09-17T03:46:37.834370+0000', 'last_active': '2024-09-17T03:46:37.834370+0000', 'last_peered': '2024-09-17T03:46:37.834370+0000', 'last_clean': '2024-09-17T03:46:37.834370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:37.834370+0000', 'last_undegraded': '2024-09-17T03:46:37.834370+0000', 'last_fullsized': '2024-09-17T03:46:37.834370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:46:43.623 INFO:tasks.ceph.ceph_manager.ceph:PG 31.2c is not active+clean 2024-09-17T03:46:43.623 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '31.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:46:37.834370+0000', 'last_change': '2024-09-17T03:46:37.834370+0000', 'last_active': '2024-09-17T03:46:37.834370+0000', 'last_peered': '2024-09-17T03:46:37.834370+0000', 'last_clean': '2024-09-17T03:46:37.834370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:37.834370+0000', 'last_undegraded': '2024-09-17T03:46:37.834370+0000', 'last_fullsized': '2024-09-17T03:46:37.834370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:46:43.623 INFO:tasks.ceph.ceph_manager.ceph:PG 31.22 is not active+clean 2024-09-17T03:46:43.623 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '31.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:46:37.834370+0000', 'last_change': '2024-09-17T03:46:37.834370+0000', 'last_active': '2024-09-17T03:46:37.834370+0000', 'last_peered': '2024-09-17T03:46:37.834370+0000', 'last_clean': '2024-09-17T03:46:37.834370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:37.834370+0000', 'last_undegraded': '2024-09-17T03:46:37.834370+0000', 'last_fullsized': '2024-09-17T03:46:37.834370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:46:43.623 INFO:tasks.ceph.ceph_manager.ceph:PG 31.1f is not active+clean 2024-09-17T03:46:43.623 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '31.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:46:37.834370+0000', 'last_change': '2024-09-17T03:46:37.834370+0000', 'last_active': '2024-09-17T03:46:37.834370+0000', 'last_peered': '2024-09-17T03:46:37.834370+0000', 'last_clean': '2024-09-17T03:46:37.834370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:37.834370+0000', 'last_undegraded': '2024-09-17T03:46:37.834370+0000', 'last_fullsized': '2024-09-17T03:46:37.834370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:46:43.623 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1d is not active+clean 2024-09-17T03:46:43.623 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 196, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:46:36.841827+0000', 'last_change': '2024-09-17T03:46:36.841827+0000', 'last_active': '2024-09-17T03:46:36.828514+0000', 'last_peered': '2024-09-17T03:46:36.828514+0000', 'last_clean': '2024-09-17T03:46:36.828514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:36.841827+0000', 'last_undegraded': '2024-09-17T03:46:36.841827+0000', 'last_fullsized': '2024-09-17T03:46:36.841827+0000', 'mapping_epoch': 196, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 196, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:46:43.623 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1c is not active+clean 2024-09-17T03:46:43.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 196, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:46:36.843011+0000', 'last_change': '2024-09-17T03:46:36.843011+0000', 'last_active': '2024-09-17T03:46:36.828514+0000', 'last_peered': '2024-09-17T03:46:36.828514+0000', 'last_clean': '2024-09-17T03:46:36.828514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:36.843011+0000', 'last_undegraded': '2024-09-17T03:46:36.843011+0000', 'last_fullsized': '2024-09-17T03:46:36.843011+0000', 'mapping_epoch': 196, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 196, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:46:43.624 INFO:tasks.ceph.ceph_manager.ceph:PG 31.18 is not active+clean 2024-09-17T03:46:43.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '31.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:46:37.834370+0000', 'last_change': '2024-09-17T03:46:37.834370+0000', 'last_active': '2024-09-17T03:46:37.834370+0000', 'last_peered': '2024-09-17T03:46:37.834370+0000', 'last_clean': '2024-09-17T03:46:37.834370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:37.834370+0000', 'last_undegraded': '2024-09-17T03:46:37.834370+0000', 'last_fullsized': '2024-09-17T03:46:37.834370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:46:43.624 INFO:tasks.ceph.ceph_manager.ceph:PG 30.18 is not active+clean 2024-09-17T03:46:43.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 196, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:46:36.841994+0000', 'last_change': '2024-09-17T03:46:36.841994+0000', 'last_active': '2024-09-17T03:46:36.828514+0000', 'last_peered': '2024-09-17T03:46:36.828514+0000', 'last_clean': '2024-09-17T03:46:36.828514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:36.841994+0000', 'last_undegraded': '2024-09-17T03:46:36.841994+0000', 'last_fullsized': '2024-09-17T03:46:36.841994+0000', 'mapping_epoch': 196, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 196, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:46:43.624 INFO:tasks.ceph.ceph_manager.ceph:PG 30.16 is not active+clean 2024-09-17T03:46:43.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 196, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:46:36.842752+0000', 'last_change': '2024-09-17T03:46:36.842752+0000', 'last_active': '2024-09-17T03:46:36.828514+0000', 'last_peered': '2024-09-17T03:46:36.828514+0000', 'last_clean': '2024-09-17T03:46:36.828514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:36.842752+0000', 'last_undegraded': '2024-09-17T03:46:36.842752+0000', 'last_fullsized': '2024-09-17T03:46:36.842752+0000', 'mapping_epoch': 196, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 196, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:46:43.624 INFO:tasks.ceph.ceph_manager.ceph:PG 31.14 is not active+clean 2024-09-17T03:46:43.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '31.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:46:37.834370+0000', 'last_change': '2024-09-17T03:46:37.834370+0000', 'last_active': '2024-09-17T03:46:37.834370+0000', 'last_peered': '2024-09-17T03:46:37.834370+0000', 'last_clean': '2024-09-17T03:46:37.834370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:37.834370+0000', 'last_undegraded': '2024-09-17T03:46:37.834370+0000', 'last_fullsized': '2024-09-17T03:46:37.834370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:46:43.624 INFO:tasks.ceph.ceph_manager.ceph:PG 30.12 is not active+clean 2024-09-17T03:46:43.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 196, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:46:36.841916+0000', 'last_change': '2024-09-17T03:46:36.841916+0000', 'last_active': '2024-09-17T03:46:36.828514+0000', 'last_peered': '2024-09-17T03:46:36.828514+0000', 'last_clean': '2024-09-17T03:46:36.828514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:36.841916+0000', 'last_undegraded': '2024-09-17T03:46:36.841916+0000', 'last_fullsized': '2024-09-17T03:46:36.841916+0000', 'mapping_epoch': 196, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 196, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:46:43.625 INFO:tasks.ceph.ceph_manager.ceph:PG 31.f is not active+clean 2024-09-17T03:46:43.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '31.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:46:37.834370+0000', 'last_change': '2024-09-17T03:46:37.834370+0000', 'last_active': '2024-09-17T03:46:37.834370+0000', 'last_peered': '2024-09-17T03:46:37.834370+0000', 'last_clean': '2024-09-17T03:46:37.834370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:37.834370+0000', 'last_undegraded': '2024-09-17T03:46:37.834370+0000', 'last_fullsized': '2024-09-17T03:46:37.834370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:46:43.625 INFO:tasks.ceph.ceph_manager.ceph:PG 30.e is not active+clean 2024-09-17T03:46:43.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 196, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:46:36.842235+0000', 'last_change': '2024-09-17T03:46:36.842235+0000', 'last_active': '2024-09-17T03:46:36.828514+0000', 'last_peered': '2024-09-17T03:46:36.828514+0000', 'last_clean': '2024-09-17T03:46:36.828514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:36.842235+0000', 'last_undegraded': '2024-09-17T03:46:36.842235+0000', 'last_fullsized': '2024-09-17T03:46:36.842235+0000', 'mapping_epoch': 196, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 196, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:46:43.625 INFO:tasks.ceph.ceph_manager.ceph:PG 30.b is not active+clean 2024-09-17T03:46:43.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 196, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:46:36.842262+0000', 'last_change': '2024-09-17T03:46:36.842262+0000', 'last_active': '2024-09-17T03:46:36.828514+0000', 'last_peered': '2024-09-17T03:46:36.828514+0000', 'last_clean': '2024-09-17T03:46:36.828514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:36.842262+0000', 'last_undegraded': '2024-09-17T03:46:36.842262+0000', 'last_fullsized': '2024-09-17T03:46:36.842262+0000', 'mapping_epoch': 196, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 196, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:46:43.625 INFO:tasks.ceph.ceph_manager.ceph:PG 30.6 is not active+clean 2024-09-17T03:46:43.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 196, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:46:36.842859+0000', 'last_change': '2024-09-17T03:46:36.842859+0000', 'last_active': '2024-09-17T03:46:36.828514+0000', 'last_peered': '2024-09-17T03:46:36.828514+0000', 'last_clean': '2024-09-17T03:46:36.828514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:36.842859+0000', 'last_undegraded': '2024-09-17T03:46:36.842859+0000', 'last_fullsized': '2024-09-17T03:46:36.842859+0000', 'mapping_epoch': 196, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 196, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:46:43.625 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1 is not active+clean 2024-09-17T03:46:43.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 196, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:46:36.840913+0000', 'last_change': '2024-09-17T03:46:36.840913+0000', 'last_active': '2024-09-17T03:46:36.828514+0000', 'last_peered': '2024-09-17T03:46:36.828514+0000', 'last_clean': '2024-09-17T03:46:36.828514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:36.840913+0000', 'last_undegraded': '2024-09-17T03:46:36.840913+0000', 'last_fullsized': '2024-09-17T03:46:36.840913+0000', 'mapping_epoch': 196, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 196, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:46:43.626 INFO:tasks.ceph.ceph_manager.ceph:PG 30.0 is not active+clean 2024-09-17T03:46:43.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 196, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:46:36.840592+0000', 'last_change': '2024-09-17T03:46:36.840592+0000', 'last_active': '2024-09-17T03:46:36.828514+0000', 'last_peered': '2024-09-17T03:46:36.828514+0000', 'last_clean': '2024-09-17T03:46:36.828514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:36.840592+0000', 'last_undegraded': '2024-09-17T03:46:36.840592+0000', 'last_fullsized': '2024-09-17T03:46:36.840592+0000', 'mapping_epoch': 196, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 196, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:46:43.626 INFO:tasks.ceph.ceph_manager.ceph:PG 31.1e is not active+clean 2024-09-17T03:46:43.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '31.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:46:37.834370+0000', 'last_change': '2024-09-17T03:46:37.834370+0000', 'last_active': '2024-09-17T03:46:37.834370+0000', 'last_peered': '2024-09-17T03:46:37.834370+0000', 'last_clean': '2024-09-17T03:46:37.834370+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:37.834370+0000', 'last_undegraded': '2024-09-17T03:46:37.834370+0000', 'last_fullsized': '2024-09-17T03:46:37.834370+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:37.834370+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:46:43.626 INFO:tasks.ceph.ceph_manager.ceph:PG 30.1f is not active+clean 2024-09-17T03:46:43.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '30.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 196, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:46:36.841813+0000', 'last_change': '2024-09-17T03:46:36.841813+0000', 'last_active': '2024-09-17T03:46:36.828514+0000', 'last_peered': '2024-09-17T03:46:36.828514+0000', 'last_clean': '2024-09-17T03:46:36.828514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:46:36.841813+0000', 'last_undegraded': '2024-09-17T03:46:36.841813+0000', 'last_fullsized': '2024-09-17T03:46:36.841813+0000', 'mapping_epoch': 196, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 196, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'last_clean_scrub_stamp': '2024-09-17T03:46:36.828514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:46:43.626 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:46:43.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.772+0000 7fe1fe139640 1 -- 172.21.15.146:0/3439985004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1f80d2800 msgr2=0x7fe1f80d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.772+0000 7fe1fe139640 1 --2- 172.21.15.146:0/3439985004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1f80d2800 0x7fe1f80d1300 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8005fd0 tx=0x7fe1e802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.772+0000 7fe1fe139640 1 -- 172.21.15.146:0/3439985004 shutdown_connections 2024-09-17T03:46:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.772+0000 7fe1fe139640 1 --2- 172.21.15.146:0/3439985004 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f80d4420 0x7fe1f80d1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.772+0000 7fe1fe139640 1 --2- 172.21.15.146:0/3439985004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1f80d2800 0x7fe1f80d1300 unknown :-1 s=CLOSED pgs=2570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.772+0000 7fe1fe139640 1 -- 172.21.15.146:0/3439985004 >> 172.21.15.146:0/3439985004 conn(0x7fe1f806ecd0 msgr2=0x7fe1f806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.772+0000 7fe1fe139640 1 -- 172.21.15.146:0/3439985004 shutdown_connections 2024-09-17T03:46:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.772+0000 7fe1fe139640 1 -- 172.21.15.146:0/3439985004 wait complete. 2024-09-17T03:46:43.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.773+0000 7fe1fe139640 1 Processor -- start 2024-09-17T03:46:43.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.774+0000 7fe1fe139640 1 -- start start 2024-09-17T03:46:43.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1fe139640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f80cf150 0x7fe1f814cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1fe139640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1f80d2800 0x7fe1f814f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1fe139640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f80d4420 0x7fe1f814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1fe139640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f80b6a80 con 0x7fe1f80d2800 2024-09-17T03:46:43.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1fe139640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f815f110 con 0x7fe1f80cf150 2024-09-17T03:46:43.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1fe139640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f80b6c00 con 0x7fe1f80d4420 2024-09-17T03:46:43.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1f6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1f80d2800 0x7fe1f814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1f6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1f80d2800 0x7fe1f814f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38750/0 (socket says 172.21.15.146:38750) 2024-09-17T03:46:43.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1f6ffd640 1 -- 172.21.15.146:0/4030361866 learned_addr learned my addr 172.21.15.146:0/4030361866 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:43.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1f77fe640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f80cf150 0x7fe1f814cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1f7fff640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f80d4420 0x7fe1f814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1f6ffd640 1 -- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f80d4420 msgr2=0x7fe1f814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1f6ffd640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f80d4420 0x7fe1f814f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1f6ffd640 1 -- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f80cf150 msgr2=0x7fe1f814cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:43.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1f6ffd640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f80cf150 0x7fe1f814cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:43.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1f6ffd640 1 -- 172.21.15.146:0/4030361866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f814d430 con 0x7fe1f80d2800 2024-09-17T03:46:43.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.775+0000 7fe1f6ffd640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1f80d2800 0x7fe1f814f420 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00c370 tx=0x7fe1ec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:43.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.776+0000 7fe1dffff640 1 -- 172.21.15.146:0/4030361866 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec0052d0 con 0x7fe1f80d2800 2024-09-17T03:46:43.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.776+0000 7fe1dffff640 1 -- 172.21.15.146:0/4030361866 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1ec007020 con 0x7fe1f80d2800 2024-09-17T03:46:43.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.776+0000 7fe1fe139640 1 -- 172.21.15.146:0/4030361866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f814d0a0 con 0x7fe1f80d2800 2024-09-17T03:46:43.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.776+0000 7fe1dffff640 1 -- 172.21.15.146:0/4030361866 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec007470 con 0x7fe1f80d2800 2024-09-17T03:46:43.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.776+0000 7fe1fe139640 1 -- 172.21.15.146:0/4030361866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f814d980 con 0x7fe1f80d2800 2024-09-17T03:46:43.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.777+0000 7fe1fe139640 1 -- 172.21.15.146:0/4030361866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f80caaa0 con 0x7fe1f80d2800 2024-09-17T03:46:43.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.777+0000 7fe1dffff640 1 -- 172.21.15.146:0/4030361866 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1ec0067d0 con 0x7fe1f80d2800 2024-09-17T03:46:43.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.778+0000 7fe1dffff640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1e4078b90 0x7fe1e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:43.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.778+0000 7fe1dffff640 1 -- 172.21.15.146:0/4030361866 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7fe1ec09a250 con 0x7fe1f80d2800 2024-09-17T03:46:43.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.778+0000 7fe1f77fe640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1e4078b90 0x7fe1e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:43.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.779+0000 7fe1f77fe640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1e4078b90 0x7fe1e407b0a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8033000 tx=0x7fe1e8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:43.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:43.783+0000 7fe1dffff640 1 -- 172.21.15.146:0/4030361866 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe1ec062690 con 0x7fe1f80d2800 2024-09-17T03:46:44.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.027+0000 7fe1fe139640 1 -- 172.21.15.146:0/4030361866 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe1f80b6370 con 0x7fe1f80d2800 2024-09-17T03:46:44.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.028+0000 7fe1dffff640 1 -- 172.21.15.146:0/4030361866 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1513 (secure 0 0 0) 0x7fe1ec061f90 con 0x7fe1f80d2800 2024-09-17T03:46:44.028 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:44.028 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":848,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":199,"num_osds":8,"num_up_osds":8,"osd_up_since":1726543968,"num_in_osds":8,"osd_in_since":1726543959,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":76},{"state_name":"creating+peering","count":11},{"state_name":"unknown","count":10}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":592196,"bytes_used":485568512,"bytes_avail":772608544768,"bytes_total":773094113280,"unknown_pgs_ratio":0.10309278219938278,"inactive_pgs_ratio":0.11340206116437912,"write_bytes_sec":2572,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":154,"btime":"2024-09-17T03:46:41:868652+0000","id":15,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":15,"rank":0,"name":"c","status":"up:active","gid":11496}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":38,"modified":"2024-09-17T03:46:32.008800+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:46:44.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 -- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1e4078b90 msgr2=0x7fe1e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:44.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1e4078b90 0x7fe1e407b0a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8033000 tx=0x7fe1e8004730 comp rx=0 tx=0).stop 2024-09-17T03:46:44.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 -- 172.21.15.146:0/4030361866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1f80d2800 msgr2=0x7fe1f814f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:44.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1f80d2800 0x7fe1f814f420 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00c370 tx=0x7fe1ec00c830 comp rx=0 tx=0).stop 2024-09-17T03:46:44.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 -- 172.21.15.146:0/4030361866 shutdown_connections 2024-09-17T03:46:44.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe1e4078b90 0x7fe1e407b0a0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1f80d4420 0x7fe1f814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1f80d2800 0x7fe1f814f420 unknown :-1 s=CLOSED pgs=2571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 --2- 172.21.15.146:0/4030361866 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1f80cf150 0x7fe1f814cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 -- 172.21.15.146:0/4030361866 >> 172.21.15.146:0/4030361866 conn(0x7fe1f806ecd0 msgr2=0x7fe1f806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:44.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 -- 172.21.15.146:0/4030361866 shutdown_connections 2024-09-17T03:46:44.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.030+0000 7fe1fe139640 1 -- 172.21.15.146:0/4030361866 wait complete. 2024-09-17T03:46:44.042 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:46:44.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:46:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.154+0000 7f11931e6640 1 -- 172.21.15.146:0/2359637586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118c0cd660 msgr2=0x7f118c0cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.154+0000 7f11931e6640 1 --2- 172.21.15.146:0/2359637586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118c0cd660 0x7f118c0cda70 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7f118c073fe0 tx=0x7f117c02a560 comp rx=0 tx=0).stop 2024-09-17T03:46:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.154+0000 7f11931e6640 1 -- 172.21.15.146:0/2359637586 shutdown_connections 2024-09-17T03:46:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.154+0000 7f11931e6640 1 --2- 172.21.15.146:0/2359637586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118c0cd660 0x7f118c0cda70 unknown :-1 s=CLOSED pgs=2572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.154+0000 7f11931e6640 1 --2- 172.21.15.146:0/2359637586 >> v2:172.21.15.179:3300/0 conn(0x7f118c0b1c20 0x7f118c0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.155+0000 7f11931e6640 1 -- 172.21.15.146:0/2359637586 >> 172.21.15.146:0/2359637586 conn(0x7f118c0d2650 msgr2=0x7f118c0d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:44.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.155+0000 7f11931e6640 1 -- 172.21.15.146:0/2359637586 shutdown_connections 2024-09-17T03:46:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.155+0000 7f11931e6640 1 -- 172.21.15.146:0/2359637586 wait complete. 2024-09-17T03:46:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.156+0000 7f11931e6640 1 Processor -- start 2024-09-17T03:46:44.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.156+0000 7f11931e6640 1 -- start start 2024-09-17T03:46:44.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f11931e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f118c0b1c20 0x7f118c156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:44.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f11931e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118c0cd660 0x7f118c0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:44.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f11931e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f118c0cedc0 0x7f118c0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:44.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f11931e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f118c0cf8e0 con 0x7f118c0cd660 2024-09-17T03:46:44.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f11931e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f118c071fd0 con 0x7f118c0cedc0 2024-09-17T03:46:44.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f11931e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f118c0cfa60 con 0x7f118c0b1c20 2024-09-17T03:46:44.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f1183fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118c0cd660 0x7f118c0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f1183fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118c0cd660 0x7f118c0b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38772/0 (socket says 172.21.15.146:38772) 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f1183fff640 1 -- 172.21.15.146:0/2419570380 learned_addr learned my addr 172.21.15.146:0/2419570380 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f1190f82640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f118c0b1c20 0x7f118c156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f1191783640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f118c0cedc0 0x7f118c0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f1183fff640 1 -- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f118c0b1c20 msgr2=0x7f118c156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f1183fff640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f118c0b1c20 0x7f118c156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f1183fff640 1 -- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f118c0cedc0 msgr2=0x7f118c0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f1183fff640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f118c0cedc0 0x7f118c0b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f1183fff640 1 -- 172.21.15.146:0/2419570380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c0cadb0 con 0x7f118c0cd660 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.158+0000 7f1183fff640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118c0cd660 0x7f118c0b3680 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7f117c034040 tx=0x7f117c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.159+0000 7f11817fa640 1 -- 172.21.15.146:0/2419570380 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c03e030 con 0x7f118c0cd660 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.159+0000 7f11817fa640 1 -- 172.21.15.146:0/2419570380 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f117c003e00 con 0x7f118c0cd660 2024-09-17T03:46:44.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.159+0000 7f11931e6640 1 -- 172.21.15.146:0/2419570380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118c09cea0 con 0x7f118c0cd660 2024-09-17T03:46:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.159+0000 7f11817fa640 1 -- 172.21.15.146:0/2419570380 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c035040 con 0x7f118c0cd660 2024-09-17T03:46:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.159+0000 7f11931e6640 1 -- 172.21.15.146:0/2419570380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118c09d160 con 0x7f118c0cd660 2024-09-17T03:46:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.160+0000 7f11931e6640 1 -- 172.21.15.146:0/2419570380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f118c0cffc0 con 0x7f118c0cd660 2024-09-17T03:46:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.160+0000 7f11817fa640 1 -- 172.21.15.146:0/2419570380 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f117c041030 con 0x7f118c0cd660 2024-09-17T03:46:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.161+0000 7f11817fa640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1178078b90 0x7f117807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.161+0000 7f11817fa640 1 -- 172.21.15.146:0/2419570380 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f117c0bb510 con 0x7f118c0cd660 2024-09-17T03:46:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.161+0000 7f1190f82640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1178078b90 0x7f117807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.162+0000 7f1190f82640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1178078b90 0x7f117807b0a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1188004630 tx=0x7f118800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:44.165 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.165+0000 7f11817fa640 1 -- 172.21.15.146:0/2419570380 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f117c083300 con 0x7f118c0cd660 2024-09-17T03:46:44.337 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.337+0000 7f11931e6640 1 -- 172.21.15.146:0/2419570380 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f118c0c9390 con 0x7f1178078b90 2024-09-17T03:46:44.341 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.341+0000 7f11817fa640 1 -- 172.21.15.146:0/2419570380 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252478 (secure 0 0 0) 0x7f118c0c9390 con 0x7f1178078b90 2024-09-17T03:46:44.344 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:44.345 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 -- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1178078b90 msgr2=0x7f117807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1178078b90 0x7f117807b0a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1188004630 tx=0x7f118800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 -- 172.21.15.146:0/2419570380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118c0cd660 msgr2=0x7f118c0b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118c0cd660 0x7f118c0b3680 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7f117c034040 tx=0x7f117c003910 comp rx=0 tx=0).stop 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 -- 172.21.15.146:0/2419570380 shutdown_connections 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1178078b90 0x7f117807b0a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f118c0cedc0 0x7f118c0b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f118c0cd660 0x7f118c0b3680 unknown :-1 s=CLOSED pgs=2573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 --2- 172.21.15.146:0/2419570380 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f118c0b1c20 0x7f118c156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 -- 172.21.15.146:0/2419570380 >> 172.21.15.146:0/2419570380 conn(0x7f118c0d2650 msgr2=0x7f118c0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 -- 172.21.15.146:0/2419570380 shutdown_connections 2024-09-17T03:46:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:44.345+0000 7f11931e6640 1 -- 172.21.15.146:0/2419570380 wait complete. 2024-09-17T03:46:44.356 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":611,"stamp":"2024-09-17T03:46:44.011335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474256,"kb_used_data":20736,"kb_used_omap":12,"kb_used_meta":453299,"kb_avail":754500464,"statfs":{"total":773094113280,"available":772608475136,"internally_reserved":0,"allocated":21233664,"data_stored":9982245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":464178737},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.173008"},"pg_stats":[{"pgid":"31.3f","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873864+0000","last_change":"2024-09-17T03:46:38.871668+0000","last_active":"2024-09-17T03:46:38.873864+0000","last_peered":"2024-09-17T03:46:38.873864+0000","last_clean":"2024-09-17T03:46:38.873864+0000","last_became_active":"2024-09-17T03:46:38.871334+0000","last_became_peered":"2024-09-17T03:46:38.871334+0000","last_unstale":"2024-09-17T03:46:38.873864+0000","last_undegraded":"2024-09-17T03:46:38.873864+0000","last_fullsized":"2024-09-17T03:46:38.873864+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:33.859485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884639+0000","last_change":"2024-09-17T03:46:38.879231+0000","last_active":"2024-09-17T03:46:38.884639+0000","last_peered":"2024-09-17T03:46:38.884639+0000","last_clean":"2024-09-17T03:46:38.884639+0000","last_became_active":"2024-09-17T03:46:38.878901+0000","last_became_peered":"2024-09-17T03:46:38.878901+0000","last_unstale":"2024-09-17T03:46:38.884639+0000","last_undegraded":"2024-09-17T03:46:38.884639+0000","last_fullsized":"2024-09-17T03:46:38.884639+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:40.395914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420844+0000","last_change":"2024-09-17T03:46:38.858931+0000","last_active":"2024-09-17T03:46:40.420844+0000","last_peered":"2024-09-17T03:46:40.420844+0000","last_clean":"2024-09-17T03:46:40.420844+0000","last_became_active":"2024-09-17T03:46:38.858612+0000","last_became_peered":"2024-09-17T03:46:38.858612+0000","last_unstale":"2024-09-17T03:46:40.420844+0000","last_undegraded":"2024-09-17T03:46:40.420844+0000","last_fullsized":"2024-09-17T03:46:40.420844+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:08.043054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868060+0000","last_change":"2024-09-17T03:46:38.866452+0000","last_active":"2024-09-17T03:46:38.868060+0000","last_peered":"2024-09-17T03:46:38.868060+0000","last_clean":"2024-09-17T03:46:38.868060+0000","last_became_active":"2024-09-17T03:46:38.866088+0000","last_became_peered":"2024-09-17T03:46:38.866088+0000","last_unstale":"2024-09-17T03:46:38.868060+0000","last_undegraded":"2024-09-17T03:46:38.868060+0000","last_fullsized":"2024-09-17T03:46:38.868060+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:50.828365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.870813+0000","last_change":"2024-09-17T03:46:38.870977+0000","last_active":"2024-09-17T03:46:39.870813+0000","last_peered":"2024-09-17T03:46:39.870813+0000","last_clean":"2024-09-17T03:46:39.870813+0000","last_became_active":"2024-09-17T03:46:38.870662+0000","last_became_peered":"2024-09-17T03:46:38.870662+0000","last_unstale":"2024-09-17T03:46:39.870813+0000","last_undegraded":"2024-09-17T03:46:39.870813+0000","last_fullsized":"2024-09-17T03:46:39.870813+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:15.308843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.864979+0000","last_change":"2024-09-17T03:46:38.862117+0000","last_active":"2024-09-17T03:46:38.864979+0000","last_peered":"2024-09-17T03:46:38.864979+0000","last_clean":"2024-09-17T03:46:38.864979+0000","last_became_active":"2024-09-17T03:46:38.861759+0000","last_became_peered":"2024-09-17T03:46:38.861759+0000","last_unstale":"2024-09-17T03:46:38.864979+0000","last_undegraded":"2024-09-17T03:46:38.864979+0000","last_fullsized":"2024-09-17T03:46:38.864979+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:03.120246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879159+0000","last_change":"2024-09-17T03:46:38.877127+0000","last_active":"2024-09-17T03:46:38.879159+0000","last_peered":"2024-09-17T03:46:38.879159+0000","last_clean":"2024-09-17T03:46:38.879159+0000","last_became_active":"2024-09-17T03:46:38.876807+0000","last_became_peered":"2024-09-17T03:46:38.876807+0000","last_unstale":"2024-09-17T03:46:38.879159+0000","last_undegraded":"2024-09-17T03:46:38.879159+0000","last_fullsized":"2024-09-17T03:46:38.879159+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:36.353553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872714+0000","last_change":"2024-09-17T03:46:38.866116+0000","last_active":"2024-09-17T03:46:38.872714+0000","last_peered":"2024-09-17T03:46:38.872714+0000","last_clean":"2024-09-17T03:46:38.872714+0000","last_became_active":"2024-09-17T03:46:38.865806+0000","last_became_peered":"2024-09-17T03:46:38.865806+0000","last_unstale":"2024-09-17T03:46:38.872714+0000","last_undegraded":"2024-09-17T03:46:38.872714+0000","last_fullsized":"2024-09-17T03:46:38.872714+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:59.762164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878063+0000","last_change":"2024-09-17T03:46:38.876509+0000","last_active":"2024-09-17T03:46:38.878063+0000","last_peered":"2024-09-17T03:46:38.878063+0000","last_clean":"2024-09-17T03:46:38.878063+0000","last_became_active":"2024-09-17T03:46:38.876170+0000","last_became_peered":"2024-09-17T03:46:38.876170+0000","last_unstale":"2024-09-17T03:46:38.878063+0000","last_undegraded":"2024-09-17T03:46:38.878063+0000","last_fullsized":"2024-09-17T03:46:38.878063+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:07.118394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871684+0000","last_change":"2024-09-17T03:46:38.869498+0000","last_active":"2024-09-17T03:46:38.871684+0000","last_peered":"2024-09-17T03:46:38.871684+0000","last_clean":"2024-09-17T03:46:38.871684+0000","last_became_active":"2024-09-17T03:46:38.869166+0000","last_became_peered":"2024-09-17T03:46:38.869166+0000","last_unstale":"2024-09-17T03:46:38.871684+0000","last_undegraded":"2024-09-17T03:46:38.871684+0000","last_fullsized":"2024-09-17T03:46:38.871684+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.132290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883071+0000","last_change":"2024-09-17T03:46:38.874775+0000","last_active":"2024-09-17T03:46:38.883071+0000","last_peered":"2024-09-17T03:46:38.883071+0000","last_clean":"2024-09-17T03:46:38.883071+0000","last_became_active":"2024-09-17T03:46:38.874487+0000","last_became_peered":"2024-09-17T03:46:38.874487+0000","last_unstale":"2024-09-17T03:46:38.883071+0000","last_undegraded":"2024-09-17T03:46:38.883071+0000","last_fullsized":"2024-09-17T03:46:38.883071+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:41.649494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871053+0000","last_change":"2024-09-17T03:46:38.864701+0000","last_active":"2024-09-17T03:46:38.871053+0000","last_peered":"2024-09-17T03:46:38.871053+0000","last_clean":"2024-09-17T03:46:38.871053+0000","last_became_active":"2024-09-17T03:46:38.864315+0000","last_became_peered":"2024-09-17T03:46:38.864315+0000","last_unstale":"2024-09-17T03:46:38.871053+0000","last_undegraded":"2024-09-17T03:46:38.871053+0000","last_fullsized":"2024-09-17T03:46:38.871053+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:23.297852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879231+0000","last_change":"2024-09-17T03:46:38.877166+0000","last_active":"2024-09-17T03:46:38.879231+0000","last_peered":"2024-09-17T03:46:38.879231+0000","last_clean":"2024-09-17T03:46:38.879231+0000","last_became_active":"2024-09-17T03:46:38.876853+0000","last_became_peered":"2024-09-17T03:46:38.876853+0000","last_unstale":"2024-09-17T03:46:38.879231+0000","last_undegraded":"2024-09-17T03:46:38.879231+0000","last_fullsized":"2024-09-17T03:46:38.879231+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:22.583146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873963+0000","last_change":"2024-09-17T03:46:38.871599+0000","last_active":"2024-09-17T03:46:38.873963+0000","last_peered":"2024-09-17T03:46:38.873963+0000","last_clean":"2024-09-17T03:46:38.873963+0000","last_became_active":"2024-09-17T03:46:38.871279+0000","last_became_peered":"2024-09-17T03:46:38.871279+0000","last_unstale":"2024-09-17T03:46:38.873963+0000","last_undegraded":"2024-09-17T03:46:38.873963+0000","last_fullsized":"2024-09-17T03:46:38.873963+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:39.019606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878350+0000","last_change":"2024-09-17T03:46:38.877390+0000","last_active":"2024-09-17T03:46:38.878350+0000","last_peered":"2024-09-17T03:46:38.878350+0000","last_clean":"2024-09-17T03:46:38.878350+0000","last_became_active":"2024-09-17T03:46:38.877043+0000","last_became_peered":"2024-09-17T03:46:38.877043+0000","last_unstale":"2024-09-17T03:46:38.878350+0000","last_undegraded":"2024-09-17T03:46:38.878350+0000","last_fullsized":"2024-09-17T03:46:38.878350+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:52.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420556+0000","last_change":"2024-09-17T03:46:38.867618+0000","last_active":"2024-09-17T03:46:40.420556+0000","last_peered":"2024-09-17T03:46:40.420556+0000","last_clean":"2024-09-17T03:46:40.420556+0000","last_became_active":"2024-09-17T03:46:38.867337+0000","last_became_peered":"2024-09-17T03:46:38.867337+0000","last_unstale":"2024-09-17T03:46:40.420556+0000","last_undegraded":"2024-09-17T03:46:40.420556+0000","last_fullsized":"2024-09-17T03:46:40.420556+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:50.927543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856633+0000","last_change":"2024-09-17T03:46:38.855444+0000","last_active":"2024-09-17T03:46:38.856633+0000","last_peered":"2024-09-17T03:46:38.856633+0000","last_clean":"2024-09-17T03:46:38.856633+0000","last_became_active":"2024-09-17T03:46:38.855104+0000","last_became_peered":"2024-09-17T03:46:38.855104+0000","last_unstale":"2024-09-17T03:46:38.856633+0000","last_undegraded":"2024-09-17T03:46:38.856633+0000","last_fullsized":"2024-09-17T03:46:38.856633+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:45.332349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871069+0000","last_change":"2024-09-17T03:46:38.869122+0000","last_active":"2024-09-17T03:46:38.871069+0000","last_peered":"2024-09-17T03:46:38.871069+0000","last_clean":"2024-09-17T03:46:38.871069+0000","last_became_active":"2024-09-17T03:46:38.868818+0000","last_became_peered":"2024-09-17T03:46:38.868818+0000","last_unstale":"2024-09-17T03:46:38.871069+0000","last_undegraded":"2024-09-17T03:46:38.871069+0000","last_fullsized":"2024-09-17T03:46:38.871069+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:47.484288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874564+0000","last_change":"2024-09-17T03:46:38.873994+0000","last_active":"2024-09-17T03:46:38.874564+0000","last_peered":"2024-09-17T03:46:38.874564+0000","last_clean":"2024-09-17T03:46:38.874564+0000","last_became_active":"2024-09-17T03:46:38.873589+0000","last_became_peered":"2024-09-17T03:46:38.873589+0000","last_unstale":"2024-09-17T03:46:38.874564+0000","last_undegraded":"2024-09-17T03:46:38.874564+0000","last_fullsized":"2024-09-17T03:46:38.874564+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:12.986513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.421114+0000","last_change":"2024-09-17T03:46:38.867002+0000","last_active":"2024-09-17T03:46:40.421114+0000","last_peered":"2024-09-17T03:46:40.421114+0000","last_clean":"2024-09-17T03:46:40.421114+0000","last_became_active":"2024-09-17T03:46:38.866625+0000","last_became_peered":"2024-09-17T03:46:38.866625+0000","last_unstale":"2024-09-17T03:46:40.421114+0000","last_undegraded":"2024-09-17T03:46:40.421114+0000","last_fullsized":"2024-09-17T03:46:40.421114+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:17.704242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872593+0000","last_change":"2024-09-17T03:46:38.869135+0000","last_active":"2024-09-17T03:46:38.872593+0000","last_peered":"2024-09-17T03:46:38.872593+0000","last_clean":"2024-09-17T03:46:38.872593+0000","last_became_active":"2024-09-17T03:46:38.868524+0000","last_became_peered":"2024-09-17T03:46:38.868524+0000","last_unstale":"2024-09-17T03:46:38.872593+0000","last_undegraded":"2024-09-17T03:46:38.872593+0000","last_fullsized":"2024-09-17T03:46:38.872593+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:39.027714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872689+0000","last_change":"2024-09-17T03:46:38.871659+0000","last_active":"2024-09-17T03:46:38.872689+0000","last_peered":"2024-09-17T03:46:38.872689+0000","last_clean":"2024-09-17T03:46:38.872689+0000","last_became_active":"2024-09-17T03:46:38.871304+0000","last_became_peered":"2024-09-17T03:46:38.871304+0000","last_unstale":"2024-09-17T03:46:38.872689+0000","last_undegraded":"2024-09-17T03:46:38.872689+0000","last_fullsized":"2024-09-17T03:46:38.872689+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:42.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868055+0000","last_change":"2024-09-17T03:46:38.862294+0000","last_active":"2024-09-17T03:46:38.868055+0000","last_peered":"2024-09-17T03:46:38.868055+0000","last_clean":"2024-09-17T03:46:38.868055+0000","last_became_active":"2024-09-17T03:46:38.861912+0000","last_became_peered":"2024-09-17T03:46:38.861912+0000","last_unstale":"2024-09-17T03:46:38.868055+0000","last_undegraded":"2024-09-17T03:46:38.868055+0000","last_fullsized":"2024-09-17T03:46:38.868055+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:45.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883740+0000","last_change":"2024-09-17T03:46:38.876742+0000","last_active":"2024-09-17T03:46:38.883740+0000","last_peered":"2024-09-17T03:46:38.883740+0000","last_clean":"2024-09-17T03:46:38.883740+0000","last_became_active":"2024-09-17T03:46:38.876441+0000","last_became_peered":"2024-09-17T03:46:38.876441+0000","last_unstale":"2024-09-17T03:46:38.883740+0000","last_undegraded":"2024-09-17T03:46:38.883740+0000","last_fullsized":"2024-09-17T03:46:38.883740+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:24.794528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.864971+0000","last_change":"2024-09-17T03:46:38.862445+0000","last_active":"2024-09-17T03:46:38.864971+0000","last_peered":"2024-09-17T03:46:38.864971+0000","last_clean":"2024-09-17T03:46:38.864971+0000","last_became_active":"2024-09-17T03:46:38.861998+0000","last_became_peered":"2024-09-17T03:46:38.861998+0000","last_unstale":"2024-09-17T03:46:38.864971+0000","last_undegraded":"2024-09-17T03:46:38.864971+0000","last_fullsized":"2024-09-17T03:46:38.864971+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:55.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879214+0000","last_change":"2024-09-17T03:46:38.877664+0000","last_active":"2024-09-17T03:46:38.879214+0000","last_peered":"2024-09-17T03:46:38.879214+0000","last_clean":"2024-09-17T03:46:38.879214+0000","last_became_active":"2024-09-17T03:46:38.877375+0000","last_became_peered":"2024-09-17T03:46:38.877375+0000","last_unstale":"2024-09-17T03:46:38.879214+0000","last_undegraded":"2024-09-17T03:46:38.879214+0000","last_fullsized":"2024-09-17T03:46:38.879214+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:17.248059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.882971+0000","last_change":"2024-09-17T03:46:38.874450+0000","last_active":"2024-09-17T03:46:38.882971+0000","last_peered":"2024-09-17T03:46:38.882971+0000","last_clean":"2024-09-17T03:46:38.882971+0000","last_became_active":"2024-09-17T03:46:38.873914+0000","last_became_peered":"2024-09-17T03:46:38.873914+0000","last_unstale":"2024-09-17T03:46:38.882971+0000","last_undegraded":"2024-09-17T03:46:38.882971+0000","last_fullsized":"2024-09-17T03:46:38.882971+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:18.270227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.885019+0000","last_change":"2024-09-17T03:46:38.880123+0000","last_active":"2024-09-17T03:46:38.885019+0000","last_peered":"2024-09-17T03:46:38.885019+0000","last_clean":"2024-09-17T03:46:38.885019+0000","last_became_active":"2024-09-17T03:46:38.879828+0000","last_became_peered":"2024-09-17T03:46:38.879828+0000","last_unstale":"2024-09-17T03:46:38.885019+0000","last_undegraded":"2024-09-17T03:46:38.885019+0000","last_fullsized":"2024-09-17T03:46:38.885019+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:15.132290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872413+0000","last_change":"2024-09-17T03:46:38.864173+0000","last_active":"2024-09-17T03:46:38.872413+0000","last_peered":"2024-09-17T03:46:38.872413+0000","last_clean":"2024-09-17T03:46:38.872413+0000","last_became_active":"2024-09-17T03:46:38.863861+0000","last_became_peered":"2024-09-17T03:46:38.863861+0000","last_unstale":"2024-09-17T03:46:38.872413+0000","last_undegraded":"2024-09-17T03:46:38.872413+0000","last_fullsized":"2024-09-17T03:46:38.872413+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:14.514064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.870825+0000","last_change":"2024-09-17T03:46:38.865938+0000","last_active":"2024-09-17T03:46:39.870825+0000","last_peered":"2024-09-17T03:46:39.870825+0000","last_clean":"2024-09-17T03:46:39.870825+0000","last_became_active":"2024-09-17T03:46:38.865609+0000","last_became_peered":"2024-09-17T03:46:38.865609+0000","last_unstale":"2024-09-17T03:46:39.870825+0000","last_undegraded":"2024-09-17T03:46:39.870825+0000","last_fullsized":"2024-09-17T03:46:39.870825+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:05.400623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.877166+0000","last_change":"2024-09-17T03:46:38.875927+0000","last_active":"2024-09-17T03:46:38.877166+0000","last_peered":"2024-09-17T03:46:38.877166+0000","last_clean":"2024-09-17T03:46:38.877166+0000","last_became_active":"2024-09-17T03:46:38.875618+0000","last_became_peered":"2024-09-17T03:46:38.875618+0000","last_unstale":"2024-09-17T03:46:38.877166+0000","last_undegraded":"2024-09-17T03:46:38.877166+0000","last_fullsized":"2024-09-17T03:46:38.877166+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:08.073928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873903+0000","last_change":"2024-09-17T03:46:38.870813+0000","last_active":"2024-09-17T03:46:38.873903+0000","last_peered":"2024-09-17T03:46:38.873903+0000","last_clean":"2024-09-17T03:46:38.873903+0000","last_became_active":"2024-09-17T03:46:38.870493+0000","last_became_peered":"2024-09-17T03:46:38.870493+0000","last_unstale":"2024-09-17T03:46:38.873903+0000","last_undegraded":"2024-09-17T03:46:38.873903+0000","last_fullsized":"2024-09-17T03:46:38.873903+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:28.445042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.421012+0000","last_change":"2024-09-17T03:46:38.865947+0000","last_active":"2024-09-17T03:46:40.421012+0000","last_peered":"2024-09-17T03:46:40.421012+0000","last_clean":"2024-09-17T03:46:40.421012+0000","last_became_active":"2024-09-17T03:46:38.865631+0000","last_became_peered":"2024-09-17T03:46:38.865631+0000","last_unstale":"2024-09-17T03:46:40.421012+0000","last_undegraded":"2024-09-17T03:46:40.421012+0000","last_fullsized":"2024-09-17T03:46:40.421012+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:34.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1e","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878982+0000","last_change":"2024-09-17T03:46:37.849807+0000","last_active":"2024-09-17T03:46:38.878982+0000","last_peered":"2024-09-17T03:46:38.878982+0000","last_clean":"2024-09-17T03:46:38.878982+0000","last_became_active":"2024-09-17T03:46:37.849384+0000","last_became_peered":"2024-09-17T03:46:37.849384+0000","last_unstale":"2024-09-17T03:46:38.878982+0000","last_undegraded":"2024-09-17T03:46:38.878982+0000","last_fullsized":"2024-09-17T03:46:38.878982+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:56.687816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872914+0000","last_change":"2024-09-17T03:46:38.864532+0000","last_active":"2024-09-17T03:46:38.872914+0000","last_peered":"2024-09-17T03:46:38.872914+0000","last_clean":"2024-09-17T03:46:38.872914+0000","last_became_active":"2024-09-17T03:46:38.864221+0000","last_became_peered":"2024-09-17T03:46:38.864221+0000","last_unstale":"2024-09-17T03:46:38.872914+0000","last_undegraded":"2024-09-17T03:46:38.872914+0000","last_fullsized":"2024-09-17T03:46:38.872914+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.402855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1d","version":"198'2","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420648+0000","last_change":"2024-09-17T03:46:37.851833+0000","last_active":"2024-09-17T03:46:40.420648+0000","last_peered":"2024-09-17T03:46:40.420648+0000","last_clean":"2024-09-17T03:46:40.420648+0000","last_became_active":"2024-09-17T03:46:37.851531+0000","last_became_peered":"2024-09-17T03:46:37.851531+0000","last_unstale":"2024-09-17T03:46:40.420648+0000","last_undegraded":"2024-09-17T03:46:40.420648+0000","last_fullsized":"2024-09-17T03:46:40.420648+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:05.023218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.859231+0000","last_change":"2024-09-17T03:46:38.857502+0000","last_active":"2024-09-17T03:46:38.859231+0000","last_peered":"2024-09-17T03:46:38.859231+0000","last_clean":"2024-09-17T03:46:38.859231+0000","last_became_active":"2024-09-17T03:46:38.857193+0000","last_became_peered":"2024-09-17T03:46:38.857193+0000","last_unstale":"2024-09-17T03:46:38.859231+0000","last_undegraded":"2024-09-17T03:46:38.859231+0000","last_fullsized":"2024-09-17T03:46:38.859231+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:57.596324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1c","version":"198'2","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.421182+0000","last_change":"2024-09-17T03:46:37.850060+0000","last_active":"2024-09-17T03:46:40.421182+0000","last_peered":"2024-09-17T03:46:40.421182+0000","last_clean":"2024-09-17T03:46:40.421182+0000","last_became_active":"2024-09-17T03:46:37.849550+0000","last_became_peered":"2024-09-17T03:46:37.849550+0000","last_unstale":"2024-09-17T03:46:40.421182+0000","last_undegraded":"2024-09-17T03:46:40.421182+0000","last_fullsized":"2024-09-17T03:46:40.421182+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:21.228868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872348+0000","last_change":"2024-09-17T03:46:38.863432+0000","last_active":"2024-09-17T03:46:38.872348+0000","last_peered":"2024-09-17T03:46:38.872348+0000","last_clean":"2024-09-17T03:46:38.872348+0000","last_became_active":"2024-09-17T03:46:38.863073+0000","last_became_peered":"2024-09-17T03:46:38.863073+0000","last_unstale":"2024-09-17T03:46:38.872348+0000","last_undegraded":"2024-09-17T03:46:38.872348+0000","last_fullsized":"2024-09-17T03:46:38.872348+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:38.721703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1b","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874483+0000","last_change":"2024-09-17T03:46:37.857697+0000","last_active":"2024-09-17T03:46:38.874483+0000","last_peered":"2024-09-17T03:46:38.874483+0000","last_clean":"2024-09-17T03:46:38.874483+0000","last_became_active":"2024-09-17T03:46:37.857396+0000","last_became_peered":"2024-09-17T03:46:37.857396+0000","last_unstale":"2024-09-17T03:46:38.874483+0000","last_undegraded":"2024-09-17T03:46:38.874483+0000","last_fullsized":"2024-09-17T03:46:38.874483+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:47.376600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878548+0000","last_change":"2024-09-17T03:46:38.877940+0000","last_active":"2024-09-17T03:46:38.878548+0000","last_peered":"2024-09-17T03:46:38.878548+0000","last_clean":"2024-09-17T03:46:38.878548+0000","last_became_active":"2024-09-17T03:46:38.877521+0000","last_became_peered":"2024-09-17T03:46:38.877521+0000","last_unstale":"2024-09-17T03:46:38.878548+0000","last_undegraded":"2024-09-17T03:46:38.878548+0000","last_fullsized":"2024-09-17T03:46:38.878548+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:35.037081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884389+0000","last_change":"2024-09-17T03:46:37.853555+0000","last_active":"2024-09-17T03:46:38.884389+0000","last_peered":"2024-09-17T03:46:38.884389+0000","last_clean":"2024-09-17T03:46:38.884389+0000","last_became_active":"2024-09-17T03:46:37.853225+0000","last_became_peered":"2024-09-17T03:46:37.853225+0000","last_unstale":"2024-09-17T03:46:38.884389+0000","last_undegraded":"2024-09-17T03:46:38.884389+0000","last_fullsized":"2024-09-17T03:46:38.884389+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:52.469536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420590+0000","last_change":"2024-09-17T03:46:38.865217+0000","last_active":"2024-09-17T03:46:40.420590+0000","last_peered":"2024-09-17T03:46:40.420590+0000","last_clean":"2024-09-17T03:46:40.420590+0000","last_became_active":"2024-09-17T03:46:38.864894+0000","last_became_peered":"2024-09-17T03:46:38.864894+0000","last_unstale":"2024-09-17T03:46:40.420590+0000","last_undegraded":"2024-09-17T03:46:40.420590+0000","last_fullsized":"2024-09-17T03:46:40.420590+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:20.242463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856579+0000","last_change":"2024-09-17T03:46:37.856566+0000","last_active":"2024-09-17T03:46:38.856579+0000","last_peered":"2024-09-17T03:46:38.856579+0000","last_clean":"2024-09-17T03:46:38.856579+0000","last_became_active":"2024-09-17T03:46:37.856251+0000","last_became_peered":"2024-09-17T03:46:37.856251+0000","last_unstale":"2024-09-17T03:46:38.856579+0000","last_undegraded":"2024-09-17T03:46:38.856579+0000","last_fullsized":"2024-09-17T03:46:38.856579+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:11.674372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.875351+0000","last_change":"2024-09-17T03:46:38.874486+0000","last_active":"2024-09-17T03:46:38.875351+0000","last_peered":"2024-09-17T03:46:38.875351+0000","last_clean":"2024-09-17T03:46:38.875351+0000","last_became_active":"2024-09-17T03:46:38.874172+0000","last_became_peered":"2024-09-17T03:46:38.874172+0000","last_unstale":"2024-09-17T03:46:38.875351+0000","last_undegraded":"2024-09-17T03:46:38.875351+0000","last_fullsized":"2024-09-17T03:46:38.875351+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:57.693671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420700+0000","last_change":"2024-09-17T03:46:37.850688+0000","last_active":"2024-09-17T03:46:40.420700+0000","last_peered":"2024-09-17T03:46:40.420700+0000","last_clean":"2024-09-17T03:46:40.420700+0000","last_became_active":"2024-09-17T03:46:37.850077+0000","last_became_peered":"2024-09-17T03:46:37.850077+0000","last_unstale":"2024-09-17T03:46:40.420700+0000","last_undegraded":"2024-09-17T03:46:40.420700+0000","last_fullsized":"2024-09-17T03:46:40.420700+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:55.851229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883287+0000","last_change":"2024-09-17T03:46:38.875932+0000","last_active":"2024-09-17T03:46:38.883287+0000","last_peered":"2024-09-17T03:46:38.883287+0000","last_clean":"2024-09-17T03:46:38.883287+0000","last_became_active":"2024-09-17T03:46:38.875606+0000","last_became_peered":"2024-09-17T03:46:38.875606+0000","last_unstale":"2024-09-17T03:46:38.883287+0000","last_undegraded":"2024-09-17T03:46:38.883287+0000","last_fullsized":"2024-09-17T03:46:38.883287+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:59.503799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.853027+0000","last_change":"2024-09-17T03:46:37.859345+0000","last_active":"2024-09-17T03:46:38.853027+0000","last_peered":"2024-09-17T03:46:38.853027+0000","last_clean":"2024-09-17T03:46:38.853027+0000","last_became_active":"2024-09-17T03:46:37.859006+0000","last_became_peered":"2024-09-17T03:46:37.859006+0000","last_unstale":"2024-09-17T03:46:38.853027+0000","last_undegraded":"2024-09-17T03:46:38.853027+0000","last_fullsized":"2024-09-17T03:46:38.853027+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:10.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.874637+0000","last_change":"2024-09-17T03:46:38.871889+0000","last_active":"2024-09-17T03:46:38.874637+0000","last_peered":"2024-09-17T03:46:38.874637+0000","last_clean":"2024-09-17T03:46:38.874637+0000","last_became_active":"2024-09-17T03:46:38.871405+0000","last_became_peered":"2024-09-17T03:46:38.871405+0000","last_unstale":"2024-09-17T03:46:38.874637+0000","last_undegraded":"2024-09-17T03:46:38.874637+0000","last_fullsized":"2024-09-17T03:46:38.874637+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:11.581943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420768+0000","last_change":"2024-09-17T03:46:37.857948+0000","last_active":"2024-09-17T03:46:40.420768+0000","last_peered":"2024-09-17T03:46:40.420768+0000","last_clean":"2024-09-17T03:46:40.420768+0000","last_became_active":"2024-09-17T03:46:37.857657+0000","last_became_peered":"2024-09-17T03:46:37.857657+0000","last_unstale":"2024-09-17T03:46:40.420768+0000","last_undegraded":"2024-09-17T03:46:40.420768+0000","last_fullsized":"2024-09-17T03:46:40.420768+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:46.258164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.421117+0000","last_change":"2024-09-17T03:46:38.877386+0000","last_active":"2024-09-17T03:46:40.421117+0000","last_peered":"2024-09-17T03:46:40.421117+0000","last_clean":"2024-09-17T03:46:40.421117+0000","last_became_active":"2024-09-17T03:46:38.876839+0000","last_became_peered":"2024-09-17T03:46:38.876839+0000","last_unstale":"2024-09-17T03:46:40.421117+0000","last_undegraded":"2024-09-17T03:46:40.421117+0000","last_fullsized":"2024-09-17T03:46:40.421117+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:15.568009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.15","version":"198'3","reported_seq":16,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884805+0000","last_change":"2024-09-17T03:46:37.857029+0000","last_active":"2024-09-17T03:46:38.884805+0000","last_peered":"2024-09-17T03:46:38.884805+0000","last_clean":"2024-09-17T03:46:38.884805+0000","last_became_active":"2024-09-17T03:46:37.856738+0000","last_became_peered":"2024-09-17T03:46:37.856738+0000","last_unstale":"2024-09-17T03:46:38.884805+0000","last_undegraded":"2024-09-17T03:46:38.884805+0000","last_fullsized":"2024-09-17T03:46:38.884805+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:01.595359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.872102+0000","last_change":"2024-09-17T03:46:38.867964+0000","last_active":"2024-09-17T03:46:38.872102+0000","last_peered":"2024-09-17T03:46:38.872102+0000","last_clean":"2024-09-17T03:46:38.872102+0000","last_became_active":"2024-09-17T03:46:38.867541+0000","last_became_peered":"2024-09-17T03:46:38.867541+0000","last_unstale":"2024-09-17T03:46:38.872102+0000","last_undegraded":"2024-09-17T03:46:38.872102+0000","last_fullsized":"2024-09-17T03:46:38.872102+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:40.395914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.14","version":"198'6","reported_seq":19,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.886872+0000","last_change":"2024-09-17T03:46:37.861154+0000","last_active":"2024-09-17T03:46:38.886872+0000","last_peered":"2024-09-17T03:46:38.886872+0000","last_clean":"2024-09-17T03:46:38.886872+0000","last_became_active":"2024-09-17T03:46:37.860819+0000","last_became_peered":"2024-09-17T03:46:37.860819+0000","last_unstale":"2024-09-17T03:46:38.886872+0000","last_undegraded":"2024-09-17T03:46:38.886872+0000","last_fullsized":"2024-09-17T03:46:38.886872+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:33.736709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871744+0000","last_change":"2024-09-17T03:46:38.869534+0000","last_active":"2024-09-17T03:46:38.871744+0000","last_peered":"2024-09-17T03:46:38.871744+0000","last_clean":"2024-09-17T03:46:38.871744+0000","last_became_active":"2024-09-17T03:46:38.869205+0000","last_became_peered":"2024-09-17T03:46:38.869205+0000","last_unstale":"2024-09-17T03:46:38.871744+0000","last_undegraded":"2024-09-17T03:46:38.871744+0000","last_fullsized":"2024-09-17T03:46:38.871744+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:27.696745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.13","version":"198'2","reported_seq":15,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884557+0000","last_change":"2024-09-17T03:46:37.857360+0000","last_active":"2024-09-17T03:46:38.884557+0000","last_peered":"2024-09-17T03:46:38.884557+0000","last_clean":"2024-09-17T03:46:38.884557+0000","last_became_active":"2024-09-17T03:46:37.857041+0000","last_became_peered":"2024-09-17T03:46:37.857041+0000","last_unstale":"2024-09-17T03:46:38.884557+0000","last_undegraded":"2024-09-17T03:46:38.884557+0000","last_fullsized":"2024-09-17T03:46:38.884557+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:15.827164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868255+0000","last_change":"2024-09-17T03:46:38.866013+0000","last_active":"2024-09-17T03:46:38.868255+0000","last_peered":"2024-09-17T03:46:38.868255+0000","last_clean":"2024-09-17T03:46:38.868255+0000","last_became_active":"2024-09-17T03:46:38.865682+0000","last_became_peered":"2024-09-17T03:46:38.865682+0000","last_unstale":"2024-09-17T03:46:38.868255+0000","last_undegraded":"2024-09-17T03:46:38.868255+0000","last_fullsized":"2024-09-17T03:46:38.868255+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:53.452915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420614+0000","last_change":"2024-09-17T03:46:37.849974+0000","last_active":"2024-09-17T03:46:40.420614+0000","last_peered":"2024-09-17T03:46:40.420614+0000","last_clean":"2024-09-17T03:46:40.420614+0000","last_became_active":"2024-09-17T03:46:37.849660+0000","last_became_peered":"2024-09-17T03:46:37.849660+0000","last_unstale":"2024-09-17T03:46:40.420614+0000","last_undegraded":"2024-09-17T03:46:40.420614+0000","last_fullsized":"2024-09-17T03:46:40.420614+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:35.038415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.877632+0000","last_change":"2024-09-17T03:46:38.876700+0000","last_active":"2024-09-17T03:46:38.877632+0000","last_peered":"2024-09-17T03:46:38.877632+0000","last_clean":"2024-09-17T03:46:38.877632+0000","last_became_active":"2024-09-17T03:46:38.876391+0000","last_became_peered":"2024-09-17T03:46:38.876391+0000","last_unstale":"2024-09-17T03:46:38.877632+0000","last_undegraded":"2024-09-17T03:46:38.877632+0000","last_fullsized":"2024-09-17T03:46:38.877632+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:42.280443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856153+0000","last_change":"2024-09-17T03:46:37.851640+0000","last_active":"2024-09-17T03:46:38.856153+0000","last_peered":"2024-09-17T03:46:38.856153+0000","last_clean":"2024-09-17T03:46:38.856153+0000","last_became_active":"2024-09-17T03:46:37.851293+0000","last_became_peered":"2024-09-17T03:46:37.851293+0000","last_unstale":"2024-09-17T03:46:38.856153+0000","last_undegraded":"2024-09-17T03:46:38.856153+0000","last_fullsized":"2024-09-17T03:46:38.856153+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:38.013751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873248+0000","last_change":"2024-09-17T03:46:38.872576+0000","last_active":"2024-09-17T03:46:38.873248+0000","last_peered":"2024-09-17T03:46:38.873248+0000","last_clean":"2024-09-17T03:46:38.873248+0000","last_became_active":"2024-09-17T03:46:38.872235+0000","last_became_peered":"2024-09-17T03:46:38.872235+0000","last_unstale":"2024-09-17T03:46:38.873248+0000","last_undegraded":"2024-09-17T03:46:38.873248+0000","last_fullsized":"2024-09-17T03:46:38.873248+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:22.527655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.10","version":"198'8","reported_seq":21,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.883901+0000","last_change":"2024-09-17T03:46:37.859205+0000","last_active":"2024-09-17T03:46:38.883901+0000","last_peered":"2024-09-17T03:46:38.883901+0000","last_clean":"2024-09-17T03:46:38.883901+0000","last_became_active":"2024-09-17T03:46:37.858827+0000","last_became_peered":"2024-09-17T03:46:37.858827+0000","last_unstale":"2024-09-17T03:46:38.883901+0000","last_undegraded":"2024-09-17T03:46:38.883901+0000","last_fullsized":"2024-09-17T03:46:38.883901+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:52.447059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873714+0000","last_change":"2024-09-17T03:46:38.870343+0000","last_active":"2024-09-17T03:46:38.873714+0000","last_peered":"2024-09-17T03:46:38.873714+0000","last_clean":"2024-09-17T03:46:38.873714+0000","last_became_active":"2024-09-17T03:46:38.870050+0000","last_became_peered":"2024-09-17T03:46:38.870050+0000","last_unstale":"2024-09-17T03:46:38.873714+0000","last_undegraded":"2024-09-17T03:46:38.873714+0000","last_fullsized":"2024-09-17T03:46:38.873714+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:41.722010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.f","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.879122+0000","last_change":"2024-09-17T03:46:37.856352+0000","last_active":"2024-09-17T03:46:38.879122+0000","last_peered":"2024-09-17T03:46:38.879122+0000","last_clean":"2024-09-17T03:46:38.879122+0000","last_became_active":"2024-09-17T03:46:37.855823+0000","last_became_peered":"2024-09-17T03:46:37.855823+0000","last_unstale":"2024-09-17T03:46:38.879122+0000","last_undegraded":"2024-09-17T03:46:38.879122+0000","last_fullsized":"2024-09-17T03:46:38.879122+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:32.853630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420947+0000","last_change":"2024-09-17T03:46:38.866806+0000","last_active":"2024-09-17T03:46:40.420947+0000","last_peered":"2024-09-17T03:46:40.420947+0000","last_clean":"2024-09-17T03:46:40.420947+0000","last_became_active":"2024-09-17T03:46:38.866523+0000","last_became_peered":"2024-09-17T03:46:38.866523+0000","last_unstale":"2024-09-17T03:46:40.420947+0000","last_undegraded":"2024-09-17T03:46:40.420947+0000","last_fullsized":"2024-09-17T03:46:40.420947+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:20.966428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.e","version":"198'2","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420913+0000","last_change":"2024-09-17T03:46:37.852362+0000","last_active":"2024-09-17T03:46:40.420913+0000","last_peered":"2024-09-17T03:46:40.420913+0000","last_clean":"2024-09-17T03:46:40.420913+0000","last_became_active":"2024-09-17T03:46:37.852073+0000","last_became_peered":"2024-09-17T03:46:37.852073+0000","last_unstale":"2024-09-17T03:46:40.420913+0000","last_undegraded":"2024-09-17T03:46:40.420913+0000","last_fullsized":"2024-09-17T03:46:40.420913+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:38.266891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871988+0000","last_change":"2024-09-17T03:46:38.869114+0000","last_active":"2024-09-17T03:46:38.871988+0000","last_peered":"2024-09-17T03:46:38.871988+0000","last_clean":"2024-09-17T03:46:38.871988+0000","last_became_active":"2024-09-17T03:46:38.868763+0000","last_became_peered":"2024-09-17T03:46:38.868763+0000","last_unstale":"2024-09-17T03:46:38.871988+0000","last_undegraded":"2024-09-17T03:46:38.871988+0000","last_fullsized":"2024-09-17T03:46:38.871988+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:21.384878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.d","version":"198'1","reported_seq":14,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.875112+0000","last_change":"2024-09-17T03:46:37.855339+0000","last_active":"2024-09-17T03:46:38.875112+0000","last_peered":"2024-09-17T03:46:38.875112+0000","last_clean":"2024-09-17T03:46:38.875112+0000","last_became_active":"2024-09-17T03:46:37.854766+0000","last_became_peered":"2024-09-17T03:46:37.854766+0000","last_unstale":"2024-09-17T03:46:38.875112+0000","last_undegraded":"2024-09-17T03:46:38.875112+0000","last_fullsized":"2024-09-17T03:46:38.875112+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:25.106006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.865023+0000","last_change":"2024-09-17T03:46:38.858260+0000","last_active":"2024-09-17T03:46:38.865023+0000","last_peered":"2024-09-17T03:46:38.865023+0000","last_clean":"2024-09-17T03:46:38.865023+0000","last_became_active":"2024-09-17T03:46:38.856652+0000","last_became_peered":"2024-09-17T03:46:38.856652+0000","last_unstale":"2024-09-17T03:46:38.865023+0000","last_undegraded":"2024-09-17T03:46:38.865023+0000","last_fullsized":"2024-09-17T03:46:38.865023+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:14.476439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856659+0000","last_change":"2024-09-17T03:46:37.858541+0000","last_active":"2024-09-17T03:46:38.856659+0000","last_peered":"2024-09-17T03:46:38.856659+0000","last_clean":"2024-09-17T03:46:38.856659+0000","last_became_active":"2024-09-17T03:46:37.857850+0000","last_became_peered":"2024-09-17T03:46:37.857850+0000","last_unstale":"2024-09-17T03:46:38.856659+0000","last_undegraded":"2024-09-17T03:46:38.856659+0000","last_fullsized":"2024-09-17T03:46:38.856659+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:06.112538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868122+0000","last_change":"2024-09-17T03:46:38.860988+0000","last_active":"2024-09-17T03:46:38.868122+0000","last_peered":"2024-09-17T03:46:38.868122+0000","last_clean":"2024-09-17T03:46:38.868122+0000","last_became_active":"2024-09-17T03:46:38.860657+0000","last_became_peered":"2024-09-17T03:46:38.860657+0000","last_unstale":"2024-09-17T03:46:38.868122+0000","last_undegraded":"2024-09-17T03:46:38.868122+0000","last_fullsized":"2024-09-17T03:46:38.868122+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:37.643112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.b","version":"198'2","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420894+0000","last_change":"2024-09-17T03:46:37.851777+0000","last_active":"2024-09-17T03:46:40.420894+0000","last_peered":"2024-09-17T03:46:40.420894+0000","last_clean":"2024-09-17T03:46:40.420894+0000","last_became_active":"2024-09-17T03:46:37.851068+0000","last_became_peered":"2024-09-17T03:46:37.851068+0000","last_unstale":"2024-09-17T03:46:40.420894+0000","last_undegraded":"2024-09-17T03:46:40.420894+0000","last_fullsized":"2024-09-17T03:46:40.420894+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:59.821952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873819+0000","last_change":"2024-09-17T03:46:38.872416+0000","last_active":"2024-09-17T03:46:38.873819+0000","last_peered":"2024-09-17T03:46:38.873819+0000","last_clean":"2024-09-17T03:46:38.873819+0000","last_became_active":"2024-09-17T03:46:38.872130+0000","last_became_peered":"2024-09-17T03:46:38.872130+0000","last_unstale":"2024-09-17T03:46:38.873819+0000","last_undegraded":"2024-09-17T03:46:38.873819+0000","last_fullsized":"2024-09-17T03:46:38.873819+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:12.680228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856452+0000","last_change":"2024-09-17T03:46:37.856091+0000","last_active":"2024-09-17T03:46:38.856452+0000","last_peered":"2024-09-17T03:46:38.856452+0000","last_clean":"2024-09-17T03:46:38.856452+0000","last_became_active":"2024-09-17T03:46:37.855774+0000","last_became_peered":"2024-09-17T03:46:37.855774+0000","last_unstale":"2024-09-17T03:46:38.856452+0000","last_undegraded":"2024-09-17T03:46:38.856452+0000","last_fullsized":"2024-09-17T03:46:38.856452+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:20.379023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.881413+0000","last_change":"2024-09-17T03:46:38.872310+0000","last_active":"2024-09-17T03:46:38.881413+0000","last_peered":"2024-09-17T03:46:38.881413+0000","last_clean":"2024-09-17T03:46:38.881413+0000","last_became_active":"2024-09-17T03:46:38.871997+0000","last_became_peered":"2024-09-17T03:46:38.871997+0000","last_unstale":"2024-09-17T03:46:38.881413+0000","last_undegraded":"2024-09-17T03:46:38.881413+0000","last_fullsized":"2024-09-17T03:46:38.881413+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:21.541289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.858485+0000","last_change":"2024-09-17T03:46:37.855038+0000","last_active":"2024-09-17T03:46:38.858485+0000","last_peered":"2024-09-17T03:46:38.858485+0000","last_clean":"2024-09-17T03:46:38.858485+0000","last_became_active":"2024-09-17T03:46:37.854645+0000","last_became_peered":"2024-09-17T03:46:37.854645+0000","last_unstale":"2024-09-17T03:46:38.858485+0000","last_undegraded":"2024-09-17T03:46:38.858485+0000","last_fullsized":"2024-09-17T03:46:38.858485+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:09.904657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.857199+0000","last_change":"2024-09-17T03:46:38.855559+0000","last_active":"2024-09-17T03:46:38.857199+0000","last_peered":"2024-09-17T03:46:38.857199+0000","last_clean":"2024-09-17T03:46:38.857199+0000","last_became_active":"2024-09-17T03:46:38.855179+0000","last_became_peered":"2024-09-17T03:46:38.855179+0000","last_unstale":"2024-09-17T03:46:38.857199+0000","last_undegraded":"2024-09-17T03:46:38.857199+0000","last_fullsized":"2024-09-17T03:46:38.857199+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:30.305040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.854811+0000","last_change":"2024-09-17T03:46:37.850967+0000","last_active":"2024-09-17T03:46:38.854811+0000","last_peered":"2024-09-17T03:46:38.854811+0000","last_clean":"2024-09-17T03:46:38.854811+0000","last_became_active":"2024-09-17T03:46:37.849133+0000","last_became_peered":"2024-09-17T03:46:37.849133+0000","last_unstale":"2024-09-17T03:46:38.854811+0000","last_undegraded":"2024-09-17T03:46:38.854811+0000","last_fullsized":"2024-09-17T03:46:38.854811+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:27.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.867364+0000","last_change":"2024-09-17T03:46:38.864300+0000","last_active":"2024-09-17T03:46:38.867364+0000","last_peered":"2024-09-17T03:46:38.867364+0000","last_clean":"2024-09-17T03:46:38.867364+0000","last_became_active":"2024-09-17T03:46:38.863911+0000","last_became_peered":"2024-09-17T03:46:38.863911+0000","last_unstale":"2024-09-17T03:46:38.867364+0000","last_undegraded":"2024-09-17T03:46:38.867364+0000","last_fullsized":"2024-09-17T03:46:38.867364+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:24.794528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.7","version":"198'2","reported_seq":15,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.878231+0000","last_change":"2024-09-17T03:46:37.861906+0000","last_active":"2024-09-17T03:46:38.878231+0000","last_peered":"2024-09-17T03:46:38.878231+0000","last_clean":"2024-09-17T03:46:38.878231+0000","last_became_active":"2024-09-17T03:46:37.861585+0000","last_became_peered":"2024-09-17T03:46:37.861585+0000","last_unstale":"2024-09-17T03:46:38.878231+0000","last_undegraded":"2024-09-17T03:46:38.878231+0000","last_fullsized":"2024-09-17T03:46:38.878231+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:21.971121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.885637+0000","last_change":"2024-09-17T03:46:38.884951+0000","last_active":"2024-09-17T03:46:38.885637+0000","last_peered":"2024-09-17T03:46:38.885637+0000","last_clean":"2024-09-17T03:46:38.885637+0000","last_became_active":"2024-09-17T03:46:38.884466+0000","last_became_peered":"2024-09-17T03:46:38.884466+0000","last_unstale":"2024-09-17T03:46:38.885637+0000","last_undegraded":"2024-09-17T03:46:38.885637+0000","last_fullsized":"2024-09-17T03:46:38.885637+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:11.881066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"199'1","reported_seq":16,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.870881+0000","last_change":"2024-09-17T03:46:37.859307+0000","last_active":"2024-09-17T03:46:39.870881+0000","last_peered":"2024-09-17T03:46:39.870881+0000","last_clean":"2024-09-17T03:46:39.870881+0000","last_became_active":"2024-09-17T03:46:37.858470+0000","last_became_peered":"2024-09-17T03:46:37.858470+0000","last_unstale":"2024-09-17T03:46:39.870881+0000","last_undegraded":"2024-09-17T03:46:39.870881+0000","last_fullsized":"2024-09-17T03:46:39.870881+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:05.387317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.881353+0000","last_change":"2024-09-17T03:46:38.873157+0000","last_active":"2024-09-17T03:46:38.881353+0000","last_peered":"2024-09-17T03:46:38.881353+0000","last_clean":"2024-09-17T03:46:38.881353+0000","last_became_active":"2024-09-17T03:46:38.871901+0000","last_became_peered":"2024-09-17T03:46:38.871901+0000","last_unstale":"2024-09-17T03:46:38.881353+0000","last_undegraded":"2024-09-17T03:46:38.881353+0000","last_fullsized":"2024-09-17T03:46:38.881353+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:38.788056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.858748+0000","last_change":"2024-09-17T03:46:37.856607+0000","last_active":"2024-09-17T03:46:38.858748+0000","last_peered":"2024-09-17T03:46:38.858748+0000","last_clean":"2024-09-17T03:46:38.858748+0000","last_became_active":"2024-09-17T03:46:37.856210+0000","last_became_peered":"2024-09-17T03:46:37.856210+0000","last_unstale":"2024-09-17T03:46:38.858748+0000","last_undegraded":"2024-09-17T03:46:38.858748+0000","last_fullsized":"2024-09-17T03:46:38.858748+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.093398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.873039+0000","last_change":"2024-09-17T03:46:38.858182+0000","last_active":"2024-09-17T03:46:38.873039+0000","last_peered":"2024-09-17T03:46:38.873039+0000","last_clean":"2024-09-17T03:46:38.873039+0000","last_became_active":"2024-09-17T03:46:38.857886+0000","last_became_peered":"2024-09-17T03:46:38.857886+0000","last_unstale":"2024-09-17T03:46:38.873039+0000","last_undegraded":"2024-09-17T03:46:38.873039+0000","last_fullsized":"2024-09-17T03:46:38.873039+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:35.037081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856707+0000","last_change":"2024-09-17T03:46:37.860656+0000","last_active":"2024-09-17T03:46:38.856707+0000","last_peered":"2024-09-17T03:46:38.856707+0000","last_clean":"2024-09-17T03:46:38.856707+0000","last_became_active":"2024-09-17T03:46:37.860363+0000","last_became_peered":"2024-09-17T03:46:37.860363+0000","last_unstale":"2024-09-17T03:46:38.856707+0000","last_undegraded":"2024-09-17T03:46:38.856707+0000","last_fullsized":"2024-09-17T03:46:38.856707+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:51.416909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871718+0000","last_change":"2024-09-17T03:46:38.869909+0000","last_active":"2024-09-17T03:46:38.871718+0000","last_peered":"2024-09-17T03:46:38.871718+0000","last_clean":"2024-09-17T03:46:38.871718+0000","last_became_active":"2024-09-17T03:46:38.869591+0000","last_became_peered":"2024-09-17T03:46:38.869591+0000","last_unstale":"2024-09-17T03:46:38.871718+0000","last_undegraded":"2024-09-17T03:46:38.871718+0000","last_fullsized":"2024-09-17T03:46:38.871718+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:11.881066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.859758+0000","last_change":"2024-09-17T03:46:37.858101+0000","last_active":"2024-09-17T03:46:38.859758+0000","last_peered":"2024-09-17T03:46:38.859758+0000","last_clean":"2024-09-17T03:46:38.859758+0000","last_became_active":"2024-09-17T03:46:37.857577+0000","last_became_peered":"2024-09-17T03:46:37.857577+0000","last_unstale":"2024-09-17T03:46:38.859758+0000","last_undegraded":"2024-09-17T03:46:38.859758+0000","last_fullsized":"2024-09-17T03:46:38.859758+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:58.497943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.868076+0000","last_change":"2024-09-17T03:46:38.861305+0000","last_active":"2024-09-17T03:46:38.868076+0000","last_peered":"2024-09-17T03:46:38.868076+0000","last_clean":"2024-09-17T03:46:38.868076+0000","last_became_active":"2024-09-17T03:46:38.860980+0000","last_became_peered":"2024-09-17T03:46:38.860980+0000","last_unstale":"2024-09-17T03:46:38.868076+0000","last_undegraded":"2024-09-17T03:46:38.868076+0000","last_fullsized":"2024-09-17T03:46:38.868076+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:47.778627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":13,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.850086+0000","last_change":"2024-09-17T03:46:37.861053+0000","last_active":"2024-09-17T03:46:38.850086+0000","last_peered":"2024-09-17T03:46:38.850086+0000","last_clean":"2024-09-17T03:46:38.850086+0000","last_became_active":"2024-09-17T03:46:37.860753+0000","last_became_peered":"2024-09-17T03:46:37.860753+0000","last_unstale":"2024-09-17T03:46:38.850086+0000","last_undegraded":"2024-09-17T03:46:38.850086+0000","last_fullsized":"2024-09-17T03:46:38.850086+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:48.523839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.871032+0000","last_change":"2024-09-17T03:46:38.865353+0000","last_active":"2024-09-17T03:46:38.871032+0000","last_peered":"2024-09-17T03:46:38.871032+0000","last_clean":"2024-09-17T03:46:38.871032+0000","last_became_active":"2024-09-17T03:46:38.864736+0000","last_became_peered":"2024-09-17T03:46:38.864736+0000","last_unstale":"2024-09-17T03:46:38.871032+0000","last_undegraded":"2024-09-17T03:46:38.871032+0000","last_fullsized":"2024-09-17T03:46:38.871032+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:08.952464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420625+0000","last_change":"2024-09-17T03:46:37.857507+0000","last_active":"2024-09-17T03:46:40.420625+0000","last_peered":"2024-09-17T03:46:40.420625+0000","last_clean":"2024-09-17T03:46:40.420625+0000","last_became_active":"2024-09-17T03:46:37.857165+0000","last_became_peered":"2024-09-17T03:46:37.857165+0000","last_unstale":"2024-09-17T03:46:40.420625+0000","last_undegraded":"2024-09-17T03:46:40.420625+0000","last_fullsized":"2024-09-17T03:46:40.420625+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:05.429022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.884678+0000","last_change":"2024-09-17T03:46:38.882784+0000","last_active":"2024-09-17T03:46:38.884678+0000","last_peered":"2024-09-17T03:46:38.884678+0000","last_clean":"2024-09-17T03:46:38.884678+0000","last_became_active":"2024-09-17T03:46:38.882232+0000","last_became_peered":"2024-09-17T03:46:38.882232+0000","last_unstale":"2024-09-17T03:46:38.884678+0000","last_undegraded":"2024-09-17T03:46:38.884678+0000","last_fullsized":"2024-09-17T03:46:38.884678+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:27.696745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420751+0000","last_change":"2024-09-17T03:46:37.850371+0000","last_active":"2024-09-17T03:46:40.420751+0000","last_peered":"2024-09-17T03:46:40.420751+0000","last_clean":"2024-09-17T03:46:40.420751+0000","last_became_active":"2024-09-17T03:46:37.849154+0000","last_became_peered":"2024-09-17T03:46:37.849154+0000","last_unstale":"2024-09-17T03:46:40.420751+0000","last_undegraded":"2024-09-17T03:46:40.420751+0000","last_fullsized":"2024-09-17T03:46:40.420751+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:16.786678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.870988+0000","last_change":"2024-09-17T03:46:38.874481+0000","last_active":"2024-09-17T03:46:39.870988+0000","last_peered":"2024-09-17T03:46:39.870988+0000","last_clean":"2024-09-17T03:46:39.870988+0000","last_became_active":"2024-09-17T03:46:38.874084+0000","last_became_peered":"2024-09-17T03:46:38.874084+0000","last_unstale":"2024-09-17T03:46:39.870988+0000","last_undegraded":"2024-09-17T03:46:39.870988+0000","last_fullsized":"2024-09-17T03:46:39.870988+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:50.162234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1f","version":"198'4","reported_seq":19,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.421017+0000","last_change":"2024-09-17T03:46:37.859088+0000","last_active":"2024-09-17T03:46:40.421017+0000","last_peered":"2024-09-17T03:46:40.421017+0000","last_clean":"2024-09-17T03:46:40.421017+0000","last_became_active":"2024-09-17T03:46:37.858770+0000","last_became_peered":"2024-09-17T03:46:37.858770+0000","last_unstale":"2024-09-17T03:46:40.421017+0000","last_undegraded":"2024-09-17T03:46:40.421017+0000","last_fullsized":"2024-09-17T03:46:40.421017+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:51.712969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":436,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T03:46:38.856745+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:46:38.856745+0000","last_peered":"2024-09-17T03:46:38.856745+0000","last_clean":"2024-09-17T03:46:38.856745+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:46:38.856745+0000","last_undegraded":"2024-09-17T03:46:38.856745+0000","last_fullsized":"2024-09-17T03:46:38.856745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509610,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60588,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311252,"statfs":{"total":96636764160,"available":96574722048,"internally_reserved":0,"allocated":3096576,"data_stored":1689513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509610,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60012,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311828,"statfs":{"total":96636764160,"available":96575311872,"internally_reserved":0,"allocated":2506752,"data_stored":1099679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509610,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65524,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306316,"statfs":{"total":96636764160,"available":96569667584,"internally_reserved":0,"allocated":2519040,"data_stored":1100779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509610,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55844,"kb_used_data":2444,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315996,"statfs":{"total":96636764160,"available":96579579904,"internally_reserved":0,"allocated":2502656,"data_stored":1099165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509611,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59992,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311848,"statfs":{"total":96636764160,"available":96575332352,"internally_reserved":0,"allocated":2486272,"data_stored":1092300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509611,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56428,"kb_used_data":3024,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315412,"statfs":{"total":96636764160,"available":96578981888,"internally_reserved":0,"allocated":3096576,"data_stored":1689477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575018,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55852,"kb_used_data":2452,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315988,"statfs":{"total":96636764160,"available":96579571712,"internally_reserved":0,"allocated":2510848,"data_stored":1105375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575018,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60016,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311824,"statfs":{"total":96636764160,"available":96575307776,"internally_reserved":0,"allocated":2514944,"data_stored":1105957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:46:44.828 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-09-17T03:46:44.828+0000 7f045c103640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:46:47.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:46:47.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.487+0000 7fccefc9b640 1 -- 172.21.15.146:0/3846329965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce815cbe0 msgr2=0x7fcce80d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:47.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.487+0000 7fccefc9b640 1 --2- 172.21.15.146:0/3846329965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce815cbe0 0x7fcce80d0b10 secure :-1 s=READY pgs=2574 cs=0 l=1 rev1=1 crypto rx=0x7fcce8072960 tx=0x7fccd802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.487+0000 7fccefc9b640 1 -- 172.21.15.146:0/3846329965 shutdown_connections 2024-09-17T03:46:47.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.487+0000 7fccefc9b640 1 --2- 172.21.15.146:0/3846329965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce815cbe0 0x7fcce80d0b10 unknown :-1 s=CLOSED pgs=2574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.487+0000 7fccefc9b640 1 --2- 172.21.15.146:0/3846329965 >> v2:172.21.15.179:3300/0 conn(0x7fcce80d31e0 0x7fcce80cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.487+0000 7fccefc9b640 1 -- 172.21.15.146:0/3846329965 >> 172.21.15.146:0/3846329965 conn(0x7fcce80d26c0 msgr2=0x7fcce80d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:47.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.487+0000 7fccefc9b640 1 -- 172.21.15.146:0/3846329965 shutdown_connections 2024-09-17T03:46:47.488 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.487+0000 7fccefc9b640 1 -- 172.21.15.146:0/3846329965 wait complete. 2024-09-17T03:46:47.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.489+0000 7fccefc9b640 1 Processor -- start 2024-09-17T03:46:47.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.489+0000 7fccefc9b640 1 -- start start 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.490+0000 7fccefc9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce80d1050 0x7fcce815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.490+0000 7fccefc9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcce80d31e0 0x7fcce81e7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.490+0000 7fccefc9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce815cbe0 0x7fcce81e7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.490+0000 7fccefc9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fcce80cd7b0 con 0x7fcce80d1050 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.490+0000 7fccefc9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcce80b6cf0 con 0x7fcce815cbe0 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.490+0000 7fccefc9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcce80cd930 con 0x7fcce80d31e0 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.490+0000 7fcceda37640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce80d1050 0x7fcce815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.490+0000 7fcceda37640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce80d1050 0x7fcce815bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51542/0 (socket says 172.21.15.146:51542) 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.490+0000 7fcceda37640 1 -- 172.21.15.146:0/821521418 learned_addr learned my addr 172.21.15.146:0/821521418 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fcced236640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcce80d31e0 0x7fcce81e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fccee238640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce815cbe0 0x7fcce81e7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:47.492 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fcceda37640 1 -- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcce80d31e0 msgr2=0x7fcce81e7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fcceda37640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcce80d31e0 0x7fcce81e7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fcceda37640 1 -- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce815cbe0 msgr2=0x7fcce81e7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fcceda37640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce815cbe0 0x7fcce81e7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fcceda37640 1 -- 172.21.15.146:0/821521418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce8160580 con 0x7fcce80d1050 2024-09-17T03:46:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fccee238640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce815cbe0 0x7fcce81e7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fcceda37640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce80d1050 0x7fcce815bdf0 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7fcce400d750 tx=0x7fcce400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fccde7fc640 1 -- 172.21.15.146:0/821521418 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4009c30 con 0x7fcce80d1050 2024-09-17T03:46:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fccde7fc640 1 -- 172.21.15.146:0/821521418 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcce400de60 con 0x7fcce80d1050 2024-09-17T03:46:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fccefc9b640 1 -- 172.21.15.146:0/821521418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce80cb810 con 0x7fcce80d1050 2024-09-17T03:46:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fccde7fc640 1 -- 172.21.15.146:0/821521418 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4004280 con 0x7fcce80d1050 2024-09-17T03:46:47.493 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.491+0000 7fccefc9b640 1 -- 172.21.15.146:0/821521418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce80cbdb0 con 0x7fcce80d1050 2024-09-17T03:46:47.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.492+0000 7fccefc9b640 1 -- 172.21.15.146:0/821521418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce80cde50 con 0x7fcce80d1050 2024-09-17T03:46:47.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.493+0000 7fccde7fc640 1 -- 172.21.15.146:0/821521418 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcce4005030 con 0x7fcce80d1050 2024-09-17T03:46:47.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.493+0000 7fccde7fc640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcccc078bc0 0x7fcccc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:47.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.493+0000 7fccde7fc640 1 -- 172.21.15.146:0/821521418 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7fcce409b330 con 0x7fcce80d1050 2024-09-17T03:46:47.494 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.494+0000 7fcced236640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcccc078bc0 0x7fcccc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:47.495 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.494+0000 7fcced236640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcccc078bc0 0x7fcccc07b0d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fccd8033000 tx=0x7fccd8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:47.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.498+0000 7fccde7fc640 1 -- 172.21.15.146:0/821521418 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcce4020020 con 0x7fcce80d1050 2024-09-17T03:46:47.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.669+0000 7fccefc9b640 1 -- 172.21.15.146:0/821521418 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcce80761d0 con 0x7fcccc078bc0 2024-09-17T03:46:47.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.674+0000 7fccde7fc640 1 -- 172.21.15.146:0/821521418 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252429 (secure 0 0 0) 0x7fcce80761d0 con 0x7fcccc078bc0 2024-09-17T03:46:47.676 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:47.678 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:46:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 -- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcccc078bc0 msgr2=0x7fcccc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcccc078bc0 0x7fcccc07b0d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fccd8033000 tx=0x7fccd8004730 comp rx=0 tx=0).stop 2024-09-17T03:46:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 -- 172.21.15.146:0/821521418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce80d1050 msgr2=0x7fcce815bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce80d1050 0x7fcce815bdf0 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7fcce400d750 tx=0x7fcce400dc10 comp rx=0 tx=0).stop 2024-09-17T03:46:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 -- 172.21.15.146:0/821521418 shutdown_connections 2024-09-17T03:46:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fcccc078bc0 0x7fcccc07b0d0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcce815cbe0 0x7fcce81e7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcce80d31e0 0x7fcce81e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 --2- 172.21.15.146:0/821521418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcce80d1050 0x7fcce815bdf0 unknown :-1 s=CLOSED pgs=2575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 -- 172.21.15.146:0/821521418 >> 172.21.15.146:0/821521418 conn(0x7fcce80d26c0 msgr2=0x7fcce80b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 -- 172.21.15.146:0/821521418 shutdown_connections 2024-09-17T03:46:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.677+0000 7fccefc9b640 1 -- 172.21.15.146:0/821521418 wait complete. 2024-09-17T03:46:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":612,"stamp":"2024-09-17T03:46:46.011871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474332,"kb_used_data":20840,"kb_used_omap":12,"kb_used_meta":453299,"kb_avail":754500388,"statfs":{"total":773094113280,"available":772608397312,"internally_reserved":0,"allocated":21340160,"data_stored":10028556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":464178737},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001781"},"pg_stats":[{"pgid":"31.3f","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863793+0000","last_change":"2024-09-17T03:46:38.871668+0000","last_active":"2024-09-17T03:46:39.863793+0000","last_peered":"2024-09-17T03:46:39.863793+0000","last_clean":"2024-09-17T03:46:39.863793+0000","last_became_active":"2024-09-17T03:46:38.871334+0000","last_became_peered":"2024-09-17T03:46:38.871334+0000","last_unstale":"2024-09-17T03:46:39.863793+0000","last_undegraded":"2024-09-17T03:46:39.863793+0000","last_fullsized":"2024-09-17T03:46:39.863793+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:06.935629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863735+0000","last_change":"2024-09-17T03:46:38.879231+0000","last_active":"2024-09-17T03:46:39.863735+0000","last_peered":"2024-09-17T03:46:39.863735+0000","last_clean":"2024-09-17T03:46:39.863735+0000","last_became_active":"2024-09-17T03:46:38.878901+0000","last_became_peered":"2024-09-17T03:46:38.878901+0000","last_unstale":"2024-09-17T03:46:39.863735+0000","last_undegraded":"2024-09-17T03:46:39.863735+0000","last_fullsized":"2024-09-17T03:46:39.863735+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:17.248059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420844+0000","last_change":"2024-09-17T03:46:38.858931+0000","last_active":"2024-09-17T03:46:40.420844+0000","last_peered":"2024-09-17T03:46:40.420844+0000","last_clean":"2024-09-17T03:46:40.420844+0000","last_became_active":"2024-09-17T03:46:38.858612+0000","last_became_peered":"2024-09-17T03:46:38.858612+0000","last_unstale":"2024-09-17T03:46:40.420844+0000","last_undegraded":"2024-09-17T03:46:40.420844+0000","last_fullsized":"2024-09-17T03:46:40.420844+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:08.043054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836657+0000","last_change":"2024-09-17T03:46:38.866452+0000","last_active":"2024-09-17T03:46:40.836657+0000","last_peered":"2024-09-17T03:46:40.836657+0000","last_clean":"2024-09-17T03:46:40.836657+0000","last_became_active":"2024-09-17T03:46:38.866088+0000","last_became_peered":"2024-09-17T03:46:38.866088+0000","last_unstale":"2024-09-17T03:46:40.836657+0000","last_undegraded":"2024-09-17T03:46:40.836657+0000","last_fullsized":"2024-09-17T03:46:40.836657+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:47.065201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.870813+0000","last_change":"2024-09-17T03:46:38.870977+0000","last_active":"2024-09-17T03:46:39.870813+0000","last_peered":"2024-09-17T03:46:39.870813+0000","last_clean":"2024-09-17T03:46:39.870813+0000","last_became_active":"2024-09-17T03:46:38.870662+0000","last_became_peered":"2024-09-17T03:46:38.870662+0000","last_unstale":"2024-09-17T03:46:39.870813+0000","last_undegraded":"2024-09-17T03:46:39.870813+0000","last_fullsized":"2024-09-17T03:46:39.870813+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:15.308843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836380+0000","last_change":"2024-09-17T03:46:38.862117+0000","last_active":"2024-09-17T03:46:40.836380+0000","last_peered":"2024-09-17T03:46:40.836380+0000","last_clean":"2024-09-17T03:46:40.836380+0000","last_became_active":"2024-09-17T03:46:38.861759+0000","last_became_peered":"2024-09-17T03:46:38.861759+0000","last_unstale":"2024-09-17T03:46:40.836380+0000","last_undegraded":"2024-09-17T03:46:40.836380+0000","last_fullsized":"2024-09-17T03:46:40.836380+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:53.011231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.866825+0000","last_change":"2024-09-17T03:46:38.877127+0000","last_active":"2024-09-17T03:46:39.866825+0000","last_peered":"2024-09-17T03:46:39.866825+0000","last_clean":"2024-09-17T03:46:39.866825+0000","last_became_active":"2024-09-17T03:46:38.876807+0000","last_became_peered":"2024-09-17T03:46:38.876807+0000","last_unstale":"2024-09-17T03:46:39.866825+0000","last_undegraded":"2024-09-17T03:46:39.866825+0000","last_fullsized":"2024-09-17T03:46:39.866825+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:10.910513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.864984+0000","last_change":"2024-09-17T03:46:38.866116+0000","last_active":"2024-09-17T03:46:39.864984+0000","last_peered":"2024-09-17T03:46:39.864984+0000","last_clean":"2024-09-17T03:46:39.864984+0000","last_became_active":"2024-09-17T03:46:38.865806+0000","last_became_peered":"2024-09-17T03:46:38.865806+0000","last_unstale":"2024-09-17T03:46:39.864984+0000","last_undegraded":"2024-09-17T03:46:39.864984+0000","last_fullsized":"2024-09-17T03:46:39.864984+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:53.465361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.477990+0000","last_change":"2024-09-17T03:46:38.876509+0000","last_active":"2024-09-17T03:46:40.477990+0000","last_peered":"2024-09-17T03:46:40.477990+0000","last_clean":"2024-09-17T03:46:40.477990+0000","last_became_active":"2024-09-17T03:46:38.876170+0000","last_became_peered":"2024-09-17T03:46:38.876170+0000","last_unstale":"2024-09-17T03:46:40.477990+0000","last_undegraded":"2024-09-17T03:46:40.477990+0000","last_fullsized":"2024-09-17T03:46:40.477990+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:10.101126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867673+0000","last_change":"2024-09-17T03:46:38.869498+0000","last_active":"2024-09-17T03:46:39.867673+0000","last_peered":"2024-09-17T03:46:39.867673+0000","last_clean":"2024-09-17T03:46:39.867673+0000","last_became_active":"2024-09-17T03:46:38.869166+0000","last_became_peered":"2024-09-17T03:46:38.869166+0000","last_unstale":"2024-09-17T03:46:39.867673+0000","last_undegraded":"2024-09-17T03:46:39.867673+0000","last_fullsized":"2024-09-17T03:46:39.867673+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:35.037081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836957+0000","last_change":"2024-09-17T03:46:38.874775+0000","last_active":"2024-09-17T03:46:40.836957+0000","last_peered":"2024-09-17T03:46:40.836957+0000","last_clean":"2024-09-17T03:46:40.836957+0000","last_became_active":"2024-09-17T03:46:38.874487+0000","last_became_peered":"2024-09-17T03:46:38.874487+0000","last_unstale":"2024-09-17T03:46:40.836957+0000","last_undegraded":"2024-09-17T03:46:40.836957+0000","last_fullsized":"2024-09-17T03:46:40.836957+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:36.066155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.865971+0000","last_change":"2024-09-17T03:46:38.864701+0000","last_active":"2024-09-17T03:46:39.865971+0000","last_peered":"2024-09-17T03:46:39.865971+0000","last_clean":"2024-09-17T03:46:39.865971+0000","last_became_active":"2024-09-17T03:46:38.864315+0000","last_became_peered":"2024-09-17T03:46:38.864315+0000","last_unstale":"2024-09-17T03:46:39.865971+0000","last_undegraded":"2024-09-17T03:46:39.865971+0000","last_fullsized":"2024-09-17T03:46:39.865971+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:16.833020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867435+0000","last_change":"2024-09-17T03:46:38.877166+0000","last_active":"2024-09-17T03:46:39.867435+0000","last_peered":"2024-09-17T03:46:39.867435+0000","last_clean":"2024-09-17T03:46:39.867435+0000","last_became_active":"2024-09-17T03:46:38.876853+0000","last_became_peered":"2024-09-17T03:46:38.876853+0000","last_unstale":"2024-09-17T03:46:39.867435+0000","last_undegraded":"2024-09-17T03:46:39.867435+0000","last_fullsized":"2024-09-17T03:46:39.867435+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:21.384878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863544+0000","last_change":"2024-09-17T03:46:38.871599+0000","last_active":"2024-09-17T03:46:39.863544+0000","last_peered":"2024-09-17T03:46:39.863544+0000","last_clean":"2024-09-17T03:46:39.863544+0000","last_became_active":"2024-09-17T03:46:38.871279+0000","last_became_peered":"2024-09-17T03:46:38.871279+0000","last_unstale":"2024-09-17T03:46:39.863544+0000","last_undegraded":"2024-09-17T03:46:39.863544+0000","last_fullsized":"2024-09-17T03:46:39.863544+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:26.111862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.477663+0000","last_change":"2024-09-17T03:46:38.877390+0000","last_active":"2024-09-17T03:46:40.477663+0000","last_peered":"2024-09-17T03:46:40.477663+0000","last_clean":"2024-09-17T03:46:40.477663+0000","last_became_active":"2024-09-17T03:46:38.877043+0000","last_became_peered":"2024-09-17T03:46:38.877043+0000","last_unstale":"2024-09-17T03:46:40.477663+0000","last_undegraded":"2024-09-17T03:46:40.477663+0000","last_fullsized":"2024-09-17T03:46:40.477663+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:24.899437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420556+0000","last_change":"2024-09-17T03:46:38.867618+0000","last_active":"2024-09-17T03:46:40.420556+0000","last_peered":"2024-09-17T03:46:40.420556+0000","last_clean":"2024-09-17T03:46:40.420556+0000","last_became_active":"2024-09-17T03:46:38.867337+0000","last_became_peered":"2024-09-17T03:46:38.867337+0000","last_unstale":"2024-09-17T03:46:40.420556+0000","last_undegraded":"2024-09-17T03:46:40.420556+0000","last_fullsized":"2024-09-17T03:46:40.420556+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:50.927543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.866118+0000","last_change":"2024-09-17T03:46:38.855444+0000","last_active":"2024-09-17T03:46:39.866118+0000","last_peered":"2024-09-17T03:46:39.866118+0000","last_clean":"2024-09-17T03:46:39.866118+0000","last_became_active":"2024-09-17T03:46:38.855104+0000","last_became_peered":"2024-09-17T03:46:38.855104+0000","last_unstale":"2024-09-17T03:46:39.866118+0000","last_undegraded":"2024-09-17T03:46:39.866118+0000","last_fullsized":"2024-09-17T03:46:39.866118+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:39.019606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863930+0000","last_change":"2024-09-17T03:46:38.869122+0000","last_active":"2024-09-17T03:46:39.863930+0000","last_peered":"2024-09-17T03:46:39.863930+0000","last_clean":"2024-09-17T03:46:39.863930+0000","last_became_active":"2024-09-17T03:46:38.868818+0000","last_became_peered":"2024-09-17T03:46:38.868818+0000","last_unstale":"2024-09-17T03:46:39.863930+0000","last_undegraded":"2024-09-17T03:46:39.863930+0000","last_fullsized":"2024-09-17T03:46:39.863930+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:07.118394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.865998+0000","last_change":"2024-09-17T03:46:38.873994+0000","last_active":"2024-09-17T03:46:39.865998+0000","last_peered":"2024-09-17T03:46:39.865998+0000","last_clean":"2024-09-17T03:46:39.865998+0000","last_became_active":"2024-09-17T03:46:38.873589+0000","last_became_peered":"2024-09-17T03:46:38.873589+0000","last_unstale":"2024-09-17T03:46:39.865998+0000","last_undegraded":"2024-09-17T03:46:39.865998+0000","last_fullsized":"2024-09-17T03:46:39.865998+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:47.484288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.421114+0000","last_change":"2024-09-17T03:46:38.867002+0000","last_active":"2024-09-17T03:46:40.421114+0000","last_peered":"2024-09-17T03:46:40.421114+0000","last_clean":"2024-09-17T03:46:40.421114+0000","last_became_active":"2024-09-17T03:46:38.866625+0000","last_became_peered":"2024-09-17T03:46:38.866625+0000","last_unstale":"2024-09-17T03:46:40.421114+0000","last_undegraded":"2024-09-17T03:46:40.421114+0000","last_fullsized":"2024-09-17T03:46:40.421114+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:17.704242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.865377+0000","last_change":"2024-09-17T03:46:38.869135+0000","last_active":"2024-09-17T03:46:39.865377+0000","last_peered":"2024-09-17T03:46:39.865377+0000","last_clean":"2024-09-17T03:46:39.865377+0000","last_became_active":"2024-09-17T03:46:38.868524+0000","last_became_peered":"2024-09-17T03:46:38.868524+0000","last_unstale":"2024-09-17T03:46:39.865377+0000","last_undegraded":"2024-09-17T03:46:39.865377+0000","last_fullsized":"2024-09-17T03:46:39.865377+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:34.742565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867113+0000","last_change":"2024-09-17T03:46:38.871659+0000","last_active":"2024-09-17T03:46:39.867113+0000","last_peered":"2024-09-17T03:46:39.867113+0000","last_clean":"2024-09-17T03:46:39.867113+0000","last_became_active":"2024-09-17T03:46:38.871304+0000","last_became_peered":"2024-09-17T03:46:38.871304+0000","last_unstale":"2024-09-17T03:46:39.867113+0000","last_undegraded":"2024-09-17T03:46:39.867113+0000","last_fullsized":"2024-09-17T03:46:39.867113+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:37.099253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.865119+0000","last_change":"2024-09-17T03:46:38.862294+0000","last_active":"2024-09-17T03:46:39.865119+0000","last_peered":"2024-09-17T03:46:39.865119+0000","last_clean":"2024-09-17T03:46:39.865119+0000","last_became_active":"2024-09-17T03:46:38.861912+0000","last_became_peered":"2024-09-17T03:46:38.861912+0000","last_unstale":"2024-09-17T03:46:39.865119+0000","last_undegraded":"2024-09-17T03:46:39.865119+0000","last_fullsized":"2024-09-17T03:46:39.865119+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:04.314651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863505+0000","last_change":"2024-09-17T03:46:38.876742+0000","last_active":"2024-09-17T03:46:39.863505+0000","last_peered":"2024-09-17T03:46:39.863505+0000","last_clean":"2024-09-17T03:46:39.863505+0000","last_became_active":"2024-09-17T03:46:38.876441+0000","last_became_peered":"2024-09-17T03:46:38.876441+0000","last_unstale":"2024-09-17T03:46:39.863505+0000","last_undegraded":"2024-09-17T03:46:39.863505+0000","last_fullsized":"2024-09-17T03:46:39.863505+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:10.910513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836955+0000","last_change":"2024-09-17T03:46:38.862445+0000","last_active":"2024-09-17T03:46:40.836955+0000","last_peered":"2024-09-17T03:46:40.836955+0000","last_clean":"2024-09-17T03:46:40.836955+0000","last_became_active":"2024-09-17T03:46:38.861998+0000","last_became_peered":"2024-09-17T03:46:38.861998+0000","last_unstale":"2024-09-17T03:46:40.836955+0000","last_undegraded":"2024-09-17T03:46:40.836955+0000","last_fullsized":"2024-09-17T03:46:40.836955+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:14.748771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867372+0000","last_change":"2024-09-17T03:46:38.877664+0000","last_active":"2024-09-17T03:46:39.867372+0000","last_peered":"2024-09-17T03:46:39.867372+0000","last_clean":"2024-09-17T03:46:39.867372+0000","last_became_active":"2024-09-17T03:46:38.877375+0000","last_became_peered":"2024-09-17T03:46:38.877375+0000","last_unstale":"2024-09-17T03:46:39.867372+0000","last_undegraded":"2024-09-17T03:46:39.867372+0000","last_fullsized":"2024-09-17T03:46:39.867372+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:53.452915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.837109+0000","last_change":"2024-09-17T03:46:38.874450+0000","last_active":"2024-09-17T03:46:40.837109+0000","last_peered":"2024-09-17T03:46:40.837109+0000","last_clean":"2024-09-17T03:46:40.837109+0000","last_became_active":"2024-09-17T03:46:38.873914+0000","last_became_peered":"2024-09-17T03:46:38.873914+0000","last_unstale":"2024-09-17T03:46:40.837109+0000","last_undegraded":"2024-09-17T03:46:40.837109+0000","last_fullsized":"2024-09-17T03:46:40.837109+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:46.473745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863657+0000","last_change":"2024-09-17T03:46:38.880123+0000","last_active":"2024-09-17T03:46:39.863657+0000","last_peered":"2024-09-17T03:46:39.863657+0000","last_clean":"2024-09-17T03:46:39.863657+0000","last_became_active":"2024-09-17T03:46:38.879828+0000","last_became_peered":"2024-09-17T03:46:38.879828+0000","last_unstale":"2024-09-17T03:46:39.863657+0000","last_undegraded":"2024-09-17T03:46:39.863657+0000","last_fullsized":"2024-09-17T03:46:39.863657+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:39.802070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.837081+0000","last_change":"2024-09-17T03:46:38.864173+0000","last_active":"2024-09-17T03:46:40.837081+0000","last_peered":"2024-09-17T03:46:40.837081+0000","last_clean":"2024-09-17T03:46:40.837081+0000","last_became_active":"2024-09-17T03:46:38.863861+0000","last_became_peered":"2024-09-17T03:46:38.863861+0000","last_unstale":"2024-09-17T03:46:40.837081+0000","last_undegraded":"2024-09-17T03:46:40.837081+0000","last_fullsized":"2024-09-17T03:46:40.837081+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:36.600806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.870825+0000","last_change":"2024-09-17T03:46:38.865938+0000","last_active":"2024-09-17T03:46:39.870825+0000","last_peered":"2024-09-17T03:46:39.870825+0000","last_clean":"2024-09-17T03:46:39.870825+0000","last_became_active":"2024-09-17T03:46:38.865609+0000","last_became_peered":"2024-09-17T03:46:38.865609+0000","last_unstale":"2024-09-17T03:46:39.870825+0000","last_undegraded":"2024-09-17T03:46:39.870825+0000","last_fullsized":"2024-09-17T03:46:39.870825+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:05.400623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836163+0000","last_change":"2024-09-17T03:46:38.875927+0000","last_active":"2024-09-17T03:46:40.836163+0000","last_peered":"2024-09-17T03:46:40.836163+0000","last_clean":"2024-09-17T03:46:40.836163+0000","last_became_active":"2024-09-17T03:46:38.875618+0000","last_became_peered":"2024-09-17T03:46:38.875618+0000","last_unstale":"2024-09-17T03:46:40.836163+0000","last_undegraded":"2024-09-17T03:46:40.836163+0000","last_fullsized":"2024-09-17T03:46:40.836163+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:08.912564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863707+0000","last_change":"2024-09-17T03:46:38.870813+0000","last_active":"2024-09-17T03:46:39.863707+0000","last_peered":"2024-09-17T03:46:39.863707+0000","last_clean":"2024-09-17T03:46:39.863707+0000","last_became_active":"2024-09-17T03:46:38.870493+0000","last_became_peered":"2024-09-17T03:46:38.870493+0000","last_unstale":"2024-09-17T03:46:39.863707+0000","last_undegraded":"2024-09-17T03:46:39.863707+0000","last_fullsized":"2024-09-17T03:46:39.863707+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:22.583146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.421012+0000","last_change":"2024-09-17T03:46:38.865947+0000","last_active":"2024-09-17T03:46:40.421012+0000","last_peered":"2024-09-17T03:46:40.421012+0000","last_clean":"2024-09-17T03:46:40.421012+0000","last_became_active":"2024-09-17T03:46:38.865631+0000","last_became_peered":"2024-09-17T03:46:38.865631+0000","last_unstale":"2024-09-17T03:46:40.421012+0000","last_undegraded":"2024-09-17T03:46:40.421012+0000","last_fullsized":"2024-09-17T03:46:40.421012+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:34.958141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1e","version":"198'1","reported_seq":16,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867907+0000","last_change":"2024-09-17T03:46:37.849807+0000","last_active":"2024-09-17T03:46:39.867907+0000","last_peered":"2024-09-17T03:46:39.867907+0000","last_clean":"2024-09-17T03:46:39.867907+0000","last_became_active":"2024-09-17T03:46:37.849384+0000","last_became_peered":"2024-09-17T03:46:37.849384+0000","last_unstale":"2024-09-17T03:46:39.867907+0000","last_undegraded":"2024-09-17T03:46:39.867907+0000","last_fullsized":"2024-09-17T03:46:39.867907+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:56.687816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.837477+0000","last_change":"2024-09-17T03:46:38.864532+0000","last_active":"2024-09-17T03:46:40.837477+0000","last_peered":"2024-09-17T03:46:40.837477+0000","last_clean":"2024-09-17T03:46:40.837477+0000","last_became_active":"2024-09-17T03:46:38.864221+0000","last_became_peered":"2024-09-17T03:46:38.864221+0000","last_unstale":"2024-09-17T03:46:40.837477+0000","last_undegraded":"2024-09-17T03:46:40.837477+0000","last_fullsized":"2024-09-17T03:46:40.837477+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:04.314165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1d","version":"198'2","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420648+0000","last_change":"2024-09-17T03:46:37.851833+0000","last_active":"2024-09-17T03:46:40.420648+0000","last_peered":"2024-09-17T03:46:40.420648+0000","last_clean":"2024-09-17T03:46:40.420648+0000","last_became_active":"2024-09-17T03:46:37.851531+0000","last_became_peered":"2024-09-17T03:46:37.851531+0000","last_unstale":"2024-09-17T03:46:40.420648+0000","last_undegraded":"2024-09-17T03:46:40.420648+0000","last_fullsized":"2024-09-17T03:46:40.420648+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:05.023218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.866092+0000","last_change":"2024-09-17T03:46:38.857502+0000","last_active":"2024-09-17T03:46:39.866092+0000","last_peered":"2024-09-17T03:46:39.866092+0000","last_clean":"2024-09-17T03:46:39.866092+0000","last_became_active":"2024-09-17T03:46:38.857193+0000","last_became_peered":"2024-09-17T03:46:38.857193+0000","last_unstale":"2024-09-17T03:46:39.866092+0000","last_undegraded":"2024-09-17T03:46:39.866092+0000","last_fullsized":"2024-09-17T03:46:39.866092+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:28.445042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1c","version":"198'2","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.421182+0000","last_change":"2024-09-17T03:46:37.850060+0000","last_active":"2024-09-17T03:46:40.421182+0000","last_peered":"2024-09-17T03:46:40.421182+0000","last_clean":"2024-09-17T03:46:40.421182+0000","last_became_active":"2024-09-17T03:46:37.849550+0000","last_became_peered":"2024-09-17T03:46:37.849550+0000","last_unstale":"2024-09-17T03:46:40.421182+0000","last_undegraded":"2024-09-17T03:46:40.421182+0000","last_fullsized":"2024-09-17T03:46:40.421182+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:21.228868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836574+0000","last_change":"2024-09-17T03:46:38.863432+0000","last_active":"2024-09-17T03:46:40.836574+0000","last_peered":"2024-09-17T03:46:40.836574+0000","last_clean":"2024-09-17T03:46:40.836574+0000","last_became_active":"2024-09-17T03:46:38.863073+0000","last_became_peered":"2024-09-17T03:46:38.863073+0000","last_unstale":"2024-09-17T03:46:40.836574+0000","last_undegraded":"2024-09-17T03:46:40.836574+0000","last_fullsized":"2024-09-17T03:46:40.836574+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:58.065555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1b","version":"198'1","reported_seq":16,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836313+0000","last_change":"2024-09-17T03:46:37.857697+0000","last_active":"2024-09-17T03:46:40.836313+0000","last_peered":"2024-09-17T03:46:40.836313+0000","last_clean":"2024-09-17T03:46:40.836313+0000","last_became_active":"2024-09-17T03:46:37.857396+0000","last_became_peered":"2024-09-17T03:46:37.857396+0000","last_unstale":"2024-09-17T03:46:40.836313+0000","last_undegraded":"2024-09-17T03:46:40.836313+0000","last_fullsized":"2024-09-17T03:46:40.836313+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:47.376600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.477710+0000","last_change":"2024-09-17T03:46:38.877940+0000","last_active":"2024-09-17T03:46:40.477710+0000","last_peered":"2024-09-17T03:46:40.477710+0000","last_clean":"2024-09-17T03:46:40.477710+0000","last_became_active":"2024-09-17T03:46:38.877521+0000","last_became_peered":"2024-09-17T03:46:38.877521+0000","last_unstale":"2024-09-17T03:46:40.477710+0000","last_undegraded":"2024-09-17T03:46:40.477710+0000","last_fullsized":"2024-09-17T03:46:40.477710+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:12.768400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"198'1","reported_seq":16,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863504+0000","last_change":"2024-09-17T03:46:37.853555+0000","last_active":"2024-09-17T03:46:39.863504+0000","last_peered":"2024-09-17T03:46:39.863504+0000","last_clean":"2024-09-17T03:46:39.863504+0000","last_became_active":"2024-09-17T03:46:37.853225+0000","last_became_peered":"2024-09-17T03:46:37.853225+0000","last_unstale":"2024-09-17T03:46:39.863504+0000","last_undegraded":"2024-09-17T03:46:39.863504+0000","last_fullsized":"2024-09-17T03:46:39.863504+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:52.469536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420590+0000","last_change":"2024-09-17T03:46:38.865217+0000","last_active":"2024-09-17T03:46:40.420590+0000","last_peered":"2024-09-17T03:46:40.420590+0000","last_clean":"2024-09-17T03:46:40.420590+0000","last_became_active":"2024-09-17T03:46:38.864894+0000","last_became_peered":"2024-09-17T03:46:38.864894+0000","last_unstale":"2024-09-17T03:46:40.420590+0000","last_undegraded":"2024-09-17T03:46:40.420590+0000","last_fullsized":"2024-09-17T03:46:40.420590+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:20.242463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867730+0000","last_change":"2024-09-17T03:46:37.856566+0000","last_active":"2024-09-17T03:46:39.867730+0000","last_peered":"2024-09-17T03:46:39.867730+0000","last_clean":"2024-09-17T03:46:39.867730+0000","last_became_active":"2024-09-17T03:46:37.856251+0000","last_became_peered":"2024-09-17T03:46:37.856251+0000","last_unstale":"2024-09-17T03:46:39.867730+0000","last_undegraded":"2024-09-17T03:46:39.867730+0000","last_fullsized":"2024-09-17T03:46:39.867730+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:11.674372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863531+0000","last_change":"2024-09-17T03:46:38.874486+0000","last_active":"2024-09-17T03:46:39.863531+0000","last_peered":"2024-09-17T03:46:39.863531+0000","last_clean":"2024-09-17T03:46:39.863531+0000","last_became_active":"2024-09-17T03:46:38.874172+0000","last_became_peered":"2024-09-17T03:46:38.874172+0000","last_unstale":"2024-09-17T03:46:39.863531+0000","last_undegraded":"2024-09-17T03:46:39.863531+0000","last_fullsized":"2024-09-17T03:46:39.863531+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:21.384878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420700+0000","last_change":"2024-09-17T03:46:37.850688+0000","last_active":"2024-09-17T03:46:40.420700+0000","last_peered":"2024-09-17T03:46:40.420700+0000","last_clean":"2024-09-17T03:46:40.420700+0000","last_became_active":"2024-09-17T03:46:37.850077+0000","last_became_peered":"2024-09-17T03:46:37.850077+0000","last_unstale":"2024-09-17T03:46:40.420700+0000","last_undegraded":"2024-09-17T03:46:40.420700+0000","last_fullsized":"2024-09-17T03:46:40.420700+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:55.851229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863969+0000","last_change":"2024-09-17T03:46:38.875932+0000","last_active":"2024-09-17T03:46:39.863969+0000","last_peered":"2024-09-17T03:46:39.863969+0000","last_clean":"2024-09-17T03:46:39.863969+0000","last_became_active":"2024-09-17T03:46:38.875606+0000","last_became_peered":"2024-09-17T03:46:38.875606+0000","last_unstale":"2024-09-17T03:46:39.863969+0000","last_undegraded":"2024-09-17T03:46:39.863969+0000","last_fullsized":"2024-09-17T03:46:39.863969+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:52.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.866064+0000","last_change":"2024-09-17T03:46:37.859345+0000","last_active":"2024-09-17T03:46:39.866064+0000","last_peered":"2024-09-17T03:46:39.866064+0000","last_clean":"2024-09-17T03:46:39.866064+0000","last_became_active":"2024-09-17T03:46:37.859006+0000","last_became_peered":"2024-09-17T03:46:37.859006+0000","last_unstale":"2024-09-17T03:46:39.866064+0000","last_undegraded":"2024-09-17T03:46:39.866064+0000","last_fullsized":"2024-09-17T03:46:39.866064+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:10.907090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.837669+0000","last_change":"2024-09-17T03:46:38.871889+0000","last_active":"2024-09-17T03:46:40.837669+0000","last_peered":"2024-09-17T03:46:40.837669+0000","last_clean":"2024-09-17T03:46:40.837669+0000","last_became_active":"2024-09-17T03:46:38.871405+0000","last_became_peered":"2024-09-17T03:46:38.871405+0000","last_unstale":"2024-09-17T03:46:40.837669+0000","last_undegraded":"2024-09-17T03:46:40.837669+0000","last_fullsized":"2024-09-17T03:46:40.837669+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:56.508474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420768+0000","last_change":"2024-09-17T03:46:37.857948+0000","last_active":"2024-09-17T03:46:40.420768+0000","last_peered":"2024-09-17T03:46:40.420768+0000","last_clean":"2024-09-17T03:46:40.420768+0000","last_became_active":"2024-09-17T03:46:37.857657+0000","last_became_peered":"2024-09-17T03:46:37.857657+0000","last_unstale":"2024-09-17T03:46:40.420768+0000","last_undegraded":"2024-09-17T03:46:40.420768+0000","last_fullsized":"2024-09-17T03:46:40.420768+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:46.258164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.421117+0000","last_change":"2024-09-17T03:46:38.877386+0000","last_active":"2024-09-17T03:46:40.421117+0000","last_peered":"2024-09-17T03:46:40.421117+0000","last_clean":"2024-09-17T03:46:40.421117+0000","last_became_active":"2024-09-17T03:46:38.876839+0000","last_became_peered":"2024-09-17T03:46:38.876839+0000","last_unstale":"2024-09-17T03:46:40.421117+0000","last_undegraded":"2024-09-17T03:46:40.421117+0000","last_fullsized":"2024-09-17T03:46:40.421117+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:15.568009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.15","version":"198'3","reported_seq":18,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863985+0000","last_change":"2024-09-17T03:46:37.857029+0000","last_active":"2024-09-17T03:46:39.863985+0000","last_peered":"2024-09-17T03:46:39.863985+0000","last_clean":"2024-09-17T03:46:39.863985+0000","last_became_active":"2024-09-17T03:46:37.856738+0000","last_became_peered":"2024-09-17T03:46:37.856738+0000","last_unstale":"2024-09-17T03:46:39.863985+0000","last_undegraded":"2024-09-17T03:46:39.863985+0000","last_fullsized":"2024-09-17T03:46:39.863985+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:01.595359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867534+0000","last_change":"2024-09-17T03:46:38.867964+0000","last_active":"2024-09-17T03:46:39.867534+0000","last_peered":"2024-09-17T03:46:39.867534+0000","last_clean":"2024-09-17T03:46:39.867534+0000","last_became_active":"2024-09-17T03:46:38.867541+0000","last_became_peered":"2024-09-17T03:46:38.867541+0000","last_unstale":"2024-09-17T03:46:39.867534+0000","last_undegraded":"2024-09-17T03:46:39.867534+0000","last_fullsized":"2024-09-17T03:46:39.867534+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:07.118394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.14","version":"198'6","reported_seq":21,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863657+0000","last_change":"2024-09-17T03:46:37.861154+0000","last_active":"2024-09-17T03:46:39.863657+0000","last_peered":"2024-09-17T03:46:39.863657+0000","last_clean":"2024-09-17T03:46:39.863657+0000","last_became_active":"2024-09-17T03:46:37.860819+0000","last_became_peered":"2024-09-17T03:46:37.860819+0000","last_unstale":"2024-09-17T03:46:39.863657+0000","last_undegraded":"2024-09-17T03:46:39.863657+0000","last_fullsized":"2024-09-17T03:46:39.863657+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:33.736709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867435+0000","last_change":"2024-09-17T03:46:38.869534+0000","last_active":"2024-09-17T03:46:39.867435+0000","last_peered":"2024-09-17T03:46:39.867435+0000","last_clean":"2024-09-17T03:46:39.867435+0000","last_became_active":"2024-09-17T03:46:38.869205+0000","last_became_peered":"2024-09-17T03:46:38.869205+0000","last_unstale":"2024-09-17T03:46:39.867435+0000","last_undegraded":"2024-09-17T03:46:39.867435+0000","last_fullsized":"2024-09-17T03:46:39.867435+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:14.514064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.13","version":"198'2","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863555+0000","last_change":"2024-09-17T03:46:37.857360+0000","last_active":"2024-09-17T03:46:39.863555+0000","last_peered":"2024-09-17T03:46:39.863555+0000","last_clean":"2024-09-17T03:46:39.863555+0000","last_became_active":"2024-09-17T03:46:37.857041+0000","last_became_peered":"2024-09-17T03:46:37.857041+0000","last_unstale":"2024-09-17T03:46:39.863555+0000","last_undegraded":"2024-09-17T03:46:39.863555+0000","last_fullsized":"2024-09-17T03:46:39.863555+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:15.827164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.477775+0000","last_change":"2024-09-17T03:46:38.866013+0000","last_active":"2024-09-17T03:46:40.477775+0000","last_peered":"2024-09-17T03:46:40.477775+0000","last_clean":"2024-09-17T03:46:40.477775+0000","last_became_active":"2024-09-17T03:46:38.865682+0000","last_became_peered":"2024-09-17T03:46:38.865682+0000","last_unstale":"2024-09-17T03:46:40.477775+0000","last_undegraded":"2024-09-17T03:46:40.477775+0000","last_fullsized":"2024-09-17T03:46:40.477775+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:19.573589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420614+0000","last_change":"2024-09-17T03:46:37.849974+0000","last_active":"2024-09-17T03:46:40.420614+0000","last_peered":"2024-09-17T03:46:40.420614+0000","last_clean":"2024-09-17T03:46:40.420614+0000","last_became_active":"2024-09-17T03:46:37.849660+0000","last_became_peered":"2024-09-17T03:46:37.849660+0000","last_unstale":"2024-09-17T03:46:40.420614+0000","last_undegraded":"2024-09-17T03:46:40.420614+0000","last_fullsized":"2024-09-17T03:46:40.420614+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:35.038415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836154+0000","last_change":"2024-09-17T03:46:38.876700+0000","last_active":"2024-09-17T03:46:40.836154+0000","last_peered":"2024-09-17T03:46:40.836154+0000","last_clean":"2024-09-17T03:46:40.836154+0000","last_became_active":"2024-09-17T03:46:38.876391+0000","last_became_peered":"2024-09-17T03:46:38.876391+0000","last_unstale":"2024-09-17T03:46:40.836154+0000","last_undegraded":"2024-09-17T03:46:40.836154+0000","last_fullsized":"2024-09-17T03:46:40.836154+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:43.107057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867808+0000","last_change":"2024-09-17T03:46:37.851640+0000","last_active":"2024-09-17T03:46:39.867808+0000","last_peered":"2024-09-17T03:46:39.867808+0000","last_clean":"2024-09-17T03:46:39.867808+0000","last_became_active":"2024-09-17T03:46:37.851293+0000","last_became_peered":"2024-09-17T03:46:37.851293+0000","last_unstale":"2024-09-17T03:46:39.867808+0000","last_undegraded":"2024-09-17T03:46:39.867808+0000","last_fullsized":"2024-09-17T03:46:39.867808+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:38.013751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.866884+0000","last_change":"2024-09-17T03:46:38.872576+0000","last_active":"2024-09-17T03:46:39.866884+0000","last_peered":"2024-09-17T03:46:39.866884+0000","last_clean":"2024-09-17T03:46:39.866884+0000","last_became_active":"2024-09-17T03:46:38.872235+0000","last_became_peered":"2024-09-17T03:46:38.872235+0000","last_unstale":"2024-09-17T03:46:39.866884+0000","last_undegraded":"2024-09-17T03:46:39.866884+0000","last_fullsized":"2024-09-17T03:46:39.866884+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:18.433296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.10","version":"198'8","reported_seq":23,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836238+0000","last_change":"2024-09-17T03:46:37.859205+0000","last_active":"2024-09-17T03:46:40.836238+0000","last_peered":"2024-09-17T03:46:40.836238+0000","last_clean":"2024-09-17T03:46:40.836238+0000","last_became_active":"2024-09-17T03:46:37.858827+0000","last_became_peered":"2024-09-17T03:46:37.858827+0000","last_unstale":"2024-09-17T03:46:40.836238+0000","last_undegraded":"2024-09-17T03:46:40.836238+0000","last_fullsized":"2024-09-17T03:46:40.836238+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:52.447059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.837226+0000","last_change":"2024-09-17T03:46:38.870343+0000","last_active":"2024-09-17T03:46:40.837226+0000","last_peered":"2024-09-17T03:46:40.837226+0000","last_clean":"2024-09-17T03:46:40.837226+0000","last_became_active":"2024-09-17T03:46:38.870050+0000","last_became_peered":"2024-09-17T03:46:38.870050+0000","last_unstale":"2024-09-17T03:46:40.837226+0000","last_undegraded":"2024-09-17T03:46:40.837226+0000","last_fullsized":"2024-09-17T03:46:40.837226+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:43.147235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.f","version":"198'1","reported_seq":16,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867604+0000","last_change":"2024-09-17T03:46:37.856352+0000","last_active":"2024-09-17T03:46:39.867604+0000","last_peered":"2024-09-17T03:46:39.867604+0000","last_clean":"2024-09-17T03:46:39.867604+0000","last_became_active":"2024-09-17T03:46:37.855823+0000","last_became_peered":"2024-09-17T03:46:37.855823+0000","last_unstale":"2024-09-17T03:46:39.867604+0000","last_undegraded":"2024-09-17T03:46:39.867604+0000","last_fullsized":"2024-09-17T03:46:39.867604+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:32.853630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420947+0000","last_change":"2024-09-17T03:46:38.866806+0000","last_active":"2024-09-17T03:46:40.420947+0000","last_peered":"2024-09-17T03:46:40.420947+0000","last_clean":"2024-09-17T03:46:40.420947+0000","last_became_active":"2024-09-17T03:46:38.866523+0000","last_became_peered":"2024-09-17T03:46:38.866523+0000","last_unstale":"2024-09-17T03:46:40.420947+0000","last_undegraded":"2024-09-17T03:46:40.420947+0000","last_fullsized":"2024-09-17T03:46:40.420947+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:20.966428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.e","version":"198'2","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420913+0000","last_change":"2024-09-17T03:46:37.852362+0000","last_active":"2024-09-17T03:46:40.420913+0000","last_peered":"2024-09-17T03:46:40.420913+0000","last_clean":"2024-09-17T03:46:40.420913+0000","last_became_active":"2024-09-17T03:46:37.852073+0000","last_became_peered":"2024-09-17T03:46:37.852073+0000","last_unstale":"2024-09-17T03:46:40.420913+0000","last_undegraded":"2024-09-17T03:46:40.420913+0000","last_fullsized":"2024-09-17T03:46:40.420913+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:38.266891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.477813+0000","last_change":"2024-09-17T03:46:38.869114+0000","last_active":"2024-09-17T03:46:40.477813+0000","last_peered":"2024-09-17T03:46:40.477813+0000","last_clean":"2024-09-17T03:46:40.477813+0000","last_became_active":"2024-09-17T03:46:38.868763+0000","last_became_peered":"2024-09-17T03:46:38.868763+0000","last_unstale":"2024-09-17T03:46:40.477813+0000","last_undegraded":"2024-09-17T03:46:40.477813+0000","last_fullsized":"2024-09-17T03:46:40.477813+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:11.581943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.d","version":"198'1","reported_seq":16,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.477964+0000","last_change":"2024-09-17T03:46:37.855339+0000","last_active":"2024-09-17T03:46:40.477964+0000","last_peered":"2024-09-17T03:46:40.477964+0000","last_clean":"2024-09-17T03:46:40.477964+0000","last_became_active":"2024-09-17T03:46:37.854766+0000","last_became_peered":"2024-09-17T03:46:37.854766+0000","last_unstale":"2024-09-17T03:46:40.477964+0000","last_undegraded":"2024-09-17T03:46:40.477964+0000","last_fullsized":"2024-09-17T03:46:40.477964+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:25.106006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.866266+0000","last_change":"2024-09-17T03:46:38.858260+0000","last_active":"2024-09-17T03:46:39.866266+0000","last_peered":"2024-09-17T03:46:39.866266+0000","last_clean":"2024-09-17T03:46:39.866266+0000","last_became_active":"2024-09-17T03:46:38.856652+0000","last_became_peered":"2024-09-17T03:46:38.856652+0000","last_unstale":"2024-09-17T03:46:39.866266+0000","last_undegraded":"2024-09-17T03:46:39.866266+0000","last_fullsized":"2024-09-17T03:46:39.866266+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:33.859485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.837689+0000","last_change":"2024-09-17T03:46:37.858541+0000","last_active":"2024-09-17T03:46:40.837689+0000","last_peered":"2024-09-17T03:46:40.837689+0000","last_clean":"2024-09-17T03:46:40.837689+0000","last_became_active":"2024-09-17T03:46:37.857850+0000","last_became_peered":"2024-09-17T03:46:37.857850+0000","last_unstale":"2024-09-17T03:46:40.837689+0000","last_undegraded":"2024-09-17T03:46:40.837689+0000","last_fullsized":"2024-09-17T03:46:40.837689+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:06.112538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.865324+0000","last_change":"2024-09-17T03:46:38.860988+0000","last_active":"2024-09-17T03:46:39.865324+0000","last_peered":"2024-09-17T03:46:39.865324+0000","last_clean":"2024-09-17T03:46:39.865324+0000","last_became_active":"2024-09-17T03:46:38.860657+0000","last_became_peered":"2024-09-17T03:46:38.860657+0000","last_unstale":"2024-09-17T03:46:39.865324+0000","last_undegraded":"2024-09-17T03:46:39.865324+0000","last_fullsized":"2024-09-17T03:46:39.865324+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:45.329849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.b","version":"198'2","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420894+0000","last_change":"2024-09-17T03:46:37.851777+0000","last_active":"2024-09-17T03:46:40.420894+0000","last_peered":"2024-09-17T03:46:40.420894+0000","last_clean":"2024-09-17T03:46:40.420894+0000","last_became_active":"2024-09-17T03:46:37.851068+0000","last_became_peered":"2024-09-17T03:46:37.851068+0000","last_unstale":"2024-09-17T03:46:40.420894+0000","last_undegraded":"2024-09-17T03:46:40.420894+0000","last_fullsized":"2024-09-17T03:46:40.420894+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:59.821952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863598+0000","last_change":"2024-09-17T03:46:38.872416+0000","last_active":"2024-09-17T03:46:39.863598+0000","last_peered":"2024-09-17T03:46:39.863598+0000","last_clean":"2024-09-17T03:46:39.863598+0000","last_became_active":"2024-09-17T03:46:38.872130+0000","last_became_peered":"2024-09-17T03:46:38.872130+0000","last_unstale":"2024-09-17T03:46:39.863598+0000","last_undegraded":"2024-09-17T03:46:39.863598+0000","last_fullsized":"2024-09-17T03:46:39.863598+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:42.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836784+0000","last_change":"2024-09-17T03:46:37.856091+0000","last_active":"2024-09-17T03:46:40.836784+0000","last_peered":"2024-09-17T03:46:40.836784+0000","last_clean":"2024-09-17T03:46:40.836784+0000","last_became_active":"2024-09-17T03:46:37.855774+0000","last_became_peered":"2024-09-17T03:46:37.855774+0000","last_unstale":"2024-09-17T03:46:40.836784+0000","last_undegraded":"2024-09-17T03:46:40.836784+0000","last_fullsized":"2024-09-17T03:46:40.836784+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:20.379023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836205+0000","last_change":"2024-09-17T03:46:38.872310+0000","last_active":"2024-09-17T03:46:40.836205+0000","last_peered":"2024-09-17T03:46:40.836205+0000","last_clean":"2024-09-17T03:46:40.836205+0000","last_became_active":"2024-09-17T03:46:38.871997+0000","last_became_peered":"2024-09-17T03:46:38.871997+0000","last_unstale":"2024-09-17T03:46:40.836205+0000","last_undegraded":"2024-09-17T03:46:40.836205+0000","last_fullsized":"2024-09-17T03:46:40.836205+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:29.926966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.477695+0000","last_change":"2024-09-17T03:46:37.855038+0000","last_active":"2024-09-17T03:46:40.477695+0000","last_peered":"2024-09-17T03:46:40.477695+0000","last_clean":"2024-09-17T03:46:40.477695+0000","last_became_active":"2024-09-17T03:46:37.854645+0000","last_became_peered":"2024-09-17T03:46:37.854645+0000","last_unstale":"2024-09-17T03:46:40.477695+0000","last_undegraded":"2024-09-17T03:46:40.477695+0000","last_fullsized":"2024-09-17T03:46:40.477695+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:09.904657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.865374+0000","last_change":"2024-09-17T03:46:38.855559+0000","last_active":"2024-09-17T03:46:39.865374+0000","last_peered":"2024-09-17T03:46:39.865374+0000","last_clean":"2024-09-17T03:46:39.865374+0000","last_became_active":"2024-09-17T03:46:38.855179+0000","last_became_peered":"2024-09-17T03:46:38.855179+0000","last_unstale":"2024-09-17T03:46:39.865374+0000","last_undegraded":"2024-09-17T03:46:39.865374+0000","last_fullsized":"2024-09-17T03:46:39.865374+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:53.475392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.866889+0000","last_change":"2024-09-17T03:46:37.850967+0000","last_active":"2024-09-17T03:46:39.866889+0000","last_peered":"2024-09-17T03:46:39.866889+0000","last_clean":"2024-09-17T03:46:39.866889+0000","last_became_active":"2024-09-17T03:46:37.849133+0000","last_became_peered":"2024-09-17T03:46:37.849133+0000","last_unstale":"2024-09-17T03:46:39.866889+0000","last_undegraded":"2024-09-17T03:46:39.866889+0000","last_fullsized":"2024-09-17T03:46:39.866889+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:27.439186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867640+0000","last_change":"2024-09-17T03:46:38.864300+0000","last_active":"2024-09-17T03:46:39.867640+0000","last_peered":"2024-09-17T03:46:39.867640+0000","last_clean":"2024-09-17T03:46:39.867640+0000","last_became_active":"2024-09-17T03:46:38.863911+0000","last_became_peered":"2024-09-17T03:46:38.863911+0000","last_unstale":"2024-09-17T03:46:39.867640+0000","last_undegraded":"2024-09-17T03:46:39.867640+0000","last_fullsized":"2024-09-17T03:46:39.867640+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:38.721703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.7","version":"198'2","reported_seq":17,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.837021+0000","last_change":"2024-09-17T03:46:37.861906+0000","last_active":"2024-09-17T03:46:40.837021+0000","last_peered":"2024-09-17T03:46:40.837021+0000","last_clean":"2024-09-17T03:46:40.837021+0000","last_became_active":"2024-09-17T03:46:37.861585+0000","last_became_peered":"2024-09-17T03:46:37.861585+0000","last_unstale":"2024-09-17T03:46:40.837021+0000","last_undegraded":"2024-09-17T03:46:40.837021+0000","last_fullsized":"2024-09-17T03:46:40.837021+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:21.971121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863801+0000","last_change":"2024-09-17T03:46:38.884951+0000","last_active":"2024-09-17T03:46:39.863801+0000","last_peered":"2024-09-17T03:46:39.863801+0000","last_clean":"2024-09-17T03:46:39.863801+0000","last_became_active":"2024-09-17T03:46:38.884466+0000","last_became_peered":"2024-09-17T03:46:38.884466+0000","last_unstale":"2024-09-17T03:46:39.863801+0000","last_undegraded":"2024-09-17T03:46:39.863801+0000","last_fullsized":"2024-09-17T03:46:39.863801+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:00.957700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"199'1","reported_seq":16,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.870881+0000","last_change":"2024-09-17T03:46:37.859307+0000","last_active":"2024-09-17T03:46:39.870881+0000","last_peered":"2024-09-17T03:46:39.870881+0000","last_clean":"2024-09-17T03:46:39.870881+0000","last_became_active":"2024-09-17T03:46:37.858470+0000","last_became_peered":"2024-09-17T03:46:37.858470+0000","last_unstale":"2024-09-17T03:46:39.870881+0000","last_undegraded":"2024-09-17T03:46:39.870881+0000","last_fullsized":"2024-09-17T03:46:39.870881+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:05.387317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.837481+0000","last_change":"2024-09-17T03:46:38.873157+0000","last_active":"2024-09-17T03:46:40.837481+0000","last_peered":"2024-09-17T03:46:40.837481+0000","last_clean":"2024-09-17T03:46:40.837481+0000","last_became_active":"2024-09-17T03:46:38.871901+0000","last_became_peered":"2024-09-17T03:46:38.871901+0000","last_unstale":"2024-09-17T03:46:40.837481+0000","last_undegraded":"2024-09-17T03:46:40.837481+0000","last_fullsized":"2024-09-17T03:46:40.837481+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:19.828800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.477882+0000","last_change":"2024-09-17T03:46:37.856607+0000","last_active":"2024-09-17T03:46:40.477882+0000","last_peered":"2024-09-17T03:46:40.477882+0000","last_clean":"2024-09-17T03:46:40.477882+0000","last_became_active":"2024-09-17T03:46:37.856210+0000","last_became_peered":"2024-09-17T03:46:37.856210+0000","last_unstale":"2024-09-17T03:46:40.477882+0000","last_undegraded":"2024-09-17T03:46:40.477882+0000","last_fullsized":"2024-09-17T03:46:40.477882+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:36.093398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.837452+0000","last_change":"2024-09-17T03:46:38.858182+0000","last_active":"2024-09-17T03:46:40.837452+0000","last_peered":"2024-09-17T03:46:40.837452+0000","last_clean":"2024-09-17T03:46:40.837452+0000","last_became_active":"2024-09-17T03:46:38.857886+0000","last_became_peered":"2024-09-17T03:46:38.857886+0000","last_unstale":"2024-09-17T03:46:40.837452+0000","last_undegraded":"2024-09-17T03:46:40.837452+0000","last_fullsized":"2024-09-17T03:46:40.837452+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:27.942484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.837695+0000","last_change":"2024-09-17T03:46:37.860656+0000","last_active":"2024-09-17T03:46:40.837695+0000","last_peered":"2024-09-17T03:46:40.837695+0000","last_clean":"2024-09-17T03:46:40.837695+0000","last_became_active":"2024-09-17T03:46:37.860363+0000","last_became_peered":"2024-09-17T03:46:37.860363+0000","last_unstale":"2024-09-17T03:46:40.837695+0000","last_undegraded":"2024-09-17T03:46:40.837695+0000","last_fullsized":"2024-09-17T03:46:40.837695+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:51.416909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867585+0000","last_change":"2024-09-17T03:46:38.869909+0000","last_active":"2024-09-17T03:46:39.867585+0000","last_peered":"2024-09-17T03:46:39.867585+0000","last_clean":"2024-09-17T03:46:39.867585+0000","last_became_active":"2024-09-17T03:46:38.869591+0000","last_became_peered":"2024-09-17T03:46:38.869591+0000","last_unstale":"2024-09-17T03:46:39.867585+0000","last_undegraded":"2024-09-17T03:46:39.867585+0000","last_fullsized":"2024-09-17T03:46:39.867585+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:52.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.867516+0000","last_change":"2024-09-17T03:46:37.858101+0000","last_active":"2024-09-17T03:46:39.867516+0000","last_peered":"2024-09-17T03:46:39.867516+0000","last_clean":"2024-09-17T03:46:39.867516+0000","last_became_active":"2024-09-17T03:46:37.857577+0000","last_became_peered":"2024-09-17T03:46:37.857577+0000","last_unstale":"2024-09-17T03:46:39.867516+0000","last_undegraded":"2024-09-17T03:46:39.867516+0000","last_fullsized":"2024-09-17T03:46:39.867516+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:58.497943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.865379+0000","last_change":"2024-09-17T03:46:38.861305+0000","last_active":"2024-09-17T03:46:39.865379+0000","last_peered":"2024-09-17T03:46:39.865379+0000","last_clean":"2024-09-17T03:46:39.865379+0000","last_became_active":"2024-09-17T03:46:38.860980+0000","last_became_peered":"2024-09-17T03:46:38.860980+0000","last_unstale":"2024-09-17T03:46:39.865379+0000","last_undegraded":"2024-09-17T03:46:39.865379+0000","last_fullsized":"2024-09-17T03:46:39.865379+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:58.100495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.836488+0000","last_change":"2024-09-17T03:46:37.861053+0000","last_active":"2024-09-17T03:46:40.836488+0000","last_peered":"2024-09-17T03:46:40.836488+0000","last_clean":"2024-09-17T03:46:40.836488+0000","last_became_active":"2024-09-17T03:46:37.860753+0000","last_became_peered":"2024-09-17T03:46:37.860753+0000","last_unstale":"2024-09-17T03:46:40.836488+0000","last_undegraded":"2024-09-17T03:46:40.836488+0000","last_fullsized":"2024-09-17T03:46:40.836488+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:48.523839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.865071+0000","last_change":"2024-09-17T03:46:38.865353+0000","last_active":"2024-09-17T03:46:39.865071+0000","last_peered":"2024-09-17T03:46:39.865071+0000","last_clean":"2024-09-17T03:46:39.865071+0000","last_became_active":"2024-09-17T03:46:38.864736+0000","last_became_peered":"2024-09-17T03:46:38.864736+0000","last_unstale":"2024-09-17T03:46:39.865071+0000","last_undegraded":"2024-09-17T03:46:39.865071+0000","last_fullsized":"2024-09-17T03:46:39.865071+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:17.566256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420625+0000","last_change":"2024-09-17T03:46:37.857507+0000","last_active":"2024-09-17T03:46:40.420625+0000","last_peered":"2024-09-17T03:46:40.420625+0000","last_clean":"2024-09-17T03:46:40.420625+0000","last_became_active":"2024-09-17T03:46:37.857165+0000","last_became_peered":"2024-09-17T03:46:37.857165+0000","last_unstale":"2024-09-17T03:46:40.420625+0000","last_undegraded":"2024-09-17T03:46:40.420625+0000","last_fullsized":"2024-09-17T03:46:40.420625+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:05.429022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.863651+0000","last_change":"2024-09-17T03:46:38.882784+0000","last_active":"2024-09-17T03:46:39.863651+0000","last_peered":"2024-09-17T03:46:39.863651+0000","last_clean":"2024-09-17T03:46:39.863651+0000","last_became_active":"2024-09-17T03:46:38.882232+0000","last_became_peered":"2024-09-17T03:46:38.882232+0000","last_unstale":"2024-09-17T03:46:39.863651+0000","last_undegraded":"2024-09-17T03:46:39.863651+0000","last_fullsized":"2024-09-17T03:46:39.863651+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:22.527655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":15,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.420751+0000","last_change":"2024-09-17T03:46:37.850371+0000","last_active":"2024-09-17T03:46:40.420751+0000","last_peered":"2024-09-17T03:46:40.420751+0000","last_clean":"2024-09-17T03:46:40.420751+0000","last_became_active":"2024-09-17T03:46:37.849154+0000","last_became_peered":"2024-09-17T03:46:37.849154+0000","last_unstale":"2024-09-17T03:46:40.420751+0000","last_undegraded":"2024-09-17T03:46:40.420751+0000","last_fullsized":"2024-09-17T03:46:40.420751+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:16.786678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:39.870988+0000","last_change":"2024-09-17T03:46:38.874481+0000","last_active":"2024-09-17T03:46:39.870988+0000","last_peered":"2024-09-17T03:46:39.870988+0000","last_clean":"2024-09-17T03:46:39.870988+0000","last_became_active":"2024-09-17T03:46:38.874084+0000","last_became_peered":"2024-09-17T03:46:38.874084+0000","last_unstale":"2024-09-17T03:46:39.870988+0000","last_undegraded":"2024-09-17T03:46:39.870988+0000","last_fullsized":"2024-09-17T03:46:39.870988+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:37.834370+0000","last_clean_scrub_stamp":"2024-09-17T03:46:37.834370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:50.162234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1f","version":"198'4","reported_seq":19,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.421017+0000","last_change":"2024-09-17T03:46:37.859088+0000","last_active":"2024-09-17T03:46:40.421017+0000","last_peered":"2024-09-17T03:46:40.421017+0000","last_clean":"2024-09-17T03:46:40.421017+0000","last_became_active":"2024-09-17T03:46:37.858770+0000","last_became_peered":"2024-09-17T03:46:37.858770+0000","last_unstale":"2024-09-17T03:46:40.421017+0000","last_undegraded":"2024-09-17T03:46:40.421017+0000","last_fullsized":"2024-09-17T03:46:40.421017+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:46:36.828514+0000","last_clean_scrub_stamp":"2024-09-17T03:46:36.828514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:51.712969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":438,"reported_epoch":199,"state":"active+clean","last_fresh":"2024-09-17T03:46:40.477561+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:46:40.477561+0000","last_peered":"2024-09-17T03:46:40.477561+0000","last_clean":"2024-09-17T03:46:40.477561+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:46:40.477561+0000","last_undegraded":"2024-09-17T03:46:40.477561+0000","last_fullsized":"2024-09-17T03:46:40.477561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509611,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60592,"kb_used_data":3036,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311248,"statfs":{"total":96636764160,"available":96574717952,"internally_reserved":0,"allocated":3108864,"data_stored":1695813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509611,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60016,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311824,"statfs":{"total":96636764160,"available":96575307776,"internally_reserved":0,"allocated":2519040,"data_stored":1105979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509611,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65540,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306300,"statfs":{"total":96636764160,"available":96569651200,"internally_reserved":0,"allocated":2531328,"data_stored":1107079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509611,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55852,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315988,"statfs":{"total":96636764160,"available":96579571712,"internally_reserved":0,"allocated":2514944,"data_stored":1105465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509612,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60032,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311808,"statfs":{"total":96636764160,"available":96575291392,"internally_reserved":0,"allocated":2531328,"data_stored":1107111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509612,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56432,"kb_used_data":3036,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315408,"statfs":{"total":96636764160,"available":96578977792,"internally_reserved":0,"allocated":3108864,"data_stored":1695777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575018,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55852,"kb_used_data":2452,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315988,"statfs":{"total":96636764160,"available":96579571712,"internally_reserved":0,"allocated":2510848,"data_stored":1105375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575018,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60016,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311824,"statfs":{"total":96636764160,"available":96575307776,"internally_reserved":0,"allocated":2514944,"data_stored":1105957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:46:47.693 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:46:47.693 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:46:47.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.850+0000 7fe9c448b640 1 -- 172.21.15.146:0/2285757272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9bc0b4db0 msgr2=0x7fe9bc0b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:47.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.850+0000 7fe9c448b640 1 --2- 172.21.15.146:0/2285757272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9bc0b4db0 0x7fe9bc0b51c0 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc072010 tx=0x7fe9b402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.850+0000 7fe9c448b640 1 -- 172.21.15.146:0/2285757272 shutdown_connections 2024-09-17T03:46:47.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.850+0000 7fe9c448b640 1 --2- 172.21.15.146:0/2285757272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9bc0b4db0 0x7fe9bc0b51c0 unknown :-1 s=CLOSED pgs=2576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.850+0000 7fe9c448b640 1 --2- 172.21.15.146:0/2285757272 >> v2:172.21.15.179:3300/0 conn(0x7fe9bc070170 0x7fe9bc15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.850+0000 7fe9c448b640 1 --2- 172.21.15.146:0/2285757272 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc0724a0 0x7fe9bc074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.850+0000 7fe9c448b640 1 -- 172.21.15.146:0/2285757272 >> 172.21.15.146:0/2285757272 conn(0x7fe9bc0b2240 msgr2=0x7fe9bc0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:47.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.850+0000 7fe9c448b640 1 -- 172.21.15.146:0/2285757272 shutdown_connections 2024-09-17T03:46:47.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.850+0000 7fe9c448b640 1 -- 172.21.15.146:0/2285757272 wait complete. 2024-09-17T03:46:47.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.851+0000 7fe9c448b640 1 Processor -- start 2024-09-17T03:46:47.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.852+0000 7fe9c448b640 1 -- start start 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c448b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9bc070170 0x7fe9bc142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c448b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9bc0724a0 0x7fe9bc154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c448b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc0b4db0 0x7fe9bc155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c448b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0cd340 con 0x7fe9bc070170 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c448b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0cd1c0 con 0x7fe9bc0724a0 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c448b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe9bc0cd4c0 con 0x7fe9bc0b4db0 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c2227640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9bc070170 0x7fe9bc142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c2227640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9bc070170 0x7fe9bc142ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51554/0 (socket says 172.21.15.146:51554) 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c2227640 1 -- 172.21.15.146:0/1460209310 learned_addr learned my addr 172.21.15.146:0/1460209310 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c2a28640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc0b4db0 0x7fe9bc155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c1a26640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9bc0724a0 0x7fe9bc154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:47.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c2227640 1 -- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc0b4db0 msgr2=0x7fe9bc155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:47.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c2227640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc0b4db0 0x7fe9bc155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c2227640 1 -- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9bc0724a0 msgr2=0x7fe9bc154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:47.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c2227640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9bc0724a0 0x7fe9bc154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:47.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c2227640 1 -- 172.21.15.146:0/1460209310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc143530 con 0x7fe9bc070170 2024-09-17T03:46:47.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.853+0000 7fe9c2227640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9bc070170 0x7fe9bc142ff0 secure :-1 s=READY pgs=2577 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800fad0 tx=0x7fe9b800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:47.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.854+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/1460209310 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b801c070 con 0x7fe9bc070170 2024-09-17T03:46:47.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.854+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/1460209310 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9b800dde0 con 0x7fe9bc070170 2024-09-17T03:46:47.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.854+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/1460209310 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8017670 con 0x7fe9bc070170 2024-09-17T03:46:47.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.854+0000 7fe9c448b640 1 -- 172.21.15.146:0/1460209310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9bc155d00 con 0x7fe9bc070170 2024-09-17T03:46:47.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.854+0000 7fe9c448b640 1 -- 172.21.15.146:0/1460209310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9bc1562c0 con 0x7fe9bc070170 2024-09-17T03:46:47.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.855+0000 7fe9c448b640 1 -- 172.21.15.146:0/1460209310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9bc074450 con 0x7fe9bc070170 2024-09-17T03:46:47.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.855+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/1460209310 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9b801f070 con 0x7fe9bc070170 2024-09-17T03:46:47.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.856+0000 7fe9b2ffd640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078b90 0x7fe9a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:47.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.856+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/1460209310 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7fe9b809bdf0 con 0x7fe9bc070170 2024-09-17T03:46:47.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.856+0000 7fe9c1a26640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078b90 0x7fe9a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:47.857 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.857+0000 7fe9c1a26640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078b90 0x7fe9a007b0a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc1e77f0 tx=0x7fe9ac00b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:47.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:47.860+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/1460209310 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe9b8063be0 con 0x7fe9bc070170 2024-09-17T03:46:48.106 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.106+0000 7fe9c448b640 1 -- 172.21.15.146:0/1460209310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe9bc0b27f0 con 0x7fe9bc070170 2024-09-17T03:46:48.111 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.111+0000 7fe9b2ffd640 1 -- 172.21.15.146:0/1460209310 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v28) ==== 190+0+147 (secure 0 0 0) 0x7fe9b8068610 con 0x7fe9bc070170 2024-09-17T03:46:48.111 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:46:48.111 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:46:48.111 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:46:48.111 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:46:48.112 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:46:48.112 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:46:48.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 -- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078b90 msgr2=0x7fe9a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:48.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078b90 0x7fe9a007b0a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc1e77f0 tx=0x7fe9ac00b260 comp rx=0 tx=0).stop 2024-09-17T03:46:48.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 -- 172.21.15.146:0/1460209310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9bc070170 msgr2=0x7fe9bc142ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:48.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9bc070170 0x7fe9bc142ff0 secure :-1 s=READY pgs=2577 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800fad0 tx=0x7fe9b800ff90 comp rx=0 tx=0).stop 2024-09-17T03:46:48.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 -- 172.21.15.146:0/1460209310 shutdown_connections 2024-09-17T03:46:48.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9a0078b90 0x7fe9a007b0a0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9bc0b4db0 0x7fe9bc155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9bc0724a0 0x7fe9bc154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 --2- 172.21.15.146:0/1460209310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9bc070170 0x7fe9bc142ff0 unknown :-1 s=CLOSED pgs=2577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 -- 172.21.15.146:0/1460209310 >> 172.21.15.146:0/1460209310 conn(0x7fe9bc0b2240 msgr2=0x7fe9bc0d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:48.114 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 -- 172.21.15.146:0/1460209310 shutdown_connections 2024-09-17T03:46:48.115 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.113+0000 7fe9c448b640 1 -- 172.21.15.146:0/1460209310 wait complete. 2024-09-17T03:46:48.125 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.238+0000 7f1c47063640 1 -- 172.21.15.146:0/3467452605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4015b1a0 msgr2=0x7f1c4006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.238+0000 7f1c47063640 1 --2- 172.21.15.146:0/3467452605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4015b1a0 0x7f1c4006e340 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7f1c38005fd0 tx=0x7f1c3802aaa0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.238+0000 7f1c47063640 1 -- 172.21.15.146:0/3467452605 shutdown_connections 2024-09-17T03:46:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.238+0000 7f1c47063640 1 --2- 172.21.15.146:0/3467452605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4015b1a0 0x7f1c4006e340 unknown :-1 s=CLOSED pgs=2579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.238+0000 7f1c47063640 1 -- 172.21.15.146:0/3467452605 >> 172.21.15.146:0/3467452605 conn(0x7f1c400b2790 msgr2=0x7f1c400d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.238+0000 7f1c47063640 1 -- 172.21.15.146:0/3467452605 shutdown_connections 2024-09-17T03:46:48.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.238+0000 7f1c47063640 1 -- 172.21.15.146:0/3467452605 wait complete. 2024-09-17T03:46:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.240+0000 7f1c47063640 1 Processor -- start 2024-09-17T03:46:48.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.240+0000 7f1c47063640 1 -- start start 2024-09-17T03:46:48.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c47063640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c400cfbe0 0x7f1c401e0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c47063640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015b1a0 0x7f1c40153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c47063640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c401f2be0 0x7f1c400ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c47063640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1c400cf2b0 con 0x7f1c400cfbe0 2024-09-17T03:46:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c47063640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1c400cf130 con 0x7f1c401f2be0 2024-09-17T03:46:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c47063640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1c400cf430 con 0x7f1c4015b1a0 2024-09-17T03:46:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c44dff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c400cfbe0 0x7f1c401e0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c44dff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c400cfbe0 0x7f1c401e0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51574/0 (socket says 172.21.15.146:51574) 2024-09-17T03:46:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c44dff640 1 -- 172.21.15.146:0/1663464454 learned_addr learned my addr 172.21.15.146:0/1663464454 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:48.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c37fff640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015b1a0 0x7f1c40153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c45600640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c401f2be0 0x7f1c400ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c44dff640 1 -- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015b1a0 msgr2=0x7f1c40153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c44dff640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015b1a0 0x7f1c40153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c44dff640 1 -- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c401f2be0 msgr2=0x7f1c400ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c44dff640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c401f2be0 0x7f1c400ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c44dff640 1 -- 172.21.15.146:0/1663464454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c401f3680 con 0x7f1c400cfbe0 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c45600640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c401f2be0 0x7f1c400ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c44dff640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c400cfbe0 0x7f1c401e0400 secure :-1 s=READY pgs=2580 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c3d0 tx=0x7f1c3c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c357fa640 1 -- 172.21.15.146:0/1663464454 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c017070 con 0x7f1c400cfbe0 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c357fa640 1 -- 172.21.15.146:0/1663464454 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c3c0053c0 con 0x7f1c400cfbe0 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c47063640 1 -- 172.21.15.146:0/1663464454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c401f3960 con 0x7f1c400cfbe0 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.242+0000 7f1c357fa640 1 -- 172.21.15.146:0/1663464454 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c003850 con 0x7f1c400cfbe0 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.243+0000 7f1c47063640 1 -- 172.21.15.146:0/1663464454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c400ad560 con 0x7f1c400cfbe0 2024-09-17T03:46:48.245 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.243+0000 7f1c47063640 1 -- 172.21.15.146:0/1663464454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4006f930 con 0x7f1c400cfbe0 2024-09-17T03:46:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.244+0000 7f1c357fa640 1 -- 172.21.15.146:0/1663464454 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c3c01a070 con 0x7f1c400cfbe0 2024-09-17T03:46:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.245+0000 7f1c357fa640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c2c078b90 0x7f1c2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.245+0000 7f1c357fa640 1 -- 172.21.15.146:0/1663464454 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f1c3c09a010 con 0x7f1c400cfbe0 2024-09-17T03:46:48.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.245+0000 7f1c37fff640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c2c078b90 0x7f1c2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:48.247 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.245+0000 7f1c37fff640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c2c078b90 0x7f1c2c07b0a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1c400cc5a0 tx=0x7f1c30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:48.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.249+0000 7f1c357fa640 1 -- 172.21.15.146:0/1663464454 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c3c061e00 con 0x7f1c400cfbe0 2024-09-17T03:46:48.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.460+0000 7f1c47063640 1 -- 172.21.15.146:0/1663464454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c4006e320 con 0x7f1c400cfbe0 2024-09-17T03:46:48.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.460+0000 7f1c357fa640 1 -- 172.21.15.146:0/1663464454 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 154 v154) ==== 95+0+5241 (secure 0 0 0) 0x7f1c3c066830 con 0x7f1c400cfbe0 2024-09-17T03:46:48.461 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:48.461 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":154,"btime":"2024-09-17T03:46:41:868652+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2786459468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2786459468},{"type":"v1","addr":"172.21.15.179:6837","nonce":2786459468}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/35044870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":35044870},{"type":"v1","addr":"172.21.15.146:6835","nonce":35044870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4262340236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4262340236},{"type":"v1","addr":"172.21.15.179:6836","nonce":4262340236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149}],"filesystems":[{"mdsmap":{"epoch":154,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:46:38.209003+0000","modified":"2024-09-17T03:46:41.229411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11496":{"gid":11496,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/172455759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":172455759},{"type":"v1","addr":"172.21.15.146:6833","nonce":172455759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11496,"qdb_cluster":[11496]},"id":15}]} 2024-09-17T03:46:48.461 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 154 2024-09-17T03:46:48.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.462+0000 7f1c47063640 1 -- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c2c078b90 msgr2=0x7f1c2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:48.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.462+0000 7f1c47063640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c2c078b90 0x7f1c2c07b0a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1c400cc5a0 tx=0x7f1c30009040 comp rx=0 tx=0).stop 2024-09-17T03:46:48.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.462+0000 7f1c47063640 1 -- 172.21.15.146:0/1663464454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c400cfbe0 msgr2=0x7f1c401e0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:48.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.462+0000 7f1c47063640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c400cfbe0 0x7f1c401e0400 secure :-1 s=READY pgs=2580 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c3d0 tx=0x7f1c3c00c890 comp rx=0 tx=0).stop 2024-09-17T03:46:48.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.463+0000 7f1c47063640 1 -- 172.21.15.146:0/1663464454 shutdown_connections 2024-09-17T03:46:48.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.463+0000 7f1c47063640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1c2c078b90 0x7f1c2c07b0a0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.463+0000 7f1c47063640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1c401f2be0 0x7f1c400ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.463+0000 7f1c47063640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1c4015b1a0 0x7f1c40153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.463+0000 7f1c47063640 1 --2- 172.21.15.146:0/1663464454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c400cfbe0 0x7f1c401e0400 unknown :-1 s=CLOSED pgs=2580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.463+0000 7f1c47063640 1 -- 172.21.15.146:0/1663464454 >> 172.21.15.146:0/1663464454 conn(0x7f1c400b2790 msgr2=0x7f1c401555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:48.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.463+0000 7f1c47063640 1 -- 172.21.15.146:0/1663464454 shutdown_connections 2024-09-17T03:46:48.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.463+0000 7f1c47063640 1 -- 172.21.15.146:0/1663464454 wait complete. 2024-09-17T03:46:48.877 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 154, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:46:38.209003+0000', 'modified': '2024-09-17T03:46:41.229411+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11496}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11496': {'gid': 11496, 'name': 'c', 'rank': 0, 'incarnation': 150, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6833/172455759', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 172455759}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 172455759}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [31], 'metadata_pool': 30, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11496, 'qdb_cluster': [11496]} 2024-09-17T03:46:48.877 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:46:48.877 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:46:48.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.993+0000 7fe291eb6640 1 -- 172.21.15.146:0/1222529134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28c0cff50 msgr2=0x7fe28c0690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:48.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.993+0000 7fe291eb6640 1 --2- 172.21.15.146:0/1222529134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28c0cff50 0x7fe28c0690b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe284005fd0 tx=0x7fe28402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.993+0000 7fe291eb6640 1 -- 172.21.15.146:0/1222529134 shutdown_connections 2024-09-17T03:46:48.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.993+0000 7fe291eb6640 1 --2- 172.21.15.146:0/1222529134 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28c0cff50 0x7fe28c0690b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.993+0000 7fe291eb6640 1 --2- 172.21.15.146:0/1222529134 >> v2:172.21.15.179:3300/0 conn(0x7fe28c15fc60 0x7fe28c1628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.993+0000 7fe291eb6640 1 -- 172.21.15.146:0/1222529134 >> 172.21.15.146:0/1222529134 conn(0x7fe28c0d4cd0 msgr2=0x7fe28c0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:48.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.993+0000 7fe291eb6640 1 -- 172.21.15.146:0/1222529134 shutdown_connections 2024-09-17T03:46:48.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.993+0000 7fe291eb6640 1 -- 172.21.15.146:0/1222529134 wait complete. 2024-09-17T03:46:48.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.995+0000 7fe291eb6640 1 Processor -- start 2024-09-17T03:46:48.995 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.995+0000 7fe291eb6640 1 -- start start 2024-09-17T03:46:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.996+0000 7fe291eb6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0cfb40 0x7fe28c15b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.996+0000 7fe291eb6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe28c0cff50 0x7fe28c1f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.996+0000 7fe291eb6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28c15fc60 0x7fe28c0ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.996+0000 7fe291eb6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c160290 con 0x7fe28c0cfb40 2024-09-17T03:46:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.996+0000 7fe291eb6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c163040 con 0x7fe28c0cff50 2024-09-17T03:46:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.996+0000 7fe291eb6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe28c0d3380 con 0x7fe28c15fc60 2024-09-17T03:46:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.996+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0cfb40 0x7fe28c15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.996+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0cfb40 0x7fe28c15b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51586/0 (socket says 172.21.15.146:51586) 2024-09-17T03:46:48.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.996+0000 7fe28b7fe640 1 -- 172.21.15.146:0/1931978715 learned_addr learned my addr 172.21.15.146:0/1931978715 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.996+0000 7fe28bfff640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28c15fc60 0x7fe28c0ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.996+0000 7fe28affd640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe28c0cff50 0x7fe28c1f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.997+0000 7fe28b7fe640 1 -- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28c15fc60 msgr2=0x7fe28c0ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.997+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28c15fc60 0x7fe28c0ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.997+0000 7fe28b7fe640 1 -- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe28c0cff50 msgr2=0x7fe28c1f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.997+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe28c0cff50 0x7fe28c1f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.997+0000 7fe28b7fe640 1 -- 172.21.15.146:0/1931978715 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c1599d0 con 0x7fe28c0cfb40 2024-09-17T03:46:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.997+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0cfb40 0x7fe28c15b560 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e9f0 tx=0x7fe27c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.997+0000 7fe273fff640 1 -- 172.21.15.146:0/1931978715 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00cd80 con 0x7fe28c0cfb40 2024-09-17T03:46:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.997+0000 7fe273fff640 1 -- 172.21.15.146:0/1931978715 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe27c004020 con 0x7fe28c0cfb40 2024-09-17T03:46:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.997+0000 7fe291eb6640 1 -- 172.21.15.146:0/1931978715 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28c159cb0 con 0x7fe28c0cfb40 2024-09-17T03:46:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.997+0000 7fe273fff640 1 -- 172.21.15.146:0/1931978715 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c004470 con 0x7fe28c0cfb40 2024-09-17T03:46:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.997+0000 7fe291eb6640 1 -- 172.21.15.146:0/1931978715 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28c15a270 con 0x7fe28c0cfb40 2024-09-17T03:46:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:48.999+0000 7fe273fff640 1 -- 172.21.15.146:0/1931978715 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe27c0035f0 con 0x7fe28c0cfb40 2024-09-17T03:46:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.000+0000 7fe273fff640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe278078b90 0x7fe27807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.000+0000 7fe273fff640 1 -- 172.21.15.146:0/1931978715 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7fe27c09b640 con 0x7fe28c0cfb40 2024-09-17T03:46:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.000+0000 7fe28affd640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe278078b90 0x7fe27807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.000+0000 7fe28affd640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe278078b90 0x7fe27807b0a0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0d1300 tx=0x7fe280007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.000+0000 7fe298e20740 1 Processor -- start 2024-09-17T03:46:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.000+0000 7fe298e20740 1 -- start start 2024-09-17T03:46:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe298e20740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6aedfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe298e20740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66f33b0 0x55f6c6aee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe298e20740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66fb590 0x55f6c6b0b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe298e20740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f6c6a36820 con 0x55f6c671c270 2024-09-17T03:46:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe298e20740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f6c6a25c50 con 0x55f6c66f33b0 2024-09-17T03:46:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe298e20740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f6c6a29a60 con 0x55f6c66fb590 2024-09-17T03:46:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6aedfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6aedfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51594/0 (socket says 172.21.15.146:51594) 2024-09-17T03:46:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe28b7fe640 1 -- 172.21.15.146:0/2681258611 learned_addr learned my addr 172.21.15.146:0/2681258611 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe28affd640 1 --2- 172.21.15.146:0/2681258611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66f33b0 0x55f6c6aee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.004 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe28bfff640 1 --2- 172.21.15.146:0/2681258611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66fb590 0x55f6c6b0b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe28b7fe640 1 -- 172.21.15.146:0/2681258611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66fb590 msgr2=0x55f6c6b0b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/2681258611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66fb590 0x55f6c6b0b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe28b7fe640 1 -- 172.21.15.146:0/2681258611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66f33b0 msgr2=0x55f6c6aee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/2681258611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66f33b0 0x55f6c6aee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe28b7fe640 1 -- 172.21.15.146:0/2681258611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6c6787850 con 0x55f6c671c270 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.002+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/2681258611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6aedfa0 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7fe27c063450 tx=0x7fe27c0633c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475ef90c3ae67146 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.003+0000 7fe2717fa640 1 -- 172.21.15.146:0/2681258611 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0634c0 con 0x55f6c671c270 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.003+0000 7fe2717fa640 1 -- 172.21.15.146:0/2681258611 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe27c067ef0 con 0x55f6c671c270 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.003+0000 7fe2717fa640 1 -- 172.21.15.146:0/2681258611 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c085dc0 con 0x55f6c671c270 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.003+0000 7fe298e20740 1 -- 172.21.15.146:0/2681258611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 msgr2=0x55f6c6aedfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.003+0000 7fe298e20740 1 --2- 172.21.15.146:0/2681258611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6aedfa0 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7fe27c063450 tx=0x7fe27c0633c0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.004+0000 7fe298e20740 1 -- 172.21.15.146:0/2681258611 shutdown_connections 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.004+0000 7fe298e20740 1 --2- 172.21.15.146:0/2681258611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66fb590 0x55f6c6b0b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.004+0000 7fe298e20740 1 --2- 172.21.15.146:0/2681258611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66f33b0 0x55f6c6aee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.004+0000 7fe298e20740 1 --2- 172.21.15.146:0/2681258611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6aedfa0 unknown :-1 s=CLOSED pgs=2582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.004+0000 7fe298e20740 1 -- 172.21.15.146:0/2681258611 >> 172.21.15.146:0/2681258611 conn(0x55f6c67103c0 msgr2=0x55f6c6ac4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.004+0000 7fe298e20740 1 -- 172.21.15.146:0/2681258611 shutdown_connections 2024-09-17T03:46:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.004+0000 7fe298e20740 1 -- 172.21.15.146:0/2681258611 wait complete. 2024-09-17T03:46:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.004+0000 7fe298e20740 1 -- start start 2024-09-17T03:46:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.005+0000 7fe298e20740 1 Processor -- start 2024-09-17T03:46:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe298e20740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66f33b0 0x55f6c6abd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe298e20740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66fb590 0x55f6c6ada520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe298e20740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c671c270 0x55f6c6ad7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe298e20740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f6c6796620 con 0x55f6c66f33b0 2024-09-17T03:46:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe298e20740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f6c69cb5f0 con 0x55f6c66fb590 2024-09-17T03:46:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe298e20740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f6c6b0b140 con 0x55f6c671c270 2024-09-17T03:46:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe298e20740 10 client.0 _ll_register_callbacks cb 0x55f6c69cf0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:46:49.010 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66f33b0 0x55f6c6abd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66f33b0 0x55f6c6abd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51610/0 (socket says 172.21.15.146:51610) 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28b7fe640 1 -- 172.21.15.146:0/2832063710 learned_addr learned my addr 172.21.15.146:0/2832063710 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28bfff640 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c671c270 0x55f6c6ad7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28affd640 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66fb590 0x55f6c6ada520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28b7fe640 1 -- 172.21.15.146:0/2832063710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c671c270 msgr2=0x55f6c6ad7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c671c270 0x55f6c6ad7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28b7fe640 1 -- 172.21.15.146:0/2832063710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66fb590 msgr2=0x55f6c6ada520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66fb590 0x55f6c6ada520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28b7fe640 1 -- 172.21.15.146:0/2832063710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6c67fe6b0 con 0x55f6c66f33b0 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28affd640 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66fb590 0x55f6c6ada520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28bfff640 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c671c270 0x55f6c6ad7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66f33b0 0x55f6c6abd9d0 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e9c0 tx=0x7fe27c06cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03d17d574de8a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe26a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:46:49.011 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.006+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2832063710 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c06a120 con 0x55f6c66f33b0 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2832063710 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7fe27c06a2c0 con 0x55f6c66f33b0 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe298e20740 1 -- 172.21.15.146:0/2832063710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe27c067ef0 con 0x55f6c66f33b0 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2832063710 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=154) ==== 24+0+0 (secure 0 0 0) 0x7fe27c062720 con 0x55f6c66f33b0 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe298e20740 10 client.11646 fetch_fsmap learned FSMap version 154 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe298e20740 1 -- 172.21.15.146:0/2832063710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=154,monmap=2+}) -- 0x55f6c6ad7aa0 con 0x55f6c66f33b0 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2832063710 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe27c067ef0 con 0x55f6c66f33b0 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2832063710 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 154) ==== 3502+0+0 (secure 0 0 0) 0x7fe27c0628c0 con 0x55f6c66f33b0 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe298e20740 10 client.11646 fetch_fsmap finished waiting for FSMap version 154 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe298e20740 10 client.11646 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe298e20740 20 client.11646 populate_metadata read hostname 'smithi146' 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe298e20740 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55f6c66dae40 0x55f6c6b25330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe298e20740 4 client.11646 mds_command: new command op to 11496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe298e20740 1 -- 172.21.15.146:0/2832063710 --> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6c6a38770 con 0x55f6c66dae40 2024-09-17T03:46:49.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.007+0000 7fe28affd640 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55f6c66dae40 0x55f6c6b25330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe26a7fc640 10 client.11646 ms_handle_connect on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe28affd640 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55f6c66dae40 0x55f6c6b25330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99969276727b62d7 server_cookie=bd3932a2777499c2 in_seq=0 out_seq=0 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2832063710 <== mds.0 v2:172.21.15.146:6832/172455759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f6c6a38770 con 0x55f6c66dae40 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe26a7fc640 10 client.11646 handle_command_reply: tid=0 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe298e20740 1 client.11646 shutdown 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe298e20740 1 -- 172.21.15.146:0/2832063710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66f33b0 msgr2=0x55f6c6abd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe298e20740 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66f33b0 0x55f6c6abd9d0 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e9c0 tx=0x7fe27c06cda0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe298e20740 1 -- 172.21.15.146:0/2832063710 shutdown_connections 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe298e20740 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c671c270 0x55f6c6ad7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe298e20740 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66fb590 0x55f6c6ada520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe298e20740 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55f6c66dae40 0x55f6c6b25330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe298e20740 1 --2- 172.21.15.146:0/2832063710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66f33b0 0x55f6c6abd9d0 unknown :-1 s=CLOSED pgs=2583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe26a7fc640 0 client.11646 ms_handle_reset on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:49.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe298e20740 1 -- 172.21.15.146:0/2832063710 >> 172.21.15.146:0/2832063710 conn(0x55f6c67103c0 msgr2=0x55f6c6b0a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:49.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.008+0000 7fe298e20740 1 -- 172.21.15.146:0/2832063710 shutdown_connections 2024-09-17T03:46:49.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.009+0000 7fe298e20740 1 -- 172.21.15.146:0/2832063710 wait complete. 2024-09-17T03:46:49.014 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.009+0000 7fe298e20740 20 client.11646 trim_cache size 0 max 16384 2024-09-17T03:46:49.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.027+0000 7fe298e20740 1 Processor -- start 2024-09-17T03:46:49.028 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.027+0000 7fe298e20740 1 -- start start 2024-09-17T03:46:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.028+0000 7fe298e20740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66f33b0 0x55f6c6ac42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.028+0000 7fe298e20740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66fb590 0x55f6c6abd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.028+0000 7fe298e20740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6abd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.028+0000 7fe298e20740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c2014d0 con 0x55f6c671c270 2024-09-17T03:46:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.028+0000 7fe298e20740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c1f9c40 con 0x55f6c66f33b0 2024-09-17T03:46:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.028+0000 7fe298e20740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe28c0cc420 con 0x55f6c66fb590 2024-09-17T03:46:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.028+0000 7fe28bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6abd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.028+0000 7fe28bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6abd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51620/0 (socket says 172.21.15.146:51620) 2024-09-17T03:46:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.028+0000 7fe28bfff640 1 -- 172.21.15.146:0/3254206369 learned_addr learned my addr 172.21.15.146:0/3254206369 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:49.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/3254206369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66f33b0 0x55f6c6ac42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe28affd640 1 --2- 172.21.15.146:0/3254206369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66fb590 0x55f6c6abd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe28bfff640 1 -- 172.21.15.146:0/3254206369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66fb590 msgr2=0x55f6c6abd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe28bfff640 1 --2- 172.21.15.146:0/3254206369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66fb590 0x55f6c6abd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe28bfff640 1 -- 172.21.15.146:0/3254206369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66f33b0 msgr2=0x55f6c6ac42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe28bfff640 1 --2- 172.21.15.146:0/3254206369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66f33b0 0x55f6c6ac42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe28bfff640 1 -- 172.21.15.146:0/3254206369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6c6b0a540 con 0x55f6c671c270 2024-09-17T03:46:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/3254206369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66f33b0 0x55f6c6ac42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe28bfff640 1 --2- 172.21.15.146:0/3254206369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6abd970 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7fe284009420 tx=0x7fe284004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94f1599e8edcdf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe270ff9640 1 -- 172.21.15.146:0/3254206369 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28404b070 con 0x55f6c671c270 2024-09-17T03:46:49.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe270ff9640 1 -- 172.21.15.146:0/3254206369 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe284004040 con 0x55f6c671c270 2024-09-17T03:46:49.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.029+0000 7fe270ff9640 1 -- 172.21.15.146:0/3254206369 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284004410 con 0x55f6c671c270 2024-09-17T03:46:49.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.030+0000 7fe298e20740 1 -- 172.21.15.146:0/3254206369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 msgr2=0x55f6c6abd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:49.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.030+0000 7fe298e20740 1 --2- 172.21.15.146:0/3254206369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6abd970 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7fe284009420 tx=0x7fe284004a40 comp rx=0 tx=0).stop 2024-09-17T03:46:49.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.030+0000 7fe298e20740 1 -- 172.21.15.146:0/3254206369 shutdown_connections 2024-09-17T03:46:49.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.030+0000 7fe298e20740 1 --2- 172.21.15.146:0/3254206369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c671c270 0x55f6c6abd970 unknown :-1 s=CLOSED pgs=2584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.030+0000 7fe298e20740 1 --2- 172.21.15.146:0/3254206369 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66fb590 0x55f6c6abd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.030+0000 7fe298e20740 1 --2- 172.21.15.146:0/3254206369 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c66f33b0 0x55f6c6ac42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.030+0000 7fe298e20740 1 -- 172.21.15.146:0/3254206369 >> 172.21.15.146:0/3254206369 conn(0x55f6c67103c0 msgr2=0x55f6c6ab9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:49.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.030+0000 7fe298e20740 1 -- 172.21.15.146:0/3254206369 shutdown_connections 2024-09-17T03:46:49.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.030+0000 7fe298e20740 1 -- 172.21.15.146:0/3254206369 wait complete. 2024-09-17T03:46:49.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.031+0000 7fe298e20740 1 -- start start 2024-09-17T03:46:49.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.031+0000 7fe298e20740 1 Processor -- start 2024-09-17T03:46:49.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe298e20740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66f33b0 0x55f6c6b89b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe298e20740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66fb590 0x55f6c6abd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe298e20740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c671c270 0x55f6c6abd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe298e20740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55f6c6796620 con 0x55f6c66fb590 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe298e20740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55f6c6ad9400 con 0x55f6c671c270 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe298e20740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55f6c69cb5f0 con 0x55f6c66f33b0 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe298e20740 10 client.0 _ll_register_callbacks cb 0x7fe27c06a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe28affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66fb590 0x55f6c6abd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe28affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66fb590 0x55f6c6abd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51632/0 (socket says 172.21.15.146:51632) 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe28affd640 1 -- 172.21.15.146:0/2966364189 learned_addr learned my addr 172.21.15.146:0/2966364189 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66f33b0 0x55f6c6b89b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.032+0000 7fe28bfff640 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c671c270 0x55f6c6abd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe28affd640 1 -- 172.21.15.146:0/2966364189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66f33b0 msgr2=0x55f6c6b89b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe28affd640 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66f33b0 0x55f6c6b89b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe28affd640 1 -- 172.21.15.146:0/2966364189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c671c270 msgr2=0x55f6c6abd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe28affd640 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c671c270 0x55f6c6abd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe28affd640 1 -- 172.21.15.146:0/2966364189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6c6b0a250 con 0x55f6c66fb590 2024-09-17T03:46:49.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe28affd640 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66fb590 0x55f6c6abd200 secure :-1 s=READY pgs=2585 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0d29c0 tx=0x7fe280000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9edb7ce93c60067d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe26a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2966364189 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280032060 con 0x55f6c66fb590 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2966364189 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7fe280023440 con 0x55f6c66fb590 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe298e20740 1 -- 172.21.15.146:0/2966364189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe284004040 con 0x55f6c66fb590 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2966364189 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=154) ==== 24+0+0 (secure 0 0 0) 0x7fe280038050 con 0x55f6c66fb590 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe298e20740 10 client.11652 fetch_fsmap learned FSMap version 154 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe298e20740 1 -- 172.21.15.146:0/2966364189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=154,monmap=2+}) -- 0x55f6c6abdc80 con 0x55f6c66fb590 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2966364189 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe284004040 con 0x55f6c66fb590 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2966364189 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 154) ==== 3502+0+0 (secure 0 0 0) 0x7fe28003b020 con 0x55f6c66fb590 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe298e20740 10 client.11652 fetch_fsmap finished waiting for FSMap version 154 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe298e20740 10 client.11652 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe298e20740 20 client.11652 populate_metadata read hostname 'smithi146' 2024-09-17T03:46:49.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe298e20740 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55f6c6ad6520 0x55f6c6adb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe298e20740 4 client.11652 mds_command: new command op to 11496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.033+0000 7fe298e20740 1 -- 172.21.15.146:0/2966364189 --> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] -- command(tid 0: {"prefix": "status"}) -- 0x55f6c6b003c0 con 0x55f6c6ad6520 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55f6c6ad6520 0x55f6c6adb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe26a7fc640 10 client.11652 ms_handle_connect on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe28b7fe640 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55f6c6ad6520 0x55f6c6adb6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72dd382967b13690 server_cookie=c783ba66147970a0 in_seq=0 out_seq=0 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe26a7fc640 1 -- 172.21.15.146:0/2966364189 <== mds.0 v2:172.21.15.146:6832/172455759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x55f6c6b003c0 con 0x55f6c6ad6520 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe26a7fc640 10 client.11652 handle_command_reply: tid=0 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe298e20740 1 client.11652 shutdown 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe298e20740 1 -- 172.21.15.146:0/2966364189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66fb590 msgr2=0x55f6c6abd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe298e20740 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66fb590 0x55f6c6abd200 secure :-1 s=READY pgs=2585 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0d29c0 tx=0x7fe280000bc0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe298e20740 1 -- 172.21.15.146:0/2966364189 shutdown_connections 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe298e20740 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55f6c671c270 0x55f6c6abd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe298e20740 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55f6c6ad6520 0x55f6c6adb6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe298e20740 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f6c66fb590 0x55f6c6abd200 unknown :-1 s=CLOSED pgs=2585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe298e20740 1 --2- 172.21.15.146:0/2966364189 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55f6c66f33b0 0x55f6c6b89b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe26a7fc640 0 client.11652 ms_handle_reset on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:49.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe298e20740 1 -- 172.21.15.146:0/2966364189 >> 172.21.15.146:0/2966364189 conn(0x55f6c67103c0 msgr2=0x55f6c6ada300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:49.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe298e20740 1 -- 172.21.15.146:0/2966364189 shutdown_connections 2024-09-17T03:46:49.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.034+0000 7fe298e20740 1 -- 172.21.15.146:0/2966364189 wait complete. 2024-09-17T03:46:49.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe298e20740 20 client.11652 trim_cache size 0 max 16384 2024-09-17T03:46:49.042 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:46:49.042 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:46:49.042 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:46:49.042 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 11496, 2024-09-17T03:46:49.043 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:46:49.043 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:46:49.043 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:46:49.043 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.178724155999999, 2024-09-17T03:46:49.043 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 154, 2024-09-17T03:46:49.043 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 199, 2024-09-17T03:46:49.043 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 199, 2024-09-17T03:46:49.043 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 14.871982219 2024-09-17T03:46:49.043 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:46:49.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 -- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe278078b90 msgr2=0x7fe27807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:49.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe278078b90 0x7fe27807b0a0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0d1300 tx=0x7fe280007e90 comp rx=0 tx=0).stop 2024-09-17T03:46:49.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 -- 172.21.15.146:0/1931978715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0cfb40 msgr2=0x7fe28c15b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:49.044 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0cfb40 0x7fe28c15b560 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e9f0 tx=0x7fe27c00eeb0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 -- 172.21.15.146:0/1931978715 shutdown_connections 2024-09-17T03:46:49.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe278078b90 0x7fe27807b0a0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28c15fc60 0x7fe28c0ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe28c0cff50 0x7fe28c1f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 --2- 172.21.15.146:0/1931978715 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe28c0cfb40 0x7fe28c15b560 unknown :-1 s=CLOSED pgs=2581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 -- 172.21.15.146:0/1931978715 >> 172.21.15.146:0/1931978715 conn(0x7fe28c0d4cd0 msgr2=0x7fe28c0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:49.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 -- 172.21.15.146:0/1931978715 shutdown_connections 2024-09-17T03:46:49.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.035+0000 7fe291eb6640 1 -- 172.21.15.146:0/1931978715 wait complete. 2024-09-17T03:46:49.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:46:49.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.161+0000 7fa07983f640 1 -- 172.21.15.146:0/846255922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa05c003fd0 msgr2=0x7fa05c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:49.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.161+0000 7fa07983f640 1 --2- 172.21.15.146:0/846255922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa05c003fd0 0x7fa05c004800 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7fa074159a90 tx=0x7fa05c005830 comp rx=0 tx=0).stop 2024-09-17T03:46:49.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.161+0000 7fa0737fe640 1 -- 172.21.15.146:0/846255922 reap_dead start 2024-09-17T03:46:49.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.161+0000 7fa07983f640 1 -- 172.21.15.146:0/846255922 shutdown_connections 2024-09-17T03:46:49.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.161+0000 7fa07983f640 1 -- 172.21.15.146:0/846255922 >> 172.21.15.146:0/846255922 conn(0x7fa0740b3250 msgr2=0x7fa0740b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:49.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.161+0000 7fa07983f640 1 -- 172.21.15.146:0/846255922 shutdown_connections 2024-09-17T03:46:49.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.161+0000 7fa07983f640 1 -- 172.21.15.146:0/846255922 wait complete. 2024-09-17T03:46:49.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.163+0000 7fa07983f640 1 Processor -- start 2024-09-17T03:46:49.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.163+0000 7fa07983f640 1 -- start start 2024-09-17T03:46:49.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.164+0000 7fa07983f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c003fd0 0x7fa07414fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.164+0000 7fa07983f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0740cbaa0 0x7fa0740cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.164+0000 7fa07983f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0741f4a90 0x7fa0741f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.164+0000 7fa07983f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa07406f920 con 0x7fa0740cbaa0 2024-09-17T03:46:49.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.164+0000 7fa07983f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa07406f7a0 con 0x7fa0741f4a90 2024-09-17T03:46:49.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.164+0000 7fa07983f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa07406faa0 con 0x7fa05c003fd0 2024-09-17T03:46:49.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.164+0000 7fa0727fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0740cbaa0 0x7fa0740cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.164+0000 7fa0727fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0740cbaa0 0x7fa0740cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51654/0 (socket says 172.21.15.146:51654) 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.164+0000 7fa0727fc640 1 -- 172.21.15.146:0/2294871847 learned_addr learned my addr 172.21.15.146:0/2294871847 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.164+0000 7fa0737fe640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0741f4a90 0x7fa0741f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.164+0000 7fa072ffd640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c003fd0 0x7fa07414fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.165+0000 7fa0727fc640 1 -- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c003fd0 msgr2=0x7fa07414fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.165+0000 7fa0727fc640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c003fd0 0x7fa07414fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.165+0000 7fa0727fc640 1 -- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0741f4a90 msgr2=0x7fa0741f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.165+0000 7fa0727fc640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0741f4a90 0x7fa0741f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.165+0000 7fa0727fc640 1 -- 172.21.15.146:0/2294871847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0740aab90 con 0x7fa0740cbaa0 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.165+0000 7fa0727fc640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0740cbaa0 0x7fa0740cbeb0 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7fa068036040 tx=0x7fa068033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.165+0000 7fa05bfff640 1 -- 172.21.15.146:0/2294871847 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068038040 con 0x7fa0740cbaa0 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.165+0000 7fa05bfff640 1 -- 172.21.15.146:0/2294871847 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa068033860 con 0x7fa0740cbaa0 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.165+0000 7fa07983f640 1 -- 172.21.15.146:0/2294871847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0740aa5d0 con 0x7fa0740cbaa0 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.165+0000 7fa05bfff640 1 -- 172.21.15.146:0/2294871847 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068033cb0 con 0x7fa0740cbaa0 2024-09-17T03:46:49.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.165+0000 7fa07983f640 1 -- 172.21.15.146:0/2294871847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0740cc730 con 0x7fa0740cbaa0 2024-09-17T03:46:49.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.166+0000 7fa07983f640 1 -- 172.21.15.146:0/2294871847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa074070f50 con 0x7fa0740cbaa0 2024-09-17T03:46:49.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.167+0000 7fa05bfff640 1 -- 172.21.15.146:0/2294871847 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa068043020 con 0x7fa0740cbaa0 2024-09-17T03:46:49.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.167+0000 7fa05bfff640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa060078bc0 0x7fa06007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:49.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.167+0000 7fa05bfff640 1 -- 172.21.15.146:0/2294871847 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7fa0680bad40 con 0x7fa0740cbaa0 2024-09-17T03:46:49.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.168+0000 7fa072ffd640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa060078bc0 0x7fa06007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:49.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.168+0000 7fa072ffd640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa060078bc0 0x7fa06007b0d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa064001c00 tx=0x7fa064002120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:49.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.172+0000 7fa05bfff640 1 -- 172.21.15.146:0/2294871847 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa074070f50 con 0x7fa0740cbaa0 2024-09-17T03:46:49.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.381+0000 7fa07983f640 1 -- 172.21.15.146:0/2294871847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa07415bf30 con 0x7fa0740cbaa0 2024-09-17T03:46:49.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.382+0000 7fa05bfff640 1 -- 172.21.15.146:0/2294871847 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v154) ==== 53+0+73 (secure 0 0 0) 0x7fa06804a020 con 0x7fa0740cbaa0 2024-09-17T03:46:49.382 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:46:49.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 -- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa060078bc0 msgr2=0x7fa06007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:49.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa060078bc0 0x7fa06007b0d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa064001c00 tx=0x7fa064002120 comp rx=0 tx=0).stop 2024-09-17T03:46:49.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 -- 172.21.15.146:0/2294871847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0740cbaa0 msgr2=0x7fa0740cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:49.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0740cbaa0 0x7fa0740cbeb0 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7fa068036040 tx=0x7fa068033670 comp rx=0 tx=0).stop 2024-09-17T03:46:49.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 -- 172.21.15.146:0/2294871847 shutdown_connections 2024-09-17T03:46:49.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa060078bc0 0x7fa06007b0d0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa0741f4a90 0x7fa0741f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0740cbaa0 0x7fa0740cbeb0 unknown :-1 s=CLOSED pgs=2588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 --2- 172.21.15.146:0/2294871847 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa05c003fd0 0x7fa07414fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:49.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 -- 172.21.15.146:0/2294871847 >> 172.21.15.146:0/2294871847 conn(0x7fa0740b3250 msgr2=0x7fa0740cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:49.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 -- 172.21.15.146:0/2294871847 shutdown_connections 2024-09-17T03:46:49.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49.384+0000 7fa07983f640 1 -- 172.21.15.146:0/2294871847 wait complete. 2024-09-17T03:46:49.397 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:46:49.397 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:46:49.397 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:46:49.397 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:46:49.397 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:46:49.397 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:46:49.397 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:46:49.397 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:46:49.397 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:46:49.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:49.398 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:46:49.413 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:46:49.414 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41962sec preferred_lft 41962sec 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:46:49.415 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:46:49.416 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:46:49.416 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:46:49.416 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:46:49.416 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:46:49.416 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:46:49.416 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:46:49.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:49.416 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:46:49.477 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:46:49.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:49.479 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:46:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:46:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:46:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:46:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:46:49.535 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:46:49.536 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:46:49.536 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:46:49.536 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:46:49.536 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:46:49.536 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:46:49.536 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:46:49.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:46:49.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:46:49.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:49.663 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:46:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:46:49.678 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:46:49.679 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:46:49.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:49.679 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:46:49.744 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:46:49.744 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:46:49.799 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:46:49.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:46:49.800 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:46:49.855 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:46:49.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:49.855 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:46:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:46:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:46:49.949 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:46:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:46:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:46:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:46:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:46:49.960 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:46:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:46:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:46:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:46:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:46:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:46:49.969 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:46:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:46:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:46:49.970 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:46:49.970 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:46:49.970 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:46:49.970 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:46:49.970 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:46:49.971 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:46:49.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:49.972 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:46:49.998 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:46:50.090 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:46:50.094 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:46:50.100 INFO:teuthology.orchestra.run.smithi146.stdout:client11661 2024-09-17T03:46:50.100 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:46:50.100 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:50.116 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:46:50.116 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:50.172 DEBUG:teuthology.orchestra.run.smithi146:> stdin-killer -- python3 -c ' 2024-09-17T03:46:50.172 DEBUG:teuthology.orchestra.run.smithi146:> import os 2024-09-17T03:46:50.172 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2024-09-17T03:46:50.172 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:46:50.172 DEBUG:teuthology.orchestra.run.smithi146:> n = 1000 2024-09-17T03:46:50.172 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2024-09-17T03:46:50.172 DEBUG:teuthology.orchestra.run.smithi146:> if 0 > 0: 2024-09-17T03:46:50.172 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2024-09-17T03:46:50.172 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/scrub-new-files/file" 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> try: 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:46:50.173 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(0): 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2024-09-17T03:46:50.174 DEBUG:teuthology.orchestra.run.smithi146:> ' 2024-09-17T03:46:51.112 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:46:51.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:51.118 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.15:0 scrub status 2024-09-17T03:46:51.273 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.273+0000 7effb2c30640 1 -- 172.21.15.146:0/2929282223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effac1527a0 msgr2=0x7effac15f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.273+0000 7effb2c30640 1 --2- 172.21.15.146:0/2929282223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effac1527a0 0x7effac15f360 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 crypto rx=0x7effac0ce550 tx=0x7eff9c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.273+0000 7effb2c30640 1 -- 172.21.15.146:0/2929282223 shutdown_connections 2024-09-17T03:46:51.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.273+0000 7effb2c30640 1 --2- 172.21.15.146:0/2929282223 >> v2:172.21.15.179:3300/0 conn(0x7effac15f8a0 0x7effac0cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.273+0000 7effb2c30640 1 --2- 172.21.15.146:0/2929282223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effac1527a0 0x7effac15f360 unknown :-1 s=CLOSED pgs=2590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.273+0000 7effb2c30640 1 -- 172.21.15.146:0/2929282223 >> 172.21.15.146:0/2929282223 conn(0x7effac06ee10 msgr2=0x7effac06f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.273+0000 7effb2c30640 1 -- 172.21.15.146:0/2929282223 shutdown_connections 2024-09-17T03:46:51.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.273+0000 7effb2c30640 1 -- 172.21.15.146:0/2929282223 wait complete. 2024-09-17T03:46:51.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.275+0000 7effb2c30640 1 Processor -- start 2024-09-17T03:46:51.275 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.275+0000 7effb2c30640 1 -- start start 2024-09-17T03:46:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.276+0000 7effb2c30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effac073dc0 0x7effac1f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.276+0000 7effb2c30640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac1527a0 0x7effac14e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.276+0000 7effb2c30640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac15f8a0 0x7effac0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.276+0000 7effb2c30640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7effac0cfd90 con 0x7effac073dc0 2024-09-17T03:46:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.276+0000 7effb2c30640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7effac0cfc10 con 0x7effac1527a0 2024-09-17T03:46:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.276+0000 7effb2c30640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7effac0cff10 con 0x7effac15f8a0 2024-09-17T03:46:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.276+0000 7effb09cc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effac073dc0 0x7effac1f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.276+0000 7effb09cc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effac073dc0 0x7effac1f7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51664/0 (socket says 172.21.15.146:51664) 2024-09-17T03:46:51.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effb09cc640 1 -- 172.21.15.146:0/2955938751 learned_addr learned my addr 172.21.15.146:0/2955938751 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effb11cd640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac15f8a0 0x7effac0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effa3fff640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac1527a0 0x7effac14e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effb09cc640 1 -- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac15f8a0 msgr2=0x7effac0af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effb09cc640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac15f8a0 0x7effac0af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effb09cc640 1 -- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac1527a0 msgr2=0x7effac14e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effb09cc640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac1527a0 0x7effac14e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effb09cc640 1 -- 172.21.15.146:0/2955938751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac1f7fa0 con 0x7effac073dc0 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effa3fff640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac1527a0 0x7effac14e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effb09cc640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effac073dc0 0x7effac1f7a60 secure :-1 s=READY pgs=2591 cs=0 l=1 rev1=1 crypto rx=0x7effa800b3c0 tx=0x7effa800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effa17fa640 1 -- 172.21.15.146:0/2955938751 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8015020 con 0x7effac073dc0 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effa17fa640 1 -- 172.21.15.146:0/2955938751 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effa8011920 con 0x7effac073dc0 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effb2c30640 1 -- 172.21.15.146:0/2955938751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effac1f4070 con 0x7effac073dc0 2024-09-17T03:46:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effa17fa640 1 -- 172.21.15.146:0/2955938751 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8011db0 con 0x7effac073dc0 2024-09-17T03:46:51.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.277+0000 7effb2c30640 1 -- 172.21.15.146:0/2955938751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effac1f4630 con 0x7effac073dc0 2024-09-17T03:46:51.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.279+0000 7effa17fa640 1 -- 172.21.15.146:0/2955938751 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7effa8018020 con 0x7effac073dc0 2024-09-17T03:46:51.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.279+0000 7effa17fa640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff98078bc0 0x7eff9807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.280+0000 7effa17fa640 1 -- 172.21.15.146:0/2955938751 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7effa809a970 con 0x7effac073dc0 2024-09-17T03:46:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.280+0000 7effa3fff640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff98078bc0 0x7eff9807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.280+0000 7effa3fff640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff98078bc0 0x7eff9807b0d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7eff9c033000 tx=0x7eff9c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.281+0000 7effb9c7e740 1 Processor -- start 2024-09-17T03:46:51.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.281+0000 7effb9c7e740 1 -- start start 2024-09-17T03:46:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.282+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4236f390 0x55fb4275ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.282+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42730860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.282+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb42730da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.282+0000 7effb9c7e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fb42689a60 con 0x55fb4234e6b0 2024-09-17T03:46:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.282+0000 7effb9c7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fb42678e90 con 0x55fb4236f390 2024-09-17T03:46:51.283 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.282+0000 7effb9c7e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55fb4267cca0 con 0x55fb423464d0 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.282+0000 7effb11cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb42730da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.282+0000 7effb11cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb42730da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51666/0 (socket says 172.21.15.146:51666) 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.282+0000 7effb11cd640 1 -- 172.21.15.146:0/424966473 learned_addr learned my addr 172.21.15.146:0/424966473 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.282+0000 7effa3fff640 1 --2- 172.21.15.146:0/424966473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42730860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.282+0000 7effb09cc640 1 --2- 172.21.15.146:0/424966473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4236f390 0x55fb4275ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.283+0000 7effb11cd640 1 -- 172.21.15.146:0/424966473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 msgr2=0x55fb42730860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.283+0000 7effb11cd640 1 --2- 172.21.15.146:0/424966473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42730860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.283+0000 7effb11cd640 1 -- 172.21.15.146:0/424966473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4236f390 msgr2=0x55fb4275ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.283+0000 7effb11cd640 1 --2- 172.21.15.146:0/424966473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4236f390 0x55fb4275ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.283+0000 7effb11cd640 1 -- 172.21.15.146:0/424966473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb424517d0 con 0x55fb4234e6b0 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.283+0000 7effb11cd640 1 --2- 172.21.15.146:0/424966473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb42730da0 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7effa400ae70 tx=0x7effa400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98fded2229e99d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.283+0000 7eff927fc640 1 -- 172.21.15.146:0/424966473 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4004d20 con 0x55fb4234e6b0 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.283+0000 7eff927fc640 1 -- 172.21.15.146:0/424966473 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effa4011650 con 0x55fb4234e6b0 2024-09-17T03:46:51.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.283+0000 7eff927fc640 1 -- 172.21.15.146:0/424966473 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4011a80 con 0x55fb4234e6b0 2024-09-17T03:46:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.284+0000 7effb9c7e740 1 -- 172.21.15.146:0/424966473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 msgr2=0x55fb42730da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.284+0000 7effb9c7e740 1 --2- 172.21.15.146:0/424966473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb42730da0 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7effa400ae70 tx=0x7effa400f730 comp rx=0 tx=0).stop 2024-09-17T03:46:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.284+0000 7effb9c7e740 1 -- 172.21.15.146:0/424966473 shutdown_connections 2024-09-17T03:46:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.284+0000 7effb9c7e740 1 --2- 172.21.15.146:0/424966473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb42730da0 unknown :-1 s=CLOSED pgs=2592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.284+0000 7effb9c7e740 1 --2- 172.21.15.146:0/424966473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42730860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.284+0000 7effb9c7e740 1 --2- 172.21.15.146:0/424966473 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4236f390 0x55fb4275ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.284+0000 7effb9c7e740 1 -- 172.21.15.146:0/424966473 >> 172.21.15.146:0/424966473 conn(0x55fb423634e0 msgr2=0x55fb42716d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.284+0000 7effb9c7e740 1 -- 172.21.15.146:0/424966473 shutdown_connections 2024-09-17T03:46:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.284+0000 7effb9c7e740 1 -- 172.21.15.146:0/424966473 wait complete. 2024-09-17T03:46:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.285+0000 7effb9c7e740 1 -- start start 2024-09-17T03:46:51.286 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.285+0000 7effb9c7e740 1 Processor -- start 2024-09-17T03:46:51.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.286+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42741250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.286+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb427157b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.290 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.286+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4236f390 0x55fb42715cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.286+0000 7effb9c7e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fb423e9740 con 0x55fb4234e6b0 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.286+0000 7effb9c7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55fb4261e970 con 0x55fb4236f390 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.286+0000 7effb9c7e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55fb427169a0 con 0x55fb423464d0 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.286+0000 7effb9c7e740 10 client.0 _ll_register_callbacks cb 0x55fb4262d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.286+0000 7effa3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb427157b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.286+0000 7effa3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb427157b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51682/0 (socket says 172.21.15.146:51682) 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.286+0000 7effa3fff640 1 -- 172.21.15.146:0/4193614639 learned_addr learned my addr 172.21.15.146:0/4193614639 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effb09cc640 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42741250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effb11cd640 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4236f390 0x55fb42715cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effa3fff640 1 -- 172.21.15.146:0/4193614639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 msgr2=0x55fb42741250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effa3fff640 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42741250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effa3fff640 1 -- 172.21.15.146:0/4193614639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4236f390 msgr2=0x55fb42715cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effa3fff640 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4236f390 0x55fb42715cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effa3fff640 1 -- 172.21.15.146:0/4193614639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb423da970 con 0x55fb4234e6b0 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effb11cd640 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4236f390 0x55fb42715cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effa3fff640 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb427157b0 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7eff9c000c00 tx=0x7eff9c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853c5b29661aa90f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7eff8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7eff8b7fe640 1 -- 172.21.15.146:0/4193614639 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c04d020 con 0x55fb4234e6b0 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7eff8b7fe640 1 -- 172.21.15.146:0/4193614639 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7eff9c0049a0 con 0x55fb4234e6b0 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effb9c7e740 1 -- 172.21.15.146:0/4193614639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effa4011650 con 0x55fb4234e6b0 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7eff8b7fe640 1 -- 172.21.15.146:0/4193614639 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=154) ==== 24+0+0 (secure 0 0 0) 0x7eff9c057050 con 0x55fb4234e6b0 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effb9c7e740 10 client.11673 fetch_fsmap learned FSMap version 154 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7effb9c7e740 1 -- 172.21.15.146:0/4193614639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=154,monmap=2+}) -- 0x55fb423b86a0 con 0x55fb4234e6b0 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7eff8b7fe640 1 -- 172.21.15.146:0/4193614639 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effa4011650 con 0x55fb4234e6b0 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.287+0000 7eff8b7fe640 1 -- 172.21.15.146:0/4193614639 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 154) ==== 3502+0+0 (secure 0 0 0) 0x7eff9c05a020 con 0x55fb4234e6b0 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.288+0000 7effb9c7e740 10 client.11673 fetch_fsmap finished waiting for FSMap version 154 2024-09-17T03:46:51.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.288+0000 7effb9c7e740 10 client.11673 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.c 2024-09-17T03:46:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.288+0000 7effb9c7e740 20 client.11673 populate_metadata read hostname 'smithi146' 2024-09-17T03:46:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.288+0000 7effb9c7e740 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55fb4232df60 0x55fb42722ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.288+0000 7effb9c7e740 4 client.11673 mds_command: new command op to 11496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:46:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.288+0000 7effb9c7e740 1 -- 172.21.15.146:0/4193614639 --> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb4268b9b0 con 0x55fb4232df60 2024-09-17T03:46:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.288+0000 7effb09cc640 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55fb4232df60 0x55fb42722ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.288+0000 7eff8b7fe640 10 client.11673 ms_handle_connect on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.288+0000 7effb09cc640 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55fb4232df60 0x55fb42722ad0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=541dd5a994f6dc60 server_cookie=cdc0a96990655889 in_seq=0 out_seq=0 2024-09-17T03:46:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7eff8b7fe640 1 -- 172.21.15.146:0/4193614639 <== mds.0 v2:172.21.15.146:6832/172455759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb4268b9b0 con 0x55fb4232df60 2024-09-17T03:46:51.293 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7eff8b7fe640 10 client.11673 handle_command_reply: tid=0 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 1 client.11673 shutdown 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 1 -- 172.21.15.146:0/4193614639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 msgr2=0x55fb427157b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb427157b0 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7eff9c000c00 tx=0x7eff9c009260 comp rx=0 tx=0).stop 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 1 -- 172.21.15.146:0/4193614639 shutdown_connections 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4236f390 0x55fb42715cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55fb4232df60 0x55fb42722ad0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4234e6b0 0x55fb427157b0 unknown :-1 s=CLOSED pgs=2593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 1 --2- 172.21.15.146:0/4193614639 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42741250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7eff8b7fe640 0 client.11673 ms_handle_reset on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 1 -- 172.21.15.146:0/4193614639 >> 172.21.15.146:0/4193614639 conn(0x55fb423634e0 msgr2=0x55fb4270fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 1 -- 172.21.15.146:0/4193614639 shutdown_connections 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 1 -- 172.21.15.146:0/4193614639 wait complete. 2024-09-17T03:46:51.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.289+0000 7effb9c7e740 20 client.11673 trim_cache size 0 max 16384 2024-09-17T03:46:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.307+0000 7effb9c7e740 1 Processor -- start 2024-09-17T03:46:51.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.307+0000 7effb9c7e740 1 -- start start 2024-09-17T03:46:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42722ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4234e6b0 0x55fb42723010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb9c7e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7effac2001f0 con 0x55fb4236f390 2024-09-17T03:46:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb9c7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7effac1ff3e0 con 0x55fb4234e6b0 2024-09-17T03:46:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb9c7e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7effac072f40 con 0x55fb423464d0 2024-09-17T03:46:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb11cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb11cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51694/0 (socket says 172.21.15.146:51694) 2024-09-17T03:46:51.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb11cd640 1 -- 172.21.15.146:0/2521501649 learned_addr learned my addr 172.21.15.146:0/2521501649 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb09cc640 1 --2- 172.21.15.146:0/2521501649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42722ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb11cd640 1 -- 172.21.15.146:0/2521501649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 msgr2=0x55fb42722ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effa3fff640 1 --2- 172.21.15.146:0/2521501649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4234e6b0 0x55fb42723010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb11cd640 1 --2- 172.21.15.146:0/2521501649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42722ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb11cd640 1 -- 172.21.15.146:0/2521501649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4234e6b0 msgr2=0x55fb42723010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb11cd640 1 --2- 172.21.15.146:0/2521501649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4234e6b0 0x55fb42723010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.308+0000 7effb11cd640 1 -- 172.21.15.146:0/2521501649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb4273e6a0 con 0x55fb4236f390 2024-09-17T03:46:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.309+0000 7effb11cd640 1 --2- 172.21.15.146:0/2521501649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275b1a0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7effa400aae0 tx=0x7effa4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381eb0ac6d48143a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.309+0000 7eff91ffb640 1 -- 172.21.15.146:0/2521501649 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4004d20 con 0x55fb4236f390 2024-09-17T03:46:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.309+0000 7eff91ffb640 1 -- 172.21.15.146:0/2521501649 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effa4003970 con 0x55fb4236f390 2024-09-17T03:46:51.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.309+0000 7eff91ffb640 1 -- 172.21.15.146:0/2521501649 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4003da0 con 0x55fb4236f390 2024-09-17T03:46:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.309+0000 7effb9c7e740 1 -- 172.21.15.146:0/2521501649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 msgr2=0x55fb4275b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.309+0000 7effb9c7e740 1 --2- 172.21.15.146:0/2521501649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275b1a0 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7effa400aae0 tx=0x7effa4004a40 comp rx=0 tx=0).stop 2024-09-17T03:46:51.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.309+0000 7effb9c7e740 1 -- 172.21.15.146:0/2521501649 shutdown_connections 2024-09-17T03:46:51.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.309+0000 7effb9c7e740 1 --2- 172.21.15.146:0/2521501649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275b1a0 unknown :-1 s=CLOSED pgs=2594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.309+0000 7effb9c7e740 1 --2- 172.21.15.146:0/2521501649 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4234e6b0 0x55fb42723010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.310+0000 7effb9c7e740 1 --2- 172.21.15.146:0/2521501649 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb42722ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.310+0000 7effb9c7e740 1 -- 172.21.15.146:0/2521501649 >> 172.21.15.146:0/2521501649 conn(0x55fb423634e0 msgr2=0x55fb4273dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.310+0000 7effb9c7e740 1 -- 172.21.15.146:0/2521501649 shutdown_connections 2024-09-17T03:46:51.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.310+0000 7effb9c7e740 1 -- 172.21.15.146:0/2521501649 wait complete. 2024-09-17T03:46:51.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.310+0000 7effb9c7e740 1 -- start start 2024-09-17T03:46:51.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.311+0000 7effb9c7e740 1 Processor -- start 2024-09-17T03:46:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb4277d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4234e6b0 0x55fb4275b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb9c7e740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb9c7e740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55fb42715900 con 0x55fb4236f390 2024-09-17T03:46:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb9c7e740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7effac073590 con 0x55fb4234e6b0 2024-09-17T03:46:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb9c7e740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55fb42751ea0 con 0x55fb423464d0 2024-09-17T03:46:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb9c7e740 10 client.0 _ll_register_callbacks cb 0x7eff9c004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:46:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb11cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb11cd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51706/0 (socket says 172.21.15.146:51706) 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb11cd640 1 -- 172.21.15.146:0/1734135074 learned_addr learned my addr 172.21.15.146:0/1734135074 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effa3fff640 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4234e6b0 0x55fb4275b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb09cc640 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb4277d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb11cd640 1 -- 172.21.15.146:0/1734135074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 msgr2=0x55fb4277d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb11cd640 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb4277d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb11cd640 1 -- 172.21.15.146:0/1734135074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4234e6b0 msgr2=0x55fb4275b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb11cd640 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4234e6b0 0x55fb4275b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb11cd640 1 -- 172.21.15.146:0/1734135074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb4275c1c0 con 0x55fb4236f390 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.312+0000 7effb09cc640 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb4277d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7effb11cd640 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275bc80 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7effa400ae70 tx=0x7effa4004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf5ef9bf8b7ecb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7eff8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7eff8b7fe640 1 -- 172.21.15.146:0/1734135074 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4031060 con 0x55fb4236f390 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7eff8b7fe640 1 -- 172.21.15.146:0/1734135074 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7effa4003d30 con 0x55fb4236f390 2024-09-17T03:46:51.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7effb9c7e740 1 -- 172.21.15.146:0/1734135074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effa4003970 con 0x55fb4236f390 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7eff8b7fe640 1 -- 172.21.15.146:0/1734135074 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=154) ==== 24+0+0 (secure 0 0 0) 0x7effa4037050 con 0x55fb4236f390 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7effb9c7e740 10 client.11679 fetch_fsmap learned FSMap version 154 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7effb9c7e740 1 -- 172.21.15.146:0/1734135074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=154,monmap=2+}) -- 0x55fb427231e0 con 0x55fb4236f390 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7eff8b7fe640 1 -- 172.21.15.146:0/1734135074 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effa4003970 con 0x55fb4236f390 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7eff8b7fe640 1 -- 172.21.15.146:0/1734135074 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 154) ==== 3502+0+0 (secure 0 0 0) 0x7effa403a020 con 0x55fb4236f390 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7effb9c7e740 10 client.11679 fetch_fsmap finished waiting for FSMap version 154 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7effb9c7e740 10 client.11679 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.c 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7effb9c7e740 20 client.11679 populate_metadata read hostname 'smithi146' 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7effb9c7e740 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55fb42716e80 0x55fb427d9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7effb9c7e740 4 client.11679 mds_command: new command op to 11496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7effb9c7e740 1 -- 172.21.15.146:0/1734135074 --> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fb42687460 con 0x55fb42716e80 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.313+0000 7effb09cc640 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55fb42716e80 0x55fb427d9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7eff8b7fe640 10 client.11679 ms_handle_connect on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:51.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb09cc640 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55fb42716e80 0x55fb427d9db0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6600ecdb757a7ad3 server_cookie=2860b74fa9c35832 in_seq=0 out_seq=0 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7eff8b7fe640 1 -- 172.21.15.146:0/1734135074 <== mds.0 v2:172.21.15.146:6832/172455759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+86 (crc 0 0 0) 0x55fb42687460 con 0x55fb42716e80 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7eff8b7fe640 10 client.11679 handle_command_reply: tid=0 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 1 client.11679 shutdown 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 1 -- 172.21.15.146:0/1734135074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 msgr2=0x55fb4275bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275bc80 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7effa400ae70 tx=0x7effa4004d50 comp rx=0 tx=0).stop 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 1 -- 172.21.15.146:0/1734135074 shutdown_connections 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55fb42716e80 0x55fb427d9db0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fb4236f390 0x55fb4275bc80 unknown :-1 s=CLOSED pgs=2595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7eff8b7fe640 0 client.11679 ms_handle_reset on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55fb4234e6b0 0x55fb4275b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 1 --2- 172.21.15.146:0/1734135074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55fb423464d0 0x55fb4277d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 1 -- 172.21.15.146:0/1734135074 >> 172.21.15.146:0/1734135074 conn(0x55fb423634e0 msgr2=0x55fb42722ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 1 -- 172.21.15.146:0/1734135074 shutdown_connections 2024-09-17T03:46:51.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 1 -- 172.21.15.146:0/1734135074 wait complete. 2024-09-17T03:46:51.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.314+0000 7effb9c7e740 20 client.11679 trim_cache size 0 max 16384 2024-09-17T03:46:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:46:51.320 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2024-09-17T03:46:51.320 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {}, 2024-09-17T03:46:51.320 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": {} 2024-09-17T03:46:51.320 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:46:51.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 -- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff98078bc0 msgr2=0x7eff9807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff98078bc0 0x7eff9807b0d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7eff9c033000 tx=0x7eff9c004730 comp rx=0 tx=0).stop 2024-09-17T03:46:51.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 -- 172.21.15.146:0/2955938751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effac073dc0 msgr2=0x7effac1f7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effac073dc0 0x7effac1f7a60 secure :-1 s=READY pgs=2591 cs=0 l=1 rev1=1 crypto rx=0x7effa800b3c0 tx=0x7effa800b880 comp rx=0 tx=0).stop 2024-09-17T03:46:51.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 -- 172.21.15.146:0/2955938751 shutdown_connections 2024-09-17T03:46:51.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7eff98078bc0 0x7eff9807b0d0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7effac15f8a0 0x7effac0af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7effac1527a0 0x7effac14e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 --2- 172.21.15.146:0/2955938751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effac073dc0 0x7effac1f7a60 unknown :-1 s=CLOSED pgs=2591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 -- 172.21.15.146:0/2955938751 >> 172.21.15.146:0/2955938751 conn(0x7effac06ee10 msgr2=0x7effac0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 -- 172.21.15.146:0/2955938751 shutdown_connections 2024-09-17T03:46:51.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.315+0000 7effb2c30640 1 -- 172.21.15.146:0/2955938751 wait complete. 2024-09-17T03:46:51.326 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:46:51.326 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.15:0 damage ls 2024-09-17T03:46:51.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.440+0000 7f40110d5640 1 -- 172.21.15.146:0/3846910312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c0ce610 msgr2=0x7f400c152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.440+0000 7f40110d5640 1 --2- 172.21.15.146:0/3846910312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c0ce610 0x7f400c152a70 secure :-1 s=READY pgs=2596 cs=0 l=1 rev1=1 crypto rx=0x7f4000005fd0 tx=0x7f400002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.440+0000 7f40110d5640 1 -- 172.21.15.146:0/3846910312 shutdown_connections 2024-09-17T03:46:51.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.440+0000 7f40110d5640 1 --2- 172.21.15.146:0/3846910312 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c15f5c0 0x7f400c15f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.440+0000 7f40110d5640 1 --2- 172.21.15.146:0/3846910312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c0ce610 0x7f400c152a70 unknown :-1 s=CLOSED pgs=2596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.440+0000 7f40110d5640 1 -- 172.21.15.146:0/3846910312 >> 172.21.15.146:0/3846910312 conn(0x7f400c0b3350 msgr2=0x7f400c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.440+0000 7f40110d5640 1 -- 172.21.15.146:0/3846910312 shutdown_connections 2024-09-17T03:46:51.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.440+0000 7f40110d5640 1 -- 172.21.15.146:0/3846910312 wait complete. 2024-09-17T03:46:51.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.442+0000 7f40110d5640 1 Processor -- start 2024-09-17T03:46:51.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.442+0000 7f40110d5640 1 -- start start 2024-09-17T03:46:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.443+0000 7f40110d5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f400c15cd10 0x7f400c1566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.443+0000 7f40110d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c15f5c0 0x7f400c1f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.443+0000 7f40110d5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c1f6920 0x7f400c1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.443+0000 7f40110d5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f400c0cfb70 con 0x7f400c15f5c0 2024-09-17T03:46:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.443+0000 7f40110d5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f400c0cf9f0 con 0x7f400c15cd10 2024-09-17T03:46:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.443+0000 7f40110d5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f400c0cfcf0 con 0x7f400c1f6920 2024-09-17T03:46:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c15f5c0 0x7f400c1f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c15f5c0 0x7f400c1f55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51732/0 (socket says 172.21.15.146:51732) 2024-09-17T03:46:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400a59c640 1 -- 172.21.15.146:0/1084731387 learned_addr learned my addr 172.21.15.146:0/1084731387 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:51.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400b59e640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c1f6920 0x7f400c1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400ad9d640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f400c15cd10 0x7f400c1566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400a59c640 1 -- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c1f6920 msgr2=0x7f400c1f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400a59c640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c1f6920 0x7f400c1f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400a59c640 1 -- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f400c15cd10 msgr2=0x7f400c1566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400a59c640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f400c15cd10 0x7f400c1566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400a59c640 1 -- 172.21.15.146:0/1084731387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400c1f5ae0 con 0x7f400c15f5c0 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400ad9d640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f400c15cd10 0x7f400c1566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400b59e640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c1f6920 0x7f400c1f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f400a59c640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c15f5c0 0x7f400c1f55a0 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7f4000034040 tx=0x7f4000003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f3ff37fe640 1 -- 172.21.15.146:0/1084731387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000035040 con 0x7f400c15f5c0 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f3ff37fe640 1 -- 172.21.15.146:0/1084731387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40000047a0 con 0x7f400c15f5c0 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f40110d5640 1 -- 172.21.15.146:0/1084731387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400c156fe0 con 0x7f400c15f5c0 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f3ff37fe640 1 -- 172.21.15.146:0/1084731387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000004bf0 con 0x7f400c15f5c0 2024-09-17T03:46:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.444+0000 7f40110d5640 1 -- 172.21.15.146:0/1084731387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f400c1575a0 con 0x7f400c15f5c0 2024-09-17T03:46:51.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.446+0000 7f3ff37fe640 1 -- 172.21.15.146:0/1084731387 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4000004d90 con 0x7f400c15f5c0 2024-09-17T03:46:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.446+0000 7f3ff37fe640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ff8078b90 0x7f3ff807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.447+0000 7f3ff37fe640 1 -- 172.21.15.146:0/1084731387 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f40000bd750 con 0x7f400c15f5c0 2024-09-17T03:46:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.447+0000 7f400ad9d640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ff8078b90 0x7f3ff807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.447+0000 7f400ad9d640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ff8078b90 0x7f3ff807b0a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00a830 tx=0x7f3ffc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.447+0000 7f401803d740 1 Processor -- start 2024-09-17T03:46:51.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.448+0000 7f401803d740 1 -- start start 2024-09-17T03:46:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f401803d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d7f390 0x55a62713fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f401803d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d564d0 0x55a62714e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f401803d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d5e6b0 0x55a62714e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f401803d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a6270998e0 con 0x55a626d564d0 2024-09-17T03:46:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f401803d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a627088d10 con 0x55a626d7f390 2024-09-17T03:46:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f401803d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a62708cb20 con 0x55a626d5e6b0 2024-09-17T03:46:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f400a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d564d0 0x55a62714e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f400ad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d7f390 0x55a62713fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f400a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d564d0 0x55a62714e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51738/0 (socket says 172.21.15.146:51738) 2024-09-17T03:46:51.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f400a59c640 1 -- 172.21.15.146:0/81160092 learned_addr learned my addr 172.21.15.146:0/81160092 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:51.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f400b59e640 1 --2- 172.21.15.146:0/81160092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d5e6b0 0x55a62714e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f400a59c640 1 -- 172.21.15.146:0/81160092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d5e6b0 msgr2=0x55a62714e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f400a59c640 1 --2- 172.21.15.146:0/81160092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d5e6b0 0x55a62714e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f400a59c640 1 -- 172.21.15.146:0/81160092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d7f390 msgr2=0x55a62713fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f400a59c640 1 --2- 172.21.15.146:0/81160092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d7f390 0x55a62713fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f400a59c640 1 -- 172.21.15.146:0/81160092 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a626dea970 con 0x55a626d564d0 2024-09-17T03:46:51.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.449+0000 7f400a59c640 1 --2- 172.21.15.146:0/81160092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d564d0 0x55a62714e0a0 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7f40000854c0 tx=0x7f4000081cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b985892df5cefcc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.450+0000 7f3ff0ff9640 1 -- 172.21.15.146:0/81160092 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000005310 con 0x55a626d564d0 2024-09-17T03:46:51.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.450+0000 7f3ff0ff9640 1 -- 172.21.15.146:0/81160092 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4000085040 con 0x55a626d564d0 2024-09-17T03:46:51.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.450+0000 7f3ff0ff9640 1 -- 172.21.15.146:0/81160092 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000085990 con 0x55a626d564d0 2024-09-17T03:46:51.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.450+0000 7f401803d740 1 -- 172.21.15.146:0/81160092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d564d0 msgr2=0x55a62714e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.450+0000 7f401803d740 1 --2- 172.21.15.146:0/81160092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d564d0 0x55a62714e0a0 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7f40000854c0 tx=0x7f4000081cb0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.451+0000 7f401803d740 1 -- 172.21.15.146:0/81160092 shutdown_connections 2024-09-17T03:46:51.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.451+0000 7f401803d740 1 --2- 172.21.15.146:0/81160092 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d5e6b0 0x55a62714e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.451+0000 7f401803d740 1 --2- 172.21.15.146:0/81160092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d564d0 0x55a62714e0a0 unknown :-1 s=CLOSED pgs=2598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.451+0000 7f401803d740 1 --2- 172.21.15.146:0/81160092 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d7f390 0x55a62713fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.451+0000 7f401803d740 1 -- 172.21.15.146:0/81160092 >> 172.21.15.146:0/81160092 conn(0x55a626d734e0 msgr2=0x55a627127490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.451+0000 7f401803d740 1 -- 172.21.15.146:0/81160092 shutdown_connections 2024-09-17T03:46:51.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.451+0000 7f401803d740 1 -- 172.21.15.146:0/81160092 wait complete. 2024-09-17T03:46:51.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.451+0000 7f401803d740 1 -- start start 2024-09-17T03:46:51.453 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.452+0000 7f401803d740 1 Processor -- start 2024-09-17T03:46:51.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f401803d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d564d0 0x55a62713e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f401803d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d5e6b0 0x55a627126630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f401803d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d7f390 0x55a627168e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f401803d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a626df9740 con 0x55a626d7f390 2024-09-17T03:46:51.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f401803d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55a62702e7f0 con 0x55a626d564d0 2024-09-17T03:46:51.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f401803d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a6270998e0 con 0x55a626d5e6b0 2024-09-17T03:46:51.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f401803d740 10 client.0 _ll_register_callbacks cb 0x55a6270322a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:46:51.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f400b59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d7f390 0x55a627168e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f400b59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d7f390 0x55a627168e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51740/0 (socket says 172.21.15.146:51740) 2024-09-17T03:46:51.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f400b59e640 1 -- 172.21.15.146:0/1523496234 learned_addr learned my addr 172.21.15.146:0/1523496234 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:51.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f400ad9d640 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d564d0 0x55a62713e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f400a59c640 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d5e6b0 0x55a627126630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f400b59e640 1 -- 172.21.15.146:0/1523496234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d5e6b0 msgr2=0x55a627126630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f400b59e640 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d5e6b0 0x55a627126630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f400b59e640 1 -- 172.21.15.146:0/1523496234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d564d0 msgr2=0x55a62713e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f400b59e640 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d564d0 0x55a62713e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f400b59e640 1 -- 172.21.15.146:0/1523496234 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a626e617d0 con 0x55a626d7f390 2024-09-17T03:46:51.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f400b59e640 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d7f390 0x55a627168e60 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 crypto rx=0x7f400400faf0 tx=0x7f4004007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6308dba6a8f75f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.453+0000 7f3fe9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:46:51.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/1523496234 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400400dea0 con 0x55a626d7f390 2024-09-17T03:46:51.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/1523496234 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f4004010420 con 0x55a626d7f390 2024-09-17T03:46:51.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f401803d740 1 -- 172.21.15.146:0/1523496234 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4000085040 con 0x55a626d7f390 2024-09-17T03:46:51.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/1523496234 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=154) ==== 24+0+0 (secure 0 0 0) 0x7f4004010620 con 0x55a626d7f390 2024-09-17T03:46:51.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f401803d740 10 client.11691 fetch_fsmap learned FSMap version 154 2024-09-17T03:46:51.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f401803d740 1 -- 172.21.15.146:0/1523496234 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=154,monmap=2+}) -- 0x55a627180310 con 0x55a626d7f390 2024-09-17T03:46:51.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/1523496234 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4000085040 con 0x55a626d7f390 2024-09-17T03:46:51.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/1523496234 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 154) ==== 3502+0+0 (secure 0 0 0) 0x7f4004025080 con 0x55a626d7f390 2024-09-17T03:46:51.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f401803d740 10 client.11691 fetch_fsmap finished waiting for FSMap version 154 2024-09-17T03:46:51.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f401803d740 10 client.11691 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.c 2024-09-17T03:46:51.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f401803d740 20 client.11691 populate_metadata read hostname 'smithi146' 2024-09-17T03:46:51.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f401803d740 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55a626d3df60 0x55a627162ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f401803d740 4 client.11691 mds_command: new command op to 11496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:46:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f401803d740 1 -- 172.21.15.146:0/1523496234 --> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a62709b830 con 0x55a626d3df60 2024-09-17T03:46:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.454+0000 7f400ad9d640 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55a626d3df60 0x55a627162ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f3fe9ffb640 10 client.11691 ms_handle_connect on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f400ad9d640 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55a626d3df60 0x55a627162ec0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82447017ad26be75 server_cookie=721332a9cc7b6066 in_seq=0 out_seq=0 2024-09-17T03:46:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/1523496234 <== mds.0 v2:172.21.15.146:6832/172455759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a62709b830 con 0x55a626d3df60 2024-09-17T03:46:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f3fe9ffb640 10 client.11691 handle_command_reply: tid=0 2024-09-17T03:46:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f401803d740 1 client.11691 shutdown 2024-09-17T03:46:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f401803d740 1 -- 172.21.15.146:0/1523496234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d7f390 msgr2=0x55a627168e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f401803d740 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d7f390 0x55a627168e60 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 crypto rx=0x7f400400faf0 tx=0x7f4004007f70 comp rx=0 tx=0).stop 2024-09-17T03:46:51.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f401803d740 1 -- 172.21.15.146:0/1523496234 shutdown_connections 2024-09-17T03:46:51.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f401803d740 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55a626d3df60 0x55a627162ec0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f401803d740 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d7f390 0x55a627168e60 unknown :-1 s=CLOSED pgs=2599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f401803d740 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d5e6b0 0x55a627126630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f401803d740 1 --2- 172.21.15.146:0/1523496234 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d564d0 0x55a62713e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f3fe9ffb640 0 client.11691 ms_handle_reset on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:51.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.455+0000 7f401803d740 1 -- 172.21.15.146:0/1523496234 >> 172.21.15.146:0/1523496234 conn(0x55a626d734e0 msgr2=0x55a62714e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.456+0000 7f401803d740 1 -- 172.21.15.146:0/1523496234 shutdown_connections 2024-09-17T03:46:51.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.456+0000 7f401803d740 1 -- 172.21.15.146:0/1523496234 wait complete. 2024-09-17T03:46:51.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.456+0000 7f401803d740 20 client.11691 trim_cache size 0 max 16384 2024-09-17T03:46:51.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.469+0000 7f401803d740 1 Processor -- start 2024-09-17T03:46:51.469 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.469+0000 7f401803d740 1 -- start start 2024-09-17T03:46:51.472 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.470+0000 7f401803d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d734e0 0x55a62716e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.470+0000 7f401803d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d564d0 0x55a627165610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.470+0000 7f401803d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d5e6b0 0x55a627165b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.470+0000 7f401803d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f400c1fe260 con 0x55a626d734e0 2024-09-17T03:46:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.470+0000 7f401803d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f400c06d060 con 0x55a626d5e6b0 2024-09-17T03:46:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.470+0000 7f401803d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f400c15b550 con 0x55a626d564d0 2024-09-17T03:46:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.470+0000 7f400ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d734e0 0x55a62716e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.470+0000 7f400ad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d734e0 0x55a62716e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51756/0 (socket says 172.21.15.146:51756) 2024-09-17T03:46:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.470+0000 7f400ad9d640 1 -- 172.21.15.146:0/1047271453 learned_addr learned my addr 172.21.15.146:0/1047271453 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:51.473 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.471+0000 7f400a59c640 1 --2- 172.21.15.146:0/1047271453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d564d0 0x55a627165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.471+0000 7f400b59e640 1 --2- 172.21.15.146:0/1047271453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d5e6b0 0x55a627165b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.471+0000 7f400ad9d640 1 -- 172.21.15.146:0/1047271453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d564d0 msgr2=0x55a627165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.471+0000 7f400ad9d640 1 --2- 172.21.15.146:0/1047271453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d564d0 0x55a627165610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.471+0000 7f400ad9d640 1 -- 172.21.15.146:0/1047271453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d5e6b0 msgr2=0x55a627165b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.471+0000 7f400ad9d640 1 --2- 172.21.15.146:0/1047271453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d5e6b0 0x55a627165b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.471+0000 7f400ad9d640 1 -- 172.21.15.146:0/1047271453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a627123810 con 0x55a626d734e0 2024-09-17T03:46:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.471+0000 7f400ad9d640 1 --2- 172.21.15.146:0/1047271453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d734e0 0x55a62716e520 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x55a627126c00 tx=0x7f3ffc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8836fdd803cd3fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.471+0000 7f3febfff640 1 -- 172.21.15.146:0/1047271453 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc004020 con 0x55a626d734e0 2024-09-17T03:46:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.471+0000 7f3febfff640 1 -- 172.21.15.146:0/1047271453 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ffc0041c0 con 0x55a626d734e0 2024-09-17T03:46:51.474 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.471+0000 7f3febfff640 1 -- 172.21.15.146:0/1047271453 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc004410 con 0x55a626d734e0 2024-09-17T03:46:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.472+0000 7f401803d740 1 -- 172.21.15.146:0/1047271453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d734e0 msgr2=0x55a62716e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.472+0000 7f401803d740 1 --2- 172.21.15.146:0/1047271453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d734e0 0x55a62716e520 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x55a627126c00 tx=0x7f3ffc012000 comp rx=0 tx=0).stop 2024-09-17T03:46:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.472+0000 7f401803d740 1 -- 172.21.15.146:0/1047271453 shutdown_connections 2024-09-17T03:46:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.472+0000 7f401803d740 1 --2- 172.21.15.146:0/1047271453 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d5e6b0 0x55a627165b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.472+0000 7f401803d740 1 --2- 172.21.15.146:0/1047271453 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d564d0 0x55a627165610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.472+0000 7f401803d740 1 --2- 172.21.15.146:0/1047271453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d734e0 0x55a62716e520 unknown :-1 s=CLOSED pgs=2600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.472+0000 7f401803d740 1 -- 172.21.15.146:0/1047271453 >> 172.21.15.146:0/1047271453 conn(0x55a627168f90 msgr2=0x55a627122f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.472+0000 7f401803d740 1 -- 172.21.15.146:0/1047271453 shutdown_connections 2024-09-17T03:46:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.472+0000 7f401803d740 1 -- 172.21.15.146:0/1047271453 wait complete. 2024-09-17T03:46:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.473+0000 7f401803d740 1 -- start start 2024-09-17T03:46:51.475 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.473+0000 7f401803d740 1 Processor -- start 2024-09-17T03:46:51.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f401803d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d564d0 0x55a627140970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f401803d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d5e6b0 0x55a627165980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f401803d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d734e0 0x55a6271ef820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f401803d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55a627182a50 con 0x55a626d5e6b0 2024-09-17T03:46:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f401803d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f400c1f34a0 con 0x55a626d734e0 2024-09-17T03:46:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f401803d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55a627141190 con 0x55a626d564d0 2024-09-17T03:46:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f401803d740 10 client.0 _ll_register_callbacks cb 0x7f40040079c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:46:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f400a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d5e6b0 0x55a627165980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f400a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d5e6b0 0x55a627165980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51760/0 (socket says 172.21.15.146:51760) 2024-09-17T03:46:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f400a59c640 1 -- 172.21.15.146:0/244109573 learned_addr learned my addr 172.21.15.146:0/244109573 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:51.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f400ad9d640 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d564d0 0x55a627140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f400b59e640 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d734e0 0x55a6271ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f400a59c640 1 -- 172.21.15.146:0/244109573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d564d0 msgr2=0x55a627140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f400a59c640 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d564d0 0x55a627140970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f400a59c640 1 -- 172.21.15.146:0/244109573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d734e0 msgr2=0x55a6271ef820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:46:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f400a59c640 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d734e0 0x55a6271ef820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f400a59c640 1 -- 172.21.15.146:0/244109573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a627147c70 con 0x55a626d5e6b0 2024-09-17T03:46:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.474+0000 7f400b59e640 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d734e0 0x55a6271ef820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f400a59c640 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d5e6b0 0x55a627165980 secure :-1 s=READY pgs=2601 cs=0 l=1 rev1=1 crypto rx=0x7f40000827a0 tx=0x7f4000085b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169f46468b00bcbc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f3fe9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:46:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/244109573 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000005310 con 0x55a626d5e6b0 2024-09-17T03:46:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/244109573 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f400009f760 con 0x55a626d5e6b0 2024-09-17T03:46:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f401803d740 1 -- 172.21.15.146:0/244109573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ffc0041c0 con 0x55a626d5e6b0 2024-09-17T03:46:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/244109573 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=154) ==== 24+0+0 (secure 0 0 0) 0x7f4000085040 con 0x55a626d5e6b0 2024-09-17T03:46:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f401803d740 10 client.11697 fetch_fsmap learned FSMap version 154 2024-09-17T03:46:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f401803d740 1 -- 172.21.15.146:0/244109573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=154,monmap=2+}) -- 0x55a627147c70 con 0x55a626d5e6b0 2024-09-17T03:46:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/244109573 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ffc0041c0 con 0x55a626d5e6b0 2024-09-17T03:46:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/244109573 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 154) ==== 3502+0+0 (secure 0 0 0) 0x7f4000040070 con 0x55a626d5e6b0 2024-09-17T03:46:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f401803d740 10 client.11697 fetch_fsmap finished waiting for FSMap version 154 2024-09-17T03:46:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f401803d740 10 client.11697 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.c 2024-09-17T03:46:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f401803d740 20 client.11697 populate_metadata read hostname 'smithi146' 2024-09-17T03:46:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f401803d740 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55a626d133a0 0x55a627148150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f401803d740 4 client.11697 mds_command: new command op to 11496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f401803d740 1 -- 172.21.15.146:0/244109573 --> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a6270972e0 con 0x55a626d133a0 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.475+0000 7f400ad9d640 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55a626d133a0 0x55a627148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f3fe9ffb640 10 client.11697 ms_handle_connect on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f400ad9d640 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55a626d133a0 0x55a627148150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d21b9163d7619aea server_cookie=d7d371b196501fae in_seq=0 out_seq=0 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f3fe9ffb640 1 -- 172.21.15.146:0/244109573 <== mds.0 v2:172.21.15.146:6832/172455759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a6270972e0 con 0x55a626d133a0 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f3fe9ffb640 10 client.11697 handle_command_reply: tid=0 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 1 client.11697 shutdown 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 1 -- 172.21.15.146:0/244109573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d5e6b0 msgr2=0x55a627165980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d5e6b0 0x55a627165980 secure :-1 s=READY pgs=2601 cs=0 l=1 rev1=1 crypto rx=0x7f40000827a0 tx=0x7f4000085b50 comp rx=0 tx=0).stop 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 1 -- 172.21.15.146:0/244109573 shutdown_connections 2024-09-17T03:46:51.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55a626d734e0 0x55a6271ef820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.146:6832/172455759,v1:172.21.15.146:6833/172455759] conn(0x55a626d133a0 0x55a627148150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a626d5e6b0 0x55a627165980 unknown :-1 s=CLOSED pgs=2601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 1 --2- 172.21.15.146:0/244109573 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55a626d564d0 0x55a627140970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f3fe9ffb640 0 client.11697 ms_handle_reset on v2:172.21.15.146:6832/172455759 2024-09-17T03:46:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 1 -- 172.21.15.146:0/244109573 >> 172.21.15.146:0/244109573 conn(0x55a627168f90 msgr2=0x55a62713f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 1 -- 172.21.15.146:0/244109573 shutdown_connections 2024-09-17T03:46:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 1 -- 172.21.15.146:0/244109573 wait complete. 2024-09-17T03:46:51.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.476+0000 7f401803d740 20 client.11697 trim_cache size 0 max 16384 2024-09-17T03:46:51.485 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2024-09-17T03:46:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 -- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ff8078b90 msgr2=0x7f3ff807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ff8078b90 0x7f3ff807b0a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00a830 tx=0x7f3ffc008040 comp rx=0 tx=0).stop 2024-09-17T03:46:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 -- 172.21.15.146:0/1084731387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c15f5c0 msgr2=0x7f400c1f55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c15f5c0 0x7f400c1f55a0 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7f4000034040 tx=0x7f4000003970 comp rx=0 tx=0).stop 2024-09-17T03:46:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 -- 172.21.15.146:0/1084731387 shutdown_connections 2024-09-17T03:46:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3ff8078b90 0x7f3ff807b0a0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f400c1f6920 0x7f400c1f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f400c15f5c0 0x7f400c1f55a0 unknown :-1 s=CLOSED pgs=2597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 --2- 172.21.15.146:0/1084731387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f400c15cd10 0x7f400c1566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 -- 172.21.15.146:0/1084731387 >> 172.21.15.146:0/1084731387 conn(0x7f400c0b3350 msgr2=0x7f400c0d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 -- 172.21.15.146:0/1084731387 shutdown_connections 2024-09-17T03:46:51.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.477+0000 7f40110d5640 1 -- 172.21.15.146:0/1084731387 wait complete. 2024-09-17T03:46:51.488 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:46:51.489 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:46:51.525 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:46:51.570 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:46:51.570 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:46:51.571 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:46:51.571 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:51.586 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:46:51.587 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:51.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:46:51.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.797+0000 7f5c0672b640 1 -- 172.21.15.146:0/425339660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c000b5420 msgr2=0x7f5c0015bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.797+0000 7f5c0672b640 1 --2- 172.21.15.146:0/425339660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c000b5420 0x7f5c0015bf30 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7f5c000ce130 tx=0x7f5bf402a480 comp rx=0 tx=0).stop 2024-09-17T03:46:51.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.797+0000 7f5c0672b640 1 -- 172.21.15.146:0/425339660 shutdown_connections 2024-09-17T03:46:51.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.797+0000 7f5c0672b640 1 --2- 172.21.15.146:0/425339660 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c0015c470 0x7f5c0006f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.797+0000 7f5c0672b640 1 --2- 172.21.15.146:0/425339660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c000b5420 0x7f5c0015bf30 unknown :-1 s=CLOSED pgs=2602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.797+0000 7f5c0672b640 1 -- 172.21.15.146:0/425339660 >> 172.21.15.146:0/425339660 conn(0x7f5c000b3250 msgr2=0x7f5c000b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:51.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.797+0000 7f5c0672b640 1 -- 172.21.15.146:0/425339660 shutdown_connections 2024-09-17T03:46:51.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.797+0000 7f5c0672b640 1 -- 172.21.15.146:0/425339660 wait complete. 2024-09-17T03:46:51.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.799+0000 7f5c0672b640 1 Processor -- start 2024-09-17T03:46:51.799 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.799+0000 7f5c0672b640 1 -- start start 2024-09-17T03:46:51.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.800+0000 7f5c0672b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c000b5010 0x7f5c00141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.800+0000 7f5c0672b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c000b5420 0x7f5c0013e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.800+0000 7f5c0672b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c0015c470 0x7f5c00158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.800+0000 7f5c0672b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0006fe60 con 0x7f5c000b5420 2024-09-17T03:46:51.802 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.800+0000 7f5c0672b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0006fce0 con 0x7f5c0015c470 2024-09-17T03:46:51.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.800+0000 7f5c0672b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5c00073530 con 0x7f5c000b5010 2024-09-17T03:46:51.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.800+0000 7f5bff7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c000b5420 0x7f5c0013e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bff7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c000b5420 0x7f5c0013e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51768/0 (socket says 172.21.15.146:51768) 2024-09-17T03:46:51.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bff7fe640 1 -- 172.21.15.146:0/2177025934 learned_addr learned my addr 172.21.15.146:0/2177025934 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:51.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5c04cc8640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c0015c470 0x7f5c00158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.803 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bfffff640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c000b5010 0x7f5c00141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bff7fe640 1 -- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c000b5010 msgr2=0x7f5c00141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bff7fe640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c000b5010 0x7f5c00141b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bff7fe640 1 -- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c0015c470 msgr2=0x7f5c00158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bff7fe640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c0015c470 0x7f5c00158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bff7fe640 1 -- 172.21.15.146:0/2177025934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c00142060 con 0x7f5c000b5420 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5c04cc8640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c0015c470 0x7f5c00158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bff7fe640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c000b5420 0x7f5c0013e730 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4034040 tx=0x7f5bf40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bfcff9640 1 -- 172.21.15.146:0/2177025934 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf403e030 con 0x7f5c000b5420 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bfcff9640 1 -- 172.21.15.146:0/2177025934 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bf40047a0 con 0x7f5c000b5420 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5c0672b640 1 -- 172.21.15.146:0/2177025934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0013f450 con 0x7f5c000b5420 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5bfcff9640 1 -- 172.21.15.146:0/2177025934 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4035040 con 0x7f5c000b5420 2024-09-17T03:46:51.804 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.801+0000 7f5c0672b640 1 -- 172.21.15.146:0/2177025934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c0013fa10 con 0x7f5c000b5420 2024-09-17T03:46:51.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.802+0000 7f5c0672b640 1 -- 172.21.15.146:0/2177025934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0015b7c0 con 0x7f5c000b5420 2024-09-17T03:46:51.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.803+0000 7f5bfcff9640 1 -- 172.21.15.146:0/2177025934 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5bf4041030 con 0x7f5c000b5420 2024-09-17T03:46:51.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.804+0000 7f5bfcff9640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bec078b90 0x7f5bec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:51.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.804+0000 7f5bfcff9640 1 -- 172.21.15.146:0/2177025934 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f5bf40bb520 con 0x7f5c000b5420 2024-09-17T03:46:51.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.804+0000 7f5bfffff640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bec078b90 0x7f5bec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:51.806 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.805+0000 7f5bfffff640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bec078b90 0x7f5bec07b0a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0006fd0 tx=0x7f5bf0009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:51.808 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.809+0000 7f5bfcff9640 1 -- 172.21.15.146:0/2177025934 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5c0015b7c0 con 0x7f5c000b5420 2024-09-17T03:46:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.998+0000 7f5c0672b640 1 -- 172.21.15.146:0/2177025934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5c0015bf30 con 0x7f5c000b5420 2024-09-17T03:46:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:51.998+0000 7f5bfcff9640 1 -- 172.21.15.146:0/2177025934 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v199) ==== 80+0+0 (secure 0 0 0) 0x7f5bf4083300 con 0x7f5c000b5420 2024-09-17T03:46:51.998 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 -- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bec078b90 msgr2=0x7f5bec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bec078b90 0x7f5bec07b0a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0006fd0 tx=0x7f5bf0009060 comp rx=0 tx=0).stop 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 -- 172.21.15.146:0/2177025934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c000b5420 msgr2=0x7f5c0013e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c000b5420 0x7f5c0013e730 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4034040 tx=0x7f5bf40039e0 comp rx=0 tx=0).stop 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 -- 172.21.15.146:0/2177025934 shutdown_connections 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5bec078b90 0x7f5bec07b0a0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5c0015c470 0x7f5c00158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c000b5420 0x7f5c0013e730 unknown :-1 s=CLOSED pgs=2603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 --2- 172.21.15.146:0/2177025934 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5c000b5010 0x7f5c00141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 -- 172.21.15.146:0/2177025934 >> 172.21.15.146:0/2177025934 conn(0x7f5c000b3250 msgr2=0x7f5c0006cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 -- 172.21.15.146:0/2177025934 shutdown_connections 2024-09-17T03:46:52.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:52.000+0000 7f5c0672b640 1 -- 172.21.15.146:0/2177025934 wait complete. 2024-09-17T03:46:52.012 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:46:52.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:52.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:46:52.921 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:46:52.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:46:52.921 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:46:52.937 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:46:52.937 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:46:52.938 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:52.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:46:52.954 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:46:52.955 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:46:52.955 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:52.994 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:46:52.994 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:46:52.994 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:46:52.994 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:46:53.009 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:46:53.009 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:53.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.147+0000 7fb72ae5c640 1 -- 172.21.15.146:0/2686088418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7240b6b00 msgr2=0x7fb7240b6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.147+0000 7fb72ae5c640 1 --2- 172.21.15.146:0/2686088418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7240b6b00 0x7fb7240b6f10 secure :-1 s=READY pgs=2604 cs=0 l=1 rev1=1 crypto rx=0x7fb724074440 tx=0x7fb71002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.148+0000 7fb72ae5c640 1 -- 172.21.15.146:0/2686088418 shutdown_connections 2024-09-17T03:46:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.148+0000 7fb72ae5c640 1 --2- 172.21.15.146:0/2686088418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7240b6b00 0x7fb7240b6f10 unknown :-1 s=CLOSED pgs=2604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.148+0000 7fb72ae5c640 1 --2- 172.21.15.146:0/2686088418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7241600b0 0x7fb7240b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.148+0000 7fb72ae5c640 1 -- 172.21.15.146:0/2686088418 >> 172.21.15.146:0/2686088418 conn(0x7fb7240b41b0 msgr2=0x7fb7240b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.148+0000 7fb72ae5c640 1 -- 172.21.15.146:0/2686088418 shutdown_connections 2024-09-17T03:46:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.148+0000 7fb72ae5c640 1 -- 172.21.15.146:0/2686088418 wait complete. 2024-09-17T03:46:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.149+0000 7fb72ae5c640 1 Processor -- start 2024-09-17T03:46:53.149 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.149+0000 7fb72ae5c640 1 -- start start 2024-09-17T03:46:53.152 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb72ae5c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7240b6b00 0x7fb72415b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb72ae5c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7240b7450 0x7fb72409c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb72ae5c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7241600b0 0x7fb7241f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb72ae5c640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb724166ee0 con 0x7fb7240b7450 2024-09-17T03:46:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb72ae5c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb7240b7c10 con 0x7fb7240b6b00 2024-09-17T03:46:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb72ae5c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb724167060 con 0x7fb7241600b0 2024-09-17T03:46:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb723fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7240b7450 0x7fb72409c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb723fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7240b7450 0x7fb72409c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51784/0 (socket says 172.21.15.146:51784) 2024-09-17T03:46:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb723fff640 1 -- 172.21.15.146:0/3100843368 learned_addr learned my addr 172.21.15.146:0/3100843368 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:53.153 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb7293f9640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7241600b0 0x7fb7241f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb728bf8640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7240b6b00 0x7fb72415b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb723fff640 1 -- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7241600b0 msgr2=0x7fb7241f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb723fff640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7241600b0 0x7fb7241f6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb723fff640 1 -- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7240b6b00 msgr2=0x7fb72415b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb723fff640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7240b6b00 0x7fb72415b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb723fff640 1 -- 172.21.15.146:0/3100843368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7241f7b50 con 0x7fb7240b7450 2024-09-17T03:46:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb728bf8640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7240b6b00 0x7fb72415b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb7293f9640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7241600b0 0x7fb7241f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:53.154 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb723fff640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7240b7450 0x7fb72409c5a0 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7fb710034040 tx=0x7fb710003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.151+0000 7fb7217fa640 1 -- 172.21.15.146:0/3100843368 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71003e030 con 0x7fb7240b7450 2024-09-17T03:46:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.152+0000 7fb7217fa640 1 -- 172.21.15.146:0/3100843368 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb710003e00 con 0x7fb7240b7450 2024-09-17T03:46:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.152+0000 7fb72ae5c640 1 -- 172.21.15.146:0/3100843368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb724157910 con 0x7fb7240b7450 2024-09-17T03:46:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.152+0000 7fb7217fa640 1 -- 172.21.15.146:0/3100843368 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710035040 con 0x7fb7240b7450 2024-09-17T03:46:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.152+0000 7fb72ae5c640 1 -- 172.21.15.146:0/3100843368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb724157ed0 con 0x7fb7240b7450 2024-09-17T03:46:53.155 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.153+0000 7fb72ae5c640 1 -- 172.21.15.146:0/3100843368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb724157680 con 0x7fb7240b7450 2024-09-17T03:46:53.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.153+0000 7fb7217fa640 1 -- 172.21.15.146:0/3100843368 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb710041030 con 0x7fb7240b7450 2024-09-17T03:46:53.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.154+0000 7fb7217fa640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb708078bc0 0x7fb70807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.154+0000 7fb7217fa640 1 -- 172.21.15.146:0/3100843368 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7fb7100bb480 con 0x7fb7240b7450 2024-09-17T03:46:53.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.154+0000 7fb728bf8640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb708078bc0 0x7fb70807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.156 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.154+0000 7fb728bf8640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb708078bc0 0x7fb70807b0d0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb718005860 tx=0x7fb718005da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:53.158 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.158+0000 7fb7217fa640 1 -- 172.21.15.146:0/3100843368 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb710083950 con 0x7fb7240b7450 2024-09-17T03:46:53.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.369+0000 7fb72ae5c640 1 -- 172.21.15.146:0/3100843368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7240b6f10 con 0x7fb7240b7450 2024-09-17T03:46:53.369 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.369+0000 7fb7217fa640 1 -- 172.21.15.146:0/3100843368 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 154 v154) ==== 95+0+5241 (secure 0 0 0) 0x7fb710083250 con 0x7fb7240b7450 2024-09-17T03:46:53.369 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:53.370 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":154,"btime":"2024-09-17T03:46:41:868652+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2786459468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2786459468},{"type":"v1","addr":"172.21.15.179:6837","nonce":2786459468}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/35044870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":35044870},{"type":"v1","addr":"172.21.15.146:6835","nonce":35044870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4262340236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4262340236},{"type":"v1","addr":"172.21.15.179:6836","nonce":4262340236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149}],"filesystems":[{"mdsmap":{"epoch":154,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:46:38.209003+0000","modified":"2024-09-17T03:46:41.229411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11496":{"gid":11496,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/172455759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":172455759},{"type":"v1","addr":"172.21.15.146:6833","nonce":172455759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11496,"qdb_cluster":[11496]},"id":15}]} 2024-09-17T03:46:53.370 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 154 2024-09-17T03:46:53.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.371+0000 7fb72ae5c640 1 -- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb708078bc0 msgr2=0x7fb70807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.371+0000 7fb72ae5c640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb708078bc0 0x7fb70807b0d0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb718005860 tx=0x7fb718005da0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.371+0000 7fb72ae5c640 1 -- 172.21.15.146:0/3100843368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7240b7450 msgr2=0x7fb72409c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.371+0000 7fb72ae5c640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7240b7450 0x7fb72409c5a0 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7fb710034040 tx=0x7fb710003910 comp rx=0 tx=0).stop 2024-09-17T03:46:53.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.371+0000 7fb72ae5c640 1 -- 172.21.15.146:0/3100843368 shutdown_connections 2024-09-17T03:46:53.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.371+0000 7fb72ae5c640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb708078bc0 0x7fb70807b0d0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.371+0000 7fb72ae5c640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb7241600b0 0x7fb7241f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.371+0000 7fb72ae5c640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7240b7450 0x7fb72409c5a0 unknown :-1 s=CLOSED pgs=2605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.371+0000 7fb72ae5c640 1 --2- 172.21.15.146:0/3100843368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb7240b6b00 0x7fb72415b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.372 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.371+0000 7fb72ae5c640 1 -- 172.21.15.146:0/3100843368 >> 172.21.15.146:0/3100843368 conn(0x7fb7240b41b0 msgr2=0x7fb7240b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:53.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.372+0000 7fb72ae5c640 1 -- 172.21.15.146:0/3100843368 shutdown_connections 2024-09-17T03:46:53.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.372+0000 7fb72ae5c640 1 -- 172.21.15.146:0/3100843368 wait complete. 2024-09-17T03:46:53.383 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:53.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.496+0000 7f6da49cf640 1 -- 172.21.15.146:0/1392917863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da00d31e0 msgr2=0x7f6da00cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.496+0000 7f6da49cf640 1 --2- 172.21.15.146:0/1392917863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da00d31e0 0x7f6da00cebc0 secure :-1 s=READY pgs=2606 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009910 tx=0x7f6d9002a590 comp rx=0 tx=0).stop 2024-09-17T03:46:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.496+0000 7f6da49cf640 1 -- 172.21.15.146:0/1392917863 shutdown_connections 2024-09-17T03:46:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.496+0000 7f6da49cf640 1 --2- 172.21.15.146:0/1392917863 >> v2:172.21.15.179:3300/0 conn(0x7f6da00d1050 0x7f6da00cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.496+0000 7f6da49cf640 1 --2- 172.21.15.146:0/1392917863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6da015cbe0 0x7f6da00d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.496+0000 7f6da49cf640 1 --2- 172.21.15.146:0/1392917863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da00d31e0 0x7f6da00cebc0 unknown :-1 s=CLOSED pgs=2606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.496+0000 7f6da49cf640 1 -- 172.21.15.146:0/1392917863 >> 172.21.15.146:0/1392917863 conn(0x7f6da00d26c0 msgr2=0x7f6da00d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.496+0000 7f6da49cf640 1 -- 172.21.15.146:0/1392917863 shutdown_connections 2024-09-17T03:46:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.496+0000 7f6da49cf640 1 -- 172.21.15.146:0/1392917863 wait complete. 2024-09-17T03:46:53.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.498+0000 7f6da49cf640 1 Processor -- start 2024-09-17T03:46:53.498 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.498+0000 7f6da49cf640 1 -- start start 2024-09-17T03:46:53.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.499+0000 7f6da49cf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6da00d1050 0x7f6da00ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.499+0000 7f6da49cf640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6da00d31e0 0x7f6da009f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.499+0000 7f6da49cf640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da015cbe0 0x7f6da009da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.499+0000 7f6da49cf640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6da00cd970 con 0x7f6da015cbe0 2024-09-17T03:46:53.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.499+0000 7f6da49cf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6da00cd7f0 con 0x7f6da00d1050 2024-09-17T03:46:53.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.499+0000 7f6da49cf640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6da00cdaf0 con 0x7f6da00d31e0 2024-09-17T03:46:53.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.499+0000 7f6d9ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da015cbe0 0x7f6da009da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.499+0000 7f6d9ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da015cbe0 0x7f6da009da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51806/0 (socket says 172.21.15.146:51806) 2024-09-17T03:46:53.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.499+0000 7f6d9ed9d640 1 -- 172.21.15.146:0/2329714046 learned_addr learned my addr 172.21.15.146:0/2329714046 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.499+0000 7f6d9e59c640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6da00d1050 0x7f6da00ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.499+0000 7f6d95d9b640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6da00d31e0 0x7f6da009f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.500+0000 7f6d9ed9d640 1 -- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6da00d31e0 msgr2=0x7f6da009f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.500+0000 7f6d9ed9d640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6da00d31e0 0x7f6da009f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.500+0000 7f6d9ed9d640 1 -- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6da00d1050 msgr2=0x7f6da00ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.500+0000 7f6d9ed9d640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6da00d1050 0x7f6da00ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.500+0000 7f6d9ed9d640 1 -- 172.21.15.146:0/2329714046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da00ca800 con 0x7f6da015cbe0 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.500+0000 7f6d9ed9d640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da015cbe0 0x7f6da009da50 secure :-1 s=READY pgs=2607 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800d980 tx=0x7f6d9800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.500+0000 7f6d977fe640 1 -- 172.21.15.146:0/2329714046 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98016070 con 0x7f6da015cbe0 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.500+0000 7f6d977fe640 1 -- 172.21.15.146:0/2329714046 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d9800bd60 con 0x7f6da015cbe0 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.500+0000 7f6da49cf640 1 -- 172.21.15.146:0/2329714046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da00a0030 con 0x7f6da015cbe0 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.500+0000 7f6d977fe640 1 -- 172.21.15.146:0/2329714046 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d980106c0 con 0x7f6da015cbe0 2024-09-17T03:46:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.500+0000 7f6da49cf640 1 -- 172.21.15.146:0/2329714046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da00c9ac0 con 0x7f6da015cbe0 2024-09-17T03:46:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.501+0000 7f6da49cf640 1 -- 172.21.15.146:0/2329714046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da00cebc0 con 0x7f6da015cbe0 2024-09-17T03:46:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.502+0000 7f6d977fe640 1 -- 172.21.15.146:0/2329714046 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6d98019070 con 0x7f6da015cbe0 2024-09-17T03:46:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.502+0000 7f6d977fe640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6d80078b90 0x7f6d8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.502+0000 7f6d977fe640 1 -- 172.21.15.146:0/2329714046 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f6d9809b220 con 0x7f6da015cbe0 2024-09-17T03:46:53.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.502+0000 7f6d9e59c640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6d80078b90 0x7f6d8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.503+0000 7f6d9e59c640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6d80078b90 0x7f6d8007b0a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6d90034000 tx=0x7f6d90004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:53.506 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.507+0000 7f6d977fe640 1 -- 172.21.15.146:0/2329714046 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6d980630a0 con 0x7f6da015cbe0 2024-09-17T03:46:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.716+0000 7f6da49cf640 1 -- 172.21.15.146:0/2329714046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6da0071bd0 con 0x7f6da015cbe0 2024-09-17T03:46:53.716 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.716+0000 7f6d977fe640 1 -- 172.21.15.146:0/2329714046 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 154 v154) ==== 95+0+5241 (secure 0 0 0) 0x7f6d98067ad0 con 0x7f6da015cbe0 2024-09-17T03:46:53.717 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:53.717 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":154,"btime":"2024-09-17T03:46:41:868652+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2786459468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2786459468},{"type":"v1","addr":"172.21.15.179:6837","nonce":2786459468}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/35044870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":35044870},{"type":"v1","addr":"172.21.15.146:6835","nonce":35044870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4262340236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4262340236},{"type":"v1","addr":"172.21.15.179:6836","nonce":4262340236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149}],"filesystems":[{"mdsmap":{"epoch":154,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:46:38.209003+0000","modified":"2024-09-17T03:46:41.229411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11496":{"gid":11496,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/172455759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":172455759},{"type":"v1","addr":"172.21.15.146:6833","nonce":172455759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11496,"qdb_cluster":[11496]},"id":15}]} 2024-09-17T03:46:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 154 2024-09-17T03:46:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.718+0000 7f6da49cf640 1 -- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6d80078b90 msgr2=0x7f6d8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.718+0000 7f6da49cf640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6d80078b90 0x7f6d8007b0a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6d90034000 tx=0x7f6d90004730 comp rx=0 tx=0).stop 2024-09-17T03:46:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.718+0000 7f6da49cf640 1 -- 172.21.15.146:0/2329714046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da015cbe0 msgr2=0x7f6da009da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.718+0000 7f6da49cf640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da015cbe0 0x7f6da009da50 secure :-1 s=READY pgs=2607 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800d980 tx=0x7f6d9800de40 comp rx=0 tx=0).stop 2024-09-17T03:46:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.719+0000 7f6da49cf640 1 -- 172.21.15.146:0/2329714046 shutdown_connections 2024-09-17T03:46:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.719+0000 7f6da49cf640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6d80078b90 0x7f6d8007b0a0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.719+0000 7f6da49cf640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6da015cbe0 0x7f6da009da50 unknown :-1 s=CLOSED pgs=2607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.719+0000 7f6da49cf640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6da00d31e0 0x7f6da009f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.719+0000 7f6da49cf640 1 --2- 172.21.15.146:0/2329714046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6da00d1050 0x7f6da00ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.719+0000 7f6da49cf640 1 -- 172.21.15.146:0/2329714046 >> 172.21.15.146:0/2329714046 conn(0x7f6da00d26c0 msgr2=0x7f6da00707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.719+0000 7f6da49cf640 1 -- 172.21.15.146:0/2329714046 shutdown_connections 2024-09-17T03:46:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.719+0000 7f6da49cf640 1 -- 172.21.15.146:0/2329714046 wait complete. 2024-09-17T03:46:53.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:46:53.844 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.844+0000 7fdbf7a94640 1 -- 172.21.15.146:0/3164550109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbf00cfe10 msgr2=0x7fdbf00d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.844+0000 7fdbf7a94640 1 --2- 172.21.15.146:0/3164550109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbf00cfe10 0x7fdbf00d0220 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8005fd0 tx=0x7fdbe802aa10 comp rx=0 tx=0).stop 2024-09-17T03:46:53.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.844+0000 7fdbf7a94640 1 -- 172.21.15.146:0/3164550109 shutdown_connections 2024-09-17T03:46:53.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.844+0000 7fdbf7a94640 1 --2- 172.21.15.146:0/3164550109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbf00cfe10 0x7fdbf00d0220 unknown :-1 s=CLOSED pgs=2609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.844+0000 7fdbf7a94640 1 --2- 172.21.15.146:0/3164550109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf0073cc0 0x7fdbf015c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.844+0000 7fdbf7a94640 1 -- 172.21.15.146:0/3164550109 >> 172.21.15.146:0/3164550109 conn(0x7fdbf00b3880 msgr2=0x7fdbf00d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:53.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.844+0000 7fdbf7a94640 1 -- 172.21.15.146:0/3164550109 shutdown_connections 2024-09-17T03:46:53.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.844+0000 7fdbf7a94640 1 -- 172.21.15.146:0/3164550109 wait complete. 2024-09-17T03:46:53.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.846+0000 7fdbf7a94640 1 Processor -- start 2024-09-17T03:46:53.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.846+0000 7fdbf7a94640 1 -- start start 2024-09-17T03:46:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.847+0000 7fdbf7a94640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf0070fc0 0x7fdbf0154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.847+0000 7fdbf7a94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbf00cfe10 0x7fdbf0148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.847+0000 7fdbf7a94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf00b0000 0x7fdbf014eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.847+0000 7fdbf7a94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf00d0af0 con 0x7fdbf00cfe10 2024-09-17T03:46:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.847+0000 7fdbf7a94640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf00d0970 con 0x7fdbf00b0000 2024-09-17T03:46:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.847+0000 7fdbf7a94640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf00d0c70 con 0x7fdbf0070fc0 2024-09-17T03:46:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.847+0000 7fdbf502f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbf00cfe10 0x7fdbf0148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.847+0000 7fdbf502f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbf00cfe10 0x7fdbf0148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51822/0 (socket says 172.21.15.146:51822) 2024-09-17T03:46:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.847+0000 7fdbf502f640 1 -- 172.21.15.146:0/910608804 learned_addr learned my addr 172.21.15.146:0/910608804 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbf5830640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf0070fc0 0x7fdbf0154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbf6031640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf00b0000 0x7fdbf014eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbf502f640 1 -- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf0070fc0 msgr2=0x7fdbf0154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbf502f640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf0070fc0 0x7fdbf0154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbf502f640 1 -- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf00b0000 msgr2=0x7fdbf014eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbf502f640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf00b0000 0x7fdbf014eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbf502f640 1 -- 172.21.15.146:0/910608804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf01f7b20 con 0x7fdbf00cfe10 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbf502f640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbf00cfe10 0x7fdbf0148ba0 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000c9a0 tx=0x7fdbe000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbe67fc640 1 -- 172.21.15.146:0/910608804 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0007bb0 con 0x7fdbf00cfe10 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbe67fc640 1 -- 172.21.15.146:0/910608804 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbe0007e40 con 0x7fdbf00cfe10 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbe67fc640 1 -- 172.21.15.146:0/910608804 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0005280 con 0x7fdbf00cfe10 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbf7a94640 1 -- 172.21.15.146:0/910608804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf00ab620 con 0x7fdbf00cfe10 2024-09-17T03:46:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.848+0000 7fdbf7a94640 1 -- 172.21.15.146:0/910608804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf01f7840 con 0x7fdbf00cfe10 2024-09-17T03:46:53.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.850+0000 7fdbf7a94640 1 -- 172.21.15.146:0/910608804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbf00b0490 con 0x7fdbf00cfe10 2024-09-17T03:46:53.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.850+0000 7fdbe67fc640 1 -- 172.21.15.146:0/910608804 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbe0005420 con 0x7fdbf00cfe10 2024-09-17T03:46:53.851 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.851+0000 7fdbe67fc640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbd4078bc0 0x7fdbd407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.851+0000 7fdbe67fc640 1 -- 172.21.15.146:0/910608804 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7fdbe009b020 con 0x7fdbf00cfe10 2024-09-17T03:46:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.851+0000 7fdbf5830640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbd4078bc0 0x7fdbd407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.851+0000 7fdbf5830640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbd4078bc0 0x7fdbd407b0d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000fd0 tx=0x7fdbec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:53.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:53.856+0000 7fdbe67fc640 1 -- 172.21.15.146:0/910608804 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdbe0014030 con 0x7fdbf00cfe10 2024-09-17T03:46:54.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.032+0000 7fdbf7a94640 1 -- 172.21.15.146:0/910608804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdbf015c9a0 con 0x7fdbf00cfe10 2024-09-17T03:46:54.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.033+0000 7fdbe67fc640 1 -- 172.21.15.146:0/910608804 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) ==== 74+0+16727 (secure 0 0 0) 0x7fdbe0062ff0 con 0x7fdbf00cfe10 2024-09-17T03:46:54.033 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:54.034 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":199,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:46:39.856551+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:46:35.852577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_data","create_time":"2024-09-17T03:46:37.175209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:46:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.035+0000 7fdbf7a94640 1 -- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbd4078bc0 msgr2=0x7fdbd407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.035+0000 7fdbf7a94640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbd4078bc0 0x7fdbd407b0d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000fd0 tx=0x7fdbec009040 comp rx=0 tx=0).stop 2024-09-17T03:46:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.035+0000 7fdbf7a94640 1 -- 172.21.15.146:0/910608804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbf00cfe10 msgr2=0x7fdbf0148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.035+0000 7fdbf7a94640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbf00cfe10 0x7fdbf0148ba0 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000c9a0 tx=0x7fdbe000ce60 comp rx=0 tx=0).stop 2024-09-17T03:46:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.035+0000 7fdbf7a94640 1 -- 172.21.15.146:0/910608804 shutdown_connections 2024-09-17T03:46:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.035+0000 7fdbf7a94640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbd4078bc0 0x7fdbd407b0d0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.035+0000 7fdbf7a94640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbf00b0000 0x7fdbf014eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.036+0000 7fdbf7a94640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbf00cfe10 0x7fdbf0148ba0 unknown :-1 s=CLOSED pgs=2610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.036+0000 7fdbf7a94640 1 --2- 172.21.15.146:0/910608804 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbf0070fc0 0x7fdbf0154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.036+0000 7fdbf7a94640 1 -- 172.21.15.146:0/910608804 >> 172.21.15.146:0/910608804 conn(0x7fdbf00b3880 msgr2=0x7fdbf006cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:54.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.036+0000 7fdbf7a94640 1 -- 172.21.15.146:0/910608804 shutdown_connections 2024-09-17T03:46:54.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.036+0000 7fdbf7a94640 1 -- 172.21.15.146:0/910608804 wait complete. 2024-09-17T03:46:54.047 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:46:54.048 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:54.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.161+0000 7ff21484d640 1 -- 172.21.15.146:0/3794891394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2100cfe10 msgr2=0x7ff2100d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.161 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.161+0000 7ff21484d640 1 --2- 172.21.15.146:0/3794891394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2100cfe10 0x7ff2100d0220 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff208005fd0 tx=0x7ff20802aa10 comp rx=0 tx=0).stop 2024-09-17T03:46:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.161+0000 7ff21484d640 1 -- 172.21.15.146:0/3794891394 shutdown_connections 2024-09-17T03:46:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.161+0000 7ff21484d640 1 --2- 172.21.15.146:0/3794891394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff2100cfe10 0x7ff2100d0220 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.161+0000 7ff21484d640 1 --2- 172.21.15.146:0/3794891394 >> v2:172.21.15.179:3300/0 conn(0x7ff210073cc0 0x7ff21015c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.161+0000 7ff21484d640 1 -- 172.21.15.146:0/3794891394 >> 172.21.15.146:0/3794891394 conn(0x7ff2100b3880 msgr2=0x7ff2100d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.161+0000 7ff21484d640 1 -- 172.21.15.146:0/3794891394 shutdown_connections 2024-09-17T03:46:54.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.161+0000 7ff21484d640 1 -- 172.21.15.146:0/3794891394 wait complete. 2024-09-17T03:46:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.163+0000 7ff21484d640 1 Processor -- start 2024-09-17T03:46:54.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.163+0000 7ff21484d640 1 -- start start 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.164+0000 7ff21484d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff210070fc0 0x7ff2101f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.164+0000 7ff21484d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2100cfe10 0x7ff2100ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.164+0000 7ff21484d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2101f78d0 0x7ff210147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.164+0000 7ff21484d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff2100d0af0 con 0x7ff2101f78d0 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.164+0000 7ff21484d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff2100d0970 con 0x7ff2100cfe10 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.164+0000 7ff21484d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff2100d0c70 con 0x7ff210070fc0 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.164+0000 7ff20ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2101f78d0 0x7ff210147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff20ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2101f78d0 0x7ff210147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51828/0 (socket says 172.21.15.146:51828) 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff20ed9d640 1 -- 172.21.15.146:0/4133684511 learned_addr learned my addr 172.21.15.146:0/4133684511 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff20e59c640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff210070fc0 0x7ff2101f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff205d9b640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2100cfe10 0x7ff2100ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff20ed9d640 1 -- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff210070fc0 msgr2=0x7ff2101f7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff20ed9d640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff210070fc0 0x7ff2101f7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff20ed9d640 1 -- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2100cfe10 msgr2=0x7ff2100ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff20ed9d640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2100cfe10 0x7ff2100ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff20ed9d640 1 -- 172.21.15.146:0/4133684511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2100abde0 con 0x7ff2101f78d0 2024-09-17T03:46:54.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff20ed9d640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2101f78d0 0x7ff210147c40 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 crypto rx=0x7ff208006010 tx=0x7ff208003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:54.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff2077fe640 1 -- 172.21.15.146:0/4133684511 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208046070 con 0x7ff2101f78d0 2024-09-17T03:46:54.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff2077fe640 1 -- 172.21.15.146:0/4133684511 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff208004340 con 0x7ff2101f78d0 2024-09-17T03:46:54.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff21484d640 1 -- 172.21.15.146:0/4133684511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2101f4e20 con 0x7ff2101f78d0 2024-09-17T03:46:54.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff2077fe640 1 -- 172.21.15.146:0/4133684511 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208033070 con 0x7ff2101f78d0 2024-09-17T03:46:54.167 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.165+0000 7ff21484d640 1 -- 172.21.15.146:0/4133684511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2101f53e0 con 0x7ff2101f78d0 2024-09-17T03:46:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.166+0000 7ff21484d640 1 -- 172.21.15.146:0/4133684511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff21015ccd0 con 0x7ff2101f78d0 2024-09-17T03:46:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.167+0000 7ff2077fe640 1 -- 172.21.15.146:0/4133684511 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff208049070 con 0x7ff2101f78d0 2024-09-17T03:46:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.168+0000 7ff2077fe640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1f0078b90 0x7ff1f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.168+0000 7ff2077fe640 1 -- 172.21.15.146:0/4133684511 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7ff2080bbd20 con 0x7ff2101f78d0 2024-09-17T03:46:54.168 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.168+0000 7ff20e59c640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1f0078b90 0x7ff1f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.169 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.168+0000 7ff20e59c640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1f0078b90 0x7ff1f007b0a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7ff2000017a0 tx=0x7ff200009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:54.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.172+0000 7ff2077fe640 1 -- 172.21.15.146:0/4133684511 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff21015ccd0 con 0x7ff2101f78d0 2024-09-17T03:46:54.382 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.382+0000 7ff21484d640 1 -- 172.21.15.146:0/4133684511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2100abb70 con 0x7ff2101f78d0 2024-09-17T03:46:54.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.383+0000 7ff2077fe640 1 -- 172.21.15.146:0/4133684511 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 154 v154) ==== 95+0+5241 (secure 0 0 0) 0x7ff20803e070 con 0x7ff2101f78d0 2024-09-17T03:46:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:54.383 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":154,"btime":"2024-09-17T03:46:41:868652+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2786459468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2786459468},{"type":"v1","addr":"172.21.15.179:6837","nonce":2786459468}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/35044870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":35044870},{"type":"v1","addr":"172.21.15.146:6835","nonce":35044870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4262340236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4262340236},{"type":"v1","addr":"172.21.15.179:6836","nonce":4262340236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149}],"filesystems":[{"mdsmap":{"epoch":154,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:46:38.209003+0000","modified":"2024-09-17T03:46:41.229411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11496":{"gid":11496,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/172455759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":172455759},{"type":"v1","addr":"172.21.15.146:6833","nonce":172455759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11496,"qdb_cluster":[11496]},"id":15}]} 2024-09-17T03:46:54.383 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 154 2024-09-17T03:46:54.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 -- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1f0078b90 msgr2=0x7ff1f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1f0078b90 0x7ff1f007b0a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7ff2000017a0 tx=0x7ff200009040 comp rx=0 tx=0).stop 2024-09-17T03:46:54.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 -- 172.21.15.146:0/4133684511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2101f78d0 msgr2=0x7ff210147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2101f78d0 0x7ff210147c40 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 crypto rx=0x7ff208006010 tx=0x7ff208003f10 comp rx=0 tx=0).stop 2024-09-17T03:46:54.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 -- 172.21.15.146:0/4133684511 shutdown_connections 2024-09-17T03:46:54.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff1f0078b90 0x7ff1f007b0a0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2101f78d0 0x7ff210147c40 unknown :-1 s=CLOSED pgs=2611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff2100cfe10 0x7ff2100ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 --2- 172.21.15.146:0/4133684511 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff210070fc0 0x7ff2101f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 -- 172.21.15.146:0/4133684511 >> 172.21.15.146:0/4133684511 conn(0x7ff2100b3880 msgr2=0x7ff2100b4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:54.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 -- 172.21.15.146:0/4133684511 shutdown_connections 2024-09-17T03:46:54.386 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.385+0000 7ff21484d640 1 -- 172.21.15.146:0/4133684511 wait complete. 2024-09-17T03:46:54.397 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:46:54.510 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.509+0000 7f62fcf9b640 1 -- 172.21.15.146:0/1612595443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f80b51b0 msgr2=0x7f62f806e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.509+0000 7f62fcf9b640 1 --2- 172.21.15.146:0/1612595443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f80b51b0 0x7f62f806e9e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009830 tx=0x7f62e002a480 comp rx=0 tx=0).stop 2024-09-17T03:46:54.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.509+0000 7f62fcf9b640 1 -- 172.21.15.146:0/1612595443 shutdown_connections 2024-09-17T03:46:54.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.509+0000 7f62fcf9b640 1 --2- 172.21.15.146:0/1612595443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f80b51b0 0x7f62f806e9e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.509+0000 7f62fcf9b640 1 --2- 172.21.15.146:0/1612595443 >> v2:172.21.15.179:3300/0 conn(0x7f62f8152b40 0x7f62f80ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.509+0000 7f62fcf9b640 1 -- 172.21.15.146:0/1612595443 >> 172.21.15.146:0/1612595443 conn(0x7f62f80b2790 msgr2=0x7f62f80d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:54.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.510+0000 7f62fcf9b640 1 -- 172.21.15.146:0/1612595443 shutdown_connections 2024-09-17T03:46:54.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.510+0000 7f62fcf9b640 1 -- 172.21.15.146:0/1612595443 wait complete. 2024-09-17T03:46:54.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.512+0000 7f62fcf9b640 1 Processor -- start 2024-09-17T03:46:54.512 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.512+0000 7f62fcf9b640 1 -- start start 2024-09-17T03:46:54.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.513+0000 7f62fcf9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f806ef20 0x7f62f80aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.513+0000 7f62fcf9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f80b51b0 0x7f62f80aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.513+0000 7f62fcf9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f8152b40 0x7f62f81f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.513+0000 7f62fcf9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f62f815fe50 con 0x7f62f8152b40 2024-09-17T03:46:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.513+0000 7f62fcf9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f62f815fcd0 con 0x7f62f806ef20 2024-09-17T03:46:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.513+0000 7f62fcf9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f62f815ffd0 con 0x7f62f80b51b0 2024-09-17T03:46:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.513+0000 7f62f6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f8152b40 0x7f62f81f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.513+0000 7f62f6d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f8152b40 0x7f62f81f70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51836/0 (socket says 172.21.15.146:51836) 2024-09-17T03:46:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.513+0000 7f62f6d9d640 1 -- 172.21.15.146:0/4223238761 learned_addr learned my addr 172.21.15.146:0/4223238761 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.513+0000 7f62edd9b640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f80b51b0 0x7f62f80aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.513+0000 7f62f659c640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f806ef20 0x7f62f80aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62f659c640 1 -- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f80b51b0 msgr2=0x7f62f80aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62f659c640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f80b51b0 0x7f62f80aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62f659c640 1 -- 172.21.15.146:0/4223238761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f8152b40 msgr2=0x7f62f81f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62f659c640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f8152b40 0x7f62f81f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62f659c640 1 -- 172.21.15.146:0/4223238761 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f81f6e70 con 0x7f62f806ef20 2024-09-17T03:46:54.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62f6d9d640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f8152b40 0x7f62f81f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:46:54.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62f659c640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f806ef20 0x7f62f80aa4a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f62e800e9c0 tx=0x7f62e800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:54.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62ef7fe640 1 -- 172.21.15.146:0/4223238761 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e800ccc0 con 0x7f62f806ef20 2024-09-17T03:46:54.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62ef7fe640 1 -- 172.21.15.146:0/4223238761 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62e800ce60 con 0x7f62f806ef20 2024-09-17T03:46:54.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62fcf9b640 1 -- 172.21.15.146:0/4223238761 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f81f4d50 con 0x7f62f806ef20 2024-09-17T03:46:54.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62ef7fe640 1 -- 172.21.15.146:0/4223238761 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8004260 con 0x7f62f806ef20 2024-09-17T03:46:54.516 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.514+0000 7f62fcf9b640 1 -- 172.21.15.146:0/4223238761 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f81f5310 con 0x7f62f806ef20 2024-09-17T03:46:54.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.515+0000 7f62fcf9b640 1 -- 172.21.15.146:0/4223238761 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f80d0d00 con 0x7f62f806ef20 2024-09-17T03:46:54.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.516+0000 7f62ef7fe640 1 -- 172.21.15.146:0/4223238761 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f62e80035f0 con 0x7f62f806ef20 2024-09-17T03:46:54.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.516+0000 7f62ef7fe640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62d8078b90 0x7f62d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.517+0000 7f62ef7fe640 1 -- 172.21.15.146:0/4223238761 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f62e809b6e0 con 0x7f62f806ef20 2024-09-17T03:46:54.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.517+0000 7f62edd9b640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62d8078b90 0x7f62d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.517+0000 7f62edd9b640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62d8078b90 0x7f62d807b0a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f62e0034000 tx=0x7f62e0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:54.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.521+0000 7f62ef7fe640 1 -- 172.21.15.146:0/4223238761 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f62f80d0d00 con 0x7f62f806ef20 2024-09-17T03:46:54.734 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.734+0000 7f62fcf9b640 1 -- 172.21.15.146:0/4223238761 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62f806e9e0 con 0x7f62f806ef20 2024-09-17T03:46:54.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.735+0000 7f62ef7fe640 1 -- 172.21.15.146:0/4223238761 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 154 v154) ==== 95+0+5241 (secure 0 0 0) 0x7f62e8063560 con 0x7f62f806ef20 2024-09-17T03:46:54.735 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:54.735 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":154,"btime":"2024-09-17T03:46:41:868652+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2786459468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2786459468},{"type":"v1","addr":"172.21.15.179:6837","nonce":2786459468}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/35044870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":35044870},{"type":"v1","addr":"172.21.15.146:6835","nonce":35044870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4262340236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4262340236},{"type":"v1","addr":"172.21.15.179:6836","nonce":4262340236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149}],"filesystems":[{"mdsmap":{"epoch":154,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:46:38.209003+0000","modified":"2024-09-17T03:46:41.229411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11496},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11496":{"gid":11496,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/172455759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":172455759},{"type":"v1","addr":"172.21.15.146:6833","nonce":172455759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11496,"qdb_cluster":[11496]},"id":15}]} 2024-09-17T03:46:54.735 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 154 2024-09-17T03:46:54.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 -- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62d8078b90 msgr2=0x7f62d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62d8078b90 0x7f62d807b0a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f62e0034000 tx=0x7f62e0004730 comp rx=0 tx=0).stop 2024-09-17T03:46:54.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 -- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f806ef20 msgr2=0x7f62f80aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f806ef20 0x7f62f80aa4a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f62e800e9c0 tx=0x7f62e800ee80 comp rx=0 tx=0).stop 2024-09-17T03:46:54.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 -- 172.21.15.146:0/4223238761 shutdown_connections 2024-09-17T03:46:54.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f62d8078b90 0x7f62d807b0a0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62f8152b40 0x7f62f81f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f62f80b51b0 0x7f62f80aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 --2- 172.21.15.146:0/4223238761 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f62f806ef20 0x7f62f80aa4a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 -- 172.21.15.146:0/4223238761 >> 172.21.15.146:0/4223238761 conn(0x7f62f80b2790 msgr2=0x7f62f815bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:54.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 -- 172.21.15.146:0/4223238761 shutdown_connections 2024-09-17T03:46:54.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.737+0000 7f62fcf9b640 1 -- 172.21.15.146:0/4223238761 wait complete. 2024-09-17T03:46:54.748 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:46:54.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.860+0000 7f9562121640 1 -- 172.21.15.146:0/3370719425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f955c0cebc0 msgr2=0x7f955c0d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.860+0000 7f9562121640 1 --2- 172.21.15.146:0/3370719425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f955c0cebc0 0x7f955c0d0b10 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f955c1607d0 tx=0x7f955002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.860+0000 7f9562121640 1 -- 172.21.15.146:0/3370719425 shutdown_connections 2024-09-17T03:46:54.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.860+0000 7f9562121640 1 --2- 172.21.15.146:0/3370719425 >> v2:172.21.15.179:3300/0 conn(0x7f955c0d1050 0x7f955c0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.860+0000 7f9562121640 1 --2- 172.21.15.146:0/3370719425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f955c0cebc0 0x7f955c0d0b10 unknown :-1 s=CLOSED pgs=2613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.860+0000 7f9562121640 1 -- 172.21.15.146:0/3370719425 >> 172.21.15.146:0/3370719425 conn(0x7f955c0d26c0 msgr2=0x7f955c0d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:54.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.861+0000 7f9562121640 1 -- 172.21.15.146:0/3370719425 shutdown_connections 2024-09-17T03:46:54.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.861+0000 7f9562121640 1 -- 172.21.15.146:0/3370719425 wait complete. 2024-09-17T03:46:54.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.862+0000 7f9562121640 1 Processor -- start 2024-09-17T03:46:54.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.863+0000 7f9562121640 1 -- start start 2024-09-17T03:46:54.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f9562121640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f955c0cebc0 0x7f955c1f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f9562121640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f955c0d1050 0x7f955c09f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f9562121640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f955c0d31e0 0x7f955c1f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f9562121640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f955c0b6450 con 0x7f955c0d1050 2024-09-17T03:46:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f9562121640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f955c0b62d0 con 0x7f955c0cebc0 2024-09-17T03:46:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f9562121640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f955c0b65d0 con 0x7f955c0d31e0 2024-09-17T03:46:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f955affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f955c0d1050 0x7f955c09f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f955affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f955c0d1050 0x7f955c09f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51856/0 (socket says 172.21.15.146:51856) 2024-09-17T03:46:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f955affd640 1 -- 172.21.15.146:0/3048170205 learned_addr learned my addr 172.21.15.146:0/3048170205 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f955b7fe640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f955c0cebc0 0x7f955c1f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.866 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f955bfff640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f955c0d31e0 0x7f955c1f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f955affd640 1 -- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f955c0d31e0 msgr2=0x7f955c1f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f955affd640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f955c0d31e0 0x7f955c1f3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f955affd640 1 -- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f955c0cebc0 msgr2=0x7f955c1f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:54.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f955affd640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f955c0cebc0 0x7f955c1f6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:54.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.864+0000 7f955affd640 1 -- 172.21.15.146:0/3048170205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955c148ae0 con 0x7f955c0d1050 2024-09-17T03:46:54.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.865+0000 7f955affd640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f955c0d1050 0x7f955c09f2d0 secure :-1 s=READY pgs=2614 cs=0 l=1 rev1=1 crypto rx=0x7f9550034040 tx=0x7f95500039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:54.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.865+0000 7f9543fff640 1 -- 172.21.15.146:0/3048170205 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955003e030 con 0x7f955c0d1050 2024-09-17T03:46:54.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.865+0000 7f9543fff640 1 -- 172.21.15.146:0/3048170205 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95500047a0 con 0x7f955c0d1050 2024-09-17T03:46:54.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.865+0000 7f9543fff640 1 -- 172.21.15.146:0/3048170205 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550035040 con 0x7f955c0d1050 2024-09-17T03:46:54.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.865+0000 7f9562121640 1 -- 172.21.15.146:0/3048170205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f955c1f79b0 con 0x7f955c0d1050 2024-09-17T03:46:54.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.865+0000 7f9562121640 1 -- 172.21.15.146:0/3048170205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f955c0ca960 con 0x7f955c0d1050 2024-09-17T03:46:54.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.866+0000 7f9562121640 1 -- 172.21.15.146:0/3048170205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f955c0b6b60 con 0x7f955c0d1050 2024-09-17T03:46:54.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.867+0000 7f9543fff640 1 -- 172.21.15.146:0/3048170205 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9550041030 con 0x7f955c0d1050 2024-09-17T03:46:54.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.867+0000 7f9543fff640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9548078bc0 0x7f954807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:54.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.867+0000 7f9543fff640 1 -- 172.21.15.146:0/3048170205 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f95500bb470 con 0x7f955c0d1050 2024-09-17T03:46:54.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.867+0000 7f955b7fe640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9548078bc0 0x7f954807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:54.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.868+0000 7f955b7fe640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9548078bc0 0x7f954807b0d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f954c000fd0 tx=0x7f954c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:54.872 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:54.872+0000 7f9543fff640 1 -- 172.21.15.146:0/3048170205 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9550083270 con 0x7f955c0d1050 2024-09-17T03:46:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.049+0000 7f9562121640 1 -- 172.21.15.146:0/3048170205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f955c0c8fc0 con 0x7f955c0d1050 2024-09-17T03:46:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.050+0000 7f9543fff640 1 -- 172.21.15.146:0/3048170205 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) ==== 74+0+16727 (secure 0 0 0) 0x7f9550087ca0 con 0x7f955c0d1050 2024-09-17T03:46:55.050 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:55.050 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":199,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:46:39.856551+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:46:35.852577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_data","create_time":"2024-09-17T03:46:37.175209+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:46:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 -- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9548078bc0 msgr2=0x7f954807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9548078bc0 0x7f954807b0d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f954c000fd0 tx=0x7f954c009040 comp rx=0 tx=0).stop 2024-09-17T03:46:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 -- 172.21.15.146:0/3048170205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f955c0d1050 msgr2=0x7f955c09f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f955c0d1050 0x7f955c09f2d0 secure :-1 s=READY pgs=2614 cs=0 l=1 rev1=1 crypto rx=0x7f9550034040 tx=0x7f95500039e0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 -- 172.21.15.146:0/3048170205 shutdown_connections 2024-09-17T03:46:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9548078bc0 0x7f954807b0d0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f955c0d31e0 0x7f955c1f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f955c0d1050 0x7f955c09f2d0 unknown :-1 s=CLOSED pgs=2614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 --2- 172.21.15.146:0/3048170205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f955c0cebc0 0x7f955c1f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 -- 172.21.15.146:0/3048170205 >> 172.21.15.146:0/3048170205 conn(0x7f955c0d26c0 msgr2=0x7f955c15cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 -- 172.21.15.146:0/3048170205 shutdown_connections 2024-09-17T03:46:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.052+0000 7f9562121640 1 -- 172.21.15.146:0/3048170205 wait complete. 2024-09-17T03:46:55.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:46:55.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.178+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3430583829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7d4152b40 msgr2=0x7fd7d40ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.178+0000 7fd7d8a9b640 1 --2- 172.21.15.146:0/3430583829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7d4152b40 0x7fd7d40ce3d0 secure :-1 s=READY pgs=2616 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4005fd0 tx=0x7fd7c402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.178+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3430583829 shutdown_connections 2024-09-17T03:46:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.178+0000 7fd7d8a9b640 1 --2- 172.21.15.146:0/3430583829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7d4152b40 0x7fd7d40ce3d0 unknown :-1 s=CLOSED pgs=2616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.178+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3430583829 >> 172.21.15.146:0/3430583829 conn(0x7fd7d40b2790 msgr2=0x7fd7d40d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.178+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3430583829 shutdown_connections 2024-09-17T03:46:55.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.178+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3430583829 wait complete. 2024-09-17T03:46:55.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.180+0000 7fd7d8a9b640 1 Processor -- start 2024-09-17T03:46:55.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.180+0000 7fd7d8a9b640 1 -- start start 2024-09-17T03:46:55.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.181+0000 7fd7d8a9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7d406f0f0 0x7fd7d4136700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.181+0000 7fd7d8a9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d40b51b0 0x7fd7d4136c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.181+0000 7fd7d8a9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d4152b40 0x7fd7d40ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.181+0000 7fd7d8a9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d415cab0 con 0x7fd7d406f0f0 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.181+0000 7fd7d8a9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d415c930 con 0x7fd7d4152b40 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.181+0000 7fd7d8a9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d415cc30 con 0x7fd7d40b51b0 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.181+0000 7fd7d259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7d406f0f0 0x7fd7d4136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.181+0000 7fd7d259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7d406f0f0 0x7fd7d4136700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51876/0 (socket says 172.21.15.146:51876) 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7d259c640 1 -- 172.21.15.146:0/3019779663 learned_addr learned my addr 172.21.15.146:0/3019779663 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7d1d9b640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d40b51b0 0x7fd7d4136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7d2d9d640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d4152b40 0x7fd7d40ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7d259c640 1 -- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d40b51b0 msgr2=0x7fd7d4136c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:55.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7d259c640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d40b51b0 0x7fd7d4136c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7d259c640 1 -- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d4152b40 msgr2=0x7fd7d40ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:55.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7d259c640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d4152b40 0x7fd7d40ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7d259c640 1 -- 172.21.15.146:0/3019779663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d4137480 con 0x7fd7d406f0f0 2024-09-17T03:46:55.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7d259c640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7d406f0f0 0x7fd7d4136700 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4034040 tx=0x7fd7c40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:55.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7c2ffd640 1 -- 172.21.15.146:0/3019779663 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c403e030 con 0x7fd7d406f0f0 2024-09-17T03:46:55.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3019779663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d414d380 con 0x7fd7d406f0f0 2024-09-17T03:46:55.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7c2ffd640 1 -- 172.21.15.146:0/3019779663 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7c40047a0 con 0x7fd7d406f0f0 2024-09-17T03:46:55.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7c2ffd640 1 -- 172.21.15.146:0/3019779663 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4035040 con 0x7fd7d406f0f0 2024-09-17T03:46:55.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.182+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3019779663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d414d940 con 0x7fd7d406f0f0 2024-09-17T03:46:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.183+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3019779663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d40ce3d0 con 0x7fd7d406f0f0 2024-09-17T03:46:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.184+0000 7fd7c2ffd640 1 -- 172.21.15.146:0/3019779663 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7c4041030 con 0x7fd7d406f0f0 2024-09-17T03:46:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.184+0000 7fd7c2ffd640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd7b4078bc0 0x7fd7b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.185+0000 7fd7c2ffd640 1 -- 172.21.15.146:0/3019779663 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7fd7c40bb5b0 con 0x7fd7d406f0f0 2024-09-17T03:46:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.185+0000 7fd7d1d9b640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd7b4078bc0 0x7fd7b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:55.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.185+0000 7fd7d1d9b640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd7b4078bc0 0x7fd7b407b0d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4072d50 tx=0x7fd7c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:55.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.189+0000 7fd7c2ffd640 1 -- 172.21.15.146:0/3019779663 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7c4083a00 con 0x7fd7d406f0f0 2024-09-17T03:46:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.398+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3019779663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd7d40cf220 con 0x7fd7d406f0f0 2024-09-17T03:46:55.398 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:46:55.398+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:46:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.402+0000 7fd7c2ffd640 1 -- 172.21.15.146:0/3019779663 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v155) ==== 161+0+0 (secure 0 0 0) 0x7fd7c4083300 con 0x7fd7d406f0f0 2024-09-17T03:46:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:46:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.405+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd7b4078bc0 msgr2=0x7fd7b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.405+0000 7fd7d8a9b640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd7b4078bc0 0x7fd7b407b0d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4072d50 tx=0x7fd7c8009040 comp rx=0 tx=0).stop 2024-09-17T03:46:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.405+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3019779663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7d406f0f0 msgr2=0x7fd7d4136700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.405+0000 7fd7d8a9b640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7d406f0f0 0x7fd7d4136700 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4034040 tx=0x7fd7c40039e0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.405+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3019779663 shutdown_connections 2024-09-17T03:46:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.405+0000 7fd7d8a9b640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd7b4078bc0 0x7fd7b407b0d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.405+0000 7fd7d8a9b640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd7d4152b40 0x7fd7d40ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.405+0000 7fd7d8a9b640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd7d40b51b0 0x7fd7d4136c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.405+0000 7fd7d8a9b640 1 --2- 172.21.15.146:0/3019779663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7d406f0f0 0x7fd7d4136700 unknown :-1 s=CLOSED pgs=2617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.405+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3019779663 >> 172.21.15.146:0/3019779663 conn(0x7fd7d40b2790 msgr2=0x7fd7d40cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.406+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3019779663 shutdown_connections 2024-09-17T03:46:55.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.406+0000 7fd7d8a9b640 1 -- 172.21.15.146:0/3019779663 wait complete. 2024-09-17T03:46:55.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:46:55.469 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:46:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.535+0000 7ff117e9b640 1 -- 172.21.15.146:0/3926262385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100735b0 msgr2=0x7ff1100739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.535+0000 7ff117e9b640 1 --2- 172.21.15.146:0/3926262385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100735b0 0x7ff1100739c0 secure :-1 s=READY pgs=2621 cs=0 l=1 rev1=1 crypto rx=0x7ff100005fd0 tx=0x7ff10002a540 comp rx=0 tx=0).stop 2024-09-17T03:46:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.535+0000 7ff117e9b640 1 -- 172.21.15.146:0/3926262385 shutdown_connections 2024-09-17T03:46:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.535+0000 7ff117e9b640 1 --2- 172.21.15.146:0/3926262385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100735b0 0x7ff1100739c0 unknown :-1 s=CLOSED pgs=2621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.535+0000 7ff117e9b640 1 --2- 172.21.15.146:0/3926262385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff110070fc0 0x7ff11015c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.535+0000 7ff117e9b640 1 -- 172.21.15.146:0/3926262385 >> 172.21.15.146:0/3926262385 conn(0x7ff1100b3880 msgr2=0x7ff1100d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.535+0000 7ff117e9b640 1 -- 172.21.15.146:0/3926262385 shutdown_connections 2024-09-17T03:46:55.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.535+0000 7ff117e9b640 1 -- 172.21.15.146:0/3926262385 wait complete. 2024-09-17T03:46:55.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.537+0000 7ff117e9b640 1 Processor -- start 2024-09-17T03:46:55.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.537+0000 7ff117e9b640 1 -- start start 2024-09-17T03:46:55.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.538+0000 7ff117e9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff110070fc0 0x7ff110159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:55.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.538+0000 7ff117e9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100735b0 0x7ff11013ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:55.539 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.538+0000 7ff117e9b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff11015f540 0x7ff1101f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.538+0000 7ff117e9b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff1100d0fa0 con 0x7ff1100735b0 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.538+0000 7ff117e9b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff1100d0e20 con 0x7ff11015f540 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.538+0000 7ff117e9b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff1100d1120 con 0x7ff110070fc0 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.538+0000 7ff115436640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100735b0 0x7ff11013ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.538+0000 7ff115436640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100735b0 0x7ff11013ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51910/0 (socket says 172.21.15.146:51910) 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.538+0000 7ff115436640 1 -- 172.21.15.146:0/3997949012 learned_addr learned my addr 172.21.15.146:0/3997949012 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.538+0000 7ff115c37640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff110070fc0 0x7ff110159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff116438640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff11015f540 0x7ff1101f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff115436640 1 -- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff110070fc0 msgr2=0x7ff110159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff115436640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff110070fc0 0x7ff110159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff115436640 1 -- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff11015f540 msgr2=0x7ff1101f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:55.540 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff115436640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff11015f540 0x7ff1101f7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:55.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff115436640 1 -- 172.21.15.146:0/3997949012 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff110151a00 con 0x7ff1100735b0 2024-09-17T03:46:55.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff116438640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff11015f540 0x7ff1101f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:55.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff115436640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100735b0 0x7ff11013ff60 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7ff100006010 tx=0x7ff1000039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:55.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff1067fc640 1 -- 172.21.15.146:0/3997949012 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10003e030 con 0x7ff1100735b0 2024-09-17T03:46:55.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff1067fc640 1 -- 172.21.15.146:0/3997949012 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1000047a0 con 0x7ff1100735b0 2024-09-17T03:46:55.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff117e9b640 1 -- 172.21.15.146:0/3997949012 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1101f6f20 con 0x7ff1100735b0 2024-09-17T03:46:55.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff1067fc640 1 -- 172.21.15.146:0/3997949012 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100035040 con 0x7ff1100735b0 2024-09-17T03:46:55.541 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.539+0000 7ff117e9b640 1 -- 172.21.15.146:0/3997949012 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1101567b0 con 0x7ff1100735b0 2024-09-17T03:46:55.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.540+0000 7ff117e9b640 1 -- 172.21.15.146:0/3997949012 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff110154730 con 0x7ff1100735b0 2024-09-17T03:46:55.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.541+0000 7ff1067fc640 1 -- 172.21.15.146:0/3997949012 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff100041030 con 0x7ff1100735b0 2024-09-17T03:46:55.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.541+0000 7ff1067fc640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff0f4078bc0 0x7ff0f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:55.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.541+0000 7ff1067fc640 1 -- 172.21.15.146:0/3997949012 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5795+0+0 (secure 0 0 0) 0x7ff1000bb610 con 0x7ff1100735b0 2024-09-17T03:46:55.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.541+0000 7ff115c37640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff0f4078bc0 0x7ff0f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:55.542 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.542+0000 7ff115c37640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff0f4078bc0 0x7ff0f407b0d0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff10c005fd0 tx=0x7ff10c005cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:55.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.546+0000 7ff1067fc640 1 -- 172.21.15.146:0/3997949012 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff110151a00 con 0x7ff1100735b0 2024-09-17T03:46:55.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:55.755+0000 7ff117e9b640 1 -- 172.21.15.146:0/3997949012 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff11015c9a0 con 0x7ff1100735b0 2024-09-17T03:46:56.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.411+0000 7ff1067fc640 1 -- 172.21.15.146:0/3997949012 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v156) ==== 104+0+0 (secure 0 0 0) 0x7ff100083a80 con 0x7ff1100735b0 2024-09-17T03:46:56.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 -- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff0f4078bc0 msgr2=0x7ff0f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:56.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff0f4078bc0 0x7ff0f407b0d0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff10c005fd0 tx=0x7ff10c005cf0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 -- 172.21.15.146:0/3997949012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100735b0 msgr2=0x7ff11013ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100735b0 0x7ff11013ff60 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7ff100006010 tx=0x7ff1000039e0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 -- 172.21.15.146:0/3997949012 shutdown_connections 2024-09-17T03:46:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff0f4078bc0 0x7ff0f407b0d0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff11015f540 0x7ff1101f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1100735b0 0x7ff11013ff60 unknown :-1 s=CLOSED pgs=2622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 --2- 172.21.15.146:0/3997949012 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff110070fc0 0x7ff110159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 -- 172.21.15.146:0/3997949012 >> 172.21.15.146:0/3997949012 conn(0x7ff1100b3880 msgr2=0x7ff1100b4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 -- 172.21.15.146:0/3997949012 shutdown_connections 2024-09-17T03:46:56.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.415+0000 7ff117e9b640 1 -- 172.21.15.146:0/3997949012 wait complete. 2024-09-17T03:46:56.428 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:46:56.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.545+0000 7f4e38838640 1 -- 172.21.15.146:0/1927071902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e340d09e0 msgr2=0x7f4e340d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:56.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.545+0000 7f4e38838640 1 --2- 172.21.15.146:0/1927071902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e340d09e0 0x7f4e340d0df0 secure :-1 s=READY pgs=2623 cs=0 l=1 rev1=1 crypto rx=0x7f4e34076a30 tx=0x7f4e2802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.546+0000 7f4e38838640 1 -- 172.21.15.146:0/1927071902 shutdown_connections 2024-09-17T03:46:56.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.546+0000 7f4e38838640 1 --2- 172.21.15.146:0/1927071902 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e340cee00 0x7f4e340cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.546+0000 7f4e38838640 1 --2- 172.21.15.146:0/1927071902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e340d09e0 0x7f4e340d0df0 unknown :-1 s=CLOSED pgs=2623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.546+0000 7f4e38838640 1 --2- 172.21.15.146:0/1927071902 >> v2:172.21.15.179:3300/0 conn(0x7f4e340b4cb0 0x7f4e340b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.546 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.546+0000 7f4e38838640 1 -- 172.21.15.146:0/1927071902 >> 172.21.15.146:0/1927071902 conn(0x7f4e3409ba40 msgr2=0x7f4e340b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.546+0000 7f4e38838640 1 -- 172.21.15.146:0/1927071902 shutdown_connections 2024-09-17T03:46:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.546+0000 7f4e38838640 1 -- 172.21.15.146:0/1927071902 wait complete. 2024-09-17T03:46:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.547+0000 7f4e38838640 1 Processor -- start 2024-09-17T03:46:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.548+0000 7f4e38838640 1 -- start start 2024-09-17T03:46:56.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e38838640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e340b4cb0 0x7f4e3415ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e38838640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e340cee00 0x7f4e340cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e38838640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e340d09e0 0x7f4e340cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e38838640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4e340b7b90 con 0x7f4e340b4cb0 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e38838640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4e340b7a10 con 0x7f4e340cee00 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e38838640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4e340cf750 con 0x7f4e340d09e0 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e3259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e340b4cb0 0x7f4e3415ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e3259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e340b4cb0 0x7f4e3415ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51932/0 (socket says 172.21.15.146:51932) 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e3259c640 1 -- 172.21.15.146:0/2345152985 learned_addr learned my addr 172.21.15.146:0/2345152985 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e31d9b640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e340cee00 0x7f4e340cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e32d9d640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e340d09e0 0x7f4e340cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e3259c640 1 -- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e340d09e0 msgr2=0x7f4e340cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e3259c640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e340d09e0 0x7f4e340cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e3259c640 1 -- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e340cee00 msgr2=0x7f4e340cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e3259c640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e340cee00 0x7f4e340cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e3259c640 1 -- 172.21.15.146:0/2345152985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e341f41c0 con 0x7f4e340b4cb0 2024-09-17T03:46:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e32d9d640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e340d09e0 0x7f4e340cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:46:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e3259c640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e340b4cb0 0x7f4e3415ee80 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400d650 tx=0x7f4e2400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.549+0000 7f4e22ffd640 1 -- 172.21.15.146:0/2345152985 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24017070 con 0x7f4e340b4cb0 2024-09-17T03:46:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.550+0000 7f4e22ffd640 1 -- 172.21.15.146:0/2345152985 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e24004310 con 0x7f4e340b4cb0 2024-09-17T03:46:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.550+0000 7f4e38838640 1 -- 172.21.15.146:0/2345152985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e341f44a0 con 0x7f4e340b4cb0 2024-09-17T03:46:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.550+0000 7f4e22ffd640 1 -- 172.21.15.146:0/2345152985 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24005280 con 0x7f4e340b4cb0 2024-09-17T03:46:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.550+0000 7f4e38838640 1 -- 172.21.15.146:0/2345152985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e341f4a60 con 0x7f4e340b4cb0 2024-09-17T03:46:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.551+0000 7f4e38838640 1 -- 172.21.15.146:0/2345152985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e340cfc00 con 0x7f4e340b4cb0 2024-09-17T03:46:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.552+0000 7f4e22ffd640 1 -- 172.21.15.146:0/2345152985 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4e24005420 con 0x7f4e340b4cb0 2024-09-17T03:46:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.552+0000 7f4e22ffd640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4e14078bc0 0x7f4e1407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.552+0000 7f4e22ffd640 1 -- 172.21.15.146:0/2345152985 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5795+0+0 (secure 0 0 0) 0x7f4e2409b130 con 0x7f4e340b4cb0 2024-09-17T03:46:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.552+0000 7f4e31d9b640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4e14078bc0 0x7f4e1407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.553+0000 7f4e31d9b640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4e14078bc0 0x7f4e1407b0d0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f4e28033000 tx=0x7f4e28004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.557+0000 7f4e22ffd640 1 -- 172.21.15.146:0/2345152985 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4e24020020 con 0x7f4e340b4cb0 2024-09-17T03:46:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:56.733+0000 7f4e38838640 1 -- 172.21.15.146:0/2345152985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4e340c6790 con 0x7f4e340b4cb0 2024-09-17T03:46:57.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.413+0000 7f4e22ffd640 1 -- 172.21.15.146:0/2345152985 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v201) ==== 181+0+0 (secure 0 0 0) 0x7f4e24063510 con 0x7f4e340b4cb0 2024-09-17T03:46:57.414 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:46:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 -- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4e14078bc0 msgr2=0x7f4e1407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4e14078bc0 0x7f4e1407b0d0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f4e28033000 tx=0x7f4e28004730 comp rx=0 tx=0).stop 2024-09-17T03:46:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 -- 172.21.15.146:0/2345152985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e340b4cb0 msgr2=0x7f4e3415ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e340b4cb0 0x7f4e3415ee80 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400d650 tx=0x7f4e2400db10 comp rx=0 tx=0).stop 2024-09-17T03:46:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 -- 172.21.15.146:0/2345152985 shutdown_connections 2024-09-17T03:46:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4e14078bc0 0x7f4e1407b0d0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4e340d09e0 0x7f4e340cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e340cee00 0x7f4e340cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 --2- 172.21.15.146:0/2345152985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4e340b4cb0 0x7f4e3415ee80 unknown :-1 s=CLOSED pgs=2624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 -- 172.21.15.146:0/2345152985 >> 172.21.15.146:0/2345152985 conn(0x7f4e3409ba40 msgr2=0x7f4e34160d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 -- 172.21.15.146:0/2345152985 shutdown_connections 2024-09-17T03:46:57.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.417+0000 7f4e38838640 1 -- 172.21.15.146:0/2345152985 wait complete. 2024-09-17T03:46:57.430 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:46:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.550+0000 7f833ecb4640 1 -- 172.21.15.146:0/3247415334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83381529a0 msgr2=0x7f833815c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.550+0000 7f833ecb4640 1 --2- 172.21.15.146:0/3247415334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83381529a0 0x7f833815c130 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f832c009830 tx=0x7f832c02a480 comp rx=0 tx=0).stop 2024-09-17T03:46:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.550+0000 7f833ecb4640 1 -- 172.21.15.146:0/3247415334 shutdown_connections 2024-09-17T03:46:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.550+0000 7f833ecb4640 1 --2- 172.21.15.146:0/3247415334 >> v2:172.21.15.179:3300/0 conn(0x7f8338073df0 0x7f83380b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.550+0000 7f833ecb4640 1 --2- 172.21.15.146:0/3247415334 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f83381529a0 0x7f833815c130 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.550+0000 7f833ecb4640 1 -- 172.21.15.146:0/3247415334 >> 172.21.15.146:0/3247415334 conn(0x7f833806e4c0 msgr2=0x7f83380b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.550+0000 7f833ecb4640 1 -- 172.21.15.146:0/3247415334 shutdown_connections 2024-09-17T03:46:57.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.550+0000 7f833ecb4640 1 -- 172.21.15.146:0/3247415334 wait complete. 2024-09-17T03:46:57.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.552+0000 7f833ecb4640 1 Processor -- start 2024-09-17T03:46:57.552 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.552+0000 7f833ecb4640 1 -- start start 2024-09-17T03:46:57.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833ecb4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83381529a0 0x7f833814c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:57.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833ecb4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338152db0 0x7f83381580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:57.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833ecb4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8338148c20 0x7f8338158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:57.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833ecb4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f83380b0c50 con 0x7f8338148c20 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833ecb4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f833815c9d0 con 0x7f83381529a0 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833ecb4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f83380b0dd0 con 0x7f8338152db0 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833d251640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8338148c20 0x7f8338158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833d251640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8338148c20 0x7f8338158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46440/0 (socket says 172.21.15.146:46440) 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833d251640 1 -- 172.21.15.146:0/985532185 learned_addr learned my addr 172.21.15.146:0/985532185 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833ca50640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83381529a0 0x7f833814c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f8337fff640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338152db0 0x7f83381580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833d251640 1 -- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338152db0 msgr2=0x7f83381580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833d251640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338152db0 0x7f83381580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833d251640 1 -- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83381529a0 msgr2=0x7f833814c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833d251640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83381529a0 0x7f833814c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833d251640 1 -- 172.21.15.146:0/985532185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83381e5890 con 0x7f8338148c20 2024-09-17T03:46:57.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833d251640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8338148c20 0x7f8338158610 secure :-1 s=READY pgs=2625 cs=0 l=1 rev1=1 crypto rx=0x7f833000ec50 tx=0x7f833000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f83357fa640 1 -- 172.21.15.146:0/985532185 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330003b70 con 0x7f8338148c20 2024-09-17T03:46:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f83357fa640 1 -- 172.21.15.146:0/985532185 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8330003d10 con 0x7f8338148c20 2024-09-17T03:46:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f83357fa640 1 -- 172.21.15.146:0/985532185 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330004280 con 0x7f8338148c20 2024-09-17T03:46:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.554+0000 7f833ecb4640 1 -- 172.21.15.146:0/985532185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83381e5d90 con 0x7f8338148c20 2024-09-17T03:46:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.555+0000 7f833ecb4640 1 -- 172.21.15.146:0/985532185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83381e8250 con 0x7f8338148c20 2024-09-17T03:46:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.555+0000 7f833ecb4640 1 -- 172.21.15.146:0/985532185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83380b0500 con 0x7f8338148c20 2024-09-17T03:46:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.556+0000 7f83357fa640 1 -- 172.21.15.146:0/985532185 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8330004420 con 0x7f8338148c20 2024-09-17T03:46:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.557+0000 7f83357fa640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f831c078b90 0x7f831c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.557+0000 7f83357fa640 1 -- 172.21.15.146:0/985532185 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 5357+0+0 (secure 0 0 0) 0x7f833009b960 con 0x7f8338148c20 2024-09-17T03:46:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.557+0000 7f833ca50640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f831c078b90 0x7f831c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:57.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.557+0000 7f833ca50640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f831c078b90 0x7f831c07b0a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f832c034000 tx=0x7f832c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:57.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.561+0000 7f83357fa640 1 -- 172.21.15.146:0/985532185 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f83300638b0 con 0x7f8338148c20 2024-09-17T03:46:57.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:57.737+0000 7f833ecb4640 1 -- 172.21.15.146:0/985532185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8338154700 con 0x7f8338148c20 2024-09-17T03:46:58.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.420+0000 7f83357fa640 1 -- 172.21.15.146:0/985532185 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v202) ==== 169+0+0 (secure 0 0 0) 0x7f83300682e0 con 0x7f8338148c20 2024-09-17T03:46:58.422 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:46:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 -- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f831c078b90 msgr2=0x7f831c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f831c078b90 0x7f831c07b0a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f832c034000 tx=0x7f832c004730 comp rx=0 tx=0).stop 2024-09-17T03:46:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 -- 172.21.15.146:0/985532185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8338148c20 msgr2=0x7f8338158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8338148c20 0x7f8338158610 secure :-1 s=READY pgs=2625 cs=0 l=1 rev1=1 crypto rx=0x7f833000ec50 tx=0x7f833000c6a0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 -- 172.21.15.146:0/985532185 shutdown_connections 2024-09-17T03:46:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f831c078b90 0x7f831c07b0a0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8338148c20 0x7f8338158610 unknown :-1 s=CLOSED pgs=2625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8338152db0 0x7f83381580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 --2- 172.21.15.146:0/985532185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f83381529a0 0x7f833814c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 -- 172.21.15.146:0/985532185 >> 172.21.15.146:0/985532185 conn(0x7f833806e4c0 msgr2=0x7f83380b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 -- 172.21.15.146:0/985532185 shutdown_connections 2024-09-17T03:46:58.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.423+0000 7f833ecb4640 1 -- 172.21.15.146:0/985532185 wait complete. 2024-09-17T03:46:58.441 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:46:58.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.561+0000 7f4d4e37b640 1 -- 172.21.15.146:0/3450548648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d480d2800 msgr2=0x7f4d480d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:58.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.561+0000 7f4d4e37b640 1 --2- 172.21.15.146:0/3450548648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d480d2800 0x7f4d480d1300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009860 tx=0x7f4d3802a540 comp rx=0 tx=0).stop 2024-09-17T03:46:58.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.561+0000 7f4d4e37b640 1 -- 172.21.15.146:0/3450548648 shutdown_connections 2024-09-17T03:46:58.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.561+0000 7f4d4e37b640 1 --2- 172.21.15.146:0/3450548648 >> v2:172.21.15.179:3300/0 conn(0x7f4d480cf150 0x7f4d480d1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.561+0000 7f4d4e37b640 1 --2- 172.21.15.146:0/3450548648 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d480d2800 0x7f4d480d1300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.561+0000 7f4d4e37b640 1 -- 172.21.15.146:0/3450548648 >> 172.21.15.146:0/3450548648 conn(0x7f4d4806ecd0 msgr2=0x7f4d4806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:58.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.561+0000 7f4d4e37b640 1 -- 172.21.15.146:0/3450548648 shutdown_connections 2024-09-17T03:46:58.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.561+0000 7f4d4e37b640 1 -- 172.21.15.146:0/3450548648 wait complete. 2024-09-17T03:46:58.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.563+0000 7f4d4e37b640 1 Processor -- start 2024-09-17T03:46:58.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.563+0000 7f4d4e37b640 1 -- start start 2024-09-17T03:46:58.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.564+0000 7f4d4e37b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d480cf150 0x7f4d48149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:58.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.564+0000 7f4d4e37b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d480d2800 0x7f4d481598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:58.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.564+0000 7f4d4e37b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d4815edf0 0x7f4d481fa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:58.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d4e37b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4d480b6c00 con 0x7f4d480d2800 2024-09-17T03:46:58.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d4e37b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4d480b6a80 con 0x7f4d480cf150 2024-09-17T03:46:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d4e37b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4d480b6d80 con 0x7f4d4815edf0 2024-09-17T03:46:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d477fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d480d2800 0x7f4d481598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d477fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d480d2800 0x7f4d481598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46452/0 (socket says 172.21.15.146:46452) 2024-09-17T03:46:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d477fe640 1 -- 172.21.15.146:0/1834836724 learned_addr learned my addr 172.21.15.146:0/1834836724 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d47fff640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d480cf150 0x7f4d48149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d4c918640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d4815edf0 0x7f4d481fa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d477fe640 1 -- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d4815edf0 msgr2=0x7f4d481fa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d477fe640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d4815edf0 0x7f4d481fa190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d477fe640 1 -- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d480cf150 msgr2=0x7f4d48149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d477fe640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d480cf150 0x7f4d48149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d477fe640 1 -- 172.21.15.146:0/1834836724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d48149e60 con 0x7f4d480d2800 2024-09-17T03:46:58.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d477fe640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d480d2800 0x7f4d481598b0 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00ea20 tx=0x7f4d3c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:58.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d44ff9640 1 -- 172.21.15.146:0/1834836724 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00cd80 con 0x7f4d480d2800 2024-09-17T03:46:58.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d44ff9640 1 -- 172.21.15.146:0/1834836724 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d3c004020 con 0x7f4d480d2800 2024-09-17T03:46:58.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d44ff9640 1 -- 172.21.15.146:0/1834836724 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c004470 con 0x7f4d480d2800 2024-09-17T03:46:58.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.565+0000 7f4d4e37b640 1 -- 172.21.15.146:0/1834836724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d4814a140 con 0x7f4d480d2800 2024-09-17T03:46:58.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.566+0000 7f4d4e37b640 1 -- 172.21.15.146:0/1834836724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d48159f30 con 0x7f4d480d2800 2024-09-17T03:46:58.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.567+0000 7f4d4e37b640 1 -- 172.21.15.146:0/1834836724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4814a660 con 0x7f4d480d2800 2024-09-17T03:46:58.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.567+0000 7f4d44ff9640 1 -- 172.21.15.146:0/1834836724 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d3c0035f0 con 0x7f4d480d2800 2024-09-17T03:46:58.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.568+0000 7f4d44ff9640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d34078bc0 0x7f4d3407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:58.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.568+0000 7f4d44ff9640 1 -- 172.21.15.146:0/1834836724 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4943+0+0 (secure 0 0 0) 0x7f4d3c09b2c0 con 0x7f4d480d2800 2024-09-17T03:46:58.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.568+0000 7f4d47fff640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d34078bc0 0x7f4d3407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:58.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.569+0000 7f4d47fff640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d34078bc0 0x7f4d3407b0d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f4d38034000 tx=0x7f4d38004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:58.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.572+0000 7f4d44ff9640 1 -- 172.21.15.146:0/1834836724 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4d4814a660 con 0x7f4d480d2800 2024-09-17T03:46:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.749+0000 7f4d4e37b640 1 -- 172.21.15.146:0/1834836724 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f4d480d0f80 con 0x7f4d480d2800 2024-09-17T03:46:58.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.754+0000 7f4d44ff9640 1 -- 172.21.15.146:0/1834836724 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v67) ==== 71+0+0 (secure 0 0 0) 0x7f4d480d0f80 con 0x7f4d480d2800 2024-09-17T03:46:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 -- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d34078bc0 msgr2=0x7f4d3407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d34078bc0 0x7f4d3407b0d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f4d38034000 tx=0x7f4d38004730 comp rx=0 tx=0).stop 2024-09-17T03:46:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 -- 172.21.15.146:0/1834836724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d480d2800 msgr2=0x7f4d481598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d480d2800 0x7f4d481598b0 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00ea20 tx=0x7f4d3c00eee0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 -- 172.21.15.146:0/1834836724 shutdown_connections 2024-09-17T03:46:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4d34078bc0 0x7f4d3407b0d0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4d4815edf0 0x7f4d481fa190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d480d2800 0x7f4d481598b0 unknown :-1 s=CLOSED pgs=2626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 --2- 172.21.15.146:0/1834836724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4d480cf150 0x7f4d48149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 -- 172.21.15.146:0/1834836724 >> 172.21.15.146:0/1834836724 conn(0x7f4d4806ecd0 msgr2=0x7f4d480b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 -- 172.21.15.146:0/1834836724 shutdown_connections 2024-09-17T03:46:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.756+0000 7f4d4e37b640 1 -- 172.21.15.146:0/1834836724 wait complete. 2024-09-17T03:46:58.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2024-09-17T03:46:58.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.895+0000 7f659ccd5640 1 -- 172.21.15.146:0/2297695957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6584003c10 msgr2=0x7f6584004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:58.895 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.895+0000 7f659ccd5640 1 --2- 172.21.15.146:0/2297695957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6584003c10 0x7f6584004060 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7f6588009b30 tx=0x7f6584005830 comp rx=0 tx=0).stop 2024-09-17T03:46:58.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.895+0000 7f6596d9d640 1 -- 172.21.15.146:0/2297695957 reap_dead start 2024-09-17T03:46:58.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.895+0000 7f659ccd5640 1 -- 172.21.15.146:0/2297695957 shutdown_connections 2024-09-17T03:46:58.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.895+0000 7f659ccd5640 1 -- 172.21.15.146:0/2297695957 >> 172.21.15.146:0/2297695957 conn(0x7f65980d26a0 msgr2=0x7f65980d2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:58.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.895+0000 7f659ccd5640 1 -- 172.21.15.146:0/2297695957 shutdown_connections 2024-09-17T03:46:58.896 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.895+0000 7f659ccd5640 1 -- 172.21.15.146:0/2297695957 wait complete. 2024-09-17T03:46:58.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.897+0000 7f659ccd5640 1 Processor -- start 2024-09-17T03:46:58.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.897+0000 7f659ccd5640 1 -- start start 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.898+0000 7f659ccd5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6584003c10 0x7f6598150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.898+0000 7f659ccd5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65981f49d0 0x7f65981f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.898+0000 7f659ccd5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65981f77f0 0x7f65980cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.898+0000 7f659ccd5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f65980cd9a0 con 0x7f6584003c10 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.898+0000 7f659ccd5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f65980cd820 con 0x7f65981f77f0 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.898+0000 7f659ccd5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f65980cdb20 con 0x7f65981f49d0 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.898+0000 7f659659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6584003c10 0x7f6598150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.898+0000 7f659659c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6584003c10 0x7f6598150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46470/0 (socket says 172.21.15.146:46470) 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.898+0000 7f659659c640 1 -- 172.21.15.146:0/680184752 learned_addr learned my addr 172.21.15.146:0/680184752 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f658ffff640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65981f49d0 0x7f65981f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f6596d9d640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65981f77f0 0x7f65980cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f659659c640 1 -- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65981f49d0 msgr2=0x7f65981f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f659659c640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65981f49d0 0x7f65981f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f659659c640 1 -- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65981f77f0 msgr2=0x7f65980cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f659659c640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65981f77f0 0x7f65980cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f659659c640 1 -- 172.21.15.146:0/680184752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65981f7fe0 con 0x7f6584003c10 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f658ffff640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65981f49d0 0x7f65981f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f6596d9d640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65981f77f0 0x7f65980cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f659659c640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6584003c10 0x7f6598150960 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7f6588009a50 tx=0x7f658802ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f658effd640 1 -- 172.21.15.146:0/680184752 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588041020 con 0x7f6584003c10 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f658effd640 1 -- 172.21.15.146:0/680184752 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6588004ca0 con 0x7f6584003c10 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f659ccd5640 1 -- 172.21.15.146:0/680184752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65981f3ef0 con 0x7f6584003c10 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f658effd640 1 -- 172.21.15.146:0/680184752 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658803d6c0 con 0x7f6584003c10 2024-09-17T03:46:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.899+0000 7f659ccd5640 1 -- 172.21.15.146:0/680184752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65980a0320 con 0x7f6584003c10 2024-09-17T03:46:58.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.900+0000 7f659ccd5640 1 -- 172.21.15.146:0/680184752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65980ce080 con 0x7f6584003c10 2024-09-17T03:46:58.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.901+0000 7f658effd640 1 -- 172.21.15.146:0/680184752 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6588044020 con 0x7f6584003c10 2024-09-17T03:46:58.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.901+0000 7f658effd640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6578078b90 0x7f657807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:58.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.901+0000 7f658effd640 1 -- 172.21.15.146:0/680184752 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4943+0+0 (secure 0 0 0) 0x7f65880bbf50 con 0x7f6584003c10 2024-09-17T03:46:58.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.902+0000 7f658ffff640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6578078b90 0x7f657807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:58.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.902+0000 7f658ffff640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6578078b90 0x7f657807b0a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f659809d870 tx=0x7f6580000fd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:58.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:58.906+0000 7f658effd640 1 -- 172.21.15.146:0/680184752 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f658804b030 con 0x7f6584003c10 2024-09-17T03:46:59.148 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.148+0000 7f659ccd5640 1 -- 172.21.15.146:0/680184752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) -- 0x7f65980ceba0 con 0x7f6584003c10 2024-09-17T03:46:59.422 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.422+0000 7f658effd640 1 -- 172.21.15.146:0/680184752 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v672) ==== 147+0+0 (secure 0 0 0) 0x7f6588084680 con 0x7f6584003c10 2024-09-17T03:46:59.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 -- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6578078b90 msgr2=0x7f657807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:59.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6578078b90 0x7f657807b0a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f659809d870 tx=0x7f6580000fd0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 -- 172.21.15.146:0/680184752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6584003c10 msgr2=0x7f6598150960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:59.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6584003c10 0x7f6598150960 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7f6588009a50 tx=0x7f658802ba60 comp rx=0 tx=0).stop 2024-09-17T03:46:59.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 -- 172.21.15.146:0/680184752 shutdown_connections 2024-09-17T03:46:59.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6578078b90 0x7f657807b0a0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f65981f77f0 0x7f65980cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f65981f49d0 0x7f65981f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 --2- 172.21.15.146:0/680184752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6584003c10 0x7f6598150960 unknown :-1 s=CLOSED pgs=2629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 -- 172.21.15.146:0/680184752 >> 172.21.15.146:0/680184752 conn(0x7f65980d26a0 msgr2=0x7f65980b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:59.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 -- 172.21.15.146:0/680184752 shutdown_connections 2024-09-17T03:46:59.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.424+0000 7f659ccd5640 1 -- 172.21.15.146:0/680184752 wait complete. 2024-09-17T03:46:59.436 INFO:tasks.cephfs_test_runner:test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-17T03:46:59.436 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) 2024-09-17T03:46:59.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:46:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.549+0000 7fb66272b640 1 -- 172.21.15.146:0/2750029058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0cd830 msgr2=0x7fb65c0cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.549+0000 7fb66272b640 1 --2- 172.21.15.146:0/2750029058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0cd830 0x7fb65c0cdc40 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7fb650009830 tx=0x7fb65002a510 comp rx=0 tx=0).stop 2024-09-17T03:46:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.549+0000 7fb66272b640 1 -- 172.21.15.146:0/2750029058 shutdown_connections 2024-09-17T03:46:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.549+0000 7fb66272b640 1 --2- 172.21.15.146:0/2750029058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0cd830 0x7fb65c0cdc40 unknown :-1 s=CLOSED pgs=2631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.549+0000 7fb66272b640 1 -- 172.21.15.146:0/2750029058 >> 172.21.15.146:0/2750029058 conn(0x7fb65c0d2650 msgr2=0x7fb65c0d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.549+0000 7fb66272b640 1 -- 172.21.15.146:0/2750029058 shutdown_connections 2024-09-17T03:46:59.550 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.549+0000 7fb66272b640 1 -- 172.21.15.146:0/2750029058 wait complete. 2024-09-17T03:46:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.551+0000 7fb66272b640 1 Processor -- start 2024-09-17T03:46:59.551 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.551+0000 7fb66272b640 1 -- start start 2024-09-17T03:46:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb66272b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb65c070db0 0x7fb65c0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:59.554 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb66272b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0b1c20 0x7fb65c156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb66272b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb65c0cd830 0x7fb65c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb66272b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c071a50 con 0x7fb65c0b1c20 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb66272b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c0718d0 con 0x7fb65c070db0 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb66272b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb65c071bd0 con 0x7fb65c0cd830 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb65b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0b1c20 0x7fb65c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb65b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0b1c20 0x7fb65c156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46486/0 (socket says 172.21.15.146:46486) 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb65b7fe640 1 -- 172.21.15.146:0/4090061021 learned_addr learned my addr 172.21.15.146:0/4090061021 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb660cc8640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb65c0cd830 0x7fb65c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb65bfff640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb65c070db0 0x7fb65c0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb65b7fe640 1 -- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb65c0cd830 msgr2=0x7fb65c156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb65b7fe640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb65c0cd830 0x7fb65c156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb65b7fe640 1 -- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb65c070db0 msgr2=0x7fb65c0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:59.555 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb65b7fe640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb65c070db0 0x7fb65c0cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.553+0000 7fb65b7fe640 1 -- 172.21.15.146:0/4090061021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65c09f5c0 con 0x7fb65c0b1c20 2024-09-17T03:46:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.554+0000 7fb65b7fe640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0b1c20 0x7fb65c156670 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 crypto rx=0x7fb650009950 tx=0x7fb650033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.554+0000 7fb658ff9640 1 -- 172.21.15.146:0/4090061021 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650031d60 con 0x7fb65c0b1c20 2024-09-17T03:46:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.554+0000 7fb658ff9640 1 -- 172.21.15.146:0/4090061021 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb650033e10 con 0x7fb65c0b1c20 2024-09-17T03:46:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.554+0000 7fb66272b640 1 -- 172.21.15.146:0/4090061021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65c09f8a0 con 0x7fb65c0b1c20 2024-09-17T03:46:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.554+0000 7fb658ff9640 1 -- 172.21.15.146:0/4090061021 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650005260 con 0x7fb65c0b1c20 2024-09-17T03:46:59.556 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.554+0000 7fb66272b640 1 -- 172.21.15.146:0/4090061021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65c09fe60 con 0x7fb65c0b1c20 2024-09-17T03:46:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.555+0000 7fb66272b640 1 -- 172.21.15.146:0/4090061021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb65c0cdc40 con 0x7fb65c0b1c20 2024-09-17T03:46:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.556+0000 7fb658ff9640 1 -- 172.21.15.146:0/4090061021 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb650005400 con 0x7fb65c0b1c20 2024-09-17T03:46:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.556+0000 7fb658ff9640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb648078b90 0x7fb64807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.556+0000 7fb658ff9640 1 -- 172.21.15.146:0/4090061021 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4943+0+0 (secure 0 0 0) 0x7fb6500bbd00 con 0x7fb65c0b1c20 2024-09-17T03:46:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.556+0000 7fb65bfff640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb648078b90 0x7fb64807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:59.557 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.557+0000 7fb65bfff640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb648078b90 0x7fb64807b0a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb64c000f60 tx=0x7fb64c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:59.560 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.561+0000 7fb658ff9640 1 -- 172.21.15.146:0/4090061021 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb65003f030 con 0x7fb65c0b1c20 2024-09-17T03:46:59.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.738+0000 7fb66272b640 1 -- 172.21.15.146:0/4090061021 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb65c09f350 con 0x7fb65c0b1c20 2024-09-17T03:46:59.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.738+0000 7fb658ff9640 1 -- 172.21.15.146:0/4090061021 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) ==== 74+0+13090 (secure 0 0 0) 0x7fb650083df0 con 0x7fb65c0b1c20 2024-09-17T03:46:59.739 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:46:59.739 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":202,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:46:58.415398+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6833/172455759":"2024-09-18T03:46:55.400110+0000","172.21.15.146:6832/172455759":"2024-09-18T03:46:55.400110+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:46:59.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 -- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb648078b90 msgr2=0x7fb64807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:59.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb648078b90 0x7fb64807b0a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb64c000f60 tx=0x7fb64c009040 comp rx=0 tx=0).stop 2024-09-17T03:46:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 -- 172.21.15.146:0/4090061021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0b1c20 msgr2=0x7fb65c156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0b1c20 0x7fb65c156670 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 crypto rx=0x7fb650009950 tx=0x7fb650033c20 comp rx=0 tx=0).stop 2024-09-17T03:46:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 -- 172.21.15.146:0/4090061021 shutdown_connections 2024-09-17T03:46:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb648078b90 0x7fb64807b0a0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb65c0cd830 0x7fb65c156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb65c0b1c20 0x7fb65c156670 unknown :-1 s=CLOSED pgs=2632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 --2- 172.21.15.146:0/4090061021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb65c070db0 0x7fb65c0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 -- 172.21.15.146:0/4090061021 >> 172.21.15.146:0/4090061021 conn(0x7fb65c0d2650 msgr2=0x7fb65c0711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 -- 172.21.15.146:0/4090061021 shutdown_connections 2024-09-17T03:46:59.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.741+0000 7fb66272b640 1 -- 172.21.15.146:0/4090061021 wait complete. 2024-09-17T03:46:59.752 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:32:47.805805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:46:59.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:46:59.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.868+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1520679465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a58070020 msgr2=0x7f1a5815ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.868+0000 7f1a5cb21640 1 --2- 172.21.15.146:0/1520679465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a58070020 0x7f1a5815ba40 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7f1a48005fd0 tx=0x7f1a4802aa90 comp rx=0 tx=0).stop 2024-09-17T03:46:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.868+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1520679465 shutdown_connections 2024-09-17T03:46:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.868+0000 7f1a5cb21640 1 --2- 172.21.15.146:0/1520679465 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a5806e340 0x7f1a5806e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.868+0000 7f1a5cb21640 1 --2- 172.21.15.146:0/1520679465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a58070020 0x7f1a5815ba40 unknown :-1 s=CLOSED pgs=2633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.868+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1520679465 >> 172.21.15.146:0/1520679465 conn(0x7f1a580b2790 msgr2=0x7f1a580d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:46:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.868+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1520679465 shutdown_connections 2024-09-17T03:46:59.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.868+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1520679465 wait complete. 2024-09-17T03:46:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.870+0000 7f1a5cb21640 1 Processor -- start 2024-09-17T03:46:59.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.870+0000 7f1a5cb21640 1 -- start start 2024-09-17T03:46:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.871+0000 7f1a5cb21640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a5806e340 0x7f1a58154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.871+0000 7f1a5cb21640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a58070020 0x7f1a580c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.871+0000 7f1a5cb21640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a5815f5a0 0x7f1a580c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.871+0000 7f1a5cb21640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5806f020 con 0x7f1a58070020 2024-09-17T03:46:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.871+0000 7f1a5cb21640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5806eea0 con 0x7f1a5806e340 2024-09-17T03:46:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.871+0000 7f1a5cb21640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1a5806f1a0 con 0x7f1a5815f5a0 2024-09-17T03:46:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.871+0000 7f1a55d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a58070020 0x7f1a580c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.871+0000 7f1a55d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a58070020 0x7f1a580c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46504/0 (socket says 172.21.15.146:46504) 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.871+0000 7f1a55d9b640 1 -- 172.21.15.146:0/1803628119 learned_addr learned my addr 172.21.15.146:0/1803628119 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a5659c640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a5806e340 0x7f1a58154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a56d9d640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a5815f5a0 0x7f1a580c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a55d9b640 1 -- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a5815f5a0 msgr2=0x7f1a580c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a55d9b640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a5815f5a0 0x7f1a580c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a55d9b640 1 -- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a5806e340 msgr2=0x7f1a58154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a55d9b640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a5806e340 0x7f1a58154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a55d9b640 1 -- 172.21.15.146:0/1803628119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a58073130 con 0x7f1a58070020 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a55d9b640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a58070020 0x7f1a580c53d0 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c340 tx=0x7f1a4000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a4effd640 1 -- 172.21.15.146:0/1803628119 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40017070 con 0x7f1a58070020 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a4effd640 1 -- 172.21.15.146:0/1803628119 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a400053c0 con 0x7f1a58070020 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a4effd640 1 -- 172.21.15.146:0/1803628119 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40003850 con 0x7f1a58070020 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1803628119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a58073410 con 0x7f1a58070020 2024-09-17T03:46:59.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.872+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1803628119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a580739d0 con 0x7f1a58070020 2024-09-17T03:46:59.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.873+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1803628119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a5806e750 con 0x7f1a58070020 2024-09-17T03:46:59.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.874+0000 7f1a4effd640 1 -- 172.21.15.146:0/1803628119 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a4001a070 con 0x7f1a58070020 2024-09-17T03:46:59.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.874+0000 7f1a4effd640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 0x7f1a3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:46:59.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.874+0000 7f1a4effd640 1 -- 172.21.15.146:0/1803628119 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4943+0+0 (secure 0 0 0) 0x7f1a40099e30 con 0x7f1a58070020 2024-09-17T03:46:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.875+0000 7f1a5659c640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 0x7f1a3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:46:59.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.875+0000 7f1a5659c640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 0x7f1a3807b0a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f1a48035000 tx=0x7f1a48038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:46:59.879 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:46:59.879+0000 7f1a4effd640 1 -- 172.21.15.146:0/1803628119 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1a400624d0 con 0x7f1a58070020 2024-09-17T03:47:00.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.055+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1803628119 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1a58073e10 con 0x7f1a58070020 2024-09-17T03:47:00.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.056+0000 7f1a4effd640 1 -- 172.21.15.146:0/1803628119 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v202) ==== 93+0+10 (secure 0 0 0) 0x7f1a40061dd0 con 0x7f1a58070020 2024-09-17T03:47:00.056 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2024-09-17T03:47:00.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 msgr2=0x7f1a3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:00.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 0x7f1a3807b0a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f1a48035000 tx=0x7f1a48038040 comp rx=0 tx=0).stop 2024-09-17T03:47:00.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1803628119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a58070020 msgr2=0x7f1a580c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a58070020 0x7f1a580c53d0 secure :-1 s=READY pgs=2634 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c340 tx=0x7f1a4000c800 comp rx=0 tx=0).stop 2024-09-17T03:47:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1803628119 shutdown_connections 2024-09-17T03:47:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1a38078b90 0x7f1a3807b0a0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a5815f5a0 0x7f1a580c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a58070020 0x7f1a580c53d0 unknown :-1 s=CLOSED pgs=2634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 --2- 172.21.15.146:0/1803628119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a5806e340 0x7f1a58154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1803628119 >> 172.21.15.146:0/1803628119 conn(0x7f1a580b2790 msgr2=0x7f1a5815b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1803628119 shutdown_connections 2024-09-17T03:47:00.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.058+0000 7f1a5cb21640 1 -- 172.21.15.146:0/1803628119 wait complete. 2024-09-17T03:47:00.070 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2024-09-17T03:47:00.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.182+0000 7fc21d88b640 1 -- 172.21.15.146:0/3046360246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2180d2800 msgr2=0x7fc2180d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:00.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.182+0000 7fc21d88b640 1 --2- 172.21.15.146:0/3046360246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2180d2800 0x7fc2180d1300 secure :-1 s=READY pgs=2635 cs=0 l=1 rev1=1 crypto rx=0x7fc208005fd0 tx=0x7fc20802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:47:00.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.182+0000 7fc21d88b640 1 -- 172.21.15.146:0/3046360246 shutdown_connections 2024-09-17T03:47:00.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.182+0000 7fc21d88b640 1 --2- 172.21.15.146:0/3046360246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2180d4420 0x7fc2180d1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:00.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.182+0000 7fc21d88b640 1 --2- 172.21.15.146:0/3046360246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2180d2800 0x7fc2180d1300 unknown :-1 s=CLOSED pgs=2635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:00.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.182+0000 7fc21d88b640 1 -- 172.21.15.146:0/3046360246 >> 172.21.15.146:0/3046360246 conn(0x7fc21806ecd0 msgr2=0x7fc21806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:00.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.182+0000 7fc21d88b640 1 -- 172.21.15.146:0/3046360246 shutdown_connections 2024-09-17T03:47:00.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.182+0000 7fc21d88b640 1 -- 172.21.15.146:0/3046360246 wait complete. 2024-09-17T03:47:00.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.184+0000 7fc21d88b640 1 Processor -- start 2024-09-17T03:47:00.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.184+0000 7fc21d88b640 1 -- start start 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc21d88b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2180cf150 0x7fc218160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc21d88b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2180d2800 0x7fc21814a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc21d88b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2180d4420 0x7fc21814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc21d88b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc2180b6a80 con 0x7fc2180d4420 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc21d88b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc21815f0f0 con 0x7fc2180cf150 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc21d88b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc2180b6c00 con 0x7fc2180d2800 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc2177fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2180d4420 0x7fc21814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc2177fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2180d4420 0x7fc21814da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46514/0 (socket says 172.21.15.146:46514) 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc2177fe640 1 -- 172.21.15.146:0/4153565638 learned_addr learned my addr 172.21.15.146:0/4153565638 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc2167fc640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2180d2800 0x7fc21814a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc216ffd640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2180cf150 0x7fc218160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:00.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc2177fe640 1 -- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2180d2800 msgr2=0x7fc21814a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc2177fe640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2180d2800 0x7fc21814a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc2177fe640 1 -- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2180cf150 msgr2=0x7fc218160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc2177fe640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2180cf150 0x7fc218160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc2177fe640 1 -- 172.21.15.146:0/4153565638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc218161780 con 0x7fc2180d4420 2024-09-17T03:47:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc2177fe640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2180d4420 0x7fc21814da70 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7fc21000e9c0 tx=0x7fc21000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc1fffff640 1 -- 172.21.15.146:0/4153565638 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210004d20 con 0x7fc2180d4420 2024-09-17T03:47:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc1fffff640 1 -- 172.21.15.146:0/4153565638 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc21000cb20 con 0x7fc2180d4420 2024-09-17T03:47:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc21d88b640 1 -- 172.21.15.146:0/4153565638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc218161a60 con 0x7fc2180d4420 2024-09-17T03:47:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc1fffff640 1 -- 172.21.15.146:0/4153565638 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210005020 con 0x7fc2180d4420 2024-09-17T03:47:00.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.186+0000 7fc21d88b640 1 -- 172.21.15.146:0/4153565638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc218162020 con 0x7fc2180d4420 2024-09-17T03:47:00.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.188+0000 7fc21d88b640 1 -- 172.21.15.146:0/4153565638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2180b7130 con 0x7fc2180d4420 2024-09-17T03:47:00.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.188+0000 7fc1fffff640 1 -- 172.21.15.146:0/4153565638 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc2100051c0 con 0x7fc2180d4420 2024-09-17T03:47:00.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.189+0000 7fc1fffff640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc204078b90 0x7fc20407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:00.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.189+0000 7fc1fffff640 1 -- 172.21.15.146:0/4153565638 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4943+0+0 (secure 0 0 0) 0x7fc21009b200 con 0x7fc2180d4420 2024-09-17T03:47:00.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.189+0000 7fc216ffd640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc204078b90 0x7fc20407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:00.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.190+0000 7fc216ffd640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc204078b90 0x7fc20407b0a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc208033000 tx=0x7fc208004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:00.193 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.193+0000 7fc1fffff640 1 -- 172.21.15.146:0/4153565638 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc210016030 con 0x7fc2180d4420 2024-09-17T03:47:00.236 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:47:00.239 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:47:00.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:00.440+0000 7fc21d88b640 1 -- 172.21.15.146:0/4153565638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) -- 0x7fc218161510 con 0x7fc2180d4420 2024-09-17T03:47:01.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.428+0000 7fc1fffff640 1 -- 172.21.15.146:0/4153565638 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v674) ==== 136+0+0 (secure 0 0 0) 0x7fc210063380 con 0x7fc2180d4420 2024-09-17T03:47:01.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.431+0000 7fc21d88b640 1 -- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc204078b90 msgr2=0x7fc20407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:01.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.431+0000 7fc21d88b640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc204078b90 0x7fc20407b0a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fc208033000 tx=0x7fc208004730 comp rx=0 tx=0).stop 2024-09-17T03:47:01.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.431+0000 7fc21d88b640 1 -- 172.21.15.146:0/4153565638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2180d4420 msgr2=0x7fc21814da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:01.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.431+0000 7fc21d88b640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2180d4420 0x7fc21814da70 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7fc21000e9c0 tx=0x7fc21000ee80 comp rx=0 tx=0).stop 2024-09-17T03:47:01.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.431+0000 7fc21d88b640 1 -- 172.21.15.146:0/4153565638 shutdown_connections 2024-09-17T03:47:01.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.431+0000 7fc21d88b640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc204078b90 0x7fc20407b0a0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.431+0000 7fc21d88b640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2180d4420 0x7fc21814da70 unknown :-1 s=CLOSED pgs=2636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.431+0000 7fc21d88b640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2180d2800 0x7fc21814a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.431+0000 7fc21d88b640 1 --2- 172.21.15.146:0/4153565638 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2180cf150 0x7fc218160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.431+0000 7fc21d88b640 1 -- 172.21.15.146:0/4153565638 >> 172.21.15.146:0/4153565638 conn(0x7fc21806ecd0 msgr2=0x7fc2180b6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:01.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.432+0000 7fc21d88b640 1 -- 172.21.15.146:0/4153565638 shutdown_connections 2024-09-17T03:47:01.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.432+0000 7fc21d88b640 1 -- 172.21.15.146:0/4153565638 wait complete. 2024-09-17T03:47:01.446 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:47:01.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.565+0000 7fa86fb2b640 1 -- 172.21.15.146:0/4137285990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa86815b8e0 msgr2=0x7fa8680747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:01.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.565+0000 7fa86fb2b640 1 --2- 172.21.15.146:0/4137285990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa86815b8e0 0x7fa8680747b0 secure :-1 s=READY pgs=2637 cs=0 l=1 rev1=1 crypto rx=0x7fa8680b6630 tx=0x7fa85802aa30 comp rx=0 tx=0).stop 2024-09-17T03:47:01.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.565+0000 7fa86fb2b640 1 -- 172.21.15.146:0/4137285990 shutdown_connections 2024-09-17T03:47:01.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.565+0000 7fa86fb2b640 1 --2- 172.21.15.146:0/4137285990 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8680b45e0 0x7fa8680b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.565+0000 7fa86fb2b640 1 --2- 172.21.15.146:0/4137285990 >> v2:172.21.15.179:3300/0 conn(0x7fa8680cde80 0x7fa8680ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.565+0000 7fa86fb2b640 1 --2- 172.21.15.146:0/4137285990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa86815b8e0 0x7fa8680747b0 unknown :-1 s=CLOSED pgs=2637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.565+0000 7fa86fb2b640 1 -- 172.21.15.146:0/4137285990 >> 172.21.15.146:0/4137285990 conn(0x7fa8680b2ae0 msgr2=0x7fa8680b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:01.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.565+0000 7fa86fb2b640 1 -- 172.21.15.146:0/4137285990 shutdown_connections 2024-09-17T03:47:01.566 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.565+0000 7fa86fb2b640 1 -- 172.21.15.146:0/4137285990 wait complete. 2024-09-17T03:47:01.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.567+0000 7fa86fb2b640 1 Processor -- start 2024-09-17T03:47:01.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.567+0000 7fa86fb2b640 1 -- start start 2024-09-17T03:47:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.568+0000 7fa86fb2b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8680b45e0 0x7fa86814f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.568+0000 7fa86fb2b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8680cde80 0x7fa86814e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.568+0000 7fa86fb2b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa86815b8e0 0x7fa8681e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.568+0000 7fa86fb2b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa86806ff60 con 0x7fa8680b45e0 2024-09-17T03:47:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.568+0000 7fa86fb2b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa86806fde0 con 0x7fa86815b8e0 2024-09-17T03:47:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.568+0000 7fa86fb2b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa8680700e0 con 0x7fa8680cde80 2024-09-17T03:47:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.568+0000 7fa86d8c7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8680b45e0 0x7fa86814f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:01.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.568+0000 7fa86d8c7640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8680b45e0 0x7fa86814f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46532/0 (socket says 172.21.15.146:46532) 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.568+0000 7fa86d8c7640 1 -- 172.21.15.146:0/997561418 learned_addr learned my addr 172.21.15.146:0/997561418 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa86d0c6640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8680cde80 0x7fa86814e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa86e0c8640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa86815b8e0 0x7fa8681e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa86d8c7640 1 -- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8680cde80 msgr2=0x7fa86814e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa86d8c7640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8680cde80 0x7fa86814e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa86d8c7640 1 -- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa86815b8e0 msgr2=0x7fa8681e8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa86d8c7640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa86815b8e0 0x7fa8681e8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa86d8c7640 1 -- 172.21.15.146:0/997561418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa868152420 con 0x7fa8680b45e0 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa86e0c8640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa86815b8e0 0x7fa8681e8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa86d8c7640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8680b45e0 0x7fa86814f150 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 crypto rx=0x7fa858009d60 tx=0x7fa858003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa8667fc640 1 -- 172.21.15.146:0/997561418 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858033050 con 0x7fa8680b45e0 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa8667fc640 1 -- 172.21.15.146:0/997561418 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8580044f0 con 0x7fa8680b45e0 2024-09-17T03:47:01.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa86fb2b640 1 -- 172.21.15.146:0/997561418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa868152140 con 0x7fa8680b45e0 2024-09-17T03:47:01.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa8667fc640 1 -- 172.21.15.146:0/997561418 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858038450 con 0x7fa8680b45e0 2024-09-17T03:47:01.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.569+0000 7fa86fb2b640 1 -- 172.21.15.146:0/997561418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8680c6aa0 con 0x7fa8680b45e0 2024-09-17T03:47:01.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.570+0000 7fa86fb2b640 1 -- 172.21.15.146:0/997561418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa868070600 con 0x7fa8680b45e0 2024-09-17T03:47:01.572 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.571+0000 7fa8667fc640 1 -- 172.21.15.146:0/997561418 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa858036070 con 0x7fa8680b45e0 2024-09-17T03:47:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.571+0000 7fa8667fc640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa854078b90 0x7fa85407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.571+0000 7fa8667fc640 1 -- 172.21.15.146:0/997561418 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4943+0+0 (secure 0 0 0) 0x7fa8580bbf10 con 0x7fa8680b45e0 2024-09-17T03:47:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.572+0000 7fa86d0c6640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa854078b90 0x7fa85407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:01.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.572+0000 7fa86d0c6640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa854078b90 0x7fa85407b0a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fa8680c9ef0 tx=0x7fa85c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.576+0000 7fa8667fc640 1 -- 172.21.15.146:0/997561418 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa858084650 con 0x7fa8680b45e0 2024-09-17T03:47:01.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.751+0000 7fa86fb2b640 1 -- 172.21.15.146:0/997561418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fa868068fb0 con 0x7fa8680b45e0 2024-09-17T03:47:01.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.751+0000 7fa8667fc640 1 -- 172.21.15.146:0/997561418 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v67) ==== 59+0+2294 (secure 0 0 0) 0x7fa858083f50 con 0x7fa8680b45e0 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_client 20/20 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5505.184888 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5368.834578 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5312.580561 2024-09-17T03:47:01.752 INFO:teuthology.orchestra.run.smithi146.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7008.797503 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5511.028203 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7750.645469 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5380.679187 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5423.302254 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds 20/20 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced debug_ms 2/2 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_frag true 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:mds dev mds_verify_scatter true 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:47:01.753 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:47:01.754 INFO:teuthology.orchestra.run.smithi146.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:47:01.754 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced client_mount_timeout 600 2024-09-17T03:47:01.754 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_client 20/20 2024-09-17T03:47:01.754 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced debug_ms 1/1 2024-09-17T03:47:01.754 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:47:01.754 INFO:teuthology.orchestra.run.smithi146.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:47:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 -- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa854078b90 msgr2=0x7fa85407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa854078b90 0x7fa85407b0a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fa8680c9ef0 tx=0x7fa85c00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 -- 172.21.15.146:0/997561418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8680b45e0 msgr2=0x7fa86814f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8680b45e0 0x7fa86814f150 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 crypto rx=0x7fa858009d60 tx=0x7fa858003f10 comp rx=0 tx=0).stop 2024-09-17T03:47:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 -- 172.21.15.146:0/997561418 shutdown_connections 2024-09-17T03:47:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa854078b90 0x7fa85407b0a0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa86815b8e0 0x7fa8681e8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8680cde80 0x7fa86814e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 --2- 172.21.15.146:0/997561418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8680b45e0 0x7fa86814f150 unknown :-1 s=CLOSED pgs=2638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 -- 172.21.15.146:0/997561418 >> 172.21.15.146:0/997561418 conn(0x7fa8680b2ae0 msgr2=0x7fa868157140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:01.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 -- 172.21.15.146:0/997561418 shutdown_connections 2024-09-17T03:47:01.756 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.754+0000 7fa86fb2b640 1 -- 172.21.15.146:0/997561418 wait complete. 2024-09-17T03:47:01.765 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:47:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.882+0000 7f97444cc640 1 -- 172.21.15.146:0/2350043701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0cff50 msgr2=0x7f973c0690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.882+0000 7f97444cc640 1 --2- 172.21.15.146:0/2350043701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0cff50 0x7f973c0690b0 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f9734005fd0 tx=0x7f973402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.882+0000 7f97444cc640 1 -- 172.21.15.146:0/2350043701 shutdown_connections 2024-09-17T03:47:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.882+0000 7f97444cc640 1 --2- 172.21.15.146:0/2350043701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0cff50 0x7f973c0690b0 unknown :-1 s=CLOSED pgs=2640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.882+0000 7f97444cc640 1 --2- 172.21.15.146:0/2350043701 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f973c15fc60 0x7f973c1628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.882+0000 7f97444cc640 1 -- 172.21.15.146:0/2350043701 >> 172.21.15.146:0/2350043701 conn(0x7f973c0d4cd0 msgr2=0x7f973c0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.882+0000 7f97444cc640 1 -- 172.21.15.146:0/2350043701 shutdown_connections 2024-09-17T03:47:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.882+0000 7f97444cc640 1 -- 172.21.15.146:0/2350043701 wait complete. 2024-09-17T03:47:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.883+0000 7f97444cc640 1 Processor -- start 2024-09-17T03:47:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.884+0000 7f97444cc640 1 -- start start 2024-09-17T03:47:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f97444cc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f973c0cfb40 0x7f973c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f97444cc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0cff50 0x7f973c0ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f97444cc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f973c15fc60 0x7f973c1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f97444cc640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f973c160260 con 0x7f973c0cff50 2024-09-17T03:47:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f97444cc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f973c163040 con 0x7f973c0cfb40 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f97444cc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f973c0d3380 con 0x7f973c15fc60 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f9741a67640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0cff50 0x7f973c0ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f9741a67640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0cff50 0x7f973c0ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46542/0 (socket says 172.21.15.146:46542) 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f9741a67640 1 -- 172.21.15.146:0/3290875884 learned_addr learned my addr 172.21.15.146:0/3290875884 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f9742a69640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f973c15fc60 0x7f973c1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f9742268640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f973c0cfb40 0x7f973c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f9741a67640 1 -- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f973c15fc60 msgr2=0x7f973c1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f9741a67640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f973c15fc60 0x7f973c1586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f9741a67640 1 -- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f973c0cfb40 msgr2=0x7f973c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f9741a67640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f973c0cfb40 0x7f973c0cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f9741a67640 1 -- 172.21.15.146:0/3290875884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c15a5d0 con 0x7f973c0cff50 2024-09-17T03:47:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.885+0000 7f9741a67640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0cff50 0x7f973c0ce2e0 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7f972c00c3f0 tx=0x7f972c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.886+0000 7f9732ffd640 1 -- 172.21.15.146:0/3290875884 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c017070 con 0x7f973c0cff50 2024-09-17T03:47:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.886+0000 7f9732ffd640 1 -- 172.21.15.146:0/3290875884 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f972c0035f0 con 0x7f973c0cff50 2024-09-17T03:47:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.886+0000 7f97444cc640 1 -- 172.21.15.146:0/3290875884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973c0ce820 con 0x7f973c0cff50 2024-09-17T03:47:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.886+0000 7f9732ffd640 1 -- 172.21.15.146:0/3290875884 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c003a40 con 0x7f973c0cff50 2024-09-17T03:47:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.886+0000 7f97444cc640 1 -- 172.21.15.146:0/3290875884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973c0cc900 con 0x7f973c0cff50 2024-09-17T03:47:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.887+0000 7f97444cc640 1 -- 172.21.15.146:0/3290875884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f973c0696f0 con 0x7f973c0cff50 2024-09-17T03:47:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.887+0000 7f9732ffd640 1 -- 172.21.15.146:0/3290875884 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f972c01a070 con 0x7f973c0cff50 2024-09-17T03:47:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.888+0000 7f9732ffd640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9720078b90 0x7f972007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.888+0000 7f9732ffd640 1 -- 172.21.15.146:0/3290875884 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4943+0+0 (secure 0 0 0) 0x7f972c099c50 con 0x7f973c0cff50 2024-09-17T03:47:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.888+0000 7f9742268640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9720078b90 0x7f972007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.889+0000 7f9742268640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9720078b90 0x7f972007b0a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f9738009f20 tx=0x7f97380094f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:01.893+0000 7f9732ffd640 1 -- 172.21.15.146:0/3290875884 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f972c09f020 con 0x7f973c0cff50 2024-09-17T03:47:02.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.070+0000 7f97444cc640 1 -- 172.21.15.146:0/3290875884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f973c0cebf0 con 0x7f973c0cff50 2024-09-17T03:47:02.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.073+0000 7f9732ffd640 1 -- 172.21.15.146:0/3290875884 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v68)=0 v68) ==== 122+0+0 (secure 0 0 0) 0x7f972c0624b0 con 0x7f973c0cff50 2024-09-17T03:47:02.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 -- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9720078b90 msgr2=0x7f972007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:02.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9720078b90 0x7f972007b0a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f9738009f20 tx=0x7f97380094f0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 -- 172.21.15.146:0/3290875884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0cff50 msgr2=0x7f973c0ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:02.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0cff50 0x7f973c0ce2e0 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7f972c00c3f0 tx=0x7f972c00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 -- 172.21.15.146:0/3290875884 shutdown_connections 2024-09-17T03:47:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9720078b90 0x7f972007b0a0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f973c15fc60 0x7f973c1586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0cff50 0x7f973c0ce2e0 unknown :-1 s=CLOSED pgs=2641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 --2- 172.21.15.146:0/3290875884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f973c0cfb40 0x7f973c0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 -- 172.21.15.146:0/3290875884 >> 172.21.15.146:0/3290875884 conn(0x7f973c0d4cd0 msgr2=0x7f973c161ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 -- 172.21.15.146:0/3290875884 shutdown_connections 2024-09-17T03:47:02.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.076+0000 7f97444cc640 1 -- 172.21.15.146:0/3290875884 wait complete. 2024-09-17T03:47:02.087 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:47:02.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:47:02.128 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:47:02.170 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:47:02.170 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:47:02.170 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:47:02.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:47:02.186 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:47:02.186 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:47:02.230 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:47:02.230 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:47:02.230 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:47:02.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:47:02.246 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:47:02.246 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:47:02.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:47:02.289 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:47:02.289 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:47:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.401+0000 7f55233a8640 1 -- 172.21.15.146:0/2938315098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f551c15c040 msgr2=0x7f551c06f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.401+0000 7f55233a8640 1 --2- 172.21.15.146:0/2938315098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f551c15c040 0x7f551c06f940 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 crypto rx=0x7f5514005fd0 tx=0x7f551402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.402+0000 7f55233a8640 1 -- 172.21.15.146:0/2938315098 shutdown_connections 2024-09-17T03:47:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.402+0000 7f55233a8640 1 --2- 172.21.15.146:0/2938315098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f551c15c040 0x7f551c06f940 unknown :-1 s=CLOSED pgs=2643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.402+0000 7f55233a8640 1 --2- 172.21.15.146:0/2938315098 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c15e9c0 0x7f551c15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.402+0000 7f55233a8640 1 -- 172.21.15.146:0/2938315098 >> 172.21.15.146:0/2938315098 conn(0x7f551c0b2240 msgr2=0x7f551c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.402+0000 7f55233a8640 1 -- 172.21.15.146:0/2938315098 shutdown_connections 2024-09-17T03:47:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.402+0000 7f55233a8640 1 -- 172.21.15.146:0/2938315098 wait complete. 2024-09-17T03:47:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.403+0000 7f55233a8640 1 Processor -- start 2024-09-17T03:47:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.403+0000 7f55233a8640 1 -- start start 2024-09-17T03:47:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f55233a8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c0af890 0x7f551c1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f55233a8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551c15c040 0x7f551c14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f55233a8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f551c15e9c0 0x7f551c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f55233a8640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f551c06fe80 con 0x7f551c15e9c0 2024-09-17T03:47:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f55233a8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f551c0707d0 con 0x7f551c15c040 2024-09-17T03:47:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f55233a8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f551c070000 con 0x7f551c0af890 2024-09-17T03:47:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5521945640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f551c15e9c0 0x7f551c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5521945640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f551c15e9c0 0x7f551c15a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46560/0 (socket says 172.21.15.146:46560) 2024-09-17T03:47:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5521945640 1 -- 172.21.15.146:0/2818356143 learned_addr learned my addr 172.21.15.146:0/2818356143 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5521144640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c0af890 0x7f551c1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5520943640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551c15c040 0x7f551c14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5521945640 1 -- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c0af890 msgr2=0x7f551c1589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5521945640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c0af890 0x7f551c1589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5521945640 1 -- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551c15c040 msgr2=0x7f551c14fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5521945640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551c15c040 0x7f551c14fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5521945640 1 -- 172.21.15.146:0/2818356143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c14e070 con 0x7f551c15e9c0 2024-09-17T03:47:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5521945640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f551c15e9c0 0x7f551c15a020 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 crypto rx=0x7f5514034040 tx=0x7f55140038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5511ffb640 1 -- 172.21.15.146:0/2818356143 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551403e030 con 0x7f551c15e9c0 2024-09-17T03:47:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f5511ffb640 1 -- 172.21.15.146:0/2818356143 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5514003ca0 con 0x7f551c15e9c0 2024-09-17T03:47:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.405+0000 7f55233a8640 1 -- 172.21.15.146:0/2818356143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f551c14e350 con 0x7f551c15e9c0 2024-09-17T03:47:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.406+0000 7f5511ffb640 1 -- 172.21.15.146:0/2818356143 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514035040 con 0x7f551c15e9c0 2024-09-17T03:47:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.406+0000 7f55233a8640 1 -- 172.21.15.146:0/2818356143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f551c1580c0 con 0x7f551c15e9c0 2024-09-17T03:47:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.407+0000 7f55233a8640 1 -- 172.21.15.146:0/2818356143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f551c158320 con 0x7f551c15e9c0 2024-09-17T03:47:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.408+0000 7f5511ffb640 1 -- 172.21.15.146:0/2818356143 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5514041030 con 0x7f551c15e9c0 2024-09-17T03:47:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.408+0000 7f5511ffb640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5500078b90 0x7f550007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.408+0000 7f5511ffb640 1 -- 172.21.15.146:0/2818356143 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4943+0+0 (secure 0 0 0) 0x7f55140bb160 con 0x7f551c15e9c0 2024-09-17T03:47:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.408+0000 7f5521144640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5500078b90 0x7f550007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.409+0000 7f5521144640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5500078b90 0x7f550007b0a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5518007fd0 tx=0x7f5518009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.412+0000 7f5511ffb640 1 -- 172.21.15.146:0/2818356143 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55140837c0 con 0x7f551c15e9c0 2024-09-17T03:47:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.625+0000 7f55233a8640 1 -- 172.21.15.146:0/2818356143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f551c06f940 con 0x7f551c15e9c0 2024-09-17T03:47:02.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.625+0000 7f5511ffb640 1 -- 172.21.15.146:0/2818356143 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 156 v156) ==== 95+0+3923 (secure 0 0 0) 0x7f55140830c0 con 0x7f551c15e9c0 2024-09-17T03:47:02.625 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:02.626 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":156,"btime":"2024-09-17T03:46:56:404042+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2786459468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2786459468},{"type":"v1","addr":"172.21.15.179:6837","nonce":2786459468}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/35044870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":35044870},{"type":"v1","addr":"172.21.15.146:6835","nonce":35044870}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":9892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/4262340236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":4262340236},{"type":"v1","addr":"172.21.15.179:6836","nonce":4262340236}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":149},{"gid":11754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/1940134808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1940134808},{"type":"v1","addr":"172.21.15.146:6833","nonce":1940134808}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":156}],"filesystems":[]} 2024-09-17T03:47:02.626 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 156 2024-09-17T03:47:02.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 -- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5500078b90 msgr2=0x7f550007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:02.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5500078b90 0x7f550007b0a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5518007fd0 tx=0x7f5518009040 comp rx=0 tx=0).stop 2024-09-17T03:47:02.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 -- 172.21.15.146:0/2818356143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f551c15e9c0 msgr2=0x7f551c15a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:02.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f551c15e9c0 0x7f551c15a020 secure :-1 s=READY pgs=2644 cs=0 l=1 rev1=1 crypto rx=0x7f5514034040 tx=0x7f55140038a0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 -- 172.21.15.146:0/2818356143 shutdown_connections 2024-09-17T03:47:02.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5500078b90 0x7f550007b0a0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f551c15e9c0 0x7f551c15a020 unknown :-1 s=CLOSED pgs=2644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f551c15c040 0x7f551c14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 --2- 172.21.15.146:0/2818356143 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f551c0af890 0x7f551c1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 -- 172.21.15.146:0/2818356143 >> 172.21.15.146:0/2818356143 conn(0x7f551c0b2240 msgr2=0x7f551c14f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:02.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 -- 172.21.15.146:0/2818356143 shutdown_connections 2024-09-17T03:47:02.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.627+0000 7f55233a8640 1 -- 172.21.15.146:0/2818356143 wait complete. 2024-09-17T03:47:02.639 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:47:02.639 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:47:02.639 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:47:02.640 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:47:02.640 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:47:02.640 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:47:02.640 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:47:02.640 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:47:02.640 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:47:02.640 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:47:02.641 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:47:02.641 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:47:02.641 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:47:02.641 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:47:02.641 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:47:02.641 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:47:02.650 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:47:02.650 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:47:02.652 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:47:02.653 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:47:02.653 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:47:02.653 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:47:02.654 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:47:02.654 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:47:02.665 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:47:02.665 DEBUG:teuthology.parallel:result is None 2024-09-17T03:47:02.668 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:47:02.668 DEBUG:teuthology.parallel:result is None 2024-09-17T03:47:02.697 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:47:02.698 DEBUG:teuthology.parallel:result is None 2024-09-17T03:47:02.700 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:47:02.700 DEBUG:teuthology.parallel:result is None 2024-09-17T03:47:02.700 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:47:02.750 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2024-09-17T03:47:02.752 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:47:02.792 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-09-17T03:47:02.792 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:47:02.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.821+0000 7ff866c20640 1 -- 172.21.15.146:0/3565562813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86015f5a0 msgr2=0x7ff86015f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:02.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.821+0000 7ff866c20640 1 --2- 172.21.15.146:0/3565562813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86015f5a0 0x7ff86015f9b0 secure :-1 s=READY pgs=2653 cs=0 l=1 rev1=1 crypto rx=0x7ff84c005fd0 tx=0x7ff84c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.821 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.821+0000 7ff866c20640 1 -- 172.21.15.146:0/3565562813 shutdown_connections 2024-09-17T03:47:02.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.821+0000 7ff866c20640 1 --2- 172.21.15.146:0/3565562813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86015f5a0 0x7ff86015f9b0 unknown :-1 s=CLOSED pgs=2653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.821+0000 7ff866c20640 1 --2- 172.21.15.146:0/3565562813 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff860070020 0x7ff86015ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.821+0000 7ff866c20640 1 -- 172.21.15.146:0/3565562813 >> 172.21.15.146:0/3565562813 conn(0x7ff8600b2790 msgr2=0x7ff8600d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:02.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.821+0000 7ff866c20640 1 -- 172.21.15.146:0/3565562813 shutdown_connections 2024-09-17T03:47:02.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.821+0000 7ff866c20640 1 -- 172.21.15.146:0/3565562813 wait complete. 2024-09-17T03:47:02.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.823+0000 7ff866c20640 1 Processor -- start 2024-09-17T03:47:02.822 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.823+0000 7ff866c20640 1 -- start start 2024-09-17T03:47:02.825 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.824+0000 7ff866c20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff860070020 0x7ff860147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.824+0000 7ff866c20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff86015f5a0 0x7ff8600ab550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.824+0000 7ff866c20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86015fef0 0x7ff8600ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.824+0000 7ff866c20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8600cf700 con 0x7ff86015fef0 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.824+0000 7ff866c20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff86006f6b0 con 0x7ff86015f5a0 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.824+0000 7ff866c20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff8600cf880 con 0x7ff860070020 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.824+0000 7ff8651bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86015fef0 0x7ff8600ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.824+0000 7ff8649bc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff860070020 0x7ff860147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.824+0000 7ff8651bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86015fef0 0x7ff8600ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46620/0 (socket says 172.21.15.146:46620) 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.824+0000 7ff8651bd640 1 -- 172.21.15.146:0/3842737691 learned_addr learned my addr 172.21.15.146:0/3842737691 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.824+0000 7ff85ffff640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff86015f5a0 0x7ff8600ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff85ffff640 1 -- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff860070020 msgr2=0x7ff860147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff85ffff640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff860070020 0x7ff860147f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff85ffff640 1 -- 172.21.15.146:0/3842737691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86015fef0 msgr2=0x7ff8600ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:02.826 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff85ffff640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86015fef0 0x7ff8600ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:02.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff85ffff640 1 -- 172.21.15.146:0/3842737691 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff860148490 con 0x7ff86015f5a0 2024-09-17T03:47:02.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff8649bc640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff860070020 0x7ff860147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:47:02.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff85ffff640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff86015f5a0 0x7ff8600ab550 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff84c031000 tx=0x7ff84c0035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:02.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff85d7fa640 1 -- 172.21.15.146:0/3842737691 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c03e030 con 0x7ff86015f5a0 2024-09-17T03:47:02.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff85d7fa640 1 -- 172.21.15.146:0/3842737691 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff84c003b00 con 0x7ff86015f5a0 2024-09-17T03:47:02.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff866c20640 1 -- 172.21.15.146:0/3842737691 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8601f3e10 con 0x7ff86015f5a0 2024-09-17T03:47:02.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff85d7fa640 1 -- 172.21.15.146:0/3842737691 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c035040 con 0x7ff86015f5a0 2024-09-17T03:47:02.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.825+0000 7ff866c20640 1 -- 172.21.15.146:0/3842737691 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8601f43d0 con 0x7ff86015f5a0 2024-09-17T03:47:02.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.826+0000 7ff866c20640 1 -- 172.21.15.146:0/3842737691 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff86006fde0 con 0x7ff86015f5a0 2024-09-17T03:47:02.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.827+0000 7ff85d7fa640 1 -- 172.21.15.146:0/3842737691 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff84c041030 con 0x7ff86015f5a0 2024-09-17T03:47:02.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.827+0000 7ff85d7fa640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff844078b90 0x7ff84407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:02.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.827+0000 7ff85d7fa640 1 -- 172.21.15.146:0/3842737691 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4943+0+0 (secure 0 0 0) 0x7ff84c0bae80 con 0x7ff86015f5a0 2024-09-17T03:47:02.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.827+0000 7ff8649bc640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff844078b90 0x7ff84407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:02.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.828+0000 7ff8649bc640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff844078b90 0x7ff84407b0a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff854009f20 tx=0x7ff854005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:02.832 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:02.832+0000 7ff85d7fa640 1 -- 172.21.15.146:0/3842737691 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff86006fde0 con 0x7ff86015f5a0 2024-09-17T03:47:03.018 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.018+0000 7ff866c20640 1 -- 172.21.15.146:0/3842737691 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff8600cfda0 con 0x7ff86015f5a0 2024-09-17T03:47:03.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.461+0000 7ff85d7fa640 1 -- 172.21.15.146:0/3842737691 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v204) ==== 97+0+0 (secure 0 0 0) 0x7ff84c082f50 con 0x7ff86015f5a0 2024-09-17T03:47:03.461 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2024-09-17T03:47:03.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 -- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff844078b90 msgr2=0x7ff84407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff844078b90 0x7ff84407b0a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff854009f20 tx=0x7ff854005f90 comp rx=0 tx=0).stop 2024-09-17T03:47:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 -- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff86015f5a0 msgr2=0x7ff8600ab550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff86015f5a0 0x7ff8600ab550 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff84c031000 tx=0x7ff84c0035f0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 -- 172.21.15.146:0/3842737691 shutdown_connections 2024-09-17T03:47:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff844078b90 0x7ff84407b0a0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff86015fef0 0x7ff8600ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff86015f5a0 0x7ff8600ab550 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 --2- 172.21.15.146:0/3842737691 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff860070020 0x7ff860147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 -- 172.21.15.146:0/3842737691 >> 172.21.15.146:0/3842737691 conn(0x7ff8600b2790 msgr2=0x7ff8600b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 -- 172.21.15.146:0/3842737691 shutdown_connections 2024-09-17T03:47:03.464 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.463+0000 7ff866c20640 1 -- 172.21.15.146:0/3842737691 wait complete. 2024-09-17T03:47:03.476 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:47:03.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.588+0000 7fb520425640 1 -- 172.21.15.146:0/2546630791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5180d2800 msgr2=0x7fb5180d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:03.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.588+0000 7fb520425640 1 --2- 172.21.15.146:0/2546630791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5180d2800 0x7fb5180d1300 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb514009830 tx=0x7fb51402a510 comp rx=0 tx=0).stop 2024-09-17T03:47:03.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.588+0000 7fb520425640 1 -- 172.21.15.146:0/2546630791 shutdown_connections 2024-09-17T03:47:03.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.588+0000 7fb520425640 1 --2- 172.21.15.146:0/2546630791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5180d4420 0x7fb5180d1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.588+0000 7fb520425640 1 --2- 172.21.15.146:0/2546630791 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5180d2800 0x7fb5180d1300 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.588+0000 7fb520425640 1 -- 172.21.15.146:0/2546630791 >> 172.21.15.146:0/2546630791 conn(0x7fb51806ecd0 msgr2=0x7fb51806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.588+0000 7fb520425640 1 -- 172.21.15.146:0/2546630791 shutdown_connections 2024-09-17T03:47:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.588+0000 7fb520425640 1 -- 172.21.15.146:0/2546630791 wait complete. 2024-09-17T03:47:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.590+0000 7fb520425640 1 Processor -- start 2024-09-17T03:47:03.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.590+0000 7fb520425640 1 -- start start 2024-09-17T03:47:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.591+0000 7fb520425640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5180cf150 0x7fb518161af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.591+0000 7fb520425640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5180d2800 0x7fb518152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.591+0000 7fb520425640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5180d4420 0x7fb5180ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.591+0000 7fb520425640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb5180b6a80 con 0x7fb5180d2800 2024-09-17T03:47:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.591+0000 7fb520425640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb51815f110 con 0x7fb5180cf150 2024-09-17T03:47:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.591+0000 7fb520425640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb5180b6c00 con 0x7fb5180d4420 2024-09-17T03:47:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51d9c0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5180d2800 0x7fb518152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51d9c0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5180d2800 0x7fb518152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46626/0 (socket says 172.21.15.146:46626) 2024-09-17T03:47:03.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51d9c0640 1 -- 172.21.15.146:0/72346116 learned_addr learned my addr 172.21.15.146:0/72346116 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51e9c2640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5180d4420 0x7fb5180ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51e1c1640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5180cf150 0x7fb518161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51d9c0640 1 -- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5180d4420 msgr2=0x7fb5180ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51d9c0640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5180d4420 0x7fb5180ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51d9c0640 1 -- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5180cf150 msgr2=0x7fb518161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51d9c0640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5180cf150 0x7fb518161af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51d9c0640 1 -- 172.21.15.146:0/72346116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5181f5f00 con 0x7fb5180d2800 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51e9c2640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5180d4420 0x7fb5180ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb51d9c0640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5180d2800 0x7fb518152170 secure :-1 s=READY pgs=2654 cs=0 l=1 rev1=1 crypto rx=0x7fb50800c410 tx=0x7fb50800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb50effd640 1 -- 172.21.15.146:0/72346116 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508011790 con 0x7fb5180d2800 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb520425640 1 -- 172.21.15.146:0/72346116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5181f61e0 con 0x7fb5180d2800 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb50effd640 1 -- 172.21.15.146:0/72346116 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb508017070 con 0x7fb5180d2800 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb50effd640 1 -- 172.21.15.146:0/72346116 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508011ce0 con 0x7fb5180d2800 2024-09-17T03:47:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.592+0000 7fb520425640 1 -- 172.21.15.146:0/72346116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5181f67a0 con 0x7fb5180d2800 2024-09-17T03:47:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.593+0000 7fb520425640 1 -- 172.21.15.146:0/72346116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5180d0f80 con 0x7fb5180d2800 2024-09-17T03:47:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.594+0000 7fb50effd640 1 -- 172.21.15.146:0/72346116 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb50801c460 con 0x7fb5180d2800 2024-09-17T03:47:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.595+0000 7fb50effd640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb4fc078b90 0x7fb4fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.595+0000 7fb50effd640 1 -- 172.21.15.146:0/72346116 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 4857+0+0 (secure 0 0 0) 0x7fb50809a8e0 con 0x7fb5180d2800 2024-09-17T03:47:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.595+0000 7fb51e1c1640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb4fc078b90 0x7fb4fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.596+0000 7fb51e1c1640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb4fc078b90 0x7fb4fc07b0a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fb514034000 tx=0x7fb514004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:03.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.599+0000 7fb50effd640 1 -- 172.21.15.146:0/72346116 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb5180d0f80 con 0x7fb5180d2800 2024-09-17T03:47:03.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.838+0000 7fb520425640 1 -- 172.21.15.146:0/72346116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb5180b6370 con 0x7fb5180d2800 2024-09-17T03:47:03.838 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.838+0000 7fb50effd640 1 -- 172.21.15.146:0/72346116 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) ==== 80+0+5304 (secure 0 0 0) 0x7fb5080630b0 con 0x7fb5180d2800 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmoBSGMBAAun9pdX8uP7SDxfMWvM2B8g==", 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.839 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohm4FkIAhAADSHU+djtyvku80pgUAixeQ==", 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.840 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohma35FOBAAaI8b9tLuGcNEb7zVDZlJTg==", 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmTeC/CRAAWD8f8MiB+zj+Qlq92ADARw==", 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.841 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAy+OhmeImaJhAA56qlW1IJIPwKqpWKfVdIBA==", 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA2+Ohm8Bx7CxAAhOp6F5J/fOnQc3QdKxnNkA==", 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA5+OhmcT7mHRAAD3vbMZt/K5zna3ChJbsOPg==", 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.843 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:47:03.844 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:47:03.844 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.844 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.844 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.844 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2024-09-17T03:47:03.844 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQA9+Ohm71qwAhAAuv6Df0zJogfIvRehOTiIRA==", 2024-09-17T03:47:03.844 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.844 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBD+Ohm50d9DBAAY8e9wJg6v3bjvo0limWVww==", 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.845 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBG+OhmWqtpHhAAR7Axz8P2UZgMoub8+iLV3A==", 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBJ+Ohm3cYSIRAAa/UkUJx0kSbYsH/jkzmcUg==", 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:47:03.846 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQBN+OhmYFQRBhAA+UUVLb0O0UzbuYazUy9E0w==", 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.847 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw==", 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmAs02FhAAAOBV90dhlR+5ml3txTY0Ig==", 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:47:03.848 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:47:03.849 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:47:03.849 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:47:03.849 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.849 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.849 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2024-09-17T03:47:03.849 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmaytqEhAAJDo8G2bal1RtnhxFZ4EPgg==", 2024-09-17T03:47:03.849 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.850 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:47:03.850 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:47:03.850 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:47:03.850 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:47:03.850 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.850 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.850 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2024-09-17T03:47:03.850 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAv+OhmLzP7GRAA3MQs83QPeFFXvle68VIHzA==", 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+OhmX8dkExAA7R54s6CxCW9tcdA8/enE6w==", 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2024-09-17T03:47:03.851 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2024-09-17T03:47:03.852 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.852 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.852 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.852 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2024-09-17T03:47:03.852 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohm2WSvLBAAvBZJAwbJioY/YJtTEF5gMg==", 2024-09-17T03:47:03.852 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.852 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:47:03.852 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:47:03.852 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.852 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:03.853 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:03.853 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2024-09-17T03:47:03.853 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQAu+Ohmvl2ZKBAAEp0pnAOkFnMIxq2x+EiqkQ==", 2024-09-17T03:47:03.853 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2024-09-17T03:47:03.853 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2024-09-17T03:47:03.853 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2024-09-17T03:47:03.853 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2024-09-17T03:47:03.853 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.853 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:03.853 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2024-09-17T03:47:03.854 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:47:03.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.840+0000 7fb520425640 1 -- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb4fc078b90 msgr2=0x7fb4fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:03.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.840+0000 7fb520425640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb4fc078b90 0x7fb4fc07b0a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fb514034000 tx=0x7fb514004730 comp rx=0 tx=0).stop 2024-09-17T03:47:03.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.840+0000 7fb520425640 1 -- 172.21.15.146:0/72346116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5180d2800 msgr2=0x7fb518152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:03.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.840+0000 7fb520425640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5180d2800 0x7fb518152170 secure :-1 s=READY pgs=2654 cs=0 l=1 rev1=1 crypto rx=0x7fb50800c410 tx=0x7fb50800c8d0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.840+0000 7fb520425640 1 -- 172.21.15.146:0/72346116 shutdown_connections 2024-09-17T03:47:03.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.840+0000 7fb520425640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb4fc078b90 0x7fb4fc07b0a0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.840+0000 7fb520425640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb5180d4420 0x7fb5180ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.840+0000 7fb520425640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5180d2800 0x7fb518152170 unknown :-1 s=CLOSED pgs=2654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.840+0000 7fb520425640 1 --2- 172.21.15.146:0/72346116 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb5180cf150 0x7fb518161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.840+0000 7fb520425640 1 -- 172.21.15.146:0/72346116 >> 172.21.15.146:0/72346116 conn(0x7fb51806ecd0 msgr2=0x7fb5180b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:03.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.841+0000 7fb520425640 1 -- 172.21.15.146:0/72346116 shutdown_connections 2024-09-17T03:47:03.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.841+0000 7fb520425640 1 -- 172.21.15.146:0/72346116 wait complete. 2024-09-17T03:47:03.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:47:03.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.969+0000 7f39e5369640 1 -- 172.21.15.146:0/3521429321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39e0069940 msgr2=0x7f39e00cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:03.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.969+0000 7f39e5369640 1 --2- 172.21.15.146:0/3521429321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39e0069940 0x7f39e00cf3c0 secure :-1 s=READY pgs=2655 cs=0 l=1 rev1=1 crypto rx=0x7f39e00d0520 tx=0x7f39d402a560 comp rx=0 tx=0).stop 2024-09-17T03:47:03.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.970+0000 7f39e5369640 1 -- 172.21.15.146:0/3521429321 shutdown_connections 2024-09-17T03:47:03.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.970+0000 7f39e5369640 1 --2- 172.21.15.146:0/3521429321 >> v2:172.21.15.179:3300/0 conn(0x7f39e00d3200 0x7f39e00d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.970+0000 7f39e5369640 1 --2- 172.21.15.146:0/3521429321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39e0069940 0x7f39e00cf3c0 unknown :-1 s=CLOSED pgs=2655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.970 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.970+0000 7f39e5369640 1 -- 172.21.15.146:0/3521429321 >> 172.21.15.146:0/3521429321 conn(0x7f39e00d1770 msgr2=0x7f39e00d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.970+0000 7f39e5369640 1 -- 172.21.15.146:0/3521429321 shutdown_connections 2024-09-17T03:47:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.970+0000 7f39e5369640 1 -- 172.21.15.146:0/3521429321 wait complete. 2024-09-17T03:47:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.972+0000 7f39e5369640 1 Processor -- start 2024-09-17T03:47:03.971 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.972+0000 7f39e5369640 1 -- start start 2024-09-17T03:47:03.974 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39e5369640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39e00d3200 0x7f39e01f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:03.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39e5369640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39e015edf0 0x7f39e0154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:03.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39e5369640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39e0154bd0 0x7f39e00b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:03.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39e5369640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f39e00d3b50 con 0x7f39e00d3200 2024-09-17T03:47:03.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39e5369640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f39e00b3b10 con 0x7f39e015edf0 2024-09-17T03:47:03.975 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39e5369640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f39e00d3cd0 con 0x7f39e0154bd0 2024-09-17T03:47:03.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39deffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39e00d3200 0x7f39e01f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:03.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39deffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39e00d3200 0x7f39e01f6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46646/0 (socket says 172.21.15.146:46646) 2024-09-17T03:47:03.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39deffd640 1 -- 172.21.15.146:0/2989307619 learned_addr learned my addr 172.21.15.146:0/2989307619 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:03.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39de7fc640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39e015edf0 0x7f39e0154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:03.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39df7fe640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39e0154bd0 0x7f39e00b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:03.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39deffd640 1 -- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39e0154bd0 msgr2=0x7f39e00b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:03.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39deffd640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39e0154bd0 0x7f39e00b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39deffd640 1 -- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39e015edf0 msgr2=0x7f39e0154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:03.976 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39deffd640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39e015edf0 0x7f39e0154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39deffd640 1 -- 172.21.15.146:0/2989307619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e01f7290 con 0x7f39e00d3200 2024-09-17T03:47:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.973+0000 7f39deffd640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39e00d3200 0x7f39e01f6d50 secure :-1 s=READY pgs=2656 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c370 tx=0x7f39d000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.974+0000 7f39c77fe640 1 -- 172.21.15.146:0/2989307619 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0017070 con 0x7f39e00d3200 2024-09-17T03:47:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.974+0000 7f39c77fe640 1 -- 172.21.15.146:0/2989307619 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39d00053c0 con 0x7f39e00d3200 2024-09-17T03:47:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.974+0000 7f39e5369640 1 -- 172.21.15.146:0/2989307619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e0160b10 con 0x7f39e00d3200 2024-09-17T03:47:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.974+0000 7f39c77fe640 1 -- 172.21.15.146:0/2989307619 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0003850 con 0x7f39e00d3200 2024-09-17T03:47:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.974+0000 7f39e5369640 1 -- 172.21.15.146:0/2989307619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e00ce6f0 con 0x7f39e00d3200 2024-09-17T03:47:03.977 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.975+0000 7f39e5369640 1 -- 172.21.15.146:0/2989307619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e00d5a20 con 0x7f39e00d3200 2024-09-17T03:47:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.975+0000 7f39c77fe640 1 -- 172.21.15.146:0/2989307619 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39d001a070 con 0x7f39e00d3200 2024-09-17T03:47:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.976+0000 7f39c77fe640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f39cc078bc0 0x7f39cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.976+0000 7f39c77fe640 1 -- 172.21.15.146:0/2989307619 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 4857+0+0 (secure 0 0 0) 0x7f39d0099d20 con 0x7f39e00d3200 2024-09-17T03:47:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.976+0000 7f39de7fc640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f39cc078bc0 0x7f39cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:03.978 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.977+0000 7f39de7fc640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f39cc078bc0 0x7f39cc07b0d0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f39d4033000 tx=0x7f39d4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:03.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:03.981+0000 7f39c77fe640 1 -- 172.21.15.146:0/2989307619 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39e00d5a20 con 0x7f39e00d3200 2024-09-17T03:47:04.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.159+0000 7f39e5369640 1 -- 172.21.15.146:0/2989307619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f39e015e480 con 0x7f39e00d3200 2024-09-17T03:47:04.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.160+0000 7f39c77fe640 1 -- 172.21.15.146:0/2989307619 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v206) ==== 84+0+65 (secure 0 0 0) 0x7f39e01f7290 con 0x7f39e00d3200 2024-09-17T03:47:04.160 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:04.160 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2024-09-17T03:47:04.160 INFO:teuthology.orchestra.run.smithi146.stdout: { 2024-09-17T03:47:04.160 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2024-09-17T03:47:04.160 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2024-09-17T03:47:04.160 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:04.160 INFO:teuthology.orchestra.run.smithi146.stdout:] 2024-09-17T03:47:04.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 -- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f39cc078bc0 msgr2=0x7f39cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:04.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f39cc078bc0 0x7f39cc07b0d0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f39d4033000 tx=0x7f39d4004730 comp rx=0 tx=0).stop 2024-09-17T03:47:04.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 -- 172.21.15.146:0/2989307619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39e00d3200 msgr2=0x7f39e01f6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:04.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39e00d3200 0x7f39e01f6d50 secure :-1 s=READY pgs=2656 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c370 tx=0x7f39d000c830 comp rx=0 tx=0).stop 2024-09-17T03:47:04.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 -- 172.21.15.146:0/2989307619 shutdown_connections 2024-09-17T03:47:04.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f39cc078bc0 0x7f39cc07b0d0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:04.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f39e0154bd0 0x7f39e00b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:04.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f39e015edf0 0x7f39e0154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:04.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 --2- 172.21.15.146:0/2989307619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39e00d3200 0x7f39e01f6d50 unknown :-1 s=CLOSED pgs=2656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:04.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 -- 172.21.15.146:0/2989307619 >> 172.21.15.146:0/2989307619 conn(0x7f39e00d1770 msgr2=0x7f39e015ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:04.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 -- 172.21.15.146:0/2989307619 shutdown_connections 2024-09-17T03:47:04.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.162+0000 7f39e5369640 1 -- 172.21.15.146:0/2989307619 wait complete. 2024-09-17T03:47:04.173 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:47:04.174 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:47:04.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.291+0000 7fd8ea339640 1 -- 172.21.15.146:0/58737366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc005300 msgr2=0x7fd8cc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:04.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.291+0000 7fd8ea339640 1 --2- 172.21.15.146:0/58737366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc005300 0x7fd8cc00b9c0 secure :-1 s=READY pgs=2658 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc001dc0 tx=0x7fd8cc005830 comp rx=0 tx=0).stop 2024-09-17T03:47:04.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.291+0000 7fd8ea339640 1 -- 172.21.15.146:0/58737366 shutdown_connections 2024-09-17T03:47:04.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.291+0000 7fd8ea339640 1 --2- 172.21.15.146:0/58737366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc005300 0x7fd8cc00b9c0 unknown :-1 s=CLOSED pgs=2658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:04.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.291+0000 7fd8ea339640 1 -- 172.21.15.146:0/58737366 >> 172.21.15.146:0/58737366 conn(0x7fd8e406de90 msgr2=0x7fd8e406e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:04.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.291+0000 7fd8ea339640 1 -- 172.21.15.146:0/58737366 shutdown_connections 2024-09-17T03:47:04.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.291+0000 7fd8ea339640 1 -- 172.21.15.146:0/58737366 wait complete. 2024-09-17T03:47:04.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.292+0000 7fd8ea339640 1 Processor -- start 2024-09-17T03:47:04.292 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.293+0000 7fd8ea339640 1 -- start start 2024-09-17T03:47:04.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8ea339640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc005300 0x7fd8e4152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:04.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8ea339640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e41f9370 0x7fd8e4159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:04.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8ea339640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e40b3e40 0x7fd8e415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:04.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8ea339640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e406cfe0 con 0x7fd8cc005300 2024-09-17T03:47:04.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8ea339640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e406ce60 con 0x7fd8e40b3e40 2024-09-17T03:47:04.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8ea339640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e406d160 con 0x7fd8e41f9370 2024-09-17T03:47:04.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8e3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc005300 0x7fd8e4152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:04.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8e3fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc005300 0x7fd8e4152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46666/0 (socket says 172.21.15.146:46666) 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8e3fff640 1 -- 172.21.15.146:0/3448240845 learned_addr learned my addr 172.21.15.146:0/3448240845 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8e37fe640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e41f9370 0x7fd8e4159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8e88d6640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e40b3e40 0x7fd8e415a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8e3fff640 1 -- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e41f9370 msgr2=0x7fd8e4159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8e3fff640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e41f9370 0x7fd8e4159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8e3fff640 1 -- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e40b3e40 msgr2=0x7fd8e415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8e3fff640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e40b3e40 0x7fd8e415a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.294+0000 7fd8e3fff640 1 -- 172.21.15.146:0/3448240845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e41578d0 con 0x7fd8cc005300 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.295+0000 7fd8e3fff640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc005300 0x7fd8e4152140 secure :-1 s=READY pgs=2659 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4000fb0 tx=0x7fd8d400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.295+0000 7fd8e0ff9640 1 -- 172.21.15.146:0/3448240845 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4015020 con 0x7fd8cc005300 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.295+0000 7fd8e0ff9640 1 -- 172.21.15.146:0/3448240845 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8d400ca00 con 0x7fd8cc005300 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.295+0000 7fd8ea339640 1 -- 172.21.15.146:0/3448240845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e4158300 con 0x7fd8cc005300 2024-09-17T03:47:04.296 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.295+0000 7fd8e0ff9640 1 -- 172.21.15.146:0/3448240845 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400ce10 con 0x7fd8cc005300 2024-09-17T03:47:04.297 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.295+0000 7fd8ea339640 1 -- 172.21.15.146:0/3448240845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e4157e50 con 0x7fd8cc005300 2024-09-17T03:47:04.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.296+0000 7fd8ea339640 1 -- 172.21.15.146:0/3448240845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e40b0a90 con 0x7fd8cc005300 2024-09-17T03:47:04.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.296+0000 7fd8e0ff9640 1 -- 172.21.15.146:0/3448240845 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8d4018020 con 0x7fd8cc005300 2024-09-17T03:47:04.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.297+0000 7fd8e0ff9640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d0078b90 0x7fd8d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:04.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.297+0000 7fd8e0ff9640 1 -- 172.21.15.146:0/3448240845 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 4857+0+0 (secure 0 0 0) 0x7fd8d409ad20 con 0x7fd8cc005300 2024-09-17T03:47:04.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.297+0000 7fd8e37fe640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d0078b90 0x7fd8d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:04.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.298+0000 7fd8e37fe640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d0078b90 0x7fd8d007b0a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800db30 tx=0x7fd8d800d2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:04.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.301+0000 7fd8e0ff9640 1 -- 172.21.15.146:0/3448240845 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd8d401f020 con 0x7fd8cc005300 2024-09-17T03:47:04.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:04.479+0000 7fd8ea339640 1 -- 172.21.15.146:0/3448240845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd8e40714a0 con 0x7fd8cc005300 2024-09-17T03:47:05.476 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.476+0000 7fd8e0ff9640 1 -- 172.21.15.146:0/3448240845 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v207) ==== 138+0+0 (secure 0 0 0) 0x7fd8d4062ef0 con 0x7fd8cc005300 2024-09-17T03:47:05.476 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2024-09-17T03:47:05.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 -- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d0078b90 msgr2=0x7fd8d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:05.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d0078b90 0x7fd8d007b0a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800db30 tx=0x7fd8d800d2e0 comp rx=0 tx=0).stop 2024-09-17T03:47:05.479 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 -- 172.21.15.146:0/3448240845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc005300 msgr2=0x7fd8e4152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:05.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc005300 0x7fd8e4152140 secure :-1 s=READY pgs=2659 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4000fb0 tx=0x7fd8d400ea70 comp rx=0 tx=0).stop 2024-09-17T03:47:05.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 -- 172.21.15.146:0/3448240845 shutdown_connections 2024-09-17T03:47:05.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd8d0078b90 0x7fd8d007b0a0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:05.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8e40b3e40 0x7fd8e415a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:05.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd8e41f9370 0x7fd8e4159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:05.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 --2- 172.21.15.146:0/3448240845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8cc005300 0x7fd8e4152140 unknown :-1 s=CLOSED pgs=2659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:05.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 -- 172.21.15.146:0/3448240845 >> 172.21.15.146:0/3448240845 conn(0x7fd8e406de90 msgr2=0x7fd8e406e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:05.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 -- 172.21.15.146:0/3448240845 shutdown_connections 2024-09-17T03:47:05.480 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.479+0000 7fd8ea339640 1 -- 172.21.15.146:0/3448240845 wait complete. 2024-09-17T03:47:05.497 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:47:05.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.623+0000 7f53cc6a9640 1 -- 172.21.15.146:0/3289608077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40cd830 msgr2=0x7f53c40cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:05.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.623+0000 7f53cc6a9640 1 --2- 172.21.15.146:0/3289608077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40cd830 0x7f53c40cdc40 secure :-1 s=READY pgs=2661 cs=0 l=1 rev1=1 crypto rx=0x7f53b4005fd0 tx=0x7f53b402a670 comp rx=0 tx=0).stop 2024-09-17T03:47:05.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.623+0000 7f53cc6a9640 1 -- 172.21.15.146:0/3289608077 shutdown_connections 2024-09-17T03:47:05.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.623+0000 7f53cc6a9640 1 --2- 172.21.15.146:0/3289608077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40cd830 0x7f53c40cdc40 unknown :-1 s=CLOSED pgs=2661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:05.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.623+0000 7f53cc6a9640 1 -- 172.21.15.146:0/3289608077 >> 172.21.15.146:0/3289608077 conn(0x7f53c40d2650 msgr2=0x7f53c40d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:05.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.623+0000 7f53cc6a9640 1 -- 172.21.15.146:0/3289608077 shutdown_connections 2024-09-17T03:47:05.624 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.623+0000 7f53cc6a9640 1 -- 172.21.15.146:0/3289608077 wait complete. 2024-09-17T03:47:05.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.625+0000 7f53cc6a9640 1 Processor -- start 2024-09-17T03:47:05.625 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.625+0000 7f53cc6a9640 1 -- start start 2024-09-17T03:47:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.626+0000 7f53cc6a9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c4070db0 0x7f53c415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.626+0000 7f53cc6a9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c40b1c20 0x7f53c409fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.626+0000 7f53cc6a9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40cd830 0x7f53c409ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.626+0000 7f53cc6a9640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f53c4071a50 con 0x7f53c40cd830 2024-09-17T03:47:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.626+0000 7f53cc6a9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40718d0 con 0x7f53c40b1c20 2024-09-17T03:47:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.626+0000 7f53cc6a9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f53c4071bd0 con 0x7f53c4070db0 2024-09-17T03:47:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53cac46640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40cd830 0x7f53c409ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53cac46640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40cd830 0x7f53c409ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46690/0 (socket says 172.21.15.146:46690) 2024-09-17T03:47:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53cac46640 1 -- 172.21.15.146:0/4020360184 learned_addr learned my addr 172.21.15.146:0/4020360184 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53ca445640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c4070db0 0x7f53c415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53c9c44640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c40b1c20 0x7f53c409fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:05.628 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53cac46640 1 -- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c4070db0 msgr2=0x7f53c415a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:05.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53cac46640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c4070db0 0x7f53c415a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:05.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53cac46640 1 -- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c40b1c20 msgr2=0x7f53c409fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:05.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53cac46640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c40b1c20 0x7f53c409fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:05.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53cac46640 1 -- 172.21.15.146:0/4020360184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c40c8f60 con 0x7f53c40cd830 2024-09-17T03:47:05.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53cac46640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40cd830 0x7f53c409ffa0 secure :-1 s=READY pgs=2662 cs=0 l=1 rev1=1 crypto rx=0x7f53bc002230 tx=0x7f53bc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:05.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53baffd640 1 -- 172.21.15.146:0/4020360184 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc003b70 con 0x7f53c40cd830 2024-09-17T03:47:05.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53baffd640 1 -- 172.21.15.146:0/4020360184 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53bc003d10 con 0x7f53c40cd830 2024-09-17T03:47:05.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53baffd640 1 -- 172.21.15.146:0/4020360184 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc005330 con 0x7f53c40cd830 2024-09-17T03:47:05.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53cc6a9640 1 -- 172.21.15.146:0/4020360184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c415e370 con 0x7f53c40cd830 2024-09-17T03:47:05.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.627+0000 7f53cc6a9640 1 -- 172.21.15.146:0/4020360184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c40cc300 con 0x7f53c40cd830 2024-09-17T03:47:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.628+0000 7f53cc6a9640 1 -- 172.21.15.146:0/4020360184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c40c9130 con 0x7f53c40cd830 2024-09-17T03:47:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.629+0000 7f53baffd640 1 -- 172.21.15.146:0/4020360184 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f53bc0056e0 con 0x7f53c40cd830 2024-09-17T03:47:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.629+0000 7f53baffd640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f53a8078b90 0x7f53a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.630+0000 7f53baffd640 1 -- 172.21.15.146:0/4020360184 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5227+0+0 (secure 0 0 0) 0x7f53bc09a8f0 con 0x7f53c40cd830 2024-09-17T03:47:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.630+0000 7f53ca445640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f53a8078b90 0x7f53a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.630+0000 7f53ca445640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f53a8078b90 0x7f53a807b0a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f53c0000f60 tx=0x7f53c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:05.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.634+0000 7f53baffd640 1 -- 172.21.15.146:0/4020360184 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f53c40c9130 con 0x7f53c40cd830 2024-09-17T03:47:05.810 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:05.810+0000 7f53cc6a9640 1 -- 172.21.15.146:0/4020360184 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f53c4072070 con 0x7f53c40cd830 2024-09-17T03:47:06.483 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.483+0000 7f53baffd640 1 -- 172.21.15.146:0/4020360184 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v208) ==== 170+0+0 (secure 0 0 0) 0x7f53bc0629e0 con 0x7f53c40cd830 2024-09-17T03:47:06.483 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2024-09-17T03:47:06.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 -- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f53a8078b90 msgr2=0x7f53a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f53a8078b90 0x7f53a807b0a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f53c0000f60 tx=0x7f53c0009040 comp rx=0 tx=0).stop 2024-09-17T03:47:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 -- 172.21.15.146:0/4020360184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40cd830 msgr2=0x7f53c409ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40cd830 0x7f53c409ffa0 secure :-1 s=READY pgs=2662 cs=0 l=1 rev1=1 crypto rx=0x7f53bc002230 tx=0x7f53bc00cb90 comp rx=0 tx=0).stop 2024-09-17T03:47:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 -- 172.21.15.146:0/4020360184 shutdown_connections 2024-09-17T03:47:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f53a8078b90 0x7f53a807b0a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f53c40cd830 0x7f53c409ffa0 unknown :-1 s=CLOSED pgs=2662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53c40b1c20 0x7f53c409fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 --2- 172.21.15.146:0/4020360184 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f53c4070db0 0x7f53c415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 -- 172.21.15.146:0/4020360184 >> 172.21.15.146:0/4020360184 conn(0x7f53c40d2650 msgr2=0x7f53c40b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 -- 172.21.15.146:0/4020360184 shutdown_connections 2024-09-17T03:47:06.487 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.486+0000 7f53cc6a9640 1 -- 172.21.15.146:0/4020360184 wait complete. 2024-09-17T03:47:06.513 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:47:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.634+0000 7fe28c75f640 1 -- 172.21.15.146:0/2314059277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe270005280 msgr2=0x7fe27000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.634+0000 7fe28c75f640 1 --2- 172.21.15.146:0/2314059277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe270005280 0x7fe27000b9c0 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009b20 tx=0x7fe270005830 comp rx=0 tx=0).stop 2024-09-17T03:47:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.634+0000 7fe28c75f640 1 -- 172.21.15.146:0/2314059277 shutdown_connections 2024-09-17T03:47:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.634+0000 7fe28c75f640 1 --2- 172.21.15.146:0/2314059277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe270005280 0x7fe27000b9c0 unknown :-1 s=CLOSED pgs=2664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.634+0000 7fe28c75f640 1 -- 172.21.15.146:0/2314059277 >> 172.21.15.146:0/2314059277 conn(0x7fe2840d2650 msgr2=0x7fe2840d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.634+0000 7fe28c75f640 1 -- 172.21.15.146:0/2314059277 shutdown_connections 2024-09-17T03:47:06.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.634+0000 7fe28c75f640 1 -- 172.21.15.146:0/2314059277 wait complete. 2024-09-17T03:47:06.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.636+0000 7fe28c75f640 1 Processor -- start 2024-09-17T03:47:06.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.636+0000 7fe28c75f640 1 -- start start 2024-09-17T03:47:06.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.637+0000 7fe28c75f640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe270005280 0x7fe28415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.637+0000 7fe28c75f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28415d5d0 0x7fe28415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.637+0000 7fe28c75f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2840cb140 0x7fe2840cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.637+0000 7fe28c75f640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840cd4b0 con 0x7fe270005280 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.637+0000 7fe28c75f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840cd330 con 0x7fe2840cb140 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.637+0000 7fe28c75f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe2840cd630 con 0x7fe28415d5d0 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.637+0000 7fe28a4fb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe270005280 0x7fe28415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.637+0000 7fe28a4fb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe270005280 0x7fe28415d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46708/0 (socket says 172.21.15.146:46708) 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.637+0000 7fe28a4fb640 1 -- 172.21.15.146:0/663947563 learned_addr learned my addr 172.21.15.146:0/663947563 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe28acfc640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2840cb140 0x7fe2840cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe289cfa640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28415d5d0 0x7fe28415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe28a4fb640 1 -- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28415d5d0 msgr2=0x7fe28415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe28a4fb640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28415d5d0 0x7fe28415d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe28a4fb640 1 -- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2840cb140 msgr2=0x7fe2840cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:06.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe28a4fb640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2840cb140 0x7fe2840cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe28a4fb640 1 -- 172.21.15.146:0/663947563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28415df20 con 0x7fe270005280 2024-09-17T03:47:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe289cfa640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28415d5d0 0x7fe28415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe28acfc640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2840cb140 0x7fe2840cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe28a4fb640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe270005280 0x7fe28415d090 secure :-1 s=READY pgs=2665 cs=0 l=1 rev1=1 crypto rx=0x7fe280006300 tx=0x7fe2800067c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe27affd640 1 -- 172.21.15.146:0/663947563 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280015070 con 0x7fe270005280 2024-09-17T03:47:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe27affd640 1 -- 172.21.15.146:0/663947563 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe28000fd40 con 0x7fe270005280 2024-09-17T03:47:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe28c75f640 1 -- 172.21.15.146:0/663947563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28414c710 con 0x7fe270005280 2024-09-17T03:47:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe27affd640 1 -- 172.21.15.146:0/663947563 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280011690 con 0x7fe270005280 2024-09-17T03:47:06.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.638+0000 7fe28c75f640 1 -- 172.21.15.146:0/663947563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28415b7a0 con 0x7fe270005280 2024-09-17T03:47:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.639+0000 7fe28c75f640 1 -- 172.21.15.146:0/663947563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2840cf0b0 con 0x7fe270005280 2024-09-17T03:47:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.640+0000 7fe27affd640 1 -- 172.21.15.146:0/663947563 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe280011830 con 0x7fe270005280 2024-09-17T03:47:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.640+0000 7fe27affd640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe268078b90 0x7fe26807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.640+0000 7fe27affd640 1 -- 172.21.15.146:0/663947563 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(208..208 src has 1..208) ==== 5609+0+0 (secure 0 0 0) 0x7fe28009be00 con 0x7fe270005280 2024-09-17T03:47:06.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.640+0000 7fe289cfa640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe268078b90 0x7fe26807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:06.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.641+0000 7fe289cfa640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe268078b90 0x7fe26807b0a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fe274000c00 tx=0x7fe2740064a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:06.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.645+0000 7fe27affd640 1 -- 172.21.15.146:0/663947563 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe28415df20 con 0x7fe270005280 2024-09-17T03:47:06.856 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:06.856+0000 7fe28c75f640 1 -- 172.21.15.146:0/663947563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe2840cc920 con 0x7fe270005280 2024-09-17T03:47:07.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.484+0000 7fe27affd640 1 -- 172.21.15.146:0/663947563 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 32 and data pool 33 v159) ==== 174+0+0 (secure 0 0 0) 0x7fe2840ce050 con 0x7fe270005280 2024-09-17T03:47:07.485 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 32 and data pool 33 2024-09-17T03:47:07.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.488+0000 7fe28c75f640 1 -- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe268078b90 msgr2=0x7fe26807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:07.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.488+0000 7fe28c75f640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe268078b90 0x7fe26807b0a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fe274000c00 tx=0x7fe2740064a0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.488+0000 7fe28c75f640 1 -- 172.21.15.146:0/663947563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe270005280 msgr2=0x7fe28415d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:07.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.488+0000 7fe28c75f640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe270005280 0x7fe28415d090 secure :-1 s=READY pgs=2665 cs=0 l=1 rev1=1 crypto rx=0x7fe280006300 tx=0x7fe2800067c0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.488+0000 7fe28c75f640 1 -- 172.21.15.146:0/663947563 shutdown_connections 2024-09-17T03:47:07.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.488+0000 7fe28c75f640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe268078b90 0x7fe26807b0a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.488+0000 7fe28c75f640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe2840cb140 0x7fe2840cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.488+0000 7fe28c75f640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe28415d5d0 0x7fe28415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.488+0000 7fe28c75f640 1 --2- 172.21.15.146:0/663947563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe270005280 0x7fe28415d090 unknown :-1 s=CLOSED pgs=2665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.488+0000 7fe28c75f640 1 -- 172.21.15.146:0/663947563 >> 172.21.15.146:0/663947563 conn(0x7fe2840d2650 msgr2=0x7fe2840ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:07.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.489+0000 7fe28c75f640 1 -- 172.21.15.146:0/663947563 shutdown_connections 2024-09-17T03:47:07.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.490+0000 7fe28c75f640 1 -- 172.21.15.146:0/663947563 wait complete. 2024-09-17T03:47:07.523 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:47:07.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.637+0000 7f7a403ed640 1 -- 172.21.15.146:0/2288347990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a380cebc0 msgr2=0x7f7a380d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.637+0000 7f7a403ed640 1 --2- 172.21.15.146:0/2288347990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a380cebc0 0x7f7a380d0b10 secure :-1 s=READY pgs=2667 cs=0 l=1 rev1=1 crypto rx=0x7f7a381607d0 tx=0x7f7a2802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.637+0000 7f7a403ed640 1 -- 172.21.15.146:0/2288347990 shutdown_connections 2024-09-17T03:47:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.637+0000 7f7a403ed640 1 --2- 172.21.15.146:0/2288347990 >> v2:172.21.15.179:3300/0 conn(0x7f7a380d1050 0x7f7a380b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.637+0000 7f7a403ed640 1 --2- 172.21.15.146:0/2288347990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a380cebc0 0x7f7a380d0b10 unknown :-1 s=CLOSED pgs=2667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.637+0000 7f7a403ed640 1 -- 172.21.15.146:0/2288347990 >> 172.21.15.146:0/2288347990 conn(0x7f7a380d26c0 msgr2=0x7f7a380d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.637+0000 7f7a403ed640 1 -- 172.21.15.146:0/2288347990 shutdown_connections 2024-09-17T03:47:07.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.637+0000 7f7a403ed640 1 -- 172.21.15.146:0/2288347990 wait complete. 2024-09-17T03:47:07.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.639+0000 7f7a403ed640 1 Processor -- start 2024-09-17T03:47:07.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.639+0000 7f7a403ed640 1 -- start start 2024-09-17T03:47:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a403ed640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a380cebc0 0x7f7a380af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a403ed640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a380d1050 0x7f7a381568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:07.641 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a403ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a380d31e0 0x7f7a380b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a403ed640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7a380b6450 con 0x7f7a380d31e0 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a403ed640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7a380b62d0 con 0x7f7a380d1050 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a403ed640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7a380b65d0 con 0x7f7a380cebc0 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a3e98a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a380d31e0 0x7f7a380b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a3e98a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a380d31e0 0x7f7a380b0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45848/0 (socket says 172.21.15.146:45848) 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a3e98a640 1 -- 172.21.15.146:0/1647326192 learned_addr learned my addr 172.21.15.146:0/1647326192 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a3d988640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a380d1050 0x7f7a381568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a3e189640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a380cebc0 0x7f7a380af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a3e98a640 1 -- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a380cebc0 msgr2=0x7f7a380af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a3e98a640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a380cebc0 0x7f7a380af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a3e98a640 1 -- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a380d1050 msgr2=0x7f7a381568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:07.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a3e98a640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a380d1050 0x7f7a381568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a3e98a640 1 -- 172.21.15.146:0/1647326192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a380b2620 con 0x7f7a380d31e0 2024-09-17T03:47:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.640+0000 7f7a3d988640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a380d1050 0x7f7a381568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:47:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.641+0000 7f7a3e98a640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a380d31e0 0x7f7a380b0260 secure :-1 s=READY pgs=2668 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000d9e0 tx=0x7f7a3000dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.641+0000 7f7a2effd640 1 -- 172.21.15.146:0/1647326192 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30017070 con 0x7f7a380d31e0 2024-09-17T03:47:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.641+0000 7f7a2effd640 1 -- 172.21.15.146:0/1647326192 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a3000be30 con 0x7f7a380d31e0 2024-09-17T03:47:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.641+0000 7f7a403ed640 1 -- 172.21.15.146:0/1647326192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a380b2900 con 0x7f7a380d31e0 2024-09-17T03:47:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.641+0000 7f7a2effd640 1 -- 172.21.15.146:0/1647326192 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30003bb0 con 0x7f7a380d31e0 2024-09-17T03:47:07.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.641+0000 7f7a403ed640 1 -- 172.21.15.146:0/1647326192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a380b2ec0 con 0x7f7a380d31e0 2024-09-17T03:47:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.642+0000 7f7a403ed640 1 -- 172.21.15.146:0/1647326192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a380b6b60 con 0x7f7a380d31e0 2024-09-17T03:47:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.643+0000 7f7a2effd640 1 -- 172.21.15.146:0/1647326192 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a30010460 con 0x7f7a380d31e0 2024-09-17T03:47:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.643+0000 7f7a2effd640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a1c078bc0 0x7f7a1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:07.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.643+0000 7f7a2effd640 1 -- 172.21.15.146:0/1647326192 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5709+0+0 (secure 0 0 0) 0x7f7a3009b0f0 con 0x7f7a380d31e0 2024-09-17T03:47:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.643+0000 7f7a3e189640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a1c078bc0 0x7f7a1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:07.645 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.644+0000 7f7a3e189640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a1c078bc0 0x7f7a1c07b0d0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f7a34000fd0 tx=0x7f7a34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:07.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.648+0000 7f7a2effd640 1 -- 172.21.15.146:0/1647326192 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7a300635c0 con 0x7f7a380d31e0 2024-09-17T03:47:07.823 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.823+0000 7f7a403ed640 1 -- 172.21.15.146:0/1647326192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a380c9140 con 0x7f7a380d31e0 2024-09-17T03:47:07.824 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.824+0000 7f7a2effd640 1 -- 172.21.15.146:0/1647326192 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) ==== 74+0+16744 (secure 0 0 0) 0x7f7a30062ec0 con 0x7f7a380d31e0 2024-09-17T03:47:07.825 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:07.825 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":209,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:47:06.858135+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:47:04.485441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_data","create_time":"2024-09-17T03:47:05.816308+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:47:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.826+0000 7f7a403ed640 1 -- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a1c078bc0 msgr2=0x7f7a1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.826+0000 7f7a403ed640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a1c078bc0 0x7f7a1c07b0d0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f7a34000fd0 tx=0x7f7a34009040 comp rx=0 tx=0).stop 2024-09-17T03:47:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.827+0000 7f7a403ed640 1 -- 172.21.15.146:0/1647326192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a380d31e0 msgr2=0x7f7a380b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.827+0000 7f7a403ed640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a380d31e0 0x7f7a380b0260 secure :-1 s=READY pgs=2668 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000d9e0 tx=0x7f7a3000dea0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.827+0000 7f7a403ed640 1 -- 172.21.15.146:0/1647326192 shutdown_connections 2024-09-17T03:47:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.827+0000 7f7a403ed640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a1c078bc0 0x7f7a1c07b0d0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.827+0000 7f7a403ed640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a380d31e0 0x7f7a380b0260 unknown :-1 s=CLOSED pgs=2668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.827 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.827+0000 7f7a403ed640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a380d1050 0x7f7a381568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.827+0000 7f7a403ed640 1 --2- 172.21.15.146:0/1647326192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a380cebc0 0x7f7a380af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.827+0000 7f7a403ed640 1 -- 172.21.15.146:0/1647326192 >> 172.21.15.146:0/1647326192 conn(0x7f7a380d26c0 msgr2=0x7f7a3815cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.827+0000 7f7a403ed640 1 -- 172.21.15.146:0/1647326192 shutdown_connections 2024-09-17T03:47:07.828 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.827+0000 7f7a403ed640 1 -- 172.21.15.146:0/1647326192 wait complete. 2024-09-17T03:47:07.839 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:47:07.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.992+0000 7ff09ab51640 1 -- 172.21.15.146:0/1482647984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0940d31e0 msgr2=0x7ff0940cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.992+0000 7ff09ab51640 1 --2- 172.21.15.146:0/1482647984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0940d31e0 0x7ff0940cebc0 secure :-1 s=READY pgs=2670 cs=0 l=1 rev1=1 crypto rx=0x7ff094075770 tx=0x7ff09002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.992+0000 7ff09ab51640 1 -- 172.21.15.146:0/1482647984 shutdown_connections 2024-09-17T03:47:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.992+0000 7ff09ab51640 1 --2- 172.21.15.146:0/1482647984 >> v2:172.21.15.179:3300/0 conn(0x7ff09415cbe0 0x7ff0940d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.992+0000 7ff09ab51640 1 --2- 172.21.15.146:0/1482647984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0940d31e0 0x7ff0940cebc0 unknown :-1 s=CLOSED pgs=2670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.992+0000 7ff09ab51640 1 -- 172.21.15.146:0/1482647984 >> 172.21.15.146:0/1482647984 conn(0x7ff0940d26c0 msgr2=0x7ff0940d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.992+0000 7ff09ab51640 1 -- 172.21.15.146:0/1482647984 shutdown_connections 2024-09-17T03:47:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.992+0000 7ff09ab51640 1 -- 172.21.15.146:0/1482647984 wait complete. 2024-09-17T03:47:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.994+0000 7ff09ab51640 1 Processor -- start 2024-09-17T03:47:07.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.994+0000 7ff09ab51640 1 -- start start 2024-09-17T03:47:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.995+0000 7ff09ab51640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0940d1050 0x7ff09415d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.995+0000 7ff09ab51640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0940d31e0 0x7ff0941e7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.995+0000 7ff09ab51640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff09415cbe0 0x7ff0941e7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.995+0000 7ff09ab51640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff0940cd7b0 con 0x7ff0940d1050 2024-09-17T03:47:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.995+0000 7ff09ab51640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff0940b6cf0 con 0x7ff09415cbe0 2024-09-17T03:47:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.995+0000 7ff09ab51640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff0940cd930 con 0x7ff0940d31e0 2024-09-17T03:47:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.995+0000 7ff0988ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0940d1050 0x7ff09415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.995+0000 7ff0988ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0940d1050 0x7ff09415d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45856/0 (socket says 172.21.15.146:45856) 2024-09-17T03:47:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.995+0000 7ff0988ed640 1 -- 172.21.15.146:0/4024620287 learned_addr learned my addr 172.21.15.146:0/4024620287 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff08bfff640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0940d31e0 0x7ff0941e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff0990ee640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff09415cbe0 0x7ff0941e7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff0988ed640 1 -- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0940d31e0 msgr2=0x7ff0941e7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff0988ed640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0940d31e0 0x7ff0941e7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff0988ed640 1 -- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff09415cbe0 msgr2=0x7ff0941e7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff0988ed640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff09415cbe0 0x7ff0941e7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff0988ed640 1 -- 172.21.15.146:0/4024620287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09415f720 con 0x7ff0940d1050 2024-09-17T03:47:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff0988ed640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0940d1050 0x7ff09415d710 secure :-1 s=READY pgs=2671 cs=0 l=1 rev1=1 crypto rx=0x7ff0900099d0 tx=0x7ff0900052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff0897fa640 1 -- 172.21.15.146:0/4024620287 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090005cf0 con 0x7ff0940d1050 2024-09-17T03:47:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff0897fa640 1 -- 172.21.15.146:0/4024620287 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff090031c40 con 0x7ff0940d1050 2024-09-17T03:47:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff09ab51640 1 -- 172.21.15.146:0/4024620287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09415fa00 con 0x7ff0940d1050 2024-09-17T03:47:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff0897fa640 1 -- 172.21.15.146:0/4024620287 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090033330 con 0x7ff0940d1050 2024-09-17T03:47:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.996+0000 7ff09ab51640 1 -- 172.21.15.146:0/4024620287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09415ffc0 con 0x7ff0940d1050 2024-09-17T03:47:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.997+0000 7ff09ab51640 1 -- 172.21.15.146:0/4024620287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0940cde50 con 0x7ff0940d1050 2024-09-17T03:47:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.998+0000 7ff0897fa640 1 -- 172.21.15.146:0/4024620287 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0900334d0 con 0x7ff0940d1050 2024-09-17T03:47:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.998+0000 7ff0897fa640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff080078b90 0x7ff08007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.998+0000 7ff0897fa640 1 -- 172.21.15.146:0/4024620287 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5709+0+0 (secure 0 0 0) 0x7ff0900bc0e0 con 0x7ff0940d1050 2024-09-17T03:47:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.998+0000 7ff08bfff640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff080078b90 0x7ff08007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:07.999+0000 7ff08bfff640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff080078b90 0x7ff08007b0a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff084005fd0 tx=0x7ff084005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:08.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.003+0000 7ff0897fa640 1 -- 172.21.15.146:0/4024620287 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff09003f030 con 0x7ff0940d1050 2024-09-17T03:47:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.177+0000 7ff09ab51640 1 -- 172.21.15.146:0/4024620287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0941eb700 con 0x7ff0940d1050 2024-09-17T03:47:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.179+0000 7ff0897fa640 1 -- 172.21.15.146:0/4024620287 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) ==== 74+0+16744 (secure 0 0 0) 0x7ff0900845b0 con 0x7ff0940d1050 2024-09-17T03:47:08.179 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:08.179 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":209,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:47:06.858135+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:47:04.485441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_data","create_time":"2024-09-17T03:47:05.816308+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:47:08.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 -- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff080078b90 msgr2=0x7ff08007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:08.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff080078b90 0x7ff08007b0a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff084005fd0 tx=0x7ff084005850 comp rx=0 tx=0).stop 2024-09-17T03:47:08.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 -- 172.21.15.146:0/4024620287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0940d1050 msgr2=0x7ff09415d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:08.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0940d1050 0x7ff09415d710 secure :-1 s=READY pgs=2671 cs=0 l=1 rev1=1 crypto rx=0x7ff0900099d0 tx=0x7ff0900052f0 comp rx=0 tx=0).stop 2024-09-17T03:47:08.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 -- 172.21.15.146:0/4024620287 shutdown_connections 2024-09-17T03:47:08.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff080078b90 0x7ff08007b0a0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:08.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff09415cbe0 0x7ff0941e7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:08.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0940d31e0 0x7ff0941e7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:08.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 --2- 172.21.15.146:0/4024620287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0940d1050 0x7ff09415d710 unknown :-1 s=CLOSED pgs=2671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:08.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 -- 172.21.15.146:0/4024620287 >> 172.21.15.146:0/4024620287 conn(0x7ff0940d26c0 msgr2=0x7ff0940d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:08.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 -- 172.21.15.146:0/4024620287 shutdown_connections 2024-09-17T03:47:08.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.181+0000 7ff09ab51640 1 -- 172.21.15.146:0/4024620287 wait complete. 2024-09-17T03:47:08.193 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:47:08.309 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.309+0000 7ff135a7e640 1 -- 172.21.15.146:0/149725174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1300d31e0 msgr2=0x7ff1300cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:08.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.309+0000 7ff135a7e640 1 --2- 172.21.15.146:0/149725174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1300d31e0 0x7ff1300cebc0 secure :-1 s=READY pgs=2672 cs=0 l=1 rev1=1 crypto rx=0x7ff130075770 tx=0x7ff12002a570 comp rx=0 tx=0).stop 2024-09-17T03:47:08.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.309+0000 7ff135a7e640 1 -- 172.21.15.146:0/149725174 shutdown_connections 2024-09-17T03:47:08.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.309+0000 7ff135a7e640 1 --2- 172.21.15.146:0/149725174 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300d1050 0x7ff1300cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:08.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.309+0000 7ff135a7e640 1 --2- 172.21.15.146:0/149725174 >> v2:172.21.15.179:3300/0 conn(0x7ff13015cbe0 0x7ff1300d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:08.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.309+0000 7ff135a7e640 1 --2- 172.21.15.146:0/149725174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1300d31e0 0x7ff1300cebc0 unknown :-1 s=CLOSED pgs=2672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:08.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.309+0000 7ff135a7e640 1 -- 172.21.15.146:0/149725174 >> 172.21.15.146:0/149725174 conn(0x7ff1300d26c0 msgr2=0x7ff1300d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:08.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.309+0000 7ff135a7e640 1 -- 172.21.15.146:0/149725174 shutdown_connections 2024-09-17T03:47:08.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.309+0000 7ff135a7e640 1 -- 172.21.15.146:0/149725174 wait complete. 2024-09-17T03:47:08.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.311+0000 7ff135a7e640 1 Processor -- start 2024-09-17T03:47:08.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.311+0000 7ff135a7e640 1 -- start start 2024-09-17T03:47:08.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.312+0000 7ff135a7e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300d1050 0x7ff13015f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.312+0000 7ff135a7e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1300d31e0 0x7ff13015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.312+0000 7ff135a7e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13015cbe0 0x7ff1301f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.312+0000 7ff135a7e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff1300cd970 con 0x7ff13015cbe0 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.312+0000 7ff135a7e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff1300cd7f0 con 0x7ff1300d31e0 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.312+0000 7ff135a7e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff1300cdaf0 con 0x7ff1300d1050 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.312+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13015cbe0 0x7ff1301f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.312+0000 7ff12ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13015cbe0 0x7ff1301f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45880/0 (socket says 172.21.15.146:45880) 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.312+0000 7ff12ffff640 1 -- 172.21.15.146:0/3260112587 learned_addr learned my addr 172.21.15.146:0/3260112587 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.312+0000 7ff12f7fe640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300d1050 0x7ff13015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.312+0000 7ff126ffd640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1300d31e0 0x7ff13015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.313+0000 7ff12ffff640 1 -- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300d1050 msgr2=0x7ff13015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:08.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.313+0000 7ff12ffff640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300d1050 0x7ff13015f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.313+0000 7ff12ffff640 1 -- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1300d31e0 msgr2=0x7ff13015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.313+0000 7ff12ffff640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1300d31e0 0x7ff13015eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.313+0000 7ff12ffff640 1 -- 172.21.15.146:0/3260112587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13009de30 con 0x7ff13015cbe0 2024-09-17T03:47:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.313+0000 7ff12ffff640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13015cbe0 0x7ff1301f6ac0 secure :-1 s=READY pgs=2673 cs=0 l=1 rev1=1 crypto rx=0x7ff12800ca30 tx=0x7ff12800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.313+0000 7ff12cff9640 1 -- 172.21.15.146:0/3260112587 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128007d30 con 0x7ff13015cbe0 2024-09-17T03:47:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.313+0000 7ff12cff9640 1 -- 172.21.15.146:0/3260112587 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff128003990 con 0x7ff13015cbe0 2024-09-17T03:47:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.313+0000 7ff135a7e640 1 -- 172.21.15.146:0/3260112587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13009e110 con 0x7ff13015cbe0 2024-09-17T03:47:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.313+0000 7ff12cff9640 1 -- 172.21.15.146:0/3260112587 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128003de0 con 0x7ff13015cbe0 2024-09-17T03:47:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.313+0000 7ff135a7e640 1 -- 172.21.15.146:0/3260112587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1301f77d0 con 0x7ff13015cbe0 2024-09-17T03:47:08.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.314+0000 7ff135a7e640 1 -- 172.21.15.146:0/3260112587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1300cebc0 con 0x7ff13015cbe0 2024-09-17T03:47:08.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.315+0000 7ff12cff9640 1 -- 172.21.15.146:0/3260112587 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff128004b20 con 0x7ff13015cbe0 2024-09-17T03:47:08.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.315+0000 7ff12cff9640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff110078b90 0x7ff11007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:08.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.316+0000 7ff12cff9640 1 -- 172.21.15.146:0/3260112587 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 5709+0+0 (secure 0 0 0) 0x7ff12809b8d0 con 0x7ff13015cbe0 2024-09-17T03:47:08.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.316+0000 7ff12f7fe640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff110078b90 0x7ff11007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:08.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.316+0000 7ff12f7fe640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff110078b90 0x7ff11007b0a0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff120034000 tx=0x7ff120004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:08.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.319+0000 7ff12cff9640 1 -- 172.21.15.146:0/3260112587 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff128014070 con 0x7ff13015cbe0 2024-09-17T03:47:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:08.533+0000 7ff135a7e640 1 -- 172.21.15.146:0/3260112587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff13015fc50 con 0x7ff13015cbe0 2024-09-17T03:47:09.463 INFO:tasks.ceph.mds.d.smithi179.stderr:2024-09-17T03:47:09.463+0000 7f165b4fc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:47:09.511 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.511+0000 7ff12cff9640 1 -- 172.21.15.146:0/3260112587 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v162) ==== 118+0+0 (secure 0 0 0) 0x7ff128063620 con 0x7ff13015cbe0 2024-09-17T03:47:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 -- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff110078b90 msgr2=0x7ff11007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff110078b90 0x7ff11007b0a0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff120034000 tx=0x7ff120004730 comp rx=0 tx=0).stop 2024-09-17T03:47:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 -- 172.21.15.146:0/3260112587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13015cbe0 msgr2=0x7ff1301f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13015cbe0 0x7ff1301f6ac0 secure :-1 s=READY pgs=2673 cs=0 l=1 rev1=1 crypto rx=0x7ff12800ca30 tx=0x7ff12800cef0 comp rx=0 tx=0).stop 2024-09-17T03:47:09.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 -- 172.21.15.146:0/3260112587 shutdown_connections 2024-09-17T03:47:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff110078b90 0x7ff11007b0a0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13015cbe0 0x7ff1301f6ac0 unknown :-1 s=CLOSED pgs=2673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1300d31e0 0x7ff13015eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 --2- 172.21.15.146:0/3260112587 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1300d1050 0x7ff13015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 -- 172.21.15.146:0/3260112587 >> 172.21.15.146:0/3260112587 conn(0x7ff1300d26c0 msgr2=0x7ff1300c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 -- 172.21.15.146:0/3260112587 shutdown_connections 2024-09-17T03:47:09.515 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.514+0000 7ff135a7e640 1 -- 172.21.15.146:0/3260112587 wait complete. 2024-09-17T03:47:09.528 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:47:09.528 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:47:09.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.652+0000 7fa3da4bd640 1 -- 172.21.15.146:0/782365700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d4069940 msgr2=0x7fa3d40cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:09.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.652+0000 7fa3da4bd640 1 --2- 172.21.15.146:0/782365700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d4069940 0x7fa3d40cf3c0 secure :-1 s=READY pgs=2675 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009830 tx=0x7fa3c802a530 comp rx=0 tx=0).stop 2024-09-17T03:47:09.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.652+0000 7fa3da4bd640 1 -- 172.21.15.146:0/782365700 shutdown_connections 2024-09-17T03:47:09.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.652+0000 7fa3da4bd640 1 --2- 172.21.15.146:0/782365700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d4069940 0x7fa3d40cf3c0 unknown :-1 s=CLOSED pgs=2675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:09.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.652+0000 7fa3da4bd640 1 -- 172.21.15.146:0/782365700 >> 172.21.15.146:0/782365700 conn(0x7fa3d40d1770 msgr2=0x7fa3d40d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:09.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.652+0000 7fa3da4bd640 1 -- 172.21.15.146:0/782365700 shutdown_connections 2024-09-17T03:47:09.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.652+0000 7fa3da4bd640 1 -- 172.21.15.146:0/782365700 wait complete. 2024-09-17T03:47:09.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.654+0000 7fa3da4bd640 1 Processor -- start 2024-09-17T03:47:09.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.654+0000 7fa3da4bd640 1 -- start start 2024-09-17T03:47:09.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.655+0000 7fa3da4bd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d40d3200 0x7fa3d41f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:09.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.655+0000 7fa3da4bd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d415edf0 0x7fa3d40b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:09.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.655+0000 7fa3da4bd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d4154910 0x7fa3d4159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:09.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.655+0000 7fa3da4bd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d40d3ea0 con 0x7fa3d415edf0 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.655+0000 7fa3da4bd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d40d3d20 con 0x7fa3d40d3200 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.655+0000 7fa3da4bd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d40d4020 con 0x7fa3d4154910 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.655+0000 7fa3d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d415edf0 0x7fa3d40b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.655+0000 7fa3d37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d415edf0 0x7fa3d40b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45908/0 (socket says 172.21.15.146:45908) 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.655+0000 7fa3d37fe640 1 -- 172.21.15.146:0/219624707 learned_addr learned my addr 172.21.15.146:0/219624707 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.655+0000 7fa3d3fff640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d40d3200 0x7fa3d41f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.655+0000 7fa3d8a5a640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d4154910 0x7fa3d4159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3d37fe640 1 -- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d4154910 msgr2=0x7fa3d4159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3d37fe640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d4154910 0x7fa3d4159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3d37fe640 1 -- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d40d3200 msgr2=0x7fa3d41f9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3d37fe640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d40d3200 0x7fa3d41f9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:09.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3d37fe640 1 -- 172.21.15.146:0/219624707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d4155450 con 0x7fa3d415edf0 2024-09-17T03:47:09.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3d8a5a640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d4154910 0x7fa3d4159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:09.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3d3fff640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d40d3200 0x7fa3d41f9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:09.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3d37fe640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d415edf0 0x7fa3d40b5670 secure :-1 s=READY pgs=2676 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8000c00 tx=0x7fa3c8033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:09.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3d0ff9640 1 -- 172.21.15.146:0/219624707 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8031d60 con 0x7fa3d415edf0 2024-09-17T03:47:09.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3d0ff9640 1 -- 172.21.15.146:0/219624707 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3c80330d0 con 0x7fa3d415edf0 2024-09-17T03:47:09.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3d0ff9640 1 -- 172.21.15.146:0/219624707 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8033520 con 0x7fa3d415edf0 2024-09-17T03:47:09.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3da4bd640 1 -- 172.21.15.146:0/219624707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d4158fc0 con 0x7fa3d415edf0 2024-09-17T03:47:09.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.656+0000 7fa3da4bd640 1 -- 172.21.15.146:0/219624707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d415bfb0 con 0x7fa3d415edf0 2024-09-17T03:47:09.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.657+0000 7fa3da4bd640 1 -- 172.21.15.146:0/219624707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d415bd20 con 0x7fa3d415edf0 2024-09-17T03:47:09.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.658+0000 7fa3d0ff9640 1 -- 172.21.15.146:0/219624707 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3c80035f0 con 0x7fa3d415edf0 2024-09-17T03:47:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.658+0000 7fa3d0ff9640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3c0078bc0 0x7fa3c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.659+0000 7fa3d0ff9640 1 -- 172.21.15.146:0/219624707 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7fa3c80bc200 con 0x7fa3d415edf0 2024-09-17T03:47:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.659+0000 7fa3d3fff640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3c0078bc0 0x7fa3c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:09.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.659+0000 7fa3d3fff640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3c0078bc0 0x7fa3c007b0d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4000f60 tx=0x7fa3c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:09.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.663+0000 7fa3d0ff9640 1 -- 172.21.15.146:0/219624707 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa3c803f030 con 0x7fa3d415edf0 2024-09-17T03:47:09.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:09.877+0000 7fa3da4bd640 1 -- 172.21.15.146:0/219624707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa3d40d44c0 con 0x7fa3d415edf0 2024-09-17T03:47:10.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.518+0000 7fa3d0ff9640 1 -- 172.21.15.146:0/219624707 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v163) ==== 122+0+0 (secure 0 0 0) 0x7fa3c8084080 con 0x7fa3d415edf0 2024-09-17T03:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 -- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3c0078bc0 msgr2=0x7fa3c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3c0078bc0 0x7fa3c007b0d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4000f60 tx=0x7fa3c4009040 comp rx=0 tx=0).stop 2024-09-17T03:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 -- 172.21.15.146:0/219624707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d415edf0 msgr2=0x7fa3d40b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d415edf0 0x7fa3d40b5670 secure :-1 s=READY pgs=2676 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8000c00 tx=0x7fa3c8033d60 comp rx=0 tx=0).stop 2024-09-17T03:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 -- 172.21.15.146:0/219624707 shutdown_connections 2024-09-17T03:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fa3c0078bc0 0x7fa3c007b0d0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3d4154910 0x7fa3d4159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d415edf0 0x7fa3d40b5670 unknown :-1 s=CLOSED pgs=2676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 --2- 172.21.15.146:0/219624707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3d40d3200 0x7fa3d41f9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 -- 172.21.15.146:0/219624707 >> 172.21.15.146:0/219624707 conn(0x7fa3d40d1770 msgr2=0x7fa3d40ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:10.522 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 -- 172.21.15.146:0/219624707 shutdown_connections 2024-09-17T03:47:10.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.521+0000 7fa3da4bd640 1 -- 172.21.15.146:0/219624707 wait complete. 2024-09-17T03:47:10.534 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:47:10.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:47:10.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.651+0000 7f2516e63640 1 -- 172.21.15.146:0/662514576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2510070120 msgr2=0x7f2510155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:10.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.651+0000 7f2516e63640 1 --2- 172.21.15.146:0/662514576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2510070120 0x7f2510155e90 secure :-1 s=READY pgs=2677 cs=0 l=1 rev1=1 crypto rx=0x7f2508005fd0 tx=0x7f250802a9f0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.651+0000 7f2516e63640 1 -- 172.21.15.146:0/662514576 shutdown_connections 2024-09-17T03:47:10.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.651+0000 7f2516e63640 1 --2- 172.21.15.146:0/662514576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2510070120 0x7f2510155e90 unknown :-1 s=CLOSED pgs=2677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.651+0000 7f2516e63640 1 --2- 172.21.15.146:0/662514576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f251015bf40 0x7f25100ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.651+0000 7f2516e63640 1 -- 172.21.15.146:0/662514576 >> 172.21.15.146:0/662514576 conn(0x7f25100b2790 msgr2=0x7f25100d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:10.652 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.651+0000 7f2516e63640 1 -- 172.21.15.146:0/662514576 shutdown_connections 2024-09-17T03:47:10.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.651+0000 7f2516e63640 1 -- 172.21.15.146:0/662514576 wait complete. 2024-09-17T03:47:10.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.653+0000 7f2516e63640 1 Processor -- start 2024-09-17T03:47:10.653 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.653+0000 7f2516e63640 1 -- start start 2024-09-17T03:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2516e63640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25100b51f0 0x7f2510151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2516e63640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f251015bf40 0x7f25100ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2516e63640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25101f66b0 0x7f25100abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2516e63640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f251006ed30 con 0x7f25101f66b0 2024-09-17T03:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2516e63640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f251006ebb0 con 0x7f251015bf40 2024-09-17T03:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2516e63640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f251006eeb0 con 0x7f25100b51f0 2024-09-17T03:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2515400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25101f66b0 0x7f25100abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:10.656 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2515400640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25101f66b0 0x7f25100abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45928/0 (socket says 172.21.15.146:45928) 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2515400640 1 -- 172.21.15.146:0/2413243122 learned_addr learned my addr 172.21.15.146:0/2413243122 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2515400640 1 -- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25100b51f0 msgr2=0x7f2510151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2514bff640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25100b51f0 0x7f2510151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f250ffff640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f251015bf40 0x7f25100ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2515400640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25100b51f0 0x7f2510151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2515400640 1 -- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f251015bf40 msgr2=0x7f25100ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2515400640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f251015bf40 0x7f25100ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2515400640 1 -- 172.21.15.146:0/2413243122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2510151640 con 0x7f25101f66b0 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2514bff640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25100b51f0 0x7f2510151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f250ffff640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f251015bf40 0x7f25100ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2515400640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25101f66b0 0x7f25100abeb0 secure :-1 s=READY pgs=2678 cs=0 l=1 rev1=1 crypto rx=0x7f2508009d90 tx=0x7f2508003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f250d7fa640 1 -- 172.21.15.146:0/2413243122 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508033050 con 0x7f25101f66b0 2024-09-17T03:47:10.657 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f250d7fa640 1 -- 172.21.15.146:0/2413243122 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2508004550 con 0x7f25101f66b0 2024-09-17T03:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f2516e63640 1 -- 172.21.15.146:0/2413243122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25100aae10 con 0x7f25101f66b0 2024-09-17T03:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.655+0000 7f250d7fa640 1 -- 172.21.15.146:0/2413243122 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2508038450 con 0x7f25101f66b0 2024-09-17T03:47:10.658 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.656+0000 7f2516e63640 1 -- 172.21.15.146:0/2413243122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25100ab3d0 con 0x7f25101f66b0 2024-09-17T03:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.656+0000 7f2516e63640 1 -- 172.21.15.146:0/2413243122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f251006f3d0 con 0x7f25101f66b0 2024-09-17T03:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.657+0000 7f250d7fa640 1 -- 172.21.15.146:0/2413243122 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2508036070 con 0x7f25101f66b0 2024-09-17T03:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.658+0000 7f250d7fa640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24f4078b90 0x7f24f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.658+0000 7f250d7fa640 1 -- 172.21.15.146:0/2413243122 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7f25080bc2e0 con 0x7f25101f66b0 2024-09-17T03:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.658+0000 7f2514bff640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24f4078b90 0x7f24f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:10.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.659+0000 7f2514bff640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24f4078b90 0x7f24f407b0a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f250400ba60 tx=0x7f2504005cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:10.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.663+0000 7f250d7fa640 1 -- 172.21.15.146:0/2413243122 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2510151640 con 0x7f25101f66b0 2024-09-17T03:47:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.873+0000 7f2516e63640 1 -- 172.21.15.146:0/2413243122 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25100adf30 con 0x7f25101f66b0 2024-09-17T03:47:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.873+0000 7f250d7fa640 1 -- 172.21.15.146:0/2413243122 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 163 v163) ==== 95+0+5250 (secure 0 0 0) 0x7f25080846a0 con 0x7f25101f66b0 2024-09-17T03:47:10.874 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:10.874 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":163,"btime":"2024-09-17T03:47:10:512617+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157},{"gid":11841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2488811693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2488811693},{"type":"v1","addr":"172.21.15.146:6835","nonce":2488811693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158}],"filesystems":[{"mdsmap":{"epoch":163,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:47:06.858092+0000","modified":"2024-09-17T03:47:09.879574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11853},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11853":{"gid":11853,"name":"d","rank":0,"incarnation":159,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3004139766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3004139766},{"type":"v1","addr":"172.21.15.179:6837","nonce":3004139766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11853,"qdb_cluster":[11853]},"id":16}]} 2024-09-17T03:47:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 163 2024-09-17T03:47:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.875+0000 7f2516e63640 1 -- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24f4078b90 msgr2=0x7f24f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.875+0000 7f2516e63640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24f4078b90 0x7f24f407b0a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f250400ba60 tx=0x7f2504005cf0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.875+0000 7f2516e63640 1 -- 172.21.15.146:0/2413243122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25101f66b0 msgr2=0x7f25100abeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.875+0000 7f2516e63640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25101f66b0 0x7f25100abeb0 secure :-1 s=READY pgs=2678 cs=0 l=1 rev1=1 crypto rx=0x7f2508009d90 tx=0x7f2508003f10 comp rx=0 tx=0).stop 2024-09-17T03:47:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.875+0000 7f2516e63640 1 -- 172.21.15.146:0/2413243122 shutdown_connections 2024-09-17T03:47:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.875+0000 7f2516e63640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24f4078b90 0x7f24f407b0a0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.875+0000 7f2516e63640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25101f66b0 0x7f25100abeb0 unknown :-1 s=CLOSED pgs=2678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.875+0000 7f2516e63640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f251015bf40 0x7f25100ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.875+0000 7f2516e63640 1 --2- 172.21.15.146:0/2413243122 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25100b51f0 0x7f2510151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:10.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.875+0000 7f2516e63640 1 -- 172.21.15.146:0/2413243122 >> 172.21.15.146:0/2413243122 conn(0x7f25100b2790 msgr2=0x7f25100740a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:10.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.876+0000 7f2516e63640 1 -- 172.21.15.146:0/2413243122 shutdown_connections 2024-09-17T03:47:10.877 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:10.876+0000 7f2516e63640 1 -- 172.21.15.146:0/2413243122 wait complete. 2024-09-17T03:47:10.888 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.001+0000 7f924fc93640 1 -- 172.21.15.146:0/743774501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9234004800 msgr2=0x7f9234004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.001+0000 7f924fc93640 1 --2- 172.21.15.146:0/743774501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9234004800 0x7f9234004c10 secure :-1 s=READY pgs=2680 cs=0 l=1 rev1=1 crypto rx=0x7f9238009b30 tx=0x7f9234005830 comp rx=0 tx=0).stop 2024-09-17T03:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.001+0000 7f924fc93640 1 -- 172.21.15.146:0/743774501 shutdown_connections 2024-09-17T03:47:11.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.001+0000 7f924fc93640 1 --2- 172.21.15.146:0/743774501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9234004800 0x7f9234004c10 unknown :-1 s=CLOSED pgs=2680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.001+0000 7f924fc93640 1 -- 172.21.15.146:0/743774501 >> 172.21.15.146:0/743774501 conn(0x7f92480d26c0 msgr2=0x7f92480d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.001+0000 7f924fc93640 1 -- 172.21.15.146:0/743774501 shutdown_connections 2024-09-17T03:47:11.002 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.001+0000 7f924fc93640 1 -- 172.21.15.146:0/743774501 wait complete. 2024-09-17T03:47:11.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.002+0000 7f924fc93640 1 Processor -- start 2024-09-17T03:47:11.003 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.003+0000 7f924fc93640 1 -- start start 2024-09-17T03:47:11.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924fc93640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9234004800 0x7f924814f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924fc93640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9248152a50 0x7f924809cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924fc93640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92480b3770 0x7f924814c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.005 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924fc93640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f924815cbe0 con 0x7f9248152a50 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924fc93640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92480d0e30 con 0x7f9234004800 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924fc93640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f924815cd60 con 0x7f92480b3770 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924d22e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9248152a50 0x7f924809cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924d22e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9248152a50 0x7f924809cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45938/0 (socket says 172.21.15.146:45938) 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924d22e640 1 -- 172.21.15.146:0/1434749221 learned_addr learned my addr 172.21.15.146:0/1434749221 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924e230640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92480b3770 0x7f924814c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924da2f640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9234004800 0x7f924814f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924d22e640 1 -- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92480b3770 msgr2=0x7f924814c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924d22e640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92480b3770 0x7f924814c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924d22e640 1 -- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9234004800 msgr2=0x7f924814f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924d22e640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9234004800 0x7f924814f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924d22e640 1 -- 172.21.15.146:0/1434749221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92480af630 con 0x7f9248152a50 2024-09-17T03:47:11.006 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.004+0000 7f924d22e640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9248152a50 0x7f924809cff0 secure :-1 s=READY pgs=2681 cs=0 l=1 rev1=1 crypto rx=0x7f9238035040 tx=0x7f923802ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:11.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.005+0000 7f923e7fc640 1 -- 172.21.15.146:0/1434749221 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238041020 con 0x7f9248152a50 2024-09-17T03:47:11.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.005+0000 7f923e7fc640 1 -- 172.21.15.146:0/1434749221 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9238004ca0 con 0x7f9248152a50 2024-09-17T03:47:11.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.005+0000 7f923e7fc640 1 -- 172.21.15.146:0/1434749221 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923803d6c0 con 0x7f9248152a50 2024-09-17T03:47:11.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.005+0000 7f924fc93640 1 -- 172.21.15.146:0/1434749221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92480af910 con 0x7f9248152a50 2024-09-17T03:47:11.007 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.005+0000 7f924fc93640 1 -- 172.21.15.146:0/1434749221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f924809cad0 con 0x7f9248152a50 2024-09-17T03:47:11.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.006+0000 7f924fc93640 1 -- 172.21.15.146:0/1434749221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924815d910 con 0x7f9248152a50 2024-09-17T03:47:11.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.007+0000 7f923e7fc640 1 -- 172.21.15.146:0/1434749221 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9238044020 con 0x7f9248152a50 2024-09-17T03:47:11.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.007+0000 7f923e7fc640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f922c078bc0 0x7f922c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.007+0000 7f923e7fc640 1 -- 172.21.15.146:0/1434749221 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7f92380bc0a0 con 0x7f9248152a50 2024-09-17T03:47:11.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.008+0000 7f924da2f640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f922c078bc0 0x7f922c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.008 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.008+0000 7f924da2f640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f922c078bc0 0x7f922c07b0d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f924806a3d0 tx=0x7f9244006da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:11.012 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.012+0000 7f923e7fc640 1 -- 172.21.15.146:0/1434749221 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f923804b030 con 0x7f9248152a50 2024-09-17T03:47:11.186 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.186+0000 7f924fc93640 1 -- 172.21.15.146:0/1434749221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92480afae0 con 0x7f9248152a50 2024-09-17T03:47:11.187 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.187+0000 7f923e7fc640 1 -- 172.21.15.146:0/1434749221 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v210) ==== 74+0+16731 (secure 0 0 0) 0x7f9238083e90 con 0x7f9248152a50 2024-09-17T03:47:11.187 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:11.188 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":210,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:47:08.486079+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:47:04.485441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_data","create_time":"2024-09-17T03:47:05.816308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"210","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:47:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 -- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f922c078bc0 msgr2=0x7f922c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f922c078bc0 0x7f922c07b0d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f924806a3d0 tx=0x7f9244006da0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 -- 172.21.15.146:0/1434749221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9248152a50 msgr2=0x7f924809cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9248152a50 0x7f924809cff0 secure :-1 s=READY pgs=2681 cs=0 l=1 rev1=1 crypto rx=0x7f9238035040 tx=0x7f923802ba60 comp rx=0 tx=0).stop 2024-09-17T03:47:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 -- 172.21.15.146:0/1434749221 shutdown_connections 2024-09-17T03:47:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f922c078bc0 0x7f922c07b0d0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92480b3770 0x7f924814c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9248152a50 0x7f924809cff0 unknown :-1 s=CLOSED pgs=2681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 --2- 172.21.15.146:0/1434749221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9234004800 0x7f924814f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 -- 172.21.15.146:0/1434749221 >> 172.21.15.146:0/1434749221 conn(0x7f92480d26c0 msgr2=0x7f92480b6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:11.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 -- 172.21.15.146:0/1434749221 shutdown_connections 2024-09-17T03:47:11.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.189+0000 7f924fc93640 1 -- 172.21.15.146:0/1434749221 wait complete. 2024-09-17T03:47:11.201 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:47:11.201 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:47:11.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.314+0000 7fdbe09ba640 1 -- 172.21.15.146:0/2725773884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc073bf0 msgr2=0x7fdbdc15fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.314+0000 7fdbe09ba640 1 --2- 172.21.15.146:0/2725773884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc073bf0 0x7fdbdc15fa10 secure :-1 s=READY pgs=2683 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc15c710 tx=0x7fdbd402a920 comp rx=0 tx=0).stop 2024-09-17T03:47:11.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.314+0000 7fdbe09ba640 1 -- 172.21.15.146:0/2725773884 shutdown_connections 2024-09-17T03:47:11.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.314+0000 7fdbe09ba640 1 --2- 172.21.15.146:0/2725773884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc073bf0 0x7fdbdc15fa10 unknown :-1 s=CLOSED pgs=2683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.314+0000 7fdbe09ba640 1 -- 172.21.15.146:0/2725773884 >> 172.21.15.146:0/2725773884 conn(0x7fdbdc0d16c0 msgr2=0x7fdbdc0d1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:11.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.314+0000 7fdbe09ba640 1 -- 172.21.15.146:0/2725773884 shutdown_connections 2024-09-17T03:47:11.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.314+0000 7fdbe09ba640 1 -- 172.21.15.146:0/2725773884 wait complete. 2024-09-17T03:47:11.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.316+0000 7fdbe09ba640 1 Processor -- start 2024-09-17T03:47:11.316 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.316+0000 7fdbe09ba640 1 -- start start 2024-09-17T03:47:11.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.317+0000 7fdbe09ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbdc0b0cc0 0x7fdbdc1e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.317+0000 7fdbe09ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc15f600 0x7fdbdc1e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.317+0000 7fdbe09ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbdc0d02e0 0x7fdbdc0d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.317+0000 7fdbe09ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc070860 con 0x7fdbdc15f600 2024-09-17T03:47:11.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.317+0000 7fdbe09ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc0706e0 con 0x7fdbdc0d02e0 2024-09-17T03:47:11.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.317+0000 7fdbe09ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdbdc0709e0 con 0x7fdbdc0b0cc0 2024-09-17T03:47:11.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc15f600 0x7fdbdc1e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd1d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc15f600 0x7fdbdc1e58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45956/0 (socket says 172.21.15.146:45956) 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd1d9b640 1 -- 172.21.15.146:0/3304909864 learned_addr learned my addr 172.21.15.146:0/3304909864 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbdad9d640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbdc0d02e0 0x7fdbdc0d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbda59c640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbdc0b0cc0 0x7fdbdc1e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd1d9b640 1 -- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbdc0b0cc0 msgr2=0x7fdbdc1e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd1d9b640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbdc0b0cc0 0x7fdbdc1e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd1d9b640 1 -- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbdc0d02e0 msgr2=0x7fdbdc0d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd1d9b640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbdc0d02e0 0x7fdbdc0d06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd1d9b640 1 -- 172.21.15.146:0/3304909864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc0d0c30 con 0x7fdbdc15f600 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbda59c640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbdc0b0cc0 0x7fdbdc1e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd1d9b640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc15f600 0x7fdbdc1e58e0 secure :-1 s=READY pgs=2684 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c3a0 tx=0x7fdbc400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd37fe640 1 -- 172.21.15.146:0/3304909864 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4011790 con 0x7fdbdc15f600 2024-09-17T03:47:11.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd37fe640 1 -- 172.21.15.146:0/3304909864 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbc4017070 con 0x7fdbdc15f600 2024-09-17T03:47:11.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbe09ba640 1 -- 172.21.15.146:0/3304909864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbdc1f70b0 con 0x7fdbdc15f600 2024-09-17T03:47:11.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbd37fe640 1 -- 172.21.15.146:0/3304909864 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4011ce0 con 0x7fdbdc15f600 2024-09-17T03:47:11.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.318+0000 7fdbe09ba640 1 -- 172.21.15.146:0/3304909864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbdc1f7670 con 0x7fdbdc15f600 2024-09-17T03:47:11.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.319+0000 7fdbe09ba640 1 -- 172.21.15.146:0/3304909864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbdc1f6e20 con 0x7fdbdc15f600 2024-09-17T03:47:11.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.320+0000 7fdbd37fe640 1 -- 172.21.15.146:0/3304909864 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbc401c460 con 0x7fdbdc15f600 2024-09-17T03:47:11.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.321+0000 7fdbd37fe640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbbc078b90 0x7fdbbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.321+0000 7fdbd37fe640 1 -- 172.21.15.146:0/3304909864 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7fdbc409aaa0 con 0x7fdbdc15f600 2024-09-17T03:47:11.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.321+0000 7fdbda59c640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbbc078b90 0x7fdbbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.321+0000 7fdbda59c640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbbc078b90 0x7fdbbc07b0a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0016a0 tx=0x7fdbcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:11.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.325+0000 7fdbd37fe640 1 -- 172.21.15.146:0/3304909864 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdbdc0d0c30 con 0x7fdbdc15f600 2024-09-17T03:47:11.496 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.496+0000 7fdbe09ba640 1 -- 172.21.15.146:0/3304909864 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbdc070e90 con 0x7fdbbc078b90 2024-09-17T03:47:11.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.501+0000 7fdbd37fe640 1 -- 172.21.15.146:0/3304909864 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252472 (secure 0 0 0) 0x7fdbdc070e90 con 0x7fdbbc078b90 2024-09-17T03:47:11.504 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:11.505 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 -- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbbc078b90 msgr2=0x7fdbbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbbc078b90 0x7fdbbc07b0a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0016a0 tx=0x7fdbcc009040 comp rx=0 tx=0).stop 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 -- 172.21.15.146:0/3304909864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc15f600 msgr2=0x7fdbdc1e58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc15f600 0x7fdbdc1e58e0 secure :-1 s=READY pgs=2684 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c3a0 tx=0x7fdbc400c860 comp rx=0 tx=0).stop 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 -- 172.21.15.146:0/3304909864 shutdown_connections 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdbbc078b90 0x7fdbbc07b0a0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbdc0d02e0 0x7fdbdc0d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbdc15f600 0x7fdbdc1e58e0 unknown :-1 s=CLOSED pgs=2684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 --2- 172.21.15.146:0/3304909864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdbdc0b0cc0 0x7fdbdc1e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 -- 172.21.15.146:0/3304909864 >> 172.21.15.146:0/3304909864 conn(0x7fdbdc0d16c0 msgr2=0x7fdbdc0b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 -- 172.21.15.146:0/3304909864 shutdown_connections 2024-09-17T03:47:11.507 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.504+0000 7fdbe09ba640 1 -- 172.21.15.146:0/3304909864 wait complete. 2024-09-17T03:47:11.516 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":635,"stamp":"2024-09-17T03:47:10.018211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":475380,"kb_used_data":21884,"kb_used_omap":12,"kb_used_meta":453299,"kb_avail":754499340,"statfs":{"total":773094113280,"available":772607324160,"internally_reserved":0,"allocated":22409216,"data_stored":10499512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":464178737},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.539024"},"pg_stats":[{"pgid":"33.3f","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491804+0000","last_change":"2024-09-17T03:47:07.502251+0000","last_active":"2024-09-17T03:47:08.491804+0000","last_peered":"2024-09-17T03:47:08.491804+0000","last_clean":"2024-09-17T03:47:08.491804+0000","last_became_active":"2024-09-17T03:47:07.501914+0000","last_became_peered":"2024-09-17T03:47:07.501914+0000","last_unstale":"2024-09-17T03:47:08.491804+0000","last_undegraded":"2024-09-17T03:47:08.491804+0000","last_fullsized":"2024-09-17T03:47:08.491804+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:58.364229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.3e","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148094+0000","last_change":"2024-09-17T03:47:07.519718+0000","last_active":"2024-09-17T03:47:09.148094+0000","last_peered":"2024-09-17T03:47:09.148094+0000","last_clean":"2024-09-17T03:47:09.148094+0000","last_became_active":"2024-09-17T03:47:07.519365+0000","last_became_peered":"2024-09-17T03:47:07.519365+0000","last_unstale":"2024-09-17T03:47:09.148094+0000","last_undegraded":"2024-09-17T03:47:09.148094+0000","last_fullsized":"2024-09-17T03:47:09.148094+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:06.891258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.3d","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.514070+0000","last_change":"2024-09-17T03:47:07.510993+0000","last_active":"2024-09-17T03:47:07.514070+0000","last_peered":"2024-09-17T03:47:07.514070+0000","last_clean":"2024-09-17T03:47:07.514070+0000","last_became_active":"2024-09-17T03:47:07.509223+0000","last_became_peered":"2024-09-17T03:47:07.509223+0000","last_unstale":"2024-09-17T03:47:07.514070+0000","last_undegraded":"2024-09-17T03:47:07.514070+0000","last_fullsized":"2024-09-17T03:47:07.514070+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:03.487851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.3c","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.509809+0000","last_change":"2024-09-17T03:47:07.504211+0000","last_active":"2024-09-17T03:47:07.509809+0000","last_peered":"2024-09-17T03:47:07.509809+0000","last_clean":"2024-09-17T03:47:07.509809+0000","last_became_active":"2024-09-17T03:47:07.503856+0000","last_became_peered":"2024-09-17T03:47:07.503856+0000","last_unstale":"2024-09-17T03:47:07.509809+0000","last_undegraded":"2024-09-17T03:47:07.509809+0000","last_fullsized":"2024-09-17T03:47:07.509809+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:59.798938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.3b","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.511635+0000","last_change":"2024-09-17T03:47:07.509082+0000","last_active":"2024-09-17T03:47:07.511635+0000","last_peered":"2024-09-17T03:47:07.511635+0000","last_clean":"2024-09-17T03:47:07.511635+0000","last_became_active":"2024-09-17T03:47:07.508754+0000","last_became_peered":"2024-09-17T03:47:07.508754+0000","last_unstale":"2024-09-17T03:47:07.511635+0000","last_undegraded":"2024-09-17T03:47:07.511635+0000","last_fullsized":"2024-09-17T03:47:07.511635+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:33.587077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.3a","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.639976+0000","last_change":"2024-09-17T03:47:07.505296+0000","last_active":"2024-09-17T03:47:08.639976+0000","last_peered":"2024-09-17T03:47:08.639976+0000","last_clean":"2024-09-17T03:47:08.639976+0000","last_became_active":"2024-09-17T03:47:07.504988+0000","last_became_peered":"2024-09-17T03:47:07.504988+0000","last_unstale":"2024-09-17T03:47:08.639976+0000","last_undegraded":"2024-09-17T03:47:08.639976+0000","last_fullsized":"2024-09-17T03:47:08.639976+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:30.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.39","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492129+0000","last_change":"2024-09-17T03:47:07.511627+0000","last_active":"2024-09-17T03:47:08.492129+0000","last_peered":"2024-09-17T03:47:08.492129+0000","last_clean":"2024-09-17T03:47:08.492129+0000","last_became_active":"2024-09-17T03:47:07.510708+0000","last_became_peered":"2024-09-17T03:47:07.510708+0000","last_unstale":"2024-09-17T03:47:08.492129+0000","last_undegraded":"2024-09-17T03:47:08.492129+0000","last_fullsized":"2024-09-17T03:47:08.492129+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:12.371481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.38","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.490978+0000","last_change":"2024-09-17T03:47:07.512047+0000","last_active":"2024-09-17T03:47:08.490978+0000","last_peered":"2024-09-17T03:47:08.490978+0000","last_clean":"2024-09-17T03:47:08.490978+0000","last_became_active":"2024-09-17T03:47:07.511718+0000","last_became_peered":"2024-09-17T03:47:07.511718+0000","last_unstale":"2024-09-17T03:47:08.490978+0000","last_undegraded":"2024-09-17T03:47:08.490978+0000","last_fullsized":"2024-09-17T03:47:08.490978+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:25.602119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.37","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489993+0000","last_change":"2024-09-17T03:47:07.507284+0000","last_active":"2024-09-17T03:47:08.489993+0000","last_peered":"2024-09-17T03:47:08.489993+0000","last_clean":"2024-09-17T03:47:08.489993+0000","last_became_active":"2024-09-17T03:47:07.506987+0000","last_became_peered":"2024-09-17T03:47:07.506987+0000","last_unstale":"2024-09-17T03:47:08.489993+0000","last_undegraded":"2024-09-17T03:47:08.489993+0000","last_fullsized":"2024-09-17T03:47:08.489993+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:50.904096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.36","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.493047+0000","last_change":"2024-09-17T03:47:07.502184+0000","last_active":"2024-09-17T03:47:08.493047+0000","last_peered":"2024-09-17T03:47:08.493047+0000","last_clean":"2024-09-17T03:47:08.493047+0000","last_became_active":"2024-09-17T03:47:07.501863+0000","last_became_peered":"2024-09-17T03:47:07.501863+0000","last_unstale":"2024-09-17T03:47:08.493047+0000","last_undegraded":"2024-09-17T03:47:08.493047+0000","last_fullsized":"2024-09-17T03:47:08.493047+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:29.887804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.35","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492594+0000","last_change":"2024-09-17T03:47:07.501148+0000","last_active":"2024-09-17T03:47:08.492594+0000","last_peered":"2024-09-17T03:47:08.492594+0000","last_clean":"2024-09-17T03:47:08.492594+0000","last_became_active":"2024-09-17T03:47:07.500813+0000","last_became_peered":"2024-09-17T03:47:07.500813+0000","last_unstale":"2024-09-17T03:47:08.492594+0000","last_undegraded":"2024-09-17T03:47:08.492594+0000","last_fullsized":"2024-09-17T03:47:08.492594+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:00.366207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.34","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491516+0000","last_change":"2024-09-17T03:47:07.507210+0000","last_active":"2024-09-17T03:47:08.491516+0000","last_peered":"2024-09-17T03:47:08.491516+0000","last_clean":"2024-09-17T03:47:08.491516+0000","last_became_active":"2024-09-17T03:47:07.506879+0000","last_became_peered":"2024-09-17T03:47:07.506879+0000","last_unstale":"2024-09-17T03:47:08.491516+0000","last_undegraded":"2024-09-17T03:47:08.491516+0000","last_fullsized":"2024-09-17T03:47:08.491516+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:21.066329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.33","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147512+0000","last_change":"2024-09-17T03:47:07.508027+0000","last_active":"2024-09-17T03:47:09.147512+0000","last_peered":"2024-09-17T03:47:09.147512+0000","last_clean":"2024-09-17T03:47:09.147512+0000","last_became_active":"2024-09-17T03:47:07.507708+0000","last_became_peered":"2024-09-17T03:47:07.507708+0000","last_unstale":"2024-09-17T03:47:09.147512+0000","last_undegraded":"2024-09-17T03:47:09.147512+0000","last_fullsized":"2024-09-17T03:47:09.147512+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:49.258990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.32","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147563+0000","last_change":"2024-09-17T03:47:07.514841+0000","last_active":"2024-09-17T03:47:09.147563+0000","last_peered":"2024-09-17T03:47:09.147563+0000","last_clean":"2024-09-17T03:47:09.147563+0000","last_became_active":"2024-09-17T03:47:07.514523+0000","last_became_peered":"2024-09-17T03:47:07.514523+0000","last_unstale":"2024-09-17T03:47:09.147563+0000","last_undegraded":"2024-09-17T03:47:09.147563+0000","last_fullsized":"2024-09-17T03:47:09.147563+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:31.384975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.31","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147935+0000","last_change":"2024-09-17T03:47:07.511024+0000","last_active":"2024-09-17T03:47:09.147935+0000","last_peered":"2024-09-17T03:47:09.147935+0000","last_clean":"2024-09-17T03:47:09.147935+0000","last_became_active":"2024-09-17T03:47:07.510722+0000","last_became_peered":"2024-09-17T03:47:07.510722+0000","last_unstale":"2024-09-17T03:47:09.147935+0000","last_undegraded":"2024-09-17T03:47:09.147935+0000","last_fullsized":"2024-09-17T03:47:09.147935+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:06.183594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.30","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640225+0000","last_change":"2024-09-17T03:47:07.497521+0000","last_active":"2024-09-17T03:47:08.640225+0000","last_peered":"2024-09-17T03:47:08.640225+0000","last_clean":"2024-09-17T03:47:08.640225+0000","last_became_active":"2024-09-17T03:47:07.497219+0000","last_became_peered":"2024-09-17T03:47:07.497219+0000","last_unstale":"2024-09-17T03:47:08.640225+0000","last_undegraded":"2024-09-17T03:47:08.640225+0000","last_fullsized":"2024-09-17T03:47:08.640225+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:11.213699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.2f","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.516613+0000","last_change":"2024-09-17T03:47:07.509996+0000","last_active":"2024-09-17T03:47:07.516613+0000","last_peered":"2024-09-17T03:47:07.516613+0000","last_clean":"2024-09-17T03:47:07.516613+0000","last_became_active":"2024-09-17T03:47:07.509710+0000","last_became_peered":"2024-09-17T03:47:07.509710+0000","last_unstale":"2024-09-17T03:47:07.516613+0000","last_undegraded":"2024-09-17T03:47:07.516613+0000","last_fullsized":"2024-09-17T03:47:07.516613+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:56.928654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.2e","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.493239+0000","last_change":"2024-09-17T03:47:07.515837+0000","last_active":"2024-09-17T03:47:08.493239+0000","last_peered":"2024-09-17T03:47:08.493239+0000","last_clean":"2024-09-17T03:47:08.493239+0000","last_became_active":"2024-09-17T03:47:07.513438+0000","last_became_peered":"2024-09-17T03:47:07.513438+0000","last_unstale":"2024-09-17T03:47:08.493239+0000","last_undegraded":"2024-09-17T03:47:08.493239+0000","last_fullsized":"2024-09-17T03:47:08.493239+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:28.583499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.2d","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492995+0000","last_change":"2024-09-17T03:47:07.498014+0000","last_active":"2024-09-17T03:47:08.492995+0000","last_peered":"2024-09-17T03:47:08.492995+0000","last_clean":"2024-09-17T03:47:08.492995+0000","last_became_active":"2024-09-17T03:47:07.497596+0000","last_became_peered":"2024-09-17T03:47:07.497596+0000","last_unstale":"2024-09-17T03:47:08.492995+0000","last_undegraded":"2024-09-17T03:47:08.492995+0000","last_fullsized":"2024-09-17T03:47:08.492995+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:24.700775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.2c","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640057+0000","last_change":"2024-09-17T03:47:07.500358+0000","last_active":"2024-09-17T03:47:08.640057+0000","last_peered":"2024-09-17T03:47:08.640057+0000","last_clean":"2024-09-17T03:47:08.640057+0000","last_became_active":"2024-09-17T03:47:07.500016+0000","last_became_peered":"2024-09-17T03:47:07.500016+0000","last_unstale":"2024-09-17T03:47:08.640057+0000","last_undegraded":"2024-09-17T03:47:08.640057+0000","last_fullsized":"2024-09-17T03:47:08.640057+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:51.726852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.2b","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489688+0000","last_change":"2024-09-17T03:47:07.510258+0000","last_active":"2024-09-17T03:47:08.489688+0000","last_peered":"2024-09-17T03:47:08.489688+0000","last_clean":"2024-09-17T03:47:08.489688+0000","last_became_active":"2024-09-17T03:47:07.509970+0000","last_became_peered":"2024-09-17T03:47:07.509970+0000","last_unstale":"2024-09-17T03:47:08.489688+0000","last_undegraded":"2024-09-17T03:47:08.489688+0000","last_fullsized":"2024-09-17T03:47:08.489688+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:30.301128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2a","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489753+0000","last_change":"2024-09-17T03:47:07.506800+0000","last_active":"2024-09-17T03:47:08.489753+0000","last_peered":"2024-09-17T03:47:08.489753+0000","last_clean":"2024-09-17T03:47:08.489753+0000","last_became_active":"2024-09-17T03:47:07.506490+0000","last_became_peered":"2024-09-17T03:47:07.506490+0000","last_unstale":"2024-09-17T03:47:08.489753+0000","last_undegraded":"2024-09-17T03:47:08.489753+0000","last_fullsized":"2024-09-17T03:47:08.489753+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:27.734024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.29","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492384+0000","last_change":"2024-09-17T03:47:07.502536+0000","last_active":"2024-09-17T03:47:08.492384+0000","last_peered":"2024-09-17T03:47:08.492384+0000","last_clean":"2024-09-17T03:47:08.492384+0000","last_became_active":"2024-09-17T03:47:07.502223+0000","last_became_peered":"2024-09-17T03:47:07.502223+0000","last_unstale":"2024-09-17T03:47:08.492384+0000","last_undegraded":"2024-09-17T03:47:08.492384+0000","last_fullsized":"2024-09-17T03:47:08.492384+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:28.943917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.28","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.515064+0000","last_change":"2024-09-17T03:47:07.510251+0000","last_active":"2024-09-17T03:47:07.515064+0000","last_peered":"2024-09-17T03:47:07.515064+0000","last_clean":"2024-09-17T03:47:07.515064+0000","last_became_active":"2024-09-17T03:47:07.508411+0000","last_became_peered":"2024-09-17T03:47:07.508411+0000","last_unstale":"2024-09-17T03:47:07.515064+0000","last_undegraded":"2024-09-17T03:47:07.515064+0000","last_fullsized":"2024-09-17T03:47:07.515064+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:15.398520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.27","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148010+0000","last_change":"2024-09-17T03:47:07.503855+0000","last_active":"2024-09-17T03:47:09.148010+0000","last_peered":"2024-09-17T03:47:09.148010+0000","last_clean":"2024-09-17T03:47:09.148010+0000","last_became_active":"2024-09-17T03:47:07.503021+0000","last_became_peered":"2024-09-17T03:47:07.503021+0000","last_unstale":"2024-09-17T03:47:09.148010+0000","last_undegraded":"2024-09-17T03:47:09.148010+0000","last_fullsized":"2024-09-17T03:47:09.148010+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:35.519739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.26","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.514652+0000","last_change":"2024-09-17T03:47:07.513351+0000","last_active":"2024-09-17T03:47:07.514652+0000","last_peered":"2024-09-17T03:47:07.514652+0000","last_clean":"2024-09-17T03:47:07.514652+0000","last_became_active":"2024-09-17T03:47:07.512991+0000","last_became_peered":"2024-09-17T03:47:07.512991+0000","last_unstale":"2024-09-17T03:47:07.514652+0000","last_undegraded":"2024-09-17T03:47:07.514652+0000","last_fullsized":"2024-09-17T03:47:07.514652+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:49.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.25","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492993+0000","last_change":"2024-09-17T03:47:07.512146+0000","last_active":"2024-09-17T03:47:08.492993+0000","last_peered":"2024-09-17T03:47:08.492993+0000","last_clean":"2024-09-17T03:47:08.492993+0000","last_became_active":"2024-09-17T03:47:07.511803+0000","last_became_peered":"2024-09-17T03:47:07.511803+0000","last_unstale":"2024-09-17T03:47:08.492993+0000","last_undegraded":"2024-09-17T03:47:08.492993+0000","last_fullsized":"2024-09-17T03:47:08.492993+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:11.213699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.24","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147989+0000","last_change":"2024-09-17T03:47:07.502264+0000","last_active":"2024-09-17T03:47:09.147989+0000","last_peered":"2024-09-17T03:47:09.147989+0000","last_clean":"2024-09-17T03:47:09.147989+0000","last_became_active":"2024-09-17T03:47:07.501967+0000","last_became_peered":"2024-09-17T03:47:07.501967+0000","last_unstale":"2024-09-17T03:47:09.147989+0000","last_undegraded":"2024-09-17T03:47:09.147989+0000","last_fullsized":"2024-09-17T03:47:09.147989+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:33.169978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.23","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.500310+0000","last_change":"2024-09-17T03:47:07.498673+0000","last_active":"2024-09-17T03:47:07.500310+0000","last_peered":"2024-09-17T03:47:07.500310+0000","last_clean":"2024-09-17T03:47:07.500310+0000","last_became_active":"2024-09-17T03:47:07.498345+0000","last_became_peered":"2024-09-17T03:47:07.498345+0000","last_unstale":"2024-09-17T03:47:07.500310+0000","last_undegraded":"2024-09-17T03:47:07.500310+0000","last_fullsized":"2024-09-17T03:47:07.500310+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:38.268532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.22","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147463+0000","last_change":"2024-09-17T03:47:07.508959+0000","last_active":"2024-09-17T03:47:09.147463+0000","last_peered":"2024-09-17T03:47:09.147463+0000","last_clean":"2024-09-17T03:47:09.147463+0000","last_became_active":"2024-09-17T03:47:07.508684+0000","last_became_peered":"2024-09-17T03:47:07.508684+0000","last_unstale":"2024-09-17T03:47:09.147463+0000","last_undegraded":"2024-09-17T03:47:09.147463+0000","last_fullsized":"2024-09-17T03:47:09.147463+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:45.667841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.21","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.490984+0000","last_change":"2024-09-17T03:47:07.501494+0000","last_active":"2024-09-17T03:47:08.490984+0000","last_peered":"2024-09-17T03:47:08.490984+0000","last_clean":"2024-09-17T03:47:08.490984+0000","last_became_active":"2024-09-17T03:47:07.501147+0000","last_became_peered":"2024-09-17T03:47:07.501147+0000","last_unstale":"2024-09-17T03:47:08.490984+0000","last_undegraded":"2024-09-17T03:47:08.490984+0000","last_fullsized":"2024-09-17T03:47:08.490984+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:50.028442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.1e","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.493209+0000","last_change":"2024-09-17T03:47:07.519220+0000","last_active":"2024-09-17T03:47:08.493209+0000","last_peered":"2024-09-17T03:47:08.493209+0000","last_clean":"2024-09-17T03:47:08.493209+0000","last_became_active":"2024-09-17T03:47:07.518750+0000","last_became_peered":"2024-09-17T03:47:07.518750+0000","last_unstale":"2024-09-17T03:47:08.493209+0000","last_undegraded":"2024-09-17T03:47:08.493209+0000","last_fullsized":"2024-09-17T03:47:08.493209+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:44.358945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1f","version":"209'4","reported_seq":17,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.521564+0000","last_change":"2024-09-17T03:47:06.506564+0000","last_active":"2024-09-17T03:47:07.521564+0000","last_peered":"2024-09-17T03:47:07.521564+0000","last_clean":"2024-09-17T03:47:07.521564+0000","last_became_active":"2024-09-17T03:47:06.506137+0000","last_became_peered":"2024-09-17T03:47:06.506137+0000","last_unstale":"2024-09-17T03:47:07.521564+0000","last_undegraded":"2024-09-17T03:47:07.521564+0000","last_fullsized":"2024-09-17T03:47:07.521564+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:12.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.1f","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148084+0000","last_change":"2024-09-17T03:47:07.514367+0000","last_active":"2024-09-17T03:47:09.148084+0000","last_peered":"2024-09-17T03:47:09.148084+0000","last_clean":"2024-09-17T03:47:09.148084+0000","last_became_active":"2024-09-17T03:47:07.513832+0000","last_became_peered":"2024-09-17T03:47:07.513832+0000","last_unstale":"2024-09-17T03:47:09.148084+0000","last_undegraded":"2024-09-17T03:47:09.148084+0000","last_fullsized":"2024-09-17T03:47:09.148084+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:51.271333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1e","version":"209'1","reported_seq":16,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147881+0000","last_change":"2024-09-17T03:47:06.501297+0000","last_active":"2024-09-17T03:47:09.147881+0000","last_peered":"2024-09-17T03:47:09.147881+0000","last_clean":"2024-09-17T03:47:09.147881+0000","last_became_active":"2024-09-17T03:47:06.500936+0000","last_became_peered":"2024-09-17T03:47:06.500936+0000","last_unstale":"2024-09-17T03:47:09.147881+0000","last_undegraded":"2024-09-17T03:47:09.147881+0000","last_fullsized":"2024-09-17T03:47:09.147881+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:18.246424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1c","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492215+0000","last_change":"2024-09-17T03:47:07.501003+0000","last_active":"2024-09-17T03:47:08.492215+0000","last_peered":"2024-09-17T03:47:08.492215+0000","last_clean":"2024-09-17T03:47:08.492215+0000","last_became_active":"2024-09-17T03:47:07.500668+0000","last_became_peered":"2024-09-17T03:47:07.500668+0000","last_unstale":"2024-09-17T03:47:08.492215+0000","last_undegraded":"2024-09-17T03:47:08.492215+0000","last_fullsized":"2024-09-17T03:47:08.492215+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:03.591415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1d","version":"209'2","reported_seq":17,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640376+0000","last_change":"2024-09-17T03:47:06.498904+0000","last_active":"2024-09-17T03:47:08.640376+0000","last_peered":"2024-09-17T03:47:08.640376+0000","last_clean":"2024-09-17T03:47:08.640376+0000","last_became_active":"2024-09-17T03:47:06.498572+0000","last_became_peered":"2024-09-17T03:47:06.498572+0000","last_unstale":"2024-09-17T03:47:08.640376+0000","last_undegraded":"2024-09-17T03:47:08.640376+0000","last_fullsized":"2024-09-17T03:47:08.640376+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:44.831128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.1d","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491511+0000","last_change":"2024-09-17T03:47:07.503139+0000","last_active":"2024-09-17T03:47:08.491511+0000","last_peered":"2024-09-17T03:47:08.491511+0000","last_clean":"2024-09-17T03:47:08.491511+0000","last_became_active":"2024-09-17T03:47:07.502491+0000","last_became_peered":"2024-09-17T03:47:07.502491+0000","last_unstale":"2024-09-17T03:47:08.491511+0000","last_undegraded":"2024-09-17T03:47:08.491511+0000","last_fullsized":"2024-09-17T03:47:08.491511+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:36.988601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.1c","version":"209'2","reported_seq":17,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640048+0000","last_change":"2024-09-17T03:47:06.500377+0000","last_active":"2024-09-17T03:47:08.640048+0000","last_peered":"2024-09-17T03:47:08.640048+0000","last_clean":"2024-09-17T03:47:08.640048+0000","last_became_active":"2024-09-17T03:47:06.499861+0000","last_became_peered":"2024-09-17T03:47:06.499861+0000","last_unstale":"2024-09-17T03:47:08.640048+0000","last_undegraded":"2024-09-17T03:47:08.640048+0000","last_fullsized":"2024-09-17T03:47:08.640048+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:20.691684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.1a","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489622+0000","last_change":"2024-09-17T03:47:07.508994+0000","last_active":"2024-09-17T03:47:08.489622+0000","last_peered":"2024-09-17T03:47:08.489622+0000","last_clean":"2024-09-17T03:47:08.489622+0000","last_became_active":"2024-09-17T03:47:07.507935+0000","last_became_peered":"2024-09-17T03:47:07.507935+0000","last_unstale":"2024-09-17T03:47:08.489622+0000","last_undegraded":"2024-09-17T03:47:08.489622+0000","last_fullsized":"2024-09-17T03:47:08.489622+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:38.529657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1b","version":"209'1","reported_seq":16,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491865+0000","last_change":"2024-09-17T03:47:06.501218+0000","last_active":"2024-09-17T03:47:08.491865+0000","last_peered":"2024-09-17T03:47:08.491865+0000","last_clean":"2024-09-17T03:47:08.491865+0000","last_became_active":"2024-09-17T03:47:06.499652+0000","last_became_peered":"2024-09-17T03:47:06.499652+0000","last_unstale":"2024-09-17T03:47:08.491865+0000","last_undegraded":"2024-09-17T03:47:08.491865+0000","last_fullsized":"2024-09-17T03:47:08.491865+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:20.691684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1b","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640142+0000","last_change":"2024-09-17T03:47:07.512734+0000","last_active":"2024-09-17T03:47:08.640142+0000","last_peered":"2024-09-17T03:47:08.640142+0000","last_clean":"2024-09-17T03:47:08.640142+0000","last_became_active":"2024-09-17T03:47:07.512386+0000","last_became_peered":"2024-09-17T03:47:07.512386+0000","last_unstale":"2024-09-17T03:47:08.640142+0000","last_undegraded":"2024-09-17T03:47:08.640142+0000","last_fullsized":"2024-09-17T03:47:08.640142+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:58.221000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1a","version":"209'1","reported_seq":14,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.511539+0000","last_change":"2024-09-17T03:47:06.490545+0000","last_active":"2024-09-17T03:47:07.511539+0000","last_peered":"2024-09-17T03:47:07.511539+0000","last_clean":"2024-09-17T03:47:07.511539+0000","last_became_active":"2024-09-17T03:47:06.490177+0000","last_became_peered":"2024-09-17T03:47:06.490177+0000","last_unstale":"2024-09-17T03:47:07.511539+0000","last_undegraded":"2024-09-17T03:47:07.511539+0000","last_fullsized":"2024-09-17T03:47:07.511539+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:29.292788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.639914+0000","last_change":"2024-09-17T03:47:07.504019+0000","last_active":"2024-09-17T03:47:08.639914+0000","last_peered":"2024-09-17T03:47:08.639914+0000","last_clean":"2024-09-17T03:47:08.639914+0000","last_became_active":"2024-09-17T03:47:07.503650+0000","last_became_peered":"2024-09-17T03:47:07.503650+0000","last_unstale":"2024-09-17T03:47:08.639914+0000","last_undegraded":"2024-09-17T03:47:08.639914+0000","last_fullsized":"2024-09-17T03:47:08.639914+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:05.359610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.503446+0000","last_change":"2024-09-17T03:47:06.503048+0000","last_active":"2024-09-17T03:47:07.503446+0000","last_peered":"2024-09-17T03:47:07.503446+0000","last_clean":"2024-09-17T03:47:07.503446+0000","last_became_active":"2024-09-17T03:47:06.502732+0000","last_became_peered":"2024-09-17T03:47:06.502732+0000","last_unstale":"2024-09-17T03:47:07.503446+0000","last_undegraded":"2024-09-17T03:47:07.503446+0000","last_fullsized":"2024-09-17T03:47:07.503446+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:49.667823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492654+0000","last_change":"2024-09-17T03:47:07.511966+0000","last_active":"2024-09-17T03:47:08.492654+0000","last_peered":"2024-09-17T03:47:08.492654+0000","last_clean":"2024-09-17T03:47:08.492654+0000","last_became_active":"2024-09-17T03:47:07.511304+0000","last_became_peered":"2024-09-17T03:47:07.511304+0000","last_unstale":"2024-09-17T03:47:08.492654+0000","last_undegraded":"2024-09-17T03:47:08.492654+0000","last_fullsized":"2024-09-17T03:47:08.492654+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:29.219289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491526+0000","last_change":"2024-09-17T03:47:06.507809+0000","last_active":"2024-09-17T03:47:08.491526+0000","last_peered":"2024-09-17T03:47:08.491526+0000","last_clean":"2024-09-17T03:47:08.491526+0000","last_became_active":"2024-09-17T03:47:06.507466+0000","last_became_peered":"2024-09-17T03:47:06.507466+0000","last_unstale":"2024-09-17T03:47:08.491526+0000","last_undegraded":"2024-09-17T03:47:08.491526+0000","last_fullsized":"2024-09-17T03:47:08.491526+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:48.089017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.493353+0000","last_change":"2024-09-17T03:47:07.517593+0000","last_active":"2024-09-17T03:47:08.493353+0000","last_peered":"2024-09-17T03:47:08.493353+0000","last_clean":"2024-09-17T03:47:08.493353+0000","last_became_active":"2024-09-17T03:47:07.510865+0000","last_became_peered":"2024-09-17T03:47:07.510865+0000","last_unstale":"2024-09-17T03:47:08.493353+0000","last_undegraded":"2024-09-17T03:47:08.493353+0000","last_fullsized":"2024-09-17T03:47:08.493353+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:14.421372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.490373+0000","last_change":"2024-09-17T03:47:06.503612+0000","last_active":"2024-09-17T03:47:07.490373+0000","last_peered":"2024-09-17T03:47:07.490373+0000","last_clean":"2024-09-17T03:47:07.490373+0000","last_became_active":"2024-09-17T03:47:06.503311+0000","last_became_peered":"2024-09-17T03:47:06.503311+0000","last_unstale":"2024-09-17T03:47:07.490373+0000","last_undegraded":"2024-09-17T03:47:07.490373+0000","last_fullsized":"2024-09-17T03:47:07.490373+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:34.236070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.504540+0000","last_change":"2024-09-17T03:47:07.500153+0000","last_active":"2024-09-17T03:47:07.504540+0000","last_peered":"2024-09-17T03:47:07.504540+0000","last_clean":"2024-09-17T03:47:07.504540+0000","last_became_active":"2024-09-17T03:47:07.499461+0000","last_became_peered":"2024-09-17T03:47:07.499461+0000","last_unstale":"2024-09-17T03:47:07.504540+0000","last_undegraded":"2024-09-17T03:47:07.504540+0000","last_fullsized":"2024-09-17T03:47:07.504540+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:10.369545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640158+0000","last_change":"2024-09-17T03:47:06.507145+0000","last_active":"2024-09-17T03:47:08.640158+0000","last_peered":"2024-09-17T03:47:08.640158+0000","last_clean":"2024-09-17T03:47:08.640158+0000","last_became_active":"2024-09-17T03:47:06.506341+0000","last_became_peered":"2024-09-17T03:47:06.506341+0000","last_unstale":"2024-09-17T03:47:08.640158+0000","last_undegraded":"2024-09-17T03:47:08.640158+0000","last_fullsized":"2024-09-17T03:47:08.640158+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:34.752860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.14","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147737+0000","last_change":"2024-09-17T03:47:07.514007+0000","last_active":"2024-09-17T03:47:09.147737+0000","last_peered":"2024-09-17T03:47:09.147737+0000","last_clean":"2024-09-17T03:47:09.147737+0000","last_became_active":"2024-09-17T03:47:07.513693+0000","last_became_peered":"2024-09-17T03:47:07.513693+0000","last_unstale":"2024-09-17T03:47:09.147737+0000","last_undegraded":"2024-09-17T03:47:09.147737+0000","last_fullsized":"2024-09-17T03:47:09.147737+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:25.143911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.15","version":"209'3","reported_seq":18,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640446+0000","last_change":"2024-09-17T03:47:06.502269+0000","last_active":"2024-09-17T03:47:08.640446+0000","last_peered":"2024-09-17T03:47:08.640446+0000","last_clean":"2024-09-17T03:47:08.640446+0000","last_became_active":"2024-09-17T03:47:06.501852+0000","last_became_peered":"2024-09-17T03:47:06.501852+0000","last_unstale":"2024-09-17T03:47:08.640446+0000","last_undegraded":"2024-09-17T03:47:08.640446+0000","last_fullsized":"2024-09-17T03:47:08.640446+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:40.995496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.15","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.500265+0000","last_change":"2024-09-17T03:47:07.498071+0000","last_active":"2024-09-17T03:47:07.500265+0000","last_peered":"2024-09-17T03:47:07.500265+0000","last_clean":"2024-09-17T03:47:07.500265+0000","last_became_active":"2024-09-17T03:47:07.497778+0000","last_became_peered":"2024-09-17T03:47:07.497778+0000","last_unstale":"2024-09-17T03:47:07.500265+0000","last_undegraded":"2024-09-17T03:47:07.500265+0000","last_fullsized":"2024-09-17T03:47:07.500265+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:55.912683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.14","version":"209'6","reported_seq":19,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.522039+0000","last_change":"2024-09-17T03:47:06.500185+0000","last_active":"2024-09-17T03:47:07.522039+0000","last_peered":"2024-09-17T03:47:07.522039+0000","last_clean":"2024-09-17T03:47:07.522039+0000","last_became_active":"2024-09-17T03:47:06.499855+0000","last_became_peered":"2024-09-17T03:47:06.499855+0000","last_unstale":"2024-09-17T03:47:07.522039+0000","last_undegraded":"2024-09-17T03:47:07.522039+0000","last_fullsized":"2024-09-17T03:47:07.522039+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:07.646710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.507514+0000","last_change":"2024-09-17T03:47:07.501864+0000","last_active":"2024-09-17T03:47:07.507514+0000","last_peered":"2024-09-17T03:47:07.507514+0000","last_clean":"2024-09-17T03:47:07.507514+0000","last_became_active":"2024-09-17T03:47:07.501577+0000","last_became_peered":"2024-09-17T03:47:07.501577+0000","last_unstale":"2024-09-17T03:47:07.507514+0000","last_undegraded":"2024-09-17T03:47:07.507514+0000","last_fullsized":"2024-09-17T03:47:07.507514+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:39.124165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"209'2","reported_seq":17,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491133+0000","last_change":"2024-09-17T03:47:06.501307+0000","last_active":"2024-09-17T03:47:08.491133+0000","last_peered":"2024-09-17T03:47:08.491133+0000","last_clean":"2024-09-17T03:47:08.491133+0000","last_became_active":"2024-09-17T03:47:06.500836+0000","last_became_peered":"2024-09-17T03:47:06.500836+0000","last_unstale":"2024-09-17T03:47:08.491133+0000","last_undegraded":"2024-09-17T03:47:08.491133+0000","last_fullsized":"2024-09-17T03:47:08.491133+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:29.167672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.13","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640120+0000","last_change":"2024-09-17T03:47:07.502797+0000","last_active":"2024-09-17T03:47:08.640120+0000","last_peered":"2024-09-17T03:47:08.640120+0000","last_clean":"2024-09-17T03:47:08.640120+0000","last_became_active":"2024-09-17T03:47:07.502461+0000","last_became_peered":"2024-09-17T03:47:07.502461+0000","last_unstale":"2024-09-17T03:47:08.640120+0000","last_undegraded":"2024-09-17T03:47:08.640120+0000","last_fullsized":"2024-09-17T03:47:08.640120+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:39.111155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489714+0000","last_change":"2024-09-17T03:47:06.505445+0000","last_active":"2024-09-17T03:47:08.489714+0000","last_peered":"2024-09-17T03:47:08.489714+0000","last_clean":"2024-09-17T03:47:08.489714+0000","last_became_active":"2024-09-17T03:47:06.505118+0000","last_became_peered":"2024-09-17T03:47:06.505118+0000","last_unstale":"2024-09-17T03:47:08.489714+0000","last_undegraded":"2024-09-17T03:47:08.489714+0000","last_fullsized":"2024-09-17T03:47:08.489714+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:29.175324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.10","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.515086+0000","last_change":"2024-09-17T03:47:07.510611+0000","last_active":"2024-09-17T03:47:07.515086+0000","last_peered":"2024-09-17T03:47:07.515086+0000","last_clean":"2024-09-17T03:47:07.515086+0000","last_became_active":"2024-09-17T03:47:07.508052+0000","last_became_peered":"2024-09-17T03:47:07.508052+0000","last_unstale":"2024-09-17T03:47:07.515086+0000","last_undegraded":"2024-09-17T03:47:07.515086+0000","last_fullsized":"2024-09-17T03:47:07.515086+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:09.075213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147757+0000","last_change":"2024-09-17T03:47:06.500773+0000","last_active":"2024-09-17T03:47:09.147757+0000","last_peered":"2024-09-17T03:47:09.147757+0000","last_clean":"2024-09-17T03:47:09.147757+0000","last_became_active":"2024-09-17T03:47:06.500209+0000","last_became_peered":"2024-09-17T03:47:06.500209+0000","last_unstale":"2024-09-17T03:47:09.147757+0000","last_undegraded":"2024-09-17T03:47:09.147757+0000","last_fullsized":"2024-09-17T03:47:09.147757+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:55.583872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.515885+0000","last_change":"2024-09-17T03:47:07.513100+0000","last_active":"2024-09-17T03:47:07.515885+0000","last_peered":"2024-09-17T03:47:07.515885+0000","last_clean":"2024-09-17T03:47:07.515885+0000","last_became_active":"2024-09-17T03:47:07.512813+0000","last_became_peered":"2024-09-17T03:47:07.512813+0000","last_unstale":"2024-09-17T03:47:07.515885+0000","last_undegraded":"2024-09-17T03:47:07.515885+0000","last_fullsized":"2024-09-17T03:47:07.515885+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:21.112355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.10","version":"209'8","reported_seq":23,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640115+0000","last_change":"2024-09-17T03:47:06.510721+0000","last_active":"2024-09-17T03:47:08.640115+0000","last_peered":"2024-09-17T03:47:08.640115+0000","last_clean":"2024-09-17T03:47:08.640115+0000","last_became_active":"2024-09-17T03:47:06.510369+0000","last_became_peered":"2024-09-17T03:47:06.510369+0000","last_unstale":"2024-09-17T03:47:08.640115+0000","last_undegraded":"2024-09-17T03:47:08.640115+0000","last_fullsized":"2024-09-17T03:47:08.640115+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:47.470187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.e","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147760+0000","last_change":"2024-09-17T03:47:07.513415+0000","last_active":"2024-09-17T03:47:09.147760+0000","last_peered":"2024-09-17T03:47:09.147760+0000","last_clean":"2024-09-17T03:47:09.147760+0000","last_became_active":"2024-09-17T03:47:07.512812+0000","last_became_peered":"2024-09-17T03:47:07.512812+0000","last_unstale":"2024-09-17T03:47:09.147760+0000","last_undegraded":"2024-09-17T03:47:09.147760+0000","last_fullsized":"2024-09-17T03:47:09.147760+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:52.995220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.f","version":"209'1","reported_seq":16,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491800+0000","last_change":"2024-09-17T03:47:06.498537+0000","last_active":"2024-09-17T03:47:08.491800+0000","last_peered":"2024-09-17T03:47:08.491800+0000","last_clean":"2024-09-17T03:47:08.491800+0000","last_became_active":"2024-09-17T03:47:06.498183+0000","last_became_peered":"2024-09-17T03:47:06.498183+0000","last_unstale":"2024-09-17T03:47:08.491800+0000","last_undegraded":"2024-09-17T03:47:08.491800+0000","last_fullsized":"2024-09-17T03:47:08.491800+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:07.443457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148426+0000","last_change":"2024-09-17T03:47:07.509460+0000","last_active":"2024-09-17T03:47:09.148426+0000","last_peered":"2024-09-17T03:47:09.148426+0000","last_clean":"2024-09-17T03:47:09.148426+0000","last_became_active":"2024-09-17T03:47:07.509081+0000","last_became_peered":"2024-09-17T03:47:07.509081+0000","last_unstale":"2024-09-17T03:47:09.148426+0000","last_undegraded":"2024-09-17T03:47:09.148426+0000","last_fullsized":"2024-09-17T03:47:09.148426+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:49.853012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.e","version":"209'2","reported_seq":17,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640201+0000","last_change":"2024-09-17T03:47:06.503041+0000","last_active":"2024-09-17T03:47:08.640201+0000","last_peered":"2024-09-17T03:47:08.640201+0000","last_clean":"2024-09-17T03:47:08.640201+0000","last_became_active":"2024-09-17T03:47:06.502672+0000","last_became_peered":"2024-09-17T03:47:06.502672+0000","last_unstale":"2024-09-17T03:47:08.640201+0000","last_undegraded":"2024-09-17T03:47:08.640201+0000","last_fullsized":"2024-09-17T03:47:08.640201+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:45.960661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147895+0000","last_change":"2024-09-17T03:47:07.511189+0000","last_active":"2024-09-17T03:47:09.147895+0000","last_peered":"2024-09-17T03:47:09.147895+0000","last_clean":"2024-09-17T03:47:09.147895+0000","last_became_active":"2024-09-17T03:47:07.510875+0000","last_became_peered":"2024-09-17T03:47:07.510875+0000","last_unstale":"2024-09-17T03:47:09.147895+0000","last_undegraded":"2024-09-17T03:47:09.147895+0000","last_fullsized":"2024-09-17T03:47:09.147895+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:16.637752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.d","version":"209'1","reported_seq":16,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147684+0000","last_change":"2024-09-17T03:47:06.496313+0000","last_active":"2024-09-17T03:47:09.147684+0000","last_peered":"2024-09-17T03:47:09.147684+0000","last_clean":"2024-09-17T03:47:09.147684+0000","last_became_active":"2024-09-17T03:47:06.495982+0000","last_became_peered":"2024-09-17T03:47:06.495982+0000","last_unstale":"2024-09-17T03:47:09.147684+0000","last_undegraded":"2024-09-17T03:47:09.147684+0000","last_fullsized":"2024-09-17T03:47:09.147684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:14.115132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.d","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.511516+0000","last_change":"2024-09-17T03:47:07.507026+0000","last_active":"2024-09-17T03:47:07.511516+0000","last_peered":"2024-09-17T03:47:07.511516+0000","last_clean":"2024-09-17T03:47:07.511516+0000","last_became_active":"2024-09-17T03:47:07.506249+0000","last_became_peered":"2024-09-17T03:47:07.506249+0000","last_unstale":"2024-09-17T03:47:07.511516+0000","last_undegraded":"2024-09-17T03:47:07.511516+0000","last_fullsized":"2024-09-17T03:47:07.511516+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:58.170501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148010+0000","last_change":"2024-09-17T03:47:06.502359+0000","last_active":"2024-09-17T03:47:09.148010+0000","last_peered":"2024-09-17T03:47:09.148010+0000","last_clean":"2024-09-17T03:47:09.148010+0000","last_became_active":"2024-09-17T03:47:06.502031+0000","last_became_peered":"2024-09-17T03:47:06.502031+0000","last_unstale":"2024-09-17T03:47:09.148010+0000","last_undegraded":"2024-09-17T03:47:09.148010+0000","last_fullsized":"2024-09-17T03:47:09.148010+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:44.000387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640187+0000","last_change":"2024-09-17T03:47:07.504234+0000","last_active":"2024-09-17T03:47:08.640187+0000","last_peered":"2024-09-17T03:47:08.640187+0000","last_clean":"2024-09-17T03:47:08.640187+0000","last_became_active":"2024-09-17T03:47:07.503947+0000","last_became_peered":"2024-09-17T03:47:07.503947+0000","last_unstale":"2024-09-17T03:47:08.640187+0000","last_undegraded":"2024-09-17T03:47:08.640187+0000","last_fullsized":"2024-09-17T03:47:08.640187+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:40.851131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.b","version":"209'2","reported_seq":15,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.518304+0000","last_change":"2024-09-17T03:47:06.497157+0000","last_active":"2024-09-17T03:47:07.518304+0000","last_peered":"2024-09-17T03:47:07.518304+0000","last_clean":"2024-09-17T03:47:07.518304+0000","last_became_active":"2024-09-17T03:47:06.496837+0000","last_became_peered":"2024-09-17T03:47:06.496837+0000","last_unstale":"2024-09-17T03:47:07.518304+0000","last_undegraded":"2024-09-17T03:47:07.518304+0000","last_fullsized":"2024-09-17T03:47:07.518304+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:30.513560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.b","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640299+0000","last_change":"2024-09-17T03:47:07.496615+0000","last_active":"2024-09-17T03:47:08.640299+0000","last_peered":"2024-09-17T03:47:08.640299+0000","last_clean":"2024-09-17T03:47:08.640299+0000","last_became_active":"2024-09-17T03:47:07.496295+0000","last_became_peered":"2024-09-17T03:47:07.496295+0000","last_unstale":"2024-09-17T03:47:08.640299+0000","last_undegraded":"2024-09-17T03:47:08.640299+0000","last_fullsized":"2024-09-17T03:47:08.640299+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:38.245617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491192+0000","last_change":"2024-09-17T03:47:06.502698+0000","last_active":"2024-09-17T03:47:08.491192+0000","last_peered":"2024-09-17T03:47:08.491192+0000","last_clean":"2024-09-17T03:47:08.491192+0000","last_became_active":"2024-09-17T03:47:06.502343+0000","last_became_peered":"2024-09-17T03:47:06.502343+0000","last_unstale":"2024-09-17T03:47:08.491192+0000","last_undegraded":"2024-09-17T03:47:08.491192+0000","last_fullsized":"2024-09-17T03:47:08.491192+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:10.979155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.515038+0000","last_change":"2024-09-17T03:47:07.509873+0000","last_active":"2024-09-17T03:47:07.515038+0000","last_peered":"2024-09-17T03:47:07.515038+0000","last_clean":"2024-09-17T03:47:07.515038+0000","last_became_active":"2024-09-17T03:47:07.507111+0000","last_became_peered":"2024-09-17T03:47:07.507111+0000","last_unstale":"2024-09-17T03:47:07.515038+0000","last_undegraded":"2024-09-17T03:47:07.515038+0000","last_fullsized":"2024-09-17T03:47:07.515038+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:12.588275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147878+0000","last_change":"2024-09-17T03:47:06.502698+0000","last_active":"2024-09-17T03:47:09.147878+0000","last_peered":"2024-09-17T03:47:09.147878+0000","last_clean":"2024-09-17T03:47:09.147878+0000","last_became_active":"2024-09-17T03:47:06.502352+0000","last_became_peered":"2024-09-17T03:47:06.502352+0000","last_unstale":"2024-09-17T03:47:09.147878+0000","last_undegraded":"2024-09-17T03:47:09.147878+0000","last_fullsized":"2024-09-17T03:47:09.147878+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:31.955552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489556+0000","last_change":"2024-09-17T03:47:07.508462+0000","last_active":"2024-09-17T03:47:08.489556+0000","last_peered":"2024-09-17T03:47:08.489556+0000","last_clean":"2024-09-17T03:47:08.489556+0000","last_became_active":"2024-09-17T03:47:07.507345+0000","last_became_peered":"2024-09-17T03:47:07.507345+0000","last_unstale":"2024-09-17T03:47:08.489556+0000","last_undegraded":"2024-09-17T03:47:08.489556+0000","last_fullsized":"2024-09-17T03:47:08.489556+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:38.245617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491103+0000","last_change":"2024-09-17T03:47:06.499715+0000","last_active":"2024-09-17T03:47:08.491103+0000","last_peered":"2024-09-17T03:47:08.491103+0000","last_clean":"2024-09-17T03:47:08.491103+0000","last_became_active":"2024-09-17T03:47:06.499410+0000","last_became_peered":"2024-09-17T03:47:06.499410+0000","last_unstale":"2024-09-17T03:47:08.491103+0000","last_undegraded":"2024-09-17T03:47:08.491103+0000","last_fullsized":"2024-09-17T03:47:08.491103+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:04.289299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147939+0000","last_change":"2024-09-17T03:47:07.513100+0000","last_active":"2024-09-17T03:47:09.147939+0000","last_peered":"2024-09-17T03:47:09.147939+0000","last_clean":"2024-09-17T03:47:09.147939+0000","last_became_active":"2024-09-17T03:47:07.512433+0000","last_became_peered":"2024-09-17T03:47:07.512433+0000","last_unstale":"2024-09-17T03:47:09.147939+0000","last_undegraded":"2024-09-17T03:47:09.147939+0000","last_fullsized":"2024-09-17T03:47:09.147939+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:43.778354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.7","version":"209'2","reported_seq":17,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148081+0000","last_change":"2024-09-17T03:47:06.507885+0000","last_active":"2024-09-17T03:47:09.148081+0000","last_peered":"2024-09-17T03:47:09.148081+0000","last_clean":"2024-09-17T03:47:09.148081+0000","last_became_active":"2024-09-17T03:47:06.507369+0000","last_became_peered":"2024-09-17T03:47:06.507369+0000","last_unstale":"2024-09-17T03:47:09.148081+0000","last_undegraded":"2024-09-17T03:47:09.148081+0000","last_fullsized":"2024-09-17T03:47:09.148081+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:48.914222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.7","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.516571+0000","last_change":"2024-09-17T03:47:07.505989+0000","last_active":"2024-09-17T03:47:07.516571+0000","last_peered":"2024-09-17T03:47:07.516571+0000","last_clean":"2024-09-17T03:47:07.516571+0000","last_became_active":"2024-09-17T03:47:07.504764+0000","last_became_peered":"2024-09-17T03:47:07.504764+0000","last_unstale":"2024-09-17T03:47:07.516571+0000","last_undegraded":"2024-09-17T03:47:07.516571+0000","last_fullsized":"2024-09-17T03:47:07.516571+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:03.319770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.504954+0000","last_change":"2024-09-17T03:47:06.505008+0000","last_active":"2024-09-17T03:47:07.504954+0000","last_peered":"2024-09-17T03:47:07.504954+0000","last_clean":"2024-09-17T03:47:07.504954+0000","last_became_active":"2024-09-17T03:47:06.504748+0000","last_became_peered":"2024-09-17T03:47:06.504748+0000","last_unstale":"2024-09-17T03:47:07.504954+0000","last_undegraded":"2024-09-17T03:47:07.504954+0000","last_fullsized":"2024-09-17T03:47:07.504954+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:45.447734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.509839+0000","last_change":"2024-09-17T03:47:07.505653+0000","last_active":"2024-09-17T03:47:07.509839+0000","last_peered":"2024-09-17T03:47:07.509839+0000","last_clean":"2024-09-17T03:47:07.509839+0000","last_became_active":"2024-09-17T03:47:07.505325+0000","last_became_peered":"2024-09-17T03:47:07.505325+0000","last_unstale":"2024-09-17T03:47:07.509839+0000","last_undegraded":"2024-09-17T03:47:07.509839+0000","last_fullsized":"2024-09-17T03:47:07.509839+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:14.812921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.493095+0000","last_change":"2024-09-17T03:47:06.496523+0000","last_active":"2024-09-17T03:47:08.493095+0000","last_peered":"2024-09-17T03:47:08.493095+0000","last_clean":"2024-09-17T03:47:08.493095+0000","last_became_active":"2024-09-17T03:47:06.496168+0000","last_became_peered":"2024-09-17T03:47:06.496168+0000","last_unstale":"2024-09-17T03:47:08.493095+0000","last_undegraded":"2024-09-17T03:47:08.493095+0000","last_fullsized":"2024-09-17T03:47:08.493095+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:44.831128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.511485+0000","last_change":"2024-09-17T03:47:07.507455+0000","last_active":"2024-09-17T03:47:07.511485+0000","last_peered":"2024-09-17T03:47:07.511485+0000","last_clean":"2024-09-17T03:47:07.511485+0000","last_became_active":"2024-09-17T03:47:07.506685+0000","last_became_peered":"2024-09-17T03:47:07.506685+0000","last_unstale":"2024-09-17T03:47:07.511485+0000","last_undegraded":"2024-09-17T03:47:07.511485+0000","last_fullsized":"2024-09-17T03:47:07.511485+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:34.974282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.489359+0000","last_change":"2024-09-17T03:47:06.503893+0000","last_active":"2024-09-17T03:47:07.489359+0000","last_peered":"2024-09-17T03:47:07.489359+0000","last_clean":"2024-09-17T03:47:07.489359+0000","last_became_active":"2024-09-17T03:47:06.503267+0000","last_became_peered":"2024-09-17T03:47:06.503267+0000","last_unstale":"2024-09-17T03:47:07.489359+0000","last_undegraded":"2024-09-17T03:47:07.489359+0000","last_fullsized":"2024-09-17T03:47:07.489359+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:25.521145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147687+0000","last_change":"2024-09-17T03:47:07.512558+0000","last_active":"2024-09-17T03:47:09.147687+0000","last_peered":"2024-09-17T03:47:09.147687+0000","last_clean":"2024-09-17T03:47:09.147687+0000","last_became_active":"2024-09-17T03:47:07.512204+0000","last_became_peered":"2024-09-17T03:47:07.512204+0000","last_unstale":"2024-09-17T03:47:09.147687+0000","last_undegraded":"2024-09-17T03:47:09.147687+0000","last_fullsized":"2024-09-17T03:47:09.147687+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:19.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489471+0000","last_change":"2024-09-17T03:47:06.506205+0000","last_active":"2024-09-17T03:47:08.489471+0000","last_peered":"2024-09-17T03:47:08.489471+0000","last_clean":"2024-09-17T03:47:08.489471+0000","last_became_active":"2024-09-17T03:47:06.505894+0000","last_became_peered":"2024-09-17T03:47:06.505894+0000","last_unstale":"2024-09-17T03:47:08.489471+0000","last_undegraded":"2024-09-17T03:47:08.489471+0000","last_fullsized":"2024-09-17T03:47:08.489471+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:51.138118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147524+0000","last_change":"2024-09-17T03:47:07.511983+0000","last_active":"2024-09-17T03:47:09.147524+0000","last_peered":"2024-09-17T03:47:09.147524+0000","last_clean":"2024-09-17T03:47:09.147524+0000","last_became_active":"2024-09-17T03:47:07.511524+0000","last_became_peered":"2024-09-17T03:47:07.511524+0000","last_unstale":"2024-09-17T03:47:09.147524+0000","last_undegraded":"2024-09-17T03:47:09.147524+0000","last_fullsized":"2024-09-17T03:47:09.147524+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:16.127852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489819+0000","last_change":"2024-09-17T03:47:06.507589+0000","last_active":"2024-09-17T03:47:08.489819+0000","last_peered":"2024-09-17T03:47:08.489819+0000","last_clean":"2024-09-17T03:47:08.489819+0000","last_became_active":"2024-09-17T03:47:06.507295+0000","last_became_peered":"2024-09-17T03:47:06.507295+0000","last_unstale":"2024-09-17T03:47:08.489819+0000","last_undegraded":"2024-09-17T03:47:08.489819+0000","last_fullsized":"2024-09-17T03:47:08.489819+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:04.357433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147798+0000","last_change":"2024-09-17T03:47:07.502303+0000","last_active":"2024-09-17T03:47:09.147798+0000","last_peered":"2024-09-17T03:47:09.147798+0000","last_clean":"2024-09-17T03:47:09.147798+0000","last_became_active":"2024-09-17T03:47:07.501258+0000","last_became_peered":"2024-09-17T03:47:07.501258+0000","last_unstale":"2024-09-17T03:47:09.147798+0000","last_undegraded":"2024-09-17T03:47:09.147798+0000","last_fullsized":"2024-09-17T03:47:09.147798+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:26.905112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147748+0000","last_change":"2024-09-17T03:47:06.495941+0000","last_active":"2024-09-17T03:47:09.147748+0000","last_peered":"2024-09-17T03:47:09.147748+0000","last_clean":"2024-09-17T03:47:09.147748+0000","last_became_active":"2024-09-17T03:47:06.495630+0000","last_became_peered":"2024-09-17T03:47:06.495630+0000","last_unstale":"2024-09-17T03:47:09.147748+0000","last_undegraded":"2024-09-17T03:47:09.147748+0000","last_fullsized":"2024-09-17T03:47:09.147748+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:29.024642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.511667+0000","last_change":"2024-09-17T03:47:07.509204+0000","last_active":"2024-09-17T03:47:07.511667+0000","last_peered":"2024-09-17T03:47:07.511667+0000","last_clean":"2024-09-17T03:47:07.511667+0000","last_became_active":"2024-09-17T03:47:07.508281+0000","last_became_peered":"2024-09-17T03:47:07.508281+0000","last_unstale":"2024-09-17T03:47:07.511667+0000","last_undegraded":"2024-09-17T03:47:07.511667+0000","last_fullsized":"2024-09-17T03:47:07.511667+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:10.705715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.489731+0000","last_change":"2024-09-17T03:47:06.505043+0000","last_active":"2024-09-17T03:47:07.489731+0000","last_peered":"2024-09-17T03:47:07.489731+0000","last_clean":"2024-09-17T03:47:07.489731+0000","last_became_active":"2024-09-17T03:47:06.504725+0000","last_became_peered":"2024-09-17T03:47:06.504725+0000","last_unstale":"2024-09-17T03:47:07.489731+0000","last_undegraded":"2024-09-17T03:47:07.489731+0000","last_fullsized":"2024-09-17T03:47:07.489731+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:44.640334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.20","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491087+0000","last_change":"2024-09-17T03:47:07.507849+0000","last_active":"2024-09-17T03:47:08.491087+0000","last_peered":"2024-09-17T03:47:08.491087+0000","last_clean":"2024-09-17T03:47:08.491087+0000","last_became_active":"2024-09-17T03:47:07.507472+0000","last_became_peered":"2024-09-17T03:47:07.507472+0000","last_unstale":"2024-09-17T03:47:08.491087+0000","last_undegraded":"2024-09-17T03:47:08.491087+0000","last_fullsized":"2024-09-17T03:47:08.491087+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:14.961574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":459,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147453+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:47:09.147453+0000","last_peered":"2024-09-17T03:47:09.147453+0000","last_clean":"2024-09-17T03:47:09.147453+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:47:09.147453+0000","last_undegraded":"2024-09-17T03:47:09.147453+0000","last_fullsized":"2024-09-17T03:47:09.147453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":33,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":32,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509616,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60720,"kb_used_data":3164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311120,"statfs":{"total":96636764160,"available":96574586880,"internally_reserved":0,"allocated":3239936,"data_stored":1752713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509616,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60164,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311676,"statfs":{"total":96636764160,"available":96575156224,"internally_reserved":0,"allocated":2662400,"data_stored":1168687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509616,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65676,"kb_used_data":2612,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306164,"statfs":{"total":96636764160,"available":96569511936,"internally_reserved":0,"allocated":2674688,"data_stored":1170243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509616,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55992,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315848,"statfs":{"total":96636764160,"available":96579428352,"internally_reserved":0,"allocated":2654208,"data_stored":1168575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509617,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60164,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311676,"statfs":{"total":96636764160,"available":96575156224,"internally_reserved":0,"allocated":2670592,"data_stored":1169351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509617,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56572,"kb_used_data":3172,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315268,"statfs":{"total":96636764160,"available":96578834432,"internally_reserved":0,"allocated":3248128,"data_stored":1758943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55968,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315872,"statfs":{"total":96636764160,"available":96579452928,"internally_reserved":0,"allocated":2629632,"data_stored":1155500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575023,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60124,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311716,"statfs":{"total":96636764160,"available":96575197184,"internally_reserved":0,"allocated":2629632,"data_stored":1155500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:47:11.520 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.668+0000 7f6a82884640 1 -- 172.21.15.146:0/3583670874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7c0cff50 msgr2=0x7f6a7c0690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.668+0000 7f6a82884640 1 --2- 172.21.15.146:0/3583670874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7c0cff50 0x7f6a7c0690b0 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7f6a74005fd0 tx=0x7f6a7402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.668+0000 7f6a82884640 1 -- 172.21.15.146:0/3583670874 shutdown_connections 2024-09-17T03:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.668+0000 7f6a82884640 1 --2- 172.21.15.146:0/3583670874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7c0cff50 0x7f6a7c0690b0 unknown :-1 s=CLOSED pgs=2686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.668+0000 7f6a82884640 1 --2- 172.21.15.146:0/3583670874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c15fc60 0x7f6a7c1628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.668+0000 7f6a82884640 1 -- 172.21.15.146:0/3583670874 >> 172.21.15.146:0/3583670874 conn(0x7f6a7c0d4cd0 msgr2=0x7f6a7c0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.668+0000 7f6a82884640 1 -- 172.21.15.146:0/3583670874 shutdown_connections 2024-09-17T03:47:11.669 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.668+0000 7f6a82884640 1 -- 172.21.15.146:0/3583670874 wait complete. 2024-09-17T03:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.670+0000 7f6a82884640 1 Processor -- start 2024-09-17T03:47:11.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.670+0000 7f6a82884640 1 -- start start 2024-09-17T03:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.671+0000 7f6a82884640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c0cfb40 0x7f6a7c0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.671+0000 7f6a82884640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7c0cff50 0x7f6a7c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.671+0000 7f6a82884640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7c15fc60 0x7f6a7c0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.671+0000 7f6a82884640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c160260 con 0x7f6a7c0cff50 2024-09-17T03:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.671+0000 7f6a82884640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c163040 con 0x7f6a7c15fc60 2024-09-17T03:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.671+0000 7f6a82884640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7c0d3380 con 0x7f6a7c0cfb40 2024-09-17T03:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a7b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7c0cff50 0x7f6a7c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a7b7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7c0cff50 0x7f6a7c0cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45980/0 (socket says 172.21.15.146:45980) 2024-09-17T03:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a7b7fe640 1 -- 172.21.15.146:0/644333505 learned_addr learned my addr 172.21.15.146:0/644333505 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:11.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a80e21640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7c15fc60 0x7f6a7c0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a7bfff640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c0cfb40 0x7f6a7c0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a7b7fe640 1 -- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c0cfb40 msgr2=0x7f6a7c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a7b7fe640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c0cfb40 0x7f6a7c0cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a7b7fe640 1 -- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7c15fc60 msgr2=0x7f6a7c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a7b7fe640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7c15fc60 0x7f6a7c0cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a7b7fe640 1 -- 172.21.15.146:0/644333505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c0cb950 con 0x7f6a7c0cff50 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a80e21640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7c15fc60 0x7f6a7c0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a7b7fe640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7c0cff50 0x7f6a7c0cd5e0 secure :-1 s=READY pgs=2687 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c3c0 tx=0x7f6a6400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a78ff9640 1 -- 172.21.15.146:0/644333505 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64017070 con 0x7f6a7c0cff50 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a78ff9640 1 -- 172.21.15.146:0/644333505 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a640035f0 con 0x7f6a7c0cff50 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a82884640 1 -- 172.21.15.146:0/644333505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7c0cbc30 con 0x7f6a7c0cff50 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a78ff9640 1 -- 172.21.15.146:0/644333505 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64003a40 con 0x7f6a7c0cff50 2024-09-17T03:47:11.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.672+0000 7f6a82884640 1 -- 172.21.15.146:0/644333505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a7c0cc1f0 con 0x7f6a7c0cff50 2024-09-17T03:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.673+0000 7f6a82884640 1 -- 172.21.15.146:0/644333505 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a7c0690b0 con 0x7f6a7c0cff50 2024-09-17T03:47:11.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.674+0000 7f6a78ff9640 1 -- 172.21.15.146:0/644333505 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a6401a070 con 0x7f6a7c0cff50 2024-09-17T03:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.675+0000 7f6a78ff9640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a5c078b90 0x7f6a5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.675+0000 7f6a78ff9640 1 -- 172.21.15.146:0/644333505 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7f6a6409a050 con 0x7f6a7c0cff50 2024-09-17T03:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.675+0000 7f6a7bfff640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a5c078b90 0x7f6a5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:11.676 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.676+0000 7f6a7bfff640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a5c078b90 0x7f6a5c07b0a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0058c0 tx=0x7f6a6c00c440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:11.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.680+0000 7f6a78ff9640 1 -- 172.21.15.146:0/644333505 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6a64062490 con 0x7f6a7c0cff50 2024-09-17T03:47:11.850 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.850+0000 7f6a82884640 1 -- 172.21.15.146:0/644333505 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a7c0cb290 con 0x7f6a5c078b90 2024-09-17T03:47:11.855 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.855+0000 7f6a78ff9640 1 -- 172.21.15.146:0/644333505 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252472 (secure 0 0 0) 0x7f6a7c0cb290 con 0x7f6a5c078b90 2024-09-17T03:47:11.858 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:11.859 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:47:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.858+0000 7f6a82884640 1 -- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a5c078b90 msgr2=0x7f6a5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.858+0000 7f6a82884640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a5c078b90 0x7f6a5c07b0a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0058c0 tx=0x7f6a6c00c440 comp rx=0 tx=0).stop 2024-09-17T03:47:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.858+0000 7f6a82884640 1 -- 172.21.15.146:0/644333505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7c0cff50 msgr2=0x7f6a7c0cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:11.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.858+0000 7f6a82884640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7c0cff50 0x7f6a7c0cd5e0 secure :-1 s=READY pgs=2687 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c3c0 tx=0x7f6a6400c880 comp rx=0 tx=0).stop 2024-09-17T03:47:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.858+0000 7f6a82884640 1 -- 172.21.15.146:0/644333505 shutdown_connections 2024-09-17T03:47:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.858+0000 7f6a82884640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6a5c078b90 0x7f6a5c07b0a0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.858+0000 7f6a82884640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6a7c15fc60 0x7f6a7c0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.858+0000 7f6a82884640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a7c0cff50 0x7f6a7c0cd5e0 unknown :-1 s=CLOSED pgs=2687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.858+0000 7f6a82884640 1 --2- 172.21.15.146:0/644333505 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6a7c0cfb40 0x7f6a7c0cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.858+0000 7f6a82884640 1 -- 172.21.15.146:0/644333505 >> 172.21.15.146:0/644333505 conn(0x7f6a7c0d4cd0 msgr2=0x7f6a7c0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.859+0000 7f6a82884640 1 -- 172.21.15.146:0/644333505 shutdown_connections 2024-09-17T03:47:11.861 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:11.859+0000 7f6a82884640 1 -- 172.21.15.146:0/644333505 wait complete. 2024-09-17T03:47:11.870 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":635,"stamp":"2024-09-17T03:47:10.018211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":475380,"kb_used_data":21884,"kb_used_omap":12,"kb_used_meta":453299,"kb_avail":754499340,"statfs":{"total":773094113280,"available":772607324160,"internally_reserved":0,"allocated":22409216,"data_stored":10499512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":464178737},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.539024"},"pg_stats":[{"pgid":"33.3f","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491804+0000","last_change":"2024-09-17T03:47:07.502251+0000","last_active":"2024-09-17T03:47:08.491804+0000","last_peered":"2024-09-17T03:47:08.491804+0000","last_clean":"2024-09-17T03:47:08.491804+0000","last_became_active":"2024-09-17T03:47:07.501914+0000","last_became_peered":"2024-09-17T03:47:07.501914+0000","last_unstale":"2024-09-17T03:47:08.491804+0000","last_undegraded":"2024-09-17T03:47:08.491804+0000","last_fullsized":"2024-09-17T03:47:08.491804+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:58.364229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.3e","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148094+0000","last_change":"2024-09-17T03:47:07.519718+0000","last_active":"2024-09-17T03:47:09.148094+0000","last_peered":"2024-09-17T03:47:09.148094+0000","last_clean":"2024-09-17T03:47:09.148094+0000","last_became_active":"2024-09-17T03:47:07.519365+0000","last_became_peered":"2024-09-17T03:47:07.519365+0000","last_unstale":"2024-09-17T03:47:09.148094+0000","last_undegraded":"2024-09-17T03:47:09.148094+0000","last_fullsized":"2024-09-17T03:47:09.148094+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:06.891258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.3d","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.514070+0000","last_change":"2024-09-17T03:47:07.510993+0000","last_active":"2024-09-17T03:47:07.514070+0000","last_peered":"2024-09-17T03:47:07.514070+0000","last_clean":"2024-09-17T03:47:07.514070+0000","last_became_active":"2024-09-17T03:47:07.509223+0000","last_became_peered":"2024-09-17T03:47:07.509223+0000","last_unstale":"2024-09-17T03:47:07.514070+0000","last_undegraded":"2024-09-17T03:47:07.514070+0000","last_fullsized":"2024-09-17T03:47:07.514070+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:03.487851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.3c","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.509809+0000","last_change":"2024-09-17T03:47:07.504211+0000","last_active":"2024-09-17T03:47:07.509809+0000","last_peered":"2024-09-17T03:47:07.509809+0000","last_clean":"2024-09-17T03:47:07.509809+0000","last_became_active":"2024-09-17T03:47:07.503856+0000","last_became_peered":"2024-09-17T03:47:07.503856+0000","last_unstale":"2024-09-17T03:47:07.509809+0000","last_undegraded":"2024-09-17T03:47:07.509809+0000","last_fullsized":"2024-09-17T03:47:07.509809+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:59.798938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.3b","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.511635+0000","last_change":"2024-09-17T03:47:07.509082+0000","last_active":"2024-09-17T03:47:07.511635+0000","last_peered":"2024-09-17T03:47:07.511635+0000","last_clean":"2024-09-17T03:47:07.511635+0000","last_became_active":"2024-09-17T03:47:07.508754+0000","last_became_peered":"2024-09-17T03:47:07.508754+0000","last_unstale":"2024-09-17T03:47:07.511635+0000","last_undegraded":"2024-09-17T03:47:07.511635+0000","last_fullsized":"2024-09-17T03:47:07.511635+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:33.587077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.3a","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.639976+0000","last_change":"2024-09-17T03:47:07.505296+0000","last_active":"2024-09-17T03:47:08.639976+0000","last_peered":"2024-09-17T03:47:08.639976+0000","last_clean":"2024-09-17T03:47:08.639976+0000","last_became_active":"2024-09-17T03:47:07.504988+0000","last_became_peered":"2024-09-17T03:47:07.504988+0000","last_unstale":"2024-09-17T03:47:08.639976+0000","last_undegraded":"2024-09-17T03:47:08.639976+0000","last_fullsized":"2024-09-17T03:47:08.639976+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:30.177501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.39","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492129+0000","last_change":"2024-09-17T03:47:07.511627+0000","last_active":"2024-09-17T03:47:08.492129+0000","last_peered":"2024-09-17T03:47:08.492129+0000","last_clean":"2024-09-17T03:47:08.492129+0000","last_became_active":"2024-09-17T03:47:07.510708+0000","last_became_peered":"2024-09-17T03:47:07.510708+0000","last_unstale":"2024-09-17T03:47:08.492129+0000","last_undegraded":"2024-09-17T03:47:08.492129+0000","last_fullsized":"2024-09-17T03:47:08.492129+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:12.371481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.38","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.490978+0000","last_change":"2024-09-17T03:47:07.512047+0000","last_active":"2024-09-17T03:47:08.490978+0000","last_peered":"2024-09-17T03:47:08.490978+0000","last_clean":"2024-09-17T03:47:08.490978+0000","last_became_active":"2024-09-17T03:47:07.511718+0000","last_became_peered":"2024-09-17T03:47:07.511718+0000","last_unstale":"2024-09-17T03:47:08.490978+0000","last_undegraded":"2024-09-17T03:47:08.490978+0000","last_fullsized":"2024-09-17T03:47:08.490978+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:25.602119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.37","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489993+0000","last_change":"2024-09-17T03:47:07.507284+0000","last_active":"2024-09-17T03:47:08.489993+0000","last_peered":"2024-09-17T03:47:08.489993+0000","last_clean":"2024-09-17T03:47:08.489993+0000","last_became_active":"2024-09-17T03:47:07.506987+0000","last_became_peered":"2024-09-17T03:47:07.506987+0000","last_unstale":"2024-09-17T03:47:08.489993+0000","last_undegraded":"2024-09-17T03:47:08.489993+0000","last_fullsized":"2024-09-17T03:47:08.489993+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:50.904096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.36","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.493047+0000","last_change":"2024-09-17T03:47:07.502184+0000","last_active":"2024-09-17T03:47:08.493047+0000","last_peered":"2024-09-17T03:47:08.493047+0000","last_clean":"2024-09-17T03:47:08.493047+0000","last_became_active":"2024-09-17T03:47:07.501863+0000","last_became_peered":"2024-09-17T03:47:07.501863+0000","last_unstale":"2024-09-17T03:47:08.493047+0000","last_undegraded":"2024-09-17T03:47:08.493047+0000","last_fullsized":"2024-09-17T03:47:08.493047+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:29.887804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.35","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492594+0000","last_change":"2024-09-17T03:47:07.501148+0000","last_active":"2024-09-17T03:47:08.492594+0000","last_peered":"2024-09-17T03:47:08.492594+0000","last_clean":"2024-09-17T03:47:08.492594+0000","last_became_active":"2024-09-17T03:47:07.500813+0000","last_became_peered":"2024-09-17T03:47:07.500813+0000","last_unstale":"2024-09-17T03:47:08.492594+0000","last_undegraded":"2024-09-17T03:47:08.492594+0000","last_fullsized":"2024-09-17T03:47:08.492594+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:00.366207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.34","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491516+0000","last_change":"2024-09-17T03:47:07.507210+0000","last_active":"2024-09-17T03:47:08.491516+0000","last_peered":"2024-09-17T03:47:08.491516+0000","last_clean":"2024-09-17T03:47:08.491516+0000","last_became_active":"2024-09-17T03:47:07.506879+0000","last_became_peered":"2024-09-17T03:47:07.506879+0000","last_unstale":"2024-09-17T03:47:08.491516+0000","last_undegraded":"2024-09-17T03:47:08.491516+0000","last_fullsized":"2024-09-17T03:47:08.491516+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:21.066329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.33","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147512+0000","last_change":"2024-09-17T03:47:07.508027+0000","last_active":"2024-09-17T03:47:09.147512+0000","last_peered":"2024-09-17T03:47:09.147512+0000","last_clean":"2024-09-17T03:47:09.147512+0000","last_became_active":"2024-09-17T03:47:07.507708+0000","last_became_peered":"2024-09-17T03:47:07.507708+0000","last_unstale":"2024-09-17T03:47:09.147512+0000","last_undegraded":"2024-09-17T03:47:09.147512+0000","last_fullsized":"2024-09-17T03:47:09.147512+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:49.258990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.32","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147563+0000","last_change":"2024-09-17T03:47:07.514841+0000","last_active":"2024-09-17T03:47:09.147563+0000","last_peered":"2024-09-17T03:47:09.147563+0000","last_clean":"2024-09-17T03:47:09.147563+0000","last_became_active":"2024-09-17T03:47:07.514523+0000","last_became_peered":"2024-09-17T03:47:07.514523+0000","last_unstale":"2024-09-17T03:47:09.147563+0000","last_undegraded":"2024-09-17T03:47:09.147563+0000","last_fullsized":"2024-09-17T03:47:09.147563+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:31.384975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.31","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147935+0000","last_change":"2024-09-17T03:47:07.511024+0000","last_active":"2024-09-17T03:47:09.147935+0000","last_peered":"2024-09-17T03:47:09.147935+0000","last_clean":"2024-09-17T03:47:09.147935+0000","last_became_active":"2024-09-17T03:47:07.510722+0000","last_became_peered":"2024-09-17T03:47:07.510722+0000","last_unstale":"2024-09-17T03:47:09.147935+0000","last_undegraded":"2024-09-17T03:47:09.147935+0000","last_fullsized":"2024-09-17T03:47:09.147935+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:06.183594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.30","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640225+0000","last_change":"2024-09-17T03:47:07.497521+0000","last_active":"2024-09-17T03:47:08.640225+0000","last_peered":"2024-09-17T03:47:08.640225+0000","last_clean":"2024-09-17T03:47:08.640225+0000","last_became_active":"2024-09-17T03:47:07.497219+0000","last_became_peered":"2024-09-17T03:47:07.497219+0000","last_unstale":"2024-09-17T03:47:08.640225+0000","last_undegraded":"2024-09-17T03:47:08.640225+0000","last_fullsized":"2024-09-17T03:47:08.640225+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:11.213699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.2f","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.516613+0000","last_change":"2024-09-17T03:47:07.509996+0000","last_active":"2024-09-17T03:47:07.516613+0000","last_peered":"2024-09-17T03:47:07.516613+0000","last_clean":"2024-09-17T03:47:07.516613+0000","last_became_active":"2024-09-17T03:47:07.509710+0000","last_became_peered":"2024-09-17T03:47:07.509710+0000","last_unstale":"2024-09-17T03:47:07.516613+0000","last_undegraded":"2024-09-17T03:47:07.516613+0000","last_fullsized":"2024-09-17T03:47:07.516613+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:56.928654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.2e","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.493239+0000","last_change":"2024-09-17T03:47:07.515837+0000","last_active":"2024-09-17T03:47:08.493239+0000","last_peered":"2024-09-17T03:47:08.493239+0000","last_clean":"2024-09-17T03:47:08.493239+0000","last_became_active":"2024-09-17T03:47:07.513438+0000","last_became_peered":"2024-09-17T03:47:07.513438+0000","last_unstale":"2024-09-17T03:47:08.493239+0000","last_undegraded":"2024-09-17T03:47:08.493239+0000","last_fullsized":"2024-09-17T03:47:08.493239+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:28.583499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.2d","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492995+0000","last_change":"2024-09-17T03:47:07.498014+0000","last_active":"2024-09-17T03:47:08.492995+0000","last_peered":"2024-09-17T03:47:08.492995+0000","last_clean":"2024-09-17T03:47:08.492995+0000","last_became_active":"2024-09-17T03:47:07.497596+0000","last_became_peered":"2024-09-17T03:47:07.497596+0000","last_unstale":"2024-09-17T03:47:08.492995+0000","last_undegraded":"2024-09-17T03:47:08.492995+0000","last_fullsized":"2024-09-17T03:47:08.492995+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:24.700775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.2c","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640057+0000","last_change":"2024-09-17T03:47:07.500358+0000","last_active":"2024-09-17T03:47:08.640057+0000","last_peered":"2024-09-17T03:47:08.640057+0000","last_clean":"2024-09-17T03:47:08.640057+0000","last_became_active":"2024-09-17T03:47:07.500016+0000","last_became_peered":"2024-09-17T03:47:07.500016+0000","last_unstale":"2024-09-17T03:47:08.640057+0000","last_undegraded":"2024-09-17T03:47:08.640057+0000","last_fullsized":"2024-09-17T03:47:08.640057+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:51.726852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.2b","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489688+0000","last_change":"2024-09-17T03:47:07.510258+0000","last_active":"2024-09-17T03:47:08.489688+0000","last_peered":"2024-09-17T03:47:08.489688+0000","last_clean":"2024-09-17T03:47:08.489688+0000","last_became_active":"2024-09-17T03:47:07.509970+0000","last_became_peered":"2024-09-17T03:47:07.509970+0000","last_unstale":"2024-09-17T03:47:08.489688+0000","last_undegraded":"2024-09-17T03:47:08.489688+0000","last_fullsized":"2024-09-17T03:47:08.489688+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:30.301128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2a","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489753+0000","last_change":"2024-09-17T03:47:07.506800+0000","last_active":"2024-09-17T03:47:08.489753+0000","last_peered":"2024-09-17T03:47:08.489753+0000","last_clean":"2024-09-17T03:47:08.489753+0000","last_became_active":"2024-09-17T03:47:07.506490+0000","last_became_peered":"2024-09-17T03:47:07.506490+0000","last_unstale":"2024-09-17T03:47:08.489753+0000","last_undegraded":"2024-09-17T03:47:08.489753+0000","last_fullsized":"2024-09-17T03:47:08.489753+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:27.734024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.29","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492384+0000","last_change":"2024-09-17T03:47:07.502536+0000","last_active":"2024-09-17T03:47:08.492384+0000","last_peered":"2024-09-17T03:47:08.492384+0000","last_clean":"2024-09-17T03:47:08.492384+0000","last_became_active":"2024-09-17T03:47:07.502223+0000","last_became_peered":"2024-09-17T03:47:07.502223+0000","last_unstale":"2024-09-17T03:47:08.492384+0000","last_undegraded":"2024-09-17T03:47:08.492384+0000","last_fullsized":"2024-09-17T03:47:08.492384+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:28.943917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.28","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.515064+0000","last_change":"2024-09-17T03:47:07.510251+0000","last_active":"2024-09-17T03:47:07.515064+0000","last_peered":"2024-09-17T03:47:07.515064+0000","last_clean":"2024-09-17T03:47:07.515064+0000","last_became_active":"2024-09-17T03:47:07.508411+0000","last_became_peered":"2024-09-17T03:47:07.508411+0000","last_unstale":"2024-09-17T03:47:07.515064+0000","last_undegraded":"2024-09-17T03:47:07.515064+0000","last_fullsized":"2024-09-17T03:47:07.515064+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:15.398520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.27","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148010+0000","last_change":"2024-09-17T03:47:07.503855+0000","last_active":"2024-09-17T03:47:09.148010+0000","last_peered":"2024-09-17T03:47:09.148010+0000","last_clean":"2024-09-17T03:47:09.148010+0000","last_became_active":"2024-09-17T03:47:07.503021+0000","last_became_peered":"2024-09-17T03:47:07.503021+0000","last_unstale":"2024-09-17T03:47:09.148010+0000","last_undegraded":"2024-09-17T03:47:09.148010+0000","last_fullsized":"2024-09-17T03:47:09.148010+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:35.519739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.26","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.514652+0000","last_change":"2024-09-17T03:47:07.513351+0000","last_active":"2024-09-17T03:47:07.514652+0000","last_peered":"2024-09-17T03:47:07.514652+0000","last_clean":"2024-09-17T03:47:07.514652+0000","last_became_active":"2024-09-17T03:47:07.512991+0000","last_became_peered":"2024-09-17T03:47:07.512991+0000","last_unstale":"2024-09-17T03:47:07.514652+0000","last_undegraded":"2024-09-17T03:47:07.514652+0000","last_fullsized":"2024-09-17T03:47:07.514652+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:49.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.25","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492993+0000","last_change":"2024-09-17T03:47:07.512146+0000","last_active":"2024-09-17T03:47:08.492993+0000","last_peered":"2024-09-17T03:47:08.492993+0000","last_clean":"2024-09-17T03:47:08.492993+0000","last_became_active":"2024-09-17T03:47:07.511803+0000","last_became_peered":"2024-09-17T03:47:07.511803+0000","last_unstale":"2024-09-17T03:47:08.492993+0000","last_undegraded":"2024-09-17T03:47:08.492993+0000","last_fullsized":"2024-09-17T03:47:08.492993+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:11.213699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.24","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147989+0000","last_change":"2024-09-17T03:47:07.502264+0000","last_active":"2024-09-17T03:47:09.147989+0000","last_peered":"2024-09-17T03:47:09.147989+0000","last_clean":"2024-09-17T03:47:09.147989+0000","last_became_active":"2024-09-17T03:47:07.501967+0000","last_became_peered":"2024-09-17T03:47:07.501967+0000","last_unstale":"2024-09-17T03:47:09.147989+0000","last_undegraded":"2024-09-17T03:47:09.147989+0000","last_fullsized":"2024-09-17T03:47:09.147989+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:33.169978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.23","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.500310+0000","last_change":"2024-09-17T03:47:07.498673+0000","last_active":"2024-09-17T03:47:07.500310+0000","last_peered":"2024-09-17T03:47:07.500310+0000","last_clean":"2024-09-17T03:47:07.500310+0000","last_became_active":"2024-09-17T03:47:07.498345+0000","last_became_peered":"2024-09-17T03:47:07.498345+0000","last_unstale":"2024-09-17T03:47:07.500310+0000","last_undegraded":"2024-09-17T03:47:07.500310+0000","last_fullsized":"2024-09-17T03:47:07.500310+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:38.268532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.22","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147463+0000","last_change":"2024-09-17T03:47:07.508959+0000","last_active":"2024-09-17T03:47:09.147463+0000","last_peered":"2024-09-17T03:47:09.147463+0000","last_clean":"2024-09-17T03:47:09.147463+0000","last_became_active":"2024-09-17T03:47:07.508684+0000","last_became_peered":"2024-09-17T03:47:07.508684+0000","last_unstale":"2024-09-17T03:47:09.147463+0000","last_undegraded":"2024-09-17T03:47:09.147463+0000","last_fullsized":"2024-09-17T03:47:09.147463+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:45.667841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.21","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.490984+0000","last_change":"2024-09-17T03:47:07.501494+0000","last_active":"2024-09-17T03:47:08.490984+0000","last_peered":"2024-09-17T03:47:08.490984+0000","last_clean":"2024-09-17T03:47:08.490984+0000","last_became_active":"2024-09-17T03:47:07.501147+0000","last_became_peered":"2024-09-17T03:47:07.501147+0000","last_unstale":"2024-09-17T03:47:08.490984+0000","last_undegraded":"2024-09-17T03:47:08.490984+0000","last_fullsized":"2024-09-17T03:47:08.490984+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:50.028442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.1e","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.493209+0000","last_change":"2024-09-17T03:47:07.519220+0000","last_active":"2024-09-17T03:47:08.493209+0000","last_peered":"2024-09-17T03:47:08.493209+0000","last_clean":"2024-09-17T03:47:08.493209+0000","last_became_active":"2024-09-17T03:47:07.518750+0000","last_became_peered":"2024-09-17T03:47:07.518750+0000","last_unstale":"2024-09-17T03:47:08.493209+0000","last_undegraded":"2024-09-17T03:47:08.493209+0000","last_fullsized":"2024-09-17T03:47:08.493209+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:44.358945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1f","version":"209'4","reported_seq":17,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.521564+0000","last_change":"2024-09-17T03:47:06.506564+0000","last_active":"2024-09-17T03:47:07.521564+0000","last_peered":"2024-09-17T03:47:07.521564+0000","last_clean":"2024-09-17T03:47:07.521564+0000","last_became_active":"2024-09-17T03:47:06.506137+0000","last_became_peered":"2024-09-17T03:47:06.506137+0000","last_unstale":"2024-09-17T03:47:07.521564+0000","last_undegraded":"2024-09-17T03:47:07.521564+0000","last_fullsized":"2024-09-17T03:47:07.521564+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:12.967612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.1f","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148084+0000","last_change":"2024-09-17T03:47:07.514367+0000","last_active":"2024-09-17T03:47:09.148084+0000","last_peered":"2024-09-17T03:47:09.148084+0000","last_clean":"2024-09-17T03:47:09.148084+0000","last_became_active":"2024-09-17T03:47:07.513832+0000","last_became_peered":"2024-09-17T03:47:07.513832+0000","last_unstale":"2024-09-17T03:47:09.148084+0000","last_undegraded":"2024-09-17T03:47:09.148084+0000","last_fullsized":"2024-09-17T03:47:09.148084+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:51.271333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1e","version":"209'1","reported_seq":16,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147881+0000","last_change":"2024-09-17T03:47:06.501297+0000","last_active":"2024-09-17T03:47:09.147881+0000","last_peered":"2024-09-17T03:47:09.147881+0000","last_clean":"2024-09-17T03:47:09.147881+0000","last_became_active":"2024-09-17T03:47:06.500936+0000","last_became_peered":"2024-09-17T03:47:06.500936+0000","last_unstale":"2024-09-17T03:47:09.147881+0000","last_undegraded":"2024-09-17T03:47:09.147881+0000","last_fullsized":"2024-09-17T03:47:09.147881+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:18.246424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1c","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492215+0000","last_change":"2024-09-17T03:47:07.501003+0000","last_active":"2024-09-17T03:47:08.492215+0000","last_peered":"2024-09-17T03:47:08.492215+0000","last_clean":"2024-09-17T03:47:08.492215+0000","last_became_active":"2024-09-17T03:47:07.500668+0000","last_became_peered":"2024-09-17T03:47:07.500668+0000","last_unstale":"2024-09-17T03:47:08.492215+0000","last_undegraded":"2024-09-17T03:47:08.492215+0000","last_fullsized":"2024-09-17T03:47:08.492215+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:03.591415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1d","version":"209'2","reported_seq":17,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640376+0000","last_change":"2024-09-17T03:47:06.498904+0000","last_active":"2024-09-17T03:47:08.640376+0000","last_peered":"2024-09-17T03:47:08.640376+0000","last_clean":"2024-09-17T03:47:08.640376+0000","last_became_active":"2024-09-17T03:47:06.498572+0000","last_became_peered":"2024-09-17T03:47:06.498572+0000","last_unstale":"2024-09-17T03:47:08.640376+0000","last_undegraded":"2024-09-17T03:47:08.640376+0000","last_fullsized":"2024-09-17T03:47:08.640376+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:44.831128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.1d","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491511+0000","last_change":"2024-09-17T03:47:07.503139+0000","last_active":"2024-09-17T03:47:08.491511+0000","last_peered":"2024-09-17T03:47:08.491511+0000","last_clean":"2024-09-17T03:47:08.491511+0000","last_became_active":"2024-09-17T03:47:07.502491+0000","last_became_peered":"2024-09-17T03:47:07.502491+0000","last_unstale":"2024-09-17T03:47:08.491511+0000","last_undegraded":"2024-09-17T03:47:08.491511+0000","last_fullsized":"2024-09-17T03:47:08.491511+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:36.988601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.1c","version":"209'2","reported_seq":17,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640048+0000","last_change":"2024-09-17T03:47:06.500377+0000","last_active":"2024-09-17T03:47:08.640048+0000","last_peered":"2024-09-17T03:47:08.640048+0000","last_clean":"2024-09-17T03:47:08.640048+0000","last_became_active":"2024-09-17T03:47:06.499861+0000","last_became_peered":"2024-09-17T03:47:06.499861+0000","last_unstale":"2024-09-17T03:47:08.640048+0000","last_undegraded":"2024-09-17T03:47:08.640048+0000","last_fullsized":"2024-09-17T03:47:08.640048+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:20.691684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.1a","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489622+0000","last_change":"2024-09-17T03:47:07.508994+0000","last_active":"2024-09-17T03:47:08.489622+0000","last_peered":"2024-09-17T03:47:08.489622+0000","last_clean":"2024-09-17T03:47:08.489622+0000","last_became_active":"2024-09-17T03:47:07.507935+0000","last_became_peered":"2024-09-17T03:47:07.507935+0000","last_unstale":"2024-09-17T03:47:08.489622+0000","last_undegraded":"2024-09-17T03:47:08.489622+0000","last_fullsized":"2024-09-17T03:47:08.489622+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:38.529657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1b","version":"209'1","reported_seq":16,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491865+0000","last_change":"2024-09-17T03:47:06.501218+0000","last_active":"2024-09-17T03:47:08.491865+0000","last_peered":"2024-09-17T03:47:08.491865+0000","last_clean":"2024-09-17T03:47:08.491865+0000","last_became_active":"2024-09-17T03:47:06.499652+0000","last_became_peered":"2024-09-17T03:47:06.499652+0000","last_unstale":"2024-09-17T03:47:08.491865+0000","last_undegraded":"2024-09-17T03:47:08.491865+0000","last_fullsized":"2024-09-17T03:47:08.491865+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:20.691684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1b","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640142+0000","last_change":"2024-09-17T03:47:07.512734+0000","last_active":"2024-09-17T03:47:08.640142+0000","last_peered":"2024-09-17T03:47:08.640142+0000","last_clean":"2024-09-17T03:47:08.640142+0000","last_became_active":"2024-09-17T03:47:07.512386+0000","last_became_peered":"2024-09-17T03:47:07.512386+0000","last_unstale":"2024-09-17T03:47:08.640142+0000","last_undegraded":"2024-09-17T03:47:08.640142+0000","last_fullsized":"2024-09-17T03:47:08.640142+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:58.221000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1a","version":"209'1","reported_seq":14,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.511539+0000","last_change":"2024-09-17T03:47:06.490545+0000","last_active":"2024-09-17T03:47:07.511539+0000","last_peered":"2024-09-17T03:47:07.511539+0000","last_clean":"2024-09-17T03:47:07.511539+0000","last_became_active":"2024-09-17T03:47:06.490177+0000","last_became_peered":"2024-09-17T03:47:06.490177+0000","last_unstale":"2024-09-17T03:47:07.511539+0000","last_undegraded":"2024-09-17T03:47:07.511539+0000","last_fullsized":"2024-09-17T03:47:07.511539+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:29.292788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.639914+0000","last_change":"2024-09-17T03:47:07.504019+0000","last_active":"2024-09-17T03:47:08.639914+0000","last_peered":"2024-09-17T03:47:08.639914+0000","last_clean":"2024-09-17T03:47:08.639914+0000","last_became_active":"2024-09-17T03:47:07.503650+0000","last_became_peered":"2024-09-17T03:47:07.503650+0000","last_unstale":"2024-09-17T03:47:08.639914+0000","last_undegraded":"2024-09-17T03:47:08.639914+0000","last_fullsized":"2024-09-17T03:47:08.639914+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:05.359610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.503446+0000","last_change":"2024-09-17T03:47:06.503048+0000","last_active":"2024-09-17T03:47:07.503446+0000","last_peered":"2024-09-17T03:47:07.503446+0000","last_clean":"2024-09-17T03:47:07.503446+0000","last_became_active":"2024-09-17T03:47:06.502732+0000","last_became_peered":"2024-09-17T03:47:06.502732+0000","last_unstale":"2024-09-17T03:47:07.503446+0000","last_undegraded":"2024-09-17T03:47:07.503446+0000","last_fullsized":"2024-09-17T03:47:07.503446+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:49.667823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.492654+0000","last_change":"2024-09-17T03:47:07.511966+0000","last_active":"2024-09-17T03:47:08.492654+0000","last_peered":"2024-09-17T03:47:08.492654+0000","last_clean":"2024-09-17T03:47:08.492654+0000","last_became_active":"2024-09-17T03:47:07.511304+0000","last_became_peered":"2024-09-17T03:47:07.511304+0000","last_unstale":"2024-09-17T03:47:08.492654+0000","last_undegraded":"2024-09-17T03:47:08.492654+0000","last_fullsized":"2024-09-17T03:47:08.492654+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:29.219289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491526+0000","last_change":"2024-09-17T03:47:06.507809+0000","last_active":"2024-09-17T03:47:08.491526+0000","last_peered":"2024-09-17T03:47:08.491526+0000","last_clean":"2024-09-17T03:47:08.491526+0000","last_became_active":"2024-09-17T03:47:06.507466+0000","last_became_peered":"2024-09-17T03:47:06.507466+0000","last_unstale":"2024-09-17T03:47:08.491526+0000","last_undegraded":"2024-09-17T03:47:08.491526+0000","last_fullsized":"2024-09-17T03:47:08.491526+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:48.089017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.493353+0000","last_change":"2024-09-17T03:47:07.517593+0000","last_active":"2024-09-17T03:47:08.493353+0000","last_peered":"2024-09-17T03:47:08.493353+0000","last_clean":"2024-09-17T03:47:08.493353+0000","last_became_active":"2024-09-17T03:47:07.510865+0000","last_became_peered":"2024-09-17T03:47:07.510865+0000","last_unstale":"2024-09-17T03:47:08.493353+0000","last_undegraded":"2024-09-17T03:47:08.493353+0000","last_fullsized":"2024-09-17T03:47:08.493353+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:14.421372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.490373+0000","last_change":"2024-09-17T03:47:06.503612+0000","last_active":"2024-09-17T03:47:07.490373+0000","last_peered":"2024-09-17T03:47:07.490373+0000","last_clean":"2024-09-17T03:47:07.490373+0000","last_became_active":"2024-09-17T03:47:06.503311+0000","last_became_peered":"2024-09-17T03:47:06.503311+0000","last_unstale":"2024-09-17T03:47:07.490373+0000","last_undegraded":"2024-09-17T03:47:07.490373+0000","last_fullsized":"2024-09-17T03:47:07.490373+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:34.236070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.504540+0000","last_change":"2024-09-17T03:47:07.500153+0000","last_active":"2024-09-17T03:47:07.504540+0000","last_peered":"2024-09-17T03:47:07.504540+0000","last_clean":"2024-09-17T03:47:07.504540+0000","last_became_active":"2024-09-17T03:47:07.499461+0000","last_became_peered":"2024-09-17T03:47:07.499461+0000","last_unstale":"2024-09-17T03:47:07.504540+0000","last_undegraded":"2024-09-17T03:47:07.504540+0000","last_fullsized":"2024-09-17T03:47:07.504540+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:10.369545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640158+0000","last_change":"2024-09-17T03:47:06.507145+0000","last_active":"2024-09-17T03:47:08.640158+0000","last_peered":"2024-09-17T03:47:08.640158+0000","last_clean":"2024-09-17T03:47:08.640158+0000","last_became_active":"2024-09-17T03:47:06.506341+0000","last_became_peered":"2024-09-17T03:47:06.506341+0000","last_unstale":"2024-09-17T03:47:08.640158+0000","last_undegraded":"2024-09-17T03:47:08.640158+0000","last_fullsized":"2024-09-17T03:47:08.640158+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:34.752860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.14","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147737+0000","last_change":"2024-09-17T03:47:07.514007+0000","last_active":"2024-09-17T03:47:09.147737+0000","last_peered":"2024-09-17T03:47:09.147737+0000","last_clean":"2024-09-17T03:47:09.147737+0000","last_became_active":"2024-09-17T03:47:07.513693+0000","last_became_peered":"2024-09-17T03:47:07.513693+0000","last_unstale":"2024-09-17T03:47:09.147737+0000","last_undegraded":"2024-09-17T03:47:09.147737+0000","last_fullsized":"2024-09-17T03:47:09.147737+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:25.143911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.15","version":"209'3","reported_seq":18,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640446+0000","last_change":"2024-09-17T03:47:06.502269+0000","last_active":"2024-09-17T03:47:08.640446+0000","last_peered":"2024-09-17T03:47:08.640446+0000","last_clean":"2024-09-17T03:47:08.640446+0000","last_became_active":"2024-09-17T03:47:06.501852+0000","last_became_peered":"2024-09-17T03:47:06.501852+0000","last_unstale":"2024-09-17T03:47:08.640446+0000","last_undegraded":"2024-09-17T03:47:08.640446+0000","last_fullsized":"2024-09-17T03:47:08.640446+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:40.995496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.15","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.500265+0000","last_change":"2024-09-17T03:47:07.498071+0000","last_active":"2024-09-17T03:47:07.500265+0000","last_peered":"2024-09-17T03:47:07.500265+0000","last_clean":"2024-09-17T03:47:07.500265+0000","last_became_active":"2024-09-17T03:47:07.497778+0000","last_became_peered":"2024-09-17T03:47:07.497778+0000","last_unstale":"2024-09-17T03:47:07.500265+0000","last_undegraded":"2024-09-17T03:47:07.500265+0000","last_fullsized":"2024-09-17T03:47:07.500265+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:55.912683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.14","version":"209'6","reported_seq":19,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.522039+0000","last_change":"2024-09-17T03:47:06.500185+0000","last_active":"2024-09-17T03:47:07.522039+0000","last_peered":"2024-09-17T03:47:07.522039+0000","last_clean":"2024-09-17T03:47:07.522039+0000","last_became_active":"2024-09-17T03:47:06.499855+0000","last_became_peered":"2024-09-17T03:47:06.499855+0000","last_unstale":"2024-09-17T03:47:07.522039+0000","last_undegraded":"2024-09-17T03:47:07.522039+0000","last_fullsized":"2024-09-17T03:47:07.522039+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:07.646710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.507514+0000","last_change":"2024-09-17T03:47:07.501864+0000","last_active":"2024-09-17T03:47:07.507514+0000","last_peered":"2024-09-17T03:47:07.507514+0000","last_clean":"2024-09-17T03:47:07.507514+0000","last_became_active":"2024-09-17T03:47:07.501577+0000","last_became_peered":"2024-09-17T03:47:07.501577+0000","last_unstale":"2024-09-17T03:47:07.507514+0000","last_undegraded":"2024-09-17T03:47:07.507514+0000","last_fullsized":"2024-09-17T03:47:07.507514+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:39.124165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"209'2","reported_seq":17,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491133+0000","last_change":"2024-09-17T03:47:06.501307+0000","last_active":"2024-09-17T03:47:08.491133+0000","last_peered":"2024-09-17T03:47:08.491133+0000","last_clean":"2024-09-17T03:47:08.491133+0000","last_became_active":"2024-09-17T03:47:06.500836+0000","last_became_peered":"2024-09-17T03:47:06.500836+0000","last_unstale":"2024-09-17T03:47:08.491133+0000","last_undegraded":"2024-09-17T03:47:08.491133+0000","last_fullsized":"2024-09-17T03:47:08.491133+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:29.167672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.13","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640120+0000","last_change":"2024-09-17T03:47:07.502797+0000","last_active":"2024-09-17T03:47:08.640120+0000","last_peered":"2024-09-17T03:47:08.640120+0000","last_clean":"2024-09-17T03:47:08.640120+0000","last_became_active":"2024-09-17T03:47:07.502461+0000","last_became_peered":"2024-09-17T03:47:07.502461+0000","last_unstale":"2024-09-17T03:47:08.640120+0000","last_undegraded":"2024-09-17T03:47:08.640120+0000","last_fullsized":"2024-09-17T03:47:08.640120+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:39.111155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489714+0000","last_change":"2024-09-17T03:47:06.505445+0000","last_active":"2024-09-17T03:47:08.489714+0000","last_peered":"2024-09-17T03:47:08.489714+0000","last_clean":"2024-09-17T03:47:08.489714+0000","last_became_active":"2024-09-17T03:47:06.505118+0000","last_became_peered":"2024-09-17T03:47:06.505118+0000","last_unstale":"2024-09-17T03:47:08.489714+0000","last_undegraded":"2024-09-17T03:47:08.489714+0000","last_fullsized":"2024-09-17T03:47:08.489714+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:29.175324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.10","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.515086+0000","last_change":"2024-09-17T03:47:07.510611+0000","last_active":"2024-09-17T03:47:07.515086+0000","last_peered":"2024-09-17T03:47:07.515086+0000","last_clean":"2024-09-17T03:47:07.515086+0000","last_became_active":"2024-09-17T03:47:07.508052+0000","last_became_peered":"2024-09-17T03:47:07.508052+0000","last_unstale":"2024-09-17T03:47:07.515086+0000","last_undegraded":"2024-09-17T03:47:07.515086+0000","last_fullsized":"2024-09-17T03:47:07.515086+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:09.075213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147757+0000","last_change":"2024-09-17T03:47:06.500773+0000","last_active":"2024-09-17T03:47:09.147757+0000","last_peered":"2024-09-17T03:47:09.147757+0000","last_clean":"2024-09-17T03:47:09.147757+0000","last_became_active":"2024-09-17T03:47:06.500209+0000","last_became_peered":"2024-09-17T03:47:06.500209+0000","last_unstale":"2024-09-17T03:47:09.147757+0000","last_undegraded":"2024-09-17T03:47:09.147757+0000","last_fullsized":"2024-09-17T03:47:09.147757+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:55.583872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.515885+0000","last_change":"2024-09-17T03:47:07.513100+0000","last_active":"2024-09-17T03:47:07.515885+0000","last_peered":"2024-09-17T03:47:07.515885+0000","last_clean":"2024-09-17T03:47:07.515885+0000","last_became_active":"2024-09-17T03:47:07.512813+0000","last_became_peered":"2024-09-17T03:47:07.512813+0000","last_unstale":"2024-09-17T03:47:07.515885+0000","last_undegraded":"2024-09-17T03:47:07.515885+0000","last_fullsized":"2024-09-17T03:47:07.515885+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:21.112355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.10","version":"209'8","reported_seq":23,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640115+0000","last_change":"2024-09-17T03:47:06.510721+0000","last_active":"2024-09-17T03:47:08.640115+0000","last_peered":"2024-09-17T03:47:08.640115+0000","last_clean":"2024-09-17T03:47:08.640115+0000","last_became_active":"2024-09-17T03:47:06.510369+0000","last_became_peered":"2024-09-17T03:47:06.510369+0000","last_unstale":"2024-09-17T03:47:08.640115+0000","last_undegraded":"2024-09-17T03:47:08.640115+0000","last_fullsized":"2024-09-17T03:47:08.640115+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:47.470187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.e","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147760+0000","last_change":"2024-09-17T03:47:07.513415+0000","last_active":"2024-09-17T03:47:09.147760+0000","last_peered":"2024-09-17T03:47:09.147760+0000","last_clean":"2024-09-17T03:47:09.147760+0000","last_became_active":"2024-09-17T03:47:07.512812+0000","last_became_peered":"2024-09-17T03:47:07.512812+0000","last_unstale":"2024-09-17T03:47:09.147760+0000","last_undegraded":"2024-09-17T03:47:09.147760+0000","last_fullsized":"2024-09-17T03:47:09.147760+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:52.995220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.f","version":"209'1","reported_seq":16,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491800+0000","last_change":"2024-09-17T03:47:06.498537+0000","last_active":"2024-09-17T03:47:08.491800+0000","last_peered":"2024-09-17T03:47:08.491800+0000","last_clean":"2024-09-17T03:47:08.491800+0000","last_became_active":"2024-09-17T03:47:06.498183+0000","last_became_peered":"2024-09-17T03:47:06.498183+0000","last_unstale":"2024-09-17T03:47:08.491800+0000","last_undegraded":"2024-09-17T03:47:08.491800+0000","last_fullsized":"2024-09-17T03:47:08.491800+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:07.443457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148426+0000","last_change":"2024-09-17T03:47:07.509460+0000","last_active":"2024-09-17T03:47:09.148426+0000","last_peered":"2024-09-17T03:47:09.148426+0000","last_clean":"2024-09-17T03:47:09.148426+0000","last_became_active":"2024-09-17T03:47:07.509081+0000","last_became_peered":"2024-09-17T03:47:07.509081+0000","last_unstale":"2024-09-17T03:47:09.148426+0000","last_undegraded":"2024-09-17T03:47:09.148426+0000","last_fullsized":"2024-09-17T03:47:09.148426+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:49.853012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.e","version":"209'2","reported_seq":17,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640201+0000","last_change":"2024-09-17T03:47:06.503041+0000","last_active":"2024-09-17T03:47:08.640201+0000","last_peered":"2024-09-17T03:47:08.640201+0000","last_clean":"2024-09-17T03:47:08.640201+0000","last_became_active":"2024-09-17T03:47:06.502672+0000","last_became_peered":"2024-09-17T03:47:06.502672+0000","last_unstale":"2024-09-17T03:47:08.640201+0000","last_undegraded":"2024-09-17T03:47:08.640201+0000","last_fullsized":"2024-09-17T03:47:08.640201+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:45.960661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147895+0000","last_change":"2024-09-17T03:47:07.511189+0000","last_active":"2024-09-17T03:47:09.147895+0000","last_peered":"2024-09-17T03:47:09.147895+0000","last_clean":"2024-09-17T03:47:09.147895+0000","last_became_active":"2024-09-17T03:47:07.510875+0000","last_became_peered":"2024-09-17T03:47:07.510875+0000","last_unstale":"2024-09-17T03:47:09.147895+0000","last_undegraded":"2024-09-17T03:47:09.147895+0000","last_fullsized":"2024-09-17T03:47:09.147895+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:16.637752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.d","version":"209'1","reported_seq":16,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147684+0000","last_change":"2024-09-17T03:47:06.496313+0000","last_active":"2024-09-17T03:47:09.147684+0000","last_peered":"2024-09-17T03:47:09.147684+0000","last_clean":"2024-09-17T03:47:09.147684+0000","last_became_active":"2024-09-17T03:47:06.495982+0000","last_became_peered":"2024-09-17T03:47:06.495982+0000","last_unstale":"2024-09-17T03:47:09.147684+0000","last_undegraded":"2024-09-17T03:47:09.147684+0000","last_fullsized":"2024-09-17T03:47:09.147684+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:14.115132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.d","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.511516+0000","last_change":"2024-09-17T03:47:07.507026+0000","last_active":"2024-09-17T03:47:07.511516+0000","last_peered":"2024-09-17T03:47:07.511516+0000","last_clean":"2024-09-17T03:47:07.511516+0000","last_became_active":"2024-09-17T03:47:07.506249+0000","last_became_peered":"2024-09-17T03:47:07.506249+0000","last_unstale":"2024-09-17T03:47:07.511516+0000","last_undegraded":"2024-09-17T03:47:07.511516+0000","last_fullsized":"2024-09-17T03:47:07.511516+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:58.170501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148010+0000","last_change":"2024-09-17T03:47:06.502359+0000","last_active":"2024-09-17T03:47:09.148010+0000","last_peered":"2024-09-17T03:47:09.148010+0000","last_clean":"2024-09-17T03:47:09.148010+0000","last_became_active":"2024-09-17T03:47:06.502031+0000","last_became_peered":"2024-09-17T03:47:06.502031+0000","last_unstale":"2024-09-17T03:47:09.148010+0000","last_undegraded":"2024-09-17T03:47:09.148010+0000","last_fullsized":"2024-09-17T03:47:09.148010+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:44.000387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640187+0000","last_change":"2024-09-17T03:47:07.504234+0000","last_active":"2024-09-17T03:47:08.640187+0000","last_peered":"2024-09-17T03:47:08.640187+0000","last_clean":"2024-09-17T03:47:08.640187+0000","last_became_active":"2024-09-17T03:47:07.503947+0000","last_became_peered":"2024-09-17T03:47:07.503947+0000","last_unstale":"2024-09-17T03:47:08.640187+0000","last_undegraded":"2024-09-17T03:47:08.640187+0000","last_fullsized":"2024-09-17T03:47:08.640187+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:40.851131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.b","version":"209'2","reported_seq":15,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.518304+0000","last_change":"2024-09-17T03:47:06.497157+0000","last_active":"2024-09-17T03:47:07.518304+0000","last_peered":"2024-09-17T03:47:07.518304+0000","last_clean":"2024-09-17T03:47:07.518304+0000","last_became_active":"2024-09-17T03:47:06.496837+0000","last_became_peered":"2024-09-17T03:47:06.496837+0000","last_unstale":"2024-09-17T03:47:07.518304+0000","last_undegraded":"2024-09-17T03:47:07.518304+0000","last_fullsized":"2024-09-17T03:47:07.518304+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:30.513560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.b","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.640299+0000","last_change":"2024-09-17T03:47:07.496615+0000","last_active":"2024-09-17T03:47:08.640299+0000","last_peered":"2024-09-17T03:47:08.640299+0000","last_clean":"2024-09-17T03:47:08.640299+0000","last_became_active":"2024-09-17T03:47:07.496295+0000","last_became_peered":"2024-09-17T03:47:07.496295+0000","last_unstale":"2024-09-17T03:47:08.640299+0000","last_undegraded":"2024-09-17T03:47:08.640299+0000","last_fullsized":"2024-09-17T03:47:08.640299+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:38.245617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491192+0000","last_change":"2024-09-17T03:47:06.502698+0000","last_active":"2024-09-17T03:47:08.491192+0000","last_peered":"2024-09-17T03:47:08.491192+0000","last_clean":"2024-09-17T03:47:08.491192+0000","last_became_active":"2024-09-17T03:47:06.502343+0000","last_became_peered":"2024-09-17T03:47:06.502343+0000","last_unstale":"2024-09-17T03:47:08.491192+0000","last_undegraded":"2024-09-17T03:47:08.491192+0000","last_fullsized":"2024-09-17T03:47:08.491192+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:10.979155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.515038+0000","last_change":"2024-09-17T03:47:07.509873+0000","last_active":"2024-09-17T03:47:07.515038+0000","last_peered":"2024-09-17T03:47:07.515038+0000","last_clean":"2024-09-17T03:47:07.515038+0000","last_became_active":"2024-09-17T03:47:07.507111+0000","last_became_peered":"2024-09-17T03:47:07.507111+0000","last_unstale":"2024-09-17T03:47:07.515038+0000","last_undegraded":"2024-09-17T03:47:07.515038+0000","last_fullsized":"2024-09-17T03:47:07.515038+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:12.588275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147878+0000","last_change":"2024-09-17T03:47:06.502698+0000","last_active":"2024-09-17T03:47:09.147878+0000","last_peered":"2024-09-17T03:47:09.147878+0000","last_clean":"2024-09-17T03:47:09.147878+0000","last_became_active":"2024-09-17T03:47:06.502352+0000","last_became_peered":"2024-09-17T03:47:06.502352+0000","last_unstale":"2024-09-17T03:47:09.147878+0000","last_undegraded":"2024-09-17T03:47:09.147878+0000","last_fullsized":"2024-09-17T03:47:09.147878+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:31.955552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489556+0000","last_change":"2024-09-17T03:47:07.508462+0000","last_active":"2024-09-17T03:47:08.489556+0000","last_peered":"2024-09-17T03:47:08.489556+0000","last_clean":"2024-09-17T03:47:08.489556+0000","last_became_active":"2024-09-17T03:47:07.507345+0000","last_became_peered":"2024-09-17T03:47:07.507345+0000","last_unstale":"2024-09-17T03:47:08.489556+0000","last_undegraded":"2024-09-17T03:47:08.489556+0000","last_fullsized":"2024-09-17T03:47:08.489556+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:38.245617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491103+0000","last_change":"2024-09-17T03:47:06.499715+0000","last_active":"2024-09-17T03:47:08.491103+0000","last_peered":"2024-09-17T03:47:08.491103+0000","last_clean":"2024-09-17T03:47:08.491103+0000","last_became_active":"2024-09-17T03:47:06.499410+0000","last_became_peered":"2024-09-17T03:47:06.499410+0000","last_unstale":"2024-09-17T03:47:08.491103+0000","last_undegraded":"2024-09-17T03:47:08.491103+0000","last_fullsized":"2024-09-17T03:47:08.491103+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:04.289299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147939+0000","last_change":"2024-09-17T03:47:07.513100+0000","last_active":"2024-09-17T03:47:09.147939+0000","last_peered":"2024-09-17T03:47:09.147939+0000","last_clean":"2024-09-17T03:47:09.147939+0000","last_became_active":"2024-09-17T03:47:07.512433+0000","last_became_peered":"2024-09-17T03:47:07.512433+0000","last_unstale":"2024-09-17T03:47:09.147939+0000","last_undegraded":"2024-09-17T03:47:09.147939+0000","last_fullsized":"2024-09-17T03:47:09.147939+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:43.778354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.7","version":"209'2","reported_seq":17,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.148081+0000","last_change":"2024-09-17T03:47:06.507885+0000","last_active":"2024-09-17T03:47:09.148081+0000","last_peered":"2024-09-17T03:47:09.148081+0000","last_clean":"2024-09-17T03:47:09.148081+0000","last_became_active":"2024-09-17T03:47:06.507369+0000","last_became_peered":"2024-09-17T03:47:06.507369+0000","last_unstale":"2024-09-17T03:47:09.148081+0000","last_undegraded":"2024-09-17T03:47:09.148081+0000","last_fullsized":"2024-09-17T03:47:09.148081+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:48.914222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.7","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.516571+0000","last_change":"2024-09-17T03:47:07.505989+0000","last_active":"2024-09-17T03:47:07.516571+0000","last_peered":"2024-09-17T03:47:07.516571+0000","last_clean":"2024-09-17T03:47:07.516571+0000","last_became_active":"2024-09-17T03:47:07.504764+0000","last_became_peered":"2024-09-17T03:47:07.504764+0000","last_unstale":"2024-09-17T03:47:07.516571+0000","last_undegraded":"2024-09-17T03:47:07.516571+0000","last_fullsized":"2024-09-17T03:47:07.516571+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:03.319770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.504954+0000","last_change":"2024-09-17T03:47:06.505008+0000","last_active":"2024-09-17T03:47:07.504954+0000","last_peered":"2024-09-17T03:47:07.504954+0000","last_clean":"2024-09-17T03:47:07.504954+0000","last_became_active":"2024-09-17T03:47:06.504748+0000","last_became_peered":"2024-09-17T03:47:06.504748+0000","last_unstale":"2024-09-17T03:47:07.504954+0000","last_undegraded":"2024-09-17T03:47:07.504954+0000","last_fullsized":"2024-09-17T03:47:07.504954+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:45.447734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.509839+0000","last_change":"2024-09-17T03:47:07.505653+0000","last_active":"2024-09-17T03:47:07.509839+0000","last_peered":"2024-09-17T03:47:07.509839+0000","last_clean":"2024-09-17T03:47:07.509839+0000","last_became_active":"2024-09-17T03:47:07.505325+0000","last_became_peered":"2024-09-17T03:47:07.505325+0000","last_unstale":"2024-09-17T03:47:07.509839+0000","last_undegraded":"2024-09-17T03:47:07.509839+0000","last_fullsized":"2024-09-17T03:47:07.509839+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:14.812921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.493095+0000","last_change":"2024-09-17T03:47:06.496523+0000","last_active":"2024-09-17T03:47:08.493095+0000","last_peered":"2024-09-17T03:47:08.493095+0000","last_clean":"2024-09-17T03:47:08.493095+0000","last_became_active":"2024-09-17T03:47:06.496168+0000","last_became_peered":"2024-09-17T03:47:06.496168+0000","last_unstale":"2024-09-17T03:47:08.493095+0000","last_undegraded":"2024-09-17T03:47:08.493095+0000","last_fullsized":"2024-09-17T03:47:08.493095+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:44.831128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.511485+0000","last_change":"2024-09-17T03:47:07.507455+0000","last_active":"2024-09-17T03:47:07.511485+0000","last_peered":"2024-09-17T03:47:07.511485+0000","last_clean":"2024-09-17T03:47:07.511485+0000","last_became_active":"2024-09-17T03:47:07.506685+0000","last_became_peered":"2024-09-17T03:47:07.506685+0000","last_unstale":"2024-09-17T03:47:07.511485+0000","last_undegraded":"2024-09-17T03:47:07.511485+0000","last_fullsized":"2024-09-17T03:47:07.511485+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:34.974282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.489359+0000","last_change":"2024-09-17T03:47:06.503893+0000","last_active":"2024-09-17T03:47:07.489359+0000","last_peered":"2024-09-17T03:47:07.489359+0000","last_clean":"2024-09-17T03:47:07.489359+0000","last_became_active":"2024-09-17T03:47:06.503267+0000","last_became_peered":"2024-09-17T03:47:06.503267+0000","last_unstale":"2024-09-17T03:47:07.489359+0000","last_undegraded":"2024-09-17T03:47:07.489359+0000","last_fullsized":"2024-09-17T03:47:07.489359+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:25.521145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147687+0000","last_change":"2024-09-17T03:47:07.512558+0000","last_active":"2024-09-17T03:47:09.147687+0000","last_peered":"2024-09-17T03:47:09.147687+0000","last_clean":"2024-09-17T03:47:09.147687+0000","last_became_active":"2024-09-17T03:47:07.512204+0000","last_became_peered":"2024-09-17T03:47:07.512204+0000","last_unstale":"2024-09-17T03:47:09.147687+0000","last_undegraded":"2024-09-17T03:47:09.147687+0000","last_fullsized":"2024-09-17T03:47:09.147687+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:19.395997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489471+0000","last_change":"2024-09-17T03:47:06.506205+0000","last_active":"2024-09-17T03:47:08.489471+0000","last_peered":"2024-09-17T03:47:08.489471+0000","last_clean":"2024-09-17T03:47:08.489471+0000","last_became_active":"2024-09-17T03:47:06.505894+0000","last_became_peered":"2024-09-17T03:47:06.505894+0000","last_unstale":"2024-09-17T03:47:08.489471+0000","last_undegraded":"2024-09-17T03:47:08.489471+0000","last_fullsized":"2024-09-17T03:47:08.489471+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:51.138118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147524+0000","last_change":"2024-09-17T03:47:07.511983+0000","last_active":"2024-09-17T03:47:09.147524+0000","last_peered":"2024-09-17T03:47:09.147524+0000","last_clean":"2024-09-17T03:47:09.147524+0000","last_became_active":"2024-09-17T03:47:07.511524+0000","last_became_peered":"2024-09-17T03:47:07.511524+0000","last_unstale":"2024-09-17T03:47:09.147524+0000","last_undegraded":"2024-09-17T03:47:09.147524+0000","last_fullsized":"2024-09-17T03:47:09.147524+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:16.127852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.489819+0000","last_change":"2024-09-17T03:47:06.507589+0000","last_active":"2024-09-17T03:47:08.489819+0000","last_peered":"2024-09-17T03:47:08.489819+0000","last_clean":"2024-09-17T03:47:08.489819+0000","last_became_active":"2024-09-17T03:47:06.507295+0000","last_became_peered":"2024-09-17T03:47:06.507295+0000","last_unstale":"2024-09-17T03:47:08.489819+0000","last_undegraded":"2024-09-17T03:47:08.489819+0000","last_fullsized":"2024-09-17T03:47:08.489819+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:04.357433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147798+0000","last_change":"2024-09-17T03:47:07.502303+0000","last_active":"2024-09-17T03:47:09.147798+0000","last_peered":"2024-09-17T03:47:09.147798+0000","last_clean":"2024-09-17T03:47:09.147798+0000","last_became_active":"2024-09-17T03:47:07.501258+0000","last_became_peered":"2024-09-17T03:47:07.501258+0000","last_unstale":"2024-09-17T03:47:09.147798+0000","last_undegraded":"2024-09-17T03:47:09.147798+0000","last_fullsized":"2024-09-17T03:47:09.147798+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:26.905112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":15,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147748+0000","last_change":"2024-09-17T03:47:06.495941+0000","last_active":"2024-09-17T03:47:09.147748+0000","last_peered":"2024-09-17T03:47:09.147748+0000","last_clean":"2024-09-17T03:47:09.147748+0000","last_became_active":"2024-09-17T03:47:06.495630+0000","last_became_peered":"2024-09-17T03:47:06.495630+0000","last_unstale":"2024-09-17T03:47:09.147748+0000","last_undegraded":"2024-09-17T03:47:09.147748+0000","last_fullsized":"2024-09-17T03:47:09.147748+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:29.024642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":10,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.511667+0000","last_change":"2024-09-17T03:47:07.509204+0000","last_active":"2024-09-17T03:47:07.511667+0000","last_peered":"2024-09-17T03:47:07.511667+0000","last_clean":"2024-09-17T03:47:07.511667+0000","last_became_active":"2024-09-17T03:47:07.508281+0000","last_became_peered":"2024-09-17T03:47:07.508281+0000","last_unstale":"2024-09-17T03:47:07.511667+0000","last_undegraded":"2024-09-17T03:47:07.511667+0000","last_fullsized":"2024-09-17T03:47:07.511667+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:10.705715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":13,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-17T03:47:07.489731+0000","last_change":"2024-09-17T03:47:06.505043+0000","last_active":"2024-09-17T03:47:07.489731+0000","last_peered":"2024-09-17T03:47:07.489731+0000","last_clean":"2024-09-17T03:47:07.489731+0000","last_became_active":"2024-09-17T03:47:06.504725+0000","last_became_peered":"2024-09-17T03:47:06.504725+0000","last_unstale":"2024-09-17T03:47:07.489731+0000","last_undegraded":"2024-09-17T03:47:07.489731+0000","last_fullsized":"2024-09-17T03:47:07.489731+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":207,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:05.475757+0000","last_clean_scrub_stamp":"2024-09-17T03:47:05.475757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:44.640334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.20","version":"0'0","reported_seq":13,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:08.491087+0000","last_change":"2024-09-17T03:47:07.507849+0000","last_active":"2024-09-17T03:47:08.491087+0000","last_peered":"2024-09-17T03:47:08.491087+0000","last_clean":"2024-09-17T03:47:08.491087+0000","last_became_active":"2024-09-17T03:47:07.507472+0000","last_became_peered":"2024-09-17T03:47:07.507472+0000","last_unstale":"2024-09-17T03:47:08.491087+0000","last_undegraded":"2024-09-17T03:47:08.491087+0000","last_fullsized":"2024-09-17T03:47:08.491087+0000","mapping_epoch":208,"log_start":"0'0","ondisk_log_start":"0'0","created":208,"last_epoch_clean":209,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:47:06.477933+0000","last_clean_scrub_stamp":"2024-09-17T03:47:06.477933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:14.961574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":459,"reported_epoch":210,"state":"active+clean","last_fresh":"2024-09-17T03:47:09.147453+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:47:09.147453+0000","last_peered":"2024-09-17T03:47:09.147453+0000","last_clean":"2024-09-17T03:47:09.147453+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:47:09.147453+0000","last_undegraded":"2024-09-17T03:47:09.147453+0000","last_fullsized":"2024-09-17T03:47:09.147453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":33,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":32,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509616,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60720,"kb_used_data":3164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311120,"statfs":{"total":96636764160,"available":96574586880,"internally_reserved":0,"allocated":3239936,"data_stored":1752713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509616,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60164,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311676,"statfs":{"total":96636764160,"available":96575156224,"internally_reserved":0,"allocated":2662400,"data_stored":1168687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509616,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65676,"kb_used_data":2612,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306164,"statfs":{"total":96636764160,"available":96569511936,"internally_reserved":0,"allocated":2674688,"data_stored":1170243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509616,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55992,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315848,"statfs":{"total":96636764160,"available":96579428352,"internally_reserved":0,"allocated":2654208,"data_stored":1168575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509617,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60164,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311676,"statfs":{"total":96636764160,"available":96575156224,"internally_reserved":0,"allocated":2670592,"data_stored":1169351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509617,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56572,"kb_used_data":3172,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315268,"statfs":{"total":96636764160,"available":96578834432,"internally_reserved":0,"allocated":3248128,"data_stored":1758943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55968,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315872,"statfs":{"total":96636764160,"available":96579452928,"internally_reserved":0,"allocated":2629632,"data_stored":1155500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575023,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60124,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311716,"statfs":{"total":96636764160,"available":96575197184,"internally_reserved":0,"allocated":2629632,"data_stored":1155500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:47:11.874 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:47:11.874 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:47:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.030+0000 7f24fe172640 1 -- 172.21.15.146:0/665003809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f815f480 msgr2=0x7f24f80cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.030+0000 7f24fe172640 1 --2- 172.21.15.146:0/665003809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f815f480 0x7f24f80cf9c0 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 crypto rx=0x7f24f8072b20 tx=0x7f24e802a5a0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.030+0000 7f24fe172640 1 -- 172.21.15.146:0/665003809 shutdown_connections 2024-09-17T03:47:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.030+0000 7f24fe172640 1 --2- 172.21.15.146:0/665003809 >> v2:172.21.15.179:3300/0 conn(0x7f24f815bb20 0x7f24f80cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.030+0000 7f24fe172640 1 --2- 172.21.15.146:0/665003809 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24f8072d50 0x7f24f80cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.030+0000 7f24fe172640 1 --2- 172.21.15.146:0/665003809 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f815f480 0x7f24f80cf9c0 unknown :-1 s=CLOSED pgs=2688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.030+0000 7f24fe172640 1 -- 172.21.15.146:0/665003809 >> 172.21.15.146:0/665003809 conn(0x7f24f80d0ce0 msgr2=0x7f24f80d10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.030+0000 7f24fe172640 1 -- 172.21.15.146:0/665003809 shutdown_connections 2024-09-17T03:47:12.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.030+0000 7f24fe172640 1 -- 172.21.15.146:0/665003809 wait complete. 2024-09-17T03:47:12.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.032+0000 7f24fe172640 1 Processor -- start 2024-09-17T03:47:12.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.032+0000 7f24fe172640 1 -- start start 2024-09-17T03:47:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.033+0000 7f24fe172640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f8072d50 0x7f24f81f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.033+0000 7f24fe172640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24f815bb20 0x7f24f80b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24fe172640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f815f480 0x7f24f80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24fe172640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f24f80cb9f0 con 0x7f24f8072d50 2024-09-17T03:47:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24fe172640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f24f80cb870 con 0x7f24f815f480 2024-09-17T03:47:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24fe172640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f24f80cbb70 con 0x7f24f815bb20 2024-09-17T03:47:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f8072d50 0x7f24f81f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f8072d50 0x7f24f81f50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46008/0 (socket says 172.21.15.146:46008) 2024-09-17T03:47:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f77fe640 1 -- 172.21.15.146:0/1823554413 learned_addr learned my addr 172.21.15.146:0/1823554413 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:12.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f7fff640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f815f480 0x7f24f80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f6ffd640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24f815bb20 0x7f24f80b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f77fe640 1 -- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24f815bb20 msgr2=0x7f24f80b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f77fe640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24f815bb20 0x7f24f80b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f77fe640 1 -- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f815f480 msgr2=0x7f24f80b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f77fe640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f815f480 0x7f24f80b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f77fe640 1 -- 172.21.15.146:0/1823554413 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f80b3e90 con 0x7f24f8072d50 2024-09-17T03:47:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f6ffd640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24f815bb20 0x7f24f80b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24f77fe640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f8072d50 0x7f24f81f50f0 secure :-1 s=READY pgs=2689 cs=0 l=1 rev1=1 crypto rx=0x7f24e8000c00 tx=0x7f24e80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24dffff640 1 -- 172.21.15.146:0/1823554413 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e803e030 con 0x7f24f8072d50 2024-09-17T03:47:12.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24dffff640 1 -- 172.21.15.146:0/1823554413 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24e80047a0 con 0x7f24f8072d50 2024-09-17T03:47:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24fe172640 1 -- 172.21.15.146:0/1823554413 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f80b4170 con 0x7f24f8072d50 2024-09-17T03:47:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24dffff640 1 -- 172.21.15.146:0/1823554413 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e8035040 con 0x7f24f8072d50 2024-09-17T03:47:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.034+0000 7f24fe172640 1 -- 172.21.15.146:0/1823554413 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f80b4730 con 0x7f24f8072d50 2024-09-17T03:47:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.035+0000 7f24fe172640 1 -- 172.21.15.146:0/1823554413 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f80cc110 con 0x7f24f8072d50 2024-09-17T03:47:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.036+0000 7f24dffff640 1 -- 172.21.15.146:0/1823554413 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24e8041030 con 0x7f24f8072d50 2024-09-17T03:47:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.037+0000 7f24dffff640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24e4078bc0 0x7f24e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.037+0000 7f24dffff640 1 -- 172.21.15.146:0/1823554413 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7f24e80bb510 con 0x7f24f8072d50 2024-09-17T03:47:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.037+0000 7f24f6ffd640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24e4078bc0 0x7f24e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.038+0000 7f24f6ffd640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24e4078bc0 0x7f24e407b0d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f24f8158100 tx=0x7f24ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:12.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.041+0000 7f24dffff640 1 -- 172.21.15.146:0/1823554413 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f24e8083300 con 0x7f24f8072d50 2024-09-17T03:47:12.289 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.289+0000 7f24fe172640 1 -- 172.21.15.146:0/1823554413 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f24f80b2690 con 0x7f24f8072d50 2024-09-17T03:47:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.291+0000 7f24dffff640 1 -- 172.21.15.146:0/1823554413 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v29) ==== 190+0+147 (secure 0 0 0) 0x7f24e8087d30 con 0x7f24f8072d50 2024-09-17T03:47:12.291 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2024-09-17T03:47:12.292 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAv+Ohmi7mfDhAAb+7qCiv2IkanVy4DTF4xNw== 2024-09-17T03:47:12.292 INFO:teuthology.orchestra.run.smithi146.stdout: caps mds = "allow" 2024-09-17T03:47:12.292 INFO:teuthology.orchestra.run.smithi146.stdout: caps mon = "allow r" 2024-09-17T03:47:12.292 INFO:teuthology.orchestra.run.smithi146.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:47:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2024-09-17T03:47:12.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 -- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24e4078bc0 msgr2=0x7f24e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:12.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24e4078bc0 0x7f24e407b0d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f24f8158100 tx=0x7f24ec008040 comp rx=0 tx=0).stop 2024-09-17T03:47:12.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 -- 172.21.15.146:0/1823554413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f8072d50 msgr2=0x7f24f81f50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:12.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f8072d50 0x7f24f81f50f0 secure :-1 s=READY pgs=2689 cs=0 l=1 rev1=1 crypto rx=0x7f24e8000c00 tx=0x7f24e80039e0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 -- 172.21.15.146:0/1823554413 shutdown_connections 2024-09-17T03:47:12.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f24e4078bc0 0x7f24e407b0d0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24f815f480 0x7f24f80b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f24f815bb20 0x7f24f80b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 --2- 172.21.15.146:0/1823554413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24f8072d50 0x7f24f81f50f0 unknown :-1 s=CLOSED pgs=2689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 -- 172.21.15.146:0/1823554413 >> 172.21.15.146:0/1823554413 conn(0x7f24f80d0ce0 msgr2=0x7f24f80cf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:12.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 -- 172.21.15.146:0/1823554413 shutdown_connections 2024-09-17T03:47:12.295 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.294+0000 7f24fe172640 1 -- 172.21.15.146:0/1823554413 wait complete. 2024-09-17T03:47:12.306 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:47:12.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.419+0000 7f8766d20640 1 -- 172.21.15.146:0/2524036917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8748005350 msgr2=0x7f874800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:12.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.419+0000 7f8766d20640 1 --2- 172.21.15.146:0/2524036917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8748005350 0x7f874800b9c0 secure :-1 s=READY pgs=2691 cs=0 l=1 rev1=1 crypto rx=0x7f8758001690 tx=0x7f8748005830 comp rx=0 tx=0).stop 2024-09-17T03:47:12.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.419+0000 7f8766d20640 1 -- 172.21.15.146:0/2524036917 shutdown_connections 2024-09-17T03:47:12.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.419+0000 7f8766d20640 1 --2- 172.21.15.146:0/2524036917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8748005350 0x7f874800b9c0 unknown :-1 s=CLOSED pgs=2691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.419+0000 7f8766d20640 1 -- 172.21.15.146:0/2524036917 >> 172.21.15.146:0/2524036917 conn(0x7f87600b3880 msgr2=0x7f87600d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:12.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.419+0000 7f8766d20640 1 -- 172.21.15.146:0/2524036917 shutdown_connections 2024-09-17T03:47:12.420 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.419+0000 7f8766d20640 1 -- 172.21.15.146:0/2524036917 wait complete. 2024-09-17T03:47:12.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.421+0000 7f8766d20640 1 Processor -- start 2024-09-17T03:47:12.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.421+0000 7f8766d20640 1 -- start start 2024-09-17T03:47:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.422+0000 7f8766d20640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8748005350 0x7f87601579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.422+0000 7f8766d20640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876013af50 0x7f876013b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f8766d20640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876013b8a0 0x7f87601f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f8766d20640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f876015cd30 con 0x7f876013af50 2024-09-17T03:47:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f8766d20640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f876015cbb0 con 0x7f876013b8a0 2024-09-17T03:47:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f8766d20640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f87600735b0 con 0x7f8748005350 2024-09-17T03:47:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876013af50 0x7f876013b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875ffff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876013af50 0x7f876013b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46036/0 (socket says 172.21.15.146:46036) 2024-09-17T03:47:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875ffff640 1 -- 172.21.15.146:0/694644025 learned_addr learned my addr 172.21.15.146:0/694644025 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f8764abc640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8748005350 0x7f87601579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:12.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f87652bd640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876013b8a0 0x7f87601f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875ffff640 1 -- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8748005350 msgr2=0x7f87601579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875ffff640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8748005350 0x7f87601579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875ffff640 1 -- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876013b8a0 msgr2=0x7f87601f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875ffff640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876013b8a0 0x7f87601f6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875ffff640 1 -- 172.21.15.146:0/694644025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8760159090 con 0x7f876013af50 2024-09-17T03:47:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875ffff640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876013af50 0x7f876013b360 secure :-1 s=READY pgs=2692 cs=0 l=1 rev1=1 crypto rx=0x7f8754010b00 tx=0x7f875400e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875d7fa640 1 -- 172.21.15.146:0/694644025 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8754003970 con 0x7f876013af50 2024-09-17T03:47:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875d7fa640 1 -- 172.21.15.146:0/694644025 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8754003c00 con 0x7f876013af50 2024-09-17T03:47:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f8766d20640 1 -- 172.21.15.146:0/694644025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8760152530 con 0x7f876013af50 2024-09-17T03:47:12.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f875d7fa640 1 -- 172.21.15.146:0/694644025 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8754004050 con 0x7f876013af50 2024-09-17T03:47:12.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.423+0000 7f8766d20640 1 -- 172.21.15.146:0/694644025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87601585b0 con 0x7f876013af50 2024-09-17T03:47:12.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.424+0000 7f8766d20640 1 -- 172.21.15.146:0/694644025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8760073ac0 con 0x7f876013af50 2024-09-17T03:47:12.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.425+0000 7f875d7fa640 1 -- 172.21.15.146:0/694644025 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f87540041f0 con 0x7f876013af50 2024-09-17T03:47:12.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.426+0000 7f875d7fa640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f874c078bc0 0x7f874c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:12.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.426+0000 7f875d7fa640 1 -- 172.21.15.146:0/694644025 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7f875409bc20 con 0x7f876013af50 2024-09-17T03:47:12.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.426+0000 7f8764abc640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f874c078bc0 0x7f874c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:12.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.426+0000 7f8764abc640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f874c078bc0 0x7f874c07b0d0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f87500046e0 tx=0x7f8750001260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:12.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.430+0000 7f875d7fa640 1 -- 172.21.15.146:0/694644025 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f87540640f0 con 0x7f876013af50 2024-09-17T03:47:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.642+0000 7f8766d20640 1 -- 172.21.15.146:0/694644025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f876015a360 con 0x7f876013af50 2024-09-17T03:47:12.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.643+0000 7f875d7fa640 1 -- 172.21.15.146:0/694644025 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 163 v163) ==== 95+0+5250 (secure 0 0 0) 0x7f87540639f0 con 0x7f876013af50 2024-09-17T03:47:12.643 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:12.643 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":163,"btime":"2024-09-17T03:47:10:512617+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157},{"gid":11841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2488811693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2488811693},{"type":"v1","addr":"172.21.15.146:6835","nonce":2488811693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158}],"filesystems":[{"mdsmap":{"epoch":163,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:47:06.858092+0000","modified":"2024-09-17T03:47:09.879574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11853},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11853":{"gid":11853,"name":"d","rank":0,"incarnation":159,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3004139766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3004139766},{"type":"v1","addr":"172.21.15.179:6837","nonce":3004139766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11853,"qdb_cluster":[11853]},"id":16}]} 2024-09-17T03:47:12.644 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 163 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 -- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f874c078bc0 msgr2=0x7f874c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f874c078bc0 0x7f874c07b0d0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f87500046e0 tx=0x7f8750001260 comp rx=0 tx=0).stop 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 -- 172.21.15.146:0/694644025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876013af50 msgr2=0x7f876013b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876013af50 0x7f876013b360 secure :-1 s=READY pgs=2692 cs=0 l=1 rev1=1 crypto rx=0x7f8754010b00 tx=0x7f875400e350 comp rx=0 tx=0).stop 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 -- 172.21.15.146:0/694644025 shutdown_connections 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f874c078bc0 0x7f874c07b0d0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f876013b8a0 0x7f87601f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f876013af50 0x7f876013b360 unknown :-1 s=CLOSED pgs=2692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 --2- 172.21.15.146:0/694644025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8748005350 0x7f87601579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 -- 172.21.15.146:0/694644025 >> 172.21.15.146:0/694644025 conn(0x7f87600b3880 msgr2=0x7f8760159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 -- 172.21.15.146:0/694644025 shutdown_connections 2024-09-17T03:47:12.646 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:12.645+0000 7f8766d20640 1 -- 172.21.15.146:0/694644025 wait complete. 2024-09-17T03:47:13.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 163, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:47:06.858092+0000', 'modified': '2024-09-17T03:47:09.879574+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11853}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11853': {'gid': 11853, 'name': 'd', 'rank': 0, 'incarnation': 159, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6837/3004139766', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6835', 'nonce': 3004139766}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 3004139766}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [33], 'metadata_pool': 32, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11853, 'qdb_cluster': [11853]} 2024-09-17T03:47:13.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:47:13.060 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:47:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.176+0000 7ff059101640 1 -- 172.21.15.146:0/4129402935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff05406fde0 msgr2=0x7ff0540701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.176+0000 7ff059101640 1 --2- 172.21.15.146:0/4129402935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff05406fde0 0x7ff0540701f0 secure :-1 s=READY pgs=2693 cs=0 l=1 rev1=1 crypto rx=0x7ff03c005fd0 tx=0x7ff03c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.176+0000 7ff059101640 1 -- 172.21.15.146:0/4129402935 shutdown_connections 2024-09-17T03:47:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.176+0000 7ff059101640 1 --2- 172.21.15.146:0/4129402935 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0540b3de0 0x7ff0540b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.176+0000 7ff059101640 1 --2- 172.21.15.146:0/4129402935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff05406fde0 0x7ff0540701f0 unknown :-1 s=CLOSED pgs=2693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.176+0000 7ff059101640 1 -- 172.21.15.146:0/4129402935 >> 172.21.15.146:0/4129402935 conn(0x7ff0540b2ae0 msgr2=0x7ff0540b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:13.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.176+0000 7ff059101640 1 -- 172.21.15.146:0/4129402935 shutdown_connections 2024-09-17T03:47:13.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.177+0000 7ff059101640 1 -- 172.21.15.146:0/4129402935 wait complete. 2024-09-17T03:47:13.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.178+0000 7ff059101640 1 Processor -- start 2024-09-17T03:47:13.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.178+0000 7ff059101640 1 -- start start 2024-09-17T03:47:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff059101640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff05406fde0 0x7ff05413f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff059101640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0540b3de0 0x7ff0541473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff059101640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0540d05e0 0x7ff054147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff059101640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff054068e80 con 0x7ff0540b3de0 2024-09-17T03:47:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff059101640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff054068d00 con 0x7ff05406fde0 2024-09-17T03:47:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff059101640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff054069000 con 0x7ff0540d05e0 2024-09-17T03:47:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff04bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0540b3de0 0x7ff0541473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff04bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0540b3de0 0x7ff0541473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46052/0 (socket says 172.21.15.146:46052) 2024-09-17T03:47:13.182 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff04bfff640 1 -- 172.21.15.146:0/522593739 learned_addr learned my addr 172.21.15.146:0/522593739 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff05359e640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0540d05e0 0x7ff054147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff052d9d640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff05406fde0 0x7ff05413f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff04bfff640 1 -- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0540d05e0 msgr2=0x7ff054147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff04bfff640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0540d05e0 0x7ff054147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff04bfff640 1 -- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff05406fde0 msgr2=0x7ff05413f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff04bfff640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff05406fde0 0x7ff05413f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff04bfff640 1 -- 172.21.15.146:0/522593739 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff054148c40 con 0x7ff0540b3de0 2024-09-17T03:47:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff04bfff640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0540b3de0 0x7ff0541473e0 secure :-1 s=READY pgs=2694 cs=0 l=1 rev1=1 crypto rx=0x7ff03c006010 tx=0x7ff03c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff04b7fe640 1 -- 172.21.15.146:0/522593739 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c03e030 con 0x7ff0540b3de0 2024-09-17T03:47:13.183 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff04b7fe640 1 -- 172.21.15.146:0/522593739 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff03c003ca0 con 0x7ff0540b3de0 2024-09-17T03:47:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.180+0000 7ff059101640 1 -- 172.21.15.146:0/522593739 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff054143b10 con 0x7ff0540b3de0 2024-09-17T03:47:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.181+0000 7ff04b7fe640 1 -- 172.21.15.146:0/522593739 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c035040 con 0x7ff0540b3de0 2024-09-17T03:47:13.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.181+0000 7ff059101640 1 -- 172.21.15.146:0/522593739 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff054148440 con 0x7ff0540b3de0 2024-09-17T03:47:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.182+0000 7ff04b7fe640 1 -- 172.21.15.146:0/522593739 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff03c041030 con 0x7ff0540b3de0 2024-09-17T03:47:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.183+0000 7ff04b7fe640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff034078b90 0x7ff03407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.183+0000 7ff04b7fe640 1 -- 172.21.15.146:0/522593739 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7ff03c0bb330 con 0x7ff0540b3de0 2024-09-17T03:47:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.183+0000 7ff052d9d640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff034078b90 0x7ff03407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.184+0000 7ff052d9d640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff034078b90 0x7ff03407b0a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff0440015e0 tx=0x7ff044009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.184+0000 7ff06006f740 1 Processor -- start 2024-09-17T03:47:13.185 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.184+0000 7ff06006f740 1 -- start start 2024-09-17T03:47:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.185+0000 7ff06006f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171ac270 0x56071757dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.185+0000 7ff06006f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171833b0 0x56071757e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.185+0000 7ff06006f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x56071759b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.185+0000 7ff06006f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5607174c6820 con 0x5607171ac270 2024-09-17T03:47:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.185+0000 7ff06006f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5607174b5c50 con 0x5607171833b0 2024-09-17T03:47:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.185+0000 7ff06006f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5607174b9a60 con 0x56071718b590 2024-09-17T03:47:13.188 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.185+0000 7ff052d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171ac270 0x56071757dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.185+0000 7ff052d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171ac270 0x56071757dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46054/0 (socket says 172.21.15.146:46054) 2024-09-17T03:47:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.185+0000 7ff052d9d640 1 -- 172.21.15.146:0/2284914231 learned_addr learned my addr 172.21.15.146:0/2284914231 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.185+0000 7ff04bfff640 1 --2- 172.21.15.146:0/2284914231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171833b0 0x56071757e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.185+0000 7ff05359e640 1 --2- 172.21.15.146:0/2284914231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x56071759b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.186+0000 7ff052d9d640 1 -- 172.21.15.146:0/2284914231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 msgr2=0x56071759b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.186+0000 7ff052d9d640 1 --2- 172.21.15.146:0/2284914231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x56071759b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.186+0000 7ff052d9d640 1 -- 172.21.15.146:0/2284914231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171833b0 msgr2=0x56071757e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.186+0000 7ff052d9d640 1 --2- 172.21.15.146:0/2284914231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171833b0 0x56071757e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.186+0000 7ff052d9d640 1 -- 172.21.15.146:0/2284914231 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560717217850 con 0x5607171ac270 2024-09-17T03:47:13.189 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.186+0000 7ff05359e640 1 --2- 172.21.15.146:0/2284914231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x56071759b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.186+0000 7ff052d9d640 1 --2- 172.21.15.146:0/2284914231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171ac270 0x56071757dfc0 secure :-1 s=READY pgs=2695 cs=0 l=1 rev1=1 crypto rx=0x7ff044005280 tx=0x7ff044011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ced4cd3aae9c524 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.186+0000 7ff048ff9640 1 -- 172.21.15.146:0/2284914231 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04400e4b0 con 0x5607171ac270 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.186+0000 7ff048ff9640 1 -- 172.21.15.146:0/2284914231 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff04400e740 con 0x5607171ac270 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.186+0000 7ff048ff9640 1 -- 172.21.15.146:0/2284914231 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04400eb30 con 0x5607171ac270 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.187+0000 7ff06006f740 1 -- 172.21.15.146:0/2284914231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171ac270 msgr2=0x56071757dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.187+0000 7ff06006f740 1 --2- 172.21.15.146:0/2284914231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171ac270 0x56071757dfc0 secure :-1 s=READY pgs=2695 cs=0 l=1 rev1=1 crypto rx=0x7ff044005280 tx=0x7ff044011000 comp rx=0 tx=0).stop 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.187+0000 7ff06006f740 1 -- 172.21.15.146:0/2284914231 shutdown_connections 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.187+0000 7ff06006f740 1 --2- 172.21.15.146:0/2284914231 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x56071759b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.187+0000 7ff06006f740 1 --2- 172.21.15.146:0/2284914231 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171833b0 0x56071757e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.187+0000 7ff06006f740 1 --2- 172.21.15.146:0/2284914231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171ac270 0x56071757dfc0 unknown :-1 s=CLOSED pgs=2695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.187+0000 7ff06006f740 1 -- 172.21.15.146:0/2284914231 >> 172.21.15.146:0/2284914231 conn(0x5607171a03c0 msgr2=0x560717554280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.187+0000 7ff06006f740 1 -- 172.21.15.146:0/2284914231 shutdown_connections 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.187+0000 7ff06006f740 1 -- 172.21.15.146:0/2284914231 wait complete. 2024-09-17T03:47:13.190 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.188+0000 7ff06006f740 1 -- start start 2024-09-17T03:47:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.188+0000 7ff06006f740 1 Processor -- start 2024-09-17T03:47:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff06006f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071758fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff06006f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56071718b590 0x560717591ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff06006f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5607171ac270 0x5607175a86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff06006f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560717226620 con 0x5607171833b0 2024-09-17T03:47:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff06006f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x56071745b5f0 con 0x56071718b590 2024-09-17T03:47:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff06006f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56071757ea40 con 0x5607171ac270 2024-09-17T03:47:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff06006f740 10 client.0 _ll_register_callbacks cb 0x56071745f0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff052d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071758fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff052d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071758fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46062/0 (socket says 172.21.15.146:46062) 2024-09-17T03:47:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff052d9d640 1 -- 172.21.15.146:0/2414409570 learned_addr learned my addr 172.21.15.146:0/2414409570 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff05359e640 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5607171ac270 0x5607175a86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.189+0000 7ff04bfff640 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56071718b590 0x560717591ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff052d9d640 1 -- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5607171ac270 msgr2=0x5607175a86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:13.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff052d9d640 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5607171ac270 0x5607175a86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff052d9d640 1 -- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56071718b590 msgr2=0x560717591ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff052d9d640 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56071718b590 0x560717591ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff052d9d640 1 -- 172.21.15.146:0/2414409570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56071728e6b0 con 0x5607171833b0 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff05359e640 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5607171ac270 0x5607175a86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff04bfff640 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56071718b590 0x560717591ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff052d9d640 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071758fbb0 secure :-1 s=READY pgs=2696 cs=0 l=1 rev1=1 crypto rx=0x560717555e50 tx=0x7ff04400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24aadd358896fae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff031ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff031ffb640 1 -- 172.21.15.146:0/2414409570 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044021650 con 0x5607171833b0 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff031ffb640 1 -- 172.21.15.146:0/2414409570 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7ff0440217f0 con 0x5607171833b0 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff06006f740 1 -- 172.21.15.146:0/2414409570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff04400e740 con 0x5607171833b0 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff031ffb640 1 -- 172.21.15.146:0/2414409570 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=163) ==== 24+0+0 (secure 0 0 0) 0x7ff044030050 con 0x5607171833b0 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff06006f740 10 client.11976 fetch_fsmap learned FSMap version 163 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff06006f740 1 -- 172.21.15.146:0/2414409570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=163,monmap=2+}) -- 0x5607175a8230 con 0x5607171833b0 2024-09-17T03:47:13.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff031ffb640 1 -- 172.21.15.146:0/2414409570 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff04400e740 con 0x5607171833b0 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff031ffb640 1 -- 172.21.15.146:0/2414409570 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 163) ==== 3502+0+0 (secure 0 0 0) 0x7ff044033020 con 0x5607171833b0 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff06006f740 10 client.11976 fetch_fsmap finished waiting for FSMap version 163 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff06006f740 10 client.11976 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff06006f740 20 client.11976 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff06006f740 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:6835/3004139766,v1:172.21.15.179:6837/3004139766] conn(0x56071716ae40 0x56071756a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff06006f740 4 client.11976 mds_command: new command op to 11853 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.190+0000 7ff06006f740 1 -- 172.21.15.146:0/2414409570 --> [v2:172.21.15.179:6835/3004139766,v1:172.21.15.179:6837/3004139766] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607174c8770 con 0x56071716ae40 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.191+0000 7ff04bfff640 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:6835/3004139766,v1:172.21.15.179:6837/3004139766] conn(0x56071716ae40 0x56071756a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.191+0000 7ff031ffb640 10 client.11976 ms_handle_connect on v2:172.21.15.179:6835/3004139766 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.191+0000 7ff04bfff640 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:6835/3004139766,v1:172.21.15.179:6837/3004139766] conn(0x56071716ae40 0x56071756a630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84d01780e02fe06b server_cookie=88846f783b54f843 in_seq=0 out_seq=0 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff031ffb640 1 -- 172.21.15.146:0/2414409570 <== mds.0 v2:172.21.15.179:6835/3004139766 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5607174c8770 con 0x56071716ae40 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff031ffb640 10 client.11976 handle_command_reply: tid=0 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 1 client.11976 shutdown 2024-09-17T03:47:13.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 1 -- 172.21.15.146:0/2414409570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 msgr2=0x56071758fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071758fbb0 secure :-1 s=READY pgs=2696 cs=0 l=1 rev1=1 crypto rx=0x560717555e50 tx=0x7ff04400eba0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 1 -- 172.21.15.146:0/2414409570 shutdown_connections 2024-09-17T03:47:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:6835/3004139766,v1:172.21.15.179:6837/3004139766] conn(0x56071716ae40 0x56071756a630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5607171ac270 0x5607175a86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56071718b590 0x560717591ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 1 --2- 172.21.15.146:0/2414409570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071758fbb0 unknown :-1 s=CLOSED pgs=2696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 1 -- 172.21.15.146:0/2414409570 >> 172.21.15.146:0/2414409570 conn(0x5607171a03c0 msgr2=0x56071754eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff031ffb640 0 client.11976 ms_handle_reset on v2:172.21.15.179:6835/3004139766 2024-09-17T03:47:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 1 -- 172.21.15.146:0/2414409570 shutdown_connections 2024-09-17T03:47:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 1 -- 172.21.15.146:0/2414409570 wait complete. 2024-09-17T03:47:13.198 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.192+0000 7ff06006f740 20 client.11976 trim_cache size 0 max 16384 2024-09-17T03:47:13.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.210+0000 7ff06006f740 1 Processor -- start 2024-09-17T03:47:13.211 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.211+0000 7ff06006f740 1 -- start start 2024-09-17T03:47:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff06006f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x5607175bc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff06006f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x560717554110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff06006f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171ac270 0x560717554650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff06006f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff0541ff270 con 0x5607171833b0 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff06006f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff054142db0 con 0x5607171ac270 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff06006f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff054143400 con 0x56071718b590 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff052d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x5607175bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff052d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x5607175bc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46076/0 (socket says 172.21.15.146:46076) 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff052d9d640 1 -- 172.21.15.146:0/3830693495 learned_addr learned my addr 172.21.15.146:0/3830693495 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff04bfff640 1 --2- 172.21.15.146:0/3830693495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x560717554110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff052d9d640 1 -- 172.21.15.146:0/3830693495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 msgr2=0x560717554110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff05359e640 1 --2- 172.21.15.146:0/3830693495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171ac270 0x560717554650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff052d9d640 1 --2- 172.21.15.146:0/3830693495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x560717554110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff052d9d640 1 -- 172.21.15.146:0/3830693495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171ac270 msgr2=0x560717554650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff052d9d640 1 --2- 172.21.15.146:0/3830693495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171ac270 0x560717554650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff052d9d640 1 -- 172.21.15.146:0/3830693495 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560717575860 con 0x5607171833b0 2024-09-17T03:47:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff04bfff640 1 --2- 172.21.15.146:0/3830693495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x560717554110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff05359e640 1 --2- 172.21.15.146:0/3830693495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171ac270 0x560717554650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff052d9d640 1 --2- 172.21.15.146:0/3830693495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x5607175bc160 secure :-1 s=READY pgs=2697 cs=0 l=1 rev1=1 crypto rx=0x7ff044021c00 tx=0x7ff04400e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32b929fd6a3ab59 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.212+0000 7ff033fff640 1 -- 172.21.15.146:0/3830693495 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044039070 con 0x5607171833b0 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.213+0000 7ff033fff640 1 -- 172.21.15.146:0/3830693495 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff04400e740 con 0x5607171833b0 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.213+0000 7ff033fff640 1 -- 172.21.15.146:0/3830693495 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04402a420 con 0x5607171833b0 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.213+0000 7ff06006f740 1 -- 172.21.15.146:0/3830693495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 msgr2=0x5607175bc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.213+0000 7ff06006f740 1 --2- 172.21.15.146:0/3830693495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x5607175bc160 secure :-1 s=READY pgs=2697 cs=0 l=1 rev1=1 crypto rx=0x7ff044021c00 tx=0x7ff04400e160 comp rx=0 tx=0).stop 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.213+0000 7ff06006f740 1 -- 172.21.15.146:0/3830693495 shutdown_connections 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.213+0000 7ff06006f740 1 --2- 172.21.15.146:0/3830693495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171ac270 0x560717554650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.213+0000 7ff06006f740 1 --2- 172.21.15.146:0/3830693495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x560717554110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.213+0000 7ff06006f740 1 --2- 172.21.15.146:0/3830693495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x5607175bc160 unknown :-1 s=CLOSED pgs=2697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.213+0000 7ff06006f740 1 -- 172.21.15.146:0/3830693495 >> 172.21.15.146:0/3830693495 conn(0x5607171a03c0 msgr2=0x560717555330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.213+0000 7ff06006f740 1 -- 172.21.15.146:0/3830693495 shutdown_connections 2024-09-17T03:47:13.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.213+0000 7ff06006f740 1 -- 172.21.15.146:0/3830693495 wait complete. 2024-09-17T03:47:13.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.214+0000 7ff06006f740 1 -- start start 2024-09-17T03:47:13.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.214+0000 7ff06006f740 1 Processor -- start 2024-09-17T03:47:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.215+0000 7ff06006f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071760e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.215+0000 7ff06006f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x5607175993c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.215+0000 7ff06006f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171ac270 0x560717599900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.215+0000 7ff06006f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5607175ab6c0 con 0x5607171833b0 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.215+0000 7ff06006f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5607175901f0 con 0x5607171ac270 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.215+0000 7ff06006f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x56071757b390 con 0x56071718b590 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.215+0000 7ff06006f740 10 client.0 _ll_register_callbacks cb 0x7ff03c0056f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.215+0000 7ff052d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071760e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff052d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071760e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46088/0 (socket says 172.21.15.146:46088) 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff052d9d640 1 -- 172.21.15.146:0/2504974562 learned_addr learned my addr 172.21.15.146:0/2504974562 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff05359e640 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171ac270 0x560717599900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff04bfff640 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x5607175993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff052d9d640 1 -- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 msgr2=0x5607175993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff052d9d640 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x5607175993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff052d9d640 1 -- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171ac270 msgr2=0x560717599900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff052d9d640 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171ac270 0x560717599900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff052d9d640 1 -- 172.21.15.146:0/2504974562 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607175bb280 con 0x5607171833b0 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff052d9d640 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071760e2c0 secure :-1 s=READY pgs=2698 cs=0 l=1 rev1=1 crypto rx=0x7ff044005040 tx=0x7ff044000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8576fa9076c8c21 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff031ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff031ffb640 1 -- 172.21.15.146:0/2504974562 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044039070 con 0x5607171833b0 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff031ffb640 1 -- 172.21.15.146:0/2504974562 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7ff04402a830 con 0x5607171833b0 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff06006f740 1 -- 172.21.15.146:0/2504974562 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff04400e740 con 0x5607171833b0 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff031ffb640 1 -- 172.21.15.146:0/2504974562 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=163) ==== 24+0+0 (secure 0 0 0) 0x7ff04404a050 con 0x5607171833b0 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff06006f740 10 client.11982 fetch_fsmap learned FSMap version 163 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff06006f740 1 -- 172.21.15.146:0/2504974562 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=163,monmap=2+}) -- 0x5607175bbae0 con 0x5607171833b0 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.216+0000 7ff031ffb640 1 -- 172.21.15.146:0/2504974562 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff04400e740 con 0x5607171833b0 2024-09-17T03:47:13.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff031ffb640 1 -- 172.21.15.146:0/2504974562 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 163) ==== 3502+0+0 (secure 0 0 0) 0x7ff04404d020 con 0x5607171833b0 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff06006f740 10 client.11982 fetch_fsmap finished waiting for FSMap version 163 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff06006f740 10 client.11982 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff06006f740 20 client.11982 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff06006f740 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:6835/3004139766,v1:172.21.15.179:6837/3004139766] conn(0x56071761b450 0x56071761b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff06006f740 4 client.11982 mds_command: new command op to 11853 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff06006f740 1 -- 172.21.15.146:0/2504974562 --> [v2:172.21.15.179:6835/3004139766,v1:172.21.15.179:6837/3004139766] -- command(tid 0: {"prefix": "status"}) -- 0x5607174c4220 con 0x56071761b450 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff04bfff640 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:6835/3004139766,v1:172.21.15.179:6837/3004139766] conn(0x56071761b450 0x56071761b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff04bfff640 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:6835/3004139766,v1:172.21.15.179:6837/3004139766] conn(0x56071761b450 0x56071761b860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7e7455b415b4ce7 server_cookie=1b9932fcdf609218 in_seq=0 out_seq=0 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff031ffb640 10 client.11982 ms_handle_connect on v2:172.21.15.179:6835/3004139766 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff031ffb640 1 -- 172.21.15.146:0/2504974562 <== mds.0 v2:172.21.15.179:6835/3004139766 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x5607174c4220 con 0x56071761b450 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff031ffb640 10 client.11982 handle_command_reply: tid=0 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.217+0000 7ff06006f740 1 client.11982 shutdown 2024-09-17T03:47:13.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff06006f740 1 -- 172.21.15.146:0/2504974562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 msgr2=0x56071760e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff06006f740 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071760e2c0 secure :-1 s=READY pgs=2698 cs=0 l=1 rev1=1 crypto rx=0x7ff044005040 tx=0x7ff044000bc0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff06006f740 1 -- 172.21.15.146:0/2504974562 shutdown_connections 2024-09-17T03:47:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff06006f740 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:6835/3004139766,v1:172.21.15.179:6837/3004139766] conn(0x56071761b450 0x56071761b860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff06006f740 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5607171ac270 0x560717599900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff031ffb640 0 client.11982 ms_handle_reset on v2:172.21.15.179:6835/3004139766 2024-09-17T03:47:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff06006f740 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x56071718b590 0x5607175993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff06006f740 1 --2- 172.21.15.146:0/2504974562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5607171833b0 0x56071760e2c0 unknown :-1 s=CLOSED pgs=2698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff06006f740 1 -- 172.21.15.146:0/2504974562 >> 172.21.15.146:0/2504974562 conn(0x5607171a03c0 msgr2=0x560717575e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff06006f740 1 -- 172.21.15.146:0/2504974562 shutdown_connections 2024-09-17T03:47:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff06006f740 1 -- 172.21.15.146:0/2504974562 wait complete. 2024-09-17T03:47:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff06006f740 20 client.11982 trim_cache size 0 max 16384 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 11853, 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 5.7323978579999997, 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 163, 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 210, 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 210, 2024-09-17T03:47:13.225 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 10.424492724 2024-09-17T03:47:13.226 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:47:13.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 -- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff034078b90 msgr2=0x7ff03407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff034078b90 0x7ff03407b0a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff0440015e0 tx=0x7ff044009040 comp rx=0 tx=0).stop 2024-09-17T03:47:13.226 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 -- 172.21.15.146:0/522593739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0540b3de0 msgr2=0x7ff0541473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0540b3de0 0x7ff0541473e0 secure :-1 s=READY pgs=2694 cs=0 l=1 rev1=1 crypto rx=0x7ff03c006010 tx=0x7ff03c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 -- 172.21.15.146:0/522593739 shutdown_connections 2024-09-17T03:47:13.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff034078b90 0x7ff03407b0a0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff0540d05e0 0x7ff054147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0540b3de0 0x7ff0541473e0 unknown :-1 s=CLOSED pgs=2694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 --2- 172.21.15.146:0/522593739 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff05406fde0 0x7ff05413f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 -- 172.21.15.146:0/522593739 >> 172.21.15.146:0/522593739 conn(0x7ff0540b2ae0 msgr2=0x7ff0541525d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:13.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 -- 172.21.15.146:0/522593739 shutdown_connections 2024-09-17T03:47:13.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.218+0000 7ff059101640 1 -- 172.21.15.146:0/522593739 wait complete. 2024-09-17T03:47:13.230 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:47:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.342+0000 7f7a207a1640 1 -- 172.21.15.146:0/3857566749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a18073cc0 msgr2=0x7f7a1815c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.342+0000 7f7a207a1640 1 --2- 172.21.15.146:0/3857566749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a18073cc0 0x7f7a1815c9a0 secure :-1 s=READY pgs=2700 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c005fd0 tx=0x7f7a0c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.342+0000 7f7a207a1640 1 -- 172.21.15.146:0/3857566749 shutdown_connections 2024-09-17T03:47:13.342 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.342+0000 7f7a207a1640 1 --2- 172.21.15.146:0/3857566749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a18073cc0 0x7f7a1815c9a0 unknown :-1 s=CLOSED pgs=2700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.342+0000 7f7a207a1640 1 -- 172.21.15.146:0/3857566749 >> 172.21.15.146:0/3857566749 conn(0x7f7a180b3880 msgr2=0x7f7a180d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.342+0000 7f7a207a1640 1 -- 172.21.15.146:0/3857566749 shutdown_connections 2024-09-17T03:47:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.342+0000 7f7a207a1640 1 -- 172.21.15.146:0/3857566749 wait complete. 2024-09-17T03:47:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.344+0000 7f7a207a1640 1 Processor -- start 2024-09-17T03:47:13.343 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.344+0000 7f7a207a1640 1 -- start start 2024-09-17T03:47:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a207a1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a18070fc0 0x7f7a181565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a207a1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a180cfe10 0x7f7a181f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.346 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a207a1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a18157550 0x7f7a1815ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a207a1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7a180d0cc0 con 0x7f7a180cfe10 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a207a1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7a180d0b40 con 0x7f7a18157550 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a207a1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7a180d0e40 con 0x7f7a18070fc0 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a1dd3c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a180cfe10 0x7f7a181f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a1dd3c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a180cfe10 0x7f7a181f6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46110/0 (socket says 172.21.15.146:46110) 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a1dd3c640 1 -- 172.21.15.146:0/525211326 learned_addr learned my addr 172.21.15.146:0/525211326 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a1ed3e640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a18157550 0x7f7a1815ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a1e53d640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a18070fc0 0x7f7a181565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a1dd3c640 1 -- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a18070fc0 msgr2=0x7f7a181565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a1dd3c640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a18070fc0 0x7f7a181565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a1dd3c640 1 -- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a18157550 msgr2=0x7f7a1815ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a1dd3c640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a18157550 0x7f7a1815ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a1dd3c640 1 -- 172.21.15.146:0/525211326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a18156ae0 con 0x7f7a180cfe10 2024-09-17T03:47:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.345+0000 7f7a1e53d640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a18070fc0 0x7f7a181565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.346+0000 7f7a1dd3c640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a180cfe10 0x7f7a181f6a50 secure :-1 s=READY pgs=2701 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c034040 tx=0x7f7a0c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.346+0000 7f7a16ffd640 1 -- 172.21.15.146:0/525211326 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c03e030 con 0x7f7a180cfe10 2024-09-17T03:47:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.346+0000 7f7a16ffd640 1 -- 172.21.15.146:0/525211326 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a0c003e00 con 0x7f7a180cfe10 2024-09-17T03:47:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.346+0000 7f7a207a1640 1 -- 172.21.15.146:0/525211326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1814d4d0 con 0x7f7a180cfe10 2024-09-17T03:47:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.346+0000 7f7a16ffd640 1 -- 172.21.15.146:0/525211326 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c035040 con 0x7f7a180cfe10 2024-09-17T03:47:13.348 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.346+0000 7f7a207a1640 1 -- 172.21.15.146:0/525211326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a18150750 con 0x7f7a180cfe10 2024-09-17T03:47:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.347+0000 7f7a207a1640 1 -- 172.21.15.146:0/525211326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a180b5940 con 0x7f7a180cfe10 2024-09-17T03:47:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.348+0000 7f7a16ffd640 1 -- 172.21.15.146:0/525211326 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a0c041030 con 0x7f7a180cfe10 2024-09-17T03:47:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.348+0000 7f7a16ffd640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a04078b90 0x7f7a0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.348+0000 7f7a16ffd640 1 -- 172.21.15.146:0/525211326 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7f7a0c0bb550 con 0x7f7a180cfe10 2024-09-17T03:47:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.348+0000 7f7a1e53d640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a04078b90 0x7f7a0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.349+0000 7f7a1e53d640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a04078b90 0x7f7a0407b0a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f7a08007fd0 tx=0x7f7a08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.353+0000 7f7a16ffd640 1 -- 172.21.15.146:0/525211326 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7a180b5940 con 0x7f7a180cfe10 2024-09-17T03:47:13.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.564+0000 7f7a207a1640 1 -- 172.21.15.146:0/525211326 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7a181504e0 con 0x7f7a180cfe10 2024-09-17T03:47:13.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.564+0000 7f7a16ffd640 1 -- 172.21.15.146:0/525211326 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v163) ==== 53+0+73 (secure 0 0 0) 0x7f7a0c0833d0 con 0x7f7a180cfe10 2024-09-17T03:47:13.564 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:47:13.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 -- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a04078b90 msgr2=0x7f7a0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a04078b90 0x7f7a0407b0a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f7a08007fd0 tx=0x7f7a08009040 comp rx=0 tx=0).stop 2024-09-17T03:47:13.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 -- 172.21.15.146:0/525211326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a180cfe10 msgr2=0x7f7a181f6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:13.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a180cfe10 0x7f7a181f6a50 secure :-1 s=READY pgs=2701 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c034040 tx=0x7f7a0c003910 comp rx=0 tx=0).stop 2024-09-17T03:47:13.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 -- 172.21.15.146:0/525211326 shutdown_connections 2024-09-17T03:47:13.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7a04078b90 0x7f7a0407b0a0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a18157550 0x7f7a1815ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a180cfe10 0x7f7a181f6a50 unknown :-1 s=CLOSED pgs=2701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 --2- 172.21.15.146:0/525211326 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a18070fc0 0x7f7a181565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:13.567 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 -- 172.21.15.146:0/525211326 >> 172.21.15.146:0/525211326 conn(0x7f7a180b3880 msgr2=0x7f7a180735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:13.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 -- 172.21.15.146:0/525211326 shutdown_connections 2024-09-17T03:47:13.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13.566+0000 7f7a207a1640 1 -- 172.21.15.146:0/525211326 wait complete. 2024-09-17T03:47:13.578 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:47:13.578 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:47:13.578 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2024-09-17T03:47:13.578 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:47:13.578 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:47:13.578 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:47:13.578 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:47:13.578 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:47:13.578 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:47:13.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:13.579 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2024-09-17T03:47:13.594 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:47:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:47:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:47:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:47:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2024-09-17T03:47:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:47:13.595 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:47:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:47:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2024-09-17T03:47:13.595 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:47:13.595 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:47:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2024-09-17T03:47:13.596 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:47:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:47:13.596 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:47:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:47:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:47:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41938sec preferred_lft 41938sec 2024-09-17T03:47:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2024-09-17T03:47:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:47:13.596 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:47:13.596 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:47:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:47:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:47:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::6470:14ff:fe70:5460/64 scope link 2024-09-17T03:47:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:47:13.597 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:47:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 32:35:52:7e:40:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:47:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3035:52ff:fe7e:405c/64 scope link 2024-09-17T03:47:13.597 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:47:13.598 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:47:13.598 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 12:83:4f:72:e0:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:47:13.598 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::1083:4fff:fe72:e092/64 scope link 2024-09-17T03:47:13.598 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:47:13.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:13.598 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:47:13.658 INFO:teuthology.orchestra.run.smithi146.stdout:1 2024-09-17T03:47:13.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:13.660 DEBUG:teuthology.orchestra.run.smithi146:> route 2024-09-17T03:47:13.716 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2024-09-17T03:47:13.717 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:47:13.717 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:47:13.717 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:47:13.717 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:47:13.717 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:47:13.718 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2024-09-17T03:47:13.718 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:47:13.718 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:47:13.718 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:47:13.718 DEBUG:teuthology.orchestra.run.smithi146:> ') 2024-09-17T03:47:13.805 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:47:13.836 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:47:13.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:13.843 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:47:13.858 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:47:13.859 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:47:13.859 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:47:13.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:13.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2024-09-17T03:47:13.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:47:13.924 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:47:13.979 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:47:13.979 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:47:13.980 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:47:14.035 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:47:14.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:14.035 DEBUG:teuthology.orchestra.run.smithi146:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:47:14.130 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:47:14.130 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:47:14.130 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:47:14.141 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:47:14.141 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:47:14.141 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:47:14.141 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:47:14.141 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:47:14.153 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:47:14.153 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:47:14.153 INFO:teuthology.orchestra.run.smithi146.stdout:invalid new device string format 2024-09-17T03:47:14.153 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:3300,172.21.15.179:3300,172.21.15.179:3301" 2024-09-17T03:47:14.153 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:47:14.153 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: resolved to: "172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790" 2024-09-17T03:47:14.153 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.146:6789,172.21.15.179:6789,172.21.15.179:6790:/ 2024-09-17T03:47:14.153 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=3f04b219-91f7-40f1-98fe-bc08c29ffc97" will pass to kernel 2024-09-17T03:47:14.154 INFO:teuthology.orchestra.run.smithi146.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:47:14.154 INFO:teuthology.orchestra.run.smithi146.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:47:14.154 INFO:teuthology.orchestra.run.smithi146.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:47:14.154 INFO:teuthology.orchestra.run.smithi146.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:47:14.154 INFO:teuthology.orchestra.run.smithi146.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:47:14.155 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:47:14.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:14.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:47:14.181 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:47:14.272 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:47:14.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:47:14.283 INFO:teuthology.orchestra.run.smithi146.stdout:client10267 2024-09-17T03:47:14.284 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:47:14.284 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:47:14.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:14.300 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent) 2024-09-17T03:47:14.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:14.360 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child) 2024-09-17T03:47:14.418 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:47:14.418 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:47:14.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:14.474 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/parentfile bs=1M conv=fdatasync count=6 seek=0) 2024-09-17T03:47:14.569 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records in 2024-09-17T03:47:14.569 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records out 2024-09-17T03:47:14.569 INFO:teuthology.orchestra.run.smithi146.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0383221 s, 164 MB/s 2024-09-17T03:47:14.569 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:47:14.569 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:47:14.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:14.585 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/child/childfile bs=1M conv=fdatasync count=6 seek=0) 2024-09-17T03:47:14.679 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records in 2024-09-17T03:47:14.679 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records out 2024-09-17T03:47:14.679 INFO:teuthology.orchestra.run.smithi146.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0389603 s, 161 MB/s 2024-09-17T03:47:14.682 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:47:14.685 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:47:14.726 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2024-09-17T03:47:14.726 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2024-09-17T03:47:14.726 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:47:14.726 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:47:14.727 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2024-09-17T03:47:14.728 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:47:14.729 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2024-09-17T03:47:14.729 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:47:14.729 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:47:14.729 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2024-09-17T03:47:14.729 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.729 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:47:14.729 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.729 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2024-09-17T03:47:14.730 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.730 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2024-09-17T03:47:14.730 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:47:14.731 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.732 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2024-09-17T03:47:14.733 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2024-09-17T03:47:14.734 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:47:14.735 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:47:14.736 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout: mon down mkfs grace = 300 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2024-09-17T03:47:14.737 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-09-17T03:47:14.738 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-09-17T03:47:14.738 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-09-17T03:47:14.738 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-09-17T03:47:14.738 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2024-09-17T03:47:14.738 INFO:teuthology.orchestra.run.smithi146.stdout: mds cache max size = 1000 2024-09-17T03:47:14.738 INFO:teuthology.orchestra.run.smithi146.stdout: mds log max segments = 1 2024-09-17T03:47:14.738 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = False 2024-09-17T03:47:14.738 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = False 2024-09-17T03:47:14.741 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-17T03:47:14.741 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-17T03:47:14.741 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-17T03:47:14.742 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:47:14.743 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.744 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.146,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-17T03:47:14.745 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-17T03:47:14.746 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-17T03:47:14.747 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-09-17T03:47:14.748 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:47:14.749 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-17T03:47:14.750 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:47:14.751 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: mon down mkfs grace = 300 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:47:14.752 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout: mds cache max size = 1000 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout: mds log max segments = 1 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = False 2024-09-17T03:47:14.753 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = False 2024-09-17T03:47:14.755 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:47:14.797 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:47:14.838 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2024-09-17T03:47:14.838 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2024-09-17T03:47:14.839 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:47:14.839 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2024-09-17T03:47:14.839 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.839 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2024-09-17T03:47:14.839 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.839 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2024-09-17T03:47:14.839 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.839 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2024-09-17T03:47:14.840 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2024-09-17T03:47:14.840 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.840 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2024-09-17T03:47:14.840 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2024-09-17T03:47:14.840 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.840 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:47:14.840 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2024-09-17T03:47:14.840 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.840 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:47:14.840 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:47:14.840 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.841 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2024-09-17T03:47:14.841 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.841 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2024-09-17T03:47:14.841 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2024-09-17T03:47:14.841 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:47:14.841 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:47:14.841 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2024-09-17T03:47:14.841 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:47:14.841 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2024-09-17T03:47:14.841 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:47:14.842 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:47:14.842 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2024-09-17T03:47:14.842 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.842 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:47:14.842 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.842 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2024-09-17T03:47:14.842 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.842 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2024-09-17T03:47:14.843 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.843 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2024-09-17T03:47:14.843 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2024-09-17T03:47:14.843 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2024-09-17T03:47:14.843 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-17T03:47:14.843 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2024-09-17T03:47:14.843 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:47:14.843 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2024-09-17T03:47:14.844 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug trim objects = true 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2024-09-17T03:47:14.845 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:47:14.846 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2024-09-17T03:47:14.847 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:47:14.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: mon down mkfs grace = 300 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2024-09-17T03:47:14.849 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout: mds cache max size = 1000 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout: mds log max segments = 1 2024-09-17T03:47:14.850 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = False 2024-09-17T03:47:14.851 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = False 2024-09-17T03:47:14.851 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-17T03:47:14.851 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-17T03:47:14.851 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:47:14.851 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-17T03:47:14.851 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.851 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.852 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:47:14.853 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.146,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 3f04b219-91f7-40f1-98fe-bc08c29ffc97 2024-09-17T03:47:14.854 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-17T03:47:14.855 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-17T03:47:14.856 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-09-17T03:47:14.857 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.858 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:47:14.859 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: mon down mkfs grace = 300 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-17T03:47:14.860 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout: mds cache max size = 1000 2024-09-17T03:47:14.861 INFO:teuthology.orchestra.run.smithi179.stdout: mds log max segments = 1 2024-09-17T03:47:14.862 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = False 2024-09-17T03:47:14.862 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = False 2024-09-17T03:47:14.863 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:47:14.863 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:47:14.919 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:47:14.919 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:47:14.975 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:47:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.129+0000 7ff7df7e6640 1 -- 172.21.15.146:0/2593890603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d80b5160 msgr2=0x7ff7d8167780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:15.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.129+0000 7ff7df7e6640 1 --2- 172.21.15.146:0/2593890603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d80b5160 0x7ff7d8167780 secure :-1 s=READY pgs=2703 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8160780 tx=0x7ff7d002aa00 comp rx=0 tx=0).stop 2024-09-17T03:47:15.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.129+0000 7ff7df7e6640 1 -- 172.21.15.146:0/2593890603 shutdown_connections 2024-09-17T03:47:15.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.129+0000 7ff7df7e6640 1 --2- 172.21.15.146:0/2593890603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d80b5160 0x7ff7d8167780 unknown :-1 s=CLOSED pgs=2703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.129+0000 7ff7df7e6640 1 -- 172.21.15.146:0/2593890603 >> 172.21.15.146:0/2593890603 conn(0x7ff7d80b3880 msgr2=0x7ff7d80d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:15.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.129+0000 7ff7df7e6640 1 -- 172.21.15.146:0/2593890603 shutdown_connections 2024-09-17T03:47:15.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.129+0000 7ff7df7e6640 1 -- 172.21.15.146:0/2593890603 wait complete. 2024-09-17T03:47:15.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.130+0000 7ff7df7e6640 1 Processor -- start 2024-09-17T03:47:15.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.131+0000 7ff7df7e6640 1 -- start start 2024-09-17T03:47:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7df7e6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d80b5160 0x7ff7d8156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7df7e6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7d8153c50 0x7ff7d8153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7df7e6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7d806f500 0x7ff7d8154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7df7e6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d8168090 con 0x7ff7d80b5160 2024-09-17T03:47:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7df7e6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d8167f10 con 0x7ff7d806f500 2024-09-17T03:47:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7df7e6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d8168210 con 0x7ff7d8153c50 2024-09-17T03:47:15.133 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7dd582640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d80b5160 0x7ff7d8156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7dd582640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d80b5160 0x7ff7d8156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46128/0 (socket says 172.21.15.146:46128) 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7dd582640 1 -- 172.21.15.146:0/1673669618 learned_addr learned my addr 172.21.15.146:0/1673669618 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7ddd83640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7d806f500 0x7ff7d8154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7dcd81640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7d8153c50 0x7ff7d8153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7dd582640 1 -- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7d8153c50 msgr2=0x7ff7d8153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7dd582640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7d8153c50 0x7ff7d8153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7dd582640 1 -- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7d806f500 msgr2=0x7ff7d8154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7dd582640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7d806f500 0x7ff7d8154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7dd582640 1 -- 172.21.15.146:0/1673669618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d806fa40 con 0x7ff7d80b5160 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.132+0000 7ff7dd582640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d80b5160 0x7ff7d8156b70 secure :-1 s=READY pgs=2704 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400b410 tx=0x7ff7d400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.133+0000 7ff7cdffb640 1 -- 172.21.15.146:0/1673669618 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4015020 con 0x7ff7d80b5160 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.133+0000 7ff7cdffb640 1 -- 172.21.15.146:0/1673669618 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7d4011920 con 0x7ff7d80b5160 2024-09-17T03:47:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.133+0000 7ff7df7e6640 1 -- 172.21.15.146:0/1673669618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d80b14b0 con 0x7ff7d80b5160 2024-09-17T03:47:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.133+0000 7ff7cdffb640 1 -- 172.21.15.146:0/1673669618 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4011d70 con 0x7ff7d80b5160 2024-09-17T03:47:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.133+0000 7ff7df7e6640 1 -- 172.21.15.146:0/1673669618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d8154cb0 con 0x7ff7d80b5160 2024-09-17T03:47:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.134+0000 7ff7df7e6640 1 -- 172.21.15.146:0/1673669618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d8154f10 con 0x7ff7d80b5160 2024-09-17T03:47:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.134+0000 7ff7cdffb640 1 -- 172.21.15.146:0/1673669618 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff7d4018020 con 0x7ff7d80b5160 2024-09-17T03:47:15.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.135+0000 7ff7cdffb640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff7bc078b90 0x7ff7bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:15.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.135+0000 7ff7cdffb640 1 -- 172.21.15.146:0/1673669618 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7ff7d409a910 con 0x7ff7d80b5160 2024-09-17T03:47:15.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.135+0000 7ff7dcd81640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff7bc078b90 0x7ff7bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:15.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.136+0000 7ff7dcd81640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff7bc078b90 0x7ff7bc07b0a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7ff7d814adb0 tx=0x7ff7c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:15.140 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.140+0000 7ff7cdffb640 1 -- 172.21.15.146:0/1673669618 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff7d4062790 con 0x7ff7d80b5160 2024-09-17T03:47:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.324+0000 7ff7df7e6640 1 -- 172.21.15.146:0/1673669618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff7d80cf4e0 con 0x7ff7d80b5160 2024-09-17T03:47:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.325+0000 7ff7cdffb640 1 -- 172.21.15.146:0/1673669618 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v210) ==== 80+0+0 (secure 0 0 0) 0x7ff7d40671c0 con 0x7ff7d80b5160 2024-09-17T03:47:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:listed 0 entries 2024-09-17T03:47:15.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 -- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff7bc078b90 msgr2=0x7ff7bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:15.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff7bc078b90 0x7ff7bc07b0a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7ff7d814adb0 tx=0x7ff7c8009040 comp rx=0 tx=0).stop 2024-09-17T03:47:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 -- 172.21.15.146:0/1673669618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d80b5160 msgr2=0x7ff7d8156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d80b5160 0x7ff7d8156b70 secure :-1 s=READY pgs=2704 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400b410 tx=0x7ff7d400b8d0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 -- 172.21.15.146:0/1673669618 shutdown_connections 2024-09-17T03:47:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff7bc078b90 0x7ff7bc07b0a0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff7d806f500 0x7ff7d8154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff7d8153c50 0x7ff7d8153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 --2- 172.21.15.146:0/1673669618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7d80b5160 0x7ff7d8156b70 unknown :-1 s=CLOSED pgs=2704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 -- 172.21.15.146:0/1673669618 >> 172.21.15.146:0/1673669618 conn(0x7ff7d80b3880 msgr2=0x7ff7d806e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 -- 172.21.15.146:0/1673669618 shutdown_connections 2024-09-17T03:47:15.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.327+0000 7ff7df7e6640 1 -- 172.21.15.146:0/1673669618 wait complete. 2024-09-17T03:47:15.338 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:47:15.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:15.338 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:47:15.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:47:15.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:15.391 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:47:15.417 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:47:15.573 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.573+0000 7f0c14a07640 1 -- 172.21.15.146:0/1320192974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c10074620 msgr2=0x7f0c10074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.573+0000 7f0c14a07640 1 --2- 172.21.15.146:0/1320192974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c10074620 0x7f0c10074a30 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009860 tx=0x7f0bf802a420 comp rx=0 tx=0).stop 2024-09-17T03:47:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.573+0000 7f0c14a07640 1 -- 172.21.15.146:0/1320192974 shutdown_connections 2024-09-17T03:47:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.573+0000 7f0c14a07640 1 --2- 172.21.15.146:0/1320192974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c10074620 0x7f0c10074a30 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.573+0000 7f0c14a07640 1 --2- 172.21.15.146:0/1320192974 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c1015a5c0 0x7f0c1015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.573+0000 7f0c14a07640 1 -- 172.21.15.146:0/1320192974 >> 172.21.15.146:0/1320192974 conn(0x7f0c100b2ae0 msgr2=0x7f0c100b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.573+0000 7f0c14a07640 1 -- 172.21.15.146:0/1320192974 shutdown_connections 2024-09-17T03:47:15.574 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.573+0000 7f0c14a07640 1 -- 172.21.15.146:0/1320192974 wait complete. 2024-09-17T03:47:15.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.575+0000 7f0c14a07640 1 Processor -- start 2024-09-17T03:47:15.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.575+0000 7f0c14a07640 1 -- start start 2024-09-17T03:47:15.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.576+0000 7f0c14a07640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c1006fde0 0x7f0c100afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:15.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.576+0000 7f0c14a07640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c10074620 0x7f0c10147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.576+0000 7f0c14a07640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c1015a5c0 0x7f0c100736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.576+0000 7f0c14a07640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0c10072ff0 con 0x7f0c1006fde0 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.576+0000 7f0c14a07640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0c10072e70 con 0x7f0c1015a5c0 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.576+0000 7f0c14a07640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0c10073170 con 0x7f0c10074620 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.576+0000 7f0c0e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c1006fde0 0x7f0c100afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.576+0000 7f0c0e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c1006fde0 0x7f0c100afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46144/0 (socket says 172.21.15.146:46144) 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.576+0000 7f0c0e59c640 1 -- 172.21.15.146:0/2029585860 learned_addr learned my addr 172.21.15.146:0/2029585860 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c07fff640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c10074620 0x7f0c10147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c0ed9d640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c1015a5c0 0x7f0c100736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c0e59c640 1 -- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c10074620 msgr2=0x7f0c10147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c0e59c640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c10074620 0x7f0c10147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c0e59c640 1 -- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c1015a5c0 msgr2=0x7f0c100736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c0e59c640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c1015a5c0 0x7f0c100736b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c0e59c640 1 -- 172.21.15.146:0/2029585860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c10147940 con 0x7f0c1006fde0 2024-09-17T03:47:15.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c0e59c640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c1006fde0 0x7f0c100afef0 secure :-1 s=READY pgs=2705 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000e9f0 tx=0x7f0c0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:15.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c06ffd640 1 -- 172.21.15.146:0/2029585860 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0000cd80 con 0x7f0c1006fde0 2024-09-17T03:47:15.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c06ffd640 1 -- 172.21.15.146:0/2029585860 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c00004020 con 0x7f0c1006fde0 2024-09-17T03:47:15.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c14a07640 1 -- 172.21.15.146:0/2029585860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c101f6cf0 con 0x7f0c1006fde0 2024-09-17T03:47:15.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c06ffd640 1 -- 172.21.15.146:0/2029585860 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c00004470 con 0x7f0c1006fde0 2024-09-17T03:47:15.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.577+0000 7f0c14a07640 1 -- 172.21.15.146:0/2029585860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c101f72b0 con 0x7f0c1006fde0 2024-09-17T03:47:15.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.578+0000 7f0c14a07640 1 -- 172.21.15.146:0/2029585860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c10074a30 con 0x7f0c1006fde0 2024-09-17T03:47:15.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.579+0000 7f0c06ffd640 1 -- 172.21.15.146:0/2029585860 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c000035f0 con 0x7f0c1006fde0 2024-09-17T03:47:15.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.579+0000 7f0c06ffd640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bf0078b90 0x7f0bf007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:15.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.580+0000 7f0c06ffd640 1 -- 172.21.15.146:0/2029585860 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7f0c0009b420 con 0x7f0c1006fde0 2024-09-17T03:47:15.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.580+0000 7f0c07fff640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bf0078b90 0x7f0bf007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:15.580 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.580+0000 7f0c07fff640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bf0078b90 0x7f0bf007b0a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8034000 tx=0x7f0bf8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:15.584 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.584+0000 7f0c06ffd640 1 -- 172.21.15.146:0/2029585860 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c00063330 con 0x7f0c1006fde0 2024-09-17T03:47:15.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.794+0000 7f0c14a07640 1 -- 172.21.15.146:0/2029585860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c101f3330 con 0x7f0c1006fde0 2024-09-17T03:47:15.794 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.794+0000 7f0c06ffd640 1 -- 172.21.15.146:0/2029585860 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 163 v163) ==== 95+0+5250 (secure 0 0 0) 0x7f0c101f3330 con 0x7f0c1006fde0 2024-09-17T03:47:15.795 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:15.795 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":163,"btime":"2024-09-17T03:47:10:512617+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157},{"gid":11841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2488811693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2488811693},{"type":"v1","addr":"172.21.15.146:6835","nonce":2488811693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158}],"filesystems":[{"mdsmap":{"epoch":163,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:47:06.858092+0000","modified":"2024-09-17T03:47:09.879574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11853},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11853":{"gid":11853,"name":"d","rank":0,"incarnation":159,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3004139766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":3004139766},{"type":"v1","addr":"172.21.15.179:6837","nonce":3004139766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11853,"qdb_cluster":[11853]},"id":16}]} 2024-09-17T03:47:15.795 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 163 2024-09-17T03:47:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 -- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bf0078b90 msgr2=0x7f0bf007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bf0078b90 0x7f0bf007b0a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8034000 tx=0x7f0bf8004730 comp rx=0 tx=0).stop 2024-09-17T03:47:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 -- 172.21.15.146:0/2029585860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c1006fde0 msgr2=0x7f0c100afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c1006fde0 0x7f0c100afef0 secure :-1 s=READY pgs=2705 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000e9f0 tx=0x7f0c0000eeb0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 -- 172.21.15.146:0/2029585860 shutdown_connections 2024-09-17T03:47:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0bf0078b90 0x7f0bf007b0a0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0c1015a5c0 0x7f0c100736b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0c10074620 0x7f0c10147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 --2- 172.21.15.146:0/2029585860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c1006fde0 0x7f0c100afef0 unknown :-1 s=CLOSED pgs=2705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:15.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 -- 172.21.15.146:0/2029585860 >> 172.21.15.146:0/2029585860 conn(0x7f0c100b2ae0 msgr2=0x7f0c100d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:15.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 -- 172.21.15.146:0/2029585860 shutdown_connections 2024-09-17T03:47:15.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:15.797+0000 7f0c14a07640 1 -- 172.21.15.146:0/2029585860 wait complete. 2024-09-17T03:47:15.809 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-09-17T03:47:15.940 INFO:teuthology.orchestra.run.smithi179.stdout:{"message":"","return_code":0} 2024-09-17T03:47:15.940 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T03:47:15.940 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:47:16.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.054+0000 7faf4c427640 1 -- 172.21.15.146:0/3606424832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf440cdc00 msgr2=0x7faf440ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.054+0000 7faf4c427640 1 --2- 172.21.15.146:0/3606424832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf440cdc00 0x7faf440ccf40 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 crypto rx=0x7faf40009830 tx=0x7faf4002a510 comp rx=0 tx=0).stop 2024-09-17T03:47:16.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.054+0000 7faf4c427640 1 -- 172.21.15.146:0/3606424832 shutdown_connections 2024-09-17T03:47:16.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.054+0000 7faf4c427640 1 --2- 172.21.15.146:0/3606424832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf44070080 0x7faf44072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.054+0000 7faf4c427640 1 --2- 172.21.15.146:0/3606424832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf440cdc00 0x7faf440ccf40 unknown :-1 s=CLOSED pgs=2707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.054+0000 7faf4c427640 1 -- 172.21.15.146:0/3606424832 >> 172.21.15.146:0/3606424832 conn(0x7faf440b2240 msgr2=0x7faf440b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:16.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.054+0000 7faf4c427640 1 -- 172.21.15.146:0/3606424832 shutdown_connections 2024-09-17T03:47:16.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.054+0000 7faf4c427640 1 -- 172.21.15.146:0/3606424832 wait complete. 2024-09-17T03:47:16.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.056+0000 7faf4c427640 1 Processor -- start 2024-09-17T03:47:16.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.056+0000 7faf4c427640 1 -- start start 2024-09-17T03:47:16.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4c427640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf44070080 0x7faf44150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4c427640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf440cd480 0x7faf440ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4c427640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf440cdc00 0x7faf440aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.058 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4c427640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7faf440730f0 con 0x7faf44070080 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4c427640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7faf4415d050 con 0x7faf440cd480 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4c427640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7faf44073270 con 0x7faf440cdc00 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4a1c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf44070080 0x7faf44150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4a1c3640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf44070080 0x7faf44150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46158/0 (socket says 172.21.15.146:46158) 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4a1c3640 1 -- 172.21.15.146:0/4007830107 learned_addr learned my addr 172.21.15.146:0/4007830107 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4a9c4640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf440cdc00 0x7faf440aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf499c2640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf440cd480 0x7faf440ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4a1c3640 1 -- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf440cdc00 msgr2=0x7faf440aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4a1c3640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf440cdc00 0x7faf440aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4a1c3640 1 -- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf440cd480 msgr2=0x7faf440ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4a1c3640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf440cd480 0x7faf440ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.057+0000 7faf4a1c3640 1 -- 172.21.15.146:0/4007830107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf44152040 con 0x7faf44070080 2024-09-17T03:47:16.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.058+0000 7faf4a1c3640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf44070080 0x7faf44150d10 secure :-1 s=READY pgs=2708 cs=0 l=1 rev1=1 crypto rx=0x7faf40009950 tx=0x7faf40033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.058+0000 7faf3affd640 1 -- 172.21.15.146:0/4007830107 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf40005c90 con 0x7faf44070080 2024-09-17T03:47:16.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.058+0000 7faf3affd640 1 -- 172.21.15.146:0/4007830107 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf40031e50 con 0x7faf44070080 2024-09-17T03:47:16.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.058+0000 7faf4c427640 1 -- 172.21.15.146:0/4007830107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf441522e0 con 0x7faf44070080 2024-09-17T03:47:16.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.058+0000 7faf3affd640 1 -- 172.21.15.146:0/4007830107 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf40005260 con 0x7faf44070080 2024-09-17T03:47:16.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.058+0000 7faf4c427640 1 -- 172.21.15.146:0/4007830107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf441528a0 con 0x7faf44070080 2024-09-17T03:47:16.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.059+0000 7faf4c427640 1 -- 172.21.15.146:0/4007830107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf440ccf40 con 0x7faf44070080 2024-09-17T03:47:16.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.060+0000 7faf3affd640 1 -- 172.21.15.146:0/4007830107 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf40005400 con 0x7faf44070080 2024-09-17T03:47:16.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.060+0000 7faf3affd640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf28078b90 0x7faf2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.060+0000 7faf3affd640 1 -- 172.21.15.146:0/4007830107 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5709+0+0 (secure 0 0 0) 0x7faf400bbe10 con 0x7faf44070080 2024-09-17T03:47:16.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.060+0000 7faf499c2640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf28078b90 0x7faf2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.061+0000 7faf499c2640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf28078b90 0x7faf2807b0a0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7faf440ad220 tx=0x7faf34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.065+0000 7faf3affd640 1 -- 172.21.15.146:0/4007830107 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf4003f030 con 0x7faf44070080 2024-09-17T03:47:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.274+0000 7faf4c427640 1 -- 172.21.15.146:0/4007830107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7faf440cf6f0 con 0x7faf44070080 2024-09-17T03:47:16.275 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:47:16.275+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:47:16.276 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.277+0000 7faf3affd640 1 -- 172.21.15.146:0/4007830107 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v164) ==== 161+0+0 (secure 0 0 0) 0x7faf40083c90 con 0x7faf44070080 2024-09-17T03:47:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:47:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 -- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf28078b90 msgr2=0x7faf2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf28078b90 0x7faf2807b0a0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7faf440ad220 tx=0x7faf34009040 comp rx=0 tx=0).stop 2024-09-17T03:47:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 -- 172.21.15.146:0/4007830107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf44070080 msgr2=0x7faf44150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf44070080 0x7faf44150d10 secure :-1 s=READY pgs=2708 cs=0 l=1 rev1=1 crypto rx=0x7faf40009950 tx=0x7faf40033c20 comp rx=0 tx=0).stop 2024-09-17T03:47:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 -- 172.21.15.146:0/4007830107 shutdown_connections 2024-09-17T03:47:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7faf28078b90 0x7faf2807b0a0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7faf440cdc00 0x7faf440aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.279 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faf440cd480 0x7faf440ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 --2- 172.21.15.146:0/4007830107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf44070080 0x7faf44150d10 unknown :-1 s=CLOSED pgs=2708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 -- 172.21.15.146:0/4007830107 >> 172.21.15.146:0/4007830107 conn(0x7faf440b2240 msgr2=0x7faf4415f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:16.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 -- 172.21.15.146:0/4007830107 shutdown_connections 2024-09-17T03:47:16.280 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.279+0000 7faf4c427640 1 -- 172.21.15.146:0/4007830107 wait complete. 2024-09-17T03:47:16.283 INFO:tasks.ceph.mds.d.smithi179.stderr: -6212> 2024-09-17T03:47:09.463+0000 7f165b4fc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:47:16.291 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapval 10000000000.00000000 parentfile_head - 2024-09-17T03:47:16.337 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-09-17T03:47:16.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.347+0000 7f9361018f40 1 Processor -- start 2024-09-17T03:47:16.347 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.347+0000 7f9361018f40 1 -- start start 2024-09-17T03:47:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.348+0000 7f9361018f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 0x561ff1e60690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.348+0000 7f9361018f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561ff1f09840 0x561ff1e61110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.348+0000 7f9361018f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561ff1e622b0 0x561ff1e61650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.348+0000 7f9361018f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561ff1de0430 con 0x561ff1e31ba0 2024-09-17T03:47:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.348+0000 7f9361018f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561ff1ded1f0 con 0x561ff1e622b0 2024-09-17T03:47:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.348+0000 7f9361018f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561ff1d81d60 con 0x561ff1f09840 2024-09-17T03:47:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f9359e64640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 0x561ff1e60690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f9359e64640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 0x561ff1e60690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46176/0 (socket says 172.21.15.146:46176) 2024-09-17T03:47:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f9359e64640 1 -- 172.21.15.146:0/2555343474 learned_addr learned my addr 172.21.15.146:0/2555343474 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f935a665640 1 --2- 172.21.15.146:0/2555343474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561ff1e622b0 0x561ff1e61650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f9359663640 1 --2- 172.21.15.146:0/2555343474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561ff1f09840 0x561ff1e61110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f9359e64640 1 -- 172.21.15.146:0/2555343474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561ff1f09840 msgr2=0x561ff1e61110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f9359e64640 1 --2- 172.21.15.146:0/2555343474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561ff1f09840 0x561ff1e61110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f9359e64640 1 -- 172.21.15.146:0/2555343474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561ff1e622b0 msgr2=0x561ff1e61650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f9359e64640 1 --2- 172.21.15.146:0/2555343474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561ff1e622b0 0x561ff1e61650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f9359e64640 1 -- 172.21.15.146:0/2555343474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ff1f047c0 con 0x561ff1e31ba0 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f9359e64640 1 --2- 172.21.15.146:0/2555343474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 0x561ff1e60690 secure :-1 s=READY pgs=2712 cs=0 l=1 rev1=1 crypto rx=0x7f934c001db0 tx=0x7f934c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aac3e7a39c4d70d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f934bfff640 1 -- 172.21.15.146:0/2555343474 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c00bde0 con 0x561ff1e31ba0 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f934bfff640 1 -- 172.21.15.146:0/2555343474 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f934c00f400 con 0x561ff1e31ba0 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.349+0000 7f934bfff640 1 -- 172.21.15.146:0/2555343474 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c00f850 con 0x561ff1e31ba0 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.350+0000 7f9361018f40 1 -- 172.21.15.146:0/2555343474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 msgr2=0x561ff1e60690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.350+0000 7f9361018f40 1 --2- 172.21.15.146:0/2555343474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 0x561ff1e60690 secure :-1 s=READY pgs=2712 cs=0 l=1 rev1=1 crypto rx=0x7f934c001db0 tx=0x7f934c00b5b0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.350+0000 7f9361018f40 1 -- 172.21.15.146:0/2555343474 shutdown_connections 2024-09-17T03:47:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.350+0000 7f9361018f40 1 --2- 172.21.15.146:0/2555343474 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561ff1e622b0 0x561ff1e61650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.350+0000 7f9361018f40 1 --2- 172.21.15.146:0/2555343474 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561ff1f09840 0x561ff1e61110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.350+0000 7f9361018f40 1 --2- 172.21.15.146:0/2555343474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 0x561ff1e60690 unknown :-1 s=CLOSED pgs=2712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.350+0000 7f9361018f40 1 -- 172.21.15.146:0/2555343474 >> 172.21.15.146:0/2555343474 conn(0x561ff1d52ac0 msgr2=0x561ff1e5d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.350+0000 7f9361018f40 1 -- 172.21.15.146:0/2555343474 shutdown_connections 2024-09-17T03:47:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.350+0000 7f9361018f40 1 -- 172.21.15.146:0/2555343474 wait complete. 2024-09-17T03:47:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.351+0000 7f9361018f40 1 Processor -- start 2024-09-17T03:47:16.353 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.351+0000 7f9361018f40 1 -- start start 2024-09-17T03:47:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9361018f40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 0x561ff1ee9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9361018f40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561ff1f09840 0x561ff1effb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9361018f40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561ff1f11430 0x561ff1fa0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.356 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9361018f40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x561ff1f02b50 con 0x561ff1e31ba0 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9361018f40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x561ff1f11ba0 con 0x561ff1f09840 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9361018f40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x561ff1fa1200 con 0x561ff1f11430 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9359e64640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 0x561ff1ee9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9359e64640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 0x561ff1ee9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46192/0 (socket says 172.21.15.146:46192) 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9359e64640 1 -- 172.21.15.146:0/4158457074 learned_addr learned my addr 172.21.15.146:0/4158457074 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9359663640 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561ff1f09840 0x561ff1effb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f935a665640 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561ff1f11430 0x561ff1fa0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9359e64640 1 -- 172.21.15.146:0/4158457074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561ff1f11430 msgr2=0x561ff1fa0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9359e64640 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x561ff1f11430 0x561ff1fa0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9359e64640 1 -- 172.21.15.146:0/4158457074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561ff1f09840 msgr2=0x561ff1effb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9359e64640 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x561ff1f09840 0x561ff1effb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.352+0000 7f9359e64640 1 -- 172.21.15.146:0/4158457074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ff1e618b0 con 0x561ff1e31ba0 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.353+0000 7f9359e64640 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 0x561ff1ee9b60 secure :-1 s=READY pgs=2713 cs=0 l=1 rev1=1 crypto rx=0x7f934c00bab0 tx=0x7f934c00fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.357 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.353+0000 7f934affd640 1 -- 172.21.15.146:0/4158457074 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c01b430 con 0x561ff1e31ba0 2024-09-17T03:47:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.353+0000 7f934affd640 1 -- 172.21.15.146:0/4158457074 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f934c020020 con 0x561ff1e31ba0 2024-09-17T03:47:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.353+0000 7f9361018f40 1 -- 172.21.15.146:0/4158457074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ff1e61b90 con 0x561ff1e31ba0 2024-09-17T03:47:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.353+0000 7f934affd640 1 -- 172.21.15.146:0/4158457074 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c01b720 con 0x561ff1e31ba0 2024-09-17T03:47:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.353+0000 7f9361018f40 1 -- 172.21.15.146:0/4158457074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ff1fa0f40 con 0x561ff1e31ba0 2024-09-17T03:47:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.354+0000 7f934affd640 1 -- 172.21.15.146:0/4158457074 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f934c017070 con 0x561ff1e31ba0 2024-09-17T03:47:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.355+0000 7f934affd640 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f933c0775a0 0x7f933c079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.355+0000 7f934affd640 1 -- 172.21.15.146:0/4158457074 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f934c09ab00 con 0x561ff1e31ba0 2024-09-17T03:47:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.355+0000 7f9359663640 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f933c0775a0 0x7f933c079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.355+0000 7f9361018f40 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x561ff1f10110 0x561ff1f10520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.355+0000 7f9361018f40 1 -- 172.21.15.146:0/4158457074 --> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] -- osd_op(unknown.0.0:1 32.10 32:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e211) -- 0x561ff1fa0b60 con 0x561ff1f10110 2024-09-17T03:47:16.358 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.355+0000 7f935a665640 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x561ff1f10110 0x561ff1f10520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f9359663640 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f933c0775a0 0x7f933c079ab0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x561ff1efd680 tx=0x7f9350001690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f935a665640 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x561ff1f10110 0x561ff1f10520 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f935a665640 1 -- 172.21.15.146:0/4158457074 <== osd.1 v2:172.21.15.146:6816/2854727168 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-vals-by-keys out=588b] v0'0 uv10 ondisk = 0) ==== 164+0+588 (crc 0 0 0) 0x7f935405e040 con 0x561ff1f10110 2024-09-17T03:47:16.359 INFO:teuthology.orchestra.run.smithi146.stderr:Writing to - 2024-09-17T03:47:16.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f9361018f40 1 -- 172.21.15.146:0/4158457074 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x561ff1f10110 msgr2=0x561ff1f10520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f9361018f40 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x561ff1f10110 0x561ff1f10520 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.360 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f9361018f40 1 -- 172.21.15.146:0/4158457074 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f933c0775a0 msgr2=0x7f933c079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f9361018f40 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f933c0775a0 0x7f933c079ab0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x561ff1efd680 tx=0x7f9350001690 comp rx=0 tx=0).stop 2024-09-17T03:47:16.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f9361018f40 1 -- 172.21.15.146:0/4158457074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 msgr2=0x561ff1ee9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f9361018f40 1 --2- 172.21.15.146:0/4158457074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff1e31ba0 0x561ff1ee9b60 secure :-1 s=READY pgs=2713 cs=0 l=1 rev1=1 crypto rx=0x7f934c00bab0 tx=0x7f934c00fdd0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f935a665640 1 -- 172.21.15.146:0/4158457074 reap_dead start 2024-09-17T03:47:16.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f9361018f40 1 -- 172.21.15.146:0/4158457074 shutdown_connections 2024-09-17T03:47:16.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f9361018f40 1 -- 172.21.15.146:0/4158457074 >> 172.21.15.146:0/4158457074 conn(0x561ff1d52ac0 msgr2=0x561ff1f07150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:16.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f9361018f40 1 -- 172.21.15.146:0/4158457074 shutdown_connections 2024-09-17T03:47:16.361 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.356+0000 7f9361018f40 1 -- 172.21.15.146:0/4158457074 wait complete. 2024-09-17T03:47:16.361 INFO:teuthology.orchestra.run.smithi146.stdout:i"����f��� ���5@@!`�����������f��� ���fU�(8`���f��� 8`���f��� �����������fU�����security.selinux%unconfined_u:object_r:unlabeled_t:s0�������� 2024-09-17T03:47:16.361 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 shadow_head 2024-09-17T03:47:16.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.417+0000 7f319ee0cf40 1 Processor -- start 2024-09-17T03:47:16.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.417+0000 7f319ee0cf40 1 -- start start 2024-09-17T03:47:16.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319ee0cf40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840030f0 0x55c510388930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.429 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319ee0cf40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c51036c100 0x55c510418210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319ee0cf40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c510418750 0x55c510418b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319ee0cf40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c510263430 con 0x55c510418750 2024-09-17T03:47:16.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319ee0cf40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c5102701f0 con 0x7f31840030f0 2024-09-17T03:47:16.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319ee0cf40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c510204d60 con 0x55c51036c100 2024-09-17T03:47:16.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319847a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c510418750 0x55c510418b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.430 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319847a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c510418750 0x55c510418b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46200/0 (socket says 172.21.15.146:46200) 2024-09-17T03:47:16.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319847a640 1 -- 172.21.15.146:0/2555789817 learned_addr learned my addr 172.21.15.146:0/2555789817 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:16.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f3197c79640 1 --2- 172.21.15.146:0/2555789817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840030f0 0x55c510388930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f318f478640 1 --2- 172.21.15.146:0/2555789817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c51036c100 0x55c510418210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319847a640 1 -- 172.21.15.146:0/2555789817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c51036c100 msgr2=0x55c510418210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:16.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319847a640 1 --2- 172.21.15.146:0/2555789817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c51036c100 0x55c510418210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319847a640 1 -- 172.21.15.146:0/2555789817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840030f0 msgr2=0x55c510388930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:16.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319847a640 1 --2- 172.21.15.146:0/2555789817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840030f0 0x55c510388930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319847a640 1 -- 172.21.15.146:0/2555789817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5102fd140 con 0x55c510418750 2024-09-17T03:47:16.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f3197c79640 1 --2- 172.21.15.146:0/2555789817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840030f0 0x55c510388930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:47:16.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f318f478640 1 --2- 172.21.15.146:0/2555789817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c51036c100 0x55c510418210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:47:16.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f319847a640 1 --2- 172.21.15.146:0/2555789817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c510418750 0x55c510418b60 secure :-1 s=READY pgs=2716 cs=0 l=1 rev1=1 crypto rx=0x55c5102f7ff0 tx=0x7f3190009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abc1329b82dce48 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f3196c77640 1 -- 172.21.15.146:0/2555789817 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319000d600 con 0x55c510418750 2024-09-17T03:47:16.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f3196c77640 1 -- 172.21.15.146:0/2555789817 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f319000d7a0 con 0x55c510418750 2024-09-17T03:47:16.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.419+0000 7f3196c77640 1 -- 172.21.15.146:0/2555789817 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319000dbd0 con 0x55c510418750 2024-09-17T03:47:16.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.420+0000 7f319ee0cf40 1 -- 172.21.15.146:0/2555789817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c510418750 msgr2=0x55c510418b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.420+0000 7f319ee0cf40 1 --2- 172.21.15.146:0/2555789817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c510418750 0x55c510418b60 secure :-1 s=READY pgs=2716 cs=0 l=1 rev1=1 crypto rx=0x55c5102f7ff0 tx=0x7f3190009d60 comp rx=0 tx=0).stop 2024-09-17T03:47:16.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.420+0000 7f319ee0cf40 1 -- 172.21.15.146:0/2555789817 shutdown_connections 2024-09-17T03:47:16.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.420+0000 7f319ee0cf40 1 --2- 172.21.15.146:0/2555789817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c510418750 0x55c510418b60 unknown :-1 s=CLOSED pgs=2716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.420+0000 7f319ee0cf40 1 --2- 172.21.15.146:0/2555789817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c51036c100 0x55c510418210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.420+0000 7f319ee0cf40 1 --2- 172.21.15.146:0/2555789817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840030f0 0x55c510388930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.420+0000 7f319ee0cf40 1 -- 172.21.15.146:0/2555789817 >> 172.21.15.146:0/2555789817 conn(0x55c5101d5ac0 msgr2=0x55c51038a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:16.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.420+0000 7f319ee0cf40 1 -- 172.21.15.146:0/2555789817 shutdown_connections 2024-09-17T03:47:16.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.420+0000 7f319ee0cf40 1 -- 172.21.15.146:0/2555789817 wait complete. 2024-09-17T03:47:16.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.421+0000 7f319ee0cf40 1 Processor -- start 2024-09-17T03:47:16.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.421+0000 7f319ee0cf40 1 -- start start 2024-09-17T03:47:16.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.422+0000 7f319ee0cf40 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c51036c100 0x55c5102fe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.422+0000 7f319ee0cf40 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c510418750 0x55c510388050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.422+0000 7f319ee0cf40 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840030f0 0x55c5102fd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.422+0000 7f319ee0cf40 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c5103697f0 con 0x55c51036c100 2024-09-17T03:47:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.422+0000 7f319ee0cf40 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c51038b170 con 0x7f31840030f0 2024-09-17T03:47:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.422+0000 7f319ee0cf40 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c5102fb3c0 con 0x55c510418750 2024-09-17T03:47:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.422+0000 7f3197c79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c51036c100 0x55c5102fe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.422+0000 7f3197c79640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c51036c100 0x55c5102fe5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46216/0 (socket says 172.21.15.146:46216) 2024-09-17T03:47:16.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.422+0000 7f3197c79640 1 -- 172.21.15.146:0/3920041287 learned_addr learned my addr 172.21.15.146:0/3920041287 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.422+0000 7f318f478640 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c510418750 0x55c510388050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.422+0000 7f319847a640 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840030f0 0x55c5102fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f3197c79640 1 -- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c510418750 msgr2=0x55c510388050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f3197c79640 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c510418750 0x55c510388050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f3197c79640 1 -- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840030f0 msgr2=0x55c5102fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f3197c79640 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31840030f0 0x55c5102fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f3197c79640 1 -- 172.21.15.146:0/3920041287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c510388590 con 0x55c51036c100 2024-09-17T03:47:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f318f478640 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c510418750 0x55c510388050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f3197c79640 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c51036c100 0x55c5102fe5d0 secure :-1 s=READY pgs=2717 cs=0 l=1 rev1=1 crypto rx=0x7f318800e670 tx=0x7f318800eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f3195c75640 1 -- 172.21.15.146:0/3920041287 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318800c8f0 con 0x55c51036c100 2024-09-17T03:47:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f3195c75640 1 -- 172.21.15.146:0/3920041287 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3188013020 con 0x55c51036c100 2024-09-17T03:47:16.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f319ee0cf40 1 -- 172.21.15.146:0/3920041287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c51038a0d0 con 0x55c51036c100 2024-09-17T03:47:16.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f3195c75640 1 -- 172.21.15.146:0/3920041287 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318800ccf0 con 0x55c51036c100 2024-09-17T03:47:16.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.423+0000 7f319ee0cf40 1 -- 172.21.15.146:0/3920041287 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c51038a690 con 0x55c51036c100 2024-09-17T03:47:16.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.425+0000 7f3195c75640 1 -- 172.21.15.146:0/3920041287 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f318800f400 con 0x55c51036c100 2024-09-17T03:47:16.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.425+0000 7f3195c75640 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31780775a0 0x7f3178079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.425+0000 7f3195c75640 1 -- 172.21.15.146:0/3920041287 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f3188099920 con 0x55c51036c100 2024-09-17T03:47:16.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.425+0000 7f318f478640 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31780775a0 0x7f3178079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.425+0000 7f319ee0cf40 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x55c51038c220 0x55c5102fa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.425+0000 7f319ee0cf40 1 -- 172.21.15.146:0/3920041287 --> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] -- osd_op(unknown.0.0:1 32.10 32:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=584b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e211) -- 0x55c5102fa5c0 con 0x55c51038c220 2024-09-17T03:47:16.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.426+0000 7f319847a640 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x55c51038c220 0x55c5102fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.426+0000 7f318f478640 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31780775a0 0x7f3178079ab0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3180055000 tx=0x7f3180002fb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.426+0000 7f319847a640 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x55c51038c220 0x55c5102fa080 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.427+0000 7f319847a640 1 -- 172.21.15.146:0/3920041287 <== osd.1 v2:172.21.15.146:6816/2854727168 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v211'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f319000d6a0 con 0x55c51038c220 2024-09-17T03:47:16.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.427+0000 7f319ee0cf40 1 -- 172.21.15.146:0/3920041287 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x55c51038c220 msgr2=0x55c5102fa080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.427+0000 7f319ee0cf40 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x55c51038c220 0x55c5102fa080 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.427+0000 7f319ee0cf40 1 -- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31780775a0 msgr2=0x7f3178079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.427+0000 7f319ee0cf40 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f31780775a0 0x7f3178079ab0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3180055000 tx=0x7f3180002fb0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.427+0000 7f319ee0cf40 1 -- 172.21.15.146:0/3920041287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c51036c100 msgr2=0x55c5102fe5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.427+0000 7f319ee0cf40 1 --2- 172.21.15.146:0/3920041287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c51036c100 0x55c5102fe5d0 secure :-1 s=READY pgs=2717 cs=0 l=1 rev1=1 crypto rx=0x7f318800e670 tx=0x7f318800eb30 comp rx=0 tx=0).stop 2024-09-17T03:47:16.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.427+0000 7f319847a640 1 -- 172.21.15.146:0/3920041287 reap_dead start 2024-09-17T03:47:16.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.427+0000 7f319ee0cf40 1 -- 172.21.15.146:0/3920041287 shutdown_connections 2024-09-17T03:47:16.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.427+0000 7f319ee0cf40 1 -- 172.21.15.146:0/3920041287 >> 172.21.15.146:0/3920041287 conn(0x55c5101d5ac0 msgr2=0x55c510389410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:16.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.428+0000 7f319ee0cf40 1 -- 172.21.15.146:0/3920041287 shutdown_connections 2024-09-17T03:47:16.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.428+0000 7f319ee0cf40 1 -- 172.21.15.146:0/3920041287 wait complete. 2024-09-17T03:47:16.444 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_hack_allow_loading_invalid_metadata True 2024-09-17T03:47:16.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.601+0000 7f164fbb0640 1 -- 172.21.15.146:0/2329188030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16480b5010 msgr2=0x7f16480b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.601+0000 7f164fbb0640 1 --2- 172.21.15.146:0/2329188030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16480b5010 0x7f16480b5420 secure :-1 s=READY pgs=2718 cs=0 l=1 rev1=1 crypto rx=0x7f16480ce130 tx=0x7f164402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.601+0000 7f164fbb0640 1 -- 172.21.15.146:0/2329188030 shutdown_connections 2024-09-17T03:47:16.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.601+0000 7f164fbb0640 1 --2- 172.21.15.146:0/2329188030 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f164815bf30 0x7f164815c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.601+0000 7f164fbb0640 1 --2- 172.21.15.146:0/2329188030 >> v2:172.21.15.179:3300/0 conn(0x7f16480d0bc0 0x7f16480d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.601+0000 7f164fbb0640 1 --2- 172.21.15.146:0/2329188030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16480b5010 0x7f16480b5420 unknown :-1 s=CLOSED pgs=2718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.601+0000 7f164fbb0640 1 -- 172.21.15.146:0/2329188030 >> 172.21.15.146:0/2329188030 conn(0x7f16480b3250 msgr2=0x7f16480b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:16.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.601+0000 7f164fbb0640 1 -- 172.21.15.146:0/2329188030 shutdown_connections 2024-09-17T03:47:16.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.601+0000 7f164fbb0640 1 -- 172.21.15.146:0/2329188030 wait complete. 2024-09-17T03:47:16.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.603+0000 7f164fbb0640 1 Processor -- start 2024-09-17T03:47:16.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.603+0000 7f164fbb0640 1 -- start start 2024-09-17T03:47:16.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.604+0000 7f164fbb0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16480b5010 0x7f1648155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.604+0000 7f164fbb0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16480d0bc0 0x7f164814c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.604+0000 7f164fbb0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f164815bf30 0x7f16481f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164fbb0640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f164806fc50 con 0x7f16480d0bc0 2024-09-17T03:47:16.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164fbb0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f164806fad0 con 0x7f164815bf30 2024-09-17T03:47:16.606 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164fbb0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f164806fdd0 con 0x7f16480b5010 2024-09-17T03:47:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164d14b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16480d0bc0 0x7f164814c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164d14b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16480d0bc0 0x7f164814c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46236/0 (socket says 172.21.15.146:46236) 2024-09-17T03:47:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164d14b640 1 -- 172.21.15.146:0/3423408390 learned_addr learned my addr 172.21.15.146:0/3423408390 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164d94c640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16480b5010 0x7f1648155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164d14b640 1 -- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16480b5010 msgr2=0x7f1648155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164e14d640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f164815bf30 0x7f16481f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164d14b640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16480b5010 0x7f1648155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164d14b640 1 -- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f164815bf30 msgr2=0x7f16481f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164d14b640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f164815bf30 0x7f16481f8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164d14b640 1 -- 172.21.15.146:0/3423408390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164814d360 con 0x7f16480d0bc0 2024-09-17T03:47:16.607 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164d14b640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16480d0bc0 0x7f164814c810 secure :-1 s=READY pgs=2719 cs=0 l=1 rev1=1 crypto rx=0x7f163c00e7c0 tx=0x7f163c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f163a7fc640 1 -- 172.21.15.146:0/3423408390 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c00ccc0 con 0x7f16480d0bc0 2024-09-17T03:47:16.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f163a7fc640 1 -- 172.21.15.146:0/3423408390 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f163c00ee70 con 0x7f16480d0bc0 2024-09-17T03:47:16.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164fbb0640 1 -- 172.21.15.146:0/3423408390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164814d640 con 0x7f16480d0bc0 2024-09-17T03:47:16.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f163a7fc640 1 -- 172.21.15.146:0/3423408390 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c00ce60 con 0x7f16480d0bc0 2024-09-17T03:47:16.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.605+0000 7f164fbb0640 1 -- 172.21.15.146:0/3423408390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164814dc00 con 0x7f16480d0bc0 2024-09-17T03:47:16.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.606+0000 7f164fbb0640 1 -- 172.21.15.146:0/3423408390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164814d0d0 con 0x7f16480d0bc0 2024-09-17T03:47:16.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.607+0000 7f163a7fc640 1 -- 172.21.15.146:0/3423408390 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f163c004260 con 0x7f16480d0bc0 2024-09-17T03:47:16.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.608+0000 7f163a7fc640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f162c078b90 0x7f162c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.608+0000 7f163a7fc640 1 -- 172.21.15.146:0/3423408390 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f163c09b700 con 0x7f16480d0bc0 2024-09-17T03:47:16.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.608+0000 7f164d94c640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f162c078b90 0x7f162c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.608+0000 7f164d94c640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f162c078b90 0x7f162c07b0a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f1644033000 tx=0x7f1644004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.612+0000 7f163a7fc640 1 -- 172.21.15.146:0/3423408390 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f163c063ae0 con 0x7f16480d0bc0 2024-09-17T03:47:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.787+0000 7f164fbb0640 1 -- 172.21.15.146:0/3423408390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}] v 0) -- 0x7f16480d0fd0 con 0x7f16480d0bc0 2024-09-17T03:47:16.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.791+0000 7f163a7fc640 1 -- 172.21.15.146:0/3423408390 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}]=0 v69)=0 v69) ==== 140+0+0 (secure 0 0 0) 0x7f163c0633e0 con 0x7f16480d0bc0 2024-09-17T03:47:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 -- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f162c078b90 msgr2=0x7f162c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f162c078b90 0x7f162c07b0a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f1644033000 tx=0x7f1644004730 comp rx=0 tx=0).stop 2024-09-17T03:47:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 -- 172.21.15.146:0/3423408390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16480d0bc0 msgr2=0x7f164814c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16480d0bc0 0x7f164814c810 secure :-1 s=READY pgs=2719 cs=0 l=1 rev1=1 crypto rx=0x7f163c00e7c0 tx=0x7f163c00ec80 comp rx=0 tx=0).stop 2024-09-17T03:47:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 -- 172.21.15.146:0/3423408390 shutdown_connections 2024-09-17T03:47:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f162c078b90 0x7f162c07b0a0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f164815bf30 0x7f16481f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.797 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16480d0bc0 0x7f164814c810 unknown :-1 s=CLOSED pgs=2719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 --2- 172.21.15.146:0/3423408390 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f16480b5010 0x7f1648155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 -- 172.21.15.146:0/3423408390 >> 172.21.15.146:0/3423408390 conn(0x7f16480b3250 msgr2=0x7f164806cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 -- 172.21.15.146:0/3423408390 shutdown_connections 2024-09-17T03:47:16.798 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.794+0000 7f164fbb0640 1 -- 172.21.15.146:0/3423408390 wait complete. 2024-09-17T03:47:16.805 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-17T03:47:16.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.922+0000 7f122e494640 1 -- 172.21.15.146:0/1890574048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12100039e0 msgr2=0x7f1210003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.922+0000 7f122e494640 1 --2- 172.21.15.146:0/1890574048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12100039e0 0x7f1210003e10 secure :-1 s=READY pgs=2721 cs=0 l=1 rev1=1 crypto rx=0x7f121800c2c0 tx=0x7f1210005830 comp rx=0 tx=0).stop 2024-09-17T03:47:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.922+0000 7f122ca31640 1 -- 172.21.15.146:0/1890574048 reap_dead start 2024-09-17T03:47:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.922+0000 7f122e494640 1 -- 172.21.15.146:0/1890574048 shutdown_connections 2024-09-17T03:47:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.922+0000 7f122e494640 1 -- 172.21.15.146:0/1890574048 >> 172.21.15.146:0/1890574048 conn(0x7f12280b2ae0 msgr2=0x7f12280b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.922+0000 7f122e494640 1 -- 172.21.15.146:0/1890574048 shutdown_connections 2024-09-17T03:47:16.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.922+0000 7f122e494640 1 -- 172.21.15.146:0/1890574048 wait complete. 2024-09-17T03:47:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.924+0000 7f122e494640 1 Processor -- start 2024-09-17T03:47:16.924 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.924+0000 7f122e494640 1 -- start start 2024-09-17T03:47:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.925+0000 7f122e494640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12100039e0 0x7f12281523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.925+0000 7f122e494640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12280cc040 0x7f12281423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.925+0000 7f122e494640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1228142910 0x7f12281f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.925+0000 7f122e494640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f12280ce620 con 0x7f1228142910 2024-09-17T03:47:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.925+0000 7f122e494640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12280ce4a0 con 0x7f12100039e0 2024-09-17T03:47:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.925+0000 7f122e494640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f12280b49f0 con 0x7f12280cc040 2024-09-17T03:47:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f122ca31640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1228142910 0x7f12281f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f122ca31640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1228142910 0x7f12281f7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46252/0 (socket says 172.21.15.146:46252) 2024-09-17T03:47:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f122ca31640 1 -- 172.21.15.146:0/2349634249 learned_addr learned my addr 172.21.15.146:0/2349634249 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:16.927 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f1227fff640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12100039e0 0x7f12281523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f12277fe640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12280cc040 0x7f12281423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f122ca31640 1 -- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12280cc040 msgr2=0x7f12281423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f122ca31640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12280cc040 0x7f12281423d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f122ca31640 1 -- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12100039e0 msgr2=0x7f12281523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f122ca31640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12100039e0 0x7f12281523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f122ca31640 1 -- 172.21.15.146:0/2349634249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1228150e10 con 0x7f1228142910 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f122ca31640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1228142910 0x7f12281f7080 secure :-1 s=READY pgs=2722 cs=0 l=1 rev1=1 crypto rx=0x7f12280b4100 tx=0x7f1220006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f1224ff9640 1 -- 172.21.15.146:0/2349634249 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220011900 con 0x7f1228142910 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f1224ff9640 1 -- 172.21.15.146:0/2349634249 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1220018070 con 0x7f1228142910 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f1224ff9640 1 -- 172.21.15.146:0/2349634249 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220011d40 con 0x7f1228142910 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f122e494640 1 -- 172.21.15.146:0/2349634249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1228151310 con 0x7f1228142910 2024-09-17T03:47:16.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.926+0000 7f122e494640 1 -- 172.21.15.146:0/2349634249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12281518d0 con 0x7f1228142910 2024-09-17T03:47:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.927+0000 7f122e494640 1 -- 172.21.15.146:0/2349634249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1228151060 con 0x7f1228142910 2024-09-17T03:47:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.928+0000 7f1224ff9640 1 -- 172.21.15.146:0/2349634249 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f122001d460 con 0x7f1228142910 2024-09-17T03:47:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.929+0000 7f1224ff9640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1214078b90 0x7f121407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.929+0000 7f1224ff9640 1 -- 172.21.15.146:0/2349634249 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f122009b5a0 con 0x7f1228142910 2024-09-17T03:47:16.929 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.929+0000 7f1227fff640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1214078b90 0x7f121407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:16.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.930+0000 7f1227fff640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1214078b90 0x7f121407b0a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1218033000 tx=0x7f1218038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:16.933 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:16.934+0000 7f1224ff9640 1 -- 172.21.15.146:0/2349634249 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1220063a10 con 0x7f1228142910 2024-09-17T03:47:17.143 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.143+0000 7f122e494640 1 -- 172.21.15.146:0/2349634249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f122806fde0 con 0x7f1228142910 2024-09-17T03:47:17.278 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.278+0000 7f1224ff9640 1 -- 172.21.15.146:0/2349634249 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v165) ==== 162+0+0 (secure 0 0 0) 0x7f1220063310 con 0x7f1228142910 2024-09-17T03:47:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-17T03:47:17.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 -- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1214078b90 msgr2=0x7f121407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:17.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1214078b90 0x7f121407b0a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1218033000 tx=0x7f1218038040 comp rx=0 tx=0).stop 2024-09-17T03:47:17.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 -- 172.21.15.146:0/2349634249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1228142910 msgr2=0x7f12281f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:17.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1228142910 0x7f12281f7080 secure :-1 s=READY pgs=2722 cs=0 l=1 rev1=1 crypto rx=0x7f12280b4100 tx=0x7f1220006430 comp rx=0 tx=0).stop 2024-09-17T03:47:17.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 -- 172.21.15.146:0/2349634249 shutdown_connections 2024-09-17T03:47:17.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1214078b90 0x7f121407b0a0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1228142910 0x7f12281f7080 unknown :-1 s=CLOSED pgs=2722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12280cc040 0x7f12281423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 --2- 172.21.15.146:0/2349634249 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12100039e0 0x7f12281523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 -- 172.21.15.146:0/2349634249 >> 172.21.15.146:0/2349634249 conn(0x7f12280b2ae0 msgr2=0x7f12280742e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:17.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 -- 172.21.15.146:0/2349634249 shutdown_connections 2024-09-17T03:47:17.282 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.281+0000 7f122e494640 1 -- 172.21.15.146:0/2349634249 wait complete. 2024-09-17T03:47:17.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:47:17.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.408+0000 7f15ef3ba640 1 -- 172.21.15.146:0/721177347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e806f0f0 msgr2=0x7f15e815c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.408+0000 7f15ef3ba640 1 --2- 172.21.15.146:0/721177347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e806f0f0 0x7f15e815c010 secure :-1 s=READY pgs=2723 cs=0 l=1 rev1=1 crypto rx=0x7f15e8156590 tx=0x7f15e002a4b0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.408+0000 7f15ef3ba640 1 -- 172.21.15.146:0/721177347 shutdown_connections 2024-09-17T03:47:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.408+0000 7f15ef3ba640 1 --2- 172.21.15.146:0/721177347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e806f0f0 0x7f15e815c010 unknown :-1 s=CLOSED pgs=2723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.408+0000 7f15ef3ba640 1 --2- 172.21.15.146:0/721177347 >> v2:172.21.15.179:3300/0 conn(0x7f15e8152b40 0x7f15e80ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.408+0000 7f15ef3ba640 1 -- 172.21.15.146:0/721177347 >> 172.21.15.146:0/721177347 conn(0x7f15e80b2790 msgr2=0x7f15e80d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.408+0000 7f15ef3ba640 1 -- 172.21.15.146:0/721177347 shutdown_connections 2024-09-17T03:47:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.408+0000 7f15ef3ba640 1 -- 172.21.15.146:0/721177347 wait complete. 2024-09-17T03:47:17.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.410+0000 7f15ef3ba640 1 Processor -- start 2024-09-17T03:47:17.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.410+0000 7f15ef3ba640 1 -- start start 2024-09-17T03:47:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.411+0000 7f15ef3ba640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e806f0f0 0x7f15e81f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.411+0000 7f15ef3ba640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e80b51b0 0x7f15e81f6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.411+0000 7f15ef3ba640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8152b40 0x7f15e814dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.411+0000 7f15ef3ba640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f15e815c8e0 con 0x7f15e8152b40 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.411+0000 7f15ef3ba640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f15e815c760 con 0x7f15e806f0f0 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.411+0000 7f15ef3ba640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f15e815ca60 con 0x7f15e80b51b0 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.411+0000 7f15ed957640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8152b40 0x7f15e814dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.411+0000 7f15ed957640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8152b40 0x7f15e814dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42072/0 (socket says 172.21.15.146:42072) 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.411+0000 7f15ed957640 1 -- 172.21.15.146:0/131468454 learned_addr learned my addr 172.21.15.146:0/131468454 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.411+0000 7f15ed156640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e806f0f0 0x7f15e81f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15ed957640 1 -- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e80b51b0 msgr2=0x7f15e81f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15ec955640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e80b51b0 0x7f15e81f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15ed957640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e80b51b0 0x7f15e81f6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15ed957640 1 -- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e806f0f0 msgr2=0x7f15e81f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15ed957640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e806f0f0 0x7f15e81f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15ed957640 1 -- 172.21.15.146:0/131468454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e814f3d0 con 0x7f15e8152b40 2024-09-17T03:47:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15ed957640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8152b40 0x7f15e814dc40 secure :-1 s=READY pgs=2724 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009230 tx=0x7f15e0003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15e5ffb640 1 -- 172.21.15.146:0/131468454 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e003e030 con 0x7f15e8152b40 2024-09-17T03:47:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15e5ffb640 1 -- 172.21.15.146:0/131468454 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15e0003e50 con 0x7f15e8152b40 2024-09-17T03:47:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15ef3ba640 1 -- 172.21.15.146:0/131468454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e80aa5b0 con 0x7f15e8152b40 2024-09-17T03:47:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15e5ffb640 1 -- 172.21.15.146:0/131468454 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0035040 con 0x7f15e8152b40 2024-09-17T03:47:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.412+0000 7f15ef3ba640 1 -- 172.21.15.146:0/131468454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e80aab70 con 0x7f15e8152b40 2024-09-17T03:47:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.413+0000 7f15ef3ba640 1 -- 172.21.15.146:0/131468454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e815c010 con 0x7f15e8152b40 2024-09-17T03:47:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.414+0000 7f15e5ffb640 1 -- 172.21.15.146:0/131468454 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f15e0041030 con 0x7f15e8152b40 2024-09-17T03:47:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.414+0000 7f15e5ffb640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f15d4078b90 0x7f15d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.415+0000 7f15e5ffb640 1 -- 172.21.15.146:0/131468454 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f15e00bb670 con 0x7f15e8152b40 2024-09-17T03:47:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.415+0000 7f15ed156640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f15d4078b90 0x7f15d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.415+0000 7f15ed156640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f15d4078b90 0x7f15d407b0a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f15d800a2e0 tx=0x7f15d800a270 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.419+0000 7f15e5ffb640 1 -- 172.21.15.146:0/131468454 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f15e00839d0 con 0x7f15e8152b40 2024-09-17T03:47:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.629+0000 7f15ef3ba640 1 -- 172.21.15.146:0/131468454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15e80ce3d0 con 0x7f15e8152b40 2024-09-17T03:47:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.629+0000 7f15e5ffb640 1 -- 172.21.15.146:0/131468454 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 166 v166) ==== 95+0+5243 (secure 0 0 0) 0x7f15e00832d0 con 0x7f15e8152b40 2024-09-17T03:47:17.630 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:17.630 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":166,"btime":"2024-09-17T03:47:17:282754+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":10288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2813416980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2813416980},{"type":"v1","addr":"172.21.15.179:6837","nonce":2813416980}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157}],"filesystems":[{"mdsmap":{"epoch":166,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:47:06.858092+0000","modified":"2024-09-17T03:47:17.282741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":211,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11841":{"gid":11841,"name":"c","rank":0,"incarnation":166,"state":"up:replay","state_seq":1,"addr":"172.21.15.146:6835/2488811693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2488811693},{"type":"v1","addr":"172.21.15.146:6835","nonce":2488811693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":16}]} 2024-09-17T03:47:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 166 2024-09-17T03:47:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 -- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f15d4078b90 msgr2=0x7f15d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f15d4078b90 0x7f15d407b0a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f15d800a2e0 tx=0x7f15d800a270 comp rx=0 tx=0).stop 2024-09-17T03:47:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 -- 172.21.15.146:0/131468454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8152b40 msgr2=0x7f15e814dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8152b40 0x7f15e814dc40 secure :-1 s=READY pgs=2724 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009230 tx=0x7f15e0003960 comp rx=0 tx=0).stop 2024-09-17T03:47:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 -- 172.21.15.146:0/131468454 shutdown_connections 2024-09-17T03:47:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f15d4078b90 0x7f15d407b0a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15e8152b40 0x7f15e814dc40 unknown :-1 s=CLOSED pgs=2724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f15e80b51b0 0x7f15e81f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 --2- 172.21.15.146:0/131468454 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15e806f0f0 0x7f15e81f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 -- 172.21.15.146:0/131468454 >> 172.21.15.146:0/131468454 conn(0x7f15e80b2790 msgr2=0x7f15e81592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 -- 172.21.15.146:0/131468454 shutdown_connections 2024-09-17T03:47:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:17.631+0000 7f15ef3ba640 1 -- 172.21.15.146:0/131468454 wait complete. 2024-09-17T03:47:18.045 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 166, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:47:06.858092+0000', 'modified': '2024-09-17T03:47:17.282741+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 211, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11841}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11841': {'gid': 11841, 'name': 'c', 'rank': 0, 'incarnation': 166, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.146:6835/2488811693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2488811693}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2488811693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [33], 'metadata_pool': 32, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:47:18.046 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_11841:up:replay 2024-09-17T03:47:19.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:47:19.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.173+0000 7f7cb827e640 1 -- 172.21.15.146:0/1367366701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb00d31e0 msgr2=0x7f7cb00cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:19.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.173+0000 7f7cb827e640 1 --2- 172.21.15.146:0/1367366701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb00d31e0 0x7f7cb00cebc0 secure :-1 s=READY pgs=2725 cs=0 l=1 rev1=1 crypto rx=0x7f7cb01607d0 tx=0x7f7cac02aa30 comp rx=0 tx=0).stop 2024-09-17T03:47:19.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.173+0000 7f7cb827e640 1 -- 172.21.15.146:0/1367366701 shutdown_connections 2024-09-17T03:47:19.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.173+0000 7f7cb827e640 1 --2- 172.21.15.146:0/1367366701 >> v2:172.21.15.179:3300/0 conn(0x7f7cb00d1220 0x7f7cb00b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:19.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.173+0000 7f7cb827e640 1 --2- 172.21.15.146:0/1367366701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb00d31e0 0x7f7cb00cebc0 unknown :-1 s=CLOSED pgs=2725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:19.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.173+0000 7f7cb827e640 1 -- 172.21.15.146:0/1367366701 >> 172.21.15.146:0/1367366701 conn(0x7f7cb00d26c0 msgr2=0x7f7cb00d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:19.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.173+0000 7f7cb827e640 1 -- 172.21.15.146:0/1367366701 shutdown_connections 2024-09-17T03:47:19.174 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.173+0000 7f7cb827e640 1 -- 172.21.15.146:0/1367366701 wait complete. 2024-09-17T03:47:19.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.175+0000 7f7cb827e640 1 Processor -- start 2024-09-17T03:47:19.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.175+0000 7f7cb827e640 1 -- start start 2024-09-17T03:47:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.176+0000 7f7cb827e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00d31e0 0x7f7cb009e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.176+0000 7f7cb827e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb015cbe0 0x7f7cb00cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.176+0000 7f7cb827e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb015ac20 0x7f7cb015b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.176+0000 7f7cb827e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb00b6450 con 0x7f7cb015cbe0 2024-09-17T03:47:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.176+0000 7f7cb827e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb00b62d0 con 0x7f7cb015ac20 2024-09-17T03:47:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.176+0000 7f7cb827e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb00b65d0 con 0x7f7cb00d31e0 2024-09-17T03:47:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb5819640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb015cbe0 0x7f7cb00cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb5819640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb015cbe0 0x7f7cb00cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42088/0 (socket says 172.21.15.146:42088) 2024-09-17T03:47:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb5819640 1 -- 172.21.15.146:0/1814613968 learned_addr learned my addr 172.21.15.146:0/1814613968 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb601a640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00d31e0 0x7f7cb009e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:19.178 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb681b640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb015ac20 0x7f7cb015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb5819640 1 -- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00d31e0 msgr2=0x7f7cb009e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb5819640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00d31e0 0x7f7cb009e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb5819640 1 -- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb015ac20 msgr2=0x7f7cb015b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb5819640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb015ac20 0x7f7cb015b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb5819640 1 -- 172.21.15.146:0/1814613968 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb00afe20 con 0x7f7cb015cbe0 2024-09-17T03:47:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb5819640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb015cbe0 0x7f7cb00cbe60 secure :-1 s=READY pgs=2726 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000c400 tx=0x7f7ca000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7ca6ffd640 1 -- 172.21.15.146:0/1814613968 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0017070 con 0x7f7cb015cbe0 2024-09-17T03:47:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7ca6ffd640 1 -- 172.21.15.146:0/1814613968 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ca00053c0 con 0x7f7cb015cbe0 2024-09-17T03:47:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb827e640 1 -- 172.21.15.146:0/1814613968 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb015c0d0 con 0x7f7cb015cbe0 2024-09-17T03:47:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7ca6ffd640 1 -- 172.21.15.146:0/1814613968 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0003850 con 0x7f7cb015cbe0 2024-09-17T03:47:19.179 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.177+0000 7f7cb827e640 1 -- 172.21.15.146:0/1814613968 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb00b0090 con 0x7f7cb015cbe0 2024-09-17T03:47:19.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.178+0000 7f7cb827e640 1 -- 172.21.15.146:0/1814613968 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb00b6a80 con 0x7f7cb015cbe0 2024-09-17T03:47:19.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.179+0000 7f7ca6ffd640 1 -- 172.21.15.146:0/1814613968 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ca001a070 con 0x7f7cb015cbe0 2024-09-17T03:47:19.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.179+0000 7f7ca6ffd640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c94078b90 0x7f7c9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:19.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.180+0000 7f7ca6ffd640 1 -- 172.21.15.146:0/1814613968 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f7ca009a220 con 0x7f7cb015cbe0 2024-09-17T03:47:19.180 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.180+0000 7f7cb601a640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c94078b90 0x7f7c9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:19.181 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.180+0000 7f7cb601a640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c94078b90 0x7f7c9407b0a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f7cac035000 tx=0x7f7cac004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:19.184 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.184+0000 7f7ca6ffd640 1 -- 172.21.15.146:0/1814613968 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ca0062600 con 0x7f7cb015cbe0 2024-09-17T03:47:19.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.394+0000 7f7cb827e640 1 -- 172.21.15.146:0/1814613968 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cb00d0420 con 0x7f7cb015cbe0 2024-09-17T03:47:19.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.395+0000 7f7ca6ffd640 1 -- 172.21.15.146:0/1814613968 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) ==== 95+0+5243 (secure 0 0 0) 0x7f7ca0061f00 con 0x7f7cb015cbe0 2024-09-17T03:47:19.395 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:19.395 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":168,"btime":"2024-09-17T03:47:19:287440+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":10288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2813416980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2813416980},{"type":"v1","addr":"172.21.15.179:6837","nonce":2813416980}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157}],"filesystems":[{"mdsmap":{"epoch":168,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:47:06.858092+0000","modified":"2024-09-17T03:47:18.290914+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":211,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11841":{"gid":11841,"name":"c","rank":0,"incarnation":166,"state":"up:rejoin","state_seq":6,"addr":"172.21.15.146:6835/2488811693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2488811693},{"type":"v1","addr":"172.21.15.146:6835","nonce":2488811693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":16}]} 2024-09-17T03:47:19.395 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 168 2024-09-17T03:47:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 -- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c94078b90 msgr2=0x7f7c9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c94078b90 0x7f7c9407b0a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f7cac035000 tx=0x7f7cac004ab0 comp rx=0 tx=0).stop 2024-09-17T03:47:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 -- 172.21.15.146:0/1814613968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb015cbe0 msgr2=0x7f7cb00cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb015cbe0 0x7f7cb00cbe60 secure :-1 s=READY pgs=2726 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000c400 tx=0x7f7ca000c8c0 comp rx=0 tx=0).stop 2024-09-17T03:47:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 -- 172.21.15.146:0/1814613968 shutdown_connections 2024-09-17T03:47:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7c94078b90 0x7f7c9407b0a0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:19.397 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7cb015ac20 0x7f7cb015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cb015cbe0 0x7f7cb00cbe60 unknown :-1 s=CLOSED pgs=2726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 --2- 172.21.15.146:0/1814613968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7cb00d31e0 0x7f7cb009e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 -- 172.21.15.146:0/1814613968 >> 172.21.15.146:0/1814613968 conn(0x7f7cb00d26c0 msgr2=0x7f7cb00d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 -- 172.21.15.146:0/1814613968 shutdown_connections 2024-09-17T03:47:19.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:19.397+0000 7f7cb827e640 1 -- 172.21.15.146:0/1814613968 wait complete. 2024-09-17T03:47:19.812 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 168, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:47:06.858092+0000', 'modified': '2024-09-17T03:47:18.290914+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 211, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11841}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11841': {'gid': 11841, 'name': 'c', 'rank': 0, 'incarnation': 166, 'state': 'up:rejoin', 'state_seq': 6, 'addr': '172.21.15.146:6835/2488811693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2488811693}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2488811693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [33], 'metadata_pool': 32, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T03:47:19.812 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_11841:up:rejoin 2024-09-17T03:47:20.814 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:47:20.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.940+0000 7f7b520d5640 1 -- 172.21.15.146:0/3028964056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4c15fca0 msgr2=0x7f7b4c072820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:20.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.940+0000 7f7b520d5640 1 --2- 172.21.15.146:0/3028964056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4c15fca0 0x7f7b4c072820 secure :-1 s=READY pgs=2728 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0722d0 tx=0x7f7b4402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:47:20.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.940+0000 7f7b520d5640 1 -- 172.21.15.146:0/3028964056 shutdown_connections 2024-09-17T03:47:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.940+0000 7f7b520d5640 1 --2- 172.21.15.146:0/3028964056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4c15fca0 0x7f7b4c072820 unknown :-1 s=CLOSED pgs=2728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.940+0000 7f7b520d5640 1 --2- 172.21.15.146:0/3028964056 >> v2:172.21.15.179:3300/0 conn(0x7f7b4c160210 0x7f7b4c074570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.940+0000 7f7b520d5640 1 -- 172.21.15.146:0/3028964056 >> 172.21.15.146:0/3028964056 conn(0x7f7b4c06d1a0 msgr2=0x7f7b4c06d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.940+0000 7f7b520d5640 1 -- 172.21.15.146:0/3028964056 shutdown_connections 2024-09-17T03:47:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.940+0000 7f7b520d5640 1 -- 172.21.15.146:0/3028964056 wait complete. 2024-09-17T03:47:20.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.942+0000 7f7b520d5640 1 Processor -- start 2024-09-17T03:47:20.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.942+0000 7f7b520d5640 1 -- start start 2024-09-17T03:47:20.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.943+0000 7f7b520d5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b4c1493b0 0x7f7b4c14b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:20.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.943+0000 7f7b520d5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b4c155a20 0x7f7b4c15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.943+0000 7f7b520d5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4c155e30 0x7f7b4c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.943+0000 7f7b520d5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c0731b0 con 0x7f7b4c155e30 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.943+0000 7f7b520d5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c073030 con 0x7f7b4c1493b0 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.943+0000 7f7b520d5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4c073330 con 0x7f7b4c155a20 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.943+0000 7f7b4bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4c155e30 0x7f7b4c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.943+0000 7f7b4bfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4c155e30 0x7f7b4c15af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42100/0 (socket says 172.21.15.146:42100) 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.943+0000 7f7b4bfff640 1 -- 172.21.15.146:0/2543133250 learned_addr learned my addr 172.21.15.146:0/2543133250 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.943+0000 7f7b4b7fe640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b4c1493b0 0x7f7b4c14b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.943+0000 7f7b4affd640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b4c155a20 0x7f7b4c15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b4bfff640 1 -- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b4c155a20 msgr2=0x7f7b4c15a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b4bfff640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b4c155a20 0x7f7b4c15a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:20.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b4bfff640 1 -- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b4c1493b0 msgr2=0x7f7b4c14b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b4bfff640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b4c1493b0 0x7f7b4c14b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b4bfff640 1 -- 172.21.15.146:0/2543133250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4c149920 con 0x7f7b4c155e30 2024-09-17T03:47:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b4affd640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b4c155a20 0x7f7b4c15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b4bfff640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4c155e30 0x7f7b4c15af20 secure :-1 s=READY pgs=2729 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009ca0 tx=0x7f7b44003990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b33fff640 1 -- 172.21.15.146:0/2543133250 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44031990 con 0x7f7b4c155e30 2024-09-17T03:47:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b33fff640 1 -- 172.21.15.146:0/2543133250 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b44031c20 con 0x7f7b4c155e30 2024-09-17T03:47:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b520d5640 1 -- 172.21.15.146:0/2543133250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4c149c00 con 0x7f7b4c155e30 2024-09-17T03:47:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b33fff640 1 -- 172.21.15.146:0/2543133250 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b440330d0 con 0x7f7b4c155e30 2024-09-17T03:47:20.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.944+0000 7f7b520d5640 1 -- 172.21.15.146:0/2543133250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4c14a1c0 con 0x7f7b4c155e30 2024-09-17T03:47:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.946+0000 7f7b520d5640 1 -- 172.21.15.146:0/2543133250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b4c070590 con 0x7f7b4c155e30 2024-09-17T03:47:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.947+0000 7f7b33fff640 1 -- 172.21.15.146:0/2543133250 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b44033290 con 0x7f7b4c155e30 2024-09-17T03:47:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.947+0000 7f7b33fff640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b38078bc0 0x7f7b3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.947+0000 7f7b33fff640 1 -- 172.21.15.146:0/2543133250 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f7b440bc280 con 0x7f7b4c155e30 2024-09-17T03:47:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.947+0000 7f7b4b7fe640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b38078bc0 0x7f7b3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:20.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.947+0000 7f7b4b7fe640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b38078bc0 0x7f7b3807b0d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00bb50 tx=0x7f7b3c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:20.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:20.952+0000 7f7b33fff640 1 -- 172.21.15.146:0/2543133250 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b4403f030 con 0x7f7b4c155e30 2024-09-17T03:47:21.159 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.160+0000 7f7b520d5640 1 -- 172.21.15.146:0/2543133250 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b4c0d0f40 con 0x7f7b4c155e30 2024-09-17T03:47:21.160 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.161+0000 7f7b33fff640 1 -- 172.21.15.146:0/2543133250 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5252 (secure 0 0 0) 0x7f7b440846f0 con 0x7f7b4c155e30 2024-09-17T03:47:21.160 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:47:21.160 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":169,"btime":"2024-09-17T03:47:20:289055+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":10288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2813416980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2813416980},{"type":"v1","addr":"172.21.15.179:6837","nonce":2813416980}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:47:06.858092+0000","modified":"2024-09-17T03:47:20.289043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":211,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11841":{"gid":11841,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6835/2488811693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2488811693},{"type":"v1","addr":"172.21.15.146:6835","nonce":2488811693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11841,"qdb_cluster":[11841]},"id":16}]} 2024-09-17T03:47:21.161 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 169 2024-09-17T03:47:21.162 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 -- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b38078bc0 msgr2=0x7f7b3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b38078bc0 0x7f7b3807b0d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c00bb50 tx=0x7f7b3c00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 -- 172.21.15.146:0/2543133250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4c155e30 msgr2=0x7f7b4c15af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4c155e30 0x7f7b4c15af20 secure :-1 s=READY pgs=2729 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009ca0 tx=0x7f7b44003990 comp rx=0 tx=0).stop 2024-09-17T03:47:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 -- 172.21.15.146:0/2543133250 shutdown_connections 2024-09-17T03:47:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7b38078bc0 0x7f7b3807b0d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b4c155e30 0x7f7b4c15af20 unknown :-1 s=CLOSED pgs=2729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7b4c155a20 0x7f7b4c15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 --2- 172.21.15.146:0/2543133250 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7b4c1493b0 0x7f7b4c14b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 -- 172.21.15.146:0/2543133250 >> 172.21.15.146:0/2543133250 conn(0x7f7b4c06d1a0 msgr2=0x7f7b4c15d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 -- 172.21.15.146:0/2543133250 shutdown_connections 2024-09-17T03:47:21.163 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.163+0000 7f7b520d5640 1 -- 172.21.15.146:0/2543133250 wait complete. 2024-09-17T03:47:21.577 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 169, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:47:06.858092+0000', 'modified': '2024-09-17T03:47:20.289043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 211, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11841}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11841': {'gid': 11841, 'name': 'c', 'rank': 0, 'incarnation': 166, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.146:6835/2488811693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2488811693}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2488811693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [33], 'metadata_pool': 32, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11841, 'qdb_cluster': [11841]} 2024-09-17T03:47:21.577 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:47:21.578 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:47:21.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.694+0000 7f80e57ff640 1 -- 172.21.15.146:0/1264245234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80e00b5010 msgr2=0x7f80e00b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.694+0000 7f80e57ff640 1 --2- 172.21.15.146:0/1264245234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80e00b5010 0x7f80e00b5420 secure :-1 s=READY pgs=2730 cs=0 l=1 rev1=1 crypto rx=0x7f80e00ce160 tx=0x7f80d002a560 comp rx=0 tx=0).stop 2024-09-17T03:47:21.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.694+0000 7f80e57ff640 1 -- 172.21.15.146:0/1264245234 shutdown_connections 2024-09-17T03:47:21.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.694+0000 7f80e57ff640 1 --2- 172.21.15.146:0/1264245234 >> v2:172.21.15.179:3300/0 conn(0x7f80e015bf30 0x7f80e015c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.694+0000 7f80e57ff640 1 --2- 172.21.15.146:0/1264245234 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80e00d0bc0 0x7f80e00d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.694+0000 7f80e57ff640 1 --2- 172.21.15.146:0/1264245234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80e00b5010 0x7f80e00b5420 unknown :-1 s=CLOSED pgs=2730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.694+0000 7f80e57ff640 1 -- 172.21.15.146:0/1264245234 >> 172.21.15.146:0/1264245234 conn(0x7f80e00b3250 msgr2=0x7f80e00b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.694+0000 7f80e57ff640 1 -- 172.21.15.146:0/1264245234 shutdown_connections 2024-09-17T03:47:21.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.694+0000 7f80e57ff640 1 -- 172.21.15.146:0/1264245234 wait complete. 2024-09-17T03:47:21.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.696+0000 7f80e57ff640 1 Processor -- start 2024-09-17T03:47:21.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.696+0000 7f80e57ff640 1 -- start start 2024-09-17T03:47:21.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.697+0000 7f80e57ff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80e00b5010 0x7f80e01e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.697+0000 7f80e57ff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80e00d0bc0 0x7f80e013fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.697+0000 7f80e57ff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80e015bf30 0x7f80e013ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.697+0000 7f80e57ff640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f80e006fbc0 con 0x7f80e015bf30 2024-09-17T03:47:21.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.697+0000 7f80e57ff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f80e006fa40 con 0x7f80e00d0bc0 2024-09-17T03:47:21.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.697+0000 7f80e57ff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f80e006fd40 con 0x7f80e00b5010 2024-09-17T03:47:21.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80df7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80e015bf30 0x7f80e013ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80df7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80e015bf30 0x7f80e013ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42116/0 (socket says 172.21.15.146:42116) 2024-09-17T03:47:21.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80df7fe640 1 -- 172.21.15.146:0/1271479038 learned_addr learned my addr 172.21.15.146:0/1271479038 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:21.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80deffd640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80e00b5010 0x7f80e01e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80d67fc640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80e00d0bc0 0x7f80e013fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80df7fe640 1 -- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80e00b5010 msgr2=0x7f80e01e74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80df7fe640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80e00b5010 0x7f80e01e74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80df7fe640 1 -- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80e00d0bc0 msgr2=0x7f80e013fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80df7fe640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80e00d0bc0 0x7f80e013fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80df7fe640 1 -- 172.21.15.146:0/1271479038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e01589c0 con 0x7f80e015bf30 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80df7fe640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80e015bf30 0x7f80e013ffd0 secure :-1 s=READY pgs=2731 cs=0 l=1 rev1=1 crypto rx=0x7f80d800e990 tx=0x7f80d800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80d7fff640 1 -- 172.21.15.146:0/1271479038 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8004d20 con 0x7f80e015bf30 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80d7fff640 1 -- 172.21.15.146:0/1271479038 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80d800cb00 con 0x7f80e015bf30 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80e57ff640 1 -- 172.21.15.146:0/1271479038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e013efb0 con 0x7f80e015bf30 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80d7fff640 1 -- 172.21.15.146:0/1271479038 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8005020 con 0x7f80e015bf30 2024-09-17T03:47:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.698+0000 7f80e57ff640 1 -- 172.21.15.146:0/1271479038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e013f570 con 0x7f80e015bf30 2024-09-17T03:47:21.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.700+0000 7f80d7fff640 1 -- 172.21.15.146:0/1271479038 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f80d80051c0 con 0x7f80e015bf30 2024-09-17T03:47:21.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.701+0000 7f80d7fff640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80c0078bc0 0x7f80c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.701+0000 7f80d7fff640 1 -- 172.21.15.146:0/1271479038 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f80d809b560 con 0x7f80e015bf30 2024-09-17T03:47:21.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.701+0000 7f80deffd640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80c0078bc0 0x7f80c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.701+0000 7f80deffd640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80c0078bc0 0x7f80c007b0d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f80d0033000 tx=0x7f80d0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.701+0000 7f80ec846740 1 Processor -- start 2024-09-17T03:47:21.701 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.702+0000 7f80ec846740 1 -- start start 2024-09-17T03:47:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80ec846740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9ddc9270 0x560b9e189970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80ec846740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e197e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80ec846740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda8590 0x560b9e1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80ec846740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560b9e0e3820 con 0x560b9dda03b0 2024-09-17T03:47:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80ec846740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560b9e0d2c50 con 0x560b9dda8590 2024-09-17T03:47:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80ec846740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x560b9e0d6a60 con 0x560b9ddc9270 2024-09-17T03:47:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80d67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80d67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42130/0 (socket says 172.21.15.146:42130) 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80d67fc640 1 -- 172.21.15.146:0/2747091301 learned_addr learned my addr 172.21.15.146:0/2747091301 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80deffd640 1 --2- 172.21.15.146:0/2747091301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9ddc9270 0x560b9e189970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80df7fe640 1 --2- 172.21.15.146:0/2747091301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda8590 0x560b9e1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80d67fc640 1 -- 172.21.15.146:0/2747091301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9ddc9270 msgr2=0x560b9e189970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80d67fc640 1 --2- 172.21.15.146:0/2747091301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9ddc9270 0x560b9e189970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80d67fc640 1 -- 172.21.15.146:0/2747091301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda8590 msgr2=0x560b9e1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80d67fc640 1 --2- 172.21.15.146:0/2747091301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda8590 0x560b9e1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.703+0000 7f80d67fc640 1 -- 172.21.15.146:0/2747091301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b9de34850 con 0x560b9dda03b0 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.704+0000 7f80d67fc640 1 --2- 172.21.15.146:0/2747091301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e197e70 secure :-1 s=READY pgs=2732 cs=0 l=1 rev1=1 crypto rx=0x7f80c80036a0 tx=0x7f80c8003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17811a4cdbc75b05 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.704+0000 7f80d4ff9640 1 -- 172.21.15.146:0/2747091301 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c800bb60 con 0x560b9dda03b0 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.704+0000 7f80d4ff9640 1 -- 172.21.15.146:0/2747091301 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80c8015070 con 0x560b9dda03b0 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.704+0000 7f80d4ff9640 1 -- 172.21.15.146:0/2747091301 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c8005020 con 0x560b9dda03b0 2024-09-17T03:47:21.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.705+0000 7f80ec846740 1 -- 172.21.15.146:0/2747091301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 msgr2=0x560b9e197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.705+0000 7f80ec846740 1 --2- 172.21.15.146:0/2747091301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e197e70 secure :-1 s=READY pgs=2732 cs=0 l=1 rev1=1 crypto rx=0x7f80c80036a0 tx=0x7f80c8003b60 comp rx=0 tx=0).stop 2024-09-17T03:47:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.705+0000 7f80ec846740 1 -- 172.21.15.146:0/2747091301 shutdown_connections 2024-09-17T03:47:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.705+0000 7f80ec846740 1 --2- 172.21.15.146:0/2747091301 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda8590 0x560b9e1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.705+0000 7f80ec846740 1 --2- 172.21.15.146:0/2747091301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e197e70 unknown :-1 s=CLOSED pgs=2732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.705+0000 7f80ec846740 1 --2- 172.21.15.146:0/2747091301 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9ddc9270 0x560b9e189970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.705+0000 7f80ec846740 1 -- 172.21.15.146:0/2747091301 >> 172.21.15.146:0/2747091301 conn(0x560b9ddbd3c0 msgr2=0x560b9e171260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.705+0000 7f80ec846740 1 -- 172.21.15.146:0/2747091301 shutdown_connections 2024-09-17T03:47:21.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.705+0000 7f80ec846740 1 -- 172.21.15.146:0/2747091301 wait complete. 2024-09-17T03:47:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.706+0000 7f80ec846740 1 -- start start 2024-09-17T03:47:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.706+0000 7f80ec846740 1 Processor -- start 2024-09-17T03:47:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80ec846740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda03b0 0x560b9e1b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80ec846740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9dda8590 0x560b9e1af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80ec846740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80ec846740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560b9de43620 con 0x560b9ddc9270 2024-09-17T03:47:21.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80ec846740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560b9e0785f0 con 0x560b9dda03b0 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80ec846740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x560b9e17d710 con 0x560b9dda8590 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80ec846740 10 client.0 _ll_register_callbacks cb 0x560b9e07c0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80df7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80df7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42140/0 (socket says 172.21.15.146:42140) 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80df7fe640 1 -- 172.21.15.146:0/1115076795 learned_addr learned my addr 172.21.15.146:0/1115076795 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80deffd640 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda03b0 0x560b9e1b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80d67fc640 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9dda8590 0x560b9e1af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80df7fe640 1 -- 172.21.15.146:0/1115076795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9dda8590 msgr2=0x560b9e1af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80df7fe640 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9dda8590 0x560b9e1af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80df7fe640 1 -- 172.21.15.146:0/1115076795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda03b0 msgr2=0x560b9e1b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80df7fe640 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda03b0 0x560b9e1b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.707+0000 7f80df7fe640 1 -- 172.21.15.146:0/1115076795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b9deab6b0 con 0x560b9ddc9270 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80df7fe640 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1ae270 secure :-1 s=READY pgs=2733 cs=0 l=1 rev1=1 crypto rx=0x7f80d80605f0 tx=0x7f80d80638e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0ced562d3300b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80bdffb640 1 -- 172.21.15.146:0/1115076795 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d801f040 con 0x560b9ddc9270 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80bdffb640 1 -- 172.21.15.146:0/1115076795 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f80d804e860 con 0x560b9ddc9270 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80ec846740 1 -- 172.21.15.146:0/1115076795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80c8015070 con 0x560b9ddc9270 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80bdffb640 1 -- 172.21.15.146:0/1115076795 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f80d8062e90 con 0x560b9ddc9270 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80ec846740 10 client.12084 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80ec846740 1 -- 172.21.15.146:0/1115076795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x560b9e1b3260 con 0x560b9ddc9270 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80bdffb640 1 -- 172.21.15.146:0/1115076795 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80c8015070 con 0x560b9ddc9270 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80bdffb640 1 -- 172.21.15.146:0/1115076795 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f80d800f040 con 0x560b9ddc9270 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80ec846740 10 client.12084 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80ec846740 10 client.12084 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80ec846740 20 client.12084 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80ec846740 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x560b9dd87e40 0x560b9e17e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.712 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80ec846740 4 client.12084 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80ec846740 1 -- 172.21.15.146:0/1115076795 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b9e0e5770 con 0x560b9dd87e40 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.708+0000 7f80deffd640 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x560b9dd87e40 0x560b9e17e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.709+0000 7f80deffd640 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x560b9dd87e40 0x560b9e17e3b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3967b602aa53346 server_cookie=39879fdc8802c98c in_seq=0 out_seq=0 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.709+0000 7f80bdffb640 10 client.12084 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.709+0000 7f80bdffb640 1 -- 172.21.15.146:0/1115076795 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b9e0e5770 con 0x560b9dd87e40 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.709+0000 7f80bdffb640 10 client.12084 handle_command_reply: tid=0 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.709+0000 7f80ec846740 1 client.12084 shutdown 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80ec846740 1 -- 172.21.15.146:0/1115076795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 msgr2=0x560b9e1ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80ec846740 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1ae270 secure :-1 s=READY pgs=2733 cs=0 l=1 rev1=1 crypto rx=0x7f80d80605f0 tx=0x7f80d80638e0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80ec846740 1 -- 172.21.15.146:0/1115076795 shutdown_connections 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80ec846740 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x560b9dd87e40 0x560b9e17e3b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80ec846740 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1ae270 unknown :-1 s=CLOSED pgs=2733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80bdffb640 0 client.12084 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80ec846740 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9dda8590 0x560b9e1af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80ec846740 1 --2- 172.21.15.146:0/1115076795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda03b0 0x560b9e1b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80ec846740 1 -- 172.21.15.146:0/1115076795 >> 172.21.15.146:0/1115076795 conn(0x560b9ddbd3c0 msgr2=0x560b9e1984e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80ec846740 1 -- 172.21.15.146:0/1115076795 shutdown_connections 2024-09-17T03:47:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80ec846740 1 -- 172.21.15.146:0/1115076795 wait complete. 2024-09-17T03:47:21.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.710+0000 7f80ec846740 20 client.12084 trim_cache size 0 max 16384 2024-09-17T03:47:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.728+0000 7f80ec846740 1 Processor -- start 2024-09-17T03:47:21.727 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.728+0000 7f80ec846740 1 -- start start 2024-09-17T03:47:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.729+0000 7f80ec846740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda03b0 0x560b9e18a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.729+0000 7f80ec846740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9dda8590 0x560b9e1b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.729+0000 7f80ec846740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1872b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.729+0000 7f80ec846740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f80e00cff80 con 0x560b9ddc9270 2024-09-17T03:47:21.730 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.729+0000 7f80ec846740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01580a0 con 0x560b9dda03b0 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.729+0000 7f80ec846740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f80e01586f0 con 0x560b9dda8590 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.729+0000 7f80df7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1872b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.729+0000 7f80df7fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1872b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42142/0 (socket says 172.21.15.146:42142) 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80df7fe640 1 -- 172.21.15.146:0/3962526276 learned_addr learned my addr 172.21.15.146:0/3962526276 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80deffd640 1 --2- 172.21.15.146:0/3962526276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda03b0 0x560b9e18a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80d67fc640 1 --2- 172.21.15.146:0/3962526276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9dda8590 0x560b9e1b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80df7fe640 1 -- 172.21.15.146:0/3962526276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9dda8590 msgr2=0x560b9e1b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80df7fe640 1 --2- 172.21.15.146:0/3962526276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9dda8590 0x560b9e1b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80df7fe640 1 -- 172.21.15.146:0/3962526276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda03b0 msgr2=0x560b9e18a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80df7fe640 1 --2- 172.21.15.146:0/3962526276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda03b0 0x560b9e18a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80df7fe640 1 -- 172.21.15.146:0/3962526276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b9e19b950 con 0x560b9ddc9270 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80d67fc640 1 --2- 172.21.15.146:0/3962526276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9dda8590 0x560b9e1b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80df7fe640 1 --2- 172.21.15.146:0/3962526276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1872b0 secure :-1 s=READY pgs=2734 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009450 tx=0x7f80d809b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed78c9c7f42f7189 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.731 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80bffff640 1 -- 172.21.15.146:0/3962526276 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d801f070 con 0x560b9ddc9270 2024-09-17T03:47:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80bffff640 1 -- 172.21.15.146:0/3962526276 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80d8099e50 con 0x560b9ddc9270 2024-09-17T03:47:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.730+0000 7f80bffff640 1 -- 172.21.15.146:0/3962526276 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d806ccb0 con 0x560b9ddc9270 2024-09-17T03:47:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.731+0000 7f80ec846740 1 -- 172.21.15.146:0/3962526276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 msgr2=0x560b9e1872b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.731+0000 7f80ec846740 1 --2- 172.21.15.146:0/3962526276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1872b0 secure :-1 s=READY pgs=2734 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009450 tx=0x7f80d809b050 comp rx=0 tx=0).stop 2024-09-17T03:47:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.731+0000 7f80ec846740 1 -- 172.21.15.146:0/3962526276 shutdown_connections 2024-09-17T03:47:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.731+0000 7f80ec846740 1 --2- 172.21.15.146:0/3962526276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9ddc9270 0x560b9e1872b0 unknown :-1 s=CLOSED pgs=2734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.731+0000 7f80ec846740 1 --2- 172.21.15.146:0/3962526276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9dda8590 0x560b9e1b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.731+0000 7f80ec846740 1 --2- 172.21.15.146:0/3962526276 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda03b0 0x560b9e18a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.731+0000 7f80ec846740 1 -- 172.21.15.146:0/3962526276 >> 172.21.15.146:0/3962526276 conn(0x560b9ddbd3c0 msgr2=0x560b9e16c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.731+0000 7f80ec846740 1 -- 172.21.15.146:0/3962526276 shutdown_connections 2024-09-17T03:47:21.732 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.731+0000 7f80ec846740 1 -- 172.21.15.146:0/3962526276 wait complete. 2024-09-17T03:47:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.732+0000 7f80ec846740 1 -- start start 2024-09-17T03:47:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.732+0000 7f80ec846740 1 Processor -- start 2024-09-17T03:47:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80ec846740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e236bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80ec846740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda8590 0x560b9e1872b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80ec846740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9ddc9270 0x560b9e1877f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80ec846740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x560b9e17c3d0 con 0x560b9dda03b0 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80ec846740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x560b9e17d500 con 0x560b9dda8590 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80ec846740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x560b9e17c9f0 con 0x560b9ddc9270 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80ec846740 10 client.0 _ll_register_callbacks cb 0x7f80d800e8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80deffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e236bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80deffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e236bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42154/0 (socket says 172.21.15.146:42154) 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80deffd640 1 -- 172.21.15.146:0/2087471178 learned_addr learned my addr 172.21.15.146:0/2087471178 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80d67fc640 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda8590 0x560b9e1872b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80df7fe640 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9ddc9270 0x560b9e1877f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80deffd640 1 -- 172.21.15.146:0/2087471178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9ddc9270 msgr2=0x560b9e1877f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80deffd640 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9ddc9270 0x560b9e1877f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80deffd640 1 -- 172.21.15.146:0/2087471178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda8590 msgr2=0x560b9e1872b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80deffd640 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda8590 0x560b9e1872b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80deffd640 1 -- 172.21.15.146:0/2087471178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b9e1b1b10 con 0x560b9dda03b0 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.733+0000 7f80d67fc640 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda8590 0x560b9e1872b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80deffd640 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e236bb0 secure :-1 s=READY pgs=2735 cs=0 l=1 rev1=1 crypto rx=0x7f80d0034040 tx=0x7f80d0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa3ef2308c3b377 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80bdffb640 1 -- 172.21.15.146:0/2087471178 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0035040 con 0x560b9dda03b0 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80bdffb640 1 -- 172.21.15.146:0/2087471178 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f80d005cb20 con 0x560b9dda03b0 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80ec846740 1 -- 172.21.15.146:0/2087471178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80d8099e50 con 0x560b9dda03b0 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80bdffb640 1 -- 172.21.15.146:0/2087471178 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f80d005cd20 con 0x560b9dda03b0 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80ec846740 10 client.12090 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80ec846740 1 -- 172.21.15.146:0/2087471178 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x560b9e1cb060 con 0x560b9dda03b0 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80bdffb640 1 -- 172.21.15.146:0/2087471178 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80d8099e50 con 0x560b9dda03b0 2024-09-17T03:47:21.738 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80bdffb640 1 -- 172.21.15.146:0/2087471178 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f80d0003a80 con 0x560b9dda03b0 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80ec846740 10 client.12090 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80ec846740 10 client.12090 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80ec846740 20 client.12090 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80ec846740 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x560b9e19a6c0 0x560b9e17a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80ec846740 4 client.12090 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80ec846740 1 -- 172.21.15.146:0/2087471178 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "status"}) -- 0x560b9e0e1220 con 0x560b9e19a6c0 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.734+0000 7f80d67fc640 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x560b9e19a6c0 0x560b9e17a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80bdffb640 10 client.12090 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80d67fc640 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x560b9e19a6c0 0x560b9e17a5e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c4d1ede651788f8 server_cookie=a62e1a3920c17720 in_seq=0 out_seq=0 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80bdffb640 1 -- 172.21.15.146:0/2087471178 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x560b9e0e1220 con 0x560b9e19a6c0 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80bdffb640 10 client.12090 handle_command_reply: tid=0 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 1 client.12090 shutdown 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 1 -- 172.21.15.146:0/2087471178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 msgr2=0x560b9e236bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e236bb0 secure :-1 s=READY pgs=2735 cs=0 l=1 rev1=1 crypto rx=0x7f80d0034040 tx=0x7f80d0009260 comp rx=0 tx=0).stop 2024-09-17T03:47:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 1 -- 172.21.15.146:0/2087471178 shutdown_connections 2024-09-17T03:47:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x560b9e19a6c0 0x560b9e17a5e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x560b9ddc9270 0x560b9e1877f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x560b9dda8590 0x560b9e1872b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80bdffb640 0 client.12090 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 1 --2- 172.21.15.146:0/2087471178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560b9dda03b0 0x560b9e236bb0 unknown :-1 s=CLOSED pgs=2735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 1 -- 172.21.15.146:0/2087471178 >> 172.21.15.146:0/2087471178 conn(0x560b9ddbd3c0 msgr2=0x560b9e1cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 1 -- 172.21.15.146:0/2087471178 shutdown_connections 2024-09-17T03:47:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 1 -- 172.21.15.146:0/2087471178 wait complete. 2024-09-17T03:47:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.735+0000 7f80ec846740 20 client.12090 trim_cache size 0 max 16384 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 11841, 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 4.4496538960000001, 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 169, 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 211, 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 211, 2024-09-17T03:47:21.741 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 18.980359619000001 2024-09-17T03:47:21.742 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:47:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 -- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80c0078bc0 msgr2=0x7f80c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80c0078bc0 0x7f80c007b0d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f80d0033000 tx=0x7f80d0004730 comp rx=0 tx=0).stop 2024-09-17T03:47:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 -- 172.21.15.146:0/1271479038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80e015bf30 msgr2=0x7f80e013ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80e015bf30 0x7f80e013ffd0 secure :-1 s=READY pgs=2731 cs=0 l=1 rev1=1 crypto rx=0x7f80d800e990 tx=0x7f80d800ee50 comp rx=0 tx=0).stop 2024-09-17T03:47:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 -- 172.21.15.146:0/1271479038 shutdown_connections 2024-09-17T03:47:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f80c0078bc0 0x7f80c007b0d0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80e015bf30 0x7f80e013ffd0 unknown :-1 s=CLOSED pgs=2731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f80e00d0bc0 0x7f80e013fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 --2- 172.21.15.146:0/1271479038 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f80e00b5010 0x7f80e01e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 -- 172.21.15.146:0/1271479038 >> 172.21.15.146:0/1271479038 conn(0x7f80e00b3250 msgr2=0x7f80e00b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 -- 172.21.15.146:0/1271479038 shutdown_connections 2024-09-17T03:47:21.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.736+0000 7f80e57ff640 1 -- 172.21.15.146:0/1271479038 wait complete. 2024-09-17T03:47:21.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:21.746 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub start / recursive,repair 2024-09-17T03:47:21.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.864+0000 7f0034830640 1 -- 172.21.15.146:0/2495815323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300d05d0 msgr2=0x7f00300b7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.864+0000 7f0034830640 1 --2- 172.21.15.146:0/2495815323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300d05d0 0x7f00300b7fb0 secure :-1 s=READY pgs=2737 cs=0 l=1 rev1=1 crypto rx=0x7f00300753c0 tx=0x7f002402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.864+0000 7f0034830640 1 -- 172.21.15.146:0/2495815323 shutdown_connections 2024-09-17T03:47:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.864+0000 7f0034830640 1 --2- 172.21.15.146:0/2495815323 >> v2:172.21.15.179:3300/0 conn(0x7f00300cf140 0x7f00300cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.864+0000 7f0034830640 1 --2- 172.21.15.146:0/2495815323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300d05d0 0x7f00300b7fb0 unknown :-1 s=CLOSED pgs=2737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.864+0000 7f0034830640 1 -- 172.21.15.146:0/2495815323 >> 172.21.15.146:0/2495815323 conn(0x7f003009ba40 msgr2=0x7f00300d2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.864+0000 7f0034830640 1 -- 172.21.15.146:0/2495815323 shutdown_connections 2024-09-17T03:47:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.864+0000 7f0034830640 1 -- 172.21.15.146:0/2495815323 wait complete. 2024-09-17T03:47:21.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.866+0000 7f0034830640 1 Processor -- start 2024-09-17T03:47:21.865 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.866+0000 7f0034830640 1 -- start start 2024-09-17T03:47:21.867 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.867+0000 7f0034830640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00300cf140 0x7f003015ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.867+0000 7f0034830640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00300d05d0 0x7f003009ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.867+0000 7f0034830640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300d3320 0x7f003009f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.867+0000 7f0034830640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f00300b26f0 con 0x7f00300d3320 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.867+0000 7f0034830640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f00300b2570 con 0x7f00300cf140 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.867+0000 7f0034830640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f00300b2870 con 0x7f00300d05d0 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.867+0000 7f002ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300d3320 0x7f003009f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.867+0000 7f002ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300d3320 0x7f003009f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42170/0 (socket says 172.21.15.146:42170) 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.867+0000 7f002ed9d640 1 -- 172.21.15.146:0/2020000628 learned_addr learned my addr 172.21.15.146:0/2020000628 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f002dd9b640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00300d05d0 0x7f003009ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f002e59c640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00300cf140 0x7f003015ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f002ed9d640 1 -- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00300d05d0 msgr2=0x7f003009ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f002ed9d640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00300d05d0 0x7f003009ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f002ed9d640 1 -- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00300cf140 msgr2=0x7f003015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.868 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f002ed9d640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00300cf140 0x7f003015ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f002ed9d640 1 -- 172.21.15.146:0/2020000628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003009e080 con 0x7f00300d3320 2024-09-17T03:47:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f002ed9d640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300d3320 0x7f003009f380 secure :-1 s=READY pgs=2738 cs=0 l=1 rev1=1 crypto rx=0x7f002800e990 tx=0x7f002800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f001effd640 1 -- 172.21.15.146:0/2020000628 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028004d20 con 0x7f00300d3320 2024-09-17T03:47:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f001effd640 1 -- 172.21.15.146:0/2020000628 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f002800cb00 con 0x7f00300d3320 2024-09-17T03:47:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f0034830640 1 -- 172.21.15.146:0/2020000628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003009e360 con 0x7f00300d3320 2024-09-17T03:47:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f001effd640 1 -- 172.21.15.146:0/2020000628 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028005020 con 0x7f00300d3320 2024-09-17T03:47:21.869 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.868+0000 7f0034830640 1 -- 172.21.15.146:0/2020000628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00300a02d0 con 0x7f00300d3320 2024-09-17T03:47:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.870+0000 7f001effd640 1 -- 172.21.15.146:0/2020000628 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f00280051c0 con 0x7f00300d3320 2024-09-17T03:47:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.870+0000 7f001effd640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0010078bc0 0x7f001007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.870+0000 7f001effd640 1 -- 172.21.15.146:0/2020000628 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f002809b710 con 0x7f00300d3320 2024-09-17T03:47:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.871+0000 7f002e59c640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0010078bc0 0x7f001007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.870 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.871+0000 7f002e59c640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0010078bc0 0x7f001007b0d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f00200015e0 tx=0x7f0020009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.872+0000 7f003b87f740 1 Processor -- start 2024-09-17T03:47:21.871 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.872+0000 7f003b87f740 1 -- start start 2024-09-17T03:47:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f003b87f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x5654014696e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f003b87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540107f550 0x565401477be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f003b87f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 0x565401478120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f003b87f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5654013c3120 con 0x5654010a8410 2024-09-17T03:47:21.873 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f003b87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5654013b2550 con 0x56540107f550 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f003b87f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5654013b6360 con 0x565401087730 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f002e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x5654014696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f002e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x5654014696e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42186/0 (socket says 172.21.15.146:42186) 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f002e59c640 1 -- 172.21.15.146:0/4272895567 learned_addr learned my addr 172.21.15.146:0/4272895567 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f002dd9b640 1 --2- 172.21.15.146:0/4272895567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540107f550 0x565401477be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f002ed9d640 1 --2- 172.21.15.146:0/4272895567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 0x565401478120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f002e59c640 1 -- 172.21.15.146:0/4272895567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 msgr2=0x565401478120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f002e59c640 1 --2- 172.21.15.146:0/4272895567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 0x565401478120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f002e59c640 1 -- 172.21.15.146:0/4272895567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540107f550 msgr2=0x565401477be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f002e59c640 1 --2- 172.21.15.146:0/4272895567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540107f550 0x565401477be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.873+0000 7f002e59c640 1 -- 172.21.15.146:0/4272895567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654010a4470 con 0x5654010a8410 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.874+0000 7f002e59c640 1 --2- 172.21.15.146:0/4272895567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x5654014696e0 secure :-1 s=READY pgs=2739 cs=0 l=1 rev1=1 crypto rx=0x7f002000e670 tx=0x7f0020011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db412a6d398fbd8b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.874+0000 7f000ffff640 1 -- 172.21.15.146:0/4272895567 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020025070 con 0x5654010a8410 2024-09-17T03:47:21.874 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.874+0000 7f000ffff640 1 -- 172.21.15.146:0/4272895567 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0020015870 con 0x5654010a8410 2024-09-17T03:47:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.874+0000 7f000ffff640 1 -- 172.21.15.146:0/4272895567 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020015c20 con 0x5654010a8410 2024-09-17T03:47:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.875+0000 7f003b87f740 1 -- 172.21.15.146:0/4272895567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 msgr2=0x5654014696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.875 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.875+0000 7f003b87f740 1 --2- 172.21.15.146:0/4272895567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x5654014696e0 secure :-1 s=READY pgs=2739 cs=0 l=1 rev1=1 crypto rx=0x7f002000e670 tx=0x7f0020011000 comp rx=0 tx=0).stop 2024-09-17T03:47:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.875+0000 7f003b87f740 1 -- 172.21.15.146:0/4272895567 shutdown_connections 2024-09-17T03:47:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.875+0000 7f003b87f740 1 --2- 172.21.15.146:0/4272895567 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 0x565401478120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.875+0000 7f003b87f740 1 --2- 172.21.15.146:0/4272895567 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540107f550 0x565401477be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.875+0000 7f003b87f740 1 --2- 172.21.15.146:0/4272895567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x5654014696e0 unknown :-1 s=CLOSED pgs=2739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.875+0000 7f003b87f740 1 -- 172.21.15.146:0/4272895567 >> 172.21.15.146:0/4272895567 conn(0x56540109c560 msgr2=0x565401450fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.875+0000 7f003b87f740 1 -- 172.21.15.146:0/4272895567 shutdown_connections 2024-09-17T03:47:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.875+0000 7f003b87f740 1 -- 172.21.15.146:0/4272895567 wait complete. 2024-09-17T03:47:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.876+0000 7f003b87f740 1 -- start start 2024-09-17T03:47:21.876 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.876+0000 7f003b87f740 1 Processor -- start 2024-09-17T03:47:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.877+0000 7f003b87f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014514b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.877+0000 7f003b87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565401087730 0x565401495270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.877+0000 7f003b87f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5654010a8410 0x5654014957b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.877+0000 7f003b87f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5654011227c0 con 0x56540107f550 2024-09-17T03:47:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.877+0000 7f003b87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x565401357890 con 0x565401087730 2024-09-17T03:47:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.877+0000 7f003b87f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5654014965b0 con 0x5654010a8410 2024-09-17T03:47:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.877+0000 7f003b87f740 10 client.0 _ll_register_callbacks cb 0x5654013abce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.877+0000 7f002e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.877+0000 7f002e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42202/0 (socket says 172.21.15.146:42202) 2024-09-17T03:47:21.880 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.877+0000 7f002e59c640 1 -- 172.21.15.146:0/3262197384 learned_addr learned my addr 172.21.15.146:0/3262197384 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f002e59c640 1 -- 172.21.15.146:0/3262197384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5654010a8410 msgr2=0x5654014957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f002ed9d640 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5654010a8410 0x5654014957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f002dd9b640 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565401087730 0x565401495270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f002e59c640 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5654010a8410 0x5654014957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f002e59c640 1 -- 172.21.15.146:0/3262197384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565401087730 msgr2=0x565401495270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f002e59c640 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565401087730 0x565401495270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f002e59c640 1 -- 172.21.15.146:0/3262197384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654011887e0 con 0x56540107f550 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f002e59c640 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014514b0 secure :-1 s=READY pgs=2740 cs=0 l=1 rev1=1 crypto rx=0x7f0020023040 tx=0x7f0020015dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbfa9856d2a2782 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f000d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f000d7fa640 1 -- 172.21.15.146:0/3262197384 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002002e060 con 0x56540107f550 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f003b87f740 1 -- 172.21.15.146:0/3262197384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0020015870 con 0x56540107f550 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f000d7fa640 1 -- 172.21.15.146:0/3262197384 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f0020020600 con 0x56540107f550 2024-09-17T03:47:21.881 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f000d7fa640 1 -- 172.21.15.146:0/3262197384 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f0020034050 con 0x56540107f550 2024-09-17T03:47:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f003b87f740 10 client.12105 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f003b87f740 1 -- 172.21.15.146:0/3262197384 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x5654011e8f70 con 0x56540107f550 2024-09-17T03:47:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f000d7fa640 1 -- 172.21.15.146:0/3262197384 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0020015870 con 0x56540107f550 2024-09-17T03:47:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f000d7fa640 1 -- 172.21.15.146:0/3262197384 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f0020037020 con 0x56540107f550 2024-09-17T03:47:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f003b87f740 10 client.12105 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f003b87f740 10 client.12105 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:47:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f003b87f740 20 client.12105 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f003b87f740 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5654010671f0 0x5654014a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.882 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f003b87f740 4 client.12105 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.878+0000 7f003b87f740 1 -- 172.21.15.146:0/3262197384 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654013c5070 con 0x5654010671f0 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.879+0000 7f002dd9b640 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5654010671f0 0x5654014a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.879+0000 7f000d7fa640 10 client.12105 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.879+0000 7f002dd9b640 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5654010671f0 0x5654014a8f70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5ee213251d4e5d8 server_cookie=6a60f7cc5ed6fbfa in_seq=0 out_seq=0 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f000d7fa640 1 -- 172.21.15.146:0/3262197384 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5654013c5070 con 0x5654010671f0 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f000d7fa640 10 client.12105 handle_command_reply: tid=0 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 1 client.12105 shutdown 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 1 -- 172.21.15.146:0/3262197384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 msgr2=0x5654014514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014514b0 secure :-1 s=READY pgs=2740 cs=0 l=1 rev1=1 crypto rx=0x7f0020023040 tx=0x7f0020015dd0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 1 -- 172.21.15.146:0/3262197384 shutdown_connections 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5654010671f0 0x5654014a8f70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5654010a8410 0x5654014957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f000d7fa640 0 client.12105 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:21.883 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x565401087730 0x565401495270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 1 --2- 172.21.15.146:0/3262197384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014514b0 unknown :-1 s=CLOSED pgs=2740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 1 -- 172.21.15.146:0/3262197384 >> 172.21.15.146:0/3262197384 conn(0x56540109c560 msgr2=0x56540147aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 1 -- 172.21.15.146:0/3262197384 shutdown_connections 2024-09-17T03:47:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 1 -- 172.21.15.146:0/3262197384 wait complete. 2024-09-17T03:47:21.884 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.880+0000 7f003b87f740 20 client.12105 trim_cache size 0 max 16384 2024-09-17T03:47:21.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.898+0000 7f003b87f740 1 Processor -- start 2024-09-17T03:47:21.897 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.898+0000 7f003b87f740 1 -- start start 2024-09-17T03:47:21.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.899+0000 7f003b87f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014683c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.899+0000 7f003b87f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 0x565401468900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.899+0000 7f003b87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654010a8410 0x565401477a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.899 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.899+0000 7f003b87f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0030152d10 con 0x56540107f550 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.899+0000 7f003b87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f00301f8260 con 0x5654010a8410 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.899+0000 7f003b87f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f003014ff80 con 0x565401087730 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.899+0000 7f002e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.899+0000 7f002e59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014683c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42206/0 (socket says 172.21.15.146:42206) 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.899+0000 7f002e59c640 1 -- 172.21.15.146:0/240254627 learned_addr learned my addr 172.21.15.146:0/240254627 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.900+0000 7f002e59c640 1 -- 172.21.15.146:0/240254627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 msgr2=0x565401468900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.900+0000 7f002e59c640 1 --2- 172.21.15.146:0/240254627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 0x565401468900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.900+0000 7f002e59c640 1 -- 172.21.15.146:0/240254627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654010a8410 msgr2=0x565401477a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.900+0000 7f002e59c640 1 --2- 172.21.15.146:0/240254627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654010a8410 0x565401477a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.900+0000 7f002e59c640 1 -- 172.21.15.146:0/240254627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56540146a550 con 0x56540107f550 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.900+0000 7f002e59c640 1 --2- 172.21.15.146:0/240254627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014683c0 secure :-1 s=READY pgs=2741 cs=0 l=1 rev1=1 crypto rx=0x7f0020001010 tx=0x7f0020011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ee5660ab18f644 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.900+0000 7f000f7fe640 1 -- 172.21.15.146:0/240254627 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020025040 con 0x56540107f550 2024-09-17T03:47:21.900 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.900+0000 7f000f7fe640 1 -- 172.21.15.146:0/240254627 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0020015870 con 0x56540107f550 2024-09-17T03:47:21.901 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.900+0000 7f000f7fe640 1 -- 172.21.15.146:0/240254627 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020020640 con 0x56540107f550 2024-09-17T03:47:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.901+0000 7f003b87f740 1 -- 172.21.15.146:0/240254627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 msgr2=0x5654014683c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.901+0000 7f003b87f740 1 --2- 172.21.15.146:0/240254627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014683c0 secure :-1 s=READY pgs=2741 cs=0 l=1 rev1=1 crypto rx=0x7f0020001010 tx=0x7f0020011000 comp rx=0 tx=0).stop 2024-09-17T03:47:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.901+0000 7f003b87f740 1 -- 172.21.15.146:0/240254627 shutdown_connections 2024-09-17T03:47:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.901+0000 7f003b87f740 1 --2- 172.21.15.146:0/240254627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5654010a8410 0x565401477a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.901+0000 7f003b87f740 1 --2- 172.21.15.146:0/240254627 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 0x565401468900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.901+0000 7f003b87f740 1 --2- 172.21.15.146:0/240254627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56540107f550 0x5654014683c0 unknown :-1 s=CLOSED pgs=2741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.901+0000 7f003b87f740 1 -- 172.21.15.146:0/240254627 >> 172.21.15.146:0/240254627 conn(0x56540109c560 msgr2=0x565401493bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.901+0000 7f003b87f740 1 -- 172.21.15.146:0/240254627 shutdown_connections 2024-09-17T03:47:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.901+0000 7f003b87f740 1 -- 172.21.15.146:0/240254627 wait complete. 2024-09-17T03:47:21.902 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.902+0000 7f003b87f740 1 -- start start 2024-09-17T03:47:21.903 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.902+0000 7f003b87f740 1 Processor -- start 2024-09-17T03:47:21.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f003b87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540107f550 0x565401517860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f003b87f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 0x565401469650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.906 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f003b87f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x565401469b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f003b87f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5654014a8b00 con 0x5654010a8410 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f003b87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f00301f7c10 con 0x56540107f550 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f003b87f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x565401471ac0 con 0x565401087730 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f003b87f740 10 client.0 _ll_register_callbacks cb 0x7f0020023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f002ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x565401469b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f002ed9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x565401469b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42212/0 (socket says 172.21.15.146:42212) 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f002ed9d640 1 -- 172.21.15.146:0/2812238498 learned_addr learned my addr 172.21.15.146:0/2812238498 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f002e59c640 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540107f550 0x565401517860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.903+0000 7f002dd9b640 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 0x565401469650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f002ed9d640 1 -- 172.21.15.146:0/2812238498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 msgr2=0x565401469650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f002ed9d640 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 0x565401469650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f002ed9d640 1 -- 172.21.15.146:0/2812238498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540107f550 msgr2=0x565401517860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:21.907 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f002ed9d640 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540107f550 0x565401517860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f002ed9d640 1 -- 172.21.15.146:0/2812238498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654010f1720 con 0x5654010a8410 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f002ed9d640 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x565401469b90 secure :-1 s=READY pgs=2742 cs=0 l=1 rev1=1 crypto rx=0x7f0028099b80 tx=0x7f0028062ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22cf7e403dd1e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f000d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f000d7fa640 1 -- 172.21.15.146:0/2812238498 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0028089020 con 0x5654010a8410 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f000d7fa640 1 -- 172.21.15.146:0/2812238498 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f002805edd0 con 0x5654010a8410 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f003b87f740 1 -- 172.21.15.146:0/2812238498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0020015870 con 0x5654010a8410 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f000d7fa640 1 -- 172.21.15.146:0/2812238498 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f002801f040 con 0x5654010a8410 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f003b87f740 10 client.12111 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f003b87f740 1 -- 172.21.15.146:0/2812238498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x56540148e7d0 con 0x5654010a8410 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f000d7fa640 1 -- 172.21.15.146:0/2812238498 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0020015870 con 0x5654010a8410 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f000d7fa640 1 -- 172.21.15.146:0/2812238498 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f002800f040 con 0x5654010a8410 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f003b87f740 10 client.12111 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f003b87f740 10 client.12111 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:47:21.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f003b87f740 20 client.12111 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f003b87f740 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5654014920f0 0x565401492500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f003b87f740 4 client.12111 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.904+0000 7f003b87f740 1 -- 172.21.15.146:0/2812238498 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x5654013c0b20 con 0x5654014920f0 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.905+0000 7f002e59c640 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5654014920f0 0x565401492500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.905+0000 7f000d7fa640 10 client.12111 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.905+0000 7f002e59c640 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5654014920f0 0x565401492500 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2580fbd95829817e server_cookie=280b829a77297c89 in_seq=0 out_seq=0 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f000d7fa640 1 -- 172.21.15.146:0/2812238498 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5654013c0b20 con 0x5654014920f0 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f000d7fa640 10 client.12111 handle_command_reply: tid=0 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 1 client.12111 shutdown 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 1 -- 172.21.15.146:0/2812238498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 msgr2=0x565401469b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x565401469b90 secure :-1 s=READY pgs=2742 cs=0 l=1 rev1=1 crypto rx=0x7f0028099b80 tx=0x7f0028062ef0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 1 -- 172.21.15.146:0/2812238498 shutdown_connections 2024-09-17T03:47:21.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5654014920f0 0x565401492500 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5654010a8410 0x565401469b90 unknown :-1 s=CLOSED pgs=2742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x565401087730 0x565401469650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 1 --2- 172.21.15.146:0/2812238498 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x56540107f550 0x565401517860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 1 -- 172.21.15.146:0/2812238498 >> 172.21.15.146:0/2812238498 conn(0x56540109c560 msgr2=0x5654014683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f000d7fa640 0 client.12111 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 1 -- 172.21.15.146:0/2812238498 shutdown_connections 2024-09-17T03:47:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 1 -- 172.21.15.146:0/2812238498 wait complete. 2024-09-17T03:47:21.910 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.906+0000 7f003b87f740 20 client.12111 trim_cache size 0 max 16384 2024-09-17T03:47:21.910 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:47:21.910 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:47:21.911 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "8b50f951-7502-494d-9c08-8017d1b9f231", 2024-09-17T03:47:21.911 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:47:21.911 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:47:21.911 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 -- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0010078bc0 msgr2=0x7f001007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0010078bc0 0x7f001007b0d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f00200015e0 tx=0x7f0020009040 comp rx=0 tx=0).stop 2024-09-17T03:47:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 -- 172.21.15.146:0/2020000628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300d3320 msgr2=0x7f003009f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300d3320 0x7f003009f380 secure :-1 s=READY pgs=2738 cs=0 l=1 rev1=1 crypto rx=0x7f002800e990 tx=0x7f002800ee50 comp rx=0 tx=0).stop 2024-09-17T03:47:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 -- 172.21.15.146:0/2020000628 shutdown_connections 2024-09-17T03:47:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0010078bc0 0x7f001007b0d0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00300d3320 0x7f003009f380 unknown :-1 s=CLOSED pgs=2738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00300d05d0 0x7f003009ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 --2- 172.21.15.146:0/2020000628 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00300cf140 0x7f003015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 -- 172.21.15.146:0/2020000628 >> 172.21.15.146:0/2020000628 conn(0x7f003009ba40 msgr2=0x7f0030072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 -- 172.21.15.146:0/2020000628 shutdown_connections 2024-09-17T03:47:21.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:21.907+0000 7f0034830640 1 -- 172.21.15.146:0/2020000628 wait complete. 2024-09-17T03:47:21.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:21.918 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-17T03:47:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.034+0000 7f458f84d640 1 -- 172.21.15.146:0/109619160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4588070fc0 msgr2=0x7f458815c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.034+0000 7f458f84d640 1 --2- 172.21.15.146:0/109619160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4588070fc0 0x7f458815c9a0 secure :-1 s=READY pgs=2744 cs=0 l=1 rev1=1 crypto rx=0x7f4588073380 tx=0x7f457802a9a0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.034+0000 7f458f84d640 1 -- 172.21.15.146:0/109619160 shutdown_connections 2024-09-17T03:47:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.034+0000 7f458f84d640 1 --2- 172.21.15.146:0/109619160 >> v2:172.21.15.179:3300/0 conn(0x7f45880cfe10 0x7f45880d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.034+0000 7f458f84d640 1 --2- 172.21.15.146:0/109619160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4588070fc0 0x7f458815c9a0 unknown :-1 s=CLOSED pgs=2744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.034+0000 7f458f84d640 1 -- 172.21.15.146:0/109619160 >> 172.21.15.146:0/109619160 conn(0x7f45880b3880 msgr2=0x7f45880d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.034+0000 7f458f84d640 1 -- 172.21.15.146:0/109619160 shutdown_connections 2024-09-17T03:47:22.034 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.034+0000 7f458f84d640 1 -- 172.21.15.146:0/109619160 wait complete. 2024-09-17T03:47:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.036+0000 7f458f84d640 1 Processor -- start 2024-09-17T03:47:22.035 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.036+0000 7f458f84d640 1 -- start start 2024-09-17T03:47:22.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.037+0000 7f458f84d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4588070fc0 0x7f45880af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.037+0000 7f458f84d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45880735b0 0x7f458814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.038 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.037+0000 7f458f84d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45880cfe10 0x7f45881f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.037+0000 7f458f84d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f45880d0af0 con 0x7f4588070fc0 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.037+0000 7f458f84d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f45880d0970 con 0x7f45880735b0 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.037+0000 7f458f84d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f45880d0c70 con 0x7f45880cfe10 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.037+0000 7f458d5e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4588070fc0 0x7f45880af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.037+0000 7f458d5e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4588070fc0 0x7f45880af240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42238/0 (socket says 172.21.15.146:42238) 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.037+0000 7f458d5e9640 1 -- 172.21.15.146:0/3448567682 learned_addr learned my addr 172.21.15.146:0/3448567682 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f458cde8640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45880735b0 0x7f458814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f458ddea640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45880cfe10 0x7f45881f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f458d5e9640 1 -- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45880cfe10 msgr2=0x7f45881f6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f458d5e9640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45880cfe10 0x7f45881f6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f458d5e9640 1 -- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45880735b0 msgr2=0x7f458814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f458d5e9640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45880735b0 0x7f458814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.039 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f458d5e9640 1 -- 172.21.15.146:0/3448567682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4588159590 con 0x7f4588070fc0 2024-09-17T03:47:22.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f458cde8640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45880735b0 0x7f458814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:22.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f458d5e9640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4588070fc0 0x7f45880af240 secure :-1 s=READY pgs=2745 cs=0 l=1 rev1=1 crypto rx=0x7f457802af90 tx=0x7f4578003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:22.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f4585ffb640 1 -- 172.21.15.146:0/3448567682 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578033050 con 0x7f4588070fc0 2024-09-17T03:47:22.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f4585ffb640 1 -- 172.21.15.146:0/3448567682 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4578004570 con 0x7f4588070fc0 2024-09-17T03:47:22.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f458f84d640 1 -- 172.21.15.146:0/3448567682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45880afb90 con 0x7f4588070fc0 2024-09-17T03:47:22.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f4585ffb640 1 -- 172.21.15.146:0/3448567682 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578038450 con 0x7f4588070fc0 2024-09-17T03:47:22.040 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.038+0000 7f458f84d640 1 -- 172.21.15.146:0/3448567682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45880b0150 con 0x7f4588070fc0 2024-09-17T03:47:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.040+0000 7f4585ffb640 1 -- 172.21.15.146:0/3448567682 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4578036070 con 0x7f4588070fc0 2024-09-17T03:47:22.041 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.041+0000 7f4585ffb640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4574078bc0 0x7f457407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.041+0000 7f4585ffb640 1 -- 172.21.15.146:0/3448567682 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f45780bc090 con 0x7f4588070fc0 2024-09-17T03:47:22.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.041+0000 7f458cde8640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4574078bc0 0x7f457407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.042+0000 7f458cde8640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4574078bc0 0x7f457407b0d0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f457c000f60 tx=0x7f457c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:22.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.042+0000 7f45967c1740 1 Processor -- start 2024-09-17T03:47:22.042 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.042+0000 7f45967c1740 1 -- start start 2024-09-17T03:47:22.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f45967c1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe602da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f45967c1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c184d0 0x559fe6002860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f45967c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c206b0 0x559fe6002da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f45967c1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559fe5f5ba60 con 0x559fe5c41390 2024-09-17T03:47:22.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f45967c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559fe5f4ae90 con 0x559fe5c206b0 2024-09-17T03:47:22.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f45967c1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x559fe5f4eca0 con 0x559fe5c184d0 2024-09-17T03:47:22.045 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f458d5e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe602da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f458d5e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe602da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42254/0 (socket says 172.21.15.146:42254) 2024-09-17T03:47:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f458d5e9640 1 -- 172.21.15.146:0/876042622 learned_addr learned my addr 172.21.15.146:0/876042622 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f458ddea640 1 --2- 172.21.15.146:0/876042622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c206b0 0x559fe6002da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f458cde8640 1 --2- 172.21.15.146:0/876042622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c184d0 0x559fe6002860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.043+0000 7f458d5e9640 1 -- 172.21.15.146:0/876042622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c184d0 msgr2=0x559fe6002860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.044+0000 7f458d5e9640 1 --2- 172.21.15.146:0/876042622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c184d0 0x559fe6002860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.044+0000 7f458d5e9640 1 -- 172.21.15.146:0/876042622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c206b0 msgr2=0x559fe6002da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.044+0000 7f458d5e9640 1 --2- 172.21.15.146:0/876042622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c206b0 0x559fe6002da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.044+0000 7f458d5e9640 1 -- 172.21.15.146:0/876042622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fe5d237d0 con 0x559fe5c41390 2024-09-17T03:47:22.046 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.044+0000 7f458cde8640 1 --2- 172.21.15.146:0/876042622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c184d0 0x559fe6002860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.044+0000 7f458d5e9640 1 --2- 172.21.15.146:0/876042622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe602da10 secure :-1 s=READY pgs=2746 cs=0 l=1 rev1=1 crypto rx=0x7f45780ba580 tx=0x7f45780835a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8f98f8dacc74a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.044+0000 7f456effd640 1 -- 172.21.15.146:0/876042622 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45780aa030 con 0x559fe5c41390 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.044+0000 7f456effd640 1 -- 172.21.15.146:0/876042622 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4578088850 con 0x559fe5c41390 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.044+0000 7f456effd640 1 -- 172.21.15.146:0/876042622 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457808d790 con 0x559fe5c41390 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.045+0000 7f45967c1740 1 -- 172.21.15.146:0/876042622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 msgr2=0x559fe602da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.045+0000 7f45967c1740 1 --2- 172.21.15.146:0/876042622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe602da10 secure :-1 s=READY pgs=2746 cs=0 l=1 rev1=1 crypto rx=0x7f45780ba580 tx=0x7f45780835a0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.045+0000 7f45967c1740 1 -- 172.21.15.146:0/876042622 shutdown_connections 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.045+0000 7f45967c1740 1 --2- 172.21.15.146:0/876042622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c206b0 0x559fe6002da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.045+0000 7f45967c1740 1 --2- 172.21.15.146:0/876042622 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c184d0 0x559fe6002860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.045+0000 7f45967c1740 1 --2- 172.21.15.146:0/876042622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe602da10 unknown :-1 s=CLOSED pgs=2746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.045+0000 7f45967c1740 1 -- 172.21.15.146:0/876042622 >> 172.21.15.146:0/876042622 conn(0x559fe5c354e0 msgr2=0x559fe5fe8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.045+0000 7f45967c1740 1 -- 172.21.15.146:0/876042622 shutdown_connections 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.045+0000 7f45967c1740 1 -- 172.21.15.146:0/876042622 wait complete. 2024-09-17T03:47:22.047 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.046+0000 7f45967c1740 1 -- start start 2024-09-17T03:47:22.048 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.046+0000 7f45967c1740 1 Processor -- start 2024-09-17T03:47:22.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f45967c1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6024870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f45967c1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c206b0 0x559fe5ff4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f45967c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c41390 0x559fe5ff76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f45967c1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559fe5cbb740 con 0x559fe5c184d0 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f45967c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x559fe5ef0970 con 0x559fe5c41390 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f45967c1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x559fe5f4ae90 con 0x559fe5c206b0 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f45967c1740 10 client.0 _ll_register_callbacks cb 0x559fe5eff780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f458d5e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6024870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f458d5e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6024870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42266/0 (socket says 172.21.15.146:42266) 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f458d5e9640 1 -- 172.21.15.146:0/3929943433 learned_addr learned my addr 172.21.15.146:0/3929943433 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f458d5e9640 1 -- 172.21.15.146:0/3929943433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c206b0 msgr2=0x559fe5ff4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f458d5e9640 1 --2- 172.21.15.146:0/3929943433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c206b0 0x559fe5ff4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f458d5e9640 1 -- 172.21.15.146:0/3929943433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c41390 msgr2=0x559fe5ff76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.047+0000 7f458d5e9640 1 --2- 172.21.15.146:0/3929943433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c41390 0x559fe5ff76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f458d5e9640 1 -- 172.21.15.146:0/3929943433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fe5cac970 con 0x559fe5c184d0 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f458d5e9640 1 --2- 172.21.15.146:0/3929943433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6024870 secure :-1 s=READY pgs=2747 cs=0 l=1 rev1=1 crypto rx=0x7f4578080fe0 tx=0x7f45780845b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c56a344069862f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f4567fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:22.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f4567fff640 1 -- 172.21.15.146:0/3929943433 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457809d030 con 0x559fe5c184d0 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f4567fff640 1 -- 172.21.15.146:0/3929943433 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f457807ffe0 con 0x559fe5c184d0 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f45967c1740 1 -- 172.21.15.146:0/3929943433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4578088850 con 0x559fe5c184d0 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f4567fff640 1 -- 172.21.15.146:0/3929943433 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f45780a60d0 con 0x559fe5c184d0 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f45967c1740 10 client.12126 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f45967c1740 1 -- 172.21.15.146:0/3929943433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x559fe5c8a6a0 con 0x559fe5c184d0 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f4567fff640 1 -- 172.21.15.146:0/3929943433 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4578088850 con 0x559fe5c184d0 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f4567fff640 1 -- 172.21.15.146:0/3929943433 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f4578040070 con 0x559fe5c184d0 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f45967c1740 10 client.12126 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f45967c1740 10 client.12126 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f45967c1740 20 client.12126 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f45967c1740 1 --2- 172.21.15.146:0/3929943433 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x559fe5bfff60 0x559fe603bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f45967c1740 4 client.12126 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:47:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f45967c1740 1 -- 172.21.15.146:0/3929943433 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fe5f5d9b0 con 0x559fe5bfff60 2024-09-17T03:47:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.048+0000 7f458cde8640 1 --2- 172.21.15.146:0/3929943433 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x559fe5bfff60 0x559fe603bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.049+0000 7f4567fff640 10 client.12126 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.049+0000 7f458cde8640 1 --2- 172.21.15.146:0/3929943433 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x559fe5bfff60 0x559fe603bc40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=851b45456e56eaab server_cookie=334ea6a99405a16c in_seq=0 out_seq=0 2024-09-17T03:47:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.049+0000 7f4567fff640 1 -- 172.21.15.146:0/3929943433 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559fe5f5d9b0 con 0x559fe5bfff60 2024-09-17T03:47:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.049+0000 7f4567fff640 10 client.12126 handle_command_reply: tid=0 2024-09-17T03:47:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 1 client.12126 shutdown 2024-09-17T03:47:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 1 -- 172.21.15.146:0/3929943433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 msgr2=0x559fe6024870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 1 --2- 172.21.15.146:0/3929943433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6024870 secure :-1 s=READY pgs=2747 cs=0 l=1 rev1=1 crypto rx=0x7f4578080fe0 tx=0x7f45780845b0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 1 -- 172.21.15.146:0/3929943433 shutdown_connections 2024-09-17T03:47:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 1 --2- 172.21.15.146:0/3929943433 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x559fe5bfff60 0x559fe603bc40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 1 --2- 172.21.15.146:0/3929943433 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c41390 0x559fe5ff76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 1 --2- 172.21.15.146:0/3929943433 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c206b0 0x559fe5ff4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 1 --2- 172.21.15.146:0/3929943433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6024870 unknown :-1 s=CLOSED pgs=2747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f4567fff640 0 client.12126 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 1 -- 172.21.15.146:0/3929943433 >> 172.21.15.146:0/3929943433 conn(0x559fe5c354e0 msgr2=0x559fe6002860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 1 -- 172.21.15.146:0/3929943433 shutdown_connections 2024-09-17T03:47:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 1 -- 172.21.15.146:0/3929943433 wait complete. 2024-09-17T03:47:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.050+0000 7f45967c1740 20 client.12126 trim_cache size 0 max 16384 2024-09-17T03:47:22.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.067+0000 7f45967c1740 1 Processor -- start 2024-09-17T03:47:22.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.067+0000 7f45967c1740 1 -- start start 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f45967c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c184d0 0x559fe60230f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f45967c1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c206b0 0x559fe6027f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f45967c1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe6028490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f45967c1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f4588200170 con 0x559fe5c41390 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f45967c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4588148530 con 0x559fe5c184d0 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f45967c1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f458815a680 con 0x559fe5c206b0 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f458ddea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe6028490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f458ddea640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe6028490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42278/0 (socket says 172.21.15.146:42278) 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f458ddea640 1 -- 172.21.15.146:0/1553421905 learned_addr learned my addr 172.21.15.146:0/1553421905 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f458ddea640 1 -- 172.21.15.146:0/1553421905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c206b0 msgr2=0x559fe6027f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f458ddea640 1 --2- 172.21.15.146:0/1553421905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c206b0 0x559fe6027f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f458ddea640 1 -- 172.21.15.146:0/1553421905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c184d0 msgr2=0x559fe60230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:22.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f458ddea640 1 --2- 172.21.15.146:0/1553421905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c184d0 0x559fe60230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f458ddea640 1 -- 172.21.15.146:0/1553421905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fe5fea6f0 con 0x559fe5c41390 2024-09-17T03:47:22.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f458ddea640 1 --2- 172.21.15.146:0/1553421905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe6028490 secure :-1 s=READY pgs=2748 cs=0 l=1 rev1=1 crypto rx=0x7f458000cac0 tx=0x7f458000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3220943c2946440f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:22.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f456e7fc640 1 -- 172.21.15.146:0/1553421905 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458001e070 con 0x559fe5c41390 2024-09-17T03:47:22.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f456e7fc640 1 -- 172.21.15.146:0/1553421905 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45800193f0 con 0x559fe5c41390 2024-09-17T03:47:22.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.069+0000 7f456e7fc640 1 -- 172.21.15.146:0/1553421905 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580019840 con 0x559fe5c41390 2024-09-17T03:47:22.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.070+0000 7f45967c1740 1 -- 172.21.15.146:0/1553421905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 msgr2=0x559fe6028490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:22.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.070+0000 7f45967c1740 1 --2- 172.21.15.146:0/1553421905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe6028490 secure :-1 s=READY pgs=2748 cs=0 l=1 rev1=1 crypto rx=0x7f458000cac0 tx=0x7f458000cf80 comp rx=0 tx=0).stop 2024-09-17T03:47:22.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.070+0000 7f45967c1740 1 -- 172.21.15.146:0/1553421905 shutdown_connections 2024-09-17T03:47:22.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.070+0000 7f45967c1740 1 --2- 172.21.15.146:0/1553421905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c41390 0x559fe6028490 unknown :-1 s=CLOSED pgs=2748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.070+0000 7f45967c1740 1 --2- 172.21.15.146:0/1553421905 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c206b0 0x559fe6027f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.070+0000 7f45967c1740 1 --2- 172.21.15.146:0/1553421905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c184d0 0x559fe60230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.070+0000 7f45967c1740 1 -- 172.21.15.146:0/1553421905 >> 172.21.15.146:0/1553421905 conn(0x559fe5c354e0 msgr2=0x559fe6025100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.070+0000 7f45967c1740 1 -- 172.21.15.146:0/1553421905 shutdown_connections 2024-09-17T03:47:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.070+0000 7f45967c1740 1 -- 172.21.15.146:0/1553421905 wait complete. 2024-09-17T03:47:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.071+0000 7f45967c1740 1 -- start start 2024-09-17T03:47:22.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.071+0000 7f45967c1740 1 Processor -- start 2024-09-17T03:47:22.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f45967c1740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6099310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f45967c1740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c206b0 0x559fe600f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f45967c1740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c41390 0x559fe600f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.076 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f45967c1740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x559fe5f5ba60 con 0x559fe5c184d0 2024-09-17T03:47:22.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f45967c1740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f458815acd0 con 0x559fe5c206b0 2024-09-17T03:47:22.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f45967c1740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x559fe5fe89a0 con 0x559fe5c41390 2024-09-17T03:47:22.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f45967c1740 10 client.0 _ll_register_callbacks cb 0x7f4580005ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:22.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f458d5e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6099310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f458d5e9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6099310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42280/0 (socket says 172.21.15.146:42280) 2024-09-17T03:47:22.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f458d5e9640 1 -- 172.21.15.146:0/3266616095 learned_addr learned my addr 172.21.15.146:0/3266616095 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:22.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f458cde8640 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c206b0 0x559fe600f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f458ddea640 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c41390 0x559fe600f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f458d5e9640 1 -- 172.21.15.146:0/3266616095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c41390 msgr2=0x559fe600f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:22.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f458d5e9640 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c41390 0x559fe600f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f458d5e9640 1 -- 172.21.15.146:0/3266616095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c206b0 msgr2=0x559fe600f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:22.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f458d5e9640 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c206b0 0x559fe600f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f458d5e9640 1 -- 172.21.15.146:0/3266616095 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fe60a0cb0 con 0x559fe5c184d0 2024-09-17T03:47:22.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f458d5e9640 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6099310 secure :-1 s=READY pgs=2749 cs=0 l=1 rev1=1 crypto rx=0x7f4578083d00 tx=0x7f45780801f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a00e55939a0ddc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:22.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f4567fff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:22.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f4567fff640 1 -- 172.21.15.146:0/3266616095 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457809d070 con 0x559fe5c184d0 2024-09-17T03:47:22.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f4567fff640 1 -- 172.21.15.146:0/3266616095 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f4578036bf0 con 0x559fe5c184d0 2024-09-17T03:47:22.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f45967c1740 1 -- 172.21.15.146:0/3266616095 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45800193f0 con 0x559fe5c184d0 2024-09-17T03:47:22.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f4567fff640 1 -- 172.21.15.146:0/3266616095 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f45780803c0 con 0x559fe5c184d0 2024-09-17T03:47:22.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f45967c1740 10 client.12132 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:22.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.073+0000 7f45967c1740 1 -- 172.21.15.146:0/3266616095 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x559fe60a0cb0 con 0x559fe5c184d0 2024-09-17T03:47:22.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f4567fff640 1 -- 172.21.15.146:0/3266616095 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45800193f0 con 0x559fe5c184d0 2024-09-17T03:47:22.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f4567fff640 1 -- 172.21.15.146:0/3266616095 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f4578040070 con 0x559fe5c184d0 2024-09-17T03:47:22.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f45967c1740 10 client.12132 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:22.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f45967c1740 10 client.12132 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:47:22.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f45967c1740 20 client.12132 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:22.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f45967c1740 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x559fe60add70 0x559fe5fe22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:22.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f45967c1740 4 client.12132 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:47:22.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f45967c1740 1 -- 172.21.15.146:0/3266616095 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559fe5f59460 con 0x559fe60add70 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f458cde8640 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x559fe60add70 0x559fe5fe22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f4567fff640 10 client.12132 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f458cde8640 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x559fe60add70 0x559fe5fe22f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=326d3b92790fe6df server_cookie=904bf13d12685230 in_seq=0 out_seq=0 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f4567fff640 1 -- 172.21.15.146:0/3266616095 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x559fe5f59460 con 0x559fe60add70 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f4567fff640 10 client.12132 handle_command_reply: tid=0 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.074+0000 7f45967c1740 1 client.12132 shutdown 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f45967c1740 1 -- 172.21.15.146:0/3266616095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 msgr2=0x559fe6099310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f45967c1740 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6099310 secure :-1 s=READY pgs=2749 cs=0 l=1 rev1=1 crypto rx=0x7f4578083d00 tx=0x7f45780801f0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f45967c1740 1 -- 172.21.15.146:0/3266616095 shutdown_connections 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f45967c1740 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x559fe60add70 0x559fe5fe22f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f45967c1740 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x559fe5c41390 0x559fe600f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f45967c1740 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x559fe5c206b0 0x559fe600f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f45967c1740 1 --2- 172.21.15.146:0/3266616095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559fe5c184d0 0x559fe6099310 unknown :-1 s=CLOSED pgs=2749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f4567fff640 0 client.12132 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:22.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f45967c1740 1 -- 172.21.15.146:0/3266616095 >> 172.21.15.146:0/3266616095 conn(0x559fe5c354e0 msgr2=0x559fe6026020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:22.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f45967c1740 1 -- 172.21.15.146:0/3266616095 shutdown_connections 2024-09-17T03:47:22.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f45967c1740 1 -- 172.21.15.146:0/3266616095 wait complete. 2024-09-17T03:47:22.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f45967c1740 20 client.12132 trim_cache size 0 max 16384 2024-09-17T03:47:22.081 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:47:22.081 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:47:22.081 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:47:22.081 INFO:teuthology.orchestra.run.smithi146.stdout: "8b50f951-7502-494d-9c08-8017d1b9f231": { 2024-09-17T03:47:22.082 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:47:22.082 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "8b50f951-7502-494d-9c08-8017d1b9f231", 2024-09-17T03:47:22.082 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive,repair" 2024-09-17T03:47:22.082 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:22.082 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:22.082 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:47:22.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f458f84d640 1 -- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4574078bc0 msgr2=0x7f457407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:22.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f458f84d640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4574078bc0 0x7f457407b0d0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f457c000f60 tx=0x7f457c009040 comp rx=0 tx=0).stop 2024-09-17T03:47:22.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f458f84d640 1 -- 172.21.15.146:0/3448567682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4588070fc0 msgr2=0x7f45880af240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:22.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.075+0000 7f458f84d640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4588070fc0 0x7f45880af240 secure :-1 s=READY pgs=2745 cs=0 l=1 rev1=1 crypto rx=0x7f457802af90 tx=0x7f4578003f90 comp rx=0 tx=0).stop 2024-09-17T03:47:22.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.076+0000 7f458f84d640 1 -- 172.21.15.146:0/3448567682 shutdown_connections 2024-09-17T03:47:22.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.076+0000 7f458f84d640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4574078bc0 0x7f457407b0d0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.076+0000 7f458f84d640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f45880cfe10 0x7f45881f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.076+0000 7f458f84d640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45880735b0 0x7f458814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.076+0000 7f458f84d640 1 --2- 172.21.15.146:0/3448567682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4588070fc0 0x7f45880af240 unknown :-1 s=CLOSED pgs=2745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:22.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.076+0000 7f458f84d640 1 -- 172.21.15.146:0/3448567682 >> 172.21.15.146:0/3448567682 conn(0x7f45880b3880 msgr2=0x7f45880b6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:22.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.076+0000 7f458f84d640 1 -- 172.21.15.146:0/3448567682 shutdown_connections 2024-09-17T03:47:22.084 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:22.076+0000 7f458f84d640 1 -- 172.21.15.146:0/3448567682 wait complete. 2024-09-17T03:47:22.086 INFO:tasks.cephfs.filesystem:scrub status for tag:8b50f951-7502-494d-9c08-8017d1b9f231 - {'path': '/', 'tag': '8b50f951-7502-494d-9c08-8017d1b9f231', 'options': 'recursive,repair'} 2024-09-17T03:47:24.462 INFO:tasks.ceph.mds.c.smithi146.stderr:2024-09-17T03:47:24.462+0000 7fe9d8b65640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:47:30.368 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:47:30.371 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:47:52.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:52.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-17T03:47:52.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.216+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/834624163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e480d1220 msgr2=0x7f5e480b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.216+0000 7f5e4fd8e640 1 --2- 172.21.15.146:0/834624163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e480d1220 0x7f5e480b5ad0 secure :-1 s=READY pgs=2750 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009ca0 tx=0x7f5e4002aac0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.216+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/834624163 shutdown_connections 2024-09-17T03:47:52.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.216+0000 7f5e4fd8e640 1 --2- 172.21.15.146:0/834624163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e480d1220 0x7f5e480b5ad0 unknown :-1 s=CLOSED pgs=2750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.216+0000 7f5e4fd8e640 1 --2- 172.21.15.146:0/834624163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e480d31e0 0x7f5e480cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.216+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/834624163 >> 172.21.15.146:0/834624163 conn(0x7f5e480d26c0 msgr2=0x7f5e480d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.216+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/834624163 shutdown_connections 2024-09-17T03:47:52.217 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.216+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/834624163 wait complete. 2024-09-17T03:47:52.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.218+0000 7f5e4fd8e640 1 Processor -- start 2024-09-17T03:47:52.218 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.218+0000 7f5e4fd8e640 1 -- start start 2024-09-17T03:47:52.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.219+0000 7f5e4fd8e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e480d31e0 0x7f5e481e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.219+0000 7f5e4fd8e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e4815cbe0 0x7f5e481f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.219+0000 7f5e4fd8e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e4806f210 0x7f5e481f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.219+0000 7f5e4fd8e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5e480b6510 con 0x7f5e480d31e0 2024-09-17T03:47:52.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.219+0000 7f5e4fd8e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e480b6390 con 0x7f5e4806f210 2024-09-17T03:47:52.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.219+0000 7f5e4fd8e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5e480b6690 con 0x7f5e4815cbe0 2024-09-17T03:47:52.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.219+0000 7f5e4db2a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e480d31e0 0x7f5e481e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.219+0000 7f5e4db2a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e480d31e0 0x7f5e481e4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49066/0 (socket says 172.21.15.146:49066) 2024-09-17T03:47:52.221 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.219+0000 7f5e4db2a640 1 -- 172.21.15.146:0/609276300 learned_addr learned my addr 172.21.15.146:0/609276300 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e4e32b640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e4806f210 0x7f5e481f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e4d329640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e4815cbe0 0x7f5e481f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e4db2a640 1 -- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e4815cbe0 msgr2=0x7f5e481f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e4db2a640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e4815cbe0 0x7f5e481f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e4db2a640 1 -- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e4806f210 msgr2=0x7f5e481f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e4db2a640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e4806f210 0x7f5e481f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e4db2a640 1 -- 172.21.15.146:0/609276300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e481f6280 con 0x7f5e480d31e0 2024-09-17T03:47:52.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e4db2a640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e480d31e0 0x7f5e481e4ce0 secure :-1 s=READY pgs=2751 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400d700 tx=0x7f5e4400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e3e7fc640 1 -- 172.21.15.146:0/609276300 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44017070 con 0x7f5e480d31e0 2024-09-17T03:47:52.222 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e3e7fc640 1 -- 172.21.15.146:0/609276300 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e44009d20 con 0x7f5e480d31e0 2024-09-17T03:47:52.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/609276300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e481e3c40 con 0x7f5e480d31e0 2024-09-17T03:47:52.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e3e7fc640 1 -- 172.21.15.146:0/609276300 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e440106c0 con 0x7f5e480d31e0 2024-09-17T03:47:52.223 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.220+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/609276300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e481e4200 con 0x7f5e480d31e0 2024-09-17T03:47:52.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.222+0000 7f5e3e7fc640 1 -- 172.21.15.146:0/609276300 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e4401a070 con 0x7f5e480d31e0 2024-09-17T03:47:52.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.222+0000 7f5e3e7fc640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e2c078bc0 0x7f5e2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.223+0000 7f5e3e7fc640 1 -- 172.21.15.146:0/609276300 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f5e4409ae40 con 0x7f5e480d31e0 2024-09-17T03:47:52.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.223+0000 7f5e4d329640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e2c078bc0 0x7f5e2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.223+0000 7f5e4d329640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e2c078bc0 0x7f5e2c07b0d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f5e48156740 tx=0x7f5e38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.224+0000 7f5e56ddb740 1 Processor -- start 2024-09-17T03:47:52.224 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.224+0000 7f5e56ddb740 1 -- start start 2024-09-17T03:47:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea81843390 0x55ea81c14740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea8181a4d0 0x55ea81c14c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea818226b0 0x55ea81c31b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ea81b5da60 con 0x55ea8181a4d0 2024-09-17T03:47:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ea81b4ce90 con 0x55ea81843390 2024-09-17T03:47:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ea81b50ca0 con 0x55ea818226b0 2024-09-17T03:47:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e4d329640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea8181a4d0 0x55ea81c14c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e4d329640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea8181a4d0 0x55ea81c14c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49080/0 (socket says 172.21.15.146:49080) 2024-09-17T03:47:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e4d329640 1 -- 172.21.15.146:0/3179572192 learned_addr learned my addr 172.21.15.146:0/3179572192 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.227 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e4db2a640 1 --2- 172.21.15.146:0/3179572192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea81843390 0x55ea81c14740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e4e32b640 1 --2- 172.21.15.146:0/3179572192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea818226b0 0x55ea81c31b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e4d329640 1 -- 172.21.15.146:0/3179572192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea818226b0 msgr2=0x55ea81c31b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e4d329640 1 --2- 172.21.15.146:0/3179572192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea818226b0 0x55ea81c31b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e4d329640 1 -- 172.21.15.146:0/3179572192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea81843390 msgr2=0x55ea81c14740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e4d329640 1 --2- 172.21.15.146:0/3179572192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea81843390 0x55ea81c14740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e4d329640 1 -- 172.21.15.146:0/3179572192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea819257d0 con 0x55ea8181a4d0 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.225+0000 7f5e4d329640 1 --2- 172.21.15.146:0/3179572192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea8181a4d0 0x55ea81c14c80 secure :-1 s=READY pgs=2752 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800f940 tx=0x7f5e38012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bf767538f9250f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.226+0000 7f5e2b7fe640 1 -- 172.21.15.146:0/3179572192 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38025070 con 0x55ea8181a4d0 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.226+0000 7f5e2b7fe640 1 -- 172.21.15.146:0/3179572192 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e3801b050 con 0x55ea8181a4d0 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.226+0000 7f5e2b7fe640 1 -- 172.21.15.146:0/3179572192 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38014e40 con 0x55ea8181a4d0 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.226+0000 7f5e56ddb740 1 -- 172.21.15.146:0/3179572192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea8181a4d0 msgr2=0x55ea81c14c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.226+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/3179572192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea8181a4d0 0x55ea81c14c80 secure :-1 s=READY pgs=2752 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800f940 tx=0x7f5e38012000 comp rx=0 tx=0).stop 2024-09-17T03:47:52.228 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.227+0000 7f5e56ddb740 1 -- 172.21.15.146:0/3179572192 shutdown_connections 2024-09-17T03:47:52.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.227+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/3179572192 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea818226b0 0x55ea81c31b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.227+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/3179572192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea8181a4d0 0x55ea81c14c80 unknown :-1 s=CLOSED pgs=2752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.227+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/3179572192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea81843390 0x55ea81c14740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.227+0000 7f5e56ddb740 1 -- 172.21.15.146:0/3179572192 >> 172.21.15.146:0/3179572192 conn(0x55ea818374e0 msgr2=0x55ea81beaa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.227+0000 7f5e56ddb740 1 -- 172.21.15.146:0/3179572192 shutdown_connections 2024-09-17T03:47:52.229 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.227+0000 7f5e56ddb740 1 -- 172.21.15.146:0/3179572192 wait complete. 2024-09-17T03:47:52.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.227+0000 7f5e56ddb740 1 -- start start 2024-09-17T03:47:52.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.228+0000 7f5e56ddb740 1 Processor -- start 2024-09-17T03:47:52.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea8181a4d0 0x55ea81c292f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.235 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea818226b0 0x55ea81c045e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c04b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ea818bd740 con 0x55ea81843390 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ea81af2970 con 0x55ea8181a4d0 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ea81c151c0 con 0x55ea818226b0 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e56ddb740 10 client.0 _ll_register_callbacks cb 0x55ea81af5be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e4e32b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c04b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e4e32b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c04b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49092/0 (socket says 172.21.15.146:49092) 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e4e32b640 1 -- 172.21.15.146:0/2768730900 learned_addr learned my addr 172.21.15.146:0/2768730900 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e4db2a640 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea8181a4d0 0x55ea81c292f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e4d329640 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea818226b0 0x55ea81c045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e4e32b640 1 -- 172.21.15.146:0/2768730900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea818226b0 msgr2=0x55ea81c045e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.236 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e4e32b640 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea818226b0 0x55ea81c045e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e4e32b640 1 -- 172.21.15.146:0/2768730900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea8181a4d0 msgr2=0x55ea81c292f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e4e32b640 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea8181a4d0 0x55ea81c292f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.229+0000 7f5e4e32b640 1 -- 172.21.15.146:0/2768730900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea818ae970 con 0x55ea81843390 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e4e32b640 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c04b20 secure :-1 s=READY pgs=2753 cs=0 l=1 rev1=1 crypto rx=0x7f5e40006010 tx=0x7f5e40009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d3f71106b6ec35 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e28ff9640 1 -- 172.21.15.146:0/2768730900 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40046020 con 0x55ea81843390 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e28ff9640 1 -- 172.21.15.146:0/2768730900 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f5e40003970 con 0x55ea81843390 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e56ddb740 1 -- 172.21.15.146:0/2768730900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e3801b050 con 0x55ea81843390 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e28ff9640 1 -- 172.21.15.146:0/2768730900 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f5e40050050 con 0x55ea81843390 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e56ddb740 10 client.12144 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e56ddb740 1 -- 172.21.15.146:0/2768730900 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x55ea8188c6a0 con 0x55ea81843390 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e28ff9640 1 -- 172.21.15.146:0/2768730900 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e3801b050 con 0x55ea81843390 2024-09-17T03:47:52.237 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e28ff9640 1 -- 172.21.15.146:0/2768730900 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f5e40053020 con 0x55ea81843390 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e56ddb740 10 client.12144 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e56ddb740 10 client.12144 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e56ddb740 20 client.12144 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55ea81801f60 0x55ea81c3ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e56ddb740 4 client.12144 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e56ddb740 1 -- 172.21.15.146:0/2768730900 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea81b5f9b0 con 0x55ea81801f60 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.230+0000 7f5e4db2a640 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55ea81801f60 0x55ea81c3ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.231+0000 7f5e28ff9640 10 client.12144 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.231+0000 7f5e4db2a640 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55ea81801f60 0x55ea81c3ee10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9e3d3aa712ece5d server_cookie=689a5a0838b1d1da in_seq=0 out_seq=0 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.231+0000 7f5e28ff9640 1 -- 172.21.15.146:0/2768730900 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea81b5f9b0 con 0x55ea81801f60 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.231+0000 7f5e28ff9640 10 client.12144 handle_command_reply: tid=0 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.231+0000 7f5e56ddb740 1 client.12144 shutdown 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e56ddb740 1 -- 172.21.15.146:0/2768730900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 msgr2=0x55ea81c04b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c04b20 secure :-1 s=READY pgs=2753 cs=0 l=1 rev1=1 crypto rx=0x7f5e40006010 tx=0x7f5e40009a20 comp rx=0 tx=0).stop 2024-09-17T03:47:52.238 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e56ddb740 1 -- 172.21.15.146:0/2768730900 shutdown_connections 2024-09-17T03:47:52.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55ea81801f60 0x55ea81c3ee10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c04b20 unknown :-1 s=CLOSED pgs=2753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea818226b0 0x55ea81c045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/2768730900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea8181a4d0 0x55ea81c292f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e28ff9640 0 client.12144 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e56ddb740 1 -- 172.21.15.146:0/2768730900 >> 172.21.15.146:0/2768730900 conn(0x55ea818374e0 msgr2=0x55ea81be52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e56ddb740 1 -- 172.21.15.146:0/2768730900 shutdown_connections 2024-09-17T03:47:52.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e56ddb740 1 -- 172.21.15.146:0/2768730900 wait complete. 2024-09-17T03:47:52.239 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.232+0000 7f5e56ddb740 20 client.12144 trim_cache size 0 max 16384 2024-09-17T03:47:52.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.250+0000 7f5e56ddb740 1 Processor -- start 2024-09-17T03:47:52.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.250+0000 7f5e56ddb740 1 -- start start 2024-09-17T03:47:52.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea8181a4d0 0x55ea81c29030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea818226b0 0x55ea81c14830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea81843390 0x55ea81c14d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5e48202550 con 0x55ea818226b0 2024-09-17T03:47:52.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e48148d60 con 0x55ea81843390 2024-09-17T03:47:52.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5e480c9020 con 0x55ea8181a4d0 2024-09-17T03:47:52.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e4d329640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea818226b0 0x55ea81c14830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e4d329640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea818226b0 0x55ea81c14830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49100/0 (socket says 172.21.15.146:49100) 2024-09-17T03:47:52.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e4d329640 1 -- 172.21.15.146:0/3219138884 learned_addr learned my addr 172.21.15.146:0/3219138884 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.252 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e4d329640 1 -- 172.21.15.146:0/3219138884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea8181a4d0 msgr2=0x55ea81c29030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e4d329640 1 --2- 172.21.15.146:0/3219138884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea8181a4d0 0x55ea81c29030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e4d329640 1 -- 172.21.15.146:0/3219138884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea81843390 msgr2=0x55ea81c14d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e4d329640 1 --2- 172.21.15.146:0/3219138884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea81843390 0x55ea81c14d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.251+0000 7f5e4d329640 1 -- 172.21.15.146:0/3219138884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea81bff600 con 0x55ea818226b0 2024-09-17T03:47:52.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.252+0000 7f5e4d329640 1 --2- 172.21.15.146:0/3219138884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea818226b0 0x55ea81c14830 secure :-1 s=READY pgs=2754 cs=0 l=1 rev1=1 crypto rx=0x7f5e38014820 tx=0x7f5e38007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b548afdc190330bc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.252+0000 7f5e2affd640 1 -- 172.21.15.146:0/3219138884 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38030030 con 0x55ea818226b0 2024-09-17T03:47:52.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.252+0000 7f5e2affd640 1 -- 172.21.15.146:0/3219138884 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e38026040 con 0x55ea818226b0 2024-09-17T03:47:52.253 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.252+0000 7f5e2affd640 1 -- 172.21.15.146:0/3219138884 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38025040 con 0x55ea818226b0 2024-09-17T03:47:52.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.252+0000 7f5e56ddb740 1 -- 172.21.15.146:0/3219138884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea818226b0 msgr2=0x55ea81c14830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.252+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/3219138884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea818226b0 0x55ea81c14830 secure :-1 s=READY pgs=2754 cs=0 l=1 rev1=1 crypto rx=0x7f5e38014820 tx=0x7f5e38007df0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.253+0000 7f5e56ddb740 1 -- 172.21.15.146:0/3219138884 shutdown_connections 2024-09-17T03:47:52.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.253+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/3219138884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea81843390 0x55ea81c14d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.253+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/3219138884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea818226b0 0x55ea81c14830 unknown :-1 s=CLOSED pgs=2754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.253+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/3219138884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea8181a4d0 0x55ea81c29030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.253+0000 7f5e56ddb740 1 -- 172.21.15.146:0/3219138884 >> 172.21.15.146:0/3219138884 conn(0x55ea818374e0 msgr2=0x55ea81c255b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.253+0000 7f5e56ddb740 1 -- 172.21.15.146:0/3219138884 shutdown_connections 2024-09-17T03:47:52.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.253+0000 7f5e56ddb740 1 -- 172.21.15.146:0/3219138884 wait complete. 2024-09-17T03:47:52.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.253+0000 7f5e56ddb740 1 -- start start 2024-09-17T03:47:52.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.253+0000 7f5e56ddb740 1 Processor -- start 2024-09-17T03:47:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea8181a4d0 0x55ea81ca5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea818226b0 0x55ea81c480f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e56ddb740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c48630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55ea81c2fd30 con 0x55ea81843390 2024-09-17T03:47:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5e481486f0 con 0x55ea818226b0 2024-09-17T03:47:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e56ddb740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ea81c3f500 con 0x55ea8181a4d0 2024-09-17T03:47:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e56ddb740 10 client.0 _ll_register_callbacks cb 0x7f5e40009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e4e32b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c48630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e4e32b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c48630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49114/0 (socket says 172.21.15.146:49114) 2024-09-17T03:47:52.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e4e32b640 1 -- 172.21.15.146:0/1615323440 learned_addr learned my addr 172.21.15.146:0/1615323440 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e4d329640 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea818226b0 0x55ea81c480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e4db2a640 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea8181a4d0 0x55ea81ca5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e4e32b640 1 -- 172.21.15.146:0/1615323440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea8181a4d0 msgr2=0x55ea81ca5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e4e32b640 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea8181a4d0 0x55ea81ca5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e4e32b640 1 -- 172.21.15.146:0/1615323440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea818226b0 msgr2=0x55ea81c480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e4e32b640 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea818226b0 0x55ea81c480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e4e32b640 1 -- 172.21.15.146:0/1615323440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea81caf2b0 con 0x55ea81843390 2024-09-17T03:47:52.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.255+0000 7f5e4e32b640 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c48630 secure :-1 s=READY pgs=2755 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009590 tx=0x7f5e400095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845cbab9b65d396f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e28ff9640 1 -- 172.21.15.146:0/1615323440 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40046040 con 0x55ea81843390 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e28ff9640 1 -- 172.21.15.146:0/1615323440 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f5e40004b40 con 0x55ea81843390 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e56ddb740 1 -- 172.21.15.146:0/1615323440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e38026040 con 0x55ea81843390 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e28ff9640 1 -- 172.21.15.146:0/1615323440 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f5e40061050 con 0x55ea81843390 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e56ddb740 10 client.12150 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e56ddb740 1 -- 172.21.15.146:0/1615323440 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x55ea81c02d50 con 0x55ea81843390 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e28ff9640 1 -- 172.21.15.146:0/1615323440 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e38026040 con 0x55ea81843390 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e28ff9640 1 -- 172.21.15.146:0/1615323440 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f5e40053070 con 0x55ea81843390 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e56ddb740 10 client.12150 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e56ddb740 10 client.12150 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e56ddb740 20 client.12150 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55ea81bfdec0 0x55ea81cb2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e56ddb740 4 client.12150 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e56ddb740 1 -- 172.21.15.146:0/1615323440 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ea81b5b460 con 0x55ea81bfdec0 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.256+0000 7f5e4db2a640 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55ea81bfdec0 0x55ea81cb2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e28ff9640 10 client.12150 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e4db2a640 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55ea81bfdec0 0x55ea81cb2830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c890735fe4d6897 server_cookie=fbe0be54d0605812 in_seq=0 out_seq=0 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e28ff9640 1 -- 172.21.15.146:0/1615323440 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55ea81b5b460 con 0x55ea81bfdec0 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e28ff9640 10 client.12150 handle_command_reply: tid=0 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e56ddb740 1 client.12150 shutdown 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e56ddb740 1 -- 172.21.15.146:0/1615323440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 msgr2=0x55ea81c48630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c48630 secure :-1 s=READY pgs=2755 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009590 tx=0x7f5e400095c0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e56ddb740 1 -- 172.21.15.146:0/1615323440 shutdown_connections 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55ea81bfdec0 0x55ea81cb2830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ea81843390 0x55ea81c48630 unknown :-1 s=CLOSED pgs=2755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ea818226b0 0x55ea81c480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e28ff9640 0 client.12150 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e56ddb740 1 --2- 172.21.15.146:0/1615323440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ea8181a4d0 0x55ea81ca5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e56ddb740 1 -- 172.21.15.146:0/1615323440 >> 172.21.15.146:0/1615323440 conn(0x55ea818374e0 msgr2=0x55ea81c255b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e56ddb740 1 -- 172.21.15.146:0/1615323440 shutdown_connections 2024-09-17T03:47:52.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.257+0000 7f5e56ddb740 1 -- 172.21.15.146:0/1615323440 wait complete. 2024-09-17T03:47:52.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e56ddb740 20 client.12150 trim_cache size 0 max 16384 2024-09-17T03:47:52.263 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:47:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2024-09-17T03:47:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {}, 2024-09-17T03:47:52.263 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:47:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "8b50f951-7502-494d-9c08-8017d1b9f231": { 2024-09-17T03:47:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:47:27.757320+0000", 2024-09-17T03:47:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:47:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:47:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:47:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:47:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:47:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:52.264 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:52.264 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:47:52.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e2c078bc0 msgr2=0x7f5e2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e2c078bc0 0x7f5e2c07b0d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f5e48156740 tx=0x7f5e38009040 comp rx=0 tx=0).stop 2024-09-17T03:47:52.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/609276300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e480d31e0 msgr2=0x7f5e481e4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e480d31e0 0x7f5e481e4ce0 secure :-1 s=READY pgs=2751 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400d700 tx=0x7f5e4400dbc0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/609276300 shutdown_connections 2024-09-17T03:47:52.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5e2c078bc0 0x7f5e2c07b0d0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5e4806f210 0x7f5e481f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5e4815cbe0 0x7f5e481f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 --2- 172.21.15.146:0/609276300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e480d31e0 0x7f5e481e4ce0 unknown :-1 s=CLOSED pgs=2751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/609276300 >> 172.21.15.146:0/609276300 conn(0x7f5e480d26c0 msgr2=0x7f5e480d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/609276300 shutdown_connections 2024-09-17T03:47:52.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.258+0000 7f5e4fd8e640 1 -- 172.21.15.146:0/609276300 wait complete. 2024-09-17T03:47:52.270 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:47:52.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:52.270 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub start / recursive,repair 2024-09-17T03:47:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.387+0000 7f122359e640 1 -- 172.21.15.146:0/1333718034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122415ff70 msgr2=0x7f12240ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.387+0000 7f122359e640 1 --2- 172.21.15.146:0/1333718034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122415ff70 0x7f12240ccb60 secure :-1 s=READY pgs=2756 cs=0 l=1 rev1=1 crypto rx=0x7f12240cbcd0 tx=0x7f121c02a530 comp rx=0 tx=0).stop 2024-09-17T03:47:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.387+0000 7f122359e640 1 -- 172.21.15.146:0/1333718034 shutdown_connections 2024-09-17T03:47:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.387+0000 7f122359e640 1 --2- 172.21.15.146:0/1333718034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122415ff70 0x7f12240ccb60 unknown :-1 s=CLOSED pgs=2756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.387+0000 7f122359e640 1 --2- 172.21.15.146:0/1333718034 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f122415f620 0x7f122415fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.387+0000 7f122359e640 1 -- 172.21.15.146:0/1333718034 >> 172.21.15.146:0/1333718034 conn(0x7f12240d1500 msgr2=0x7f12240d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.387+0000 7f122359e640 1 -- 172.21.15.146:0/1333718034 shutdown_connections 2024-09-17T03:47:52.388 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.387+0000 7f122359e640 1 -- 172.21.15.146:0/1333718034 wait complete. 2024-09-17T03:47:52.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.389+0000 7f122359e640 1 Processor -- start 2024-09-17T03:47:52.389 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.389+0000 7f122359e640 1 -- start start 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.390+0000 7f122359e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12240d0e80 0x7f122415d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.390+0000 7f122359e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f122415f620 0x7f12240b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.390+0000 7f122359e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122415ff70 0x7f1224158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.390+0000 7f122359e640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f12240cd0a0 con 0x7f122415ff70 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.390+0000 7f122359e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12240c4e10 con 0x7f12240d0e80 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.390+0000 7f122359e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f12240cd220 con 0x7f122415f620 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.390+0000 7f1222d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122415ff70 0x7f1224158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.390+0000 7f1222d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122415ff70 0x7f1224158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49144/0 (socket says 172.21.15.146:49144) 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.390+0000 7f1222d9d640 1 -- 172.21.15.146:0/3287969943 learned_addr learned my addr 172.21.15.146:0/3287969943 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f122259c640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12240d0e80 0x7f122415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f1221d9b640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f122415f620 0x7f12240b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f1222d9d640 1 -- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f122415f620 msgr2=0x7f12240b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f1222d9d640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f122415f620 0x7f12240b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f1222d9d640 1 -- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12240d0e80 msgr2=0x7f122415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f1222d9d640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12240d0e80 0x7f122415d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f1222d9d640 1 -- 172.21.15.146:0/3287969943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12241f9880 con 0x7f122415ff70 2024-09-17T03:47:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f1222d9d640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122415ff70 0x7f1224158490 secure :-1 s=READY pgs=2757 cs=0 l=1 rev1=1 crypto rx=0x7f121c009230 tx=0x7f121c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f1212ffd640 1 -- 172.21.15.146:0/3287969943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c03e030 con 0x7f122415ff70 2024-09-17T03:47:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f1212ffd640 1 -- 172.21.15.146:0/3287969943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f121c003e50 con 0x7f122415ff70 2024-09-17T03:47:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f122359e640 1 -- 172.21.15.146:0/3287969943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12241f9b60 con 0x7f122415ff70 2024-09-17T03:47:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f1212ffd640 1 -- 172.21.15.146:0/3287969943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c035040 con 0x7f122415ff70 2024-09-17T03:47:52.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.391+0000 7f122359e640 1 -- 172.21.15.146:0/3287969943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12240b5070 con 0x7f122415ff70 2024-09-17T03:47:52.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.393+0000 7f1212ffd640 1 -- 172.21.15.146:0/3287969943 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f121c041030 con 0x7f122415ff70 2024-09-17T03:47:52.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.394+0000 7f1212ffd640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1204078b90 0x7f120407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.394+0000 7f1212ffd640 1 -- 172.21.15.146:0/3287969943 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f121c0bb430 con 0x7f122415ff70 2024-09-17T03:47:52.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.394+0000 7f122259c640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1204078b90 0x7f120407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.394+0000 7f122259c640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1204078b90 0x7f120407b0a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f121400b450 tx=0x7f121400d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.395+0000 7f122fa46740 1 Processor -- start 2024-09-17T03:47:52.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.395+0000 7f122fa46740 1 -- start start 2024-09-17T03:47:52.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122fa46740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x55641648cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122fa46740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416091550 0x55641648d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122fa46740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416099730 0x5564164aa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122fa46740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5564163d5120 con 0x5564160ba410 2024-09-17T03:47:52.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122fa46740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5564163c4550 con 0x556416091550 2024-09-17T03:47:52.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122fa46740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5564163c8360 con 0x556416099730 2024-09-17T03:47:52.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x55641648cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x55641648cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49154/0 (socket says 172.21.15.146:49154) 2024-09-17T03:47:52.398 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122259c640 1 -- 172.21.15.146:0/1842386320 learned_addr learned my addr 172.21.15.146:0/1842386320 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f1222d9d640 1 --2- 172.21.15.146:0/1842386320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416099730 0x5564164aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f1221d9b640 1 --2- 172.21.15.146:0/1842386320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416091550 0x55641648d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122259c640 1 -- 172.21.15.146:0/1842386320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416099730 msgr2=0x5564164aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122259c640 1 --2- 172.21.15.146:0/1842386320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416099730 0x5564164aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122259c640 1 -- 172.21.15.146:0/1842386320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416091550 msgr2=0x55641648d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122259c640 1 --2- 172.21.15.146:0/1842386320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416091550 0x55641648d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f122259c640 1 -- 172.21.15.146:0/1842386320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564160b6470 con 0x5564160ba410 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.396+0000 7f1221d9b640 1 --2- 172.21.15.146:0/1842386320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416091550 0x55641648d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.397+0000 7f122259c640 1 --2- 172.21.15.146:0/1842386320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x55641648cf10 secure :-1 s=READY pgs=2758 cs=0 l=1 rev1=1 crypto rx=0x7f121400a860 tx=0x7f1214011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a59f5ccc73286 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.397+0000 7f1203fff640 1 -- 172.21.15.146:0/1842386320 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214016b20 con 0x5564160ba410 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.397+0000 7f1203fff640 1 -- 172.21.15.146:0/1842386320 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1214016cc0 con 0x5564160ba410 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.397+0000 7f1203fff640 1 -- 172.21.15.146:0/1842386320 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214003b70 con 0x5564160ba410 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.398+0000 7f122fa46740 1 -- 172.21.15.146:0/1842386320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 msgr2=0x55641648cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.399 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.398+0000 7f122fa46740 1 --2- 172.21.15.146:0/1842386320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x55641648cf10 secure :-1 s=READY pgs=2758 cs=0 l=1 rev1=1 crypto rx=0x7f121400a860 tx=0x7f1214011000 comp rx=0 tx=0).stop 2024-09-17T03:47:52.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.398+0000 7f122fa46740 1 -- 172.21.15.146:0/1842386320 shutdown_connections 2024-09-17T03:47:52.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.398+0000 7f122fa46740 1 --2- 172.21.15.146:0/1842386320 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416099730 0x5564164aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.398+0000 7f122fa46740 1 --2- 172.21.15.146:0/1842386320 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416091550 0x55641648d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.398+0000 7f122fa46740 1 --2- 172.21.15.146:0/1842386320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x55641648cf10 unknown :-1 s=CLOSED pgs=2758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.398+0000 7f122fa46740 1 -- 172.21.15.146:0/1842386320 >> 172.21.15.146:0/1842386320 conn(0x5564160ae560 msgr2=0x5564164631d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.398+0000 7f122fa46740 1 -- 172.21.15.146:0/1842386320 shutdown_connections 2024-09-17T03:47:52.400 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.398+0000 7f122fa46740 1 -- 172.21.15.146:0/1842386320 wait complete. 2024-09-17T03:47:52.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.399+0000 7f122fa46740 1 -- start start 2024-09-17T03:47:52.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.399+0000 7f122fa46740 1 Processor -- start 2024-09-17T03:47:52.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f122fa46740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416091550 0x5564164a30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f122fa46740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416099730 0x5564164b7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f122fa46740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5564160ba410 0x5564164b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f122fa46740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x5564161347c0 con 0x556416091550 2024-09-17T03:47:52.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f122fa46740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556416369890 con 0x556416099730 2024-09-17T03:47:52.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f122fa46740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55641648d990 con 0x5564160ba410 2024-09-17T03:47:52.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f122fa46740 10 client.0 _ll_register_callbacks cb 0x5564163bdce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:52.404 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f122259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416091550 0x5564164a30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f122259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416091550 0x5564164a30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49166/0 (socket says 172.21.15.146:49166) 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f122259c640 1 -- 172.21.15.146:0/3049665035 learned_addr learned my addr 172.21.15.146:0/3049665035 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f1221d9b640 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416099730 0x5564164b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.400+0000 7f1222d9d640 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5564160ba410 0x5564164b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122259c640 1 -- 172.21.15.146:0/3049665035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5564160ba410 msgr2=0x5564164b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122259c640 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5564160ba410 0x5564164b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122259c640 1 -- 172.21.15.146:0/3049665035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416099730 msgr2=0x5564164b7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122259c640 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416099730 0x5564164b7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122259c640 1 -- 172.21.15.146:0/3049665035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55641619a7e0 con 0x556416091550 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122259c640 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416091550 0x5564164a30f0 secure :-1 s=READY pgs=2759 cs=0 l=1 rev1=1 crypto rx=0x7f1214022040 tx=0x7f121400af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60692d293084b3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f12017fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f12017fa640 1 -- 172.21.15.146:0/3049665035 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214030020 con 0x556416091550 2024-09-17T03:47:52.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f12017fa640 1 -- 172.21.15.146:0/3049665035 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f1214003fc0 con 0x556416091550 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122fa46740 1 -- 172.21.15.146:0/3049665035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1214016cc0 con 0x556416091550 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f12017fa640 1 -- 172.21.15.146:0/3049665035 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f121403a050 con 0x556416091550 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122fa46740 10 client.12162 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122fa46740 1 -- 172.21.15.146:0/3049665035 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x5564161faf70 con 0x556416091550 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f12017fa640 1 -- 172.21.15.146:0/3049665035 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1214016cc0 con 0x556416091550 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f12017fa640 1 -- 172.21.15.146:0/3049665035 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f121403d020 con 0x556416091550 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122fa46740 10 client.12162 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122fa46740 10 client.12162 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122fa46740 20 client.12162 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122fa46740 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5564160791f0 0x5564164aa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122fa46740 4 client.12162 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.401+0000 7f122fa46740 1 -- 172.21.15.146:0/3049665035 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564163d7070 con 0x5564160791f0 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.402+0000 7f1221d9b640 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5564160791f0 0x5564164aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.402+0000 7f12017fa640 10 client.12162 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.402+0000 7f1221d9b640 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5564160791f0 0x5564164aa580 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bf8e641d3c8b033 server_cookie=c269a6e6c2f58a09 in_seq=0 out_seq=0 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f12017fa640 1 -- 172.21.15.146:0/3049665035 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564163d7070 con 0x5564160791f0 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f12017fa640 10 client.12162 handle_command_reply: tid=0 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 1 client.12162 shutdown 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 1 -- 172.21.15.146:0/3049665035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416091550 msgr2=0x5564164a30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416091550 0x5564164a30f0 secure :-1 s=READY pgs=2759 cs=0 l=1 rev1=1 crypto rx=0x7f1214022040 tx=0x7f121400af80 comp rx=0 tx=0).stop 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 1 -- 172.21.15.146:0/3049665035 shutdown_connections 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x5564160791f0 0x5564164aa580 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5564160ba410 0x5564164b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416099730 0x5564164b7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 1 --2- 172.21.15.146:0/3049665035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416091550 0x5564164a30f0 unknown :-1 s=CLOSED pgs=2759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f12017fa640 0 client.12162 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 1 -- 172.21.15.146:0/3049665035 >> 172.21.15.146:0/3049665035 conn(0x5564160ae560 msgr2=0x5564164a9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 1 -- 172.21.15.146:0/3049665035 shutdown_connections 2024-09-17T03:47:52.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 1 -- 172.21.15.146:0/3049665035 wait complete. 2024-09-17T03:47:52.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.403+0000 7f122fa46740 20 client.12162 trim_cache size 0 max 16384 2024-09-17T03:47:52.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.421+0000 7f122fa46740 1 Processor -- start 2024-09-17T03:47:52.421 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.421+0000 7f122fa46740 1 -- start start 2024-09-17T03:47:52.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f122fa46740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416091550 0x5564164640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f122fa46740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416099730 0x5564164a3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f122fa46740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x5564164a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.424 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f122fa46740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f1224202340 con 0x5564160ba410 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f122fa46740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f12241f6af0 con 0x556416099730 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f122fa46740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f12241f5e50 con 0x556416091550 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f1222d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x5564164a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f1222d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x5564164a3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49178/0 (socket says 172.21.15.146:49178) 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f1222d9d640 1 -- 172.21.15.146:0/196035874 learned_addr learned my addr 172.21.15.146:0/196035874 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f122259c640 1 --2- 172.21.15.146:0/196035874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416091550 0x5564164640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f1221d9b640 1 --2- 172.21.15.146:0/196035874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416099730 0x5564164a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f1222d9d640 1 -- 172.21.15.146:0/196035874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416091550 msgr2=0x5564164640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.422+0000 7f1222d9d640 1 --2- 172.21.15.146:0/196035874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416091550 0x5564164640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.423+0000 7f1222d9d640 1 -- 172.21.15.146:0/196035874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416099730 msgr2=0x5564164a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.423+0000 7f1222d9d640 1 --2- 172.21.15.146:0/196035874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416099730 0x5564164a3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.423+0000 7f1222d9d640 1 -- 172.21.15.146:0/196035874 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564164aa8f0 con 0x5564160ba410 2024-09-17T03:47:52.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.423+0000 7f122259c640 1 --2- 172.21.15.146:0/196035874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416091550 0x5564164640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:52.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.423+0000 7f1221d9b640 1 --2- 172.21.15.146:0/196035874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416099730 0x5564164a3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:52.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.423+0000 7f1222d9d640 1 --2- 172.21.15.146:0/196035874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x5564164a3d90 secure :-1 s=READY pgs=2760 cs=0 l=1 rev1=1 crypto rx=0x7f121c0804c0 tx=0x7f121c0bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e757d8c8d36e9a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.423+0000 7f12037fe640 1 -- 172.21.15.146:0/196035874 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c048040 con 0x5564160ba410 2024-09-17T03:47:52.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.423+0000 7f12037fe640 1 -- 172.21.15.146:0/196035874 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f121c083250 con 0x5564160ba410 2024-09-17T03:47:52.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.423+0000 7f12037fe640 1 -- 172.21.15.146:0/196035874 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c087c80 con 0x5564160ba410 2024-09-17T03:47:52.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.423+0000 7f122fa46740 1 -- 172.21.15.146:0/196035874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 msgr2=0x5564164a3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.423+0000 7f122fa46740 1 --2- 172.21.15.146:0/196035874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x5564164a3d90 secure :-1 s=READY pgs=2760 cs=0 l=1 rev1=1 crypto rx=0x7f121c0804c0 tx=0x7f121c0bb040 comp rx=0 tx=0).stop 2024-09-17T03:47:52.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.424+0000 7f122fa46740 1 -- 172.21.15.146:0/196035874 shutdown_connections 2024-09-17T03:47:52.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.424+0000 7f122fa46740 1 --2- 172.21.15.146:0/196035874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5564160ba410 0x5564164a3d90 unknown :-1 s=CLOSED pgs=2760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.426 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.424+0000 7f122fa46740 1 --2- 172.21.15.146:0/196035874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x556416099730 0x5564164a3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.424+0000 7f122fa46740 1 --2- 172.21.15.146:0/196035874 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416091550 0x5564164640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.424+0000 7f122fa46740 1 -- 172.21.15.146:0/196035874 >> 172.21.15.146:0/196035874 conn(0x5564160ae560 msgr2=0x556416463060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.424+0000 7f122fa46740 1 -- 172.21.15.146:0/196035874 shutdown_connections 2024-09-17T03:47:52.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.424+0000 7f122fa46740 1 -- 172.21.15.146:0/196035874 wait complete. 2024-09-17T03:47:52.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.424+0000 7f122fa46740 1 -- start start 2024-09-17T03:47:52.427 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.425+0000 7f122fa46740 1 Processor -- start 2024-09-17T03:47:52.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f122fa46740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416091550 0x5564164b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f122fa46740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416099730 0x5564164b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f122fa46740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5564160ba410 0x5564165276f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f122fa46740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f12241f64a0 con 0x556416099730 2024-09-17T03:47:52.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f122fa46740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x556416528610 con 0x5564160ba410 2024-09-17T03:47:52.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f122fa46740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55641648d0e0 con 0x556416091550 2024-09-17T03:47:52.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f122fa46740 10 client.0 _ll_register_callbacks cb 0x7f1218005f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:52.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f1221d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416099730 0x5564164b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f1221d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416099730 0x5564164b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49188/0 (socket says 172.21.15.146:49188) 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f1221d9b640 1 -- 172.21.15.146:0/4251909428 learned_addr learned my addr 172.21.15.146:0/4251909428 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f122259c640 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416091550 0x5564164b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f1222d9d640 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5564160ba410 0x5564165276f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f1221d9b640 1 -- 172.21.15.146:0/4251909428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416091550 msgr2=0x5564164b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f1221d9b640 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416091550 0x5564164b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f1221d9b640 1 -- 172.21.15.146:0/4251909428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5564160ba410 msgr2=0x5564165276f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f1221d9b640 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5564160ba410 0x5564165276f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.426+0000 7f1221d9b640 1 -- 172.21.15.146:0/4251909428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556416103720 con 0x556416099730 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f1221d9b640 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416099730 0x5564164b6890 secure :-1 s=READY pgs=2761 cs=0 l=1 rev1=1 crypto rx=0x7f1218000c00 tx=0x7f121800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd206916e14126d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f12017fa640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f12017fa640 1 -- 172.21.15.146:0/4251909428 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218028060 con 0x556416099730 2024-09-17T03:47:52.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f12017fa640 1 -- 172.21.15.146:0/4251909428 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f1218023440 con 0x556416099730 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f122fa46740 1 -- 172.21.15.146:0/4251909428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f121c083250 con 0x556416099730 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f12017fa640 1 -- 172.21.15.146:0/4251909428 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f121802e050 con 0x556416099730 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f122fa46740 10 client.12168 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f122fa46740 1 -- 172.21.15.146:0/4251909428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x55641648cbb0 con 0x556416099730 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f12017fa640 1 -- 172.21.15.146:0/4251909428 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f121c083250 con 0x556416099730 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f12017fa640 1 -- 172.21.15.146:0/4251909428 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f1218031020 con 0x556416099730 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f122fa46740 10 client.12168 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f122fa46740 10 client.12168 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f122fa46740 20 client.12168 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f122fa46740 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55641647bb50 0x556416527c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f122fa46740 4 client.12168 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-17T03:47:52.433 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f122fa46740 1 -- 172.21.15.146:0/4251909428 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x5564163d2b20 con 0x55641647bb50 2024-09-17T03:47:52.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.427+0000 7f122259c640 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55641647bb50 0x556416527c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.428+0000 7f12017fa640 10 client.12168 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.428+0000 7f122259c640 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55641647bb50 0x556416527c30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c38095134fb4b6 server_cookie=7cf36e61afdbd6be in_seq=0 out_seq=0 2024-09-17T03:47:52.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.428+0000 7f12017fa640 1 -- 172.21.15.146:0/4251909428 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f121402d080 con 0x55641647bb50 2024-09-17T03:47:52.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.428+0000 7f12017fa640 10 client.12168 handle_command_reply: tid=0 2024-09-17T03:47:52.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.428+0000 7f122fa46740 1 client.12168 shutdown 2024-09-17T03:47:52.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122fa46740 1 -- 172.21.15.146:0/4251909428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416099730 msgr2=0x5564164b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122fa46740 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416099730 0x5564164b6890 secure :-1 s=READY pgs=2761 cs=0 l=1 rev1=1 crypto rx=0x7f1218000c00 tx=0x7f121800bdd0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122fa46740 1 -- 172.21.15.146:0/4251909428 shutdown_connections 2024-09-17T03:47:52.434 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122fa46740 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55641647bb50 0x556416527c30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122fa46740 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5564160ba410 0x5564165276f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122fa46740 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556416099730 0x5564164b6890 unknown :-1 s=CLOSED pgs=2761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f12017fa640 0 client.12168 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122fa46740 1 --2- 172.21.15.146:0/4251909428 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x556416091550 0x5564164b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122fa46740 1 -- 172.21.15.146:0/4251909428 >> 172.21.15.146:0/4251909428 conn(0x5564160ae560 msgr2=0x55641645c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122fa46740 1 -- 172.21.15.146:0/4251909428 shutdown_connections 2024-09-17T03:47:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122fa46740 1 -- 172.21.15.146:0/4251909428 wait complete. 2024-09-17T03:47:52.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122fa46740 20 client.12168 trim_cache size 0 max 16384 2024-09-17T03:47:52.437 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:47:52.437 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2024-09-17T03:47:52.437 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "01c5a93d-15da-4ce8-acd6-b56962676bee", 2024-09-17T03:47:52.437 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2024-09-17T03:47:52.438 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122359e640 1 -- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1204078b90 msgr2=0x7f120407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122359e640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1204078b90 0x7f120407b0a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f121400b450 tx=0x7f121400d040 comp rx=0 tx=0).stop 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122359e640 1 -- 172.21.15.146:0/3287969943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122415ff70 msgr2=0x7f1224158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.429+0000 7f122359e640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122415ff70 0x7f1224158490 secure :-1 s=READY pgs=2757 cs=0 l=1 rev1=1 crypto rx=0x7f121c009230 tx=0x7f121c003960 comp rx=0 tx=0).stop 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.430+0000 7f122359e640 1 -- 172.21.15.146:0/3287969943 shutdown_connections 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.430+0000 7f122359e640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f1204078b90 0x7f120407b0a0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.430+0000 7f122359e640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122415ff70 0x7f1224158490 unknown :-1 s=CLOSED pgs=2757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.430+0000 7f122359e640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f122415f620 0x7f12240b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.430+0000 7f122359e640 1 --2- 172.21.15.146:0/3287969943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12240d0e80 0x7f122415d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.430+0000 7f122359e640 1 -- 172.21.15.146:0/3287969943 >> 172.21.15.146:0/3287969943 conn(0x7f12240d1500 msgr2=0x7f122415b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.430+0000 7f122359e640 1 -- 172.21.15.146:0/3287969943 shutdown_connections 2024-09-17T03:47:52.439 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.430+0000 7f122359e640 1 -- 172.21.15.146:0/3287969943 wait complete. 2024-09-17T03:47:52.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:47:52.441 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-17T03:47:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.556+0000 7f6d07913640 1 -- 172.21.15.146:0/3994794810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d000cfbe0 msgr2=0x7f6d0015b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.556+0000 7f6d07913640 1 --2- 172.21.15.146:0/3994794810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d000cfbe0 0x7f6d0015b1a0 secure :-1 s=READY pgs=2762 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc005fd0 tx=0x7f6cfc02b880 comp rx=0 tx=0).stop 2024-09-17T03:47:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.556+0000 7f6d07913640 1 -- 172.21.15.146:0/3994794810 shutdown_connections 2024-09-17T03:47:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.556+0000 7f6d07913640 1 --2- 172.21.15.146:0/3994794810 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d000cd5d0 0x7f6d000cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.558 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.556+0000 7f6d07913640 1 --2- 172.21.15.146:0/3994794810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d000cfbe0 0x7f6d0015b1a0 unknown :-1 s=CLOSED pgs=2762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.556+0000 7f6d07913640 1 -- 172.21.15.146:0/3994794810 >> 172.21.15.146:0/3994794810 conn(0x7f6d000b2790 msgr2=0x7f6d000d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.556+0000 7f6d07913640 1 -- 172.21.15.146:0/3994794810 shutdown_connections 2024-09-17T03:47:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.556+0000 7f6d07913640 1 -- 172.21.15.146:0/3994794810 wait complete. 2024-09-17T03:47:52.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.558+0000 7f6d07913640 1 Processor -- start 2024-09-17T03:47:52.561 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.558+0000 7f6d07913640 1 -- start start 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.559+0000 7f6d07913640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d0006e340 0x7f6d001f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.559+0000 7f6d07913640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d000cfbe0 0x7f6d001e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.559+0000 7f6d07913640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d00154ea0 0x7f6d001f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.559+0000 7f6d07913640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d000d0d60 con 0x7f6d000cfbe0 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.559+0000 7f6d07913640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d000d0be0 con 0x7f6d00154ea0 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.559+0000 7f6d07913640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6d000d0ee0 con 0x7f6d0006e340 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d04eae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d000cfbe0 0x7f6d001e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d04eae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d000cfbe0 0x7f6d001e60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49210/0 (socket says 172.21.15.146:49210) 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d04eae640 1 -- 172.21.15.146:0/3201200747 learned_addr learned my addr 172.21.15.146:0/3201200747 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d05eb0640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d00154ea0 0x7f6d001f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d056af640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d0006e340 0x7f6d001f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d04eae640 1 -- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d0006e340 msgr2=0x7f6d001f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.562 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d04eae640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d0006e340 0x7f6d001f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d04eae640 1 -- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d00154ea0 msgr2=0x7f6d001f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d04eae640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d00154ea0 0x7f6d001f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d04eae640 1 -- 172.21.15.146:0/3201200747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d001574c0 con 0x7f6d000cfbe0 2024-09-17T03:47:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d04eae640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d000cfbe0 0x7f6d001e60f0 secure :-1 s=READY pgs=2763 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000c3d0 tx=0x7f6cf000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6cf5ffb640 1 -- 172.21.15.146:0/3201200747 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0017070 con 0x7f6d000cfbe0 2024-09-17T03:47:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6cf5ffb640 1 -- 172.21.15.146:0/3201200747 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf00053c0 con 0x7f6d000cfbe0 2024-09-17T03:47:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d07913640 1 -- 172.21.15.146:0/3201200747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d00157790 con 0x7f6d000cfbe0 2024-09-17T03:47:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6cf5ffb640 1 -- 172.21.15.146:0/3201200747 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0003850 con 0x7f6d000cfbe0 2024-09-17T03:47:52.563 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.560+0000 7f6d07913640 1 -- 172.21.15.146:0/3201200747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d00157d50 con 0x7f6d000cfbe0 2024-09-17T03:47:52.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.562+0000 7f6cf5ffb640 1 -- 172.21.15.146:0/3201200747 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6cf001a070 con 0x7f6d000cfbe0 2024-09-17T03:47:52.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.563+0000 7f6cf5ffb640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ce4078b90 0x7f6ce407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.564 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.563+0000 7f6cf5ffb640 1 -- 172.21.15.146:0/3201200747 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f6cf009a040 con 0x7f6d000cfbe0 2024-09-17T03:47:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.563+0000 7f6d056af640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ce4078b90 0x7f6ce407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.563+0000 7f6d056af640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ce4078b90 0x7f6ce407b0a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc035000 tx=0x7f6cfc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.563+0000 7f6d0e87f740 1 Processor -- start 2024-09-17T03:47:52.565 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.564+0000 7f6d0e87f740 1 -- start start 2024-09-17T03:47:52.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baecb7390 0x562baf0a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec8e4d0 0x562baf07aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec966b0 0x562baf07afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562baefd1a60 con 0x562baec966b0 2024-09-17T03:47:52.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562baefc0e90 con 0x562baec8e4d0 2024-09-17T03:47:52.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562baefc4ca0 con 0x562baecb7390 2024-09-17T03:47:52.568 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d05eb0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec966b0 0x562baf07afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d05eb0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec966b0 0x562baf07afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49226/0 (socket says 172.21.15.146:49226) 2024-09-17T03:47:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d05eb0640 1 -- 172.21.15.146:0/3731043079 learned_addr learned my addr 172.21.15.146:0/3731043079 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d04eae640 1 --2- 172.21.15.146:0/3731043079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec8e4d0 0x562baf07aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d056af640 1 --2- 172.21.15.146:0/3731043079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baecb7390 0x562baf0a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d05eb0640 1 -- 172.21.15.146:0/3731043079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baecb7390 msgr2=0x562baf0a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d05eb0640 1 --2- 172.21.15.146:0/3731043079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baecb7390 0x562baf0a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d05eb0640 1 -- 172.21.15.146:0/3731043079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec8e4d0 msgr2=0x562baf07aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d05eb0640 1 --2- 172.21.15.146:0/3731043079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec8e4d0 0x562baf07aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d05eb0640 1 -- 172.21.15.146:0/3731043079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562baed997d0 con 0x562baec966b0 2024-09-17T03:47:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d056af640 1 --2- 172.21.15.146:0/3731043079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baecb7390 0x562baf0a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:52.569 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.565+0000 7f6d05eb0640 1 --2- 172.21.15.146:0/3731043079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec966b0 0x562baf07afb0 secure :-1 s=READY pgs=2764 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009f20 tx=0x7f6cf8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f818458022b040f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6ceaffd640 1 -- 172.21.15.146:0/3731043079 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8016070 con 0x562baec966b0 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6ceaffd640 1 -- 172.21.15.146:0/3731043079 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf8004e10 con 0x562baec966b0 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6ceaffd640 1 -- 172.21.15.146:0/3731043079 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8005260 con 0x562baec966b0 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6d0e87f740 1 -- 172.21.15.146:0/3731043079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec966b0 msgr2=0x562baf07afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/3731043079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec966b0 0x562baf07afb0 secure :-1 s=READY pgs=2764 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009f20 tx=0x7f6cf8010800 comp rx=0 tx=0).stop 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6d0e87f740 1 -- 172.21.15.146:0/3731043079 shutdown_connections 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/3731043079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec966b0 0x562baf07afb0 unknown :-1 s=CLOSED pgs=2764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/3731043079 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec8e4d0 0x562baf07aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/3731043079 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baecb7390 0x562baf0a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6d0e87f740 1 -- 172.21.15.146:0/3731043079 >> 172.21.15.146:0/3731043079 conn(0x562baecab4e0 msgr2=0x562baf060f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6d0e87f740 1 -- 172.21.15.146:0/3731043079 shutdown_connections 2024-09-17T03:47:52.570 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.566+0000 7f6d0e87f740 1 -- 172.21.15.146:0/3731043079 wait complete. 2024-09-17T03:47:52.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.567+0000 7f6d0e87f740 1 -- start start 2024-09-17T03:47:52.571 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.567+0000 7f6d0e87f740 1 Processor -- start 2024-09-17T03:47:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec8e4d0 0x562baf09b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec966b0 0x562baf0a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baecb7390 0x562baf0b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562baed31740 con 0x562baecb7390 2024-09-17T03:47:52.575 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x562baef66970 con 0x562baec966b0 2024-09-17T03:47:52.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562baf0a24c0 con 0x562baec8e4d0 2024-09-17T03:47:52.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d0e87f740 10 client.0 _ll_register_callbacks cb 0x562baef75780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:52.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d05eb0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baecb7390 0x562baf0b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d05eb0640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baecb7390 0x562baf0b7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49234/0 (socket says 172.21.15.146:49234) 2024-09-17T03:47:52.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d05eb0640 1 -- 172.21.15.146:0/1164164976 learned_addr learned my addr 172.21.15.146:0/1164164976 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d04eae640 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec966b0 0x562baf0a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d056af640 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec8e4d0 0x562baf09b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d05eb0640 1 -- 172.21.15.146:0/1164164976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec8e4d0 msgr2=0x562baf09b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d05eb0640 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec8e4d0 0x562baf09b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.576 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d05eb0640 1 -- 172.21.15.146:0/1164164976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec966b0 msgr2=0x562baf0a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d05eb0640 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec966b0 0x562baf0a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d05eb0640 1 -- 172.21.15.146:0/1164164976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562baed22970 con 0x562baecb7390 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d056af640 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec8e4d0 0x562baf09b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d04eae640 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec966b0 0x562baf0a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6d05eb0640 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baecb7390 0x562baf0b7fe0 secure :-1 s=READY pgs=2765 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80049a0 tx=0x7f6cf8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406dc54ecbb37ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.569+0000 7f6cdffff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6cdffff640 1 -- 172.21.15.146:0/1164164976 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8029060 con 0x562baecb7390 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6cdffff640 1 -- 172.21.15.146:0/1164164976 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f6cf8012760 con 0x562baecb7390 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6d0e87f740 1 -- 172.21.15.146:0/1164164976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf8004e10 con 0x562baecb7390 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6cdffff640 1 -- 172.21.15.146:0/1164164976 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f6cf802f050 con 0x562baecb7390 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6d0e87f740 10 client.12180 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6d0e87f740 1 -- 172.21.15.146:0/1164164976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x562baed006a0 con 0x562baecb7390 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6cdffff640 1 -- 172.21.15.146:0/1164164976 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf8004e10 con 0x562baecb7390 2024-09-17T03:47:52.577 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6cdffff640 1 -- 172.21.15.146:0/1164164976 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f6cf8032020 con 0x562baecb7390 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6d0e87f740 10 client.12180 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6d0e87f740 10 client.12180 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6d0e87f740 20 client.12180 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x562baec75f60 0x562baf09ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6d0e87f740 4 client.12180 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6d0e87f740 1 -- 172.21.15.146:0/1164164976 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562baefd39b0 con 0x562baec75f60 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.570+0000 7f6d056af640 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x562baec75f60 0x562baf09ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.571+0000 7f6cdffff640 10 client.12180 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.571+0000 7f6d056af640 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x562baec75f60 0x562baf09ed80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca4d47e30623509e server_cookie=f0c578b825ded64b in_seq=0 out_seq=0 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.571+0000 7f6cdffff640 1 -- 172.21.15.146:0/1164164976 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562baefd39b0 con 0x562baec75f60 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.571+0000 7f6cdffff640 10 client.12180 handle_command_reply: tid=0 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.571+0000 7f6d0e87f740 1 client.12180 shutdown 2024-09-17T03:47:52.578 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6d0e87f740 1 -- 172.21.15.146:0/1164164976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baecb7390 msgr2=0x562baf0b7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baecb7390 0x562baf0b7fe0 secure :-1 s=READY pgs=2765 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80049a0 tx=0x7f6cf8004c80 comp rx=0 tx=0).stop 2024-09-17T03:47:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6d0e87f740 1 -- 172.21.15.146:0/1164164976 shutdown_connections 2024-09-17T03:47:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x562baec75f60 0x562baf09ed80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6cdffff640 0 client.12180 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baecb7390 0x562baf0b7fe0 unknown :-1 s=CLOSED pgs=2765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec966b0 0x562baf0a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/1164164976 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec8e4d0 0x562baf09b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6d0e87f740 1 -- 172.21.15.146:0/1164164976 >> 172.21.15.146:0/1164164976 conn(0x562baecab4e0 msgr2=0x562baf0a4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6d0e87f740 1 -- 172.21.15.146:0/1164164976 shutdown_connections 2024-09-17T03:47:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6d0e87f740 1 -- 172.21.15.146:0/1164164976 wait complete. 2024-09-17T03:47:52.579 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.572+0000 7f6d0e87f740 20 client.12180 trim_cache size 0 max 16384 2024-09-17T03:47:52.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.589+0000 7f6d0e87f740 1 Processor -- start 2024-09-17T03:47:52.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.589+0000 7f6d0e87f740 1 -- start start 2024-09-17T03:47:52.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.590+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec75f60 0x562baf09d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.590+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf060980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.590+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec966b0 0x562baf060ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.598 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.590+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001fe100 con 0x562baec8e4d0 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.590+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001f2890 con 0x562baec75f60 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.590+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6d001f1bf0 con 0x562baec966b0 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6d04eae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf060980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6d04eae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf060980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49250/0 (socket says 172.21.15.146:49250) 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6d04eae640 1 -- 172.21.15.146:0/2577363961 learned_addr learned my addr 172.21.15.146:0/2577363961 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6d056af640 1 --2- 172.21.15.146:0/2577363961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec75f60 0x562baf09d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6d05eb0640 1 --2- 172.21.15.146:0/2577363961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec966b0 0x562baf060ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6d04eae640 1 -- 172.21.15.146:0/2577363961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec966b0 msgr2=0x562baf060ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6d04eae640 1 --2- 172.21.15.146:0/2577363961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec966b0 0x562baf060ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6d04eae640 1 -- 172.21.15.146:0/2577363961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec75f60 msgr2=0x562baf09d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6d04eae640 1 --2- 172.21.15.146:0/2577363961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec75f60 0x562baf09d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6d04eae640 1 -- 172.21.15.146:0/2577363961 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562baefc7140 con 0x562baec8e4d0 2024-09-17T03:47:52.599 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6d04eae640 1 --2- 172.21.15.146:0/2577363961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf060980 secure :-1 s=READY pgs=2766 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0061df0 tx=0x7f6cf0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcb4ac6c40af6ee server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6cea7fc640 1 -- 172.21.15.146:0/2577363961 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf006b7d0 con 0x562baec8e4d0 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6cea7fc640 1 -- 172.21.15.146:0/2577363961 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf007c070 con 0x562baec8e4d0 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.591+0000 7f6cea7fc640 1 -- 172.21.15.146:0/2577363961 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00612c0 con 0x562baec8e4d0 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.592+0000 7f6d0e87f740 1 -- 172.21.15.146:0/2577363961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 msgr2=0x562baf060980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.592+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/2577363961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf060980 secure :-1 s=READY pgs=2766 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0061df0 tx=0x7f6cf0000bc0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.592+0000 7f6d0e87f740 1 -- 172.21.15.146:0/2577363961 shutdown_connections 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.592+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/2577363961 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec966b0 0x562baf060ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.592+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/2577363961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf060980 unknown :-1 s=CLOSED pgs=2766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.592+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/2577363961 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec75f60 0x562baf09d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.592+0000 7f6d0e87f740 1 -- 172.21.15.146:0/2577363961 >> 172.21.15.146:0/2577363961 conn(0x562baecab4e0 msgr2=0x562baf0b7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.592+0000 7f6d0e87f740 1 -- 172.21.15.146:0/2577363961 shutdown_connections 2024-09-17T03:47:52.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.592+0000 7f6d0e87f740 1 -- 172.21.15.146:0/2577363961 wait complete. 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.593+0000 7f6d0e87f740 1 -- start start 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.593+0000 7f6d0e87f740 1 Processor -- start 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.594+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec75f60 0x562baf07a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.594+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf118170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.594+0000 7f6d0e87f740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec966b0 0x562baf09eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.594+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x562baf0546a0 con 0x562baec8e4d0 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.594+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d001f2240 con 0x562baec75f60 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.594+0000 7f6d0e87f740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x562baf11cae0 con 0x562baec966b0 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.594+0000 7f6d0e87f740 10 client.0 _ll_register_callbacks cb 0x7f6cfc00a890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.594+0000 7f6d04eae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf118170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.594+0000 7f6d04eae640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf118170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49254/0 (socket says 172.21.15.146:49254) 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.594+0000 7f6d04eae640 1 -- 172.21.15.146:0/678921140 learned_addr learned my addr 172.21.15.146:0/678921140 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:47:52.601 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d056af640 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec75f60 0x562baf07a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d05eb0640 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec966b0 0x562baf09eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d04eae640 1 -- 172.21.15.146:0/678921140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec966b0 msgr2=0x562baf09eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d04eae640 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec966b0 0x562baf09eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d04eae640 1 -- 172.21.15.146:0/678921140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec75f60 msgr2=0x562baf07a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d04eae640 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec75f60 0x562baf07a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d04eae640 1 -- 172.21.15.146:0/678921140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562baf0b23b0 con 0x562baec8e4d0 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d05eb0640 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec966b0 0x562baf09eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d056af640 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec75f60 0x562baf07a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d04eae640 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf118170 secure :-1 s=READY pgs=2767 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000cd90 tx=0x7f6cf005e300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695d5bb33aeacf10 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6cdffff640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6cdffff640 1 -- 172.21.15.146:0/678921140 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf006b7d0 con 0x562baec8e4d0 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6cdffff640 1 -- 172.21.15.146:0/678921140 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f6cf0084080 con 0x562baec8e4d0 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d0e87f740 1 -- 172.21.15.146:0/678921140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf007c070 con 0x562baec8e4d0 2024-09-17T03:47:52.602 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6cdffff640 1 -- 172.21.15.146:0/678921140 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f6cf0084280 con 0x562baec8e4d0 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d0e87f740 10 client.12186 fetch_fsmap learned FSMap version 169 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d0e87f740 1 -- 172.21.15.146:0/678921140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x562baf1186b0 con 0x562baec8e4d0 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6cdffff640 1 -- 172.21.15.146:0/678921140 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf007c070 con 0x562baec8e4d0 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6cdffff640 1 -- 172.21.15.146:0/678921140 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f6cf005d7b0 con 0x562baec8e4d0 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d0e87f740 10 client.12186 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d0e87f740 10 client.12186 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d0e87f740 20 client.12186 populate_metadata read hostname 'smithi146' 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x562baec4b3a0 0x562baf09f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d0e87f740 4 client.12186 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.595+0000 7f6d0e87f740 1 -- 172.21.15.146:0/678921140 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562baefcf460 con 0x562baec4b3a0 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6d056af640 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x562baec4b3a0 0x562baf09f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6cdffff640 10 client.12186 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6d056af640 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x562baec4b3a0 0x562baf09f080 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e786153b89a35552 server_cookie=59e6c4a293556149 in_seq=0 out_seq=0 2024-09-17T03:47:52.603 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6cdffff640 1 -- 172.21.15.146:0/678921140 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+855 (crc 0 0 0) 0x562baefcf460 con 0x562baec4b3a0 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6cdffff640 10 client.12186 handle_command_reply: tid=0 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6d0e87f740 1 client.12186 shutdown 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6d0e87f740 1 -- 172.21.15.146:0/678921140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 msgr2=0x562baf118170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf118170 secure :-1 s=READY pgs=2767 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000cd90 tx=0x7f6cf005e300 comp rx=0 tx=0).stop 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6d0e87f740 1 -- 172.21.15.146:0/678921140 shutdown_connections 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x562baec4b3a0 0x562baf09f080 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x562baec966b0 0x562baf09eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6cdffff640 0 client.12186 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562baec8e4d0 0x562baf118170 unknown :-1 s=CLOSED pgs=2767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6d0e87f740 1 --2- 172.21.15.146:0/678921140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x562baec75f60 0x562baf07a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.596+0000 7f6d0e87f740 1 -- 172.21.15.146:0/678921140 >> 172.21.15.146:0/678921140 conn(0x562baecab4e0 msgr2=0x562baf09e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d0e87f740 1 -- 172.21.15.146:0/678921140 shutdown_connections 2024-09-17T03:47:52.604 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d0e87f740 1 -- 172.21.15.146:0/678921140 wait complete. 2024-09-17T03:47:52.605 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d0e87f740 20 client.12186 trim_cache size 0 max 16384 2024-09-17T03:47:52.605 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:47:52.605 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:47:52.605 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2024-09-17T03:47:52.605 INFO:teuthology.orchestra.run.smithi146.stdout: "01c5a93d-15da-4ce8-acd6-b56962676bee": { 2024-09-17T03:47:52.605 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:47:52.605 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "01c5a93d-15da-4ce8-acd6-b56962676bee", 2024-09-17T03:47:52.605 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive,repair" 2024-09-17T03:47:52.605 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: "01c5a93d-15da-4ce8-acd6-b56962676bee": { 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:47:52.428939+0000", 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: "8b50f951-7502-494d-9c08-8017d1b9f231": { 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:47:27.757320+0000", 2024-09-17T03:47:52.606 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:47:52.607 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:47:52.607 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:47:52.607 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:47:52.607 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:47:52.607 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:52.607 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:47:52.607 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:47:52.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 -- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ce4078b90 msgr2=0x7f6ce407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.608 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ce4078b90 0x7f6ce407b0a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc035000 tx=0x7f6cfc004730 comp rx=0 tx=0).stop 2024-09-17T03:47:52.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 -- 172.21.15.146:0/3201200747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d000cfbe0 msgr2=0x7f6d001e60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:47:52.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d000cfbe0 0x7f6d001e60f0 secure :-1 s=READY pgs=2763 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000c3d0 tx=0x7f6cf000c890 comp rx=0 tx=0).stop 2024-09-17T03:47:52.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 -- 172.21.15.146:0/3201200747 shutdown_connections 2024-09-17T03:47:52.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6ce4078b90 0x7f6ce407b0a0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d00154ea0 0x7f6d001f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d000cfbe0 0x7f6d001e60f0 unknown :-1 s=CLOSED pgs=2763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 --2- 172.21.15.146:0/3201200747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d0006e340 0x7f6d001f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:47:52.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 -- 172.21.15.146:0/3201200747 >> 172.21.15.146:0/3201200747 conn(0x7f6d000b2790 msgr2=0x7f6d000cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:47:52.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 -- 172.21.15.146:0/3201200747 shutdown_connections 2024-09-17T03:47:52.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:47:52.597+0000 7f6d07913640 1 -- 172.21.15.146:0/3201200747 wait complete. 2024-09-17T03:47:52.609 INFO:tasks.cephfs.filesystem:scrub status for tag:01c5a93d-15da-4ce8-acd6-b56962676bee - {'path': '/', 'tag': '01c5a93d-15da-4ce8-acd6-b56962676bee', 'options': 'recursive,repair'} 2024-09-17T03:48:00.500 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:48:00.503 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:48:22.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:22.611 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-17T03:48:22.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.741+0000 7fe19bed5640 1 -- 172.21.15.146:0/2214604089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19415a5c0 msgr2=0x7fe19415d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.741+0000 7fe19bed5640 1 --2- 172.21.15.146:0/2214604089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19415a5c0 0x7fe19415d820 secure :-1 s=READY pgs=2769 cs=0 l=1 rev1=1 crypto rx=0x7fe190005fd0 tx=0x7fe19002a820 comp rx=0 tx=0).stop 2024-09-17T03:48:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.741+0000 7fe19bed5640 1 -- 172.21.15.146:0/2214604089 shutdown_connections 2024-09-17T03:48:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.741+0000 7fe19bed5640 1 --2- 172.21.15.146:0/2214604089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19415a5c0 0x7fe19415d820 unknown :-1 s=CLOSED pgs=2769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.741+0000 7fe19bed5640 1 -- 172.21.15.146:0/2214604089 >> 172.21.15.146:0/2214604089 conn(0x7fe1940b2ae0 msgr2=0x7fe1940b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.741+0000 7fe19bed5640 1 -- 172.21.15.146:0/2214604089 shutdown_connections 2024-09-17T03:48:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.741+0000 7fe19bed5640 1 -- 172.21.15.146:0/2214604089 wait complete. 2024-09-17T03:48:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.743+0000 7fe19bed5640 1 Processor -- start 2024-09-17T03:48:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.743+0000 7fe19bed5640 1 -- start start 2024-09-17T03:48:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.744+0000 7fe19bed5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe194074620 0x7fe1941f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.744+0000 7fe19bed5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19415a5c0 0x7fe19414d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.744+0000 7fe19bed5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1940ccd00 0x7fe1940cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.744+0000 7fe19bed5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe194074a30 con 0x7fe19415a5c0 2024-09-17T03:48:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.744+0000 7fe19bed5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe194073690 con 0x7fe194074620 2024-09-17T03:48:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.744+0000 7fe19bed5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe194074bb0 con 0x7fe1940ccd00 2024-09-17T03:48:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.744+0000 7fe199470640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19415a5c0 0x7fe19414d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.744+0000 7fe199470640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19415a5c0 0x7fe19414d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51992/0 (socket says 172.21.15.146:51992) 2024-09-17T03:48:22.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.744+0000 7fe199470640 1 -- 172.21.15.146:0/1846668489 learned_addr learned my addr 172.21.15.146:0/1846668489 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe199c71640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe194074620 0x7fe1941f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe19a472640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1940ccd00 0x7fe1940cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe199470640 1 -- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1940ccd00 msgr2=0x7fe1940cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe199470640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1940ccd00 0x7fe1940cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe199470640 1 -- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe194074620 msgr2=0x7fe1941f5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe199470640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe194074620 0x7fe1941f5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe199470640 1 -- 172.21.15.146:0/1846668489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1941f6300 con 0x7fe19415a5c0 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe199470640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19415a5c0 0x7fe19414d560 secure :-1 s=READY pgs=2770 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c3a0 tx=0x7fe18400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe18a7fc640 1 -- 172.21.15.146:0/1846668489 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184017070 con 0x7fe19415a5c0 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe18a7fc640 1 -- 172.21.15.146:0/1846668489 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1840053c0 con 0x7fe19415a5c0 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe19bed5640 1 -- 172.21.15.146:0/1846668489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1940cd650 con 0x7fe19415a5c0 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe18a7fc640 1 -- 172.21.15.146:0/1846668489 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe184003850 con 0x7fe19415a5c0 2024-09-17T03:48:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.745+0000 7fe19bed5640 1 -- 172.21.15.146:0/1846668489 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1941504d0 con 0x7fe19415a5c0 2024-09-17T03:48:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.747+0000 7fe18a7fc640 1 -- 172.21.15.146:0/1846668489 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe18401a070 con 0x7fe19415a5c0 2024-09-17T03:48:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.748+0000 7fe18a7fc640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe178078b90 0x7fe17807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.748+0000 7fe18a7fc640 1 -- 172.21.15.146:0/1846668489 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7fe18409a210 con 0x7fe19415a5c0 2024-09-17T03:48:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.748+0000 7fe199c71640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe178078b90 0x7fe17807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.749+0000 7fe1a2e3d740 1 Processor -- start 2024-09-17T03:48:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.749+0000 7fe199c71640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe178078b90 0x7fe17807b0a0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fe190034000 tx=0x7fe190004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.749+0000 7fe1a2e3d740 1 -- start start 2024-09-17T03:48:22.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.750+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c33390 0x55c39a01fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.759 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.750+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c0a4d0 0x55c399ff4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.750+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.750+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c399f4da60 con 0x55c399c126b0 2024-09-17T03:48:22.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.750+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c399f3ce90 con 0x55c399c0a4d0 2024-09-17T03:48:22.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.750+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c399f40ca0 con 0x55c399c33390 2024-09-17T03:48:22.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe19a472640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe19a472640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51998/0 (socket says 172.21.15.146:51998) 2024-09-17T03:48:22.760 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe19a472640 1 -- 172.21.15.146:0/2616039466 learned_addr learned my addr 172.21.15.146:0/2616039466 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe199470640 1 --2- 172.21.15.146:0/2616039466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c0a4d0 0x55c399ff4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe199c71640 1 --2- 172.21.15.146:0/2616039466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c33390 0x55c39a01fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe19a472640 1 -- 172.21.15.146:0/2616039466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c33390 msgr2=0x55c39a01fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe19a472640 1 --2- 172.21.15.146:0/2616039466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c33390 0x55c39a01fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe19a472640 1 -- 172.21.15.146:0/2616039466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c0a4d0 msgr2=0x55c399ff4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe19a472640 1 --2- 172.21.15.146:0/2616039466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c0a4d0 0x55c399ff4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe19a472640 1 -- 172.21.15.146:0/2616039466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c399d157d0 con 0x55c399c126b0 2024-09-17T03:48:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe199470640 1 --2- 172.21.15.146:0/2616039466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c0a4d0 0x55c399ff4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:48:22.761 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe19a472640 1 --2- 172.21.15.146:0/2616039466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff4da0 secure :-1 s=READY pgs=2771 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0017d0 tx=0x7fe18c001c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a630598ccb947b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe1777fe640 1 -- 172.21.15.146:0/2616039466 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c018020 con 0x55c399c126b0 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe1777fe640 1 -- 172.21.15.146:0/2616039466 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe18c00fab0 con 0x55c399c126b0 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.751+0000 7fe1777fe640 1 -- 172.21.15.146:0/2616039466 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c00fe60 con 0x55c399c126b0 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.752+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2616039466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 msgr2=0x55c399ff4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.752+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/2616039466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff4da0 secure :-1 s=READY pgs=2771 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0017d0 tx=0x7fe18c001c90 comp rx=0 tx=0).stop 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.752+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2616039466 shutdown_connections 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.752+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/2616039466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff4da0 unknown :-1 s=CLOSED pgs=2771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.752+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/2616039466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c0a4d0 0x55c399ff4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.752+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/2616039466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c33390 0x55c39a01fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.752+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2616039466 >> 172.21.15.146:0/2616039466 conn(0x55c399c274e0 msgr2=0x55c399fdad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.752+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2616039466 shutdown_connections 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.752+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2616039466 wait complete. 2024-09-17T03:48:22.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.753+0000 7fe1a2e3d740 1 -- start start 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.753+0000 7fe1a2e3d740 1 Processor -- start 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c0a4d0 0x55c39a015ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a01b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c33390 0x55c39a01be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55c399cad740 con 0x55c399c126b0 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c399ee2970 con 0x55c399c33390 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c39a002f80 con 0x55c399c0a4d0 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe1a2e3d740 10 client.0 _ll_register_callbacks cb 0x55c399ef1780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe199470640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a01b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe199470640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a01b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52014/0 (socket says 172.21.15.146:52014) 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe199470640 1 -- 172.21.15.146:0/2679571778 learned_addr learned my addr 172.21.15.146:0/2679571778 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe199c71640 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c0a4d0 0x55c39a015ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe19a472640 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c33390 0x55c39a01be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe199470640 1 -- 172.21.15.146:0/2679571778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c0a4d0 msgr2=0x55c39a015ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe199470640 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c0a4d0 0x55c39a015ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe199470640 1 -- 172.21.15.146:0/2679571778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c33390 msgr2=0x55c39a01be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe199470640 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c33390 0x55c39a01be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe199470640 1 -- 172.21.15.146:0/2679571778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c399c9e970 con 0x55c399c126b0 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe199470640 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a01b8f0 secure :-1 s=READY pgs=2772 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c370 tx=0x7fe184061890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7847200f29f8f69a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.755+0000 7fe174ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe174ff9640 1 -- 172.21.15.146:0/2679571778 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1840668b0 con 0x55c399c126b0 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe174ff9640 1 -- 172.21.15.146:0/2679571778 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7fe184088170 con 0x55c399c126b0 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2679571778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe18c00fab0 con 0x55c399c126b0 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe174ff9640 1 -- 172.21.15.146:0/2679571778 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7fe18407c120 con 0x55c399c126b0 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe1a2e3d740 10 client.12201 fetch_fsmap learned FSMap version 169 2024-09-17T03:48:22.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2679571778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x55c399c7c6a0 con 0x55c399c126b0 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe174ff9640 1 -- 172.21.15.146:0/2679571778 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe18c00fab0 con 0x55c399c126b0 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe174ff9640 1 -- 172.21.15.146:0/2679571778 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7fe184082ce0 con 0x55c399c126b0 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe1a2e3d740 10 client.12201 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe1a2e3d740 10 client.12201 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe1a2e3d740 20 client.12201 populate_metadata read hostname 'smithi146' 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55c399bf1f60 0x55c39a001cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe1a2e3d740 4 client.12201 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2679571778 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c399f4f9b0 con 0x55c399bf1f60 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe199c71640 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55c399bf1f60 0x55c39a001cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.756+0000 7fe174ff9640 10 client.12201 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe199c71640 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55c399bf1f60 0x55c39a001cb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f491ccf24e09229a server_cookie=8640ca3b76393cf4 in_seq=0 out_seq=0 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe174ff9640 1 -- 172.21.15.146:0/2679571778 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c399f4f9b0 con 0x55c399bf1f60 2024-09-17T03:48:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe174ff9640 10 client.12201 handle_command_reply: tid=0 2024-09-17T03:48:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe1a2e3d740 1 client.12201 shutdown 2024-09-17T03:48:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2679571778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 msgr2=0x55c39a01b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a01b8f0 secure :-1 s=READY pgs=2772 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c370 tx=0x7fe184061890 comp rx=0 tx=0).stop 2024-09-17T03:48:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2679571778 shutdown_connections 2024-09-17T03:48:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55c399bf1f60 0x55c39a001cb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c33390 0x55c39a01be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a01b8f0 unknown :-1 s=CLOSED pgs=2772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe174ff9640 0 client.12201 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:48:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/2679571778 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c0a4d0 0x55c39a015ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.757+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2679571778 >> 172.21.15.146:0/2679571778 conn(0x55c399c274e0 msgr2=0x55c39a01d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.758+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2679571778 shutdown_connections 2024-09-17T03:48:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.758+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/2679571778 wait complete. 2024-09-17T03:48:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.758+0000 7fe1a2e3d740 20 client.12201 trim_cache size 0 max 16384 2024-09-17T03:48:22.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.775+0000 7fe1a2e3d740 1 Processor -- start 2024-09-17T03:48:22.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.775+0000 7fe1a2e3d740 1 -- start start 2024-09-17T03:48:22.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.776+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c0a4d0 0x55c39a002790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.776+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.776+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c33390 0x55c39a016e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.776+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe194202540 con 0x55c399c126b0 2024-09-17T03:48:22.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.776+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe1941f91c0 con 0x55c399c0a4d0 2024-09-17T03:48:22.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.776+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe1940c6e50 con 0x55c399c33390 2024-09-17T03:48:22.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe199470640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe199470640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52018/0 (socket says 172.21.15.146:52018) 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe199470640 1 -- 172.21.15.146:0/1273767443 learned_addr learned my addr 172.21.15.146:0/1273767443 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe199c71640 1 --2- 172.21.15.146:0/1273767443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c0a4d0 0x55c39a002790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe19a472640 1 --2- 172.21.15.146:0/1273767443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c33390 0x55c39a016e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe199470640 1 -- 172.21.15.146:0/1273767443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c33390 msgr2=0x55c39a016e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe199470640 1 --2- 172.21.15.146:0/1273767443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c33390 0x55c39a016e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe199470640 1 -- 172.21.15.146:0/1273767443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c0a4d0 msgr2=0x55c39a002790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe199470640 1 --2- 172.21.15.146:0/1273767443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c0a4d0 0x55c39a002790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe199470640 1 -- 172.21.15.146:0/1273767443 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39a020d80 con 0x55c399c126b0 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe199470640 1 --2- 172.21.15.146:0/1273767443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff48a0 secure :-1 s=READY pgs=2773 cs=0 l=1 rev1=1 crypto rx=0x7fe184000fd0 tx=0x7fe18405ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba261fb9515ab70 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe176ffd640 1 -- 172.21.15.146:0/1273767443 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1840668b0 con 0x55c399c126b0 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe176ffd640 1 -- 172.21.15.146:0/1273767443 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1840842d0 con 0x55c399c126b0 2024-09-17T03:48:22.779 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.777+0000 7fe176ffd640 1 -- 172.21.15.146:0/1273767443 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18405e4d0 con 0x55c399c126b0 2024-09-17T03:48:22.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.778+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1273767443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 msgr2=0x55c399ff48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:22.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.778+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/1273767443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff48a0 secure :-1 s=READY pgs=2773 cs=0 l=1 rev1=1 crypto rx=0x7fe184000fd0 tx=0x7fe18405ddd0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.778+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1273767443 shutdown_connections 2024-09-17T03:48:22.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.778+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/1273767443 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c33390 0x55c39a016e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.778+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/1273767443 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c399ff48a0 unknown :-1 s=CLOSED pgs=2773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.778+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/1273767443 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c0a4d0 0x55c39a002790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.778+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1273767443 >> 172.21.15.146:0/1273767443 conn(0x55c399c274e0 msgr2=0x55c39a01fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:22.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.778+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1273767443 shutdown_connections 2024-09-17T03:48:22.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.778+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1273767443 wait complete. 2024-09-17T03:48:22.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.779+0000 7fe1a2e3d740 1 -- start start 2024-09-17T03:48:22.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.779+0000 7fe1a2e3d740 1 Processor -- start 2024-09-17T03:48:22.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.780+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c0a4d0 0x55c39a09e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.780+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a0a2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.784 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.780+0000 7fe1a2e3d740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c33390 0x55c39a001570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.780+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe1941f8b70 con 0x55c399c126b0 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.780+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55c39a043860 con 0x55c399c33390 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.780+0000 7fe1a2e3d740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55c39a09f2a0 con 0x55c399c0a4d0 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.780+0000 7fe1a2e3d740 10 client.0 _ll_register_callbacks cb 0x7fe18c007cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.780+0000 7fe199470640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a0a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.780+0000 7fe199470640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a0a2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52020/0 (socket says 172.21.15.146:52020) 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.780+0000 7fe199470640 1 -- 172.21.15.146:0/1269343468 learned_addr learned my addr 172.21.15.146:0/1269343468 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe199c71640 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c0a4d0 0x55c39a09e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe19a472640 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c33390 0x55c39a001570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe199470640 1 -- 172.21.15.146:0/1269343468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c0a4d0 msgr2=0x55c39a09e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe199470640 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c0a4d0 0x55c39a09e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe199470640 1 -- 172.21.15.146:0/1269343468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c33390 msgr2=0x55c39a001570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:22.785 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe199470640 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c33390 0x55c39a001570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe199470640 1 -- 172.21.15.146:0/1269343468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39a033040 con 0x55c399c126b0 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe199470640 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a0a2570 secure :-1 s=READY pgs=2774 cs=0 l=1 rev1=1 crypto rx=0x7fe18406b8e0 tx=0x7fe184084030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653481b71f93297 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe174ff9640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe174ff9640 1 -- 172.21.15.146:0/1269343468 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18405e4d0 con 0x55c399c126b0 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe174ff9640 1 -- 172.21.15.146:0/1269343468 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7fe184060b50 con 0x55c399c126b0 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1269343468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1840842d0 con 0x55c399c126b0 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe174ff9640 1 -- 172.21.15.146:0/1269343468 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7fe1840668b0 con 0x55c399c126b0 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe1a2e3d740 10 client.12207 fetch_fsmap learned FSMap version 169 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1269343468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x55c39a043410 con 0x55c399c126b0 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe174ff9640 1 -- 172.21.15.146:0/1269343468 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1840842d0 con 0x55c399c126b0 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe174ff9640 1 -- 172.21.15.146:0/1269343468 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7fe184082ce0 con 0x55c399c126b0 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.781+0000 7fe1a2e3d740 10 client.12207 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe1a2e3d740 10 client.12207 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.c 2024-09-17T03:48:22.786 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe1a2e3d740 20 client.12207 populate_metadata read hostname 'smithi146' 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55c39a098b10 0x55c39a001ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe1a2e3d740 4 client.12207 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1269343468 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c399fd0a90 con 0x55c39a098b10 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe199c71640 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55c39a098b10 0x55c39a001ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe174ff9640 10 client.12207 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe199c71640 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55c39a098b10 0x55c39a001ab0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58bdabb535b2e497 server_cookie=ad4800fd6f54c0b6 in_seq=0 out_seq=0 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe174ff9640 1 -- 172.21.15.146:0/1269343468 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x55c399fd0a90 con 0x55c39a098b10 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe174ff9640 10 client.12207 handle_command_reply: tid=0 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe1a2e3d740 1 client.12207 shutdown 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1269343468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 msgr2=0x55c39a0a2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.782+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a0a2570 secure :-1 s=READY pgs=2774 cs=0 l=1 rev1=1 crypto rx=0x7fe18406b8e0 tx=0x7fe184084030 comp rx=0 tx=0).stop 2024-09-17T03:48:22.787 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1269343468 shutdown_connections 2024-09-17T03:48:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55c39a098b10 0x55c39a001ab0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55c399c33390 0x55c39a001570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c399c126b0 0x55c39a0a2570 unknown :-1 s=CLOSED pgs=2774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe174ff9640 0 client.12207 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:48:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe1a2e3d740 1 --2- 172.21.15.146:0/1269343468 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55c399c0a4d0 0x55c39a09e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1269343468 >> 172.21.15.146:0/1269343468 conn(0x55c399c274e0 msgr2=0x55c39a038be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1269343468 shutdown_connections 2024-09-17T03:48:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe1a2e3d740 1 -- 172.21.15.146:0/1269343468 wait complete. 2024-09-17T03:48:22.788 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe1a2e3d740 20 client.12207 trim_cache size 0 max 16384 2024-09-17T03:48:22.788 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {}, 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_stats": { 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: "01c5a93d-15da-4ce8-acd6-b56962676bee": { 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:47:52.428939+0000", 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2024-09-17T03:48:22.789 INFO:teuthology.orchestra.run.smithi146.stdout: "8b50f951-7502-494d-9c08-8017d1b9f231": { 2024-09-17T03:48:22.790 INFO:teuthology.orchestra.run.smithi146.stdout: "start_time": "2024-09-17T03:47:27.757320+0000", 2024-09-17T03:48:22.790 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2024-09-17T03:48:22.790 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_started": 0, 2024-09-17T03:48:22.790 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_passed": 0, 2024-09-17T03:48:22.790 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_failed": 0, 2024-09-17T03:48:22.790 INFO:teuthology.orchestra.run.smithi146.stdout: "uninline_skipped": 0 2024-09-17T03:48:22.790 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:48:22.790 INFO:teuthology.orchestra.run.smithi146.stdout: } 2024-09-17T03:48:22.790 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:48:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 -- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe178078b90 msgr2=0x7fe17807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe178078b90 0x7fe17807b0a0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fe190034000 tx=0x7fe190004ab0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 -- 172.21.15.146:0/1846668489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19415a5c0 msgr2=0x7fe19414d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19415a5c0 0x7fe19414d560 secure :-1 s=READY pgs=2770 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c3a0 tx=0x7fe18400c860 comp rx=0 tx=0).stop 2024-09-17T03:48:22.791 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 -- 172.21.15.146:0/1846668489 shutdown_connections 2024-09-17T03:48:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe178078b90 0x7fe17807b0a0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe1940ccd00 0x7fe1940cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19415a5c0 0x7fe19414d560 unknown :-1 s=CLOSED pgs=2770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 --2- 172.21.15.146:0/1846668489 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe194074620 0x7fe1941f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 -- 172.21.15.146:0/1846668489 >> 172.21.15.146:0/1846668489 conn(0x7fe1940b2ae0 msgr2=0x7fe194075d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 -- 172.21.15.146:0/1846668489 shutdown_connections 2024-09-17T03:48:22.792 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:22.783+0000 7fe19bed5640 1 -- 172.21.15.146:0/1846668489 wait complete. 2024-09-17T03:48:22.795 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:48:23.197 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:48:23.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.313+0000 7fdf5c04d640 1 -- 172.21.15.146:0/3406531766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf540cebc0 msgr2=0x7fdf540d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.313+0000 7fdf5c04d640 1 --2- 172.21.15.146:0/3406531766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf540cebc0 0x7fdf540d0b10 secure :-1 s=READY pgs=2776 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009830 tx=0x7fdf4402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.313+0000 7fdf5c04d640 1 -- 172.21.15.146:0/3406531766 shutdown_connections 2024-09-17T03:48:23.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.313+0000 7fdf5c04d640 1 --2- 172.21.15.146:0/3406531766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf540cebc0 0x7fdf540d0b10 unknown :-1 s=CLOSED pgs=2776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.313+0000 7fdf5c04d640 1 -- 172.21.15.146:0/3406531766 >> 172.21.15.146:0/3406531766 conn(0x7fdf540d26c0 msgr2=0x7fdf540d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:23.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.313+0000 7fdf5c04d640 1 -- 172.21.15.146:0/3406531766 shutdown_connections 2024-09-17T03:48:23.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.313+0000 7fdf5c04d640 1 -- 172.21.15.146:0/3406531766 wait complete. 2024-09-17T03:48:23.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.315+0000 7fdf5c04d640 1 Processor -- start 2024-09-17T03:48:23.315 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.315+0000 7fdf5c04d640 1 -- start start 2024-09-17T03:48:23.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf5c04d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf540cebc0 0x7fdf5414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf5c04d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540d1050 0x7fdf5409d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf5c04d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf540d31e0 0x7fdf5415f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf5c04d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fdf540b66b0 con 0x7fdf540cebc0 2024-09-17T03:48:23.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf5c04d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdf540b6530 con 0x7fdf540d31e0 2024-09-17T03:48:23.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf5c04d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdf540b6830 con 0x7fdf540d1050 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf59de9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf540cebc0 0x7fdf5414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf59de9640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf540cebc0 0x7fdf5414fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52028/0 (socket says 172.21.15.146:52028) 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf59de9640 1 -- 172.21.15.146:0/2324465521 learned_addr learned my addr 172.21.15.146:0/2324465521 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf5a5ea640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf540d31e0 0x7fdf5415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf595e8640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540d1050 0x7fdf5409d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf59de9640 1 -- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540d1050 msgr2=0x7fdf5409d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf59de9640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540d1050 0x7fdf5409d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf59de9640 1 -- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf540d31e0 msgr2=0x7fdf5415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf59de9640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf540d31e0 0x7fdf5415f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf59de9640 1 -- 172.21.15.146:0/2324465521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5409d950 con 0x7fdf540cebc0 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.316+0000 7fdf595e8640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540d1050 0x7fdf5409d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.317+0000 7fdf59de9640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf540cebc0 0x7fdf5414fc30 secure :-1 s=READY pgs=2777 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000c430 tx=0x7fdf5000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.317+0000 7fdf4a7fc640 1 -- 172.21.15.146:0/2324465521 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50017070 con 0x7fdf540cebc0 2024-09-17T03:48:23.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.317+0000 7fdf4a7fc640 1 -- 172.21.15.146:0/2324465521 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf500053c0 con 0x7fdf540cebc0 2024-09-17T03:48:23.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.317+0000 7fdf4a7fc640 1 -- 172.21.15.146:0/2324465521 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf500038a0 con 0x7fdf540cebc0 2024-09-17T03:48:23.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.317+0000 7fdf5c04d640 1 -- 172.21.15.146:0/2324465521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf540c99e0 con 0x7fdf540cebc0 2024-09-17T03:48:23.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.317+0000 7fdf5c04d640 1 -- 172.21.15.146:0/2324465521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf540c9fa0 con 0x7fdf540cebc0 2024-09-17T03:48:23.319 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.318+0000 7fdf5c04d640 1 -- 172.21.15.146:0/2324465521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf540b6ce0 con 0x7fdf540cebc0 2024-09-17T03:48:23.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.319+0000 7fdf4a7fc640 1 -- 172.21.15.146:0/2324465521 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf5001a070 con 0x7fdf540cebc0 2024-09-17T03:48:23.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.319+0000 7fdf4a7fc640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf38078bc0 0x7fdf3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.319+0000 7fdf4a7fc640 1 -- 172.21.15.146:0/2324465521 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7fdf5009a000 con 0x7fdf540cebc0 2024-09-17T03:48:23.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.319+0000 7fdf595e8640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf38078bc0 0x7fdf3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.320+0000 7fdf595e8640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf38078bc0 0x7fdf3807b0d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fdf44034000 tx=0x7fdf44004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:23.324 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.324+0000 7fdf4a7fc640 1 -- 172.21.15.146:0/2324465521 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdf50061e20 con 0x7fdf540cebc0 2024-09-17T03:48:23.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.533+0000 7fdf5c04d640 1 -- 172.21.15.146:0/2324465521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf540ce250 con 0x7fdf540cebc0 2024-09-17T03:48:23.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.534+0000 7fdf4a7fc640 1 -- 172.21.15.146:0/2324465521 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5252 (secure 0 0 0) 0x7fdf50066850 con 0x7fdf540cebc0 2024-09-17T03:48:23.534 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:23.534 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":169,"btime":"2024-09-17T03:47:20:289055+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":10288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2813416980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2813416980},{"type":"v1","addr":"172.21.15.179:6837","nonce":2813416980}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:47:06.858092+0000","modified":"2024-09-17T03:47:20.289043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":211,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11841":{"gid":11841,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6835/2488811693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2488811693},{"type":"v1","addr":"172.21.15.146:6835","nonce":2488811693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11841,"qdb_cluster":[11841]},"id":16}]} 2024-09-17T03:48:23.534 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 169 2024-09-17T03:48:23.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 -- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf38078bc0 msgr2=0x7fdf3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.536 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf38078bc0 0x7fdf3807b0d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fdf44034000 tx=0x7fdf44004730 comp rx=0 tx=0).stop 2024-09-17T03:48:23.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 -- 172.21.15.146:0/2324465521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf540cebc0 msgr2=0x7fdf5414fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf540cebc0 0x7fdf5414fc30 secure :-1 s=READY pgs=2777 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000c430 tx=0x7fdf5000c8f0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 -- 172.21.15.146:0/2324465521 shutdown_connections 2024-09-17T03:48:23.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fdf38078bc0 0x7fdf3807b0d0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf540d31e0 0x7fdf5415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdf540d1050 0x7fdf5409d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 --2- 172.21.15.146:0/2324465521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf540cebc0 0x7fdf5414fc30 unknown :-1 s=CLOSED pgs=2777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 -- 172.21.15.146:0/2324465521 >> 172.21.15.146:0/2324465521 conn(0x7fdf540d26c0 msgr2=0x7fdf5415cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:23.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 -- 172.21.15.146:0/2324465521 shutdown_connections 2024-09-17T03:48:23.537 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.536+0000 7fdf5c04d640 1 -- 172.21.15.146:0/2324465521 wait complete. 2024-09-17T03:48:23.547 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 169, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:47:06.858092+0000', 'modified': '2024-09-17T03:47:20.289043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 211, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11841}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11841': {'gid': 11841, 'name': 'c', 'rank': 0, 'incarnation': 166, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.146:6835/2488811693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 2488811693}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 2488811693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [33], 'metadata_pool': 32, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11841, 'qdb_cluster': [11841]} 2024-09-17T03:48:23.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:48:23.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:48:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.661+0000 7f5bfd771640 1 -- 172.21.15.146:0/774406145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf815cbe0 msgr2=0x7f5bf80d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.661+0000 7f5bfd771640 1 --2- 172.21.15.146:0/774406145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf815cbe0 0x7f5bf80d0b10 secure :-1 s=READY pgs=2778 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009900 tx=0x7f5bec02a560 comp rx=0 tx=0).stop 2024-09-17T03:48:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.661+0000 7f5bfd771640 1 -- 172.21.15.146:0/774406145 shutdown_connections 2024-09-17T03:48:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.661+0000 7f5bfd771640 1 --2- 172.21.15.146:0/774406145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf815cbe0 0x7f5bf80d0b10 unknown :-1 s=CLOSED pgs=2778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.661+0000 7f5bfd771640 1 --2- 172.21.15.146:0/774406145 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf80d31e0 0x7f5bf80cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.661+0000 7f5bfd771640 1 -- 172.21.15.146:0/774406145 >> 172.21.15.146:0/774406145 conn(0x7f5bf80d26c0 msgr2=0x7f5bf80d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:23.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.661+0000 7f5bfd771640 1 -- 172.21.15.146:0/774406145 shutdown_connections 2024-09-17T03:48:23.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.661+0000 7f5bfd771640 1 -- 172.21.15.146:0/774406145 wait complete. 2024-09-17T03:48:23.662 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.663+0000 7f5bfd771640 1 Processor -- start 2024-09-17T03:48:23.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.663+0000 7f5bfd771640 1 -- start start 2024-09-17T03:48:23.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bfd771640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf80d1050 0x7f5bf814b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bfd771640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf80d31e0 0x7f5bf81f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bfd771640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf815cbe0 0x7f5bf81f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bfd771640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf80cd7b0 con 0x7f5bf80d31e0 2024-09-17T03:48:23.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bfd771640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf80b6e00 con 0x7f5bf80d1050 2024-09-17T03:48:23.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bfd771640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf80cd930 con 0x7f5bf815cbe0 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bf67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf80d31e0 0x7f5bf81f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bf67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf80d31e0 0x7f5bf81f3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52056/0 (socket says 172.21.15.146:52056) 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bf67fc640 1 -- 172.21.15.146:0/410873704 learned_addr learned my addr 172.21.15.146:0/410873704 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf80d1050 0x7f5bf814b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bf77fe640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf815cbe0 0x7f5bf81f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bf67fc640 1 -- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf815cbe0 msgr2=0x7f5bf81f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf815cbe0 0x7f5bf81f3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bf67fc640 1 -- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf80d1050 msgr2=0x7f5bf814b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf80d1050 0x7f5bf814b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.664+0000 7f5bf67fc640 1 -- 172.21.15.146:0/410873704 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf814dd20 con 0x7f5bf80d31e0 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.665+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf80d31e0 0x7f5bf81f3990 secure :-1 s=READY pgs=2779 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009230 tx=0x7f5bec003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.665+0000 7f5bdf7fe640 1 -- 172.21.15.146:0/410873704 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec03e030 con 0x7f5bf80d31e0 2024-09-17T03:48:23.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.665+0000 7f5bdf7fe640 1 -- 172.21.15.146:0/410873704 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bec003e60 con 0x7f5bf80d31e0 2024-09-17T03:48:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.665+0000 7f5bdf7fe640 1 -- 172.21.15.146:0/410873704 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec035040 con 0x7f5bf80d31e0 2024-09-17T03:48:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.665+0000 7f5bfd771640 1 -- 172.21.15.146:0/410873704 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf814e000 con 0x7f5bf80d31e0 2024-09-17T03:48:23.667 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.665+0000 7f5bfd771640 1 -- 172.21.15.146:0/410873704 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf814c9f0 con 0x7f5bf80d31e0 2024-09-17T03:48:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.667+0000 7f5bdf7fe640 1 -- 172.21.15.146:0/410873704 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5bec041030 con 0x7f5bf80d31e0 2024-09-17T03:48:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.667+0000 7f5bdf7fe640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5be4078b90 0x7f5be407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.667+0000 7f5bdf7fe640 1 -- 172.21.15.146:0/410873704 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f5bec0bb9f0 con 0x7f5bf80d31e0 2024-09-17T03:48:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.667+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5be4078b90 0x7f5be407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.668+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5be4078b90 0x7f5be407b0a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5be8005860 tx=0x7f5be8005f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.668+0000 7f5c04322740 1 Processor -- start 2024-09-17T03:48:23.668 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.668+0000 7f5c04322740 1 -- start start 2024-09-17T03:48:23.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5c04322740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379ca1270 0x55837a072fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5c04322740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a0734e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5c04322740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c80590 0x55837a0903e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5c04322740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558379fbb820 con 0x558379c783b0 2024-09-17T03:48:23.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5c04322740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558379faac50 con 0x558379ca1270 2024-09-17T03:48:23.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5c04322740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x558379faea60 con 0x558379c80590 2024-09-17T03:48:23.672 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a0734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf67fc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a0734e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52070/0 (socket says 172.21.15.146:52070) 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf67fc640 1 -- 172.21.15.146:0/229087108 learned_addr learned my addr 172.21.15.146:0/229087108 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf77fe640 1 --2- 172.21.15.146:0/229087108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c80590 0x55837a0903e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/229087108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379ca1270 0x55837a072fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf67fc640 1 -- 172.21.15.146:0/229087108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c80590 msgr2=0x55837a0903e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/229087108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c80590 0x55837a0903e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf67fc640 1 -- 172.21.15.146:0/229087108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379ca1270 msgr2=0x55837a072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/229087108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379ca1270 0x55837a072fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf67fc640 1 -- 172.21.15.146:0/229087108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558379d0c850 con 0x558379c783b0 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf77fe640 1 --2- 172.21.15.146:0/229087108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c80590 0x55837a0903e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/229087108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379ca1270 0x55837a072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:48:23.673 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/229087108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a0734e0 secure :-1 s=READY pgs=2780 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0b9ec0 tx=0x7f5bec082e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd6a7a4cdd79c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bdcff9640 1 -- 172.21.15.146:0/229087108 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec048040 con 0x558379c783b0 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bdcff9640 1 -- 172.21.15.146:0/229087108 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bec088110 con 0x558379c783b0 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.670+0000 7f5bdcff9640 1 -- 172.21.15.146:0/229087108 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec083b80 con 0x558379c783b0 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.671+0000 7f5c04322740 1 -- 172.21.15.146:0/229087108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 msgr2=0x55837a0734e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.671+0000 7f5c04322740 1 --2- 172.21.15.146:0/229087108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a0734e0 secure :-1 s=READY pgs=2780 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0b9ec0 tx=0x7f5bec082e50 comp rx=0 tx=0).stop 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.671+0000 7f5c04322740 1 -- 172.21.15.146:0/229087108 shutdown_connections 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.671+0000 7f5c04322740 1 --2- 172.21.15.146:0/229087108 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c80590 0x55837a0903e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.671+0000 7f5c04322740 1 --2- 172.21.15.146:0/229087108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a0734e0 unknown :-1 s=CLOSED pgs=2780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.671+0000 7f5c04322740 1 --2- 172.21.15.146:0/229087108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379ca1270 0x55837a072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.671+0000 7f5c04322740 1 -- 172.21.15.146:0/229087108 >> 172.21.15.146:0/229087108 conn(0x558379c953c0 msgr2=0x55837a049260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.671+0000 7f5c04322740 1 -- 172.21.15.146:0/229087108 shutdown_connections 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.671+0000 7f5c04322740 1 -- 172.21.15.146:0/229087108 wait complete. 2024-09-17T03:48:23.674 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.672+0000 7f5c04322740 1 -- start start 2024-09-17T03:48:23.675 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.672+0000 7f5c04322740 1 Processor -- start 2024-09-17T03:48:23.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.673+0000 7f5c04322740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a087a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.673+0000 7f5c04322740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c80590 0x55837a061230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.673+0000 7f5c04322740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379ca1270 0x55837a0a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5c04322740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x558379d1b620 con 0x558379c783b0 2024-09-17T03:48:23.678 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5c04322740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x558379f505f0 con 0x558379ca1270 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5c04322740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x558379fbb820 con 0x558379c80590 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5c04322740 10 client.0 _ll_register_callbacks cb 0x558379f540a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bf6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a087a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bf6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a087a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52080/0 (socket says 172.21.15.146:52080) 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bf6ffd640 1 -- 172.21.15.146:0/3258669949 learned_addr learned my addr 172.21.15.146:0/3258669949 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bf77fe640 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379ca1270 0x55837a0a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bf6ffd640 1 -- 172.21.15.146:0/3258669949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c80590 msgr2=0x55837a061230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c80590 0x55837a061230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bf6ffd640 1 -- 172.21.15.146:0/3258669949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379ca1270 msgr2=0x55837a0a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379ca1270 0x55837a0a00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bf6ffd640 1 -- 172.21.15.146:0/3258669949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558379d836b0 con 0x558379c783b0 2024-09-17T03:48:23.679 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a087a30 secure :-1 s=READY pgs=2781 cs=0 l=1 rev1=1 crypto rx=0x7f5be800a5b0 tx=0x7f5be8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66076dc94b554800 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/3258669949 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be8016070 con 0x558379c783b0 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/3258669949 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f5be8027b50 con 0x558379c783b0 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5c04322740 1 -- 172.21.15.146:0/3258669949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bec088110 con 0x558379c783b0 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/3258669949 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f5be8027d50 con 0x558379c783b0 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5c04322740 10 client.12228 fetch_fsmap learned FSMap version 169 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.674+0000 7f5c04322740 1 -- 172.21.15.146:0/3258669949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x55837a061770 con 0x558379c783b0 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.675+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/3258669949 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bec088110 con 0x558379c783b0 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.675+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/3258669949 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f5be802e050 con 0x558379c783b0 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.675+0000 7f5c04322740 10 client.12228 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.675+0000 7f5c04322740 10 client.12228 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:48:23.680 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.675+0000 7f5c04322740 20 client.12228 populate_metadata read hostname 'smithi146' 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.675+0000 7f5c04322740 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x558379c5fe40 0x55837a0aa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.675+0000 7f5c04322740 4 client.12228 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.675+0000 7f5c04322740 1 -- 172.21.15.146:0/3258669949 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558379fbd770 con 0x558379c5fe40 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.675+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x558379c5fe40 0x55837a0aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.675+0000 7f5bd5ffb640 10 client.12228 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.675+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x558379c5fe40 0x55837a0aa590 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35925294dc8ed852 server_cookie=eae3a3c2629da0cc in_seq=0 out_seq=0 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/3258669949 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558379fbd770 con 0x558379c5fe40 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5bd5ffb640 10 client.12228 handle_command_reply: tid=0 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 1 client.12228 shutdown 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 1 -- 172.21.15.146:0/3258669949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 msgr2=0x55837a087a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a087a30 secure :-1 s=READY pgs=2781 cs=0 l=1 rev1=1 crypto rx=0x7f5be800a5b0 tx=0x7f5be8004730 comp rx=0 tx=0).stop 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 1 -- 172.21.15.146:0/3258669949 shutdown_connections 2024-09-17T03:48:23.681 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x558379c5fe40 0x55837a0aa590 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379ca1270 0x55837a0a00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c80590 0x55837a061230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5bd5ffb640 0 client.12228 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:48:23.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 1 --2- 172.21.15.146:0/3258669949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a087a30 unknown :-1 s=CLOSED pgs=2781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 1 -- 172.21.15.146:0/3258669949 >> 172.21.15.146:0/3258669949 conn(0x558379c953c0 msgr2=0x55837a043b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:23.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 1 -- 172.21.15.146:0/3258669949 shutdown_connections 2024-09-17T03:48:23.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 1 -- 172.21.15.146:0/3258669949 wait complete. 2024-09-17T03:48:23.682 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.676+0000 7f5c04322740 20 client.12228 trim_cache size 0 max 16384 2024-09-17T03:48:23.694 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.694+0000 7f5c04322740 1 Processor -- start 2024-09-17T03:48:23.695 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.695+0000 7f5c04322740 1 -- start start 2024-09-17T03:48:23.697 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5c04322740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c783b0 0x55837a061a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5c04322740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379c80590 0x55837a061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5c04322740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379ca1270 0x55837a089c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5c04322740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf81ff410 con 0x558379ca1270 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5c04322740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf814c740 con 0x558379c80590 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5c04322740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf80cc5e0 con 0x558379c783b0 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379ca1270 0x55837a089c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379ca1270 0x55837a089c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52094/0 (socket says 172.21.15.146:52094) 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf77fe640 1 -- 172.21.15.146:0/3118533327 learned_addr learned my addr 172.21.15.146:0/3118533327 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/3118533327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379c80590 0x55837a061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/3118533327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c783b0 0x55837a061a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf77fe640 1 -- 172.21.15.146:0/3118533327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c783b0 msgr2=0x55837a061a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:23.698 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf77fe640 1 --2- 172.21.15.146:0/3118533327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c783b0 0x55837a061a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf77fe640 1 -- 172.21.15.146:0/3118533327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379c80590 msgr2=0x55837a061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf77fe640 1 --2- 172.21.15.146:0/3118533327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379c80590 0x55837a061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf77fe640 1 -- 172.21.15.146:0/3118533327 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837a0632d0 con 0x558379ca1270 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/3118533327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c783b0 0x55837a061a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bf77fe640 1 --2- 172.21.15.146:0/3118533327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379ca1270 0x55837a089c70 secure :-1 s=READY pgs=2782 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009dd0 tx=0x7f5bf0009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2f4d5f9047ad6c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bd7fff640 1 -- 172.21.15.146:0/3118533327 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0003970 con 0x558379ca1270 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bd7fff640 1 -- 172.21.15.146:0/3118533327 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bf0010070 con 0x558379ca1270 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.696+0000 7f5bd7fff640 1 -- 172.21.15.146:0/3118533327 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0004020 con 0x558379ca1270 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.697+0000 7f5c04322740 1 -- 172.21.15.146:0/3118533327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379ca1270 msgr2=0x55837a089c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.697+0000 7f5c04322740 1 --2- 172.21.15.146:0/3118533327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379ca1270 0x55837a089c70 secure :-1 s=READY pgs=2782 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009dd0 tx=0x7f5bf0009630 comp rx=0 tx=0).stop 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.697+0000 7f5c04322740 1 -- 172.21.15.146:0/3118533327 shutdown_connections 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.697+0000 7f5c04322740 1 --2- 172.21.15.146:0/3118533327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379ca1270 0x55837a089c70 unknown :-1 s=CLOSED pgs=2782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.697+0000 7f5c04322740 1 --2- 172.21.15.146:0/3118533327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379c80590 0x55837a061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.699 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.697+0000 7f5c04322740 1 --2- 172.21.15.146:0/3118533327 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379c783b0 0x55837a061a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.697+0000 7f5c04322740 1 -- 172.21.15.146:0/3118533327 >> 172.21.15.146:0/3118533327 conn(0x558379c953c0 msgr2=0x55837a043b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.697+0000 7f5c04322740 1 -- 172.21.15.146:0/3118533327 shutdown_connections 2024-09-17T03:48:23.700 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.697+0000 7f5c04322740 1 -- 172.21.15.146:0/3118533327 wait complete. 2024-09-17T03:48:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.698+0000 7f5c04322740 1 -- start start 2024-09-17T03:48:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.698+0000 7f5c04322740 1 Processor -- start 2024-09-17T03:48:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.699+0000 7f5c04322740 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a115240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.699+0000 7f5c04322740 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379c80590 0x55837a107a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.699+0000 7f5c04322740 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379ca1270 0x55837a061a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.699+0000 7f5c04322740 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x55837a0853c0 con 0x558379c783b0 2024-09-17T03:48:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.699+0000 7f5c04322740 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55837a0a0af0 con 0x558379c80590 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.699+0000 7f5c04322740 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55837a085a00 con 0x558379ca1270 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.699+0000 7f5c04322740 10 client.0 _ll_register_callbacks cb 0x7f5be800a7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.699+0000 7f5bf6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a115240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.699+0000 7f5bf6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a115240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52102/0 (socket says 172.21.15.146:52102) 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bf6ffd640 1 -- 172.21.15.146:0/26039033 learned_addr learned my addr 172.21.15.146:0/26039033 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379c80590 0x55837a107a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bf77fe640 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379ca1270 0x55837a061a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bf6ffd640 1 -- 172.21.15.146:0/26039033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379ca1270 msgr2=0x55837a061a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379ca1270 0x55837a061a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bf6ffd640 1 -- 172.21.15.146:0/26039033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379c80590 msgr2=0x55837a107a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379c80590 0x55837a107a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bf6ffd640 1 -- 172.21.15.146:0/26039033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837a0a32d0 con 0x558379c783b0 2024-09-17T03:48:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bf6ffd640 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a115240 secure :-1 s=READY pgs=2783 cs=0 l=1 rev1=1 crypto rx=0x7f5be80050e0 tx=0x7f5be8026c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46928b6763ef518 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/26039033 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be8030670 con 0x558379c783b0 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/26039033 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f5be8030810 con 0x558379c783b0 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5c04322740 1 -- 172.21.15.146:0/26039033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bf0010070 con 0x558379c783b0 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/26039033 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f5be8041050 con 0x558379c783b0 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5c04322740 10 client.12234 fetch_fsmap learned FSMap version 169 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5c04322740 1 -- 172.21.15.146:0/26039033 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=169,monmap=2+}) -- 0x55837a108010 con 0x558379c783b0 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.700+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/26039033 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bf0010070 con 0x558379c783b0 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/26039033 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 169) ==== 3502+0+0 (secure 0 0 0) 0x7f5be8044020 con 0x558379c783b0 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 10 client.12234 fetch_fsmap finished waiting for FSMap version 169 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 10 client.12234 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 20 client.12234 populate_metadata read hostname 'smithi146' 2024-09-17T03:48:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55837a0a6b90 0x55837a05da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 4 client.12234 mds_command: new command op to 11841 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 1 -- 172.21.15.146:0/26039033 --> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] -- command(tid 0: {"prefix": "status"}) -- 0x558379fb9220 con 0x55837a0a6b90 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55837a0a6b90 0x55837a05da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5bd5ffb640 10 client.12234 ms_handle_connect on v2:172.21.15.146:6834/2488811693 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5bf67fc640 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55837a0a6b90 0x55837a05da30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57e321aaa1e39d2e server_cookie=22dfff71b4779261 in_seq=0 out_seq=0 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5bd5ffb640 1 -- 172.21.15.146:0/26039033 <== mds.0 v2:172.21.15.146:6834/2488811693 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x558379fb9220 con 0x55837a0a6b90 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5bd5ffb640 10 client.12234 handle_command_reply: tid=0 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 1 client.12234 shutdown 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 1 -- 172.21.15.146:0/26039033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 msgr2=0x55837a115240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a115240 secure :-1 s=READY pgs=2783 cs=0 l=1 rev1=1 crypto rx=0x7f5be80050e0 tx=0x7f5be8026c10 comp rx=0 tx=0).stop 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 1 -- 172.21.15.146:0/26039033 shutdown_connections 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.146:6834/2488811693,v1:172.21.15.146:6835/2488811693] conn(0x55837a0a6b90 0x55837a05da30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.707 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x558379ca1270 0x55837a061a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558379c80590 0x55837a107a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 1 --2- 172.21.15.146:0/26039033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558379c783b0 0x55837a115240 unknown :-1 s=CLOSED pgs=2783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5bd5ffb640 0 client.12234 ms_handle_reset on v2:172.21.15.146:6834/2488811693 2024-09-17T03:48:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.701+0000 7f5c04322740 1 -- 172.21.15.146:0/26039033 >> 172.21.15.146:0/26039033 conn(0x558379c953c0 msgr2=0x55837a060e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5c04322740 1 -- 172.21.15.146:0/26039033 shutdown_connections 2024-09-17T03:48:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5c04322740 1 -- 172.21.15.146:0/26039033 wait complete. 2024-09-17T03:48:23.708 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5c04322740 20 client.12234 trim_cache size 0 max 16384 2024-09-17T03:48:23.708 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:48:23.708 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "3f04b219-91f7-40f1-98fe-bc08c29ffc97", 2024-09-17T03:48:23.708 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2024-09-17T03:48:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 11841, 2024-09-17T03:48:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2024-09-17T03:48:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2024-09-17T03:48:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2024-09-17T03:48:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 66.417026336999996, 2024-09-17T03:48:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 169, 2024-09-17T03:48:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 211, 2024-09-17T03:48:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 211, 2024-09-17T03:48:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 80.947733224000004 2024-09-17T03:48:23.709 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:48:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 -- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5be4078b90 msgr2=0x7f5be407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5be4078b90 0x7f5be407b0a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5be8005860 tx=0x7f5be8005f50 comp rx=0 tx=0).stop 2024-09-17T03:48:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 -- 172.21.15.146:0/410873704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf80d31e0 msgr2=0x7f5bf81f3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf80d31e0 0x7f5bf81f3990 secure :-1 s=READY pgs=2779 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009230 tx=0x7f5bec003970 comp rx=0 tx=0).stop 2024-09-17T03:48:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 -- 172.21.15.146:0/410873704 shutdown_connections 2024-09-17T03:48:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f5be4078b90 0x7f5be407b0a0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f5bf815cbe0 0x7f5bf81f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf80d31e0 0x7f5bf81f3990 unknown :-1 s=CLOSED pgs=2779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 --2- 172.21.15.146:0/410873704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5bf80d1050 0x7f5bf814b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 -- 172.21.15.146:0/410873704 >> 172.21.15.146:0/410873704 conn(0x7f5bf80d26c0 msgr2=0x7f5bf815f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 -- 172.21.15.146:0/410873704 shutdown_connections 2024-09-17T03:48:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:23.702+0000 7f5bfd771640 1 -- 172.21.15.146:0/410873704 wait complete. 2024-09-17T03:48:23.714 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:48:23.714 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:48:23.755 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:48:23.797 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:48:23.797 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:48:23.797 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:48:23.798 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:48:23.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:48:23.814 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:48:23.814 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:48:23.814 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:48:23.854 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:48:23.854 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:48:23.855 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:48:23.855 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:48:23.870 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:48:23.871 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:48:23.871 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:48:23.871 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:48:23.911 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:48:23.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:48:24.025 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.025+0000 7fe9f10f4640 1 -- 172.21.15.146:0/1620352750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9d8003a50 msgr2=0x7fe9d8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.025+0000 7fe9f10f4640 1 --2- 172.21.15.146:0/1620352750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9d8003a50 0x7fe9d8003ec0 secure :-1 s=READY pgs=2785 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00c310 tx=0x7fe9d8005830 comp rx=0 tx=0).stop 2024-09-17T03:48:24.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.025+0000 7fe9f10f4640 1 -- 172.21.15.146:0/1620352750 shutdown_connections 2024-09-17T03:48:24.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.025+0000 7fe9f10f4640 1 --2- 172.21.15.146:0/1620352750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9d8003a50 0x7fe9d8003ec0 unknown :-1 s=CLOSED pgs=2785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.025+0000 7fe9f10f4640 1 -- 172.21.15.146:0/1620352750 >> 172.21.15.146:0/1620352750 conn(0x7fe9ec0d4cd0 msgr2=0x7fe9ec0d50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:24.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.025+0000 7fe9f10f4640 1 -- 172.21.15.146:0/1620352750 shutdown_connections 2024-09-17T03:48:24.026 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.025+0000 7fe9f10f4640 1 -- 172.21.15.146:0/1620352750 wait complete. 2024-09-17T03:48:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.027+0000 7fe9f10f4640 1 Processor -- start 2024-09-17T03:48:24.027 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.027+0000 7fe9f10f4640 1 -- start start 2024-09-17T03:48:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.028+0000 7fe9f10f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d8003a50 0x7fe9ec14ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.028+0000 7fe9f10f4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9ec14f090 0x7fe9ec159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.028+0000 7fe9f10f4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9ec159e40 0x7fe9ec15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.028+0000 7fe9f10f4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec162a70 con 0x7fe9ec14f090 2024-09-17T03:48:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.028+0000 7fe9f10f4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec1628f0 con 0x7fe9ec159e40 2024-09-17T03:48:24.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.028+0000 7fe9f10f4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec162bf0 con 0x7fe9d8003a50 2024-09-17T03:48:24.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9ec14f090 0x7fe9ec159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e259c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9ec14f090 0x7fe9ec159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52126/0 (socket says 172.21.15.146:52126) 2024-09-17T03:48:24.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e259c640 1 -- 172.21.15.146:0/905592971 learned_addr learned my addr 172.21.15.146:0/905592971 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:24.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9ead9d640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d8003a50 0x7fe9ec14ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9eb59e640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9ec159e40 0x7fe9ec15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e259c640 1 -- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d8003a50 msgr2=0x7fe9ec14ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e259c640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d8003a50 0x7fe9ec14ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e259c640 1 -- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9ec159e40 msgr2=0x7fe9ec15a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e259c640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9ec159e40 0x7fe9ec15a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.031 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e259c640 1 -- 172.21.15.146:0/905592971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec0ce800 con 0x7fe9ec14f090 2024-09-17T03:48:24.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e259c640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9ec14f090 0x7fe9ec159900 secure :-1 s=READY pgs=2786 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4004dd0 tx=0x7fe9d4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:24.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e3fff640 1 -- 172.21.15.146:0/905592971 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4015020 con 0x7fe9ec14f090 2024-09-17T03:48:24.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e3fff640 1 -- 172.21.15.146:0/905592971 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9d4011670 con 0x7fe9ec14f090 2024-09-17T03:48:24.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9f10f4640 1 -- 172.21.15.146:0/905592971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec0ce520 con 0x7fe9ec14f090 2024-09-17T03:48:24.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9e3fff640 1 -- 172.21.15.146:0/905592971 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4011aa0 con 0x7fe9ec14f090 2024-09-17T03:48:24.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.029+0000 7fe9f10f4640 1 -- 172.21.15.146:0/905592971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec15be50 con 0x7fe9ec14f090 2024-09-17T03:48:24.032 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.030+0000 7fe9f10f4640 1 -- 172.21.15.146:0/905592971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ec162fd0 con 0x7fe9ec14f090 2024-09-17T03:48:24.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.031+0000 7fe9e3fff640 1 -- 172.21.15.146:0/905592971 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9d4018020 con 0x7fe9ec14f090 2024-09-17T03:48:24.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.032+0000 7fe9e3fff640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9cc078bc0 0x7fe9cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.032+0000 7fe9e3fff640 1 -- 172.21.15.146:0/905592971 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7fe9d409b630 con 0x7fe9ec14f090 2024-09-17T03:48:24.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.032+0000 7fe9ead9d640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9cc078bc0 0x7fe9cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.033 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.032+0000 7fe9ead9d640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9cc078bc0 0x7fe9cc07b0d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc033000 tx=0x7fe9dc038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:24.036 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.036+0000 7fe9e3fff640 1 -- 172.21.15.146:0/905592971 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe9d401f020 con 0x7fe9ec14f090 2024-09-17T03:48:24.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.246+0000 7fe9f10f4640 1 -- 172.21.15.146:0/905592971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9ec15df00 con 0x7fe9ec14f090 2024-09-17T03:48:24.246 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.246+0000 7fe9e3fff640 1 -- 172.21.15.146:0/905592971 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5252 (secure 0 0 0) 0x7fe9ec0ce800 con 0x7fe9ec14f090 2024-09-17T03:48:24.246 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:24.247 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":169,"btime":"2024-09-17T03:47:20:289055+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":10288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2813416980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2813416980},{"type":"v1","addr":"172.21.15.179:6837","nonce":2813416980}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:47:06.858092+0000","modified":"2024-09-17T03:47:20.289043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":211,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11841":{"gid":11841,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6835/2488811693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2488811693},{"type":"v1","addr":"172.21.15.146:6835","nonce":2488811693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11841,"qdb_cluster":[11841]},"id":16}]} 2024-09-17T03:48:24.247 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 169 2024-09-17T03:48:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.248+0000 7fe9f10f4640 1 -- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9cc078bc0 msgr2=0x7fe9cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.248+0000 7fe9f10f4640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9cc078bc0 0x7fe9cc07b0d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc033000 tx=0x7fe9dc038040 comp rx=0 tx=0).stop 2024-09-17T03:48:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.248+0000 7fe9f10f4640 1 -- 172.21.15.146:0/905592971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9ec14f090 msgr2=0x7fe9ec159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.248+0000 7fe9f10f4640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9ec14f090 0x7fe9ec159900 secure :-1 s=READY pgs=2786 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4004dd0 tx=0x7fe9d4001630 comp rx=0 tx=0).stop 2024-09-17T03:48:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.249+0000 7fe9f10f4640 1 -- 172.21.15.146:0/905592971 shutdown_connections 2024-09-17T03:48:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.249+0000 7fe9f10f4640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fe9cc078bc0 0x7fe9cc07b0d0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.249+0000 7fe9f10f4640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe9ec159e40 0x7fe9ec15a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.249+0000 7fe9f10f4640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9ec14f090 0x7fe9ec159900 unknown :-1 s=CLOSED pgs=2786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.249+0000 7fe9f10f4640 1 --2- 172.21.15.146:0/905592971 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe9d8003a50 0x7fe9ec14ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.249+0000 7fe9f10f4640 1 -- 172.21.15.146:0/905592971 >> 172.21.15.146:0/905592971 conn(0x7fe9ec0d4cd0 msgr2=0x7fe9ec15e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.249+0000 7fe9f10f4640 1 -- 172.21.15.146:0/905592971 shutdown_connections 2024-09-17T03:48:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.249+0000 7fe9f10f4640 1 -- 172.21.15.146:0/905592971 wait complete. 2024-09-17T03:48:24.260 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:48:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.399+0000 7ff3a70c5640 1 -- 172.21.15.146:0/1190846637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a00d1050 msgr2=0x7ff3a00b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.399+0000 7ff3a70c5640 1 --2- 172.21.15.146:0/1190846637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a00d1050 0x7ff3a00b5ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff398005fd0 tx=0x7ff39802aa90 comp rx=0 tx=0).stop 2024-09-17T03:48:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.399+0000 7ff3a70c5640 1 -- 172.21.15.146:0/1190846637 shutdown_connections 2024-09-17T03:48:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.399+0000 7ff3a70c5640 1 --2- 172.21.15.146:0/1190846637 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a00d1050 0x7ff3a00b5ad0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.399+0000 7ff3a70c5640 1 --2- 172.21.15.146:0/1190846637 >> v2:172.21.15.179:3300/0 conn(0x7ff3a00cebc0 0x7ff3a00d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.399+0000 7ff3a70c5640 1 -- 172.21.15.146:0/1190846637 >> 172.21.15.146:0/1190846637 conn(0x7ff3a00d26c0 msgr2=0x7ff3a00d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.400+0000 7ff3a70c5640 1 -- 172.21.15.146:0/1190846637 shutdown_connections 2024-09-17T03:48:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.400+0000 7ff3a70c5640 1 -- 172.21.15.146:0/1190846637 wait complete. 2024-09-17T03:48:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.401+0000 7ff3a70c5640 1 Processor -- start 2024-09-17T03:48:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.401+0000 7ff3a70c5640 1 -- start start 2024-09-17T03:48:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a70c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a00cebc0 0x7ff3a015af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a70c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a00d1050 0x7ff3a00b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a70c5640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a00d31e0 0x7ff3a00b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a70c5640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a00b6510 con 0x7ff3a00d31e0 2024-09-17T03:48:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a70c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a00b6390 con 0x7ff3a00d1050 2024-09-17T03:48:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a70c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a00b6690 con 0x7ff3a00cebc0 2024-09-17T03:48:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a5662640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a00d31e0 0x7ff3a00b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a5662640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a00d31e0 0x7ff3a00b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52130/0 (socket says 172.21.15.146:52130) 2024-09-17T03:48:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a5662640 1 -- 172.21.15.146:0/2843367427 learned_addr learned my addr 172.21.15.146:0/2843367427 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff397fff640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a00d1050 0x7ff3a00b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a4e61640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a00cebc0 0x7ff3a015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a5662640 1 -- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a00cebc0 msgr2=0x7ff3a015af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a5662640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a00cebc0 0x7ff3a015af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a5662640 1 -- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a00d1050 msgr2=0x7ff3a00b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a5662640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a00d1050 0x7ff3a00b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.403+0000 7ff3a5662640 1 -- 172.21.15.146:0/2843367427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a015b490 con 0x7ff3a00d31e0 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.404+0000 7ff3a5662640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a00d31e0 0x7ff3a00b4ae0 secure :-1 s=READY pgs=2787 cs=0 l=1 rev1=1 crypto rx=0x7ff398006010 tx=0x7ff398003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.404+0000 7ff3957fa640 1 -- 172.21.15.146:0/2843367427 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398044070 con 0x7ff3a00d31e0 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.404+0000 7ff3957fa640 1 -- 172.21.15.146:0/2843367427 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff398004040 con 0x7ff3a00d31e0 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.404+0000 7ff3a70c5640 1 -- 172.21.15.146:0/2843367427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a01f3d10 con 0x7ff3a00d31e0 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.404+0000 7ff3957fa640 1 -- 172.21.15.146:0/2843367427 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398004430 con 0x7ff3a00d31e0 2024-09-17T03:48:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.404+0000 7ff3a70c5640 1 -- 172.21.15.146:0/2843367427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a00ca880 con 0x7ff3a00d31e0 2024-09-17T03:48:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.405+0000 7ff3a70c5640 1 -- 172.21.15.146:0/2843367427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a00b6bb0 con 0x7ff3a00d31e0 2024-09-17T03:48:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.405+0000 7ff3957fa640 1 -- 172.21.15.146:0/2843367427 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff398047070 con 0x7ff3a00d31e0 2024-09-17T03:48:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.406+0000 7ff3957fa640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff38c078b90 0x7ff38c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.406+0000 7ff3957fa640 1 -- 172.21.15.146:0/2843367427 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7ff3980bbbc0 con 0x7ff3a00d31e0 2024-09-17T03:48:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.406+0000 7ff3a4e61640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff38c078b90 0x7ff38c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.407+0000 7ff3a4e61640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff38c078b90 0x7ff38c07b0a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff39c007fd0 tx=0x7ff39c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:24.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.411+0000 7ff3957fa640 1 -- 172.21.15.146:0/2843367427 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff3a015b490 con 0x7ff3a00d31e0 2024-09-17T03:48:24.618 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.618+0000 7ff3a70c5640 1 -- 172.21.15.146:0/2843367427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3a01e9110 con 0x7ff3a00d31e0 2024-09-17T03:48:24.619 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.619+0000 7ff3957fa640 1 -- 172.21.15.146:0/2843367427 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5252 (secure 0 0 0) 0x7ff398032030 con 0x7ff3a00d31e0 2024-09-17T03:48:24.619 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:24.619 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":169,"btime":"2024-09-17T03:47:20:289055+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":10288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2813416980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2813416980},{"type":"v1","addr":"172.21.15.179:6837","nonce":2813416980}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:47:06.858092+0000","modified":"2024-09-17T03:47:20.289043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":211,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11841":{"gid":11841,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6835/2488811693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2488811693},{"type":"v1","addr":"172.21.15.146:6835","nonce":2488811693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11841,"qdb_cluster":[11841]},"id":16}]} 2024-09-17T03:48:24.619 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 169 2024-09-17T03:48:24.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 -- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff38c078b90 msgr2=0x7ff38c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.621 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff38c078b90 0x7ff38c07b0a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff39c007fd0 tx=0x7ff39c009040 comp rx=0 tx=0).stop 2024-09-17T03:48:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 -- 172.21.15.146:0/2843367427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a00d31e0 msgr2=0x7ff3a00b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a00d31e0 0x7ff3a00b4ae0 secure :-1 s=READY pgs=2787 cs=0 l=1 rev1=1 crypto rx=0x7ff398006010 tx=0x7ff398003ce0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 -- 172.21.15.146:0/2843367427 shutdown_connections 2024-09-17T03:48:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff38c078b90 0x7ff38c07b0a0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3a00d31e0 0x7ff3a00b4ae0 unknown :-1 s=CLOSED pgs=2787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff3a00d1050 0x7ff3a00b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 --2- 172.21.15.146:0/2843367427 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff3a00cebc0 0x7ff3a015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 -- 172.21.15.146:0/2843367427 >> 172.21.15.146:0/2843367427 conn(0x7ff3a00d26c0 msgr2=0x7ff3a01e5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 -- 172.21.15.146:0/2843367427 shutdown_connections 2024-09-17T03:48:24.622 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.621+0000 7ff3a70c5640 1 -- 172.21.15.146:0/2843367427 wait complete. 2024-09-17T03:48:24.633 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:48:24.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.746+0000 7ff6e1f90640 1 -- 172.21.15.146:0/2499028382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6dc06f5b0 msgr2=0x7ff6dc06f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.746 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.746+0000 7ff6e1f90640 1 --2- 172.21.15.146:0/2499028382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6dc06f5b0 0x7ff6dc06f9c0 secure :-1 s=READY pgs=2789 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4005fd0 tx=0x7ff6d402a820 comp rx=0 tx=0).stop 2024-09-17T03:48:24.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.746+0000 7ff6e1f90640 1 -- 172.21.15.146:0/2499028382 shutdown_connections 2024-09-17T03:48:24.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.746+0000 7ff6e1f90640 1 --2- 172.21.15.146:0/2499028382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6dc06f5b0 0x7ff6dc06f9c0 unknown :-1 s=CLOSED pgs=2789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.746+0000 7ff6e1f90640 1 --2- 172.21.15.146:0/2499028382 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6dc0cd650 0x7ff6dc06f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.746+0000 7ff6e1f90640 1 -- 172.21.15.146:0/2499028382 >> 172.21.15.146:0/2499028382 conn(0x7ff6dc0b2240 msgr2=0x7ff6dc0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:24.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.746+0000 7ff6e1f90640 1 -- 172.21.15.146:0/2499028382 shutdown_connections 2024-09-17T03:48:24.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.746+0000 7ff6e1f90640 1 -- 172.21.15.146:0/2499028382 wait complete. 2024-09-17T03:48:24.747 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.748+0000 7ff6e1f90640 1 Processor -- start 2024-09-17T03:48:24.748 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.748+0000 7ff6e1f90640 1 -- start start 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.749+0000 7ff6e1f90640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6dc06f5b0 0x7ff6dc1f96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.749+0000 7ff6e1f90640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6dc0cdc00 0x7ff6dc0b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.749+0000 7ff6e1f90640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6dc0b4d20 0x7ff6dc0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.749+0000 7ff6e1f90640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc0afa60 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.749+0000 7ff6e1f90640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc06ff00 con 0x7ff6dc0cdc00 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.749+0000 7ff6e1f90640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff6dc0b3640 con 0x7ff6dc06f5b0 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.749+0000 7ff6dbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6dc0b4d20 0x7ff6dc0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.749+0000 7ff6dbfff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6dc0b4d20 0x7ff6dc0ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52142/0 (socket says 172.21.15.146:52142) 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.749+0000 7ff6dbfff640 1 -- 172.21.15.146:0/3052782747 learned_addr learned my addr 172.21.15.146:0/3052782747 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.749+0000 7ff6daffd640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6dc0cdc00 0x7ff6dc0b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.749+0000 7ff6db7fe640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6dc06f5b0 0x7ff6dc1f96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.751 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6dbfff640 1 -- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6dc06f5b0 msgr2=0x7ff6dc1f96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6dbfff640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6dc06f5b0 0x7ff6dc1f96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6dbfff640 1 -- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6dc0cdc00 msgr2=0x7ff6dc0b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6dbfff640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6dc0cdc00 0x7ff6dc0b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6dbfff640 1 -- 172.21.15.146:0/3052782747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc14c7a0 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6db7fe640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6dc06f5b0 0x7ff6dc1f96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:48:24.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6dbfff640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6dc0b4d20 0x7ff6dc0ae8b0 secure :-1 s=READY pgs=2790 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009cd0 tx=0x7ff6d4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:24.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6c3fff640 1 -- 172.21.15.146:0/3052782747 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4037040 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6c3fff640 1 -- 172.21.15.146:0/3052782747 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6d4042070 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6c3fff640 1 -- 172.21.15.146:0/3052782747 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4003e60 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6e1f90640 1 -- 172.21.15.146:0/3052782747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc1f5a80 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.752 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.750+0000 7ff6e1f90640 1 -- 172.21.15.146:0/3052782747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc14ec80 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.751+0000 7ff6e1f90640 1 -- 172.21.15.146:0/3052782747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6dc074060 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.752+0000 7ff6c3fff640 1 -- 172.21.15.146:0/3052782747 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff6d4004280 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.752+0000 7ff6c3fff640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6c8078b90 0x7ff6c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:24.753 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.753+0000 7ff6c3fff640 1 -- 172.21.15.146:0/3052782747 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7ff6d40bba90 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.753+0000 7ff6db7fe640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6c8078b90 0x7ff6c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:24.754 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.753+0000 7ff6db7fe640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6c8078b90 0x7ff6c807b0a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000f60 tx=0x7ff6cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:24.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.758+0000 7ff6c3fff640 1 -- 172.21.15.146:0/3052782747 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff6dc074060 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.934 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.934+0000 7ff6e1f90640 1 -- 172.21.15.146:0/3052782747 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6dc14c530 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.935 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.935+0000 7ff6c3fff640 1 -- 172.21.15.146:0/3052782747 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v211) ==== 74+0+16862 (secure 0 0 0) 0x7ff6d4083f00 con 0x7ff6dc0b4d20 2024-09-17T03:48:24.935 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:24.935 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":211,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:47:16.276788+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:47:04.485441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_data","create_time":"2024-09-17T03:47:05.816308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"210","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6837/3004139766":"2024-09-18T03:47:16.276758+0000","172.21.15.179:6835/3004139766":"2024-09-18T03:47:16.276758+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:48:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 -- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6c8078b90 msgr2=0x7ff6c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6c8078b90 0x7ff6c807b0a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000f60 tx=0x7ff6cc009040 comp rx=0 tx=0).stop 2024-09-17T03:48:24.937 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 -- 172.21.15.146:0/3052782747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6dc0b4d20 msgr2=0x7ff6dc0ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6dc0b4d20 0x7ff6dc0ae8b0 secure :-1 s=READY pgs=2790 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009cd0 tx=0x7ff6d4032d10 comp rx=0 tx=0).stop 2024-09-17T03:48:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 -- 172.21.15.146:0/3052782747 shutdown_connections 2024-09-17T03:48:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff6c8078b90 0x7ff6c807b0a0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6dc0b4d20 0x7ff6dc0ae8b0 unknown :-1 s=CLOSED pgs=2790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6dc0cdc00 0x7ff6dc0b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 --2- 172.21.15.146:0/3052782747 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff6dc06f5b0 0x7ff6dc1f96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 -- 172.21.15.146:0/3052782747 >> 172.21.15.146:0/3052782747 conn(0x7ff6dc0b2240 msgr2=0x7ff6dc0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 -- 172.21.15.146:0/3052782747 shutdown_connections 2024-09-17T03:48:24.938 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:24.937+0000 7ff6e1f90640 1 -- 172.21.15.146:0/3052782747 wait complete. 2024-09-17T03:48:24.949 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:48:24.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:48:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.062+0000 7f25ac470640 1 -- 172.21.15.146:0/76832396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a4164100 msgr2=0x7f25a4166520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.062+0000 7f25ac470640 1 --2- 172.21.15.146:0/76832396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a4164100 0x7f25a4166520 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f259c005fd0 tx=0x7f259c02a820 comp rx=0 tx=0).stop 2024-09-17T03:48:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.062+0000 7f25ac470640 1 -- 172.21.15.146:0/76832396 shutdown_connections 2024-09-17T03:48:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.062+0000 7f25ac470640 1 --2- 172.21.15.146:0/76832396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a4164100 0x7f25a4166520 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.062+0000 7f25ac470640 1 --2- 172.21.15.146:0/76832396 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a41617a0 0x7f25a4163bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.062+0000 7f25ac470640 1 -- 172.21.15.146:0/76832396 >> 172.21.15.146:0/76832396 conn(0x7f25a40b41b0 msgr2=0x7f25a40b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.062+0000 7f25ac470640 1 -- 172.21.15.146:0/76832396 shutdown_connections 2024-09-17T03:48:25.063 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.062+0000 7f25ac470640 1 -- 172.21.15.146:0/76832396 wait complete. 2024-09-17T03:48:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.064+0000 7f25ac470640 1 Processor -- start 2024-09-17T03:48:25.064 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.064+0000 7f25ac470640 1 -- start start 2024-09-17T03:48:25.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.065+0000 7f25ac470640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a41600b0 0x7f25a41661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.065+0000 7f25ac470640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a41617a0 0x7f25a41f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.065+0000 7f25ac470640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a4164100 0x7f25a41f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.065+0000 7f25ac470640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f25a4166df0 con 0x7f25a41600b0 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.065+0000 7f25ac470640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f25a4166c70 con 0x7f25a41617a0 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.065+0000 7f25ac470640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f25a4166f70 con 0x7f25a4164100 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.065+0000 7f25aa20c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a41600b0 0x7f25a41661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.065+0000 7f25aa20c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a41600b0 0x7f25a41661b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52156/0 (socket says 172.21.15.146:52156) 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.065+0000 7f25aa20c640 1 -- 172.21.15.146:0/3867541710 learned_addr learned my addr 172.21.15.146:0/3867541710 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f25a9a0b640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a41617a0 0x7f25a41f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f25aaa0d640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a4164100 0x7f25a41f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f25aa20c640 1 -- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a4164100 msgr2=0x7f25a41f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f25aa20c640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a4164100 0x7f25a41f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.067 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f25aa20c640 1 -- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a41617a0 msgr2=0x7f25a41f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f25aa20c640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a41617a0 0x7f25a41f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f25aa20c640 1 -- 172.21.15.146:0/3867541710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a41f72a0 con 0x7f25a41600b0 2024-09-17T03:48:25.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f25aa20c640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a41600b0 0x7f25a41661b0 secure :-1 s=READY pgs=2791 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c400 tx=0x7f25a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:25.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f259affd640 1 -- 172.21.15.146:0/3867541710 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a0011790 con 0x7f25a41600b0 2024-09-17T03:48:25.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f259affd640 1 -- 172.21.15.146:0/3867541710 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25a0017070 con 0x7f25a41600b0 2024-09-17T03:48:25.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f259affd640 1 -- 172.21.15.146:0/3867541710 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a0011cc0 con 0x7f25a41600b0 2024-09-17T03:48:25.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f25ac470640 1 -- 172.21.15.146:0/3867541710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a4143be0 con 0x7f25a41600b0 2024-09-17T03:48:25.068 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.066+0000 7f25ac470640 1 -- 172.21.15.146:0/3867541710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a41441a0 con 0x7f25a41600b0 2024-09-17T03:48:25.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.067+0000 7f25ac470640 1 -- 172.21.15.146:0/3867541710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a415af30 con 0x7f25a41600b0 2024-09-17T03:48:25.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.068+0000 7f259affd640 1 -- 172.21.15.146:0/3867541710 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f25a001c460 con 0x7f25a41600b0 2024-09-17T03:48:25.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.068+0000 7f259affd640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2588078b90 0x7f258807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.069+0000 7f259affd640 1 -- 172.21.15.146:0/3867541710 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f25a009aba0 con 0x7f25a41600b0 2024-09-17T03:48:25.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.069+0000 7f25a9a0b640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2588078b90 0x7f258807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.069 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.069+0000 7f25a9a0b640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2588078b90 0x7f258807b0a0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f25a41660d0 tx=0x7f2594005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:25.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.074+0000 7f259affd640 1 -- 172.21.15.146:0/3867541710 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f25a415af30 con 0x7f25a41600b0 2024-09-17T03:48:25.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.281+0000 7f25ac470640 1 -- 172.21.15.146:0/3867541710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25a40b65c0 con 0x7f25a41600b0 2024-09-17T03:48:25.281 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.281+0000 7f259affd640 1 -- 172.21.15.146:0/3867541710 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5252 (secure 0 0 0) 0x7f25a0062f80 con 0x7f25a41600b0 2024-09-17T03:48:25.282 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:25.282 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":169,"btime":"2024-09-17T03:47:20:289055+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":10288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2813416980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2813416980},{"type":"v1","addr":"172.21.15.179:6837","nonce":2813416980}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:47:06.858092+0000","modified":"2024-09-17T03:47:20.289043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":211,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11841":{"gid":11841,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6835/2488811693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2488811693},{"type":"v1","addr":"172.21.15.146:6835","nonce":2488811693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11841,"qdb_cluster":[11841]},"id":16}]} 2024-09-17T03:48:25.282 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 169 2024-09-17T03:48:25.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.283+0000 7f25ac470640 1 -- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2588078b90 msgr2=0x7f258807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.283+0000 7f25ac470640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2588078b90 0x7f258807b0a0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f25a41660d0 tx=0x7f2594005f90 comp rx=0 tx=0).stop 2024-09-17T03:48:25.284 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.283+0000 7f25ac470640 1 -- 172.21.15.146:0/3867541710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a41600b0 msgr2=0x7f25a41661b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.283+0000 7f25ac470640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a41600b0 0x7f25a41661b0 secure :-1 s=READY pgs=2791 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c400 tx=0x7f25a000c8c0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.284+0000 7f25ac470640 1 -- 172.21.15.146:0/3867541710 shutdown_connections 2024-09-17T03:48:25.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.284+0000 7f25ac470640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2588078b90 0x7f258807b0a0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.284+0000 7f25ac470640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f25a4164100 0x7f25a41f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.284+0000 7f25ac470640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f25a41617a0 0x7f25a41f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.284+0000 7f25ac470640 1 --2- 172.21.15.146:0/3867541710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f25a41600b0 0x7f25a41661b0 unknown :-1 s=CLOSED pgs=2791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.284+0000 7f25ac470640 1 -- 172.21.15.146:0/3867541710 >> 172.21.15.146:0/3867541710 conn(0x7f25a40b41b0 msgr2=0x7f25a4075d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:25.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.284+0000 7f25ac470640 1 -- 172.21.15.146:0/3867541710 shutdown_connections 2024-09-17T03:48:25.285 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.284+0000 7f25ac470640 1 -- 172.21.15.146:0/3867541710 wait complete. 2024-09-17T03:48:25.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:48:25.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.410+0000 7f7a03484640 1 -- 172.21.15.146:0/327418120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79e80040a0 msgr2=0x7f79e8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.410 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.410+0000 7f7a03484640 1 --2- 172.21.15.146:0/327418120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79e80040a0 0x7f79e8004800 secure :-1 s=READY pgs=2793 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00baf0 tx=0x7f79e8005830 comp rx=0 tx=0).stop 2024-09-17T03:48:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.410+0000 7f7a01a21640 1 -- 172.21.15.146:0/327418120 reap_dead start 2024-09-17T03:48:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.410+0000 7f7a03484640 1 -- 172.21.15.146:0/327418120 shutdown_connections 2024-09-17T03:48:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.410+0000 7f7a03484640 1 -- 172.21.15.146:0/327418120 >> 172.21.15.146:0/327418120 conn(0x7f79fc0b2240 msgr2=0x7f79fc0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.410+0000 7f7a03484640 1 -- 172.21.15.146:0/327418120 shutdown_connections 2024-09-17T03:48:25.411 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.410+0000 7f7a03484640 1 -- 172.21.15.146:0/327418120 wait complete. 2024-09-17T03:48:25.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.412+0000 7f7a03484640 1 Processor -- start 2024-09-17T03:48:25.412 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.412+0000 7f7a03484640 1 -- start start 2024-09-17T03:48:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.413+0000 7f7a03484640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80040a0 0x7f79fc149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.413+0000 7f7a03484640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79fc0aa4a0 0x7f79fc0cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.414 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.413+0000 7f7a03484640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79fc14cc80 0x7f79fc0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.413+0000 7f7a03484640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc15bb00 con 0x7f79fc14cc80 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.413+0000 7f7a03484640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc0707a0 con 0x7f79e80040a0 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.413+0000 7f7a03484640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f79fc15bc80 con 0x7f79fc0aa4a0 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.413+0000 7f7a01a21640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79fc14cc80 0x7f79fc0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.413+0000 7f7a01a21640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79fc14cc80 0x7f79fc0cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52168/0 (socket says 172.21.15.146:52168) 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.413+0000 7f7a01a21640 1 -- 172.21.15.146:0/1105526449 learned_addr learned my addr 172.21.15.146:0/1105526449 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a00a1f640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79fc0aa4a0 0x7f79fc0cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a01220640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80040a0 0x7f79fc149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a01a21640 1 -- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79fc0aa4a0 msgr2=0x7f79fc0cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a01a21640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79fc0aa4a0 0x7f79fc0cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a01a21640 1 -- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80040a0 msgr2=0x7f79fc149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a01a21640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80040a0 0x7f79fc149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.415 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a01a21640 1 -- 172.21.15.146:0/1105526449 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc1555e0 con 0x7f79fc14cc80 2024-09-17T03:48:25.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a00a1f640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79fc0aa4a0 0x7f79fc0cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:48:25.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a01220640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80040a0 0x7f79fc149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:48:25.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a01a21640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79fc14cc80 0x7f79fc0cf630 secure :-1 s=READY pgs=2794 cs=0 l=1 rev1=1 crypto rx=0x7f79fc074730 tx=0x7f79f4009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:25.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f79f1ffb640 1 -- 172.21.15.146:0/1105526449 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f4004b20 con 0x7f79fc14cc80 2024-09-17T03:48:25.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f79f1ffb640 1 -- 172.21.15.146:0/1105526449 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79f4004dd0 con 0x7f79fc14cc80 2024-09-17T03:48:25.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f79f1ffb640 1 -- 172.21.15.146:0/1105526449 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f400faf0 con 0x7f79fc14cc80 2024-09-17T03:48:25.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a03484640 1 -- 172.21.15.146:0/1105526449 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79fc1f6f50 con 0x7f79fc14cc80 2024-09-17T03:48:25.416 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.414+0000 7f7a03484640 1 -- 172.21.15.146:0/1105526449 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79fc1f7510 con 0x7f79fc14cc80 2024-09-17T03:48:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.415+0000 7f7a03484640 1 -- 172.21.15.146:0/1105526449 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79fc155350 con 0x7f79fc14cc80 2024-09-17T03:48:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.416+0000 7f79f1ffb640 1 -- 172.21.15.146:0/1105526449 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79f401b020 con 0x7f79fc14cc80 2024-09-17T03:48:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.416+0000 7f79f1ffb640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79e0078b90 0x7f79e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.417+0000 7f79f1ffb640 1 -- 172.21.15.146:0/1105526449 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f79f409add0 con 0x7f79fc14cc80 2024-09-17T03:48:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.417+0000 7f7a01220640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79e0078b90 0x7f79e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.418 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.417+0000 7f7a01220640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79e0078b90 0x7f79e007b0a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f79f8001eb0 tx=0x7f79f8000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:25.425 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.421+0000 7f79f1ffb640 1 -- 172.21.15.146:0/1105526449 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f79f4063240 con 0x7f79fc14cc80 2024-09-17T03:48:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.630+0000 7f7a03484640 1 -- 172.21.15.146:0/1105526449 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79fc06ff60 con 0x7f79fc14cc80 2024-09-17T03:48:25.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.630+0000 7f79f1ffb640 1 -- 172.21.15.146:0/1105526449 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 169 v169) ==== 95+0+5252 (secure 0 0 0) 0x7f79f409c090 con 0x7f79fc14cc80 2024-09-17T03:48:25.630 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:25.631 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":169,"btime":"2024-09-17T03:47:20:289055+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":10288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2813416980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2813416980},{"type":"v1","addr":"172.21.15.179:6837","nonce":2813416980}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157}],"filesystems":[{"mdsmap":{"epoch":169,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:47:06.858092+0000","modified":"2024-09-17T03:47:20.289043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":211,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11841},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11841":{"gid":11841,"name":"c","rank":0,"incarnation":166,"state":"up:active","state_seq":7,"addr":"172.21.15.146:6835/2488811693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2488811693},{"type":"v1","addr":"172.21.15.146:6835","nonce":2488811693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11841,"qdb_cluster":[11841]},"id":16}]} 2024-09-17T03:48:25.631 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 169 2024-09-17T03:48:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.632+0000 7f7a03484640 1 -- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79e0078b90 msgr2=0x7f79e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.632+0000 7f7a03484640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79e0078b90 0x7f79e007b0a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f79f8001eb0 tx=0x7f79f8000ed0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.632+0000 7f7a03484640 1 -- 172.21.15.146:0/1105526449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79fc14cc80 msgr2=0x7f79fc0cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.632+0000 7f7a03484640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79fc14cc80 0x7f79fc0cf630 secure :-1 s=READY pgs=2794 cs=0 l=1 rev1=1 crypto rx=0x7f79fc074730 tx=0x7f79f4009b40 comp rx=0 tx=0).stop 2024-09-17T03:48:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.632+0000 7f7a03484640 1 -- 172.21.15.146:0/1105526449 shutdown_connections 2024-09-17T03:48:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.632+0000 7f7a03484640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f79e0078b90 0x7f79e007b0a0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.632+0000 7f7a03484640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79fc14cc80 0x7f79fc0cf630 unknown :-1 s=CLOSED pgs=2794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.632+0000 7f7a03484640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f79fc0aa4a0 0x7f79fc0cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.632+0000 7f7a03484640 1 --2- 172.21.15.146:0/1105526449 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f79e80040a0 0x7f79fc149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.632+0000 7f7a03484640 1 -- 172.21.15.146:0/1105526449 >> 172.21.15.146:0/1105526449 conn(0x7f79fc0b2240 msgr2=0x7f79fc15cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:25.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.634+0000 7f7a03484640 1 -- 172.21.15.146:0/1105526449 shutdown_connections 2024-09-17T03:48:25.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.634+0000 7f7a03484640 1 -- 172.21.15.146:0/1105526449 wait complete. 2024-09-17T03:48:25.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:48:25.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.758+0000 7f01b6e94640 1 -- 172.21.15.146:0/1198434402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01b015cbe0 msgr2=0x7f01b00d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.758+0000 7f01b6e94640 1 --2- 172.21.15.146:0/1198434402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01b015cbe0 0x7f01b00d0b10 secure :-1 s=READY pgs=2796 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009860 tx=0x7f01a002a540 comp rx=0 tx=0).stop 2024-09-17T03:48:25.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.758+0000 7f01b6e94640 1 -- 172.21.15.146:0/1198434402 shutdown_connections 2024-09-17T03:48:25.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.758+0000 7f01b6e94640 1 --2- 172.21.15.146:0/1198434402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01b015cbe0 0x7f01b00d0b10 unknown :-1 s=CLOSED pgs=2796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.758+0000 7f01b6e94640 1 --2- 172.21.15.146:0/1198434402 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b00d31e0 0x7f01b00cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.758+0000 7f01b6e94640 1 -- 172.21.15.146:0/1198434402 >> 172.21.15.146:0/1198434402 conn(0x7f01b00d26c0 msgr2=0x7f01b00d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:25.757 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.758+0000 7f01b6e94640 1 -- 172.21.15.146:0/1198434402 shutdown_connections 2024-09-17T03:48:25.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.758+0000 7f01b6e94640 1 -- 172.21.15.146:0/1198434402 wait complete. 2024-09-17T03:48:25.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.759+0000 7f01b6e94640 1 Processor -- start 2024-09-17T03:48:25.758 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.759+0000 7f01b6e94640 1 -- start start 2024-09-17T03:48:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b6e94640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01b00d1050 0x7f01b01f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b6e94640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b00d31e0 0x7f01b009fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b6e94640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b015cbe0 0x7f01b015e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b6e94640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f01b00cd7b0 con 0x7f01b00d1050 2024-09-17T03:48:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b6e94640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f01b00b6e00 con 0x7f01b015cbe0 2024-09-17T03:48:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b6e94640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f01b00cd930 con 0x7f01b00d31e0 2024-09-17T03:48:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b4c30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01b00d1050 0x7f01b01f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b4c30640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01b00d1050 0x7f01b01f2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52176/0 (socket says 172.21.15.146:52176) 2024-09-17T03:48:25.762 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b4c30640 1 -- 172.21.15.146:0/1807542492 learned_addr learned my addr 172.21.15.146:0/1807542492 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b5431640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b015cbe0 0x7f01b015e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01a7fff640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b00d31e0 0x7f01b009fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b4c30640 1 -- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b00d31e0 msgr2=0x7f01b009fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b4c30640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b00d31e0 0x7f01b009fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b4c30640 1 -- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b015cbe0 msgr2=0x7f01b015e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b4c30640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b015cbe0 0x7f01b015e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b4c30640 1 -- 172.21.15.146:0/1807542492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b01f4910 con 0x7f01b00d1050 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b5431640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b015cbe0 0x7f01b015e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.761+0000 7f01b4c30640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01b00d1050 0x7f01b01f2dd0 secure :-1 s=READY pgs=2797 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00c940 tx=0x7f01ac00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.762+0000 7f01a57fa640 1 -- 172.21.15.146:0/1807542492 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac004220 con 0x7f01b00d1050 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.762+0000 7f01a57fa640 1 -- 172.21.15.146:0/1807542492 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01ac0079b0 con 0x7f01b00d1050 2024-09-17T03:48:25.763 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.762+0000 7f01a57fa640 1 -- 172.21.15.146:0/1807542492 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac007e00 con 0x7f01b00d1050 2024-09-17T03:48:25.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.762+0000 7f01b6e94640 1 -- 172.21.15.146:0/1807542492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b01f4bf0 con 0x7f01b00d1050 2024-09-17T03:48:25.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.762+0000 7f01b6e94640 1 -- 172.21.15.146:0/1807542492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b01f51b0 con 0x7f01b00d1050 2024-09-17T03:48:25.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.763+0000 7f01b6e94640 1 -- 172.21.15.146:0/1807542492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b00cde50 con 0x7f01b00d1050 2024-09-17T03:48:25.764 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.764+0000 7f01a57fa640 1 -- 172.21.15.146:0/1807542492 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01ac005030 con 0x7f01b00d1050 2024-09-17T03:48:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.764+0000 7f01a57fa640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f019c078b90 0x7f019c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.764+0000 7f01a57fa640 1 -- 172.21.15.146:0/1807542492 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7f01ac09b320 con 0x7f01b00d1050 2024-09-17T03:48:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.764+0000 7f01a7fff640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f019c078b90 0x7f019c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.765+0000 7f01a7fff640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f019c078b90 0x7f019c07b0a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f01a0034000 tx=0x7f01a0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:25.767 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.769+0000 7f01a57fa640 1 -- 172.21.15.146:0/1807542492 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01ac014070 con 0x7f01b00d1050 2024-09-17T03:48:25.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.943+0000 7f01b6e94640 1 -- 172.21.15.146:0/1807542492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01b01f5650 con 0x7f01b00d1050 2024-09-17T03:48:25.943 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.944+0000 7f01a57fa640 1 -- 172.21.15.146:0/1807542492 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v211) ==== 74+0+16862 (secure 0 0 0) 0x7f01ac063680 con 0x7f01b00d1050 2024-09-17T03:48:25.944 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:25.944 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":211,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:47:16.276788+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:47:04.485441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"209","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_data","create_time":"2024-09-17T03:47:05.816308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"210","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.179:6837/3004139766":"2024-09-18T03:47:16.276758+0000","172.21.15.179:6835/3004139766":"2024-09-18T03:47:16.276758+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:48:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.946+0000 7f01b6e94640 1 -- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f019c078b90 msgr2=0x7f019c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.946+0000 7f01b6e94640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f019c078b90 0x7f019c07b0a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f01a0034000 tx=0x7f01a0004730 comp rx=0 tx=0).stop 2024-09-17T03:48:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.947+0000 7f01b6e94640 1 -- 172.21.15.146:0/1807542492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01b00d1050 msgr2=0x7f01b01f2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.947+0000 7f01b6e94640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01b00d1050 0x7f01b01f2dd0 secure :-1 s=READY pgs=2797 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00c940 tx=0x7f01ac00ce00 comp rx=0 tx=0).stop 2024-09-17T03:48:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.947+0000 7f01b6e94640 1 -- 172.21.15.146:0/1807542492 shutdown_connections 2024-09-17T03:48:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.947+0000 7f01b6e94640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f019c078b90 0x7f019c07b0a0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.947+0000 7f01b6e94640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01b015cbe0 0x7f01b015e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.947+0000 7f01b6e94640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f01b00d31e0 0x7f01b009fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.947+0000 7f01b6e94640 1 --2- 172.21.15.146:0/1807542492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01b00d1050 0x7f01b01f2dd0 unknown :-1 s=CLOSED pgs=2797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:25.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.947+0000 7f01b6e94640 1 -- 172.21.15.146:0/1807542492 >> 172.21.15.146:0/1807542492 conn(0x7f01b00d26c0 msgr2=0x7f01b015bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:25.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.947+0000 7f01b6e94640 1 -- 172.21.15.146:0/1807542492 shutdown_connections 2024-09-17T03:48:25.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:25.947+0000 7f01b6e94640 1 -- 172.21.15.146:0/1807542492 wait complete. 2024-09-17T03:48:25.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:48:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.073+0000 7fb24f38a640 1 -- 172.21.15.146:0/3150452512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb234005350 msgr2=0x7fb23400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.073+0000 7fb24f38a640 1 --2- 172.21.15.146:0/3150452512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb234005350 0x7fb23400b9c0 secure :-1 s=READY pgs=2799 cs=0 l=1 rev1=1 crypto rx=0x7fb240001d90 tx=0x7fb234005830 comp rx=0 tx=0).stop 2024-09-17T03:48:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.073+0000 7fb24f38a640 1 -- 172.21.15.146:0/3150452512 shutdown_connections 2024-09-17T03:48:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.073+0000 7fb24f38a640 1 --2- 172.21.15.146:0/3150452512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb234005350 0x7fb23400b9c0 unknown :-1 s=CLOSED pgs=2799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.073+0000 7fb24f38a640 1 -- 172.21.15.146:0/3150452512 >> 172.21.15.146:0/3150452512 conn(0x7fb2480b3880 msgr2=0x7fb2480d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.073+0000 7fb24f38a640 1 -- 172.21.15.146:0/3150452512 shutdown_connections 2024-09-17T03:48:26.073 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.073+0000 7fb24f38a640 1 -- 172.21.15.146:0/3150452512 wait complete. 2024-09-17T03:48:26.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.075+0000 7fb24f38a640 1 Processor -- start 2024-09-17T03:48:26.074 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.075+0000 7fb24f38a640 1 -- start start 2024-09-17T03:48:26.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.076+0000 7fb24f38a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb234005350 0x7fb248159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:26.077 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.076+0000 7fb24f38a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2481f7980 0x7fb248156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:26.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.076+0000 7fb24f38a640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb24813f700 0x7fb24814f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:26.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.076+0000 7fb24f38a640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fb24815cd30 con 0x7fb24813f700 2024-09-17T03:48:26.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.076+0000 7fb24f38a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb24815cbb0 con 0x7fb234005350 2024-09-17T03:48:26.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.076+0000 7fb24f38a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb2480739c0 con 0x7fb2481f7980 2024-09-17T03:48:26.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.076+0000 7fb24d927640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb24813f700 0x7fb24814f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:26.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.076+0000 7fb24d927640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb24813f700 0x7fb24814f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52202/0 (socket says 172.21.15.146:52202) 2024-09-17T03:48:26.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.076+0000 7fb24d927640 1 -- 172.21.15.146:0/264346266 learned_addr learned my addr 172.21.15.146:0/264346266 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:26.078 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb24d126640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb234005350 0x7fb248159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb24c925640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2481f7980 0x7fb248156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb24d927640 1 -- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2481f7980 msgr2=0x7fb248156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb24d927640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2481f7980 0x7fb248156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb24d927640 1 -- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb234005350 msgr2=0x7fb248159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb24d927640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb234005350 0x7fb248159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb24d927640 1 -- 172.21.15.146:0/264346266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2481583e0 con 0x7fb24813f700 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb24d126640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb234005350 0x7fb248159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb24d927640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb24813f700 0x7fb24814f600 secure :-1 s=READY pgs=2800 cs=0 l=1 rev1=1 crypto rx=0x7fb240001eb0 tx=0x7fb240006ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb23dffb640 1 -- 172.21.15.146:0/264346266 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240003d80 con 0x7fb24813f700 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb23dffb640 1 -- 172.21.15.146:0/264346266 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb240005b00 con 0x7fb24813f700 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb24f38a640 1 -- 172.21.15.146:0/264346266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2481586c0 con 0x7fb24813f700 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb23dffb640 1 -- 172.21.15.146:0/264346266 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240005ed0 con 0x7fb24813f700 2024-09-17T03:48:26.079 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.077+0000 7fb24f38a640 1 -- 172.21.15.146:0/264346266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb248158c80 con 0x7fb24813f700 2024-09-17T03:48:26.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.078+0000 7fb24f38a640 1 -- 172.21.15.146:0/264346266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb24815f540 con 0x7fb24813f700 2024-09-17T03:48:26.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.079+0000 7fb23dffb640 1 -- 172.21.15.146:0/264346266 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb240006070 con 0x7fb24813f700 2024-09-17T03:48:26.080 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.079+0000 7fb23dffb640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb22c078b90 0x7fb22c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:26.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.080+0000 7fb23dffb640 1 -- 172.21.15.146:0/264346266 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5795+0+0 (secure 0 0 0) 0x7fb2400bace0 con 0x7fb24813f700 2024-09-17T03:48:26.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.080+0000 7fb24d126640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb22c078b90 0x7fb22c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:26.081 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.080+0000 7fb24d126640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb22c078b90 0x7fb22c07b0a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb244009ac0 tx=0x7fb244005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:26.083 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.084+0000 7fb23dffb640 1 -- 172.21.15.146:0/264346266 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb240083150 con 0x7fb24813f700 2024-09-17T03:48:26.294 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.295+0000 7fb24f38a640 1 -- 172.21.15.146:0/264346266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb24806e6f0 con 0x7fb24813f700 2024-09-17T03:48:26.294 INFO:tasks.ceph.mon.a.smithi146.stderr:2024-09-17T03:48:26.296+0000 7f82d5c1b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:48:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.299+0000 7fb23dffb640 1 -- 172.21.15.146:0/264346266 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v170) ==== 161+0+0 (secure 0 0 0) 0x7fb240082a50 con 0x7fb24813f700 2024-09-17T03:48:26.298 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:48:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 -- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb22c078b90 msgr2=0x7fb22c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb22c078b90 0x7fb22c07b0a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb244009ac0 tx=0x7fb244005f30 comp rx=0 tx=0).stop 2024-09-17T03:48:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 -- 172.21.15.146:0/264346266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb24813f700 msgr2=0x7fb24814f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb24813f700 0x7fb24814f600 secure :-1 s=READY pgs=2800 cs=0 l=1 rev1=1 crypto rx=0x7fb240001eb0 tx=0x7fb240006ca0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 -- 172.21.15.146:0/264346266 shutdown_connections 2024-09-17T03:48:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fb22c078b90 0x7fb22c07b0a0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb24813f700 0x7fb24814f600 unknown :-1 s=CLOSED pgs=2800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb2481f7980 0x7fb248156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 --2- 172.21.15.146:0/264346266 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb234005350 0x7fb248159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 -- 172.21.15.146:0/264346266 >> 172.21.15.146:0/264346266 conn(0x7fb2480b3880 msgr2=0x7fb248159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 -- 172.21.15.146:0/264346266 shutdown_connections 2024-09-17T03:48:26.302 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.301+0000 7fb24f38a640 1 -- 172.21.15.146:0/264346266 wait complete. 2024-09-17T03:48:26.305 INFO:tasks.ceph.mds.c.smithi146.stderr: -2457> 2024-09-17T03:47:24.462+0000 7fe9d8b65640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:48:26.314 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:48:26.358 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2024-09-17T03:48:26.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.431+0000 7fc678270640 1 -- 172.21.15.146:0/3481161461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6700b1580 msgr2=0x7fc6700b7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:26.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.431+0000 7fc678270640 1 --2- 172.21.15.146:0/3481161461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6700b1580 0x7fc6700b7d00 secure :-1 s=READY pgs=2804 cs=0 l=1 rev1=1 crypto rx=0x7fc66c005fd0 tx=0x7fc66c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.431+0000 7fc678270640 1 -- 172.21.15.146:0/3481161461 shutdown_connections 2024-09-17T03:48:26.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.431+0000 7fc678270640 1 --2- 172.21.15.146:0/3481161461 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6700cefd0 0x7fc6700cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.431+0000 7fc678270640 1 --2- 172.21.15.146:0/3481161461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6700b1580 0x7fc6700b7d00 unknown :-1 s=CLOSED pgs=2804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.431+0000 7fc678270640 1 -- 172.21.15.146:0/3481161461 >> 172.21.15.146:0/3481161461 conn(0x7fc6700d26a0 msgr2=0x7fc6700d2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:26.431 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.431+0000 7fc678270640 1 -- 172.21.15.146:0/3481161461 shutdown_connections 2024-09-17T03:48:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.431+0000 7fc678270640 1 -- 172.21.15.146:0/3481161461 wait complete. 2024-09-17T03:48:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.433+0000 7fc678270640 1 Processor -- start 2024-09-17T03:48:26.432 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.433+0000 7fc678270640 1 -- start start 2024-09-17T03:48:26.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.434+0000 7fc678270640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6700afc50 0x7fc67009fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:26.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.434+0000 7fc678270640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6700b1580 0x7fc6701f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:26.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.434+0000 7fc678270640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6700cefd0 0x7fc6700b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:26.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.434+0000 7fc678270640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc6700b0770 con 0x7fc6700afc50 2024-09-17T03:48:26.435 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.434+0000 7fc678270640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc6700ce4c0 con 0x7fc6700cefd0 2024-09-17T03:48:26.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.434+0000 7fc678270640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc6700b08f0 con 0x7fc6700b1580 2024-09-17T03:48:26.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.434+0000 7fc67600c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6700afc50 0x7fc67009fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:26.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc67600c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6700afc50 0x7fc67009fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52230/0 (socket says 172.21.15.146:52230) 2024-09-17T03:48:26.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc67600c640 1 -- 172.21.15.146:0/38134508 learned_addr learned my addr 172.21.15.146:0/38134508 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:26.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc67580b640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6700b1580 0x7fc6701f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:26.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc67680d640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6700cefd0 0x7fc6700b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:26.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc67600c640 1 -- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6700b1580 msgr2=0x7fc6701f6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:26.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc67600c640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6700b1580 0x7fc6701f6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc67600c640 1 -- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6700cefd0 msgr2=0x7fc6700b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:26.436 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc67600c640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6700cefd0 0x7fc6700b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc67600c640 1 -- 172.21.15.146:0/38134508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6701f7c60 con 0x7fc6700afc50 2024-09-17T03:48:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc67680d640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6700cefd0 0x7fc6700b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:48:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc67600c640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6700afc50 0x7fc67009fc30 secure :-1 s=READY pgs=2805 cs=0 l=1 rev1=1 crypto rx=0x7fc66c006010 tx=0x7fc66c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc662ffd640 1 -- 172.21.15.146:0/38134508 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c03e030 con 0x7fc6700afc50 2024-09-17T03:48:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc662ffd640 1 -- 172.21.15.146:0/38134508 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc66c003ca0 con 0x7fc6700afc50 2024-09-17T03:48:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc662ffd640 1 -- 172.21.15.146:0/38134508 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c035040 con 0x7fc6700afc50 2024-09-17T03:48:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc678270640 1 -- 172.21.15.146:0/38134508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6701f3b30 con 0x7fc6700afc50 2024-09-17T03:48:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.435+0000 7fc678270640 1 -- 172.21.15.146:0/38134508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc67009d0e0 con 0x7fc6700afc50 2024-09-17T03:48:26.437 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.436+0000 7fc678270640 1 -- 172.21.15.146:0/38134508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6701f3940 con 0x7fc6700afc50 2024-09-17T03:48:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.437+0000 7fc662ffd640 1 -- 172.21.15.146:0/38134508 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc66c041030 con 0x7fc6700afc50 2024-09-17T03:48:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.437+0000 7fc662ffd640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc654078bc0 0x7fc65407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.437+0000 7fc662ffd640 1 -- 172.21.15.146:0/38134508 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 5881+0+0 (secure 0 0 0) 0x7fc66c0bb410 con 0x7fc6700afc50 2024-09-17T03:48:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.438+0000 7fc67580b640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc654078bc0 0x7fc65407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.438+0000 7fc67580b640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc654078bc0 0x7fc65407b0d0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fc66400bb00 tx=0x7fc664005e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:26.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.442+0000 7fc662ffd640 1 -- 172.21.15.146:0/38134508 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc66c0837b0 con 0x7fc6700afc50 2024-09-17T03:48:26.654 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:26.655+0000 7fc678270640 1 -- 172.21.15.146:0/38134508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc6700b0da0 con 0x7fc6700afc50 2024-09-17T03:48:27.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.302+0000 7fc662ffd640 1 -- 172.21.15.146:0/38134508 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v171) ==== 104+0+0 (secure 0 0 0) 0x7fc66c0830b0 con 0x7fc6700afc50 2024-09-17T03:48:27.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 -- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc654078bc0 msgr2=0x7fc65407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:27.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc654078bc0 0x7fc65407b0d0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fc66400bb00 tx=0x7fc664005e30 comp rx=0 tx=0).stop 2024-09-17T03:48:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 -- 172.21.15.146:0/38134508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6700afc50 msgr2=0x7fc67009fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6700afc50 0x7fc67009fc30 secure :-1 s=READY pgs=2805 cs=0 l=1 rev1=1 crypto rx=0x7fc66c006010 tx=0x7fc66c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:48:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 -- 172.21.15.146:0/38134508 shutdown_connections 2024-09-17T03:48:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc654078bc0 0x7fc65407b0d0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc6700cefd0 0x7fc6700b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:27.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6700b1580 0x7fc6701f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 --2- 172.21.15.146:0/38134508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6700afc50 0x7fc67009fc30 unknown :-1 s=CLOSED pgs=2805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 -- 172.21.15.146:0/38134508 >> 172.21.15.146:0/38134508 conn(0x7fc6700d26a0 msgr2=0x7fc670070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 -- 172.21.15.146:0/38134508 shutdown_connections 2024-09-17T03:48:27.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.305+0000 7fc678270640 1 -- 172.21.15.146:0/38134508 wait complete. 2024-09-17T03:48:27.318 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:48:27.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.441+0000 7ff8b2de4640 1 -- 172.21.15.146:0/611012644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8ac0d3400 msgr2=0x7ff8ac06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.441+0000 7ff8b2de4640 1 --2- 172.21.15.146:0/611012644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8ac0d3400 0x7ff8ac06d290 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff894005fd0 tx=0x7ff89402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:48:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.441+0000 7ff8b2de4640 1 -- 172.21.15.146:0/611012644 shutdown_connections 2024-09-17T03:48:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.441+0000 7ff8b2de4640 1 --2- 172.21.15.146:0/611012644 >> v2:172.21.15.179:3300/0 conn(0x7ff8ac0d1c70 0x7ff8ac06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.441+0000 7ff8b2de4640 1 --2- 172.21.15.146:0/611012644 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8ac0d3400 0x7ff8ac06d290 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.441+0000 7ff8b2de4640 1 -- 172.21.15.146:0/611012644 >> 172.21.15.146:0/611012644 conn(0x7ff8ac09ddc0 msgr2=0x7ff8ac0d4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.441+0000 7ff8b2de4640 1 -- 172.21.15.146:0/611012644 shutdown_connections 2024-09-17T03:48:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.441+0000 7ff8b2de4640 1 -- 172.21.15.146:0/611012644 wait complete. 2024-09-17T03:48:27.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.442+0000 7ff8b2de4640 1 Processor -- start 2024-09-17T03:48:27.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.443+0000 7ff8b2de4640 1 -- start start 2024-09-17T03:48:27.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b2de4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8ac0b9cc0 0x7ff8ac0ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:27.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b2de4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8ac0d1c70 0x7ff8ac15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:27.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b2de4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8ac0cd2e0 0x7ff8ac0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b2de4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac06e120 con 0x7ff8ac0cd2e0 2024-09-17T03:48:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b2de4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac06dfa0 con 0x7ff8ac0b9cc0 2024-09-17T03:48:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b2de4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff8ac06e2a0 con 0x7ff8ac0d1c70 2024-09-17T03:48:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b1381640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8ac0cd2e0 0x7ff8ac0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:27.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b0b80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8ac0b9cc0 0x7ff8ac0ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b1381640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8ac0cd2e0 0x7ff8ac0cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48928/0 (socket says 172.21.15.146:48928) 2024-09-17T03:48:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b1381640 1 -- 172.21.15.146:0/432132138 learned_addr learned my addr 172.21.15.146:0/432132138 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8abfff640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8ac0d1c70 0x7ff8ac15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b1381640 1 -- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8ac0d1c70 msgr2=0x7ff8ac15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b1381640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8ac0d1c70 0x7ff8ac15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:27.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b1381640 1 -- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8ac0b9cc0 msgr2=0x7ff8ac0ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b1381640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8ac0b9cc0 0x7ff8ac0ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.444+0000 7ff8b1381640 1 -- 172.21.15.146:0/432132138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ac0cdc30 con 0x7ff8ac0cd2e0 2024-09-17T03:48:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.445+0000 7ff8b1381640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8ac0cd2e0 0x7ff8ac0cd6f0 secure :-1 s=READY pgs=2806 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400e8d0 tx=0x7ff8a400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.445+0000 7ff8a97fa640 1 -- 172.21.15.146:0/432132138 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400ccc0 con 0x7ff8ac0cd2e0 2024-09-17T03:48:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.445+0000 7ff8a97fa640 1 -- 172.21.15.146:0/432132138 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8a400ce60 con 0x7ff8ac0cd2e0 2024-09-17T03:48:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.445+0000 7ff8b2de4640 1 -- 172.21.15.146:0/432132138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ac1f5ba0 con 0x7ff8ac0cd2e0 2024-09-17T03:48:27.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.445+0000 7ff8a97fa640 1 -- 172.21.15.146:0/432132138 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4004280 con 0x7ff8ac0cd2e0 2024-09-17T03:48:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.445+0000 7ff8b2de4640 1 -- 172.21.15.146:0/432132138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8ac1f6160 con 0x7ff8ac0cd2e0 2024-09-17T03:48:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.446+0000 7ff8b2de4640 1 -- 172.21.15.146:0/432132138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8ac06e750 con 0x7ff8ac0cd2e0 2024-09-17T03:48:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.446+0000 7ff8a97fa640 1 -- 172.21.15.146:0/432132138 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8a40035f0 con 0x7ff8ac0cd2e0 2024-09-17T03:48:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.447+0000 7ff8a97fa640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff88c078b90 0x7ff88c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.447+0000 7ff8a97fa640 1 -- 172.21.15.146:0/432132138 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 5881+0+0 (secure 0 0 0) 0x7ff8a409b6d0 con 0x7ff8ac0cd2e0 2024-09-17T03:48:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.447+0000 7ff8b0b80640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff88c078b90 0x7ff88c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.448+0000 7ff8b0b80640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff88c078b90 0x7ff88c07b0a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7ff89c007fd0 tx=0x7ff89c001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:27.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.452+0000 7ff8a97fa640 1 -- 172.21.15.146:0/432132138 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff8ac0cdc30 con 0x7ff8ac0cd2e0 2024-09-17T03:48:27.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:27.631+0000 7ff8b2de4640 1 -- 172.21.15.146:0/432132138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff8ac0b2b60 con 0x7ff8ac0cd2e0 2024-09-17T03:48:28.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.308+0000 7ff8a97fa640 1 -- 172.21.15.146:0/432132138 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v213) ==== 181+0+0 (secure 0 0 0) 0x7ff8a4063390 con 0x7ff8ac0cd2e0 2024-09-17T03:48:28.307 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:48:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.311+0000 7ff8b2de4640 1 -- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff88c078b90 msgr2=0x7ff88c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.311+0000 7ff8b2de4640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff88c078b90 0x7ff88c07b0a0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7ff89c007fd0 tx=0x7ff89c001370 comp rx=0 tx=0).stop 2024-09-17T03:48:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.311+0000 7ff8b2de4640 1 -- 172.21.15.146:0/432132138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8ac0cd2e0 msgr2=0x7ff8ac0cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:28.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.311+0000 7ff8b2de4640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8ac0cd2e0 0x7ff8ac0cd6f0 secure :-1 s=READY pgs=2806 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400e8d0 tx=0x7ff8a400ed90 comp rx=0 tx=0).stop 2024-09-17T03:48:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.312+0000 7ff8b2de4640 1 -- 172.21.15.146:0/432132138 shutdown_connections 2024-09-17T03:48:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.312+0000 7ff8b2de4640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff88c078b90 0x7ff88c07b0a0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.312+0000 7ff8b2de4640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8ac0cd2e0 0x7ff8ac0cd6f0 unknown :-1 s=CLOSED pgs=2806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.312+0000 7ff8b2de4640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff8ac0d1c70 0x7ff8ac15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.312+0000 7ff8b2de4640 1 --2- 172.21.15.146:0/432132138 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff8ac0b9cc0 0x7ff8ac0ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.312+0000 7ff8b2de4640 1 -- 172.21.15.146:0/432132138 >> 172.21.15.146:0/432132138 conn(0x7ff8ac09ddc0 msgr2=0x7ff8ac161a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.312+0000 7ff8b2de4640 1 -- 172.21.15.146:0/432132138 shutdown_connections 2024-09-17T03:48:28.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.312+0000 7ff8b2de4640 1 -- 172.21.15.146:0/432132138 wait complete. 2024-09-17T03:48:28.325 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:48:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.445+0000 7f03a2f0b640 1 -- 172.21.15.146:0/26847313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f038c003a50 msgr2=0x7f038c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.445+0000 7f03a2f0b640 1 --2- 172.21.15.146:0/26847313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f038c003a50 0x7f038c003ec0 secure :-1 s=READY pgs=2808 cs=0 l=1 rev1=1 crypto rx=0x7f03900016c0 tx=0x7f038c005830 comp rx=0 tx=0).stop 2024-09-17T03:48:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.445+0000 7f03a2f0b640 1 -- 172.21.15.146:0/26847313 shutdown_connections 2024-09-17T03:48:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.445+0000 7f03a2f0b640 1 --2- 172.21.15.146:0/26847313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f038c003a50 0x7f038c003ec0 unknown :-1 s=CLOSED pgs=2808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.445+0000 7f03a2f0b640 1 -- 172.21.15.146:0/26847313 >> 172.21.15.146:0/26847313 conn(0x7f039c09ba40 msgr2=0x7f039c0d2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:28.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.446+0000 7f03a2f0b640 1 -- 172.21.15.146:0/26847313 shutdown_connections 2024-09-17T03:48:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.446+0000 7f03a2f0b640 1 -- 172.21.15.146:0/26847313 wait complete. 2024-09-17T03:48:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.447+0000 7f03a2f0b640 1 Processor -- start 2024-09-17T03:48:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.447+0000 7f03a2f0b640 1 -- start start 2024-09-17T03:48:28.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a2f0b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f038c003a50 0x7f039c0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a2f0b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f039c09fd10 0x7f039c1f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a2f0b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f039c1f7380 0x7f039c09d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a2f0b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f039c0b8340 con 0x7f039c1f7380 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a2f0b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f039c0b81c0 con 0x7f038c003a50 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a2f0b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f039c0ce3b0 con 0x7f039c09fd10 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a14a8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f039c1f7380 0x7f039c09d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a14a8640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f039c1f7380 0x7f039c09d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48936/0 (socket says 172.21.15.146:48936) 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a14a8640 1 -- 172.21.15.146:0/1742488191 learned_addr learned my addr 172.21.15.146:0/1742488191 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a0ca7640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f038c003a50 0x7f039c0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f039bfff640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f039c09fd10 0x7f039c1f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a14a8640 1 -- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f039c09fd10 msgr2=0x7f039c1f6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:28.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a14a8640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f039c09fd10 0x7f039c1f6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a14a8640 1 -- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f038c003a50 msgr2=0x7f039c0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a14a8640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f038c003a50 0x7f039c0cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a14a8640 1 -- 172.21.15.146:0/1742488191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f039c1f7790 con 0x7f039c1f7380 2024-09-17T03:48:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.449+0000 7f03a14a8640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f039c1f7380 0x7f039c09d870 secure :-1 s=READY pgs=2809 cs=0 l=1 rev1=1 crypto rx=0x7f039c0cd080 tx=0x7f0394006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.450+0000 7f03997fa640 1 -- 172.21.15.146:0/1742488191 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039400fa20 con 0x7f039c1f7380 2024-09-17T03:48:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.450+0000 7f03997fa640 1 -- 172.21.15.146:0/1742488191 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0394018070 con 0x7f039c1f7380 2024-09-17T03:48:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.450+0000 7f03a2f0b640 1 -- 172.21.15.146:0/1742488191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f039c0c65e0 con 0x7f039c1f7380 2024-09-17T03:48:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.450+0000 7f03997fa640 1 -- 172.21.15.146:0/1742488191 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039400fe20 con 0x7f039c1f7380 2024-09-17T03:48:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.450+0000 7f03a2f0b640 1 -- 172.21.15.146:0/1742488191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f039c0c6ba0 con 0x7f039c1f7380 2024-09-17T03:48:28.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.451+0000 7f03a2f0b640 1 -- 172.21.15.146:0/1742488191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f039c0cf550 con 0x7f039c1f7380 2024-09-17T03:48:28.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.452+0000 7f03997fa640 1 -- 172.21.15.146:0/1742488191 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f039401d460 con 0x7f039c1f7380 2024-09-17T03:48:28.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.452+0000 7f03997fa640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0380078b90 0x7f038007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:28.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.452+0000 7f03997fa640 1 -- 172.21.15.146:0/1742488191 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 5443+0+0 (secure 0 0 0) 0x7f039409b290 con 0x7f039c1f7380 2024-09-17T03:48:28.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.452+0000 7f03a0ca7640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0380078b90 0x7f038007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:28.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.453+0000 7f03a0ca7640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0380078b90 0x7f038007b0a0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f0390032000 tx=0x7f039002c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:28.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.457+0000 7f03997fa640 1 -- 172.21.15.146:0/1742488191 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f039c1f7790 con 0x7f039c1f7380 2024-09-17T03:48:28.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:28.633+0000 7f03a2f0b640 1 -- 172.21.15.146:0/1742488191 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f039c0c7e30 con 0x7f039c1f7380 2024-09-17T03:48:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.314+0000 7f03997fa640 1 -- 172.21.15.146:0/1742488191 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v214) ==== 169+0+0 (secure 0 0 0) 0x7f0394063180 con 0x7f039c1f7380 2024-09-17T03:48:29.313 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2024-09-17T03:48:29.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.317+0000 7f03a2f0b640 1 -- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0380078b90 msgr2=0x7f038007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:29.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.317+0000 7f03a2f0b640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0380078b90 0x7f038007b0a0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f0390032000 tx=0x7f039002c040 comp rx=0 tx=0).stop 2024-09-17T03:48:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.318+0000 7f03a2f0b640 1 -- 172.21.15.146:0/1742488191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f039c1f7380 msgr2=0x7f039c09d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.318+0000 7f03a2f0b640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f039c1f7380 0x7f039c09d870 secure :-1 s=READY pgs=2809 cs=0 l=1 rev1=1 crypto rx=0x7f039c0cd080 tx=0x7f0394006720 comp rx=0 tx=0).stop 2024-09-17T03:48:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.318+0000 7f03a2f0b640 1 -- 172.21.15.146:0/1742488191 shutdown_connections 2024-09-17T03:48:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.318+0000 7f03a2f0b640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0380078b90 0x7f038007b0a0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.318+0000 7f03a2f0b640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f039c1f7380 0x7f039c09d870 unknown :-1 s=CLOSED pgs=2809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.318+0000 7f03a2f0b640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f039c09fd10 0x7f039c1f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.318+0000 7f03a2f0b640 1 --2- 172.21.15.146:0/1742488191 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f038c003a50 0x7f039c0cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.318+0000 7f03a2f0b640 1 -- 172.21.15.146:0/1742488191 >> 172.21.15.146:0/1742488191 conn(0x7f039c09ba40 msgr2=0x7f039c0b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.318+0000 7f03a2f0b640 1 -- 172.21.15.146:0/1742488191 shutdown_connections 2024-09-17T03:48:29.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.318+0000 7f03a2f0b640 1 -- 172.21.15.146:0/1742488191 wait complete. 2024-09-17T03:48:29.332 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:48:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.451+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/150737103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb40003a30 msgr2=0x7ffb40003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.451+0000 7ffb5b2a2640 1 --2- 172.21.15.146:0/150737103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb40003a30 0x7ffb40003ea0 secure :-1 s=READY pgs=2811 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000bb20 tx=0x7ffb40005830 comp rx=0 tx=0).stop 2024-09-17T03:48:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.451+0000 7ffb5983f640 1 -- 172.21.15.146:0/150737103 reap_dead start 2024-09-17T03:48:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.451+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/150737103 shutdown_connections 2024-09-17T03:48:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.451+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/150737103 >> 172.21.15.146:0/150737103 conn(0x7ffb540d26a0 msgr2=0x7ffb540d2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.451+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/150737103 shutdown_connections 2024-09-17T03:48:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.451+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/150737103 wait complete. 2024-09-17T03:48:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.453+0000 7ffb5b2a2640 1 Processor -- start 2024-09-17T03:48:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.453+0000 7ffb5b2a2640 1 -- start start 2024-09-17T03:48:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5b2a2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb40003a30 0x7ffb540caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5b2a2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb5414ba40 0x7ffb5415ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5b2a2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5415f4b0 0x7ffb540b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5b2a2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ffb540cd9a0 con 0x7ffb40003a30 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5b2a2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffb540cd820 con 0x7ffb5414ba40 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5b2a2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffb540cdb20 con 0x7ffb5415f4b0 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5903e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb40003a30 0x7ffb540caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5903e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb40003a30 0x7ffb540caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48954/0 (socket says 172.21.15.146:48954) 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5903e640 1 -- 172.21.15.146:0/3796429550 learned_addr learned my addr 172.21.15.146:0/3796429550 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5883d640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb5414ba40 0x7ffb5415ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5983f640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5415f4b0 0x7ffb540b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5903e640 1 -- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5415f4b0 msgr2=0x7ffb540b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5903e640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5415f4b0 0x7ffb540b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5903e640 1 -- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb5414ba40 msgr2=0x7ffb5415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5903e640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb5414ba40 0x7ffb5415ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5903e640 1 -- 172.21.15.146:0/3796429550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5415f8c0 con 0x7ffb40003a30 2024-09-17T03:48:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.454+0000 7ffb5883d640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb5414ba40 0x7ffb5415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:48:29.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.455+0000 7ffb5903e640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb40003a30 0x7ffb540caad0 secure :-1 s=READY pgs=2812 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000bc40 tx=0x7ffb5000b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:29.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.455+0000 7ffb49ffb640 1 -- 172.21.15.146:0/3796429550 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb50040070 con 0x7ffb40003a30 2024-09-17T03:48:29.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.455+0000 7ffb49ffb640 1 -- 172.21.15.146:0/3796429550 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb5003a920 con 0x7ffb40003a30 2024-09-17T03:48:29.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.455+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/3796429550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb540cb440 con 0x7ffb40003a30 2024-09-17T03:48:29.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.455+0000 7ffb49ffb640 1 -- 172.21.15.146:0/3796429550 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb50035040 con 0x7ffb40003a30 2024-09-17T03:48:29.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.455+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/3796429550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb540cba00 con 0x7ffb40003a30 2024-09-17T03:48:29.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.456+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/3796429550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb540ce010 con 0x7ffb40003a30 2024-09-17T03:48:29.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.457+0000 7ffb49ffb640 1 -- 172.21.15.146:0/3796429550 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb50038020 con 0x7ffb40003a30 2024-09-17T03:48:29.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.457+0000 7ffb49ffb640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb38078b90 0x7ffb3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:29.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.457+0000 7ffb49ffb640 1 -- 172.21.15.146:0/3796429550 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7ffb500bb840 con 0x7ffb40003a30 2024-09-17T03:48:29.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.457+0000 7ffb5883d640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb38078b90 0x7ffb3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:29.457 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.458+0000 7ffb5883d640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb38078b90 0x7ffb3807b0a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ffb44000c00 tx=0x7ffb44006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.462+0000 7ffb49ffb640 1 -- 172.21.15.146:0/3796429550 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffb5415f8c0 con 0x7ffb40003a30 2024-09-17T03:48:29.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.641+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/3796429550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7ffb540ceba0 con 0x7ffb40003a30 2024-09-17T03:48:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.645+0000 7ffb49ffb640 1 -- 172.21.15.146:0/3796429550 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v70) ==== 71+0+0 (secure 0 0 0) 0x7ffb50083ea0 con 0x7ffb40003a30 2024-09-17T03:48:29.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.647+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb38078b90 msgr2=0x7ffb3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:29.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.647+0000 7ffb5b2a2640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb38078b90 0x7ffb3807b0a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ffb44000c00 tx=0x7ffb44006b70 comp rx=0 tx=0).stop 2024-09-17T03:48:29.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.647+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/3796429550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb40003a30 msgr2=0x7ffb540caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:29.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.647+0000 7ffb5b2a2640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb40003a30 0x7ffb540caad0 secure :-1 s=READY pgs=2812 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000bc40 tx=0x7ffb5000b710 comp rx=0 tx=0).stop 2024-09-17T03:48:29.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.648+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/3796429550 shutdown_connections 2024-09-17T03:48:29.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.648+0000 7ffb5b2a2640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ffb38078b90 0x7ffb3807b0a0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.648+0000 7ffb5b2a2640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffb5415f4b0 0x7ffb540b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.648+0000 7ffb5b2a2640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffb5414ba40 0x7ffb5415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.648+0000 7ffb5b2a2640 1 --2- 172.21.15.146:0/3796429550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb40003a30 0x7ffb540caad0 unknown :-1 s=CLOSED pgs=2812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.647 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.648+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/3796429550 >> 172.21.15.146:0/3796429550 conn(0x7ffb540d26a0 msgr2=0x7ffb5415d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:29.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.648+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/3796429550 shutdown_connections 2024-09-17T03:48:29.648 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.648+0000 7ffb5b2a2640 1 -- 172.21.15.146:0/3796429550 wait complete. 2024-09-17T03:48:29.658 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2024-09-17T03:48:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.772+0000 7fc2faa16640 1 -- 172.21.15.146:0/1155920999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40d2800 msgr2=0x7fc2f40d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.772+0000 7fc2faa16640 1 --2- 172.21.15.146:0/1155920999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40d2800 0x7fc2f40d1300 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009860 tx=0x7fc2e402a540 comp rx=0 tx=0).stop 2024-09-17T03:48:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.772+0000 7fc2faa16640 1 -- 172.21.15.146:0/1155920999 shutdown_connections 2024-09-17T03:48:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.772+0000 7fc2faa16640 1 --2- 172.21.15.146:0/1155920999 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f40cf150 0x7fc2f40d1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.771 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.772+0000 7fc2faa16640 1 --2- 172.21.15.146:0/1155920999 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40d2800 0x7fc2f40d1300 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.772+0000 7fc2faa16640 1 -- 172.21.15.146:0/1155920999 >> 172.21.15.146:0/1155920999 conn(0x7fc2f406ecd0 msgr2=0x7fc2f406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:29.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.772+0000 7fc2faa16640 1 -- 172.21.15.146:0/1155920999 shutdown_connections 2024-09-17T03:48:29.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.772+0000 7fc2faa16640 1 -- 172.21.15.146:0/1155920999 wait complete. 2024-09-17T03:48:29.772 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.773+0000 7fc2faa16640 1 Processor -- start 2024-09-17T03:48:29.773 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.774+0000 7fc2faa16640 1 -- start start 2024-09-17T03:48:29.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2faa16640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40cf150 0x7fc2f40ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:29.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2faa16640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f40d2800 0x7fc2f41555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:29.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2faa16640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f415edf0 0x7fc2f40d48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:29.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2faa16640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f40b6c00 con 0x7fc2f40d2800 2024-09-17T03:48:29.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2faa16640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f40b6a80 con 0x7fc2f40cf150 2024-09-17T03:48:29.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2faa16640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f40b6d80 con 0x7fc2f415edf0 2024-09-17T03:48:29.775 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2f37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f40d2800 0x7fc2f41555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40cf150 0x7fc2f40ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2f37fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f40d2800 0x7fc2f41555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48966/0 (socket says 172.21.15.146:48966) 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2f37fe640 1 -- 172.21.15.146:0/1271659140 learned_addr learned my addr 172.21.15.146:0/1271659140 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2f8fb3640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f415edf0 0x7fc2f40d48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2f37fe640 1 -- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f415edf0 msgr2=0x7fc2f40d48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2f37fe640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f415edf0 0x7fc2f40d48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2f37fe640 1 -- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40cf150 msgr2=0x7fc2f40ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.775+0000 7fc2f37fe640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40cf150 0x7fc2f40ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.776+0000 7fc2f37fe640 1 -- 172.21.15.146:0/1271659140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f415f640 con 0x7fc2f40d2800 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.776+0000 7fc2f3fff640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40cf150 0x7fc2f40ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.776+0000 7fc2f37fe640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f40d2800 0x7fc2f41555a0 secure :-1 s=READY pgs=2813 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800e9f0 tx=0x7fc2e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.776+0000 7fc2f0ff9640 1 -- 172.21.15.146:0/1271659140 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800ccc0 con 0x7fc2f40d2800 2024-09-17T03:48:29.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.776+0000 7fc2faa16640 1 -- 172.21.15.146:0/1271659140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f415f920 con 0x7fc2f40d2800 2024-09-17T03:48:29.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.776+0000 7fc2f0ff9640 1 -- 172.21.15.146:0/1271659140 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2e800ce60 con 0x7fc2f40d2800 2024-09-17T03:48:29.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.776+0000 7fc2f0ff9640 1 -- 172.21.15.146:0/1271659140 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8004260 con 0x7fc2f40d2800 2024-09-17T03:48:29.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.776+0000 7fc2faa16640 1 -- 172.21.15.146:0/1271659140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f415fee0 con 0x7fc2f40d2800 2024-09-17T03:48:29.777 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.777+0000 7fc2faa16640 1 -- 172.21.15.146:0/1271659140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f40b6370 con 0x7fc2f40d2800 2024-09-17T03:48:29.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.778+0000 7fc2f0ff9640 1 -- 172.21.15.146:0/1271659140 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc2e80035f0 con 0x7fc2f40d2800 2024-09-17T03:48:29.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.778+0000 7fc2f0ff9640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2e0078b90 0x7fc2e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:29.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.778+0000 7fc2f0ff9640 1 -- 172.21.15.146:0/1271659140 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7fc2e809b3a0 con 0x7fc2f40d2800 2024-09-17T03:48:29.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.778+0000 7fc2f3fff640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2e0078b90 0x7fc2e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:29.778 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.779+0000 7fc2f3fff640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2e0078b90 0x7fc2e007b0a0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4034000 tx=0x7fc2e4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:29.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:29.783+0000 7fc2f0ff9640 1 -- 172.21.15.146:0/1271659140 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc2e80633b0 con 0x7fc2f40d2800 2024-09-17T03:48:30.022 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.023+0000 7fc2faa16640 1 -- 172.21.15.146:0/1271659140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) -- 0x7fc2f40cf730 con 0x7fc2f40d2800 2024-09-17T03:48:30.314 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.315+0000 7fc2f0ff9640 1 -- 172.21.15.146:0/1271659140 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v733) ==== 133+0+0 (secure 0 0 0) 0x7fc2e8067de0 con 0x7fc2f40d2800 2024-09-17T03:48:30.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 -- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2e0078b90 msgr2=0x7fc2e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:30.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2e0078b90 0x7fc2e007b0a0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4034000 tx=0x7fc2e4004730 comp rx=0 tx=0).stop 2024-09-17T03:48:30.317 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 -- 172.21.15.146:0/1271659140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f40d2800 msgr2=0x7fc2f41555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f40d2800 0x7fc2f41555a0 secure :-1 s=READY pgs=2813 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800e9f0 tx=0x7fc2e800eeb0 comp rx=0 tx=0).stop 2024-09-17T03:48:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 -- 172.21.15.146:0/1271659140 shutdown_connections 2024-09-17T03:48:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc2e0078b90 0x7fc2e007b0a0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc2f415edf0 0x7fc2f40d48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2f40d2800 0x7fc2f41555a0 unknown :-1 s=CLOSED pgs=2813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 --2- 172.21.15.146:0/1271659140 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2f40cf150 0x7fc2f40ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 -- 172.21.15.146:0/1271659140 >> 172.21.15.146:0/1271659140 conn(0x7fc2f406ecd0 msgr2=0x7fc2f40b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 -- 172.21.15.146:0/1271659140 shutdown_connections 2024-09-17T03:48:30.318 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:30.318+0000 7fc2faa16640 1 -- 172.21.15.146:0/1271659140 wait complete. 2024-09-17T03:48:30.329 INFO:tasks.cephfs_test_runner:test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-17T03:48:30.330 INFO:tasks.cephfs_test_runner: 2024-09-17T03:48:30.330 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T03:48:30.330 INFO:tasks.cephfs_test_runner:Ran 15 tests in 906.483s 2024-09-17T03:48:30.330 INFO:tasks.cephfs_test_runner: 2024-09-17T03:48:30.330 INFO:tasks.cephfs_test_runner:OK 2024-09-17T03:48:30.330 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T03:48:30.339 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T03:48:30.371 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T03:48:30.372 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:48:30.372 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:48:30.388 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:48:30.389 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2024-09-17T03:48:30.389 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:48:30.445 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=385 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:48:30.445 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:48:30.446 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:48:30.465 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:48:30.465 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T03:48:30.466 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:48:30.523 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:48:30.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:30.524 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:48:30.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:48:30.540 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:48:30.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:30.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:48:30.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:30.609 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:48:30.630 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:48:30.652 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:48:30.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:30.676 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-09-17T03:48:30.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:30.775 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2024-09-17T03:48:30.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:30.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2024-09-17T03:48:30.859 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2024-09-17T03:48:30.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:48:30.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:30.861 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-17T03:48:30.879 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:48:30.879 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:48:30.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:30.879 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:48:30.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:30.947 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:48:31.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:31.015 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-09-17T03:48:31.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:31.110 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2024-09-17T03:48:31.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:48:31.126 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2024-09-17T03:48:31.195 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2024-09-17T03:48:31.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:48:31.196 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T03:48:31.205 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:48:31.205 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:48:31.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.320+0000 7f7f10a4d640 1 -- 172.21.15.146:0/1456103411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c0724a0 msgr2=0x7f7f0c074450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.320+0000 7f7f10a4d640 1 --2- 172.21.15.146:0/1456103411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c0724a0 0x7f7f0c074450 secure :-1 s=READY pgs=2815 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009830 tx=0x7f7efc02a530 comp rx=0 tx=0).stop 2024-09-17T03:48:31.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.321+0000 7f7f10a4d640 1 -- 172.21.15.146:0/1456103411 shutdown_connections 2024-09-17T03:48:31.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.321+0000 7f7f10a4d640 1 --2- 172.21.15.146:0/1456103411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c0724a0 0x7f7f0c074450 unknown :-1 s=CLOSED pgs=2815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.321+0000 7f7f10a4d640 1 -- 172.21.15.146:0/1456103411 >> 172.21.15.146:0/1456103411 conn(0x7f7f0c0b2240 msgr2=0x7f7f0c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:31.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.321+0000 7f7f10a4d640 1 -- 172.21.15.146:0/1456103411 shutdown_connections 2024-09-17T03:48:31.320 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.321+0000 7f7f10a4d640 1 -- 172.21.15.146:0/1456103411 wait complete. 2024-09-17T03:48:31.321 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.323+0000 7f7f10a4d640 1 Processor -- start 2024-09-17T03:48:31.322 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.323+0000 7f7f10a4d640 1 -- start start 2024-09-17T03:48:31.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f10a4d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c070170 0x7f7f0c144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f10a4d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0c0724a0 0x7f7f0c1f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f10a4d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f0c1f70f0 0x7f7f0c1f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f10a4d640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c15f780 con 0x7f7f0c070170 2024-09-17T03:48:31.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f10a4d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c06efd0 con 0x7f7f0c0724a0 2024-09-17T03:48:31.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f10a4d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0c15f900 con 0x7f7f0c1f70f0 2024-09-17T03:48:31.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f0a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c070170 0x7f7f0c144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f0a59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c070170 0x7f7f0c144c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48978/0 (socket says 172.21.15.146:48978) 2024-09-17T03:48:31.325 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f0a59c640 1 -- 172.21.15.146:0/3664215585 learned_addr learned my addr 172.21.15.146:0/3664215585 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f09d9b640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0c0724a0 0x7f7f0c1f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f0ad9d640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f0c1f70f0 0x7f7f0c1f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f0a59c640 1 -- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f0c1f70f0 msgr2=0x7f7f0c1f0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f0a59c640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f0c1f70f0 0x7f7f0c1f0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f0a59c640 1 -- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0c0724a0 msgr2=0x7f7f0c1f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f0a59c640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0c0724a0 0x7f7f0c1f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.324+0000 7f7f0a59c640 1 -- 172.21.15.146:0/3664215585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c145600 con 0x7f7f0c070170 2024-09-17T03:48:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.325+0000 7f7f0a59c640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c070170 0x7f7f0c144c60 secure :-1 s=READY pgs=2816 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009950 tx=0x7f7efc033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.325+0000 7f7efaffd640 1 -- 172.21.15.146:0/3664215585 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc031d60 con 0x7f7f0c070170 2024-09-17T03:48:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.325+0000 7f7efaffd640 1 -- 172.21.15.146:0/3664215585 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7efc033070 con 0x7f7f0c070170 2024-09-17T03:48:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.325+0000 7f7efaffd640 1 -- 172.21.15.146:0/3664215585 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0334c0 con 0x7f7f0c070170 2024-09-17T03:48:31.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.325+0000 7f7f10a4d640 1 -- 172.21.15.146:0/3664215585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0c1458e0 con 0x7f7f0c070170 2024-09-17T03:48:31.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.325+0000 7f7f10a4d640 1 -- 172.21.15.146:0/3664215585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0c1f4950 con 0x7f7f0c070170 2024-09-17T03:48:31.327 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.326+0000 7f7f10a4d640 1 -- 172.21.15.146:0/3664215585 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f0c074450 con 0x7f7f0c070170 2024-09-17T03:48:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.327+0000 7f7efaffd640 1 -- 172.21.15.146:0/3664215585 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7efc033660 con 0x7f7f0c070170 2024-09-17T03:48:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.327+0000 7f7efaffd640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7eec078b90 0x7f7eec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.327+0000 7f7efaffd640 1 -- 172.21.15.146:0/3664215585 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f7efc0bbfa0 con 0x7f7f0c070170 2024-09-17T03:48:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.327+0000 7f7f09d9b640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7eec078b90 0x7f7eec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.328+0000 7f7f09d9b640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7eec078b90 0x7f7eec07b0a0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f7f000046b0 tx=0x7f7f00007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.332+0000 7f7efaffd640 1 -- 172.21.15.146:0/3664215585 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7efc03f030 con 0x7f7f0c070170 2024-09-17T03:48:31.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.502+0000 7f7f10a4d640 1 -- 172.21.15.146:0/3664215585 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f0c0cec20 con 0x7f7eec078b90 2024-09-17T03:48:31.501 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.503+0000 7f7efaffd640 1 -- 172.21.15.146:0/3664215585 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13441 (secure 0 0 0) 0x7f7f0c0cec20 con 0x7f7eec078b90 2024-09-17T03:48:31.502 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:31.502 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:48:31.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 -- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7eec078b90 msgr2=0x7f7eec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.504 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7eec078b90 0x7f7eec07b0a0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f7f000046b0 tx=0x7f7f00007e90 comp rx=0 tx=0).stop 2024-09-17T03:48:31.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 -- 172.21.15.146:0/3664215585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c070170 msgr2=0x7f7f0c144c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c070170 0x7f7f0c144c60 secure :-1 s=READY pgs=2816 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009950 tx=0x7f7efc033d60 comp rx=0 tx=0).stop 2024-09-17T03:48:31.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 -- 172.21.15.146:0/3664215585 shutdown_connections 2024-09-17T03:48:31.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f7eec078b90 0x7f7eec07b0a0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7f0c1f70f0 0x7f7f0c1f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0c0724a0 0x7f7f0c1f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 --2- 172.21.15.146:0/3664215585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c070170 0x7f7f0c144c60 unknown :-1 s=CLOSED pgs=2816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 -- 172.21.15.146:0/3664215585 >> 172.21.15.146:0/3664215585 conn(0x7f7f0c0b2240 msgr2=0x7f7f0c0ce430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:31.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 -- 172.21.15.146:0/3664215585 shutdown_connections 2024-09-17T03:48:31.505 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.505+0000 7f7f10a4d640 1 -- 172.21.15.146:0/3664215585 wait complete. 2024-09-17T03:48:31.515 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":679,"stamp":"2024-09-17T03:48:30.041913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":508596,"kb_used_data":46800,"kb_used_omap":12,"kb_used_meta":461619,"kb_avail":754466124,"statfs":{"total":773094113280,"available":772573310976,"internally_reserved":0,"allocated":47923200,"data_stored":35858670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":472698417},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12623452,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-105,"num_write":-95,"num_write_kb":-12359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001591"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":465,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T03:48:28.863614+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:48:28.863614+0000","last_peered":"2024-09-17T03:48:28.863614+0000","last_clean":"2024-09-17T03:48:28.863614+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:48:28.863614+0000","last_undegraded":"2024-09-17T03:48:28.863614+0000","last_fullsized":"2024-09-17T03:48:28.863614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509632,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60756,"kb_used_data":3200,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311084,"statfs":{"total":96636764160,"available":96574550016,"internally_reserved":0,"allocated":3276800,"data_stored":1771261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509632,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72540,"kb_used_data":10824,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94299300,"statfs":{"total":96636764160,"available":96562483200,"internally_reserved":0,"allocated":11083776,"data_stored":9575520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509632,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73952,"kb_used_data":6728,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94297888,"statfs":{"total":96636764160,"available":96561037312,"internally_reserved":0,"allocated":6889472,"data_stored":5381216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509632,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56028,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315812,"statfs":{"total":96636764160,"available":96579391488,"internally_reserved":0,"allocated":2695168,"data_stored":1186912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509633,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60188,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311652,"statfs":{"total":96636764160,"available":96575131648,"internally_reserved":0,"allocated":2695168,"data_stored":1181615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509633,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60704,"kb_used_data":7308,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311136,"statfs":{"total":96636764160,"available":96574603264,"internally_reserved":0,"allocated":7483392,"data_stored":5971584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575039,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56012,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315828,"statfs":{"total":96636764160,"available":96579407872,"internally_reserved":0,"allocated":2678784,"data_stored":1180823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575039,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68416,"kb_used_data":10860,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94303424,"statfs":{"total":96636764160,"available":96566706176,"internally_reserved":0,"allocated":11120640,"data_stored":9609739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:48:31.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:48:31.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.629+0000 7f2918c8b640 1 -- 172.21.15.146:0/2650881412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29140d31e0 msgr2=0x7f29140cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.629+0000 7f2918c8b640 1 --2- 172.21.15.146:0/2650881412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29140d31e0 0x7f29140cebc0 secure :-1 s=READY pgs=2818 cs=0 l=1 rev1=1 crypto rx=0x7f29141607d0 tx=0x7f28fc02a530 comp rx=0 tx=0).stop 2024-09-17T03:48:31.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.629+0000 7f2918c8b640 1 -- 172.21.15.146:0/2650881412 shutdown_connections 2024-09-17T03:48:31.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.629+0000 7f2918c8b640 1 --2- 172.21.15.146:0/2650881412 >> v2:172.21.15.179:3300/0 conn(0x7f29140d1220 0x7f29140b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.629+0000 7f2918c8b640 1 --2- 172.21.15.146:0/2650881412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29140d31e0 0x7f29140cebc0 unknown :-1 s=CLOSED pgs=2818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.629+0000 7f2918c8b640 1 -- 172.21.15.146:0/2650881412 >> 172.21.15.146:0/2650881412 conn(0x7f29140d26c0 msgr2=0x7f29140d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:31.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.629+0000 7f2918c8b640 1 -- 172.21.15.146:0/2650881412 shutdown_connections 2024-09-17T03:48:31.629 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.629+0000 7f2918c8b640 1 -- 172.21.15.146:0/2650881412 wait complete. 2024-09-17T03:48:31.630 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.631+0000 7f2918c8b640 1 Processor -- start 2024-09-17T03:48:31.631 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.631+0000 7f2918c8b640 1 -- start start 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2918c8b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29140d31e0 0x7f29140ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2918c8b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f291415cbe0 0x7f29141f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2918c8b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29141f30d0 0x7f291409f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2918c8b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f29140b6450 con 0x7f29141f30d0 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2918c8b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f29140b62d0 con 0x7f291415cbe0 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2918c8b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f29140b65d0 con 0x7f29140d31e0 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2912d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29141f30d0 0x7f291409f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2912d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29141f30d0 0x7f291409f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48996/0 (socket says 172.21.15.146:48996) 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2912d9d640 1 -- 172.21.15.146:0/4088538246 learned_addr learned my addr 172.21.15.146:0/4088538246 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f291259c640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29140d31e0 0x7f29140ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2909d9b640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f291415cbe0 0x7f29141f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2912d9d640 1 -- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29140d31e0 msgr2=0x7f29140ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2912d9d640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29140d31e0 0x7f29140ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2912d9d640 1 -- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f291415cbe0 msgr2=0x7f29141f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2912d9d640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f291415cbe0 0x7f29141f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2912d9d640 1 -- 172.21.15.146:0/4088538246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29141f3b90 con 0x7f29141f30d0 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2909d9b640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f291415cbe0 0x7f29141f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f2912d9d640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29141f30d0 0x7f291409f230 secure :-1 s=READY pgs=2819 cs=0 l=1 rev1=1 crypto rx=0x7f290c00e990 tx=0x7f290c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.633+0000 7f290b7fe640 1 -- 172.21.15.146:0/4088538246 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c004d20 con 0x7f29141f30d0 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.634+0000 7f290b7fe640 1 -- 172.21.15.146:0/4088538246 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f290c00cb00 con 0x7f29141f30d0 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.634+0000 7f2918c8b640 1 -- 172.21.15.146:0/4088538246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29141f3e70 con 0x7f29141f30d0 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.634+0000 7f290b7fe640 1 -- 172.21.15.146:0/4088538246 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c005020 con 0x7f29141f30d0 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.634+0000 7f2918c8b640 1 -- 172.21.15.146:0/4088538246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29141f7520 con 0x7f29141f30d0 2024-09-17T03:48:31.635 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.635+0000 7f2918c8b640 1 -- 172.21.15.146:0/4088538246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29141f3900 con 0x7f29141f30d0 2024-09-17T03:48:31.636 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.635+0000 7f290b7fe640 1 -- 172.21.15.146:0/4088538246 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f290c0051c0 con 0x7f29141f30d0 2024-09-17T03:48:31.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.636+0000 7f290b7fe640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28f8078b90 0x7f28f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.636+0000 7f291259c640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28f8078b90 0x7f28f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.636+0000 7f290b7fe640 1 -- 172.21.15.146:0/4088538246 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f290c09b3c0 con 0x7f29141f30d0 2024-09-17T03:48:31.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.637+0000 7f291259c640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28f8078b90 0x7f28f807b0a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f28fc034000 tx=0x7f28fc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:31.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.641+0000 7f290b7fe640 1 -- 172.21.15.146:0/4088538246 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f290c016030 con 0x7f29141f30d0 2024-09-17T03:48:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.813+0000 7f2918c8b640 1 -- 172.21.15.146:0/4088538246 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29140b73c0 con 0x7f28f8078b90 2024-09-17T03:48:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.814+0000 7f290b7fe640 1 -- 172.21.15.146:0/4088538246 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13441 (secure 0 0 0) 0x7f29140b73c0 con 0x7f28f8078b90 2024-09-17T03:48:31.813 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:48:31.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 -- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28f8078b90 msgr2=0x7f28f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28f8078b90 0x7f28f807b0a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f28fc034000 tx=0x7f28fc004730 comp rx=0 tx=0).stop 2024-09-17T03:48:31.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 -- 172.21.15.146:0/4088538246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29141f30d0 msgr2=0x7f291409f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29141f30d0 0x7f291409f230 secure :-1 s=READY pgs=2819 cs=0 l=1 rev1=1 crypto rx=0x7f290c00e990 tx=0x7f290c00ee50 comp rx=0 tx=0).stop 2024-09-17T03:48:31.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 -- 172.21.15.146:0/4088538246 shutdown_connections 2024-09-17T03:48:31.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f28f8078b90 0x7f28f807b0a0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29141f30d0 0x7f291409f230 unknown :-1 s=CLOSED pgs=2819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f291415cbe0 0x7f29141f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 --2- 172.21.15.146:0/4088538246 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29140d31e0 0x7f29140ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 -- 172.21.15.146:0/4088538246 >> 172.21.15.146:0/4088538246 conn(0x7f29140d26c0 msgr2=0x7f291415bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 -- 172.21.15.146:0/4088538246 shutdown_connections 2024-09-17T03:48:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.816+0000 7f2918c8b640 1 -- 172.21.15.146:0/4088538246 wait complete. 2024-09-17T03:48:31.826 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":679,"stamp":"2024-09-17T03:48:30.041913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":508596,"kb_used_data":46800,"kb_used_omap":12,"kb_used_meta":461619,"kb_avail":754466124,"statfs":{"total":773094113280,"available":772573310976,"internally_reserved":0,"allocated":47923200,"data_stored":35858670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":472698417},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12623452,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-105,"num_write":-95,"num_write_kb":-12359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001591"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":465,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T03:48:28.863614+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:48:28.863614+0000","last_peered":"2024-09-17T03:48:28.863614+0000","last_clean":"2024-09-17T03:48:28.863614+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:48:28.863614+0000","last_undegraded":"2024-09-17T03:48:28.863614+0000","last_fullsized":"2024-09-17T03:48:28.863614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509632,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60756,"kb_used_data":3200,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311084,"statfs":{"total":96636764160,"available":96574550016,"internally_reserved":0,"allocated":3276800,"data_stored":1771261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509632,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72540,"kb_used_data":10824,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94299300,"statfs":{"total":96636764160,"available":96562483200,"internally_reserved":0,"allocated":11083776,"data_stored":9575520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509632,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73952,"kb_used_data":6728,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94297888,"statfs":{"total":96636764160,"available":96561037312,"internally_reserved":0,"allocated":6889472,"data_stored":5381216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509632,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56028,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315812,"statfs":{"total":96636764160,"available":96579391488,"internally_reserved":0,"allocated":2695168,"data_stored":1186912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509633,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60188,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311652,"statfs":{"total":96636764160,"available":96575131648,"internally_reserved":0,"allocated":2695168,"data_stored":1181615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509633,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60704,"kb_used_data":7308,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311136,"statfs":{"total":96636764160,"available":96574603264,"internally_reserved":0,"allocated":7483392,"data_stored":5971584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575039,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56012,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315828,"statfs":{"total":96636764160,"available":96579407872,"internally_reserved":0,"allocated":2678784,"data_stored":1180823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575039,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68416,"kb_used_data":10860,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94303424,"statfs":{"total":96636764160,"available":96566706176,"internally_reserved":0,"allocated":11120640,"data_stored":9609739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:48:31.827 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:48:31.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:48:31.940 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.941+0000 7ff4e33c6640 1 -- 172.21.15.146:0/1909834293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4dc0b7620 msgr2=0x7ff4dc1667d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.941+0000 7ff4e33c6640 1 --2- 172.21.15.146:0/1909834293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4dc0b7620 0x7ff4dc1667d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4005fd0 tx=0x7ff4d402a820 comp rx=0 tx=0).stop 2024-09-17T03:48:31.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.941+0000 7ff4e33c6640 1 -- 172.21.15.146:0/1909834293 shutdown_connections 2024-09-17T03:48:31.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.941+0000 7ff4e33c6640 1 --2- 172.21.15.146:0/1909834293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4dc0b7620 0x7ff4dc1667d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.941+0000 7ff4e33c6640 1 --2- 172.21.15.146:0/1909834293 >> v2:172.21.15.179:3300/0 conn(0x7ff4dc1600b0 0x7ff4dc0b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.941+0000 7ff4e33c6640 1 -- 172.21.15.146:0/1909834293 >> 172.21.15.146:0/1909834293 conn(0x7ff4dc0b41b0 msgr2=0x7ff4dc0b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:31.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.941+0000 7ff4e33c6640 1 -- 172.21.15.146:0/1909834293 shutdown_connections 2024-09-17T03:48:31.941 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.941+0000 7ff4e33c6640 1 -- 172.21.15.146:0/1909834293 wait complete. 2024-09-17T03:48:31.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.943+0000 7ff4e33c6640 1 Processor -- start 2024-09-17T03:48:31.942 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.943+0000 7ff4e33c6640 1 -- start start 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.944+0000 7ff4e33c6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4dc0b6b00 0x7ff4dc155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.944+0000 7ff4e33c6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4dc0b7620 0x7ff4dc0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.944+0000 7ff4e33c6640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4dc1600b0 0x7ff4dc165cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.944+0000 7ff4e33c6640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc166e90 con 0x7ff4dc1600b0 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.944+0000 7ff4e33c6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc166d10 con 0x7ff4dc0b6b00 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.944+0000 7ff4e33c6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff4dc167010 con 0x7ff4dc0b7620 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.944+0000 7ff4e1963640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4dc1600b0 0x7ff4dc165cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e1963640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4dc1600b0 0x7ff4dc165cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49012/0 (socket says 172.21.15.146:49012) 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e1963640 1 -- 172.21.15.146:0/862704777 learned_addr learned my addr 172.21.15.146:0/862704777 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e1162640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4dc0b6b00 0x7ff4dc155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e0961640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4dc0b7620 0x7ff4dc0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e1963640 1 -- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4dc0b7620 msgr2=0x7ff4dc0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e1963640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4dc0b7620 0x7ff4dc0b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e1963640 1 -- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4dc0b6b00 msgr2=0x7ff4dc155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e1963640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4dc0b6b00 0x7ff4dc155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e1963640 1 -- 172.21.15.146:0/862704777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc1560f0 con 0x7ff4dc1600b0 2024-09-17T03:48:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e1963640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4dc1600b0 0x7ff4dc165cd0 secure :-1 s=READY pgs=2820 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009b30 tx=0x7ff4d4032be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4d1ffb640 1 -- 172.21.15.146:0/862704777 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4037040 con 0x7ff4dc1600b0 2024-09-17T03:48:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4d1ffb640 1 -- 172.21.15.146:0/862704777 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4d4042070 con 0x7ff4dc1600b0 2024-09-17T03:48:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e33c6640 1 -- 172.21.15.146:0/862704777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4dc157cb0 con 0x7ff4dc1600b0 2024-09-17T03:48:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4d1ffb640 1 -- 172.21.15.146:0/862704777 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4004040 con 0x7ff4dc1600b0 2024-09-17T03:48:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.945+0000 7ff4e33c6640 1 -- 172.21.15.146:0/862704777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4dc165060 con 0x7ff4dc1600b0 2024-09-17T03:48:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.946+0000 7ff4e33c6640 1 -- 172.21.15.146:0/862704777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4dc0b65c0 con 0x7ff4dc1600b0 2024-09-17T03:48:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.947+0000 7ff4d1ffb640 1 -- 172.21.15.146:0/862704777 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4d40041e0 con 0x7ff4dc1600b0 2024-09-17T03:48:31.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.948+0000 7ff4d1ffb640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4c0078bc0 0x7ff4c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:31.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.948+0000 7ff4d1ffb640 1 -- 172.21.15.146:0/862704777 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7ff4d40bc0e0 con 0x7ff4dc1600b0 2024-09-17T03:48:31.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.948+0000 7ff4e1162640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4c0078bc0 0x7ff4c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:31.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.949+0000 7ff4e1162640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4c0078bc0 0x7ff4c007b0d0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009590 tx=0x7ff4d8005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:31.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:31.952+0000 7ff4d1ffb640 1 -- 172.21.15.146:0/862704777 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff4d4084200 con 0x7ff4dc1600b0 2024-09-17T03:48:32.122 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.123+0000 7ff4e33c6640 1 -- 172.21.15.146:0/862704777 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4dc157a40 con 0x7ff4c0078bc0 2024-09-17T03:48:32.123 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.124+0000 7ff4d1ffb640 1 -- 172.21.15.146:0/862704777 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13441 (secure 0 0 0) 0x7ff4dc157a40 con 0x7ff4c0078bc0 2024-09-17T03:48:32.123 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:32.123 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 -- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4c0078bc0 msgr2=0x7ff4c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4c0078bc0 0x7ff4c007b0d0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009590 tx=0x7ff4d8005f30 comp rx=0 tx=0).stop 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 -- 172.21.15.146:0/862704777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4dc1600b0 msgr2=0x7ff4dc165cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4dc1600b0 0x7ff4dc165cd0 secure :-1 s=READY pgs=2820 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009b30 tx=0x7ff4d4032be0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 -- 172.21.15.146:0/862704777 shutdown_connections 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7ff4c0078bc0 0x7ff4c007b0d0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4dc1600b0 0x7ff4dc165cd0 unknown :-1 s=CLOSED pgs=2820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff4dc0b7620 0x7ff4dc0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 --2- 172.21.15.146:0/862704777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff4dc0b6b00 0x7ff4dc155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 -- 172.21.15.146:0/862704777 >> 172.21.15.146:0/862704777 conn(0x7ff4dc0b41b0 msgr2=0x7ff4dc0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 -- 172.21.15.146:0/862704777 shutdown_connections 2024-09-17T03:48:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.126+0000 7ff4e33c6640 1 -- 172.21.15.146:0/862704777 wait complete. 2024-09-17T03:48:32.137 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":680,"stamp":"2024-09-17T03:48:32.042332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":508596,"kb_used_data":46800,"kb_used_omap":12,"kb_used_meta":461619,"kb_avail":754466124,"statfs":{"total":773094113280,"available":772573310976,"internally_reserved":0,"allocated":47923200,"data_stored":35858670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":472698417},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12623452,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-105,"num_write":-95,"num_write_kb":-12359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001544"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":465,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T03:48:28.863614+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:48:28.863614+0000","last_peered":"2024-09-17T03:48:28.863614+0000","last_clean":"2024-09-17T03:48:28.863614+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:48:28.863614+0000","last_undegraded":"2024-09-17T03:48:28.863614+0000","last_fullsized":"2024-09-17T03:48:28.863614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509632,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60756,"kb_used_data":3200,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311084,"statfs":{"total":96636764160,"available":96574550016,"internally_reserved":0,"allocated":3276800,"data_stored":1771261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509632,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72540,"kb_used_data":10824,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94299300,"statfs":{"total":96636764160,"available":96562483200,"internally_reserved":0,"allocated":11083776,"data_stored":9575520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509632,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73952,"kb_used_data":6728,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94297888,"statfs":{"total":96636764160,"available":96561037312,"internally_reserved":0,"allocated":6889472,"data_stored":5381216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509632,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56028,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315812,"statfs":{"total":96636764160,"available":96579391488,"internally_reserved":0,"allocated":2695168,"data_stored":1186912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509633,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60188,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311652,"statfs":{"total":96636764160,"available":96575131648,"internally_reserved":0,"allocated":2695168,"data_stored":1181615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509633,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60704,"kb_used_data":7308,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311136,"statfs":{"total":96636764160,"available":96574603264,"internally_reserved":0,"allocated":7483392,"data_stored":5971584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575039,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56012,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315828,"statfs":{"total":96636764160,"available":96579407872,"internally_reserved":0,"allocated":2678784,"data_stored":1180823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575039,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68416,"kb_used_data":10860,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94303424,"statfs":{"total":96636764160,"available":96566706176,"internally_reserved":0,"allocated":11120640,"data_stored":9609739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:48:32.138 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:48:32.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.254+0000 7f2bbe558640 1 -- 172.21.15.146:0/3226011940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb80b4810 msgr2=0x7f2bb80ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:32.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.254+0000 7f2bbe558640 1 --2- 172.21.15.146:0/3226011940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb80b4810 0x7f2bb80ced00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80ce9f0 tx=0x7f2bb002a770 comp rx=0 tx=0).stop 2024-09-17T03:48:32.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.254+0000 7f2bbe558640 1 -- 172.21.15.146:0/3226011940 shutdown_connections 2024-09-17T03:48:32.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.254+0000 7f2bbe558640 1 --2- 172.21.15.146:0/3226011940 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb80b4810 0x7f2bb80ced00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.254+0000 7f2bbe558640 1 --2- 172.21.15.146:0/3226011940 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb80d0c50 0x7f2bb815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.254+0000 7f2bbe558640 1 -- 172.21.15.146:0/3226011940 >> 172.21.15.146:0/3226011940 conn(0x7f2bb80b2790 msgr2=0x7f2bb80d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:32.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.255+0000 7f2bbe558640 1 -- 172.21.15.146:0/3226011940 shutdown_connections 2024-09-17T03:48:32.254 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.255+0000 7f2bbe558640 1 -- 172.21.15.146:0/3226011940 wait complete. 2024-09-17T03:48:32.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.256+0000 7f2bbe558640 1 Processor -- start 2024-09-17T03:48:32.255 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.257+0000 7f2bbe558640 1 -- start start 2024-09-17T03:48:32.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bbe558640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb8073900 0x7f2bb81f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:32.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bbe558640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb80d0c50 0x7f2bb815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:32.258 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bbe558640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb815a5a0 0x7f2bb80ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bbe558640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80cf690 con 0x7f2bb80d0c50 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bbe558640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80cf510 con 0x7f2bb815a5a0 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bbe558640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb80cf810 con 0x7f2bb8073900 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb80d0c50 0x7f2bb815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bb77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb80d0c50 0x7f2bb815a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49024/0 (socket says 172.21.15.146:49024) 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bb77fe640 1 -- 172.21.15.146:0/3594310576 learned_addr learned my addr 172.21.15.146:0/3594310576 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bbcaf5640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb815a5a0 0x7f2bb80ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bb7fff640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb8073900 0x7f2bb81f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bb77fe640 1 -- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb8073900 msgr2=0x7f2bb81f70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bb77fe640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb8073900 0x7f2bb81f70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bb77fe640 1 -- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb815a5a0 msgr2=0x7f2bb80ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bb77fe640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb815a5a0 0x7f2bb80ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.258+0000 7f2bb77fe640 1 -- 172.21.15.146:0/3594310576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb815ad50 con 0x7f2bb80d0c50 2024-09-17T03:48:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.259+0000 7f2bb77fe640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb80d0c50 0x7f2bb815a060 secure :-1 s=READY pgs=2821 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c460 tx=0x7f2ba000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.259+0000 7f2bb4ff9640 1 -- 172.21.15.146:0/3594310576 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0016020 con 0x7f2bb80d0c50 2024-09-17T03:48:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.259+0000 7f2bb4ff9640 1 -- 172.21.15.146:0/3594310576 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ba0012940 con 0x7f2bb80d0c50 2024-09-17T03:48:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.259+0000 7f2bbe558640 1 -- 172.21.15.146:0/3594310576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb815b030 con 0x7f2bb80d0c50 2024-09-17T03:48:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.259+0000 7f2bb4ff9640 1 -- 172.21.15.146:0/3594310576 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0012d90 con 0x7f2bb80d0c50 2024-09-17T03:48:32.260 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.259+0000 7f2bbe558640 1 -- 172.21.15.146:0/3594310576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb815b5f0 con 0x7f2bb80d0c50 2024-09-17T03:48:32.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.260+0000 7f2bbe558640 1 -- 172.21.15.146:0/3594310576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb815aac0 con 0x7f2bb80d0c50 2024-09-17T03:48:32.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.261+0000 7f2bb4ff9640 1 -- 172.21.15.146:0/3594310576 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ba0019020 con 0x7f2bb80d0c50 2024-09-17T03:48:32.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.261+0000 7f2bb4ff9640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b98078b90 0x7f2b9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:32.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.261+0000 7f2bb4ff9640 1 -- 172.21.15.146:0/3594310576 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f2ba009ae70 con 0x7f2bb80d0c50 2024-09-17T03:48:32.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.262+0000 7f2bb7fff640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b98078b90 0x7f2b9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:32.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.262+0000 7f2bb7fff640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b98078b90 0x7f2b9807b0a0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80095f0 tx=0x7f2ba8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.269+0000 7f2bb4ff9640 1 -- 172.21.15.146:0/3594310576 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2ba0020020 con 0x7f2bb80d0c50 2024-09-17T03:48:32.455 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.456+0000 7f2bbe558640 1 -- 172.21.15.146:0/3594310576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bb80726f0 con 0x7f2bb80d0c50 2024-09-17T03:48:32.456 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.457+0000 7f2bb4ff9640 1 -- 172.21.15.146:0/3594310576 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v214) ==== 74+0+13224 (secure 0 0 0) 0x7f2bb80726f0 con 0x7f2bb80d0c50 2024-09-17T03:48:32.456 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:32.456 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":214,"fsid":"3f04b219-91f7-40f1-98fe-bc08c29ffc97","created":"2024-09-17T03:32:35.461879+0000","modified":"2024-09-17T03:48:29.308795+0000","last_up_change":"2024-09-17T03:32:48.570152+0000","last_in_change":"2024-09-17T03:32:39.086389+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:32:47.805805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a5539a5-a505-4265-961c-c0d673dbf09d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6809","nonce":2899634261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6811","nonce":2899634261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6815","nonce":2899634261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":2899634261},{"type":"v1","addr":"172.21.15.146:6813","nonce":2899634261}]},"public_addr":"172.21.15.146:6809/2899634261","cluster_addr":"172.21.15.146:6811/2899634261","heartbeat_back_addr":"172.21.15.146:6815/2899634261","heartbeat_front_addr":"172.21.15.146:6813/2899634261","state":["exists","up"]},{"osd":1,"uuid":"cde7a1c4-b80e-47ee-aace-c3490cf6a174","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6817","nonce":2854727168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6819","nonce":2854727168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6823","nonce":2854727168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":2854727168},{"type":"v1","addr":"172.21.15.146:6821","nonce":2854727168}]},"public_addr":"172.21.15.146:6817/2854727168","cluster_addr":"172.21.15.146:6819/2854727168","heartbeat_back_addr":"172.21.15.146:6823/2854727168","heartbeat_front_addr":"172.21.15.146:6821/2854727168","state":["exists","up"]},{"osd":2,"uuid":"c0fd1603-92f7-48e5-8fb5-bdb20e46a6c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6825","nonce":2785235792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6827","nonce":2785235792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6831","nonce":2785235792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":2785235792},{"type":"v1","addr":"172.21.15.146:6829","nonce":2785235792}]},"public_addr":"172.21.15.146:6825/2785235792","cluster_addr":"172.21.15.146:6827/2785235792","heartbeat_back_addr":"172.21.15.146:6831/2785235792","heartbeat_front_addr":"172.21.15.146:6829/2785235792","state":["exists","up"]},{"osd":3,"uuid":"542f3e7b-0e57-449e-89e0-a8e443f8fa44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6801","nonce":99103729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6803","nonce":99103729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6807","nonce":99103729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":99103729},{"type":"v1","addr":"172.21.15.146:6805","nonce":99103729}]},"public_addr":"172.21.15.146:6801/99103729","cluster_addr":"172.21.15.146:6803/99103729","heartbeat_back_addr":"172.21.15.146:6807/99103729","heartbeat_front_addr":"172.21.15.146:6805/99103729","state":["exists","up"]},{"osd":4,"uuid":"d6cae9a1-5c96-42c9-b3c4-8193823111c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6819","nonce":3302933995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6821","nonce":3302933995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6825","nonce":3302933995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3302933995},{"type":"v1","addr":"172.21.15.179:6823","nonce":3302933995}]},"public_addr":"172.21.15.179:6819/3302933995","cluster_addr":"172.21.15.179:6821/3302933995","heartbeat_back_addr":"172.21.15.179:6825/3302933995","heartbeat_front_addr":"172.21.15.179:6823/3302933995","state":["exists","up"]},{"osd":5,"uuid":"d956715d-591c-4915-b131-ed4756ac0e3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6803","nonce":3411666156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6805","nonce":3411666156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6809","nonce":3411666156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3411666156},{"type":"v1","addr":"172.21.15.179:6807","nonce":3411666156}]},"public_addr":"172.21.15.179:6803/3411666156","cluster_addr":"172.21.15.179:6805/3411666156","heartbeat_back_addr":"172.21.15.179:6809/3411666156","heartbeat_front_addr":"172.21.15.179:6807/3411666156","state":["exists","up"]},{"osd":6,"uuid":"da872c37-516d-432c-b171-fc750171a886","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6811","nonce":1755575046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6813","nonce":1755575046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6817","nonce":1755575046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1755575046},{"type":"v1","addr":"172.21.15.179:6815","nonce":1755575046}]},"public_addr":"172.21.15.179:6811/1755575046","cluster_addr":"172.21.15.179:6813/1755575046","heartbeat_back_addr":"172.21.15.179:6817/1755575046","heartbeat_front_addr":"172.21.15.179:6815/1755575046","state":["exists","up"]},{"osd":7,"uuid":"03575bb5-3966-4f22-85eb-378a03e46a11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":208,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6827","nonce":1919891472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6829","nonce":1919891472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6833","nonce":1919891472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1919891472},{"type":"v1","addr":"172.21.15.179:6831","nonce":1919891472}]},"public_addr":"172.21.15.179:6827/1919891472","cluster_addr":"172.21.15.179:6829/1919891472","heartbeat_back_addr":"172.21.15.179:6833/1919891472","heartbeat_front_addr":"172.21.15.179:6831/1919891472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.618808+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.973210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.840780+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.407935+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.929087+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.381505+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:45.931430+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:32:46.194726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6835/2488811693":"2024-09-18T03:48:26.296189+0000","172.21.15.146:6834/2488811693":"2024-09-18T03:48:26.296189+0000","172.21.15.179:6837/3004139766":"2024-09-18T03:47:16.276758+0000","172.21.15.179:6835/3004139766":"2024-09-18T03:47:16.276758+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:48:32.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 -- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b98078b90 msgr2=0x7f2b9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:32.458 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b98078b90 0x7f2b9807b0a0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80095f0 tx=0x7f2ba8005f90 comp rx=0 tx=0).stop 2024-09-17T03:48:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 -- 172.21.15.146:0/3594310576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb80d0c50 msgr2=0x7f2bb815a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb80d0c50 0x7f2bb815a060 secure :-1 s=READY pgs=2821 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c460 tx=0x7f2ba000c920 comp rx=0 tx=0).stop 2024-09-17T03:48:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 -- 172.21.15.146:0/3594310576 shutdown_connections 2024-09-17T03:48:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b98078b90 0x7f2b9807b0a0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2bb815a5a0 0x7f2bb80ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bb80d0c50 0x7f2bb815a060 unknown :-1 s=CLOSED pgs=2821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 --2- 172.21.15.146:0/3594310576 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2bb8073900 0x7f2bb81f70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 -- 172.21.15.146:0/3594310576 >> 172.21.15.146:0/3594310576 conn(0x7f2bb80b2790 msgr2=0x7f2bb815dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 -- 172.21.15.146:0/3594310576 shutdown_connections 2024-09-17T03:48:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:32.459+0000 7f2bbe558640 1 -- 172.21.15.146:0/3594310576 wait complete. 2024-09-17T03:48:33.471 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T03:48:33.471 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:48:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.590+0000 7f6d65d43640 1 -- 172.21.15.146:0/133756729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d6015ecf0 msgr2=0x7f6d6015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.590+0000 7f6d65d43640 1 --2- 172.21.15.146:0/133756729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d6015ecf0 0x7f6d6015f100 secure :-1 s=READY pgs=2822 cs=0 l=1 rev1=1 crypto rx=0x7f6d60072290 tx=0x7f6d5802b910 comp rx=0 tx=0).stop 2024-09-17T03:48:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.590+0000 7f6d65d43640 1 -- 172.21.15.146:0/133756729 shutdown_connections 2024-09-17T03:48:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.590+0000 7f6d65d43640 1 --2- 172.21.15.146:0/133756729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d6015ecf0 0x7f6d6015f100 unknown :-1 s=CLOSED pgs=2822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.590+0000 7f6d65d43640 1 --2- 172.21.15.146:0/133756729 >> v2:172.21.15.179:3300/0 conn(0x7f6d6006f230 0x7f6d60158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.590+0000 7f6d65d43640 1 -- 172.21.15.146:0/133756729 >> 172.21.15.146:0/133756729 conn(0x7f6d6006d170 msgr2=0x7f6d6006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.590+0000 7f6d65d43640 1 -- 172.21.15.146:0/133756729 shutdown_connections 2024-09-17T03:48:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.590+0000 7f6d65d43640 1 -- 172.21.15.146:0/133756729 wait complete. 2024-09-17T03:48:33.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.592+0000 7f6d65d43640 1 Processor -- start 2024-09-17T03:48:33.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.592+0000 7f6d65d43640 1 -- start start 2024-09-17T03:48:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.593+0000 7f6d65d43640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d6006f230 0x7f6d601f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.593+0000 7f6d65d43640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d60074620 0x7f6d600b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.593+0000 7f6d65d43640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6015ecf0 0x7f6d600cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.593+0000 7f6d65d43640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6d600d0d70 con 0x7f6d60074620 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.593+0000 7f6d65d43640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6d600d0bf0 con 0x7f6d6015ecf0 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.593+0000 7f6d65d43640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6d600d0ef0 con 0x7f6d6006f230 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.593+0000 7f6d5effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d60074620 0x7f6d600b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.593+0000 7f6d5effd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d60074620 0x7f6d600b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49036/0 (socket says 172.21.15.146:49036) 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.593+0000 7f6d5effd640 1 -- 172.21.15.146:0/991817360 learned_addr learned my addr 172.21.15.146:0/991817360 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.593+0000 7f6d5ffff640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6015ecf0 0x7f6d600cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.593+0000 7f6d5f7fe640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d6006f230 0x7f6d601f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.594+0000 7f6d5effd640 1 -- 172.21.15.146:0/991817360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d6006f230 msgr2=0x7f6d601f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.594+0000 7f6d5effd640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6d6006f230 0x7f6d601f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.594+0000 7f6d5effd640 1 -- 172.21.15.146:0/991817360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6015ecf0 msgr2=0x7f6d600cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.594+0000 7f6d5effd640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6015ecf0 0x7f6d600cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.594+0000 7f6d5effd640 1 -- 172.21.15.146:0/991817360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d601f4630 con 0x7f6d60074620 2024-09-17T03:48:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.594+0000 7f6d5effd640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d60074620 0x7f6d600b0bf0 secure :-1 s=READY pgs=2823 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400c3a0 tx=0x7f6d5400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.594+0000 7f6d47fff640 1 -- 172.21.15.146:0/991817360 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54017070 con 0x7f6d60074620 2024-09-17T03:48:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.594+0000 7f6d47fff640 1 -- 172.21.15.146:0/991817360 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d540053c0 con 0x7f6d60074620 2024-09-17T03:48:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.594+0000 7f6d65d43640 1 -- 172.21.15.146:0/991817360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d601f4910 con 0x7f6d60074620 2024-09-17T03:48:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.594+0000 7f6d47fff640 1 -- 172.21.15.146:0/991817360 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54003850 con 0x7f6d60074620 2024-09-17T03:48:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.594+0000 7f6d65d43640 1 -- 172.21.15.146:0/991817360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d600b03f0 con 0x7f6d60074620 2024-09-17T03:48:33.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.595+0000 7f6d65d43640 1 -- 172.21.15.146:0/991817360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6d60158c70 con 0x7f6d60074620 2024-09-17T03:48:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.596+0000 7f6d47fff640 1 -- 172.21.15.146:0/991817360 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6d5401a070 con 0x7f6d60074620 2024-09-17T03:48:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.596+0000 7f6d47fff640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6d4c078b90 0x7f6d4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.596+0000 7f6d47fff640 1 -- 172.21.15.146:0/991817360 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f6d5409a4d0 con 0x7f6d60074620 2024-09-17T03:48:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.597+0000 7f6d5f7fe640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6d4c078b90 0x7f6d4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.597+0000 7f6d47fff640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] conn(0x7f6d4c07eb40 0x7f6d4c080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.597+0000 7f6d47fff640 1 -- 172.21.15.146:0/991817360 --> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d54009e50 con 0x7f6d4c07eb40 2024-09-17T03:48:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.597+0000 7f6d47fff640 1 -- 172.21.15.146:0/991817360 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) ==== 24+0+0 (secure 0 0 0) 0x7f6d5409a960 con 0x7f6d60074620 2024-09-17T03:48:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.597+0000 7f6d5ffff640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] conn(0x7f6d4c07eb40 0x7f6d4c080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.597+0000 7f6d5f7fe640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6d4c078b90 0x7f6d4c07b0a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009b30 tx=0x7f6d50005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.597+0000 7f6d5ffff640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] conn(0x7f6d4c07eb40 0x7f6d4c080f90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.598+0000 7f6d47fff640 1 -- 172.21.15.146:0/991817360 <== osd.0 v2:172.21.15.146:6808/2899634261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d54009e50 con 0x7f6d4c07eb40 2024-09-17T03:48:33.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.610+0000 7f6d65d43640 1 -- 172.21.15.146:0/991817360 --> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6d600733a0 con 0x7f6d4c07eb40 2024-09-17T03:48:33.609 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.610+0000 7f6d47fff640 1 -- 172.21.15.146:0/991817360 <== osd.0 v2:172.21.15.146:6808/2899634261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6d600733a0 con 0x7f6d4c07eb40 2024-09-17T03:48:33.610 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:48:33.610 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:48:33.610 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:48:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.610+0000 7f6d65d43640 1 -- 172.21.15.146:0/991817360 >> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] conn(0x7f6d4c07eb40 msgr2=0x7f6d4c080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.610+0000 7f6d65d43640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.146:6808/2899634261,v1:172.21.15.146:6809/2899634261] conn(0x7f6d4c07eb40 0x7f6d4c080f90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.611+0000 7f6d65d43640 1 -- 172.21.15.146:0/991817360 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6d4c078b90 msgr2=0x7f6d4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.611+0000 7f6d65d43640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6d4c078b90 0x7f6d4c07b0a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009b30 tx=0x7f6d50005f90 comp rx=0 tx=0).stop 2024-09-17T03:48:33.611 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.611+0000 7f6d65d43640 1 -- 172.21.15.146:0/991817360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d60074620 msgr2=0x7f6d600b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.611+0000 7f6d65d43640 1 --2- 172.21.15.146:0/991817360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d60074620 0x7f6d600b0bf0 secure :-1 s=READY pgs=2823 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400c3a0 tx=0x7f6d5400c860 comp rx=0 tx=0).stop 2024-09-17T03:48:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.611+0000 7f6d5ffff640 1 -- 172.21.15.146:0/991817360 reap_dead start 2024-09-17T03:48:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.611+0000 7f6d65d43640 1 -- 172.21.15.146:0/991817360 shutdown_connections 2024-09-17T03:48:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.611+0000 7f6d65d43640 1 -- 172.21.15.146:0/991817360 >> 172.21.15.146:0/991817360 conn(0x7f6d6006d170 msgr2=0x7f6d6015c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.611+0000 7f6d65d43640 1 -- 172.21.15.146:0/991817360 shutdown_connections 2024-09-17T03:48:33.612 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.611+0000 7f6d65d43640 1 -- 172.21.15.146:0/991817360 wait complete. 2024-09-17T03:48:33.620 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T03:48:33.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.735+0000 7fd79428b640 1 -- 172.21.15.146:0/4000494795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78c0b6c10 msgr2=0x7fd78c0b7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:33.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.735+0000 7fd79428b640 1 --2- 172.21.15.146:0/4000494795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78c0b6c10 0x7fd78c0b7020 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd784005fd0 tx=0x7fd78402a840 comp rx=0 tx=0).stop 2024-09-17T03:48:33.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.736+0000 7fd79428b640 1 -- 172.21.15.146:0/4000494795 shutdown_connections 2024-09-17T03:48:33.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.736+0000 7fd79428b640 1 --2- 172.21.15.146:0/4000494795 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78c0b6c10 0x7fd78c0b7020 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.736+0000 7fd79428b640 1 -- 172.21.15.146:0/4000494795 >> 172.21.15.146:0/4000494795 conn(0x7fd78c0d2640 msgr2=0x7fd78c0d2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:33.735 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.736+0000 7fd79428b640 1 -- 172.21.15.146:0/4000494795 shutdown_connections 2024-09-17T03:48:33.736 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.736+0000 7fd79428b640 1 -- 172.21.15.146:0/4000494795 wait complete. 2024-09-17T03:48:33.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.737+0000 7fd79428b640 1 Processor -- start 2024-09-17T03:48:33.737 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.737+0000 7fd79428b640 1 -- start start 2024-09-17T03:48:33.739 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd79428b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78c0b60f0 0x7fd78c06ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd79428b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c0b6c10 0x7fd78c1515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd79428b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd78c0b79a0 0x7fd78c151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd79428b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c0b80d0 con 0x7fd78c0b6c10 2024-09-17T03:48:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd79428b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c0b7f50 con 0x7fd78c0b60f0 2024-09-17T03:48:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd79428b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd78c168320 con 0x7fd78c0b79a0 2024-09-17T03:48:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd791826640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c0b6c10 0x7fd78c1515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd791826640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c0b6c10 0x7fd78c1515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49046/0 (socket says 172.21.15.146:49046) 2024-09-17T03:48:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd791826640 1 -- 172.21.15.146:0/2585290832 learned_addr learned my addr 172.21.15.146:0/2585290832 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd792027640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78c0b60f0 0x7fd78c06ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:33.740 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd792828640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd78c0b79a0 0x7fd78c151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd791826640 1 -- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd78c0b79a0 msgr2=0x7fd78c151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd791826640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd78c0b79a0 0x7fd78c151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd791826640 1 -- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78c0b60f0 msgr2=0x7fd78c06ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd791826640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78c0b60f0 0x7fd78c06ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd791826640 1 -- 172.21.15.146:0/2585290832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c162fc0 con 0x7fd78c0b6c10 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd791826640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c0b6c10 0x7fd78c1515c0 secure :-1 s=READY pgs=2825 cs=0 l=1 rev1=1 crypto rx=0x7fd77c001220 tx=0x7fd77c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd782ffd640 1 -- 172.21.15.146:0/2585290832 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c016020 con 0x7fd78c0b6c10 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd782ffd640 1 -- 172.21.15.146:0/2585290832 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd77c00ce50 con 0x7fd78c0b6c10 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.739+0000 7fd79428b640 1 -- 172.21.15.146:0/2585290832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78c1f62a0 con 0x7fd78c0b6c10 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.740+0000 7fd782ffd640 1 -- 172.21.15.146:0/2585290832 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c00abb0 con 0x7fd78c0b6c10 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.740+0000 7fd79428b640 1 -- 172.21.15.146:0/2585290832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd78c0ca610 con 0x7fd78c0b6c10 2024-09-17T03:48:33.741 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.741+0000 7fd79428b640 1 -- 172.21.15.146:0/2585290832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78c0b7020 con 0x7fd78c0b6c10 2024-09-17T03:48:33.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.741+0000 7fd782ffd640 1 -- 172.21.15.146:0/2585290832 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd77c019020 con 0x7fd78c0b6c10 2024-09-17T03:48:33.742 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.742+0000 7fd782ffd640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd770078b90 0x7fd77007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:33.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.742+0000 7fd782ffd640 1 -- 172.21.15.146:0/2585290832 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7fd77c09a8d0 con 0x7fd78c0b6c10 2024-09-17T03:48:33.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.742+0000 7fd792027640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd770078b90 0x7fd77007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:33.743 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.742+0000 7fd792027640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd770078b90 0x7fd77007b0a0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd788000f60 tx=0x7fd788009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:33.745 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.746+0000 7fd782ffd640 1 -- 172.21.15.146:0/2585290832 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd77c020020 con 0x7fd78c0b6c10 2024-09-17T03:48:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.919+0000 7fd79428b640 1 -- 172.21.15.146:0/2585290832 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd78c06e270 con 0x7fd770078b90 2024-09-17T03:48:33.919 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.920+0000 7fd782ffd640 1 -- 172.21.15.146:0/2585290832 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd78c06e270 con 0x7fd770078b90 2024-09-17T03:48:33.919 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T03:48:33.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 -- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd770078b90 msgr2=0x7fd77007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:33.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd770078b90 0x7fd77007b0a0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd788000f60 tx=0x7fd788009040 comp rx=0 tx=0).stop 2024-09-17T03:48:33.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 -- 172.21.15.146:0/2585290832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c0b6c10 msgr2=0x7fd78c1515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:33.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c0b6c10 0x7fd78c1515c0 secure :-1 s=READY pgs=2825 cs=0 l=1 rev1=1 crypto rx=0x7fd77c001220 tx=0x7fd77c00cb10 comp rx=0 tx=0).stop 2024-09-17T03:48:33.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 -- 172.21.15.146:0/2585290832 shutdown_connections 2024-09-17T03:48:33.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd770078b90 0x7fd77007b0a0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd78c0b79a0 0x7fd78c151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd78c0b6c10 0x7fd78c1515c0 unknown :-1 s=CLOSED pgs=2825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 --2- 172.21.15.146:0/2585290832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd78c0b60f0 0x7fd78c06ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:33.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 -- 172.21.15.146:0/2585290832 >> 172.21.15.146:0/2585290832 conn(0x7fd78c0d2640 msgr2=0x7fd78c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:33.922 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 -- 172.21.15.146:0/2585290832 shutdown_connections 2024-09-17T03:48:33.923 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:33.922+0000 7fd79428b640 1 -- 172.21.15.146:0/2585290832 wait complete. 2024-09-17T03:48:33.933 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T03:48:33.933 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:48:34.050 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.051+0000 7f3fd5152640 1 -- 172.21.15.146:0/807401375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fd00cda80 msgr2=0x7f3fd00b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.051+0000 7f3fd5152640 1 --2- 172.21.15.146:0/807401375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fd00cda80 0x7f3fd00b57e0 secure :-1 s=READY pgs=2826 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8005fd0 tx=0x7f3fc802aa10 comp rx=0 tx=0).stop 2024-09-17T03:48:34.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.051+0000 7f3fd5152640 1 -- 172.21.15.146:0/807401375 shutdown_connections 2024-09-17T03:48:34.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.051+0000 7f3fd5152640 1 --2- 172.21.15.146:0/807401375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fd00cda80 0x7f3fd00b57e0 unknown :-1 s=CLOSED pgs=2826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.051+0000 7f3fd5152640 1 --2- 172.21.15.146:0/807401375 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fd00b7c20 0x7f3fd0160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.051+0000 7f3fd5152640 1 -- 172.21.15.146:0/807401375 >> 172.21.15.146:0/807401375 conn(0x7f3fd009ba40 msgr2=0x7f3fd00d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:34.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.051+0000 7f3fd5152640 1 -- 172.21.15.146:0/807401375 shutdown_connections 2024-09-17T03:48:34.051 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.051+0000 7f3fd5152640 1 -- 172.21.15.146:0/807401375 wait complete. 2024-09-17T03:48:34.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.053+0000 7f3fd5152640 1 Processor -- start 2024-09-17T03:48:34.052 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.053+0000 7f3fd5152640 1 -- start start 2024-09-17T03:48:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.054+0000 7f3fd5152640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fd00b7470 0x7f3fd015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.054+0000 7f3fd5152640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fd00b7c20 0x7f3fd01f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.054+0000 7f3fd5152640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fd00cda80 0x7f3fd00b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.054+0000 7f3fd5152640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd00b5ea0 con 0x7f3fd00b7470 2024-09-17T03:48:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.054+0000 7f3fd5152640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd00b5d20 con 0x7f3fd00b7c20 2024-09-17T03:48:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.054+0000 7f3fd5152640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd00b6020 con 0x7f3fd00cda80 2024-09-17T03:48:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.054+0000 7f3fced9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fd00b7470 0x7f3fd015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.054+0000 7f3fced9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fd00b7470 0x7f3fd015ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49062/0 (socket says 172.21.15.146:49062) 2024-09-17T03:48:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.054+0000 7f3fced9d640 1 -- 172.21.15.146:0/1162936750 learned_addr learned my addr 172.21.15.146:0/1162936750 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.054+0000 7f3fc659c640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fd00b7c20 0x7f3fd01f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.054+0000 7f3fcf59e640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fd00cda80 0x7f3fd00b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.055+0000 7f3fced9d640 1 -- 172.21.15.146:0/1162936750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fd00cda80 msgr2=0x7f3fd00b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.055+0000 7f3fced9d640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3fd00cda80 0x7f3fd00b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.055+0000 7f3fced9d640 1 -- 172.21.15.146:0/1162936750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fd00b7c20 msgr2=0x7f3fd01f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.055+0000 7f3fced9d640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3fd00b7c20 0x7f3fd01f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.055+0000 7f3fced9d640 1 -- 172.21.15.146:0/1162936750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd01f6be0 con 0x7f3fd00b7470 2024-09-17T03:48:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.055+0000 7f3fced9d640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fd00b7470 0x7f3fd015ba70 secure :-1 s=READY pgs=2827 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000e790 tx=0x7f3fc000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.055+0000 7f3fc7fff640 1 -- 172.21.15.146:0/1162936750 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000eea0 con 0x7f3fd00b7470 2024-09-17T03:48:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.055+0000 7f3fc7fff640 1 -- 172.21.15.146:0/1162936750 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fc000cdb0 con 0x7f3fd00b7470 2024-09-17T03:48:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.055+0000 7f3fc7fff640 1 -- 172.21.15.146:0/1162936750 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0010690 con 0x7f3fd00b7470 2024-09-17T03:48:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.055+0000 7f3fd5152640 1 -- 172.21.15.146:0/1162936750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd00c6880 con 0x7f3fd00b7470 2024-09-17T03:48:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.055+0000 7f3fd5152640 1 -- 172.21.15.146:0/1162936750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd00c6e40 con 0x7f3fd00b7470 2024-09-17T03:48:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.056+0000 7f3fd5152640 1 -- 172.21.15.146:0/1162936750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3fd00b6510 con 0x7f3fd00b7470 2024-09-17T03:48:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.057+0000 7f3fc7fff640 1 -- 172.21.15.146:0/1162936750 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3fc0010830 con 0x7f3fd00b7470 2024-09-17T03:48:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.057+0000 7f3fc7fff640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3fb0078b90 0x7f3fb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.057+0000 7f3fc7fff640 1 -- 172.21.15.146:0/1162936750 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f3fc009b320 con 0x7f3fd00b7470 2024-09-17T03:48:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.057+0000 7f3fc659c640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3fb0078b90 0x7f3fb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.057+0000 7f3fc7fff640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x7f3fb007eb40 0x7f3fb0080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.057+0000 7f3fc7fff640 1 -- 172.21.15.146:0/1162936750 --> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fc000be50 con 0x7f3fb007eb40 2024-09-17T03:48:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.057+0000 7f3fc7fff640 1 -- 172.21.15.146:0/1162936750 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) ==== 24+0+0 (secure 0 0 0) 0x7f3fc00a2050 con 0x7f3fd00b7470 2024-09-17T03:48:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.058+0000 7f3fcf59e640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x7f3fb007eb40 0x7f3fb0080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.058+0000 7f3fc659c640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3fb0078b90 0x7f3fb007b0a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f3fd006e050 tx=0x7f3fb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.058+0000 7f3fcf59e640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x7f3fb007eb40 0x7f3fb0080f90 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.059+0000 7f3fc7fff640 1 -- 172.21.15.146:0/1162936750 <== osd.1 v2:172.21.15.146:6816/2854727168 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3fc000be50 con 0x7f3fb007eb40 2024-09-17T03:48:34.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.071+0000 7f3fd5152640 1 -- 172.21.15.146:0/1162936750 --> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3fd00c7820 con 0x7f3fb007eb40 2024-09-17T03:48:34.070 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.071+0000 7f3fc7fff640 1 -- 172.21.15.146:0/1162936750 <== osd.1 v2:172.21.15.146:6816/2854727168 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3fc8009360 con 0x7f3fb007eb40 2024-09-17T03:48:34.070 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:48:34.070 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:48:34.071 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:48:34.071 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.071+0000 7f3fd5152640 1 -- 172.21.15.146:0/1162936750 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x7f3fb007eb40 msgr2=0x7f3fb0080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.071+0000 7f3fd5152640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.146:6816/2854727168,v1:172.21.15.146:6817/2854727168] conn(0x7f3fb007eb40 0x7f3fb0080f90 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.072+0000 7f3fd5152640 1 -- 172.21.15.146:0/1162936750 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3fb0078b90 msgr2=0x7f3fb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.072+0000 7f3fd5152640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f3fb0078b90 0x7f3fb007b0a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f3fd006e050 tx=0x7f3fb8009040 comp rx=0 tx=0).stop 2024-09-17T03:48:34.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.072+0000 7f3fd5152640 1 -- 172.21.15.146:0/1162936750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fd00b7470 msgr2=0x7f3fd015ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.072+0000 7f3fd5152640 1 --2- 172.21.15.146:0/1162936750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fd00b7470 0x7f3fd015ba70 secure :-1 s=READY pgs=2827 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000e790 tx=0x7f3fc000ec50 comp rx=0 tx=0).stop 2024-09-17T03:48:34.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.072+0000 7f3fcf59e640 1 -- 172.21.15.146:0/1162936750 reap_dead start 2024-09-17T03:48:34.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.072+0000 7f3fd5152640 1 -- 172.21.15.146:0/1162936750 shutdown_connections 2024-09-17T03:48:34.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.072+0000 7f3fd5152640 1 -- 172.21.15.146:0/1162936750 >> 172.21.15.146:0/1162936750 conn(0x7f3fd009ba40 msgr2=0x7f3fd00d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:34.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.072+0000 7f3fd5152640 1 -- 172.21.15.146:0/1162936750 shutdown_connections 2024-09-17T03:48:34.072 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.072+0000 7f3fd5152640 1 -- 172.21.15.146:0/1162936750 wait complete. 2024-09-17T03:48:34.081 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T03:48:34.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.196+0000 7f20cdf07640 1 -- 172.21.15.146:0/983547473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c80d1050 msgr2=0x7f20c80b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.196+0000 7f20cdf07640 1 --2- 172.21.15.146:0/983547473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c80d1050 0x7f20c80b5ad0 secure :-1 s=READY pgs=2828 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009ca0 tx=0x7f20c002aac0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.196+0000 7f20cdf07640 1 -- 172.21.15.146:0/983547473 shutdown_connections 2024-09-17T03:48:34.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.196+0000 7f20cdf07640 1 --2- 172.21.15.146:0/983547473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c80d1050 0x7f20c80b5ad0 unknown :-1 s=CLOSED pgs=2828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.196+0000 7f20cdf07640 1 --2- 172.21.15.146:0/983547473 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c80cebc0 0x7f20c80d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.196+0000 7f20cdf07640 1 -- 172.21.15.146:0/983547473 >> 172.21.15.146:0/983547473 conn(0x7f20c80d26c0 msgr2=0x7f20c80d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:34.195 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.196+0000 7f20cdf07640 1 -- 172.21.15.146:0/983547473 shutdown_connections 2024-09-17T03:48:34.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.196+0000 7f20cdf07640 1 -- 172.21.15.146:0/983547473 wait complete. 2024-09-17T03:48:34.196 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.198+0000 7f20cdf07640 1 Processor -- start 2024-09-17T03:48:34.197 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.198+0000 7f20cdf07640 1 -- start start 2024-09-17T03:48:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20cdf07640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20c80cebc0 0x7f20c8150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20cdf07640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c80d1050 0x7f20c80ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20cdf07640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c80d31e0 0x7f20c80ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20cdf07640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f20c80b6570 con 0x7f20c80d1050 2024-09-17T03:48:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20cdf07640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f20c80b63f0 con 0x7f20c80cebc0 2024-09-17T03:48:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20cdf07640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f20c80b66f0 con 0x7f20c80d31e0 2024-09-17T03:48:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20c6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c80d1050 0x7f20c80ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20c6ffd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c80d1050 0x7f20c80ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49070/0 (socket says 172.21.15.146:49070) 2024-09-17T03:48:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20c6ffd640 1 -- 172.21.15.146:0/2122563437 learned_addr learned my addr 172.21.15.146:0/2122563437 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:34.200 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20c77fe640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20c80cebc0 0x7f20c8150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20c7fff640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c80d31e0 0x7f20c80ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20c6ffd640 1 -- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c80d31e0 msgr2=0x7f20c80ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20c6ffd640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c80d31e0 0x7f20c80ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20c6ffd640 1 -- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20c80cebc0 msgr2=0x7f20c8150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20c6ffd640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20c80cebc0 0x7f20c8150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.199+0000 7f20c6ffd640 1 -- 172.21.15.146:0/2122563437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c81e42b0 con 0x7f20c80d1050 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.200+0000 7f20c6ffd640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c80d1050 0x7f20c80ca2f0 secure :-1 s=READY pgs=2829 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00e7c0 tx=0x7f20bc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.200+0000 7f20affff640 1 -- 172.21.15.146:0/2122563437 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00ccc0 con 0x7f20c80d1050 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.200+0000 7f20affff640 1 -- 172.21.15.146:0/2122563437 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20bc010430 con 0x7f20c80d1050 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.200+0000 7f20affff640 1 -- 172.21.15.146:0/2122563437 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc010860 con 0x7f20c80d1050 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.200+0000 7f20cdf07640 1 -- 172.21.15.146:0/2122563437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c81e3fd0 con 0x7f20c80d1050 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.200+0000 7f20cdf07640 1 -- 172.21.15.146:0/2122563437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c80c9af0 con 0x7f20c80d1050 2024-09-17T03:48:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.201+0000 7f20cdf07640 1 -- 172.21.15.146:0/2122563437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c81e3d40 con 0x7f20c80d1050 2024-09-17T03:48:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.201+0000 7f20affff640 1 -- 172.21.15.146:0/2122563437 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20bc010a00 con 0x7f20c80d1050 2024-09-17T03:48:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.202+0000 7f20affff640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078b90 0x7f20b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.202+0000 7f20affff640 1 -- 172.21.15.146:0/2122563437 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f20bc09b400 con 0x7f20c80d1050 2024-09-17T03:48:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.202+0000 7f20c77fe640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078b90 0x7f20b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.202 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.203+0000 7f20c77fe640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078b90 0x7f20b407b0a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f20b8007fd0 tx=0x7f20b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.205 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.207+0000 7f20affff640 1 -- 172.21.15.146:0/2122563437 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f20bc063490 con 0x7f20c80d1050 2024-09-17T03:48:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.381+0000 7f20cdf07640 1 -- 172.21.15.146:0/2122563437 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f20c80b4710 con 0x7f20b4078b90 2024-09-17T03:48:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.382+0000 7f20affff640 1 -- 172.21.15.146:0/2122563437 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f20c80b4710 con 0x7f20b4078b90 2024-09-17T03:48:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T03:48:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 -- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078b90 msgr2=0x7f20b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078b90 0x7f20b407b0a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f20b8007fd0 tx=0x7f20b8009040 comp rx=0 tx=0).stop 2024-09-17T03:48:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 -- 172.21.15.146:0/2122563437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c80d1050 msgr2=0x7f20c80ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c80d1050 0x7f20c80ca2f0 secure :-1 s=READY pgs=2829 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00e7c0 tx=0x7f20bc00ec80 comp rx=0 tx=0).stop 2024-09-17T03:48:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 -- 172.21.15.146:0/2122563437 shutdown_connections 2024-09-17T03:48:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f20b4078b90 0x7f20b407b0a0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f20c80d31e0 0x7f20c80ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20c80d1050 0x7f20c80ca2f0 unknown :-1 s=CLOSED pgs=2829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 --2- 172.21.15.146:0/2122563437 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f20c80cebc0 0x7f20c8150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 -- 172.21.15.146:0/2122563437 >> 172.21.15.146:0/2122563437 conn(0x7f20c80d26c0 msgr2=0x7f20c80b4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 -- 172.21.15.146:0/2122563437 shutdown_connections 2024-09-17T03:48:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.384+0000 7f20cdf07640 1 -- 172.21.15.146:0/2122563437 wait complete. 2024-09-17T03:48:34.394 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T03:48:34.395 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:48:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.513+0000 7f78b7d50640 1 -- 172.21.15.146:0/2975405293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b00b7fb0 msgr2=0x7f78b00ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.513+0000 7f78b7d50640 1 --2- 172.21.15.146:0/2975405293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b00b7fb0 0x7f78b00ce3b0 secure :-1 s=READY pgs=2831 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009860 tx=0x7f78a402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.513+0000 7f78b7d50640 1 -- 172.21.15.146:0/2975405293 shutdown_connections 2024-09-17T03:48:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.513+0000 7f78b7d50640 1 --2- 172.21.15.146:0/2975405293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b00b7fb0 0x7f78b00ce3b0 unknown :-1 s=CLOSED pgs=2831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.513+0000 7f78b7d50640 1 --2- 172.21.15.146:0/2975405293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b00d3320 0x7f78b00d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.513+0000 7f78b7d50640 1 -- 172.21.15.146:0/2975405293 >> 172.21.15.146:0/2975405293 conn(0x7f78b009ba40 msgr2=0x7f78b00d2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.513+0000 7f78b7d50640 1 -- 172.21.15.146:0/2975405293 shutdown_connections 2024-09-17T03:48:34.513 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.513+0000 7f78b7d50640 1 -- 172.21.15.146:0/2975405293 wait complete. 2024-09-17T03:48:34.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.515+0000 7f78b7d50640 1 Processor -- start 2024-09-17T03:48:34.514 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.515+0000 7f78b7d50640 1 -- start start 2024-09-17T03:48:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.516+0000 7f78b7d50640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78b00b7fb0 0x7f78b01f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.516+0000 7f78b7d50640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b00cf140 0x7f78b01f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.516+0000 7f78b7d50640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b00d3320 0x7f78b01f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.516+0000 7f78b7d50640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f78b00b26f0 con 0x7f78b00d3320 2024-09-17T03:48:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.516+0000 7f78b7d50640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f78b00b2570 con 0x7f78b00b7fb0 2024-09-17T03:48:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.516+0000 7f78b7d50640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f78b00b2870 con 0x7f78b00cf140 2024-09-17T03:48:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.516+0000 7f78b62ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b00d3320 0x7f78b01f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b62ed640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b00d3320 0x7f78b01f7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49086/0 (socket says 172.21.15.146:49086) 2024-09-17T03:48:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b62ed640 1 -- 172.21.15.146:0/2266993166 learned_addr learned my addr 172.21.15.146:0/2266993166 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b52eb640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b00cf140 0x7f78b01f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.517 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b5aec640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78b00b7fb0 0x7f78b01f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b62ed640 1 -- 172.21.15.146:0/2266993166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b00cf140 msgr2=0x7f78b01f77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b62ed640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f78b00cf140 0x7f78b01f77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b62ed640 1 -- 172.21.15.146:0/2266993166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78b00b7fb0 msgr2=0x7f78b01f41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b62ed640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f78b00b7fb0 0x7f78b01f41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b62ed640 1 -- 172.21.15.146:0/2266993166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b01f4a50 con 0x7f78b00d3320 2024-09-17T03:48:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b62ed640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b00d3320 0x7f78b01f7ce0 secure :-1 s=READY pgs=2832 cs=0 l=1 rev1=1 crypto rx=0x7f78a000ca20 tx=0x7f78a000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78ae7fc640 1 -- 172.21.15.146:0/2266993166 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0016020 con 0x7f78b00d3320 2024-09-17T03:48:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78ae7fc640 1 -- 172.21.15.146:0/2266993166 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78a000ac60 con 0x7f78b00d3320 2024-09-17T03:48:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b7d50640 1 -- 172.21.15.146:0/2266993166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b01f4d30 con 0x7f78b00d3320 2024-09-17T03:48:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78ae7fc640 1 -- 172.21.15.146:0/2266993166 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0012680 con 0x7f78b00d3320 2024-09-17T03:48:34.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.517+0000 7f78b7d50640 1 -- 172.21.15.146:0/2266993166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b009dd00 con 0x7f78b00d3320 2024-09-17T03:48:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.518+0000 7f78b7d50640 1 -- 172.21.15.146:0/2266993166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78b00b2e00 con 0x7f78b00d3320 2024-09-17T03:48:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.519+0000 7f78ae7fc640 1 -- 172.21.15.146:0/2266993166 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78a0019020 con 0x7f78b00d3320 2024-09-17T03:48:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.519+0000 7f78ae7fc640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f789c078b90 0x7f789c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.520+0000 7f78ae7fc640 1 -- 172.21.15.146:0/2266993166 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f78a009b420 con 0x7f78b00d3320 2024-09-17T03:48:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.520+0000 7f78b5aec640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f789c078b90 0x7f789c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.520+0000 7f78ae7fc640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] conn(0x7f789c07eb40 0x7f789c080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.520+0000 7f78ae7fc640 1 -- 172.21.15.146:0/2266993166 --> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78a0019ec0 con 0x7f789c07eb40 2024-09-17T03:48:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.520+0000 7f78ae7fc640 1 -- 172.21.15.146:0/2266993166 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) ==== 24+0+0 (secure 0 0 0) 0x7f78a009b8b0 con 0x7f78b00d3320 2024-09-17T03:48:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.520+0000 7f78b52eb640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] conn(0x7f789c07eb40 0x7f789c080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.520+0000 7f78b52eb640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] conn(0x7f789c07eb40 0x7f789c080f90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.520+0000 7f78b5aec640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f789c078b90 0x7f789c07b0a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f78a800bb50 tx=0x7f78a800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.521 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.521+0000 7f78ae7fc640 1 -- 172.21.15.146:0/2266993166 <== osd.2 v2:172.21.15.146:6824/2785235792 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f78a0019ec0 con 0x7f789c07eb40 2024-09-17T03:48:34.532 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.533+0000 7f78b7d50640 1 -- 172.21.15.146:0/2266993166 --> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f78b01f4800 con 0x7f789c07eb40 2024-09-17T03:48:34.533 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.533+0000 7f78ae7fc640 1 -- 172.21.15.146:0/2266993166 <== osd.2 v2:172.21.15.146:6824/2785235792 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f78b01f4800 con 0x7f789c07eb40 2024-09-17T03:48:34.533 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:48:34.533 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:48:34.533 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:48:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.534+0000 7f78b7d50640 1 -- 172.21.15.146:0/2266993166 >> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] conn(0x7f789c07eb40 msgr2=0x7f789c080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.534+0000 7f78b7d50640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.146:6824/2785235792,v1:172.21.15.146:6825/2785235792] conn(0x7f789c07eb40 0x7f789c080f90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.534+0000 7f78b7d50640 1 -- 172.21.15.146:0/2266993166 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f789c078b90 msgr2=0x7f789c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.534+0000 7f78b7d50640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f789c078b90 0x7f789c07b0a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f78a800bb50 tx=0x7f78a800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.534+0000 7f78b7d50640 1 -- 172.21.15.146:0/2266993166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b00d3320 msgr2=0x7f78b01f7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.534+0000 7f78b7d50640 1 --2- 172.21.15.146:0/2266993166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b00d3320 0x7f78b01f7ce0 secure :-1 s=READY pgs=2832 cs=0 l=1 rev1=1 crypto rx=0x7f78a000ca20 tx=0x7f78a000cee0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.534+0000 7f78b62ed640 1 -- 172.21.15.146:0/2266993166 reap_dead start 2024-09-17T03:48:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.534+0000 7f78b7d50640 1 -- 172.21.15.146:0/2266993166 shutdown_connections 2024-09-17T03:48:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.534+0000 7f78b7d50640 1 -- 172.21.15.146:0/2266993166 >> 172.21.15.146:0/2266993166 conn(0x7f78b009ba40 msgr2=0x7f78b0072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.534+0000 7f78b7d50640 1 -- 172.21.15.146:0/2266993166 shutdown_connections 2024-09-17T03:48:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.534+0000 7f78b7d50640 1 -- 172.21.15.146:0/2266993166 wait complete. 2024-09-17T03:48:34.544 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T03:48:34.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.659+0000 7fec5d2ce640 1 -- 172.21.15.146:0/3011925651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec580b7b70 msgr2=0x7fec580b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.659+0000 7fec5d2ce640 1 --2- 172.21.15.146:0/3011925651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec580b7b70 0x7fec580b19c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fec48009820 tx=0x7fec4802a3d0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.659+0000 7fec5d2ce640 1 -- 172.21.15.146:0/3011925651 shutdown_connections 2024-09-17T03:48:34.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.659+0000 7fec5d2ce640 1 --2- 172.21.15.146:0/3011925651 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec580b7b70 0x7fec580b19c0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.660+0000 7fec5d2ce640 1 -- 172.21.15.146:0/3011925651 >> 172.21.15.146:0/3011925651 conn(0x7fec580d2740 msgr2=0x7fec580d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:34.659 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.660+0000 7fec5d2ce640 1 -- 172.21.15.146:0/3011925651 shutdown_connections 2024-09-17T03:48:34.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.660+0000 7fec5d2ce640 1 -- 172.21.15.146:0/3011925651 wait complete. 2024-09-17T03:48:34.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.661+0000 7fec5d2ce640 1 Processor -- start 2024-09-17T03:48:34.660 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.661+0000 7fec5d2ce640 1 -- start start 2024-09-17T03:48:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec5d2ce640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec580b32d0 0x7fec58149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec5d2ce640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec580b7b70 0x7fec58148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec5d2ce640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec580cef80 0x7fec581f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec5d2ce640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fec580cdf40 con 0x7fec580cef80 2024-09-17T03:48:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec5d2ce640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fec580cddc0 con 0x7fec580b32d0 2024-09-17T03:48:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec5d2ce640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fec580ce0c0 con 0x7fec580b7b70 2024-09-17T03:48:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec577fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec580cef80 0x7fec581f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.663 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec577fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec580cef80 0x7fec581f2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49096/0 (socket says 172.21.15.146:49096) 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec577fe640 1 -- 172.21.15.146:0/662680943 learned_addr learned my addr 172.21.15.146:0/662680943 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec56ffd640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec580b32d0 0x7fec58149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec4e7fc640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec580b7b70 0x7fec58148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec577fe640 1 -- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec580b7b70 msgr2=0x7fec58148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec577fe640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec580b7b70 0x7fec58148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec577fe640 1 -- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec580b32d0 msgr2=0x7fec58149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec577fe640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec580b32d0 0x7fec58149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec577fe640 1 -- 172.21.15.146:0/662680943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5815caf0 con 0x7fec580cef80 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec56ffd640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec580b32d0 0x7fec58149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.663+0000 7fec577fe640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec580cef80 0x7fec581f2ad0 secure :-1 s=READY pgs=2834 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c7a0 tx=0x7fec5000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.664+0000 7fec4ffff640 1 -- 172.21.15.146:0/662680943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec50017070 con 0x7fec580cef80 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.664+0000 7fec4ffff640 1 -- 172.21.15.146:0/662680943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec50005070 con 0x7fec580cef80 2024-09-17T03:48:34.664 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.664+0000 7fec4ffff640 1 -- 172.21.15.146:0/662680943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec500054a0 con 0x7fec580cef80 2024-09-17T03:48:34.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.664+0000 7fec5d2ce640 1 -- 172.21.15.146:0/662680943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5815cdd0 con 0x7fec580cef80 2024-09-17T03:48:34.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.664+0000 7fec5d2ce640 1 -- 172.21.15.146:0/662680943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5815d390 con 0x7fec580cef80 2024-09-17T03:48:34.665 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.665+0000 7fec5d2ce640 1 -- 172.21.15.146:0/662680943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec580ce5d0 con 0x7fec580cef80 2024-09-17T03:48:34.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.665+0000 7fec4ffff640 1 -- 172.21.15.146:0/662680943 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec5001a070 con 0x7fec580cef80 2024-09-17T03:48:34.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.666+0000 7fec4ffff640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec38078b90 0x7fec3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.666+0000 7fec4ffff640 1 -- 172.21.15.146:0/662680943 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7fec5009a0c0 con 0x7fec580cef80 2024-09-17T03:48:34.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.666+0000 7fec56ffd640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec38078b90 0x7fec3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.666 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.667+0000 7fec56ffd640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec38078b90 0x7fec3807b0a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fec48034000 tx=0x7fec4802c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.670 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.671+0000 7fec4ffff640 1 -- 172.21.15.146:0/662680943 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec50062150 con 0x7fec580cef80 2024-09-17T03:48:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.849+0000 7fec5d2ce640 1 -- 172.21.15.146:0/662680943 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fec580b2c90 con 0x7fec38078b90 2024-09-17T03:48:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.850+0000 7fec4ffff640 1 -- 172.21.15.146:0/662680943 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fec580b2c90 con 0x7fec38078b90 2024-09-17T03:48:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T03:48:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.852+0000 7fec5d2ce640 1 -- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec38078b90 msgr2=0x7fec3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.852+0000 7fec5d2ce640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec38078b90 0x7fec3807b0a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fec48034000 tx=0x7fec4802c040 comp rx=0 tx=0).stop 2024-09-17T03:48:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.852+0000 7fec5d2ce640 1 -- 172.21.15.146:0/662680943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec580cef80 msgr2=0x7fec581f2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.852+0000 7fec5d2ce640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec580cef80 0x7fec581f2ad0 secure :-1 s=READY pgs=2834 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c7a0 tx=0x7fec5000cc60 comp rx=0 tx=0).stop 2024-09-17T03:48:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.852+0000 7fec5d2ce640 1 -- 172.21.15.146:0/662680943 shutdown_connections 2024-09-17T03:48:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.852+0000 7fec5d2ce640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fec38078b90 0x7fec3807b0a0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.852+0000 7fec5d2ce640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec580cef80 0x7fec581f2ad0 unknown :-1 s=CLOSED pgs=2834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.852+0000 7fec5d2ce640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fec580b7b70 0x7fec58148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.852+0000 7fec5d2ce640 1 --2- 172.21.15.146:0/662680943 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec580b32d0 0x7fec58149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.852+0000 7fec5d2ce640 1 -- 172.21.15.146:0/662680943 >> 172.21.15.146:0/662680943 conn(0x7fec580d2740 msgr2=0x7fec580cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:34.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.852+0000 7fec5d2ce640 1 -- 172.21.15.146:0/662680943 shutdown_connections 2024-09-17T03:48:34.853 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.853+0000 7fec5d2ce640 1 -- 172.21.15.146:0/662680943 wait complete. 2024-09-17T03:48:34.862 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T03:48:34.862 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:48:34.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.979+0000 7efd4ccf2640 1 -- 172.21.15.146:0/3745289042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd4815ca50 msgr2=0x7efd480cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.979+0000 7efd4ccf2640 1 --2- 172.21.15.146:0/3745289042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd4815ca50 0x7efd480cdbe0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7efd38005fd0 tx=0x7efd3802a840 comp rx=0 tx=0).stop 2024-09-17T03:48:34.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.980+0000 7efd4ccf2640 1 -- 172.21.15.146:0/3745289042 shutdown_connections 2024-09-17T03:48:34.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.980+0000 7efd4ccf2640 1 --2- 172.21.15.146:0/3745289042 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd4815ca50 0x7efd480cdbe0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.980+0000 7efd4ccf2640 1 -- 172.21.15.146:0/3745289042 >> 172.21.15.146:0/3745289042 conn(0x7efd4806e070 msgr2=0x7efd4806e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:34.979 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.980+0000 7efd4ccf2640 1 -- 172.21.15.146:0/3745289042 shutdown_connections 2024-09-17T03:48:34.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.980+0000 7efd4ccf2640 1 -- 172.21.15.146:0/3745289042 wait complete. 2024-09-17T03:48:34.980 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.982+0000 7efd4ccf2640 1 Processor -- start 2024-09-17T03:48:34.981 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.982+0000 7efd4ccf2640 1 -- start start 2024-09-17T03:48:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd4ccf2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd48071010 0x7efd4814d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd4ccf2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd4815ca50 0x7efd48153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd4ccf2640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd48157d60 0x7efd48158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd4ccf2640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7efd4815e5e0 con 0x7efd48157d60 2024-09-17T03:48:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd4ccf2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efd4815e460 con 0x7efd4815ca50 2024-09-17T03:48:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd4ccf2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efd4815e760 con 0x7efd48071010 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd46d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd48157d60 0x7efd48158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd46d9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd48157d60 0x7efd48158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49102/0 (socket says 172.21.15.146:49102) 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd46d9d640 1 -- 172.21.15.146:0/4208761947 learned_addr learned my addr 172.21.15.146:0/4208761947 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd4659c640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd48071010 0x7efd4814d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd45d9b640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd4815ca50 0x7efd48153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd46d9d640 1 -- 172.21.15.146:0/4208761947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd48071010 msgr2=0x7efd4814d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd46d9d640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efd48071010 0x7efd4814d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd46d9d640 1 -- 172.21.15.146:0/4208761947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd4815ca50 msgr2=0x7efd48153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd46d9d640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efd4815ca50 0x7efd48153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.983+0000 7efd46d9d640 1 -- 172.21.15.146:0/4208761947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd481586b0 con 0x7efd48157d60 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.984+0000 7efd46d9d640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd48157d60 0x7efd48158170 secure :-1 s=READY pgs=2836 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c3f0 tx=0x7efd4000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.984+0000 7efd36ffd640 1 -- 172.21.15.146:0/4208761947 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40017070 con 0x7efd48157d60 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.984+0000 7efd36ffd640 1 -- 172.21.15.146:0/4208761947 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd400053c0 con 0x7efd48157d60 2024-09-17T03:48:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.984+0000 7efd4ccf2640 1 -- 172.21.15.146:0/4208761947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd48153db0 con 0x7efd48157d60 2024-09-17T03:48:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.984+0000 7efd36ffd640 1 -- 172.21.15.146:0/4208761947 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40003850 con 0x7efd48157d60 2024-09-17T03:48:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.984+0000 7efd4ccf2640 1 -- 172.21.15.146:0/4208761947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd481f7620 con 0x7efd48157d60 2024-09-17T03:48:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.985+0000 7efd4ccf2640 1 -- 172.21.15.146:0/4208761947 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd4814d710 con 0x7efd48157d60 2024-09-17T03:48:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.986+0000 7efd36ffd640 1 -- 172.21.15.146:0/4208761947 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd4001a070 con 0x7efd48157d60 2024-09-17T03:48:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.986+0000 7efd36ffd640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd28078bc0 0x7efd2807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.986+0000 7efd36ffd640 1 -- 172.21.15.146:0/4208761947 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7efd4009a460 con 0x7efd48157d60 2024-09-17T03:48:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.986+0000 7efd4659c640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd28078bc0 0x7efd2807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.986+0000 7efd36ffd640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x7efd2807eb70 0x7efd28080fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.986+0000 7efd36ffd640 1 -- 172.21.15.146:0/4208761947 --> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd40009e50 con 0x7efd2807eb70 2024-09-17T03:48:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.986+0000 7efd36ffd640 1 -- 172.21.15.146:0/4208761947 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) ==== 24+0+0 (secure 0 0 0) 0x7efd4009a8f0 con 0x7efd48157d60 2024-09-17T03:48:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.986+0000 7efd45d9b640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x7efd2807eb70 0x7efd28080fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:34.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.987+0000 7efd45d9b640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x7efd2807eb70 0x7efd28080fc0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.987+0000 7efd4659c640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd28078bc0 0x7efd2807b0d0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7efd38033000 tx=0x7efd38004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:34.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.987+0000 7efd36ffd640 1 -- 172.21.15.146:0/4208761947 <== osd.3 v2:172.21.15.146:6800/99103729 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd40009e50 con 0x7efd2807eb70 2024-09-17T03:48:34.998 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:34.999+0000 7efd4ccf2640 1 -- 172.21.15.146:0/4208761947 --> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efd481f3ba0 con 0x7efd2807eb70 2024-09-17T03:48:34.999 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd36ffd640 1 -- 172.21.15.146:0/4208761947 <== osd.3 v2:172.21.15.146:6800/99103729 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efd481f3ba0 con 0x7efd2807eb70 2024-09-17T03:48:34.999 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:48:34.999 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:48:34.999 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:48:35.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd4ccf2640 1 -- 172.21.15.146:0/4208761947 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x7efd2807eb70 msgr2=0x7efd28080fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd4ccf2640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.146:6800/99103729,v1:172.21.15.146:6801/99103729] conn(0x7efd2807eb70 0x7efd28080fc0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd4ccf2640 1 -- 172.21.15.146:0/4208761947 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd28078bc0 msgr2=0x7efd2807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd4ccf2640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7efd28078bc0 0x7efd2807b0d0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7efd38033000 tx=0x7efd38004ab0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd4ccf2640 1 -- 172.21.15.146:0/4208761947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd48157d60 msgr2=0x7efd48158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd4ccf2640 1 --2- 172.21.15.146:0/4208761947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd48157d60 0x7efd48158170 secure :-1 s=READY pgs=2836 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c3f0 tx=0x7efd4000c8b0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.000 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd46d9d640 1 -- 172.21.15.146:0/4208761947 reap_dead start 2024-09-17T03:48:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd4ccf2640 1 -- 172.21.15.146:0/4208761947 shutdown_connections 2024-09-17T03:48:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd4ccf2640 1 -- 172.21.15.146:0/4208761947 >> 172.21.15.146:0/4208761947 conn(0x7efd4806e070 msgr2=0x7efd480b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd4ccf2640 1 -- 172.21.15.146:0/4208761947 shutdown_connections 2024-09-17T03:48:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.000+0000 7efd4ccf2640 1 -- 172.21.15.146:0/4208761947 wait complete. 2024-09-17T03:48:35.010 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T03:48:35.124 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.125+0000 7f2b00abd640 1 -- 172.21.15.146:0/2299844583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae8003a50 msgr2=0x7f2ae8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.125+0000 7f2b00abd640 1 --2- 172.21.15.146:0/2299844583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae8003a50 0x7f2ae8003ec0 secure :-1 s=READY pgs=2838 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009b20 tx=0x7f2ae8005830 comp rx=0 tx=0).stop 2024-09-17T03:48:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.125+0000 7f2b00abd640 1 -- 172.21.15.146:0/2299844583 shutdown_connections 2024-09-17T03:48:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.125+0000 7f2b00abd640 1 --2- 172.21.15.146:0/2299844583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ae8003a50 0x7f2ae8003ec0 unknown :-1 s=CLOSED pgs=2838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.125+0000 7f2b00abd640 1 -- 172.21.15.146:0/2299844583 >> 172.21.15.146:0/2299844583 conn(0x7f2afc0d2650 msgr2=0x7f2afc0d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.125+0000 7f2b00abd640 1 -- 172.21.15.146:0/2299844583 shutdown_connections 2024-09-17T03:48:35.125 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.125+0000 7f2b00abd640 1 -- 172.21.15.146:0/2299844583 wait complete. 2024-09-17T03:48:35.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.127+0000 7f2b00abd640 1 Processor -- start 2024-09-17T03:48:35.126 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.127+0000 7f2b00abd640 1 -- start start 2024-09-17T03:48:35.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.128+0000 7f2b00abd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ae8003a50 0x7f2afc0b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.128+0000 7f2b00abd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc154950 0x7f2afc0b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.128+0000 7f2b00abd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc0b3bb0 0x7f2afc0c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.128+0000 7f2b00abd640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc0cf2e0 con 0x7f2afc0b3bb0 2024-09-17T03:48:35.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.128+0000 7f2b00abd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc0b79d0 con 0x7f2ae8003a50 2024-09-17T03:48:35.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.128+0000 7f2b00abd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2afc0cf460 con 0x7f2afc154950 2024-09-17T03:48:35.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.128+0000 7f2afad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc0b3bb0 0x7f2afc0c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.128+0000 7f2afad9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc0b3bb0 0x7f2afc0c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49120/0 (socket says 172.21.15.146:49120) 2024-09-17T03:48:35.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.128+0000 7f2afad9d640 1 -- 172.21.15.146:0/3870059762 learned_addr learned my addr 172.21.15.146:0/3870059762 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:35.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.128+0000 7f2afa59c640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ae8003a50 0x7f2afc0b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.128+0000 7f2af3fff640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc154950 0x7f2afc0b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.129+0000 7f2afad9d640 1 -- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc154950 msgr2=0x7f2afc0b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.129+0000 7f2afad9d640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc154950 0x7f2afc0b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.129+0000 7f2afad9d640 1 -- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ae8003a50 msgr2=0x7f2afc0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.129+0000 7f2afad9d640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ae8003a50 0x7f2afc0b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.129+0000 7f2afad9d640 1 -- 172.21.15.146:0/3870059762 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc0c6e90 con 0x7f2afc0b3bb0 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.129+0000 7f2afad9d640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc0b3bb0 0x7f2afc0c6180 secure :-1 s=READY pgs=2839 cs=0 l=1 rev1=1 crypto rx=0x7f2afc074330 tx=0x7f2af4006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.129+0000 7f2af2ffd640 1 -- 172.21.15.146:0/3870059762 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af400fc30 con 0x7f2afc0b3bb0 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.129+0000 7f2af2ffd640 1 -- 172.21.15.146:0/3870059762 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2af4018070 con 0x7f2afc0b3bb0 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.129+0000 7f2b00abd640 1 -- 172.21.15.146:0/3870059762 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2afc0b1d70 con 0x7f2afc0b3bb0 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.129+0000 7f2af2ffd640 1 -- 172.21.15.146:0/3870059762 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4011430 con 0x7f2afc0b3bb0 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.129+0000 7f2b00abd640 1 -- 172.21.15.146:0/3870059762 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2afc0b2330 con 0x7f2afc0b3bb0 2024-09-17T03:48:35.130 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.130+0000 7f2b00abd640 1 -- 172.21.15.146:0/3870059762 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2afc06b1b0 con 0x7f2afc0b3bb0 2024-09-17T03:48:35.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.131+0000 7f2af2ffd640 1 -- 172.21.15.146:0/3870059762 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2af40115d0 con 0x7f2afc0b3bb0 2024-09-17T03:48:35.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.131+0000 7f2af2ffd640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2adc078b80 0x7f2adc07b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.131+0000 7f2af2ffd640 1 -- 172.21.15.146:0/3870059762 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f2af409b230 con 0x7f2afc0b3bb0 2024-09-17T03:48:35.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.131+0000 7f2afa59c640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2adc078b80 0x7f2adc07b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.131 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.132+0000 7f2afa59c640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2adc078b80 0x7f2adc07b090 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f2aec035000 tx=0x7f2aec02d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:35.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.136+0000 7f2af2ffd640 1 -- 172.21.15.146:0/3870059762 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2afc06b1b0 con 0x7f2afc0b3bb0 2024-09-17T03:48:35.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.309+0000 7f2b00abd640 1 -- 172.21.15.146:0/3870059762 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2afc0d08a0 con 0x7f2adc078b80 2024-09-17T03:48:35.308 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.309+0000 7f2af2ffd640 1 -- 172.21.15.146:0/3870059762 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2afc0d08a0 con 0x7f2adc078b80 2024-09-17T03:48:35.308 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T03:48:35.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 -- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2adc078b80 msgr2=0x7f2adc07b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2adc078b80 0x7f2adc07b090 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f2aec035000 tx=0x7f2aec02d040 comp rx=0 tx=0).stop 2024-09-17T03:48:35.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 -- 172.21.15.146:0/3870059762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc0b3bb0 msgr2=0x7f2afc0c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.311 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc0b3bb0 0x7f2afc0c6180 secure :-1 s=READY pgs=2839 cs=0 l=1 rev1=1 crypto rx=0x7f2afc074330 tx=0x7f2af4006720 comp rx=0 tx=0).stop 2024-09-17T03:48:35.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 -- 172.21.15.146:0/3870059762 shutdown_connections 2024-09-17T03:48:35.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2adc078b80 0x7f2adc07b090 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2afc0b3bb0 0x7f2afc0c6180 unknown :-1 s=CLOSED pgs=2839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2afc154950 0x7f2afc0b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 --2- 172.21.15.146:0/3870059762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2ae8003a50 0x7f2afc0b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 -- 172.21.15.146:0/3870059762 >> 172.21.15.146:0/3870059762 conn(0x7f2afc0d2650 msgr2=0x7f2afc075e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:35.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 -- 172.21.15.146:0/3870059762 shutdown_connections 2024-09-17T03:48:35.312 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.312+0000 7f2b00abd640 1 -- 172.21.15.146:0/3870059762 wait complete. 2024-09-17T03:48:35.322 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T03:48:35.322 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:48:35.440 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.441+0000 7f9d64030640 1 -- 172.21.15.146:0/2168196390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d5c074320 msgr2=0x7f9d5c0d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.441+0000 7f9d64030640 1 --2- 172.21.15.146:0/2168196390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d5c074320 0x7f9d5c0d0590 secure :-1 s=READY pgs=2841 cs=0 l=1 rev1=1 crypto rx=0x7f9d54005fd0 tx=0x7f9d5402aa90 comp rx=0 tx=0).stop 2024-09-17T03:48:35.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.441+0000 7f9d64030640 1 -- 172.21.15.146:0/2168196390 shutdown_connections 2024-09-17T03:48:35.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.441+0000 7f9d64030640 1 --2- 172.21.15.146:0/2168196390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d5c074320 0x7f9d5c0d0590 unknown :-1 s=CLOSED pgs=2841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.441+0000 7f9d64030640 1 -- 172.21.15.146:0/2168196390 >> 172.21.15.146:0/2168196390 conn(0x7f9d5c06e2b0 msgr2=0x7f9d5c06e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:35.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.441+0000 7f9d64030640 1 -- 172.21.15.146:0/2168196390 shutdown_connections 2024-09-17T03:48:35.441 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.441+0000 7f9d64030640 1 -- 172.21.15.146:0/2168196390 wait complete. 2024-09-17T03:48:35.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.443+0000 7f9d64030640 1 Processor -- start 2024-09-17T03:48:35.442 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.443+0000 7f9d64030640 1 -- start start 2024-09-17T03:48:35.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.444+0000 7f9d64030640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d5c074320 0x7f9d5c1e6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.444+0000 7f9d64030640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d5c145160 0x7f9d5c1f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.444+0000 7f9d64030640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d5c15f490 0x7f9d5c1f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.444+0000 7f9d64030640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c0d0c50 con 0x7f9d5c074320 2024-09-17T03:48:35.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.444+0000 7f9d64030640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c0d0ad0 con 0x7f9d5c145160 2024-09-17T03:48:35.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.444+0000 7f9d64030640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5c0d0dd0 con 0x7f9d5c15f490 2024-09-17T03:48:35.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.444+0000 7f9d61dcc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d5c074320 0x7f9d5c1e6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.445 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.444+0000 7f9d61dcc640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d5c074320 0x7f9d5c1e6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49126/0 (socket says 172.21.15.146:49126) 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.444+0000 7f9d61dcc640 1 -- 172.21.15.146:0/2870857664 learned_addr learned my addr 172.21.15.146:0/2870857664 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d625cd640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d5c15f490 0x7f9d5c1f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d615cb640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d5c145160 0x7f9d5c1f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d61dcc640 1 -- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d5c15f490 msgr2=0x7f9d5c1f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d61dcc640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9d5c15f490 0x7f9d5c1f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d61dcc640 1 -- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d5c145160 msgr2=0x7f9d5c1f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d61dcc640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d5c145160 0x7f9d5c1f6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d61dcc640 1 -- 172.21.15.146:0/2870857664 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5c140580 con 0x7f9d5c074320 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d61dcc640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d5c074320 0x7f9d5c1e6a60 secure :-1 s=READY pgs=2842 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800c3a0 tx=0x7f9d5800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d527fc640 1 -- 172.21.15.146:0/2870857664 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58017070 con 0x7f9d5c074320 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d527fc640 1 -- 172.21.15.146:0/2870857664 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d580053c0 con 0x7f9d5c074320 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d527fc640 1 -- 172.21.15.146:0/2870857664 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58003850 con 0x7f9d5c074320 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d64030640 1 -- 172.21.15.146:0/2870857664 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5c1e7560 con 0x7f9d5c074320 2024-09-17T03:48:35.446 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.445+0000 7f9d64030640 1 -- 172.21.15.146:0/2870857664 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5c1e7b20 con 0x7f9d5c074320 2024-09-17T03:48:35.447 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.446+0000 7f9d64030640 1 -- 172.21.15.146:0/2870857664 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d5c0d0590 con 0x7f9d5c074320 2024-09-17T03:48:35.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.447+0000 7f9d527fc640 1 -- 172.21.15.146:0/2870857664 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d5801a070 con 0x7f9d5c074320 2024-09-17T03:48:35.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.447+0000 7f9d527fc640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d40078b90 0x7f9d4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.447+0000 7f9d527fc640 1 -- 172.21.15.146:0/2870857664 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f9d58099e40 con 0x7f9d5c074320 2024-09-17T03:48:35.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.447+0000 7f9d527fc640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x7f9d4007eb40 0x7f9d40080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.447+0000 7f9d527fc640 1 -- 172.21.15.146:0/2870857664 --> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d58016ec0 con 0x7f9d4007eb40 2024-09-17T03:48:35.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.447+0000 7f9d527fc640 1 -- 172.21.15.146:0/2870857664 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) ==== 24+0+0 (secure 0 0 0) 0x7f9d5809c540 con 0x7f9d5c074320 2024-09-17T03:48:35.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.448+0000 7f9d615cb640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d40078b90 0x7f9d4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.448+0000 7f9d625cd640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x7f9d4007eb40 0x7f9d40080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.448+0000 7f9d615cb640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d40078b90 0x7f9d4007b0a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c006fd0 tx=0x7f9d4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:35.448 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.448+0000 7f9d625cd640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x7f9d4007eb40 0x7f9d40080f90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:35.449 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.449+0000 7f9d527fc640 1 -- 172.21.15.146:0/2870857664 <== osd.4 v2:172.21.15.179:6818/3302933995 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d58016ec0 con 0x7f9d4007eb40 2024-09-17T03:48:35.460 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.461+0000 7f9d64030640 1 -- 172.21.15.146:0/2870857664 --> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9d5c0b4990 con 0x7f9d4007eb40 2024-09-17T03:48:35.461 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.462+0000 7f9d527fc640 1 -- 172.21.15.146:0/2870857664 <== osd.4 v2:172.21.15.179:6818/3302933995 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9d5c0b4990 con 0x7f9d4007eb40 2024-09-17T03:48:35.461 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:48:35.461 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:48:35.461 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:48:35.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.462+0000 7f9d64030640 1 -- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x7f9d4007eb40 msgr2=0x7f9d40080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.462+0000 7f9d64030640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:6818/3302933995,v1:172.21.15.179:6819/3302933995] conn(0x7f9d4007eb40 0x7f9d40080f90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.463+0000 7f9d64030640 1 -- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d40078b90 msgr2=0x7f9d4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.462 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.463+0000 7f9d64030640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9d40078b90 0x7f9d4007b0a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c006fd0 tx=0x7f9d4c008040 comp rx=0 tx=0).stop 2024-09-17T03:48:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.463+0000 7f9d64030640 1 -- 172.21.15.146:0/2870857664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d5c074320 msgr2=0x7f9d5c1e6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.463+0000 7f9d64030640 1 --2- 172.21.15.146:0/2870857664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d5c074320 0x7f9d5c1e6a60 secure :-1 s=READY pgs=2842 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800c3a0 tx=0x7f9d5800c860 comp rx=0 tx=0).stop 2024-09-17T03:48:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.463+0000 7f9d625cd640 1 -- 172.21.15.146:0/2870857664 reap_dead start 2024-09-17T03:48:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.463+0000 7f9d64030640 1 -- 172.21.15.146:0/2870857664 shutdown_connections 2024-09-17T03:48:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.463+0000 7f9d64030640 1 -- 172.21.15.146:0/2870857664 >> 172.21.15.146:0/2870857664 conn(0x7f9d5c06e2b0 msgr2=0x7f9d5c0b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.463+0000 7f9d64030640 1 -- 172.21.15.146:0/2870857664 shutdown_connections 2024-09-17T03:48:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.463+0000 7f9d64030640 1 -- 172.21.15.146:0/2870857664 wait complete. 2024-09-17T03:48:35.472 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T03:48:35.589 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.590+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/2166681613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c80b1580 msgr2=0x7fc9c80b7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.590+0000 7fc9cd7eb640 1 --2- 172.21.15.146:0/2166681613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c80b1580 0x7fc9c80b7d00 secure :-1 s=READY pgs=2843 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8005fd0 tx=0x7fc9b802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.590+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/2166681613 shutdown_connections 2024-09-17T03:48:35.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.590+0000 7fc9cd7eb640 1 --2- 172.21.15.146:0/2166681613 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c80cefd0 0x7fc9c80cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.590+0000 7fc9cd7eb640 1 --2- 172.21.15.146:0/2166681613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c80b1580 0x7fc9c80b7d00 unknown :-1 s=CLOSED pgs=2843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.590+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/2166681613 >> 172.21.15.146:0/2166681613 conn(0x7fc9c80d26a0 msgr2=0x7fc9c80d2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:35.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.590+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/2166681613 shutdown_connections 2024-09-17T03:48:35.590 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.590+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/2166681613 wait complete. 2024-09-17T03:48:35.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.592+0000 7fc9cd7eb640 1 Processor -- start 2024-09-17T03:48:35.591 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.592+0000 7fc9cd7eb640 1 -- start start 2024-09-17T03:48:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9cd7eb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c80afc50 0x7fc9c80b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9cd7eb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c80b1580 0x7fc9c8154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9cd7eb640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c80cefd0 0x7fc9c81e9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9cd7eb640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c80b0770 con 0x7fc9c80cefd0 2024-09-17T03:48:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9cd7eb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c80ce4c0 con 0x7fc9c80b1580 2024-09-17T03:48:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9cd7eb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c80b08f0 con 0x7fc9c80afc50 2024-09-17T03:48:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9c77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c80cefd0 0x7fc9c81e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.594 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9c77fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c80cefd0 0x7fc9c81e9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49146/0 (socket says 172.21.15.146:49146) 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9c6ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c80afc50 0x7fc9c80b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9be7fc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c80b1580 0x7fc9c8154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9c77fe640 1 -- 172.21.15.146:0/242986346 learned_addr learned my addr 172.21.15.146:0/242986346 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9c77fe640 1 -- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c80afc50 msgr2=0x7fc9c80b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9c77fe640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c80afc50 0x7fc9c80b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9c77fe640 1 -- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c80b1580 msgr2=0x7fc9c8154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9c77fe640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c80b1580 0x7fc9c8154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9c77fe640 1 -- 172.21.15.146:0/242986346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c80b6e70 con 0x7fc9c80cefd0 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9c77fe640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c80cefd0 0x7fc9c81e9990 secure :-1 s=READY pgs=2844 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000c6e0 tx=0x7fc9c000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9bffff640 1 -- 172.21.15.146:0/242986346 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0003b70 con 0x7fc9c80cefd0 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9bffff640 1 -- 172.21.15.146:0/242986346 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9c0003d10 con 0x7fc9c80cefd0 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/242986346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c80b7380 con 0x7fc9c80cefd0 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.594+0000 7fc9bffff640 1 -- 172.21.15.146:0/242986346 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0005330 con 0x7fc9c80cefd0 2024-09-17T03:48:35.595 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.595+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/242986346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c806f420 con 0x7fc9c80cefd0 2024-09-17T03:48:35.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.595+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/242986346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c80b0da0 con 0x7fc9c80cefd0 2024-09-17T03:48:35.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.596+0000 7fc9bffff640 1 -- 172.21.15.146:0/242986346 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9c00054d0 con 0x7fc9c80cefd0 2024-09-17T03:48:35.596 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.597+0000 7fc9bffff640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9a8078bc0 0x7fc9a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.597+0000 7fc9bffff640 1 -- 172.21.15.146:0/242986346 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7fc9c009a6c0 con 0x7fc9c80cefd0 2024-09-17T03:48:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.597+0000 7fc9c6ffd640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9a8078bc0 0x7fc9a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.597 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.597+0000 7fc9c6ffd640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9a8078bc0 0x7fc9a807b0d0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8033000 tx=0x7fc9b8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:35.600 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.601+0000 7fc9bffff640 1 -- 172.21.15.146:0/242986346 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc9c80cf920 con 0x7fc9c80cefd0 2024-09-17T03:48:35.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.777+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/242986346 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fc9c80b7110 con 0x7fc9a8078bc0 2024-09-17T03:48:35.776 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.777+0000 7fc9bffff640 1 -- 172.21.15.146:0/242986346 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc9c80b7110 con 0x7fc9a8078bc0 2024-09-17T03:48:35.777 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T03:48:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9a8078bc0 msgr2=0x7fc9a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9a8078bc0 0x7fc9a807b0d0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8033000 tx=0x7fc9b8004730 comp rx=0 tx=0).stop 2024-09-17T03:48:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/242986346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c80cefd0 msgr2=0x7fc9c81e9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c80cefd0 0x7fc9c81e9990 secure :-1 s=READY pgs=2844 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000c6e0 tx=0x7fc9c000cba0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/242986346 shutdown_connections 2024-09-17T03:48:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fc9a8078bc0 0x7fc9a807b0d0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c80cefd0 0x7fc9c81e9990 unknown :-1 s=CLOSED pgs=2844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9c80b1580 0x7fc9c8154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.780 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 --2- 172.21.15.146:0/242986346 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9c80afc50 0x7fc9c80b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/242986346 >> 172.21.15.146:0/242986346 conn(0x7fc9c80d26a0 msgr2=0x7fc9c8070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:35.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/242986346 shutdown_connections 2024-09-17T03:48:35.781 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.780+0000 7fc9cd7eb640 1 -- 172.21.15.146:0/242986346 wait complete. 2024-09-17T03:48:35.791 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T03:48:35.791 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:48:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.908+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1814234561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b900b5690 msgr2=0x7f6b900b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.908+0000 7f6b96d7b640 1 --2- 172.21.15.146:0/1814234561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b900b5690 0x7f6b900b5aa0 secure :-1 s=READY pgs=2845 cs=0 l=1 rev1=1 crypto rx=0x7f6b90076a30 tx=0x7f6b8802aa30 comp rx=0 tx=0).stop 2024-09-17T03:48:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.908+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1814234561 shutdown_connections 2024-09-17T03:48:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.908+0000 7f6b96d7b640 1 --2- 172.21.15.146:0/1814234561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b900b5690 0x7f6b900b5aa0 unknown :-1 s=CLOSED pgs=2845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.908+0000 7f6b96d7b640 1 --2- 172.21.15.146:0/1814234561 >> v2:172.21.15.179:3300/0 conn(0x7f6b900b4cb0 0x7f6b900b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.908+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1814234561 >> 172.21.15.146:0/1814234561 conn(0x7f6b9009ba40 msgr2=0x7f6b900b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.908+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1814234561 shutdown_connections 2024-09-17T03:48:35.908 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.908+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1814234561 wait complete. 2024-09-17T03:48:35.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.910+0000 7f6b96d7b640 1 Processor -- start 2024-09-17T03:48:35.909 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.910+0000 7f6b96d7b640 1 -- start start 2024-09-17T03:48:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b96d7b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b900b4cb0 0x7f6b900b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b96d7b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900b5690 0x7f6b9006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b96d7b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b900d09e0 0x7f6b901f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b96d7b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6b900b5fe0 con 0x7f6b900b4cb0 2024-09-17T03:48:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b96d7b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6b900b7c20 con 0x7f6b900b5690 2024-09-17T03:48:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b96d7b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6b900b6160 con 0x7f6b900d09e0 2024-09-17T03:48:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b94b17640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b900b4cb0 0x7f6b900b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.912 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b94b17640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b900b4cb0 0x7f6b900b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49174/0 (socket says 172.21.15.146:49174) 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b94b17640 1 -- 172.21.15.146:0/1112818029 learned_addr learned my addr 172.21.15.146:0/1112818029 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b87fff640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900b5690 0x7f6b9006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b95318640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b900d09e0 0x7f6b901f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b94b17640 1 -- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b900d09e0 msgr2=0x7f6b901f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b94b17640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6b900d09e0 0x7f6b901f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b94b17640 1 -- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900b5690 msgr2=0x7f6b9006f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b94b17640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b900b5690 0x7f6b9006f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b94b17640 1 -- 172.21.15.146:0/1112818029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b901f6900 con 0x7f6b900b4cb0 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b94b17640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b900b4cb0 0x7f6b900b1340 secure :-1 s=READY pgs=2846 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00e790 tx=0x7f6b8c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b857fa640 1 -- 172.21.15.146:0/1112818029 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00eea0 con 0x7f6b900b4cb0 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b857fa640 1 -- 172.21.15.146:0/1112818029 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b8c00cdb0 con 0x7f6b900b4cb0 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1112818029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b900b0860 con 0x7f6b900b4cb0 2024-09-17T03:48:35.913 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.912+0000 7f6b857fa640 1 -- 172.21.15.146:0/1112818029 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c010690 con 0x7f6b900b4cb0 2024-09-17T03:48:35.914 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.913+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1112818029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b900b0e20 con 0x7f6b900b4cb0 2024-09-17T03:48:35.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.913+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1112818029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b900b6620 con 0x7f6b900b4cb0 2024-09-17T03:48:35.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.914+0000 7f6b857fa640 1 -- 172.21.15.146:0/1112818029 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b8c010830 con 0x7f6b900b4cb0 2024-09-17T03:48:35.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.915+0000 7f6b857fa640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b7c078b90 0x7f6b7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.915+0000 7f6b857fa640 1 -- 172.21.15.146:0/1112818029 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f6b8c09bfd0 con 0x7f6b900b4cb0 2024-09-17T03:48:35.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.915+0000 7f6b857fa640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] conn(0x7f6b7c07eb40 0x7f6b7c080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:35.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.915+0000 7f6b857fa640 1 -- 172.21.15.146:0/1112818029 --> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b8c011ea0 con 0x7f6b7c07eb40 2024-09-17T03:48:35.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.915+0000 7f6b857fa640 1 -- 172.21.15.146:0/1112818029 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) ==== 24+0+0 (secure 0 0 0) 0x7f6b8c09c460 con 0x7f6b900b4cb0 2024-09-17T03:48:35.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.915+0000 7f6b87fff640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b7c078b90 0x7f6b7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.915 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.915+0000 7f6b95318640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] conn(0x7f6b7c07eb40 0x7f6b7c080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:35.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.916+0000 7f6b87fff640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b7c078b90 0x7f6b7c07b0a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f6b900cb130 tx=0x7f6b80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:35.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.916+0000 7f6b95318640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] conn(0x7f6b7c07eb40 0x7f6b7c080f90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:35.916 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.916+0000 7f6b857fa640 1 -- 172.21.15.146:0/1112818029 <== osd.5 v2:172.21.15.179:6802/3411666156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b8c011ea0 con 0x7f6b7c07eb40 2024-09-17T03:48:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.929+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1112818029 --> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6b900d3410 con 0x7f6b7c07eb40 2024-09-17T03:48:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.929+0000 7f6b857fa640 1 -- 172.21.15.146:0/1112818029 <== osd.5 v2:172.21.15.179:6802/3411666156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6b900d3410 con 0x7f6b7c07eb40 2024-09-17T03:48:35.929 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:48:35.929 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:48:35.929 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:48:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.930+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] conn(0x7f6b7c07eb40 msgr2=0x7f6b7c080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.930+0000 7f6b96d7b640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:6802/3411666156,v1:172.21.15.179:6803/3411666156] conn(0x7f6b7c07eb40 0x7f6b7c080f90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.930+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b7c078b90 msgr2=0x7f6b7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.930+0000 7f6b96d7b640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6b7c078b90 0x7f6b7c07b0a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f6b900cb130 tx=0x7f6b80009040 comp rx=0 tx=0).stop 2024-09-17T03:48:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.930+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1112818029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b900b4cb0 msgr2=0x7f6b900b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.930+0000 7f6b96d7b640 1 --2- 172.21.15.146:0/1112818029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b900b4cb0 0x7f6b900b1340 secure :-1 s=READY pgs=2846 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00e790 tx=0x7f6b8c00ec50 comp rx=0 tx=0).stop 2024-09-17T03:48:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.930+0000 7f6b95318640 1 -- 172.21.15.146:0/1112818029 reap_dead start 2024-09-17T03:48:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.930+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1112818029 shutdown_connections 2024-09-17T03:48:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.930+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1112818029 >> 172.21.15.146:0/1112818029 conn(0x7f6b9009ba40 msgr2=0x7f6b9009c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:35.930 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.930+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1112818029 shutdown_connections 2024-09-17T03:48:35.931 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:35.930+0000 7f6b96d7b640 1 -- 172.21.15.146:0/1112818029 wait complete. 2024-09-17T03:48:35.940 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T03:48:36.055 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.056+0000 7f47475df640 1 -- 172.21.15.146:0/4200187139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4740153c50 msgr2=0x7f474006cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.056+0000 7f47475df640 1 --2- 172.21.15.146:0/4200187139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4740153c50 0x7f474006cd80 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f473c005fd0 tx=0x7f473c02a980 comp rx=0 tx=0).stop 2024-09-17T03:48:36.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.056+0000 7f47475df640 1 -- 172.21.15.146:0/4200187139 shutdown_connections 2024-09-17T03:48:36.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.056+0000 7f47475df640 1 --2- 172.21.15.146:0/4200187139 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47400b5160 0x7f474006d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.056+0000 7f47475df640 1 --2- 172.21.15.146:0/4200187139 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4740153c50 0x7f474006cd80 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.056+0000 7f47475df640 1 -- 172.21.15.146:0/4200187139 >> 172.21.15.146:0/4200187139 conn(0x7f47400b3880 msgr2=0x7f47400d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:36.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.056+0000 7f47475df640 1 -- 172.21.15.146:0/4200187139 shutdown_connections 2024-09-17T03:48:36.056 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.056+0000 7f47475df640 1 -- 172.21.15.146:0/4200187139 wait complete. 2024-09-17T03:48:36.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.058+0000 7f47475df640 1 Processor -- start 2024-09-17T03:48:36.057 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.058+0000 7f47475df640 1 -- start start 2024-09-17T03:48:36.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.059+0000 7f47475df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47400b5160 0x7f4740154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.059+0000 7f47475df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47400cf4e0 0x7f474014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.059+0000 7f47475df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4740153c50 0x7f47401560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.059+0000 7f47475df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f474015d860 con 0x7f47400b5160 2024-09-17T03:48:36.059 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.059+0000 7f47475df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f474015d6e0 con 0x7f4740153c50 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.059+0000 7f47475df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f474015d9e0 con 0x7f47400cf4e0 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.059+0000 7f474537b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47400b5160 0x7f4740154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.059+0000 7f474537b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47400b5160 0x7f4740154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49180/0 (socket says 172.21.15.146:49180) 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.059+0000 7f474537b640 1 -- 172.21.15.146:0/3003657962 learned_addr learned my addr 172.21.15.146:0/3003657962 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f4744b7a640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47400cf4e0 0x7f474014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f4745b7c640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4740153c50 0x7f47401560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f474537b640 1 -- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47400cf4e0 msgr2=0x7f474014d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f474537b640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47400cf4e0 0x7f474014d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f474537b640 1 -- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4740153c50 msgr2=0x7f47401560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f474537b640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4740153c50 0x7f47401560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f474537b640 1 -- 172.21.15.146:0/3003657962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47401549f0 con 0x7f47400b5160 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f4744b7a640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47400cf4e0 0x7f474014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:48:36.060 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f474537b640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47400b5160 0x7f4740154080 secure :-1 s=READY pgs=2847 cs=0 l=1 rev1=1 crypto rx=0x7f473c006010 tx=0x7f473c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f4735ffb640 1 -- 172.21.15.146:0/3003657962 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c034040 con 0x7f47400b5160 2024-09-17T03:48:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f4735ffb640 1 -- 172.21.15.146:0/3003657962 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f473c004e30 con 0x7f47400b5160 2024-09-17T03:48:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f47475df640 1 -- 172.21.15.146:0/3003657962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4740154cd0 con 0x7f47400b5160 2024-09-17T03:48:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f4735ffb640 1 -- 172.21.15.146:0/3003657962 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c0044b0 con 0x7f47400b5160 2024-09-17T03:48:36.061 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.060+0000 7f47475df640 1 -- 172.21.15.146:0/3003657962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4740155290 con 0x7f47400b5160 2024-09-17T03:48:36.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.061+0000 7f47475df640 1 -- 172.21.15.146:0/3003657962 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f474015df00 con 0x7f47400b5160 2024-09-17T03:48:36.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.062+0000 7f4735ffb640 1 -- 172.21.15.146:0/3003657962 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f473c037020 con 0x7f47400b5160 2024-09-17T03:48:36.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.062+0000 7f4735ffb640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4724078bc0 0x7f472407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.063+0000 7f4735ffb640 1 -- 172.21.15.146:0/3003657962 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f473c0bbec0 con 0x7f47400b5160 2024-09-17T03:48:36.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.063+0000 7f4744b7a640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4724078bc0 0x7f472407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.062 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.063+0000 7f4744b7a640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4724078bc0 0x7f472407b0d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4740156d90 tx=0x7f4730005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.066 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.067+0000 7f4735ffb640 1 -- 172.21.15.146:0/3003657962 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f473c0845b0 con 0x7f47400b5160 2024-09-17T03:48:36.240 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.241+0000 7f47475df640 1 -- 172.21.15.146:0/3003657962 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f47401570a0 con 0x7f4724078bc0 2024-09-17T03:48:36.241 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.242+0000 7f4735ffb640 1 -- 172.21.15.146:0/3003657962 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f47401570a0 con 0x7f4724078bc0 2024-09-17T03:48:36.241 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T03:48:36.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 -- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4724078bc0 msgr2=0x7f472407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4724078bc0 0x7f472407b0d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4740156d90 tx=0x7f4730005f90 comp rx=0 tx=0).stop 2024-09-17T03:48:36.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 -- 172.21.15.146:0/3003657962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47400b5160 msgr2=0x7f4740154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47400b5160 0x7f4740154080 secure :-1 s=READY pgs=2847 cs=0 l=1 rev1=1 crypto rx=0x7f473c006010 tx=0x7f473c003f10 comp rx=0 tx=0).stop 2024-09-17T03:48:36.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 -- 172.21.15.146:0/3003657962 shutdown_connections 2024-09-17T03:48:36.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f4724078bc0 0x7f472407b0d0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.243 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4740153c50 0x7f47401560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f47400cf4e0 0x7f474014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 --2- 172.21.15.146:0/3003657962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47400b5160 0x7f4740154080 unknown :-1 s=CLOSED pgs=2847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 -- 172.21.15.146:0/3003657962 >> 172.21.15.146:0/3003657962 conn(0x7f47400b3880 msgr2=0x7f47400b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 -- 172.21.15.146:0/3003657962 shutdown_connections 2024-09-17T03:48:36.244 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.244+0000 7f47475df640 1 -- 172.21.15.146:0/3003657962 wait complete. 2024-09-17T03:48:36.254 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T03:48:36.254 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:48:36.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.373+0000 7f934029b640 1 -- 172.21.15.146:0/2212359036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93240051c0 msgr2=0x7f932400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.373+0000 7f934029b640 1 --2- 172.21.15.146:0/2212359036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93240051c0 0x7f932400b9c0 secure :-1 s=READY pgs=2849 cs=0 l=1 rev1=1 crypto rx=0x7f9330005fd0 tx=0x7f9324005830 comp rx=0 tx=0).stop 2024-09-17T03:48:36.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.373+0000 7f934029b640 1 -- 172.21.15.146:0/2212359036 shutdown_connections 2024-09-17T03:48:36.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.373+0000 7f934029b640 1 --2- 172.21.15.146:0/2212359036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93240051c0 0x7f932400b9c0 unknown :-1 s=CLOSED pgs=2849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.373+0000 7f934029b640 1 -- 172.21.15.146:0/2212359036 >> 172.21.15.146:0/2212359036 conn(0x7f933809dda0 msgr2=0x7f93380d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:36.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.373+0000 7f934029b640 1 -- 172.21.15.146:0/2212359036 shutdown_connections 2024-09-17T03:48:36.373 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.373+0000 7f934029b640 1 -- 172.21.15.146:0/2212359036 wait complete. 2024-09-17T03:48:36.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.375+0000 7f934029b640 1 Processor -- start 2024-09-17T03:48:36.374 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.375+0000 7f934029b640 1 -- start start 2024-09-17T03:48:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f934029b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93240051c0 0x7f93381f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f934029b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93380ce7d0 0x7f9338160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f934029b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93380a1c00 0x7f93380a2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.377 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f934029b640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f93380d1150 con 0x7f93380ce7d0 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f934029b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f93380b9dc0 con 0x7f93380a1c00 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f934029b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f93380d12d0 con 0x7f93240051c0 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933d836640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93380ce7d0 0x7f9338160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933d836640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93380ce7d0 0x7f9338160070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49190/0 (socket says 172.21.15.146:49190) 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933d836640 1 -- 172.21.15.146:0/4168388497 learned_addr learned my addr 172.21.15.146:0/4168388497 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933e838640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93380a1c00 0x7f93380a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933e037640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93240051c0 0x7f93381f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933d836640 1 -- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93240051c0 msgr2=0x7f93381f56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933d836640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93240051c0 0x7f93381f56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933d836640 1 -- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93380a1c00 msgr2=0x7f93380a2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933d836640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f93380a1c00 0x7f93380a2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933d836640 1 -- 172.21.15.146:0/4168388497 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93380a2550 con 0x7f93380ce7d0 2024-09-17T03:48:36.378 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933e037640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f93240051c0 0x7f93381f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:48:36.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f933d836640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93380ce7d0 0x7f9338160070 secure :-1 s=READY pgs=2850 cs=0 l=1 rev1=1 crypto rx=0x7f9328004d60 tx=0x7f9328001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f932effd640 1 -- 172.21.15.146:0/4168388497 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93280107d0 con 0x7f93380ce7d0 2024-09-17T03:48:36.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f932effd640 1 -- 172.21.15.146:0/4168388497 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9328010970 con 0x7f93380ce7d0 2024-09-17T03:48:36.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f934029b640 1 -- 172.21.15.146:0/4168388497 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93381f6050 con 0x7f93380ce7d0 2024-09-17T03:48:36.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f932effd640 1 -- 172.21.15.146:0/4168388497 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328010da0 con 0x7f93380ce7d0 2024-09-17T03:48:36.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.377+0000 7f934029b640 1 -- 172.21.15.146:0/4168388497 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93380c8300 con 0x7f93380ce7d0 2024-09-17T03:48:36.379 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.378+0000 7f934029b640 1 -- 172.21.15.146:0/4168388497 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93380cf520 con 0x7f93380ce7d0 2024-09-17T03:48:36.380 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.379+0000 7f932effd640 1 -- 172.21.15.146:0/4168388497 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f932801c470 con 0x7f93380ce7d0 2024-09-17T03:48:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.380+0000 7f932effd640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f931c078b90 0x7f931c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.380+0000 7f932effd640 1 -- 172.21.15.146:0/4168388497 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f932809bee0 con 0x7f93380ce7d0 2024-09-17T03:48:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.380+0000 7f932effd640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x7f931c07eb40 0x7f931c080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.380+0000 7f932effd640 1 -- 172.21.15.146:0/4168388497 --> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f931c081660 con 0x7f931c07eb40 2024-09-17T03:48:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.380+0000 7f932effd640 1 -- 172.21.15.146:0/4168388497 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) ==== 24+0+0 (secure 0 0 0) 0x7f932809c370 con 0x7f93380ce7d0 2024-09-17T03:48:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.380+0000 7f933e037640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f931c078b90 0x7f931c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.380+0000 7f933e838640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x7f931c07eb40 0x7f931c080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.380+0000 7f933e037640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f931c078b90 0x7f931c07b0a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f93340018a0 tx=0x7f9334001c70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.380+0000 7f933e838640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x7f931c07eb40 0x7f931c080f90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.381 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.381+0000 7f932effd640 1 -- 172.21.15.146:0/4168388497 <== osd.6 v2:172.21.15.179:6810/1755575046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f931c081660 con 0x7f931c07eb40 2024-09-17T03:48:36.392 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.393+0000 7f934029b640 1 -- 172.21.15.146:0/4168388497 --> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f93381f5e00 con 0x7f931c07eb40 2024-09-17T03:48:36.393 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.394+0000 7f932effd640 1 -- 172.21.15.146:0/4168388497 <== osd.6 v2:172.21.15.179:6810/1755575046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f93381f5e00 con 0x7f931c07eb40 2024-09-17T03:48:36.393 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:48:36.393 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:48:36.393 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:48:36.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.394+0000 7f934029b640 1 -- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x7f931c07eb40 msgr2=0x7f931c080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.394+0000 7f934029b640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:6810/1755575046,v1:172.21.15.179:6811/1755575046] conn(0x7f931c07eb40 0x7f931c080f90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.394 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.394+0000 7f934029b640 1 -- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f931c078b90 msgr2=0x7f931c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.394+0000 7f934029b640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f931c078b90 0x7f931c07b0a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f93340018a0 tx=0x7f9334001c70 comp rx=0 tx=0).stop 2024-09-17T03:48:36.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.394+0000 7f934029b640 1 -- 172.21.15.146:0/4168388497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93380ce7d0 msgr2=0x7f9338160070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.394+0000 7f934029b640 1 --2- 172.21.15.146:0/4168388497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93380ce7d0 0x7f9338160070 secure :-1 s=READY pgs=2850 cs=0 l=1 rev1=1 crypto rx=0x7f9328004d60 tx=0x7f9328001710 comp rx=0 tx=0).stop 2024-09-17T03:48:36.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.394+0000 7f933e838640 1 -- 172.21.15.146:0/4168388497 reap_dead start 2024-09-17T03:48:36.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.395+0000 7f934029b640 1 -- 172.21.15.146:0/4168388497 shutdown_connections 2024-09-17T03:48:36.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.395+0000 7f934029b640 1 -- 172.21.15.146:0/4168388497 >> 172.21.15.146:0/4168388497 conn(0x7f933809dda0 msgr2=0x7f9338161e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:36.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.395+0000 7f934029b640 1 -- 172.21.15.146:0/4168388497 shutdown_connections 2024-09-17T03:48:36.395 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.395+0000 7f934029b640 1 -- 172.21.15.146:0/4168388497 wait complete. 2024-09-17T03:48:36.404 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T03:48:36.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.519+0000 7f2b95238640 1 -- 172.21.15.146:0/2976599260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b900cebc0 msgr2=0x7f2b900d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.518 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.519+0000 7f2b95238640 1 --2- 172.21.15.146:0/2976599260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b900cebc0 0x7f2b900d0b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009890 tx=0x7f2b7802a560 comp rx=0 tx=0).stop 2024-09-17T03:48:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.519+0000 7f2b95238640 1 -- 172.21.15.146:0/2976599260 shutdown_connections 2024-09-17T03:48:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.519+0000 7f2b95238640 1 --2- 172.21.15.146:0/2976599260 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b900cebc0 0x7f2b900d0b10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.519+0000 7f2b95238640 1 -- 172.21.15.146:0/2976599260 >> 172.21.15.146:0/2976599260 conn(0x7f2b900d26c0 msgr2=0x7f2b900d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.519+0000 7f2b95238640 1 -- 172.21.15.146:0/2976599260 shutdown_connections 2024-09-17T03:48:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.519+0000 7f2b95238640 1 -- 172.21.15.146:0/2976599260 wait complete. 2024-09-17T03:48:36.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.521+0000 7f2b95238640 1 Processor -- start 2024-09-17T03:48:36.520 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.521+0000 7f2b95238640 1 -- start start 2024-09-17T03:48:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.522+0000 7f2b95238640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b900cebc0 0x7f2b9015b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.522+0000 7f2b95238640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b900d1050 0x7f2b900cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.522+0000 7f2b95238640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b900d31e0 0x7f2b900cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.522+0000 7f2b95238640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f2b900b6760 con 0x7f2b900d31e0 2024-09-17T03:48:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.522+0000 7f2b95238640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2b900b65e0 con 0x7f2b900cebc0 2024-09-17T03:48:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b95238640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2b900b68e0 con 0x7f2b900d1050 2024-09-17T03:48:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b8f59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b900d31e0 0x7f2b900cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b8f59e640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b900d31e0 0x7f2b900cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49196/0 (socket says 172.21.15.146:49196) 2024-09-17T03:48:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b8f59e640 1 -- 172.21.15.146:0/2881373858 learned_addr learned my addr 172.21.15.146:0/2881373858 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:36.523 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b8ed9d640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b900cebc0 0x7f2b9015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b8659c640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b900d1050 0x7f2b900cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b8f59e640 1 -- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b900d1050 msgr2=0x7f2b900cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b8f59e640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b900d1050 0x7f2b900cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b8f59e640 1 -- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b900cebc0 msgr2=0x7f2b9015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b8f59e640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b900cebc0 0x7f2b9015b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b8f59e640 1 -- 172.21.15.146:0/2881373858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9006e200 con 0x7f2b900d31e0 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b8f59e640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b900d31e0 0x7f2b900cbf70 secure :-1 s=READY pgs=2852 cs=0 l=1 rev1=1 crypto rx=0x7f2b88001f00 tx=0x7f2b8800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b87fff640 1 -- 172.21.15.146:0/2881373858 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88016020 con 0x7f2b900d31e0 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b87fff640 1 -- 172.21.15.146:0/2881373858 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b88012510 con 0x7f2b900d31e0 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b95238640 1 -- 172.21.15.146:0/2881373858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9006e4e0 con 0x7f2b900d31e0 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b87fff640 1 -- 172.21.15.146:0/2881373858 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b880129a0 con 0x7f2b900d31e0 2024-09-17T03:48:36.524 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.523+0000 7f2b95238640 1 -- 172.21.15.146:0/2881373858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b9006eaa0 con 0x7f2b900d31e0 2024-09-17T03:48:36.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.524+0000 7f2b95238640 1 -- 172.21.15.146:0/2881373858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b900b7fb0 con 0x7f2b900d31e0 2024-09-17T03:48:36.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.525+0000 7f2b87fff640 1 -- 172.21.15.146:0/2881373858 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b88019020 con 0x7f2b900d31e0 2024-09-17T03:48:36.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.526+0000 7f2b87fff640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b70078b90 0x7f2b7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.525 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.526+0000 7f2b87fff640 1 -- 172.21.15.146:0/2881373858 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f2b8809b360 con 0x7f2b900d31e0 2024-09-17T03:48:36.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.526+0000 7f2b8ed9d640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b70078b90 0x7f2b7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.526 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.526+0000 7f2b8ed9d640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b70078b90 0x7f2b7007b0a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f2b80001170 tx=0x7f2b80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.529 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.530+0000 7f2b87fff640 1 -- 172.21.15.146:0/2881373858 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2b900b7fb0 con 0x7f2b900d31e0 2024-09-17T03:48:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.710+0000 7f2b95238640 1 -- 172.21.15.146:0/2881373858 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f2b900cefd0 con 0x7f2b70078b90 2024-09-17T03:48:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.711+0000 7f2b87fff640 1 -- 172.21.15.146:0/2881373858 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2b900cefd0 con 0x7f2b70078b90 2024-09-17T03:48:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T03:48:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 -- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b70078b90 msgr2=0x7f2b7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b70078b90 0x7f2b7007b0a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f2b80001170 tx=0x7f2b80009040 comp rx=0 tx=0).stop 2024-09-17T03:48:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 -- 172.21.15.146:0/2881373858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b900d31e0 msgr2=0x7f2b900cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b900d31e0 0x7f2b900cbf70 secure :-1 s=READY pgs=2852 cs=0 l=1 rev1=1 crypto rx=0x7f2b88001f00 tx=0x7f2b8800a430 comp rx=0 tx=0).stop 2024-09-17T03:48:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 -- 172.21.15.146:0/2881373858 shutdown_connections 2024-09-17T03:48:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f2b70078b90 0x7f2b7007b0a0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b900d31e0 0x7f2b900cbf70 unknown :-1 s=CLOSED pgs=2852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2b900d1050 0x7f2b900cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 --2- 172.21.15.146:0/2881373858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b900cebc0 0x7f2b9015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 -- 172.21.15.146:0/2881373858 >> 172.21.15.146:0/2881373858 conn(0x7f2b900d26c0 msgr2=0x7f2b900d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:36.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 -- 172.21.15.146:0/2881373858 shutdown_connections 2024-09-17T03:48:36.714 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.714+0000 7f2b95238640 1 -- 172.21.15.146:0/2881373858 wait complete. 2024-09-17T03:48:36.724 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T03:48:36.724 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:48:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.841+0000 7f928e9df640 1 -- 172.21.15.146:0/3410759420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9288074000 msgr2=0x7f9288071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.841+0000 7f928e9df640 1 --2- 172.21.15.146:0/3410759420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9288074000 0x7f9288071210 secure :-1 s=READY pgs=2854 cs=0 l=1 rev1=1 crypto rx=0x7f9278005fd0 tx=0x7f927802a540 comp rx=0 tx=0).stop 2024-09-17T03:48:36.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.841+0000 7f928e9df640 1 -- 172.21.15.146:0/3410759420 shutdown_connections 2024-09-17T03:48:36.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.841+0000 7f928e9df640 1 --2- 172.21.15.146:0/3410759420 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f92880b0e20 0x7f92880d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.841+0000 7f928e9df640 1 --2- 172.21.15.146:0/3410759420 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9288074000 0x7f9288071210 unknown :-1 s=CLOSED pgs=2854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.841+0000 7f928e9df640 1 -- 172.21.15.146:0/3410759420 >> 172.21.15.146:0/3410759420 conn(0x7f928806de90 msgr2=0x7f928806e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:36.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.841+0000 7f928e9df640 1 -- 172.21.15.146:0/3410759420 shutdown_connections 2024-09-17T03:48:36.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.841+0000 7f928e9df640 1 -- 172.21.15.146:0/3410759420 wait complete. 2024-09-17T03:48:36.841 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.843+0000 7f928e9df640 1 Processor -- start 2024-09-17T03:48:36.842 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.843+0000 7f928e9df640 1 -- start start 2024-09-17T03:48:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.844+0000 7f928e9df640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9288074000 0x7f9288146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.844+0000 7f928e9df640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f928815ba00 0x7f9288143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.844+0000 7f928e9df640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92881f6eb0 0x7f928806cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.844+0000 7f928e9df640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f92880d1e00 con 0x7f9288074000 2024-09-17T03:48:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.844+0000 7f928e9df640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f92880d1c80 con 0x7f92881f6eb0 2024-09-17T03:48:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.844+0000 7f928e9df640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f92880d1f80 con 0x7f928815ba00 2024-09-17T03:48:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.844+0000 7f9287fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9288074000 0x7f9288146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.844+0000 7f9287fff640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9288074000 0x7f9288146d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49220/0 (socket says 172.21.15.146:49220) 2024-09-17T03:48:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.844+0000 7f9287fff640 1 -- 172.21.15.146:0/1159348345 learned_addr learned my addr 172.21.15.146:0/1159348345 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.844+0000 7f928cf7c640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92881f6eb0 0x7f928806cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.844+0000 7f92877fe640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f928815ba00 0x7f9288143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f9287fff640 1 -- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f928815ba00 msgr2=0x7f9288143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f9287fff640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f928815ba00 0x7f9288143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f9287fff640 1 -- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92881f6eb0 msgr2=0x7f928806cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f9287fff640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92881f6eb0 0x7f928806cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f9287fff640 1 -- 172.21.15.146:0/1159348345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92881f7690 con 0x7f9288074000 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f928cf7c640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92881f6eb0 0x7f928806cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f9287fff640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9288074000 0x7f9288146d20 secure :-1 s=READY pgs=2855 cs=0 l=1 rev1=1 crypto rx=0x7f9278034040 tx=0x7f9278004c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f9284ff9640 1 -- 172.21.15.146:0/1159348345 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927803e030 con 0x7f9288074000 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f9284ff9640 1 -- 172.21.15.146:0/1159348345 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92780035f0 con 0x7f9288074000 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f928e9df640 1 -- 172.21.15.146:0/1159348345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92881f7970 con 0x7f9288074000 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f9284ff9640 1 -- 172.21.15.146:0/1159348345 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278035040 con 0x7f9288074000 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.845+0000 7f928e9df640 1 -- 172.21.15.146:0/1159348345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92880ce1c0 con 0x7f9288074000 2024-09-17T03:48:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.846+0000 7f928e9df640 1 -- 172.21.15.146:0/1159348345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92880ccd20 con 0x7f9288074000 2024-09-17T03:48:36.847 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.847+0000 7f9284ff9640 1 -- 172.21.15.146:0/1159348345 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9278041030 con 0x7f9288074000 2024-09-17T03:48:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.847+0000 7f9284ff9640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9274078b90 0x7f927407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.847+0000 7f9284ff9640 1 -- 172.21.15.146:0/1159348345 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f92780bb720 con 0x7f9288074000 2024-09-17T03:48:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.847+0000 7f9284ff9640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] conn(0x7f927407eb40 0x7f9274080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.847+0000 7f9284ff9640 1 -- 172.21.15.146:0/1159348345 --> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9274081660 con 0x7f927407eb40 2024-09-17T03:48:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.847+0000 7f9284ff9640 1 -- 172.21.15.146:0/1159348345 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=214) ==== 24+0+0 (secure 0 0 0) 0x7f92780bbbb0 con 0x7f9288074000 2024-09-17T03:48:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.848+0000 7f92877fe640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9274078b90 0x7f927407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.848+0000 7f928cf7c640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] conn(0x7f927407eb40 0x7f9274080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.848+0000 7f92877fe640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9274078b90 0x7f927407b0a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f927c000f60 tx=0x7f927c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.848+0000 7f928cf7c640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] conn(0x7f927407eb40 0x7f9274080f90 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.849 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.849+0000 7f9284ff9640 1 -- 172.21.15.146:0/1159348345 <== osd.7 v2:172.21.15.179:6826/1919891472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9274081660 con 0x7f927407eb40 2024-09-17T03:48:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.861+0000 7f928e9df640 1 -- 172.21.15.146:0/1159348345 --> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f92880ce460 con 0x7f927407eb40 2024-09-17T03:48:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f9284ff9640 1 -- 172.21.15.146:0/1159348345 <== osd.7 v2:172.21.15.179:6826/1919891472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f92880ce460 con 0x7f927407eb40 2024-09-17T03:48:36.861 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2024-09-17T03:48:36.861 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:48:36.861 INFO:teuthology.orchestra.run.smithi146.stdout:} 2024-09-17T03:48:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f928e9df640 1 -- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] conn(0x7f927407eb40 msgr2=0x7f9274080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f928e9df640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:6826/1919891472,v1:172.21.15.179:6827/1919891472] conn(0x7f927407eb40 0x7f9274080f90 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f928e9df640 1 -- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9274078b90 msgr2=0x7f927407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f928e9df640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f9274078b90 0x7f927407b0a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f927c000f60 tx=0x7f927c009040 comp rx=0 tx=0).stop 2024-09-17T03:48:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f928e9df640 1 -- 172.21.15.146:0/1159348345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9288074000 msgr2=0x7f9288146d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f928e9df640 1 --2- 172.21.15.146:0/1159348345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9288074000 0x7f9288146d20 secure :-1 s=READY pgs=2855 cs=0 l=1 rev1=1 crypto rx=0x7f9278034040 tx=0x7f9278004c20 comp rx=0 tx=0).stop 2024-09-17T03:48:36.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f928cf7c640 1 -- 172.21.15.146:0/1159348345 reap_dead start 2024-09-17T03:48:36.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f928e9df640 1 -- 172.21.15.146:0/1159348345 shutdown_connections 2024-09-17T03:48:36.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f928e9df640 1 -- 172.21.15.146:0/1159348345 >> 172.21.15.146:0/1159348345 conn(0x7f928806de90 msgr2=0x7f92880b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:36.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f928e9df640 1 -- 172.21.15.146:0/1159348345 shutdown_connections 2024-09-17T03:48:36.863 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.862+0000 7f928e9df640 1 -- 172.21.15.146:0/1159348345 wait complete. 2024-09-17T03:48:36.872 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T03:48:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.987+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/1488112106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bec0cd660 msgr2=0x7f6bec0cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.987+0000 7f6bf0ba1640 1 --2- 172.21.15.146:0/1488112106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bec0cd660 0x7f6bec0cda70 secure :-1 s=READY pgs=2856 cs=0 l=1 rev1=1 crypto rx=0x7f6be0005fd0 tx=0x7f6be002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.987+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/1488112106 shutdown_connections 2024-09-17T03:48:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.987+0000 7f6bf0ba1640 1 --2- 172.21.15.146:0/1488112106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bec0cd660 0x7f6bec0cda70 unknown :-1 s=CLOSED pgs=2856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.987+0000 7f6bf0ba1640 1 --2- 172.21.15.146:0/1488112106 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec0b1c20 0x7f6bec0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.987+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/1488112106 >> 172.21.15.146:0/1488112106 conn(0x7f6bec0d2650 msgr2=0x7f6bec0d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.987+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/1488112106 shutdown_connections 2024-09-17T03:48:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.987+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/1488112106 wait complete. 2024-09-17T03:48:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.989+0000 7f6bf0ba1640 1 Processor -- start 2024-09-17T03:48:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.989+0000 7f6bf0ba1640 1 -- start start 2024-09-17T03:48:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bf0ba1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0b1c20 0x7f6bec09c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bf0ba1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec0cd660 0x7f6bec156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bf0ba1640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bec0cedc0 0x7f6bec0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bf0ba1640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec0cf8e0 con 0x7f6bec0cedc0 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bf0ba1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec071fd0 con 0x7f6bec0b1c20 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bf0ba1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6bec0cfa60 con 0x7f6bec0cd660 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bead9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bec0cedc0 0x7f6bec0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bead9d640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bec0cedc0 0x7f6bec0c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49236/0 (socket says 172.21.15.146:49236) 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bead9d640 1 -- 172.21.15.146:0/160896817 learned_addr learned my addr 172.21.15.146:0/160896817 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6be9d9b640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec0cd660 0x7f6bec156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bea59c640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0b1c20 0x7f6bec09c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bead9d640 1 -- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec0cd660 msgr2=0x7f6bec156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bead9d640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec0cd660 0x7f6bec156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bead9d640 1 -- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0b1c20 msgr2=0x7f6bec09c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bead9d640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0b1c20 0x7f6bec09c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bead9d640 1 -- 172.21.15.146:0/160896817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec1f7290 con 0x7f6bec0cedc0 2024-09-17T03:48:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bead9d640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bec0cedc0 0x7f6bec0c82f0 secure :-1 s=READY pgs=2857 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c3c0 tx=0x7f6be400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bdaffd640 1 -- 172.21.15.146:0/160896817 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4017070 con 0x7f6bec0cedc0 2024-09-17T03:48:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.991+0000 7f6bdaffd640 1 -- 172.21.15.146:0/160896817 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6be40053c0 con 0x7f6bec0cedc0 2024-09-17T03:48:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.992+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/160896817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bec1f7570 con 0x7f6bec0cedc0 2024-09-17T03:48:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.992+0000 7f6bdaffd640 1 -- 172.21.15.146:0/160896817 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4003850 con 0x7f6bec0cedc0 2024-09-17T03:48:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.992+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/160896817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bec1f7b30 con 0x7f6bec0cedc0 2024-09-17T03:48:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.992+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/160896817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bec0cfec0 con 0x7f6bec0cedc0 2024-09-17T03:48:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.993+0000 7f6bdaffd640 1 -- 172.21.15.146:0/160896817 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6be401a070 con 0x7f6bec0cedc0 2024-09-17T03:48:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.994+0000 7f6bdaffd640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6bcc078b90 0x7f6bcc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.994+0000 7f6bdaffd640 1 -- 172.21.15.146:0/160896817 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f6be4099cd0 con 0x7f6bec0cedc0 2024-09-17T03:48:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.994+0000 7f6bea59c640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6bcc078b90 0x7f6bcc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.994+0000 7f6bea59c640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6bcc078b90 0x7f6bcc07b0a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc005fd0 tx=0x7f6bdc009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:36.997 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:36.998+0000 7f6bdaffd640 1 -- 172.21.15.146:0/160896817 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6be4061d70 con 0x7f6bec0cedc0 2024-09-17T03:48:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.173+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/160896817 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f6bec0008d0 con 0x7f6bcc078b90 2024-09-17T03:48:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.174+0000 7f6bdaffd640 1 -- 172.21.15.146:0/160896817 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6bec0008d0 con 0x7f6bcc078b90 2024-09-17T03:48:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T03:48:37.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6bcc078b90 msgr2=0x7f6bcc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:37.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6bcc078b90 0x7f6bcc07b0a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc005fd0 tx=0x7f6bdc009500 comp rx=0 tx=0).stop 2024-09-17T03:48:37.175 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/160896817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bec0cedc0 msgr2=0x7f6bec0c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bec0cedc0 0x7f6bec0c82f0 secure :-1 s=READY pgs=2857 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c3c0 tx=0x7f6be400c880 comp rx=0 tx=0).stop 2024-09-17T03:48:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/160896817 shutdown_connections 2024-09-17T03:48:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f6bcc078b90 0x7f6bcc07b0a0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bec0cedc0 0x7f6bec0c82f0 unknown :-1 s=CLOSED pgs=2857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6bec0cd660 0x7f6bec156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 --2- 172.21.15.146:0/160896817 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6bec0b1c20 0x7f6bec09c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/160896817 >> 172.21.15.146:0/160896817 conn(0x7f6bec0d2650 msgr2=0x7f6bec0d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/160896817 shutdown_connections 2024-09-17T03:48:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.176+0000 7f6bf0ba1640 1 -- 172.21.15.146:0/160896817 wait complete. 2024-09-17T03:48:37.186 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:48:37.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.300+0000 7f40c0977640 1 -- 172.21.15.146:0/2205582808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40bc1617a0 msgr2=0x7f40bc163bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:37.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.300+0000 7f40c0977640 1 --2- 172.21.15.146:0/2205582808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40bc1617a0 0x7f40bc163bc0 secure :-1 s=READY pgs=2858 cs=0 l=1 rev1=1 crypto rx=0x7f40b0005fd0 tx=0x7f40b002a540 comp rx=0 tx=0).stop 2024-09-17T03:48:37.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.300+0000 7f40c0977640 1 -- 172.21.15.146:0/2205582808 shutdown_connections 2024-09-17T03:48:37.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.300+0000 7f40c0977640 1 --2- 172.21.15.146:0/2205582808 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40bc164100 0x7f40bc166520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.300+0000 7f40c0977640 1 --2- 172.21.15.146:0/2205582808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40bc1617a0 0x7f40bc163bc0 unknown :-1 s=CLOSED pgs=2858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.300+0000 7f40c0977640 1 -- 172.21.15.146:0/2205582808 >> 172.21.15.146:0/2205582808 conn(0x7f40bc0b41b0 msgr2=0x7f40bc0b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:37.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.300+0000 7f40c0977640 1 -- 172.21.15.146:0/2205582808 shutdown_connections 2024-09-17T03:48:37.300 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.300+0000 7f40c0977640 1 -- 172.21.15.146:0/2205582808 wait complete. 2024-09-17T03:48:37.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.302+0000 7f40c0977640 1 Processor -- start 2024-09-17T03:48:37.301 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.302+0000 7f40c0977640 1 -- start start 2024-09-17T03:48:37.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.303+0000 7f40c0977640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40bc1600b0 0x7f40bc161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:37.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.303+0000 7f40c0977640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40bc1617a0 0x7f40bc152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:37.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.303+0000 7f40c0977640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc164100 0x7f40bc1f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:37.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.303+0000 7f40c0977640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc166df0 con 0x7f40bc1600b0 2024-09-17T03:48:37.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.303+0000 7f40c0977640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc166c70 con 0x7f40bc164100 2024-09-17T03:48:37.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.303+0000 7f40c0977640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f40bc166f70 con 0x7f40bc1617a0 2024-09-17T03:48:37.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40ba59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40bc1600b0 0x7f40bc161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:37.304 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40ba59c640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40bc1600b0 0x7f40bc161bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35574/0 (socket says 172.21.15.146:35574) 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40ba59c640 1 -- 172.21.15.146:0/3673513205 learned_addr learned my addr 172.21.15.146:0/3673513205 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40bad9d640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc164100 0x7f40bc1f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40b9d9b640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40bc1617a0 0x7f40bc152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40ba59c640 1 -- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40bc1617a0 msgr2=0x7f40bc152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40ba59c640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40bc1617a0 0x7f40bc152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40ba59c640 1 -- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc164100 msgr2=0x7f40bc1f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40ba59c640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc164100 0x7f40bc1f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40ba59c640 1 -- 172.21.15.146:0/3673513205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc1f4430 con 0x7f40bc1600b0 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40bad9d640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc164100 0x7f40bc1f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40ba59c640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40bc1600b0 0x7f40bc161bb0 secure :-1 s=READY pgs=2859 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c760 tx=0x7f40ac00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40aaffd640 1 -- 172.21.15.146:0/3673513205 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac016020 con 0x7f40bc1600b0 2024-09-17T03:48:37.305 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40aaffd640 1 -- 172.21.15.146:0/3673513205 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40ac0039e0 con 0x7f40bc1600b0 2024-09-17T03:48:37.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40c0977640 1 -- 172.21.15.146:0/3673513205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc1f4710 con 0x7f40bc1600b0 2024-09-17T03:48:37.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40aaffd640 1 -- 172.21.15.146:0/3673513205 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac003e30 con 0x7f40bc1600b0 2024-09-17T03:48:37.306 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.304+0000 7f40c0977640 1 -- 172.21.15.146:0/3673513205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40bc152e60 con 0x7f40bc1600b0 2024-09-17T03:48:37.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.305+0000 7f40c0977640 1 -- 172.21.15.146:0/3673513205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40bc0b65c0 con 0x7f40bc1600b0 2024-09-17T03:48:37.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.306+0000 7f40aaffd640 1 -- 172.21.15.146:0/3673513205 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40ac00a850 con 0x7f40bc1600b0 2024-09-17T03:48:37.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.307+0000 7f40aaffd640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f409c078b90 0x7f409c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:37.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.307+0000 7f40aaffd640 1 -- 172.21.15.146:0/3673513205 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f40ac09a6d0 con 0x7f40bc1600b0 2024-09-17T03:48:37.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.307+0000 7f40b9d9b640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f409c078b90 0x7f409c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:37.307 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.308+0000 7f40b9d9b640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f409c078b90 0x7f409c07b0a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f40b0033000 tx=0x7f40b0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:37.310 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.311+0000 7f40aaffd640 1 -- 172.21.15.146:0/3673513205 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f40ac020020 con 0x7f40bc1600b0 2024-09-17T03:48:37.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.486+0000 7f40c0977640 1 -- 172.21.15.146:0/3673513205 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40bc0b6900 con 0x7f409c078b90 2024-09-17T03:48:37.486 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.487+0000 7f40aaffd640 1 -- 172.21.15.146:0/3673513205 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13394 (secure 0 0 0) 0x7f40bc0b6900 con 0x7f409c078b90 2024-09-17T03:48:37.486 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:37.487 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:48:37.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.489+0000 7f40c0977640 1 -- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f409c078b90 msgr2=0x7f409c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:37.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.489+0000 7f40c0977640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f409c078b90 0x7f409c07b0a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f40b0033000 tx=0x7f40b0004730 comp rx=0 tx=0).stop 2024-09-17T03:48:37.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.489+0000 7f40c0977640 1 -- 172.21.15.146:0/3673513205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40bc1600b0 msgr2=0x7f40bc161bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:37.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.489+0000 7f40c0977640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40bc1600b0 0x7f40bc161bb0 secure :-1 s=READY pgs=2859 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c760 tx=0x7f40ac00cc20 comp rx=0 tx=0).stop 2024-09-17T03:48:37.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.490+0000 7f40c0977640 1 -- 172.21.15.146:0/3673513205 shutdown_connections 2024-09-17T03:48:37.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.490+0000 7f40c0977640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f409c078b90 0x7f409c07b0a0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.490+0000 7f40c0977640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f40bc164100 0x7f40bc1f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.489 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.490+0000 7f40c0977640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f40bc1617a0 0x7f40bc152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.490+0000 7f40c0977640 1 --2- 172.21.15.146:0/3673513205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40bc1600b0 0x7f40bc161bb0 unknown :-1 s=CLOSED pgs=2859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:37.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.490+0000 7f40c0977640 1 -- 172.21.15.146:0/3673513205 >> 172.21.15.146:0/3673513205 conn(0x7f40bc0b41b0 msgr2=0x7f40bc0d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:37.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.490+0000 7f40c0977640 1 -- 172.21.15.146:0/3673513205 shutdown_connections 2024-09-17T03:48:37.490 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:37.490+0000 7f40c0977640 1 -- 172.21.15.146:0/3673513205 wait complete. 2024-09-17T03:48:37.500 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":682,"stamp":"2024-09-17T03:48:36.043083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":484156,"kb_used_data":22344,"kb_used_omap":12,"kb_used_meta":461619,"kb_avail":754490564,"statfs":{"total":773094113280,"available":772598337536,"internally_reserved":0,"allocated":22880256,"data_stored":10721240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":472698417},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12623452,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-105,"num_write":-95,"num_write_kb":-12359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001705"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":467,"reported_epoch":214,"state":"active+clean","last_fresh":"2024-09-17T03:48:30.397392+0000","last_change":"2024-09-17T03:32:49.920253+0000","last_active":"2024-09-17T03:48:30.397392+0000","last_peered":"2024-09-17T03:48:30.397392+0000","last_clean":"2024-09-17T03:48:30.397392+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:48:30.397392+0000","last_undegraded":"2024-09-17T03:48:30.397392+0000","last_fullsized":"2024-09-17T03:48:30.397392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:32:48.570152+0000","last_clean_scrub_stamp":"2024-09-17T03:32:48.570152+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:05.230820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509633,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60788,"kb_used_data":3228,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311052,"statfs":{"total":96636764160,"available":96574517248,"internally_reserved":0,"allocated":3305472,"data_stored":1782931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509633,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64368,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307472,"statfs":{"total":96636764160,"available":96570851328,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509633,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69868,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301972,"statfs":{"total":96636764160,"available":96565219328,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509633,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56048,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315792,"statfs":{"total":96636764160,"available":96579371008,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60204,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311636,"statfs":{"total":96636764160,"available":96575115264,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509634,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56628,"kb_used_data":3228,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315212,"statfs":{"total":96636764160,"available":96578777088,"internally_reserved":0,"allocated":3305472,"data_stored":1782931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575040,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56044,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315796,"statfs":{"total":96636764160,"available":96579375104,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575040,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60208,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311632,"statfs":{"total":96636764160,"available":96575111168,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:48:37.503 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T03:32:48.570152+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=3, tm_min=32, tm_sec=48, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=3, tm_min=48, tm_sec=32, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T03:48:37.503 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T03:48:57.504 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:48:57.632 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.632+0000 7f2591913640 1 -- 172.21.15.146:0/3792117276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f258c0cf130 msgr2=0x7f258c0d3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:57.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.632+0000 7f2591913640 1 --2- 172.21.15.146:0/3792117276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f258c0cf130 0x7f258c0d3930 secure :-1 s=READY pgs=2861 cs=0 l=1 rev1=1 crypto rx=0x7f2584005fd0 tx=0x7f258402aa90 comp rx=0 tx=0).stop 2024-09-17T03:48:57.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.632+0000 7f2591913640 1 -- 172.21.15.146:0/3792117276 shutdown_connections 2024-09-17T03:48:57.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.632+0000 7f2591913640 1 --2- 172.21.15.146:0/3792117276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f258c0cf130 0x7f258c0d3930 unknown :-1 s=CLOSED pgs=2861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.632+0000 7f2591913640 1 --2- 172.21.15.146:0/3792117276 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258c0d19f0 0x7f258c0d33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.632+0000 7f2591913640 1 -- 172.21.15.146:0/3792117276 >> 172.21.15.146:0/3792117276 conn(0x7f258c06ecd0 msgr2=0x7f258c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:57.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.632+0000 7f2591913640 1 -- 172.21.15.146:0/3792117276 shutdown_connections 2024-09-17T03:48:57.633 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.632+0000 7f2591913640 1 -- 172.21.15.146:0/3792117276 wait complete. 2024-09-17T03:48:57.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.634+0000 7f2591913640 1 Processor -- start 2024-09-17T03:48:57.634 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.634+0000 7f2591913640 1 -- start start 2024-09-17T03:48:57.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.635+0000 7f2591913640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f258c0cf130 0x7f258c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:57.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.635+0000 7f2591913640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258c0d27e0 0x7f258c0cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:57.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.635+0000 7f2591913640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f258c0b6670 0x7f258c0ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:57.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.635+0000 7f2591913640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0d3ff0 con 0x7f258c0cf130 2024-09-17T03:48:57.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.635+0000 7f2591913640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0d3e70 con 0x7f258c0b6670 2024-09-17T03:48:57.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.635+0000 7f2591913640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f258c0d4170 con 0x7f258c0d27e0 2024-09-17T03:48:57.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.635+0000 7f258affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f258c0cf130 0x7f258c15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:57.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.635+0000 7f258affd640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f258c0cf130 0x7f258c15d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50216/0 (socket says 172.21.15.146:50216) 2024-09-17T03:48:57.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.635+0000 7f258affd640 1 -- 172.21.15.146:0/4008312121 learned_addr learned my addr 172.21.15.146:0/4008312121 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:57.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.635+0000 7f258b7fe640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f258c0b6670 0x7f258c0ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:57.637 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.635+0000 7f25827fc640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258c0d27e0 0x7f258c0cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f258affd640 1 -- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258c0d27e0 msgr2=0x7f258c0cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f258affd640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258c0d27e0 0x7f258c0cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f258affd640 1 -- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f258c0b6670 msgr2=0x7f258c0ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f258affd640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f258c0b6670 0x7f258c0ab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f258affd640 1 -- 172.21.15.146:0/4008312121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c15de40 con 0x7f258c0cf130 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f258b7fe640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f258c0b6670 0x7f258c0ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f258affd640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f258c0cf130 0x7f258c15d900 secure :-1 s=READY pgs=2862 cs=0 l=1 rev1=1 crypto rx=0x7f257c00c3c0 tx=0x7f257c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f2588ff9640 1 -- 172.21.15.146:0/4008312121 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c017070 con 0x7f258c0cf130 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f2588ff9640 1 -- 172.21.15.146:0/4008312121 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f257c0053c0 con 0x7f258c0cf130 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f2591913640 1 -- 172.21.15.146:0/4008312121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258c0b55d0 con 0x7f258c0cf130 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f2588ff9640 1 -- 172.21.15.146:0/4008312121 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c003850 con 0x7f258c0cf130 2024-09-17T03:48:57.638 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.636+0000 7f2591913640 1 -- 172.21.15.146:0/4008312121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258c0b5b90 con 0x7f258c0cf130 2024-09-17T03:48:57.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.637+0000 7f2591913640 1 -- 172.21.15.146:0/4008312121 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258c0d33f0 con 0x7f258c0cf130 2024-09-17T03:48:57.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.638+0000 7f2588ff9640 1 -- 172.21.15.146:0/4008312121 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f257c01a070 con 0x7f258c0cf130 2024-09-17T03:48:57.639 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.638+0000 7f2588ff9640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f256c078b90 0x7f256c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:57.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.639+0000 7f2588ff9640 1 -- 172.21.15.146:0/4008312121 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f257c099ea0 con 0x7f258c0cf130 2024-09-17T03:48:57.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.639+0000 7f25827fc640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f256c078b90 0x7f256c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:57.640 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.639+0000 7f25827fc640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f256c078b90 0x7f256c07b0a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f2574005fd0 tx=0x7f2574005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:57.643 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.643+0000 7f2588ff9640 1 -- 172.21.15.146:0/4008312121 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f257c062580 con 0x7f258c0cf130 2024-09-17T03:48:57.815 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.815+0000 7f2591913640 1 -- 172.21.15.146:0/4008312121 --> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f258c0cf710 con 0x7f256c078b90 2024-09-17T03:48:57.816 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.816+0000 7f2588ff9640 1 -- 172.21.15.146:0/4008312121 <== mgr.4100 v2:172.21.15.179:6800/3262901240 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13371 (secure 0 0 0) 0x7f258c0cf710 con 0x7f256c078b90 2024-09-17T03:48:57.816 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:57.816 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 -- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f256c078b90 msgr2=0x7f256c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f256c078b90 0x7f256c07b0a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f2574005fd0 tx=0x7f2574005850 comp rx=0 tx=0).stop 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 -- 172.21.15.146:0/4008312121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f258c0cf130 msgr2=0x7f258c15d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f258c0cf130 0x7f258c15d900 secure :-1 s=READY pgs=2862 cs=0 l=1 rev1=1 crypto rx=0x7f257c00c3c0 tx=0x7f257c00c880 comp rx=0 tx=0).stop 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 -- 172.21.15.146:0/4008312121 shutdown_connections 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f256c078b90 0x7f256c07b0a0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f258c0b6670 0x7f258c0ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f258c0d27e0 0x7f258c0cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 --2- 172.21.15.146:0/4008312121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f258c0cf130 0x7f258c15d900 unknown :-1 s=CLOSED pgs=2862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 -- 172.21.15.146:0/4008312121 >> 172.21.15.146:0/4008312121 conn(0x7f258c06ecd0 msgr2=0x7f258c075d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 -- 172.21.15.146:0/4008312121 shutdown_connections 2024-09-17T03:48:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.818+0000 7f2591913640 1 -- 172.21.15.146:0/4008312121 wait complete. 2024-09-17T03:48:57.830 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":692,"stamp":"2024-09-17T03:48:56.047998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":484140,"kb_used_data":22344,"kb_used_omap":12,"kb_used_meta":461619,"kb_avail":754490580,"statfs":{"total":773094113280,"available":772598353920,"internally_reserved":0,"allocated":22880256,"data_stored":10721240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":472698417},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002995"},"pg_stats":[{"pgid":"1.0","version":"214'74","reported_seq":478,"reported_epoch":214,"state":"active+clean","last_fresh":"2024-09-17T03:48:37.643680+0000","last_change":"2024-09-17T03:48:37.643609+0000","last_active":"2024-09-17T03:48:37.643680+0000","last_peered":"2024-09-17T03:48:37.643680+0000","last_clean":"2024-09-17T03:48:37.643680+0000","last_became_active":"2024-09-17T03:32:49.918987+0000","last_became_peered":"2024-09-17T03:32:49.918987+0000","last_unstale":"2024-09-17T03:48:37.643680+0000","last_undegraded":"2024-09-17T03:48:37.643680+0000","last_fullsized":"2024-09-17T03:48:37.643680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"214'74","last_scrub_stamp":"2024-09-17T03:48:37.643501+0000","last_deep_scrub":"214'74","last_deep_scrub_stamp":"2024-09-17T03:48:37.643501+0000","last_clean_scrub_stamp":"2024-09-17T03:48:37.643501+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:14.553882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509637,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60780,"kb_used_data":3228,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311060,"statfs":{"total":96636764160,"available":96574525440,"internally_reserved":0,"allocated":3305472,"data_stored":1782931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58915275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64368,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307472,"statfs":{"total":96636764160,"available":96570851328,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69868,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301972,"statfs":{"total":96636764160,"available":96565219328,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56048,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315792,"statfs":{"total":96636764160,"available":96579371008,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60204,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311636,"statfs":{"total":96636764160,"available":96575115264,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509638,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56620,"kb_used_data":3228,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315220,"statfs":{"total":96636764160,"available":96578785280,"internally_reserved":0,"allocated":3305472,"data_stored":1782931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56044,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315796,"statfs":{"total":96636764160,"available":96579375104,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60208,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311632,"statfs":{"total":96636764160,"available":96575111168,"internally_reserved":0,"allocated":2711552,"data_stored":1192563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:48:57.831 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T03:48:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.943+0000 7f0d38ded640 1 -- 172.21.15.146:0/755224469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d340d1220 msgr2=0x7f0d340b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.943+0000 7f0d38ded640 1 --2- 172.21.15.146:0/755224469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d340d1220 0x7f0d340b5ad0 secure :-1 s=READY pgs=2864 cs=0 l=1 rev1=1 crypto rx=0x7f0d34072960 tx=0x7f0d2c02aac0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.944+0000 7f0d38ded640 1 -- 172.21.15.146:0/755224469 shutdown_connections 2024-09-17T03:48:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.944+0000 7f0d38ded640 1 --2- 172.21.15.146:0/755224469 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d340d1220 0x7f0d340b5ad0 unknown :-1 s=CLOSED pgs=2864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.944+0000 7f0d38ded640 1 --2- 172.21.15.146:0/755224469 >> v2:172.21.15.179:3300/0 conn(0x7f0d340d31e0 0x7f0d340cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.944 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.944+0000 7f0d38ded640 1 -- 172.21.15.146:0/755224469 >> 172.21.15.146:0/755224469 conn(0x7f0d340d26c0 msgr2=0x7f0d340d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:57.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.944+0000 7f0d38ded640 1 -- 172.21.15.146:0/755224469 shutdown_connections 2024-09-17T03:48:57.945 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.944+0000 7f0d38ded640 1 -- 172.21.15.146:0/755224469 wait complete. 2024-09-17T03:48:57.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.946+0000 7f0d38ded640 1 Processor -- start 2024-09-17T03:48:57.946 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.946+0000 7f0d38ded640 1 -- start start 2024-09-17T03:48:57.948 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d38ded640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d340d31e0 0x7f0d34155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d38ded640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3415cbe0 0x7f0d340cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d38ded640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d341e3d70 0x7f0d341e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d38ded640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7f0d340b63a0 con 0x7f0d3415cbe0 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d38ded640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f0d340b6220 con 0x7f0d341e3d70 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d38ded640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0d340b6520 con 0x7f0d340d31e0 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d29d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3415cbe0 0x7f0d340cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d29d9b640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3415cbe0 0x7f0d340cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50234/0 (socket says 172.21.15.146:50234) 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d29d9b640 1 -- 172.21.15.146:0/4115994595 learned_addr learned my addr 172.21.15.146:0/4115994595 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d32d9d640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d341e3d70 0x7f0d341e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d3259c640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d340d31e0 0x7f0d34155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d29d9b640 1 -- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d340d31e0 msgr2=0x7f0d34155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d29d9b640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d340d31e0 0x7f0d34155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.949 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d29d9b640 1 -- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d341e3d70 msgr2=0x7f0d341e4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d29d9b640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d341e3d70 0x7f0d341e4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.947+0000 7f0d29d9b640 1 -- 172.21.15.146:0/4115994595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d341e46c0 con 0x7f0d3415cbe0 2024-09-17T03:48:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.948+0000 7f0d32d9d640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d341e3d70 0x7f0d341e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:48:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.948+0000 7f0d29d9b640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3415cbe0 0x7f0d340cbe60 secure :-1 s=READY pgs=2865 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c3f0 tx=0x7f0d1c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.948+0000 7f0d2b7fe640 1 -- 172.21.15.146:0/4115994595 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c017070 con 0x7f0d3415cbe0 2024-09-17T03:48:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.948+0000 7f0d2b7fe640 1 -- 172.21.15.146:0/4115994595 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d1c0035f0 con 0x7f0d3415cbe0 2024-09-17T03:48:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.948+0000 7f0d38ded640 1 -- 172.21.15.146:0/4115994595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d34156100 con 0x7f0d3415cbe0 2024-09-17T03:48:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.948+0000 7f0d2b7fe640 1 -- 172.21.15.146:0/4115994595 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c003a40 con 0x7f0d3415cbe0 2024-09-17T03:48:57.950 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.948+0000 7f0d38ded640 1 -- 172.21.15.146:0/4115994595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d341e24c0 con 0x7f0d3415cbe0 2024-09-17T03:48:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.949+0000 7f0d38ded640 1 -- 172.21.15.146:0/4115994595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d340cda20 con 0x7f0d3415cbe0 2024-09-17T03:48:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.950+0000 7f0d2b7fe640 1 -- 172.21.15.146:0/4115994595 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d1c01a070 con 0x7f0d3415cbe0 2024-09-17T03:48:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.950+0000 7f0d2b7fe640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 0x7f0d1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.950+0000 7f0d2b7fe640 1 -- 172.21.15.146:0/4115994595 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7f0d1c099e10 con 0x7f0d3415cbe0 2024-09-17T03:48:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.951+0000 7f0d3259c640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 0x7f0d1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:57.951 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.951+0000 7f0d3259c640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 0x7f0d1407b0a0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f0d24005fd0 tx=0x7f0d24005cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:57.955 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:57.955+0000 7f0d2b7fe640 1 -- 172.21.15.146:0/4115994595 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0d340cda20 con 0x7f0d3415cbe0 2024-09-17T03:48:58.129 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.129+0000 7f0d38ded640 1 -- 172.21.15.146:0/4115994595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f0d340cffa0 con 0x7f0d3415cbe0 2024-09-17T03:48:58.132 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.133+0000 7f0d2b7fe640 1 -- 172.21.15.146:0/4115994595 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v71)=0 v71) ==== 123+0+0 (secure 0 0 0) 0x7f0d340cffa0 con 0x7f0d3415cbe0 2024-09-17T03:48:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.134+0000 7f0d2b7fe640 1 -- 172.21.15.146:0/4115994595 <== mon.0 v2:172.21.15.146:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f0d1c061900 con 0x7f0d3415cbe0 2024-09-17T03:48:58.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.135+0000 7f0d38ded640 1 -- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 msgr2=0x7f0d1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:58.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.135+0000 7f0d38ded640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 0x7f0d1407b0a0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f0d24005fd0 tx=0x7f0d24005cf0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.135+0000 7f0d38ded640 1 -- 172.21.15.146:0/4115994595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3415cbe0 msgr2=0x7f0d340cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:58.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.135+0000 7f0d38ded640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3415cbe0 0x7f0d340cbe60 secure :-1 s=READY pgs=2865 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c3f0 tx=0x7f0d1c00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.135+0000 7f0d38ded640 1 -- 172.21.15.146:0/4115994595 shutdown_connections 2024-09-17T03:48:58.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.135+0000 7f0d38ded640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7f0d14078b90 0x7f0d1407b0a0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.135+0000 7f0d38ded640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d341e3d70 0x7f0d341e4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.135+0000 7f0d38ded640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3415cbe0 0x7f0d340cbe60 unknown :-1 s=CLOSED pgs=2865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.136 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.135+0000 7f0d38ded640 1 --2- 172.21.15.146:0/4115994595 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0d340d31e0 0x7f0d34155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.136+0000 7f0d38ded640 1 -- 172.21.15.146:0/4115994595 >> 172.21.15.146:0/4115994595 conn(0x7f0d340d26c0 msgr2=0x7f0d340d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:58.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.136+0000 7f0d38ded640 1 -- 172.21.15.146:0/4115994595 shutdown_connections 2024-09-17T03:48:58.137 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.136+0000 7f0d38ded640 1 -- 172.21.15.146:0/4115994595 wait complete. 2024-09-17T03:48:58.147 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:48:58.147 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:48:58.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.261+0000 7fd43a5e4640 1 -- 172.21.15.146:0/4254799734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd434069940 msgr2=0x7fd4340cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:58.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.261+0000 7fd43a5e4640 1 --2- 172.21.15.146:0/4254799734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd434069940 0x7fd4340cf3c0 secure :-1 s=READY pgs=2867 cs=0 l=1 rev1=1 crypto rx=0x7fd428009830 tx=0x7fd42802a480 comp rx=0 tx=0).stop 2024-09-17T03:48:58.261 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.261+0000 7fd43a5e4640 1 -- 172.21.15.146:0/4254799734 shutdown_connections 2024-09-17T03:48:58.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.261+0000 7fd43a5e4640 1 --2- 172.21.15.146:0/4254799734 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd4340d3200 0x7fd4340d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.261+0000 7fd43a5e4640 1 --2- 172.21.15.146:0/4254799734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd434069940 0x7fd4340cf3c0 unknown :-1 s=CLOSED pgs=2867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.261+0000 7fd43a5e4640 1 -- 172.21.15.146:0/4254799734 >> 172.21.15.146:0/4254799734 conn(0x7fd4340d1770 msgr2=0x7fd4340d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:58.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.261+0000 7fd43a5e4640 1 -- 172.21.15.146:0/4254799734 shutdown_connections 2024-09-17T03:48:58.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.261+0000 7fd43a5e4640 1 -- 172.21.15.146:0/4254799734 wait complete. 2024-09-17T03:48:58.262 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.263+0000 7fd43a5e4640 1 Processor -- start 2024-09-17T03:48:58.263 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.263+0000 7fd43a5e4640 1 -- start start 2024-09-17T03:48:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd43a5e4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340d3200 0x7fd434154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd43a5e4640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43415edf0 0x7fd4340ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd43a5e4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43415cde0 0x7fd4340ab720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd43a5e4640 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 -- 0x7fd4340d3cd0 con 0x7fd43415edf0 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd43a5e4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd4340d3b50 con 0x7fd4340d3200 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd43a5e4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd4340d3e50 con 0x7fd43415cde0 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd4337fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43415edf0 0x7fd4340ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd4337fe640 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43415edf0 0x7fd4340ab1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50258/0 (socket says 172.21.15.146:50258) 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd4337fe640 1 -- 172.21.15.146:0/1851110256 learned_addr learned my addr 172.21.15.146:0/1851110256 (peer_addr_for_me v2:172.21.15.146:0/0) 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd433fff640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340d3200 0x7fd434154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd438b81640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43415cde0 0x7fd4340ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd4337fe640 1 -- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43415cde0 msgr2=0x7fd4340ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd4337fe640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43415cde0 0x7fd4340ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd4337fe640 1 -- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340d3200 msgr2=0x7fd434154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd4337fe640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340d3200 0x7fd434154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.264+0000 7fd4337fe640 1 -- 172.21.15.146:0/1851110256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4340b3ce0 con 0x7fd43415edf0 2024-09-17T03:48:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.265+0000 7fd4337fe640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43415edf0 0x7fd4340ab1e0 secure :-1 s=READY pgs=2868 cs=0 l=1 rev1=1 crypto rx=0x7fd428009950 tx=0x7fd428005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.265+0000 7fd430ff9640 1 -- 172.21.15.146:0/1851110256 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42803f070 con 0x7fd43415edf0 2024-09-17T03:48:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.265+0000 7fd430ff9640 1 -- 172.21.15.146:0/1851110256 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fd428031d70 con 0x7fd43415edf0 2024-09-17T03:48:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.265+0000 7fd43a5e4640 1 -- 172.21.15.146:0/1851110256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4340b6570 con 0x7fd43415edf0 2024-09-17T03:48:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.265+0000 7fd430ff9640 1 -- 172.21.15.146:0/1851110256 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4280042b0 con 0x7fd43415edf0 2024-09-17T03:48:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.265+0000 7fd43a5e4640 1 -- 172.21.15.146:0/1851110256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4340b6b30 con 0x7fd43415edf0 2024-09-17T03:48:58.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.266+0000 7fd43a5e4640 1 -- 172.21.15.146:0/1851110256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4340b6f40 con 0x7fd43415edf0 2024-09-17T03:48:58.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.267+0000 7fd430ff9640 1 -- 172.21.15.146:0/1851110256 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd428042070 con 0x7fd43415edf0 2024-09-17T03:48:58.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.267+0000 7fd430ff9640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd420078bc0 0x7fd42007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:48:58.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.267+0000 7fd430ff9640 1 -- 172.21.15.146:0/1851110256 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5029+0+0 (secure 0 0 0) 0x7fd4280bb9d0 con 0x7fd43415edf0 2024-09-17T03:48:58.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.267+0000 7fd433fff640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd420078bc0 0x7fd42007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:48:58.268 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.268+0000 7fd433fff640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd420078bc0 0x7fd42007b0d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fd43408da20 tx=0x7fd424009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:48:58.271 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.271+0000 7fd430ff9640 1 -- 172.21.15.146:0/1851110256 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd4280840b0 con 0x7fd43415edf0 2024-09-17T03:48:58.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.481+0000 7fd43a5e4640 1 -- 172.21.15.146:0/1851110256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4340b3eb0 con 0x7fd43415edf0 2024-09-17T03:48:58.481 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.481+0000 7fd430ff9640 1 -- 172.21.15.146:0/1851110256 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 171 v171) ==== 95+0+3929 (secure 0 0 0) 0x7fd4280839b0 con 0x7fd43415edf0 2024-09-17T03:48:58.481 INFO:teuthology.orchestra.run.smithi146.stdout: 2024-09-17T03:48:58.482 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":171,"btime":"2024-09-17T03:48:27:299721+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10162,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/2929730409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2929730409},{"type":"v1","addr":"172.21.15.179:6836","nonce":2929730409}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":158},{"gid":10288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2813416980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":2813416980},{"type":"v1","addr":"172.21.15.179:6837","nonce":2813416980}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":165},{"gid":11838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/196043131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":196043131},{"type":"v1","addr":"172.21.15.146:6833","nonce":196043131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":157},{"gid":12285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1411780552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1411780552},{"type":"v1","addr":"172.21.15.146:6835","nonce":1411780552}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171}],"filesystems":[]} 2024-09-17T03:48:58.482 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 171 2024-09-17T03:48:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.483+0000 7fd43a5e4640 1 -- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd420078bc0 msgr2=0x7fd42007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.483+0000 7fd43a5e4640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd420078bc0 0x7fd42007b0d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fd43408da20 tx=0x7fd424009040 comp rx=0 tx=0).stop 2024-09-17T03:48:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.484+0000 7fd43a5e4640 1 -- 172.21.15.146:0/1851110256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43415edf0 msgr2=0x7fd4340ab1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:48:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.484+0000 7fd43a5e4640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43415edf0 0x7fd4340ab1e0 secure :-1 s=READY pgs=2868 cs=0 l=1 rev1=1 crypto rx=0x7fd428009950 tx=0x7fd428005360 comp rx=0 tx=0).stop 2024-09-17T03:48:58.484 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.484+0000 7fd43a5e4640 1 -- 172.21.15.146:0/1851110256 shutdown_connections 2024-09-17T03:48:58.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.484+0000 7fd43a5e4640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:6800/3262901240,v1:172.21.15.179:6801/3262901240] conn(0x7fd420078bc0 0x7fd42007b0d0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.484+0000 7fd43a5e4640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd43415cde0 0x7fd4340ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.484+0000 7fd43a5e4640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd43415edf0 0x7fd4340ab1e0 unknown :-1 s=CLOSED pgs=2868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.484+0000 7fd43a5e4640 1 --2- 172.21.15.146:0/1851110256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd4340d3200 0x7fd434154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:48:58.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.484+0000 7fd43a5e4640 1 -- 172.21.15.146:0/1851110256 >> 172.21.15.146:0/1851110256 conn(0x7fd4340d1770 msgr2=0x7fd4340b8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:48:58.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.484+0000 7fd43a5e4640 1 -- 172.21.15.146:0/1851110256 shutdown_connections 2024-09-17T03:48:58.485 INFO:teuthology.orchestra.run.smithi146.stderr:2024-09-17T03:48:58.484+0000 7fd43a5e4640 1 -- 172.21.15.146:0/1851110256 wait complete. 2024-09-17T03:48:58.495 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T03:48:58.495 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T03:48:58.496 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:48:58.496 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:58.505 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:48:58.505 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:48:58.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:58.558 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:48:58.558 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:48:58.558 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:58.570 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:48:58.571 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:48:58.571 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:58.626 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:48:58.626 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T03:48:58.627 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T03:48:58.627 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:58.661 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T03:48:58.662 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T03:48:58.662 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:58.733 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T03:48:58.733 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T03:48:58.734 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:58.805 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T03:48:58.806 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T03:48:58.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:58.879 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T03:48:58.879 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T03:48:58.879 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:58.919 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T03:48:58.919 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T03:48:58.920 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:58.998 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T03:48:58.999 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T03:48:58.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:59.075 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T03:48:59.075 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T03:48:59.075 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:59.149 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T03:48:59.150 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T03:48:59.150 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T03:48:59.150 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:59.177 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T03:48:59.178 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T03:48:59.178 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:59.220 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T03:48:59.220 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T03:48:59.220 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T03:48:59.220 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:59.232 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T03:48:59.233 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T03:48:59.233 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:59.274 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T03:48:59.275 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T03:48:59.275 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:48:59.327 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T03:48:59.328 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T03:48:59.328 DEBUG:teuthology.orchestra.run.smithi146:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-09-17T03:48:59.364 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:48:59.365 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T03:48:59.573 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:48:59.573 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T03:48:59.685 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:48:59.685 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T03:48:59.742 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:48:59.743 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T03:48:59.784 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:48:59.785 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T03:48:59.980 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:48:59.981 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T03:49:00.069 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:49:00.069 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T03:49:00.124 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:49:00.125 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T03:49:00.181 INFO:tasks.ceph:Archiving mon data... 2024-09-17T03:49:00.183 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445/data/mon.a.tgz 2024-09-17T03:49:00.183 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2024-09-17T03:49:00.200 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.O3w3GOdwJb 2024-09-17T03:49:00.201 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.O3w3GOdwJb 2024-09-17T03:49:00.391 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.O3w3GOdwJb 2024-09-17T03:49:00.474 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.O3w3GOdwJb is 629KB 2024-09-17T03:49:00.548 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.O3w3GOdwJb 2024-09-17T03:49:00.563 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445/data/mon.b.tgz 2024-09-17T03:49:00.563 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-09-17T03:49:00.580 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.vcxtRDjR4M 2024-09-17T03:49:00.581 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vcxtRDjR4M 2024-09-17T03:49:00.728 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:49:00.731 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:49:00.794 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.vcxtRDjR4M 2024-09-17T03:49:00.918 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.vcxtRDjR4M is 662KB 2024-09-17T03:49:01.017 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.vcxtRDjR4M 2024-09-17T03:49:01.032 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445/data/mon.c.tgz 2024-09-17T03:49:01.032 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-09-17T03:49:01.087 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.uuTOh3JkiI 2024-09-17T03:49:01.087 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.uuTOh3JkiI 2024-09-17T03:49:01.281 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.uuTOh3JkiI 2024-09-17T03:49:01.366 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.uuTOh3JkiI is 662KB 2024-09-17T03:49:01.438 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.uuTOh3JkiI 2024-09-17T03:49:01.454 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T03:49:01.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T03:49:01.456 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T03:49:01.538 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T03:49:01.574 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T03:49:01.574 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T03:49:01.576 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445/remote/smithi146/crash 2024-09-17T03:49:01.577 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T03:49:01.605 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445/remote/smithi179/crash 2024-09-17T03:49:01.606 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T03:49:01.637 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T03:49:01.637 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:49:01.650 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:49:01.735 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T03:49:01.761 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T03:49:01.786 INFO:tasks.ceph:Compressing logs... 2024-09-17T03:49:01.787 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T03:49:01.804 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T03:49:01.827 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T03:49:01.827 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82964.log 2024-09-17T03:49:01.828 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61909.log 2024-09-17T03:49:01.828 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.82964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79515.log 2024-09-17T03:49:01.873 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T03:49:01.874 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36767.log 2024-09-17T03:49:01.874 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T03:49:01.874 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.36767.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T03:49:01.874 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.b.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36767.log.gz 2024-09-17T03:49:01.874 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T03:49:01.874 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42554.log 2024-09-17T03:49:01.874 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36807.log 2024-09-17T03:49:01.874 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.3.42554.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T03:49:01.874 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42554.log.gz 2024-09-17T03:49:01.874 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42154.log 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36807.log.gz 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36567.log 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.42154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42154.log.gz 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42558.log 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36527.log 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36567.log.gz/var/log/ceph/ceph-client.3.42558.log: 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42558.log.gz 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42159.log 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.36527.log: -- /var/log/ceph/ceph-client.admin.36647.log 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.1.42159.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36527.log.gz 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42159.log.gz 2024-09-17T03:49:01.875 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T03:49:01.876 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T03:49:01.876 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.36647.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T03:49:01.876 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.5.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36647.log.gz 2024-09-17T03:49:01.876 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T03:49:01.876 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.log: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T03:49:01.876 INFO:teuthology.orchestra.run.smithi179.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T03:49:01.876 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T03:49:01.876 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T03:49:01.887 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36607.log 2024-09-17T03:49:01.892 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36687.log 2024-09-17T03:49:01.905 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36727.log 2024-09-17T03:49:01.906 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36687.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36607.log.gz 2024-09-17T03:49:01.912 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.36727.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36687.log.gz 2024-09-17T03:49:01.922 INFO:teuthology.orchestra.run.smithi179.stderr: 93.7% 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36727.log.gz 2024-09-17T03:49:01.923 INFO:teuthology.orchestra.run.smithi179.stderr: -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T03:49:02.084 INFO:teuthology.orchestra.run.smithi179.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T03:49:02.303 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.82964.log.gz 2024-09-17T03:49:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67173.log 2024-09-17T03:49:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83573.log 2024-09-17T03:49:02.304 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61909.log.gz 2024-09-17T03:49:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.79515.log: /var/log/ceph/ceph-client.admin.67173.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79515.log.gz 2024-09-17T03:49:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48750.log 2024-09-17T03:49:02.304 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67173.log.gz 2024-09-17T03:49:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55926.log 2024-09-17T03:49:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83573.log: /var/log/ceph/ceph-client.0.48750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44244.log 2024-09-17T03:49:02.305 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48750.log.gz 2024-09-17T03:49:02.305 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83573.log.gz 2024-09-17T03:49:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106635.log 2024-09-17T03:49:02.305 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55926.log.gz 2024-09-17T03:49:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106677.log 2024-09-17T03:49:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106635.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44244.log.gz 2024-09-17T03:49:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55800.log 2024-09-17T03:49:02.305 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106635.log.gz 2024-09-17T03:49:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109595.log 2024-09-17T03:49:02.305 INFO:teuthology.orchestra.run.smithi146.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.106677.log.gz 2024-09-17T03:49:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70592.log 2024-09-17T03:49:02.306 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55800.log.gz 2024-09-17T03:49:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94279.log 2024-09-17T03:49:02.306 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.109595.log.gz 2024-09-17T03:49:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80887.log 2024-09-17T03:49:02.306 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70592.log.gz 2024-09-17T03:49:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110849.log 2024-09-17T03:49:02.306 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94279.log.gz 2024-09-17T03:49:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.80887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.80887.log.gz 2024-09-17T03:49:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37421.log 2024-09-17T03:49:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44776.log 2024-09-17T03:49:02.307 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110849.log.gz 2024-09-17T03:49:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.37421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68041.log 2024-09-17T03:49:02.307 INFO:teuthology.orchestra.run.smithi146.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37421.log.gz 2024-09-17T03:49:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63599.log 2024-09-17T03:49:02.307 INFO:teuthology.orchestra.run.smithi146.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44776.log.gz/var/log/ceph/ceph-client.admin.68041.log: 2024-09-17T03:49:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68980.log 2024-09-17T03:49:02.307 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68041.log.gz 2024-09-17T03:49:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69348.log 2024-09-17T03:49:02.307 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63599.log.gz 2024-09-17T03:49:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64918.log 2024-09-17T03:49:02.307 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.68980.log.gz 2024-09-17T03:49:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106467.log 2024-09-17T03:49:02.308 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69348.log.gz 2024-09-17T03:49:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60640.log 2024-09-17T03:49:02.308 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64918.log.gz 2024-09-17T03:49:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60453.log 2024-09-17T03:49:02.308 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106467.log.gz 2024-09-17T03:49:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44818.log 2024-09-17T03:49:02.308 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60640.log.gz 2024-09-17T03:49:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89452.log 2024-09-17T03:49:02.308 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60453.log.gz 2024-09-17T03:49:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111588.log 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44818.log.gz 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89736.log 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89452.log.gz 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92452.log 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111588.log.gz 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48754.log 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89736.log.gz/var/log/ceph/ceph-client.admin.92452.log: 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44242.log 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92452.log.gz 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.48754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67997.log 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48754.log.gz 2024-09-17T03:49:02.309 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61531.log 2024-09-17T03:49:02.310 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44242.log.gz 2024-09-17T03:49:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63442.log 2024-09-17T03:49:02.310 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67997.log.gz 2024-09-17T03:49:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70111.log 2024-09-17T03:49:02.310 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61531.log.gz 2024-09-17T03:49:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71556.log 2024-09-17T03:49:02.310 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63442.log.gz 2024-09-17T03:49:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94962.log 2024-09-17T03:49:02.310 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70111.log.gz 2024-09-17T03:49:02.310 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64504.log 2024-09-17T03:49:02.310 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71556.log.gz 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89824.log 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94962.log.gz 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89070.log 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64504.log.gz 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99808.log 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89824.log.gz 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113577.log 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89070.log.gz 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48034.log 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99808.log.gz 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99766.log 2024-09-17T03:49:02.311 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113577.log.gz 2024-09-17T03:49:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82922.log 2024-09-17T03:49:02.312 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48034.log.gz 2024-09-17T03:49:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112949.log 2024-09-17T03:49:02.312 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.99766.log.gz 2024-09-17T03:49:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.82922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66827.log 2024-09-17T03:49:02.312 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.82922.log.gz 2024-09-17T03:49:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44234.log 2024-09-17T03:49:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66827.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112949.log.gz 2024-09-17T03:49:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110578.log 2024-09-17T03:49:02.312 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66827.log.gz 2024-09-17T03:49:02.312 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57334.log 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44234.log.gz 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84781.log 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110578.log.gz/var/log/ceph/ceph-client.admin.57334.log: 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114988.log 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57334.log.gz 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114177.log 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84781.log.gz 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79897.log 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114988.log.gz/var/log/ceph/ceph-client.admin.114177.log: 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93178.log 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114177.log.gz 2024-09-17T03:49:02.313 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.79897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62035.log 2024-09-17T03:49:02.314 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79897.log.gz 2024-09-17T03:49:02.314 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43684.log 2024-09-17T03:49:02.314 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62035.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93178.log.gz 2024-09-17T03:49:02.314 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36555.log 2024-09-17T03:49:02.314 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62035.log.gz 2024-09-17T03:49:02.314 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63014.log 2024-09-17T03:49:02.316 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43684.log.gz 2024-09-17T03:49:02.316 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109469.log 2024-09-17T03:49:02.316 INFO:teuthology.orchestra.run.smithi146.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36555.log.gz 2024-09-17T03:49:02.316 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55758.log 2024-09-17T03:49:02.316 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63014.log.gz 2024-09-17T03:49:02.316 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80167.log 2024-09-17T03:49:02.316 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109469.log.gz 2024-09-17T03:49:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63809.log 2024-09-17T03:49:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80167.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55758.log.gz 2024-09-17T03:49:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107013.log 2024-09-17T03:49:02.317 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80167.log.gz 2024-09-17T03:49:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68335.log 2024-09-17T03:49:02.317 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63809.log.gz 2024-09-17T03:49:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64960.log 2024-09-17T03:49:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103852.log 2024-09-17T03:49:02.317 INFO:teuthology.orchestra.run.smithi146.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.68335.log.gz 2024-09-17T03:49:02.317 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.107013.log.gz 2024-09-17T03:49:02.317 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78649.log 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64960.log.gz 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92212.log 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103852.log: /var/log/ceph/ceph-client.admin.78649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92662.log 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103852.log.gz 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67952.log 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92662.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.78649.log.gz 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89410.log 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92662.log.gz 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.92212.log.gz 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67707.log 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67952.log: /var/log/ceph/ceph-client.admin.89410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111968.log 2024-09-17T03:49:02.318 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67952.log.gz 2024-09-17T03:49:02.319 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89410.log.gz 2024-09-17T03:49:02.319 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58061.log 2024-09-17T03:49:02.319 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67707.log.gz 2024-09-17T03:49:02.319 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43432.log 2024-09-17T03:49:02.319 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111968.log.gz 2024-09-17T03:49:02.319 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98382.log 2024-09-17T03:49:02.319 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45028.log 2024-09-17T03:49:02.319 INFO:teuthology.orchestra.run.smithi146.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58061.log.gz 2024-09-17T03:49:02.319 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43432.log.gz 2024-09-17T03:49:02.319 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79347.log 2024-09-17T03:49:02.319 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98382.log.gz 2024-09-17T03:49:02.320 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102640.log 2024-09-17T03:49:02.320 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45028.log: /var/log/ceph/ceph-client.admin.79347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60369.log 2024-09-17T03:49:02.320 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45028.log.gz 2024-09-17T03:49:02.320 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79347.log.gz 2024-09-17T03:49:02.320 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58439.log 2024-09-17T03:49:02.320 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102640.log.gz 2024-09-17T03:49:02.320 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61405.log 2024-09-17T03:49:02.320 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60369.log.gz 2024-09-17T03:49:02.320 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87896.log 2024-09-17T03:49:02.320 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58439.log.gz 2024-09-17T03:49:02.320 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2024-09-17T03:49:02.321 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61405.log.gz 2024-09-17T03:49:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112896.log 2024-09-17T03:49:02.321 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87896.log.gz 2024-09-17T03:49:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46603.log 2024-09-17T03:49:02.321 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2024-09-17T03:49:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114135.log 2024-09-17T03:49:02.321 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112896.log.gz 2024-09-17T03:49:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46432.log 2024-09-17T03:49:02.321 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46603.log.gz 2024-09-17T03:49:02.321 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97159.log 2024-09-17T03:49:02.322 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114135.log.gz 2024-09-17T03:49:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79159.log 2024-09-17T03:49:02.322 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46432.log.gz 2024-09-17T03:49:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99454.log 2024-09-17T03:49:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.79159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105795.log 2024-09-17T03:49:02.322 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79159.log.gz 2024-09-17T03:49:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99454.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.97159.log.gz 2024-09-17T03:49:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105482.log 2024-09-17T03:49:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105795.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99454.log.gz 2024-09-17T03:49:02.322 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56136.log 2024-09-17T03:49:02.322 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105795.log.gz 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87638.log 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105482.log.gz 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67528.log 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87638.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56136.log.gz 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97797.log 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.87638.log.gz 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85418.log 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.67528.log.gz 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104272.log 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.85418.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97797.log.gz 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.85418.log.gz 2024-09-17T03:49:02.323 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57797.log 2024-09-17T03:49:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99580.log 2024-09-17T03:49:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57797.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104272.log.gz 2024-09-17T03:49:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36839.log 2024-09-17T03:49:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93661.log 2024-09-17T03:49:02.324 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57797.log.gz 2024-09-17T03:49:02.324 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.99580.log.gz 2024-09-17T03:49:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84076.log 2024-09-17T03:49:02.324 INFO:teuthology.orchestra.run.smithi146.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36839.log.gz 2024-09-17T03:49:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98078.log 2024-09-17T03:49:02.324 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93661.log.gz 2024-09-17T03:49:02.324 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109553.log 2024-09-17T03:49:02.325 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84076.log.gz 2024-09-17T03:49:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94664.log 2024-09-17T03:49:02.325 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4%/var/log/ceph/ceph-client.admin.109553.log: -- replaced with /var/log/ceph/ceph-client.admin.98078.log.gz 2024-09-17T03:49:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61699.log 2024-09-17T03:49:02.325 INFO:teuthology.orchestra.run.smithi146.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.109553.log.gz 2024-09-17T03:49:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88232.log 2024-09-17T03:49:02.325 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94664.log.gz 2024-09-17T03:49:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84181.log 2024-09-17T03:49:02.325 INFO:teuthology.orchestra.run.smithi146.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.61699.log.gz 2024-09-17T03:49:02.325 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63380.log 2024-09-17T03:49:02.325 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88232.log.gz 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43908.log 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84181.log: /var/log/ceph/ceph-client.admin.63380.log: gzip -5 87.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.84181.log.gz -- 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.93399.log 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63380.log.gz 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94878.log 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93399.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43908.log.gz 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93399.log.gz 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103894.log 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94878.log.gz 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82814.log 2024-09-17T03:49:02.326 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64546.log 2024-09-17T03:49:02.327 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103894.log.gz 2024-09-17T03:49:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.82814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104650.log 2024-09-17T03:49:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43180.log 2024-09-17T03:49:02.327 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64546.log.gz 2024-09-17T03:49:02.327 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.82814.log.gz 2024-09-17T03:49:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67868.log 2024-09-17T03:49:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104650.log: /var/log/ceph/ceph-client.admin.43180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92536.log 2024-09-17T03:49:02.327 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43180.log.gz 2024-09-17T03:49:02.327 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68569.log 2024-09-17T03:49:02.327 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.104650.log.gz 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67868.log.gz 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94836.log 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92536.log: /var/log/ceph/ceph-client.admin.68569.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92536.log.gz 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97755.log 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68569.log.gz 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:gzip/var/log/ceph/ceph-client.admin.94836.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60682.log 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61190.log 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94836.log.gz 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97755.log.gz 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65993.log 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60682.log.gz 2024-09-17T03:49:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.61190.log: /var/log/ceph/ceph-client.admin.115407.log 2024-09-17T03:49:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56178.log 2024-09-17T03:49:02.329 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61190.log.gz 2024-09-17T03:49:02.329 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65993.log.gz 2024-09-17T03:49:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57526.log 2024-09-17T03:49:02.329 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115407.log.gz 2024-09-17T03:49:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69180.log 2024-09-17T03:49:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56178.log: /var/log/ceph/ceph-client.0.57526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84343.log 2024-09-17T03:49:02.329 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56178.log.gz 2024-09-17T03:49:02.329 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57526.log.gz 2024-09-17T03:49:02.329 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48244.log 2024-09-17T03:49:02.329 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69180.log.gz 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103764.log 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84343.log.gz 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68125.log 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48244.log: /var/log/ceph/ceph-client.admin.103764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80293.log 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48244.log.gz 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103764.log.gz 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65296.log 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68125.log.gz 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113145.log 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80293.log: /var/log/ceph/ceph-client.admin.65296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113619.log 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80293.log.gz 2024-09-17T03:49:02.330 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65296.log.gz 2024-09-17T03:49:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114651.log 2024-09-17T03:49:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111017.log 2024-09-17T03:49:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113619.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.113145.log.gz 2024-09-17T03:49:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84865.log 2024-09-17T03:49:02.331 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.114651.log.gz 2024-09-17T03:49:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44577.log 2024-09-17T03:49:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111017.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.113619.log.gz 2024-09-17T03:49:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83761.log 2024-09-17T03:49:02.331 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111017.log.gz 2024-09-17T03:49:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44577.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.84865.log.gz 2024-09-17T03:49:02.331 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70634.log 2024-09-17T03:49:02.332 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44577.log.gz 2024-09-17T03:49:02.332 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85076.log 2024-09-17T03:49:02.332 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83761.log.gz 2024-09-17T03:49:02.332 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97899.log 2024-09-17T03:49:02.332 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70634.log.gz 2024-09-17T03:49:02.332 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.85076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44902.log 2024-09-17T03:49:02.332 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85076.log.gz 2024-09-17T03:49:02.332 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89652.log 2024-09-17T03:49:02.332 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97899.log: /var/log/ceph/ceph-client.admin.44902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56676.log 2024-09-17T03:49:02.332 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97899.log.gz 2024-09-17T03:49:02.332 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44902.log.gz 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68293.log 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89652.log.gz 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36591.log 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56676.log: /var/log/ceph/ceph-client.admin.68293.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56676.log.gz 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108547.log 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68293.log.gz 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69954.log 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36591.log: /var/log/ceph/ceph-client.admin.108547.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36591.log.gz 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65992.log 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108547.log.gz 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67570.log 2024-09-17T03:49:02.333 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69954.log: /var/log/ceph/ceph-client.admin.65992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44230.log 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69954.log.gz 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65992.log.gz 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84655.log 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67570.log.gz 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59598.log 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44230.log: /var/log/ceph/ceph-client.admin.84655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44986.log 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44230.log.gz 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84655.log.gz 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56625.log 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112738.log 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44986.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.59598.log.gz 2024-09-17T03:49:02.334 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89539.log 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44986.log.gz 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56625.log.gz 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43138.log 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112738.log: /var/log/ceph/ceph-client.admin.89539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63851.log 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112738.log.gz 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89539.log.gz 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47471.log 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43138.log.gz 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108192.log 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63851.log: /var/log/ceph/ceph-client.admin.47471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83718.log 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.63851.log.gz 2024-09-17T03:49:02.335 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47471.log.gz 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105922.log 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108192.log.gz 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84385.log 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83718.log: /var/log/ceph/ceph-client.admin.105922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66278.log 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83718.log.gz 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84385.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105922.log.gz 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66232.log 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84385.log.gz 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115072.log 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66278.log.gz 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94142.log 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66232.log: /var/log/ceph/ceph-client.admin.115072.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66232.log.gz 2024-09-17T03:49:02.336 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88148.log 2024-09-17T03:49:02.337 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115072.log.gz 2024-09-17T03:49:02.337 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60892.log 2024-09-17T03:49:02.337 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94142.log: /var/log/ceph/ceph-client.admin.88148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80419.log 2024-09-17T03:49:02.337 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94142.log.gz 2024-09-17T03:49:02.337 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88148.log.gz 2024-09-17T03:49:02.337 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89908.log 2024-09-17T03:49:02.337 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60892.log.gz 2024-09-17T03:49:02.337 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55968.log 2024-09-17T03:49:02.337 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80419.log.gz 2024-09-17T03:49:02.337 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98214.log 2024-09-17T03:49:02.337 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89908.log: /var/log/ceph/ceph-client.admin.55968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110105.log 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89908.log.gz 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55968.log.gz 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108733.log 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98214.log.gz 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114429.log 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.110105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110105.log.gz 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104568.log 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108733.log.gz 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62223.log 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114429.log.gz 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.104568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.104568.log.gz 2024-09-17T03:49:02.338 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104230.log 2024-09-17T03:49:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110216.log 2024-09-17T03:49:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.62223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62223.log.gz 2024-09-17T03:49:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103417.log 2024-09-17T03:49:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104230.log: /var/log/ceph/ceph-client.admin.110216.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.104230.log.gz 2024-09-17T03:49:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84516.log 2024-09-17T03:49:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48562.log 2024-09-17T03:49:02.339 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.110216.log.gz 2024-09-17T03:49:02.339 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103417.log.gz 2024-09-17T03:49:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65991.log 2024-09-17T03:49:02.339 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64164.log 2024-09-17T03:49:02.339 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84516.log.gz 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48562.log.gz 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107972.log 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88505.log 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65991.log.gz 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64164.log: /var/log/ceph/ceph-client.admin.107972.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64164.log.gz 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66320.log 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107972.log.gz 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106761.log 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88505.log: /var/log/ceph/ceph-client.admin.66320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70363.log 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88505.log.gz 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64695.log 2024-09-17T03:49:02.340 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106761.log.gz 2024-09-17T03:49:02.341 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66320.log.gz 2024-09-17T03:49:02.341 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59988.log 2024-09-17T03:49:02.341 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70363.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.70363.log.gz 2024-09-17T03:49:02.341 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67318.log 2024-09-17T03:49:02.341 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64695.log: /var/log/ceph/ceph-client.admin.59988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107079.log 2024-09-17T03:49:02.341 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64695.log.gz 2024-09-17T03:49:02.341 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97567.log 2024-09-17T03:49:02.341 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67318.log.gz 2024-09-17T03:49:02.341 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59988.log.gz 2024-09-17T03:49:02.341 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47598.log 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107079.log: /var/log/ceph/ceph-client.admin.97567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36262.log 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107079.log.gz 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97567.log.gz 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45558.log 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47598.log.gz 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89583.log 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36262.log.gz 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.45558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99496.log 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45558.log.gz 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114861.log 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2%/var/log/ceph/ceph-client.admin.99496.log: -- replaced with /var/log/ceph/ceph-client.admin.89583.log.gz 2024-09-17T03:49:02.342 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44243.log 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.99496.log.gz 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88064.log 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114861.log: /var/log/ceph/ceph-client.admin.44243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102888.log 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114861.log.gz 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44243.log.gz 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47142.log 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88064.log.gz 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103014.log 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102888.log: /var/log/ceph/ceph-client.admin.47142.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.102888.log.gz 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64588.log 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47142.log.gz 2024-09-17T03:49:02.343 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99850.log 2024-09-17T03:49:02.344 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103014.log: /var/log/ceph/ceph-client.admin.64588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45208.log 2024-09-17T03:49:02.344 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103014.log.gz 2024-09-17T03:49:02.344 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.64588.log.gz 2024-09-17T03:49:02.344 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57522.log 2024-09-17T03:49:02.344 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99850.log.gz 2024-09-17T03:49:02.344 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83657.log 2024-09-17T03:49:02.344 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45208.log.gz 2024-09-17T03:49:02.344 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98340.log 2024-09-17T03:49:02.344 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.57522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57522.log.gz 2024-09-17T03:49:02.344 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113037.log 2024-09-17T03:49:02.344 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83657.log.gz 2024-09-17T03:49:02.345 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68251.log 2024-09-17T03:49:02.345 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98340.log.gz 2024-09-17T03:49:02.345 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112619.log 2024-09-17T03:49:02.345 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113037.log: /var/log/ceph/ceph-client.admin.68251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70195.log 2024-09-17T03:49:02.345 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113037.log.gz 2024-09-17T03:49:02.345 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68251.log.gz 2024-09-17T03:49:02.345 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68167.log 2024-09-17T03:49:02.345 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112619.log.gz 2024-09-17T03:49:02.345 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56010.log 2024-09-17T03:49:02.345 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70195.log: /var/log/ceph/ceph-client.admin.68167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56718.log 2024-09-17T03:49:02.345 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70195.log.gz 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68167.log.gz 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103337.log 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56010.log.gz 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36796.log 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56718.log: /var/log/ceph/ceph-client.admin.103337.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56718.log.gz 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80209.log 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.103337.log.gz 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97525.log 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36796.log: /var/log/ceph/ceph-client.admin.80209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70508.log 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36796.log.gz 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80209.log.gz 2024-09-17T03:49:02.346 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42882.log 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43896.log 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97525.log.gz/var/log/ceph/ceph-client.admin.70508.log: 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42882.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.70508.log.gz -5 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.admin.110401.log 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42882.log.gz 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84567.log 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43896.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43896.log.gz 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65044.log 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69825.log 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110401.log.gz 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84567.log: /var/log/ceph/ceph-client.admin.65044.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84567.log.gz 2024-09-17T03:49:02.347 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79855.log 2024-09-17T03:49:02.348 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65044.log.gz 2024-09-17T03:49:02.348 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55293.log 2024-09-17T03:49:02.348 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69825.log: /var/log/ceph/ceph-client.admin.79855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105837.log 2024-09-17T03:49:02.348 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79855.log.gz 2024-09-17T03:49:02.348 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83405.log 2024-09-17T03:49:02.348 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.69825.log.gz 2024-09-17T03:49:02.348 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79986.log 2024-09-17T03:49:02.348 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55293.log.gz 2024-09-17T03:49:02.348 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105837.log.gz 2024-09-17T03:49:02.348 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111884.log 2024-09-17T03:49:02.348 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83405.log.gz 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.79986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113864.log 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79986.log.gz 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83363.log 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111884.log: /var/log/ceph/ceph-client.admin.113864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103806.log 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111884.log.gz 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113864.log.gz/var/log/ceph/ceph-client.admin.83363.log: 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70279.log 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83363.log.gz 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113295.log 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103806.log.gz 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112798.log 2024-09-17T03:49:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70279.log: /var/log/ceph/ceph-client.admin.113295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80079.log 2024-09-17T03:49:02.350 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70279.log.gz 2024-09-17T03:49:02.350 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110933.log 2024-09-17T03:49:02.350 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.113295.log.gz 2024-09-17T03:49:02.350 INFO:teuthology.orchestra.run.smithi146.stderr: 89.4%/var/log/ceph/ceph-client.admin.80079.log: -- replaced with /var/log/ceph/ceph-client.admin.112798.log.gz 2024-09-17T03:49:02.350 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36864.log 2024-09-17T03:49:02.350 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80079.log.gz 2024-09-17T03:49:02.350 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87596.log 2024-09-17T03:49:02.350 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110933.log: /var/log/ceph/ceph-client.admin.36864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108649.log 2024-09-17T03:49:02.350 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110933.log.gz 2024-09-17T03:49:02.350 INFO:teuthology.orchestra.run.smithi146.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36864.log.gz 2024-09-17T03:49:02.350 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79305.log 2024-09-17T03:49:02.351 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 87.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.87596.log.gz -- 2024-09-17T03:49:02.351 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.109637.log 2024-09-17T03:49:02.351 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108649.log: /var/log/ceph/ceph-client.admin.79305.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108649.log.gz 2024-09-17T03:49:02.351 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69891.log 2024-09-17T03:49:02.351 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.79305.log.gz 2024-09-17T03:49:02.351 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108463.log 2024-09-17T03:49:02.351 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109637.log: /var/log/ceph/ceph-client.admin.69891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61277.log 2024-09-17T03:49:02.351 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109637.log.gz 2024-09-17T03:49:02.351 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69891.log.gz 2024-09-17T03:49:02.351 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97441.log 2024-09-17T03:49:02.351 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.108463.log.gz 2024-09-17T03:49:02.352 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.100192.log 2024-09-17T03:49:02.352 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61277.log: /var/log/ceph/ceph-client.admin.97441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55506.log 2024-09-17T03:49:02.352 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61277.log.gz 2024-09-17T03:49:02.352 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97441.log.gz 2024-09-17T03:49:02.352 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.100192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.100192.log.gz 2024-09-17T03:49:02.352 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47767.log 2024-09-17T03:49:02.352 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103540.log 2024-09-17T03:49:02.352 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55506.log: /var/log/ceph/ceph-client.admin.47767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102930.log 2024-09-17T03:49:02.352 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55506.log.gz 2024-09-17T03:49:02.352 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103540.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47767.log.gz 2024-09-17T03:49:02.352 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64206.log 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103540.log.gz 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61573.log 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.102930.log.gz 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61321.log 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64206.log.gz 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79473.log 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61573.log.gz 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98718.log 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61321.log.gz 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60808.log 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.79473.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79473.log.gz 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67910.log 2024-09-17T03:49:02.353 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98718.log.gz 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44579.log 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60808.log: /var/log/ceph/ceph-client.admin.67910.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60808.log.gz 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108276.log 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67910.log.gz 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61783.log 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44579.log: /var/log/ceph/ceph-client.admin.108276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70153.log 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44579.log.gz 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108276.log.gz 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93304.log 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61783.log.gz 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71514.log 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70153.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70153.log.gz 2024-09-17T03:49:02.354 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105627.log 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88631.log 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71514.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93304.log.gz 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105627.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71514.log.gz 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113361.log 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.105627.log.gz 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107804.log 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88631.log: gzip/var/log/ceph/ceph-client.admin.113361.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.61969.log 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88631.log.gz 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69183.log 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107804.log.gz 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61969.log: gzip -5 91.0% --verbose -- /var/log/ceph/ceph-client.admin.63683.log 2024-09-17T03:49:02.355 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113361.log.gz 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66921.log 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69183.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61969.log.gz 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43054.log 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69183.log.gz 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63683.log.gz 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78865.log 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66921.log: /var/log/ceph/ceph-client.admin.43054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62649.log 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66921.log.gz 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.78865.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43054.log.gz 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90076.log 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62649.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.78865.log.gz 2024-09-17T03:49:02.356 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113948.log 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70424.log 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.62649.log.gz 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.90076.log: /var/log/ceph/ceph-client.admin.113948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97713.log 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90076.log.gz 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113948.log.gz 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69763.log 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70424.log.gz 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83973.log 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97713.log: /var/log/ceph/ceph-client.admin.69763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47016.log 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97713.log.gz 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69763.log.gz 2024-09-17T03:49:02.357 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63168.log 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83973.log.gz 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64788.log 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47016.log: /var/log/ceph/ceph-client.admin.63168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110975.log 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47016.log.gz 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63168.log.gz 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88463.log 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64788.log.gz 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97483.log 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110975.log: /var/log/ceph/ceph-client.admin.88463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43902.log 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110975.log.gz 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88463.log.gz 2024-09-17T03:49:02.358 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90498.log 2024-09-17T03:49:02.359 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97483.log.gz 2024-09-17T03:49:02.359 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94920.log 2024-09-17T03:49:02.359 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43902.log: /var/log/ceph/ceph-client.0.90498.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43902.log.gz 2024-09-17T03:49:02.359 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90498.log.gz 2024-09-17T03:49:02.359 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88673.log 2024-09-17T03:49:02.359 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97651.log 2024-09-17T03:49:02.359 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94920.log: /var/log/ceph/ceph-client.admin.88673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42924.log 2024-09-17T03:49:02.359 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94920.log.gz 2024-09-17T03:49:02.359 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88673.log.gz 2024-09-17T03:49:02.359 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111800.log 2024-09-17T03:49:02.359 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97651.log.gz 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79389.log 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42924.log.gz 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104146.log 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111800.log: /var/log/ceph/ceph-client.admin.79389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111800.log.gz 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79389.log.gz 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108234.log 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61657.log 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104146.log.gz 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43222.log: /var/log/ceph/ceph-client.admin.108234.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59664.log 2024-09-17T03:49:02.360 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108234.log.gz 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55842.log 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61657.log: /var/log/ceph/ceph-client.admin.59664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108360.log 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61657.log.gz 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95046.log 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55842.log.gz 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.59664.log.gz 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59032.log 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose 87.5% -- /var/log/ceph/ceph-client.admin.80335.log 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108360.log.gz 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.95046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71430.log/var/log/ceph/ceph-client.admin.59032.log: 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95046.log.gz 2024-09-17T03:49:02.361 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80335.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30117.log 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.80335.log.gz 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71430.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59032.log.gz 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105753.log 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71430.log.gz 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106845.log 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.tmp-client.admin.30117.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30117.log.gz 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104020.log 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105753.log.gz 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37132.log 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.106845.log.gz 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65254.log 2024-09-17T03:49:02.362 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.104020.log.gz 2024-09-17T03:49:02.363 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.37132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95442.log 2024-09-17T03:49:02.363 INFO:teuthology.orchestra.run.smithi146.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37132.log.gz 2024-09-17T03:49:02.363 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47058.log 2024-09-17T03:49:02.363 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65254.log.gz 2024-09-17T03:49:02.363 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57731.log 2024-09-17T03:49:02.363 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.95442.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95442.log.gz 2024-09-17T03:49:02.363 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68419.log 2024-09-17T03:49:02.363 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47058.log.gz 2024-09-17T03:49:02.363 INFO:teuthology.orchestra.run.smithi146.stderr:gzip/var/log/ceph/ceph-client.admin.57731.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59098.log 2024-09-17T03:49:02.363 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99101.log 2024-09-17T03:49:02.363 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68419.log.gz 2024-09-17T03:49:02.364 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88589.log 2024-09-17T03:49:02.364 INFO:teuthology.orchestra.run.smithi146.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57731.log.gz 2024-09-17T03:49:02.364 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43306.log 2024-09-17T03:49:02.364 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59098.log.gz 2024-09-17T03:49:02.364 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99101.log.gz 2024-09-17T03:49:02.364 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88589.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T03:49:02.364 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88589.log.gz 2024-09-17T03:49:02.364 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65170.log 2024-09-17T03:49:02.364 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43306.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56581.log 2024-09-17T03:49:02.364 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43306.log.gz 2024-09-17T03:49:02.364 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93932.log 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65170.log.gz 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110494.log 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56581.log.gz 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106929.log 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110494.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93932.log.gz 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62775.log 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110494.log.gz 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98844.log 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106929.log.gz 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85160.log 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62775.log.gz 2024-09-17T03:49:02.365 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111203.log 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98844.log.gz 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.85160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90118.log 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57226.log 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111203.log.gz 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.85160.log.gz 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.90118.log: gzip -5 --verbose 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90118.log.gz 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr: -- 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.98172.log 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112094.log 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98172.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57226.log.gz 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79033.log 2024-09-17T03:49:02.366 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98172.log.gz 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47348.log 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104909.log 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.79033.log: /var/log/ceph/ceph-client.admin.47348.log: gzip 87.3% 91.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.79033.log.gz -- replaced with /var/log/ceph/ceph-client.admin.112094.log.gz --verbose 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.89249.log 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47348.log.gz 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84823.log 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78771.log 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89249.log.gz 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36863.log 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.104909.log.gz 2024-09-17T03:49:02.367 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.84823.log.gz 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114032.log 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.78771.log: /var/log/ceph/ceph-client.admin.36863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70466.log 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78771.log.gz 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36863.log.gz 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79263.log 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114032.log.gz 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113511.log 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70466.log: /var/log/ceph/ceph-client.admin.79263.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70466.log.gz 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102235.log 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.79263.log.gz 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108505.log 2024-09-17T03:49:02.368 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113511.log: /var/log/ceph/ceph-client.admin.102235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114513.log 2024-09-17T03:49:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62465.log 2024-09-17T03:49:02.369 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.113511.log.gz 2024-09-17T03:49:02.369 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.102235.log.gz 2024-09-17T03:49:02.369 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108505.log.gz 2024-09-17T03:49:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114946.log 2024-09-17T03:49:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106887.log 2024-09-17T03:49:02.369 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114513.log.gz 2024-09-17T03:49:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114946.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62465.log.gz 2024-09-17T03:49:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95342.log 2024-09-17T03:49:02.369 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114946.log.gz 2024-09-17T03:49:02.369 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102766.log 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.106887.log.gz 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.95342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.95342.log.gz 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107515.log 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99030.log 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102766.log: /var/log/ceph/ceph-client.admin.107515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55674.log 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102766.log.gz 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99030.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107515.log.gz 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36348.log 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99030.log.gz 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85118.log 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55674.log.gz 2024-09-17T03:49:02.370 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94359.log 2024-09-17T03:49:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36348.log: 76.4% -- replaced with /var/log/ceph/ceph-client.admin.36348.log.gz 2024-09-17T03:49:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.85118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102300.log 2024-09-17T03:49:02.371 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85118.log.gz 2024-09-17T03:49:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83048.log 2024-09-17T03:49:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87260.log 2024-09-17T03:49:02.371 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94359.log.gz 2024-09-17T03:49:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102300.log: /var/log/ceph/ceph-client.admin.83048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87194.log 2024-09-17T03:49:02.371 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83048.log.gz 2024-09-17T03:49:02.371 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.102300.log.gz 2024-09-17T03:49:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105711.log 2024-09-17T03:49:02.371 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108421.log 2024-09-17T03:49:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84034.log 2024-09-17T03:49:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105711.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.87260.log.gz 2024-09-17T03:49:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108421.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.105711.log.gz 2024-09-17T03:49:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89112.log 2024-09-17T03:49:02.372 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.87194.log.gz 2024-09-17T03:49:02.372 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108421.log.gz 2024-09-17T03:49:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72109.log 2024-09-17T03:49:02.372 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84034.log.gz 2024-09-17T03:49:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94440.log 2024-09-17T03:49:02.372 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89112.log: /var/log/ceph/ceph-client.0.72109.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89112.log.gz 2024-09-17T03:49:02.372 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72109.log.gz 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112991.log 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98802.log 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94440.log: /var/log/ceph/ceph-client.admin.112991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99538.log 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94440.log.gz 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112991.log.gz 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111298.log 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98802.log.gz 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48076.log 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99538.log: /var/log/ceph/ceph-client.admin.111298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106325.log 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99538.log.gz 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111298.log.gz 2024-09-17T03:49:02.373 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108691.log 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48076.log.gz 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57184.log 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106325.log.gz 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62952.log 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108691.log: /var/log/ceph/ceph-client.admin.57184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105669.log 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.108691.log.gz 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57184.log.gz 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69529.log 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62952.log.gz 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58392.log 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105669.log: /var/log/ceph/ceph-client.admin.69529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57058.log 2024-09-17T03:49:02.374 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105669.log.gz 2024-09-17T03:49:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58392.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69529.log.gz 2024-09-17T03:49:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98298.log 2024-09-17T03:49:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44580.log 2024-09-17T03:49:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57058.log: /var/log/ceph/ceph-client.admin.98298.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57058.log.gz 2024-09-17T03:49:02.375 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.58392.log.gz 2024-09-17T03:49:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83615.log 2024-09-17T03:49:02.375 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98298.log.gz 2024-09-17T03:49:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98634.log 2024-09-17T03:49:02.375 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83615.log: gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.88190.log 2024-09-17T03:49:02.375 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44580.log.gz 2024-09-17T03:49:02.375 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83615.log.gz 2024-09-17T03:49:02.376 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97291.log 2024-09-17T03:49:02.376 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.98634.log.gz 2024-09-17T03:49:02.376 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.102598.log 2024-09-17T03:49:02.376 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88190.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88190.log.gz 2024-09-17T03:49:02.376 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48412.log 2024-09-17T03:49:02.376 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94569.log 2024-09-17T03:49:02.376 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102598.log: /var/log/ceph/ceph-client.admin.48412.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.102598.log.gz 2024-09-17T03:49:02.376 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.97291.log.gz 2024-09-17T03:49:02.376 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84907.log 2024-09-17T03:49:02.376 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48412.log.gz 2024-09-17T03:49:02.376 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69571.log 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94569.log: /var/log/ceph/ceph-client.admin.84907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114693.log 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94569.log.gz 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.84907.log.gz 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70237.log 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64248.log 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.69571.log.gz 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114693.log.gz 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:gzip/var/log/ceph/ceph-client.admin.70237.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.80251.log 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64248.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70237.log.gz 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61067.log 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64248.log.gz 2024-09-17T03:49:02.377 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80587.log 2024-09-17T03:49:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66170.log 2024-09-17T03:49:02.378 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80251.log.gz 2024-09-17T03:49:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61067.log: /var/log/ceph/ceph-client.admin.80587.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61067.log.gz 2024-09-17T03:49:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48160.log 2024-09-17T03:49:02.378 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80587.log.gz 2024-09-17T03:49:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65990.log 2024-09-17T03:49:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66170.log: /var/log/ceph/ceph-client.admin.48160.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66170.log.gz 2024-09-17T03:49:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90202.log 2024-09-17T03:49:02.378 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48160.log.gz 2024-09-17T03:49:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110282.log 2024-09-17T03:49:02.378 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65990.log: /var/log/ceph/ceph-client.admin.90202.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65990.log.gz 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84950.log 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90202.log.gz 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108066.log 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70760.log 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84950.log.gz 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.110282.log.gz 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48370.log 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108066.log.gz 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114219.log 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70760.log.gz 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113906.log 2024-09-17T03:49:02.379 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48370.log: /var/log/ceph/ceph-client.admin.114219.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48370.log.gz 2024-09-17T03:49:02.380 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114903.log 2024-09-17T03:49:02.380 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114219.log.gz 2024-09-17T03:49:02.380 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43348.log 2024-09-17T03:49:02.380 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113906.log: /var/log/ceph/ceph-client.admin.114903.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113906.log.gz 2024-09-17T03:49:02.380 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114819.log 2024-09-17T03:49:02.380 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114903.log.gz 2024-09-17T03:49:02.380 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43390.log 2024-09-17T03:49:02.380 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43348.log.gz 2024-09-17T03:49:02.380 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67402.log 2024-09-17T03:49:02.380 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.114819.log.gz 2024-09-17T03:49:02.380 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60766.log 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43390.log.gz 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61232.log 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67402.log.gz 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56052.log 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60766.log.gz 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113079.log 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61232.log.gz 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57995.log 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56052.log.gz 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66963.log 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63557.log 2024-09-17T03:49:02.381 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.113079.log.gz 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103056.log 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57995.log.gz 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66963.log.gz 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64830.log 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63557.log.gz 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105398.log 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103056.log.gz 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64122.log 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64830.log.gz 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112010.log 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105398.log.gz 2024-09-17T03:49:02.382 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37333.log 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64122.log.gz 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92962.log 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112010.log.gz 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.37333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109511.log 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37333.log.gz 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105880.log 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109805.log 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109511.log.gz 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.92962.log.gz 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.105880.log: -- /var/log/ceph/ceph-client.admin.61825.log 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105880.log.gz 2024-09-17T03:49:02.383 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89028.log 2024-09-17T03:49:02.384 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109805.log.gz 2024-09-17T03:49:02.384 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105272.log 2024-09-17T03:49:02.384 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61825.log: /var/log/ceph/ceph-client.admin.89028.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61825.log.gz 2024-09-17T03:49:02.384 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64746.log 2024-09-17T03:49:02.384 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89028.log.gz 2024-09-17T03:49:02.384 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67612.log 2024-09-17T03:49:02.384 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.105272.log.gz 2024-09-17T03:49:02.384 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58801.log 2024-09-17T03:49:02.384 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64746.log.gz 2024-09-17T03:49:02.384 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71342.log 2024-09-17T03:49:02.384 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67612.log.gz 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60556.log 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105524.log 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58801.log.gz 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71342.log.gz 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60556.log: /var/log/ceph/ceph-client.admin.105524.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.60556.log.gz 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64080.log 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105524.log.gz 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89694.log 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64080.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87980.log 2024-09-17T03:49:02.385 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64080.log.gz 2024-09-17T03:49:02.386 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109297.log 2024-09-17T03:49:02.386 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87980.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89694.log.gz 2024-09-17T03:49:02.386 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79075.log 2024-09-17T03:49:02.386 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87980.log.gz 2024-09-17T03:49:02.386 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78583.log 2024-09-17T03:49:02.386 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109297.log.gz 2024-09-17T03:49:02.386 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.79075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64343.log 2024-09-17T03:49:02.386 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79075.log.gz 2024-09-17T03:49:02.386 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.78583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109031.log 2024-09-17T03:49:02.386 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92920.log 2024-09-17T03:49:02.386 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64343.log: /var/log/ceph/ceph-client.admin.109031.log: 87.4% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.78583.log.gz -- replaced with /var/log/ceph/ceph-client.admin.64343.log.gz 2024-09-17T03:49:02.387 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.387 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71851.log 2024-09-17T03:49:02.387 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109031.log.gz 2024-09-17T03:49:02.387 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58309.log 2024-09-17T03:49:02.387 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92920.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92920.log.gz 2024-09-17T03:49:02.387 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102556.log 2024-09-17T03:49:02.387 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93493.log 2024-09-17T03:49:02.387 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58309.log: /var/log/ceph/ceph-client.admin.102556.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.71851.log.gz 2024-09-17T03:49:02.387 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48202.log 2024-09-17T03:49:02.387 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102556.log.gz 2024-09-17T03:49:02.387 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58309.log.gz 2024-09-17T03:49:02.388 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55716.log 2024-09-17T03:49:02.388 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93493.log.gz 2024-09-17T03:49:02.388 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110746.log 2024-09-17T03:49:02.388 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48202.log: /var/log/ceph/ceph-client.admin.55716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61615.log 2024-09-17T03:49:02.388 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48202.log.gz 2024-09-17T03:49:02.388 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55716.log.gz 2024-09-17T03:49:02.388 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90160.log 2024-09-17T03:49:02.388 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110746.log.gz 2024-09-17T03:49:02.388 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57142.log 2024-09-17T03:49:02.388 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61615.log: /var/log/ceph/ceph-client.admin.90160.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.61615.log.gz 2024-09-17T03:49:02.388 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64876.log 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90160.log.gz 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36512.log 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44944.log 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57142.log.gz 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64876.log: /var/log/ceph/ceph-client.admin.36512.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64876.log.gz 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89154.log 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36512.log.gz 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44944.log: /var/log/ceph/ceph-client.admin.89154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60495.log 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44944.log.gz 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.a.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89154.log.gz 2024-09-17T03:49:02.389 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87368.log 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88986.log 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60495.log.gz 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93703.log 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87368.log.gz 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36206.log 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93703.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88986.log.gz 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59412.log 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93703.log.gz 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90502.log 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36206.log.gz 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78907.log 2024-09-17T03:49:02.390 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59412.log: /var/log/ceph/ceph-client.0.90502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93577.log 2024-09-17T03:49:02.391 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90502.log.gz 2024-09-17T03:49:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.78907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85414.log 2024-09-17T03:49:02.391 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59412.log.gz 2024-09-17T03:49:02.391 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78907.log.gz 2024-09-17T03:49:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2024-09-17T03:49:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.85414.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93577.log.gz 2024-09-17T03:49:02.391 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.85414.log.gz 2024-09-17T03:49:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109339.log 2024-09-17T03:49:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103242.log 2024-09-17T03:49:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43600.log: /var/log/ceph/ceph-client.admin.109339.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2024-09-17T03:49:02.391 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93220.log 2024-09-17T03:49:02.392 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109339.log.gz 2024-09-17T03:49:02.392 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105314.log 2024-09-17T03:49:02.392 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103242.log.gz 2024-09-17T03:49:02.392 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60243.log 2024-09-17T03:49:02.392 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93220.log: /var/log/ceph/ceph-client.admin.105314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43895.log 2024-09-17T03:49:02.392 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93220.log.gz 2024-09-17T03:49:02.392 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104975.log 2024-09-17T03:49:02.392 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105314.log.gz 2024-09-17T03:49:02.392 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60243.log.gz 2024-09-17T03:49:02.392 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84697.log 2024-09-17T03:49:02.392 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.43895.log.gz 2024-09-17T03:49:02.393 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68873.log 2024-09-17T03:49:02.393 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104975.log: /var/log/ceph/ceph-client.admin.84697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57929.log 2024-09-17T03:49:02.393 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5%/var/log/ceph/ceph-client.admin.68873.log: -- replaced with /var/log/ceph/ceph-client.admin.84697.log.gz 2024-09-17T03:49:02.393 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.104975.log.gz 2024-09-17T03:49:02.393 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83132.log 2024-09-17T03:49:02.393 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68873.log.gz 2024-09-17T03:49:02.393 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93890.log 2024-09-17T03:49:02.393 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57929.log: /var/log/ceph/ceph-client.admin.83132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97983.log 2024-09-17T03:49:02.393 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3%/var/log/ceph/ceph-client.admin.93890.log: -- replaced with /var/log/ceph/ceph-client.admin.83132.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94706.log 2024-09-17T03:49:02.393 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.393 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57929.log.gz 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.93890.log.gz 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111758.log 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97983.log.gz 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61447.log 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94706.log: /var/log/ceph/ceph-client.admin.111758.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94706.log.gz 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43010.log 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111758.log.gz 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84472.log 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61447.log.gz 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60201.log 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43010.log.gz 2024-09-17T03:49:02.394 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57016.log 2024-09-17T03:49:02.395 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 87.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.84472.log.gz -- 2024-09-17T03:49:02.395 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.46306.log 2024-09-17T03:49:02.395 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60201.log: /var/log/ceph/ceph-client.admin.57016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83090.log 2024-09-17T03:49:02.395 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60201.log.gz 2024-09-17T03:49:02.395 INFO:teuthology.orchestra.run.smithi146.stderr: 86.8%/var/log/ceph/ceph-client.admin.46306.log: -- replaced with /var/log/ceph/ceph-client.admin.57016.log.gz 2024-09-17T03:49:02.395 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67486.log 2024-09-17T03:49:02.395 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46306.log.gz 2024-09-17T03:49:02.395 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115030.log 2024-09-17T03:49:02.395 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83090.log.gz 2024-09-17T03:49:02.395 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71059.log 2024-09-17T03:49:02.395 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67486.log.gz 2024-09-17T03:49:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69465.log 2024-09-17T03:49:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71059.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115030.log.gz 2024-09-17T03:49:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103498.log 2024-09-17T03:49:02.396 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71059.log.gz 2024-09-17T03:49:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82616.log 2024-09-17T03:49:02.396 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69465.log.gz 2024-09-17T03:49:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36660.log 2024-09-17T03:49:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 87.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.103498.log.gz /var/log/ceph/ceph-client.admin.110891.log 2024-09-17T03:49:02.396 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.82616.log: /var/log/ceph/ceph-client.admin.36660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110101.log 2024-09-17T03:49:02.396 INFO:teuthology.orchestra.run.smithi146.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36660.log.gz 2024-09-17T03:49:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110891.log: gzip -5 --verbose -- 91.0% -- replaced with /var/log/ceph/ceph-client.admin.82616.log.gz 2024-09-17T03:49:02.397 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.110662.log 2024-09-17T03:49:02.397 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110891.log.gz 2024-09-17T03:49:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.110101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107847.log 2024-09-17T03:49:02.397 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.110101.log.gz 2024-09-17T03:49:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89950.log 2024-09-17T03:49:02.397 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110662.log.gz 2024-09-17T03:49:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:gzip/var/log/ceph/ceph-client.admin.107847.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.83447.log 2024-09-17T03:49:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89950.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107847.log.gz 2024-09-17T03:49:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107571.log 2024-09-17T03:49:02.397 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.89950.log.gz 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111842.log 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83447.log.gz 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79220.log 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107571.log: /var/log/ceph/ceph-client.admin.111842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111926.log 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111842.log.gz 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.79220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85034.log 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.107571.log.gz 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79220.log.gz 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106593.log 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.85034.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.111926.log.gz 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99724.log 2024-09-17T03:49:02.398 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85034.log.gz 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46348.log 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106593.log.gz 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115282.log 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46348.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99724.log.gz 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.46348.log.gz -5 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.admin.84609.log 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59748.log 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.115282.log.gz 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80503.log 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84609.log.gz 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.59748.log: -- /var/log/ceph/ceph-client.admin.57100.log 2024-09-17T03:49:02.399 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94482.log 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80503.log.gz 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59748.log.gz 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59814.log 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57100.log.gz 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70069.log 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94482.log: /var/log/ceph/ceph-client.admin.59814.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.94482.log.gz 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88944.log 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87938.log 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.70069.log.gz 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59814.log.gz 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79732.log 2024-09-17T03:49:02.400 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88944.log.gz 2024-09-17T03:49:02.401 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108607.log 2024-09-17T03:49:02.401 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87938.log: /var/log/ceph/ceph-client.admin.79732.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.87938.log.gz -5 2024-09-17T03:49:02.401 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62572.log 2024-09-17T03:49:02.401 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79732.log.gz 2024-09-17T03:49:02.401 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47908.log 2024-09-17T03:49:02.401 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108607.log.gz 2024-09-17T03:49:02.401 INFO:teuthology.orchestra.run.smithi146.stderr:gzip/var/log/ceph/ceph-client.admin.62572.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67005.log 2024-09-17T03:49:02.401 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47908.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62572.log.gz 2024-09-17T03:49:02.401 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70676.log 2024-09-17T03:49:02.401 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47908.log.gz 2024-09-17T03:49:02.401 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84262.log 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67005.log.gz 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:gzip/var/log/ceph/ceph-client.admin.70676.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.93848.log 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84262.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.70676.log.gz 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63102.log 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84262.log.gz 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47556.log 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.93848.log.gz 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105585.log 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104572.log 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47556.log.gz 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63102.log.gz 2024-09-17T03:49:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98466.log 2024-09-17T03:49:02.403 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105585.log.gz 2024-09-17T03:49:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.104572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107472.log 2024-09-17T03:49:02.403 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.104572.log.gz 2024-09-17T03:49:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36234.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98466.log.gz 2024-09-17T03:49:02.403 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93787.log 2024-09-17T03:49:02.403 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107472.log.gz 2024-09-17T03:49:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115240.log 2024-09-17T03:49:02.403 INFO:teuthology.orchestra.run.smithi146.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.36234.log.gz 2024-09-17T03:49:02.403 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47226.log 2024-09-17T03:49:02.403 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93787.log.gz 2024-09-17T03:49:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115240.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T03:49:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.115240.log.gz --verbose 2024-09-17T03:49:02.404 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.109115.log 2024-09-17T03:49:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47226.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46848.log 2024-09-17T03:49:02.404 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47226.log.gz 2024-09-17T03:49:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36797.log 2024-09-17T03:49:02.404 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109115.log.gz 2024-09-17T03:49:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83269.log 2024-09-17T03:49:02.404 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46848.log.gz 2024-09-17T03:49:02.404 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65834.log 2024-09-17T03:49:02.404 INFO:teuthology.orchestra.run.smithi146.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.36797.log.gz 2024-09-17T03:49:02.405 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83174.log 2024-09-17T03:49:02.405 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83269.log.gz 2024-09-17T03:49:02.405 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87812.log 2024-09-17T03:49:02.405 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65834.log.gz 2024-09-17T03:49:02.405 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71640.log 2024-09-17T03:49:02.405 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83174.log.gz 2024-09-17T03:49:02.405 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65002.log 2024-09-17T03:49:02.405 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87812.log.gz 2024-09-17T03:49:02.405 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78991.log 2024-09-17T03:49:02.405 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71640.log.gz 2024-09-17T03:49:02.405 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97857.log 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65002.log.gz 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.78991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95484.log 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78991.log.gz 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58759.log 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97857.log.gz 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.95484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58210.log 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95484.log.gz 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43558.log 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58759.log.gz 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107267.log 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94748.log 2024-09-17T03:49:02.406 INFO:teuthology.orchestra.run.smithi146.stderr: 86.7% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43558.log.gz 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58210.log.gz/var/log/ceph/ceph-client.0.107267.log: 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.107267.log.gz 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114609.log 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112052.log 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94748.log: /var/log/ceph/ceph-client.admin.114609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70550.log 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112052.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94748.log.gz 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36149.log 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114609.log.gz 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112052.log.gz 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr: -5/var/log/ceph/ceph-client.admin.70550.log: --verbose -- /var/log/ceph/ceph-client.admin.109913.log 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36149.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70550.log.gz 2024-09-17T03:49:02.407 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36149.log.gz 2024-09-17T03:49:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67215.log 2024-09-17T03:49:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62774.log 2024-09-17T03:49:02.408 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109913.log.gz 2024-09-17T03:49:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47682.log 2024-09-17T03:49:02.408 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67215.log.gz 2024-09-17T03:49:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113427.log 2024-09-17T03:49:02.408 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62774.log.gz 2024-09-17T03:49:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88106.log 2024-09-17T03:49:02.408 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47682.log.gz 2024-09-17T03:49:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99408.log 2024-09-17T03:49:02.408 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88106.log: gzip -5 --verbose 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88106.log.gz 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.69423.log 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.113427.log.gz 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106281.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99408.log.gz 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69423.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69423.log.gz 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.83847.log 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106281.log: gzip -5 --verbose -- 86.6% -- replaced with /var/log/ceph/ceph-client.admin.106281.log.gz 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.63314.log 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83847.log: gzip -5 --verbose -- 87.0% -- replaced with /var/log/ceph/ceph-client.admin.83847.log.gz 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.103582.log 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67131.log 2024-09-17T03:49:02.409 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103582.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63314.log.gz 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104104.log 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103582.log.gz 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.67131.log: -- /var/log/ceph/ceph-client.0.65596.log 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104104.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67131.log.gz 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95346.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104104.log.gz 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.65596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65596.log.gz 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48496.log 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.95346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.95346.log.gz 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66673.log 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99185.log 2024-09-17T03:49:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66673.log: gzip -5 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48496.log.gz 2024-09-17T03:49:02.411 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55590.log 2024-09-17T03:49:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99185.log: gzip -5 --verbose 90.9% -- replaced with /var/log/ceph/ceph-client.admin.66673.log.gz 2024-09-17T03:49:02.411 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.88715.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99185.log.gz 2024-09-17T03:49:02.411 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55590.log: gzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55590.log.gz 2024-09-17T03:49:02.411 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.109255.log 2024-09-17T03:49:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36696.log 2024-09-17T03:49:02.411 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88715.log.gz 2024-09-17T03:49:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80121.log 2024-09-17T03:49:02.411 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109255.log.gz 2024-09-17T03:49:02.411 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36696.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T03:49:02.412 INFO:teuthology.orchestra.run.smithi146.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36696.log.gz 2024-09-17T03:49:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46974.log 2024-09-17T03:49:02.412 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80121.log.gz 2024-09-17T03:49:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101997.log 2024-09-17T03:49:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115365.log 2024-09-17T03:49:02.412 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46974.log.gz 2024-09-17T03:49:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.101997.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101997.log.gz 2024-09-17T03:49:02.412 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.113990.log 2024-09-17T03:49:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115365.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115365.log.gz 2024-09-17T03:49:02.412 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.47950.log 2024-09-17T03:49:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99664.log 2024-09-17T03:49:02.413 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.113990.log.gz 2024-09-17T03:49:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47950.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47950.log.gz 2024-09-17T03:49:02.413 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.102682.log 2024-09-17T03:49:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110704.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.99664.log.gz 2024-09-17T03:49:02.413 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67276.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102682.log.gz 2024-09-17T03:49:02.413 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69721.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110704.log.gz 2024-09-17T03:49:02.413 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109073.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67276.log.gz 2024-09-17T03:49:02.413 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69721.log: gzip 87.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.65404.log 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69721.log.gz 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106509.log 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109073.log.gz 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87326.log 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98256.log 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65404.log.gz 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106509.log: /var/log/ceph/ceph-client.admin.87326.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106509.log.gz 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87326.log.gz 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46681.log 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70321.log 2024-09-17T03:49:02.414 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6%/var/log/ceph/ceph-client.admin.46681.log: -- replaced with /var/log/ceph/ceph-client.admin.98256.log.gz 2024-09-17T03:49:02.415 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90244.log 2024-09-17T03:49:02.415 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46681.log.gz 2024-09-17T03:49:02.415 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70321.log: gzip -5 --verbose -- 87.2% -- replaced with /var/log/ceph/ceph-client.admin.70321.log.gz 2024-09-17T03:49:02.415 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.111674.log 2024-09-17T03:49:02.415 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.90244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94184.log 2024-09-17T03:49:02.415 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104380.log 2024-09-17T03:49:02.415 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.90244.log.gz 2024-09-17T03:49:02.415 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111674.log.gz 2024-09-17T03:49:02.415 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56974.log 2024-09-17T03:49:02.415 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94184.log: /var/log/ceph/ceph-client.admin.104380.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94184.log.gz 2024-09-17T03:49:02.415 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104380.log.gz 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55143.log 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42466.log 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56974.log.gz/var/log/ceph/ceph-client.admin.55143.log: 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98550.log 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63725.log 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0%/var/log/ceph/ceph-client.admin.42466.log: -- replaced with /var/log/ceph/ceph-client.admin.55143.log.gz 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98550.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42466.log.gz 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104314.log 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.98550.log.gz 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5/var/log/ceph/ceph-client.admin.63725.log: --verbose -- /var/log/ceph/ceph-client.admin.70975.log 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104314.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63725.log.gz 2024-09-17T03:49:02.416 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79813.log 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46264.log 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.104314.log.gz 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70975.log: /var/log/ceph/ceph-client.admin.79813.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70975.log.gzgzip 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.88274.log 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79813.log.gz 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111543.log 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46264.log: /var/log/ceph/ceph-client.admin.88274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66386.log 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46264.log.gz 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111543.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88274.log.gz 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71917.log 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111543.log.gz 2024-09-17T03:49:02.417 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67360.log 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.66386.log: /var/log/ceph/ceph-client.admin.71917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88860.log 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66386.log.gz 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71917.log.gz 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98676.log 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67360.log.gz 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88860.log: gzip -5 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88860.log.gz 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.admin.111380.log 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98676.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.59922.log 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98676.log.gz 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68083.log 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111380.log.gz 2024-09-17T03:49:02.418 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69679.log 2024-09-17T03:49:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65086.log 2024-09-17T03:49:02.419 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1%/var/log/ceph/ceph-client.admin.68083.log: -- replaced with /var/log/ceph/ceph-client.admin.59922.log.gz 2024-09-17T03:49:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69679.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68083.log.gz 2024-09-17T03:49:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69679.log.gz 2024-09-17T03:49:02.419 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.71767.log 2024-09-17T03:49:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65086.log: gzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65086.log.gz 2024-09-17T03:49:02.419 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.82748.log 2024-09-17T03:49:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71767.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.88757.log 2024-09-17T03:49:02.419 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71767.log.gz 2024-09-17T03:49:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.82748.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T03:49:02.419 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114471.log 2024-09-17T03:49:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88757.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.82748.log.gz 2024-09-17T03:49:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43900.log 2024-09-17T03:49:02.420 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88757.log.gz 2024-09-17T03:49:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114471.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114471.log.gz 2024-09-17T03:49:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44572.log 2024-09-17T03:49:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105041.log 2024-09-17T03:49:02.420 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43900.log.gz 2024-09-17T03:49:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71809.log 2024-09-17T03:49:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105041.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44572.log.gz 2024-09-17T03:49:02.420 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.105041.log.gz 2024-09-17T03:49:02.420 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99622.log 2024-09-17T03:49:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46932.log 2024-09-17T03:49:02.421 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71809.log.gz 2024-09-17T03:49:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43903.log 2024-09-17T03:49:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46932.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.99622.log.gz 2024-09-17T03:49:02.421 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46932.log.gz 2024-09-17T03:49:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106971.log 2024-09-17T03:49:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97225.log 2024-09-17T03:49:02.421 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43903.log.gz 2024-09-17T03:49:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87680.log 2024-09-17T03:49:02.421 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97225.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106971.log.gz 2024-09-17T03:49:02.421 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.97225.log.gz 2024-09-17T03:49:02.422 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2024-09-17T03:49:02.422 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100000.log 2024-09-17T03:49:02.422 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43264.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.87680.log.gz 2024-09-17T03:49:02.422 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2024-09-17T03:49:02.422 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72105.log 2024-09-17T03:49:02.422 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.100000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114777.log 2024-09-17T03:49:02.422 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100000.log.gz 2024-09-17T03:49:02.422 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.72105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72105.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113738.log 2024-09-17T03:49:02.422 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.422 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114777.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114777.log.gz 2024-09-17T03:49:02.422 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93112.log 2024-09-17T03:49:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71472.log 2024-09-17T03:49:02.423 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113738.log.gz 2024-09-17T03:49:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88902.log 2024-09-17T03:49:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71472.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71472.log.gz 2024-09-17T03:49:02.423 INFO:teuthology.orchestra.run.smithi146.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T03:49:02.423 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93112.log.gz 2024-09-17T03:49:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46474.log 2024-09-17T03:49:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63060.log 2024-09-17T03:49:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46474.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88902.log.gz 2024-09-17T03:49:02.423 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42782.log 2024-09-17T03:49:02.423 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46474.log.gz 2024-09-17T03:49:02.424 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59164.log 2024-09-17T03:49:02.424 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63060.log: /var/log/ceph/ceph-client.admin.42782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85226.log 2024-09-17T03:49:02.424 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59164.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63060.log.gz 2024-09-17T03:49:02.424 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42782.log.gz 2024-09-17T03:49:02.424 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66574.log 2024-09-17T03:49:02.424 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.85226.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59164.log.gz 2024-09-17T03:49:02.424 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92494.log 2024-09-17T03:49:02.424 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85226.log.gz 2024-09-17T03:49:02.424 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T03:49:02.424 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.66574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66574.log.gz 2024-09-17T03:49:02.424 INFO:teuthology.orchestra.run.smithi146.stderr:gzip/var/log/ceph/ceph-client.admin.92494.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.103936.log 2024-09-17T03:49:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92494.log.gz 2024-09-17T03:49:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108150.log 2024-09-17T03:49:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109847.log 2024-09-17T03:49:02.425 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103936.log.gz 2024-09-17T03:49:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43516.log 2024-09-17T03:49:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109847.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108150.log.gz 2024-09-17T03:49:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48454.log 91.1% -- replaced with /var/log/ceph/ceph-client.admin.109847.log.gz 2024-09-17T03:49:02.425 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102039.log 2024-09-17T03:49:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43516.log: /var/log/ceph/ceph-client.admin.48454.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43516.log.gz 2024-09-17T03:49:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60327.log 2024-09-17T03:49:02.426 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3%/var/log/ceph/ceph-client.admin.102039.log: -- replaced with /var/log/ceph/ceph-client.admin.48454.log.gz 2024-09-17T03:49:02.426 INFO:teuthology.orchestra.run.smithi146.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T03:49:02.426 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose 90.9% -- replaced with /var/log/ceph/ceph-client.admin.102039.log.gz 2024-09-17T03:49:02.426 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.63210.log 2024-09-17T03:49:02.426 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110536.log 2024-09-17T03:49:02.426 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60327.log.gz 2024-09-17T03:49:02.426 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63210.log: gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63210.log.gz 2024-09-17T03:49:02.426 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.102808.log 2024-09-17T03:49:02.426 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.110536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111059.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110536.log.gz 2024-09-17T03:49:02.426 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.426 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61489.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102808.log.gz 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111059.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.47429.log 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.111059.log.gz 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63954.log 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61489.log.gz 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105136.log 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47429.log.gz 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82880.log 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63954.log: /var/log/ceph/ceph-client.admin.105136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104188.log 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63954.log.gz 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105136.log.gz/var/log/ceph/ceph-client.admin.82880.log: 2024-09-17T03:49:02.427 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 87.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.89329.log 2024-09-17T03:49:02.428 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.82880.log.gz 2024-09-17T03:49:02.428 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78433.log 2024-09-17T03:49:02.428 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104188.log.gz 2024-09-17T03:49:02.428 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89782.log 2024-09-17T03:49:02.428 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89329.log.gz 2024-09-17T03:49:02.428 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43096.log 2024-09-17T03:49:02.428 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.78433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47725.log 2024-09-17T03:49:02.428 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89782.log: /var/log/ceph/ceph-client.admin.43096.log: 87.5% 90.8% -- replaced with /var/log/ceph/ceph-client.admin.89782.log.gz 2024-09-17T03:49:02.428 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78433.log.gz 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43096.log.gz 2024-09-17T03:49:02.428 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.428 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88022.log 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98592.log 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47725.log.gz/var/log/ceph/ceph-client.admin.88022.log: 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84427.log 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88022.log.gz 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60285.log 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98592.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98592.log.gz -5 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.admin.103722.log 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84427.log: /var/log/ceph/ceph-client.admin.60285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55011.log 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4%/var/log/ceph/ceph-client.admin.103722.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60285.log.gz 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84427.log.gz 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103722.log.gz 2024-09-17T03:49:02.429 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99273.log 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87854.log 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99273.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109427.log 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55011.log.gz 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99273.log.gz 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110620.log 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87854.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46138.log 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109427.log: /var/log/ceph/ceph-client.admin.110620.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109427.log.gz 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110620.log.gz 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63767.log 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106421.log 2024-09-17T03:49:02.430 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46138.log.gz/var/log/ceph/ceph-client.admin.63767.log: 2024-09-17T03:49:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112761.log 2024-09-17T03:49:02.431 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63767.log.gz 2024-09-17T03:49:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115114.log 2024-09-17T03:49:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106421.log: /var/log/ceph/ceph-client.admin.112761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80695.log 2024-09-17T03:49:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115114.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106421.log.gz 2024-09-17T03:49:02.431 INFO:teuthology.orchestra.run.smithi146.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112761.log.gz 2024-09-17T03:49:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111501.log 2024-09-17T03:49:02.431 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.115114.log.gz 2024-09-17T03:49:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65592.log 2024-09-17T03:49:02.431 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80695.log: gzip/var/log/ceph/ceph-client.admin.111501.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.94524.log 2024-09-17T03:49:02.431 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80695.log.gz 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111501.log.gz 2024-09-17T03:49:02.432 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.432 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.65592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65592.log.gz 2024-09-17T03:49:02.432 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104758.log 2024-09-17T03:49:02.432 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102513.log 2024-09-17T03:49:02.432 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94524.log.gz 2024-09-17T03:49:02.432 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108318.log 2024-09-17T03:49:02.432 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79942.log 2024-09-17T03:49:02.432 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.104758.log.gz 2024-09-17T03:49:02.432 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102513.log.gz 2024-09-17T03:49:02.432 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79557.log 2024-09-17T03:49:02.432 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.79942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36838.log 2024-09-17T03:49:02.433 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108318.log.gz 2024-09-17T03:49:02.433 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.79557.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79942.log.gz 2024-09-17T03:49:02.433 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67089.log 2024-09-17T03:49:02.433 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79557.log.gz 2024-09-17T03:49:02.433 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46771.log 2024-09-17T03:49:02.433 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36838.log: /var/log/ceph/ceph-client.admin.67089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59313.log 2024-09-17T03:49:02.433 INFO:teuthology.orchestra.run.smithi146.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.36838.log.gz 2024-09-17T03:49:02.433 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67089.log.gz/var/log/ceph/ceph-client.admin.46771.log: 2024-09-17T03:49:02.433 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71388.log 2024-09-17T03:49:02.433 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46771.log.gz 2024-09-17T03:49:02.433 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37092.log 2024-09-17T03:49:02.434 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84739.log 2024-09-17T03:49:02.434 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59313.log.gz 2024-09-17T03:49:02.434 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.37092.log: /var/log/ceph/ceph-client.admin.71388.log: 86.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94794.log 2024-09-17T03:49:02.434 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37092.log.gz 2024-09-17T03:49:02.434 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71388.log.gz 2024-09-17T03:49:02.434 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97399.log 2024-09-17T03:49:02.434 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94794.log: gzip -5 87.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.84739.log.gz /var/log/ceph/ceph-client.admin.93535.log 2024-09-17T03:49:02.434 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.434 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94794.log.gz 2024-09-17T03:49:02.434 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95004.log 2024-09-17T03:49:02.434 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97399.log: /var/log/ceph/ceph-client.admin.93535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84992.log 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6%/var/log/ceph/ceph-client.admin.95004.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93535.log.gz 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97399.log.gz 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.95004.log.gz 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102724.log 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.84992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68377.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.84992.log.gz 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102724.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102724.log.gz 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.36318.log 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68377.log: gzip -5 --verbose -- 86.3% -- replaced with /var/log/ceph/ceph-client.admin.68377.log.gz 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.62389.log 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36318.log.gz 2024-09-17T03:49:02.435 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83805.log 2024-09-17T03:49:02.436 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63912.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62389.log.gz 2024-09-17T03:49:02.436 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.436 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61867.log 87.9% -- replaced with /var/log/ceph/ceph-client.admin.83805.log.gz 2024-09-17T03:49:02.436 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.436 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63912.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.89494.log 2024-09-17T03:49:02.436 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63912.log.gz 2024-09-17T03:49:02.436 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70718.log 2024-09-17T03:49:02.436 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61867.log.gz 2024-09-17T03:49:02.436 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62772.log 2024-09-17T03:49:02.436 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89494.log.gz 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93619.log 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.70718.log: /var/log/ceph/ceph-client.admin.62772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114556.log 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93619.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62772.log.gz 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70718.log.gz 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93619.log.gz 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.115325.log 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44440.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114556.log.gz 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92746.log 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115325.log.gz 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80883.log 2024-09-17T03:49:02.437 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44440.log.gz 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88818.log 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.80883.log: 0.0% 91.1% -- replaced with /var/log/ceph/ceph-client.admin.92746.log.gz 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64038.log 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.0.80883.log.gz 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62347.log 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94100.log 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88818.log.gz 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64038.log: gzip/var/log/ceph/ceph-client.admin.62347.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63996.log 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94100.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62347.log.gz 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64038.log.gz 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94100.log.gz 2024-09-17T03:49:02.438 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.103182.log 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58127.log 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63996.log: /var/log/ceph/ceph-client.admin.103182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94613.log 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58127.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63996.log.gz 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103182.log.gz 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106370.log 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62773.log 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58127.log.gz 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94613.log: /var/log/ceph/ceph-client.admin.106370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103671.log 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94613.log.gz 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106370.log.gz 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62773.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62773.log.gz 2024-09-17T03:49:02.439 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69182.log 2024-09-17T03:49:02.440 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103671.log: gzip -5 --verbose -- 87.1% -- replaced with /var/log/ceph/ceph-client.admin.103671.log.gz 2024-09-17T03:49:02.440 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.103978.log 2024-09-17T03:49:02.440 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69182.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69182.log.gz 2024-09-17T03:49:02.440 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.115156.log 2024-09-17T03:49:02.440 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103978.log: gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.56536.log 2024-09-17T03:49:02.440 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103978.log.gz 2024-09-17T03:49:02.440 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111632.log 2024-09-17T03:49:02.440 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115156.log.gz 2024-09-17T03:49:02.440 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103098.log 2024-09-17T03:49:02.440 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56536.log: /var/log/ceph/ceph-client.admin.111632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106803.log 2024-09-17T03:49:02.440 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103098.log: 87.6% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56536.log.gz 2024-09-17T03:49:02.441 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.111632.log.gz 2024-09-17T03:49:02.441 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103098.log.gz 2024-09-17T03:49:02.441 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95088.log 2024-09-17T03:49:02.441 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57666.log 2024-09-17T03:49:02.441 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9%/var/log/ceph/ceph-client.admin.95088.log: -- replaced with /var/log/ceph/ceph-client.admin.106803.log.gz 2024-09-17T03:49:02.441 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56806.log 2024-09-17T03:49:02.441 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61741.log 2024-09-17T03:49:02.441 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.95088.log.gz 2024-09-17T03:49:02.441 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57666.log: /var/log/ceph/ceph-client.admin.56806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47268.log 2024-09-17T03:49:02.441 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56806.log.gz 2024-09-17T03:49:02.441 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61741.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57666.log.gz 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61741.log.gz 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55548.log 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87554.log 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4%/var/log/ceph/ceph-client.admin.55548.log: -- replaced with /var/log/ceph/ceph-client.admin.47268.log.gz 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98939.log 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55548.log.gz 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80461.log 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87554.log: /var/log/ceph/ceph-client.admin.98939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99934.log 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98939.log.gz 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80461.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87554.log.gz 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80461.log.gz 2024-09-17T03:49:02.442 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55412.log 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65757.log 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71258.log 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.99934.log.gz 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55412.log.gz 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43726.log 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83531.log 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65757.log.gz 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112348.log 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43726.log: -- replaced with /var/log/ceph/ceph-client.admin.71258.log.gz 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105440.log 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43726.log.gz 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83531.log: /var/log/ceph/ceph-client.0.112348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112348.log.gz 2024-09-17T03:49:02.443 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83531.log.gz 2024-09-17T03:49:02.444 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78949.log 2024-09-17T03:49:02.444 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103627.log 2024-09-17T03:49:02.444 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7%/var/log/ceph/ceph-client.admin.78949.log: -- replaced with /var/log/ceph/ceph-client.admin.105440.log.gz 2024-09-17T03:49:02.444 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56848.log 2024-09-17T03:49:02.444 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78949.log.gz 2024-09-17T03:49:02.444 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114093.log 2024-09-17T03:49:02.444 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103627.log: /var/log/ceph/ceph-client.admin.56848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67787.log 2024-09-17T03:49:02.444 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114093.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103627.log.gz 2024-09-17T03:49:02.444 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56848.log.gz 2024-09-17T03:49:02.444 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 87.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.114093.log.gz -- 2024-09-17T03:49:02.444 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.2.46001.log 2024-09-17T03:49:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101902.log 2024-09-17T03:49:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67787.log: /var/log/ceph/ceph-client.2.46001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79652.log 2024-09-17T03:49:02.445 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46001.log.gz 2024-09-17T03:49:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.101902.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67787.log.gz 2024-09-17T03:49:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101902.log.gz 2024-09-17T03:49:02.445 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.102972.log 2024-09-17T03:49:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.79652.log: gzip -5 --verbose 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79652.log.gz 2024-09-17T03:49:02.445 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.101944.log 2024-09-17T03:49:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46222.log 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102972.log.gz 2024-09-17T03:49:02.445 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.445 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.101944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106197.log 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101944.log.gz 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43474.log 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46222.log.gz 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71017.log 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106197.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83006.log 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106197.log.gz 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43474.log: /var/log/ceph/ceph-client.admin.71017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103140.log 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43474.log.gz 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71017.log.gz 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83006.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.83006.log.gz 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92410.log 2024-09-17T03:49:02.446 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.103140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46180.log 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103140.log.gz 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108870.log 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92410.log.gz 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60724.log 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46180.log: /var/log/ceph/ceph-client.admin.108870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61148.log 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60724.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46180.log.gz 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108870.log.gz 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79117.log 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60724.log.gz 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56353.log 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61148.log: /var/log/ceph/ceph-client.admin.79117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113780.log 2024-09-17T03:49:02.447 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79117.log.gz 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61148.log.gz 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82682.log 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56353.log.gz 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104716.log 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.82682.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56890.log 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113780.log.gz 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65128.log 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.82682.log.gz 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56890.log: 87.7% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56890.log.gz 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104716.log.gz 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111101.log 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114735.log 2024-09-17T03:49:02.448 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65128.log.gz 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44241.log 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111101.log.gz 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.114735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115198.log 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114735.log.gz 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104824.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44241.log.gz 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.115198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56932.log 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115198.log.gz 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55632.log 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68461.log 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.104824.log.gz 2024-09-17T03:49:02.449 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56932.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79431.log 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83489.log 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68461.log: /var/log/ceph/ceph-client.admin.79431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56452.log 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55632.log.gz 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83489.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79431.log.gz 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.68461.log.gz 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43906.log 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83489.log.gz 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60850.log 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56452.log.gzgzip 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.98760.log 2024-09-17T03:49:02.450 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43906.log: /var/log/ceph/ceph-client.admin.60850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92878.log 2024-09-17T03:49:02.451 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98760.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43906.log.gz 2024-09-17T03:49:02.451 INFO:teuthology.orchestra.run.smithi146.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60850.log.gz 2024-09-17T03:49:02.451 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112160.log 2024-09-17T03:49:02.451 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98760.log.gz 2024-09-17T03:49:02.451 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65877.log 2024-09-17T03:49:02.451 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61363.log 2024-09-17T03:49:02.451 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112160.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92878.log.gz 2024-09-17T03:49:02.451 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112160.log.gz 2024-09-17T03:49:02.451 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59542.log 2024-09-17T03:49:02.451 INFO:teuthology.orchestra.run.smithi146.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.65877.log.gz 2024-09-17T03:49:02.451 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.61363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36290.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61363.log.gz 2024-09-17T03:49:02.452 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.452 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87470.log 2024-09-17T03:49:02.452 INFO:teuthology.orchestra.run.smithi146.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59542.log.gz 2024-09-17T03:49:02.452 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36290.log.gz 2024-09-17T03:49:02.452 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36487.log 2024-09-17T03:49:02.452 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83889.log 2024-09-17T03:49:02.452 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8%/var/log/ceph/ceph-client.admin.36487.log: -- replaced with /var/log/ceph/ceph-client.admin.87470.log.gz 2024-09-17T03:49:02.452 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.100188.log 2024-09-17T03:49:02.452 INFO:teuthology.orchestra.run.smithi146.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.36487.log.gz 2024-09-17T03:49:02.452 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45563.log 2024-09-17T03:49:02.452 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83889.log: /var/log/ceph/ceph-client.0.100188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58495.log 2024-09-17T03:49:02.453 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.100188.log.gz 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83889.log.gz 2024-09-17T03:49:02.453 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.453 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.45563.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106155.log 2024-09-17T03:49:02.453 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.0.45563.log.gz 2024-09-17T03:49:02.453 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64633.log 2024-09-17T03:49:02.453 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43905.log 2024-09-17T03:49:02.453 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106155.log: /var/log/ceph/ceph-client.admin.64633.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58495.log.gz 2024-09-17T03:49:02.453 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106155.log.gz 2024-09-17T03:49:02.453 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64633.log.gz 2024-09-17T03:49:02.453 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109160.log 2024-09-17T03:49:02.453 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48286.log 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109160.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43905.log.gz 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71300.log 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109160.log.gz 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106719.log 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90310.log 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48286.log.gz/var/log/ceph/ceph-client.admin.71300.log: 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106719.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71300.log.gz 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr:gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.106719.log.gz 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58693.log 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.90310.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109721.log 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90310.log.gz 2024-09-17T03:49:02.454 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58561.log 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44569.log 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109721.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58693.log.gz/var/log/ceph/ceph-client.admin.58561.log: 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109721.log.gz 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99143.log 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44569.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58561.log.gz 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56760.log 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44569.log.gz 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68503.log 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69057.log 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56760.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99143.log.gz 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66578.log 2024-09-17T03:49:02.455 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56760.log.gz 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69057.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95154.log 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68503.log.gz 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.66578.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80545.log 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69057.log.gz 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66578.log.gz/var/log/ceph/ceph-client.admin.95154.log: 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102418.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95154.log.gz 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80545.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.87128.log 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80545.log.gz 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60987.log 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102418.log.gz 2024-09-17T03:49:02.456 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87128.log: /var/log/ceph/ceph-client.admin.60987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98424.log 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48328.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60987.log.gz 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz 90.9% 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108950.log 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87128.log.gz 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.98424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111459.log 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98424.log.gz 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109763.log 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108950.log.gz 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65338.log 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111459.log: /var/log/ceph/ceph-client.admin.109763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60598.log 2024-09-17T03:49:02.457 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111459.log.gz 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109763.log.gz 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.65338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44860.log 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.60598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63641.log 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44860.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60598.log.gz 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65338.log.gz 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58867.log 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44860.log.gz 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60411.log 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63641.log.gz 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93745.log 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58867.log: /var/log/ceph/ceph-client.admin.60411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99366.log 2024-09-17T03:49:02.458 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8%/var/log/ceph/ceph-client.admin.93745.log: -- replaced with /var/log/ceph/ceph-client.admin.60411.log.gz 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93745.log.gz 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58867.log.gz 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109385.log 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99366.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99366.log.gz 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.62305.log 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90034.log 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109385.log.gz 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.62305.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.99229.log 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62305.log.gz 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.90034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59880.log 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90034.log.gz 2024-09-17T03:49:02.459 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106551.log 2024-09-17T03:49:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99229.log: /var/log/ceph/ceph-client.admin.59880.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99229.log.gz 2024-09-17T03:49:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80629.log 2024-09-17T03:49:02.460 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108108.log 2024-09-17T03:49:02.460 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59880.log.gz/var/log/ceph/ceph-client.admin.106551.log: 2024-09-17T03:49:02.460 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106551.log.gz 2024-09-17T03:49:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58627.log 2024-09-17T03:49:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55884.log 2024-09-17T03:49:02.460 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1%/var/log/ceph/ceph-client.admin.58627.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108108.log.gz 2024-09-17T03:49:02.460 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80629.log.gz 2024-09-17T03:49:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93028.log 2024-09-17T03:49:02.460 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9%/var/log/ceph/ceph-client.admin.55884.log: -- replaced with /var/log/ceph/ceph-client.admin.58627.log.gz 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36837.log 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55884.log.gz 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92620.log 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93028.log: gzip/var/log/ceph/ceph-client.admin.36837.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36837.log.gz 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92620.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.93028.log.gz 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80377.log 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44235.log: gzip 87.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.92620.log.gz -- 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.89992.log 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56094.log 2024-09-17T03:49:02.461 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80377.log: /var/log/ceph/ceph-client.admin.89992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92812.log 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0%/var/log/ceph/ceph-client.admin.56094.log: -- replaced with /var/log/ceph/ceph-client.admin.80377.log.gz 86.9% -- replaced with /var/log/ceph/ceph-client.admin.89992.log.gz 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56094.log.gz 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47866.log 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44575.log 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111716.log 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.92812.log.gz 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47866.log.gz 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107721.log 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44575.log: /var/log/ceph/ceph-client.admin.111716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70855.log 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3%/var/log/ceph/ceph-client.admin.107721.log: -- replaced with /var/log/ceph/ceph-client.admin.44575.log.gz 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111716.log.gz 2024-09-17T03:49:02.462 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59230.log 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.107721.log.gz/var/log/ceph/ceph-client.admin.70855.log: 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71725.log 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70855.log.gz 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43642.log 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47992.log 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.43642.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59230.log.gz 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71725.log.gz 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98508.log 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43642.log.gz 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108775.log 2024-09-17T03:49:02.463 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47992.log: /var/log/ceph/ceph-client.admin.98508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111161.log 2024-09-17T03:49:02.464 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47992.log.gz 2024-09-17T03:49:02.464 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98508.log.gz 2024-09-17T03:49:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.108775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112696.log 2024-09-17T03:49:02.464 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108775.log.gz 2024-09-17T03:49:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.111161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71101.log 2024-09-17T03:49:02.464 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111161.log.gz 2024-09-17T03:49:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.112696.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112696.log.gz 2024-09-17T03:49:02.464 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.78367.log 2024-09-17T03:49:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97941.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71101.log.gz 2024-09-17T03:49:02.464 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.464 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.78367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113211.log 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97941.log: gzip 90.9% -- replaced with /var/log/ceph/ceph-client.admin.78367.log.gz -5 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60107.log 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97941.log.gz 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72187.log 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113211.log: /var/log/ceph/ceph-client.admin.60107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62227.log 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60107.log.gz 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.113211.log.gz 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.72187.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.72187.log.gz 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87512.log 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.62227.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.0.62227.log.gz 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr: --verbose -- /var/log/ceph/ceph-client.admin.87428.log 2024-09-17T03:49:02.465 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87512.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87512.log.gz 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr: /var/log/ceph/ceph-client.admin.55227.log 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63252.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87428.log.gz 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69637.log 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.63252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94016.log 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55227.log.gz 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63252.log.gz 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47822.log 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69637.log: /var/log/ceph/ceph-client.admin.94016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48118.log 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69637.log.gz 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94016.log.gz 2024-09-17T03:49:02.466 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99324.log 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36597.log 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47822.log.gz/var/log/ceph/ceph-client.admin.48118.log: 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99324.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48118.log.gzgzip -5 --verbose 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99324.log.gz 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr: -- /var/log/ceph/ceph-client.admin.94058.log 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92344.log 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36597.log.gz 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.94058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88547.log 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94058.log.gz 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68761.log 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112854.log 2024-09-17T03:49:02.467 INFO:teuthology.orchestra.run.smithi146.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.92344.log.gz 2024-09-17T03:49:02.468 INFO:teuthology.orchestra.run.smithi146.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88547.log.gz 2024-09-17T03:49:02.468 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.68761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68761.log.gz 2024-09-17T03:49:02.468 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107637.log 2024-09-17T03:49:02.468 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5/var/log/ceph/ceph-client.admin.112854.log: --verbose -- /var/log/ceph/ceph-client.admin.44578.log 2024-09-17T03:49:02.468 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.107637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93974.log 2024-09-17T03:49:02.468 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112854.log.gz 2024-09-17T03:49:02.468 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106017.log 2024-09-17T03:49:02.468 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.44578.log: /var/log/ceph/ceph-client.admin.93974.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.107637.log.gz 2024-09-17T03:49:02.468 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44578.log.gz 87.0% -- replaced with /var/log/ceph/ceph-client.admin.93974.log.gz 2024-09-17T03:49:02.468 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.468 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99892.log 2024-09-17T03:49:02.469 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110788.log 2024-09-17T03:49:02.469 INFO:teuthology.orchestra.run.smithi146.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106017.log.gz 2024-09-17T03:49:02.469 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102105.log 2024-09-17T03:49:02.469 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.99892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68209.log 2024-09-17T03:49:02.469 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99892.log.gz/var/log/ceph/ceph-client.admin.110788.log: 2024-09-17T03:49:02.469 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102105.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110788.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44239.log 2024-09-17T03:49:02.469 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.469 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.68209.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.102105.log.gz 2024-09-17T03:49:02.469 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89866.log 2024-09-17T03:49:02.469 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68209.log.gz 2024-09-17T03:49:02.469 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.44239.log: -- /var/log/ceph/ceph-client.admin.97609.log 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.89866.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44239.log.gz 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92278.log 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89866.log.gz 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47100.log 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97609.log: /var/log/ceph/ceph-client.admin.92278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109679.log 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47100.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97609.log.gz 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr: 87.6% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47100.log.gz -- replaced with /var/log/ceph/ceph-client.admin.92278.log.gz 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42966.log 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.109679.log: -- /var/log/ceph/ceph-client.admin.65212.log 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109679.log.gz 2024-09-17T03:49:02.470 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59495.log 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.42966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106239.log 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0%/var/log/ceph/ceph-client.admin.65212.log: -- replaced with /var/log/ceph/ceph-client.admin.42966.log.gz 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.59495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71145.log 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65212.log.gz 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.106239.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80037.log 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59495.log.gz 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106239.log.gz 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71145.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.80037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56273.log 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.71145.log.gz 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80037.log.gz 2024-09-17T03:49:02.471 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47184.log 2024-09-17T03:49:02.472 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93262.log 2024-09-17T03:49:02.472 INFO:teuthology.orchestra.run.smithi146.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56273.log.gz 2024-09-17T03:49:02.472 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97357.log 2024-09-17T03:49:02.472 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.93262.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47184.log.gz 2024-09-17T03:49:02.472 INFO:teuthology.orchestra.run.smithi146.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.93262.log.gz 2024-09-17T03:49:02.472 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64423.log 2024-09-17T03:49:02.472 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.97357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36428.log 2024-09-17T03:49:02.472 INFO:teuthology.orchestra.run.smithi146.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.97357.log.gz 2024-09-17T03:49:02.472 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.64423.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64423.log.gz 2024-09-17T03:49:02.472 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T03:49:02.472 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.36428.log: 75.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57863.log 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36428.log.gz 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107271.log 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.57863.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57863.log.gz 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55077.log 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.107271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.107271.log.gz 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45070.log 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.55077.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55077.log.gz 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102170.log 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45070.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45070.log.gz 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57268.log 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.102170.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.102170.log.gz 2024-09-17T03:49:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58967.log 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.57268.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57268.log.gz 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68757.log 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.58967.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58967.log.gz 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87746.log 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.68757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68757.log.gz 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92578.log 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.87746.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.87746.log.gz 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113822.log 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92578.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.92578.log.gz 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83931.log 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.113822.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113822.log.gz 2024-09-17T03:49:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56494.log 2024-09-17T03:49:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.83931.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83931.log.gz 2024-09-17T03:49:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92704.log 2024-09-17T03:49:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.56494.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56494.log.gz 2024-09-17T03:49:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104062.log 2024-09-17T03:49:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.92704.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92704.log.gz 2024-09-17T03:49:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71598.log 2024-09-17T03:49:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.104062.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.104062.log.gz 2024-09-17T03:49:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88369.log 2024-09-17T03:49:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71598.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71598.log.gz 2024-09-17T03:49:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46890.log 2024-09-17T03:49:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.88369.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88369.log.gz 2024-09-17T03:49:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67444.log 2024-09-17T03:49:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46890.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46890.log.gz 2024-09-17T03:49:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69181.log 2024-09-17T03:49:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67444.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67444.log.gz 2024-09-17T03:49:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105230.log 2024-09-17T03:49:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.69181.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69181.log.gz 2024-09-17T03:49:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109204.log 2024-09-17T03:49:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105230.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105230.log.gz 2024-09-17T03:49:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46005.log 2024-09-17T03:49:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.109204.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109204.log.gz 2024-09-17T03:49:02.476 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105356.log 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.2.46005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46005.log.gz 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45697.log 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.105356.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105356.log.gz 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71189.log 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.45697.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45697.log.gz 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71682.log 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71189.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71189.log.gz 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47640.log 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.71682.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71682.log.gz 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48832.log 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.47640.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47640.log.gz 2024-09-17T03:49:02.477 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78499.log 2024-09-17T03:49:02.478 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.48832.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48832.log.gz 2024-09-17T03:49:02.478 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112352.log 2024-09-17T03:49:02.478 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.78499.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.78499.log.gz 2024-09-17T03:49:02.478 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46390.log 2024-09-17T03:49:02.478 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.0.112352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112352.log.gz 2024-09-17T03:49:02.478 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67047.log 2024-09-17T03:49:02.478 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.46390.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46390.log.gz 2024-09-17T03:49:02.478 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.67047.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67047.log.gz 2024-09-17T03:49:02.479 INFO:teuthology.orchestra.run.smithi179.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T03:49:02.590 INFO:teuthology.orchestra.run.smithi179.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T03:49:03.396 INFO:teuthology.orchestra.run.smithi146.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T03:49:03.757 INFO:teuthology.orchestra.run.smithi179.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T03:49:03.980 INFO:teuthology.orchestra.run.smithi179.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T03:49:04.194 INFO:teuthology.orchestra.run.smithi179.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T03:49:04.436 INFO:teuthology.orchestra.run.smithi179.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T03:49:04.578 INFO:teuthology.orchestra.run.smithi146.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T03:49:04.779 INFO:teuthology.orchestra.run.smithi146.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T03:49:04.783 INFO:teuthology.orchestra.run.smithi146.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T03:49:05.122 INFO:teuthology.orchestra.run.smithi146.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T03:49:08.894 INFO:teuthology.orchestra.run.smithi146.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T03:49:23.911 INFO:teuthology.orchestra.run.smithi179.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T03:49:23.913 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-09-17T03:49:23.913 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m22.071s 2024-09-17T03:49:23.913 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m31.390s 2024-09-17T03:49:23.913 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m0.996s 2024-09-17T03:49:26.070 INFO:teuthology.orchestra.run.smithi146.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T03:49:26.072 INFO:teuthology.orchestra.run.smithi146.stderr: 2024-09-17T03:49:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m24.255s 2024-09-17T03:49:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m42.465s 2024-09-17T03:49:26.072 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m2.044s 2024-09-17T03:49:26.073 INFO:tasks.ceph:Archiving logs... 2024-09-17T03:49:26.073 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445/remote/smithi146/log 2024-09-17T03:49:26.074 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T03:49:32.500 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445/remote/smithi179/log 2024-09-17T03:49:32.501 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T03:49:36.753 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T03:49:36.762 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T03:49:36.762 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T03:49:36.765 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T03:49:36.846 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T03:49:36.854 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T03:49:36.855 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:49:36.858 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:49:36.872 INFO:teuthology.orchestra.run.smithi146.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:49:36.874 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:49:36.877 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:49:36.877 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2024-09-17T03:49:36.878 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +1781us[+1786us] +/- 49ms 2024-09-17T03:49:36.878 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 64 -94us[ -89us] +/- 80ms 2024-09-17T03:49:36.878 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 63 -3184us[-3179us] +/- 86ms 2024-09-17T03:49:36.878 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:49:36.879 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:49:36.879 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-09-17T03:49:36.879 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 +1831us[+1749us] +/- 49ms 2024-09-17T03:49:36.879 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 -56us[ -139us] +/- 80ms 2024-09-17T03:49:36.879 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 0 -3136us[-3136us] +/- 87ms 2024-09-17T03:49:36.880 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:49:36.880 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T03:49:36.889 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T03:49:36.889 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T03:49:36.897 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T03:49:37.019 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T03:49:37.092 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:49:37.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:49:37.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:49:37.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:49:37.154 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T03:49:37.163 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T03:49:37.172 INFO:teuthology.task.internal:Duration was 1397.375684 seconds 2024-09-17T03:49:37.173 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T03:49:37.181 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T03:49:37.181 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T03:49:37.184 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T03:49:37.222 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:49:37.234 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:49:37.558 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T03:49:37.558 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2024-09-17T03:49:37.558 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T03:49:37.619 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T03:49:37.619 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T03:49:37.643 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T03:49:37.643 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T03:49:37.661 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T03:49:37.709 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T03:49:37.710 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T03:49:37.729 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T03:49:37.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T03:49:37.887 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T03:49:37.887 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T03:49:37.912 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T03:49:37.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T03:49:37.950 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:49:37.954 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:49:37.975 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2024-09-17T03:49:38.001 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-09-17T03:49:38.014 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:49:38.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:49:38.043 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:49:38.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:49:38.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T03:49:38.080 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T03:49:38.080 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445/remote/smithi146 2024-09-17T03:49:38.081 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T03:49:38.122 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908445/remote/smithi179 2024-09-17T03:49:38.122 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T03:49:38.157 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T03:49:38.157 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T03:49:38.159 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T03:49:38.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T03:49:38.218 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T03:49:38.218 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T03:49:38.227 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T03:49:38.228 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T03:49:38.230 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T03:49:38.242 INFO:teuthology.orchestra.run.smithi146.stdout: 265977 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 03:49 /home/ubuntu/cephtest 2024-09-17T03:49:38.262 INFO:teuthology.orchestra.run.smithi179.stdout: 265822 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 03:49 /home/ubuntu/cephtest 2024-09-17T03:49:38.263 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T03:49:38.273 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T03:49:38.296 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/scrub} duration: 1397.3756840229034 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-17T03:49:38.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T03:49:38.379 INFO:teuthology.run:pass